-- Logs begin at Sat 2022-07-23 20:01:16 UTC, end at Sat 2022-07-23 22:43:45 UTC. -- Jul 23 21:02:26.810409 ncdv-master-1 systemd[1]: Starting Devstack devstack@n-api.service... Jul 23 21:02:26.820187 ncdv-master-1 devstack@n-api.service[115445]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 23 21:02:26.824275 ncdv-master-1 devstack@n-api.service[115445]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Jul 23 21:02:26 2022] *** Jul 23 21:02:26.824275 ncdv-master-1 devstack@n-api.service[115445]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 23 21:02:26.824275 ncdv-master-1 devstack@n-api.service[115445]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 23 21:02:26.824275 ncdv-master-1 devstack@n-api.service[115445]: nodename: ncdv-master-1 Jul 23 21:02:26.824275 ncdv-master-1 devstack@n-api.service[115445]: machine: x86_64 Jul 23 21:02:26.824275 ncdv-master-1 devstack@n-api.service[115445]: clock source: unix Jul 23 21:02:26.824275 ncdv-master-1 devstack@n-api.service[115445]: pcre jit disabled Jul 23 21:02:26.824275 ncdv-master-1 devstack@n-api.service[115445]: detected number of CPU cores: 4 Jul 23 21:02:26.824275 ncdv-master-1 devstack@n-api.service[115445]: current working directory: / Jul 23 21:02:26.824275 ncdv-master-1 devstack@n-api.service[115445]: detected binary path: /usr/bin/uwsgi-core Jul 23 21:02:26.824275 ncdv-master-1 devstack@n-api.service[115445]: your processes number limit is 47680 Jul 23 21:02:26.824275 ncdv-master-1 devstack@n-api.service[115445]: your memory page size is 4096 bytes Jul 23 21:02:26.824275 ncdv-master-1 devstack@n-api.service[115445]: detected max file descriptor number: 2048 Jul 23 21:02:26.824275 ncdv-master-1 devstack@n-api.service[115445]: lock engine: pthread robust mutexes Jul 23 21:02:26.824275 ncdv-master-1 devstack@n-api.service[115445]: thunder lock: enabled Jul 23 21:02:26.824275 ncdv-master-1 devstack@n-api.service[115445]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 23 21:02:26.824275 ncdv-master-1 devstack@n-api.service[115445]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 23 21:02:26.870224 ncdv-master-1 devstack@n-api.service[115445]: Python main interpreter initialized at 0x5643b62df9c0 Jul 23 21:02:26.870224 ncdv-master-1 devstack@n-api.service[115445]: python threads support enabled Jul 23 21:02:26.870224 ncdv-master-1 devstack@n-api.service[115445]: your server socket listen backlog is limited to 100 connections Jul 23 21:02:26.870224 ncdv-master-1 devstack@n-api.service[115445]: your mercy for graceful operations on workers is 90 seconds Jul 23 21:02:26.870633 ncdv-master-1 devstack@n-api.service[115445]: mapped 403077 bytes (393 KB) for 2 cores Jul 23 21:02:26.870715 ncdv-master-1 devstack@n-api.service[115445]: *** Operational MODE: preforking *** Jul 23 21:02:26.870923 ncdv-master-1 devstack@n-api.service[115445]: *** uWSGI is running in multiple interpreter mode *** Jul 23 21:02:26.870923 ncdv-master-1 devstack@n-api.service[115445]: spawned uWSGI master process (pid: 115445) Jul 23 21:02:26.871149 ncdv-master-1 systemd[1]: Started Devstack devstack@n-api.service. Jul 23 21:02:26.871939 ncdv-master-1 devstack@n-api.service[115445]: spawned uWSGI worker 1 (pid: 115446, cores: 1) Jul 23 21:02:26.872388 ncdv-master-1 devstack@n-api.service[115445]: spawned uWSGI worker 2 (pid: 115447, cores: 1) Jul 23 21:02:26.872388 ncdv-master-1 devstack@n-api.service[115445]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 23 21:02:28.140654 ncdv-master-1 devstack@n-api.service[115447]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 23 21:02:28.141880 ncdv-master-1 devstack@n-api.service[115446]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 23 21:02:28.820290 ncdv-master-1 devstack@n-api.service[115446]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 23 21:02:28.820290 ncdv-master-1 devstack@n-api.service[115446]: from cryptography.utils import int_from_bytes Jul 23 21:02:28.820521 ncdv-master-1 devstack@n-api.service[115447]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 23 21:02:28.820521 ncdv-master-1 devstack@n-api.service[115447]: from cryptography.utils import int_from_bytes Jul 23 21:02:28.820657 ncdv-master-1 devstack@n-api.service[115446]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 23 21:02:28.820657 ncdv-master-1 devstack@n-api.service[115446]: from cryptography.utils import int_from_bytes Jul 23 21:02:28.820774 ncdv-master-1 devstack@n-api.service[115447]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 23 21:02:28.820774 ncdv-master-1 devstack@n-api.service[115447]: from cryptography.utils import int_from_bytes Jul 23 21:02:31.399359 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 23 21:02:31.400306 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 23 21:02:31.400306 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 23 21:02:31.400940 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 23 21:02:31.401033 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 23 21:02:31.401118 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 23 21:02:31.401253 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 23 21:02:31.401444 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 23 21:02:31.401561 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 23 21:02:31.401654 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 23 21:02:31.401766 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.401929 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.402018 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.402110 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.402188 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.402305 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.402423 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.402562 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.402683 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.402766 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.402849 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.402922 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.402994 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.403065 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.403341 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.403505 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.403655 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.403809 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.403952 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.404125 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.404276 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.404429 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.404581 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.404726 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.404871 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.405035 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.405190 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.405338 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.405489 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.405644 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.405793 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.406004 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.406144 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.406284 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.406436 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.406588 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.406734 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.406991 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.407160 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.407397 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.407397 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.407785 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.408100 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.408281 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.408466 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.408653 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.408830 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.409211 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.409583 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.409782 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.409993 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.410206 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.410356 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.410518 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.410668 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.410810 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.410962 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.411116 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.411281 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.411432 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.411585 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.411757 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.411970 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.412162 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.412328 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.412480 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.412619 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.412780 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.413000 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.413223 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.413381 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.413546 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.413698 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.413836 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.414005 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.414145 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.414312 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.414527 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.414750 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.414903 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.415115 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.415272 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.415435 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.415590 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.415798 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.416015 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.416194 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.416373 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.416533 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.416747 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.416912 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.417037 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.417233 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.417426 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.417580 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.417753 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.418000 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.418185 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.418334 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.418334 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.418664 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.418863 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.419027 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.419178 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.419334 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.419457 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.419620 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.419817 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.419817 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.420094 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.420265 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.420265 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.420494 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.420494 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.420706 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.420832 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.421011 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.421011 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.421296 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.421429 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.421553 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.421649 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.421763 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.421853 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.422053 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.422203 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.422318 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.422430 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.422544 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.422656 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.422807 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.422965 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.423130 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.423290 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.423439 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.423596 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.423746 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.423891 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.424056 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.424212 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.424361 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.424505 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.424721 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.424887 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.425045 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.425189 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.425310 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.425449 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.425603 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.425750 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.425942 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.426077 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.426235 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.426373 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.426515 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.426630 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.426790 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.426929 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.427083 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.427244 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.427447 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.427608 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.427762 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.427925 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.428085 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.428231 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.428385 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.428547 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.428693 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.428851 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.428851 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.429135 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.429284 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.429447 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.429584 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.429734 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.429734 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.430104 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.430104 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.430376 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.430506 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.430639 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.430737 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.430807 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.430940 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.431085 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.431213 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.431343 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.431508 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.431650 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.431842 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.432055 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.432210 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.432411 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.432545 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.432765 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.432961 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.433144 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.433318 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.433519 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.433701 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.433853 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.434130 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.434314 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.434466 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.434686 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.434880 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.435044 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.435383 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.435535 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.435714 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.435860 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.435956 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.436179 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.436352 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.436532 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.436714 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.436943 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.437150 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.437297 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.437467 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.437649 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.437843 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.438045 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.438160 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.438323 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.438529 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.438706 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.438923 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.439109 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.439285 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.439449 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.439610 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.439808 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.440001 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.440147 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.440476 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.440684 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.440862 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.441030 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.441212 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.441403 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.441600 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.441748 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.441973 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.442129 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.442271 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.442430 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.442644 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.442811 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.442954 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.443078 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.443207 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.443355 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.443501 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.443661 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.443812 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.443969 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.444107 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.444285 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.444456 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.444613 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.444749 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.444889 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.445076 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.445181 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.445275 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.445370 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.445452 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.445608 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.445753 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.445954 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.446127 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.446271 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.446469 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.446594 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:02:31.446753 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.447028 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.447176 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.447296 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.447388 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.447532 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.447660 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.447830 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.447968 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.448126 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.448287 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.448450 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.448589 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.448798 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.448952 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.449093 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.449236 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.449391 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.449538 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.449690 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.449848 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.450037 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.450179 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.450322 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.450473 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.450626 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.450770 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.450959 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.451120 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.451263 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.451413 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.451518 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.451657 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.451864 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.452013 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.452130 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.452212 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.452291 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.452431 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.452517 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.452698 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.452839 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.452935 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.453068 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.453221 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.453378 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.453527 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.453633 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.453802 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.454069 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.454217 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.454346 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.454443 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.454605 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.454749 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.454878 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.454984 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.455063 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.455132 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.455197 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.455272 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.455366 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.455484 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.455600 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.455789 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.456136 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.456282 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.456403 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.456510 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.456598 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.456757 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.456877 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.457039 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.457187 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.457333 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.457449 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.457528 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.457606 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.457727 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.457835 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.457981 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.458063 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.458189 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.458326 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.458439 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.458675 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.458850 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.458994 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.459145 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.459286 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.459404 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.459527 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.459662 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.459662 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.460004 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.460179 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.460320 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.460487 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.460623 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.460877 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.461118 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.461118 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.461494 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.461685 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.461956 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.462139 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.462351 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.462536 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.462711 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.462892 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.463071 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.463250 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.463445 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.463630 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.463825 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.464015 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.464210 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.464400 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.464572 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.464763 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.464951 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.465127 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.465305 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.465498 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.465673 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.465851 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.466072 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.466266 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.466448 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.466658 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.466840 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.467031 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.467206 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.467387 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.467573 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.467761 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.467918 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.468086 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.468276 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.468452 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.468642 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.468818 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.469002 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.469181 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.469363 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.469553 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.469755 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.469932 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.470068 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.470214 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.470473 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.470616 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.470791 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.470935 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.471080 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.471235 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.471359 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.471686 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.471835 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.471976 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.472121 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.472285 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.472437 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.472593 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.472730 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.472878 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.473016 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.473016 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.473266 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.473430 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.473577 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.473730 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.473920 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.474062 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.474216 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.474374 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.474599 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.474786 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.474933 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.474933 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.475211 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.475354 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.475500 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.475642 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.475845 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.476032 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.476223 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.476403 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.476553 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.476710 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.476853 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.476991 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.477151 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.477304 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.477460 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.477619 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.477770 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.477770 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.478086 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.478086 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.478359 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.478500 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.478662 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.478814 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.478952 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.479105 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.479246 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.479409 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.479562 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.479717 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.479859 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.480002 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.480143 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.480290 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.480432 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.480597 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.480741 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.480887 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.481037 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.481180 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.481327 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.481493 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.481641 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.481788 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.482027 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.482176 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.482315 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.482475 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.482629 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.482782 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.482935 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.483095 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.483251 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.483390 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.483548 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.483704 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.483845 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.483987 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.484154 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.484298 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.484443 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.484584 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.484726 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.484868 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.485024 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.485168 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.485310 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.485451 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.485592 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.485592 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.486008 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.486215 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.486395 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.486575 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.486723 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.486882 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.487037 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.487281 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.487428 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.487571 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.487713 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.487869 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.488026 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.488174 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.488328 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.488470 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.488616 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.488774 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.488933 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.489078 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.489231 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.489383 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.489525 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.489680 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.489822 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.490085 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.490229 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.490387 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.490531 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.490686 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.490828 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.490968 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.491106 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.491264 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.491431 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.491578 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.491722 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.491867 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.492025 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.492179 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.492338 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.492483 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.492613 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.492757 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.492906 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.493053 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.493219 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.493380 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.493536 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.493714 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.493851 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.494007 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.494188 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.494367 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.494518 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.494675 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.494852 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.495000 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.495171 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.495337 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.495487 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.495626 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.495794 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.495931 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.496091 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.496264 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.496404 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.496530 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.496654 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.496790 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.496915 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.497048 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.497170 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.497303 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.497427 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.497566 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.497695 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.497943 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.498122 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.498268 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.498466 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.498613 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.498613 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.498875 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.499060 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.499060 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.499348 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.499348 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.499625 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.499772 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.499951 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.500095 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.500261 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.500473 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.500608 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.500731 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.500854 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.501051 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.501252 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.501398 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.501575 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.501762 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.501932 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.502126 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.502281 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.502281 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.502601 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.502905 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.503050 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.503253 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.503397 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.503556 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.503690 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.503861 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.504033 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.504188 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.504390 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.504540 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.504682 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.504825 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.504966 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.505124 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.505286 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.505435 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.505616 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.505799 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.506085 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.506233 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.506411 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.506537 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.506778 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.506961 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.507203 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.507399 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.507544 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.507544 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.507798 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.507798 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.508062 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.508214 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.508335 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.508492 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.508590 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.508658 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.508781 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.508915 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.508915 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.509159 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.509301 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.509437 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.509517 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.509597 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.509751 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.509887 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.509973 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.510050 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.510128 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.510242 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.510339 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.510409 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.510480 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.510615 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.510756 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.510756 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.510897 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.511060 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.511220 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.511354 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.511495 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.511636 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.511783 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.511918 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.512053 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.512192 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.512343 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.512501 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.512660 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.512780 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.512851 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.512915 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.512989 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.513089 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.513233 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.513367 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.513477 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.513547 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.513623 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.513710 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.513794 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.513886 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.513973 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.515578 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.515745 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.515888 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.516038 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.516140 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.516262 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.516342 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.516437 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.516535 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.516651 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.516812 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.516959 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.517089 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.517254 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.517366 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.517440 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.517531 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.517704 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.517846 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.518059 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.518131 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.518131 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.518326 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.518505 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.518588 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.518684 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.518822 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.518924 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.518994 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.519068 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.519199 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.519331 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.519434 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.519571 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.519684 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.519769 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.519909 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.520068 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.520164 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.520233 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.520298 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.520363 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.520438 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.520558 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.520653 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.520723 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.520794 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.520870 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.520974 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.521121 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.521121 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.521277 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.521346 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.521427 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.521496 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.521626 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.521730 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.521799 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.522267 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.522395 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.522504 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.522582 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.522650 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.522769 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.522923 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.523067 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.523204 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.523386 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.523524 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.523703 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.523839 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.524008 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.524100 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.524206 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.524294 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.524362 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.524461 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.524549 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.524616 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.524681 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.524766 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.524950 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.525060 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.525253 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.525367 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.525558 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.525709 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.525849 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.526008 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.526185 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.526332 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.526488 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.526660 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.526784 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.526943 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.527082 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.527301 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.527418 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.527575 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.527800 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.527979 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.528116 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.528260 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.528435 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.528566 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.528763 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.528910 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.529078 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.529191 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.529262 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.529476 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.529652 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.529826 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.530015 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.530205 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.530350 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.530513 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.530687 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.530687 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.530972 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.531120 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.531258 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.531420 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.531514 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.531582 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.531648 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.531863 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.532007 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.532158 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.532312 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.532494 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.532599 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.532838 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.532988 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.533141 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.533336 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.533514 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.533605 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.533672 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.533855 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.534161 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.534314 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.534480 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.534570 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.534783 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.535000 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.535140 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.535275 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.535451 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.535614 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.535765 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.535865 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.536067 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.536164 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.536369 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.536518 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.536688 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.536825 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.536994 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.537095 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.537303 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.537456 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.537721 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.537925 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.538068 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.538213 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.538353 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.538487 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.538648 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.538793 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.538888 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.538971 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.539126 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.539271 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.539428 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.539574 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.539722 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.539870 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.540023 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.540167 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.540319 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.540461 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.540628 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.540781 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.540925 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.541080 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.541266 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.541416 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.541566 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.541711 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.541856 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.542067 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.542225 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.542364 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.542505 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.542647 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.542791 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.542955 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.543109 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.543248 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.543390 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.543529 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.543738 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.543903 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.544044 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.544280 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.544435 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.544576 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.544772 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.544933 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.545080 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.545223 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.545223 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.545446 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.545591 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.545745 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.546098 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.546248 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.546387 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.546552 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.546717 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.546879 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.547007 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.547139 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.547229 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.547312 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.547441 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.547584 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.547715 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.547868 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.547997 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.548385 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.548594 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.548594 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.548937 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.549112 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.549112 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.549488 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.549757 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.549991 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.550179 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.550374 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.550556 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.550761 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.550894 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.551028 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.551205 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.551385 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.551568 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.551738 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.551890 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.552050 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.552200 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.552526 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.552837 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.553145 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.553460 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.553619 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.553768 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.554039 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.554224 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.554375 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.554515 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.554678 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.554828 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.554989 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.555150 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.555385 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.555482 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.555627 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.555770 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.555911 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.556071 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.556314 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.556436 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.556625 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.556770 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.557026 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.557207 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.557354 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.557500 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.557649 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.557787 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.557964 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.558084 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.558479 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.558652 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.558770 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.558956 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.559113 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.559250 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.559412 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.559571 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.559714 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.559863 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.560012 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.560161 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.560321 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.560464 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.560617 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.560732 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.560816 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.560959 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.561126 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.561284 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.561395 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.561527 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.561675 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.561827 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.562133 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.562284 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.562431 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.562593 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.562746 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.562909 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.563054 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.563200 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.563322 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.563464 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.563613 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.563763 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.563914 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.564036 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.564195 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.564341 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.564489 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.564617 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.564777 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.564931 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.565069 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.565451 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.565632 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.565796 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.565996 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.566144 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.566289 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.566439 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.566592 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.566745 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.566895 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.567057 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.567215 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.567365 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.567539 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.567690 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.567833 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.567983 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.568191 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.568350 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.568535 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.568690 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.568843 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.569008 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.569155 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.569295 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.569456 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.569599 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.569747 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.569923 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.570112 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.570286 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.570437 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.570614 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.570746 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.570926 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.571067 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.571255 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.571442 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.571613 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.571766 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.571915 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.572063 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.572226 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.572365 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.572514 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.572664 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.572813 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.572968 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.573132 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.573255 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.573336 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.573469 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.573606 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.573764 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.574148 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.574318 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.574475 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.574590 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.574804 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.574976 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.575139 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.575290 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.575439 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.575589 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.575741 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.575959 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.576109 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.576256 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.576395 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.576541 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.576691 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.576822 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.576970 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.577112 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.577272 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.577415 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.577567 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.577714 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.577891 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.578095 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.578286 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.578490 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.578665 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.578810 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.578955 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.579084 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.579180 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.579322 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.579482 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.579623 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.579772 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.579881 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.580010 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.580169 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.580325 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.580446 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.580547 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.580684 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.580825 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.581071 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.581227 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.581385 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.581569 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.581709 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.581962 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.582169 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.582324 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.582515 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.582708 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.582860 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.583011 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.583011 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.583418 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.583566 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.583566 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.583862 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.584046 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.584320 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.584505 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.584645 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.584820 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.584973 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.585166 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.585342 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.585490 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.585623 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.585762 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.585936 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.586103 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.586239 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.586239 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.586401 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.586548 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.586694 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.586853 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.587004 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.587004 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.587277 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.587421 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.587569 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.587717 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.587855 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.588002 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.588163 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.588301 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.588526 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.588734 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.588942 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.589092 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.589250 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.589400 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.589562 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.589711 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.589887 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.590019 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.590203 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.590355 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.590649 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.590839 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.591024 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.591205 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.591355 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.591516 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.591660 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.591804 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.591960 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.592151 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.592151 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.592475 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.592662 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.592804 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.592982 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.593156 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.593320 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.593478 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.593624 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.593624 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.594075 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.594227 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.594499 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.594646 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.594791 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.594954 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.595100 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.595262 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.595415 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.595559 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.595704 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.595846 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.595987 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.596138 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.596276 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.596430 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.596724 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.596869 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.597015 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.597015 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.597291 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.597439 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.597579 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.597720 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.597910 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.598062 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.598228 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.598390 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.598549 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.598747 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.598956 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.599109 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.599252 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.599402 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.599591 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.599765 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.599958 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.600106 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.600285 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.600466 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.600649 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.600876 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.601046 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.601241 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.601389 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.601389 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.601667 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.601825 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.601993 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.602139 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.602287 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.602451 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.602604 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.602711 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.602868 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.602989 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.603080 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.603148 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.603214 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.603332 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.603502 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.603644 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.603788 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.603859 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.603928 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.604109 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.604260 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.604260 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.604484 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.604692 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.604866 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.605014 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.605154 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.605154 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.605414 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.605544 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.605544 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.605802 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.605938 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.606040 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.606128 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.606256 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.606402 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.606492 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.606561 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.606627 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.606701 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.606866 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.606957 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.607176 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.607362 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.607485 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.607618 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.607792 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.607894 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.608099 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.608203 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.608422 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.608564 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.608719 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.608852 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.609046 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.609145 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.609318 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.609445 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.609616 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.609752 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.609945 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.610072 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.610251 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.610417 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.610557 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.610686 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.610821 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.610958 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.611125 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.611290 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.611440 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.611567 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.611720 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.611851 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.612020 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.612256 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.612399 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.612541 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.612679 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.612826 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.612972 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.613135 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.613282 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.613411 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.613499 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.613568 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.613837 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.613997 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.614166 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.614318 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.614471 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.614563 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.614767 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.614856 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.615075 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.615214 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.615379 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.615469 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.615688 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.615832 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.616002 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.616141 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.616308 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.616469 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.616623 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.616776 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.616933 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.617075 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.617232 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.617519 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.617631 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.617855 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.617984 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.618191 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.618335 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.618600 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.618752 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.618898 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.619096 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.619278 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.619427 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.619586 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.619745 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.619891 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.620036 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.620184 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.620419 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.620581 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.620731 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.620875 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.621021 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.621164 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.621333 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.621482 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.621628 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.621779 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.621949 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.622087 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.622248 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.622392 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.622553 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.622681 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.622769 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.622878 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.623024 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.623146 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.623268 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.623393 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.623556 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.623703 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.623841 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.623973 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.624158 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.624300 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.624500 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.624661 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.624801 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.624993 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.625142 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.625284 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.625433 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.625569 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.625711 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.625801 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.626036 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.626135 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.626338 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.626463 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.626650 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.626786 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.626949 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.627040 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.627262 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.627351 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.627598 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.627832 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.628023 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.628176 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.628349 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.628497 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.628648 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.628799 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.628949 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.629062 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.629183 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.629280 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.629461 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.629565 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.629811 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.630039 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.630202 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.630351 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.630506 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.630660 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.630807 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.630974 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.631121 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.631262 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.631408 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.631552 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.631697 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.631855 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.632015 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.632161 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.632317 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.632463 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.632618 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.632766 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.632915 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.633071 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.633217 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.633363 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.633525 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.633670 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.633823 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.633991 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.634148 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.634296 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.634472 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.634620 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.634766 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.634913 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.635082 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.635254 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.635400 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.635544 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.635691 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.635834 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.635979 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.636155 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.636314 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.636459 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.636609 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.637238 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.637392 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.637566 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.637705 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.637783 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.637887 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.638023 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.638153 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.638334 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.638483 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.638636 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.638791 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.638936 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.639105 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.639250 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.639457 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.639638 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.639789 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.639947 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.640109 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.640266 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.640415 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.640561 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.640710 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.640861 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.641023 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.641186 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.641330 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.641475 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.641623 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.641774 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.641965 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.642112 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.642259 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.642387 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.642514 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.642686 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.642846 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.642997 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.643245 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.643448 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.643607 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.643807 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.643997 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.644145 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.644290 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.644433 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.644576 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.644743 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.644886 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.645032 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.645176 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.645321 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.645466 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.645621 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.645766 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.645938 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.646103 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.646261 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.646419 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.646566 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.646712 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.647470 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.647635 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.647782 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.648099 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.648257 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.648403 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.648550 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.648696 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.648894 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.649097 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.649291 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.649546 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.649753 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.650028 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.650230 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.650431 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.650575 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.650733 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.650879 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.651039 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.651203 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.651307 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.651393 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.651515 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.651674 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.651819 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.651977 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.652123 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.652267 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.652420 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.652562 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.652723 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.652723 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.652985 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.653141 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.653286 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.653433 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.653594 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.653739 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.653905 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.653905 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.654171 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.654171 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.654462 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.654462 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.654735 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.654875 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.655015 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.655164 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.655322 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.655467 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.655613 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.655613 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.655889 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.656048 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.656193 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.656337 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.656486 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.656647 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.656772 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.656859 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.656936 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.657013 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 23 21:02:31.657097 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.657097 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.657097 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.657097 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.657097 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.657589 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.657724 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.658053 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:02:31.658248 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 23 21:02:31.722590 ncdv-master-1 devstack@n-api.service[115446]: INFO dbcounter [None req-51ff65ae-7243-4c76-9a8e-0890cf6c8334 None None] Registered counter for database nova_api Jul 23 21:02:31.725813 ncdv-master-1 devstack@n-api.service[115447]: INFO dbcounter [None req-bcb25a4b-32f1-4e13-b70a-c58ed676680b None None] Registered counter for database nova_api Jul 23 21:02:31.748738 ncdv-master-1 devstack@n-api.service[115446]: DEBUG oslo_db.sqlalchemy.engines [None req-51ff65ae-7243-4c76-9a8e-0890cf6c8334 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115446) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 21:02:31.749195 ncdv-master-1 devstack@n-api.service[115447]: DEBUG oslo_db.sqlalchemy.engines [None req-bcb25a4b-32f1-4e13-b70a-c58ed676680b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115447) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 21:02:31.757371 ncdv-master-1 devstack@n-api.service[115447]: DEBUG dbcounter [-] [115447] Writer thread running {{(pid=115447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 23 21:02:31.761790 ncdv-master-1 devstack@n-api.service[115446]: DEBUG dbcounter [-] [115446] Writer thread running {{(pid=115446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 23 21:02:31.816056 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.context [None req-bcb25a4b-32f1-4e13-b70a-c58ed676680b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4e90cb14-d4b2-4158-b8cf-a592a1314a7b(cell1) {{(pid=115447) load_cells /opt/stack/nova/nova/context.py:464}} Jul 23 21:02:31.820328 ncdv-master-1 devstack@n-api.service[115447]: DEBUG oslo_concurrency.lockutils [None req-bcb25a4b-32f1-4e13-b70a-c58ed676680b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:02:31.822031 ncdv-master-1 devstack@n-api.service[115447]: DEBUG oslo_concurrency.lockutils [None req-bcb25a4b-32f1-4e13-b70a-c58ed676680b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:02:31.823716 ncdv-master-1 devstack@n-api.service[115447]: DEBUG oslo_concurrency.lockutils [None req-bcb25a4b-32f1-4e13-b70a-c58ed676680b None None] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:02:31.824999 ncdv-master-1 devstack@n-api.service[115447]: DEBUG oslo_concurrency.lockutils [None req-bcb25a4b-32f1-4e13-b70a-c58ed676680b None None] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:02:31.827558 ncdv-master-1 devstack@n-api.service[115447]: INFO dbcounter [None req-bcb25a4b-32f1-4e13-b70a-c58ed676680b None None] Registered counter for database nova_cell0 Jul 23 21:02:31.829828 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.context [None req-51ff65ae-7243-4c76-9a8e-0890cf6c8334 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4e90cb14-d4b2-4158-b8cf-a592a1314a7b(cell1) {{(pid=115446) load_cells /opt/stack/nova/nova/context.py:464}} Jul 23 21:02:31.832555 ncdv-master-1 devstack@n-api.service[115447]: INFO dbcounter [None req-bcb25a4b-32f1-4e13-b70a-c58ed676680b None None] Registered counter for database nova_cell1 Jul 23 21:02:31.834566 ncdv-master-1 devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-51ff65ae-7243-4c76-9a8e-0890cf6c8334 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:02:31.836466 ncdv-master-1 devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-51ff65ae-7243-4c76-9a8e-0890cf6c8334 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:02:31.837188 ncdv-master-1 devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-51ff65ae-7243-4c76-9a8e-0890cf6c8334 None None] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:02:31.839510 ncdv-master-1 devstack@n-api.service[115446]: DEBUG oslo_concurrency.lockutils [None req-51ff65ae-7243-4c76-9a8e-0890cf6c8334 None None] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:02:31.841820 ncdv-master-1 devstack@n-api.service[115446]: INFO dbcounter [None req-51ff65ae-7243-4c76-9a8e-0890cf6c8334 None None] Registered counter for database nova_cell0 Jul 23 21:02:31.842090 ncdv-master-1 devstack@n-api.service[115447]: DEBUG oslo_db.sqlalchemy.engines [None req-bcb25a4b-32f1-4e13-b70a-c58ed676680b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115447) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 21:02:31.843236 ncdv-master-1 devstack@n-api.service[115447]: DEBUG oslo_db.sqlalchemy.engines [None req-bcb25a4b-32f1-4e13-b70a-c58ed676680b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115447) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 21:02:31.846410 ncdv-master-1 devstack@n-api.service[115446]: INFO dbcounter [None req-51ff65ae-7243-4c76-9a8e-0890cf6c8334 None None] Registered counter for database nova_cell1 Jul 23 21:02:31.850321 ncdv-master-1 devstack@n-api.service[115447]: DEBUG dbcounter [-] [115447] Writer thread running {{(pid=115447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 23 21:02:31.852380 ncdv-master-1 devstack@n-api.service[115447]: DEBUG dbcounter [-] [115447] Writer thread running {{(pid=115447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 23 21:02:31.855460 ncdv-master-1 devstack@n-api.service[115446]: DEBUG oslo_db.sqlalchemy.engines [None req-51ff65ae-7243-4c76-9a8e-0890cf6c8334 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115446) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 21:02:31.859544 ncdv-master-1 devstack@n-api.service[115446]: DEBUG oslo_db.sqlalchemy.engines [None req-51ff65ae-7243-4c76-9a8e-0890cf6c8334 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115446) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 21:02:31.863337 ncdv-master-1 devstack@n-api.service[115446]: DEBUG dbcounter [-] [115446] Writer thread running {{(pid=115446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 23 21:02:31.869979 ncdv-master-1 devstack@n-api.service[115446]: DEBUG dbcounter [-] [115446] Writer thread running {{(pid=115446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 23 21:02:32.006144 ncdv-master-1 devstack@n-api.service[115447]: INFO dbcounter [None req-bcb25a4b-32f1-4e13-b70a-c58ed676680b None None] Registered counter for database nova_cell0 Jul 23 21:02:32.013805 ncdv-master-1 devstack@n-api.service[115447]: DEBUG oslo_db.sqlalchemy.engines [None req-bcb25a4b-32f1-4e13-b70a-c58ed676680b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115447) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 21:02:32.019322 ncdv-master-1 devstack@n-api.service[115447]: DEBUG dbcounter [-] [115447] Writer thread running {{(pid=115447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 23 21:02:32.019780 ncdv-master-1 devstack@n-api.service[115446]: INFO dbcounter [None req-51ff65ae-7243-4c76-9a8e-0890cf6c8334 None None] Registered counter for database nova_cell0 Jul 23 21:02:32.028762 ncdv-master-1 devstack@n-api.service[115446]: DEBUG oslo_db.sqlalchemy.engines [None req-51ff65ae-7243-4c76-9a8e-0890cf6c8334 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115446) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 21:02:32.033487 ncdv-master-1 devstack@n-api.service[115446]: DEBUG dbcounter [-] [115446] Writer thread running {{(pid=115446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 23 21:02:32.371163 ncdv-master-1 devstack@n-api.service[115447]: WARNING keystonemiddleware.auth_token [None req-bcb25a4b-32f1-4e13-b70a-c58ed676680b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 23 21:02:32.373438 ncdv-master-1 devstack@n-api.service[115446]: WARNING keystonemiddleware.auth_token [None req-51ff65ae-7243-4c76-9a8e-0890cf6c8334 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 23 21:02:32.381441 ncdv-master-1 devstack@n-api.service[115447]: WARNING keystonemiddleware.auth_token [None req-bcb25a4b-32f1-4e13-b70a-c58ed676680b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 23 21:02:32.382579 ncdv-master-1 devstack@n-api.service[115446]: WARNING keystonemiddleware.auth_token [None req-51ff65ae-7243-4c76-9a8e-0890cf6c8334 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 23 21:02:32.737340 ncdv-master-1 devstack@n-api.service[115447]: WARNING keystonemiddleware.auth_token [None req-bcb25a4b-32f1-4e13-b70a-c58ed676680b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 23 21:02:32.743550 ncdv-master-1 devstack@n-api.service[115447]: WARNING keystonemiddleware.auth_token [None req-bcb25a4b-32f1-4e13-b70a-c58ed676680b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 23 21:02:32.747673 ncdv-master-1 devstack@n-api.service[115446]: WARNING keystonemiddleware.auth_token [None req-51ff65ae-7243-4c76-9a8e-0890cf6c8334 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 23 21:02:32.748916 ncdv-master-1 devstack@n-api.service[115447]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5643b62df9c0 pid: 115447 (default app) Jul 23 21:02:32.751138 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi [None req-bcb25a4b-32f1-4e13-b70a-c58ed676680b None None] Calling method '>' {{(pid=115447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:02:32.752384 ncdv-master-1 devstack@n-api.service[115447]: INFO nova.api.openstack.requestlog [None req-bcb25a4b-32f1-4e13-b70a-c58ed676680b None None] 10.222.0.17 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001835 Jul 23 21:02:32.752826 ncdv-master-1 devstack@n-api.service[115447]: [pid: 115447|app: 0|req: 1/1] 10.222.0.17 () {50 vars in 788 bytes} [Sat Jul 23 21:02:32 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:02:32.754214 ncdv-master-1 devstack@n-api.service[115446]: WARNING keystonemiddleware.auth_token [None req-51ff65ae-7243-4c76-9a8e-0890cf6c8334 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 23 21:02:32.759630 ncdv-master-1 devstack@n-api.service[115446]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5643b62df9c0 pid: 115446 (default app) Jul 23 21:03:56.906540 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi [None req-bcb25a4b-32f1-4e13-b70a-c58ed676680b None None] Calling method '>' {{(pid=115447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:03:56.907648 ncdv-master-1 devstack@n-api.service[115447]: INFO nova.api.openstack.requestlog [None req-bcb25a4b-32f1-4e13-b70a-c58ed676680b None None] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Jul 23 21:03:56.908050 ncdv-master-1 devstack@n-api.service[115447]: [pid: 115447|app: 0|req: 2/2] 10.222.0.17 () {54 vars in 930 bytes} [Sat Jul 23 21:03:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:03:56.926404 ncdv-master-1 devstack@n-api.service[115446]: DEBUG dbcounter [-] [115446] Writing DB stats nova_api:SELECT=3 {{(pid=115446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:03:56.927396 ncdv-master-1 devstack@n-api.service[115446]: DEBUG dbcounter [-] [115446] Writing DB stats nova_cell0:SELECT=3 {{(pid=115446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:03:56.928229 ncdv-master-1 devstack@n-api.service[115446]: DEBUG dbcounter [-] [115446] Writing DB stats nova_cell1:SELECT=3 {{(pid=115446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:03:56.929416 ncdv-master-1 devstack@n-api.service[115446]: DEBUG dbcounter [-] [115446] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=115446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:03:57.839072 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-1cbda197-8768-4efd-a539-689af17d9c5e admin admin] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:03:57.871760 ncdv-master-1 devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-1cbda197-8768-4efd-a539-689af17d9c5e admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.955874 Jul 23 21:03:57.872499 ncdv-master-1 devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 1/3] 10.222.0.17 () {60 vars in 1291 bytes} [Sat Jul 23 21:03:56 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:04:00.523540 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi [None req-bcb25a4b-32f1-4e13-b70a-c58ed676680b None None] Calling method '>' {{(pid=115447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:04:00.523540 ncdv-master-1 devstack@n-api.service[115447]: INFO nova.api.openstack.requestlog [None req-bcb25a4b-32f1-4e13-b70a-c58ed676680b None None] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002587 Jul 23 21:04:00.530252 ncdv-master-1 devstack@n-api.service[115447]: [pid: 115447|app: 0|req: 3/4] 10.222.0.17 () {54 vars in 930 bytes} [Sat Jul 23 21:04:00 2022] GET /compute/v2.1 => generated 388 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:04:01.069975 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-eff5bd23-cf5a-4c79-974b-77704ac6a528 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "cirros256", "os-flavor-access:is_public": true, "ram": 256, "id": "c1"}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:04:01.088665 ncdv-master-1 devstack@n-api.service[115446]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:04:01.088665 ncdv-master-1 devstack@n-api.service[115446]: warnings.warn(msg) Jul 23 21:04:01.119912 ncdv-master-1 devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-eff5bd23-cf5a-4c79-974b-77704ac6a528 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.589378 Jul 23 21:04:01.128587 ncdv-master-1 devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 2/5] 10.222.0.17 () {64 vars in 1282 bytes} [Sat Jul 23 21:04:00 2022] POST /compute/v2.1/flavors => generated 407 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 23 21:04:01.135626 ncdv-master-1 devstack@n-api.service[115447]: DEBUG dbcounter [-] [115447] Writing DB stats nova_api:SELECT=3 {{(pid=115447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:04:01.136775 ncdv-master-1 devstack@n-api.service[115447]: DEBUG dbcounter [-] [115447] Writing DB stats nova_cell1:SELECT=3 {{(pid=115447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:04:01.138382 ncdv-master-1 devstack@n-api.service[115447]: DEBUG dbcounter [-] [115447] Writing DB stats nova_cell0:SELECT=3 {{(pid=115447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:04:01.139589 ncdv-master-1 devstack@n-api.service[115447]: DEBUG dbcounter [-] [115447] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=115447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:04:01.372897 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi [None req-00676325-0c15-4817-ba27-9edb64f92f6a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:04:01.378821 ncdv-master-1 devstack@n-api.service[115447]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:04:01.378821 ncdv-master-1 devstack@n-api.service[115447]: warnings.warn(msg) Jul 23 21:04:01.442980 ncdv-master-1 devstack@n-api.service[115447]: INFO nova.api.openstack.requestlog [None req-00676325-0c15-4817-ba27-9edb64f92f6a admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.313017 Jul 23 21:04:01.443748 ncdv-master-1 devstack@n-api.service[115447]: [pid: 115447|app: 0|req: 4/6] 10.222.0.17 () {64 vars in 1335 bytes} [Sat Jul 23 21:04:01 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:04:04.017649 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-eff5bd23-cf5a-4c79-974b-77704ac6a528 admin admin] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:04:04.019110 ncdv-master-1 devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-eff5bd23-cf5a-4c79-974b-77704ac6a528 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001790 Jul 23 21:04:04.019502 ncdv-master-1 devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 3/7] 10.222.0.17 () {54 vars in 930 bytes} [Sat Jul 23 21:04:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:04:04.840629 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi [None req-3f4565d3-5b41-40d4-b58f-eaa26a47e777 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "vcpus": 1, "disk": 5, "swap": 0, "ram": 512, "rxtx_factor": 1.0}} {{(pid=115447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:04:04.863781 ncdv-master-1 devstack@n-api.service[115447]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:04:04.863781 ncdv-master-1 devstack@n-api.service[115447]: warnings.warn(msg) Jul 23 21:04:04.889758 ncdv-master-1 devstack@n-api.service[115447]: INFO nova.api.openstack.requestlog [None req-3f4565d3-5b41-40d4-b58f-eaa26a47e777 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.863601 Jul 23 21:04:04.890493 ncdv-master-1 devstack@n-api.service[115447]: [pid: 115447|app: 0|req: 5/8] 10.222.0.17 () {64 vars in 1282 bytes} [Sat Jul 23 21:04:04 2022] POST /compute/v2.1/flavors => generated 404 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 23 21:04:04.904180 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-aef0e5f1-8f43-4d94-b250-b7a6e6d4bdef admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:04:04.906845 ncdv-master-1 devstack@n-api.service[115446]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:04:04.906845 ncdv-master-1 devstack@n-api.service[115446]: warnings.warn(msg) Jul 23 21:04:04.955994 ncdv-master-1 devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-aef0e5f1-8f43-4d94-b250-b7a6e6d4bdef admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.055652 Jul 23 21:04:04.962047 ncdv-master-1 devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 4/9] 10.222.0.17 () {64 vars in 1335 bytes} [Sat Jul 23 21:04:04 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:04:07.780719 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi [None req-3f4565d3-5b41-40d4-b58f-eaa26a47e777 admin admin] Calling method '>' {{(pid=115447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:04:07.782940 ncdv-master-1 devstack@n-api.service[115447]: INFO nova.api.openstack.requestlog [None req-3f4565d3-5b41-40d4-b58f-eaa26a47e777 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002582 Jul 23 21:04:07.788823 ncdv-master-1 devstack@n-api.service[115447]: [pid: 115447|app: 0|req: 6/10] 10.222.0.17 () {54 vars in 930 bytes} [Sat Jul 23 21:04:07 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:04:08.253480 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-1de4eefa-5e6a-48b2-93a8-fdcfd4f4432f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "disk": 10, "swap": 0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "os-flavor-access:is_public": true, "id": "d2", "rxtx_factor": 1.0}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:04:08.278718 ncdv-master-1 devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-1de4eefa-5e6a-48b2-93a8-fdcfd4f4432f admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.488089 Jul 23 21:04:08.280167 ncdv-master-1 devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 5/11] 10.222.0.17 () {64 vars in 1282 bytes} [Sat Jul 23 21:04:07 2022] POST /compute/v2.1/flavors => generated 404 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 23 21:04:08.292441 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi [None req-1c685971-a6f1-4a4c-b36f-0908f01efebf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:04:08.318649 ncdv-master-1 devstack@n-api.service[115447]: INFO nova.api.openstack.requestlog [None req-1c685971-a6f1-4a4c-b36f-0908f01efebf admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030245 Jul 23 21:04:08.326475 ncdv-master-1 devstack@n-api.service[115447]: [pid: 115447|app: 0|req: 7/12] 10.222.0.17 () {64 vars in 1335 bytes} [Sat Jul 23 21:04:08 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:04:11.492406 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-1de4eefa-5e6a-48b2-93a8-fdcfd4f4432f admin admin] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:04:11.492406 ncdv-master-1 devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-1de4eefa-5e6a-48b2-93a8-fdcfd4f4432f admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Jul 23 21:04:11.492406 ncdv-master-1 devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 6/13] 10.222.0.17 () {54 vars in 930 bytes} [Sat Jul 23 21:04:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:04:11.841018 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi [None req-9d894d99-ef0e-413d-9386-b8bcf9b0c8a6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "vcpus": 2, "ram": 2048, "swap": 0, "os-flavor-access:is_public": true, "disk": 10, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=115447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:04:11.862205 ncdv-master-1 devstack@n-api.service[115447]: INFO nova.api.openstack.requestlog [None req-9d894d99-ef0e-413d-9386-b8bcf9b0c8a6 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.578916 Jul 23 21:04:11.864201 ncdv-master-1 devstack@n-api.service[115447]: [pid: 115447|app: 0|req: 8/14] 10.222.0.17 () {64 vars in 1282 bytes} [Sat Jul 23 21:04:11 2022] POST /compute/v2.1/flavors => generated 404 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 23 21:04:11.881983 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-f6c6b6d4-ccde-44cc-afc6-fbebb317e312 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:04:11.910610 ncdv-master-1 devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-f6c6b6d4-ccde-44cc-afc6-fbebb317e312 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034244 Jul 23 21:04:11.911599 ncdv-master-1 devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 7/15] 10.222.0.17 () {64 vars in 1335 bytes} [Sat Jul 23 21:04:11 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:04:14.570860 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi [None req-9d894d99-ef0e-413d-9386-b8bcf9b0c8a6 admin admin] Calling method '>' {{(pid=115447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:04:14.571884 ncdv-master-1 devstack@n-api.service[115447]: INFO nova.api.openstack.requestlog [None req-9d894d99-ef0e-413d-9386-b8bcf9b0c8a6 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001623 Jul 23 21:04:14.572280 ncdv-master-1 devstack@n-api.service[115447]: [pid: 115447|app: 0|req: 9/16] 10.222.0.17 () {54 vars in 930 bytes} [Sat Jul 23 21:04:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:04:15.097234 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-108667d6-f772-415b-a5e5-8456fb1e5f14 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 20, "vcpus": 4, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 4096, "id": "d4"}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:04:15.120219 ncdv-master-1 devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-108667d6-f772-415b-a5e5-8456fb1e5f14 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.541308 Jul 23 21:04:15.121075 ncdv-master-1 devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 8/17] 10.222.0.17 () {64 vars in 1282 bytes} [Sat Jul 23 21:04:14 2022] POST /compute/v2.1/flavors => generated 404 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 23 21:04:15.133437 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi [None req-ae7a0698-db6a-4533-8650-cbb74a2c3d7f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:04:15.159741 ncdv-master-1 devstack@n-api.service[115447]: INFO nova.api.openstack.requestlog [None req-ae7a0698-db6a-4533-8650-cbb74a2c3d7f admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029707 Jul 23 21:04:15.160762 ncdv-master-1 devstack@n-api.service[115447]: [pid: 115447|app: 0|req: 10/18] 10.222.0.17 () {64 vars in 1335 bytes} [Sat Jul 23 21:04:15 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:04:17.702895 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-108667d6-f772-415b-a5e5-8456fb1e5f14 admin admin] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:04:17.703962 ncdv-master-1 devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-108667d6-f772-415b-a5e5-8456fb1e5f14 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001523 Jul 23 21:04:17.704390 ncdv-master-1 devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 9/19] 10.222.0.17 () {54 vars in 930 bytes} [Sat Jul 23 21:04:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:04:18.181040 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi [None req-4ce05a85-f60d-4b7a-9cab-607c89010a1d admin admin] Calling method '>' {{(pid=115447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:04:18.205664 ncdv-master-1 devstack@n-api.service[115447]: INFO nova.api.openstack.requestlog [None req-4ce05a85-f60d-4b7a-9cab-607c89010a1d admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.494990 Jul 23 21:04:18.206211 ncdv-master-1 devstack@n-api.service[115447]: [pid: 115447|app: 0|req: 11/20] 10.222.0.17 () {60 vars in 1291 bytes} [Sat Jul 23 21:04:17 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:04:21.276811 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-108667d6-f772-415b-a5e5-8456fb1e5f14 admin admin] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:04:21.278245 ncdv-master-1 devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-108667d6-f772-415b-a5e5-8456fb1e5f14 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002020 Jul 23 21:04:21.278793 ncdv-master-1 devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 10/21] 10.222.0.17 () {54 vars in 930 bytes} [Sat Jul 23 21:04:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:04:21.849540 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi [None req-5c080d79-436b-4ee6-a7c3-08227b7270c5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "1", "rxtx_factor": 1.0, "vcpus": 1, "name": "m1.tiny", "ram": 512, "disk": 1, "swap": 0}} {{(pid=115447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:04:21.874257 ncdv-master-1 devstack@n-api.service[115447]: INFO nova.api.openstack.requestlog [None req-5c080d79-436b-4ee6-a7c3-08227b7270c5 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.587247 Jul 23 21:04:21.875359 ncdv-master-1 devstack@n-api.service[115447]: [pid: 115447|app: 0|req: 12/22] 10.222.0.17 () {64 vars in 1282 bytes} [Sat Jul 23 21:04:21 2022] POST /compute/v2.1/flavors => generated 402 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 23 21:04:21.891736 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-c61b05e9-98fc-4b6a-86ab-591f2190109c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:04:21.926868 ncdv-master-1 devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-c61b05e9-98fc-4b6a-86ab-591f2190109c admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040916 Jul 23 21:04:21.932490 ncdv-master-1 devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 11/23] 10.222.0.17 () {64 vars in 1332 bytes} [Sat Jul 23 21:04:21 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:04:25.147097 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi [None req-5c080d79-436b-4ee6-a7c3-08227b7270c5 admin admin] Calling method '>' {{(pid=115447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:04:25.148122 ncdv-master-1 devstack@n-api.service[115447]: INFO nova.api.openstack.requestlog [None req-5c080d79-436b-4ee6-a7c3-08227b7270c5 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Jul 23 21:04:25.148498 ncdv-master-1 devstack@n-api.service[115447]: [pid: 115447|app: 0|req: 13/24] 10.222.0.17 () {54 vars in 930 bytes} [Sat Jul 23 21:04:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:04:25.646917 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-fb613c69-7fdf-41ac-856f-44785ccc2de9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "id": "2", "disk": 20, "vcpus": 1, "rxtx_factor": 1.0, "name": "m1.small", "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:04:25.680160 ncdv-master-1 devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-fb613c69-7fdf-41ac-856f-44785ccc2de9 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.525221 Jul 23 21:04:25.685993 ncdv-master-1 devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 12/25] 10.222.0.17 () {64 vars in 1282 bytes} [Sat Jul 23 21:04:25 2022] POST /compute/v2.1/flavors => generated 405 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 23 21:04:25.701200 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi [None req-8b9d5d79-4aed-47d0-b03c-0b3d9781771d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:04:25.731693 ncdv-master-1 devstack@n-api.service[115447]: INFO nova.api.openstack.requestlog [None req-8b9d5d79-4aed-47d0-b03c-0b3d9781771d admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036523 Jul 23 21:04:25.732208 ncdv-master-1 devstack@n-api.service[115447]: [pid: 115447|app: 0|req: 14/26] 10.222.0.17 () {64 vars in 1332 bytes} [Sat Jul 23 21:04:25 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:04:28.407913 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-fb613c69-7fdf-41ac-856f-44785ccc2de9 admin admin] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:04:28.409268 ncdv-master-1 devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-fb613c69-7fdf-41ac-856f-44785ccc2de9 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001897 Jul 23 21:04:28.410152 ncdv-master-1 devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 13/27] 10.222.0.17 () {54 vars in 930 bytes} [Sat Jul 23 21:04:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:04:28.844658 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi [None req-ca98184e-9f77-4ace-94c7-2fcfddf114fd admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "vcpus": 2, "disk": 40, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.medium"}} {{(pid=115447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:04:28.866655 ncdv-master-1 devstack@n-api.service[115447]: INFO nova.api.openstack.requestlog [None req-ca98184e-9f77-4ace-94c7-2fcfddf114fd admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.447326 Jul 23 21:04:28.867240 ncdv-master-1 devstack@n-api.service[115447]: [pid: 115447|app: 0|req: 15/28] 10.222.0.17 () {64 vars in 1282 bytes} [Sat Jul 23 21:04:28 2022] POST /compute/v2.1/flavors => generated 406 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 23 21:04:28.881214 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-b1b5e88d-379c-4f92-adc6-bff56958b8a0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:04:28.884875 ncdv-master-1 devstack@n-api.service[115446]: DEBUG dbcounter [-] [115446] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=115446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:04:28.909640 ncdv-master-1 devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-b1b5e88d-379c-4f92-adc6-bff56958b8a0 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032385 Jul 23 21:04:28.910270 ncdv-master-1 devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 14/29] 10.222.0.17 () {64 vars in 1332 bytes} [Sat Jul 23 21:04:28 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:04:31.527716 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi [None req-ca98184e-9f77-4ace-94c7-2fcfddf114fd admin admin] Calling method '>' {{(pid=115447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:04:31.528715 ncdv-master-1 devstack@n-api.service[115447]: INFO nova.api.openstack.requestlog [None req-ca98184e-9f77-4ace-94c7-2fcfddf114fd admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Jul 23 21:04:31.529054 ncdv-master-1 devstack@n-api.service[115447]: [pid: 115447|app: 0|req: 16/30] 10.222.0.17 () {54 vars in 930 bytes} [Sat Jul 23 21:04:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:04:32.095265 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-f836cc2a-c81d-4293-a1de-ba6a5b646296 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "id": "4", "name": "m1.large", "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "vcpus": 4, "rxtx_factor": 1.0}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:04:32.123446 ncdv-master-1 devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-f836cc2a-c81d-4293-a1de-ba6a5b646296 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.585252 Jul 23 21:04:32.124046 ncdv-master-1 devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 15/31] 10.222.0.17 () {64 vars in 1282 bytes} [Sat Jul 23 21:04:31 2022] POST /compute/v2.1/flavors => generated 405 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 23 21:04:32.136679 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi [None req-d0eb6a3b-7486-4298-973d-44767ad825db admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:04:32.143747 ncdv-master-1 devstack@n-api.service[115447]: DEBUG dbcounter [-] [115447] Writing DB stats nova_api:SELECT=39,nova_api:SAVEPOINT=4,nova_api:INSERT=8,nova_api:RELEASE=4 {{(pid=115447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:04:32.165462 ncdv-master-1 devstack@n-api.service[115447]: INFO nova.api.openstack.requestlog [None req-d0eb6a3b-7486-4298-973d-44767ad825db admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032458 Jul 23 21:04:32.166950 ncdv-master-1 devstack@n-api.service[115447]: [pid: 115447|app: 0|req: 17/32] 10.222.0.17 () {64 vars in 1332 bytes} [Sat Jul 23 21:04:32 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:04:34.801765 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-f836cc2a-c81d-4293-a1de-ba6a5b646296 admin admin] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:04:34.803696 ncdv-master-1 devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-f836cc2a-c81d-4293-a1de-ba6a5b646296 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002282 Jul 23 21:04:34.804143 ncdv-master-1 devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 16/33] 10.222.0.17 () {54 vars in 930 bytes} [Sat Jul 23 21:04:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:04:35.372805 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi [None req-1cba49c3-795e-4ee8-aa24-d25f65700ef3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "os-flavor-access:is_public": true, "id": "5", "name": "m1.xlarge", "disk": 160, "swap": 0, "vcpus": 8, "rxtx_factor": 1.0}} {{(pid=115447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:04:35.398537 ncdv-master-1 devstack@n-api.service[115447]: INFO nova.api.openstack.requestlog [None req-1cba49c3-795e-4ee8-aa24-d25f65700ef3 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.583470 Jul 23 21:04:35.399770 ncdv-master-1 devstack@n-api.service[115447]: [pid: 115447|app: 0|req: 18/34] 10.222.0.17 () {64 vars in 1282 bytes} [Sat Jul 23 21:04:34 2022] POST /compute/v2.1/flavors => generated 408 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 23 21:04:35.415629 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-942c1e80-43e8-452a-afdc-40205c23fde8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:04:35.453138 ncdv-master-1 devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-942c1e80-43e8-452a-afdc-40205c23fde8 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044346 Jul 23 21:04:35.454814 ncdv-master-1 devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 17/35] 10.222.0.17 () {64 vars in 1332 bytes} [Sat Jul 23 21:04:35 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:04:56.602064 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi [None req-1cba49c3-795e-4ee8-aa24-d25f65700ef3 admin admin] Calling method '>' {{(pid=115447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:04:56.603152 ncdv-master-1 devstack@n-api.service[115447]: INFO nova.api.openstack.requestlog [None req-1cba49c3-795e-4ee8-aa24-d25f65700ef3 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001618 Jul 23 21:04:56.603553 ncdv-master-1 devstack@n-api.service[115447]: [pid: 115447|app: 0|req: 19/36] 10.222.0.17 () {54 vars in 930 bytes} [Sat Jul 23 21:04:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:04:56.617213 ncdv-master-1 devstack@n-api.service[115446]: DEBUG dbcounter [-] [115446] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=115446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:04:57.037059 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-962af2d9-791e-49a8-9847-f3363d939f27 admin admin] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:04:57.059254 ncdv-master-1 devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-962af2d9-791e-49a8-9847-f3363d939f27 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.448729 Jul 23 21:04:57.060126 ncdv-master-1 devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 18/37] 10.222.0.17 () {60 vars in 1291 bytes} [Sat Jul 23 21:04:56 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:04:58.210280 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi [None req-1cba49c3-795e-4ee8-aa24-d25f65700ef3 admin admin] Calling method '>' {{(pid=115447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:04:58.211397 ncdv-master-1 devstack@n-api.service[115447]: INFO nova.api.openstack.requestlog [None req-1cba49c3-795e-4ee8-aa24-d25f65700ef3 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001607 Jul 23 21:04:58.211814 ncdv-master-1 devstack@n-api.service[115447]: [pid: 115447|app: 0|req: 20/38] 10.222.0.17 () {56 vars in 1074 bytes} [Sat Jul 23 21:04:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:04:58.886790 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-9b24afa2-90d7-4763-92a1-5c08bb04fea2 admin admin] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:04:58.893367 ncdv-master-1 devstack@n-api.service[115446]: INFO nova.api.openstack.wsgi [None req-9b24afa2-90d7-4763-92a1-5c08bb04fea2 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 23 21:04:58.904688 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-9b24afa2-90d7-4763-92a1-5c08bb04fea2 admin admin] Request method failure captured: Jul 23 21:04:58.904688 ncdv-master-1 devstack@n-api.service[115446]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 23 21:04:58.904688 ncdv-master-1 devstack@n-api.service[115446]: Accept: application/json Jul 23 21:04:58.904688 ncdv-master-1 devstack@n-api.service[115446]: Accept-Encoding: gzip, deflate Jul 23 21:04:58.904688 ncdv-master-1 devstack@n-api.service[115446]: Connection: keep-alive Jul 23 21:04:58.904688 ncdv-master-1 devstack@n-api.service[115446]: Content-Length: 0 Jul 23 21:04:58.904688 ncdv-master-1 devstack@n-api.service[115446]: Host: 10.222.0.17 Jul 23 21:04:58.904688 ncdv-master-1 devstack@n-api.service[115446]: Openstack-Api-Version: compute 2.90 Jul 23 21:04:58.904688 ncdv-master-1 devstack@n-api.service[115446]: Openstack-System-Scope: None Jul 23 21:04:58.904688 ncdv-master-1 devstack@n-api.service[115446]: User-Agent: python-novaclient Jul 23 21:04:58.904688 ncdv-master-1 devstack@n-api.service[115446]: X-Auth-Token: gAAAAABi3GJ6Am4B1ToGAr2Gs8j-uQoapzVTqi9Dd5lM4IgznV76pkVYsVNPwVkl053-i2Tj17uyQnAqiGE3UypmIurLZSuB-k3kXf2aFcHo9nzCCH9ohh3sA7NL8mXCKXVLEDc-PCypUh7SzfejoZ0cGt76HB98ewKnSl5MxUTp5bMzWlLsjx4 Jul 23 21:04:58.904688 ncdv-master-1 devstack@n-api.service[115446]: X-Domain-Id: None Jul 23 21:04:58.904688 ncdv-master-1 devstack@n-api.service[115446]: X-Domain-Name: None Jul 23 21:04:58.904688 ncdv-master-1 devstack@n-api.service[115446]: X-Identity-Status: Confirmed Jul 23 21:04:58.904688 ncdv-master-1 devstack@n-api.service[115446]: X-Is-Admin-Project: True Jul 23 21:04:58.904688 ncdv-master-1 devstack@n-api.service[115446]: X-Openstack-Nova-Api-Version: 2.90 Jul 23 21:04:58.904688 ncdv-master-1 devstack@n-api.service[115446]: X-Project-Domain-Id: default Jul 23 21:04:58.904688 ncdv-master-1 devstack@n-api.service[115446]: X-Project-Domain-Name: Default Jul 23 21:04:58.904688 ncdv-master-1 devstack@n-api.service[115446]: X-Project-Id: d6f3124c18f04946a431e587fc205bd4 Jul 23 21:04:58.904688 ncdv-master-1 devstack@n-api.service[115446]: X-Project-Name: admin Jul 23 21:04:58.904688 ncdv-master-1 devstack@n-api.service[115446]: X-Role: admin,reader,member Jul 23 21:04:58.904688 ncdv-master-1 devstack@n-api.service[115446]: X-Roles: admin,reader,member Jul 23 21:04:58.906563 ncdv-master-1 devstack@n-api.service[115446]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d6f3124c18f04946a431e587fc205bd4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d6f3124c18f04946a431e587fc205bd4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d6f3124c18f04946a431e587fc205bd4", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d6f3124c18f04946a431e587fc205bd4"}]}] Jul 23 21:04:58.906563 ncdv-master-1 devstack@n-api.service[115446]: X-Tenant: admin Jul 23 21:04:58.906563 ncdv-master-1 devstack@n-api.service[115446]: X-Tenant-Id: d6f3124c18f04946a431e587fc205bd4 Jul 23 21:04:58.906563 ncdv-master-1 devstack@n-api.service[115446]: X-Tenant-Name: admin Jul 23 21:04:58.906563 ncdv-master-1 devstack@n-api.service[115446]: X-User: admin Jul 23 21:04:58.906563 ncdv-master-1 devstack@n-api.service[115446]: X-User-Domain-Id: default Jul 23 21:04:58.906563 ncdv-master-1 devstack@n-api.service[115446]: X-User-Domain-Name: Default Jul 23 21:04:58.906563 ncdv-master-1 devstack@n-api.service[115446]: X-User-Id: ef460ef8c739443881697a7ad53288a2 Jul 23 21:04:58.906563 ncdv-master-1 devstack@n-api.service[115446]: X-User-Name: admin Jul 23 21:04:58.906563 ncdv-master-1 devstack@n-api.service[115446]: method: > Jul 23 21:04:58.906563 ncdv-master-1 devstack@n-api.service[115446]: exception: Flavor 42 could not be found. Jul 23 21:04:58.906563 ncdv-master-1 devstack@n-api.service[115446]: action_args: {'id': '42'} Jul 23 21:04:58.906563 ncdv-master-1 devstack@n-api.service[115446]: {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:04:58.906563 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:04:58.907558 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 23 21:04:58.907558 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 23 21:04:58.907558 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 23 21:04:58.907558 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 23 21:04:58.907558 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 23 21:04:58.907558 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 23 21:04:58.907558 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 23 21:04:58.907558 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 23 21:04:58.907558 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 23 21:04:58.907558 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:04:58.907558 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 23 21:04:58.907558 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 23 21:04:58.907558 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 23 21:04:58.907558 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi Jul 23 21:04:58.907558 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:04:58.907558 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi Jul 23 21:04:58.907558 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:04:58.907558 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:04:58.907558 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:04:58.909182 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:04:58.909182 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:04:58.909182 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:04:58.909182 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:04:58.909182 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 23 21:04:58.909182 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:04:58.909182 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 23 21:04:58.909182 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi Jul 23 21:04:58.909182 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:04:58.909182 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi Jul 23 21:04:58.909182 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:04:58.909182 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:04:58.909182 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:04:58.909182 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:04:58.909182 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:04:58.909182 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 23 21:04:58.909182 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi Jul 23 21:04:58.909182 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-9b24afa2-90d7-4763-92a1-5c08bb04fea2 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=115446) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:04:58.910563 ncdv-master-1 devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-9b24afa2-90d7-4763-92a1-5c08bb04fea2 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.449973 Jul 23 21:04:58.910563 ncdv-master-1 devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 19/39] 10.222.0.17 () {60 vars in 1190 bytes} [Sat Jul 23 21:04:58 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 451 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 23 21:04:58.914960 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi [None req-a5cd24c4-1bfa-4d2f-b18a-438fe767cf4c admin admin] Calling method '>' {{(pid=115447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:04:58.919169 ncdv-master-1 devstack@n-api.service[115447]: DEBUG dbcounter [-] [115447] Writing DB stats nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:INSERT=2,nova_api:RELEASE=1 {{(pid=115447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:04:58.940050 ncdv-master-1 devstack@n-api.service[115447]: INFO nova.api.openstack.requestlog [None req-a5cd24c4-1bfa-4d2f-b18a-438fe767cf4c admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.030339 Jul 23 21:04:58.940595 ncdv-master-1 devstack@n-api.service[115447]: [pid: 115447|app: 0|req: 21/40] 10.222.0.17 () {60 vars in 1210 bytes} [Sat Jul 23 21:04:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:04:58.955854 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-446a6d88-e38a-40c5-865f-84c7cafee2e6 admin admin] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:04:58.978003 ncdv-master-1 devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-446a6d88-e38a-40c5-865f-84c7cafee2e6 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025867 Jul 23 21:04:58.978568 ncdv-master-1 devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 20/41] 10.222.0.17 () {60 vars in 1210 bytes} [Sat Jul 23 21:04:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:04:58.991762 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi [None req-2b7ca1f9-3e44-4502-ace7-e1b5764f6a1e admin admin] Calling method '>' {{(pid=115447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:04:59.001196 ncdv-master-1 devstack@n-api.service[115447]: INFO nova.api.openstack.wsgi [None req-2b7ca1f9-3e44-4502-ace7-e1b5764f6a1e admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 23 21:04:59.006197 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi [None req-2b7ca1f9-3e44-4502-ace7-e1b5764f6a1e admin admin] Request method failure captured: Jul 23 21:04:59.006197 ncdv-master-1 devstack@n-api.service[115447]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 23 21:04:59.006197 ncdv-master-1 devstack@n-api.service[115447]: Accept: application/json Jul 23 21:04:59.006197 ncdv-master-1 devstack@n-api.service[115447]: Accept-Encoding: gzip, deflate Jul 23 21:04:59.006197 ncdv-master-1 devstack@n-api.service[115447]: Connection: keep-alive Jul 23 21:04:59.006197 ncdv-master-1 devstack@n-api.service[115447]: Content-Length: 0 Jul 23 21:04:59.006197 ncdv-master-1 devstack@n-api.service[115447]: Host: 10.222.0.17 Jul 23 21:04:59.006197 ncdv-master-1 devstack@n-api.service[115447]: Openstack-Api-Version: compute 2.90 Jul 23 21:04:59.006197 ncdv-master-1 devstack@n-api.service[115447]: Openstack-System-Scope: None Jul 23 21:04:59.006197 ncdv-master-1 devstack@n-api.service[115447]: User-Agent: python-novaclient Jul 23 21:04:59.006197 ncdv-master-1 devstack@n-api.service[115447]: X-Auth-Token: gAAAAABi3GJ6Am4B1ToGAr2Gs8j-uQoapzVTqi9Dd5lM4IgznV76pkVYsVNPwVkl053-i2Tj17uyQnAqiGE3UypmIurLZSuB-k3kXf2aFcHo9nzCCH9ohh3sA7NL8mXCKXVLEDc-PCypUh7SzfejoZ0cGt76HB98ewKnSl5MxUTp5bMzWlLsjx4 Jul 23 21:04:59.006197 ncdv-master-1 devstack@n-api.service[115447]: X-Domain-Id: None Jul 23 21:04:59.006197 ncdv-master-1 devstack@n-api.service[115447]: X-Domain-Name: None Jul 23 21:04:59.006197 ncdv-master-1 devstack@n-api.service[115447]: X-Identity-Status: Confirmed Jul 23 21:04:59.006197 ncdv-master-1 devstack@n-api.service[115447]: X-Is-Admin-Project: True Jul 23 21:04:59.006197 ncdv-master-1 devstack@n-api.service[115447]: X-Openstack-Nova-Api-Version: 2.90 Jul 23 21:04:59.006197 ncdv-master-1 devstack@n-api.service[115447]: X-Project-Domain-Id: default Jul 23 21:04:59.006197 ncdv-master-1 devstack@n-api.service[115447]: X-Project-Domain-Name: Default Jul 23 21:04:59.006197 ncdv-master-1 devstack@n-api.service[115447]: X-Project-Id: d6f3124c18f04946a431e587fc205bd4 Jul 23 21:04:59.006197 ncdv-master-1 devstack@n-api.service[115447]: X-Project-Name: admin Jul 23 21:04:59.006197 ncdv-master-1 devstack@n-api.service[115447]: X-Role: admin,reader,member Jul 23 21:04:59.006197 ncdv-master-1 devstack@n-api.service[115447]: X-Roles: admin,reader,member Jul 23 21:04:59.007503 ncdv-master-1 devstack@n-api.service[115447]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d6f3124c18f04946a431e587fc205bd4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d6f3124c18f04946a431e587fc205bd4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d6f3124c18f04946a431e587fc205bd4", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d6f3124c18f04946a431e587fc205bd4"}]}] Jul 23 21:04:59.007503 ncdv-master-1 devstack@n-api.service[115447]: X-Tenant: admin Jul 23 21:04:59.007503 ncdv-master-1 devstack@n-api.service[115447]: X-Tenant-Id: d6f3124c18f04946a431e587fc205bd4 Jul 23 21:04:59.007503 ncdv-master-1 devstack@n-api.service[115447]: X-Tenant-Name: admin Jul 23 21:04:59.007503 ncdv-master-1 devstack@n-api.service[115447]: X-User: admin Jul 23 21:04:59.007503 ncdv-master-1 devstack@n-api.service[115447]: X-User-Domain-Id: default Jul 23 21:04:59.007503 ncdv-master-1 devstack@n-api.service[115447]: X-User-Domain-Name: Default Jul 23 21:04:59.007503 ncdv-master-1 devstack@n-api.service[115447]: X-User-Id: ef460ef8c739443881697a7ad53288a2 Jul 23 21:04:59.007503 ncdv-master-1 devstack@n-api.service[115447]: X-User-Name: admin Jul 23 21:04:59.007503 ncdv-master-1 devstack@n-api.service[115447]: method: > Jul 23 21:04:59.007503 ncdv-master-1 devstack@n-api.service[115447]: exception: Flavor 42 could not be found. Jul 23 21:04:59.007503 ncdv-master-1 devstack@n-api.service[115447]: action_args: {'id': '42'} Jul 23 21:04:59.007503 ncdv-master-1 devstack@n-api.service[115447]: {{(pid=115447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:04:59.007503 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:04:59.008571 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 23 21:04:59.008571 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 23 21:04:59.008571 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 23 21:04:59.008571 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 23 21:04:59.008571 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 23 21:04:59.008571 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 23 21:04:59.008571 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 23 21:04:59.008571 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 23 21:04:59.008571 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 23 21:04:59.008571 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:04:59.008571 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 23 21:04:59.008571 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 23 21:04:59.008571 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 23 21:04:59.008571 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi Jul 23 21:04:59.008571 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:04:59.008571 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi Jul 23 21:04:59.008571 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:04:59.008571 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:04:59.008571 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:04:59.010755 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:04:59.010755 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:04:59.010755 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:04:59.010755 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:04:59.010755 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 23 21:04:59.010755 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:04:59.010755 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 23 21:04:59.010755 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi Jul 23 21:04:59.010755 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:04:59.010755 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi Jul 23 21:04:59.010755 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:04:59.010755 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:04:59.010755 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:04:59.010755 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:04:59.010755 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:04:59.010755 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 23 21:04:59.010755 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi Jul 23 21:04:59.010755 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi [None req-2b7ca1f9-3e44-4502-ace7-e1b5764f6a1e admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=115447) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:04:59.012612 ncdv-master-1 devstack@n-api.service[115447]: INFO nova.api.openstack.requestlog [None req-2b7ca1f9-3e44-4502-ace7-e1b5764f6a1e admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.022264 Jul 23 21:04:59.012612 ncdv-master-1 devstack@n-api.service[115447]: [pid: 115447|app: 0|req: 22/42] 10.222.0.17 () {60 vars in 1190 bytes} [Sat Jul 23 21:04:58 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 23 21:05:00.032981 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-446a6d88-e38a-40c5-865f-84c7cafee2e6 admin admin] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:05:00.034061 ncdv-master-1 devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-446a6d88-e38a-40c5-865f-84c7cafee2e6 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Jul 23 21:05:00.034453 ncdv-master-1 devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 21/43] 10.222.0.17 () {56 vars in 1074 bytes} [Sat Jul 23 21:05:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:05:00.647100 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi [None req-2a1b3693-aac8-4299-bc76-4d52b85b73fa admin admin] Calling method '>' {{(pid=115447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:05:00.655081 ncdv-master-1 devstack@n-api.service[115447]: INFO nova.api.openstack.wsgi [None req-2a1b3693-aac8-4299-bc76-4d52b85b73fa admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 23 21:05:00.656918 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi [None req-2a1b3693-aac8-4299-bc76-4d52b85b73fa admin admin] Request method failure captured: Jul 23 21:05:00.656918 ncdv-master-1 devstack@n-api.service[115447]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 23 21:05:00.656918 ncdv-master-1 devstack@n-api.service[115447]: Accept: application/json Jul 23 21:05:00.656918 ncdv-master-1 devstack@n-api.service[115447]: Accept-Encoding: gzip, deflate Jul 23 21:05:00.656918 ncdv-master-1 devstack@n-api.service[115447]: Connection: keep-alive Jul 23 21:05:00.656918 ncdv-master-1 devstack@n-api.service[115447]: Content-Length: 0 Jul 23 21:05:00.656918 ncdv-master-1 devstack@n-api.service[115447]: Host: 10.222.0.17 Jul 23 21:05:00.656918 ncdv-master-1 devstack@n-api.service[115447]: Openstack-Api-Version: compute 2.90 Jul 23 21:05:00.656918 ncdv-master-1 devstack@n-api.service[115447]: Openstack-System-Scope: None Jul 23 21:05:00.656918 ncdv-master-1 devstack@n-api.service[115447]: User-Agent: python-novaclient Jul 23 21:05:00.656918 ncdv-master-1 devstack@n-api.service[115447]: X-Auth-Token: gAAAAABi3GJ7_8v6gaGr3Ncojl-6hf4_1lW9zNS3I9hlGEb9QmM2pGn5cfsKxqkQnxSwhjjV-HXlVb514vmL-Eo1MW683QjzIXtEsoegV8WjciOLKtOolxZPN6UcmJjCgEf-F3oqyvGy-r7x_uLI-dTyIG2GQoOSFzjaCsCmDKmAYu2Fr1rTvls Jul 23 21:05:00.656918 ncdv-master-1 devstack@n-api.service[115447]: X-Domain-Id: None Jul 23 21:05:00.656918 ncdv-master-1 devstack@n-api.service[115447]: X-Domain-Name: None Jul 23 21:05:00.656918 ncdv-master-1 devstack@n-api.service[115447]: X-Identity-Status: Confirmed Jul 23 21:05:00.656918 ncdv-master-1 devstack@n-api.service[115447]: X-Is-Admin-Project: True Jul 23 21:05:00.656918 ncdv-master-1 devstack@n-api.service[115447]: X-Openstack-Nova-Api-Version: 2.90 Jul 23 21:05:00.656918 ncdv-master-1 devstack@n-api.service[115447]: X-Project-Domain-Id: default Jul 23 21:05:00.656918 ncdv-master-1 devstack@n-api.service[115447]: X-Project-Domain-Name: Default Jul 23 21:05:00.656918 ncdv-master-1 devstack@n-api.service[115447]: X-Project-Id: d6f3124c18f04946a431e587fc205bd4 Jul 23 21:05:00.656918 ncdv-master-1 devstack@n-api.service[115447]: X-Project-Name: admin Jul 23 21:05:00.656918 ncdv-master-1 devstack@n-api.service[115447]: X-Role: admin,reader,member Jul 23 21:05:00.656918 ncdv-master-1 devstack@n-api.service[115447]: X-Roles: admin,reader,member Jul 23 21:05:00.658411 ncdv-master-1 devstack@n-api.service[115447]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d6f3124c18f04946a431e587fc205bd4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d6f3124c18f04946a431e587fc205bd4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d6f3124c18f04946a431e587fc205bd4", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d6f3124c18f04946a431e587fc205bd4"}]}] Jul 23 21:05:00.658411 ncdv-master-1 devstack@n-api.service[115447]: X-Tenant: admin Jul 23 21:05:00.658411 ncdv-master-1 devstack@n-api.service[115447]: X-Tenant-Id: d6f3124c18f04946a431e587fc205bd4 Jul 23 21:05:00.658411 ncdv-master-1 devstack@n-api.service[115447]: X-Tenant-Name: admin Jul 23 21:05:00.658411 ncdv-master-1 devstack@n-api.service[115447]: X-User: admin Jul 23 21:05:00.658411 ncdv-master-1 devstack@n-api.service[115447]: X-User-Domain-Id: default Jul 23 21:05:00.658411 ncdv-master-1 devstack@n-api.service[115447]: X-User-Domain-Name: Default Jul 23 21:05:00.658411 ncdv-master-1 devstack@n-api.service[115447]: X-User-Id: ef460ef8c739443881697a7ad53288a2 Jul 23 21:05:00.658411 ncdv-master-1 devstack@n-api.service[115447]: X-User-Name: admin Jul 23 21:05:00.658411 ncdv-master-1 devstack@n-api.service[115447]: method: > Jul 23 21:05:00.658411 ncdv-master-1 devstack@n-api.service[115447]: exception: Flavor 84 could not be found. Jul 23 21:05:00.658411 ncdv-master-1 devstack@n-api.service[115447]: action_args: {'id': '84'} Jul 23 21:05:00.658411 ncdv-master-1 devstack@n-api.service[115447]: {{(pid=115447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:05:00.658411 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:05:00.659296 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 23 21:05:00.659296 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 23 21:05:00.659296 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 23 21:05:00.659296 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 23 21:05:00.659296 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 23 21:05:00.659296 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 23 21:05:00.659296 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 23 21:05:00.659296 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 23 21:05:00.659296 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 23 21:05:00.659296 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:05:00.659296 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 23 21:05:00.659296 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 23 21:05:00.659296 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 23 21:05:00.659296 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi Jul 23 21:05:00.659296 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:05:00.659296 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi Jul 23 21:05:00.659296 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:05:00.659296 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:05:00.659296 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:05:00.660569 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:05:00.660569 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:05:00.660569 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:05:00.660569 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:05:00.660569 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 23 21:05:00.660569 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:05:00.660569 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 23 21:05:00.660569 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi Jul 23 21:05:00.660569 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:05:00.660569 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi Jul 23 21:05:00.660569 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:05:00.660569 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:05:00.660569 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:05:00.660569 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:05:00.660569 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:05:00.660569 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 23 21:05:00.660569 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi Jul 23 21:05:00.660569 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi [None req-2a1b3693-aac8-4299-bc76-4d52b85b73fa admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=115447) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:05:00.661785 ncdv-master-1 devstack@n-api.service[115447]: INFO nova.api.openstack.requestlog [None req-2a1b3693-aac8-4299-bc76-4d52b85b73fa admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.479310 Jul 23 21:05:00.661785 ncdv-master-1 devstack@n-api.service[115447]: [pid: 115447|app: 0|req: 23/44] 10.222.0.17 () {60 vars in 1190 bytes} [Sat Jul 23 21:05:00 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 481 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 23 21:05:00.672121 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-4a06611f-5a01-4f1f-b1ba-075676dba3fa admin admin] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:05:00.693177 ncdv-master-1 devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-4a06611f-5a01-4f1f-b1ba-075676dba3fa admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027240 Jul 23 21:05:00.693729 ncdv-master-1 devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 22/45] 10.222.0.17 () {60 vars in 1210 bytes} [Sat Jul 23 21:05:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:05:00.704312 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi [None req-6d9e53aa-7cc0-4af4-baec-98561682ac82 admin admin] Calling method '>' {{(pid=115447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:05:00.719026 ncdv-master-1 devstack@n-api.service[115447]: INFO nova.api.openstack.requestlog [None req-6d9e53aa-7cc0-4af4-baec-98561682ac82 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018463 Jul 23 21:05:00.719549 ncdv-master-1 devstack@n-api.service[115447]: [pid: 115447|app: 0|req: 24/46] 10.222.0.17 () {60 vars in 1210 bytes} [Sat Jul 23 21:05:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:05:00.729444 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-ef8fe354-7c42-4c61-b69a-719a70831f4e admin admin] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:05:00.735425 ncdv-master-1 devstack@n-api.service[115446]: INFO nova.api.openstack.wsgi [None req-ef8fe354-7c42-4c61-b69a-719a70831f4e admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 23 21:05:00.736926 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-ef8fe354-7c42-4c61-b69a-719a70831f4e admin admin] Request method failure captured: Jul 23 21:05:00.736926 ncdv-master-1 devstack@n-api.service[115446]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 23 21:05:00.736926 ncdv-master-1 devstack@n-api.service[115446]: Accept: application/json Jul 23 21:05:00.736926 ncdv-master-1 devstack@n-api.service[115446]: Accept-Encoding: gzip, deflate Jul 23 21:05:00.736926 ncdv-master-1 devstack@n-api.service[115446]: Connection: keep-alive Jul 23 21:05:00.736926 ncdv-master-1 devstack@n-api.service[115446]: Content-Length: 0 Jul 23 21:05:00.736926 ncdv-master-1 devstack@n-api.service[115446]: Host: 10.222.0.17 Jul 23 21:05:00.736926 ncdv-master-1 devstack@n-api.service[115446]: Openstack-Api-Version: compute 2.90 Jul 23 21:05:00.736926 ncdv-master-1 devstack@n-api.service[115446]: Openstack-System-Scope: None Jul 23 21:05:00.736926 ncdv-master-1 devstack@n-api.service[115446]: User-Agent: python-novaclient Jul 23 21:05:00.736926 ncdv-master-1 devstack@n-api.service[115446]: X-Auth-Token: gAAAAABi3GJ7_8v6gaGr3Ncojl-6hf4_1lW9zNS3I9hlGEb9QmM2pGn5cfsKxqkQnxSwhjjV-HXlVb514vmL-Eo1MW683QjzIXtEsoegV8WjciOLKtOolxZPN6UcmJjCgEf-F3oqyvGy-r7x_uLI-dTyIG2GQoOSFzjaCsCmDKmAYu2Fr1rTvls Jul 23 21:05:00.736926 ncdv-master-1 devstack@n-api.service[115446]: X-Domain-Id: None Jul 23 21:05:00.736926 ncdv-master-1 devstack@n-api.service[115446]: X-Domain-Name: None Jul 23 21:05:00.736926 ncdv-master-1 devstack@n-api.service[115446]: X-Identity-Status: Confirmed Jul 23 21:05:00.736926 ncdv-master-1 devstack@n-api.service[115446]: X-Is-Admin-Project: True Jul 23 21:05:00.736926 ncdv-master-1 devstack@n-api.service[115446]: X-Openstack-Nova-Api-Version: 2.90 Jul 23 21:05:00.736926 ncdv-master-1 devstack@n-api.service[115446]: X-Project-Domain-Id: default Jul 23 21:05:00.736926 ncdv-master-1 devstack@n-api.service[115446]: X-Project-Domain-Name: Default Jul 23 21:05:00.736926 ncdv-master-1 devstack@n-api.service[115446]: X-Project-Id: d6f3124c18f04946a431e587fc205bd4 Jul 23 21:05:00.736926 ncdv-master-1 devstack@n-api.service[115446]: X-Project-Name: admin Jul 23 21:05:00.736926 ncdv-master-1 devstack@n-api.service[115446]: X-Role: admin,reader,member Jul 23 21:05:00.736926 ncdv-master-1 devstack@n-api.service[115446]: X-Roles: admin,reader,member Jul 23 21:05:00.738464 ncdv-master-1 devstack@n-api.service[115446]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d6f3124c18f04946a431e587fc205bd4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d6f3124c18f04946a431e587fc205bd4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d6f3124c18f04946a431e587fc205bd4", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d6f3124c18f04946a431e587fc205bd4"}]}] Jul 23 21:05:00.738464 ncdv-master-1 devstack@n-api.service[115446]: X-Tenant: admin Jul 23 21:05:00.738464 ncdv-master-1 devstack@n-api.service[115446]: X-Tenant-Id: d6f3124c18f04946a431e587fc205bd4 Jul 23 21:05:00.738464 ncdv-master-1 devstack@n-api.service[115446]: X-Tenant-Name: admin Jul 23 21:05:00.738464 ncdv-master-1 devstack@n-api.service[115446]: X-User: admin Jul 23 21:05:00.738464 ncdv-master-1 devstack@n-api.service[115446]: X-User-Domain-Id: default Jul 23 21:05:00.738464 ncdv-master-1 devstack@n-api.service[115446]: X-User-Domain-Name: Default Jul 23 21:05:00.738464 ncdv-master-1 devstack@n-api.service[115446]: X-User-Id: ef460ef8c739443881697a7ad53288a2 Jul 23 21:05:00.738464 ncdv-master-1 devstack@n-api.service[115446]: X-User-Name: admin Jul 23 21:05:00.738464 ncdv-master-1 devstack@n-api.service[115446]: method: > Jul 23 21:05:00.738464 ncdv-master-1 devstack@n-api.service[115446]: exception: Flavor 84 could not be found. Jul 23 21:05:00.738464 ncdv-master-1 devstack@n-api.service[115446]: action_args: {'id': '84'} Jul 23 21:05:00.738464 ncdv-master-1 devstack@n-api.service[115446]: {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:05:00.738464 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:05:00.739447 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 23 21:05:00.739447 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 23 21:05:00.739447 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 23 21:05:00.739447 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 23 21:05:00.739447 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 23 21:05:00.739447 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 23 21:05:00.739447 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 23 21:05:00.739447 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 23 21:05:00.739447 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 23 21:05:00.739447 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:05:00.739447 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 23 21:05:00.739447 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 23 21:05:00.739447 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 23 21:05:00.739447 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi Jul 23 21:05:00.739447 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:05:00.739447 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi Jul 23 21:05:00.739447 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:05:00.739447 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:05:00.739447 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:05:00.740718 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:05:00.740718 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:05:00.740718 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:05:00.740718 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:05:00.740718 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 23 21:05:00.740718 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:05:00.740718 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 23 21:05:00.740718 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi Jul 23 21:05:00.740718 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:05:00.740718 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi Jul 23 21:05:00.740718 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:05:00.740718 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:05:00.740718 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:05:00.740718 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:05:00.740718 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:05:00.740718 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 23 21:05:00.740718 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi Jul 23 21:05:00.740718 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-ef8fe354-7c42-4c61-b69a-719a70831f4e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=115446) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:05:00.741943 ncdv-master-1 devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-ef8fe354-7c42-4c61-b69a-719a70831f4e admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012435 Jul 23 21:05:00.741943 ncdv-master-1 devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 23/47] 10.222.0.17 () {60 vars in 1190 bytes} [Sat Jul 23 21:05:00 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 23 21:05:01.740910 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi [None req-6d9e53aa-7cc0-4af4-baec-98561682ac82 admin admin] Calling method '>' {{(pid=115447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:05:01.741932 ncdv-master-1 devstack@n-api.service[115447]: INFO nova.api.openstack.requestlog [None req-6d9e53aa-7cc0-4af4-baec-98561682ac82 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Jul 23 21:05:01.742321 ncdv-master-1 devstack@n-api.service[115447]: [pid: 115447|app: 0|req: 25/48] 10.222.0.17 () {56 vars in 1074 bytes} [Sat Jul 23 21:05:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:05:02.356263 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-7bcbb474-9321-4be3-bda7-189773582b9f admin admin] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:05:02.362392 ncdv-master-1 devstack@n-api.service[115446]: INFO nova.api.openstack.wsgi [None req-7bcbb474-9321-4be3-bda7-189773582b9f admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 23 21:05:02.363894 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-7bcbb474-9321-4be3-bda7-189773582b9f admin admin] Request method failure captured: Jul 23 21:05:02.363894 ncdv-master-1 devstack@n-api.service[115446]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 23 21:05:02.363894 ncdv-master-1 devstack@n-api.service[115446]: Accept: application/json Jul 23 21:05:02.363894 ncdv-master-1 devstack@n-api.service[115446]: Accept-Encoding: gzip, deflate Jul 23 21:05:02.363894 ncdv-master-1 devstack@n-api.service[115446]: Connection: keep-alive Jul 23 21:05:02.363894 ncdv-master-1 devstack@n-api.service[115446]: Content-Length: 0 Jul 23 21:05:02.363894 ncdv-master-1 devstack@n-api.service[115446]: Host: 10.222.0.17 Jul 23 21:05:02.363894 ncdv-master-1 devstack@n-api.service[115446]: Openstack-Api-Version: compute 2.90 Jul 23 21:05:02.363894 ncdv-master-1 devstack@n-api.service[115446]: Openstack-System-Scope: None Jul 23 21:05:02.363894 ncdv-master-1 devstack@n-api.service[115446]: User-Agent: python-novaclient Jul 23 21:05:02.363894 ncdv-master-1 devstack@n-api.service[115446]: X-Auth-Token: gAAAAABi3GJ9ftqq7jnEnpAoq1pzdv4hnYEcvMYjmJPDk2Dcf9gbKNoOG5hUMNfkUCU8Kqo0Is5d-UkQ5A3kaTHSOD9dNMpUjqYhI4iUoK-tr8C6wZAuy_AtSlBqOGKV8KxavM1g25dIHst6h2XqRQZCR5GE6pi-R_79I8iGdUnkcRgLBMArRis Jul 23 21:05:02.363894 ncdv-master-1 devstack@n-api.service[115446]: X-Domain-Id: None Jul 23 21:05:02.363894 ncdv-master-1 devstack@n-api.service[115446]: X-Domain-Name: None Jul 23 21:05:02.363894 ncdv-master-1 devstack@n-api.service[115446]: X-Identity-Status: Confirmed Jul 23 21:05:02.363894 ncdv-master-1 devstack@n-api.service[115446]: X-Is-Admin-Project: True Jul 23 21:05:02.363894 ncdv-master-1 devstack@n-api.service[115446]: X-Openstack-Nova-Api-Version: 2.90 Jul 23 21:05:02.363894 ncdv-master-1 devstack@n-api.service[115446]: X-Project-Domain-Id: default Jul 23 21:05:02.363894 ncdv-master-1 devstack@n-api.service[115446]: X-Project-Domain-Name: Default Jul 23 21:05:02.363894 ncdv-master-1 devstack@n-api.service[115446]: X-Project-Id: d6f3124c18f04946a431e587fc205bd4 Jul 23 21:05:02.363894 ncdv-master-1 devstack@n-api.service[115446]: X-Project-Name: admin Jul 23 21:05:02.363894 ncdv-master-1 devstack@n-api.service[115446]: X-Role: admin,reader,member Jul 23 21:05:02.363894 ncdv-master-1 devstack@n-api.service[115446]: X-Roles: admin,reader,member Jul 23 21:05:02.365478 ncdv-master-1 devstack@n-api.service[115446]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d6f3124c18f04946a431e587fc205bd4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d6f3124c18f04946a431e587fc205bd4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d6f3124c18f04946a431e587fc205bd4", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d6f3124c18f04946a431e587fc205bd4"}]}] Jul 23 21:05:02.365478 ncdv-master-1 devstack@n-api.service[115446]: X-Tenant: admin Jul 23 21:05:02.365478 ncdv-master-1 devstack@n-api.service[115446]: X-Tenant-Id: d6f3124c18f04946a431e587fc205bd4 Jul 23 21:05:02.365478 ncdv-master-1 devstack@n-api.service[115446]: X-Tenant-Name: admin Jul 23 21:05:02.365478 ncdv-master-1 devstack@n-api.service[115446]: X-User: admin Jul 23 21:05:02.365478 ncdv-master-1 devstack@n-api.service[115446]: X-User-Domain-Id: default Jul 23 21:05:02.365478 ncdv-master-1 devstack@n-api.service[115446]: X-User-Domain-Name: Default Jul 23 21:05:02.365478 ncdv-master-1 devstack@n-api.service[115446]: X-User-Id: ef460ef8c739443881697a7ad53288a2 Jul 23 21:05:02.365478 ncdv-master-1 devstack@n-api.service[115446]: X-User-Name: admin Jul 23 21:05:02.365478 ncdv-master-1 devstack@n-api.service[115446]: method: > Jul 23 21:05:02.365478 ncdv-master-1 devstack@n-api.service[115446]: exception: Flavor 451 could not be found. Jul 23 21:05:02.365478 ncdv-master-1 devstack@n-api.service[115446]: action_args: {'id': '451'} Jul 23 21:05:02.365478 ncdv-master-1 devstack@n-api.service[115446]: {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:05:02.365478 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:05:02.366378 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 23 21:05:02.366378 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 23 21:05:02.366378 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 23 21:05:02.366378 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 23 21:05:02.366378 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 23 21:05:02.366378 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 23 21:05:02.366378 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 23 21:05:02.366378 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 23 21:05:02.366378 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 23 21:05:02.366378 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:05:02.366378 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 23 21:05:02.366378 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 23 21:05:02.366378 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 23 21:05:02.366378 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi Jul 23 21:05:02.366378 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:05:02.366378 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi Jul 23 21:05:02.366378 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:05:02.366378 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:05:02.366378 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:05:02.367875 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:05:02.367875 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:05:02.367875 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:05:02.367875 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:05:02.367875 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 23 21:05:02.367875 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:05:02.367875 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 23 21:05:02.367875 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi Jul 23 21:05:02.367875 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:05:02.367875 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi Jul 23 21:05:02.367875 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:05:02.367875 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:05:02.367875 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:05:02.367875 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:05:02.367875 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:05:02.367875 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 23 21:05:02.367875 ncdv-master-1 devstack@n-api.service[115446]: ERROR nova.api.openstack.wsgi Jul 23 21:05:02.367875 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-7bcbb474-9321-4be3-bda7-189773582b9f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=115446) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:05:02.369264 ncdv-master-1 devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-7bcbb474-9321-4be3-bda7-189773582b9f admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.479395 Jul 23 21:05:02.369264 ncdv-master-1 devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 24/49] 10.222.0.17 () {60 vars in 1193 bytes} [Sat Jul 23 21:05:01 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 480 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 23 21:05:02.375982 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi [None req-bfc51820-a46c-45de-98ea-abfbbaab7141 admin admin] Calling method '>' {{(pid=115447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:05:02.390198 ncdv-master-1 devstack@n-api.service[115447]: INFO nova.api.openstack.requestlog [None req-bfc51820-a46c-45de-98ea-abfbbaab7141 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017828 Jul 23 21:05:02.390734 ncdv-master-1 devstack@n-api.service[115447]: [pid: 115447|app: 0|req: 26/50] 10.222.0.17 () {60 vars in 1210 bytes} [Sat Jul 23 21:05:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:05:02.400898 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-f9f849c5-604c-4e0e-ae5b-556aac30b0b0 admin admin] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:05:02.415505 ncdv-master-1 devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-f9f849c5-604c-4e0e-ae5b-556aac30b0b0 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018195 Jul 23 21:05:02.416038 ncdv-master-1 devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 25/51] 10.222.0.17 () {60 vars in 1210 bytes} [Sat Jul 23 21:05:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:05:02.427715 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi [None req-e62c1f79-5e54-4d0b-8552-84038e3adc02 admin admin] Calling method '>' {{(pid=115447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:05:02.435441 ncdv-master-1 devstack@n-api.service[115447]: INFO nova.api.openstack.wsgi [None req-e62c1f79-5e54-4d0b-8552-84038e3adc02 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 23 21:05:02.437724 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi [None req-e62c1f79-5e54-4d0b-8552-84038e3adc02 admin admin] Request method failure captured: Jul 23 21:05:02.437724 ncdv-master-1 devstack@n-api.service[115447]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 23 21:05:02.437724 ncdv-master-1 devstack@n-api.service[115447]: Accept: application/json Jul 23 21:05:02.437724 ncdv-master-1 devstack@n-api.service[115447]: Accept-Encoding: gzip, deflate Jul 23 21:05:02.437724 ncdv-master-1 devstack@n-api.service[115447]: Connection: keep-alive Jul 23 21:05:02.437724 ncdv-master-1 devstack@n-api.service[115447]: Content-Length: 0 Jul 23 21:05:02.437724 ncdv-master-1 devstack@n-api.service[115447]: Host: 10.222.0.17 Jul 23 21:05:02.437724 ncdv-master-1 devstack@n-api.service[115447]: Openstack-Api-Version: compute 2.90 Jul 23 21:05:02.437724 ncdv-master-1 devstack@n-api.service[115447]: Openstack-System-Scope: None Jul 23 21:05:02.437724 ncdv-master-1 devstack@n-api.service[115447]: User-Agent: python-novaclient Jul 23 21:05:02.437724 ncdv-master-1 devstack@n-api.service[115447]: X-Auth-Token: gAAAAABi3GJ9ftqq7jnEnpAoq1pzdv4hnYEcvMYjmJPDk2Dcf9gbKNoOG5hUMNfkUCU8Kqo0Is5d-UkQ5A3kaTHSOD9dNMpUjqYhI4iUoK-tr8C6wZAuy_AtSlBqOGKV8KxavM1g25dIHst6h2XqRQZCR5GE6pi-R_79I8iGdUnkcRgLBMArRis Jul 23 21:05:02.437724 ncdv-master-1 devstack@n-api.service[115447]: X-Domain-Id: None Jul 23 21:05:02.437724 ncdv-master-1 devstack@n-api.service[115447]: X-Domain-Name: None Jul 23 21:05:02.437724 ncdv-master-1 devstack@n-api.service[115447]: X-Identity-Status: Confirmed Jul 23 21:05:02.437724 ncdv-master-1 devstack@n-api.service[115447]: X-Is-Admin-Project: True Jul 23 21:05:02.437724 ncdv-master-1 devstack@n-api.service[115447]: X-Openstack-Nova-Api-Version: 2.90 Jul 23 21:05:02.437724 ncdv-master-1 devstack@n-api.service[115447]: X-Project-Domain-Id: default Jul 23 21:05:02.437724 ncdv-master-1 devstack@n-api.service[115447]: X-Project-Domain-Name: Default Jul 23 21:05:02.437724 ncdv-master-1 devstack@n-api.service[115447]: X-Project-Id: d6f3124c18f04946a431e587fc205bd4 Jul 23 21:05:02.437724 ncdv-master-1 devstack@n-api.service[115447]: X-Project-Name: admin Jul 23 21:05:02.437724 ncdv-master-1 devstack@n-api.service[115447]: X-Role: admin,reader,member Jul 23 21:05:02.437724 ncdv-master-1 devstack@n-api.service[115447]: X-Roles: admin,reader,member Jul 23 21:05:02.439253 ncdv-master-1 devstack@n-api.service[115447]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d6f3124c18f04946a431e587fc205bd4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d6f3124c18f04946a431e587fc205bd4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d6f3124c18f04946a431e587fc205bd4", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d6f3124c18f04946a431e587fc205bd4"}]}] Jul 23 21:05:02.439253 ncdv-master-1 devstack@n-api.service[115447]: X-Tenant: admin Jul 23 21:05:02.439253 ncdv-master-1 devstack@n-api.service[115447]: X-Tenant-Id: d6f3124c18f04946a431e587fc205bd4 Jul 23 21:05:02.439253 ncdv-master-1 devstack@n-api.service[115447]: X-Tenant-Name: admin Jul 23 21:05:02.439253 ncdv-master-1 devstack@n-api.service[115447]: X-User: admin Jul 23 21:05:02.439253 ncdv-master-1 devstack@n-api.service[115447]: X-User-Domain-Id: default Jul 23 21:05:02.439253 ncdv-master-1 devstack@n-api.service[115447]: X-User-Domain-Name: Default Jul 23 21:05:02.439253 ncdv-master-1 devstack@n-api.service[115447]: X-User-Id: ef460ef8c739443881697a7ad53288a2 Jul 23 21:05:02.439253 ncdv-master-1 devstack@n-api.service[115447]: X-User-Name: admin Jul 23 21:05:02.439253 ncdv-master-1 devstack@n-api.service[115447]: method: > Jul 23 21:05:02.439253 ncdv-master-1 devstack@n-api.service[115447]: exception: Flavor 451 could not be found. Jul 23 21:05:02.439253 ncdv-master-1 devstack@n-api.service[115447]: action_args: {'id': '451'} Jul 23 21:05:02.439253 ncdv-master-1 devstack@n-api.service[115447]: {{(pid=115447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:05:02.439253 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:05:02.440203 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 23 21:05:02.440203 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 23 21:05:02.440203 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 23 21:05:02.440203 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 23 21:05:02.440203 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 23 21:05:02.440203 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 23 21:05:02.440203 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 23 21:05:02.440203 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 23 21:05:02.440203 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 23 21:05:02.440203 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:05:02.440203 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 23 21:05:02.440203 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 23 21:05:02.440203 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 23 21:05:02.440203 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi Jul 23 21:05:02.440203 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:05:02.440203 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi Jul 23 21:05:02.440203 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:05:02.440203 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:05:02.440203 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:05:02.441627 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:05:02.441627 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:05:02.441627 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:05:02.441627 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:05:02.441627 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 23 21:05:02.441627 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:05:02.441627 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 23 21:05:02.441627 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi Jul 23 21:05:02.441627 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:05:02.441627 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi Jul 23 21:05:02.441627 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:05:02.441627 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:05:02.441627 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:05:02.441627 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:05:02.441627 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:05:02.441627 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 23 21:05:02.441627 ncdv-master-1 devstack@n-api.service[115447]: ERROR nova.api.openstack.wsgi Jul 23 21:05:02.441627 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi [None req-e62c1f79-5e54-4d0b-8552-84038e3adc02 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=115447) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:05:02.442975 ncdv-master-1 devstack@n-api.service[115447]: INFO nova.api.openstack.requestlog [None req-e62c1f79-5e54-4d0b-8552-84038e3adc02 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.016843 Jul 23 21:05:02.442975 ncdv-master-1 devstack@n-api.service[115447]: [pid: 115447|app: 0|req: 27/52] 10.222.0.17 () {60 vars in 1193 bytes} [Sat Jul 23 21:05:02 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 23 21:05:03.489810 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-f9f849c5-604c-4e0e-ae5b-556aac30b0b0 admin admin] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:05:03.491011 ncdv-master-1 devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-f9f849c5-604c-4e0e-ae5b-556aac30b0b0 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001995 Jul 23 21:05:03.491599 ncdv-master-1 devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 26/53] 10.222.0.17 () {56 vars in 1074 bytes} [Sat Jul 23 21:05:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:05:04.116348 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi [None req-4cceaa5b-2385-4a0d-8f9a-f7a25366e2c7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:05:04.136314 ncdv-master-1 devstack@n-api.service[115447]: INFO nova.api.openstack.requestlog [None req-4cceaa5b-2385-4a0d-8f9a-f7a25366e2c7 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.487149 Jul 23 21:05:04.137048 ncdv-master-1 devstack@n-api.service[115447]: [pid: 115447|app: 0|req: 28/54] 10.222.0.17 () {64 vars in 1235 bytes} [Sat Jul 23 21:05:03 2022] POST /compute/v2.1/flavors => generated 404 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 23 21:05:05.135569 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-f9f849c5-604c-4e0e-ae5b-556aac30b0b0 admin admin] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:05:05.136617 ncdv-master-1 devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-f9f849c5-604c-4e0e-ae5b-556aac30b0b0 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Jul 23 21:05:05.137005 ncdv-master-1 devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 27/55] 10.222.0.17 () {56 vars in 1074 bytes} [Sat Jul 23 21:05:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:05:05.706616 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi [None req-8250dc3c-a9a0-4e48-8db4-e299131f8f13 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:05:05.727025 ncdv-master-1 devstack@n-api.service[115447]: INFO nova.api.openstack.requestlog [None req-8250dc3c-a9a0-4e48-8db4-e299131f8f13 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.444638 Jul 23 21:05:05.727595 ncdv-master-1 devstack@n-api.service[115447]: [pid: 115447|app: 0|req: 29/56] 10.222.0.17 () {64 vars in 1235 bytes} [Sat Jul 23 21:05:05 2022] POST /compute/v2.1/flavors => generated 405 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 23 21:05:06.753562 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-f9f849c5-604c-4e0e-ae5b-556aac30b0b0 admin admin] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:05:06.754756 ncdv-master-1 devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-f9f849c5-604c-4e0e-ae5b-556aac30b0b0 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001960 Jul 23 21:05:06.755240 ncdv-master-1 devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 28/57] 10.222.0.17 () {56 vars in 1074 bytes} [Sat Jul 23 21:05:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:05:07.375607 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi [None req-8455f1da-2f5d-47fe-898e-e26412b99293 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:05:07.397307 ncdv-master-1 devstack@n-api.service[115447]: INFO nova.api.openstack.requestlog [None req-8455f1da-2f5d-47fe-898e-e26412b99293 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.486489 Jul 23 21:05:07.397884 ncdv-master-1 devstack@n-api.service[115447]: [pid: 115447|app: 0|req: 30/58] 10.222.0.17 () {64 vars in 1235 bytes} [Sat Jul 23 21:05:06 2022] POST /compute/v2.1/flavors => generated 407 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 23 21:05:08.422676 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-f9f849c5-604c-4e0e-ae5b-556aac30b0b0 admin admin] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:05:08.423786 ncdv-master-1 devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-f9f849c5-604c-4e0e-ae5b-556aac30b0b0 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001664 Jul 23 21:05:08.424195 ncdv-master-1 devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 29/59] 10.222.0.17 () {56 vars in 1074 bytes} [Sat Jul 23 21:05:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:05:09.012377 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi [None req-7a9faa29-4694-42f3-8138-f5fdc98ae80e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:05:09.032371 ncdv-master-1 devstack@n-api.service[115447]: INFO nova.api.openstack.requestlog [None req-7a9faa29-4694-42f3-8138-f5fdc98ae80e admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.461847 Jul 23 21:05:09.032918 ncdv-master-1 devstack@n-api.service[115447]: [pid: 115447|app: 0|req: 31/60] 10.222.0.17 () {64 vars in 1235 bytes} [Sat Jul 23 21:05:08 2022] POST /compute/v2.1/flavors => generated 409 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 23 21:05:10.080560 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-f9f849c5-604c-4e0e-ae5b-556aac30b0b0 admin admin] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:05:10.082102 ncdv-master-1 devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-f9f849c5-604c-4e0e-ae5b-556aac30b0b0 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002059 Jul 23 21:05:10.082622 ncdv-master-1 devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 30/61] 10.222.0.17 () {56 vars in 1074 bytes} [Sat Jul 23 21:05:10 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:05:10.688603 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi [None req-7425a7f7-bbb3-4a66-8310-74e8d301723a admin admin] Calling method '>' {{(pid=115447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:05:10.709070 ncdv-master-1 devstack@n-api.service[115447]: INFO nova.api.openstack.requestlog [None req-7425a7f7-bbb3-4a66-8310-74e8d301723a admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.479117 Jul 23 21:05:10.709627 ncdv-master-1 devstack@n-api.service[115447]: [pid: 115447|app: 0|req: 32/62] 10.222.0.17 () {60 vars in 1202 bytes} [Sat Jul 23 21:05:10 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:06:11.411301 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-f9f849c5-604c-4e0e-ae5b-556aac30b0b0 admin admin] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:06:11.412502 ncdv-master-1 devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-f9f849c5-604c-4e0e-ae5b-556aac30b0b0 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002031 Jul 23 21:06:11.413007 ncdv-master-1 devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 31/63] 10.222.0.17 () {54 vars in 930 bytes} [Sat Jul 23 21:06:11 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:06:11.423401 ncdv-master-1 devstack@n-api.service[115447]: DEBUG dbcounter [-] [115447] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=115447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:06:11.847388 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi [None req-bdb90ec4-e11b-499d-a26f-fecb0584804c admin admin] Calling method '>' {{(pid=115447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:06:11.866602 ncdv-master-1 devstack@n-api.service[115447]: INFO nova.api.openstack.requestlog [None req-bdb90ec4-e11b-499d-a26f-fecb0584804c admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.444683 Jul 23 21:06:11.867126 ncdv-master-1 devstack@n-api.service[115447]: [pid: 115447|app: 0|req: 33/64] 10.222.0.17 () {60 vars in 1291 bytes} [Sat Jul 23 21:06:11 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:06:11.888392 ncdv-master-1 devstack@n-api.service[115446]: DEBUG dbcounter [-] [115446] Writing DB stats nova_api:SELECT=14 {{(pid=115446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:06:11.892156 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-88657101-18e2-429f-84f0-f103af3bd6bf admin admin] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:06:11.900253 ncdv-master-1 devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-88657101-18e2-429f-84f0-f103af3bd6bf admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013683 Jul 23 21:06:11.900822 ncdv-master-1 devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 32/65] 10.222.0.17 () {60 vars in 1282 bytes} [Sat Jul 23 21:06:11 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:06:11.912906 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi [None req-2a456b3e-1ad5-4078-a0f2-4ffcd40e4eb7 admin admin] Calling method '>' {{(pid=115447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:06:11.920848 ncdv-master-1 devstack@n-api.service[115447]: INFO nova.api.openstack.requestlog [None req-2a456b3e-1ad5-4078-a0f2-4ffcd40e4eb7 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011552 Jul 23 21:06:11.921383 ncdv-master-1 devstack@n-api.service[115447]: [pid: 115447|app: 0|req: 34/66] 10.222.0.17 () {60 vars in 1285 bytes} [Sat Jul 23 21:06:11 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:06:11.933150 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-26fc8747-cbb0-4372-8194-b584de205d93 admin admin] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:06:11.941081 ncdv-master-1 devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-26fc8747-cbb0-4372-8194-b584de205d93 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011565 Jul 23 21:06:11.941597 ncdv-master-1 devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 33/67] 10.222.0.17 () {60 vars in 1285 bytes} [Sat Jul 23 21:06:11 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:06:11.953103 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi [None req-8acf8d15-a105-4ee7-aed7-622295386cef admin admin] Calling method '>' {{(pid=115447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:06:11.960933 ncdv-master-1 devstack@n-api.service[115447]: INFO nova.api.openstack.requestlog [None req-8acf8d15-a105-4ee7-aed7-622295386cef admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011401 Jul 23 21:06:11.961444 ncdv-master-1 devstack@n-api.service[115447]: [pid: 115447|app: 0|req: 35/68] 10.222.0.17 () {60 vars in 1282 bytes} [Sat Jul 23 21:06:11 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:11:44.856472 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-26fc8747-cbb0-4372-8194-b584de205d93 admin admin] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:11:44.857509 ncdv-master-1 devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-26fc8747-cbb0-4372-8194-b584de205d93 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001509 Jul 23 21:11:44.857890 ncdv-master-1 devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 34/69] 10.222.0.17 () {56 vars in 1074 bytes} [Sat Jul 23 21:11:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:11:45.011815 ncdv-master-1 devstack@n-api.service[115447]: DEBUG dbcounter [-] [115447] Writing DB stats nova_api:SELECT=6 {{(pid=115447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:11:45.186367 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi [None req-3b005707-ecd7-4c7a-80ec-aced93a4b71b admin admin] Calling method '>' {{(pid=115447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:11:45.188194 ncdv-master-1 devstack@n-api.service[115447]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:11:45.188194 ncdv-master-1 devstack@n-api.service[115447]: warnings.warn(msg) Jul 23 21:11:45.190385 ncdv-master-1 devstack@n-api.service[115447]: DEBUG oslo_concurrency.lockutils [None req-3b005707-ecd7-4c7a-80ec-aced93a4b71b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:11:45.191105 ncdv-master-1 devstack@n-api.service[115447]: DEBUG oslo_concurrency.lockutils [None req-3b005707-ecd7-4c7a-80ec-aced93a4b71b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:11:45.192408 ncdv-master-1 devstack@n-api.service[115447]: DEBUG oslo_concurrency.lockutils [None req-3b005707-ecd7-4c7a-80ec-aced93a4b71b admin admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:11:45.193010 ncdv-master-1 devstack@n-api.service[115447]: DEBUG oslo_concurrency.lockutils [None req-3b005707-ecd7-4c7a-80ec-aced93a4b71b admin admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:11:45.245089 ncdv-master-1 devstack@n-api.service[115447]: INFO nova.api.openstack.requestlog [None req-3b005707-ecd7-4c7a-80ec-aced93a4b71b admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.90 time: 0.235521 Jul 23 21:11:45.245694 ncdv-master-1 devstack@n-api.service[115447]: [pid: 115447|app: 0|req: 36/70] 10.222.0.17 () {60 vars in 1193 bytes} [Sat Jul 23 21:11:45 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:11:46.082294 ncdv-master-1 devstack@n-api.service[115446]: DEBUG nova.api.openstack.wsgi [None req-26fc8747-cbb0-4372-8194-b584de205d93 admin admin] Calling method '>' {{(pid=115446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:11:46.083479 ncdv-master-1 devstack@n-api.service[115446]: INFO nova.api.openstack.requestlog [None req-26fc8747-cbb0-4372-8194-b584de205d93 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001971 Jul 23 21:11:46.083876 ncdv-master-1 devstack@n-api.service[115446]: [pid: 115446|app: 0|req: 35/71] 10.222.0.17 () {56 vars in 1074 bytes} [Sat Jul 23 21:11:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:11:46.296768 ncdv-master-1 devstack@n-api.service[115447]: DEBUG nova.api.openstack.wsgi [None req-6e22e048-0382-4f3b-a689-2d71a4a50d00 admin admin] Calling method '>' {{(pid=115447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:11:46.297946 ncdv-master-1 devstack@n-api.service[115447]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:11:46.297946 ncdv-master-1 devstack@n-api.service[115447]: warnings.warn(msg) Jul 23 21:11:46.299168 ncdv-master-1 devstack@n-api.service[115447]: DEBUG oslo_concurrency.lockutils [None req-6e22e048-0382-4f3b-a689-2d71a4a50d00 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:11:46.299607 ncdv-master-1 devstack@n-api.service[115447]: DEBUG oslo_concurrency.lockutils [None req-6e22e048-0382-4f3b-a689-2d71a4a50d00 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:11:46.300447 ncdv-master-1 devstack@n-api.service[115447]: DEBUG oslo_concurrency.lockutils [None req-6e22e048-0382-4f3b-a689-2d71a4a50d00 admin admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:11:46.300895 ncdv-master-1 devstack@n-api.service[115447]: DEBUG oslo_concurrency.lockutils [None req-6e22e048-0382-4f3b-a689-2d71a4a50d00 admin admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:11:46.324107 ncdv-master-1 devstack@n-api.service[115447]: INFO nova.api.openstack.requestlog [None req-6e22e048-0382-4f3b-a689-2d71a4a50d00 admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.90 time: 0.086893 Jul 23 21:11:46.324592 ncdv-master-1 devstack@n-api.service[115447]: [pid: 115447|app: 0|req: 37/72] 10.222.0.17 () {60 vars in 1193 bytes} [Sat Jul 23 21:11:46 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:12:33.602862 ncdv-master-1 devstack@n-api.service[115445]: Sat Jul 23 21:12:33 2022 - graceful shutdown triggered... Jul 23 21:12:33.603010 ncdv-master-1 systemd[1]: Stopping Devstack devstack@n-api.service... Jul 23 21:12:33.604175 ncdv-master-1 devstack@n-api.service[115446]: Gracefully killing worker 1 (pid: 115446)... Jul 23 21:12:33.608809 ncdv-master-1 devstack@n-api.service[115447]: Gracefully killing worker 2 (pid: 115447)... Jul 23 21:12:34.605200 ncdv-master-1 devstack@n-api.service[115445]: worker 1 buried after 1 seconds Jul 23 21:12:34.605200 ncdv-master-1 devstack@n-api.service[115445]: worker 2 buried after 1 seconds Jul 23 21:12:34.605200 ncdv-master-1 devstack@n-api.service[115445]: goodbye to uWSGI. Jul 23 21:12:34.607674 ncdv-master-1 systemd[1]: devstack@n-api.service: Succeeded. Jul 23 21:12:34.608533 ncdv-master-1 systemd[1]: Stopped Devstack devstack@n-api.service. Jul 23 21:12:34.612051 ncdv-master-1 systemd[1]: Starting Devstack devstack@n-api.service... Jul 23 21:12:34.651402 ncdv-master-1 devstack@n-api.service[131305]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 23 21:12:34.669785 ncdv-master-1 devstack@n-api.service[131305]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Jul 23 21:12:34 2022] *** Jul 23 21:12:34.669785 ncdv-master-1 devstack@n-api.service[131305]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 23 21:12:34.669785 ncdv-master-1 devstack@n-api.service[131305]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 23 21:12:34.669785 ncdv-master-1 devstack@n-api.service[131305]: nodename: ncdv-master-1 Jul 23 21:12:34.669785 ncdv-master-1 devstack@n-api.service[131305]: machine: x86_64 Jul 23 21:12:34.669785 ncdv-master-1 devstack@n-api.service[131305]: clock source: unix Jul 23 21:12:34.669785 ncdv-master-1 devstack@n-api.service[131305]: pcre jit disabled Jul 23 21:12:34.669785 ncdv-master-1 devstack@n-api.service[131305]: detected number of CPU cores: 4 Jul 23 21:12:34.669785 ncdv-master-1 devstack@n-api.service[131305]: current working directory: / Jul 23 21:12:34.669785 ncdv-master-1 devstack@n-api.service[131305]: detected binary path: /usr/bin/uwsgi-core Jul 23 21:12:34.669785 ncdv-master-1 devstack@n-api.service[131305]: your processes number limit is 47680 Jul 23 21:12:34.669785 ncdv-master-1 devstack@n-api.service[131305]: your memory page size is 4096 bytes Jul 23 21:12:34.669785 ncdv-master-1 devstack@n-api.service[131305]: detected max file descriptor number: 2048 Jul 23 21:12:34.669785 ncdv-master-1 devstack@n-api.service[131305]: lock engine: pthread robust mutexes Jul 23 21:12:34.671314 ncdv-master-1 devstack@n-api.service[131305]: thunder lock: enabled Jul 23 21:12:34.671314 ncdv-master-1 devstack@n-api.service[131305]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 23 21:12:34.671314 ncdv-master-1 devstack@n-api.service[131305]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 23 21:12:34.719552 ncdv-master-1 devstack@n-api.service[131305]: Python main interpreter initialized at 0x564586be29c0 Jul 23 21:12:34.719552 ncdv-master-1 devstack@n-api.service[131305]: python threads support enabled Jul 23 21:12:34.719552 ncdv-master-1 devstack@n-api.service[131305]: your server socket listen backlog is limited to 100 connections Jul 23 21:12:34.719552 ncdv-master-1 devstack@n-api.service[131305]: your mercy for graceful operations on workers is 90 seconds Jul 23 21:12:34.719997 ncdv-master-1 devstack@n-api.service[131305]: mapped 403077 bytes (393 KB) for 2 cores Jul 23 21:12:34.719997 ncdv-master-1 devstack@n-api.service[131305]: *** Operational MODE: preforking *** Jul 23 21:12:34.720249 ncdv-master-1 devstack@n-api.service[131305]: *** uWSGI is running in multiple interpreter mode *** Jul 23 21:12:34.720249 ncdv-master-1 devstack@n-api.service[131305]: spawned uWSGI master process (pid: 131305) Jul 23 21:12:34.720476 ncdv-master-1 systemd[1]: Started Devstack devstack@n-api.service. Jul 23 21:12:34.725021 ncdv-master-1 devstack@n-api.service[131305]: spawned uWSGI worker 1 (pid: 131320, cores: 1) Jul 23 21:12:34.725021 ncdv-master-1 devstack@n-api.service[131305]: spawned uWSGI worker 2 (pid: 131321, cores: 1) Jul 23 21:12:34.725021 ncdv-master-1 devstack@n-api.service[131305]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 23 21:12:35.986269 ncdv-master-1 devstack@n-api.service[131320]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 23 21:12:35.986902 ncdv-master-1 devstack@n-api.service[131321]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 23 21:12:36.735545 ncdv-master-1 devstack@n-api.service[131320]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 23 21:12:36.735545 ncdv-master-1 devstack@n-api.service[131320]: from cryptography.utils import int_from_bytes Jul 23 21:12:36.735895 ncdv-master-1 devstack@n-api.service[131320]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 23 21:12:36.735895 ncdv-master-1 devstack@n-api.service[131320]: from cryptography.utils import int_from_bytes Jul 23 21:12:36.739951 ncdv-master-1 devstack@n-api.service[131321]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 23 21:12:36.739951 ncdv-master-1 devstack@n-api.service[131321]: from cryptography.utils import int_from_bytes Jul 23 21:12:36.740228 ncdv-master-1 devstack@n-api.service[131321]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 23 21:12:36.740228 ncdv-master-1 devstack@n-api.service[131321]: from cryptography.utils import int_from_bytes Jul 23 21:12:39.153284 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 23 21:12:39.153914 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 23 21:12:39.154050 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 23 21:12:39.154456 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 23 21:12:39.154712 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 23 21:12:39.155106 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.155251 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 23 21:12:39.155647 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 23 21:12:39.155751 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.155751 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.155945 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 23 21:12:39.156151 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.156296 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 23 21:12:39.156504 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.156593 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 23 21:12:39.156674 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.156931 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.157064 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.157261 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.157389 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.157580 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.157739 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.157844 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.157983 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.158203 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.158321 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.158525 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.158620 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.158842 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.158947 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.159150 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.159249 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.159462 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.159563 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.159718 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.159844 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.160032 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.160134 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.160348 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.160444 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.160672 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.160787 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.160970 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.161166 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.161278 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.161578 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.161705 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.161883 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.162006 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.162208 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.162350 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.162515 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.162642 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.162875 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.163020 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.163181 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.163318 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.163507 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.163669 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.163816 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.163909 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.164141 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.164241 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.164452 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.164558 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.164818 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.164916 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.165142 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.165277 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.165435 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.165561 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.165753 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.165855 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.166087 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.166190 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.166486 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.166622 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.166801 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.166912 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.167116 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.167217 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.167428 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.167532 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.167739 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.167829 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.168069 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.168164 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.168393 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.168488 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.168722 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.168814 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.169039 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.169171 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.169345 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.169441 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.169657 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.169755 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.169995 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.170090 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.170317 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.170418 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.170621 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.170736 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.170923 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.171026 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.171172 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.171263 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.171538 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.171647 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.171878 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.171979 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.172179 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.172281 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.172480 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.172582 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.172728 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.172828 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.173027 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.173130 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.173299 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.173391 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.173624 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.173722 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.173961 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.174118 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.174219 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.174318 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.174448 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.174574 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.174766 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.174868 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.175087 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.175199 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.175396 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.175498 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.175702 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.175807 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.176007 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.176106 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.176313 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.176404 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.176624 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.176764 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.176936 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.177047 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.177240 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.177338 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.177546 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.177638 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.177894 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.178006 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.178206 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.178305 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.178526 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.178627 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.178831 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.178930 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.179149 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.179240 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.179478 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.179578 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.179786 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.179884 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.180095 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.180187 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.180404 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.180500 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.180711 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.180810 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.181020 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.181131 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.181336 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.181427 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.181657 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.181753 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.181985 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.182094 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.182239 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.182339 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.182544 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.182635 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.182851 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.182951 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.183175 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.183280 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.183482 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.183575 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.183729 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.183912 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.184002 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.184094 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.184305 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.184444 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.184621 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.184727 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.184926 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.185024 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.185233 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.185330 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.185538 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.185633 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.185839 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.185974 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.186165 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.186266 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.186470 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.186562 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.186778 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.186877 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.187107 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.187205 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.187507 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.187621 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.187709 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.187791 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.188005 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.188096 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.188308 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.188408 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.188609 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.188701 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.188920 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.189032 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.189240 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.189341 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.189543 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.189648 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.189844 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.190005 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.190168 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.190308 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.190471 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.190572 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.190788 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.190887 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.191089 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.191180 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.191391 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.191489 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.191702 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.191801 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.192001 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.192093 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.192304 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.192394 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.192608 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.192712 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.192913 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.193009 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.193229 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.193365 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.193520 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.193668 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.193958 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.194076 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.194173 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.194265 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.194463 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.194573 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.194803 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.194932 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.195093 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.195194 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.195401 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.195517 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.195705 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.195819 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.196028 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.196134 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.196336 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.196435 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.196641 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.196742 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.196944 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.197059 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.197242 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.197343 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.197561 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.197663 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.197887 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.198015 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.198202 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.198314 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.198507 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.198646 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.198903 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.199122 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.199254 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.199448 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 23 21:12:39.199720 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.199824 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.200060 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.200173 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.200387 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.200497 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.200717 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.200828 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.201054 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.201166 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.201385 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.201484 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.201704 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.201812 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.202053 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.202213 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.202392 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.202528 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.202814 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.202965 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.203164 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.203305 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.203460 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.203608 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.203747 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.203857 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.204103 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.204257 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.204434 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.204586 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.204734 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.204849 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.205068 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.205219 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.205391 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.205529 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.205705 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.205854 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.206062 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.206173 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.206342 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.206481 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.206680 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.206851 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.207010 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.207129 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.207263 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.207352 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.207632 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.207770 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.207964 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.208113 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.208288 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.208425 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.208600 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.208786 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.208902 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.209000 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.209215 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.209365 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.209532 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.209670 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.209832 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.210017 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.210182 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.210322 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.210494 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.210645 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.210825 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.210957 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.211078 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.211197 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.211406 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.211571 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.211669 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.211763 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.211987 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.212116 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.212299 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.212436 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.212644 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.212958 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.213109 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.213253 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.213421 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.213571 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.213701 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.213919 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.214035 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.214177 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.214265 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.214517 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.214655 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.214823 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.214960 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.215141 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.215293 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.215390 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.215485 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.215724 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.215874 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.215977 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.216081 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.216293 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.216385 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.216594 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.216696 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.216912 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.217022 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.217237 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.217329 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.217542 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.217634 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.217854 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.217993 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.218209 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.218313 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.218526 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.218617 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.218832 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.218932 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.219139 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.219238 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.219442 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.219542 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.219751 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.219844 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.220057 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.220150 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.220358 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.220448 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.220677 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.220769 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.220984 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.221082 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.221283 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.221372 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.221598 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.221768 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.221986 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.222149 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.222267 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.222468 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.222573 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.222791 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.222920 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.223125 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.223230 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.223425 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.223543 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.223708 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.223821 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.224143 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.224325 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.224433 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.224643 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.224752 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.224936 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.225096 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.225271 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.225374 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.225554 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.225662 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.225990 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.226093 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.226224 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.226550 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.226657 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.226863 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.227002 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.227172 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.227276 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.227473 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.227565 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.227780 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.227876 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.228080 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.228182 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.228384 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.228484 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.228688 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.228788 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.228992 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.229080 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.229291 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.229381 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.229592 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.229694 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.229925 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.230131 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.230228 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.230450 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.230531 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.230758 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.230853 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.231117 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.231218 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.231403 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.231492 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.231812 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.231914 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.231990 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.232067 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.232325 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.232779 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.232916 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.233039 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.233159 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.233278 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.233390 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.233509 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.233634 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.233782 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.234128 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.234256 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.234376 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.234486 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.234636 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.234736 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.234936 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.235036 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.235270 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.235363 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.235595 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.235696 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.235902 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.236043 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.236228 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.236321 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.236537 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.236638 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.236856 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.236959 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.237164 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.237262 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.237486 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.237587 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.237803 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.237997 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.238143 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.238248 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.238469 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.238569 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.238787 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.238880 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.239234 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.239433 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.239570 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.239682 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.239790 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.239898 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.240171 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.240293 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.240381 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.240465 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.240680 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.240781 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.240987 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.241125 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.241279 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.241372 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.241590 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.241716 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.241924 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.242037 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.242252 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.242353 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.242566 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.242658 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.242888 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.242983 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.243193 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.243283 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.243508 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.243598 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.243812 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.243893 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.244127 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.244224 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.244432 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.244526 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.244742 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.244837 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.245069 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.245169 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.245381 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.245485 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.245693 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.245784 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.246070 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.246175 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.246341 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.246448 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.246647 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.246738 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.246958 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.247054 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.247269 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.247375 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.247572 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.247671 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.247875 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.247968 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.248183 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.248287 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.248494 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.248586 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.248801 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.249249 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.249502 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.249604 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.249805 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.249929 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.250147 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.250248 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.250457 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.250562 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.250761 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.250862 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.251061 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.251153 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.251369 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.251461 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.251687 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.251778 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.251994 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.252093 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.252315 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.252408 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.252627 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.252726 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.252930 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.253042 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.253240 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.253338 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.253546 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.253638 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.253854 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.254036 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.254209 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.254310 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.254477 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.254609 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.254764 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.254871 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.255107 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.255206 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.255416 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.255518 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.255717 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.255823 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.256037 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.256802 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.256904 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.257041 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.257041 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.257226 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.257321 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.257402 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.257473 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.257543 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.257642 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.257737 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.257851 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.257978 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.258183 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.258322 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.258491 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.258584 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.258800 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.258899 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.259108 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.259208 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.259416 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.259517 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.259726 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.259817 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.260038 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.260137 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.260345 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.260479 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.260652 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.260745 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.260959 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.261250 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.261378 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.261588 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.261682 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.261940 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.262069 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.262265 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.262568 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.262687 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.262902 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.263021 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.263218 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.263350 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.263605 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.263745 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.263899 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.264040 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.264211 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.264333 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.264512 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.264629 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.264823 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.264949 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.265187 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.265317 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.265503 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.265630 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.265812 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.265998 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.266148 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.266280 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.266449 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.266573 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.266759 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.266976 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.267092 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.267209 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.267349 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.267475 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.267652 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.267776 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.267955 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.268100 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.268258 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.268384 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.268561 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.268697 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.268899 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.269020 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.269151 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.269280 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.269461 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.269578 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.269763 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.269996 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.270091 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.270189 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.270398 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.270498 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.270703 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.270808 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.271036 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.271128 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.271339 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.271432 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.271640 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.271741 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.271941 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.272044 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.272282 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.272387 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.272590 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.272691 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.272932 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.273031 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.273256 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.273357 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.273560 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.273659 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.273906 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.274052 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.274202 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.274304 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.274528 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.274621 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.274841 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.274941 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.275148 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.275250 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.275462 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.275562 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.275774 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.275874 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.276087 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.276181 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.276392 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.276493 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.276694 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.276789 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.277004 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.277127 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.277307 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.277410 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.277607 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.277698 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.277948 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.278092 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.278263 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.278359 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.278581 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.278672 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.278896 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.279023 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.279207 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.279310 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.279520 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.279652 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.279823 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.279965 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.280124 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.280214 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.280428 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.280530 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.280757 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.280858 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.281063 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.281163 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.281366 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.281477 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.281678 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.281813 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.282012 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.282332 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.282552 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.282664 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.282983 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.283253 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.283357 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.283558 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.283667 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.283878 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.283977 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.284183 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.284284 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.284485 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.284586 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.284793 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.284884 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.285108 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.285200 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.285412 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.285520 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.285715 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.285822 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.286066 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.286387 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.286498 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.286693 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.286794 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.286999 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.287106 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.287312 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.287425 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.287627 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.288037 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.288326 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.288430 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.288592 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.288695 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.288941 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.289081 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.289300 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.289441 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.289610 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.289752 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.289939 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.290067 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.290247 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.290349 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.290550 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.290652 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.290876 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.290967 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.291181 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.291276 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.291486 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.291579 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.291792 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.291934 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.292096 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.292196 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.292418 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.292519 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.292744 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.292838 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.293032 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.293124 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.293337 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.293430 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.293638 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.293731 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.293986 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.294110 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.294303 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.294533 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.294652 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.294928 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.295074 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.295239 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.295345 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.295569 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.295671 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.295885 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.295986 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.296200 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.296356 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.296577 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.296678 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.296907 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.297059 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.297219 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.297367 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.297523 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.297671 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.297818 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.297975 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.298157 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.298262 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.298469 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.298563 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.298787 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.298888 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.299098 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.299193 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.299411 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.299513 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.299730 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.300042 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.300246 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.300404 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.300597 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.300761 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.300950 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.301125 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.301283 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.301439 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.301593 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.301743 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.301937 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.302109 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.302265 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.302414 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.302563 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.302721 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.302869 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.303026 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.303174 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.303331 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.303487 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.303645 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.303819 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.303968 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.304121 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.304270 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.304416 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.304566 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.304721 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.304877 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.305033 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.305181 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.305327 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.305476 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.305635 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.305802 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.306004 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.306163 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.306318 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.306469 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.306690 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.306850 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.307007 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.307157 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.307313 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.307497 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.307721 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.307885 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.308046 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.308195 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.308351 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.308510 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.308661 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.308810 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.308967 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.309122 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.309271 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.309434 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.309583 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.309738 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.309927 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.309927 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.310243 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.310407 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.310554 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.310710 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.310868 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.311017 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.311181 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.311336 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.311492 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.311646 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.311900 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.312094 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.312258 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.312408 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.312556 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.312701 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.312859 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.313016 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.313179 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.313328 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.313474 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.313665 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.313821 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.314072 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.314248 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.314404 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.314560 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.314709 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.314856 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.315012 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.315162 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.315309 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.315457 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.315610 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.315766 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.315925 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.316083 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.316242 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.316412 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.316565 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.316712 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.316891 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.317087 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.317250 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.317400 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.317569 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.317738 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.318016 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.318136 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.318237 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.318376 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.318492 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.318730 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.318911 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.319046 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.319163 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.319368 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.319555 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.319679 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.319793 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.320148 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.320281 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.320434 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.320646 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.320781 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.320903 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.321016 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.321219 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.321364 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.321569 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.321741 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.321915 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.322049 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.322165 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.322310 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.322523 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.322718 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.323099 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.323379 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.323914 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.324072 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.324200 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.324314 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.324447 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.324566 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.324780 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.324909 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.325361 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.325518 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.325660 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.325798 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.325962 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.326102 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.326240 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.326378 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.326508 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.326637 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.326810 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.326951 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.327143 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.327284 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.327463 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.327716 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.327859 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.328007 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.328217 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.328359 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.328497 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.328636 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.328769 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.328900 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.329070 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.329204 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.329400 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.329601 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.329742 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.329960 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.330109 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.330278 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.330418 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.330640 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.330774 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.330979 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.331117 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.331343 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.331530 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.331671 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.331802 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.331939 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.332076 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.332273 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.332426 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.332557 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.332685 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.332865 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.332999 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.333174 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.333319 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.333483 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.333622 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.333792 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.333979 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.334141 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.334284 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.334451 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.334583 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.334760 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.334900 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.335070 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.335217 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.335400 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.335532 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.335710 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.335842 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.336041 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.336175 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.336356 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.336495 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.336666 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.336806 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.336973 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.337116 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.337280 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.337413 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.337627 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.337759 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.337969 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.338113 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.338312 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.338499 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.338651 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.338803 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.338957 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.339114 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.339273 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.339429 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.339575 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.339676 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.339842 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.339939 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.340256 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.340420 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.340564 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.340706 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.340842 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.340972 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.341112 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.341243 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.341430 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.341570 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.341753 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.341966 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.342112 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.342260 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.342426 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.342575 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.342749 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.342889 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.343161 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.343364 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.343516 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.343655 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.343784 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.343983 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.344114 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.344317 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.344694 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.344828 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.344957 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.345095 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.345225 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.345353 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.345493 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.345623 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.345760 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.345910 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.346041 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.346192 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.346338 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.346509 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.346649 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.346828 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.346971 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.347143 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.347276 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.347473 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.347619 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.347798 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.347931 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.348126 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.348266 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.348500 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.348780 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.348958 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.349110 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.349267 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.349423 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.349577 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.349732 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.349909 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.350112 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.350451 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.350969 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.351307 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.351964 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.351964 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.352304 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.352630 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.352893 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.353055 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.353200 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.353366 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.353720 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.360507 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.360778 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.360956 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.361172 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.361172 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.361487 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.361662 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.361802 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.361980 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.362146 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.362312 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.362479 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.362992 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.363151 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.363302 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.363464 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.363619 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.363765 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.363911 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.364624 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.364783 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.364944 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.365103 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.365247 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.365402 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.365556 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.365711 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.365952 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.366108 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.366108 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.366403 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.366557 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.366717 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.366863 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.366863 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.367157 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.367303 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.367454 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.367614 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.367774 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.367920 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.368066 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.368219 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.368219 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.368583 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.368739 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.368884 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.369068 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.369227 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.369386 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.369532 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.369685 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.369839 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.370025 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.370171 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.370328 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.370480 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.370726 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.370890 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.371037 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.371201 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.371357 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.371501 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.371501 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.371791 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.371935 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.372096 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.372369 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.372528 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.372682 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.373152 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.373299 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.373464 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.373464 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.374262 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.374418 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.374574 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.374720 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.374878 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.375024 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.375177 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.375322 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.375465 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.375609 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.375766 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.375766 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.376070 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.376215 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.376366 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.376511 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.376664 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.376817 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.376971 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.377123 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.377275 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.377434 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.377578 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.377722 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.377906 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.378058 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.378203 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.378367 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.378514 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.378658 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.378801 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.407783 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.408188 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.408483 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.408764 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.409001 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.409287 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.410476 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.410648 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.410802 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.410950 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.411206 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.411369 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.411516 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.411516 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.411776 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.411909 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.412035 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.412158 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.412280 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.412414 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.412539 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.412670 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.412997 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.413129 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.413253 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.413393 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.413972 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.414116 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.414241 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.414365 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.414490 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.414621 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.414621 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.414869 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.414869 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.415101 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.415223 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.415371 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.415689 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.415850 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.415978 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.416103 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.416103 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.416346 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.416484 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.416609 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.416734 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.416734 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.416978 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.417105 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.417230 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.417355 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.417480 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.417604 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.417737 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.417884 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.418037 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.418213 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.418213 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.418213 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.418213 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.418910 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.419064 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.419064 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.419518 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.419679 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.419841 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.419990 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.420183 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.420440 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.420715 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.420996 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.421265 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.421479 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.421718 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.422031 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.422280 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.422280 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.422693 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.422925 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.423279 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.423426 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.423426 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.423426 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.423426 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.423426 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.423426 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.423426 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.424652 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.424652 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.424652 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.424652 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.424652 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.424652 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.424652 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.424652 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.426485 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.426644 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.426805 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.426805 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.427095 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.427259 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.427450 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.427620 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.427788 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.427921 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.427921 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.428170 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.428306 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.428432 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.428557 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.428681 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.428805 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.428930 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.429062 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.429190 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.429317 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.429483 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.429637 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.429801 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.430045 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.430200 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.430362 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.430524 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.430685 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.430685 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.430968 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.431095 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.431222 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.431348 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.431476 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.431601 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.431601 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.431864 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.431990 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.432116 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.432242 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.432376 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.432504 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.432629 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.432755 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.432881 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.433007 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.433141 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.433458 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.433607 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.433736 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.434154 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.434404 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.434550 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.434680 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.434807 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.434937 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.434937 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.435185 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.435313 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.435440 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.435578 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.435707 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.435850 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.436195 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.436332 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.436459 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.436586 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.436785 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.436956 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.437174 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.437306 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.437432 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.437681 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.437815 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.438060 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.439241 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.439393 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.439393 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.439641 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.439771 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.439910 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.439910 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.439910 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.439910 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.439910 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.439910 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.439910 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.439910 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.440900 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.440900 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.440900 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.440900 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.441494 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.441494 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.441494 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.441759 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.441854 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.442261 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.442433 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.442660 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.442795 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.442922 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.443051 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.443187 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.443317 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.443690 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.443832 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.443960 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.444110 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.444440 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.444582 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.444818 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.444952 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.445081 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.445209 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.445346 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.445509 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.445637 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.445763 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.445763 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.445763 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.446442 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.446442 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.446442 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.446442 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.446442 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.446442 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.446442 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.446442 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.447391 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.447391 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.447391 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.447391 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.447858 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.447858 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.447858 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.447858 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.447858 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.447858 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.447858 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.447858 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.448781 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.448907 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.449032 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.449166 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.449295 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.449420 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.449420 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.449678 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.449805 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.449966 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.450097 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.450223 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.450357 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.450487 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.450613 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.450747 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.450874 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.451000 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.451126 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.451252 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.451398 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.451525 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.451651 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.451777 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.451903 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.452029 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.452163 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.452291 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.452419 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.452560 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.452691 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.452817 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.452817 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.453076 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.453203 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.453329 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.453457 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.453609 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.453948 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.454078 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.454204 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.454204 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.454672 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.454828 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.455084 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.455228 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.455356 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.455483 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.455611 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.455746 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.455746 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.455985 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.456111 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.456236 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.456489 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.456736 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.456869 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.457006 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.457134 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=131320) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 23 21:12:39.457261 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.457261 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.457261 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.457261 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.457261 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.457261 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.457261 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.457261 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.458226 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.458226 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.458226 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.458226 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.458226 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.458226 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.458226 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.458226 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.459149 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.459149 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.459149 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 23 21:12:39.459149 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=131321) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 23 21:12:39.514601 ncdv-master-1 devstack@n-api.service[131320]: INFO dbcounter [None req-637d3d9c-2a57-4048-9301-e63415689e80 None None] Registered counter for database nova_api Jul 23 21:12:39.520608 ncdv-master-1 devstack@n-api.service[131321]: INFO dbcounter [None req-c805c803-5009-41df-b99d-2979472b47d6 None None] Registered counter for database nova_api Jul 23 21:12:39.541195 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_db.sqlalchemy.engines [None req-637d3d9c-2a57-4048-9301-e63415689e80 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=131320) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 21:12:39.542996 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_db.sqlalchemy.engines [None req-c805c803-5009-41df-b99d-2979472b47d6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=131321) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 21:12:39.548678 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writer thread running {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 23 21:12:39.550619 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writer thread running {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 23 21:12:39.608278 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.context [None req-637d3d9c-2a57-4048-9301-e63415689e80 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4e90cb14-d4b2-4158-b8cf-a592a1314a7b(cell1) {{(pid=131320) load_cells /opt/stack/nova/nova/context.py:464}} Jul 23 21:12:39.611970 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.context [None req-c805c803-5009-41df-b99d-2979472b47d6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4e90cb14-d4b2-4158-b8cf-a592a1314a7b(cell1) {{(pid=131321) load_cells /opt/stack/nova/nova/context.py:464}} Jul 23 21:12:39.613831 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-637d3d9c-2a57-4048-9301-e63415689e80 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:12:39.615486 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-637d3d9c-2a57-4048-9301-e63415689e80 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:12:39.616308 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-637d3d9c-2a57-4048-9301-e63415689e80 None None] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:12:39.617441 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c805c803-5009-41df-b99d-2979472b47d6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:12:39.618356 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-637d3d9c-2a57-4048-9301-e63415689e80 None None] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:12:39.619072 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c805c803-5009-41df-b99d-2979472b47d6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:12:39.619898 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c805c803-5009-41df-b99d-2979472b47d6 None None] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:12:39.620448 ncdv-master-1 devstack@n-api.service[131320]: INFO dbcounter [None req-637d3d9c-2a57-4048-9301-e63415689e80 None None] Registered counter for database nova_cell0 Jul 23 21:12:39.622076 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c805c803-5009-41df-b99d-2979472b47d6 None None] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:12:39.624672 ncdv-master-1 devstack@n-api.service[131321]: INFO dbcounter [None req-c805c803-5009-41df-b99d-2979472b47d6 None None] Registered counter for database nova_cell0 Jul 23 21:12:39.625103 ncdv-master-1 devstack@n-api.service[131320]: INFO dbcounter [None req-637d3d9c-2a57-4048-9301-e63415689e80 None None] Registered counter for database nova_cell1 Jul 23 21:12:39.629429 ncdv-master-1 devstack@n-api.service[131321]: INFO dbcounter [None req-c805c803-5009-41df-b99d-2979472b47d6 None None] Registered counter for database nova_cell1 Jul 23 21:12:39.635185 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_db.sqlalchemy.engines [None req-637d3d9c-2a57-4048-9301-e63415689e80 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=131320) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 21:12:39.636507 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_db.sqlalchemy.engines [None req-637d3d9c-2a57-4048-9301-e63415689e80 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=131320) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 21:12:39.637131 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_db.sqlalchemy.engines [None req-c805c803-5009-41df-b99d-2979472b47d6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=131321) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 21:12:39.639732 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_db.sqlalchemy.engines [None req-c805c803-5009-41df-b99d-2979472b47d6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=131321) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 21:12:39.642284 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writer thread running {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 23 21:12:39.644186 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writer thread running {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 23 21:12:39.783651 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writer thread running {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 23 21:12:39.786053 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writer thread running {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 23 21:12:39.794183 ncdv-master-1 devstack@n-api.service[131321]: INFO dbcounter [None req-c805c803-5009-41df-b99d-2979472b47d6 None None] Registered counter for database nova_cell0 Jul 23 21:12:39.796718 ncdv-master-1 devstack@n-api.service[131320]: INFO dbcounter [None req-637d3d9c-2a57-4048-9301-e63415689e80 None None] Registered counter for database nova_cell0 Jul 23 21:12:39.801637 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_db.sqlalchemy.engines [None req-c805c803-5009-41df-b99d-2979472b47d6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=131321) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 21:12:39.803429 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_db.sqlalchemy.engines [None req-637d3d9c-2a57-4048-9301-e63415689e80 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=131320) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 23 21:12:39.806477 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writer thread running {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 23 21:12:39.808545 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writer thread running {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 23 21:12:40.133499 ncdv-master-1 devstack@n-api.service[131321]: WARNING keystonemiddleware.auth_token [None req-c805c803-5009-41df-b99d-2979472b47d6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 23 21:12:40.140677 ncdv-master-1 devstack@n-api.service[131320]: WARNING keystonemiddleware.auth_token [None req-637d3d9c-2a57-4048-9301-e63415689e80 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 23 21:12:40.141097 ncdv-master-1 devstack@n-api.service[131321]: WARNING keystonemiddleware.auth_token [None req-c805c803-5009-41df-b99d-2979472b47d6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 23 21:12:40.148206 ncdv-master-1 devstack@n-api.service[131320]: WARNING keystonemiddleware.auth_token [None req-637d3d9c-2a57-4048-9301-e63415689e80 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 23 21:12:40.489163 ncdv-master-1 devstack@n-api.service[131321]: WARNING keystonemiddleware.auth_token [None req-c805c803-5009-41df-b99d-2979472b47d6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 23 21:12:40.495471 ncdv-master-1 devstack@n-api.service[131321]: WARNING keystonemiddleware.auth_token [None req-c805c803-5009-41df-b99d-2979472b47d6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 23 21:12:40.498028 ncdv-master-1 devstack@n-api.service[131320]: WARNING keystonemiddleware.auth_token [None req-637d3d9c-2a57-4048-9301-e63415689e80 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 23 21:12:40.501305 ncdv-master-1 devstack@n-api.service[131321]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564586be29c0 pid: 131321 (default app) Jul 23 21:12:40.504604 ncdv-master-1 devstack@n-api.service[131320]: WARNING keystonemiddleware.auth_token [None req-637d3d9c-2a57-4048-9301-e63415689e80 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 23 21:12:40.509958 ncdv-master-1 devstack@n-api.service[131320]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564586be29c0 pid: 131320 (default app) Jul 23 21:13:27.007047 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_api:SELECT=3 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:27.008251 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=3 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:27.009120 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell0:SELECT=3 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:27.009906 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell0:SELECT=3 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:27.131936 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=3 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:27.132874 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=3 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:27.133767 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=3 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:27.134682 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=3 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:28.124249 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-9df6d383-45e0-4c5a-9141-bbee789a79f7 tempest-FlavorsV255TestJSON-1696251215 tempest-FlavorsV255TestJSON-1696251215-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1490360298", "id": 835120882, "os-flavor-access:is_public": "True"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:13:28.147071 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:28.147071 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:13:28.200492 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-9df6d383-45e0-4c5a-9141-bbee789a79f7 tempest-FlavorsV255TestJSON-1696251215 tempest-FlavorsV255TestJSON-1696251215-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 446 microversion: 2.55 time: 1.202926 Jul 23 21:13:28.201249 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1/1] 10.222.0.17 () {62 vars in 1187 bytes} [Sat Jul 23 21:13:26 2022] POST /compute/v2.1/flavors => generated 446 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 23 21:13:28.215064 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ef78b9d9-c2de-461d-bc8c-22d27f214e85 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-2014300061", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:13:28.697727 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-5e4fda9b-38d7-4909-b08c-e6bf12f243c7 tempest-FlavorsV255TestJSON-1185546201 tempest-FlavorsV255TestJSON-1185546201-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:28.721453 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-5e4fda9b-38d7-4909-b08c-e6bf12f243c7 tempest-FlavorsV255TestJSON-1185546201 tempest-FlavorsV255TestJSON-1185546201-project] 10.222.0.17 "GET /compute/v2.1/flavors/835120882" status: 200 len: 446 microversion: 2.55 time: 0.512040 Jul 23 21:13:28.722075 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2/2] 10.222.0.17 () {60 vars in 1195 bytes} [Sat Jul 23 21:13:28 2022] GET /compute/v2.1/flavors/835120882 => generated 446 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 23 21:13:28.949715 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-1ab1fa57-d4d1-4c41-9f10-d85e8ff30fc2 tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:28.952000 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:28.952000 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:13:28.953883 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1ab1fa57-d4d1-4c41-9f10-d85e8ff30fc2 tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:28.954907 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1ab1fa57-d4d1-4c41-9f10-d85e8ff30fc2 tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:28.956177 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1ab1fa57-d4d1-4c41-9f10-d85e8ff30fc2 tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:28.956840 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1ab1fa57-d4d1-4c41-9f10-d85e8ff30fc2 tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:29.003334 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-1ab1fa57-d4d1-4c41-9f10-d85e8ff30fc2 tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.280057 Jul 23 21:13:29.003917 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 3/3] 10.222.0.17 () {58 vars in 1175 bytes} [Sat Jul 23 21:13:28 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:13:29.218504 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-ef78b9d9-c2de-461d-bc8c-22d27f214e85 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] validate_networks() for None {{(pid=131320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:13:29.280185 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-7f6eed48-e0c4-4063-b884-93cc9e29e004 tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] Calling method '.version_select at 0x7f0b568f0670>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:29.280992 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:29.280992 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:13:29.287242 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-7f6eed48-e0c4-4063-b884-93cc9e29e004 tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4e90cb14-d4b2-4158-b8cf-a592a1314a7b(cell1) {{(pid=131321) load_cells /opt/stack/nova/nova/compute/api.py:306}} Jul 23 21:13:29.288074 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7f6eed48-e0c4-4063-b884-93cc9e29e004 tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:29.288495 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7f6eed48-e0c4-4063-b884-93cc9e29e004 tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:29.321785 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7f6eed48-e0c4-4063-b884-93cc9e29e004 tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:29.321785 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7f6eed48-e0c4-4063-b884-93cc9e29e004 tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:29.330329 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7f6eed48-e0c4-4063-b884-93cc9e29e004 tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:29.330849 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7f6eed48-e0c4-4063-b884-93cc9e29e004 tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:29.336956 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-7f6eed48-e0c4-4063-b884-93cc9e29e004 tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.332055 Jul 23 21:13:29.337528 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 4/4] 10.222.0.17 () {58 vars in 1166 bytes} [Sat Jul 23 21:13:29 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:13:29.532751 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-9417cdd0-3eeb-4e34-9360-06e937d495d1 tempest-AggregatesAdminTestV241-1866405514 tempest-AggregatesAdminTestV241-1866405514-project-admin] Calling method '.version_select at 0x7f0b568f0940>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:29.534199 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:29.534199 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:13:29.535292 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9417cdd0-3eeb-4e34-9360-06e937d495d1 tempest-AggregatesAdminTestV241-1866405514 tempest-AggregatesAdminTestV241-1866405514-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:29.535733 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9417cdd0-3eeb-4e34-9360-06e937d495d1 tempest-AggregatesAdminTestV241-1866405514 tempest-AggregatesAdminTestV241-1866405514-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:29.553423 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9417cdd0-3eeb-4e34-9360-06e937d495d1 tempest-AggregatesAdminTestV241-1866405514 tempest-AggregatesAdminTestV241-1866405514-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:29.553891 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9417cdd0-3eeb-4e34-9360-06e937d495d1 tempest-AggregatesAdminTestV241-1866405514 tempest-AggregatesAdminTestV241-1866405514-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:29.564883 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9417cdd0-3eeb-4e34-9360-06e937d495d1 tempest-AggregatesAdminTestV241-1866405514 tempest-AggregatesAdminTestV241-1866405514-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:29.565428 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9417cdd0-3eeb-4e34-9360-06e937d495d1 tempest-AggregatesAdminTestV241-1866405514 tempest-AggregatesAdminTestV241-1866405514-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:29.573697 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-9417cdd0-3eeb-4e34-9360-06e937d495d1 tempest-AggregatesAdminTestV241-1866405514 tempest-AggregatesAdminTestV241-1866405514-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 0.234848 Jul 23 21:13:29.574142 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 5/5] 10.222.0.17 () {60 vars in 1207 bytes} [Sat Jul 23 21:13:29 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:13:29.579417 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d549b683-5957-4d60-b01a-bbca81754798 tempest-FlavorsV255TestJSON-1696251215 tempest-FlavorsV255TestJSON-1696251215-project-admin] Action: 'update', calling method: .version_select at 0x7f0b56e7cdc0>, body: {"flavor": {"description": "new"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:13:29.590907 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:29.590907 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:13:29.623554 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-ef78b9d9-c2de-461d-bc8c-22d27f214e85 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:13:29.623981 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-d549b683-5957-4d60-b01a-bbca81754798 tempest-FlavorsV255TestJSON-1696251215 tempest-FlavorsV255TestJSON-1696251215-project-admin] 10.222.0.17 "PUT /compute/v2.1/flavors/835120882" status: 200 len: 447 microversion: 2.55 time: 0.048485 Jul 23 21:13:29.624104 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-ef78b9d9-c2de-461d-bc8c-22d27f214e85 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:13:29.624564 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-ef78b9d9-c2de-461d-bc8c-22d27f214e85 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:13:29.625253 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 6/6] 10.222.0.17 () {62 vars in 1215 bytes} [Sat Jul 23 21:13:29 2022] PUT /compute/v2.1/flavors/835120882 => generated 447 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 23 21:13:29.625440 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-ef78b9d9-c2de-461d-bc8c-22d27f214e85 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:13:29.625819 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-ef78b9d9-c2de-461d-bc8c-22d27f214e85 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:13:29.640608 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ef78b9d9-c2de-461d-bc8c-22d27f214e85 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:29.641071 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ef78b9d9-c2de-461d-bc8c-22d27f214e85 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:29.641880 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ef78b9d9-c2de-461d-bc8c-22d27f214e85 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:29.642506 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ef78b9d9-c2de-461d-bc8c-22d27f214e85 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:29.678248 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-ef78b9d9-c2de-461d-bc8c-22d27f214e85 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Getting quotas for project 07101aee06ca4bb6885f87cfec3257db. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:13:29.687131 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-ef78b9d9-c2de-461d-bc8c-22d27f214e85 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Getting quotas for user 199522d29cb746379cb6f75d4b108cb9 and project 07101aee06ca4bb6885f87cfec3257db. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:13:29.699521 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ef78b9d9-c2de-461d-bc8c-22d27f214e85 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Going to run 1 instances... {{(pid=131320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:13:29.702267 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ef78b9d9-c2de-461d-bc8c-22d27f214e85 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] [instance: 5b41dd2d-cb23-4e57-91fc-1593508dc8cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:13:29.744033 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-53b56d2a-1a4f-4df3-aa5d-b95deefdda98 tempest-FlavorsExtraSpecsNegativeTestJSON-1305472578 tempest-FlavorsExtraSpecsNegativeTestJSON-1305472578-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1619110401", "ram": 512, "vcpus": 1, "disk": 10, "id": 1694354974, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:13:29.745621 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:29.745621 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:13:29.761684 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-53b56d2a-1a4f-4df3-aa5d-b95deefdda98 tempest-FlavorsExtraSpecsNegativeTestJSON-1305472578 tempest-FlavorsExtraSpecsNegativeTestJSON-1305472578-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.134925 Jul 23 21:13:29.762297 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 7/7] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:13:29 2022] POST /compute/v2.1/flavors => generated 416 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:13:29.779475 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ef78b9d9-c2de-461d-bc8c-22d27f214e85 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.660001 Jul 23 21:13:29.782079 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1/8] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:13:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 2663 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 23 21:13:29.787565 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0d9e55fd-08c5-41d9-9a46-775157fe22b9 tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1506497550"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:13:29.789715 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:29.789715 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:13:29.790795 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.objects.aggregate [None req-0d9e55fd-08c5-41d9-9a46-775157fe22b9 tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] Generated uuid 958381c5-008e-4ca8-80d6-7bab3f5f47d7 for aggregate {{(pid=131320) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 23 21:13:29.847194 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-0d9e55fd-08c5-41d9-9a46-775157fe22b9 tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.064021 Jul 23 21:13:29.847597 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2/9] 10.222.0.17 () {60 vars in 1163 bytes} [Sat Jul 23 21:13:29 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:13:29.899533 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-30f8cc8d-b14f-4cc0-9b3c-86bc9ccfe2ae tempest-HypervisorAdminUnderV252Test-1894436033 tempest-HypervisorAdminUnderV252Test-1894436033-project-admin] Calling method '.version_select at 0x7f0b568f0e50>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:29.900387 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:29.900387 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:13:29.901583 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-30f8cc8d-b14f-4cc0-9b3c-86bc9ccfe2ae tempest-HypervisorAdminUnderV252Test-1894436033 tempest-HypervisorAdminUnderV252Test-1894436033-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:29.902058 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-30f8cc8d-b14f-4cc0-9b3c-86bc9ccfe2ae tempest-HypervisorAdminUnderV252Test-1894436033 tempest-HypervisorAdminUnderV252Test-1894436033-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:29.916363 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-30f8cc8d-b14f-4cc0-9b3c-86bc9ccfe2ae tempest-HypervisorAdminUnderV252Test-1894436033 tempest-HypervisorAdminUnderV252Test-1894436033-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:29.916774 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-30f8cc8d-b14f-4cc0-9b3c-86bc9ccfe2ae tempest-HypervisorAdminUnderV252Test-1894436033 tempest-HypervisorAdminUnderV252Test-1894436033-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:29.927419 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-30f8cc8d-b14f-4cc0-9b3c-86bc9ccfe2ae tempest-HypervisorAdminUnderV252Test-1894436033 tempest-HypervisorAdminUnderV252Test-1894436033-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:29.927864 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-30f8cc8d-b14f-4cc0-9b3c-86bc9ccfe2ae tempest-HypervisorAdminUnderV252Test-1894436033 tempest-HypervisorAdminUnderV252Test-1894436033-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:29.934074 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-30f8cc8d-b14f-4cc0-9b3c-86bc9ccfe2ae tempest-HypervisorAdminUnderV252Test-1894436033 tempest-HypervisorAdminUnderV252Test-1894436033-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.170792 Jul 23 21:13:29.934655 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 8/10] 10.222.0.17 () {58 vars in 1145 bytes} [Sat Jul 23 21:13:29 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:13:29.940178 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-37b90513-62ba-455d-845d-0e900e96eef5 tempest-FlavorsV255TestJSON-1185546201 tempest-FlavorsV255TestJSON-1185546201-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:29.970980 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-37b90513-62ba-455d-845d-0e900e96eef5 tempest-FlavorsV255TestJSON-1185546201 tempest-FlavorsV255TestJSON-1185546201-project] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 6149 microversion: 2.55 time: 0.035205 Jul 23 21:13:29.971729 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 9/11] 10.222.0.17 () {60 vars in 1186 bytes} [Sat Jul 23 21:13:29 2022] GET /compute/v2.1/flavors/detail => generated 6149 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:13:29.972817 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-570609d0-a494-42b4-ad84-4dd19a0c1bf1 tempest-FlavorsAccessNegativeTestJSON-992011010 tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1063437525", "id": 1013477342, "os-flavor-access:is_public": "False"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:13:29.974422 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:29.974422 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:13:30.005038 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-570609d0-a494-42b4-ad84-4dd19a0c1bf1 tempest-FlavorsAccessNegativeTestJSON-992011010 tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.153336 Jul 23 21:13:30.011836 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3/12] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:13:29 2022] POST /compute/v2.1/flavors => generated 439 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:13:30.011836 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-899d552d-0b5d-4fee-a9e2-26fffd8d5086 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:30.011836 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-899d552d-0b5d-4fee-a9e2-26fffd8d5086 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] [instance: 5b41dd2d-cb23-4e57-91fc-1593508dc8cb] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:13:30.095181 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-df68b103-7137-4703-8079-3f57d8e3c57d tempest-FlavorsExtraSpecsNegativeTestJSON-1376996271 tempest-FlavorsExtraSpecsNegativeTestJSON-1376996271-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:30.102415 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-899d552d-0b5d-4fee-a9e2-26fffd8d5086 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199522d29cb746379cb6f75d4b108cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07101aee06ca4bb6885f87cfec3257db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:13:30.106912 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-df68b103-7137-4703-8079-3f57d8e3c57d tempest-FlavorsExtraSpecsNegativeTestJSON-1376996271 tempest-FlavorsExtraSpecsNegativeTestJSON-1376996271-project] HTTP exception thrown: Flavor 1694354974 has no extra specs with key hw:cpu_thread_policy. Jul 23 21:13:30.109129 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-df68b103-7137-4703-8079-3f57d8e3c57d tempest-FlavorsExtraSpecsNegativeTestJSON-1376996271 tempest-FlavorsExtraSpecsNegativeTestJSON-1376996271-project] Request method failure captured: Jul 23 21:13:30.109129 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/flavors/1694354974/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Jul 23 21:13:30.109129 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:13:30.109129 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:13:30.109129 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:13:30.109129 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:13:30.109129 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:13:30.109129 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:13:30.109129 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:13:30.109129 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:13:30.109129 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GR2icV8LwqDNEqzMFakjmvQw5isE_GRbmYP4Y6hGqWcR30oHTQIxppkYxN7lRTx69pbsaDVmthtXCCWLdGnpnas5_gg58h_E09c5b1Qei_obEJ8NBNsFRblAPCs7gqsI-A4RRoudXTOdntWBXGQskWxJa51CyeDkfcX5jHcFotrbXs Jul 23 21:13:30.109129 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:13:30.109129 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:13:30.109129 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:13:30.109129 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:13:30.109129 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:13:30.109129 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:13:30.109129 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 261deb211d6b45c39bbee3188d2ac559 Jul 23 21:13:30.109129 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1376996271 Jul 23 21:13:30.109129 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:13:30.109129 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:13:30.110609 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/261deb211d6b45c39bbee3188d2ac559"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/261deb211d6b45c39bbee3188d2ac559"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_261deb211d6b45c39bbee3188d2ac559", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/261deb211d6b45c39bbee3188d2ac559"}]}] Jul 23 21:13:30.110609 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1376996271 Jul 23 21:13:30.110609 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 261deb211d6b45c39bbee3188d2ac559 Jul 23 21:13:30.110609 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1376996271 Jul 23 21:13:30.110609 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1376996271-project Jul 23 21:13:30.110609 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:13:30.110609 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:13:30.110609 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: b62c516b2d50424c80d7ac4549900639 Jul 23 21:13:30.110609 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1376996271-project Jul 23 21:13:30.110609 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:13:30.110609 ncdv-master-1 devstack@n-api.service[131321]: exception: Flavor 1694354974 has no extra specs with key hw:cpu_thread_policy. Jul 23 21:13:30.111327 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'flavor_id': '1694354974', 'id': 'hw:cpu_thread_policy'} Jul 23 21:13:30.111327 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:13:30.111327 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:13:30.111327 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Jul 23 21:13:30.111327 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Jul 23 21:13:30.111327 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Jul 23 21:13:30.111327 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:13:30.111327 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:13:30.111327 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:13:30.111327 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:13:30.111327 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:13:30.111327 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:13:30.111327 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:13:30.111327 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:13:30.111327 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:13:30.111327 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:13:30.111327 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Jul 23 21:13:30.111327 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 23 21:13:30.111327 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1694354974 has no extra specs with key hw:cpu_thread_policy. Jul 23 21:13:30.111327 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:13:30.111327 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:13:30.111327 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:13:30.112588 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:13:30.112588 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:13:30.112588 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:13:30.112588 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:13:30.112588 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:13:30.112588 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1694354974 has no extra specs with key hw:cpu_thread_policy. Jul 23 21:13:30.112588 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:13:30.112588 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-df68b103-7137-4703-8079-3f57d8e3c57d tempest-FlavorsExtraSpecsNegativeTestJSON-1376996271 tempest-FlavorsExtraSpecsNegativeTestJSON-1376996271-project] Returning 404 to user: Flavor 1694354974 has no extra specs with key hw:cpu_thread_policy. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:13:30.112588 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-df68b103-7137-4703-8079-3f57d8e3c57d tempest-FlavorsExtraSpecsNegativeTestJSON-1376996271 tempest-FlavorsExtraSpecsNegativeTestJSON-1376996271-project] 10.222.0.17 "GET /compute/v2.1/flavors/1694354974/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.138311 Jul 23 21:13:30.112588 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 10/13] 10.222.0.17 () {58 vars in 1265 bytes} [Sat Jul 23 21:13:29 2022] GET /compute/v2.1/flavors/1694354974/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:13:30.118356 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c0cfd1b6-2714-4dd6-bf74-971dbe37425a tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:13:30.119857 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:30.119857 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:13:30.122040 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-899d552d-0b5d-4fee-a9e2-26fffd8d5086 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] 10.222.0.17 "GET /compute/v2.1/servers/5b41dd2d-cb23-4e57-91fc-1593508dc8cb" status: 200 len: 1220 microversion: 2.1 time: 0.114920 Jul 23 21:13:30.122791 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4/14] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:13:30 2022] GET /compute/v2.1/servers/5b41dd2d-cb23-4e57-91fc-1593508dc8cb => generated 1220 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:13:30.135653 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-28155d59-6b12-40ca-9532-fd723831a681 tempest-HypervisorAdminUnderV252Test-1894436033 tempest-HypervisorAdminUnderV252Test-1894436033-project-admin] Calling method '.version_select at 0x7f0b55025dc0>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:30.136591 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:30.136591 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:13:30.143197 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-28155d59-6b12-40ca-9532-fd723831a681 tempest-HypervisorAdminUnderV252Test-1894436033 tempest-HypervisorAdminUnderV252Test-1894436033-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4e90cb14-d4b2-4158-b8cf-a592a1314a7b(cell1) {{(pid=131320) load_cells /opt/stack/nova/nova/compute/api.py:306}} Jul 23 21:13:30.144050 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-28155d59-6b12-40ca-9532-fd723831a681 tempest-HypervisorAdminUnderV252Test-1894436033 tempest-HypervisorAdminUnderV252Test-1894436033-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:30.144497 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-28155d59-6b12-40ca-9532-fd723831a681 tempest-HypervisorAdminUnderV252Test-1894436033 tempest-HypervisorAdminUnderV252Test-1894436033-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:30.153531 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c0cfd1b6-2714-4dd6-bf74-971dbe37425a tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:30.154500 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c0cfd1b6-2714-4dd6-bf74-971dbe37425a tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:30.181767 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-28155d59-6b12-40ca-9532-fd723831a681 tempest-HypervisorAdminUnderV252Test-1894436033 tempest-HypervisorAdminUnderV252Test-1894436033-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:30.182308 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-28155d59-6b12-40ca-9532-fd723831a681 tempest-HypervisorAdminUnderV252Test-1894436033 tempest-HypervisorAdminUnderV252Test-1894436033-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:30.224935 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-28155d59-6b12-40ca-9532-fd723831a681 tempest-HypervisorAdminUnderV252Test-1894436033 tempest-HypervisorAdminUnderV252Test-1894436033-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:30.225579 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-28155d59-6b12-40ca-9532-fd723831a681 tempest-HypervisorAdminUnderV252Test-1894436033 tempest-HypervisorAdminUnderV252Test-1894436033-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:30.236442 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-28155d59-6b12-40ca-9532-fd723831a681 tempest-HypervisorAdminUnderV252Test-1894436033 tempest-HypervisorAdminUnderV252Test-1894436033-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors/nch2-master-1/servers" status: 200 len: 104 microversion: 2.1 time: 0.105402 Jul 23 21:13:30.237070 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 5/15] 10.222.0.17 () {58 vars in 1211 bytes} [Sat Jul 23 21:13:30 2022] GET /compute/v2.1/os-hypervisors/nch2-master-1/servers => generated 104 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:13:30.243699 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d0bffdf2-804c-401f-89f3-b26f7e4cc609 tempest-FlavorsV255TestJSON-1185546201 tempest-FlavorsV255TestJSON-1185546201-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:30.281248 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d0bffdf2-804c-401f-89f3-b26f7e4cc609 tempest-FlavorsV255TestJSON-1185546201 tempest-FlavorsV255TestJSON-1185546201-project] 10.222.0.17 "GET /compute/v2.1/flavors" status: 200 len: 3407 microversion: 2.55 time: 0.042407 Jul 23 21:13:30.282032 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 6/16] 10.222.0.17 () {60 vars in 1165 bytes} [Sat Jul 23 21:13:30 2022] GET /compute/v2.1/flavors => generated 3407 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:13:30.287541 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-efe538e4-d02a-4fbc-b32f-ccb53d35a449 tempest-FlavorsAccessNegativeTestJSON-992011010 tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "c62a56af2f634cf49e7556c47b3215a6"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:13:30.288904 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:30.288904 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:13:30.392783 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-efe538e4-d02a-4fbc-b32f-ccb53d35a449 tempest-FlavorsAccessNegativeTestJSON-992011010 tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors/1013477342/action" status: 200 len: 97 microversion: 2.1 time: 0.109533 Jul 23 21:13:30.393711 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 7/17] 10.222.0.17 () {60 vars in 1199 bytes} [Sat Jul 23 21:13:30 2022] POST /compute/v2.1/flavors/1013477342/action => generated 97 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 23 21:13:30.403657 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-98a82317-a49b-42b8-8562-f7fbf88b713a tempest-FlavorsExtraSpecsNegativeTestJSON-1376996271 tempest-FlavorsExtraSpecsNegativeTestJSON-1376996271-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:13:30.406034 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:30.406034 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:13:30.407149 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-98a82317-a49b-42b8-8562-f7fbf88b713a tempest-FlavorsExtraSpecsNegativeTestJSON-1376996271 tempest-FlavorsExtraSpecsNegativeTestJSON-1376996271-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': 'b62c516b2d50424c80d7ac4549900639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261deb211d6b45c39bbee3188d2ac559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:13:30.410968 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-98a82317-a49b-42b8-8562-f7fbf88b713a tempest-FlavorsExtraSpecsNegativeTestJSON-1376996271 tempest-FlavorsExtraSpecsNegativeTestJSON-1376996271-project] Request method failure captured: Jul 23 21:13:30.410968 ncdv-master-1 devstack@n-api.service[131320]: request: POST /compute/v2.1/flavors/1694354974/os-extra_specs HTTP/1.1 Jul 23 21:13:30.410968 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:13:30.410968 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:13:30.410968 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:13:30.410968 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 66 Jul 23 21:13:30.410968 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:13:30.410968 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:13:30.410968 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:13:30.410968 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:13:30.410968 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GR2icV8LwqDNEqzMFakjmvQw5isE_GRbmYP4Y6hGqWcR30oHTQIxppkYxN7lRTx69pbsaDVmthtXCCWLdGnpnas5_gg58h_E09c5b1Qei_obEJ8NBNsFRblAPCs7gqsI-A4RRoudXTOdntWBXGQskWxJa51CyeDkfcX5jHcFotrbXs Jul 23 21:13:30.410968 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:13:30.410968 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:13:30.410968 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:13:30.410968 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:13:30.410968 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:13:30.410968 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:13:30.410968 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 261deb211d6b45c39bbee3188d2ac559 Jul 23 21:13:30.410968 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1376996271 Jul 23 21:13:30.410968 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:13:30.410968 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:13:30.412061 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/261deb211d6b45c39bbee3188d2ac559"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/261deb211d6b45c39bbee3188d2ac559"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_261deb211d6b45c39bbee3188d2ac559", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/261deb211d6b45c39bbee3188d2ac559"}]}] Jul 23 21:13:30.412061 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1376996271 Jul 23 21:13:30.412061 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 261deb211d6b45c39bbee3188d2ac559 Jul 23 21:13:30.412061 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1376996271 Jul 23 21:13:30.412061 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1376996271-project Jul 23 21:13:30.412061 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:13:30.412061 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:13:30.412061 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: b62c516b2d50424c80d7ac4549900639 Jul 23 21:13:30.412061 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1376996271-project Jul 23 21:13:30.412061 ncdv-master-1 devstack@n-api.service[131320]: Jul 23 21:13:30.412061 ncdv-master-1 devstack@n-api.service[131320]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Jul 23 21:13:30.412061 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:13:30.412665 ncdv-master-1 devstack@n-api.service[131320]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jul 23 21:13:30.412665 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'flavor_id': '1694354974', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Jul 23 21:13:30.412665 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:13:30.412665 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:13:30.412665 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:13:30.412665 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:13:30.412665 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:13:30.412665 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:13:30.412665 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:13:30.412665 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:13:30.412665 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:13:30.412665 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:13:30.412665 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Jul 23 21:13:30.412665 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Jul 23 21:13:30.412665 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 23 21:13:30.412665 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 23 21:13:30.412665 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 23 21:13:30.412665 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 23 21:13:30.412665 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 23 21:13:30.413526 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 23 21:13:30.413526 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 23 21:13:30.413526 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise self.value Jul 23 21:13:30.413526 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 23 21:13:30.413526 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 23 21:13:30.413526 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 23 21:13:30.413526 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 23 21:13:30.413526 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 23 21:13:30.413526 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 23 21:13:30.413526 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jul 23 21:13:30.413526 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:13:30.413526 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:13:30.413526 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:13:30.413526 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:13:30.413526 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:13:30.413526 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:13:30.413526 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 23 21:13:30.413526 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 23 21:13:30.413526 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jul 23 21:13:30.413526 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:13:30.415787 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-98a82317-a49b-42b8-8562-f7fbf88b713a tempest-FlavorsExtraSpecsNegativeTestJSON-1376996271 tempest-FlavorsExtraSpecsNegativeTestJSON-1376996271-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:13:30.415787 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-98a82317-a49b-42b8-8562-f7fbf88b713a tempest-FlavorsExtraSpecsNegativeTestJSON-1376996271 tempest-FlavorsExtraSpecsNegativeTestJSON-1376996271-project] 10.222.0.17 "POST /compute/v2.1/flavors/1694354974/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.017990 Jul 23 21:13:30.415787 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 8/18] 10.222.0.17 () {60 vars in 1223 bytes} [Sat Jul 23 21:13:30 2022] POST /compute/v2.1/flavors/1694354974/os-extra_specs => generated 124 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:13:30.423668 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8917da8a-9f5f-4452-ae3a-0958288eeb44 tempest-HypervisorAdminUnderV252Test-1894436033 tempest-HypervisorAdminUnderV252Test-1894436033-project-admin] Calling method '.version_select at 0x7f0b54f86940>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:30.424479 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:30.424479 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:13:30.425657 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8917da8a-9f5f-4452-ae3a-0958288eeb44 tempest-HypervisorAdminUnderV252Test-1894436033 tempest-HypervisorAdminUnderV252Test-1894436033-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:30.428266 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8917da8a-9f5f-4452-ae3a-0958288eeb44 tempest-HypervisorAdminUnderV252Test-1894436033 tempest-HypervisorAdminUnderV252Test-1894436033-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:30.452430 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8917da8a-9f5f-4452-ae3a-0958288eeb44 tempest-HypervisorAdminUnderV252Test-1894436033 tempest-HypervisorAdminUnderV252Test-1894436033-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:30.452914 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8917da8a-9f5f-4452-ae3a-0958288eeb44 tempest-HypervisorAdminUnderV252Test-1894436033 tempest-HypervisorAdminUnderV252Test-1894436033-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:30.453198 ncdv-master-1 devstack@n-api.service[131321]: WARNING nova.scheduler.client.report [None req-c0cfd1b6-2714-4dd6-bf74-971dbe37425a tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] [req-6644acc0-8042-4d60-8147-6cbdff4e4104] Failed to update aggregates to [958381c5-008e-4ca8-80d6-7bab3f5f47d7] for resource provider with UUID 79fff676-0ce0-4531-aac0-7086504b3706. Got 409: {"errors": [{"status": 409, "title": "Conflict", "detail": "There was a conflict when trying to complete your request.\n\n Update conflict: Another thread concurrently updated the resource provider data. Please retry your update ", "request_id": "req-6644acc0-8042-4d60-8147-6cbdff4e4104"}]} Jul 23 21:13:30.463292 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8917da8a-9f5f-4452-ae3a-0958288eeb44 tempest-HypervisorAdminUnderV252Test-1894436033 tempest-HypervisorAdminUnderV252Test-1894436033-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:30.463742 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8917da8a-9f5f-4452-ae3a-0958288eeb44 tempest-HypervisorAdminUnderV252Test-1894436033 tempest-HypervisorAdminUnderV252Test-1894436033-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:30.469703 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8917da8a-9f5f-4452-ae3a-0958288eeb44 tempest-HypervisorAdminUnderV252Test-1894436033 tempest-HypervisorAdminUnderV252Test-1894436033-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.051010 Jul 23 21:13:30.470605 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 9/19] 10.222.0.17 () {58 vars in 1145 bytes} [Sat Jul 23 21:13:30 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:13:30.475137 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2691cc02-e488-4f80-a307-862b7c766f66 tempest-FlavorsV255TestJSON-1696251215 tempest-FlavorsV255TestJSON-1696251215-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:30.475831 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:30.475831 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:13:30.517553 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2691cc02-e488-4f80-a307-862b7c766f66 tempest-FlavorsV255TestJSON-1696251215 tempest-FlavorsV255TestJSON-1696251215-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/835120882" status: 202 len: 0 microversion: 2.55 time: 0.045724 Jul 23 21:13:30.518441 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 10/20] 10.222.0.17 () {60 vars in 1198 bytes} [Sat Jul 23 21:13:30 2022] DELETE /compute/v2.1/flavors/835120882 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:13:30.523779 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-87c1062e-435a-4501-acde-73c4a809ff3b tempest-FlavorsAccessNegativeTestJSON-992011010 tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "c62a56af2f634cf49e7556c47b3215a6"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:13:30.525448 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:30.525448 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:13:30.563340 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-c0cfd1b6-2714-4dd6-bf74-971dbe37425a tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 242 microversion: 2.1 time: 0.450899 Jul 23 21:13:30.564413 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 11/21] 10.222.0.17 () {60 vars in 1190 bytes} [Sat Jul 23 21:13:30 2022] POST /compute/v2.1/os-aggregates/1/action => generated 242 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:13:30.570933 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-0ee6afaa-84e7-4ea0-8201-6448fc7d06fa tempest-FlavorsExtraSpecsNegativeTestJSON-1305472578 tempest-FlavorsExtraSpecsNegativeTestJSON-1305472578-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:13:30.573977 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:30.573977 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:13:30.607207 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-87c1062e-435a-4501-acde-73c4a809ff3b tempest-FlavorsAccessNegativeTestJSON-992011010 tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin] HTTP exception thrown: Flavor access already exists for flavor 17 and project c62a56af2f634cf49e7556c47b3215a6 combination. Jul 23 21:13:30.613168 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-0ee6afaa-84e7-4ea0-8201-6448fc7d06fa tempest-FlavorsExtraSpecsNegativeTestJSON-1305472578 tempest-FlavorsExtraSpecsNegativeTestJSON-1305472578-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors/1694354974/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.047091 Jul 23 21:13:30.616300 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 12/22] 10.222.0.17 () {60 vars in 1223 bytes} [Sat Jul 23 21:13:30 2022] POST /compute/v2.1/flavors/1694354974/os-extra_specs => generated 66 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 23 21:13:30.620544 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c7a90185-ad05-4bf8-9621-b78c09820f2b tempest-HypervisorAdminUnderV252Test-1894436033 tempest-HypervisorAdminUnderV252Test-1894436033-project-admin] Calling method '.version_select at 0x7f0b5500daf0>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:30.621366 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:30.621366 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:13:30.622841 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c7a90185-ad05-4bf8-9621-b78c09820f2b tempest-HypervisorAdminUnderV252Test-1894436033 tempest-HypervisorAdminUnderV252Test-1894436033-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:30.623467 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c7a90185-ad05-4bf8-9621-b78c09820f2b tempest-HypervisorAdminUnderV252Test-1894436033 tempest-HypervisorAdminUnderV252Test-1894436033-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:30.630765 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-87c1062e-435a-4501-acde-73c4a809ff3b tempest-FlavorsAccessNegativeTestJSON-992011010 tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin] Request method failure captured: Jul 23 21:13:30.630765 ncdv-master-1 devstack@n-api.service[131320]: request: POST /compute/v2.1/flavors/1013477342/action HTTP/1.1 Jul 23 21:13:30.630765 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:13:30.630765 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:13:30.630765 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:13:30.630765 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 67 Jul 23 21:13:30.630765 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:13:30.630765 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:13:30.630765 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:13:30.630765 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:13:30.630765 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GR43ePav1lEHwpfyBf7WCA7TZgTvVv8cm7vx6QxU7CHq4rKCJodVxSJF0TcSvBkkgaNe9gwSKz33j5EKxv1ebFaChvRNn48gaEoQwXRp4HeCAO4q3W6xU3VXWrgrukRdjtQw7-bWwJYmjoCwUL-JtAr4xWEVwnkddvViGQIsEZopC8 Jul 23 21:13:30.630765 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:13:30.630765 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:13:30.630765 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:13:30.630765 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:13:30.630765 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:13:30.630765 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:13:30.630765 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 769afe32bc5d48dd9e24186168aaa3e1 Jul 23 21:13:30.630765 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-992011010 Jul 23 21:13:30.630765 ncdv-master-1 devstack@n-api.service[131320]: X-Role: admin,reader,member Jul 23 21:13:30.630765 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: admin,reader,member Jul 23 21:13:30.632187 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/769afe32bc5d48dd9e24186168aaa3e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/769afe32bc5d48dd9e24186168aaa3e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_769afe32bc5d48dd9e24186168aaa3e1", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/769afe32bc5d48dd9e24186168aaa3e1"}]}] Jul 23 21:13:30.632187 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-992011010 Jul 23 21:13:30.632187 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 769afe32bc5d48dd9e24186168aaa3e1 Jul 23 21:13:30.632187 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-992011010 Jul 23 21:13:30.632187 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin Jul 23 21:13:30.632187 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:13:30.632187 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:13:30.632187 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 2f243774c8494e10b8b1690f2da39b82 Jul 23 21:13:30.632187 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin Jul 23 21:13:30.632187 ncdv-master-1 devstack@n-api.service[131320]: Jul 23 21:13:30.632187 ncdv-master-1 devstack@n-api.service[131320]: {"addTenantAccess": {"tenant": "c62a56af2f634cf49e7556c47b3215a6"}} Jul 23 21:13:30.632187 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:13:30.633056 ncdv-master-1 devstack@n-api.service[131320]: exception: Flavor access already exists for flavor 17 and project c62a56af2f634cf49e7556c47b3215a6 combination. Jul 23 21:13:30.633056 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '1013477342', 'body': {'addTenantAccess': {'tenant': 'c62a56af2f634cf49e7556c47b3215a6'}}} Jul 23 21:13:30.633056 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:13:30.633056 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:13:30.633056 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 23 21:13:30.633056 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 23 21:13:30.633056 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 23 21:13:30.633056 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 23 21:13:30.633056 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 23 21:13:30.633056 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 23 21:13:30.633056 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 23 21:13:30.633056 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 23 21:13:30.633056 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 23 21:13:30.633056 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 23 21:13:30.633056 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 23 21:13:30.633056 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi result.read() Jul 23 21:13:30.633056 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 23 21:13:30.633056 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 23 21:13:30.634992 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 23 21:13:30.634992 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 23 21:13:30.634992 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 23 21:13:30.634992 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 23 21:13:30.634992 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 23 21:13:30.634992 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 23 21:13:30.634992 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '17-c62a56af2f634cf49e7556c47b3215a6' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Jul 23 21:13:30.634992 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:13:30.634992 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 23 21:13:30.634992 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:13:30.634992 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:13:30.634992 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Jul 23 21:13:30.634992 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi project.save(context.session) Jul 23 21:13:30.634992 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jul 23 21:13:30.634992 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi session.flush() Jul 23 21:13:30.634992 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 23 21:13:30.634992 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self._flush(objects) Jul 23 21:13:30.634992 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 23 21:13:30.634992 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jul 23 21:13:30.636139 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 23 21:13:30.636139 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi compat.raise_( Jul 23 21:13:30.636139 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 23 21:13:30.636139 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception Jul 23 21:13:30.636139 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 23 21:13:30.636139 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi flush_context.execute() Jul 23 21:13:30.636139 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 23 21:13:30.636139 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi rec.execute(self) Jul 23 21:13:30.636139 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 23 21:13:30.636139 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jul 23 21:13:30.636139 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 23 21:13:30.636139 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jul 23 21:13:30.636139 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 23 21:13:30.636139 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jul 23 21:13:30.636139 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 23 21:13:30.636139 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jul 23 21:13:30.636139 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 23 21:13:30.636139 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jul 23 21:13:30.637120 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 23 21:13:30.637120 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jul 23 21:13:30.637120 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 23 21:13:30.637120 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jul 23 21:13:30.637120 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 23 21:13:30.637120 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 23 21:13:30.637120 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 23 21:13:30.637120 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception Jul 23 21:13:30.637120 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 23 21:13:30.637120 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 23 21:13:30.637120 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 23 21:13:30.637120 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 23 21:13:30.637120 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 23 21:13:30.637120 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 23 21:13:30.637120 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 23 21:13:30.637120 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 23 21:13:30.637120 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 23 21:13:30.637120 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 23 21:13:30.638119 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 23 21:13:30.638119 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi result.read() Jul 23 21:13:30.638119 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 23 21:13:30.638119 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 23 21:13:30.638119 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 23 21:13:30.638119 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 23 21:13:30.638119 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 23 21:13:30.638119 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 23 21:13:30.638119 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 23 21:13:30.638119 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 23 21:13:30.638119 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '17-c62a56af2f634cf49e7556c47b3215a6' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Jul 23 21:13:30.638119 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Jul 23 21:13:30.638119 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 7, 23, 21, 13, 30, 601946), 'updated_at': None, 'flavor_id': 17, 'project_id': 'c62a56af2f634cf49e7556c47b3215a6'}] Jul 23 21:13:30.638119 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 23 21:13:30.638119 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:13:30.638119 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:13:30.638119 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:13:30.639088 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:13:30.639088 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Jul 23 21:13:30.639088 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Jul 23 21:13:30.639088 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 23 21:13:30.639088 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 23 21:13:30.639088 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Jul 23 21:13:30.639088 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Jul 23 21:13:30.639088 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Jul 23 21:13:30.639088 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Jul 23 21:13:30.639088 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Jul 23 21:13:30.639088 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Jul 23 21:13:30.639088 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 23 21:13:30.639088 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 23 21:13:30.639088 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Jul 23 21:13:30.639088 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Jul 23 21:13:30.639088 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 17 and project c62a56af2f634cf49e7556c47b3215a6 combination. Jul 23 21:13:30.639088 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:13:30.639088 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:13:30.639088 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:13:30.640456 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:13:30.640456 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:13:30.640456 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:13:30.640456 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:13:30.640456 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:13:30.640456 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:13:30.640456 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:13:30.640456 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:13:30.640456 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:13:30.640456 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Jul 23 21:13:30.640456 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Jul 23 21:13:30.640456 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 17 and project c62a56af2f634cf49e7556c47b3215a6 combination. Jul 23 21:13:30.640456 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:13:30.640456 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:13:30.640456 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:13:30.640456 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:13:30.640456 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:13:30.640456 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:13:30.640456 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:13:30.640456 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:13:30.642773 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 17 and project c62a56af2f634cf49e7556c47b3215a6 combination. Jul 23 21:13:30.642773 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:13:30.642773 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-87c1062e-435a-4501-acde-73c4a809ff3b tempest-FlavorsAccessNegativeTestJSON-992011010 tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin] Returning 409 to user: Flavor access already exists for flavor 17 and project c62a56af2f634cf49e7556c47b3215a6 combination. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:13:30.642773 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-87c1062e-435a-4501-acde-73c4a809ff3b tempest-FlavorsAccessNegativeTestJSON-992011010 tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors/1013477342/action" status: 409 len: 152 microversion: 2.1 time: 0.114145 Jul 23 21:13:30.642773 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 11/23] 10.222.0.17 () {60 vars in 1199 bytes} [Sat Jul 23 21:13:30 2022] POST /compute/v2.1/flavors/1013477342/action => generated 152 bytes in 115 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 23 21:13:30.642773 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e9c490a2-621e-447e-99f4-9b693040374e tempest-FlavorsV255TestJSON-1696251215 tempest-FlavorsV255TestJSON-1696251215-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:30.652973 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c7a90185-ad05-4bf8-9621-b78c09820f2b tempest-HypervisorAdminUnderV252Test-1894436033 tempest-HypervisorAdminUnderV252Test-1894436033-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:30.653601 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c7a90185-ad05-4bf8-9621-b78c09820f2b tempest-HypervisorAdminUnderV252Test-1894436033 tempest-HypervisorAdminUnderV252Test-1894436033-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:30.659888 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-c7a90185-ad05-4bf8-9621-b78c09820f2b tempest-HypervisorAdminUnderV252Test-1894436033 tempest-HypervisorAdminUnderV252Test-1894436033-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors/nch2-master-1/search" status: 200 len: 104 microversion: 2.1 time: 0.043958 Jul 23 21:13:30.667564 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 13/24] 10.222.0.17 () {58 vars in 1208 bytes} [Sat Jul 23 21:13:30 2022] GET /compute/v2.1/os-hypervisors/nch2-master-1/search => generated 104 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:13:30.672948 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e9c490a2-621e-447e-99f4-9b693040374e tempest-FlavorsV255TestJSON-1696251215 tempest-FlavorsV255TestJSON-1696251215-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 5712 microversion: 2.55 time: 0.037421 Jul 23 21:13:30.673916 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 12/25] 10.222.0.17 () {60 vars in 1186 bytes} [Sat Jul 23 21:13:30 2022] GET /compute/v2.1/flavors/detail => generated 5712 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:13:30.675355 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-4cd5f0d4-b553-4d65-9657-6f0c1a61be58 tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:13:30.676787 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:30.676787 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:13:30.682380 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a230519b-e7c7-4697-a5a0-1ef2f76f09c4 tempest-FlavorsExtraSpecsNegativeTestJSON-1376996271 tempest-FlavorsExtraSpecsNegativeTestJSON-1376996271-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:30.684072 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:30.684072 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:13:30.686283 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4cd5f0d4-b553-4d65-9657-6f0c1a61be58 tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:30.687004 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4cd5f0d4-b553-4d65-9657-6f0c1a61be58 tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:30.697898 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a230519b-e7c7-4697-a5a0-1ef2f76f09c4 tempest-FlavorsExtraSpecsNegativeTestJSON-1376996271 tempest-FlavorsExtraSpecsNegativeTestJSON-1376996271-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': 'b62c516b2d50424c80d7ac4549900639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261deb211d6b45c39bbee3188d2ac559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:13:30.701124 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a230519b-e7c7-4697-a5a0-1ef2f76f09c4 tempest-FlavorsExtraSpecsNegativeTestJSON-1376996271 tempest-FlavorsExtraSpecsNegativeTestJSON-1376996271-project] Request method failure captured: Jul 23 21:13:30.701124 ncdv-master-1 devstack@n-api.service[131320]: request: DELETE /compute/v2.1/flavors/1694354974/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 23 21:13:30.701124 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:13:30.701124 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:13:30.701124 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:13:30.701124 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:13:30.701124 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:13:30.701124 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:13:30.701124 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:13:30.701124 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:13:30.701124 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GR2icV8LwqDNEqzMFakjmvQw5isE_GRbmYP4Y6hGqWcR30oHTQIxppkYxN7lRTx69pbsaDVmthtXCCWLdGnpnas5_gg58h_E09c5b1Qei_obEJ8NBNsFRblAPCs7gqsI-A4RRoudXTOdntWBXGQskWxJa51CyeDkfcX5jHcFotrbXs Jul 23 21:13:30.701124 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:13:30.701124 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:13:30.701124 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:13:30.701124 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:13:30.701124 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:13:30.701124 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:13:30.701124 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 261deb211d6b45c39bbee3188d2ac559 Jul 23 21:13:30.701124 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1376996271 Jul 23 21:13:30.701124 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:13:30.701124 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:13:30.702224 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/261deb211d6b45c39bbee3188d2ac559"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/261deb211d6b45c39bbee3188d2ac559"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_261deb211d6b45c39bbee3188d2ac559", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/261deb211d6b45c39bbee3188d2ac559"}]}] Jul 23 21:13:30.702224 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1376996271 Jul 23 21:13:30.702224 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 261deb211d6b45c39bbee3188d2ac559 Jul 23 21:13:30.702224 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1376996271 Jul 23 21:13:30.702224 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1376996271-project Jul 23 21:13:30.702224 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:13:30.702224 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:13:30.702224 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: b62c516b2d50424c80d7ac4549900639 Jul 23 21:13:30.702224 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1376996271-project Jul 23 21:13:30.702224 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:13:30.702224 ncdv-master-1 devstack@n-api.service[131320]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jul 23 21:13:30.702772 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'flavor_id': '1694354974', 'id': 'hw:numa_nodes'} Jul 23 21:13:30.702772 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:13:30.702772 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:13:30.702772 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:13:30.702772 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:13:30.702772 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:13:30.702772 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:13:30.702772 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:13:30.702772 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:13:30.702772 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Jul 23 21:13:30.702772 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Jul 23 21:13:30.702772 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 23 21:13:30.702772 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 23 21:13:30.702772 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 23 21:13:30.702772 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 23 21:13:30.702772 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 23 21:13:30.702772 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 23 21:13:30.702772 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 23 21:13:30.702772 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise self.value Jul 23 21:13:30.702772 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 23 21:13:30.703702 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 23 21:13:30.703702 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 23 21:13:30.703702 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 23 21:13:30.703702 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 23 21:13:30.703702 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 23 21:13:30.703702 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jul 23 21:13:30.703702 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:13:30.703702 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:13:30.703702 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:13:30.703702 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:13:30.703702 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:13:30.703702 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:13:30.703702 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 23 21:13:30.703702 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 23 21:13:30.703702 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jul 23 21:13:30.703702 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:13:30.703702 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a230519b-e7c7-4697-a5a0-1ef2f76f09c4 tempest-FlavorsExtraSpecsNegativeTestJSON-1376996271 tempest-FlavorsExtraSpecsNegativeTestJSON-1376996271-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:13:30.704582 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a230519b-e7c7-4697-a5a0-1ef2f76f09c4 tempest-FlavorsExtraSpecsNegativeTestJSON-1376996271 tempest-FlavorsExtraSpecsNegativeTestJSON-1376996271-project] 10.222.0.17 "DELETE /compute/v2.1/flavors/1694354974/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.027618 Jul 23 21:13:30.704582 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 13/26] 10.222.0.17 () {58 vars in 1247 bytes} [Sat Jul 23 21:13:30 2022] DELETE /compute/v2.1/flavors/1694354974/os-extra_specs/hw:numa_nodes => generated 124 bytes in 29 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:13:30.721935 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-691e10fb-99a5-440d-894b-2b096adda7f2 tempest-FlavorsAccessNegativeTestJSON-992011010 tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "c62a56af2f634cf49e7556c47b3215a6"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:13:30.723843 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:30.723843 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:13:30.734555 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-4cd5f0d4-b553-4d65-9657-6f0c1a61be58 tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] HTTP exception thrown: Aggregate 1 already has host nch2-master-1. Jul 23 21:13:30.753063 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-4cd5f0d4-b553-4d65-9657-6f0c1a61be58 tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] Request method failure captured: Jul 23 21:13:30.753063 ncdv-master-1 devstack@n-api.service[131321]: request: POST /compute/v2.1/os-aggregates/1/action HTTP/1.1 Jul 23 21:13:30.753063 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:13:30.753063 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:13:30.753063 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:13:30.753063 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 39 Jul 23 21:13:30.753063 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:13:30.753063 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:13:30.753063 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:13:30.753063 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:13:30.753063 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GR4Af3W0fFvw8yTolnoTx8KNEFsndEM3vLnD4hxJdnaehXXWpmsZ1jjg3KpEdBxaaG1ArS76-3FDoYUQAdhJ6y2uiVS2G3hIvpto6hX8kiuR7ZLmmR2sTf-Q4IlaSU0UlW_J6NiqIbelxfSFp1N8iB6uGpt0n53v-bBkPGi_IfUjUw Jul 23 21:13:30.753063 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:13:30.753063 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:13:30.753063 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:13:30.753063 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:13:30.753063 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:13:30.753063 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:13:30.753063 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 91b039b789a9402796ffb5eee541b3d3 Jul 23 21:13:30.753063 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2091976692 Jul 23 21:13:30.753063 ncdv-master-1 devstack@n-api.service[131321]: X-Role: admin,reader,member Jul 23 21:13:30.753063 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: admin,reader,member Jul 23 21:13:30.754566 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/91b039b789a9402796ffb5eee541b3d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/91b039b789a9402796ffb5eee541b3d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_91b039b789a9402796ffb5eee541b3d3", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/91b039b789a9402796ffb5eee541b3d3"}]}] Jul 23 21:13:30.754566 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2091976692 Jul 23 21:13:30.754566 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 91b039b789a9402796ffb5eee541b3d3 Jul 23 21:13:30.754566 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2091976692 Jul 23 21:13:30.754566 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin Jul 23 21:13:30.754566 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:13:30.754566 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:13:30.754566 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 37598ed1e36d4e81936d5ad3cf35612b Jul 23 21:13:30.754566 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin Jul 23 21:13:30.754566 ncdv-master-1 devstack@n-api.service[131321]: Jul 23 21:13:30.754566 ncdv-master-1 devstack@n-api.service[131321]: {"add_host": {"host": "nch2-master-1"}} Jul 23 21:13:30.754566 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:13:30.754566 ncdv-master-1 devstack@n-api.service[131321]: exception: Aggregate 1 already has host nch2-master-1. Jul 23 21:13:30.755366 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': '1', 'body': {'add_host': {'host': 'nch2-master-1'}}} Jul 23 21:13:30.755366 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:13:30.755366 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:13:30.755366 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 23 21:13:30.755366 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 23 21:13:30.755366 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 23 21:13:30.755366 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 23 21:13:30.755366 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 23 21:13:30.755366 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 23 21:13:30.755366 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 23 21:13:30.755366 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 23 21:13:30.755366 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 23 21:13:30.755366 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 23 21:13:30.755366 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 23 21:13:30.755366 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi result.read() Jul 23 21:13:30.755366 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 23 21:13:30.755366 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 23 21:13:30.755366 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 23 21:13:30.755366 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 23 21:13:30.757755 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 23 21:13:30.757755 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 23 21:13:30.757755 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 23 21:13:30.757755 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 23 21:13:30.757755 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'nch2-master-1-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Jul 23 21:13:30.757755 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:13:30.757755 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 23 21:13:30.757755 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:13:30.757755 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:13:30.757755 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Jul 23 21:13:30.757755 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Jul 23 21:13:30.757755 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jul 23 21:13:30.757755 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi session.flush() Jul 23 21:13:30.757755 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 23 21:13:30.757755 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self._flush(objects) Jul 23 21:13:30.757755 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 23 21:13:30.757755 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jul 23 21:13:30.757755 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 23 21:13:30.757755 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi compat.raise_( Jul 23 21:13:30.760663 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 23 21:13:30.760663 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception Jul 23 21:13:30.760663 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 23 21:13:30.760663 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi flush_context.execute() Jul 23 21:13:30.760663 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 23 21:13:30.760663 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi rec.execute(self) Jul 23 21:13:30.760663 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 23 21:13:30.760663 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jul 23 21:13:30.760663 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 23 21:13:30.760663 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jul 23 21:13:30.760663 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 23 21:13:30.760663 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jul 23 21:13:30.760663 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 23 21:13:30.760663 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jul 23 21:13:30.760663 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 23 21:13:30.760663 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jul 23 21:13:30.760663 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 23 21:13:30.760663 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jul 23 21:13:30.762534 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 23 21:13:30.762534 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jul 23 21:13:30.762534 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 23 21:13:30.762534 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 23 21:13:30.762534 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 23 21:13:30.762534 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception Jul 23 21:13:30.762534 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 23 21:13:30.762534 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 23 21:13:30.762534 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 23 21:13:30.762534 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 23 21:13:30.762534 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 23 21:13:30.762534 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 23 21:13:30.762534 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 23 21:13:30.762534 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 23 21:13:30.762534 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 23 21:13:30.762534 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 23 21:13:30.762534 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 23 21:13:30.762534 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi result.read() Jul 23 21:13:30.764117 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 23 21:13:30.764117 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 23 21:13:30.764117 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 23 21:13:30.764117 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 23 21:13:30.764117 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 23 21:13:30.764117 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 23 21:13:30.764117 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 23 21:13:30.764117 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 23 21:13:30.764117 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'nch2-master-1-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Jul 23 21:13:30.764117 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Jul 23 21:13:30.764117 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 7, 23, 21, 13, 30, 712014), 'updated_at': None, 'host': 'nch2-master-1', 'aggregate_id': 1}] Jul 23 21:13:30.764117 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 23 21:13:30.764117 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:13:30.764117 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:13:30.764117 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:13:30.764117 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:13:30.764117 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Jul 23 21:13:30.768307 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Jul 23 21:13:30.768307 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 23 21:13:30.768307 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 23 21:13:30.768307 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 23 21:13:30.768307 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 23 21:13:30.768307 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 23 21:13:30.768307 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise self.value Jul 23 21:13:30.768307 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 23 21:13:30.768307 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 23 21:13:30.768307 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6513, in add_host_to_aggregate Jul 23 21:13:30.768307 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Jul 23 21:13:30.768307 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 23 21:13:30.768307 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 23 21:13:30.768307 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Jul 23 21:13:30.768307 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Jul 23 21:13:30.768307 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Jul 23 21:13:30.768307 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Jul 23 21:13:30.768307 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 1 already has host nch2-master-1. Jul 23 21:13:30.768307 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:13:30.768307 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:13:30.770220 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:13:30.770220 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:13:30.770220 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:13:30.770220 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:13:30.770220 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:13:30.770220 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:13:30.770220 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:13:30.770220 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:13:30.770220 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:13:30.770220 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:13:30.770220 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Jul 23 21:13:30.770220 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Jul 23 21:13:30.770220 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 1 already has host nch2-master-1. Jul 23 21:13:30.770220 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:13:30.770220 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:13:30.770220 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:13:30.770220 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:13:30.770220 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:13:30.770220 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:13:30.770220 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:13:30.770220 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:13:30.772172 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 1 already has host nch2-master-1. Jul 23 21:13:30.772172 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:13:30.772172 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-4cd5f0d4-b553-4d65-9657-6f0c1a61be58 tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] Returning 409 to user: Aggregate 1 already has host nch2-master-1. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:13:30.772172 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-4cd5f0d4-b553-4d65-9657-6f0c1a61be58 tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates/1/action" status: 409 len: 95 microversion: 2.1 time: 0.084146 Jul 23 21:13:30.772172 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 14/27] 10.222.0.17 () {60 vars in 1190 bytes} [Sat Jul 23 21:13:30 2022] POST /compute/v2.1/os-aggregates/1/action => generated 95 bytes in 88 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Jul 23 21:13:30.772172 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-555dae4d-39d7-49ec-be8d-e466f3685e16 tempest-FlavorsExtraSpecsNegativeTestJSON-1305472578 tempest-FlavorsExtraSpecsNegativeTestJSON-1305472578-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:13:30.772764 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:30.772764 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:13:30.787926 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-555dae4d-39d7-49ec-be8d-e466f3685e16 tempest-FlavorsExtraSpecsNegativeTestJSON-1305472578 tempest-FlavorsExtraSpecsNegativeTestJSON-1305472578-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors/1694354974/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.030296 Jul 23 21:13:30.788668 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 15/28] 10.222.0.17 () {60 vars in 1223 bytes} [Sat Jul 23 21:13:30 2022] POST /compute/v2.1/flavors/1694354974/os-extra_specs => generated 66 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 23 21:13:30.793525 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-af42d41b-d615-4949-b530-71ed88070f5b tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:13:30.794639 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:30.794639 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:13:30.803562 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-af42d41b-d615-4949-b530-71ed88070f5b tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:30.804023 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-af42d41b-d615-4949-b530-71ed88070f5b tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:31.021583 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-af42d41b-d615-4949-b530-71ed88070f5b tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 227 microversion: 2.1 time: 0.231922 Jul 23 21:13:31.023947 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 16/29] 10.222.0.17 () {60 vars in 1190 bytes} [Sat Jul 23 21:13:30 2022] POST /compute/v2.1/os-aggregates/1/action => generated 227 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:13:31.031582 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-51dc6ec3-6d5d-49be-97db-49766bbb95a8 tempest-FlavorsExtraSpecsNegativeTestJSON-1376996271 tempest-FlavorsExtraSpecsNegativeTestJSON-1376996271-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:13:31.032972 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:31.032972 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:13:31.033994 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-51dc6ec3-6d5d-49be-97db-49766bbb95a8 tempest-FlavorsExtraSpecsNegativeTestJSON-1376996271 tempest-FlavorsExtraSpecsNegativeTestJSON-1376996271-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': 'b62c516b2d50424c80d7ac4549900639', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261deb211d6b45c39bbee3188d2ac559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:13:31.036178 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-51dc6ec3-6d5d-49be-97db-49766bbb95a8 tempest-FlavorsExtraSpecsNegativeTestJSON-1376996271 tempest-FlavorsExtraSpecsNegativeTestJSON-1376996271-project] Request method failure captured: Jul 23 21:13:31.036178 ncdv-master-1 devstack@n-api.service[131321]: request: PUT /compute/v2.1/flavors/1694354974/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 23 21:13:31.036178 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:13:31.036178 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:13:31.036178 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:13:31.036178 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 22 Jul 23 21:13:31.036178 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:13:31.036178 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:13:31.036178 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:13:31.036178 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:13:31.036178 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GR2icV8LwqDNEqzMFakjmvQw5isE_GRbmYP4Y6hGqWcR30oHTQIxppkYxN7lRTx69pbsaDVmthtXCCWLdGnpnas5_gg58h_E09c5b1Qei_obEJ8NBNsFRblAPCs7gqsI-A4RRoudXTOdntWBXGQskWxJa51CyeDkfcX5jHcFotrbXs Jul 23 21:13:31.036178 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:13:31.036178 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:13:31.036178 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:13:31.036178 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:13:31.036178 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:13:31.036178 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:13:31.036178 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 261deb211d6b45c39bbee3188d2ac559 Jul 23 21:13:31.036178 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1376996271 Jul 23 21:13:31.036178 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:13:31.036178 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:13:31.037514 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/261deb211d6b45c39bbee3188d2ac559"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/261deb211d6b45c39bbee3188d2ac559"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_261deb211d6b45c39bbee3188d2ac559", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/261deb211d6b45c39bbee3188d2ac559"}]}] Jul 23 21:13:31.037514 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1376996271 Jul 23 21:13:31.037514 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 261deb211d6b45c39bbee3188d2ac559 Jul 23 21:13:31.037514 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1376996271 Jul 23 21:13:31.037514 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1376996271-project Jul 23 21:13:31.037514 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:13:31.037514 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:13:31.037514 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: b62c516b2d50424c80d7ac4549900639 Jul 23 21:13:31.037514 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1376996271-project Jul 23 21:13:31.037514 ncdv-master-1 devstack@n-api.service[131321]: Jul 23 21:13:31.037514 ncdv-master-1 devstack@n-api.service[131321]: {"hw:numa_nodes": "1"} Jul 23 21:13:31.037514 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:13:31.037514 ncdv-master-1 devstack@n-api.service[131321]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jul 23 21:13:31.038343 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'flavor_id': '1694354974', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Jul 23 21:13:31.038343 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:13:31.038343 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:13:31.038343 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:13:31.038343 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:13:31.038343 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:13:31.038343 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:13:31.038343 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:13:31.038343 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:13:31.038343 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:13:31.038343 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:13:31.038343 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Jul 23 21:13:31.038343 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Jul 23 21:13:31.038343 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 23 21:13:31.038343 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 23 21:13:31.038343 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 23 21:13:31.038343 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 23 21:13:31.038343 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 23 21:13:31.038343 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 23 21:13:31.039478 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 23 21:13:31.039478 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise self.value Jul 23 21:13:31.039478 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 23 21:13:31.039478 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 23 21:13:31.039478 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 23 21:13:31.039478 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 23 21:13:31.039478 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 23 21:13:31.039478 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 23 21:13:31.039478 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jul 23 21:13:31.039478 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:13:31.039478 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:13:31.039478 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:13:31.039478 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:13:31.039478 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:13:31.039478 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:13:31.039478 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 23 21:13:31.039478 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 23 21:13:31.039478 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jul 23 21:13:31.039478 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:13:31.041674 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-51dc6ec3-6d5d-49be-97db-49766bbb95a8 tempest-FlavorsExtraSpecsNegativeTestJSON-1376996271 tempest-FlavorsExtraSpecsNegativeTestJSON-1376996271-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:13:31.042602 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-51dc6ec3-6d5d-49be-97db-49766bbb95a8 tempest-FlavorsExtraSpecsNegativeTestJSON-1376996271 tempest-FlavorsExtraSpecsNegativeTestJSON-1376996271-project] 10.222.0.17 "PUT /compute/v2.1/flavors/1694354974/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.015707 Jul 23 21:13:31.043162 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 17/30] 10.222.0.17 () {60 vars in 1264 bytes} [Sat Jul 23 21:13:31 2022] PUT /compute/v2.1/flavors/1694354974/os-extra_specs/hw:numa_nodes => generated 124 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:13:31.052684 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-03a64a3a-ba9b-4ad5-ac53-178f147b1ea9 tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:31.053664 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:31.053664 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:13:31.098449 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-03a64a3a-ba9b-4ad5-ac53-178f147b1ea9 tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.049296 Jul 23 21:13:31.099782 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 18/31] 10.222.0.17 () {58 vars in 1151 bytes} [Sat Jul 23 21:13:31 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 23 21:13:31.105394 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f66f5d3b-cce5-4e4a-b4ed-1ce1d6da7f64 tempest-FlavorsExtraSpecsNegativeTestJSON-1305472578 tempest-FlavorsExtraSpecsNegativeTestJSON-1305472578-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:31.106513 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:31.106513 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:13:31.115092 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-f66f5d3b-cce5-4e4a-b4ed-1ce1d6da7f64 tempest-FlavorsExtraSpecsNegativeTestJSON-1305472578 tempest-FlavorsExtraSpecsNegativeTestJSON-1305472578-project-admin] HTTP exception thrown: Flavor 1694354974 has no extra specs with key hw:cpu_thread_policy. Jul 23 21:13:31.116726 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f66f5d3b-cce5-4e4a-b4ed-1ce1d6da7f64 tempest-FlavorsExtraSpecsNegativeTestJSON-1305472578 tempest-FlavorsExtraSpecsNegativeTestJSON-1305472578-project-admin] Request method failure captured: Jul 23 21:13:31.116726 ncdv-master-1 devstack@n-api.service[131321]: request: DELETE /compute/v2.1/flavors/1694354974/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Jul 23 21:13:31.116726 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:13:31.116726 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:13:31.116726 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:13:31.116726 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:13:31.116726 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:13:31.116726 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:13:31.116726 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:13:31.116726 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:13:31.116726 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GR4OBLshRGpWG-FVciZkdw4Z6jZxL9XwWTcpT5qSaPh6796sGDUgNL6Zr3q8BZ59IyrCpuhTwHIwg5JBkwR0Z95hTiQV1kxnP4ELWsr-xMu0KIb2Sr0Au6sLbj9wsWMi27jiKBxa5whFVLWmfERA7tJCcRlbjOHcZH-498D1VzsKko Jul 23 21:13:31.116726 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:13:31.116726 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:13:31.116726 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:13:31.116726 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:13:31.116726 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:13:31.116726 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:13:31.116726 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: c39959ed6b824c75a46b058008ce3bd6 Jul 23 21:13:31.116726 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1305472578 Jul 23 21:13:31.116726 ncdv-master-1 devstack@n-api.service[131321]: X-Role: admin,reader,member Jul 23 21:13:31.116726 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: admin,reader,member Jul 23 21:13:31.117784 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c39959ed6b824c75a46b058008ce3bd6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c39959ed6b824c75a46b058008ce3bd6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c39959ed6b824c75a46b058008ce3bd6", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c39959ed6b824c75a46b058008ce3bd6"}]}] Jul 23 21:13:31.117784 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1305472578 Jul 23 21:13:31.117784 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: c39959ed6b824c75a46b058008ce3bd6 Jul 23 21:13:31.117784 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1305472578 Jul 23 21:13:31.117784 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1305472578-project-admin Jul 23 21:13:31.117784 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:13:31.117784 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:13:31.117784 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: cdd2a325dc5a4e0fa1d3b679afb5d863 Jul 23 21:13:31.117784 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1305472578-project-admin Jul 23 21:13:31.117784 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:13:31.117784 ncdv-master-1 devstack@n-api.service[131321]: exception: Flavor 1694354974 has no extra specs with key hw:cpu_thread_policy. Jul 23 21:13:31.118384 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'flavor_id': '1694354974', 'id': 'hw:cpu_thread_policy'} Jul 23 21:13:31.118384 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:13:31.118384 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:13:31.118384 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Jul 23 21:13:31.118384 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Jul 23 21:13:31.118384 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Jul 23 21:13:31.118384 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:13:31.118384 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:13:31.118384 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:13:31.118384 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:13:31.118384 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:13:31.118384 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:13:31.118384 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:13:31.118384 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:13:31.118384 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:13:31.118384 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:13:31.118384 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Jul 23 21:13:31.118384 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 23 21:13:31.118384 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1694354974 has no extra specs with key hw:cpu_thread_policy. Jul 23 21:13:31.118384 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:13:31.118384 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:13:31.118384 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:13:31.119422 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:13:31.119422 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:13:31.119422 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:13:31.119422 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:13:31.119422 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:13:31.119422 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1694354974 has no extra specs with key hw:cpu_thread_policy. Jul 23 21:13:31.119422 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:13:31.121080 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f66f5d3b-cce5-4e4a-b4ed-1ce1d6da7f64 tempest-FlavorsExtraSpecsNegativeTestJSON-1305472578 tempest-FlavorsExtraSpecsNegativeTestJSON-1305472578-project-admin] Returning 404 to user: Flavor 1694354974 has no extra specs with key hw:cpu_thread_policy. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:13:31.122277 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-f66f5d3b-cce5-4e4a-b4ed-1ce1d6da7f64 tempest-FlavorsExtraSpecsNegativeTestJSON-1305472578 tempest-FlavorsExtraSpecsNegativeTestJSON-1305472578-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/1694354974/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.021217 Jul 23 21:13:31.127917 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 19/32] 10.222.0.17 () {58 vars in 1268 bytes} [Sat Jul 23 21:13:31 2022] DELETE /compute/v2.1/flavors/1694354974/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:13:31.137652 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a9ea7f5a-eece-4635-b34f-4b9c4995d5fc tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1115818973"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:13:31.139335 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:31.139335 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:13:31.142726 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.objects.aggregate [None req-a9ea7f5a-eece-4635-b34f-4b9c4995d5fc tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] Generated uuid 49d9ad94-e308-477d-9bf0-fa67bf864aa0 for aggregate {{(pid=131321) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 23 21:13:31.181450 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-a9ea7f5a-eece-4635-b34f-4b9c4995d5fc tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.047673 Jul 23 21:13:31.182138 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 20/33] 10.222.0.17 () {60 vars in 1163 bytes} [Sat Jul 23 21:13:31 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:13:31.192314 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-3ae2f2b5-94be-43f2-b179-e546e3f63029 tempest-FlavorsExtraSpecsNegativeTestJSON-1305472578 tempest-FlavorsExtraSpecsNegativeTestJSON-1305472578-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:13:31.194011 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:31.194011 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:13:31.194943 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-3ae2f2b5-94be-43f2-b179-e546e3f63029 tempest-FlavorsExtraSpecsNegativeTestJSON-1305472578 tempest-FlavorsExtraSpecsNegativeTestJSON-1305472578-project-admin] HTTP exception thrown: Request body and URI mismatch Jul 23 21:13:31.197771 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-3ae2f2b5-94be-43f2-b179-e546e3f63029 tempest-FlavorsExtraSpecsNegativeTestJSON-1305472578 tempest-FlavorsExtraSpecsNegativeTestJSON-1305472578-project-admin] Request method failure captured: Jul 23 21:13:31.197771 ncdv-master-1 devstack@n-api.service[131321]: request: PUT /compute/v2.1/flavors/1694354974/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 23 21:13:31.197771 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:13:31.197771 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:13:31.197771 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:13:31.197771 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 27 Jul 23 21:13:31.197771 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:13:31.197771 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:13:31.197771 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:13:31.197771 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:13:31.197771 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GR4OBLshRGpWG-FVciZkdw4Z6jZxL9XwWTcpT5qSaPh6796sGDUgNL6Zr3q8BZ59IyrCpuhTwHIwg5JBkwR0Z95hTiQV1kxnP4ELWsr-xMu0KIb2Sr0Au6sLbj9wsWMi27jiKBxa5whFVLWmfERA7tJCcRlbjOHcZH-498D1VzsKko Jul 23 21:13:31.197771 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:13:31.197771 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:13:31.197771 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:13:31.197771 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:13:31.197771 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:13:31.197771 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:13:31.197771 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: c39959ed6b824c75a46b058008ce3bd6 Jul 23 21:13:31.197771 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1305472578 Jul 23 21:13:31.197771 ncdv-master-1 devstack@n-api.service[131321]: X-Role: admin,reader,member Jul 23 21:13:31.197771 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: admin,reader,member Jul 23 21:13:31.199103 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c39959ed6b824c75a46b058008ce3bd6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c39959ed6b824c75a46b058008ce3bd6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c39959ed6b824c75a46b058008ce3bd6", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c39959ed6b824c75a46b058008ce3bd6"}]}] Jul 23 21:13:31.199103 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1305472578 Jul 23 21:13:31.199103 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: c39959ed6b824c75a46b058008ce3bd6 Jul 23 21:13:31.199103 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1305472578 Jul 23 21:13:31.199103 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1305472578-project-admin Jul 23 21:13:31.199103 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:13:31.199103 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:13:31.199103 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: cdd2a325dc5a4e0fa1d3b679afb5d863 Jul 23 21:13:31.199103 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1305472578-project-admin Jul 23 21:13:31.199103 ncdv-master-1 devstack@n-api.service[131321]: Jul 23 21:13:31.199103 ncdv-master-1 devstack@n-api.service[131321]: {"hw:cpu_policy": "shared"} Jul 23 21:13:31.199103 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:13:31.199103 ncdv-master-1 devstack@n-api.service[131321]: exception: Request body and URI mismatch Jul 23 21:13:31.199922 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'flavor_id': '1694354974', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Jul 23 21:13:31.199922 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:13:31.199922 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:13:31.199922 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:13:31.199922 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:13:31.199922 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:13:31.199922 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:13:31.199922 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:13:31.199922 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:13:31.199922 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:13:31.199922 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:13:31.199922 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Jul 23 21:13:31.199922 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Jul 23 21:13:31.199922 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Jul 23 21:13:31.199922 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:13:31.199922 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:13:31.199922 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:13:31.199922 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:13:31.199922 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:13:31.199922 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:13:31.201095 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:13:31.201095 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:13:31.201095 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Jul 23 21:13:31.201095 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:13:31.201095 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-3ae2f2b5-94be-43f2-b179-e546e3f63029 tempest-FlavorsExtraSpecsNegativeTestJSON-1305472578 tempest-FlavorsExtraSpecsNegativeTestJSON-1305472578-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:13:31.201095 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-3ae2f2b5-94be-43f2-b179-e546e3f63029 tempest-FlavorsExtraSpecsNegativeTestJSON-1305472578 tempest-FlavorsExtraSpecsNegativeTestJSON-1305472578-project-admin] 10.222.0.17 "PUT /compute/v2.1/flavors/1694354974/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.016038 Jul 23 21:13:31.205754 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 21/34] 10.222.0.17 () {60 vars in 1264 bytes} [Sat Jul 23 21:13:31 2022] PUT /compute/v2.1/flavors/1694354974/os-extra_specs/hw:numa_nodes => generated 73 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 23 21:13:31.216162 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-8b4fb8a8-e9e9-4f67-a424-926868463f1f tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:31.217206 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-8b4fb8a8-e9e9-4f67-a424-926868463f1f tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] [instance: 5b41dd2d-cb23-4e57-91fc-1593508dc8cb] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:13:31.235019 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8b4fb8a8-e9e9-4f67-a424-926868463f1f tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:31.236260 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8b4fb8a8-e9e9-4f67-a424-926868463f1f tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:31.237161 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8b4fb8a8-e9e9-4f67-a424-926868463f1f tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:31.237614 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8b4fb8a8-e9e9-4f67-a424-926868463f1f tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:31.241750 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-691e10fb-99a5-440d-894b-2b096adda7f2 tempest-FlavorsAccessNegativeTestJSON-992011010 tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors/1013477342/action" status: 200 len: 21 microversion: 2.1 time: 0.529133 Jul 23 21:13:31.243605 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 14/35] 10.222.0.17 () {60 vars in 1199 bytes} [Sat Jul 23 21:13:30 2022] POST /compute/v2.1/flavors/1013477342/action => generated 21 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 23 21:13:31.261282 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1ae3609c-c94a-4129-903b-c755fc271bdc tempest-AggregatesAdminTestV241-1866405514 tempest-AggregatesAdminTestV241-1866405514-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-844020669"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:13:31.266263 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:31.266263 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:13:31.271212 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.objects.aggregate [None req-1ae3609c-c94a-4129-903b-c755fc271bdc tempest-AggregatesAdminTestV241-1866405514 tempest-AggregatesAdminTestV241-1866405514-project-admin] Generated uuid 207df404-28f2-47e4-bba1-577cc9682b9b for aggregate {{(pid=131320) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 23 21:13:31.311485 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1ae3609c-c94a-4129-903b-c755fc271bdc tempest-AggregatesAdminTestV241-1866405514 tempest-AggregatesAdminTestV241-1866405514-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.41 time: 0.066430 Jul 23 21:13:31.312492 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 15/36] 10.222.0.17 () {62 vars in 1204 bytes} [Sat Jul 23 21:13:31 2022] POST /compute/v2.1/os-aggregates => generated 245 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 23 21:13:31.471328 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e22def76-d8ab-466f-a773-93f3afa5b608 tempest-AggregatesAdminNegativeTestJSON-1992080461 tempest-AggregatesAdminNegativeTestJSON-1992080461-project] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:13:31.472817 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:31.472817 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:13:31.473670 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e22def76-d8ab-466f-a773-93f3afa5b608 tempest-AggregatesAdminNegativeTestJSON-1992080461 tempest-AggregatesAdminNegativeTestJSON-1992080461-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '0e1fdaed25764b15a6f74a925ee81499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681566c31052436b9d2ce072e733f052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:13:31.475766 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e22def76-d8ab-466f-a773-93f3afa5b608 tempest-AggregatesAdminNegativeTestJSON-1992080461 tempest-AggregatesAdminNegativeTestJSON-1992080461-project] Request method failure captured: Jul 23 21:13:31.475766 ncdv-master-1 devstack@n-api.service[131320]: request: POST /compute/v2.1/os-aggregates/2/action HTTP/1.1 Jul 23 21:13:31.475766 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:13:31.475766 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:13:31.475766 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:13:31.475766 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 39 Jul 23 21:13:31.475766 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:13:31.475766 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:13:31.475766 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:13:31.475766 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:13:31.475766 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GR24jg3yQ9a_OLew2TbSj5pMYp5j1hBxMQWU5sEwcOe7CdPvlT12VXYE2Y0x3X5Gp8wT4xTdui2HtNjAoc5xldp7LrpNoQKXHKWpDnxijm5gqeiPXeVhEIavZ1o-cuLUTqgnQ0gnxh4oOZGKhPzWgzyuIHj9BN38CSod1QkRw4XpUw Jul 23 21:13:31.475766 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:13:31.475766 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:13:31.475766 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:13:31.475766 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:13:31.475766 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:13:31.475766 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:13:31.475766 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 681566c31052436b9d2ce072e733f052 Jul 23 21:13:31.475766 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1992080461 Jul 23 21:13:31.475766 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:13:31.475766 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:13:31.477052 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/681566c31052436b9d2ce072e733f052"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/681566c31052436b9d2ce072e733f052"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_681566c31052436b9d2ce072e733f052", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/681566c31052436b9d2ce072e733f052"}]}] Jul 23 21:13:31.477052 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1992080461 Jul 23 21:13:31.477052 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 681566c31052436b9d2ce072e733f052 Jul 23 21:13:31.477052 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1992080461 Jul 23 21:13:31.477052 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-AggregatesAdminNegativeTestJSON-1992080461-project Jul 23 21:13:31.477052 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:13:31.477052 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:13:31.477052 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 0e1fdaed25764b15a6f74a925ee81499 Jul 23 21:13:31.477052 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1992080461-project Jul 23 21:13:31.477052 ncdv-master-1 devstack@n-api.service[131320]: Jul 23 21:13:31.477052 ncdv-master-1 devstack@n-api.service[131320]: {"add_host": {"host": "nch2-master-1"}} Jul 23 21:13:31.477052 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:13:31.477052 ncdv-master-1 devstack@n-api.service[131320]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jul 23 21:13:31.478356 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '2', 'body': {'add_host': {'host': 'nch2-master-1'}}} Jul 23 21:13:31.478356 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:13:31.478356 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:13:31.478356 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:13:31.478356 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:13:31.478356 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:13:31.478356 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:13:31.478356 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:13:31.478356 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:13:31.478356 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:13:31.478356 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:13:31.478356 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Jul 23 21:13:31.478356 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Jul 23 21:13:31.478356 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 23 21:13:31.478356 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 23 21:13:31.478356 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 23 21:13:31.478356 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 23 21:13:31.478356 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 23 21:13:31.478356 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 23 21:13:31.479512 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 23 21:13:31.479512 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise self.value Jul 23 21:13:31.479512 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 23 21:13:31.479512 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 23 21:13:31.479512 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 23 21:13:31.479512 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 23 21:13:31.479512 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 23 21:13:31.479512 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 23 21:13:31.479512 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jul 23 21:13:31.479512 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:13:31.479512 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:13:31.479512 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:13:31.479512 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:13:31.479512 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:13:31.479512 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:13:31.479512 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 23 21:13:31.479512 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 23 21:13:31.479512 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jul 23 21:13:31.479512 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:13:31.480789 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e22def76-d8ab-466f-a773-93f3afa5b608 tempest-AggregatesAdminNegativeTestJSON-1992080461 tempest-AggregatesAdminNegativeTestJSON-1992080461-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:13:31.480789 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e22def76-d8ab-466f-a773-93f3afa5b608 tempest-AggregatesAdminNegativeTestJSON-1992080461 tempest-AggregatesAdminNegativeTestJSON-1992080461-project] 10.222.0.17 "POST /compute/v2.1/os-aggregates/2/action" status: 403 len: 118 microversion: 2.1 time: 0.164243 Jul 23 21:13:31.481513 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 16/37] 10.222.0.17 () {60 vars in 1190 bytes} [Sat Jul 23 21:13:31 2022] POST /compute/v2.1/os-aggregates/2/action => generated 118 bytes in 168 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:13:31.487322 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a1ddc55f-392c-4f74-ba47-b4255d92e7b0 tempest-FlavorsExtraSpecsNegativeTestJSON-1305472578 tempest-FlavorsExtraSpecsNegativeTestJSON-1305472578-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:13:31.506659 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a1ddc55f-392c-4f74-ba47-b4255d92e7b0 tempest-FlavorsExtraSpecsNegativeTestJSON-1305472578 tempest-FlavorsExtraSpecsNegativeTestJSON-1305472578-project-admin] Request method failure captured: Jul 23 21:13:31.506659 ncdv-master-1 devstack@n-api.service[131320]: request: PUT /compute/v2.1/flavors/1694354974/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 23 21:13:31.506659 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:13:31.506659 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:13:31.506659 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:13:31.506659 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 49 Jul 23 21:13:31.506659 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:13:31.506659 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:13:31.506659 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:13:31.506659 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:13:31.506659 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GR4OBLshRGpWG-FVciZkdw4Z6jZxL9XwWTcpT5qSaPh6796sGDUgNL6Zr3q8BZ59IyrCpuhTwHIwg5JBkwR0Z95hTiQV1kxnP4ELWsr-xMu0KIb2Sr0Au6sLbj9wsWMi27jiKBxa5whFVLWmfERA7tJCcRlbjOHcZH-498D1VzsKko Jul 23 21:13:31.506659 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:13:31.506659 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:13:31.506659 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:13:31.506659 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:13:31.506659 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:13:31.506659 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:13:31.506659 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: c39959ed6b824c75a46b058008ce3bd6 Jul 23 21:13:31.506659 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1305472578 Jul 23 21:13:31.506659 ncdv-master-1 devstack@n-api.service[131320]: X-Role: admin,reader,member Jul 23 21:13:31.506659 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: admin,reader,member Jul 23 21:13:31.507789 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c39959ed6b824c75a46b058008ce3bd6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c39959ed6b824c75a46b058008ce3bd6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c39959ed6b824c75a46b058008ce3bd6", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c39959ed6b824c75a46b058008ce3bd6"}]}] Jul 23 21:13:31.507789 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1305472578 Jul 23 21:13:31.507789 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: c39959ed6b824c75a46b058008ce3bd6 Jul 23 21:13:31.507789 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1305472578 Jul 23 21:13:31.507789 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1305472578-project-admin Jul 23 21:13:31.507789 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:13:31.507789 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:13:31.507789 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: cdd2a325dc5a4e0fa1d3b679afb5d863 Jul 23 21:13:31.507789 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1305472578-project-admin Jul 23 21:13:31.507789 ncdv-master-1 devstack@n-api.service[131320]: Jul 23 21:13:31.507789 ncdv-master-1 devstack@n-api.service[131320]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Jul 23 21:13:31.507789 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:13:31.508378 ncdv-master-1 devstack@n-api.service[131320]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 23 21:13:31.508378 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'flavor_id': '1694354974', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Jul 23 21:13:31.508378 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:13:31.508378 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:13:31.508378 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 23 21:13:31.508378 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 23 21:13:31.508378 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 23 21:13:31.508378 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise error Jul 23 21:13:31.508378 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 23 21:13:31.508378 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:13:31.508378 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Jul 23 21:13:31.508378 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 23 21:13:31.508378 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Jul 23 21:13:31.508378 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Jul 23 21:13:31.508378 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 23 21:13:31.508378 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi 'type': ['string', Jul 23 21:13:31.508378 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi 'number']}}, Jul 23 21:13:31.508378 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 23 21:13:31.508378 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:13:31.508378 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi On instance: Jul 23 21:13:31.508378 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Jul 23 21:13:31.508378 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:13:31.510118 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:13:31.510118 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:13:31.510118 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:13:31.510118 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:13:31.510118 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:13:31.510118 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:13:31.510118 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:13:31.510118 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:13:31.510118 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:13:31.510118 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 23 21:13:31.510118 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 23 21:13:31.510118 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 23 21:13:31.510118 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 23 21:13:31.510118 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 23 21:13:31.510118 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 23 21:13:31.510118 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 23 21:13:31.510118 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:13:31.510118 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:13:31.510118 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:13:31.510118 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:13:31.511338 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:13:31.511338 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:13:31.511338 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 23 21:13:31.511338 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 23 21:13:31.511338 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 23 21:13:31.511338 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:13:31.511338 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a1ddc55f-392c-4f74-ba47-b4255d92e7b0 tempest-FlavorsExtraSpecsNegativeTestJSON-1305472578 tempest-FlavorsExtraSpecsNegativeTestJSON-1305472578-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:13:31.511338 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a1ddc55f-392c-4f74-ba47-b4255d92e7b0 tempest-FlavorsExtraSpecsNegativeTestJSON-1305472578 tempest-FlavorsExtraSpecsNegativeTestJSON-1305472578-project-admin] 10.222.0.17 "PUT /compute/v2.1/flavors/1694354974/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.025840 Jul 23 21:13:31.513257 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 17/38] 10.222.0.17 () {60 vars in 1264 bytes} [Sat Jul 23 21:13:31 2022] PUT /compute/v2.1/flavors/1694354974/os-extra_specs/hw:numa_nodes => generated 117 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 23 21:13:31.518481 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-62f41069-b91c-4925-9201-b9f4713cefe8 tempest-FlavorsAccessNegativeTestJSON-992011010 tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:31.519736 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:31.519736 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:13:31.544388 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-8b4fb8a8-e9e9-4f67-a424-926868463f1f tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199522d29cb746379cb6f75d4b108cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07101aee06ca4bb6885f87cfec3257db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:13:31.546898 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-62f41069-b91c-4925-9201-b9f4713cefe8 tempest-FlavorsAccessNegativeTestJSON-992011010 tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/1013477342" status: 202 len: 0 microversion: 2.1 time: 0.032043 Jul 23 21:13:31.548189 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 18/39] 10.222.0.17 () {58 vars in 1160 bytes} [Sat Jul 23 21:13:31 2022] DELETE /compute/v2.1/flavors/1013477342 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:13:31.554844 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9d1b2521-5051-4a51-b23c-ea3219f53688 tempest-AggregatesAdminTestV241-1866405514 tempest-AggregatesAdminTestV241-1866405514-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-482228200"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:13:31.565997 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-8b4fb8a8-e9e9-4f67-a424-926868463f1f tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] 10.222.0.17 "GET /compute/v2.1/servers/5b41dd2d-cb23-4e57-91fc-1593508dc8cb" status: 200 len: 1216 microversion: 2.1 time: 0.358769 Jul 23 21:13:31.566745 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 22/40] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:13:31 2022] GET /compute/v2.1/servers/5b41dd2d-cb23-4e57-91fc-1593508dc8cb => generated 1216 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:13:31.571889 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-28d5cb38-ec32-4400-879a-36a1e2638cf0 tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:31.572819 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:31.572819 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:13:31.579585 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=7,nova_api:UPDATE=1,nova_api:SAVEPOINT=4,nova_api:RELEASE=4,nova_api:DELETE=3 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:31.600196 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-28d5cb38-ec32-4400-879a-36a1e2638cf0 tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.031676 Jul 23 21:13:31.605970 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 23/41] 10.222.0.17 () {58 vars in 1151 bytes} [Sat Jul 23 21:13:31 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 23 21:13:31.609263 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-0a3f6148-7087-44e9-89f8-2c4a5c624b89 tempest-FlavorsExtraSpecsNegativeTestJSON-1305472578 tempest-FlavorsExtraSpecsNegativeTestJSON-1305472578-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:31.610366 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:31.610366 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:13:31.638532 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-0a3f6148-7087-44e9-89f8-2c4a5c624b89 tempest-FlavorsExtraSpecsNegativeTestJSON-1305472578 tempest-FlavorsExtraSpecsNegativeTestJSON-1305472578-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/1694354974" status: 202 len: 0 microversion: 2.1 time: 0.035999 Jul 23 21:13:31.639866 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 24/42] 10.222.0.17 () {58 vars in 1160 bytes} [Sat Jul 23 21:13:31 2022] DELETE /compute/v2.1/flavors/1694354974 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:13:31.645287 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:31.645287 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:13:31.647398 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-24607dc3-d97d-4b3a-9719-1098a3e118dd tempest-FlavorsAccessNegativeTestJSON-992011010 tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:31.675232 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-24607dc3-d97d-4b3a-9719-1098a3e118dd tempest-FlavorsAccessNegativeTestJSON-992011010 tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.034198 Jul 23 21:13:31.675999 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 25/43] 10.222.0.17 () {58 vars in 1145 bytes} [Sat Jul 23 21:13:31 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:13:31.681315 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-10160e54-9d65-4e5c-bb3c-c1c6725d8720 tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1247022803"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:13:31.682987 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:31.682987 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:13:31.684151 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.objects.aggregate [None req-10160e54-9d65-4e5c-bb3c-c1c6725d8720 tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] Generated uuid 7d64e380-33d8-446f-a79a-a840302ed594 for aggregate {{(pid=131321) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 23 21:13:31.701987 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9d1b2521-5051-4a51-b23c-ea3219f53688 tempest-AggregatesAdminTestV241-1866405514 tempest-AggregatesAdminTestV241-1866405514-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-aggregates/3" status: 200 len: 298 microversion: 2.41 time: 0.152524 Jul 23 21:13:31.708618 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 19/44] 10.222.0.17 () {62 vars in 1209 bytes} [Sat Jul 23 21:13:31 2022] PUT /compute/v2.1/os-aggregates/3 => generated 298 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 23 21:13:31.708618 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1673ca4f-709f-40b7-ae29-cfca387ddc61 tempest-FlavorsExtraSpecsNegativeTestJSON-1305472578 tempest-FlavorsExtraSpecsNegativeTestJSON-1305472578-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:31.722354 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-10160e54-9d65-4e5c-bb3c-c1c6725d8720 tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.038178 Jul 23 21:13:31.725382 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 26/45] 10.222.0.17 () {60 vars in 1163 bytes} [Sat Jul 23 21:13:31 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:13:31.730844 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1673ca4f-709f-40b7-ae29-cfca387ddc61 tempest-FlavorsExtraSpecsNegativeTestJSON-1305472578 tempest-FlavorsExtraSpecsNegativeTestJSON-1305472578-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026885 Jul 23 21:13:31.732032 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 20/46] 10.222.0.17 () {58 vars in 1145 bytes} [Sat Jul 23 21:13:31 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:13:31.737736 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d3e40595-5eea-4510-b763-3a525e8d9504 tempest-AggregatesAdminTestV241-1866405514 tempest-AggregatesAdminTestV241-1866405514-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:31.738292 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-9f82ae95-86c6-42b2-99d4-76bf69764413 tempest-FlavorsAccessNegativeTestJSON-992011010 tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1155218797", "id": 1039298558, "os-flavor-access:is_public": "True"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:13:31.739042 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:31.739042 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:13:31.743032 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:31.743032 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:13:31.763941 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d3e40595-5eea-4510-b763-3a525e8d9504 tempest-AggregatesAdminTestV241-1866405514 tempest-AggregatesAdminTestV241-1866405514-project-admin] 10.222.0.17 "GET /compute/v2.1/os-aggregates/3" status: 200 len: 298 microversion: 2.41 time: 0.030669 Jul 23 21:13:31.766558 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 21/47] 10.222.0.17 () {60 vars in 1189 bytes} [Sat Jul 23 21:13:31 2022] GET /compute/v2.1/os-aggregates/3 => generated 298 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 23 21:13:31.773094 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-10b50ef3-1bf5-451d-afcf-aaef94ed0992 tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-1207058175"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:13:31.773586 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-9f82ae95-86c6-42b2-99d4-76bf69764413 tempest-FlavorsAccessNegativeTestJSON-992011010 tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.046366 Jul 23 21:13:31.774482 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 27/48] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:13:31 2022] POST /compute/v2.1/flavors => generated 438 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:13:31.774992 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:31.774992 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:13:31.781823 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-fb44f602-897a-4d5f-bf2c-bdb3ade4eff8 tempest-AggregatesAdminTestV241-1866405514 tempest-AggregatesAdminTestV241-1866405514-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:13:31.786779 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:31.786779 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:13:31.796140 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-10b50ef3-1bf5-451d-afcf-aaef94ed0992 tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:31.798714 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-10b50ef3-1bf5-451d-afcf-aaef94ed0992 tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:31.810320 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fb44f602-897a-4d5f-bf2c-bdb3ade4eff8 tempest-AggregatesAdminTestV241-1866405514 tempest-AggregatesAdminTestV241-1866405514-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:31.811949 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fb44f602-897a-4d5f-bf2c-bdb3ade4eff8 tempest-AggregatesAdminTestV241-1866405514 tempest-AggregatesAdminTestV241-1866405514-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:31.825732 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-10b50ef3-1bf5-451d-afcf-aaef94ed0992 tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:31.825732 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-10b50ef3-1bf5-451d-afcf-aaef94ed0992 tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:31.858297 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-10b50ef3-1bf5-451d-afcf-aaef94ed0992 tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-1207058175 could not be found. Jul 23 21:13:31.882053 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-10b50ef3-1bf5-451d-afcf-aaef94ed0992 tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] Request method failure captured: Jul 23 21:13:31.882053 ncdv-master-1 devstack@n-api.service[131320]: request: POST /compute/v2.1/os-aggregates/4/action HTTP/1.1 Jul 23 21:13:31.882053 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:13:31.882053 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:13:31.882053 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:13:31.882053 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 58 Jul 23 21:13:31.882053 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:13:31.882053 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:13:31.882053 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:13:31.882053 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:13:31.882053 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GR4Af3W0fFvw8yTolnoTx8KNEFsndEM3vLnD4hxJdnaehXXWpmsZ1jjg3KpEdBxaaG1ArS76-3FDoYUQAdhJ6y2uiVS2G3hIvpto6hX8kiuR7ZLmmR2sTf-Q4IlaSU0UlW_J6NiqIbelxfSFp1N8iB6uGpt0n53v-bBkPGi_IfUjUw Jul 23 21:13:31.882053 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:13:31.882053 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:13:31.882053 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:13:31.882053 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:13:31.882053 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:13:31.882053 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:13:31.882053 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 91b039b789a9402796ffb5eee541b3d3 Jul 23 21:13:31.882053 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2091976692 Jul 23 21:13:31.882053 ncdv-master-1 devstack@n-api.service[131320]: X-Role: admin,reader,member Jul 23 21:13:31.882053 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: admin,reader,member Jul 23 21:13:31.884710 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/91b039b789a9402796ffb5eee541b3d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/91b039b789a9402796ffb5eee541b3d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_91b039b789a9402796ffb5eee541b3d3", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/91b039b789a9402796ffb5eee541b3d3"}]}] Jul 23 21:13:31.884710 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2091976692 Jul 23 21:13:31.884710 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 91b039b789a9402796ffb5eee541b3d3 Jul 23 21:13:31.884710 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2091976692 Jul 23 21:13:31.884710 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin Jul 23 21:13:31.884710 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:13:31.884710 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:13:31.884710 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 37598ed1e36d4e81936d5ad3cf35612b Jul 23 21:13:31.884710 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin Jul 23 21:13:31.884710 ncdv-master-1 devstack@n-api.service[131320]: Jul 23 21:13:31.884710 ncdv-master-1 devstack@n-api.service[131320]: {"add_host": {"host": "tempest-nonexist_host-1207058175"}} Jul 23 21:13:31.884710 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:13:31.884710 ncdv-master-1 devstack@n-api.service[131320]: exception: Compute host tempest-nonexist_host-1207058175 could not be found. Jul 23 21:13:31.900013 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '4', 'body': {'add_host': {'host': 'tempest-nonexist_host-1207058175'}}} Jul 23 21:13:31.900013 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:13:31.900013 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:13:31.900013 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5868, in _get_service_in_cell_by_host Jul 23 21:13:31.900013 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jul 23 21:13:31.900013 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 23 21:13:31.900013 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 23 21:13:31.900013 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 23 21:13:31.900013 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 23 21:13:31.900013 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 23 21:13:31.900013 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 23 21:13:31.900013 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 23 21:13:31.900013 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 23 21:13:31.900013 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-1207058175' is not mapped to any cell Jul 23 21:13:31.900013 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:13:31.900013 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:13:31.900013 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:13:31.900013 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:13:31.900013 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5874, in _get_service_in_cell_by_host Jul 23 21:13:31.902666 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Jul 23 21:13:31.902666 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 23 21:13:31.902666 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 23 21:13:31.902666 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 23 21:13:31.902666 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:13:31.902666 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:13:31.902666 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:13:31.902666 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:13:31.902666 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Jul 23 21:13:31.902666 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Jul 23 21:13:31.902666 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 23 21:13:31.902666 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 23 21:13:31.902666 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 23 21:13:31.902666 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 23 21:13:31.902666 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 23 21:13:31.902666 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise self.value Jul 23 21:13:31.902666 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 23 21:13:31.902666 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 23 21:13:31.902666 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6493, in add_host_to_aggregate Jul 23 21:13:31.902666 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Jul 23 21:13:31.904984 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5876, in _get_service_in_cell_by_host Jul 23 21:13:31.904984 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Jul 23 21:13:31.904984 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-1207058175 could not be found. Jul 23 21:13:31.904984 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:13:31.904984 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:13:31.904984 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:13:31.904984 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:13:31.904984 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:13:31.904984 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:13:31.904984 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:13:31.904984 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:13:31.904984 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:13:31.904984 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:13:31.904984 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:13:31.904984 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:13:31.904984 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Jul 23 21:13:31.904984 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:13:31.904984 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-1207058175 could not be found. Jul 23 21:13:31.904984 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:13:31.904984 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:13:31.904984 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:13:31.911334 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:13:31.911334 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:13:31.911334 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:13:31.911334 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:13:31.911334 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:13:31.911334 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-1207058175 could not be found. Jul 23 21:13:31.911334 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:13:31.911334 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-10b50ef3-1bf5-451d-afcf-aaef94ed0992 tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-1207058175 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:13:31.911334 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-10b50ef3-1bf5-451d-afcf-aaef94ed0992 tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates/4/action" status: 404 len: 111 microversion: 2.1 time: 0.120214 Jul 23 21:13:31.911334 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 22/49] 10.222.0.17 () {60 vars in 1190 bytes} [Sat Jul 23 21:13:31 2022] POST /compute/v2.1/os-aggregates/4/action => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:13:31.914110 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-edf9fbb3-5299-4cd9-98dd-fd77910eec34 tempest-FlavorsAccessNegativeTestJSON-992011010 tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:31.914110 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:31.914110 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:13:31.922771 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-edf9fbb3-5299-4cd9-98dd-fd77910eec34 tempest-FlavorsAccessNegativeTestJSON-992011010 tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin] HTTP exception thrown: Access list not available for public flavors. Jul 23 21:13:31.926719 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-edf9fbb3-5299-4cd9-98dd-fd77910eec34 tempest-FlavorsAccessNegativeTestJSON-992011010 tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin] Request method failure captured: Jul 23 21:13:31.926719 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/flavors/1039298558/os-flavor-access HTTP/1.1 Jul 23 21:13:31.926719 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:13:31.926719 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:13:31.926719 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:13:31.926719 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:13:31.926719 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:13:31.926719 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:13:31.926719 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:13:31.926719 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:13:31.926719 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GR43ePav1lEHwpfyBf7WCA7TZgTvVv8cm7vx6QxU7CHq4rKCJodVxSJF0TcSvBkkgaNe9gwSKz33j5EKxv1ebFaChvRNn48gaEoQwXRp4HeCAO4q3W6xU3VXWrgrukRdjtQw7-bWwJYmjoCwUL-JtAr4xWEVwnkddvViGQIsEZopC8 Jul 23 21:13:31.926719 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:13:31.926719 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:13:31.926719 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:13:31.926719 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:13:31.926719 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:13:31.926719 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:13:31.926719 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 769afe32bc5d48dd9e24186168aaa3e1 Jul 23 21:13:31.926719 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-992011010 Jul 23 21:13:31.926719 ncdv-master-1 devstack@n-api.service[131320]: X-Role: admin,reader,member Jul 23 21:13:31.926719 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: admin,reader,member Jul 23 21:13:31.928441 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/769afe32bc5d48dd9e24186168aaa3e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/769afe32bc5d48dd9e24186168aaa3e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_769afe32bc5d48dd9e24186168aaa3e1", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/769afe32bc5d48dd9e24186168aaa3e1"}]}] Jul 23 21:13:31.928441 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-992011010 Jul 23 21:13:31.928441 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 769afe32bc5d48dd9e24186168aaa3e1 Jul 23 21:13:31.928441 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-992011010 Jul 23 21:13:31.928441 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin Jul 23 21:13:31.928441 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:13:31.928441 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:13:31.928441 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 2f243774c8494e10b8b1690f2da39b82 Jul 23 21:13:31.928441 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin Jul 23 21:13:31.928441 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:13:31.928441 ncdv-master-1 devstack@n-api.service[131320]: exception: Access list not available for public flavors. Jul 23 21:13:31.928441 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'flavor_id': '1039298558'} Jul 23 21:13:31.929422 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:13:31.929422 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:13:31.929422 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:13:31.929422 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:13:31.929422 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:13:31.929422 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:13:31.929422 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:13:31.929422 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:13:31.929422 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Jul 23 21:13:31.929422 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 23 21:13:31.929422 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Jul 23 21:13:31.929422 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:13:31.929422 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:13:31.929422 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:13:31.929422 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:13:31.929422 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:13:31.929422 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:13:31.929422 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:13:31.929422 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:13:31.929422 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Jul 23 21:13:31.929422 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:13:31.931669 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-edf9fbb3-5299-4cd9-98dd-fd77910eec34 tempest-FlavorsAccessNegativeTestJSON-992011010 tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:13:31.931669 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-edf9fbb3-5299-4cd9-98dd-fd77910eec34 tempest-FlavorsAccessNegativeTestJSON-992011010 tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/1039298558/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.039841 Jul 23 21:13:31.932802 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 23/50] 10.222.0.17 () {58 vars in 1208 bytes} [Sat Jul 23 21:13:31 2022] GET /compute/v2.1/flavors/1039298558/os-flavor-access => generated 91 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 23 21:13:31.946637 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c45f985b-9e9e-46a5-940d-4fc3485df382 tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:31.951665 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:31.951665 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:13:32.017618 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c45f985b-9e9e-46a5-940d-4fc3485df382 tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.073375 Jul 23 21:13:32.018393 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 24/51] 10.222.0.17 () {58 vars in 1151 bytes} [Sat Jul 23 21:13:31 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 23 21:13:32.022964 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-60c4c835-d012-4e99-b124-c96e6dc962af tempest-FlavorsAccessNegativeTestJSON-992011010 tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:32.023747 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:32.023747 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:13:32.066332 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=8,nova_api:DELETE=10,nova_api:UPDATE=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:32.079663 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-60c4c835-d012-4e99-b124-c96e6dc962af tempest-FlavorsAccessNegativeTestJSON-992011010 tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/1039298558" status: 202 len: 0 microversion: 2.1 time: 0.059255 Jul 23 21:13:32.082850 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 25/52] 10.222.0.17 () {58 vars in 1160 bytes} [Sat Jul 23 21:13:32 2022] DELETE /compute/v2.1/flavors/1039298558 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:13:32.097349 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-af4bd93d-6ce4-4b84-be7e-4feb25654516 tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:13:32.104308 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-af4bd93d-6ce4-4b84-be7e-4feb25654516 tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] Request method failure captured: Jul 23 21:13:32.104308 ncdv-master-1 devstack@n-api.service[131320]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 23 21:13:32.104308 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:13:32.104308 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:13:32.104308 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:13:32.104308 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 283 Jul 23 21:13:32.104308 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:13:32.104308 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:13:32.104308 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:13:32.104308 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:13:32.104308 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GR4Af3W0fFvw8yTolnoTx8KNEFsndEM3vLnD4hxJdnaehXXWpmsZ1jjg3KpEdBxaaG1ArS76-3FDoYUQAdhJ6y2uiVS2G3hIvpto6hX8kiuR7ZLmmR2sTf-Q4IlaSU0UlW_J6NiqIbelxfSFp1N8iB6uGpt0n53v-bBkPGi_IfUjUw Jul 23 21:13:32.104308 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:13:32.104308 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:13:32.104308 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:13:32.104308 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:13:32.104308 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:13:32.104308 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:13:32.104308 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 91b039b789a9402796ffb5eee541b3d3 Jul 23 21:13:32.104308 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2091976692 Jul 23 21:13:32.104308 ncdv-master-1 devstack@n-api.service[131320]: X-Role: admin,reader,member Jul 23 21:13:32.104308 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: admin,reader,member Jul 23 21:13:32.105462 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/91b039b789a9402796ffb5eee541b3d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/91b039b789a9402796ffb5eee541b3d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_91b039b789a9402796ffb5eee541b3d3", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/91b039b789a9402796ffb5eee541b3d3"}]}] Jul 23 21:13:32.105462 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2091976692 Jul 23 21:13:32.105462 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 91b039b789a9402796ffb5eee541b3d3 Jul 23 21:13:32.105462 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2091976692 Jul 23 21:13:32.105462 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin Jul 23 21:13:32.105462 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:13:32.105462 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:13:32.105462 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 37598ed1e36d4e81936d5ad3cf35612b Jul 23 21:13:32.105462 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin Jul 23 21:13:32.105462 ncdv-master-1 devstack@n-api.service[131320]: Jul 23 21:13:32.105462 ncdv-master-1 devstack@n-api.service[131320]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jul 23 21:13:32.106048 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:13:32.106048 ncdv-master-1 devstack@n-api.service[131320]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 23 21:13:32.106048 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jul 23 21:13:32.106048 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:13:32.106048 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:13:32.106048 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 23 21:13:32.106048 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 23 21:13:32.106048 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 23 21:13:32.106048 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise error Jul 23 21:13:32.106048 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 23 21:13:32.106048 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:13:32.106822 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Jul 23 21:13:32.106822 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 23 21:13:32.106822 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:13:32.106822 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Jul 23 21:13:32.106822 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 23 21:13:32.106822 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:13:32.106822 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:13:32.106822 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:13:32.106822 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:13:32.106822 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:13:32.106822 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:13:32.106822 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:13:32.106822 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:13:32.106822 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:13:32.106822 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:13:32.106822 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:13:32.106822 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:13:32.106822 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 23 21:13:32.106822 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 23 21:13:32.107725 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 23 21:13:32.107725 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 23 21:13:32.107725 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 23 21:13:32.107725 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 23 21:13:32.107725 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 23 21:13:32.107725 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:13:32.107725 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:13:32.107725 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:13:32.107725 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:13:32.107725 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:13:32.107725 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:13:32.107725 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 23 21:13:32.107725 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 23 21:13:32.108339 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 23 21:13:32.108339 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:13:32.108339 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-af4bd93d-6ce4-4b84-be7e-4feb25654516 tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:13:32.108339 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-af4bd93d-6ce4-4b84-be7e-4feb25654516 tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.021548 Jul 23 21:13:32.116604 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 26/53] 10.222.0.17 () {60 vars in 1164 bytes} [Sat Jul 23 21:13:32 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 23 21:13:32.126402 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-de58965c-a687-4182-8f69-502e22326b8a tempest-FlavorsAccessNegativeTestJSON-992011010 tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:32.171713 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-de58965c-a687-4182-8f69-502e22326b8a tempest-FlavorsAccessNegativeTestJSON-992011010 tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.053244 Jul 23 21:13:32.172770 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 27/54] 10.222.0.17 () {58 vars in 1145 bytes} [Sat Jul 23 21:13:32 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:13:32.184236 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1a7c894f-4ec0-4340-a8a6-d264059cee99 tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:13:32.187834 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1a7c894f-4ec0-4340-a8a6-d264059cee99 tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] Request method failure captured: Jul 23 21:13:32.187834 ncdv-master-1 devstack@n-api.service[131320]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 23 21:13:32.187834 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:13:32.187834 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:13:32.187834 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:13:32.187834 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 27 Jul 23 21:13:32.187834 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:13:32.187834 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:13:32.187834 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:13:32.187834 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:13:32.187834 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GR4Af3W0fFvw8yTolnoTx8KNEFsndEM3vLnD4hxJdnaehXXWpmsZ1jjg3KpEdBxaaG1ArS76-3FDoYUQAdhJ6y2uiVS2G3hIvpto6hX8kiuR7ZLmmR2sTf-Q4IlaSU0UlW_J6NiqIbelxfSFp1N8iB6uGpt0n53v-bBkPGi_IfUjUw Jul 23 21:13:32.187834 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:13:32.187834 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:13:32.187834 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:13:32.187834 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:13:32.187834 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:13:32.187834 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:13:32.187834 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 91b039b789a9402796ffb5eee541b3d3 Jul 23 21:13:32.187834 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2091976692 Jul 23 21:13:32.187834 ncdv-master-1 devstack@n-api.service[131320]: X-Role: admin,reader,member Jul 23 21:13:32.187834 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: admin,reader,member Jul 23 21:13:32.190469 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/91b039b789a9402796ffb5eee541b3d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/91b039b789a9402796ffb5eee541b3d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_91b039b789a9402796ffb5eee541b3d3", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/91b039b789a9402796ffb5eee541b3d3"}]}] Jul 23 21:13:32.190469 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2091976692 Jul 23 21:13:32.190469 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 91b039b789a9402796ffb5eee541b3d3 Jul 23 21:13:32.190469 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2091976692 Jul 23 21:13:32.190469 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin Jul 23 21:13:32.190469 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:13:32.190469 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:13:32.190469 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 37598ed1e36d4e81936d5ad3cf35612b Jul 23 21:13:32.190469 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin Jul 23 21:13:32.190469 ncdv-master-1 devstack@n-api.service[131320]: Jul 23 21:13:32.190469 ncdv-master-1 devstack@n-api.service[131320]: {"aggregate": {"name": ""}} Jul 23 21:13:32.190469 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:13:32.190469 ncdv-master-1 devstack@n-api.service[131320]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 23 21:13:32.191944 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'body': {'aggregate': {'name': ''}}} Jul 23 21:13:32.191944 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:13:32.191944 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:13:32.191944 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 23 21:13:32.191944 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 23 21:13:32.191944 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 23 21:13:32.191944 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise error Jul 23 21:13:32.191944 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 23 21:13:32.191944 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:13:32.191944 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Jul 23 21:13:32.191944 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 23 21:13:32.191944 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:13:32.191944 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Jul 23 21:13:32.191944 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi '' Jul 23 21:13:32.191944 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:13:32.191944 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:13:32.191944 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:13:32.191944 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:13:32.191944 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:13:32.191944 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:13:32.191944 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:13:32.191944 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:13:32.191944 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:13:32.194504 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:13:32.194504 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:13:32.194504 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:13:32.194504 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 23 21:13:32.194504 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 23 21:13:32.194504 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 23 21:13:32.194504 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 23 21:13:32.194504 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 23 21:13:32.194504 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 23 21:13:32.194504 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 23 21:13:32.194504 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:13:32.194504 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:13:32.194504 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:13:32.194504 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:13:32.194504 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:13:32.194504 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:13:32.194504 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 23 21:13:32.194504 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 23 21:13:32.194504 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 23 21:13:32.194504 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:13:32.196412 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1a7c894f-4ec0-4340-a8a6-d264059cee99 tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:13:32.196412 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1a7c894f-4ec0-4340-a8a6-d264059cee99 tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.016072 Jul 23 21:13:32.198452 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 28/55] 10.222.0.17 () {60 vars in 1163 bytes} [Sat Jul 23 21:13:32 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 23 21:13:32.207857 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ba54d815-6d11-4347-bf8c-48d3d439dc4c tempest-FlavorsAccessNegativeTestJSON-992011010 tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1521056502", "id": 418644420, "os-flavor-access:is_public": "False"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:13:32.207857 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:32.207857 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:13:32.233641 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-fb44f602-897a-4d5f-bf2c-bdb3ade4eff8 tempest-AggregatesAdminTestV241-1866405514 tempest-AggregatesAdminTestV241-1866405514-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 313 microversion: 2.41 time: 0.457572 Jul 23 21:13:32.234620 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 28/56] 10.222.0.17 () {62 vars in 1231 bytes} [Sat Jul 23 21:13:31 2022] POST /compute/v2.1/os-aggregates/3/action => generated 313 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 23 21:13:32.242206 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-3f8209f3-2cc5-41a2-a51f-2f26593ca764 tempest-AggregatesAdminNegativeTestJSON-1992080461 tempest-AggregatesAdminNegativeTestJSON-1992080461-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1807316952"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:13:32.251293 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ba54d815-6d11-4347-bf8c-48d3d439dc4c tempest-FlavorsAccessNegativeTestJSON-992011010 tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.051477 Jul 23 21:13:32.253146 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 29/57] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:13:32 2022] POST /compute/v2.1/flavors => generated 436 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:13:32.259096 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-869003d4-087e-423f-9617-d41d5ed20f91 tempest-AggregatesAdminTestV241-1866405514 tempest-AggregatesAdminTestV241-1866405514-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:13:32.260791 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:32.260791 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:13:32.269016 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:32.269016 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:13:32.269963 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-3f8209f3-2cc5-41a2-a51f-2f26593ca764 tempest-AggregatesAdminNegativeTestJSON-1992080461 tempest-AggregatesAdminNegativeTestJSON-1992080461-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '0e1fdaed25764b15a6f74a925ee81499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681566c31052436b9d2ce072e733f052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:13:32.275355 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-3f8209f3-2cc5-41a2-a51f-2f26593ca764 tempest-AggregatesAdminNegativeTestJSON-1992080461 tempest-AggregatesAdminNegativeTestJSON-1992080461-project] Request method failure captured: Jul 23 21:13:32.275355 ncdv-master-1 devstack@n-api.service[131321]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 23 21:13:32.275355 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:13:32.275355 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:13:32.275355 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:13:32.275355 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 60 Jul 23 21:13:32.275355 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:13:32.275355 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:13:32.275355 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:13:32.275355 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:13:32.275355 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GR24jg3yQ9a_OLew2TbSj5pMYp5j1hBxMQWU5sEwcOe7CdPvlT12VXYE2Y0x3X5Gp8wT4xTdui2HtNjAoc5xldp7LrpNoQKXHKWpDnxijm5gqeiPXeVhEIavZ1o-cuLUTqgnQ0gnxh4oOZGKhPzWgzyuIHj9BN38CSod1QkRw4XpUw Jul 23 21:13:32.275355 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:13:32.275355 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:13:32.275355 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:13:32.275355 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:13:32.275355 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:13:32.275355 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:13:32.275355 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 681566c31052436b9d2ce072e733f052 Jul 23 21:13:32.275355 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1992080461 Jul 23 21:13:32.275355 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:13:32.275355 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:13:32.277235 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/681566c31052436b9d2ce072e733f052"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/681566c31052436b9d2ce072e733f052"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_681566c31052436b9d2ce072e733f052", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/681566c31052436b9d2ce072e733f052"}]}] Jul 23 21:13:32.277235 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1992080461 Jul 23 21:13:32.277235 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 681566c31052436b9d2ce072e733f052 Jul 23 21:13:32.277235 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1992080461 Jul 23 21:13:32.277235 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-AggregatesAdminNegativeTestJSON-1992080461-project Jul 23 21:13:32.277235 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:13:32.277235 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:13:32.277235 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 0e1fdaed25764b15a6f74a925ee81499 Jul 23 21:13:32.277235 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1992080461-project Jul 23 21:13:32.277235 ncdv-master-1 devstack@n-api.service[131321]: Jul 23 21:13:32.277235 ncdv-master-1 devstack@n-api.service[131321]: {"aggregate": {"name": "tempest-test_aggregate-1807316952"}} Jul 23 21:13:32.277235 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:13:32.277235 ncdv-master-1 devstack@n-api.service[131321]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jul 23 21:13:32.279358 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1807316952'}}} Jul 23 21:13:32.279358 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:13:32.279358 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:13:32.279358 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:13:32.279358 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:13:32.279358 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:13:32.279358 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:13:32.279358 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:13:32.279358 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:13:32.279358 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:13:32.279358 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:13:32.279358 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:13:32.279358 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:13:32.279358 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Jul 23 21:13:32.279358 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Jul 23 21:13:32.279358 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 23 21:13:32.279358 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 23 21:13:32.279358 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 23 21:13:32.279358 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 23 21:13:32.280932 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 23 21:13:32.280932 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 23 21:13:32.280932 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 23 21:13:32.280932 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise self.value Jul 23 21:13:32.280932 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 23 21:13:32.280932 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 23 21:13:32.280932 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 23 21:13:32.280932 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 23 21:13:32.280932 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 23 21:13:32.280932 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 23 21:13:32.280932 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jul 23 21:13:32.280932 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:13:32.280932 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:13:32.280932 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:13:32.280932 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:13:32.280932 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:13:32.280932 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:13:32.280932 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 23 21:13:32.280932 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 23 21:13:32.280932 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jul 23 21:13:32.283903 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:13:32.283903 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-3f8209f3-2cc5-41a2-a51f-2f26593ca764 tempest-AggregatesAdminNegativeTestJSON-1992080461 tempest-AggregatesAdminNegativeTestJSON-1992080461-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:13:32.283903 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-3f8209f3-2cc5-41a2-a51f-2f26593ca764 tempest-AggregatesAdminNegativeTestJSON-1992080461 tempest-AggregatesAdminNegativeTestJSON-1992080461-project] 10.222.0.17 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.041005 Jul 23 21:13:32.283903 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 29/58] 10.222.0.17 () {60 vars in 1163 bytes} [Sat Jul 23 21:13:32 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 42 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:13:32.285757 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-869003d4-087e-423f-9617-d41d5ed20f91 tempest-AggregatesAdminTestV241-1866405514 tempest-AggregatesAdminTestV241-1866405514-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:32.286548 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-869003d4-087e-423f-9617-d41d5ed20f91 tempest-AggregatesAdminTestV241-1866405514 tempest-AggregatesAdminTestV241-1866405514-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:32.853685 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-714348d7-b25d-4ffd-bb35-8e0d149ac34d tempest-FlavorsAccessNegativeTestJSON-484976377 tempest-FlavorsAccessNegativeTestJSON-484976377-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "c62a56af2f634cf49e7556c47b3215a6"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:13:32.855886 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:32.855886 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:13:32.857193 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-714348d7-b25d-4ffd-bb35-8e0d149ac34d tempest-FlavorsAccessNegativeTestJSON-484976377 tempest-FlavorsAccessNegativeTestJSON-484976377-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '5edd58f5094b474aa98cf79cbcbebd5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62a56af2f634cf49e7556c47b3215a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:13:32.859208 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-714348d7-b25d-4ffd-bb35-8e0d149ac34d tempest-FlavorsAccessNegativeTestJSON-484976377 tempest-FlavorsAccessNegativeTestJSON-484976377-project] Request method failure captured: Jul 23 21:13:32.859208 ncdv-master-1 devstack@n-api.service[131321]: request: POST /compute/v2.1/flavors/418644420/action HTTP/1.1 Jul 23 21:13:32.859208 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:13:32.859208 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:13:32.859208 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:13:32.859208 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 67 Jul 23 21:13:32.859208 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:13:32.859208 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:13:32.859208 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:13:32.859208 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:13:32.859208 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GR2LefdCS9_JX5rHlNBf2HzKk0IqrxWim0ywAgNR8rjCB3Vl_r2UzbSXrXgWNMfqWKsADx9v21PW0z0eFtyevyvFa6EcetcBY2e6wy2L2txgT7k0A8bcadGLceswR31iXzEvhu0etp9lDmd4SnQPtfYHecQorqBV5DaWRGF7nUcA2Y Jul 23 21:13:32.859208 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:13:32.859208 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:13:32.859208 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:13:32.859208 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:13:32.859208 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:13:32.859208 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:13:32.859208 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: c62a56af2f634cf49e7556c47b3215a6 Jul 23 21:13:32.859208 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-484976377 Jul 23 21:13:32.859208 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:13:32.859208 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:13:32.860304 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c62a56af2f634cf49e7556c47b3215a6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c62a56af2f634cf49e7556c47b3215a6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c62a56af2f634cf49e7556c47b3215a6", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c62a56af2f634cf49e7556c47b3215a6"}]}] Jul 23 21:13:32.860304 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-484976377 Jul 23 21:13:32.860304 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: c62a56af2f634cf49e7556c47b3215a6 Jul 23 21:13:32.860304 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-484976377 Jul 23 21:13:32.860304 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-FlavorsAccessNegativeTestJSON-484976377-project Jul 23 21:13:32.860304 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:13:32.860304 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:13:32.860304 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 5edd58f5094b474aa98cf79cbcbebd5b Jul 23 21:13:32.860304 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-484976377-project Jul 23 21:13:32.860304 ncdv-master-1 devstack@n-api.service[131321]: Jul 23 21:13:32.860304 ncdv-master-1 devstack@n-api.service[131321]: {"addTenantAccess": {"tenant": "c62a56af2f634cf49e7556c47b3215a6"}} Jul 23 21:13:32.860304 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:13:32.860886 ncdv-master-1 devstack@n-api.service[131321]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jul 23 21:13:32.860886 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': '418644420', 'body': {'addTenantAccess': {'tenant': 'c62a56af2f634cf49e7556c47b3215a6'}}} Jul 23 21:13:32.860886 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:13:32.860886 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:13:32.860886 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:13:32.860886 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:13:32.860886 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:13:32.860886 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:13:32.860886 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:13:32.860886 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:13:32.860886 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:13:32.860886 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:13:32.860886 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Jul 23 21:13:32.860886 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Jul 23 21:13:32.860886 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 23 21:13:32.860886 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 23 21:13:32.860886 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 23 21:13:32.860886 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 23 21:13:32.860886 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 23 21:13:32.861770 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 23 21:13:32.861770 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 23 21:13:32.861770 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise self.value Jul 23 21:13:32.861770 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 23 21:13:32.861770 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 23 21:13:32.861770 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 23 21:13:32.861770 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 23 21:13:32.861770 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 23 21:13:32.861770 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 23 21:13:32.861770 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jul 23 21:13:32.861770 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:13:32.861770 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:13:32.861770 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:13:32.861770 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:13:32.861770 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:13:32.861770 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:13:32.861770 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 23 21:13:32.861770 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 23 21:13:32.861770 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jul 23 21:13:32.861770 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:13:32.868316 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-714348d7-b25d-4ffd-bb35-8e0d149ac34d tempest-FlavorsAccessNegativeTestJSON-484976377 tempest-FlavorsAccessNegativeTestJSON-484976377-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:13:32.869519 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-714348d7-b25d-4ffd-bb35-8e0d149ac34d tempest-FlavorsAccessNegativeTestJSON-484976377 tempest-FlavorsAccessNegativeTestJSON-484976377-project] 10.222.0.17 "POST /compute/v2.1/flavors/418644420/action" status: 403 len: 130 microversion: 2.1 time: 0.590532 Jul 23 21:13:32.871944 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 30/59] 10.222.0.17 () {60 vars in 1196 bytes} [Sat Jul 23 21:13:32 2022] POST /compute/v2.1/flavors/418644420/action => generated 130 bytes in 594 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:13:32.881336 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-602e7e56-b0c2-44e5-b9bd-61bc8c4f26cd tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1683426089"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:13:32.889183 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.objects.aggregate [None req-602e7e56-b0c2-44e5-b9bd-61bc8c4f26cd tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] Generated uuid 04d5b26d-1e84-4b61-8b98-871a6202b1fd for aggregate {{(pid=131321) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 23 21:13:32.958379 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-602e7e56-b0c2-44e5-b9bd-61bc8c4f26cd tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.082487 Jul 23 21:13:32.960344 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 31/60] 10.222.0.17 () {60 vars in 1163 bytes} [Sat Jul 23 21:13:32 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:13:32.974568 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c64170bc-b320-4a8d-b74f-e25a6a386532 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:32.978648 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-c64170bc-b320-4a8d-b74f-e25a6a386532 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] [instance: 5b41dd2d-cb23-4e57-91fc-1593508dc8cb] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:13:32.991360 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c64170bc-b320-4a8d-b74f-e25a6a386532 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:32.994336 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c64170bc-b320-4a8d-b74f-e25a6a386532 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:32.999213 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c64170bc-b320-4a8d-b74f-e25a6a386532 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:33.000426 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c64170bc-b320-4a8d-b74f-e25a6a386532 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:33.129030 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c64170bc-b320-4a8d-b74f-e25a6a386532 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199522d29cb746379cb6f75d4b108cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07101aee06ca4bb6885f87cfec3257db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:13:33.143828 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-c64170bc-b320-4a8d-b74f-e25a6a386532 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] 10.222.0.17 "GET /compute/v2.1/servers/5b41dd2d-cb23-4e57-91fc-1593508dc8cb" status: 200 len: 1278 microversion: 2.1 time: 0.180758 Jul 23 21:13:33.154010 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 32/61] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:13:32 2022] GET /compute/v2.1/servers/5b41dd2d-cb23-4e57-91fc-1593508dc8cb => generated 1278 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:13:33.160052 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-cde8a9f9-f2da-4864-93a6-9a3c81ab0576 tempest-FlavorsAccessNegativeTestJSON-992011010 tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:33.161113 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:33.161113 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:13:33.183970 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-cde8a9f9-f2da-4864-93a6-9a3c81ab0576 tempest-FlavorsAccessNegativeTestJSON-992011010 tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/418644420" status: 202 len: 0 microversion: 2.1 time: 0.029222 Jul 23 21:13:33.189129 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 33/62] 10.222.0.17 () {58 vars in 1157 bytes} [Sat Jul 23 21:13:33 2022] DELETE /compute/v2.1/flavors/418644420 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:13:33.195964 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ac6ddab0-4ae3-4355-b471-c3d6e16b98ca tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1683426089"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:13:33.197765 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:33.197765 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:13:33.200886 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.objects.aggregate [None req-ac6ddab0-4ae3-4355-b471-c3d6e16b98ca tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] Generated uuid b0e8f3a4-202b-437d-b586-34c1bf641acf for aggregate {{(pid=131321) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 23 21:13:33.232446 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-ac6ddab0-4ae3-4355-b471-c3d6e16b98ca tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1683426089 already exists. Jul 23 21:13:33.238147 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ac6ddab0-4ae3-4355-b471-c3d6e16b98ca tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] Request method failure captured: Jul 23 21:13:33.238147 ncdv-master-1 devstack@n-api.service[131321]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 23 21:13:33.238147 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:13:33.238147 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:13:33.238147 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:13:33.238147 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 60 Jul 23 21:13:33.238147 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:13:33.238147 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:13:33.238147 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:13:33.238147 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:13:33.238147 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GR4Af3W0fFvw8yTolnoTx8KNEFsndEM3vLnD4hxJdnaehXXWpmsZ1jjg3KpEdBxaaG1ArS76-3FDoYUQAdhJ6y2uiVS2G3hIvpto6hX8kiuR7ZLmmR2sTf-Q4IlaSU0UlW_J6NiqIbelxfSFp1N8iB6uGpt0n53v-bBkPGi_IfUjUw Jul 23 21:13:33.238147 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:13:33.238147 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:13:33.238147 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:13:33.238147 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:13:33.238147 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:13:33.238147 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:13:33.238147 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 91b039b789a9402796ffb5eee541b3d3 Jul 23 21:13:33.238147 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2091976692 Jul 23 21:13:33.238147 ncdv-master-1 devstack@n-api.service[131321]: X-Role: admin,reader,member Jul 23 21:13:33.238147 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: admin,reader,member Jul 23 21:13:33.239439 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/91b039b789a9402796ffb5eee541b3d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/91b039b789a9402796ffb5eee541b3d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_91b039b789a9402796ffb5eee541b3d3", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/91b039b789a9402796ffb5eee541b3d3"}]}] Jul 23 21:13:33.239439 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2091976692 Jul 23 21:13:33.239439 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 91b039b789a9402796ffb5eee541b3d3 Jul 23 21:13:33.239439 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2091976692 Jul 23 21:13:33.239439 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin Jul 23 21:13:33.239439 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:13:33.239439 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:13:33.239439 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 37598ed1e36d4e81936d5ad3cf35612b Jul 23 21:13:33.239439 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin Jul 23 21:13:33.239439 ncdv-master-1 devstack@n-api.service[131321]: Jul 23 21:13:33.239439 ncdv-master-1 devstack@n-api.service[131321]: {"aggregate": {"name": "tempest-test_aggregate-1683426089"}} Jul 23 21:13:33.239439 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:13:33.239439 ncdv-master-1 devstack@n-api.service[131321]: exception: Aggregate tempest-test_aggregate-1683426089 already exists. Jul 23 21:13:33.240138 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1683426089'}}} Jul 23 21:13:33.240138 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:13:33.240138 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:13:33.240138 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Jul 23 21:13:33.240138 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Jul 23 21:13:33.240138 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 23 21:13:33.240138 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 23 21:13:33.240138 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 23 21:13:33.240138 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 23 21:13:33.240138 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 23 21:13:33.240138 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise self.value Jul 23 21:13:33.240138 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 23 21:13:33.240138 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 23 21:13:33.240138 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6330, in create_aggregate Jul 23 21:13:33.240138 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi aggregate.create() Jul 23 21:13:33.240138 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 23 21:13:33.240138 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 23 21:13:33.240138 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Jul 23 21:13:33.240138 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Jul 23 21:13:33.241171 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 23 21:13:33.241171 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 23 21:13:33.241171 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Jul 23 21:13:33.241171 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Jul 23 21:13:33.241171 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-1683426089 already exists. Jul 23 21:13:33.241171 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:13:33.241171 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:13:33.241171 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:13:33.241171 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:13:33.241171 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:13:33.241171 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:13:33.241171 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:13:33.241171 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:13:33.241171 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:13:33.241171 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:13:33.241171 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:13:33.241171 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:13:33.241171 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:13:33.241171 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:13:33.241171 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Jul 23 21:13:33.242314 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Jul 23 21:13:33.242314 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-1683426089 already exists. Jul 23 21:13:33.242314 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:13:33.242314 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:13:33.242314 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:13:33.242314 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:13:33.242314 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:13:33.242314 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:13:33.242314 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:13:33.242314 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:13:33.242314 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-1683426089 already exists. Jul 23 21:13:33.242314 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:13:33.248083 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ac6ddab0-4ae3-4355-b471-c3d6e16b98ca tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1683426089 already exists. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:13:33.251073 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-ac6ddab0-4ae3-4355-b471-c3d6e16b98ca tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.058814 Jul 23 21:13:33.259753 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 34/63] 10.222.0.17 () {60 vars in 1163 bytes} [Sat Jul 23 21:13:33 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 66 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 23 21:13:33.280737 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-31cadddc-6557-4d5f-833a-c054ae377b70 tempest-FlavorsAccessNegativeTestJSON-992011010 tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:33.314502 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-31cadddc-6557-4d5f-833a-c054ae377b70 tempest-FlavorsAccessNegativeTestJSON-992011010 tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.055197 Jul 23 21:13:33.315944 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 35/64] 10.222.0.17 () {58 vars in 1145 bytes} [Sat Jul 23 21:13:33 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:13:33.321689 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-57d8a195-48ab-4e35-b32c-f54b3450655b tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:33.322937 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:33.322937 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:13:33.372954 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-57d8a195-48ab-4e35-b32c-f54b3450655b tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.055120 Jul 23 21:13:33.373554 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 36/65] 10.222.0.17 () {58 vars in 1151 bytes} [Sat Jul 23 21:13:33 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 23 21:13:33.388359 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f860e3ee-96c9-43bb-9abf-a91ed33d044c tempest-FlavorsAccessNegativeTestJSON-992011010 tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-281022803", "id": 799196629, "os-flavor-access:is_public": "False"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:13:33.391677 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:33.391677 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:13:33.420683 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-f860e3ee-96c9-43bb-9abf-a91ed33d044c tempest-FlavorsAccessNegativeTestJSON-992011010 tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.036422 Jul 23 21:13:33.423932 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 37/66] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:13:33 2022] POST /compute/v2.1/flavors => generated 435 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:13:33.432560 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a5f25bc5-8270-47f1-8149-9991557b26ba tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-596024520"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:13:33.435903 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:33.435903 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:13:33.437802 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.objects.aggregate [None req-a5f25bc5-8270-47f1-8149-9991557b26ba tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] Generated uuid c3b1c59e-8360-4952-a8a4-d23607d5e70d for aggregate {{(pid=131321) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 23 21:13:33.477492 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-a5f25bc5-8270-47f1-8149-9991557b26ba tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.051745 Jul 23 21:13:33.478947 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 38/67] 10.222.0.17 () {60 vars in 1163 bytes} [Sat Jul 23 21:13:33 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:13:33.493455 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-31c1e41f-f534-4289-a577-a7698500e8c5 tempest-FlavorsAccessNegativeTestJSON-992011010 tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "c62a56af2f634cf49e7556c47b3215a6"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:13:33.495562 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:33.495562 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:13:33.501675 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-869003d4-087e-423f-9617-d41d5ed20f91 tempest-AggregatesAdminTestV241-1866405514 tempest-AggregatesAdminTestV241-1866405514-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 298 microversion: 2.41 time: 1.245305 Jul 23 21:13:33.504340 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 30/68] 10.222.0.17 () {62 vars in 1231 bytes} [Sat Jul 23 21:13:32 2022] POST /compute/v2.1/os-aggregates/3/action => generated 298 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 23 21:13:33.515602 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3506e18f-1510-4950-84d8-f0297f9ddac4 tempest-AggregatesAdminNegativeTestJSON-1992080461 tempest-AggregatesAdminNegativeTestJSON-1992080461-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:33.517401 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:33.517401 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:13:33.519507 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-3506e18f-1510-4950-84d8-f0297f9ddac4 tempest-AggregatesAdminNegativeTestJSON-1992080461 tempest-AggregatesAdminNegativeTestJSON-1992080461-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '0e1fdaed25764b15a6f74a925ee81499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681566c31052436b9d2ce072e733f052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:13:33.524367 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3506e18f-1510-4950-84d8-f0297f9ddac4 tempest-AggregatesAdminNegativeTestJSON-1992080461 tempest-AggregatesAdminNegativeTestJSON-1992080461-project] Request method failure captured: Jul 23 21:13:33.524367 ncdv-master-1 devstack@n-api.service[131320]: request: DELETE /compute/v2.1/os-aggregates/6 HTTP/1.1 Jul 23 21:13:33.524367 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:13:33.524367 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:13:33.524367 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:13:33.524367 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:13:33.524367 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:13:33.524367 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:13:33.524367 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:13:33.524367 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:13:33.524367 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GR24jg3yQ9a_OLew2TbSj5pMYp5j1hBxMQWU5sEwcOe7CdPvlT12VXYE2Y0x3X5Gp8wT4xTdui2HtNjAoc5xldp7LrpNoQKXHKWpDnxijm5gqeiPXeVhEIavZ1o-cuLUTqgnQ0gnxh4oOZGKhPzWgzyuIHj9BN38CSod1QkRw4XpUw Jul 23 21:13:33.524367 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:13:33.524367 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:13:33.524367 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:13:33.524367 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:13:33.524367 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:13:33.524367 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:13:33.524367 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 681566c31052436b9d2ce072e733f052 Jul 23 21:13:33.524367 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1992080461 Jul 23 21:13:33.524367 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:13:33.524367 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:13:33.525745 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/681566c31052436b9d2ce072e733f052"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/681566c31052436b9d2ce072e733f052"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_681566c31052436b9d2ce072e733f052", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/681566c31052436b9d2ce072e733f052"}]}] Jul 23 21:13:33.525745 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1992080461 Jul 23 21:13:33.525745 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 681566c31052436b9d2ce072e733f052 Jul 23 21:13:33.525745 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1992080461 Jul 23 21:13:33.525745 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-AggregatesAdminNegativeTestJSON-1992080461-project Jul 23 21:13:33.525745 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:13:33.525745 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:13:33.525745 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 0e1fdaed25764b15a6f74a925ee81499 Jul 23 21:13:33.525745 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1992080461-project Jul 23 21:13:33.525745 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:13:33.525745 ncdv-master-1 devstack@n-api.service[131320]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jul 23 21:13:33.525745 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '6'} Jul 23 21:13:33.526451 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:13:33.526451 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:13:33.526451 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:13:33.526451 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:13:33.526451 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:13:33.526451 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:13:33.526451 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:13:33.526451 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:13:33.526451 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Jul 23 21:13:33.526451 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Jul 23 21:13:33.526451 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 23 21:13:33.526451 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 23 21:13:33.526451 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 23 21:13:33.526451 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 23 21:13:33.526451 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 23 21:13:33.526451 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 23 21:13:33.526451 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 23 21:13:33.526451 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise self.value Jul 23 21:13:33.526451 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 23 21:13:33.527523 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 23 21:13:33.527523 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 23 21:13:33.527523 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 23 21:13:33.527523 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 23 21:13:33.527523 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 23 21:13:33.527523 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jul 23 21:13:33.527523 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:13:33.527523 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:13:33.527523 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:13:33.527523 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:13:33.527523 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:13:33.527523 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:13:33.527523 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 23 21:13:33.527523 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 23 21:13:33.527523 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jul 23 21:13:33.527523 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:13:33.530168 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3506e18f-1510-4950-84d8-f0297f9ddac4 tempest-AggregatesAdminNegativeTestJSON-1992080461 tempest-AggregatesAdminNegativeTestJSON-1992080461-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:13:33.532197 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-3506e18f-1510-4950-84d8-f0297f9ddac4 tempest-AggregatesAdminNegativeTestJSON-1992080461 tempest-AggregatesAdminNegativeTestJSON-1992080461-project] 10.222.0.17 "DELETE /compute/v2.1/os-aggregates/6" status: 403 len: 116 microversion: 2.1 time: 0.025175 Jul 23 21:13:33.533895 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 31/69] 10.222.0.17 () {58 vars in 1151 bytes} [Sat Jul 23 21:13:33 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 116 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:13:33.562742 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-490058f7-ab43-498e-bd98-be601e517bd6 tempest-AggregatesAdminTestV241-1866405514 tempest-AggregatesAdminTestV241-1866405514-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:33.620746 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-490058f7-ab43-498e-bd98-be601e517bd6 tempest-AggregatesAdminTestV241-1866405514 tempest-AggregatesAdminTestV241-1866405514-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.41 time: 0.084152 Jul 23 21:13:33.627975 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 32/70] 10.222.0.17 () {60 vars in 1192 bytes} [Sat Jul 23 21:13:33 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:13:33.636132 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-66c2501c-deae-40e2-b21e-976cd3ab8054 tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:33.636878 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:33.636878 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:13:33.691559 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-66c2501c-deae-40e2-b21e-976cd3ab8054 tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.061026 Jul 23 21:13:33.692990 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 33/71] 10.222.0.17 () {58 vars in 1151 bytes} [Sat Jul 23 21:13:33 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 23 21:13:33.706922 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9b52abde-26da-45e2-9bf6-b9912dd577c1 tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:33.708149 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:33.708149 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:13:33.723981 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-9b52abde-26da-45e2-9bf6-b9912dd577c1 tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Jul 23 21:13:33.728013 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9b52abde-26da-45e2-9bf6-b9912dd577c1 tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] Request method failure captured: Jul 23 21:13:33.728013 ncdv-master-1 devstack@n-api.service[131320]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Jul 23 21:13:33.728013 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:13:33.728013 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:13:33.728013 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:13:33.728013 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:13:33.728013 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:13:33.728013 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:13:33.728013 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:13:33.728013 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:13:33.728013 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GR4Af3W0fFvw8yTolnoTx8KNEFsndEM3vLnD4hxJdnaehXXWpmsZ1jjg3KpEdBxaaG1ArS76-3FDoYUQAdhJ6y2uiVS2G3hIvpto6hX8kiuR7ZLmmR2sTf-Q4IlaSU0UlW_J6NiqIbelxfSFp1N8iB6uGpt0n53v-bBkPGi_IfUjUw Jul 23 21:13:33.728013 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:13:33.728013 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:13:33.728013 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:13:33.728013 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:13:33.728013 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:13:33.728013 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:13:33.728013 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 91b039b789a9402796ffb5eee541b3d3 Jul 23 21:13:33.728013 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2091976692 Jul 23 21:13:33.728013 ncdv-master-1 devstack@n-api.service[131320]: X-Role: admin,reader,member Jul 23 21:13:33.728013 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: admin,reader,member Jul 23 21:13:33.729128 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/91b039b789a9402796ffb5eee541b3d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/91b039b789a9402796ffb5eee541b3d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_91b039b789a9402796ffb5eee541b3d3", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/91b039b789a9402796ffb5eee541b3d3"}]}] Jul 23 21:13:33.729128 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2091976692 Jul 23 21:13:33.729128 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 91b039b789a9402796ffb5eee541b3d3 Jul 23 21:13:33.729128 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2091976692 Jul 23 21:13:33.729128 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin Jul 23 21:13:33.729128 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:13:33.729128 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:13:33.729128 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 37598ed1e36d4e81936d5ad3cf35612b Jul 23 21:13:33.729128 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin Jul 23 21:13:33.729128 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:13:33.729128 ncdv-master-1 devstack@n-api.service[131320]: exception: Aggregate -1 could not be found. Jul 23 21:13:33.729128 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '-1'} Jul 23 21:13:33.729757 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:13:33.729757 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:13:33.729757 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jul 23 21:13:33.729757 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jul 23 21:13:33.729757 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 23 21:13:33.729757 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 23 21:13:33.729757 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 23 21:13:33.729757 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 23 21:13:33.729757 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 23 21:13:33.729757 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise self.value Jul 23 21:13:33.729757 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 23 21:13:33.729757 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 23 21:13:33.729757 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate Jul 23 21:13:33.729757 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jul 23 21:13:33.729757 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 23 21:13:33.729757 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 23 21:13:33.729757 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 23 21:13:33.729757 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 23 21:13:33.729757 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 23 21:13:33.730859 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 23 21:13:33.730859 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 23 21:13:33.730859 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 23 21:13:33.730859 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Jul 23 21:13:33.730859 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:13:33.730859 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:13:33.730859 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:13:33.730859 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:13:33.730859 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:13:33.730859 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:13:33.730859 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:13:33.730859 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:13:33.730859 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:13:33.730859 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:13:33.730859 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jul 23 21:13:33.730859 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:13:33.730859 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Jul 23 21:13:33.730859 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:13:33.730859 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:13:33.730859 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:13:33.730859 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:13:33.732154 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:13:33.732154 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:13:33.732154 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:13:33.732154 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:13:33.732154 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Jul 23 21:13:33.732154 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:13:33.732154 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9b52abde-26da-45e2-9bf6-b9912dd577c1 tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:13:33.732154 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9b52abde-26da-45e2-9bf6-b9912dd577c1 tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.032503 Jul 23 21:13:33.732154 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 34/72] 10.222.0.17 () {58 vars in 1154 bytes} [Sat Jul 23 21:13:33 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 23 21:13:33.747829 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-fbcbe9ea-6fb3-4b5d-8894-a2d51245cf2e tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1807547553", "name": "tempest-test_aggregate-453054849"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:13:33.778186 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:33.778186 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:13:33.779354 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.objects.aggregate [None req-fbcbe9ea-6fb3-4b5d-8894-a2d51245cf2e tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] Generated uuid 9de84d7f-c701-475c-a103-42be8f23de32 for aggregate {{(pid=131320) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 23 21:13:33.826502 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-fbcbe9ea-6fb3-4b5d-8894-a2d51245cf2e tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.091068 Jul 23 21:13:33.827728 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 35/73] 10.222.0.17 () {60 vars in 1164 bytes} [Sat Jul 23 21:13:33 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:13:33.839423 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-bb293063-9816-4a4e-99fe-e2d91ca17248 tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-165974283"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:13:33.840857 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:33.840857 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:13:33.846697 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.objects.aggregate [None req-bb293063-9816-4a4e-99fe-e2d91ca17248 tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] Generated uuid f6682f64-b7c7-4a85-9bf2-abf9b2a00aa8 for aggregate {{(pid=131320) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 23 21:13:33.897793 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-bb293063-9816-4a4e-99fe-e2d91ca17248 tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.066468 Jul 23 21:13:33.899516 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 36/74] 10.222.0.17 () {60 vars in 1163 bytes} [Sat Jul 23 21:13:33 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:13:33.910031 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ffaeb55a-71f8-4ad5-813a-5eb55c10a1f8 tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:33.910819 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:33.910819 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:13:33.934844 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ffaeb55a-71f8-4ad5-813a-5eb55c10a1f8 tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] 10.222.0.17 "GET /compute/v2.1/os-aggregates" status: 200 len: 515 microversion: 2.1 time: 0.032528 Jul 23 21:13:33.935895 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 37/75] 10.222.0.17 () {58 vars in 1142 bytes} [Sat Jul 23 21:13:33 2022] GET /compute/v2.1/os-aggregates => generated 515 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:13:33.941185 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d0b4f157-7efc-4e11-90af-a5bef5536707 tempest-AggregatesAdminNegativeTestJSON-1992080461 tempest-AggregatesAdminNegativeTestJSON-1992080461-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:33.942070 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:33.942070 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:13:33.942977 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d0b4f157-7efc-4e11-90af-a5bef5536707 tempest-AggregatesAdminNegativeTestJSON-1992080461 tempest-AggregatesAdminNegativeTestJSON-1992080461-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '0e1fdaed25764b15a6f74a925ee81499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681566c31052436b9d2ce072e733f052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:13:33.944706 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d0b4f157-7efc-4e11-90af-a5bef5536707 tempest-AggregatesAdminNegativeTestJSON-1992080461 tempest-AggregatesAdminNegativeTestJSON-1992080461-project] Request method failure captured: Jul 23 21:13:33.944706 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/os-aggregates/8 HTTP/1.1 Jul 23 21:13:33.944706 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:13:33.944706 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:13:33.944706 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:13:33.944706 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:13:33.944706 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:13:33.944706 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:13:33.944706 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:13:33.944706 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:13:33.944706 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GR24jg3yQ9a_OLew2TbSj5pMYp5j1hBxMQWU5sEwcOe7CdPvlT12VXYE2Y0x3X5Gp8wT4xTdui2HtNjAoc5xldp7LrpNoQKXHKWpDnxijm5gqeiPXeVhEIavZ1o-cuLUTqgnQ0gnxh4oOZGKhPzWgzyuIHj9BN38CSod1QkRw4XpUw Jul 23 21:13:33.944706 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:13:33.944706 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:13:33.944706 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:13:33.944706 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:13:33.944706 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:13:33.944706 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:13:33.944706 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 681566c31052436b9d2ce072e733f052 Jul 23 21:13:33.944706 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1992080461 Jul 23 21:13:33.944706 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:13:33.944706 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:13:33.945805 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/681566c31052436b9d2ce072e733f052"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/681566c31052436b9d2ce072e733f052"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_681566c31052436b9d2ce072e733f052", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/681566c31052436b9d2ce072e733f052"}]}] Jul 23 21:13:33.945805 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1992080461 Jul 23 21:13:33.945805 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 681566c31052436b9d2ce072e733f052 Jul 23 21:13:33.945805 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1992080461 Jul 23 21:13:33.945805 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-AggregatesAdminNegativeTestJSON-1992080461-project Jul 23 21:13:33.945805 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:13:33.945805 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:13:33.945805 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 0e1fdaed25764b15a6f74a925ee81499 Jul 23 21:13:33.945805 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1992080461-project Jul 23 21:13:33.945805 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:13:33.945805 ncdv-master-1 devstack@n-api.service[131320]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jul 23 21:13:33.945805 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '8'} Jul 23 21:13:33.946487 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:13:33.946487 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:13:33.946487 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:13:33.946487 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:13:33.946487 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:13:33.946487 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:13:33.946487 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:13:33.946487 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:13:33.946487 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Jul 23 21:13:33.946487 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Jul 23 21:13:33.946487 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 23 21:13:33.946487 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 23 21:13:33.946487 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 23 21:13:33.946487 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 23 21:13:33.946487 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 23 21:13:33.946487 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 23 21:13:33.946487 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 23 21:13:33.946487 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise self.value Jul 23 21:13:33.946487 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 23 21:13:33.947406 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 23 21:13:33.947406 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 23 21:13:33.947406 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 23 21:13:33.947406 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 23 21:13:33.947406 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 23 21:13:33.947406 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jul 23 21:13:33.947406 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:13:33.947406 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:13:33.947406 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:13:33.947406 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:13:33.947406 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:13:33.947406 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:13:33.947406 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 23 21:13:33.947406 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 23 21:13:33.947406 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jul 23 21:13:33.947406 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:13:33.947406 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d0b4f157-7efc-4e11-90af-a5bef5536707 tempest-AggregatesAdminNegativeTestJSON-1992080461 tempest-AggregatesAdminNegativeTestJSON-1992080461-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:13:33.948320 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d0b4f157-7efc-4e11-90af-a5bef5536707 tempest-AggregatesAdminNegativeTestJSON-1992080461 tempest-AggregatesAdminNegativeTestJSON-1992080461-project] 10.222.0.17 "GET /compute/v2.1/os-aggregates/8" status: 403 len: 114 microversion: 2.1 time: 0.009524 Jul 23 21:13:33.950498 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 38/76] 10.222.0.17 () {58 vars in 1148 bytes} [Sat Jul 23 21:13:33 2022] GET /compute/v2.1/os-aggregates/8 => generated 114 bytes in 14 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:13:33.955420 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f0416653-0c96-4a3c-8726-2a48c90dfecf tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:13:33.956857 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:33.956857 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:13:33.967261 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f0416653-0c96-4a3c-8726-2a48c90dfecf tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:33.967887 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f0416653-0c96-4a3c-8726-2a48c90dfecf tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:34.274306 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f0416653-0c96-4a3c-8726-2a48c90dfecf tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates/7/action" status: 200 len: 314 microversion: 2.1 time: 0.321963 Jul 23 21:13:34.281661 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 39/77] 10.222.0.17 () {60 vars in 1190 bytes} [Sat Jul 23 21:13:33 2022] POST /compute/v2.1/os-aggregates/7/action => generated 314 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:13:34.288737 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-19a0ffb5-cb3f-4b75-ad0f-a6340ebca4aa tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:34.290286 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:34.290286 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:13:34.332701 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-19a0ffb5-cb3f-4b75-ad0f-a6340ebca4aa tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.049001 Jul 23 21:13:34.333986 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 40/78] 10.222.0.17 () {58 vars in 1151 bytes} [Sat Jul 23 21:13:34 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 23 21:13:34.342479 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-94dfe81b-fe9a-4779-97e4-a234dced0bee tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:34.344446 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-94dfe81b-fe9a-4779-97e4-a234dced0bee tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] [instance: 5b41dd2d-cb23-4e57-91fc-1593508dc8cb] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:13:34.368347 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-94dfe81b-fe9a-4779-97e4-a234dced0bee tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:34.369927 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-94dfe81b-fe9a-4779-97e4-a234dced0bee tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:34.371165 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-94dfe81b-fe9a-4779-97e4-a234dced0bee tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:34.371840 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-94dfe81b-fe9a-4779-97e4-a234dced0bee tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:34.818593 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-31c1e41f-f534-4289-a577-a7698500e8c5 tempest-FlavorsAccessNegativeTestJSON-992011010 tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors/799196629/action" status: 200 len: 96 microversion: 2.1 time: 1.338313 Jul 23 21:13:34.821080 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 39/79] 10.222.0.17 () {60 vars in 1196 bytes} [Sat Jul 23 21:13:33 2022] POST /compute/v2.1/flavors/799196629/action => generated 96 bytes in 1341 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 23 21:13:34.833794 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ace094b9-2f67-4e62-8fa5-14d4e17b9882 tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:34.834709 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:34.834709 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:13:34.851998 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-ace094b9-2f67-4e62-8fa5-14d4e17b9882 tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Jul 23 21:13:34.859276 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ace094b9-2f67-4e62-8fa5-14d4e17b9882 tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] Request method failure captured: Jul 23 21:13:34.859276 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Jul 23 21:13:34.859276 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:13:34.859276 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:13:34.859276 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:13:34.859276 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:13:34.859276 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:13:34.859276 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:13:34.859276 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:13:34.859276 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:13:34.859276 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GR4Af3W0fFvw8yTolnoTx8KNEFsndEM3vLnD4hxJdnaehXXWpmsZ1jjg3KpEdBxaaG1ArS76-3FDoYUQAdhJ6y2uiVS2G3hIvpto6hX8kiuR7ZLmmR2sTf-Q4IlaSU0UlW_J6NiqIbelxfSFp1N8iB6uGpt0n53v-bBkPGi_IfUjUw Jul 23 21:13:34.859276 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:13:34.859276 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:13:34.859276 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:13:34.859276 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:13:34.859276 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:13:34.859276 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:13:34.859276 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 91b039b789a9402796ffb5eee541b3d3 Jul 23 21:13:34.859276 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2091976692 Jul 23 21:13:34.859276 ncdv-master-1 devstack@n-api.service[131321]: X-Role: admin,reader,member Jul 23 21:13:34.859276 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: admin,reader,member Jul 23 21:13:34.860641 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/91b039b789a9402796ffb5eee541b3d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/91b039b789a9402796ffb5eee541b3d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_91b039b789a9402796ffb5eee541b3d3", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/91b039b789a9402796ffb5eee541b3d3"}]}] Jul 23 21:13:34.860641 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2091976692 Jul 23 21:13:34.860641 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 91b039b789a9402796ffb5eee541b3d3 Jul 23 21:13:34.860641 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2091976692 Jul 23 21:13:34.860641 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin Jul 23 21:13:34.860641 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:13:34.860641 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:13:34.860641 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 37598ed1e36d4e81936d5ad3cf35612b Jul 23 21:13:34.860641 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin Jul 23 21:13:34.860641 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:13:34.860641 ncdv-master-1 devstack@n-api.service[131321]: exception: Aggregate -1 could not be found. Jul 23 21:13:34.860641 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': '-1'} Jul 23 21:13:34.861275 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:13:34.861275 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:13:34.861275 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jul 23 21:13:34.861275 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jul 23 21:13:34.861275 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate Jul 23 21:13:34.861275 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jul 23 21:13:34.861275 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 23 21:13:34.861275 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 23 21:13:34.861275 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 23 21:13:34.861275 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 23 21:13:34.861275 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 23 21:13:34.861275 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 23 21:13:34.861275 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 23 21:13:34.861275 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 23 21:13:34.861275 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Jul 23 21:13:34.861275 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:13:34.861275 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:13:34.861275 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:13:34.861275 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:13:34.861275 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:13:34.862339 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:13:34.862339 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:13:34.862339 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:13:34.862339 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:13:34.862339 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:13:34.862339 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jul 23 21:13:34.862339 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:13:34.862339 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Jul 23 21:13:34.862339 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:13:34.862339 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:13:34.862339 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:13:34.862339 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:13:34.862339 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:13:34.862339 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:13:34.862339 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:13:34.862339 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:13:34.862339 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Jul 23 21:13:34.862339 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:13:34.867167 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ace094b9-2f67-4e62-8fa5-14d4e17b9882 tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:13:34.870577 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-ace094b9-2f67-4e62-8fa5-14d4e17b9882 tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] 10.222.0.17 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.046522 Jul 23 21:13:34.872802 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 40/80] 10.222.0.17 () {58 vars in 1151 bytes} [Sat Jul 23 21:13:34 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 23 21:13:34.891667 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-804f5b6d-97ba-4e8d-b504-b2a0b8f89397 tempest-FlavorsAccessNegativeTestJSON-484976377 tempest-FlavorsAccessNegativeTestJSON-484976377-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "c62a56af2f634cf49e7556c47b3215a6"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:13:34.893474 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:34.893474 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:13:34.895225 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-804f5b6d-97ba-4e8d-b504-b2a0b8f89397 tempest-FlavorsAccessNegativeTestJSON-484976377 tempest-FlavorsAccessNegativeTestJSON-484976377-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '5edd58f5094b474aa98cf79cbcbebd5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c62a56af2f634cf49e7556c47b3215a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:13:34.900239 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-804f5b6d-97ba-4e8d-b504-b2a0b8f89397 tempest-FlavorsAccessNegativeTestJSON-484976377 tempest-FlavorsAccessNegativeTestJSON-484976377-project] Request method failure captured: Jul 23 21:13:34.900239 ncdv-master-1 devstack@n-api.service[131321]: request: POST /compute/v2.1/flavors/799196629/action HTTP/1.1 Jul 23 21:13:34.900239 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:13:34.900239 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:13:34.900239 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:13:34.900239 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 70 Jul 23 21:13:34.900239 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:13:34.900239 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:13:34.900239 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:13:34.900239 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:13:34.900239 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GR2LefdCS9_JX5rHlNBf2HzKk0IqrxWim0ywAgNR8rjCB3Vl_r2UzbSXrXgWNMfqWKsADx9v21PW0z0eFtyevyvFa6EcetcBY2e6wy2L2txgT7k0A8bcadGLceswR31iXzEvhu0etp9lDmd4SnQPtfYHecQorqBV5DaWRGF7nUcA2Y Jul 23 21:13:34.900239 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:13:34.900239 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:13:34.900239 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:13:34.900239 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:13:34.900239 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:13:34.900239 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:13:34.900239 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: c62a56af2f634cf49e7556c47b3215a6 Jul 23 21:13:34.900239 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-484976377 Jul 23 21:13:34.900239 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:13:34.900239 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:13:34.901382 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c62a56af2f634cf49e7556c47b3215a6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c62a56af2f634cf49e7556c47b3215a6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c62a56af2f634cf49e7556c47b3215a6", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c62a56af2f634cf49e7556c47b3215a6"}]}] Jul 23 21:13:34.901382 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-484976377 Jul 23 21:13:34.901382 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: c62a56af2f634cf49e7556c47b3215a6 Jul 23 21:13:34.901382 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-484976377 Jul 23 21:13:34.901382 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-FlavorsAccessNegativeTestJSON-484976377-project Jul 23 21:13:34.901382 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:13:34.901382 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:13:34.901382 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 5edd58f5094b474aa98cf79cbcbebd5b Jul 23 21:13:34.901382 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-484976377-project Jul 23 21:13:34.901382 ncdv-master-1 devstack@n-api.service[131321]: Jul 23 21:13:34.901382 ncdv-master-1 devstack@n-api.service[131321]: {"removeTenantAccess": {"tenant": "c62a56af2f634cf49e7556c47b3215a6"}} Jul 23 21:13:34.901382 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:13:34.902030 ncdv-master-1 devstack@n-api.service[131321]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jul 23 21:13:34.902030 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': '799196629', 'body': {'removeTenantAccess': {'tenant': 'c62a56af2f634cf49e7556c47b3215a6'}}} Jul 23 21:13:34.902030 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:13:34.902030 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:13:34.902030 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:13:34.902030 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:13:34.902030 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:13:34.902030 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:13:34.902030 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:13:34.902030 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:13:34.902030 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:13:34.902030 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:13:34.902030 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Jul 23 21:13:34.902030 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi context.can( Jul 23 21:13:34.902030 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 23 21:13:34.902030 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 23 21:13:34.902030 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 23 21:13:34.902030 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 23 21:13:34.902030 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 23 21:13:34.902030 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 23 21:13:34.903033 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 23 21:13:34.903033 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise self.value Jul 23 21:13:34.903033 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 23 21:13:34.903033 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 23 21:13:34.903033 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 23 21:13:34.903033 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 23 21:13:34.903033 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 23 21:13:34.903033 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 23 21:13:34.903033 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jul 23 21:13:34.903033 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:13:34.903033 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:13:34.903033 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:13:34.903033 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:13:34.903033 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:13:34.903033 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:13:34.903033 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 23 21:13:34.903033 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 23 21:13:34.903033 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jul 23 21:13:34.903033 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:13:34.906495 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-804f5b6d-97ba-4e8d-b504-b2a0b8f89397 tempest-FlavorsAccessNegativeTestJSON-484976377 tempest-FlavorsAccessNegativeTestJSON-484976377-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:13:34.907772 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-804f5b6d-97ba-4e8d-b504-b2a0b8f89397 tempest-FlavorsAccessNegativeTestJSON-484976377 tempest-FlavorsAccessNegativeTestJSON-484976377-project] 10.222.0.17 "POST /compute/v2.1/flavors/799196629/action" status: 403 len: 133 microversion: 2.1 time: 0.032506 Jul 23 21:13:34.910560 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 41/81] 10.222.0.17 () {60 vars in 1196 bytes} [Sat Jul 23 21:13:34 2022] POST /compute/v2.1/flavors/799196629/action => generated 133 bytes in 37 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:13:34.919873 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-94dfe81b-fe9a-4779-97e4-a234dced0bee tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199522d29cb746379cb6f75d4b108cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07101aee06ca4bb6885f87cfec3257db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:13:34.936886 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-fd4e2c5c-d725-446f-be28-fc348f85e3d7 tempest-AggregatesAdminNegativeTestJSON-1992080461 tempest-AggregatesAdminNegativeTestJSON-1992080461-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:34.937673 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:34.937673 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:13:34.938638 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-fd4e2c5c-d725-446f-be28-fc348f85e3d7 tempest-AggregatesAdminNegativeTestJSON-1992080461 tempest-AggregatesAdminNegativeTestJSON-1992080461-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '0e1fdaed25764b15a6f74a925ee81499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681566c31052436b9d2ce072e733f052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:13:34.944933 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-94dfe81b-fe9a-4779-97e4-a234dced0bee tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] 10.222.0.17 "GET /compute/v2.1/servers/5b41dd2d-cb23-4e57-91fc-1593508dc8cb" status: 200 len: 1342 microversion: 2.1 time: 0.609644 Jul 23 21:13:34.947755 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-fd4e2c5c-d725-446f-be28-fc348f85e3d7 tempest-AggregatesAdminNegativeTestJSON-1992080461 tempest-AggregatesAdminNegativeTestJSON-1992080461-project] Request method failure captured: Jul 23 21:13:34.947755 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Jul 23 21:13:34.947755 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:13:34.947755 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:13:34.947755 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:13:34.947755 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:13:34.947755 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:13:34.947755 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:13:34.947755 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:13:34.947755 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:13:34.947755 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GR24jg3yQ9a_OLew2TbSj5pMYp5j1hBxMQWU5sEwcOe7CdPvlT12VXYE2Y0x3X5Gp8wT4xTdui2HtNjAoc5xldp7LrpNoQKXHKWpDnxijm5gqeiPXeVhEIavZ1o-cuLUTqgnQ0gnxh4oOZGKhPzWgzyuIHj9BN38CSod1QkRw4XpUw Jul 23 21:13:34.947755 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:13:34.947755 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:13:34.947755 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:13:34.947755 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:13:34.947755 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:13:34.947755 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:13:34.947755 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 681566c31052436b9d2ce072e733f052 Jul 23 21:13:34.947755 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1992080461 Jul 23 21:13:34.947755 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:13:34.947755 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:13:34.949020 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/681566c31052436b9d2ce072e733f052"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/681566c31052436b9d2ce072e733f052"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_681566c31052436b9d2ce072e733f052", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/681566c31052436b9d2ce072e733f052"}]}] Jul 23 21:13:34.949020 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1992080461 Jul 23 21:13:34.949020 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 681566c31052436b9d2ce072e733f052 Jul 23 21:13:34.949020 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1992080461 Jul 23 21:13:34.949020 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-AggregatesAdminNegativeTestJSON-1992080461-project Jul 23 21:13:34.949020 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:13:34.949020 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:13:34.949020 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 0e1fdaed25764b15a6f74a925ee81499 Jul 23 21:13:34.949020 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1992080461-project Jul 23 21:13:34.949020 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:13:34.949020 ncdv-master-1 devstack@n-api.service[131321]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jul 23 21:13:34.949020 ncdv-master-1 devstack@n-api.service[131321]: action_args: {} Jul 23 21:13:34.949709 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:13:34.949709 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:13:34.949709 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:13:34.949709 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:13:34.949709 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:13:34.949709 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:13:34.949709 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:13:34.949709 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:13:34.949709 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Jul 23 21:13:34.949709 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Jul 23 21:13:34.949709 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 23 21:13:34.949709 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 23 21:13:34.949709 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 23 21:13:34.949709 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 23 21:13:34.949709 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 23 21:13:34.949709 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 23 21:13:34.949709 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 23 21:13:34.949709 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise self.value Jul 23 21:13:34.949709 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 23 21:13:34.950725 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 23 21:13:34.950725 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 23 21:13:34.950725 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 23 21:13:34.950725 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 23 21:13:34.950725 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 23 21:13:34.950725 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jul 23 21:13:34.950725 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:13:34.950725 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:13:34.950725 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:13:34.950725 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:13:34.950725 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:13:34.950725 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:13:34.950725 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 23 21:13:34.950725 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 23 21:13:34.950725 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jul 23 21:13:34.950725 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:13:34.952650 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 41/82] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:13:34 2022] GET /compute/v2.1/servers/5b41dd2d-cb23-4e57-91fc-1593508dc8cb => generated 1342 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:13:34.955178 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-fd4e2c5c-d725-446f-be28-fc348f85e3d7 tempest-AggregatesAdminNegativeTestJSON-1992080461 tempest-AggregatesAdminNegativeTestJSON-1992080461-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:13:34.957718 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-fd4e2c5c-d725-446f-be28-fc348f85e3d7 tempest-AggregatesAdminNegativeTestJSON-1992080461 tempest-AggregatesAdminNegativeTestJSON-1992080461-project] 10.222.0.17 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.044399 Jul 23 21:13:34.961214 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a5ce9aa0-b7a1-4bfa-b853-0c0cc5e93cc0 tempest-FlavorsAccessNegativeTestJSON-992011010 tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "c62a56af2f634cf49e7556c47b3215a6"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:13:34.962203 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 42/83] 10.222.0.17 () {58 vars in 1142 bytes} [Sat Jul 23 21:13:34 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 51 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:13:34.964744 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:34.964744 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:13:35.429940 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a2391712-44c5-4084-bb43-09798a8e0b06 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-1438898839", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "availability_zone": "tempest-test_az-1807547553"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:13:35.451019 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a2391712-44c5-4084-bb43-09798a8e0b06 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:35.451487 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a2391712-44c5-4084-bb43-09798a8e0b06 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:35.454931 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a2391712-44c5-4084-bb43-09798a8e0b06 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:35.455590 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a2391712-44c5-4084-bb43-09798a8e0b06 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:35.596922 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.network.neutron [None req-a2391712-44c5-4084-bb43-09798a8e0b06 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] validate_networks() for None {{(pid=131321) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:13:35.862307 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a5ce9aa0-b7a1-4bfa-b853-0c0cc5e93cc0 tempest-FlavorsAccessNegativeTestJSON-992011010 tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors/799196629/action" status: 200 len: 21 microversion: 2.1 time: 0.908169 Jul 23 21:13:35.868054 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 42/84] 10.222.0.17 () {60 vars in 1196 bytes} [Sat Jul 23 21:13:34 2022] POST /compute/v2.1/flavors/799196629/action => generated 21 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 23 21:13:35.874385 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-83305ac2-3d4f-4d22-8a35-5519c1e0abc3 tempest-FlavorsAccessNegativeTestJSON-992011010 tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:35.876057 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:35.876057 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:13:35.899556 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-83305ac2-3d4f-4d22-8a35-5519c1e0abc3 tempest-FlavorsAccessNegativeTestJSON-992011010 tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/799196629" status: 202 len: 0 microversion: 2.1 time: 0.029809 Jul 23 21:13:35.901889 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 43/85] 10.222.0.17 () {58 vars in 1157 bytes} [Sat Jul 23 21:13:35 2022] DELETE /compute/v2.1/flavors/799196629 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:13:35.914670 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9fdf3884-b0fd-4c11-bfa4-beba858b720b tempest-FlavorsAccessNegativeTestJSON-992011010 tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:35.953764 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9fdf3884-b0fd-4c11-bfa4-beba858b720b tempest-FlavorsAccessNegativeTestJSON-992011010 tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.047156 Jul 23 21:13:35.959260 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 44/86] 10.222.0.17 () {58 vars in 1145 bytes} [Sat Jul 23 21:13:35 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:13:35.975476 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2431bbf4-37ee-47da-9d74-528c25f28ee9 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:35.976886 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-2431bbf4-37ee-47da-9d74-528c25f28ee9 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] [instance: 5b41dd2d-cb23-4e57-91fc-1593508dc8cb] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:13:35.990077 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2431bbf4-37ee-47da-9d74-528c25f28ee9 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:35.991048 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2431bbf4-37ee-47da-9d74-528c25f28ee9 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:35.992104 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2431bbf4-37ee-47da-9d74-528c25f28ee9 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:35.993543 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2431bbf4-37ee-47da-9d74-528c25f28ee9 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:36.340492 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-a2391712-44c5-4084-bb43-09798a8e0b06 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Flavor limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:13:36.341501 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-a2391712-44c5-4084-bb43-09798a8e0b06 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Image limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:13:36.342219 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-a2391712-44c5-4084-bb43-09798a8e0b06 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Flavor pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:13:36.342808 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-a2391712-44c5-4084-bb43-09798a8e0b06 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Image pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:13:36.343423 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-a2391712-44c5-4084-bb43-09798a8e0b06 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:13:36.387773 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a2391712-44c5-4084-bb43-09798a8e0b06 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:36.388243 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a2391712-44c5-4084-bb43-09798a8e0b06 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:36.389047 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a2391712-44c5-4084-bb43-09798a8e0b06 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:36.389485 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a2391712-44c5-4084-bb43-09798a8e0b06 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:36.485736 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-a2391712-44c5-4084-bb43-09798a8e0b06 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Getting quotas for project 2366e681931c49118c1120350487bde5. Resources: {'ram', 'instances', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:13:36.522320 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-a2391712-44c5-4084-bb43-09798a8e0b06 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Getting quotas for user 95896f2064e34e5d82e9531e68aab170 and project 2366e681931c49118c1120350487bde5. Resources: {'ram', 'instances', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:13:36.598299 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-a2391712-44c5-4084-bb43-09798a8e0b06 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Going to run 1 instances... {{(pid=131321) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:13:36.604355 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-a2391712-44c5-4084-bb43-09798a8e0b06 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] [instance: 1d5a909f-c169-415e-a7b7-41835906e801] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131321) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:13:36.829566 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-2431bbf4-37ee-47da-9d74-528c25f28ee9 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199522d29cb746379cb6f75d4b108cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07101aee06ca4bb6885f87cfec3257db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:13:36.836256 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-a2391712-44c5-4084-bb43-09798a8e0b06 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.790148 Jul 23 21:13:36.837617 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 43/87] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:13:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1793 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 23 21:13:36.848724 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-53fa2ba5-2609-4b69-9f1f-c7b879c6d212 tempest-FlavorsAccessNegativeTestJSON-992011010 tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1103169950", "id": 424365729, "os-flavor-access:is_public": "False"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:13:36.848983 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2431bbf4-37ee-47da-9d74-528c25f28ee9 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] 10.222.0.17 "GET /compute/v2.1/servers/5b41dd2d-cb23-4e57-91fc-1593508dc8cb" status: 200 len: 1342 microversion: 2.1 time: 0.887289 Jul 23 21:13:36.849799 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 45/88] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:13:35 2022] GET /compute/v2.1/servers/5b41dd2d-cb23-4e57-91fc-1593508dc8cb => generated 1342 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:13:36.862355 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:36.862355 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:13:36.864468 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5ee4a7db-380b-4c58-bb4e-e4c42f9163aa tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:36.866469 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5ee4a7db-380b-4c58-bb4e-e4c42f9163aa tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] [instance: 1d5a909f-c169-415e-a7b7-41835906e801] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:13:36.912026 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-53fa2ba5-2609-4b69-9f1f-c7b879c6d212 tempest-FlavorsAccessNegativeTestJSON-992011010 tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.072462 Jul 23 21:13:36.918769 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 44/89] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:13:36 2022] POST /compute/v2.1/flavors => generated 436 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:13:36.929419 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-7d5d34f5-9a6c-44ef-83a4-a25a2209b2bd tempest-FlavorsAccessNegativeTestJSON-992011010 tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "aefbf9ae46e34052b41a581194a5ebfb"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:13:36.933383 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:36.933383 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:13:37.055827 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5ee4a7db-380b-4c58-bb4e-e4c42f9163aa tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95896f2064e34e5d82e9531e68aab170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2366e681931c49118c1120350487bde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:13:37.074908 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5ee4a7db-380b-4c58-bb4e-e4c42f9163aa tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] 10.222.0.17 "GET /compute/v2.1/servers/1d5a909f-c169-415e-a7b7-41835906e801" status: 200 len: 1243 microversion: 2.1 time: 0.222333 Jul 23 21:13:37.078632 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 46/90] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:13:36 2022] GET /compute/v2.1/servers/1d5a909f-c169-415e-a7b7-41835906e801 => generated 1243 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:13:37.866888 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5984f44f-45db-432d-9d02-b757de5c7d95 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:37.867812 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5984f44f-45db-432d-9d02-b757de5c7d95 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] [instance: 5b41dd2d-cb23-4e57-91fc-1593508dc8cb] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:13:37.877339 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5984f44f-45db-432d-9d02-b757de5c7d95 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:37.887409 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5984f44f-45db-432d-9d02-b757de5c7d95 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:37.888455 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5984f44f-45db-432d-9d02-b757de5c7d95 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:37.891234 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5984f44f-45db-432d-9d02-b757de5c7d95 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:38.230272 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5984f44f-45db-432d-9d02-b757de5c7d95 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199522d29cb746379cb6f75d4b108cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07101aee06ca4bb6885f87cfec3257db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:13:38.238265 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5984f44f-45db-432d-9d02-b757de5c7d95 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] 10.222.0.17 "GET /compute/v2.1/servers/5b41dd2d-cb23-4e57-91fc-1593508dc8cb" status: 200 len: 1342 microversion: 2.1 time: 0.375518 Jul 23 21:13:38.247595 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 47/91] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:13:37 2022] GET /compute/v2.1/servers/5b41dd2d-cb23-4e57-91fc-1593508dc8cb => generated 1342 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:13:38.288195 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-732f1b9e-fe3d-48e1-abab-bb2a46b7221a tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:38.295536 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-732f1b9e-fe3d-48e1-abab-bb2a46b7221a tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] [instance: 1d5a909f-c169-415e-a7b7-41835906e801] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:13:38.456888 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-732f1b9e-fe3d-48e1-abab-bb2a46b7221a tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95896f2064e34e5d82e9531e68aab170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2366e681931c49118c1120350487bde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:13:38.487807 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-732f1b9e-fe3d-48e1-abab-bb2a46b7221a tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] 10.222.0.17 "GET /compute/v2.1/servers/1d5a909f-c169-415e-a7b7-41835906e801" status: 200 len: 1243 microversion: 2.1 time: 0.234524 Jul 23 21:13:38.503160 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 48/92] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:13:38 2022] GET /compute/v2.1/servers/1d5a909f-c169-415e-a7b7-41835906e801 => generated 1243 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:13:38.504347 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-7d5d34f5-9a6c-44ef-83a4-a25a2209b2bd tempest-FlavorsAccessNegativeTestJSON-992011010 tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin] HTTP exception thrown: Flavor access not found for 21 / aefbf9ae46e34052b41a581194a5ebfb combination. Jul 23 21:13:38.508379 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-7d5d34f5-9a6c-44ef-83a4-a25a2209b2bd tempest-FlavorsAccessNegativeTestJSON-992011010 tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin] Request method failure captured: Jul 23 21:13:38.508379 ncdv-master-1 devstack@n-api.service[131321]: request: POST /compute/v2.1/flavors/424365729/action HTTP/1.1 Jul 23 21:13:38.508379 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:13:38.508379 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:13:38.508379 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:13:38.508379 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 70 Jul 23 21:13:38.508379 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:13:38.508379 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:13:38.508379 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:13:38.508379 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:13:38.508379 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GR43ePav1lEHwpfyBf7WCA7TZgTvVv8cm7vx6QxU7CHq4rKCJodVxSJF0TcSvBkkgaNe9gwSKz33j5EKxv1ebFaChvRNn48gaEoQwXRp4HeCAO4q3W6xU3VXWrgrukRdjtQw7-bWwJYmjoCwUL-JtAr4xWEVwnkddvViGQIsEZopC8 Jul 23 21:13:38.508379 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:13:38.508379 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:13:38.508379 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:13:38.508379 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:13:38.508379 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:13:38.508379 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:13:38.508379 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 769afe32bc5d48dd9e24186168aaa3e1 Jul 23 21:13:38.508379 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-992011010 Jul 23 21:13:38.508379 ncdv-master-1 devstack@n-api.service[131321]: X-Role: admin,reader,member Jul 23 21:13:38.508379 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: admin,reader,member Jul 23 21:13:38.509530 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/769afe32bc5d48dd9e24186168aaa3e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/769afe32bc5d48dd9e24186168aaa3e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_769afe32bc5d48dd9e24186168aaa3e1", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/769afe32bc5d48dd9e24186168aaa3e1"}]}] Jul 23 21:13:38.509530 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-992011010 Jul 23 21:13:38.509530 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 769afe32bc5d48dd9e24186168aaa3e1 Jul 23 21:13:38.509530 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-992011010 Jul 23 21:13:38.509530 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin Jul 23 21:13:38.509530 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:13:38.509530 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:13:38.509530 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 2f243774c8494e10b8b1690f2da39b82 Jul 23 21:13:38.509530 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin Jul 23 21:13:38.509530 ncdv-master-1 devstack@n-api.service[131321]: Jul 23 21:13:38.509530 ncdv-master-1 devstack@n-api.service[131321]: {"removeTenantAccess": {"tenant": "aefbf9ae46e34052b41a581194a5ebfb"}} Jul 23 21:13:38.509530 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:13:38.510169 ncdv-master-1 devstack@n-api.service[131321]: exception: Flavor access not found for 21 / aefbf9ae46e34052b41a581194a5ebfb combination. Jul 23 21:13:38.510169 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': '424365729', 'body': {'removeTenantAccess': {'tenant': 'aefbf9ae46e34052b41a581194a5ebfb'}}} Jul 23 21:13:38.510169 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:13:38.510169 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:13:38.510169 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Jul 23 21:13:38.510169 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Jul 23 21:13:38.510169 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 23 21:13:38.510169 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 23 21:13:38.510169 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Jul 23 21:13:38.510169 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Jul 23 21:13:38.510169 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Jul 23 21:13:38.510169 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Jul 23 21:13:38.510169 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Jul 23 21:13:38.510169 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Jul 23 21:13:38.510169 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 23 21:13:38.510169 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 23 21:13:38.510169 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Jul 23 21:13:38.510169 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Jul 23 21:13:38.511111 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 21 / aefbf9ae46e34052b41a581194a5ebfb combination. Jul 23 21:13:38.511111 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:13:38.511111 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:13:38.511111 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:13:38.511111 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:13:38.511111 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:13:38.511111 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:13:38.511111 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:13:38.511111 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:13:38.511111 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:13:38.511111 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:13:38.511111 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:13:38.511111 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:13:38.511111 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Jul 23 21:13:38.511111 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:13:38.511111 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 21 / aefbf9ae46e34052b41a581194a5ebfb combination. Jul 23 21:13:38.511111 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:13:38.511111 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:13:38.511111 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:13:38.511111 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:13:38.512120 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:13:38.512120 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:13:38.512120 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:13:38.512120 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:13:38.512120 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 21 / aefbf9ae46e34052b41a581194a5ebfb combination. Jul 23 21:13:38.512120 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:13:38.517635 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-7d5d34f5-9a6c-44ef-83a4-a25a2209b2bd tempest-FlavorsAccessNegativeTestJSON-992011010 tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin] Returning 404 to user: Flavor access not found for 21 / aefbf9ae46e34052b41a581194a5ebfb combination. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:13:38.519152 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-7d5d34f5-9a6c-44ef-83a4-a25a2209b2bd tempest-FlavorsAccessNegativeTestJSON-992011010 tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors/424365729/action" status: 404 len: 124 microversion: 2.1 time: 1.597996 Jul 23 21:13:38.521286 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 45/93] 10.222.0.17 () {60 vars in 1196 bytes} [Sat Jul 23 21:13:36 2022] POST /compute/v2.1/flavors/424365729/action => generated 124 bytes in 1601 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:13:38.530298 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-be7e0e57-6e78-4072-b519-6fc66bae7981 tempest-FlavorsAccessNegativeTestJSON-992011010 tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:38.531316 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:38.531316 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:13:38.563388 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:DELETE=15,nova_api:SELECT=80,nova_api:INSERT=5 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:38.610902 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-be7e0e57-6e78-4072-b519-6fc66bae7981 tempest-FlavorsAccessNegativeTestJSON-992011010 tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/424365729" status: 202 len: 0 microversion: 2.1 time: 0.083728 Jul 23 21:13:38.611629 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 49/94] 10.222.0.17 () {58 vars in 1157 bytes} [Sat Jul 23 21:13:38 2022] DELETE /compute/v2.1/flavors/424365729 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:13:38.624458 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-16299a0d-df26-4a12-af31-fdc7f6f0f1f3 tempest-FlavorsAccessNegativeTestJSON-992011010 tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:38.695317 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-16299a0d-df26-4a12-af31-fdc7f6f0f1f3 tempest-FlavorsAccessNegativeTestJSON-992011010 tempest-FlavorsAccessNegativeTestJSON-992011010-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.050508 Jul 23 21:13:38.697824 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 46/95] 10.222.0.17 () {58 vars in 1145 bytes} [Sat Jul 23 21:13:38 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:13:39.264047 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-b964e50d-d906-4d32-be78-dfcc0b2337c7 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:39.264844 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-b964e50d-d906-4d32-be78-dfcc0b2337c7 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] [instance: 5b41dd2d-cb23-4e57-91fc-1593508dc8cb] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:13:39.268190 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_api:SELECT=78,nova_api:DELETE=11,nova_api:INSERT=11 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:39.272403 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b964e50d-d906-4d32-be78-dfcc0b2337c7 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:39.273201 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b964e50d-d906-4d32-be78-dfcc0b2337c7 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:39.274378 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b964e50d-d906-4d32-be78-dfcc0b2337c7 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:39.275026 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b964e50d-d906-4d32-be78-dfcc0b2337c7 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:39.426065 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-481359af-2622-414d-94b1-e083d6b8de2b req-7ea0a387-a9c6-4544-bae4-7fc0021c7711 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b41dd2d-cb23-4e57-91fc-1593508dc8cb", "tag": "05cc0f3e-8617-4864-a70b-b1981f569521"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:13:39.450828 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-481359af-2622-414d-94b1-e083d6b8de2b req-7ea0a387-a9c6-4544-bae4-7fc0021c7711 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:39.452135 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-481359af-2622-414d-94b1-e083d6b8de2b req-7ea0a387-a9c6-4544-bae4-7fc0021c7711 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:39.506300 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-481359af-2622-414d-94b1-e083d6b8de2b req-7ea0a387-a9c6-4544-bae4-7fc0021c7711 service nova] Creating event network-changed:05cc0f3e-8617-4864-a70b-b1981f569521 for instance 5b41dd2d-cb23-4e57-91fc-1593508dc8cb on nch2-master-1 Jul 23 21:13:39.510160 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-481359af-2622-414d-94b1-e083d6b8de2b req-7ea0a387-a9c6-4544-bae4-7fc0021c7711 service nova] Acquired lock "compute-rpcapi-router" {{(pid=131320) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 23 21:13:39.511677 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-865d6202-787a-4053-b2ff-6a60111637d9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:39.512133 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-865d6202-787a-4053-b2ff-6a60111637d9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:39.512940 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-865d6202-787a-4053-b2ff-6a60111637d9 None None] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:39.513381 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-865d6202-787a-4053-b2ff-6a60111637d9 None None] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:39.536256 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.compute.rpcapi [None req-865d6202-787a-4053-b2ff-6a60111637d9 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 23 21:13:39.539568 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-865d6202-787a-4053-b2ff-6a60111637d9 None None] Releasing lock "compute-rpcapi-router" {{(pid=131320) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 23 21:13:39.573976 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-865d6202-787a-4053-b2ff-6a60111637d9 None None] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.747259 Jul 23 21:13:39.574669 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 50/96] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:13:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:13:39.583123 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6a28be99-8131-41eb-a24a-10b8d83da65b tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:39.584173 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6a28be99-8131-41eb-a24a-10b8d83da65b tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] [instance: 1d5a909f-c169-415e-a7b7-41835906e801] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:13:39.595394 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6a28be99-8131-41eb-a24a-10b8d83da65b tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:39.596266 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6a28be99-8131-41eb-a24a-10b8d83da65b tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:39.598359 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6a28be99-8131-41eb-a24a-10b8d83da65b tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:39.599206 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6a28be99-8131-41eb-a24a-10b8d83da65b tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:39.620243 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-b964e50d-d906-4d32-be78-dfcc0b2337c7 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199522d29cb746379cb6f75d4b108cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07101aee06ca4bb6885f87cfec3257db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:13:39.638226 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-b964e50d-d906-4d32-be78-dfcc0b2337c7 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] 10.222.0.17 "GET /compute/v2.1/servers/5b41dd2d-cb23-4e57-91fc-1593508dc8cb" status: 200 len: 1342 microversion: 2.1 time: 0.377142 Jul 23 21:13:39.650205 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 47/97] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:13:39 2022] GET /compute/v2.1/servers/5b41dd2d-cb23-4e57-91fc-1593508dc8cb => generated 1342 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:13:39.993561 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6a28be99-8131-41eb-a24a-10b8d83da65b tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95896f2064e34e5d82e9531e68aab170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2366e681931c49118c1120350487bde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:13:40.007836 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6a28be99-8131-41eb-a24a-10b8d83da65b tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] 10.222.0.17 "GET /compute/v2.1/servers/1d5a909f-c169-415e-a7b7-41835906e801" status: 200 len: 1235 microversion: 2.1 time: 0.430842 Jul 23 21:13:40.019360 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 51/98] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:13:39 2022] GET /compute/v2.1/servers/1d5a909f-c169-415e-a7b7-41835906e801 => generated 1235 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:13:40.505901 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f2a9e430-9cca-416d-a8ce-aac4091f090e tempest-HostsAdminTestJSON-859142898 tempest-HostsAdminTestJSON-859142898-project-admin] Calling method '.version_select at 0x7f0b54ae5ee0>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:40.508246 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:40.508246 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:13:40.509766 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f2a9e430-9cca-416d-a8ce-aac4091f090e tempest-HostsAdminTestJSON-859142898 tempest-HostsAdminTestJSON-859142898-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:40.510490 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f2a9e430-9cca-416d-a8ce-aac4091f090e tempest-HostsAdminTestJSON-859142898 tempest-HostsAdminTestJSON-859142898-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:40.513468 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f2a9e430-9cca-416d-a8ce-aac4091f090e tempest-HostsAdminTestJSON-859142898 tempest-HostsAdminTestJSON-859142898-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:40.515451 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f2a9e430-9cca-416d-a8ce-aac4091f090e tempest-HostsAdminTestJSON-859142898 tempest-HostsAdminTestJSON-859142898-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:40.562745 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-f2a9e430-9cca-416d-a8ce-aac4091f090e tempest-HostsAdminTestJSON-859142898 tempest-HostsAdminTestJSON-859142898-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hosts" status: 200 len: 401 microversion: 2.1 time: 0.404293 Jul 23 21:13:40.565140 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 48/99] 10.222.0.17 () {58 vars in 1127 bytes} [Sat Jul 23 21:13:40 2022] GET /compute/v2.1/os-hosts => generated 401 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:13:40.586857 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-9f9b5a47-f06e-42e1-9f4e-8040eab5466d tempest-HostsAdminTestJSON-859142898 tempest-HostsAdminTestJSON-859142898-project-admin] Calling method '.version_select at 0x7f0b54c0baf0>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:40.588775 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:40.588775 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:13:40.590551 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9f9b5a47-f06e-42e1-9f4e-8040eab5466d tempest-HostsAdminTestJSON-859142898 tempest-HostsAdminTestJSON-859142898-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:40.591255 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9f9b5a47-f06e-42e1-9f4e-8040eab5466d tempest-HostsAdminTestJSON-859142898 tempest-HostsAdminTestJSON-859142898-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:40.592321 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9f9b5a47-f06e-42e1-9f4e-8040eab5466d tempest-HostsAdminTestJSON-859142898 tempest-HostsAdminTestJSON-859142898-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:40.592948 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9f9b5a47-f06e-42e1-9f4e-8040eab5466d tempest-HostsAdminTestJSON-859142898 tempest-HostsAdminTestJSON-859142898-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:40.631611 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-9f9b5a47-f06e-42e1-9f4e-8040eab5466d tempest-HostsAdminTestJSON-859142898 tempest-HostsAdminTestJSON-859142898-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 401 microversion: 2.1 time: 0.058445 Jul 23 21:13:40.633615 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 49/100] 10.222.0.17 () {58 vars in 1138 bytes} [Sat Jul 23 21:13:40 2022] GET /compute/v2.1/os-hosts?zone= => generated 401 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:13:40.673474 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-415b62bd-411b-46e7-8f94-e64d26bc903c tempest-HostsAdminTestJSON-859142898 tempest-HostsAdminTestJSON-859142898-project-admin] Calling method '.version_select at 0x7f0b54b10280>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:40.677381 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:40.677381 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:13:40.678790 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-415b62bd-411b-46e7-8f94-e64d26bc903c tempest-HostsAdminTestJSON-859142898 tempest-HostsAdminTestJSON-859142898-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:40.679242 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-415b62bd-411b-46e7-8f94-e64d26bc903c tempest-HostsAdminTestJSON-859142898 tempest-HostsAdminTestJSON-859142898-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:40.680228 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-415b62bd-411b-46e7-8f94-e64d26bc903c tempest-HostsAdminTestJSON-859142898 tempest-HostsAdminTestJSON-859142898-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:40.680847 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-415b62bd-411b-46e7-8f94-e64d26bc903c tempest-HostsAdminTestJSON-859142898 tempest-HostsAdminTestJSON-859142898-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:40.726702 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-415b62bd-411b-46e7-8f94-e64d26bc903c tempest-HostsAdminTestJSON-859142898 tempest-HostsAdminTestJSON-859142898-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.069382 Jul 23 21:13:40.727594 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 50/101] 10.222.0.17 () {58 vars in 1144 bytes} [Sat Jul 23 21:13:40 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 23 21:13:40.735065 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-26508fe1-078f-4bf9-abb1-43597b67a646 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:40.735780 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-26508fe1-078f-4bf9-abb1-43597b67a646 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] [instance: 5b41dd2d-cb23-4e57-91fc-1593508dc8cb] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:13:40.745886 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-26508fe1-078f-4bf9-abb1-43597b67a646 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:40.746811 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-26508fe1-078f-4bf9-abb1-43597b67a646 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:40.748302 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-26508fe1-078f-4bf9-abb1-43597b67a646 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:40.748977 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-26508fe1-078f-4bf9-abb1-43597b67a646 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:40.858155 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4249b189-9cbb-4e80-8658-5e1ee9929367 tempest-HypervisorAdminV228Test-846406531 tempest-HypervisorAdminV228Test-846406531-project-admin] Calling method '.version_select at 0x7f0b54afe1f0>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:40.859070 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:40.859070 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:13:40.860511 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4249b189-9cbb-4e80-8658-5e1ee9929367 tempest-HypervisorAdminV228Test-846406531 tempest-HypervisorAdminV228Test-846406531-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:40.860963 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4249b189-9cbb-4e80-8658-5e1ee9929367 tempest-HypervisorAdminV228Test-846406531 tempest-HypervisorAdminV228Test-846406531-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:40.881531 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4249b189-9cbb-4e80-8658-5e1ee9929367 tempest-HypervisorAdminV228Test-846406531 tempest-HypervisorAdminV228Test-846406531-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:40.882791 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4249b189-9cbb-4e80-8658-5e1ee9929367 tempest-HypervisorAdminV228Test-846406531 tempest-HypervisorAdminV228Test-846406531-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:40.902032 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4249b189-9cbb-4e80-8658-5e1ee9929367 tempest-HypervisorAdminV228Test-846406531 tempest-HypervisorAdminV228Test-846406531-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:40.903197 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4249b189-9cbb-4e80-8658-5e1ee9929367 tempest-HypervisorAdminV228Test-846406531 tempest-HypervisorAdminV228Test-846406531-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:40.911325 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4249b189-9cbb-4e80-8658-5e1ee9929367 tempest-HypervisorAdminV228Test-846406531 tempest-HypervisorAdminV228Test-846406531-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.440518 Jul 23 21:13:40.919342 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 52/102] 10.222.0.17 () {60 vars in 1186 bytes} [Sat Jul 23 21:13:40 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 23 21:13:40.932480 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f67f7232-aecd-42a6-a470-49e201f53809 tempest-HypervisorAdminV228Test-846406531 tempest-HypervisorAdminV228Test-846406531-project-admin] Calling method '.version_select at 0x7f0b54afe820>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:40.933042 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:40.933042 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:13:40.941657 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f67f7232-aecd-42a6-a470-49e201f53809 tempest-HypervisorAdminV228Test-846406531 tempest-HypervisorAdminV228Test-846406531-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:40.942425 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f67f7232-aecd-42a6-a470-49e201f53809 tempest-HypervisorAdminV228Test-846406531 tempest-HypervisorAdminV228Test-846406531-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:40.963104 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f67f7232-aecd-42a6-a470-49e201f53809 tempest-HypervisorAdminV228Test-846406531 tempest-HypervisorAdminV228Test-846406531-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:40.963972 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f67f7232-aecd-42a6-a470-49e201f53809 tempest-HypervisorAdminV228Test-846406531 tempest-HypervisorAdminV228Test-846406531-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:40.976314 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f67f7232-aecd-42a6-a470-49e201f53809 tempest-HypervisorAdminV228Test-846406531 tempest-HypervisorAdminV228Test-846406531-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.048913 Jul 23 21:13:40.986805 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 53/103] 10.222.0.17 () {60 vars in 1192 bytes} [Sat Jul 23 21:13:40 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 23 21:13:41.006932 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-26508fe1-078f-4bf9-abb1-43597b67a646 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199522d29cb746379cb6f75d4b108cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07101aee06ca4bb6885f87cfec3257db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:13:41.015542 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-26508fe1-078f-4bf9-abb1-43597b67a646 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] 10.222.0.17 "GET /compute/v2.1/servers/5b41dd2d-cb23-4e57-91fc-1593508dc8cb" status: 200 len: 1342 microversion: 2.1 time: 0.284527 Jul 23 21:13:41.025201 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 51/104] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:13:40 2022] GET /compute/v2.1/servers/5b41dd2d-cb23-4e57-91fc-1593508dc8cb => generated 1342 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:13:41.041187 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e139b5c3-8d00-4959-9f2a-89640384a2d8 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:41.042105 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e139b5c3-8d00-4959-9f2a-89640384a2d8 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] [instance: 1d5a909f-c169-415e-a7b7-41835906e801] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:13:41.052927 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e139b5c3-8d00-4959-9f2a-89640384a2d8 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:41.053387 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e139b5c3-8d00-4959-9f2a-89640384a2d8 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:41.054213 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e139b5c3-8d00-4959-9f2a-89640384a2d8 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:41.054654 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e139b5c3-8d00-4959-9f2a-89640384a2d8 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:41.260437 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e139b5c3-8d00-4959-9f2a-89640384a2d8 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95896f2064e34e5d82e9531e68aab170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2366e681931c49118c1120350487bde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:13:41.275815 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e139b5c3-8d00-4959-9f2a-89640384a2d8 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] 10.222.0.17 "GET /compute/v2.1/servers/1d5a909f-c169-415e-a7b7-41835906e801" status: 200 len: 1235 microversion: 2.1 time: 0.237242 Jul 23 21:13:41.279231 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 54/105] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:13:41 2022] GET /compute/v2.1/servers/1d5a909f-c169-415e-a7b7-41835906e801 => generated 1235 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:13:42.044221 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-abb23854-fd66-4bbc-b39f-0e1ac8fc1175 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:42.044959 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-abb23854-fd66-4bbc-b39f-0e1ac8fc1175 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] [instance: 5b41dd2d-cb23-4e57-91fc-1593508dc8cb] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:13:42.058074 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-1f66e3bb-39e3-4627-9a74-feb92f5c35ad tempest-InstanceUsageAuditLogNegativeTestJSON-1305023607 tempest-InstanceUsageAuditLogNegativeTestJSON-1305023607-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:42.058974 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:42.058974 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:13:42.063183 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-1f66e3bb-39e3-4627-9a74-feb92f5c35ad tempest-InstanceUsageAuditLogNegativeTestJSON-1305023607 tempest-InstanceUsageAuditLogNegativeTestJSON-1305023607-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Jul 23 21:13:42.070606 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-abb23854-fd66-4bbc-b39f-0e1ac8fc1175 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:42.072575 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-abb23854-fd66-4bbc-b39f-0e1ac8fc1175 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:42.073406 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-abb23854-fd66-4bbc-b39f-0e1ac8fc1175 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:42.074990 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-abb23854-fd66-4bbc-b39f-0e1ac8fc1175 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:42.088181 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-1f66e3bb-39e3-4627-9a74-feb92f5c35ad tempest-InstanceUsageAuditLogNegativeTestJSON-1305023607 tempest-InstanceUsageAuditLogNegativeTestJSON-1305023607-project-admin] Request method failure captured: Jul 23 21:13:42.088181 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Jul 23 21:13:42.088181 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:13:42.088181 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:13:42.088181 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:13:42.088181 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:13:42.088181 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:13:42.088181 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:13:42.088181 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:13:42.088181 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:13:42.088181 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GSF3TFexTxxdQHYTDt-caJjcJpNuOjkTLbL67dxBpG9zoU0vVvmFK8eNBs8ktXjmbEdpE5WDiWkQqrSFa_vfCawvKgCcJh1X3sNnTiw-jcT2VfMDQ2sYgSIDp2SrVbkPMz1CB_0D3BJV8KPB9LMU67eCn-5qMgT59wli2vUtyov314 Jul 23 21:13:42.088181 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:13:42.088181 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:13:42.088181 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:13:42.088181 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:13:42.088181 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:13:42.088181 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:13:42.088181 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 32b46be372824ec49b0ef96868e02437 Jul 23 21:13:42.088181 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1305023607 Jul 23 21:13:42.088181 ncdv-master-1 devstack@n-api.service[131321]: X-Role: admin,reader,member Jul 23 21:13:42.088181 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: admin,reader,member Jul 23 21:13:42.089284 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/32b46be372824ec49b0ef96868e02437"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/32b46be372824ec49b0ef96868e02437"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_32b46be372824ec49b0ef96868e02437", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/32b46be372824ec49b0ef96868e02437"}]}] Jul 23 21:13:42.089284 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1305023607 Jul 23 21:13:42.089284 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 32b46be372824ec49b0ef96868e02437 Jul 23 21:13:42.089284 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1305023607 Jul 23 21:13:42.089284 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1305023607-project-admin Jul 23 21:13:42.089284 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:13:42.089284 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:13:42.089284 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: f35d04ec736e4ebe99685b340f399b96 Jul 23 21:13:42.089284 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1305023607-project-admin Jul 23 21:13:42.089284 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:13:42.089284 ncdv-master-1 devstack@n-api.service[131321]: exception: Invalid timestamp for date invalid_time Jul 23 21:13:42.089973 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': 'invalid_time'} Jul 23 21:13:42.089973 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:13:42.089973 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:13:42.089973 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Jul 23 21:13:42.089973 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Jul 23 21:13:42.089973 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Jul 23 21:13:42.089973 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Jul 23 21:13:42.089973 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Jul 23 21:13:42.089973 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Jul 23 21:13:42.089973 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Jul 23 21:13:42.089973 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:13:42.089973 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:13:42.089973 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:13:42.089973 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:13:42.089973 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:13:42.089973 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:13:42.089973 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:13:42.089973 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:13:42.089973 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:13:42.089973 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:13:42.091039 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Jul 23 21:13:42.091039 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Jul 23 21:13:42.091039 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Jul 23 21:13:42.091039 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:13:42.091039 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:13:42.091039 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:13:42.091039 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:13:42.091039 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:13:42.091039 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:13:42.091039 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:13:42.091039 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:13:42.091039 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Jul 23 21:13:42.091039 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:13:42.091039 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-1f66e3bb-39e3-4627-9a74-feb92f5c35ad tempest-InstanceUsageAuditLogNegativeTestJSON-1305023607 tempest-InstanceUsageAuditLogNegativeTestJSON-1305023607-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:13:42.091039 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-1f66e3bb-39e3-4627-9a74-feb92f5c35ad tempest-InstanceUsageAuditLogNegativeTestJSON-1305023607 tempest-InstanceUsageAuditLogNegativeTestJSON-1305023607-project-admin] 10.222.0.17 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.381701 Jul 23 21:13:42.094013 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 52/106] 10.222.0.17 () {58 vars in 1223 bytes} [Sat Jul 23 21:13:41 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 385 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 23 21:13:42.310940 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-abb23854-fd66-4bbc-b39f-0e1ac8fc1175 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199522d29cb746379cb6f75d4b108cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07101aee06ca4bb6885f87cfec3257db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:13:42.322942 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-abb23854-fd66-4bbc-b39f-0e1ac8fc1175 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] 10.222.0.17 "GET /compute/v2.1/servers/5b41dd2d-cb23-4e57-91fc-1593508dc8cb" status: 200 len: 1342 microversion: 2.1 time: 0.290015 Jul 23 21:13:42.324223 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 55/107] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:13:42 2022] GET /compute/v2.1/servers/5b41dd2d-cb23-4e57-91fc-1593508dc8cb => generated 1342 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:13:42.329357 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c86ca0ad-9dc5-4a99-bf0a-1b05301385d5 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:42.330238 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c86ca0ad-9dc5-4a99-bf0a-1b05301385d5 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] [instance: 1d5a909f-c169-415e-a7b7-41835906e801] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:13:42.337225 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c86ca0ad-9dc5-4a99-bf0a-1b05301385d5 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:42.338077 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c86ca0ad-9dc5-4a99-bf0a-1b05301385d5 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:42.339065 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c86ca0ad-9dc5-4a99-bf0a-1b05301385d5 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:42.339672 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c86ca0ad-9dc5-4a99-bf0a-1b05301385d5 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:42.445325 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c86ca0ad-9dc5-4a99-bf0a-1b05301385d5 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95896f2064e34e5d82e9531e68aab170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2366e681931c49118c1120350487bde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:13:42.454984 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c86ca0ad-9dc5-4a99-bf0a-1b05301385d5 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] 10.222.0.17 "GET /compute/v2.1/servers/1d5a909f-c169-415e-a7b7-41835906e801" status: 200 len: 1235 microversion: 2.1 time: 0.129443 Jul 23 21:13:42.461025 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 56/108] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:13:42 2022] GET /compute/v2.1/servers/1d5a909f-c169-415e-a7b7-41835906e801 => generated 1235 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:13:42.573300 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ebdc06a1-1e34-4bd3-8e39-1cdf2a694aba tempest-InstanceUsageAuditLogNegativeTestJSON-1511133713 tempest-InstanceUsageAuditLogNegativeTestJSON-1511133713-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:42.574990 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:42.574990 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:13:42.578119 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ebdc06a1-1e34-4bd3-8e39-1cdf2a694aba tempest-InstanceUsageAuditLogNegativeTestJSON-1511133713 tempest-InstanceUsageAuditLogNegativeTestJSON-1511133713-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': 'f6cda6d061484b8aba7fc3ace8a49533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915bc70310864741842ac671ead5fd4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:13:42.590553 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ebdc06a1-1e34-4bd3-8e39-1cdf2a694aba tempest-InstanceUsageAuditLogNegativeTestJSON-1511133713 tempest-InstanceUsageAuditLogNegativeTestJSON-1511133713-project] Request method failure captured: Jul 23 21:13:42.590553 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Jul 23 21:13:42.590553 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:13:42.590553 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:13:42.590553 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:13:42.590553 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:13:42.590553 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:13:42.590553 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:13:42.590553 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:13:42.590553 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:13:42.590553 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GSDl6oP0u6Mr0Y8evrbH_vFHh8ooTTPRWD9st6EhA7mTgpnmys3jG5nQqD_hmyoZtM47MbppDta6WyTYB-sU082A_rnhfoJSiHFhMT6aMuoQqAZ5VeNONBoHSspqYfqu2_US8MAQkCnAG1zWUsheL9pF824e8zkERjcIfBEq-ELDb0 Jul 23 21:13:42.590553 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:13:42.590553 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:13:42.590553 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:13:42.590553 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:13:42.590553 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:13:42.590553 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:13:42.590553 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 915bc70310864741842ac671ead5fd4a Jul 23 21:13:42.590553 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1511133713 Jul 23 21:13:42.590553 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:13:42.590553 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:13:42.592046 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/915bc70310864741842ac671ead5fd4a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/915bc70310864741842ac671ead5fd4a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_915bc70310864741842ac671ead5fd4a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/915bc70310864741842ac671ead5fd4a"}]}] Jul 23 21:13:42.592046 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1511133713 Jul 23 21:13:42.592046 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 915bc70310864741842ac671ead5fd4a Jul 23 21:13:42.592046 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1511133713 Jul 23 21:13:42.592046 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1511133713-project Jul 23 21:13:42.592046 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:13:42.592046 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:13:42.592046 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: f6cda6d061484b8aba7fc3ace8a49533 Jul 23 21:13:42.592046 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1511133713-project Jul 23 21:13:42.592046 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:13:42.592046 ncdv-master-1 devstack@n-api.service[131321]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jul 23 21:13:42.592763 ncdv-master-1 devstack@n-api.service[131321]: action_args: {} Jul 23 21:13:42.592763 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:13:42.592763 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:13:42.592763 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:13:42.592763 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:13:42.592763 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:13:42.592763 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:13:42.592763 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:13:42.592763 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:13:42.592763 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Jul 23 21:13:42.592763 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Jul 23 21:13:42.592763 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 23 21:13:42.592763 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 23 21:13:42.592763 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 23 21:13:42.592763 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 23 21:13:42.592763 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 23 21:13:42.592763 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 23 21:13:42.592763 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 23 21:13:42.592763 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise self.value Jul 23 21:13:42.592763 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 23 21:13:42.594225 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 23 21:13:42.594225 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 23 21:13:42.594225 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 23 21:13:42.594225 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 23 21:13:42.594225 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 23 21:13:42.594225 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jul 23 21:13:42.594225 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:13:42.594225 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:13:42.594225 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:13:42.594225 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:13:42.594225 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:13:42.594225 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:13:42.594225 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 23 21:13:42.594225 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 23 21:13:42.594225 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jul 23 21:13:42.594225 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:13:42.598307 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ebdc06a1-1e34-4bd3-8e39-1cdf2a694aba tempest-InstanceUsageAuditLogNegativeTestJSON-1511133713 tempest-InstanceUsageAuditLogNegativeTestJSON-1511133713-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:13:42.599587 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-ebdc06a1-1e34-4bd3-8e39-1cdf2a694aba tempest-InstanceUsageAuditLogNegativeTestJSON-1511133713 tempest-InstanceUsageAuditLogNegativeTestJSON-1511133713-project] 10.222.0.17 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.498758 Jul 23 21:13:42.600355 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 53/109] 10.222.0.17 () {58 vars in 1184 bytes} [Sat Jul 23 21:13:42 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 500 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:13:42.610405 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5d152a2f-265d-4e45-b6cf-a43dbfc50709 tempest-InstanceUsageAuditLogNegativeTestJSON-1511133713 tempest-InstanceUsageAuditLogNegativeTestJSON-1511133713-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:42.611349 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:42.611349 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:13:42.612700 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5d152a2f-265d-4e45-b6cf-a43dbfc50709 tempest-InstanceUsageAuditLogNegativeTestJSON-1511133713 tempest-InstanceUsageAuditLogNegativeTestJSON-1511133713-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': 'f6cda6d061484b8aba7fc3ace8a49533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915bc70310864741842ac671ead5fd4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:13:42.627658 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5d152a2f-265d-4e45-b6cf-a43dbfc50709 tempest-InstanceUsageAuditLogNegativeTestJSON-1511133713 tempest-InstanceUsageAuditLogNegativeTestJSON-1511133713-project] Request method failure captured: Jul 23 21:13:42.627658 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-07-23%2021:13:42 HTTP/1.1 Jul 23 21:13:42.627658 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:13:42.627658 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:13:42.627658 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:13:42.627658 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:13:42.627658 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:13:42.627658 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:13:42.627658 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:13:42.627658 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:13:42.627658 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GSDl6oP0u6Mr0Y8evrbH_vFHh8ooTTPRWD9st6EhA7mTgpnmys3jG5nQqD_hmyoZtM47MbppDta6WyTYB-sU082A_rnhfoJSiHFhMT6aMuoQqAZ5VeNONBoHSspqYfqu2_US8MAQkCnAG1zWUsheL9pF824e8zkERjcIfBEq-ELDb0 Jul 23 21:13:42.627658 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:13:42.627658 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:13:42.627658 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:13:42.627658 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:13:42.627658 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:13:42.627658 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:13:42.627658 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 915bc70310864741842ac671ead5fd4a Jul 23 21:13:42.627658 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1511133713 Jul 23 21:13:42.627658 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:13:42.627658 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:13:42.629988 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/915bc70310864741842ac671ead5fd4a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/915bc70310864741842ac671ead5fd4a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_915bc70310864741842ac671ead5fd4a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/915bc70310864741842ac671ead5fd4a"}]}] Jul 23 21:13:42.629988 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1511133713 Jul 23 21:13:42.629988 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 915bc70310864741842ac671ead5fd4a Jul 23 21:13:42.629988 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1511133713 Jul 23 21:13:42.629988 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1511133713-project Jul 23 21:13:42.629988 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:13:42.629988 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:13:42.629988 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: f6cda6d061484b8aba7fc3ace8a49533 Jul 23 21:13:42.629988 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1511133713-project Jul 23 21:13:42.629988 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:13:42.629988 ncdv-master-1 devstack@n-api.service[131320]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jul 23 21:13:42.631036 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '2022-07-23 21:13:42'} Jul 23 21:13:42.631036 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:13:42.631036 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:13:42.631036 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:13:42.631036 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:13:42.631036 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:13:42.631036 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:13:42.631036 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:13:42.631036 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:13:42.631036 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Jul 23 21:13:42.631036 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Jul 23 21:13:42.631036 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 23 21:13:42.631036 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 23 21:13:42.631036 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 23 21:13:42.631036 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 23 21:13:42.631036 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 23 21:13:42.631036 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 23 21:13:42.631036 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 23 21:13:42.631036 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise self.value Jul 23 21:13:42.631036 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 23 21:13:42.632339 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 23 21:13:42.632339 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 23 21:13:42.632339 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 23 21:13:42.632339 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 23 21:13:42.632339 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 23 21:13:42.632339 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jul 23 21:13:42.632339 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:13:42.632339 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:13:42.632339 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:13:42.632339 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:13:42.632339 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:13:42.632339 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:13:42.632339 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 23 21:13:42.632339 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 23 21:13:42.632339 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jul 23 21:13:42.632339 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:13:42.634274 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5d152a2f-265d-4e45-b6cf-a43dbfc50709 tempest-InstanceUsageAuditLogNegativeTestJSON-1511133713 tempest-InstanceUsageAuditLogNegativeTestJSON-1511133713-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:13:42.635244 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5d152a2f-265d-4e45-b6cf-a43dbfc50709 tempest-InstanceUsageAuditLogNegativeTestJSON-1511133713 tempest-InstanceUsageAuditLogNegativeTestJSON-1511133713-project] 10.222.0.17 "GET /compute/v2.1/os-instance_usage_audit_log/2022-07-23 21:13:42" status: 403 len: 128 microversion: 2.1 time: 0.029216 Jul 23 21:13:42.636234 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 57/110] 10.222.0.17 () {58 vars in 1250 bytes} [Sat Jul 23 21:13:42 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-07-23%2021%3A13%3A42 => generated 128 bytes in 31 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:13:43.343299 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-b3c6139d-ea3a-4735-8493-fc0a998d2eb7 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:43.346408 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-b3c6139d-ea3a-4735-8493-fc0a998d2eb7 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] [instance: 5b41dd2d-cb23-4e57-91fc-1593508dc8cb] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:13:43.363020 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b3c6139d-ea3a-4735-8493-fc0a998d2eb7 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:43.364718 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b3c6139d-ea3a-4735-8493-fc0a998d2eb7 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:43.365665 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b3c6139d-ea3a-4735-8493-fc0a998d2eb7 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:43.366183 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b3c6139d-ea3a-4735-8493-fc0a998d2eb7 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:43.478959 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c51f5690-33a3-46ac-a8c7-063f446669dd tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:43.480357 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c51f5690-33a3-46ac-a8c7-063f446669dd tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] [instance: 1d5a909f-c169-415e-a7b7-41835906e801] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:13:43.490434 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c51f5690-33a3-46ac-a8c7-063f446669dd tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:43.491303 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c51f5690-33a3-46ac-a8c7-063f446669dd tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:43.492295 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c51f5690-33a3-46ac-a8c7-063f446669dd tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:43.492876 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c51f5690-33a3-46ac-a8c7-063f446669dd tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:43.539328 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-b3c6139d-ea3a-4735-8493-fc0a998d2eb7 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199522d29cb746379cb6f75d4b108cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07101aee06ca4bb6885f87cfec3257db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:13:43.547474 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-b3c6139d-ea3a-4735-8493-fc0a998d2eb7 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] 10.222.0.17 "GET /compute/v2.1/servers/5b41dd2d-cb23-4e57-91fc-1593508dc8cb" status: 200 len: 1342 microversion: 2.1 time: 0.209472 Jul 23 21:13:43.548786 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 54/111] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:13:43 2022] GET /compute/v2.1/servers/5b41dd2d-cb23-4e57-91fc-1593508dc8cb => generated 1342 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:13:43.593628 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c51f5690-33a3-46ac-a8c7-063f446669dd tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95896f2064e34e5d82e9531e68aab170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2366e681931c49118c1120350487bde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:13:43.606103 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c51f5690-33a3-46ac-a8c7-063f446669dd tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] 10.222.0.17 "GET /compute/v2.1/servers/1d5a909f-c169-415e-a7b7-41835906e801" status: 200 len: 1235 microversion: 2.1 time: 0.131416 Jul 23 21:13:43.607232 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 58/112] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:13:43 2022] GET /compute/v2.1/servers/1d5a909f-c169-415e-a7b7-41835906e801 => generated 1235 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:13:44.570790 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-0e9e78be-c7d2-4021-81f4-04dbb3a726df tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:44.571590 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-0e9e78be-c7d2-4021-81f4-04dbb3a726df tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] [instance: 5b41dd2d-cb23-4e57-91fc-1593508dc8cb] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:13:44.585521 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0e9e78be-c7d2-4021-81f4-04dbb3a726df tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:44.588064 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0e9e78be-c7d2-4021-81f4-04dbb3a726df tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:44.593263 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0e9e78be-c7d2-4021-81f4-04dbb3a726df tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:44.593933 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0e9e78be-c7d2-4021-81f4-04dbb3a726df tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:44.624306 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6edbca7c-291e-4b5a-9a7c-f7ec6284a144 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:44.624937 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6edbca7c-291e-4b5a-9a7c-f7ec6284a144 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] [instance: 1d5a909f-c169-415e-a7b7-41835906e801] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:13:44.636767 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6edbca7c-291e-4b5a-9a7c-f7ec6284a144 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:44.637298 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6edbca7c-291e-4b5a-9a7c-f7ec6284a144 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:44.642128 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6edbca7c-291e-4b5a-9a7c-f7ec6284a144 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:44.642588 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6edbca7c-291e-4b5a-9a7c-f7ec6284a144 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:44.724474 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6edbca7c-291e-4b5a-9a7c-f7ec6284a144 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95896f2064e34e5d82e9531e68aab170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2366e681931c49118c1120350487bde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:13:44.732836 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6edbca7c-291e-4b5a-9a7c-f7ec6284a144 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] 10.222.0.17 "GET /compute/v2.1/servers/1d5a909f-c169-415e-a7b7-41835906e801" status: 200 len: 1299 microversion: 2.1 time: 0.112756 Jul 23 21:13:44.733983 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 59/113] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:13:44 2022] GET /compute/v2.1/servers/1d5a909f-c169-415e-a7b7-41835906e801 => generated 1299 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:13:44.825246 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-0e9e78be-c7d2-4021-81f4-04dbb3a726df tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199522d29cb746379cb6f75d4b108cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07101aee06ca4bb6885f87cfec3257db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:13:44.834930 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-0e9e78be-c7d2-4021-81f4-04dbb3a726df tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] 10.222.0.17 "GET /compute/v2.1/servers/5b41dd2d-cb23-4e57-91fc-1593508dc8cb" status: 200 len: 1342 microversion: 2.1 time: 0.270692 Jul 23 21:13:44.846172 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 55/114] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:13:44 2022] GET /compute/v2.1/servers/5b41dd2d-cb23-4e57-91fc-1593508dc8cb => generated 1342 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:13:45.751467 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-de8b2d64-2611-4f0a-b9c1-8e7f872c38c4 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:45.752320 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-de8b2d64-2611-4f0a-b9c1-8e7f872c38c4 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] [instance: 1d5a909f-c169-415e-a7b7-41835906e801] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:13:45.764288 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-de8b2d64-2611-4f0a-b9c1-8e7f872c38c4 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:45.764926 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-de8b2d64-2611-4f0a-b9c1-8e7f872c38c4 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:45.765831 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-de8b2d64-2611-4f0a-b9c1-8e7f872c38c4 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:45.767352 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-de8b2d64-2611-4f0a-b9c1-8e7f872c38c4 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:45.852617 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-9cb801f2-cc57-4f2b-a2b3-9a4af32350b2 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:45.853815 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-9cb801f2-cc57-4f2b-a2b3-9a4af32350b2 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] [instance: 5b41dd2d-cb23-4e57-91fc-1593508dc8cb] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:13:45.859946 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9cb801f2-cc57-4f2b-a2b3-9a4af32350b2 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:45.860524 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9cb801f2-cc57-4f2b-a2b3-9a4af32350b2 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:45.865243 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9cb801f2-cc57-4f2b-a2b3-9a4af32350b2 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:45.876230 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9cb801f2-cc57-4f2b-a2b3-9a4af32350b2 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:46.004520 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-de8b2d64-2611-4f0a-b9c1-8e7f872c38c4 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95896f2064e34e5d82e9531e68aab170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2366e681931c49118c1120350487bde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:13:46.016216 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-de8b2d64-2611-4f0a-b9c1-8e7f872c38c4 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] 10.222.0.17 "GET /compute/v2.1/servers/1d5a909f-c169-415e-a7b7-41835906e801" status: 200 len: 1309 microversion: 2.1 time: 0.269850 Jul 23 21:13:46.022775 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 60/115] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:13:45 2022] GET /compute/v2.1/servers/1d5a909f-c169-415e-a7b7-41835906e801 => generated 1309 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:13:46.289225 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-9cb801f2-cc57-4f2b-a2b3-9a4af32350b2 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199522d29cb746379cb6f75d4b108cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07101aee06ca4bb6885f87cfec3257db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:13:46.297644 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-9cb801f2-cc57-4f2b-a2b3-9a4af32350b2 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] 10.222.0.17 "GET /compute/v2.1/servers/5b41dd2d-cb23-4e57-91fc-1593508dc8cb" status: 200 len: 1342 microversion: 2.1 time: 0.448783 Jul 23 21:13:46.305655 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 56/116] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:13:45 2022] GET /compute/v2.1/servers/5b41dd2d-cb23-4e57-91fc-1593508dc8cb => generated 1342 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:13:46.326257 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-da338765-4576-4ebb-bcbc-d49d3360988b tempest-FlavorsExtraSpecsTestJSON-2091607896 tempest-FlavorsExtraSpecsTestJSON-2091607896-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-312380198", "ram": 512, "vcpus": 1, "disk": 10, "id": 307423347, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:13:46.328312 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:46.328312 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:13:46.363356 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-da338765-4576-4ebb-bcbc-d49d3360988b tempest-FlavorsExtraSpecsTestJSON-2091607896 tempest-FlavorsExtraSpecsTestJSON-2091607896-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.338636 Jul 23 21:13:46.366113 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 61/117] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:13:46 2022] POST /compute/v2.1/flavors => generated 412 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:13:46.378943 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c2dc4a71-04a1-47ab-9cf5-f569506ebca9 tempest-FlavorsExtraSpecsTestJSON-2091607896 tempest-FlavorsExtraSpecsTestJSON-2091607896-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:13:46.380362 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:46.380362 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:13:46.437587 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-c2dc4a71-04a1-47ab-9cf5-f569506ebca9 tempest-FlavorsExtraSpecsTestJSON-2091607896 tempest-FlavorsExtraSpecsTestJSON-2091607896-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors/307423347/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.064083 Jul 23 21:13:46.438228 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 57/118] 10.222.0.17 () {60 vars in 1220 bytes} [Sat Jul 23 21:13:46 2022] POST /compute/v2.1/flavors/307423347/os-extra_specs => generated 66 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 23 21:13:46.751556 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b66b6728-a790-4dec-a2c2-6b3b665e4fd6 tempest-FlavorsExtraSpecsTestJSON-1127580852 tempest-FlavorsExtraSpecsTestJSON-1127580852-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:46.773249 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b66b6728-a790-4dec-a2c2-6b3b665e4fd6 tempest-FlavorsExtraSpecsTestJSON-1127580852 tempest-FlavorsExtraSpecsTestJSON-1127580852-project] 10.222.0.17 "GET /compute/v2.1/flavors/307423347/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.329115 Jul 23 21:13:46.781005 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 62/119] 10.222.0.17 () {58 vars in 1199 bytes} [Sat Jul 23 21:13:46 2022] GET /compute/v2.1/flavors/307423347/os-extra_specs => generated 66 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 23 21:13:46.787118 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f860e35a-8995-4703-88ee-419616616b37 tempest-FlavorsExtraSpecsTestJSON-2091607896 tempest-FlavorsExtraSpecsTestJSON-2091607896-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:13:46.794897 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell0:SELECT=6 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:46.838978 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-f860e35a-8995-4703-88ee-419616616b37 tempest-FlavorsExtraSpecsTestJSON-2091607896 tempest-FlavorsExtraSpecsTestJSON-2091607896-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors/307423347/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.055650 Jul 23 21:13:46.843966 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 58/120] 10.222.0.17 () {60 vars in 1220 bytes} [Sat Jul 23 21:13:46 2022] POST /compute/v2.1/flavors/307423347/os-extra_specs => generated 66 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 23 21:13:46.851916 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e3ae27cf-bb5e-4a3f-9ad9-25d6161c1a74 tempest-FlavorsExtraSpecsTestJSON-1127580852 tempest-FlavorsExtraSpecsTestJSON-1127580852-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:46.867646 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e3ae27cf-bb5e-4a3f-9ad9-25d6161c1a74 tempest-FlavorsExtraSpecsTestJSON-1127580852 tempest-FlavorsExtraSpecsTestJSON-1127580852-project] 10.222.0.17 "GET /compute/v2.1/flavors/307423347/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.019330 Jul 23 21:13:46.873975 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 63/121] 10.222.0.17 () {58 vars in 1241 bytes} [Sat Jul 23 21:13:46 2022] GET /compute/v2.1/flavors/307423347/os-extra_specs/hw:numa_nodes => generated 22 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 23 21:13:46.879177 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-2389c889-b2c7-4d2a-9cc9-ad8099f610d8 tempest-FlavorsExtraSpecsTestJSON-2091607896 tempest-FlavorsExtraSpecsTestJSON-2091607896-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:13:46.920564 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-2389c889-b2c7-4d2a-9cc9-ad8099f610d8 tempest-FlavorsExtraSpecsTestJSON-2091607896 tempest-FlavorsExtraSpecsTestJSON-2091607896-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors/307423347/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.046144 Jul 23 21:13:46.923271 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 59/122] 10.222.0.17 () {60 vars in 1220 bytes} [Sat Jul 23 21:13:46 2022] POST /compute/v2.1/flavors/307423347/os-extra_specs => generated 66 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 23 21:13:46.932995 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-26b39012-2fee-435c-870c-49c67d2ff02f tempest-FlavorsExtraSpecsTestJSON-2091607896 tempest-FlavorsExtraSpecsTestJSON-2091607896-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:46.942728 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-26b39012-2fee-435c-870c-49c67d2ff02f tempest-FlavorsExtraSpecsTestJSON-2091607896 tempest-FlavorsExtraSpecsTestJSON-2091607896-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/307423347/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.014714 Jul 23 21:13:46.953040 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-664e825a-f68c-4a0f-af2a-bd13c4e4ba6f tempest-FlavorsExtraSpecsTestJSON-2091607896 tempest-FlavorsExtraSpecsTestJSON-2091607896-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:13:46.954398 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:46.954398 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:13:46.958068 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 64/123] 10.222.0.17 () {58 vars in 1199 bytes} [Sat Jul 23 21:13:46 2022] GET /compute/v2.1/flavors/307423347/os-extra_specs => generated 66 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 23 21:13:47.002729 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-664e825a-f68c-4a0f-af2a-bd13c4e4ba6f tempest-FlavorsExtraSpecsTestJSON-2091607896 tempest-FlavorsExtraSpecsTestJSON-2091607896-project-admin] 10.222.0.17 "PUT /compute/v2.1/flavors/307423347/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.053709 Jul 23 21:13:47.005367 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 60/124] 10.222.0.17 () {60 vars in 1261 bytes} [Sat Jul 23 21:13:46 2022] PUT /compute/v2.1/flavors/307423347/os-extra_specs/hw:numa_nodes => generated 22 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 23 21:13:47.014116 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ee9604e9-d6ac-43ff-b511-2eae4d9b9dd0 tempest-FlavorsExtraSpecsTestJSON-2091607896 tempest-FlavorsExtraSpecsTestJSON-2091607896-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:47.022489 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ee9604e9-d6ac-43ff-b511-2eae4d9b9dd0 tempest-FlavorsExtraSpecsTestJSON-2091607896 tempest-FlavorsExtraSpecsTestJSON-2091607896-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/307423347/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.012404 Jul 23 21:13:47.028155 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 65/125] 10.222.0.17 () {58 vars in 1199 bytes} [Sat Jul 23 21:13:47 2022] GET /compute/v2.1/flavors/307423347/os-extra_specs => generated 66 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 23 21:13:47.033852 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a85f23e2-4638-48a2-a6ef-b093aff7d57c tempest-FlavorsExtraSpecsTestJSON-2091607896 tempest-FlavorsExtraSpecsTestJSON-2091607896-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:47.034945 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:47.034945 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:13:47.036454 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0f576c4f-e27e-47ca-81f9-e25cf0fbf2ad tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:47.037313 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-0f576c4f-e27e-47ca-81f9-e25cf0fbf2ad tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] [instance: 1d5a909f-c169-415e-a7b7-41835906e801] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:13:47.044088 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0f576c4f-e27e-47ca-81f9-e25cf0fbf2ad tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:47.044735 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0f576c4f-e27e-47ca-81f9-e25cf0fbf2ad tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:47.045670 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0f576c4f-e27e-47ca-81f9-e25cf0fbf2ad tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:47.046283 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0f576c4f-e27e-47ca-81f9-e25cf0fbf2ad tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:47.070528 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=100 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:47.082049 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-a85f23e2-4638-48a2-a6ef-b093aff7d57c tempest-FlavorsExtraSpecsTestJSON-2091607896 tempest-FlavorsExtraSpecsTestJSON-2091607896-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/307423347/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.051754 Jul 23 21:13:47.083701 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 61/126] 10.222.0.17 () {58 vars in 1244 bytes} [Sat Jul 23 21:13:47 2022] DELETE /compute/v2.1/flavors/307423347/os-extra_specs/hw:numa_nodes => generated 0 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Jul 23 21:13:47.091582 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-b3d88f59-c8ce-4e84-97d3-6ea5f21ca9ec tempest-FlavorsExtraSpecsTestJSON-2091607896 tempest-FlavorsExtraSpecsTestJSON-2091607896-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:47.115405 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-b3d88f59-c8ce-4e84-97d3-6ea5f21ca9ec tempest-FlavorsExtraSpecsTestJSON-2091607896 tempest-FlavorsExtraSpecsTestJSON-2091607896-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/307423347/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.027663 Jul 23 21:13:47.120552 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 62/127] 10.222.0.17 () {58 vars in 1244 bytes} [Sat Jul 23 21:13:47 2022] DELETE /compute/v2.1/flavors/307423347/os-extra_specs/hw:cpu_policy => generated 0 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Jul 23 21:13:47.129030 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-9f3e2482-7a55-4daf-8c9a-a8fdc23ac4fc tempest-FlavorsExtraSpecsTestJSON-2091607896 tempest-FlavorsExtraSpecsTestJSON-2091607896-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:47.141070 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-9f3e2482-7a55-4daf-8c9a-a8fdc23ac4fc tempest-FlavorsExtraSpecsTestJSON-2091607896 tempest-FlavorsExtraSpecsTestJSON-2091607896-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/307423347/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.016371 Jul 23 21:13:47.146333 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 63/128] 10.222.0.17 () {58 vars in 1199 bytes} [Sat Jul 23 21:13:47 2022] GET /compute/v2.1/flavors/307423347/os-extra_specs => generated 19 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 23 21:13:47.155777 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-8c26a49d-cc9d-4649-881d-909ab5ba1c02 tempest-FlavorsExtraSpecsTestJSON-2091607896 tempest-FlavorsExtraSpecsTestJSON-2091607896-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:47.157408 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:47.157408 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:13:47.184514 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-8c26a49d-cc9d-4649-881d-909ab5ba1c02 tempest-FlavorsExtraSpecsTestJSON-2091607896 tempest-FlavorsExtraSpecsTestJSON-2091607896-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/307423347" status: 202 len: 0 microversion: 2.1 time: 0.035276 Jul 23 21:13:47.185173 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 64/129] 10.222.0.17 () {58 vars in 1157 bytes} [Sat Jul 23 21:13:47 2022] DELETE /compute/v2.1/flavors/307423347 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:13:47.311049 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-0f576c4f-e27e-47ca-81f9-e25cf0fbf2ad tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95896f2064e34e5d82e9531e68aab170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2366e681931c49118c1120350487bde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:13:47.323532 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-0f576c4f-e27e-47ca-81f9-e25cf0fbf2ad tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] 10.222.0.17 "GET /compute/v2.1/servers/1d5a909f-c169-415e-a7b7-41835906e801" status: 200 len: 1339 microversion: 2.1 time: 0.291444 Jul 23 21:13:47.334195 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 66/130] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:13:47 2022] GET /compute/v2.1/servers/1d5a909f-c169-415e-a7b7-41835906e801 => generated 1339 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:13:47.339354 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-207fb926-9949-4eb9-843a-6b9ef32ced8f tempest-FlavorsExtraSpecsTestJSON-2091607896 tempest-FlavorsExtraSpecsTestJSON-2091607896-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:47.359098 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-207fb926-9949-4eb9-843a-6b9ef32ced8f tempest-FlavorsExtraSpecsTestJSON-2091607896 tempest-FlavorsExtraSpecsTestJSON-2091607896-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023427 Jul 23 21:13:47.360513 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 67/131] 10.222.0.17 () {58 vars in 1145 bytes} [Sat Jul 23 21:13:47 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:13:47.365631 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9cc7d6c1-de51-476a-9476-048b687c1b3c tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:47.367353 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-9cc7d6c1-de51-476a-9476-048b687c1b3c tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] [instance: 5b41dd2d-cb23-4e57-91fc-1593508dc8cb] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:13:47.376086 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9cc7d6c1-de51-476a-9476-048b687c1b3c tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:47.377261 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9cc7d6c1-de51-476a-9476-048b687c1b3c tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:47.378485 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9cc7d6c1-de51-476a-9476-048b687c1b3c tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:47.379279 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9cc7d6c1-de51-476a-9476-048b687c1b3c tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:47.409673 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e9f2a213-5118-4034-829b-51d3edfc32f7 tempest-HypervisorAdminNegativeUnderV252Test-437788957 tempest-HypervisorAdminNegativeUnderV252Test-437788957-project-admin] Calling method '.version_select at 0x7f0b54c0bf70>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:47.410602 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:47.410602 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:13:47.411860 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e9f2a213-5118-4034-829b-51d3edfc32f7 tempest-HypervisorAdminNegativeUnderV252Test-437788957 tempest-HypervisorAdminNegativeUnderV252Test-437788957-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:47.412375 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e9f2a213-5118-4034-829b-51d3edfc32f7 tempest-HypervisorAdminNegativeUnderV252Test-437788957 tempest-HypervisorAdminNegativeUnderV252Test-437788957-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:47.431155 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_api:SELECT=74,nova_api:SAVEPOINT=9,nova_api:INSERT=2,nova_api:RELEASE=9,nova_api:UPDATE=1,nova_api:DELETE=5 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:47.450880 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e9f2a213-5118-4034-829b-51d3edfc32f7 tempest-HypervisorAdminNegativeUnderV252Test-437788957 tempest-HypervisorAdminNegativeUnderV252Test-437788957-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:47.451436 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e9f2a213-5118-4034-829b-51d3edfc32f7 tempest-HypervisorAdminNegativeUnderV252Test-437788957 tempest-HypervisorAdminNegativeUnderV252Test-437788957-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:47.470881 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e9f2a213-5118-4034-829b-51d3edfc32f7 tempest-HypervisorAdminNegativeUnderV252Test-437788957 tempest-HypervisorAdminNegativeUnderV252Test-437788957-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:47.471328 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e9f2a213-5118-4034-829b-51d3edfc32f7 tempest-HypervisorAdminNegativeUnderV252Test-437788957 tempest-HypervisorAdminNegativeUnderV252Test-437788957-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:47.489668 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-e9f2a213-5118-4034-829b-51d3edfc32f7 tempest-HypervisorAdminNegativeUnderV252Test-437788957 tempest-HypervisorAdminNegativeUnderV252Test-437788957-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.303181 Jul 23 21:13:47.497176 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 65/132] 10.222.0.17 () {58 vars in 1145 bytes} [Sat Jul 23 21:13:47 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:13:47.934751 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-7b517e04-a516-4f7e-bf10-cd9ee6414503 tempest-HypervisorAdminNegativeUnderV252Test-1724377148 tempest-HypervisorAdminNegativeUnderV252Test-1724377148-project] Calling method '.version_select at 0x7f0b54b10280>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:47.938121 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:47.938121 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:13:47.940940 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-7b517e04-a516-4f7e-bf10-cd9ee6414503 tempest-HypervisorAdminNegativeUnderV252Test-1724377148 tempest-HypervisorAdminNegativeUnderV252Test-1724377148-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '221b02f2034d4ba88a36645ae61f0735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7aebda5e1e49308c404624091e8511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:13:47.943583 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-7b517e04-a516-4f7e-bf10-cd9ee6414503 tempest-HypervisorAdminNegativeUnderV252Test-1724377148 tempest-HypervisorAdminNegativeUnderV252Test-1724377148-project] Request method failure captured: Jul 23 21:13:47.943583 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/os-hypervisors/nch2-master-1/search HTTP/1.1 Jul 23 21:13:47.943583 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:13:47.943583 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:13:47.943583 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:13:47.943583 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:13:47.943583 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:13:47.943583 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:13:47.943583 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:13:47.943583 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:13:47.943583 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GSJYhwpPJ7N7xXUu8A5bRjKPhUIS3iYKnL1awrheXrQrNibDXm6wN2IZnl6x5nEPHQGTUZ-GOS5OAwsRC6Jz7IhDhOeSBjAayZKLzBSTzlP11eMk73nn0enA2Et_jafXpNP5hPPlBmGjhNjKNyAeI8XEM84rlIG7xTdFeV14_awfMc Jul 23 21:13:47.943583 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:13:47.943583 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:13:47.943583 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:13:47.943583 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:13:47.943583 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:13:47.943583 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:13:47.943583 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 7b7aebda5e1e49308c404624091e8511 Jul 23 21:13:47.943583 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1724377148 Jul 23 21:13:47.943583 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:13:47.943583 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:13:47.944882 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7b7aebda5e1e49308c404624091e8511"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7b7aebda5e1e49308c404624091e8511"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_7b7aebda5e1e49308c404624091e8511", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/7b7aebda5e1e49308c404624091e8511"}]}] Jul 23 21:13:47.944882 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1724377148 Jul 23 21:13:47.944882 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 7b7aebda5e1e49308c404624091e8511 Jul 23 21:13:47.944882 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1724377148 Jul 23 21:13:47.944882 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1724377148-project Jul 23 21:13:47.944882 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:13:47.944882 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:13:47.944882 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 221b02f2034d4ba88a36645ae61f0735 Jul 23 21:13:47.944882 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1724377148-project Jul 23 21:13:47.944882 ncdv-master-1 devstack@n-api.service[131321]: method: Jul 23 21:13:47.944882 ncdv-master-1 devstack@n-api.service[131321]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jul 23 21:13:47.944882 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': 'nch2-master-1'} Jul 23 21:13:47.945643 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:13:47.945643 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:13:47.945643 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:13:47.945643 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:13:47.945643 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:13:47.945643 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:13:47.945643 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:13:47.945643 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:13:47.945643 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:13:47.945643 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:13:47.945643 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Jul 23 21:13:47.945643 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Jul 23 21:13:47.945643 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 23 21:13:47.945643 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 23 21:13:47.945643 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 23 21:13:47.945643 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 23 21:13:47.945643 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 23 21:13:47.945643 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 23 21:13:47.945643 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 23 21:13:47.946809 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise self.value Jul 23 21:13:47.946809 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 23 21:13:47.946809 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 23 21:13:47.946809 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 23 21:13:47.946809 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 23 21:13:47.946809 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 23 21:13:47.946809 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 23 21:13:47.946809 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jul 23 21:13:47.946809 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:13:47.946809 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:13:47.946809 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:13:47.946809 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:13:47.946809 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:13:47.946809 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:13:47.946809 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 23 21:13:47.946809 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 23 21:13:47.946809 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jul 23 21:13:47.946809 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:13:47.949730 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-7b517e04-a516-4f7e-bf10-cd9ee6414503 tempest-HypervisorAdminNegativeUnderV252Test-1724377148 tempest-HypervisorAdminNegativeUnderV252Test-1724377148-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:13:47.950936 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-7b517e04-a516-4f7e-bf10-cd9ee6414503 tempest-HypervisorAdminNegativeUnderV252Test-1724377148 tempest-HypervisorAdminNegativeUnderV252Test-1724377148-project] 10.222.0.17 "GET /compute/v2.1/os-hypervisors/nch2-master-1/search" status: 403 len: 117 microversion: 2.1 time: 0.447472 Jul 23 21:13:47.952398 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 66/133] 10.222.0.17 () {58 vars in 1208 bytes} [Sat Jul 23 21:13:47 2022] GET /compute/v2.1/os-hypervisors/nch2-master-1/search => generated 117 bytes in 449 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:13:47.962602 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-aebb1f97-e575-48b0-899b-c2f30b0fadb2 tempest-HypervisorAdminNegativeUnderV252Test-437788957 tempest-HypervisorAdminNegativeUnderV252Test-437788957-project-admin] Calling method '.version_select at 0x7f0b54aac5e0>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:47.964458 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-aebb1f97-e575-48b0-899b-c2f30b0fadb2 tempest-HypervisorAdminNegativeUnderV252Test-437788957 tempest-HypervisorAdminNegativeUnderV252Test-437788957-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:47.965296 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-aebb1f97-e575-48b0-899b-c2f30b0fadb2 tempest-HypervisorAdminNegativeUnderV252Test-437788957 tempest-HypervisorAdminNegativeUnderV252Test-437788957-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:47.973226 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-aebb1f97-e575-48b0-899b-c2f30b0fadb2 tempest-HypervisorAdminNegativeUnderV252Test-437788957 tempest-HypervisorAdminNegativeUnderV252Test-437788957-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 23 21:13:47.974875 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-aebb1f97-e575-48b0-899b-c2f30b0fadb2 tempest-HypervisorAdminNegativeUnderV252Test-437788957 tempest-HypervisorAdminNegativeUnderV252Test-437788957-project-admin] Request method failure captured: Jul 23 21:13:47.974875 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Jul 23 21:13:47.974875 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:13:47.974875 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:13:47.974875 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:13:47.974875 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:13:47.974875 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:13:47.974875 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:13:47.974875 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:13:47.974875 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:13:47.974875 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GSLF4fhWadAeECgxlNqiKQBN8OwrLlwAfDx4fRyzzxrpmd5QrcLCBZfOJ0wVSGjMtcLKlHx2H01Rm4It1xXRMcs2czJN8nieSn4fpF1UEsrralh56k3xy7txWbYg_rpwIMmzZuggadVVCLKyPihnypFMPLrKuky_nnLjbeys5-KNFo Jul 23 21:13:47.974875 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:13:47.974875 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:13:47.974875 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:13:47.974875 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:13:47.974875 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:13:47.974875 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:13:47.974875 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 74db98fae0c044b19ae2bc4f74bcd38d Jul 23 21:13:47.974875 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-437788957 Jul 23 21:13:47.974875 ncdv-master-1 devstack@n-api.service[131321]: X-Role: admin,reader,member Jul 23 21:13:47.974875 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: admin,reader,member Jul 23 21:13:47.976141 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/74db98fae0c044b19ae2bc4f74bcd38d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/74db98fae0c044b19ae2bc4f74bcd38d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_74db98fae0c044b19ae2bc4f74bcd38d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/74db98fae0c044b19ae2bc4f74bcd38d"}]}] Jul 23 21:13:47.976141 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-437788957 Jul 23 21:13:47.976141 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 74db98fae0c044b19ae2bc4f74bcd38d Jul 23 21:13:47.976141 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-437788957 Jul 23 21:13:47.976141 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-437788957-project-admin Jul 23 21:13:47.976141 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:13:47.976141 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:13:47.976141 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: caaadf823a394935b08d631d2f256b38 Jul 23 21:13:47.976141 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-437788957-project-admin Jul 23 21:13:47.976141 ncdv-master-1 devstack@n-api.service[131321]: method: Jul 23 21:13:47.976141 ncdv-master-1 devstack@n-api.service[131321]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 23 21:13:47.976141 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': 'nonexistent_hypervisor_name'} Jul 23 21:13:47.976881 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:13:47.976881 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:13:47.976881 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:13:47.976881 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:13:47.976881 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:13:47.976881 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:13:47.976881 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:13:47.976881 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:13:47.976881 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:13:47.976881 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:13:47.976881 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Jul 23 21:13:47.976881 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Jul 23 21:13:47.976881 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Jul 23 21:13:47.976881 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 23 21:13:47.976881 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 23 21:13:47.976881 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:13:47.976881 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:13:47.976881 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:13:47.976881 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:13:47.976881 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:13:47.977904 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:13:47.977904 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:13:47.977904 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:13:47.977904 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 23 21:13:47.977904 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:13:47.979476 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-aebb1f97-e575-48b0-899b-c2f30b0fadb2 tempest-HypervisorAdminNegativeUnderV252Test-437788957 tempest-HypervisorAdminNegativeUnderV252Test-437788957-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:13:47.980516 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-aebb1f97-e575-48b0-899b-c2f30b0fadb2 tempest-HypervisorAdminNegativeUnderV252Test-437788957 tempest-HypervisorAdminNegativeUnderV252Test-437788957-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.021552 Jul 23 21:13:47.985805 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 67/134] 10.222.0.17 () {58 vars in 1250 bytes} [Sat Jul 23 21:13:47 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:13:47.990775 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d9472b49-20e3-41c4-a39c-3a6c822bb7aa tempest-HypervisorAdminNegativeUnderV252Test-437788957 tempest-HypervisorAdminNegativeUnderV252Test-437788957-project-admin] Calling method '.version_select at 0x7f0b54aac3a0>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:47.991907 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:47.991907 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:13:47.993560 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d9472b49-20e3-41c4-a39c-3a6c822bb7aa tempest-HypervisorAdminNegativeUnderV252Test-437788957 tempest-HypervisorAdminNegativeUnderV252Test-437788957-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:47.994340 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d9472b49-20e3-41c4-a39c-3a6c822bb7aa tempest-HypervisorAdminNegativeUnderV252Test-437788957 tempest-HypervisorAdminNegativeUnderV252Test-437788957-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:48.002244 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=100 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:48.013232 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d9472b49-20e3-41c4-a39c-3a6c822bb7aa tempest-HypervisorAdminNegativeUnderV252Test-437788957 tempest-HypervisorAdminNegativeUnderV252Test-437788957-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:48.014089 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d9472b49-20e3-41c4-a39c-3a6c822bb7aa tempest-HypervisorAdminNegativeUnderV252Test-437788957 tempest-HypervisorAdminNegativeUnderV252Test-437788957-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:48.027732 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d9472b49-20e3-41c4-a39c-3a6c822bb7aa tempest-HypervisorAdminNegativeUnderV252Test-437788957 tempest-HypervisorAdminNegativeUnderV252Test-437788957-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:48.028516 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d9472b49-20e3-41c4-a39c-3a6c822bb7aa tempest-HypervisorAdminNegativeUnderV252Test-437788957 tempest-HypervisorAdminNegativeUnderV252Test-437788957-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:48.035695 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-d9472b49-20e3-41c4-a39c-3a6c822bb7aa tempest-HypervisorAdminNegativeUnderV252Test-437788957 tempest-HypervisorAdminNegativeUnderV252Test-437788957-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.048451 Jul 23 21:13:48.042154 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 68/135] 10.222.0.17 () {58 vars in 1145 bytes} [Sat Jul 23 21:13:47 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:13:48.048441 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-cfd1bae7-5094-40f9-b4ec-63712649f035 tempest-HypervisorAdminNegativeUnderV252Test-1724377148 tempest-HypervisorAdminNegativeUnderV252Test-1724377148-project] Calling method '.version_select at 0x7f0b54aac700>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:48.049670 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:48.049670 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:13:48.051825 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-cfd1bae7-5094-40f9-b4ec-63712649f035 tempest-HypervisorAdminNegativeUnderV252Test-1724377148 tempest-HypervisorAdminNegativeUnderV252Test-1724377148-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '221b02f2034d4ba88a36645ae61f0735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b7aebda5e1e49308c404624091e8511', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:13:48.052716 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-9cc7d6c1-de51-476a-9476-048b687c1b3c tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199522d29cb746379cb6f75d4b108cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07101aee06ca4bb6885f87cfec3257db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:13:48.054559 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-cfd1bae7-5094-40f9-b4ec-63712649f035 tempest-HypervisorAdminNegativeUnderV252Test-1724377148 tempest-HypervisorAdminNegativeUnderV252Test-1724377148-project] Request method failure captured: Jul 23 21:13:48.054559 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Jul 23 21:13:48.054559 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:13:48.054559 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:13:48.054559 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:13:48.054559 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:13:48.054559 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:13:48.054559 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:13:48.054559 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:13:48.054559 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:13:48.054559 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GSJYhwpPJ7N7xXUu8A5bRjKPhUIS3iYKnL1awrheXrQrNibDXm6wN2IZnl6x5nEPHQGTUZ-GOS5OAwsRC6Jz7IhDhOeSBjAayZKLzBSTzlP11eMk73nn0enA2Et_jafXpNP5hPPlBmGjhNjKNyAeI8XEM84rlIG7xTdFeV14_awfMc Jul 23 21:13:48.054559 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:13:48.054559 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:13:48.054559 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:13:48.054559 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:13:48.054559 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:13:48.054559 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:13:48.054559 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 7b7aebda5e1e49308c404624091e8511 Jul 23 21:13:48.054559 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1724377148 Jul 23 21:13:48.054559 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:13:48.054559 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:13:48.056135 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7b7aebda5e1e49308c404624091e8511"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7b7aebda5e1e49308c404624091e8511"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_7b7aebda5e1e49308c404624091e8511", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/7b7aebda5e1e49308c404624091e8511"}]}] Jul 23 21:13:48.056135 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1724377148 Jul 23 21:13:48.056135 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 7b7aebda5e1e49308c404624091e8511 Jul 23 21:13:48.056135 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1724377148 Jul 23 21:13:48.056135 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1724377148-project Jul 23 21:13:48.056135 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:13:48.056135 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:13:48.056135 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 221b02f2034d4ba88a36645ae61f0735 Jul 23 21:13:48.056135 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1724377148-project Jul 23 21:13:48.056135 ncdv-master-1 devstack@n-api.service[131321]: method: Jul 23 21:13:48.056135 ncdv-master-1 devstack@n-api.service[131321]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jul 23 21:13:48.056135 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': '1'} Jul 23 21:13:48.056781 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:13:48.056781 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:13:48.056781 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:13:48.056781 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:13:48.056781 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:13:48.056781 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:13:48.056781 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:13:48.056781 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:13:48.056781 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:13:48.056781 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:13:48.056781 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Jul 23 21:13:48.056781 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Jul 23 21:13:48.056781 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 23 21:13:48.056781 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 23 21:13:48.056781 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 23 21:13:48.056781 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 23 21:13:48.056781 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 23 21:13:48.056781 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 23 21:13:48.056781 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 23 21:13:48.058192 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise self.value Jul 23 21:13:48.058192 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 23 21:13:48.058192 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 23 21:13:48.058192 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 23 21:13:48.058192 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 23 21:13:48.058192 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 23 21:13:48.058192 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 23 21:13:48.058192 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jul 23 21:13:48.058192 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:13:48.058192 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:13:48.058192 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:13:48.058192 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:13:48.058192 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:13:48.058192 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:13:48.058192 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 23 21:13:48.058192 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 23 21:13:48.058192 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jul 23 21:13:48.058192 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:13:48.061243 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-cfd1bae7-5094-40f9-b4ec-63712649f035 tempest-HypervisorAdminNegativeUnderV252Test-1724377148 tempest-HypervisorAdminNegativeUnderV252Test-1724377148-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:13:48.062315 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-cfd1bae7-5094-40f9-b4ec-63712649f035 tempest-HypervisorAdminNegativeUnderV252Test-1724377148 tempest-HypervisorAdminNegativeUnderV252Test-1724377148-project] 10.222.0.17 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.018757 Jul 23 21:13:48.064751 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9cc7d6c1-de51-476a-9476-048b687c1b3c tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] 10.222.0.17 "GET /compute/v2.1/servers/5b41dd2d-cb23-4e57-91fc-1593508dc8cb" status: 200 len: 1342 microversion: 2.1 time: 0.703002 Jul 23 21:13:48.065954 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 68/136] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:13:47 2022] GET /compute/v2.1/servers/5b41dd2d-cb23-4e57-91fc-1593508dc8cb => generated 1342 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:13:48.067873 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 69/137] 10.222.0.17 () {58 vars in 1175 bytes} [Sat Jul 23 21:13:48 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:13:48.073233 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-dcc04114-d46c-4ae5-9920-9ab5fba51b1a tempest-HypervisorAdminNegativeUnderV252Test-437788957 tempest-HypervisorAdminNegativeUnderV252Test-437788957-project-admin] Calling method '.version_select at 0x7f0b54acac10>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:48.074059 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:48.074059 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:13:48.079032 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dcc04114-d46c-4ae5-9920-9ab5fba51b1a tempest-HypervisorAdminNegativeUnderV252Test-437788957 tempest-HypervisorAdminNegativeUnderV252Test-437788957-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:48.079528 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dcc04114-d46c-4ae5-9920-9ab5fba51b1a tempest-HypervisorAdminNegativeUnderV252Test-437788957 tempest-HypervisorAdminNegativeUnderV252Test-437788957-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:48.090203 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-dcc04114-d46c-4ae5-9920-9ab5fba51b1a tempest-HypervisorAdminNegativeUnderV252Test-437788957 tempest-HypervisorAdminNegativeUnderV252Test-437788957-project-admin] HTTP exception thrown: No hypervisor matching 'cb08674a-004f-469f-8f30-704b2eb18973' could be found. Jul 23 21:13:48.092853 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-dcc04114-d46c-4ae5-9920-9ab5fba51b1a tempest-HypervisorAdminNegativeUnderV252Test-437788957 tempest-HypervisorAdminNegativeUnderV252Test-437788957-project-admin] Request method failure captured: Jul 23 21:13:48.092853 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/os-hypervisors/cb08674a-004f-469f-8f30-704b2eb18973/servers HTTP/1.1 Jul 23 21:13:48.092853 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:13:48.092853 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:13:48.092853 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:13:48.092853 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:13:48.092853 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:13:48.092853 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:13:48.092853 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:13:48.092853 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:13:48.092853 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GSLF4fhWadAeECgxlNqiKQBN8OwrLlwAfDx4fRyzzxrpmd5QrcLCBZfOJ0wVSGjMtcLKlHx2H01Rm4It1xXRMcs2czJN8nieSn4fpF1UEsrralh56k3xy7txWbYg_rpwIMmzZuggadVVCLKyPihnypFMPLrKuky_nnLjbeys5-KNFo Jul 23 21:13:48.092853 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:13:48.092853 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:13:48.092853 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:13:48.092853 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:13:48.092853 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:13:48.092853 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:13:48.092853 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 74db98fae0c044b19ae2bc4f74bcd38d Jul 23 21:13:48.092853 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-437788957 Jul 23 21:13:48.092853 ncdv-master-1 devstack@n-api.service[131320]: X-Role: admin,reader,member Jul 23 21:13:48.092853 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: admin,reader,member Jul 23 21:13:48.094261 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/74db98fae0c044b19ae2bc4f74bcd38d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/74db98fae0c044b19ae2bc4f74bcd38d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_74db98fae0c044b19ae2bc4f74bcd38d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/74db98fae0c044b19ae2bc4f74bcd38d"}]}] Jul 23 21:13:48.094261 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-437788957 Jul 23 21:13:48.094261 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 74db98fae0c044b19ae2bc4f74bcd38d Jul 23 21:13:48.094261 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-437788957 Jul 23 21:13:48.094261 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-437788957-project-admin Jul 23 21:13:48.094261 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:13:48.094261 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:13:48.094261 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: caaadf823a394935b08d631d2f256b38 Jul 23 21:13:48.094261 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-437788957-project-admin Jul 23 21:13:48.094261 ncdv-master-1 devstack@n-api.service[131320]: method: Jul 23 21:13:48.094261 ncdv-master-1 devstack@n-api.service[131320]: exception: No hypervisor matching 'cb08674a-004f-469f-8f30-704b2eb18973' could be found. Jul 23 21:13:48.094261 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': 'cb08674a-004f-469f-8f30-704b2eb18973'} Jul 23 21:13:48.095194 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:13:48.095194 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:13:48.095194 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:13:48.095194 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:13:48.095194 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:13:48.095194 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:13:48.095194 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:13:48.095194 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:13:48.095194 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:13:48.095194 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:13:48.095194 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Jul 23 21:13:48.095194 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Jul 23 21:13:48.095194 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Jul 23 21:13:48.095194 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 23 21:13:48.095194 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'cb08674a-004f-469f-8f30-704b2eb18973' could be found. Jul 23 21:13:48.095194 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:13:48.095194 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:13:48.095194 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:13:48.095194 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:13:48.101253 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:13:48.101253 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:13:48.101253 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:13:48.101253 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:13:48.101253 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'cb08674a-004f-469f-8f30-704b2eb18973' could be found. Jul 23 21:13:48.101253 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:13:48.101253 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-dcc04114-d46c-4ae5-9920-9ab5fba51b1a tempest-HypervisorAdminNegativeUnderV252Test-437788957 tempest-HypervisorAdminNegativeUnderV252Test-437788957-project-admin] Returning 404 to user: No hypervisor matching 'cb08674a-004f-469f-8f30-704b2eb18973' could be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:13:48.101253 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-dcc04114-d46c-4ae5-9920-9ab5fba51b1a tempest-HypervisorAdminNegativeUnderV252Test-437788957 tempest-HypervisorAdminNegativeUnderV252Test-437788957-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors/cb08674a-004f-469f-8f30-704b2eb18973/servers" status: 404 len: 123 microversion: 2.1 time: 0.024910 Jul 23 21:13:48.101253 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 69/138] 10.222.0.17 () {58 vars in 1280 bytes} [Sat Jul 23 21:13:48 2022] GET /compute/v2.1/os-hypervisors/cb08674a-004f-469f-8f30-704b2eb18973/servers => generated 123 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:13:48.238682 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-1a7b00e7-62f2-483e-abb0-140879d92788 req-5571e200-b939-4bac-9f9c-a4f53ba5b2aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d5a909f-c169-415e-a7b7-41835906e801", "tag": "567ed78e-1fe8-48f0-b345-0f19ade3de9a"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:13:48.266058 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-1a7b00e7-62f2-483e-abb0-140879d92788 req-5571e200-b939-4bac-9f9c-a4f53ba5b2aa service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:48.266575 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-1a7b00e7-62f2-483e-abb0-140879d92788 req-5571e200-b939-4bac-9f9c-a4f53ba5b2aa service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:48.301024 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-fdbdaf2a-5218-4f38-9405-c82e163cddd9 tempest-AZAdminV2TestJSON-583219608 tempest-AZAdminV2TestJSON-583219608-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:48.302939 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fdbdaf2a-5218-4f38-9405-c82e163cddd9 tempest-AZAdminV2TestJSON-583219608 tempest-AZAdminV2TestJSON-583219608-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:48.303509 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fdbdaf2a-5218-4f38-9405-c82e163cddd9 tempest-AZAdminV2TestJSON-583219608 tempest-AZAdminV2TestJSON-583219608-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:48.304651 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fdbdaf2a-5218-4f38-9405-c82e163cddd9 tempest-AZAdminV2TestJSON-583219608 tempest-AZAdminV2TestJSON-583219608-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:48.306212 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fdbdaf2a-5218-4f38-9405-c82e163cddd9 tempest-AZAdminV2TestJSON-583219608 tempest-AZAdminV2TestJSON-583219608-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:48.308585 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-1a7b00e7-62f2-483e-abb0-140879d92788 req-5571e200-b939-4bac-9f9c-a4f53ba5b2aa service nova] Creating event network-changed:567ed78e-1fe8-48f0-b345-0f19ade3de9a for instance 1d5a909f-c169-415e-a7b7-41835906e801 on nch2-master-1 Jul 23 21:13:48.327930 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-1a7b00e7-62f2-483e-abb0-140879d92788 req-5571e200-b939-4bac-9f9c-a4f53ba5b2aa service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098184 Jul 23 21:13:48.329879 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 70/139] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:13:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:13:48.356749 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d960d69d-ad9b-41be-a54c-39a9824c41c4 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:48.357843 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d960d69d-ad9b-41be-a54c-39a9824c41c4 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] [instance: 1d5a909f-c169-415e-a7b7-41835906e801] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:13:48.371087 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-fdbdaf2a-5218-4f38-9405-c82e163cddd9 tempest-AZAdminV2TestJSON-583219608 tempest-AZAdminV2TestJSON-583219608-project-admin] 10.222.0.17 "GET /compute/v2.1/os-availability-zone" status: 200 len: 190 microversion: 2.1 time: 0.278199 Jul 23 21:13:48.372842 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 70/140] 10.222.0.17 () {58 vars in 1163 bytes} [Sat Jul 23 21:13:48 2022] GET /compute/v2.1/os-availability-zone => generated 190 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:13:48.374048 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d960d69d-ad9b-41be-a54c-39a9824c41c4 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:48.374804 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d960d69d-ad9b-41be-a54c-39a9824c41c4 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:48.376096 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d960d69d-ad9b-41be-a54c-39a9824c41c4 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:48.376573 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d960d69d-ad9b-41be-a54c-39a9824c41c4 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:48.388609 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a0f41d2b-7e06-4edc-ab0b-2ea42f54fdab tempest-AZAdminV2TestJSON-583219608 tempest-AZAdminV2TestJSON-583219608-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:48.393298 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:48.393298 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:13:48.395419 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a0f41d2b-7e06-4edc-ab0b-2ea42f54fdab tempest-AZAdminV2TestJSON-583219608 tempest-AZAdminV2TestJSON-583219608-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:48.397470 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a0f41d2b-7e06-4edc-ab0b-2ea42f54fdab tempest-AZAdminV2TestJSON-583219608 tempest-AZAdminV2TestJSON-583219608-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:48.398858 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a0f41d2b-7e06-4edc-ab0b-2ea42f54fdab tempest-AZAdminV2TestJSON-583219608 tempest-AZAdminV2TestJSON-583219608-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:48.399542 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a0f41d2b-7e06-4edc-ab0b-2ea42f54fdab tempest-AZAdminV2TestJSON-583219608 tempest-AZAdminV2TestJSON-583219608-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:48.441343 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-a0f41d2b-7e06-4edc-ab0b-2ea42f54fdab tempest-AZAdminV2TestJSON-583219608 tempest-AZAdminV2TestJSON-583219608-project-admin] 10.222.0.17 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 702 microversion: 2.1 time: 0.060515 Jul 23 21:13:48.443319 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 71/141] 10.222.0.17 () {58 vars in 1184 bytes} [Sat Jul 23 21:13:48 2022] GET /compute/v2.1/os-availability-zone/detail => generated 702 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:13:48.474594 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=12 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:48.854321 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d960d69d-ad9b-41be-a54c-39a9824c41c4 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95896f2064e34e5d82e9531e68aab170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2366e681931c49118c1120350487bde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:13:48.868995 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d960d69d-ad9b-41be-a54c-39a9824c41c4 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] 10.222.0.17 "GET /compute/v2.1/servers/1d5a909f-c169-415e-a7b7-41835906e801" status: 200 len: 1339 microversion: 2.1 time: 0.525082 Jul 23 21:13:48.869924 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 71/142] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:13:48 2022] GET /compute/v2.1/servers/1d5a909f-c169-415e-a7b7-41835906e801 => generated 1339 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:13:49.084693 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c49f85cb-d3d4-46a1-9c04-4c9eebdf4539 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:49.085174 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-c49f85cb-d3d4-46a1-9c04-4c9eebdf4539 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] [instance: 5b41dd2d-cb23-4e57-91fc-1593508dc8cb] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:13:49.093583 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c49f85cb-d3d4-46a1-9c04-4c9eebdf4539 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:49.094199 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c49f85cb-d3d4-46a1-9c04-4c9eebdf4539 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:49.095214 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c49f85cb-d3d4-46a1-9c04-4c9eebdf4539 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:49.095697 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c49f85cb-d3d4-46a1-9c04-4c9eebdf4539 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:49.556679 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c49f85cb-d3d4-46a1-9c04-4c9eebdf4539 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199522d29cb746379cb6f75d4b108cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07101aee06ca4bb6885f87cfec3257db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:13:49.564670 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-c49f85cb-d3d4-46a1-9c04-4c9eebdf4539 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] 10.222.0.17 "GET /compute/v2.1/servers/5b41dd2d-cb23-4e57-91fc-1593508dc8cb" status: 200 len: 1342 microversion: 2.1 time: 0.485980 Jul 23 21:13:49.565176 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 72/143] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:13:49 2022] GET /compute/v2.1/servers/5b41dd2d-cb23-4e57-91fc-1593508dc8cb => generated 1342 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:13:49.889524 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-af292ec8-9a4f-4b69-9a69-6fb51c48da0d tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:49.890269 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-af292ec8-9a4f-4b69-9a69-6fb51c48da0d tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] [instance: 1d5a909f-c169-415e-a7b7-41835906e801] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:13:49.900656 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=6 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:49.907737 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-af292ec8-9a4f-4b69-9a69-6fb51c48da0d tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:49.908881 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-af292ec8-9a4f-4b69-9a69-6fb51c48da0d tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:49.919526 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-af292ec8-9a4f-4b69-9a69-6fb51c48da0d tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:49.920717 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-af292ec8-9a4f-4b69-9a69-6fb51c48da0d tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:50.579163 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-af292ec8-9a4f-4b69-9a69-6fb51c48da0d tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95896f2064e34e5d82e9531e68aab170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2366e681931c49118c1120350487bde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:13:50.588340 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-af292ec8-9a4f-4b69-9a69-6fb51c48da0d tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] 10.222.0.17 "GET /compute/v2.1/servers/1d5a909f-c169-415e-a7b7-41835906e801" status: 200 len: 1339 microversion: 2.1 time: 0.705002 Jul 23 21:13:50.595073 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 72/144] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:13:49 2022] GET /compute/v2.1/servers/1d5a909f-c169-415e-a7b7-41835906e801 => generated 1339 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:13:50.595762 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d9ba19fc-9e56-4c14-9bc3-30fa6feb2c84 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:50.599220 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-d9ba19fc-9e56-4c14-9bc3-30fa6feb2c84 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] [instance: 5b41dd2d-cb23-4e57-91fc-1593508dc8cb] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:13:50.623496 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d9ba19fc-9e56-4c14-9bc3-30fa6feb2c84 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:50.626698 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d9ba19fc-9e56-4c14-9bc3-30fa6feb2c84 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:50.627859 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d9ba19fc-9e56-4c14-9bc3-30fa6feb2c84 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:50.632789 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d9ba19fc-9e56-4c14-9bc3-30fa6feb2c84 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:50.987628 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-d9ba19fc-9e56-4c14-9bc3-30fa6feb2c84 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199522d29cb746379cb6f75d4b108cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07101aee06ca4bb6885f87cfec3257db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:13:51.008181 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-d9ba19fc-9e56-4c14-9bc3-30fa6feb2c84 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] 10.222.0.17 "GET /compute/v2.1/servers/5b41dd2d-cb23-4e57-91fc-1593508dc8cb" status: 200 len: 1342 microversion: 2.1 time: 0.429810 Jul 23 21:13:51.013060 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 73/145] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:13:50 2022] GET /compute/v2.1/servers/5b41dd2d-cb23-4e57-91fc-1593508dc8cb => generated 1342 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:13:51.612172 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-dd6747f1-4b03-4499-95c3-53def0f213d6 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:51.614895 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-dd6747f1-4b03-4499-95c3-53def0f213d6 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] [instance: 1d5a909f-c169-415e-a7b7-41835906e801] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:13:51.637004 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dd6747f1-4b03-4499-95c3-53def0f213d6 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:51.641252 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dd6747f1-4b03-4499-95c3-53def0f213d6 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:51.644938 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dd6747f1-4b03-4499-95c3-53def0f213d6 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:51.645413 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dd6747f1-4b03-4499-95c3-53def0f213d6 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:51.999598 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-dd6747f1-4b03-4499-95c3-53def0f213d6 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95896f2064e34e5d82e9531e68aab170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2366e681931c49118c1120350487bde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:13:52.012710 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-dd6747f1-4b03-4499-95c3-53def0f213d6 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] 10.222.0.17 "GET /compute/v2.1/servers/1d5a909f-c169-415e-a7b7-41835906e801" status: 200 len: 1339 microversion: 2.1 time: 0.404578 Jul 23 21:13:52.013379 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 73/146] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:13:51 2022] GET /compute/v2.1/servers/1d5a909f-c169-415e-a7b7-41835906e801 => generated 1339 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:13:52.028125 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-82b58f45-301c-4463-abb1-d0d7b3ba8365 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:52.028733 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-82b58f45-301c-4463-abb1-d0d7b3ba8365 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] [instance: 5b41dd2d-cb23-4e57-91fc-1593508dc8cb] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:13:52.040761 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-82b58f45-301c-4463-abb1-d0d7b3ba8365 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:52.041214 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-82b58f45-301c-4463-abb1-d0d7b3ba8365 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:52.042043 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-82b58f45-301c-4463-abb1-d0d7b3ba8365 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:52.042483 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-82b58f45-301c-4463-abb1-d0d7b3ba8365 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:52.075198 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-6709099e-c9ef-413e-b4d3-41b3f20c03fa req-e964fdda-ba52-4fe9-b2d9-88011fc8aa47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b41dd2d-cb23-4e57-91fc-1593508dc8cb", "name": "network-vif-plugged", "status": "completed", "tag": "05cc0f3e-8617-4864-a70b-b1981f569521"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:13:52.094203 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-6709099e-c9ef-413e-b4d3-41b3f20c03fa req-e964fdda-ba52-4fe9-b2d9-88011fc8aa47 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:52.095430 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-6709099e-c9ef-413e-b4d3-41b3f20c03fa req-e964fdda-ba52-4fe9-b2d9-88011fc8aa47 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:52.298147 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-6709099e-c9ef-413e-b4d3-41b3f20c03fa req-e964fdda-ba52-4fe9-b2d9-88011fc8aa47 service nova] Creating event network-vif-plugged:05cc0f3e-8617-4864-a70b-b1981f569521 for instance 5b41dd2d-cb23-4e57-91fc-1593508dc8cb on nch2-master-1 Jul 23 21:13:52.299564 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-6709099e-c9ef-413e-b4d3-41b3f20c03fa req-e964fdda-ba52-4fe9-b2d9-88011fc8aa47 service nova] Acquired lock "compute-rpcapi-router" {{(pid=131321) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 23 21:13:52.301007 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-46f9afc4-1bc8-41f2-b583-09bc028a136e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:52.301634 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-46f9afc4-1bc8-41f2-b583-09bc028a136e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:52.303542 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-46f9afc4-1bc8-41f2-b583-09bc028a136e None None] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:52.304411 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-46f9afc4-1bc8-41f2-b583-09bc028a136e None None] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:52.317507 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.compute.rpcapi [None req-46f9afc4-1bc8-41f2-b583-09bc028a136e None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 23 21:13:52.319060 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-46f9afc4-1bc8-41f2-b583-09bc028a136e None None] Releasing lock "compute-rpcapi-router" {{(pid=131321) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 23 21:13:52.354094 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-46f9afc4-1bc8-41f2-b583-09bc028a136e None None] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.528918 Jul 23 21:13:52.355504 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 74/147] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:13:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:13:52.512683 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-82b58f45-301c-4463-abb1-d0d7b3ba8365 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199522d29cb746379cb6f75d4b108cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07101aee06ca4bb6885f87cfec3257db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:13:52.530081 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-82b58f45-301c-4463-abb1-d0d7b3ba8365 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] 10.222.0.17 "GET /compute/v2.1/servers/5b41dd2d-cb23-4e57-91fc-1593508dc8cb" status: 200 len: 1342 microversion: 2.1 time: 0.505111 Jul 23 21:13:52.532417 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 74/148] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:13:52 2022] GET /compute/v2.1/servers/5b41dd2d-cb23-4e57-91fc-1593508dc8cb => generated 1342 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:13:53.035944 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b4296479-1f48-475d-999d-dce7e14db215 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:53.040288 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b4296479-1f48-475d-999d-dce7e14db215 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] [instance: 1d5a909f-c169-415e-a7b7-41835906e801] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:13:53.055811 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b4296479-1f48-475d-999d-dce7e14db215 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:53.056688 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b4296479-1f48-475d-999d-dce7e14db215 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:53.058410 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b4296479-1f48-475d-999d-dce7e14db215 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:53.060510 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b4296479-1f48-475d-999d-dce7e14db215 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:53.208020 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-2af36103-8a9d-4bda-a2a5-5348959cad8a tempest-HypervisorAdminTestJSON-456220915 tempest-HypervisorAdminTestJSON-456220915-project-admin] Calling method '.version_select at 0x7f0b54ae5e50>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:53.209682 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:53.209682 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:13:53.211308 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2af36103-8a9d-4bda-a2a5-5348959cad8a tempest-HypervisorAdminTestJSON-456220915 tempest-HypervisorAdminTestJSON-456220915-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:53.211939 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2af36103-8a9d-4bda-a2a5-5348959cad8a tempest-HypervisorAdminTestJSON-456220915 tempest-HypervisorAdminTestJSON-456220915-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:53.254610 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2af36103-8a9d-4bda-a2a5-5348959cad8a tempest-HypervisorAdminTestJSON-456220915 tempest-HypervisorAdminTestJSON-456220915-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:53.255416 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2af36103-8a9d-4bda-a2a5-5348959cad8a tempest-HypervisorAdminTestJSON-456220915 tempest-HypervisorAdminTestJSON-456220915-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:53.278768 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2af36103-8a9d-4bda-a2a5-5348959cad8a tempest-HypervisorAdminTestJSON-456220915 tempest-HypervisorAdminTestJSON-456220915-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:53.279594 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2af36103-8a9d-4bda-a2a5-5348959cad8a tempest-HypervisorAdminTestJSON-456220915 tempest-HypervisorAdminTestJSON-456220915-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:53.292515 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-2af36103-8a9d-4bda-a2a5-5348959cad8a tempest-HypervisorAdminTestJSON-456220915 tempest-HypervisorAdminTestJSON-456220915-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.469641 Jul 23 21:13:53.296144 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 75/149] 10.222.0.17 () {58 vars in 1145 bytes} [Sat Jul 23 21:13:52 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:13:53.306566 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-9c7891ef-2631-4b7d-a9b1-32e071bbfa5e tempest-HypervisorAdminTestJSON-456220915 tempest-HypervisorAdminTestJSON-456220915-project-admin] Calling method '.version_select at 0x7f0b54ae5f70>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:53.307408 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:53.307408 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:13:53.308623 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9c7891ef-2631-4b7d-a9b1-32e071bbfa5e tempest-HypervisorAdminTestJSON-456220915 tempest-HypervisorAdminTestJSON-456220915-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:53.312766 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9c7891ef-2631-4b7d-a9b1-32e071bbfa5e tempest-HypervisorAdminTestJSON-456220915 tempest-HypervisorAdminTestJSON-456220915-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:53.344735 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b4296479-1f48-475d-999d-dce7e14db215 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95896f2064e34e5d82e9531e68aab170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2366e681931c49118c1120350487bde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:13:53.354427 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b4296479-1f48-475d-999d-dce7e14db215 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] 10.222.0.17 "GET /compute/v2.1/servers/1d5a909f-c169-415e-a7b7-41835906e801" status: 200 len: 1339 microversion: 2.1 time: 0.328029 Jul 23 21:13:53.354962 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 75/150] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:13:53 2022] GET /compute/v2.1/servers/1d5a909f-c169-415e-a7b7-41835906e801 => generated 1339 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:13:53.371811 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9c7891ef-2631-4b7d-a9b1-32e071bbfa5e tempest-HypervisorAdminTestJSON-456220915 tempest-HypervisorAdminTestJSON-456220915-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:53.372278 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9c7891ef-2631-4b7d-a9b1-32e071bbfa5e tempest-HypervisorAdminTestJSON-456220915 tempest-HypervisorAdminTestJSON-456220915-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:53.394421 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9c7891ef-2631-4b7d-a9b1-32e071bbfa5e tempest-HypervisorAdminTestJSON-456220915 tempest-HypervisorAdminTestJSON-456220915-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:53.394888 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9c7891ef-2631-4b7d-a9b1-32e071bbfa5e tempest-HypervisorAdminTestJSON-456220915 tempest-HypervisorAdminTestJSON-456220915-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:53.402686 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-9c7891ef-2631-4b7d-a9b1-32e071bbfa5e tempest-HypervisorAdminTestJSON-456220915 tempest-HypervisorAdminTestJSON-456220915-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1504 microversion: 2.1 time: 0.099754 Jul 23 21:13:53.403958 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 76/151] 10.222.0.17 () {58 vars in 1166 bytes} [Sat Jul 23 21:13:53 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1504 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:13:53.417810 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-bf3c213f-617f-4ef7-aa8f-c633d806f07a tempest-HypervisorAdminTestJSON-456220915 tempest-HypervisorAdminTestJSON-456220915-project-admin] Calling method '.version_select at 0x7f0b54afe1f0>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:53.418742 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:53.418742 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:13:53.419910 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bf3c213f-617f-4ef7-aa8f-c633d806f07a tempest-HypervisorAdminTestJSON-456220915 tempest-HypervisorAdminTestJSON-456220915-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:53.420565 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bf3c213f-617f-4ef7-aa8f-c633d806f07a tempest-HypervisorAdminTestJSON-456220915 tempest-HypervisorAdminTestJSON-456220915-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:53.449393 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bf3c213f-617f-4ef7-aa8f-c633d806f07a tempest-HypervisorAdminTestJSON-456220915 tempest-HypervisorAdminTestJSON-456220915-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:53.449835 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bf3c213f-617f-4ef7-aa8f-c633d806f07a tempest-HypervisorAdminTestJSON-456220915 tempest-HypervisorAdminTestJSON-456220915-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:53.479700 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bf3c213f-617f-4ef7-aa8f-c633d806f07a tempest-HypervisorAdminTestJSON-456220915 tempest-HypervisorAdminTestJSON-456220915-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:53.482082 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bf3c213f-617f-4ef7-aa8f-c633d806f07a tempest-HypervisorAdminTestJSON-456220915 tempest-HypervisorAdminTestJSON-456220915-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:53.501849 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-bf3c213f-617f-4ef7-aa8f-c633d806f07a tempest-HypervisorAdminTestJSON-456220915 tempest-HypervisorAdminTestJSON-456220915-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.087577 Jul 23 21:13:53.507563 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 76/152] 10.222.0.17 () {58 vars in 1145 bytes} [Sat Jul 23 21:13:53 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:13:53.512354 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-1e5fcd85-6ea8-4253-9568-a22337e418ae tempest-HypervisorAdminTestJSON-456220915 tempest-HypervisorAdminTestJSON-456220915-project-admin] Calling method '.version_select at 0x7f0b54d4edc0>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:53.513187 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:53.513187 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:13:53.514443 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1e5fcd85-6ea8-4253-9568-a22337e418ae tempest-HypervisorAdminTestJSON-456220915 tempest-HypervisorAdminTestJSON-456220915-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:53.514894 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1e5fcd85-6ea8-4253-9568-a22337e418ae tempest-HypervisorAdminTestJSON-456220915 tempest-HypervisorAdminTestJSON-456220915-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:53.548854 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-93679f5c-43b4-4482-ae39-c632970f11df tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:53.550124 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-93679f5c-43b4-4482-ae39-c632970f11df tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] [instance: 5b41dd2d-cb23-4e57-91fc-1593508dc8cb] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:13:53.555864 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1e5fcd85-6ea8-4253-9568-a22337e418ae tempest-HypervisorAdminTestJSON-456220915 tempest-HypervisorAdminTestJSON-456220915-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:53.557739 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1e5fcd85-6ea8-4253-9568-a22337e418ae tempest-HypervisorAdminTestJSON-456220915 tempest-HypervisorAdminTestJSON-456220915-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:53.561103 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-93679f5c-43b4-4482-ae39-c632970f11df tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:53.561570 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-93679f5c-43b4-4482-ae39-c632970f11df tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:53.562387 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-93679f5c-43b4-4482-ae39-c632970f11df tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:53.562827 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-93679f5c-43b4-4482-ae39-c632970f11df tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:53.575345 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-1e5fcd85-6ea8-4253-9568-a22337e418ae tempest-HypervisorAdminTestJSON-456220915 tempest-HypervisorAdminTestJSON-456220915-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.066721 Jul 23 21:13:53.580215 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 77/153] 10.222.0.17 () {58 vars in 1151 bytes} [Sat Jul 23 21:13:53 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:13:53.589883 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-bfd5c0dd-8c08-4263-938a-c303a0315837 tempest-HypervisorAdminTestJSON-456220915 tempest-HypervisorAdminTestJSON-456220915-project-admin] Calling method '.version_select at 0x7f0b54ae5a60>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:53.593382 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:53.593382 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:13:53.596618 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bfd5c0dd-8c08-4263-938a-c303a0315837 tempest-HypervisorAdminTestJSON-456220915 tempest-HypervisorAdminTestJSON-456220915-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:53.598289 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bfd5c0dd-8c08-4263-938a-c303a0315837 tempest-HypervisorAdminTestJSON-456220915 tempest-HypervisorAdminTestJSON-456220915-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:53.645578 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-bfd5c0dd-8c08-4263-938a-c303a0315837 tempest-HypervisorAdminTestJSON-456220915 tempest-HypervisorAdminTestJSON-456220915-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.059466 Jul 23 21:13:53.652613 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 78/154] 10.222.0.17 () {58 vars in 1178 bytes} [Sat Jul 23 21:13:53 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:13:53.663192 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-798149db-2045-41b2-8ba2-f06a5e6d6d8e tempest-HypervisorAdminTestJSON-456220915 tempest-HypervisorAdminTestJSON-456220915-project-admin] Calling method '.version_select at 0x7f0b54b16e50>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:53.666326 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:53.666326 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:13:53.670969 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-798149db-2045-41b2-8ba2-f06a5e6d6d8e tempest-HypervisorAdminTestJSON-456220915 tempest-HypervisorAdminTestJSON-456220915-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:53.671437 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-798149db-2045-41b2-8ba2-f06a5e6d6d8e tempest-HypervisorAdminTestJSON-456220915 tempest-HypervisorAdminTestJSON-456220915-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:53.704350 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-798149db-2045-41b2-8ba2-f06a5e6d6d8e tempest-HypervisorAdminTestJSON-456220915 tempest-HypervisorAdminTestJSON-456220915-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:53.709946 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-798149db-2045-41b2-8ba2-f06a5e6d6d8e tempest-HypervisorAdminTestJSON-456220915 tempest-HypervisorAdminTestJSON-456220915-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:53.739211 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-798149db-2045-41b2-8ba2-f06a5e6d6d8e tempest-HypervisorAdminTestJSON-456220915 tempest-HypervisorAdminTestJSON-456220915-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:53.742497 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-798149db-2045-41b2-8ba2-f06a5e6d6d8e tempest-HypervisorAdminTestJSON-456220915 tempest-HypervisorAdminTestJSON-456220915-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:53.761242 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-798149db-2045-41b2-8ba2-f06a5e6d6d8e tempest-HypervisorAdminTestJSON-456220915 tempest-HypervisorAdminTestJSON-456220915-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.100344 Jul 23 21:13:53.763769 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 79/155] 10.222.0.17 () {58 vars in 1145 bytes} [Sat Jul 23 21:13:53 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:13:53.775147 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-efbbdc08-8091-4fa0-9b91-b35b9a342fa7 tempest-HypervisorAdminTestJSON-456220915 tempest-HypervisorAdminTestJSON-456220915-project-admin] Calling method '.version_select at 0x7f0b56a761f0>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:53.781200 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:53.781200 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:13:53.783847 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-efbbdc08-8091-4fa0-9b91-b35b9a342fa7 tempest-HypervisorAdminTestJSON-456220915 tempest-HypervisorAdminTestJSON-456220915-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:53.784571 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-efbbdc08-8091-4fa0-9b91-b35b9a342fa7 tempest-HypervisorAdminTestJSON-456220915 tempest-HypervisorAdminTestJSON-456220915-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:53.809844 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-93679f5c-43b4-4482-ae39-c632970f11df tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199522d29cb746379cb6f75d4b108cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07101aee06ca4bb6885f87cfec3257db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:13:53.815419 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-efbbdc08-8091-4fa0-9b91-b35b9a342fa7 tempest-HypervisorAdminTestJSON-456220915 tempest-HypervisorAdminTestJSON-456220915-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:53.816205 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-efbbdc08-8091-4fa0-9b91-b35b9a342fa7 tempest-HypervisorAdminTestJSON-456220915 tempest-HypervisorAdminTestJSON-456220915-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:53.820182 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-93679f5c-43b4-4482-ae39-c632970f11df tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] 10.222.0.17 "GET /compute/v2.1/servers/5b41dd2d-cb23-4e57-91fc-1593508dc8cb" status: 200 len: 1342 microversion: 2.1 time: 0.275412 Jul 23 21:13:53.823898 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-efbbdc08-8091-4fa0-9b91-b35b9a342fa7 tempest-HypervisorAdminTestJSON-456220915 tempest-HypervisorAdminTestJSON-456220915-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.054843 Jul 23 21:13:53.829673 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 80/156] 10.222.0.17 () {58 vars in 1151 bytes} [Sat Jul 23 21:13:53 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:13:53.835974 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 77/157] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:13:53 2022] GET /compute/v2.1/servers/5b41dd2d-cb23-4e57-91fc-1593508dc8cb => generated 1342 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:13:53.837199 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-6e4f38fe-c2ed-4895-9a07-8c7169f9a4ab tempest-HypervisorAdminTestJSON-456220915 tempest-HypervisorAdminTestJSON-456220915-project-admin] Calling method '.version_select at 0x7f0b54ae5af0>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:53.838150 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:53.838150 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:13:53.840156 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6e4f38fe-c2ed-4895-9a07-8c7169f9a4ab tempest-HypervisorAdminTestJSON-456220915 tempest-HypervisorAdminTestJSON-456220915-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:53.840798 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6e4f38fe-c2ed-4895-9a07-8c7169f9a4ab tempest-HypervisorAdminTestJSON-456220915 tempest-HypervisorAdminTestJSON-456220915-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:53.860949 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6e4f38fe-c2ed-4895-9a07-8c7169f9a4ab tempest-HypervisorAdminTestJSON-456220915 tempest-HypervisorAdminTestJSON-456220915-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:53.861763 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6e4f38fe-c2ed-4895-9a07-8c7169f9a4ab tempest-HypervisorAdminTestJSON-456220915 tempest-HypervisorAdminTestJSON-456220915-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:53.879603 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-6e4f38fe-c2ed-4895-9a07-8c7169f9a4ab tempest-HypervisorAdminTestJSON-456220915 tempest-HypervisorAdminTestJSON-456220915-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 757 microversion: 2.1 time: 0.046667 Jul 23 21:13:53.880667 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 81/158] 10.222.0.17 () {58 vars in 1151 bytes} [Sat Jul 23 21:13:53 2022] GET /compute/v2.1/os-hypervisors/2 => generated 757 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:13:53.894097 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e93254b6-61bb-4009-a944-d48a1f248490 tempest-HypervisorAdminTestJSON-456220915 tempest-HypervisorAdminTestJSON-456220915-project-admin] Calling method '.version_select at 0x7f0b54c0f310>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:53.895366 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:53.895366 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:13:53.896820 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e93254b6-61bb-4009-a944-d48a1f248490 tempest-HypervisorAdminTestJSON-456220915 tempest-HypervisorAdminTestJSON-456220915-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:53.897621 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e93254b6-61bb-4009-a944-d48a1f248490 tempest-HypervisorAdminTestJSON-456220915 tempest-HypervisorAdminTestJSON-456220915-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:53.924395 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e93254b6-61bb-4009-a944-d48a1f248490 tempest-HypervisorAdminTestJSON-456220915 tempest-HypervisorAdminTestJSON-456220915-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:53.925418 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e93254b6-61bb-4009-a944-d48a1f248490 tempest-HypervisorAdminTestJSON-456220915 tempest-HypervisorAdminTestJSON-456220915-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:53.940730 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e93254b6-61bb-4009-a944-d48a1f248490 tempest-HypervisorAdminTestJSON-456220915 tempest-HypervisorAdminTestJSON-456220915-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:53.941592 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e93254b6-61bb-4009-a944-d48a1f248490 tempest-HypervisorAdminTestJSON-456220915 tempest-HypervisorAdminTestJSON-456220915-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:53.992686 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e93254b6-61bb-4009-a944-d48a1f248490 tempest-HypervisorAdminTestJSON-456220915 tempest-HypervisorAdminTestJSON-456220915-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.103458 Jul 23 21:13:53.993655 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 78/159] 10.222.0.17 () {58 vars in 1172 bytes} [Sat Jul 23 21:13:53 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:13:54.373133 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-10c1f38d-24fe-4a37-9f5c-4958bee4fe1b tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:54.374594 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-10c1f38d-24fe-4a37-9f5c-4958bee4fe1b tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] [instance: 1d5a909f-c169-415e-a7b7-41835906e801] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:13:54.390416 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-10c1f38d-24fe-4a37-9f5c-4958bee4fe1b tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:54.391515 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-10c1f38d-24fe-4a37-9f5c-4958bee4fe1b tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:54.393527 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-10c1f38d-24fe-4a37-9f5c-4958bee4fe1b tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:54.394373 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-10c1f38d-24fe-4a37-9f5c-4958bee4fe1b tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:54.719183 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-10c1f38d-24fe-4a37-9f5c-4958bee4fe1b tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95896f2064e34e5d82e9531e68aab170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2366e681931c49118c1120350487bde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:13:54.733572 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-10c1f38d-24fe-4a37-9f5c-4958bee4fe1b tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] 10.222.0.17 "GET /compute/v2.1/servers/1d5a909f-c169-415e-a7b7-41835906e801" status: 200 len: 1339 microversion: 2.1 time: 0.363433 Jul 23 21:13:54.734667 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 82/160] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:13:54 2022] GET /compute/v2.1/servers/1d5a909f-c169-415e-a7b7-41835906e801 => generated 1339 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:13:54.854060 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-7c4c0013-9cf7-40d8-8845-c49e093b5432 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:54.855298 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-7c4c0013-9cf7-40d8-8845-c49e093b5432 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] [instance: 5b41dd2d-cb23-4e57-91fc-1593508dc8cb] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:13:54.866530 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7c4c0013-9cf7-40d8-8845-c49e093b5432 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:54.870117 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7c4c0013-9cf7-40d8-8845-c49e093b5432 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:54.871215 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7c4c0013-9cf7-40d8-8845-c49e093b5432 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:54.872918 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7c4c0013-9cf7-40d8-8845-c49e093b5432 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:54.931845 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f4475574-dec0-46b4-9042-bce7534ee89b tempest-InstanceUsageAuditLogTestJSON-157472141 tempest-InstanceUsageAuditLogTestJSON-157472141-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:54.932777 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:54.932777 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:13:55.028287 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f4475574-dec0-46b4-9042-bce7534ee89b tempest-InstanceUsageAuditLogTestJSON-157472141 tempest-InstanceUsageAuditLogTestJSON-157472141-project-admin] 10.222.0.17 "GET /compute/v2.1/os-instance_usage_audit_log/2022-07-23 21:13:54" status: 200 len: 318 microversion: 2.1 time: 0.478952 Jul 23 21:13:55.031038 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 79/161] 10.222.0.17 () {58 vars in 1250 bytes} [Sat Jul 23 21:13:54 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-07-23%2021%3A13%3A54 => generated 318 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:13:55.043307 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-fb6c03bc-378d-4b78-a9d6-98a3b29315ea tempest-InstanceUsageAuditLogTestJSON-157472141 tempest-InstanceUsageAuditLogTestJSON-157472141-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:55.044093 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:55.044093 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:13:55.070214 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-fb6c03bc-378d-4b78-a9d6-98a3b29315ea tempest-InstanceUsageAuditLogTestJSON-157472141 tempest-InstanceUsageAuditLogTestJSON-157472141-project-admin] 10.222.0.17 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.031823 Jul 23 21:13:55.072758 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 80/162] 10.222.0.17 () {58 vars in 1184 bytes} [Sat Jul 23 21:13:55 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:13:55.524272 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-7c4c0013-9cf7-40d8-8845-c49e093b5432 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199522d29cb746379cb6f75d4b108cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07101aee06ca4bb6885f87cfec3257db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:13:55.547205 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-7c4c0013-9cf7-40d8-8845-c49e093b5432 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] 10.222.0.17 "GET /compute/v2.1/servers/5b41dd2d-cb23-4e57-91fc-1593508dc8cb" status: 200 len: 1342 microversion: 2.1 time: 0.695982 Jul 23 21:13:55.551874 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 83/163] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:13:54 2022] GET /compute/v2.1/servers/5b41dd2d-cb23-4e57-91fc-1593508dc8cb => generated 1342 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:13:55.573836 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-55652a26-245b-441e-9a80-8eec25f44114 req-446edd7b-e24f-42ea-91e0-20b41dd06cf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d5a909f-c169-415e-a7b7-41835906e801", "name": "network-vif-plugged", "status": "completed", "tag": "567ed78e-1fe8-48f0-b345-0f19ade3de9a"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:13:55.592206 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-55652a26-245b-441e-9a80-8eec25f44114 req-446edd7b-e24f-42ea-91e0-20b41dd06cf0 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:55.592647 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-55652a26-245b-441e-9a80-8eec25f44114 req-446edd7b-e24f-42ea-91e0-20b41dd06cf0 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:55.620710 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-55652a26-245b-441e-9a80-8eec25f44114 req-446edd7b-e24f-42ea-91e0-20b41dd06cf0 service nova] Creating event network-vif-plugged:567ed78e-1fe8-48f0-b345-0f19ade3de9a for instance 1d5a909f-c169-415e-a7b7-41835906e801 on nch2-master-1 Jul 23 21:13:55.634426 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-55652a26-245b-441e-9a80-8eec25f44114 req-446edd7b-e24f-42ea-91e0-20b41dd06cf0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080609 Jul 23 21:13:55.637813 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 84/164] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:13:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:13:55.754800 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-968c3cc2-9bc9-4ac6-8cbd-b5d75cd15134 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:55.755804 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-968c3cc2-9bc9-4ac6-8cbd-b5d75cd15134 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] [instance: 1d5a909f-c169-415e-a7b7-41835906e801] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:13:55.776738 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-968c3cc2-9bc9-4ac6-8cbd-b5d75cd15134 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:55.778497 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-968c3cc2-9bc9-4ac6-8cbd-b5d75cd15134 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:55.781041 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-968c3cc2-9bc9-4ac6-8cbd-b5d75cd15134 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:55.782534 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-968c3cc2-9bc9-4ac6-8cbd-b5d75cd15134 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:55.831957 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2346eb4d-6776-40fd-a760-ce342e27d5b7 tempest-AZAdminNegativeTestJSON-1996287597 tempest-AZAdminNegativeTestJSON-1996287597-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:55.834466 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:13:55.834466 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:13:55.837756 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-2346eb4d-6776-40fd-a760-ce342e27d5b7 tempest-AZAdminNegativeTestJSON-1996287597 tempest-AZAdminNegativeTestJSON-1996287597-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': 'c02f293f8cb04a2197ceb22728e717cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba16f1a6764344a1b32d2b3bc85fdfe2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:13:55.845116 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2346eb4d-6776-40fd-a760-ce342e27d5b7 tempest-AZAdminNegativeTestJSON-1996287597 tempest-AZAdminNegativeTestJSON-1996287597-project] Request method failure captured: Jul 23 21:13:55.845116 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Jul 23 21:13:55.845116 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:13:55.845116 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:13:55.845116 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:13:55.845116 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:13:55.845116 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:13:55.845116 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:13:55.845116 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:13:55.845116 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:13:55.845116 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GSRgQEd8y4h5lJ2fafoN3X8LBFoC33PUMQNPG10dXi74_FrnhJlL0C5fiO5W2joPwQ87gYUxWRbVQNcbkdIKxZ4HQRDMyOxsNsfEDPdK0c057PT_ByAo_67kSUdSSvB2_VXu1YNPWmDMuCemJQ3SOcStgdCN2dmhNpqEw0HU66i-30 Jul 23 21:13:55.845116 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:13:55.845116 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:13:55.845116 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:13:55.845116 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:13:55.845116 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:13:55.845116 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:13:55.845116 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: ba16f1a6764344a1b32d2b3bc85fdfe2 Jul 23 21:13:55.845116 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-AZAdminNegativeTestJSON-1996287597 Jul 23 21:13:55.845116 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:13:55.845116 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:13:55.846634 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ba16f1a6764344a1b32d2b3bc85fdfe2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ba16f1a6764344a1b32d2b3bc85fdfe2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ba16f1a6764344a1b32d2b3bc85fdfe2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ba16f1a6764344a1b32d2b3bc85fdfe2"}]}] Jul 23 21:13:55.846634 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-AZAdminNegativeTestJSON-1996287597 Jul 23 21:13:55.846634 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: ba16f1a6764344a1b32d2b3bc85fdfe2 Jul 23 21:13:55.846634 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-1996287597 Jul 23 21:13:55.846634 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-AZAdminNegativeTestJSON-1996287597-project Jul 23 21:13:55.846634 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:13:55.846634 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:13:55.846634 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: c02f293f8cb04a2197ceb22728e717cb Jul 23 21:13:55.846634 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-AZAdminNegativeTestJSON-1996287597-project Jul 23 21:13:55.846634 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:13:55.846634 ncdv-master-1 devstack@n-api.service[131320]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jul 23 21:13:55.846634 ncdv-master-1 devstack@n-api.service[131320]: action_args: {} Jul 23 21:13:55.847488 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:13:55.847488 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:13:55.847488 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:13:55.847488 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:13:55.847488 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:13:55.847488 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:13:55.847488 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:13:55.847488 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:13:55.847488 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Jul 23 21:13:55.847488 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Jul 23 21:13:55.847488 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 23 21:13:55.847488 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 23 21:13:55.847488 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 23 21:13:55.847488 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 23 21:13:55.847488 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 23 21:13:55.847488 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 23 21:13:55.847488 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 23 21:13:55.847488 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise self.value Jul 23 21:13:55.847488 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 23 21:13:55.848659 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 23 21:13:55.848659 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 23 21:13:55.848659 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 23 21:13:55.848659 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 23 21:13:55.848659 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 23 21:13:55.848659 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jul 23 21:13:55.848659 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:13:55.848659 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:13:55.848659 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:13:55.848659 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:13:55.848659 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:13:55.848659 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:13:55.848659 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 23 21:13:55.848659 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 23 21:13:55.848659 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jul 23 21:13:55.848659 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:13:55.850114 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2346eb4d-6776-40fd-a760-ce342e27d5b7 tempest-AZAdminNegativeTestJSON-1996287597 tempest-AZAdminNegativeTestJSON-1996287597-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:13:55.858409 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2346eb4d-6776-40fd-a760-ce342e27d5b7 tempest-AZAdminNegativeTestJSON-1996287597 tempest-AZAdminNegativeTestJSON-1996287597-project] 10.222.0.17 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.618322 Jul 23 21:13:55.862524 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 81/165] 10.222.0.17 () {58 vars in 1184 bytes} [Sat Jul 23 21:13:55 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 624 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jul 23 21:13:56.085422 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-968c3cc2-9bc9-4ac6-8cbd-b5d75cd15134 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95896f2064e34e5d82e9531e68aab170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2366e681931c49118c1120350487bde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:13:56.094968 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-968c3cc2-9bc9-4ac6-8cbd-b5d75cd15134 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] 10.222.0.17 "GET /compute/v2.1/servers/1d5a909f-c169-415e-a7b7-41835906e801" status: 200 len: 1339 microversion: 2.1 time: 0.346357 Jul 23 21:13:56.096249 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 85/166] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:13:55 2022] GET /compute/v2.1/servers/1d5a909f-c169-415e-a7b7-41835906e801 => generated 1339 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:13:56.577604 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d217abb4-82ff-49f7-b41b-ba24d874bb31 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:56.579921 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d217abb4-82ff-49f7-b41b-ba24d874bb31 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] [instance: 5b41dd2d-cb23-4e57-91fc-1593508dc8cb] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:13:56.598195 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d217abb4-82ff-49f7-b41b-ba24d874bb31 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:56.598667 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d217abb4-82ff-49f7-b41b-ba24d874bb31 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:56.599908 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d217abb4-82ff-49f7-b41b-ba24d874bb31 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:56.602060 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d217abb4-82ff-49f7-b41b-ba24d874bb31 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:56.916891 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d217abb4-82ff-49f7-b41b-ba24d874bb31 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199522d29cb746379cb6f75d4b108cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07101aee06ca4bb6885f87cfec3257db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:13:56.929435 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d217abb4-82ff-49f7-b41b-ba24d874bb31 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] 10.222.0.17 "GET /compute/v2.1/servers/5b41dd2d-cb23-4e57-91fc-1593508dc8cb" status: 200 len: 1492 microversion: 2.1 time: 0.367077 Jul 23 21:13:56.930024 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 82/167] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:13:56 2022] GET /compute/v2.1/servers/5b41dd2d-cb23-4e57-91fc-1593508dc8cb => generated 1492 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:13:57.112950 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f765e14e-862e-49ef-a96c-a011dfce8fba tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:57.114091 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f765e14e-862e-49ef-a96c-a011dfce8fba tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] [instance: 1d5a909f-c169-415e-a7b7-41835906e801] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:13:57.122126 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f765e14e-862e-49ef-a96c-a011dfce8fba tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:57.123040 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f765e14e-862e-49ef-a96c-a011dfce8fba tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:57.124729 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f765e14e-862e-49ef-a96c-a011dfce8fba tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:57.128063 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f765e14e-862e-49ef-a96c-a011dfce8fba tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:57.387237 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f765e14e-862e-49ef-a96c-a011dfce8fba tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95896f2064e34e5d82e9531e68aab170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2366e681931c49118c1120350487bde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:13:57.397681 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f765e14e-862e-49ef-a96c-a011dfce8fba tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] 10.222.0.17 "GET /compute/v2.1/servers/1d5a909f-c169-415e-a7b7-41835906e801" status: 200 len: 1339 microversion: 2.1 time: 0.289308 Jul 23 21:13:57.399009 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 83/168] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:13:57 2022] GET /compute/v2.1/servers/1d5a909f-c169-415e-a7b7-41835906e801 => generated 1339 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:13:57.585847 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-646182f9-d5bc-4a97-9d61-2fb6d5beea63 tempest-DeleteServersAdminTestJSON-517104125 tempest-DeleteServersAdminTestJSON-517104125-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:57.586667 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-646182f9-d5bc-4a97-9d61-2fb6d5beea63 tempest-DeleteServersAdminTestJSON-517104125 tempest-DeleteServersAdminTestJSON-517104125-project-admin] [instance: 5b41dd2d-cb23-4e57-91fc-1593508dc8cb] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:13:57.595172 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-646182f9-d5bc-4a97-9d61-2fb6d5beea63 tempest-DeleteServersAdminTestJSON-517104125 tempest-DeleteServersAdminTestJSON-517104125-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:57.595605 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-646182f9-d5bc-4a97-9d61-2fb6d5beea63 tempest-DeleteServersAdminTestJSON-517104125 tempest-DeleteServersAdminTestJSON-517104125-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:57.596391 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-646182f9-d5bc-4a97-9d61-2fb6d5beea63 tempest-DeleteServersAdminTestJSON-517104125 tempest-DeleteServersAdminTestJSON-517104125-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:57.596840 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-646182f9-d5bc-4a97-9d61-2fb6d5beea63 tempest-DeleteServersAdminTestJSON-517104125 tempest-DeleteServersAdminTestJSON-517104125-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:57.684872 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-646182f9-d5bc-4a97-9d61-2fb6d5beea63 tempest-DeleteServersAdminTestJSON-517104125 tempest-DeleteServersAdminTestJSON-517104125-project-admin] [instance: 5b41dd2d-cb23-4e57-91fc-1593508dc8cb] Going to try to terminate instance {{(pid=131321) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:13:57.872876 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-646182f9-d5bc-4a97-9d61-2fb6d5beea63 tempest-DeleteServersAdminTestJSON-517104125 tempest-DeleteServersAdminTestJSON-517104125-project-admin] 10.222.0.17 "DELETE /compute/v2.1/servers/5b41dd2d-cb23-4e57-91fc-1593508dc8cb" status: 204 len: 0 microversion: 2.1 time: 0.926515 Jul 23 21:13:57.873758 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 86/169] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:13:56 2022] DELETE /compute/v2.1/servers/5b41dd2d-cb23-4e57-91fc-1593508dc8cb => generated 0 bytes in 929 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:13:57.882199 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4ce7c194-582a-41e0-a224-a2f3e7c7a8cd tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:57.882985 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-4ce7c194-582a-41e0-a224-a2f3e7c7a8cd tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] [instance: 5b41dd2d-cb23-4e57-91fc-1593508dc8cb] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:13:57.889440 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4ce7c194-582a-41e0-a224-a2f3e7c7a8cd tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:57.890223 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4ce7c194-582a-41e0-a224-a2f3e7c7a8cd tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:57.891249 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4ce7c194-582a-41e0-a224-a2f3e7c7a8cd tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:57.891993 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4ce7c194-582a-41e0-a224-a2f3e7c7a8cd tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:58.084468 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-4ce7c194-582a-41e0-a224-a2f3e7c7a8cd tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199522d29cb746379cb6f75d4b108cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07101aee06ca4bb6885f87cfec3257db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:13:58.092947 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4ce7c194-582a-41e0-a224-a2f3e7c7a8cd tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] 10.222.0.17 "GET /compute/v2.1/servers/5b41dd2d-cb23-4e57-91fc-1593508dc8cb" status: 200 len: 1498 microversion: 2.1 time: 0.214500 Jul 23 21:13:58.093997 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 84/170] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:13:57 2022] GET /compute/v2.1/servers/5b41dd2d-cb23-4e57-91fc-1593508dc8cb => generated 1498 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:13:58.415893 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-8c0909c4-66ae-4d1c-8cba-dbb1e2d330a0 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:58.416592 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-8c0909c4-66ae-4d1c-8cba-dbb1e2d330a0 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] [instance: 1d5a909f-c169-415e-a7b7-41835906e801] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:13:58.433061 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8c0909c4-66ae-4d1c-8cba-dbb1e2d330a0 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:58.435771 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8c0909c4-66ae-4d1c-8cba-dbb1e2d330a0 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:58.439668 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8c0909c4-66ae-4d1c-8cba-dbb1e2d330a0 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:58.441493 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8c0909c4-66ae-4d1c-8cba-dbb1e2d330a0 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:58.902021 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-8c0909c4-66ae-4d1c-8cba-dbb1e2d330a0 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95896f2064e34e5d82e9531e68aab170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2366e681931c49118c1120350487bde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:13:58.916722 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-8c0909c4-66ae-4d1c-8cba-dbb1e2d330a0 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] 10.222.0.17 "GET /compute/v2.1/servers/1d5a909f-c169-415e-a7b7-41835906e801" status: 200 len: 1489 microversion: 2.1 time: 0.505577 Jul 23 21:13:58.917341 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 87/171] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:13:58 2022] GET /compute/v2.1/servers/1d5a909f-c169-415e-a7b7-41835906e801 => generated 1489 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:13:58.936239 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-36ec53c2-6e54-437d-9a21-bf4b71e9ce51 tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:58.941921 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-36ec53c2-6e54-437d-9a21-bf4b71e9ce51 tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] [instance: 1d5a909f-c169-415e-a7b7-41835906e801] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:13:58.954735 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-36ec53c2-6e54-437d-9a21-bf4b71e9ce51 tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:58.955189 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-36ec53c2-6e54-437d-9a21-bf4b71e9ce51 tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:58.955976 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-36ec53c2-6e54-437d-9a21-bf4b71e9ce51 tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:58.956415 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-36ec53c2-6e54-437d-9a21-bf4b71e9ce51 tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:59.112424 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-5d487464-5f1f-4d5b-b78a-454035ba6c47 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:59.113157 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-5d487464-5f1f-4d5b-b78a-454035ba6c47 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] [instance: 5b41dd2d-cb23-4e57-91fc-1593508dc8cb] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:13:59.142189 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5d487464-5f1f-4d5b-b78a-454035ba6c47 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:59.143426 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5d487464-5f1f-4d5b-b78a-454035ba6c47 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:59.146780 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5d487464-5f1f-4d5b-b78a-454035ba6c47 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:59.148943 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5d487464-5f1f-4d5b-b78a-454035ba6c47 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:59.157136 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:13:59.408805 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-5d487464-5f1f-4d5b-b78a-454035ba6c47 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199522d29cb746379cb6f75d4b108cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07101aee06ca4bb6885f87cfec3257db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:13:59.422286 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-5d487464-5f1f-4d5b-b78a-454035ba6c47 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] 10.222.0.17 "GET /compute/v2.1/servers/5b41dd2d-cb23-4e57-91fc-1593508dc8cb" status: 200 len: 1498 microversion: 2.1 time: 0.314531 Jul 23 21:13:59.424686 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 88/172] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:13:59 2022] GET /compute/v2.1/servers/5b41dd2d-cb23-4e57-91fc-1593508dc8cb => generated 1498 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:13:59.801968 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-36ec53c2-6e54-437d-9a21-bf4b71e9ce51 tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/1d5a909f-c169-415e-a7b7-41835906e801" status: 200 len: 1640 microversion: 2.1 time: 0.871973 Jul 23 21:13:59.803304 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 85/173] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:13:58 2022] GET /compute/v2.1/servers/1d5a909f-c169-415e-a7b7-41835906e801 => generated 1640 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:13:59.820593 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c76bf71e-b7ed-4a4b-a9d8-7e08fb6c7d47 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:13:59.821047 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-c76bf71e-b7ed-4a4b-a9d8-7e08fb6c7d47 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] [instance: 1d5a909f-c169-415e-a7b7-41835906e801] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:13:59.840028 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c76bf71e-b7ed-4a4b-a9d8-7e08fb6c7d47 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:59.840535 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c76bf71e-b7ed-4a4b-a9d8-7e08fb6c7d47 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:59.844116 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c76bf71e-b7ed-4a4b-a9d8-7e08fb6c7d47 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:13:59.844573 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c76bf71e-b7ed-4a4b-a9d8-7e08fb6c7d47 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:13:59.922391 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-c76bf71e-b7ed-4a4b-a9d8-7e08fb6c7d47 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] [instance: 1d5a909f-c169-415e-a7b7-41835906e801] Going to try to terminate instance {{(pid=131321) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:14:00.251634 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-c76bf71e-b7ed-4a4b-a9d8-7e08fb6c7d47 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] 10.222.0.17 "DELETE /compute/v2.1/servers/1d5a909f-c169-415e-a7b7-41835906e801" status: 204 len: 0 microversion: 2.1 time: 0.433540 Jul 23 21:14:00.252715 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 89/174] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:13:59 2022] DELETE /compute/v2.1/servers/1d5a909f-c169-415e-a7b7-41835906e801 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:14:00.262963 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-7dc0f7bf-79e8-45e9-8665-b60ccf29cc6a tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:00.263585 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-7dc0f7bf-79e8-45e9-8665-b60ccf29cc6a tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] [instance: 1d5a909f-c169-415e-a7b7-41835906e801] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:14:00.276922 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7dc0f7bf-79e8-45e9-8665-b60ccf29cc6a tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:00.292626 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7dc0f7bf-79e8-45e9-8665-b60ccf29cc6a tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:00.294242 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7dc0f7bf-79e8-45e9-8665-b60ccf29cc6a tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:00.295425 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7dc0f7bf-79e8-45e9-8665-b60ccf29cc6a tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:00.316886 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-3b4690c9-71e6-46ea-ba86-fcad0cc871dc req-2d93fa62-3ce6-491f-beee-de2af8ff925b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b41dd2d-cb23-4e57-91fc-1593508dc8cb", "name": "network-vif-deleted", "tag": "05cc0f3e-8617-4864-a70b-b1981f569521"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:14:00.331813 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-3b4690c9-71e6-46ea-ba86-fcad0cc871dc req-2d93fa62-3ce6-491f-beee-de2af8ff925b service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:00.334596 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-3b4690c9-71e6-46ea-ba86-fcad0cc871dc req-2d93fa62-3ce6-491f-beee-de2af8ff925b service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:00.382786 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-3b4690c9-71e6-46ea-ba86-fcad0cc871dc req-2d93fa62-3ce6-491f-beee-de2af8ff925b service nova] Creating event network-vif-deleted:05cc0f3e-8617-4864-a70b-b1981f569521 for instance 5b41dd2d-cb23-4e57-91fc-1593508dc8cb on nch2-master-1 Jul 23 21:14:00.396788 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-3b4690c9-71e6-46ea-ba86-fcad0cc871dc req-2d93fa62-3ce6-491f-beee-de2af8ff925b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085464 Jul 23 21:14:00.397561 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 90/175] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:14:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:14:00.442501 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-802b1257-31ce-4295-b088-0f8f1ce647ed tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:00.443655 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-802b1257-31ce-4295-b088-0f8f1ce647ed tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] [instance: 5b41dd2d-cb23-4e57-91fc-1593508dc8cb] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:14:00.458346 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-802b1257-31ce-4295-b088-0f8f1ce647ed tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:00.460543 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-802b1257-31ce-4295-b088-0f8f1ce647ed tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:00.462921 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-802b1257-31ce-4295-b088-0f8f1ce647ed tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:00.468171 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-802b1257-31ce-4295-b088-0f8f1ce647ed tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:00.695913 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-7dc0f7bf-79e8-45e9-8665-b60ccf29cc6a tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95896f2064e34e5d82e9531e68aab170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2366e681931c49118c1120350487bde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:00.708223 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-7dc0f7bf-79e8-45e9-8665-b60ccf29cc6a tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] 10.222.0.17 "GET /compute/v2.1/servers/1d5a909f-c169-415e-a7b7-41835906e801" status: 200 len: 1495 microversion: 2.1 time: 0.448261 Jul 23 21:14:00.710368 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-802b1257-31ce-4295-b088-0f8f1ce647ed tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199522d29cb746379cb6f75d4b108cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07101aee06ca4bb6885f87cfec3257db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:00.710606 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 86/176] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:14:00 2022] GET /compute/v2.1/servers/1d5a909f-c169-415e-a7b7-41835906e801 => generated 1495 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:14:00.720045 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-802b1257-31ce-4295-b088-0f8f1ce647ed tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] 10.222.0.17 "GET /compute/v2.1/servers/5b41dd2d-cb23-4e57-91fc-1593508dc8cb" status: 200 len: 1456 microversion: 2.1 time: 0.282636 Jul 23 21:14:00.720678 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 91/177] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:14:00 2022] GET /compute/v2.1/servers/5b41dd2d-cb23-4e57-91fc-1593508dc8cb => generated 1456 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:14:01.773475 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-660d9f87-b3d3-4e77-a5f2-54926b126277 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-681129998", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:14:01.930003 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-660d9f87-b3d3-4e77-a5f2-54926b126277 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] validate_networks() for None {{(pid=131320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:14:01.934152 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-7325c922-b53f-4e2a-be7b-23a822d646e1 tempest-HypervisorAdminV253TestBase-1344885968 tempest-HypervisorAdminV253TestBase-1344885968-project-admin] Calling method '.version_select at 0x7f0b549ef820>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:01.935682 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:01.935682 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:14:01.937003 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7325c922-b53f-4e2a-be7b-23a822d646e1 tempest-HypervisorAdminV253TestBase-1344885968 tempest-HypervisorAdminV253TestBase-1344885968-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:01.937449 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7325c922-b53f-4e2a-be7b-23a822d646e1 tempest-HypervisorAdminV253TestBase-1344885968 tempest-HypervisorAdminV253TestBase-1344885968-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:01.978897 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7325c922-b53f-4e2a-be7b-23a822d646e1 tempest-HypervisorAdminV253TestBase-1344885968 tempest-HypervisorAdminV253TestBase-1344885968-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:01.980932 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7325c922-b53f-4e2a-be7b-23a822d646e1 tempest-HypervisorAdminV253TestBase-1344885968 tempest-HypervisorAdminV253TestBase-1344885968-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:02.080314 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7325c922-b53f-4e2a-be7b-23a822d646e1 tempest-HypervisorAdminV253TestBase-1344885968 tempest-HypervisorAdminV253TestBase-1344885968-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:02.081256 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7325c922-b53f-4e2a-be7b-23a822d646e1 tempest-HypervisorAdminV253TestBase-1344885968 tempest-HypervisorAdminV253TestBase-1344885968-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:02.108828 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7325c922-b53f-4e2a-be7b-23a822d646e1 tempest-HypervisorAdminV253TestBase-1344885968 tempest-HypervisorAdminV253TestBase-1344885968-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:02.111954 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7325c922-b53f-4e2a-be7b-23a822d646e1 tempest-HypervisorAdminV253TestBase-1344885968 tempest-HypervisorAdminV253TestBase-1344885968-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:02.148727 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7325c922-b53f-4e2a-be7b-23a822d646e1 tempest-HypervisorAdminV253TestBase-1344885968 tempest-HypervisorAdminV253TestBase-1344885968-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:02.156899 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7325c922-b53f-4e2a-be7b-23a822d646e1 tempest-HypervisorAdminV253TestBase-1344885968 tempest-HypervisorAdminV253TestBase-1344885968-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:02.170493 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-7325c922-b53f-4e2a-be7b-23a822d646e1 tempest-HypervisorAdminV253TestBase-1344885968 tempest-HypervisorAdminV253TestBase-1344885968-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1743 microversion: 2.53 time: 0.561806 Jul 23 21:14:02.180708 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 92/178] 10.222.0.17 () {60 vars in 1242 bytes} [Sat Jul 23 21:14:01 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1743 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:14:02.187659 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d7fda248-297f-4fcf-9630-17eda388561b tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:02.189151 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-d7fda248-297f-4fcf-9630-17eda388561b tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] [instance: 1d5a909f-c169-415e-a7b7-41835906e801] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:14:02.197387 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d7fda248-297f-4fcf-9630-17eda388561b tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:02.198123 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d7fda248-297f-4fcf-9630-17eda388561b tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:02.199537 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d7fda248-297f-4fcf-9630-17eda388561b tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:02.200302 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d7fda248-297f-4fcf-9630-17eda388561b tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:02.313972 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell0:SELECT=18 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:02.712470 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-d7fda248-297f-4fcf-9630-17eda388561b tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95896f2064e34e5d82e9531e68aab170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2366e681931c49118c1120350487bde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:02.726388 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-d7fda248-297f-4fcf-9630-17eda388561b tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] 10.222.0.17 "GET /compute/v2.1/servers/1d5a909f-c169-415e-a7b7-41835906e801" status: 200 len: 1495 microversion: 2.1 time: 0.544088 Jul 23 21:14:02.726997 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 93/179] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:14:02 2022] GET /compute/v2.1/servers/1d5a909f-c169-415e-a7b7-41835906e801 => generated 1495 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:14:02.740317 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-6f2e221b-c012-4b35-a7cf-213d70ac8fed tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:02.740943 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-6f2e221b-c012-4b35-a7cf-213d70ac8fed tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] [instance: 5b41dd2d-cb23-4e57-91fc-1593508dc8cb] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:14:02.753690 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6f2e221b-c012-4b35-a7cf-213d70ac8fed tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:02.754408 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6f2e221b-c012-4b35-a7cf-213d70ac8fed tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:02.756045 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6f2e221b-c012-4b35-a7cf-213d70ac8fed tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:02.757650 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6f2e221b-c012-4b35-a7cf-213d70ac8fed tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:02.780170 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-6f2e221b-c012-4b35-a7cf-213d70ac8fed tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] HTTP exception thrown: Instance 5b41dd2d-cb23-4e57-91fc-1593508dc8cb could not be found. Jul 23 21:14:02.783101 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-6f2e221b-c012-4b35-a7cf-213d70ac8fed tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Request method failure captured: Jul 23 21:14:02.783101 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/servers/5b41dd2d-cb23-4e57-91fc-1593508dc8cb HTTP/1.1 Jul 23 21:14:02.783101 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:14:02.783101 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:14:02.783101 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:14:02.783101 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:14:02.783101 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:14:02.783101 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:14:02.783101 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:14:02.783101 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:14:02.783101 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GR07Cxj8mDoaeSB9hMS3eSS4gJArNZG-6ujbTPYkwjLtjsO53fJ7xVOhcxnaWE85iE6P5UJbtHd3HKCAcWTdOmIpR3O4RBqTQnUXBt8xfQ3qochit-k5idnByZUlPNHGZHHPvgUJBawdkBrxCvUl-0YGEV74PaSmnxeVlsXrUP2CoE Jul 23 21:14:02.783101 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:14:02.783101 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:14:02.783101 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:14:02.783101 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:14:02.783101 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:14:02.783101 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:14:02.783101 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 07101aee06ca4bb6885f87cfec3257db Jul 23 21:14:02.783101 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-DeleteServersAdminTestJSON-192751077 Jul 23 21:14:02.783101 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:14:02.783101 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:14:02.784521 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/07101aee06ca4bb6885f87cfec3257db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/07101aee06ca4bb6885f87cfec3257db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_07101aee06ca4bb6885f87cfec3257db", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/07101aee06ca4bb6885f87cfec3257db"}]}] Jul 23 21:14:02.784521 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-DeleteServersAdminTestJSON-192751077 Jul 23 21:14:02.784521 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 07101aee06ca4bb6885f87cfec3257db Jul 23 21:14:02.784521 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-192751077 Jul 23 21:14:02.784521 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-DeleteServersAdminTestJSON-192751077-project Jul 23 21:14:02.784521 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:14:02.784521 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:14:02.784521 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 199522d29cb746379cb6f75d4b108cb9 Jul 23 21:14:02.784521 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-DeleteServersAdminTestJSON-192751077-project Jul 23 21:14:02.784521 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:14:02.784521 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance 5b41dd2d-cb23-4e57-91fc-1593508dc8cb could not be found. Jul 23 21:14:02.784521 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': '5b41dd2d-cb23-4e57-91fc-1593508dc8cb'} Jul 23 21:14:02.785486 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:14:02.785486 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:02.785486 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:14:02.785486 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:14:02.785486 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:14:02.785486 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:14:02.785486 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:14:02.785486 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:14:02.785486 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:14:02.785486 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:14:02.785486 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b41dd2d-cb23-4e57-91fc-1593508dc8cb could not be found. Jul 23 21:14:02.785486 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:02.785486 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:14:02.785486 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:02.785486 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:02.785486 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:14:02.785486 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:14:02.785486 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:14:02.785486 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:14:02.785486 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:14:02.786830 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:14:02.786830 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:14:02.786830 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:14:02.786830 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:14:02.786830 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:14:02.786830 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:14:02.786830 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:14:02.786830 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b41dd2d-cb23-4e57-91fc-1593508dc8cb could not be found. Jul 23 21:14:02.786830 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:02.786830 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:14:02.786830 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:02.786830 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:02.786830 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:14:02.786830 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:14:02.786830 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:14:02.786830 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:14:02.786830 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b41dd2d-cb23-4e57-91fc-1593508dc8cb could not be found. Jul 23 21:14:02.786830 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:02.787984 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-660d9f87-b3d3-4e77-a5f2-54926b126277 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:14:02.787984 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-660d9f87-b3d3-4e77-a5f2-54926b126277 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:14:02.787984 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-660d9f87-b3d3-4e77-a5f2-54926b126277 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:14:02.787984 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-660d9f87-b3d3-4e77-a5f2-54926b126277 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:14:02.787984 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-660d9f87-b3d3-4e77-a5f2-54926b126277 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:14:02.789983 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-6f2e221b-c012-4b35-a7cf-213d70ac8fed tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Returning 404 to user: Instance 5b41dd2d-cb23-4e57-91fc-1593508dc8cb could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:14:02.791035 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-6f2e221b-c012-4b35-a7cf-213d70ac8fed tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] 10.222.0.17 "GET /compute/v2.1/servers/5b41dd2d-cb23-4e57-91fc-1593508dc8cb" status: 404 len: 111 microversion: 2.1 time: 0.062923 Jul 23 21:14:02.792089 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 94/180] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:14:02 2022] GET /compute/v2.1/servers/5b41dd2d-cb23-4e57-91fc-1593508dc8cb => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:14:02.797920 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f6c12dc1-5b18-4540-992f-9bb91932b360 tempest-HypervisorAdminV253TestBase-1344885968 tempest-HypervisorAdminV253TestBase-1344885968-project-admin] Calling method '.version_select at 0x7f0b549efb80>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:02.801550 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:02.801550 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:14:02.803279 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f6c12dc1-5b18-4540-992f-9bb91932b360 tempest-HypervisorAdminV253TestBase-1344885968 tempest-HypervisorAdminV253TestBase-1344885968-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:02.803918 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f6c12dc1-5b18-4540-992f-9bb91932b360 tempest-HypervisorAdminV253TestBase-1344885968 tempest-HypervisorAdminV253TestBase-1344885968-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:02.816430 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-660d9f87-b3d3-4e77-a5f2-54926b126277 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:02.817053 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-660d9f87-b3d3-4e77-a5f2-54926b126277 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:02.823522 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-660d9f87-b3d3-4e77-a5f2-54926b126277 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:02.824119 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-660d9f87-b3d3-4e77-a5f2-54926b126277 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:02.855021 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f6c12dc1-5b18-4540-992f-9bb91932b360 tempest-HypervisorAdminV253TestBase-1344885968 tempest-HypervisorAdminV253TestBase-1344885968-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:02.855573 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f6c12dc1-5b18-4540-992f-9bb91932b360 tempest-HypervisorAdminV253TestBase-1344885968 tempest-HypervisorAdminV253TestBase-1344885968-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:02.882096 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-660d9f87-b3d3-4e77-a5f2-54926b126277 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Getting quotas for project 5935212e8b6a40768ee3fc90807b0cb1. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:14:02.903112 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-660d9f87-b3d3-4e77-a5f2-54926b126277 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Getting quotas for user 0133d9533fbd4be5b46dc308dbe3a7d9 and project 5935212e8b6a40768ee3fc90807b0cb1. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:14:02.911237 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f6c12dc1-5b18-4540-992f-9bb91932b360 tempest-HypervisorAdminV253TestBase-1344885968 tempest-HypervisorAdminV253TestBase-1344885968-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:02.915732 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f6c12dc1-5b18-4540-992f-9bb91932b360 tempest-HypervisorAdminV253TestBase-1344885968 tempest-HypervisorAdminV253TestBase-1344885968-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:02.941941 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f6c12dc1-5b18-4540-992f-9bb91932b360 tempest-HypervisorAdminV253TestBase-1344885968 tempest-HypervisorAdminV253TestBase-1344885968-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:02.942625 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f6c12dc1-5b18-4540-992f-9bb91932b360 tempest-HypervisorAdminV253TestBase-1344885968 tempest-HypervisorAdminV253TestBase-1344885968-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:02.954409 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-660d9f87-b3d3-4e77-a5f2-54926b126277 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Going to run 1 instances... {{(pid=131320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:14:02.962466 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-660d9f87-b3d3-4e77-a5f2-54926b126277 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 769ee4e5-e4df-4d4e-9f4c-6372c60d9e01] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:14:02.974928 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:02.979265 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f6c12dc1-5b18-4540-992f-9bb91932b360 tempest-HypervisorAdminV253TestBase-1344885968 tempest-HypervisorAdminV253TestBase-1344885968-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:02.982931 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f6c12dc1-5b18-4540-992f-9bb91932b360 tempest-HypervisorAdminV253TestBase-1344885968 tempest-HypervisorAdminV253TestBase-1344885968-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:03.005578 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-f6c12dc1-5b18-4540-992f-9bb91932b360 tempest-HypervisorAdminV253TestBase-1344885968 tempest-HypervisorAdminV253TestBase-1344885968-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 357 microversion: 2.53 time: 0.211578 Jul 23 21:14:03.007123 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 95/181] 10.222.0.17 () {60 vars in 1221 bytes} [Sat Jul 23 21:14:02 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 357 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 23 21:14:03.010836 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:INSERT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:03.084373 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-660d9f87-b3d3-4e77-a5f2-54926b126277 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.482844 Jul 23 21:14:03.086189 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 87/182] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:14:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1485 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 23 21:14:03.099992 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-affb1161-9482-4089-8327-40fa0673c5cf tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1581115281", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:14:03.212513 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-affb1161-9482-4089-8327-40fa0673c5cf tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] validate_networks() for None {{(pid=131320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:14:03.356435 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-afad3362-84bf-48f3-9b7f-62de93c71d36 tempest-FlavorsAdminTestJSON-1048499169 tempest-FlavorsAdminTestJSON-1048499169-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-2047850020", "id": 389561374, "os-flavor-access:is_public": "True"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:14:03.359887 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:03.359887 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:14:03.416847 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-afad3362-84bf-48f3-9b7f-62de93c71d36 tempest-FlavorsAdminTestJSON-1048499169 tempest-FlavorsAdminTestJSON-1048499169-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.405660 Jul 23 21:14:03.420798 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 96/183] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:14:03 2022] POST /compute/v2.1/flavors => generated 427 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:14:03.436521 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d3fb98b5-993d-4484-a3a1-db041066194e tempest-HypervisorAdminV253TestBase-1344885968 tempest-HypervisorAdminV253TestBase-1344885968-project-admin] Calling method '.version_select at 0x7f0b54aac8b0>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:03.437840 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:03.437840 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:14:03.444912 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d3fb98b5-993d-4484-a3a1-db041066194e tempest-HypervisorAdminV253TestBase-1344885968 tempest-HypervisorAdminV253TestBase-1344885968-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:03.453714 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d3fb98b5-993d-4484-a3a1-db041066194e tempest-HypervisorAdminV253TestBase-1344885968 tempest-HypervisorAdminV253TestBase-1344885968-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:03.535903 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d3fb98b5-993d-4484-a3a1-db041066194e tempest-HypervisorAdminV253TestBase-1344885968 tempest-HypervisorAdminV253TestBase-1344885968-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:03.548344 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d3fb98b5-993d-4484-a3a1-db041066194e tempest-HypervisorAdminV253TestBase-1344885968 tempest-HypervisorAdminV253TestBase-1344885968-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:03.583398 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-d3fb98b5-993d-4484-a3a1-db041066194e tempest-HypervisorAdminV253TestBase-1344885968 tempest-HypervisorAdminV253TestBase-1344885968-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors/79fff676-0ce0-4531-aac0-7086504b3706" status: 200 len: 792 microversion: 2.53 time: 0.160764 Jul 23 21:14:03.584256 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 97/184] 10.222.0.17 () {60 vars in 1297 bytes} [Sat Jul 23 21:14:03 2022] GET /compute/v2.1/os-hypervisors/79fff676-0ce0-4531-aac0-7086504b3706 => generated 792 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 23 21:14:03.611075 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-79416fcb-a4fb-4b50-89ad-f8e20938ca59 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:03.615968 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-79416fcb-a4fb-4b50-89ad-f8e20938ca59 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 769ee4e5-e4df-4d4e-9f4c-6372c60d9e01] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:14:03.976238 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-affb1161-9482-4089-8327-40fa0673c5cf tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:14:03.978245 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-affb1161-9482-4089-8327-40fa0673c5cf tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:14:03.979657 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-affb1161-9482-4089-8327-40fa0673c5cf tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:14:03.981297 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-affb1161-9482-4089-8327-40fa0673c5cf tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:14:03.982403 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-affb1161-9482-4089-8327-40fa0673c5cf tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:14:04.007441 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-affb1161-9482-4089-8327-40fa0673c5cf tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:04.009120 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-affb1161-9482-4089-8327-40fa0673c5cf tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:04.011396 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-affb1161-9482-4089-8327-40fa0673c5cf tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:04.013198 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-affb1161-9482-4089-8327-40fa0673c5cf tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:04.074035 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-affb1161-9482-4089-8327-40fa0673c5cf tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Getting quotas for project 07101aee06ca4bb6885f87cfec3257db. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:14:04.089744 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-affb1161-9482-4089-8327-40fa0673c5cf tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Getting quotas for user 199522d29cb746379cb6f75d4b108cb9 and project 07101aee06ca4bb6885f87cfec3257db. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:14:04.136036 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-affb1161-9482-4089-8327-40fa0673c5cf tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Going to run 1 instances... {{(pid=131320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:14:04.141270 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-affb1161-9482-4089-8327-40fa0673c5cf tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] [instance: 67f35bb9-3208-4a6f-bccd-91c993e5d0be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:14:04.217183 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-affb1161-9482-4089-8327-40fa0673c5cf tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.129559 Jul 23 21:14:04.218429 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 88/185] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:14:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1131 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 23 21:14:04.223886 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-38995220-2f20-4fd6-8270-0b090588af84 tempest-FlavorsAdminTestJSON-1048499169 tempest-FlavorsAdminTestJSON-1048499169-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:04.225652 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:04.225652 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:14:04.245918 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-79416fcb-a4fb-4b50-89ad-f8e20938ca59 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:04.252513 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-38995220-2f20-4fd6-8270-0b090588af84 tempest-FlavorsAdminTestJSON-1048499169 tempest-FlavorsAdminTestJSON-1048499169-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/389561374" status: 202 len: 0 microversion: 2.1 time: 0.032103 Jul 23 21:14:04.257494 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 89/186] 10.222.0.17 () {58 vars in 1157 bytes} [Sat Jul 23 21:14:04 2022] DELETE /compute/v2.1/flavors/389561374 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:14:04.274408 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-29e43c7c-40aa-4715-a07e-1f2fd7fbefcc req-6aa0c4c4-d21e-4e8d-a385-6e7db2b27680 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d5a909f-c169-415e-a7b7-41835906e801", "name": "network-vif-deleted", "tag": "567ed78e-1fe8-48f0-b345-0f19ade3de9a"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:14:04.277424 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-79416fcb-a4fb-4b50-89ad-f8e20938ca59 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/769ee4e5-e4df-4d4e-9f4c-6372c60d9e01" status: 200 len: 1212 microversion: 2.1 time: 0.681126 Jul 23 21:14:04.281562 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 98/187] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:14:03 2022] GET /compute/v2.1/servers/769ee4e5-e4df-4d4e-9f4c-6372c60d9e01 => generated 1212 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:14:04.296939 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-29e43c7c-40aa-4715-a07e-1f2fd7fbefcc req-6aa0c4c4-d21e-4e8d-a385-6e7db2b27680 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:04.297398 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-29e43c7c-40aa-4715-a07e-1f2fd7fbefcc req-6aa0c4c4-d21e-4e8d-a385-6e7db2b27680 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:04.305831 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-b59b4734-dcf5-4602-bc3b-d047c56e7539 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:04.307364 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-b59b4734-dcf5-4602-bc3b-d047c56e7539 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] [instance: 1d5a909f-c169-415e-a7b7-41835906e801] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:14:04.314989 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b59b4734-dcf5-4602-bc3b-d047c56e7539 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:04.315633 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b59b4734-dcf5-4602-bc3b-d047c56e7539 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:04.316557 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b59b4734-dcf5-4602-bc3b-d047c56e7539 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:04.318210 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b59b4734-dcf5-4602-bc3b-d047c56e7539 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:04.339218 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-29e43c7c-40aa-4715-a07e-1f2fd7fbefcc req-6aa0c4c4-d21e-4e8d-a385-6e7db2b27680 service nova] Creating event network-vif-deleted:567ed78e-1fe8-48f0-b345-0f19ade3de9a for instance 1d5a909f-c169-415e-a7b7-41835906e801 on nch2-master-1 Jul 23 21:14:04.354789 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-29e43c7c-40aa-4715-a07e-1f2fd7fbefcc req-6aa0c4c4-d21e-4e8d-a385-6e7db2b27680 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094953 Jul 23 21:14:04.355849 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 90/188] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:14:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:14:04.360613 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b59b4734-dcf5-4602-bc3b-d047c56e7539 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:04.361089 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b59b4734-dcf5-4602-bc3b-d047c56e7539 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:04.361605 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.objects.instance [None req-b59b4734-dcf5-4602-bc3b-d047c56e7539 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Lazy-loading 'fault' on Instance uuid 1d5a909f-c169-415e-a7b7-41835906e801 {{(pid=131321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:14:04.375065 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a67a67ba-b4b6-45c7-933d-1d6ac49b72bd tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:04.376771 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a67a67ba-b4b6-45c7-933d-1d6ac49b72bd tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] [instance: 67f35bb9-3208-4a6f-bccd-91c993e5d0be] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:14:04.510356 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-b59b4734-dcf5-4602-bc3b-d047c56e7539 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95896f2064e34e5d82e9531e68aab170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2366e681931c49118c1120350487bde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:04.515196 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a67a67ba-b4b6-45c7-933d-1d6ac49b72bd tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199522d29cb746379cb6f75d4b108cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07101aee06ca4bb6885f87cfec3257db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:04.518971 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-b59b4734-dcf5-4602-bc3b-d047c56e7539 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] 10.222.0.17 "GET /compute/v2.1/servers/1d5a909f-c169-415e-a7b7-41835906e801" status: 200 len: 1329 microversion: 2.1 time: 0.236129 Jul 23 21:14:04.528987 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 99/189] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:14:04 2022] GET /compute/v2.1/servers/1d5a909f-c169-415e-a7b7-41835906e801 => generated 1329 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:14:04.540001 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a67a67ba-b4b6-45c7-933d-1d6ac49b72bd tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] 10.222.0.17 "GET /compute/v2.1/servers/67f35bb9-3208-4a6f-bccd-91c993e5d0be" status: 200 len: 1220 microversion: 2.1 time: 0.180410 Jul 23 21:14:04.541913 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 91/190] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:14:04 2022] GET /compute/v2.1/servers/67f35bb9-3208-4a6f-bccd-91c993e5d0be => generated 1220 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:14:04.551649 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-01fa20de-aed6-49d6-a2d2-4423c81a8358 tempest-FlavorsAdminTestJSON-1048499169 tempest-FlavorsAdminTestJSON-1048499169-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:04.598237 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-01fa20de-aed6-49d6-a2d2-4423c81a8358 tempest-FlavorsAdminTestJSON-1048499169 tempest-FlavorsAdminTestJSON-1048499169-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.067860 Jul 23 21:14:04.607942 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 100/191] 10.222.0.17 () {58 vars in 1145 bytes} [Sat Jul 23 21:14:04 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:14:04.624555 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e94d0712-8872-47b6-9876-205fa5eae25c tempest-FlavorsAdminTestJSON-1048499169 tempest-FlavorsAdminTestJSON-1048499169-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1267741204", "id": 1382309955, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:14:04.628475 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:04.628475 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:14:04.689093 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e94d0712-8872-47b6-9876-205fa5eae25c tempest-FlavorsAdminTestJSON-1048499169 tempest-FlavorsAdminTestJSON-1048499169-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 417 microversion: 2.1 time: 0.072748 Jul 23 21:14:04.695208 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 92/192] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:14:04 2022] POST /compute/v2.1/flavors => generated 417 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:14:04.707742 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-3d5d5a3f-152c-44f7-8bdd-60781dfa0d50 tempest-FlavorsAdminTestJSON-1048499169 tempest-FlavorsAdminTestJSON-1048499169-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:04.766818 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-3d5d5a3f-152c-44f7-8bdd-60781dfa0d50 tempest-FlavorsAdminTestJSON-1048499169 tempest-FlavorsAdminTestJSON-1048499169-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 5398 microversion: 2.1 time: 0.062251 Jul 23 21:14:04.769585 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 101/193] 10.222.0.17 () {58 vars in 1145 bytes} [Sat Jul 23 21:14:04 2022] GET /compute/v2.1/flavors/detail => generated 5398 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:14:04.785090 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-bfb401a1-5701-400a-92a5-b4c20545c761 tempest-FlavorsAdminTestJSON-1048499169 tempest-FlavorsAdminTestJSON-1048499169-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:04.786548 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:04.786548 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:14:04.823028 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-bfb401a1-5701-400a-92a5-b4c20545c761 tempest-FlavorsAdminTestJSON-1048499169 tempest-FlavorsAdminTestJSON-1048499169-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/1382309955" status: 202 len: 0 microversion: 2.1 time: 0.042159 Jul 23 21:14:04.824267 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 93/194] 10.222.0.17 () {58 vars in 1160 bytes} [Sat Jul 23 21:14:04 2022] DELETE /compute/v2.1/flavors/1382309955 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:14:04.840617 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-1742a6f6-43d1-4525-8d06-97c6f4d83baf tempest-FlavorsAdminTestJSON-1048499169 tempest-FlavorsAdminTestJSON-1048499169-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:04.906235 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-1742a6f6-43d1-4525-8d06-97c6f4d83baf tempest-FlavorsAdminTestJSON-1048499169 tempest-FlavorsAdminTestJSON-1048499169-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.068738 Jul 23 21:14:04.910908 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 102/195] 10.222.0.17 () {58 vars in 1145 bytes} [Sat Jul 23 21:14:04 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:14:04.927638 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-fb3716d7-b2d9-473c-9fa0-a86c8e326c1f tempest-FlavorsAdminTestJSON-1048499169 tempest-FlavorsAdminTestJSON-1048499169-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-180101359", "id": 963128646, "os-flavor-access:is_public": "True"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:14:04.962943 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-fb3716d7-b2d9-473c-9fa0-a86c8e326c1f tempest-FlavorsAdminTestJSON-1048499169 tempest-FlavorsAdminTestJSON-1048499169-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.038661 Jul 23 21:14:04.965584 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 94/196] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:14:04 2022] POST /compute/v2.1/flavors => generated 425 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:14:04.978298 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-df2311af-a18a-4ab7-9f4e-b81ef1ae9d58 tempest-FlavorsAdminTestJSON-1048499169 tempest-FlavorsAdminTestJSON-1048499169-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:04.979310 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:04.979310 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:14:05.032448 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-df2311af-a18a-4ab7-9f4e-b81ef1ae9d58 tempest-FlavorsAdminTestJSON-1048499169 tempest-FlavorsAdminTestJSON-1048499169-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/963128646" status: 202 len: 0 microversion: 2.1 time: 0.059253 Jul 23 21:14:05.035391 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 103/197] 10.222.0.17 () {58 vars in 1157 bytes} [Sat Jul 23 21:14:04 2022] DELETE /compute/v2.1/flavors/963128646 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:14:05.043108 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-98855ad9-47e7-4aee-9b45-c7998e336f14 tempest-FlavorsAdminTestJSON-1048499169 tempest-FlavorsAdminTestJSON-1048499169-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:05.089132 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-98855ad9-47e7-4aee-9b45-c7998e336f14 tempest-FlavorsAdminTestJSON-1048499169 tempest-FlavorsAdminTestJSON-1048499169-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.049729 Jul 23 21:14:05.090964 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 95/198] 10.222.0.17 () {58 vars in 1145 bytes} [Sat Jul 23 21:14:05 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:14:05.120932 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-6c1f65e9-4877-47b8-b923-627b28fa42ed tempest-FlavorsAdminTestJSON-1048499169 tempest-FlavorsAdminTestJSON-1048499169-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-356658766", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:14:05.130365 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:05.130365 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:14:05.178318 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-6c1f65e9-4877-47b8-b923-627b28fa42ed tempest-FlavorsAdminTestJSON-1048499169 tempest-FlavorsAdminTestJSON-1048499169-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.070547 Jul 23 21:14:05.187753 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 104/199] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:14:05 2022] POST /compute/v2.1/flavors => generated 506 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:14:05.199950 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e074af97-6140-4246-8d9f-765052facac4 tempest-FlavorsAdminTestJSON-1048499169 tempest-FlavorsAdminTestJSON-1048499169-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:05.235906 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e074af97-6140-4246-8d9f-765052facac4 tempest-FlavorsAdminTestJSON-1048499169 tempest-FlavorsAdminTestJSON-1048499169-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/21802bfc-a077-459f-ba5c-2eb924eab32e" status: 202 len: 0 microversion: 2.1 time: 0.041530 Jul 23 21:14:05.239585 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 96/200] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:14:05 2022] DELETE /compute/v2.1/flavors/21802bfc-a077-459f-ba5c-2eb924eab32e => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:14:05.253105 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-5edb4568-9769-49d2-b6d3-73d9a4acd833 tempest-FlavorsAdminTestJSON-1048499169 tempest-FlavorsAdminTestJSON-1048499169-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:05.301761 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-31195889-2fd4-4725-a107-2edf264123ba tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:05.303098 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-31195889-2fd4-4725-a107-2edf264123ba tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 769ee4e5-e4df-4d4e-9f4c-6372c60d9e01] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:14:05.314600 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-5edb4568-9769-49d2-b6d3-73d9a4acd833 tempest-FlavorsAdminTestJSON-1048499169 tempest-FlavorsAdminTestJSON-1048499169-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.065834 Jul 23 21:14:05.316332 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 105/201] 10.222.0.17 () {58 vars in 1145 bytes} [Sat Jul 23 21:14:05 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:14:05.318477 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-31195889-2fd4-4725-a107-2edf264123ba tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:05.320584 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-31195889-2fd4-4725-a107-2edf264123ba tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:05.321331 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-31195889-2fd4-4725-a107-2edf264123ba tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:05.321896 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-31195889-2fd4-4725-a107-2edf264123ba tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:05.337372 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f7bfde1d-f40a-4ff5-b995-92a1047715b0 tempest-FlavorsAdminTestJSON-1048499169 tempest-FlavorsAdminTestJSON-1048499169-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-468213044", "id": "a40d7f8c-4581-4f59-b991-1c1bfd377e53", "os-flavor-access:is_public": "True"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:14:05.346863 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=100 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:05.438881 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-f7bfde1d-f40a-4ff5-b995-92a1047715b0 tempest-FlavorsAdminTestJSON-1048499169 tempest-FlavorsAdminTestJSON-1048499169-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.109704 Jul 23 21:14:05.449424 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 106/202] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:14:05 2022] POST /compute/v2.1/flavors => generated 506 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:14:05.473266 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f2f14c48-f411-4fb6-bb3a-41da44a0e7c1 tempest-FlavorsAdminTestJSON-1048499169 tempest-FlavorsAdminTestJSON-1048499169-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:05.510066 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-f2f14c48-f411-4fb6-bb3a-41da44a0e7c1 tempest-FlavorsAdminTestJSON-1048499169 tempest-FlavorsAdminTestJSON-1048499169-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/a40d7f8c-4581-4f59-b991-1c1bfd377e53" status: 202 len: 0 microversion: 2.1 time: 0.055696 Jul 23 21:14:05.513634 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 107/203] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:14:05 2022] DELETE /compute/v2.1/flavors/a40d7f8c-4581-4f59-b991-1c1bfd377e53 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:14:05.522503 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-07ff3f74-1d9c-4468-8e32-0790b8c9e57b tempest-FlavorsAdminTestJSON-1048499169 tempest-FlavorsAdminTestJSON-1048499169-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:05.559009 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-07ff3f74-1d9c-4468-8e32-0790b8c9e57b tempest-FlavorsAdminTestJSON-1048499169 tempest-FlavorsAdminTestJSON-1048499169-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.042981 Jul 23 21:14:05.560398 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 108/204] 10.222.0.17 () {58 vars in 1145 bytes} [Sat Jul 23 21:14:05 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:14:05.567941 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-02b83f86-2619-4366-997f-51370229243c tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:05.569107 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-02b83f86-2619-4366-997f-51370229243c tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] [instance: 1d5a909f-c169-415e-a7b7-41835906e801] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:14:05.578494 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-02b83f86-2619-4366-997f-51370229243c tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:05.579248 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-02b83f86-2619-4366-997f-51370229243c tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:05.580611 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-02b83f86-2619-4366-997f-51370229243c tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:05.581547 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-02b83f86-2619-4366-997f-51370229243c tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:05.616809 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-02b83f86-2619-4366-997f-51370229243c tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] HTTP exception thrown: Instance 1d5a909f-c169-415e-a7b7-41835906e801 could not be found. Jul 23 21:14:05.619114 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-02b83f86-2619-4366-997f-51370229243c tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Request method failure captured: Jul 23 21:14:05.619114 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/servers/1d5a909f-c169-415e-a7b7-41835906e801 HTTP/1.1 Jul 23 21:14:05.619114 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:14:05.619114 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:14:05.619114 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:14:05.619114 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:14:05.619114 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:14:05.619114 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:14:05.619114 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:14:05.619114 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:14:05.619114 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GR1eI889iz1UdOMfj-AWbWeN2aV76a5pfj4M3aeDd2iTJca2skQPCt-TeybZWX5RXMEzwhb3I6Zsxrsk4g9IZ2wNC9swlAqtfJXbq8C2TXLA7Y5M7WirEk1HUdIfULr6oHCu-dC-PIZSuAWkEl5W6343G7QEv7Lmk9voK1dKeUh_C8 Jul 23 21:14:05.619114 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:14:05.619114 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:14:05.619114 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:14:05.619114 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:14:05.619114 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:14:05.619114 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:14:05.619114 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 2366e681931c49118c1120350487bde5 Jul 23 21:14:05.619114 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-AggregatesAdminTestJSON-1783669231 Jul 23 21:14:05.619114 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:14:05.619114 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:14:05.620367 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2366e681931c49118c1120350487bde5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2366e681931c49118c1120350487bde5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2366e681931c49118c1120350487bde5", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2366e681931c49118c1120350487bde5"}]}] Jul 23 21:14:05.620367 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-AggregatesAdminTestJSON-1783669231 Jul 23 21:14:05.620367 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 2366e681931c49118c1120350487bde5 Jul 23 21:14:05.620367 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1783669231 Jul 23 21:14:05.620367 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-AggregatesAdminTestJSON-1783669231-project Jul 23 21:14:05.620367 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:14:05.620367 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:14:05.620367 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 95896f2064e34e5d82e9531e68aab170 Jul 23 21:14:05.620367 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-AggregatesAdminTestJSON-1783669231-project Jul 23 21:14:05.620367 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:14:05.620367 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance 1d5a909f-c169-415e-a7b7-41835906e801 could not be found. Jul 23 21:14:05.620367 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': '1d5a909f-c169-415e-a7b7-41835906e801'} Jul 23 21:14:05.621051 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:14:05.621051 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:05.621051 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:14:05.621051 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:14:05.621051 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:14:05.621051 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:14:05.621051 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:14:05.621051 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:14:05.621051 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:14:05.621051 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:14:05.621051 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d5a909f-c169-415e-a7b7-41835906e801 could not be found. Jul 23 21:14:05.621051 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:05.621051 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:14:05.621051 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:05.621051 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:05.621051 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:14:05.621051 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:14:05.621051 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:14:05.621051 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:14:05.621051 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:14:05.622113 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:14:05.622113 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:14:05.622113 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:14:05.622113 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:14:05.622113 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:14:05.622113 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:14:05.622113 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:14:05.622113 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d5a909f-c169-415e-a7b7-41835906e801 could not be found. Jul 23 21:14:05.622113 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:05.622113 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:14:05.622113 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:05.622113 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:05.622113 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:14:05.622113 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:14:05.622113 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:14:05.622113 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:14:05.622113 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d5a909f-c169-415e-a7b7-41835906e801 could not be found. Jul 23 21:14:05.622113 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:05.628661 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-02b83f86-2619-4366-997f-51370229243c tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Returning 404 to user: Instance 1d5a909f-c169-415e-a7b7-41835906e801 could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:14:05.630105 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-02b83f86-2619-4366-997f-51370229243c tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] 10.222.0.17 "GET /compute/v2.1/servers/1d5a909f-c169-415e-a7b7-41835906e801" status: 404 len: 111 microversion: 2.1 time: 0.068492 Jul 23 21:14:05.631218 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 109/205] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:14:05 2022] GET /compute/v2.1/servers/1d5a909f-c169-415e-a7b7-41835906e801 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:14:05.639016 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-41bea530-8bd5-4ce0-a7d9-05b1bd6925d1 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:05.639863 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-41bea530-8bd5-4ce0-a7d9-05b1bd6925d1 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] [instance: 67f35bb9-3208-4a6f-bccd-91c993e5d0be] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:14:05.650521 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-41bea530-8bd5-4ce0-a7d9-05b1bd6925d1 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:05.651351 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-41bea530-8bd5-4ce0-a7d9-05b1bd6925d1 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:05.652413 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-41bea530-8bd5-4ce0-a7d9-05b1bd6925d1 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:05.653065 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-41bea530-8bd5-4ce0-a7d9-05b1bd6925d1 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:05.727028 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-31195889-2fd4-4725-a107-2edf264123ba tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:05.741448 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-31195889-2fd4-4725-a107-2edf264123ba tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/769ee4e5-e4df-4d4e-9f4c-6372c60d9e01" status: 200 len: 1264 microversion: 2.1 time: 0.444045 Jul 23 21:14:05.744721 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 97/206] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:14:05 2022] GET /compute/v2.1/servers/769ee4e5-e4df-4d4e-9f4c-6372c60d9e01 => generated 1264 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:14:05.767899 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f05d6b7d-78b4-4ede-b1cf-a0ee6e554061 tempest-FlavorsAdminTestJSON-1048499169 tempest-FlavorsAdminTestJSON-1048499169-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-966898678", "id": 1484730894, "os-flavor-access:is_public": "True"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:14:05.772052 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:05.772052 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:14:05.822598 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f05d6b7d-78b4-4ede-b1cf-a0ee6e554061 tempest-FlavorsAdminTestJSON-1048499169 tempest-FlavorsAdminTestJSON-1048499169-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.075145 Jul 23 21:14:05.826014 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 98/207] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:14:05 2022] POST /compute/v2.1/flavors => generated 413 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:14:05.835368 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-12400e37-4561-446d-8a25-8fc9958bde0d tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:14:05.837464 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:05.837464 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:14:05.850911 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-12400e37-4561-446d-8a25-8fc9958bde0d tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:05.852255 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-12400e37-4561-446d-8a25-8fc9958bde0d tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:05.869974 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-41bea530-8bd5-4ce0-a7d9-05b1bd6925d1 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199522d29cb746379cb6f75d4b108cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07101aee06ca4bb6885f87cfec3257db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:05.883731 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-41bea530-8bd5-4ce0-a7d9-05b1bd6925d1 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] 10.222.0.17 "GET /compute/v2.1/servers/67f35bb9-3208-4a6f-bccd-91c993e5d0be" status: 200 len: 1246 microversion: 2.1 time: 0.251081 Jul 23 21:14:05.885198 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 110/208] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:14:05 2022] GET /compute/v2.1/servers/67f35bb9-3208-4a6f-bccd-91c993e5d0be => generated 1246 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:14:05.890382 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-fd5ea64f-751b-450f-a330-3c89b5cde7e7 tempest-FlavorsAdminTestJSON-1048499169 tempest-FlavorsAdminTestJSON-1048499169-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:05.903999 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-fd5ea64f-751b-450f-a330-3c89b5cde7e7 tempest-FlavorsAdminTestJSON-1048499169 tempest-FlavorsAdminTestJSON-1048499169-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/1484730894" status: 200 len: 413 microversion: 2.1 time: 0.017504 Jul 23 21:14:05.904588 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 111/209] 10.222.0.17 () {58 vars in 1157 bytes} [Sat Jul 23 21:14:05 2022] GET /compute/v2.1/flavors/1484730894 => generated 413 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:14:06.085283 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-12400e37-4561-446d-8a25-8fc9958bde0d tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates/7/action" status: 200 len: 299 microversion: 2.1 time: 0.257708 Jul 23 21:14:06.091307 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 99/210] 10.222.0.17 () {60 vars in 1190 bytes} [Sat Jul 23 21:14:05 2022] POST /compute/v2.1/os-aggregates/7/action => generated 299 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:14:06.101908 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-24ad8b63-ef44-48a5-9048-4d97a781e958 tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:06.104726 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:06.104726 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:14:06.152379 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-24ad8b63-ef44-48a5-9048-4d97a781e958 tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.058614 Jul 23 21:14:06.154070 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 100/211] 10.222.0.17 () {58 vars in 1151 bytes} [Sat Jul 23 21:14:06 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 23 21:14:06.172815 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3d20edda-5faf-477c-b8bd-edc4cac17ca6 tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2086526380"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:14:06.184781 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:06.184781 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:14:06.186280 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.objects.aggregate [None req-3d20edda-5faf-477c-b8bd-edc4cac17ca6 tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] Generated uuid 0a1a4f3b-a0e6-41f4-9c72-b6e46dbee2dd for aggregate {{(pid=131320) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 23 21:14:06.242024 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-3d20edda-5faf-477c-b8bd-edc4cac17ca6 tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.072766 Jul 23 21:14:06.248400 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 101/212] 10.222.0.17 () {60 vars in 1163 bytes} [Sat Jul 23 21:14:06 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:14:06.262380 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-59a2416f-e114-40fb-aca0-ea55547cec32 tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:14:06.264379 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:06.264379 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:14:06.303149 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-59a2416f-e114-40fb-aca0-ea55547cec32 tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:06.303609 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-59a2416f-e114-40fb-aca0-ea55547cec32 tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:06.541139 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-fdc2e95b-740b-41b9-a30f-0e987ad7f957 tempest-FlavorsAdminTestJSON-46324727 tempest-FlavorsAdminTestJSON-46324727-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:06.595593 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-fdc2e95b-740b-41b9-a30f-0e987ad7f957 tempest-FlavorsAdminTestJSON-46324727 tempest-FlavorsAdminTestJSON-46324727-project] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.679494 Jul 23 21:14:06.607289 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 112/213] 10.222.0.17 () {58 vars in 1145 bytes} [Sat Jul 23 21:14:05 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:14:06.609705 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-59a2416f-e114-40fb-aca0-ea55547cec32 tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 242 microversion: 2.1 time: 0.359699 Jul 23 21:14:06.610593 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 102/214] 10.222.0.17 () {60 vars in 1190 bytes} [Sat Jul 23 21:14:06 2022] POST /compute/v2.1/os-aggregates/9/action => generated 242 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:14:06.614461 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-80b8f6c6-cd4c-4947-8d50-db9937349161 tempest-FlavorsAdminTestJSON-1048499169 tempest-FlavorsAdminTestJSON-1048499169-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:06.615552 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:06.615552 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:14:06.622354 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5a4cff6b-49b1-4a2c-bc97-98037d6f612e tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:06.623569 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:06.623569 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:14:06.638250 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-80b8f6c6-cd4c-4947-8d50-db9937349161 tempest-FlavorsAdminTestJSON-1048499169 tempest-FlavorsAdminTestJSON-1048499169-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/1484730894" status: 202 len: 0 microversion: 2.1 time: 0.029148 Jul 23 21:14:06.639386 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 113/215] 10.222.0.17 () {58 vars in 1160 bytes} [Sat Jul 23 21:14:06 2022] DELETE /compute/v2.1/flavors/1484730894 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:14:06.642789 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5a4cff6b-49b1-4a2c-bc97-98037d6f612e tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] 10.222.0.17 "GET /compute/v2.1/os-aggregates/9" status: 200 len: 242 microversion: 2.1 time: 0.022679 Jul 23 21:14:06.642789 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 103/216] 10.222.0.17 () {58 vars in 1148 bytes} [Sat Jul 23 21:14:06 2022] GET /compute/v2.1/os-aggregates/9 => generated 242 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:14:06.652381 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-559ff2e2-a0ad-47f8-a595-e729a7ccc06c tempest-FlavorsAdminTestJSON-1048499169 tempest-FlavorsAdminTestJSON-1048499169-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:06.656637 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f3564dd2-9ca7-4a59-8a58-254e300eb26b tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:14:06.658293 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:06.658293 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:14:06.679278 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f3564dd2-9ca7-4a59-8a58-254e300eb26b tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:06.680120 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f3564dd2-9ca7-4a59-8a58-254e300eb26b tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:06.681012 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-559ff2e2-a0ad-47f8-a595-e729a7ccc06c tempest-FlavorsAdminTestJSON-1048499169 tempest-FlavorsAdminTestJSON-1048499169-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.035809 Jul 23 21:14:06.681643 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 104/217] 10.222.0.17 () {58 vars in 1145 bytes} [Sat Jul 23 21:14:06 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:14:06.702756 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-41e73e5b-deff-4e9c-bd02-5d027abff214 tempest-FlavorsAdminTestJSON-1048499169 tempest-FlavorsAdminTestJSON-1048499169-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1839447970", "id": 135923355, "os-flavor-access:is_public": "False"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:14:06.704564 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:06.704564 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:14:06.737052 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-41e73e5b-deff-4e9c-bd02-5d027abff214 tempest-FlavorsAdminTestJSON-1048499169 tempest-FlavorsAdminTestJSON-1048499169-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.042239 Jul 23 21:14:06.738501 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 105/218] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:14:06 2022] POST /compute/v2.1/flavors => generated 427 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:14:06.756449 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-eecb5519-9fc7-459b-bca1-b8b6119e5254 tempest-FlavorsAdminTestJSON-46324727 tempest-FlavorsAdminTestJSON-46324727-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "135923355"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:14:06.770065 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-eecb5519-9fc7-459b-bca1-b8b6119e5254 tempest-FlavorsAdminTestJSON-46324727 tempest-FlavorsAdminTestJSON-46324727-project] HTTP exception thrown: Flavor 135923355 could not be found. Jul 23 21:14:06.776223 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-eecb5519-9fc7-459b-bca1-b8b6119e5254 tempest-FlavorsAdminTestJSON-46324727 tempest-FlavorsAdminTestJSON-46324727-project] Request method failure captured: Jul 23 21:14:06.776223 ncdv-master-1 devstack@n-api.service[131320]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 23 21:14:06.776223 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:14:06.776223 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:14:06.776223 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:14:06.776223 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 106 Jul 23 21:14:06.776223 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:14:06.776223 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:14:06.776223 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:14:06.776223 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:14:06.776223 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GSY16ueH_oQ_7oEV6S3vLtxvVAw-7a9Oi608e-gKd2xtKIb217aaCusS--IUd_lRtTppi4cZi4ML9oJPZf6i9pjcTU3U-TrPOclHomZqi4Xvpuhq4HZ8F6_obJacTTSYiQ-WeEmxwKA4OO8fYVPDh-yQXwGQRuA1tn_yl4Gg1q0WcE Jul 23 21:14:06.776223 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:14:06.776223 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:14:06.776223 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:14:06.776223 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:14:06.776223 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:14:06.776223 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:14:06.776223 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: e761e48e603741e68de2a7f1faac1f2d Jul 23 21:14:06.776223 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-FlavorsAdminTestJSON-46324727 Jul 23 21:14:06.776223 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:14:06.776223 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:14:06.777772 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e761e48e603741e68de2a7f1faac1f2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e761e48e603741e68de2a7f1faac1f2d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e761e48e603741e68de2a7f1faac1f2d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e761e48e603741e68de2a7f1faac1f2d"}]}] Jul 23 21:14:06.777772 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-FlavorsAdminTestJSON-46324727 Jul 23 21:14:06.777772 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: e761e48e603741e68de2a7f1faac1f2d Jul 23 21:14:06.777772 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-46324727 Jul 23 21:14:06.777772 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-FlavorsAdminTestJSON-46324727-project Jul 23 21:14:06.777772 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:14:06.777772 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:14:06.777772 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 297aedc9c9804bf9877911af2892fcea Jul 23 21:14:06.777772 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-FlavorsAdminTestJSON-46324727-project Jul 23 21:14:06.777772 ncdv-master-1 devstack@n-api.service[131320]: Jul 23 21:14:06.777772 ncdv-master-1 devstack@n-api.service[131320]: {"server": {"name": "test", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "135923355"}} Jul 23 21:14:06.777772 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:14:06.777772 ncdv-master-1 devstack@n-api.service[131320]: exception: Flavor 135923355 could not be found. Jul 23 21:14:06.782278 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'body': {'server': {'name': 'test', 'imageRef': 'b27b20aa-ef1b-4dd1-989e-321af6343d6a', 'flavorRef': '135923355'}}} Jul 23 21:14:06.782278 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:14:06.782278 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:06.782278 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Jul 23 21:14:06.782278 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Jul 23 21:14:06.782278 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 23 21:14:06.782278 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 23 21:14:06.782278 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 23 21:14:06.782278 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 23 21:14:06.782278 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 23 21:14:06.782278 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 23 21:14:06.782278 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 23 21:14:06.782278 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:14:06.782278 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 23 21:14:06.782278 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 23 21:14:06.782278 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 135923355 could not be found. Jul 23 21:14:06.782278 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:14:06.782278 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:14:06.782278 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:14:06.782278 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:06.783673 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:14:06.783673 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:14:06.783673 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:14:06.783673 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:14:06.783673 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:14:06.783673 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:14:06.783673 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:14:06.783673 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:14:06.783673 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:14:06.783673 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:14:06.783673 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:14:06.783673 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:14:06.783673 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 23 21:14:06.783673 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 23 21:14:06.783673 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 23 21:14:06.783673 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 135923355 could not be found. Jul 23 21:14:06.783673 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:14:06.783673 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:14:06.783673 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:14:06.783673 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:06.783673 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:14:06.785101 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:14:06.785101 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:14:06.785101 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:14:06.785101 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 135923355 could not be found. Jul 23 21:14:06.785101 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:14:06.785101 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-eecb5519-9fc7-459b-bca1-b8b6119e5254 tempest-FlavorsAdminTestJSON-46324727 tempest-FlavorsAdminTestJSON-46324727-project] Returning 400 to user: Flavor 135923355 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:14:06.785101 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-eecb5519-9fc7-459b-bca1-b8b6119e5254 tempest-FlavorsAdminTestJSON-46324727 tempest-FlavorsAdminTestJSON-46324727-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 400 len: 80 microversion: 2.1 time: 0.031155 Jul 23 21:14:06.785101 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 106/219] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:14:06 2022] POST /compute/v2.1/servers => generated 80 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 23 21:14:06.786990 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ae40f022-7a8d-4028-9509-0e34a9465210 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:06.787617 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ae40f022-7a8d-4028-9509-0e34a9465210 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 769ee4e5-e4df-4d4e-9f4c-6372c60d9e01] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:14:06.810450 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ae40f022-7a8d-4028-9509-0e34a9465210 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:06.810918 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ae40f022-7a8d-4028-9509-0e34a9465210 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:06.811729 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ae40f022-7a8d-4028-9509-0e34a9465210 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:06.812171 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ae40f022-7a8d-4028-9509-0e34a9465210 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:06.867781 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-f3564dd2-9ca7-4a59-8a58-254e300eb26b tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 227 microversion: 2.1 time: 0.216237 Jul 23 21:14:06.869843 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 114/220] 10.222.0.17 () {60 vars in 1190 bytes} [Sat Jul 23 21:14:06 2022] POST /compute/v2.1/os-aggregates/9/action => generated 227 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:14:06.897363 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-093e0a9b-1b44-4592-a1cd-83feb474411f tempest-FlavorsAdminTestJSON-1048499169 tempest-FlavorsAdminTestJSON-1048499169-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:06.900183 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:06.900183 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:14:06.985189 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-093e0a9b-1b44-4592-a1cd-83feb474411f tempest-FlavorsAdminTestJSON-1048499169 tempest-FlavorsAdminTestJSON-1048499169-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/135923355" status: 202 len: 0 microversion: 2.1 time: 0.113554 Jul 23 21:14:06.985904 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 115/221] 10.222.0.17 () {58 vars in 1157 bytes} [Sat Jul 23 21:14:06 2022] DELETE /compute/v2.1/flavors/135923355 => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:14:06.993816 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-7db3e1ee-26a7-4b6b-901d-185e14b70582 tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:06.994685 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:06.994685 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:14:07.025845 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ae40f022-7a8d-4028-9509-0e34a9465210 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:07.040282 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ae40f022-7a8d-4028-9509-0e34a9465210 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/769ee4e5-e4df-4d4e-9f4c-6372c60d9e01" status: 200 len: 1270 microversion: 2.1 time: 0.260312 Jul 23 21:14:07.051207 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-7db3e1ee-26a7-4b6b-901d-185e14b70582 tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.064010 Jul 23 21:14:07.052026 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 116/222] 10.222.0.17 () {58 vars in 1151 bytes} [Sat Jul 23 21:14:06 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 23 21:14:07.062750 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c76c845b-63a1-49b8-b05f-d536a8033e90 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:07.063737 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-c76c845b-63a1-49b8-b05f-d536a8033e90 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] [instance: 67f35bb9-3208-4a6f-bccd-91c993e5d0be] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:14:07.064931 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 107/223] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:14:06 2022] GET /compute/v2.1/servers/769ee4e5-e4df-4d4e-9f4c-6372c60d9e01 => generated 1270 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:14:07.070987 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-bf59af75-8f64-40e5-8a6e-ea5fff96cdab tempest-FlavorsAdminTestJSON-1048499169 tempest-FlavorsAdminTestJSON-1048499169-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:07.077682 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c76c845b-63a1-49b8-b05f-d536a8033e90 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:07.078562 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c76c845b-63a1-49b8-b05f-d536a8033e90 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:07.079924 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c76c845b-63a1-49b8-b05f-d536a8033e90 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:07.080588 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c76c845b-63a1-49b8-b05f-d536a8033e90 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:07.091824 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:INSERT=11,nova_api:SELECT=77,nova_api:DELETE=12 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:07.099446 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-bf59af75-8f64-40e5-8a6e-ea5fff96cdab tempest-FlavorsAdminTestJSON-1048499169 tempest-FlavorsAdminTestJSON-1048499169-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.033154 Jul 23 21:14:07.111275 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 108/224] 10.222.0.17 () {58 vars in 1145 bytes} [Sat Jul 23 21:14:07 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:14:07.116274 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-16acb088-54c4-426c-8cdc-d0531ecdfc39 tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1585949051"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:14:07.118126 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:07.118126 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:14:07.119644 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.objects.aggregate [None req-16acb088-54c4-426c-8cdc-d0531ecdfc39 tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] Generated uuid a02507e9-fe9e-42e5-9960-5d7a0773d776 for aggregate {{(pid=131320) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 23 21:14:07.153292 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-16acb088-54c4-426c-8cdc-d0531ecdfc39 tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.050982 Jul 23 21:14:07.158575 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 109/225] 10.222.0.17 () {60 vars in 1163 bytes} [Sat Jul 23 21:14:07 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:14:07.164369 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2ebee922-1881-4192-b6ef-ce0066fabfa8 tempest-FlavorsAdminTestJSON-1048499169 tempest-FlavorsAdminTestJSON-1048499169-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1670527093", "id": 935385587, "os-flavor-access:is_public": "False"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:14:07.167561 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:07.167561 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:14:07.194638 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2ebee922-1881-4192-b6ef-ce0066fabfa8 tempest-FlavorsAdminTestJSON-1048499169 tempest-FlavorsAdminTestJSON-1048499169-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.034479 Jul 23 21:14:07.195489 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 110/226] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:14:07 2022] POST /compute/v2.1/flavors => generated 412 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:14:07.202114 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ef9ec9ba-3640-4664-9b36-d24b24bce94b tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:14:07.203867 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:07.203867 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:14:07.225319 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ef9ec9ba-3640-4664-9b36-d24b24bce94b tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:07.225793 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ef9ec9ba-3640-4664-9b36-d24b24bce94b tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:07.257123 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c76c845b-63a1-49b8-b05f-d536a8033e90 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199522d29cb746379cb6f75d4b108cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07101aee06ca4bb6885f87cfec3257db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:07.271241 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-c76c845b-63a1-49b8-b05f-d536a8033e90 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] 10.222.0.17 "GET /compute/v2.1/servers/67f35bb9-3208-4a6f-bccd-91c993e5d0be" status: 200 len: 1278 microversion: 2.1 time: 0.215530 Jul 23 21:14:07.282262 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 117/227] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:14:07 2022] GET /compute/v2.1/servers/67f35bb9-3208-4a6f-bccd-91c993e5d0be => generated 1278 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:14:07.288949 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-7450664e-5275-4964-b756-2d1a831d4b4b tempest-FlavorsAdminTestJSON-1048499169 tempest-FlavorsAdminTestJSON-1048499169-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1951474243", "id": 751459522, "os-flavor-access:is_public": "True"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:14:07.290995 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:07.290995 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:14:07.313357 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-7450664e-5275-4964-b756-2d1a831d4b4b tempest-FlavorsAdminTestJSON-1048499169 tempest-FlavorsAdminTestJSON-1048499169-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.028737 Jul 23 21:14:07.315446 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 118/228] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:14:07 2022] POST /compute/v2.1/flavors => generated 411 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:14:07.333719 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-3f2dcd18-c93a-45af-8ff5-dad9db22f101 tempest-FlavorsAdminTestJSON-1048499169 tempest-FlavorsAdminTestJSON-1048499169-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:07.357715 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-3f2dcd18-c93a-45af-8ff5-dad9db22f101 tempest-FlavorsAdminTestJSON-1048499169 tempest-FlavorsAdminTestJSON-1048499169-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 415 microversion: 2.1 time: 0.033102 Jul 23 21:14:07.358691 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 119/229] 10.222.0.17 () {58 vars in 1168 bytes} [Sat Jul 23 21:14:07 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 415 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:14:07.372105 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ce3014c2-2b12-40ea-b679-1d5d22d8e3c3 tempest-FlavorsAdminTestJSON-1048499169 tempest-FlavorsAdminTestJSON-1048499169-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:07.396703 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-ce3014c2-2b12-40ea-b679-1d5d22d8e3c3 tempest-FlavorsAdminTestJSON-1048499169 tempest-FlavorsAdminTestJSON-1048499169-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 415 microversion: 2.1 time: 0.031139 Jul 23 21:14:07.398019 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 120/230] 10.222.0.17 () {58 vars in 1176 bytes} [Sat Jul 23 21:14:07 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 415 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:14:07.410957 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-2c389d5c-67d1-49e7-9c79-9e3cf2f6672b tempest-FlavorsAdminTestJSON-1048499169 tempest-FlavorsAdminTestJSON-1048499169-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:07.422099 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-2c389d5c-67d1-49e7-9c79-9e3cf2f6672b tempest-FlavorsAdminTestJSON-1048499169 tempest-FlavorsAdminTestJSON-1048499169-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 415 microversion: 2.1 time: 0.017178 Jul 23 21:14:07.428939 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 121/231] 10.222.0.17 () {58 vars in 1170 bytes} [Sat Jul 23 21:14:07 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 415 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:14:07.440093 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c34f55d2-7576-44c2-812a-a370f70930ba tempest-FlavorsAdminTestJSON-1048499169 tempest-FlavorsAdminTestJSON-1048499169-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:07.449602 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ef9ec9ba-3640-4664-9b36-d24b24bce94b tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 243 microversion: 2.1 time: 0.252845 Jul 23 21:14:07.450483 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 111/232] 10.222.0.17 () {60 vars in 1193 bytes} [Sat Jul 23 21:14:07 2022] POST /compute/v2.1/os-aggregates/10/action => generated 243 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:14:07.461474 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-89464a95-9df4-44fe-9813-97287abb59f9 tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:07.462553 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:07.462553 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:14:07.475802 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-c34f55d2-7576-44c2-812a-a370f70930ba tempest-FlavorsAdminTestJSON-1048499169 tempest-FlavorsAdminTestJSON-1048499169-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 415 microversion: 2.1 time: 0.045012 Jul 23 21:14:07.482795 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 122/233] 10.222.0.17 () {58 vars in 1168 bytes} [Sat Jul 23 21:14:07 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 415 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:14:07.482994 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-89464a95-9df4-44fe-9813-97287abb59f9 tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] 10.222.0.17 "GET /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.1 time: 0.024405 Jul 23 21:14:07.484846 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 112/234] 10.222.0.17 () {58 vars in 1142 bytes} [Sat Jul 23 21:14:07 2022] GET /compute/v2.1/os-aggregates => generated 246 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:14:07.488433 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-7c8c86c0-ba65-4f82-8876-61cedd0b9cc9 tempest-FlavorsAdminTestJSON-1048499169 tempest-FlavorsAdminTestJSON-1048499169-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:07.494592 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-cdb09f57-bd1a-482c-b3db-f13506c17e16 tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:14:07.507028 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:07.507028 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:14:07.534153 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cdb09f57-bd1a-482c-b3db-f13506c17e16 tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:07.534753 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cdb09f57-bd1a-482c-b3db-f13506c17e16 tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:07.565116 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-7c8c86c0-ba65-4f82-8876-61cedd0b9cc9 tempest-FlavorsAdminTestJSON-1048499169 tempest-FlavorsAdminTestJSON-1048499169-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5392 microversion: 2.1 time: 0.077327 Jul 23 21:14:07.578679 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 123/235] 10.222.0.17 () {58 vars in 1168 bytes} [Sat Jul 23 21:14:07 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5392 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:14:07.586366 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-261a1574-cb67-4e68-afda-3f196b490bea tempest-FlavorsAdminTestJSON-1048499169 tempest-FlavorsAdminTestJSON-1048499169-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:07.596217 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=4,nova_api:DELETE=15 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:07.612649 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-261a1574-cb67-4e68-afda-3f196b490bea tempest-FlavorsAdminTestJSON-1048499169 tempest-FlavorsAdminTestJSON-1048499169-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5392 microversion: 2.1 time: 0.032329 Jul 23 21:14:07.614156 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 124/236] 10.222.0.17 () {58 vars in 1174 bytes} [Sat Jul 23 21:14:07 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5392 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:14:07.653801 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-2d79170c-739d-4bed-b071-e2a77abd1bf6 tempest-FlavorsAdminTestJSON-1048499169 tempest-FlavorsAdminTestJSON-1048499169-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:07.704557 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-2d79170c-739d-4bed-b071-e2a77abd1bf6 tempest-FlavorsAdminTestJSON-1048499169 tempest-FlavorsAdminTestJSON-1048499169-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5392 microversion: 2.1 time: 0.075957 Jul 23 21:14:07.705956 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 125/237] 10.222.0.17 () {58 vars in 1172 bytes} [Sat Jul 23 21:14:07 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5392 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:14:07.720487 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-07b054ed-7cda-4f7b-94c7-7876f9a0ef26 tempest-FlavorsAdminTestJSON-1048499169 tempest-FlavorsAdminTestJSON-1048499169-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:07.756263 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-07b054ed-7cda-4f7b-94c7-7876f9a0ef26 tempest-FlavorsAdminTestJSON-1048499169 tempest-FlavorsAdminTestJSON-1048499169-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5392 microversion: 2.1 time: 0.039179 Jul 23 21:14:07.757252 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 126/238] 10.222.0.17 () {58 vars in 1168 bytes} [Sat Jul 23 21:14:07 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5392 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:14:07.772701 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-cdb09f57-bd1a-482c-b3db-f13506c17e16 tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 228 microversion: 2.1 time: 0.282502 Jul 23 21:14:07.773587 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 113/239] 10.222.0.17 () {60 vars in 1193 bytes} [Sat Jul 23 21:14:07 2022] POST /compute/v2.1/os-aggregates/10/action => generated 228 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:14:07.776803 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-dc7de063-8ad5-4934-ae2e-6c36c9adf435 tempest-FlavorsAdminTestJSON-1048499169 tempest-FlavorsAdminTestJSON-1048499169-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:07.778361 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:07.778361 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:14:07.784719 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1d508dc6-782d-46c4-ace4-9269faa68cec tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:07.785680 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:07.785680 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:14:07.805209 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-dc7de063-8ad5-4934-ae2e-6c36c9adf435 tempest-FlavorsAdminTestJSON-1048499169 tempest-FlavorsAdminTestJSON-1048499169-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/751459522" status: 202 len: 0 microversion: 2.1 time: 0.032651 Jul 23 21:14:07.806312 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 127/240] 10.222.0.17 () {58 vars in 1157 bytes} [Sat Jul 23 21:14:07 2022] DELETE /compute/v2.1/flavors/751459522 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:14:07.816562 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-b38c0235-f15d-47ef-b614-6d706fdee66f tempest-FlavorsAdminTestJSON-1048499169 tempest-FlavorsAdminTestJSON-1048499169-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:07.827265 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1d508dc6-782d-46c4-ace4-9269faa68cec tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.047436 Jul 23 21:14:07.828309 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 114/241] 10.222.0.17 () {58 vars in 1154 bytes} [Sat Jul 23 21:14:07 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 23 21:14:07.839556 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-7ad40ce8-9804-44cd-8f68-a38d7d28b0ea tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1774340370"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:14:07.843770 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:07.843770 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:14:07.844803 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.objects.aggregate [None req-7ad40ce8-9804-44cd-8f68-a38d7d28b0ea tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] Generated uuid 7ab3e93f-4957-49eb-b53a-33d6129191df for aggregate {{(pid=131320) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 23 21:14:07.859799 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-b38c0235-f15d-47ef-b614-6d706fdee66f tempest-FlavorsAdminTestJSON-1048499169 tempest-FlavorsAdminTestJSON-1048499169-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.043880 Jul 23 21:14:07.863829 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 128/242] 10.222.0.17 () {58 vars in 1145 bytes} [Sat Jul 23 21:14:07 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:14:07.875294 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-5c741972-1d99-411f-8d31-9975ff564460 tempest-FlavorsAdminTestJSON-1048499169 tempest-FlavorsAdminTestJSON-1048499169-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:07.890814 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-7ad40ce8-9804-44cd-8f68-a38d7d28b0ea tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.055303 Jul 23 21:14:07.891366 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 115/243] 10.222.0.17 () {60 vars in 1163 bytes} [Sat Jul 23 21:14:07 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:14:07.902274 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2cde5ee6-7f54-4854-a110-fa738360fb22 tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:14:07.903589 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:07.903589 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:14:07.907875 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-5c741972-1d99-411f-8d31-9975ff564460 tempest-FlavorsAdminTestJSON-1048499169 tempest-FlavorsAdminTestJSON-1048499169-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/935385587" status: 202 len: 0 microversion: 2.1 time: 0.036419 Jul 23 21:14:07.908756 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 129/244] 10.222.0.17 () {58 vars in 1157 bytes} [Sat Jul 23 21:14:07 2022] DELETE /compute/v2.1/flavors/935385587 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 23 21:14:07.921180 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2cde5ee6-7f54-4854-a110-fa738360fb22 tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:07.921823 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2cde5ee6-7f54-4854-a110-fa738360fb22 tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:07.929211 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a15b9a24-d0f2-463f-bf99-656a1f6f000b tempest-FlavorsAdminTestJSON-1048499169 tempest-FlavorsAdminTestJSON-1048499169-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:07.961101 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-a15b9a24-d0f2-463f-bf99-656a1f6f000b tempest-FlavorsAdminTestJSON-1048499169 tempest-FlavorsAdminTestJSON-1048499169-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.045901 Jul 23 21:14:07.962121 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 130/245] 10.222.0.17 () {58 vars in 1145 bytes} [Sat Jul 23 21:14:07 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:14:07.981847 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-cc1a2555-945b-4552-b9d5-dcfb8a976530 tempest-FlavorsAdminTestJSON-1048499169 tempest-FlavorsAdminTestJSON-1048499169-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-227786134", "id": 66363759, "os-flavor-access:is_public": "False"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:14:08.019561 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-cc1a2555-945b-4552-b9d5-dcfb8a976530 tempest-FlavorsAdminTestJSON-1048499169 tempest-FlavorsAdminTestJSON-1048499169-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.1 time: 0.044050 Jul 23 21:14:08.020320 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 131/246] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:14:07 2022] POST /compute/v2.1/flavors => generated 408 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:14:08.038688 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-fc7ef0d9-ff69-4221-9fc7-66138a51c31a tempest-FlavorsAdminTestJSON-1048499169 tempest-FlavorsAdminTestJSON-1048499169-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:08.073028 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-fc7ef0d9-ff69-4221-9fc7-66138a51c31a tempest-FlavorsAdminTestJSON-1048499169 tempest-FlavorsAdminTestJSON-1048499169-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.045579 Jul 23 21:14:08.075069 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 132/247] 10.222.0.17 () {58 vars in 1145 bytes} [Sat Jul 23 21:14:08 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:14:08.092877 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-56c13c78-8a81-4e12-9f07-e21a39c08490 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:08.093707 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-56c13c78-8a81-4e12-9f07-e21a39c08490 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 769ee4e5-e4df-4d4e-9f4c-6372c60d9e01] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:14:08.103483 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2cde5ee6-7f54-4854-a110-fa738360fb22 tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 243 microversion: 2.1 time: 0.204770 Jul 23 21:14:08.104066 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 116/248] 10.222.0.17 () {60 vars in 1193 bytes} [Sat Jul 23 21:14:07 2022] POST /compute/v2.1/os-aggregates/11/action => generated 243 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:14:08.110382 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-56c13c78-8a81-4e12-9f07-e21a39c08490 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:08.111219 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-56c13c78-8a81-4e12-9f07-e21a39c08490 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:08.112561 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-56c13c78-8a81-4e12-9f07-e21a39c08490 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:08.113572 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-56c13c78-8a81-4e12-9f07-e21a39c08490 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:08.123142 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-67c990be-ffb2-41e4-9323-488bf0ab4414 tempest-FlavorsAdminTestJSON-46324727 tempest-FlavorsAdminTestJSON-46324727-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:08.158525 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-67c990be-ffb2-41e4-9323-488bf0ab4414 tempest-FlavorsAdminTestJSON-46324727 tempest-FlavorsAdminTestJSON-46324727-project] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.047035 Jul 23 21:14:08.159934 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 117/249] 10.222.0.17 () {58 vars in 1145 bytes} [Sat Jul 23 21:14:08 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:14:08.166595 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b58a6ba6-12a7-4d19-ae78-d73ee5db2e40 tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:14:08.168107 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:08.168107 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:14:08.180186 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b58a6ba6-12a7-4d19-ae78-d73ee5db2e40 tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:08.181303 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b58a6ba6-12a7-4d19-ae78-d73ee5db2e40 tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:08.369207 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b58a6ba6-12a7-4d19-ae78-d73ee5db2e40 tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 228 microversion: 2.1 time: 0.206095 Jul 23 21:14:08.370956 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 118/250] 10.222.0.17 () {60 vars in 1193 bytes} [Sat Jul 23 21:14:08 2022] POST /compute/v2.1/os-aggregates/11/action => generated 228 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:14:08.384836 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-23baaa5f-82b9-4bee-b818-4bf408f0cf38 tempest-FlavorsAdminTestJSON-1048499169 tempest-FlavorsAdminTestJSON-1048499169-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:08.385403 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:08.385403 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:14:08.426325 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-23baaa5f-82b9-4bee-b818-4bf408f0cf38 tempest-FlavorsAdminTestJSON-1048499169 tempest-FlavorsAdminTestJSON-1048499169-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/66363759" status: 202 len: 0 microversion: 2.1 time: 0.051294 Jul 23 21:14:08.427588 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 119/251] 10.222.0.17 () {58 vars in 1154 bytes} [Sat Jul 23 21:14:08 2022] DELETE /compute/v2.1/flavors/66363759 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:14:08.435811 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5e025c53-b44a-4672-9f74-fa7cfc6e6a3d tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:08.436764 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5e025c53-b44a-4672-9f74-fa7cfc6e6a3d tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] [instance: 67f35bb9-3208-4a6f-bccd-91c993e5d0be] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:14:08.452477 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5e025c53-b44a-4672-9f74-fa7cfc6e6a3d tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:08.453072 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5e025c53-b44a-4672-9f74-fa7cfc6e6a3d tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:08.455284 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5e025c53-b44a-4672-9f74-fa7cfc6e6a3d tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:08.457806 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5e025c53-b44a-4672-9f74-fa7cfc6e6a3d tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:08.524832 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-56c13c78-8a81-4e12-9f07-e21a39c08490 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:08.536583 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-56c13c78-8a81-4e12-9f07-e21a39c08490 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/769ee4e5-e4df-4d4e-9f4c-6372c60d9e01" status: 200 len: 1270 microversion: 2.1 time: 0.459237 Jul 23 21:14:08.542190 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 133/252] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:14:08 2022] GET /compute/v2.1/servers/769ee4e5-e4df-4d4e-9f4c-6372c60d9e01 => generated 1270 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:14:08.558579 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-03637b33-04e9-432d-a98b-c8bdf7cab4b3 tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:08.559510 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:08.559510 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:14:08.629628 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-03637b33-04e9-432d-a98b-c8bdf7cab4b3 tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.086216 Jul 23 21:14:08.632553 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 134/253] 10.222.0.17 () {58 vars in 1154 bytes} [Sat Jul 23 21:14:08 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 23 21:14:08.654614 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c84d4231-efda-466c-bf4a-b13ee10c86d1 tempest-FlavorsAdminTestJSON-1048499169 tempest-FlavorsAdminTestJSON-1048499169-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:08.710379 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-c84d4231-efda-466c-bf4a-b13ee10c86d1 tempest-FlavorsAdminTestJSON-1048499169 tempest-FlavorsAdminTestJSON-1048499169-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.075907 Jul 23 21:14:08.711013 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 135/254] 10.222.0.17 () {58 vars in 1145 bytes} [Sat Jul 23 21:14:08 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:14:08.749364 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-fe7a7d00-00f0-40a0-b0b8-02b54b1e49f2 tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-698890390"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:14:08.751556 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:08.751556 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:14:08.754778 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.objects.aggregate [None req-fe7a7d00-00f0-40a0-b0b8-02b54b1e49f2 tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] Generated uuid 5af54e3f-3c46-4275-b376-89273d150268 for aggregate {{(pid=131321) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 23 21:14:08.824296 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-fe7a7d00-00f0-40a0-b0b8-02b54b1e49f2 tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.112167 Jul 23 21:14:08.833969 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 136/255] 10.222.0.17 () {60 vars in 1163 bytes} [Sat Jul 23 21:14:08 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:14:08.849815 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e02584cf-d63e-49a6-b765-15997a7b1ee1 tempest-HostsAdminTestJSON-859142898 tempest-HostsAdminTestJSON-859142898-project-admin] Calling method '.version_select at 0x7f0b5496a700>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:08.854502 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:08.854502 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:14:08.855995 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e02584cf-d63e-49a6-b765-15997a7b1ee1 tempest-HostsAdminTestJSON-859142898 tempest-HostsAdminTestJSON-859142898-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:08.859648 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e02584cf-d63e-49a6-b765-15997a7b1ee1 tempest-HostsAdminTestJSON-859142898 tempest-HostsAdminTestJSON-859142898-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:08.862854 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e02584cf-d63e-49a6-b765-15997a7b1ee1 tempest-HostsAdminTestJSON-859142898 tempest-HostsAdminTestJSON-859142898-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:08.863617 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e02584cf-d63e-49a6-b765-15997a7b1ee1 tempest-HostsAdminTestJSON-859142898 tempest-HostsAdminTestJSON-859142898-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:08.925076 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5e025c53-b44a-4672-9f74-fa7cfc6e6a3d tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199522d29cb746379cb6f75d4b108cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07101aee06ca4bb6885f87cfec3257db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:08.945605 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5e025c53-b44a-4672-9f74-fa7cfc6e6a3d tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] 10.222.0.17 "GET /compute/v2.1/servers/67f35bb9-3208-4a6f-bccd-91c993e5d0be" status: 200 len: 1320 microversion: 2.1 time: 0.515291 Jul 23 21:14:08.947810 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 120/256] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:14:08 2022] GET /compute/v2.1/servers/67f35bb9-3208-4a6f-bccd-91c993e5d0be => generated 1320 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:14:08.975438 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-e02584cf-d63e-49a6-b765-15997a7b1ee1 tempest-HostsAdminTestJSON-859142898 tempest-HostsAdminTestJSON-859142898-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.135244 Jul 23 21:14:08.976821 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 137/257] 10.222.0.17 () {58 vars in 1127 bytes} [Sat Jul 23 21:14:08 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:14:08.997250 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ed774260-dfd6-483a-bbe7-51b5fddbf4c6 tempest-FlavorsAdminTestJSON-1048499169 tempest-FlavorsAdminTestJSON-1048499169-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-2008123754", "id": 958389986, "os-flavor-access:is_public": "True"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:14:09.001408 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:09.001408 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:14:09.032773 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-ed774260-dfd6-483a-bbe7-51b5fddbf4c6 tempest-FlavorsAdminTestJSON-1048499169 tempest-FlavorsAdminTestJSON-1048499169-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.053827 Jul 23 21:14:09.033665 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 138/258] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:14:08 2022] POST /compute/v2.1/flavors => generated 411 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:14:09.061036 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d5301623-1af6-48f3-86a1-5d858e76b23b tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:09.062173 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:09.062173 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:14:09.106401 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-d5301623-1af6-48f3-86a1-5d858e76b23b tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.058158 Jul 23 21:14:09.113067 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 139/259] 10.222.0.17 () {58 vars in 1154 bytes} [Sat Jul 23 21:14:09 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 23 21:14:09.122133 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-189399fc-9fd9-4676-a5e2-85889ced882c tempest-HostsAdminTestJSON-859142898 tempest-HostsAdminTestJSON-859142898-project-admin] Calling method '.version_select at 0x7f0b54abc700>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:09.127347 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:09.127347 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:14:09.136843 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-189399fc-9fd9-4676-a5e2-85889ced882c tempest-HostsAdminTestJSON-859142898 tempest-HostsAdminTestJSON-859142898-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:09.138890 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-189399fc-9fd9-4676-a5e2-85889ced882c tempest-HostsAdminTestJSON-859142898 tempest-HostsAdminTestJSON-859142898-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:09.143581 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-189399fc-9fd9-4676-a5e2-85889ced882c tempest-HostsAdminTestJSON-859142898 tempest-HostsAdminTestJSON-859142898-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:09.144440 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-189399fc-9fd9-4676-a5e2-85889ced882c tempest-HostsAdminTestJSON-859142898 tempest-HostsAdminTestJSON-859142898-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:09.163775 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:09.206138 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-189399fc-9fd9-4676-a5e2-85889ced882c tempest-HostsAdminTestJSON-859142898 tempest-HostsAdminTestJSON-859142898-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 239 microversion: 2.1 time: 0.089563 Jul 23 21:14:09.207476 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 140/260] 10.222.0.17 () {58 vars in 1154 bytes} [Sat Jul 23 21:14:09 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 239 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:14:09.224343 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-9b497936-0db9-40e0-b5d6-a07d47f0e066 tempest-FlavorsAdminTestJSON-46324727 tempest-FlavorsAdminTestJSON-46324727-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:09.254042 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-9b497936-0db9-40e0-b5d6-a07d47f0e066 tempest-FlavorsAdminTestJSON-46324727 tempest-FlavorsAdminTestJSON-46324727-project] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 5392 microversion: 2.1 time: 0.045150 Jul 23 21:14:09.254722 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 141/261] 10.222.0.17 () {58 vars in 1145 bytes} [Sat Jul 23 21:14:09 2022] GET /compute/v2.1/flavors/detail => generated 5392 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:14:09.259429 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-62846e08-937b-478a-a233-91983bf22f5d tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:09.260558 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:09.260558 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:14:09.272122 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-62846e08-937b-478a-a233-91983bf22f5d tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] HTTP exception thrown: Aggregate 12 could not be found. Jul 23 21:14:09.276742 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-62846e08-937b-478a-a233-91983bf22f5d tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] Request method failure captured: Jul 23 21:14:09.276742 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/os-aggregates/12 HTTP/1.1 Jul 23 21:14:09.276742 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:14:09.276742 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:14:09.276742 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:14:09.276742 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:14:09.276742 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:14:09.276742 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:14:09.276742 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:14:09.276742 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:14:09.276742 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GR4eXepWxdRHZ5IUe72SN2eA3EowLzwOW31DT1rJEtbSOxr2CxWfDf1g7FdKoHV3z_vxwcXUaB-bzf2B2ccQx8IJLBn1ZIIyO_i3qtdap59yjjWzso1WUuDrYBsdlYdXidCr--_FKkp2BlJJxx5urvqvEeJ2aA_7rxGtxJ_18yTprg Jul 23 21:14:09.276742 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:14:09.276742 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:14:09.276742 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:14:09.276742 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:14:09.276742 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:14:09.276742 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:14:09.276742 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: e9da90b237c34e5dad70af3cd2742be5 Jul 23 21:14:09.276742 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-AggregatesAdminTestJSON-1167455090 Jul 23 21:14:09.276742 ncdv-master-1 devstack@n-api.service[131321]: X-Role: admin,reader,member Jul 23 21:14:09.276742 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: admin,reader,member Jul 23 21:14:09.278475 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e9da90b237c34e5dad70af3cd2742be5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e9da90b237c34e5dad70af3cd2742be5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e9da90b237c34e5dad70af3cd2742be5", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e9da90b237c34e5dad70af3cd2742be5"}]}] Jul 23 21:14:09.278475 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-AggregatesAdminTestJSON-1167455090 Jul 23 21:14:09.278475 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: e9da90b237c34e5dad70af3cd2742be5 Jul 23 21:14:09.278475 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1167455090 Jul 23 21:14:09.278475 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-AggregatesAdminTestJSON-1167455090-project-admin Jul 23 21:14:09.278475 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:14:09.278475 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:14:09.278475 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: ff29128277cb4b6eaf78a8a62dd2b725 Jul 23 21:14:09.278475 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-AggregatesAdminTestJSON-1167455090-project-admin Jul 23 21:14:09.278475 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:14:09.278475 ncdv-master-1 devstack@n-api.service[131321]: exception: Aggregate 12 could not be found. Jul 23 21:14:09.278475 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': '12'} Jul 23 21:14:09.278475 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:14:09.279344 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:09.279344 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jul 23 21:14:09.279344 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jul 23 21:14:09.279344 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate Jul 23 21:14:09.279344 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jul 23 21:14:09.279344 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 23 21:14:09.279344 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 23 21:14:09.279344 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 23 21:14:09.279344 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 23 21:14:09.279344 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 23 21:14:09.279344 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 23 21:14:09.279344 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 23 21:14:09.279344 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 23 21:14:09.279344 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 12 could not be found. Jul 23 21:14:09.279344 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:09.279344 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:14:09.279344 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:09.279344 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:09.279344 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:14:09.280677 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:14:09.280677 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:14:09.280677 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:14:09.280677 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:14:09.280677 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:14:09.280677 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jul 23 21:14:09.280677 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:14:09.280677 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 12 could not be found. Jul 23 21:14:09.280677 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:09.280677 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:14:09.280677 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:09.280677 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:09.280677 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:14:09.280677 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:14:09.280677 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:14:09.280677 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:14:09.280677 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 12 could not be found. Jul 23 21:14:09.280677 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:09.288608 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-62846e08-937b-478a-a233-91983bf22f5d tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] Returning 404 to user: Aggregate 12 could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:14:09.295365 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-62846e08-937b-478a-a233-91983bf22f5d tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] 10.222.0.17 "GET /compute/v2.1/os-aggregates/12" status: 404 len: 78 microversion: 2.1 time: 0.039287 Jul 23 21:14:09.297039 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 142/262] 10.222.0.17 () {58 vars in 1151 bytes} [Sat Jul 23 21:14:09 2022] GET /compute/v2.1/os-aggregates/12 => generated 78 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 23 21:14:09.307320 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-8050643b-c696-4340-a249-6706b9151dbf tempest-HostsAdminTestJSON-859142898 tempest-HostsAdminTestJSON-859142898-project-admin] Calling method '.version_select at 0x7f0b549efee0>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:09.309459 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:09.309459 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:14:09.312162 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8050643b-c696-4340-a249-6706b9151dbf tempest-HostsAdminTestJSON-859142898 tempest-HostsAdminTestJSON-859142898-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:09.312826 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8050643b-c696-4340-a249-6706b9151dbf tempest-HostsAdminTestJSON-859142898 tempest-HostsAdminTestJSON-859142898-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:09.315778 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8050643b-c696-4340-a249-6706b9151dbf tempest-HostsAdminTestJSON-859142898 tempest-HostsAdminTestJSON-859142898-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:09.316947 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8050643b-c696-4340-a249-6706b9151dbf tempest-HostsAdminTestJSON-859142898 tempest-HostsAdminTestJSON-859142898-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:09.369052 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-8050643b-c696-4340-a249-6706b9151dbf tempest-HostsAdminTestJSON-859142898 tempest-HostsAdminTestJSON-859142898-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.069278 Jul 23 21:14:09.378016 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 143/263] 10.222.0.17 () {58 vars in 1127 bytes} [Sat Jul 23 21:14:09 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:14:09.395612 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-6e5a7920-9641-42bc-8b7b-77bed7b861ac tempest-FlavorsAdminTestJSON-1048499169 tempest-FlavorsAdminTestJSON-1048499169-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:09.404450 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:09.404450 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:14:09.445825 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-20c9cca7-a7e3-45d8-be33-690fb5619045 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-694308112", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "networks": [{"uuid": "dfe0034d-5d2d-4ce5-b256-d87bd84ec0c2"}]}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:14:09.448262 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-6e5a7920-9641-42bc-8b7b-77bed7b861ac tempest-FlavorsAdminTestJSON-1048499169 tempest-FlavorsAdminTestJSON-1048499169-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/958389986" status: 202 len: 0 microversion: 2.1 time: 0.068388 Jul 23 21:14:09.450426 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 144/264] 10.222.0.17 () {58 vars in 1157 bytes} [Sat Jul 23 21:14:09 2022] DELETE /compute/v2.1/flavors/958389986 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:14:09.464043 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-b68cb79b-b4d1-47a7-a90b-b6e0387bd83c tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:09.465006 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:09.465006 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:14:09.505653 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-b68cb79b-b4d1-47a7-a90b-b6e0387bd83c tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] HTTP exception thrown: Aggregate 12 could not be found. Jul 23 21:14:09.507401 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-b68cb79b-b4d1-47a7-a90b-b6e0387bd83c tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] Request method failure captured: Jul 23 21:14:09.507401 ncdv-master-1 devstack@n-api.service[131321]: request: DELETE /compute/v2.1/os-aggregates/12 HTTP/1.1 Jul 23 21:14:09.507401 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:14:09.507401 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:14:09.507401 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:14:09.507401 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:14:09.507401 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:14:09.507401 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:14:09.507401 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:14:09.507401 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:14:09.507401 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GR4eXepWxdRHZ5IUe72SN2eA3EowLzwOW31DT1rJEtbSOxr2CxWfDf1g7FdKoHV3z_vxwcXUaB-bzf2B2ccQx8IJLBn1ZIIyO_i3qtdap59yjjWzso1WUuDrYBsdlYdXidCr--_FKkp2BlJJxx5urvqvEeJ2aA_7rxGtxJ_18yTprg Jul 23 21:14:09.507401 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:14:09.507401 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:14:09.507401 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:14:09.507401 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:14:09.507401 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:14:09.507401 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:14:09.507401 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: e9da90b237c34e5dad70af3cd2742be5 Jul 23 21:14:09.507401 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-AggregatesAdminTestJSON-1167455090 Jul 23 21:14:09.507401 ncdv-master-1 devstack@n-api.service[131321]: X-Role: admin,reader,member Jul 23 21:14:09.507401 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: admin,reader,member Jul 23 21:14:09.508621 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e9da90b237c34e5dad70af3cd2742be5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e9da90b237c34e5dad70af3cd2742be5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e9da90b237c34e5dad70af3cd2742be5", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e9da90b237c34e5dad70af3cd2742be5"}]}] Jul 23 21:14:09.508621 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-AggregatesAdminTestJSON-1167455090 Jul 23 21:14:09.508621 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: e9da90b237c34e5dad70af3cd2742be5 Jul 23 21:14:09.508621 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1167455090 Jul 23 21:14:09.508621 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-AggregatesAdminTestJSON-1167455090-project-admin Jul 23 21:14:09.508621 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:14:09.508621 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:14:09.508621 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: ff29128277cb4b6eaf78a8a62dd2b725 Jul 23 21:14:09.508621 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-AggregatesAdminTestJSON-1167455090-project-admin Jul 23 21:14:09.508621 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:14:09.508621 ncdv-master-1 devstack@n-api.service[131321]: exception: Aggregate 12 could not be found. Jul 23 21:14:09.508621 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': '12'} Jul 23 21:14:09.508621 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:14:09.509315 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:09.509315 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jul 23 21:14:09.509315 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jul 23 21:14:09.509315 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 23 21:14:09.509315 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 23 21:14:09.509315 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 23 21:14:09.509315 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 23 21:14:09.509315 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 23 21:14:09.509315 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise self.value Jul 23 21:14:09.509315 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 23 21:14:09.509315 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 23 21:14:09.509315 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate Jul 23 21:14:09.509315 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jul 23 21:14:09.509315 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 23 21:14:09.509315 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 23 21:14:09.509315 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 23 21:14:09.509315 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 23 21:14:09.509315 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 23 21:14:09.509315 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 23 21:14:09.510778 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 23 21:14:09.510778 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 23 21:14:09.510778 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 12 could not be found. Jul 23 21:14:09.510778 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:09.510778 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:14:09.510778 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:09.510778 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:09.510778 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:14:09.510778 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:14:09.510778 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:14:09.510778 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:14:09.510778 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:14:09.510778 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:14:09.510778 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jul 23 21:14:09.510778 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:14:09.510778 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 12 could not be found. Jul 23 21:14:09.510778 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:09.510778 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:14:09.510778 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:09.510778 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:09.510778 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:14:09.519234 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:14:09.519234 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:14:09.519234 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:14:09.519234 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 12 could not be found. Jul 23 21:14:09.519234 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:09.519234 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-b68cb79b-b4d1-47a7-a90b-b6e0387bd83c tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] Returning 404 to user: Aggregate 12 could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:14:09.519234 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-b68cb79b-b4d1-47a7-a90b-b6e0387bd83c tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-aggregates/12" status: 404 len: 78 microversion: 2.1 time: 0.057347 Jul 23 21:14:09.519234 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 145/265] 10.222.0.17 () {58 vars in 1154 bytes} [Sat Jul 23 21:14:09 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 78 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 23 21:14:09.524558 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-010c1beb-fb2d-4466-8461-f4949e3666a0 tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1788984816"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:14:09.537461 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:09.537461 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:14:09.538579 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.objects.aggregate [None req-010c1beb-fb2d-4466-8461-f4949e3666a0 tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] Generated uuid 4d1a385f-2d6e-404f-9cc0-4087509b6004 for aggregate {{(pid=131321) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 23 21:14:09.587355 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-20c9cca7-a7e3-45d8-be33-690fb5619045 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] validate_networks() for [('dfe0034d-5d2d-4ce5-b256-d87bd84ec0c2', None, None, None, None, None)] {{(pid=131320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:14:09.619099 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-010c1beb-fb2d-4466-8461-f4949e3666a0 tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.108721 Jul 23 21:14:09.619790 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 146/266] 10.222.0.17 () {60 vars in 1163 bytes} [Sat Jul 23 21:14:09 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:14:09.627329 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-77f4ade1-866d-4ad2-86be-1245ee33c7be tempest-HostsAdminTestJSON-859142898 tempest-HostsAdminTestJSON-859142898-project-admin] Calling method '.version_select at 0x7f0b548ad430>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:09.628205 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:09.628205 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:14:09.635531 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-77f4ade1-866d-4ad2-86be-1245ee33c7be tempest-HostsAdminTestJSON-859142898 tempest-HostsAdminTestJSON-859142898-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:09.636203 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-77f4ade1-866d-4ad2-86be-1245ee33c7be tempest-HostsAdminTestJSON-859142898 tempest-HostsAdminTestJSON-859142898-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:09.663596 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-77f4ade1-866d-4ad2-86be-1245ee33c7be tempest-HostsAdminTestJSON-859142898 tempest-HostsAdminTestJSON-859142898-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:09.664224 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-77f4ade1-866d-4ad2-86be-1245ee33c7be tempest-HostsAdminTestJSON-859142898 tempest-HostsAdminTestJSON-859142898-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:09.688604 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-77f4ade1-866d-4ad2-86be-1245ee33c7be tempest-HostsAdminTestJSON-859142898 tempest-HostsAdminTestJSON-859142898-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hosts/nch2-master-1" status: 200 len: 467 microversion: 2.1 time: 0.067007 Jul 23 21:14:09.689493 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 147/267] 10.222.0.17 () {58 vars in 1169 bytes} [Sat Jul 23 21:14:09 2022] GET /compute/v2.1/os-hosts/nch2-master-1 => generated 467 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:14:09.696064 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-4f110c4a-751c-4d92-947d-55a8922f2e89 tempest-FlavorsAdminTestJSON-1048499169 tempest-FlavorsAdminTestJSON-1048499169-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:09.725567 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-4f110c4a-751c-4d92-947d-55a8922f2e89 tempest-FlavorsAdminTestJSON-1048499169 tempest-FlavorsAdminTestJSON-1048499169-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.034810 Jul 23 21:14:09.726459 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 148/268] 10.222.0.17 () {58 vars in 1145 bytes} [Sat Jul 23 21:14:09 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:14:09.731609 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-3a8cd596-8bfe-45fe-a21c-6011e7ab3c6d tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1063169235", "name": "tempest-test_aggregate-1609626936"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:14:09.761305 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:09.761305 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:14:09.762717 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.objects.aggregate [None req-3a8cd596-8bfe-45fe-a21c-6011e7ab3c6d tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] Generated uuid f393f7d7-09de-405e-83bc-4d58d73f75c9 for aggregate {{(pid=131321) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 23 21:14:09.815634 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-3a8cd596-8bfe-45fe-a21c-6011e7ab3c6d tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates" status: 200 len: 223 microversion: 2.1 time: 0.080334 Jul 23 21:14:09.816487 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 149/269] 10.222.0.17 () {60 vars in 1164 bytes} [Sat Jul 23 21:14:09 2022] POST /compute/v2.1/os-aggregates => generated 223 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:14:09.832782 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f0c82bfa-cb62-4679-a8f5-26987f4712a2 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:09.833911 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-f0c82bfa-cb62-4679-a8f5-26987f4712a2 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 769ee4e5-e4df-4d4e-9f4c-6372c60d9e01] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:14:09.842680 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f0c82bfa-cb62-4679-a8f5-26987f4712a2 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:09.843468 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f0c82bfa-cb62-4679-a8f5-26987f4712a2 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:09.844750 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f0c82bfa-cb62-4679-a8f5-26987f4712a2 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:09.845385 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f0c82bfa-cb62-4679-a8f5-26987f4712a2 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:10.078291 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-f0c82bfa-cb62-4679-a8f5-26987f4712a2 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:10.089311 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-f0c82bfa-cb62-4679-a8f5-26987f4712a2 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/769ee4e5-e4df-4d4e-9f4c-6372c60d9e01" status: 200 len: 1312 microversion: 2.1 time: 0.271639 Jul 23 21:14:10.094685 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 150/270] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:14:09 2022] GET /compute/v2.1/servers/769ee4e5-e4df-4d4e-9f4c-6372c60d9e01 => generated 1312 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:14:10.104507 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-362d82bb-7dc3-455a-a46e-a187517f3d57 tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:14:10.113545 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:10.113545 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:14:10.138818 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-362d82bb-7dc3-455a-a46e-a187517f3d57 tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:10.139623 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-362d82bb-7dc3-455a-a46e-a187517f3d57 tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:10.150894 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=13,nova_api:INSERT=6 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:10.357624 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-362d82bb-7dc3-455a-a46e-a187517f3d57 tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 243 microversion: 2.1 time: 0.259299 Jul 23 21:14:10.358269 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 151/271] 10.222.0.17 () {60 vars in 1193 bytes} [Sat Jul 23 21:14:10 2022] POST /compute/v2.1/os-aggregates/13/action => generated 243 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:14:10.364933 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-dac845dc-84f1-46e2-a46c-b5489a31435a tempest-HostsAdminTestJSON-859142898 tempest-HostsAdminTestJSON-859142898-project-admin] Calling method '.version_select at 0x7f0b54889e50>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:10.365838 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:10.365838 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:14:10.373523 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-dac845dc-84f1-46e2-a46c-b5489a31435a tempest-HostsAdminTestJSON-859142898 tempest-HostsAdminTestJSON-859142898-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:10.374319 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-dac845dc-84f1-46e2-a46c-b5489a31435a tempest-HostsAdminTestJSON-859142898 tempest-HostsAdminTestJSON-859142898-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:10.391591 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-dac845dc-84f1-46e2-a46c-b5489a31435a tempest-HostsAdminTestJSON-859142898 tempest-HostsAdminTestJSON-859142898-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:10.392683 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-dac845dc-84f1-46e2-a46c-b5489a31435a tempest-HostsAdminTestJSON-859142898 tempest-HostsAdminTestJSON-859142898-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:10.418722 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-dac845dc-84f1-46e2-a46c-b5489a31435a tempest-HostsAdminTestJSON-859142898 tempest-HostsAdminTestJSON-859142898-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hosts/nch1-master-1" status: 200 len: 467 microversion: 2.1 time: 0.059358 Jul 23 21:14:10.419622 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 152/272] 10.222.0.17 () {58 vars in 1169 bytes} [Sat Jul 23 21:14:10 2022] GET /compute/v2.1/os-hosts/nch1-master-1 => generated 467 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:14:10.426184 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-28908d64-be76-4f7a-989d-085ce243d85d tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:10.427315 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:10.427315 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:14:10.480414 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-28908d64-be76-4f7a-989d-085ce243d85d tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.059499 Jul 23 21:14:10.481582 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 153/273] 10.222.0.17 () {58 vars in 1154 bytes} [Sat Jul 23 21:14:10 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 23 21:14:10.489807 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-4f2efea8-133a-4b38-aa7c-7cc36d43def1 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:10.490378 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-4f2efea8-133a-4b38-aa7c-7cc36d43def1 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] [instance: 67f35bb9-3208-4a6f-bccd-91c993e5d0be] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:14:10.507050 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4f2efea8-133a-4b38-aa7c-7cc36d43def1 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:10.507605 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4f2efea8-133a-4b38-aa7c-7cc36d43def1 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:10.508726 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4f2efea8-133a-4b38-aa7c-7cc36d43def1 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:10.509265 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4f2efea8-133a-4b38-aa7c-7cc36d43def1 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:10.786391 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-4f2efea8-133a-4b38-aa7c-7cc36d43def1 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199522d29cb746379cb6f75d4b108cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07101aee06ca4bb6885f87cfec3257db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:10.799575 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-4f2efea8-133a-4b38-aa7c-7cc36d43def1 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] 10.222.0.17 "GET /compute/v2.1/servers/67f35bb9-3208-4a6f-bccd-91c993e5d0be" status: 200 len: 1320 microversion: 2.1 time: 0.316171 Jul 23 21:14:10.802105 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 154/274] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:14:10 2022] GET /compute/v2.1/servers/67f35bb9-3208-4a6f-bccd-91c993e5d0be => generated 1320 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:14:10.807341 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-88d40620-bff9-4695-a90f-1ab304f1af2a tempest-AggregatesAdminNegativeTestJSON-1992080461 tempest-AggregatesAdminNegativeTestJSON-1992080461-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:14:10.808835 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:10.808835 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:14:10.809788 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-88d40620-bff9-4695-a90f-1ab304f1af2a tempest-AggregatesAdminNegativeTestJSON-1992080461 tempest-AggregatesAdminNegativeTestJSON-1992080461-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '0e1fdaed25764b15a6f74a925ee81499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '681566c31052436b9d2ce072e733f052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:10.811672 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-88d40620-bff9-4695-a90f-1ab304f1af2a tempest-AggregatesAdminNegativeTestJSON-1992080461 tempest-AggregatesAdminNegativeTestJSON-1992080461-project] Request method failure captured: Jul 23 21:14:10.811672 ncdv-master-1 devstack@n-api.service[131321]: request: POST /compute/v2.1/os-aggregates/13/action HTTP/1.1 Jul 23 21:14:10.811672 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:14:10.811672 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:14:10.811672 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:14:10.811672 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 42 Jul 23 21:14:10.811672 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:14:10.811672 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:14:10.811672 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:14:10.811672 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:14:10.811672 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GR24jg3yQ9a_OLew2TbSj5pMYp5j1hBxMQWU5sEwcOe7CdPvlT12VXYE2Y0x3X5Gp8wT4xTdui2HtNjAoc5xldp7LrpNoQKXHKWpDnxijm5gqeiPXeVhEIavZ1o-cuLUTqgnQ0gnxh4oOZGKhPzWgzyuIHj9BN38CSod1QkRw4XpUw Jul 23 21:14:10.811672 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:14:10.811672 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:14:10.811672 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:14:10.811672 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:14:10.811672 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:14:10.811672 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:14:10.811672 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 681566c31052436b9d2ce072e733f052 Jul 23 21:14:10.811672 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1992080461 Jul 23 21:14:10.811672 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:14:10.811672 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:14:10.813052 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/681566c31052436b9d2ce072e733f052"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/681566c31052436b9d2ce072e733f052"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_681566c31052436b9d2ce072e733f052", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/681566c31052436b9d2ce072e733f052"}]}] Jul 23 21:14:10.813052 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1992080461 Jul 23 21:14:10.813052 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 681566c31052436b9d2ce072e733f052 Jul 23 21:14:10.813052 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1992080461 Jul 23 21:14:10.813052 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-AggregatesAdminNegativeTestJSON-1992080461-project Jul 23 21:14:10.813052 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:14:10.813052 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:14:10.813052 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 0e1fdaed25764b15a6f74a925ee81499 Jul 23 21:14:10.813052 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1992080461-project Jul 23 21:14:10.813052 ncdv-master-1 devstack@n-api.service[131321]: Jul 23 21:14:10.813052 ncdv-master-1 devstack@n-api.service[131321]: {"remove_host": {"host": "nch2-master-1"}} Jul 23 21:14:10.813052 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:14:10.813052 ncdv-master-1 devstack@n-api.service[131321]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jul 23 21:14:10.819397 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': '13', 'body': {'remove_host': {'host': 'nch2-master-1'}}} Jul 23 21:14:10.819397 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:14:10.819397 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:10.819397 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:14:10.819397 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:14:10.819397 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:14:10.819397 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:14:10.819397 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:14:10.819397 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:14:10.819397 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:14:10.819397 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:14:10.819397 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Jul 23 21:14:10.819397 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Jul 23 21:14:10.819397 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 23 21:14:10.819397 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 23 21:14:10.819397 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 23 21:14:10.819397 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 23 21:14:10.819397 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 23 21:14:10.819397 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 23 21:14:10.820752 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 23 21:14:10.820752 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise self.value Jul 23 21:14:10.820752 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 23 21:14:10.820752 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 23 21:14:10.820752 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 23 21:14:10.820752 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 23 21:14:10.820752 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 23 21:14:10.820752 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 23 21:14:10.820752 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jul 23 21:14:10.820752 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:10.820752 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:14:10.820752 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:10.820752 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:10.820752 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:14:10.820752 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:14:10.820752 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 23 21:14:10.820752 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 23 21:14:10.820752 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jul 23 21:14:10.820752 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:10.825907 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-88d40620-bff9-4695-a90f-1ab304f1af2a tempest-AggregatesAdminNegativeTestJSON-1992080461 tempest-AggregatesAdminNegativeTestJSON-1992080461-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:14:10.825907 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-88d40620-bff9-4695-a90f-1ab304f1af2a tempest-AggregatesAdminNegativeTestJSON-1992080461 tempest-AggregatesAdminNegativeTestJSON-1992080461-project] 10.222.0.17 "POST /compute/v2.1/os-aggregates/13/action" status: 403 len: 121 microversion: 2.1 time: 0.012371 Jul 23 21:14:10.825907 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 155/275] 10.222.0.17 () {60 vars in 1193 bytes} [Sat Jul 23 21:14:10 2022] POST /compute/v2.1/os-aggregates/13/action => generated 121 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:14:10.825907 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d22e8e39-dcfc-4d2f-b908-ddc77ed8622b tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:10.825907 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:10.825907 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:14:10.833215 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-d22e8e39-dcfc-4d2f-b908-ddc77ed8622b tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Jul 23 21:14:10.834959 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d22e8e39-dcfc-4d2f-b908-ddc77ed8622b tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] Request method failure captured: Jul 23 21:14:10.834959 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/os-aggregates/14 HTTP/1.1 Jul 23 21:14:10.834959 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:14:10.834959 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:14:10.834959 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:14:10.834959 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:14:10.834959 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:14:10.834959 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:14:10.834959 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:14:10.834959 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:14:10.834959 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GR4eXepWxdRHZ5IUe72SN2eA3EowLzwOW31DT1rJEtbSOxr2CxWfDf1g7FdKoHV3z_vxwcXUaB-bzf2B2ccQx8IJLBn1ZIIyO_i3qtdap59yjjWzso1WUuDrYBsdlYdXidCr--_FKkp2BlJJxx5urvqvEeJ2aA_7rxGtxJ_18yTprg Jul 23 21:14:10.834959 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:14:10.834959 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:14:10.834959 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:14:10.834959 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:14:10.834959 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:14:10.834959 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:14:10.834959 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: e9da90b237c34e5dad70af3cd2742be5 Jul 23 21:14:10.834959 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-AggregatesAdminTestJSON-1167455090 Jul 23 21:14:10.834959 ncdv-master-1 devstack@n-api.service[131321]: X-Role: admin,reader,member Jul 23 21:14:10.834959 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: admin,reader,member Jul 23 21:14:10.837126 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e9da90b237c34e5dad70af3cd2742be5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e9da90b237c34e5dad70af3cd2742be5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e9da90b237c34e5dad70af3cd2742be5", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e9da90b237c34e5dad70af3cd2742be5"}]}] Jul 23 21:14:10.837126 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-AggregatesAdminTestJSON-1167455090 Jul 23 21:14:10.837126 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: e9da90b237c34e5dad70af3cd2742be5 Jul 23 21:14:10.837126 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1167455090 Jul 23 21:14:10.837126 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-AggregatesAdminTestJSON-1167455090-project-admin Jul 23 21:14:10.837126 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:14:10.837126 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:14:10.837126 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: ff29128277cb4b6eaf78a8a62dd2b725 Jul 23 21:14:10.837126 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-AggregatesAdminTestJSON-1167455090-project-admin Jul 23 21:14:10.837126 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:14:10.837126 ncdv-master-1 devstack@n-api.service[131321]: exception: Aggregate 14 could not be found. Jul 23 21:14:10.837126 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': '14'} Jul 23 21:14:10.837126 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:14:10.838750 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:10.838750 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jul 23 21:14:10.838750 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jul 23 21:14:10.838750 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate Jul 23 21:14:10.838750 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jul 23 21:14:10.838750 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 23 21:14:10.838750 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 23 21:14:10.838750 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 23 21:14:10.838750 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 23 21:14:10.838750 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 23 21:14:10.838750 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 23 21:14:10.838750 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 23 21:14:10.838750 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 23 21:14:10.838750 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Jul 23 21:14:10.838750 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:10.838750 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:14:10.838750 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:10.838750 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:10.838750 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:14:10.844085 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:14:10.844085 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:14:10.844085 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:14:10.844085 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:14:10.844085 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:14:10.844085 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jul 23 21:14:10.844085 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:14:10.844085 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Jul 23 21:14:10.844085 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:10.844085 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:14:10.844085 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:10.844085 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:10.844085 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:14:10.844085 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:14:10.844085 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:14:10.844085 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:14:10.844085 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Jul 23 21:14:10.844085 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:10.846654 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d22e8e39-dcfc-4d2f-b908-ddc77ed8622b tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:14:10.846654 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-d22e8e39-dcfc-4d2f-b908-ddc77ed8622b tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] 10.222.0.17 "GET /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.021287 Jul 23 21:14:10.846654 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 156/276] 10.222.0.17 () {58 vars in 1151 bytes} [Sat Jul 23 21:14:10 2022] GET /compute/v2.1/os-aggregates/14 => generated 78 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 23 21:14:10.847466 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-230ddfc6-98c6-46c0-8778-f90ca524f7f8 req-ee05f382-cdfd-419d-87ec-9d94bd9ab56c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67f35bb9-3208-4a6f-bccd-91c993e5d0be", "tag": "92c4d90e-3729-42fa-90e2-afe182773805"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:14:10.856834 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-230ddfc6-98c6-46c0-8778-f90ca524f7f8 req-ee05f382-cdfd-419d-87ec-9d94bd9ab56c service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:10.857487 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-230ddfc6-98c6-46c0-8778-f90ca524f7f8 req-ee05f382-cdfd-419d-87ec-9d94bd9ab56c service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:10.869741 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-230ddfc6-98c6-46c0-8778-f90ca524f7f8 req-ee05f382-cdfd-419d-87ec-9d94bd9ab56c service nova] Creating event network-changed:92c4d90e-3729-42fa-90e2-afe182773805 for instance 67f35bb9-3208-4a6f-bccd-91c993e5d0be on nch2-master-1 Jul 23 21:14:10.875033 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-230ddfc6-98c6-46c0-8778-f90ca524f7f8 req-ee05f382-cdfd-419d-87ec-9d94bd9ab56c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032918 Jul 23 21:14:10.880303 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 157/277] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:14:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:14:10.889044 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-80e87e67-93e6-48a5-9621-0912ba4faa30 tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:14:10.891293 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:10.891293 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:14:10.905591 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-80e87e67-93e6-48a5-9621-0912ba4faa30 tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:10.907367 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-80e87e67-93e6-48a5-9621-0912ba4faa30 tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:11.109090 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-80e87e67-93e6-48a5-9621-0912ba4faa30 tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 228 microversion: 2.1 time: 0.219037 Jul 23 21:14:11.113141 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 158/278] 10.222.0.17 () {60 vars in 1193 bytes} [Sat Jul 23 21:14:10 2022] POST /compute/v2.1/os-aggregates/13/action => generated 228 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:14:11.128588 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-513b9078-e82e-4786-b9e6-e3c2c90af0ae tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:11.132843 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:11.132843 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:14:11.156823 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-513b9078-e82e-4786-b9e6-e3c2c90af0ae tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Jul 23 21:14:11.158829 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-513b9078-e82e-4786-b9e6-e3c2c90af0ae tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] Request method failure captured: Jul 23 21:14:11.158829 ncdv-master-1 devstack@n-api.service[131321]: request: DELETE /compute/v2.1/os-aggregates/14 HTTP/1.1 Jul 23 21:14:11.158829 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:14:11.158829 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:14:11.158829 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:14:11.158829 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:14:11.158829 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:14:11.158829 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:14:11.158829 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:14:11.158829 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:14:11.158829 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GR4eXepWxdRHZ5IUe72SN2eA3EowLzwOW31DT1rJEtbSOxr2CxWfDf1g7FdKoHV3z_vxwcXUaB-bzf2B2ccQx8IJLBn1ZIIyO_i3qtdap59yjjWzso1WUuDrYBsdlYdXidCr--_FKkp2BlJJxx5urvqvEeJ2aA_7rxGtxJ_18yTprg Jul 23 21:14:11.158829 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:14:11.158829 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:14:11.158829 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:14:11.158829 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:14:11.158829 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:14:11.158829 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:14:11.158829 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: e9da90b237c34e5dad70af3cd2742be5 Jul 23 21:14:11.158829 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-AggregatesAdminTestJSON-1167455090 Jul 23 21:14:11.158829 ncdv-master-1 devstack@n-api.service[131321]: X-Role: admin,reader,member Jul 23 21:14:11.158829 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: admin,reader,member Jul 23 21:14:11.160232 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e9da90b237c34e5dad70af3cd2742be5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e9da90b237c34e5dad70af3cd2742be5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e9da90b237c34e5dad70af3cd2742be5", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e9da90b237c34e5dad70af3cd2742be5"}]}] Jul 23 21:14:11.160232 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-AggregatesAdminTestJSON-1167455090 Jul 23 21:14:11.160232 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: e9da90b237c34e5dad70af3cd2742be5 Jul 23 21:14:11.160232 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1167455090 Jul 23 21:14:11.160232 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-AggregatesAdminTestJSON-1167455090-project-admin Jul 23 21:14:11.160232 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:14:11.160232 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:14:11.160232 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: ff29128277cb4b6eaf78a8a62dd2b725 Jul 23 21:14:11.160232 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-AggregatesAdminTestJSON-1167455090-project-admin Jul 23 21:14:11.160232 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:14:11.160232 ncdv-master-1 devstack@n-api.service[131321]: exception: Aggregate 14 could not be found. Jul 23 21:14:11.160232 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': '14'} Jul 23 21:14:11.160232 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:14:11.160942 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:11.160942 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jul 23 21:14:11.160942 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jul 23 21:14:11.160942 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 23 21:14:11.160942 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 23 21:14:11.160942 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 23 21:14:11.160942 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 23 21:14:11.160942 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 23 21:14:11.160942 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise self.value Jul 23 21:14:11.160942 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 23 21:14:11.160942 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 23 21:14:11.160942 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate Jul 23 21:14:11.160942 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jul 23 21:14:11.160942 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 23 21:14:11.160942 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 23 21:14:11.160942 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 23 21:14:11.160942 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 23 21:14:11.160942 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 23 21:14:11.160942 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 23 21:14:11.161945 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 23 21:14:11.161945 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 23 21:14:11.161945 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Jul 23 21:14:11.161945 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:11.161945 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:14:11.161945 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:11.161945 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:11.161945 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:14:11.161945 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:14:11.161945 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:14:11.161945 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:14:11.161945 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:14:11.161945 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:14:11.161945 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jul 23 21:14:11.161945 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:14:11.161945 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Jul 23 21:14:11.161945 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:11.161945 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:14:11.161945 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:11.161945 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:11.161945 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:14:11.163223 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:14:11.163223 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:14:11.163223 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:14:11.163223 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Jul 23 21:14:11.163223 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:11.163223 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-513b9078-e82e-4786-b9e6-e3c2c90af0ae tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:14:11.163223 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-513b9078-e82e-4786-b9e6-e3c2c90af0ae tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.046704 Jul 23 21:14:11.166088 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 159/279] 10.222.0.17 () {58 vars in 1154 bytes} [Sat Jul 23 21:14:11 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 78 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 23 21:14:11.181640 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-9fda2980-c819-4fba-a72c-72e8cf732b17 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:11.182685 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-9fda2980-c819-4fba-a72c-72e8cf732b17 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 769ee4e5-e4df-4d4e-9f4c-6372c60d9e01] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:14:11.191256 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9fda2980-c819-4fba-a72c-72e8cf732b17 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:11.191964 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9fda2980-c819-4fba-a72c-72e8cf732b17 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:11.192909 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9fda2980-c819-4fba-a72c-72e8cf732b17 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:11.193527 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9fda2980-c819-4fba-a72c-72e8cf732b17 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:11.422017 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-9fda2980-c819-4fba-a72c-72e8cf732b17 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:11.433416 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-9fda2980-c819-4fba-a72c-72e8cf732b17 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/769ee4e5-e4df-4d4e-9f4c-6372c60d9e01" status: 200 len: 1312 microversion: 2.1 time: 0.264342 Jul 23 21:14:11.437109 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 160/280] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:14:11 2022] GET /compute/v2.1/servers/769ee4e5-e4df-4d4e-9f4c-6372c60d9e01 => generated 1312 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:14:11.441812 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-690edee9-b65e-426a-a4cc-31ee9e6dc13f tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:11.442610 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:11.442610 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:14:11.487015 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-690edee9-b65e-426a-a4cc-31ee9e6dc13f tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.048778 Jul 23 21:14:11.491894 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 161/281] 10.222.0.17 () {58 vars in 1154 bytes} [Sat Jul 23 21:14:11 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 23 21:14:11.495368 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f6de3b1c-4898-4b1f-a912-dafb3e02daed tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-103128719"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:14:11.496791 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:11.496791 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:14:11.497672 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.objects.aggregate [None req-f6de3b1c-4898-4b1f-a912-dafb3e02daed tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] Generated uuid af1de8f7-3d0f-465c-a086-71c4ba227b22 for aggregate {{(pid=131321) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 23 21:14:11.549629 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-f6de3b1c-4898-4b1f-a912-dafb3e02daed tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.059326 Jul 23 21:14:11.550295 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 162/282] 10.222.0.17 () {60 vars in 1163 bytes} [Sat Jul 23 21:14:11 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:14:11.554860 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-28ecb299-0e25-48e8-84e0-baa695e5d6a2 tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-559405139"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:14:11.559103 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:11.559103 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:14:11.560121 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.objects.aggregate [None req-28ecb299-0e25-48e8-84e0-baa695e5d6a2 tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] Generated uuid ad636eed-f0f9-4d02-a662-7091276b9cdb for aggregate {{(pid=131321) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 23 21:14:11.623476 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-28ecb299-0e25-48e8-84e0-baa695e5d6a2 tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.071113 Jul 23 21:14:11.629828 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 163/283] 10.222.0.17 () {60 vars in 1163 bytes} [Sat Jul 23 21:14:11 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:14:11.950411 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-20c9cca7-a7e3-45d8-be33-690fb5619045 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:14:11.950969 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-20c9cca7-a7e3-45d8-be33-690fb5619045 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:14:11.951334 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-20c9cca7-a7e3-45d8-be33-690fb5619045 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:14:11.951743 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-20c9cca7-a7e3-45d8-be33-690fb5619045 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:14:11.952156 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-20c9cca7-a7e3-45d8-be33-690fb5619045 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:14:11.966579 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-20c9cca7-a7e3-45d8-be33-690fb5619045 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:11.967055 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-20c9cca7-a7e3-45d8-be33-690fb5619045 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:11.967848 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-20c9cca7-a7e3-45d8-be33-690fb5619045 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:11.968390 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-20c9cca7-a7e3-45d8-be33-690fb5619045 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:11.991773 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-20c9cca7-a7e3-45d8-be33-690fb5619045 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Getting quotas for project 6610a2359aa64f89befcf72e4f3f6a54. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:14:11.996336 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-20c9cca7-a7e3-45d8-be33-690fb5619045 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Getting quotas for user f2672c5db79b4a48a505c3df536594dd and project 6610a2359aa64f89befcf72e4f3f6a54. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:14:12.012355 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-20c9cca7-a7e3-45d8-be33-690fb5619045 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Going to run 1 instances... {{(pid=131320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:14:12.015563 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-20c9cca7-a7e3-45d8-be33-690fb5619045 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 965630ba-6832-46c9-8f42-7a9fed39e598] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:14:12.029431 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-7e03edd8-2ae4-4b3b-9df3-eb7654385e6f tempest-HypervisorAdminNegativeTestJSON-756328306 tempest-HypervisorAdminNegativeTestJSON-756328306-project] Calling method '.version_select at 0x7f0b54abc700>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:12.033213 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:12.033213 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:14:12.035270 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-7e03edd8-2ae4-4b3b-9df3-eb7654385e6f tempest-HypervisorAdminNegativeTestJSON-756328306 tempest-HypervisorAdminNegativeTestJSON-756328306-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': 'f92b0abcebcf4ef49dd02002a0f477ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dcc0dd92cc4ece9f1810ba760a8b1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:12.039217 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-7e03edd8-2ae4-4b3b-9df3-eb7654385e6f tempest-HypervisorAdminNegativeTestJSON-756328306 tempest-HypervisorAdminNegativeTestJSON-756328306-project] Request method failure captured: Jul 23 21:14:12.039217 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Jul 23 21:14:12.039217 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:14:12.039217 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:14:12.039217 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:14:12.039217 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:14:12.039217 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:14:12.039217 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:14:12.039217 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:14:12.039217 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:14:12.039217 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GSh7g5-9EPjmQoLq8eM5M7DYDis2kJaHVdSSKHVMhhtrigHyB79PhOAbuHoHxL3OWUUjyLxg2YKKvQK4S8QDrUG1kMCGXcDyUa2PcAfx0nRdyhwmqMxhLJ1GGtJr-Qp_M4d3-6gJNfOBpQ-oA6lkJ_X7r6m_dqZBkpfpDoHLW6W36Y Jul 23 21:14:12.039217 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:14:12.039217 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:14:12.039217 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:14:12.039217 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:14:12.039217 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:14:12.039217 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:14:12.039217 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 30dcc0dd92cc4ece9f1810ba760a8b1c Jul 23 21:14:12.039217 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-756328306 Jul 23 21:14:12.039217 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:14:12.039217 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:14:12.040722 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/30dcc0dd92cc4ece9f1810ba760a8b1c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/30dcc0dd92cc4ece9f1810ba760a8b1c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_30dcc0dd92cc4ece9f1810ba760a8b1c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/30dcc0dd92cc4ece9f1810ba760a8b1c"}]}] Jul 23 21:14:12.040722 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-756328306 Jul 23 21:14:12.040722 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 30dcc0dd92cc4ece9f1810ba760a8b1c Jul 23 21:14:12.040722 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-756328306 Jul 23 21:14:12.040722 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-HypervisorAdminNegativeTestJSON-756328306-project Jul 23 21:14:12.040722 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:14:12.040722 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:14:12.040722 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: f92b0abcebcf4ef49dd02002a0f477ab Jul 23 21:14:12.040722 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-756328306-project Jul 23 21:14:12.040722 ncdv-master-1 devstack@n-api.service[131321]: method: Jul 23 21:14:12.040722 ncdv-master-1 devstack@n-api.service[131321]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jul 23 21:14:12.040722 ncdv-master-1 devstack@n-api.service[131321]: action_args: {} Jul 23 21:14:12.040722 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:14:12.041533 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:12.041533 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:14:12.041533 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:14:12.041533 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:14:12.041533 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:14:12.041533 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:14:12.041533 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:14:12.041533 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:14:12.041533 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:14:12.041533 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Jul 23 21:14:12.041533 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self._detail(req) Jul 23 21:14:12.041533 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Jul 23 21:14:12.041533 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Jul 23 21:14:12.041533 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 23 21:14:12.041533 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 23 21:14:12.041533 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 23 21:14:12.041533 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 23 21:14:12.041533 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 23 21:14:12.041533 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 23 21:14:12.042625 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 23 21:14:12.042625 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise self.value Jul 23 21:14:12.042625 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 23 21:14:12.042625 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 23 21:14:12.042625 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 23 21:14:12.042625 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 23 21:14:12.042625 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 23 21:14:12.042625 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 23 21:14:12.042625 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jul 23 21:14:12.042625 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:12.042625 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:14:12.042625 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:12.042625 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:12.042625 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:14:12.042625 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:14:12.042625 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 23 21:14:12.042625 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 23 21:14:12.042625 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jul 23 21:14:12.042625 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:12.043749 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-7e03edd8-2ae4-4b3b-9df3-eb7654385e6f tempest-HypervisorAdminNegativeTestJSON-756328306 tempest-HypervisorAdminNegativeTestJSON-756328306-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:14:12.043749 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-7e03edd8-2ae4-4b3b-9df3-eb7654385e6f tempest-HypervisorAdminNegativeTestJSON-756328306 tempest-HypervisorAdminNegativeTestJSON-756328306-project] 10.222.0.17 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.414863 Jul 23 21:14:12.043749 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 164/284] 10.222.0.17 () {58 vars in 1166 bytes} [Sat Jul 23 21:14:11 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 416 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:14:12.051256 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-5d377c92-ed4e-4db4-91b7-892a1087f3a3 tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:12.055782 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:12.055782 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:14:12.081195 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-5d377c92-ed4e-4db4-91b7-892a1087f3a3 tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] 10.222.0.17 "GET /compute/v2.1/os-aggregates/15" status: 200 len: 227 microversion: 2.1 time: 0.035959 Jul 23 21:14:12.087356 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 165/285] 10.222.0.17 () {58 vars in 1151 bytes} [Sat Jul 23 21:14:12 2022] GET /compute/v2.1/os-aggregates/15 => generated 227 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:14:12.096219 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-4b2d2f3e-738b-405c-9819-8a45eab8840a tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:14:12.097941 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:12.097941 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:14:12.102820 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-20c9cca7-a7e3-45d8-be33-690fb5619045 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.152045 Jul 23 21:14:12.104057 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 121/286] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:14:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 3154 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 23 21:14:12.118869 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a14cd6b3-c671-4ec8-80f5-0c400eab4503 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:12.119522 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a14cd6b3-c671-4ec8-80f5-0c400eab4503 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] [instance: 67f35bb9-3208-4a6f-bccd-91c993e5d0be] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:14:12.123895 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4b2d2f3e-738b-405c-9819-8a45eab8840a tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:12.124996 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4b2d2f3e-738b-405c-9819-8a45eab8840a tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:12.153117 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a14cd6b3-c671-4ec8-80f5-0c400eab4503 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:12.157209 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a14cd6b3-c671-4ec8-80f5-0c400eab4503 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:12.158165 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a14cd6b3-c671-4ec8-80f5-0c400eab4503 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:12.161048 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a14cd6b3-c671-4ec8-80f5-0c400eab4503 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:12.165784 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4b2d2f3e-738b-405c-9819-8a45eab8840a tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:12.167131 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4b2d2f3e-738b-405c-9819-8a45eab8840a tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:12.189398 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.compute.aggregates [None req-4b2d2f3e-738b-405c-9819-8a45eab8840a tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] Failed to remove host nonexist_host from aggregate 16. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Jul 23 21:14:12.190132 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-4b2d2f3e-738b-405c-9819-8a45eab8840a tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 16 Jul 23 21:14:12.193377 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-4b2d2f3e-738b-405c-9819-8a45eab8840a tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] Request method failure captured: Jul 23 21:14:12.193377 ncdv-master-1 devstack@n-api.service[131321]: request: POST /compute/v2.1/os-aggregates/16/action HTTP/1.1 Jul 23 21:14:12.193377 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:14:12.193377 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:14:12.193377 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:14:12.193377 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 42 Jul 23 21:14:12.193377 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:14:12.193377 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:14:12.193377 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:14:12.193377 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:14:12.193377 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GR4Af3W0fFvw8yTolnoTx8KNEFsndEM3vLnD4hxJdnaehXXWpmsZ1jjg3KpEdBxaaG1ArS76-3FDoYUQAdhJ6y2uiVS2G3hIvpto6hX8kiuR7ZLmmR2sTf-Q4IlaSU0UlW_J6NiqIbelxfSFp1N8iB6uGpt0n53v-bBkPGi_IfUjUw Jul 23 21:14:12.193377 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:14:12.193377 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:14:12.193377 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:14:12.193377 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:14:12.193377 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:14:12.193377 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:14:12.193377 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 91b039b789a9402796ffb5eee541b3d3 Jul 23 21:14:12.193377 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2091976692 Jul 23 21:14:12.193377 ncdv-master-1 devstack@n-api.service[131321]: X-Role: admin,reader,member Jul 23 21:14:12.193377 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: admin,reader,member Jul 23 21:14:12.194869 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/91b039b789a9402796ffb5eee541b3d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/91b039b789a9402796ffb5eee541b3d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_91b039b789a9402796ffb5eee541b3d3", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/91b039b789a9402796ffb5eee541b3d3"}]}] Jul 23 21:14:12.194869 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2091976692 Jul 23 21:14:12.194869 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 91b039b789a9402796ffb5eee541b3d3 Jul 23 21:14:12.194869 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2091976692 Jul 23 21:14:12.194869 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin Jul 23 21:14:12.194869 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:14:12.194869 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:14:12.194869 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 37598ed1e36d4e81936d5ad3cf35612b Jul 23 21:14:12.194869 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin Jul 23 21:14:12.194869 ncdv-master-1 devstack@n-api.service[131321]: Jul 23 21:14:12.194869 ncdv-master-1 devstack@n-api.service[131321]: {"remove_host": {"host": "nonexist_host"}} Jul 23 21:14:12.194869 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:14:12.194869 ncdv-master-1 devstack@n-api.service[131321]: exception: Cannot remove host nonexist_host in aggregate 16 Jul 23 21:14:12.195701 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': '16', 'body': {'remove_host': {'host': 'nonexist_host'}}} Jul 23 21:14:12.195701 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:14:12.195701 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:12.195701 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5868, in _get_service_in_cell_by_host Jul 23 21:14:12.195701 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jul 23 21:14:12.195701 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 23 21:14:12.195701 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 23 21:14:12.195701 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 23 21:14:12.195701 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 23 21:14:12.195701 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 23 21:14:12.195701 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 23 21:14:12.195701 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 23 21:14:12.195701 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 23 21:14:12.195701 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Jul 23 21:14:12.195701 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:12.195701 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:14:12.195701 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:12.195701 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:12.195701 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5874, in _get_service_in_cell_by_host Jul 23 21:14:12.195701 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Jul 23 21:14:12.197163 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 23 21:14:12.197163 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 23 21:14:12.197163 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 23 21:14:12.197163 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:12.197163 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:14:12.197163 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:12.197163 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:12.197163 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Jul 23 21:14:12.197163 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Jul 23 21:14:12.197163 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 23 21:14:12.197163 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 23 21:14:12.197163 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 23 21:14:12.197163 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 23 21:14:12.197163 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 23 21:14:12.197163 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise self.value Jul 23 21:14:12.197163 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 23 21:14:12.197163 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 23 21:14:12.197163 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6555, in remove_host_from_aggregate Jul 23 21:14:12.197163 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Jul 23 21:14:12.197163 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5876, in _get_service_in_cell_by_host Jul 23 21:14:12.199197 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Jul 23 21:14:12.199197 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Jul 23 21:14:12.199197 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:12.199197 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:14:12.199197 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:12.199197 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:12.199197 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:14:12.199197 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:14:12.199197 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:14:12.199197 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:14:12.199197 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:14:12.199197 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:14:12.199197 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:14:12.199197 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:14:12.199197 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Jul 23 21:14:12.199197 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 23 21:14:12.199197 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 16 Jul 23 21:14:12.199197 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:12.199197 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:14:12.199197 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:12.199197 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:12.201462 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:14:12.201462 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:14:12.201462 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:14:12.201462 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:14:12.201462 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 16 Jul 23 21:14:12.201462 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:12.201462 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-4b2d2f3e-738b-405c-9819-8a45eab8840a tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 16 {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:14:12.201462 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-4b2d2f3e-738b-405c-9819-8a45eab8840a tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates/16/action" status: 404 len: 94 microversion: 2.1 time: 0.110918 Jul 23 21:14:12.204359 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 166/287] 10.222.0.17 () {60 vars in 1193 bytes} [Sat Jul 23 21:14:12 2022] POST /compute/v2.1/os-aggregates/16/action => generated 94 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 23 21:14:12.214291 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a51be48f-70a1-4c0b-8351-a5777c38c079 tempest-HypervisorAdminNegativeTestJSON-756328306 tempest-HypervisorAdminNegativeTestJSON-756328306-project] Calling method '.version_select at 0x7f0b54abc550>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:12.215102 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:12.215102 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:14:12.216185 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-a51be48f-70a1-4c0b-8351-a5777c38c079 tempest-HypervisorAdminNegativeTestJSON-756328306 tempest-HypervisorAdminNegativeTestJSON-756328306-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': 'f92b0abcebcf4ef49dd02002a0f477ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dcc0dd92cc4ece9f1810ba760a8b1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:12.217808 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a51be48f-70a1-4c0b-8351-a5777c38c079 tempest-HypervisorAdminNegativeTestJSON-756328306 tempest-HypervisorAdminNegativeTestJSON-756328306-project] Request method failure captured: Jul 23 21:14:12.217808 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Jul 23 21:14:12.217808 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:14:12.217808 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:14:12.217808 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:14:12.217808 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:14:12.217808 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:14:12.217808 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:14:12.217808 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:14:12.217808 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:14:12.217808 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GSh7g5-9EPjmQoLq8eM5M7DYDis2kJaHVdSSKHVMhhtrigHyB79PhOAbuHoHxL3OWUUjyLxg2YKKvQK4S8QDrUG1kMCGXcDyUa2PcAfx0nRdyhwmqMxhLJ1GGtJr-Qp_M4d3-6gJNfOBpQ-oA6lkJ_X7r6m_dqZBkpfpDoHLW6W36Y Jul 23 21:14:12.217808 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:14:12.217808 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:14:12.217808 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:14:12.217808 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:14:12.217808 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:14:12.217808 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:14:12.217808 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 30dcc0dd92cc4ece9f1810ba760a8b1c Jul 23 21:14:12.217808 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-756328306 Jul 23 21:14:12.217808 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:14:12.217808 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:14:12.219310 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/30dcc0dd92cc4ece9f1810ba760a8b1c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/30dcc0dd92cc4ece9f1810ba760a8b1c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_30dcc0dd92cc4ece9f1810ba760a8b1c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/30dcc0dd92cc4ece9f1810ba760a8b1c"}]}] Jul 23 21:14:12.219310 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-756328306 Jul 23 21:14:12.219310 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 30dcc0dd92cc4ece9f1810ba760a8b1c Jul 23 21:14:12.219310 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-756328306 Jul 23 21:14:12.219310 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-HypervisorAdminNegativeTestJSON-756328306-project Jul 23 21:14:12.219310 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:14:12.219310 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:14:12.219310 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: f92b0abcebcf4ef49dd02002a0f477ab Jul 23 21:14:12.219310 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-756328306-project Jul 23 21:14:12.219310 ncdv-master-1 devstack@n-api.service[131321]: method: Jul 23 21:14:12.219310 ncdv-master-1 devstack@n-api.service[131321]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jul 23 21:14:12.219310 ncdv-master-1 devstack@n-api.service[131321]: action_args: {} Jul 23 21:14:12.219310 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:14:12.220197 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:12.220197 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:14:12.220197 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:14:12.220197 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:14:12.220197 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:14:12.220197 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:14:12.220197 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:14:12.220197 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:14:12.220197 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:14:12.220197 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Jul 23 21:14:12.220197 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self._index(req) Jul 23 21:14:12.220197 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Jul 23 21:14:12.220197 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Jul 23 21:14:12.220197 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 23 21:14:12.220197 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 23 21:14:12.220197 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 23 21:14:12.220197 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 23 21:14:12.220197 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 23 21:14:12.220197 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 23 21:14:12.221392 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 23 21:14:12.221392 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise self.value Jul 23 21:14:12.221392 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 23 21:14:12.221392 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 23 21:14:12.221392 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 23 21:14:12.221392 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 23 21:14:12.221392 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 23 21:14:12.221392 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 23 21:14:12.221392 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jul 23 21:14:12.221392 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:12.221392 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:14:12.221392 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:12.221392 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:12.221392 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:14:12.221392 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:14:12.221392 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 23 21:14:12.221392 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 23 21:14:12.221392 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jul 23 21:14:12.221392 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:12.222657 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a51be48f-70a1-4c0b-8351-a5777c38c079 tempest-HypervisorAdminNegativeTestJSON-756328306 tempest-HypervisorAdminNegativeTestJSON-756328306-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:14:12.222657 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-a51be48f-70a1-4c0b-8351-a5777c38c079 tempest-HypervisorAdminNegativeTestJSON-756328306 tempest-HypervisorAdminNegativeTestJSON-756328306-project] 10.222.0.17 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.014373 Jul 23 21:14:12.232590 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 167/288] 10.222.0.17 () {58 vars in 1145 bytes} [Sat Jul 23 21:14:12 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:14:12.242558 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-03af4268-2d91-4c58-a72e-af2b89611b5a tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:14:12.245827 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:12.245827 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:14:12.308566 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-03af4268-2d91-4c58-a72e-af2b89611b5a tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates/15/action" status: 200 len: 265 microversion: 2.1 time: 0.074719 Jul 23 21:14:12.314840 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 168/289] 10.222.0.17 () {60 vars in 1193 bytes} [Sat Jul 23 21:14:12 2022] POST /compute/v2.1/os-aggregates/15/action => generated 265 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:14:12.320340 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-03ae2830-b8f4-42fe-8ada-4673a12408c2 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:12.321048 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-03ae2830-b8f4-42fe-8ada-4673a12408c2 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 965630ba-6832-46c9-8f42-7a9fed39e598] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:14:12.561670 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-03ae2830-b8f4-42fe-8ada-4673a12408c2 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:12.572308 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-03ae2830-b8f4-42fe-8ada-4673a12408c2 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/965630ba-6832-46c9-8f42-7a9fed39e598" status: 200 len: 1210 microversion: 2.1 time: 0.253692 Jul 23 21:14:12.573289 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 169/290] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:14:12 2022] GET /compute/v2.1/servers/965630ba-6832-46c9-8f42-7a9fed39e598 => generated 1210 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:14:12.589172 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d8c39462-93cd-4fea-aa68-dbd37c926187 tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:12.591067 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:12.591067 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:14:12.638972 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a14cd6b3-c671-4ec8-80f5-0c400eab4503 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199522d29cb746379cb6f75d4b108cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07101aee06ca4bb6885f87cfec3257db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:12.653110 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a14cd6b3-c671-4ec8-80f5-0c400eab4503 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] 10.222.0.17 "GET /compute/v2.1/servers/67f35bb9-3208-4a6f-bccd-91c993e5d0be" status: 200 len: 1320 microversion: 2.1 time: 0.547278 Jul 23 21:14:12.656234 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-d8c39462-93cd-4fea-aa68-dbd37c926187 tempest-AggregatesAdminNegativeTestJSON-2091976692 tempest-AggregatesAdminNegativeTestJSON-2091976692-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.080605 Jul 23 21:14:12.660996 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 170/291] 10.222.0.17 () {58 vars in 1154 bytes} [Sat Jul 23 21:14:12 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 23 21:14:12.664455 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 122/292] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:14:12 2022] GET /compute/v2.1/servers/67f35bb9-3208-4a6f-bccd-91c993e5d0be => generated 1320 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:14:12.665295 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d013545f-c320-4faa-ae07-38b171e96488 tempest-HypervisorAdminNegativeTestJSON-756328306 tempest-HypervisorAdminNegativeTestJSON-756328306-project] Calling method '.version_select at 0x7f0b548ad310>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:12.670296 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:12.670296 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:14:12.671780 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-d013545f-c320-4faa-ae07-38b171e96488 tempest-HypervisorAdminNegativeTestJSON-756328306 tempest-HypervisorAdminNegativeTestJSON-756328306-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': 'f92b0abcebcf4ef49dd02002a0f477ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dcc0dd92cc4ece9f1810ba760a8b1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:12.677609 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d013545f-c320-4faa-ae07-38b171e96488 tempest-HypervisorAdminNegativeTestJSON-756328306 tempest-HypervisorAdminNegativeTestJSON-756328306-project] Request method failure captured: Jul 23 21:14:12.677609 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Jul 23 21:14:12.677609 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:14:12.677609 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:14:12.677609 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:14:12.677609 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:14:12.677609 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:14:12.677609 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:14:12.677609 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:14:12.677609 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:14:12.677609 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GSh7g5-9EPjmQoLq8eM5M7DYDis2kJaHVdSSKHVMhhtrigHyB79PhOAbuHoHxL3OWUUjyLxg2YKKvQK4S8QDrUG1kMCGXcDyUa2PcAfx0nRdyhwmqMxhLJ1GGtJr-Qp_M4d3-6gJNfOBpQ-oA6lkJ_X7r6m_dqZBkpfpDoHLW6W36Y Jul 23 21:14:12.677609 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:14:12.677609 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:14:12.677609 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:14:12.677609 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:14:12.677609 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:14:12.677609 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:14:12.677609 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 30dcc0dd92cc4ece9f1810ba760a8b1c Jul 23 21:14:12.677609 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-756328306 Jul 23 21:14:12.677609 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:14:12.677609 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:14:12.679019 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/30dcc0dd92cc4ece9f1810ba760a8b1c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/30dcc0dd92cc4ece9f1810ba760a8b1c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_30dcc0dd92cc4ece9f1810ba760a8b1c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/30dcc0dd92cc4ece9f1810ba760a8b1c"}]}] Jul 23 21:14:12.679019 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-756328306 Jul 23 21:14:12.679019 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 30dcc0dd92cc4ece9f1810ba760a8b1c Jul 23 21:14:12.679019 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-756328306 Jul 23 21:14:12.679019 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-HypervisorAdminNegativeTestJSON-756328306-project Jul 23 21:14:12.679019 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:14:12.679019 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:14:12.679019 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: f92b0abcebcf4ef49dd02002a0f477ab Jul 23 21:14:12.679019 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-756328306-project Jul 23 21:14:12.679019 ncdv-master-1 devstack@n-api.service[131321]: method: Jul 23 21:14:12.679019 ncdv-master-1 devstack@n-api.service[131321]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jul 23 21:14:12.679019 ncdv-master-1 devstack@n-api.service[131321]: action_args: {} Jul 23 21:14:12.679019 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:14:12.679728 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:12.679728 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:14:12.679728 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:14:12.679728 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:14:12.679728 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:14:12.679728 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:14:12.679728 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:14:12.679728 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:14:12.679728 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:14:12.679728 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Jul 23 21:14:12.679728 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Jul 23 21:14:12.679728 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 23 21:14:12.679728 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 23 21:14:12.679728 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 23 21:14:12.679728 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 23 21:14:12.679728 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 23 21:14:12.679728 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 23 21:14:12.679728 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 23 21:14:12.679728 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise self.value Jul 23 21:14:12.681180 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 23 21:14:12.681180 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 23 21:14:12.681180 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 23 21:14:12.681180 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 23 21:14:12.681180 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 23 21:14:12.681180 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 23 21:14:12.681180 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jul 23 21:14:12.681180 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:12.681180 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:14:12.681180 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:12.681180 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:12.681180 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:14:12.681180 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:14:12.681180 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 23 21:14:12.681180 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 23 21:14:12.681180 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jul 23 21:14:12.681180 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:12.682882 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d013545f-c320-4faa-ae07-38b171e96488 tempest-HypervisorAdminNegativeTestJSON-756328306 tempest-HypervisorAdminNegativeTestJSON-756328306-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:14:12.682882 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-d013545f-c320-4faa-ae07-38b171e96488 tempest-HypervisorAdminNegativeTestJSON-756328306 tempest-HypervisorAdminNegativeTestJSON-756328306-project] 10.222.0.17 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.021074 Jul 23 21:14:12.683090 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-46f81b11-54ec-4370-85c4-3ed2018735c5 tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:12.683203 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 171/293] 10.222.0.17 () {58 vars in 1178 bytes} [Sat Jul 23 21:14:12 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:14:12.683306 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:12.683306 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:14:12.688800 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-5a17a29e-04aa-4966-8016-50787eec03f0 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:12.689420 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-5a17a29e-04aa-4966-8016-50787eec03f0 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 769ee4e5-e4df-4d4e-9f4c-6372c60d9e01] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:14:12.705293 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5a17a29e-04aa-4966-8016-50787eec03f0 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:12.705949 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5a17a29e-04aa-4966-8016-50787eec03f0 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:12.706926 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5a17a29e-04aa-4966-8016-50787eec03f0 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:12.707491 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5a17a29e-04aa-4966-8016-50787eec03f0 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:12.742279 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-46f81b11-54ec-4370-85c4-3ed2018735c5 tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] 10.222.0.17 "GET /compute/v2.1/os-aggregates/15" status: 200 len: 241 microversion: 2.1 time: 0.074888 Jul 23 21:14:12.742899 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 123/294] 10.222.0.17 () {58 vars in 1151 bytes} [Sat Jul 23 21:14:12 2022] GET /compute/v2.1/os-aggregates/15 => generated 241 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:14:13.104706 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-5a17a29e-04aa-4966-8016-50787eec03f0 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:13.117499 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-5a17a29e-04aa-4966-8016-50787eec03f0 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/769ee4e5-e4df-4d4e-9f4c-6372c60d9e01" status: 200 len: 1312 microversion: 2.1 time: 0.433988 Jul 23 21:14:13.118338 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 172/295] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:14:12 2022] GET /compute/v2.1/servers/769ee4e5-e4df-4d4e-9f4c-6372c60d9e01 => generated 1312 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:14:13.142769 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-21ab4920-df26-45ac-b594-2598b1ef94df tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:13.144166 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:13.144166 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:14:13.194033 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-21ab4920-df26-45ac-b594-2598b1ef94df tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.063919 Jul 23 21:14:13.200346 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 173/296] 10.222.0.17 () {58 vars in 1154 bytes} [Sat Jul 23 21:14:13 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 23 21:14:13.207058 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-455d6518-7167-46af-bcd6-6e85bfbdfe96 tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1857726820", "availability_zone": "tempest-test_az-804306484"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:14:13.209108 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:13.209108 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:14:13.211059 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.objects.aggregate [None req-455d6518-7167-46af-bcd6-6e85bfbdfe96 tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] Generated uuid 7aa9738c-a9fd-4a01-947b-a0c9506b76e4 for aggregate {{(pid=131321) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 23 21:14:13.258002 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-455d6518-7167-46af-bcd6-6e85bfbdfe96 tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.052064 Jul 23 21:14:13.265033 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 174/297] 10.222.0.17 () {60 vars in 1164 bytes} [Sat Jul 23 21:14:13 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:14:13.280192 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-3510e766-f3d6-4513-a2fa-a4b3b6665513 tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1857726820_new", "availability_zone": "tempest-test_az-804306484_new"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:14:13.521089 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:13.521089 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:14:13.618123 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3510e766-f3d6-4513-a2fa-a4b3b6665513 tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:13.618584 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3510e766-f3d6-4513-a2fa-a4b3b6665513 tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:13.691016 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-3510e766-f3d6-4513-a2fa-a4b3b6665513 tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-aggregates/17" status: 200 len: 335 microversion: 2.1 time: 0.424752 Jul 23 21:14:13.691645 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 175/298] 10.222.0.17 () {60 vars in 1172 bytes} [Sat Jul 23 21:14:13 2022] PUT /compute/v2.1/os-aggregates/17 => generated 335 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:14:13.709368 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d6c76dd5-97bb-46d3-9697-5fc4499639c7 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:13.710577 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-d6c76dd5-97bb-46d3-9697-5fc4499639c7 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 965630ba-6832-46c9-8f42-7a9fed39e598] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:14:13.721558 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d6c76dd5-97bb-46d3-9697-5fc4499639c7 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:13.722048 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d6c76dd5-97bb-46d3-9697-5fc4499639c7 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:13.726591 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d6c76dd5-97bb-46d3-9697-5fc4499639c7 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:13.727034 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d6c76dd5-97bb-46d3-9697-5fc4499639c7 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:13.915102 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c5c6a105-ce1a-477a-b22d-c0d3a6f957af tempest-HypervisorAdminNegativeTestJSON-1767240806 tempest-HypervisorAdminNegativeTestJSON-1767240806-project-admin] Calling method '.version_select at 0x7f0b5411d310>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:13.915940 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:13.915940 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:14:13.917142 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c5c6a105-ce1a-477a-b22d-c0d3a6f957af tempest-HypervisorAdminNegativeTestJSON-1767240806 tempest-HypervisorAdminNegativeTestJSON-1767240806-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:13.917595 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c5c6a105-ce1a-477a-b22d-c0d3a6f957af tempest-HypervisorAdminNegativeTestJSON-1767240806 tempest-HypervisorAdminNegativeTestJSON-1767240806-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:13.949920 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c5c6a105-ce1a-477a-b22d-c0d3a6f957af tempest-HypervisorAdminNegativeTestJSON-1767240806 tempest-HypervisorAdminNegativeTestJSON-1767240806-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:13.952853 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c5c6a105-ce1a-477a-b22d-c0d3a6f957af tempest-HypervisorAdminNegativeTestJSON-1767240806 tempest-HypervisorAdminNegativeTestJSON-1767240806-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:13.987841 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c5c6a105-ce1a-477a-b22d-c0d3a6f957af tempest-HypervisorAdminNegativeTestJSON-1767240806 tempest-HypervisorAdminNegativeTestJSON-1767240806-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:13.996078 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c5c6a105-ce1a-477a-b22d-c0d3a6f957af tempest-HypervisorAdminNegativeTestJSON-1767240806 tempest-HypervisorAdminNegativeTestJSON-1767240806-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:14.014597 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c5c6a105-ce1a-477a-b22d-c0d3a6f957af tempest-HypervisorAdminNegativeTestJSON-1767240806 tempest-HypervisorAdminNegativeTestJSON-1767240806-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 1.264260 Jul 23 21:14:14.015576 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 124/299] 10.222.0.17 () {58 vars in 1145 bytes} [Sat Jul 23 21:14:12 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:14:14.029757 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0fc6667e-860b-4072-80ba-599ba5254158 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:14.030846 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-0fc6667e-860b-4072-80ba-599ba5254158 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] [instance: 67f35bb9-3208-4a6f-bccd-91c993e5d0be] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:14:14.042611 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0fc6667e-860b-4072-80ba-599ba5254158 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:14.045569 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0fc6667e-860b-4072-80ba-599ba5254158 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:14.048570 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0fc6667e-860b-4072-80ba-599ba5254158 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:14.049548 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0fc6667e-860b-4072-80ba-599ba5254158 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:14.189536 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-d6c76dd5-97bb-46d3-9697-5fc4499639c7 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:14.198985 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-d6c76dd5-97bb-46d3-9697-5fc4499639c7 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/965630ba-6832-46c9-8f42-7a9fed39e598" status: 200 len: 1262 microversion: 2.1 time: 0.506194 Jul 23 21:14:14.201424 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 176/300] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:14:13 2022] GET /compute/v2.1/servers/965630ba-6832-46c9-8f42-7a9fed39e598 => generated 1262 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:14:14.206691 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-cc30947c-b7e3-4dc1-844c-16b1cb48c30a tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:14.207623 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:14.207623 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:14:14.234550 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-cc30947c-b7e3-4dc1-844c-16b1cb48c30a tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] 10.222.0.17 "GET /compute/v2.1/os-aggregates" status: 200 len: 338 microversion: 2.1 time: 0.031751 Jul 23 21:14:14.241054 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 177/301] 10.222.0.17 () {58 vars in 1142 bytes} [Sat Jul 23 21:14:14 2022] GET /compute/v2.1/os-aggregates => generated 338 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:14:14.253423 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-2cee2a4f-92bd-4aef-b246-885dd90074f1 tempest-HypervisorAdminNegativeTestJSON-756328306 tempest-HypervisorAdminNegativeTestJSON-756328306-project] Calling method '.version_select at 0x7f0b54ae5e50>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:14.254607 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:14.254607 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:14:14.256010 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-2cee2a4f-92bd-4aef-b246-885dd90074f1 tempest-HypervisorAdminNegativeTestJSON-756328306 tempest-HypervisorAdminNegativeTestJSON-756328306-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': 'f92b0abcebcf4ef49dd02002a0f477ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dcc0dd92cc4ece9f1810ba760a8b1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:14.258099 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-2cee2a4f-92bd-4aef-b246-885dd90074f1 tempest-HypervisorAdminNegativeTestJSON-756328306 tempest-HypervisorAdminNegativeTestJSON-756328306-project] Request method failure captured: Jul 23 21:14:14.258099 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Jul 23 21:14:14.258099 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:14:14.258099 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:14:14.258099 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:14:14.258099 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:14:14.258099 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:14:14.258099 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:14:14.258099 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:14:14.258099 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:14:14.258099 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GSh7g5-9EPjmQoLq8eM5M7DYDis2kJaHVdSSKHVMhhtrigHyB79PhOAbuHoHxL3OWUUjyLxg2YKKvQK4S8QDrUG1kMCGXcDyUa2PcAfx0nRdyhwmqMxhLJ1GGtJr-Qp_M4d3-6gJNfOBpQ-oA6lkJ_X7r6m_dqZBkpfpDoHLW6W36Y Jul 23 21:14:14.258099 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:14:14.258099 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:14:14.258099 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:14:14.258099 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:14:14.258099 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:14:14.258099 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:14:14.258099 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 30dcc0dd92cc4ece9f1810ba760a8b1c Jul 23 21:14:14.258099 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-756328306 Jul 23 21:14:14.258099 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:14:14.258099 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:14:14.259381 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/30dcc0dd92cc4ece9f1810ba760a8b1c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/30dcc0dd92cc4ece9f1810ba760a8b1c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_30dcc0dd92cc4ece9f1810ba760a8b1c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/30dcc0dd92cc4ece9f1810ba760a8b1c"}]}] Jul 23 21:14:14.259381 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-756328306 Jul 23 21:14:14.259381 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 30dcc0dd92cc4ece9f1810ba760a8b1c Jul 23 21:14:14.259381 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-756328306 Jul 23 21:14:14.259381 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-HypervisorAdminNegativeTestJSON-756328306-project Jul 23 21:14:14.259381 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:14:14.259381 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:14:14.259381 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: f92b0abcebcf4ef49dd02002a0f477ab Jul 23 21:14:14.259381 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-756328306-project Jul 23 21:14:14.259381 ncdv-master-1 devstack@n-api.service[131321]: method: Jul 23 21:14:14.259381 ncdv-master-1 devstack@n-api.service[131321]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jul 23 21:14:14.259381 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': '1'} Jul 23 21:14:14.259381 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:14:14.260135 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:14.260135 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:14:14.260135 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:14:14.260135 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:14:14.260135 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:14:14.260135 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:14:14.260135 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:14:14.260135 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:14:14.260135 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:14:14.260135 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Jul 23 21:14:14.260135 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Jul 23 21:14:14.260135 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 23 21:14:14.260135 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 23 21:14:14.260135 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 23 21:14:14.260135 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 23 21:14:14.260135 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 23 21:14:14.260135 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 23 21:14:14.260135 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 23 21:14:14.260135 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise self.value Jul 23 21:14:14.261324 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 23 21:14:14.261324 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 23 21:14:14.261324 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 23 21:14:14.261324 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 23 21:14:14.261324 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 23 21:14:14.261324 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 23 21:14:14.261324 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jul 23 21:14:14.261324 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:14.261324 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:14:14.261324 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:14.261324 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:14.261324 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:14:14.261324 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:14:14.261324 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 23 21:14:14.261324 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 23 21:14:14.261324 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jul 23 21:14:14.261324 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:14.264335 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-2cee2a4f-92bd-4aef-b246-885dd90074f1 tempest-HypervisorAdminNegativeTestJSON-756328306 tempest-HypervisorAdminNegativeTestJSON-756328306-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:14:14.265399 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-2cee2a4f-92bd-4aef-b246-885dd90074f1 tempest-HypervisorAdminNegativeTestJSON-756328306 tempest-HypervisorAdminNegativeTestJSON-756328306-project] 10.222.0.17 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.028382 Jul 23 21:14:14.266175 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 178/302] 10.222.0.17 () {58 vars in 1172 bytes} [Sat Jul 23 21:14:14 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:14:14.277293 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ffc3befa-20f9-4804-8228-ce940190ab3c tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:14.278262 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-ffc3befa-20f9-4804-8228-ce940190ab3c tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 769ee4e5-e4df-4d4e-9f4c-6372c60d9e01] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:14:14.285551 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ffc3befa-20f9-4804-8228-ce940190ab3c tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:14.287075 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ffc3befa-20f9-4804-8228-ce940190ab3c tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:14.288092 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ffc3befa-20f9-4804-8228-ce940190ab3c tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:14.288730 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ffc3befa-20f9-4804-8228-ce940190ab3c tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:14.605307 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-0fc6667e-860b-4072-80ba-599ba5254158 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199522d29cb746379cb6f75d4b108cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07101aee06ca4bb6885f87cfec3257db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:14.619521 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-0fc6667e-860b-4072-80ba-599ba5254158 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] 10.222.0.17 "GET /compute/v2.1/servers/67f35bb9-3208-4a6f-bccd-91c993e5d0be" status: 200 len: 1320 microversion: 2.1 time: 0.601314 Jul 23 21:14:14.620695 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 125/303] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:14:14 2022] GET /compute/v2.1/servers/67f35bb9-3208-4a6f-bccd-91c993e5d0be => generated 1320 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:14:14.647285 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e568c218-8c4d-45d5-af82-4e216aa9872c tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:14.648601 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:14.648601 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:14:14.711132 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e568c218-8c4d-45d5-af82-4e216aa9872c tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.069119 Jul 23 21:14:14.716136 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 126/304] 10.222.0.17 () {58 vars in 1154 bytes} [Sat Jul 23 21:14:14 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 23 21:14:14.727967 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-833c9dc8-5f0a-43e0-83ad-799cb1bc8e80 tempest-HypervisorAdminNegativeTestJSON-1767240806 tempest-HypervisorAdminNegativeTestJSON-1767240806-project-admin] Calling method '.version_select at 0x7f0b54afe0d0>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:14.728811 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:14.728811 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:14:14.729817 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-833c9dc8-5f0a-43e0-83ad-799cb1bc8e80 tempest-HypervisorAdminNegativeTestJSON-1767240806 tempest-HypervisorAdminNegativeTestJSON-1767240806-project-admin] HTTP exception thrown: Hypervisor with ID '051e5b6d-179a-4f17-bc2b-fab244b8699a' could not be found. Jul 23 21:14:14.756317 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-833c9dc8-5f0a-43e0-83ad-799cb1bc8e80 tempest-HypervisorAdminNegativeTestJSON-1767240806 tempest-HypervisorAdminNegativeTestJSON-1767240806-project-admin] Request method failure captured: Jul 23 21:14:14.756317 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/os-hypervisors/051e5b6d-179a-4f17-bc2b-fab244b8699a/uptime HTTP/1.1 Jul 23 21:14:14.756317 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:14:14.756317 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:14:14.756317 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:14:14.756317 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:14:14.756317 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:14:14.756317 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:14:14.756317 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:14:14.756317 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:14:14.756317 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GSj4DSLThFmc2M0hVIva-qFyB11xXOpUkBVoVQJN22RdhKAuj4gkfHr0F96-oIVahv5HKmWLjmhqOcFNXM9HajzvTJRSvA8PJjqWkWkBRrjKHPNHwkzp3gi5rUk4zi0wMLAZl9j_7TvVaxbIBmHNInPYWADz_03B2O5tViqXMxGGZw Jul 23 21:14:14.756317 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:14:14.756317 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:14:14.756317 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:14:14.756317 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:14:14.756317 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:14:14.756317 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:14:14.756317 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 638e3886481548668ccddebb3eabfa12 Jul 23 21:14:14.756317 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1767240806 Jul 23 21:14:14.756317 ncdv-master-1 devstack@n-api.service[131320]: X-Role: admin,reader,member Jul 23 21:14:14.756317 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: admin,reader,member Jul 23 21:14:14.757779 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/638e3886481548668ccddebb3eabfa12"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/638e3886481548668ccddebb3eabfa12"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_638e3886481548668ccddebb3eabfa12", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/638e3886481548668ccddebb3eabfa12"}]}] Jul 23 21:14:14.757779 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1767240806 Jul 23 21:14:14.757779 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 638e3886481548668ccddebb3eabfa12 Jul 23 21:14:14.757779 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1767240806 Jul 23 21:14:14.757779 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-HypervisorAdminNegativeTestJSON-1767240806-project-admin Jul 23 21:14:14.757779 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:14:14.757779 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:14:14.757779 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: c03fe65aa9364b8a94f79f887387d260 Jul 23 21:14:14.757779 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1767240806-project-admin Jul 23 21:14:14.757779 ncdv-master-1 devstack@n-api.service[131320]: method: Jul 23 21:14:14.757779 ncdv-master-1 devstack@n-api.service[131320]: exception: Hypervisor with ID '051e5b6d-179a-4f17-bc2b-fab244b8699a' could not be found. Jul 23 21:14:14.757779 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '051e5b6d-179a-4f17-bc2b-fab244b8699a'} Jul 23 21:14:14.758805 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:14:14.758805 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:14.758805 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Jul 23 21:14:14.758805 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi value = int(str(value)) Jul 23 21:14:14.758805 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '051e5b6d-179a-4f17-bc2b-fab244b8699a' Jul 23 21:14:14.758805 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:14:14.758805 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:14:14.758805 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:14:14.758805 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:14.758805 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Jul 23 21:14:14.758805 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Jul 23 21:14:14.758805 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Jul 23 21:14:14.758805 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Jul 23 21:14:14.758805 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Jul 23 21:14:14.758805 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:14:14.758805 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:14:14.758805 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:14:14.758805 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:14.758805 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Jul 23 21:14:14.758805 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Jul 23 21:14:14.758805 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Jul 23 21:14:14.758805 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Jul 23 21:14:14.760275 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Jul 23 21:14:14.760275 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:14:14.760275 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:14:14.760275 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:14:14.760275 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:14.760275 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:14:14.760275 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:14:14.760275 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:14:14.760275 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:14:14.760275 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:14:14.760275 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:14:14.760275 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:14:14.760275 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:14:14.760275 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Jul 23 21:14:14.760275 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Jul 23 21:14:14.760275 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Jul 23 21:14:14.760275 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 23 21:14:14.760275 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '051e5b6d-179a-4f17-bc2b-fab244b8699a' could not be found. Jul 23 21:14:14.760275 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:14:14.760275 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:14:14.760275 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:14:14.762708 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:14.762708 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:14:14.762708 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:14:14.762708 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:14:14.762708 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:14:14.762708 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '051e5b6d-179a-4f17-bc2b-fab244b8699a' could not be found. Jul 23 21:14:14.762708 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:14:14.767423 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-833c9dc8-5f0a-43e0-83ad-799cb1bc8e80 tempest-HypervisorAdminNegativeTestJSON-1767240806 tempest-HypervisorAdminNegativeTestJSON-1767240806-project-admin] Returning 404 to user: Hypervisor with ID '051e5b6d-179a-4f17-bc2b-fab244b8699a' could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:14:14.767423 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-833c9dc8-5f0a-43e0-83ad-799cb1bc8e80 tempest-HypervisorAdminNegativeTestJSON-1767240806 tempest-HypervisorAdminNegativeTestJSON-1767240806-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors/051e5b6d-179a-4f17-bc2b-fab244b8699a/uptime" status: 404 len: 123 microversion: 2.1 time: 0.047588 Jul 23 21:14:14.767423 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 127/305] 10.222.0.17 () {58 vars in 1277 bytes} [Sat Jul 23 21:14:14 2022] GET /compute/v2.1/os-hypervisors/051e5b6d-179a-4f17-bc2b-fab244b8699a/uptime => generated 123 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:14:14.779849 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5c04d7dd-70af-4e09-990d-60d723b62c2a tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-858309056"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:14:14.784751 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:14.784751 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:14:14.786478 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.objects.aggregate [None req-5c04d7dd-70af-4e09-990d-60d723b62c2a tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] Generated uuid 6deb7b36-957c-4c4a-943c-f2af8eff7be7 for aggregate {{(pid=131320) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 23 21:14:14.803111 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=8,nova_api:DELETE=9 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:14.839308 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5c04d7dd-70af-4e09-990d-60d723b62c2a tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.068541 Jul 23 21:14:14.840555 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 128/306] 10.222.0.17 () {60 vars in 1163 bytes} [Sat Jul 23 21:14:14 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:14:15.056319 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ffc3befa-20f9-4804-8228-ce940190ab3c tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:15.068011 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-ffc3befa-20f9-4804-8228-ce940190ab3c tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/769ee4e5-e4df-4d4e-9f4c-6372c60d9e01" status: 200 len: 1312 microversion: 2.1 time: 0.800319 Jul 23 21:14:15.068640 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-90978082-1227-457c-bc36-3c8e27337566 req-d008c188-50a9-406d-9788-d3842bacb849 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "769ee4e5-e4df-4d4e-9f4c-6372c60d9e01", "tag": "ac63fc07-76cc-4d6e-8aca-987edbb6e640"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:14:15.073325 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 179/307] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:14:14 2022] GET /compute/v2.1/servers/769ee4e5-e4df-4d4e-9f4c-6372c60d9e01 => generated 1312 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:14:15.081523 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a603521d-bb76-4f51-98ec-b41fc6db2b5f tempest-HypervisorAdminNegativeTestJSON-1767240806 tempest-HypervisorAdminNegativeTestJSON-1767240806-project-admin] Calling method '.version_select at 0x7f0b54985e50>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:15.087015 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:15.087015 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:14:15.087989 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-90978082-1227-457c-bc36-3c8e27337566 req-d008c188-50a9-406d-9788-d3842bacb849 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:15.088609 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-90978082-1227-457c-bc36-3c8e27337566 req-d008c188-50a9-406d-9788-d3842bacb849 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:15.089115 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a603521d-bb76-4f51-98ec-b41fc6db2b5f tempest-HypervisorAdminNegativeTestJSON-1767240806 tempest-HypervisorAdminNegativeTestJSON-1767240806-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:15.092848 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a603521d-bb76-4f51-98ec-b41fc6db2b5f tempest-HypervisorAdminNegativeTestJSON-1767240806 tempest-HypervisorAdminNegativeTestJSON-1767240806-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:15.130382 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-90978082-1227-457c-bc36-3c8e27337566 req-d008c188-50a9-406d-9788-d3842bacb849 service nova] Creating event network-changed:ac63fc07-76cc-4d6e-8aca-987edbb6e640 for instance 769ee4e5-e4df-4d4e-9f4c-6372c60d9e01 on nch1-master-1 Jul 23 21:14:15.143673 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-90978082-1227-457c-bc36-3c8e27337566 req-d008c188-50a9-406d-9788-d3842bacb849 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.300756 Jul 23 21:14:15.144362 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 129/308] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:14:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:14:15.150405 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-23bf3004-2180-4cf9-ba22-ec628d403945 tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:15.151328 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:15.151328 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:14:15.152815 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a603521d-bb76-4f51-98ec-b41fc6db2b5f tempest-HypervisorAdminNegativeTestJSON-1767240806 tempest-HypervisorAdminNegativeTestJSON-1767240806-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:15.153256 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a603521d-bb76-4f51-98ec-b41fc6db2b5f tempest-HypervisorAdminNegativeTestJSON-1767240806 tempest-HypervisorAdminNegativeTestJSON-1767240806-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:15.158035 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-23bf3004-2180-4cf9-ba22-ec628d403945 tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] 10.222.0.17 "GET /compute/v2.1/os-aggregates" status: 200 len: 230 microversion: 2.1 time: 0.012356 Jul 23 21:14:15.159205 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 130/309] 10.222.0.17 () {58 vars in 1142 bytes} [Sat Jul 23 21:14:15 2022] GET /compute/v2.1/os-aggregates => generated 230 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:14:15.169738 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-043096d2-ec31-4c84-b0b9-541907b0def7 tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:15.171016 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:15.171016 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:14:15.179723 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=6,nova_api:DELETE=9,nova_api:UPDATE=2 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:15.190905 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a603521d-bb76-4f51-98ec-b41fc6db2b5f tempest-HypervisorAdminNegativeTestJSON-1767240806 tempest-HypervisorAdminNegativeTestJSON-1767240806-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:15.191436 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a603521d-bb76-4f51-98ec-b41fc6db2b5f tempest-HypervisorAdminNegativeTestJSON-1767240806 tempest-HypervisorAdminNegativeTestJSON-1767240806-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:15.206717 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-a603521d-bb76-4f51-98ec-b41fc6db2b5f tempest-HypervisorAdminNegativeTestJSON-1767240806 tempest-HypervisorAdminNegativeTestJSON-1767240806-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.131981 Jul 23 21:14:15.207352 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 180/310] 10.222.0.17 () {58 vars in 1145 bytes} [Sat Jul 23 21:14:15 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:14:15.225645 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-b257d25d-d80f-4fb1-b1e1-0c21d0911bb3 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:15.225962 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-043096d2-ec31-4c84-b0b9-541907b0def7 tempest-AggregatesAdminTestJSON-1167455090 tempest-AggregatesAdminTestJSON-1167455090-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.060292 Jul 23 21:14:15.227019 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 131/311] 10.222.0.17 () {58 vars in 1154 bytes} [Sat Jul 23 21:14:15 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Jul 23 21:14:15.229825 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-b257d25d-d80f-4fb1-b1e1-0c21d0911bb3 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 965630ba-6832-46c9-8f42-7a9fed39e598] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:14:15.232513 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-085288fe-8091-4f7a-86b7-363ade46757b tempest-HypervisorAdminNegativeTestJSON-756328306 tempest-HypervisorAdminNegativeTestJSON-756328306-project] Calling method '.version_select at 0x7f0b5411d790>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:15.233323 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:15.233323 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:14:15.237613 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-085288fe-8091-4f7a-86b7-363ade46757b tempest-HypervisorAdminNegativeTestJSON-756328306 tempest-HypervisorAdminNegativeTestJSON-756328306-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': 'f92b0abcebcf4ef49dd02002a0f477ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30dcc0dd92cc4ece9f1810ba760a8b1c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:15.245164 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-085288fe-8091-4f7a-86b7-363ade46757b tempest-HypervisorAdminNegativeTestJSON-756328306 tempest-HypervisorAdminNegativeTestJSON-756328306-project] Request method failure captured: Jul 23 21:14:15.245164 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Jul 23 21:14:15.245164 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:14:15.245164 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:14:15.245164 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:14:15.245164 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:14:15.245164 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:14:15.245164 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:14:15.245164 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:14:15.245164 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:14:15.245164 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GSh7g5-9EPjmQoLq8eM5M7DYDis2kJaHVdSSKHVMhhtrigHyB79PhOAbuHoHxL3OWUUjyLxg2YKKvQK4S8QDrUG1kMCGXcDyUa2PcAfx0nRdyhwmqMxhLJ1GGtJr-Qp_M4d3-6gJNfOBpQ-oA6lkJ_X7r6m_dqZBkpfpDoHLW6W36Y Jul 23 21:14:15.245164 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:14:15.245164 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:14:15.245164 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:14:15.245164 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:14:15.245164 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:14:15.245164 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:14:15.245164 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 30dcc0dd92cc4ece9f1810ba760a8b1c Jul 23 21:14:15.245164 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-756328306 Jul 23 21:14:15.245164 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:14:15.245164 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:14:15.246726 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/30dcc0dd92cc4ece9f1810ba760a8b1c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/30dcc0dd92cc4ece9f1810ba760a8b1c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_30dcc0dd92cc4ece9f1810ba760a8b1c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/30dcc0dd92cc4ece9f1810ba760a8b1c"}]}] Jul 23 21:14:15.246726 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-756328306 Jul 23 21:14:15.246726 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 30dcc0dd92cc4ece9f1810ba760a8b1c Jul 23 21:14:15.246726 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-756328306 Jul 23 21:14:15.246726 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-HypervisorAdminNegativeTestJSON-756328306-project Jul 23 21:14:15.246726 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:14:15.246726 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:14:15.246726 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: f92b0abcebcf4ef49dd02002a0f477ab Jul 23 21:14:15.246726 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-756328306-project Jul 23 21:14:15.246726 ncdv-master-1 devstack@n-api.service[131320]: method: Jul 23 21:14:15.246726 ncdv-master-1 devstack@n-api.service[131320]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jul 23 21:14:15.246726 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '1'} Jul 23 21:14:15.246726 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:14:15.247681 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:15.247681 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:14:15.247681 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:14:15.247681 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:14:15.247681 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:14:15.247681 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:14:15.247681 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:14:15.247681 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:14:15.247681 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:14:15.247681 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Jul 23 21:14:15.247681 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jul 23 21:14:15.247681 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Jul 23 21:14:15.247681 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Jul 23 21:14:15.247681 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 23 21:14:15.247681 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 23 21:14:15.247681 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 23 21:14:15.247681 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 23 21:14:15.247681 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 23 21:14:15.247681 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 23 21:14:15.248718 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 23 21:14:15.248718 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise self.value Jul 23 21:14:15.248718 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 23 21:14:15.248718 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 23 21:14:15.248718 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 23 21:14:15.248718 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 23 21:14:15.248718 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 23 21:14:15.248718 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 23 21:14:15.248718 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jul 23 21:14:15.248718 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:14:15.248718 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:14:15.248718 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:14:15.248718 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:15.248718 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:14:15.248718 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:14:15.248718 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 23 21:14:15.248718 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 23 21:14:15.248718 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jul 23 21:14:15.248718 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:14:15.249958 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b257d25d-d80f-4fb1-b1e1-0c21d0911bb3 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:15.249958 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b257d25d-d80f-4fb1-b1e1-0c21d0911bb3 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:15.249958 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b257d25d-d80f-4fb1-b1e1-0c21d0911bb3 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:15.249958 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b257d25d-d80f-4fb1-b1e1-0c21d0911bb3 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:15.253158 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-085288fe-8091-4f7a-86b7-363ade46757b tempest-HypervisorAdminNegativeTestJSON-756328306 tempest-HypervisorAdminNegativeTestJSON-756328306-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:14:15.254262 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-085288fe-8091-4f7a-86b7-363ade46757b tempest-HypervisorAdminNegativeTestJSON-756328306 tempest-HypervisorAdminNegativeTestJSON-756328306-project] 10.222.0.17 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.026130 Jul 23 21:14:15.257723 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 132/312] 10.222.0.17 () {58 vars in 1151 bytes} [Sat Jul 23 21:14:15 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:14:15.273552 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6e72f36f-455e-4179-bd30-45822ae17e1d tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:15.274648 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6e72f36f-455e-4179-bd30-45822ae17e1d tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] [instance: 1d5a909f-c169-415e-a7b7-41835906e801] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:14:15.287166 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6e72f36f-455e-4179-bd30-45822ae17e1d tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:15.287780 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6e72f36f-455e-4179-bd30-45822ae17e1d tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:15.288787 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6e72f36f-455e-4179-bd30-45822ae17e1d tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:15.289375 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6e72f36f-455e-4179-bd30-45822ae17e1d tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:15.307856 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-6e72f36f-455e-4179-bd30-45822ae17e1d tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] HTTP exception thrown: Instance 1d5a909f-c169-415e-a7b7-41835906e801 could not be found. Jul 23 21:14:15.310275 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6e72f36f-455e-4179-bd30-45822ae17e1d tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Request method failure captured: Jul 23 21:14:15.310275 ncdv-master-1 devstack@n-api.service[131320]: request: DELETE /compute/v2.1/servers/1d5a909f-c169-415e-a7b7-41835906e801 HTTP/1.1 Jul 23 21:14:15.310275 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:14:15.310275 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:14:15.310275 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:14:15.310275 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:14:15.310275 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:14:15.310275 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:14:15.310275 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:14:15.310275 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:14:15.310275 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GR1eI889iz1UdOMfj-AWbWeN2aV76a5pfj4M3aeDd2iTJca2skQPCt-TeybZWX5RXMEzwhb3I6Zsxrsk4g9IZ2wNC9swlAqtfJXbq8C2TXLA7Y5M7WirEk1HUdIfULr6oHCu-dC-PIZSuAWkEl5W6343G7QEv7Lmk9voK1dKeUh_C8 Jul 23 21:14:15.310275 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:14:15.310275 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:14:15.310275 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:14:15.310275 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:14:15.310275 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:14:15.310275 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:14:15.310275 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 2366e681931c49118c1120350487bde5 Jul 23 21:14:15.310275 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-AggregatesAdminTestJSON-1783669231 Jul 23 21:14:15.310275 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:14:15.310275 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:14:15.311485 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2366e681931c49118c1120350487bde5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2366e681931c49118c1120350487bde5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2366e681931c49118c1120350487bde5", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2366e681931c49118c1120350487bde5"}]}] Jul 23 21:14:15.311485 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-AggregatesAdminTestJSON-1783669231 Jul 23 21:14:15.311485 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 2366e681931c49118c1120350487bde5 Jul 23 21:14:15.311485 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1783669231 Jul 23 21:14:15.311485 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-AggregatesAdminTestJSON-1783669231-project Jul 23 21:14:15.311485 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:14:15.311485 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:14:15.311485 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 95896f2064e34e5d82e9531e68aab170 Jul 23 21:14:15.311485 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-AggregatesAdminTestJSON-1783669231-project Jul 23 21:14:15.311485 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:14:15.311485 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance 1d5a909f-c169-415e-a7b7-41835906e801 could not be found. Jul 23 21:14:15.311485 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '1d5a909f-c169-415e-a7b7-41835906e801'} Jul 23 21:14:15.312219 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:14:15.312219 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:15.312219 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:14:15.312219 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:14:15.312219 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:14:15.312219 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:14:15.312219 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:14:15.312219 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:14:15.312219 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:14:15.312219 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:14:15.312219 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d5a909f-c169-415e-a7b7-41835906e801 could not be found. Jul 23 21:14:15.312219 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:14:15.312219 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:14:15.312219 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:14:15.312219 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:15.312219 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:14:15.312219 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:14:15.312219 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:14:15.312219 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:14:15.312219 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:14:15.313258 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:14:15.313258 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 23 21:14:15.313258 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 23 21:14:15.313258 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 23 21:14:15.313258 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 23 21:14:15.313258 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:14:15.313258 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:14:15.313258 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:14:15.313258 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:14:15.313258 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d5a909f-c169-415e-a7b7-41835906e801 could not be found. Jul 23 21:14:15.313258 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:14:15.313258 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:14:15.313258 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:14:15.313258 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:15.313258 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:14:15.313258 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:14:15.313258 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:14:15.313258 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:14:15.313258 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d5a909f-c169-415e-a7b7-41835906e801 could not be found. Jul 23 21:14:15.313258 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:14:15.317398 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6e72f36f-455e-4179-bd30-45822ae17e1d tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Returning 404 to user: Instance 1d5a909f-c169-415e-a7b7-41835906e801 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:14:15.319642 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6e72f36f-455e-4179-bd30-45822ae17e1d tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] 10.222.0.17 "DELETE /compute/v2.1/servers/1d5a909f-c169-415e-a7b7-41835906e801" status: 404 len: 111 microversion: 2.1 time: 0.060715 Jul 23 21:14:15.321381 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 133/313] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:14:15 2022] DELETE /compute/v2.1/servers/1d5a909f-c169-415e-a7b7-41835906e801 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:14:15.327149 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b9e23a65-2776-4212-a9d1-2ce3c62bb1dd tempest-HypervisorAdminNegativeTestJSON-1767240806 tempest-HypervisorAdminNegativeTestJSON-1767240806-project-admin] Calling method '.version_select at 0x7f0b54c0f310>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:15.328239 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:15.328239 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:14:15.329451 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-b9e23a65-2776-4212-a9d1-2ce3c62bb1dd tempest-HypervisorAdminNegativeTestJSON-1767240806 tempest-HypervisorAdminNegativeTestJSON-1767240806-project-admin] HTTP exception thrown: Hypervisor with ID 'a8f5aa11-6f2d-4b6d-9f36-235b4d4a58b0' could not be found. Jul 23 21:14:15.332453 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b9e23a65-2776-4212-a9d1-2ce3c62bb1dd tempest-HypervisorAdminNegativeTestJSON-1767240806 tempest-HypervisorAdminNegativeTestJSON-1767240806-project-admin] Request method failure captured: Jul 23 21:14:15.332453 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/os-hypervisors/a8f5aa11-6f2d-4b6d-9f36-235b4d4a58b0 HTTP/1.1 Jul 23 21:14:15.332453 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:14:15.332453 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:14:15.332453 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:14:15.332453 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:14:15.332453 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:14:15.332453 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:14:15.332453 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:14:15.332453 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:14:15.332453 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GSj4DSLThFmc2M0hVIva-qFyB11xXOpUkBVoVQJN22RdhKAuj4gkfHr0F96-oIVahv5HKmWLjmhqOcFNXM9HajzvTJRSvA8PJjqWkWkBRrjKHPNHwkzp3gi5rUk4zi0wMLAZl9j_7TvVaxbIBmHNInPYWADz_03B2O5tViqXMxGGZw Jul 23 21:14:15.332453 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:14:15.332453 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:14:15.332453 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:14:15.332453 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:14:15.332453 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:14:15.332453 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:14:15.332453 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 638e3886481548668ccddebb3eabfa12 Jul 23 21:14:15.332453 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1767240806 Jul 23 21:14:15.332453 ncdv-master-1 devstack@n-api.service[131320]: X-Role: admin,reader,member Jul 23 21:14:15.332453 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: admin,reader,member Jul 23 21:14:15.333646 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/638e3886481548668ccddebb3eabfa12"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/638e3886481548668ccddebb3eabfa12"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_638e3886481548668ccddebb3eabfa12", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/638e3886481548668ccddebb3eabfa12"}]}] Jul 23 21:14:15.333646 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1767240806 Jul 23 21:14:15.333646 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 638e3886481548668ccddebb3eabfa12 Jul 23 21:14:15.333646 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1767240806 Jul 23 21:14:15.333646 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-HypervisorAdminNegativeTestJSON-1767240806-project-admin Jul 23 21:14:15.333646 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:14:15.333646 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:14:15.333646 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: c03fe65aa9364b8a94f79f887387d260 Jul 23 21:14:15.333646 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1767240806-project-admin Jul 23 21:14:15.333646 ncdv-master-1 devstack@n-api.service[131320]: method: Jul 23 21:14:15.333646 ncdv-master-1 devstack@n-api.service[131320]: exception: Hypervisor with ID 'a8f5aa11-6f2d-4b6d-9f36-235b4d4a58b0' could not be found. Jul 23 21:14:15.333646 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': 'a8f5aa11-6f2d-4b6d-9f36-235b4d4a58b0'} Jul 23 21:14:15.334416 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:14:15.334416 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:15.334416 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Jul 23 21:14:15.334416 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi value = int(str(value)) Jul 23 21:14:15.334416 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'a8f5aa11-6f2d-4b6d-9f36-235b4d4a58b0' Jul 23 21:14:15.334416 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:14:15.334416 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:14:15.334416 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:14:15.334416 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:15.334416 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Jul 23 21:14:15.334416 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Jul 23 21:14:15.334416 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Jul 23 21:14:15.334416 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Jul 23 21:14:15.334416 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Jul 23 21:14:15.334416 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:14:15.334416 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:14:15.334416 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:14:15.334416 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:15.334416 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Jul 23 21:14:15.334416 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Jul 23 21:14:15.334416 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Jul 23 21:14:15.334416 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Jul 23 21:14:15.335582 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Jul 23 21:14:15.335582 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:14:15.335582 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:14:15.335582 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:14:15.335582 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:15.335582 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:14:15.335582 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:14:15.335582 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:14:15.335582 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:14:15.335582 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:14:15.335582 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:14:15.335582 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:14:15.335582 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:14:15.335582 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Jul 23 21:14:15.335582 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jul 23 21:14:15.335582 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Jul 23 21:14:15.335582 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Jul 23 21:14:15.335582 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Jul 23 21:14:15.335582 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 23 21:14:15.335582 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'a8f5aa11-6f2d-4b6d-9f36-235b4d4a58b0' could not be found. Jul 23 21:14:15.336630 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:14:15.336630 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:14:15.336630 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:14:15.336630 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:15.336630 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:14:15.336630 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:14:15.336630 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:14:15.336630 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:14:15.336630 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'a8f5aa11-6f2d-4b6d-9f36-235b4d4a58b0' could not be found. Jul 23 21:14:15.336630 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:14:15.339965 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b9e23a65-2776-4212-a9d1-2ce3c62bb1dd tempest-HypervisorAdminNegativeTestJSON-1767240806 tempest-HypervisorAdminNegativeTestJSON-1767240806-project-admin] Returning 404 to user: Hypervisor with ID 'a8f5aa11-6f2d-4b6d-9f36-235b4d4a58b0' could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:14:15.341376 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b9e23a65-2776-4212-a9d1-2ce3c62bb1dd tempest-HypervisorAdminNegativeTestJSON-1767240806 tempest-HypervisorAdminNegativeTestJSON-1767240806-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors/a8f5aa11-6f2d-4b6d-9f36-235b4d4a58b0" status: 404 len: 123 microversion: 2.1 time: 0.018198 Jul 23 21:14:15.343106 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 134/314] 10.222.0.17 () {58 vars in 1256 bytes} [Sat Jul 23 21:14:15 2022] GET /compute/v2.1/os-hypervisors/a8f5aa11-6f2d-4b6d-9f36-235b4d4a58b0 => generated 123 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:14:15.349962 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9c73d80f-346d-479c-9173-84be1c5e7fa4 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:15.350858 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-9c73d80f-346d-479c-9173-84be1c5e7fa4 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] [instance: 1d5a909f-c169-415e-a7b7-41835906e801] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:14:15.366319 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9c73d80f-346d-479c-9173-84be1c5e7fa4 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:15.367820 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9c73d80f-346d-479c-9173-84be1c5e7fa4 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:15.368924 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9c73d80f-346d-479c-9173-84be1c5e7fa4 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:15.369787 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9c73d80f-346d-479c-9173-84be1c5e7fa4 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:15.388118 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-9c73d80f-346d-479c-9173-84be1c5e7fa4 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] HTTP exception thrown: Instance 1d5a909f-c169-415e-a7b7-41835906e801 could not be found. Jul 23 21:14:15.390430 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9c73d80f-346d-479c-9173-84be1c5e7fa4 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Request method failure captured: Jul 23 21:14:15.390430 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/1d5a909f-c169-415e-a7b7-41835906e801 HTTP/1.1 Jul 23 21:14:15.390430 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:14:15.390430 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:14:15.390430 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:14:15.390430 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:14:15.390430 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:14:15.390430 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:14:15.390430 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:14:15.390430 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:14:15.390430 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GR1eI889iz1UdOMfj-AWbWeN2aV76a5pfj4M3aeDd2iTJca2skQPCt-TeybZWX5RXMEzwhb3I6Zsxrsk4g9IZ2wNC9swlAqtfJXbq8C2TXLA7Y5M7WirEk1HUdIfULr6oHCu-dC-PIZSuAWkEl5W6343G7QEv7Lmk9voK1dKeUh_C8 Jul 23 21:14:15.390430 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:14:15.390430 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:14:15.390430 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:14:15.390430 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:14:15.390430 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:14:15.390430 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:14:15.390430 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 2366e681931c49118c1120350487bde5 Jul 23 21:14:15.390430 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-AggregatesAdminTestJSON-1783669231 Jul 23 21:14:15.390430 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:14:15.390430 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:14:15.391545 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2366e681931c49118c1120350487bde5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2366e681931c49118c1120350487bde5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2366e681931c49118c1120350487bde5", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2366e681931c49118c1120350487bde5"}]}] Jul 23 21:14:15.391545 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-AggregatesAdminTestJSON-1783669231 Jul 23 21:14:15.391545 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 2366e681931c49118c1120350487bde5 Jul 23 21:14:15.391545 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1783669231 Jul 23 21:14:15.391545 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-AggregatesAdminTestJSON-1783669231-project Jul 23 21:14:15.391545 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:14:15.391545 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:14:15.391545 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 95896f2064e34e5d82e9531e68aab170 Jul 23 21:14:15.391545 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-AggregatesAdminTestJSON-1783669231-project Jul 23 21:14:15.391545 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:14:15.391545 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance 1d5a909f-c169-415e-a7b7-41835906e801 could not be found. Jul 23 21:14:15.391545 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '1d5a909f-c169-415e-a7b7-41835906e801'} Jul 23 21:14:15.392382 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:14:15.392382 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:15.392382 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:14:15.392382 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:14:15.392382 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:14:15.392382 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:14:15.392382 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:14:15.392382 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:14:15.392382 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:14:15.392382 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:14:15.392382 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d5a909f-c169-415e-a7b7-41835906e801 could not be found. Jul 23 21:14:15.392382 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:14:15.392382 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:14:15.392382 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:14:15.392382 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:15.392382 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:14:15.392382 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:14:15.392382 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:14:15.392382 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:14:15.392382 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:14:15.393429 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:14:15.393429 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:14:15.393429 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:14:15.393429 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:14:15.393429 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:14:15.393429 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:14:15.393429 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:14:15.393429 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d5a909f-c169-415e-a7b7-41835906e801 could not be found. Jul 23 21:14:15.393429 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:14:15.393429 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:14:15.393429 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:14:15.393429 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:15.393429 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:14:15.393429 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:14:15.393429 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:14:15.393429 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:14:15.393429 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d5a909f-c169-415e-a7b7-41835906e801 could not be found. Jul 23 21:14:15.393429 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:14:15.396100 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9c73d80f-346d-479c-9173-84be1c5e7fa4 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] Returning 404 to user: Instance 1d5a909f-c169-415e-a7b7-41835906e801 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:14:15.397598 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9c73d80f-346d-479c-9173-84be1c5e7fa4 tempest-AggregatesAdminTestJSON-1783669231 tempest-AggregatesAdminTestJSON-1783669231-project] 10.222.0.17 "GET /compute/v2.1/servers/1d5a909f-c169-415e-a7b7-41835906e801" status: 404 len: 111 microversion: 2.1 time: 0.052883 Jul 23 21:14:15.398884 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 135/315] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:14:15 2022] GET /compute/v2.1/servers/1d5a909f-c169-415e-a7b7-41835906e801 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:14:15.499602 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-b257d25d-d80f-4fb1-b1e1-0c21d0911bb3 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:15.511912 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-b257d25d-d80f-4fb1-b1e1-0c21d0911bb3 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/965630ba-6832-46c9-8f42-7a9fed39e598" status: 200 len: 1268 microversion: 2.1 time: 0.297979 Jul 23 21:14:15.513495 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 181/316] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:14:15 2022] GET /compute/v2.1/servers/965630ba-6832-46c9-8f42-7a9fed39e598 => generated 1268 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:14:15.640402 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ddf94cab-df6b-4360-8d54-d84c87237824 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:15.655965 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ddf94cab-df6b-4360-8d54-d84c87237824 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] [instance: 67f35bb9-3208-4a6f-bccd-91c993e5d0be] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:14:15.672947 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ddf94cab-df6b-4360-8d54-d84c87237824 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:15.673934 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ddf94cab-df6b-4360-8d54-d84c87237824 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:15.678336 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ddf94cab-df6b-4360-8d54-d84c87237824 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:15.681499 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ddf94cab-df6b-4360-8d54-d84c87237824 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:16.093458 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-064369a3-2bc7-4610-bb3d-e0d0b37da828 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:16.094341 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-064369a3-2bc7-4610-bb3d-e0d0b37da828 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 769ee4e5-e4df-4d4e-9f4c-6372c60d9e01] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:14:16.111699 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-064369a3-2bc7-4610-bb3d-e0d0b37da828 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:16.112354 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-064369a3-2bc7-4610-bb3d-e0d0b37da828 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:16.113775 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-064369a3-2bc7-4610-bb3d-e0d0b37da828 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:16.114381 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-064369a3-2bc7-4610-bb3d-e0d0b37da828 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:16.205720 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ddf94cab-df6b-4360-8d54-d84c87237824 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199522d29cb746379cb6f75d4b108cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07101aee06ca4bb6885f87cfec3257db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:16.214118 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ddf94cab-df6b-4360-8d54-d84c87237824 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] 10.222.0.17 "GET /compute/v2.1/servers/67f35bb9-3208-4a6f-bccd-91c993e5d0be" status: 200 len: 1320 microversion: 2.1 time: 0.579322 Jul 23 21:14:16.222075 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 136/317] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:14:15 2022] GET /compute/v2.1/servers/67f35bb9-3208-4a6f-bccd-91c993e5d0be => generated 1320 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:14:16.319722 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-064369a3-2bc7-4610-bb3d-e0d0b37da828 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:16.329389 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-064369a3-2bc7-4610-bb3d-e0d0b37da828 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/769ee4e5-e4df-4d4e-9f4c-6372c60d9e01" status: 200 len: 1312 microversion: 2.1 time: 0.243088 Jul 23 21:14:16.330693 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 182/318] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:14:16 2022] GET /compute/v2.1/servers/769ee4e5-e4df-4d4e-9f4c-6372c60d9e01 => generated 1312 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:14:16.532040 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-14e5f551-093a-44dc-9117-2ee07c259632 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:16.533443 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-14e5f551-093a-44dc-9117-2ee07c259632 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 965630ba-6832-46c9-8f42-7a9fed39e598] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:14:16.541602 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-14e5f551-093a-44dc-9117-2ee07c259632 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:16.542177 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-14e5f551-093a-44dc-9117-2ee07c259632 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:16.543021 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-14e5f551-093a-44dc-9117-2ee07c259632 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:16.543455 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-14e5f551-093a-44dc-9117-2ee07c259632 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:16.868245 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-14e5f551-093a-44dc-9117-2ee07c259632 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:16.880361 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-14e5f551-093a-44dc-9117-2ee07c259632 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/965630ba-6832-46c9-8f42-7a9fed39e598" status: 200 len: 1310 microversion: 2.1 time: 0.352913 Jul 23 21:14:16.890248 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 137/319] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:14:16 2022] GET /compute/v2.1/servers/965630ba-6832-46c9-8f42-7a9fed39e598 => generated 1310 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:14:16.970560 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-cb67a000-ee66-4948-8624-82774b65b558 req-221659fc-7940-4b42-89b3-86146a17658e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "965630ba-6832-46c9-8f42-7a9fed39e598", "tag": "93e984c6-69bf-434e-b812-af74ab1347d8"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:14:16.984866 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-cb67a000-ee66-4948-8624-82774b65b558 req-221659fc-7940-4b42-89b3-86146a17658e service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:16.985327 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-cb67a000-ee66-4948-8624-82774b65b558 req-221659fc-7940-4b42-89b3-86146a17658e service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:17.003434 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-cb67a000-ee66-4948-8624-82774b65b558 req-221659fc-7940-4b42-89b3-86146a17658e service nova] Creating event network-changed:93e984c6-69bf-434e-b812-af74ab1347d8 for instance 965630ba-6832-46c9-8f42-7a9fed39e598 on nch1-master-1 Jul 23 21:14:17.008919 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-cb67a000-ee66-4948-8624-82774b65b558 req-221659fc-7940-4b42-89b3-86146a17658e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042466 Jul 23 21:14:17.009531 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 183/320] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:14:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:14:17.231394 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6146503c-a4da-4fbf-9362-f415a8d4b0c5 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:17.231920 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6146503c-a4da-4fbf-9362-f415a8d4b0c5 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] [instance: 67f35bb9-3208-4a6f-bccd-91c993e5d0be] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:14:17.240691 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6146503c-a4da-4fbf-9362-f415a8d4b0c5 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:17.241157 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6146503c-a4da-4fbf-9362-f415a8d4b0c5 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:17.242051 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6146503c-a4da-4fbf-9362-f415a8d4b0c5 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:17.242691 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6146503c-a4da-4fbf-9362-f415a8d4b0c5 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:17.350167 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-df248642-7d07-466b-bd57-a1901e06be5d tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:17.351629 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-df248642-7d07-466b-bd57-a1901e06be5d tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 769ee4e5-e4df-4d4e-9f4c-6372c60d9e01] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:14:17.368563 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-df248642-7d07-466b-bd57-a1901e06be5d tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:17.369841 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-df248642-7d07-466b-bd57-a1901e06be5d tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:17.371893 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-df248642-7d07-466b-bd57-a1901e06be5d tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:17.373782 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-df248642-7d07-466b-bd57-a1901e06be5d tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:17.796203 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6146503c-a4da-4fbf-9362-f415a8d4b0c5 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199522d29cb746379cb6f75d4b108cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07101aee06ca4bb6885f87cfec3257db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:17.804036 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6146503c-a4da-4fbf-9362-f415a8d4b0c5 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] 10.222.0.17 "GET /compute/v2.1/servers/67f35bb9-3208-4a6f-bccd-91c993e5d0be" status: 200 len: 1320 microversion: 2.1 time: 0.576599 Jul 23 21:14:17.810226 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 138/321] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:14:17 2022] GET /compute/v2.1/servers/67f35bb9-3208-4a6f-bccd-91c993e5d0be => generated 1320 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:14:17.822078 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-ebf12348-2f3a-4a65-86b4-d2ec140bc715 req-07d7767e-7800-49b7-babb-634d6ccdfa10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67f35bb9-3208-4a6f-bccd-91c993e5d0be", "name": "network-vif-plugged", "status": "completed", "tag": "92c4d90e-3729-42fa-90e2-afe182773805"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:14:17.846195 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-ebf12348-2f3a-4a65-86b4-d2ec140bc715 req-07d7767e-7800-49b7-babb-634d6ccdfa10 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:17.849326 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-ebf12348-2f3a-4a65-86b4-d2ec140bc715 req-07d7767e-7800-49b7-babb-634d6ccdfa10 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:17.878614 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-ebf12348-2f3a-4a65-86b4-d2ec140bc715 req-07d7767e-7800-49b7-babb-634d6ccdfa10 service nova] Creating event network-vif-plugged:92c4d90e-3729-42fa-90e2-afe182773805 for instance 67f35bb9-3208-4a6f-bccd-91c993e5d0be on nch2-master-1 Jul 23 21:14:17.886661 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-ebf12348-2f3a-4a65-86b4-d2ec140bc715 req-07d7767e-7800-49b7-babb-634d6ccdfa10 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074580 Jul 23 21:14:17.887737 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 139/322] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:14:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:14:17.900035 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-16595e43-82e5-4193-9b98-27c37dad2ff5 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:17.901555 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-16595e43-82e5-4193-9b98-27c37dad2ff5 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 965630ba-6832-46c9-8f42-7a9fed39e598] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:14:17.911804 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-16595e43-82e5-4193-9b98-27c37dad2ff5 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:17.912585 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-16595e43-82e5-4193-9b98-27c37dad2ff5 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:17.914117 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-16595e43-82e5-4193-9b98-27c37dad2ff5 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:17.914715 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-16595e43-82e5-4193-9b98-27c37dad2ff5 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:17.918307 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-df248642-7d07-466b-bd57-a1901e06be5d tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:17.931265 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-df248642-7d07-466b-bd57-a1901e06be5d tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/769ee4e5-e4df-4d4e-9f4c-6372c60d9e01" status: 200 len: 1312 microversion: 2.1 time: 0.586565 Jul 23 21:14:17.932183 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 184/323] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:14:17 2022] GET /compute/v2.1/servers/769ee4e5-e4df-4d4e-9f4c-6372c60d9e01 => generated 1312 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:14:18.247339 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-16595e43-82e5-4193-9b98-27c37dad2ff5 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:18.257754 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-16595e43-82e5-4193-9b98-27c37dad2ff5 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/965630ba-6832-46c9-8f42-7a9fed39e598" status: 200 len: 1310 microversion: 2.1 time: 0.362796 Jul 23 21:14:18.258795 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 140/324] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:14:17 2022] GET /compute/v2.1/servers/965630ba-6832-46c9-8f42-7a9fed39e598 => generated 1310 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:14:18.826842 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f00785c1-94de-4a27-bcef-8ad41782ed18 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:18.827456 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-f00785c1-94de-4a27-bcef-8ad41782ed18 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] [instance: 67f35bb9-3208-4a6f-bccd-91c993e5d0be] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:14:18.845655 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f00785c1-94de-4a27-bcef-8ad41782ed18 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:18.846131 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f00785c1-94de-4a27-bcef-8ad41782ed18 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:18.846926 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f00785c1-94de-4a27-bcef-8ad41782ed18 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:18.847377 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f00785c1-94de-4a27-bcef-8ad41782ed18 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:18.948097 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ca82a67a-fa97-4980-b25f-efbad467a077 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:18.948720 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ca82a67a-fa97-4980-b25f-efbad467a077 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 769ee4e5-e4df-4d4e-9f4c-6372c60d9e01] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:14:18.957278 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ca82a67a-fa97-4980-b25f-efbad467a077 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:18.962201 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ca82a67a-fa97-4980-b25f-efbad467a077 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:18.963208 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ca82a67a-fa97-4980-b25f-efbad467a077 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:18.964018 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ca82a67a-fa97-4980-b25f-efbad467a077 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:19.175457 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-f00785c1-94de-4a27-bcef-8ad41782ed18 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199522d29cb746379cb6f75d4b108cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07101aee06ca4bb6885f87cfec3257db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:19.190953 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-f00785c1-94de-4a27-bcef-8ad41782ed18 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] 10.222.0.17 "GET /compute/v2.1/servers/67f35bb9-3208-4a6f-bccd-91c993e5d0be" status: 200 len: 1320 microversion: 2.1 time: 0.367883 Jul 23 21:14:19.192405 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 185/325] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:14:18 2022] GET /compute/v2.1/servers/67f35bb9-3208-4a6f-bccd-91c993e5d0be => generated 1320 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:14:19.276145 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-405645e2-2b73-4262-8806-de7e2d384e6a tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:19.276772 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-405645e2-2b73-4262-8806-de7e2d384e6a tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 965630ba-6832-46c9-8f42-7a9fed39e598] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:14:19.283482 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-405645e2-2b73-4262-8806-de7e2d384e6a tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:19.284249 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-405645e2-2b73-4262-8806-de7e2d384e6a tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:19.285246 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-405645e2-2b73-4262-8806-de7e2d384e6a tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:19.285915 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-405645e2-2b73-4262-8806-de7e2d384e6a tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:19.309080 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ca82a67a-fa97-4980-b25f-efbad467a077 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:19.326989 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ca82a67a-fa97-4980-b25f-efbad467a077 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/769ee4e5-e4df-4d4e-9f4c-6372c60d9e01" status: 200 len: 1312 microversion: 2.1 time: 0.379596 Jul 23 21:14:19.328533 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 141/326] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:14:18 2022] GET /compute/v2.1/servers/769ee4e5-e4df-4d4e-9f4c-6372c60d9e01 => generated 1312 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:14:19.343558 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=100 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:19.592207 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-405645e2-2b73-4262-8806-de7e2d384e6a tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:19.606072 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-405645e2-2b73-4262-8806-de7e2d384e6a tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/965630ba-6832-46c9-8f42-7a9fed39e598" status: 200 len: 1310 microversion: 2.1 time: 0.334115 Jul 23 21:14:19.607283 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 186/327] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:14:19 2022] GET /compute/v2.1/servers/965630ba-6832-46c9-8f42-7a9fed39e598 => generated 1310 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:14:20.209664 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-7ebb13b5-410e-45a7-af99-a95910fd0ec5 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:20.210629 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-7ebb13b5-410e-45a7-af99-a95910fd0ec5 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] [instance: 67f35bb9-3208-4a6f-bccd-91c993e5d0be] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:14:20.222873 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7ebb13b5-410e-45a7-af99-a95910fd0ec5 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:20.225851 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7ebb13b5-410e-45a7-af99-a95910fd0ec5 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:20.229570 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7ebb13b5-410e-45a7-af99-a95910fd0ec5 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:20.230043 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7ebb13b5-410e-45a7-af99-a95910fd0ec5 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:20.238151 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=100 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:20.345708 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-b140fdca-55a7-4345-9350-3fe6506eeffd tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:20.346920 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-b140fdca-55a7-4345-9350-3fe6506eeffd tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 769ee4e5-e4df-4d4e-9f4c-6372c60d9e01] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:14:20.358972 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b140fdca-55a7-4345-9350-3fe6506eeffd tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:20.360788 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b140fdca-55a7-4345-9350-3fe6506eeffd tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:20.363417 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b140fdca-55a7-4345-9350-3fe6506eeffd tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:20.364796 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b140fdca-55a7-4345-9350-3fe6506eeffd tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:20.516441 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-7ebb13b5-410e-45a7-af99-a95910fd0ec5 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199522d29cb746379cb6f75d4b108cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07101aee06ca4bb6885f87cfec3257db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:20.526290 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-7ebb13b5-410e-45a7-af99-a95910fd0ec5 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] 10.222.0.17 "GET /compute/v2.1/servers/67f35bb9-3208-4a6f-bccd-91c993e5d0be" status: 200 len: 1470 microversion: 2.1 time: 0.321241 Jul 23 21:14:20.539428 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 142/328] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:14:20 2022] GET /compute/v2.1/servers/67f35bb9-3208-4a6f-bccd-91c993e5d0be => generated 1470 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:14:20.839525 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-b140fdca-55a7-4345-9350-3fe6506eeffd tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:20.850269 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-b140fdca-55a7-4345-9350-3fe6506eeffd tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/769ee4e5-e4df-4d4e-9f4c-6372c60d9e01" status: 200 len: 1312 microversion: 2.1 time: 0.509450 Jul 23 21:14:20.851426 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 187/329] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:14:20 2022] GET /compute/v2.1/servers/769ee4e5-e4df-4d4e-9f4c-6372c60d9e01 => generated 1312 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:14:20.859932 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ec77a094-fa13-4498-9e8f-2989183bb5fc tempest-DeleteServersAdminTestJSON-517104125 tempest-DeleteServersAdminTestJSON-517104125-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:14:20.864294 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-ec77a094-fa13-4498-9e8f-2989183bb5fc tempest-DeleteServersAdminTestJSON-517104125 tempest-DeleteServersAdminTestJSON-517104125-project-admin] [instance: 67f35bb9-3208-4a6f-bccd-91c993e5d0be] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:14:20.884168 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ec77a094-fa13-4498-9e8f-2989183bb5fc tempest-DeleteServersAdminTestJSON-517104125 tempest-DeleteServersAdminTestJSON-517104125-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:20.884874 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ec77a094-fa13-4498-9e8f-2989183bb5fc tempest-DeleteServersAdminTestJSON-517104125 tempest-DeleteServersAdminTestJSON-517104125-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:20.887218 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ec77a094-fa13-4498-9e8f-2989183bb5fc tempest-DeleteServersAdminTestJSON-517104125 tempest-DeleteServersAdminTestJSON-517104125-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:20.888174 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ec77a094-fa13-4498-9e8f-2989183bb5fc tempest-DeleteServersAdminTestJSON-517104125 tempest-DeleteServersAdminTestJSON-517104125-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:21.063690 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-ec77a094-fa13-4498-9e8f-2989183bb5fc tempest-DeleteServersAdminTestJSON-517104125 tempest-DeleteServersAdminTestJSON-517104125-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/67f35bb9-3208-4a6f-bccd-91c993e5d0be/action" status: 202 len: 0 microversion: 2.1 time: 0.208840 Jul 23 21:14:21.068895 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 188/330] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:14:20 2022] POST /compute/v2.1/servers/67f35bb9-3208-4a6f-bccd-91c993e5d0be/action => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:14:21.076994 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-0d16680e-dbdb-4e55-800b-a7526f19b629 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:21.077957 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-0d16680e-dbdb-4e55-800b-a7526f19b629 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 965630ba-6832-46c9-8f42-7a9fed39e598] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:14:21.086626 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0d16680e-dbdb-4e55-800b-a7526f19b629 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:21.087286 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0d16680e-dbdb-4e55-800b-a7526f19b629 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:21.088479 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0d16680e-dbdb-4e55-800b-a7526f19b629 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:21.089080 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0d16680e-dbdb-4e55-800b-a7526f19b629 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:21.162208 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5f01fbd9-8a0e-46f4-9b89-449b621b1512 tempest-FlavorsAccessTestJSON-898147174 tempest-FlavorsAccessTestJSON-898147174-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1938185410", "id": 1685017814, "os-flavor-access:is_public": "False"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:14:21.164008 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:21.164008 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:14:21.195239 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5f01fbd9-8a0e-46f4-9b89-449b621b1512 tempest-FlavorsAccessTestJSON-898147174 tempest-FlavorsAccessTestJSON-898147174-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.654404 Jul 23 21:14:21.205273 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 143/331] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:14:20 2022] POST /compute/v2.1/flavors => generated 431 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:14:21.213472 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3170034d-a013-4a9e-9bb6-97a76c5c0037 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:21.214470 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-3170034d-a013-4a9e-9bb6-97a76c5c0037 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] [instance: 67f35bb9-3208-4a6f-bccd-91c993e5d0be] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:14:21.222923 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3170034d-a013-4a9e-9bb6-97a76c5c0037 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:21.224525 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3170034d-a013-4a9e-9bb6-97a76c5c0037 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:21.225724 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3170034d-a013-4a9e-9bb6-97a76c5c0037 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:21.226390 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3170034d-a013-4a9e-9bb6-97a76c5c0037 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:21.271194 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3170034d-a013-4a9e-9bb6-97a76c5c0037 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:21.271802 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3170034d-a013-4a9e-9bb6-97a76c5c0037 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:21.272533 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.objects.instance [None req-3170034d-a013-4a9e-9bb6-97a76c5c0037 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lazy-loading 'fault' on Instance uuid 67f35bb9-3208-4a6f-bccd-91c993e5d0be {{(pid=131320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:14:21.366745 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-0d16680e-dbdb-4e55-800b-a7526f19b629 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:21.378632 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-0d16680e-dbdb-4e55-800b-a7526f19b629 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/965630ba-6832-46c9-8f42-7a9fed39e598" status: 200 len: 1310 microversion: 2.1 time: 0.306572 Jul 23 21:14:21.379224 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 189/332] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:14:21 2022] GET /compute/v2.1/servers/965630ba-6832-46c9-8f42-7a9fed39e598 => generated 1310 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:14:21.386472 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-dd72786e-c287-44dd-98f3-abb71ba7f5c4 tempest-FlavorsAccessTestJSON-898147174 tempest-FlavorsAccessTestJSON-898147174-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "9b6f57645a0e416cb21768225f71801e"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:14:21.387814 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:21.387814 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:14:21.473707 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-3170034d-a013-4a9e-9bb6-97a76c5c0037 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199522d29cb746379cb6f75d4b108cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07101aee06ca4bb6885f87cfec3257db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:21.483348 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-3170034d-a013-4a9e-9bb6-97a76c5c0037 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] 10.222.0.17 "GET /compute/v2.1/servers/67f35bb9-3208-4a6f-bccd-91c993e5d0be" status: 200 len: 1453 microversion: 2.1 time: 0.276382 Jul 23 21:14:21.484608 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 144/333] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:14:21 2022] GET /compute/v2.1/servers/67f35bb9-3208-4a6f-bccd-91c993e5d0be => generated 1453 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:14:21.788842 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ed66ae84-69eb-44ad-ab2e-d9c62408aff0 tempest-FlavorsV261TestJSON-1907886890 tempest-FlavorsV261TestJSON-1907886890-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-315638575", "id": 1637848782, "os-flavor-access:is_public": "True"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:14:21.790847 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:21.790847 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:14:21.850888 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ed66ae84-69eb-44ad-ab2e-d9c62408aff0 tempest-FlavorsV261TestJSON-1907886890 tempest-FlavorsV261TestJSON-1907886890-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 467 microversion: 2.61 time: 0.361122 Jul 23 21:14:21.853072 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 145/334] 10.222.0.17 () {62 vars in 1187 bytes} [Sat Jul 23 21:14:21 2022] POST /compute/v2.1/flavors => generated 467 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 23 21:14:21.877802 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3c559f65-5ebd-4120-a217-40161d879f94 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:21.880436 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-3c559f65-5ebd-4120-a217-40161d879f94 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] [instance: 67f35bb9-3208-4a6f-bccd-91c993e5d0be] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:14:21.901721 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3c559f65-5ebd-4120-a217-40161d879f94 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:21.902450 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3c559f65-5ebd-4120-a217-40161d879f94 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:21.903592 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3c559f65-5ebd-4120-a217-40161d879f94 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:21.905740 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3c559f65-5ebd-4120-a217-40161d879f94 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:21.974931 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-3c559f65-5ebd-4120-a217-40161d879f94 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] [instance: 67f35bb9-3208-4a6f-bccd-91c993e5d0be] Going to try to terminate instance {{(pid=131320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:14:21.987471 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=6 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:22.042314 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=28 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:22.064605 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-dd72786e-c287-44dd-98f3-abb71ba7f5c4 tempest-FlavorsAccessTestJSON-898147174 tempest-FlavorsAccessTestJSON-898147174-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors/1685017814/action" status: 200 len: 97 microversion: 2.1 time: 0.682583 Jul 23 21:14:22.071163 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 190/335] 10.222.0.17 () {60 vars in 1199 bytes} [Sat Jul 23 21:14:21 2022] POST /compute/v2.1/flavors/1685017814/action => generated 97 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 23 21:14:22.162996 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell0:SELECT=8 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:22.222209 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-3c559f65-5ebd-4120-a217-40161d879f94 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] 10.222.0.17 "DELETE /compute/v2.1/servers/67f35bb9-3208-4a6f-bccd-91c993e5d0be" status: 204 len: 0 microversion: 2.1 time: 0.363621 Jul 23 21:14:22.226233 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 146/336] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:14:21 2022] DELETE /compute/v2.1/servers/67f35bb9-3208-4a6f-bccd-91c993e5d0be => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:14:22.233600 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-12e00d88-87e3-464f-867b-1effae261602 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:22.234728 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-12e00d88-87e3-464f-867b-1effae261602 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 769ee4e5-e4df-4d4e-9f4c-6372c60d9e01] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:14:22.243725 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-12e00d88-87e3-464f-867b-1effae261602 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:22.244569 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-12e00d88-87e3-464f-867b-1effae261602 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:22.245759 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-12e00d88-87e3-464f-867b-1effae261602 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:22.247141 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-12e00d88-87e3-464f-867b-1effae261602 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:22.478847 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-42b9ea5f-f7c9-4979-b80c-c0ee33faf215 tempest-FlavorsV261TestJSON-1904069103 tempest-FlavorsV261TestJSON-1904069103-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:22.496762 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-42b9ea5f-f7c9-4979-b80c-c0ee33faf215 tempest-FlavorsV261TestJSON-1904069103 tempest-FlavorsV261TestJSON-1904069103-project] 10.222.0.17 "GET /compute/v2.1/flavors/1637848782" status: 200 len: 467 microversion: 2.61 time: 0.422880 Jul 23 21:14:22.497319 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 191/337] 10.222.0.17 () {60 vars in 1198 bytes} [Sat Jul 23 21:14:22 2022] GET /compute/v2.1/flavors/1637848782 => generated 467 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 23 21:14:22.566260 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell0:SELECT=4 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:22.810164 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-12e00d88-87e3-464f-867b-1effae261602 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:22.820285 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-12e00d88-87e3-464f-867b-1effae261602 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/769ee4e5-e4df-4d4e-9f4c-6372c60d9e01" status: 200 len: 1312 microversion: 2.1 time: 0.591581 Jul 23 21:14:22.827233 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 147/338] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:14:22 2022] GET /compute/v2.1/servers/769ee4e5-e4df-4d4e-9f4c-6372c60d9e01 => generated 1312 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:14:22.834686 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d2f11a51-1065-46f5-aef2-7fb6b5988de3 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:22.839500 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d2f11a51-1065-46f5-aef2-7fb6b5988de3 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] [instance: 67f35bb9-3208-4a6f-bccd-91c993e5d0be] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:14:22.854010 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d2f11a51-1065-46f5-aef2-7fb6b5988de3 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:22.854543 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d2f11a51-1065-46f5-aef2-7fb6b5988de3 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:22.855335 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d2f11a51-1065-46f5-aef2-7fb6b5988de3 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:22.855985 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d2f11a51-1065-46f5-aef2-7fb6b5988de3 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:22.890574 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-273c888e-5083-44ee-80ef-339207cad35b tempest-FlavorsAccessTestJSON-1931714549 tempest-FlavorsAccessTestJSON-1931714549-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:22.938060 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-273c888e-5083-44ee-80ef-339207cad35b tempest-FlavorsAccessTestJSON-1931714549 tempest-FlavorsAccessTestJSON-1931714549-project] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 5829 microversion: 2.1 time: 0.437815 Jul 23 21:14:22.953096 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d2f11a51-1065-46f5-aef2-7fb6b5988de3 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:22.953850 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d2f11a51-1065-46f5-aef2-7fb6b5988de3 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:22.954717 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.objects.instance [None req-d2f11a51-1065-46f5-aef2-7fb6b5988de3 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lazy-loading 'fault' on Instance uuid 67f35bb9-3208-4a6f-bccd-91c993e5d0be {{(pid=131320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:14:22.955154 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 192/339] 10.222.0.17 () {58 vars in 1145 bytes} [Sat Jul 23 21:14:22 2022] GET /compute/v2.1/flavors/detail => generated 5829 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:14:22.965739 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-1729963e-ed7e-4fc4-8520-5340a982585c tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:22.966783 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-1729963e-ed7e-4fc4-8520-5340a982585c tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 965630ba-6832-46c9-8f42-7a9fed39e598] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:14:22.977684 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1729963e-ed7e-4fc4-8520-5340a982585c tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:22.978454 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1729963e-ed7e-4fc4-8520-5340a982585c tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:22.979650 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1729963e-ed7e-4fc4-8520-5340a982585c tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:22.980245 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1729963e-ed7e-4fc4-8520-5340a982585c tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:23.175308 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-1729963e-ed7e-4fc4-8520-5340a982585c tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:23.186549 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-1729963e-ed7e-4fc4-8520-5340a982585c tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/965630ba-6832-46c9-8f42-7a9fed39e598" status: 200 len: 1310 microversion: 2.1 time: 0.230050 Jul 23 21:14:23.198912 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 193/340] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:14:22 2022] GET /compute/v2.1/servers/965630ba-6832-46c9-8f42-7a9fed39e598 => generated 1310 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:14:23.219543 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-6572fed7-d698-41c5-9b9f-fa017a50f611 tempest-FlavorsV261TestJSON-1907886890 tempest-FlavorsV261TestJSON-1907886890-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:14:23.225008 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:23.225008 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:14:23.296747 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-6572fed7-d698-41c5-9b9f-fa017a50f611 tempest-FlavorsV261TestJSON-1907886890 tempest-FlavorsV261TestJSON-1907886890-project-admin] 10.222.0.17 "PUT /compute/v2.1/flavors/1637848782" status: 200 len: 468 microversion: 2.61 time: 0.096304 Jul 23 21:14:23.297820 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 194/341] 10.222.0.17 () {62 vars in 1218 bytes} [Sat Jul 23 21:14:23 2022] PUT /compute/v2.1/flavors/1637848782 => generated 468 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 23 21:14:23.303180 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d2f11a51-1065-46f5-aef2-7fb6b5988de3 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199522d29cb746379cb6f75d4b108cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07101aee06ca4bb6885f87cfec3257db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:23.304080 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-5f222e0d-0b0b-4034-b597-c6eae0a35643 tempest-FlavorsAccessTestJSON-898147174 tempest-FlavorsAccessTestJSON-898147174-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "9b6f57645a0e416cb21768225f71801e"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:14:23.305717 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:23.305717 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:14:23.312528 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d2f11a51-1065-46f5-aef2-7fb6b5988de3 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] 10.222.0.17 "GET /compute/v2.1/servers/67f35bb9-3208-4a6f-bccd-91c993e5d0be" status: 200 len: 1459 microversion: 2.1 time: 0.483890 Jul 23 21:14:23.325023 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 148/342] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:14:22 2022] GET /compute/v2.1/servers/67f35bb9-3208-4a6f-bccd-91c993e5d0be => generated 1459 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:14:23.330770 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0a34f576-0107-4e64-bd8a-84235b5ef832 tempest-FlavorsV261TestJSON-1904069103 tempest-FlavorsV261TestJSON-1904069103-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:23.369535 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-0a34f576-0107-4e64-bd8a-84235b5ef832 tempest-FlavorsV261TestJSON-1904069103 tempest-FlavorsV261TestJSON-1904069103-project] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 6249 microversion: 2.61 time: 0.043003 Jul 23 21:14:23.373114 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 149/343] 10.222.0.17 () {60 vars in 1186 bytes} [Sat Jul 23 21:14:23 2022] GET /compute/v2.1/flavors/detail => generated 6249 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:14:23.389932 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0fd2957a-d42e-4ad9-9769-faf8dec11227 tempest-FlavorsV261TestJSON-1904069103 tempest-FlavorsV261TestJSON-1904069103-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:23.436763 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-0fd2957a-d42e-4ad9-9769-faf8dec11227 tempest-FlavorsV261TestJSON-1904069103 tempest-FlavorsV261TestJSON-1904069103-project] 10.222.0.17 "GET /compute/v2.1/flavors" status: 200 len: 3156 microversion: 2.61 time: 0.050490 Jul 23 21:14:23.442215 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 150/344] 10.222.0.17 () {60 vars in 1165 bytes} [Sat Jul 23 21:14:23 2022] GET /compute/v2.1/flavors => generated 3156 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:14:23.456554 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-13d0ef94-1382-4226-97b3-4b679461ca06 tempest-FlavorsV261TestJSON-1907886890 tempest-FlavorsV261TestJSON-1907886890-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:23.459370 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:23.459370 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:14:23.494132 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-13d0ef94-1382-4226-97b3-4b679461ca06 tempest-FlavorsV261TestJSON-1907886890 tempest-FlavorsV261TestJSON-1907886890-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/1637848782" status: 202 len: 0 microversion: 2.61 time: 0.039887 Jul 23 21:14:23.497685 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 151/345] 10.222.0.17 () {60 vars in 1201 bytes} [Sat Jul 23 21:14:23 2022] DELETE /compute/v2.1/flavors/1637848782 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:14:23.509185 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-13cdd33a-7e51-42c5-9131-c908f41e472e tempest-FlavorsV261TestJSON-1907886890 tempest-FlavorsV261TestJSON-1907886890-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:23.542953 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-13cdd33a-7e51-42c5-9131-c908f41e472e tempest-FlavorsV261TestJSON-1907886890 tempest-FlavorsV261TestJSON-1907886890-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.040597 Jul 23 21:14:23.554002 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 152/346] 10.222.0.17 () {60 vars in 1186 bytes} [Sat Jul 23 21:14:23 2022] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:14:23.639331 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9f948f2e-6f27-423c-bc48-3ea2f14718b5 tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] Calling method '.version_select at 0x7f0b5422a4c0>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:23.687603 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-5f222e0d-0b0b-4034-b597-c6eae0a35643 tempest-FlavorsAccessTestJSON-898147174 tempest-FlavorsAccessTestJSON-898147174-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors/1685017814/action" status: 200 len: 21 microversion: 2.1 time: 0.388304 Jul 23 21:14:23.694088 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 195/347] 10.222.0.17 () {60 vars in 1199 bytes} [Sat Jul 23 21:14:23 2022] POST /compute/v2.1/flavors/1685017814/action => generated 21 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 23 21:14:23.701931 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-6aecba74-05df-4273-9412-f5db3747307e tempest-FlavorsAccessTestJSON-1931714549 tempest-FlavorsAccessTestJSON-1931714549-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:23.766139 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-6aecba74-05df-4273-9412-f5db3747307e tempest-FlavorsAccessTestJSON-1931714549 tempest-FlavorsAccessTestJSON-1931714549-project] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.067974 Jul 23 21:14:23.783082 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 196/348] 10.222.0.17 () {58 vars in 1145 bytes} [Sat Jul 23 21:14:23 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:14:23.789063 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-beaa8492-d111-4703-adfc-e56c5d96d2ca tempest-FlavorsAccessTestJSON-898147174 tempest-FlavorsAccessTestJSON-898147174-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:23.790125 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:23.790125 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:14:23.797948 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9f948f2e-6f27-423c-bc48-3ea2f14718b5 tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] 10.222.0.17 "GET /compute/v2.1/os-quota-sets/5c1062cf2e7d44a7b2ca6cd79cba041e" status: 200 len: 371 microversion: 2.1 time: 0.251854 Jul 23 21:14:23.805534 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 153/349] 10.222.0.17 () {58 vars in 1241 bytes} [Sat Jul 23 21:14:23 2022] GET /compute/v2.1/os-quota-sets/5c1062cf2e7d44a7b2ca6cd79cba041e => generated 371 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:14:23.823041 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-7666ad35-f234-407f-b8c9-e361df619f42 tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] Action: 'update', calling method: .version_select at 0x7f0b540e51f0>, body: {"quota_set": {"ram": "5120"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:14:23.831670 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-beaa8492-d111-4703-adfc-e56c5d96d2ca tempest-FlavorsAccessTestJSON-898147174 tempest-FlavorsAccessTestJSON-898147174-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/1685017814" status: 202 len: 0 microversion: 2.1 time: 0.042920 Jul 23 21:14:23.847835 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 197/350] 10.222.0.17 () {58 vars in 1160 bytes} [Sat Jul 23 21:14:23 2022] DELETE /compute/v2.1/flavors/1685017814 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:14:23.857503 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-2167d1cf-f409-4788-a210-74da491e16b1 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:23.858459 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-2167d1cf-f409-4788-a210-74da491e16b1 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 769ee4e5-e4df-4d4e-9f4c-6372c60d9e01] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:14:23.870490 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2167d1cf-f409-4788-a210-74da491e16b1 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:23.870987 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2167d1cf-f409-4788-a210-74da491e16b1 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:23.872842 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2167d1cf-f409-4788-a210-74da491e16b1 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:23.873446 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2167d1cf-f409-4788-a210-74da491e16b1 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:24.004255 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7666ad35-f234-407f-b8c9-e361df619f42 tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:24.006473 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7666ad35-f234-407f-b8c9-e361df619f42 tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:24.009295 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7666ad35-f234-407f-b8c9-e361df619f42 tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:24.012054 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7666ad35-f234-407f-b8c9-e361df619f42 tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:24.120189 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-2167d1cf-f409-4788-a210-74da491e16b1 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:24.134561 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-2167d1cf-f409-4788-a210-74da491e16b1 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/769ee4e5-e4df-4d4e-9f4c-6372c60d9e01" status: 200 len: 1312 microversion: 2.1 time: 0.283182 Jul 23 21:14:24.136026 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 198/351] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:14:23 2022] GET /compute/v2.1/servers/769ee4e5-e4df-4d4e-9f4c-6372c60d9e01 => generated 1312 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:14:24.147318 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a716c0ea-06f5-42b1-95f1-61b15946a513 tempest-FlavorsAccessTestJSON-898147174 tempest-FlavorsAccessTestJSON-898147174-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:24.163860 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-7666ad35-f234-407f-b8c9-e361df619f42 tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-quota-sets/5c1062cf2e7d44a7b2ca6cd79cba041e" status: 200 len: 328 microversion: 2.1 time: 0.348028 Jul 23 21:14:24.167918 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 154/352] 10.222.0.17 () {60 vars in 1261 bytes} [Sat Jul 23 21:14:23 2022] PUT /compute/v2.1/os-quota-sets/5c1062cf2e7d44a7b2ca6cd79cba041e => generated 328 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:14:24.173283 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-b75d14e8-47de-407f-8b72-a0574018f69b req-2ae252fe-de0b-42eb-98a5-3261856d00df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "769ee4e5-e4df-4d4e-9f4c-6372c60d9e01", "name": "network-vif-plugged", "status": "completed", "tag": "ac63fc07-76cc-4d6e-8aca-987edbb6e640"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:14:24.188153 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-a716c0ea-06f5-42b1-95f1-61b15946a513 tempest-FlavorsAccessTestJSON-898147174 tempest-FlavorsAccessTestJSON-898147174-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.049195 Jul 23 21:14:24.189460 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 199/353] 10.222.0.17 () {58 vars in 1145 bytes} [Sat Jul 23 21:14:24 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:14:24.199045 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-b75d14e8-47de-407f-8b72-a0574018f69b req-2ae252fe-de0b-42eb-98a5-3261856d00df service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:24.200080 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-2fcf81d3-1140-4bde-8c0b-390d47c5ac04 tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:24.202529 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-b75d14e8-47de-407f-8b72-a0574018f69b req-2ae252fe-de0b-42eb-98a5-3261856d00df service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:24.228406 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-2fcf81d3-1140-4bde-8c0b-390d47c5ac04 tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-quota-sets/5c1062cf2e7d44a7b2ca6cd79cba041e" status: 202 len: 0 microversion: 2.1 time: 0.037497 Jul 23 21:14:24.230165 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 200/354] 10.222.0.17 () {58 vars in 1244 bytes} [Sat Jul 23 21:14:24 2022] DELETE /compute/v2.1/os-quota-sets/5c1062cf2e7d44a7b2ca6cd79cba041e => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:14:24.239139 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-9d5e6b9b-7cc9-4039-98cc-19df81c03167 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:24.240005 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-9d5e6b9b-7cc9-4039-98cc-19df81c03167 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 965630ba-6832-46c9-8f42-7a9fed39e598] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:14:24.241813 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-b75d14e8-47de-407f-8b72-a0574018f69b req-2ae252fe-de0b-42eb-98a5-3261856d00df service nova] Creating event network-vif-plugged:ac63fc07-76cc-4d6e-8aca-987edbb6e640 for instance 769ee4e5-e4df-4d4e-9f4c-6372c60d9e01 on nch1-master-1 Jul 23 21:14:24.250453 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9d5e6b9b-7cc9-4039-98cc-19df81c03167 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:24.252589 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9d5e6b9b-7cc9-4039-98cc-19df81c03167 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:24.253435 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9d5e6b9b-7cc9-4039-98cc-19df81c03167 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:24.253891 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9d5e6b9b-7cc9-4039-98cc-19df81c03167 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:24.255879 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-b75d14e8-47de-407f-8b72-a0574018f69b req-2ae252fe-de0b-42eb-98a5-3261856d00df service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083616 Jul 23 21:14:24.258325 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 155/355] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:14:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:14:24.270872 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a88360e4-309c-40e5-9ee3-842068716089 tempest-FlavorsAccessTestJSON-898147174 tempest-FlavorsAccessTestJSON-898147174-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1761844262", "id": 2145738926, "os-flavor-access:is_public": "False"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:14:24.274607 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:24.274607 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:14:24.283950 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=90,nova_api:DELETE=5,nova_api:UPDATE=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:24.307631 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a88360e4-309c-40e5-9ee3-842068716089 tempest-FlavorsAccessTestJSON-898147174 tempest-FlavorsAccessTestJSON-898147174-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.047988 Jul 23 21:14:24.314565 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 156/356] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:14:24 2022] POST /compute/v2.1/flavors => generated 431 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:14:24.321494 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d7f1e759-41cc-4a53-b5ed-e09129e964a1 tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] Calling method '.version_select at 0x7f0b540a8280>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:24.690335 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d7f1e759-41cc-4a53-b5ed-e09129e964a1 tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] 10.222.0.17 "GET /compute/v2.1/os-quota-sets/5c1062cf2e7d44a7b2ca6cd79cba041e" status: 200 len: 371 microversion: 2.1 time: 0.374519 Jul 23 21:14:24.713901 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 157/357] 10.222.0.17 () {58 vars in 1241 bytes} [Sat Jul 23 21:14:24 2022] GET /compute/v2.1/os-quota-sets/5c1062cf2e7d44a7b2ca6cd79cba041e => generated 371 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:14:24.729666 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-dee48df8-5e2b-4aa5-b5fd-3a37b716b381 tempest-FlavorsAccessTestJSON-898147174 tempest-FlavorsAccessTestJSON-898147174-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:24.731708 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:24.731708 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:14:24.757563 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-dee48df8-5e2b-4aa5-b5fd-3a37b716b381 tempest-FlavorsAccessTestJSON-898147174 tempest-FlavorsAccessTestJSON-898147174-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/2145738926/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.041033 Jul 23 21:14:24.758189 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 158/358] 10.222.0.17 () {58 vars in 1208 bytes} [Sat Jul 23 21:14:24 2022] GET /compute/v2.1/flavors/2145738926/os-flavor-access => generated 21 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 23 21:14:24.780866 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-31156cab-8a84-4046-bc96-a1f7dbb435e1 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:24.783491 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-31156cab-8a84-4046-bc96-a1f7dbb435e1 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] [instance: 67f35bb9-3208-4a6f-bccd-91c993e5d0be] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:14:24.796444 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-9d5e6b9b-7cc9-4039-98cc-19df81c03167 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:24.808778 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-9d5e6b9b-7cc9-4039-98cc-19df81c03167 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/965630ba-6832-46c9-8f42-7a9fed39e598" status: 200 len: 1310 microversion: 2.1 time: 0.576765 Jul 23 21:14:24.810184 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 201/359] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:14:24 2022] GET /compute/v2.1/servers/965630ba-6832-46c9-8f42-7a9fed39e598 => generated 1310 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:14:24.815003 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-fa49a408-0320-47dc-a56b-c699da127a4a tempest-FlavorsAccessTestJSON-898147174 tempest-FlavorsAccessTestJSON-898147174-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:24.823250 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:24.823250 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:14:24.834774 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-31156cab-8a84-4046-bc96-a1f7dbb435e1 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:24.835323 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-31156cab-8a84-4046-bc96-a1f7dbb435e1 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:24.836094 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-31156cab-8a84-4046-bc96-a1f7dbb435e1 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:24.836539 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-31156cab-8a84-4046-bc96-a1f7dbb435e1 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:24.867033 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-fa49a408-0320-47dc-a56b-c699da127a4a tempest-FlavorsAccessTestJSON-898147174 tempest-FlavorsAccessTestJSON-898147174-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/2145738926" status: 202 len: 0 microversion: 2.1 time: 0.055511 Jul 23 21:14:24.868530 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 202/360] 10.222.0.17 () {58 vars in 1160 bytes} [Sat Jul 23 21:14:24 2022] DELETE /compute/v2.1/flavors/2145738926 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:14:24.881133 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f32d868d-ed7b-4f88-8929-4449fa64f95a tempest-FlavorsAccessTestJSON-898147174 tempest-FlavorsAccessTestJSON-898147174-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:24.904695 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-31156cab-8a84-4046-bc96-a1f7dbb435e1 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:24.905793 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-31156cab-8a84-4046-bc96-a1f7dbb435e1 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:24.906420 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.objects.instance [None req-31156cab-8a84-4046-bc96-a1f7dbb435e1 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lazy-loading 'fault' on Instance uuid 67f35bb9-3208-4a6f-bccd-91c993e5d0be {{(pid=131320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:14:24.941984 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-f32d868d-ed7b-4f88-8929-4449fa64f95a tempest-FlavorsAccessTestJSON-898147174 tempest-FlavorsAccessTestJSON-898147174-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.062906 Jul 23 21:14:24.943275 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 203/361] 10.222.0.17 () {58 vars in 1145 bytes} [Sat Jul 23 21:14:24 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:14:24.973500 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-8e3988ea-0550-46ad-8446-b960f4272acc tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] Calling method '.version_select at 0x7f0b54822940>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:25.126957 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-31156cab-8a84-4046-bc96-a1f7dbb435e1 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199522d29cb746379cb6f75d4b108cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07101aee06ca4bb6885f87cfec3257db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:25.136520 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-31156cab-8a84-4046-bc96-a1f7dbb435e1 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] 10.222.0.17 "GET /compute/v2.1/servers/67f35bb9-3208-4a6f-bccd-91c993e5d0be" status: 200 len: 1417 microversion: 2.1 time: 0.367112 Jul 23 21:14:25.142672 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 159/362] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:14:24 2022] GET /compute/v2.1/servers/67f35bb9-3208-4a6f-bccd-91c993e5d0be => generated 1417 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:14:25.152486 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-cb6a9a45-3227-4cf6-95fe-d70d24291ed3 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:25.153108 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-cb6a9a45-3227-4cf6-95fe-d70d24291ed3 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 769ee4e5-e4df-4d4e-9f4c-6372c60d9e01] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:14:25.160397 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cb6a9a45-3227-4cf6-95fe-d70d24291ed3 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:25.161078 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cb6a9a45-3227-4cf6-95fe-d70d24291ed3 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:25.162043 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cb6a9a45-3227-4cf6-95fe-d70d24291ed3 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:25.162776 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cb6a9a45-3227-4cf6-95fe-d70d24291ed3 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:25.410831 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-8e3988ea-0550-46ad-8446-b960f4272acc tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] 10.222.0.17 "GET /compute/v2.1/os-quota-sets/66610bd60abc459dae24d25231d10cfe/defaults" status: 200 len: 371 microversion: 2.1 time: 0.442618 Jul 23 21:14:25.412002 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 204/363] 10.222.0.17 () {58 vars in 1268 bytes} [Sat Jul 23 21:14:24 2022] GET /compute/v2.1/os-quota-sets/66610bd60abc459dae24d25231d10cfe/defaults => generated 371 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:14:25.518328 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-cb6a9a45-3227-4cf6-95fe-d70d24291ed3 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:25.531681 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-cb6a9a45-3227-4cf6-95fe-d70d24291ed3 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/769ee4e5-e4df-4d4e-9f4c-6372c60d9e01" status: 200 len: 1312 microversion: 2.1 time: 0.383135 Jul 23 21:14:25.538396 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 160/364] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:14:25 2022] GET /compute/v2.1/servers/769ee4e5-e4df-4d4e-9f4c-6372c60d9e01 => generated 1312 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:14:25.662534 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-b4377a12-c8ef-459e-9b4d-d982f33c125b req-620813b3-353a-4ddc-aea9-0aead4477eb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67f35bb9-3208-4a6f-bccd-91c993e5d0be", "name": "network-vif-deleted", "tag": "92c4d90e-3729-42fa-90e2-afe182773805"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:14:25.678633 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-b4377a12-c8ef-459e-9b4d-d982f33c125b req-620813b3-353a-4ddc-aea9-0aead4477eb9 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:25.679315 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-b4377a12-c8ef-459e-9b4d-d982f33c125b req-620813b3-353a-4ddc-aea9-0aead4477eb9 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:25.708043 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-b4377a12-c8ef-459e-9b4d-d982f33c125b req-620813b3-353a-4ddc-aea9-0aead4477eb9 service nova] Creating event network-vif-deleted:92c4d90e-3729-42fa-90e2-afe182773805 for instance 67f35bb9-3208-4a6f-bccd-91c993e5d0be on nch2-master-1 Jul 23 21:14:25.720843 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-b4377a12-c8ef-459e-9b4d-d982f33c125b req-620813b3-353a-4ddc-aea9-0aead4477eb9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065120 Jul 23 21:14:25.723259 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 205/365] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:14:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:14:25.852556 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5f7028b2-a56a-43e9-906f-da36244613ce tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:25.853777 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5f7028b2-a56a-43e9-906f-da36244613ce tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 965630ba-6832-46c9-8f42-7a9fed39e598] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:14:25.886667 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5f7028b2-a56a-43e9-906f-da36244613ce tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:25.893321 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5f7028b2-a56a-43e9-906f-da36244613ce tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:25.899528 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5f7028b2-a56a-43e9-906f-da36244613ce tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:25.901333 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5f7028b2-a56a-43e9-906f-da36244613ce tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:26.164716 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a6eb7635-c68b-4f30-aa0d-0b05c1aa7cbf tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:26.165722 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-a6eb7635-c68b-4f30-aa0d-0b05c1aa7cbf tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] [instance: 67f35bb9-3208-4a6f-bccd-91c993e5d0be] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:14:26.179368 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a6eb7635-c68b-4f30-aa0d-0b05c1aa7cbf tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:26.179815 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a6eb7635-c68b-4f30-aa0d-0b05c1aa7cbf tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:26.185660 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a6eb7635-c68b-4f30-aa0d-0b05c1aa7cbf tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:26.186261 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a6eb7635-c68b-4f30-aa0d-0b05c1aa7cbf tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:26.264058 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a6eb7635-c68b-4f30-aa0d-0b05c1aa7cbf tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:26.266525 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a6eb7635-c68b-4f30-aa0d-0b05c1aa7cbf tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:26.280524 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.objects.instance [None req-a6eb7635-c68b-4f30-aa0d-0b05c1aa7cbf tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lazy-loading 'fault' on Instance uuid 67f35bb9-3208-4a6f-bccd-91c993e5d0be {{(pid=131321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:14:26.417689 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-a6eb7635-c68b-4f30-aa0d-0b05c1aa7cbf tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '199522d29cb746379cb6f75d4b108cb9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07101aee06ca4bb6885f87cfec3257db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:26.427772 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-a6eb7635-c68b-4f30-aa0d-0b05c1aa7cbf tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] 10.222.0.17 "GET /compute/v2.1/servers/67f35bb9-3208-4a6f-bccd-91c993e5d0be" status: 200 len: 1310 microversion: 2.1 time: 0.269919 Jul 23 21:14:26.429041 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 206/366] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:14:26 2022] GET /compute/v2.1/servers/67f35bb9-3208-4a6f-bccd-91c993e5d0be => generated 1310 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:14:26.441961 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e1365308-c178-4277-9284-2a3cf5b6c249 tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] Action: 'update', calling method: .version_select at 0x7f0b548ade50>, body: {"quota_set": {"ram": "5120"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:14:26.447927 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5f7028b2-a56a-43e9-906f-da36244613ce tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:26.463956 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5f7028b2-a56a-43e9-906f-da36244613ce tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/965630ba-6832-46c9-8f42-7a9fed39e598" status: 200 len: 1310 microversion: 2.1 time: 0.636602 Jul 23 21:14:26.476097 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 161/367] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:14:25 2022] GET /compute/v2.1/servers/965630ba-6832-46c9-8f42-7a9fed39e598 => generated 1310 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:14:26.551917 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e10978cd-21a7-47ee-851a-027ba21102d4 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:26.552537 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e10978cd-21a7-47ee-851a-027ba21102d4 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 769ee4e5-e4df-4d4e-9f4c-6372c60d9e01] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:14:26.589530 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e10978cd-21a7-47ee-851a-027ba21102d4 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:26.590771 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e10978cd-21a7-47ee-851a-027ba21102d4 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:26.593899 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e10978cd-21a7-47ee-851a-027ba21102d4 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:26.594620 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e10978cd-21a7-47ee-851a-027ba21102d4 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:26.868248 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e1365308-c178-4277-9284-2a3cf5b6c249 tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:26.868801 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e1365308-c178-4277-9284-2a3cf5b6c249 tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:26.869803 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e1365308-c178-4277-9284-2a3cf5b6c249 tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:26.870440 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e1365308-c178-4277-9284-2a3cf5b6c249 tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:26.962579 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-e1365308-c178-4277-9284-2a3cf5b6c249 tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-quota-sets/3ad0d4062a894b9aab861106cff69b34" status: 200 len: 328 microversion: 2.1 time: 0.530043 Jul 23 21:14:26.968681 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 207/368] 10.222.0.17 () {60 vars in 1261 bytes} [Sat Jul 23 21:14:26 2022] PUT /compute/v2.1/os-quota-sets/3ad0d4062a894b9aab861106cff69b34 => generated 328 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:14:26.975459 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-8066a777-d308-470b-845d-bd441006a08a tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] Calling method '.version_select at 0x7f0b547d2f70>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:27.054136 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8066a777-d308-470b-845d-bd441006a08a tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:27.054596 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8066a777-d308-470b-845d-bd441006a08a tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:27.055428 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8066a777-d308-470b-845d-bd441006a08a tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:27.055884 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8066a777-d308-470b-845d-bd441006a08a tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:27.070392 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=2,nova_api:UPDATE=1,nova_api:DELETE=9 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:27.078843 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-8066a777-d308-470b-845d-bd441006a08a tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] 10.222.0.17 "GET /compute/v2.1/os-quota-sets/3ad0d4062a894b9aab861106cff69b34/detail" status: 200 len: 916 microversion: 2.1 time: 0.108898 Jul 23 21:14:27.085919 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 208/369] 10.222.0.17 () {58 vars in 1262 bytes} [Sat Jul 23 21:14:26 2022] GET /compute/v2.1/os-quota-sets/3ad0d4062a894b9aab861106cff69b34/detail => generated 916 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:14:27.237287 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-63d9881e-5f06-49f9-96a3-95224e38233f tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] Action: 'update', calling method: .version_select at 0x7f0b54781040>, body: {"quota_set": {"ram": "2048"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:14:27.317163 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-63d9881e-5f06-49f9-96a3-95224e38233f tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:27.318578 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-63d9881e-5f06-49f9-96a3-95224e38233f tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:27.319733 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-63d9881e-5f06-49f9-96a3-95224e38233f tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:27.320399 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-63d9881e-5f06-49f9-96a3-95224e38233f tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:27.367354 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-63d9881e-5f06-49f9-96a3-95224e38233f tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:27.367854 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-63d9881e-5f06-49f9-96a3-95224e38233f tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:27.368836 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-63d9881e-5f06-49f9-96a3-95224e38233f tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:27.369545 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-63d9881e-5f06-49f9-96a3-95224e38233f tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:27.451305 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-63d9881e-5f06-49f9-96a3-95224e38233f tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-quota-sets/3ad0d4062a894b9aab861106cff69b34?user_id=a0d6c632326e4ca08bab885ed7ec0e78" status: 200 len: 328 microversion: 2.1 time: 0.222739 Jul 23 21:14:27.452294 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 209/370] 10.222.0.17 () {60 vars in 1342 bytes} [Sat Jul 23 21:14:27 2022] PUT /compute/v2.1/os-quota-sets/3ad0d4062a894b9aab861106cff69b34?user_id=a0d6c632326e4ca08bab885ed7ec0e78 => generated 328 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:14:27.457906 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-8b5337dd-62b9-4ef3-bef5-561cfb6bff1c req-d70a9da9-fcd1-489b-ad58-044034e32970 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "965630ba-6832-46c9-8f42-7a9fed39e598", "name": "network-vif-plugged", "status": "completed", "tag": "93e984c6-69bf-434e-b812-af74ab1347d8"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:14:27.466740 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-8b5337dd-62b9-4ef3-bef5-561cfb6bff1c req-d70a9da9-fcd1-489b-ad58-044034e32970 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:27.467678 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-8b5337dd-62b9-4ef3-bef5-561cfb6bff1c req-d70a9da9-fcd1-489b-ad58-044034e32970 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:27.481439 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-8b5337dd-62b9-4ef3-bef5-561cfb6bff1c req-d70a9da9-fcd1-489b-ad58-044034e32970 service nova] Creating event network-vif-plugged:93e984c6-69bf-434e-b812-af74ab1347d8 for instance 965630ba-6832-46c9-8f42-7a9fed39e598 on nch1-master-1 Jul 23 21:14:27.487636 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-8b5337dd-62b9-4ef3-bef5-561cfb6bff1c req-d70a9da9-fcd1-489b-ad58-044034e32970 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033890 Jul 23 21:14:27.494776 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 210/371] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:14:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:14:27.502724 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a855d81c-76c4-4828-803a-8f6ea71ac18c tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:27.504564 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-a855d81c-76c4-4828-803a-8f6ea71ac18c tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] [instance: 67f35bb9-3208-4a6f-bccd-91c993e5d0be] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:14:27.512561 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a855d81c-76c4-4828-803a-8f6ea71ac18c tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:27.513459 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a855d81c-76c4-4828-803a-8f6ea71ac18c tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:27.514703 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a855d81c-76c4-4828-803a-8f6ea71ac18c tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:27.515246 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a855d81c-76c4-4828-803a-8f6ea71ac18c tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:27.537056 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-a855d81c-76c4-4828-803a-8f6ea71ac18c tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] HTTP exception thrown: Instance 67f35bb9-3208-4a6f-bccd-91c993e5d0be could not be found. Jul 23 21:14:27.540392 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a855d81c-76c4-4828-803a-8f6ea71ac18c tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Request method failure captured: Jul 23 21:14:27.540392 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/servers/67f35bb9-3208-4a6f-bccd-91c993e5d0be HTTP/1.1 Jul 23 21:14:27.540392 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:14:27.540392 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:14:27.540392 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:14:27.540392 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:14:27.540392 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:14:27.540392 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:14:27.540392 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:14:27.540392 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:14:27.540392 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GR07Cxj8mDoaeSB9hMS3eSS4gJArNZG-6ujbTPYkwjLtjsO53fJ7xVOhcxnaWE85iE6P5UJbtHd3HKCAcWTdOmIpR3O4RBqTQnUXBt8xfQ3qochit-k5idnByZUlPNHGZHHPvgUJBawdkBrxCvUl-0YGEV74PaSmnxeVlsXrUP2CoE Jul 23 21:14:27.540392 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:14:27.540392 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:14:27.540392 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:14:27.540392 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:14:27.540392 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:14:27.540392 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:14:27.540392 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 07101aee06ca4bb6885f87cfec3257db Jul 23 21:14:27.540392 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-DeleteServersAdminTestJSON-192751077 Jul 23 21:14:27.540392 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:14:27.540392 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:14:27.541918 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/07101aee06ca4bb6885f87cfec3257db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/07101aee06ca4bb6885f87cfec3257db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_07101aee06ca4bb6885f87cfec3257db", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/07101aee06ca4bb6885f87cfec3257db"}]}] Jul 23 21:14:27.541918 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-DeleteServersAdminTestJSON-192751077 Jul 23 21:14:27.541918 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 07101aee06ca4bb6885f87cfec3257db Jul 23 21:14:27.541918 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-192751077 Jul 23 21:14:27.541918 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-DeleteServersAdminTestJSON-192751077-project Jul 23 21:14:27.541918 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:14:27.541918 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:14:27.541918 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 199522d29cb746379cb6f75d4b108cb9 Jul 23 21:14:27.541918 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-DeleteServersAdminTestJSON-192751077-project Jul 23 21:14:27.541918 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:14:27.541918 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance 67f35bb9-3208-4a6f-bccd-91c993e5d0be could not be found. Jul 23 21:14:27.541918 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': '67f35bb9-3208-4a6f-bccd-91c993e5d0be'} Jul 23 21:14:27.542687 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:14:27.542687 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:27.542687 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:14:27.542687 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:14:27.542687 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:14:27.542687 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:14:27.542687 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:14:27.542687 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:14:27.542687 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:14:27.542687 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:14:27.542687 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67f35bb9-3208-4a6f-bccd-91c993e5d0be could not be found. Jul 23 21:14:27.542687 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:27.542687 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:14:27.542687 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:27.542687 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:27.542687 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:14:27.542687 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:14:27.542687 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:14:27.542687 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:14:27.542687 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:14:27.543710 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:14:27.543710 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:14:27.543710 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:14:27.543710 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:14:27.543710 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:14:27.543710 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:14:27.543710 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:14:27.543710 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67f35bb9-3208-4a6f-bccd-91c993e5d0be could not be found. Jul 23 21:14:27.543710 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:27.543710 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:14:27.543710 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:27.543710 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:27.543710 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:14:27.543710 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:14:27.543710 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:14:27.543710 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:14:27.543710 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67f35bb9-3208-4a6f-bccd-91c993e5d0be could not be found. Jul 23 21:14:27.543710 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:27.544656 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a855d81c-76c4-4828-803a-8f6ea71ac18c tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Returning 404 to user: Instance 67f35bb9-3208-4a6f-bccd-91c993e5d0be could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:14:27.544656 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-a855d81c-76c4-4828-803a-8f6ea71ac18c tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] 10.222.0.17 "GET /compute/v2.1/servers/67f35bb9-3208-4a6f-bccd-91c993e5d0be" status: 404 len: 111 microversion: 2.1 time: 0.047224 Jul 23 21:14:27.549990 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 211/372] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:14:27 2022] GET /compute/v2.1/servers/67f35bb9-3208-4a6f-bccd-91c993e5d0be => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:14:27.555961 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-0c15e307-c4c7-4e11-84b6-34f546ccb091 tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] Calling method '.version_select at 0x7f0b5471dc10>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:27.584522 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e10978cd-21a7-47ee-851a-027ba21102d4 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:27.594438 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e10978cd-21a7-47ee-851a-027ba21102d4 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/769ee4e5-e4df-4d4e-9f4c-6372c60d9e01" status: 200 len: 1462 microversion: 2.1 time: 1.049292 Jul 23 21:14:27.595022 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 162/373] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:14:26 2022] GET /compute/v2.1/servers/769ee4e5-e4df-4d4e-9f4c-6372c60d9e01 => generated 1462 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:14:27.611094 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ff885cd6-d816-489f-9589-4120eb6a16ad tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:27.612065 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ff885cd6-d816-489f-9589-4120eb6a16ad tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 965630ba-6832-46c9-8f42-7a9fed39e598] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:14:27.631121 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ff885cd6-d816-489f-9589-4120eb6a16ad tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:27.634331 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ff885cd6-d816-489f-9589-4120eb6a16ad tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:27.635751 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ff885cd6-d816-489f-9589-4120eb6a16ad tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:27.636558 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ff885cd6-d816-489f-9589-4120eb6a16ad tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:27.857551 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-0c15e307-c4c7-4e11-84b6-34f546ccb091 tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] 10.222.0.17 "GET /compute/v2.1/os-quota-sets/3ad0d4062a894b9aab861106cff69b34?user_id=a0d6c632326e4ca08bab885ed7ec0e78" status: 200 len: 370 microversion: 2.1 time: 0.304933 Jul 23 21:14:27.864349 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 212/374] 10.222.0.17 () {58 vars in 1322 bytes} [Sat Jul 23 21:14:27 2022] GET /compute/v2.1/os-quota-sets/3ad0d4062a894b9aab861106cff69b34?user_id=a0d6c632326e4ca08bab885ed7ec0e78 => generated 370 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:14:27.870373 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d335d29c-dd82-4f55-aa42-66b8df393617 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:27.870948 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-d335d29c-dd82-4f55-aa42-66b8df393617 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] [instance: 67f35bb9-3208-4a6f-bccd-91c993e5d0be] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:14:27.879398 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d335d29c-dd82-4f55-aa42-66b8df393617 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:27.879942 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d335d29c-dd82-4f55-aa42-66b8df393617 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:27.880794 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d335d29c-dd82-4f55-aa42-66b8df393617 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:27.881318 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d335d29c-dd82-4f55-aa42-66b8df393617 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:27.907165 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-d335d29c-dd82-4f55-aa42-66b8df393617 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] HTTP exception thrown: Instance 67f35bb9-3208-4a6f-bccd-91c993e5d0be could not be found. Jul 23 21:14:27.909641 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d335d29c-dd82-4f55-aa42-66b8df393617 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Request method failure captured: Jul 23 21:14:27.909641 ncdv-master-1 devstack@n-api.service[131321]: request: DELETE /compute/v2.1/servers/67f35bb9-3208-4a6f-bccd-91c993e5d0be HTTP/1.1 Jul 23 21:14:27.909641 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:14:27.909641 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:14:27.909641 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:14:27.909641 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:14:27.909641 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:14:27.909641 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:14:27.909641 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:14:27.909641 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:14:27.909641 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GR07Cxj8mDoaeSB9hMS3eSS4gJArNZG-6ujbTPYkwjLtjsO53fJ7xVOhcxnaWE85iE6P5UJbtHd3HKCAcWTdOmIpR3O4RBqTQnUXBt8xfQ3qochit-k5idnByZUlPNHGZHHPvgUJBawdkBrxCvUl-0YGEV74PaSmnxeVlsXrUP2CoE Jul 23 21:14:27.909641 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:14:27.909641 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:14:27.909641 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:14:27.909641 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:14:27.909641 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:14:27.909641 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:14:27.909641 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 07101aee06ca4bb6885f87cfec3257db Jul 23 21:14:27.909641 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-DeleteServersAdminTestJSON-192751077 Jul 23 21:14:27.909641 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:14:27.909641 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:14:27.911182 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/07101aee06ca4bb6885f87cfec3257db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/07101aee06ca4bb6885f87cfec3257db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_07101aee06ca4bb6885f87cfec3257db", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/07101aee06ca4bb6885f87cfec3257db"}]}] Jul 23 21:14:27.911182 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-DeleteServersAdminTestJSON-192751077 Jul 23 21:14:27.911182 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 07101aee06ca4bb6885f87cfec3257db Jul 23 21:14:27.911182 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-192751077 Jul 23 21:14:27.911182 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-DeleteServersAdminTestJSON-192751077-project Jul 23 21:14:27.911182 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:14:27.911182 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:14:27.911182 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 199522d29cb746379cb6f75d4b108cb9 Jul 23 21:14:27.911182 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-DeleteServersAdminTestJSON-192751077-project Jul 23 21:14:27.911182 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:14:27.911182 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance 67f35bb9-3208-4a6f-bccd-91c993e5d0be could not be found. Jul 23 21:14:27.911182 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': '67f35bb9-3208-4a6f-bccd-91c993e5d0be'} Jul 23 21:14:27.911827 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:14:27.911827 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:27.911827 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:14:27.911827 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:14:27.911827 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:14:27.911827 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:14:27.911827 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:14:27.911827 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:14:27.911827 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:14:27.911827 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:14:27.911827 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67f35bb9-3208-4a6f-bccd-91c993e5d0be could not be found. Jul 23 21:14:27.911827 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:27.911827 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:14:27.911827 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:27.911827 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:27.911827 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:14:27.911827 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:14:27.911827 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:14:27.911827 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:14:27.911827 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:14:27.912898 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:14:27.912898 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 23 21:14:27.912898 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 23 21:14:27.912898 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 23 21:14:27.912898 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 23 21:14:27.912898 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:14:27.912898 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:14:27.912898 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:14:27.912898 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:14:27.912898 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67f35bb9-3208-4a6f-bccd-91c993e5d0be could not be found. Jul 23 21:14:27.912898 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:27.912898 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:14:27.912898 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:27.912898 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:27.912898 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:14:27.912898 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:14:27.912898 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:14:27.912898 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:14:27.912898 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67f35bb9-3208-4a6f-bccd-91c993e5d0be could not be found. Jul 23 21:14:27.912898 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:27.915833 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d335d29c-dd82-4f55-aa42-66b8df393617 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Returning 404 to user: Instance 67f35bb9-3208-4a6f-bccd-91c993e5d0be could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:14:27.922433 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-d335d29c-dd82-4f55-aa42-66b8df393617 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] 10.222.0.17 "DELETE /compute/v2.1/servers/67f35bb9-3208-4a6f-bccd-91c993e5d0be" status: 404 len: 111 microversion: 2.1 time: 0.052683 Jul 23 21:14:27.928168 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 213/375] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:14:27 2022] DELETE /compute/v2.1/servers/67f35bb9-3208-4a6f-bccd-91c993e5d0be => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:14:28.358819 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ff885cd6-d816-489f-9589-4120eb6a16ad tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:28.368353 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ff885cd6-d816-489f-9589-4120eb6a16ad tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/965630ba-6832-46c9-8f42-7a9fed39e598" status: 200 len: 1310 microversion: 2.1 time: 0.770602 Jul 23 21:14:28.369256 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 163/376] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:14:27 2022] GET /compute/v2.1/servers/965630ba-6832-46c9-8f42-7a9fed39e598 => generated 1310 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:14:28.374990 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ee779b3f-e6cb-4ea3-9673-1adabb9a87b1 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:28.376272 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ee779b3f-e6cb-4ea3-9673-1adabb9a87b1 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] [instance: 67f35bb9-3208-4a6f-bccd-91c993e5d0be] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:14:28.384519 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ee779b3f-e6cb-4ea3-9673-1adabb9a87b1 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:28.386069 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ee779b3f-e6cb-4ea3-9673-1adabb9a87b1 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:28.387070 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ee779b3f-e6cb-4ea3-9673-1adabb9a87b1 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:28.387865 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ee779b3f-e6cb-4ea3-9673-1adabb9a87b1 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:28.420957 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-ee779b3f-e6cb-4ea3-9673-1adabb9a87b1 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] HTTP exception thrown: Instance 67f35bb9-3208-4a6f-bccd-91c993e5d0be could not be found. Jul 23 21:14:28.423183 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ee779b3f-e6cb-4ea3-9673-1adabb9a87b1 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Request method failure captured: Jul 23 21:14:28.423183 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/67f35bb9-3208-4a6f-bccd-91c993e5d0be HTTP/1.1 Jul 23 21:14:28.423183 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:14:28.423183 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:14:28.423183 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:14:28.423183 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:14:28.423183 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:14:28.423183 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:14:28.423183 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:14:28.423183 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:14:28.423183 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GR07Cxj8mDoaeSB9hMS3eSS4gJArNZG-6ujbTPYkwjLtjsO53fJ7xVOhcxnaWE85iE6P5UJbtHd3HKCAcWTdOmIpR3O4RBqTQnUXBt8xfQ3qochit-k5idnByZUlPNHGZHHPvgUJBawdkBrxCvUl-0YGEV74PaSmnxeVlsXrUP2CoE Jul 23 21:14:28.423183 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:14:28.423183 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:14:28.423183 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:14:28.423183 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:14:28.423183 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:14:28.423183 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:14:28.423183 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 07101aee06ca4bb6885f87cfec3257db Jul 23 21:14:28.423183 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-DeleteServersAdminTestJSON-192751077 Jul 23 21:14:28.423183 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:14:28.423183 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:14:28.424471 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/07101aee06ca4bb6885f87cfec3257db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/07101aee06ca4bb6885f87cfec3257db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_07101aee06ca4bb6885f87cfec3257db", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/07101aee06ca4bb6885f87cfec3257db"}]}] Jul 23 21:14:28.424471 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-DeleteServersAdminTestJSON-192751077 Jul 23 21:14:28.424471 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 07101aee06ca4bb6885f87cfec3257db Jul 23 21:14:28.424471 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-192751077 Jul 23 21:14:28.424471 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-DeleteServersAdminTestJSON-192751077-project Jul 23 21:14:28.424471 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:14:28.424471 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:14:28.424471 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 199522d29cb746379cb6f75d4b108cb9 Jul 23 21:14:28.424471 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-DeleteServersAdminTestJSON-192751077-project Jul 23 21:14:28.424471 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:14:28.424471 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance 67f35bb9-3208-4a6f-bccd-91c993e5d0be could not be found. Jul 23 21:14:28.424471 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '67f35bb9-3208-4a6f-bccd-91c993e5d0be'} Jul 23 21:14:28.425121 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:14:28.425121 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:28.425121 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:14:28.425121 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:14:28.425121 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:14:28.425121 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:14:28.425121 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:14:28.425121 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:14:28.425121 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:14:28.425121 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:14:28.425121 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67f35bb9-3208-4a6f-bccd-91c993e5d0be could not be found. Jul 23 21:14:28.425121 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:14:28.425121 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:14:28.425121 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:14:28.425121 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:28.425121 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:14:28.425121 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:14:28.425121 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:14:28.425121 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:14:28.425121 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:14:28.426198 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:14:28.426198 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:14:28.426198 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:14:28.426198 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:14:28.426198 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:14:28.426198 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:14:28.426198 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:14:28.426198 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67f35bb9-3208-4a6f-bccd-91c993e5d0be could not be found. Jul 23 21:14:28.426198 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:14:28.426198 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:14:28.426198 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:14:28.426198 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:28.426198 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:14:28.426198 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:14:28.426198 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:14:28.426198 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:14:28.426198 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67f35bb9-3208-4a6f-bccd-91c993e5d0be could not be found. Jul 23 21:14:28.426198 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:14:28.430229 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ee779b3f-e6cb-4ea3-9673-1adabb9a87b1 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Returning 404 to user: Instance 67f35bb9-3208-4a6f-bccd-91c993e5d0be could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:14:28.431355 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ee779b3f-e6cb-4ea3-9673-1adabb9a87b1 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] 10.222.0.17 "GET /compute/v2.1/servers/67f35bb9-3208-4a6f-bccd-91c993e5d0be" status: 404 len: 111 microversion: 2.1 time: 0.060950 Jul 23 21:14:28.432470 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 164/377] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:14:28 2022] GET /compute/v2.1/servers/67f35bb9-3208-4a6f-bccd-91c993e5d0be => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:14:28.447846 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-acd6f2ad-fce0-4862-9033-ca4235f6a2d9 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:28.452741 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-acd6f2ad-fce0-4862-9033-ca4235f6a2d9 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] [instance: 5b41dd2d-cb23-4e57-91fc-1593508dc8cb] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:14:28.478189 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-acd6f2ad-fce0-4862-9033-ca4235f6a2d9 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:28.485395 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-acd6f2ad-fce0-4862-9033-ca4235f6a2d9 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:28.498914 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-acd6f2ad-fce0-4862-9033-ca4235f6a2d9 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:28.502528 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-acd6f2ad-fce0-4862-9033-ca4235f6a2d9 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:28.555183 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-acd6f2ad-fce0-4862-9033-ca4235f6a2d9 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] HTTP exception thrown: Instance 5b41dd2d-cb23-4e57-91fc-1593508dc8cb could not be found. Jul 23 21:14:28.556775 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-acd6f2ad-fce0-4862-9033-ca4235f6a2d9 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Request method failure captured: Jul 23 21:14:28.556775 ncdv-master-1 devstack@n-api.service[131320]: request: DELETE /compute/v2.1/servers/5b41dd2d-cb23-4e57-91fc-1593508dc8cb HTTP/1.1 Jul 23 21:14:28.556775 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:14:28.556775 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:14:28.556775 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:14:28.556775 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:14:28.556775 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:14:28.556775 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:14:28.556775 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:14:28.556775 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:14:28.556775 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GR07Cxj8mDoaeSB9hMS3eSS4gJArNZG-6ujbTPYkwjLtjsO53fJ7xVOhcxnaWE85iE6P5UJbtHd3HKCAcWTdOmIpR3O4RBqTQnUXBt8xfQ3qochit-k5idnByZUlPNHGZHHPvgUJBawdkBrxCvUl-0YGEV74PaSmnxeVlsXrUP2CoE Jul 23 21:14:28.556775 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:14:28.556775 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:14:28.556775 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:14:28.556775 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:14:28.556775 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:14:28.556775 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:14:28.556775 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 07101aee06ca4bb6885f87cfec3257db Jul 23 21:14:28.556775 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-DeleteServersAdminTestJSON-192751077 Jul 23 21:14:28.556775 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:14:28.556775 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:14:28.558231 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/07101aee06ca4bb6885f87cfec3257db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/07101aee06ca4bb6885f87cfec3257db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_07101aee06ca4bb6885f87cfec3257db", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/07101aee06ca4bb6885f87cfec3257db"}]}] Jul 23 21:14:28.558231 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-DeleteServersAdminTestJSON-192751077 Jul 23 21:14:28.558231 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 07101aee06ca4bb6885f87cfec3257db Jul 23 21:14:28.558231 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-192751077 Jul 23 21:14:28.558231 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-DeleteServersAdminTestJSON-192751077-project Jul 23 21:14:28.558231 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:14:28.558231 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:14:28.558231 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 199522d29cb746379cb6f75d4b108cb9 Jul 23 21:14:28.558231 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-DeleteServersAdminTestJSON-192751077-project Jul 23 21:14:28.558231 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:14:28.558231 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance 5b41dd2d-cb23-4e57-91fc-1593508dc8cb could not be found. Jul 23 21:14:28.558231 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '5b41dd2d-cb23-4e57-91fc-1593508dc8cb'} Jul 23 21:14:28.558892 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:14:28.558892 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:28.558892 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:14:28.558892 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:14:28.558892 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:14:28.558892 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:14:28.558892 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:14:28.558892 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:14:28.558892 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:14:28.558892 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:14:28.558892 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b41dd2d-cb23-4e57-91fc-1593508dc8cb could not be found. Jul 23 21:14:28.558892 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:14:28.558892 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:14:28.558892 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:14:28.558892 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:28.558892 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:14:28.558892 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:14:28.558892 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:14:28.558892 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:14:28.558892 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:14:28.559935 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:14:28.559935 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 23 21:14:28.559935 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 23 21:14:28.559935 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 23 21:14:28.559935 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 23 21:14:28.559935 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:14:28.559935 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:14:28.559935 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:14:28.559935 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:14:28.559935 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b41dd2d-cb23-4e57-91fc-1593508dc8cb could not be found. Jul 23 21:14:28.559935 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:14:28.559935 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:14:28.559935 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:14:28.559935 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:28.559935 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:14:28.559935 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:14:28.559935 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:14:28.559935 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:14:28.559935 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b41dd2d-cb23-4e57-91fc-1593508dc8cb could not be found. Jul 23 21:14:28.559935 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:14:28.561071 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-acd6f2ad-fce0-4862-9033-ca4235f6a2d9 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Returning 404 to user: Instance 5b41dd2d-cb23-4e57-91fc-1593508dc8cb could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:14:28.561071 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-acd6f2ad-fce0-4862-9033-ca4235f6a2d9 tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] 10.222.0.17 "DELETE /compute/v2.1/servers/5b41dd2d-cb23-4e57-91fc-1593508dc8cb" status: 404 len: 111 microversion: 2.1 time: 0.121306 Jul 23 21:14:28.563630 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 165/378] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:14:28 2022] DELETE /compute/v2.1/servers/5b41dd2d-cb23-4e57-91fc-1593508dc8cb => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:14:28.571796 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-082bac73-b343-4963-b3b3-2d96d31c42eb tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:28.575897 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-082bac73-b343-4963-b3b3-2d96d31c42eb tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] [instance: 5b41dd2d-cb23-4e57-91fc-1593508dc8cb] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:14:28.587775 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-082bac73-b343-4963-b3b3-2d96d31c42eb tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:28.588334 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-082bac73-b343-4963-b3b3-2d96d31c42eb tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:28.589136 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-082bac73-b343-4963-b3b3-2d96d31c42eb tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:28.589586 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-082bac73-b343-4963-b3b3-2d96d31c42eb tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:28.626458 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-082bac73-b343-4963-b3b3-2d96d31c42eb tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] HTTP exception thrown: Instance 5b41dd2d-cb23-4e57-91fc-1593508dc8cb could not be found. Jul 23 21:14:28.626458 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-082bac73-b343-4963-b3b3-2d96d31c42eb tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Request method failure captured: Jul 23 21:14:28.626458 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/5b41dd2d-cb23-4e57-91fc-1593508dc8cb HTTP/1.1 Jul 23 21:14:28.626458 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:14:28.626458 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:14:28.626458 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:14:28.626458 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:14:28.626458 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:14:28.626458 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:14:28.626458 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:14:28.626458 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:14:28.626458 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GR07Cxj8mDoaeSB9hMS3eSS4gJArNZG-6ujbTPYkwjLtjsO53fJ7xVOhcxnaWE85iE6P5UJbtHd3HKCAcWTdOmIpR3O4RBqTQnUXBt8xfQ3qochit-k5idnByZUlPNHGZHHPvgUJBawdkBrxCvUl-0YGEV74PaSmnxeVlsXrUP2CoE Jul 23 21:14:28.626458 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:14:28.626458 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:14:28.626458 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:14:28.626458 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:14:28.626458 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:14:28.626458 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:14:28.626458 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 07101aee06ca4bb6885f87cfec3257db Jul 23 21:14:28.626458 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-DeleteServersAdminTestJSON-192751077 Jul 23 21:14:28.626458 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:14:28.626458 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:14:28.627771 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/07101aee06ca4bb6885f87cfec3257db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/07101aee06ca4bb6885f87cfec3257db"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_07101aee06ca4bb6885f87cfec3257db", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/07101aee06ca4bb6885f87cfec3257db"}]}] Jul 23 21:14:28.627771 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-DeleteServersAdminTestJSON-192751077 Jul 23 21:14:28.627771 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 07101aee06ca4bb6885f87cfec3257db Jul 23 21:14:28.627771 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-192751077 Jul 23 21:14:28.627771 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-DeleteServersAdminTestJSON-192751077-project Jul 23 21:14:28.627771 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:14:28.627771 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:14:28.627771 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 199522d29cb746379cb6f75d4b108cb9 Jul 23 21:14:28.627771 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-DeleteServersAdminTestJSON-192751077-project Jul 23 21:14:28.627771 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:14:28.627771 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance 5b41dd2d-cb23-4e57-91fc-1593508dc8cb could not be found. Jul 23 21:14:28.627771 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '5b41dd2d-cb23-4e57-91fc-1593508dc8cb'} Jul 23 21:14:28.628403 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:14:28.628403 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:28.628403 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:14:28.628403 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:14:28.628403 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:14:28.628403 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:14:28.628403 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:14:28.628403 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:14:28.628403 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:14:28.628403 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:14:28.628403 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b41dd2d-cb23-4e57-91fc-1593508dc8cb could not be found. Jul 23 21:14:28.628403 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:14:28.628403 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:14:28.628403 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:14:28.628403 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:28.628403 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:14:28.628403 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:14:28.628403 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:14:28.628403 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:14:28.628403 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:14:28.629724 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:14:28.629724 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:14:28.629724 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:14:28.629724 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:14:28.629724 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:14:28.629724 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:14:28.629724 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:14:28.629724 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b41dd2d-cb23-4e57-91fc-1593508dc8cb could not be found. Jul 23 21:14:28.629724 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:14:28.629724 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:14:28.629724 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:14:28.629724 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:28.629724 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:14:28.629724 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:14:28.629724 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:14:28.629724 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:14:28.629724 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b41dd2d-cb23-4e57-91fc-1593508dc8cb could not be found. Jul 23 21:14:28.629724 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:14:28.630990 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-082bac73-b343-4963-b3b3-2d96d31c42eb tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] Returning 404 to user: Instance 5b41dd2d-cb23-4e57-91fc-1593508dc8cb could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:14:28.630990 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-082bac73-b343-4963-b3b3-2d96d31c42eb tempest-DeleteServersAdminTestJSON-192751077 tempest-DeleteServersAdminTestJSON-192751077-project] 10.222.0.17 "GET /compute/v2.1/servers/5b41dd2d-cb23-4e57-91fc-1593508dc8cb" status: 404 len: 111 microversion: 2.1 time: 0.057182 Jul 23 21:14:28.630990 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 166/379] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:14:28 2022] GET /compute/v2.1/servers/5b41dd2d-cb23-4e57-91fc-1593508dc8cb => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:14:29.028599 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9aa75526-fcf3-4bc7-9f92-be057108371e tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] Calling method '.version_select at 0x7f0b540291f0>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:29.050564 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-924d61aa-12f8-4041-b637-071f8ea0b864 tempest-MigrationsAdminTest-19880863 tempest-MigrationsAdminTest-19880863-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:29.051230 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-924d61aa-12f8-4041-b637-071f8ea0b864 tempest-MigrationsAdminTest-19880863 tempest-MigrationsAdminTest-19880863-project-admin] [instance: 769ee4e5-e4df-4d4e-9f4c-6372c60d9e01] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:14:29.062734 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-924d61aa-12f8-4041-b637-071f8ea0b864 tempest-MigrationsAdminTest-19880863 tempest-MigrationsAdminTest-19880863-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:29.063193 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-924d61aa-12f8-4041-b637-071f8ea0b864 tempest-MigrationsAdminTest-19880863 tempest-MigrationsAdminTest-19880863-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:29.064062 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-924d61aa-12f8-4041-b637-071f8ea0b864 tempest-MigrationsAdminTest-19880863 tempest-MigrationsAdminTest-19880863-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:29.066434 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-924d61aa-12f8-4041-b637-071f8ea0b864 tempest-MigrationsAdminTest-19880863 tempest-MigrationsAdminTest-19880863-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:29.539235 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-924d61aa-12f8-4041-b637-071f8ea0b864 tempest-MigrationsAdminTest-19880863 tempest-MigrationsAdminTest-19880863-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/769ee4e5-e4df-4d4e-9f4c-6372c60d9e01" status: 200 len: 1613 microversion: 2.1 time: 1.607726 Jul 23 21:14:29.539999 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 214/380] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:14:27 2022] GET /compute/v2.1/servers/769ee4e5-e4df-4d4e-9f4c-6372c60d9e01 => generated 1613 bytes in 1611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:14:29.546550 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-709177a6-4709-4da8-a9d3-a21465b666f4 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:29.548183 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-709177a6-4709-4da8-a9d3-a21465b666f4 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 965630ba-6832-46c9-8f42-7a9fed39e598] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:14:29.576097 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-709177a6-4709-4da8-a9d3-a21465b666f4 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:29.577259 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-709177a6-4709-4da8-a9d3-a21465b666f4 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:29.578386 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-709177a6-4709-4da8-a9d3-a21465b666f4 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:29.580542 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-709177a6-4709-4da8-a9d3-a21465b666f4 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:29.764441 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-709177a6-4709-4da8-a9d3-a21465b666f4 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:29.775227 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-709177a6-4709-4da8-a9d3-a21465b666f4 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/965630ba-6832-46c9-8f42-7a9fed39e598" status: 200 len: 1493 microversion: 2.1 time: 0.232329 Jul 23 21:14:29.776815 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 215/381] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:14:29 2022] GET /compute/v2.1/servers/965630ba-6832-46c9-8f42-7a9fed39e598 => generated 1493 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:14:29.781894 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ca9adc5d-d8ee-4f5b-9d57-b095d262c80e tempest-MigrationsAdminTest-19880863 tempest-MigrationsAdminTest-19880863-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:14:29.788852 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-ca9adc5d-d8ee-4f5b-9d57-b095d262c80e tempest-MigrationsAdminTest-19880863 tempest-MigrationsAdminTest-19880863-project-admin] [instance: 769ee4e5-e4df-4d4e-9f4c-6372c60d9e01] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:14:29.795824 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ca9adc5d-d8ee-4f5b-9d57-b095d262c80e tempest-MigrationsAdminTest-19880863 tempest-MigrationsAdminTest-19880863-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:29.796633 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ca9adc5d-d8ee-4f5b-9d57-b095d262c80e tempest-MigrationsAdminTest-19880863 tempest-MigrationsAdminTest-19880863-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:29.798596 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ca9adc5d-d8ee-4f5b-9d57-b095d262c80e tempest-MigrationsAdminTest-19880863 tempest-MigrationsAdminTest-19880863-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:29.799257 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ca9adc5d-d8ee-4f5b-9d57-b095d262c80e tempest-MigrationsAdminTest-19880863 tempest-MigrationsAdminTest-19880863-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:30.095331 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9aa75526-fcf3-4bc7-9f92-be057108371e tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] 10.222.0.17 "GET /compute/v2.1/os-quota-sets/66610bd60abc459dae24d25231d10cfe/defaults" status: 200 len: 371 microversion: 2.1 time: 1.070911 Jul 23 21:14:30.105322 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 167/382] 10.222.0.17 () {58 vars in 1268 bytes} [Sat Jul 23 21:14:29 2022] GET /compute/v2.1/os-quota-sets/66610bd60abc459dae24d25231d10cfe/defaults => generated 371 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:14:30.643458 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2f456959-6da3-4d96-9eef-1972a10167c8 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:30.644152 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-2f456959-6da3-4d96-9eef-1972a10167c8 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] [instance: 965630ba-6832-46c9-8f42-7a9fed39e598] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:14:30.659708 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2f456959-6da3-4d96-9eef-1972a10167c8 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:30.660262 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2f456959-6da3-4d96-9eef-1972a10167c8 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:30.662800 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2f456959-6da3-4d96-9eef-1972a10167c8 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:30.663237 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2f456959-6da3-4d96-9eef-1972a10167c8 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:30.899805 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2f456959-6da3-4d96-9eef-1972a10167c8 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/965630ba-6832-46c9-8f42-7a9fed39e598" status: 200 len: 1644 microversion: 2.1 time: 0.792297 Jul 23 21:14:30.901273 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 168/383] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:14:30 2022] GET /compute/v2.1/servers/965630ba-6832-46c9-8f42-7a9fed39e598 => generated 1644 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:14:30.906930 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-925b7ae0-eece-4207-85f4-d717f2e67254 tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] Action: 'update', calling method: .version_select at 0x7f0b5404ca60>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:14:31.058885 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ca9adc5d-d8ee-4f5b-9d57-b095d262c80e tempest-MigrationsAdminTest-19880863 tempest-MigrationsAdminTest-19880863-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'f740c6611de74dadae72b604cc5c2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06abafd34fdd4fea90decc7bec9dc63f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:31.062926 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-ca9adc5d-d8ee-4f5b-9d57-b095d262c80e tempest-MigrationsAdminTest-19880863 tempest-MigrationsAdminTest-19880863-project-admin] [instance: 769ee4e5-e4df-4d4e-9f4c-6372c60d9e01] flavor_id is None. Assuming migration. {{(pid=131321) resize /opt/stack/nova/nova/compute/api.py:4142}} Jul 23 21:14:31.063802 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-ca9adc5d-d8ee-4f5b-9d57-b095d262c80e tempest-MigrationsAdminTest-19880863 tempest-MigrationsAdminTest-19880863-project-admin] [instance: 769ee4e5-e4df-4d4e-9f4c-6372c60d9e01] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=131321) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 23 21:14:31.666407 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-925b7ae0-eece-4207-85f4-d717f2e67254 tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:31.670319 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-925b7ae0-eece-4207-85f4-d717f2e67254 tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:31.671623 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-925b7ae0-eece-4207-85f4-d717f2e67254 tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:31.676015 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-925b7ae0-eece-4207-85f4-d717f2e67254 tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:32.228339 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-925b7ae0-eece-4207-85f4-d717f2e67254 tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-quota-sets/66610bd60abc459dae24d25231d10cfe" status: 200 len: 329 microversion: 2.1 time: 1.325502 Jul 23 21:14:32.234884 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 169/384] 10.222.0.17 () {60 vars in 1262 bytes} [Sat Jul 23 21:14:30 2022] PUT /compute/v2.1/os-quota-sets/66610bd60abc459dae24d25231d10cfe => generated 329 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:14:32.240958 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b74c7697-555f-48e9-a854-1eeab8cd971e tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:32.242033 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b74c7697-555f-48e9-a854-1eeab8cd971e tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] [instance: 965630ba-6832-46c9-8f42-7a9fed39e598] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:14:32.252461 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b74c7697-555f-48e9-a854-1eeab8cd971e tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:32.253524 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b74c7697-555f-48e9-a854-1eeab8cd971e tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:32.255052 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b74c7697-555f-48e9-a854-1eeab8cd971e tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:32.255901 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b74c7697-555f-48e9-a854-1eeab8cd971e tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:32.653118 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:32.692515 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-ca9adc5d-d8ee-4f5b-9d57-b095d262c80e tempest-MigrationsAdminTest-19880863 tempest-MigrationsAdminTest-19880863-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/769ee4e5-e4df-4d4e-9f4c-6372c60d9e01/action" status: 202 len: 0 microversion: 2.1 time: 2.914020 Jul 23 21:14:32.696984 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 216/385] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:14:29 2022] POST /compute/v2.1/servers/769ee4e5-e4df-4d4e-9f4c-6372c60d9e01/action => generated 0 bytes in 2919 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:14:32.703278 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-b91a3aac-1992-4b26-8193-4be617ea78d7 tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] Action: 'update', calling method: .version_select at 0x7f0b54822dc0>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:14:33.092069 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b74c7697-555f-48e9-a854-1eeab8cd971e tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/965630ba-6832-46c9-8f42-7a9fed39e598" status: 200 len: 1644 microversion: 2.1 time: 0.854909 Jul 23 21:14:33.093692 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 170/386] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:14:32 2022] GET /compute/v2.1/servers/965630ba-6832-46c9-8f42-7a9fed39e598 => generated 1644 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:14:33.102010 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-bee08004-0353-46f0-9a3f-62063a41b1de tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:33.103207 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-bee08004-0353-46f0-9a3f-62063a41b1de tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 769ee4e5-e4df-4d4e-9f4c-6372c60d9e01] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:14:33.118429 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bee08004-0353-46f0-9a3f-62063a41b1de tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:33.119099 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bee08004-0353-46f0-9a3f-62063a41b1de tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:33.120324 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bee08004-0353-46f0-9a3f-62063a41b1de tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:33.120944 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bee08004-0353-46f0-9a3f-62063a41b1de tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:33.127166 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:33.531060 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-bee08004-0353-46f0-9a3f-62063a41b1de tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:33.545240 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-bee08004-0353-46f0-9a3f-62063a41b1de tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/769ee4e5-e4df-4d4e-9f4c-6372c60d9e01" status: 200 len: 1471 microversion: 2.1 time: 0.443791 Jul 23 21:14:33.547155 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 171/387] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:14:33 2022] GET /compute/v2.1/servers/769ee4e5-e4df-4d4e-9f4c-6372c60d9e01 => generated 1471 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:14:33.568185 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2e6e1c57-a3a0-4aa9-aa3b-2a26e4b99e85 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:33.571890 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:33.571890 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:14:33.580936 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2e6e1c57-a3a0-4aa9-aa3b-2a26e4b99e85 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:33.585656 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2e6e1c57-a3a0-4aa9-aa3b-2a26e4b99e85 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:33.588910 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2e6e1c57-a3a0-4aa9-aa3b-2a26e4b99e85 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:33.590625 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2e6e1c57-a3a0-4aa9-aa3b-2a26e4b99e85 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:33.688401 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2e6e1c57-a3a0-4aa9-aa3b-2a26e4b99e85 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.137542 Jul 23 21:14:33.691376 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 172/388] 10.222.0.17 () {58 vars in 1175 bytes} [Sat Jul 23 21:14:33 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:14:33.704256 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-096b4e5a-42b0-4b6f-9476-728eb45396ba tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:14:33.707811 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-096b4e5a-42b0-4b6f-9476-728eb45396ba tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] [instance: 965630ba-6832-46c9-8f42-7a9fed39e598] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:14:33.743049 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-096b4e5a-42b0-4b6f-9476-728eb45396ba tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:33.748201 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b91a3aac-1992-4b26-8193-4be617ea78d7 tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:33.748691 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b91a3aac-1992-4b26-8193-4be617ea78d7 tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:33.749423 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b91a3aac-1992-4b26-8193-4be617ea78d7 tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:33.749851 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b91a3aac-1992-4b26-8193-4be617ea78d7 tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:33.750243 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-096b4e5a-42b0-4b6f-9476-728eb45396ba tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:33.756369 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-096b4e5a-42b0-4b6f-9476-728eb45396ba tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:33.759080 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-096b4e5a-42b0-4b6f-9476-728eb45396ba tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:34.060081 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.objects.instance [None req-096b4e5a-42b0-4b6f-9476-728eb45396ba tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lazy-loading 'flavor' on Instance uuid 965630ba-6832-46c9-8f42-7a9fed39e598 {{(pid=131320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:14:34.175446 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-096b4e5a-42b0-4b6f-9476-728eb45396ba tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] [instance: 965630ba-6832-46c9-8f42-7a9fed39e598] Going to try to live migrate instance to nch2-master-1 {{(pid=131320) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 23 21:14:34.409890 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=13,nova_api:UPDATE=11 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:34.566696 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-b91a3aac-1992-4b26-8193-4be617ea78d7 tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-quota-sets/66610bd60abc459dae24d25231d10cfe" status: 200 len: 329 microversion: 2.1 time: 1.868021 Jul 23 21:14:34.573102 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 217/389] 10.222.0.17 () {60 vars in 1262 bytes} [Sat Jul 23 21:14:32 2022] PUT /compute/v2.1/os-quota-sets/66610bd60abc459dae24d25231d10cfe => generated 329 bytes in 1875 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:14:34.574490 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-b91a3aac-1992-4b26-8193-4be617ea78d7 tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:34.575793 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-b91a3aac-1992-4b26-8193-4be617ea78d7 tempest-QuotasAdminTestJSON-1432283241 tempest-QuotasAdminTestJSON-1432283241-project-admin] 10.222.0.17 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001642 Jul 23 21:14:34.583640 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 218/390] 10.222.0.17 () {56 vars in 885 bytes} [Sat Jul 23 21:14:34 2022] GET /compute/ => generated 377 bytes in 10 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 23 21:14:34.596229 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-9d9a1ca2-4c30-48ea-adf3-317e87d4eabe tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:34.607916 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-9d9a1ca2-4c30-48ea-adf3-317e87d4eabe tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 769ee4e5-e4df-4d4e-9f4c-6372c60d9e01] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:14:34.615952 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9d9a1ca2-4c30-48ea-adf3-317e87d4eabe tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:34.627077 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9d9a1ca2-4c30-48ea-adf3-317e87d4eabe tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:34.628150 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9d9a1ca2-4c30-48ea-adf3-317e87d4eabe tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:34.630510 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9d9a1ca2-4c30-48ea-adf3-317e87d4eabe tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:35.114176 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-9d9a1ca2-4c30-48ea-adf3-317e87d4eabe tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:35.125481 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-9d9a1ca2-4c30-48ea-adf3-317e87d4eabe tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/769ee4e5-e4df-4d4e-9f4c-6372c60d9e01" status: 200 len: 1471 microversion: 2.1 time: 0.540218 Jul 23 21:14:35.127733 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 219/391] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:14:34 2022] GET /compute/v2.1/servers/769ee4e5-e4df-4d4e-9f4c-6372c60d9e01 => generated 1471 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:14:35.813252 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a11b8ffc-4ab3-447b-82fb-6a95a662418e tempest-HostsAdminNegativeTestJSON-249164809 tempest-HostsAdminNegativeTestJSON-249164809-project-admin] Calling method '.version_select at 0x7f0b54699ee0>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:35.815054 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:35.815054 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:14:35.816562 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a11b8ffc-4ab3-447b-82fb-6a95a662418e tempest-HostsAdminNegativeTestJSON-249164809 tempest-HostsAdminNegativeTestJSON-249164809-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:35.817186 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a11b8ffc-4ab3-447b-82fb-6a95a662418e tempest-HostsAdminNegativeTestJSON-249164809 tempest-HostsAdminNegativeTestJSON-249164809-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:35.820863 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a11b8ffc-4ab3-447b-82fb-6a95a662418e tempest-HostsAdminNegativeTestJSON-249164809 tempest-HostsAdminNegativeTestJSON-249164809-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:35.821320 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a11b8ffc-4ab3-447b-82fb-6a95a662418e tempest-HostsAdminNegativeTestJSON-249164809 tempest-HostsAdminNegativeTestJSON-249164809-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:35.904826 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-a11b8ffc-4ab3-447b-82fb-6a95a662418e tempest-HostsAdminNegativeTestJSON-249164809 tempest-HostsAdminNegativeTestJSON-249164809-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.774132 Jul 23 21:14:35.905658 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 220/392] 10.222.0.17 () {58 vars in 1127 bytes} [Sat Jul 23 21:14:35 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:14:36.352910 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f206fbaf-990a-4a11-91a4-f162a86a9135 tempest-HostsAdminNegativeTestJSON-200260207 tempest-HostsAdminNegativeTestJSON-200260207-project] Calling method '.version_select at 0x7f0b5469e430>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:36.355208 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:36.355208 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:14:36.357033 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-f206fbaf-990a-4a11-91a4-f162a86a9135 tempest-HostsAdminNegativeTestJSON-200260207 tempest-HostsAdminNegativeTestJSON-200260207-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '925c3413d59f4b0bbb329317ea1f8a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa284ec485b94303a8c7e3387e31dc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:36.366310 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f206fbaf-990a-4a11-91a4-f162a86a9135 tempest-HostsAdminNegativeTestJSON-200260207 tempest-HostsAdminNegativeTestJSON-200260207-project] Request method failure captured: Jul 23 21:14:36.366310 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Jul 23 21:14:36.366310 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:14:36.366310 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:14:36.366310 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:14:36.366310 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:14:36.366310 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:14:36.366310 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:14:36.366310 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:14:36.366310 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:14:36.366310 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GS4HsSWMPGHJqkNlyglFVFy6RXjWTc2E3Eiv9mHktzya9Xl7alRc6WZuHP3hUXtd_z6_oiI_ZmxrD1VkhHR5A2oZcHG5wotlrDU-YCNh9_xUhd3ptpIoAJnTdeh0k0PMm-JbpYssgfS7A5nnPHflx-pyHkJA-3kgawwpFEBElc8VwY Jul 23 21:14:36.366310 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:14:36.366310 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:14:36.366310 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:14:36.366310 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:14:36.366310 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:14:36.366310 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:14:36.366310 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: fa284ec485b94303a8c7e3387e31dc63 Jul 23 21:14:36.366310 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-200260207 Jul 23 21:14:36.366310 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:14:36.366310 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:14:36.367659 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fa284ec485b94303a8c7e3387e31dc63"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fa284ec485b94303a8c7e3387e31dc63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_fa284ec485b94303a8c7e3387e31dc63", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/fa284ec485b94303a8c7e3387e31dc63"}]}] Jul 23 21:14:36.367659 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-HostsAdminNegativeTestJSON-200260207 Jul 23 21:14:36.367659 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: fa284ec485b94303a8c7e3387e31dc63 Jul 23 21:14:36.367659 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-200260207 Jul 23 21:14:36.367659 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-HostsAdminNegativeTestJSON-200260207-project Jul 23 21:14:36.367659 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:14:36.367659 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:14:36.367659 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 925c3413d59f4b0bbb329317ea1f8a65 Jul 23 21:14:36.367659 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-HostsAdminNegativeTestJSON-200260207-project Jul 23 21:14:36.367659 ncdv-master-1 devstack@n-api.service[131321]: method: Jul 23 21:14:36.367659 ncdv-master-1 devstack@n-api.service[131321]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jul 23 21:14:36.367659 ncdv-master-1 devstack@n-api.service[131321]: action_args: {} Jul 23 21:14:36.367659 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:14:36.368516 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:36.368516 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:14:36.368516 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:14:36.368516 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:14:36.368516 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:14:36.368516 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:14:36.368516 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:14:36.368516 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 23 21:14:36.368516 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:14:36.368516 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:14:36.368516 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:14:36.368516 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Jul 23 21:14:36.368516 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Jul 23 21:14:36.368516 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 23 21:14:36.368516 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 23 21:14:36.368516 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 23 21:14:36.368516 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 23 21:14:36.368516 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 23 21:14:36.368516 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 23 21:14:36.369616 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 23 21:14:36.369616 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise self.value Jul 23 21:14:36.369616 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 23 21:14:36.369616 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 23 21:14:36.369616 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 23 21:14:36.369616 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 23 21:14:36.369616 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 23 21:14:36.369616 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 23 21:14:36.369616 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jul 23 21:14:36.369616 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:36.369616 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:14:36.369616 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:36.369616 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:36.369616 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:14:36.369616 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:14:36.369616 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 23 21:14:36.369616 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 23 21:14:36.369616 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jul 23 21:14:36.369616 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:36.372056 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f206fbaf-990a-4a11-91a4-f162a86a9135 tempest-HostsAdminNegativeTestJSON-200260207 tempest-HostsAdminNegativeTestJSON-200260207-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:14:36.372056 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-f206fbaf-990a-4a11-91a4-f162a86a9135 tempest-HostsAdminNegativeTestJSON-200260207 tempest-HostsAdminNegativeTestJSON-200260207-project] 10.222.0.17 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.455771 Jul 23 21:14:36.372056 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 221/393] 10.222.0.17 () {58 vars in 1127 bytes} [Sat Jul 23 21:14:35 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 458 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jul 23 21:14:36.405921 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-3c56c455-7455-4792-95d8-c7a99702f4d6 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:36.415133 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-3c56c455-7455-4792-95d8-c7a99702f4d6 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 769ee4e5-e4df-4d4e-9f4c-6372c60d9e01] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:14:36.446282 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3c56c455-7455-4792-95d8-c7a99702f4d6 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:36.446732 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3c56c455-7455-4792-95d8-c7a99702f4d6 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:36.449197 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3c56c455-7455-4792-95d8-c7a99702f4d6 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:36.450113 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3c56c455-7455-4792-95d8-c7a99702f4d6 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:36.951370 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-3c56c455-7455-4792-95d8-c7a99702f4d6 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:36.973625 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-3c56c455-7455-4792-95d8-c7a99702f4d6 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/769ee4e5-e4df-4d4e-9f4c-6372c60d9e01" status: 200 len: 1471 microversion: 2.1 time: 0.580992 Jul 23 21:14:36.988076 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 222/394] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:14:36 2022] GET /compute/v2.1/servers/769ee4e5-e4df-4d4e-9f4c-6372c60d9e01 => generated 1471 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:14:36.998870 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-6fdbb309-28dd-40e5-8e27-318dd287cf3c tempest-HostsAdminNegativeTestJSON-200260207 tempest-HostsAdminNegativeTestJSON-200260207-project] Calling method '.version_select at 0x7f0b5474c8b0>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:37.000279 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:37.000279 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:14:37.011008 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-6fdbb309-28dd-40e5-8e27-318dd287cf3c tempest-HostsAdminNegativeTestJSON-200260207 tempest-HostsAdminNegativeTestJSON-200260207-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '925c3413d59f4b0bbb329317ea1f8a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa284ec485b94303a8c7e3387e31dc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:37.012834 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-6fdbb309-28dd-40e5-8e27-318dd287cf3c tempest-HostsAdminNegativeTestJSON-200260207 tempest-HostsAdminNegativeTestJSON-200260207-project] Request method failure captured: Jul 23 21:14:37.012834 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/os-hosts/ncdv-master-1/reboot HTTP/1.1 Jul 23 21:14:37.012834 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:14:37.012834 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:14:37.012834 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:14:37.012834 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:14:37.012834 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:14:37.012834 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:14:37.012834 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:14:37.012834 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:14:37.012834 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GS4HsSWMPGHJqkNlyglFVFy6RXjWTc2E3Eiv9mHktzya9Xl7alRc6WZuHP3hUXtd_z6_oiI_ZmxrD1VkhHR5A2oZcHG5wotlrDU-YCNh9_xUhd3ptpIoAJnTdeh0k0PMm-JbpYssgfS7A5nnPHflx-pyHkJA-3kgawwpFEBElc8VwY Jul 23 21:14:37.012834 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:14:37.012834 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:14:37.012834 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:14:37.012834 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:14:37.012834 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:14:37.012834 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:14:37.012834 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: fa284ec485b94303a8c7e3387e31dc63 Jul 23 21:14:37.012834 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-200260207 Jul 23 21:14:37.012834 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:14:37.012834 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:14:37.014094 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fa284ec485b94303a8c7e3387e31dc63"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fa284ec485b94303a8c7e3387e31dc63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_fa284ec485b94303a8c7e3387e31dc63", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/fa284ec485b94303a8c7e3387e31dc63"}]}] Jul 23 21:14:37.014094 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-HostsAdminNegativeTestJSON-200260207 Jul 23 21:14:37.014094 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: fa284ec485b94303a8c7e3387e31dc63 Jul 23 21:14:37.014094 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-200260207 Jul 23 21:14:37.014094 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-HostsAdminNegativeTestJSON-200260207-project Jul 23 21:14:37.014094 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:14:37.014094 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:14:37.014094 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 925c3413d59f4b0bbb329317ea1f8a65 Jul 23 21:14:37.014094 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-HostsAdminNegativeTestJSON-200260207-project Jul 23 21:14:37.014094 ncdv-master-1 devstack@n-api.service[131321]: method: Jul 23 21:14:37.014094 ncdv-master-1 devstack@n-api.service[131321]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jul 23 21:14:37.014094 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': 'ncdv-master-1'} Jul 23 21:14:37.014094 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:14:37.014778 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:37.014778 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:14:37.014778 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:14:37.014778 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:14:37.014778 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:14:37.014778 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:14:37.014778 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:14:37.014778 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:14:37.014778 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:14:37.014778 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Jul 23 21:14:37.014778 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Jul 23 21:14:37.014778 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 23 21:14:37.014778 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 23 21:14:37.014778 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 23 21:14:37.014778 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 23 21:14:37.014778 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 23 21:14:37.014778 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 23 21:14:37.014778 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 23 21:14:37.014778 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise self.value Jul 23 21:14:37.015836 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 23 21:14:37.015836 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 23 21:14:37.015836 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 23 21:14:37.015836 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 23 21:14:37.015836 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 23 21:14:37.015836 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 23 21:14:37.015836 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jul 23 21:14:37.015836 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:37.015836 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:14:37.015836 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:37.015836 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:37.015836 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:14:37.015836 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:14:37.015836 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 23 21:14:37.015836 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 23 21:14:37.015836 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jul 23 21:14:37.015836 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:37.016948 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-6fdbb309-28dd-40e5-8e27-318dd287cf3c tempest-HostsAdminNegativeTestJSON-200260207 tempest-HostsAdminNegativeTestJSON-200260207-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:14:37.030990 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-6fdbb309-28dd-40e5-8e27-318dd287cf3c tempest-HostsAdminNegativeTestJSON-200260207 tempest-HostsAdminNegativeTestJSON-200260207-project] 10.222.0.17 "GET /compute/v2.1/os-hosts/ncdv-master-1/reboot" status: 403 len: 111 microversion: 2.1 time: 0.034987 Jul 23 21:14:37.033552 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 223/395] 10.222.0.17 () {58 vars in 1190 bytes} [Sat Jul 23 21:14:36 2022] GET /compute/v2.1/os-hosts/ncdv-master-1/reboot => generated 111 bytes in 44 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:14:37.050221 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-4b2df470-cad4-4a16-a99e-f04cd3a7d83c tempest-HostsAdminNegativeTestJSON-249164809 tempest-HostsAdminNegativeTestJSON-249164809-project-admin] Calling method '.version_select at 0x7f0b54699790>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:37.073921 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-4b2df470-cad4-4a16-a99e-f04cd3a7d83c tempest-HostsAdminNegativeTestJSON-249164809 tempest-HostsAdminNegativeTestJSON-249164809-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 23 21:14:37.080413 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-4b2df470-cad4-4a16-a99e-f04cd3a7d83c tempest-HostsAdminNegativeTestJSON-249164809 tempest-HostsAdminNegativeTestJSON-249164809-project-admin] Request method failure captured: Jul 23 21:14:37.080413 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Jul 23 21:14:37.080413 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:14:37.080413 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:14:37.080413 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:14:37.080413 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:14:37.080413 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:14:37.080413 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:14:37.080413 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:14:37.080413 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:14:37.080413 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GS6SBAHKjQvdyCXBrW9HqclhPdBNJv3KI9-MiIOYZbY9gllNO78vCl452F3UATg0mWp_8fKxtwGVbDmTLwiBJ6seXrt1R2guAajnGhG5M054b3kLFU8Uy-Yp-hXKZLDe8en5oO4ZR7qah_0tsED2PPniSOSlszyV1TQVlRYVaHmIWA Jul 23 21:14:37.080413 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:14:37.080413 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:14:37.080413 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:14:37.080413 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:14:37.080413 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:14:37.080413 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:14:37.080413 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: e031fe2a65f54f1da9d17aff9c2d7b08 Jul 23 21:14:37.080413 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-249164809 Jul 23 21:14:37.080413 ncdv-master-1 devstack@n-api.service[131321]: X-Role: admin,reader,member Jul 23 21:14:37.080413 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: admin,reader,member Jul 23 21:14:37.082015 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e031fe2a65f54f1da9d17aff9c2d7b08"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e031fe2a65f54f1da9d17aff9c2d7b08"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e031fe2a65f54f1da9d17aff9c2d7b08", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e031fe2a65f54f1da9d17aff9c2d7b08"}]}] Jul 23 21:14:37.082015 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-HostsAdminNegativeTestJSON-249164809 Jul 23 21:14:37.082015 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: e031fe2a65f54f1da9d17aff9c2d7b08 Jul 23 21:14:37.082015 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-249164809 Jul 23 21:14:37.082015 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-HostsAdminNegativeTestJSON-249164809-project-admin Jul 23 21:14:37.082015 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:14:37.082015 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:14:37.082015 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 9cc2753d5f8c4a3481d35781da5b97c5 Jul 23 21:14:37.082015 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-HostsAdminNegativeTestJSON-249164809-project-admin Jul 23 21:14:37.082015 ncdv-master-1 devstack@n-api.service[131321]: method: Jul 23 21:14:37.082015 ncdv-master-1 devstack@n-api.service[131321]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 23 21:14:37.082015 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': 'nonexistent_hostname'} Jul 23 21:14:37.082015 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:14:37.082922 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:37.082922 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jul 23 21:14:37.082922 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jul 23 21:14:37.082922 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 23 21:14:37.082922 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 23 21:14:37.082922 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 23 21:14:37.082922 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 23 21:14:37.082922 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 23 21:14:37.082922 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise self.value Jul 23 21:14:37.082922 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 23 21:14:37.082922 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 23 21:14:37.082922 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jul 23 21:14:37.082922 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 23 21:14:37.082922 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 23 21:14:37.082922 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 23 21:14:37.082922 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 23 21:14:37.082922 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 23 21:14:37.082922 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 23 21:14:37.082922 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 23 21:14:37.084239 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 23 21:14:37.084239 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 23 21:14:37.084239 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 23 21:14:37.084239 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:37.084239 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:14:37.084239 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:37.084239 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:37.084239 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:14:37.084239 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:14:37.084239 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:14:37.084239 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:14:37.084239 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:14:37.084239 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:14:37.084239 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:14:37.084239 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:14:37.084239 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Jul 23 21:14:37.084239 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Jul 23 21:14:37.084239 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jul 23 21:14:37.084239 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:14:37.085503 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 23 21:14:37.085503 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:37.085503 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:14:37.085503 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:37.085503 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:37.085503 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:14:37.085503 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:14:37.085503 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:14:37.085503 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:14:37.085503 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 23 21:14:37.085503 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:37.086857 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-4b2df470-cad4-4a16-a99e-f04cd3a7d83c tempest-HostsAdminNegativeTestJSON-249164809 tempest-HostsAdminNegativeTestJSON-249164809-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:14:37.090928 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-4b2df470-cad4-4a16-a99e-f04cd3a7d83c tempest-HostsAdminNegativeTestJSON-249164809 tempest-HostsAdminNegativeTestJSON-249164809-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.051730 Jul 23 21:14:37.092253 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 224/396] 10.222.0.17 () {58 vars in 1211 bytes} [Sat Jul 23 21:14:37 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 23 21:14:37.111134 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-4b555c35-82b2-4f2d-9fdb-d1cf362ed642 tempest-HostsAdminNegativeTestJSON-200260207 tempest-HostsAdminNegativeTestJSON-200260207-project] Calling method '.version_select at 0x7f0b54699940>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:37.112078 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:37.112078 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:14:37.113283 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-4b555c35-82b2-4f2d-9fdb-d1cf362ed642 tempest-HostsAdminNegativeTestJSON-200260207 tempest-HostsAdminNegativeTestJSON-200260207-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '925c3413d59f4b0bbb329317ea1f8a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa284ec485b94303a8c7e3387e31dc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:37.122680 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-4b555c35-82b2-4f2d-9fdb-d1cf362ed642 tempest-HostsAdminNegativeTestJSON-200260207 tempest-HostsAdminNegativeTestJSON-200260207-project] Request method failure captured: Jul 23 21:14:37.122680 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/os-hosts/ncdv-master-1 HTTP/1.1 Jul 23 21:14:37.122680 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:14:37.122680 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:14:37.122680 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:14:37.122680 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:14:37.122680 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:14:37.122680 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:14:37.122680 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:14:37.122680 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:14:37.122680 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GS4HsSWMPGHJqkNlyglFVFy6RXjWTc2E3Eiv9mHktzya9Xl7alRc6WZuHP3hUXtd_z6_oiI_ZmxrD1VkhHR5A2oZcHG5wotlrDU-YCNh9_xUhd3ptpIoAJnTdeh0k0PMm-JbpYssgfS7A5nnPHflx-pyHkJA-3kgawwpFEBElc8VwY Jul 23 21:14:37.122680 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:14:37.122680 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:14:37.122680 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:14:37.122680 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:14:37.122680 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:14:37.122680 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:14:37.122680 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: fa284ec485b94303a8c7e3387e31dc63 Jul 23 21:14:37.122680 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-200260207 Jul 23 21:14:37.122680 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:14:37.122680 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:14:37.123979 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fa284ec485b94303a8c7e3387e31dc63"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fa284ec485b94303a8c7e3387e31dc63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_fa284ec485b94303a8c7e3387e31dc63", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/fa284ec485b94303a8c7e3387e31dc63"}]}] Jul 23 21:14:37.123979 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-HostsAdminNegativeTestJSON-200260207 Jul 23 21:14:37.123979 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: fa284ec485b94303a8c7e3387e31dc63 Jul 23 21:14:37.123979 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-200260207 Jul 23 21:14:37.123979 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-HostsAdminNegativeTestJSON-200260207-project Jul 23 21:14:37.123979 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:14:37.123979 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:14:37.123979 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 925c3413d59f4b0bbb329317ea1f8a65 Jul 23 21:14:37.123979 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-HostsAdminNegativeTestJSON-200260207-project Jul 23 21:14:37.123979 ncdv-master-1 devstack@n-api.service[131321]: method: Jul 23 21:14:37.123979 ncdv-master-1 devstack@n-api.service[131321]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jul 23 21:14:37.123979 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': 'ncdv-master-1'} Jul 23 21:14:37.123979 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:14:37.124697 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:37.124697 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:14:37.124697 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:14:37.124697 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:14:37.124697 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:14:37.124697 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:14:37.124697 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:14:37.124697 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:14:37.124697 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:14:37.124697 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Jul 23 21:14:37.124697 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Jul 23 21:14:37.124697 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 23 21:14:37.124697 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 23 21:14:37.124697 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 23 21:14:37.124697 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 23 21:14:37.124697 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 23 21:14:37.124697 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 23 21:14:37.124697 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 23 21:14:37.124697 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise self.value Jul 23 21:14:37.126230 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 23 21:14:37.126230 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 23 21:14:37.126230 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 23 21:14:37.126230 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 23 21:14:37.126230 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 23 21:14:37.126230 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 23 21:14:37.126230 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jul 23 21:14:37.126230 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:37.126230 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:14:37.126230 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:37.126230 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:37.126230 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:14:37.126230 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:14:37.126230 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 23 21:14:37.126230 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 23 21:14:37.126230 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jul 23 21:14:37.126230 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:37.127791 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-4b555c35-82b2-4f2d-9fdb-d1cf362ed642 tempest-HostsAdminNegativeTestJSON-200260207 tempest-HostsAdminNegativeTestJSON-200260207-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:14:37.127791 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-4b555c35-82b2-4f2d-9fdb-d1cf362ed642 tempest-HostsAdminNegativeTestJSON-200260207 tempest-HostsAdminNegativeTestJSON-200260207-project] 10.222.0.17 "GET /compute/v2.1/os-hosts/ncdv-master-1" status: 403 len: 109 microversion: 2.1 time: 0.026382 Jul 23 21:14:37.134057 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 225/397] 10.222.0.17 () {58 vars in 1169 bytes} [Sat Jul 23 21:14:37 2022] GET /compute/v2.1/os-hosts/ncdv-master-1 => generated 109 bytes in 37 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:14:37.149310 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-b4396f52-d847-424f-991f-f2634c780631 tempest-HostsAdminNegativeTestJSON-249164809 tempest-HostsAdminNegativeTestJSON-249164809-project-admin] Calling method '.version_select at 0x7f0b5474cf70>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:37.161139 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-b4396f52-d847-424f-991f-f2634c780631 tempest-HostsAdminNegativeTestJSON-249164809 tempest-HostsAdminNegativeTestJSON-249164809-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 23 21:14:37.166856 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-b4396f52-d847-424f-991f-f2634c780631 tempest-HostsAdminNegativeTestJSON-249164809 tempest-HostsAdminNegativeTestJSON-249164809-project-admin] Request method failure captured: Jul 23 21:14:37.166856 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Jul 23 21:14:37.166856 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:14:37.166856 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:14:37.166856 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:14:37.166856 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:14:37.166856 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:14:37.166856 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:14:37.166856 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:14:37.166856 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:14:37.166856 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GS6SBAHKjQvdyCXBrW9HqclhPdBNJv3KI9-MiIOYZbY9gllNO78vCl452F3UATg0mWp_8fKxtwGVbDmTLwiBJ6seXrt1R2guAajnGhG5M054b3kLFU8Uy-Yp-hXKZLDe8en5oO4ZR7qah_0tsED2PPniSOSlszyV1TQVlRYVaHmIWA Jul 23 21:14:37.166856 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:14:37.166856 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:14:37.166856 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:14:37.166856 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:14:37.166856 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:14:37.166856 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:14:37.166856 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: e031fe2a65f54f1da9d17aff9c2d7b08 Jul 23 21:14:37.166856 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-249164809 Jul 23 21:14:37.166856 ncdv-master-1 devstack@n-api.service[131321]: X-Role: admin,reader,member Jul 23 21:14:37.166856 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: admin,reader,member Jul 23 21:14:37.168119 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e031fe2a65f54f1da9d17aff9c2d7b08"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e031fe2a65f54f1da9d17aff9c2d7b08"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e031fe2a65f54f1da9d17aff9c2d7b08", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e031fe2a65f54f1da9d17aff9c2d7b08"}]}] Jul 23 21:14:37.168119 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-HostsAdminNegativeTestJSON-249164809 Jul 23 21:14:37.168119 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: e031fe2a65f54f1da9d17aff9c2d7b08 Jul 23 21:14:37.168119 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-249164809 Jul 23 21:14:37.168119 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-HostsAdminNegativeTestJSON-249164809-project-admin Jul 23 21:14:37.168119 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:14:37.168119 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:14:37.168119 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 9cc2753d5f8c4a3481d35781da5b97c5 Jul 23 21:14:37.168119 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-HostsAdminNegativeTestJSON-249164809-project-admin Jul 23 21:14:37.168119 ncdv-master-1 devstack@n-api.service[131321]: method: Jul 23 21:14:37.168119 ncdv-master-1 devstack@n-api.service[131321]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 23 21:14:37.168119 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': 'nonexistent_hostname'} Jul 23 21:14:37.168119 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:14:37.168801 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:37.168801 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Jul 23 21:14:37.168801 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jul 23 21:14:37.168801 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 23 21:14:37.168801 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 23 21:14:37.168801 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 23 21:14:37.168801 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 23 21:14:37.168801 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 23 21:14:37.168801 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 23 21:14:37.168801 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 23 21:14:37.168801 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 23 21:14:37.168801 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 23 21:14:37.168801 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:37.168801 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:14:37.168801 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:37.168801 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:37.168801 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:14:37.168801 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:14:37.168801 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:14:37.169826 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:14:37.169826 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:14:37.169826 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:14:37.169826 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:14:37.169826 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:14:37.169826 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Jul 23 21:14:37.169826 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:14:37.169826 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 23 21:14:37.169826 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:37.169826 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:14:37.169826 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:37.169826 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:37.169826 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:14:37.169826 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:14:37.169826 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:14:37.169826 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:14:37.169826 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 23 21:14:37.169826 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:37.171597 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-b4396f52-d847-424f-991f-f2634c780631 tempest-HostsAdminNegativeTestJSON-249164809 tempest-HostsAdminNegativeTestJSON-249164809-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:14:37.172607 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-b4396f52-d847-424f-991f-f2634c780631 tempest-HostsAdminNegativeTestJSON-249164809 tempest-HostsAdminNegativeTestJSON-249164809-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.035911 Jul 23 21:14:37.173357 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 226/398] 10.222.0.17 () {58 vars in 1190 bytes} [Sat Jul 23 21:14:37 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 23 21:14:37.185937 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-26288d4b-8609-4678-aadf-3946fa872c82 tempest-HostsAdminNegativeTestJSON-200260207 tempest-HostsAdminNegativeTestJSON-200260207-project] Calling method '.version_select at 0x7f0b5471d310>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:37.188024 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:37.188024 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:14:37.190977 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-26288d4b-8609-4678-aadf-3946fa872c82 tempest-HostsAdminNegativeTestJSON-200260207 tempest-HostsAdminNegativeTestJSON-200260207-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '925c3413d59f4b0bbb329317ea1f8a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa284ec485b94303a8c7e3387e31dc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:37.194185 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-26288d4b-8609-4678-aadf-3946fa872c82 tempest-HostsAdminNegativeTestJSON-200260207 tempest-HostsAdminNegativeTestJSON-200260207-project] Request method failure captured: Jul 23 21:14:37.194185 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/os-hosts/ncdv-master-1/shutdown HTTP/1.1 Jul 23 21:14:37.194185 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:14:37.194185 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:14:37.194185 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:14:37.194185 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:14:37.194185 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:14:37.194185 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:14:37.194185 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:14:37.194185 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:14:37.194185 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GS4HsSWMPGHJqkNlyglFVFy6RXjWTc2E3Eiv9mHktzya9Xl7alRc6WZuHP3hUXtd_z6_oiI_ZmxrD1VkhHR5A2oZcHG5wotlrDU-YCNh9_xUhd3ptpIoAJnTdeh0k0PMm-JbpYssgfS7A5nnPHflx-pyHkJA-3kgawwpFEBElc8VwY Jul 23 21:14:37.194185 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:14:37.194185 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:14:37.194185 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:14:37.194185 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:14:37.194185 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:14:37.194185 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:14:37.194185 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: fa284ec485b94303a8c7e3387e31dc63 Jul 23 21:14:37.194185 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-200260207 Jul 23 21:14:37.194185 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:14:37.194185 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:14:37.195504 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fa284ec485b94303a8c7e3387e31dc63"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fa284ec485b94303a8c7e3387e31dc63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_fa284ec485b94303a8c7e3387e31dc63", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/fa284ec485b94303a8c7e3387e31dc63"}]}] Jul 23 21:14:37.195504 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-HostsAdminNegativeTestJSON-200260207 Jul 23 21:14:37.195504 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: fa284ec485b94303a8c7e3387e31dc63 Jul 23 21:14:37.195504 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-200260207 Jul 23 21:14:37.195504 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-HostsAdminNegativeTestJSON-200260207-project Jul 23 21:14:37.195504 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:14:37.195504 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:14:37.195504 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 925c3413d59f4b0bbb329317ea1f8a65 Jul 23 21:14:37.195504 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-HostsAdminNegativeTestJSON-200260207-project Jul 23 21:14:37.195504 ncdv-master-1 devstack@n-api.service[131321]: method: Jul 23 21:14:37.195504 ncdv-master-1 devstack@n-api.service[131321]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jul 23 21:14:37.195504 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': 'ncdv-master-1'} Jul 23 21:14:37.195504 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:14:37.196186 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:37.196186 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:14:37.196186 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:14:37.196186 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:14:37.196186 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:14:37.196186 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:14:37.196186 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:14:37.196186 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:14:37.196186 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:14:37.196186 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Jul 23 21:14:37.196186 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Jul 23 21:14:37.196186 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 23 21:14:37.196186 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 23 21:14:37.196186 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 23 21:14:37.196186 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 23 21:14:37.196186 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 23 21:14:37.196186 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 23 21:14:37.196186 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 23 21:14:37.196186 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise self.value Jul 23 21:14:37.197290 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 23 21:14:37.197290 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 23 21:14:37.197290 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 23 21:14:37.197290 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 23 21:14:37.197290 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 23 21:14:37.197290 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 23 21:14:37.197290 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jul 23 21:14:37.197290 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:37.197290 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:14:37.197290 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:37.197290 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:37.197290 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:14:37.197290 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:14:37.197290 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 23 21:14:37.197290 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 23 21:14:37.197290 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jul 23 21:14:37.197290 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:37.200823 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-26288d4b-8609-4678-aadf-3946fa872c82 tempest-HostsAdminNegativeTestJSON-200260207 tempest-HostsAdminNegativeTestJSON-200260207-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:14:37.202795 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-26288d4b-8609-4678-aadf-3946fa872c82 tempest-HostsAdminNegativeTestJSON-200260207 tempest-HostsAdminNegativeTestJSON-200260207-project] 10.222.0.17 "GET /compute/v2.1/os-hosts/ncdv-master-1/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.021025 Jul 23 21:14:37.206309 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 227/399] 10.222.0.17 () {58 vars in 1196 bytes} [Sat Jul 23 21:14:37 2022] GET /compute/v2.1/os-hosts/ncdv-master-1/shutdown => generated 113 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:14:37.217446 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-430e3d56-ad2c-46f3-a1b2-680e52fd6f4b tempest-HostsAdminNegativeTestJSON-249164809 tempest-HostsAdminNegativeTestJSON-249164809-project-admin] Calling method '.version_select at 0x7f0b5471d550>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:37.236673 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-430e3d56-ad2c-46f3-a1b2-680e52fd6f4b tempest-HostsAdminNegativeTestJSON-249164809 tempest-HostsAdminNegativeTestJSON-249164809-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 23 21:14:37.240594 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-430e3d56-ad2c-46f3-a1b2-680e52fd6f4b tempest-HostsAdminNegativeTestJSON-249164809 tempest-HostsAdminNegativeTestJSON-249164809-project-admin] Request method failure captured: Jul 23 21:14:37.240594 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Jul 23 21:14:37.240594 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:14:37.240594 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:14:37.240594 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:14:37.240594 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:14:37.240594 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:14:37.240594 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:14:37.240594 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:14:37.240594 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:14:37.240594 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GS6SBAHKjQvdyCXBrW9HqclhPdBNJv3KI9-MiIOYZbY9gllNO78vCl452F3UATg0mWp_8fKxtwGVbDmTLwiBJ6seXrt1R2guAajnGhG5M054b3kLFU8Uy-Yp-hXKZLDe8en5oO4ZR7qah_0tsED2PPniSOSlszyV1TQVlRYVaHmIWA Jul 23 21:14:37.240594 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:14:37.240594 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:14:37.240594 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:14:37.240594 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:14:37.240594 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:14:37.240594 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:14:37.240594 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: e031fe2a65f54f1da9d17aff9c2d7b08 Jul 23 21:14:37.240594 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-249164809 Jul 23 21:14:37.240594 ncdv-master-1 devstack@n-api.service[131321]: X-Role: admin,reader,member Jul 23 21:14:37.240594 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: admin,reader,member Jul 23 21:14:37.242206 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e031fe2a65f54f1da9d17aff9c2d7b08"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e031fe2a65f54f1da9d17aff9c2d7b08"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e031fe2a65f54f1da9d17aff9c2d7b08", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e031fe2a65f54f1da9d17aff9c2d7b08"}]}] Jul 23 21:14:37.242206 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-HostsAdminNegativeTestJSON-249164809 Jul 23 21:14:37.242206 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: e031fe2a65f54f1da9d17aff9c2d7b08 Jul 23 21:14:37.242206 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-249164809 Jul 23 21:14:37.242206 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-HostsAdminNegativeTestJSON-249164809-project-admin Jul 23 21:14:37.242206 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:14:37.242206 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:14:37.242206 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 9cc2753d5f8c4a3481d35781da5b97c5 Jul 23 21:14:37.242206 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-HostsAdminNegativeTestJSON-249164809-project-admin Jul 23 21:14:37.242206 ncdv-master-1 devstack@n-api.service[131321]: method: Jul 23 21:14:37.242206 ncdv-master-1 devstack@n-api.service[131321]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 23 21:14:37.242206 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': 'nonexistent_hostname'} Jul 23 21:14:37.242206 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:14:37.242906 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:37.242906 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jul 23 21:14:37.242906 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jul 23 21:14:37.242906 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 23 21:14:37.242906 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 23 21:14:37.242906 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 23 21:14:37.242906 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 23 21:14:37.242906 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 23 21:14:37.242906 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise self.value Jul 23 21:14:37.242906 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 23 21:14:37.242906 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 23 21:14:37.242906 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jul 23 21:14:37.242906 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 23 21:14:37.242906 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 23 21:14:37.242906 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 23 21:14:37.242906 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 23 21:14:37.242906 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 23 21:14:37.242906 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 23 21:14:37.242906 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 23 21:14:37.243921 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 23 21:14:37.243921 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 23 21:14:37.243921 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 23 21:14:37.243921 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:37.243921 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:14:37.243921 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:37.243921 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:37.243921 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:14:37.243921 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:14:37.243921 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:14:37.243921 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:14:37.243921 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:14:37.243921 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:14:37.243921 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:14:37.243921 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:14:37.243921 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Jul 23 21:14:37.243921 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Jul 23 21:14:37.243921 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jul 23 21:14:37.243921 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:14:37.245045 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 23 21:14:37.245045 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:37.245045 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:14:37.245045 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:37.245045 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:37.245045 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:14:37.245045 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:14:37.245045 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:14:37.245045 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:14:37.245045 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 23 21:14:37.245045 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:37.248249 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-430e3d56-ad2c-46f3-a1b2-680e52fd6f4b tempest-HostsAdminNegativeTestJSON-249164809 tempest-HostsAdminNegativeTestJSON-249164809-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:14:37.249558 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-430e3d56-ad2c-46f3-a1b2-680e52fd6f4b tempest-HostsAdminNegativeTestJSON-249164809 tempest-HostsAdminNegativeTestJSON-249164809-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.035620 Jul 23 21:14:37.251182 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 228/400] 10.222.0.17 () {58 vars in 1217 bytes} [Sat Jul 23 21:14:37 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 23 21:14:37.260628 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-798a7443-1ad6-46b4-9fc5-6844f91831b4 tempest-HostsAdminNegativeTestJSON-200260207 tempest-HostsAdminNegativeTestJSON-200260207-project] Calling method '.version_select at 0x7f0b5469e430>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:37.261753 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:37.261753 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:14:37.263547 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-798a7443-1ad6-46b4-9fc5-6844f91831b4 tempest-HostsAdminNegativeTestJSON-200260207 tempest-HostsAdminNegativeTestJSON-200260207-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '925c3413d59f4b0bbb329317ea1f8a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa284ec485b94303a8c7e3387e31dc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:37.265410 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-798a7443-1ad6-46b4-9fc5-6844f91831b4 tempest-HostsAdminNegativeTestJSON-200260207 tempest-HostsAdminNegativeTestJSON-200260207-project] Request method failure captured: Jul 23 21:14:37.265410 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/os-hosts/ncdv-master-1/startup HTTP/1.1 Jul 23 21:14:37.265410 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:14:37.265410 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:14:37.265410 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:14:37.265410 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:14:37.265410 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:14:37.265410 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:14:37.265410 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:14:37.265410 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:14:37.265410 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GS4HsSWMPGHJqkNlyglFVFy6RXjWTc2E3Eiv9mHktzya9Xl7alRc6WZuHP3hUXtd_z6_oiI_ZmxrD1VkhHR5A2oZcHG5wotlrDU-YCNh9_xUhd3ptpIoAJnTdeh0k0PMm-JbpYssgfS7A5nnPHflx-pyHkJA-3kgawwpFEBElc8VwY Jul 23 21:14:37.265410 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:14:37.265410 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:14:37.265410 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:14:37.265410 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:14:37.265410 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:14:37.265410 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:14:37.265410 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: fa284ec485b94303a8c7e3387e31dc63 Jul 23 21:14:37.265410 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-200260207 Jul 23 21:14:37.265410 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:14:37.265410 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:14:37.266680 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fa284ec485b94303a8c7e3387e31dc63"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fa284ec485b94303a8c7e3387e31dc63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_fa284ec485b94303a8c7e3387e31dc63", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/fa284ec485b94303a8c7e3387e31dc63"}]}] Jul 23 21:14:37.266680 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-HostsAdminNegativeTestJSON-200260207 Jul 23 21:14:37.266680 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: fa284ec485b94303a8c7e3387e31dc63 Jul 23 21:14:37.266680 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-200260207 Jul 23 21:14:37.266680 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-HostsAdminNegativeTestJSON-200260207-project Jul 23 21:14:37.266680 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:14:37.266680 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:14:37.266680 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 925c3413d59f4b0bbb329317ea1f8a65 Jul 23 21:14:37.266680 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-HostsAdminNegativeTestJSON-200260207-project Jul 23 21:14:37.266680 ncdv-master-1 devstack@n-api.service[131321]: method: Jul 23 21:14:37.266680 ncdv-master-1 devstack@n-api.service[131321]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jul 23 21:14:37.266680 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': 'ncdv-master-1'} Jul 23 21:14:37.266680 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:14:37.267625 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:37.267625 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:14:37.267625 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:14:37.267625 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:14:37.267625 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:14:37.267625 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:14:37.267625 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:14:37.267625 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:14:37.267625 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:14:37.267625 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Jul 23 21:14:37.267625 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Jul 23 21:14:37.267625 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 23 21:14:37.267625 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 23 21:14:37.267625 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 23 21:14:37.267625 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 23 21:14:37.267625 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 23 21:14:37.267625 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 23 21:14:37.267625 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 23 21:14:37.267625 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise self.value Jul 23 21:14:37.268853 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 23 21:14:37.268853 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 23 21:14:37.268853 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 23 21:14:37.268853 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 23 21:14:37.268853 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 23 21:14:37.268853 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 23 21:14:37.268853 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jul 23 21:14:37.268853 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:37.268853 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:14:37.268853 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:37.268853 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:37.268853 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:14:37.268853 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:14:37.268853 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 23 21:14:37.268853 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 23 21:14:37.268853 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jul 23 21:14:37.268853 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:37.271790 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-798a7443-1ad6-46b4-9fc5-6844f91831b4 tempest-HostsAdminNegativeTestJSON-200260207 tempest-HostsAdminNegativeTestJSON-200260207-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:14:37.272883 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-798a7443-1ad6-46b4-9fc5-6844f91831b4 tempest-HostsAdminNegativeTestJSON-200260207 tempest-HostsAdminNegativeTestJSON-200260207-project] 10.222.0.17 "GET /compute/v2.1/os-hosts/ncdv-master-1/startup" status: 403 len: 110 microversion: 2.1 time: 0.016721 Jul 23 21:14:37.273989 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 229/401] 10.222.0.17 () {58 vars in 1193 bytes} [Sat Jul 23 21:14:37 2022] GET /compute/v2.1/os-hosts/ncdv-master-1/startup => generated 110 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jul 23 21:14:37.283746 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-15d50608-cdd3-469f-9bee-4416bccdf48e tempest-HostsAdminNegativeTestJSON-249164809 tempest-HostsAdminNegativeTestJSON-249164809-project-admin] Calling method '.version_select at 0x7f0b54699820>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:37.295396 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-15d50608-cdd3-469f-9bee-4416bccdf48e tempest-HostsAdminNegativeTestJSON-249164809 tempest-HostsAdminNegativeTestJSON-249164809-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 23 21:14:37.297733 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-15d50608-cdd3-469f-9bee-4416bccdf48e tempest-HostsAdminNegativeTestJSON-249164809 tempest-HostsAdminNegativeTestJSON-249164809-project-admin] Request method failure captured: Jul 23 21:14:37.297733 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Jul 23 21:14:37.297733 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:14:37.297733 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:14:37.297733 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:14:37.297733 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:14:37.297733 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:14:37.297733 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:14:37.297733 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:14:37.297733 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:14:37.297733 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GS6SBAHKjQvdyCXBrW9HqclhPdBNJv3KI9-MiIOYZbY9gllNO78vCl452F3UATg0mWp_8fKxtwGVbDmTLwiBJ6seXrt1R2guAajnGhG5M054b3kLFU8Uy-Yp-hXKZLDe8en5oO4ZR7qah_0tsED2PPniSOSlszyV1TQVlRYVaHmIWA Jul 23 21:14:37.297733 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:14:37.297733 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:14:37.297733 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:14:37.297733 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:14:37.297733 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:14:37.297733 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:14:37.297733 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: e031fe2a65f54f1da9d17aff9c2d7b08 Jul 23 21:14:37.297733 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-249164809 Jul 23 21:14:37.297733 ncdv-master-1 devstack@n-api.service[131321]: X-Role: admin,reader,member Jul 23 21:14:37.297733 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: admin,reader,member Jul 23 21:14:37.299206 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e031fe2a65f54f1da9d17aff9c2d7b08"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e031fe2a65f54f1da9d17aff9c2d7b08"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e031fe2a65f54f1da9d17aff9c2d7b08", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e031fe2a65f54f1da9d17aff9c2d7b08"}]}] Jul 23 21:14:37.299206 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-HostsAdminNegativeTestJSON-249164809 Jul 23 21:14:37.299206 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: e031fe2a65f54f1da9d17aff9c2d7b08 Jul 23 21:14:37.299206 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-249164809 Jul 23 21:14:37.299206 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-HostsAdminNegativeTestJSON-249164809-project-admin Jul 23 21:14:37.299206 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:14:37.299206 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:14:37.299206 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 9cc2753d5f8c4a3481d35781da5b97c5 Jul 23 21:14:37.299206 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-HostsAdminNegativeTestJSON-249164809-project-admin Jul 23 21:14:37.299206 ncdv-master-1 devstack@n-api.service[131321]: method: Jul 23 21:14:37.299206 ncdv-master-1 devstack@n-api.service[131321]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 23 21:14:37.299206 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': 'nonexistent_hostname'} Jul 23 21:14:37.299206 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:14:37.299932 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:37.299932 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jul 23 21:14:37.299932 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jul 23 21:14:37.299932 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 23 21:14:37.299932 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 23 21:14:37.299932 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 23 21:14:37.299932 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 23 21:14:37.299932 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 23 21:14:37.299932 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise self.value Jul 23 21:14:37.299932 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 23 21:14:37.299932 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 23 21:14:37.299932 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jul 23 21:14:37.299932 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 23 21:14:37.299932 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 23 21:14:37.299932 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 23 21:14:37.299932 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 23 21:14:37.299932 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 23 21:14:37.299932 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 23 21:14:37.299932 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 23 21:14:37.300973 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 23 21:14:37.300973 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 23 21:14:37.300973 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 23 21:14:37.300973 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:37.300973 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:14:37.300973 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:37.300973 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:37.300973 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:14:37.300973 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:14:37.300973 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:14:37.300973 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:14:37.300973 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:14:37.300973 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:14:37.300973 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:14:37.300973 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:14:37.300973 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Jul 23 21:14:37.300973 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Jul 23 21:14:37.300973 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jul 23 21:14:37.300973 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:14:37.302025 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 23 21:14:37.302025 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:37.302025 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:14:37.302025 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:37.302025 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:37.302025 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:14:37.302025 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:14:37.302025 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:14:37.302025 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:14:37.302025 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 23 21:14:37.302025 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:37.304203 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-15d50608-cdd3-469f-9bee-4416bccdf48e tempest-HostsAdminNegativeTestJSON-249164809 tempest-HostsAdminNegativeTestJSON-249164809-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:14:37.305418 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-15d50608-cdd3-469f-9bee-4416bccdf48e tempest-HostsAdminNegativeTestJSON-249164809 tempest-HostsAdminNegativeTestJSON-249164809-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.025597 Jul 23 21:14:37.307026 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 230/402] 10.222.0.17 () {58 vars in 1214 bytes} [Sat Jul 23 21:14:37 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 23 21:14:37.317364 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c1bc6205-ecc0-467c-96e9-22d08758c195 tempest-HostsAdminNegativeTestJSON-249164809 tempest-HostsAdminNegativeTestJSON-249164809-project-admin] Action: 'update', calling method: .version_select at 0x7f0b5469e940>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:14:37.321341 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c1bc6205-ecc0-467c-96e9-22d08758c195 tempest-HostsAdminNegativeTestJSON-249164809 tempest-HostsAdminNegativeTestJSON-249164809-project-admin] Request method failure captured: Jul 23 21:14:37.321341 ncdv-master-1 devstack@n-api.service[131321]: request: PUT /compute/v2.1/os-hosts/ncdv-master-1 HTTP/1.1 Jul 23 21:14:37.321341 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:14:37.321341 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:14:37.321341 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:14:37.321341 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 51 Jul 23 21:14:37.321341 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:14:37.321341 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:14:37.321341 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:14:37.321341 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:14:37.321341 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GS6SBAHKjQvdyCXBrW9HqclhPdBNJv3KI9-MiIOYZbY9gllNO78vCl452F3UATg0mWp_8fKxtwGVbDmTLwiBJ6seXrt1R2guAajnGhG5M054b3kLFU8Uy-Yp-hXKZLDe8en5oO4ZR7qah_0tsED2PPniSOSlszyV1TQVlRYVaHmIWA Jul 23 21:14:37.321341 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:14:37.321341 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:14:37.321341 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:14:37.321341 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:14:37.321341 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:14:37.321341 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:14:37.321341 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: e031fe2a65f54f1da9d17aff9c2d7b08 Jul 23 21:14:37.321341 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-249164809 Jul 23 21:14:37.321341 ncdv-master-1 devstack@n-api.service[131321]: X-Role: admin,reader,member Jul 23 21:14:37.321341 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: admin,reader,member Jul 23 21:14:37.322972 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e031fe2a65f54f1da9d17aff9c2d7b08"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e031fe2a65f54f1da9d17aff9c2d7b08"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e031fe2a65f54f1da9d17aff9c2d7b08", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e031fe2a65f54f1da9d17aff9c2d7b08"}]}] Jul 23 21:14:37.322972 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-HostsAdminNegativeTestJSON-249164809 Jul 23 21:14:37.322972 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: e031fe2a65f54f1da9d17aff9c2d7b08 Jul 23 21:14:37.322972 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-249164809 Jul 23 21:14:37.322972 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-HostsAdminNegativeTestJSON-249164809-project-admin Jul 23 21:14:37.322972 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:14:37.322972 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:14:37.322972 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 9cc2753d5f8c4a3481d35781da5b97c5 Jul 23 21:14:37.322972 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-HostsAdminNegativeTestJSON-249164809-project-admin Jul 23 21:14:37.322972 ncdv-master-1 devstack@n-api.service[131321]: Jul 23 21:14:37.322972 ncdv-master-1 devstack@n-api.service[131321]: {"status": "enable", "maintenance_mode": "invalid"} Jul 23 21:14:37.322972 ncdv-master-1 devstack@n-api.service[131321]: method: Jul 23 21:14:37.322972 ncdv-master-1 devstack@n-api.service[131321]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 23 21:14:37.323669 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': 'ncdv-master-1', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Jul 23 21:14:37.323669 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:14:37.323669 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:37.323669 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 23 21:14:37.323669 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 23 21:14:37.323669 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 23 21:14:37.323669 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise error Jul 23 21:14:37.323669 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 23 21:14:37.323669 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:37.323669 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Jul 23 21:14:37.323669 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jul 23 21:14:37.323669 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi 'disable', Jul 23 21:14:37.323669 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi 'Enable', Jul 23 21:14:37.323669 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi 'Disable', Jul 23 21:14:37.323669 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi 'ENABLE', Jul 23 21:14:37.323669 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jul 23 21:14:37.323669 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jul 23 21:14:37.323669 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:37.323669 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi On instance: Jul 23 21:14:37.323669 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi 'invalid' Jul 23 21:14:37.323669 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:37.323669 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:14:37.323669 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:37.323669 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:37.323669 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:14:37.324985 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:14:37.324985 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:14:37.324985 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:14:37.324985 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:14:37.324985 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:14:37.324985 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:14:37.324985 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:14:37.324985 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 23 21:14:37.324985 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 23 21:14:37.324985 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 23 21:14:37.324985 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 23 21:14:37.324985 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 23 21:14:37.324985 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 23 21:14:37.324985 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 23 21:14:37.324985 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:37.324985 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:14:37.324985 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:37.324985 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:37.324985 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:14:37.326840 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:14:37.326840 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 23 21:14:37.326840 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 23 21:14:37.326840 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 23 21:14:37.326840 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:37.326840 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c1bc6205-ecc0-467c-96e9-22d08758c195 tempest-HostsAdminNegativeTestJSON-249164809 tempest-HostsAdminNegativeTestJSON-249164809-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:14:37.326840 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-c1bc6205-ecc0-467c-96e9-22d08758c195 tempest-HostsAdminNegativeTestJSON-249164809 tempest-HostsAdminNegativeTestJSON-249164809-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 199 microversion: 2.1 time: 0.010783 Jul 23 21:14:37.326840 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 231/403] 10.222.0.17 () {60 vars in 1189 bytes} [Sat Jul 23 21:14:37 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 199 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 23 21:14:37.335227 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-1fdd32ca-8ba4-4a3c-901b-3d505a3ce35a tempest-HostsAdminNegativeTestJSON-249164809 tempest-HostsAdminNegativeTestJSON-249164809-project-admin] Action: 'update', calling method: .version_select at 0x7f0b5462b3a0>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:14:37.338201 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-1fdd32ca-8ba4-4a3c-901b-3d505a3ce35a tempest-HostsAdminNegativeTestJSON-249164809 tempest-HostsAdminNegativeTestJSON-249164809-project-admin] Request method failure captured: Jul 23 21:14:37.338201 ncdv-master-1 devstack@n-api.service[131321]: request: PUT /compute/v2.1/os-hosts/ncdv-master-1 HTTP/1.1 Jul 23 21:14:37.338201 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:14:37.338201 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:14:37.338201 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:14:37.338201 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 51 Jul 23 21:14:37.338201 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:14:37.338201 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:14:37.338201 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:14:37.338201 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:14:37.338201 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GS6SBAHKjQvdyCXBrW9HqclhPdBNJv3KI9-MiIOYZbY9gllNO78vCl452F3UATg0mWp_8fKxtwGVbDmTLwiBJ6seXrt1R2guAajnGhG5M054b3kLFU8Uy-Yp-hXKZLDe8en5oO4ZR7qah_0tsED2PPniSOSlszyV1TQVlRYVaHmIWA Jul 23 21:14:37.338201 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:14:37.338201 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:14:37.338201 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:14:37.338201 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:14:37.338201 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:14:37.338201 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:14:37.338201 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: e031fe2a65f54f1da9d17aff9c2d7b08 Jul 23 21:14:37.338201 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-249164809 Jul 23 21:14:37.338201 ncdv-master-1 devstack@n-api.service[131321]: X-Role: admin,reader,member Jul 23 21:14:37.338201 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: admin,reader,member Jul 23 21:14:37.339555 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e031fe2a65f54f1da9d17aff9c2d7b08"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e031fe2a65f54f1da9d17aff9c2d7b08"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e031fe2a65f54f1da9d17aff9c2d7b08", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e031fe2a65f54f1da9d17aff9c2d7b08"}]}] Jul 23 21:14:37.339555 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-HostsAdminNegativeTestJSON-249164809 Jul 23 21:14:37.339555 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: e031fe2a65f54f1da9d17aff9c2d7b08 Jul 23 21:14:37.339555 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-249164809 Jul 23 21:14:37.339555 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-HostsAdminNegativeTestJSON-249164809-project-admin Jul 23 21:14:37.339555 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:14:37.339555 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:14:37.339555 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 9cc2753d5f8c4a3481d35781da5b97c5 Jul 23 21:14:37.339555 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-HostsAdminNegativeTestJSON-249164809-project-admin Jul 23 21:14:37.339555 ncdv-master-1 devstack@n-api.service[131321]: Jul 23 21:14:37.339555 ncdv-master-1 devstack@n-api.service[131321]: {"status": "invalid", "maintenance_mode": "enable"} Jul 23 21:14:37.339555 ncdv-master-1 devstack@n-api.service[131321]: method: Jul 23 21:14:37.339555 ncdv-master-1 devstack@n-api.service[131321]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 23 21:14:37.340231 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': 'ncdv-master-1', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Jul 23 21:14:37.340231 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:14:37.340231 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:37.340231 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 23 21:14:37.340231 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 23 21:14:37.340231 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 23 21:14:37.340231 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise error Jul 23 21:14:37.340231 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 23 21:14:37.340231 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:37.340231 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Jul 23 21:14:37.340231 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jul 23 21:14:37.340231 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi 'disable', Jul 23 21:14:37.340231 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi 'Enable', Jul 23 21:14:37.340231 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi 'Disable', Jul 23 21:14:37.340231 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi 'ENABLE', Jul 23 21:14:37.340231 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jul 23 21:14:37.340231 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jul 23 21:14:37.340231 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:37.340231 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi On instance: Jul 23 21:14:37.340231 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi 'invalid' Jul 23 21:14:37.340231 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:37.340231 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:14:37.340231 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:37.340231 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:37.340231 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:14:37.341484 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:14:37.341484 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:14:37.341484 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:14:37.341484 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:14:37.341484 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:14:37.341484 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:14:37.341484 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:14:37.341484 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 23 21:14:37.341484 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 23 21:14:37.341484 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 23 21:14:37.341484 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 23 21:14:37.341484 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 23 21:14:37.341484 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 23 21:14:37.341484 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 23 21:14:37.341484 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:37.341484 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:14:37.341484 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:37.341484 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:37.341484 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:14:37.343098 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:14:37.343098 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 23 21:14:37.343098 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 23 21:14:37.343098 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 23 21:14:37.343098 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:37.343098 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-1fdd32ca-8ba4-4a3c-901b-3d505a3ce35a tempest-HostsAdminNegativeTestJSON-249164809 tempest-HostsAdminNegativeTestJSON-249164809-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:14:37.343098 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-1fdd32ca-8ba4-4a3c-901b-3d505a3ce35a tempest-HostsAdminNegativeTestJSON-249164809 tempest-HostsAdminNegativeTestJSON-249164809-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 189 microversion: 2.1 time: 0.008726 Jul 23 21:14:37.347442 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 232/404] 10.222.0.17 () {60 vars in 1189 bytes} [Sat Jul 23 21:14:37 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 189 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 23 21:14:37.354992 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-129346ec-3220-45d3-9ad4-ca3343ca8368 tempest-HostsAdminNegativeTestJSON-200260207 tempest-HostsAdminNegativeTestJSON-200260207-project] Action: 'update', calling method: .version_select at 0x7f0b5474cf70>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:14:37.357651 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:37.357651 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:14:37.359210 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-129346ec-3220-45d3-9ad4-ca3343ca8368 tempest-HostsAdminNegativeTestJSON-200260207 tempest-HostsAdminNegativeTestJSON-200260207-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '925c3413d59f4b0bbb329317ea1f8a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa284ec485b94303a8c7e3387e31dc63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:37.362301 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-129346ec-3220-45d3-9ad4-ca3343ca8368 tempest-HostsAdminNegativeTestJSON-200260207 tempest-HostsAdminNegativeTestJSON-200260207-project] Request method failure captured: Jul 23 21:14:37.362301 ncdv-master-1 devstack@n-api.service[131321]: request: PUT /compute/v2.1/os-hosts/ncdv-master-1 HTTP/1.1 Jul 23 21:14:37.362301 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:14:37.362301 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:14:37.362301 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:14:37.362301 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 50 Jul 23 21:14:37.362301 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:14:37.362301 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:14:37.362301 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:14:37.362301 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:14:37.362301 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GS4HsSWMPGHJqkNlyglFVFy6RXjWTc2E3Eiv9mHktzya9Xl7alRc6WZuHP3hUXtd_z6_oiI_ZmxrD1VkhHR5A2oZcHG5wotlrDU-YCNh9_xUhd3ptpIoAJnTdeh0k0PMm-JbpYssgfS7A5nnPHflx-pyHkJA-3kgawwpFEBElc8VwY Jul 23 21:14:37.362301 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:14:37.362301 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:14:37.362301 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:14:37.362301 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:14:37.362301 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:14:37.362301 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:14:37.362301 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: fa284ec485b94303a8c7e3387e31dc63 Jul 23 21:14:37.362301 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-200260207 Jul 23 21:14:37.362301 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:14:37.362301 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:14:37.363548 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fa284ec485b94303a8c7e3387e31dc63"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fa284ec485b94303a8c7e3387e31dc63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_fa284ec485b94303a8c7e3387e31dc63", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/fa284ec485b94303a8c7e3387e31dc63"}]}] Jul 23 21:14:37.363548 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-HostsAdminNegativeTestJSON-200260207 Jul 23 21:14:37.363548 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: fa284ec485b94303a8c7e3387e31dc63 Jul 23 21:14:37.363548 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-200260207 Jul 23 21:14:37.363548 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-HostsAdminNegativeTestJSON-200260207-project Jul 23 21:14:37.363548 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:14:37.363548 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:14:37.363548 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 925c3413d59f4b0bbb329317ea1f8a65 Jul 23 21:14:37.363548 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-HostsAdminNegativeTestJSON-200260207-project Jul 23 21:14:37.363548 ncdv-master-1 devstack@n-api.service[131321]: Jul 23 21:14:37.363548 ncdv-master-1 devstack@n-api.service[131321]: {"status": "enable", "maintenance_mode": "enable"} Jul 23 21:14:37.363548 ncdv-master-1 devstack@n-api.service[131321]: method: Jul 23 21:14:37.363548 ncdv-master-1 devstack@n-api.service[131321]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jul 23 21:14:37.363548 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': 'ncdv-master-1', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Jul 23 21:14:37.364608 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:14:37.364608 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:37.364608 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:14:37.364608 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:14:37.364608 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:14:37.364608 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:14:37.364608 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:14:37.364608 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:14:37.364608 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:14:37.364608 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:14:37.364608 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:14:37.364608 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:14:37.364608 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Jul 23 21:14:37.364608 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Jul 23 21:14:37.364608 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 23 21:14:37.364608 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 23 21:14:37.364608 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 23 21:14:37.364608 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 23 21:14:37.364608 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 23 21:14:37.364608 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 23 21:14:37.365658 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 23 21:14:37.365658 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise self.value Jul 23 21:14:37.365658 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 23 21:14:37.365658 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 23 21:14:37.365658 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 23 21:14:37.365658 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 23 21:14:37.365658 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 23 21:14:37.365658 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 23 21:14:37.365658 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jul 23 21:14:37.365658 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:37.365658 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:14:37.365658 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:37.365658 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:37.365658 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:14:37.365658 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:14:37.365658 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 23 21:14:37.365658 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 23 21:14:37.365658 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jul 23 21:14:37.365658 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:37.368955 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-129346ec-3220-45d3-9ad4-ca3343ca8368 tempest-HostsAdminNegativeTestJSON-200260207 tempest-HostsAdminNegativeTestJSON-200260207-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:14:37.369996 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-129346ec-3220-45d3-9ad4-ca3343ca8368 tempest-HostsAdminNegativeTestJSON-200260207 tempest-HostsAdminNegativeTestJSON-200260207-project] 10.222.0.17 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 403 len: 111 microversion: 2.1 time: 0.020065 Jul 23 21:14:37.377510 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 233/405] 10.222.0.17 () {60 vars in 1189 bytes} [Sat Jul 23 21:14:37 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 111 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:14:37.384719 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-b4dc8626-fa7b-4a92-b180-c270f814d6db tempest-HostsAdminNegativeTestJSON-249164809 tempest-HostsAdminNegativeTestJSON-249164809-project-admin] Action: 'update', calling method: .version_select at 0x7f0b548adee0>, body: {"status": null, "maintenance_mode": null} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:14:37.388264 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-b4dc8626-fa7b-4a92-b180-c270f814d6db tempest-HostsAdminNegativeTestJSON-249164809 tempest-HostsAdminNegativeTestJSON-249164809-project-admin] Request method failure captured: Jul 23 21:14:37.388264 ncdv-master-1 devstack@n-api.service[131321]: request: PUT /compute/v2.1/os-hosts/ncdv-master-1 HTTP/1.1 Jul 23 21:14:37.388264 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:14:37.388264 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:14:37.388264 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:14:37.388264 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 42 Jul 23 21:14:37.388264 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:14:37.388264 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:14:37.388264 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:14:37.388264 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:14:37.388264 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GS6SBAHKjQvdyCXBrW9HqclhPdBNJv3KI9-MiIOYZbY9gllNO78vCl452F3UATg0mWp_8fKxtwGVbDmTLwiBJ6seXrt1R2guAajnGhG5M054b3kLFU8Uy-Yp-hXKZLDe8en5oO4ZR7qah_0tsED2PPniSOSlszyV1TQVlRYVaHmIWA Jul 23 21:14:37.388264 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:14:37.388264 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:14:37.388264 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:14:37.388264 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:14:37.388264 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:14:37.388264 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:14:37.388264 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: e031fe2a65f54f1da9d17aff9c2d7b08 Jul 23 21:14:37.388264 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-249164809 Jul 23 21:14:37.388264 ncdv-master-1 devstack@n-api.service[131321]: X-Role: admin,reader,member Jul 23 21:14:37.388264 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: admin,reader,member Jul 23 21:14:37.389633 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e031fe2a65f54f1da9d17aff9c2d7b08"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e031fe2a65f54f1da9d17aff9c2d7b08"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e031fe2a65f54f1da9d17aff9c2d7b08", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e031fe2a65f54f1da9d17aff9c2d7b08"}]}] Jul 23 21:14:37.389633 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-HostsAdminNegativeTestJSON-249164809 Jul 23 21:14:37.389633 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: e031fe2a65f54f1da9d17aff9c2d7b08 Jul 23 21:14:37.389633 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-249164809 Jul 23 21:14:37.389633 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-HostsAdminNegativeTestJSON-249164809-project-admin Jul 23 21:14:37.389633 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:14:37.389633 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:14:37.389633 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 9cc2753d5f8c4a3481d35781da5b97c5 Jul 23 21:14:37.389633 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-HostsAdminNegativeTestJSON-249164809-project-admin Jul 23 21:14:37.389633 ncdv-master-1 devstack@n-api.service[131321]: Jul 23 21:14:37.389633 ncdv-master-1 devstack@n-api.service[131321]: {"status": null, "maintenance_mode": null} Jul 23 21:14:37.389633 ncdv-master-1 devstack@n-api.service[131321]: method: Jul 23 21:14:37.389633 ncdv-master-1 devstack@n-api.service[131321]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jul 23 21:14:37.389633 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': 'ncdv-master-1', 'body': {'status': None, 'maintenance_mode': None}} Jul 23 21:14:37.390422 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:14:37.390422 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:37.390422 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 23 21:14:37.390422 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 23 21:14:37.390422 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 23 21:14:37.390422 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise error Jul 23 21:14:37.390422 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Jul 23 21:14:37.390422 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:37.390422 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Jul 23 21:14:37.390422 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jul 23 21:14:37.390422 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi 'disable', Jul 23 21:14:37.390422 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi 'Enable', Jul 23 21:14:37.390422 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi 'Disable', Jul 23 21:14:37.390422 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi 'ENABLE', Jul 23 21:14:37.390422 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jul 23 21:14:37.390422 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jul 23 21:14:37.390422 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:37.390422 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi On instance: Jul 23 21:14:37.390422 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi None Jul 23 21:14:37.390422 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:37.390422 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:14:37.390422 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:37.390422 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:37.390422 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:14:37.390422 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:14:37.391759 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:14:37.391759 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:14:37.391759 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:14:37.391759 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:14:37.391759 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:14:37.391759 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:14:37.391759 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 23 21:14:37.391759 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 23 21:14:37.391759 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 23 21:14:37.391759 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 23 21:14:37.391759 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 23 21:14:37.391759 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 23 21:14:37.391759 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jul 23 21:14:37.391759 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:37.391759 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:14:37.391759 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:37.391759 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:37.391759 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:14:37.391759 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:14:37.392799 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 23 21:14:37.392799 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 23 21:14:37.392799 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jul 23 21:14:37.392799 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:37.394511 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-b4dc8626-fa7b-4a92-b180-c270f814d6db tempest-HostsAdminNegativeTestJSON-249164809 tempest-HostsAdminNegativeTestJSON-249164809-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:14:37.395525 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-b4dc8626-fa7b-4a92-b180-c270f814d6db tempest-HostsAdminNegativeTestJSON-249164809 tempest-HostsAdminNegativeTestJSON-249164809-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 127 microversion: 2.1 time: 0.015582 Jul 23 21:14:37.401116 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 234/406] 10.222.0.17 () {60 vars in 1189 bytes} [Sat Jul 23 21:14:37 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 127 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 23 21:14:37.407868 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-1801a80b-988c-4007-8bb1-2d7c6759325b tempest-HostsAdminNegativeTestJSON-249164809 tempest-HostsAdminNegativeTestJSON-249164809-project-admin] Action: 'update', calling method: .version_select at 0x7f0b5462baf0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:14:37.411515 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.hosts [None req-1801a80b-988c-4007-8bb1-2d7c6759325b tempest-HostsAdminNegativeTestJSON-249164809 tempest-HostsAdminNegativeTestJSON-249164809-project-admin] Enabling host nonexistent_hostname. Jul 23 21:14:37.421563 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-1801a80b-988c-4007-8bb1-2d7c6759325b tempest-HostsAdminNegativeTestJSON-249164809 tempest-HostsAdminNegativeTestJSON-249164809-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 23 21:14:37.424030 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-1801a80b-988c-4007-8bb1-2d7c6759325b tempest-HostsAdminNegativeTestJSON-249164809 tempest-HostsAdminNegativeTestJSON-249164809-project-admin] Request method failure captured: Jul 23 21:14:37.424030 ncdv-master-1 devstack@n-api.service[131321]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Jul 23 21:14:37.424030 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:14:37.424030 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:14:37.424030 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:14:37.424030 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 50 Jul 23 21:14:37.424030 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:14:37.424030 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:14:37.424030 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:14:37.424030 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:14:37.424030 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GS6SBAHKjQvdyCXBrW9HqclhPdBNJv3KI9-MiIOYZbY9gllNO78vCl452F3UATg0mWp_8fKxtwGVbDmTLwiBJ6seXrt1R2guAajnGhG5M054b3kLFU8Uy-Yp-hXKZLDe8en5oO4ZR7qah_0tsED2PPniSOSlszyV1TQVlRYVaHmIWA Jul 23 21:14:37.424030 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:14:37.424030 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:14:37.424030 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:14:37.424030 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:14:37.424030 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:14:37.424030 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:14:37.424030 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: e031fe2a65f54f1da9d17aff9c2d7b08 Jul 23 21:14:37.424030 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-249164809 Jul 23 21:14:37.424030 ncdv-master-1 devstack@n-api.service[131321]: X-Role: admin,reader,member Jul 23 21:14:37.424030 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: admin,reader,member Jul 23 21:14:37.425675 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e031fe2a65f54f1da9d17aff9c2d7b08"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e031fe2a65f54f1da9d17aff9c2d7b08"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e031fe2a65f54f1da9d17aff9c2d7b08", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e031fe2a65f54f1da9d17aff9c2d7b08"}]}] Jul 23 21:14:37.425675 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-HostsAdminNegativeTestJSON-249164809 Jul 23 21:14:37.425675 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: e031fe2a65f54f1da9d17aff9c2d7b08 Jul 23 21:14:37.425675 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-249164809 Jul 23 21:14:37.425675 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-HostsAdminNegativeTestJSON-249164809-project-admin Jul 23 21:14:37.425675 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:14:37.425675 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:14:37.425675 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 9cc2753d5f8c4a3481d35781da5b97c5 Jul 23 21:14:37.425675 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-HostsAdminNegativeTestJSON-249164809-project-admin Jul 23 21:14:37.425675 ncdv-master-1 devstack@n-api.service[131321]: Jul 23 21:14:37.425675 ncdv-master-1 devstack@n-api.service[131321]: {"status": "enable", "maintenance_mode": "enable"} Jul 23 21:14:37.425675 ncdv-master-1 devstack@n-api.service[131321]: method: Jul 23 21:14:37.425675 ncdv-master-1 devstack@n-api.service[131321]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 23 21:14:37.425675 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Jul 23 21:14:37.426615 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:14:37.426615 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:37.426615 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Jul 23 21:14:37.426615 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Jul 23 21:14:37.426615 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 23 21:14:37.426615 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 23 21:14:37.426615 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 23 21:14:37.426615 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 23 21:14:37.426615 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 23 21:14:37.426615 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise self.value Jul 23 21:14:37.426615 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 23 21:14:37.426615 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 23 21:14:37.426615 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jul 23 21:14:37.426615 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 23 21:14:37.426615 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 23 21:14:37.426615 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 23 21:14:37.426615 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 23 21:14:37.426615 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 23 21:14:37.427616 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 23 21:14:37.427616 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 23 21:14:37.427616 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 23 21:14:37.427616 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 23 21:14:37.427616 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 23 21:14:37.427616 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:37.427616 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:14:37.427616 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:37.427616 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:37.427616 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:14:37.427616 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:14:37.427616 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:14:37.427616 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:14:37.427616 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:14:37.427616 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:14:37.427616 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:14:37.427616 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:14:37.427616 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:14:37.427616 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:14:37.427616 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Jul 23 21:14:37.428707 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Jul 23 21:14:37.428707 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Jul 23 21:14:37.428707 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:14:37.428707 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 23 21:14:37.428707 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:37.428707 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:14:37.428707 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:37.428707 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:14:37.428707 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:14:37.428707 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:14:37.428707 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:14:37.428707 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:14:37.428707 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 23 21:14:37.428707 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:14:37.428707 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-1801a80b-988c-4007-8bb1-2d7c6759325b tempest-HostsAdminNegativeTestJSON-249164809 tempest-HostsAdminNegativeTestJSON-249164809-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:14:37.431465 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-1801a80b-988c-4007-8bb1-2d7c6759325b tempest-HostsAdminNegativeTestJSON-249164809 tempest-HostsAdminNegativeTestJSON-249164809-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.026816 Jul 23 21:14:37.436778 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 235/407] 10.222.0.17 () {60 vars in 1210 bytes} [Sat Jul 23 21:14:37 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 23 21:14:37.991441 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-08d1d48d-4649-4364-bbdf-5394f1a9a600 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:37.992360 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-08d1d48d-4649-4364-bbdf-5394f1a9a600 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 769ee4e5-e4df-4d4e-9f4c-6372c60d9e01] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:14:38.013642 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-08d1d48d-4649-4364-bbdf-5394f1a9a600 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:38.014571 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-08d1d48d-4649-4364-bbdf-5394f1a9a600 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:38.019624 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-08d1d48d-4649-4364-bbdf-5394f1a9a600 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:38.020872 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-08d1d48d-4649-4364-bbdf-5394f1a9a600 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:38.383929 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-08d1d48d-4649-4364-bbdf-5394f1a9a600 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:38.403587 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-08d1d48d-4649-4364-bbdf-5394f1a9a600 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/769ee4e5-e4df-4d4e-9f4c-6372c60d9e01" status: 200 len: 1471 microversion: 2.1 time: 0.415668 Jul 23 21:14:38.415761 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 236/408] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:14:37 2022] GET /compute/v2.1/servers/769ee4e5-e4df-4d4e-9f4c-6372c60d9e01 => generated 1471 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:14:39.423975 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c5c6b2e4-2c07-4895-8b22-91171d21441f tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:39.424644 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-c5c6b2e4-2c07-4895-8b22-91171d21441f tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 769ee4e5-e4df-4d4e-9f4c-6372c60d9e01] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:14:39.442547 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c5c6b2e4-2c07-4895-8b22-91171d21441f tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:39.443290 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c5c6b2e4-2c07-4895-8b22-91171d21441f tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:39.445408 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c5c6b2e4-2c07-4895-8b22-91171d21441f tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:39.446477 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c5c6b2e4-2c07-4895-8b22-91171d21441f tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:40.797012 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c5c6b2e4-2c07-4895-8b22-91171d21441f tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:40.816541 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-c5c6b2e4-2c07-4895-8b22-91171d21441f tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/769ee4e5-e4df-4d4e-9f4c-6372c60d9e01" status: 200 len: 1471 microversion: 2.1 time: 1.396576 Jul 23 21:14:40.820061 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 237/409] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:14:39 2022] GET /compute/v2.1/servers/769ee4e5-e4df-4d4e-9f4c-6372c60d9e01 => generated 1471 bytes in 1402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:14:41.837014 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ae3720a7-d7ed-466b-bb85-97c502fce47f tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:41.837808 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-ae3720a7-d7ed-466b-bb85-97c502fce47f tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 769ee4e5-e4df-4d4e-9f4c-6372c60d9e01] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:14:41.851140 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ae3720a7-d7ed-466b-bb85-97c502fce47f tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:41.851743 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ae3720a7-d7ed-466b-bb85-97c502fce47f tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:41.856653 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ae3720a7-d7ed-466b-bb85-97c502fce47f tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:41.858074 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ae3720a7-d7ed-466b-bb85-97c502fce47f tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:42.214931 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=46 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:42.357730 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-096b4e5a-42b0-4b6f-9476-728eb45396ba tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/965630ba-6832-46c9-8f42-7a9fed39e598/action" status: 202 len: 0 microversion: 2.1 time: 8.656798 Jul 23 21:14:42.357730 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 173/410] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:14:33 2022] POST /compute/v2.1/servers/965630ba-6832-46c9-8f42-7a9fed39e598/action => generated 0 bytes in 8659 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 23 21:14:42.988585 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ae3720a7-d7ed-466b-bb85-97c502fce47f tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:43.024063 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-ae3720a7-d7ed-466b-bb85-97c502fce47f tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/769ee4e5-e4df-4d4e-9f4c-6372c60d9e01" status: 200 len: 1471 microversion: 2.1 time: 1.191964 Jul 23 21:14:43.025358 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 238/411] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:14:41 2022] GET /compute/v2.1/servers/769ee4e5-e4df-4d4e-9f4c-6372c60d9e01 => generated 1471 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:14:43.032072 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e932eba8-2ce4-41f0-9e91-a9228362825e tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:43.040483 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-e932eba8-2ce4-41f0-9e91-a9228362825e tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 965630ba-6832-46c9-8f42-7a9fed39e598] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:14:43.051754 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e932eba8-2ce4-41f0-9e91-a9228362825e tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:43.052588 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e932eba8-2ce4-41f0-9e91-a9228362825e tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:43.054772 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e932eba8-2ce4-41f0-9e91-a9228362825e tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:43.055637 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e932eba8-2ce4-41f0-9e91-a9228362825e tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:43.287437 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6313f98c-3eb2-4e50-94e2-12770266f28e tempest-FlavorMetadataValidation-2121675685 tempest-FlavorMetadataValidation-2121675685-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-24945314", "id": 310856517, "os-flavor-access:is_public": "True"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:14:43.293418 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:43.293418 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:14:43.344220 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6313f98c-3eb2-4e50-94e2-12770266f28e tempest-FlavorMetadataValidation-2121675685 tempest-FlavorMetadataValidation-2121675685-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 466 microversion: 2.86 time: 0.982998 Jul 23 21:14:43.356256 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 174/412] 10.222.0.17 () {62 vars in 1187 bytes} [Sat Jul 23 21:14:42 2022] POST /compute/v2.1/flavors => generated 466 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 23 21:14:43.364661 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-35317fae-7d72-439e-a81d-646f8ed871d7 tempest-FlavorMetadataValidation-2121675685 tempest-FlavorMetadataValidation-2121675685-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:14:43.366964 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:43.366964 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:14:43.483618 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-e932eba8-2ce4-41f0-9e91-a9228362825e tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:43.501331 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-e932eba8-2ce4-41f0-9e91-a9228362825e tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/965630ba-6832-46c9-8f42-7a9fed39e598" status: 200 len: 1503 microversion: 2.1 time: 0.469426 Jul 23 21:14:43.502116 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 239/413] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:14:43 2022] GET /compute/v2.1/servers/965630ba-6832-46c9-8f42-7a9fed39e598 => generated 1503 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:14:43.930628 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=6 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:43.976587 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:INSERT=18,nova_api:SELECT=79,nova_api:SAVEPOINT=2,nova_api:RELEASE=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:44.008000 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-35317fae-7d72-439e-a81d-646f8ed871d7 tempest-FlavorMetadataValidation-2121675685 tempest-FlavorMetadataValidation-2121675685-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors/310856517/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.649053 Jul 23 21:14:44.011921 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 175/414] 10.222.0.17 () {62 vars in 1261 bytes} [Sat Jul 23 21:14:43 2022] POST /compute/v2.1/flavors/310856517/os-extra_specs => generated 62 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:14:44.022576 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-b5c032fc-37cc-4c5e-9e3c-f9a396fa821e tempest-FlavorMetadataValidation-2121675685 tempest-FlavorMetadataValidation-2121675685-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:44.024047 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:44.024047 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:14:44.042718 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e5aa6920-017f-4d3f-9656-1eab66e55d04 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:44.043698 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e5aa6920-017f-4d3f-9656-1eab66e55d04 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 769ee4e5-e4df-4d4e-9f4c-6372c60d9e01] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:14:44.060773 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e5aa6920-017f-4d3f-9656-1eab66e55d04 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:44.061504 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e5aa6920-017f-4d3f-9656-1eab66e55d04 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:44.064806 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e5aa6920-017f-4d3f-9656-1eab66e55d04 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:44.066042 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e5aa6920-017f-4d3f-9656-1eab66e55d04 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:44.078095 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-b5c032fc-37cc-4c5e-9e3c-f9a396fa821e tempest-FlavorMetadataValidation-2121675685 tempest-FlavorMetadataValidation-2121675685-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/310856517" status: 202 len: 0 microversion: 2.86 time: 0.060548 Jul 23 21:14:44.082222 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 240/415] 10.222.0.17 () {60 vars in 1198 bytes} [Sat Jul 23 21:14:44 2022] DELETE /compute/v2.1/flavors/310856517 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:14:44.090846 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-9949a112-9a28-46c3-985f-d8271631fc9c tempest-FlavorMetadataValidation-2121675685 tempest-FlavorMetadataValidation-2121675685-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:44.147471 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-9949a112-9a28-46c3-985f-d8271631fc9c tempest-FlavorMetadataValidation-2121675685 tempest-FlavorMetadataValidation-2121675685-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.063586 Jul 23 21:14:44.167785 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 241/416] 10.222.0.17 () {60 vars in 1186 bytes} [Sat Jul 23 21:14:44 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:14:44.521218 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a3816ebf-5669-4c00-a153-3cbd5374b71f tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:44.522007 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-a3816ebf-5669-4c00-a153-3cbd5374b71f tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 965630ba-6832-46c9-8f42-7a9fed39e598] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:14:44.535517 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a3816ebf-5669-4c00-a153-3cbd5374b71f tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:44.536200 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a3816ebf-5669-4c00-a153-3cbd5374b71f tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:44.539236 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a3816ebf-5669-4c00-a153-3cbd5374b71f tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:44.541013 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a3816ebf-5669-4c00-a153-3cbd5374b71f tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:44.576346 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell0:SELECT=60 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:45.020330 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e5aa6920-017f-4d3f-9656-1eab66e55d04 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:45.029414 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e5aa6920-017f-4d3f-9656-1eab66e55d04 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/769ee4e5-e4df-4d4e-9f4c-6372c60d9e01" status: 200 len: 1476 microversion: 2.1 time: 0.991803 Jul 23 21:14:45.031185 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 176/417] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:14:44 2022] GET /compute/v2.1/servers/769ee4e5-e4df-4d4e-9f4c-6372c60d9e01 => generated 1476 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:14:45.080116 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-a3816ebf-5669-4c00-a153-3cbd5374b71f tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:45.088097 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-a3816ebf-5669-4c00-a153-3cbd5374b71f tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/965630ba-6832-46c9-8f42-7a9fed39e598" status: 200 len: 1503 microversion: 2.1 time: 0.572094 Jul 23 21:14:45.098210 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 242/418] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:14:44 2022] GET /compute/v2.1/servers/965630ba-6832-46c9-8f42-7a9fed39e598 => generated 1503 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:14:46.024169 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-fb0dce1e-bb28-4485-876e-377e3d168115 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-244699680", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "networks": [{"uuid": "290f6ab6-b90e-4acc-9fe0-f410e54c8881"}]}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:14:46.047060 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-0eeb8bce-0057-4abb-b70f-7e7a63b5e8be tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:46.048199 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-0eeb8bce-0057-4abb-b70f-7e7a63b5e8be tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 769ee4e5-e4df-4d4e-9f4c-6372c60d9e01] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:14:46.051030 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell0:SELECT=13 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:46.077538 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0eeb8bce-0057-4abb-b70f-7e7a63b5e8be tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:46.081805 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0eeb8bce-0057-4abb-b70f-7e7a63b5e8be tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:46.085401 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0eeb8bce-0057-4abb-b70f-7e7a63b5e8be tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:46.087994 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0eeb8bce-0057-4abb-b70f-7e7a63b5e8be tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:46.253967 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-fb0dce1e-bb28-4485-876e-377e3d168115 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] validate_networks() for [('290f6ab6-b90e-4acc-9fe0-f410e54c8881', None, None, None, None, None)] {{(pid=131320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:14:46.807130 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-0eeb8bce-0057-4abb-b70f-7e7a63b5e8be tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:46.816481 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-0eeb8bce-0057-4abb-b70f-7e7a63b5e8be tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/769ee4e5-e4df-4d4e-9f4c-6372c60d9e01" status: 200 len: 1476 microversion: 2.1 time: 0.773618 Jul 23 21:14:46.830618 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 243/419] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:14:46 2022] GET /compute/v2.1/servers/769ee4e5-e4df-4d4e-9f4c-6372c60d9e01 => generated 1476 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:14:46.856182 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-7172c8d4-39c4-4ca5-aca8-c169c513336b tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:46.856376 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-7172c8d4-39c4-4ca5-aca8-c169c513336b tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 965630ba-6832-46c9-8f42-7a9fed39e598] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:14:46.880974 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7172c8d4-39c4-4ca5-aca8-c169c513336b tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:46.881434 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7172c8d4-39c4-4ca5-aca8-c169c513336b tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:46.883840 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7172c8d4-39c4-4ca5-aca8-c169c513336b tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:46.886268 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7172c8d4-39c4-4ca5-aca8-c169c513336b tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:47.215262 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-7172c8d4-39c4-4ca5-aca8-c169c513336b tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:47.229210 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-7172c8d4-39c4-4ca5-aca8-c169c513336b tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/965630ba-6832-46c9-8f42-7a9fed39e598" status: 200 len: 1503 microversion: 2.1 time: 0.397122 Jul 23 21:14:47.242909 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 244/420] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:14:46 2022] GET /compute/v2.1/servers/965630ba-6832-46c9-8f42-7a9fed39e598 => generated 1503 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:14:47.359357 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-fb0dce1e-bb28-4485-876e-377e3d168115 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:14:47.359883 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-fb0dce1e-bb28-4485-876e-377e3d168115 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:14:47.360155 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-fb0dce1e-bb28-4485-876e-377e3d168115 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:14:47.360562 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-fb0dce1e-bb28-4485-876e-377e3d168115 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:14:47.361085 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-fb0dce1e-bb28-4485-876e-377e3d168115 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:14:47.382295 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fb0dce1e-bb28-4485-876e-377e3d168115 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:47.382760 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fb0dce1e-bb28-4485-876e-377e3d168115 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:47.383662 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fb0dce1e-bb28-4485-876e-377e3d168115 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:47.384201 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fb0dce1e-bb28-4485-876e-377e3d168115 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:47.421521 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-fb0dce1e-bb28-4485-876e-377e3d168115 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Getting quotas for project b347973dfb204484bdb87ab0094dbe22. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:14:47.440539 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-fb0dce1e-bb28-4485-876e-377e3d168115 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Getting quotas for user 3a56b82cf3954f279dd21e17a42462b3 and project b347973dfb204484bdb87ab0094dbe22. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:14:47.458327 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-fb0dce1e-bb28-4485-876e-377e3d168115 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Going to run 1 instances... {{(pid=131320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:14:47.461103 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-fb0dce1e-bb28-4485-876e-377e3d168115 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: ed0fdfd2-3506-40c4-8e4a-bb984e946fdd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:14:47.565930 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-fb0dce1e-bb28-4485-876e-377e3d168115 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.875924 Jul 23 21:14:47.575545 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 177/421] 10.222.0.17 () {62 vars in 1187 bytes} [Sat Jul 23 21:14:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1890 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 23 21:14:47.592438 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-a0f50efa-04bd-4b29-9420-f2611290f71b req-eeb789bc-0c4a-41ad-ab87-6a865b00f69d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "965630ba-6832-46c9-8f42-7a9fed39e598", "name": "network-vif-unplugged", "status": "completed", "tag": "93e984c6-69bf-434e-b812-af74ab1347d8"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:14:47.610563 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-a0f50efa-04bd-4b29-9420-f2611290f71b req-eeb789bc-0c4a-41ad-ab87-6a865b00f69d service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:47.611042 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-a0f50efa-04bd-4b29-9420-f2611290f71b req-eeb789bc-0c4a-41ad-ab87-6a865b00f69d service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:47.643242 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-a0f50efa-04bd-4b29-9420-f2611290f71b req-eeb789bc-0c4a-41ad-ab87-6a865b00f69d service nova] Creating event network-vif-unplugged:93e984c6-69bf-434e-b812-af74ab1347d8 for instance 965630ba-6832-46c9-8f42-7a9fed39e598 on nch1-master-1 Jul 23 21:14:47.656893 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-a0f50efa-04bd-4b29-9420-f2611290f71b req-eeb789bc-0c4a-41ad-ab87-6a865b00f69d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.073722 Jul 23 21:14:47.657711 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 178/422] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:14:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:14:47.668575 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-da60c415-ca96-4cd7-98e4-dadc29162992 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:47.673987 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-da60c415-ca96-4cd7-98e4-dadc29162992 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: ed0fdfd2-3506-40c4-8e4a-bb984e946fdd] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:14:47.997408 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-da60c415-ca96-4cd7-98e4-dadc29162992 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:48.014729 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-da60c415-ca96-4cd7-98e4-dadc29162992 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:48.026792 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-da60c415-ca96-4cd7-98e4-dadc29162992 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:48.035849 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-da60c415-ca96-4cd7-98e4-dadc29162992 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/ed0fdfd2-3506-40c4-8e4a-bb984e946fdd" status: 200 len: 1261 microversion: 2.25 time: 0.374680 Jul 23 21:14:48.038225 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 179/423] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:14:47 2022] GET /compute/v2.1/servers/ed0fdfd2-3506-40c4-8e4a-bb984e946fdd => generated 1261 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:14:48.052052 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1657546f-6622-4f70-bc2e-3ac2cf855939 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:48.052678 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1657546f-6622-4f70-bc2e-3ac2cf855939 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 769ee4e5-e4df-4d4e-9f4c-6372c60d9e01] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:14:48.092066 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1657546f-6622-4f70-bc2e-3ac2cf855939 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:48.092528 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1657546f-6622-4f70-bc2e-3ac2cf855939 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:48.093406 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1657546f-6622-4f70-bc2e-3ac2cf855939 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:48.093839 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1657546f-6622-4f70-bc2e-3ac2cf855939 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:48.110310 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-6eddf5df-3a3c-43b8-9039-79b478a1bcea tempest-KeyPairsV210TestJSON-962825778 tempest-KeyPairsV210TestJSON-962825778-project-admin] Action: 'create', calling method: .version_select at 0x7f0b545e8160>, body: {"keypair": {"name": "tempest-keypair-1571723704", "type": "ssh", "user_id": "c838be8a91804574aa90e8d90df8600c", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNqzDVVdHCdxhxBOWPS279GZ89sQSFr8W/Z6FI+6Mh+KtRVtHWTPMKnwSbW3mvgTya1209NSkyd4kU37A7LtkwIQ3wyJwz7+Gz6h9dTZse38CLj3jHyATYbQg5ym3SxZ7Q=="}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:14:48.186670 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-6eddf5df-3a3c-43b8-9039-79b478a1bcea tempest-KeyPairsV210TestJSON-962825778 tempest-KeyPairsV210TestJSON-962825778-project-admin] Getting quotas for project d0df7d6bde584592a1b92d00065cb6a9. Resources: {'key_pairs'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:14:48.198659 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-6eddf5df-3a3c-43b8-9039-79b478a1bcea tempest-KeyPairsV210TestJSON-962825778 tempest-KeyPairsV210TestJSON-962825778-project-admin] Getting quotas for user 20ff4b538d574a53a05b261388b614b6 and project d0df7d6bde584592a1b92d00065cb6a9. Resources: {'key_pairs'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:14:48.318457 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-6eddf5df-3a3c-43b8-9039-79b478a1bcea tempest-KeyPairsV210TestJSON-962825778 tempest-KeyPairsV210TestJSON-962825778-project-admin] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 1.071923 Jul 23 21:14:48.319088 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 245/424] 10.222.0.17 () {62 vars in 1199 bytes} [Sat Jul 23 21:14:47 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1075 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 23 21:14:48.348053 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-05021359-1db1-4c1c-977e-e4e383bdca2c tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:48.350472 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-05021359-1db1-4c1c-977e-e4e383bdca2c tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 965630ba-6832-46c9-8f42-7a9fed39e598] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:14:48.371711 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-05021359-1db1-4c1c-977e-e4e383bdca2c tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:48.376643 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-05021359-1db1-4c1c-977e-e4e383bdca2c tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:48.380836 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-05021359-1db1-4c1c-977e-e4e383bdca2c tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:48.383011 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-05021359-1db1-4c1c-977e-e4e383bdca2c tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:48.979121 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-1657546f-6622-4f70-bc2e-3ac2cf855939 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:49.027845 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1657546f-6622-4f70-bc2e-3ac2cf855939 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/769ee4e5-e4df-4d4e-9f4c-6372c60d9e01" status: 200 len: 1476 microversion: 2.1 time: 0.983497 Jul 23 21:14:49.033706 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 180/425] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:14:48 2022] GET /compute/v2.1/servers/769ee4e5-e4df-4d4e-9f4c-6372c60d9e01 => generated 1476 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:14:49.053880 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-05021359-1db1-4c1c-977e-e4e383bdca2c tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:49.058503 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-67016434-53b0-485b-bfaf-5f941e95ecac tempest-KeyPairsV210TestJSON-962825778 tempest-KeyPairsV210TestJSON-962825778-project-admin] Action: 'create', calling method: .version_select at 0x7f0b47f384c0>, body: {"keypair": {"name": "tempest-keypair-1708314019", "type": "ssh", "user_id": "c838be8a91804574aa90e8d90df8600c", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB4FIaH20aqsS6tmIHV26I3n7usgf/dCi+gAsqePZknPRTOHWxQGnyJQgWuHEoVBD+7Ba5rsnZ4bZ4H+jrl3RSB6z6lIxfaAmTf7QvoIVSCipw4fRsyBUFIABJdUvCLQQw=="}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:14:49.067071 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-05021359-1db1-4c1c-977e-e4e383bdca2c tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/965630ba-6832-46c9-8f42-7a9fed39e598" status: 200 len: 1503 microversion: 2.1 time: 0.734977 Jul 23 21:14:49.079508 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 246/426] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:14:48 2022] GET /compute/v2.1/servers/965630ba-6832-46c9-8f42-7a9fed39e598 => generated 1503 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:14:49.086451 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-6278deea-f037-4e5b-80d5-51a82447105b tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:49.089908 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-6278deea-f037-4e5b-80d5-51a82447105b tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: ed0fdfd2-3506-40c4-8e4a-bb984e946fdd] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:14:49.118060 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6278deea-f037-4e5b-80d5-51a82447105b tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:49.121074 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6278deea-f037-4e5b-80d5-51a82447105b tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:49.127408 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6278deea-f037-4e5b-80d5-51a82447105b tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:49.129417 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6278deea-f037-4e5b-80d5-51a82447105b tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:49.179315 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-67016434-53b0-485b-bfaf-5f941e95ecac tempest-KeyPairsV210TestJSON-962825778 tempest-KeyPairsV210TestJSON-962825778-project-admin] Getting quotas for project d0df7d6bde584592a1b92d00065cb6a9. Resources: {'key_pairs'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:14:49.197655 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-67016434-53b0-485b-bfaf-5f941e95ecac tempest-KeyPairsV210TestJSON-962825778 tempest-KeyPairsV210TestJSON-962825778-project-admin] Getting quotas for user 20ff4b538d574a53a05b261388b614b6 and project d0df7d6bde584592a1b92d00065cb6a9. Resources: {'key_pairs'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:14:49.293052 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-67016434-53b0-485b-bfaf-5f941e95ecac tempest-KeyPairsV210TestJSON-962825778 tempest-KeyPairsV210TestJSON-962825778-project-admin] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.257951 Jul 23 21:14:49.294067 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 181/427] 10.222.0.17 () {62 vars in 1199 bytes} [Sat Jul 23 21:14:49 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 259 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 23 21:14:49.307214 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-bcf0743f-e274-4cbb-9039-e4e87a78b055 tempest-KeyPairsV210TestJSON-962825778 tempest-KeyPairsV210TestJSON-962825778-project-admin] Calling method '.version_select at 0x7f0b47ec19d0>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:49.320022 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-bcf0743f-e274-4cbb-9039-e4e87a78b055 tempest-KeyPairsV210TestJSON-962825778 tempest-KeyPairsV210TestJSON-962825778-project-admin] 10.222.0.17 "GET /compute/v2.1/os-keypairs/tempest-keypair-1571723704?user_id=c838be8a91804574aa90e8d90df8600c" status: 200 len: 512 microversion: 2.10 time: 0.019564 Jul 23 21:14:49.321222 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 182/428] 10.222.0.17 () {60 vars in 1339 bytes} [Sat Jul 23 21:14:49 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1571723704?user_id=c838be8a91804574aa90e8d90df8600c => generated 512 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 23 21:14:49.334205 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c875808d-20d3-4662-878e-f84475f50e26 tempest-KeyPairsV210TestJSON-962825778 tempest-KeyPairsV210TestJSON-962825778-project-admin] Action: 'create', calling method: .version_select at 0x7f0b47f219d0>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-1897857856", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOFUBXc5SoTZA9tu3TeZ5a6p8mAAI6/YlO1vjKLJ0fXf29Ef7+O8sxJcM6XPep93PuMRNQaAK9tehlpInO79a535x6dODRtnH74FWFA9FKyhlEsEs9QLPb+B165XH9Z/FQ=="}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:14:49.406997 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-c875808d-20d3-4662-878e-f84475f50e26 tempest-KeyPairsV210TestJSON-962825778 tempest-KeyPairsV210TestJSON-962825778-project-admin] Getting quotas for project d0df7d6bde584592a1b92d00065cb6a9. Resources: {'key_pairs'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:14:49.417282 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-c875808d-20d3-4662-878e-f84475f50e26 tempest-KeyPairsV210TestJSON-962825778 tempest-KeyPairsV210TestJSON-962825778-project-admin] Getting quotas for user 20ff4b538d574a53a05b261388b614b6 and project d0df7d6bde584592a1b92d00065cb6a9. Resources: {'key_pairs'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:14:49.462858 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-6278deea-f037-4e5b-80d5-51a82447105b tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:49.475026 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c875808d-20d3-4662-878e-f84475f50e26 tempest-KeyPairsV210TestJSON-962825778 tempest-KeyPairsV210TestJSON-962825778-project-admin] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.144899 Jul 23 21:14:49.481194 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 183/429] 10.222.0.17 () {62 vars in 1199 bytes} [Sat Jul 23 21:14:49 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 152 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jul 23 21:14:49.483996 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-6278deea-f037-4e5b-80d5-51a82447105b tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:49.488983 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-6278deea-f037-4e5b-80d5-51a82447105b tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:49.491186 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-6278deea-f037-4e5b-80d5-51a82447105b tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/ed0fdfd2-3506-40c4-8e4a-bb984e946fdd" status: 200 len: 1257 microversion: 2.25 time: 0.410108 Jul 23 21:14:49.493485 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 247/430] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:14:49 2022] GET /compute/v2.1/servers/ed0fdfd2-3506-40c4-8e4a-bb984e946fdd => generated 1257 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:14:49.495081 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e7b22d44-6488-41d2-a7e6-ee85ce547b12 tempest-KeyPairsV210TestJSON-962825778 tempest-KeyPairsV210TestJSON-962825778-project-admin] Calling method '.version_select at 0x7f0b5404ca60>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:49.501248 ncdv-master-1 devstack@n-api.service[131320]: WARNING oslo_db.sqlalchemy.utils [None req-e7b22d44-6488-41d2-a7e6-ee85ce547b12 tempest-KeyPairsV210TestJSON-962825778 tempest-KeyPairsV210TestJSON-962825778-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Jul 23 21:14:49.523755 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e7b22d44-6488-41d2-a7e6-ee85ce547b12 tempest-KeyPairsV210TestJSON-962825778 tempest-KeyPairsV210TestJSON-962825778-project-admin] 10.222.0.17 "GET /compute/v2.1/os-keypairs?user_id=c838be8a91804574aa90e8d90df8600c" status: 200 len: 726 microversion: 2.10 time: 0.040171 Jul 23 21:14:49.525084 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 184/431] 10.222.0.17 () {60 vars in 1258 bytes} [Sat Jul 23 21:14:49 2022] GET /compute/v2.1/os-keypairs?user_id=c838be8a91804574aa90e8d90df8600c => generated 726 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 23 21:14:49.536763 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8e421e8e-ac48-4310-9cf3-505f0f35bf96 tempest-KeyPairsV210TestJSON-962825778 tempest-KeyPairsV210TestJSON-962825778-project-admin] Calling method '.version_select at 0x7f0b47eac9d0>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:49.577057 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8e421e8e-ac48-4310-9cf3-505f0f35bf96 tempest-KeyPairsV210TestJSON-962825778 tempest-KeyPairsV210TestJSON-962825778-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1897857856" status: 204 len: 0 microversion: 2.10 time: 0.046040 Jul 23 21:14:49.578171 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 185/432] 10.222.0.17 () {60 vars in 1324 bytes} [Sat Jul 23 21:14:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1897857856 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 23 21:14:49.587000 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f0b80685-0769-4e56-9b7a-675fa6b12825 tempest-KeyPairsV210TestJSON-962825778 tempest-KeyPairsV210TestJSON-962825778-project-admin] Calling method '.version_select at 0x7f0b5404c4c0>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:49.626443 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f0b80685-0769-4e56-9b7a-675fa6b12825 tempest-KeyPairsV210TestJSON-962825778 tempest-KeyPairsV210TestJSON-962825778-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1708314019?user_id=c838be8a91804574aa90e8d90df8600c" status: 204 len: 0 microversion: 2.10 time: 0.042804 Jul 23 21:14:49.627101 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 186/433] 10.222.0.17 () {60 vars in 1342 bytes} [Sat Jul 23 21:14:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1708314019?user_id=c838be8a91804574aa90e8d90df8600c => generated 0 bytes in 45 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 23 21:14:49.638737 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-73f72419-f204-4efe-a22c-63911d5405ad tempest-KeyPairsV210TestJSON-962825778 tempest-KeyPairsV210TestJSON-962825778-project-admin] Calling method '.version_select at 0x7f0b47f34310>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:49.691727 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-73f72419-f204-4efe-a22c-63911d5405ad tempest-KeyPairsV210TestJSON-962825778 tempest-KeyPairsV210TestJSON-962825778-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1571723704?user_id=c838be8a91804574aa90e8d90df8600c" status: 204 len: 0 microversion: 2.10 time: 0.056944 Jul 23 21:14:49.692335 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 187/434] 10.222.0.17 () {60 vars in 1342 bytes} [Sat Jul 23 21:14:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1571723704?user_id=c838be8a91804574aa90e8d90df8600c => generated 0 bytes in 58 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 23 21:14:49.726265 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-c03fdec5-48b9-4df1-bcb1-8c34f4063a0c req-95af7707-c368-4ab8-929d-8d997cef4012 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "965630ba-6832-46c9-8f42-7a9fed39e598", "tag": "93e984c6-69bf-434e-b812-af74ab1347d8"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:14:49.768681 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-c03fdec5-48b9-4df1-bcb1-8c34f4063a0c req-95af7707-c368-4ab8-929d-8d997cef4012 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:49.769310 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-c03fdec5-48b9-4df1-bcb1-8c34f4063a0c req-95af7707-c368-4ab8-929d-8d997cef4012 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:49.804335 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-c03fdec5-48b9-4df1-bcb1-8c34f4063a0c req-95af7707-c368-4ab8-929d-8d997cef4012 service nova] Creating event network-changed:93e984c6-69bf-434e-b812-af74ab1347d8 for instance 965630ba-6832-46c9-8f42-7a9fed39e598 on nch1-master-1 Jul 23 21:14:49.838077 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-c03fdec5-48b9-4df1-bcb1-8c34f4063a0c req-95af7707-c368-4ab8-929d-8d997cef4012 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131437 Jul 23 21:14:49.838318 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-26d00e7c-9e44-4fa9-b2b2-ef96b60fc6dc tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-225992456", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:14:49.842578 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 188/435] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:14:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:14:49.938547 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.network.neutron [None req-26d00e7c-9e44-4fa9-b2b2-ef96b60fc6dc tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] validate_networks() for None {{(pid=131321) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:14:50.056304 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e1bcc061-5ad5-4ed2-97a1-0ad24122bd28 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:50.058201 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e1bcc061-5ad5-4ed2-97a1-0ad24122bd28 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 769ee4e5-e4df-4d4e-9f4c-6372c60d9e01] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:14:50.076868 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e1bcc061-5ad5-4ed2-97a1-0ad24122bd28 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:50.078267 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e1bcc061-5ad5-4ed2-97a1-0ad24122bd28 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:50.082226 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e1bcc061-5ad5-4ed2-97a1-0ad24122bd28 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:50.083249 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e1bcc061-5ad5-4ed2-97a1-0ad24122bd28 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:50.931512 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e1bcc061-5ad5-4ed2-97a1-0ad24122bd28 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:50.951658 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e1bcc061-5ad5-4ed2-97a1-0ad24122bd28 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/769ee4e5-e4df-4d4e-9f4c-6372c60d9e01" status: 200 len: 1476 microversion: 2.1 time: 0.898478 Jul 23 21:14:50.955878 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 189/436] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:14:50 2022] GET /compute/v2.1/servers/769ee4e5-e4df-4d4e-9f4c-6372c60d9e01 => generated 1476 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:14:50.967751 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3d94fc81-5c6e-4133-a2ed-61a696722093 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:50.971876 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-3d94fc81-5c6e-4133-a2ed-61a696722093 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 965630ba-6832-46c9-8f42-7a9fed39e598] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:14:50.988334 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3d94fc81-5c6e-4133-a2ed-61a696722093 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:50.991874 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3d94fc81-5c6e-4133-a2ed-61a696722093 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:50.993940 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3d94fc81-5c6e-4133-a2ed-61a696722093 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:50.995807 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3d94fc81-5c6e-4133-a2ed-61a696722093 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:51.545315 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-26d00e7c-9e44-4fa9-b2b2-ef96b60fc6dc tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Flavor limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:14:51.546371 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-26d00e7c-9e44-4fa9-b2b2-ef96b60fc6dc tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Image limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:14:51.547008 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-26d00e7c-9e44-4fa9-b2b2-ef96b60fc6dc tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Flavor pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:14:51.547690 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-26d00e7c-9e44-4fa9-b2b2-ef96b60fc6dc tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Image pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:14:51.548270 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-26d00e7c-9e44-4fa9-b2b2-ef96b60fc6dc tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:14:51.568842 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-26d00e7c-9e44-4fa9-b2b2-ef96b60fc6dc tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:51.569446 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-26d00e7c-9e44-4fa9-b2b2-ef96b60fc6dc tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:51.570404 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-26d00e7c-9e44-4fa9-b2b2-ef96b60fc6dc tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:51.571026 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-26d00e7c-9e44-4fa9-b2b2-ef96b60fc6dc tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:51.628763 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-26d00e7c-9e44-4fa9-b2b2-ef96b60fc6dc tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Getting quotas for project 457d184c579a4016a0eec16eb9f23195. Resources: {'ram', 'instances', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:14:51.635892 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-26d00e7c-9e44-4fa9-b2b2-ef96b60fc6dc tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Getting quotas for user 8a872dad882e4694aba20eaa8c06df53 and project 457d184c579a4016a0eec16eb9f23195. Resources: {'ram', 'instances', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:14:51.657475 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-26d00e7c-9e44-4fa9-b2b2-ef96b60fc6dc tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Going to run 1 instances... {{(pid=131321) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:14:51.661187 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-26d00e7c-9e44-4fa9-b2b2-ef96b60fc6dc tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] [instance: 7b12c52a-fc64-472b-8659-4e7312fcc83a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131321) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:14:51.845945 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-26d00e7c-9e44-4fa9-b2b2-ef96b60fc6dc tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.333993 Jul 23 21:14:51.850001 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 248/437] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:14:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 2339 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 23 21:14:51.858552 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-3d94fc81-5c6e-4133-a2ed-61a696722093 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:51.860368 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-2f7ef737-0438-46b0-b470-42ea9c503882 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:51.861420 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-2f7ef737-0438-46b0-b470-42ea9c503882 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: ed0fdfd2-3506-40c4-8e4a-bb984e946fdd] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:14:51.867645 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-3d94fc81-5c6e-4133-a2ed-61a696722093 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/965630ba-6832-46c9-8f42-7a9fed39e598" status: 200 len: 1503 microversion: 2.1 time: 0.909050 Jul 23 21:14:51.884209 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 190/438] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:14:50 2022] GET /compute/v2.1/servers/965630ba-6832-46c9-8f42-7a9fed39e598 => generated 1503 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:14:51.884663 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2f7ef737-0438-46b0-b470-42ea9c503882 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:51.886167 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2f7ef737-0438-46b0-b470-42ea9c503882 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:51.887541 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2f7ef737-0438-46b0-b470-42ea9c503882 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:51.895806 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2f7ef737-0438-46b0-b470-42ea9c503882 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:51.902571 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e7ea4498-5318-4e5c-b0ec-5cb5c9fe6175 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:51.915954 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e7ea4498-5318-4e5c-b0ec-5cb5c9fe6175 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] [instance: 7b12c52a-fc64-472b-8659-4e7312fcc83a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:14:52.163287 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-2f7ef737-0438-46b0-b470-42ea9c503882 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:52.175402 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-2f7ef737-0438-46b0-b470-42ea9c503882 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:52.176929 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-2f7ef737-0438-46b0-b470-42ea9c503882 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:52.183082 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-2f7ef737-0438-46b0-b470-42ea9c503882 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/ed0fdfd2-3506-40c4-8e4a-bb984e946fdd" status: 200 len: 1319 microversion: 2.25 time: 0.331796 Jul 23 21:14:52.183677 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 249/439] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:14:51 2022] GET /compute/v2.1/servers/ed0fdfd2-3506-40c4-8e4a-bb984e946fdd => generated 1319 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:14:52.200588 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e5715402-17dd-4900-b756-7ab73e95a143 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:52.201444 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-e5715402-17dd-4900-b756-7ab73e95a143 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 769ee4e5-e4df-4d4e-9f4c-6372c60d9e01] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:14:52.210812 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e5715402-17dd-4900-b756-7ab73e95a143 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:52.211490 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e5715402-17dd-4900-b756-7ab73e95a143 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:52.212994 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e5715402-17dd-4900-b756-7ab73e95a143 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:52.213595 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e5715402-17dd-4900-b756-7ab73e95a143 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:52.438644 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e7ea4498-5318-4e5c-b0ec-5cb5c9fe6175 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a872dad882e4694aba20eaa8c06df53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457d184c579a4016a0eec16eb9f23195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:52.448633 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e7ea4498-5318-4e5c-b0ec-5cb5c9fe6175 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] 10.222.0.17 "GET /compute/v2.1/servers/7b12c52a-fc64-472b-8659-4e7312fcc83a" status: 200 len: 1218 microversion: 2.1 time: 0.562677 Jul 23 21:14:52.452099 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 191/440] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:14:51 2022] GET /compute/v2.1/servers/7b12c52a-fc64-472b-8659-4e7312fcc83a => generated 1218 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:14:53.062774 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-628a8c10-a967-4ea8-b3b1-1e562d1c0eb5 tempest-FlavorsV2TestJSON-1397238601 tempest-FlavorsV2TestJSON-1397238601-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:53.090228 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-628a8c10-a967-4ea8-b3b1-1e562d1c0eb5 tempest-FlavorsV2TestJSON-1397238601 tempest-FlavorsV2TestJSON-1397238601-project] 10.222.0.17 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.631901 Jul 23 21:14:53.097692 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 192/441] 10.222.0.17 () {58 vars in 1136 bytes} [Sat Jul 23 21:14:52 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:14:53.100144 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f88e3653-ef38-48d9-a323-d35ae4c61b49 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:53.100771 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f88e3653-ef38-48d9-a323-d35ae4c61b49 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 965630ba-6832-46c9-8f42-7a9fed39e598] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:14:53.113746 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f88e3653-ef38-48d9-a323-d35ae4c61b49 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:53.114268 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f88e3653-ef38-48d9-a323-d35ae4c61b49 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:53.115120 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f88e3653-ef38-48d9-a323-d35ae4c61b49 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:53.115566 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f88e3653-ef38-48d9-a323-d35ae4c61b49 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:53.366943 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-e5715402-17dd-4900-b756-7ab73e95a143 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:53.376646 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-e5715402-17dd-4900-b756-7ab73e95a143 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/769ee4e5-e4df-4d4e-9f4c-6372c60d9e01" status: 200 len: 1476 microversion: 2.1 time: 1.180251 Jul 23 21:14:53.391357 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 250/442] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:14:52 2022] GET /compute/v2.1/servers/769ee4e5-e4df-4d4e-9f4c-6372c60d9e01 => generated 1476 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:14:53.405996 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-5a13c158-201b-4fdc-a893-e7032a37d79f tempest-FlavorsV2TestJSON-1397238601 tempest-FlavorsV2TestJSON-1397238601-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:53.473640 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f88e3653-ef38-48d9-a323-d35ae4c61b49 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:53.493393 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-5a13c158-201b-4fdc-a893-e7032a37d79f tempest-FlavorsV2TestJSON-1397238601 tempest-FlavorsV2TestJSON-1397238601-project] 10.222.0.17 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.100229 Jul 23 21:14:53.493489 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 251/443] 10.222.0.17 () {58 vars in 1124 bytes} [Sat Jul 23 21:14:53 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:14:53.494190 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f88e3653-ef38-48d9-a323-d35ae4c61b49 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/965630ba-6832-46c9-8f42-7a9fed39e598" status: 200 len: 1503 microversion: 2.1 time: 0.400982 Jul 23 21:14:53.495276 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 193/444] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:14:53 2022] GET /compute/v2.1/servers/965630ba-6832-46c9-8f42-7a9fed39e598 => generated 1503 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:14:53.500422 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b6de0fc9-06fb-4888-9813-00d2cb1ff37a tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:53.502713 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b6de0fc9-06fb-4888-9813-00d2cb1ff37a tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] [instance: 7b12c52a-fc64-472b-8659-4e7312fcc83a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:14:53.509487 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-2f0b1f69-454c-44de-b5d7-98799d0a44bf tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:53.510439 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-2f0b1f69-454c-44de-b5d7-98799d0a44bf tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: ed0fdfd2-3506-40c4-8e4a-bb984e946fdd] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:14:53.516409 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b6de0fc9-06fb-4888-9813-00d2cb1ff37a tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:53.518831 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b6de0fc9-06fb-4888-9813-00d2cb1ff37a tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:53.521106 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b6de0fc9-06fb-4888-9813-00d2cb1ff37a tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:53.522406 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b6de0fc9-06fb-4888-9813-00d2cb1ff37a tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:53.526499 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2f0b1f69-454c-44de-b5d7-98799d0a44bf tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:53.527219 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2f0b1f69-454c-44de-b5d7-98799d0a44bf tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:53.528658 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2f0b1f69-454c-44de-b5d7-98799d0a44bf tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:53.529407 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2f0b1f69-454c-44de-b5d7-98799d0a44bf tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:53.650976 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b6de0fc9-06fb-4888-9813-00d2cb1ff37a tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a872dad882e4694aba20eaa8c06df53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457d184c579a4016a0eec16eb9f23195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:53.660759 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b6de0fc9-06fb-4888-9813-00d2cb1ff37a tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] 10.222.0.17 "GET /compute/v2.1/servers/7b12c52a-fc64-472b-8659-4e7312fcc83a" status: 200 len: 1270 microversion: 2.1 time: 0.164242 Jul 23 21:14:53.674681 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 194/445] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:14:53 2022] GET /compute/v2.1/servers/7b12c52a-fc64-472b-8659-4e7312fcc83a => generated 1270 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:14:53.686047 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-866a70ff-8b5e-4c64-bb46-c5348d174ebc tempest-FlavorsV2TestJSON-1397238601 tempest-FlavorsV2TestJSON-1397238601-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:53.698318 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-866a70ff-8b5e-4c64-bb46-c5348d174ebc tempest-FlavorsV2TestJSON-1397238601 tempest-FlavorsV2TestJSON-1397238601-project] 10.222.0.17 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.021953 Jul 23 21:14:53.699369 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 195/446] 10.222.0.17 () {58 vars in 1136 bytes} [Sat Jul 23 21:14:53 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:14:53.719068 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f0c42f48-df17-4e68-8776-86ad1153bbb2 tempest-FlavorsV2TestJSON-1397238601 tempest-FlavorsV2TestJSON-1397238601-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:53.747459 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f0c42f48-df17-4e68-8776-86ad1153bbb2 tempest-FlavorsV2TestJSON-1397238601 tempest-FlavorsV2TestJSON-1397238601-project] 10.222.0.17 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.038116 Jul 23 21:14:53.749583 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 196/447] 10.222.0.17 () {58 vars in 1136 bytes} [Sat Jul 23 21:14:53 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:14:53.787183 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2d0327bd-4df5-4ae6-9ca4-3208f827d3b5 tempest-FlavorsV2TestJSON-1397238601 tempest-FlavorsV2TestJSON-1397238601-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:53.885725 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2d0327bd-4df5-4ae6-9ca4-3208f827d3b5 tempest-FlavorsV2TestJSON-1397238601 tempest-FlavorsV2TestJSON-1397238601-project] 10.222.0.17 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.128681 Jul 23 21:14:53.909464 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 197/448] 10.222.0.17 () {58 vars in 1164 bytes} [Sat Jul 23 21:14:53 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:14:53.934697 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-074201ad-0cec-4ddd-9c8f-a53f37c7dc3a tempest-FlavorsV2TestJSON-1397238601 tempest-FlavorsV2TestJSON-1397238601-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:53.960457 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-074201ad-0cec-4ddd-9c8f-a53f37c7dc3a tempest-FlavorsV2TestJSON-1397238601 tempest-FlavorsV2TestJSON-1397238601-project] 10.222.0.17 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.029817 Jul 23 21:14:53.975720 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 198/449] 10.222.0.17 () {58 vars in 1136 bytes} [Sat Jul 23 21:14:53 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:14:53.992755 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-bbb56f5b-d292-4a74-8990-8750d8f50287 tempest-FlavorsV2TestJSON-1397238601 tempest-FlavorsV2TestJSON-1397238601-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:54.085632 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-bbb56f5b-d292-4a74-8990-8750d8f50287 tempest-FlavorsV2TestJSON-1397238601 tempest-FlavorsV2TestJSON-1397238601-project] 10.222.0.17 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.106841 Jul 23 21:14:54.098057 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 199/450] 10.222.0.17 () {58 vars in 1168 bytes} [Sat Jul 23 21:14:53 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:14:54.297226 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-2f0b1f69-454c-44de-b5d7-98799d0a44bf tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:54.309715 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-2f0b1f69-454c-44de-b5d7-98799d0a44bf tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:54.313428 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-2f0b1f69-454c-44de-b5d7-98799d0a44bf tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:54.314802 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-2f0b1f69-454c-44de-b5d7-98799d0a44bf tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/ed0fdfd2-3506-40c4-8e4a-bb984e946fdd" status: 200 len: 1361 microversion: 2.25 time: 0.820217 Jul 23 21:14:54.315428 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 252/451] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:14:53 2022] GET /compute/v2.1/servers/ed0fdfd2-3506-40c4-8e4a-bb984e946fdd => generated 1361 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:14:54.328866 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-3d69cfde-c623-4858-87bf-df37cc847c2d tempest-FlavorsV2TestJSON-1397238601 tempest-FlavorsV2TestJSON-1397238601-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:54.357071 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-3d69cfde-c623-4858-87bf-df37cc847c2d tempest-FlavorsV2TestJSON-1397238601 tempest-FlavorsV2TestJSON-1397238601-project] 10.222.0.17 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.040511 Jul 23 21:14:54.358046 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 253/452] 10.222.0.17 () {58 vars in 1160 bytes} [Sat Jul 23 21:14:54 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:14:54.370148 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-413b8a79-60c9-4a31-bccf-7a01f7ee8c81 tempest-FlavorsV2TestJSON-1397238601 tempest-FlavorsV2TestJSON-1397238601-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:54.391547 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-413b8a79-60c9-4a31-bccf-7a01f7ee8c81 tempest-FlavorsV2TestJSON-1397238601 tempest-FlavorsV2TestJSON-1397238601-project] 10.222.0.17 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.021009 Jul 23 21:14:54.401242 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 254/453] 10.222.0.17 () {58 vars in 1136 bytes} [Sat Jul 23 21:14:54 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:14:54.411154 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-37c6d3a4-a654-4fac-a510-f96e4cba9923 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:54.411854 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-37c6d3a4-a654-4fac-a510-f96e4cba9923 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 769ee4e5-e4df-4d4e-9f4c-6372c60d9e01] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:14:54.428818 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=3,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:54.440720 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-37c6d3a4-a654-4fac-a510-f96e4cba9923 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:54.442175 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-37c6d3a4-a654-4fac-a510-f96e4cba9923 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:54.443798 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-37c6d3a4-a654-4fac-a510-f96e4cba9923 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:54.444882 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-37c6d3a4-a654-4fac-a510-f96e4cba9923 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:54.649160 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-beb2ede7-2490-4946-a946-721f13bbfe15 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-544078427", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:14:54.737984 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-beb2ede7-2490-4946-a946-721f13bbfe15 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] validate_networks() for None {{(pid=131320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:14:55.097849 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-37c6d3a4-a654-4fac-a510-f96e4cba9923 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:55.115132 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-37c6d3a4-a654-4fac-a510-f96e4cba9923 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/769ee4e5-e4df-4d4e-9f4c-6372c60d9e01" status: 200 len: 1476 microversion: 2.1 time: 0.712534 Jul 23 21:14:55.116293 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 255/454] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:14:54 2022] GET /compute/v2.1/servers/769ee4e5-e4df-4d4e-9f4c-6372c60d9e01 => generated 1476 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:14:55.132867 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-81b91879-539c-4092-82e4-b0ba4fe7c66f tempest-FlavorsV2TestJSON-1397238601 tempest-FlavorsV2TestJSON-1397238601-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:55.224074 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-81b91879-539c-4092-82e4-b0ba4fe7c66f tempest-FlavorsV2TestJSON-1397238601 tempest-FlavorsV2TestJSON-1397238601-project] 10.222.0.17 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.104342 Jul 23 21:14:55.225783 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 256/455] 10.222.0.17 () {58 vars in 1166 bytes} [Sat Jul 23 21:14:55 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:14:55.237395 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-166eb8d4-5b03-4118-95df-9956ae07a8cf tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:55.240747 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-166eb8d4-5b03-4118-95df-9956ae07a8cf tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 965630ba-6832-46c9-8f42-7a9fed39e598] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:14:55.250177 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-166eb8d4-5b03-4118-95df-9956ae07a8cf tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:55.252320 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-166eb8d4-5b03-4118-95df-9956ae07a8cf tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:55.253394 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-166eb8d4-5b03-4118-95df-9956ae07a8cf tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:55.254093 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-166eb8d4-5b03-4118-95df-9956ae07a8cf tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:55.299848 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=100 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:55.397780 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-beb2ede7-2490-4946-a946-721f13bbfe15 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:14:55.398523 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-beb2ede7-2490-4946-a946-721f13bbfe15 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:14:55.399889 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-beb2ede7-2490-4946-a946-721f13bbfe15 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:14:55.400538 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-beb2ede7-2490-4946-a946-721f13bbfe15 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:14:55.401799 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-beb2ede7-2490-4946-a946-721f13bbfe15 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:14:55.415503 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-beb2ede7-2490-4946-a946-721f13bbfe15 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:55.416091 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-beb2ede7-2490-4946-a946-721f13bbfe15 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:55.417063 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-beb2ede7-2490-4946-a946-721f13bbfe15 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:55.417780 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-beb2ede7-2490-4946-a946-721f13bbfe15 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:55.440347 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:RELEASE=1,nova_api:SELECT=91,nova_api:INSERT=5,nova_api:DELETE=3 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:55.451072 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-beb2ede7-2490-4946-a946-721f13bbfe15 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Getting quotas for project fcf6363b1e154ff59ee30143aee3d4f1. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:14:55.458431 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-beb2ede7-2490-4946-a946-721f13bbfe15 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Getting quotas for user 90d3840d84f34ae5ba5d95b4c96847ba and project fcf6363b1e154ff59ee30143aee3d4f1. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:14:55.478687 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-beb2ede7-2490-4946-a946-721f13bbfe15 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Going to run 1 instances... {{(pid=131320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:14:55.483147 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-beb2ede7-2490-4946-a946-721f13bbfe15 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] [instance: 31f37ba7-d5b3-4b48-9261-47e337e06a86] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:14:55.565424 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-beb2ede7-2490-4946-a946-721f13bbfe15 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.460369 Jul 23 21:14:55.566385 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 200/456] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:14:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1467 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 23 21:14:55.579693 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-7aab1330-eec2-4327-ab24-680fb52d6dd0 req-8b74faec-4eb2-4368-934f-add5660a0bbd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed0fdfd2-3506-40c4-8e4a-bb984e946fdd", "tag": "1e9171bb-cfe1-4d9d-b4e2-14b9c65df29e"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:14:55.597307 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-7aab1330-eec2-4327-ab24-680fb52d6dd0 req-8b74faec-4eb2-4368-934f-add5660a0bbd service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:55.598074 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-7aab1330-eec2-4327-ab24-680fb52d6dd0 req-8b74faec-4eb2-4368-934f-add5660a0bbd service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:55.647173 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-7aab1330-eec2-4327-ab24-680fb52d6dd0 req-8b74faec-4eb2-4368-934f-add5660a0bbd service nova] Creating event network-changed:1e9171bb-cfe1-4d9d-b4e2-14b9c65df29e for instance ed0fdfd2-3506-40c4-8e4a-bb984e946fdd on nch2-master-1 Jul 23 21:14:55.660440 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-7aab1330-eec2-4327-ab24-680fb52d6dd0 req-8b74faec-4eb2-4368-934f-add5660a0bbd service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085141 Jul 23 21:14:55.661324 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 201/457] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:14:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:14:55.665725 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-166eb8d4-5b03-4118-95df-9956ae07a8cf tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:55.673261 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2e8ddafc-a4fa-4f5a-a215-d308ef2b98f7 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:55.673747 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-166eb8d4-5b03-4118-95df-9956ae07a8cf tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/965630ba-6832-46c9-8f42-7a9fed39e598" status: 200 len: 1503 microversion: 2.1 time: 0.446535 Jul 23 21:14:55.674094 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-2e8ddafc-a4fa-4f5a-a215-d308ef2b98f7 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] [instance: 7b12c52a-fc64-472b-8659-4e7312fcc83a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:14:55.677057 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 257/458] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:14:55 2022] GET /compute/v2.1/servers/965630ba-6832-46c9-8f42-7a9fed39e598 => generated 1503 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:14:55.715008 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2e8ddafc-a4fa-4f5a-a215-d308ef2b98f7 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:55.720401 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2e8ddafc-a4fa-4f5a-a215-d308ef2b98f7 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:55.721375 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2e8ddafc-a4fa-4f5a-a215-d308ef2b98f7 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:55.724952 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2e8ddafc-a4fa-4f5a-a215-d308ef2b98f7 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:55.865574 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-2e8ddafc-a4fa-4f5a-a215-d308ef2b98f7 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a872dad882e4694aba20eaa8c06df53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457d184c579a4016a0eec16eb9f23195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:55.882189 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2e8ddafc-a4fa-4f5a-a215-d308ef2b98f7 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] 10.222.0.17 "GET /compute/v2.1/servers/7b12c52a-fc64-472b-8659-4e7312fcc83a" status: 200 len: 1276 microversion: 2.1 time: 0.216302 Jul 23 21:14:55.886086 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 202/459] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:14:55 2022] GET /compute/v2.1/servers/7b12c52a-fc64-472b-8659-4e7312fcc83a => generated 1276 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:14:55.908121 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3f9edfa5-8985-4c0b-a4d7-1cd6154683f0 tempest-FlavorsV2TestJSON-1397238601 tempest-FlavorsV2TestJSON-1397238601-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:55.943870 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-3f9edfa5-8985-4c0b-a4d7-1cd6154683f0 tempest-FlavorsV2TestJSON-1397238601 tempest-FlavorsV2TestJSON-1397238601-project] 10.222.0.17 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.046704 Jul 23 21:14:55.945063 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 203/460] 10.222.0.17 () {58 vars in 1136 bytes} [Sat Jul 23 21:14:55 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:14:55.952240 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3c07cf88-0dc4-4184-9c09-38c319039e13 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:55.953093 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-3c07cf88-0dc4-4184-9c09-38c319039e13 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: ed0fdfd2-3506-40c4-8e4a-bb984e946fdd] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:14:55.962274 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3c07cf88-0dc4-4184-9c09-38c319039e13 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:55.962958 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3c07cf88-0dc4-4184-9c09-38c319039e13 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:55.963938 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3c07cf88-0dc4-4184-9c09-38c319039e13 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:55.965182 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3c07cf88-0dc4-4184-9c09-38c319039e13 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:56.106695 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-be779afe-2506-40ae-a82c-a7c2dc1a3839 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:56.128011 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-be779afe-2506-40ae-a82c-a7c2dc1a3839 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] 10.222.0.17 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.449780 Jul 23 21:14:56.128623 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 258/461] 10.222.0.17 () {58 vars in 1136 bytes} [Sat Jul 23 21:14:55 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:14:56.150374 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c172fcd7-cf97-4778-9024-5a4c54c9a478 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:56.154046 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-c172fcd7-cf97-4778-9024-5a4c54c9a478 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] [instance: 31f37ba7-d5b3-4b48-9261-47e337e06a86] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:14:56.278663 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c172fcd7-cf97-4778-9024-5a4c54c9a478 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d3840d84f34ae5ba5d95b4c96847ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf6363b1e154ff59ee30143aee3d4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:56.295875 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-c172fcd7-cf97-4778-9024-5a4c54c9a478 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] 10.222.0.17 "GET /compute/v2.1/servers/31f37ba7-d5b3-4b48-9261-47e337e06a86" status: 200 len: 1222 microversion: 2.1 time: 0.156628 Jul 23 21:14:56.304689 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 259/462] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:14:56 2022] GET /compute/v2.1/servers/31f37ba7-d5b3-4b48-9261-47e337e06a86 => generated 1222 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:14:56.333345 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-0f51208b-d3dc-4e9a-97c2-7b9cb556d345 req-d33c9249-303c-4fbc-9fda-55885b78622b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "965630ba-6832-46c9-8f42-7a9fed39e598", "name": "network-vif-unplugged", "status": "completed", "tag": "93e984c6-69bf-434e-b812-af74ab1347d8"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:14:56.356930 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-0f51208b-d3dc-4e9a-97c2-7b9cb556d345 req-d33c9249-303c-4fbc-9fda-55885b78622b service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:56.357613 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-0f51208b-d3dc-4e9a-97c2-7b9cb556d345 req-d33c9249-303c-4fbc-9fda-55885b78622b service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:56.388888 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-0f51208b-d3dc-4e9a-97c2-7b9cb556d345 req-d33c9249-303c-4fbc-9fda-55885b78622b service nova] Creating event network-vif-unplugged:93e984c6-69bf-434e-b812-af74ab1347d8 for instance 965630ba-6832-46c9-8f42-7a9fed39e598 on nch1-master-1 Jul 23 21:14:56.419085 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-0f51208b-d3dc-4e9a-97c2-7b9cb556d345 req-d33c9249-303c-4fbc-9fda-55885b78622b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.107415 Jul 23 21:14:56.422274 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 260/463] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:14:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:14:56.434832 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-887c96dd-59e4-496f-b37f-4864a6d888bd tempest-FlavorsV2TestJSON-1397238601 tempest-FlavorsV2TestJSON-1397238601-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:56.492493 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-3c07cf88-0dc4-4184-9c09-38c319039e13 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:56.502818 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-3c07cf88-0dc4-4184-9c09-38c319039e13 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:56.517283 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-3c07cf88-0dc4-4184-9c09-38c319039e13 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:56.518637 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-3c07cf88-0dc4-4184-9c09-38c319039e13 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/ed0fdfd2-3506-40c4-8e4a-bb984e946fdd" status: 200 len: 1361 microversion: 2.25 time: 0.572292 Jul 23 21:14:56.519246 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 204/464] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:14:55 2022] GET /compute/v2.1/servers/ed0fdfd2-3506-40c4-8e4a-bb984e946fdd => generated 1361 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:14:56.530174 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-7a05dac8-359f-41bd-8b8a-a589b449297f tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:56.530795 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-7a05dac8-359f-41bd-8b8a-a589b449297f tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 769ee4e5-e4df-4d4e-9f4c-6372c60d9e01] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:14:56.541346 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-887c96dd-59e4-496f-b37f-4864a6d888bd tempest-FlavorsV2TestJSON-1397238601 tempest-FlavorsV2TestJSON-1397238601-project] 10.222.0.17 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.117010 Jul 23 21:14:56.544379 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 261/465] 10.222.0.17 () {58 vars in 1143 bytes} [Sat Jul 23 21:14:56 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:14:56.568019 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7a05dac8-359f-41bd-8b8a-a589b449297f tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:56.570174 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7a05dac8-359f-41bd-8b8a-a589b449297f tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:56.573362 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7a05dac8-359f-41bd-8b8a-a589b449297f tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:56.589198 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7a05dac8-359f-41bd-8b8a-a589b449297f tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:57.123270 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-4d252fe0-f4bf-484d-8420-d5c46e739b4f tempest-ServersWithSpecificFlavorTestJSON-1083796490 tempest-ServersWithSpecificFlavorTestJSON-1083796490-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-1894524836", "id": 231097847, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:14:57.131924 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:57.131924 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:14:57.162467 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-4d252fe0-f4bf-484d-8420-d5c46e739b4f tempest-ServersWithSpecificFlavorTestJSON-1083796490 tempest-ServersWithSpecificFlavorTestJSON-1083796490-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 422 microversion: 2.1 time: 0.616666 Jul 23 21:14:57.163914 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 262/466] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:14:56 2022] POST /compute/v2.1/flavors => generated 422 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:14:57.164747 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-7a05dac8-359f-41bd-8b8a-a589b449297f tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:57.170879 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-602fd0c4-a7a5-462b-98e4-4405a0c0b4b2 tempest-FlavorsV2TestJSON-1397238601 tempest-FlavorsV2TestJSON-1397238601-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:57.181549 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-7a05dac8-359f-41bd-8b8a-a589b449297f tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/769ee4e5-e4df-4d4e-9f4c-6372c60d9e01" status: 200 len: 1476 microversion: 2.1 time: 0.654168 Jul 23 21:14:57.186733 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 205/467] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:14:56 2022] GET /compute/v2.1/servers/769ee4e5-e4df-4d4e-9f4c-6372c60d9e01 => generated 1476 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:14:57.192720 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-40b3eae6-d023-425f-ae6d-5e694e7a05f3 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:57.193481 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-602fd0c4-a7a5-462b-98e4-4405a0c0b4b2 tempest-FlavorsV2TestJSON-1397238601 tempest-FlavorsV2TestJSON-1397238601-project] 10.222.0.17 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.027452 Jul 23 21:14:57.194730 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-40b3eae6-d023-425f-ae6d-5e694e7a05f3 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 965630ba-6832-46c9-8f42-7a9fed39e598] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:14:57.200181 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 263/468] 10.222.0.17 () {58 vars in 1136 bytes} [Sat Jul 23 21:14:57 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:14:57.207824 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-40b3eae6-d023-425f-ae6d-5e694e7a05f3 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:57.208478 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-40b3eae6-d023-425f-ae6d-5e694e7a05f3 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:57.209476 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-40b3eae6-d023-425f-ae6d-5e694e7a05f3 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:57.210141 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-40b3eae6-d023-425f-ae6d-5e694e7a05f3 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:57.210271 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-fa13f492-e48d-4268-a142-d88094e0ac1e tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:57.211970 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-fa13f492-e48d-4268-a142-d88094e0ac1e tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] [instance: 7b12c52a-fc64-472b-8659-4e7312fcc83a] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:14:57.227675 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fa13f492-e48d-4268-a142-d88094e0ac1e tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:57.228138 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fa13f492-e48d-4268-a142-d88094e0ac1e tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:57.228957 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fa13f492-e48d-4268-a142-d88094e0ac1e tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:57.229408 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fa13f492-e48d-4268-a142-d88094e0ac1e tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:57.526098 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-40b3eae6-d023-425f-ae6d-5e694e7a05f3 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:57.538486 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-40b3eae6-d023-425f-ae6d-5e694e7a05f3 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/965630ba-6832-46c9-8f42-7a9fed39e598" status: 200 len: 1503 microversion: 2.1 time: 0.348502 Jul 23 21:14:57.541069 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 206/469] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:14:57 2022] GET /compute/v2.1/servers/965630ba-6832-46c9-8f42-7a9fed39e598 => generated 1503 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:14:57.552636 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2b7ea0ec-65b5-44f0-9999-2f99a698145a tempest-ServersWithSpecificFlavorTestJSON-1083796490 tempest-ServersWithSpecificFlavorTestJSON-1083796490-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:57.571957 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2b7ea0ec-65b5-44f0-9999-2f99a698145a tempest-ServersWithSpecificFlavorTestJSON-1083796490 tempest-ServersWithSpecificFlavorTestJSON-1083796490-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.029736 Jul 23 21:14:57.572808 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 207/470] 10.222.0.17 () {58 vars in 1181 bytes} [Sat Jul 23 21:14:57 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 23 21:14:57.588754 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b35c09d5-2541-4916-998f-9f15bd4643f3 tempest-FlavorsV2TestJSON-1397238601 tempest-FlavorsV2TestJSON-1397238601-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:57.620908 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b35c09d5-2541-4916-998f-9f15bd4643f3 tempest-FlavorsV2TestJSON-1397238601 tempest-FlavorsV2TestJSON-1397238601-project] 10.222.0.17 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.042655 Jul 23 21:14:57.628268 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 208/471] 10.222.0.17 () {58 vars in 1147 bytes} [Sat Jul 23 21:14:57 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:14:57.643110 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a52062c4-2fb1-40af-aac9-e9f912810185 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:57.644225 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a52062c4-2fb1-40af-aac9-e9f912810185 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] [instance: 31f37ba7-d5b3-4b48-9261-47e337e06a86] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:14:57.656460 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a52062c4-2fb1-40af-aac9-e9f912810185 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:57.656910 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a52062c4-2fb1-40af-aac9-e9f912810185 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:57.657700 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a52062c4-2fb1-40af-aac9-e9f912810185 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:57.663566 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a52062c4-2fb1-40af-aac9-e9f912810185 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:57.792861 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a52062c4-2fb1-40af-aac9-e9f912810185 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d3840d84f34ae5ba5d95b4c96847ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf6363b1e154ff59ee30143aee3d4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:57.796541 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:57.803900 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a52062c4-2fb1-40af-aac9-e9f912810185 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] 10.222.0.17 "GET /compute/v2.1/servers/31f37ba7-d5b3-4b48-9261-47e337e06a86" status: 200 len: 1282 microversion: 2.1 time: 0.173582 Jul 23 21:14:57.804841 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 209/472] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:14:57 2022] GET /compute/v2.1/servers/31f37ba7-d5b3-4b48-9261-47e337e06a86 => generated 1282 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:14:57.827582 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-998d3f62-4ba6-47ad-a24e-937d52bd067c tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:57.828197 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-998d3f62-4ba6-47ad-a24e-937d52bd067c tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: ed0fdfd2-3506-40c4-8e4a-bb984e946fdd] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:14:57.849768 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-998d3f62-4ba6-47ad-a24e-937d52bd067c tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:57.851711 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-998d3f62-4ba6-47ad-a24e-937d52bd067c tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:57.854504 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-998d3f62-4ba6-47ad-a24e-937d52bd067c tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:57.854969 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-998d3f62-4ba6-47ad-a24e-937d52bd067c tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:58.149039 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-998d3f62-4ba6-47ad-a24e-937d52bd067c tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:58.163733 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-998d3f62-4ba6-47ad-a24e-937d52bd067c tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:58.172258 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-998d3f62-4ba6-47ad-a24e-937d52bd067c tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:58.174206 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-998d3f62-4ba6-47ad-a24e-937d52bd067c tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/ed0fdfd2-3506-40c4-8e4a-bb984e946fdd" status: 200 len: 1361 microversion: 2.25 time: 0.368158 Jul 23 21:14:58.176459 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 210/473] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:14:57 2022] GET /compute/v2.1/servers/ed0fdfd2-3506-40c4-8e4a-bb984e946fdd => generated 1361 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:14:58.182092 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1073acba-b1b0-4149-b9df-d26fcafbd91a tempest-ServersWithSpecificFlavorTestJSON-1083796490 tempest-ServersWithSpecificFlavorTestJSON-1083796490-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-2026299024", "id": 1416912473, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:14:58.182535 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-fa13f492-e48d-4268-a142-d88094e0ac1e tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a872dad882e4694aba20eaa8c06df53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457d184c579a4016a0eec16eb9f23195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:58.184676 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:58.184676 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:14:58.210725 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1073acba-b1b0-4149-b9df-d26fcafbd91a tempest-ServersWithSpecificFlavorTestJSON-1083796490 tempest-ServersWithSpecificFlavorTestJSON-1083796490-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.029962 Jul 23 21:14:58.210725 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 211/474] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:14:58 2022] POST /compute/v2.1/flavors => generated 425 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:14:58.216096 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-fa13f492-e48d-4268-a142-d88094e0ac1e tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] 10.222.0.17 "GET /compute/v2.1/servers/7b12c52a-fc64-472b-8659-4e7312fcc83a" status: 200 len: 1318 microversion: 2.1 time: 1.014522 Jul 23 21:14:58.216999 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 264/475] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:14:57 2022] GET /compute/v2.1/servers/7b12c52a-fc64-472b-8659-4e7312fcc83a => generated 1318 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:14:58.228833 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-7786fff1-e3d8-4916-b2e7-c9f6c05714d3 tempest-FlavorsV2TestJSON-1397238601 tempest-FlavorsV2TestJSON-1397238601-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:58.230290 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-6f124cc6-011d-4bc4-a588-ba607925b72e tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:58.232047 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-6f124cc6-011d-4bc4-a588-ba607925b72e tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 769ee4e5-e4df-4d4e-9f4c-6372c60d9e01] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:14:58.241516 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-7786fff1-e3d8-4916-b2e7-c9f6c05714d3 tempest-FlavorsV2TestJSON-1397238601 tempest-FlavorsV2TestJSON-1397238601-project] 10.222.0.17 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.025942 Jul 23 21:14:58.250545 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 212/476] 10.222.0.17 () {58 vars in 1139 bytes} [Sat Jul 23 21:14:58 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:14:58.251340 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6f124cc6-011d-4bc4-a588-ba607925b72e tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:58.251340 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6f124cc6-011d-4bc4-a588-ba607925b72e tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:58.251340 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6f124cc6-011d-4bc4-a588-ba607925b72e tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:58.251340 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6f124cc6-011d-4bc4-a588-ba607925b72e tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:58.401229 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a3217cab-97d5-4610-9817-195f24e256da tempest-QuotaClassesAdminTestJSON-1737895607 tempest-QuotaClassesAdminTestJSON-1737895607-project-admin] Calling method '.version_select at 0x7f0b47ec13a0>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:58.402074 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:58.402074 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:14:58.416268 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a3217cab-97d5-4610-9817-195f24e256da tempest-QuotaClassesAdminTestJSON-1737895607 tempest-QuotaClassesAdminTestJSON-1737895607-project-admin] 10.222.0.17 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.172810 Jul 23 21:14:58.417073 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 213/477] 10.222.0.17 () {58 vars in 1184 bytes} [Sat Jul 23 21:14:58 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:14:58.421635 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3fe82c22-c332-4aa4-8def-3b66c09dcb3a tempest-ServersWithSpecificFlavorTestJSON-1083796490 tempest-ServersWithSpecificFlavorTestJSON-1083796490-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:58.432046 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-3fe82c22-c332-4aa4-8def-3b66c09dcb3a tempest-ServersWithSpecificFlavorTestJSON-1083796490 tempest-ServersWithSpecificFlavorTestJSON-1083796490-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.013906 Jul 23 21:14:58.432959 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 214/478] 10.222.0.17 () {58 vars in 1181 bytes} [Sat Jul 23 21:14:58 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 23 21:14:58.438122 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d3563eb5-8d43-47e4-903f-5fcaaa94afe3 tempest-FlavorsV2TestJSON-1397238601 tempest-FlavorsV2TestJSON-1397238601-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:58.446878 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d3563eb5-8d43-47e4-903f-5fcaaa94afe3 tempest-FlavorsV2TestJSON-1397238601 tempest-FlavorsV2TestJSON-1397238601-project] 10.222.0.17 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012722 Jul 23 21:14:58.447462 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 215/479] 10.222.0.17 () {58 vars in 1136 bytes} [Sat Jul 23 21:14:58 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:14:58.451949 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-36ca56fe-229a-4d60-b1e9-f0cb9443da0f tempest-QuotaClassesAdminTestJSON-1737895607 tempest-QuotaClassesAdminTestJSON-1737895607-project-admin] Action: 'update', calling method: .version_select at 0x7f0b47ec1820>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:14:58.453700 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:58.453700 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:14:58.759446 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=15,nova_api:UPDATE=12 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:14:58.783831 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-6f124cc6-011d-4bc4-a588-ba607925b72e tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:58.792285 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-6f124cc6-011d-4bc4-a588-ba607925b72e tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/769ee4e5-e4df-4d4e-9f4c-6372c60d9e01" status: 200 len: 1476 microversion: 2.1 time: 0.574212 Jul 23 21:14:58.793097 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 265/480] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:14:58 2022] GET /compute/v2.1/servers/769ee4e5-e4df-4d4e-9f4c-6372c60d9e01 => generated 1476 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:14:58.799107 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-63550275-1110-4260-95c2-aa8e91259a9d tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Action: 'create', calling method: .version_select at 0x7f0b5462bb80>, body: {"keypair": {"name": "tempest-keypair-69753320", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDxqMbkDYaFJgjbOV9HcVdrU8JlZt4B4RGpr03ctGcJ9TM/iUEimjSYV7eS2sfo7SI75+9NHY7bHQoozm1yeLTjMi93znFUyfXOVJOrypYaehsP+GSBnM6W7DFNqbmBbjA=="}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:14:58.816509 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-36ca56fe-229a-4d60-b1e9-f0cb9443da0f tempest-QuotaClassesAdminTestJSON-1737895607 tempest-QuotaClassesAdminTestJSON-1737895607-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.366359 Jul 23 21:14:58.822291 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 216/481] 10.222.0.17 () {60 vars in 1205 bytes} [Sat Jul 23 21:14:58 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:14:58.825792 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-63550275-1110-4260-95c2-aa8e91259a9d tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Getting quotas for project d3c17bd813264fb9891076799e33acca. Resources: {'key_pairs'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:14:58.827490 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-45fbc715-0817-49b9-a9f2-7a9387a9699b tempest-FlavorsV2TestJSON-1397238601 tempest-FlavorsV2TestJSON-1397238601-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:58.835881 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-63550275-1110-4260-95c2-aa8e91259a9d tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Getting quotas for user 39f1a14a59b7401d88f18ec35c91e30a and project d3c17bd813264fb9891076799e33acca. Resources: {'key_pairs'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:14:58.877962 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-63550275-1110-4260-95c2-aa8e91259a9d tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.083589 Jul 23 21:14:58.879237 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 266/482] 10.222.0.17 () {60 vars in 1158 bytes} [Sat Jul 23 21:14:58 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:14:58.890064 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-6306464b-fa47-4480-8dc1-3c638d9cd838 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:58.892073 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-6306464b-fa47-4480-8dc1-3c638d9cd838 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 965630ba-6832-46c9-8f42-7a9fed39e598] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:14:58.909596 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6306464b-fa47-4480-8dc1-3c638d9cd838 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:58.910484 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6306464b-fa47-4480-8dc1-3c638d9cd838 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:58.911520 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6306464b-fa47-4480-8dc1-3c638d9cd838 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:58.912138 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6306464b-fa47-4480-8dc1-3c638d9cd838 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:58.914724 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-45fbc715-0817-49b9-a9f2-7a9387a9699b tempest-FlavorsV2TestJSON-1397238601 tempest-FlavorsV2TestJSON-1397238601-project] 10.222.0.17 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.095420 Jul 23 21:14:58.919244 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 217/483] 10.222.0.17 () {58 vars in 1145 bytes} [Sat Jul 23 21:14:58 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:14:58.935521 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2e1eed04-74a7-4897-9376-395ca6f7736c tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:58.936810 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-2e1eed04-74a7-4897-9376-395ca6f7736c tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] [instance: 31f37ba7-d5b3-4b48-9261-47e337e06a86] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:14:58.961187 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2e1eed04-74a7-4897-9376-395ca6f7736c tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:58.962513 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2e1eed04-74a7-4897-9376-395ca6f7736c tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:58.963335 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2e1eed04-74a7-4897-9376-395ca6f7736c tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:58.964371 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2e1eed04-74a7-4897-9376-395ca6f7736c tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:59.052115 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-2e1eed04-74a7-4897-9376-395ca6f7736c tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d3840d84f34ae5ba5d95b4c96847ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf6363b1e154ff59ee30143aee3d4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:59.060682 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2e1eed04-74a7-4897-9376-395ca6f7736c tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] 10.222.0.17 "GET /compute/v2.1/servers/31f37ba7-d5b3-4b48-9261-47e337e06a86" status: 200 len: 1280 microversion: 2.1 time: 0.140060 Jul 23 21:14:59.070031 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 218/484] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:14:58 2022] GET /compute/v2.1/servers/31f37ba7-d5b3-4b48-9261-47e337e06a86 => generated 1280 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:14:59.075342 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c925c414-cc44-4c31-9264-d730c95fcbc9 tempest-QuotaClassesAdminTestJSON-1737895607 tempest-QuotaClassesAdminTestJSON-1737895607-project-admin] Calling method '.version_select at 0x7f0b47f380d0>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:59.076202 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:59.076202 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:14:59.087963 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c925c414-cc44-4c31-9264-d730c95fcbc9 tempest-QuotaClassesAdminTestJSON-1737895607 tempest-QuotaClassesAdminTestJSON-1737895607-project-admin] 10.222.0.17 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.016681 Jul 23 21:14:59.088741 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 219/485] 10.222.0.17 () {58 vars in 1184 bytes} [Sat Jul 23 21:14:59 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:14:59.098762 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5d1946f6-cb63-4650-bd7c-932adc75f983 tempest-FlavorsV2TestJSON-1397238601 tempest-FlavorsV2TestJSON-1397238601-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:59.145570 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5d1946f6-cb63-4650-bd7c-932adc75f983 tempest-FlavorsV2TestJSON-1397238601 tempest-FlavorsV2TestJSON-1397238601-project] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.055747 Jul 23 21:14:59.158639 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 220/486] 10.222.0.17 () {58 vars in 1145 bytes} [Sat Jul 23 21:14:59 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:14:59.164753 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b4188dc4-7f8b-47a4-9ee9-df47bf6aef08 tempest-QuotaClassesAdminTestJSON-1737895607 tempest-QuotaClassesAdminTestJSON-1737895607-project-admin] Action: 'update', calling method: .version_select at 0x7f0b47f34f70>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:14:59.166476 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:14:59.166476 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:14:59.294254 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-6306464b-fa47-4480-8dc1-3c638d9cd838 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:59.316205 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-6306464b-fa47-4480-8dc1-3c638d9cd838 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/965630ba-6832-46c9-8f42-7a9fed39e598" status: 200 len: 1503 microversion: 2.1 time: 0.434688 Jul 23 21:14:59.317772 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 267/487] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:14:58 2022] GET /compute/v2.1/servers/965630ba-6832-46c9-8f42-7a9fed39e598 => generated 1503 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:14:59.338013 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d05d4daf-6fee-483e-92b9-c8c97ddc4a8b tempest-FlavorsV2TestJSON-1397238601 tempest-FlavorsV2TestJSON-1397238601-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:59.351433 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-d05d4daf-6fee-483e-92b9-c8c97ddc4a8b tempest-FlavorsV2TestJSON-1397238601 tempest-FlavorsV2TestJSON-1397238601-project] 10.222.0.17 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.031718 Jul 23 21:14:59.352430 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 268/488] 10.222.0.17 () {58 vars in 1136 bytes} [Sat Jul 23 21:14:59 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:14:59.363959 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f676b322-5c3b-4d8f-a2a8-a5fe9b60898c tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:59.364958 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-f676b322-5c3b-4d8f-a2a8-a5fe9b60898c tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: ed0fdfd2-3506-40c4-8e4a-bb984e946fdd] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:14:59.379313 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f676b322-5c3b-4d8f-a2a8-a5fe9b60898c tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:59.381184 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f676b322-5c3b-4d8f-a2a8-a5fe9b60898c tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:59.382357 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f676b322-5c3b-4d8f-a2a8-a5fe9b60898c tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:59.383313 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f676b322-5c3b-4d8f-a2a8-a5fe9b60898c tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:59.421646 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b4188dc4-7f8b-47a4-9ee9-df47bf6aef08 tempest-QuotaClassesAdminTestJSON-1737895607 tempest-QuotaClassesAdminTestJSON-1737895607-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.260756 Jul 23 21:14:59.437599 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 221/489] 10.222.0.17 () {60 vars in 1205 bytes} [Sat Jul 23 21:14:59 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:14:59.451267 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-113f9d8a-815f-4f44-9539-3c9ee2f07c20 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:59.454357 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-113f9d8a-815f-4f44-9539-3c9ee2f07c20 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] [instance: 7b12c52a-fc64-472b-8659-4e7312fcc83a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:14:59.480089 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-113f9d8a-815f-4f44-9539-3c9ee2f07c20 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:59.482864 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-113f9d8a-815f-4f44-9539-3c9ee2f07c20 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:59.484669 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-113f9d8a-815f-4f44-9539-3c9ee2f07c20 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:59.485136 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-113f9d8a-815f-4f44-9539-3c9ee2f07c20 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:59.914052 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-113f9d8a-815f-4f44-9539-3c9ee2f07c20 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a872dad882e4694aba20eaa8c06df53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457d184c579a4016a0eec16eb9f23195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:14:59.921782 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-113f9d8a-815f-4f44-9539-3c9ee2f07c20 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] 10.222.0.17 "GET /compute/v2.1/servers/7b12c52a-fc64-472b-8659-4e7312fcc83a" status: 200 len: 1318 microversion: 2.1 time: 0.481435 Jul 23 21:14:59.938043 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 222/490] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:14:59 2022] GET /compute/v2.1/servers/7b12c52a-fc64-472b-8659-4e7312fcc83a => generated 1318 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:14:59.950342 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-32492e09-bf32-40c0-9af0-ae65151b7c4a tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:14:59.953256 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-32492e09-bf32-40c0-9af0-ae65151b7c4a tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 769ee4e5-e4df-4d4e-9f4c-6372c60d9e01] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:14:59.982352 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-32492e09-bf32-40c0-9af0-ae65151b7c4a tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:59.982715 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-32492e09-bf32-40c0-9af0-ae65151b7c4a tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:14:59.983494 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-32492e09-bf32-40c0-9af0-ae65151b7c4a tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:14:59.983945 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-32492e09-bf32-40c0-9af0-ae65151b7c4a tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:00.164992 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-f676b322-5c3b-4d8f-a2a8-a5fe9b60898c tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:00.184738 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-f676b322-5c3b-4d8f-a2a8-a5fe9b60898c tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:00.186280 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-f676b322-5c3b-4d8f-a2a8-a5fe9b60898c tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:00.187422 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-f676b322-5c3b-4d8f-a2a8-a5fe9b60898c tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/ed0fdfd2-3506-40c4-8e4a-bb984e946fdd" status: 200 len: 1361 microversion: 2.25 time: 0.833758 Jul 23 21:15:00.203799 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 269/491] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:14:59 2022] GET /compute/v2.1/servers/ed0fdfd2-3506-40c4-8e4a-bb984e946fdd => generated 1361 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:15:00.209026 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-6c1aaeb7-b838-4f28-b266-677238d16217 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:00.209697 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-6c1aaeb7-b838-4f28-b266-677238d16217 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] [instance: 31f37ba7-d5b3-4b48-9261-47e337e06a86] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:00.227111 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6c1aaeb7-b838-4f28-b266-677238d16217 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:00.227560 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6c1aaeb7-b838-4f28-b266-677238d16217 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:00.228343 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6c1aaeb7-b838-4f28-b266-677238d16217 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:00.228780 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6c1aaeb7-b838-4f28-b266-677238d16217 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:00.389159 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-32492e09-bf32-40c0-9af0-ae65151b7c4a tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:00.397267 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-32492e09-bf32-40c0-9af0-ae65151b7c4a tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/769ee4e5-e4df-4d4e-9f4c-6372c60d9e01" status: 200 len: 1476 microversion: 2.1 time: 0.458013 Jul 23 21:15:00.401099 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-6c1aaeb7-b838-4f28-b266-677238d16217 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d3840d84f34ae5ba5d95b4c96847ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf6363b1e154ff59ee30143aee3d4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:00.410678 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-6c1aaeb7-b838-4f28-b266-677238d16217 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] 10.222.0.17 "GET /compute/v2.1/servers/31f37ba7-d5b3-4b48-9261-47e337e06a86" status: 200 len: 1280 microversion: 2.1 time: 0.205570 Jul 23 21:15:00.411599 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 223/492] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:14:59 2022] GET /compute/v2.1/servers/769ee4e5-e4df-4d4e-9f4c-6372c60d9e01 => generated 1476 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:00.417344 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9eb8c547-cf7c-4af7-b8d3-3cefd8d5b2bc tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:00.427891 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 270/493] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:00 2022] GET /compute/v2.1/servers/31f37ba7-d5b3-4b48-9261-47e337e06a86 => generated 1280 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:00.429337 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-9eb8c547-cf7c-4af7-b8d3-3cefd8d5b2bc tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 965630ba-6832-46c9-8f42-7a9fed39e598] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:00.436666 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9eb8c547-cf7c-4af7-b8d3-3cefd8d5b2bc tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:00.437977 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9eb8c547-cf7c-4af7-b8d3-3cefd8d5b2bc tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:00.439318 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9eb8c547-cf7c-4af7-b8d3-3cefd8d5b2bc tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:00.440003 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9eb8c547-cf7c-4af7-b8d3-3cefd8d5b2bc tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:00.738140 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-74da8d67-7726-4a10-8c40-0ac324438545 req-a49f5dfb-60e7-4672-97cb-f7270de14646 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b12c52a-fc64-472b-8659-4e7312fcc83a", "tag": "b40a2ef2-d21e-4032-85d7-9361b81fcc6a"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:15:00.774055 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-74da8d67-7726-4a10-8c40-0ac324438545 req-a49f5dfb-60e7-4672-97cb-f7270de14646 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:00.774773 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-74da8d67-7726-4a10-8c40-0ac324438545 req-a49f5dfb-60e7-4672-97cb-f7270de14646 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:00.795588 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-74da8d67-7726-4a10-8c40-0ac324438545 req-a49f5dfb-60e7-4672-97cb-f7270de14646 service nova] Creating event network-changed:b40a2ef2-d21e-4032-85d7-9361b81fcc6a for instance 7b12c52a-fc64-472b-8659-4e7312fcc83a on nch2-master-1 Jul 23 21:15:00.808558 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-74da8d67-7726-4a10-8c40-0ac324438545 req-a49f5dfb-60e7-4672-97cb-f7270de14646 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088723 Jul 23 21:15:00.809659 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 271/494] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:15:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:15:00.826895 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-9eb8c547-cf7c-4af7-b8d3-3cefd8d5b2bc tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:00.836500 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9eb8c547-cf7c-4af7-b8d3-3cefd8d5b2bc tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/965630ba-6832-46c9-8f42-7a9fed39e598" status: 200 len: 1493 microversion: 2.1 time: 0.423542 Jul 23 21:15:00.858329 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 224/495] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:00 2022] GET /compute/v2.1/servers/965630ba-6832-46c9-8f42-7a9fed39e598 => generated 1493 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:00.884441 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-89e6b202-c432-4a9c-a629-d6a2061adf48 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Calling method '.version_select at 0x7f0b545bfee0>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:00.895277 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-89e6b202-c432-4a9c-a629-d6a2061adf48 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:00.895740 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-89e6b202-c432-4a9c-a629-d6a2061adf48 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:00.944678 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-bdada4c8-09f7-45b1-b4f6-ee71201cf842 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:00.947968 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-89e6b202-c432-4a9c-a629-d6a2061adf48 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] 10.222.0.17 "GET /compute/v2.1/os-migrations" status: 200 len: 791 microversion: 2.1 time: 0.087433 Jul 23 21:15:00.949264 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 272/496] 10.222.0.17 () {58 vars in 1142 bytes} [Sat Jul 23 21:15:00 2022] GET /compute/v2.1/os-migrations => generated 791 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:15:00.951650 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-bdada4c8-09f7-45b1-b4f6-ee71201cf842 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] [instance: 7b12c52a-fc64-472b-8659-4e7312fcc83a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:00.970808 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bdada4c8-09f7-45b1-b4f6-ee71201cf842 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:00.971269 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bdada4c8-09f7-45b1-b4f6-ee71201cf842 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:00.972068 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bdada4c8-09f7-45b1-b4f6-ee71201cf842 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:00.974466 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-9a6e80fe-fa29-4247-a3e0-fdde580482a8 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:00.975373 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-9a6e80fe-fa29-4247-a3e0-fdde580482a8 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] [instance: 965630ba-6832-46c9-8f42-7a9fed39e598] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:00.975944 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bdada4c8-09f7-45b1-b4f6-ee71201cf842 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:00.999059 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9a6e80fe-fa29-4247-a3e0-fdde580482a8 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:00.999363 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9a6e80fe-fa29-4247-a3e0-fdde580482a8 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:01.000336 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9a6e80fe-fa29-4247-a3e0-fdde580482a8 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:01.000923 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9a6e80fe-fa29-4247-a3e0-fdde580482a8 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:01.321489 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-bdada4c8-09f7-45b1-b4f6-ee71201cf842 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a872dad882e4694aba20eaa8c06df53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457d184c579a4016a0eec16eb9f23195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:01.332709 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-bdada4c8-09f7-45b1-b4f6-ee71201cf842 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] 10.222.0.17 "GET /compute/v2.1/servers/7b12c52a-fc64-472b-8659-4e7312fcc83a" status: 200 len: 1318 microversion: 2.1 time: 0.394398 Jul 23 21:15:01.333310 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 225/497] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:00 2022] GET /compute/v2.1/servers/7b12c52a-fc64-472b-8659-4e7312fcc83a => generated 1318 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:15:01.350907 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0ab4bd8f-4e8f-4b85-87cb-e5bf2c42b307 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:01.352010 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-0ab4bd8f-4e8f-4b85-87cb-e5bf2c42b307 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: ed0fdfd2-3506-40c4-8e4a-bb984e946fdd] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:01.358929 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0ab4bd8f-4e8f-4b85-87cb-e5bf2c42b307 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:01.359661 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0ab4bd8f-4e8f-4b85-87cb-e5bf2c42b307 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:01.360629 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0ab4bd8f-4e8f-4b85-87cb-e5bf2c42b307 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:01.361265 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0ab4bd8f-4e8f-4b85-87cb-e5bf2c42b307 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:01.396123 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-9a6e80fe-fa29-4247-a3e0-fdde580482a8 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/965630ba-6832-46c9-8f42-7a9fed39e598" status: 200 len: 1644 microversion: 2.1 time: 0.438519 Jul 23 21:15:01.396707 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 273/498] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:00 2022] GET /compute/v2.1/servers/965630ba-6832-46c9-8f42-7a9fed39e598 => generated 1644 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:01.432680 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-03c1e134-73d2-4bd8-add2-ff32a37c70a2 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:01.434881 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-03c1e134-73d2-4bd8-add2-ff32a37c70a2 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 769ee4e5-e4df-4d4e-9f4c-6372c60d9e01] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:01.452094 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-03c1e134-73d2-4bd8-add2-ff32a37c70a2 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:01.458101 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-03c1e134-73d2-4bd8-add2-ff32a37c70a2 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:01.459384 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-03c1e134-73d2-4bd8-add2-ff32a37c70a2 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:01.461218 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-03c1e134-73d2-4bd8-add2-ff32a37c70a2 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:01.603166 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell0:SELECT=2 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:15:01.872560 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-0ab4bd8f-4e8f-4b85-87cb-e5bf2c42b307 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:01.888908 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-0ab4bd8f-4e8f-4b85-87cb-e5bf2c42b307 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:01.890431 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-0ab4bd8f-4e8f-4b85-87cb-e5bf2c42b307 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:01.898859 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-0ab4bd8f-4e8f-4b85-87cb-e5bf2c42b307 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/ed0fdfd2-3506-40c4-8e4a-bb984e946fdd" status: 200 len: 1361 microversion: 2.25 time: 0.561563 Jul 23 21:15:01.901012 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 226/499] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:15:01 2022] GET /compute/v2.1/servers/ed0fdfd2-3506-40c4-8e4a-bb984e946fdd => generated 1361 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:15:01.919764 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9759abe4-1cbf-48b9-988c-b43106f5bff2 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:01.919764 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-9759abe4-1cbf-48b9-988c-b43106f5bff2 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] [instance: 31f37ba7-d5b3-4b48-9261-47e337e06a86] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:01.930457 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9759abe4-1cbf-48b9-988c-b43106f5bff2 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:01.930718 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9759abe4-1cbf-48b9-988c-b43106f5bff2 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:01.931405 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9759abe4-1cbf-48b9-988c-b43106f5bff2 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:01.931848 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9759abe4-1cbf-48b9-988c-b43106f5bff2 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:02.127317 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-9759abe4-1cbf-48b9-988c-b43106f5bff2 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d3840d84f34ae5ba5d95b4c96847ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf6363b1e154ff59ee30143aee3d4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:02.137813 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9759abe4-1cbf-48b9-988c-b43106f5bff2 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] 10.222.0.17 "GET /compute/v2.1/servers/31f37ba7-d5b3-4b48-9261-47e337e06a86" status: 200 len: 1322 microversion: 2.1 time: 0.236843 Jul 23 21:15:02.139182 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 227/500] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:01 2022] GET /compute/v2.1/servers/31f37ba7-d5b3-4b48-9261-47e337e06a86 => generated 1322 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:02.144413 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8ea8a96a-670a-4c5f-ba63-1ae89e80093f tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-806686514", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "networks": [{"uuid": "dfe0034d-5d2d-4ce5-b256-d87bd84ec0c2"}]}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:15:02.216220 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-8ea8a96a-670a-4c5f-ba63-1ae89e80093f tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] validate_networks() for [('dfe0034d-5d2d-4ce5-b256-d87bd84ec0c2', None, None, None, None, None)] {{(pid=131320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:15:02.342605 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-03c1e134-73d2-4bd8-add2-ff32a37c70a2 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:02.351072 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-03c1e134-73d2-4bd8-add2-ff32a37c70a2 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/769ee4e5-e4df-4d4e-9f4c-6372c60d9e01" status: 200 len: 1476 microversion: 2.1 time: 0.925886 Jul 23 21:15:02.351998 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 274/501] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:01 2022] GET /compute/v2.1/servers/769ee4e5-e4df-4d4e-9f4c-6372c60d9e01 => generated 1476 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:02.356864 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-9052745c-0dac-4d50-85b0-d2ec2208731e req-e4369421-5350-412e-9d68-92a76fddefca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed0fdfd2-3506-40c4-8e4a-bb984e946fdd", "name": "network-vif-plugged", "status": "completed", "tag": "1e9171bb-cfe1-4d9d-b4e2-14b9c65df29e"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:15:02.373150 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-9052745c-0dac-4d50-85b0-d2ec2208731e req-e4369421-5350-412e-9d68-92a76fddefca service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:02.374764 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-9052745c-0dac-4d50-85b0-d2ec2208731e req-e4369421-5350-412e-9d68-92a76fddefca service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:02.389003 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-9052745c-0dac-4d50-85b0-d2ec2208731e req-e4369421-5350-412e-9d68-92a76fddefca service nova] Creating event network-vif-plugged:1e9171bb-cfe1-4d9d-b4e2-14b9c65df29e for instance ed0fdfd2-3506-40c4-8e4a-bb984e946fdd on nch2-master-1 Jul 23 21:15:02.394545 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-9052745c-0dac-4d50-85b0-d2ec2208731e req-e4369421-5350-412e-9d68-92a76fddefca service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041139 Jul 23 21:15:02.395392 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 275/502] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:15:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:15:02.403767 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-626985fb-b913-44d2-acbf-52750a820cb9 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-830617665", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "1416912473", "adminPass": "***", "networks": [{"uuid": "523a5244-1039-418e-81fd-9fdb77c1b606"}], "security_groups": [{"name": "tempest-securitygroup--1538760754"}], "key_name": "tempest-keypair-69753320", "user_data": "}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:15:02.583327 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.network.neutron [None req-626985fb-b913-44d2-acbf-52750a820cb9 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] validate_networks() for [('523a5244-1039-418e-81fd-9fdb77c1b606', None, None, None, None, None)] {{(pid=131321) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:15:02.891994 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-8ea8a96a-670a-4c5f-ba63-1ae89e80093f tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:15:02.892630 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-8ea8a96a-670a-4c5f-ba63-1ae89e80093f tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:15:02.893110 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-8ea8a96a-670a-4c5f-ba63-1ae89e80093f tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:15:02.893519 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-8ea8a96a-670a-4c5f-ba63-1ae89e80093f tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:15:02.894116 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-8ea8a96a-670a-4c5f-ba63-1ae89e80093f tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:15:02.905157 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8ea8a96a-670a-4c5f-ba63-1ae89e80093f tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:02.906047 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8ea8a96a-670a-4c5f-ba63-1ae89e80093f tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:02.907056 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8ea8a96a-670a-4c5f-ba63-1ae89e80093f tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:02.907592 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8ea8a96a-670a-4c5f-ba63-1ae89e80093f tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:02.927389 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-8ea8a96a-670a-4c5f-ba63-1ae89e80093f tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Getting quotas for project 6610a2359aa64f89befcf72e4f3f6a54. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:15:02.936163 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-8ea8a96a-670a-4c5f-ba63-1ae89e80093f tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Getting quotas for user f2672c5db79b4a48a505c3df536594dd and project 6610a2359aa64f89befcf72e4f3f6a54. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:15:02.957113 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8ea8a96a-670a-4c5f-ba63-1ae89e80093f tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Going to run 1 instances... {{(pid=131320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:15:02.960139 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8ea8a96a-670a-4c5f-ba63-1ae89e80093f tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:15:03.018365 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8ea8a96a-670a-4c5f-ba63-1ae89e80093f tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.877798 Jul 23 21:15:03.024557 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 228/503] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:15:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 885 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 23 21:15:03.031155 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f79809e2-95dc-4e65-9ee1-916d078cce93 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:03.032138 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f79809e2-95dc-4e65-9ee1-916d078cce93 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] [instance: 7b12c52a-fc64-472b-8659-4e7312fcc83a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:03.039947 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f79809e2-95dc-4e65-9ee1-916d078cce93 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:03.040732 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f79809e2-95dc-4e65-9ee1-916d078cce93 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:03.041688 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f79809e2-95dc-4e65-9ee1-916d078cce93 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:03.042337 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f79809e2-95dc-4e65-9ee1-916d078cce93 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:03.265684 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f79809e2-95dc-4e65-9ee1-916d078cce93 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a872dad882e4694aba20eaa8c06df53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457d184c579a4016a0eec16eb9f23195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:03.276579 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f79809e2-95dc-4e65-9ee1-916d078cce93 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] 10.222.0.17 "GET /compute/v2.1/servers/7b12c52a-fc64-472b-8659-4e7312fcc83a" status: 200 len: 1318 microversion: 2.1 time: 0.250450 Jul 23 21:15:03.277333 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 229/504] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:03 2022] GET /compute/v2.1/servers/7b12c52a-fc64-472b-8659-4e7312fcc83a => generated 1318 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:03.283520 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c4945a5a-428e-43ef-8508-0e98489039f4 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:03.284482 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c4945a5a-428e-43ef-8508-0e98489039f4 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: ed0fdfd2-3506-40c4-8e4a-bb984e946fdd] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:03.292034 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c4945a5a-428e-43ef-8508-0e98489039f4 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:03.292806 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c4945a5a-428e-43ef-8508-0e98489039f4 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:03.294028 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c4945a5a-428e-43ef-8508-0e98489039f4 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:03.294657 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c4945a5a-428e-43ef-8508-0e98489039f4 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:03.460588 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c4945a5a-428e-43ef-8508-0e98489039f4 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:03.469821 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c4945a5a-428e-43ef-8508-0e98489039f4 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:03.471411 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c4945a5a-428e-43ef-8508-0e98489039f4 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:03.472522 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c4945a5a-428e-43ef-8508-0e98489039f4 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/ed0fdfd2-3506-40c4-8e4a-bb984e946fdd" status: 200 len: 1361 microversion: 2.25 time: 0.193603 Jul 23 21:15:03.483974 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 230/505] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:15:03 2022] GET /compute/v2.1/servers/ed0fdfd2-3506-40c4-8e4a-bb984e946fdd => generated 1361 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:15:03.490380 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-093e58b8-737f-47d8-b403-f772f073dbd5 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:03.491073 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-093e58b8-737f-47d8-b403-f772f073dbd5 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:03.556103 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-093e58b8-737f-47d8-b403-f772f073dbd5 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:03.565199 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-093e58b8-737f-47d8-b403-f772f073dbd5 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b" status: 200 len: 1210 microversion: 2.1 time: 0.078841 Jul 23 21:15:03.566492 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 231/506] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:03 2022] GET /compute/v2.1/servers/d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b => generated 1210 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:03.581005 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a15d2b84-bd90-4263-8859-438849b3c0c5 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:03.581696 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a15d2b84-bd90-4263-8859-438849b3c0c5 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] [instance: 31f37ba7-d5b3-4b48-9261-47e337e06a86] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:03.588282 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a15d2b84-bd90-4263-8859-438849b3c0c5 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:03.589003 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a15d2b84-bd90-4263-8859-438849b3c0c5 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:03.590804 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a15d2b84-bd90-4263-8859-438849b3c0c5 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:03.591431 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a15d2b84-bd90-4263-8859-438849b3c0c5 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:03.750827 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a15d2b84-bd90-4263-8859-438849b3c0c5 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d3840d84f34ae5ba5d95b4c96847ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf6363b1e154ff59ee30143aee3d4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:03.760471 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a15d2b84-bd90-4263-8859-438849b3c0c5 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] 10.222.0.17 "GET /compute/v2.1/servers/31f37ba7-d5b3-4b48-9261-47e337e06a86" status: 200 len: 1322 microversion: 2.1 time: 0.192749 Jul 23 21:15:03.761978 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 232/507] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:03 2022] GET /compute/v2.1/servers/31f37ba7-d5b3-4b48-9261-47e337e06a86 => generated 1322 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:03.780075 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f0e57c51-8cb8-46ab-94e0-e979dd5c66f4 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:03.780619 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f0e57c51-8cb8-46ab-94e0-e979dd5c66f4 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 769ee4e5-e4df-4d4e-9f4c-6372c60d9e01] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:03.789209 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f0e57c51-8cb8-46ab-94e0-e979dd5c66f4 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:03.789980 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f0e57c51-8cb8-46ab-94e0-e979dd5c66f4 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:03.790929 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f0e57c51-8cb8-46ab-94e0-e979dd5c66f4 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:03.791403 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f0e57c51-8cb8-46ab-94e0-e979dd5c66f4 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:03.992200 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-626985fb-b913-44d2-acbf-52750a820cb9 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Flavor limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:15:03.992704 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-626985fb-b913-44d2-acbf-52750a820cb9 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Image limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:15:03.993075 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-626985fb-b913-44d2-acbf-52750a820cb9 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Flavor pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:15:03.993475 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-626985fb-b913-44d2-acbf-52750a820cb9 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Image pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:15:03.993894 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-626985fb-b913-44d2-acbf-52750a820cb9 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:15:03.994519 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f0e57c51-8cb8-46ab-94e0-e979dd5c66f4 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:04.008550 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-626985fb-b913-44d2-acbf-52750a820cb9 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:04.009258 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f0e57c51-8cb8-46ab-94e0-e979dd5c66f4 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/769ee4e5-e4df-4d4e-9f4c-6372c60d9e01" status: 200 len: 1476 microversion: 2.1 time: 0.245587 Jul 23 21:15:04.010327 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 233/508] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:03 2022] GET /compute/v2.1/servers/769ee4e5-e4df-4d4e-9f4c-6372c60d9e01 => generated 1476 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:04.011032 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-626985fb-b913-44d2-acbf-52750a820cb9 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:04.012016 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-626985fb-b913-44d2-acbf-52750a820cb9 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:04.012567 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-626985fb-b913-44d2-acbf-52750a820cb9 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:04.025274 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-7ea1ed45-7abf-4d5c-a38b-fdd0b9b54029 req-caddbf67-a88a-4bff-8a0a-9d34b193144f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31f37ba7-d5b3-4b48-9261-47e337e06a86", "tag": "36f20cbc-51d2-47f5-9a05-f635c6a69ae4"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:15:04.034214 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-626985fb-b913-44d2-acbf-52750a820cb9 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Getting quotas for project d3c17bd813264fb9891076799e33acca. Resources: {'ram', 'instances', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:15:04.041124 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-7ea1ed45-7abf-4d5c-a38b-fdd0b9b54029 req-caddbf67-a88a-4bff-8a0a-9d34b193144f service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:04.041637 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-7ea1ed45-7abf-4d5c-a38b-fdd0b9b54029 req-caddbf67-a88a-4bff-8a0a-9d34b193144f service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:04.048162 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-626985fb-b913-44d2-acbf-52750a820cb9 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Getting quotas for user 39f1a14a59b7401d88f18ec35c91e30a and project d3c17bd813264fb9891076799e33acca. Resources: {'ram', 'instances', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:15:04.056004 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-7ea1ed45-7abf-4d5c-a38b-fdd0b9b54029 req-caddbf67-a88a-4bff-8a0a-9d34b193144f service nova] Creating event network-changed:36f20cbc-51d2-47f5-9a05-f635c6a69ae4 for instance 31f37ba7-d5b3-4b48-9261-47e337e06a86 on nch1-master-1 Jul 23 21:15:04.062114 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-7ea1ed45-7abf-4d5c-a38b-fdd0b9b54029 req-caddbf67-a88a-4bff-8a0a-9d34b193144f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049850 Jul 23 21:15:04.063524 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 234/509] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:15:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:15:04.064609 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-626985fb-b913-44d2-acbf-52750a820cb9 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Going to run 1 instances... {{(pid=131321) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:15:04.067160 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-626985fb-b913-44d2-acbf-52750a820cb9 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] [instance: fc41b6cc-f603-4f7d-89cb-a7e3cee372a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131321) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:15:04.136131 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-626985fb-b913-44d2-acbf-52750a820cb9 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.739290 Jul 23 21:15:04.136964 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 276/510] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:15:02 2022] POST /compute/v2.1/servers => generated 402 bytes in 1741 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 23 21:15:04.157332 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c5d56977-6cb4-4571-9a6d-af86b85b10a4 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:04.158190 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c5d56977-6cb4-4571-9a6d-af86b85b10a4 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] [instance: fc41b6cc-f603-4f7d-89cb-a7e3cee372a5] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:04.246818 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c5d56977-6cb4-4571-9a6d-af86b85b10a4 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f1a14a59b7401d88f18ec35c91e30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c17bd813264fb9891076799e33acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:04.260646 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c5d56977-6cb4-4571-9a6d-af86b85b10a4 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] 10.222.0.17 "GET /compute/v2.1/servers/fc41b6cc-f603-4f7d-89cb-a7e3cee372a5" status: 200 len: 1262 microversion: 2.1 time: 0.115994 Jul 23 21:15:04.266472 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 235/511] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:04 2022] GET /compute/v2.1/servers/fc41b6cc-f603-4f7d-89cb-a7e3cee372a5 => generated 1262 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:04.293418 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-40222c99-4a41-459d-8e62-b127f53ea8c1 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:04.294454 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-40222c99-4a41-459d-8e62-b127f53ea8c1 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] [instance: 7b12c52a-fc64-472b-8659-4e7312fcc83a] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:04.302947 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-40222c99-4a41-459d-8e62-b127f53ea8c1 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:04.303600 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-40222c99-4a41-459d-8e62-b127f53ea8c1 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:04.304927 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-40222c99-4a41-459d-8e62-b127f53ea8c1 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:04.309988 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-40222c99-4a41-459d-8e62-b127f53ea8c1 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:04.492184 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-02bd4c14-e957-49df-9281-771b44dcb27e tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:04.493360 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-02bd4c14-e957-49df-9281-771b44dcb27e tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: ed0fdfd2-3506-40c4-8e4a-bb984e946fdd] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:04.505205 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-02bd4c14-e957-49df-9281-771b44dcb27e tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:04.507733 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-02bd4c14-e957-49df-9281-771b44dcb27e tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:04.510976 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-02bd4c14-e957-49df-9281-771b44dcb27e tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:04.512301 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-02bd4c14-e957-49df-9281-771b44dcb27e tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:04.592695 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-40222c99-4a41-459d-8e62-b127f53ea8c1 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a872dad882e4694aba20eaa8c06df53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457d184c579a4016a0eec16eb9f23195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:04.604469 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-40222c99-4a41-459d-8e62-b127f53ea8c1 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] 10.222.0.17 "GET /compute/v2.1/servers/7b12c52a-fc64-472b-8659-4e7312fcc83a" status: 200 len: 1318 microversion: 2.1 time: 0.312953 Jul 23 21:15:04.627666 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 277/512] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:04 2022] GET /compute/v2.1/servers/7b12c52a-fc64-472b-8659-4e7312fcc83a => generated 1318 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:04.635017 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e22e990e-fcc6-4175-a0b9-27b414dac0c3 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:04.636166 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-e22e990e-fcc6-4175-a0b9-27b414dac0c3 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:04.649208 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e22e990e-fcc6-4175-a0b9-27b414dac0c3 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:04.650480 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e22e990e-fcc6-4175-a0b9-27b414dac0c3 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:04.651668 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e22e990e-fcc6-4175-a0b9-27b414dac0c3 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:04.652335 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e22e990e-fcc6-4175-a0b9-27b414dac0c3 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:04.782248 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-e22e990e-fcc6-4175-a0b9-27b414dac0c3 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:04.796988 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-e22e990e-fcc6-4175-a0b9-27b414dac0c3 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b" status: 200 len: 1270 microversion: 2.1 time: 0.166584 Jul 23 21:15:04.797805 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 278/513] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:04 2022] GET /compute/v2.1/servers/d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b => generated 1270 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:04.804523 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-7e4945ce-6f89-41fa-ad13-8693c1c17fad tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:04.806378 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-7e4945ce-6f89-41fa-ad13-8693c1c17fad tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] [instance: 31f37ba7-d5b3-4b48-9261-47e337e06a86] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:04.826371 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7e4945ce-6f89-41fa-ad13-8693c1c17fad tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:04.829975 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7e4945ce-6f89-41fa-ad13-8693c1c17fad tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:04.830918 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7e4945ce-6f89-41fa-ad13-8693c1c17fad tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:04.832595 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7e4945ce-6f89-41fa-ad13-8693c1c17fad tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:05.062003 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-02bd4c14-e957-49df-9281-771b44dcb27e tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:05.072147 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-02bd4c14-e957-49df-9281-771b44dcb27e tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:05.074109 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-02bd4c14-e957-49df-9281-771b44dcb27e tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:05.076161 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-02bd4c14-e957-49df-9281-771b44dcb27e tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/ed0fdfd2-3506-40c4-8e4a-bb984e946fdd" status: 200 len: 1361 microversion: 2.25 time: 0.588717 Jul 23 21:15:05.087123 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 236/514] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:15:04 2022] GET /compute/v2.1/servers/ed0fdfd2-3506-40c4-8e4a-bb984e946fdd => generated 1361 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:15:05.097840 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-fd099d06-65bb-4238-b986-49c065abecc6 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:05.098668 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-fd099d06-65bb-4238-b986-49c065abecc6 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 769ee4e5-e4df-4d4e-9f4c-6372c60d9e01] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:05.115526 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fd099d06-65bb-4238-b986-49c065abecc6 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:05.117714 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fd099d06-65bb-4238-b986-49c065abecc6 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:05.118816 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fd099d06-65bb-4238-b986-49c065abecc6 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:05.120703 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fd099d06-65bb-4238-b986-49c065abecc6 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:05.133219 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-7e4945ce-6f89-41fa-ad13-8693c1c17fad tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d3840d84f34ae5ba5d95b4c96847ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf6363b1e154ff59ee30143aee3d4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:05.144549 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-7e4945ce-6f89-41fa-ad13-8693c1c17fad tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] 10.222.0.17 "GET /compute/v2.1/servers/31f37ba7-d5b3-4b48-9261-47e337e06a86" status: 200 len: 1322 microversion: 2.1 time: 0.344922 Jul 23 21:15:05.146383 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 279/515] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:04 2022] GET /compute/v2.1/servers/31f37ba7-d5b3-4b48-9261-47e337e06a86 => generated 1322 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:05.441976 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-fd099d06-65bb-4238-b986-49c065abecc6 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:05.452469 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-fd099d06-65bb-4238-b986-49c065abecc6 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/769ee4e5-e4df-4d4e-9f4c-6372c60d9e01" status: 200 len: 1476 microversion: 2.1 time: 0.366338 Jul 23 21:15:05.458081 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 237/516] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:05 2022] GET /compute/v2.1/servers/769ee4e5-e4df-4d4e-9f4c-6372c60d9e01 => generated 1476 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:05.464655 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3007e130-88ce-4778-997a-912f825d7115 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:05.465503 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-3007e130-88ce-4778-997a-912f825d7115 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] [instance: fc41b6cc-f603-4f7d-89cb-a7e3cee372a5] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:05.476361 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3007e130-88ce-4778-997a-912f825d7115 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:05.484466 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3007e130-88ce-4778-997a-912f825d7115 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:05.489065 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3007e130-88ce-4778-997a-912f825d7115 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:05.489746 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3007e130-88ce-4778-997a-912f825d7115 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:05.498207 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-129bcd7f-17f5-4724-90b6-376dc52ffdb9 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1528375074", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:15:05.571845 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.network.neutron [None req-129bcd7f-17f5-4724-90b6-376dc52ffdb9 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] validate_networks() for None {{(pid=131321) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:15:05.623003 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-3007e130-88ce-4778-997a-912f825d7115 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f1a14a59b7401d88f18ec35c91e30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c17bd813264fb9891076799e33acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:05.639922 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-3007e130-88ce-4778-997a-912f825d7115 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] 10.222.0.17 "GET /compute/v2.1/servers/fc41b6cc-f603-4f7d-89cb-a7e3cee372a5" status: 200 len: 1314 microversion: 2.1 time: 0.180517 Jul 23 21:15:05.640557 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 238/517] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:05 2022] GET /compute/v2.1/servers/fc41b6cc-f603-4f7d-89cb-a7e3cee372a5 => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:05.655518 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-835b1d7b-171e-4335-a40a-2952908fc817 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:05.656139 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-835b1d7b-171e-4335-a40a-2952908fc817 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] [instance: 7b12c52a-fc64-472b-8659-4e7312fcc83a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:05.674152 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-835b1d7b-171e-4335-a40a-2952908fc817 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:05.674665 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-835b1d7b-171e-4335-a40a-2952908fc817 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:05.675486 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-835b1d7b-171e-4335-a40a-2952908fc817 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:05.678339 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-835b1d7b-171e-4335-a40a-2952908fc817 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:06.244989 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-835b1d7b-171e-4335-a40a-2952908fc817 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a872dad882e4694aba20eaa8c06df53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457d184c579a4016a0eec16eb9f23195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:06.252209 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=100 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:15:06.258545 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-835b1d7b-171e-4335-a40a-2952908fc817 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] 10.222.0.17 "GET /compute/v2.1/servers/7b12c52a-fc64-472b-8659-4e7312fcc83a" status: 200 len: 1318 microversion: 2.1 time: 0.606995 Jul 23 21:15:06.259151 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 239/518] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:05 2022] GET /compute/v2.1/servers/7b12c52a-fc64-472b-8659-4e7312fcc83a => generated 1318 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:06.268683 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-072b74bb-5132-4123-96ba-4c7e0ec900a3 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:06.269300 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-072b74bb-5132-4123-96ba-4c7e0ec900a3 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:06.291071 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-072b74bb-5132-4123-96ba-4c7e0ec900a3 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:06.291535 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-072b74bb-5132-4123-96ba-4c7e0ec900a3 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:06.293183 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-072b74bb-5132-4123-96ba-4c7e0ec900a3 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:06.293646 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-072b74bb-5132-4123-96ba-4c7e0ec900a3 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:06.439690 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-072b74bb-5132-4123-96ba-4c7e0ec900a3 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:06.451492 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-072b74bb-5132-4123-96ba-4c7e0ec900a3 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b" status: 200 len: 1268 microversion: 2.1 time: 0.191220 Jul 23 21:15:06.452072 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 240/519] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:06 2022] GET /compute/v2.1/servers/d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b => generated 1268 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:06.494438 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6996bad4-518d-42b6-ae97-7ef79f9bec61 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:06.495694 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6996bad4-518d-42b6-ae97-7ef79f9bec61 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: ed0fdfd2-3506-40c4-8e4a-bb984e946fdd] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:06.521640 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-129bcd7f-17f5-4724-90b6-376dc52ffdb9 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Flavor limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:15:06.522859 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-129bcd7f-17f5-4724-90b6-376dc52ffdb9 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Image limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:15:06.526197 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-129bcd7f-17f5-4724-90b6-376dc52ffdb9 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Flavor pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:15:06.526859 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-129bcd7f-17f5-4724-90b6-376dc52ffdb9 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Image pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:15:06.527507 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-129bcd7f-17f5-4724-90b6-376dc52ffdb9 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:15:06.532894 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6996bad4-518d-42b6-ae97-7ef79f9bec61 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:06.534517 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6996bad4-518d-42b6-ae97-7ef79f9bec61 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:06.535635 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6996bad4-518d-42b6-ae97-7ef79f9bec61 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:06.538487 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6996bad4-518d-42b6-ae97-7ef79f9bec61 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:06.552929 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-129bcd7f-17f5-4724-90b6-376dc52ffdb9 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:06.555674 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-129bcd7f-17f5-4724-90b6-376dc52ffdb9 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:06.557816 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-129bcd7f-17f5-4724-90b6-376dc52ffdb9 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:06.561335 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-129bcd7f-17f5-4724-90b6-376dc52ffdb9 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:06.617905 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-129bcd7f-17f5-4724-90b6-376dc52ffdb9 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Getting quotas for project f5e7d37a0e3b4b32ae99c3bc15a831e6. Resources: {'ram', 'instances', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:15:06.624153 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-129bcd7f-17f5-4724-90b6-376dc52ffdb9 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Getting quotas for user ebf92af08fa94215b4eafcacea6c63f6 and project f5e7d37a0e3b4b32ae99c3bc15a831e6. Resources: {'ram', 'instances', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:15:06.670049 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-129bcd7f-17f5-4724-90b6-376dc52ffdb9 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Going to run 1 instances... {{(pid=131321) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:15:06.682277 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-129bcd7f-17f5-4724-90b6-376dc52ffdb9 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: 9e985a36-586a-4546-a0c0-1a3e3da330c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131321) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:15:06.804990 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-129bcd7f-17f5-4724-90b6-376dc52ffdb9 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.555022 Jul 23 21:15:06.810992 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 280/520] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:15:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1562 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 23 21:15:06.820915 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-6b077e76-1bab-4b4c-9d87-ffb39685e506 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:06.821765 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-6b077e76-1bab-4b4c-9d87-ffb39685e506 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] [instance: 31f37ba7-d5b3-4b48-9261-47e337e06a86] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:06.837450 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6b077e76-1bab-4b4c-9d87-ffb39685e506 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:06.839652 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6b077e76-1bab-4b4c-9d87-ffb39685e506 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:06.840958 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6b077e76-1bab-4b4c-9d87-ffb39685e506 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:06.841560 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6b077e76-1bab-4b4c-9d87-ffb39685e506 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:07.218832 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6996bad4-518d-42b6-ae97-7ef79f9bec61 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:07.228034 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6996bad4-518d-42b6-ae97-7ef79f9bec61 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:07.228241 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-6b077e76-1bab-4b4c-9d87-ffb39685e506 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d3840d84f34ae5ba5d95b4c96847ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf6363b1e154ff59ee30143aee3d4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:07.229473 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6996bad4-518d-42b6-ae97-7ef79f9bec61 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:07.230823 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6996bad4-518d-42b6-ae97-7ef79f9bec61 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/ed0fdfd2-3506-40c4-8e4a-bb984e946fdd" status: 200 len: 1557 microversion: 2.25 time: 0.777669 Jul 23 21:15:07.238145 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 241/521] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:15:06 2022] GET /compute/v2.1/servers/ed0fdfd2-3506-40c4-8e4a-bb984e946fdd => generated 1557 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:15:07.239953 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-6b077e76-1bab-4b4c-9d87-ffb39685e506 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] 10.222.0.17 "GET /compute/v2.1/servers/31f37ba7-d5b3-4b48-9261-47e337e06a86" status: 200 len: 1322 microversion: 2.1 time: 0.427593 Jul 23 21:15:07.240852 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 281/522] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:06 2022] GET /compute/v2.1/servers/31f37ba7-d5b3-4b48-9261-47e337e06a86 => generated 1322 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:07.257217 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1be2d716-55eb-44e5-8ddd-886daf2bab66 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:07.258106 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1be2d716-55eb-44e5-8ddd-886daf2bab66 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 769ee4e5-e4df-4d4e-9f4c-6372c60d9e01] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:07.260632 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-cd5ae8ea-c287-4c47-b6ee-c6968fcad03b tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:07.261560 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-cd5ae8ea-c287-4c47-b6ee-c6968fcad03b tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] [instance: fc41b6cc-f603-4f7d-89cb-a7e3cee372a5] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:07.262474 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=4,nova_api:UPDATE=12 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:15:07.266279 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1be2d716-55eb-44e5-8ddd-886daf2bab66 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:07.266968 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1be2d716-55eb-44e5-8ddd-886daf2bab66 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:07.268139 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1be2d716-55eb-44e5-8ddd-886daf2bab66 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:07.268727 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1be2d716-55eb-44e5-8ddd-886daf2bab66 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:07.284907 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cd5ae8ea-c287-4c47-b6ee-c6968fcad03b tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:07.285352 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cd5ae8ea-c287-4c47-b6ee-c6968fcad03b tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:07.294241 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cd5ae8ea-c287-4c47-b6ee-c6968fcad03b tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:07.298038 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cd5ae8ea-c287-4c47-b6ee-c6968fcad03b tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:07.604330 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-cd5ae8ea-c287-4c47-b6ee-c6968fcad03b tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f1a14a59b7401d88f18ec35c91e30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c17bd813264fb9891076799e33acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:07.618628 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-cd5ae8ea-c287-4c47-b6ee-c6968fcad03b tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] 10.222.0.17 "GET /compute/v2.1/servers/fc41b6cc-f603-4f7d-89cb-a7e3cee372a5" status: 200 len: 1320 microversion: 2.1 time: 0.375819 Jul 23 21:15:07.619627 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 282/523] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:07 2022] GET /compute/v2.1/servers/fc41b6cc-f603-4f7d-89cb-a7e3cee372a5 => generated 1320 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:07.642171 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-435fdf92-2be6-47ad-bb64-dbd1b9fb6de3 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:07.643267 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-435fdf92-2be6-47ad-bb64-dbd1b9fb6de3 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: 9e985a36-586a-4546-a0c0-1a3e3da330c9] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:07.652648 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:15:07.680677 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-435fdf92-2be6-47ad-bb64-dbd1b9fb6de3 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:07.681143 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-435fdf92-2be6-47ad-bb64-dbd1b9fb6de3 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:07.681991 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-435fdf92-2be6-47ad-bb64-dbd1b9fb6de3 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:07.682441 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-435fdf92-2be6-47ad-bb64-dbd1b9fb6de3 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:07.803899 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-435fdf92-2be6-47ad-bb64-dbd1b9fb6de3 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf92af08fa94215b4eafcacea6c63f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e7d37a0e3b4b32ae99c3bc15a831e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:07.819156 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-435fdf92-2be6-47ad-bb64-dbd1b9fb6de3 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "GET /compute/v2.1/servers/9e985a36-586a-4546-a0c0-1a3e3da330c9" status: 200 len: 1213 microversion: 2.1 time: 0.197901 Jul 23 21:15:07.819550 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 283/524] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:07 2022] GET /compute/v2.1/servers/9e985a36-586a-4546-a0c0-1a3e3da330c9 => generated 1213 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:08.038038 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-20373145-3331-4f7e-a4e3-48857ba30c20 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:08.039720 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-20373145-3331-4f7e-a4e3-48857ba30c20 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] [instance: ed0fdfd2-3506-40c4-8e4a-bb984e946fdd] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:08.056698 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-20373145-3331-4f7e-a4e3-48857ba30c20 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:08.058362 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-20373145-3331-4f7e-a4e3-48857ba30c20 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:08.059378 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-20373145-3331-4f7e-a4e3-48857ba30c20 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:08.060690 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-20373145-3331-4f7e-a4e3-48857ba30c20 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:08.089342 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-1be2d716-55eb-44e5-8ddd-886daf2bab66 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:08.101638 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1be2d716-55eb-44e5-8ddd-886daf2bab66 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/769ee4e5-e4df-4d4e-9f4c-6372c60d9e01" status: 200 len: 1475 microversion: 2.1 time: 0.848580 Jul 23 21:15:08.105233 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 242/525] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:07 2022] GET /compute/v2.1/servers/769ee4e5-e4df-4d4e-9f4c-6372c60d9e01 => generated 1475 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:08.126349 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c11049b4-282e-46c8-a955-b495f3b7521a tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:08.127823 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c11049b4-282e-46c8-a955-b495f3b7521a tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] [instance: 7b12c52a-fc64-472b-8659-4e7312fcc83a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:08.137224 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c11049b4-282e-46c8-a955-b495f3b7521a tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:08.138733 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c11049b4-282e-46c8-a955-b495f3b7521a tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:08.139805 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c11049b4-282e-46c8-a955-b495f3b7521a tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:08.140488 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c11049b4-282e-46c8-a955-b495f3b7521a tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:08.447335 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.objects.instance [None req-20373145-3331-4f7e-a4e3-48857ba30c20 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lazy-loading 'services' on Instance uuid ed0fdfd2-3506-40c4-8e4a-bb984e946fdd {{(pid=131321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:15:08.547757 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=100 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:15:08.573937 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-20373145-3331-4f7e-a4e3-48857ba30c20 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/ed0fdfd2-3506-40c4-8e4a-bb984e946fdd" status: 200 len: 2049 microversion: 2.25 time: 0.744092 Jul 23 21:15:08.575412 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 284/526] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:15:07 2022] GET /compute/v2.1/servers/ed0fdfd2-3506-40c4-8e4a-bb984e946fdd => generated 2049 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:15:08.582950 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ec387f9b-b5d5-4fa3-9d9b-287e97d243f6 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:08.584047 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-ec387f9b-b5d5-4fa3-9d9b-287e97d243f6 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:08.591767 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ec387f9b-b5d5-4fa3-9d9b-287e97d243f6 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:08.593113 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ec387f9b-b5d5-4fa3-9d9b-287e97d243f6 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:08.594317 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ec387f9b-b5d5-4fa3-9d9b-287e97d243f6 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:08.594865 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ec387f9b-b5d5-4fa3-9d9b-287e97d243f6 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:08.716422 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c11049b4-282e-46c8-a955-b495f3b7521a tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a872dad882e4694aba20eaa8c06df53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457d184c579a4016a0eec16eb9f23195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:08.727412 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c11049b4-282e-46c8-a955-b495f3b7521a tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] 10.222.0.17 "GET /compute/v2.1/servers/7b12c52a-fc64-472b-8659-4e7312fcc83a" status: 200 len: 1318 microversion: 2.1 time: 0.621033 Jul 23 21:15:08.741458 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 243/527] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:08 2022] GET /compute/v2.1/servers/7b12c52a-fc64-472b-8659-4e7312fcc83a => generated 1318 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:08.762342 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-7265c1a6-87ce-432b-a9eb-f60f8d8cb755 req-88a01c9d-a938-4f56-a8a2-1ff798148504 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b12c52a-fc64-472b-8659-4e7312fcc83a", "name": "network-vif-plugged", "status": "completed", "tag": "b40a2ef2-d21e-4032-85d7-9361b81fcc6a"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:15:08.776603 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-7265c1a6-87ce-432b-a9eb-f60f8d8cb755 req-88a01c9d-a938-4f56-a8a2-1ff798148504 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:08.780164 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-7265c1a6-87ce-432b-a9eb-f60f8d8cb755 req-88a01c9d-a938-4f56-a8a2-1ff798148504 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:08.824327 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-7265c1a6-87ce-432b-a9eb-f60f8d8cb755 req-88a01c9d-a938-4f56-a8a2-1ff798148504 service nova] Creating event network-vif-plugged:b40a2ef2-d21e-4032-85d7-9361b81fcc6a for instance 7b12c52a-fc64-472b-8659-4e7312fcc83a on nch2-master-1 Jul 23 21:15:08.839938 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-7265c1a6-87ce-432b-a9eb-f60f8d8cb755 req-88a01c9d-a938-4f56-a8a2-1ff798148504 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087726 Jul 23 21:15:08.841078 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 244/528] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:15:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:15:08.850784 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-7d6dc207-6201-4d14-ab6b-3e1ab2e66901 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:08.851491 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-7d6dc207-6201-4d14-ab6b-3e1ab2e66901 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] [instance: 31f37ba7-d5b3-4b48-9261-47e337e06a86] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:08.869305 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7d6dc207-6201-4d14-ab6b-3e1ab2e66901 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:08.870374 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7d6dc207-6201-4d14-ab6b-3e1ab2e66901 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:08.871393 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7d6dc207-6201-4d14-ab6b-3e1ab2e66901 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:08.872075 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7d6dc207-6201-4d14-ab6b-3e1ab2e66901 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:09.310405 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ec387f9b-b5d5-4fa3-9d9b-287e97d243f6 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:09.320122 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-ec387f9b-b5d5-4fa3-9d9b-287e97d243f6 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b" status: 200 len: 1310 microversion: 2.1 time: 0.743082 Jul 23 21:15:09.330502 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 285/529] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:08 2022] GET /compute/v2.1/servers/d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b => generated 1310 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:09.336083 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-0e33cafd-458a-4999-9afc-0c2ba88c8b27 req-3f14ae1b-1d3f-4c4a-8edf-c3cd2bc85e84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "769ee4e5-e4df-4d4e-9f4c-6372c60d9e01", "name": "network-vif-unplugged", "status": "completed", "tag": "ac63fc07-76cc-4d6e-8aca-987edbb6e640"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:15:09.347007 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-0e33cafd-458a-4999-9afc-0c2ba88c8b27 req-3f14ae1b-1d3f-4c4a-8edf-c3cd2bc85e84 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:09.347753 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-0e33cafd-458a-4999-9afc-0c2ba88c8b27 req-3f14ae1b-1d3f-4c4a-8edf-c3cd2bc85e84 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:09.360415 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-0e33cafd-458a-4999-9afc-0c2ba88c8b27 req-3f14ae1b-1d3f-4c4a-8edf-c3cd2bc85e84 service nova] Creating event network-vif-unplugged:ac63fc07-76cc-4d6e-8aca-987edbb6e640 for instance 769ee4e5-e4df-4d4e-9f4c-6372c60d9e01 on nch2-master-1 Jul 23 21:15:09.369308 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [req-0e33cafd-458a-4999-9afc-0c2ba88c8b27 req-3f14ae1b-1d3f-4c4a-8edf-c3cd2bc85e84 service nova] Instance 769ee4e5-e4df-4d4e-9f4c-6372c60d9e01 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=131321) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 23 21:15:09.382201 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-0e33cafd-458a-4999-9afc-0c2ba88c8b27 req-3f14ae1b-1d3f-4c4a-8edf-c3cd2bc85e84 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049984 Jul 23 21:15:09.383141 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 286/530] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:15:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:15:09.389279 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-b1210f61-81de-4d5a-a2fc-4fa6dd2559f9 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:09.390993 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-b1210f61-81de-4d5a-a2fc-4fa6dd2559f9 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] [instance: ed0fdfd2-3506-40c4-8e4a-bb984e946fdd] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:09.397981 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b1210f61-81de-4d5a-a2fc-4fa6dd2559f9 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:09.398887 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b1210f61-81de-4d5a-a2fc-4fa6dd2559f9 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:09.401155 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b1210f61-81de-4d5a-a2fc-4fa6dd2559f9 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:09.402608 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b1210f61-81de-4d5a-a2fc-4fa6dd2559f9 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:09.435143 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-7d6dc207-6201-4d14-ab6b-3e1ab2e66901 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d3840d84f34ae5ba5d95b4c96847ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf6363b1e154ff59ee30143aee3d4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:09.450555 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-7d6dc207-6201-4d14-ab6b-3e1ab2e66901 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] 10.222.0.17 "GET /compute/v2.1/servers/31f37ba7-d5b3-4b48-9261-47e337e06a86" status: 200 len: 1322 microversion: 2.1 time: 0.608009 Jul 23 21:15:09.451144 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 245/531] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:08 2022] GET /compute/v2.1/servers/31f37ba7-d5b3-4b48-9261-47e337e06a86 => generated 1322 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:09.456046 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9b2762e2-92c2-4ea0-99b1-d5a42aaceb17 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:09.456930 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-9b2762e2-92c2-4ea0-99b1-d5a42aaceb17 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] [instance: fc41b6cc-f603-4f7d-89cb-a7e3cee372a5] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:09.465808 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9b2762e2-92c2-4ea0-99b1-d5a42aaceb17 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:09.466411 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9b2762e2-92c2-4ea0-99b1-d5a42aaceb17 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:09.467432 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9b2762e2-92c2-4ea0-99b1-d5a42aaceb17 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:09.467966 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9b2762e2-92c2-4ea0-99b1-d5a42aaceb17 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:09.688791 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.objects.instance [None req-b1210f61-81de-4d5a-a2fc-4fa6dd2559f9 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lazy-loading 'services' on Instance uuid ed0fdfd2-3506-40c4-8e4a-bb984e946fdd {{(pid=131321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:15:09.704601 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-b1210f61-81de-4d5a-a2fc-4fa6dd2559f9 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/ed0fdfd2-3506-40c4-8e4a-bb984e946fdd" status: 200 len: 2049 microversion: 2.25 time: 0.319728 Jul 23 21:15:09.717370 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 287/532] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:15:09 2022] GET /compute/v2.1/servers/ed0fdfd2-3506-40c4-8e4a-bb984e946fdd => generated 2049 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:15:09.726860 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-2bf6449f-8bc2-4843-8255-e9c07a524a20 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:09.727931 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-2bf6449f-8bc2-4843-8255-e9c07a524a20 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: 9e985a36-586a-4546-a0c0-1a3e3da330c9] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:09.738267 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2bf6449f-8bc2-4843-8255-e9c07a524a20 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:09.739211 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2bf6449f-8bc2-4843-8255-e9c07a524a20 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:09.739514 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2bf6449f-8bc2-4843-8255-e9c07a524a20 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:09.739902 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2bf6449f-8bc2-4843-8255-e9c07a524a20 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:09.897600 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-2bf6449f-8bc2-4843-8255-e9c07a524a20 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf92af08fa94215b4eafcacea6c63f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e7d37a0e3b4b32ae99c3bc15a831e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:09.909351 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-2bf6449f-8bc2-4843-8255-e9c07a524a20 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "GET /compute/v2.1/servers/9e985a36-586a-4546-a0c0-1a3e3da330c9" status: 200 len: 1275 microversion: 2.1 time: 0.188588 Jul 23 21:15:09.918282 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 288/533] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:09 2022] GET /compute/v2.1/servers/9e985a36-586a-4546-a0c0-1a3e3da330c9 => generated 1275 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:09.923728 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-20d9083e-3759-465a-9fd9-4054f6b33351 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:09.924344 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-20d9083e-3759-465a-9fd9-4054f6b33351 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 769ee4e5-e4df-4d4e-9f4c-6372c60d9e01] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:09.934530 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-20d9083e-3759-465a-9fd9-4054f6b33351 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:09.934982 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-20d9083e-3759-465a-9fd9-4054f6b33351 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:09.935779 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-20d9083e-3759-465a-9fd9-4054f6b33351 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:09.936492 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-20d9083e-3759-465a-9fd9-4054f6b33351 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:10.292076 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-20d9083e-3759-465a-9fd9-4054f6b33351 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:10.306320 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-20d9083e-3759-465a-9fd9-4054f6b33351 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/769ee4e5-e4df-4d4e-9f4c-6372c60d9e01" status: 200 len: 1475 microversion: 2.1 time: 0.386509 Jul 23 21:15:10.315873 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 289/534] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:09 2022] GET /compute/v2.1/servers/769ee4e5-e4df-4d4e-9f4c-6372c60d9e01 => generated 1475 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:10.316494 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f675e08d-1d06-488a-805c-e2997818d80e tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:10.317672 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:15:10.317672 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:15:10.319059 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f675e08d-1d06-488a-805c-e2997818d80e tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:10.319516 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f675e08d-1d06-488a-805c-e2997818d80e tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:10.320951 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f675e08d-1d06-488a-805c-e2997818d80e tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:10.321400 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f675e08d-1d06-488a-805c-e2997818d80e tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:10.322447 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-9b2762e2-92c2-4ea0-99b1-d5a42aaceb17 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f1a14a59b7401d88f18ec35c91e30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c17bd813264fb9891076799e33acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:10.332688 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9b2762e2-92c2-4ea0-99b1-d5a42aaceb17 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] 10.222.0.17 "GET /compute/v2.1/servers/fc41b6cc-f603-4f7d-89cb-a7e3cee372a5" status: 200 len: 1388 microversion: 2.1 time: 0.880288 Jul 23 21:15:10.345733 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 246/535] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:09 2022] GET /compute/v2.1/servers/fc41b6cc-f603-4f7d-89cb-a7e3cee372a5 => generated 1388 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:10.356023 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f0022d1a-efd1-4b24-9c80-492316a0ccc0 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:10.357045 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f0022d1a-efd1-4b24-9c80-492316a0ccc0 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] [instance: 7b12c52a-fc64-472b-8659-4e7312fcc83a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:10.368793 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-f675e08d-1d06-488a-805c-e2997818d80e tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.058517 Jul 23 21:15:10.371288 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 290/536] 10.222.0.17 () {60 vars in 1216 bytes} [Sat Jul 23 21:15:10 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 23 21:15:10.380724 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-521c326f-e389-4df5-88ba-5967ecbebcb0 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:10.382386 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-521c326f-e389-4df5-88ba-5967ecbebcb0 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:10.384564 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f0022d1a-efd1-4b24-9c80-492316a0ccc0 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:10.387364 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f0022d1a-efd1-4b24-9c80-492316a0ccc0 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:10.390043 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f0022d1a-efd1-4b24-9c80-492316a0ccc0 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:10.391496 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f0022d1a-efd1-4b24-9c80-492316a0ccc0 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:10.392818 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-521c326f-e389-4df5-88ba-5967ecbebcb0 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:10.393466 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-521c326f-e389-4df5-88ba-5967ecbebcb0 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:10.396223 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-521c326f-e389-4df5-88ba-5967ecbebcb0 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:10.396922 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-521c326f-e389-4df5-88ba-5967ecbebcb0 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:10.718202 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-521c326f-e389-4df5-88ba-5967ecbebcb0 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:10.731196 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-521c326f-e389-4df5-88ba-5967ecbebcb0 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b" status: 200 len: 1310 microversion: 2.1 time: 0.358530 Jul 23 21:15:10.741049 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 291/537] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:10 2022] GET /compute/v2.1/servers/d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b => generated 1310 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:10.741049 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-06b9a863-1dec-4396-91b3-a6b84645e8d6 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": "auto"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:15:10.741049 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-06b9a863-1dec-4396-91b3-a6b84645e8d6 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] [instance: ed0fdfd2-3506-40c4-8e4a-bb984e946fdd] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:10.749931 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-06b9a863-1dec-4396-91b3-a6b84645e8d6 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:10.751882 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-06b9a863-1dec-4396-91b3-a6b84645e8d6 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:10.752830 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-06b9a863-1dec-4396-91b3-a6b84645e8d6 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:10.753283 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-06b9a863-1dec-4396-91b3-a6b84645e8d6 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:10.859244 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.objects.instance [None req-06b9a863-1dec-4396-91b3-a6b84645e8d6 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lazy-loading 'flavor' on Instance uuid ed0fdfd2-3506-40c4-8e4a-bb984e946fdd {{(pid=131321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:15:10.913214 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-06b9a863-1dec-4396-91b3-a6b84645e8d6 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] [instance: ed0fdfd2-3506-40c4-8e4a-bb984e946fdd] Going to try to live migrate instance to nch1-master-1 {{(pid=131321) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 23 21:15:10.932776 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f0022d1a-efd1-4b24-9c80-492316a0ccc0 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a872dad882e4694aba20eaa8c06df53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457d184c579a4016a0eec16eb9f23195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:10.946138 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f0022d1a-efd1-4b24-9c80-492316a0ccc0 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] 10.222.0.17 "GET /compute/v2.1/servers/7b12c52a-fc64-472b-8659-4e7312fcc83a" status: 200 len: 1318 microversion: 2.1 time: 0.598176 Jul 23 21:15:10.946592 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 247/538] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:10 2022] GET /compute/v2.1/servers/7b12c52a-fc64-472b-8659-4e7312fcc83a => generated 1318 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:10.955715 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-685b1a90-90aa-4bf6-9e67-57fd2c264c7e tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:10.955715 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-685b1a90-90aa-4bf6-9e67-57fd2c264c7e tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] [instance: 31f37ba7-d5b3-4b48-9261-47e337e06a86] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:10.975898 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-685b1a90-90aa-4bf6-9e67-57fd2c264c7e tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:10.984351 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-685b1a90-90aa-4bf6-9e67-57fd2c264c7e tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:10.987906 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-685b1a90-90aa-4bf6-9e67-57fd2c264c7e tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:10.989825 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-685b1a90-90aa-4bf6-9e67-57fd2c264c7e tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:11.622490 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-685b1a90-90aa-4bf6-9e67-57fd2c264c7e tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d3840d84f34ae5ba5d95b4c96847ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf6363b1e154ff59ee30143aee3d4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:11.633696 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-685b1a90-90aa-4bf6-9e67-57fd2c264c7e tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] 10.222.0.17 "GET /compute/v2.1/servers/31f37ba7-d5b3-4b48-9261-47e337e06a86" status: 200 len: 1322 microversion: 2.1 time: 0.686014 Jul 23 21:15:11.646662 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 248/539] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:10 2022] GET /compute/v2.1/servers/31f37ba7-d5b3-4b48-9261-47e337e06a86 => generated 1322 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:11.652124 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-07dd1136-46d6-4d45-89a7-4c8d029fa100 req-7b55576d-bdcd-46d9-80a6-acb545a39ed8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc41b6cc-f603-4f7d-89cb-a7e3cee372a5", "tag": "3e18f4f9-3b4c-4c36-997a-bc967d44787f"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:15:11.663257 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-07dd1136-46d6-4d45-89a7-4c8d029fa100 req-7b55576d-bdcd-46d9-80a6-acb545a39ed8 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:11.664182 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-07dd1136-46d6-4d45-89a7-4c8d029fa100 req-7b55576d-bdcd-46d9-80a6-acb545a39ed8 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:11.681879 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-07dd1136-46d6-4d45-89a7-4c8d029fa100 req-7b55576d-bdcd-46d9-80a6-acb545a39ed8 service nova] Creating event network-changed:3e18f4f9-3b4c-4c36-997a-bc967d44787f for instance fc41b6cc-f603-4f7d-89cb-a7e3cee372a5 on nch2-master-1 Jul 23 21:15:11.689154 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-07dd1136-46d6-4d45-89a7-4c8d029fa100 req-7b55576d-bdcd-46d9-80a6-acb545a39ed8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040529 Jul 23 21:15:11.690544 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 249/540] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:15:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:15:11.701345 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c8752a52-5e0b-42fc-a0b3-572f2cc14d26 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:11.703370 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c8752a52-5e0b-42fc-a0b3-572f2cc14d26 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: 9e985a36-586a-4546-a0c0-1a3e3da330c9] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:11.724240 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c8752a52-5e0b-42fc-a0b3-572f2cc14d26 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:11.724705 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c8752a52-5e0b-42fc-a0b3-572f2cc14d26 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:11.725559 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c8752a52-5e0b-42fc-a0b3-572f2cc14d26 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:11.731196 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c8752a52-5e0b-42fc-a0b3-572f2cc14d26 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:12.298793 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c8752a52-5e0b-42fc-a0b3-572f2cc14d26 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf92af08fa94215b4eafcacea6c63f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e7d37a0e3b4b32ae99c3bc15a831e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:12.317648 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c8752a52-5e0b-42fc-a0b3-572f2cc14d26 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "GET /compute/v2.1/servers/9e985a36-586a-4546-a0c0-1a3e3da330c9" status: 200 len: 1317 microversion: 2.1 time: 0.625454 Jul 23 21:15:12.318675 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 250/541] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:11 2022] GET /compute/v2.1/servers/9e985a36-586a-4546-a0c0-1a3e3da330c9 => generated 1317 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:12.342664 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-83f1d1b5-3eb4-4039-963e-ec7d0287072b tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:12.343434 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-83f1d1b5-3eb4-4039-963e-ec7d0287072b tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 769ee4e5-e4df-4d4e-9f4c-6372c60d9e01] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:12.354237 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-83f1d1b5-3eb4-4039-963e-ec7d0287072b tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:12.354814 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-83f1d1b5-3eb4-4039-963e-ec7d0287072b tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:12.355951 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-83f1d1b5-3eb4-4039-963e-ec7d0287072b tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:12.357218 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-83f1d1b5-3eb4-4039-963e-ec7d0287072b tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:12.918012 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=6 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:15:13.267864 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-83f1d1b5-3eb4-4039-963e-ec7d0287072b tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:13.287683 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-83f1d1b5-3eb4-4039-963e-ec7d0287072b tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/769ee4e5-e4df-4d4e-9f4c-6372c60d9e01" status: 200 len: 1475 microversion: 2.1 time: 0.956105 Jul 23 21:15:13.289380 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 251/542] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:12 2022] GET /compute/v2.1/servers/769ee4e5-e4df-4d4e-9f4c-6372c60d9e01 => generated 1475 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:13.296862 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-fde6a9ef-733b-4795-a402-5aa8b4b0295d tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:13.297921 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-fde6a9ef-733b-4795-a402-5aa8b4b0295d tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] [instance: fc41b6cc-f603-4f7d-89cb-a7e3cee372a5] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:13.313128 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fde6a9ef-733b-4795-a402-5aa8b4b0295d tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:13.314659 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fde6a9ef-733b-4795-a402-5aa8b4b0295d tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:13.315805 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fde6a9ef-733b-4795-a402-5aa8b4b0295d tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:13.317392 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fde6a9ef-733b-4795-a402-5aa8b4b0295d tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:13.617202 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-fde6a9ef-733b-4795-a402-5aa8b4b0295d tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f1a14a59b7401d88f18ec35c91e30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c17bd813264fb9891076799e33acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:13.625645 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-fde6a9ef-733b-4795-a402-5aa8b4b0295d tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] 10.222.0.17 "GET /compute/v2.1/servers/fc41b6cc-f603-4f7d-89cb-a7e3cee372a5" status: 200 len: 1388 microversion: 2.1 time: 0.334813 Jul 23 21:15:13.626786 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 252/543] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:13 2022] GET /compute/v2.1/servers/fc41b6cc-f603-4f7d-89cb-a7e3cee372a5 => generated 1388 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:13.631691 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-03f872e0-c155-407d-89f5-de09e7285e7e req-f7c64cd4-6692-43ff-a32a-5fc93437e533 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "769ee4e5-e4df-4d4e-9f4c-6372c60d9e01", "tag": "ac63fc07-76cc-4d6e-8aca-987edbb6e640"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:15:13.640609 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-03f872e0-c155-407d-89f5-de09e7285e7e req-f7c64cd4-6692-43ff-a32a-5fc93437e533 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:13.641136 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-03f872e0-c155-407d-89f5-de09e7285e7e req-f7c64cd4-6692-43ff-a32a-5fc93437e533 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:13.654537 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-03f872e0-c155-407d-89f5-de09e7285e7e req-f7c64cd4-6692-43ff-a32a-5fc93437e533 service nova] Creating event network-changed:ac63fc07-76cc-4d6e-8aca-987edbb6e640 for instance 769ee4e5-e4df-4d4e-9f4c-6372c60d9e01 on nch2-master-1 Jul 23 21:15:13.667267 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [req-03f872e0-c155-407d-89f5-de09e7285e7e req-f7c64cd4-6692-43ff-a32a-5fc93437e533 service nova] Instance 769ee4e5-e4df-4d4e-9f4c-6372c60d9e01 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=131320) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 23 21:15:13.685317 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-03f872e0-c155-407d-89f5-de09e7285e7e req-f7c64cd4-6692-43ff-a32a-5fc93437e533 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053158 Jul 23 21:15:13.685317 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 253/544] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:15:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:15:13.689835 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b0cafcee-1921-4e60-994d-8304a8b4f8e6 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:13.694066 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b0cafcee-1921-4e60-994d-8304a8b4f8e6 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:13.711343 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b0cafcee-1921-4e60-994d-8304a8b4f8e6 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:13.716068 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b0cafcee-1921-4e60-994d-8304a8b4f8e6 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:13.717624 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b0cafcee-1921-4e60-994d-8304a8b4f8e6 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:13.718799 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b0cafcee-1921-4e60-994d-8304a8b4f8e6 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:13.972786 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-06b9a863-1dec-4396-91b3-a6b84645e8d6 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/ed0fdfd2-3506-40c4-8e4a-bb984e946fdd/action" status: 202 len: 0 microversion: 2.25 time: 3.238923 Jul 23 21:15:13.976701 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 292/545] 10.222.0.17 () {62 vars in 1318 bytes} [Sat Jul 23 21:15:10 2022] POST /compute/v2.1/servers/ed0fdfd2-3506-40c4-8e4a-bb984e946fdd/action => generated 0 bytes in 3243 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:15:13.981932 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-0e092ce8-5623-475a-8b44-0026d2d6a466 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:13.982559 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-0e092ce8-5623-475a-8b44-0026d2d6a466 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] [instance: 7b12c52a-fc64-472b-8659-4e7312fcc83a] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:13.992404 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0e092ce8-5623-475a-8b44-0026d2d6a466 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:13.992851 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0e092ce8-5623-475a-8b44-0026d2d6a466 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:13.993638 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0e092ce8-5623-475a-8b44-0026d2d6a466 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:13.994116 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0e092ce8-5623-475a-8b44-0026d2d6a466 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:14.033198 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b0cafcee-1921-4e60-994d-8304a8b4f8e6 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:14.042669 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b0cafcee-1921-4e60-994d-8304a8b4f8e6 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b" status: 200 len: 1310 microversion: 2.1 time: 0.357147 Jul 23 21:15:14.044281 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 254/546] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:13 2022] GET /compute/v2.1/servers/d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b => generated 1310 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:14.049779 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-caeca8fd-fc87-45dc-bdf2-f617891cfa68 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:14.050858 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-caeca8fd-fc87-45dc-bdf2-f617891cfa68 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] [instance: 31f37ba7-d5b3-4b48-9261-47e337e06a86] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:14.070306 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-caeca8fd-fc87-45dc-bdf2-f617891cfa68 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:14.071435 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-caeca8fd-fc87-45dc-bdf2-f617891cfa68 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:14.072479 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-caeca8fd-fc87-45dc-bdf2-f617891cfa68 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:14.073337 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-caeca8fd-fc87-45dc-bdf2-f617891cfa68 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:14.244384 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-0e092ce8-5623-475a-8b44-0026d2d6a466 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a872dad882e4694aba20eaa8c06df53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457d184c579a4016a0eec16eb9f23195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:14.258783 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=78,nova_cell0:UPDATE=12 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:15:14.263743 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-0e092ce8-5623-475a-8b44-0026d2d6a466 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] 10.222.0.17 "GET /compute/v2.1/servers/7b12c52a-fc64-472b-8659-4e7312fcc83a" status: 200 len: 1468 microversion: 2.1 time: 0.285801 Jul 23 21:15:14.269817 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 293/547] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:13 2022] GET /compute/v2.1/servers/7b12c52a-fc64-472b-8659-4e7312fcc83a => generated 1468 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:14.286974 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-acaf9e62-3e95-466c-ac34-5821d5f4ae31 req-94af0d97-d21d-4ae8-bcd5-adcd93d2a3f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31f37ba7-d5b3-4b48-9261-47e337e06a86", "name": "network-vif-plugged", "status": "completed", "tag": "36f20cbc-51d2-47f5-9a05-f635c6a69ae4"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:15:14.312317 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-acaf9e62-3e95-466c-ac34-5821d5f4ae31 req-94af0d97-d21d-4ae8-bcd5-adcd93d2a3f6 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:14.315577 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-acaf9e62-3e95-466c-ac34-5821d5f4ae31 req-94af0d97-d21d-4ae8-bcd5-adcd93d2a3f6 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:14.338085 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-acaf9e62-3e95-466c-ac34-5821d5f4ae31 req-94af0d97-d21d-4ae8-bcd5-adcd93d2a3f6 service nova] Creating event network-vif-plugged:36f20cbc-51d2-47f5-9a05-f635c6a69ae4 for instance 31f37ba7-d5b3-4b48-9261-47e337e06a86 on nch1-master-1 Jul 23 21:15:14.350880 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-acaf9e62-3e95-466c-ac34-5821d5f4ae31 req-94af0d97-d21d-4ae8-bcd5-adcd93d2a3f6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079421 Jul 23 21:15:14.354579 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 294/548] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:15:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:15:14.360383 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-3e9a6e8e-cc78-4129-ae0e-e8c914c45ec3 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:14.361178 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-3e9a6e8e-cc78-4129-ae0e-e8c914c45ec3 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: 9e985a36-586a-4546-a0c0-1a3e3da330c9] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:14.368706 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3e9a6e8e-cc78-4129-ae0e-e8c914c45ec3 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:14.370001 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3e9a6e8e-cc78-4129-ae0e-e8c914c45ec3 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:14.370993 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3e9a6e8e-cc78-4129-ae0e-e8c914c45ec3 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:14.371893 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3e9a6e8e-cc78-4129-ae0e-e8c914c45ec3 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:14.430187 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-caeca8fd-fc87-45dc-bdf2-f617891cfa68 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d3840d84f34ae5ba5d95b4c96847ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf6363b1e154ff59ee30143aee3d4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:14.456719 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-caeca8fd-fc87-45dc-bdf2-f617891cfa68 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] 10.222.0.17 "GET /compute/v2.1/servers/31f37ba7-d5b3-4b48-9261-47e337e06a86" status: 200 len: 1322 microversion: 2.1 time: 0.410691 Jul 23 21:15:14.458074 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 255/549] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:14 2022] GET /compute/v2.1/servers/31f37ba7-d5b3-4b48-9261-47e337e06a86 => generated 1322 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:14.464326 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-b9a936d5-3600-47e5-927d-8dd95516cb33 req-70432eb4-2495-43d6-8007-291fb828b17f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e985a36-586a-4546-a0c0-1a3e3da330c9", "tag": "f7d5f9d8-f247-4c0e-b465-0c960879af67"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:15:14.474223 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-b9a936d5-3600-47e5-927d-8dd95516cb33 req-70432eb4-2495-43d6-8007-291fb828b17f service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:14.475020 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-b9a936d5-3600-47e5-927d-8dd95516cb33 req-70432eb4-2495-43d6-8007-291fb828b17f service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:14.488343 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-b9a936d5-3600-47e5-927d-8dd95516cb33 req-70432eb4-2495-43d6-8007-291fb828b17f service nova] Creating event network-changed:f7d5f9d8-f247-4c0e-b465-0c960879af67 for instance 9e985a36-586a-4546-a0c0-1a3e3da330c9 on nch1-master-1 Jul 23 21:15:14.494688 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-b9a936d5-3600-47e5-927d-8dd95516cb33 req-70432eb4-2495-43d6-8007-291fb828b17f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034764 Jul 23 21:15:14.495627 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 256/550] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:15:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:15:14.503159 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3af64199-37b6-4ab0-b52d-e4a5fcf71fb1 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:14.504695 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-3af64199-37b6-4ab0-b52d-e4a5fcf71fb1 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: ed0fdfd2-3506-40c4-8e4a-bb984e946fdd] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:14.513501 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3af64199-37b6-4ab0-b52d-e4a5fcf71fb1 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:14.514209 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3af64199-37b6-4ab0-b52d-e4a5fcf71fb1 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:14.515213 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3af64199-37b6-4ab0-b52d-e4a5fcf71fb1 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:14.515849 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3af64199-37b6-4ab0-b52d-e4a5fcf71fb1 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:14.691579 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-3e9a6e8e-cc78-4129-ae0e-e8c914c45ec3 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf92af08fa94215b4eafcacea6c63f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e7d37a0e3b4b32ae99c3bc15a831e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:14.706473 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-3e9a6e8e-cc78-4129-ae0e-e8c914c45ec3 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "GET /compute/v2.1/servers/9e985a36-586a-4546-a0c0-1a3e3da330c9" status: 200 len: 1317 microversion: 2.1 time: 0.350506 Jul 23 21:15:14.707945 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 295/551] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:14 2022] GET /compute/v2.1/servers/9e985a36-586a-4546-a0c0-1a3e3da330c9 => generated 1317 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:14.880908 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-81ce4884-a6f2-4b62-a823-12d10f092ca9 tempest-LiveMigrationNegativeTest-1891632565 tempest-LiveMigrationNegativeTest-1891632565-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-1580809775", "block_migration": true, "disk_over_commit": false}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:15:14.882352 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-81ce4884-a6f2-4b62-a823-12d10f092ca9 tempest-LiveMigrationNegativeTest-1891632565 tempest-LiveMigrationNegativeTest-1891632565-project-admin] [instance: 7b12c52a-fc64-472b-8659-4e7312fcc83a] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:14.890275 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-81ce4884-a6f2-4b62-a823-12d10f092ca9 tempest-LiveMigrationNegativeTest-1891632565 tempest-LiveMigrationNegativeTest-1891632565-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:14.891033 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-81ce4884-a6f2-4b62-a823-12d10f092ca9 tempest-LiveMigrationNegativeTest-1891632565 tempest-LiveMigrationNegativeTest-1891632565-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:14.892198 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-81ce4884-a6f2-4b62-a823-12d10f092ca9 tempest-LiveMigrationNegativeTest-1891632565 tempest-LiveMigrationNegativeTest-1891632565-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:14.893245 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-81ce4884-a6f2-4b62-a823-12d10f092ca9 tempest-LiveMigrationNegativeTest-1891632565 tempest-LiveMigrationNegativeTest-1891632565-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:14.923841 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.objects.instance [None req-81ce4884-a6f2-4b62-a823-12d10f092ca9 tempest-LiveMigrationNegativeTest-1891632565 tempest-LiveMigrationNegativeTest-1891632565-project-admin] Lazy-loading 'flavor' on Instance uuid 7b12c52a-fc64-472b-8659-4e7312fcc83a {{(pid=131321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:15:14.934783 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-3af64199-37b6-4ab0-b52d-e4a5fcf71fb1 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:14.946022 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-81ce4884-a6f2-4b62-a823-12d10f092ca9 tempest-LiveMigrationNegativeTest-1891632565 tempest-LiveMigrationNegativeTest-1891632565-project-admin] [instance: 7b12c52a-fc64-472b-8659-4e7312fcc83a] Going to try to live migrate instance to tempest-host-1580809775 {{(pid=131321) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 23 21:15:14.950388 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-3af64199-37b6-4ab0-b52d-e4a5fcf71fb1 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:14.952812 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-3af64199-37b6-4ab0-b52d-e4a5fcf71fb1 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:14.953811 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-81ce4884-a6f2-4b62-a823-12d10f092ca9 tempest-LiveMigrationNegativeTest-1891632565 tempest-LiveMigrationNegativeTest-1891632565-project-admin] HTTP exception thrown: Compute host tempest-host-1580809775 could not be found. Jul 23 21:15:14.955065 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-3af64199-37b6-4ab0-b52d-e4a5fcf71fb1 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/ed0fdfd2-3506-40c4-8e4a-bb984e946fdd" status: 200 len: 1567 microversion: 2.25 time: 0.458303 Jul 23 21:15:14.965455 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 257/552] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:15:14 2022] GET /compute/v2.1/servers/ed0fdfd2-3506-40c4-8e4a-bb984e946fdd => generated 1567 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:15:14.965455 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c1393411-d542-47be-bba7-e68a1daf89b2 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:14.965455 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c1393411-d542-47be-bba7-e68a1daf89b2 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 769ee4e5-e4df-4d4e-9f4c-6372c60d9e01] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:14.969359 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-81ce4884-a6f2-4b62-a823-12d10f092ca9 tempest-LiveMigrationNegativeTest-1891632565 tempest-LiveMigrationNegativeTest-1891632565-project-admin] Request method failure captured: Jul 23 21:15:14.969359 ncdv-master-1 devstack@n-api.service[131321]: request: POST /compute/v2.1/servers/7b12c52a-fc64-472b-8659-4e7312fcc83a/action HTTP/1.1 Jul 23 21:15:14.969359 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:15:14.969359 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:15:14.969359 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:15:14.969359 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 107 Jul 23 21:15:14.969359 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:15:14.969359 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:15:14.969359 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:15:14.969359 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:15:14.969359 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GTJvqZRdX__hl5980iICJ18yBUlgOZ_qS-6VO5dC6Df0YyYXGcabBbMWXTT9AC25g7YvohQI2M1Lc8xh2A01aFVaQbezBk31nMDRQ52sftF5Ix4rhbm1sggxZYrLq8KA9hqnUaNNvb9DgSgtF1TzIMNAwXKd1sGQNWCODRu1AmfWAA Jul 23 21:15:14.969359 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:15:14.969359 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:15:14.969359 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:15:14.969359 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:15:14.969359 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:15:14.969359 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:15:14.969359 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: a1e5e46ae97b4f79832de640e753f8c8 Jul 23 21:15:14.969359 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-LiveMigrationNegativeTest-1891632565 Jul 23 21:15:14.969359 ncdv-master-1 devstack@n-api.service[131321]: X-Role: admin,reader,member Jul 23 21:15:14.969359 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: admin,reader,member Jul 23 21:15:14.970788 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a1e5e46ae97b4f79832de640e753f8c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a1e5e46ae97b4f79832de640e753f8c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a1e5e46ae97b4f79832de640e753f8c8", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a1e5e46ae97b4f79832de640e753f8c8"}]}] Jul 23 21:15:14.970788 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-LiveMigrationNegativeTest-1891632565 Jul 23 21:15:14.970788 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: a1e5e46ae97b4f79832de640e753f8c8 Jul 23 21:15:14.970788 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1891632565 Jul 23 21:15:14.970788 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-LiveMigrationNegativeTest-1891632565-project-admin Jul 23 21:15:14.970788 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:15:14.970788 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:15:14.970788 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: a65178068e4e487bb27e2f152ba9b081 Jul 23 21:15:14.970788 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-LiveMigrationNegativeTest-1891632565-project-admin Jul 23 21:15:14.970788 ncdv-master-1 devstack@n-api.service[131321]: Jul 23 21:15:14.970788 ncdv-master-1 devstack@n-api.service[131321]: {"os-migrateLive": {"host": "tempest-host-1580809775", "block_migration": true, "disk_over_commit": false}} Jul 23 21:15:14.970788 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:15:14.971517 ncdv-master-1 devstack@n-api.service[131321]: exception: Compute host tempest-host-1580809775 could not be found. Jul 23 21:15:14.971517 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': '7b12c52a-fc64-472b-8659-4e7312fcc83a', 'body': {'os-migrateLive': {'host': 'tempest-host-1580809775', 'block_migration': True, 'disk_over_commit': False}}} Jul 23 21:15:14.971517 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:15:14.971517 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:15:14.971517 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Jul 23 21:15:14.971517 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Jul 23 21:15:14.971517 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 23 21:15:14.971517 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 23 21:15:14.971517 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 23 21:15:14.971517 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 23 21:15:14.971517 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 23 21:15:14.971517 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 23 21:15:14.971517 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 23 21:15:14.971517 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 23 21:15:14.971517 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 23 21:15:14.971517 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 23 21:15:14.971517 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Jul 23 21:15:14.971517 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 23 21:15:14.971517 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 23 21:15:14.972596 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 23 21:15:14.972596 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 23 21:15:14.972596 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 23 21:15:14.972596 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5355, in live_migrate Jul 23 21:15:14.972596 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Jul 23 21:15:14.972596 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 23 21:15:14.972596 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 23 21:15:14.972596 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Jul 23 21:15:14.972596 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Jul 23 21:15:14.972596 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Jul 23 21:15:14.972596 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:15:14.972596 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Jul 23 21:15:14.972596 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Jul 23 21:15:14.972596 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Jul 23 21:15:14.972596 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Jul 23 21:15:14.972596 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Jul 23 21:15:14.972596 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Jul 23 21:15:14.972596 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-1580809775 could not be found. Jul 23 21:15:14.972596 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:15:14.978345 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:15:14.978345 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:15:14.978345 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:15:14.978345 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:15:14.978345 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:15:14.978345 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:15:14.978345 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:15:14.978345 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:15:14.978345 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:15:14.978345 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:15:14.978345 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:15:14.978345 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:15:14.978345 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:15:14.978345 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:15:14.978345 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:15:14.978345 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 23 21:15:14.978345 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Jul 23 21:15:14.978345 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 23 21:15:14.978345 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-1580809775 could not be found. Jul 23 21:15:14.978345 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:15:14.981063 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:15:14.981063 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:15:14.981063 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:15:14.981063 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:15:14.981063 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:15:14.981063 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:15:14.981063 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:15:14.981063 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-1580809775 could not be found. Jul 23 21:15:14.981063 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:15:14.981063 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-81ce4884-a6f2-4b62-a823-12d10f092ca9 tempest-LiveMigrationNegativeTest-1891632565 tempest-LiveMigrationNegativeTest-1891632565-project-admin] Returning 400 to user: Compute host tempest-host-1580809775 could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:15:14.981063 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-81ce4884-a6f2-4b62-a823-12d10f092ca9 tempest-LiveMigrationNegativeTest-1891632565 tempest-LiveMigrationNegativeTest-1891632565-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/7b12c52a-fc64-472b-8659-4e7312fcc83a/action" status: 400 len: 100 microversion: 2.1 time: 0.263402 Jul 23 21:15:14.981063 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 296/553] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 23 21:15:14 2022] POST /compute/v2.1/servers/7b12c52a-fc64-472b-8659-4e7312fcc83a/action => generated 100 bytes in 265 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 23 21:15:14.982679 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-3db86a18-08fd-424a-8106-e7c81da5a6fd tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:14.982679 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-3db86a18-08fd-424a-8106-e7c81da5a6fd tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] [instance: fc41b6cc-f603-4f7d-89cb-a7e3cee372a5] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:14.982953 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c1393411-d542-47be-bba7-e68a1daf89b2 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:14.982953 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c1393411-d542-47be-bba7-e68a1daf89b2 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:14.982953 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c1393411-d542-47be-bba7-e68a1daf89b2 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:14.982953 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c1393411-d542-47be-bba7-e68a1daf89b2 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:14.987783 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3db86a18-08fd-424a-8106-e7c81da5a6fd tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:14.988233 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3db86a18-08fd-424a-8106-e7c81da5a6fd tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:14.989037 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3db86a18-08fd-424a-8106-e7c81da5a6fd tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:14.989850 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3db86a18-08fd-424a-8106-e7c81da5a6fd tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:15.145544 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-3db86a18-08fd-424a-8106-e7c81da5a6fd tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f1a14a59b7401d88f18ec35c91e30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c17bd813264fb9891076799e33acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:15.153411 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-3db86a18-08fd-424a-8106-e7c81da5a6fd tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] 10.222.0.17 "GET /compute/v2.1/servers/fc41b6cc-f603-4f7d-89cb-a7e3cee372a5" status: 200 len: 1388 microversion: 2.1 time: 0.177977 Jul 23 21:15:15.154008 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 297/554] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:14 2022] GET /compute/v2.1/servers/fc41b6cc-f603-4f7d-89cb-a7e3cee372a5 => generated 1388 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:15.159633 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-bf97a7ec-24ad-423c-b0ed-4234276bf84b tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:15.160637 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-bf97a7ec-24ad-423c-b0ed-4234276bf84b tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] [instance: 7b12c52a-fc64-472b-8659-4e7312fcc83a] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:15.167902 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bf97a7ec-24ad-423c-b0ed-4234276bf84b tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:15.168432 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bf97a7ec-24ad-423c-b0ed-4234276bf84b tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:15.169939 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bf97a7ec-24ad-423c-b0ed-4234276bf84b tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:15.170380 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bf97a7ec-24ad-423c-b0ed-4234276bf84b tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:15.325616 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-bf97a7ec-24ad-423c-b0ed-4234276bf84b tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a872dad882e4694aba20eaa8c06df53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457d184c579a4016a0eec16eb9f23195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:15.336774 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-bf97a7ec-24ad-423c-b0ed-4234276bf84b tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] 10.222.0.17 "GET /compute/v2.1/servers/7b12c52a-fc64-472b-8659-4e7312fcc83a" status: 200 len: 1468 microversion: 2.1 time: 0.181485 Jul 23 21:15:15.338811 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c1393411-d542-47be-bba7-e68a1daf89b2 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:15.345265 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=100 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:15:15.355965 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c1393411-d542-47be-bba7-e68a1daf89b2 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/769ee4e5-e4df-4d4e-9f4c-6372c60d9e01" status: 200 len: 1470 microversion: 2.1 time: 0.398857 Jul 23 21:15:15.359539 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 298/555] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:15 2022] GET /compute/v2.1/servers/7b12c52a-fc64-472b-8659-4e7312fcc83a => generated 1468 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:15.366385 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 258/556] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:14 2022] GET /compute/v2.1/servers/769ee4e5-e4df-4d4e-9f4c-6372c60d9e01 => generated 1470 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:15.369248 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a5291701-cdb8-471f-abf1-e636e365b3f8 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:15.370197 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-a5291701-cdb8-471f-abf1-e636e365b3f8 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:15.378959 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1bbf4fbe-3f61-44e2-b9d8-ddac5c173b26 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:15:15.379502 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1bbf4fbe-3f61-44e2-b9d8-ddac5c173b26 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 769ee4e5-e4df-4d4e-9f4c-6372c60d9e01] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:15.388803 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a5291701-cdb8-471f-abf1-e636e365b3f8 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:15.389621 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a5291701-cdb8-471f-abf1-e636e365b3f8 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:15.390712 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a5291701-cdb8-471f-abf1-e636e365b3f8 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:15.391519 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a5291701-cdb8-471f-abf1-e636e365b3f8 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:15.398682 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1bbf4fbe-3f61-44e2-b9d8-ddac5c173b26 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:15.399144 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1bbf4fbe-3f61-44e2-b9d8-ddac5c173b26 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:15.399977 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1bbf4fbe-3f61-44e2-b9d8-ddac5c173b26 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:15.400424 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1bbf4fbe-3f61-44e2-b9d8-ddac5c173b26 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:15.490268 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1bbf4fbe-3f61-44e2-b9d8-ddac5c173b26 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "POST /compute/v2.1/servers/769ee4e5-e4df-4d4e-9f4c-6372c60d9e01/action" status: 204 len: 0 microversion: 2.1 time: 0.116783 Jul 23 21:15:15.491669 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 259/557] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:15:15 2022] POST /compute/v2.1/servers/769ee4e5-e4df-4d4e-9f4c-6372c60d9e01/action => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:15:15.500121 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3c8bce3f-debe-4332-b40c-950375f0d3a2 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:15.503415 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-3c8bce3f-debe-4332-b40c-950375f0d3a2 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] [instance: 31f37ba7-d5b3-4b48-9261-47e337e06a86] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:15.513020 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3c8bce3f-debe-4332-b40c-950375f0d3a2 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:15.513943 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3c8bce3f-debe-4332-b40c-950375f0d3a2 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:15.515110 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3c8bce3f-debe-4332-b40c-950375f0d3a2 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:15.515791 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3c8bce3f-debe-4332-b40c-950375f0d3a2 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:16.031943 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-a5291701-cdb8-471f-abf1-e636e365b3f8 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:16.048877 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-a5291701-cdb8-471f-abf1-e636e365b3f8 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b" status: 200 len: 1310 microversion: 2.1 time: 0.687155 Jul 23 21:15:16.052693 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 299/558] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:15 2022] GET /compute/v2.1/servers/d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b => generated 1310 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:16.059961 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-cfd53da4-721b-481c-ba75-6896d4ffead9 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:16.060858 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-cfd53da4-721b-481c-ba75-6896d4ffead9 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 769ee4e5-e4df-4d4e-9f4c-6372c60d9e01] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:16.074870 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cfd53da4-721b-481c-ba75-6896d4ffead9 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:16.075424 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cfd53da4-721b-481c-ba75-6896d4ffead9 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:16.076255 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cfd53da4-721b-481c-ba75-6896d4ffead9 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:16.076542 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cfd53da4-721b-481c-ba75-6896d4ffead9 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:16.104075 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:15:16.335579 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-3c8bce3f-debe-4332-b40c-950375f0d3a2 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d3840d84f34ae5ba5d95b4c96847ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf6363b1e154ff59ee30143aee3d4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:16.347595 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-3c8bce3f-debe-4332-b40c-950375f0d3a2 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] 10.222.0.17 "GET /compute/v2.1/servers/31f37ba7-d5b3-4b48-9261-47e337e06a86" status: 200 len: 1322 microversion: 2.1 time: 0.853968 Jul 23 21:15:16.349032 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 260/559] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:15 2022] GET /compute/v2.1/servers/31f37ba7-d5b3-4b48-9261-47e337e06a86 => generated 1322 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:16.357467 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-19db7a2f-36cd-4de9-a3cc-7433e2c577f9 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-850685214", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:15:16.420474 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-cfd53da4-721b-481c-ba75-6896d4ffead9 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:16.425958 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-19db7a2f-36cd-4de9-a3cc-7433e2c577f9 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] validate_networks() for None {{(pid=131320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:15:16.435635 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-cfd53da4-721b-481c-ba75-6896d4ffead9 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/769ee4e5-e4df-4d4e-9f4c-6372c60d9e01" status: 200 len: 1470 microversion: 2.1 time: 0.380869 Jul 23 21:15:16.443298 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 300/560] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:16 2022] GET /compute/v2.1/servers/769ee4e5-e4df-4d4e-9f4c-6372c60d9e01 => generated 1470 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:16.448613 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-4739b497-4a4a-45a0-84b3-491e90a6c692 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:16.449365 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-4739b497-4a4a-45a0-84b3-491e90a6c692 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: 9e985a36-586a-4546-a0c0-1a3e3da330c9] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:16.456557 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4739b497-4a4a-45a0-84b3-491e90a6c692 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:16.457243 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4739b497-4a4a-45a0-84b3-491e90a6c692 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:16.458244 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4739b497-4a4a-45a0-84b3-491e90a6c692 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:16.458688 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4739b497-4a4a-45a0-84b3-491e90a6c692 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:16.643779 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell0:SELECT=28 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:15:16.717653 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-4739b497-4a4a-45a0-84b3-491e90a6c692 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf92af08fa94215b4eafcacea6c63f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e7d37a0e3b4b32ae99c3bc15a831e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:16.727874 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-4739b497-4a4a-45a0-84b3-491e90a6c692 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "GET /compute/v2.1/servers/9e985a36-586a-4546-a0c0-1a3e3da330c9" status: 200 len: 1317 microversion: 2.1 time: 0.283046 Jul 23 21:15:16.728587 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 301/561] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:16 2022] GET /compute/v2.1/servers/9e985a36-586a-4546-a0c0-1a3e3da330c9 => generated 1317 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:16.733401 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-6e73d481-a79a-40a0-94f9-5ba9cc300286 req-4d370f86-66eb-42d4-a069-c74baf047ba4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b", "tag": "514e8daf-fac6-48ba-9a0d-0c9edf5b2d8e"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:15:16.741894 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-6e73d481-a79a-40a0-94f9-5ba9cc300286 req-4d370f86-66eb-42d4-a069-c74baf047ba4 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:16.742491 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-6e73d481-a79a-40a0-94f9-5ba9cc300286 req-4d370f86-66eb-42d4-a069-c74baf047ba4 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:16.755188 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-6e73d481-a79a-40a0-94f9-5ba9cc300286 req-4d370f86-66eb-42d4-a069-c74baf047ba4 service nova] Creating event network-changed:514e8daf-fac6-48ba-9a0d-0c9edf5b2d8e for instance d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b on nch1-master-1 Jul 23 21:15:16.760511 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-6e73d481-a79a-40a0-94f9-5ba9cc300286 req-4d370f86-66eb-42d4-a069-c74baf047ba4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030489 Jul 23 21:15:16.761729 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 302/562] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:15:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:15:16.767403 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-31c173cf-9b6b-453a-8708-30dd61de1766 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:16.768377 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-31c173cf-9b6b-453a-8708-30dd61de1766 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: ed0fdfd2-3506-40c4-8e4a-bb984e946fdd] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:16.775988 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-31c173cf-9b6b-453a-8708-30dd61de1766 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:16.776675 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-31c173cf-9b6b-453a-8708-30dd61de1766 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:16.777885 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-31c173cf-9b6b-453a-8708-30dd61de1766 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:16.778555 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-31c173cf-9b6b-453a-8708-30dd61de1766 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:16.846590 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-19db7a2f-36cd-4de9-a3cc-7433e2c577f9 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:15:16.847116 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-19db7a2f-36cd-4de9-a3cc-7433e2c577f9 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:15:16.847807 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-19db7a2f-36cd-4de9-a3cc-7433e2c577f9 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:15:16.848107 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-19db7a2f-36cd-4de9-a3cc-7433e2c577f9 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:15:16.848924 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-19db7a2f-36cd-4de9-a3cc-7433e2c577f9 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:15:16.861790 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-19db7a2f-36cd-4de9-a3cc-7433e2c577f9 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:16.862609 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-19db7a2f-36cd-4de9-a3cc-7433e2c577f9 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:16.863557 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-19db7a2f-36cd-4de9-a3cc-7433e2c577f9 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:16.864005 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-19db7a2f-36cd-4de9-a3cc-7433e2c577f9 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:16.884509 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-19db7a2f-36cd-4de9-a3cc-7433e2c577f9 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Getting quotas for project 457d184c579a4016a0eec16eb9f23195. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:15:16.890559 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-19db7a2f-36cd-4de9-a3cc-7433e2c577f9 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Getting quotas for user 8a872dad882e4694aba20eaa8c06df53 and project 457d184c579a4016a0eec16eb9f23195. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:15:16.905691 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-19db7a2f-36cd-4de9-a3cc-7433e2c577f9 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Going to run 1 instances... {{(pid=131320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:15:16.908166 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-19db7a2f-36cd-4de9-a3cc-7433e2c577f9 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] [instance: 70997419-42ea-46b3-a1bd-127efc670cd2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:15:16.932101 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-31c173cf-9b6b-453a-8708-30dd61de1766 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:16.942360 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-31c173cf-9b6b-453a-8708-30dd61de1766 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:16.944776 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-31c173cf-9b6b-453a-8708-30dd61de1766 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:16.946167 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-31c173cf-9b6b-453a-8708-30dd61de1766 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/ed0fdfd2-3506-40c4-8e4a-bb984e946fdd" status: 200 len: 1567 microversion: 2.25 time: 0.183079 Jul 23 21:15:16.947128 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 303/563] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:15:16 2022] GET /compute/v2.1/servers/ed0fdfd2-3506-40c4-8e4a-bb984e946fdd => generated 1567 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:15:16.952041 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-402e8232-0588-48d2-bc09-6a21671d337b tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:16.953089 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-402e8232-0588-48d2-bc09-6a21671d337b tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] [instance: fc41b6cc-f603-4f7d-89cb-a7e3cee372a5] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:16.959453 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-402e8232-0588-48d2-bc09-6a21671d337b tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:16.959907 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-402e8232-0588-48d2-bc09-6a21671d337b tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:16.960693 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-402e8232-0588-48d2-bc09-6a21671d337b tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:16.961133 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-402e8232-0588-48d2-bc09-6a21671d337b tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:16.992243 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-19db7a2f-36cd-4de9-a3cc-7433e2c577f9 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.641937 Jul 23 21:15:16.996761 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 261/564] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:15:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 647 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 23 21:15:17.076401 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-92f32c3b-c6b9-47c6-9079-57ba0871e113 tempest-FloatingIPsTestJSON-443811915 tempest-FloatingIPsTestJSON-443811915-project] Action: 'create', calling method: .version_select at 0x7f0b47ccdb80>, body: {"pool": null} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:15:17.350421 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-402e8232-0588-48d2-bc09-6a21671d337b tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f1a14a59b7401d88f18ec35c91e30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c17bd813264fb9891076799e33acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:17.362133 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-402e8232-0588-48d2-bc09-6a21671d337b tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] 10.222.0.17 "GET /compute/v2.1/servers/fc41b6cc-f603-4f7d-89cb-a7e3cee372a5" status: 200 len: 1388 microversion: 2.1 time: 0.413368 Jul 23 21:15:17.364109 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 304/565] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:16 2022] GET /compute/v2.1/servers/fc41b6cc-f603-4f7d-89cb-a7e3cee372a5 => generated 1388 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:17.369229 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-440b7a1c-df3a-4619-b15a-6ee780e5a381 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:17.370270 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-440b7a1c-df3a-4619-b15a-6ee780e5a381 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] [instance: 70997419-42ea-46b3-a1bd-127efc670cd2] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:17.458587 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-440b7a1c-df3a-4619-b15a-6ee780e5a381 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a872dad882e4694aba20eaa8c06df53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457d184c579a4016a0eec16eb9f23195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:17.465264 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-440b7a1c-df3a-4619-b15a-6ee780e5a381 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] 10.222.0.17 "GET /compute/v2.1/servers/70997419-42ea-46b3-a1bd-127efc670cd2" status: 200 len: 1218 microversion: 2.1 time: 0.099689 Jul 23 21:15:17.465848 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 305/566] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:17 2022] GET /compute/v2.1/servers/70997419-42ea-46b3-a1bd-127efc670cd2 => generated 1218 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:17.472437 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-4aee6b29-3ae1-4699-aa65-f5f604326b59 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:17.478915 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-4aee6b29-3ae1-4699-aa65-f5f604326b59 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:17.497855 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4aee6b29-3ae1-4699-aa65-f5f604326b59 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:17.498657 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4aee6b29-3ae1-4699-aa65-f5f604326b59 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:17.499788 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4aee6b29-3ae1-4699-aa65-f5f604326b59 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:17.500420 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4aee6b29-3ae1-4699-aa65-f5f604326b59 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:17.956624 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-4aee6b29-3ae1-4699-aa65-f5f604326b59 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:17.967544 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-4aee6b29-3ae1-4699-aa65-f5f604326b59 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b" status: 200 len: 1310 microversion: 2.1 time: 0.498788 Jul 23 21:15:17.979049 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 306/567] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:17 2022] GET /compute/v2.1/servers/d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b => generated 1310 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:17.985422 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c72cc2b8-7cd5-4ac4-92a1-508032b8c612 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:17.986325 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-c72cc2b8-7cd5-4ac4-92a1-508032b8c612 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] [instance: 31f37ba7-d5b3-4b48-9261-47e337e06a86] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:17.993323 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c72cc2b8-7cd5-4ac4-92a1-508032b8c612 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:17.994077 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c72cc2b8-7cd5-4ac4-92a1-508032b8c612 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:17.995039 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c72cc2b8-7cd5-4ac4-92a1-508032b8c612 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:17.995703 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c72cc2b8-7cd5-4ac4-92a1-508032b8c612 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:18.718888 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c72cc2b8-7cd5-4ac4-92a1-508032b8c612 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d3840d84f34ae5ba5d95b4c96847ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf6363b1e154ff59ee30143aee3d4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:18.737051 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-c72cc2b8-7cd5-4ac4-92a1-508032b8c612 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] 10.222.0.17 "GET /compute/v2.1/servers/31f37ba7-d5b3-4b48-9261-47e337e06a86" status: 200 len: 1472 microversion: 2.1 time: 0.755720 Jul 23 21:15:18.740758 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 307/568] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:17 2022] GET /compute/v2.1/servers/31f37ba7-d5b3-4b48-9261-47e337e06a86 => generated 1472 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:18.753637 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c6016036-c6b9-4c11-9520-344ac680271f tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:18.754472 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-c6016036-c6b9-4c11-9520-344ac680271f tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 769ee4e5-e4df-4d4e-9f4c-6372c60d9e01] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:18.760732 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c6016036-c6b9-4c11-9520-344ac680271f tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:18.761469 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c6016036-c6b9-4c11-9520-344ac680271f tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:18.762653 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c6016036-c6b9-4c11-9520-344ac680271f tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:18.763241 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c6016036-c6b9-4c11-9520-344ac680271f tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:19.207389 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c6016036-c6b9-4c11-9520-344ac680271f tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:19.220330 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-c6016036-c6b9-4c11-9520-344ac680271f tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/769ee4e5-e4df-4d4e-9f4c-6372c60d9e01" status: 200 len: 1470 microversion: 2.1 time: 0.471166 Jul 23 21:15:19.221378 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 308/569] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:18 2022] GET /compute/v2.1/servers/769ee4e5-e4df-4d4e-9f4c-6372c60d9e01 => generated 1470 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:19.235615 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-09851fe4-e736-42b2-aa77-94fbaa6f94d9 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:19.236475 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-09851fe4-e736-42b2-aa77-94fbaa6f94d9 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: 9e985a36-586a-4546-a0c0-1a3e3da330c9] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:19.247596 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-09851fe4-e736-42b2-aa77-94fbaa6f94d9 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:19.248528 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-09851fe4-e736-42b2-aa77-94fbaa6f94d9 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:19.249551 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-09851fe4-e736-42b2-aa77-94fbaa6f94d9 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:19.250243 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-09851fe4-e736-42b2-aa77-94fbaa6f94d9 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:19.612227 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-09851fe4-e736-42b2-aa77-94fbaa6f94d9 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf92af08fa94215b4eafcacea6c63f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e7d37a0e3b4b32ae99c3bc15a831e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:19.624374 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-09851fe4-e736-42b2-aa77-94fbaa6f94d9 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "GET /compute/v2.1/servers/9e985a36-586a-4546-a0c0-1a3e3da330c9" status: 200 len: 1317 microversion: 2.1 time: 0.400686 Jul 23 21:15:19.625083 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 309/570] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:19 2022] GET /compute/v2.1/servers/9e985a36-586a-4546-a0c0-1a3e3da330c9 => generated 1317 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:19.632540 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-1a056f51-3db1-44de-88fb-be3658c8b25e tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:19.633406 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-1a056f51-3db1-44de-88fb-be3658c8b25e tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: ed0fdfd2-3506-40c4-8e4a-bb984e946fdd] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:19.645460 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1a056f51-3db1-44de-88fb-be3658c8b25e tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:19.646353 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1a056f51-3db1-44de-88fb-be3658c8b25e tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:19.649319 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1a056f51-3db1-44de-88fb-be3658c8b25e tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:19.650907 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1a056f51-3db1-44de-88fb-be3658c8b25e tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:19.893795 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-92f32c3b-c6b9-47c6-9079-57ba0871e113 tempest-FloatingIPsTestJSON-443811915 tempest-FloatingIPsTestJSON-443811915-project] 10.222.0.17 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.895535 Jul 23 21:15:19.906774 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 262/571] 10.222.0.17 () {60 vars in 1169 bytes} [Sat Jul 23 21:15:16 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2909 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:15:19.923995 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c87250e9-ad24-4c74-80f1-6f454ab87f16 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:19.930941 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c87250e9-ad24-4c74-80f1-6f454ab87f16 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] [instance: fc41b6cc-f603-4f7d-89cb-a7e3cee372a5] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:19.960774 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c87250e9-ad24-4c74-80f1-6f454ab87f16 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:19.962811 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c87250e9-ad24-4c74-80f1-6f454ab87f16 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:19.964134 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c87250e9-ad24-4c74-80f1-6f454ab87f16 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:19.965433 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c87250e9-ad24-4c74-80f1-6f454ab87f16 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:20.009835 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-1a056f51-3db1-44de-88fb-be3658c8b25e tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:20.024641 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-1a056f51-3db1-44de-88fb-be3658c8b25e tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:20.032154 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-1a056f51-3db1-44de-88fb-be3658c8b25e tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:20.033963 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-1a056f51-3db1-44de-88fb-be3658c8b25e tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/ed0fdfd2-3506-40c4-8e4a-bb984e946fdd" status: 200 len: 1567 microversion: 2.25 time: 0.407704 Jul 23 21:15:20.036964 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 310/572] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:15:19 2022] GET /compute/v2.1/servers/ed0fdfd2-3506-40c4-8e4a-bb984e946fdd => generated 1567 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:15:20.051070 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-c778197d-2d13-4d81-9b8a-e1d97e17cb96 req-30d14405-b77e-4fe2-a574-93eab617ac3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "769ee4e5-e4df-4d4e-9f4c-6372c60d9e01", "name": "network-vif-plugged", "status": "completed", "tag": "ac63fc07-76cc-4d6e-8aca-987edbb6e640"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:15:20.071806 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-c778197d-2d13-4d81-9b8a-e1d97e17cb96 req-30d14405-b77e-4fe2-a574-93eab617ac3c service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:20.073001 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-c778197d-2d13-4d81-9b8a-e1d97e17cb96 req-30d14405-b77e-4fe2-a574-93eab617ac3c service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:20.089064 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-c778197d-2d13-4d81-9b8a-e1d97e17cb96 req-30d14405-b77e-4fe2-a574-93eab617ac3c service nova] Creating event network-vif-plugged:ac63fc07-76cc-4d6e-8aca-987edbb6e640 for instance 769ee4e5-e4df-4d4e-9f4c-6372c60d9e01 on nch2-master-1 Jul 23 21:15:20.094266 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-c778197d-2d13-4d81-9b8a-e1d97e17cb96 req-30d14405-b77e-4fe2-a574-93eab617ac3c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054919 Jul 23 21:15:20.094965 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 311/573] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:15:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:15:20.100748 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-4386f548-040b-411f-bcb8-bc37ff797a0d tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:20.101537 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-4386f548-040b-411f-bcb8-bc37ff797a0d tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] [instance: 70997419-42ea-46b3-a1bd-127efc670cd2] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:20.109451 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4386f548-040b-411f-bcb8-bc37ff797a0d tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:20.110078 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4386f548-040b-411f-bcb8-bc37ff797a0d tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:20.111325 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4386f548-040b-411f-bcb8-bc37ff797a0d tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:20.111801 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4386f548-040b-411f-bcb8-bc37ff797a0d tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:20.191840 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-4386f548-040b-411f-bcb8-bc37ff797a0d tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a872dad882e4694aba20eaa8c06df53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457d184c579a4016a0eec16eb9f23195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:20.204492 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-4386f548-040b-411f-bcb8-bc37ff797a0d tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] 10.222.0.17 "GET /compute/v2.1/servers/70997419-42ea-46b3-a1bd-127efc670cd2" status: 200 len: 1276 microversion: 2.1 time: 0.108071 Jul 23 21:15:20.205784 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 312/574] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:20 2022] GET /compute/v2.1/servers/70997419-42ea-46b3-a1bd-127efc670cd2 => generated 1276 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:20.219563 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-26d959fc-92ab-4318-a186-0b5b05be1da9 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:20.220641 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-26d959fc-92ab-4318-a186-0b5b05be1da9 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] [instance: 31f37ba7-d5b3-4b48-9261-47e337e06a86] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:20.227132 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-26d959fc-92ab-4318-a186-0b5b05be1da9 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:20.227688 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-26d959fc-92ab-4318-a186-0b5b05be1da9 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:20.228541 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-26d959fc-92ab-4318-a186-0b5b05be1da9 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:20.229036 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-26d959fc-92ab-4318-a186-0b5b05be1da9 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:20.256174 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-26d959fc-92ab-4318-a186-0b5b05be1da9 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '90d3840d84f34ae5ba5d95b4c96847ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf6363b1e154ff59ee30143aee3d4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:20.257421 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-26d959fc-92ab-4318-a186-0b5b05be1da9 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Request method failure captured: Jul 23 21:15:20.257421 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/servers/31f37ba7-d5b3-4b48-9261-47e337e06a86/diagnostics HTTP/1.1 Jul 23 21:15:20.257421 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:15:20.257421 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:15:20.257421 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:15:20.257421 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:15:20.257421 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:15:20.257421 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:15:20.257421 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:15:20.257421 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:15:20.257421 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GTMBp5d59dLoZFkVv-0PujKjzwKskAudDxCiog65H7s2PIb673GIGHrPmNfOgPxVvtjPgTwVS-MdTMaltPYGI4dETzpep4UWsqR78VVk7-zIjqWct3ht2GjJtC7EHiXWwxGhBo6GFYu6Z1uF2wFgpca5jE0zsKn_D8IfonNNsk3WxM Jul 23 21:15:20.257421 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:15:20.257421 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:15:20.257421 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:15:20.257421 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:15:20.257421 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:15:20.257421 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:15:20.257421 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: fcf6363b1e154ff59ee30143aee3d4f1 Jul 23 21:15:20.257421 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-519689208 Jul 23 21:15:20.257421 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:15:20.257421 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:15:20.258940 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fcf6363b1e154ff59ee30143aee3d4f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fcf6363b1e154ff59ee30143aee3d4f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_fcf6363b1e154ff59ee30143aee3d4f1", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/fcf6363b1e154ff59ee30143aee3d4f1"}]}] Jul 23 21:15:20.258940 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-519689208 Jul 23 21:15:20.258940 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: fcf6363b1e154ff59ee30143aee3d4f1 Jul 23 21:15:20.258940 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-519689208 Jul 23 21:15:20.258940 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ServerDiagnosticsNegativeTest-519689208-project Jul 23 21:15:20.258940 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:15:20.258940 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:15:20.258940 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 90d3840d84f34ae5ba5d95b4c96847ba Jul 23 21:15:20.258940 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-519689208-project Jul 23 21:15:20.258940 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:15:20.258940 ncdv-master-1 devstack@n-api.service[131321]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jul 23 21:15:20.259608 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'server_id': '31f37ba7-d5b3-4b48-9261-47e337e06a86'} Jul 23 21:15:20.259608 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:15:20.259608 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:15:20.259608 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:15:20.259608 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:15:20.259608 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:15:20.259608 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:15:20.259608 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:15:20.259608 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:15:20.259608 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Jul 23 21:15:20.259608 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Jul 23 21:15:20.259608 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 23 21:15:20.259608 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 23 21:15:20.259608 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 23 21:15:20.259608 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 23 21:15:20.259608 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 23 21:15:20.259608 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 23 21:15:20.259608 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 23 21:15:20.259608 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise self.value Jul 23 21:15:20.259608 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 23 21:15:20.261157 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 23 21:15:20.261157 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 23 21:15:20.261157 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 23 21:15:20.261157 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 23 21:15:20.261157 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 23 21:15:20.261157 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jul 23 21:15:20.261157 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:15:20.261157 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:15:20.261157 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:15:20.261157 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:15:20.261157 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:15:20.261157 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:15:20.261157 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 23 21:15:20.261157 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 23 21:15:20.261157 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jul 23 21:15:20.261157 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:15:20.261157 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-26d959fc-92ab-4318-a186-0b5b05be1da9 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:15:20.262195 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-26d959fc-92ab-4318-a186-0b5b05be1da9 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] 10.222.0.17 "GET /compute/v2.1/servers/31f37ba7-d5b3-4b48-9261-47e337e06a86/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.051773 Jul 23 21:15:20.264731 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 313/575] 10.222.0.17 () {58 vars in 1271 bytes} [Sat Jul 23 21:15:20 2022] GET /compute/v2.1/servers/31f37ba7-d5b3-4b48-9261-47e337e06a86/diagnostics => generated 117 bytes in 58 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:15:20.267601 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c87250e9-ad24-4c74-80f1-6f454ab87f16 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f1a14a59b7401d88f18ec35c91e30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c17bd813264fb9891076799e33acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:20.269701 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-861cf804-8d0b-41a9-86c1-cc96671bec8c tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:20.270410 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-861cf804-8d0b-41a9-86c1-cc96671bec8c tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:20.277650 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-861cf804-8d0b-41a9-86c1-cc96671bec8c tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:20.278222 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-861cf804-8d0b-41a9-86c1-cc96671bec8c tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:20.279367 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-861cf804-8d0b-41a9-86c1-cc96671bec8c tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:20.279875 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-861cf804-8d0b-41a9-86c1-cc96671bec8c tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:20.283045 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c87250e9-ad24-4c74-80f1-6f454ab87f16 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] 10.222.0.17 "GET /compute/v2.1/servers/fc41b6cc-f603-4f7d-89cb-a7e3cee372a5" status: 200 len: 1388 microversion: 2.1 time: 0.374059 Jul 23 21:15:20.293062 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 263/576] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:19 2022] GET /compute/v2.1/servers/fc41b6cc-f603-4f7d-89cb-a7e3cee372a5 => generated 1388 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:20.299452 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-646231e5-f9d4-4dde-9e05-43876d9b8727 req-79ec5389-5024-4e7b-9d90-75d52aaf65c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed0fdfd2-3506-40c4-8e4a-bb984e946fdd", "name": "network-vif-unplugged", "status": "completed", "tag": "1e9171bb-cfe1-4d9d-b4e2-14b9c65df29e"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:15:20.308265 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-646231e5-f9d4-4dde-9e05-43876d9b8727 req-79ec5389-5024-4e7b-9d90-75d52aaf65c0 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:20.308893 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-646231e5-f9d4-4dde-9e05-43876d9b8727 req-79ec5389-5024-4e7b-9d90-75d52aaf65c0 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:20.322911 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-646231e5-f9d4-4dde-9e05-43876d9b8727 req-79ec5389-5024-4e7b-9d90-75d52aaf65c0 service nova] Creating event network-vif-unplugged:1e9171bb-cfe1-4d9d-b4e2-14b9c65df29e for instance ed0fdfd2-3506-40c4-8e4a-bb984e946fdd on nch2-master-1 Jul 23 21:15:20.329639 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-646231e5-f9d4-4dde-9e05-43876d9b8727 req-79ec5389-5024-4e7b-9d90-75d52aaf65c0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036204 Jul 23 21:15:20.332663 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell0:SELECT=6 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:15:20.333530 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 264/577] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:15:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:15:20.339884 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-94e46645-74d1-4b8a-b1fc-4f97c7ecbe6e tempest-FloatingIPsTestJSON-443811915 tempest-FloatingIPsTestJSON-443811915-project] Calling method '.version_select at 0x7f0b47d08700>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:20.428695 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-861cf804-8d0b-41a9-86c1-cc96671bec8c tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:20.451218 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-861cf804-8d0b-41a9-86c1-cc96671bec8c tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b" status: 200 len: 1310 microversion: 2.1 time: 0.184938 Jul 23 21:15:20.453275 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 314/578] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:20 2022] GET /compute/v2.1/servers/d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b => generated 1310 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:20.465478 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ee8f6418-f8d9-40a0-8822-ec348c7528dc tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:20.467580 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-ee8f6418-f8d9-40a0-8822-ec348c7528dc tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 769ee4e5-e4df-4d4e-9f4c-6372c60d9e01] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:20.475427 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ee8f6418-f8d9-40a0-8822-ec348c7528dc tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:20.476172 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ee8f6418-f8d9-40a0-8822-ec348c7528dc tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:20.476941 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ee8f6418-f8d9-40a0-8822-ec348c7528dc tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:20.477456 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ee8f6418-f8d9-40a0-8822-ec348c7528dc tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:20.642295 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ee8f6418-f8d9-40a0-8822-ec348c7528dc tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:20.657473 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-94e46645-74d1-4b8a-b1fc-4f97c7ecbe6e tempest-FloatingIPsTestJSON-443811915 tempest-FloatingIPsTestJSON-443811915-project] 10.222.0.17 "GET /compute/v2.1/os-floating-ips/f3d90e96-0092-42fe-8b2b-f21c1364166e" status: 200 len: 142 microversion: 2.1 time: 0.322506 Jul 23 21:15:20.666736 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 265/579] 10.222.0.17 () {58 vars in 1259 bytes} [Sat Jul 23 21:15:20 2022] GET /compute/v2.1/os-floating-ips/f3d90e96-0092-42fe-8b2b-f21c1364166e => generated 142 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:15:20.680852 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b76d933a-fae5-4d30-b099-68138201b621 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:20.681829 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b76d933a-fae5-4d30-b099-68138201b621 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] [instance: 31f37ba7-d5b3-4b48-9261-47e337e06a86] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:20.684260 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-ee8f6418-f8d9-40a0-8822-ec348c7528dc tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/769ee4e5-e4df-4d4e-9f4c-6372c60d9e01" status: 200 len: 1462 microversion: 2.1 time: 0.228808 Jul 23 21:15:20.690139 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 315/580] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:20 2022] GET /compute/v2.1/servers/769ee4e5-e4df-4d4e-9f4c-6372c60d9e01 => generated 1462 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:20.696003 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b76d933a-fae5-4d30-b099-68138201b621 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:20.696593 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-2972e452-6e24-48e2-974e-6de4600b4b63 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:20.697213 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-2972e452-6e24-48e2-974e-6de4600b4b63 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: 9e985a36-586a-4546-a0c0-1a3e3da330c9] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:20.698081 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b76d933a-fae5-4d30-b099-68138201b621 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:20.699514 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b76d933a-fae5-4d30-b099-68138201b621 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:20.700334 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b76d933a-fae5-4d30-b099-68138201b621 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:20.704878 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2972e452-6e24-48e2-974e-6de4600b4b63 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:20.705336 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2972e452-6e24-48e2-974e-6de4600b4b63 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:20.706337 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2972e452-6e24-48e2-974e-6de4600b4b63 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:20.707071 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2972e452-6e24-48e2-974e-6de4600b4b63 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:20.750396 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b76d933a-fae5-4d30-b099-68138201b621 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] [instance: 31f37ba7-d5b3-4b48-9261-47e337e06a86] Going to try to terminate instance {{(pid=131320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:15:20.924211 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b76d933a-fae5-4d30-b099-68138201b621 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] 10.222.0.17 "DELETE /compute/v2.1/servers/31f37ba7-d5b3-4b48-9261-47e337e06a86" status: 204 len: 0 microversion: 2.1 time: 0.249283 Jul 23 21:15:20.933014 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 266/581] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:15:20 2022] DELETE /compute/v2.1/servers/31f37ba7-d5b3-4b48-9261-47e337e06a86 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:15:20.941513 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-37d306b0-38ca-486f-9d26-71d055cf5e1f tempest-FloatingIPsTestJSON-443811915 tempest-FloatingIPsTestJSON-443811915-project] Calling method '.version_select at 0x7f0b47cc6550>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:21.046059 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-2972e452-6e24-48e2-974e-6de4600b4b63 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf92af08fa94215b4eafcacea6c63f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e7d37a0e3b4b32ae99c3bc15a831e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:21.064672 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-2972e452-6e24-48e2-974e-6de4600b4b63 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "GET /compute/v2.1/servers/9e985a36-586a-4546-a0c0-1a3e3da330c9" status: 200 len: 1317 microversion: 2.1 time: 0.366816 Jul 23 21:15:21.065365 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 316/582] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:20 2022] GET /compute/v2.1/servers/9e985a36-586a-4546-a0c0-1a3e3da330c9 => generated 1317 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:21.072657 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e5dcf8e6-5327-40b9-bfa0-cf04c6d8c238 tempest-MigrationsAdminTest-19880863 tempest-MigrationsAdminTest-19880863-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:21.075173 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-e5dcf8e6-5327-40b9-bfa0-cf04c6d8c238 tempest-MigrationsAdminTest-19880863 tempest-MigrationsAdminTest-19880863-project-admin] [instance: 769ee4e5-e4df-4d4e-9f4c-6372c60d9e01] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:21.085796 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e5dcf8e6-5327-40b9-bfa0-cf04c6d8c238 tempest-MigrationsAdminTest-19880863 tempest-MigrationsAdminTest-19880863-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:21.086284 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e5dcf8e6-5327-40b9-bfa0-cf04c6d8c238 tempest-MigrationsAdminTest-19880863 tempest-MigrationsAdminTest-19880863-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:21.087070 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e5dcf8e6-5327-40b9-bfa0-cf04c6d8c238 tempest-MigrationsAdminTest-19880863 tempest-MigrationsAdminTest-19880863-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:21.087510 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e5dcf8e6-5327-40b9-bfa0-cf04c6d8c238 tempest-MigrationsAdminTest-19880863 tempest-MigrationsAdminTest-19880863-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:21.245243 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-e5dcf8e6-5327-40b9-bfa0-cf04c6d8c238 tempest-MigrationsAdminTest-19880863 tempest-MigrationsAdminTest-19880863-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/769ee4e5-e4df-4d4e-9f4c-6372c60d9e01" status: 200 len: 1613 microversion: 2.1 time: 0.178512 Jul 23 21:15:21.257906 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 317/583] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:21 2022] GET /compute/v2.1/servers/769ee4e5-e4df-4d4e-9f4c-6372c60d9e01 => generated 1613 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:21.266537 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-3df74fcb-4c84-45eb-9d15-e396febce7d1 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:21.267478 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-3df74fcb-4c84-45eb-9d15-e396febce7d1 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] [instance: 31f37ba7-d5b3-4b48-9261-47e337e06a86] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:21.275013 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3df74fcb-4c84-45eb-9d15-e396febce7d1 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:21.275013 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3df74fcb-4c84-45eb-9d15-e396febce7d1 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:21.275443 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3df74fcb-4c84-45eb-9d15-e396febce7d1 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:21.275870 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3df74fcb-4c84-45eb-9d15-e396febce7d1 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:21.432132 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-37d306b0-38ca-486f-9d26-71d055cf5e1f tempest-FloatingIPsTestJSON-443811915 tempest-FloatingIPsTestJSON-443811915-project] 10.222.0.17 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.497084 Jul 23 21:15:21.432721 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 267/584] 10.222.0.17 () {58 vars in 1148 bytes} [Sat Jul 23 21:15:20 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:15:21.438172 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-03880457-9b3d-4a48-8f71-b4fd6f4330e3 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:21.439496 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-03880457-9b3d-4a48-8f71-b4fd6f4330e3 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: ed0fdfd2-3506-40c4-8e4a-bb984e946fdd] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:21.452022 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-03880457-9b3d-4a48-8f71-b4fd6f4330e3 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:21.457503 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-03880457-9b3d-4a48-8f71-b4fd6f4330e3 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:21.458526 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-03880457-9b3d-4a48-8f71-b4fd6f4330e3 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:21.458984 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-03880457-9b3d-4a48-8f71-b4fd6f4330e3 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:21.475984 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-3df74fcb-4c84-45eb-9d15-e396febce7d1 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d3840d84f34ae5ba5d95b4c96847ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf6363b1e154ff59ee30143aee3d4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:21.489465 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-3df74fcb-4c84-45eb-9d15-e396febce7d1 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] 10.222.0.17 "GET /compute/v2.1/servers/31f37ba7-d5b3-4b48-9261-47e337e06a86" status: 200 len: 1478 microversion: 2.1 time: 0.230011 Jul 23 21:15:21.490284 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 318/585] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:21 2022] GET /compute/v2.1/servers/31f37ba7-d5b3-4b48-9261-47e337e06a86 => generated 1478 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:21.495110 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-09a231b7-0429-44be-968f-8e8dab44453a tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:21.495725 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-09a231b7-0429-44be-968f-8e8dab44453a tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] [instance: 70997419-42ea-46b3-a1bd-127efc670cd2] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:21.509430 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-09a231b7-0429-44be-968f-8e8dab44453a tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:21.513943 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-09a231b7-0429-44be-968f-8e8dab44453a tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:21.515185 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-09a231b7-0429-44be-968f-8e8dab44453a tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:21.515860 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-09a231b7-0429-44be-968f-8e8dab44453a tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:21.672469 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-09a231b7-0429-44be-968f-8e8dab44453a tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a872dad882e4694aba20eaa8c06df53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457d184c579a4016a0eec16eb9f23195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:21.676482 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=100 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:15:21.682152 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-09a231b7-0429-44be-968f-8e8dab44453a tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] 10.222.0.17 "GET /compute/v2.1/servers/70997419-42ea-46b3-a1bd-127efc670cd2" status: 200 len: 1318 microversion: 2.1 time: 0.190771 Jul 23 21:15:21.682748 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 319/586] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:21 2022] GET /compute/v2.1/servers/70997419-42ea-46b3-a1bd-127efc670cd2 => generated 1318 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:21.687116 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-7402f68a-d4d7-4b57-95a4-d052abef1b46 tempest-MigrationsAdminTest-19880863 tempest-MigrationsAdminTest-19880863-project-admin] Calling method '.version_select at 0x7f0b5438a550>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:21.695884 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7402f68a-d4d7-4b57-95a4-d052abef1b46 tempest-MigrationsAdminTest-19880863 tempest-MigrationsAdminTest-19880863-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:21.696029 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7402f68a-d4d7-4b57-95a4-d052abef1b46 tempest-MigrationsAdminTest-19880863 tempest-MigrationsAdminTest-19880863-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:21.715196 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-7402f68a-d4d7-4b57-95a4-d052abef1b46 tempest-MigrationsAdminTest-19880863 tempest-MigrationsAdminTest-19880863-project-admin] 10.222.0.17 "GET /compute/v2.1/os-migrations" status: 200 len: 1175 microversion: 2.1 time: 0.031352 Jul 23 21:15:21.715822 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 320/587] 10.222.0.17 () {58 vars in 1142 bytes} [Sat Jul 23 21:15:21 2022] GET /compute/v2.1/os-migrations => generated 1175 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:21.721080 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-6cf4611f-41b0-4bee-830b-1da6450a43a2 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:21.721891 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-6cf4611f-41b0-4bee-830b-1da6450a43a2 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] [instance: fc41b6cc-f603-4f7d-89cb-a7e3cee372a5] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:21.730177 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6cf4611f-41b0-4bee-830b-1da6450a43a2 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:21.730918 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6cf4611f-41b0-4bee-830b-1da6450a43a2 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:21.732658 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6cf4611f-41b0-4bee-830b-1da6450a43a2 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:21.737478 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6cf4611f-41b0-4bee-830b-1da6450a43a2 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:21.779364 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-03880457-9b3d-4a48-8f71-b4fd6f4330e3 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:21.796166 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-03880457-9b3d-4a48-8f71-b4fd6f4330e3 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:21.800331 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-03880457-9b3d-4a48-8f71-b4fd6f4330e3 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:21.801554 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-03880457-9b3d-4a48-8f71-b4fd6f4330e3 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/ed0fdfd2-3506-40c4-8e4a-bb984e946fdd" status: 200 len: 1567 microversion: 2.25 time: 0.367892 Jul 23 21:15:21.807036 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 268/588] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:15:21 2022] GET /compute/v2.1/servers/ed0fdfd2-3506-40c4-8e4a-bb984e946fdd => generated 1567 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:15:21.817668 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3496fc73-f374-4965-87b5-c89f75c621c8 tempest-FloatingIPsTestJSON-443811915 tempest-FloatingIPsTestJSON-443811915-project] Calling method '.version_select at 0x7f0b47ce8b80>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:22.031964 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-6cf4611f-41b0-4bee-830b-1da6450a43a2 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f1a14a59b7401d88f18ec35c91e30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c17bd813264fb9891076799e33acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:22.041673 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-6cf4611f-41b0-4bee-830b-1da6450a43a2 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] 10.222.0.17 "GET /compute/v2.1/servers/fc41b6cc-f603-4f7d-89cb-a7e3cee372a5" status: 200 len: 1388 microversion: 2.1 time: 0.324394 Jul 23 21:15:22.042832 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 321/589] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:21 2022] GET /compute/v2.1/servers/fc41b6cc-f603-4f7d-89cb-a7e3cee372a5 => generated 1388 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:22.047836 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-3fded00e-a23d-4e14-8dd8-a5b53545f8a3 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:22.049567 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-3fded00e-a23d-4e14-8dd8-a5b53545f8a3 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:22.057621 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3fded00e-a23d-4e14-8dd8-a5b53545f8a3 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:22.058560 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3fded00e-a23d-4e14-8dd8-a5b53545f8a3 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:22.059581 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3fded00e-a23d-4e14-8dd8-a5b53545f8a3 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:22.060224 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3fded00e-a23d-4e14-8dd8-a5b53545f8a3 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:22.230053 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-3fded00e-a23d-4e14-8dd8-a5b53545f8a3 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:22.239315 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-3fded00e-a23d-4e14-8dd8-a5b53545f8a3 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b" status: 200 len: 1310 microversion: 2.1 time: 0.195307 Jul 23 21:15:22.249010 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 322/590] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:22 2022] GET /compute/v2.1/servers/d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b => generated 1310 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:22.254566 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ec833bf4-ddeb-44ef-ab61-9dfdfb04d6e6 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-767288959", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:15:22.315582 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.network.neutron [None req-ec833bf4-ddeb-44ef-ab61-9dfdfb04d6e6 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] validate_networks() for None {{(pid=131321) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:15:22.730980 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-ec833bf4-ddeb-44ef-ab61-9dfdfb04d6e6 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Flavor limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:15:22.731600 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-ec833bf4-ddeb-44ef-ab61-9dfdfb04d6e6 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Image limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:15:22.732249 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-ec833bf4-ddeb-44ef-ab61-9dfdfb04d6e6 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Flavor pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:15:22.732950 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-ec833bf4-ddeb-44ef-ab61-9dfdfb04d6e6 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Image pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:15:22.733515 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-ec833bf4-ddeb-44ef-ab61-9dfdfb04d6e6 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:15:22.743566 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ec833bf4-ddeb-44ef-ab61-9dfdfb04d6e6 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:22.744012 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ec833bf4-ddeb-44ef-ab61-9dfdfb04d6e6 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:22.744808 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ec833bf4-ddeb-44ef-ab61-9dfdfb04d6e6 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:22.745249 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ec833bf4-ddeb-44ef-ab61-9dfdfb04d6e6 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:22.770602 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-ec833bf4-ddeb-44ef-ab61-9dfdfb04d6e6 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Getting quotas for project 5935212e8b6a40768ee3fc90807b0cb1. Resources: {'ram', 'instances', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:15:22.782275 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-ec833bf4-ddeb-44ef-ab61-9dfdfb04d6e6 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Getting quotas for user 0133d9533fbd4be5b46dc308dbe3a7d9 and project 5935212e8b6a40768ee3fc90807b0cb1. Resources: {'ram', 'instances', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:15:22.797006 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-ec833bf4-ddeb-44ef-ab61-9dfdfb04d6e6 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Going to run 1 instances... {{(pid=131321) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:15:22.799855 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-ec833bf4-ddeb-44ef-ab61-9dfdfb04d6e6 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 5bc4befa-252d-456a-92cd-323bad80fcdf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131321) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:15:22.861574 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-ec833bf4-ddeb-44ef-ab61-9dfdfb04d6e6 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.610380 Jul 23 21:15:22.862641 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 323/591] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:15:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 613 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 23 21:15:22.874115 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e097624b-ca89-48e4-9301-ba73379d98c7 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:22.875022 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-e097624b-ca89-48e4-9301-ba73379d98c7 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: 9e985a36-586a-4546-a0c0-1a3e3da330c9] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:22.895953 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:15:22.899203 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e097624b-ca89-48e4-9301-ba73379d98c7 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:22.899747 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e097624b-ca89-48e4-9301-ba73379d98c7 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:22.900977 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e097624b-ca89-48e4-9301-ba73379d98c7 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:22.900977 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e097624b-ca89-48e4-9301-ba73379d98c7 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:23.109586 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-e097624b-ca89-48e4-9301-ba73379d98c7 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf92af08fa94215b4eafcacea6c63f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e7d37a0e3b4b32ae99c3bc15a831e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:23.120838 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-e097624b-ca89-48e4-9301-ba73379d98c7 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "GET /compute/v2.1/servers/9e985a36-586a-4546-a0c0-1a3e3da330c9" status: 200 len: 1317 microversion: 2.1 time: 0.256587 Jul 23 21:15:23.123378 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 324/592] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:22 2022] GET /compute/v2.1/servers/9e985a36-586a-4546-a0c0-1a3e3da330c9 => generated 1317 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:23.138594 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-4b9dac98-6b2a-4c6f-be37-f947422d2ebf req-6ef13a02-51d5-42f2-a8da-4771ee01e9bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc41b6cc-f603-4f7d-89cb-a7e3cee372a5", "name": "network-vif-plugged", "status": "completed", "tag": "3e18f4f9-3b4c-4c36-997a-bc967d44787f"}, {"server_uuid": "9e985a36-586a-4546-a0c0-1a3e3da330c9", "name": "network-vif-plugged", "status": "completed", "tag": "f7d5f9d8-f247-4c0e-b465-0c960879af67"}, {"server_uuid": "d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b", "name": "network-vif-plugged", "status": "completed", "tag": "514e8daf-fac6-48ba-9a0d-0c9edf5b2d8e"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:15:23.172220 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-4b9dac98-6b2a-4c6f-be37-f947422d2ebf req-6ef13a02-51d5-42f2-a8da-4771ee01e9bc service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:23.172678 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-4b9dac98-6b2a-4c6f-be37-f947422d2ebf req-6ef13a02-51d5-42f2-a8da-4771ee01e9bc service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:23.229937 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-4b9dac98-6b2a-4c6f-be37-f947422d2ebf req-6ef13a02-51d5-42f2-a8da-4771ee01e9bc service nova] Creating event network-vif-plugged:3e18f4f9-3b4c-4c36-997a-bc967d44787f for instance fc41b6cc-f603-4f7d-89cb-a7e3cee372a5 on nch2-master-1 Jul 23 21:15:23.235167 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-4b9dac98-6b2a-4c6f-be37-f947422d2ebf req-6ef13a02-51d5-42f2-a8da-4771ee01e9bc service nova] Creating event network-vif-plugged:f7d5f9d8-f247-4c0e-b465-0c960879af67 for instance 9e985a36-586a-4546-a0c0-1a3e3da330c9 on nch1-master-1 Jul 23 21:15:23.238587 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-4b9dac98-6b2a-4c6f-be37-f947422d2ebf req-6ef13a02-51d5-42f2-a8da-4771ee01e9bc service nova] Creating event network-vif-plugged:514e8daf-fac6-48ba-9a0d-0c9edf5b2d8e for instance d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b on nch1-master-1 Jul 23 21:15:23.265990 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-4b9dac98-6b2a-4c6f-be37-f947422d2ebf req-6ef13a02-51d5-42f2-a8da-4771ee01e9bc service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.137980 Jul 23 21:15:23.267664 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 325/593] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:15:23 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:15:23.276769 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-dbc1ed6b-fc49-4c8d-bf77-eb1c342af134 req-4414b501-efa5-4d03-b23f-b60a48c61046 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed0fdfd2-3506-40c4-8e4a-bb984e946fdd", "tag": "1e9171bb-cfe1-4d9d-b4e2-14b9c65df29e"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:15:23.287850 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-dbc1ed6b-fc49-4c8d-bf77-eb1c342af134 req-4414b501-efa5-4d03-b23f-b60a48c61046 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:23.290235 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-dbc1ed6b-fc49-4c8d-bf77-eb1c342af134 req-4414b501-efa5-4d03-b23f-b60a48c61046 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:23.316619 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-dbc1ed6b-fc49-4c8d-bf77-eb1c342af134 req-4414b501-efa5-4d03-b23f-b60a48c61046 service nova] Creating event network-changed:1e9171bb-cfe1-4d9d-b4e2-14b9c65df29e for instance ed0fdfd2-3506-40c4-8e4a-bb984e946fdd on nch2-master-1 Jul 23 21:15:23.325250 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-dbc1ed6b-fc49-4c8d-bf77-eb1c342af134 req-4414b501-efa5-4d03-b23f-b60a48c61046 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053843 Jul 23 21:15:23.337163 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 326/594] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:15:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:15:23.350017 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-103d3b3c-6f50-48b4-9efc-46aba2ae1bfb tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:23.350674 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-103d3b3c-6f50-48b4-9efc-46aba2ae1bfb tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] [instance: 31f37ba7-d5b3-4b48-9261-47e337e06a86] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:23.361734 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-103d3b3c-6f50-48b4-9efc-46aba2ae1bfb tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:23.362373 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-103d3b3c-6f50-48b4-9efc-46aba2ae1bfb tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:23.363172 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-103d3b3c-6f50-48b4-9efc-46aba2ae1bfb tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:23.363946 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-103d3b3c-6f50-48b4-9efc-46aba2ae1bfb tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:23.584768 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-103d3b3c-6f50-48b4-9efc-46aba2ae1bfb tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d3840d84f34ae5ba5d95b4c96847ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf6363b1e154ff59ee30143aee3d4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:23.601503 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-103d3b3c-6f50-48b4-9efc-46aba2ae1bfb tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] 10.222.0.17 "GET /compute/v2.1/servers/31f37ba7-d5b3-4b48-9261-47e337e06a86" status: 200 len: 1436 microversion: 2.1 time: 0.260659 Jul 23 21:15:23.614195 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 327/595] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:23 2022] GET /compute/v2.1/servers/31f37ba7-d5b3-4b48-9261-47e337e06a86 => generated 1436 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:23.618231 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-a877cab1-faf0-4f4c-872b-930c8cc8618f req-56491607-2484-4e32-94e2-963796bd3d3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70997419-42ea-46b3-a1bd-127efc670cd2", "tag": "85027928-65ec-4df1-9876-e9b194f491fb"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:15:23.627348 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-a877cab1-faf0-4f4c-872b-930c8cc8618f req-56491607-2484-4e32-94e2-963796bd3d3a service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:23.627803 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-a877cab1-faf0-4f4c-872b-930c8cc8618f req-56491607-2484-4e32-94e2-963796bd3d3a service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:23.639138 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-a877cab1-faf0-4f4c-872b-930c8cc8618f req-56491607-2484-4e32-94e2-963796bd3d3a service nova] Creating event network-changed:85027928-65ec-4df1-9876-e9b194f491fb for instance 70997419-42ea-46b3-a1bd-127efc670cd2 on nch2-master-1 Jul 23 21:15:23.645011 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-a877cab1-faf0-4f4c-872b-930c8cc8618f req-56491607-2484-4e32-94e2-963796bd3d3a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030787 Jul 23 21:15:23.645700 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 328/596] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:15:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:15:23.653068 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f77224d1-09f3-4cd5-97fb-c8fdae706a21 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:23.653790 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-f77224d1-09f3-4cd5-97fb-c8fdae706a21 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] [instance: 70997419-42ea-46b3-a1bd-127efc670cd2] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:23.661251 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f77224d1-09f3-4cd5-97fb-c8fdae706a21 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:23.661742 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f77224d1-09f3-4cd5-97fb-c8fdae706a21 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:23.662763 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f77224d1-09f3-4cd5-97fb-c8fdae706a21 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:23.663085 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f77224d1-09f3-4cd5-97fb-c8fdae706a21 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:23.786924 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-3496fc73-f374-4965-87b5-c89f75c621c8 tempest-FloatingIPsTestJSON-443811915 tempest-FloatingIPsTestJSON-443811915-project] 10.222.0.17 "DELETE /compute/v2.1/os-floating-ips/f3d90e96-0092-42fe-8b2b-f21c1364166e" status: 202 len: 0 microversion: 2.1 time: 1.978045 Jul 23 21:15:23.791955 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 269/597] 10.222.0.17 () {58 vars in 1262 bytes} [Sat Jul 23 21:15:21 2022] DELETE /compute/v2.1/os-floating-ips/f3d90e96-0092-42fe-8b2b-f21c1364166e => generated 0 bytes in 1980 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:15:23.795839 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c64742ed-fc63-4c73-8f49-0370140d7dad tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:23.796734 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c64742ed-fc63-4c73-8f49-0370140d7dad tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: ed0fdfd2-3506-40c4-8e4a-bb984e946fdd] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:23.804407 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c64742ed-fc63-4c73-8f49-0370140d7dad tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:23.804760 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c64742ed-fc63-4c73-8f49-0370140d7dad tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:23.805650 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c64742ed-fc63-4c73-8f49-0370140d7dad tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:23.806193 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c64742ed-fc63-4c73-8f49-0370140d7dad tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:23.900522 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-f77224d1-09f3-4cd5-97fb-c8fdae706a21 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a872dad882e4694aba20eaa8c06df53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457d184c579a4016a0eec16eb9f23195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:23.911119 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-f77224d1-09f3-4cd5-97fb-c8fdae706a21 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] 10.222.0.17 "GET /compute/v2.1/servers/70997419-42ea-46b3-a1bd-127efc670cd2" status: 200 len: 1318 microversion: 2.1 time: 0.263985 Jul 23 21:15:23.920951 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 329/598] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:23 2022] GET /compute/v2.1/servers/70997419-42ea-46b3-a1bd-127efc670cd2 => generated 1318 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:23.927103 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-45bab920-a283-4b26-9522-52197c21d7bb tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:23.927797 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-45bab920-a283-4b26-9522-52197c21d7bb tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 5bc4befa-252d-456a-92cd-323bad80fcdf] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:23.934483 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-45bab920-a283-4b26-9522-52197c21d7bb tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:23.934938 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-45bab920-a283-4b26-9522-52197c21d7bb tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:23.935898 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-45bab920-a283-4b26-9522-52197c21d7bb tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:23.936335 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-45bab920-a283-4b26-9522-52197c21d7bb tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:23.977635 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c64742ed-fc63-4c73-8f49-0370140d7dad tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:23.988710 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c64742ed-fc63-4c73-8f49-0370140d7dad tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:23.991014 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c64742ed-fc63-4c73-8f49-0370140d7dad tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:23.992345 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c64742ed-fc63-4c73-8f49-0370140d7dad tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/ed0fdfd2-3506-40c4-8e4a-bb984e946fdd" status: 200 len: 1567 microversion: 2.25 time: 0.203259 Jul 23 21:15:23.992914 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 270/599] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:15:23 2022] GET /compute/v2.1/servers/ed0fdfd2-3506-40c4-8e4a-bb984e946fdd => generated 1567 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:15:24.009064 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-049f8cae-33c7-40f9-bd2b-5ed1c35dff8d tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:24.010007 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-049f8cae-33c7-40f9-bd2b-5ed1c35dff8d tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] [instance: fc41b6cc-f603-4f7d-89cb-a7e3cee372a5] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:24.016284 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-049f8cae-33c7-40f9-bd2b-5ed1c35dff8d tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:24.016731 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-049f8cae-33c7-40f9-bd2b-5ed1c35dff8d tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:24.017574 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-049f8cae-33c7-40f9-bd2b-5ed1c35dff8d tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:24.018042 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-049f8cae-33c7-40f9-bd2b-5ed1c35dff8d tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:24.031897 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-45bab920-a283-4b26-9522-52197c21d7bb tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:24.040805 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-45bab920-a283-4b26-9522-52197c21d7bb tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/5bc4befa-252d-456a-92cd-323bad80fcdf" status: 200 len: 1208 microversion: 2.1 time: 0.118204 Jul 23 21:15:24.041689 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 330/600] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:23 2022] GET /compute/v2.1/servers/5bc4befa-252d-456a-92cd-323bad80fcdf => generated 1208 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:24.047401 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-46e4b5ea-8453-4d14-b937-de4aa07f3207 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:24.048357 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-46e4b5ea-8453-4d14-b937-de4aa07f3207 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:24.055270 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-46e4b5ea-8453-4d14-b937-de4aa07f3207 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:24.056092 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-46e4b5ea-8453-4d14-b937-de4aa07f3207 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:24.056952 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-46e4b5ea-8453-4d14-b937-de4aa07f3207 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:24.057455 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-46e4b5ea-8453-4d14-b937-de4aa07f3207 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:24.161098 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-049f8cae-33c7-40f9-bd2b-5ed1c35dff8d tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f1a14a59b7401d88f18ec35c91e30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c17bd813264fb9891076799e33acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:24.171572 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-049f8cae-33c7-40f9-bd2b-5ed1c35dff8d tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] 10.222.0.17 "GET /compute/v2.1/servers/fc41b6cc-f603-4f7d-89cb-a7e3cee372a5" status: 200 len: 1388 microversion: 2.1 time: 0.172435 Jul 23 21:15:24.172200 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 271/601] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:23 2022] GET /compute/v2.1/servers/fc41b6cc-f603-4f7d-89cb-a7e3cee372a5 => generated 1388 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:24.176916 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e30e3211-9f2b-4d01-8df2-2d7bb5764dd6 tempest-FloatingIPsTestJSON-443811915 tempest-FloatingIPsTestJSON-443811915-project] Action: 'create', calling method: .version_select at 0x7f0b47ce8e50>, body: {"pool": null} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:15:24.198157 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-46e4b5ea-8453-4d14-b937-de4aa07f3207 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:24.205811 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-46e4b5ea-8453-4d14-b937-de4aa07f3207 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b" status: 200 len: 1310 microversion: 2.1 time: 0.162606 Jul 23 21:15:24.207273 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 331/602] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:24 2022] GET /compute/v2.1/servers/d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b => generated 1310 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:24.210988 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-7305f215-e161-465e-a8b6-872c9b348d0e tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:24.211575 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-7305f215-e161-465e-a8b6-872c9b348d0e tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: 9e985a36-586a-4546-a0c0-1a3e3da330c9] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:24.217604 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7305f215-e161-465e-a8b6-872c9b348d0e tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:24.218013 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7305f215-e161-465e-a8b6-872c9b348d0e tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:24.218779 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7305f215-e161-465e-a8b6-872c9b348d0e tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:24.219212 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7305f215-e161-465e-a8b6-872c9b348d0e tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:24.348032 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-7305f215-e161-465e-a8b6-872c9b348d0e tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf92af08fa94215b4eafcacea6c63f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e7d37a0e3b4b32ae99c3bc15a831e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:24.355479 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-7305f215-e161-465e-a8b6-872c9b348d0e tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "GET /compute/v2.1/servers/9e985a36-586a-4546-a0c0-1a3e3da330c9" status: 200 len: 1317 microversion: 2.1 time: 0.148113 Jul 23 21:15:24.356054 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 332/603] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:24 2022] GET /compute/v2.1/servers/9e985a36-586a-4546-a0c0-1a3e3da330c9 => generated 1317 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:24.621250 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-6f0b15a1-df7f-4897-b040-1fe3541fb27c tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:24.622240 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-6f0b15a1-df7f-4897-b040-1fe3541fb27c tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] [instance: 31f37ba7-d5b3-4b48-9261-47e337e06a86] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:24.632023 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6f0b15a1-df7f-4897-b040-1fe3541fb27c tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:24.633617 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6f0b15a1-df7f-4897-b040-1fe3541fb27c tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:24.634157 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6f0b15a1-df7f-4897-b040-1fe3541fb27c tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:24.634858 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6f0b15a1-df7f-4897-b040-1fe3541fb27c tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:24.850789 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6f0b15a1-df7f-4897-b040-1fe3541fb27c tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:24.851241 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6f0b15a1-df7f-4897-b040-1fe3541fb27c tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:24.851690 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.objects.instance [None req-6f0b15a1-df7f-4897-b040-1fe3541fb27c tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Lazy-loading 'fault' on Instance uuid 31f37ba7-d5b3-4b48-9261-47e337e06a86 {{(pid=131321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:15:24.892834 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-6f0b15a1-df7f-4897-b040-1fe3541fb27c tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d3840d84f34ae5ba5d95b4c96847ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcf6363b1e154ff59ee30143aee3d4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:24.899856 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-6f0b15a1-df7f-4897-b040-1fe3541fb27c tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] 10.222.0.17 "GET /compute/v2.1/servers/31f37ba7-d5b3-4b48-9261-47e337e06a86" status: 200 len: 1312 microversion: 2.1 time: 0.283355 Jul 23 21:15:24.900423 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 333/604] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:24 2022] GET /compute/v2.1/servers/31f37ba7-d5b3-4b48-9261-47e337e06a86 => generated 1312 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:24.928313 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-b0e6f00e-7c16-41ae-ab44-978faa294484 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:24.928926 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-b0e6f00e-7c16-41ae-ab44-978faa294484 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] [instance: 70997419-42ea-46b3-a1bd-127efc670cd2] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:24.935109 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b0e6f00e-7c16-41ae-ab44-978faa294484 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:24.935580 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b0e6f00e-7c16-41ae-ab44-978faa294484 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:24.936442 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b0e6f00e-7c16-41ae-ab44-978faa294484 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:24.936882 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b0e6f00e-7c16-41ae-ab44-978faa294484 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:25.272316 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e30e3211-9f2b-4d01-8df2-2d7bb5764dd6 tempest-FloatingIPsTestJSON-443811915 tempest-FloatingIPsTestJSON-443811915-project] 10.222.0.17 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.098995 Jul 23 21:15:25.273026 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 272/605] 10.222.0.17 () {60 vars in 1169 bytes} [Sat Jul 23 21:15:24 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:15:25.277746 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5a33cdf2-4c4e-434a-a399-d4d08ea40890 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:25.278600 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5a33cdf2-4c4e-434a-a399-d4d08ea40890 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: ed0fdfd2-3506-40c4-8e4a-bb984e946fdd] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:25.285632 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5a33cdf2-4c4e-434a-a399-d4d08ea40890 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:25.286258 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5a33cdf2-4c4e-434a-a399-d4d08ea40890 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:25.287113 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5a33cdf2-4c4e-434a-a399-d4d08ea40890 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:25.287666 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5a33cdf2-4c4e-434a-a399-d4d08ea40890 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:25.381171 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-b0e6f00e-7c16-41ae-ab44-978faa294484 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a872dad882e4694aba20eaa8c06df53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457d184c579a4016a0eec16eb9f23195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:25.388929 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-b0e6f00e-7c16-41ae-ab44-978faa294484 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] 10.222.0.17 "GET /compute/v2.1/servers/70997419-42ea-46b3-a1bd-127efc670cd2" status: 200 len: 1318 microversion: 2.1 time: 0.464415 Jul 23 21:15:25.389505 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 334/606] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:24 2022] GET /compute/v2.1/servers/70997419-42ea-46b3-a1bd-127efc670cd2 => generated 1318 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:25.394072 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c0d2ea2b-ec38-4e17-9926-f236772a7604 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:25.394596 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-c0d2ea2b-ec38-4e17-9926-f236772a7604 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 5bc4befa-252d-456a-92cd-323bad80fcdf] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:25.400558 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c0d2ea2b-ec38-4e17-9926-f236772a7604 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:25.401013 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c0d2ea2b-ec38-4e17-9926-f236772a7604 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:25.401817 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c0d2ea2b-ec38-4e17-9926-f236772a7604 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:25.402280 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c0d2ea2b-ec38-4e17-9926-f236772a7604 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:25.418106 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5a33cdf2-4c4e-434a-a399-d4d08ea40890 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:25.426342 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5a33cdf2-4c4e-434a-a399-d4d08ea40890 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:25.427844 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5a33cdf2-4c4e-434a-a399-d4d08ea40890 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:25.429058 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5a33cdf2-4c4e-434a-a399-d4d08ea40890 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/ed0fdfd2-3506-40c4-8e4a-bb984e946fdd" status: 200 len: 1567 microversion: 2.25 time: 0.154996 Jul 23 21:15:25.429610 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 273/607] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:15:25 2022] GET /compute/v2.1/servers/ed0fdfd2-3506-40c4-8e4a-bb984e946fdd => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:15:25.433980 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1356074f-769b-4bc2-8151-60867960f1e4 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:25.434587 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1356074f-769b-4bc2-8151-60867960f1e4 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] [instance: fc41b6cc-f603-4f7d-89cb-a7e3cee372a5] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:25.440749 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1356074f-769b-4bc2-8151-60867960f1e4 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:25.441204 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1356074f-769b-4bc2-8151-60867960f1e4 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:25.442017 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1356074f-769b-4bc2-8151-60867960f1e4 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:25.442457 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1356074f-769b-4bc2-8151-60867960f1e4 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:25.463675 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c0d2ea2b-ec38-4e17-9926-f236772a7604 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:25.471421 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-c0d2ea2b-ec38-4e17-9926-f236772a7604 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/5bc4befa-252d-456a-92cd-323bad80fcdf" status: 200 len: 1264 microversion: 2.1 time: 0.080921 Jul 23 21:15:25.471988 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 335/608] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:25 2022] GET /compute/v2.1/servers/5bc4befa-252d-456a-92cd-323bad80fcdf => generated 1264 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:25.477953 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-5af02ec1-9950-4283-a730-9909a4c5757d tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:25.478631 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-5af02ec1-9950-4283-a730-9909a4c5757d tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:25.484752 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5af02ec1-9950-4283-a730-9909a4c5757d tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:25.485196 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5af02ec1-9950-4283-a730-9909a4c5757d tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:25.485996 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5af02ec1-9950-4283-a730-9909a4c5757d tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:25.486479 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5af02ec1-9950-4283-a730-9909a4c5757d tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:25.618367 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-1356074f-769b-4bc2-8151-60867960f1e4 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f1a14a59b7401d88f18ec35c91e30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c17bd813264fb9891076799e33acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:25.628907 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1356074f-769b-4bc2-8151-60867960f1e4 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] 10.222.0.17 "GET /compute/v2.1/servers/fc41b6cc-f603-4f7d-89cb-a7e3cee372a5" status: 200 len: 1388 microversion: 2.1 time: 0.198186 Jul 23 21:15:25.632249 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 274/609] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:25 2022] GET /compute/v2.1/servers/fc41b6cc-f603-4f7d-89cb-a7e3cee372a5 => generated 1388 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:25.647181 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-817ffcd6-d381-47dc-8ba7-48fc121cfa81 tempest-FloatingIPsTestJSON-443811915 tempest-FloatingIPsTestJSON-443811915-project] Calling method '.version_select at 0x7f0b47c93820>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:25.790169 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-5af02ec1-9950-4283-a730-9909a4c5757d tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:25.798958 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-5af02ec1-9950-4283-a730-9909a4c5757d tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b" status: 200 len: 1310 microversion: 2.1 time: 0.324798 Jul 23 21:15:25.799930 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 336/610] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:25 2022] GET /compute/v2.1/servers/d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b => generated 1310 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:25.804643 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-342d963c-3f75-4254-bc4f-75538e24036c req-d098e080-f9b7-4337-bb74-a297f7f07bc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31f37ba7-d5b3-4b48-9261-47e337e06a86", "name": "network-vif-deleted", "tag": "36f20cbc-51d2-47f5-9a05-f635c6a69ae4"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:15:25.813536 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-342d963c-3f75-4254-bc4f-75538e24036c req-d098e080-f9b7-4337-bb74-a297f7f07bc5 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:25.814016 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-342d963c-3f75-4254-bc4f-75538e24036c req-d098e080-f9b7-4337-bb74-a297f7f07bc5 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:25.828890 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-342d963c-3f75-4254-bc4f-75538e24036c req-d098e080-f9b7-4337-bb74-a297f7f07bc5 service nova] Creating event network-vif-deleted:36f20cbc-51d2-47f5-9a05-f635c6a69ae4 for instance 31f37ba7-d5b3-4b48-9261-47e337e06a86 on nch1-master-1 Jul 23 21:15:25.834745 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-342d963c-3f75-4254-bc4f-75538e24036c req-d098e080-f9b7-4337-bb74-a297f7f07bc5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033530 Jul 23 21:15:25.835848 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 337/611] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:15:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:15:25.841056 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c4a0f4d0-295a-4422-9da9-84ebc5d2b925 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:25.841631 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-c4a0f4d0-295a-4422-9da9-84ebc5d2b925 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: 9e985a36-586a-4546-a0c0-1a3e3da330c9] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:25.849514 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c4a0f4d0-295a-4422-9da9-84ebc5d2b925 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:25.850017 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c4a0f4d0-295a-4422-9da9-84ebc5d2b925 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:25.851221 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c4a0f4d0-295a-4422-9da9-84ebc5d2b925 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:25.851221 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c4a0f4d0-295a-4422-9da9-84ebc5d2b925 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:26.281091 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c4a0f4d0-295a-4422-9da9-84ebc5d2b925 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf92af08fa94215b4eafcacea6c63f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e7d37a0e3b4b32ae99c3bc15a831e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:26.297430 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-c4a0f4d0-295a-4422-9da9-84ebc5d2b925 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "GET /compute/v2.1/servers/9e985a36-586a-4546-a0c0-1a3e3da330c9" status: 200 len: 1467 microversion: 2.1 time: 0.459700 Jul 23 21:15:26.306756 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 338/612] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:25 2022] GET /compute/v2.1/servers/9e985a36-586a-4546-a0c0-1a3e3da330c9 => generated 1467 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:26.317407 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f7add3ae-b971-4a19-918a-ae1dbfc436d4 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:26.318226 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-f7add3ae-b971-4a19-918a-ae1dbfc436d4 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] [instance: 31f37ba7-d5b3-4b48-9261-47e337e06a86] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:26.324944 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f7add3ae-b971-4a19-918a-ae1dbfc436d4 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:26.325508 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f7add3ae-b971-4a19-918a-ae1dbfc436d4 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:26.327217 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f7add3ae-b971-4a19-918a-ae1dbfc436d4 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:26.327217 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f7add3ae-b971-4a19-918a-ae1dbfc436d4 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:26.360186 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-f7add3ae-b971-4a19-918a-ae1dbfc436d4 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] HTTP exception thrown: Instance 31f37ba7-d5b3-4b48-9261-47e337e06a86 could not be found. Jul 23 21:15:26.362735 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f7add3ae-b971-4a19-918a-ae1dbfc436d4 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Request method failure captured: Jul 23 21:15:26.362735 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/servers/31f37ba7-d5b3-4b48-9261-47e337e06a86 HTTP/1.1 Jul 23 21:15:26.362735 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:15:26.362735 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:15:26.362735 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:15:26.362735 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:15:26.362735 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:15:26.362735 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:15:26.362735 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:15:26.362735 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:15:26.362735 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GTMBp5d59dLoZFkVv-0PujKjzwKskAudDxCiog65H7s2PIb673GIGHrPmNfOgPxVvtjPgTwVS-MdTMaltPYGI4dETzpep4UWsqR78VVk7-zIjqWct3ht2GjJtC7EHiXWwxGhBo6GFYu6Z1uF2wFgpca5jE0zsKn_D8IfonNNsk3WxM Jul 23 21:15:26.362735 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:15:26.362735 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:15:26.362735 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:15:26.362735 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:15:26.362735 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:15:26.362735 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:15:26.362735 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: fcf6363b1e154ff59ee30143aee3d4f1 Jul 23 21:15:26.362735 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-519689208 Jul 23 21:15:26.362735 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:15:26.362735 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:15:26.364148 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fcf6363b1e154ff59ee30143aee3d4f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/fcf6363b1e154ff59ee30143aee3d4f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_fcf6363b1e154ff59ee30143aee3d4f1", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/fcf6363b1e154ff59ee30143aee3d4f1"}]}] Jul 23 21:15:26.364148 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-519689208 Jul 23 21:15:26.364148 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: fcf6363b1e154ff59ee30143aee3d4f1 Jul 23 21:15:26.364148 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-519689208 Jul 23 21:15:26.364148 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ServerDiagnosticsNegativeTest-519689208-project Jul 23 21:15:26.364148 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:15:26.364148 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:15:26.364148 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 90d3840d84f34ae5ba5d95b4c96847ba Jul 23 21:15:26.364148 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-519689208-project Jul 23 21:15:26.364148 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:15:26.364148 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance 31f37ba7-d5b3-4b48-9261-47e337e06a86 could not be found. Jul 23 21:15:26.364148 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': '31f37ba7-d5b3-4b48-9261-47e337e06a86'} Jul 23 21:15:26.364999 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:15:26.364999 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:15:26.364999 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:15:26.364999 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:15:26.364999 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:15:26.364999 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:15:26.364999 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:15:26.364999 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:15:26.364999 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:15:26.364999 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:15:26.364999 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31f37ba7-d5b3-4b48-9261-47e337e06a86 could not be found. Jul 23 21:15:26.364999 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:15:26.364999 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:15:26.364999 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:15:26.364999 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:15:26.364999 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:15:26.364999 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:15:26.364999 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:15:26.364999 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:15:26.364999 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:15:26.366509 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:15:26.366509 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:15:26.366509 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:15:26.366509 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:15:26.366509 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:15:26.366509 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:15:26.366509 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:15:26.366509 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31f37ba7-d5b3-4b48-9261-47e337e06a86 could not be found. Jul 23 21:15:26.366509 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:15:26.366509 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:15:26.366509 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:15:26.366509 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:15:26.366509 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:15:26.366509 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:15:26.366509 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:15:26.366509 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:15:26.366509 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31f37ba7-d5b3-4b48-9261-47e337e06a86 could not be found. Jul 23 21:15:26.366509 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:15:26.367806 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f7add3ae-b971-4a19-918a-ae1dbfc436d4 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] Returning 404 to user: Instance 31f37ba7-d5b3-4b48-9261-47e337e06a86 could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:15:26.367806 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-f7add3ae-b971-4a19-918a-ae1dbfc436d4 tempest-ServerDiagnosticsNegativeTest-519689208 tempest-ServerDiagnosticsNegativeTest-519689208-project] 10.222.0.17 "GET /compute/v2.1/servers/31f37ba7-d5b3-4b48-9261-47e337e06a86" status: 404 len: 111 microversion: 2.1 time: 0.055492 Jul 23 21:15:26.367806 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 339/613] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:26 2022] GET /compute/v2.1/servers/31f37ba7-d5b3-4b48-9261-47e337e06a86 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:15:26.380911 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-711451dc-699c-47e4-9f1a-42c4391b9001 req-fcbd48d8-f278-4383-b546-735cf9975937 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed0fdfd2-3506-40c4-8e4a-bb984e946fdd", "name": "network-vif-unplugged", "status": "completed", "tag": "1e9171bb-cfe1-4d9d-b4e2-14b9c65df29e"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:15:26.434725 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-711451dc-699c-47e4-9f1a-42c4391b9001 req-fcbd48d8-f278-4383-b546-735cf9975937 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:26.435385 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-711451dc-699c-47e4-9f1a-42c4391b9001 req-fcbd48d8-f278-4383-b546-735cf9975937 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:26.487653 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-711451dc-699c-47e4-9f1a-42c4391b9001 req-fcbd48d8-f278-4383-b546-735cf9975937 service nova] Creating event network-vif-unplugged:1e9171bb-cfe1-4d9d-b4e2-14b9c65df29e for instance ed0fdfd2-3506-40c4-8e4a-bb984e946fdd on nch2-master-1 Jul 23 21:15:26.507491 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-711451dc-699c-47e4-9f1a-42c4391b9001 req-fcbd48d8-f278-4383-b546-735cf9975937 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.138812 Jul 23 21:15:26.508130 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 340/614] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:15:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:15:26.668999 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-9d015147-0c94-4c63-9f6f-a7e8549c62c7 tempest-ServersOnMultiNodesTest-1671986198 tempest-ServersOnMultiNodesTest-1671986198-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:26.669844 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-9d015147-0c94-4c63-9f6f-a7e8549c62c7 tempest-ServersOnMultiNodesTest-1671986198 tempest-ServersOnMultiNodesTest-1671986198-project-admin] [instance: 9e985a36-586a-4546-a0c0-1a3e3da330c9] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:26.681617 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9d015147-0c94-4c63-9f6f-a7e8549c62c7 tempest-ServersOnMultiNodesTest-1671986198 tempest-ServersOnMultiNodesTest-1671986198-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:26.682100 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9d015147-0c94-4c63-9f6f-a7e8549c62c7 tempest-ServersOnMultiNodesTest-1671986198 tempest-ServersOnMultiNodesTest-1671986198-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:26.686672 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9d015147-0c94-4c63-9f6f-a7e8549c62c7 tempest-ServersOnMultiNodesTest-1671986198 tempest-ServersOnMultiNodesTest-1671986198-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:26.688999 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9d015147-0c94-4c63-9f6f-a7e8549c62c7 tempest-ServersOnMultiNodesTest-1671986198 tempest-ServersOnMultiNodesTest-1671986198-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:26.765549 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=100 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:15:26.874871 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:15:26.899171 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=6 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:15:26.968672 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-817ffcd6-d381-47dc-8ba7-48fc121cfa81 tempest-FloatingIPsTestJSON-443811915 tempest-FloatingIPsTestJSON-443811915-project] 10.222.0.17 "DELETE /compute/v2.1/os-floating-ips/f74839d1-9c08-46a9-a894-536c0afc6cdd" status: 202 len: 0 microversion: 2.1 time: 1.334814 Jul 23 21:15:26.969265 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 275/615] 10.222.0.17 () {58 vars in 1262 bytes} [Sat Jul 23 21:15:25 2022] DELETE /compute/v2.1/os-floating-ips/f74839d1-9c08-46a9-a894-536c0afc6cdd => generated 0 bytes in 1336 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:15:26.974926 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-fe9a211f-c539-441d-9dcc-2a27bf759dae tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:26.975549 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-fe9a211f-c539-441d-9dcc-2a27bf759dae tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] [instance: 70997419-42ea-46b3-a1bd-127efc670cd2] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:26.984519 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fe9a211f-c539-441d-9dcc-2a27bf759dae tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:26.984975 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fe9a211f-c539-441d-9dcc-2a27bf759dae tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:26.986389 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fe9a211f-c539-441d-9dcc-2a27bf759dae tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:26.986840 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fe9a211f-c539-441d-9dcc-2a27bf759dae tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:27.131321 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-fe9a211f-c539-441d-9dcc-2a27bf759dae tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a872dad882e4694aba20eaa8c06df53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457d184c579a4016a0eec16eb9f23195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:27.139523 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-fe9a211f-c539-441d-9dcc-2a27bf759dae tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] 10.222.0.17 "GET /compute/v2.1/servers/70997419-42ea-46b3-a1bd-127efc670cd2" status: 200 len: 1318 microversion: 2.1 time: 0.169207 Jul 23 21:15:27.140092 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 276/616] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:26 2022] GET /compute/v2.1/servers/70997419-42ea-46b3-a1bd-127efc670cd2 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:27.145025 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6dc340de-ddcc-4b12-aabb-a18b099fd22c tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:27.146007 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6dc340de-ddcc-4b12-aabb-a18b099fd22c tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: ed0fdfd2-3506-40c4-8e4a-bb984e946fdd] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:27.152543 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6dc340de-ddcc-4b12-aabb-a18b099fd22c tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:27.153007 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6dc340de-ddcc-4b12-aabb-a18b099fd22c tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:27.153793 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6dc340de-ddcc-4b12-aabb-a18b099fd22c tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:27.154243 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6dc340de-ddcc-4b12-aabb-a18b099fd22c tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:27.348630 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6dc340de-ddcc-4b12-aabb-a18b099fd22c tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:27.358943 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6dc340de-ddcc-4b12-aabb-a18b099fd22c tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:27.361311 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6dc340de-ddcc-4b12-aabb-a18b099fd22c tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:27.363242 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6dc340de-ddcc-4b12-aabb-a18b099fd22c tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/ed0fdfd2-3506-40c4-8e4a-bb984e946fdd" status: 200 len: 1567 microversion: 2.25 time: 0.221893 Jul 23 21:15:27.370743 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 277/617] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:15:27 2022] GET /compute/v2.1/servers/ed0fdfd2-3506-40c4-8e4a-bb984e946fdd => generated 1567 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:15:27.377057 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-03b4dda7-66a2-4606-92e6-507b4971e5cc tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:27.377972 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-03b4dda7-66a2-4606-92e6-507b4971e5cc tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 5bc4befa-252d-456a-92cd-323bad80fcdf] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:27.385358 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-03b4dda7-66a2-4606-92e6-507b4971e5cc tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:27.385920 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-03b4dda7-66a2-4606-92e6-507b4971e5cc tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:27.386682 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-03b4dda7-66a2-4606-92e6-507b4971e5cc tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:27.387111 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-03b4dda7-66a2-4606-92e6-507b4971e5cc tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:27.420611 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-9d015147-0c94-4c63-9f6f-a7e8549c62c7 tempest-ServersOnMultiNodesTest-1671986198 tempest-ServersOnMultiNodesTest-1671986198-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/9e985a36-586a-4546-a0c0-1a3e3da330c9" status: 200 len: 1618 microversion: 2.1 time: 0.905509 Jul 23 21:15:27.440796 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 341/618] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:26 2022] GET /compute/v2.1/servers/9e985a36-586a-4546-a0c0-1a3e3da330c9 => generated 1618 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:27.468872 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d70e6b75-ce0a-4101-9714-4ef69b243eb3 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:27.472043 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-d70e6b75-ce0a-4101-9714-4ef69b243eb3 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] [instance: fc41b6cc-f603-4f7d-89cb-a7e3cee372a5] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:27.482904 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d70e6b75-ce0a-4101-9714-4ef69b243eb3 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:27.483330 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d70e6b75-ce0a-4101-9714-4ef69b243eb3 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:27.484269 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d70e6b75-ce0a-4101-9714-4ef69b243eb3 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:27.484721 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d70e6b75-ce0a-4101-9714-4ef69b243eb3 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:27.503149 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-03b4dda7-66a2-4606-92e6-507b4971e5cc tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:27.526753 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-03b4dda7-66a2-4606-92e6-507b4971e5cc tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/5bc4befa-252d-456a-92cd-323bad80fcdf" status: 200 len: 1270 microversion: 2.1 time: 0.154316 Jul 23 21:15:27.537980 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 278/619] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:27 2022] GET /compute/v2.1/servers/5bc4befa-252d-456a-92cd-323bad80fcdf => generated 1270 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:27.544676 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3f18415a-8ea6-437d-888e-163b6d91c6dd tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:27.546340 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-3f18415a-8ea6-437d-888e-163b6d91c6dd tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:27.554206 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3f18415a-8ea6-437d-888e-163b6d91c6dd tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:27.555312 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3f18415a-8ea6-437d-888e-163b6d91c6dd tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:27.556123 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3f18415a-8ea6-437d-888e-163b6d91c6dd tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:27.556563 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3f18415a-8ea6-437d-888e-163b6d91c6dd tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:27.918858 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-d70e6b75-ce0a-4101-9714-4ef69b243eb3 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f1a14a59b7401d88f18ec35c91e30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c17bd813264fb9891076799e33acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:27.928037 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-d70e6b75-ce0a-4101-9714-4ef69b243eb3 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] 10.222.0.17 "GET /compute/v2.1/servers/fc41b6cc-f603-4f7d-89cb-a7e3cee372a5" status: 200 len: 1588 microversion: 2.1 time: 0.485310 Jul 23 21:15:27.928811 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 342/620] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:27 2022] GET /compute/v2.1/servers/fc41b6cc-f603-4f7d-89cb-a7e3cee372a5 => generated 1588 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:27.934281 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-47dac2a0-e49e-469b-8e23-2f59f38f30d9 tempest-FloatingIPsTestJSON-443811915 tempest-FloatingIPsTestJSON-443811915-project] Calling method '.version_select at 0x7f0b54367310>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:27.977634 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-3f18415a-8ea6-437d-888e-163b6d91c6dd tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:27.987064 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-3f18415a-8ea6-437d-888e-163b6d91c6dd tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b" status: 200 len: 1494 microversion: 2.1 time: 0.447588 Jul 23 21:15:27.987664 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 279/621] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:27 2022] GET /compute/v2.1/servers/d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b => generated 1494 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:27.997661 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d4bf0aa7-6e88-4ea8-952a-d0e460d6bb80 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Action: 'create', calling method: .version_select at 0x7f0b540ea3a0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-809188957", "policies": ["affinity"]}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:15:28.018944 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-d4bf0aa7-6e88-4ea8-952a-d0e460d6bb80 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Getting quotas for project f5e7d37a0e3b4b32ae99c3bc15a831e6. Resources: {'server_groups'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:15:28.024005 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-d4bf0aa7-6e88-4ea8-952a-d0e460d6bb80 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Getting quotas for user ebf92af08fa94215b4eafcacea6c63f6 and project f5e7d37a0e3b4b32ae99c3bc15a831e6. Resources: {'server_groups'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:15:28.038931 ncdv-master-1 devstack@n-api.service[131321]: DEBUG neutronclient.v2_0.client [None req-47dac2a0-e49e-469b-8e23-2f59f38f30d9 tempest-FloatingIPsTestJSON-443811915 tempest-FloatingIPsTestJSON-443811915-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP f74839d1-9c08-46a9-a894-536c0afc6cdd could not be found", "detail": ""}} {{(pid=131321) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 23 21:15:28.039827 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-47dac2a0-e49e-469b-8e23-2f59f38f30d9 tempest-FloatingIPsTestJSON-443811915 tempest-FloatingIPsTestJSON-443811915-project] HTTP exception thrown: Floating IP not found for ID f74839d1-9c08-46a9-a894-536c0afc6cdd Jul 23 21:15:28.053921 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-47dac2a0-e49e-469b-8e23-2f59f38f30d9 tempest-FloatingIPsTestJSON-443811915 tempest-FloatingIPsTestJSON-443811915-project] Request method failure captured: Jul 23 21:15:28.053921 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/os-floating-ips/f74839d1-9c08-46a9-a894-536c0afc6cdd HTTP/1.1 Jul 23 21:15:28.053921 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:15:28.053921 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:15:28.053921 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:15:28.053921 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:15:28.053921 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:15:28.053921 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:15:28.053921 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:15:28.053921 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:15:28.053921 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GTkfUF1Slpffit17g3M6pwsoLNQ_HP0LoI9zkXi_w4hYlZoK73O2ba16-EzoAk1vPwyzc4Xg3e-H32JJ4mOzz8w80hjo6p7D_emWJqT5VSemKjz5CF4lLr7L8ogyRvCvp1T6lbmVNI7c17qppdFsN0MPcytnvMHUjSrmQS8SH3m6t8 Jul 23 21:15:28.053921 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:15:28.053921 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:15:28.053921 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:15:28.053921 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:15:28.053921 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:15:28.053921 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:15:28.053921 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 21523d7e146e4e84a1a85222141c6e7b Jul 23 21:15:28.053921 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-FloatingIPsTestJSON-443811915 Jul 23 21:15:28.053921 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:15:28.053921 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:15:28.055728 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/21523d7e146e4e84a1a85222141c6e7b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/21523d7e146e4e84a1a85222141c6e7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_21523d7e146e4e84a1a85222141c6e7b", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/21523d7e146e4e84a1a85222141c6e7b"}]}] Jul 23 21:15:28.055728 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-FloatingIPsTestJSON-443811915 Jul 23 21:15:28.055728 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 21523d7e146e4e84a1a85222141c6e7b Jul 23 21:15:28.055728 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-FloatingIPsTestJSON-443811915 Jul 23 21:15:28.055728 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-FloatingIPsTestJSON-443811915-project Jul 23 21:15:28.055728 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:15:28.055728 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:15:28.055728 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 89b3fe601e1a476ea1abb1870769eb60 Jul 23 21:15:28.055728 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-FloatingIPsTestJSON-443811915-project Jul 23 21:15:28.055728 ncdv-master-1 devstack@n-api.service[131321]: method: Jul 23 21:15:28.055728 ncdv-master-1 devstack@n-api.service[131321]: exception: Floating IP not found for ID f74839d1-9c08-46a9-a894-536c0afc6cdd Jul 23 21:15:28.055728 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': 'f74839d1-9c08-46a9-a894-536c0afc6cdd'} Jul 23 21:15:28.055728 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:15:28.056993 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:15:28.056993 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 23 21:15:28.056993 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 23 21:15:28.056993 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:15:28.056993 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:15:28.056993 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 23 21:15:28.056993 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 23 21:15:28.056993 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:15:28.056993 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:15:28.056993 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 23 21:15:28.056993 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 23 21:15:28.056993 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:15:28.056993 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:15:28.056993 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 23 21:15:28.056993 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 23 21:15:28.056993 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:15:28.056993 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:15:28.056993 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 23 21:15:28.056993 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 23 21:15:28.059102 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:15:28.059102 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:15:28.059102 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 23 21:15:28.059102 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 23 21:15:28.059102 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 23 21:15:28.059102 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 23 21:15:28.059102 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP f74839d1-9c08-46a9-a894-536c0afc6cdd could not be found Jul 23 21:15:28.059102 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-657a1f7a-8c79-4855-b25d-5aad22494211'] Jul 23 21:15:28.059102 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:15:28.059102 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:15:28.059102 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:15:28.059102 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:15:28.059102 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Jul 23 21:15:28.059102 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 23 21:15:28.059102 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 23 21:15:28.059102 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 23 21:15:28.059102 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID f74839d1-9c08-46a9-a894-536c0afc6cdd. Jul 23 21:15:28.059102 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:15:28.059102 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:15:28.059102 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:15:28.061224 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:15:28.061224 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:15:28.061224 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:15:28.061224 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:15:28.061224 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:15:28.061224 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:15:28.061224 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:15:28.061224 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:15:28.061224 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:15:28.061224 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Jul 23 21:15:28.061224 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 23 21:15:28.061224 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID f74839d1-9c08-46a9-a894-536c0afc6cdd Jul 23 21:15:28.061224 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:15:28.061224 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:15:28.061224 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:15:28.061224 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:15:28.061224 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:15:28.061224 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:15:28.061224 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:15:28.061224 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:15:28.063156 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID f74839d1-9c08-46a9-a894-536c0afc6cdd Jul 23 21:15:28.063156 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:15:28.064761 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-47dac2a0-e49e-469b-8e23-2f59f38f30d9 tempest-FloatingIPsTestJSON-443811915 tempest-FloatingIPsTestJSON-443811915-project] Returning 404 to user: Floating IP not found for ID f74839d1-9c08-46a9-a894-536c0afc6cdd {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:15:28.065979 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:15:28.066729 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-47dac2a0-e49e-469b-8e23-2f59f38f30d9 tempest-FloatingIPsTestJSON-443811915 tempest-FloatingIPsTestJSON-443811915-project] 10.222.0.17 "GET /compute/v2.1/os-floating-ips/f74839d1-9c08-46a9-a894-536c0afc6cdd" status: 404 len: 111 microversion: 2.1 time: 0.136134 Jul 23 21:15:28.071179 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 343/622] 10.222.0.17 () {58 vars in 1259 bytes} [Sat Jul 23 21:15:27 2022] GET /compute/v2.1/os-floating-ips/f74839d1-9c08-46a9-a894-536c0afc6cdd => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:15:28.077202 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-cc209bbf-522d-41be-8efd-9ea57bdc466d tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:28.077802 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-cc209bbf-522d-41be-8efd-9ea57bdc466d tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] [instance: fc41b6cc-f603-4f7d-89cb-a7e3cee372a5] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:28.083062 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-d4bf0aa7-6e88-4ea8-952a-d0e460d6bb80 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Getting quotas for project f5e7d37a0e3b4b32ae99c3bc15a831e6. Resources: {'server_groups'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:15:28.087993 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cc209bbf-522d-41be-8efd-9ea57bdc466d tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:28.088755 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cc209bbf-522d-41be-8efd-9ea57bdc466d tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:28.089427 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-d4bf0aa7-6e88-4ea8-952a-d0e460d6bb80 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Getting quotas for user ebf92af08fa94215b4eafcacea6c63f6 and project f5e7d37a0e3b4b32ae99c3bc15a831e6. Resources: {'server_groups'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:15:28.089680 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cc209bbf-522d-41be-8efd-9ea57bdc466d tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:28.090472 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cc209bbf-522d-41be-8efd-9ea57bdc466d tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:28.108937 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d4bf0aa7-6e88-4ea8-952a-d0e460d6bb80 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "POST /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.115777 Jul 23 21:15:28.109160 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 280/623] 10.222.0.17 () {60 vars in 1173 bytes} [Sat Jul 23 21:15:27 2022] POST /compute/v2.1/os-server-groups => generated 187 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:15:28.113947 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-49ed57e8-053b-4699-b0cf-38909f62fe54 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:28.114572 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-49ed57e8-053b-4699-b0cf-38909f62fe54 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] [instance: d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:28.132746 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-49ed57e8-053b-4699-b0cf-38909f62fe54 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:28.136353 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-49ed57e8-053b-4699-b0cf-38909f62fe54 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:28.140356 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-49ed57e8-053b-4699-b0cf-38909f62fe54 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:28.141036 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-49ed57e8-053b-4699-b0cf-38909f62fe54 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:28.146409 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:15:28.293942 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-49ed57e8-053b-4699-b0cf-38909f62fe54 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b" status: 200 len: 1645 microversion: 2.1 time: 0.183642 Jul 23 21:15:28.300650 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 281/624] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:28 2022] GET /compute/v2.1/servers/d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b => generated 1645 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:28.300650 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-08d9354c-4f4d-44bf-bc4b-b935d4948413 tempest-FloatingIPsTestJSON-443811915 tempest-FloatingIPsTestJSON-443811915-project] Calling method '.version_select at 0x7f0b47ccdd30>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:28.350343 ncdv-master-1 devstack@n-api.service[131320]: DEBUG neutronclient.v2_0.client [None req-08d9354c-4f4d-44bf-bc4b-b935d4948413 tempest-FloatingIPsTestJSON-443811915 tempest-FloatingIPsTestJSON-443811915-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP f74839d1-9c08-46a9-a894-536c0afc6cdd could not be found", "detail": ""}} {{(pid=131320) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 23 21:15:28.351256 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-08d9354c-4f4d-44bf-bc4b-b935d4948413 tempest-FloatingIPsTestJSON-443811915 tempest-FloatingIPsTestJSON-443811915-project] HTTP exception thrown: Floating IP not found for ID f74839d1-9c08-46a9-a894-536c0afc6cdd Jul 23 21:15:28.358682 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-08d9354c-4f4d-44bf-bc4b-b935d4948413 tempest-FloatingIPsTestJSON-443811915 tempest-FloatingIPsTestJSON-443811915-project] Request method failure captured: Jul 23 21:15:28.358682 ncdv-master-1 devstack@n-api.service[131320]: request: DELETE /compute/v2.1/os-floating-ips/f74839d1-9c08-46a9-a894-536c0afc6cdd HTTP/1.1 Jul 23 21:15:28.358682 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:15:28.358682 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:15:28.358682 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:15:28.358682 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:15:28.358682 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:15:28.358682 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:15:28.358682 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:15:28.358682 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:15:28.358682 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GTkfUF1Slpffit17g3M6pwsoLNQ_HP0LoI9zkXi_w4hYlZoK73O2ba16-EzoAk1vPwyzc4Xg3e-H32JJ4mOzz8w80hjo6p7D_emWJqT5VSemKjz5CF4lLr7L8ogyRvCvp1T6lbmVNI7c17qppdFsN0MPcytnvMHUjSrmQS8SH3m6t8 Jul 23 21:15:28.358682 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:15:28.358682 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:15:28.358682 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:15:28.358682 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:15:28.358682 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:15:28.358682 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:15:28.358682 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 21523d7e146e4e84a1a85222141c6e7b Jul 23 21:15:28.358682 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-FloatingIPsTestJSON-443811915 Jul 23 21:15:28.358682 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:15:28.358682 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:15:28.360796 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/21523d7e146e4e84a1a85222141c6e7b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/21523d7e146e4e84a1a85222141c6e7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_21523d7e146e4e84a1a85222141c6e7b", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/21523d7e146e4e84a1a85222141c6e7b"}]}] Jul 23 21:15:28.360796 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-FloatingIPsTestJSON-443811915 Jul 23 21:15:28.360796 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 21523d7e146e4e84a1a85222141c6e7b Jul 23 21:15:28.360796 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-FloatingIPsTestJSON-443811915 Jul 23 21:15:28.360796 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-FloatingIPsTestJSON-443811915-project Jul 23 21:15:28.360796 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:15:28.360796 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:15:28.360796 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 89b3fe601e1a476ea1abb1870769eb60 Jul 23 21:15:28.360796 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-FloatingIPsTestJSON-443811915-project Jul 23 21:15:28.360796 ncdv-master-1 devstack@n-api.service[131320]: method: Jul 23 21:15:28.360796 ncdv-master-1 devstack@n-api.service[131320]: exception: Floating IP not found for ID f74839d1-9c08-46a9-a894-536c0afc6cdd Jul 23 21:15:28.360796 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': 'f74839d1-9c08-46a9-a894-536c0afc6cdd'} Jul 23 21:15:28.360796 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:15:28.361903 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:15:28.361903 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 23 21:15:28.361903 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 23 21:15:28.361903 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:15:28.361903 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:15:28.361903 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 23 21:15:28.361903 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 23 21:15:28.361903 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:15:28.361903 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:15:28.361903 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 23 21:15:28.361903 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 23 21:15:28.361903 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:15:28.361903 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:15:28.361903 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 23 21:15:28.361903 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 23 21:15:28.361903 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:15:28.361903 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:15:28.361903 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 23 21:15:28.361903 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 23 21:15:28.363898 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:15:28.363898 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:15:28.363898 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 23 21:15:28.363898 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 23 21:15:28.363898 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 23 21:15:28.363898 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 23 21:15:28.363898 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP f74839d1-9c08-46a9-a894-536c0afc6cdd could not be found Jul 23 21:15:28.363898 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-39656576-cb7d-4c6a-9021-37fbc3a3d03f'] Jul 23 21:15:28.363898 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:15:28.363898 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:15:28.363898 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:15:28.363898 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:15:28.363898 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Jul 23 21:15:28.363898 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 23 21:15:28.363898 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 23 21:15:28.363898 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 23 21:15:28.363898 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID f74839d1-9c08-46a9-a894-536c0afc6cdd. Jul 23 21:15:28.363898 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:15:28.363898 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:15:28.363898 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:15:28.365379 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:15:28.365379 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:15:28.365379 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:15:28.365379 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:15:28.365379 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:15:28.365379 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:15:28.365379 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:15:28.365379 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:15:28.365379 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:15:28.365379 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Jul 23 21:15:28.365379 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 23 21:15:28.365379 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID f74839d1-9c08-46a9-a894-536c0afc6cdd Jul 23 21:15:28.365379 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:15:28.365379 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:15:28.365379 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:15:28.365379 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:15:28.365379 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:15:28.365379 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:15:28.365379 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:15:28.365379 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:15:28.367174 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID f74839d1-9c08-46a9-a894-536c0afc6cdd Jul 23 21:15:28.367174 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:15:28.367174 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-08d9354c-4f4d-44bf-bc4b-b935d4948413 tempest-FloatingIPsTestJSON-443811915 tempest-FloatingIPsTestJSON-443811915-project] Returning 404 to user: Floating IP not found for ID f74839d1-9c08-46a9-a894-536c0afc6cdd {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:15:28.367174 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-08d9354c-4f4d-44bf-bc4b-b935d4948413 tempest-FloatingIPsTestJSON-443811915 tempest-FloatingIPsTestJSON-443811915-project] 10.222.0.17 "DELETE /compute/v2.1/os-floating-ips/f74839d1-9c08-46a9-a894-536c0afc6cdd" status: 404 len: 111 microversion: 2.1 time: 0.067603 Jul 23 21:15:28.367174 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 282/625] 10.222.0.17 () {58 vars in 1262 bytes} [Sat Jul 23 21:15:28 2022] DELETE /compute/v2.1/os-floating-ips/f74839d1-9c08-46a9-a894-536c0afc6cdd => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:15:28.375251 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-de91d347-8e55-4002-8b95-31f90ae8c9f3 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:28.376070 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-de91d347-8e55-4002-8b95-31f90ae8c9f3 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] [instance: 70997419-42ea-46b3-a1bd-127efc670cd2] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:28.384560 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-de91d347-8e55-4002-8b95-31f90ae8c9f3 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:28.385497 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-de91d347-8e55-4002-8b95-31f90ae8c9f3 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:28.386477 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-de91d347-8e55-4002-8b95-31f90ae8c9f3 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:28.387060 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-de91d347-8e55-4002-8b95-31f90ae8c9f3 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:28.534780 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-cc209bbf-522d-41be-8efd-9ea57bdc466d tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] 10.222.0.17 "GET /compute/v2.1/servers/fc41b6cc-f603-4f7d-89cb-a7e3cee372a5/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.462230 Jul 23 21:15:28.535676 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 344/626] 10.222.0.17 () {58 vars in 1274 bytes} [Sat Jul 23 21:15:28 2022] GET /compute/v2.1/servers/fc41b6cc-f603-4f7d-89cb-a7e3cee372a5/os-interface => generated 285 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:15:28.545262 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-70d22df3-6d70-4dc9-9774-fb3c4353fab0 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1739598718", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "b40e815e-b69f-4380-9032-d2af05d5a157"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:15:28.616927 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.network.neutron [None req-70d22df3-6d70-4dc9-9774-fb3c4353fab0 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] validate_networks() for None {{(pid=131321) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:15:28.671083 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-de91d347-8e55-4002-8b95-31f90ae8c9f3 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a872dad882e4694aba20eaa8c06df53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457d184c579a4016a0eec16eb9f23195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:28.679125 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-de91d347-8e55-4002-8b95-31f90ae8c9f3 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] 10.222.0.17 "GET /compute/v2.1/servers/70997419-42ea-46b3-a1bd-127efc670cd2" status: 200 len: 1318 microversion: 2.1 time: 0.307651 Jul 23 21:15:28.688687 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 283/627] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:28 2022] GET /compute/v2.1/servers/70997419-42ea-46b3-a1bd-127efc670cd2 => generated 1318 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:28.693910 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-236fd5c2-48c2-45db-8ea6-39ca2038d53a tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:28.694761 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-236fd5c2-48c2-45db-8ea6-39ca2038d53a tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] [instance: d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:28.701314 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-236fd5c2-48c2-45db-8ea6-39ca2038d53a tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:28.702156 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-236fd5c2-48c2-45db-8ea6-39ca2038d53a tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:28.703121 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-236fd5c2-48c2-45db-8ea6-39ca2038d53a tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:28.703765 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-236fd5c2-48c2-45db-8ea6-39ca2038d53a tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:29.041439 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-236fd5c2-48c2-45db-8ea6-39ca2038d53a tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b" status: 200 len: 1645 microversion: 2.1 time: 0.351231 Jul 23 21:15:29.054888 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 284/628] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:28 2022] GET /compute/v2.1/servers/d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b => generated 1645 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:29.054888 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3c7be866-52e5-4cd2-ad77-0eb1f4306a6d tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:29.054888 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-3c7be866-52e5-4cd2-ad77-0eb1f4306a6d tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: ed0fdfd2-3506-40c4-8e4a-bb984e946fdd] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:29.065371 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3c7be866-52e5-4cd2-ad77-0eb1f4306a6d tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:29.066623 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3c7be866-52e5-4cd2-ad77-0eb1f4306a6d tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:29.067521 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3c7be866-52e5-4cd2-ad77-0eb1f4306a6d tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:29.068097 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3c7be866-52e5-4cd2-ad77-0eb1f4306a6d tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:29.438696 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-3c7be866-52e5-4cd2-ad77-0eb1f4306a6d tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:29.451622 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-3c7be866-52e5-4cd2-ad77-0eb1f4306a6d tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:29.453699 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-3c7be866-52e5-4cd2-ad77-0eb1f4306a6d tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:29.455595 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-3c7be866-52e5-4cd2-ad77-0eb1f4306a6d tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/ed0fdfd2-3506-40c4-8e4a-bb984e946fdd" status: 200 len: 1567 microversion: 2.25 time: 0.408707 Jul 23 21:15:29.466761 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 285/629] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:15:29 2022] GET /compute/v2.1/servers/ed0fdfd2-3506-40c4-8e4a-bb984e946fdd => generated 1567 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:15:29.471534 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-90c43df6-b9df-45fc-8cbe-f1d91a7f341c tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:29.472145 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-90c43df6-b9df-45fc-8cbe-f1d91a7f341c tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 5bc4befa-252d-456a-92cd-323bad80fcdf] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:29.499727 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-90c43df6-b9df-45fc-8cbe-f1d91a7f341c tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:29.506069 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-90c43df6-b9df-45fc-8cbe-f1d91a7f341c tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:29.511597 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-90c43df6-b9df-45fc-8cbe-f1d91a7f341c tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:29.512965 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-90c43df6-b9df-45fc-8cbe-f1d91a7f341c tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:29.598358 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-70d22df3-6d70-4dc9-9774-fb3c4353fab0 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Flavor limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:15:29.599026 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-70d22df3-6d70-4dc9-9774-fb3c4353fab0 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Image limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:15:29.599251 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-70d22df3-6d70-4dc9-9774-fb3c4353fab0 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Flavor pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:15:29.599735 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-70d22df3-6d70-4dc9-9774-fb3c4353fab0 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Image pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:15:29.600351 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-70d22df3-6d70-4dc9-9774-fb3c4353fab0 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:15:29.660759 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-70d22df3-6d70-4dc9-9774-fb3c4353fab0 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:29.661526 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-70d22df3-6d70-4dc9-9774-fb3c4353fab0 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:29.662696 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-70d22df3-6d70-4dc9-9774-fb3c4353fab0 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:29.663392 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-70d22df3-6d70-4dc9-9774-fb3c4353fab0 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:29.716860 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-70d22df3-6d70-4dc9-9774-fb3c4353fab0 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Getting quotas for project f5e7d37a0e3b4b32ae99c3bc15a831e6. Resources: {'ram', 'instances', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:15:29.734096 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-70d22df3-6d70-4dc9-9774-fb3c4353fab0 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Getting quotas for user ebf92af08fa94215b4eafcacea6c63f6 and project f5e7d37a0e3b4b32ae99c3bc15a831e6. Resources: {'ram', 'instances', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:15:29.770431 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-70d22df3-6d70-4dc9-9774-fb3c4353fab0 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Going to run 2 instances... {{(pid=131321) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:15:29.774020 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-70d22df3-6d70-4dc9-9774-fb3c4353fab0 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: da599d16-7a8c-4ced-b129-d692e5b4866f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131321) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:15:29.870026 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-70d22df3-6d70-4dc9-9774-fb3c4353fab0 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=131321) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Jul 23 21:15:29.930051 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-70d22df3-6d70-4dc9-9774-fb3c4353fab0 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Getting quotas for project f5e7d37a0e3b4b32ae99c3bc15a831e6. Resources: {'server_group_members'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:15:29.942790 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-70d22df3-6d70-4dc9-9774-fb3c4353fab0 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Getting quotas for user ebf92af08fa94215b4eafcacea6c63f6 and project f5e7d37a0e3b4b32ae99c3bc15a831e6. Resources: {'server_group_members'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:15:30.018159 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-90c43df6-b9df-45fc-8cbe-f1d91a7f341c tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:30.026489 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-90c43df6-b9df-45fc-8cbe-f1d91a7f341c tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/5bc4befa-252d-456a-92cd-323bad80fcdf" status: 200 len: 1312 microversion: 2.1 time: 0.558771 Jul 23 21:15:30.049058 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 286/630] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:29 2022] GET /compute/v2.1/servers/5bc4befa-252d-456a-92cd-323bad80fcdf => generated 1312 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:30.053986 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-70d22df3-6d70-4dc9-9774-fb3c4353fab0 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Getting quotas for project f5e7d37a0e3b4b32ae99c3bc15a831e6. Resources: {'server_group_members'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:15:30.055430 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2470fc2e-9960-4a88-9715-4e6ef5ab46ea tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:30.060161 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:15:30.060161 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:15:30.063498 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2470fc2e-9960-4a88-9715-4e6ef5ab46ea tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:30.063830 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-70d22df3-6d70-4dc9-9774-fb3c4353fab0 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Getting quotas for user ebf92af08fa94215b4eafcacea6c63f6 and project f5e7d37a0e3b4b32ae99c3bc15a831e6. Resources: {'server_group_members'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:15:30.065083 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2470fc2e-9960-4a88-9715-4e6ef5ab46ea tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:30.073137 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2470fc2e-9960-4a88-9715-4e6ef5ab46ea tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:30.073643 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2470fc2e-9960-4a88-9715-4e6ef5ab46ea tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:30.088601 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-70d22df3-6d70-4dc9-9774-fb3c4353fab0 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: f299d55c-90a4-41cc-98a8-e14ca5964eb1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=da599d16-7a8c-4ced-b129-d692e5b4866f,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131321) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:15:30.124685 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2470fc2e-9960-4a88-9715-4e6ef5ab46ea tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.073759 Jul 23 21:15:30.127569 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 287/631] 10.222.0.17 () {58 vars in 1175 bytes} [Sat Jul 23 21:15:30 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:15:30.134230 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c1635850-6e57-4d8c-8534-afe21af926a0 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:30.135244 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c1635850-6e57-4d8c-8534-afe21af926a0 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] [instance: 70997419-42ea-46b3-a1bd-127efc670cd2] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:30.144900 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c1635850-6e57-4d8c-8534-afe21af926a0 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:30.146207 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c1635850-6e57-4d8c-8534-afe21af926a0 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:30.147217 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c1635850-6e57-4d8c-8534-afe21af926a0 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:30.147987 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c1635850-6e57-4d8c-8534-afe21af926a0 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:30.188771 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-70d22df3-6d70-4dc9-9774-fb3c4353fab0 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Getting quotas for project f5e7d37a0e3b4b32ae99c3bc15a831e6. Resources: {'server_group_members'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:15:30.196750 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-70d22df3-6d70-4dc9-9774-fb3c4353fab0 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Getting quotas for user ebf92af08fa94215b4eafcacea6c63f6 and project f5e7d37a0e3b4b32ae99c3bc15a831e6. Resources: {'server_group_members'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:15:30.235766 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:15:30.264532 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-70d22df3-6d70-4dc9-9774-fb3c4353fab0 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Getting quotas for project f5e7d37a0e3b4b32ae99c3bc15a831e6. Resources: {'server_group_members'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:15:30.276011 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-70d22df3-6d70-4dc9-9774-fb3c4353fab0 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Getting quotas for user ebf92af08fa94215b4eafcacea6c63f6 and project f5e7d37a0e3b4b32ae99c3bc15a831e6. Resources: {'server_group_members'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:15:30.325056 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-70d22df3-6d70-4dc9-9774-fb3c4353fab0 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.787916 Jul 23 21:15:30.326710 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 345/632] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:15:28 2022] POST /compute/v2.1/servers => generated 32 bytes in 1790 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jul 23 21:15:30.338227 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-46835a1c-a525-40f8-951b-240a54b5aae1 req-d6e38044-abfa-4bfd-92ca-0ca3e26dcc2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70997419-42ea-46b3-a1bd-127efc670cd2", "name": "network-vif-plugged", "status": "completed", "tag": "85027928-65ec-4df1-9876-e9b194f491fb"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:15:30.358538 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-46835a1c-a525-40f8-951b-240a54b5aae1 req-d6e38044-abfa-4bfd-92ca-0ca3e26dcc2e service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:30.358979 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-46835a1c-a525-40f8-951b-240a54b5aae1 req-d6e38044-abfa-4bfd-92ca-0ca3e26dcc2e service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:30.394408 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-46835a1c-a525-40f8-951b-240a54b5aae1 req-d6e38044-abfa-4bfd-92ca-0ca3e26dcc2e service nova] Creating event network-vif-plugged:85027928-65ec-4df1-9876-e9b194f491fb for instance 70997419-42ea-46b3-a1bd-127efc670cd2 on nch2-master-1 Jul 23 21:15:30.409977 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-46835a1c-a525-40f8-951b-240a54b5aae1 req-d6e38044-abfa-4bfd-92ca-0ca3e26dcc2e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074963 Jul 23 21:15:30.411259 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 346/633] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:15:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:15:30.416716 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-473b9e63-7e1c-4778-a7e3-1fa7c80be617 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:15:30.417299 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-473b9e63-7e1c-4778-a7e3-1fa7c80be617 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] [instance: d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:30.433120 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-473b9e63-7e1c-4778-a7e3-1fa7c80be617 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:30.433581 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-473b9e63-7e1c-4778-a7e3-1fa7c80be617 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:30.434386 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-473b9e63-7e1c-4778-a7e3-1fa7c80be617 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:30.434907 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-473b9e63-7e1c-4778-a7e3-1fa7c80be617 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:30.590033 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-473b9e63-7e1c-4778-a7e3-1fa7c80be617 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b/action" status: 202 len: 0 microversion: 2.1 time: 0.177070 Jul 23 21:15:30.593788 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 347/634] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:15:30 2022] POST /compute/v2.1/servers/d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b/action => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:15:30.611535 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-8e3dab14-0fb1-42c4-aa39-c38dde79acae tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:30.617036 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-8e3dab14-0fb1-42c4-aa39-c38dde79acae tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ebf92af08fa94215b4eafcacea6c63f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e7d37a0e3b4b32ae99c3bc15a831e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:30.618392 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-8e3dab14-0fb1-42c4-aa39-c38dde79acae tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Searching by: {'deleted': False, 'project_id': 'f5e7d37a0e3b4b32ae99c3bc15a831e6'} {{(pid=131321) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 23 21:15:30.654469 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8e3dab14-0fb1-42c4-aa39-c38dde79acae tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:30.657380 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8e3dab14-0fb1-42c4-aa39-c38dde79acae tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:30.659373 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8e3dab14-0fb1-42c4-aa39-c38dde79acae tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:30.660102 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8e3dab14-0fb1-42c4-aa39-c38dde79acae tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:30.676133 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c1635850-6e57-4d8c-8534-afe21af926a0 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a872dad882e4694aba20eaa8c06df53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457d184c579a4016a0eec16eb9f23195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:30.694400 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c1635850-6e57-4d8c-8534-afe21af926a0 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] 10.222.0.17 "GET /compute/v2.1/servers/70997419-42ea-46b3-a1bd-127efc670cd2" status: 200 len: 1318 microversion: 2.1 time: 0.559325 Jul 23 21:15:30.717760 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 288/635] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:30 2022] GET /compute/v2.1/servers/70997419-42ea-46b3-a1bd-127efc670cd2 => generated 1318 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:30.748444 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-29fd6d04-fc8d-4236-8d89-e08f2cce809e tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:30.749131 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-29fd6d04-fc8d-4236-8d89-e08f2cce809e tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: ed0fdfd2-3506-40c4-8e4a-bb984e946fdd] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:30.779844 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-29fd6d04-fc8d-4236-8d89-e08f2cce809e tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:30.780296 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-29fd6d04-fc8d-4236-8d89-e08f2cce809e tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:30.781094 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-29fd6d04-fc8d-4236-8d89-e08f2cce809e tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:30.781534 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-29fd6d04-fc8d-4236-8d89-e08f2cce809e tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:30.965479 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.multi_cell_list [None req-8e3dab14-0fb1-42c4-aa39-c38dde79acae tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=131321) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 23 21:15:31.374344 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-8e3dab14-0fb1-42c4-aa39-c38dde79acae tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "GET /compute/v2.1/servers" status: 200 len: 1004 microversion: 2.1 time: 0.777354 Jul 23 21:15:31.375054 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 348/636] 10.222.0.17 () {58 vars in 1124 bytes} [Sat Jul 23 21:15:30 2022] GET /compute/v2.1/servers => generated 1004 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:31.388371 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-72b42b77-2fdc-4c73-90ce-9c156a1bb09e tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:31.391487 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-72b42b77-2fdc-4c73-90ce-9c156a1bb09e tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] [instance: d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:31.406117 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-72b42b77-2fdc-4c73-90ce-9c156a1bb09e tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:31.408548 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-72b42b77-2fdc-4c73-90ce-9c156a1bb09e tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:31.409467 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-72b42b77-2fdc-4c73-90ce-9c156a1bb09e tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:31.410279 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-72b42b77-2fdc-4c73-90ce-9c156a1bb09e tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:31.445649 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-29fd6d04-fc8d-4236-8d89-e08f2cce809e tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:31.459283 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-29fd6d04-fc8d-4236-8d89-e08f2cce809e tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:31.463269 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-29fd6d04-fc8d-4236-8d89-e08f2cce809e tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:31.464484 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-29fd6d04-fc8d-4236-8d89-e08f2cce809e tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/ed0fdfd2-3506-40c4-8e4a-bb984e946fdd" status: 200 len: 1557 microversion: 2.25 time: 0.745599 Jul 23 21:15:31.469482 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 289/637] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:15:30 2022] GET /compute/v2.1/servers/ed0fdfd2-3506-40c4-8e4a-bb984e946fdd => generated 1557 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:15:31.486282 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-06a2afa8-070d-4b30-bc14-d2e4885c30e4 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:31.486901 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-06a2afa8-070d-4b30-bc14-d2e4885c30e4 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 5bc4befa-252d-456a-92cd-323bad80fcdf] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:31.498612 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-06a2afa8-070d-4b30-bc14-d2e4885c30e4 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:31.499298 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-06a2afa8-070d-4b30-bc14-d2e4885c30e4 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:31.500088 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-06a2afa8-070d-4b30-bc14-d2e4885c30e4 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:31.500769 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-06a2afa8-070d-4b30-bc14-d2e4885c30e4 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:31.723982 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-06a2afa8-070d-4b30-bc14-d2e4885c30e4 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:31.732012 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-06a2afa8-070d-4b30-bc14-d2e4885c30e4 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/5bc4befa-252d-456a-92cd-323bad80fcdf" status: 200 len: 1312 microversion: 2.1 time: 0.260519 Jul 23 21:15:31.734438 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 290/638] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:31 2022] GET /compute/v2.1/servers/5bc4befa-252d-456a-92cd-323bad80fcdf => generated 1312 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:31.744623 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-bc998610-e06e-46ed-a322-e6d8373c0bb5 req-ae4a4cbf-2ca2-459e-9ef8-e01dc6024312 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bc4befa-252d-456a-92cd-323bad80fcdf", "tag": "f00e5169-4343-4b5e-aafd-b0e8eea7078c"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:15:31.759060 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-bc998610-e06e-46ed-a322-e6d8373c0bb5 req-ae4a4cbf-2ca2-459e-9ef8-e01dc6024312 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:31.759759 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-bc998610-e06e-46ed-a322-e6d8373c0bb5 req-ae4a4cbf-2ca2-459e-9ef8-e01dc6024312 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:31.773045 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-bc998610-e06e-46ed-a322-e6d8373c0bb5 req-ae4a4cbf-2ca2-459e-9ef8-e01dc6024312 service nova] Creating event network-changed:f00e5169-4343-4b5e-aafd-b0e8eea7078c for instance 5bc4befa-252d-456a-92cd-323bad80fcdf on nch1-master-1 Jul 23 21:15:31.779680 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-bc998610-e06e-46ed-a322-e6d8373c0bb5 req-ae4a4cbf-2ca2-459e-9ef8-e01dc6024312 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038519 Jul 23 21:15:31.780918 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 291/639] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:15:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:15:31.787705 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6e179a1b-727a-4585-9599-992aaf876d4b tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:31.788730 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6e179a1b-727a-4585-9599-992aaf876d4b tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: f299d55c-90a4-41cc-98a8-e14ca5964eb1] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:31.811865 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6e179a1b-727a-4585-9599-992aaf876d4b tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:31.814122 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6e179a1b-727a-4585-9599-992aaf876d4b tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:31.815035 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6e179a1b-727a-4585-9599-992aaf876d4b tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:31.816954 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6e179a1b-727a-4585-9599-992aaf876d4b tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:31.943977 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-72b42b77-2fdc-4c73-90ce-9c156a1bb09e tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b" status: 200 len: 1630 microversion: 2.1 time: 0.564261 Jul 23 21:15:31.948151 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 349/640] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:31 2022] GET /compute/v2.1/servers/d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b => generated 1630 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:31.961701 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-20c57a96-d1e2-45f4-9180-b9d75218c098 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Calling method '.version_select at 0x7f0b5469e280>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:31.968587 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-20c57a96-d1e2-45f4-9180-b9d75218c098 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:31.969310 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-20c57a96-d1e2-45f4-9180-b9d75218c098 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:31.984465 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-20c57a96-d1e2-45f4-9180-b9d75218c098 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] 10.222.0.17 "GET /compute/v2.1/os-migrations" status: 200 len: 1280 microversion: 2.25 time: 0.034988 Jul 23 21:15:31.985825 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 350/641] 10.222.0.17 () {60 vars in 1183 bytes} [Sat Jul 23 21:15:31 2022] GET /compute/v2.1/os-migrations => generated 1280 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:15:31.991021 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-3465fd26-99d5-44b0-a135-e52f6950621e tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:31.991806 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-3465fd26-99d5-44b0-a135-e52f6950621e tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] [instance: 70997419-42ea-46b3-a1bd-127efc670cd2] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:31.998652 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3465fd26-99d5-44b0-a135-e52f6950621e tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:31.999366 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3465fd26-99d5-44b0-a135-e52f6950621e tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:32.000324 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3465fd26-99d5-44b0-a135-e52f6950621e tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:32.000916 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3465fd26-99d5-44b0-a135-e52f6950621e tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:32.190899 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6e179a1b-727a-4585-9599-992aaf876d4b tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf92af08fa94215b4eafcacea6c63f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e7d37a0e3b4b32ae99c3bc15a831e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:32.201180 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6e179a1b-727a-4585-9599-992aaf876d4b tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "GET /compute/v2.1/servers/f299d55c-90a4-41cc-98a8-e14ca5964eb1" status: 200 len: 1223 microversion: 2.1 time: 0.418781 Jul 23 21:15:32.202304 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 292/642] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:31 2022] GET /compute/v2.1/servers/f299d55c-90a4-41cc-98a8-e14ca5964eb1 => generated 1223 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:32.207381 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e04cc070-29b5-45b2-a089-4dc2cb2bc56e tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:32.208339 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e04cc070-29b5-45b2-a089-4dc2cb2bc56e tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] [instance: fc41b6cc-f603-4f7d-89cb-a7e3cee372a5] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:32.214824 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e04cc070-29b5-45b2-a089-4dc2cb2bc56e tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:32.215573 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e04cc070-29b5-45b2-a089-4dc2cb2bc56e tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:32.216595 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e04cc070-29b5-45b2-a089-4dc2cb2bc56e tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:32.217259 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e04cc070-29b5-45b2-a089-4dc2cb2bc56e tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:32.448040 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e04cc070-29b5-45b2-a089-4dc2cb2bc56e tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f1a14a59b7401d88f18ec35c91e30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c17bd813264fb9891076799e33acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:32.459385 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e04cc070-29b5-45b2-a089-4dc2cb2bc56e tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] 10.222.0.17 "GET /compute/v2.1/servers/fc41b6cc-f603-4f7d-89cb-a7e3cee372a5" status: 200 len: 1588 microversion: 2.1 time: 0.255799 Jul 23 21:15:32.460930 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 293/643] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:32 2022] GET /compute/v2.1/servers/fc41b6cc-f603-4f7d-89cb-a7e3cee372a5 => generated 1588 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:32.467223 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ee3ca01b-227b-45dd-b9c2-5fa17cbf2627 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:15:32.469121 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ee3ca01b-227b-45dd-b9c2-5fa17cbf2627 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] [instance: d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:32.478451 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ee3ca01b-227b-45dd-b9c2-5fa17cbf2627 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:32.479393 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ee3ca01b-227b-45dd-b9c2-5fa17cbf2627 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:32.480322 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ee3ca01b-227b-45dd-b9c2-5fa17cbf2627 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:32.480951 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ee3ca01b-227b-45dd-b9c2-5fa17cbf2627 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:32.543168 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.objects.instance [None req-ee3ca01b-227b-45dd-b9c2-5fa17cbf2627 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lazy-loading 'flavor' on Instance uuid d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b {{(pid=131320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:15:32.568641 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ee3ca01b-227b-45dd-b9c2-5fa17cbf2627 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] [instance: d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b] Going to try to live migrate instance to nch2-master-1 {{(pid=131320) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 23 21:15:32.702958 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-3465fd26-99d5-44b0-a135-e52f6950621e tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a872dad882e4694aba20eaa8c06df53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457d184c579a4016a0eec16eb9f23195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:32.714713 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-3465fd26-99d5-44b0-a135-e52f6950621e tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] 10.222.0.17 "GET /compute/v2.1/servers/70997419-42ea-46b3-a1bd-127efc670cd2" status: 200 len: 1318 microversion: 2.1 time: 0.727541 Jul 23 21:15:32.729218 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 351/644] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:31 2022] GET /compute/v2.1/servers/70997419-42ea-46b3-a1bd-127efc670cd2 => generated 1318 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:32.734938 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-44a4aeeb-3ea3-4367-bdc3-1c812c386c7c tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:32.735689 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-44a4aeeb-3ea3-4367-bdc3-1c812c386c7c tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] [instance: ed0fdfd2-3506-40c4-8e4a-bb984e946fdd] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:32.756456 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-44a4aeeb-3ea3-4367-bdc3-1c812c386c7c tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:32.758516 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-44a4aeeb-3ea3-4367-bdc3-1c812c386c7c tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:32.759539 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-44a4aeeb-3ea3-4367-bdc3-1c812c386c7c tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:32.761451 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-44a4aeeb-3ea3-4367-bdc3-1c812c386c7c tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:33.072685 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.objects.instance [None req-44a4aeeb-3ea3-4367-bdc3-1c812c386c7c tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lazy-loading 'services' on Instance uuid ed0fdfd2-3506-40c4-8e4a-bb984e946fdd {{(pid=131321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:15:33.104109 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-44a4aeeb-3ea3-4367-bdc3-1c812c386c7c tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/ed0fdfd2-3506-40c4-8e4a-bb984e946fdd" status: 200 len: 2049 microversion: 2.25 time: 0.380185 Jul 23 21:15:33.122253 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 352/645] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:15:32 2022] GET /compute/v2.1/servers/ed0fdfd2-3506-40c4-8e4a-bb984e946fdd => generated 2049 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:15:33.136491 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-241a7168-214d-4979-a124-160c06a4b417 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:33.141597 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-241a7168-214d-4979-a124-160c06a4b417 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 5bc4befa-252d-456a-92cd-323bad80fcdf] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:33.160462 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-241a7168-214d-4979-a124-160c06a4b417 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:33.162173 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-241a7168-214d-4979-a124-160c06a4b417 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:33.164848 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-241a7168-214d-4979-a124-160c06a4b417 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:33.166506 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-241a7168-214d-4979-a124-160c06a4b417 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:33.760620 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-241a7168-214d-4979-a124-160c06a4b417 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:33.772686 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-241a7168-214d-4979-a124-160c06a4b417 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/5bc4befa-252d-456a-92cd-323bad80fcdf" status: 200 len: 1312 microversion: 2.1 time: 0.647374 Jul 23 21:15:33.773311 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 353/646] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:33 2022] GET /compute/v2.1/servers/5bc4befa-252d-456a-92cd-323bad80fcdf => generated 1312 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:33.798352 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c584f483-d294-491a-abf4-3eba8b4f72d9 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:33.798498 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-c584f483-d294-491a-abf4-3eba8b4f72d9 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: f299d55c-90a4-41cc-98a8-e14ca5964eb1] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:33.815979 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c584f483-d294-491a-abf4-3eba8b4f72d9 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:33.821121 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c584f483-d294-491a-abf4-3eba8b4f72d9 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:33.822798 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c584f483-d294-491a-abf4-3eba8b4f72d9 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:33.823800 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c584f483-d294-491a-abf4-3eba8b4f72d9 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:34.096940 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c584f483-d294-491a-abf4-3eba8b4f72d9 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf92af08fa94215b4eafcacea6c63f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e7d37a0e3b4b32ae99c3bc15a831e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:34.114495 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-c584f483-d294-491a-abf4-3eba8b4f72d9 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "GET /compute/v2.1/servers/f299d55c-90a4-41cc-98a8-e14ca5964eb1" status: 200 len: 1289 microversion: 2.1 time: 0.340077 Jul 23 21:15:34.115099 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 354/647] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:33 2022] GET /compute/v2.1/servers/f299d55c-90a4-41cc-98a8-e14ca5964eb1 => generated 1289 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:34.129083 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-df302db9-7fab-4145-b2de-e09dcad4c7d5 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1930081864", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "networks": [{"uuid": "290f6ab6-b90e-4acc-9fe0-f410e54c8881"}]}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:15:34.239075 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.network.neutron [None req-df302db9-7fab-4145-b2de-e09dcad4c7d5 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] validate_networks() for [('290f6ab6-b90e-4acc-9fe0-f410e54c8881', None, None, None, None, None)] {{(pid=131321) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:15:35.163191 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ee3ca01b-227b-45dd-b9c2-5fa17cbf2627 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b/action" status: 202 len: 0 microversion: 2.1 time: 2.699568 Jul 23 21:15:35.167710 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 294/648] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:15:32 2022] POST /compute/v2.1/servers/d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b/action => generated 0 bytes in 2705 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:15:35.181667 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-055b5860-cbeb-4978-9dcf-27bb681e0b49 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:35.185906 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-055b5860-cbeb-4978-9dcf-27bb681e0b49 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] [instance: 70997419-42ea-46b3-a1bd-127efc670cd2] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:35.251053 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-055b5860-cbeb-4978-9dcf-27bb681e0b49 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:35.261336 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-055b5860-cbeb-4978-9dcf-27bb681e0b49 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:35.265216 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-055b5860-cbeb-4978-9dcf-27bb681e0b49 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:35.265679 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-055b5860-cbeb-4978-9dcf-27bb681e0b49 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:35.880437 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-055b5860-cbeb-4978-9dcf-27bb681e0b49 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a872dad882e4694aba20eaa8c06df53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457d184c579a4016a0eec16eb9f23195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:35.890284 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-055b5860-cbeb-4978-9dcf-27bb681e0b49 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] 10.222.0.17 "GET /compute/v2.1/servers/70997419-42ea-46b3-a1bd-127efc670cd2" status: 200 len: 1467 microversion: 2.1 time: 0.720807 Jul 23 21:15:35.891256 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 295/649] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:35 2022] GET /compute/v2.1/servers/70997419-42ea-46b3-a1bd-127efc670cd2 => generated 1467 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:35.897780 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-a58c383a-c222-4c61-a034-89c5918e7a5a req-9452eff5-e837-4193-91b2-4fc5a054ce54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc41b6cc-f603-4f7d-89cb-a7e3cee372a5", "tag": "3e18f4f9-3b4c-4c36-997a-bc967d44787f"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:15:35.909211 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-a58c383a-c222-4c61-a034-89c5918e7a5a req-9452eff5-e837-4193-91b2-4fc5a054ce54 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:35.909828 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-a58c383a-c222-4c61-a034-89c5918e7a5a req-9452eff5-e837-4193-91b2-4fc5a054ce54 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:35.928838 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-a58c383a-c222-4c61-a034-89c5918e7a5a req-9452eff5-e837-4193-91b2-4fc5a054ce54 service nova] Creating event network-changed:3e18f4f9-3b4c-4c36-997a-bc967d44787f for instance fc41b6cc-f603-4f7d-89cb-a7e3cee372a5 on nch2-master-1 Jul 23 21:15:35.945903 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-a58c383a-c222-4c61-a034-89c5918e7a5a req-9452eff5-e837-4193-91b2-4fc5a054ce54 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043192 Jul 23 21:15:35.948229 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 296/650] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:15:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:15:35.954390 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-939e7f64-c3f7-476f-8105-9c84f57464ea tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:35.955403 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-939e7f64-c3f7-476f-8105-9c84f57464ea tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 5bc4befa-252d-456a-92cd-323bad80fcdf] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:35.966955 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-939e7f64-c3f7-476f-8105-9c84f57464ea tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:35.984655 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-939e7f64-c3f7-476f-8105-9c84f57464ea tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:36.000539 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-939e7f64-c3f7-476f-8105-9c84f57464ea tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:36.009959 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-939e7f64-c3f7-476f-8105-9c84f57464ea tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:36.486792 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-df302db9-7fab-4145-b2de-e09dcad4c7d5 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Flavor limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:15:36.487322 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-df302db9-7fab-4145-b2de-e09dcad4c7d5 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Image limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:15:36.487824 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-df302db9-7fab-4145-b2de-e09dcad4c7d5 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Flavor pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:15:36.488262 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-df302db9-7fab-4145-b2de-e09dcad4c7d5 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Image pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:15:36.488696 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-df302db9-7fab-4145-b2de-e09dcad4c7d5 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:15:36.514170 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-df302db9-7fab-4145-b2de-e09dcad4c7d5 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:36.514621 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-df302db9-7fab-4145-b2de-e09dcad4c7d5 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:36.515627 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-df302db9-7fab-4145-b2de-e09dcad4c7d5 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:36.516228 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-df302db9-7fab-4145-b2de-e09dcad4c7d5 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:36.575850 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-df302db9-7fab-4145-b2de-e09dcad4c7d5 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Getting quotas for project b347973dfb204484bdb87ab0094dbe22. Resources: {'ram', 'instances', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:15:36.603201 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-df302db9-7fab-4145-b2de-e09dcad4c7d5 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Getting quotas for user 3a56b82cf3954f279dd21e17a42462b3 and project b347973dfb204484bdb87ab0094dbe22. Resources: {'ram', 'instances', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:15:36.627078 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-df302db9-7fab-4145-b2de-e09dcad4c7d5 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Going to run 1 instances... {{(pid=131321) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:15:36.637424 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-df302db9-7fab-4145-b2de-e09dcad4c7d5 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: 7558d52c-24e7-4115-88f7-ced193819c33] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131321) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:15:36.707402 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-df302db9-7fab-4145-b2de-e09dcad4c7d5 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.589458 Jul 23 21:15:36.708083 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 355/651] 10.222.0.17 () {62 vars in 1187 bytes} [Sat Jul 23 21:15:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 2592 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 23 21:15:36.722042 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-376b6cb0-38a3-4045-911d-f80d045711a6 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:36.723251 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-376b6cb0-38a3-4045-911d-f80d045711a6 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: f299d55c-90a4-41cc-98a8-e14ca5964eb1] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:36.730390 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-376b6cb0-38a3-4045-911d-f80d045711a6 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:36.731078 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-376b6cb0-38a3-4045-911d-f80d045711a6 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:36.733073 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-376b6cb0-38a3-4045-911d-f80d045711a6 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:36.734350 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-376b6cb0-38a3-4045-911d-f80d045711a6 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:36.899762 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-939e7f64-c3f7-476f-8105-9c84f57464ea tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:36.912467 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-939e7f64-c3f7-476f-8105-9c84f57464ea tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/5bc4befa-252d-456a-92cd-323bad80fcdf" status: 200 len: 1312 microversion: 2.1 time: 0.962711 Jul 23 21:15:36.921658 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 297/652] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:35 2022] GET /compute/v2.1/servers/5bc4befa-252d-456a-92cd-323bad80fcdf => generated 1312 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:36.927705 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-7eb02cb0-f7fa-4293-8f14-9a3fec20f7d6 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:36.929197 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-7eb02cb0-f7fa-4293-8f14-9a3fec20f7d6 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:36.943114 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7eb02cb0-f7fa-4293-8f14-9a3fec20f7d6 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:36.943565 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7eb02cb0-f7fa-4293-8f14-9a3fec20f7d6 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:36.944365 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7eb02cb0-f7fa-4293-8f14-9a3fec20f7d6 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:36.944818 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7eb02cb0-f7fa-4293-8f14-9a3fec20f7d6 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:37.587311 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-376b6cb0-38a3-4045-911d-f80d045711a6 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf92af08fa94215b4eafcacea6c63f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e7d37a0e3b4b32ae99c3bc15a831e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:37.596617 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-376b6cb0-38a3-4045-911d-f80d045711a6 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "GET /compute/v2.1/servers/f299d55c-90a4-41cc-98a8-e14ca5964eb1" status: 200 len: 1319 microversion: 2.1 time: 0.885775 Jul 23 21:15:37.597261 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 356/653] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:36 2022] GET /compute/v2.1/servers/f299d55c-90a4-41cc-98a8-e14ca5964eb1 => generated 1319 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:37.625990 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-6131b6b1-87b7-4432-a662-49afee34f487 tempest-LiveMigrationNegativeTest-1891632565 tempest-LiveMigrationNegativeTest-1891632565-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:15:37.628873 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-6131b6b1-87b7-4432-a662-49afee34f487 tempest-LiveMigrationNegativeTest-1891632565 tempest-LiveMigrationNegativeTest-1891632565-project-admin] [instance: 70997419-42ea-46b3-a1bd-127efc670cd2] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:37.649308 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6131b6b1-87b7-4432-a662-49afee34f487 tempest-LiveMigrationNegativeTest-1891632565 tempest-LiveMigrationNegativeTest-1891632565-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:37.650163 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6131b6b1-87b7-4432-a662-49afee34f487 tempest-LiveMigrationNegativeTest-1891632565 tempest-LiveMigrationNegativeTest-1891632565-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:37.653238 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6131b6b1-87b7-4432-a662-49afee34f487 tempest-LiveMigrationNegativeTest-1891632565 tempest-LiveMigrationNegativeTest-1891632565-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:37.655469 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6131b6b1-87b7-4432-a662-49afee34f487 tempest-LiveMigrationNegativeTest-1891632565 tempest-LiveMigrationNegativeTest-1891632565-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:37.721545 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.objects.instance [None req-6131b6b1-87b7-4432-a662-49afee34f487 tempest-LiveMigrationNegativeTest-1891632565 tempest-LiveMigrationNegativeTest-1891632565-project-admin] Lazy-loading 'flavor' on Instance uuid 70997419-42ea-46b3-a1bd-127efc670cd2 {{(pid=131321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:15:37.888199 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-6131b6b1-87b7-4432-a662-49afee34f487 tempest-LiveMigrationNegativeTest-1891632565 tempest-LiveMigrationNegativeTest-1891632565-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/70997419-42ea-46b3-a1bd-127efc670cd2/action" status: 202 len: 0 microversion: 2.1 time: 0.288552 Jul 23 21:15:37.892642 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 357/654] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:15:37 2022] POST /compute/v2.1/servers/70997419-42ea-46b3-a1bd-127efc670cd2/action => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:15:37.905652 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-85d019b9-8515-4a6a-b940-cff10546cebb tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:37.906794 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-85d019b9-8515-4a6a-b940-cff10546cebb tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: 7558d52c-24e7-4115-88f7-ced193819c33] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:37.923088 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-85d019b9-8515-4a6a-b940-cff10546cebb tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:37.923918 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-85d019b9-8515-4a6a-b940-cff10546cebb tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:37.926645 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-85d019b9-8515-4a6a-b940-cff10546cebb tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:37.929147 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-85d019b9-8515-4a6a-b940-cff10546cebb tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:38.007978 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-7eb02cb0-f7fa-4293-8f14-9a3fec20f7d6 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:38.011892 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:15:38.025249 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-7eb02cb0-f7fa-4293-8f14-9a3fec20f7d6 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b" status: 200 len: 1504 microversion: 2.1 time: 1.103978 Jul 23 21:15:38.029786 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 298/655] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:36 2022] GET /compute/v2.1/servers/d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b => generated 1504 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:38.054532 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-7b171743-fb02-44b5-b55d-6ea0795ee261 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:38.060619 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-7b171743-fb02-44b5-b55d-6ea0795ee261 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] [instance: 70997419-42ea-46b3-a1bd-127efc670cd2] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:38.079906 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7b171743-fb02-44b5-b55d-6ea0795ee261 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:38.080610 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7b171743-fb02-44b5-b55d-6ea0795ee261 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:38.081581 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7b171743-fb02-44b5-b55d-6ea0795ee261 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:38.082228 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7b171743-fb02-44b5-b55d-6ea0795ee261 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:38.105309 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=8 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:15:38.507925 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-85d019b9-8515-4a6a-b940-cff10546cebb tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:38.513322 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:15:38.528967 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-85d019b9-8515-4a6a-b940-cff10546cebb tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:38.532174 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-85d019b9-8515-4a6a-b940-cff10546cebb tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:38.534019 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-85d019b9-8515-4a6a-b940-cff10546cebb tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/7558d52c-24e7-4115-88f7-ced193819c33" status: 200 len: 1314 microversion: 2.25 time: 0.636361 Jul 23 21:15:38.535243 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 358/656] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:15:37 2022] GET /compute/v2.1/servers/7558d52c-24e7-4115-88f7-ced193819c33 => generated 1314 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:15:38.542819 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-559e98f8-bdb1-498e-bd02-57ab53920680 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:38.544227 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-559e98f8-bdb1-498e-bd02-57ab53920680 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 5bc4befa-252d-456a-92cd-323bad80fcdf] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:38.554011 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-559e98f8-bdb1-498e-bd02-57ab53920680 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:38.556148 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-559e98f8-bdb1-498e-bd02-57ab53920680 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:38.558125 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-559e98f8-bdb1-498e-bd02-57ab53920680 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:38.558717 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-559e98f8-bdb1-498e-bd02-57ab53920680 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:38.808447 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-7b171743-fb02-44b5-b55d-6ea0795ee261 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a872dad882e4694aba20eaa8c06df53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457d184c579a4016a0eec16eb9f23195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:38.836700 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-7b171743-fb02-44b5-b55d-6ea0795ee261 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] 10.222.0.17 "GET /compute/v2.1/servers/70997419-42ea-46b3-a1bd-127efc670cd2" status: 200 len: 1475 microversion: 2.1 time: 0.805448 Jul 23 21:15:38.841878 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 299/657] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:38 2022] GET /compute/v2.1/servers/70997419-42ea-46b3-a1bd-127efc670cd2 => generated 1475 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:38.858463 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-bcf39426-5a39-438a-a42e-7a42cbc726bc tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:38.859008 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-bcf39426-5a39-438a-a42e-7a42cbc726bc tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: f299d55c-90a4-41cc-98a8-e14ca5964eb1] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:38.874070 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bcf39426-5a39-438a-a42e-7a42cbc726bc tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:38.874873 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bcf39426-5a39-438a-a42e-7a42cbc726bc tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:38.877260 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bcf39426-5a39-438a-a42e-7a42cbc726bc tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:38.877989 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bcf39426-5a39-438a-a42e-7a42cbc726bc tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:39.154747 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-bcf39426-5a39-438a-a42e-7a42cbc726bc tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf92af08fa94215b4eafcacea6c63f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e7d37a0e3b4b32ae99c3bc15a831e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:39.168291 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-559e98f8-bdb1-498e-bd02-57ab53920680 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:39.177341 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-559e98f8-bdb1-498e-bd02-57ab53920680 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/5bc4befa-252d-456a-92cd-323bad80fcdf" status: 200 len: 1312 microversion: 2.1 time: 0.640774 Jul 23 21:15:39.182457 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-bcf39426-5a39-438a-a42e-7a42cbc726bc tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "GET /compute/v2.1/servers/f299d55c-90a4-41cc-98a8-e14ca5964eb1" status: 200 len: 1319 microversion: 2.1 time: 0.334458 Jul 23 21:15:39.182965 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 359/658] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:38 2022] GET /compute/v2.1/servers/5bc4befa-252d-456a-92cd-323bad80fcdf => generated 1312 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:39.186493 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 300/659] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:38 2022] GET /compute/v2.1/servers/f299d55c-90a4-41cc-98a8-e14ca5964eb1 => generated 1319 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:39.189075 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-bae9d8d7-5983-4b9f-9e70-b7ec0aa18c90 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:39.193445 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-bae9d8d7-5983-4b9f-9e70-b7ec0aa18c90 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:39.211607 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-fad01d50-7194-48fa-aad0-56900d1eb9de req-65ff8129-3976-49e9-af3e-f286285675ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f299d55c-90a4-41cc-98a8-e14ca5964eb1", "tag": "6b938da1-d7da-40b9-92a8-95e3181b67b9"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:15:39.227209 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bae9d8d7-5983-4b9f-9e70-b7ec0aa18c90 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:39.227675 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bae9d8d7-5983-4b9f-9e70-b7ec0aa18c90 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:39.228499 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bae9d8d7-5983-4b9f-9e70-b7ec0aa18c90 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:39.228932 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bae9d8d7-5983-4b9f-9e70-b7ec0aa18c90 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:39.240206 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-fad01d50-7194-48fa-aad0-56900d1eb9de req-65ff8129-3976-49e9-af3e-f286285675ee service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:39.240794 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-fad01d50-7194-48fa-aad0-56900d1eb9de req-65ff8129-3976-49e9-af3e-f286285675ee service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:39.267819 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-fad01d50-7194-48fa-aad0-56900d1eb9de req-65ff8129-3976-49e9-af3e-f286285675ee service nova] Creating event network-changed:6b938da1-d7da-40b9-92a8-95e3181b67b9 for instance f299d55c-90a4-41cc-98a8-e14ca5964eb1 on nch2-master-1 Jul 23 21:15:39.278112 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-fad01d50-7194-48fa-aad0-56900d1eb9de req-65ff8129-3976-49e9-af3e-f286285675ee service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070005 Jul 23 21:15:39.279075 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 301/660] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:15:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:15:39.484732 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-fa5fcd6d-ed94-4ca0-a23a-37e87181a9ec req-bdcb0367-b3df-4861-aa4c-fde83fddbdc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bc4befa-252d-456a-92cd-323bad80fcdf", "name": "network-vif-plugged", "status": "completed", "tag": "f00e5169-4343-4b5e-aafd-b0e8eea7078c"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:15:39.502284 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-fa5fcd6d-ed94-4ca0-a23a-37e87181a9ec req-bdcb0367-b3df-4861-aa4c-fde83fddbdc2 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:39.502994 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-fa5fcd6d-ed94-4ca0-a23a-37e87181a9ec req-bdcb0367-b3df-4861-aa4c-fde83fddbdc2 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:39.516038 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-fa5fcd6d-ed94-4ca0-a23a-37e87181a9ec req-bdcb0367-b3df-4861-aa4c-fde83fddbdc2 service nova] Creating event network-vif-plugged:f00e5169-4343-4b5e-aafd-b0e8eea7078c for instance 5bc4befa-252d-456a-92cd-323bad80fcdf on nch1-master-1 Jul 23 21:15:39.522440 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-fa5fcd6d-ed94-4ca0-a23a-37e87181a9ec req-bdcb0367-b3df-4861-aa4c-fde83fddbdc2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043634 Jul 23 21:15:39.523305 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 302/661] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:15:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:15:39.562465 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-01c0d0ad-4899-4941-bf1f-aa6087256eaa tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:39.563250 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-01c0d0ad-4899-4941-bf1f-aa6087256eaa tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: 7558d52c-24e7-4115-88f7-ced193819c33] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:39.591929 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-01c0d0ad-4899-4941-bf1f-aa6087256eaa tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:39.596451 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-01c0d0ad-4899-4941-bf1f-aa6087256eaa tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:39.599498 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-01c0d0ad-4899-4941-bf1f-aa6087256eaa tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:39.600117 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-01c0d0ad-4899-4941-bf1f-aa6087256eaa tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:39.696194 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-01c0d0ad-4899-4941-bf1f-aa6087256eaa tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:39.708768 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-01c0d0ad-4899-4941-bf1f-aa6087256eaa tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:39.712633 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-01c0d0ad-4899-4941-bf1f-aa6087256eaa tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:39.720315 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-01c0d0ad-4899-4941-bf1f-aa6087256eaa tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/7558d52c-24e7-4115-88f7-ced193819c33" status: 200 len: 1320 microversion: 2.25 time: 0.168238 Jul 23 21:15:39.732635 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 303/662] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:15:39 2022] GET /compute/v2.1/servers/7558d52c-24e7-4115-88f7-ced193819c33 => generated 1320 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:15:39.862762 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-da4374f2-fbfd-4e63-97c4-741998e4e354 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:39.863564 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-da4374f2-fbfd-4e63-97c4-741998e4e354 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] [instance: 70997419-42ea-46b3-a1bd-127efc670cd2] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:39.871942 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-da4374f2-fbfd-4e63-97c4-741998e4e354 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:39.872684 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-da4374f2-fbfd-4e63-97c4-741998e4e354 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:39.874074 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-da4374f2-fbfd-4e63-97c4-741998e4e354 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:39.874672 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-da4374f2-fbfd-4e63-97c4-741998e4e354 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:39.878080 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-bae9d8d7-5983-4b9f-9e70-b7ec0aa18c90 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:39.889732 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-bae9d8d7-5983-4b9f-9e70-b7ec0aa18c90 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b" status: 200 len: 1504 microversion: 2.1 time: 0.705181 Jul 23 21:15:39.899426 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 360/663] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:39 2022] GET /compute/v2.1/servers/d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b => generated 1504 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:39.972670 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-6ff318cb-6479-4a28-a7e1-828d3a2139b4 req-85560b05-8453-4707-baf3-dfef1ffc7b14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da599d16-7a8c-4ced-b129-d692e5b4866f", "tag": "34a50e7e-5622-49f8-8abb-5386329b37bc"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:15:39.981757 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-6ff318cb-6479-4a28-a7e1-828d3a2139b4 req-85560b05-8453-4707-baf3-dfef1ffc7b14 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:39.982365 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-6ff318cb-6479-4a28-a7e1-828d3a2139b4 req-85560b05-8453-4707-baf3-dfef1ffc7b14 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:39.997262 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-6ff318cb-6479-4a28-a7e1-828d3a2139b4 req-85560b05-8453-4707-baf3-dfef1ffc7b14 service nova] Creating event network-changed:34a50e7e-5622-49f8-8abb-5386329b37bc for instance da599d16-7a8c-4ced-b129-d692e5b4866f on nch2-master-1 Jul 23 21:15:40.003557 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-6ff318cb-6479-4a28-a7e1-828d3a2139b4 req-85560b05-8453-4707-baf3-dfef1ffc7b14 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036103 Jul 23 21:15:40.004658 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 361/664] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:15:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:15:40.092018 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:15:40.109740 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-da4374f2-fbfd-4e63-97c4-741998e4e354 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a872dad882e4694aba20eaa8c06df53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457d184c579a4016a0eec16eb9f23195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:40.118329 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-da4374f2-fbfd-4e63-97c4-741998e4e354 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] 10.222.0.17 "GET /compute/v2.1/servers/70997419-42ea-46b3-a1bd-127efc670cd2" status: 200 len: 1458 microversion: 2.1 time: 0.263216 Jul 23 21:15:40.119558 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 304/665] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:39 2022] GET /compute/v2.1/servers/70997419-42ea-46b3-a1bd-127efc670cd2 => generated 1458 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:15:40.137744 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-bac80b24-7b44-41c4-a103-dbcb4061c974 tempest-LiveMigrationNegativeTest-1891632565 tempest-LiveMigrationNegativeTest-1891632565-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:40.138597 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-bac80b24-7b44-41c4-a103-dbcb4061c974 tempest-LiveMigrationNegativeTest-1891632565 tempest-LiveMigrationNegativeTest-1891632565-project-admin] [instance: 70997419-42ea-46b3-a1bd-127efc670cd2] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:40.145764 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bac80b24-7b44-41c4-a103-dbcb4061c974 tempest-LiveMigrationNegativeTest-1891632565 tempest-LiveMigrationNegativeTest-1891632565-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:40.146360 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bac80b24-7b44-41c4-a103-dbcb4061c974 tempest-LiveMigrationNegativeTest-1891632565 tempest-LiveMigrationNegativeTest-1891632565-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:40.147266 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bac80b24-7b44-41c4-a103-dbcb4061c974 tempest-LiveMigrationNegativeTest-1891632565 tempest-LiveMigrationNegativeTest-1891632565-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:40.147807 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bac80b24-7b44-41c4-a103-dbcb4061c974 tempest-LiveMigrationNegativeTest-1891632565 tempest-LiveMigrationNegativeTest-1891632565-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:40.196840 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1317a78f-f434-4750-a6bb-4a5f84e89668 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:40.199351 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1317a78f-f434-4750-a6bb-4a5f84e89668 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 5bc4befa-252d-456a-92cd-323bad80fcdf] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:40.206778 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1317a78f-f434-4750-a6bb-4a5f84e89668 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:40.207709 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1317a78f-f434-4750-a6bb-4a5f84e89668 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:40.209047 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1317a78f-f434-4750-a6bb-4a5f84e89668 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:40.209802 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1317a78f-f434-4750-a6bb-4a5f84e89668 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:40.427559 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-1317a78f-f434-4750-a6bb-4a5f84e89668 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:40.438491 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1317a78f-f434-4750-a6bb-4a5f84e89668 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/5bc4befa-252d-456a-92cd-323bad80fcdf" status: 200 len: 1312 microversion: 2.1 time: 0.245547 Jul 23 21:15:40.448720 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 305/666] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:40 2022] GET /compute/v2.1/servers/5bc4befa-252d-456a-92cd-323bad80fcdf => generated 1312 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:15:40.454720 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-560b60b4-14f9-46e2-948f-8d81e21748b0 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:40.455343 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-560b60b4-14f9-46e2-948f-8d81e21748b0 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: f299d55c-90a4-41cc-98a8-e14ca5964eb1] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:40.463135 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-560b60b4-14f9-46e2-948f-8d81e21748b0 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:40.463587 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-560b60b4-14f9-46e2-948f-8d81e21748b0 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:40.464368 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-560b60b4-14f9-46e2-948f-8d81e21748b0 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:40.465027 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-560b60b4-14f9-46e2-948f-8d81e21748b0 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:40.726940 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-560b60b4-14f9-46e2-948f-8d81e21748b0 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf92af08fa94215b4eafcacea6c63f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e7d37a0e3b4b32ae99c3bc15a831e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:40.738889 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-560b60b4-14f9-46e2-948f-8d81e21748b0 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "GET /compute/v2.1/servers/f299d55c-90a4-41cc-98a8-e14ca5964eb1" status: 200 len: 1319 microversion: 2.1 time: 0.287367 Jul 23 21:15:40.739557 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 306/667] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:40 2022] GET /compute/v2.1/servers/f299d55c-90a4-41cc-98a8-e14ca5964eb1 => generated 1319 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:40.744613 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-af1ac727-e5cb-4e27-b66d-172724ee12a4 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:40.745283 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-af1ac727-e5cb-4e27-b66d-172724ee12a4 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: 7558d52c-24e7-4115-88f7-ced193819c33] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:40.751947 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-af1ac727-e5cb-4e27-b66d-172724ee12a4 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:40.752442 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-af1ac727-e5cb-4e27-b66d-172724ee12a4 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:40.753461 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-af1ac727-e5cb-4e27-b66d-172724ee12a4 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:40.754025 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-af1ac727-e5cb-4e27-b66d-172724ee12a4 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:40.869329 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-af1ac727-e5cb-4e27-b66d-172724ee12a4 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:40.889449 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-af1ac727-e5cb-4e27-b66d-172724ee12a4 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:40.894717 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-af1ac727-e5cb-4e27-b66d-172724ee12a4 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:40.896238 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-af1ac727-e5cb-4e27-b66d-172724ee12a4 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/7558d52c-24e7-4115-88f7-ced193819c33" status: 200 len: 1320 microversion: 2.25 time: 0.155229 Jul 23 21:15:40.898794 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 307/668] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:15:40 2022] GET /compute/v2.1/servers/7558d52c-24e7-4115-88f7-ced193819c33 => generated 1320 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:15:40.921681 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0cb37a7a-3830-4eef-8d09-c4af6647b648 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:40.923128 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-0cb37a7a-3830-4eef-8d09-c4af6647b648 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:40.936472 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0cb37a7a-3830-4eef-8d09-c4af6647b648 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:40.937210 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0cb37a7a-3830-4eef-8d09-c4af6647b648 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:40.938256 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0cb37a7a-3830-4eef-8d09-c4af6647b648 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:40.938808 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0cb37a7a-3830-4eef-8d09-c4af6647b648 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:41.264078 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-bac80b24-7b44-41c4-a103-dbcb4061c974 tempest-LiveMigrationNegativeTest-1891632565 tempest-LiveMigrationNegativeTest-1891632565-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/70997419-42ea-46b3-a1bd-127efc670cd2" status: 200 len: 1609 microversion: 2.1 time: 1.130456 Jul 23 21:15:41.276372 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 362/669] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:40 2022] GET /compute/v2.1/servers/70997419-42ea-46b3-a1bd-127efc670cd2 => generated 1609 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:41.281626 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-7dec7947-1593-4c5d-8c7e-20e8eef774f5 tempest-LiveMigrationNegativeTest-1891632565 tempest-LiveMigrationNegativeTest-1891632565-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:41.283731 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:15:41.283731 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:15:41.285702 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7dec7947-1593-4c5d-8c7e-20e8eef774f5 tempest-LiveMigrationNegativeTest-1891632565 tempest-LiveMigrationNegativeTest-1891632565-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:41.289772 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7dec7947-1593-4c5d-8c7e-20e8eef774f5 tempest-LiveMigrationNegativeTest-1891632565 tempest-LiveMigrationNegativeTest-1891632565-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:41.290709 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7dec7947-1593-4c5d-8c7e-20e8eef774f5 tempest-LiveMigrationNegativeTest-1891632565 tempest-LiveMigrationNegativeTest-1891632565-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:41.291161 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7dec7947-1593-4c5d-8c7e-20e8eef774f5 tempest-LiveMigrationNegativeTest-1891632565 tempest-LiveMigrationNegativeTest-1891632565-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:41.321511 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-7dec7947-1593-4c5d-8c7e-20e8eef774f5 tempest-LiveMigrationNegativeTest-1891632565 tempest-LiveMigrationNegativeTest-1891632565-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.043759 Jul 23 21:15:41.322197 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 363/670] 10.222.0.17 () {58 vars in 1175 bytes} [Sat Jul 23 21:15:41 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:15:41.334532 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-0cb37a7a-3830-4eef-8d09-c4af6647b648 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:41.337168 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-001abb08-858d-43c5-a6d3-c846cac0f76e tempest-LiveMigrationNegativeTest-1891632565 tempest-LiveMigrationNegativeTest-1891632565-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:15:41.338424 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-001abb08-858d-43c5-a6d3-c846cac0f76e tempest-LiveMigrationNegativeTest-1891632565 tempest-LiveMigrationNegativeTest-1891632565-project-admin] [instance: 70997419-42ea-46b3-a1bd-127efc670cd2] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:41.342681 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-0cb37a7a-3830-4eef-8d09-c4af6647b648 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b" status: 200 len: 1504 microversion: 2.1 time: 0.430774 Jul 23 21:15:41.343251 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 308/671] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:40 2022] GET /compute/v2.1/servers/d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b => generated 1504 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:15:41.350450 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-001abb08-858d-43c5-a6d3-c846cac0f76e tempest-LiveMigrationNegativeTest-1891632565 tempest-LiveMigrationNegativeTest-1891632565-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:41.350937 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-001abb08-858d-43c5-a6d3-c846cac0f76e tempest-LiveMigrationNegativeTest-1891632565 tempest-LiveMigrationNegativeTest-1891632565-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:41.351988 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-001abb08-858d-43c5-a6d3-c846cac0f76e tempest-LiveMigrationNegativeTest-1891632565 tempest-LiveMigrationNegativeTest-1891632565-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:41.352629 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-001abb08-858d-43c5-a6d3-c846cac0f76e tempest-LiveMigrationNegativeTest-1891632565 tempest-LiveMigrationNegativeTest-1891632565-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:41.396183 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.objects.instance [None req-001abb08-858d-43c5-a6d3-c846cac0f76e tempest-LiveMigrationNegativeTest-1891632565 tempest-LiveMigrationNegativeTest-1891632565-project-admin] Lazy-loading 'flavor' on Instance uuid 70997419-42ea-46b3-a1bd-127efc670cd2 {{(pid=131321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:15:41.420162 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-001abb08-858d-43c5-a6d3-c846cac0f76e tempest-LiveMigrationNegativeTest-1891632565 tempest-LiveMigrationNegativeTest-1891632565-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 70997419-42ea-46b3-a1bd-127efc670cd2 while it is in vm_state suspended Jul 23 21:15:41.422179 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-001abb08-858d-43c5-a6d3-c846cac0f76e tempest-LiveMigrationNegativeTest-1891632565 tempest-LiveMigrationNegativeTest-1891632565-project-admin] Request method failure captured: Jul 23 21:15:41.422179 ncdv-master-1 devstack@n-api.service[131321]: request: POST /compute/v2.1/servers/70997419-42ea-46b3-a1bd-127efc670cd2/action HTTP/1.1 Jul 23 21:15:41.422179 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:15:41.422179 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:15:41.422179 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:15:41.422179 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 97 Jul 23 21:15:41.422179 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:15:41.422179 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:15:41.422179 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:15:41.422179 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:15:41.422179 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GTJvqZRdX__hl5980iICJ18yBUlgOZ_qS-6VO5dC6Df0YyYXGcabBbMWXTT9AC25g7YvohQI2M1Lc8xh2A01aFVaQbezBk31nMDRQ52sftF5Ix4rhbm1sggxZYrLq8KA9hqnUaNNvb9DgSgtF1TzIMNAwXKd1sGQNWCODRu1AmfWAA Jul 23 21:15:41.422179 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:15:41.422179 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:15:41.422179 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:15:41.422179 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:15:41.422179 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:15:41.422179 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:15:41.422179 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: a1e5e46ae97b4f79832de640e753f8c8 Jul 23 21:15:41.422179 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-LiveMigrationNegativeTest-1891632565 Jul 23 21:15:41.422179 ncdv-master-1 devstack@n-api.service[131321]: X-Role: admin,reader,member Jul 23 21:15:41.422179 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: admin,reader,member Jul 23 21:15:41.423825 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a1e5e46ae97b4f79832de640e753f8c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a1e5e46ae97b4f79832de640e753f8c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a1e5e46ae97b4f79832de640e753f8c8", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a1e5e46ae97b4f79832de640e753f8c8"}]}] Jul 23 21:15:41.423825 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-LiveMigrationNegativeTest-1891632565 Jul 23 21:15:41.423825 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: a1e5e46ae97b4f79832de640e753f8c8 Jul 23 21:15:41.423825 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1891632565 Jul 23 21:15:41.423825 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-LiveMigrationNegativeTest-1891632565-project-admin Jul 23 21:15:41.423825 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:15:41.423825 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:15:41.423825 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: a65178068e4e487bb27e2f152ba9b081 Jul 23 21:15:41.423825 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-LiveMigrationNegativeTest-1891632565-project-admin Jul 23 21:15:41.423825 ncdv-master-1 devstack@n-api.service[131321]: Jul 23 21:15:41.423825 ncdv-master-1 devstack@n-api.service[131321]: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": true, "disk_over_commit": false}} Jul 23 21:15:41.423825 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:15:41.424625 ncdv-master-1 devstack@n-api.service[131321]: exception: Cannot 'os-migrateLive' instance 70997419-42ea-46b3-a1bd-127efc670cd2 while it is in vm_state suspended Jul 23 21:15:41.424625 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': '70997419-42ea-46b3-a1bd-127efc670cd2', 'body': {'os-migrateLive': {'host': 'nch1-master-1', 'block_migration': True, 'disk_over_commit': False}}} Jul 23 21:15:41.424625 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:15:41.424625 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:15:41.424625 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Jul 23 21:15:41.424625 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Jul 23 21:15:41.424625 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 23 21:15:41.424625 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 23 21:15:41.424625 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 23 21:15:41.424625 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 23 21:15:41.424625 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 23 21:15:41.424625 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 23 21:15:41.424625 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 23 21:15:41.424625 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 23 21:15:41.424625 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 23 21:15:41.424625 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 23 21:15:41.424625 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Jul 23 21:15:41.424625 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 23 21:15:41.425657 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 23 21:15:41.425657 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 23 21:15:41.425657 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 23 21:15:41.425657 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 23 21:15:41.425657 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 70997419-42ea-46b3-a1bd-127efc670cd2 in vm_state suspended. Cannot live_migrate while the instance is in this state. Jul 23 21:15:41.425657 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:15:41.425657 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:15:41.425657 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:15:41.425657 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:15:41.425657 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:15:41.425657 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:15:41.425657 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:15:41.425657 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:15:41.425657 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:15:41.425657 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:15:41.425657 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:15:41.425657 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:15:41.425657 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:15:41.425657 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:15:41.425657 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:15:41.426837 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:15:41.426837 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 23 21:15:41.426837 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Jul 23 21:15:41.426837 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 23 21:15:41.426837 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 23 21:15:41.426837 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 23 21:15:41.426837 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 70997419-42ea-46b3-a1bd-127efc670cd2 while it is in vm_state suspended Jul 23 21:15:41.426837 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:15:41.426837 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:15:41.426837 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:15:41.426837 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:15:41.426837 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:15:41.426837 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:15:41.426837 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:15:41.426837 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:15:41.426837 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 70997419-42ea-46b3-a1bd-127efc670cd2 while it is in vm_state suspended Jul 23 21:15:41.426837 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:15:41.427847 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-001abb08-858d-43c5-a6d3-c846cac0f76e tempest-LiveMigrationNegativeTest-1891632565 tempest-LiveMigrationNegativeTest-1891632565-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 70997419-42ea-46b3-a1bd-127efc670cd2 while it is in vm_state suspended {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:15:41.427847 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-001abb08-858d-43c5-a6d3-c846cac0f76e tempest-LiveMigrationNegativeTest-1891632565 tempest-LiveMigrationNegativeTest-1891632565-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/70997419-42ea-46b3-a1bd-127efc670cd2/action" status: 409 len: 155 microversion: 2.1 time: 0.094597 Jul 23 21:15:41.434033 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 364/672] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:15:41 2022] POST /compute/v2.1/servers/70997419-42ea-46b3-a1bd-127efc670cd2/action => generated 155 bytes in 105 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 23 21:15:41.439472 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-514248e1-7b5e-477e-9e3a-4820623ebe68 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:41.440268 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-514248e1-7b5e-477e-9e3a-4820623ebe68 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] [instance: 70997419-42ea-46b3-a1bd-127efc670cd2] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:41.451465 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-514248e1-7b5e-477e-9e3a-4820623ebe68 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:41.452173 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-514248e1-7b5e-477e-9e3a-4820623ebe68 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:41.452971 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-514248e1-7b5e-477e-9e3a-4820623ebe68 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:41.453414 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-514248e1-7b5e-477e-9e3a-4820623ebe68 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:41.455205 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-304d965f-ce75-4f69-b9b3-60b7af8d4b98 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:41.455821 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-304d965f-ce75-4f69-b9b3-60b7af8d4b98 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 5bc4befa-252d-456a-92cd-323bad80fcdf] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:41.464774 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-304d965f-ce75-4f69-b9b3-60b7af8d4b98 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:41.465476 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-304d965f-ce75-4f69-b9b3-60b7af8d4b98 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:41.466453 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-304d965f-ce75-4f69-b9b3-60b7af8d4b98 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:41.467041 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-304d965f-ce75-4f69-b9b3-60b7af8d4b98 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:41.495888 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-514248e1-7b5e-477e-9e3a-4820623ebe68 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] [instance: 70997419-42ea-46b3-a1bd-127efc670cd2] Going to try to terminate instance {{(pid=131320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:15:41.632663 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-514248e1-7b5e-477e-9e3a-4820623ebe68 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] 10.222.0.17 "DELETE /compute/v2.1/servers/70997419-42ea-46b3-a1bd-127efc670cd2" status: 204 len: 0 microversion: 2.1 time: 0.196951 Jul 23 21:15:41.634393 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 309/673] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:15:41 2022] DELETE /compute/v2.1/servers/70997419-42ea-46b3-a1bd-127efc670cd2 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:15:41.645751 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8ab8ac96-fb05-4706-833b-1f0704591710 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:41.646757 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8ab8ac96-fb05-4706-833b-1f0704591710 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] [instance: 70997419-42ea-46b3-a1bd-127efc670cd2] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:41.666617 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8ab8ac96-fb05-4706-833b-1f0704591710 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:41.667540 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8ab8ac96-fb05-4706-833b-1f0704591710 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:41.668777 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8ab8ac96-fb05-4706-833b-1f0704591710 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:41.669431 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8ab8ac96-fb05-4706-833b-1f0704591710 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:42.170369 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-304d965f-ce75-4f69-b9b3-60b7af8d4b98 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:42.179957 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-304d965f-ce75-4f69-b9b3-60b7af8d4b98 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/5bc4befa-252d-456a-92cd-323bad80fcdf" status: 200 len: 1312 microversion: 2.1 time: 0.728508 Jul 23 21:15:42.181328 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 365/674] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:41 2022] GET /compute/v2.1/servers/5bc4befa-252d-456a-92cd-323bad80fcdf => generated 1312 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:15:42.193760 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e44887eb-7782-46d0-9dd9-810f1db5cd42 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:42.194784 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-e44887eb-7782-46d0-9dd9-810f1db5cd42 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: f299d55c-90a4-41cc-98a8-e14ca5964eb1] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:42.201682 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e44887eb-7782-46d0-9dd9-810f1db5cd42 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:42.202509 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e44887eb-7782-46d0-9dd9-810f1db5cd42 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:42.203716 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e44887eb-7782-46d0-9dd9-810f1db5cd42 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:42.204382 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e44887eb-7782-46d0-9dd9-810f1db5cd42 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:42.454700 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-e44887eb-7782-46d0-9dd9-810f1db5cd42 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf92af08fa94215b4eafcacea6c63f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e7d37a0e3b4b32ae99c3bc15a831e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:42.467227 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-e44887eb-7782-46d0-9dd9-810f1db5cd42 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "GET /compute/v2.1/servers/f299d55c-90a4-41cc-98a8-e14ca5964eb1" status: 200 len: 1319 microversion: 2.1 time: 0.283216 Jul 23 21:15:42.476930 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 366/675] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:42 2022] GET /compute/v2.1/servers/f299d55c-90a4-41cc-98a8-e14ca5964eb1 => generated 1319 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:42.481403 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-b3e20fd6-18d4-4f0f-aaf2-2a5ab3f12a3e tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:42.482041 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-b3e20fd6-18d4-4f0f-aaf2-2a5ab3f12a3e tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: 7558d52c-24e7-4115-88f7-ced193819c33] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:42.493212 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b3e20fd6-18d4-4f0f-aaf2-2a5ab3f12a3e tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:42.493747 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b3e20fd6-18d4-4f0f-aaf2-2a5ab3f12a3e tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:42.495543 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b3e20fd6-18d4-4f0f-aaf2-2a5ab3f12a3e tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:42.496226 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b3e20fd6-18d4-4f0f-aaf2-2a5ab3f12a3e tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:42.514797 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8ab8ac96-fb05-4706-833b-1f0704591710 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a872dad882e4694aba20eaa8c06df53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457d184c579a4016a0eec16eb9f23195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:42.527242 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8ab8ac96-fb05-4706-833b-1f0704591710 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] 10.222.0.17 "GET /compute/v2.1/servers/70997419-42ea-46b3-a1bd-127efc670cd2" status: 200 len: 1464 microversion: 2.1 time: 0.887417 Jul 23 21:15:42.527872 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 310/676] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:41 2022] GET /compute/v2.1/servers/70997419-42ea-46b3-a1bd-127efc670cd2 => generated 1464 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:42.542836 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-c60073d8-1f16-4a89-a307-1cdcb9ae3ab9 req-3e2d49ba-0c38-4d32-88be-55a22d2f96f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b", "name": "network-vif-unplugged", "status": "completed", "tag": "514e8daf-fac6-48ba-9a0d-0c9edf5b2d8e"}, {"name": "network-changed", "server_uuid": "d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b", "tag": "514e8daf-fac6-48ba-9a0d-0c9edf5b2d8e"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:15:42.552481 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-c60073d8-1f16-4a89-a307-1cdcb9ae3ab9 req-3e2d49ba-0c38-4d32-88be-55a22d2f96f8 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:42.553180 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-c60073d8-1f16-4a89-a307-1cdcb9ae3ab9 req-3e2d49ba-0c38-4d32-88be-55a22d2f96f8 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:42.566084 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-c60073d8-1f16-4a89-a307-1cdcb9ae3ab9 req-3e2d49ba-0c38-4d32-88be-55a22d2f96f8 service nova] Creating event network-vif-unplugged:514e8daf-fac6-48ba-9a0d-0c9edf5b2d8e for instance d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b on nch1-master-1 Jul 23 21:15:42.566852 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-c60073d8-1f16-4a89-a307-1cdcb9ae3ab9 req-3e2d49ba-0c38-4d32-88be-55a22d2f96f8 service nova] Creating event network-changed:514e8daf-fac6-48ba-9a0d-0c9edf5b2d8e for instance d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b on nch1-master-1 Jul 23 21:15:42.573734 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-c60073d8-1f16-4a89-a307-1cdcb9ae3ab9 req-3e2d49ba-0c38-4d32-88be-55a22d2f96f8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.034449 Jul 23 21:15:42.574771 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 311/677] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:15:42 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:15:42.581353 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f6e99a5b-641e-4741-8817-0e074cc02581 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:42.582959 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f6e99a5b-641e-4741-8817-0e074cc02581 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:42.591798 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f6e99a5b-641e-4741-8817-0e074cc02581 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:42.593785 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f6e99a5b-641e-4741-8817-0e074cc02581 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:42.598030 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f6e99a5b-641e-4741-8817-0e074cc02581 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:42.599182 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f6e99a5b-641e-4741-8817-0e074cc02581 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:43.005036 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f6e99a5b-641e-4741-8817-0e074cc02581 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:43.017229 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f6e99a5b-641e-4741-8817-0e074cc02581 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b" status: 200 len: 1504 microversion: 2.1 time: 0.441054 Jul 23 21:15:43.018213 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 312/678] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:42 2022] GET /compute/v2.1/servers/d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b => generated 1504 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:43.197733 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2ede4d7d-bc69-4009-b8d4-f47db7b28527 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:43.198652 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-2ede4d7d-bc69-4009-b8d4-f47db7b28527 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 5bc4befa-252d-456a-92cd-323bad80fcdf] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:43.209594 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2ede4d7d-bc69-4009-b8d4-f47db7b28527 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:43.217074 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2ede4d7d-bc69-4009-b8d4-f47db7b28527 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:43.218372 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2ede4d7d-bc69-4009-b8d4-f47db7b28527 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:43.218977 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2ede4d7d-bc69-4009-b8d4-f47db7b28527 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:43.363078 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-b3e20fd6-18d4-4f0f-aaf2-2a5ab3f12a3e tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:43.385745 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-b3e20fd6-18d4-4f0f-aaf2-2a5ab3f12a3e tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:43.392863 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-b3e20fd6-18d4-4f0f-aaf2-2a5ab3f12a3e tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:43.396749 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-b3e20fd6-18d4-4f0f-aaf2-2a5ab3f12a3e tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/7558d52c-24e7-4115-88f7-ced193819c33" status: 200 len: 1362 microversion: 2.25 time: 0.922859 Jul 23 21:15:43.402527 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 367/679] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:15:42 2022] GET /compute/v2.1/servers/7558d52c-24e7-4115-88f7-ced193819c33 => generated 1362 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:15:43.484655 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-fe34086f-7663-4e8d-98c2-39ed86b82d5f tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:43.485360 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-fe34086f-7663-4e8d-98c2-39ed86b82d5f tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: f299d55c-90a4-41cc-98a8-e14ca5964eb1] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:43.496943 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fe34086f-7663-4e8d-98c2-39ed86b82d5f tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:43.497405 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fe34086f-7663-4e8d-98c2-39ed86b82d5f tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:43.498460 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fe34086f-7663-4e8d-98c2-39ed86b82d5f tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:43.503391 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fe34086f-7663-4e8d-98c2-39ed86b82d5f tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:43.956280 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-2ede4d7d-bc69-4009-b8d4-f47db7b28527 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:43.968270 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2ede4d7d-bc69-4009-b8d4-f47db7b28527 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/5bc4befa-252d-456a-92cd-323bad80fcdf" status: 200 len: 1462 microversion: 2.1 time: 0.774764 Jul 23 21:15:43.969086 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 313/680] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:43 2022] GET /compute/v2.1/servers/5bc4befa-252d-456a-92cd-323bad80fcdf => generated 1462 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:15:43.973523 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4d32f2a0-0962-40e4-a4e4-43d051e42670 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:43.974451 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-4d32f2a0-0962-40e4-a4e4-43d051e42670 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] [instance: 70997419-42ea-46b3-a1bd-127efc670cd2] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:43.981807 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4d32f2a0-0962-40e4-a4e4-43d051e42670 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:43.982652 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4d32f2a0-0962-40e4-a4e4-43d051e42670 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:43.983940 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4d32f2a0-0962-40e4-a4e4-43d051e42670 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:43.984641 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4d32f2a0-0962-40e4-a4e4-43d051e42670 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:44.167065 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-fe34086f-7663-4e8d-98c2-39ed86b82d5f tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf92af08fa94215b4eafcacea6c63f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e7d37a0e3b4b32ae99c3bc15a831e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:44.176691 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-fe34086f-7663-4e8d-98c2-39ed86b82d5f tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "GET /compute/v2.1/servers/f299d55c-90a4-41cc-98a8-e14ca5964eb1" status: 200 len: 1319 microversion: 2.1 time: 0.695739 Jul 23 21:15:44.182309 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 368/681] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:43 2022] GET /compute/v2.1/servers/f299d55c-90a4-41cc-98a8-e14ca5964eb1 => generated 1319 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:15:44.195617 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e098fb0b-7e37-4970-ab05-5b3bf011daf0 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:15:44.197260 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-e098fb0b-7e37-4970-ab05-5b3bf011daf0 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 5bc4befa-252d-456a-92cd-323bad80fcdf] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:44.215001 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e098fb0b-7e37-4970-ab05-5b3bf011daf0 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:44.218040 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e098fb0b-7e37-4970-ab05-5b3bf011daf0 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:44.223133 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e098fb0b-7e37-4970-ab05-5b3bf011daf0 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:44.223881 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e098fb0b-7e37-4970-ab05-5b3bf011daf0 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:44.451169 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-e098fb0b-7e37-4970-ab05-5b3bf011daf0 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:44.457956 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-e098fb0b-7e37-4970-ab05-5b3bf011daf0 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 5bc4befa-252d-456a-92cd-323bad80fcdf] Old instance type m1.heat2, new instance type m1.heat {{(pid=131321) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 23 21:15:44.481052 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-e098fb0b-7e37-4970-ab05-5b3bf011daf0 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Flavor limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:15:44.481467 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-e098fb0b-7e37-4970-ab05-5b3bf011daf0 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Image limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:15:44.491585 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-e098fb0b-7e37-4970-ab05-5b3bf011daf0 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Flavor pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:15:44.492180 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-e098fb0b-7e37-4970-ab05-5b3bf011daf0 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Image pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:15:44.492425 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-e098fb0b-7e37-4970-ab05-5b3bf011daf0 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:15:44.639744 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-4d32f2a0-0962-40e4-a4e4-43d051e42670 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a872dad882e4694aba20eaa8c06df53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457d184c579a4016a0eec16eb9f23195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:44.662983 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4d32f2a0-0962-40e4-a4e4-43d051e42670 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] 10.222.0.17 "GET /compute/v2.1/servers/70997419-42ea-46b3-a1bd-127efc670cd2" status: 200 len: 1464 microversion: 2.1 time: 0.693030 Jul 23 21:15:44.673081 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 314/682] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:43 2022] GET /compute/v2.1/servers/70997419-42ea-46b3-a1bd-127efc670cd2 => generated 1464 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:44.686699 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-00b5dc43-6afd-4a63-b538-7d207d5dcaee tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:44.688055 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-00b5dc43-6afd-4a63-b538-7d207d5dcaee tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:44.703516 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-00b5dc43-6afd-4a63-b538-7d207d5dcaee tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:44.704247 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-00b5dc43-6afd-4a63-b538-7d207d5dcaee tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:44.705267 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-00b5dc43-6afd-4a63-b538-7d207d5dcaee tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:44.705855 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-00b5dc43-6afd-4a63-b538-7d207d5dcaee tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:44.763947 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-e098fb0b-7e37-4970-ab05-5b3bf011daf0 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "POST /compute/v2.1/servers/5bc4befa-252d-456a-92cd-323bad80fcdf/action" status: 202 len: 0 microversion: 2.1 time: 0.578780 Jul 23 21:15:44.766074 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 369/683] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:15:44 2022] POST /compute/v2.1/servers/5bc4befa-252d-456a-92cd-323bad80fcdf/action => generated 0 bytes in 583 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:15:44.779590 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-36be2a93-97b8-47c4-acbe-b6a790759e23 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:44.780480 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-36be2a93-97b8-47c4-acbe-b6a790759e23 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: 7558d52c-24e7-4115-88f7-ced193819c33] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:44.794557 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-36be2a93-97b8-47c4-acbe-b6a790759e23 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:44.797798 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-36be2a93-97b8-47c4-acbe-b6a790759e23 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:44.799148 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-36be2a93-97b8-47c4-acbe-b6a790759e23 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:44.804831 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-36be2a93-97b8-47c4-acbe-b6a790759e23 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:45.228460 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-36be2a93-97b8-47c4-acbe-b6a790759e23 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:45.251087 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-36be2a93-97b8-47c4-acbe-b6a790759e23 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:45.253328 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-36be2a93-97b8-47c4-acbe-b6a790759e23 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:45.258997 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-36be2a93-97b8-47c4-acbe-b6a790759e23 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/7558d52c-24e7-4115-88f7-ced193819c33" status: 200 len: 1362 microversion: 2.25 time: 0.491440 Jul 23 21:15:45.262277 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 370/684] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:15:44 2022] GET /compute/v2.1/servers/7558d52c-24e7-4115-88f7-ced193819c33 => generated 1362 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:15:45.267210 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-9ea888f3-8a5a-48a8-a6aa-7f840a8d98bd req-00edff34-af83-40f8-9c12-befe8f2c6e09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7558d52c-24e7-4115-88f7-ced193819c33", "tag": "ba673080-c139-468a-94c4-8bd962f254a6"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:15:45.298048 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-9ea888f3-8a5a-48a8-a6aa-7f840a8d98bd req-00edff34-af83-40f8-9c12-befe8f2c6e09 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:45.307171 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-9ea888f3-8a5a-48a8-a6aa-7f840a8d98bd req-00edff34-af83-40f8-9c12-befe8f2c6e09 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:45.335642 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-9ea888f3-8a5a-48a8-a6aa-7f840a8d98bd req-00edff34-af83-40f8-9c12-befe8f2c6e09 service nova] Creating event network-changed:ba673080-c139-468a-94c4-8bd962f254a6 for instance 7558d52c-24e7-4115-88f7-ced193819c33 on nch1-master-1 Jul 23 21:15:45.359678 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-9ea888f3-8a5a-48a8-a6aa-7f840a8d98bd req-00edff34-af83-40f8-9c12-befe8f2c6e09 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095933 Jul 23 21:15:45.362698 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 371/685] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:15:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:15:45.372804 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-21c0835b-b86b-48e6-9c45-ce1189419b83 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:45.378743 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-21c0835b-b86b-48e6-9c45-ce1189419b83 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 5bc4befa-252d-456a-92cd-323bad80fcdf] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:45.389016 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-21c0835b-b86b-48e6-9c45-ce1189419b83 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:45.391520 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-21c0835b-b86b-48e6-9c45-ce1189419b83 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:45.392617 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-21c0835b-b86b-48e6-9c45-ce1189419b83 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:45.399721 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-21c0835b-b86b-48e6-9c45-ce1189419b83 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:45.782244 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-00b5dc43-6afd-4a63-b538-7d207d5dcaee tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:45.790576 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:15:45.795969 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-00b5dc43-6afd-4a63-b538-7d207d5dcaee tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b" status: 200 len: 1504 microversion: 2.1 time: 1.121276 Jul 23 21:15:45.799088 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 315/686] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:44 2022] GET /compute/v2.1/servers/d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b => generated 1504 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:45.804404 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-21c0835b-b86b-48e6-9c45-ce1189419b83 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:45.817466 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-21c0835b-b86b-48e6-9c45-ce1189419b83 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/5bc4befa-252d-456a-92cd-323bad80fcdf" status: 200 len: 1471 microversion: 2.1 time: 0.452753 Jul 23 21:15:45.820713 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 372/687] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:45 2022] GET /compute/v2.1/servers/5bc4befa-252d-456a-92cd-323bad80fcdf => generated 1471 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:45.826362 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-46f95524-1bc5-4714-ac1f-6e0e2265c5d2 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:45.827555 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-46f95524-1bc5-4714-ac1f-6e0e2265c5d2 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] [instance: 70997419-42ea-46b3-a1bd-127efc670cd2] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:45.830592 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-95008577-5c82-4d4a-90ad-774879c3eb6f tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:45.831767 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-95008577-5c82-4d4a-90ad-774879c3eb6f tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: f299d55c-90a4-41cc-98a8-e14ca5964eb1] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:45.839767 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-46f95524-1bc5-4714-ac1f-6e0e2265c5d2 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:45.840559 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-46f95524-1bc5-4714-ac1f-6e0e2265c5d2 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:45.842200 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-46f95524-1bc5-4714-ac1f-6e0e2265c5d2 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:45.842868 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-46f95524-1bc5-4714-ac1f-6e0e2265c5d2 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:45.862319 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-95008577-5c82-4d4a-90ad-774879c3eb6f tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:45.862896 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-95008577-5c82-4d4a-90ad-774879c3eb6f tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:45.863703 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-95008577-5c82-4d4a-90ad-774879c3eb6f tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:45.864149 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-95008577-5c82-4d4a-90ad-774879c3eb6f tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:46.029284 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-46f95524-1bc5-4714-ac1f-6e0e2265c5d2 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a872dad882e4694aba20eaa8c06df53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457d184c579a4016a0eec16eb9f23195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:46.057558 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-46f95524-1bc5-4714-ac1f-6e0e2265c5d2 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] 10.222.0.17 "GET /compute/v2.1/servers/70997419-42ea-46b3-a1bd-127efc670cd2" status: 200 len: 1422 microversion: 2.1 time: 0.235312 Jul 23 21:15:46.066745 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 373/688] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:45 2022] GET /compute/v2.1/servers/70997419-42ea-46b3-a1bd-127efc670cd2 => generated 1422 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:46.279433 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-3b7980b7-d5b0-44de-8074-b2b4ada495e0 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:46.280152 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-3b7980b7-d5b0-44de-8074-b2b4ada495e0 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: 7558d52c-24e7-4115-88f7-ced193819c33] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:46.289598 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3b7980b7-d5b0-44de-8074-b2b4ada495e0 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:46.292239 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3b7980b7-d5b0-44de-8074-b2b4ada495e0 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:46.293271 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3b7980b7-d5b0-44de-8074-b2b4ada495e0 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:46.294670 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3b7980b7-d5b0-44de-8074-b2b4ada495e0 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:46.529242 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-3b7980b7-d5b0-44de-8074-b2b4ada495e0 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:46.539419 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-3b7980b7-d5b0-44de-8074-b2b4ada495e0 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:46.541627 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-3b7980b7-d5b0-44de-8074-b2b4ada495e0 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:46.545366 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-3b7980b7-d5b0-44de-8074-b2b4ada495e0 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/7558d52c-24e7-4115-88f7-ced193819c33" status: 200 len: 1362 microversion: 2.25 time: 0.267487 Jul 23 21:15:46.547078 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 374/689] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:15:46 2022] GET /compute/v2.1/servers/7558d52c-24e7-4115-88f7-ced193819c33 => generated 1362 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:15:46.558539 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-1abae4ff-7d0d-4966-b5fa-4ffa362f0de6 req-98d906df-71bf-4ecd-add1-3108da9af57f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70997419-42ea-46b3-a1bd-127efc670cd2", "name": "network-vif-deleted", "tag": "85027928-65ec-4df1-9876-e9b194f491fb"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:15:46.569232 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-1abae4ff-7d0d-4966-b5fa-4ffa362f0de6 req-98d906df-71bf-4ecd-add1-3108da9af57f service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:46.570217 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-1abae4ff-7d0d-4966-b5fa-4ffa362f0de6 req-98d906df-71bf-4ecd-add1-3108da9af57f service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:46.585648 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-1abae4ff-7d0d-4966-b5fa-4ffa362f0de6 req-98d906df-71bf-4ecd-add1-3108da9af57f service nova] Creating event network-vif-deleted:85027928-65ec-4df1-9876-e9b194f491fb for instance 70997419-42ea-46b3-a1bd-127efc670cd2 on nch2-master-1 Jul 23 21:15:46.592895 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-1abae4ff-7d0d-4966-b5fa-4ffa362f0de6 req-98d906df-71bf-4ecd-add1-3108da9af57f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043295 Jul 23 21:15:46.594325 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 375/690] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:15:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:15:46.723890 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-95008577-5c82-4d4a-90ad-774879c3eb6f tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf92af08fa94215b4eafcacea6c63f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e7d37a0e3b4b32ae99c3bc15a831e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:46.739173 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-95008577-5c82-4d4a-90ad-774879c3eb6f tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "GET /compute/v2.1/servers/f299d55c-90a4-41cc-98a8-e14ca5964eb1" status: 200 len: 1319 microversion: 2.1 time: 0.929073 Jul 23 21:15:46.741478 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 316/691] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:45 2022] GET /compute/v2.1/servers/f299d55c-90a4-41cc-98a8-e14ca5964eb1 => generated 1319 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:46.815564 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell0:SELECT=36 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:15:46.821244 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f9d0b1f5-e524-4dbb-b243-e612f079327f tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:46.822939 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-f9d0b1f5-e524-4dbb-b243-e612f079327f tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:46.837428 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-be71dd72-9dd8-4476-800f-a1963525ee99 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:46.839013 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-be71dd72-9dd8-4476-800f-a1963525ee99 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 5bc4befa-252d-456a-92cd-323bad80fcdf] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:46.839630 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f9d0b1f5-e524-4dbb-b243-e612f079327f tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:46.840184 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f9d0b1f5-e524-4dbb-b243-e612f079327f tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:46.841622 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f9d0b1f5-e524-4dbb-b243-e612f079327f tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:46.843561 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f9d0b1f5-e524-4dbb-b243-e612f079327f tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:46.856635 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-be71dd72-9dd8-4476-800f-a1963525ee99 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:46.860093 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-be71dd72-9dd8-4476-800f-a1963525ee99 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:46.863337 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-be71dd72-9dd8-4476-800f-a1963525ee99 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:46.865278 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-be71dd72-9dd8-4476-800f-a1963525ee99 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:47.070915 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-f9d0b1f5-e524-4dbb-b243-e612f079327f tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:47.077039 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:15:47.107286 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-f9d0b1f5-e524-4dbb-b243-e612f079327f tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b" status: 200 len: 1504 microversion: 2.1 time: 0.295360 Jul 23 21:15:47.109965 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 376/692] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:46 2022] GET /compute/v2.1/servers/d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b => generated 1504 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:47.127282 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-956a25e1-997a-40cd-b15e-eb5a87be49f9 req-58d7a589-921f-4f3b-a4d6-c9dd94099223 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f299d55c-90a4-41cc-98a8-e14ca5964eb1", "name": "network-vif-plugged", "status": "completed", "tag": "6b938da1-d7da-40b9-92a8-95e3181b67b9"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:15:47.150514 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-956a25e1-997a-40cd-b15e-eb5a87be49f9 req-58d7a589-921f-4f3b-a4d6-c9dd94099223 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:47.152885 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-956a25e1-997a-40cd-b15e-eb5a87be49f9 req-58d7a589-921f-4f3b-a4d6-c9dd94099223 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:47.201651 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-956a25e1-997a-40cd-b15e-eb5a87be49f9 req-58d7a589-921f-4f3b-a4d6-c9dd94099223 service nova] Creating event network-vif-plugged:6b938da1-d7da-40b9-92a8-95e3181b67b9 for instance f299d55c-90a4-41cc-98a8-e14ca5964eb1 on nch2-master-1 Jul 23 21:15:47.224627 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-be71dd72-9dd8-4476-800f-a1963525ee99 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:47.238116 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-956a25e1-997a-40cd-b15e-eb5a87be49f9 req-58d7a589-921f-4f3b-a4d6-c9dd94099223 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105604 Jul 23 21:15:47.240255 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 377/693] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:15:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:15:47.250755 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-be71dd72-9dd8-4476-800f-a1963525ee99 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/5bc4befa-252d-456a-92cd-323bad80fcdf" status: 200 len: 1471 microversion: 2.1 time: 0.418266 Jul 23 21:15:47.262926 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 317/694] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:46 2022] GET /compute/v2.1/servers/5bc4befa-252d-456a-92cd-323bad80fcdf => generated 1471 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:15:47.267197 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-fd0679a7-0751-484e-b409-a6233315cc3b tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:47.272224 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-fd0679a7-0751-484e-b409-a6233315cc3b tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] [instance: 70997419-42ea-46b3-a1bd-127efc670cd2] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:47.290481 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fd0679a7-0751-484e-b409-a6233315cc3b tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:47.291168 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fd0679a7-0751-484e-b409-a6233315cc3b tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:47.292976 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fd0679a7-0751-484e-b409-a6233315cc3b tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:47.298028 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fd0679a7-0751-484e-b409-a6233315cc3b tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:47.374562 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fd0679a7-0751-484e-b409-a6233315cc3b tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:47.376045 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fd0679a7-0751-484e-b409-a6233315cc3b tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:47.376045 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.objects.instance [None req-fd0679a7-0751-484e-b409-a6233315cc3b tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lazy-loading 'fault' on Instance uuid 70997419-42ea-46b3-a1bd-127efc670cd2 {{(pid=131321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:15:47.494043 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-fd0679a7-0751-484e-b409-a6233315cc3b tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a872dad882e4694aba20eaa8c06df53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457d184c579a4016a0eec16eb9f23195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:47.502993 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-fd0679a7-0751-484e-b409-a6233315cc3b tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] 10.222.0.17 "GET /compute/v2.1/servers/70997419-42ea-46b3-a1bd-127efc670cd2" status: 200 len: 1308 microversion: 2.1 time: 0.258894 Jul 23 21:15:47.503933 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 378/695] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:47 2022] GET /compute/v2.1/servers/70997419-42ea-46b3-a1bd-127efc670cd2 => generated 1308 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:47.567299 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-21ceee59-02e1-4cdc-bc22-6e4e51e72f67 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:47.569012 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-21ceee59-02e1-4cdc-bc22-6e4e51e72f67 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: 7558d52c-24e7-4115-88f7-ced193819c33] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:47.585738 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-21ceee59-02e1-4cdc-bc22-6e4e51e72f67 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:47.589352 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-21ceee59-02e1-4cdc-bc22-6e4e51e72f67 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:47.590443 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-21ceee59-02e1-4cdc-bc22-6e4e51e72f67 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:47.591035 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-21ceee59-02e1-4cdc-bc22-6e4e51e72f67 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:47.760575 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-27a870b2-6163-42b2-b9df-fd9e1767ab37 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:47.761297 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-27a870b2-6163-42b2-b9df-fd9e1767ab37 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: f299d55c-90a4-41cc-98a8-e14ca5964eb1] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:47.771320 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:15:47.777249 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-27a870b2-6163-42b2-b9df-fd9e1767ab37 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:47.777722 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-27a870b2-6163-42b2-b9df-fd9e1767ab37 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:47.778574 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-27a870b2-6163-42b2-b9df-fd9e1767ab37 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:47.779024 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-27a870b2-6163-42b2-b9df-fd9e1767ab37 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:48.136505 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-21ceee59-02e1-4cdc-bc22-6e4e51e72f67 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:48.152282 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-21ceee59-02e1-4cdc-bc22-6e4e51e72f67 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:48.160481 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-21ceee59-02e1-4cdc-bc22-6e4e51e72f67 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:48.168529 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-21ceee59-02e1-4cdc-bc22-6e4e51e72f67 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/7558d52c-24e7-4115-88f7-ced193819c33" status: 200 len: 1362 microversion: 2.25 time: 0.607254 Jul 23 21:15:48.172443 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 318/696] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:15:47 2022] GET /compute/v2.1/servers/7558d52c-24e7-4115-88f7-ced193819c33 => generated 1362 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:15:48.177646 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-23954c81-ed73-40e0-8e13-297f52b18deb tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:48.188096 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-23954c81-ed73-40e0-8e13-297f52b18deb tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:48.199838 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-23954c81-ed73-40e0-8e13-297f52b18deb tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:48.210734 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-23954c81-ed73-40e0-8e13-297f52b18deb tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:48.212168 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-23954c81-ed73-40e0-8e13-297f52b18deb tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:48.212833 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-23954c81-ed73-40e0-8e13-297f52b18deb tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:48.597089 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-27a870b2-6163-42b2-b9df-fd9e1767ab37 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf92af08fa94215b4eafcacea6c63f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e7d37a0e3b4b32ae99c3bc15a831e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:48.607604 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-27a870b2-6163-42b2-b9df-fd9e1767ab37 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "GET /compute/v2.1/servers/f299d55c-90a4-41cc-98a8-e14ca5964eb1" status: 200 len: 1319 microversion: 2.1 time: 0.852630 Jul 23 21:15:48.611217 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 379/697] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:47 2022] GET /compute/v2.1/servers/f299d55c-90a4-41cc-98a8-e14ca5964eb1 => generated 1319 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:48.619184 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-4d652362-032f-4827-8f16-01e4701e5f5b tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:48.621766 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-4d652362-032f-4827-8f16-01e4701e5f5b tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 5bc4befa-252d-456a-92cd-323bad80fcdf] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:48.631209 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4d652362-032f-4827-8f16-01e4701e5f5b tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:48.632139 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4d652362-032f-4827-8f16-01e4701e5f5b tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:48.633222 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4d652362-032f-4827-8f16-01e4701e5f5b tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:48.633893 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4d652362-032f-4827-8f16-01e4701e5f5b tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:48.987840 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-4d652362-032f-4827-8f16-01e4701e5f5b tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:48.997908 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-4d652362-032f-4827-8f16-01e4701e5f5b tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/5bc4befa-252d-456a-92cd-323bad80fcdf" status: 200 len: 1471 microversion: 2.1 time: 0.382350 Jul 23 21:15:48.998570 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 380/698] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:48 2022] GET /compute/v2.1/servers/5bc4befa-252d-456a-92cd-323bad80fcdf => generated 1471 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:49.028207 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-566694bc-4904-4fbb-b4de-d02a954d5d67 req-53bf996c-69ed-4b89-9082-fac2dd9405ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b", "name": "network-vif-unplugged", "status": "completed", "tag": "514e8daf-fac6-48ba-9a0d-0c9edf5b2d8e"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:15:49.041792 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-23954c81-ed73-40e0-8e13-297f52b18deb tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:49.043586 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-566694bc-4904-4fbb-b4de-d02a954d5d67 req-53bf996c-69ed-4b89-9082-fac2dd9405ce service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:49.045603 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-566694bc-4904-4fbb-b4de-d02a954d5d67 req-53bf996c-69ed-4b89-9082-fac2dd9405ce service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:49.057925 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-23954c81-ed73-40e0-8e13-297f52b18deb tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b" status: 200 len: 1504 microversion: 2.1 time: 0.884075 Jul 23 21:15:49.061473 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 319/699] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:48 2022] GET /compute/v2.1/servers/d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b => generated 1504 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:49.079068 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f425f11a-1932-40aa-8192-17990100d8c6 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:49.081949 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f425f11a-1932-40aa-8192-17990100d8c6 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] [instance: 70997419-42ea-46b3-a1bd-127efc670cd2] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:49.095191 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-566694bc-4904-4fbb-b4de-d02a954d5d67 req-53bf996c-69ed-4b89-9082-fac2dd9405ce service nova] Creating event network-vif-unplugged:514e8daf-fac6-48ba-9a0d-0c9edf5b2d8e for instance d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b on nch1-master-1 Jul 23 21:15:49.097008 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f425f11a-1932-40aa-8192-17990100d8c6 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:49.097717 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f425f11a-1932-40aa-8192-17990100d8c6 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:49.105052 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-566694bc-4904-4fbb-b4de-d02a954d5d67 req-53bf996c-69ed-4b89-9082-fac2dd9405ce service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.084440 Jul 23 21:15:49.105605 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f425f11a-1932-40aa-8192-17990100d8c6 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:49.106067 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 381/700] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:15:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:15:49.107950 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f425f11a-1932-40aa-8192-17990100d8c6 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:49.128214 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-f425f11a-1932-40aa-8192-17990100d8c6 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] HTTP exception thrown: Instance 70997419-42ea-46b3-a1bd-127efc670cd2 could not be found. Jul 23 21:15:49.130778 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f425f11a-1932-40aa-8192-17990100d8c6 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Request method failure captured: Jul 23 21:15:49.130778 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/70997419-42ea-46b3-a1bd-127efc670cd2 HTTP/1.1 Jul 23 21:15:49.130778 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:15:49.130778 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:15:49.130778 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:15:49.130778 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:15:49.130778 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:15:49.130778 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:15:49.130778 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:15:49.130778 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:15:49.130778 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GTGWeOhu3zgRHDWycxdv9pjozLbySUQ6z7AMI-iXnP-MSjYiaWSNJUd1t-JIv9ontE64T_hgNfZUN_9_asLyWTnpz2MaHA2twMw47k4DwBs3O_zp7E6nggkabOi39NZ-jizF4_hmKHIj5PYn6LEP1MJOlyCGtVVqxJZ2Q4nlf1CHLY Jul 23 21:15:49.130778 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:15:49.130778 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:15:49.130778 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:15:49.130778 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:15:49.130778 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:15:49.130778 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:15:49.130778 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 457d184c579a4016a0eec16eb9f23195 Jul 23 21:15:49.130778 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-LiveMigrationNegativeTest-645922185 Jul 23 21:15:49.130778 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:15:49.130778 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:15:49.132174 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/457d184c579a4016a0eec16eb9f23195"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/457d184c579a4016a0eec16eb9f23195"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_457d184c579a4016a0eec16eb9f23195", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/457d184c579a4016a0eec16eb9f23195"}]}] Jul 23 21:15:49.132174 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-LiveMigrationNegativeTest-645922185 Jul 23 21:15:49.132174 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 457d184c579a4016a0eec16eb9f23195 Jul 23 21:15:49.132174 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-645922185 Jul 23 21:15:49.132174 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-LiveMigrationNegativeTest-645922185-project Jul 23 21:15:49.132174 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:15:49.132174 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:15:49.132174 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 8a872dad882e4694aba20eaa8c06df53 Jul 23 21:15:49.132174 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-LiveMigrationNegativeTest-645922185-project Jul 23 21:15:49.132174 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:15:49.132174 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance 70997419-42ea-46b3-a1bd-127efc670cd2 could not be found. Jul 23 21:15:49.132174 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '70997419-42ea-46b3-a1bd-127efc670cd2'} Jul 23 21:15:49.132928 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:15:49.132928 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:15:49.132928 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:15:49.132928 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:15:49.132928 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:15:49.132928 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:15:49.132928 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:15:49.132928 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:15:49.132928 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:15:49.132928 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:15:49.132928 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70997419-42ea-46b3-a1bd-127efc670cd2 could not be found. Jul 23 21:15:49.132928 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:15:49.132928 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:15:49.132928 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:15:49.132928 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:15:49.132928 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:15:49.132928 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:15:49.132928 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:15:49.132928 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:15:49.132928 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:15:49.134156 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:15:49.134156 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:15:49.134156 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:15:49.134156 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:15:49.134156 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:15:49.134156 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:15:49.134156 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:15:49.134156 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70997419-42ea-46b3-a1bd-127efc670cd2 could not be found. Jul 23 21:15:49.134156 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:15:49.134156 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:15:49.134156 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:15:49.134156 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:15:49.134156 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:15:49.134156 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:15:49.134156 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:15:49.134156 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:15:49.134156 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70997419-42ea-46b3-a1bd-127efc670cd2 could not be found. Jul 23 21:15:49.134156 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:15:49.137697 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f425f11a-1932-40aa-8192-17990100d8c6 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Returning 404 to user: Instance 70997419-42ea-46b3-a1bd-127efc670cd2 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:15:49.139936 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f425f11a-1932-40aa-8192-17990100d8c6 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] 10.222.0.17 "GET /compute/v2.1/servers/70997419-42ea-46b3-a1bd-127efc670cd2" status: 404 len: 111 microversion: 2.1 time: 0.077182 Jul 23 21:15:49.141141 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 320/701] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:49 2022] GET /compute/v2.1/servers/70997419-42ea-46b3-a1bd-127efc670cd2 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:15:49.151015 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-457b287c-2dba-47c0-a06d-ff2fc2268dee tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:49.151613 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-457b287c-2dba-47c0-a06d-ff2fc2268dee tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] [instance: 7b12c52a-fc64-472b-8659-4e7312fcc83a] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:49.183648 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-457b287c-2dba-47c0-a06d-ff2fc2268dee tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:49.184201 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-457b287c-2dba-47c0-a06d-ff2fc2268dee tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:49.189644 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-457b287c-2dba-47c0-a06d-ff2fc2268dee tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:49.190217 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-457b287c-2dba-47c0-a06d-ff2fc2268dee tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:49.193277 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-da830b85-e2db-47d9-accf-58d6c4d2ace8 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:49.194187 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-da830b85-e2db-47d9-accf-58d6c4d2ace8 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: 7558d52c-24e7-4115-88f7-ced193819c33] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:49.203775 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-da830b85-e2db-47d9-accf-58d6c4d2ace8 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:49.205920 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-da830b85-e2db-47d9-accf-58d6c4d2ace8 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:49.207659 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-da830b85-e2db-47d9-accf-58d6c4d2ace8 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:49.208637 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-da830b85-e2db-47d9-accf-58d6c4d2ace8 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:49.301602 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-457b287c-2dba-47c0-a06d-ff2fc2268dee tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] [instance: 7b12c52a-fc64-472b-8659-4e7312fcc83a] Going to try to terminate instance {{(pid=131321) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:15:49.452528 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-457b287c-2dba-47c0-a06d-ff2fc2268dee tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] 10.222.0.17 "DELETE /compute/v2.1/servers/7b12c52a-fc64-472b-8659-4e7312fcc83a" status: 204 len: 0 microversion: 2.1 time: 0.305362 Jul 23 21:15:49.456971 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 382/702] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:15:49 2022] DELETE /compute/v2.1/servers/7b12c52a-fc64-472b-8659-4e7312fcc83a => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 23 21:15:49.537314 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-81d340ed-500f-4020-80cf-504b6ac49004 tempest-FloatingIPsNegativeTestJSON-545785580 tempest-FloatingIPsNegativeTestJSON-545785580-project] Calling method '.version_select at 0x7f0b5410de50>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:49.613333 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-81d340ed-500f-4020-80cf-504b6ac49004 tempest-FloatingIPsNegativeTestJSON-545785580 tempest-FloatingIPsNegativeTestJSON-545785580-project] 10.222.0.17 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.155068 Jul 23 21:15:49.613949 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 383/703] 10.222.0.17 () {58 vars in 1148 bytes} [Sat Jul 23 21:15:49 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 23 21:15:49.618760 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-4efeb7f0-6acb-4744-a10d-bc81c49e01e2 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:49.619506 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-4efeb7f0-6acb-4744-a10d-bc81c49e01e2 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] [instance: 7b12c52a-fc64-472b-8659-4e7312fcc83a] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:49.638510 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4efeb7f0-6acb-4744-a10d-bc81c49e01e2 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:49.638934 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4efeb7f0-6acb-4744-a10d-bc81c49e01e2 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:49.643385 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4efeb7f0-6acb-4744-a10d-bc81c49e01e2 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:49.643998 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4efeb7f0-6acb-4744-a10d-bc81c49e01e2 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:49.770834 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-da830b85-e2db-47d9-accf-58d6c4d2ace8 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:49.787960 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-da830b85-e2db-47d9-accf-58d6c4d2ace8 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:49.790353 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-da830b85-e2db-47d9-accf-58d6c4d2ace8 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:49.791740 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-da830b85-e2db-47d9-accf-58d6c4d2ace8 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/7558d52c-24e7-4115-88f7-ced193819c33" status: 200 len: 1362 microversion: 2.25 time: 0.604127 Jul 23 21:15:49.806375 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 321/704] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:15:49 2022] GET /compute/v2.1/servers/7558d52c-24e7-4115-88f7-ced193819c33 => generated 1362 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:15:49.811782 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-45bb6944-1668-434e-b12a-31da1f71f45e tempest-FloatingIPsNegativeTestJSON-545785580 tempest-FloatingIPsNegativeTestJSON-545785580-project] Action: 'create', calling method: .version_select at 0x7f0b47bd6ee0>, body: {"pool": "non_exist_pool"} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:15:49.827119 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-4efeb7f0-6acb-4744-a10d-bc81c49e01e2 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a872dad882e4694aba20eaa8c06df53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457d184c579a4016a0eec16eb9f23195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:49.836530 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-4efeb7f0-6acb-4744-a10d-bc81c49e01e2 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] 10.222.0.17 "GET /compute/v2.1/servers/7b12c52a-fc64-472b-8659-4e7312fcc83a" status: 200 len: 1474 microversion: 2.1 time: 0.221404 Jul 23 21:15:49.837067 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 384/705] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:49 2022] GET /compute/v2.1/servers/7b12c52a-fc64-472b-8659-4e7312fcc83a => generated 1474 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:49.852310 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d9c8d676-0168-4825-bbfc-81b6accadcd7 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:49.852932 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-d9c8d676-0168-4825-bbfc-81b6accadcd7 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: f299d55c-90a4-41cc-98a8-e14ca5964eb1] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:49.859563 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d9c8d676-0168-4825-bbfc-81b6accadcd7 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:49.860016 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d9c8d676-0168-4825-bbfc-81b6accadcd7 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:49.860812 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d9c8d676-0168-4825-bbfc-81b6accadcd7 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:49.861343 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d9c8d676-0168-4825-bbfc-81b6accadcd7 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:49.907718 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-45bb6944-1668-434e-b12a-31da1f71f45e tempest-FloatingIPsNegativeTestJSON-545785580 tempest-FloatingIPsNegativeTestJSON-545785580-project] HTTP exception thrown: Floating IP pool not found. Jul 23 21:15:49.909365 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-45bb6944-1668-434e-b12a-31da1f71f45e tempest-FloatingIPsNegativeTestJSON-545785580 tempest-FloatingIPsNegativeTestJSON-545785580-project] Request method failure captured: Jul 23 21:15:49.909365 ncdv-master-1 devstack@n-api.service[131320]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Jul 23 21:15:49.909365 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:15:49.909365 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:15:49.909365 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:15:49.909365 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 26 Jul 23 21:15:49.909365 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:15:49.909365 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:15:49.909365 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:15:49.909365 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:15:49.909365 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GUFLyEmGQEoy0W4Vfk6QG8Tq2lujHwp66kJ7oGericYTMm-91EpKeOpUOinty0v7P-YuZinFn_D9UXS0o46ChDAofOfl0fbYYqV16IXdSQE4UJzu3ew6PDjLNCgocHO9J8b-hIZ8IhpQzJy_NqtNxYdiJGNqFYEJcBr-Ve6b9q_-iU Jul 23 21:15:49.909365 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:15:49.909365 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:15:49.909365 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:15:49.909365 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:15:49.909365 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:15:49.909365 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:15:49.909365 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: db444807b51d4f20a3c99848a8c373eb Jul 23 21:15:49.909365 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-545785580 Jul 23 21:15:49.909365 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:15:49.909365 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:15:49.910984 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/db444807b51d4f20a3c99848a8c373eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/db444807b51d4f20a3c99848a8c373eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_db444807b51d4f20a3c99848a8c373eb", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/db444807b51d4f20a3c99848a8c373eb"}]}] Jul 23 21:15:49.910984 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-545785580 Jul 23 21:15:49.910984 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: db444807b51d4f20a3c99848a8c373eb Jul 23 21:15:49.910984 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-545785580 Jul 23 21:15:49.910984 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-FloatingIPsNegativeTestJSON-545785580-project Jul 23 21:15:49.910984 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:15:49.910984 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:15:49.910984 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: a943802454a547b694910d4110180f9c Jul 23 21:15:49.910984 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-545785580-project Jul 23 21:15:49.910984 ncdv-master-1 devstack@n-api.service[131320]: Jul 23 21:15:49.910984 ncdv-master-1 devstack@n-api.service[131320]: {"pool": "non_exist_pool"} Jul 23 21:15:49.910984 ncdv-master-1 devstack@n-api.service[131320]: method: Jul 23 21:15:49.910984 ncdv-master-1 devstack@n-api.service[131320]: exception: Floating IP pool not found. Jul 23 21:15:49.910984 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'body': {'pool': 'non_exist_pool'}} Jul 23 21:15:49.910984 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:15:49.911943 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:15:49.911943 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Jul 23 21:15:49.911943 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Jul 23 21:15:49.911943 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2975, in allocate_floating_ip Jul 23 21:15:49.911943 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Jul 23 21:15:49.911943 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2965, in _get_floating_ip_pool_id_by_name_or_id Jul 23 21:15:49.911943 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Jul 23 21:15:49.911943 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Jul 23 21:15:49.911943 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:15:49.911943 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:15:49.911943 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:15:49.911943 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:15:49.911943 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:15:49.911943 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:15:49.911943 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:15:49.911943 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:15:49.911943 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:15:49.911943 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:15:49.911943 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:15:49.911943 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:15:49.913163 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Jul 23 21:15:49.913163 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:15:49.913163 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Jul 23 21:15:49.913163 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:15:49.913163 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:15:49.913163 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:15:49.913163 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:15:49.913163 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:15:49.913163 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:15:49.913163 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:15:49.913163 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:15:49.913163 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Jul 23 21:15:49.913163 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:15:49.913163 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-45bb6944-1668-434e-b12a-31da1f71f45e tempest-FloatingIPsNegativeTestJSON-545785580 tempest-FloatingIPsNegativeTestJSON-545785580-project] Returning 404 to user: Floating IP pool not found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:15:49.913163 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-45bb6944-1668-434e-b12a-31da1f71f45e tempest-FloatingIPsNegativeTestJSON-545785580 tempest-FloatingIPsNegativeTestJSON-545785580-project] 10.222.0.17 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.103019 Jul 23 21:15:49.916755 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 322/706] 10.222.0.17 () {60 vars in 1169 bytes} [Sat Jul 23 21:15:49 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 23 21:15:49.931797 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1eb2979d-7233-44b8-a667-562cb45e8a17 tempest-FloatingIPsNegativeTestJSON-545785580 tempest-FloatingIPsNegativeTestJSON-545785580-project] Calling method '.version_select at 0x7f0b47b91550>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:50.045420 ncdv-master-1 devstack@n-api.service[131320]: DEBUG neutronclient.v2_0.client [None req-1eb2979d-7233-44b8-a667-562cb45e8a17 tempest-FloatingIPsNegativeTestJSON-545785580 tempest-FloatingIPsNegativeTestJSON-545785580-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP c7bbd20f-e78e-4b0f-9d21-7bfdded32f3b could not be found", "detail": ""}} {{(pid=131320) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 23 21:15:50.045420 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-1eb2979d-7233-44b8-a667-562cb45e8a17 tempest-FloatingIPsNegativeTestJSON-545785580 tempest-FloatingIPsNegativeTestJSON-545785580-project] HTTP exception thrown: Floating IP not found for ID c7bbd20f-e78e-4b0f-9d21-7bfdded32f3b Jul 23 21:15:50.047290 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1eb2979d-7233-44b8-a667-562cb45e8a17 tempest-FloatingIPsNegativeTestJSON-545785580 tempest-FloatingIPsNegativeTestJSON-545785580-project] Request method failure captured: Jul 23 21:15:50.047290 ncdv-master-1 devstack@n-api.service[131320]: request: DELETE /compute/v2.1/os-floating-ips/c7bbd20f-e78e-4b0f-9d21-7bfdded32f3b HTTP/1.1 Jul 23 21:15:50.047290 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:15:50.047290 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:15:50.047290 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:15:50.047290 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:15:50.047290 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:15:50.047290 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:15:50.047290 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:15:50.047290 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:15:50.047290 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GUFLyEmGQEoy0W4Vfk6QG8Tq2lujHwp66kJ7oGericYTMm-91EpKeOpUOinty0v7P-YuZinFn_D9UXS0o46ChDAofOfl0fbYYqV16IXdSQE4UJzu3ew6PDjLNCgocHO9J8b-hIZ8IhpQzJy_NqtNxYdiJGNqFYEJcBr-Ve6b9q_-iU Jul 23 21:15:50.047290 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:15:50.047290 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:15:50.047290 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:15:50.047290 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:15:50.047290 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:15:50.047290 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:15:50.047290 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: db444807b51d4f20a3c99848a8c373eb Jul 23 21:15:50.047290 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-545785580 Jul 23 21:15:50.047290 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:15:50.047290 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:15:50.048541 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/db444807b51d4f20a3c99848a8c373eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/db444807b51d4f20a3c99848a8c373eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_db444807b51d4f20a3c99848a8c373eb", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/db444807b51d4f20a3c99848a8c373eb"}]}] Jul 23 21:15:50.048541 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-545785580 Jul 23 21:15:50.048541 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: db444807b51d4f20a3c99848a8c373eb Jul 23 21:15:50.048541 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-545785580 Jul 23 21:15:50.048541 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-FloatingIPsNegativeTestJSON-545785580-project Jul 23 21:15:50.048541 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:15:50.048541 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:15:50.048541 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: a943802454a547b694910d4110180f9c Jul 23 21:15:50.048541 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-545785580-project Jul 23 21:15:50.048541 ncdv-master-1 devstack@n-api.service[131320]: method: Jul 23 21:15:50.048541 ncdv-master-1 devstack@n-api.service[131320]: exception: Floating IP not found for ID c7bbd20f-e78e-4b0f-9d21-7bfdded32f3b Jul 23 21:15:50.048541 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': 'c7bbd20f-e78e-4b0f-9d21-7bfdded32f3b'} Jul 23 21:15:50.048541 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:15:50.049855 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:15:50.049855 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 23 21:15:50.049855 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 23 21:15:50.049855 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:15:50.049855 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:15:50.049855 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 23 21:15:50.049855 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 23 21:15:50.049855 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:15:50.049855 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:15:50.049855 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 23 21:15:50.049855 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 23 21:15:50.049855 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:15:50.049855 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:15:50.049855 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 23 21:15:50.049855 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 23 21:15:50.049855 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:15:50.049855 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:15:50.049855 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 23 21:15:50.049855 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 23 21:15:50.051298 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:15:50.051298 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:15:50.051298 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 23 21:15:50.051298 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 23 21:15:50.051298 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 23 21:15:50.051298 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 23 21:15:50.051298 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP c7bbd20f-e78e-4b0f-9d21-7bfdded32f3b could not be found Jul 23 21:15:50.051298 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-00766299-353e-48aa-921b-12318c3fa633'] Jul 23 21:15:50.051298 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:15:50.051298 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:15:50.051298 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:15:50.051298 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:15:50.051298 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Jul 23 21:15:50.051298 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 23 21:15:50.051298 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 23 21:15:50.051298 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 23 21:15:50.051298 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID c7bbd20f-e78e-4b0f-9d21-7bfdded32f3b. Jul 23 21:15:50.051298 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:15:50.051298 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:15:50.051298 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:15:50.052543 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:15:50.052543 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:15:50.052543 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:15:50.052543 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:15:50.052543 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:15:50.052543 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:15:50.052543 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:15:50.052543 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:15:50.052543 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:15:50.052543 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Jul 23 21:15:50.052543 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 23 21:15:50.052543 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID c7bbd20f-e78e-4b0f-9d21-7bfdded32f3b Jul 23 21:15:50.052543 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:15:50.052543 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:15:50.052543 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:15:50.052543 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:15:50.052543 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:15:50.052543 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:15:50.052543 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:15:50.052543 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:15:50.053670 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID c7bbd20f-e78e-4b0f-9d21-7bfdded32f3b Jul 23 21:15:50.053670 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:15:50.053670 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1eb2979d-7233-44b8-a667-562cb45e8a17 tempest-FloatingIPsNegativeTestJSON-545785580 tempest-FloatingIPsNegativeTestJSON-545785580-project] Returning 404 to user: Floating IP not found for ID c7bbd20f-e78e-4b0f-9d21-7bfdded32f3b {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:15:50.053670 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1eb2979d-7233-44b8-a667-562cb45e8a17 tempest-FloatingIPsNegativeTestJSON-545785580 tempest-FloatingIPsNegativeTestJSON-545785580-project] 10.222.0.17 "DELETE /compute/v2.1/os-floating-ips/c7bbd20f-e78e-4b0f-9d21-7bfdded32f3b" status: 404 len: 111 microversion: 2.1 time: 0.126040 Jul 23 21:15:50.055213 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 323/707] 10.222.0.17 () {58 vars in 1262 bytes} [Sat Jul 23 21:15:49 2022] DELETE /compute/v2.1/os-floating-ips/c7bbd20f-e78e-4b0f-9d21-7bfdded32f3b => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 23 21:15:50.061521 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9e1ef70b-3d6a-4a10-952b-ca03732d88c9 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:50.062167 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-9e1ef70b-3d6a-4a10-952b-ca03732d88c9 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 5bc4befa-252d-456a-92cd-323bad80fcdf] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:50.082384 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:15:50.083983 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9e1ef70b-3d6a-4a10-952b-ca03732d88c9 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:50.084442 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9e1ef70b-3d6a-4a10-952b-ca03732d88c9 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:50.085242 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9e1ef70b-3d6a-4a10-952b-ca03732d88c9 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:50.085730 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9e1ef70b-3d6a-4a10-952b-ca03732d88c9 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:50.262947 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-d9c8d676-0168-4825-bbfc-81b6accadcd7 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf92af08fa94215b4eafcacea6c63f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e7d37a0e3b4b32ae99c3bc15a831e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:50.276910 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-d9c8d676-0168-4825-bbfc-81b6accadcd7 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "GET /compute/v2.1/servers/f299d55c-90a4-41cc-98a8-e14ca5964eb1" status: 200 len: 1469 microversion: 2.1 time: 0.428167 Jul 23 21:15:50.279215 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 385/708] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:49 2022] GET /compute/v2.1/servers/f299d55c-90a4-41cc-98a8-e14ca5964eb1 => generated 1469 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:50.295097 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-3df57bbb-e497-4149-9d2b-f6a3e849470e tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:50.295779 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-3df57bbb-e497-4149-9d2b-f6a3e849470e tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:50.311723 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3df57bbb-e497-4149-9d2b-f6a3e849470e tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:50.312175 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3df57bbb-e497-4149-9d2b-f6a3e849470e tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:50.312969 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3df57bbb-e497-4149-9d2b-f6a3e849470e tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:50.313399 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3df57bbb-e497-4149-9d2b-f6a3e849470e tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:50.536394 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-9e1ef70b-3d6a-4a10-952b-ca03732d88c9 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:50.553282 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9e1ef70b-3d6a-4a10-952b-ca03732d88c9 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/5bc4befa-252d-456a-92cd-323bad80fcdf" status: 200 len: 1471 microversion: 2.1 time: 0.495881 Jul 23 21:15:50.553917 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 324/709] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:50 2022] GET /compute/v2.1/servers/5bc4befa-252d-456a-92cd-323bad80fcdf => generated 1471 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:50.560245 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-29965561-ef11-4bef-b572-d4eba2c412a1 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:50.560864 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-29965561-ef11-4bef-b572-d4eba2c412a1 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: da599d16-7a8c-4ced-b129-d692e5b4866f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:50.578848 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-29965561-ef11-4bef-b572-d4eba2c412a1 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:50.579277 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-29965561-ef11-4bef-b572-d4eba2c412a1 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:50.587402 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-29965561-ef11-4bef-b572-d4eba2c412a1 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:50.588190 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-29965561-ef11-4bef-b572-d4eba2c412a1 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:50.993221 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-3df57bbb-e497-4149-9d2b-f6a3e849470e tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:51.004865 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-3df57bbb-e497-4149-9d2b-f6a3e849470e tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b" status: 200 len: 1504 microversion: 2.1 time: 0.723269 Jul 23 21:15:51.005470 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 386/710] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:50 2022] GET /compute/v2.1/servers/d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b => generated 1504 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:51.020279 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-99d76a8e-a073-4e22-af41-135a85c11230 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:51.021143 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-99d76a8e-a073-4e22-af41-135a85c11230 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: 7558d52c-24e7-4115-88f7-ced193819c33] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:51.036348 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-99d76a8e-a073-4e22-af41-135a85c11230 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:51.036806 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-99d76a8e-a073-4e22-af41-135a85c11230 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:51.037605 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-99d76a8e-a073-4e22-af41-135a85c11230 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:51.038072 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-99d76a8e-a073-4e22-af41-135a85c11230 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:51.132910 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-29965561-ef11-4bef-b572-d4eba2c412a1 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf92af08fa94215b4eafcacea6c63f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e7d37a0e3b4b32ae99c3bc15a831e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:51.140838 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-29965561-ef11-4bef-b572-d4eba2c412a1 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "GET /compute/v2.1/servers/da599d16-7a8c-4ced-b129-d692e5b4866f" status: 200 len: 1319 microversion: 2.1 time: 0.585828 Jul 23 21:15:51.141425 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 325/711] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:50 2022] GET /compute/v2.1/servers/da599d16-7a8c-4ced-b129-d692e5b4866f => generated 1319 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:51.153905 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ef628ff8-e2e3-47c8-b6f8-aaf9dee7ebc8 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:51.162877 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ef628ff8-e2e3-47c8-b6f8-aaf9dee7ebc8 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] [instance: 7b12c52a-fc64-472b-8659-4e7312fcc83a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:51.174014 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ef628ff8-e2e3-47c8-b6f8-aaf9dee7ebc8 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:51.177251 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ef628ff8-e2e3-47c8-b6f8-aaf9dee7ebc8 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:51.178336 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ef628ff8-e2e3-47c8-b6f8-aaf9dee7ebc8 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:51.178939 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ef628ff8-e2e3-47c8-b6f8-aaf9dee7ebc8 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:51.299967 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell0:SELECT=10 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:15:51.504633 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-99d76a8e-a073-4e22-af41-135a85c11230 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:51.529735 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ef628ff8-e2e3-47c8-b6f8-aaf9dee7ebc8 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a872dad882e4694aba20eaa8c06df53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457d184c579a4016a0eec16eb9f23195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:51.537628 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-99d76a8e-a073-4e22-af41-135a85c11230 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:51.538798 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ef628ff8-e2e3-47c8-b6f8-aaf9dee7ebc8 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] 10.222.0.17 "GET /compute/v2.1/servers/7b12c52a-fc64-472b-8659-4e7312fcc83a" status: 200 len: 1474 microversion: 2.1 time: 0.388719 Jul 23 21:15:51.542857 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-99d76a8e-a073-4e22-af41-135a85c11230 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:51.544698 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 326/712] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:51 2022] GET /compute/v2.1/servers/7b12c52a-fc64-472b-8659-4e7312fcc83a => generated 1474 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:51.548517 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-99d76a8e-a073-4e22-af41-135a85c11230 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/7558d52c-24e7-4115-88f7-ced193819c33" status: 200 len: 1362 microversion: 2.25 time: 0.532166 Jul 23 21:15:51.563977 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 387/713] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:15:51 2022] GET /compute/v2.1/servers/7558d52c-24e7-4115-88f7-ced193819c33 => generated 1362 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:15:51.571273 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f4288554-a8ad-4fee-9870-d92a36beb5e2 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:51.571858 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f4288554-a8ad-4fee-9870-d92a36beb5e2 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 5bc4befa-252d-456a-92cd-323bad80fcdf] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:51.581352 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f4288554-a8ad-4fee-9870-d92a36beb5e2 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:51.586385 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f4288554-a8ad-4fee-9870-d92a36beb5e2 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:51.587241 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f4288554-a8ad-4fee-9870-d92a36beb5e2 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:51.587687 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f4288554-a8ad-4fee-9870-d92a36beb5e2 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:51.828603 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-69c30b5c-dac4-4c58-81de-183ff4cb0119 req-4040c95c-30e7-42e4-b755-885fe9951b37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da599d16-7a8c-4ced-b129-d692e5b4866f", "name": "network-vif-plugged", "status": "completed", "tag": "34a50e7e-5622-49f8-8abb-5386329b37bc"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:15:51.844526 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-69c30b5c-dac4-4c58-81de-183ff4cb0119 req-4040c95c-30e7-42e4-b755-885fe9951b37 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:51.844972 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-69c30b5c-dac4-4c58-81de-183ff4cb0119 req-4040c95c-30e7-42e4-b755-885fe9951b37 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:51.894371 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-69c30b5c-dac4-4c58-81de-183ff4cb0119 req-4040c95c-30e7-42e4-b755-885fe9951b37 service nova] Creating event network-vif-plugged:34a50e7e-5622-49f8-8abb-5386329b37bc for instance da599d16-7a8c-4ced-b129-d692e5b4866f on nch2-master-1 Jul 23 21:15:51.902029 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-69c30b5c-dac4-4c58-81de-183ff4cb0119 req-4040c95c-30e7-42e4-b755-885fe9951b37 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076930 Jul 23 21:15:51.902646 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 388/714] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:15:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:15:52.025747 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-93a3d3e4-6943-4c98-bf34-486e190f5fb3 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:52.027527 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-93a3d3e4-6943-4c98-bf34-486e190f5fb3 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:52.041987 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-93a3d3e4-6943-4c98-bf34-486e190f5fb3 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:52.042826 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-93a3d3e4-6943-4c98-bf34-486e190f5fb3 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:52.044010 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-93a3d3e4-6943-4c98-bf34-486e190f5fb3 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:52.044754 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-93a3d3e4-6943-4c98-bf34-486e190f5fb3 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:52.119622 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f4288554-a8ad-4fee-9870-d92a36beb5e2 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:52.141119 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f4288554-a8ad-4fee-9870-d92a36beb5e2 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/5bc4befa-252d-456a-92cd-323bad80fcdf" status: 200 len: 1476 microversion: 2.1 time: 0.573579 Jul 23 21:15:52.150852 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 327/715] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:51 2022] GET /compute/v2.1/servers/5bc4befa-252d-456a-92cd-323bad80fcdf => generated 1476 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:52.158952 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-30151027-d1a1-486e-9b56-95fb805f9bc6 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:52.159586 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-30151027-d1a1-486e-9b56-95fb805f9bc6 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: da599d16-7a8c-4ced-b129-d692e5b4866f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:52.169986 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-30151027-d1a1-486e-9b56-95fb805f9bc6 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:52.170505 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-30151027-d1a1-486e-9b56-95fb805f9bc6 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:52.171326 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-30151027-d1a1-486e-9b56-95fb805f9bc6 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:52.171770 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-30151027-d1a1-486e-9b56-95fb805f9bc6 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:52.502149 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-93a3d3e4-6943-4c98-bf34-486e190f5fb3 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:52.514148 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-93a3d3e4-6943-4c98-bf34-486e190f5fb3 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b" status: 200 len: 1504 microversion: 2.1 time: 0.495416 Jul 23 21:15:52.517063 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 389/716] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:52 2022] GET /compute/v2.1/servers/d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b => generated 1504 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:52.526287 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-bf8c8a15-c8ff-498f-bf0b-b2a78cbca1ca req-262aa1e6-57c4-4bc7-83d5-502ce121388c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b12c52a-fc64-472b-8659-4e7312fcc83a", "name": "network-vif-deleted", "tag": "b40a2ef2-d21e-4032-85d7-9361b81fcc6a"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:15:52.564285 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-bf8c8a15-c8ff-498f-bf0b-b2a78cbca1ca req-262aa1e6-57c4-4bc7-83d5-502ce121388c service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:52.568306 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-bf8c8a15-c8ff-498f-bf0b-b2a78cbca1ca req-262aa1e6-57c4-4bc7-83d5-502ce121388c service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:52.604861 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-bf8c8a15-c8ff-498f-bf0b-b2a78cbca1ca req-262aa1e6-57c4-4bc7-83d5-502ce121388c service nova] Creating event network-vif-deleted:b40a2ef2-d21e-4032-85d7-9361b81fcc6a for instance 7b12c52a-fc64-472b-8659-4e7312fcc83a on nch2-master-1 Jul 23 21:15:52.625467 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-bf8c8a15-c8ff-498f-bf0b-b2a78cbca1ca req-262aa1e6-57c4-4bc7-83d5-502ce121388c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102235 Jul 23 21:15:52.628343 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 390/717] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:15:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:15:52.643932 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-3743c991-a656-4e9a-a645-746082fdd5c4 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:52.644943 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-3743c991-a656-4e9a-a645-746082fdd5c4 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] [instance: 7b12c52a-fc64-472b-8659-4e7312fcc83a] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:52.657221 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3743c991-a656-4e9a-a645-746082fdd5c4 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:52.658268 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3743c991-a656-4e9a-a645-746082fdd5c4 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:52.661044 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3743c991-a656-4e9a-a645-746082fdd5c4 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:52.663637 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3743c991-a656-4e9a-a645-746082fdd5c4 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:52.726177 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3743c991-a656-4e9a-a645-746082fdd5c4 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:52.727245 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3743c991-a656-4e9a-a645-746082fdd5c4 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:52.730189 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.objects.instance [None req-3743c991-a656-4e9a-a645-746082fdd5c4 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lazy-loading 'fault' on Instance uuid 7b12c52a-fc64-472b-8659-4e7312fcc83a {{(pid=131321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:15:52.809643 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-30151027-d1a1-486e-9b56-95fb805f9bc6 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf92af08fa94215b4eafcacea6c63f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e7d37a0e3b4b32ae99c3bc15a831e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:52.821961 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-30151027-d1a1-486e-9b56-95fb805f9bc6 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "GET /compute/v2.1/servers/da599d16-7a8c-4ced-b129-d692e5b4866f" status: 200 len: 1319 microversion: 2.1 time: 0.667577 Jul 23 21:15:52.839056 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 328/718] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:52 2022] GET /compute/v2.1/servers/da599d16-7a8c-4ced-b129-d692e5b4866f => generated 1319 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:52.844316 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b0e8341c-40ed-427f-9160-63808c0b959b tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:52.858936 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b0e8341c-40ed-427f-9160-63808c0b959b tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: 7558d52c-24e7-4115-88f7-ced193819c33] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:52.864413 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-3743c991-a656-4e9a-a645-746082fdd5c4 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a872dad882e4694aba20eaa8c06df53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457d184c579a4016a0eec16eb9f23195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:52.879186 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-3743c991-a656-4e9a-a645-746082fdd5c4 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] 10.222.0.17 "GET /compute/v2.1/servers/7b12c52a-fc64-472b-8659-4e7312fcc83a" status: 200 len: 1308 microversion: 2.1 time: 0.245431 Jul 23 21:15:52.879866 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b0e8341c-40ed-427f-9160-63808c0b959b tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:52.880329 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b0e8341c-40ed-427f-9160-63808c0b959b tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:52.881153 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b0e8341c-40ed-427f-9160-63808c0b959b tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:52.881596 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b0e8341c-40ed-427f-9160-63808c0b959b tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:52.883419 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 391/719] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:52 2022] GET /compute/v2.1/servers/7b12c52a-fc64-472b-8659-4e7312fcc83a => generated 1308 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:53.159653 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b0e8341c-40ed-427f-9160-63808c0b959b tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:53.162866 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f7a21090-d80f-478a-98a8-3d8ff9d8dfc8 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:53.165666 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-f7a21090-d80f-478a-98a8-3d8ff9d8dfc8 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 5bc4befa-252d-456a-92cd-323bad80fcdf] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:53.179179 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f7a21090-d80f-478a-98a8-3d8ff9d8dfc8 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:53.179959 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f7a21090-d80f-478a-98a8-3d8ff9d8dfc8 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:53.180956 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f7a21090-d80f-478a-98a8-3d8ff9d8dfc8 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:53.181141 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b0e8341c-40ed-427f-9160-63808c0b959b tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:53.181694 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f7a21090-d80f-478a-98a8-3d8ff9d8dfc8 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:53.184095 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b0e8341c-40ed-427f-9160-63808c0b959b tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:53.185250 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b0e8341c-40ed-427f-9160-63808c0b959b tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/7558d52c-24e7-4115-88f7-ced193819c33" status: 200 len: 1362 microversion: 2.25 time: 0.344886 Jul 23 21:15:53.196016 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 329/720] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:15:52 2022] GET /compute/v2.1/servers/7558d52c-24e7-4115-88f7-ced193819c33 => generated 1362 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:15:53.534420 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-451e69e4-14b2-494b-9804-06a1eed61f43 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:53.535344 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-451e69e4-14b2-494b-9804-06a1eed61f43 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:53.545078 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-451e69e4-14b2-494b-9804-06a1eed61f43 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:53.551787 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-451e69e4-14b2-494b-9804-06a1eed61f43 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:53.553215 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-451e69e4-14b2-494b-9804-06a1eed61f43 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:53.553831 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-451e69e4-14b2-494b-9804-06a1eed61f43 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:53.875328 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-451e69e4-14b2-494b-9804-06a1eed61f43 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:53.889480 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-451e69e4-14b2-494b-9804-06a1eed61f43 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b" status: 200 len: 1504 microversion: 2.1 time: 0.358939 Jul 23 21:15:53.904178 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 330/721] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:53 2022] GET /compute/v2.1/servers/d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b => generated 1504 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:54.056480 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-7fe4555c-701a-4ef9-989f-a400ccc1eecd tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1969326622", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "networks": [{"uuid": "472a8f36-7623-4bc7-b732-b31d10b9dfde"}]}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:15:54.165888 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-7fe4555c-701a-4ef9-989f-a400ccc1eecd tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] validate_networks() for [('472a8f36-7623-4bc7-b732-b31d10b9dfde', None, None, None, None, None)] {{(pid=131320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:15:54.253749 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-f7a21090-d80f-478a-98a8-3d8ff9d8dfc8 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:54.263147 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-f7a21090-d80f-478a-98a8-3d8ff9d8dfc8 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/5bc4befa-252d-456a-92cd-323bad80fcdf" status: 200 len: 1476 microversion: 2.1 time: 1.107474 Jul 23 21:15:54.268131 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 392/722] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:53 2022] GET /compute/v2.1/servers/5bc4befa-252d-456a-92cd-323bad80fcdf => generated 1476 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:54.280401 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-72fc29f4-3bfb-4dc9-b908-e8664622467b tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:54.281033 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-72fc29f4-3bfb-4dc9-b908-e8664622467b tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: da599d16-7a8c-4ced-b129-d692e5b4866f] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:54.312462 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-72fc29f4-3bfb-4dc9-b908-e8664622467b tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:54.319155 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-72fc29f4-3bfb-4dc9-b908-e8664622467b tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:54.320987 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-72fc29f4-3bfb-4dc9-b908-e8664622467b tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:54.321649 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-72fc29f4-3bfb-4dc9-b908-e8664622467b tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:54.711051 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-72fc29f4-3bfb-4dc9-b908-e8664622467b tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf92af08fa94215b4eafcacea6c63f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e7d37a0e3b4b32ae99c3bc15a831e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:54.720985 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-72fc29f4-3bfb-4dc9-b908-e8664622467b tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "GET /compute/v2.1/servers/da599d16-7a8c-4ced-b129-d692e5b4866f" status: 200 len: 1469 microversion: 2.1 time: 0.450433 Jul 23 21:15:54.721572 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 393/723] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:54 2022] GET /compute/v2.1/servers/da599d16-7a8c-4ced-b129-d692e5b4866f => generated 1469 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:54.750958 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-4585c59a-5cb1-4412-89a3-c1306e3a3e27 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:54.754965 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-4585c59a-5cb1-4412-89a3-c1306e3a3e27 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] [instance: 7b12c52a-fc64-472b-8659-4e7312fcc83a] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:54.770289 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4585c59a-5cb1-4412-89a3-c1306e3a3e27 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:54.771036 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4585c59a-5cb1-4412-89a3-c1306e3a3e27 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:54.774819 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4585c59a-5cb1-4412-89a3-c1306e3a3e27 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:54.775500 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4585c59a-5cb1-4412-89a3-c1306e3a3e27 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:54.812216 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-4585c59a-5cb1-4412-89a3-c1306e3a3e27 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] HTTP exception thrown: Instance 7b12c52a-fc64-472b-8659-4e7312fcc83a could not be found. Jul 23 21:15:54.814563 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-4585c59a-5cb1-4412-89a3-c1306e3a3e27 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Request method failure captured: Jul 23 21:15:54.814563 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/servers/7b12c52a-fc64-472b-8659-4e7312fcc83a HTTP/1.1 Jul 23 21:15:54.814563 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:15:54.814563 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:15:54.814563 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:15:54.814563 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:15:54.814563 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:15:54.814563 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:15:54.814563 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:15:54.814563 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:15:54.814563 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GTGWeOhu3zgRHDWycxdv9pjozLbySUQ6z7AMI-iXnP-MSjYiaWSNJUd1t-JIv9ontE64T_hgNfZUN_9_asLyWTnpz2MaHA2twMw47k4DwBs3O_zp7E6nggkabOi39NZ-jizF4_hmKHIj5PYn6LEP1MJOlyCGtVVqxJZ2Q4nlf1CHLY Jul 23 21:15:54.814563 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:15:54.814563 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:15:54.814563 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:15:54.814563 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:15:54.814563 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:15:54.814563 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:15:54.814563 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 457d184c579a4016a0eec16eb9f23195 Jul 23 21:15:54.814563 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-LiveMigrationNegativeTest-645922185 Jul 23 21:15:54.814563 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:15:54.814563 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:15:54.816017 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/457d184c579a4016a0eec16eb9f23195"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/457d184c579a4016a0eec16eb9f23195"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_457d184c579a4016a0eec16eb9f23195", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/457d184c579a4016a0eec16eb9f23195"}]}] Jul 23 21:15:54.816017 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-LiveMigrationNegativeTest-645922185 Jul 23 21:15:54.816017 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 457d184c579a4016a0eec16eb9f23195 Jul 23 21:15:54.816017 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-645922185 Jul 23 21:15:54.816017 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-LiveMigrationNegativeTest-645922185-project Jul 23 21:15:54.816017 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:15:54.816017 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:15:54.816017 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 8a872dad882e4694aba20eaa8c06df53 Jul 23 21:15:54.816017 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-LiveMigrationNegativeTest-645922185-project Jul 23 21:15:54.816017 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:15:54.816017 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance 7b12c52a-fc64-472b-8659-4e7312fcc83a could not be found. Jul 23 21:15:54.816017 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': '7b12c52a-fc64-472b-8659-4e7312fcc83a'} Jul 23 21:15:54.816898 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:15:54.816898 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:15:54.816898 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:15:54.816898 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:15:54.816898 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:15:54.816898 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:15:54.816898 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:15:54.816898 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:15:54.816898 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:15:54.816898 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:15:54.816898 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b12c52a-fc64-472b-8659-4e7312fcc83a could not be found. Jul 23 21:15:54.816898 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:15:54.816898 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:15:54.816898 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:15:54.816898 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:15:54.816898 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:15:54.816898 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:15:54.816898 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:15:54.816898 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:15:54.816898 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:15:54.818374 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:15:54.818374 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:15:54.818374 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:15:54.818374 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:15:54.818374 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:15:54.818374 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:15:54.818374 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:15:54.818374 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b12c52a-fc64-472b-8659-4e7312fcc83a could not be found. Jul 23 21:15:54.818374 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:15:54.818374 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:15:54.818374 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:15:54.818374 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:15:54.818374 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:15:54.818374 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:15:54.818374 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:15:54.818374 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:15:54.818374 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b12c52a-fc64-472b-8659-4e7312fcc83a could not be found. Jul 23 21:15:54.818374 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:15:54.820582 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-4585c59a-5cb1-4412-89a3-c1306e3a3e27 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] Returning 404 to user: Instance 7b12c52a-fc64-472b-8659-4e7312fcc83a could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:15:54.825649 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-4585c59a-5cb1-4412-89a3-c1306e3a3e27 tempest-LiveMigrationNegativeTest-645922185 tempest-LiveMigrationNegativeTest-645922185-project] 10.222.0.17 "GET /compute/v2.1/servers/7b12c52a-fc64-472b-8659-4e7312fcc83a" status: 404 len: 111 microversion: 2.1 time: 0.084254 Jul 23 21:15:54.826890 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 394/724] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:54 2022] GET /compute/v2.1/servers/7b12c52a-fc64-472b-8659-4e7312fcc83a => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:15:54.833116 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-1bda3929-f559-4f10-94b9-991686a37ed4 req-17800e4c-e980-44b9-8015-b0ef4a845d06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7558d52c-24e7-4115-88f7-ced193819c33", "name": "network-vif-plugged", "status": "completed", "tag": "ba673080-c139-468a-94c4-8bd962f254a6"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:15:54.843865 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-1bda3929-f559-4f10-94b9-991686a37ed4 req-17800e4c-e980-44b9-8015-b0ef4a845d06 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:54.844597 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-1bda3929-f559-4f10-94b9-991686a37ed4 req-17800e4c-e980-44b9-8015-b0ef4a845d06 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:54.858840 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-1bda3929-f559-4f10-94b9-991686a37ed4 req-17800e4c-e980-44b9-8015-b0ef4a845d06 service nova] Creating event network-vif-plugged:ba673080-c139-468a-94c4-8bd962f254a6 for instance 7558d52c-24e7-4115-88f7-ced193819c33 on nch1-master-1 Jul 23 21:15:54.864512 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-1bda3929-f559-4f10-94b9-991686a37ed4 req-17800e4c-e980-44b9-8015-b0ef4a845d06 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036188 Jul 23 21:15:54.865345 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 395/725] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:15:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:15:54.873448 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-9c67820d-6629-4e88-91f6-b7245ffc8aa7 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:54.874341 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-9c67820d-6629-4e88-91f6-b7245ffc8aa7 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: 7558d52c-24e7-4115-88f7-ced193819c33] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:54.882221 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9c67820d-6629-4e88-91f6-b7245ffc8aa7 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:54.882960 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9c67820d-6629-4e88-91f6-b7245ffc8aa7 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:54.884011 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9c67820d-6629-4e88-91f6-b7245ffc8aa7 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:54.884595 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9c67820d-6629-4e88-91f6-b7245ffc8aa7 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:54.932166 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:15:55.314598 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-9c67820d-6629-4e88-91f6-b7245ffc8aa7 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:55.328212 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-9c67820d-6629-4e88-91f6-b7245ffc8aa7 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:55.334783 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-9c67820d-6629-4e88-91f6-b7245ffc8aa7 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:55.344067 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-9c67820d-6629-4e88-91f6-b7245ffc8aa7 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/7558d52c-24e7-4115-88f7-ced193819c33" status: 200 len: 1362 microversion: 2.25 time: 0.474759 Jul 23 21:15:55.344984 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 396/726] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:15:54 2022] GET /compute/v2.1/servers/7558d52c-24e7-4115-88f7-ced193819c33 => generated 1362 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:15:55.358336 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-5202dd5a-6061-467e-9bf4-0c71d92a30e3 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:55.371978 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-5202dd5a-6061-467e-9bf4-0c71d92a30e3 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ebf92af08fa94215b4eafcacea6c63f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e7d37a0e3b4b32ae99c3bc15a831e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:55.373532 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-5202dd5a-6061-467e-9bf4-0c71d92a30e3 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Searching by: {'reservation_id': 'r-trg69on0', 'deleted': False, 'project_id': 'f5e7d37a0e3b4b32ae99c3bc15a831e6'} {{(pid=131321) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 23 21:15:55.391830 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5202dd5a-6061-467e-9bf4-0c71d92a30e3 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:55.392639 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5202dd5a-6061-467e-9bf4-0c71d92a30e3 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:55.393653 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5202dd5a-6061-467e-9bf4-0c71d92a30e3 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:55.394293 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5202dd5a-6061-467e-9bf4-0c71d92a30e3 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:55.781833 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.multi_cell_list [None req-5202dd5a-6061-467e-9bf4-0c71d92a30e3 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=131321) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 23 21:15:55.867483 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-7fe4555c-701a-4ef9-989f-a400ccc1eecd tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:15:55.868539 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-7fe4555c-701a-4ef9-989f-a400ccc1eecd tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:15:55.869160 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-7fe4555c-701a-4ef9-989f-a400ccc1eecd tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:15:55.869830 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-7fe4555c-701a-4ef9-989f-a400ccc1eecd tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:15:55.870428 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-7fe4555c-701a-4ef9-989f-a400ccc1eecd tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:15:55.888569 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7fe4555c-701a-4ef9-989f-a400ccc1eecd tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:55.889372 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7fe4555c-701a-4ef9-989f-a400ccc1eecd tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:55.893362 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7fe4555c-701a-4ef9-989f-a400ccc1eecd tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:55.896047 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7fe4555c-701a-4ef9-989f-a400ccc1eecd tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:55.898224 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-5202dd5a-6061-467e-9bf4-0c71d92a30e3 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf92af08fa94215b4eafcacea6c63f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e7d37a0e3b4b32ae99c3bc15a831e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:55.906256 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5202dd5a-6061-467e-9bf4-0c71d92a30e3 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:55.906908 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5202dd5a-6061-467e-9bf4-0c71d92a30e3 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:55.955723 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-7fe4555c-701a-4ef9-989f-a400ccc1eecd tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Getting quotas for project 580ed681cbf44d10936259b17f60f1b2. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:15:55.968213 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-7fe4555c-701a-4ef9-989f-a400ccc1eecd tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Getting quotas for user bb4f9dda4c2a411cb0394bf86e9ae223 and project 580ed681cbf44d10936259b17f60f1b2. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:15:55.989694 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-7fe4555c-701a-4ef9-989f-a400ccc1eecd tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Going to run 1 instances... {{(pid=131320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:15:55.992383 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-7fe4555c-701a-4ef9-989f-a400ccc1eecd tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 9b360b14-9ea2-4336-b32e-d6546267664e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:15:56.070664 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-7fe4555c-701a-4ef9-989f-a400ccc1eecd tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.162609 Jul 23 21:15:56.074338 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 331/727] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:15:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 2169 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 23 21:15:56.082998 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-19f53440-1cea-40dc-b4a7-94741a40aa0c tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:56.084216 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-19f53440-1cea-40dc-b4a7-94741a40aa0c tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:56.104246 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-19f53440-1cea-40dc-b4a7-94741a40aa0c tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:56.105076 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-19f53440-1cea-40dc-b4a7-94741a40aa0c tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:56.107915 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-19f53440-1cea-40dc-b4a7-94741a40aa0c tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:56.110987 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-19f53440-1cea-40dc-b4a7-94741a40aa0c tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:56.207349 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-5202dd5a-6061-467e-9bf4-0c71d92a30e3 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "GET /compute/v2.1/servers/detail?reservation_id=r-trg69on0" status: 200 len: 2931 microversion: 2.1 time: 0.858813 Jul 23 21:15:56.208161 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 397/728] 10.222.0.17 () {58 vars in 1196 bytes} [Sat Jul 23 21:15:55 2022] GET /compute/v2.1/servers/detail?reservation_id=r-trg69on0 => generated 2931 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:56.214032 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-13660c86-71a7-41fd-a64d-54e5a2cb89d1 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:56.214672 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-13660c86-71a7-41fd-a64d-54e5a2cb89d1 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 5bc4befa-252d-456a-92cd-323bad80fcdf] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:56.233083 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-13660c86-71a7-41fd-a64d-54e5a2cb89d1 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:56.233538 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-13660c86-71a7-41fd-a64d-54e5a2cb89d1 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:56.234482 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-13660c86-71a7-41fd-a64d-54e5a2cb89d1 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:56.235219 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-13660c86-71a7-41fd-a64d-54e5a2cb89d1 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:56.353765 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-19f53440-1cea-40dc-b4a7-94741a40aa0c tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:56.381182 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-19f53440-1cea-40dc-b4a7-94741a40aa0c tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b" status: 200 len: 1479 microversion: 2.1 time: 0.305218 Jul 23 21:15:56.384769 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 332/729] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:56 2022] GET /compute/v2.1/servers/d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b => generated 1479 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:56.396282 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a6cc53a9-f726-445c-8280-ef3de4d5b0ae tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:56.397193 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a6cc53a9-f726-445c-8280-ef3de4d5b0ae tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 9b360b14-9ea2-4336-b32e-d6546267664e] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:56.589845 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a6cc53a9-f726-445c-8280-ef3de4d5b0ae tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4f9dda4c2a411cb0394bf86e9ae223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580ed681cbf44d10936259b17f60f1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:56.610446 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a6cc53a9-f726-445c-8280-ef3de4d5b0ae tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/servers/9b360b14-9ea2-4336-b32e-d6546267664e" status: 200 len: 1208 microversion: 2.1 time: 0.213522 Jul 23 21:15:56.613076 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 333/730] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:56 2022] GET /compute/v2.1/servers/9b360b14-9ea2-4336-b32e-d6546267664e => generated 1208 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:56.618728 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-040f39d6-16b7-43c3-a41c-58c2f7d6b64a tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:56.648180 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.compute.server_groups [None req-040f39d6-16b7-43c3-a41c-58c2f7d6b64a tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Querying cell 4e90cb14-d4b2-4158-b8cf-a592a1314a7b(cell1) for 2 instances {{(pid=131320) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 23 21:15:56.649274 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-040f39d6-16b7-43c3-a41c-58c2f7d6b64a tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:56.650043 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-040f39d6-16b7-43c3-a41c-58c2f7d6b64a tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:56.699256 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-040f39d6-16b7-43c3-a41c-58c2f7d6b64a tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "GET /compute/v2.1/os-server-groups/b40e815e-b69f-4380-9032-d2af05d5a157" status: 200 len: 265 microversion: 2.1 time: 0.083702 Jul 23 21:15:56.706943 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 334/731] 10.222.0.17 () {58 vars in 1262 bytes} [Sat Jul 23 21:15:56 2022] GET /compute/v2.1/os-server-groups/b40e815e-b69f-4380-9032-d2af05d5a157 => generated 265 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:15:56.721067 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1a56aec9-d224-4dd1-bc83-a3c35a2d7c7c tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:56.722931 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1a56aec9-d224-4dd1-bc83-a3c35a2d7c7c tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: 7558d52c-24e7-4115-88f7-ced193819c33] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:56.743937 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1a56aec9-d224-4dd1-bc83-a3c35a2d7c7c tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:56.745169 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1a56aec9-d224-4dd1-bc83-a3c35a2d7c7c tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:56.748947 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1a56aec9-d224-4dd1-bc83-a3c35a2d7c7c tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:56.749678 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1a56aec9-d224-4dd1-bc83-a3c35a2d7c7c tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:57.090860 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-13660c86-71a7-41fd-a64d-54e5a2cb89d1 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:57.102465 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-13660c86-71a7-41fd-a64d-54e5a2cb89d1 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/5bc4befa-252d-456a-92cd-323bad80fcdf" status: 200 len: 1476 microversion: 2.1 time: 0.889901 Jul 23 21:15:57.103240 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 398/732] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:56 2022] GET /compute/v2.1/servers/5bc4befa-252d-456a-92cd-323bad80fcdf => generated 1476 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:57.105171 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-1a56aec9-d224-4dd1-bc83-a3c35a2d7c7c tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:57.114313 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-38bf2ea8-97f6-4a07-babd-a8f452b8e4a6 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Calling method '.version_select at 0x7f0b544a7ca0>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:57.116814 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-1a56aec9-d224-4dd1-bc83-a3c35a2d7c7c tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:57.122708 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-1a56aec9-d224-4dd1-bc83-a3c35a2d7c7c tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:57.124038 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-38bf2ea8-97f6-4a07-babd-a8f452b8e4a6 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:57.125424 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-38bf2ea8-97f6-4a07-babd-a8f452b8e4a6 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:57.128970 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1a56aec9-d224-4dd1-bc83-a3c35a2d7c7c tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/7558d52c-24e7-4115-88f7-ced193819c33" status: 200 len: 1362 microversion: 2.25 time: 0.419746 Jul 23 21:15:57.131664 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 335/733] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:15:56 2022] GET /compute/v2.1/servers/7558d52c-24e7-4115-88f7-ced193819c33 => generated 1362 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:15:57.136499 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-03e12cde-a6ff-48e8-b17e-334048ecc134 tempest-ServersOnMultiNodesTest-1671986198 tempest-ServersOnMultiNodesTest-1671986198-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:57.140452 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-03e12cde-a6ff-48e8-b17e-334048ecc134 tempest-ServersOnMultiNodesTest-1671986198 tempest-ServersOnMultiNodesTest-1671986198-project-admin] [instance: f299d55c-90a4-41cc-98a8-e14ca5964eb1] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:57.168777 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-38bf2ea8-97f6-4a07-babd-a8f452b8e4a6 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] 10.222.0.17 "GET /compute/v2.1/os-migrations" status: 200 len: 1954 microversion: 2.1 time: 0.064227 Jul 23 21:15:57.172422 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 399/734] 10.222.0.17 () {58 vars in 1142 bytes} [Sat Jul 23 21:15:57 2022] GET /compute/v2.1/os-migrations => generated 1954 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:57.180980 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-03e12cde-a6ff-48e8-b17e-334048ecc134 tempest-ServersOnMultiNodesTest-1671986198 tempest-ServersOnMultiNodesTest-1671986198-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:57.182973 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-03e12cde-a6ff-48e8-b17e-334048ecc134 tempest-ServersOnMultiNodesTest-1671986198 tempest-ServersOnMultiNodesTest-1671986198-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:57.184670 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-82698c96-d329-4bb1-a2f6-2aa65b45c420 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:57.185990 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-03e12cde-a6ff-48e8-b17e-334048ecc134 tempest-ServersOnMultiNodesTest-1671986198 tempest-ServersOnMultiNodesTest-1671986198-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:57.186832 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-03e12cde-a6ff-48e8-b17e-334048ecc134 tempest-ServersOnMultiNodesTest-1671986198 tempest-ServersOnMultiNodesTest-1671986198-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:57.190314 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-82698c96-d329-4bb1-a2f6-2aa65b45c420 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] [instance: d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:57.203738 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-82698c96-d329-4bb1-a2f6-2aa65b45c420 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:57.208565 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-82698c96-d329-4bb1-a2f6-2aa65b45c420 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:57.209770 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-82698c96-d329-4bb1-a2f6-2aa65b45c420 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:57.212646 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-82698c96-d329-4bb1-a2f6-2aa65b45c420 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:57.515154 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-82698c96-d329-4bb1-a2f6-2aa65b45c420 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b" status: 200 len: 1630 microversion: 2.1 time: 0.336138 Jul 23 21:15:57.516176 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 400/735] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:57 2022] GET /compute/v2.1/servers/d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b => generated 1630 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:57.546963 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f02e0ee7-c1b5-46ed-8428-cb92310474d4 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Action: 'create', calling method: .version_select at 0x7f0b541e8160>, body: {"keypair": {"name": "tempest-keypair-1830557801", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDeUdNhh5ic4nr5zEgKjzyA3MvmutG8MsSmIgtPouLV7UjDNWuTfMKClr/fV1JvDjW4rHUjsS0arYBeW6+O3EWZpBpBmOYOLAhzZgEBEAsveEtSRO7rY8+Xls+gwcsNutg=="}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:15:57.562196 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-03e12cde-a6ff-48e8-b17e-334048ecc134 tempest-ServersOnMultiNodesTest-1671986198 tempest-ServersOnMultiNodesTest-1671986198-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/f299d55c-90a4-41cc-98a8-e14ca5964eb1" status: 200 len: 1620 microversion: 2.1 time: 0.429204 Jul 23 21:15:57.576422 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-f02e0ee7-c1b5-46ed-8428-cb92310474d4 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Getting quotas for project 6610a2359aa64f89befcf72e4f3f6a54. Resources: {'key_pairs'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:15:57.580959 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 336/736] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:57 2022] GET /compute/v2.1/servers/f299d55c-90a4-41cc-98a8-e14ca5964eb1 => generated 1620 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:57.588544 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5af106e1-d2fb-4085-ae52-168063de38af tempest-ServersOnMultiNodesTest-1671986198 tempest-ServersOnMultiNodesTest-1671986198-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:57.589527 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5af106e1-d2fb-4085-ae52-168063de38af tempest-ServersOnMultiNodesTest-1671986198 tempest-ServersOnMultiNodesTest-1671986198-project-admin] [instance: da599d16-7a8c-4ced-b129-d692e5b4866f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:57.594057 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-f02e0ee7-c1b5-46ed-8428-cb92310474d4 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Getting quotas for user f2672c5db79b4a48a505c3df536594dd and project 6610a2359aa64f89befcf72e4f3f6a54. Resources: {'key_pairs'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:15:57.597592 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5af106e1-d2fb-4085-ae52-168063de38af tempest-ServersOnMultiNodesTest-1671986198 tempest-ServersOnMultiNodesTest-1671986198-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:57.598137 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5af106e1-d2fb-4085-ae52-168063de38af tempest-ServersOnMultiNodesTest-1671986198 tempest-ServersOnMultiNodesTest-1671986198-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:57.600462 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5af106e1-d2fb-4085-ae52-168063de38af tempest-ServersOnMultiNodesTest-1671986198 tempest-ServersOnMultiNodesTest-1671986198-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:57.600819 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5af106e1-d2fb-4085-ae52-168063de38af tempest-ServersOnMultiNodesTest-1671986198 tempest-ServersOnMultiNodesTest-1671986198-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:57.608581 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=100 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:15:57.657008 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-f02e0ee7-c1b5-46ed-8428-cb92310474d4 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.114124 Jul 23 21:15:57.657636 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 401/737] 10.222.0.17 () {60 vars in 1158 bytes} [Sat Jul 23 21:15:57 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:15:57.669676 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-433cacdb-765b-4243-a837-8b2b45695106 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:57.670363 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-433cacdb-765b-4243-a837-8b2b45695106 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 9b360b14-9ea2-4336-b32e-d6546267664e] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:57.689724 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-433cacdb-765b-4243-a837-8b2b45695106 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:57.690208 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-433cacdb-765b-4243-a837-8b2b45695106 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:57.690998 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-433cacdb-765b-4243-a837-8b2b45695106 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:57.698269 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-433cacdb-765b-4243-a837-8b2b45695106 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:57.843591 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-433cacdb-765b-4243-a837-8b2b45695106 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4f9dda4c2a411cb0394bf86e9ae223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580ed681cbf44d10936259b17f60f1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:57.903790 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-433cacdb-765b-4243-a837-8b2b45695106 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/servers/9b360b14-9ea2-4336-b32e-d6546267664e" status: 200 len: 1260 microversion: 2.1 time: 0.241390 Jul 23 21:15:57.905849 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 402/738] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:57 2022] GET /compute/v2.1/servers/9b360b14-9ea2-4336-b32e-d6546267664e => generated 1260 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:58.013575 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5af106e1-d2fb-4085-ae52-168063de38af tempest-ServersOnMultiNodesTest-1671986198 tempest-ServersOnMultiNodesTest-1671986198-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/da599d16-7a8c-4ced-b129-d692e5b4866f" status: 200 len: 1620 microversion: 2.1 time: 0.431334 Jul 23 21:15:58.022555 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 337/739] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:57 2022] GET /compute/v2.1/servers/da599d16-7a8c-4ced-b129-d692e5b4866f => generated 1620 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:58.047711 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-1ff3d138-02a8-459b-8b42-d3e172a73a49 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Action: 'create', calling method: .version_select at 0x7f0b5410df70>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-2000421450", "policies": ["anti-affinity"]}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:15:58.079828 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-1ff3d138-02a8-459b-8b42-d3e172a73a49 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Getting quotas for project f5e7d37a0e3b4b32ae99c3bc15a831e6. Resources: {'server_groups'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:15:58.090291 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-1ff3d138-02a8-459b-8b42-d3e172a73a49 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Getting quotas for user ebf92af08fa94215b4eafcacea6c63f6 and project f5e7d37a0e3b4b32ae99c3bc15a831e6. Resources: {'server_groups'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:15:58.119151 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-7c0029fa-5a89-48c0-8592-317e388180cb tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:58.119843 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-7c0029fa-5a89-48c0-8592-317e388180cb tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 5bc4befa-252d-456a-92cd-323bad80fcdf] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:58.134776 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7c0029fa-5a89-48c0-8592-317e388180cb tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:58.138934 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7c0029fa-5a89-48c0-8592-317e388180cb tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:58.141324 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7c0029fa-5a89-48c0-8592-317e388180cb tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:58.141944 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7c0029fa-5a89-48c0-8592-317e388180cb tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:58.194413 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-1ff3d138-02a8-459b-8b42-d3e172a73a49 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Getting quotas for project f5e7d37a0e3b4b32ae99c3bc15a831e6. Resources: {'server_groups'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:15:58.261963 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-1ff3d138-02a8-459b-8b42-d3e172a73a49 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Getting quotas for user ebf92af08fa94215b4eafcacea6c63f6 and project f5e7d37a0e3b4b32ae99c3bc15a831e6. Resources: {'server_groups'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:15:58.331848 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-1ff3d138-02a8-459b-8b42-d3e172a73a49 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.290663 Jul 23 21:15:58.343680 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 403/740] 10.222.0.17 () {60 vars in 1173 bytes} [Sat Jul 23 21:15:58 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:15:58.350609 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-2d43d9f8-f079-4991-98b1-5c3383ae2c99 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:58.351837 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-2d43d9f8-f079-4991-98b1-5c3383ae2c99 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: 7558d52c-24e7-4115-88f7-ced193819c33] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:58.360439 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2d43d9f8-f079-4991-98b1-5c3383ae2c99 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:58.361212 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2d43d9f8-f079-4991-98b1-5c3383ae2c99 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:58.362221 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2d43d9f8-f079-4991-98b1-5c3383ae2c99 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:58.363795 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2d43d9f8-f079-4991-98b1-5c3383ae2c99 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:58.839443 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-7c0029fa-5a89-48c0-8592-317e388180cb tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:58.857907 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-7c0029fa-5a89-48c0-8592-317e388180cb tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/5bc4befa-252d-456a-92cd-323bad80fcdf" status: 200 len: 1476 microversion: 2.1 time: 0.742731 Jul 23 21:15:58.868037 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 338/741] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:58 2022] GET /compute/v2.1/servers/5bc4befa-252d-456a-92cd-323bad80fcdf => generated 1476 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:15:58.873092 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ee434381-91bc-489f-9023-9af03aa40585 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-820977118", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "cf87636d-b698-4ed9-b104-f097f98fabbc"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:15:58.961086 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-ee434381-91bc-489f-9023-9af03aa40585 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] validate_networks() for None {{(pid=131320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:15:58.986570 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-2d43d9f8-f079-4991-98b1-5c3383ae2c99 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:59.002280 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-2d43d9f8-f079-4991-98b1-5c3383ae2c99 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:59.004872 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-2d43d9f8-f079-4991-98b1-5c3383ae2c99 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:59.009237 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-2d43d9f8-f079-4991-98b1-5c3383ae2c99 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/7558d52c-24e7-4115-88f7-ced193819c33" status: 200 len: 1559 microversion: 2.25 time: 0.663872 Jul 23 21:15:59.011440 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 404/742] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:15:58 2022] GET /compute/v2.1/servers/7558d52c-24e7-4115-88f7-ced193819c33 => generated 1559 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:15:59.020896 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-71802323-cfb9-48b2-a1f9-1a02083fab0b tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:59.034335 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-71802323-cfb9-48b2-a1f9-1a02083fab0b tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 9b360b14-9ea2-4336-b32e-d6546267664e] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:59.045044 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-71802323-cfb9-48b2-a1f9-1a02083fab0b tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:59.046036 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-71802323-cfb9-48b2-a1f9-1a02083fab0b tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:59.064280 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-71802323-cfb9-48b2-a1f9-1a02083fab0b tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:59.065417 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-71802323-cfb9-48b2-a1f9-1a02083fab0b tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:59.253500 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-71802323-cfb9-48b2-a1f9-1a02083fab0b tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4f9dda4c2a411cb0394bf86e9ae223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580ed681cbf44d10936259b17f60f1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:15:59.266930 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-71802323-cfb9-48b2-a1f9-1a02083fab0b tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/servers/9b360b14-9ea2-4336-b32e-d6546267664e" status: 200 len: 1266 microversion: 2.1 time: 0.253541 Jul 23 21:15:59.268048 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 405/743] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:59 2022] GET /compute/v2.1/servers/9b360b14-9ea2-4336-b32e-d6546267664e => generated 1266 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:15:59.273903 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-8320aece-d135-43f7-9aae-66e58886005c tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:59.274540 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-8320aece-d135-43f7-9aae-66e58886005c tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] [instance: 7558d52c-24e7-4115-88f7-ced193819c33] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:59.283842 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8320aece-d135-43f7-9aae-66e58886005c tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:59.284643 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8320aece-d135-43f7-9aae-66e58886005c tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:59.286266 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8320aece-d135-43f7-9aae-66e58886005c tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:59.287031 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8320aece-d135-43f7-9aae-66e58886005c tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:59.479354 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.objects.instance [None req-8320aece-d135-43f7-9aae-66e58886005c tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lazy-loading 'services' on Instance uuid 7558d52c-24e7-4115-88f7-ced193819c33 {{(pid=131321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:15:59.516068 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-8320aece-d135-43f7-9aae-66e58886005c tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/7558d52c-24e7-4115-88f7-ced193819c33" status: 200 len: 2052 microversion: 2.25 time: 0.246820 Jul 23 21:15:59.516954 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 406/744] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:15:59 2022] GET /compute/v2.1/servers/7558d52c-24e7-4115-88f7-ced193819c33 => generated 2052 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:15:59.536549 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-afc65ca5-bec9-4c73-b159-913c1b58af41 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:59.537184 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-afc65ca5-bec9-4c73-b159-913c1b58af41 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] [instance: 7558d52c-24e7-4115-88f7-ced193819c33] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:59.554659 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-ee434381-91bc-489f-9023-9af03aa40585 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:15:59.555408 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-ee434381-91bc-489f-9023-9af03aa40585 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:15:59.555726 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-ee434381-91bc-489f-9023-9af03aa40585 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:15:59.556342 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-ee434381-91bc-489f-9023-9af03aa40585 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:15:59.557111 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-ee434381-91bc-489f-9023-9af03aa40585 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:15:59.563004 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-afc65ca5-bec9-4c73-b159-913c1b58af41 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:59.569386 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-afc65ca5-bec9-4c73-b159-913c1b58af41 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:59.585207 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-afc65ca5-bec9-4c73-b159-913c1b58af41 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:59.589310 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-afc65ca5-bec9-4c73-b159-913c1b58af41 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:59.642868 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ee434381-91bc-489f-9023-9af03aa40585 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:59.643349 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ee434381-91bc-489f-9023-9af03aa40585 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:59.647220 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ee434381-91bc-489f-9023-9af03aa40585 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:59.647799 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ee434381-91bc-489f-9023-9af03aa40585 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:59.703206 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-ee434381-91bc-489f-9023-9af03aa40585 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Getting quotas for project f5e7d37a0e3b4b32ae99c3bc15a831e6. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:15:59.718990 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-ee434381-91bc-489f-9023-9af03aa40585 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Getting quotas for user ebf92af08fa94215b4eafcacea6c63f6 and project f5e7d37a0e3b4b32ae99c3bc15a831e6. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:15:59.758465 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ee434381-91bc-489f-9023-9af03aa40585 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Going to run 2 instances... {{(pid=131320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:15:59.768913 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ee434381-91bc-489f-9023-9af03aa40585 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: 5bbeec29-35ee-44ca-a0f0-3dbe2198e5bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:15:59.853507 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-ee434381-91bc-489f-9023-9af03aa40585 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=131320) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Jul 23 21:15:59.896663 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-ee434381-91bc-489f-9023-9af03aa40585 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Getting quotas for project f5e7d37a0e3b4b32ae99c3bc15a831e6. Resources: {'server_group_members'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:15:59.903578 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-ee434381-91bc-489f-9023-9af03aa40585 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Getting quotas for user ebf92af08fa94215b4eafcacea6c63f6 and project f5e7d37a0e3b4b32ae99c3bc15a831e6. Resources: {'server_group_members'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:15:59.917805 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.objects.instance [None req-afc65ca5-bec9-4c73-b159-913c1b58af41 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lazy-loading 'services' on Instance uuid 7558d52c-24e7-4115-88f7-ced193819c33 {{(pid=131321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:15:59.948569 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-afc65ca5-bec9-4c73-b159-913c1b58af41 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/7558d52c-24e7-4115-88f7-ced193819c33" status: 200 len: 2052 microversion: 2.25 time: 0.417842 Jul 23 21:15:59.949789 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 407/745] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:15:59 2022] GET /compute/v2.1/servers/7558d52c-24e7-4115-88f7-ced193819c33 => generated 2052 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:15:59.966720 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d1964a15-1a87-4958-9d3c-e42cae0dfbfc tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:15:59.976415 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-d1964a15-1a87-4958-9d3c-e42cae0dfbfc tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 5bc4befa-252d-456a-92cd-323bad80fcdf] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:15:59.988385 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d1964a15-1a87-4958-9d3c-e42cae0dfbfc tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:59.988846 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d1964a15-1a87-4958-9d3c-e42cae0dfbfc tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:15:59.989638 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d1964a15-1a87-4958-9d3c-e42cae0dfbfc tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:15:59.990112 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d1964a15-1a87-4958-9d3c-e42cae0dfbfc tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:00.018057 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-ee434381-91bc-489f-9023-9af03aa40585 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Getting quotas for project f5e7d37a0e3b4b32ae99c3bc15a831e6. Resources: {'server_group_members'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:16:00.024635 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-ee434381-91bc-489f-9023-9af03aa40585 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Getting quotas for user ebf92af08fa94215b4eafcacea6c63f6 and project f5e7d37a0e3b4b32ae99c3bc15a831e6. Resources: {'server_group_members'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:16:00.060952 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ee434381-91bc-489f-9023-9af03aa40585 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: 36204b8b-c78e-447c-a3e7-f1f22c6ffe1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=5bbeec29-35ee-44ca-a0f0-3dbe2198e5bf,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:16:00.131759 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:16:00.145026 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-ee434381-91bc-489f-9023-9af03aa40585 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Getting quotas for project f5e7d37a0e3b4b32ae99c3bc15a831e6. Resources: {'server_group_members'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:16:00.152468 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-ee434381-91bc-489f-9023-9af03aa40585 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Getting quotas for user ebf92af08fa94215b4eafcacea6c63f6 and project f5e7d37a0e3b4b32ae99c3bc15a831e6. Resources: {'server_group_members'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:16:00.204999 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-ee434381-91bc-489f-9023-9af03aa40585 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Getting quotas for project f5e7d37a0e3b4b32ae99c3bc15a831e6. Resources: {'server_group_members'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:16:00.217357 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-ee434381-91bc-489f-9023-9af03aa40585 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Getting quotas for user ebf92af08fa94215b4eafcacea6c63f6 and project f5e7d37a0e3b4b32ae99c3bc15a831e6. Resources: {'server_group_members'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:16:00.247982 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-d1964a15-1a87-4958-9d3c-e42cae0dfbfc tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:00.260585 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-d1964a15-1a87-4958-9d3c-e42cae0dfbfc tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/5bc4befa-252d-456a-92cd-323bad80fcdf" status: 200 len: 1476 microversion: 2.1 time: 0.309282 Jul 23 21:16:00.263720 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 408/746] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:15:59 2022] GET /compute/v2.1/servers/5bc4befa-252d-456a-92cd-323bad80fcdf => generated 1476 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:00.275245 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f94ec288-441e-4f7c-be7b-3dfc45da32d1 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:00.276918 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:16:00.276918 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:16:00.279882 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f94ec288-441e-4f7c-be7b-3dfc45da32d1 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:00.280407 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f94ec288-441e-4f7c-be7b-3dfc45da32d1 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:00.281465 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ee434381-91bc-489f-9023-9af03aa40585 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.412210 Jul 23 21:16:00.282015 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f94ec288-441e-4f7c-be7b-3dfc45da32d1 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:00.282675 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f94ec288-441e-4f7c-be7b-3dfc45da32d1 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:00.286531 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 339/747] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:15:58 2022] POST /compute/v2.1/servers => generated 32 bytes in 1418 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jul 23 21:16:00.293547 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-94c8bce9-6768-45ae-8290-3255662724c7 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:00.295066 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-94c8bce9-6768-45ae-8290-3255662724c7 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 9b360b14-9ea2-4336-b32e-d6546267664e] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:00.302623 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:16:00.305086 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-94c8bce9-6768-45ae-8290-3255662724c7 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:00.305840 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-94c8bce9-6768-45ae-8290-3255662724c7 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:00.308067 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-94c8bce9-6768-45ae-8290-3255662724c7 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:00.308874 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-94c8bce9-6768-45ae-8290-3255662724c7 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:00.328336 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-f94ec288-441e-4f7c-be7b-3dfc45da32d1 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.062918 Jul 23 21:16:00.329155 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 409/748] 10.222.0.17 () {60 vars in 1216 bytes} [Sat Jul 23 21:16:00 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 23 21:16:00.337911 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-3012d0e5-d27d-4d71-819f-30a02dfb2588 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:00.342446 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-3012d0e5-d27d-4d71-819f-30a02dfb2588 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ebf92af08fa94215b4eafcacea6c63f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e7d37a0e3b4b32ae99c3bc15a831e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:00.343431 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-3012d0e5-d27d-4d71-819f-30a02dfb2588 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Searching by: {'deleted': False, 'project_id': 'f5e7d37a0e3b4b32ae99c3bc15a831e6'} {{(pid=131321) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 23 21:16:00.365548 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3012d0e5-d27d-4d71-819f-30a02dfb2588 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:00.366342 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3012d0e5-d27d-4d71-819f-30a02dfb2588 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:00.367253 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3012d0e5-d27d-4d71-819f-30a02dfb2588 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:00.367791 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3012d0e5-d27d-4d71-819f-30a02dfb2588 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:00.403495 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.multi_cell_list [None req-3012d0e5-d27d-4d71-819f-30a02dfb2588 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=131321) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 23 21:16:00.459205 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-3012d0e5-d27d-4d71-819f-30a02dfb2588 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "GET /compute/v2.1/servers" status: 200 len: 1664 microversion: 2.1 time: 0.127742 Jul 23 21:16:00.461479 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 410/749] 10.222.0.17 () {58 vars in 1124 bytes} [Sat Jul 23 21:16:00 2022] GET /compute/v2.1/servers => generated 1664 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:00.468244 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-cf1acc62-d640-4c17-bf08-432c52433553 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:16:00.469366 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-cf1acc62-d640-4c17-bf08-432c52433553 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] [instance: 7558d52c-24e7-4115-88f7-ced193819c33] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:00.477988 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cf1acc62-d640-4c17-bf08-432c52433553 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:00.478950 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cf1acc62-d640-4c17-bf08-432c52433553 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:00.480482 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cf1acc62-d640-4c17-bf08-432c52433553 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:00.481521 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cf1acc62-d640-4c17-bf08-432c52433553 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:00.608574 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-cf1acc62-d640-4c17-bf08-432c52433553 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/7558d52c-24e7-4115-88f7-ced193819c33/action" status: 202 len: 0 microversion: 2.25 time: 0.142629 Jul 23 21:16:00.609348 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 411/750] 10.222.0.17 () {62 vars in 1318 bytes} [Sat Jul 23 21:16:00 2022] POST /compute/v2.1/servers/7558d52c-24e7-4115-88f7-ced193819c33/action => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:16:00.620764 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-2cb063e1-750d-4052-8b09-c17a16106a30 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:00.628674 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-2cb063e1-750d-4052-8b09-c17a16106a30 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: 36204b8b-c78e-447c-a3e7-f1f22c6ffe1f] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:00.740651 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-94c8bce9-6768-45ae-8290-3255662724c7 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4f9dda4c2a411cb0394bf86e9ae223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580ed681cbf44d10936259b17f60f1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:00.746350 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-2cb063e1-750d-4052-8b09-c17a16106a30 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf92af08fa94215b4eafcacea6c63f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e7d37a0e3b4b32ae99c3bc15a831e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:00.753614 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-94c8bce9-6768-45ae-8290-3255662724c7 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/servers/9b360b14-9ea2-4336-b32e-d6546267664e" status: 200 len: 1308 microversion: 2.1 time: 0.465783 Jul 23 21:16:00.754361 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-2cb063e1-750d-4052-8b09-c17a16106a30 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "GET /compute/v2.1/servers/36204b8b-c78e-447c-a3e7-f1f22c6ffe1f" status: 200 len: 1218 microversion: 2.1 time: 0.142853 Jul 23 21:16:00.754512 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 340/751] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:16:00 2022] GET /compute/v2.1/servers/9b360b14-9ea2-4336-b32e-d6546267664e => generated 1308 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:00.764082 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f9d4d80a-15d5-4392-82fa-e189740040bb tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:00.764082 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f9d4d80a-15d5-4392-82fa-e189740040bb tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] [instance: 7558d52c-24e7-4115-88f7-ced193819c33] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:00.764424 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 412/752] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:16:00 2022] GET /compute/v2.1/servers/36204b8b-c78e-447c-a3e7-f1f22c6ffe1f => generated 1218 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:00.766720 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f9d4d80a-15d5-4392-82fa-e189740040bb tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:00.767171 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f9d4d80a-15d5-4392-82fa-e189740040bb tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:00.768043 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f9d4d80a-15d5-4392-82fa-e189740040bb tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:00.768550 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f9d4d80a-15d5-4392-82fa-e189740040bb tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:01.085002 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-3ad01fc2-c4cd-43da-913c-7925f5889811 tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] Calling method '.version_select at 0x7f0b5469e8b0>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:01.206006 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.objects.instance [None req-f9d4d80a-15d5-4392-82fa-e189740040bb tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lazy-loading 'services' on Instance uuid 7558d52c-24e7-4115-88f7-ced193819c33 {{(pid=131320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:16:01.266127 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-3ad01fc2-c4cd-43da-913c-7925f5889811 tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] 10.222.0.17 "GET /compute/v2.1/os-quota-sets/eef12e9221c04a6cbee380b903a30363" status: 200 len: 371 microversion: 2.1 time: 0.500196 Jul 23 21:16:01.268196 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 413/753] 10.222.0.17 () {58 vars in 1241 bytes} [Sat Jul 23 21:16:00 2022] GET /compute/v2.1/os-quota-sets/eef12e9221c04a6cbee380b903a30363 => generated 371 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:16:01.284316 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e9553e58-bf0c-473e-89d7-d66ad379fe2e tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:01.285042 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-e9553e58-bf0c-473e-89d7-d66ad379fe2e tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 5bc4befa-252d-456a-92cd-323bad80fcdf] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:01.311346 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e9553e58-bf0c-473e-89d7-d66ad379fe2e tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:01.312218 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e9553e58-bf0c-473e-89d7-d66ad379fe2e tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:01.313605 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e9553e58-bf0c-473e-89d7-d66ad379fe2e tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:01.314465 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e9553e58-bf0c-473e-89d7-d66ad379fe2e tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:01.539259 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f9d4d80a-15d5-4392-82fa-e189740040bb tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/7558d52c-24e7-4115-88f7-ced193819c33" status: 200 len: 2057 microversion: 2.25 time: 0.783422 Jul 23 21:16:01.542108 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 341/754] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:16:00 2022] GET /compute/v2.1/servers/7558d52c-24e7-4115-88f7-ced193819c33 => generated 2057 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:16:01.547942 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-100e996f-2e55-400b-afd1-de4ddf54f999 tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] Action: 'update', calling method: .version_select at 0x7f0b47bac700>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:16:01.623998 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-e9553e58-bf0c-473e-89d7-d66ad379fe2e tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:01.639861 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-e9553e58-bf0c-473e-89d7-d66ad379fe2e tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/5bc4befa-252d-456a-92cd-323bad80fcdf" status: 200 len: 1476 microversion: 2.1 time: 0.363739 Jul 23 21:16:01.650394 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 414/755] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:16:01 2022] GET /compute/v2.1/servers/5bc4befa-252d-456a-92cd-323bad80fcdf => generated 1476 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:01.762976 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-100e996f-2e55-400b-afd1-de4ddf54f999 tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:01.764828 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-100e996f-2e55-400b-afd1-de4ddf54f999 tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:01.766556 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-100e996f-2e55-400b-afd1-de4ddf54f999 tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:01.767008 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-100e996f-2e55-400b-afd1-de4ddf54f999 tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:01.771698 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-7af1d91c-1a48-4de6-9ea2-8930a005c7eb tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:01.772530 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-7af1d91c-1a48-4de6-9ea2-8930a005c7eb tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 9b360b14-9ea2-4336-b32e-d6546267664e] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:01.778949 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7af1d91c-1a48-4de6-9ea2-8930a005c7eb tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:01.779648 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7af1d91c-1a48-4de6-9ea2-8930a005c7eb tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:01.780689 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7af1d91c-1a48-4de6-9ea2-8930a005c7eb tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:01.781446 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7af1d91c-1a48-4de6-9ea2-8930a005c7eb tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:01.805249 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:16:01.881053 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-100e996f-2e55-400b-afd1-de4ddf54f999 tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-quota-sets/eef12e9221c04a6cbee380b903a30363" status: 200 len: 328 microversion: 2.1 time: 0.336518 Jul 23 21:16:01.881958 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 342/756] 10.222.0.17 () {60 vars in 1261 bytes} [Sat Jul 23 21:16:01 2022] PUT /compute/v2.1/os-quota-sets/eef12e9221c04a6cbee380b903a30363 => generated 328 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:16:01.888550 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-72a8c952-ae3c-443f-bf35-be51452ce9aa tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:01.890091 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-72a8c952-ae3c-443f-bf35-be51452ce9aa tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: 36204b8b-c78e-447c-a3e7-f1f22c6ffe1f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:01.906865 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-72a8c952-ae3c-443f-bf35-be51452ce9aa tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:01.907925 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-72a8c952-ae3c-443f-bf35-be51452ce9aa tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:01.909526 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-72a8c952-ae3c-443f-bf35-be51452ce9aa tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:01.910650 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-72a8c952-ae3c-443f-bf35-be51452ce9aa tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:02.019239 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-7af1d91c-1a48-4de6-9ea2-8930a005c7eb tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4f9dda4c2a411cb0394bf86e9ae223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580ed681cbf44d10936259b17f60f1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:02.029245 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-7af1d91c-1a48-4de6-9ea2-8930a005c7eb tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/servers/9b360b14-9ea2-4336-b32e-d6546267664e" status: 200 len: 1308 microversion: 2.1 time: 0.261770 Jul 23 21:16:02.029363 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 415/757] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:16:01 2022] GET /compute/v2.1/servers/9b360b14-9ea2-4336-b32e-d6546267664e => generated 1308 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:16:02.129443 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-72a8c952-ae3c-443f-bf35-be51452ce9aa tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf92af08fa94215b4eafcacea6c63f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e7d37a0e3b4b32ae99c3bc15a831e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:02.140147 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-72a8c952-ae3c-443f-bf35-be51452ce9aa tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "GET /compute/v2.1/servers/36204b8b-c78e-447c-a3e7-f1f22c6ffe1f" status: 200 len: 1270 microversion: 2.1 time: 0.256767 Jul 23 21:16:02.142322 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c111db66-a9ac-481d-9893-7f7e9f55a469 tempest-QuotasAdminNegativeTest-1955886607 tempest-QuotasAdminNegativeTest-1955886607-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1516365087", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:16:02.156915 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 343/758] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:16:01 2022] GET /compute/v2.1/servers/36204b8b-c78e-447c-a3e7-f1f22c6ffe1f => generated 1270 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:02.250261 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.network.neutron [None req-c111db66-a9ac-481d-9893-7f7e9f55a469 tempest-QuotasAdminNegativeTest-1955886607 tempest-QuotasAdminNegativeTest-1955886607-project] validate_networks() for None {{(pid=131321) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:16:02.331010 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a302c38c-e84d-4e3d-a1cf-5ffdcb003b0f tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-789688553", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "networks": [{"uuid": "dfe0034d-5d2d-4ce5-b256-d87bd84ec0c2"}], "security_groups": [{"name": "tempest-securitygroup--657236108"}], "key_name": "tempest-keypair-1830557801", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:16:02.676199 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-a302c38c-e84d-4e3d-a1cf-5ffdcb003b0f tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] validate_networks() for [('dfe0034d-5d2d-4ce5-b256-d87bd84ec0c2', None, None, None, None, None)] {{(pid=131320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:16:03.053723 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-c111db66-a9ac-481d-9893-7f7e9f55a469 tempest-QuotasAdminNegativeTest-1955886607 tempest-QuotasAdminNegativeTest-1955886607-project] Flavor limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:16:03.054974 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-c111db66-a9ac-481d-9893-7f7e9f55a469 tempest-QuotasAdminNegativeTest-1955886607 tempest-QuotasAdminNegativeTest-1955886607-project] Image limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:16:03.055600 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-c111db66-a9ac-481d-9893-7f7e9f55a469 tempest-QuotasAdminNegativeTest-1955886607 tempest-QuotasAdminNegativeTest-1955886607-project] Flavor pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:16:03.057074 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-c111db66-a9ac-481d-9893-7f7e9f55a469 tempest-QuotasAdminNegativeTest-1955886607 tempest-QuotasAdminNegativeTest-1955886607-project] Image pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:16:03.058651 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-c111db66-a9ac-481d-9893-7f7e9f55a469 tempest-QuotasAdminNegativeTest-1955886607 tempest-QuotasAdminNegativeTest-1955886607-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:16:03.073469 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c111db66-a9ac-481d-9893-7f7e9f55a469 tempest-QuotasAdminNegativeTest-1955886607 tempest-QuotasAdminNegativeTest-1955886607-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:03.073960 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c111db66-a9ac-481d-9893-7f7e9f55a469 tempest-QuotasAdminNegativeTest-1955886607 tempest-QuotasAdminNegativeTest-1955886607-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:03.075206 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c111db66-a9ac-481d-9893-7f7e9f55a469 tempest-QuotasAdminNegativeTest-1955886607 tempest-QuotasAdminNegativeTest-1955886607-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:03.075643 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c111db66-a9ac-481d-9893-7f7e9f55a469 tempest-QuotasAdminNegativeTest-1955886607 tempest-QuotasAdminNegativeTest-1955886607-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:03.103983 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-c111db66-a9ac-481d-9893-7f7e9f55a469 tempest-QuotasAdminNegativeTest-1955886607 tempest-QuotasAdminNegativeTest-1955886607-project] Getting quotas for project eef12e9221c04a6cbee380b903a30363. Resources: {'ram', 'instances', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:16:03.111783 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-c111db66-a9ac-481d-9893-7f7e9f55a469 tempest-QuotasAdminNegativeTest-1955886607 tempest-QuotasAdminNegativeTest-1955886607-project] Getting quotas for user a62c9c8b061b4d29b61696314907c572 and project eef12e9221c04a6cbee380b903a30363. Resources: {'ram', 'instances', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:16:03.138654 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.utils [None req-c111db66-a9ac-481d-9893-7f7e9f55a469 tempest-QuotasAdminNegativeTest-1955886607 tempest-QuotasAdminNegativeTest-1955886607-project] cores quota exceeded for eef12e9221c04a6cbee380b903a30363, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=131321) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jul 23 21:16:03.140862 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-c111db66-a9ac-481d-9893-7f7e9f55a469 tempest-QuotasAdminNegativeTest-1955886607 tempest-QuotasAdminNegativeTest-1955886607-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 23 21:16:03.150888 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c111db66-a9ac-481d-9893-7f7e9f55a469 tempest-QuotasAdminNegativeTest-1955886607 tempest-QuotasAdminNegativeTest-1955886607-project] Request method failure captured: Jul 23 21:16:03.150888 ncdv-master-1 devstack@n-api.service[131321]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 23 21:16:03.150888 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:16:03.150888 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:16:03.150888 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:16:03.150888 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 145 Jul 23 21:16:03.150888 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:16:03.150888 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:16:03.150888 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:16:03.150888 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:16:03.150888 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GUPlW-fE2cczqdvyVuzbiPs78hchm0GqBwSQOFwGgehCtuqn92H2FDD6t_IUpk07Q8u5iFrSH8fSbJRqQHBn8sUorPlrHvQvcLpMTiRGriGWqQ71QsbY6H1sDQJJcmOPbexm664JpBXpcu-zLIe5g3boZhneJlDcuWrSIxnLUxKWpw Jul 23 21:16:03.150888 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:16:03.150888 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:16:03.150888 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:16:03.150888 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:16:03.150888 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:16:03.150888 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:16:03.150888 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: eef12e9221c04a6cbee380b903a30363 Jul 23 21:16:03.150888 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-QuotasAdminNegativeTest-1955886607 Jul 23 21:16:03.150888 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:16:03.150888 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:16:03.152582 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/eef12e9221c04a6cbee380b903a30363"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/eef12e9221c04a6cbee380b903a30363"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_eef12e9221c04a6cbee380b903a30363", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/eef12e9221c04a6cbee380b903a30363"}]}] Jul 23 21:16:03.152582 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-QuotasAdminNegativeTest-1955886607 Jul 23 21:16:03.152582 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: eef12e9221c04a6cbee380b903a30363 Jul 23 21:16:03.152582 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1955886607 Jul 23 21:16:03.152582 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-QuotasAdminNegativeTest-1955886607-project Jul 23 21:16:03.152582 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:16:03.152582 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:16:03.152582 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: a62c9c8b061b4d29b61696314907c572 Jul 23 21:16:03.152582 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-QuotasAdminNegativeTest-1955886607-project Jul 23 21:16:03.152582 ncdv-master-1 devstack@n-api.service[131321]: Jul 23 21:16:03.152582 ncdv-master-1 devstack@n-api.service[131321]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1516365087", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452"}} Jul 23 21:16:03.152582 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:16:03.153451 ncdv-master-1 devstack@n-api.service[131321]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 23 21:16:03.153451 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1516365087', 'imageRef': 'b27b20aa-ef1b-4dd1-989e-321af6343d6a', 'flavorRef': '452'}}} Jul 23 21:16:03.153451 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:16:03.153451 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:16:03.153451 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jul 23 21:16:03.153451 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jul 23 21:16:03.153451 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 23 21:16:03.153451 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 23 21:16:03.153451 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 23 21:16:03.153451 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc Jul 23 21:16:03.153451 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 23 21:16:03.153451 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 23 21:16:03.153451 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 23 21:16:03.153451 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 23 21:16:03.153451 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 23 21:16:03.153451 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 23 21:16:03.153451 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 23 21:16:03.153451 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 23 21:16:03.154750 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jul 23 21:16:03.154750 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 23 21:16:03.154750 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Jul 23 21:16:03.154750 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:16:03.154750 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:16:03.154750 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:16:03.154750 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:16:03.154750 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 23 21:16:03.154750 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 23 21:16:03.154750 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 23 21:16:03.154750 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 23 21:16:03.154750 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance Jul 23 21:16:03.154750 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jul 23 21:16:03.154750 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances Jul 23 21:16:03.154750 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jul 23 21:16:03.154750 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jul 23 21:16:03.154750 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 23 21:16:03.154750 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 23 21:16:03.154750 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:16:03.154750 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:16:03.154750 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:16:03.156195 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:16:03.156195 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:16:03.156195 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:16:03.156195 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:16:03.156195 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:16:03.156195 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:16:03.156195 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:16:03.156195 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:16:03.156195 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:16:03.156195 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:16:03.156195 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:16:03.156195 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:16:03.156195 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:16:03.156195 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 23 21:16:03.156195 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 23 21:16:03.156195 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 23 21:16:03.156195 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 23 21:16:03.156195 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:16:03.156195 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:16:03.156195 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:16:03.156195 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:16:03.158103 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:16:03.158103 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:16:03.158103 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:16:03.158103 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:16:03.158103 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 23 21:16:03.158103 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:16:03.158103 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c111db66-a9ac-481d-9893-7f7e9f55a469 tempest-QuotasAdminNegativeTest-1955886607 tempest-QuotasAdminNegativeTest-1955886607-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:16:03.158103 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-c111db66-a9ac-481d-9893-7f7e9f55a469 tempest-QuotasAdminNegativeTest-1955886607 tempest-QuotasAdminNegativeTest-1955886607-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 1.087937 Jul 23 21:16:03.158103 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 416/759] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:16:02 2022] POST /compute/v2.1/servers => generated 111 bytes in 1090 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jul 23 21:16:03.165024 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-9e2fbd9d-6f79-43e0-a86d-59d0c980070d tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:03.165823 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-9e2fbd9d-6f79-43e0-a86d-59d0c980070d tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] [instance: 7558d52c-24e7-4115-88f7-ced193819c33] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:03.175392 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9e2fbd9d-6f79-43e0-a86d-59d0c980070d tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:03.175856 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9e2fbd9d-6f79-43e0-a86d-59d0c980070d tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:03.176691 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9e2fbd9d-6f79-43e0-a86d-59d0c980070d tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:03.177319 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9e2fbd9d-6f79-43e0-a86d-59d0c980070d tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:03.407250 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.objects.instance [None req-9e2fbd9d-6f79-43e0-a86d-59d0c980070d tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lazy-loading 'services' on Instance uuid 7558d52c-24e7-4115-88f7-ced193819c33 {{(pid=131321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:16:03.422986 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-9e2fbd9d-6f79-43e0-a86d-59d0c980070d tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/7558d52c-24e7-4115-88f7-ced193819c33" status: 200 len: 2037 microversion: 2.25 time: 0.266973 Jul 23 21:16:03.424436 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 417/760] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:16:03 2022] GET /compute/v2.1/servers/7558d52c-24e7-4115-88f7-ced193819c33 => generated 2037 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:16:03.443300 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c154a8ba-574a-4bce-98ae-fd1528a0bc3b tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:03.444312 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-c154a8ba-574a-4bce-98ae-fd1528a0bc3b tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 5bc4befa-252d-456a-92cd-323bad80fcdf] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:03.451551 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c154a8ba-574a-4bce-98ae-fd1528a0bc3b tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:03.452355 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c154a8ba-574a-4bce-98ae-fd1528a0bc3b tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:03.453463 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c154a8ba-574a-4bce-98ae-fd1528a0bc3b tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:03.454155 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c154a8ba-574a-4bce-98ae-fd1528a0bc3b tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:03.654242 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c154a8ba-574a-4bce-98ae-fd1528a0bc3b tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:03.663298 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-c154a8ba-574a-4bce-98ae-fd1528a0bc3b tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/5bc4befa-252d-456a-92cd-323bad80fcdf" status: 200 len: 1476 microversion: 2.1 time: 0.237082 Jul 23 21:16:03.664010 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 418/761] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:16:03 2022] GET /compute/v2.1/servers/5bc4befa-252d-456a-92cd-323bad80fcdf => generated 1476 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:03.669370 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-cf3c559d-f0cf-46a2-88b7-1848a19b3da6 req-1f262763-7184-44be-86c5-2b8da1add330 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b360b14-9ea2-4336-b32e-d6546267664e", "tag": "ab0b5da4-b12b-497b-b93e-08673983e63d"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:16:03.679766 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-cf3c559d-f0cf-46a2-88b7-1848a19b3da6 req-1f262763-7184-44be-86c5-2b8da1add330 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:03.680374 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-cf3c559d-f0cf-46a2-88b7-1848a19b3da6 req-1f262763-7184-44be-86c5-2b8da1add330 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:03.692490 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-cf3c559d-f0cf-46a2-88b7-1848a19b3da6 req-1f262763-7184-44be-86c5-2b8da1add330 service nova] Creating event network-changed:ab0b5da4-b12b-497b-b93e-08673983e63d for instance 9b360b14-9ea2-4336-b32e-d6546267664e on nch1-master-1 Jul 23 21:16:03.697601 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-cf3c559d-f0cf-46a2-88b7-1848a19b3da6 req-1f262763-7184-44be-86c5-2b8da1add330 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032201 Jul 23 21:16:03.698608 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 419/762] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:16:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:16:03.704687 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-5358410c-7aef-41b4-afa7-5214cba28c59 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:03.705671 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-5358410c-7aef-41b4-afa7-5214cba28c59 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 9b360b14-9ea2-4336-b32e-d6546267664e] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:03.714011 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5358410c-7aef-41b4-afa7-5214cba28c59 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:03.714735 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5358410c-7aef-41b4-afa7-5214cba28c59 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:03.715741 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5358410c-7aef-41b4-afa7-5214cba28c59 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:03.716395 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5358410c-7aef-41b4-afa7-5214cba28c59 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:03.974392 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-5358410c-7aef-41b4-afa7-5214cba28c59 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4f9dda4c2a411cb0394bf86e9ae223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580ed681cbf44d10936259b17f60f1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:03.987134 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-5358410c-7aef-41b4-afa7-5214cba28c59 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/servers/9b360b14-9ea2-4336-b32e-d6546267664e" status: 200 len: 1308 microversion: 2.1 time: 0.286330 Jul 23 21:16:03.991656 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 420/763] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:16:03 2022] GET /compute/v2.1/servers/9b360b14-9ea2-4336-b32e-d6546267664e => generated 1308 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:04.004389 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-4ed0130b-1eb2-48ff-b0a9-8f21a486be55 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:04.005173 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-4ed0130b-1eb2-48ff-b0a9-8f21a486be55 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: 36204b8b-c78e-447c-a3e7-f1f22c6ffe1f] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:04.015475 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4ed0130b-1eb2-48ff-b0a9-8f21a486be55 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:04.015954 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4ed0130b-1eb2-48ff-b0a9-8f21a486be55 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:04.016769 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4ed0130b-1eb2-48ff-b0a9-8f21a486be55 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:04.020114 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4ed0130b-1eb2-48ff-b0a9-8f21a486be55 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:04.287109 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-4ed0130b-1eb2-48ff-b0a9-8f21a486be55 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf92af08fa94215b4eafcacea6c63f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e7d37a0e3b4b32ae99c3bc15a831e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:04.294210 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-a302c38c-e84d-4e3d-a1cf-5ffdcb003b0f tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:16:04.295282 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-a302c38c-e84d-4e3d-a1cf-5ffdcb003b0f tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:16:04.295641 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-4ed0130b-1eb2-48ff-b0a9-8f21a486be55 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "GET /compute/v2.1/servers/36204b8b-c78e-447c-a3e7-f1f22c6ffe1f" status: 200 len: 1318 microversion: 2.1 time: 0.302731 Jul 23 21:16:04.296240 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-a302c38c-e84d-4e3d-a1cf-5ffdcb003b0f tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:16:04.297183 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-a302c38c-e84d-4e3d-a1cf-5ffdcb003b0f tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:16:04.297751 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-a302c38c-e84d-4e3d-a1cf-5ffdcb003b0f tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:16:04.305500 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 421/764] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:16:03 2022] GET /compute/v2.1/servers/36204b8b-c78e-447c-a3e7-f1f22c6ffe1f => generated 1318 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:04.309265 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a302c38c-e84d-4e3d-a1cf-5ffdcb003b0f tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:04.309776 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a302c38c-e84d-4e3d-a1cf-5ffdcb003b0f tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:04.310677 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-60578a38-56f6-4c6a-b7ab-21e8facf81e0 tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] Action: 'update', calling method: .version_select at 0x7f0b541f70d0>, body: {"quota_set": {"cores": 20}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:16:04.311070 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a302c38c-e84d-4e3d-a1cf-5ffdcb003b0f tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:04.311539 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a302c38c-e84d-4e3d-a1cf-5ffdcb003b0f tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:04.336512 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-a302c38c-e84d-4e3d-a1cf-5ffdcb003b0f tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Getting quotas for project 6610a2359aa64f89befcf72e4f3f6a54. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:16:04.341541 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-a302c38c-e84d-4e3d-a1cf-5ffdcb003b0f tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Getting quotas for user f2672c5db79b4a48a505c3df536594dd and project 6610a2359aa64f89befcf72e4f3f6a54. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:16:04.353845 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a302c38c-e84d-4e3d-a1cf-5ffdcb003b0f tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Going to run 1 instances... {{(pid=131320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:16:04.356159 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a302c38c-e84d-4e3d-a1cf-5ffdcb003b0f tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 34eaf1d2-9732-4c0e-b970-02fbb449514b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:16:04.383989 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-60578a38-56f6-4c6a-b7ab-21e8facf81e0 tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:04.384759 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-60578a38-56f6-4c6a-b7ab-21e8facf81e0 tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:04.386354 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-60578a38-56f6-4c6a-b7ab-21e8facf81e0 tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:04.387147 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-60578a38-56f6-4c6a-b7ab-21e8facf81e0 tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:04.422413 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a302c38c-e84d-4e3d-a1cf-5ffdcb003b0f tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.095258 Jul 23 21:16:04.423782 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 344/765] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:16:02 2022] POST /compute/v2.1/servers => generated 405 bytes in 2098 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 23 21:16:04.429379 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f40784f6-14be-4e2f-b237-8d606d67bb64 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": "auto"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:16:04.430864 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f40784f6-14be-4e2f-b237-8d606d67bb64 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] [instance: 7558d52c-24e7-4115-88f7-ced193819c33] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:04.438847 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f40784f6-14be-4e2f-b237-8d606d67bb64 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:04.439722 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f40784f6-14be-4e2f-b237-8d606d67bb64 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:04.440835 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f40784f6-14be-4e2f-b237-8d606d67bb64 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:04.441612 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f40784f6-14be-4e2f-b237-8d606d67bb64 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:04.503692 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.objects.instance [None req-f40784f6-14be-4e2f-b237-8d606d67bb64 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lazy-loading 'flavor' on Instance uuid 7558d52c-24e7-4115-88f7-ced193819c33 {{(pid=131320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:16:04.515394 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-60578a38-56f6-4c6a-b7ab-21e8facf81e0 tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-quota-sets/eef12e9221c04a6cbee380b903a30363" status: 200 len: 329 microversion: 2.1 time: 0.204628 Jul 23 21:16:04.516113 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 422/766] 10.222.0.17 () {60 vars in 1261 bytes} [Sat Jul 23 21:16:04 2022] PUT /compute/v2.1/os-quota-sets/eef12e9221c04a6cbee380b903a30363 => generated 329 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:16:04.522571 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-7c94b1f4-417e-48d2-a80b-980d54213bd3 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:04.523407 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-7c94b1f4-417e-48d2-a80b-980d54213bd3 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 34eaf1d2-9732-4c0e-b970-02fbb449514b] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:04.535605 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f40784f6-14be-4e2f-b237-8d606d67bb64 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] [instance: 7558d52c-24e7-4115-88f7-ced193819c33] Going to try to live migrate instance to nch2-master-1 {{(pid=131320) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 23 21:16:04.623166 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-7c94b1f4-417e-48d2-a80b-980d54213bd3 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:04.636587 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-7c94b1f4-417e-48d2-a80b-980d54213bd3 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/34eaf1d2-9732-4c0e-b970-02fbb449514b" status: 200 len: 1234 microversion: 2.1 time: 0.118756 Jul 23 21:16:04.637933 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 423/767] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:16:04 2022] GET /compute/v2.1/servers/34eaf1d2-9732-4c0e-b970-02fbb449514b => generated 1234 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:04.644842 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-94f80ce1-775b-4f7a-af53-24b251f0a681 tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] Calling method '.version_select at 0x7f0b47fdcca0>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:04.765266 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-94f80ce1-775b-4f7a-af53-24b251f0a681 tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] 10.222.0.17 "GET /compute/v2.1/os-quota-sets/eef12e9221c04a6cbee380b903a30363" status: 200 len: 371 microversion: 2.1 time: 0.126070 Jul 23 21:16:04.771974 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 424/768] 10.222.0.17 () {58 vars in 1241 bytes} [Sat Jul 23 21:16:04 2022] GET /compute/v2.1/os-quota-sets/eef12e9221c04a6cbee380b903a30363 => generated 371 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:16:04.780421 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-8a9b18cd-3ff8-4b9c-828f-cb744ca05150 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:04.782195 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-8a9b18cd-3ff8-4b9c-828f-cb744ca05150 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 5bc4befa-252d-456a-92cd-323bad80fcdf] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:04.797054 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8a9b18cd-3ff8-4b9c-828f-cb744ca05150 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:04.797703 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8a9b18cd-3ff8-4b9c-828f-cb744ca05150 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:04.798750 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8a9b18cd-3ff8-4b9c-828f-cb744ca05150 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:04.799341 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8a9b18cd-3ff8-4b9c-828f-cb744ca05150 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:05.304940 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-8a9b18cd-3ff8-4b9c-828f-cb744ca05150 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:05.322434 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-8a9b18cd-3ff8-4b9c-828f-cb744ca05150 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/5bc4befa-252d-456a-92cd-323bad80fcdf" status: 200 len: 1476 microversion: 2.1 time: 0.548884 Jul 23 21:16:05.336020 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 425/769] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:16:04 2022] GET /compute/v2.1/servers/5bc4befa-252d-456a-92cd-323bad80fcdf => generated 1476 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:05.346748 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-6b3674bf-42ce-4813-b1ee-eb33811e0538 tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] Action: 'update', calling method: .version_select at 0x7f0b47fac700>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:16:05.451619 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6b3674bf-42ce-4813-b1ee-eb33811e0538 tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:05.453382 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6b3674bf-42ce-4813-b1ee-eb33811e0538 tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:05.456374 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6b3674bf-42ce-4813-b1ee-eb33811e0538 tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:05.456912 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6b3674bf-42ce-4813-b1ee-eb33811e0538 tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:05.532232 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-6b3674bf-42ce-4813-b1ee-eb33811e0538 tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-quota-sets/eef12e9221c04a6cbee380b903a30363" status: 200 len: 328 microversion: 2.1 time: 0.192613 Jul 23 21:16:05.544638 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 426/770] 10.222.0.17 () {60 vars in 1261 bytes} [Sat Jul 23 21:16:05 2022] PUT /compute/v2.1/os-quota-sets/eef12e9221c04a6cbee380b903a30363 => generated 328 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:16:05.551544 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ae119ee6-4a48-4391-989d-498ae9fafe88 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:05.552289 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-ae119ee6-4a48-4391-989d-498ae9fafe88 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 9b360b14-9ea2-4336-b32e-d6546267664e] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:05.558893 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ae119ee6-4a48-4391-989d-498ae9fafe88 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:05.560140 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ae119ee6-4a48-4391-989d-498ae9fafe88 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:05.561144 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ae119ee6-4a48-4391-989d-498ae9fafe88 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:05.561765 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ae119ee6-4a48-4391-989d-498ae9fafe88 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:05.958369 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ae119ee6-4a48-4391-989d-498ae9fafe88 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4f9dda4c2a411cb0394bf86e9ae223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580ed681cbf44d10936259b17f60f1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:05.970037 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-ae119ee6-4a48-4391-989d-498ae9fafe88 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/servers/9b360b14-9ea2-4336-b32e-d6546267664e" status: 200 len: 1308 microversion: 2.1 time: 0.420444 Jul 23 21:16:05.971109 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 427/771] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:16:05 2022] GET /compute/v2.1/servers/9b360b14-9ea2-4336-b32e-d6546267664e => generated 1308 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:05.986786 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-b5568de3-92eb-4104-b026-62eaf42431d0 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:05.988039 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-b5568de3-92eb-4104-b026-62eaf42431d0 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: 36204b8b-c78e-447c-a3e7-f1f22c6ffe1f] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:06.012237 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b5568de3-92eb-4104-b026-62eaf42431d0 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:06.013478 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b5568de3-92eb-4104-b026-62eaf42431d0 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:06.014539 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b5568de3-92eb-4104-b026-62eaf42431d0 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:06.015188 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b5568de3-92eb-4104-b026-62eaf42431d0 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:06.842698 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-b5568de3-92eb-4104-b026-62eaf42431d0 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf92af08fa94215b4eafcacea6c63f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e7d37a0e3b4b32ae99c3bc15a831e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:06.853889 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-b5568de3-92eb-4104-b026-62eaf42431d0 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "GET /compute/v2.1/servers/36204b8b-c78e-447c-a3e7-f1f22c6ffe1f" status: 200 len: 1318 microversion: 2.1 time: 0.878625 Jul 23 21:16:06.854826 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 428/772] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:16:05 2022] GET /compute/v2.1/servers/36204b8b-c78e-447c-a3e7-f1f22c6ffe1f => generated 1318 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:06.860145 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-8139920b-62cb-4329-9b2c-105ab7b1a2f0 tempest-QuotasAdminNegativeTest-1955886607 tempest-QuotasAdminNegativeTest-1955886607-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1228802235", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:16:06.933920 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.network.neutron [None req-8139920b-62cb-4329-9b2c-105ab7b1a2f0 tempest-QuotasAdminNegativeTest-1955886607 tempest-QuotasAdminNegativeTest-1955886607-project] validate_networks() for None {{(pid=131321) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:16:07.156669 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f40784f6-14be-4e2f-b237-8d606d67bb64 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/7558d52c-24e7-4115-88f7-ced193819c33/action" status: 202 len: 0 microversion: 2.25 time: 2.731456 Jul 23 21:16:07.158193 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 345/773] 10.222.0.17 () {62 vars in 1318 bytes} [Sat Jul 23 21:16:04 2022] POST /compute/v2.1/servers/7558d52c-24e7-4115-88f7-ced193819c33/action => generated 0 bytes in 2734 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:16:07.163823 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-90aa02e7-7429-4b1a-ac99-a2745ed74b73 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:07.164700 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-90aa02e7-7429-4b1a-ac99-a2745ed74b73 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 34eaf1d2-9732-4c0e-b970-02fbb449514b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:07.188935 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-90aa02e7-7429-4b1a-ac99-a2745ed74b73 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:07.189682 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-90aa02e7-7429-4b1a-ac99-a2745ed74b73 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:07.191636 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-90aa02e7-7429-4b1a-ac99-a2745ed74b73 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:07.192269 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-90aa02e7-7429-4b1a-ac99-a2745ed74b73 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:07.302765 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-90aa02e7-7429-4b1a-ac99-a2745ed74b73 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:07.312894 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-90aa02e7-7429-4b1a-ac99-a2745ed74b73 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/34eaf1d2-9732-4c0e-b970-02fbb449514b" status: 200 len: 1292 microversion: 2.1 time: 0.152202 Jul 23 21:16:07.313289 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 346/774] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:16:07 2022] GET /compute/v2.1/servers/34eaf1d2-9732-4c0e-b970-02fbb449514b => generated 1292 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:07.320295 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-595133a8-587d-4721-8df9-e81335a50d1c tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:07.321130 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-595133a8-587d-4721-8df9-e81335a50d1c tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 5bc4befa-252d-456a-92cd-323bad80fcdf] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:07.345154 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-595133a8-587d-4721-8df9-e81335a50d1c tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:07.351186 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-595133a8-587d-4721-8df9-e81335a50d1c tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:07.356609 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-595133a8-587d-4721-8df9-e81335a50d1c tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:07.357228 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-595133a8-587d-4721-8df9-e81335a50d1c tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:07.902354 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-595133a8-587d-4721-8df9-e81335a50d1c tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:07.918684 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-595133a8-587d-4721-8df9-e81335a50d1c tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/5bc4befa-252d-456a-92cd-323bad80fcdf" status: 200 len: 1476 microversion: 2.1 time: 0.603971 Jul 23 21:16:07.920384 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 347/775] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:16:07 2022] GET /compute/v2.1/servers/5bc4befa-252d-456a-92cd-323bad80fcdf => generated 1476 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:07.930917 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-082d95a0-4a90-43d6-b36f-7d6398767a98 req-6ffd061e-f593-476a-876e-860b34a9bb37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bbeec29-35ee-44ca-a0f0-3dbe2198e5bf", "tag": "74ad436d-bbbc-4932-b444-95cdeceb5cd1"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:16:07.943847 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-082d95a0-4a90-43d6-b36f-7d6398767a98 req-6ffd061e-f593-476a-876e-860b34a9bb37 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:07.944820 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-082d95a0-4a90-43d6-b36f-7d6398767a98 req-6ffd061e-f593-476a-876e-860b34a9bb37 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:07.961327 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-082d95a0-4a90-43d6-b36f-7d6398767a98 req-6ffd061e-f593-476a-876e-860b34a9bb37 service nova] Creating event network-changed:74ad436d-bbbc-4932-b444-95cdeceb5cd1 for instance 5bbeec29-35ee-44ca-a0f0-3dbe2198e5bf on nch2-master-1 Jul 23 21:16:07.970804 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-082d95a0-4a90-43d6-b36f-7d6398767a98 req-6ffd061e-f593-476a-876e-860b34a9bb37 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046201 Jul 23 21:16:07.971720 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 348/776] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:16:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:16:07.983398 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b1a4fa8e-d6ec-4c0f-9faf-9b36eb6bcdab tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:07.984146 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b1a4fa8e-d6ec-4c0f-9faf-9b36eb6bcdab tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 9b360b14-9ea2-4336-b32e-d6546267664e] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:08.006357 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b1a4fa8e-d6ec-4c0f-9faf-9b36eb6bcdab tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:08.014124 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b1a4fa8e-d6ec-4c0f-9faf-9b36eb6bcdab tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:08.018739 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b1a4fa8e-d6ec-4c0f-9faf-9b36eb6bcdab tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:08.022914 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b1a4fa8e-d6ec-4c0f-9faf-9b36eb6bcdab tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:08.226118 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b1a4fa8e-d6ec-4c0f-9faf-9b36eb6bcdab tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4f9dda4c2a411cb0394bf86e9ae223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580ed681cbf44d10936259b17f60f1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:08.235743 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b1a4fa8e-d6ec-4c0f-9faf-9b36eb6bcdab tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/servers/9b360b14-9ea2-4336-b32e-d6546267664e" status: 200 len: 1308 microversion: 2.1 time: 0.262561 Jul 23 21:16:08.236634 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 349/777] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:16:07 2022] GET /compute/v2.1/servers/9b360b14-9ea2-4336-b32e-d6546267664e => generated 1308 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:08.242149 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-3df0b49f-ab36-4891-81bc-a7edf389aba2 req-34f19c2b-fea1-472c-b12e-75eb48bb95d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36204b8b-c78e-447c-a3e7-f1f22c6ffe1f", "tag": "30f66f72-a68b-4b83-b061-353e991a5389"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:16:08.253663 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-3df0b49f-ab36-4891-81bc-a7edf389aba2 req-34f19c2b-fea1-472c-b12e-75eb48bb95d4 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:08.254436 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-3df0b49f-ab36-4891-81bc-a7edf389aba2 req-34f19c2b-fea1-472c-b12e-75eb48bb95d4 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:08.266052 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-8139920b-62cb-4329-9b2c-105ab7b1a2f0 tempest-QuotasAdminNegativeTest-1955886607 tempest-QuotasAdminNegativeTest-1955886607-project] Flavor limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:16:08.267055 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-8139920b-62cb-4329-9b2c-105ab7b1a2f0 tempest-QuotasAdminNegativeTest-1955886607 tempest-QuotasAdminNegativeTest-1955886607-project] Image limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:16:08.267691 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-8139920b-62cb-4329-9b2c-105ab7b1a2f0 tempest-QuotasAdminNegativeTest-1955886607 tempest-QuotasAdminNegativeTest-1955886607-project] Flavor pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:16:08.268157 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-8139920b-62cb-4329-9b2c-105ab7b1a2f0 tempest-QuotasAdminNegativeTest-1955886607 tempest-QuotasAdminNegativeTest-1955886607-project] Image pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:16:08.268803 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-8139920b-62cb-4329-9b2c-105ab7b1a2f0 tempest-QuotasAdminNegativeTest-1955886607 tempest-QuotasAdminNegativeTest-1955886607-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:16:08.283325 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8139920b-62cb-4329-9b2c-105ab7b1a2f0 tempest-QuotasAdminNegativeTest-1955886607 tempest-QuotasAdminNegativeTest-1955886607-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:08.284129 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8139920b-62cb-4329-9b2c-105ab7b1a2f0 tempest-QuotasAdminNegativeTest-1955886607 tempest-QuotasAdminNegativeTest-1955886607-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:08.285278 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8139920b-62cb-4329-9b2c-105ab7b1a2f0 tempest-QuotasAdminNegativeTest-1955886607 tempest-QuotasAdminNegativeTest-1955886607-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:08.286474 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8139920b-62cb-4329-9b2c-105ab7b1a2f0 tempest-QuotasAdminNegativeTest-1955886607 tempest-QuotasAdminNegativeTest-1955886607-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:08.287437 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-3df0b49f-ab36-4891-81bc-a7edf389aba2 req-34f19c2b-fea1-472c-b12e-75eb48bb95d4 service nova] Creating event network-changed:30f66f72-a68b-4b83-b061-353e991a5389 for instance 36204b8b-c78e-447c-a3e7-f1f22c6ffe1f on nch1-master-1 Jul 23 21:16:08.294439 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-3df0b49f-ab36-4891-81bc-a7edf389aba2 req-34f19c2b-fea1-472c-b12e-75eb48bb95d4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055920 Jul 23 21:16:08.296050 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 350/778] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:16:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:16:08.304812 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-10d27f7f-a9c8-43bc-ab7b-7c2a1ddc8f8f tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:08.305978 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-10d27f7f-a9c8-43bc-ab7b-7c2a1ddc8f8f tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: 7558d52c-24e7-4115-88f7-ced193819c33] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:08.311917 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-8139920b-62cb-4329-9b2c-105ab7b1a2f0 tempest-QuotasAdminNegativeTest-1955886607 tempest-QuotasAdminNegativeTest-1955886607-project] Getting quotas for project eef12e9221c04a6cbee380b903a30363. Resources: {'ram', 'instances', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:16:08.315047 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-10d27f7f-a9c8-43bc-ab7b-7c2a1ddc8f8f tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:08.316396 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-10d27f7f-a9c8-43bc-ab7b-7c2a1ddc8f8f tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:08.317714 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-10d27f7f-a9c8-43bc-ab7b-7c2a1ddc8f8f tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:08.318389 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-10d27f7f-a9c8-43bc-ab7b-7c2a1ddc8f8f tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:08.327198 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-8139920b-62cb-4329-9b2c-105ab7b1a2f0 tempest-QuotasAdminNegativeTest-1955886607 tempest-QuotasAdminNegativeTest-1955886607-project] Getting quotas for user a62c9c8b061b4d29b61696314907c572 and project eef12e9221c04a6cbee380b903a30363. Resources: {'ram', 'instances', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:16:08.351079 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.utils [None req-8139920b-62cb-4329-9b2c-105ab7b1a2f0 tempest-QuotasAdminNegativeTest-1955886607 tempest-QuotasAdminNegativeTest-1955886607-project] instances quota exceeded for eef12e9221c04a6cbee380b903a30363, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=131321) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jul 23 21:16:08.351747 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-8139920b-62cb-4329-9b2c-105ab7b1a2f0 tempest-QuotasAdminNegativeTest-1955886607 tempest-QuotasAdminNegativeTest-1955886607-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 23 21:16:08.356842 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-8139920b-62cb-4329-9b2c-105ab7b1a2f0 tempest-QuotasAdminNegativeTest-1955886607 tempest-QuotasAdminNegativeTest-1955886607-project] Request method failure captured: Jul 23 21:16:08.356842 ncdv-master-1 devstack@n-api.service[131321]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 23 21:16:08.356842 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:16:08.356842 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:16:08.356842 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:16:08.356842 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 145 Jul 23 21:16:08.356842 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:16:08.356842 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:16:08.356842 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:16:08.356842 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:16:08.356842 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GUPlW-fE2cczqdvyVuzbiPs78hchm0GqBwSQOFwGgehCtuqn92H2FDD6t_IUpk07Q8u5iFrSH8fSbJRqQHBn8sUorPlrHvQvcLpMTiRGriGWqQ71QsbY6H1sDQJJcmOPbexm664JpBXpcu-zLIe5g3boZhneJlDcuWrSIxnLUxKWpw Jul 23 21:16:08.356842 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:16:08.356842 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:16:08.356842 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:16:08.356842 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:16:08.356842 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:16:08.356842 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:16:08.356842 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: eef12e9221c04a6cbee380b903a30363 Jul 23 21:16:08.356842 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-QuotasAdminNegativeTest-1955886607 Jul 23 21:16:08.356842 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:16:08.356842 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:16:08.358392 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/eef12e9221c04a6cbee380b903a30363"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/eef12e9221c04a6cbee380b903a30363"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_eef12e9221c04a6cbee380b903a30363", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/eef12e9221c04a6cbee380b903a30363"}]}] Jul 23 21:16:08.358392 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-QuotasAdminNegativeTest-1955886607 Jul 23 21:16:08.358392 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: eef12e9221c04a6cbee380b903a30363 Jul 23 21:16:08.358392 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1955886607 Jul 23 21:16:08.358392 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-QuotasAdminNegativeTest-1955886607-project Jul 23 21:16:08.358392 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:16:08.358392 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:16:08.358392 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: a62c9c8b061b4d29b61696314907c572 Jul 23 21:16:08.358392 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-QuotasAdminNegativeTest-1955886607-project Jul 23 21:16:08.358392 ncdv-master-1 devstack@n-api.service[131321]: Jul 23 21:16:08.358392 ncdv-master-1 devstack@n-api.service[131321]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1228802235", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452"}} Jul 23 21:16:08.358392 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:16:08.359249 ncdv-master-1 devstack@n-api.service[131321]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 23 21:16:08.359249 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1228802235', 'imageRef': 'b27b20aa-ef1b-4dd1-989e-321af6343d6a', 'flavorRef': '452'}}} Jul 23 21:16:08.359249 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:16:08.359249 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:16:08.359249 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jul 23 21:16:08.359249 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jul 23 21:16:08.359249 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 23 21:16:08.359249 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 23 21:16:08.359249 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 23 21:16:08.359249 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc Jul 23 21:16:08.359249 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 23 21:16:08.359249 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 23 21:16:08.359249 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 23 21:16:08.359249 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 23 21:16:08.359249 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 23 21:16:08.359249 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 23 21:16:08.359249 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 23 21:16:08.359249 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 23 21:16:08.360511 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jul 23 21:16:08.360511 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 23 21:16:08.360511 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Jul 23 21:16:08.360511 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:16:08.360511 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:16:08.360511 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:16:08.360511 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:16:08.360511 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 23 21:16:08.360511 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 23 21:16:08.360511 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 23 21:16:08.360511 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 23 21:16:08.360511 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance Jul 23 21:16:08.360511 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jul 23 21:16:08.360511 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances Jul 23 21:16:08.360511 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jul 23 21:16:08.360511 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jul 23 21:16:08.360511 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 23 21:16:08.360511 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 23 21:16:08.360511 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:16:08.360511 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:16:08.360511 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:16:08.363122 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:16:08.363122 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:16:08.363122 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:16:08.363122 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:16:08.363122 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:16:08.363122 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:16:08.363122 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:16:08.363122 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:16:08.363122 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:16:08.363122 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:16:08.363122 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:16:08.363122 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:16:08.363122 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:16:08.363122 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 23 21:16:08.363122 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 23 21:16:08.363122 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 23 21:16:08.363122 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 23 21:16:08.363122 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:16:08.363122 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:16:08.363122 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:16:08.363122 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:16:08.364538 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:16:08.364538 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:16:08.364538 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:16:08.364538 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:16:08.364538 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 23 21:16:08.364538 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:16:08.364538 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-8139920b-62cb-4329-9b2c-105ab7b1a2f0 tempest-QuotasAdminNegativeTest-1955886607 tempest-QuotasAdminNegativeTest-1955886607-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:16:08.364538 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-8139920b-62cb-4329-9b2c-105ab7b1a2f0 tempest-QuotasAdminNegativeTest-1955886607 tempest-QuotasAdminNegativeTest-1955886607-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 1.503924 Jul 23 21:16:08.364538 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 429/779] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:16:06 2022] POST /compute/v2.1/servers => generated 119 bytes in 1506 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:16:08.370427 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-2df5cc0e-e635-4b26-a80a-b2b3d09da06a tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:08.371102 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-2df5cc0e-e635-4b26-a80a-b2b3d09da06a tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: 36204b8b-c78e-447c-a3e7-f1f22c6ffe1f] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:08.379718 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2df5cc0e-e635-4b26-a80a-b2b3d09da06a tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:08.380498 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2df5cc0e-e635-4b26-a80a-b2b3d09da06a tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:08.381500 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2df5cc0e-e635-4b26-a80a-b2b3d09da06a tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:08.382708 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2df5cc0e-e635-4b26-a80a-b2b3d09da06a tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:08.550261 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-10d27f7f-a9c8-43bc-ab7b-7c2a1ddc8f8f tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:08.562181 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-10d27f7f-a9c8-43bc-ab7b-7c2a1ddc8f8f tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:08.564933 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-10d27f7f-a9c8-43bc-ab7b-7c2a1ddc8f8f tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:08.567044 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-10d27f7f-a9c8-43bc-ab7b-7c2a1ddc8f8f tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/7558d52c-24e7-4115-88f7-ced193819c33" status: 200 len: 1569 microversion: 2.25 time: 0.269406 Jul 23 21:16:08.568016 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 351/780] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:16:08 2022] GET /compute/v2.1/servers/7558d52c-24e7-4115-88f7-ced193819c33 => generated 1569 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:16:08.573775 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0e543c80-c736-4355-be84-571246373f74 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:08.574923 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-0e543c80-c736-4355-be84-571246373f74 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 34eaf1d2-9732-4c0e-b970-02fbb449514b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:08.590930 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0e543c80-c736-4355-be84-571246373f74 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:08.591513 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0e543c80-c736-4355-be84-571246373f74 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:08.592413 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0e543c80-c736-4355-be84-571246373f74 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:08.593043 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0e543c80-c736-4355-be84-571246373f74 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:08.677989 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-0e543c80-c736-4355-be84-571246373f74 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:08.686905 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-0e543c80-c736-4355-be84-571246373f74 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/34eaf1d2-9732-4c0e-b970-02fbb449514b" status: 200 len: 1292 microversion: 2.1 time: 0.117445 Jul 23 21:16:08.687870 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 352/781] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:16:08 2022] GET /compute/v2.1/servers/34eaf1d2-9732-4c0e-b970-02fbb449514b => generated 1292 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:08.704184 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-318fa61b-8d46-469e-964e-47f4d353bbfa tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] Action: 'update', calling method: .version_select at 0x7f0b47d12ca0>, body: {"quota_set": {"instances": 10}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:16:08.785371 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-318fa61b-8d46-469e-964e-47f4d353bbfa tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:08.786536 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-318fa61b-8d46-469e-964e-47f4d353bbfa tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:08.787443 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-318fa61b-8d46-469e-964e-47f4d353bbfa tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:08.787955 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-318fa61b-8d46-469e-964e-47f4d353bbfa tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:08.857160 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-318fa61b-8d46-469e-964e-47f4d353bbfa tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-quota-sets/eef12e9221c04a6cbee380b903a30363" status: 200 len: 329 microversion: 2.1 time: 0.158190 Jul 23 21:16:08.857902 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 353/782] 10.222.0.17 () {60 vars in 1261 bytes} [Sat Jul 23 21:16:08 2022] PUT /compute/v2.1/os-quota-sets/eef12e9221c04a6cbee380b903a30363 => generated 329 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:16:08.862548 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-2df5cc0e-e635-4b26-a80a-b2b3d09da06a tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf92af08fa94215b4eafcacea6c63f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e7d37a0e3b4b32ae99c3bc15a831e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:08.870258 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-188db546-bd12-4cab-935d-170b4c787aea tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] Calling method '.version_select at 0x7f0b47d12dc0>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:08.871811 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-2df5cc0e-e635-4b26-a80a-b2b3d09da06a tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "GET /compute/v2.1/servers/36204b8b-c78e-447c-a3e7-f1f22c6ffe1f" status: 200 len: 1318 microversion: 2.1 time: 0.508231 Jul 23 21:16:08.872404 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 430/783] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:16:08 2022] GET /compute/v2.1/servers/36204b8b-c78e-447c-a3e7-f1f22c6ffe1f => generated 1318 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:08.940404 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-188db546-bd12-4cab-935d-170b4c787aea tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] 10.222.0.17 "GET /compute/v2.1/os-quota-sets/eef12e9221c04a6cbee380b903a30363" status: 200 len: 371 microversion: 2.1 time: 0.074926 Jul 23 21:16:08.941297 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 354/784] 10.222.0.17 () {58 vars in 1241 bytes} [Sat Jul 23 21:16:08 2022] GET /compute/v2.1/os-quota-sets/eef12e9221c04a6cbee380b903a30363 => generated 371 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:16:08.945754 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-66e703b2-3a2c-4903-b482-66452fa70399 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:08.951345 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b7782f02-d0be-4256-9c9d-03b57145b981 tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] Action: 'update', calling method: .version_select at 0x7f0b47d61a60>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:16:08.951879 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-66e703b2-3a2c-4903-b482-66452fa70399 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 5bc4befa-252d-456a-92cd-323bad80fcdf] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:08.955014 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:16:08.961893 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-66e703b2-3a2c-4903-b482-66452fa70399 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:08.962939 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-66e703b2-3a2c-4903-b482-66452fa70399 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:08.964197 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-66e703b2-3a2c-4903-b482-66452fa70399 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:08.964718 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-66e703b2-3a2c-4903-b482-66452fa70399 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:09.023838 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b7782f02-d0be-4256-9c9d-03b57145b981 tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:09.024283 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b7782f02-d0be-4256-9c9d-03b57145b981 tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:09.025088 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b7782f02-d0be-4256-9c9d-03b57145b981 tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:09.025529 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b7782f02-d0be-4256-9c9d-03b57145b981 tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:09.041524 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:16:09.081112 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b7782f02-d0be-4256-9c9d-03b57145b981 tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-quota-sets/eef12e9221c04a6cbee380b903a30363" status: 200 len: 325 microversion: 2.1 time: 0.133347 Jul 23 21:16:09.081662 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 355/785] 10.222.0.17 () {60 vars in 1261 bytes} [Sat Jul 23 21:16:08 2022] PUT /compute/v2.1/os-quota-sets/eef12e9221c04a6cbee380b903a30363 => generated 325 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:16:09.133429 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4b9c4ca8-5f9f-47cc-b9d3-1222903666f1 tempest-QuotasAdminNegativeTest-1955886607 tempest-QuotasAdminNegativeTest-1955886607-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-668225063", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:16:09.190414 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-4b9c4ca8-5f9f-47cc-b9d3-1222903666f1 tempest-QuotasAdminNegativeTest-1955886607 tempest-QuotasAdminNegativeTest-1955886607-project] validate_networks() for None {{(pid=131320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:16:09.352517 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-66e703b2-3a2c-4903-b482-66452fa70399 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:09.361102 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-66e703b2-3a2c-4903-b482-66452fa70399 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/5bc4befa-252d-456a-92cd-323bad80fcdf" status: 200 len: 1476 microversion: 2.1 time: 0.426472 Jul 23 21:16:09.361846 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 431/786] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:16:08 2022] GET /compute/v2.1/servers/5bc4befa-252d-456a-92cd-323bad80fcdf => generated 1476 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:09.371492 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-eb0124eb-70d2-46cd-8b7a-16e6875704f2 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:09.373082 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-eb0124eb-70d2-46cd-8b7a-16e6875704f2 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 9b360b14-9ea2-4336-b32e-d6546267664e] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:09.380911 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-eb0124eb-70d2-46cd-8b7a-16e6875704f2 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:09.381506 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-eb0124eb-70d2-46cd-8b7a-16e6875704f2 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:09.382460 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-eb0124eb-70d2-46cd-8b7a-16e6875704f2 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:09.382977 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-eb0124eb-70d2-46cd-8b7a-16e6875704f2 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:09.995764 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-4b9c4ca8-5f9f-47cc-b9d3-1222903666f1 tempest-QuotasAdminNegativeTest-1955886607 tempest-QuotasAdminNegativeTest-1955886607-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:16:09.996345 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-4b9c4ca8-5f9f-47cc-b9d3-1222903666f1 tempest-QuotasAdminNegativeTest-1955886607 tempest-QuotasAdminNegativeTest-1955886607-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:16:09.997080 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-4b9c4ca8-5f9f-47cc-b9d3-1222903666f1 tempest-QuotasAdminNegativeTest-1955886607 tempest-QuotasAdminNegativeTest-1955886607-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:16:09.997494 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-4b9c4ca8-5f9f-47cc-b9d3-1222903666f1 tempest-QuotasAdminNegativeTest-1955886607 tempest-QuotasAdminNegativeTest-1955886607-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:16:09.997903 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-4b9c4ca8-5f9f-47cc-b9d3-1222903666f1 tempest-QuotasAdminNegativeTest-1955886607 tempest-QuotasAdminNegativeTest-1955886607-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:16:10.024221 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4b9c4ca8-5f9f-47cc-b9d3-1222903666f1 tempest-QuotasAdminNegativeTest-1955886607 tempest-QuotasAdminNegativeTest-1955886607-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:10.024655 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4b9c4ca8-5f9f-47cc-b9d3-1222903666f1 tempest-QuotasAdminNegativeTest-1955886607 tempest-QuotasAdminNegativeTest-1955886607-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:10.025452 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4b9c4ca8-5f9f-47cc-b9d3-1222903666f1 tempest-QuotasAdminNegativeTest-1955886607 tempest-QuotasAdminNegativeTest-1955886607-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:10.025918 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4b9c4ca8-5f9f-47cc-b9d3-1222903666f1 tempest-QuotasAdminNegativeTest-1955886607 tempest-QuotasAdminNegativeTest-1955886607-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:10.050669 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-4b9c4ca8-5f9f-47cc-b9d3-1222903666f1 tempest-QuotasAdminNegativeTest-1955886607 tempest-QuotasAdminNegativeTest-1955886607-project] Getting quotas for project eef12e9221c04a6cbee380b903a30363. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:16:10.060271 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-4b9c4ca8-5f9f-47cc-b9d3-1222903666f1 tempest-QuotasAdminNegativeTest-1955886607 tempest-QuotasAdminNegativeTest-1955886607-project] Getting quotas for user a62c9c8b061b4d29b61696314907c572 and project eef12e9221c04a6cbee380b903a30363. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:16:10.077200 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.utils [None req-4b9c4ca8-5f9f-47cc-b9d3-1222903666f1 tempest-QuotasAdminNegativeTest-1955886607 tempest-QuotasAdminNegativeTest-1955886607-project] ram quota exceeded for eef12e9221c04a6cbee380b903a30363, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=131320) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jul 23 21:16:10.078259 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-4b9c4ca8-5f9f-47cc-b9d3-1222903666f1 tempest-QuotasAdminNegativeTest-1955886607 tempest-QuotasAdminNegativeTest-1955886607-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 23 21:16:10.085478 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4b9c4ca8-5f9f-47cc-b9d3-1222903666f1 tempest-QuotasAdminNegativeTest-1955886607 tempest-QuotasAdminNegativeTest-1955886607-project] Request method failure captured: Jul 23 21:16:10.085478 ncdv-master-1 devstack@n-api.service[131320]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 23 21:16:10.085478 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:16:10.085478 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:16:10.085478 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:16:10.085478 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 144 Jul 23 21:16:10.085478 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:16:10.085478 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:16:10.085478 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:16:10.085478 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:16:10.085478 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GUPlW-fE2cczqdvyVuzbiPs78hchm0GqBwSQOFwGgehCtuqn92H2FDD6t_IUpk07Q8u5iFrSH8fSbJRqQHBn8sUorPlrHvQvcLpMTiRGriGWqQ71QsbY6H1sDQJJcmOPbexm664JpBXpcu-zLIe5g3boZhneJlDcuWrSIxnLUxKWpw Jul 23 21:16:10.085478 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:16:10.085478 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:16:10.085478 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:16:10.085478 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:16:10.085478 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:16:10.085478 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:16:10.085478 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: eef12e9221c04a6cbee380b903a30363 Jul 23 21:16:10.085478 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-QuotasAdminNegativeTest-1955886607 Jul 23 21:16:10.085478 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:16:10.085478 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:16:10.087295 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/eef12e9221c04a6cbee380b903a30363"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/eef12e9221c04a6cbee380b903a30363"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_eef12e9221c04a6cbee380b903a30363", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/eef12e9221c04a6cbee380b903a30363"}]}] Jul 23 21:16:10.087295 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-QuotasAdminNegativeTest-1955886607 Jul 23 21:16:10.087295 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: eef12e9221c04a6cbee380b903a30363 Jul 23 21:16:10.087295 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1955886607 Jul 23 21:16:10.087295 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-QuotasAdminNegativeTest-1955886607-project Jul 23 21:16:10.087295 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:16:10.087295 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:16:10.087295 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: a62c9c8b061b4d29b61696314907c572 Jul 23 21:16:10.087295 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-QuotasAdminNegativeTest-1955886607-project Jul 23 21:16:10.087295 ncdv-master-1 devstack@n-api.service[131320]: Jul 23 21:16:10.087295 ncdv-master-1 devstack@n-api.service[131320]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-668225063", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452"}} Jul 23 21:16:10.087295 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:16:10.088143 ncdv-master-1 devstack@n-api.service[131320]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 23 21:16:10.088143 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-668225063', 'imageRef': 'b27b20aa-ef1b-4dd1-989e-321af6343d6a', 'flavorRef': '452'}}} Jul 23 21:16:10.088143 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:16:10.088143 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:16:10.088143 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jul 23 21:16:10.088143 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jul 23 21:16:10.088143 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 23 21:16:10.088143 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 23 21:16:10.088143 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 23 21:16:10.088143 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc Jul 23 21:16:10.088143 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 23 21:16:10.088143 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 23 21:16:10.088143 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 23 21:16:10.088143 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 23 21:16:10.088143 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 23 21:16:10.088143 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 23 21:16:10.088143 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 23 21:16:10.088143 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 23 21:16:10.089473 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jul 23 21:16:10.089473 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 23 21:16:10.089473 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Jul 23 21:16:10.089473 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:16:10.089473 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:16:10.089473 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:16:10.089473 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:16:10.089473 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 23 21:16:10.089473 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 23 21:16:10.089473 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 23 21:16:10.089473 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 23 21:16:10.089473 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance Jul 23 21:16:10.089473 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jul 23 21:16:10.089473 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances Jul 23 21:16:10.089473 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jul 23 21:16:10.089473 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jul 23 21:16:10.089473 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 23 21:16:10.089473 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 23 21:16:10.089473 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:16:10.089473 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:16:10.089473 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:16:10.091043 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:16:10.091043 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:16:10.091043 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:16:10.091043 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:16:10.091043 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:16:10.091043 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:16:10.091043 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:16:10.091043 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:16:10.091043 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:16:10.091043 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:16:10.091043 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:16:10.091043 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:16:10.091043 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:16:10.091043 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 23 21:16:10.091043 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 23 21:16:10.091043 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 23 21:16:10.091043 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 23 21:16:10.091043 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:16:10.091043 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:16:10.091043 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:16:10.091043 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:16:10.092921 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:16:10.092921 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:16:10.092921 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:16:10.092921 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:16:10.092921 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 23 21:16:10.092921 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:16:10.092921 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4b9c4ca8-5f9f-47cc-b9d3-1222903666f1 tempest-QuotasAdminNegativeTest-1955886607 tempest-QuotasAdminNegativeTest-1955886607-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:16:10.092921 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4b9c4ca8-5f9f-47cc-b9d3-1222903666f1 tempest-QuotasAdminNegativeTest-1955886607 tempest-QuotasAdminNegativeTest-1955886607-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.957968 Jul 23 21:16:10.092921 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 356/787] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:16:09 2022] POST /compute/v2.1/servers => generated 110 bytes in 963 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:16:10.101174 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-239e22f1-b286-4896-ab30-4c2ae7b985ed tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:10.101174 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-239e22f1-b286-4896-ab30-4c2ae7b985ed tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: 7558d52c-24e7-4115-88f7-ced193819c33] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:10.105969 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-239e22f1-b286-4896-ab30-4c2ae7b985ed tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:10.106637 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-239e22f1-b286-4896-ab30-4c2ae7b985ed tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:10.107592 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-239e22f1-b286-4896-ab30-4c2ae7b985ed tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:10.108063 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-239e22f1-b286-4896-ab30-4c2ae7b985ed tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:10.179402 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-eb0124eb-70d2-46cd-8b7a-16e6875704f2 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4f9dda4c2a411cb0394bf86e9ae223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580ed681cbf44d10936259b17f60f1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:10.198381 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-eb0124eb-70d2-46cd-8b7a-16e6875704f2 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/servers/9b360b14-9ea2-4336-b32e-d6546267664e" status: 200 len: 1308 microversion: 2.1 time: 0.832390 Jul 23 21:16:10.200590 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 432/788] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:16:09 2022] GET /compute/v2.1/servers/9b360b14-9ea2-4336-b32e-d6546267664e => generated 1308 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:10.206815 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-d920350d-1568-4c45-9972-dd8d2371c39e req-56719071-c109-43af-95bf-c8a143084724 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b360b14-9ea2-4336-b32e-d6546267664e", "name": "network-vif-plugged", "status": "completed", "tag": "ab0b5da4-b12b-497b-b93e-08673983e63d"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:16:10.218965 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-d920350d-1568-4c45-9972-dd8d2371c39e req-56719071-c109-43af-95bf-c8a143084724 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:10.219593 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-d920350d-1568-4c45-9972-dd8d2371c39e req-56719071-c109-43af-95bf-c8a143084724 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:10.258631 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-d920350d-1568-4c45-9972-dd8d2371c39e req-56719071-c109-43af-95bf-c8a143084724 service nova] Creating event network-vif-plugged:ab0b5da4-b12b-497b-b93e-08673983e63d for instance 9b360b14-9ea2-4336-b32e-d6546267664e on nch1-master-1 Jul 23 21:16:10.265719 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-d920350d-1568-4c45-9972-dd8d2371c39e req-56719071-c109-43af-95bf-c8a143084724 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062989 Jul 23 21:16:10.267508 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 433/789] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:16:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:16:10.274855 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-0887edfd-3d17-40ff-ad52-17b3b20b999c tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:10.275830 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-0887edfd-3d17-40ff-ad52-17b3b20b999c tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 34eaf1d2-9732-4c0e-b970-02fbb449514b] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:10.284051 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0887edfd-3d17-40ff-ad52-17b3b20b999c tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:10.285238 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0887edfd-3d17-40ff-ad52-17b3b20b999c tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:10.286225 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0887edfd-3d17-40ff-ad52-17b3b20b999c tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:10.287108 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0887edfd-3d17-40ff-ad52-17b3b20b999c tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:10.477839 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-239e22f1-b286-4896-ab30-4c2ae7b985ed tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:10.481370 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:16:10.495465 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-239e22f1-b286-4896-ab30-4c2ae7b985ed tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:10.512306 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-239e22f1-b286-4896-ab30-4c2ae7b985ed tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:10.514123 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-239e22f1-b286-4896-ab30-4c2ae7b985ed tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/7558d52c-24e7-4115-88f7-ced193819c33" status: 200 len: 1569 microversion: 2.25 time: 0.420864 Jul 23 21:16:10.515114 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 357/790] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:16:10 2022] GET /compute/v2.1/servers/7558d52c-24e7-4115-88f7-ced193819c33 => generated 1569 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:16:10.534915 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c82ed680-caf0-45f8-83df-d51e6ef2ee52 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:10.536890 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c82ed680-caf0-45f8-83df-d51e6ef2ee52 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: 36204b8b-c78e-447c-a3e7-f1f22c6ffe1f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:10.555715 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c82ed680-caf0-45f8-83df-d51e6ef2ee52 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:10.556402 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c82ed680-caf0-45f8-83df-d51e6ef2ee52 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:10.557294 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c82ed680-caf0-45f8-83df-d51e6ef2ee52 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:10.558703 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c82ed680-caf0-45f8-83df-d51e6ef2ee52 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:10.742123 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-0887edfd-3d17-40ff-ad52-17b3b20b999c tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:10.755786 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-0887edfd-3d17-40ff-ad52-17b3b20b999c tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/34eaf1d2-9732-4c0e-b970-02fbb449514b" status: 200 len: 1359 microversion: 2.1 time: 0.486745 Jul 23 21:16:10.756415 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 434/791] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:16:10 2022] GET /compute/v2.1/servers/34eaf1d2-9732-4c0e-b970-02fbb449514b => generated 1359 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:10.767905 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f8453364-eff8-4b6a-b574-fb689169552f tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] Action: 'update', calling method: .version_select at 0x7f0b47fac4c0>, body: {"quota_set": {"ram": 51200}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:16:10.910458 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f8453364-eff8-4b6a-b574-fb689169552f tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:10.911689 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f8453364-eff8-4b6a-b574-fb689169552f tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:10.913332 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f8453364-eff8-4b6a-b574-fb689169552f tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:10.914483 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f8453364-eff8-4b6a-b574-fb689169552f tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:10.927016 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c82ed680-caf0-45f8-83df-d51e6ef2ee52 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf92af08fa94215b4eafcacea6c63f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e7d37a0e3b4b32ae99c3bc15a831e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:10.939820 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c82ed680-caf0-45f8-83df-d51e6ef2ee52 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "GET /compute/v2.1/servers/36204b8b-c78e-447c-a3e7-f1f22c6ffe1f" status: 200 len: 1318 microversion: 2.1 time: 0.423433 Jul 23 21:16:10.942711 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 358/792] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:16:10 2022] GET /compute/v2.1/servers/36204b8b-c78e-447c-a3e7-f1f22c6ffe1f => generated 1318 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:10.959288 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e8b4ba4d-bb49-49d6-8192-b02dcb6fba7f tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:10.959812 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e8b4ba4d-bb49-49d6-8192-b02dcb6fba7f tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] [instance: fc41b6cc-f603-4f7d-89cb-a7e3cee372a5] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:10.973551 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e8b4ba4d-bb49-49d6-8192-b02dcb6fba7f tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:10.973977 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e8b4ba4d-bb49-49d6-8192-b02dcb6fba7f tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:10.974860 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e8b4ba4d-bb49-49d6-8192-b02dcb6fba7f tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:10.975336 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e8b4ba4d-bb49-49d6-8192-b02dcb6fba7f tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:10.993929 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-f8453364-eff8-4b6a-b574-fb689169552f tempest-QuotasAdminNegativeTest-1459539385 tempest-QuotasAdminNegativeTest-1459539385-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-quota-sets/eef12e9221c04a6cbee380b903a30363" status: 200 len: 329 microversion: 2.1 time: 0.231064 Jul 23 21:16:10.994984 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 435/793] 10.222.0.17 () {60 vars in 1261 bytes} [Sat Jul 23 21:16:10 2022] PUT /compute/v2.1/os-quota-sets/eef12e9221c04a6cbee380b903a30363 => generated 329 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:16:11.004076 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-38245511-9912-4a31-8651-71ed50c42527 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:11.005075 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-38245511-9912-4a31-8651-71ed50c42527 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 5bc4befa-252d-456a-92cd-323bad80fcdf] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:11.014365 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-38245511-9912-4a31-8651-71ed50c42527 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:11.015126 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-38245511-9912-4a31-8651-71ed50c42527 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:11.016120 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-38245511-9912-4a31-8651-71ed50c42527 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:11.016796 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-38245511-9912-4a31-8651-71ed50c42527 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:11.034581 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e8b4ba4d-bb49-49d6-8192-b02dcb6fba7f tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] [instance: fc41b6cc-f603-4f7d-89cb-a7e3cee372a5] Going to try to terminate instance {{(pid=131320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:16:11.224182 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e8b4ba4d-bb49-49d6-8192-b02dcb6fba7f tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] 10.222.0.17 "DELETE /compute/v2.1/servers/fc41b6cc-f603-4f7d-89cb-a7e3cee372a5" status: 204 len: 0 microversion: 2.1 time: 0.275624 Jul 23 21:16:11.226597 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 359/794] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:16:10 2022] DELETE /compute/v2.1/servers/fc41b6cc-f603-4f7d-89cb-a7e3cee372a5 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:16:11.253744 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2416bb03-1207-44c5-8552-faee6e8d7842 tempest-QuotasAdminNegativeTest-1955886607 tempest-QuotasAdminNegativeTest-1955886607-project] Action: 'update', calling method: .version_select at 0x7f0b47dc2a60>, body: {"quota_set": {"ram": 0}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:16:11.262093 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-2416bb03-1207-44c5-8552-faee6e8d7842 tempest-QuotasAdminNegativeTest-1955886607 tempest-QuotasAdminNegativeTest-1955886607-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': 'a62c9c8b061b4d29b61696314907c572', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eef12e9221c04a6cbee380b903a30363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:11.267036 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2416bb03-1207-44c5-8552-faee6e8d7842 tempest-QuotasAdminNegativeTest-1955886607 tempest-QuotasAdminNegativeTest-1955886607-project] Request method failure captured: Jul 23 21:16:11.267036 ncdv-master-1 devstack@n-api.service[131320]: request: PUT /compute/v2.1/os-quota-sets/eef12e9221c04a6cbee380b903a30363 HTTP/1.1 Jul 23 21:16:11.267036 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:16:11.267036 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:16:11.267036 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:16:11.267036 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 25 Jul 23 21:16:11.267036 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:16:11.267036 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:16:11.267036 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:16:11.267036 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:16:11.267036 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GUPlW-fE2cczqdvyVuzbiPs78hchm0GqBwSQOFwGgehCtuqn92H2FDD6t_IUpk07Q8u5iFrSH8fSbJRqQHBn8sUorPlrHvQvcLpMTiRGriGWqQ71QsbY6H1sDQJJcmOPbexm664JpBXpcu-zLIe5g3boZhneJlDcuWrSIxnLUxKWpw Jul 23 21:16:11.267036 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:16:11.267036 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:16:11.267036 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:16:11.267036 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:16:11.267036 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:16:11.267036 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:16:11.267036 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: eef12e9221c04a6cbee380b903a30363 Jul 23 21:16:11.267036 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-QuotasAdminNegativeTest-1955886607 Jul 23 21:16:11.267036 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:16:11.267036 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:16:11.268726 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/eef12e9221c04a6cbee380b903a30363"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/eef12e9221c04a6cbee380b903a30363"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_eef12e9221c04a6cbee380b903a30363", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/eef12e9221c04a6cbee380b903a30363"}]}] Jul 23 21:16:11.268726 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-QuotasAdminNegativeTest-1955886607 Jul 23 21:16:11.268726 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: eef12e9221c04a6cbee380b903a30363 Jul 23 21:16:11.268726 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1955886607 Jul 23 21:16:11.268726 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-QuotasAdminNegativeTest-1955886607-project Jul 23 21:16:11.268726 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:16:11.268726 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:16:11.268726 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: a62c9c8b061b4d29b61696314907c572 Jul 23 21:16:11.268726 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-QuotasAdminNegativeTest-1955886607-project Jul 23 21:16:11.268726 ncdv-master-1 devstack@n-api.service[131320]: Jul 23 21:16:11.268726 ncdv-master-1 devstack@n-api.service[131320]: {"quota_set": {"ram": 0}} Jul 23 21:16:11.268726 ncdv-master-1 devstack@n-api.service[131320]: method: Jul 23 21:16:11.268726 ncdv-master-1 devstack@n-api.service[131320]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jul 23 21:16:11.268726 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': 'eef12e9221c04a6cbee380b903a30363', 'body': {'quota_set': {'ram': 0}}} Jul 23 21:16:11.269948 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:16:11.269948 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:16:11.269948 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:16:11.269948 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:16:11.269948 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:16:11.269948 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:16:11.269948 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:16:11.269948 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:16:11.269948 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:16:11.269948 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:16:11.269948 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:16:11.269948 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:16:11.269948 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Jul 23 21:16:11.269948 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Jul 23 21:16:11.269948 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 23 21:16:11.269948 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:16:11.269948 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 23 21:16:11.269948 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:16:11.269948 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Jul 23 21:16:11.271347 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Jul 23 21:16:11.271347 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 23 21:16:11.271347 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 23 21:16:11.271347 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 23 21:16:11.271347 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 23 21:16:11.271347 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 23 21:16:11.271347 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 23 21:16:11.271347 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 23 21:16:11.271347 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise self.value Jul 23 21:16:11.271347 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 23 21:16:11.271347 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 23 21:16:11.271347 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 23 21:16:11.271347 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 23 21:16:11.271347 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 23 21:16:11.271347 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 23 21:16:11.271347 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jul 23 21:16:11.271347 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:16:11.271347 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:16:11.271347 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:16:11.271347 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:16:11.273125 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:16:11.273125 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:16:11.273125 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 23 21:16:11.273125 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 23 21:16:11.273125 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jul 23 21:16:11.273125 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:16:11.276447 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2416bb03-1207-44c5-8552-faee6e8d7842 tempest-QuotasAdminNegativeTest-1955886607 tempest-QuotasAdminNegativeTest-1955886607-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:16:11.280000 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2416bb03-1207-44c5-8552-faee6e8d7842 tempest-QuotasAdminNegativeTest-1955886607 tempest-QuotasAdminNegativeTest-1955886607-project] 10.222.0.17 "PUT /compute/v2.1/os-quota-sets/eef12e9221c04a6cbee380b903a30363" status: 403 len: 116 microversion: 2.1 time: 0.050641 Jul 23 21:16:11.282417 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 360/795] 10.222.0.17 () {60 vars in 1261 bytes} [Sat Jul 23 21:16:11 2022] PUT /compute/v2.1/os-quota-sets/eef12e9221c04a6cbee380b903a30363 => generated 116 bytes in 55 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:16:11.312278 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-485e7cbd-1824-493e-85d3-fd987d61970b tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:11.326377 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-485e7cbd-1824-493e-85d3-fd987d61970b tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 9b360b14-9ea2-4336-b32e-d6546267664e] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:11.340362 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-485e7cbd-1824-493e-85d3-fd987d61970b tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:11.340841 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-485e7cbd-1824-493e-85d3-fd987d61970b tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:11.341675 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-485e7cbd-1824-493e-85d3-fd987d61970b tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:11.348863 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-485e7cbd-1824-493e-85d3-fd987d61970b tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:11.632239 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-38245511-9912-4a31-8651-71ed50c42527 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:11.641769 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-38245511-9912-4a31-8651-71ed50c42527 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/5bc4befa-252d-456a-92cd-323bad80fcdf" status: 200 len: 1476 microversion: 2.1 time: 0.645434 Jul 23 21:16:11.646613 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 436/796] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:16:10 2022] GET /compute/v2.1/servers/5bc4befa-252d-456a-92cd-323bad80fcdf => generated 1476 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:11.663810 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-2c00e277-859a-4893-876d-acb72481e5ae req-aa3e13c1-a2df-4ccd-a6d0-1410ff409fca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7558d52c-24e7-4115-88f7-ced193819c33", "name": "network-vif-unplugged", "status": "completed", "tag": "ba673080-c139-468a-94c4-8bd962f254a6"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:16:11.678293 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-2c00e277-859a-4893-876d-acb72481e5ae req-aa3e13c1-a2df-4ccd-a6d0-1410ff409fca service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:11.683575 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-2c00e277-859a-4893-876d-acb72481e5ae req-aa3e13c1-a2df-4ccd-a6d0-1410ff409fca service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:11.714526 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-2c00e277-859a-4893-876d-acb72481e5ae req-aa3e13c1-a2df-4ccd-a6d0-1410ff409fca service nova] Creating event network-vif-unplugged:ba673080-c139-468a-94c4-8bd962f254a6 for instance 7558d52c-24e7-4115-88f7-ced193819c33 on nch1-master-1 Jul 23 21:16:11.731982 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-2c00e277-859a-4893-876d-acb72481e5ae req-aa3e13c1-a2df-4ccd-a6d0-1410ff409fca service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.083882 Jul 23 21:16:11.732600 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 437/797] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:16:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:16:11.752166 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-66e2d9eb-3df4-4aae-9246-2541dbff91c1 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1582164667", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "231097847", "adminPass": "***", "networks": [{"uuid": "523a5244-1039-418e-81fd-9fdb77c1b606"}], "security_groups": [{"name": "tempest-securitygroup--1538760754"}], "key_name": "tempest-keypair-69753320", "user_data": "}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:16:11.893631 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-485e7cbd-1824-493e-85d3-fd987d61970b tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4f9dda4c2a411cb0394bf86e9ae223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580ed681cbf44d10936259b17f60f1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:11.907575 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-485e7cbd-1824-493e-85d3-fd987d61970b tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/servers/9b360b14-9ea2-4336-b32e-d6546267664e" status: 200 len: 1308 microversion: 2.1 time: 0.622092 Jul 23 21:16:11.919703 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 361/798] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:16:11 2022] GET /compute/v2.1/servers/9b360b14-9ea2-4336-b32e-d6546267664e => generated 1308 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:11.920121 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-49cad324-c0b6-41ef-92ed-219c2a3c1097 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:11.921403 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-49cad324-c0b6-41ef-92ed-219c2a3c1097 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: 7558d52c-24e7-4115-88f7-ced193819c33] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:11.941010 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-49cad324-c0b6-41ef-92ed-219c2a3c1097 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:11.941485 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-49cad324-c0b6-41ef-92ed-219c2a3c1097 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:11.944326 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-49cad324-c0b6-41ef-92ed-219c2a3c1097 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:11.944795 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-49cad324-c0b6-41ef-92ed-219c2a3c1097 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:12.177812 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.network.neutron [None req-66e2d9eb-3df4-4aae-9246-2541dbff91c1 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] validate_networks() for [('523a5244-1039-418e-81fd-9fdb77c1b606', None, None, None, None, None)] {{(pid=131321) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:16:12.298199 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-49cad324-c0b6-41ef-92ed-219c2a3c1097 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:12.323043 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-49cad324-c0b6-41ef-92ed-219c2a3c1097 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:12.324951 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-49cad324-c0b6-41ef-92ed-219c2a3c1097 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:12.327175 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-49cad324-c0b6-41ef-92ed-219c2a3c1097 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/7558d52c-24e7-4115-88f7-ced193819c33" status: 200 len: 1569 microversion: 2.25 time: 0.413661 Jul 23 21:16:12.340545 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 362/799] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:16:11 2022] GET /compute/v2.1/servers/7558d52c-24e7-4115-88f7-ced193819c33 => generated 1569 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:16:12.346974 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3fd5fb91-9b5a-46ad-9927-f10a4edea1c7 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:12.348225 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-3fd5fb91-9b5a-46ad-9927-f10a4edea1c7 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 34eaf1d2-9732-4c0e-b970-02fbb449514b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:12.356563 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3fd5fb91-9b5a-46ad-9927-f10a4edea1c7 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:12.357294 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3fd5fb91-9b5a-46ad-9927-f10a4edea1c7 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:12.358597 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3fd5fb91-9b5a-46ad-9927-f10a4edea1c7 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:12.359214 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3fd5fb91-9b5a-46ad-9927-f10a4edea1c7 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:12.570430 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-3fd5fb91-9b5a-46ad-9927-f10a4edea1c7 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:12.587154 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-3fd5fb91-9b5a-46ad-9927-f10a4edea1c7 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/34eaf1d2-9732-4c0e-b970-02fbb449514b" status: 200 len: 1359 microversion: 2.1 time: 0.244845 Jul 23 21:16:12.588086 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 363/800] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:16:12 2022] GET /compute/v2.1/servers/34eaf1d2-9732-4c0e-b970-02fbb449514b => generated 1359 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:12.593056 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-086dde64-b59f-47c4-a779-de4e47453b9e tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:12.594082 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-086dde64-b59f-47c4-a779-de4e47453b9e tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: 36204b8b-c78e-447c-a3e7-f1f22c6ffe1f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:12.643013 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-086dde64-b59f-47c4-a779-de4e47453b9e tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:12.659055 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-086dde64-b59f-47c4-a779-de4e47453b9e tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:12.662046 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-086dde64-b59f-47c4-a779-de4e47453b9e tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:12.674125 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-086dde64-b59f-47c4-a779-de4e47453b9e tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:13.191311 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-086dde64-b59f-47c4-a779-de4e47453b9e tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf92af08fa94215b4eafcacea6c63f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e7d37a0e3b4b32ae99c3bc15a831e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:13.204721 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-086dde64-b59f-47c4-a779-de4e47453b9e tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "GET /compute/v2.1/servers/36204b8b-c78e-447c-a3e7-f1f22c6ffe1f" status: 200 len: 1318 microversion: 2.1 time: 0.615265 Jul 23 21:16:13.205537 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 364/801] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:16:12 2022] GET /compute/v2.1/servers/36204b8b-c78e-447c-a3e7-f1f22c6ffe1f => generated 1318 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:13.237761 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-ca917261-2d87-450f-9d0f-dd6241fd8123 req-07d73f64-7b56-4e8b-846c-9c37c01b3aa9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34eaf1d2-9732-4c0e-b970-02fbb449514b", "tag": "b09648fa-0071-4d7d-ba66-d0da81ab9768"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:16:13.250782 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-ca917261-2d87-450f-9d0f-dd6241fd8123 req-07d73f64-7b56-4e8b-846c-9c37c01b3aa9 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:13.251583 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-ca917261-2d87-450f-9d0f-dd6241fd8123 req-07d73f64-7b56-4e8b-846c-9c37c01b3aa9 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:13.276128 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-ca917261-2d87-450f-9d0f-dd6241fd8123 req-07d73f64-7b56-4e8b-846c-9c37c01b3aa9 service nova] Creating event network-changed:b09648fa-0071-4d7d-ba66-d0da81ab9768 for instance 34eaf1d2-9732-4c0e-b970-02fbb449514b on nch2-master-1 Jul 23 21:16:13.283978 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-ca917261-2d87-450f-9d0f-dd6241fd8123 req-07d73f64-7b56-4e8b-846c-9c37c01b3aa9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066640 Jul 23 21:16:13.285183 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 365/802] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:16:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:16:13.292646 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-97aecb18-23b9-42a8-bc67-e2b2e6f2f441 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:13.302582 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-97aecb18-23b9-42a8-bc67-e2b2e6f2f441 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 5bc4befa-252d-456a-92cd-323bad80fcdf] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:13.312011 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-97aecb18-23b9-42a8-bc67-e2b2e6f2f441 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:13.312507 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-97aecb18-23b9-42a8-bc67-e2b2e6f2f441 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:13.318109 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-97aecb18-23b9-42a8-bc67-e2b2e6f2f441 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:13.318760 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-97aecb18-23b9-42a8-bc67-e2b2e6f2f441 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:13.965161 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-97aecb18-23b9-42a8-bc67-e2b2e6f2f441 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:13.975564 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-97aecb18-23b9-42a8-bc67-e2b2e6f2f441 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/5bc4befa-252d-456a-92cd-323bad80fcdf" status: 200 len: 1476 microversion: 2.1 time: 0.688508 Jul 23 21:16:13.992551 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 366/803] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:16:13 2022] GET /compute/v2.1/servers/5bc4befa-252d-456a-92cd-323bad80fcdf => generated 1476 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:14.000469 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f022154a-b58f-4ce3-bb15-3c09acf3a7d0 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:14.002205 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f022154a-b58f-4ce3-bb15-3c09acf3a7d0 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 9b360b14-9ea2-4336-b32e-d6546267664e] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:14.016989 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f022154a-b58f-4ce3-bb15-3c09acf3a7d0 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:14.018120 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f022154a-b58f-4ce3-bb15-3c09acf3a7d0 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:14.019710 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f022154a-b58f-4ce3-bb15-3c09acf3a7d0 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:14.020363 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f022154a-b58f-4ce3-bb15-3c09acf3a7d0 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:14.483749 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f022154a-b58f-4ce3-bb15-3c09acf3a7d0 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4f9dda4c2a411cb0394bf86e9ae223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580ed681cbf44d10936259b17f60f1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:14.493677 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f022154a-b58f-4ce3-bb15-3c09acf3a7d0 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/servers/9b360b14-9ea2-4336-b32e-d6546267664e" status: 200 len: 1488 microversion: 2.1 time: 0.499505 Jul 23 21:16:14.494311 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 367/804] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:16:13 2022] GET /compute/v2.1/servers/9b360b14-9ea2-4336-b32e-d6546267664e => generated 1488 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:14.515967 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0f28664b-a375-49b7-b607-3f31b6fe1a03 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:14.517127 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-0f28664b-a375-49b7-b607-3f31b6fe1a03 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: 7558d52c-24e7-4115-88f7-ced193819c33] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:14.533202 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0f28664b-a375-49b7-b607-3f31b6fe1a03 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:14.534354 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0f28664b-a375-49b7-b607-3f31b6fe1a03 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:14.538478 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0f28664b-a375-49b7-b607-3f31b6fe1a03 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:14.539812 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0f28664b-a375-49b7-b607-3f31b6fe1a03 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:14.681534 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-66e2d9eb-3df4-4aae-9246-2541dbff91c1 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Flavor limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:16:14.684502 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-66e2d9eb-3df4-4aae-9246-2541dbff91c1 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Image limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:16:14.698832 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-66e2d9eb-3df4-4aae-9246-2541dbff91c1 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Flavor pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:16:14.699691 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-66e2d9eb-3df4-4aae-9246-2541dbff91c1 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Image pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:16:14.700383 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-66e2d9eb-3df4-4aae-9246-2541dbff91c1 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:16:14.735320 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-66e2d9eb-3df4-4aae-9246-2541dbff91c1 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:14.735791 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-66e2d9eb-3df4-4aae-9246-2541dbff91c1 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:14.741154 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-66e2d9eb-3df4-4aae-9246-2541dbff91c1 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:14.742039 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-66e2d9eb-3df4-4aae-9246-2541dbff91c1 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:14.774300 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-66e2d9eb-3df4-4aae-9246-2541dbff91c1 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Getting quotas for project d3c17bd813264fb9891076799e33acca. Resources: {'ram', 'instances', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:16:14.791890 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-66e2d9eb-3df4-4aae-9246-2541dbff91c1 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Getting quotas for user 39f1a14a59b7401d88f18ec35c91e30a and project d3c17bd813264fb9891076799e33acca. Resources: {'ram', 'instances', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:16:14.829212 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-66e2d9eb-3df4-4aae-9246-2541dbff91c1 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Going to run 1 instances... {{(pid=131321) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:16:14.838605 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-66e2d9eb-3df4-4aae-9246-2541dbff91c1 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] [instance: 26494d1b-0e9c-45ac-90f7-55924a958e4c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=131321) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:16:14.924492 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-66e2d9eb-3df4-4aae-9246-2541dbff91c1 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.190639 Jul 23 21:16:14.934021 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 438/805] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:16:11 2022] POST /compute/v2.1/servers => generated 402 bytes in 3201 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 23 21:16:14.940780 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-3dc29e85-e365-4497-bc2f-571579a4a20f tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:14.941750 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-3dc29e85-e365-4497-bc2f-571579a4a20f tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 34eaf1d2-9732-4c0e-b970-02fbb449514b] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:14.949168 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3dc29e85-e365-4497-bc2f-571579a4a20f tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:14.949944 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3dc29e85-e365-4497-bc2f-571579a4a20f tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:14.951050 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3dc29e85-e365-4497-bc2f-571579a4a20f tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:14.951803 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3dc29e85-e365-4497-bc2f-571579a4a20f tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:15.436555 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-3dc29e85-e365-4497-bc2f-571579a4a20f tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:15.440836 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=100 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:16:15.446515 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-3dc29e85-e365-4497-bc2f-571579a4a20f tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/34eaf1d2-9732-4c0e-b970-02fbb449514b" status: 200 len: 1359 microversion: 2.1 time: 0.510516 Jul 23 21:16:15.458104 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 439/806] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:16:14 2022] GET /compute/v2.1/servers/34eaf1d2-9732-4c0e-b970-02fbb449514b => generated 1359 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:15.471290 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-b5dfe78b-f10c-4b47-b2f0-7c10a57e68b8 req-be488372-20f4-4f44-8374-4606c41e1c0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7558d52c-24e7-4115-88f7-ced193819c33", "tag": "ba673080-c139-468a-94c4-8bd962f254a6"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:16:15.494047 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-b5dfe78b-f10c-4b47-b2f0-7c10a57e68b8 req-be488372-20f4-4f44-8374-4606c41e1c0d service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:15.503128 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-b5dfe78b-f10c-4b47-b2f0-7c10a57e68b8 req-be488372-20f4-4f44-8374-4606c41e1c0d service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:15.528421 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-b5dfe78b-f10c-4b47-b2f0-7c10a57e68b8 req-be488372-20f4-4f44-8374-4606c41e1c0d service nova] Creating event network-changed:ba673080-c139-468a-94c4-8bd962f254a6 for instance 7558d52c-24e7-4115-88f7-ced193819c33 on nch1-master-1 Jul 23 21:16:15.549120 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-b5dfe78b-f10c-4b47-b2f0-7c10a57e68b8 req-be488372-20f4-4f44-8374-4606c41e1c0d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087898 Jul 23 21:16:15.551104 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 440/807] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:16:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:16:15.560258 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-0d741666-7058-40cb-844f-df225fb7df4d req-d9b601e8-e739-4834-b9ee-66eb251bc2e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bbeec29-35ee-44ca-a0f0-3dbe2198e5bf", "name": "network-vif-plugged", "status": "completed", "tag": "74ad436d-bbbc-4932-b444-95cdeceb5cd1"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:16:15.571668 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-0d741666-7058-40cb-844f-df225fb7df4d req-d9b601e8-e739-4834-b9ee-66eb251bc2e1 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:15.572328 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-0d741666-7058-40cb-844f-df225fb7df4d req-d9b601e8-e739-4834-b9ee-66eb251bc2e1 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:15.587153 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-0d741666-7058-40cb-844f-df225fb7df4d req-d9b601e8-e739-4834-b9ee-66eb251bc2e1 service nova] Creating event network-vif-plugged:74ad436d-bbbc-4932-b444-95cdeceb5cd1 for instance 5bbeec29-35ee-44ca-a0f0-3dbe2198e5bf on nch2-master-1 Jul 23 21:16:15.594531 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-0d741666-7058-40cb-844f-df225fb7df4d req-d9b601e8-e739-4834-b9ee-66eb251bc2e1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041114 Jul 23 21:16:15.596825 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 441/808] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:16:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:16:15.604783 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-55544424-d536-4b29-a001-28e42aab3d70 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:15.606016 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-55544424-d536-4b29-a001-28e42aab3d70 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: 36204b8b-c78e-447c-a3e7-f1f22c6ffe1f] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:15.616680 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-55544424-d536-4b29-a001-28e42aab3d70 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:15.617082 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-55544424-d536-4b29-a001-28e42aab3d70 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:15.618037 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-55544424-d536-4b29-a001-28e42aab3d70 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:15.618484 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-55544424-d536-4b29-a001-28e42aab3d70 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:15.667846 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-0f28664b-a375-49b7-b607-3f31b6fe1a03 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:15.678410 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-0f28664b-a375-49b7-b607-3f31b6fe1a03 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:15.680411 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-0f28664b-a375-49b7-b607-3f31b6fe1a03 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:15.681745 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-0f28664b-a375-49b7-b607-3f31b6fe1a03 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/7558d52c-24e7-4115-88f7-ced193819c33" status: 200 len: 1569 microversion: 2.25 time: 1.170563 Jul 23 21:16:15.692475 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 368/809] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:16:14 2022] GET /compute/v2.1/servers/7558d52c-24e7-4115-88f7-ced193819c33 => generated 1569 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:16:15.692475 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e7c08ab8-bfcd-47e5-a9fa-abb7b84e37d2 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:16:15.692475 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e7c08ab8-bfcd-47e5-a9fa-abb7b84e37d2 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 9b360b14-9ea2-4336-b32e-d6546267664e] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:15.698443 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e7c08ab8-bfcd-47e5-a9fa-abb7b84e37d2 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:15.698947 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e7c08ab8-bfcd-47e5-a9fa-abb7b84e37d2 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:15.699742 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e7c08ab8-bfcd-47e5-a9fa-abb7b84e37d2 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:15.700181 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e7c08ab8-bfcd-47e5-a9fa-abb7b84e37d2 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:15.805981 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e7c08ab8-bfcd-47e5-a9fa-abb7b84e37d2 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "POST /compute/v2.1/servers/9b360b14-9ea2-4336-b32e-d6546267664e/action" status: 202 len: 0 microversion: 2.1 time: 0.119438 Jul 23 21:16:15.808336 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 369/810] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:16:15 2022] POST /compute/v2.1/servers/9b360b14-9ea2-4336-b32e-d6546267664e/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:16:15.832456 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-544a4ac3-d613-4476-b806-b51e7c722131 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:15.837931 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-544a4ac3-d613-4476-b806-b51e7c722131 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] [instance: 26494d1b-0e9c-45ac-90f7-55924a958e4c] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:15.851983 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-544a4ac3-d613-4476-b806-b51e7c722131 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:15.856079 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-544a4ac3-d613-4476-b806-b51e7c722131 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:15.857573 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-544a4ac3-d613-4476-b806-b51e7c722131 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:15.858303 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-544a4ac3-d613-4476-b806-b51e7c722131 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:15.987066 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-55544424-d536-4b29-a001-28e42aab3d70 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf92af08fa94215b4eafcacea6c63f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e7d37a0e3b4b32ae99c3bc15a831e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:16.002964 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-55544424-d536-4b29-a001-28e42aab3d70 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "GET /compute/v2.1/servers/36204b8b-c78e-447c-a3e7-f1f22c6ffe1f" status: 200 len: 1318 microversion: 2.1 time: 0.404368 Jul 23 21:16:16.003566 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 442/811] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:16:15 2022] GET /compute/v2.1/servers/36204b8b-c78e-447c-a3e7-f1f22c6ffe1f => generated 1318 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:16.008910 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ec094d42-23ad-4c88-ac2d-7c8f9fc5bac3 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:16.016199 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-ec094d42-23ad-4c88-ac2d-7c8f9fc5bac3 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 5bc4befa-252d-456a-92cd-323bad80fcdf] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:16.030977 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ec094d42-23ad-4c88-ac2d-7c8f9fc5bac3 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:16.031419 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ec094d42-23ad-4c88-ac2d-7c8f9fc5bac3 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:16.032619 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ec094d42-23ad-4c88-ac2d-7c8f9fc5bac3 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:16.032619 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ec094d42-23ad-4c88-ac2d-7c8f9fc5bac3 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:16.054757 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-544a4ac3-d613-4476-b806-b51e7c722131 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f1a14a59b7401d88f18ec35c91e30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c17bd813264fb9891076799e33acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:16.069227 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-544a4ac3-d613-4476-b806-b51e7c722131 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] 10.222.0.17 "GET /compute/v2.1/servers/26494d1b-0e9c-45ac-90f7-55924a958e4c" status: 200 len: 1265 microversion: 2.1 time: 0.246134 Jul 23 21:16:16.069992 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 370/812] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:16:15 2022] GET /compute/v2.1/servers/26494d1b-0e9c-45ac-90f7-55924a958e4c => generated 1265 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:16.084083 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-617c44eb-ecc1-4b1d-89c0-71dc46fe2ea6 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:16.084882 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-617c44eb-ecc1-4b1d-89c0-71dc46fe2ea6 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 9b360b14-9ea2-4336-b32e-d6546267664e] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:16.093810 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-617c44eb-ecc1-4b1d-89c0-71dc46fe2ea6 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:16.094825 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-617c44eb-ecc1-4b1d-89c0-71dc46fe2ea6 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:16.096880 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-617c44eb-ecc1-4b1d-89c0-71dc46fe2ea6 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:16.099685 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-617c44eb-ecc1-4b1d-89c0-71dc46fe2ea6 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:16.355153 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ec094d42-23ad-4c88-ac2d-7c8f9fc5bac3 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:16.366440 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-ec094d42-23ad-4c88-ac2d-7c8f9fc5bac3 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/5bc4befa-252d-456a-92cd-323bad80fcdf" status: 200 len: 1473 microversion: 2.1 time: 0.361298 Jul 23 21:16:16.367184 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 443/813] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:16:16 2022] GET /compute/v2.1/servers/5bc4befa-252d-456a-92cd-323bad80fcdf => generated 1473 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:16.387216 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-617c44eb-ecc1-4b1d-89c0-71dc46fe2ea6 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4f9dda4c2a411cb0394bf86e9ae223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580ed681cbf44d10936259b17f60f1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:16.399274 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-617c44eb-ecc1-4b1d-89c0-71dc46fe2ea6 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/servers/9b360b14-9ea2-4336-b32e-d6546267664e" status: 200 len: 1493 microversion: 2.1 time: 0.326647 Jul 23 21:16:16.403575 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 371/814] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:16:16 2022] GET /compute/v2.1/servers/9b360b14-9ea2-4336-b32e-d6546267664e => generated 1493 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:16.463433 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-171b9fc7-5e35-44d7-b3b2-877b68ded4a9 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:16.464044 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-171b9fc7-5e35-44d7-b3b2-877b68ded4a9 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 34eaf1d2-9732-4c0e-b970-02fbb449514b] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:16.472377 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-171b9fc7-5e35-44d7-b3b2-877b68ded4a9 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:16.472829 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-171b9fc7-5e35-44d7-b3b2-877b68ded4a9 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:16.473609 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-171b9fc7-5e35-44d7-b3b2-877b68ded4a9 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:16.474179 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-171b9fc7-5e35-44d7-b3b2-877b68ded4a9 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:16.701582 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-995ecfdf-d52a-4af5-8fb5-3a3acd8ebf9d tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:16.703087 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-995ecfdf-d52a-4af5-8fb5-3a3acd8ebf9d tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: 7558d52c-24e7-4115-88f7-ced193819c33] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:16.711183 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-995ecfdf-d52a-4af5-8fb5-3a3acd8ebf9d tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:16.712126 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-995ecfdf-d52a-4af5-8fb5-3a3acd8ebf9d tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:16.713142 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-995ecfdf-d52a-4af5-8fb5-3a3acd8ebf9d tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:16.713896 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-995ecfdf-d52a-4af5-8fb5-3a3acd8ebf9d tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:17.005792 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-171b9fc7-5e35-44d7-b3b2-877b68ded4a9 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:17.025662 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-171b9fc7-5e35-44d7-b3b2-877b68ded4a9 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/34eaf1d2-9732-4c0e-b970-02fbb449514b" status: 200 len: 1359 microversion: 2.1 time: 0.565422 Jul 23 21:16:17.026326 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 444/815] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:16:16 2022] GET /compute/v2.1/servers/34eaf1d2-9732-4c0e-b970-02fbb449514b => generated 1359 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:17.039414 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-84e36040-926c-4119-bd74-68b829b9dd0e tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:17.042152 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-84e36040-926c-4119-bd74-68b829b9dd0e tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: 36204b8b-c78e-447c-a3e7-f1f22c6ffe1f] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:17.058330 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-84e36040-926c-4119-bd74-68b829b9dd0e tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:17.059151 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-84e36040-926c-4119-bd74-68b829b9dd0e tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:17.061112 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-84e36040-926c-4119-bd74-68b829b9dd0e tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:17.061752 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-84e36040-926c-4119-bd74-68b829b9dd0e tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:17.133982 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-995ecfdf-d52a-4af5-8fb5-3a3acd8ebf9d tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:17.149749 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-995ecfdf-d52a-4af5-8fb5-3a3acd8ebf9d tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:17.161849 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-995ecfdf-d52a-4af5-8fb5-3a3acd8ebf9d tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:17.166824 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-995ecfdf-d52a-4af5-8fb5-3a3acd8ebf9d tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/7558d52c-24e7-4115-88f7-ced193819c33" status: 200 len: 1569 microversion: 2.25 time: 0.469734 Jul 23 21:16:17.169259 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 372/816] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:16:16 2022] GET /compute/v2.1/servers/7558d52c-24e7-4115-88f7-ced193819c33 => generated 1569 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:16:17.183423 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9816695f-fddb-44eb-a58c-fd38be8ae9cb tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:17.184473 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-9816695f-fddb-44eb-a58c-fd38be8ae9cb tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] [instance: 26494d1b-0e9c-45ac-90f7-55924a958e4c] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:17.193731 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9816695f-fddb-44eb-a58c-fd38be8ae9cb tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:17.194595 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9816695f-fddb-44eb-a58c-fd38be8ae9cb tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:17.195705 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9816695f-fddb-44eb-a58c-fd38be8ae9cb tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:17.196377 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9816695f-fddb-44eb-a58c-fd38be8ae9cb tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:17.227034 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:16:17.305458 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-9816695f-fddb-44eb-a58c-fd38be8ae9cb tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f1a14a59b7401d88f18ec35c91e30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c17bd813264fb9891076799e33acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:17.318026 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9816695f-fddb-44eb-a58c-fd38be8ae9cb tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] 10.222.0.17 "GET /compute/v2.1/servers/26494d1b-0e9c-45ac-90f7-55924a958e4c" status: 200 len: 1313 microversion: 2.1 time: 0.147205 Jul 23 21:16:17.318873 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 373/817] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:16:17 2022] GET /compute/v2.1/servers/26494d1b-0e9c-45ac-90f7-55924a958e4c => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:17.370174 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-84e36040-926c-4119-bd74-68b829b9dd0e tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf92af08fa94215b4eafcacea6c63f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e7d37a0e3b4b32ae99c3bc15a831e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:17.387465 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a00e8261-0ca6-48a3-bbdd-44aa4ba6062c tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:17.388091 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a00e8261-0ca6-48a3-bbdd-44aa4ba6062c tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 5bc4befa-252d-456a-92cd-323bad80fcdf] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:17.388743 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-84e36040-926c-4119-bd74-68b829b9dd0e tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "GET /compute/v2.1/servers/36204b8b-c78e-447c-a3e7-f1f22c6ffe1f" status: 200 len: 1318 microversion: 2.1 time: 0.355458 Jul 23 21:16:17.389361 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 445/818] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:16:17 2022] GET /compute/v2.1/servers/36204b8b-c78e-447c-a3e7-f1f22c6ffe1f => generated 1318 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:17.396136 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a00e8261-0ca6-48a3-bbdd-44aa4ba6062c tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:17.397479 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a00e8261-0ca6-48a3-bbdd-44aa4ba6062c tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:17.398474 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a00e8261-0ca6-48a3-bbdd-44aa4ba6062c tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:17.399261 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a00e8261-0ca6-48a3-bbdd-44aa4ba6062c tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:17.419795 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e1a5f9bd-4cf9-4219-af29-5d53331e19ea tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:17.420876 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-e1a5f9bd-4cf9-4219-af29-5d53331e19ea tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 9b360b14-9ea2-4336-b32e-d6546267664e] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:17.427582 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e1a5f9bd-4cf9-4219-af29-5d53331e19ea tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:17.428266 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e1a5f9bd-4cf9-4219-af29-5d53331e19ea tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:17.429191 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e1a5f9bd-4cf9-4219-af29-5d53331e19ea tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:17.429981 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e1a5f9bd-4cf9-4219-af29-5d53331e19ea tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:17.805355 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a00e8261-0ca6-48a3-bbdd-44aa4ba6062c tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:17.816590 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a00e8261-0ca6-48a3-bbdd-44aa4ba6062c tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/5bc4befa-252d-456a-92cd-323bad80fcdf" status: 200 len: 1473 microversion: 2.1 time: 0.434808 Jul 23 21:16:17.816590 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 374/819] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:16:17 2022] GET /compute/v2.1/servers/5bc4befa-252d-456a-92cd-323bad80fcdf => generated 1473 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:17.834334 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-e1a5f9bd-4cf9-4219-af29-5d53331e19ea tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4f9dda4c2a411cb0394bf86e9ae223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580ed681cbf44d10936259b17f60f1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:17.835851 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-2f699727-3fa4-4f84-b8a4-9ed59190afca req-1e9666c0-59bc-4ca3-9caf-3555d5ab5696 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36204b8b-c78e-447c-a3e7-f1f22c6ffe1f", "name": "network-vif-plugged", "status": "completed", "tag": "30f66f72-a68b-4b83-b061-353e991a5389"}, {"server_uuid": "5bc4befa-252d-456a-92cd-323bad80fcdf", "name": "network-vif-unplugged", "status": "completed", "tag": "f00e5169-4343-4b5e-aafd-b0e8eea7078c"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:16:17.853751 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-e1a5f9bd-4cf9-4219-af29-5d53331e19ea tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/servers/9b360b14-9ea2-4336-b32e-d6546267664e" status: 200 len: 1473 microversion: 2.1 time: 0.435931 Jul 23 21:16:17.857177 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 446/820] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:16:17 2022] GET /compute/v2.1/servers/9b360b14-9ea2-4336-b32e-d6546267664e => generated 1473 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:16:17.867729 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-1b26c18b-c40e-46bd-ab5e-0a65c746dc04 req-9f4383f3-42bb-4787-b1f0-4d2c487a5e9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc41b6cc-f603-4f7d-89cb-a7e3cee372a5", "name": "network-vif-deleted", "tag": "3e18f4f9-3b4c-4c36-997a-bc967d44787f"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:16:17.888175 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-2f699727-3fa4-4f84-b8a4-9ed59190afca req-1e9666c0-59bc-4ca3-9caf-3555d5ab5696 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:17.888681 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-2f699727-3fa4-4f84-b8a4-9ed59190afca req-1e9666c0-59bc-4ca3-9caf-3555d5ab5696 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:17.889139 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-1b26c18b-c40e-46bd-ab5e-0a65c746dc04 req-9f4383f3-42bb-4787-b1f0-4d2c487a5e9c service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:17.889735 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-1b26c18b-c40e-46bd-ab5e-0a65c746dc04 req-9f4383f3-42bb-4787-b1f0-4d2c487a5e9c service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:17.948668 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-2f699727-3fa4-4f84-b8a4-9ed59190afca req-1e9666c0-59bc-4ca3-9caf-3555d5ab5696 service nova] Creating event network-vif-plugged:30f66f72-a68b-4b83-b061-353e991a5389 for instance 36204b8b-c78e-447c-a3e7-f1f22c6ffe1f on nch1-master-1 Jul 23 21:16:17.949192 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-2f699727-3fa4-4f84-b8a4-9ed59190afca req-1e9666c0-59bc-4ca3-9caf-3555d5ab5696 service nova] Creating event network-vif-unplugged:f00e5169-4343-4b5e-aafd-b0e8eea7078c for instance 5bc4befa-252d-456a-92cd-323bad80fcdf on nch1-master-1 Jul 23 21:16:17.959255 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-1b26c18b-c40e-46bd-ab5e-0a65c746dc04 req-9f4383f3-42bb-4787-b1f0-4d2c487a5e9c service nova] Creating event network-vif-deleted:3e18f4f9-3b4c-4c36-997a-bc967d44787f for instance fc41b6cc-f603-4f7d-89cb-a7e3cee372a5 on nch2-master-1 Jul 23 21:16:17.964848 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [req-2f699727-3fa4-4f84-b8a4-9ed59190afca req-1e9666c0-59bc-4ca3-9caf-3555d5ab5696 service nova] Instance 5bc4befa-252d-456a-92cd-323bad80fcdf is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1'} {{(pid=131320) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 23 21:16:17.988505 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-1b26c18b-c40e-46bd-ab5e-0a65c746dc04 req-9f4383f3-42bb-4787-b1f0-4d2c487a5e9c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126748 Jul 23 21:16:17.994602 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 447/821] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:16:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:16:17.998716 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-2f699727-3fa4-4f84-b8a4-9ed59190afca req-1e9666c0-59bc-4ca3-9caf-3555d5ab5696 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.180979 Jul 23 21:16:18.005908 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 375/822] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:16:17 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:16:18.014301 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-fc77c70b-b534-46a1-affe-ce23e7ec80b6 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-429113342"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:16:18.015499 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-fc77c70b-b534-46a1-affe-ce23e7ec80b6 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 9b360b14-9ea2-4336-b32e-d6546267664e] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:18.043578 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4126d0fe-3736-4726-a22a-88bcba525c7a tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:18.044360 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-4126d0fe-3736-4726-a22a-88bcba525c7a tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 34eaf1d2-9732-4c0e-b970-02fbb449514b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:18.045556 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fc77c70b-b534-46a1-affe-ce23e7ec80b6 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:18.046050 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fc77c70b-b534-46a1-affe-ce23e7ec80b6 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:18.054690 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fc77c70b-b534-46a1-affe-ce23e7ec80b6 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:18.055092 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4126d0fe-3736-4726-a22a-88bcba525c7a tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:18.055235 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fc77c70b-b534-46a1-affe-ce23e7ec80b6 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:18.055554 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4126d0fe-3736-4726-a22a-88bcba525c7a tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:18.056356 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4126d0fe-3736-4726-a22a-88bcba525c7a tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:18.056808 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4126d0fe-3736-4726-a22a-88bcba525c7a tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:18.824594 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-fc77c70b-b534-46a1-affe-ce23e7ec80b6 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "POST /compute/v2.1/servers/9b360b14-9ea2-4336-b32e-d6546267664e/action" status: 202 len: 0 microversion: 2.1 time: 0.828555 Jul 23 21:16:18.835154 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 448/823] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:16:17 2022] POST /compute/v2.1/servers/9b360b14-9ea2-4336-b32e-d6546267664e/action => generated 0 bytes in 840 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 23 21:16:19.030002 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-4126d0fe-3736-4726-a22a-88bcba525c7a tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:19.049595 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4126d0fe-3736-4726-a22a-88bcba525c7a tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/34eaf1d2-9732-4c0e-b970-02fbb449514b" status: 200 len: 1359 microversion: 2.1 time: 1.005311 Jul 23 21:16:19.050706 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 376/824] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:16:18 2022] GET /compute/v2.1/servers/34eaf1d2-9732-4c0e-b970-02fbb449514b => generated 1359 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:19.067220 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-53692b47-a2e1-4d33-ba47-293850d70b79 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:19.068630 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-53692b47-a2e1-4d33-ba47-293850d70b79 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: 7558d52c-24e7-4115-88f7-ced193819c33] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:19.087279 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-53692b47-a2e1-4d33-ba47-293850d70b79 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:19.097144 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-9c0d1aed-0c07-4cd4-99e1-2970ea9db593 tempest-FloatingIPDetailsTestJSON-1126152156 tempest-FloatingIPDetailsTestJSON-1126152156-project] Action: 'create', calling method: .version_select at 0x7f0b47f2e310>, body: {"pool": null} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:16:19.103577 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-53692b47-a2e1-4d33-ba47-293850d70b79 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:19.104747 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-53692b47-a2e1-4d33-ba47-293850d70b79 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:19.107966 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-53692b47-a2e1-4d33-ba47-293850d70b79 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:19.363709 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-53692b47-a2e1-4d33-ba47-293850d70b79 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:19.373611 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-53692b47-a2e1-4d33-ba47-293850d70b79 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:19.375727 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-53692b47-a2e1-4d33-ba47-293850d70b79 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:19.377642 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-53692b47-a2e1-4d33-ba47-293850d70b79 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/7558d52c-24e7-4115-88f7-ced193819c33" status: 200 len: 1569 microversion: 2.25 time: 0.324738 Jul 23 21:16:19.381830 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 377/825] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:16:19 2022] GET /compute/v2.1/servers/7558d52c-24e7-4115-88f7-ced193819c33 => generated 1569 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:16:19.387491 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-76a09eb8-ccad-4ceb-8beb-0c195eb8e340 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:19.395590 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-76a09eb8-ccad-4ceb-8beb-0c195eb8e340 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] [instance: 26494d1b-0e9c-45ac-90f7-55924a958e4c] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:19.410315 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-76a09eb8-ccad-4ceb-8beb-0c195eb8e340 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:19.410777 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-76a09eb8-ccad-4ceb-8beb-0c195eb8e340 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:19.411595 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-76a09eb8-ccad-4ceb-8beb-0c195eb8e340 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:19.412037 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-76a09eb8-ccad-4ceb-8beb-0c195eb8e340 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:19.525554 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-76a09eb8-ccad-4ceb-8beb-0c195eb8e340 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f1a14a59b7401d88f18ec35c91e30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c17bd813264fb9891076799e33acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:19.539698 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-76a09eb8-ccad-4ceb-8beb-0c195eb8e340 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] 10.222.0.17 "GET /compute/v2.1/servers/26494d1b-0e9c-45ac-90f7-55924a958e4c" status: 200 len: 1319 microversion: 2.1 time: 0.156316 Jul 23 21:16:19.543753 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 378/826] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:16:19 2022] GET /compute/v2.1/servers/26494d1b-0e9c-45ac-90f7-55924a958e4c => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:19.558117 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f35beb42-f2ef-4e57-a87a-5dca0c768fb3 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:19.559111 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f35beb42-f2ef-4e57-a87a-5dca0c768fb3 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: 36204b8b-c78e-447c-a3e7-f1f22c6ffe1f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:19.574339 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f35beb42-f2ef-4e57-a87a-5dca0c768fb3 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:19.575177 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f35beb42-f2ef-4e57-a87a-5dca0c768fb3 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:19.576241 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f35beb42-f2ef-4e57-a87a-5dca0c768fb3 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:19.576804 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f35beb42-f2ef-4e57-a87a-5dca0c768fb3 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:19.837194 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f35beb42-f2ef-4e57-a87a-5dca0c768fb3 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf92af08fa94215b4eafcacea6c63f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e7d37a0e3b4b32ae99c3bc15a831e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:19.850703 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f35beb42-f2ef-4e57-a87a-5dca0c768fb3 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "GET /compute/v2.1/servers/36204b8b-c78e-447c-a3e7-f1f22c6ffe1f" status: 200 len: 1318 microversion: 2.1 time: 0.296418 Jul 23 21:16:19.852201 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 379/827] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:16:19 2022] GET /compute/v2.1/servers/36204b8b-c78e-447c-a3e7-f1f22c6ffe1f => generated 1318 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:19.986070 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d26a814b-545c-4184-a9d3-2a7ed321f80d tempest-ServicesAdminNegativeTestJSON-319353511 tempest-ServicesAdminNegativeTestJSON-319353511-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:19.988161 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:16:19.988161 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:16:19.989960 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d26a814b-545c-4184-a9d3-2a7ed321f80d tempest-ServicesAdminNegativeTestJSON-319353511 tempest-ServicesAdminNegativeTestJSON-319353511-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:19.990938 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d26a814b-545c-4184-a9d3-2a7ed321f80d tempest-ServicesAdminNegativeTestJSON-319353511 tempest-ServicesAdminNegativeTestJSON-319353511-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:19.992075 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d26a814b-545c-4184-a9d3-2a7ed321f80d tempest-ServicesAdminNegativeTestJSON-319353511 tempest-ServicesAdminNegativeTestJSON-319353511-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:19.992889 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d26a814b-545c-4184-a9d3-2a7ed321f80d tempest-ServicesAdminNegativeTestJSON-319353511 tempest-ServicesAdminNegativeTestJSON-319353511-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:20.031972 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d26a814b-545c-4184-a9d3-2a7ed321f80d tempest-ServicesAdminNegativeTestJSON-319353511 tempest-ServicesAdminNegativeTestJSON-319353511-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.177653 Jul 23 21:16:20.036266 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 380/828] 10.222.0.17 () {58 vars in 1136 bytes} [Sat Jul 23 21:16:19 2022] GET /compute/v2.1/os-services => generated 947 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:16:20.044148 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-7972fdde-d25c-4799-b940-651d1113af69 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:20.045066 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-7972fdde-d25c-4799-b940-651d1113af69 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 5bc4befa-252d-456a-92cd-323bad80fcdf] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:20.054621 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7972fdde-d25c-4799-b940-651d1113af69 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:20.057060 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7972fdde-d25c-4799-b940-651d1113af69 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:20.058192 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7972fdde-d25c-4799-b940-651d1113af69 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:20.059971 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7972fdde-d25c-4799-b940-651d1113af69 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:20.090279 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=68 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:16:20.477485 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-7972fdde-d25c-4799-b940-651d1113af69 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:20.493779 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-7972fdde-d25c-4799-b940-651d1113af69 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/5bc4befa-252d-456a-92cd-323bad80fcdf" status: 200 len: 1470 microversion: 2.1 time: 0.456131 Jul 23 21:16:20.494365 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 381/829] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:16:20 2022] GET /compute/v2.1/servers/5bc4befa-252d-456a-92cd-323bad80fcdf => generated 1470 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:20.505549 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3a42e478-a71a-40cf-a727-ed4527030025 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '.version_select at 0x7f0b47cac040>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:20.579532 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-3a42e478-a71a-40cf-a727-ed4527030025 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/images/8a2df693-27eb-4ab8-9b5e-e603a022f603" status: 200 len: 1413 microversion: 2.1 time: 0.083781 Jul 23 21:16:20.580398 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 382/830] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:16:20 2022] GET /compute/v2.1/images/8a2df693-27eb-4ab8-9b5e-e603a022f603 => generated 1413 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:20.586300 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-52860f76-4931-4f3a-b128-bdd765a76175 tempest-ServicesAdminNegativeTestJSON-319353511 tempest-ServicesAdminNegativeTestJSON-319353511-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:20.588359 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:16:20.588359 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:16:20.590620 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-52860f76-4931-4f3a-b128-bdd765a76175 tempest-ServicesAdminNegativeTestJSON-319353511 tempest-ServicesAdminNegativeTestJSON-319353511-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:20.591418 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-52860f76-4931-4f3a-b128-bdd765a76175 tempest-ServicesAdminNegativeTestJSON-319353511 tempest-ServicesAdminNegativeTestJSON-319353511-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:20.592504 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-52860f76-4931-4f3a-b128-bdd765a76175 tempest-ServicesAdminNegativeTestJSON-319353511 tempest-ServicesAdminNegativeTestJSON-319353511-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:20.593039 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-52860f76-4931-4f3a-b128-bdd765a76175 tempest-ServicesAdminNegativeTestJSON-319353511 tempest-ServicesAdminNegativeTestJSON-319353511-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:20.598066 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=17 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:16:20.621730 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-52860f76-4931-4f3a-b128-bdd765a76175 tempest-ServicesAdminNegativeTestJSON-319353511 tempest-ServicesAdminNegativeTestJSON-319353511-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.039769 Jul 23 21:16:20.630337 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 383/831] 10.222.0.17 () {58 vars in 1169 bytes} [Sat Jul 23 21:16:20 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 947 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:16:20.635448 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b06e600f-58fe-4b48-9320-fd9288bcb2ce tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:20.636238 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b06e600f-58fe-4b48-9320-fd9288bcb2ce tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 34eaf1d2-9732-4c0e-b970-02fbb449514b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:20.648269 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b06e600f-58fe-4b48-9320-fd9288bcb2ce tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:20.648985 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b06e600f-58fe-4b48-9320-fd9288bcb2ce tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:20.650002 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b06e600f-58fe-4b48-9320-fd9288bcb2ce tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:20.650592 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b06e600f-58fe-4b48-9320-fd9288bcb2ce tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:20.937171 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b06e600f-58fe-4b48-9320-fd9288bcb2ce tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:20.947381 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b06e600f-58fe-4b48-9320-fd9288bcb2ce tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/34eaf1d2-9732-4c0e-b970-02fbb449514b" status: 200 len: 1359 microversion: 2.1 time: 0.315644 Jul 23 21:16:20.948648 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 384/832] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:16:20 2022] GET /compute/v2.1/servers/34eaf1d2-9732-4c0e-b970-02fbb449514b => generated 1359 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:20.955070 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-b5d6dc5e-b6d5-4c53-bed3-3baff8fae12b req-9362d686-bc0c-4c74-890a-a7702eb7d402 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7558d52c-24e7-4115-88f7-ced193819c33", "name": "network-vif-unplugged", "status": "completed", "tag": "ba673080-c139-468a-94c4-8bd962f254a6"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:16:20.968819 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-b5d6dc5e-b6d5-4c53-bed3-3baff8fae12b req-9362d686-bc0c-4c74-890a-a7702eb7d402 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:20.969289 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-b5d6dc5e-b6d5-4c53-bed3-3baff8fae12b req-9362d686-bc0c-4c74-890a-a7702eb7d402 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:20.985488 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-b5d6dc5e-b6d5-4c53-bed3-3baff8fae12b req-9362d686-bc0c-4c74-890a-a7702eb7d402 service nova] Creating event network-vif-unplugged:ba673080-c139-468a-94c4-8bd962f254a6 for instance 7558d52c-24e7-4115-88f7-ced193819c33 on nch1-master-1 Jul 23 21:16:20.991855 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-b5d6dc5e-b6d5-4c53-bed3-3baff8fae12b req-9362d686-bc0c-4c74-890a-a7702eb7d402 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041323 Jul 23 21:16:20.992847 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 385/833] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:16:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:16:21.000971 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-abd1c62c-274f-4427-8267-28b1d71bd846 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:21.002834 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-abd1c62c-274f-4427-8267-28b1d71bd846 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: 7558d52c-24e7-4115-88f7-ced193819c33] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:21.011246 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-abd1c62c-274f-4427-8267-28b1d71bd846 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:21.011779 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-abd1c62c-274f-4427-8267-28b1d71bd846 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:21.013548 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-abd1c62c-274f-4427-8267-28b1d71bd846 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:21.014062 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-abd1c62c-274f-4427-8267-28b1d71bd846 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:21.202295 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-abd1c62c-274f-4427-8267-28b1d71bd846 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:21.212855 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-abd1c62c-274f-4427-8267-28b1d71bd846 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:21.215261 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-abd1c62c-274f-4427-8267-28b1d71bd846 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:21.217788 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-abd1c62c-274f-4427-8267-28b1d71bd846 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/7558d52c-24e7-4115-88f7-ced193819c33" status: 200 len: 1569 microversion: 2.25 time: 0.223134 Jul 23 21:16:21.218916 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 386/834] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:16:20 2022] GET /compute/v2.1/servers/7558d52c-24e7-4115-88f7-ced193819c33 => generated 1569 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:16:21.230356 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9fa2f527-e920-4640-b1f7-eb30b70159cb tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:16:21.231068 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-9fa2f527-e920-4640-b1f7-eb30b70159cb tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 5bc4befa-252d-456a-92cd-323bad80fcdf] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:21.245295 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9fa2f527-e920-4640-b1f7-eb30b70159cb tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:21.246205 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9fa2f527-e920-4640-b1f7-eb30b70159cb tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:21.247203 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9fa2f527-e920-4640-b1f7-eb30b70159cb tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:21.248436 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9fa2f527-e920-4640-b1f7-eb30b70159cb tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:21.361300 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9fa2f527-e920-4640-b1f7-eb30b70159cb tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "POST /compute/v2.1/servers/5bc4befa-252d-456a-92cd-323bad80fcdf/action" status: 204 len: 0 microversion: 2.1 time: 0.139628 Jul 23 21:16:21.366138 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 387/835] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:16:21 2022] POST /compute/v2.1/servers/5bc4befa-252d-456a-92cd-323bad80fcdf/action => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:16:21.389580 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-bf6ef432-0027-4781-8287-5ba74ee52fab tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:21.390531 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-bf6ef432-0027-4781-8287-5ba74ee52fab tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] [instance: 26494d1b-0e9c-45ac-90f7-55924a958e4c] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:21.429710 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bf6ef432-0027-4781-8287-5ba74ee52fab tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:21.430201 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bf6ef432-0027-4781-8287-5ba74ee52fab tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:21.431022 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bf6ef432-0027-4781-8287-5ba74ee52fab tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:21.431472 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bf6ef432-0027-4781-8287-5ba74ee52fab tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:21.757267 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-bf6ef432-0027-4781-8287-5ba74ee52fab tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f1a14a59b7401d88f18ec35c91e30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c17bd813264fb9891076799e33acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:21.766582 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-bf6ef432-0027-4781-8287-5ba74ee52fab tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] 10.222.0.17 "GET /compute/v2.1/servers/26494d1b-0e9c-45ac-90f7-55924a958e4c" status: 200 len: 1387 microversion: 2.1 time: 0.401248 Jul 23 21:16:21.768019 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 388/836] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:16:21 2022] GET /compute/v2.1/servers/26494d1b-0e9c-45ac-90f7-55924a958e4c => generated 1387 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:21.789428 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ac5b6a6f-93af-4f4a-a554-8d666fa4cc8c tempest-ServicesAdminNegativeTestJSON-319353511 tempest-ServicesAdminNegativeTestJSON-319353511-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:21.794119 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:16:21.794119 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:16:21.798349 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ac5b6a6f-93af-4f4a-a554-8d666fa4cc8c tempest-ServicesAdminNegativeTestJSON-319353511 tempest-ServicesAdminNegativeTestJSON-319353511-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:21.799626 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ac5b6a6f-93af-4f4a-a554-8d666fa4cc8c tempest-ServicesAdminNegativeTestJSON-319353511 tempest-ServicesAdminNegativeTestJSON-319353511-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:21.802175 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ac5b6a6f-93af-4f4a-a554-8d666fa4cc8c tempest-ServicesAdminNegativeTestJSON-319353511 tempest-ServicesAdminNegativeTestJSON-319353511-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:21.802788 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ac5b6a6f-93af-4f4a-a554-8d666fa4cc8c tempest-ServicesAdminNegativeTestJSON-319353511 tempest-ServicesAdminNegativeTestJSON-319353511-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:21.859014 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ac5b6a6f-93af-4f4a-a554-8d666fa4cc8c tempest-ServicesAdminNegativeTestJSON-319353511 tempest-ServicesAdminNegativeTestJSON-319353511-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.078065 Jul 23 21:16:21.860801 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 389/837] 10.222.0.17 () {58 vars in 1136 bytes} [Sat Jul 23 21:16:21 2022] GET /compute/v2.1/os-services => generated 947 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:16:21.866331 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-7df8eb4d-f175-4872-9a5c-f99659939e0d tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:21.867496 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-7df8eb4d-f175-4872-9a5c-f99659939e0d tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: 36204b8b-c78e-447c-a3e7-f1f22c6ffe1f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:21.877536 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7df8eb4d-f175-4872-9a5c-f99659939e0d tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:21.890483 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7df8eb4d-f175-4872-9a5c-f99659939e0d tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:21.892010 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7df8eb4d-f175-4872-9a5c-f99659939e0d tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:21.894484 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7df8eb4d-f175-4872-9a5c-f99659939e0d tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:22.163082 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-7df8eb4d-f175-4872-9a5c-f99659939e0d tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf92af08fa94215b4eafcacea6c63f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e7d37a0e3b4b32ae99c3bc15a831e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:22.178600 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-7df8eb4d-f175-4872-9a5c-f99659939e0d tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "GET /compute/v2.1/servers/36204b8b-c78e-447c-a3e7-f1f22c6ffe1f" status: 200 len: 1468 microversion: 2.1 time: 0.316571 Jul 23 21:16:22.179492 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 390/838] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:16:21 2022] GET /compute/v2.1/servers/36204b8b-c78e-447c-a3e7-f1f22c6ffe1f => generated 1468 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:22.186225 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-409d5e3f-9a70-4702-b0ce-66c192ffbfcc tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:22.188995 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-409d5e3f-9a70-4702-b0ce-66c192ffbfcc tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 5bc4befa-252d-456a-92cd-323bad80fcdf] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:22.203335 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-409d5e3f-9a70-4702-b0ce-66c192ffbfcc tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:22.205202 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-409d5e3f-9a70-4702-b0ce-66c192ffbfcc tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:22.206334 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-409d5e3f-9a70-4702-b0ce-66c192ffbfcc tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:22.207007 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-409d5e3f-9a70-4702-b0ce-66c192ffbfcc tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:22.419310 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-409d5e3f-9a70-4702-b0ce-66c192ffbfcc tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:22.433626 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-409d5e3f-9a70-4702-b0ce-66c192ffbfcc tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/5bc4befa-252d-456a-92cd-323bad80fcdf" status: 200 len: 1470 microversion: 2.1 time: 0.252681 Jul 23 21:16:22.434616 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 391/839] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:16:22 2022] GET /compute/v2.1/servers/5bc4befa-252d-456a-92cd-323bad80fcdf => generated 1470 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:22.446370 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-58efe70b-9225-4da8-a4b3-c06b46feb055 req-dcf06635-4eab-42bc-81f5-8d39280422ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34eaf1d2-9732-4c0e-b970-02fbb449514b", "name": "network-vif-plugged", "status": "completed", "tag": "b09648fa-0071-4d7d-ba66-d0da81ab9768"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:16:22.450355 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:16:22.457019 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-58efe70b-9225-4da8-a4b3-c06b46feb055 req-dcf06635-4eab-42bc-81f5-8d39280422ff service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:22.457465 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-58efe70b-9225-4da8-a4b3-c06b46feb055 req-dcf06635-4eab-42bc-81f5-8d39280422ff service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:22.473298 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-58efe70b-9225-4da8-a4b3-c06b46feb055 req-dcf06635-4eab-42bc-81f5-8d39280422ff service nova] Creating event network-vif-plugged:b09648fa-0071-4d7d-ba66-d0da81ab9768 for instance 34eaf1d2-9732-4c0e-b970-02fbb449514b on nch2-master-1 Jul 23 21:16:22.481903 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-58efe70b-9225-4da8-a4b3-c06b46feb055 req-dcf06635-4eab-42bc-81f5-8d39280422ff service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044926 Jul 23 21:16:22.481903 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 392/840] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:16:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:16:22.487813 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-472e90e4-ba9a-4a02-a5a6-1a4caac3633b tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '.version_select at 0x7f0b47dc2310>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:22.544421 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-472e90e4-ba9a-4a02-a5a6-1a4caac3633b tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/images/8a2df693-27eb-4ab8-9b5e-e603a022f603" status: 200 len: 1413 microversion: 2.1 time: 0.061258 Jul 23 21:16:22.545259 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 393/841] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:16:22 2022] GET /compute/v2.1/images/8a2df693-27eb-4ab8-9b5e-e603a022f603 => generated 1413 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:22.549621 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3018fccd-f79d-4c1a-b182-4807518d22af tempest-ServicesAdminNegativeTestJSON-319353511 tempest-ServicesAdminNegativeTestJSON-319353511-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:22.551082 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:16:22.551082 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:16:22.552295 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3018fccd-f79d-4c1a-b182-4807518d22af tempest-ServicesAdminNegativeTestJSON-319353511 tempest-ServicesAdminNegativeTestJSON-319353511-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:22.552780 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3018fccd-f79d-4c1a-b182-4807518d22af tempest-ServicesAdminNegativeTestJSON-319353511 tempest-ServicesAdminNegativeTestJSON-319353511-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:22.553570 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3018fccd-f79d-4c1a-b182-4807518d22af tempest-ServicesAdminNegativeTestJSON-319353511 tempest-ServicesAdminNegativeTestJSON-319353511-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:22.554028 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3018fccd-f79d-4c1a-b182-4807518d22af tempest-ServicesAdminNegativeTestJSON-319353511 tempest-ServicesAdminNegativeTestJSON-319353511-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:22.577667 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-3018fccd-f79d-4c1a-b182-4807518d22af tempest-ServicesAdminNegativeTestJSON-319353511 tempest-ServicesAdminNegativeTestJSON-319353511-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.031550 Jul 23 21:16:22.578491 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 394/842] 10.222.0.17 () {58 vars in 1195 bytes} [Sat Jul 23 21:16:22 2022] GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx => generated 16 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 23 21:16:22.588157 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-80d30ecb-2521-4961-bede-62e25b123f02 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:22.588896 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-80d30ecb-2521-4961-bede-62e25b123f02 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 34eaf1d2-9732-4c0e-b970-02fbb449514b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:22.597164 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-80d30ecb-2521-4961-bede-62e25b123f02 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:22.597642 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-80d30ecb-2521-4961-bede-62e25b123f02 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:22.601925 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-80d30ecb-2521-4961-bede-62e25b123f02 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:22.601925 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-80d30ecb-2521-4961-bede-62e25b123f02 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:22.605384 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:16:22.798550 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-80d30ecb-2521-4961-bede-62e25b123f02 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:22.813459 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-80d30ecb-2521-4961-bede-62e25b123f02 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/34eaf1d2-9732-4c0e-b970-02fbb449514b" status: 200 len: 1359 microversion: 2.1 time: 0.230381 Jul 23 21:16:22.814453 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 395/843] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:16:22 2022] GET /compute/v2.1/servers/34eaf1d2-9732-4c0e-b970-02fbb449514b => generated 1359 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:22.820548 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c15add08-474c-471e-b7d2-d105c550307d tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:22.821801 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c15add08-474c-471e-b7d2-d105c550307d tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: 5bbeec29-35ee-44ca-a0f0-3dbe2198e5bf] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:22.830615 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c15add08-474c-471e-b7d2-d105c550307d tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:22.831073 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c15add08-474c-471e-b7d2-d105c550307d tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:22.833172 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c15add08-474c-471e-b7d2-d105c550307d tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:22.833822 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c15add08-474c-471e-b7d2-d105c550307d tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:22.986549 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c15add08-474c-471e-b7d2-d105c550307d tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf92af08fa94215b4eafcacea6c63f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e7d37a0e3b4b32ae99c3bc15a831e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:22.995763 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c15add08-474c-471e-b7d2-d105c550307d tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "GET /compute/v2.1/servers/5bbeec29-35ee-44ca-a0f0-3dbe2198e5bf" status: 200 len: 1467 microversion: 2.1 time: 0.180177 Jul 23 21:16:22.996717 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 396/844] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:16:22 2022] GET /compute/v2.1/servers/5bbeec29-35ee-44ca-a0f0-3dbe2198e5bf => generated 1467 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:23.012302 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-7b11e750-37b0-4155-a0f9-7562dfb04168 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:23.012909 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-7b11e750-37b0-4155-a0f9-7562dfb04168 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: 7558d52c-24e7-4115-88f7-ced193819c33] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:23.020348 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7b11e750-37b0-4155-a0f9-7562dfb04168 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:23.020797 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7b11e750-37b0-4155-a0f9-7562dfb04168 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:23.021574 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7b11e750-37b0-4155-a0f9-7562dfb04168 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:23.022089 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7b11e750-37b0-4155-a0f9-7562dfb04168 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:23.258353 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-7b11e750-37b0-4155-a0f9-7562dfb04168 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:23.266917 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-7b11e750-37b0-4155-a0f9-7562dfb04168 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:23.271502 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-7b11e750-37b0-4155-a0f9-7562dfb04168 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:23.276158 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-7b11e750-37b0-4155-a0f9-7562dfb04168 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/7558d52c-24e7-4115-88f7-ced193819c33" status: 200 len: 1544 microversion: 2.25 time: 0.267864 Jul 23 21:16:23.278261 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 397/845] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:16:22 2022] GET /compute/v2.1/servers/7558d52c-24e7-4115-88f7-ced193819c33 => generated 1544 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:16:23.286894 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e7196ffb-d434-40a2-bfb4-eb305d5aea36 tempest-ServicesAdminNegativeTestJSON-319353511 tempest-ServicesAdminNegativeTestJSON-319353511-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:23.288303 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:16:23.288303 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:16:23.291080 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e7196ffb-d434-40a2-bfb4-eb305d5aea36 tempest-ServicesAdminNegativeTestJSON-319353511 tempest-ServicesAdminNegativeTestJSON-319353511-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:23.291742 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e7196ffb-d434-40a2-bfb4-eb305d5aea36 tempest-ServicesAdminNegativeTestJSON-319353511 tempest-ServicesAdminNegativeTestJSON-319353511-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:23.293182 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e7196ffb-d434-40a2-bfb4-eb305d5aea36 tempest-ServicesAdminNegativeTestJSON-319353511 tempest-ServicesAdminNegativeTestJSON-319353511-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:23.302317 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e7196ffb-d434-40a2-bfb4-eb305d5aea36 tempest-ServicesAdminNegativeTestJSON-319353511 tempest-ServicesAdminNegativeTestJSON-319353511-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:23.357065 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-9c0d1aed-0c07-4cd4-99e1-2970ea9db593 tempest-FloatingIPDetailsTestJSON-1126152156 tempest-FloatingIPDetailsTestJSON-1126152156-project] 10.222.0.17 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.519181 Jul 23 21:16:23.365145 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 449/846] 10.222.0.17 () {60 vars in 1169 bytes} [Sat Jul 23 21:16:18 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4529 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:16:23.370969 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d78df50f-d216-41ef-a167-97ab0a778855 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:23.375839 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-d78df50f-d216-41ef-a167-97ab0a778855 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] [instance: 26494d1b-0e9c-45ac-90f7-55924a958e4c] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:23.377405 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e7196ffb-d434-40a2-bfb4-eb305d5aea36 tempest-ServicesAdminNegativeTestJSON-319353511 tempest-ServicesAdminNegativeTestJSON-319353511-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.097438 Jul 23 21:16:23.381153 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 398/847] 10.222.0.17 () {58 vars in 1136 bytes} [Sat Jul 23 21:16:23 2022] GET /compute/v2.1/os-services => generated 947 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:16:23.384205 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d78df50f-d216-41ef-a167-97ab0a778855 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:23.385482 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d78df50f-d216-41ef-a167-97ab0a778855 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:23.386568 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d78df50f-d216-41ef-a167-97ab0a778855 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:23.387515 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d78df50f-d216-41ef-a167-97ab0a778855 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:23.400003 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1c8e6f50-06ff-44de-80f2-d67bd8636d83 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:23.417980 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-1c8e6f50-06ff-44de-80f2-d67bd8636d83 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ebf92af08fa94215b4eafcacea6c63f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e7d37a0e3b4b32ae99c3bc15a831e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:23.420707 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1c8e6f50-06ff-44de-80f2-d67bd8636d83 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Searching by: {'reservation_id': 'r-yh7lzwn8', 'deleted': False, 'project_id': 'f5e7d37a0e3b4b32ae99c3bc15a831e6'} {{(pid=131320) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 23 21:16:23.441997 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1c8e6f50-06ff-44de-80f2-d67bd8636d83 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:23.442588 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1c8e6f50-06ff-44de-80f2-d67bd8636d83 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:23.443711 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1c8e6f50-06ff-44de-80f2-d67bd8636d83 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:23.446623 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1c8e6f50-06ff-44de-80f2-d67bd8636d83 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:23.595421 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.multi_cell_list [None req-1c8e6f50-06ff-44de-80f2-d67bd8636d83 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=131320) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 23 21:16:23.766722 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-1c8e6f50-06ff-44de-80f2-d67bd8636d83 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf92af08fa94215b4eafcacea6c63f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e7d37a0e3b4b32ae99c3bc15a831e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:23.780726 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1c8e6f50-06ff-44de-80f2-d67bd8636d83 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:23.781547 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1c8e6f50-06ff-44de-80f2-d67bd8636d83 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:24.076566 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1c8e6f50-06ff-44de-80f2-d67bd8636d83 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "GET /compute/v2.1/servers/detail?reservation_id=r-yh7lzwn8" status: 200 len: 2928 microversion: 2.1 time: 0.693346 Jul 23 21:16:24.077892 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 399/848] 10.222.0.17 () {58 vars in 1196 bytes} [Sat Jul 23 21:16:23 2022] GET /compute/v2.1/servers/detail?reservation_id=r-yh7lzwn8 => generated 2928 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:24.082723 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f146a769-dff9-4fc7-aaa8-ab02bf84b6b0 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Calling method '.version_select at 0x7f0b47dbcc10>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:24.086566 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f146a769-dff9-4fc7-aaa8-ab02bf84b6b0 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:24.087081 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f146a769-dff9-4fc7-aaa8-ab02bf84b6b0 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:24.102491 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f146a769-dff9-4fc7-aaa8-ab02bf84b6b0 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] 10.222.0.17 "GET /compute/v2.1/os-migrations" status: 200 len: 2785 microversion: 2.25 time: 0.023343 Jul 23 21:16:24.110530 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 400/849] 10.222.0.17 () {60 vars in 1183 bytes} [Sat Jul 23 21:16:24 2022] GET /compute/v2.1/os-migrations => generated 2785 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:16:24.110530 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-02c28509-5adb-4290-bc63-da143a48d3c3 tempest-FloatingIPDetailsTestJSON-1126152156 tempest-FloatingIPDetailsTestJSON-1126152156-project] Action: 'create', calling method: .version_select at 0x7f0b47bdf940>, body: {"pool": null} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:16:24.439428 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-d78df50f-d216-41ef-a167-97ab0a778855 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f1a14a59b7401d88f18ec35c91e30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c17bd813264fb9891076799e33acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:24.473570 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-d78df50f-d216-41ef-a167-97ab0a778855 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] 10.222.0.17 "GET /compute/v2.1/servers/26494d1b-0e9c-45ac-90f7-55924a958e4c" status: 200 len: 1387 microversion: 2.1 time: 1.107135 Jul 23 21:16:24.478336 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 450/850] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:16:23 2022] GET /compute/v2.1/servers/26494d1b-0e9c-45ac-90f7-55924a958e4c => generated 1387 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:24.483525 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c4135423-cb82-4c48-a210-0db6a381d0c0 tempest-ServicesAdminNegativeTestJSON-319353511 tempest-ServicesAdminNegativeTestJSON-319353511-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:24.500741 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:16:24.500741 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:16:24.506773 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c4135423-cb82-4c48-a210-0db6a381d0c0 tempest-ServicesAdminNegativeTestJSON-319353511 tempest-ServicesAdminNegativeTestJSON-319353511-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:24.508887 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c4135423-cb82-4c48-a210-0db6a381d0c0 tempest-ServicesAdminNegativeTestJSON-319353511 tempest-ServicesAdminNegativeTestJSON-319353511-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:24.510722 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c4135423-cb82-4c48-a210-0db6a381d0c0 tempest-ServicesAdminNegativeTestJSON-319353511 tempest-ServicesAdminNegativeTestJSON-319353511-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:24.514996 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c4135423-cb82-4c48-a210-0db6a381d0c0 tempest-ServicesAdminNegativeTestJSON-319353511 tempest-ServicesAdminNegativeTestJSON-319353511-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:24.543071 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell0:SELECT=19 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:16:24.565434 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-c4135423-cb82-4c48-a210-0db6a381d0c0 tempest-ServicesAdminNegativeTestJSON-319353511 tempest-ServicesAdminNegativeTestJSON-319353511-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.085528 Jul 23 21:16:24.566807 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 451/851] 10.222.0.17 () {58 vars in 1197 bytes} [Sat Jul 23 21:16:24 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 23 21:16:24.571826 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-3f610941-ae46-45c2-9703-12a7160bd17c tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:24.572757 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-3f610941-ae46-45c2-9703-12a7160bd17c tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 5bc4befa-252d-456a-92cd-323bad80fcdf] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:24.580375 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3f610941-ae46-45c2-9703-12a7160bd17c tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:24.581276 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3f610941-ae46-45c2-9703-12a7160bd17c tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:24.582584 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3f610941-ae46-45c2-9703-12a7160bd17c tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:24.583273 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3f610941-ae46-45c2-9703-12a7160bd17c tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:24.801834 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell0:SELECT=64 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:16:24.966496 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-3f610941-ae46-45c2-9703-12a7160bd17c tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:24.977222 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-3f610941-ae46-45c2-9703-12a7160bd17c tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/5bc4befa-252d-456a-92cd-323bad80fcdf" status: 200 len: 1470 microversion: 2.1 time: 0.408797 Jul 23 21:16:24.990976 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 452/852] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:16:24 2022] GET /compute/v2.1/servers/5bc4befa-252d-456a-92cd-323bad80fcdf => generated 1470 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:25.006523 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-7e616c34-fda8-4943-8855-9975831f3c55 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '.version_select at 0x7f0b47ed7670>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:25.072920 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-7e616c34-fda8-4943-8855-9975831f3c55 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/images/8a2df693-27eb-4ab8-9b5e-e603a022f603" status: 200 len: 1413 microversion: 2.1 time: 0.080420 Jul 23 21:16:25.073980 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 453/853] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:16:24 2022] GET /compute/v2.1/images/8a2df693-27eb-4ab8-9b5e-e603a022f603 => generated 1413 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:25.083582 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-33187774-81ee-4dbe-8012-838946e92bc7 req-bfb54e4a-d34c-4f61-b00d-4f873b68f81b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26494d1b-0e9c-45ac-90f7-55924a958e4c", "tag": "c6aa3bed-afcf-4eb9-938d-ec89a16a6dab"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:16:25.103545 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-33187774-81ee-4dbe-8012-838946e92bc7 req-bfb54e4a-d34c-4f61-b00d-4f873b68f81b service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:25.104307 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-33187774-81ee-4dbe-8012-838946e92bc7 req-bfb54e4a-d34c-4f61-b00d-4f873b68f81b service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:25.131717 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-33187774-81ee-4dbe-8012-838946e92bc7 req-bfb54e4a-d34c-4f61-b00d-4f873b68f81b service nova] Creating event network-changed:c6aa3bed-afcf-4eb9-938d-ec89a16a6dab for instance 26494d1b-0e9c-45ac-90f7-55924a958e4c on nch2-master-1 Jul 23 21:16:25.144182 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-33187774-81ee-4dbe-8012-838946e92bc7 req-bfb54e4a-d34c-4f61-b00d-4f873b68f81b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068813 Jul 23 21:16:25.151153 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 454/854] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:16:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:16:25.159308 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-9c449956-e8b7-44ec-b500-9467c52f263a tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:25.160023 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-9c449956-e8b7-44ec-b500-9467c52f263a tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 34eaf1d2-9732-4c0e-b970-02fbb449514b] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:25.191015 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9c449956-e8b7-44ec-b500-9467c52f263a tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:25.191817 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9c449956-e8b7-44ec-b500-9467c52f263a tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:25.193209 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9c449956-e8b7-44ec-b500-9467c52f263a tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:25.214409 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9c449956-e8b7-44ec-b500-9467c52f263a tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:25.424640 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-9c449956-e8b7-44ec-b500-9467c52f263a tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:25.435049 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-9c449956-e8b7-44ec-b500-9467c52f263a tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/34eaf1d2-9732-4c0e-b970-02fbb449514b" status: 200 len: 1543 microversion: 2.1 time: 0.280072 Jul 23 21:16:25.438685 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 455/855] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:16:25 2022] GET /compute/v2.1/servers/34eaf1d2-9732-4c0e-b970-02fbb449514b => generated 1543 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:25.455004 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e9bf425b-2f17-47f1-bf4f-be5f701c4128 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:25.469996 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.compute.server_groups [None req-e9bf425b-2f17-47f1-bf4f-be5f701c4128 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Querying cell 4e90cb14-d4b2-4158-b8cf-a592a1314a7b(cell1) for 2 instances {{(pid=131321) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 23 21:16:25.471320 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e9bf425b-2f17-47f1-bf4f-be5f701c4128 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:25.472036 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e9bf425b-2f17-47f1-bf4f-be5f701c4128 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:25.512761 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-e9bf425b-2f17-47f1-bf4f-be5f701c4128 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "GET /compute/v2.1/os-server-groups/cf87636d-b698-4ed9-b104-f097f98fabbc" status: 200 len: 271 microversion: 2.1 time: 0.061517 Jul 23 21:16:25.514128 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 456/856] 10.222.0.17 () {58 vars in 1262 bytes} [Sat Jul 23 21:16:25 2022] GET /compute/v2.1/os-server-groups/cf87636d-b698-4ed9-b104-f097f98fabbc => generated 271 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:16:25.524698 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-196e4a12-087c-44e2-abf1-6748db980494 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:25.525676 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-196e4a12-087c-44e2-abf1-6748db980494 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] [instance: 7558d52c-24e7-4115-88f7-ced193819c33] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:25.534158 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-196e4a12-087c-44e2-abf1-6748db980494 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:25.534706 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-196e4a12-087c-44e2-abf1-6748db980494 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:25.535618 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-196e4a12-087c-44e2-abf1-6748db980494 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:25.536142 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-196e4a12-087c-44e2-abf1-6748db980494 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:25.770801 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.objects.instance [None req-196e4a12-087c-44e2-abf1-6748db980494 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lazy-loading 'services' on Instance uuid 7558d52c-24e7-4115-88f7-ced193819c33 {{(pid=131321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:16:25.786389 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-196e4a12-087c-44e2-abf1-6748db980494 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/7558d52c-24e7-4115-88f7-ced193819c33" status: 200 len: 2037 microversion: 2.25 time: 0.265491 Jul 23 21:16:25.787659 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 457/857] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:16:25 2022] GET /compute/v2.1/servers/7558d52c-24e7-4115-88f7-ced193819c33 => generated 2037 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:16:25.792682 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-58d7d84c-5ca8-4052-8aa5-f7ec14106b20 req-4711c102-dc99-4a51-8988-1903c1d7f686 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bc4befa-252d-456a-92cd-323bad80fcdf", "name": "network-vif-plugged", "status": "completed", "tag": "f00e5169-4343-4b5e-aafd-b0e8eea7078c"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:16:25.828778 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-58d7d84c-5ca8-4052-8aa5-f7ec14106b20 req-4711c102-dc99-4a51-8988-1903c1d7f686 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:25.829511 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-58d7d84c-5ca8-4052-8aa5-f7ec14106b20 req-4711c102-dc99-4a51-8988-1903c1d7f686 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:25.846027 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-58d7d84c-5ca8-4052-8aa5-f7ec14106b20 req-4711c102-dc99-4a51-8988-1903c1d7f686 service nova] Creating event network-vif-plugged:f00e5169-4343-4b5e-aafd-b0e8eea7078c for instance 5bc4befa-252d-456a-92cd-323bad80fcdf on nch1-master-1 Jul 23 21:16:25.856269 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-58d7d84c-5ca8-4052-8aa5-f7ec14106b20 req-4711c102-dc99-4a51-8988-1903c1d7f686 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067021 Jul 23 21:16:25.857729 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 458/858] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:16:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:16:25.955345 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-02c28509-5adb-4290-bc63-da143a48d3c3 tempest-FloatingIPDetailsTestJSON-1126152156 tempest-FloatingIPDetailsTestJSON-1126152156-project] 10.222.0.17 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 1.850071 Jul 23 21:16:25.956292 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 401/859] 10.222.0.17 () {60 vars in 1169 bytes} [Sat Jul 23 21:16:24 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 1852 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:16:25.966695 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2d94b27d-d713-4b54-832f-fb55602b7512 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:25.969686 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-2d94b27d-d713-4b54-832f-fb55602b7512 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 34eaf1d2-9732-4c0e-b970-02fbb449514b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:25.994380 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2d94b27d-d713-4b54-832f-fb55602b7512 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:25.995308 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2d94b27d-d713-4b54-832f-fb55602b7512 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:25.997439 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2d94b27d-d713-4b54-832f-fb55602b7512 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:25.998390 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2d94b27d-d713-4b54-832f-fb55602b7512 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:26.037951 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e4387c45-5700-4b42-82f1-6ee581a648cb tempest-ServicesAdminNegativeTestJSON-404226166 tempest-ServicesAdminNegativeTestJSON-404226166-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:26.040234 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:16:26.040234 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:16:26.042886 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-e4387c45-5700-4b42-82f1-6ee581a648cb tempest-ServicesAdminNegativeTestJSON-404226166 tempest-ServicesAdminNegativeTestJSON-404226166-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'c55591dee28340968946a4199aea40db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd33c120f6af043118dc2a6a38f1b3fef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:26.048318 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e4387c45-5700-4b42-82f1-6ee581a648cb tempest-ServicesAdminNegativeTestJSON-404226166 tempest-ServicesAdminNegativeTestJSON-404226166-project] Request method failure captured: Jul 23 21:16:26.048318 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/os-services HTTP/1.1 Jul 23 21:16:26.048318 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:16:26.048318 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:16:26.048318 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:16:26.048318 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:16:26.048318 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:16:26.048318 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:16:26.048318 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:16:26.048318 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:16:26.048318 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GUhZt35OMiTdHrezGLOgYBbWsTCUdFJLxShgBZxOvRAPpOP_i3a1etXrBP9OoJc_aMvSCbfFqFW6c9JEtMmUkH8mmPgCdlN7L134yAa1zKntxrFVGtDE2qZhecuSnHBSR2I7doLVa8I9daXq9FwUqm3Kje8ouFTpRliM5oT49qGCmY Jul 23 21:16:26.048318 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:16:26.048318 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:16:26.048318 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:16:26.048318 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:16:26.048318 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:16:26.048318 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:16:26.048318 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: d33c120f6af043118dc2a6a38f1b3fef Jul 23 21:16:26.048318 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-404226166 Jul 23 21:16:26.048318 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:16:26.048318 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:16:26.049979 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d33c120f6af043118dc2a6a38f1b3fef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d33c120f6af043118dc2a6a38f1b3fef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d33c120f6af043118dc2a6a38f1b3fef", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d33c120f6af043118dc2a6a38f1b3fef"}]}] Jul 23 21:16:26.049979 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-404226166 Jul 23 21:16:26.049979 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: d33c120f6af043118dc2a6a38f1b3fef Jul 23 21:16:26.049979 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-404226166 Jul 23 21:16:26.049979 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ServicesAdminNegativeTestJSON-404226166-project Jul 23 21:16:26.049979 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:16:26.049979 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:16:26.049979 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: c55591dee28340968946a4199aea40db Jul 23 21:16:26.049979 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-404226166-project Jul 23 21:16:26.049979 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:16:26.049979 ncdv-master-1 devstack@n-api.service[131321]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 23 21:16:26.049979 ncdv-master-1 devstack@n-api.service[131321]: action_args: {} Jul 23 21:16:26.050940 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:16:26.050940 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:16:26.050940 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:16:26.050940 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:16:26.050940 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:16:26.050940 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:16:26.050940 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 23 21:16:26.050940 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:16:26.050940 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 23 21:16:26.050940 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:16:26.050940 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:16:26.050940 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:16:26.050940 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Jul 23 21:16:26.050940 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Jul 23 21:16:26.050940 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 23 21:16:26.050940 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 23 21:16:26.050940 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 23 21:16:26.050940 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 23 21:16:26.050940 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 23 21:16:26.052384 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 23 21:16:26.052384 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 23 21:16:26.052384 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise self.value Jul 23 21:16:26.052384 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 23 21:16:26.052384 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 23 21:16:26.052384 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 23 21:16:26.052384 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 23 21:16:26.052384 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 23 21:16:26.052384 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 23 21:16:26.052384 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 23 21:16:26.052384 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:16:26.052384 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:16:26.052384 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:16:26.052384 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:16:26.052384 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:16:26.052384 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:16:26.052384 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 23 21:16:26.052384 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 23 21:16:26.052384 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 23 21:16:26.052384 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:16:26.054260 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e4387c45-5700-4b42-82f1-6ee581a648cb tempest-ServicesAdminNegativeTestJSON-404226166 tempest-ServicesAdminNegativeTestJSON-404226166-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:16:26.054260 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-e4387c45-5700-4b42-82f1-6ee581a648cb tempest-ServicesAdminNegativeTestJSON-404226166 tempest-ServicesAdminNegativeTestJSON-404226166-project] 10.222.0.17 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.190626 Jul 23 21:16:26.054260 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 459/860] 10.222.0.17 () {58 vars in 1136 bytes} [Sat Jul 23 21:16:25 2022] GET /compute/v2.1/os-services => generated 112 bytes in 194 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:16:26.066292 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-109b4f52-f259-442d-b026-9308f5169500 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:26.067061 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-109b4f52-f259-442d-b026-9308f5169500 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] [instance: 26494d1b-0e9c-45ac-90f7-55924a958e4c] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:26.079021 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-109b4f52-f259-442d-b026-9308f5169500 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:26.079498 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-109b4f52-f259-442d-b026-9308f5169500 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:26.083358 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-109b4f52-f259-442d-b026-9308f5169500 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:26.083851 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-109b4f52-f259-442d-b026-9308f5169500 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:26.134935 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2d94b27d-d713-4b54-832f-fb55602b7512 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/34eaf1d2-9732-4c0e-b970-02fbb449514b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.176287 Jul 23 21:16:26.136194 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 402/861] 10.222.0.17 () {58 vars in 1274 bytes} [Sat Jul 23 21:16:25 2022] GET /compute/v2.1/servers/34eaf1d2-9732-4c0e-b970-02fbb449514b/os-interface => generated 285 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:16:26.141148 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ec776346-97a1-4225-8d51-dd5c5121d083 tempest-ServersOnMultiNodesTest-1671986198 tempest-ServersOnMultiNodesTest-1671986198-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:26.141747 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ec776346-97a1-4225-8d51-dd5c5121d083 tempest-ServersOnMultiNodesTest-1671986198 tempest-ServersOnMultiNodesTest-1671986198-project-admin] [instance: 36204b8b-c78e-447c-a3e7-f1f22c6ffe1f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:26.158427 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ec776346-97a1-4225-8d51-dd5c5121d083 tempest-ServersOnMultiNodesTest-1671986198 tempest-ServersOnMultiNodesTest-1671986198-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:26.160291 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ec776346-97a1-4225-8d51-dd5c5121d083 tempest-ServersOnMultiNodesTest-1671986198 tempest-ServersOnMultiNodesTest-1671986198-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:26.161304 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ec776346-97a1-4225-8d51-dd5c5121d083 tempest-ServersOnMultiNodesTest-1671986198 tempest-ServersOnMultiNodesTest-1671986198-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:26.161742 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ec776346-97a1-4225-8d51-dd5c5121d083 tempest-ServersOnMultiNodesTest-1671986198 tempest-ServersOnMultiNodesTest-1671986198-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:26.413052 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ec776346-97a1-4225-8d51-dd5c5121d083 tempest-ServersOnMultiNodesTest-1671986198 tempest-ServersOnMultiNodesTest-1671986198-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/36204b8b-c78e-447c-a3e7-f1f22c6ffe1f" status: 200 len: 1619 microversion: 2.1 time: 0.275364 Jul 23 21:16:26.426252 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 403/862] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:16:26 2022] GET /compute/v2.1/servers/36204b8b-c78e-447c-a3e7-f1f22c6ffe1f => generated 1619 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:26.432705 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b0ba1389-6ffc-4d89-844c-c4a85fe15fc7 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Action: 'create', calling method: .version_select at 0x7f0b47eac820>, body: {"keypair": {"name": "tempest-keypair-1790694479", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPo07XRJYqBZdr3CSbVAVHJYYXwW/imyegEe9ukzJfFVJuqNnA+mfTc1NiqVGQyiI2o8uO+xWS2+JrThvBTEo9+wKFZHye4tFXoyfarlshMt4SMOqOIJ6dObB5jIDpYjjA=="}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:16:26.451564 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-b0ba1389-6ffc-4d89-844c-c4a85fe15fc7 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Getting quotas for project b347973dfb204484bdb87ab0094dbe22. Resources: {'key_pairs'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:16:26.460089 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-b0ba1389-6ffc-4d89-844c-c4a85fe15fc7 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Getting quotas for user 3a56b82cf3954f279dd21e17a42462b3 and project b347973dfb204484bdb87ab0094dbe22. Resources: {'key_pairs'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:16:26.466824 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-109b4f52-f259-442d-b026-9308f5169500 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f1a14a59b7401d88f18ec35c91e30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c17bd813264fb9891076799e33acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:26.478386 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-109b4f52-f259-442d-b026-9308f5169500 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] 10.222.0.17 "GET /compute/v2.1/servers/26494d1b-0e9c-45ac-90f7-55924a958e4c" status: 200 len: 1387 microversion: 2.1 time: 0.424389 Jul 23 21:16:26.482818 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 460/863] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:16:26 2022] GET /compute/v2.1/servers/26494d1b-0e9c-45ac-90f7-55924a958e4c => generated 1387 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:26.492604 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b0ba1389-6ffc-4d89-844c-c4a85fe15fc7 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.25 time: 0.064788 Jul 23 21:16:26.504476 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e1771dbd-37b7-415e-afcb-bf90de38638b tempest-FloatingIPDetailsTestJSON-1126152156 tempest-FloatingIPDetailsTestJSON-1126152156-project] Action: 'create', calling method: .version_select at 0x7f0b47f139d0>, body: {"pool": null} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:16:26.512587 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 404/864] 10.222.0.17 () {62 vars in 1199 bytes} [Sat Jul 23 21:16:26 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 85 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 23 21:16:26.517899 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-04b5e6f6-80d1-48ad-b8f9-adb0a7108083 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:26.521175 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-04b5e6f6-80d1-48ad-b8f9-adb0a7108083 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 5bc4befa-252d-456a-92cd-323bad80fcdf] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:26.545754 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-04b5e6f6-80d1-48ad-b8f9-adb0a7108083 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:26.546326 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-04b5e6f6-80d1-48ad-b8f9-adb0a7108083 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:26.547459 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-04b5e6f6-80d1-48ad-b8f9-adb0a7108083 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:26.547982 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-04b5e6f6-80d1-48ad-b8f9-adb0a7108083 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:26.939704 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-04b5e6f6-80d1-48ad-b8f9-adb0a7108083 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:26.953278 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-04b5e6f6-80d1-48ad-b8f9-adb0a7108083 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/5bc4befa-252d-456a-92cd-323bad80fcdf" status: 200 len: 1462 microversion: 2.1 time: 0.439374 Jul 23 21:16:26.954566 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 405/865] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:16:26 2022] GET /compute/v2.1/servers/5bc4befa-252d-456a-92cd-323bad80fcdf => generated 1462 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:26.962427 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e1e51633-a692-4521-8e2c-ec2a791c4e31 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '.version_select at 0x7f0b47bd60d0>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:27.050986 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e1e51633-a692-4521-8e2c-ec2a791c4e31 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/images/8a2df693-27eb-4ab8-9b5e-e603a022f603" status: 200 len: 1413 microversion: 2.1 time: 0.094880 Jul 23 21:16:27.052015 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 406/866] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:16:26 2022] GET /compute/v2.1/images/8a2df693-27eb-4ab8-9b5e-e603a022f603 => generated 1413 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:27.058752 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1f6601d8-bdd4-4401-afcb-575f55715c54 tempest-ServersOnMultiNodesTest-1671986198 tempest-ServersOnMultiNodesTest-1671986198-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:27.059646 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1f6601d8-bdd4-4401-afcb-575f55715c54 tempest-ServersOnMultiNodesTest-1671986198 tempest-ServersOnMultiNodesTest-1671986198-project-admin] [instance: 5bbeec29-35ee-44ca-a0f0-3dbe2198e5bf] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:27.067570 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1f6601d8-bdd4-4401-afcb-575f55715c54 tempest-ServersOnMultiNodesTest-1671986198 tempest-ServersOnMultiNodesTest-1671986198-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:27.068347 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1f6601d8-bdd4-4401-afcb-575f55715c54 tempest-ServersOnMultiNodesTest-1671986198 tempest-ServersOnMultiNodesTest-1671986198-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:27.069693 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1f6601d8-bdd4-4401-afcb-575f55715c54 tempest-ServersOnMultiNodesTest-1671986198 tempest-ServersOnMultiNodesTest-1671986198-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:27.070353 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1f6601d8-bdd4-4401-afcb-575f55715c54 tempest-ServersOnMultiNodesTest-1671986198 tempest-ServersOnMultiNodesTest-1671986198-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:27.260939 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1f6601d8-bdd4-4401-afcb-575f55715c54 tempest-ServersOnMultiNodesTest-1671986198 tempest-ServersOnMultiNodesTest-1671986198-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/5bbeec29-35ee-44ca-a0f0-3dbe2198e5bf" status: 200 len: 1618 microversion: 2.1 time: 0.205744 Jul 23 21:16:27.275673 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 407/867] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:16:27 2022] GET /compute/v2.1/servers/5bbeec29-35ee-44ca-a0f0-3dbe2198e5bf => generated 1618 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:27.286582 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3278e7f8-d2f1-431c-9a74-07f5590eb1c1 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:27.287474 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-3278e7f8-d2f1-431c-9a74-07f5590eb1c1 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 5bc4befa-252d-456a-92cd-323bad80fcdf] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:27.294433 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3278e7f8-d2f1-431c-9a74-07f5590eb1c1 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:27.295022 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3278e7f8-d2f1-431c-9a74-07f5590eb1c1 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:27.296570 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3278e7f8-d2f1-431c-9a74-07f5590eb1c1 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:27.297235 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3278e7f8-d2f1-431c-9a74-07f5590eb1c1 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:27.459483 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-3278e7f8-d2f1-431c-9a74-07f5590eb1c1 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:27.475292 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-3278e7f8-d2f1-431c-9a74-07f5590eb1c1 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/5bc4befa-252d-456a-92cd-323bad80fcdf" status: 200 len: 1462 microversion: 2.1 time: 0.198262 Jul 23 21:16:27.476189 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 408/868] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:16:27 2022] GET /compute/v2.1/servers/5bc4befa-252d-456a-92cd-323bad80fcdf => generated 1462 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:27.481049 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-728a7e84-1952-4fbe-8b9b-ac73e84dbd22 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-525134938", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "9e985a36-586a-4546-a0c0-1a3e3da330c9"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:16:27.558076 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-728a7e84-1952-4fbe-8b9b-ac73e84dbd22 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] validate_networks() for None {{(pid=131320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:16:27.845514 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-728a7e84-1952-4fbe-8b9b-ac73e84dbd22 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:16:27.846025 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-728a7e84-1952-4fbe-8b9b-ac73e84dbd22 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:16:27.846508 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-728a7e84-1952-4fbe-8b9b-ac73e84dbd22 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:16:27.846909 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-728a7e84-1952-4fbe-8b9b-ac73e84dbd22 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:16:27.847319 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-728a7e84-1952-4fbe-8b9b-ac73e84dbd22 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:16:27.857992 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-728a7e84-1952-4fbe-8b9b-ac73e84dbd22 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:27.858668 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-728a7e84-1952-4fbe-8b9b-ac73e84dbd22 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:27.859703 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-728a7e84-1952-4fbe-8b9b-ac73e84dbd22 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:27.860309 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-728a7e84-1952-4fbe-8b9b-ac73e84dbd22 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:27.888798 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-728a7e84-1952-4fbe-8b9b-ac73e84dbd22 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Getting quotas for project f5e7d37a0e3b4b32ae99c3bc15a831e6. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:16:27.895054 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-728a7e84-1952-4fbe-8b9b-ac73e84dbd22 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Getting quotas for user ebf92af08fa94215b4eafcacea6c63f6 and project f5e7d37a0e3b4b32ae99c3bc15a831e6. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:16:27.918524 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-728a7e84-1952-4fbe-8b9b-ac73e84dbd22 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Going to run 1 instances... {{(pid=131320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:16:27.921573 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-728a7e84-1952-4fbe-8b9b-ac73e84dbd22 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: c942eaa9-e288-44b7-b76c-afaf9b84b93d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:16:28.001985 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-728a7e84-1952-4fbe-8b9b-ac73e84dbd22 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.524266 Jul 23 21:16:28.004968 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 409/869] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:16:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 528 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 23 21:16:28.011734 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-25fef2f2-7a7e-4ad2-a864-188e984bf88f tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Action: 'create', calling method: .version_select at 0x7f0b5408ac10>, body: {"keypair": {"name": "tempest-keypair-893784733", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI6Kp8LwXfYbZCdhs4GAnNDEWenwqsDNgiZDwPuSSFmNgGHl4d6QOvGtJAmttronA+RW/yFIVf1lyaUH9XlB5EDJm1gBSMS8zNmwH/W1II8YA4SUoMGiQdd16TJ/Q2zDrA=="}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:16:28.056952 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-25fef2f2-7a7e-4ad2-a864-188e984bf88f tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Getting quotas for project 5935212e8b6a40768ee3fc90807b0cb1. Resources: {'key_pairs'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:16:28.078040 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-25fef2f2-7a7e-4ad2-a864-188e984bf88f tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Getting quotas for user 0133d9533fbd4be5b46dc308dbe3a7d9 and project 5935212e8b6a40768ee3fc90807b0cb1. Resources: {'key_pairs'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:16:28.153269 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-25fef2f2-7a7e-4ad2-a864-188e984bf88f tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.146368 Jul 23 21:16:28.154506 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 410/870] 10.222.0.17 () {60 vars in 1158 bytes} [Sat Jul 23 21:16:28 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:16:28.165176 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-7612e01d-6315-4f62-b963-61e09346ef34 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:28.165826 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-7612e01d-6315-4f62-b963-61e09346ef34 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] [instance: 26494d1b-0e9c-45ac-90f7-55924a958e4c] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:28.179288 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7612e01d-6315-4f62-b963-61e09346ef34 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:28.179741 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7612e01d-6315-4f62-b963-61e09346ef34 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:28.180533 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7612e01d-6315-4f62-b963-61e09346ef34 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:28.184777 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7612e01d-6315-4f62-b963-61e09346ef34 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:28.771224 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-7612e01d-6315-4f62-b963-61e09346ef34 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f1a14a59b7401d88f18ec35c91e30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c17bd813264fb9891076799e33acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:28.805674 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-7612e01d-6315-4f62-b963-61e09346ef34 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] 10.222.0.17 "GET /compute/v2.1/servers/26494d1b-0e9c-45ac-90f7-55924a958e4c" status: 200 len: 1387 microversion: 2.1 time: 0.649674 Jul 23 21:16:28.822355 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 411/871] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:16:28 2022] GET /compute/v2.1/servers/26494d1b-0e9c-45ac-90f7-55924a958e4c => generated 1387 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:28.833746 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-a5715780-1d90-4e05-ac9d-f37feb4ff629 req-d3c70a5c-49f6-4c8e-af23-910eb48fd64f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b360b14-9ea2-4336-b32e-d6546267664e", "name": "network-vif-plugged", "status": "completed", "tag": "ab0b5da4-b12b-497b-b93e-08673983e63d"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:16:28.845040 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-a5715780-1d90-4e05-ac9d-f37feb4ff629 req-d3c70a5c-49f6-4c8e-af23-910eb48fd64f service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:28.845040 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-a5715780-1d90-4e05-ac9d-f37feb4ff629 req-d3c70a5c-49f6-4c8e-af23-910eb48fd64f service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:28.870903 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-a5715780-1d90-4e05-ac9d-f37feb4ff629 req-d3c70a5c-49f6-4c8e-af23-910eb48fd64f service nova] Creating event network-vif-plugged:ab0b5da4-b12b-497b-b93e-08673983e63d for instance 9b360b14-9ea2-4336-b32e-d6546267664e on nch1-master-1 Jul 23 21:16:28.900436 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-a5715780-1d90-4e05-ac9d-f37feb4ff629 req-d3c70a5c-49f6-4c8e-af23-910eb48fd64f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081045 Jul 23 21:16:28.906684 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 412/872] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:16:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:16:28.914784 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-340de5f2-4a96-4ac6-bc0c-8c2242d9901a tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:28.916555 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-340de5f2-4a96-4ac6-bc0c-8c2242d9901a tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: c942eaa9-e288-44b7-b76c-afaf9b84b93d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:29.028438 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-340de5f2-4a96-4ac6-bc0c-8c2242d9901a tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf92af08fa94215b4eafcacea6c63f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e7d37a0e3b4b32ae99c3bc15a831e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:29.053852 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-340de5f2-4a96-4ac6-bc0c-8c2242d9901a tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "GET /compute/v2.1/servers/c942eaa9-e288-44b7-b76c-afaf9b84b93d" status: 200 len: 1216 microversion: 2.1 time: 0.135837 Jul 23 21:16:29.063654 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 413/873] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:16:28 2022] GET /compute/v2.1/servers/c942eaa9-e288-44b7-b76c-afaf9b84b93d => generated 1216 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:29.066110 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-7441a4dc-b1be-471b-8ee4-8dc0b777ccb1 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '.version_select at 0x7f0b540a8e50>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:29.139948 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-7441a4dc-b1be-471b-8ee4-8dc0b777ccb1 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/images/8a2df693-27eb-4ab8-9b5e-e603a022f603" status: 200 len: 1413 microversion: 2.1 time: 0.084065 Jul 23 21:16:29.141035 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 414/874] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:16:29 2022] GET /compute/v2.1/images/8a2df693-27eb-4ab8-9b5e-e603a022f603 => generated 1413 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:29.829299 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-75c9ffb6-ceda-4226-95fb-a424ae2125b2 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:29.830496 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-75c9ffb6-ceda-4226-95fb-a424ae2125b2 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] [instance: 26494d1b-0e9c-45ac-90f7-55924a958e4c] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:29.854483 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-75c9ffb6-ceda-4226-95fb-a424ae2125b2 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:29.855120 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-75c9ffb6-ceda-4226-95fb-a424ae2125b2 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:29.859491 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-75c9ffb6-ceda-4226-95fb-a424ae2125b2 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:29.860194 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-75c9ffb6-ceda-4226-95fb-a424ae2125b2 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:30.492319 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-75c9ffb6-ceda-4226-95fb-a424ae2125b2 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f1a14a59b7401d88f18ec35c91e30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c17bd813264fb9891076799e33acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:30.520638 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-75c9ffb6-ceda-4226-95fb-a424ae2125b2 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] 10.222.0.17 "GET /compute/v2.1/servers/26494d1b-0e9c-45ac-90f7-55924a958e4c" status: 200 len: 1387 microversion: 2.1 time: 0.700577 Jul 23 21:16:30.530597 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 415/875] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:16:29 2022] GET /compute/v2.1/servers/26494d1b-0e9c-45ac-90f7-55924a958e4c => generated 1387 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:30.551257 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f9217452-e47f-42a1-961e-7e2d5c226089 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:30.552521 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f9217452-e47f-42a1-961e-7e2d5c226089 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: c942eaa9-e288-44b7-b76c-afaf9b84b93d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:30.568521 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f9217452-e47f-42a1-961e-7e2d5c226089 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:30.570245 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f9217452-e47f-42a1-961e-7e2d5c226089 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:30.573084 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f9217452-e47f-42a1-961e-7e2d5c226089 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:30.573552 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f9217452-e47f-42a1-961e-7e2d5c226089 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:30.737659 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f9217452-e47f-42a1-961e-7e2d5c226089 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf92af08fa94215b4eafcacea6c63f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e7d37a0e3b4b32ae99c3bc15a831e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:30.749343 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f9217452-e47f-42a1-961e-7e2d5c226089 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "GET /compute/v2.1/servers/c942eaa9-e288-44b7-b76c-afaf9b84b93d" status: 200 len: 1274 microversion: 2.1 time: 0.219148 Jul 23 21:16:30.750223 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 416/876] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:16:30 2022] GET /compute/v2.1/servers/c942eaa9-e288-44b7-b76c-afaf9b84b93d => generated 1274 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:30.755807 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-97d08a0e-0b63-40b3-8f39-d4e505434291 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '.version_select at 0x7f0b47ec1670>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:30.812855 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-97d08a0e-0b63-40b3-8f39-d4e505434291 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/images/8a2df693-27eb-4ab8-9b5e-e603a022f603" status: 200 len: 1413 microversion: 2.1 time: 0.056954 Jul 23 21:16:30.812855 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 417/877] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:16:30 2022] GET /compute/v2.1/images/8a2df693-27eb-4ab8-9b5e-e603a022f603 => generated 1413 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:30.818285 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-09d9e17b-1578-477f-a988-7299614410e1 req-6b49e1fe-259e-4c84-b54b-ecaac079627f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34eaf1d2-9732-4c0e-b970-02fbb449514b", "tag": "b09648fa-0071-4d7d-ba66-d0da81ab9768"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:16:30.831326 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-09d9e17b-1578-477f-a988-7299614410e1 req-6b49e1fe-259e-4c84-b54b-ecaac079627f service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:30.831785 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-09d9e17b-1578-477f-a988-7299614410e1 req-6b49e1fe-259e-4c84-b54b-ecaac079627f service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:30.845379 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-09d9e17b-1578-477f-a988-7299614410e1 req-6b49e1fe-259e-4c84-b54b-ecaac079627f service nova] Creating event network-changed:b09648fa-0071-4d7d-ba66-d0da81ab9768 for instance 34eaf1d2-9732-4c0e-b970-02fbb449514b on nch2-master-1 Jul 23 21:16:30.851812 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-09d9e17b-1578-477f-a988-7299614410e1 req-6b49e1fe-259e-4c84-b54b-ecaac079627f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038761 Jul 23 21:16:30.852659 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 418/878] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:16:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:16:31.541996 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-68705e97-f914-454b-8747-2f1867ebd0c9 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:31.544615 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-68705e97-f914-454b-8747-2f1867ebd0c9 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] [instance: 26494d1b-0e9c-45ac-90f7-55924a958e4c] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:31.582706 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-68705e97-f914-454b-8747-2f1867ebd0c9 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:31.583187 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-68705e97-f914-454b-8747-2f1867ebd0c9 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:31.587467 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-68705e97-f914-454b-8747-2f1867ebd0c9 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:31.591392 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-68705e97-f914-454b-8747-2f1867ebd0c9 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:32.365504 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-68705e97-f914-454b-8747-2f1867ebd0c9 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f1a14a59b7401d88f18ec35c91e30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c17bd813264fb9891076799e33acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:32.380703 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-68705e97-f914-454b-8747-2f1867ebd0c9 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] 10.222.0.17 "GET /compute/v2.1/servers/26494d1b-0e9c-45ac-90f7-55924a958e4c" status: 200 len: 1387 microversion: 2.1 time: 0.844540 Jul 23 21:16:32.383027 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 419/879] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:16:31 2022] GET /compute/v2.1/servers/26494d1b-0e9c-45ac-90f7-55924a958e4c => generated 1387 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:16:32.397811 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-f2cca714-1aeb-4eaa-9255-4adbe0d9bf7d req-f380da75-45cb-4d9f-8c00-cc3251588654 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26494d1b-0e9c-45ac-90f7-55924a958e4c", "name": "network-vif-plugged", "status": "completed", "tag": "c6aa3bed-afcf-4eb9-938d-ec89a16a6dab"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:16:32.423338 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-f2cca714-1aeb-4eaa-9255-4adbe0d9bf7d req-f380da75-45cb-4d9f-8c00-cc3251588654 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:32.424293 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-f2cca714-1aeb-4eaa-9255-4adbe0d9bf7d req-f380da75-45cb-4d9f-8c00-cc3251588654 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:32.443292 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-f2cca714-1aeb-4eaa-9255-4adbe0d9bf7d req-f380da75-45cb-4d9f-8c00-cc3251588654 service nova] Creating event network-vif-plugged:c6aa3bed-afcf-4eb9-938d-ec89a16a6dab for instance 26494d1b-0e9c-45ac-90f7-55924a958e4c on nch2-master-1 Jul 23 21:16:32.452280 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-f2cca714-1aeb-4eaa-9255-4adbe0d9bf7d req-f380da75-45cb-4d9f-8c00-cc3251588654 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065334 Jul 23 21:16:32.452280 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 420/880] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:16:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:16:32.470405 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5b9c9e4e-cd4a-470a-b1ac-ed1b498b6299 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:32.471169 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5b9c9e4e-cd4a-470a-b1ac-ed1b498b6299 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: c942eaa9-e288-44b7-b76c-afaf9b84b93d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:32.505760 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5b9c9e4e-cd4a-470a-b1ac-ed1b498b6299 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:32.506275 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5b9c9e4e-cd4a-470a-b1ac-ed1b498b6299 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:32.508226 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5b9c9e4e-cd4a-470a-b1ac-ed1b498b6299 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:32.510007 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5b9c9e4e-cd4a-470a-b1ac-ed1b498b6299 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:32.638173 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5b9c9e4e-cd4a-470a-b1ac-ed1b498b6299 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf92af08fa94215b4eafcacea6c63f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e7d37a0e3b4b32ae99c3bc15a831e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:32.642920 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-e1771dbd-37b7-415e-afcb-bf90de38638b tempest-FloatingIPDetailsTestJSON-1126152156 tempest-FloatingIPDetailsTestJSON-1126152156-project] 10.222.0.17 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 6.157170 Jul 23 21:16:32.650273 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 461/881] 10.222.0.17 () {60 vars in 1169 bytes} [Sat Jul 23 21:16:26 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 6160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:16:32.650273 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-72c7351b-c15e-4160-8fb1-e36fa4b249df tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '.version_select at 0x7f0b47e91820>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:32.650718 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5b9c9e4e-cd4a-470a-b1ac-ed1b498b6299 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "GET /compute/v2.1/servers/c942eaa9-e288-44b7-b76c-afaf9b84b93d" status: 200 len: 1274 microversion: 2.1 time: 0.196176 Jul 23 21:16:32.651454 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 421/882] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:16:32 2022] GET /compute/v2.1/servers/c942eaa9-e288-44b7-b76c-afaf9b84b93d => generated 1274 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:32.661212 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-cd1f5ef3-095f-419b-a8ce-fb81a35e3bca tempest-FloatingIPDetailsTestJSON-1126152156 tempest-FloatingIPDetailsTestJSON-1126152156-project] Action: 'create', calling method: .version_select at 0x7f0b47bd6e50>, body: {"pool": null} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:16:32.757351 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-72c7351b-c15e-4160-8fb1-e36fa4b249df tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/images/8a2df693-27eb-4ab8-9b5e-e603a022f603" status: 200 len: 1413 microversion: 2.1 time: 0.111714 Jul 23 21:16:32.759643 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 462/883] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:16:32 2022] GET /compute/v2.1/images/8a2df693-27eb-4ab8-9b5e-e603a022f603 => generated 1413 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:33.544560 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-7785e404-ee41-48d5-ae5a-bc1aa55fabe9 tempest-TenantUsagesNegativeTestJSON-372615985 tempest-TenantUsagesNegativeTestJSON-372615985-project-admin] 10.222.0.17 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-07-22T21%3A16%3A33.230260&end=2022-07-24T21%3A16%3A33.230260" status: 404 len: 112 microversion: - time: 0.308889 Jul 23 21:16:33.545819 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 463/884] 10.222.0.17 () {58 vars in 1315 bytes} [Sat Jul 23 21:16:33 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-07-22T21%3A16%3A33.230260&end=2022-07-24T21%3A16%3A33.230260 => generated 112 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 23 21:16:33.570118 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-347e12e6-0dee-4d34-9b55-2a7476fc3f8f tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1252991195", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "networks": [{"uuid": "290f6ab6-b90e-4acc-9fe0-f410e54c8881"}], "security_groups": [{"name": "tempest-securitygroup--1272607372"}], "key_name": "tempest-keypair-1790694479", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:16:33.861956 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.network.neutron [None req-347e12e6-0dee-4d34-9b55-2a7476fc3f8f tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] validate_networks() for [('290f6ab6-b90e-4acc-9fe0-f410e54c8881', None, None, None, None, None)] {{(pid=131321) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:16:34.554597 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell0:SELECT=1 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:16:34.765013 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-cd1f5ef3-095f-419b-a8ce-fb81a35e3bca tempest-FloatingIPDetailsTestJSON-1126152156 tempest-FloatingIPDetailsTestJSON-1126152156-project] 10.222.0.17 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.108683 Jul 23 21:16:34.766067 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 422/885] 10.222.0.17 () {60 vars in 1169 bytes} [Sat Jul 23 21:16:32 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:16:34.771291 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-194a216f-8db7-4463-a0bd-0500096972bf tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:34.771914 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-194a216f-8db7-4463-a0bd-0500096972bf tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] [instance: 26494d1b-0e9c-45ac-90f7-55924a958e4c] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:34.789990 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-194a216f-8db7-4463-a0bd-0500096972bf tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:34.790454 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-194a216f-8db7-4463-a0bd-0500096972bf tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:34.792048 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-194a216f-8db7-4463-a0bd-0500096972bf tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:34.792871 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-194a216f-8db7-4463-a0bd-0500096972bf tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:34.823133 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=100 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:16:35.050175 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-194a216f-8db7-4463-a0bd-0500096972bf tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f1a14a59b7401d88f18ec35c91e30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c17bd813264fb9891076799e33acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:35.061854 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-194a216f-8db7-4463-a0bd-0500096972bf tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] 10.222.0.17 "GET /compute/v2.1/servers/26494d1b-0e9c-45ac-90f7-55924a958e4c" status: 200 len: 1586 microversion: 2.1 time: 0.294640 Jul 23 21:16:35.104251 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 423/886] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:16:34 2022] GET /compute/v2.1/servers/26494d1b-0e9c-45ac-90f7-55924a958e4c => generated 1586 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:35.111749 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-48dc2f56-efe6-4e9d-a3df-97ea50aefd15 tempest-TenantUsagesNegativeTestJSON-372615985 tempest-TenantUsagesNegativeTestJSON-372615985-project-admin] Calling method '.version_select at 0x7f0b47bd6e50>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:35.119034 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-48dc2f56-efe6-4e9d-a3df-97ea50aefd15 tempest-TenantUsagesNegativeTestJSON-372615985 tempest-TenantUsagesNegativeTestJSON-372615985-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Jul 23 21:16:35.121550 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-48dc2f56-efe6-4e9d-a3df-97ea50aefd15 tempest-TenantUsagesNegativeTestJSON-372615985 tempest-TenantUsagesNegativeTestJSON-372615985-project-admin] Request method failure captured: Jul 23 21:16:35.121550 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/os-simple-tenant-usage/4a19b7b423a940b6881c60f7e5a32e04?start=2022-07-24T21%3A16%3A33.230260&end=2022-07-22T21%3A16%3A33.230260 HTTP/1.1 Jul 23 21:16:35.121550 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:16:35.121550 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:16:35.121550 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:16:35.121550 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:16:35.121550 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:16:35.121550 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:16:35.121550 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:16:35.121550 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:16:35.121550 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GUw_Eaxo7MrFw9a_FY2i6iMxp4jcl7czOr0KJ3Vvc7llc7d9H8GOpKot05sQJHEM7QJgqekSnvkqmZHphOzk6efmfHUxiZbi0TcSIgh9GOoEzPtnza-h5zCyeCSFje5BCV_Ypx3zEy-l-zS1RfGiIX5H_coR_ZnklpijKmQuzGk63E Jul 23 21:16:35.121550 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:16:35.121550 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:16:35.121550 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:16:35.121550 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:16:35.121550 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:16:35.121550 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:16:35.121550 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 43617ab0d12046bdb548f383035fb37e Jul 23 21:16:35.121550 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-372615985 Jul 23 21:16:35.121550 ncdv-master-1 devstack@n-api.service[131320]: X-Role: admin,reader,member Jul 23 21:16:35.121550 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: admin,reader,member Jul 23 21:16:35.123026 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/43617ab0d12046bdb548f383035fb37e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/43617ab0d12046bdb548f383035fb37e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_43617ab0d12046bdb548f383035fb37e", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/43617ab0d12046bdb548f383035fb37e"}]}] Jul 23 21:16:35.123026 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-372615985 Jul 23 21:16:35.123026 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 43617ab0d12046bdb548f383035fb37e Jul 23 21:16:35.123026 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-372615985 Jul 23 21:16:35.123026 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-TenantUsagesNegativeTestJSON-372615985-project-admin Jul 23 21:16:35.123026 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:16:35.123026 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:16:35.123026 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 2fb354f50ad34c13919aebcbe8abb3aa Jul 23 21:16:35.123026 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-372615985-project-admin Jul 23 21:16:35.123026 ncdv-master-1 devstack@n-api.service[131320]: method: Jul 23 21:16:35.123026 ncdv-master-1 devstack@n-api.service[131320]: exception: Invalid start time. The start time cannot occur after the end time. Jul 23 21:16:35.123026 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '4a19b7b423a940b6881c60f7e5a32e04'} Jul 23 21:16:35.123805 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:16:35.123805 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:16:35.123805 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:16:35.123805 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:16:35.123805 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:16:35.123805 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:16:35.123805 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:16:35.123805 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:16:35.123805 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 23 21:16:35.123805 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:16:35.123805 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:16:35.123805 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:16:35.123805 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Jul 23 21:16:35.123805 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jul 23 21:16:35.123805 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Jul 23 21:16:35.123805 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Jul 23 21:16:35.123805 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Jul 23 21:16:35.123805 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 23 21:16:35.123805 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Jul 23 21:16:35.125043 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:16:35.125043 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:16:35.125043 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:16:35.125043 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:16:35.125043 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:16:35.125043 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:16:35.125043 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:16:35.125043 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:16:35.125043 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Jul 23 21:16:35.125043 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:16:35.125043 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-48dc2f56-efe6-4e9d-a3df-97ea50aefd15 tempest-TenantUsagesNegativeTestJSON-372615985 tempest-TenantUsagesNegativeTestJSON-372615985-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:16:35.136754 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-48dc2f56-efe6-4e9d-a3df-97ea50aefd15 tempest-TenantUsagesNegativeTestJSON-372615985 tempest-TenantUsagesNegativeTestJSON-372615985-project-admin] 10.222.0.17 "GET /compute/v2.1/os-simple-tenant-usage/4a19b7b423a940b6881c60f7e5a32e04?start=2022-07-24T21%3A16%3A33.230260&end=2022-07-22T21%3A16%3A33.230260" status: 400 len: 111 microversion: 2.1 time: 0.031098 Jul 23 21:16:35.137201 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-347e12e6-0dee-4d34-9b55-2a7476fc3f8f tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Flavor limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:16:35.137963 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-347e12e6-0dee-4d34-9b55-2a7476fc3f8f tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Image limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:16:35.138630 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-347e12e6-0dee-4d34-9b55-2a7476fc3f8f tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Flavor pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:16:35.139063 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-347e12e6-0dee-4d34-9b55-2a7476fc3f8f tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Image pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:16:35.139486 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-347e12e6-0dee-4d34-9b55-2a7476fc3f8f tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:16:35.144754 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 424/887] 10.222.0.17 () {58 vars in 1411 bytes} [Sat Jul 23 21:16:35 2022] GET /compute/v2.1/os-simple-tenant-usage/4a19b7b423a940b6881c60f7e5a32e04?start=2022-07-24T21%3A16%3A33.230260&end=2022-07-22T21%3A16%3A33.230260 => generated 111 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 23 21:16:35.153294 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-818b9d4f-01f8-45ed-ba22-14ef6cbfdb81 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:35.154040 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-818b9d4f-01f8-45ed-ba22-14ef6cbfdb81 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: c942eaa9-e288-44b7-b76c-afaf9b84b93d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:35.182753 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-818b9d4f-01f8-45ed-ba22-14ef6cbfdb81 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:35.183342 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-347e12e6-0dee-4d34-9b55-2a7476fc3f8f tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:35.184087 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-818b9d4f-01f8-45ed-ba22-14ef6cbfdb81 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:35.184356 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-347e12e6-0dee-4d34-9b55-2a7476fc3f8f tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:35.185144 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-818b9d4f-01f8-45ed-ba22-14ef6cbfdb81 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:35.185663 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-347e12e6-0dee-4d34-9b55-2a7476fc3f8f tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:35.185820 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-818b9d4f-01f8-45ed-ba22-14ef6cbfdb81 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:35.186572 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-347e12e6-0dee-4d34-9b55-2a7476fc3f8f tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:35.258425 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-347e12e6-0dee-4d34-9b55-2a7476fc3f8f tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Getting quotas for project b347973dfb204484bdb87ab0094dbe22. Resources: {'ram', 'instances', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:16:35.267998 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-347e12e6-0dee-4d34-9b55-2a7476fc3f8f tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Getting quotas for user 3a56b82cf3954f279dd21e17a42462b3 and project b347973dfb204484bdb87ab0094dbe22. Resources: {'ram', 'instances', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:16:35.283662 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:16:35.285567 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-347e12e6-0dee-4d34-9b55-2a7476fc3f8f tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Going to run 1 instances... {{(pid=131321) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:16:35.288118 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-347e12e6-0dee-4d34-9b55-2a7476fc3f8f tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: a6de755e-739d-437c-aafb-6bc49f8bb086] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131321) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:16:35.375360 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-347e12e6-0dee-4d34-9b55-2a7476fc3f8f tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.25 time: 1.828072 Jul 23 21:16:35.381231 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 464/888] 10.222.0.17 () {62 vars in 1187 bytes} [Sat Jul 23 21:16:33 2022] POST /compute/v2.1/servers => generated 406 bytes in 1834 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 23 21:16:35.402047 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-89e35e51-5415-434c-a5c7-ae202d40c8af tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '.version_select at 0x7f0b47ed74c0>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:35.467715 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-89e35e51-5415-434c-a5c7-ae202d40c8af tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/images/8a2df693-27eb-4ab8-9b5e-e603a022f603" status: 200 len: 1413 microversion: 2.1 time: 0.084028 Jul 23 21:16:35.469932 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 465/889] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:16:35 2022] GET /compute/v2.1/images/8a2df693-27eb-4ab8-9b5e-e603a022f603 => generated 1413 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:35.486714 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-dea32e0a-011d-4098-9067-1e90986913b8 tempest-MigrationsAdminTest-19880863 tempest-MigrationsAdminTest-19880863-project-admin] Calling method '.version_select at 0x7f0b47ee6430>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:35.489922 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-dea32e0a-011d-4098-9067-1e90986913b8 tempest-MigrationsAdminTest-19880863 tempest-MigrationsAdminTest-19880863-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:35.495543 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-dea32e0a-011d-4098-9067-1e90986913b8 tempest-MigrationsAdminTest-19880863 tempest-MigrationsAdminTest-19880863-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:35.498121 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-818b9d4f-01f8-45ed-ba22-14ef6cbfdb81 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf92af08fa94215b4eafcacea6c63f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e7d37a0e3b4b32ae99c3bc15a831e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:35.507769 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-818b9d4f-01f8-45ed-ba22-14ef6cbfdb81 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "GET /compute/v2.1/servers/c942eaa9-e288-44b7-b76c-afaf9b84b93d" status: 200 len: 1316 microversion: 2.1 time: 0.360384 Jul 23 21:16:35.508892 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 425/890] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:16:35 2022] GET /compute/v2.1/servers/c942eaa9-e288-44b7-b76c-afaf9b84b93d => generated 1316 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:35.510953 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-dea32e0a-011d-4098-9067-1e90986913b8 tempest-MigrationsAdminTest-19880863 tempest-MigrationsAdminTest-19880863-project-admin] 10.222.0.17 "GET /compute/v2.1/os-migrations" status: 200 len: 2338 microversion: 2.1 time: 0.037181 Jul 23 21:16:35.512021 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 466/891] 10.222.0.17 () {58 vars in 1142 bytes} [Sat Jul 23 21:16:35 2022] GET /compute/v2.1/os-migrations => generated 2338 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:35.518184 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-225f9e02-2b22-47b7-8ab1-7d86446f146b tempest-FloatingIPDetailsTestJSON-1126152156 tempest-FloatingIPDetailsTestJSON-1126152156-project] Calling method '.version_select at 0x7f0b54033d30>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:35.523674 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-82490451-8d72-45ea-a237-422a2d3d557f tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:35.524818 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-82490451-8d72-45ea-a237-422a2d3d557f tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] [instance: 26494d1b-0e9c-45ac-90f7-55924a958e4c] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:35.532769 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-82490451-8d72-45ea-a237-422a2d3d557f tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:35.533711 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-82490451-8d72-45ea-a237-422a2d3d557f tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:35.538535 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-82490451-8d72-45ea-a237-422a2d3d557f tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:35.539545 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-82490451-8d72-45ea-a237-422a2d3d557f tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:35.568889 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:16:35.690432 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-82490451-8d72-45ea-a237-422a2d3d557f tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] 10.222.0.17 "GET /compute/v2.1/servers/26494d1b-0e9c-45ac-90f7-55924a958e4c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.176892 Jul 23 21:16:35.691028 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 467/892] 10.222.0.17 () {58 vars in 1274 bytes} [Sat Jul 23 21:16:35 2022] GET /compute/v2.1/servers/26494d1b-0e9c-45ac-90f7-55924a958e4c/os-interface => generated 284 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:16:35.902590 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-225f9e02-2b22-47b7-8ab1-7d86446f146b tempest-FloatingIPDetailsTestJSON-1126152156 tempest-FloatingIPDetailsTestJSON-1126152156-project] 10.222.0.17 "GET /compute/v2.1/os-floating-ips/a95c6b59-3e8a-4cef-8075-f9fb3567b242" status: 200 len: 142 microversion: 2.1 time: 0.392288 Jul 23 21:16:35.911161 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 426/893] 10.222.0.17 () {58 vars in 1259 bytes} [Sat Jul 23 21:16:35 2022] GET /compute/v2.1/os-floating-ips/a95c6b59-3e8a-4cef-8075-f9fb3567b242 => generated 142 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:16:35.911939 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-013a2691-4c6a-4bcf-a887-7fa381938a10 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:35.914618 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-013a2691-4c6a-4bcf-a887-7fa381938a10 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: a6de755e-739d-437c-aafb-6bc49f8bb086] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:35.966886 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ed5523d8-eb56-4e0b-89b2-ddebb5e6c944 tempest-TenantUsagesNegativeTestJSON-699553422 tempest-TenantUsagesNegativeTestJSON-699553422-project] Calling method '.version_select at 0x7f0b47f1d8b0>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:35.969311 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ed5523d8-eb56-4e0b-89b2-ddebb5e6c944 tempest-TenantUsagesNegativeTestJSON-699553422 tempest-TenantUsagesNegativeTestJSON-699553422-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': 'cd0bef731892464d80e1c433b43e3afe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a19b7b423a940b6881c60f7e5a32e04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:35.971558 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ed5523d8-eb56-4e0b-89b2-ddebb5e6c944 tempest-TenantUsagesNegativeTestJSON-699553422 tempest-TenantUsagesNegativeTestJSON-699553422-project] Request method failure captured: Jul 23 21:16:35.971558 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-22T21%3A16%3A33.230260&end=2022-07-24T21%3A16%3A33.230260&detailed=1 HTTP/1.1 Jul 23 21:16:35.971558 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:16:35.971558 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:16:35.971558 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:16:35.971558 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:16:35.971558 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:16:35.971558 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:16:35.971558 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:16:35.971558 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:16:35.971558 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GUvv-pfkHk6N3sMKlqYwxzfKa9vLNBy6I7tIFT6GaBFJyaU_nhd9rvK1w8h-_p8vtOJTuzmeAyqdht8begiN84TwD0vOQLR8ZNEHnHhWNXP9yEa-uo5940GShXo90rEYSLKF16hczLqeAxK_c64SyXpghK7q3ug63OdIzCpPRmBs0k Jul 23 21:16:35.971558 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:16:35.971558 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:16:35.971558 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:16:35.971558 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:16:35.971558 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:16:35.971558 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:16:35.971558 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 4a19b7b423a940b6881c60f7e5a32e04 Jul 23 21:16:35.971558 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-699553422 Jul 23 21:16:35.971558 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:16:35.971558 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:16:35.972874 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4a19b7b423a940b6881c60f7e5a32e04"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4a19b7b423a940b6881c60f7e5a32e04"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4a19b7b423a940b6881c60f7e5a32e04", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4a19b7b423a940b6881c60f7e5a32e04"}]}] Jul 23 21:16:35.972874 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-699553422 Jul 23 21:16:35.972874 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 4a19b7b423a940b6881c60f7e5a32e04 Jul 23 21:16:35.972874 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-699553422 Jul 23 21:16:35.972874 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-TenantUsagesNegativeTestJSON-699553422-project Jul 23 21:16:35.972874 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:16:35.972874 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:16:35.972874 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: cd0bef731892464d80e1c433b43e3afe Jul 23 21:16:35.972874 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-699553422-project Jul 23 21:16:35.972874 ncdv-master-1 devstack@n-api.service[131321]: method: Jul 23 21:16:35.972874 ncdv-master-1 devstack@n-api.service[131321]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jul 23 21:16:35.972874 ncdv-master-1 devstack@n-api.service[131321]: action_args: {} Jul 23 21:16:35.972874 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:16:35.973732 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:16:35.973732 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:16:35.973732 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:16:35.973732 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:16:35.973732 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:16:35.973732 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:16:35.973732 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:16:35.973732 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 23 21:16:35.973732 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:16:35.973732 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:16:35.973732 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:16:35.973732 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Jul 23 21:16:35.973732 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self._index(req) Jul 23 21:16:35.973732 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Jul 23 21:16:35.973732 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Jul 23 21:16:35.973732 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 23 21:16:35.973732 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 23 21:16:35.973732 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 23 21:16:35.973732 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 23 21:16:35.974893 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 23 21:16:35.974893 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 23 21:16:35.974893 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 23 21:16:35.974893 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise self.value Jul 23 21:16:35.974893 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 23 21:16:35.974893 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 23 21:16:35.974893 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 23 21:16:35.974893 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 23 21:16:35.974893 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 23 21:16:35.974893 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 23 21:16:35.974893 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jul 23 21:16:35.974893 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:16:35.974893 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:16:35.974893 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:16:35.974893 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:16:35.974893 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:16:35.974893 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:16:35.974893 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 23 21:16:35.974893 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 23 21:16:35.979854 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jul 23 21:16:35.979854 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:16:35.979854 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ed5523d8-eb56-4e0b-89b2-ddebb5e6c944 tempest-TenantUsagesNegativeTestJSON-699553422 tempest-TenantUsagesNegativeTestJSON-699553422-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:16:35.979854 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-ed5523d8-eb56-4e0b-89b2-ddebb5e6c944 tempest-TenantUsagesNegativeTestJSON-699553422 tempest-TenantUsagesNegativeTestJSON-699553422-project] 10.222.0.17 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-22T21%3A16%3A33.230260&end=2022-07-24T21%3A16%3A33.230260&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.281015 Jul 23 21:16:35.979854 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 468/894] 10.222.0.17 () {58 vars in 1334 bytes} [Sat Jul 23 21:16:35 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-22T21%3A16%3A33.230260&end=2022-07-24T21%3A16%3A33.230260&detailed=1 => generated 123 bytes in 282 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:16:35.991821 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-013a2691-4c6a-4bcf-a887-7fa381938a10 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:36.012001 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-013a2691-4c6a-4bcf-a887-7fa381938a10 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:36.018114 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-3fbc29a8-e864-401f-990a-2dc7e07178af tempest-MigrationsAdminTest-19880863 tempest-MigrationsAdminTest-19880863-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:36.018879 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-013a2691-4c6a-4bcf-a887-7fa381938a10 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:36.021064 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-013a2691-4c6a-4bcf-a887-7fa381938a10 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/a6de755e-739d-437c-aafb-6bc49f8bb086" status: 200 len: 1286 microversion: 2.25 time: 0.115162 Jul 23 21:16:36.023588 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 427/895] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:16:35 2022] GET /compute/v2.1/servers/a6de755e-739d-437c-aafb-6bc49f8bb086 => generated 1286 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:16:36.036857 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-3fbc29a8-e864-401f-990a-2dc7e07178af tempest-MigrationsAdminTest-19880863 tempest-MigrationsAdminTest-19880863-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.032968 Jul 23 21:16:36.041300 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-d3b19b9b-4890-4c81-b018-36bbdbff8b25 req-d16318aa-b627-4081-8cda-1036b8eba038 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c942eaa9-e288-44b7-b76c-afaf9b84b93d", "tag": "7388a4be-59a7-4cfd-ad2c-a6b3f952a32c"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:16:36.041821 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 469/896] 10.222.0.17 () {58 vars in 1136 bytes} [Sat Jul 23 21:16:35 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:16:36.055331 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-b15471bb-f726-4773-be49-a4ac0ad51b55 tempest-FloatingIPDetailsTestJSON-1126152156 tempest-FloatingIPDetailsTestJSON-1126152156-project] Calling method '.version_select at 0x7f0b47ed7430>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:36.074348 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-d3b19b9b-4890-4c81-b018-36bbdbff8b25 req-d16318aa-b627-4081-8cda-1036b8eba038 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:36.074894 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-d3b19b9b-4890-4c81-b018-36bbdbff8b25 req-d16318aa-b627-4081-8cda-1036b8eba038 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:36.103571 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-d3b19b9b-4890-4c81-b018-36bbdbff8b25 req-d16318aa-b627-4081-8cda-1036b8eba038 service nova] Creating event network-changed:7388a4be-59a7-4cfd-ad2c-a6b3f952a32c for instance c942eaa9-e288-44b7-b76c-afaf9b84b93d on nch2-master-1 Jul 23 21:16:36.110281 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-d3b19b9b-4890-4c81-b018-36bbdbff8b25 req-d16318aa-b627-4081-8cda-1036b8eba038 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083521 Jul 23 21:16:36.111309 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 428/897] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:16:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:16:36.121054 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-16ac41b9-d706-431e-81a6-0a1f0dd14a21 tempest-MigrationsAdminTest-19880863 tempest-MigrationsAdminTest-19880863-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-2046216278", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:16:36.122812 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:16:36.122812 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:16:36.131807 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:16:36.200097 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-16ac41b9-d706-431e-81a6-0a1f0dd14a21 tempest-MigrationsAdminTest-19880863 tempest-MigrationsAdminTest-19880863-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 499 microversion: 2.1 time: 0.086118 Jul 23 21:16:36.202847 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 429/898] 10.222.0.17 () {60 vars in 1145 bytes} [Sat Jul 23 21:16:36 2022] POST /compute/v2.1/flavors => generated 499 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:16:36.220638 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8926d855-33b0-46be-b92b-9207e69a0d24 tempest-MigrationsAdminTest-19880863 tempest-MigrationsAdminTest-19880863-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:36.238530 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8926d855-33b0-46be-b92b-9207e69a0d24 tempest-MigrationsAdminTest-19880863 tempest-MigrationsAdminTest-19880863-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.021961 Jul 23 21:16:36.239868 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 430/899] 10.222.0.17 () {58 vars in 1181 bytes} [Sat Jul 23 21:16:36 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 23 21:16:36.466832 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2c68f58f-7773-4e74-80e8-7bb59e4eacb2 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-437035358", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "eb0634b6-cfd7-4679-8048-873d526132b7"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:16:36.542731 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-2c68f58f-7773-4e74-80e8-7bb59e4eacb2 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] validate_networks() for None {{(pid=131320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:16:36.913573 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-2c68f58f-7773-4e74-80e8-7bb59e4eacb2 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:16:36.914435 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-2c68f58f-7773-4e74-80e8-7bb59e4eacb2 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:16:36.914685 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-2c68f58f-7773-4e74-80e8-7bb59e4eacb2 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:16:36.915432 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-2c68f58f-7773-4e74-80e8-7bb59e4eacb2 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:16:36.916025 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-2c68f58f-7773-4e74-80e8-7bb59e4eacb2 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:16:36.940808 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2c68f58f-7773-4e74-80e8-7bb59e4eacb2 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:36.941276 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2c68f58f-7773-4e74-80e8-7bb59e4eacb2 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:36.942134 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2c68f58f-7773-4e74-80e8-7bb59e4eacb2 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:36.942583 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2c68f58f-7773-4e74-80e8-7bb59e4eacb2 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:36.987695 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-2c68f58f-7773-4e74-80e8-7bb59e4eacb2 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Getting quotas for project 5935212e8b6a40768ee3fc90807b0cb1. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:16:36.995617 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-2c68f58f-7773-4e74-80e8-7bb59e4eacb2 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Getting quotas for user 0133d9533fbd4be5b46dc308dbe3a7d9 and project 5935212e8b6a40768ee3fc90807b0cb1. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:16:37.013351 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-2c68f58f-7773-4e74-80e8-7bb59e4eacb2 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Going to run 1 instances... {{(pid=131320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:16:37.016783 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-2c68f58f-7773-4e74-80e8-7bb59e4eacb2 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 760fa31f-a0cf-46df-b456-3af5dc7f9933] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:16:37.146928 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2c68f58f-7773-4e74-80e8-7bb59e4eacb2 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.680633 Jul 23 21:16:37.160579 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 431/900] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:16:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 698 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 23 21:16:37.183174 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-181c9eaa-123f-49ac-b536-88fbd57d8b92 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '.version_select at 0x7f0b47fc4f70>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:37.285229 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-181c9eaa-123f-49ac-b536-88fbd57d8b92 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/images/8a2df693-27eb-4ab8-9b5e-e603a022f603" status: 200 len: 1413 microversion: 2.1 time: 0.123378 Jul 23 21:16:37.285834 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 432/901] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:16:37 2022] GET /compute/v2.1/images/8a2df693-27eb-4ab8-9b5e-e603a022f603 => generated 1413 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:37.292685 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4f3e5e4b-eb55-4f77-9973-f0414379e059 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:37.293319 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-4f3e5e4b-eb55-4f77-9973-f0414379e059 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: c942eaa9-e288-44b7-b76c-afaf9b84b93d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:37.300389 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4f3e5e4b-eb55-4f77-9973-f0414379e059 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:37.300771 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4f3e5e4b-eb55-4f77-9973-f0414379e059 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:37.301570 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4f3e5e4b-eb55-4f77-9973-f0414379e059 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:37.302400 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4f3e5e4b-eb55-4f77-9973-f0414379e059 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:37.583723 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-4f3e5e4b-eb55-4f77-9973-f0414379e059 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf92af08fa94215b4eafcacea6c63f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e7d37a0e3b4b32ae99c3bc15a831e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:37.592305 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4f3e5e4b-eb55-4f77-9973-f0414379e059 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "GET /compute/v2.1/servers/c942eaa9-e288-44b7-b76c-afaf9b84b93d" status: 200 len: 1316 microversion: 2.1 time: 0.305273 Jul 23 21:16:37.598132 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 433/902] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:16:37 2022] GET /compute/v2.1/servers/c942eaa9-e288-44b7-b76c-afaf9b84b93d => generated 1316 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:37.607500 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8830e145-67f5-432f-b768-39e8d5db169b tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:37.612004 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8830e145-67f5-432f-b768-39e8d5db169b tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: a6de755e-739d-437c-aafb-6bc49f8bb086] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:37.623826 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8830e145-67f5-432f-b768-39e8d5db169b tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:37.624188 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8830e145-67f5-432f-b768-39e8d5db169b tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:37.624978 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8830e145-67f5-432f-b768-39e8d5db169b tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:37.625416 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8830e145-67f5-432f-b768-39e8d5db169b tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:37.756060 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8830e145-67f5-432f-b768-39e8d5db169b tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:37.783065 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8830e145-67f5-432f-b768-39e8d5db169b tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:37.787531 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8830e145-67f5-432f-b768-39e8d5db169b tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:37.788910 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8830e145-67f5-432f-b768-39e8d5db169b tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/a6de755e-739d-437c-aafb-6bc49f8bb086" status: 200 len: 1344 microversion: 2.25 time: 0.189671 Jul 23 21:16:37.791726 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 434/903] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:16:37 2022] GET /compute/v2.1/servers/a6de755e-739d-437c-aafb-6bc49f8bb086 => generated 1344 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:16:37.813893 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-403f01ff-0f2e-43f2-818e-ea189a1982ef tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:37.816680 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-403f01ff-0f2e-43f2-818e-ea189a1982ef tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 760fa31f-a0cf-46df-b456-3af5dc7f9933] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:37.935435 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-403f01ff-0f2e-43f2-818e-ea189a1982ef tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:37.949279 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-403f01ff-0f2e-43f2-818e-ea189a1982ef tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933" status: 200 len: 1278 microversion: 2.1 time: 0.149139 Jul 23 21:16:37.950755 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 435/904] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:16:37 2022] GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933 => generated 1278 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:38.298482 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e3fe224a-c2da-4ea5-990c-9ff2129112d4 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '.version_select at 0x7f0b540ea1f0>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:38.382322 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e3fe224a-c2da-4ea5-990c-9ff2129112d4 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/images/8a2df693-27eb-4ab8-9b5e-e603a022f603" status: 200 len: 1413 microversion: 2.1 time: 0.087676 Jul 23 21:16:38.385335 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 436/905] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:16:38 2022] GET /compute/v2.1/images/8a2df693-27eb-4ab8-9b5e-e603a022f603 => generated 1413 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:16:38.610837 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-decaebc6-04b9-445d-883a-19faa8c6bd32 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:38.611861 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-decaebc6-04b9-445d-883a-19faa8c6bd32 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: c942eaa9-e288-44b7-b76c-afaf9b84b93d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:38.624117 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-decaebc6-04b9-445d-883a-19faa8c6bd32 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:38.628504 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-decaebc6-04b9-445d-883a-19faa8c6bd32 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:38.629715 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-decaebc6-04b9-445d-883a-19faa8c6bd32 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:38.630574 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-decaebc6-04b9-445d-883a-19faa8c6bd32 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:38.918711 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-decaebc6-04b9-445d-883a-19faa8c6bd32 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf92af08fa94215b4eafcacea6c63f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e7d37a0e3b4b32ae99c3bc15a831e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:38.927935 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-decaebc6-04b9-445d-883a-19faa8c6bd32 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "GET /compute/v2.1/servers/c942eaa9-e288-44b7-b76c-afaf9b84b93d" status: 200 len: 1316 microversion: 2.1 time: 0.321506 Jul 23 21:16:38.930659 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 437/906] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:16:38 2022] GET /compute/v2.1/servers/c942eaa9-e288-44b7-b76c-afaf9b84b93d => generated 1316 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:16:38.937150 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8cc0503a-cd42-4f29-8b3c-2a0d48c018d6 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:38.943455 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8cc0503a-cd42-4f29-8b3c-2a0d48c018d6 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: a6de755e-739d-437c-aafb-6bc49f8bb086] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:38.972034 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8cc0503a-cd42-4f29-8b3c-2a0d48c018d6 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:38.972915 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8cc0503a-cd42-4f29-8b3c-2a0d48c018d6 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:38.975331 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8cc0503a-cd42-4f29-8b3c-2a0d48c018d6 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:38.977285 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8cc0503a-cd42-4f29-8b3c-2a0d48c018d6 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:39.099114 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8cc0503a-cd42-4f29-8b3c-2a0d48c018d6 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:39.115517 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8cc0503a-cd42-4f29-8b3c-2a0d48c018d6 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:39.117028 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8cc0503a-cd42-4f29-8b3c-2a0d48c018d6 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:39.118191 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8cc0503a-cd42-4f29-8b3c-2a0d48c018d6 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/a6de755e-739d-437c-aafb-6bc49f8bb086" status: 200 len: 1344 microversion: 2.25 time: 0.186309 Jul 23 21:16:39.118746 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 438/907] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:16:38 2022] GET /compute/v2.1/servers/a6de755e-739d-437c-aafb-6bc49f8bb086 => generated 1344 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:16:39.144087 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1e46f51c-1d21-4bba-9d09-204a45efa3bf tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:39.144743 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1e46f51c-1d21-4bba-9d09-204a45efa3bf tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 760fa31f-a0cf-46df-b456-3af5dc7f9933] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:39.151328 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1e46f51c-1d21-4bba-9d09-204a45efa3bf tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:39.151770 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1e46f51c-1d21-4bba-9d09-204a45efa3bf tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:39.152769 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1e46f51c-1d21-4bba-9d09-204a45efa3bf tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:39.153362 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1e46f51c-1d21-4bba-9d09-204a45efa3bf tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:39.164795 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-b15471bb-f726-4773-be49-a4ac0ad51b55 tempest-FloatingIPDetailsTestJSON-1126152156 tempest-FloatingIPDetailsTestJSON-1126152156-project] 10.222.0.17 "DELETE /compute/v2.1/os-floating-ips/a95c6b59-3e8a-4cef-8075-f9fb3567b242" status: 202 len: 0 microversion: 2.1 time: 3.119086 Jul 23 21:16:39.167552 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 470/908] 10.222.0.17 () {58 vars in 1262 bytes} [Sat Jul 23 21:16:36 2022] DELETE /compute/v2.1/os-floating-ips/a95c6b59-3e8a-4cef-8075-f9fb3567b242 => generated 0 bytes in 3124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:16:39.180034 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-44dfee3d-623a-4666-86b6-e065743e6ce4 tempest-FloatingIPDetailsTestJSON-1126152156 tempest-FloatingIPDetailsTestJSON-1126152156-project] Calling method '.version_select at 0x7f0b47facd30>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:39.274286 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-1e46f51c-1d21-4bba-9d09-204a45efa3bf tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:39.283852 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1e46f51c-1d21-4bba-9d09-204a45efa3bf tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933" status: 200 len: 1336 microversion: 2.1 time: 0.147156 Jul 23 21:16:39.284785 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 439/909] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:16:39 2022] GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933 => generated 1336 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:39.401716 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c05f64b8-c289-48cb-aa1f-0a287c0e645c tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '.version_select at 0x7f0b5422a310>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:39.472372 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c05f64b8-c289-48cb-aa1f-0a287c0e645c tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/images/8a2df693-27eb-4ab8-9b5e-e603a022f603" status: 200 len: 1413 microversion: 2.1 time: 0.075344 Jul 23 21:16:39.476295 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 440/910] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:16:39 2022] GET /compute/v2.1/images/8a2df693-27eb-4ab8-9b5e-e603a022f603 => generated 1413 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:16:39.839070 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-44dfee3d-623a-4666-86b6-e065743e6ce4 tempest-FloatingIPDetailsTestJSON-1126152156 tempest-FloatingIPDetailsTestJSON-1126152156-project] 10.222.0.17 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.664127 Jul 23 21:16:39.841424 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 471/911] 10.222.0.17 () {58 vars in 1163 bytes} [Sat Jul 23 21:16:39 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 23 21:16:39.851743 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e54028ce-9a25-4fa5-9c9b-ca723adc7257 tempest-FloatingIPDetailsTestJSON-1126152156 tempest-FloatingIPDetailsTestJSON-1126152156-project] Calling method '.version_select at 0x7f0b54029790>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:39.953529 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-cc8fe3f9-4187-4583-8364-3481b534ec3e tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:39.954112 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-cc8fe3f9-4187-4583-8364-3481b534ec3e tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: c942eaa9-e288-44b7-b76c-afaf9b84b93d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:39.991774 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cc8fe3f9-4187-4583-8364-3481b534ec3e tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:39.994621 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cc8fe3f9-4187-4583-8364-3481b534ec3e tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:39.997519 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cc8fe3f9-4187-4583-8364-3481b534ec3e tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:40.006110 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cc8fe3f9-4187-4583-8364-3481b534ec3e tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:40.185352 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e54028ce-9a25-4fa5-9c9b-ca723adc7257 tempest-FloatingIPDetailsTestJSON-1126152156 tempest-FloatingIPDetailsTestJSON-1126152156-project] 10.222.0.17 "GET /compute/v2.1/os-floating-ips" status: 200 len: 397 microversion: 2.1 time: 0.337323 Jul 23 21:16:40.186405 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 441/912] 10.222.0.17 () {58 vars in 1148 bytes} [Sat Jul 23 21:16:39 2022] GET /compute/v2.1/os-floating-ips => generated 397 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:16:40.192352 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4035c017-80a6-40fc-ae48-2babc5c04d2c tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:40.193310 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-4035c017-80a6-40fc-ae48-2babc5c04d2c tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: a6de755e-739d-437c-aafb-6bc49f8bb086] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:40.245470 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4035c017-80a6-40fc-ae48-2babc5c04d2c tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:40.246069 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4035c017-80a6-40fc-ae48-2babc5c04d2c tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:40.250267 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4035c017-80a6-40fc-ae48-2babc5c04d2c tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:40.252862 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4035c017-80a6-40fc-ae48-2babc5c04d2c tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:40.353717 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-4035c017-80a6-40fc-ae48-2babc5c04d2c tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:40.363061 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-4035c017-80a6-40fc-ae48-2babc5c04d2c tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:40.364573 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-4035c017-80a6-40fc-ae48-2babc5c04d2c tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:40.366073 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4035c017-80a6-40fc-ae48-2babc5c04d2c tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/a6de755e-739d-437c-aafb-6bc49f8bb086" status: 200 len: 1344 microversion: 2.25 time: 0.178263 Jul 23 21:16:40.368038 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 442/913] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:16:40 2022] GET /compute/v2.1/servers/a6de755e-739d-437c-aafb-6bc49f8bb086 => generated 1344 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:16:40.373032 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b359f392-ca55-4460-9e92-dac120a3e75d tempest-FloatingIPDetailsTestJSON-1126152156 tempest-FloatingIPDetailsTestJSON-1126152156-project] Calling method '.version_select at 0x7f0b5422a3a0>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:41.237769 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-cc8fe3f9-4187-4583-8364-3481b534ec3e tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf92af08fa94215b4eafcacea6c63f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e7d37a0e3b4b32ae99c3bc15a831e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:41.253970 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-cc8fe3f9-4187-4583-8364-3481b534ec3e tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "GET /compute/v2.1/servers/c942eaa9-e288-44b7-b76c-afaf9b84b93d" status: 200 len: 1316 microversion: 2.1 time: 1.307022 Jul 23 21:16:41.254869 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 472/914] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:16:39 2022] GET /compute/v2.1/servers/c942eaa9-e288-44b7-b76c-afaf9b84b93d => generated 1316 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:16:41.272771 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f2973b8f-cc13-4dd4-94f7-ad55fa3f1650 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:41.273610 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-f2973b8f-cc13-4dd4-94f7-ad55fa3f1650 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 760fa31f-a0cf-46df-b456-3af5dc7f9933] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:41.289144 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f2973b8f-cc13-4dd4-94f7-ad55fa3f1650 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:41.289590 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f2973b8f-cc13-4dd4-94f7-ad55fa3f1650 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:41.290435 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f2973b8f-cc13-4dd4-94f7-ad55fa3f1650 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:41.290884 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f2973b8f-cc13-4dd4-94f7-ad55fa3f1650 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:41.513425 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-f2973b8f-cc13-4dd4-94f7-ad55fa3f1650 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:41.524840 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-f2973b8f-cc13-4dd4-94f7-ad55fa3f1650 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933" status: 200 len: 1336 microversion: 2.1 time: 0.266785 Jul 23 21:16:41.530318 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 473/915] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:16:41 2022] GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933 => generated 1336 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:41.542228 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-929eec18-85cd-48ae-b6ed-57078d942517 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '.version_select at 0x7f0b47fac430>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:41.644607 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-929eec18-85cd-48ae-b6ed-57078d942517 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/images/8a2df693-27eb-4ab8-9b5e-e603a022f603" status: 200 len: 1413 microversion: 2.1 time: 0.112735 Jul 23 21:16:41.645932 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 474/916] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:16:41 2022] GET /compute/v2.1/images/8a2df693-27eb-4ab8-9b5e-e603a022f603 => generated 1413 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:41.657509 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a6c87131-ad8f-465a-af10-141d3e88f22c tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:41.658823 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-a6c87131-ad8f-465a-af10-141d3e88f22c tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: a6de755e-739d-437c-aafb-6bc49f8bb086] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:41.677720 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a6c87131-ad8f-465a-af10-141d3e88f22c tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:41.686946 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a6c87131-ad8f-465a-af10-141d3e88f22c tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:41.688119 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a6c87131-ad8f-465a-af10-141d3e88f22c tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:41.688859 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a6c87131-ad8f-465a-af10-141d3e88f22c tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:42.105129 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-a6c87131-ad8f-465a-af10-141d3e88f22c tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:42.118629 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-a6c87131-ad8f-465a-af10-141d3e88f22c tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:42.125038 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-a6c87131-ad8f-465a-af10-141d3e88f22c tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:42.127785 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-a6c87131-ad8f-465a-af10-141d3e88f22c tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/a6de755e-739d-437c-aafb-6bc49f8bb086" status: 200 len: 1412 microversion: 2.25 time: 0.480579 Jul 23 21:16:42.130521 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 475/917] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:16:41 2022] GET /compute/v2.1/servers/a6de755e-739d-437c-aafb-6bc49f8bb086 => generated 1412 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:16:42.136025 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-0e2f7b18-6757-40a8-ac6e-98b517bc8782 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:42.137313 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-0e2f7b18-6757-40a8-ac6e-98b517bc8782 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] [instance: 26494d1b-0e9c-45ac-90f7-55924a958e4c] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:42.147318 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0e2f7b18-6757-40a8-ac6e-98b517bc8782 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:42.148283 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0e2f7b18-6757-40a8-ac6e-98b517bc8782 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:42.149442 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0e2f7b18-6757-40a8-ac6e-98b517bc8782 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:42.150629 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0e2f7b18-6757-40a8-ac6e-98b517bc8782 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:42.239010 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b359f392-ca55-4460-9e92-dac120a3e75d tempest-FloatingIPDetailsTestJSON-1126152156 tempest-FloatingIPDetailsTestJSON-1126152156-project] 10.222.0.17 "DELETE /compute/v2.1/os-floating-ips/52fe1f98-0d8b-44ed-bdb8-7629cbd4a6ed" status: 202 len: 0 microversion: 2.1 time: 1.869293 Jul 23 21:16:42.246070 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 443/918] 10.222.0.17 () {58 vars in 1262 bytes} [Sat Jul 23 21:16:40 2022] DELETE /compute/v2.1/os-floating-ips/52fe1f98-0d8b-44ed-bdb8-7629cbd4a6ed => generated 0 bytes in 1877 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:16:42.254081 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-6d21259e-3230-4fb1-a7f8-1c0ad75c7b18 req-cf2f716e-4437-410b-b6ea-57b77daa5241 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26494d1b-0e9c-45ac-90f7-55924a958e4c", "tag": "c6aa3bed-afcf-4eb9-938d-ec89a16a6dab"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:16:42.268392 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-6d21259e-3230-4fb1-a7f8-1c0ad75c7b18 req-cf2f716e-4437-410b-b6ea-57b77daa5241 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:42.269480 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-6d21259e-3230-4fb1-a7f8-1c0ad75c7b18 req-cf2f716e-4437-410b-b6ea-57b77daa5241 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:42.286917 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-6d21259e-3230-4fb1-a7f8-1c0ad75c7b18 req-cf2f716e-4437-410b-b6ea-57b77daa5241 service nova] Creating event network-changed:c6aa3bed-afcf-4eb9-938d-ec89a16a6dab for instance 26494d1b-0e9c-45ac-90f7-55924a958e4c on nch2-master-1 Jul 23 21:16:42.305468 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-6d21259e-3230-4fb1-a7f8-1c0ad75c7b18 req-cf2f716e-4437-410b-b6ea-57b77daa5241 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057175 Jul 23 21:16:42.307470 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 444/919] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:16:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:16:42.338648 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-d24ab504-d092-4a82-b8b3-68aba394604a req-a765bd02-a2b3-4c00-aa4a-73ffc8958d62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c942eaa9-e288-44b7-b76c-afaf9b84b93d", "name": "network-vif-plugged", "status": "completed", "tag": "7388a4be-59a7-4cfd-ad2c-a6b3f952a32c"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:16:42.354437 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-d24ab504-d092-4a82-b8b3-68aba394604a req-a765bd02-a2b3-4c00-aa4a-73ffc8958d62 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:42.356365 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-d24ab504-d092-4a82-b8b3-68aba394604a req-a765bd02-a2b3-4c00-aa4a-73ffc8958d62 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:42.389554 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-d24ab504-d092-4a82-b8b3-68aba394604a req-a765bd02-a2b3-4c00-aa4a-73ffc8958d62 service nova] Creating event network-vif-plugged:7388a4be-59a7-4cfd-ad2c-a6b3f952a32c for instance c942eaa9-e288-44b7-b76c-afaf9b84b93d on nch2-master-1 Jul 23 21:16:42.433097 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-d24ab504-d092-4a82-b8b3-68aba394604a req-a765bd02-a2b3-4c00-aa4a-73ffc8958d62 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123018 Jul 23 21:16:42.439152 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 445/920] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:16:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:16:42.449030 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-bef1cb34-9b0f-4e23-bea2-65e13f9b1756 tempest-FloatingIPDetailsTestJSON-1126152156 tempest-FloatingIPDetailsTestJSON-1126152156-project] Calling method '.version_select at 0x7f0b541fa700>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:42.707238 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-0e2f7b18-6757-40a8-ac6e-98b517bc8782 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f1a14a59b7401d88f18ec35c91e30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c17bd813264fb9891076799e33acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:42.728564 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-0e2f7b18-6757-40a8-ac6e-98b517bc8782 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] 10.222.0.17 "GET /compute/v2.1/servers/26494d1b-0e9c-45ac-90f7-55924a958e4c" status: 200 len: 1586 microversion: 2.1 time: 0.594795 Jul 23 21:16:42.756152 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 476/921] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:16:42 2022] GET /compute/v2.1/servers/26494d1b-0e9c-45ac-90f7-55924a958e4c => generated 1586 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:42.772794 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-9e580b1b-399e-4037-aeff-109925da9320 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:42.773394 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-9e580b1b-399e-4037-aeff-109925da9320 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: c942eaa9-e288-44b7-b76c-afaf9b84b93d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:42.793855 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9e580b1b-399e-4037-aeff-109925da9320 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:42.794368 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9e580b1b-399e-4037-aeff-109925da9320 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:42.797736 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9e580b1b-399e-4037-aeff-109925da9320 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:42.798211 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9e580b1b-399e-4037-aeff-109925da9320 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:43.325453 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-9e580b1b-399e-4037-aeff-109925da9320 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf92af08fa94215b4eafcacea6c63f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e7d37a0e3b4b32ae99c3bc15a831e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:43.336369 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-9e580b1b-399e-4037-aeff-109925da9320 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "GET /compute/v2.1/servers/c942eaa9-e288-44b7-b76c-afaf9b84b93d" status: 200 len: 1316 microversion: 2.1 time: 0.578196 Jul 23 21:16:43.347012 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 477/922] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:16:42 2022] GET /compute/v2.1/servers/c942eaa9-e288-44b7-b76c-afaf9b84b93d => generated 1316 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:43.353689 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-3d72dd39-c040-4f93-b79c-297dd4d06731 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:43.354693 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-3d72dd39-c040-4f93-b79c-297dd4d06731 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 760fa31f-a0cf-46df-b456-3af5dc7f9933] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:43.363684 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3d72dd39-c040-4f93-b79c-297dd4d06731 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:43.364548 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3d72dd39-c040-4f93-b79c-297dd4d06731 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:43.365608 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3d72dd39-c040-4f93-b79c-297dd4d06731 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:43.366281 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3d72dd39-c040-4f93-b79c-297dd4d06731 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:43.872219 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-3d72dd39-c040-4f93-b79c-297dd4d06731 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:43.888980 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-3d72dd39-c040-4f93-b79c-297dd4d06731 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933" status: 200 len: 1378 microversion: 2.1 time: 0.540450 Jul 23 21:16:43.891392 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 478/923] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:16:43 2022] GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933 => generated 1378 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:43.898931 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-5b102b68-cc5f-426d-a857-da065fe41648 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '.version_select at 0x7f0b47fac940>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:43.977070 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-5b102b68-cc5f-426d-a857-da065fe41648 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/images/8a2df693-27eb-4ab8-9b5e-e603a022f603" status: 200 len: 1422 microversion: 2.1 time: 0.084075 Jul 23 21:16:43.978359 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 479/924] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:16:43 2022] GET /compute/v2.1/images/8a2df693-27eb-4ab8-9b5e-e603a022f603 => generated 1422 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:43.985408 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-127c484e-b525-4bcc-bf82-d071402365dc tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:43.987022 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-127c484e-b525-4bcc-bf82-d071402365dc tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: a6de755e-739d-437c-aafb-6bc49f8bb086] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:43.996523 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-127c484e-b525-4bcc-bf82-d071402365dc tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:43.997218 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-127c484e-b525-4bcc-bf82-d071402365dc tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:43.998707 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-127c484e-b525-4bcc-bf82-d071402365dc tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:43.999316 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-127c484e-b525-4bcc-bf82-d071402365dc tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:44.506514 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-127c484e-b525-4bcc-bf82-d071402365dc tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:44.523725 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-127c484e-b525-4bcc-bf82-d071402365dc tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:44.562175 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-127c484e-b525-4bcc-bf82-d071402365dc tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:44.568992 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-127c484e-b525-4bcc-bf82-d071402365dc tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/a6de755e-739d-437c-aafb-6bc49f8bb086" status: 200 len: 1412 microversion: 2.25 time: 0.588672 Jul 23 21:16:44.569781 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 480/925] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:16:43 2022] GET /compute/v2.1/servers/a6de755e-739d-437c-aafb-6bc49f8bb086 => generated 1412 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:16:44.587498 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-97483bc5-5196-4cfe-9e91-a7c6047fe5fd tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '.version_select at 0x7f0b47f1d550>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:44.703078 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-97483bc5-5196-4cfe-9e91-a7c6047fe5fd tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/images/8a2df693-27eb-4ab8-9b5e-e603a022f603" status: 200 len: 1422 microversion: 2.1 time: 0.126523 Jul 23 21:16:44.704222 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 481/926] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:16:44 2022] GET /compute/v2.1/images/8a2df693-27eb-4ab8-9b5e-e603a022f603 => generated 1422 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:44.709700 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-940bd2be-b796-4509-aac6-02e702cdfc82 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:44.710718 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-940bd2be-b796-4509-aac6-02e702cdfc82 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: c942eaa9-e288-44b7-b76c-afaf9b84b93d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:44.719280 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-940bd2be-b796-4509-aac6-02e702cdfc82 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:44.719839 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-940bd2be-b796-4509-aac6-02e702cdfc82 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:44.720957 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-940bd2be-b796-4509-aac6-02e702cdfc82 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:44.722150 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-940bd2be-b796-4509-aac6-02e702cdfc82 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:44.897325 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-bef1cb34-9b0f-4e23-bea2-65e13f9b1756 tempest-FloatingIPDetailsTestJSON-1126152156 tempest-FloatingIPDetailsTestJSON-1126152156-project] 10.222.0.17 "DELETE /compute/v2.1/os-floating-ips/e7a97d7e-51a5-4301-8ee1-fdfec42106fb" status: 202 len: 0 microversion: 2.1 time: 2.453073 Jul 23 21:16:44.901998 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 446/927] 10.222.0.17 () {58 vars in 1262 bytes} [Sat Jul 23 21:16:42 2022] DELETE /compute/v2.1/os-floating-ips/e7a97d7e-51a5-4301-8ee1-fdfec42106fb => generated 0 bytes in 2462 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:16:44.910923 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-43b70cfb-d5eb-4fb7-a7d4-6200082002f9 req-61d4844d-a0ee-47d4-9190-e6456e98c020 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6de755e-739d-437c-aafb-6bc49f8bb086", "tag": "07b0b8e7-f27b-4cdb-893e-93a9a7e67017"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:16:44.949266 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-43b70cfb-d5eb-4fb7-a7d4-6200082002f9 req-61d4844d-a0ee-47d4-9190-e6456e98c020 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:44.950716 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-43b70cfb-d5eb-4fb7-a7d4-6200082002f9 req-61d4844d-a0ee-47d4-9190-e6456e98c020 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:44.985263 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-43b70cfb-d5eb-4fb7-a7d4-6200082002f9 req-61d4844d-a0ee-47d4-9190-e6456e98c020 service nova] Creating event network-changed:07b0b8e7-f27b-4cdb-893e-93a9a7e67017 for instance a6de755e-739d-437c-aafb-6bc49f8bb086 on nch1-master-1 Jul 23 21:16:45.000379 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-43b70cfb-d5eb-4fb7-a7d4-6200082002f9 req-61d4844d-a0ee-47d4-9190-e6456e98c020 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095847 Jul 23 21:16:45.000990 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 447/928] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:16:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:16:45.007778 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9368bc2b-bb75-4bd6-9391-bb1530ed57eb tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '.version_select at 0x7f0b5422a310>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:45.207201 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell0:SELECT=2 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:16:45.276260 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell0:SELECT=6 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:16:45.621970 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-940bd2be-b796-4509-aac6-02e702cdfc82 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf92af08fa94215b4eafcacea6c63f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e7d37a0e3b4b32ae99c3bc15a831e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:45.634212 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-940bd2be-b796-4509-aac6-02e702cdfc82 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "GET /compute/v2.1/servers/c942eaa9-e288-44b7-b76c-afaf9b84b93d" status: 200 len: 1316 microversion: 2.1 time: 0.928364 Jul 23 21:16:45.635106 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 482/929] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:16:44 2022] GET /compute/v2.1/servers/c942eaa9-e288-44b7-b76c-afaf9b84b93d => generated 1316 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:45.649087 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a0481d70-f5ce-464a-8fab-4d6527b39ce3 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:45.650888 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-a0481d70-f5ce-464a-8fab-4d6527b39ce3 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 760fa31f-a0cf-46df-b456-3af5dc7f9933] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:45.661576 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a0481d70-f5ce-464a-8fab-4d6527b39ce3 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:45.662563 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a0481d70-f5ce-464a-8fab-4d6527b39ce3 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:45.663770 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a0481d70-f5ce-464a-8fab-4d6527b39ce3 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:45.665835 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a0481d70-f5ce-464a-8fab-4d6527b39ce3 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:45.831168 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9368bc2b-bb75-4bd6-9391-bb1530ed57eb tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "DELETE /compute/v2.1/images/8a2df693-27eb-4ab8-9b5e-e603a022f603" status: 204 len: 0 microversion: 2.1 time: 0.827719 Jul 23 21:16:45.835280 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 448/930] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:16:45 2022] DELETE /compute/v2.1/images/8a2df693-27eb-4ab8-9b5e-e603a022f603 => generated 0 bytes in 829 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:16:45.843248 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-cb94f18a-c046-4bdf-9224-593f2a9e0138 tempest-FloatingIPDetailsTestJSON-1126152156 tempest-FloatingIPDetailsTestJSON-1126152156-project] Calling method '.version_select at 0x7f0b54ac1550>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:45.917357 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-a0481d70-f5ce-464a-8fab-4d6527b39ce3 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:45.926939 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-a0481d70-f5ce-464a-8fab-4d6527b39ce3 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933" status: 200 len: 1378 microversion: 2.1 time: 0.289415 Jul 23 21:16:45.936903 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 483/931] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:16:45 2022] GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933 => generated 1378 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:45.942444 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a8d75050-3173-42d9-b552-c05d45d8ed46 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:45.943442 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-a8d75050-3173-42d9-b552-c05d45d8ed46 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: a6de755e-739d-437c-aafb-6bc49f8bb086] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:45.950863 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a8d75050-3173-42d9-b552-c05d45d8ed46 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:45.951701 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a8d75050-3173-42d9-b552-c05d45d8ed46 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:45.952751 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a8d75050-3173-42d9-b552-c05d45d8ed46 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:45.953748 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a8d75050-3173-42d9-b552-c05d45d8ed46 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:46.120665 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-a8d75050-3173-42d9-b552-c05d45d8ed46 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:46.137579 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-a8d75050-3173-42d9-b552-c05d45d8ed46 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:46.144157 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-a8d75050-3173-42d9-b552-c05d45d8ed46 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:46.145954 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-a8d75050-3173-42d9-b552-c05d45d8ed46 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/a6de755e-739d-437c-aafb-6bc49f8bb086" status: 200 len: 1412 microversion: 2.25 time: 0.207424 Jul 23 21:16:46.146684 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 484/932] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:16:45 2022] GET /compute/v2.1/servers/a6de755e-739d-437c-aafb-6bc49f8bb086 => generated 1412 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:16:46.157514 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d9c02918-dfca-4373-9cb8-dbbfb40595ea tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:46.158430 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-d9c02918-dfca-4373-9cb8-dbbfb40595ea tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 9b360b14-9ea2-4336-b32e-d6546267664e] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:46.168202 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d9c02918-dfca-4373-9cb8-dbbfb40595ea tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:46.168202 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d9c02918-dfca-4373-9cb8-dbbfb40595ea tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:46.170128 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d9c02918-dfca-4373-9cb8-dbbfb40595ea tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:46.170657 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d9c02918-dfca-4373-9cb8-dbbfb40595ea tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:46.220785 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-d9c02918-dfca-4373-9cb8-dbbfb40595ea tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 9b360b14-9ea2-4336-b32e-d6546267664e] Going to try to terminate instance {{(pid=131321) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:16:46.350919 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-d9c02918-dfca-4373-9cb8-dbbfb40595ea tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "DELETE /compute/v2.1/servers/9b360b14-9ea2-4336-b32e-d6546267664e" status: 204 len: 0 microversion: 2.1 time: 0.202414 Jul 23 21:16:46.351525 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 485/933] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:16:46 2022] DELETE /compute/v2.1/servers/9b360b14-9ea2-4336-b32e-d6546267664e => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:16:46.457577 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ec460532-777a-4033-955a-13cc002455df tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1931230277", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "networks": [{"uuid": "472a8f36-7623-4bc7-b732-b31d10b9dfde"}]}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:16:46.521175 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.network.neutron [None req-ec460532-777a-4033-955a-13cc002455df tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] validate_networks() for [('472a8f36-7623-4bc7-b732-b31d10b9dfde', None, None, None, None, None)] {{(pid=131321) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:16:46.967727 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=13 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:16:47.094927 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-ec460532-777a-4033-955a-13cc002455df tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Flavor limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:16:47.095769 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-ec460532-777a-4033-955a-13cc002455df tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Image limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:16:47.096530 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-ec460532-777a-4033-955a-13cc002455df tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Flavor pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:16:47.096948 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-ec460532-777a-4033-955a-13cc002455df tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Image pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:16:47.097622 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-ec460532-777a-4033-955a-13cc002455df tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:16:47.111155 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ec460532-777a-4033-955a-13cc002455df tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:47.111906 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ec460532-777a-4033-955a-13cc002455df tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:47.113043 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ec460532-777a-4033-955a-13cc002455df tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:47.113630 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ec460532-777a-4033-955a-13cc002455df tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:47.122565 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-cb94f18a-c046-4bdf-9224-593f2a9e0138 tempest-FloatingIPDetailsTestJSON-1126152156 tempest-FloatingIPDetailsTestJSON-1126152156-project] 10.222.0.17 "DELETE /compute/v2.1/os-floating-ips/ef7fab67-b079-4e20-8162-bfd22e3460ef" status: 202 len: 0 microversion: 2.1 time: 1.284667 Jul 23 21:16:47.123189 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 449/934] 10.222.0.17 () {58 vars in 1262 bytes} [Sat Jul 23 21:16:45 2022] DELETE /compute/v2.1/os-floating-ips/ef7fab67-b079-4e20-8162-bfd22e3460ef => generated 0 bytes in 1287 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:16:47.129501 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-37842119-22b5-42b0-ae77-8c0c64793769 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:47.130502 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-37842119-22b5-42b0-ae77-8c0c64793769 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: c942eaa9-e288-44b7-b76c-afaf9b84b93d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:47.148440 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-37842119-22b5-42b0-ae77-8c0c64793769 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:47.152296 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-37842119-22b5-42b0-ae77-8c0c64793769 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:47.153294 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-37842119-22b5-42b0-ae77-8c0c64793769 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:47.156182 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-37842119-22b5-42b0-ae77-8c0c64793769 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:47.175952 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-ec460532-777a-4033-955a-13cc002455df tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Getting quotas for project 580ed681cbf44d10936259b17f60f1b2. Resources: {'ram', 'instances', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:16:47.189907 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-ec460532-777a-4033-955a-13cc002455df tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Getting quotas for user bb4f9dda4c2a411cb0394bf86e9ae223 and project 580ed681cbf44d10936259b17f60f1b2. Resources: {'ram', 'instances', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:16:47.220379 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-ec460532-777a-4033-955a-13cc002455df tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Going to run 1 instances... {{(pid=131321) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:16:47.223912 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-ec460532-777a-4033-955a-13cc002455df tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 8025dc38-59d4-4296-b2c7-5aebb08eacae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131321) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:16:47.297171 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-ec460532-777a-4033-955a-13cc002455df tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.844605 Jul 23 21:16:47.298183 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 486/935] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:16:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 847 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 23 21:16:47.313260 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-bbbfa033-434b-4e46-ab48-db24be6d2d05 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:47.314126 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-bbbfa033-434b-4e46-ab48-db24be6d2d05 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 760fa31f-a0cf-46df-b456-3af5dc7f9933] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:47.327893 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bbbfa033-434b-4e46-ab48-db24be6d2d05 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:47.328346 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bbbfa033-434b-4e46-ab48-db24be6d2d05 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:47.330089 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bbbfa033-434b-4e46-ab48-db24be6d2d05 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:47.330547 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bbbfa033-434b-4e46-ab48-db24be6d2d05 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:47.431449 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-37842119-22b5-42b0-ae77-8c0c64793769 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf92af08fa94215b4eafcacea6c63f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e7d37a0e3b4b32ae99c3bc15a831e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:47.443935 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-37842119-22b5-42b0-ae77-8c0c64793769 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "GET /compute/v2.1/servers/c942eaa9-e288-44b7-b76c-afaf9b84b93d" status: 200 len: 1464 microversion: 2.1 time: 0.318588 Jul 23 21:16:47.446209 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 450/936] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:16:47 2022] GET /compute/v2.1/servers/c942eaa9-e288-44b7-b76c-afaf9b84b93d => generated 1464 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:47.457055 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0cc747f0-010e-4b38-bffd-a22c462a1fd6 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:47.463133 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-0cc747f0-010e-4b38-bffd-a22c462a1fd6 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: a6de755e-739d-437c-aafb-6bc49f8bb086] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:47.476153 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0cc747f0-010e-4b38-bffd-a22c462a1fd6 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:47.478315 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0cc747f0-010e-4b38-bffd-a22c462a1fd6 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:47.479188 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0cc747f0-010e-4b38-bffd-a22c462a1fd6 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:47.479634 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0cc747f0-010e-4b38-bffd-a22c462a1fd6 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:47.583170 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-bbbfa033-434b-4e46-ab48-db24be6d2d05 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:47.596433 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-bbbfa033-434b-4e46-ab48-db24be6d2d05 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933" status: 200 len: 1378 microversion: 2.1 time: 0.294633 Jul 23 21:16:47.606126 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 487/937] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:16:47 2022] GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933 => generated 1378 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:47.613003 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-63be787a-41d5-4de0-80b1-734dc4300f52 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:47.613995 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-63be787a-41d5-4de0-80b1-734dc4300f52 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 8025dc38-59d4-4296-b2c7-5aebb08eacae] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:47.700517 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-63be787a-41d5-4de0-80b1-734dc4300f52 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4f9dda4c2a411cb0394bf86e9ae223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580ed681cbf44d10936259b17f60f1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:47.711202 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-63be787a-41d5-4de0-80b1-734dc4300f52 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/servers/8025dc38-59d4-4296-b2c7-5aebb08eacae" status: 200 len: 1208 microversion: 2.1 time: 0.112080 Jul 23 21:16:47.712444 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 488/938] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:16:47 2022] GET /compute/v2.1/servers/8025dc38-59d4-4296-b2c7-5aebb08eacae => generated 1208 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:47.735271 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-20018273-60da-4b98-a015-45790194caa3 req-c1fa0bbc-3859-40ad-9815-1a619de26cd4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "760fa31f-a0cf-46df-b456-3af5dc7f9933", "tag": "0eaaed80-36fa-4393-8345-fc0c35160cb5"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:16:47.758114 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-20018273-60da-4b98-a015-45790194caa3 req-c1fa0bbc-3859-40ad-9815-1a619de26cd4 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:47.758699 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-20018273-60da-4b98-a015-45790194caa3 req-c1fa0bbc-3859-40ad-9815-1a619de26cd4 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:47.787867 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-20018273-60da-4b98-a015-45790194caa3 req-c1fa0bbc-3859-40ad-9815-1a619de26cd4 service nova] Creating event network-changed:0eaaed80-36fa-4393-8345-fc0c35160cb5 for instance 760fa31f-a0cf-46df-b456-3af5dc7f9933 on nch1-master-1 Jul 23 21:16:47.798501 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-20018273-60da-4b98-a015-45790194caa3 req-c1fa0bbc-3859-40ad-9815-1a619de26cd4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083718 Jul 23 21:16:47.801560 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 489/939] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:16:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:16:47.807847 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d783f17b-fd68-44f0-b54e-11e515f068e0 tempest-ServersOnMultiNodesTest-1671986198 tempest-ServersOnMultiNodesTest-1671986198-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:47.808970 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-d783f17b-fd68-44f0-b54e-11e515f068e0 tempest-ServersOnMultiNodesTest-1671986198 tempest-ServersOnMultiNodesTest-1671986198-project-admin] [instance: c942eaa9-e288-44b7-b76c-afaf9b84b93d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:47.819378 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d783f17b-fd68-44f0-b54e-11e515f068e0 tempest-ServersOnMultiNodesTest-1671986198 tempest-ServersOnMultiNodesTest-1671986198-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:47.820332 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d783f17b-fd68-44f0-b54e-11e515f068e0 tempest-ServersOnMultiNodesTest-1671986198 tempest-ServersOnMultiNodesTest-1671986198-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:47.821285 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d783f17b-fd68-44f0-b54e-11e515f068e0 tempest-ServersOnMultiNodesTest-1671986198 tempest-ServersOnMultiNodesTest-1671986198-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:47.822025 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d783f17b-fd68-44f0-b54e-11e515f068e0 tempest-ServersOnMultiNodesTest-1671986198 tempest-ServersOnMultiNodesTest-1671986198-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:47.855838 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-0cc747f0-010e-4b38-bffd-a22c462a1fd6 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:47.867095 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-0cc747f0-010e-4b38-bffd-a22c462a1fd6 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:47.868660 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-0cc747f0-010e-4b38-bffd-a22c462a1fd6 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:47.869845 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-0cc747f0-010e-4b38-bffd-a22c462a1fd6 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/a6de755e-739d-437c-aafb-6bc49f8bb086" status: 200 len: 1412 microversion: 2.25 time: 0.421895 Jul 23 21:16:47.876199 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 451/940] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:16:47 2022] GET /compute/v2.1/servers/a6de755e-739d-437c-aafb-6bc49f8bb086 => generated 1412 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:16:48.198811 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-d783f17b-fd68-44f0-b54e-11e515f068e0 tempest-ServersOnMultiNodesTest-1671986198 tempest-ServersOnMultiNodesTest-1671986198-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/c942eaa9-e288-44b7-b76c-afaf9b84b93d" status: 200 len: 1615 microversion: 2.1 time: 0.395810 Jul 23 21:16:48.203133 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 490/941] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:16:47 2022] GET /compute/v2.1/servers/c942eaa9-e288-44b7-b76c-afaf9b84b93d => generated 1615 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:48.358285 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-1c2ce4d1-e393-4339-93eb-d20535fac866 req-c04f4713-21f5-4dd2-a8ff-9964ef6f60dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b360b14-9ea2-4336-b32e-d6546267664e", "name": "network-vif-unplugged", "status": "completed", "tag": "ab0b5da4-b12b-497b-b93e-08673983e63d"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:16:48.368351 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=28 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:16:48.388543 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-1c2ce4d1-e393-4339-93eb-d20535fac866 req-c04f4713-21f5-4dd2-a8ff-9964ef6f60dc service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:48.389284 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-1c2ce4d1-e393-4339-93eb-d20535fac866 req-c04f4713-21f5-4dd2-a8ff-9964ef6f60dc service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:48.427294 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-1c2ce4d1-e393-4339-93eb-d20535fac866 req-c04f4713-21f5-4dd2-a8ff-9964ef6f60dc service nova] Creating event network-vif-unplugged:ab0b5da4-b12b-497b-b93e-08673983e63d for instance 9b360b14-9ea2-4336-b32e-d6546267664e on nch1-master-1 Jul 23 21:16:48.441700 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-1c2ce4d1-e393-4339-93eb-d20535fac866 req-c04f4713-21f5-4dd2-a8ff-9964ef6f60dc service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.087149 Jul 23 21:16:48.445651 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 452/942] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:16:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:16:48.449967 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c3a7313d-00a9-4794-967e-b0fdec258880 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1155515055", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["9e985a36-586a-4546-a0c0-1a3e3da330c9"]}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:16:48.545446 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.network.neutron [None req-c3a7313d-00a9-4794-967e-b0fdec258880 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] validate_networks() for None {{(pid=131321) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:16:48.632156 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6edb3a3d-090a-448f-9e10-08068e730dca tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:48.634669 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6edb3a3d-090a-448f-9e10-08068e730dca tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 760fa31f-a0cf-46df-b456-3af5dc7f9933] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:48.646894 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6edb3a3d-090a-448f-9e10-08068e730dca tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:48.647626 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6edb3a3d-090a-448f-9e10-08068e730dca tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:48.648944 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6edb3a3d-090a-448f-9e10-08068e730dca tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:48.649628 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6edb3a3d-090a-448f-9e10-08068e730dca tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:49.297901 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6edb3a3d-090a-448f-9e10-08068e730dca tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:49.309676 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6edb3a3d-090a-448f-9e10-08068e730dca tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933" status: 200 len: 1378 microversion: 2.1 time: 0.698970 Jul 23 21:16:49.327218 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 453/943] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:16:48 2022] GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933 => generated 1378 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:16:49.327218 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-68821a6b-0b36-49f6-9589-a976926a0bc6 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:49.327218 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-68821a6b-0b36-49f6-9589-a976926a0bc6 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 8025dc38-59d4-4296-b2c7-5aebb08eacae] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:49.333485 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-68821a6b-0b36-49f6-9589-a976926a0bc6 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:49.334185 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-68821a6b-0b36-49f6-9589-a976926a0bc6 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:49.335187 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-68821a6b-0b36-49f6-9589-a976926a0bc6 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:49.335795 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-68821a6b-0b36-49f6-9589-a976926a0bc6 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:49.367655 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-c3a7313d-00a9-4794-967e-b0fdec258880 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Flavor limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:16:49.368085 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-c3a7313d-00a9-4794-967e-b0fdec258880 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Image limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:16:49.368552 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-c3a7313d-00a9-4794-967e-b0fdec258880 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Flavor pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:16:49.369281 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-c3a7313d-00a9-4794-967e-b0fdec258880 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Image pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:16:49.369755 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-c3a7313d-00a9-4794-967e-b0fdec258880 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:16:49.396309 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c3a7313d-00a9-4794-967e-b0fdec258880 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:49.397090 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c3a7313d-00a9-4794-967e-b0fdec258880 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:49.398222 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c3a7313d-00a9-4794-967e-b0fdec258880 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:49.398855 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c3a7313d-00a9-4794-967e-b0fdec258880 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:49.443390 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-c3a7313d-00a9-4794-967e-b0fdec258880 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Getting quotas for project f5e7d37a0e3b4b32ae99c3bc15a831e6. Resources: {'ram', 'instances', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:16:49.459544 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-c3a7313d-00a9-4794-967e-b0fdec258880 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Getting quotas for user ebf92af08fa94215b4eafcacea6c63f6 and project f5e7d37a0e3b4b32ae99c3bc15a831e6. Resources: {'ram', 'instances', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:16:49.502418 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-c3a7313d-00a9-4794-967e-b0fdec258880 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Going to run 1 instances... {{(pid=131321) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:16:49.509299 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-c3a7313d-00a9-4794-967e-b0fdec258880 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: a27111b2-863b-460b-9b89-ba08092d3561] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131321) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:16:49.558565 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-68821a6b-0b36-49f6-9589-a976926a0bc6 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4f9dda4c2a411cb0394bf86e9ae223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580ed681cbf44d10936259b17f60f1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:49.579719 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-68821a6b-0b36-49f6-9589-a976926a0bc6 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/servers/8025dc38-59d4-4296-b2c7-5aebb08eacae" status: 200 len: 1260 microversion: 2.1 time: 0.267163 Jul 23 21:16:49.589983 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 454/944] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:16:49 2022] GET /compute/v2.1/servers/8025dc38-59d4-4296-b2c7-5aebb08eacae => generated 1260 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:49.602850 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-87959059-c740-4eb3-826f-310d22f7616c tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:49.603827 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-87959059-c740-4eb3-826f-310d22f7616c tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: a6de755e-739d-437c-aafb-6bc49f8bb086] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:49.619023 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-87959059-c740-4eb3-826f-310d22f7616c tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:49.619736 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-87959059-c740-4eb3-826f-310d22f7616c tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:49.620955 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-87959059-c740-4eb3-826f-310d22f7616c tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:49.621795 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-c3a7313d-00a9-4794-967e-b0fdec258880 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.175346 Jul 23 21:16:49.630733 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-87959059-c740-4eb3-826f-310d22f7616c tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:49.641125 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 491/945] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:16:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1184 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 23 21:16:49.653400 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f60ae352-3fea-458a-989b-3a9967c6c2f7 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:49.654089 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-f60ae352-3fea-458a-989b-3a9967c6c2f7 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: a27111b2-863b-460b-9b89-ba08092d3561] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:49.801814 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-f60ae352-3fea-458a-989b-3a9967c6c2f7 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf92af08fa94215b4eafcacea6c63f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e7d37a0e3b4b32ae99c3bc15a831e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:49.815626 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-f60ae352-3fea-458a-989b-3a9967c6c2f7 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "GET /compute/v2.1/servers/a27111b2-863b-460b-9b89-ba08092d3561" status: 200 len: 1217 microversion: 2.1 time: 0.167197 Jul 23 21:16:49.836239 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 492/946] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:16:49 2022] GET /compute/v2.1/servers/a27111b2-863b-460b-9b89-ba08092d3561 => generated 1217 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:50.343381 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-3faaa0af-d86f-4a17-9816-4510a9f6a8b8 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:50.344207 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-3faaa0af-d86f-4a17-9816-4510a9f6a8b8 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 760fa31f-a0cf-46df-b456-3af5dc7f9933] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:50.355080 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3faaa0af-d86f-4a17-9816-4510a9f6a8b8 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:50.355541 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3faaa0af-d86f-4a17-9816-4510a9f6a8b8 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:50.356349 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3faaa0af-d86f-4a17-9816-4510a9f6a8b8 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:50.356900 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3faaa0af-d86f-4a17-9816-4510a9f6a8b8 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:50.608045 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-87959059-c740-4eb3-826f-310d22f7616c tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:50.626037 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-87959059-c740-4eb3-826f-310d22f7616c tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:50.629003 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-87959059-c740-4eb3-826f-310d22f7616c tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:50.634891 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-87959059-c740-4eb3-826f-310d22f7616c tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/a6de755e-739d-437c-aafb-6bc49f8bb086" status: 200 len: 1412 microversion: 2.25 time: 1.043753 Jul 23 21:16:50.638222 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 455/947] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:16:49 2022] GET /compute/v2.1/servers/a6de755e-739d-437c-aafb-6bc49f8bb086 => generated 1412 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:16:50.649899 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-679f796f-fed2-4b21-92de-8278bc2e94f9 req-c7a2aaec-12f8-40b4-8397-4cbf33086bc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6de755e-739d-437c-aafb-6bc49f8bb086", "name": "network-vif-plugged", "status": "completed", "tag": "07b0b8e7-f27b-4cdb-893e-93a9a7e67017"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:16:50.683248 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-679f796f-fed2-4b21-92de-8278bc2e94f9 req-c7a2aaec-12f8-40b4-8397-4cbf33086bc2 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:50.686803 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-679f796f-fed2-4b21-92de-8278bc2e94f9 req-c7a2aaec-12f8-40b4-8397-4cbf33086bc2 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:50.710993 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-679f796f-fed2-4b21-92de-8278bc2e94f9 req-c7a2aaec-12f8-40b4-8397-4cbf33086bc2 service nova] Creating event network-vif-plugged:07b0b8e7-f27b-4cdb-893e-93a9a7e67017 for instance a6de755e-739d-437c-aafb-6bc49f8bb086 on nch1-master-1 Jul 23 21:16:50.731588 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-679f796f-fed2-4b21-92de-8278bc2e94f9 req-c7a2aaec-12f8-40b4-8397-4cbf33086bc2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089750 Jul 23 21:16:50.732569 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 456/948] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:16:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:16:50.738930 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-7a353131-a45f-4c5f-84a9-0907a984228f tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:50.740039 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-7a353131-a45f-4c5f-84a9-0907a984228f tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 8025dc38-59d4-4296-b2c7-5aebb08eacae] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:50.747987 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7a353131-a45f-4c5f-84a9-0907a984228f tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:50.748759 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7a353131-a45f-4c5f-84a9-0907a984228f tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:50.750253 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7a353131-a45f-4c5f-84a9-0907a984228f tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:50.750905 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7a353131-a45f-4c5f-84a9-0907a984228f tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:51.137019 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-7a353131-a45f-4c5f-84a9-0907a984228f tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4f9dda4c2a411cb0394bf86e9ae223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580ed681cbf44d10936259b17f60f1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:51.150784 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-7a353131-a45f-4c5f-84a9-0907a984228f tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/servers/8025dc38-59d4-4296-b2c7-5aebb08eacae" status: 200 len: 1266 microversion: 2.1 time: 0.416749 Jul 23 21:16:51.151395 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 457/949] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:16:50 2022] GET /compute/v2.1/servers/8025dc38-59d4-4296-b2c7-5aebb08eacae => generated 1266 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:51.167818 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-323edc7c-311f-4905-969d-de5a466704f0 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:51.168696 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-323edc7c-311f-4905-969d-de5a466704f0 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: a27111b2-863b-460b-9b89-ba08092d3561] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:51.178430 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-323edc7c-311f-4905-969d-de5a466704f0 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:51.179300 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-323edc7c-311f-4905-969d-de5a466704f0 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:51.180279 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-323edc7c-311f-4905-969d-de5a466704f0 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:51.181968 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-323edc7c-311f-4905-969d-de5a466704f0 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:51.221114 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-3faaa0af-d86f-4a17-9816-4510a9f6a8b8 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:51.228114 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:16:51.242546 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-3faaa0af-d86f-4a17-9816-4510a9f6a8b8 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933" status: 200 len: 1378 microversion: 2.1 time: 0.911282 Jul 23 21:16:51.243252 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 493/950] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:16:50 2022] GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933 => generated 1378 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:51.391009 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-323edc7c-311f-4905-969d-de5a466704f0 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf92af08fa94215b4eafcacea6c63f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e7d37a0e3b4b32ae99c3bc15a831e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:51.395915 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=100 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:16:51.411463 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-323edc7c-311f-4905-969d-de5a466704f0 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "GET /compute/v2.1/servers/a27111b2-863b-460b-9b89-ba08092d3561" status: 200 len: 1277 microversion: 2.1 time: 0.253652 Jul 23 21:16:51.412218 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 458/951] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:16:51 2022] GET /compute/v2.1/servers/a27111b2-863b-460b-9b89-ba08092d3561 => generated 1277 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:51.548332 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-5b17863e-5660-42ec-a45d-47b60bb1deb5 req-e7afc693-e62b-45c3-ad96-f04211e2f04e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b360b14-9ea2-4336-b32e-d6546267664e", "name": "network-vif-deleted", "tag": "ab0b5da4-b12b-497b-b93e-08673983e63d"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:16:51.557600 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-5b17863e-5660-42ec-a45d-47b60bb1deb5 req-e7afc693-e62b-45c3-ad96-f04211e2f04e service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:51.558531 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-5b17863e-5660-42ec-a45d-47b60bb1deb5 req-e7afc693-e62b-45c3-ad96-f04211e2f04e service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:51.572680 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-5b17863e-5660-42ec-a45d-47b60bb1deb5 req-e7afc693-e62b-45c3-ad96-f04211e2f04e service nova] Creating event network-vif-deleted:ab0b5da4-b12b-497b-b93e-08673983e63d for instance 9b360b14-9ea2-4336-b32e-d6546267664e on nch1-master-1 Jul 23 21:16:51.578645 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-5b17863e-5660-42ec-a45d-47b60bb1deb5 req-e7afc693-e62b-45c3-ad96-f04211e2f04e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034560 Jul 23 21:16:51.579727 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 494/952] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:16:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:16:51.655844 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-7b3bca5b-2ec8-49cb-8fcb-d17fb5883477 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:51.656460 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-7b3bca5b-2ec8-49cb-8fcb-d17fb5883477 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: a6de755e-739d-437c-aafb-6bc49f8bb086] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:51.676847 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7b3bca5b-2ec8-49cb-8fcb-d17fb5883477 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:51.676847 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7b3bca5b-2ec8-49cb-8fcb-d17fb5883477 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:51.677621 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7b3bca5b-2ec8-49cb-8fcb-d17fb5883477 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:51.678090 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7b3bca5b-2ec8-49cb-8fcb-d17fb5883477 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:52.026547 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-7b3bca5b-2ec8-49cb-8fcb-d17fb5883477 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:52.038187 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-7b3bca5b-2ec8-49cb-8fcb-d17fb5883477 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:52.039691 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-7b3bca5b-2ec8-49cb-8fcb-d17fb5883477 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:52.041193 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-7b3bca5b-2ec8-49cb-8fcb-d17fb5883477 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/a6de755e-739d-437c-aafb-6bc49f8bb086" status: 200 len: 1412 microversion: 2.25 time: 0.389427 Jul 23 21:16:52.057546 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 459/953] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:16:51 2022] GET /compute/v2.1/servers/a6de755e-739d-437c-aafb-6bc49f8bb086 => generated 1412 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:16:52.187466 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-bab4889e-c4bb-4863-bf54-5f6b954b8f97 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:52.191340 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-bab4889e-c4bb-4863-bf54-5f6b954b8f97 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 8025dc38-59d4-4296-b2c7-5aebb08eacae] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:52.206412 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bab4889e-c4bb-4863-bf54-5f6b954b8f97 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:52.208618 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bab4889e-c4bb-4863-bf54-5f6b954b8f97 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:52.216059 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bab4889e-c4bb-4863-bf54-5f6b954b8f97 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:52.217205 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bab4889e-c4bb-4863-bf54-5f6b954b8f97 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:52.261447 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b8d51406-7fc2-47d4-8cd5-5e45b31f0500 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:52.262416 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b8d51406-7fc2-47d4-8cd5-5e45b31f0500 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 760fa31f-a0cf-46df-b456-3af5dc7f9933] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:52.275644 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b8d51406-7fc2-47d4-8cd5-5e45b31f0500 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:52.278383 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b8d51406-7fc2-47d4-8cd5-5e45b31f0500 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:52.282676 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b8d51406-7fc2-47d4-8cd5-5e45b31f0500 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:52.284448 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b8d51406-7fc2-47d4-8cd5-5e45b31f0500 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:52.480507 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-bab4889e-c4bb-4863-bf54-5f6b954b8f97 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4f9dda4c2a411cb0394bf86e9ae223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580ed681cbf44d10936259b17f60f1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:52.497890 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-bab4889e-c4bb-4863-bf54-5f6b954b8f97 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/servers/8025dc38-59d4-4296-b2c7-5aebb08eacae" status: 200 len: 1266 microversion: 2.1 time: 0.329178 Jul 23 21:16:52.511453 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 495/954] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:16:52 2022] GET /compute/v2.1/servers/8025dc38-59d4-4296-b2c7-5aebb08eacae => generated 1266 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:52.551686 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-3ff49298-3f18-4011-9f7d-37071be960a0 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:52.556252 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-3ff49298-3f18-4011-9f7d-37071be960a0 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: a27111b2-863b-460b-9b89-ba08092d3561] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:52.573440 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3ff49298-3f18-4011-9f7d-37071be960a0 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:52.573883 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3ff49298-3f18-4011-9f7d-37071be960a0 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:52.576686 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3ff49298-3f18-4011-9f7d-37071be960a0 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:52.577016 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3ff49298-3f18-4011-9f7d-37071be960a0 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:52.769822 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-3ff49298-3f18-4011-9f7d-37071be960a0 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf92af08fa94215b4eafcacea6c63f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e7d37a0e3b4b32ae99c3bc15a831e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:52.781724 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-3ff49298-3f18-4011-9f7d-37071be960a0 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "GET /compute/v2.1/servers/a27111b2-863b-460b-9b89-ba08092d3561" status: 200 len: 1275 microversion: 2.1 time: 0.274351 Jul 23 21:16:52.783909 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 496/955] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:16:52 2022] GET /compute/v2.1/servers/a27111b2-863b-460b-9b89-ba08092d3561 => generated 1275 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:52.875409 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b8d51406-7fc2-47d4-8cd5-5e45b31f0500 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:52.888573 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b8d51406-7fc2-47d4-8cd5-5e45b31f0500 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933" status: 200 len: 1378 microversion: 2.1 time: 0.627819 Jul 23 21:16:52.889813 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 460/956] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:16:52 2022] GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933 => generated 1378 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:53.074680 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-8dd12ca2-5336-45d8-873b-082b6e1d350a tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:53.075300 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-8dd12ca2-5336-45d8-873b-082b6e1d350a tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: a6de755e-739d-437c-aafb-6bc49f8bb086] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:53.084840 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8dd12ca2-5336-45d8-873b-082b6e1d350a tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:53.085207 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8dd12ca2-5336-45d8-873b-082b6e1d350a tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:53.086063 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8dd12ca2-5336-45d8-873b-082b6e1d350a tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:53.093501 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8dd12ca2-5336-45d8-873b-082b6e1d350a tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:53.518416 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6f8156b5-063d-4f01-8607-c81635ca711d tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:53.519036 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6f8156b5-063d-4f01-8607-c81635ca711d tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 8025dc38-59d4-4296-b2c7-5aebb08eacae] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:53.533394 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6f8156b5-063d-4f01-8607-c81635ca711d tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:53.538459 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6f8156b5-063d-4f01-8607-c81635ca711d tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:53.539571 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6f8156b5-063d-4f01-8607-c81635ca711d tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:53.540171 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6f8156b5-063d-4f01-8607-c81635ca711d tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:53.796790 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-8dd12ca2-5336-45d8-873b-082b6e1d350a tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:53.829686 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-8dd12ca2-5336-45d8-873b-082b6e1d350a tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:53.838724 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-8dd12ca2-5336-45d8-873b-082b6e1d350a tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:53.840068 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-8dd12ca2-5336-45d8-873b-082b6e1d350a tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/a6de755e-739d-437c-aafb-6bc49f8bb086" status: 200 len: 1412 microversion: 2.25 time: 0.769387 Jul 23 21:16:53.850550 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 497/957] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:16:53 2022] GET /compute/v2.1/servers/a6de755e-739d-437c-aafb-6bc49f8bb086 => generated 1412 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:16:53.850550 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-fdd222da-e42f-4ac9-98c9-5e3a10c27615 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:53.850550 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-fdd222da-e42f-4ac9-98c9-5e3a10c27615 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: a27111b2-863b-460b-9b89-ba08092d3561] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:53.852830 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fdd222da-e42f-4ac9-98c9-5e3a10c27615 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:53.853283 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fdd222da-e42f-4ac9-98c9-5e3a10c27615 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:53.854101 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fdd222da-e42f-4ac9-98c9-5e3a10c27615 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:53.854539 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fdd222da-e42f-4ac9-98c9-5e3a10c27615 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:54.442527 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6f8156b5-063d-4f01-8607-c81635ca711d tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4f9dda4c2a411cb0394bf86e9ae223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580ed681cbf44d10936259b17f60f1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:54.456573 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6f8156b5-063d-4f01-8607-c81635ca711d tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/servers/8025dc38-59d4-4296-b2c7-5aebb08eacae" status: 200 len: 1308 microversion: 2.1 time: 0.941900 Jul 23 21:16:54.457947 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 461/958] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:16:53 2022] GET /compute/v2.1/servers/8025dc38-59d4-4296-b2c7-5aebb08eacae => generated 1308 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:54.465026 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5b1b5db4-1cb4-4b93-a856-468aa3194558 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:54.465959 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5b1b5db4-1cb4-4b93-a856-468aa3194558 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 760fa31f-a0cf-46df-b456-3af5dc7f9933] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:54.475744 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5b1b5db4-1cb4-4b93-a856-468aa3194558 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:54.476541 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5b1b5db4-1cb4-4b93-a856-468aa3194558 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:54.477557 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5b1b5db4-1cb4-4b93-a856-468aa3194558 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:54.478229 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5b1b5db4-1cb4-4b93-a856-468aa3194558 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:54.600475 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-fdd222da-e42f-4ac9-98c9-5e3a10c27615 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf92af08fa94215b4eafcacea6c63f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e7d37a0e3b4b32ae99c3bc15a831e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:54.612887 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-fdd222da-e42f-4ac9-98c9-5e3a10c27615 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "GET /compute/v2.1/servers/a27111b2-863b-460b-9b89-ba08092d3561" status: 200 len: 1317 microversion: 2.1 time: 0.770771 Jul 23 21:16:54.615788 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 498/959] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:16:53 2022] GET /compute/v2.1/servers/a27111b2-863b-460b-9b89-ba08092d3561 => generated 1317 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:54.857801 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-34e68284-bc6f-4d70-8775-d663c4c73413 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:54.858521 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-34e68284-bc6f-4d70-8775-d663c4c73413 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: a6de755e-739d-437c-aafb-6bc49f8bb086] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:54.869634 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-34e68284-bc6f-4d70-8775-d663c4c73413 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:54.871168 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-34e68284-bc6f-4d70-8775-d663c4c73413 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:54.874257 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-34e68284-bc6f-4d70-8775-d663c4c73413 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:54.874770 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-34e68284-bc6f-4d70-8775-d663c4c73413 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:55.111311 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5b1b5db4-1cb4-4b93-a856-468aa3194558 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:55.144803 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5b1b5db4-1cb4-4b93-a856-468aa3194558 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933" status: 200 len: 1378 microversion: 2.1 time: 0.679304 Jul 23 21:16:55.158981 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 462/960] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:16:54 2022] GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933 => generated 1378 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:55.458170 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-a49366a5-495e-43fb-beb8-a0ba7f74f594 req-1ec7dd3f-4d8c-4898-b7c8-53ac9844a397 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8025dc38-59d4-4296-b2c7-5aebb08eacae", "tag": "e9c441a4-cbfb-45c6-a442-223a4f1afaf0"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:16:55.486125 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-a49366a5-495e-43fb-beb8-a0ba7f74f594 req-1ec7dd3f-4d8c-4898-b7c8-53ac9844a397 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:55.486722 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-a49366a5-495e-43fb-beb8-a0ba7f74f594 req-1ec7dd3f-4d8c-4898-b7c8-53ac9844a397 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:55.519570 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-a49366a5-495e-43fb-beb8-a0ba7f74f594 req-1ec7dd3f-4d8c-4898-b7c8-53ac9844a397 service nova] Creating event network-changed:e9c441a4-cbfb-45c6-a442-223a4f1afaf0 for instance 8025dc38-59d4-4296-b2c7-5aebb08eacae on nch1-master-1 Jul 23 21:16:55.533121 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-a49366a5-495e-43fb-beb8-a0ba7f74f594 req-1ec7dd3f-4d8c-4898-b7c8-53ac9844a397 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088191 Jul 23 21:16:55.538129 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 463/961] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:16:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:16:55.550779 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-81838905-f2d9-441e-8340-9082cb221609 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:55.551493 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-81838905-f2d9-441e-8340-9082cb221609 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 8025dc38-59d4-4296-b2c7-5aebb08eacae] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:55.572469 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-81838905-f2d9-441e-8340-9082cb221609 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:55.573476 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-81838905-f2d9-441e-8340-9082cb221609 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:55.574775 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-81838905-f2d9-441e-8340-9082cb221609 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:55.575188 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-81838905-f2d9-441e-8340-9082cb221609 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:55.657808 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-34e68284-bc6f-4d70-8775-d663c4c73413 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:55.689925 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-34e68284-bc6f-4d70-8775-d663c4c73413 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:55.694644 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-34e68284-bc6f-4d70-8775-d663c4c73413 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:55.706566 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-34e68284-bc6f-4d70-8775-d663c4c73413 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/a6de755e-739d-437c-aafb-6bc49f8bb086" status: 200 len: 1609 microversion: 2.25 time: 0.848325 Jul 23 21:16:55.718676 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 499/962] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:16:54 2022] GET /compute/v2.1/servers/a6de755e-739d-437c-aafb-6bc49f8bb086 => generated 1609 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:16:55.718676 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-6e1a203b-8482-491a-a4c9-0f914fcf0a4c tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:55.718676 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-6e1a203b-8482-491a-a4c9-0f914fcf0a4c tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: a27111b2-863b-460b-9b89-ba08092d3561] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:55.744488 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6e1a203b-8482-491a-a4c9-0f914fcf0a4c tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:55.745206 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6e1a203b-8482-491a-a4c9-0f914fcf0a4c tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:55.746219 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6e1a203b-8482-491a-a4c9-0f914fcf0a4c tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:55.746810 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6e1a203b-8482-491a-a4c9-0f914fcf0a4c tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:55.950225 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-81838905-f2d9-441e-8340-9082cb221609 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4f9dda4c2a411cb0394bf86e9ae223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580ed681cbf44d10936259b17f60f1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:55.963853 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-81838905-f2d9-441e-8340-9082cb221609 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/servers/8025dc38-59d4-4296-b2c7-5aebb08eacae" status: 200 len: 1308 microversion: 2.1 time: 0.422715 Jul 23 21:16:55.964457 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 464/963] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:16:55 2022] GET /compute/v2.1/servers/8025dc38-59d4-4296-b2c7-5aebb08eacae => generated 1308 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:55.969530 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-22786279-067d-4104-b826-53f95fca3157 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:55.981805 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-22786279-067d-4104-b826-53f95fca3157 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: a6de755e-739d-437c-aafb-6bc49f8bb086] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:56.005587 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-22786279-067d-4104-b826-53f95fca3157 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:56.006492 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-22786279-067d-4104-b826-53f95fca3157 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:56.009652 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-22786279-067d-4104-b826-53f95fca3157 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:56.010343 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-22786279-067d-4104-b826-53f95fca3157 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:56.206296 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-22786279-067d-4104-b826-53f95fca3157 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/a6de755e-739d-437c-aafb-6bc49f8bb086/os-interface" status: 200 len: 285 microversion: 2.25 time: 0.240463 Jul 23 21:16:56.207240 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 465/964] 10.222.0.17 () {60 vars in 1315 bytes} [Sat Jul 23 21:16:55 2022] GET /compute/v2.1/servers/a6de755e-739d-437c-aafb-6bc49f8bb086/os-interface => generated 285 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 23 21:16:56.212471 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-545cf8ee-9d4a-435c-9e2c-49704c217754 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:56.213345 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-545cf8ee-9d4a-435c-9e2c-49704c217754 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 760fa31f-a0cf-46df-b456-3af5dc7f9933] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:56.224497 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-545cf8ee-9d4a-435c-9e2c-49704c217754 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:56.231573 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-545cf8ee-9d4a-435c-9e2c-49704c217754 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:56.232736 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-545cf8ee-9d4a-435c-9e2c-49704c217754 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:56.233372 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-545cf8ee-9d4a-435c-9e2c-49704c217754 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:56.821579 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-6e1a203b-8482-491a-a4c9-0f914fcf0a4c tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf92af08fa94215b4eafcacea6c63f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e7d37a0e3b4b32ae99c3bc15a831e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:56.840568 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-6e1a203b-8482-491a-a4c9-0f914fcf0a4c tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "GET /compute/v2.1/servers/a27111b2-863b-460b-9b89-ba08092d3561" status: 200 len: 1317 microversion: 2.1 time: 1.130164 Jul 23 21:16:56.845093 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 500/965] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:16:55 2022] GET /compute/v2.1/servers/a27111b2-863b-460b-9b89-ba08092d3561 => generated 1317 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:56.877511 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-a98d279d-45b4-4f25-9232-b23efb4d3265 req-e5995d6e-5f87-434a-96ee-6ab3727259fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a27111b2-863b-460b-9b89-ba08092d3561", "tag": "899df295-0f0b-4e78-9c0a-c4447102f642"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:16:56.888299 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:16:56.893777 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-a98d279d-45b4-4f25-9232-b23efb4d3265 req-e5995d6e-5f87-434a-96ee-6ab3727259fb service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:56.894745 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-a98d279d-45b4-4f25-9232-b23efb4d3265 req-e5995d6e-5f87-434a-96ee-6ab3727259fb service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:56.927658 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-a98d279d-45b4-4f25-9232-b23efb4d3265 req-e5995d6e-5f87-434a-96ee-6ab3727259fb service nova] Creating event network-changed:899df295-0f0b-4e78-9c0a-c4447102f642 for instance a27111b2-863b-460b-9b89-ba08092d3561 on nch2-master-1 Jul 23 21:16:56.940503 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-a98d279d-45b4-4f25-9232-b23efb4d3265 req-e5995d6e-5f87-434a-96ee-6ab3727259fb service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087309 Jul 23 21:16:56.941817 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 501/966] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:16:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:16:56.984003 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-330188b4-f783-452c-89ce-e00b840dc0b3 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:56.985160 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-330188b4-f783-452c-89ce-e00b840dc0b3 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 8025dc38-59d4-4296-b2c7-5aebb08eacae] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:57.004723 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-330188b4-f783-452c-89ce-e00b840dc0b3 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:57.007086 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-330188b4-f783-452c-89ce-e00b840dc0b3 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:57.012481 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-330188b4-f783-452c-89ce-e00b840dc0b3 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:57.013374 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-330188b4-f783-452c-89ce-e00b840dc0b3 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:57.290154 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-545cf8ee-9d4a-435c-9e2c-49704c217754 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:57.304100 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-545cf8ee-9d4a-435c-9e2c-49704c217754 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933" status: 200 len: 1378 microversion: 2.1 time: 1.095022 Jul 23 21:16:57.306213 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 466/967] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:16:56 2022] GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933 => generated 1378 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:57.387480 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-330188b4-f783-452c-89ce-e00b840dc0b3 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4f9dda4c2a411cb0394bf86e9ae223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580ed681cbf44d10936259b17f60f1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:57.406413 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-330188b4-f783-452c-89ce-e00b840dc0b3 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/servers/8025dc38-59d4-4296-b2c7-5aebb08eacae" status: 200 len: 1308 microversion: 2.1 time: 0.428939 Jul 23 21:16:57.407322 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 502/968] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:16:56 2022] GET /compute/v2.1/servers/8025dc38-59d4-4296-b2c7-5aebb08eacae => generated 1308 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:57.859571 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-91695f39-ce26-4e14-94c3-5be086df4975 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:57.860487 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-91695f39-ce26-4e14-94c3-5be086df4975 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: a27111b2-863b-460b-9b89-ba08092d3561] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:57.868704 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-91695f39-ce26-4e14-94c3-5be086df4975 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:57.869648 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-91695f39-ce26-4e14-94c3-5be086df4975 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:57.870972 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-91695f39-ce26-4e14-94c3-5be086df4975 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:57.871514 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-91695f39-ce26-4e14-94c3-5be086df4975 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:58.322287 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-29eb5fdb-2cbb-40a0-8bae-4abb5852868f tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:58.322956 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-29eb5fdb-2cbb-40a0-8bae-4abb5852868f tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 760fa31f-a0cf-46df-b456-3af5dc7f9933] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:58.342063 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-29eb5fdb-2cbb-40a0-8bae-4abb5852868f tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:58.342942 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-29eb5fdb-2cbb-40a0-8bae-4abb5852868f tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:58.344957 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-29eb5fdb-2cbb-40a0-8bae-4abb5852868f tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:58.348083 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-29eb5fdb-2cbb-40a0-8bae-4abb5852868f tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:58.396772 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-91695f39-ce26-4e14-94c3-5be086df4975 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf92af08fa94215b4eafcacea6c63f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e7d37a0e3b4b32ae99c3bc15a831e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:58.418296 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-91695f39-ce26-4e14-94c3-5be086df4975 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "GET /compute/v2.1/servers/a27111b2-863b-460b-9b89-ba08092d3561" status: 200 len: 1317 microversion: 2.1 time: 0.562603 Jul 23 21:16:58.429186 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 467/969] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:16:57 2022] GET /compute/v2.1/servers/a27111b2-863b-460b-9b89-ba08092d3561 => generated 1317 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:58.435218 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d71deeda-bbfe-43e2-baf7-099606561ab5 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:58.436032 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d71deeda-bbfe-43e2-baf7-099606561ab5 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 8025dc38-59d4-4296-b2c7-5aebb08eacae] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:58.453666 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d71deeda-bbfe-43e2-baf7-099606561ab5 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:58.454414 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d71deeda-bbfe-43e2-baf7-099606561ab5 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:58.455476 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d71deeda-bbfe-43e2-baf7-099606561ab5 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:58.456060 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d71deeda-bbfe-43e2-baf7-099606561ab5 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:58.620855 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-29eb5fdb-2cbb-40a0-8bae-4abb5852868f tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:58.630508 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-29eb5fdb-2cbb-40a0-8bae-4abb5852868f tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933" status: 200 len: 1378 microversion: 2.1 time: 0.312191 Jul 23 21:16:58.643164 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 503/970] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:16:58 2022] GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933 => generated 1378 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:58.679189 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-2653554f-7b4b-462a-a774-14bd7df94497 req-80b645b5-150b-477f-9b3b-48bfc226337f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "760fa31f-a0cf-46df-b456-3af5dc7f9933", "name": "network-vif-plugged", "status": "completed", "tag": "0eaaed80-36fa-4393-8345-fc0c35160cb5"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:16:58.695391 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-2653554f-7b4b-462a-a774-14bd7df94497 req-80b645b5-150b-477f-9b3b-48bfc226337f service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:58.696311 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-2653554f-7b4b-462a-a774-14bd7df94497 req-80b645b5-150b-477f-9b3b-48bfc226337f service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:58.754836 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-2653554f-7b4b-462a-a774-14bd7df94497 req-80b645b5-150b-477f-9b3b-48bfc226337f service nova] Creating event network-vif-plugged:0eaaed80-36fa-4393-8345-fc0c35160cb5 for instance 760fa31f-a0cf-46df-b456-3af5dc7f9933 on nch1-master-1 Jul 23 21:16:58.763499 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-2653554f-7b4b-462a-a774-14bd7df94497 req-80b645b5-150b-477f-9b3b-48bfc226337f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090206 Jul 23 21:16:58.764846 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 504/971] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:16:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:16:58.853419 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d71deeda-bbfe-43e2-baf7-099606561ab5 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4f9dda4c2a411cb0394bf86e9ae223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580ed681cbf44d10936259b17f60f1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:58.875094 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d71deeda-bbfe-43e2-baf7-099606561ab5 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/servers/8025dc38-59d4-4296-b2c7-5aebb08eacae" status: 200 len: 1308 microversion: 2.1 time: 0.444367 Jul 23 21:16:58.876789 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 468/972] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:16:58 2022] GET /compute/v2.1/servers/8025dc38-59d4-4296-b2c7-5aebb08eacae => generated 1308 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:59.437988 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-69e91851-5185-4ea3-8260-e518a9add9cc tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:59.438811 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-69e91851-5185-4ea3-8260-e518a9add9cc tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: a27111b2-863b-460b-9b89-ba08092d3561] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:59.448126 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell0:SELECT=4 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:16:59.464559 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-69e91851-5185-4ea3-8260-e518a9add9cc tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:59.473286 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-69e91851-5185-4ea3-8260-e518a9add9cc tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:59.474481 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-69e91851-5185-4ea3-8260-e518a9add9cc tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:59.475082 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-69e91851-5185-4ea3-8260-e518a9add9cc tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:59.650169 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ff00ed68-3e34-4e66-aa1c-9d9a88f01047 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:59.650786 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ff00ed68-3e34-4e66-aa1c-9d9a88f01047 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 760fa31f-a0cf-46df-b456-3af5dc7f9933] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:59.661306 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ff00ed68-3e34-4e66-aa1c-9d9a88f01047 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:59.668713 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ff00ed68-3e34-4e66-aa1c-9d9a88f01047 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:59.669575 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ff00ed68-3e34-4e66-aa1c-9d9a88f01047 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:59.670060 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ff00ed68-3e34-4e66-aa1c-9d9a88f01047 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:59.807784 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-69e91851-5185-4ea3-8260-e518a9add9cc tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf92af08fa94215b4eafcacea6c63f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e7d37a0e3b4b32ae99c3bc15a831e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:16:59.812564 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell0:SELECT=16 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:16:59.825032 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-69e91851-5185-4ea3-8260-e518a9add9cc tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "GET /compute/v2.1/servers/a27111b2-863b-460b-9b89-ba08092d3561" status: 200 len: 1317 microversion: 2.1 time: 0.392573 Jul 23 21:16:59.827963 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 505/973] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:16:59 2022] GET /compute/v2.1/servers/a27111b2-863b-460b-9b89-ba08092d3561 => generated 1317 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:16:59.893458 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-33e54c8a-f81c-4b4f-ae72-a8b07171dbbf tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:16:59.894256 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-33e54c8a-f81c-4b4f-ae72-a8b07171dbbf tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 8025dc38-59d4-4296-b2c7-5aebb08eacae] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:16:59.906301 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-33e54c8a-f81c-4b4f-ae72-a8b07171dbbf tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:59.906846 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-33e54c8a-f81c-4b4f-ae72-a8b07171dbbf tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:16:59.911199 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-33e54c8a-f81c-4b4f-ae72-a8b07171dbbf tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:16:59.911834 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-33e54c8a-f81c-4b4f-ae72-a8b07171dbbf tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:00.135876 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ff00ed68-3e34-4e66-aa1c-9d9a88f01047 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:00.149682 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ff00ed68-3e34-4e66-aa1c-9d9a88f01047 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933" status: 200 len: 1378 microversion: 2.1 time: 0.504893 Jul 23 21:17:00.150337 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 469/974] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:16:59 2022] GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933 => generated 1378 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:00.155236 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-16a6f9c8-3e1f-4dd1-aa3c-c5bd3b6859f5 req-b4863851-54aa-4a58-8b5d-1c5b38b80f84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6de755e-739d-437c-aafb-6bc49f8bb086", "tag": "07b0b8e7-f27b-4cdb-893e-93a9a7e67017"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:17:00.181095 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-16a6f9c8-3e1f-4dd1-aa3c-c5bd3b6859f5 req-b4863851-54aa-4a58-8b5d-1c5b38b80f84 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:00.181670 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-16a6f9c8-3e1f-4dd1-aa3c-c5bd3b6859f5 req-b4863851-54aa-4a58-8b5d-1c5b38b80f84 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:00.208014 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-16a6f9c8-3e1f-4dd1-aa3c-c5bd3b6859f5 req-b4863851-54aa-4a58-8b5d-1c5b38b80f84 service nova] Creating event network-changed:07b0b8e7-f27b-4cdb-893e-93a9a7e67017 for instance a6de755e-739d-437c-aafb-6bc49f8bb086 on nch1-master-1 Jul 23 21:17:00.223187 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-16a6f9c8-3e1f-4dd1-aa3c-c5bd3b6859f5 req-b4863851-54aa-4a58-8b5d-1c5b38b80f84 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071598 Jul 23 21:17:00.224109 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 470/975] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:17:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:17:00.331225 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-33e54c8a-f81c-4b4f-ae72-a8b07171dbbf tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4f9dda4c2a411cb0394bf86e9ae223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580ed681cbf44d10936259b17f60f1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:00.342240 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-33e54c8a-f81c-4b4f-ae72-a8b07171dbbf tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/servers/8025dc38-59d4-4296-b2c7-5aebb08eacae" status: 200 len: 1308 microversion: 2.1 time: 0.453274 Jul 23 21:17:00.347077 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 506/976] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:16:59 2022] GET /compute/v2.1/servers/8025dc38-59d4-4296-b2c7-5aebb08eacae => generated 1308 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:00.846589 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d3533ee0-f05d-45a3-995e-c18928d4b4e8 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:00.847925 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d3533ee0-f05d-45a3-995e-c18928d4b4e8 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: a27111b2-863b-460b-9b89-ba08092d3561] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:00.855583 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d3533ee0-f05d-45a3-995e-c18928d4b4e8 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:00.856226 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d3533ee0-f05d-45a3-995e-c18928d4b4e8 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:00.857179 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d3533ee0-f05d-45a3-995e-c18928d4b4e8 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:00.857620 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d3533ee0-f05d-45a3-995e-c18928d4b4e8 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:01.167636 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f4ef9371-fb14-4afd-9bdf-4f2da1715056 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:01.169247 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-f4ef9371-fb14-4afd-9bdf-4f2da1715056 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 760fa31f-a0cf-46df-b456-3af5dc7f9933] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:01.177002 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f4ef9371-fb14-4afd-9bdf-4f2da1715056 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:01.177764 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f4ef9371-fb14-4afd-9bdf-4f2da1715056 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:01.178914 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f4ef9371-fb14-4afd-9bdf-4f2da1715056 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:01.179632 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f4ef9371-fb14-4afd-9bdf-4f2da1715056 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:01.212664 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d3533ee0-f05d-45a3-995e-c18928d4b4e8 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf92af08fa94215b4eafcacea6c63f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e7d37a0e3b4b32ae99c3bc15a831e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:01.234421 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d3533ee0-f05d-45a3-995e-c18928d4b4e8 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "GET /compute/v2.1/servers/a27111b2-863b-460b-9b89-ba08092d3561" status: 200 len: 1317 microversion: 2.1 time: 0.393009 Jul 23 21:17:01.235274 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 471/977] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:00 2022] GET /compute/v2.1/servers/a27111b2-863b-460b-9b89-ba08092d3561 => generated 1317 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:01.366815 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-f4ef9371-fb14-4afd-9bdf-4f2da1715056 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:01.369256 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f9ce889d-bd58-47b7-8a7a-af7ace468bae tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:01.371329 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f9ce889d-bd58-47b7-8a7a-af7ace468bae tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 8025dc38-59d4-4296-b2c7-5aebb08eacae] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:01.384247 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-f4ef9371-fb14-4afd-9bdf-4f2da1715056 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933" status: 200 len: 1528 microversion: 2.1 time: 0.220676 Jul 23 21:17:01.385105 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 507/978] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:01 2022] GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933 => generated 1528 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:01.393772 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f9ce889d-bd58-47b7-8a7a-af7ace468bae tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:01.394390 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f9ce889d-bd58-47b7-8a7a-af7ace468bae tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:01.395813 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f9ce889d-bd58-47b7-8a7a-af7ace468bae tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:01.402169 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f9ce889d-bd58-47b7-8a7a-af7ace468bae tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:01.402598 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-cf758747-4acd-4392-b233-af1038b4ff5a tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:01.403214 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-cf758747-4acd-4392-b233-af1038b4ff5a tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 760fa31f-a0cf-46df-b456-3af5dc7f9933] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:01.412767 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cf758747-4acd-4392-b233-af1038b4ff5a tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:01.414612 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cf758747-4acd-4392-b233-af1038b4ff5a tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:01.415433 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cf758747-4acd-4392-b233-af1038b4ff5a tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:01.415879 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cf758747-4acd-4392-b233-af1038b4ff5a tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:01.638064 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f9ce889d-bd58-47b7-8a7a-af7ace468bae tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4f9dda4c2a411cb0394bf86e9ae223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580ed681cbf44d10936259b17f60f1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:01.655555 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f9ce889d-bd58-47b7-8a7a-af7ace468bae tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/servers/8025dc38-59d4-4296-b2c7-5aebb08eacae" status: 200 len: 1308 microversion: 2.1 time: 0.297482 Jul 23 21:17:01.665184 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 472/979] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:01 2022] GET /compute/v2.1/servers/8025dc38-59d4-4296-b2c7-5aebb08eacae => generated 1308 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:01.885075 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-cf758747-4acd-4392-b233-af1038b4ff5a tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:01.916830 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-cf758747-4acd-4392-b233-af1038b4ff5a tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933" status: 200 len: 1528 microversion: 2.1 time: 0.518072 Jul 23 21:17:01.918797 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 508/980] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:01 2022] GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933 => generated 1528 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:01.936915 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-962eda18-7a68-4dda-afc1-f7e845994ab4 tempest-MigrationsAdminTest-19880863 tempest-MigrationsAdminTest-19880863-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:01.938248 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:17:01.938248 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:17:01.967995 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-962eda18-7a68-4dda-afc1-f7e845994ab4 tempest-MigrationsAdminTest-19880863 tempest-MigrationsAdminTest-19880863-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/eb0634b6-cfd7-4679-8048-873d526132b7" status: 202 len: 0 microversion: 2.1 time: 0.035363 Jul 23 21:17:01.968585 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 473/981] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:17:01 2022] DELETE /compute/v2.1/flavors/eb0634b6-cfd7-4679-8048-873d526132b7 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:17:01.978987 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-950785fa-aa13-4fca-a32a-c5a61042183f tempest-MigrationsAdminTest-19880863 tempest-MigrationsAdminTest-19880863-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:02.003188 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-950785fa-aa13-4fca-a32a-c5a61042183f tempest-MigrationsAdminTest-19880863 tempest-MigrationsAdminTest-19880863-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.028884 Jul 23 21:17:02.014595 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 509/982] 10.222.0.17 () {58 vars in 1145 bytes} [Sat Jul 23 21:17:01 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:02.019918 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6dd8a69e-870e-4520-b802-0b220ddf38b7 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:17:02.021023 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6dd8a69e-870e-4520-b802-0b220ddf38b7 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 760fa31f-a0cf-46df-b456-3af5dc7f9933] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:02.029738 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6dd8a69e-870e-4520-b802-0b220ddf38b7 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:02.030222 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6dd8a69e-870e-4520-b802-0b220ddf38b7 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:02.031020 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6dd8a69e-870e-4520-b802-0b220ddf38b7 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:02.031467 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6dd8a69e-870e-4520-b802-0b220ddf38b7 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:02.146869 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6dd8a69e-870e-4520-b802-0b220ddf38b7 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:02.150749 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=93,nova_api:DELETE=3 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:17:02.154956 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6dd8a69e-870e-4520-b802-0b220ddf38b7 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 760fa31f-a0cf-46df-b456-3af5dc7f9933] Old instance type tempest-test_resize_flavor_-2046216278, new instance type m1.heat {{(pid=131320) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 23 21:17:02.163999 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-6dd8a69e-870e-4520-b802-0b220ddf38b7 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:17:02.164482 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-6dd8a69e-870e-4520-b802-0b220ddf38b7 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:17:02.165137 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-6dd8a69e-870e-4520-b802-0b220ddf38b7 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:17:02.165706 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-6dd8a69e-870e-4520-b802-0b220ddf38b7 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:17:02.166328 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-6dd8a69e-870e-4520-b802-0b220ddf38b7 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:17:02.254767 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-8205e9de-4164-4129-8908-548a04623136 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:02.255377 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-8205e9de-4164-4129-8908-548a04623136 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: a27111b2-863b-460b-9b89-ba08092d3561] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:02.262007 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8205e9de-4164-4129-8908-548a04623136 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:02.268045 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8205e9de-4164-4129-8908-548a04623136 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:02.270806 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8205e9de-4164-4129-8908-548a04623136 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:02.271418 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8205e9de-4164-4129-8908-548a04623136 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:02.322483 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6dd8a69e-870e-4520-b802-0b220ddf38b7 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "POST /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933/action" status: 202 len: 0 microversion: 2.1 time: 0.306655 Jul 23 21:17:02.323407 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 474/983] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:17:02 2022] POST /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933/action => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 23 21:17:02.331775 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-673bc5bc-1b24-4112-89c6-efd9bb8e7976 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:02.332395 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-673bc5bc-1b24-4112-89c6-efd9bb8e7976 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 760fa31f-a0cf-46df-b456-3af5dc7f9933] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:02.339040 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-673bc5bc-1b24-4112-89c6-efd9bb8e7976 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:02.339486 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-673bc5bc-1b24-4112-89c6-efd9bb8e7976 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:02.340369 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-673bc5bc-1b24-4112-89c6-efd9bb8e7976 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:02.340810 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-673bc5bc-1b24-4112-89c6-efd9bb8e7976 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:02.562677 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-673bc5bc-1b24-4112-89c6-efd9bb8e7976 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:02.574326 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-673bc5bc-1b24-4112-89c6-efd9bb8e7976 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933" status: 200 len: 1537 microversion: 2.1 time: 0.246064 Jul 23 21:17:02.584734 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 475/984] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:02 2022] GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933 => generated 1537 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:02.676864 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3e7b9423-1ed9-4c38-b605-51396beb8d74 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:02.677905 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-3e7b9423-1ed9-4c38-b605-51396beb8d74 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 8025dc38-59d4-4296-b2c7-5aebb08eacae] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:02.690495 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3e7b9423-1ed9-4c38-b605-51396beb8d74 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:02.691216 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3e7b9423-1ed9-4c38-b605-51396beb8d74 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:02.692212 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3e7b9423-1ed9-4c38-b605-51396beb8d74 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:02.692814 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3e7b9423-1ed9-4c38-b605-51396beb8d74 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:02.890375 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-3e7b9423-1ed9-4c38-b605-51396beb8d74 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4f9dda4c2a411cb0394bf86e9ae223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580ed681cbf44d10936259b17f60f1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:02.897311 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:17:02.901271 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-3e7b9423-1ed9-4c38-b605-51396beb8d74 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/servers/8025dc38-59d4-4296-b2c7-5aebb08eacae" status: 200 len: 1308 microversion: 2.1 time: 0.232300 Jul 23 21:17:02.902392 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 476/985] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:02 2022] GET /compute/v2.1/servers/8025dc38-59d4-4296-b2c7-5aebb08eacae => generated 1308 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:17:03.211580 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-8205e9de-4164-4129-8908-548a04623136 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf92af08fa94215b4eafcacea6c63f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e7d37a0e3b4b32ae99c3bc15a831e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:03.250230 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-8205e9de-4164-4129-8908-548a04623136 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "GET /compute/v2.1/servers/a27111b2-863b-460b-9b89-ba08092d3561" status: 200 len: 1317 microversion: 2.1 time: 0.987885 Jul 23 21:17:03.251709 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 510/986] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:02 2022] GET /compute/v2.1/servers/a27111b2-863b-460b-9b89-ba08092d3561 => generated 1317 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:17:03.593028 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-93b4c48c-a005-4c57-bfdf-d1d95817f11e tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:03.594533 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-93b4c48c-a005-4c57-bfdf-d1d95817f11e tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 760fa31f-a0cf-46df-b456-3af5dc7f9933] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:03.606247 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-93b4c48c-a005-4c57-bfdf-d1d95817f11e tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:03.606874 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-93b4c48c-a005-4c57-bfdf-d1d95817f11e tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:03.607933 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-93b4c48c-a005-4c57-bfdf-d1d95817f11e tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:03.608598 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-93b4c48c-a005-4c57-bfdf-d1d95817f11e tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:03.654285 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-5bbbf979-d719-473b-b146-6f572c5f6bfd req-d09deecd-16dc-45a1-a283-ca16863b57a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a27111b2-863b-460b-9b89-ba08092d3561", "name": "network-vif-plugged", "status": "completed", "tag": "899df295-0f0b-4e78-9c0a-c4447102f642"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:17:03.671727 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-5bbbf979-d719-473b-b146-6f572c5f6bfd req-d09deecd-16dc-45a1-a283-ca16863b57a5 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:03.672173 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-5bbbf979-d719-473b-b146-6f572c5f6bfd req-d09deecd-16dc-45a1-a283-ca16863b57a5 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:03.717546 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-5bbbf979-d719-473b-b146-6f572c5f6bfd req-d09deecd-16dc-45a1-a283-ca16863b57a5 service nova] Creating event network-vif-plugged:899df295-0f0b-4e78-9c0a-c4447102f642 for instance a27111b2-863b-460b-9b89-ba08092d3561 on nch2-master-1 Jul 23 21:17:03.735083 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-5bbbf979-d719-473b-b146-6f572c5f6bfd req-d09deecd-16dc-45a1-a283-ca16863b57a5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084230 Jul 23 21:17:03.740990 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 511/987] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:17:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:17:03.795724 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-93b4c48c-a005-4c57-bfdf-d1d95817f11e tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:03.808369 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-93b4c48c-a005-4c57-bfdf-d1d95817f11e tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933" status: 200 len: 1537 microversion: 2.1 time: 0.219941 Jul 23 21:17:03.809259 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 477/988] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:03 2022] GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933 => generated 1537 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:17:03.920977 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-4853fdd1-15a6-40b8-ad56-343b19a307ac tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:03.921690 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-4853fdd1-15a6-40b8-ad56-343b19a307ac tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 8025dc38-59d4-4296-b2c7-5aebb08eacae] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:03.933064 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4853fdd1-15a6-40b8-ad56-343b19a307ac tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:03.933778 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4853fdd1-15a6-40b8-ad56-343b19a307ac tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:03.934937 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4853fdd1-15a6-40b8-ad56-343b19a307ac tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:03.935535 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4853fdd1-15a6-40b8-ad56-343b19a307ac tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:04.272325 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f6e88af6-0db8-4a0b-bb12-d712dee46fb8 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:04.273083 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f6e88af6-0db8-4a0b-bb12-d712dee46fb8 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: a27111b2-863b-460b-9b89-ba08092d3561] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:04.285315 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f6e88af6-0db8-4a0b-bb12-d712dee46fb8 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:04.285772 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f6e88af6-0db8-4a0b-bb12-d712dee46fb8 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:04.286619 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f6e88af6-0db8-4a0b-bb12-d712dee46fb8 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:04.287058 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f6e88af6-0db8-4a0b-bb12-d712dee46fb8 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:04.606231 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f6e88af6-0db8-4a0b-bb12-d712dee46fb8 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf92af08fa94215b4eafcacea6c63f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e7d37a0e3b4b32ae99c3bc15a831e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:04.631914 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f6e88af6-0db8-4a0b-bb12-d712dee46fb8 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "GET /compute/v2.1/servers/a27111b2-863b-460b-9b89-ba08092d3561" status: 200 len: 1317 microversion: 2.1 time: 0.365916 Jul 23 21:17:04.643993 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 478/989] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:04 2022] GET /compute/v2.1/servers/a27111b2-863b-460b-9b89-ba08092d3561 => generated 1317 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:04.723225 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-4853fdd1-15a6-40b8-ad56-343b19a307ac tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4f9dda4c2a411cb0394bf86e9ae223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580ed681cbf44d10936259b17f60f1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:04.757602 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-4853fdd1-15a6-40b8-ad56-343b19a307ac tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/servers/8025dc38-59d4-4296-b2c7-5aebb08eacae" status: 200 len: 1308 microversion: 2.1 time: 0.842161 Jul 23 21:17:04.771606 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 512/990] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:03 2022] GET /compute/v2.1/servers/8025dc38-59d4-4296-b2c7-5aebb08eacae => generated 1308 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:04.839631 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ce848c62-cb1c-4fd0-bd35-9ea53dc64b31 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:04.840763 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ce848c62-cb1c-4fd0-bd35-9ea53dc64b31 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 760fa31f-a0cf-46df-b456-3af5dc7f9933] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:04.854625 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ce848c62-cb1c-4fd0-bd35-9ea53dc64b31 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:04.858471 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ce848c62-cb1c-4fd0-bd35-9ea53dc64b31 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:04.859543 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ce848c62-cb1c-4fd0-bd35-9ea53dc64b31 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:04.859986 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ce848c62-cb1c-4fd0-bd35-9ea53dc64b31 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:05.102428 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ce848c62-cb1c-4fd0-bd35-9ea53dc64b31 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:05.123848 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ce848c62-cb1c-4fd0-bd35-9ea53dc64b31 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933" status: 200 len: 1537 microversion: 2.1 time: 0.301887 Jul 23 21:17:05.128341 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 479/991] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:04 2022] GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933 => generated 1537 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:05.653822 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-1ba53e5f-c8ab-435d-99ef-f3a0f8469891 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:05.654943 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-1ba53e5f-c8ab-435d-99ef-f3a0f8469891 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: a27111b2-863b-460b-9b89-ba08092d3561] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:05.670738 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1ba53e5f-c8ab-435d-99ef-f3a0f8469891 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:05.671199 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1ba53e5f-c8ab-435d-99ef-f3a0f8469891 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:05.672003 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1ba53e5f-c8ab-435d-99ef-f3a0f8469891 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:05.672440 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1ba53e5f-c8ab-435d-99ef-f3a0f8469891 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:05.755478 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-1d5cef28-da39-4f13-9ab8-f380aefd5c48 req-ed3ffa06-cd71-4227-b5c8-6e01a632e760 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8025dc38-59d4-4296-b2c7-5aebb08eacae", "name": "network-vif-plugged", "status": "completed", "tag": "e9c441a4-cbfb-45c6-a442-223a4f1afaf0"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:17:05.767493 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-1d5cef28-da39-4f13-9ab8-f380aefd5c48 req-ed3ffa06-cd71-4227-b5c8-6e01a632e760 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:05.767935 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-1d5cef28-da39-4f13-9ab8-f380aefd5c48 req-ed3ffa06-cd71-4227-b5c8-6e01a632e760 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:05.781851 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-1d5cef28-da39-4f13-9ab8-f380aefd5c48 req-ed3ffa06-cd71-4227-b5c8-6e01a632e760 service nova] Creating event network-vif-plugged:e9c441a4-cbfb-45c6-a442-223a4f1afaf0 for instance 8025dc38-59d4-4296-b2c7-5aebb08eacae on nch1-master-1 Jul 23 21:17:05.788215 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-1d5cef28-da39-4f13-9ab8-f380aefd5c48 req-ed3ffa06-cd71-4227-b5c8-6e01a632e760 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039106 Jul 23 21:17:05.789049 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 480/992] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:17:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:17:05.795782 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8c204b72-0b11-47fb-ab99-086f8af4753e tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:05.797407 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8c204b72-0b11-47fb-ab99-086f8af4753e tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 8025dc38-59d4-4296-b2c7-5aebb08eacae] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:05.804572 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8c204b72-0b11-47fb-ab99-086f8af4753e tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:05.805356 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8c204b72-0b11-47fb-ab99-086f8af4753e tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:05.806584 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8c204b72-0b11-47fb-ab99-086f8af4753e tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:05.808067 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8c204b72-0b11-47fb-ab99-086f8af4753e tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:06.033808 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8c204b72-0b11-47fb-ab99-086f8af4753e tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4f9dda4c2a411cb0394bf86e9ae223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580ed681cbf44d10936259b17f60f1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:06.045024 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8c204b72-0b11-47fb-ab99-086f8af4753e tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/servers/8025dc38-59d4-4296-b2c7-5aebb08eacae" status: 200 len: 1308 microversion: 2.1 time: 0.254389 Jul 23 21:17:06.047579 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 481/993] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:05 2022] GET /compute/v2.1/servers/8025dc38-59d4-4296-b2c7-5aebb08eacae => generated 1308 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:06.143707 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-aa375300-6941-4ade-b07e-fb25dedfaeae tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:06.144770 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-aa375300-6941-4ade-b07e-fb25dedfaeae tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 760fa31f-a0cf-46df-b456-3af5dc7f9933] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:06.161712 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-aa375300-6941-4ade-b07e-fb25dedfaeae tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:06.162500 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-aa375300-6941-4ade-b07e-fb25dedfaeae tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:06.166240 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-aa375300-6941-4ade-b07e-fb25dedfaeae tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:06.166743 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-aa375300-6941-4ade-b07e-fb25dedfaeae tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:06.249734 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-1ba53e5f-c8ab-435d-99ef-f3a0f8469891 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf92af08fa94215b4eafcacea6c63f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e7d37a0e3b4b32ae99c3bc15a831e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:06.261051 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-1ba53e5f-c8ab-435d-99ef-f3a0f8469891 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "GET /compute/v2.1/servers/a27111b2-863b-460b-9b89-ba08092d3561" status: 200 len: 1317 microversion: 2.1 time: 0.614945 Jul 23 21:17:06.261657 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 513/994] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:05 2022] GET /compute/v2.1/servers/a27111b2-863b-460b-9b89-ba08092d3561 => generated 1317 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:06.401695 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-aa375300-6941-4ade-b07e-fb25dedfaeae tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:06.411822 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-aa375300-6941-4ade-b07e-fb25dedfaeae tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933" status: 200 len: 1537 microversion: 2.1 time: 0.272096 Jul 23 21:17:06.412947 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 482/995] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:06 2022] GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933 => generated 1537 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:17:07.068069 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-8ffe46e3-b117-4a52-82f7-f4eebd6fb10f tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:07.068739 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-8ffe46e3-b117-4a52-82f7-f4eebd6fb10f tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 8025dc38-59d4-4296-b2c7-5aebb08eacae] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:07.078351 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8ffe46e3-b117-4a52-82f7-f4eebd6fb10f tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:07.078811 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8ffe46e3-b117-4a52-82f7-f4eebd6fb10f tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:07.082840 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8ffe46e3-b117-4a52-82f7-f4eebd6fb10f tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:07.083298 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8ffe46e3-b117-4a52-82f7-f4eebd6fb10f tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:07.093932 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=100 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:17:07.137154 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-107fc17d-6913-4212-a2cd-b78b194b75b3 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:07.143027 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-107fc17d-6913-4212-a2cd-b78b194b75b3 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] [instance: 34eaf1d2-9732-4c0e-b970-02fbb449514b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:07.168051 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-107fc17d-6913-4212-a2cd-b78b194b75b3 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:07.168777 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-107fc17d-6913-4212-a2cd-b78b194b75b3 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:07.170167 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-107fc17d-6913-4212-a2cd-b78b194b75b3 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:07.170811 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-107fc17d-6913-4212-a2cd-b78b194b75b3 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:07.393821 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-8ffe46e3-b117-4a52-82f7-f4eebd6fb10f tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4f9dda4c2a411cb0394bf86e9ae223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580ed681cbf44d10936259b17f60f1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:07.402103 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-8ffe46e3-b117-4a52-82f7-f4eebd6fb10f tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/servers/8025dc38-59d4-4296-b2c7-5aebb08eacae" status: 200 len: 1308 microversion: 2.1 time: 0.338743 Jul 23 21:17:07.402697 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 514/996] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:07 2022] GET /compute/v2.1/servers/8025dc38-59d4-4296-b2c7-5aebb08eacae => generated 1308 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:07.410499 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c589f7fe-a36e-41f7-95d7-cc80fc40d4c5 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:07.411110 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-c589f7fe-a36e-41f7-95d7-cc80fc40d4c5 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: a27111b2-863b-460b-9b89-ba08092d3561] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:07.433295 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c589f7fe-a36e-41f7-95d7-cc80fc40d4c5 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:07.439564 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c589f7fe-a36e-41f7-95d7-cc80fc40d4c5 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:07.442135 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c589f7fe-a36e-41f7-95d7-cc80fc40d4c5 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:07.445607 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c589f7fe-a36e-41f7-95d7-cc80fc40d4c5 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:07.499926 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-107fc17d-6913-4212-a2cd-b78b194b75b3 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/34eaf1d2-9732-4c0e-b970-02fbb449514b" status: 200 len: 1813 microversion: 2.1 time: 0.370515 Jul 23 21:17:07.520677 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 483/997] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:07 2022] GET /compute/v2.1/servers/34eaf1d2-9732-4c0e-b970-02fbb449514b => generated 1813 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:07.531123 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-18362b1f-17e8-4956-a6f4-e180158fd5c6 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:07.541262 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-18362b1f-17e8-4956-a6f4-e180158fd5c6 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 760fa31f-a0cf-46df-b456-3af5dc7f9933] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:07.547918 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-18362b1f-17e8-4956-a6f4-e180158fd5c6 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:07.548488 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-18362b1f-17e8-4956-a6f4-e180158fd5c6 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:07.550019 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-18362b1f-17e8-4956-a6f4-e180158fd5c6 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:07.550019 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-18362b1f-17e8-4956-a6f4-e180158fd5c6 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:07.871071 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-18362b1f-17e8-4956-a6f4-e180158fd5c6 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:07.889736 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-18362b1f-17e8-4956-a6f4-e180158fd5c6 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933" status: 200 len: 1542 microversion: 2.1 time: 0.367449 Jul 23 21:17:07.892488 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 484/998] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:07 2022] GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933 => generated 1542 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:07.908399 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-85cb92c1-5eee-4779-b5bd-7994f45dfae3 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:07.911052 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:17:07.911052 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:17:07.914108 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-85cb92c1-5eee-4779-b5bd-7994f45dfae3 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:07.914900 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-85cb92c1-5eee-4779-b5bd-7994f45dfae3 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:07.915831 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-85cb92c1-5eee-4779-b5bd-7994f45dfae3 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:07.916367 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-85cb92c1-5eee-4779-b5bd-7994f45dfae3 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:07.957323 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-85cb92c1-5eee-4779-b5bd-7994f45dfae3 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.063172 Jul 23 21:17:07.958523 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 485/999] 10.222.0.17 () {58 vars in 1175 bytes} [Sat Jul 23 21:17:07 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:17:08.009395 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c589f7fe-a36e-41f7-95d7-cc80fc40d4c5 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf92af08fa94215b4eafcacea6c63f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e7d37a0e3b4b32ae99c3bc15a831e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:08.018262 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-c589f7fe-a36e-41f7-95d7-cc80fc40d4c5 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "GET /compute/v2.1/servers/a27111b2-863b-460b-9b89-ba08092d3561" status: 200 len: 1467 microversion: 2.1 time: 0.614455 Jul 23 21:17:08.021834 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 515/1000] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:07 2022] GET /compute/v2.1/servers/a27111b2-863b-460b-9b89-ba08092d3561 => generated 1467 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:08.039995 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a91eace4-e7aa-4c3b-a301-77b90885d469 tempest-ServersOnMultiNodesTest-1671986198 tempest-ServersOnMultiNodesTest-1671986198-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:08.042550 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a91eace4-e7aa-4c3b-a301-77b90885d469 tempest-ServersOnMultiNodesTest-1671986198 tempest-ServersOnMultiNodesTest-1671986198-project-admin] [instance: a27111b2-863b-460b-9b89-ba08092d3561] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:08.059564 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a91eace4-e7aa-4c3b-a301-77b90885d469 tempest-ServersOnMultiNodesTest-1671986198 tempest-ServersOnMultiNodesTest-1671986198-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:08.060040 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a91eace4-e7aa-4c3b-a301-77b90885d469 tempest-ServersOnMultiNodesTest-1671986198 tempest-ServersOnMultiNodesTest-1671986198-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:08.060867 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a91eace4-e7aa-4c3b-a301-77b90885d469 tempest-ServersOnMultiNodesTest-1671986198 tempest-ServersOnMultiNodesTest-1671986198-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:08.067631 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a91eace4-e7aa-4c3b-a301-77b90885d469 tempest-ServersOnMultiNodesTest-1671986198 tempest-ServersOnMultiNodesTest-1671986198-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:08.420777 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-bf0b6120-d19f-4c57-ab50-8f137607003e tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:08.421854 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-bf0b6120-d19f-4c57-ab50-8f137607003e tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 8025dc38-59d4-4296-b2c7-5aebb08eacae] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:08.443687 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bf0b6120-d19f-4c57-ab50-8f137607003e tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:08.444274 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bf0b6120-d19f-4c57-ab50-8f137607003e tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:08.445157 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bf0b6120-d19f-4c57-ab50-8f137607003e tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:08.446819 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bf0b6120-d19f-4c57-ab50-8f137607003e tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:09.426085 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-bf0b6120-d19f-4c57-ab50-8f137607003e tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4f9dda4c2a411cb0394bf86e9ae223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580ed681cbf44d10936259b17f60f1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:09.438557 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-bf0b6120-d19f-4c57-ab50-8f137607003e tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/servers/8025dc38-59d4-4296-b2c7-5aebb08eacae" status: 200 len: 1489 microversion: 2.1 time: 1.022371 Jul 23 21:17:09.442843 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 516/1001] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:08 2022] GET /compute/v2.1/servers/8025dc38-59d4-4296-b2c7-5aebb08eacae => generated 1489 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:17:09.454169 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d5312de1-bd70-4de4-bd4a-db9766ad87cf tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:09.456133 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-d5312de1-bd70-4de4-bd4a-db9766ad87cf tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 760fa31f-a0cf-46df-b456-3af5dc7f9933] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:09.473022 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d5312de1-bd70-4de4-bd4a-db9766ad87cf tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:09.479561 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d5312de1-bd70-4de4-bd4a-db9766ad87cf tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:09.483220 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d5312de1-bd70-4de4-bd4a-db9766ad87cf tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:09.490653 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d5312de1-bd70-4de4-bd4a-db9766ad87cf tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:09.848313 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a91eace4-e7aa-4c3b-a301-77b90885d469 tempest-ServersOnMultiNodesTest-1671986198 tempest-ServersOnMultiNodesTest-1671986198-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/a27111b2-863b-460b-9b89-ba08092d3561" status: 200 len: 1618 microversion: 2.1 time: 1.808006 Jul 23 21:17:09.849679 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 486/1002] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:08 2022] GET /compute/v2.1/servers/a27111b2-863b-460b-9b89-ba08092d3561 => generated 1618 bytes in 1816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:09.857036 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-53c2d53e-3604-4519-a67f-f541a3abb7d0 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:17:09.875043 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-53c2d53e-3604-4519-a67f-f541a3abb7d0 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:09.878172 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-53c2d53e-3604-4519-a67f-f541a3abb7d0 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:10.039150 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-53c2d53e-3604-4519-a67f-f541a3abb7d0 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 8025dc38-59d4-4296-b2c7-5aebb08eacae] Going to try to stop instance {{(pid=131320) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 23 21:17:10.206911 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-53c2d53e-3604-4519-a67f-f541a3abb7d0 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "POST /compute/v2.1/servers/8025dc38-59d4-4296-b2c7-5aebb08eacae/action" status: 202 len: 0 microversion: 2.1 time: 0.354651 Jul 23 21:17:10.208980 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 487/1003] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:17:09 2022] POST /compute/v2.1/servers/8025dc38-59d4-4296-b2c7-5aebb08eacae/action => generated 0 bytes in 358 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:17:10.228965 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8cfe8007-f873-40df-ae75-0f4b4ca373d2 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:10.231255 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8cfe8007-f873-40df-ae75-0f4b4ca373d2 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 8025dc38-59d4-4296-b2c7-5aebb08eacae] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:10.255194 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8cfe8007-f873-40df-ae75-0f4b4ca373d2 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:10.256808 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8cfe8007-f873-40df-ae75-0f4b4ca373d2 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:10.268624 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8cfe8007-f873-40df-ae75-0f4b4ca373d2 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:10.269078 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8cfe8007-f873-40df-ae75-0f4b4ca373d2 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:10.558784 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-d5312de1-bd70-4de4-bd4a-db9766ad87cf tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:10.580738 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-d5312de1-bd70-4de4-bd4a-db9766ad87cf tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933" status: 200 len: 1542 microversion: 2.1 time: 1.134460 Jul 23 21:17:10.584904 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 517/1004] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:09 2022] GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933 => generated 1542 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:10.601238 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-246e564b-e40d-4bae-ae8b-27bfd3a9b72e tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1335285976", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "9e985a36-586a-4546-a0c0-1a3e3da330c9"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:17:10.760794 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.network.neutron [None req-246e564b-e40d-4bae-ae8b-27bfd3a9b72e tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] validate_networks() for None {{(pid=131321) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:17:10.797778 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8cfe8007-f873-40df-ae75-0f4b4ca373d2 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4f9dda4c2a411cb0394bf86e9ae223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580ed681cbf44d10936259b17f60f1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:10.808402 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8cfe8007-f873-40df-ae75-0f4b4ca373d2 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/servers/8025dc38-59d4-4296-b2c7-5aebb08eacae" status: 200 len: 1499 microversion: 2.1 time: 0.595541 Jul 23 21:17:10.819764 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 488/1005] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:10 2022] GET /compute/v2.1/servers/8025dc38-59d4-4296-b2c7-5aebb08eacae => generated 1499 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:11.572526 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-354c03ef-7804-44b6-a0cd-ef1113d54e47 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a69bbe9e-0481-45eb-807a-0a14799fc07b", "device": "/dev/xvdb"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:17:11.575232 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-354c03ef-7804-44b6-a0cd-ef1113d54e47 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 34eaf1d2-9732-4c0e-b970-02fbb449514b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:11.589851 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-354c03ef-7804-44b6-a0cd-ef1113d54e47 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:11.595540 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-354c03ef-7804-44b6-a0cd-ef1113d54e47 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:11.596953 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-354c03ef-7804-44b6-a0cd-ef1113d54e47 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:11.598091 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-354c03ef-7804-44b6-a0cd-ef1113d54e47 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:11.881643 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-246e564b-e40d-4bae-ae8b-27bfd3a9b72e tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Flavor limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:17:11.882306 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-246e564b-e40d-4bae-ae8b-27bfd3a9b72e tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Image limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:17:11.902824 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-246e564b-e40d-4bae-ae8b-27bfd3a9b72e tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Flavor pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:17:11.906042 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-246e564b-e40d-4bae-ae8b-27bfd3a9b72e tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Image pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:17:11.906194 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-246e564b-e40d-4bae-ae8b-27bfd3a9b72e tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:17:11.950281 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-246e564b-e40d-4bae-ae8b-27bfd3a9b72e tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:11.951221 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-246e564b-e40d-4bae-ae8b-27bfd3a9b72e tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:11.952902 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-246e564b-e40d-4bae-ae8b-27bfd3a9b72e tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:11.953534 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-246e564b-e40d-4bae-ae8b-27bfd3a9b72e tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:11.995714 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-246e564b-e40d-4bae-ae8b-27bfd3a9b72e tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Getting quotas for project f5e7d37a0e3b4b32ae99c3bc15a831e6. Resources: {'ram', 'instances', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:17:12.011211 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-246e564b-e40d-4bae-ae8b-27bfd3a9b72e tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Getting quotas for user ebf92af08fa94215b4eafcacea6c63f6 and project f5e7d37a0e3b4b32ae99c3bc15a831e6. Resources: {'ram', 'instances', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:17:12.046970 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-246e564b-e40d-4bae-ae8b-27bfd3a9b72e tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Going to run 1 instances... {{(pid=131321) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:17:12.049377 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-246e564b-e40d-4bae-ae8b-27bfd3a9b72e tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: e346d31f-1498-49ff-8a58-0c607e41923e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131321) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:17:12.200907 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-246e564b-e40d-4bae-ae8b-27bfd3a9b72e tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.611784 Jul 23 21:17:12.202368 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 518/1006] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:17:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1617 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 23 21:17:12.212927 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-90065caa-779d-4887-a861-c953d87b13ed tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:12.217573 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-90065caa-779d-4887-a861-c953d87b13ed tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 760fa31f-a0cf-46df-b456-3af5dc7f9933] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:12.229175 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-90065caa-779d-4887-a861-c953d87b13ed tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:12.234696 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-90065caa-779d-4887-a861-c953d87b13ed tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:12.243716 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-90065caa-779d-4887-a861-c953d87b13ed tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:12.247836 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-90065caa-779d-4887-a861-c953d87b13ed tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:12.524220 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-354c03ef-7804-44b6-a0cd-ef1113d54e47 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "POST /compute/v2.1/servers/34eaf1d2-9732-4c0e-b970-02fbb449514b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.956037 Jul 23 21:17:12.555119 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 489/1007] 10.222.0.17 () {60 vars in 1322 bytes} [Sat Jul 23 21:17:11 2022] POST /compute/v2.1/servers/34eaf1d2-9732-4c0e-b970-02fbb449514b/os-volume_attachments => generated 194 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:17:12.589490 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-23de640f-718b-4972-88f5-e5f671992684 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:12.595085 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-23de640f-718b-4972-88f5-e5f671992684 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 8025dc38-59d4-4296-b2c7-5aebb08eacae] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:12.651017 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-90065caa-779d-4887-a861-c953d87b13ed tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:12.673390 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-23de640f-718b-4972-88f5-e5f671992684 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:12.673928 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-23de640f-718b-4972-88f5-e5f671992684 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:12.674990 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-23de640f-718b-4972-88f5-e5f671992684 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:12.675403 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-90065caa-779d-4887-a861-c953d87b13ed tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933" status: 200 len: 1542 microversion: 2.1 time: 0.470010 Jul 23 21:17:12.680467 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-23de640f-718b-4972-88f5-e5f671992684 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:12.686208 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 519/1008] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:12 2022] GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933 => generated 1542 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:12.698926 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c069f961-1ca9-4c78-9643-0435d63e798f tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:12.703458 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-c069f961-1ca9-4c78-9643-0435d63e798f tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: e346d31f-1498-49ff-8a58-0c607e41923e] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:12.877397 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c069f961-1ca9-4c78-9643-0435d63e798f tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf92af08fa94215b4eafcacea6c63f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e7d37a0e3b4b32ae99c3bc15a831e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:12.904012 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-c069f961-1ca9-4c78-9643-0435d63e798f tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "GET /compute/v2.1/servers/e346d31f-1498-49ff-8a58-0c607e41923e" status: 200 len: 1217 microversion: 2.1 time: 0.215997 Jul 23 21:17:12.922603 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 520/1009] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:12 2022] GET /compute/v2.1/servers/e346d31f-1498-49ff-8a58-0c607e41923e => generated 1217 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:13.121505 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-23de640f-718b-4972-88f5-e5f671992684 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4f9dda4c2a411cb0394bf86e9ae223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580ed681cbf44d10936259b17f60f1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:13.135437 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-23de640f-718b-4972-88f5-e5f671992684 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/servers/8025dc38-59d4-4296-b2c7-5aebb08eacae" status: 200 len: 1499 microversion: 2.1 time: 0.582521 Jul 23 21:17:13.146595 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 490/1010] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:12 2022] GET /compute/v2.1/servers/8025dc38-59d4-4296-b2c7-5aebb08eacae => generated 1499 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:13.278619 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-85aa5bb2-0916-44eb-b0f7-77df7b50066e tempest-FloatingIPDetailsNegativeTestJSON-2037033606 tempest-FloatingIPDetailsNegativeTestJSON-2037033606-project] Calling method '.version_select at 0x7f0b47ee6af0>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:13.443844 ncdv-master-1 devstack@n-api.service[131321]: DEBUG neutronclient.v2_0.client [None req-85aa5bb2-0916-44eb-b0f7-77df7b50066e tempest-FloatingIPDetailsNegativeTestJSON-2037033606 tempest-FloatingIPDetailsNegativeTestJSON-2037033606-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 8bb2be8c-fdc7-448c-8261-98b075da299b could not be found", "detail": ""}} {{(pid=131321) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 23 21:17:13.444817 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-85aa5bb2-0916-44eb-b0f7-77df7b50066e tempest-FloatingIPDetailsNegativeTestJSON-2037033606 tempest-FloatingIPDetailsNegativeTestJSON-2037033606-project] HTTP exception thrown: Floating IP not found for ID 8bb2be8c-fdc7-448c-8261-98b075da299b Jul 23 21:17:13.447301 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-85aa5bb2-0916-44eb-b0f7-77df7b50066e tempest-FloatingIPDetailsNegativeTestJSON-2037033606 tempest-FloatingIPDetailsNegativeTestJSON-2037033606-project] Request method failure captured: Jul 23 21:17:13.447301 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/os-floating-ips/8bb2be8c-fdc7-448c-8261-98b075da299b HTTP/1.1 Jul 23 21:17:13.447301 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:17:13.447301 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:17:13.447301 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:17:13.447301 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:17:13.447301 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:17:13.447301 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:17:13.447301 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:17:13.447301 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:17:13.447301 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GVYxfGRvWe_hoA_mL3bDnuWZB7i2_F1I1768eq27IU0Ye05pT35dYqCgoTbEORMzDJq4uINJ8eEGNQ7lc-AKQvBy3qnJrvOKiY7ZGRY0P0OQCSPUHZCO8bCI9tZ2v4kz8Zoq3ngD8Pjamvq6DVT_RmT_xNZ1cMg3yaYwgyk9nvmE3A Jul 23 21:17:13.447301 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:17:13.447301 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:17:13.447301 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:17:13.447301 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:17:13.447301 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:17:13.447301 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:17:13.447301 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: a9048665723042548bb40405a19e3efd Jul 23 21:17:13.447301 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-2037033606 Jul 23 21:17:13.447301 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:17:13.447301 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:17:13.448989 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a9048665723042548bb40405a19e3efd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a9048665723042548bb40405a19e3efd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a9048665723042548bb40405a19e3efd", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a9048665723042548bb40405a19e3efd"}]}] Jul 23 21:17:13.448989 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-2037033606 Jul 23 21:17:13.448989 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: a9048665723042548bb40405a19e3efd Jul 23 21:17:13.448989 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-2037033606 Jul 23 21:17:13.448989 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-2037033606-project Jul 23 21:17:13.448989 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:17:13.448989 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:17:13.448989 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 55c76bc3f4d24532a4a8e9fd5aa7ec10 Jul 23 21:17:13.448989 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-2037033606-project Jul 23 21:17:13.448989 ncdv-master-1 devstack@n-api.service[131321]: method: Jul 23 21:17:13.448989 ncdv-master-1 devstack@n-api.service[131321]: exception: Floating IP not found for ID 8bb2be8c-fdc7-448c-8261-98b075da299b Jul 23 21:17:13.448989 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': '8bb2be8c-fdc7-448c-8261-98b075da299b'} Jul 23 21:17:13.449807 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:17:13.449807 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:17:13.449807 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 23 21:17:13.449807 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 23 21:17:13.449807 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:17:13.449807 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:17:13.449807 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 23 21:17:13.449807 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 23 21:17:13.449807 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:17:13.449807 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:17:13.449807 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 23 21:17:13.449807 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 23 21:17:13.449807 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:17:13.449807 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:17:13.449807 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 23 21:17:13.449807 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 23 21:17:13.449807 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:17:13.449807 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:17:13.449807 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 23 21:17:13.451242 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 23 21:17:13.451242 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:17:13.451242 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:17:13.451242 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 23 21:17:13.451242 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 23 21:17:13.451242 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 23 21:17:13.451242 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 23 21:17:13.451242 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 8bb2be8c-fdc7-448c-8261-98b075da299b could not be found Jul 23 21:17:13.451242 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-06744ec8-34b3-4b3a-9b51-83230a2fbccf'] Jul 23 21:17:13.451242 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:17:13.451242 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:17:13.451242 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:17:13.451242 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:17:13.451242 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Jul 23 21:17:13.451242 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 23 21:17:13.451242 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 23 21:17:13.451242 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 23 21:17:13.451242 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 8bb2be8c-fdc7-448c-8261-98b075da299b. Jul 23 21:17:13.451242 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:17:13.452743 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:17:13.452743 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:17:13.452743 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:17:13.452743 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:17:13.452743 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:17:13.452743 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:17:13.452743 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:17:13.452743 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:17:13.452743 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:17:13.452743 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:17:13.452743 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:17:13.452743 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Jul 23 21:17:13.452743 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 23 21:17:13.452743 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 8bb2be8c-fdc7-448c-8261-98b075da299b Jul 23 21:17:13.452743 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:17:13.452743 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:17:13.452743 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:17:13.452743 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:17:13.452743 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:17:13.452743 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:17:13.452743 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:17:13.454457 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:17:13.454457 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 8bb2be8c-fdc7-448c-8261-98b075da299b Jul 23 21:17:13.454457 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:17:13.455950 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-85aa5bb2-0916-44eb-b0f7-77df7b50066e tempest-FloatingIPDetailsNegativeTestJSON-2037033606 tempest-FloatingIPDetailsNegativeTestJSON-2037033606-project] Returning 404 to user: Floating IP not found for ID 8bb2be8c-fdc7-448c-8261-98b075da299b {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:17:13.457070 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-85aa5bb2-0916-44eb-b0f7-77df7b50066e tempest-FloatingIPDetailsNegativeTestJSON-2037033606 tempest-FloatingIPDetailsNegativeTestJSON-2037033606-project] 10.222.0.17 "GET /compute/v2.1/os-floating-ips/8bb2be8c-fdc7-448c-8261-98b075da299b" status: 404 len: 111 microversion: 2.1 time: 0.532720 Jul 23 21:17:13.469727 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 521/1011] 10.222.0.17 () {58 vars in 1259 bytes} [Sat Jul 23 21:17:12 2022] GET /compute/v2.1/os-floating-ips/8bb2be8c-fdc7-448c-8261-98b075da299b => generated 111 bytes in 546 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:17:13.696201 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-546707ad-2afe-48ac-b28d-913c54d8f6a7 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:13.696825 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-546707ad-2afe-48ac-b28d-913c54d8f6a7 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 760fa31f-a0cf-46df-b456-3af5dc7f9933] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:13.710165 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-546707ad-2afe-48ac-b28d-913c54d8f6a7 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:13.710990 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-546707ad-2afe-48ac-b28d-913c54d8f6a7 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:13.714201 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-546707ad-2afe-48ac-b28d-913c54d8f6a7 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:13.714892 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-546707ad-2afe-48ac-b28d-913c54d8f6a7 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:13.942911 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-2afc073c-d0fb-42aa-b82a-1fe868b53e1e tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:13.944945 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-2afc073c-d0fb-42aa-b82a-1fe868b53e1e tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: e346d31f-1498-49ff-8a58-0c607e41923e] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:13.962921 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2afc073c-d0fb-42aa-b82a-1fe868b53e1e tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:13.964558 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2afc073c-d0fb-42aa-b82a-1fe868b53e1e tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:13.966577 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2afc073c-d0fb-42aa-b82a-1fe868b53e1e tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:13.967362 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2afc073c-d0fb-42aa-b82a-1fe868b53e1e tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:14.048642 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-2afc073c-d0fb-42aa-b82a-1fe868b53e1e tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf92af08fa94215b4eafcacea6c63f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e7d37a0e3b4b32ae99c3bc15a831e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:14.058561 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-2afc073c-d0fb-42aa-b82a-1fe868b53e1e tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "GET /compute/v2.1/servers/e346d31f-1498-49ff-8a58-0c607e41923e" status: 200 len: 1269 microversion: 2.1 time: 0.127682 Jul 23 21:17:14.067230 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 522/1012] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:13 2022] GET /compute/v2.1/servers/e346d31f-1498-49ff-8a58-0c607e41923e => generated 1269 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:14.137077 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-546707ad-2afe-48ac-b28d-913c54d8f6a7 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:14.156675 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-13207d18-0eb7-438f-a8ec-59b7b9bf006e tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:14.157472 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-13207d18-0eb7-438f-a8ec-59b7b9bf006e tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 8025dc38-59d4-4296-b2c7-5aebb08eacae] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:14.162065 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-546707ad-2afe-48ac-b28d-913c54d8f6a7 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933" status: 200 len: 1542 microversion: 2.1 time: 0.458574 Jul 23 21:17:14.174013 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 491/1013] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:13 2022] GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933 => generated 1542 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:14.190158 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-13207d18-0eb7-438f-a8ec-59b7b9bf006e tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:14.191702 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-13207d18-0eb7-438f-a8ec-59b7b9bf006e tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:14.192753 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-13207d18-0eb7-438f-a8ec-59b7b9bf006e tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:14.193358 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-13207d18-0eb7-438f-a8ec-59b7b9bf006e tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:14.403841 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-13207d18-0eb7-438f-a8ec-59b7b9bf006e tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4f9dda4c2a411cb0394bf86e9ae223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580ed681cbf44d10936259b17f60f1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:14.420891 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-13207d18-0eb7-438f-a8ec-59b7b9bf006e tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/servers/8025dc38-59d4-4296-b2c7-5aebb08eacae" status: 200 len: 1499 microversion: 2.1 time: 0.266784 Jul 23 21:17:14.426264 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 523/1014] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:14 2022] GET /compute/v2.1/servers/8025dc38-59d4-4296-b2c7-5aebb08eacae => generated 1499 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:15.077037 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-83fcf915-5d3f-4ab6-abb4-e4b6dd0b1271 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:15.078645 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-83fcf915-5d3f-4ab6-abb4-e4b6dd0b1271 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: e346d31f-1498-49ff-8a58-0c607e41923e] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:15.094092 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-83fcf915-5d3f-4ab6-abb4-e4b6dd0b1271 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:15.094874 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-83fcf915-5d3f-4ab6-abb4-e4b6dd0b1271 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:15.095939 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-83fcf915-5d3f-4ab6-abb4-e4b6dd0b1271 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:15.096538 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-83fcf915-5d3f-4ab6-abb4-e4b6dd0b1271 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:15.165102 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:17:15.180874 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-5bc9021d-1713-46a3-b608-7cce987f764a tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:15.182720 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-5bc9021d-1713-46a3-b608-7cce987f764a tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 760fa31f-a0cf-46df-b456-3af5dc7f9933] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:15.202830 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5bc9021d-1713-46a3-b608-7cce987f764a tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:15.224046 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5bc9021d-1713-46a3-b608-7cce987f764a tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:15.230127 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5bc9021d-1713-46a3-b608-7cce987f764a tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:15.233131 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5bc9021d-1713-46a3-b608-7cce987f764a tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:15.358255 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-83fcf915-5d3f-4ab6-abb4-e4b6dd0b1271 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf92af08fa94215b4eafcacea6c63f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e7d37a0e3b4b32ae99c3bc15a831e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:15.378703 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-83fcf915-5d3f-4ab6-abb4-e4b6dd0b1271 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "GET /compute/v2.1/servers/e346d31f-1498-49ff-8a58-0c607e41923e" status: 200 len: 1275 microversion: 2.1 time: 0.305043 Jul 23 21:17:15.390243 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 492/1015] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:15 2022] GET /compute/v2.1/servers/e346d31f-1498-49ff-8a58-0c607e41923e => generated 1275 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:15.444156 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e8fdc7b7-89e3-426b-a266-463879460057 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:15.444623 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e8fdc7b7-89e3-426b-a266-463879460057 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 8025dc38-59d4-4296-b2c7-5aebb08eacae] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:15.453069 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e8fdc7b7-89e3-426b-a266-463879460057 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:15.453534 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e8fdc7b7-89e3-426b-a266-463879460057 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:15.458521 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e8fdc7b7-89e3-426b-a266-463879460057 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:15.462101 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e8fdc7b7-89e3-426b-a266-463879460057 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:15.947041 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-5bc9021d-1713-46a3-b608-7cce987f764a tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:15.966145 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-5bc9021d-1713-46a3-b608-7cce987f764a tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933" status: 200 len: 1542 microversion: 2.1 time: 0.786448 Jul 23 21:17:15.968753 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 524/1016] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:15 2022] GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933 => generated 1542 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:17:16.415010 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-94cb0c45-c415-423b-a705-38bdcc7bfc30 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:16.417756 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-94cb0c45-c415-423b-a705-38bdcc7bfc30 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: e346d31f-1498-49ff-8a58-0c607e41923e] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:16.442387 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-94cb0c45-c415-423b-a705-38bdcc7bfc30 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:16.443420 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-94cb0c45-c415-423b-a705-38bdcc7bfc30 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:16.468008 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-94cb0c45-c415-423b-a705-38bdcc7bfc30 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:16.469397 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-94cb0c45-c415-423b-a705-38bdcc7bfc30 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:16.479457 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e8fdc7b7-89e3-426b-a266-463879460057 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4f9dda4c2a411cb0394bf86e9ae223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580ed681cbf44d10936259b17f60f1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:16.493089 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e8fdc7b7-89e3-426b-a266-463879460057 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/servers/8025dc38-59d4-4296-b2c7-5aebb08eacae" status: 200 len: 1499 microversion: 2.1 time: 1.054770 Jul 23 21:17:16.493702 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 493/1017] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:15 2022] GET /compute/v2.1/servers/8025dc38-59d4-4296-b2c7-5aebb08eacae => generated 1499 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:16.987399 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6d4011e7-fd28-403a-8b55-9047aa64243b tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:16.988456 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6d4011e7-fd28-403a-8b55-9047aa64243b tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 760fa31f-a0cf-46df-b456-3af5dc7f9933] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:17.002129 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6d4011e7-fd28-403a-8b55-9047aa64243b tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:17.005394 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6d4011e7-fd28-403a-8b55-9047aa64243b tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:17.013435 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6d4011e7-fd28-403a-8b55-9047aa64243b tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:17.014091 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6d4011e7-fd28-403a-8b55-9047aa64243b tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:17.575198 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6d4011e7-fd28-403a-8b55-9047aa64243b tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:17.596437 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6d4011e7-fd28-403a-8b55-9047aa64243b tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933" status: 200 len: 1542 microversion: 2.1 time: 0.615680 Jul 23 21:17:17.598001 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 494/1018] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:16 2022] GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933 => generated 1542 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:17.610818 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2aa1a9a5-bdc6-4d15-a18a-6761fc7d62b9 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:17.612096 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-2aa1a9a5-bdc6-4d15-a18a-6761fc7d62b9 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 8025dc38-59d4-4296-b2c7-5aebb08eacae] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:17.629458 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2aa1a9a5-bdc6-4d15-a18a-6761fc7d62b9 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:17.633464 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2aa1a9a5-bdc6-4d15-a18a-6761fc7d62b9 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:17.634740 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2aa1a9a5-bdc6-4d15-a18a-6761fc7d62b9 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:17.635398 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2aa1a9a5-bdc6-4d15-a18a-6761fc7d62b9 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:17.925966 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:17:17.956452 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-2aa1a9a5-bdc6-4d15-a18a-6761fc7d62b9 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4f9dda4c2a411cb0394bf86e9ae223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580ed681cbf44d10936259b17f60f1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:17.969067 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2aa1a9a5-bdc6-4d15-a18a-6761fc7d62b9 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/servers/8025dc38-59d4-4296-b2c7-5aebb08eacae" status: 200 len: 1499 microversion: 2.1 time: 0.369664 Jul 23 21:17:17.969887 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 495/1019] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:17 2022] GET /compute/v2.1/servers/8025dc38-59d4-4296-b2c7-5aebb08eacae => generated 1499 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:18.083110 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-94cb0c45-c415-423b-a705-38bdcc7bfc30 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf92af08fa94215b4eafcacea6c63f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e7d37a0e3b4b32ae99c3bc15a831e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:18.098826 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-94cb0c45-c415-423b-a705-38bdcc7bfc30 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "GET /compute/v2.1/servers/e346d31f-1498-49ff-8a58-0c607e41923e" status: 200 len: 1317 microversion: 2.1 time: 1.706090 Jul 23 21:17:18.100001 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 525/1020] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:16 2022] GET /compute/v2.1/servers/e346d31f-1498-49ff-8a58-0c607e41923e => generated 1317 bytes in 1708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:18.617550 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-7e9530f8-de9f-420f-8666-4aee10dfd350 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:18.619210 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-7e9530f8-de9f-420f-8666-4aee10dfd350 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 760fa31f-a0cf-46df-b456-3af5dc7f9933] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:18.629661 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7e9530f8-de9f-420f-8666-4aee10dfd350 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:18.631060 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7e9530f8-de9f-420f-8666-4aee10dfd350 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:18.632055 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7e9530f8-de9f-420f-8666-4aee10dfd350 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:18.633295 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7e9530f8-de9f-420f-8666-4aee10dfd350 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:18.744480 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-44554ddf-d6a4-40b6-991a-b4aa3dd12d67 req-565c2651-74a5-482f-a92c-545751ae708e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e346d31f-1498-49ff-8a58-0c607e41923e", "tag": "7730518a-afbf-4f1e-9b23-7a49e9c11fad"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:17:18.771488 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-44554ddf-d6a4-40b6-991a-b4aa3dd12d67 req-565c2651-74a5-482f-a92c-545751ae708e service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:18.772357 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-44554ddf-d6a4-40b6-991a-b4aa3dd12d67 req-565c2651-74a5-482f-a92c-545751ae708e service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:18.834208 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-44554ddf-d6a4-40b6-991a-b4aa3dd12d67 req-565c2651-74a5-482f-a92c-545751ae708e service nova] Creating event network-changed:7730518a-afbf-4f1e-9b23-7a49e9c11fad for instance e346d31f-1498-49ff-8a58-0c607e41923e on nch1-master-1 Jul 23 21:17:18.840835 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-44554ddf-d6a4-40b6-991a-b4aa3dd12d67 req-565c2651-74a5-482f-a92c-545751ae708e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101161 Jul 23 21:17:18.842416 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 526/1021] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:17:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:17:19.023091 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f352cbc3-b934-4719-bb32-dc86373612a7 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:19.028045 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-f352cbc3-b934-4719-bb32-dc86373612a7 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 8025dc38-59d4-4296-b2c7-5aebb08eacae] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:19.055854 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-7e9530f8-de9f-420f-8666-4aee10dfd350 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:19.068370 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-7e9530f8-de9f-420f-8666-4aee10dfd350 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933" status: 200 len: 1542 microversion: 2.1 time: 0.454841 Jul 23 21:17:19.077814 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 496/1022] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:18 2022] GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933 => generated 1542 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:19.078078 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f352cbc3-b934-4719-bb32-dc86373612a7 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:19.102469 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f352cbc3-b934-4719-bb32-dc86373612a7 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:19.103379 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f352cbc3-b934-4719-bb32-dc86373612a7 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:19.103833 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f352cbc3-b934-4719-bb32-dc86373612a7 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:19.120388 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-dfdf7c0f-fbaa-44c8-93a4-ce4b28be6119 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:19.121007 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-dfdf7c0f-fbaa-44c8-93a4-ce4b28be6119 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: e346d31f-1498-49ff-8a58-0c607e41923e] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:19.139639 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dfdf7c0f-fbaa-44c8-93a4-ce4b28be6119 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:19.140090 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dfdf7c0f-fbaa-44c8-93a4-ce4b28be6119 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:19.140908 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dfdf7c0f-fbaa-44c8-93a4-ce4b28be6119 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:19.141344 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dfdf7c0f-fbaa-44c8-93a4-ce4b28be6119 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:19.387393 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-dfdf7c0f-fbaa-44c8-93a4-ce4b28be6119 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf92af08fa94215b4eafcacea6c63f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e7d37a0e3b4b32ae99c3bc15a831e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:19.399906 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-dfdf7c0f-fbaa-44c8-93a4-ce4b28be6119 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "GET /compute/v2.1/servers/e346d31f-1498-49ff-8a58-0c607e41923e" status: 200 len: 1317 microversion: 2.1 time: 0.281770 Jul 23 21:17:19.409190 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 497/1023] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:19 2022] GET /compute/v2.1/servers/e346d31f-1498-49ff-8a58-0c607e41923e => generated 1317 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:17:19.505995 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-f352cbc3-b934-4719-bb32-dc86373612a7 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4f9dda4c2a411cb0394bf86e9ae223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580ed681cbf44d10936259b17f60f1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:19.514284 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-f352cbc3-b934-4719-bb32-dc86373612a7 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/servers/8025dc38-59d4-4296-b2c7-5aebb08eacae" status: 200 len: 1499 microversion: 2.1 time: 0.527122 Jul 23 21:17:19.515376 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 527/1024] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:18 2022] GET /compute/v2.1/servers/8025dc38-59d4-4296-b2c7-5aebb08eacae => generated 1499 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:17:20.088226 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9b1524d7-fb51-439b-bb4f-715e2c90e46f tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:20.088844 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-9b1524d7-fb51-439b-bb4f-715e2c90e46f tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 760fa31f-a0cf-46df-b456-3af5dc7f9933] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:20.108943 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9b1524d7-fb51-439b-bb4f-715e2c90e46f tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:20.116456 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9b1524d7-fb51-439b-bb4f-715e2c90e46f tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:20.118655 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9b1524d7-fb51-439b-bb4f-715e2c90e46f tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:20.119478 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9b1524d7-fb51-439b-bb4f-715e2c90e46f tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:20.382763 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-9b1524d7-fb51-439b-bb4f-715e2c90e46f tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:20.403165 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9b1524d7-fb51-439b-bb4f-715e2c90e46f tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933" status: 200 len: 1542 microversion: 2.1 time: 0.318730 Jul 23 21:17:20.416182 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 498/1025] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:20 2022] GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933 => generated 1542 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:20.422999 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-6fbdc4a0-f55b-45bb-9130-129458055d0f tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:20.422999 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-6fbdc4a0-f55b-45bb-9130-129458055d0f tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: e346d31f-1498-49ff-8a58-0c607e41923e] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:20.432412 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6fbdc4a0-f55b-45bb-9130-129458055d0f tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:20.432878 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6fbdc4a0-f55b-45bb-9130-129458055d0f tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:20.433668 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6fbdc4a0-f55b-45bb-9130-129458055d0f tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:20.434139 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6fbdc4a0-f55b-45bb-9130-129458055d0f tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:20.541621 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-57e9c5f2-0087-4efa-9de4-e5bba45422f6 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:20.543546 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-57e9c5f2-0087-4efa-9de4-e5bba45422f6 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 8025dc38-59d4-4296-b2c7-5aebb08eacae] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:20.552132 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-57e9c5f2-0087-4efa-9de4-e5bba45422f6 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:20.553366 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-57e9c5f2-0087-4efa-9de4-e5bba45422f6 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:20.555336 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-57e9c5f2-0087-4efa-9de4-e5bba45422f6 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:20.556271 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-57e9c5f2-0087-4efa-9de4-e5bba45422f6 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:20.710495 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-6fbdc4a0-f55b-45bb-9130-129458055d0f tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf92af08fa94215b4eafcacea6c63f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e7d37a0e3b4b32ae99c3bc15a831e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:20.719091 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-6fbdc4a0-f55b-45bb-9130-129458055d0f tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "GET /compute/v2.1/servers/e346d31f-1498-49ff-8a58-0c607e41923e" status: 200 len: 1317 microversion: 2.1 time: 0.301831 Jul 23 21:17:20.719998 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 528/1026] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:20 2022] GET /compute/v2.1/servers/e346d31f-1498-49ff-8a58-0c607e41923e => generated 1317 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:20.724997 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-0f2895db-996f-404c-8b8c-cd682a13105a tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:20.725978 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-0f2895db-996f-404c-8b8c-cd682a13105a tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] [instance: 34eaf1d2-9732-4c0e-b970-02fbb449514b] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:20.734107 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0f2895db-996f-404c-8b8c-cd682a13105a tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:20.734913 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0f2895db-996f-404c-8b8c-cd682a13105a tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:20.735938 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0f2895db-996f-404c-8b8c-cd682a13105a tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:20.736321 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0f2895db-996f-404c-8b8c-cd682a13105a tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:20.900228 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-0f2895db-996f-404c-8b8c-cd682a13105a tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/34eaf1d2-9732-4c0e-b970-02fbb449514b" status: 200 len: 1859 microversion: 2.1 time: 0.178603 Jul 23 21:17:20.900829 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 529/1027] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:20 2022] GET /compute/v2.1/servers/34eaf1d2-9732-4c0e-b970-02fbb449514b => generated 1859 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:20.919517 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f29f8edd-114e-4948-b565-00bfe4babd78 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:17:20.920748 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-f29f8edd-114e-4948-b565-00bfe4babd78 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] [instance: 34eaf1d2-9732-4c0e-b970-02fbb449514b] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:20.927951 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f29f8edd-114e-4948-b565-00bfe4babd78 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:20.928959 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f29f8edd-114e-4948-b565-00bfe4babd78 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:20.930418 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f29f8edd-114e-4948-b565-00bfe4babd78 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:20.931063 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f29f8edd-114e-4948-b565-00bfe4babd78 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:20.966477 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.objects.instance [None req-f29f8edd-114e-4948-b565-00bfe4babd78 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lazy-loading 'flavor' on Instance uuid 34eaf1d2-9732-4c0e-b970-02fbb449514b {{(pid=131321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:17:20.980733 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-f29f8edd-114e-4948-b565-00bfe4babd78 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] [instance: 34eaf1d2-9732-4c0e-b970-02fbb449514b] Going to try to live migrate instance to nch1-master-1 {{(pid=131321) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 23 21:17:21.226759 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-57e9c5f2-0087-4efa-9de4-e5bba45422f6 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4f9dda4c2a411cb0394bf86e9ae223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580ed681cbf44d10936259b17f60f1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:21.236524 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-57e9c5f2-0087-4efa-9de4-e5bba45422f6 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/servers/8025dc38-59d4-4296-b2c7-5aebb08eacae" status: 200 len: 1499 microversion: 2.1 time: 0.708568 Jul 23 21:17:21.247078 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 499/1028] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:20 2022] GET /compute/v2.1/servers/8025dc38-59d4-4296-b2c7-5aebb08eacae => generated 1499 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:21.434868 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5708daad-a4ae-45b9-9288-765104362303 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:21.435871 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5708daad-a4ae-45b9-9288-765104362303 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 760fa31f-a0cf-46df-b456-3af5dc7f9933] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:21.443565 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5708daad-a4ae-45b9-9288-765104362303 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:21.444292 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5708daad-a4ae-45b9-9288-765104362303 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:21.445505 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5708daad-a4ae-45b9-9288-765104362303 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:21.450637 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5708daad-a4ae-45b9-9288-765104362303 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:21.645531 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5708daad-a4ae-45b9-9288-765104362303 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:21.656861 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5708daad-a4ae-45b9-9288-765104362303 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933" status: 200 len: 1542 microversion: 2.1 time: 0.228904 Jul 23 21:17:21.668982 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 500/1029] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:21 2022] GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933 => generated 1542 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:17:21.737889 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e5763be7-fcd1-44ca-a439-8569d2d27788 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:21.738539 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e5763be7-fcd1-44ca-a439-8569d2d27788 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: e346d31f-1498-49ff-8a58-0c607e41923e] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:21.745013 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e5763be7-fcd1-44ca-a439-8569d2d27788 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:21.745470 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e5763be7-fcd1-44ca-a439-8569d2d27788 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:21.746289 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e5763be7-fcd1-44ca-a439-8569d2d27788 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:21.746730 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e5763be7-fcd1-44ca-a439-8569d2d27788 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:21.970536 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell0:SELECT=2 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:17:21.984778 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e5763be7-fcd1-44ca-a439-8569d2d27788 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf92af08fa94215b4eafcacea6c63f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e7d37a0e3b4b32ae99c3bc15a831e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:22.000029 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e5763be7-fcd1-44ca-a439-8569d2d27788 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "GET /compute/v2.1/servers/e346d31f-1498-49ff-8a58-0c607e41923e" status: 200 len: 1317 microversion: 2.1 time: 0.267378 Jul 23 21:17:22.017815 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 501/1030] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:21 2022] GET /compute/v2.1/servers/e346d31f-1498-49ff-8a58-0c607e41923e => generated 1317 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:22.255216 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2b3ad150-c471-47ab-bd14-3330bba86cd9 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:22.260290 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-2b3ad150-c471-47ab-bd14-3330bba86cd9 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 8025dc38-59d4-4296-b2c7-5aebb08eacae] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:22.276230 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2b3ad150-c471-47ab-bd14-3330bba86cd9 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:22.276952 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2b3ad150-c471-47ab-bd14-3330bba86cd9 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:22.278170 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2b3ad150-c471-47ab-bd14-3330bba86cd9 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:22.278914 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2b3ad150-c471-47ab-bd14-3330bba86cd9 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:22.573506 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-2b3ad150-c471-47ab-bd14-3330bba86cd9 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4f9dda4c2a411cb0394bf86e9ae223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580ed681cbf44d10936259b17f60f1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:22.588797 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2b3ad150-c471-47ab-bd14-3330bba86cd9 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/servers/8025dc38-59d4-4296-b2c7-5aebb08eacae" status: 200 len: 1499 microversion: 2.1 time: 0.339855 Jul 23 21:17:22.591296 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 502/1031] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:22 2022] GET /compute/v2.1/servers/8025dc38-59d4-4296-b2c7-5aebb08eacae => generated 1499 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:22.633466 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-f29f8edd-114e-4948-b565-00bfe4babd78 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/34eaf1d2-9732-4c0e-b970-02fbb449514b/action" status: 202 len: 0 microversion: 2.1 time: 1.718551 Jul 23 21:17:22.634602 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 530/1032] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:17:20 2022] POST /compute/v2.1/servers/34eaf1d2-9732-4c0e-b970-02fbb449514b/action => generated 0 bytes in 1721 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:17:22.643064 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e18a68dd-47de-4b6f-8381-760cf060992f tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:22.644044 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e18a68dd-47de-4b6f-8381-760cf060992f tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 34eaf1d2-9732-4c0e-b970-02fbb449514b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:22.654695 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e18a68dd-47de-4b6f-8381-760cf060992f tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:22.657898 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e18a68dd-47de-4b6f-8381-760cf060992f tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:22.659620 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e18a68dd-47de-4b6f-8381-760cf060992f tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:22.662850 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e18a68dd-47de-4b6f-8381-760cf060992f tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:22.680790 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-36f59ad7-17c1-4764-88ba-8fd098827555 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:22.681594 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-36f59ad7-17c1-4764-88ba-8fd098827555 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 760fa31f-a0cf-46df-b456-3af5dc7f9933] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:22.703684 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-36f59ad7-17c1-4764-88ba-8fd098827555 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:22.705136 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-36f59ad7-17c1-4764-88ba-8fd098827555 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:22.707634 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-36f59ad7-17c1-4764-88ba-8fd098827555 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:22.708547 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-36f59ad7-17c1-4764-88ba-8fd098827555 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:22.886595 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell0:SELECT=8 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:17:22.978733 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e18a68dd-47de-4b6f-8381-760cf060992f tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:22.992036 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-36f59ad7-17c1-4764-88ba-8fd098827555 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:22.993660 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e18a68dd-47de-4b6f-8381-760cf060992f tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/34eaf1d2-9732-4c0e-b970-02fbb449514b" status: 200 len: 1718 microversion: 2.1 time: 0.354302 Jul 23 21:17:23.000218 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 503/1033] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:22 2022] GET /compute/v2.1/servers/34eaf1d2-9732-4c0e-b970-02fbb449514b => generated 1718 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:23.004175 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-36f59ad7-17c1-4764-88ba-8fd098827555 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933" status: 200 len: 1542 microversion: 2.1 time: 0.332705 Jul 23 21:17:23.006739 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 531/1034] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:22 2022] GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933 => generated 1542 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:17:23.017266 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9f8b5709-6f5b-47c4-90cc-752465f916ee tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:23.017905 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-9f8b5709-6f5b-47c4-90cc-752465f916ee tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: e346d31f-1498-49ff-8a58-0c607e41923e] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:23.031452 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9f8b5709-6f5b-47c4-90cc-752465f916ee tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:23.031915 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9f8b5709-6f5b-47c4-90cc-752465f916ee tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:23.032706 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9f8b5709-6f5b-47c4-90cc-752465f916ee tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:23.033228 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9f8b5709-6f5b-47c4-90cc-752465f916ee tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:23.230622 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-9f8b5709-6f5b-47c4-90cc-752465f916ee tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf92af08fa94215b4eafcacea6c63f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e7d37a0e3b4b32ae99c3bc15a831e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:23.244045 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9f8b5709-6f5b-47c4-90cc-752465f916ee tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "GET /compute/v2.1/servers/e346d31f-1498-49ff-8a58-0c607e41923e" status: 200 len: 1317 microversion: 2.1 time: 0.230567 Jul 23 21:17:23.244894 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 504/1035] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:23 2022] GET /compute/v2.1/servers/e346d31f-1498-49ff-8a58-0c607e41923e => generated 1317 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:23.616325 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-99c294d4-86ef-4d1c-9bc7-f26852896f83 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:23.617373 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-99c294d4-86ef-4d1c-9bc7-f26852896f83 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 8025dc38-59d4-4296-b2c7-5aebb08eacae] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:23.625343 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-99c294d4-86ef-4d1c-9bc7-f26852896f83 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:23.627164 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-99c294d4-86ef-4d1c-9bc7-f26852896f83 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:23.627977 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-99c294d4-86ef-4d1c-9bc7-f26852896f83 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:23.628410 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-99c294d4-86ef-4d1c-9bc7-f26852896f83 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:23.635522 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:17:23.883519 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-99c294d4-86ef-4d1c-9bc7-f26852896f83 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4f9dda4c2a411cb0394bf86e9ae223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580ed681cbf44d10936259b17f60f1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:23.896771 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-99c294d4-86ef-4d1c-9bc7-f26852896f83 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/servers/8025dc38-59d4-4296-b2c7-5aebb08eacae" status: 200 len: 1499 microversion: 2.1 time: 0.291859 Jul 23 21:17:23.908294 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 532/1036] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:23 2022] GET /compute/v2.1/servers/8025dc38-59d4-4296-b2c7-5aebb08eacae => generated 1499 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:23.952898 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f1b30a71-ba54-4bae-9848-59efbef3c532 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:23.953476 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f1b30a71-ba54-4bae-9848-59efbef3c532 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] [instance: 26494d1b-0e9c-45ac-90f7-55924a958e4c] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:23.964261 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f1b30a71-ba54-4bae-9848-59efbef3c532 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:23.965263 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f1b30a71-ba54-4bae-9848-59efbef3c532 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:23.966404 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f1b30a71-ba54-4bae-9848-59efbef3c532 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:23.967000 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f1b30a71-ba54-4bae-9848-59efbef3c532 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:24.013208 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-8d4d0c0b-9721-4ead-bca0-c175bab800e0 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:24.014683 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-8d4d0c0b-9721-4ead-bca0-c175bab800e0 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 34eaf1d2-9732-4c0e-b970-02fbb449514b] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:24.033560 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8d4d0c0b-9721-4ead-bca0-c175bab800e0 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:24.035549 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8d4d0c0b-9721-4ead-bca0-c175bab800e0 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:24.036624 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8d4d0c0b-9721-4ead-bca0-c175bab800e0 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:24.038510 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8d4d0c0b-9721-4ead-bca0-c175bab800e0 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:24.049430 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f1b30a71-ba54-4bae-9848-59efbef3c532 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] [instance: 26494d1b-0e9c-45ac-90f7-55924a958e4c] Going to try to terminate instance {{(pid=131320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:17:24.219250 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f1b30a71-ba54-4bae-9848-59efbef3c532 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] 10.222.0.17 "DELETE /compute/v2.1/servers/26494d1b-0e9c-45ac-90f7-55924a958e4c" status: 204 len: 0 microversion: 2.1 time: 0.270200 Jul 23 21:17:24.225146 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 505/1037] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:17:23 2022] DELETE /compute/v2.1/servers/26494d1b-0e9c-45ac-90f7-55924a958e4c => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:17:24.245170 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8bf83376-efeb-4901-a7e2-9c4b689475aa tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:24.249999 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8bf83376-efeb-4901-a7e2-9c4b689475aa tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 760fa31f-a0cf-46df-b456-3af5dc7f9933] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:24.268913 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8bf83376-efeb-4901-a7e2-9c4b689475aa tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:24.270968 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8bf83376-efeb-4901-a7e2-9c4b689475aa tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:24.274459 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8bf83376-efeb-4901-a7e2-9c4b689475aa tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:24.275093 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8bf83376-efeb-4901-a7e2-9c4b689475aa tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:24.310020 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-8d4d0c0b-9721-4ead-bca0-c175bab800e0 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:24.320580 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-8d4d0c0b-9721-4ead-bca0-c175bab800e0 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/34eaf1d2-9732-4c0e-b970-02fbb449514b" status: 200 len: 1718 microversion: 2.1 time: 0.311704 Jul 23 21:17:24.321747 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 533/1038] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:24 2022] GET /compute/v2.1/servers/34eaf1d2-9732-4c0e-b970-02fbb449514b => generated 1718 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:17:24.327979 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-3e0e4e2a-c130-429b-95a6-6566422fde70 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:24.328816 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-3e0e4e2a-c130-429b-95a6-6566422fde70 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] [instance: 26494d1b-0e9c-45ac-90f7-55924a958e4c] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:24.336380 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3e0e4e2a-c130-429b-95a6-6566422fde70 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:24.337573 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3e0e4e2a-c130-429b-95a6-6566422fde70 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:24.338881 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3e0e4e2a-c130-429b-95a6-6566422fde70 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:24.339464 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3e0e4e2a-c130-429b-95a6-6566422fde70 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:24.549699 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-3e0e4e2a-c130-429b-95a6-6566422fde70 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f1a14a59b7401d88f18ec35c91e30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c17bd813264fb9891076799e33acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:24.562872 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-3e0e4e2a-c130-429b-95a6-6566422fde70 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] 10.222.0.17 "GET /compute/v2.1/servers/26494d1b-0e9c-45ac-90f7-55924a958e4c" status: 200 len: 1711 microversion: 2.1 time: 0.234607 Jul 23 21:17:24.563882 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 534/1039] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:24 2022] GET /compute/v2.1/servers/26494d1b-0e9c-45ac-90f7-55924a958e4c => generated 1711 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:24.572753 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-9e0daf26-6f94-4e21-b71d-f5107feccfa5 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:24.573580 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-9e0daf26-6f94-4e21-b71d-f5107feccfa5 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: e346d31f-1498-49ff-8a58-0c607e41923e] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:24.580914 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9e0daf26-6f94-4e21-b71d-f5107feccfa5 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:24.581609 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9e0daf26-6f94-4e21-b71d-f5107feccfa5 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:24.582584 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9e0daf26-6f94-4e21-b71d-f5107feccfa5 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:24.583204 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9e0daf26-6f94-4e21-b71d-f5107feccfa5 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:24.617351 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8bf83376-efeb-4901-a7e2-9c4b689475aa tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:24.634817 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8bf83376-efeb-4901-a7e2-9c4b689475aa tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933" status: 200 len: 1542 microversion: 2.1 time: 0.410812 Jul 23 21:17:24.644246 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 506/1040] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:24 2022] GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933 => generated 1542 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:24.869317 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-9e0daf26-6f94-4e21-b71d-f5107feccfa5 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf92af08fa94215b4eafcacea6c63f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e7d37a0e3b4b32ae99c3bc15a831e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:24.879562 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-9e0daf26-6f94-4e21-b71d-f5107feccfa5 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "GET /compute/v2.1/servers/e346d31f-1498-49ff-8a58-0c607e41923e" status: 200 len: 1317 microversion: 2.1 time: 0.314323 Jul 23 21:17:24.881333 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 535/1041] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:24 2022] GET /compute/v2.1/servers/e346d31f-1498-49ff-8a58-0c607e41923e => generated 1317 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:24.914656 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6653ddfe-ff31-4f6c-ab02-a62d197bd0a0 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:24.915599 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6653ddfe-ff31-4f6c-ab02-a62d197bd0a0 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 8025dc38-59d4-4296-b2c7-5aebb08eacae] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:24.925461 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6653ddfe-ff31-4f6c-ab02-a62d197bd0a0 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:24.926281 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6653ddfe-ff31-4f6c-ab02-a62d197bd0a0 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:24.928353 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6653ddfe-ff31-4f6c-ab02-a62d197bd0a0 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:24.928964 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6653ddfe-ff31-4f6c-ab02-a62d197bd0a0 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:24.960004 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:17:25.340008 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-9eb68990-042a-440d-a7a9-873664a29f2a tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:25.341539 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-9eb68990-042a-440d-a7a9-873664a29f2a tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 34eaf1d2-9732-4c0e-b970-02fbb449514b] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:25.352129 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9eb68990-042a-440d-a7a9-873664a29f2a tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:25.357928 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9eb68990-042a-440d-a7a9-873664a29f2a tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:25.365061 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9eb68990-042a-440d-a7a9-873664a29f2a tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:25.368019 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9eb68990-042a-440d-a7a9-873664a29f2a tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:25.563003 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6653ddfe-ff31-4f6c-ab02-a62d197bd0a0 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4f9dda4c2a411cb0394bf86e9ae223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580ed681cbf44d10936259b17f60f1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:25.585621 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6653ddfe-ff31-4f6c-ab02-a62d197bd0a0 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/servers/8025dc38-59d4-4296-b2c7-5aebb08eacae" status: 200 len: 1499 microversion: 2.1 time: 0.665881 Jul 23 21:17:25.598183 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 507/1042] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:24 2022] GET /compute/v2.1/servers/8025dc38-59d4-4296-b2c7-5aebb08eacae => generated 1499 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:25.605977 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-69408ba1-3027-44a6-878f-441b67555a27 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:25.606642 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-69408ba1-3027-44a6-878f-441b67555a27 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] [instance: 26494d1b-0e9c-45ac-90f7-55924a958e4c] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:25.632382 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-69408ba1-3027-44a6-878f-441b67555a27 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:25.632846 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-69408ba1-3027-44a6-878f-441b67555a27 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:25.640084 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-69408ba1-3027-44a6-878f-441b67555a27 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:25.640250 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-69408ba1-3027-44a6-878f-441b67555a27 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:25.713935 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-9eb68990-042a-440d-a7a9-873664a29f2a tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:25.728162 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-9eb68990-042a-440d-a7a9-873664a29f2a tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/34eaf1d2-9732-4c0e-b970-02fbb449514b" status: 200 len: 1718 microversion: 2.1 time: 0.392324 Jul 23 21:17:25.729965 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 536/1043] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:25 2022] GET /compute/v2.1/servers/34eaf1d2-9732-4c0e-b970-02fbb449514b => generated 1718 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:17:25.735875 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-43e8d588-5405-4c49-9c44-27ba834d6ecc req-08ad4281-f6f4-4b8d-ab27-93829d9d252b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e346d31f-1498-49ff-8a58-0c607e41923e", "name": "network-vif-plugged", "status": "completed", "tag": "7730518a-afbf-4f1e-9b23-7a49e9c11fad"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:17:25.746428 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-43e8d588-5405-4c49-9c44-27ba834d6ecc req-08ad4281-f6f4-4b8d-ab27-93829d9d252b service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:25.747239 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-43e8d588-5405-4c49-9c44-27ba834d6ecc req-08ad4281-f6f4-4b8d-ab27-93829d9d252b service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:25.767351 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-43e8d588-5405-4c49-9c44-27ba834d6ecc req-08ad4281-f6f4-4b8d-ab27-93829d9d252b service nova] Creating event network-vif-plugged:7730518a-afbf-4f1e-9b23-7a49e9c11fad for instance e346d31f-1498-49ff-8a58-0c607e41923e on nch1-master-1 Jul 23 21:17:25.775161 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-43e8d588-5405-4c49-9c44-27ba834d6ecc req-08ad4281-f6f4-4b8d-ab27-93829d9d252b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042477 Jul 23 21:17:25.776400 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 537/1044] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:17:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:17:25.788027 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ce4ad319-9dc1-4071-b721-7b0b82393ff9 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:25.788732 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-ce4ad319-9dc1-4071-b721-7b0b82393ff9 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 760fa31f-a0cf-46df-b456-3af5dc7f9933] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:25.797564 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ce4ad319-9dc1-4071-b721-7b0b82393ff9 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:25.798047 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ce4ad319-9dc1-4071-b721-7b0b82393ff9 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:25.799101 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ce4ad319-9dc1-4071-b721-7b0b82393ff9 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:25.799902 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ce4ad319-9dc1-4071-b721-7b0b82393ff9 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:25.914228 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-69408ba1-3027-44a6-878f-441b67555a27 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f1a14a59b7401d88f18ec35c91e30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c17bd813264fb9891076799e33acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:25.928526 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-69408ba1-3027-44a6-878f-441b67555a27 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] 10.222.0.17 "GET /compute/v2.1/servers/26494d1b-0e9c-45ac-90f7-55924a958e4c" status: 200 len: 1711 microversion: 2.1 time: 0.334228 Jul 23 21:17:25.929653 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 508/1045] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:25 2022] GET /compute/v2.1/servers/26494d1b-0e9c-45ac-90f7-55924a958e4c => generated 1711 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:25.941793 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-298fbe72-503b-485f-a9ef-a34f7e634b4b tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:25.956671 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-298fbe72-503b-485f-a9ef-a34f7e634b4b tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: e346d31f-1498-49ff-8a58-0c607e41923e] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:26.016722 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-298fbe72-503b-485f-a9ef-a34f7e634b4b tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:26.023530 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-298fbe72-503b-485f-a9ef-a34f7e634b4b tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:26.025096 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-298fbe72-503b-485f-a9ef-a34f7e634b4b tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:26.025835 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-298fbe72-503b-485f-a9ef-a34f7e634b4b tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:26.177015 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ce4ad319-9dc1-4071-b721-7b0b82393ff9 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:26.188603 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-ce4ad319-9dc1-4071-b721-7b0b82393ff9 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933" status: 200 len: 1542 microversion: 2.1 time: 0.409016 Jul 23 21:17:26.199555 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 538/1046] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:25 2022] GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933 => generated 1542 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:26.407120 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-298fbe72-503b-485f-a9ef-a34f7e634b4b tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf92af08fa94215b4eafcacea6c63f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e7d37a0e3b4b32ae99c3bc15a831e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:26.421392 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-298fbe72-503b-485f-a9ef-a34f7e634b4b tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "GET /compute/v2.1/servers/e346d31f-1498-49ff-8a58-0c607e41923e" status: 200 len: 1317 microversion: 2.1 time: 0.488474 Jul 23 21:17:26.423278 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 509/1047] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:25 2022] GET /compute/v2.1/servers/e346d31f-1498-49ff-8a58-0c607e41923e => generated 1317 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:26.609995 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-4bd7d46f-7c04-4268-96b2-2ff83479aafb tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:26.610690 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-4bd7d46f-7c04-4268-96b2-2ff83479aafb tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 8025dc38-59d4-4296-b2c7-5aebb08eacae] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:26.627015 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4bd7d46f-7c04-4268-96b2-2ff83479aafb tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:26.637754 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4bd7d46f-7c04-4268-96b2-2ff83479aafb tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:26.638665 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4bd7d46f-7c04-4268-96b2-2ff83479aafb tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:26.639120 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4bd7d46f-7c04-4268-96b2-2ff83479aafb tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:26.747086 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e93e92f7-eaba-4326-a5e8-668f97130bad tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:26.748024 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e93e92f7-eaba-4326-a5e8-668f97130bad tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 34eaf1d2-9732-4c0e-b970-02fbb449514b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:26.756907 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e93e92f7-eaba-4326-a5e8-668f97130bad tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:26.767787 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e93e92f7-eaba-4326-a5e8-668f97130bad tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:26.768909 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e93e92f7-eaba-4326-a5e8-668f97130bad tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:26.769358 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e93e92f7-eaba-4326-a5e8-668f97130bad tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:27.078731 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e93e92f7-eaba-4326-a5e8-668f97130bad tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:27.101314 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-4bd7d46f-7c04-4268-96b2-2ff83479aafb tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4f9dda4c2a411cb0394bf86e9ae223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580ed681cbf44d10936259b17f60f1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:27.104769 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e93e92f7-eaba-4326-a5e8-668f97130bad tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/34eaf1d2-9732-4c0e-b970-02fbb449514b" status: 200 len: 1718 microversion: 2.1 time: 0.359168 Jul 23 21:17:27.107975 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 510/1048] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:26 2022] GET /compute/v2.1/servers/34eaf1d2-9732-4c0e-b970-02fbb449514b => generated 1718 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:27.113308 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-4bd7d46f-7c04-4268-96b2-2ff83479aafb tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/servers/8025dc38-59d4-4296-b2c7-5aebb08eacae" status: 200 len: 1499 microversion: 2.1 time: 0.507909 Jul 23 21:17:27.117385 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0e662421-2d49-48a4-8f1b-98c769c92a72 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:27.118774 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-0e662421-2d49-48a4-8f1b-98c769c92a72 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] [instance: 26494d1b-0e9c-45ac-90f7-55924a958e4c] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:27.125689 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 539/1049] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:26 2022] GET /compute/v2.1/servers/8025dc38-59d4-4296-b2c7-5aebb08eacae => generated 1499 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:27.128596 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0e662421-2d49-48a4-8f1b-98c769c92a72 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:27.129046 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0e662421-2d49-48a4-8f1b-98c769c92a72 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:27.130093 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0e662421-2d49-48a4-8f1b-98c769c92a72 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:27.130694 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0e662421-2d49-48a4-8f1b-98c769c92a72 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:27.207204 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-8eacad5a-f5a3-4d36-b18d-a77ac3ffcb4a tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:27.208143 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-8eacad5a-f5a3-4d36-b18d-a77ac3ffcb4a tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 760fa31f-a0cf-46df-b456-3af5dc7f9933] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:27.211075 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:17:27.222794 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8eacad5a-f5a3-4d36-b18d-a77ac3ffcb4a tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:27.225718 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8eacad5a-f5a3-4d36-b18d-a77ac3ffcb4a tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:27.229593 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8eacad5a-f5a3-4d36-b18d-a77ac3ffcb4a tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:27.230353 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8eacad5a-f5a3-4d36-b18d-a77ac3ffcb4a tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:27.446067 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-0e662421-2d49-48a4-8f1b-98c769c92a72 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f1a14a59b7401d88f18ec35c91e30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c17bd813264fb9891076799e33acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:27.454452 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-8eacad5a-f5a3-4d36-b18d-a77ac3ffcb4a tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:27.463074 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-0e662421-2d49-48a4-8f1b-98c769c92a72 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] 10.222.0.17 "GET /compute/v2.1/servers/26494d1b-0e9c-45ac-90f7-55924a958e4c" status: 200 len: 1711 microversion: 2.1 time: 0.353736 Jul 23 21:17:27.465924 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 511/1050] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:27 2022] GET /compute/v2.1/servers/26494d1b-0e9c-45ac-90f7-55924a958e4c => generated 1711 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:27.483269 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-8eacad5a-f5a3-4d36-b18d-a77ac3ffcb4a tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933" status: 200 len: 1542 microversion: 2.1 time: 0.280068 Jul 23 21:17:27.483733 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-366c0586-aca3-47b4-a706-d5b55a69d913 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:27.484944 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-366c0586-aca3-47b4-a706-d5b55a69d913 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: e346d31f-1498-49ff-8a58-0c607e41923e] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:27.485996 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 540/1051] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:27 2022] GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933 => generated 1542 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:17:27.500770 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-366c0586-aca3-47b4-a706-d5b55a69d913 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:27.502140 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-366c0586-aca3-47b4-a706-d5b55a69d913 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:27.503042 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-366c0586-aca3-47b4-a706-d5b55a69d913 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:27.509770 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-366c0586-aca3-47b4-a706-d5b55a69d913 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:27.822861 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-366c0586-aca3-47b4-a706-d5b55a69d913 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf92af08fa94215b4eafcacea6c63f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e7d37a0e3b4b32ae99c3bc15a831e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:27.832275 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-366c0586-aca3-47b4-a706-d5b55a69d913 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "GET /compute/v2.1/servers/e346d31f-1498-49ff-8a58-0c607e41923e" status: 200 len: 1317 microversion: 2.1 time: 0.363099 Jul 23 21:17:27.836615 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 512/1052] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:27 2022] GET /compute/v2.1/servers/e346d31f-1498-49ff-8a58-0c607e41923e => generated 1317 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:28.083452 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-8cba137f-ef08-411e-9a36-8879b5c94c32 req-7a32d286-2615-489d-b57e-03c0b087e3d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26494d1b-0e9c-45ac-90f7-55924a958e4c", "name": "network-vif-deleted", "tag": "c6aa3bed-afcf-4eb9-938d-ec89a16a6dab"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:17:28.102627 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-8cba137f-ef08-411e-9a36-8879b5c94c32 req-7a32d286-2615-489d-b57e-03c0b087e3d2 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:28.103389 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-8cba137f-ef08-411e-9a36-8879b5c94c32 req-7a32d286-2615-489d-b57e-03c0b087e3d2 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:28.118495 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-8cba137f-ef08-411e-9a36-8879b5c94c32 req-7a32d286-2615-489d-b57e-03c0b087e3d2 service nova] Creating event network-vif-deleted:c6aa3bed-afcf-4eb9-938d-ec89a16a6dab for instance 26494d1b-0e9c-45ac-90f7-55924a958e4c on nch2-master-1 Jul 23 21:17:28.125961 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-482bdd4e-66f0-4ca5-9983-0837a2c2fbe0 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:28.127697 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-482bdd4e-66f0-4ca5-9983-0837a2c2fbe0 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 34eaf1d2-9732-4c0e-b970-02fbb449514b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:28.144591 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-482bdd4e-66f0-4ca5-9983-0837a2c2fbe0 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:28.145051 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-482bdd4e-66f0-4ca5-9983-0837a2c2fbe0 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:28.145856 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-482bdd4e-66f0-4ca5-9983-0837a2c2fbe0 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:28.147023 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-8cba137f-ef08-411e-9a36-8879b5c94c32 req-7a32d286-2615-489d-b57e-03c0b087e3d2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068163 Jul 23 21:17:28.160979 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 541/1053] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:17:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:17:28.162668 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-482bdd4e-66f0-4ca5-9983-0837a2c2fbe0 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:28.181001 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-abc9061a-8b2a-4ab1-a372-4b4b59942213 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:28.184659 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-abc9061a-8b2a-4ab1-a372-4b4b59942213 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 8025dc38-59d4-4296-b2c7-5aebb08eacae] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:28.204248 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-abc9061a-8b2a-4ab1-a372-4b4b59942213 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:28.206378 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-abc9061a-8b2a-4ab1-a372-4b4b59942213 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:28.209376 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-abc9061a-8b2a-4ab1-a372-4b4b59942213 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:28.209907 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-abc9061a-8b2a-4ab1-a372-4b4b59942213 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:28.539369 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-abc9061a-8b2a-4ab1-a372-4b4b59942213 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4f9dda4c2a411cb0394bf86e9ae223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580ed681cbf44d10936259b17f60f1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:28.551703 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-abc9061a-8b2a-4ab1-a372-4b4b59942213 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/servers/8025dc38-59d4-4296-b2c7-5aebb08eacae" status: 200 len: 1499 microversion: 2.1 time: 0.386761 Jul 23 21:17:28.553200 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 542/1054] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:28 2022] GET /compute/v2.1/servers/8025dc38-59d4-4296-b2c7-5aebb08eacae => generated 1499 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:28.558182 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-9aef297a-7127-4aab-a995-4738ecc7b510 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:28.558851 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-9aef297a-7127-4aab-a995-4738ecc7b510 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] [instance: 26494d1b-0e9c-45ac-90f7-55924a958e4c] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:28.566874 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9aef297a-7127-4aab-a995-4738ecc7b510 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:28.567331 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9aef297a-7127-4aab-a995-4738ecc7b510 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:28.568644 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9aef297a-7127-4aab-a995-4738ecc7b510 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:28.569096 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9aef297a-7127-4aab-a995-4738ecc7b510 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:28.628959 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9aef297a-7127-4aab-a995-4738ecc7b510 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:28.629507 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9aef297a-7127-4aab-a995-4738ecc7b510 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:28.630066 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.objects.instance [None req-9aef297a-7127-4aab-a995-4738ecc7b510 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lazy-loading 'fault' on Instance uuid 26494d1b-0e9c-45ac-90f7-55924a958e4c {{(pid=131321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:17:28.681194 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-9aef297a-7127-4aab-a995-4738ecc7b510 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39f1a14a59b7401d88f18ec35c91e30a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c17bd813264fb9891076799e33acca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:28.692894 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-9aef297a-7127-4aab-a995-4738ecc7b510 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] 10.222.0.17 "GET /compute/v2.1/servers/26494d1b-0e9c-45ac-90f7-55924a958e4c" status: 200 len: 1351 microversion: 2.1 time: 0.138400 Jul 23 21:17:28.702362 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 543/1055] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:28 2022] GET /compute/v2.1/servers/26494d1b-0e9c-45ac-90f7-55924a958e4c => generated 1351 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:28.702362 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e6d8bd77-cb43-4f73-a3a2-a70ef61daf3b tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:28.702362 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-e6d8bd77-cb43-4f73-a3a2-a70ef61daf3b tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 760fa31f-a0cf-46df-b456-3af5dc7f9933] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:28.709444 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e6d8bd77-cb43-4f73-a3a2-a70ef61daf3b tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:28.710127 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e6d8bd77-cb43-4f73-a3a2-a70ef61daf3b tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:28.711122 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e6d8bd77-cb43-4f73-a3a2-a70ef61daf3b tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:28.712208 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e6d8bd77-cb43-4f73-a3a2-a70ef61daf3b tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:28.858009 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-482bdd4e-66f0-4ca5-9983-0837a2c2fbe0 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:28.883280 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-482bdd4e-66f0-4ca5-9983-0837a2c2fbe0 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/34eaf1d2-9732-4c0e-b970-02fbb449514b" status: 200 len: 1718 microversion: 2.1 time: 0.760728 Jul 23 21:17:28.885790 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 513/1056] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:28 2022] GET /compute/v2.1/servers/34eaf1d2-9732-4c0e-b970-02fbb449514b => generated 1718 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:17:28.897239 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-99b60c99-c930-4558-a31a-e8f70bd4d5a8 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:28.900016 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-99b60c99-c930-4558-a31a-e8f70bd4d5a8 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: e346d31f-1498-49ff-8a58-0c607e41923e] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:28.920366 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-99b60c99-c930-4558-a31a-e8f70bd4d5a8 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:28.922416 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-99b60c99-c930-4558-a31a-e8f70bd4d5a8 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:28.924578 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-99b60c99-c930-4558-a31a-e8f70bd4d5a8 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:28.926158 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-99b60c99-c930-4558-a31a-e8f70bd4d5a8 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:28.950455 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-e6d8bd77-cb43-4f73-a3a2-a70ef61daf3b tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:28.965669 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-e6d8bd77-cb43-4f73-a3a2-a70ef61daf3b tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933" status: 200 len: 1542 microversion: 2.1 time: 0.269246 Jul 23 21:17:28.976599 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 544/1057] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:28 2022] GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933 => generated 1542 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:29.572607 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a62fa9f9-ccb8-4bb5-a2c1-3ad0bc7267f3 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:29.574465 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-a62fa9f9-ccb8-4bb5-a2c1-3ad0bc7267f3 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 8025dc38-59d4-4296-b2c7-5aebb08eacae] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:29.586410 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a62fa9f9-ccb8-4bb5-a2c1-3ad0bc7267f3 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:29.590111 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a62fa9f9-ccb8-4bb5-a2c1-3ad0bc7267f3 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:29.593997 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a62fa9f9-ccb8-4bb5-a2c1-3ad0bc7267f3 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:29.595995 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a62fa9f9-ccb8-4bb5-a2c1-3ad0bc7267f3 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:29.801854 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-99b60c99-c930-4558-a31a-e8f70bd4d5a8 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf92af08fa94215b4eafcacea6c63f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e7d37a0e3b4b32ae99c3bc15a831e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:29.812378 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-99b60c99-c930-4558-a31a-e8f70bd4d5a8 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "GET /compute/v2.1/servers/e346d31f-1498-49ff-8a58-0c607e41923e" status: 200 len: 1466 microversion: 2.1 time: 0.925261 Jul 23 21:17:29.828584 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 514/1058] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:28 2022] GET /compute/v2.1/servers/e346d31f-1498-49ff-8a58-0c607e41923e => generated 1466 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:29.843766 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1441953e-8481-4248-8086-877b3a4eee8f tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:29.844394 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1441953e-8481-4248-8086-877b3a4eee8f tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] [instance: 26494d1b-0e9c-45ac-90f7-55924a958e4c] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:29.865173 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1441953e-8481-4248-8086-877b3a4eee8f tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:29.865625 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1441953e-8481-4248-8086-877b3a4eee8f tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:29.869732 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1441953e-8481-4248-8086-877b3a4eee8f tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:29.870560 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1441953e-8481-4248-8086-877b3a4eee8f tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:29.910772 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-1441953e-8481-4248-8086-877b3a4eee8f tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] HTTP exception thrown: Instance 26494d1b-0e9c-45ac-90f7-55924a958e4c could not be found. Jul 23 21:17:29.912779 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1441953e-8481-4248-8086-877b3a4eee8f tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Request method failure captured: Jul 23 21:17:29.912779 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/26494d1b-0e9c-45ac-90f7-55924a958e4c HTTP/1.1 Jul 23 21:17:29.912779 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:17:29.912779 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:17:29.912779 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:17:29.912779 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:17:29.912779 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:17:29.912779 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:17:29.912779 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:17:29.912779 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:17:29.912779 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GS7W_Qz0O8S72DOsPN0vtzp3rm_KIyrWpbu3vGcpxZc3lL1oeDqY1JXJP76rNS_fR3jdUMr3QL6xcb1hVcrAyUE4w-GFOGKF7TPWfQEnVl2dmqHRCQpVjTSkHFcvpvFq7yIRCtQGZhgGHKQQV6NmfEErSsL7YZBXmwL3j_FkLRDWm0 Jul 23 21:17:29.912779 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:17:29.912779 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:17:29.912779 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:17:29.912779 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:17:29.912779 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:17:29.912779 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:17:29.912779 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: d3c17bd813264fb9891076799e33acca Jul 23 21:17:29.912779 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1151584351 Jul 23 21:17:29.912779 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:17:29.912779 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:17:29.914303 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d3c17bd813264fb9891076799e33acca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d3c17bd813264fb9891076799e33acca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d3c17bd813264fb9891076799e33acca", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d3c17bd813264fb9891076799e33acca"}]}] Jul 23 21:17:29.914303 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1151584351 Jul 23 21:17:29.914303 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: d3c17bd813264fb9891076799e33acca Jul 23 21:17:29.914303 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1151584351 Jul 23 21:17:29.914303 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1151584351-project Jul 23 21:17:29.914303 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:17:29.914303 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:17:29.914303 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 39f1a14a59b7401d88f18ec35c91e30a Jul 23 21:17:29.914303 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1151584351-project Jul 23 21:17:29.914303 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:17:29.914303 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance 26494d1b-0e9c-45ac-90f7-55924a958e4c could not be found. Jul 23 21:17:29.914303 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '26494d1b-0e9c-45ac-90f7-55924a958e4c'} Jul 23 21:17:29.915163 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:17:29.915163 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:17:29.915163 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:17:29.915163 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:17:29.915163 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:17:29.915163 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:17:29.915163 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:17:29.915163 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:17:29.915163 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:17:29.915163 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:17:29.915163 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26494d1b-0e9c-45ac-90f7-55924a958e4c could not be found. Jul 23 21:17:29.915163 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:17:29.915163 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:17:29.915163 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:17:29.915163 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:17:29.915163 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:17:29.915163 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:17:29.915163 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:17:29.915163 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:17:29.915163 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:17:29.916397 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:17:29.916397 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:17:29.916397 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:17:29.916397 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:17:29.916397 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:17:29.916397 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:17:29.916397 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:17:29.916397 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26494d1b-0e9c-45ac-90f7-55924a958e4c could not be found. Jul 23 21:17:29.916397 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:17:29.916397 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:17:29.916397 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:17:29.916397 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:17:29.916397 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:17:29.916397 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:17:29.916397 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:17:29.916397 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:17:29.916397 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26494d1b-0e9c-45ac-90f7-55924a958e4c could not be found. Jul 23 21:17:29.916397 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:17:29.917497 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-a62fa9f9-ccb8-4bb5-a2c1-3ad0bc7267f3 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4f9dda4c2a411cb0394bf86e9ae223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580ed681cbf44d10936259b17f60f1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:29.921546 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1441953e-8481-4248-8086-877b3a4eee8f tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Returning 404 to user: Instance 26494d1b-0e9c-45ac-90f7-55924a958e4c could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:17:29.924670 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-a62fa9f9-ccb8-4bb5-a2c1-3ad0bc7267f3 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/servers/8025dc38-59d4-4296-b2c7-5aebb08eacae" status: 200 len: 1499 microversion: 2.1 time: 0.358968 Jul 23 21:17:29.925821 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1441953e-8481-4248-8086-877b3a4eee8f tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] 10.222.0.17 "GET /compute/v2.1/servers/26494d1b-0e9c-45ac-90f7-55924a958e4c" status: 404 len: 111 microversion: 2.1 time: 0.093795 Jul 23 21:17:29.926635 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 515/1059] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:29 2022] GET /compute/v2.1/servers/26494d1b-0e9c-45ac-90f7-55924a958e4c => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:17:29.928725 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 545/1060] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:29 2022] GET /compute/v2.1/servers/8025dc38-59d4-4296-b2c7-5aebb08eacae => generated 1499 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:29.934502 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-7e424e81-bd80-44b2-912d-84c9026ff0e8 tempest-ServersOnMultiNodesTest-1671986198 tempest-ServersOnMultiNodesTest-1671986198-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:29.940839 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-67b8a72a-0908-45ec-8652-910c0cd3eb0e tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:29.941080 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-67b8a72a-0908-45ec-8652-910c0cd3eb0e tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 34eaf1d2-9732-4c0e-b970-02fbb449514b] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:29.942319 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-7e424e81-bd80-44b2-912d-84c9026ff0e8 tempest-ServersOnMultiNodesTest-1671986198 tempest-ServersOnMultiNodesTest-1671986198-project-admin] [instance: e346d31f-1498-49ff-8a58-0c607e41923e] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:29.955710 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7e424e81-bd80-44b2-912d-84c9026ff0e8 tempest-ServersOnMultiNodesTest-1671986198 tempest-ServersOnMultiNodesTest-1671986198-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:29.958465 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7e424e81-bd80-44b2-912d-84c9026ff0e8 tempest-ServersOnMultiNodesTest-1671986198 tempest-ServersOnMultiNodesTest-1671986198-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:29.959451 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7e424e81-bd80-44b2-912d-84c9026ff0e8 tempest-ServersOnMultiNodesTest-1671986198 tempest-ServersOnMultiNodesTest-1671986198-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:29.960046 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7e424e81-bd80-44b2-912d-84c9026ff0e8 tempest-ServersOnMultiNodesTest-1671986198 tempest-ServersOnMultiNodesTest-1671986198-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:29.963729 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-67b8a72a-0908-45ec-8652-910c0cd3eb0e tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:29.964231 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-67b8a72a-0908-45ec-8652-910c0cd3eb0e tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:29.965044 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-67b8a72a-0908-45ec-8652-910c0cd3eb0e tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:29.965484 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-67b8a72a-0908-45ec-8652-910c0cd3eb0e tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:30.247779 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-67b8a72a-0908-45ec-8652-910c0cd3eb0e tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:30.259671 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-67b8a72a-0908-45ec-8652-910c0cd3eb0e tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/34eaf1d2-9732-4c0e-b970-02fbb449514b" status: 200 len: 1718 microversion: 2.1 time: 0.329806 Jul 23 21:17:30.278625 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 546/1061] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:29 2022] GET /compute/v2.1/servers/34eaf1d2-9732-4c0e-b970-02fbb449514b => generated 1718 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:30.279183 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-6fd83e95-ce0f-4937-8ed2-12f78af4a804 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:30.279692 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-6fd83e95-ce0f-4937-8ed2-12f78af4a804 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] [instance: fc41b6cc-f603-4f7d-89cb-a7e3cee372a5] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:30.294718 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6fd83e95-ce0f-4937-8ed2-12f78af4a804 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:30.295174 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6fd83e95-ce0f-4937-8ed2-12f78af4a804 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:30.313323 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6fd83e95-ce0f-4937-8ed2-12f78af4a804 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:30.314121 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6fd83e95-ce0f-4937-8ed2-12f78af4a804 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:30.330214 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-6fd83e95-ce0f-4937-8ed2-12f78af4a804 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] HTTP exception thrown: Instance fc41b6cc-f603-4f7d-89cb-a7e3cee372a5 could not be found. Jul 23 21:17:30.332472 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-6fd83e95-ce0f-4937-8ed2-12f78af4a804 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Request method failure captured: Jul 23 21:17:30.332472 ncdv-master-1 devstack@n-api.service[131321]: request: DELETE /compute/v2.1/servers/fc41b6cc-f603-4f7d-89cb-a7e3cee372a5 HTTP/1.1 Jul 23 21:17:30.332472 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:17:30.332472 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:17:30.332472 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:17:30.332472 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:17:30.332472 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:17:30.332472 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:17:30.332472 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:17:30.332472 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:17:30.332472 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GS7W_Qz0O8S72DOsPN0vtzp3rm_KIyrWpbu3vGcpxZc3lL1oeDqY1JXJP76rNS_fR3jdUMr3QL6xcb1hVcrAyUE4w-GFOGKF7TPWfQEnVl2dmqHRCQpVjTSkHFcvpvFq7yIRCtQGZhgGHKQQV6NmfEErSsL7YZBXmwL3j_FkLRDWm0 Jul 23 21:17:30.332472 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:17:30.332472 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:17:30.332472 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:17:30.332472 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:17:30.332472 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:17:30.332472 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:17:30.332472 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: d3c17bd813264fb9891076799e33acca Jul 23 21:17:30.332472 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1151584351 Jul 23 21:17:30.332472 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:17:30.332472 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:17:30.333753 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d3c17bd813264fb9891076799e33acca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d3c17bd813264fb9891076799e33acca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d3c17bd813264fb9891076799e33acca", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d3c17bd813264fb9891076799e33acca"}]}] Jul 23 21:17:30.333753 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1151584351 Jul 23 21:17:30.333753 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: d3c17bd813264fb9891076799e33acca Jul 23 21:17:30.333753 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1151584351 Jul 23 21:17:30.333753 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1151584351-project Jul 23 21:17:30.333753 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:17:30.333753 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:17:30.333753 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 39f1a14a59b7401d88f18ec35c91e30a Jul 23 21:17:30.333753 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1151584351-project Jul 23 21:17:30.333753 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:17:30.333753 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance fc41b6cc-f603-4f7d-89cb-a7e3cee372a5 could not be found. Jul 23 21:17:30.333753 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': 'fc41b6cc-f603-4f7d-89cb-a7e3cee372a5'} Jul 23 21:17:30.334876 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:17:30.334876 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:17:30.334876 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:17:30.334876 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:17:30.334876 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:17:30.334876 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:17:30.334876 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:17:30.334876 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:17:30.334876 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:17:30.334876 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:17:30.334876 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc41b6cc-f603-4f7d-89cb-a7e3cee372a5 could not be found. Jul 23 21:17:30.334876 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:17:30.334876 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:17:30.334876 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:17:30.334876 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:17:30.334876 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:17:30.334876 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:17:30.334876 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:17:30.334876 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:17:30.334876 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:17:30.336225 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:17:30.336225 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 23 21:17:30.336225 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 23 21:17:30.336225 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 23 21:17:30.336225 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 23 21:17:30.336225 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:17:30.336225 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:17:30.336225 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:17:30.336225 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:17:30.336225 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc41b6cc-f603-4f7d-89cb-a7e3cee372a5 could not be found. Jul 23 21:17:30.336225 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:17:30.336225 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:17:30.336225 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:17:30.336225 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:17:30.336225 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:17:30.336225 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:17:30.336225 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:17:30.336225 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:17:30.336225 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc41b6cc-f603-4f7d-89cb-a7e3cee372a5 could not be found. Jul 23 21:17:30.336225 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:17:30.337649 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-6fd83e95-ce0f-4937-8ed2-12f78af4a804 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Returning 404 to user: Instance fc41b6cc-f603-4f7d-89cb-a7e3cee372a5 could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:17:30.337649 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-6fd83e95-ce0f-4937-8ed2-12f78af4a804 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] 10.222.0.17 "DELETE /compute/v2.1/servers/fc41b6cc-f603-4f7d-89cb-a7e3cee372a5" status: 404 len: 111 microversion: 2.1 time: 0.062915 Jul 23 21:17:30.337649 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 547/1062] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:17:30 2022] DELETE /compute/v2.1/servers/fc41b6cc-f603-4f7d-89cb-a7e3cee372a5 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:17:30.341391 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-b9f36a12-9d75-4c66-8dee-aacbad347fb1 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:30.342555 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-b9f36a12-9d75-4c66-8dee-aacbad347fb1 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 760fa31f-a0cf-46df-b456-3af5dc7f9933] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:30.353087 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b9f36a12-9d75-4c66-8dee-aacbad347fb1 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:30.353751 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b9f36a12-9d75-4c66-8dee-aacbad347fb1 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:30.354667 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b9f36a12-9d75-4c66-8dee-aacbad347fb1 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:30.355116 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b9f36a12-9d75-4c66-8dee-aacbad347fb1 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:30.429518 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-7e424e81-bd80-44b2-912d-84c9026ff0e8 tempest-ServersOnMultiNodesTest-1671986198 tempest-ServersOnMultiNodesTest-1671986198-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/e346d31f-1498-49ff-8a58-0c607e41923e" status: 200 len: 1617 microversion: 2.1 time: 0.501587 Jul 23 21:17:30.430147 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 516/1063] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:29 2022] GET /compute/v2.1/servers/e346d31f-1498-49ff-8a58-0c607e41923e => generated 1617 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:30.457895 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e6271e48-f77d-476c-9d9f-a0bf2aaa4cb5 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:30.463716 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e6271e48-f77d-476c-9d9f-a0bf2aaa4cb5 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] [instance: fc41b6cc-f603-4f7d-89cb-a7e3cee372a5] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:30.479749 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e6271e48-f77d-476c-9d9f-a0bf2aaa4cb5 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:30.484454 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e6271e48-f77d-476c-9d9f-a0bf2aaa4cb5 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:30.485549 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e6271e48-f77d-476c-9d9f-a0bf2aaa4cb5 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:30.486997 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e6271e48-f77d-476c-9d9f-a0bf2aaa4cb5 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:30.531164 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-e6271e48-f77d-476c-9d9f-a0bf2aaa4cb5 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] HTTP exception thrown: Instance fc41b6cc-f603-4f7d-89cb-a7e3cee372a5 could not be found. Jul 23 21:17:30.541189 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e6271e48-f77d-476c-9d9f-a0bf2aaa4cb5 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Request method failure captured: Jul 23 21:17:30.541189 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/fc41b6cc-f603-4f7d-89cb-a7e3cee372a5 HTTP/1.1 Jul 23 21:17:30.541189 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:17:30.541189 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:17:30.541189 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:17:30.541189 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:17:30.541189 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:17:30.541189 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:17:30.541189 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:17:30.541189 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:17:30.541189 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GS7W_Qz0O8S72DOsPN0vtzp3rm_KIyrWpbu3vGcpxZc3lL1oeDqY1JXJP76rNS_fR3jdUMr3QL6xcb1hVcrAyUE4w-GFOGKF7TPWfQEnVl2dmqHRCQpVjTSkHFcvpvFq7yIRCtQGZhgGHKQQV6NmfEErSsL7YZBXmwL3j_FkLRDWm0 Jul 23 21:17:30.541189 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:17:30.541189 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:17:30.541189 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:17:30.541189 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:17:30.541189 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:17:30.541189 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:17:30.541189 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: d3c17bd813264fb9891076799e33acca Jul 23 21:17:30.541189 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1151584351 Jul 23 21:17:30.541189 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:17:30.541189 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:17:30.542648 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d3c17bd813264fb9891076799e33acca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d3c17bd813264fb9891076799e33acca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d3c17bd813264fb9891076799e33acca", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d3c17bd813264fb9891076799e33acca"}]}] Jul 23 21:17:30.542648 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1151584351 Jul 23 21:17:30.542648 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: d3c17bd813264fb9891076799e33acca Jul 23 21:17:30.542648 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1151584351 Jul 23 21:17:30.542648 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1151584351-project Jul 23 21:17:30.542648 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:17:30.542648 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:17:30.542648 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 39f1a14a59b7401d88f18ec35c91e30a Jul 23 21:17:30.542648 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1151584351-project Jul 23 21:17:30.542648 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:17:30.542648 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance fc41b6cc-f603-4f7d-89cb-a7e3cee372a5 could not be found. Jul 23 21:17:30.542648 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': 'fc41b6cc-f603-4f7d-89cb-a7e3cee372a5'} Jul 23 21:17:30.543366 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:17:30.543366 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:17:30.543366 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:17:30.543366 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:17:30.543366 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:17:30.543366 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:17:30.543366 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:17:30.543366 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:17:30.543366 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:17:30.543366 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:17:30.543366 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc41b6cc-f603-4f7d-89cb-a7e3cee372a5 could not be found. Jul 23 21:17:30.543366 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:17:30.543366 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:17:30.543366 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:17:30.543366 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:17:30.543366 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:17:30.543366 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:17:30.543366 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:17:30.543366 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:17:30.543366 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:17:30.544563 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:17:30.544563 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:17:30.544563 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:17:30.544563 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:17:30.544563 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:17:30.544563 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:17:30.544563 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:17:30.544563 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc41b6cc-f603-4f7d-89cb-a7e3cee372a5 could not be found. Jul 23 21:17:30.544563 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:17:30.544563 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:17:30.544563 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:17:30.544563 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:17:30.544563 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:17:30.544563 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:17:30.544563 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:17:30.544563 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:17:30.544563 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc41b6cc-f603-4f7d-89cb-a7e3cee372a5 could not be found. Jul 23 21:17:30.544563 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:17:30.556469 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e6271e48-f77d-476c-9d9f-a0bf2aaa4cb5 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Returning 404 to user: Instance fc41b6cc-f603-4f7d-89cb-a7e3cee372a5 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:17:30.560654 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e6271e48-f77d-476c-9d9f-a0bf2aaa4cb5 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] 10.222.0.17 "GET /compute/v2.1/servers/fc41b6cc-f603-4f7d-89cb-a7e3cee372a5" status: 404 len: 111 microversion: 2.1 time: 0.109427 Jul 23 21:17:30.562924 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 517/1064] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:30 2022] GET /compute/v2.1/servers/fc41b6cc-f603-4f7d-89cb-a7e3cee372a5 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:17:30.574157 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-811d8be5-2597-428c-b23f-b39a38d30a92 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:30.575023 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-811d8be5-2597-428c-b23f-b39a38d30a92 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: e346d31f-1498-49ff-8a58-0c607e41923e] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:30.588944 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-811d8be5-2597-428c-b23f-b39a38d30a92 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:30.591075 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-811d8be5-2597-428c-b23f-b39a38d30a92 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:30.591960 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-b9f36a12-9d75-4c66-8dee-aacbad347fb1 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:30.593412 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-811d8be5-2597-428c-b23f-b39a38d30a92 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:30.596184 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-811d8be5-2597-428c-b23f-b39a38d30a92 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:30.605632 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-b9f36a12-9d75-4c66-8dee-aacbad347fb1 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933" status: 200 len: 1542 microversion: 2.1 time: 0.265728 Jul 23 21:17:30.612195 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 548/1065] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:30 2022] GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933 => generated 1542 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:30.628731 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a4148b9a-5635-4440-9600-2311f83e2408 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Calling method '.version_select at 0x7f0b47f7d670>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:30.673125 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-a4148b9a-5635-4440-9600-2311f83e2408 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-69753320" status: 202 len: 0 microversion: 2.1 time: 0.058312 Jul 23 21:17:30.677658 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 549/1066] 10.222.0.17 () {58 vars in 1214 bytes} [Sat Jul 23 21:17:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-69753320 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:17:30.685833 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-811d8be5-2597-428c-b23f-b39a38d30a92 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: e346d31f-1498-49ff-8a58-0c607e41923e] Going to try to terminate instance {{(pid=131320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:17:30.814849 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:17:30.832268 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-811d8be5-2597-428c-b23f-b39a38d30a92 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "DELETE /compute/v2.1/servers/e346d31f-1498-49ff-8a58-0c607e41923e" status: 204 len: 0 microversion: 2.1 time: 0.264883 Jul 23 21:17:30.833529 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 518/1067] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:17:30 2022] DELETE /compute/v2.1/servers/e346d31f-1498-49ff-8a58-0c607e41923e => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:17:30.845299 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-387e217a-f1a7-4275-8def-b13e45f2826d tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:30.846234 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-387e217a-f1a7-4275-8def-b13e45f2826d tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: e346d31f-1498-49ff-8a58-0c607e41923e] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:30.856763 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-387e217a-f1a7-4275-8def-b13e45f2826d tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:30.857378 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-387e217a-f1a7-4275-8def-b13e45f2826d tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:30.858776 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-387e217a-f1a7-4275-8def-b13e45f2826d tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:30.859350 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-387e217a-f1a7-4275-8def-b13e45f2826d tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:30.943677 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ef2bfa64-c9e9-48f9-b116-af478948dec8 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:30.944665 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ef2bfa64-c9e9-48f9-b116-af478948dec8 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 8025dc38-59d4-4296-b2c7-5aebb08eacae] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:30.962502 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ef2bfa64-c9e9-48f9-b116-af478948dec8 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:30.963655 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ef2bfa64-c9e9-48f9-b116-af478948dec8 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:30.964631 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ef2bfa64-c9e9-48f9-b116-af478948dec8 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:30.965272 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ef2bfa64-c9e9-48f9-b116-af478948dec8 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:31.318577 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-387e217a-f1a7-4275-8def-b13e45f2826d tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf92af08fa94215b4eafcacea6c63f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e7d37a0e3b4b32ae99c3bc15a831e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:31.327737 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-387e217a-f1a7-4275-8def-b13e45f2826d tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "GET /compute/v2.1/servers/e346d31f-1498-49ff-8a58-0c607e41923e" status: 200 len: 1472 microversion: 2.1 time: 0.488275 Jul 23 21:17:31.332357 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 550/1068] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:30 2022] GET /compute/v2.1/servers/e346d31f-1498-49ff-8a58-0c607e41923e => generated 1472 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:31.358045 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-5c51fc51-7684-40d8-90f8-38eff92fcae7 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:31.359364 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-5c51fc51-7684-40d8-90f8-38eff92fcae7 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 34eaf1d2-9732-4c0e-b970-02fbb449514b] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:31.371340 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5c51fc51-7684-40d8-90f8-38eff92fcae7 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:31.380335 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5c51fc51-7684-40d8-90f8-38eff92fcae7 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:31.381436 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5c51fc51-7684-40d8-90f8-38eff92fcae7 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:31.386905 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5c51fc51-7684-40d8-90f8-38eff92fcae7 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:31.504049 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=100 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:17:31.606289 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ef2bfa64-c9e9-48f9-b116-af478948dec8 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4f9dda4c2a411cb0394bf86e9ae223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580ed681cbf44d10936259b17f60f1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:31.638705 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ef2bfa64-c9e9-48f9-b116-af478948dec8 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/servers/8025dc38-59d4-4296-b2c7-5aebb08eacae" status: 200 len: 1499 microversion: 2.1 time: 0.700520 Jul 23 21:17:31.642245 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 519/1069] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:30 2022] GET /compute/v2.1/servers/8025dc38-59d4-4296-b2c7-5aebb08eacae => generated 1499 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:31.656663 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1e475a50-0607-471a-94cc-6173cd08424b tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:31.657531 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1e475a50-0607-471a-94cc-6173cd08424b tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 760fa31f-a0cf-46df-b456-3af5dc7f9933] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:31.696090 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1e475a50-0607-471a-94cc-6173cd08424b tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:31.697925 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1e475a50-0607-471a-94cc-6173cd08424b tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:31.699039 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1e475a50-0607-471a-94cc-6173cd08424b tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:31.703287 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1e475a50-0607-471a-94cc-6173cd08424b tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:32.062129 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-1e475a50-0607-471a-94cc-6173cd08424b tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:32.075877 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1e475a50-0607-471a-94cc-6173cd08424b tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933" status: 200 len: 1542 microversion: 2.1 time: 0.432029 Jul 23 21:17:32.077427 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 520/1070] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:31 2022] GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933 => generated 1542 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:32.353635 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3ddc7eb8-aad7-4eda-a413-fa93f260c492 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:32.361547 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-3ddc7eb8-aad7-4eda-a413-fa93f260c492 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: e346d31f-1498-49ff-8a58-0c607e41923e] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:32.393398 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3ddc7eb8-aad7-4eda-a413-fa93f260c492 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:32.393952 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3ddc7eb8-aad7-4eda-a413-fa93f260c492 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:32.394671 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3ddc7eb8-aad7-4eda-a413-fa93f260c492 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:32.395112 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3ddc7eb8-aad7-4eda-a413-fa93f260c492 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:32.448751 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-5c51fc51-7684-40d8-90f8-38eff92fcae7 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:32.478613 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-5c51fc51-7684-40d8-90f8-38eff92fcae7 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/34eaf1d2-9732-4c0e-b970-02fbb449514b" status: 200 len: 1718 microversion: 2.1 time: 1.142461 Jul 23 21:17:32.497905 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 551/1071] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:31 2022] GET /compute/v2.1/servers/34eaf1d2-9732-4c0e-b970-02fbb449514b => generated 1718 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:32.662917 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-0102ca0f-fd83-4bc1-ba1f-ade4d2776cf0 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:32.665001 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-0102ca0f-fd83-4bc1-ba1f-ade4d2776cf0 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 8025dc38-59d4-4296-b2c7-5aebb08eacae] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:32.679621 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0102ca0f-fd83-4bc1-ba1f-ade4d2776cf0 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:32.680257 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0102ca0f-fd83-4bc1-ba1f-ade4d2776cf0 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:32.681389 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0102ca0f-fd83-4bc1-ba1f-ade4d2776cf0 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:32.683556 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0102ca0f-fd83-4bc1-ba1f-ade4d2776cf0 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:33.102156 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-0102ca0f-fd83-4bc1-ba1f-ade4d2776cf0 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4f9dda4c2a411cb0394bf86e9ae223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580ed681cbf44d10936259b17f60f1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:33.113957 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-0102ca0f-fd83-4bc1-ba1f-ade4d2776cf0 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/servers/8025dc38-59d4-4296-b2c7-5aebb08eacae" status: 200 len: 1499 microversion: 2.1 time: 0.460784 Jul 23 21:17:33.126579 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 552/1072] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:32 2022] GET /compute/v2.1/servers/8025dc38-59d4-4296-b2c7-5aebb08eacae => generated 1499 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:17:33.132066 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a7434a53-60d1-4b48-bc8b-a40c9543794a tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:33.136729 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-a7434a53-60d1-4b48-bc8b-a40c9543794a tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 760fa31f-a0cf-46df-b456-3af5dc7f9933] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:33.147356 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-3ddc7eb8-aad7-4eda-a413-fa93f260c492 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf92af08fa94215b4eafcacea6c63f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e7d37a0e3b4b32ae99c3bc15a831e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:33.150184 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a7434a53-60d1-4b48-bc8b-a40c9543794a tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:33.150776 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a7434a53-60d1-4b48-bc8b-a40c9543794a tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:33.151682 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a7434a53-60d1-4b48-bc8b-a40c9543794a tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:33.153822 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a7434a53-60d1-4b48-bc8b-a40c9543794a tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:33.165292 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-3ddc7eb8-aad7-4eda-a413-fa93f260c492 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "GET /compute/v2.1/servers/e346d31f-1498-49ff-8a58-0c607e41923e" status: 200 len: 1472 microversion: 2.1 time: 0.820128 Jul 23 21:17:33.170154 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 521/1073] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:32 2022] GET /compute/v2.1/servers/e346d31f-1498-49ff-8a58-0c607e41923e => generated 1472 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:17:33.377901 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-fd4804f5-f843-499e-81c0-48ae994d9e57 tempest-ServersWithSpecificFlavorTestJSON-1083796490 tempest-ServersWithSpecificFlavorTestJSON-1083796490-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:33.379058 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:17:33.379058 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:17:33.411773 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-fd4804f5-f843-499e-81c0-48ae994d9e57 tempest-ServersWithSpecificFlavorTestJSON-1083796490 tempest-ServersWithSpecificFlavorTestJSON-1083796490-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/1416912473" status: 202 len: 0 microversion: 2.1 time: 0.039165 Jul 23 21:17:33.413058 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 522/1074] 10.222.0.17 () {58 vars in 1160 bytes} [Sat Jul 23 21:17:33 2022] DELETE /compute/v2.1/flavors/1416912473 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 23 21:17:33.449819 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b33478f6-3028-42dd-b062-1c6f338f7133 tempest-ServersWithSpecificFlavorTestJSON-1083796490 tempest-ServersWithSpecificFlavorTestJSON-1083796490-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:33.523410 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b33478f6-3028-42dd-b062-1c6f338f7133 tempest-ServersWithSpecificFlavorTestJSON-1083796490 tempest-ServersWithSpecificFlavorTestJSON-1083796490-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 5403 microversion: 2.1 time: 0.082750 Jul 23 21:17:33.525098 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 523/1075] 10.222.0.17 () {58 vars in 1145 bytes} [Sat Jul 23 21:17:33 2022] GET /compute/v2.1/flavors/detail => generated 5403 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:33.531054 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b9567681-86fe-4212-bc50-aa31571e993e tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:33.531804 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b9567681-86fe-4212-bc50-aa31571e993e tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 34eaf1d2-9732-4c0e-b970-02fbb449514b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:33.547233 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b9567681-86fe-4212-bc50-aa31571e993e tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:33.548011 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b9567681-86fe-4212-bc50-aa31571e993e tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:33.549139 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b9567681-86fe-4212-bc50-aa31571e993e tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:33.550045 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b9567681-86fe-4212-bc50-aa31571e993e tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:33.808795 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b9567681-86fe-4212-bc50-aa31571e993e tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:33.820368 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b9567681-86fe-4212-bc50-aa31571e993e tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/34eaf1d2-9732-4c0e-b970-02fbb449514b" status: 200 len: 1718 microversion: 2.1 time: 0.294048 Jul 23 21:17:33.824170 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-a7434a53-60d1-4b48-bc8b-a40c9543794a tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:33.832934 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 524/1076] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:33 2022] GET /compute/v2.1/servers/34eaf1d2-9732-4c0e-b970-02fbb449514b => generated 1718 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:33.841298 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f4a0900b-a597-4421-a167-8684d2f9fb45 tempest-ServersWithSpecificFlavorTestJSON-1083796490 tempest-ServersWithSpecificFlavorTestJSON-1083796490-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:33.841723 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-a7434a53-60d1-4b48-bc8b-a40c9543794a tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933" status: 200 len: 1542 microversion: 2.1 time: 0.709320 Jul 23 21:17:33.842595 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 553/1077] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:33 2022] GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933 => generated 1542 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:33.844886 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:17:33.844886 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:17:33.861200 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-dced4303-00a8-431d-beb6-05911e1005de req-ab15c1e2-2021-4fff-9ac6-d07d84c8305b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34eaf1d2-9732-4c0e-b970-02fbb449514b", "name": "network-vif-unplugged", "status": "completed", "tag": "b09648fa-0071-4d7d-ba66-d0da81ab9768"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:17:33.881931 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f4a0900b-a597-4421-a167-8684d2f9fb45 tempest-ServersWithSpecificFlavorTestJSON-1083796490 tempest-ServersWithSpecificFlavorTestJSON-1083796490-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/231097847" status: 202 len: 0 microversion: 2.1 time: 0.046802 Jul 23 21:17:33.882841 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 525/1078] 10.222.0.17 () {58 vars in 1157 bytes} [Sat Jul 23 21:17:33 2022] DELETE /compute/v2.1/flavors/231097847 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:17:33.886851 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-dced4303-00a8-431d-beb6-05911e1005de req-ab15c1e2-2021-4fff-9ac6-d07d84c8305b service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:33.887310 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-dced4303-00a8-431d-beb6-05911e1005de req-ab15c1e2-2021-4fff-9ac6-d07d84c8305b service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:33.891496 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-51905211-a032-4921-9ba0-7c7816ad8dce tempest-ServersWithSpecificFlavorTestJSON-1083796490 tempest-ServersWithSpecificFlavorTestJSON-1083796490-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:33.921665 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-dced4303-00a8-431d-beb6-05911e1005de req-ab15c1e2-2021-4fff-9ac6-d07d84c8305b service nova] Creating event network-vif-unplugged:b09648fa-0071-4d7d-ba66-d0da81ab9768 for instance 34eaf1d2-9732-4c0e-b970-02fbb449514b on nch2-master-1 Jul 23 21:17:33.931089 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-dced4303-00a8-431d-beb6-05911e1005de req-ab15c1e2-2021-4fff-9ac6-d07d84c8305b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.087017 Jul 23 21:17:33.934620 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 554/1079] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:17:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:17:33.938430 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-51905211-a032-4921-9ba0-7c7816ad8dce tempest-ServersWithSpecificFlavorTestJSON-1083796490 tempest-ServersWithSpecificFlavorTestJSON-1083796490-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.048513 Jul 23 21:17:33.939540 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 526/1080] 10.222.0.17 () {58 vars in 1145 bytes} [Sat Jul 23 21:17:33 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:33.993910 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c272ac41-5ded-4bc2-9056-2f23b0a1e59b tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:33.994576 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-c272ac41-5ded-4bc2-9056-2f23b0a1e59b tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] [instance: 26494d1b-0e9c-45ac-90f7-55924a958e4c] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:34.004075 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c272ac41-5ded-4bc2-9056-2f23b0a1e59b tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:34.005852 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c272ac41-5ded-4bc2-9056-2f23b0a1e59b tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:34.009019 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c272ac41-5ded-4bc2-9056-2f23b0a1e59b tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:34.016932 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c272ac41-5ded-4bc2-9056-2f23b0a1e59b tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:34.059129 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-c272ac41-5ded-4bc2-9056-2f23b0a1e59b tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] HTTP exception thrown: Instance 26494d1b-0e9c-45ac-90f7-55924a958e4c could not be found. Jul 23 21:17:34.063756 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c272ac41-5ded-4bc2-9056-2f23b0a1e59b tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Request method failure captured: Jul 23 21:17:34.063756 ncdv-master-1 devstack@n-api.service[131321]: request: DELETE /compute/v2.1/servers/26494d1b-0e9c-45ac-90f7-55924a958e4c HTTP/1.1 Jul 23 21:17:34.063756 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:17:34.063756 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:17:34.063756 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:17:34.063756 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:17:34.063756 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:17:34.063756 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:17:34.063756 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:17:34.063756 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:17:34.063756 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GS7W_Qz0O8S72DOsPN0vtzp3rm_KIyrWpbu3vGcpxZc3lL1oeDqY1JXJP76rNS_fR3jdUMr3QL6xcb1hVcrAyUE4w-GFOGKF7TPWfQEnVl2dmqHRCQpVjTSkHFcvpvFq7yIRCtQGZhgGHKQQV6NmfEErSsL7YZBXmwL3j_FkLRDWm0 Jul 23 21:17:34.063756 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:17:34.063756 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:17:34.063756 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:17:34.063756 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:17:34.063756 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:17:34.063756 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:17:34.063756 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: d3c17bd813264fb9891076799e33acca Jul 23 21:17:34.063756 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1151584351 Jul 23 21:17:34.063756 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:17:34.063756 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:17:34.065276 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d3c17bd813264fb9891076799e33acca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d3c17bd813264fb9891076799e33acca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d3c17bd813264fb9891076799e33acca", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d3c17bd813264fb9891076799e33acca"}]}] Jul 23 21:17:34.065276 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1151584351 Jul 23 21:17:34.065276 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: d3c17bd813264fb9891076799e33acca Jul 23 21:17:34.065276 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1151584351 Jul 23 21:17:34.065276 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1151584351-project Jul 23 21:17:34.065276 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:17:34.065276 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:17:34.065276 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 39f1a14a59b7401d88f18ec35c91e30a Jul 23 21:17:34.065276 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1151584351-project Jul 23 21:17:34.065276 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:17:34.065276 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance 26494d1b-0e9c-45ac-90f7-55924a958e4c could not be found. Jul 23 21:17:34.065276 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': '26494d1b-0e9c-45ac-90f7-55924a958e4c'} Jul 23 21:17:34.067179 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:17:34.067179 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:17:34.067179 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:17:34.067179 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:17:34.067179 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:17:34.067179 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:17:34.067179 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:17:34.067179 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:17:34.067179 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:17:34.067179 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:17:34.067179 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26494d1b-0e9c-45ac-90f7-55924a958e4c could not be found. Jul 23 21:17:34.067179 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:17:34.067179 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:17:34.067179 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:17:34.067179 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:17:34.067179 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:17:34.067179 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:17:34.067179 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:17:34.067179 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:17:34.067179 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:17:34.069217 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:17:34.069217 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 23 21:17:34.069217 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 23 21:17:34.069217 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 23 21:17:34.069217 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 23 21:17:34.069217 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:17:34.069217 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:17:34.069217 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:17:34.069217 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:17:34.069217 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26494d1b-0e9c-45ac-90f7-55924a958e4c could not be found. Jul 23 21:17:34.069217 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:17:34.069217 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:17:34.069217 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:17:34.069217 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:17:34.069217 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:17:34.069217 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:17:34.069217 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:17:34.069217 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:17:34.069217 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26494d1b-0e9c-45ac-90f7-55924a958e4c could not be found. Jul 23 21:17:34.069217 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:17:34.075893 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c272ac41-5ded-4bc2-9056-2f23b0a1e59b tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Returning 404 to user: Instance 26494d1b-0e9c-45ac-90f7-55924a958e4c could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:17:34.080327 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-c272ac41-5ded-4bc2-9056-2f23b0a1e59b tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] 10.222.0.17 "DELETE /compute/v2.1/servers/26494d1b-0e9c-45ac-90f7-55924a958e4c" status: 404 len: 111 microversion: 2.1 time: 0.092147 Jul 23 21:17:34.083180 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 555/1081] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:17:33 2022] DELETE /compute/v2.1/servers/26494d1b-0e9c-45ac-90f7-55924a958e4c => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:17:34.091790 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-42a1b90b-75a3-44a7-8cc5-96ce1018d30b tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:34.092942 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-42a1b90b-75a3-44a7-8cc5-96ce1018d30b tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] [instance: 26494d1b-0e9c-45ac-90f7-55924a958e4c] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:34.116346 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-42a1b90b-75a3-44a7-8cc5-96ce1018d30b tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:34.116912 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-42a1b90b-75a3-44a7-8cc5-96ce1018d30b tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:34.117766 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-42a1b90b-75a3-44a7-8cc5-96ce1018d30b tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:34.118292 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-42a1b90b-75a3-44a7-8cc5-96ce1018d30b tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:34.150761 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d6141ed8-7e9e-46da-8e72-50825269a65b tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:34.151504 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-d6141ed8-7e9e-46da-8e72-50825269a65b tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 8025dc38-59d4-4296-b2c7-5aebb08eacae] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:34.169826 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d6141ed8-7e9e-46da-8e72-50825269a65b tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:34.173173 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d6141ed8-7e9e-46da-8e72-50825269a65b tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:34.181772 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d6141ed8-7e9e-46da-8e72-50825269a65b tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:34.183415 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d6141ed8-7e9e-46da-8e72-50825269a65b tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:34.193689 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-42a1b90b-75a3-44a7-8cc5-96ce1018d30b tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] HTTP exception thrown: Instance 26494d1b-0e9c-45ac-90f7-55924a958e4c could not be found. Jul 23 21:17:34.197457 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-42a1b90b-75a3-44a7-8cc5-96ce1018d30b tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Request method failure captured: Jul 23 21:17:34.197457 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/26494d1b-0e9c-45ac-90f7-55924a958e4c HTTP/1.1 Jul 23 21:17:34.197457 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:17:34.197457 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:17:34.197457 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:17:34.197457 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:17:34.197457 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:17:34.197457 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:17:34.197457 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:17:34.197457 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:17:34.197457 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GS7W_Qz0O8S72DOsPN0vtzp3rm_KIyrWpbu3vGcpxZc3lL1oeDqY1JXJP76rNS_fR3jdUMr3QL6xcb1hVcrAyUE4w-GFOGKF7TPWfQEnVl2dmqHRCQpVjTSkHFcvpvFq7yIRCtQGZhgGHKQQV6NmfEErSsL7YZBXmwL3j_FkLRDWm0 Jul 23 21:17:34.197457 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:17:34.197457 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:17:34.197457 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:17:34.197457 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:17:34.197457 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:17:34.197457 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:17:34.197457 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: d3c17bd813264fb9891076799e33acca Jul 23 21:17:34.197457 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1151584351 Jul 23 21:17:34.197457 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:17:34.197457 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:17:34.198962 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d3c17bd813264fb9891076799e33acca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d3c17bd813264fb9891076799e33acca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d3c17bd813264fb9891076799e33acca", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d3c17bd813264fb9891076799e33acca"}]}] Jul 23 21:17:34.198962 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1151584351 Jul 23 21:17:34.198962 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: d3c17bd813264fb9891076799e33acca Jul 23 21:17:34.198962 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1151584351 Jul 23 21:17:34.198962 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1151584351-project Jul 23 21:17:34.198962 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:17:34.198962 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:17:34.198962 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 39f1a14a59b7401d88f18ec35c91e30a Jul 23 21:17:34.198962 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1151584351-project Jul 23 21:17:34.198962 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:17:34.198962 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance 26494d1b-0e9c-45ac-90f7-55924a958e4c could not be found. Jul 23 21:17:34.198962 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '26494d1b-0e9c-45ac-90f7-55924a958e4c'} Jul 23 21:17:34.199763 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:17:34.199763 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:17:34.199763 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:17:34.199763 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:17:34.199763 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:17:34.199763 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:17:34.199763 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:17:34.199763 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:17:34.199763 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:17:34.199763 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:17:34.199763 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26494d1b-0e9c-45ac-90f7-55924a958e4c could not be found. Jul 23 21:17:34.199763 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:17:34.199763 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:17:34.199763 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:17:34.199763 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:17:34.199763 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:17:34.199763 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:17:34.199763 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:17:34.199763 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:17:34.199763 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:17:34.201331 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:17:34.201331 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:17:34.201331 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:17:34.201331 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:17:34.201331 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:17:34.201331 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:17:34.201331 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:17:34.201331 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26494d1b-0e9c-45ac-90f7-55924a958e4c could not be found. Jul 23 21:17:34.201331 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:17:34.201331 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:17:34.201331 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:17:34.201331 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:17:34.201331 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:17:34.201331 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:17:34.201331 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:17:34.201331 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:17:34.201331 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26494d1b-0e9c-45ac-90f7-55924a958e4c could not be found. Jul 23 21:17:34.201331 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:17:34.205331 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-42a1b90b-75a3-44a7-8cc5-96ce1018d30b tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Returning 404 to user: Instance 26494d1b-0e9c-45ac-90f7-55924a958e4c could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:17:34.209354 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-42a1b90b-75a3-44a7-8cc5-96ce1018d30b tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] 10.222.0.17 "GET /compute/v2.1/servers/26494d1b-0e9c-45ac-90f7-55924a958e4c" status: 404 len: 111 microversion: 2.1 time: 0.122018 Jul 23 21:17:34.215088 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 527/1082] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:34 2022] GET /compute/v2.1/servers/26494d1b-0e9c-45ac-90f7-55924a958e4c => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:17:34.224319 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-dc7fad9b-9279-4065-85c6-a7f3f49e1c42 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:34.234415 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-dc7fad9b-9279-4065-85c6-a7f3f49e1c42 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: e346d31f-1498-49ff-8a58-0c607e41923e] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:34.253643 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dc7fad9b-9279-4065-85c6-a7f3f49e1c42 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:34.254550 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dc7fad9b-9279-4065-85c6-a7f3f49e1c42 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:34.256560 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dc7fad9b-9279-4065-85c6-a7f3f49e1c42 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:34.257623 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dc7fad9b-9279-4065-85c6-a7f3f49e1c42 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:34.304821 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:17:34.445693 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-dc7fad9b-9279-4065-85c6-a7f3f49e1c42 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf92af08fa94215b4eafcacea6c63f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e7d37a0e3b4b32ae99c3bc15a831e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:34.459914 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-dc7fad9b-9279-4065-85c6-a7f3f49e1c42 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "GET /compute/v2.1/servers/e346d31f-1498-49ff-8a58-0c607e41923e" status: 200 len: 1430 microversion: 2.1 time: 0.243378 Jul 23 21:17:34.460500 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 528/1083] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:34 2022] GET /compute/v2.1/servers/e346d31f-1498-49ff-8a58-0c607e41923e => generated 1430 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:34.732939 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-d6141ed8-7e9e-46da-8e72-50825269a65b tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4f9dda4c2a411cb0394bf86e9ae223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580ed681cbf44d10936259b17f60f1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:34.746491 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-d6141ed8-7e9e-46da-8e72-50825269a65b tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/servers/8025dc38-59d4-4296-b2c7-5aebb08eacae" status: 200 len: 1499 microversion: 2.1 time: 0.597258 Jul 23 21:17:34.758606 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 556/1084] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:34 2022] GET /compute/v2.1/servers/8025dc38-59d4-4296-b2c7-5aebb08eacae => generated 1499 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:17:34.780880 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-3a111894-4209-4d70-aa6a-aeba8d143315 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:34.781529 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-3a111894-4209-4d70-aa6a-aeba8d143315 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] [instance: fc41b6cc-f603-4f7d-89cb-a7e3cee372a5] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:34.797265 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3a111894-4209-4d70-aa6a-aeba8d143315 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:34.798212 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3a111894-4209-4d70-aa6a-aeba8d143315 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:34.803405 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3a111894-4209-4d70-aa6a-aeba8d143315 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:34.805356 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3a111894-4209-4d70-aa6a-aeba8d143315 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:34.841262 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-3a111894-4209-4d70-aa6a-aeba8d143315 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] HTTP exception thrown: Instance fc41b6cc-f603-4f7d-89cb-a7e3cee372a5 could not be found. Jul 23 21:17:34.844125 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-3a111894-4209-4d70-aa6a-aeba8d143315 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Request method failure captured: Jul 23 21:17:34.844125 ncdv-master-1 devstack@n-api.service[131321]: request: DELETE /compute/v2.1/servers/fc41b6cc-f603-4f7d-89cb-a7e3cee372a5 HTTP/1.1 Jul 23 21:17:34.844125 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:17:34.844125 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:17:34.844125 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:17:34.844125 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:17:34.844125 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:17:34.844125 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:17:34.844125 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:17:34.844125 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:17:34.844125 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GS7W_Qz0O8S72DOsPN0vtzp3rm_KIyrWpbu3vGcpxZc3lL1oeDqY1JXJP76rNS_fR3jdUMr3QL6xcb1hVcrAyUE4w-GFOGKF7TPWfQEnVl2dmqHRCQpVjTSkHFcvpvFq7yIRCtQGZhgGHKQQV6NmfEErSsL7YZBXmwL3j_FkLRDWm0 Jul 23 21:17:34.844125 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:17:34.844125 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:17:34.844125 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:17:34.844125 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:17:34.844125 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:17:34.844125 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:17:34.844125 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: d3c17bd813264fb9891076799e33acca Jul 23 21:17:34.844125 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1151584351 Jul 23 21:17:34.844125 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:17:34.844125 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:17:34.846057 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d3c17bd813264fb9891076799e33acca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d3c17bd813264fb9891076799e33acca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d3c17bd813264fb9891076799e33acca", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d3c17bd813264fb9891076799e33acca"}]}] Jul 23 21:17:34.846057 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1151584351 Jul 23 21:17:34.846057 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: d3c17bd813264fb9891076799e33acca Jul 23 21:17:34.846057 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1151584351 Jul 23 21:17:34.846057 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1151584351-project Jul 23 21:17:34.846057 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:17:34.846057 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:17:34.846057 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 39f1a14a59b7401d88f18ec35c91e30a Jul 23 21:17:34.846057 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1151584351-project Jul 23 21:17:34.846057 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:17:34.846057 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance fc41b6cc-f603-4f7d-89cb-a7e3cee372a5 could not be found. Jul 23 21:17:34.846057 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': 'fc41b6cc-f603-4f7d-89cb-a7e3cee372a5'} Jul 23 21:17:34.847794 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:17:34.847794 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:17:34.847794 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:17:34.847794 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:17:34.847794 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:17:34.847794 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:17:34.847794 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:17:34.847794 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:17:34.847794 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:17:34.847794 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:17:34.847794 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc41b6cc-f603-4f7d-89cb-a7e3cee372a5 could not be found. Jul 23 21:17:34.847794 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:17:34.847794 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:17:34.847794 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:17:34.847794 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:17:34.847794 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:17:34.847794 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:17:34.847794 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:17:34.847794 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:17:34.847794 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:17:34.850180 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:17:34.850180 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 23 21:17:34.850180 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 23 21:17:34.850180 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 23 21:17:34.850180 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 23 21:17:34.850180 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:17:34.850180 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:17:34.850180 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:17:34.850180 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:17:34.850180 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc41b6cc-f603-4f7d-89cb-a7e3cee372a5 could not be found. Jul 23 21:17:34.850180 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:17:34.850180 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:17:34.850180 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:17:34.850180 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:17:34.850180 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:17:34.850180 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:17:34.850180 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:17:34.850180 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:17:34.850180 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc41b6cc-f603-4f7d-89cb-a7e3cee372a5 could not be found. Jul 23 21:17:34.850180 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:17:34.856101 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-3a111894-4209-4d70-aa6a-aeba8d143315 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Returning 404 to user: Instance fc41b6cc-f603-4f7d-89cb-a7e3cee372a5 could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:17:34.857596 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-3a111894-4209-4d70-aa6a-aeba8d143315 tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] 10.222.0.17 "DELETE /compute/v2.1/servers/fc41b6cc-f603-4f7d-89cb-a7e3cee372a5" status: 404 len: 111 microversion: 2.1 time: 0.097467 Jul 23 21:17:34.863597 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 557/1085] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:17:34 2022] DELETE /compute/v2.1/servers/fc41b6cc-f603-4f7d-89cb-a7e3cee372a5 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:17:34.869848 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-423963f8-30a1-4491-b976-870d91505b5c req-a1f91bc7-2625-413e-93c2-c97117d22dce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e346d31f-1498-49ff-8a58-0c607e41923e", "name": "network-vif-deleted", "tag": "7730518a-afbf-4f1e-9b23-7a49e9c11fad"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:17:34.877951 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-30df292e-2f8b-4618-a372-e6ed417c99a9 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-1339099077", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "networks": [{"uuid": "f9690c58-b6d6-4484-bf8b-1818bc8f53ad"}]}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:17:34.889317 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-423963f8-30a1-4491-b976-870d91505b5c req-a1f91bc7-2625-413e-93c2-c97117d22dce service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:34.890558 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-423963f8-30a1-4491-b976-870d91505b5c req-a1f91bc7-2625-413e-93c2-c97117d22dce service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:34.906247 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-423963f8-30a1-4491-b976-870d91505b5c req-a1f91bc7-2625-413e-93c2-c97117d22dce service nova] Creating event network-vif-deleted:7730518a-afbf-4f1e-9b23-7a49e9c11fad for instance e346d31f-1498-49ff-8a58-0c607e41923e on nch1-master-1 Jul 23 21:17:34.917795 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-423963f8-30a1-4491-b976-870d91505b5c req-a1f91bc7-2625-413e-93c2-c97117d22dce service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051414 Jul 23 21:17:34.920981 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 558/1086] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:17:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:17:34.932477 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-4038f057-c031-49c2-af08-03e85fe950fb tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:34.933186 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-4038f057-c031-49c2-af08-03e85fe950fb tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 34eaf1d2-9732-4c0e-b970-02fbb449514b] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:34.943082 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4038f057-c031-49c2-af08-03e85fe950fb tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:34.943535 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4038f057-c031-49c2-af08-03e85fe950fb tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:34.944320 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4038f057-c031-49c2-af08-03e85fe950fb tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:34.944755 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4038f057-c031-49c2-af08-03e85fe950fb tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:34.956675 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-30df292e-2f8b-4618-a372-e6ed417c99a9 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] validate_networks() for [('f9690c58-b6d6-4484-bf8b-1818bc8f53ad', None, None, None, None, None)] {{(pid=131320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:17:35.146822 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-4038f057-c031-49c2-af08-03e85fe950fb tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:35.163468 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-4038f057-c031-49c2-af08-03e85fe950fb tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/34eaf1d2-9732-4c0e-b970-02fbb449514b" status: 200 len: 1718 microversion: 2.1 time: 0.241043 Jul 23 21:17:35.164075 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 559/1087] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:34 2022] GET /compute/v2.1/servers/34eaf1d2-9732-4c0e-b970-02fbb449514b => generated 1718 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:35.181030 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-8f2a50f5-48bb-4d6c-ba2d-7485e3bb3f40 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:35.181659 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-8f2a50f5-48bb-4d6c-ba2d-7485e3bb3f40 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 760fa31f-a0cf-46df-b456-3af5dc7f9933] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:35.202599 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8f2a50f5-48bb-4d6c-ba2d-7485e3bb3f40 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:35.203077 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8f2a50f5-48bb-4d6c-ba2d-7485e3bb3f40 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:35.203881 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8f2a50f5-48bb-4d6c-ba2d-7485e3bb3f40 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:35.204329 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8f2a50f5-48bb-4d6c-ba2d-7485e3bb3f40 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:35.485510 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-8f2a50f5-48bb-4d6c-ba2d-7485e3bb3f40 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:35.495994 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-8f2a50f5-48bb-4d6c-ba2d-7485e3bb3f40 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933" status: 200 len: 1542 microversion: 2.1 time: 0.330730 Jul 23 21:17:35.506586 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 560/1088] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:35 2022] GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933 => generated 1542 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:35.513772 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-0491cc84-636c-4e5d-a84f-79ca875a25fc tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:35.514698 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-0491cc84-636c-4e5d-a84f-79ca875a25fc tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] [instance: fc41b6cc-f603-4f7d-89cb-a7e3cee372a5] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:35.523765 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0491cc84-636c-4e5d-a84f-79ca875a25fc tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:35.524476 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0491cc84-636c-4e5d-a84f-79ca875a25fc tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:35.525487 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0491cc84-636c-4e5d-a84f-79ca875a25fc tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:35.526124 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0491cc84-636c-4e5d-a84f-79ca875a25fc tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:35.547321 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-0491cc84-636c-4e5d-a84f-79ca875a25fc tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] HTTP exception thrown: Instance fc41b6cc-f603-4f7d-89cb-a7e3cee372a5 could not be found. Jul 23 21:17:35.549478 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-0491cc84-636c-4e5d-a84f-79ca875a25fc tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Request method failure captured: Jul 23 21:17:35.549478 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/servers/fc41b6cc-f603-4f7d-89cb-a7e3cee372a5 HTTP/1.1 Jul 23 21:17:35.549478 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:17:35.549478 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:17:35.549478 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:17:35.549478 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:17:35.549478 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:17:35.549478 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:17:35.549478 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:17:35.549478 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:17:35.549478 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GS7W_Qz0O8S72DOsPN0vtzp3rm_KIyrWpbu3vGcpxZc3lL1oeDqY1JXJP76rNS_fR3jdUMr3QL6xcb1hVcrAyUE4w-GFOGKF7TPWfQEnVl2dmqHRCQpVjTSkHFcvpvFq7yIRCtQGZhgGHKQQV6NmfEErSsL7YZBXmwL3j_FkLRDWm0 Jul 23 21:17:35.549478 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:17:35.549478 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:17:35.549478 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:17:35.549478 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:17:35.549478 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:17:35.549478 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:17:35.549478 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: d3c17bd813264fb9891076799e33acca Jul 23 21:17:35.549478 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1151584351 Jul 23 21:17:35.549478 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:17:35.549478 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:17:35.551133 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d3c17bd813264fb9891076799e33acca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d3c17bd813264fb9891076799e33acca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d3c17bd813264fb9891076799e33acca", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d3c17bd813264fb9891076799e33acca"}]}] Jul 23 21:17:35.551133 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1151584351 Jul 23 21:17:35.551133 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: d3c17bd813264fb9891076799e33acca Jul 23 21:17:35.551133 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1151584351 Jul 23 21:17:35.551133 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1151584351-project Jul 23 21:17:35.551133 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:17:35.551133 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:17:35.551133 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 39f1a14a59b7401d88f18ec35c91e30a Jul 23 21:17:35.551133 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1151584351-project Jul 23 21:17:35.551133 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:17:35.551133 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance fc41b6cc-f603-4f7d-89cb-a7e3cee372a5 could not be found. Jul 23 21:17:35.551133 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': 'fc41b6cc-f603-4f7d-89cb-a7e3cee372a5'} Jul 23 21:17:35.552047 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:17:35.552047 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:17:35.552047 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:17:35.552047 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:17:35.552047 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:17:35.552047 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:17:35.552047 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:17:35.552047 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:17:35.552047 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:17:35.552047 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:17:35.552047 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc41b6cc-f603-4f7d-89cb-a7e3cee372a5 could not be found. Jul 23 21:17:35.552047 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:17:35.552047 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:17:35.552047 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:17:35.552047 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:17:35.552047 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:17:35.552047 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:17:35.552047 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:17:35.552047 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:17:35.552047 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:17:35.553611 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:17:35.553611 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:17:35.553611 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:17:35.553611 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:17:35.553611 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:17:35.553611 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:17:35.553611 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:17:35.553611 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc41b6cc-f603-4f7d-89cb-a7e3cee372a5 could not be found. Jul 23 21:17:35.553611 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:17:35.553611 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:17:35.553611 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:17:35.553611 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:17:35.553611 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:17:35.553611 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:17:35.553611 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:17:35.553611 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:17:35.553611 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc41b6cc-f603-4f7d-89cb-a7e3cee372a5 could not be found. Jul 23 21:17:35.553611 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:17:35.555943 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-0491cc84-636c-4e5d-a84f-79ca875a25fc tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] Returning 404 to user: Instance fc41b6cc-f603-4f7d-89cb-a7e3cee372a5 could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:17:35.557386 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-0491cc84-636c-4e5d-a84f-79ca875a25fc tempest-ServersWithSpecificFlavorTestJSON-1151584351 tempest-ServersWithSpecificFlavorTestJSON-1151584351-project] 10.222.0.17 "GET /compute/v2.1/servers/fc41b6cc-f603-4f7d-89cb-a7e3cee372a5" status: 404 len: 111 microversion: 2.1 time: 0.048973 Jul 23 21:17:35.558299 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 561/1089] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:35 2022] GET /compute/v2.1/servers/fc41b6cc-f603-4f7d-89cb-a7e3cee372a5 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:17:35.598435 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-30df292e-2f8b-4618-a372-e6ed417c99a9 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:17:35.599031 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-30df292e-2f8b-4618-a372-e6ed417c99a9 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:17:35.599318 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-30df292e-2f8b-4618-a372-e6ed417c99a9 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:17:35.600149 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-30df292e-2f8b-4618-a372-e6ed417c99a9 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:17:35.600707 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-30df292e-2f8b-4618-a372-e6ed417c99a9 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:17:35.606792 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-069cbd37-78d9-4b4e-a36f-58e1c7dc360f tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:35.608852 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-069cbd37-78d9-4b4e-a36f-58e1c7dc360f tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] [instance: a6de755e-739d-437c-aafb-6bc49f8bb086] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:35.621542 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-30df292e-2f8b-4618-a372-e6ed417c99a9 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:35.622043 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-30df292e-2f8b-4618-a372-e6ed417c99a9 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:35.622861 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-30df292e-2f8b-4618-a372-e6ed417c99a9 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:35.623303 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-30df292e-2f8b-4618-a372-e6ed417c99a9 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:35.630531 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-069cbd37-78d9-4b4e-a36f-58e1c7dc360f tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:35.631289 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-069cbd37-78d9-4b4e-a36f-58e1c7dc360f tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:35.632318 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-069cbd37-78d9-4b4e-a36f-58e1c7dc360f tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:35.632933 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-069cbd37-78d9-4b4e-a36f-58e1c7dc360f tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:35.647157 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-30df292e-2f8b-4618-a372-e6ed417c99a9 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Getting quotas for project 454092f7aaf44ed3a3cdfba882e217b3. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:17:35.653288 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-30df292e-2f8b-4618-a372-e6ed417c99a9 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Getting quotas for user d18a11b26ded436ab197043a4b90b276 and project 454092f7aaf44ed3a3cdfba882e217b3. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:17:35.668594 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-30df292e-2f8b-4618-a372-e6ed417c99a9 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Going to run 1 instances... {{(pid=131320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:17:35.671382 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-30df292e-2f8b-4618-a372-e6ed417c99a9 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] [instance: c9f5f0b3-e6bd-447f-9ada-0b34f3bae4fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:17:35.737430 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-30df292e-2f8b-4618-a372-e6ed417c99a9 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.275563 Jul 23 21:17:35.738725 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 529/1090] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:17:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1278 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 23 21:17:35.747065 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-dc470c89-da39-4679-9e53-aa1952c53d10 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:35.747940 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-dc470c89-da39-4679-9e53-aa1952c53d10 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: e346d31f-1498-49ff-8a58-0c607e41923e] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:35.758809 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dc470c89-da39-4679-9e53-aa1952c53d10 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:35.759565 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dc470c89-da39-4679-9e53-aa1952c53d10 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:35.760529 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dc470c89-da39-4679-9e53-aa1952c53d10 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:35.761177 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dc470c89-da39-4679-9e53-aa1952c53d10 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:35.780045 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-dc470c89-da39-4679-9e53-aa1952c53d10 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] HTTP exception thrown: Instance e346d31f-1498-49ff-8a58-0c607e41923e could not be found. Jul 23 21:17:35.782141 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-dc470c89-da39-4679-9e53-aa1952c53d10 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Request method failure captured: Jul 23 21:17:35.782141 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/e346d31f-1498-49ff-8a58-0c607e41923e HTTP/1.1 Jul 23 21:17:35.782141 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:17:35.782141 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:17:35.782141 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:17:35.782141 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:17:35.782141 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:17:35.782141 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:17:35.782141 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:17:35.782141 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:17:35.782141 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GTXg43xsvaDpXj4BMz40UdSnpyPBTbhxj1IdGMcN1ZmThctVpX9T9iG6eRr9MGt1QTpmHEqYNbJp_e-y4RlWttw_Ug9gposZ1FVUrLfy9Hukeo6nEcrmiwqSETVX_CDHg3xVpH7dYYo0t5AjovoUMlG-_EeGSUlkV9963ANN9g-cqA Jul 23 21:17:35.782141 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:17:35.782141 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:17:35.782141 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:17:35.782141 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:17:35.782141 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:17:35.782141 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:17:35.782141 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: f5e7d37a0e3b4b32ae99c3bc15a831e6 Jul 23 21:17:35.782141 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServersOnMultiNodesTest-62510325 Jul 23 21:17:35.782141 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:17:35.782141 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:17:35.783875 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f5e7d37a0e3b4b32ae99c3bc15a831e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f5e7d37a0e3b4b32ae99c3bc15a831e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f5e7d37a0e3b4b32ae99c3bc15a831e6", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f5e7d37a0e3b4b32ae99c3bc15a831e6"}]}] Jul 23 21:17:35.783875 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServersOnMultiNodesTest-62510325 Jul 23 21:17:35.783875 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: f5e7d37a0e3b4b32ae99c3bc15a831e6 Jul 23 21:17:35.783875 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-62510325 Jul 23 21:17:35.783875 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServersOnMultiNodesTest-62510325-project Jul 23 21:17:35.783875 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:17:35.783875 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:17:35.783875 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: ebf92af08fa94215b4eafcacea6c63f6 Jul 23 21:17:35.783875 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServersOnMultiNodesTest-62510325-project Jul 23 21:17:35.783875 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:17:35.783875 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance e346d31f-1498-49ff-8a58-0c607e41923e could not be found. Jul 23 21:17:35.783875 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': 'e346d31f-1498-49ff-8a58-0c607e41923e'} Jul 23 21:17:35.784795 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:17:35.784795 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:17:35.784795 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:17:35.784795 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:17:35.784795 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:17:35.784795 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:17:35.784795 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:17:35.784795 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:17:35.784795 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:17:35.784795 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:17:35.784795 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e346d31f-1498-49ff-8a58-0c607e41923e could not be found. Jul 23 21:17:35.784795 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:17:35.784795 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:17:35.784795 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:17:35.784795 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:17:35.784795 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:17:35.784795 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:17:35.784795 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:17:35.784795 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:17:35.784795 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:17:35.786250 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:17:35.786250 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:17:35.786250 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:17:35.786250 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:17:35.786250 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:17:35.786250 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:17:35.786250 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:17:35.786250 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e346d31f-1498-49ff-8a58-0c607e41923e could not be found. Jul 23 21:17:35.786250 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:17:35.786250 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:17:35.786250 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:17:35.786250 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:17:35.786250 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:17:35.786250 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:17:35.786250 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:17:35.786250 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:17:35.786250 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e346d31f-1498-49ff-8a58-0c607e41923e could not be found. Jul 23 21:17:35.786250 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:17:35.801737 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-dc470c89-da39-4679-9e53-aa1952c53d10 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Returning 404 to user: Instance e346d31f-1498-49ff-8a58-0c607e41923e could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:17:35.802835 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-dc470c89-da39-4679-9e53-aa1952c53d10 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "GET /compute/v2.1/servers/e346d31f-1498-49ff-8a58-0c607e41923e" status: 404 len: 111 microversion: 2.1 time: 0.061382 Jul 23 21:17:35.803727 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 530/1091] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:35 2022] GET /compute/v2.1/servers/e346d31f-1498-49ff-8a58-0c607e41923e => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:17:35.814683 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-37b5099d-48ca-4533-a471-5f420fad8fa8 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:35.815605 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-37b5099d-48ca-4533-a471-5f420fad8fa8 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] [instance: c9f5f0b3-e6bd-447f-9ada-0b34f3bae4fd] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:35.933565 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-37b5099d-48ca-4533-a471-5f420fad8fa8 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd18a11b26ded436ab197043a4b90b276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454092f7aaf44ed3a3cdfba882e217b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:35.941755 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-37b5099d-48ca-4533-a471-5f420fad8fa8 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] 10.222.0.17 "GET /compute/v2.1/servers/c9f5f0b3-e6bd-447f-9ada-0b34f3bae4fd" status: 200 len: 1216 microversion: 2.1 time: 0.136882 Jul 23 21:17:35.949000 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 531/1092] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:35 2022] GET /compute/v2.1/servers/c9f5f0b3-e6bd-447f-9ada-0b34f3bae4fd => generated 1216 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:35.958079 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6364c401-9c05-48a9-b01b-22ce8d9aab90 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:35.958079 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6364c401-9c05-48a9-b01b-22ce8d9aab90 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 8025dc38-59d4-4296-b2c7-5aebb08eacae] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:35.966361 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6364c401-9c05-48a9-b01b-22ce8d9aab90 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:35.966821 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6364c401-9c05-48a9-b01b-22ce8d9aab90 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:35.967624 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6364c401-9c05-48a9-b01b-22ce8d9aab90 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:35.968071 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6364c401-9c05-48a9-b01b-22ce8d9aab90 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:36.015099 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.objects.instance [None req-069cbd37-78d9-4b4e-a36f-58e1c7dc360f tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lazy-loading 'services' on Instance uuid a6de755e-739d-437c-aafb-6bc49f8bb086 {{(pid=131321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:17:36.044990 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-069cbd37-78d9-4b4e-a36f-58e1c7dc360f tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/a6de755e-739d-437c-aafb-6bc49f8bb086" status: 200 len: 2347 microversion: 2.25 time: 0.485422 Jul 23 21:17:36.069321 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 562/1093] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:17:35 2022] GET /compute/v2.1/servers/a6de755e-739d-437c-aafb-6bc49f8bb086 => generated 2347 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:17:36.077240 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e8717f93-e303-4bc9-8972-a2f4d5999ea5 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:36.077755 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-e8717f93-e303-4bc9-8972-a2f4d5999ea5 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: a27111b2-863b-460b-9b89-ba08092d3561] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:36.099898 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e8717f93-e303-4bc9-8972-a2f4d5999ea5 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:36.100643 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e8717f93-e303-4bc9-8972-a2f4d5999ea5 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:36.101504 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e8717f93-e303-4bc9-8972-a2f4d5999ea5 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:36.102528 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e8717f93-e303-4bc9-8972-a2f4d5999ea5 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:36.167582 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-e8717f93-e303-4bc9-8972-a2f4d5999ea5 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: a27111b2-863b-460b-9b89-ba08092d3561] Going to try to terminate instance {{(pid=131321) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:17:36.325631 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6364c401-9c05-48a9-b01b-22ce8d9aab90 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4f9dda4c2a411cb0394bf86e9ae223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580ed681cbf44d10936259b17f60f1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:36.350196 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6364c401-9c05-48a9-b01b-22ce8d9aab90 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/servers/8025dc38-59d4-4296-b2c7-5aebb08eacae" status: 200 len: 1499 microversion: 2.1 time: 0.398492 Jul 23 21:17:36.352406 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 532/1094] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:35 2022] GET /compute/v2.1/servers/8025dc38-59d4-4296-b2c7-5aebb08eacae => generated 1499 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:36.372281 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-66d3d2f7-4f8d-4f51-ad3d-f5886669fd4a req-9a0a6303-7cc2-4d00-8f39-56dc9946fe73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34eaf1d2-9732-4c0e-b970-02fbb449514b", "tag": "b09648fa-0071-4d7d-ba66-d0da81ab9768"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:17:36.401038 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-66d3d2f7-4f8d-4f51-ad3d-f5886669fd4a req-9a0a6303-7cc2-4d00-8f39-56dc9946fe73 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:36.402450 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-66d3d2f7-4f8d-4f51-ad3d-f5886669fd4a req-9a0a6303-7cc2-4d00-8f39-56dc9946fe73 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:36.421275 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-e8717f93-e303-4bc9-8972-a2f4d5999ea5 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "DELETE /compute/v2.1/servers/a27111b2-863b-460b-9b89-ba08092d3561" status: 204 len: 0 microversion: 2.1 time: 0.350275 Jul 23 21:17:36.424661 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 563/1095] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:17:36 2022] DELETE /compute/v2.1/servers/a27111b2-863b-460b-9b89-ba08092d3561 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:17:36.432677 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-94600f7a-8436-445f-896b-2cab3a734efa tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:36.434743 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-66d3d2f7-4f8d-4f51-ad3d-f5886669fd4a req-9a0a6303-7cc2-4d00-8f39-56dc9946fe73 service nova] Creating event network-changed:b09648fa-0071-4d7d-ba66-d0da81ab9768 for instance 34eaf1d2-9732-4c0e-b970-02fbb449514b on nch2-master-1 Jul 23 21:17:36.436205 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:17:36.436205 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:17:36.438125 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-94600f7a-8436-445f-896b-2cab3a734efa tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:36.439696 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-94600f7a-8436-445f-896b-2cab3a734efa tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:36.443464 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-94600f7a-8436-445f-896b-2cab3a734efa tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:36.443727 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-94600f7a-8436-445f-896b-2cab3a734efa tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:36.447129 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-66d3d2f7-4f8d-4f51-ad3d-f5886669fd4a req-9a0a6303-7cc2-4d00-8f39-56dc9946fe73 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093288 Jul 23 21:17:36.448456 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 533/1096] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:17:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:17:36.463610 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-67981aa8-88d3-40c8-8365-920683befb33 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:36.464593 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-67981aa8-88d3-40c8-8365-920683befb33 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 34eaf1d2-9732-4c0e-b970-02fbb449514b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:36.474747 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-94600f7a-8436-445f-896b-2cab3a734efa tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.048120 Jul 23 21:17:36.475555 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-67981aa8-88d3-40c8-8365-920683befb33 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:36.475864 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 564/1097] 10.222.0.17 () {60 vars in 1216 bytes} [Sat Jul 23 21:17:36 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 23 21:17:36.478463 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-67981aa8-88d3-40c8-8365-920683befb33 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:36.479294 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-67981aa8-88d3-40c8-8365-920683befb33 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:36.481433 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-005ade9a-2ad2-4d59-a60a-5c00ac8422fd tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:36.482376 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-005ade9a-2ad2-4d59-a60a-5c00ac8422fd tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: a27111b2-863b-460b-9b89-ba08092d3561] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:36.490337 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-005ade9a-2ad2-4d59-a60a-5c00ac8422fd tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:36.491022 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-005ade9a-2ad2-4d59-a60a-5c00ac8422fd tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:36.491992 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-005ade9a-2ad2-4d59-a60a-5c00ac8422fd tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:36.492618 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-005ade9a-2ad2-4d59-a60a-5c00ac8422fd tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:36.505489 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-67981aa8-88d3-40c8-8365-920683befb33 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:36.886553 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-67981aa8-88d3-40c8-8365-920683befb33 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:36.909968 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-67981aa8-88d3-40c8-8365-920683befb33 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/34eaf1d2-9732-4c0e-b970-02fbb449514b" status: 200 len: 1718 microversion: 2.1 time: 0.459216 Jul 23 21:17:36.910586 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 534/1098] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:36 2022] GET /compute/v2.1/servers/34eaf1d2-9732-4c0e-b970-02fbb449514b => generated 1718 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:36.915512 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-93467f3d-7db5-4f13-bfec-e3a103a0f4d1 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:36.916138 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-93467f3d-7db5-4f13-bfec-e3a103a0f4d1 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 760fa31f-a0cf-46df-b456-3af5dc7f9933] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:36.942916 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-93467f3d-7db5-4f13-bfec-e3a103a0f4d1 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:36.943735 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-93467f3d-7db5-4f13-bfec-e3a103a0f4d1 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:36.944740 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-93467f3d-7db5-4f13-bfec-e3a103a0f4d1 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:36.945377 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-93467f3d-7db5-4f13-bfec-e3a103a0f4d1 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:37.122458 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-005ade9a-2ad2-4d59-a60a-5c00ac8422fd tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf92af08fa94215b4eafcacea6c63f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e7d37a0e3b4b32ae99c3bc15a831e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:37.132223 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-005ade9a-2ad2-4d59-a60a-5c00ac8422fd tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "GET /compute/v2.1/servers/a27111b2-863b-460b-9b89-ba08092d3561" status: 200 len: 1473 microversion: 2.1 time: 0.655132 Jul 23 21:17:37.139717 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 565/1099] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:36 2022] GET /compute/v2.1/servers/a27111b2-863b-460b-9b89-ba08092d3561 => generated 1473 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:37.152565 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-db3f4cd9-81b8-4c26-ade2-310542587015 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:37.152759 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-db3f4cd9-81b8-4c26-ade2-310542587015 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] [instance: c9f5f0b3-e6bd-447f-9ada-0b34f3bae4fd] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:37.168045 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-db3f4cd9-81b8-4c26-ade2-310542587015 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:37.172502 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-db3f4cd9-81b8-4c26-ade2-310542587015 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:37.173497 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-db3f4cd9-81b8-4c26-ade2-310542587015 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:37.175279 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-db3f4cd9-81b8-4c26-ade2-310542587015 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:37.259808 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-93467f3d-7db5-4f13-bfec-e3a103a0f4d1 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:37.268684 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-93467f3d-7db5-4f13-bfec-e3a103a0f4d1 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933" status: 200 len: 1542 microversion: 2.1 time: 0.357025 Jul 23 21:17:37.270070 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 535/1100] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:36 2022] GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933 => generated 1542 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:37.308658 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-db3f4cd9-81b8-4c26-ade2-310542587015 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd18a11b26ded436ab197043a4b90b276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454092f7aaf44ed3a3cdfba882e217b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:37.316491 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-db3f4cd9-81b8-4c26-ade2-310542587015 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] 10.222.0.17 "GET /compute/v2.1/servers/c9f5f0b3-e6bd-447f-9ada-0b34f3bae4fd" status: 200 len: 1220 microversion: 2.1 time: 0.175608 Jul 23 21:17:37.317239 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 566/1101] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:37 2022] GET /compute/v2.1/servers/c9f5f0b3-e6bd-447f-9ada-0b34f3bae4fd => generated 1220 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:37.372294 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1bc94f61-46bb-4427-b7f2-69b534f00bbc tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:37.373105 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1bc94f61-46bb-4427-b7f2-69b534f00bbc tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 8025dc38-59d4-4296-b2c7-5aebb08eacae] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:37.385530 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1bc94f61-46bb-4427-b7f2-69b534f00bbc tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:37.386155 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1bc94f61-46bb-4427-b7f2-69b534f00bbc tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:37.387028 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1bc94f61-46bb-4427-b7f2-69b534f00bbc tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:37.387517 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1bc94f61-46bb-4427-b7f2-69b534f00bbc tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:37.616565 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-1bc94f61-46bb-4427-b7f2-69b534f00bbc tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4f9dda4c2a411cb0394bf86e9ae223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580ed681cbf44d10936259b17f60f1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:37.626482 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1bc94f61-46bb-4427-b7f2-69b534f00bbc tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/servers/8025dc38-59d4-4296-b2c7-5aebb08eacae" status: 200 len: 1499 microversion: 2.1 time: 0.261796 Jul 23 21:17:37.632249 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 536/1102] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:37 2022] GET /compute/v2.1/servers/8025dc38-59d4-4296-b2c7-5aebb08eacae => generated 1499 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:37.928732 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-44824043-93be-44d9-9340-dd02ab590df0 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:37.929366 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-44824043-93be-44d9-9340-dd02ab590df0 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 34eaf1d2-9732-4c0e-b970-02fbb449514b] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:37.947322 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-44824043-93be-44d9-9340-dd02ab590df0 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:37.948837 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-44824043-93be-44d9-9340-dd02ab590df0 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:37.952230 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-44824043-93be-44d9-9340-dd02ab590df0 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:37.952901 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-44824043-93be-44d9-9340-dd02ab590df0 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:38.154863 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0c57eb86-0542-4fb1-8d7c-fd837b9b933b tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:38.155731 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-0c57eb86-0542-4fb1-8d7c-fd837b9b933b tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: a27111b2-863b-460b-9b89-ba08092d3561] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:38.176969 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0c57eb86-0542-4fb1-8d7c-fd837b9b933b tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:38.177426 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0c57eb86-0542-4fb1-8d7c-fd837b9b933b tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:38.178264 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0c57eb86-0542-4fb1-8d7c-fd837b9b933b tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:38.178711 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0c57eb86-0542-4fb1-8d7c-fd837b9b933b tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:38.586427 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-0c57eb86-0542-4fb1-8d7c-fd837b9b933b tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf92af08fa94215b4eafcacea6c63f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e7d37a0e3b4b32ae99c3bc15a831e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:38.597232 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-0c57eb86-0542-4fb1-8d7c-fd837b9b933b tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "GET /compute/v2.1/servers/a27111b2-863b-460b-9b89-ba08092d3561" status: 200 len: 1473 microversion: 2.1 time: 0.449070 Jul 23 21:17:38.602042 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 537/1103] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:38 2022] GET /compute/v2.1/servers/a27111b2-863b-460b-9b89-ba08092d3561 => generated 1473 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:38.618230 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6ed180c8-2f4a-4f7c-864b-477889ed8b61 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ae9e1d9d-8480-46b5-b3ec-f6bb2a5341c9", "device": "/dev/xvdb"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:17:38.620698 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6ed180c8-2f4a-4f7c-864b-477889ed8b61 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: a6de755e-739d-437c-aafb-6bc49f8bb086] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:38.620820 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-44824043-93be-44d9-9340-dd02ab590df0 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:38.637722 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6ed180c8-2f4a-4f7c-864b-477889ed8b61 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:38.638882 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6ed180c8-2f4a-4f7c-864b-477889ed8b61 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:38.643477 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6ed180c8-2f4a-4f7c-864b-477889ed8b61 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:38.644223 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6ed180c8-2f4a-4f7c-864b-477889ed8b61 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:38.661133 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-44824043-93be-44d9-9340-dd02ab590df0 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/34eaf1d2-9732-4c0e-b970-02fbb449514b" status: 200 len: 1718 microversion: 2.1 time: 0.733977 Jul 23 21:17:38.664882 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 567/1104] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:37 2022] GET /compute/v2.1/servers/34eaf1d2-9732-4c0e-b970-02fbb449514b => generated 1718 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:38.692230 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-51ddd79e-b264-47ab-b14f-4adb79f5c2fa tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:38.697449 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-51ddd79e-b264-47ab-b14f-4adb79f5c2fa tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 760fa31f-a0cf-46df-b456-3af5dc7f9933] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:38.721902 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-51ddd79e-b264-47ab-b14f-4adb79f5c2fa tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:38.725810 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-51ddd79e-b264-47ab-b14f-4adb79f5c2fa tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:38.730519 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-51ddd79e-b264-47ab-b14f-4adb79f5c2fa tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:38.733455 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-51ddd79e-b264-47ab-b14f-4adb79f5c2fa tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:39.432202 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6ed180c8-2f4a-4f7c-864b-477889ed8b61 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "POST /compute/v2.1/servers/a6de755e-739d-437c-aafb-6bc49f8bb086/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.827933 Jul 23 21:17:39.433223 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 538/1105] 10.222.0.17 () {62 vars in 1363 bytes} [Sat Jul 23 21:17:38 2022] POST /compute/v2.1/servers/a6de755e-739d-437c-aafb-6bc49f8bb086/os-volume_attachments => generated 194 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 23 21:17:39.440792 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-559b4a32-3ab2-4d92-9409-26ca03b9d262 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:39.445903 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-559b4a32-3ab2-4d92-9409-26ca03b9d262 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] [instance: c9f5f0b3-e6bd-447f-9ada-0b34f3bae4fd] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:39.460804 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-559b4a32-3ab2-4d92-9409-26ca03b9d262 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:39.463553 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-559b4a32-3ab2-4d92-9409-26ca03b9d262 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:39.467880 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-559b4a32-3ab2-4d92-9409-26ca03b9d262 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:39.468609 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-559b4a32-3ab2-4d92-9409-26ca03b9d262 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:39.652026 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-51ddd79e-b264-47ab-b14f-4adb79f5c2fa tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:39.662919 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-51ddd79e-b264-47ab-b14f-4adb79f5c2fa tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933" status: 200 len: 1542 microversion: 2.1 time: 0.995271 Jul 23 21:17:39.671301 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 568/1106] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:38 2022] GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933 => generated 1542 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:39.680130 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-6ce46eee-57a8-4296-8fbb-aeb8db7b7f9e tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:39.688300 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-6ce46eee-57a8-4296-8fbb-aeb8db7b7f9e tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 8025dc38-59d4-4296-b2c7-5aebb08eacae] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:39.732356 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6ce46eee-57a8-4296-8fbb-aeb8db7b7f9e tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:39.738934 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6ce46eee-57a8-4296-8fbb-aeb8db7b7f9e tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:39.743548 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6ce46eee-57a8-4296-8fbb-aeb8db7b7f9e tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:39.746471 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6ce46eee-57a8-4296-8fbb-aeb8db7b7f9e tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:40.443831 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-6ce46eee-57a8-4296-8fbb-aeb8db7b7f9e tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4f9dda4c2a411cb0394bf86e9ae223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580ed681cbf44d10936259b17f60f1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:40.457023 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-6ce46eee-57a8-4296-8fbb-aeb8db7b7f9e tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/servers/8025dc38-59d4-4296-b2c7-5aebb08eacae" status: 200 len: 1499 microversion: 2.1 time: 0.784172 Jul 23 21:17:40.466602 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 569/1107] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:39 2022] GET /compute/v2.1/servers/8025dc38-59d4-4296-b2c7-5aebb08eacae => generated 1499 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:40.472304 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ad509850-c34c-44d4-a36c-98d9acd9be26 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:40.472842 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-ad509850-c34c-44d4-a36c-98d9acd9be26 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: a27111b2-863b-460b-9b89-ba08092d3561] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:40.499970 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ad509850-c34c-44d4-a36c-98d9acd9be26 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:40.500414 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ad509850-c34c-44d4-a36c-98d9acd9be26 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:40.509357 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ad509850-c34c-44d4-a36c-98d9acd9be26 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:40.509822 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ad509850-c34c-44d4-a36c-98d9acd9be26 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:40.527629 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:17:40.623215 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ad509850-c34c-44d4-a36c-98d9acd9be26 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:40.623661 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ad509850-c34c-44d4-a36c-98d9acd9be26 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:40.624326 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.objects.instance [None req-ad509850-c34c-44d4-a36c-98d9acd9be26 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lazy-loading 'fault' on Instance uuid a27111b2-863b-460b-9b89-ba08092d3561 {{(pid=131321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:17:40.875436 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-559b4a32-3ab2-4d92-9409-26ca03b9d262 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd18a11b26ded436ab197043a4b90b276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454092f7aaf44ed3a3cdfba882e217b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:40.928051 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-559b4a32-3ab2-4d92-9409-26ca03b9d262 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] 10.222.0.17 "GET /compute/v2.1/servers/c9f5f0b3-e6bd-447f-9ada-0b34f3bae4fd" status: 200 len: 1316 microversion: 2.1 time: 1.493001 Jul 23 21:17:40.929393 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 539/1108] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:39 2022] GET /compute/v2.1/servers/c9f5f0b3-e6bd-447f-9ada-0b34f3bae4fd => generated 1316 bytes in 1496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:40.953278 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8485c748-0139-4848-ac6a-b00d01a1efa7 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:40.962420 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8485c748-0139-4848-ac6a-b00d01a1efa7 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 34eaf1d2-9732-4c0e-b970-02fbb449514b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:40.994725 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8485c748-0139-4848-ac6a-b00d01a1efa7 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:40.995189 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8485c748-0139-4848-ac6a-b00d01a1efa7 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:41.004017 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8485c748-0139-4848-ac6a-b00d01a1efa7 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:41.004596 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8485c748-0139-4848-ac6a-b00d01a1efa7 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:41.206475 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ad509850-c34c-44d4-a36c-98d9acd9be26 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf92af08fa94215b4eafcacea6c63f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e7d37a0e3b4b32ae99c3bc15a831e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:41.222775 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-ad509850-c34c-44d4-a36c-98d9acd9be26 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "GET /compute/v2.1/servers/a27111b2-863b-460b-9b89-ba08092d3561" status: 200 len: 1307 microversion: 2.1 time: 0.754972 Jul 23 21:17:41.234270 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 570/1109] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:40 2022] GET /compute/v2.1/servers/a27111b2-863b-460b-9b89-ba08092d3561 => generated 1307 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:41.248375 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-699e957e-d466-477b-9801-a59a470d9bfc req-e259dbfc-dce0-4972-891f-9e9073187762 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a27111b2-863b-460b-9b89-ba08092d3561", "name": "network-vif-deleted", "tag": "899df295-0f0b-4e78-9c0a-c4447102f642"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:17:41.287635 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-699e957e-d466-477b-9801-a59a470d9bfc req-e259dbfc-dce0-4972-891f-9e9073187762 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:41.291658 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-699e957e-d466-477b-9801-a59a470d9bfc req-e259dbfc-dce0-4972-891f-9e9073187762 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:41.340665 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-699e957e-d466-477b-9801-a59a470d9bfc req-e259dbfc-dce0-4972-891f-9e9073187762 service nova] Creating event network-vif-deleted:899df295-0f0b-4e78-9c0a-c4447102f642 for instance a27111b2-863b-460b-9b89-ba08092d3561 on nch2-master-1 Jul 23 21:17:41.357707 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-699e957e-d466-477b-9801-a59a470d9bfc req-e259dbfc-dce0-4972-891f-9e9073187762 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128598 Jul 23 21:17:41.361896 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 571/1110] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:17:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:17:41.378148 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-bb40bc71-1db2-4c0b-aae1-2a64bcef58c2 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:41.384091 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-bb40bc71-1db2-4c0b-aae1-2a64bcef58c2 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 760fa31f-a0cf-46df-b456-3af5dc7f9933] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:41.419913 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bb40bc71-1db2-4c0b-aae1-2a64bcef58c2 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:41.420386 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bb40bc71-1db2-4c0b-aae1-2a64bcef58c2 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:41.428515 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bb40bc71-1db2-4c0b-aae1-2a64bcef58c2 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:41.430600 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bb40bc71-1db2-4c0b-aae1-2a64bcef58c2 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:41.579972 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8485c748-0139-4848-ac6a-b00d01a1efa7 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:41.588828 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8485c748-0139-4848-ac6a-b00d01a1efa7 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/34eaf1d2-9732-4c0e-b970-02fbb449514b" status: 200 len: 1718 microversion: 2.1 time: 0.656552 Jul 23 21:17:41.589434 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 540/1111] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:40 2022] GET /compute/v2.1/servers/34eaf1d2-9732-4c0e-b970-02fbb449514b => generated 1718 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:41.623422 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4f97f4ae-b321-410e-b9c9-dc4f4f0d0e2a tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:41.638182 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-4f97f4ae-b321-410e-b9c9-dc4f4f0d0e2a tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 8025dc38-59d4-4296-b2c7-5aebb08eacae] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:41.651419 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4f97f4ae-b321-410e-b9c9-dc4f4f0d0e2a tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:41.652177 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4f97f4ae-b321-410e-b9c9-dc4f4f0d0e2a tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:41.653129 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4f97f4ae-b321-410e-b9c9-dc4f4f0d0e2a tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:41.656639 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4f97f4ae-b321-410e-b9c9-dc4f4f0d0e2a tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:42.341619 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-4f97f4ae-b321-410e-b9c9-dc4f4f0d0e2a tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4f9dda4c2a411cb0394bf86e9ae223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580ed681cbf44d10936259b17f60f1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:42.351514 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4f97f4ae-b321-410e-b9c9-dc4f4f0d0e2a tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/servers/8025dc38-59d4-4296-b2c7-5aebb08eacae" status: 200 len: 1499 microversion: 2.1 time: 0.744426 Jul 23 21:17:42.352113 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 541/1112] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:41 2022] GET /compute/v2.1/servers/8025dc38-59d4-4296-b2c7-5aebb08eacae => generated 1499 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:42.372347 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-88ced7fe-cac1-45dd-9950-eb6835c8b2ce tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:42.372964 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-88ced7fe-cac1-45dd-9950-eb6835c8b2ce tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] [instance: c9f5f0b3-e6bd-447f-9ada-0b34f3bae4fd] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:42.411878 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-88ced7fe-cac1-45dd-9950-eb6835c8b2ce tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:42.415134 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-88ced7fe-cac1-45dd-9950-eb6835c8b2ce tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:42.416178 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-88ced7fe-cac1-45dd-9950-eb6835c8b2ce tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:42.416816 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-88ced7fe-cac1-45dd-9950-eb6835c8b2ce tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:42.489466 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-bb40bc71-1db2-4c0b-aae1-2a64bcef58c2 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:42.502179 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-bb40bc71-1db2-4c0b-aae1-2a64bcef58c2 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933" status: 200 len: 1541 microversion: 2.1 time: 1.138639 Jul 23 21:17:42.504255 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 572/1113] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:41 2022] GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933 => generated 1541 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:42.522347 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-07c82969-9013-4915-88a3-0a76cd863ed3 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:42.537094 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-07c82969-9013-4915-88a3-0a76cd863ed3 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: a27111b2-863b-460b-9b89-ba08092d3561] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:42.558180 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-07c82969-9013-4915-88a3-0a76cd863ed3 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:42.561160 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-07c82969-9013-4915-88a3-0a76cd863ed3 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:42.563118 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-07c82969-9013-4915-88a3-0a76cd863ed3 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:42.566705 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-07c82969-9013-4915-88a3-0a76cd863ed3 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:42.617021 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-07c82969-9013-4915-88a3-0a76cd863ed3 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] HTTP exception thrown: Instance a27111b2-863b-460b-9b89-ba08092d3561 could not be found. Jul 23 21:17:42.619157 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-07c82969-9013-4915-88a3-0a76cd863ed3 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Request method failure captured: Jul 23 21:17:42.619157 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/servers/a27111b2-863b-460b-9b89-ba08092d3561 HTTP/1.1 Jul 23 21:17:42.619157 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:17:42.619157 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:17:42.619157 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:17:42.619157 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:17:42.619157 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:17:42.619157 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:17:42.619157 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:17:42.619157 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:17:42.619157 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GTXg43xsvaDpXj4BMz40UdSnpyPBTbhxj1IdGMcN1ZmThctVpX9T9iG6eRr9MGt1QTpmHEqYNbJp_e-y4RlWttw_Ug9gposZ1FVUrLfy9Hukeo6nEcrmiwqSETVX_CDHg3xVpH7dYYo0t5AjovoUMlG-_EeGSUlkV9963ANN9g-cqA Jul 23 21:17:42.619157 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:17:42.619157 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:17:42.619157 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:17:42.619157 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:17:42.619157 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:17:42.619157 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:17:42.619157 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: f5e7d37a0e3b4b32ae99c3bc15a831e6 Jul 23 21:17:42.619157 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ServersOnMultiNodesTest-62510325 Jul 23 21:17:42.619157 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:17:42.619157 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:17:42.620867 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f5e7d37a0e3b4b32ae99c3bc15a831e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f5e7d37a0e3b4b32ae99c3bc15a831e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f5e7d37a0e3b4b32ae99c3bc15a831e6", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f5e7d37a0e3b4b32ae99c3bc15a831e6"}]}] Jul 23 21:17:42.620867 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ServersOnMultiNodesTest-62510325 Jul 23 21:17:42.620867 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: f5e7d37a0e3b4b32ae99c3bc15a831e6 Jul 23 21:17:42.620867 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-62510325 Jul 23 21:17:42.620867 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ServersOnMultiNodesTest-62510325-project Jul 23 21:17:42.620867 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:17:42.620867 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:17:42.620867 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: ebf92af08fa94215b4eafcacea6c63f6 Jul 23 21:17:42.620867 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ServersOnMultiNodesTest-62510325-project Jul 23 21:17:42.620867 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:17:42.620867 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance a27111b2-863b-460b-9b89-ba08092d3561 could not be found. Jul 23 21:17:42.620867 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': 'a27111b2-863b-460b-9b89-ba08092d3561'} Jul 23 21:17:42.621759 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:17:42.621759 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:17:42.621759 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:17:42.621759 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:17:42.621759 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:17:42.621759 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:17:42.621759 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:17:42.621759 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:17:42.621759 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:17:42.621759 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:17:42.621759 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a27111b2-863b-460b-9b89-ba08092d3561 could not be found. Jul 23 21:17:42.621759 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:17:42.621759 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:17:42.621759 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:17:42.621759 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:17:42.621759 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:17:42.621759 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:17:42.621759 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:17:42.621759 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:17:42.621759 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:17:42.623243 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:17:42.623243 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:17:42.623243 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:17:42.623243 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:17:42.623243 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:17:42.623243 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:17:42.623243 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:17:42.623243 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a27111b2-863b-460b-9b89-ba08092d3561 could not be found. Jul 23 21:17:42.623243 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:17:42.623243 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:17:42.623243 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:17:42.623243 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:17:42.623243 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:17:42.623243 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:17:42.623243 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:17:42.623243 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:17:42.623243 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a27111b2-863b-460b-9b89-ba08092d3561 could not be found. Jul 23 21:17:42.623243 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:17:42.624534 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-07c82969-9013-4915-88a3-0a76cd863ed3 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Returning 404 to user: Instance a27111b2-863b-460b-9b89-ba08092d3561 could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:17:42.625248 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-07c82969-9013-4915-88a3-0a76cd863ed3 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "GET /compute/v2.1/servers/a27111b2-863b-460b-9b89-ba08092d3561" status: 404 len: 111 microversion: 2.1 time: 0.110419 Jul 23 21:17:42.626704 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 573/1114] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:42 2022] GET /compute/v2.1/servers/a27111b2-863b-460b-9b89-ba08092d3561 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:17:42.636359 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d6aa0463-d883-435b-b346-ccc91d8fc447 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:42.652784 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-d6aa0463-d883-435b-b346-ccc91d8fc447 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 34eaf1d2-9732-4c0e-b970-02fbb449514b] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:42.666827 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d6aa0463-d883-435b-b346-ccc91d8fc447 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:42.667333 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d6aa0463-d883-435b-b346-ccc91d8fc447 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:42.668318 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d6aa0463-d883-435b-b346-ccc91d8fc447 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:42.672271 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d6aa0463-d883-435b-b346-ccc91d8fc447 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:42.771578 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-88ced7fe-cac1-45dd-9950-eb6835c8b2ce tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd18a11b26ded436ab197043a4b90b276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454092f7aaf44ed3a3cdfba882e217b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:42.782219 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-88ced7fe-cac1-45dd-9950-eb6835c8b2ce tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] 10.222.0.17 "GET /compute/v2.1/servers/c9f5f0b3-e6bd-447f-9ada-0b34f3bae4fd" status: 200 len: 1316 microversion: 2.1 time: 0.429004 Jul 23 21:17:42.785080 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 542/1115] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:42 2022] GET /compute/v2.1/servers/c9f5f0b3-e6bd-447f-9ada-0b34f3bae4fd => generated 1316 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:42.790360 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-90ee29b5-8a9f-4f69-a694-8c1f001cf583 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:42.791094 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-90ee29b5-8a9f-4f69-a694-8c1f001cf583 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: c942eaa9-e288-44b7-b76c-afaf9b84b93d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:42.827463 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-90ee29b5-8a9f-4f69-a694-8c1f001cf583 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:42.828291 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-90ee29b5-8a9f-4f69-a694-8c1f001cf583 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:42.829326 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-90ee29b5-8a9f-4f69-a694-8c1f001cf583 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:42.830139 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-90ee29b5-8a9f-4f69-a694-8c1f001cf583 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:42.890974 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-90ee29b5-8a9f-4f69-a694-8c1f001cf583 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: c942eaa9-e288-44b7-b76c-afaf9b84b93d] Going to try to terminate instance {{(pid=131320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:17:43.044291 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-90ee29b5-8a9f-4f69-a694-8c1f001cf583 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "DELETE /compute/v2.1/servers/c942eaa9-e288-44b7-b76c-afaf9b84b93d" status: 204 len: 0 microversion: 2.1 time: 0.257526 Jul 23 21:17:43.048586 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 543/1116] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:17:42 2022] DELETE /compute/v2.1/servers/c942eaa9-e288-44b7-b76c-afaf9b84b93d => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:17:43.057835 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a244efab-01ad-4115-a92c-a675b9464117 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:43.058911 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a244efab-01ad-4115-a92c-a675b9464117 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: c942eaa9-e288-44b7-b76c-afaf9b84b93d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:43.067724 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a244efab-01ad-4115-a92c-a675b9464117 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:43.068396 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a244efab-01ad-4115-a92c-a675b9464117 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:43.073914 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a244efab-01ad-4115-a92c-a675b9464117 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:43.074762 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a244efab-01ad-4115-a92c-a675b9464117 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:43.351933 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a244efab-01ad-4115-a92c-a675b9464117 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf92af08fa94215b4eafcacea6c63f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e7d37a0e3b4b32ae99c3bc15a831e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:43.365536 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a244efab-01ad-4115-a92c-a675b9464117 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "GET /compute/v2.1/servers/c942eaa9-e288-44b7-b76c-afaf9b84b93d" status: 200 len: 1470 microversion: 2.1 time: 0.315620 Jul 23 21:17:43.368162 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 544/1117] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:43 2022] GET /compute/v2.1/servers/c942eaa9-e288-44b7-b76c-afaf9b84b93d => generated 1470 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:43.530865 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-68cc52c0-ba5e-49f3-a08f-b4a2807ca724 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Action: 'create', calling method: .version_select at 0x7f0b4777fdc0>, body: {"keypair": {"name": "tempest-keypair-252562887", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCtK/DxbFy49Y74W5cphfz4eoZG3gRkC21lJ6/tILEeCxDQBy48rSiFeFhW7I+y4H3WTt92t5qsRzugeM9CcdgRD6lJgmnX/4Gz51AlkACTLI1DzeQsEr9+e/n4sMhOC8w=="}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:17:43.545840 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-68cc52c0-ba5e-49f3-a08f-b4a2807ca724 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Getting quotas for project 3811ea868f5649e8a235539a5bf46706. Resources: {'key_pairs'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:17:43.547939 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-d6aa0463-d883-435b-b346-ccc91d8fc447 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:43.551407 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-68cc52c0-ba5e-49f3-a08f-b4a2807ca724 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Getting quotas for user fe3ad614d9d24300adb274cc95120fd3 and project 3811ea868f5649e8a235539a5bf46706. Resources: {'key_pairs'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:17:43.559196 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-d6aa0463-d883-435b-b346-ccc91d8fc447 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/34eaf1d2-9732-4c0e-b970-02fbb449514b" status: 200 len: 1718 microversion: 2.1 time: 0.926960 Jul 23 21:17:43.560505 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 574/1118] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:42 2022] GET /compute/v2.1/servers/34eaf1d2-9732-4c0e-b970-02fbb449514b => generated 1718 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:43.567328 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-2cca5b0a-7992-4d0a-9068-6e53ab9cbb90 req-bfacb271-7fdc-4002-91f3-1ee3a7346abf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "760fa31f-a0cf-46df-b456-3af5dc7f9933", "name": "network-vif-unplugged", "status": "completed", "tag": "0eaaed80-36fa-4393-8345-fc0c35160cb5"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:17:43.575948 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=2,nova_api:DELETE=6,nova_api:INSERT=4 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:17:43.578332 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-2cca5b0a-7992-4d0a-9068-6e53ab9cbb90 req-bfacb271-7fdc-4002-91f3-1ee3a7346abf service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:43.578840 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-2cca5b0a-7992-4d0a-9068-6e53ab9cbb90 req-bfacb271-7fdc-4002-91f3-1ee3a7346abf service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:43.588778 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-68cc52c0-ba5e-49f3-a08f-b4a2807ca724 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.214064 Jul 23 21:17:43.590061 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 545/1119] 10.222.0.17 () {60 vars in 1158 bytes} [Sat Jul 23 21:17:43 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:17:43.593724 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-2cca5b0a-7992-4d0a-9068-6e53ab9cbb90 req-bfacb271-7fdc-4002-91f3-1ee3a7346abf service nova] Creating event network-vif-unplugged:0eaaed80-36fa-4393-8345-fc0c35160cb5 for instance 760fa31f-a0cf-46df-b456-3af5dc7f9933 on nch1-master-1 Jul 23 21:17:43.600277 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [req-2cca5b0a-7992-4d0a-9068-6e53ab9cbb90 req-bfacb271-7fdc-4002-91f3-1ee3a7346abf service nova] Instance 760fa31f-a0cf-46df-b456-3af5dc7f9933 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1'} {{(pid=131321) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 23 21:17:43.608592 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-2cca5b0a-7992-4d0a-9068-6e53ab9cbb90 req-bfacb271-7fdc-4002-91f3-1ee3a7346abf service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046349 Jul 23 21:17:43.609843 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 575/1120] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:17:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:17:43.610581 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ce51c59d-6022-4369-b1cb-51c41c36d49c tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:43.612559 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ce51c59d-6022-4369-b1cb-51c41c36d49c tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 8025dc38-59d4-4296-b2c7-5aebb08eacae] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:43.617743 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-6f7a1d9f-8b17-4b66-aa17-4695e709cc11 req-c8290d57-4f72-4738-a9fb-f7c858834487 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9f5f0b3-e6bd-447f-9ada-0b34f3bae4fd", "tag": "a0ccd355-8441-4085-bdca-6a6ad08b732d"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:17:43.630479 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-6f7a1d9f-8b17-4b66-aa17-4695e709cc11 req-c8290d57-4f72-4738-a9fb-f7c858834487 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:43.631088 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-6f7a1d9f-8b17-4b66-aa17-4695e709cc11 req-c8290d57-4f72-4738-a9fb-f7c858834487 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:43.633845 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ce51c59d-6022-4369-b1cb-51c41c36d49c tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:43.637390 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ce51c59d-6022-4369-b1cb-51c41c36d49c tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:43.640004 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ce51c59d-6022-4369-b1cb-51c41c36d49c tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:43.641495 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ce51c59d-6022-4369-b1cb-51c41c36d49c tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:43.645018 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-6f7a1d9f-8b17-4b66-aa17-4695e709cc11 req-c8290d57-4f72-4738-a9fb-f7c858834487 service nova] Creating event network-changed:a0ccd355-8441-4085-bdca-6a6ad08b732d for instance c9f5f0b3-e6bd-447f-9ada-0b34f3bae4fd on nch2-master-1 Jul 23 21:17:43.651805 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-6f7a1d9f-8b17-4b66-aa17-4695e709cc11 req-c8290d57-4f72-4738-a9fb-f7c858834487 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039368 Jul 23 21:17:43.654866 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 576/1121] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:17:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:17:43.659547 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:17:43.662879 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-086c0849-face-4d80-957c-b19530d42a48 req-35bb237b-3319-4768-875d-e266853c0664 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34eaf1d2-9732-4c0e-b970-02fbb449514b", "name": "network-vif-unplugged", "status": "completed", "tag": "b09648fa-0071-4d7d-ba66-d0da81ab9768"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:17:43.672769 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-086c0849-face-4d80-957c-b19530d42a48 req-35bb237b-3319-4768-875d-e266853c0664 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:43.674363 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-086c0849-face-4d80-957c-b19530d42a48 req-35bb237b-3319-4768-875d-e266853c0664 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:43.694254 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-086c0849-face-4d80-957c-b19530d42a48 req-35bb237b-3319-4768-875d-e266853c0664 service nova] Creating event network-vif-unplugged:b09648fa-0071-4d7d-ba66-d0da81ab9768 for instance 34eaf1d2-9732-4c0e-b970-02fbb449514b on nch2-master-1 Jul 23 21:17:43.710039 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-086c0849-face-4d80-957c-b19530d42a48 req-35bb237b-3319-4768-875d-e266853c0664 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053328 Jul 23 21:17:43.710935 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 577/1122] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:17:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:17:43.719596 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-73ccf30e-9c1e-4fb1-a918-bd49ac9e57d4 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:43.720453 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-73ccf30e-9c1e-4fb1-a918-bd49ac9e57d4 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 760fa31f-a0cf-46df-b456-3af5dc7f9933] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:43.730806 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-73ccf30e-9c1e-4fb1-a918-bd49ac9e57d4 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:43.731455 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-73ccf30e-9c1e-4fb1-a918-bd49ac9e57d4 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:43.732581 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-73ccf30e-9c1e-4fb1-a918-bd49ac9e57d4 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:43.733067 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-73ccf30e-9c1e-4fb1-a918-bd49ac9e57d4 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:43.911999 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ce51c59d-6022-4369-b1cb-51c41c36d49c tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4f9dda4c2a411cb0394bf86e9ae223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580ed681cbf44d10936259b17f60f1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:43.921023 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ce51c59d-6022-4369-b1cb-51c41c36d49c tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/servers/8025dc38-59d4-4296-b2c7-5aebb08eacae" status: 200 len: 1476 microversion: 2.1 time: 0.329178 Jul 23 21:17:43.924166 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 546/1123] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:43 2022] GET /compute/v2.1/servers/8025dc38-59d4-4296-b2c7-5aebb08eacae => generated 1476 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:43.935266 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f5aa8244-ba5e-4ce8-89eb-cae25d3f172e tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:43.935928 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f5aa8244-ba5e-4ce8-89eb-cae25d3f172e tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] [instance: c9f5f0b3-e6bd-447f-9ada-0b34f3bae4fd] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:43.949969 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f5aa8244-ba5e-4ce8-89eb-cae25d3f172e tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:43.950785 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f5aa8244-ba5e-4ce8-89eb-cae25d3f172e tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:43.964189 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f5aa8244-ba5e-4ce8-89eb-cae25d3f172e tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:43.964741 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f5aa8244-ba5e-4ce8-89eb-cae25d3f172e tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:44.298413 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-73ccf30e-9c1e-4fb1-a918-bd49ac9e57d4 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:44.307379 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-73ccf30e-9c1e-4fb1-a918-bd49ac9e57d4 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933" status: 200 len: 1541 microversion: 2.1 time: 0.595208 Jul 23 21:17:44.308079 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 578/1124] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:43 2022] GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933 => generated 1541 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:44.313655 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-55199cf0-4ec3-422a-aac7-df7fce9b4ed5 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-102331054"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:17:44.314838 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-55199cf0-4ec3-422a-aac7-df7fce9b4ed5 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 8025dc38-59d4-4296-b2c7-5aebb08eacae] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:44.321235 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-55199cf0-4ec3-422a-aac7-df7fce9b4ed5 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:44.321770 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-55199cf0-4ec3-422a-aac7-df7fce9b4ed5 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:44.322780 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-55199cf0-4ec3-422a-aac7-df7fce9b4ed5 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:44.323476 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-55199cf0-4ec3-422a-aac7-df7fce9b4ed5 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:44.444856 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f5aa8244-ba5e-4ce8-89eb-cae25d3f172e tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd18a11b26ded436ab197043a4b90b276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454092f7aaf44ed3a3cdfba882e217b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:44.459152 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f5aa8244-ba5e-4ce8-89eb-cae25d3f172e tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] 10.222.0.17 "GET /compute/v2.1/servers/c9f5f0b3-e6bd-447f-9ada-0b34f3bae4fd" status: 200 len: 1316 microversion: 2.1 time: 0.533035 Jul 23 21:17:44.461617 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 547/1125] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:43 2022] GET /compute/v2.1/servers/c9f5f0b3-e6bd-447f-9ada-0b34f3bae4fd => generated 1316 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:44.471330 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-7e13ac3b-3195-4ba2-962f-458fabafe474 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:44.473276 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-7e13ac3b-3195-4ba2-962f-458fabafe474 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] [instance: a6de755e-739d-437c-aafb-6bc49f8bb086] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:44.483175 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7e13ac3b-3195-4ba2-962f-458fabafe474 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:44.484655 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7e13ac3b-3195-4ba2-962f-458fabafe474 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:44.485984 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7e13ac3b-3195-4ba2-962f-458fabafe474 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:44.486650 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7e13ac3b-3195-4ba2-962f-458fabafe474 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:44.662301 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-55199cf0-4ec3-422a-aac7-df7fce9b4ed5 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "POST /compute/v2.1/servers/8025dc38-59d4-4296-b2c7-5aebb08eacae/action" status: 202 len: 0 microversion: 2.1 time: 0.352572 Jul 23 21:17:44.663885 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 579/1126] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:17:44 2022] POST /compute/v2.1/servers/8025dc38-59d4-4296-b2c7-5aebb08eacae/action => generated 0 bytes in 355 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 23 21:17:44.669290 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-5b6408d5-f5c1-4304-b313-4d61b658c66c tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:44.670343 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-5b6408d5-f5c1-4304-b313-4d61b658c66c tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: c942eaa9-e288-44b7-b76c-afaf9b84b93d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:44.678463 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5b6408d5-f5c1-4304-b313-4d61b658c66c tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:44.679228 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5b6408d5-f5c1-4304-b313-4d61b658c66c tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:44.680217 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5b6408d5-f5c1-4304-b313-4d61b658c66c tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:44.680840 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5b6408d5-f5c1-4304-b313-4d61b658c66c tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:44.964065 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.objects.instance [None req-7e13ac3b-3195-4ba2-962f-458fabafe474 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lazy-loading 'services' on Instance uuid a6de755e-739d-437c-aafb-6bc49f8bb086 {{(pid=131320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:17:44.978197 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-7e13ac3b-3195-4ba2-962f-458fabafe474 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/a6de755e-739d-437c-aafb-6bc49f8bb086" status: 200 len: 2425 microversion: 2.25 time: 0.513130 Jul 23 21:17:44.978790 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 548/1127] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:17:44 2022] GET /compute/v2.1/servers/a6de755e-739d-437c-aafb-6bc49f8bb086 => generated 2425 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:17:44.996600 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6da9219a-4994-4835-82b3-5d2f528274bb tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:44.997425 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6da9219a-4994-4835-82b3-5d2f528274bb tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 34eaf1d2-9732-4c0e-b970-02fbb449514b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:45.004863 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6da9219a-4994-4835-82b3-5d2f528274bb tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:45.005766 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6da9219a-4994-4835-82b3-5d2f528274bb tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:45.006743 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6da9219a-4994-4835-82b3-5d2f528274bb tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:45.007459 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6da9219a-4994-4835-82b3-5d2f528274bb tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:45.182489 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-5b6408d5-f5c1-4304-b313-4d61b658c66c tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf92af08fa94215b4eafcacea6c63f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e7d37a0e3b4b32ae99c3bc15a831e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:45.197161 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-5b6408d5-f5c1-4304-b313-4d61b658c66c tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "GET /compute/v2.1/servers/c942eaa9-e288-44b7-b76c-afaf9b84b93d" status: 200 len: 1470 microversion: 2.1 time: 0.531814 Jul 23 21:17:45.204201 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 580/1128] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:44 2022] GET /compute/v2.1/servers/c942eaa9-e288-44b7-b76c-afaf9b84b93d => generated 1470 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:45.216186 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-111cf7bd-5dc3-469d-8fe0-b9b9f1da39cd tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '.version_select at 0x7f0b47e50ee0>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:45.271214 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-111cf7bd-5dc3-469d-8fe0-b9b9f1da39cd tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/images/b69f77e0-151c-4769-8791-18d7474c1ded" status: 200 len: 1413 microversion: 2.1 time: 0.064798 Jul 23 21:17:45.271731 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 581/1129] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:17:45 2022] GET /compute/v2.1/images/b69f77e0-151c-4769-8791-18d7474c1ded => generated 1413 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:45.281333 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-5d6cdb3b-31a0-4e55-baa1-d53a80cdeab3 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": "auto"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:17:45.283207 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-5d6cdb3b-31a0-4e55-baa1-d53a80cdeab3 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] [instance: a6de755e-739d-437c-aafb-6bc49f8bb086] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:45.291616 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5d6cdb3b-31a0-4e55-baa1-d53a80cdeab3 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:45.292355 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5d6cdb3b-31a0-4e55-baa1-d53a80cdeab3 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:45.293429 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5d6cdb3b-31a0-4e55-baa1-d53a80cdeab3 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:45.294084 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5d6cdb3b-31a0-4e55-baa1-d53a80cdeab3 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:45.325331 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.objects.instance [None req-5d6cdb3b-31a0-4e55-baa1-d53a80cdeab3 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lazy-loading 'flavor' on Instance uuid a6de755e-739d-437c-aafb-6bc49f8bb086 {{(pid=131321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:17:45.343172 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-5d6cdb3b-31a0-4e55-baa1-d53a80cdeab3 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] [instance: a6de755e-739d-437c-aafb-6bc49f8bb086] Going to try to live migrate instance to nch2-master-1 {{(pid=131321) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 23 21:17:45.548691 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6da9219a-4994-4835-82b3-5d2f528274bb tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:45.566046 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6da9219a-4994-4835-82b3-5d2f528274bb tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/34eaf1d2-9732-4c0e-b970-02fbb449514b" status: 200 len: 1718 microversion: 2.1 time: 0.573359 Jul 23 21:17:45.567461 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 549/1130] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:44 2022] GET /compute/v2.1/servers/34eaf1d2-9732-4c0e-b970-02fbb449514b => generated 1718 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:45.575660 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2748f6bf-6453-4f90-81ae-a17fd03ff9e4 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:45.576576 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-2748f6bf-6453-4f90-81ae-a17fd03ff9e4 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 760fa31f-a0cf-46df-b456-3af5dc7f9933] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:45.586734 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2748f6bf-6453-4f90-81ae-a17fd03ff9e4 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:45.587660 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2748f6bf-6453-4f90-81ae-a17fd03ff9e4 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:45.596265 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2748f6bf-6453-4f90-81ae-a17fd03ff9e4 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:45.597372 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2748f6bf-6453-4f90-81ae-a17fd03ff9e4 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:45.642704 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:17:46.456142 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell0:SELECT=2 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:17:46.487597 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-2748f6bf-6453-4f90-81ae-a17fd03ff9e4 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:46.515157 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2748f6bf-6453-4f90-81ae-a17fd03ff9e4 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933" status: 200 len: 1473 microversion: 2.1 time: 0.933309 Jul 23 21:17:46.517519 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 550/1131] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:45 2022] GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933 => generated 1473 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:46.539846 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e0964ff8-f0ea-4779-9650-e2f6b5bf8580 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:46.542113 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e0964ff8-f0ea-4779-9650-e2f6b5bf8580 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] [instance: c9f5f0b3-e6bd-447f-9ada-0b34f3bae4fd] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:46.554123 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e0964ff8-f0ea-4779-9650-e2f6b5bf8580 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:46.556069 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e0964ff8-f0ea-4779-9650-e2f6b5bf8580 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:46.558332 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e0964ff8-f0ea-4779-9650-e2f6b5bf8580 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:46.559579 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e0964ff8-f0ea-4779-9650-e2f6b5bf8580 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:47.252326 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e0964ff8-f0ea-4779-9650-e2f6b5bf8580 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd18a11b26ded436ab197043a4b90b276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454092f7aaf44ed3a3cdfba882e217b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:47.267757 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e0964ff8-f0ea-4779-9650-e2f6b5bf8580 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] 10.222.0.17 "GET /compute/v2.1/servers/c9f5f0b3-e6bd-447f-9ada-0b34f3bae4fd" status: 200 len: 1316 microversion: 2.1 time: 0.746759 Jul 23 21:17:47.270865 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 551/1132] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:46 2022] GET /compute/v2.1/servers/c9f5f0b3-e6bd-447f-9ada-0b34f3bae4fd => generated 1316 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:47.276743 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b930c18c-92f1-4429-bcca-78dfbe07d894 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:47.277636 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b930c18c-92f1-4429-bcca-78dfbe07d894 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: c942eaa9-e288-44b7-b76c-afaf9b84b93d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:47.286922 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b930c18c-92f1-4429-bcca-78dfbe07d894 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:47.287604 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b930c18c-92f1-4429-bcca-78dfbe07d894 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:47.290455 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b930c18c-92f1-4429-bcca-78dfbe07d894 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:47.291267 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b930c18c-92f1-4429-bcca-78dfbe07d894 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:47.344815 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b930c18c-92f1-4429-bcca-78dfbe07d894 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:47.345497 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b930c18c-92f1-4429-bcca-78dfbe07d894 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:47.346162 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.objects.instance [None req-b930c18c-92f1-4429-bcca-78dfbe07d894 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lazy-loading 'fault' on Instance uuid c942eaa9-e288-44b7-b76c-afaf9b84b93d {{(pid=131320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:17:47.429794 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b930c18c-92f1-4429-bcca-78dfbe07d894 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf92af08fa94215b4eafcacea6c63f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e7d37a0e3b4b32ae99c3bc15a831e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:47.443381 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b930c18c-92f1-4429-bcca-78dfbe07d894 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "GET /compute/v2.1/servers/c942eaa9-e288-44b7-b76c-afaf9b84b93d" status: 200 len: 1306 microversion: 2.1 time: 0.171044 Jul 23 21:17:47.444247 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 552/1133] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:47 2022] GET /compute/v2.1/servers/c942eaa9-e288-44b7-b76c-afaf9b84b93d => generated 1306 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:47.448745 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a24e7297-0f6e-4a0b-9464-2fcc8846fc19 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '.version_select at 0x7f0b4775b700>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:47.496293 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a24e7297-0f6e-4a0b-9464-2fcc8846fc19 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/images/b69f77e0-151c-4769-8791-18d7474c1ded" status: 200 len: 1413 microversion: 2.1 time: 0.051088 Jul 23 21:17:47.497125 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 553/1134] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:17:47 2022] GET /compute/v2.1/images/b69f77e0-151c-4769-8791-18d7474c1ded => generated 1413 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:47.502566 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4bd06c13-62d9-4e18-90ca-ab8d96ffab58 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:47.503121 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-4bd06c13-62d9-4e18-90ca-ab8d96ffab58 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 34eaf1d2-9732-4c0e-b970-02fbb449514b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:47.509652 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4bd06c13-62d9-4e18-90ca-ab8d96ffab58 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:47.509973 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4bd06c13-62d9-4e18-90ca-ab8d96ffab58 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:47.510932 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4bd06c13-62d9-4e18-90ca-ab8d96ffab58 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:47.511370 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4bd06c13-62d9-4e18-90ca-ab8d96ffab58 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:47.736828 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-5d6cdb3b-31a0-4e55-baa1-d53a80cdeab3 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/a6de755e-739d-437c-aafb-6bc49f8bb086/action" status: 202 len: 0 microversion: 2.25 time: 2.463719 Jul 23 21:17:47.738857 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 582/1135] 10.222.0.17 () {62 vars in 1318 bytes} [Sat Jul 23 21:17:45 2022] POST /compute/v2.1/servers/a6de755e-739d-437c-aafb-6bc49f8bb086/action => generated 0 bytes in 2466 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:17:47.755451 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-dc8aeae7-fe6e-4148-b35b-fa4ba8a647de req-8c3b520b-c0a4-4607-b3af-2b572294ae34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c942eaa9-e288-44b7-b76c-afaf9b84b93d", "name": "network-vif-deleted", "tag": "7388a4be-59a7-4cfd-ad2c-a6b3f952a32c"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:17:47.792054 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:17:47.795258 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-dc8aeae7-fe6e-4148-b35b-fa4ba8a647de req-8c3b520b-c0a4-4607-b3af-2b572294ae34 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:47.799415 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-dc8aeae7-fe6e-4148-b35b-fa4ba8a647de req-8c3b520b-c0a4-4607-b3af-2b572294ae34 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:47.832066 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-dc8aeae7-fe6e-4148-b35b-fa4ba8a647de req-8c3b520b-c0a4-4607-b3af-2b572294ae34 service nova] Creating event network-vif-deleted:7388a4be-59a7-4cfd-ad2c-a6b3f952a32c for instance c942eaa9-e288-44b7-b76c-afaf9b84b93d on nch2-master-1 Jul 23 21:17:47.835130 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-4bd06c13-62d9-4e18-90ca-ab8d96ffab58 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:47.844120 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4bd06c13-62d9-4e18-90ca-ab8d96ffab58 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/34eaf1d2-9732-4c0e-b970-02fbb449514b" status: 200 len: 1718 microversion: 2.1 time: 0.345579 Jul 23 21:17:47.844724 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 554/1136] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:47 2022] GET /compute/v2.1/servers/34eaf1d2-9732-4c0e-b970-02fbb449514b => generated 1718 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:47.846502 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-dc8aeae7-fe6e-4148-b35b-fa4ba8a647de req-8c3b520b-c0a4-4607-b3af-2b572294ae34 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104351 Jul 23 21:17:47.847566 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 583/1137] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:17:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:17:47.853649 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-59fd01a2-0b22-4a82-991e-a7236c2ff807 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:47.854747 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-59fd01a2-0b22-4a82-991e-a7236c2ff807 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: a6de755e-739d-437c-aafb-6bc49f8bb086] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:47.857938 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9e57e1ef-929e-4b19-b6c3-995cc6976f22 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:47.858198 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-9e57e1ef-929e-4b19-b6c3-995cc6976f22 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 760fa31f-a0cf-46df-b456-3af5dc7f9933] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:47.866849 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-59fd01a2-0b22-4a82-991e-a7236c2ff807 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:47.867659 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-59fd01a2-0b22-4a82-991e-a7236c2ff807 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:47.868673 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-59fd01a2-0b22-4a82-991e-a7236c2ff807 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:47.871752 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-59fd01a2-0b22-4a82-991e-a7236c2ff807 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:47.875463 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9e57e1ef-929e-4b19-b6c3-995cc6976f22 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:47.876643 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9e57e1ef-929e-4b19-b6c3-995cc6976f22 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:47.877621 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9e57e1ef-929e-4b19-b6c3-995cc6976f22 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:47.879656 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9e57e1ef-929e-4b19-b6c3-995cc6976f22 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:48.306490 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-59fd01a2-0b22-4a82-991e-a7236c2ff807 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:48.316469 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-59fd01a2-0b22-4a82-991e-a7236c2ff807 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:48.318346 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-59fd01a2-0b22-4a82-991e-a7236c2ff807 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:48.319931 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-59fd01a2-0b22-4a82-991e-a7236c2ff807 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/a6de755e-739d-437c-aafb-6bc49f8bb086" status: 200 len: 1816 microversion: 2.25 time: 0.470842 Jul 23 21:17:48.330813 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 584/1138] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:17:47 2022] GET /compute/v2.1/servers/a6de755e-739d-437c-aafb-6bc49f8bb086 => generated 1816 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:17:48.338438 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-bd1d3c69-c1aa-4533-b9cf-1b2f2de92f6b tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:48.339941 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-bd1d3c69-c1aa-4533-b9cf-1b2f2de92f6b tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] [instance: c9f5f0b3-e6bd-447f-9ada-0b34f3bae4fd] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:48.348523 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bd1d3c69-c1aa-4533-b9cf-1b2f2de92f6b tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:48.350035 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bd1d3c69-c1aa-4533-b9cf-1b2f2de92f6b tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:48.351928 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bd1d3c69-c1aa-4533-b9cf-1b2f2de92f6b tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:48.352628 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bd1d3c69-c1aa-4533-b9cf-1b2f2de92f6b tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:48.570959 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-bd1d3c69-c1aa-4533-b9cf-1b2f2de92f6b tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd18a11b26ded436ab197043a4b90b276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454092f7aaf44ed3a3cdfba882e217b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:48.579189 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-bd1d3c69-c1aa-4533-b9cf-1b2f2de92f6b tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] 10.222.0.17 "GET /compute/v2.1/servers/c9f5f0b3-e6bd-447f-9ada-0b34f3bae4fd" status: 200 len: 1316 microversion: 2.1 time: 0.246865 Jul 23 21:17:48.580052 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 585/1139] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:48 2022] GET /compute/v2.1/servers/c9f5f0b3-e6bd-447f-9ada-0b34f3bae4fd => generated 1316 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:48.586190 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-9e57e1ef-929e-4b19-b6c3-995cc6976f22 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:48.593060 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c0ce8e50-ad8f-47bb-885e-3619e1874a1f tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:48.597801 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9e57e1ef-929e-4b19-b6c3-995cc6976f22 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933" status: 200 len: 1470 microversion: 2.1 time: 0.751945 Jul 23 21:17:48.598802 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 555/1140] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:47 2022] GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933 => generated 1470 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:48.603486 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e2d68213-1eb3-4193-8f9a-3c1e420e9758 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '.version_select at 0x7f0b4779a3a0>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:48.606340 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-c0ce8e50-ad8f-47bb-885e-3619e1874a1f tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: c942eaa9-e288-44b7-b76c-afaf9b84b93d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:48.613160 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c0ce8e50-ad8f-47bb-885e-3619e1874a1f tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:48.613605 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c0ce8e50-ad8f-47bb-885e-3619e1874a1f tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:48.618948 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c0ce8e50-ad8f-47bb-885e-3619e1874a1f tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:48.620144 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c0ce8e50-ad8f-47bb-885e-3619e1874a1f tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:48.636187 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-c0ce8e50-ad8f-47bb-885e-3619e1874a1f tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] HTTP exception thrown: Instance c942eaa9-e288-44b7-b76c-afaf9b84b93d could not be found. Jul 23 21:17:48.638413 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c0ce8e50-ad8f-47bb-885e-3619e1874a1f tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Request method failure captured: Jul 23 21:17:48.638413 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/servers/c942eaa9-e288-44b7-b76c-afaf9b84b93d HTTP/1.1 Jul 23 21:17:48.638413 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:17:48.638413 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:17:48.638413 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:17:48.638413 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:17:48.638413 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:17:48.638413 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:17:48.638413 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:17:48.638413 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:17:48.638413 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GTXg43xsvaDpXj4BMz40UdSnpyPBTbhxj1IdGMcN1ZmThctVpX9T9iG6eRr9MGt1QTpmHEqYNbJp_e-y4RlWttw_Ug9gposZ1FVUrLfy9Hukeo6nEcrmiwqSETVX_CDHg3xVpH7dYYo0t5AjovoUMlG-_EeGSUlkV9963ANN9g-cqA Jul 23 21:17:48.638413 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:17:48.638413 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:17:48.638413 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:17:48.638413 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:17:48.638413 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:17:48.638413 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:17:48.638413 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: f5e7d37a0e3b4b32ae99c3bc15a831e6 Jul 23 21:17:48.638413 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ServersOnMultiNodesTest-62510325 Jul 23 21:17:48.638413 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:17:48.638413 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:17:48.639885 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f5e7d37a0e3b4b32ae99c3bc15a831e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f5e7d37a0e3b4b32ae99c3bc15a831e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f5e7d37a0e3b4b32ae99c3bc15a831e6", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f5e7d37a0e3b4b32ae99c3bc15a831e6"}]}] Jul 23 21:17:48.639885 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ServersOnMultiNodesTest-62510325 Jul 23 21:17:48.639885 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: f5e7d37a0e3b4b32ae99c3bc15a831e6 Jul 23 21:17:48.639885 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-62510325 Jul 23 21:17:48.639885 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ServersOnMultiNodesTest-62510325-project Jul 23 21:17:48.639885 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:17:48.639885 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:17:48.639885 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: ebf92af08fa94215b4eafcacea6c63f6 Jul 23 21:17:48.639885 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ServersOnMultiNodesTest-62510325-project Jul 23 21:17:48.639885 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:17:48.639885 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance c942eaa9-e288-44b7-b76c-afaf9b84b93d could not be found. Jul 23 21:17:48.639885 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': 'c942eaa9-e288-44b7-b76c-afaf9b84b93d'} Jul 23 21:17:48.640592 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:17:48.640592 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:17:48.640592 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:17:48.640592 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:17:48.640592 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:17:48.640592 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:17:48.640592 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:17:48.640592 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:17:48.640592 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:17:48.640592 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:17:48.640592 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c942eaa9-e288-44b7-b76c-afaf9b84b93d could not be found. Jul 23 21:17:48.640592 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:17:48.640592 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:17:48.640592 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:17:48.640592 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:17:48.640592 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:17:48.640592 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:17:48.640592 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:17:48.640592 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:17:48.640592 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:17:48.641840 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:17:48.641840 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:17:48.641840 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:17:48.641840 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:17:48.641840 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:17:48.641840 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:17:48.641840 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:17:48.641840 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c942eaa9-e288-44b7-b76c-afaf9b84b93d could not be found. Jul 23 21:17:48.641840 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:17:48.641840 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:17:48.641840 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:17:48.641840 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:17:48.641840 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:17:48.641840 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:17:48.641840 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:17:48.641840 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:17:48.641840 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c942eaa9-e288-44b7-b76c-afaf9b84b93d could not be found. Jul 23 21:17:48.641840 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:17:48.644195 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c0ce8e50-ad8f-47bb-885e-3619e1874a1f tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Returning 404 to user: Instance c942eaa9-e288-44b7-b76c-afaf9b84b93d could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:17:48.645338 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-c0ce8e50-ad8f-47bb-885e-3619e1874a1f tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "GET /compute/v2.1/servers/c942eaa9-e288-44b7-b76c-afaf9b84b93d" status: 404 len: 111 microversion: 2.1 time: 0.064076 Jul 23 21:17:48.646471 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 586/1141] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:48 2022] GET /compute/v2.1/servers/c942eaa9-e288-44b7-b76c-afaf9b84b93d => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:17:48.657645 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d93ac064-2d29-4759-8b3d-cb1b45cdcf62 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:17:48.658533 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-d93ac064-2d29-4759-8b3d-cb1b45cdcf62 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 760fa31f-a0cf-46df-b456-3af5dc7f9933] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:48.668038 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d93ac064-2d29-4759-8b3d-cb1b45cdcf62 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:48.668804 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d93ac064-2d29-4759-8b3d-cb1b45cdcf62 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:48.670745 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e2d68213-1eb3-4193-8f9a-3c1e420e9758 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/images/b69f77e0-151c-4769-8791-18d7474c1ded" status: 200 len: 1413 microversion: 2.1 time: 0.070714 Jul 23 21:17:48.671353 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d93ac064-2d29-4759-8b3d-cb1b45cdcf62 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:48.671618 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 556/1142] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:17:48 2022] GET /compute/v2.1/images/b69f77e0-151c-4769-8791-18d7474c1ded => generated 1413 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:48.672143 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d93ac064-2d29-4759-8b3d-cb1b45cdcf62 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:48.676230 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-bd257245-967c-4226-93c7-1bbdcb776ae7 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:48.676770 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-bd257245-967c-4226-93c7-1bbdcb776ae7 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: 5bbeec29-35ee-44ca-a0f0-3dbe2198e5bf] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:48.683632 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bd257245-967c-4226-93c7-1bbdcb776ae7 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:48.684116 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bd257245-967c-4226-93c7-1bbdcb776ae7 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:48.684898 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bd257245-967c-4226-93c7-1bbdcb776ae7 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:48.685313 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bd257245-967c-4226-93c7-1bbdcb776ae7 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:48.727509 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-bd257245-967c-4226-93c7-1bbdcb776ae7 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: 5bbeec29-35ee-44ca-a0f0-3dbe2198e5bf] Going to try to terminate instance {{(pid=131320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:17:48.772521 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d93ac064-2d29-4759-8b3d-cb1b45cdcf62 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:48.773906 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d93ac064-2d29-4759-8b3d-cb1b45cdcf62 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:48.777268 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d93ac064-2d29-4759-8b3d-cb1b45cdcf62 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:48.777268 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d93ac064-2d29-4759-8b3d-cb1b45cdcf62 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:48.857052 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:17:48.864473 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-d93ac064-2d29-4759-8b3d-cb1b45cdcf62 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Getting quotas for project 5935212e8b6a40768ee3fc90807b0cb1. Resources: {'ram', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:17:48.880024 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-d93ac064-2d29-4759-8b3d-cb1b45cdcf62 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Getting quotas for user 0133d9533fbd4be5b46dc308dbe3a7d9 and project 5935212e8b6a40768ee3fc90807b0cb1. Resources: {'ram', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:17:48.880676 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-bd257245-967c-4226-93c7-1bbdcb776ae7 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "DELETE /compute/v2.1/servers/5bbeec29-35ee-44ca-a0f0-3dbe2198e5bf" status: 204 len: 0 microversion: 2.1 time: 0.207107 Jul 23 21:17:48.881283 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 557/1143] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:17:48 2022] DELETE /compute/v2.1/servers/5bbeec29-35ee-44ca-a0f0-3dbe2198e5bf => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:17:48.894820 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-64895cc1-901b-4d00-95b3-60cd5b7bf8f2 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-118344885", "imageRef": "babc81e1-ca78-4919-b9c2-82b2fc7c675e", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "2ea44983-3bd4-4b9c-a1d8-c4e6bcb08901"}], "security_groups": [{"name": "tempest-securitygroup--882685904"}], "key_name": "tempest-keypair-252562887", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:17:49.053812 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-64895cc1-901b-4d00-95b3-60cd5b7bf8f2 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] validate_networks() for [('2ea44983-3bd4-4b9c-a1d8-c4e6bcb08901', None, None, None, None, None)] {{(pid=131320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:17:49.057221 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-d93ac064-2d29-4759-8b3d-cb1b45cdcf62 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "POST /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933/action" status: 202 len: 0 microversion: 2.1 time: 0.409329 Jul 23 21:17:49.058176 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 587/1144] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:17:48 2022] POST /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933/action => generated 0 bytes in 411 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:17:49.065127 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a8f6f5d1-26cb-4325-af4a-fdfb9e08103e tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:49.066127 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-a8f6f5d1-26cb-4325-af4a-fdfb9e08103e tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 34eaf1d2-9732-4c0e-b970-02fbb449514b] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:49.076586 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a8f6f5d1-26cb-4325-af4a-fdfb9e08103e tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:49.077283 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a8f6f5d1-26cb-4325-af4a-fdfb9e08103e tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:49.078334 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a8f6f5d1-26cb-4325-af4a-fdfb9e08103e tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:49.078984 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a8f6f5d1-26cb-4325-af4a-fdfb9e08103e tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:49.323916 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-a8f6f5d1-26cb-4325-af4a-fdfb9e08103e tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:49.339175 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-a8f6f5d1-26cb-4325-af4a-fdfb9e08103e tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/34eaf1d2-9732-4c0e-b970-02fbb449514b" status: 200 len: 1708 microversion: 2.1 time: 0.279603 Jul 23 21:17:49.340240 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 588/1145] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:49 2022] GET /compute/v2.1/servers/34eaf1d2-9732-4c0e-b970-02fbb449514b => generated 1708 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:49.345447 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-81ff378c-e075-414c-871a-0cbabe16a558 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:49.348112 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-81ff378c-e075-414c-871a-0cbabe16a558 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: 36204b8b-c78e-447c-a3e7-f1f22c6ffe1f] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:49.377368 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-81ff378c-e075-414c-871a-0cbabe16a558 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:49.379110 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-81ff378c-e075-414c-871a-0cbabe16a558 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:49.380285 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-81ff378c-e075-414c-871a-0cbabe16a558 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:49.380913 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-81ff378c-e075-414c-871a-0cbabe16a558 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:49.479228 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-81ff378c-e075-414c-871a-0cbabe16a558 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: 36204b8b-c78e-447c-a3e7-f1f22c6ffe1f] Going to try to terminate instance {{(pid=131321) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:17:49.648137 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-81ff378c-e075-414c-871a-0cbabe16a558 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "DELETE /compute/v2.1/servers/36204b8b-c78e-447c-a3e7-f1f22c6ffe1f" status: 204 len: 0 microversion: 2.1 time: 0.306214 Jul 23 21:17:49.649409 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 589/1146] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:17:49 2022] DELETE /compute/v2.1/servers/36204b8b-c78e-447c-a3e7-f1f22c6ffe1f => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:17:49.661985 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-52d64050-de8b-4625-90c5-596ea6c3a638 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:49.662704 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-52d64050-de8b-4625-90c5-596ea6c3a638 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 760fa31f-a0cf-46df-b456-3af5dc7f9933] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:49.677261 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-52d64050-de8b-4625-90c5-596ea6c3a638 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:49.681634 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-52d64050-de8b-4625-90c5-596ea6c3a638 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:49.685051 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-52d64050-de8b-4625-90c5-596ea6c3a638 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:49.685521 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-52d64050-de8b-4625-90c5-596ea6c3a638 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:49.967684 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-64895cc1-901b-4d00-95b3-60cd5b7bf8f2 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:17:49.969334 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-64895cc1-901b-4d00-95b3-60cd5b7bf8f2 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:17:49.970258 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-64895cc1-901b-4d00-95b3-60cd5b7bf8f2 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:17:49.970856 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-64895cc1-901b-4d00-95b3-60cd5b7bf8f2 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:17:49.971866 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-64895cc1-901b-4d00-95b3-60cd5b7bf8f2 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:17:49.983623 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-64895cc1-901b-4d00-95b3-60cd5b7bf8f2 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:49.984284 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-64895cc1-901b-4d00-95b3-60cd5b7bf8f2 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:49.985491 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-64895cc1-901b-4d00-95b3-60cd5b7bf8f2 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:49.986184 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-64895cc1-901b-4d00-95b3-60cd5b7bf8f2 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:50.007890 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-64895cc1-901b-4d00-95b3-60cd5b7bf8f2 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Getting quotas for project 3811ea868f5649e8a235539a5bf46706. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:17:50.013938 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-64895cc1-901b-4d00-95b3-60cd5b7bf8f2 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Getting quotas for user fe3ad614d9d24300adb274cc95120fd3 and project 3811ea868f5649e8a235539a5bf46706. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:17:50.031872 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-64895cc1-901b-4d00-95b3-60cd5b7bf8f2 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Going to run 1 instances... {{(pid=131320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:17:50.035228 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-64895cc1-901b-4d00-95b3-60cd5b7bf8f2 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] [instance: e753b3c8-e63a-48d5-a349-fa19db134404] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='babc81e1-ca78-4919-b9c2-82b2fc7c675e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:17:50.066116 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-52d64050-de8b-4625-90c5-596ea6c3a638 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:50.085317 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-52d64050-de8b-4625-90c5-596ea6c3a638 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933" status: 200 len: 1469 microversion: 2.1 time: 0.434398 Jul 23 21:17:50.089690 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 590/1147] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:49 2022] GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933 => generated 1469 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:50.105423 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-34f7e2de-46d6-4a65-a0e2-27d89fae0ce7 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:50.114482 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-34f7e2de-46d6-4a65-a0e2-27d89fae0ce7 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: a6de755e-739d-437c-aafb-6bc49f8bb086] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:50.132315 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-64895cc1-901b-4d00-95b3-60cd5b7bf8f2 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.249432 Jul 23 21:17:50.148872 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 558/1148] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:17:48 2022] POST /compute/v2.1/servers => generated 405 bytes in 1266 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 23 21:17:50.155051 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9ad194ae-2e60-44e6-b090-99bc16d288a2 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Calling method '.version_select at 0x7f0b47772d30>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:50.164827 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9ad194ae-2e60-44e6-b090-99bc16d288a2 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:50.165298 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9ad194ae-2e60-44e6-b090-99bc16d288a2 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:50.168493 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-34f7e2de-46d6-4a65-a0e2-27d89fae0ce7 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:50.173382 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-34f7e2de-46d6-4a65-a0e2-27d89fae0ce7 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:50.195721 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-34f7e2de-46d6-4a65-a0e2-27d89fae0ce7 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:50.198644 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-34f7e2de-46d6-4a65-a0e2-27d89fae0ce7 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:50.199274 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9ad194ae-2e60-44e6-b090-99bc16d288a2 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] 10.222.0.17 "GET /compute/v2.1/os-migrations" status: 200 len: 3497 microversion: 2.1 time: 0.048264 Jul 23 21:17:50.199538 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 559/1149] 10.222.0.17 () {58 vars in 1142 bytes} [Sat Jul 23 21:17:50 2022] GET /compute/v2.1/os-migrations => generated 3497 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:50.228372 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-dda8bcf1-a8d2-4150-b12c-a4927025c346 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:50.229010 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-dda8bcf1-a8d2-4150-b12c-a4927025c346 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] [instance: c9f5f0b3-e6bd-447f-9ada-0b34f3bae4fd] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:50.268757 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dda8bcf1-a8d2-4150-b12c-a4927025c346 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:50.269314 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dda8bcf1-a8d2-4150-b12c-a4927025c346 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:50.272882 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dda8bcf1-a8d2-4150-b12c-a4927025c346 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:50.275391 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dda8bcf1-a8d2-4150-b12c-a4927025c346 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:50.738358 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-34f7e2de-46d6-4a65-a0e2-27d89fae0ce7 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:50.762908 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-34f7e2de-46d6-4a65-a0e2-27d89fae0ce7 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:50.765701 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-34f7e2de-46d6-4a65-a0e2-27d89fae0ce7 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:50.766985 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-34f7e2de-46d6-4a65-a0e2-27d89fae0ce7 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/a6de755e-739d-437c-aafb-6bc49f8bb086" status: 200 len: 1816 microversion: 2.25 time: 0.671630 Jul 23 21:17:50.774723 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 591/1150] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:17:50 2022] GET /compute/v2.1/servers/a6de755e-739d-437c-aafb-6bc49f8bb086 => generated 1816 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:17:50.785548 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ce57d4c7-b7a8-41b9-86f4-2d5006652c4a tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:50.787201 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-ce57d4c7-b7a8-41b9-86f4-2d5006652c4a tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: 5bbeec29-35ee-44ca-a0f0-3dbe2198e5bf] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:50.822874 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ce57d4c7-b7a8-41b9-86f4-2d5006652c4a tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:50.823571 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ce57d4c7-b7a8-41b9-86f4-2d5006652c4a tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:50.841761 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ce57d4c7-b7a8-41b9-86f4-2d5006652c4a tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:50.842526 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ce57d4c7-b7a8-41b9-86f4-2d5006652c4a tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:51.016559 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-dda8bcf1-a8d2-4150-b12c-a4927025c346 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd18a11b26ded436ab197043a4b90b276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454092f7aaf44ed3a3cdfba882e217b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:51.051078 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-dda8bcf1-a8d2-4150-b12c-a4927025c346 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] 10.222.0.17 "GET /compute/v2.1/servers/c9f5f0b3-e6bd-447f-9ada-0b34f3bae4fd" status: 200 len: 1316 microversion: 2.1 time: 0.850403 Jul 23 21:17:51.051676 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 560/1151] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:50 2022] GET /compute/v2.1/servers/c9f5f0b3-e6bd-447f-9ada-0b34f3bae4fd => generated 1316 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:51.073944 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-62dd2ddd-1b45-4dbe-b2b4-9df653c52920 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '.version_select at 0x7f0b4779a5e0>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:51.170448 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-62dd2ddd-1b45-4dbe-b2b4-9df653c52920 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/images/b69f77e0-151c-4769-8791-18d7474c1ded" status: 200 len: 1413 microversion: 2.1 time: 0.111373 Jul 23 21:17:51.171822 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 561/1152] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:17:51 2022] GET /compute/v2.1/images/b69f77e0-151c-4769-8791-18d7474c1ded => generated 1413 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:51.187042 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6a8d5c40-f34a-410b-a181-db408ebe2caa tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:51.187744 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6a8d5c40-f34a-410b-a181-db408ebe2caa tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] [instance: e753b3c8-e63a-48d5-a349-fa19db134404] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:51.201847 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6a8d5c40-f34a-410b-a181-db408ebe2caa tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:51.216509 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6a8d5c40-f34a-410b-a181-db408ebe2caa tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:51.219335 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6a8d5c40-f34a-410b-a181-db408ebe2caa tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:51.220263 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6a8d5c40-f34a-410b-a181-db408ebe2caa tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:51.422852 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ce57d4c7-b7a8-41b9-86f4-2d5006652c4a tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf92af08fa94215b4eafcacea6c63f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e7d37a0e3b4b32ae99c3bc15a831e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:51.446168 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-ce57d4c7-b7a8-41b9-86f4-2d5006652c4a tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "GET /compute/v2.1/servers/5bbeec29-35ee-44ca-a0f0-3dbe2198e5bf" status: 200 len: 1473 microversion: 2.1 time: 0.668937 Jul 23 21:17:51.447150 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 592/1153] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:50 2022] GET /compute/v2.1/servers/5bbeec29-35ee-44ca-a0f0-3dbe2198e5bf => generated 1473 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:51.452059 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-fe54238e-c51f-4f4a-84a0-9ff4f915e1eb tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:51.453320 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-fe54238e-c51f-4f4a-84a0-9ff4f915e1eb tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] [instance: 34eaf1d2-9732-4c0e-b970-02fbb449514b] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:51.460578 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fe54238e-c51f-4f4a-84a0-9ff4f915e1eb tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:51.462200 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fe54238e-c51f-4f4a-84a0-9ff4f915e1eb tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:51.463109 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fe54238e-c51f-4f4a-84a0-9ff4f915e1eb tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:51.464079 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fe54238e-c51f-4f4a-84a0-9ff4f915e1eb tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:51.942500 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-fe54238e-c51f-4f4a-84a0-9ff4f915e1eb tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/34eaf1d2-9732-4c0e-b970-02fbb449514b" status: 200 len: 1859 microversion: 2.1 time: 0.494057 Jul 23 21:17:51.948208 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 593/1154] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:51 2022] GET /compute/v2.1/servers/34eaf1d2-9732-4c0e-b970-02fbb449514b => generated 1859 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:51.953128 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-61623c05-b63c-4573-89fe-f2286352ab76 req-c1352795-5c80-44b8-9206-c37ab4549037 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8025dc38-59d4-4296-b2c7-5aebb08eacae", "name": "network-vif-plugged", "status": "completed", "tag": "e9c441a4-cbfb-45c6-a442-223a4f1afaf0"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:17:51.986401 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-61623c05-b63c-4573-89fe-f2286352ab76 req-c1352795-5c80-44b8-9206-c37ab4549037 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:51.987099 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-61623c05-b63c-4573-89fe-f2286352ab76 req-c1352795-5c80-44b8-9206-c37ab4549037 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:52.010019 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-61623c05-b63c-4573-89fe-f2286352ab76 req-c1352795-5c80-44b8-9206-c37ab4549037 service nova] Creating event network-vif-plugged:e9c441a4-cbfb-45c6-a442-223a4f1afaf0 for instance 8025dc38-59d4-4296-b2c7-5aebb08eacae on nch1-master-1 Jul 23 21:17:52.024582 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-61623c05-b63c-4573-89fe-f2286352ab76 req-c1352795-5c80-44b8-9206-c37ab4549037 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074864 Jul 23 21:17:52.025481 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 594/1155] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:17:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:17:52.043341 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-0fa964c4-5229-4fd0-bf61-badb55f32f36 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:52.044891 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-0fa964c4-5229-4fd0-bf61-badb55f32f36 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 760fa31f-a0cf-46df-b456-3af5dc7f9933] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:52.054882 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0fa964c4-5229-4fd0-bf61-badb55f32f36 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:52.058528 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0fa964c4-5229-4fd0-bf61-badb55f32f36 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:52.059553 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0fa964c4-5229-4fd0-bf61-badb55f32f36 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:52.060154 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0fa964c4-5229-4fd0-bf61-badb55f32f36 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:52.479065 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6a8d5c40-f34a-410b-a181-db408ebe2caa tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3ad614d9d24300adb274cc95120fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3811ea868f5649e8a235539a5bf46706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:52.491221 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6a8d5c40-f34a-410b-a181-db408ebe2caa tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] 10.222.0.17 "GET /compute/v2.1/servers/e753b3c8-e63a-48d5-a349-fa19db134404" status: 200 len: 1248 microversion: 2.1 time: 1.318125 Jul 23 21:17:52.494847 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 562/1156] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:51 2022] GET /compute/v2.1/servers/e753b3c8-e63a-48d5-a349-fa19db134404 => generated 1248 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:52.515767 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-df7de551-2ed7-4a0b-a3fa-8269cff5ac0a tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:52.517406 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-df7de551-2ed7-4a0b-a3fa-8269cff5ac0a tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: a6de755e-739d-437c-aafb-6bc49f8bb086] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:52.544762 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-df7de551-2ed7-4a0b-a3fa-8269cff5ac0a tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:52.550796 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-df7de551-2ed7-4a0b-a3fa-8269cff5ac0a tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:52.552132 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-df7de551-2ed7-4a0b-a3fa-8269cff5ac0a tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:52.554707 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-df7de551-2ed7-4a0b-a3fa-8269cff5ac0a tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:52.858404 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-0fa964c4-5229-4fd0-bf61-badb55f32f36 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:52.867830 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-0fa964c4-5229-4fd0-bf61-badb55f32f36 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933" status: 200 len: 1469 microversion: 2.1 time: 0.840668 Jul 23 21:17:52.873530 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 595/1157] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:52 2022] GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933 => generated 1469 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:52.892361 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-b15a79a4-eb00-4fe4-853c-77b53136935b tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:52.893282 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-b15a79a4-eb00-4fe4-853c-77b53136935b tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] [instance: 34eaf1d2-9732-4c0e-b970-02fbb449514b] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:52.910276 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b15a79a4-eb00-4fe4-853c-77b53136935b tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:52.910763 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b15a79a4-eb00-4fe4-853c-77b53136935b tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:52.914851 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b15a79a4-eb00-4fe4-853c-77b53136935b tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:52.915392 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b15a79a4-eb00-4fe4-853c-77b53136935b tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:53.441732 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-df7de551-2ed7-4a0b-a3fa-8269cff5ac0a tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:53.463936 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-df7de551-2ed7-4a0b-a3fa-8269cff5ac0a tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:53.471224 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-df7de551-2ed7-4a0b-a3fa-8269cff5ac0a tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:53.475320 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-df7de551-2ed7-4a0b-a3fa-8269cff5ac0a tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/a6de755e-739d-437c-aafb-6bc49f8bb086" status: 200 len: 1816 microversion: 2.25 time: 0.979091 Jul 23 21:17:53.482984 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 563/1158] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:17:52 2022] GET /compute/v2.1/servers/a6de755e-739d-437c-aafb-6bc49f8bb086 => generated 1816 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:17:53.502893 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e8ac73d1-882f-4135-92c4-42acc920af50 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:53.505713 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e8ac73d1-882f-4135-92c4-42acc920af50 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] [instance: c9f5f0b3-e6bd-447f-9ada-0b34f3bae4fd] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:53.534813 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-b15a79a4-eb00-4fe4-853c-77b53136935b tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/34eaf1d2-9732-4c0e-b970-02fbb449514b" status: 200 len: 1859 microversion: 2.1 time: 0.655732 Jul 23 21:17:53.540100 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 596/1159] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:52 2022] GET /compute/v2.1/servers/34eaf1d2-9732-4c0e-b970-02fbb449514b => generated 1859 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:53.543484 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e8ac73d1-882f-4135-92c4-42acc920af50 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:53.548792 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e8ac73d1-882f-4135-92c4-42acc920af50 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:53.552409 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e8ac73d1-882f-4135-92c4-42acc920af50 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:53.553382 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e8ac73d1-882f-4135-92c4-42acc920af50 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:53.558742 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e2c40f9e-340b-4717-9402-2c77308b4cf3 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '.version_select at 0x7f0b47e6ae50>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:54.069645 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e8ac73d1-882f-4135-92c4-42acc920af50 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd18a11b26ded436ab197043a4b90b276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454092f7aaf44ed3a3cdfba882e217b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:54.075497 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:17:54.081008 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e8ac73d1-882f-4135-92c4-42acc920af50 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] 10.222.0.17 "GET /compute/v2.1/servers/c9f5f0b3-e6bd-447f-9ada-0b34f3bae4fd" status: 200 len: 1316 microversion: 2.1 time: 0.595979 Jul 23 21:17:54.112740 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 564/1160] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:53 2022] GET /compute/v2.1/servers/c9f5f0b3-e6bd-447f-9ada-0b34f3bae4fd => generated 1316 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:54.136414 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-71d1a37b-60fb-4e5a-b113-31a6f0d06b7a tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:54.137369 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-71d1a37b-60fb-4e5a-b113-31a6f0d06b7a tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: 5bbeec29-35ee-44ca-a0f0-3dbe2198e5bf] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:54.167405 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-71d1a37b-60fb-4e5a-b113-31a6f0d06b7a tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:54.170349 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-71d1a37b-60fb-4e5a-b113-31a6f0d06b7a tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:54.172973 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-71d1a37b-60fb-4e5a-b113-31a6f0d06b7a tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:54.179061 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-71d1a37b-60fb-4e5a-b113-31a6f0d06b7a tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:54.235496 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-71d1a37b-60fb-4e5a-b113-31a6f0d06b7a tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:54.237298 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-71d1a37b-60fb-4e5a-b113-31a6f0d06b7a tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:54.239257 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.objects.instance [None req-71d1a37b-60fb-4e5a-b113-31a6f0d06b7a tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lazy-loading 'fault' on Instance uuid 5bbeec29-35ee-44ca-a0f0-3dbe2198e5bf {{(pid=131320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:17:54.414252 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-71d1a37b-60fb-4e5a-b113-31a6f0d06b7a tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf92af08fa94215b4eafcacea6c63f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e7d37a0e3b4b32ae99c3bc15a831e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:54.428186 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-71d1a37b-60fb-4e5a-b113-31a6f0d06b7a tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "GET /compute/v2.1/servers/5bbeec29-35ee-44ca-a0f0-3dbe2198e5bf" status: 200 len: 1308 microversion: 2.1 time: 0.311992 Jul 23 21:17:54.432032 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 565/1161] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:54 2022] GET /compute/v2.1/servers/5bbeec29-35ee-44ca-a0f0-3dbe2198e5bf => generated 1308 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:54.444727 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-94f22074-3444-4755-a47b-e7bd64c7285c req-fbbc62f1-96a3-4bfa-8c94-3056847a309f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bbeec29-35ee-44ca-a0f0-3dbe2198e5bf", "name": "network-vif-deleted", "tag": "74ad436d-bbbc-4932-b444-95cdeceb5cd1"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:17:54.467396 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-94f22074-3444-4755-a47b-e7bd64c7285c req-fbbc62f1-96a3-4bfa-8c94-3056847a309f service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:54.473518 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-94f22074-3444-4755-a47b-e7bd64c7285c req-fbbc62f1-96a3-4bfa-8c94-3056847a309f service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:54.512252 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-94f22074-3444-4755-a47b-e7bd64c7285c req-fbbc62f1-96a3-4bfa-8c94-3056847a309f service nova] Creating event network-vif-deleted:74ad436d-bbbc-4932-b444-95cdeceb5cd1 for instance 5bbeec29-35ee-44ca-a0f0-3dbe2198e5bf on nch2-master-1 Jul 23 21:17:54.526488 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-94f22074-3444-4755-a47b-e7bd64c7285c req-fbbc62f1-96a3-4bfa-8c94-3056847a309f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092862 Jul 23 21:17:54.532808 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 566/1162] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:17:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:17:54.547657 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-677e53e4-a7fe-4936-ae6e-498b804892b0 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:54.551581 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-677e53e4-a7fe-4936-ae6e-498b804892b0 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] [instance: e753b3c8-e63a-48d5-a349-fa19db134404] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:54.561910 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-677e53e4-a7fe-4936-ae6e-498b804892b0 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:54.562665 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-677e53e4-a7fe-4936-ae6e-498b804892b0 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:54.563918 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-677e53e4-a7fe-4936-ae6e-498b804892b0 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:54.564537 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-677e53e4-a7fe-4936-ae6e-498b804892b0 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:54.713147 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-677e53e4-a7fe-4936-ae6e-498b804892b0 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3ad614d9d24300adb274cc95120fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3811ea868f5649e8a235539a5bf46706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:54.733388 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-677e53e4-a7fe-4936-ae6e-498b804892b0 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] 10.222.0.17 "GET /compute/v2.1/servers/e753b3c8-e63a-48d5-a349-fa19db134404" status: 200 len: 1302 microversion: 2.1 time: 0.195705 Jul 23 21:17:54.742512 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 567/1163] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:54 2022] GET /compute/v2.1/servers/e753b3c8-e63a-48d5-a349-fa19db134404 => generated 1302 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:54.749205 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9861ac91-5d7f-4ef9-b0e1-597a82c21501 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:54.750140 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-9861ac91-5d7f-4ef9-b0e1-597a82c21501 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 34eaf1d2-9732-4c0e-b970-02fbb449514b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:54.762387 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9861ac91-5d7f-4ef9-b0e1-597a82c21501 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:54.763106 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9861ac91-5d7f-4ef9-b0e1-597a82c21501 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:54.764212 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9861ac91-5d7f-4ef9-b0e1-597a82c21501 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:54.764809 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9861ac91-5d7f-4ef9-b0e1-597a82c21501 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:55.162632 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.objects.instance [None req-9861ac91-5d7f-4ef9-b0e1-597a82c21501 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lazy-loading 'services' on Instance uuid 34eaf1d2-9732-4c0e-b970-02fbb449514b {{(pid=131320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:17:55.448944 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9861ac91-5d7f-4ef9-b0e1-597a82c21501 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "DELETE /compute/v2.1/servers/34eaf1d2-9732-4c0e-b970-02fbb449514b/os-volume_attachments/a69bbe9e-0481-45eb-807a-0a14799fc07b" status: 202 len: 0 microversion: 2.1 time: 0.704476 Jul 23 21:17:55.452583 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 568/1164] 10.222.0.17 () {58 vars in 1415 bytes} [Sat Jul 23 21:17:54 2022] DELETE /compute/v2.1/servers/34eaf1d2-9732-4c0e-b970-02fbb449514b/os-volume_attachments/a69bbe9e-0481-45eb-807a-0a14799fc07b => generated 0 bytes in 709 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:17:55.460256 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-6e19ce03-ace9-431f-b336-3e067bbdf422 req-7edbbf16-4cff-406d-a91a-9aff79b69cf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36204b8b-c78e-447c-a3e7-f1f22c6ffe1f", "name": "network-vif-deleted", "tag": "30f66f72-a68b-4b83-b061-353e991a5389"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:17:55.477077 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-6e19ce03-ace9-431f-b336-3e067bbdf422 req-7edbbf16-4cff-406d-a91a-9aff79b69cf9 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:55.477801 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-6e19ce03-ace9-431f-b336-3e067bbdf422 req-7edbbf16-4cff-406d-a91a-9aff79b69cf9 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:55.497226 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-6e19ce03-ace9-431f-b336-3e067bbdf422 req-7edbbf16-4cff-406d-a91a-9aff79b69cf9 service nova] Creating event network-vif-deleted:30f66f72-a68b-4b83-b061-353e991a5389 for instance 36204b8b-c78e-447c-a3e7-f1f22c6ffe1f on nch1-master-1 Jul 23 21:17:55.511177 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-6e19ce03-ace9-431f-b336-3e067bbdf422 req-7edbbf16-4cff-406d-a91a-9aff79b69cf9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055575 Jul 23 21:17:55.512090 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 569/1165] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:17:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:17:55.520255 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2be25def-edbd-4f9d-83eb-5c31e2373310 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:55.521675 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-2be25def-edbd-4f9d-83eb-5c31e2373310 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 760fa31f-a0cf-46df-b456-3af5dc7f9933] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:55.540440 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2be25def-edbd-4f9d-83eb-5c31e2373310 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:55.541364 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2be25def-edbd-4f9d-83eb-5c31e2373310 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:55.542609 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2be25def-edbd-4f9d-83eb-5c31e2373310 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:55.543214 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2be25def-edbd-4f9d-83eb-5c31e2373310 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:55.985716 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-2be25def-edbd-4f9d-83eb-5c31e2373310 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:55.999672 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2be25def-edbd-4f9d-83eb-5c31e2373310 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933" status: 200 len: 1469 microversion: 2.1 time: 0.480573 Jul 23 21:17:56.011611 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 570/1166] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:55 2022] GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933 => generated 1469 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:56.045828 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-ddb3e47f-d4fb-4c47-b1f8-384d24c7bc4a req-ae6b5c69-6c93-4ed5-b410-6f63f197e011 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "760fa31f-a0cf-46df-b456-3af5dc7f9933", "name": "network-vif-plugged", "status": "completed", "tag": "0eaaed80-36fa-4393-8345-fc0c35160cb5"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:17:56.086605 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-ddb3e47f-d4fb-4c47-b1f8-384d24c7bc4a req-ae6b5c69-6c93-4ed5-b410-6f63f197e011 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:56.087130 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-ddb3e47f-d4fb-4c47-b1f8-384d24c7bc4a req-ae6b5c69-6c93-4ed5-b410-6f63f197e011 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:56.134083 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-ddb3e47f-d4fb-4c47-b1f8-384d24c7bc4a req-ae6b5c69-6c93-4ed5-b410-6f63f197e011 service nova] Creating event network-vif-plugged:0eaaed80-36fa-4393-8345-fc0c35160cb5 for instance 760fa31f-a0cf-46df-b456-3af5dc7f9933 on nch1-master-1 Jul 23 21:17:56.155228 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [req-ddb3e47f-d4fb-4c47-b1f8-384d24c7bc4a req-ae6b5c69-6c93-4ed5-b410-6f63f197e011 service nova] Instance 760fa31f-a0cf-46df-b456-3af5dc7f9933 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1'} {{(pid=131320) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 23 21:17:56.171095 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-ddb3e47f-d4fb-4c47-b1f8-384d24c7bc4a req-ae6b5c69-6c93-4ed5-b410-6f63f197e011 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152866 Jul 23 21:17:56.174641 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 571/1167] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:17:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:17:56.204267 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ff8da65e-44c0-4a2e-9810-1a3418723c5f tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:56.209437 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ff8da65e-44c0-4a2e-9810-1a3418723c5f tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: a6de755e-739d-437c-aafb-6bc49f8bb086] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:56.223763 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ff8da65e-44c0-4a2e-9810-1a3418723c5f tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:56.228893 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ff8da65e-44c0-4a2e-9810-1a3418723c5f tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:56.230246 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ff8da65e-44c0-4a2e-9810-1a3418723c5f tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:56.230980 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ff8da65e-44c0-4a2e-9810-1a3418723c5f tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:56.687891 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ff8da65e-44c0-4a2e-9810-1a3418723c5f tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:56.700506 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ff8da65e-44c0-4a2e-9810-1a3418723c5f tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:56.702016 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ff8da65e-44c0-4a2e-9810-1a3418723c5f tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:56.705148 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ff8da65e-44c0-4a2e-9810-1a3418723c5f tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/a6de755e-739d-437c-aafb-6bc49f8bb086" status: 200 len: 1816 microversion: 2.25 time: 0.529093 Jul 23 21:17:56.719610 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 572/1168] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:17:56 2022] GET /compute/v2.1/servers/a6de755e-739d-437c-aafb-6bc49f8bb086 => generated 1816 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:17:56.733144 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-07e6d172-089a-43cb-8cd2-6cf7237206b1 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:56.734523 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-07e6d172-089a-43cb-8cd2-6cf7237206b1 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] [instance: c9f5f0b3-e6bd-447f-9ada-0b34f3bae4fd] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:56.743183 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-07e6d172-089a-43cb-8cd2-6cf7237206b1 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:56.743644 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-07e6d172-089a-43cb-8cd2-6cf7237206b1 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:56.747356 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-07e6d172-089a-43cb-8cd2-6cf7237206b1 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:56.747834 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-07e6d172-089a-43cb-8cd2-6cf7237206b1 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:57.183360 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-07e6d172-089a-43cb-8cd2-6cf7237206b1 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd18a11b26ded436ab197043a4b90b276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454092f7aaf44ed3a3cdfba882e217b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:57.197533 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-07e6d172-089a-43cb-8cd2-6cf7237206b1 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] 10.222.0.17 "GET /compute/v2.1/servers/c9f5f0b3-e6bd-447f-9ada-0b34f3bae4fd" status: 200 len: 1316 microversion: 2.1 time: 0.471269 Jul 23 21:17:57.198596 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 573/1169] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:56 2022] GET /compute/v2.1/servers/c9f5f0b3-e6bd-447f-9ada-0b34f3bae4fd => generated 1316 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:57.215042 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-bd47c32a-d379-487b-a108-7907d682f023 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:57.215676 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-bd47c32a-d379-487b-a108-7907d682f023 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: 5bbeec29-35ee-44ca-a0f0-3dbe2198e5bf] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:57.231351 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bd47c32a-d379-487b-a108-7907d682f023 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:57.232693 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bd47c32a-d379-487b-a108-7907d682f023 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:57.234515 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bd47c32a-d379-487b-a108-7907d682f023 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:57.237672 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bd47c32a-d379-487b-a108-7907d682f023 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:57.283975 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-bd47c32a-d379-487b-a108-7907d682f023 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] HTTP exception thrown: Instance 5bbeec29-35ee-44ca-a0f0-3dbe2198e5bf could not be found. Jul 23 21:17:57.288764 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-bd47c32a-d379-487b-a108-7907d682f023 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Request method failure captured: Jul 23 21:17:57.288764 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/5bbeec29-35ee-44ca-a0f0-3dbe2198e5bf HTTP/1.1 Jul 23 21:17:57.288764 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:17:57.288764 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:17:57.288764 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:17:57.288764 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:17:57.288764 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:17:57.288764 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:17:57.288764 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:17:57.288764 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:17:57.288764 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GTXg43xsvaDpXj4BMz40UdSnpyPBTbhxj1IdGMcN1ZmThctVpX9T9iG6eRr9MGt1QTpmHEqYNbJp_e-y4RlWttw_Ug9gposZ1FVUrLfy9Hukeo6nEcrmiwqSETVX_CDHg3xVpH7dYYo0t5AjovoUMlG-_EeGSUlkV9963ANN9g-cqA Jul 23 21:17:57.288764 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:17:57.288764 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:17:57.288764 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:17:57.288764 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:17:57.288764 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:17:57.288764 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:17:57.288764 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: f5e7d37a0e3b4b32ae99c3bc15a831e6 Jul 23 21:17:57.288764 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServersOnMultiNodesTest-62510325 Jul 23 21:17:57.288764 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:17:57.288764 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:17:57.291100 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f5e7d37a0e3b4b32ae99c3bc15a831e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f5e7d37a0e3b4b32ae99c3bc15a831e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f5e7d37a0e3b4b32ae99c3bc15a831e6", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f5e7d37a0e3b4b32ae99c3bc15a831e6"}]}] Jul 23 21:17:57.291100 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServersOnMultiNodesTest-62510325 Jul 23 21:17:57.291100 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: f5e7d37a0e3b4b32ae99c3bc15a831e6 Jul 23 21:17:57.291100 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-62510325 Jul 23 21:17:57.291100 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServersOnMultiNodesTest-62510325-project Jul 23 21:17:57.291100 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:17:57.291100 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:17:57.291100 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: ebf92af08fa94215b4eafcacea6c63f6 Jul 23 21:17:57.291100 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServersOnMultiNodesTest-62510325-project Jul 23 21:17:57.291100 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:17:57.291100 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance 5bbeec29-35ee-44ca-a0f0-3dbe2198e5bf could not be found. Jul 23 21:17:57.291100 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '5bbeec29-35ee-44ca-a0f0-3dbe2198e5bf'} Jul 23 21:17:57.291923 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:17:57.291923 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:17:57.291923 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:17:57.291923 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:17:57.291923 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:17:57.291923 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:17:57.291923 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:17:57.291923 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:17:57.291923 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:17:57.291923 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:17:57.291923 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bbeec29-35ee-44ca-a0f0-3dbe2198e5bf could not be found. Jul 23 21:17:57.291923 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:17:57.291923 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:17:57.291923 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:17:57.291923 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:17:57.291923 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:17:57.291923 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:17:57.291923 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:17:57.291923 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:17:57.291923 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:17:57.293213 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:17:57.293213 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:17:57.293213 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:17:57.293213 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:17:57.293213 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:17:57.293213 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:17:57.293213 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:17:57.293213 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bbeec29-35ee-44ca-a0f0-3dbe2198e5bf could not be found. Jul 23 21:17:57.293213 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:17:57.293213 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:17:57.293213 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:17:57.293213 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:17:57.293213 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:17:57.293213 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:17:57.293213 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:17:57.293213 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:17:57.293213 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bbeec29-35ee-44ca-a0f0-3dbe2198e5bf could not be found. Jul 23 21:17:57.293213 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:17:57.297140 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-bd47c32a-d379-487b-a108-7907d682f023 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Returning 404 to user: Instance 5bbeec29-35ee-44ca-a0f0-3dbe2198e5bf could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:17:57.297140 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-bd47c32a-d379-487b-a108-7907d682f023 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "GET /compute/v2.1/servers/5bbeec29-35ee-44ca-a0f0-3dbe2198e5bf" status: 404 len: 111 microversion: 2.1 time: 0.089670 Jul 23 21:17:57.297140 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 574/1170] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:57 2022] GET /compute/v2.1/servers/5bbeec29-35ee-44ca-a0f0-3dbe2198e5bf => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:17:57.325576 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3a3a7413-2a53-4b53-8736-4c9a966fb9d5 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:57.327489 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-3a3a7413-2a53-4b53-8736-4c9a966fb9d5 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 34eaf1d2-9732-4c0e-b970-02fbb449514b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:57.347266 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3a3a7413-2a53-4b53-8736-4c9a966fb9d5 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:57.349027 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3a3a7413-2a53-4b53-8736-4c9a966fb9d5 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:57.351453 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3a3a7413-2a53-4b53-8736-4c9a966fb9d5 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:57.352085 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3a3a7413-2a53-4b53-8736-4c9a966fb9d5 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:57.454729 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-3a3a7413-2a53-4b53-8736-4c9a966fb9d5 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/34eaf1d2-9732-4c0e-b970-02fbb449514b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.155286 Jul 23 21:17:57.455380 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 575/1171] 10.222.0.17 () {58 vars in 1301 bytes} [Sat Jul 23 21:17:57 2022] GET /compute/v2.1/servers/34eaf1d2-9732-4c0e-b970-02fbb449514b/os-volume_attachments => generated 197 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:17:57.465789 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-eccfe86a-d080-4f24-96aa-18ad449b6412 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:57.470704 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-eccfe86a-d080-4f24-96aa-18ad449b6412 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] [instance: e753b3c8-e63a-48d5-a349-fa19db134404] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:57.481053 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-eccfe86a-d080-4f24-96aa-18ad449b6412 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:57.481374 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-eccfe86a-d080-4f24-96aa-18ad449b6412 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:57.487704 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-eccfe86a-d080-4f24-96aa-18ad449b6412 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:57.488222 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-eccfe86a-d080-4f24-96aa-18ad449b6412 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:57.888024 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-eccfe86a-d080-4f24-96aa-18ad449b6412 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3ad614d9d24300adb274cc95120fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3811ea868f5649e8a235539a5bf46706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:57.897989 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-eccfe86a-d080-4f24-96aa-18ad449b6412 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] 10.222.0.17 "GET /compute/v2.1/servers/e753b3c8-e63a-48d5-a349-fa19db134404" status: 200 len: 1369 microversion: 2.1 time: 0.441516 Jul 23 21:17:57.910114 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 576/1172] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:57 2022] GET /compute/v2.1/servers/e753b3c8-e63a-48d5-a349-fa19db134404 => generated 1369 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:57.915318 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-494b621b-2805-4b91-977d-538349c2d768 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:57.916205 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-494b621b-2805-4b91-977d-538349c2d768 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 760fa31f-a0cf-46df-b456-3af5dc7f9933] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:57.922909 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-494b621b-2805-4b91-977d-538349c2d768 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:57.923868 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-494b621b-2805-4b91-977d-538349c2d768 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:57.924917 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-494b621b-2805-4b91-977d-538349c2d768 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:57.925604 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-494b621b-2805-4b91-977d-538349c2d768 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:58.550770 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-494b621b-2805-4b91-977d-538349c2d768 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:58.563457 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-494b621b-2805-4b91-977d-538349c2d768 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933" status: 200 len: 1535 microversion: 2.1 time: 0.647999 Jul 23 21:17:58.564726 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 577/1173] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:57 2022] GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933 => generated 1535 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:58.583156 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-64e0bfe7-7df7-499b-b0cd-a2a0684bc9c2 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:58.584698 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-64e0bfe7-7df7-499b-b0cd-a2a0684bc9c2 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: 36204b8b-c78e-447c-a3e7-f1f22c6ffe1f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:58.607430 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-64e0bfe7-7df7-499b-b0cd-a2a0684bc9c2 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:58.608439 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-64e0bfe7-7df7-499b-b0cd-a2a0684bc9c2 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:58.611149 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-64e0bfe7-7df7-499b-b0cd-a2a0684bc9c2 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:58.614251 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-64e0bfe7-7df7-499b-b0cd-a2a0684bc9c2 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:58.666710 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-64e0bfe7-7df7-499b-b0cd-a2a0684bc9c2 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] HTTP exception thrown: Instance 36204b8b-c78e-447c-a3e7-f1f22c6ffe1f could not be found. Jul 23 21:17:58.673664 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-64e0bfe7-7df7-499b-b0cd-a2a0684bc9c2 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Request method failure captured: Jul 23 21:17:58.673664 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/36204b8b-c78e-447c-a3e7-f1f22c6ffe1f HTTP/1.1 Jul 23 21:17:58.673664 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:17:58.673664 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:17:58.673664 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:17:58.673664 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:17:58.673664 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:17:58.673664 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:17:58.673664 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:17:58.673664 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:17:58.673664 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GTXg43xsvaDpXj4BMz40UdSnpyPBTbhxj1IdGMcN1ZmThctVpX9T9iG6eRr9MGt1QTpmHEqYNbJp_e-y4RlWttw_Ug9gposZ1FVUrLfy9Hukeo6nEcrmiwqSETVX_CDHg3xVpH7dYYo0t5AjovoUMlG-_EeGSUlkV9963ANN9g-cqA Jul 23 21:17:58.673664 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:17:58.673664 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:17:58.673664 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:17:58.673664 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:17:58.673664 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:17:58.673664 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:17:58.673664 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: f5e7d37a0e3b4b32ae99c3bc15a831e6 Jul 23 21:17:58.673664 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServersOnMultiNodesTest-62510325 Jul 23 21:17:58.673664 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:17:58.673664 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:17:58.675410 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f5e7d37a0e3b4b32ae99c3bc15a831e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f5e7d37a0e3b4b32ae99c3bc15a831e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f5e7d37a0e3b4b32ae99c3bc15a831e6", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f5e7d37a0e3b4b32ae99c3bc15a831e6"}]}] Jul 23 21:17:58.675410 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServersOnMultiNodesTest-62510325 Jul 23 21:17:58.675410 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: f5e7d37a0e3b4b32ae99c3bc15a831e6 Jul 23 21:17:58.675410 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-62510325 Jul 23 21:17:58.675410 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServersOnMultiNodesTest-62510325-project Jul 23 21:17:58.675410 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:17:58.675410 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:17:58.675410 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: ebf92af08fa94215b4eafcacea6c63f6 Jul 23 21:17:58.675410 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServersOnMultiNodesTest-62510325-project Jul 23 21:17:58.675410 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:17:58.675410 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance 36204b8b-c78e-447c-a3e7-f1f22c6ffe1f could not be found. Jul 23 21:17:58.675410 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '36204b8b-c78e-447c-a3e7-f1f22c6ffe1f'} Jul 23 21:17:58.676318 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:17:58.676318 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:17:58.676318 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:17:58.676318 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:17:58.676318 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:17:58.676318 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:17:58.676318 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:17:58.676318 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:17:58.676318 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:17:58.676318 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:17:58.676318 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36204b8b-c78e-447c-a3e7-f1f22c6ffe1f could not be found. Jul 23 21:17:58.676318 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:17:58.676318 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:17:58.676318 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:17:58.676318 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:17:58.676318 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:17:58.676318 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:17:58.676318 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:17:58.676318 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:17:58.676318 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:17:58.677895 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:17:58.677895 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:17:58.677895 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:17:58.677895 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:17:58.677895 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:17:58.677895 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:17:58.677895 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:17:58.677895 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36204b8b-c78e-447c-a3e7-f1f22c6ffe1f could not be found. Jul 23 21:17:58.677895 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:17:58.677895 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:17:58.677895 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:17:58.677895 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:17:58.677895 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:17:58.677895 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:17:58.677895 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:17:58.677895 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:17:58.677895 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36204b8b-c78e-447c-a3e7-f1f22c6ffe1f could not be found. Jul 23 21:17:58.677895 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:17:58.680538 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-64e0bfe7-7df7-499b-b0cd-a2a0684bc9c2 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Returning 404 to user: Instance 36204b8b-c78e-447c-a3e7-f1f22c6ffe1f could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:17:58.681899 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-64e0bfe7-7df7-499b-b0cd-a2a0684bc9c2 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "GET /compute/v2.1/servers/36204b8b-c78e-447c-a3e7-f1f22c6ffe1f" status: 404 len: 111 microversion: 2.1 time: 0.115419 Jul 23 21:17:58.686454 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 578/1174] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:58 2022] GET /compute/v2.1/servers/36204b8b-c78e-447c-a3e7-f1f22c6ffe1f => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:17:58.697568 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f69fc941-f976-40ad-963f-db26c0564d07 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:58.699188 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f69fc941-f976-40ad-963f-db26c0564d07 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: a6de755e-739d-437c-aafb-6bc49f8bb086] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:58.713886 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f69fc941-f976-40ad-963f-db26c0564d07 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:58.714768 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f69fc941-f976-40ad-963f-db26c0564d07 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:58.716310 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f69fc941-f976-40ad-963f-db26c0564d07 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:58.716748 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f69fc941-f976-40ad-963f-db26c0564d07 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:58.815950 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell0:SELECT=3 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:17:59.260782 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f69fc941-f976-40ad-963f-db26c0564d07 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:59.274196 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f69fc941-f976-40ad-963f-db26c0564d07 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:59.275804 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f69fc941-f976-40ad-963f-db26c0564d07 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:59.277022 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f69fc941-f976-40ad-963f-db26c0564d07 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/a6de755e-739d-437c-aafb-6bc49f8bb086" status: 200 len: 1816 microversion: 2.25 time: 0.589299 Jul 23 21:17:59.277591 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 579/1175] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:17:58 2022] GET /compute/v2.1/servers/a6de755e-739d-437c-aafb-6bc49f8bb086 => generated 1816 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:17:59.298714 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-9c0f8608-8fda-4713-a016-5848a3602e77 req-92945f95-5e8f-4990-a467-d0055f058a6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e753b3c8-e63a-48d5-a349-fa19db134404", "tag": "386c18e4-513b-4ac2-a469-5df264df0146"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:17:59.313466 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-9c0f8608-8fda-4713-a016-5848a3602e77 req-92945f95-5e8f-4990-a467-d0055f058a6d service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:59.314373 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-9c0f8608-8fda-4713-a016-5848a3602e77 req-92945f95-5e8f-4990-a467-d0055f058a6d service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:59.340392 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-9c0f8608-8fda-4713-a016-5848a3602e77 req-92945f95-5e8f-4990-a467-d0055f058a6d service nova] Creating event network-changed:386c18e4-513b-4ac2-a469-5df264df0146 for instance e753b3c8-e63a-48d5-a349-fa19db134404 on nch1-master-1 Jul 23 21:17:59.345648 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-9c0f8608-8fda-4713-a016-5848a3602e77 req-92945f95-5e8f-4990-a467-d0055f058a6d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060838 Jul 23 21:17:59.360322 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 580/1176] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:17:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:17:59.365979 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-76c40f79-4c9b-4776-9247-d868b0eaf9f8 req-02ea9845-dd4e-4b0b-93b6-761044497fb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9f5f0b3-e6bd-447f-9ada-0b34f3bae4fd", "name": "network-vif-plugged", "status": "completed", "tag": "a0ccd355-8441-4085-bdca-6a6ad08b732d"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:17:59.374733 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-76c40f79-4c9b-4776-9247-d868b0eaf9f8 req-02ea9845-dd4e-4b0b-93b6-761044497fb3 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:59.375445 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-76c40f79-4c9b-4776-9247-d868b0eaf9f8 req-02ea9845-dd4e-4b0b-93b6-761044497fb3 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:59.388651 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-76c40f79-4c9b-4776-9247-d868b0eaf9f8 req-02ea9845-dd4e-4b0b-93b6-761044497fb3 service nova] Creating event network-vif-plugged:a0ccd355-8441-4085-bdca-6a6ad08b732d for instance c9f5f0b3-e6bd-447f-9ada-0b34f3bae4fd on nch2-master-1 Jul 23 21:17:59.396667 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-76c40f79-4c9b-4776-9247-d868b0eaf9f8 req-02ea9845-dd4e-4b0b-93b6-761044497fb3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034322 Jul 23 21:17:59.397448 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 581/1177] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:17:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:17:59.410750 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3df5585f-5656-4e72-ba58-d18cbf145eaf tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:59.412415 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-3df5585f-5656-4e72-ba58-d18cbf145eaf tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] [instance: c9f5f0b3-e6bd-447f-9ada-0b34f3bae4fd] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:59.428741 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3df5585f-5656-4e72-ba58-d18cbf145eaf tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:59.429471 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3df5585f-5656-4e72-ba58-d18cbf145eaf tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:59.430469 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3df5585f-5656-4e72-ba58-d18cbf145eaf tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:59.431249 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3df5585f-5656-4e72-ba58-d18cbf145eaf tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:59.866322 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-3df5585f-5656-4e72-ba58-d18cbf145eaf tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd18a11b26ded436ab197043a4b90b276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454092f7aaf44ed3a3cdfba882e217b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:17:59.879348 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-3df5585f-5656-4e72-ba58-d18cbf145eaf tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] 10.222.0.17 "GET /compute/v2.1/servers/c9f5f0b3-e6bd-447f-9ada-0b34f3bae4fd" status: 200 len: 1316 microversion: 2.1 time: 0.480448 Jul 23 21:17:59.880133 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 582/1178] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:17:59 2022] GET /compute/v2.1/servers/c9f5f0b3-e6bd-447f-9ada-0b34f3bae4fd => generated 1316 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:17:59.896007 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-bb28817a-0dd1-4c84-9f7f-37b4d199c602 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:17:59.899856 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-bb28817a-0dd1-4c84-9f7f-37b4d199c602 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 34eaf1d2-9732-4c0e-b970-02fbb449514b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:17:59.917322 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bb28817a-0dd1-4c84-9f7f-37b4d199c602 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:59.917772 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bb28817a-0dd1-4c84-9f7f-37b4d199c602 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:59.918588 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bb28817a-0dd1-4c84-9f7f-37b4d199c602 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:17:59.919019 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bb28817a-0dd1-4c84-9f7f-37b4d199c602 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:17:59.997428 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:18:00.007339 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-bb28817a-0dd1-4c84-9f7f-37b4d199c602 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/34eaf1d2-9732-4c0e-b970-02fbb449514b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.120761 Jul 23 21:18:00.008246 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 583/1179] 10.222.0.17 () {58 vars in 1301 bytes} [Sat Jul 23 21:17:59 2022] GET /compute/v2.1/servers/34eaf1d2-9732-4c0e-b970-02fbb449514b/os-volume_attachments => generated 25 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 23 21:18:00.035737 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-158c646e-9892-48cb-a66c-e835db8acf19 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:00.048556 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=18 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:18:00.116894 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:18:00.151824 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-158c646e-9892-48cb-a66c-e835db8acf19 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "DELETE /compute/v2.1/os-server-groups/cf87636d-b698-4ed9-b104-f097f98fabbc" status: 204 len: 0 microversion: 2.1 time: 0.142006 Jul 23 21:18:00.155615 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 584/1180] 10.222.0.17 () {58 vars in 1265 bytes} [Sat Jul 23 21:18:00 2022] DELETE /compute/v2.1/os-server-groups/cf87636d-b698-4ed9-b104-f097f98fabbc => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:18:00.160111 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9de257ed-15bb-42e7-9aaa-96ab076dae78 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:00.160754 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-9de257ed-15bb-42e7-9aaa-96ab076dae78 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] [instance: e753b3c8-e63a-48d5-a349-fa19db134404] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:18:00.177964 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9de257ed-15bb-42e7-9aaa-96ab076dae78 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:00.178792 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9de257ed-15bb-42e7-9aaa-96ab076dae78 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:00.179687 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9de257ed-15bb-42e7-9aaa-96ab076dae78 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:00.180186 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9de257ed-15bb-42e7-9aaa-96ab076dae78 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:00.612894 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-9de257ed-15bb-42e7-9aaa-96ab076dae78 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3ad614d9d24300adb274cc95120fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3811ea868f5649e8a235539a5bf46706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:18:00.615905 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:18:00.651668 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9de257ed-15bb-42e7-9aaa-96ab076dae78 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] 10.222.0.17 "GET /compute/v2.1/servers/e753b3c8-e63a-48d5-a349-fa19db134404" status: 200 len: 1369 microversion: 2.1 time: 0.497314 Jul 23 21:18:00.660892 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 585/1181] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:18:00 2022] GET /compute/v2.1/servers/e753b3c8-e63a-48d5-a349-fa19db134404 => generated 1369 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:18:00.660892 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-cc03bd9d-76f3-42dd-b25c-bb4076312bcb tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:00.660892 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-cc03bd9d-76f3-42dd-b25c-bb4076312bcb tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 760fa31f-a0cf-46df-b456-3af5dc7f9933] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:18:00.713903 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cc03bd9d-76f3-42dd-b25c-bb4076312bcb tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:00.714431 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cc03bd9d-76f3-42dd-b25c-bb4076312bcb tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:00.715315 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cc03bd9d-76f3-42dd-b25c-bb4076312bcb tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:00.715730 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cc03bd9d-76f3-42dd-b25c-bb4076312bcb tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:02.403740 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-cc03bd9d-76f3-42dd-b25c-bb4076312bcb tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:18:02.428349 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-cc03bd9d-76f3-42dd-b25c-bb4076312bcb tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933" status: 200 len: 1535 microversion: 2.1 time: 1.768626 Jul 23 21:18:02.429628 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 586/1182] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:18:00 2022] GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933 => generated 1535 bytes in 1777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:18:02.434731 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d9a5b2f3-136e-4c08-aad8-145c9b46a822 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:02.440051 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d9a5b2f3-136e-4c08-aad8-145c9b46a822 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: da599d16-7a8c-4ced-b129-d692e5b4866f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:18:02.459736 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d9a5b2f3-136e-4c08-aad8-145c9b46a822 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:02.460380 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d9a5b2f3-136e-4c08-aad8-145c9b46a822 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:02.468017 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d9a5b2f3-136e-4c08-aad8-145c9b46a822 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:02.468626 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d9a5b2f3-136e-4c08-aad8-145c9b46a822 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:02.549716 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d9a5b2f3-136e-4c08-aad8-145c9b46a822 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: da599d16-7a8c-4ced-b129-d692e5b4866f] Going to try to terminate instance {{(pid=131320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:18:02.767778 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d9a5b2f3-136e-4c08-aad8-145c9b46a822 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "DELETE /compute/v2.1/servers/da599d16-7a8c-4ced-b129-d692e5b4866f" status: 204 len: 0 microversion: 2.1 time: 0.336276 Jul 23 21:18:02.768919 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 587/1183] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:18:02 2022] DELETE /compute/v2.1/servers/da599d16-7a8c-4ced-b129-d692e5b4866f => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:18:02.807094 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c0d6a8e6-620d-4a94-9298-04ec6ff4aebc tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:02.807989 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c0d6a8e6-620d-4a94-9298-04ec6ff4aebc tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: a6de755e-739d-437c-aafb-6bc49f8bb086] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:18:02.823279 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c0d6a8e6-620d-4a94-9298-04ec6ff4aebc tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:02.826428 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c0d6a8e6-620d-4a94-9298-04ec6ff4aebc tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:02.827593 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c0d6a8e6-620d-4a94-9298-04ec6ff4aebc tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:02.828246 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c0d6a8e6-620d-4a94-9298-04ec6ff4aebc tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:02.908959 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=2 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:18:03.527234 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:18:03.650537 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c0d6a8e6-620d-4a94-9298-04ec6ff4aebc tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:18:03.660301 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c0d6a8e6-620d-4a94-9298-04ec6ff4aebc tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:18:03.669305 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c0d6a8e6-620d-4a94-9298-04ec6ff4aebc tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:18:03.671090 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c0d6a8e6-620d-4a94-9298-04ec6ff4aebc tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/a6de755e-739d-437c-aafb-6bc49f8bb086" status: 200 len: 1816 microversion: 2.25 time: 0.880220 Jul 23 21:18:03.675944 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 588/1184] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:18:02 2022] GET /compute/v2.1/servers/a6de755e-739d-437c-aafb-6bc49f8bb086 => generated 1816 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:18:03.699478 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-05e5fb86-ddc7-47d4-872f-48c115679e43 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:03.700279 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-05e5fb86-ddc7-47d4-872f-48c115679e43 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] [instance: c9f5f0b3-e6bd-447f-9ada-0b34f3bae4fd] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:18:03.718199 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-05e5fb86-ddc7-47d4-872f-48c115679e43 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:03.718840 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-05e5fb86-ddc7-47d4-872f-48c115679e43 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:03.719714 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-05e5fb86-ddc7-47d4-872f-48c115679e43 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:03.720386 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-05e5fb86-ddc7-47d4-872f-48c115679e43 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:04.031401 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-05e5fb86-ddc7-47d4-872f-48c115679e43 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd18a11b26ded436ab197043a4b90b276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454092f7aaf44ed3a3cdfba882e217b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:18:04.041200 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-05e5fb86-ddc7-47d4-872f-48c115679e43 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] 10.222.0.17 "GET /compute/v2.1/servers/c9f5f0b3-e6bd-447f-9ada-0b34f3bae4fd" status: 200 len: 1504 microversion: 2.1 time: 0.363885 Jul 23 21:18:04.047249 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 589/1185] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:18:03 2022] GET /compute/v2.1/servers/c9f5f0b3-e6bd-447f-9ada-0b34f3bae4fd => generated 1504 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:18:04.072235 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-2c7f4cf0-ba3a-49e2-8a4f-e3dd10b3c48f req-f596fc0e-a4d0-48f7-8486-3977892cc5c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "760fa31f-a0cf-46df-b456-3af5dc7f9933", "name": "network-vif-unplugged", "status": "completed", "tag": "0eaaed80-36fa-4393-8345-fc0c35160cb5"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:18:04.113296 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-2c7f4cf0-ba3a-49e2-8a4f-e3dd10b3c48f req-f596fc0e-a4d0-48f7-8486-3977892cc5c8 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:04.118708 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-2c7f4cf0-ba3a-49e2-8a4f-e3dd10b3c48f req-f596fc0e-a4d0-48f7-8486-3977892cc5c8 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:04.147830 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-2c7f4cf0-ba3a-49e2-8a4f-e3dd10b3c48f req-f596fc0e-a4d0-48f7-8486-3977892cc5c8 service nova] Creating event network-vif-unplugged:0eaaed80-36fa-4393-8345-fc0c35160cb5 for instance 760fa31f-a0cf-46df-b456-3af5dc7f9933 on nch1-master-1 Jul 23 21:18:04.188263 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [req-2c7f4cf0-ba3a-49e2-8a4f-e3dd10b3c48f req-f596fc0e-a4d0-48f7-8486-3977892cc5c8 service nova] Instance 760fa31f-a0cf-46df-b456-3af5dc7f9933 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1'} {{(pid=131320) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 23 21:18:04.214845 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-2c7f4cf0-ba3a-49e2-8a4f-e3dd10b3c48f req-f596fc0e-a4d0-48f7-8486-3977892cc5c8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.164799 Jul 23 21:18:04.223125 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 590/1186] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:18:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:18:04.233715 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8cd5910d-939a-42dc-a445-9baad8923f8f tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:04.234453 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8cd5910d-939a-42dc-a445-9baad8923f8f tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] [instance: e753b3c8-e63a-48d5-a349-fa19db134404] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:18:04.250831 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8cd5910d-939a-42dc-a445-9baad8923f8f tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:04.258584 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8cd5910d-939a-42dc-a445-9baad8923f8f tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:04.259710 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8cd5910d-939a-42dc-a445-9baad8923f8f tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:04.260303 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8cd5910d-939a-42dc-a445-9baad8923f8f tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:04.792505 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8cd5910d-939a-42dc-a445-9baad8923f8f tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3ad614d9d24300adb274cc95120fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3811ea868f5649e8a235539a5bf46706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:18:04.807826 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8cd5910d-939a-42dc-a445-9baad8923f8f tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] 10.222.0.17 "GET /compute/v2.1/servers/e753b3c8-e63a-48d5-a349-fa19db134404" status: 200 len: 1369 microversion: 2.1 time: 0.583308 Jul 23 21:18:04.839660 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 591/1187] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:18:04 2022] GET /compute/v2.1/servers/e753b3c8-e63a-48d5-a349-fa19db134404 => generated 1369 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:18:04.859714 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-47fd7f17-1c8e-4d9c-bee1-3f7780804ce7 req-dd228bd0-f9c1-43e4-a706-458b652f43a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6de755e-739d-437c-aafb-6bc49f8bb086", "name": "network-vif-unplugged", "status": "completed", "tag": "07b0b8e7-f27b-4cdb-893e-93a9a7e67017"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:18:04.897645 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-47fd7f17-1c8e-4d9c-bee1-3f7780804ce7 req-dd228bd0-f9c1-43e4-a706-458b652f43a7 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:04.898697 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-47fd7f17-1c8e-4d9c-bee1-3f7780804ce7 req-dd228bd0-f9c1-43e4-a706-458b652f43a7 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:04.975880 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-47fd7f17-1c8e-4d9c-bee1-3f7780804ce7 req-dd228bd0-f9c1-43e4-a706-458b652f43a7 service nova] Creating event network-vif-unplugged:07b0b8e7-f27b-4cdb-893e-93a9a7e67017 for instance a6de755e-739d-437c-aafb-6bc49f8bb086 on nch1-master-1 Jul 23 21:18:05.017405 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-47fd7f17-1c8e-4d9c-bee1-3f7780804ce7 req-dd228bd0-f9c1-43e4-a706-458b652f43a7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.175955 Jul 23 21:18:05.025475 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 592/1188] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:18:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:18:05.043996 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-bc66415f-d286-4cde-80e1-9ca02a4d5f1b tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:05.044918 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-bc66415f-d286-4cde-80e1-9ca02a4d5f1b tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: f299d55c-90a4-41cc-98a8-e14ca5964eb1] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:18:05.057544 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bc66415f-d286-4cde-80e1-9ca02a4d5f1b tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:05.058402 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bc66415f-d286-4cde-80e1-9ca02a4d5f1b tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:05.059409 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bc66415f-d286-4cde-80e1-9ca02a4d5f1b tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:05.063361 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bc66415f-d286-4cde-80e1-9ca02a4d5f1b tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:05.223720 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-bc66415f-d286-4cde-80e1-9ca02a4d5f1b tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: f299d55c-90a4-41cc-98a8-e14ca5964eb1] Going to try to terminate instance {{(pid=131320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:18:05.602483 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-bc66415f-d286-4cde-80e1-9ca02a4d5f1b tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "DELETE /compute/v2.1/servers/f299d55c-90a4-41cc-98a8-e14ca5964eb1" status: 204 len: 0 microversion: 2.1 time: 0.575098 Jul 23 21:18:05.611746 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 593/1189] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:18:05 2022] DELETE /compute/v2.1/servers/f299d55c-90a4-41cc-98a8-e14ca5964eb1 => generated 0 bytes in 585 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:18:05.631936 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2d7add51-b8ba-47b0-a98a-fc1a594f73bf tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:05.646999 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-2d7add51-b8ba-47b0-a98a-fc1a594f73bf tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 760fa31f-a0cf-46df-b456-3af5dc7f9933] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:18:05.667694 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2d7add51-b8ba-47b0-a98a-fc1a594f73bf tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:05.668146 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2d7add51-b8ba-47b0-a98a-fc1a594f73bf tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:05.668932 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2d7add51-b8ba-47b0-a98a-fc1a594f73bf tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:05.669370 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2d7add51-b8ba-47b0-a98a-fc1a594f73bf tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:06.608271 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-2d7add51-b8ba-47b0-a98a-fc1a594f73bf tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:18:06.618381 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2d7add51-b8ba-47b0-a98a-fc1a594f73bf tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933" status: 200 len: 1528 microversion: 2.1 time: 1.000820 Jul 23 21:18:06.634901 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 594/1190] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:18:05 2022] GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933 => generated 1528 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:18:06.646122 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c4785c13-7931-4632-a584-c10e065b9a54 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:06.646781 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c4785c13-7931-4632-a584-c10e065b9a54 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] [instance: c9f5f0b3-e6bd-447f-9ada-0b34f3bae4fd] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:18:06.667926 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c4785c13-7931-4632-a584-c10e065b9a54 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:06.670269 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c4785c13-7931-4632-a584-c10e065b9a54 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:06.671382 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c4785c13-7931-4632-a584-c10e065b9a54 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:06.672036 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c4785c13-7931-4632-a584-c10e065b9a54 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:06.758456 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c4785c13-7931-4632-a584-c10e065b9a54 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] [instance: c9f5f0b3-e6bd-447f-9ada-0b34f3bae4fd] Going to try to terminate instance {{(pid=131320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:18:06.949347 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c4785c13-7931-4632-a584-c10e065b9a54 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] 10.222.0.17 "DELETE /compute/v2.1/servers/c9f5f0b3-e6bd-447f-9ada-0b34f3bae4fd" status: 204 len: 0 microversion: 2.1 time: 0.312738 Jul 23 21:18:06.952060 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 595/1191] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:18:06 2022] DELETE /compute/v2.1/servers/c9f5f0b3-e6bd-447f-9ada-0b34f3bae4fd => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:18:06.959749 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a69e78ff-28ed-4fca-8c45-d6dd007ea07b tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:06.960855 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a69e78ff-28ed-4fca-8c45-d6dd007ea07b tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: a6de755e-739d-437c-aafb-6bc49f8bb086] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:18:06.972034 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a69e78ff-28ed-4fca-8c45-d6dd007ea07b tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:06.972937 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a69e78ff-28ed-4fca-8c45-d6dd007ea07b tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:06.974207 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a69e78ff-28ed-4fca-8c45-d6dd007ea07b tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:06.974918 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a69e78ff-28ed-4fca-8c45-d6dd007ea07b tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:07.199669 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a69e78ff-28ed-4fca-8c45-d6dd007ea07b tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:18:07.209085 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a69e78ff-28ed-4fca-8c45-d6dd007ea07b tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:18:07.211401 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a69e78ff-28ed-4fca-8c45-d6dd007ea07b tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:18:07.219340 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a69e78ff-28ed-4fca-8c45-d6dd007ea07b tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/a6de755e-739d-437c-aafb-6bc49f8bb086" status: 200 len: 1816 microversion: 2.25 time: 0.265054 Jul 23 21:18:07.220130 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 596/1192] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:18:06 2022] GET /compute/v2.1/servers/a6de755e-739d-437c-aafb-6bc49f8bb086 => generated 1816 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:18:07.231082 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b6ae6ca4-3e00-4bc5-89c4-d7e6c1167310 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:07.236373 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b6ae6ca4-3e00-4bc5-89c4-d7e6c1167310 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: da599d16-7a8c-4ced-b129-d692e5b4866f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:18:07.263327 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b6ae6ca4-3e00-4bc5-89c4-d7e6c1167310 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:07.265676 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b6ae6ca4-3e00-4bc5-89c4-d7e6c1167310 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:07.274147 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b6ae6ca4-3e00-4bc5-89c4-d7e6c1167310 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:07.275929 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b6ae6ca4-3e00-4bc5-89c4-d7e6c1167310 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:07.373052 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b6ae6ca4-3e00-4bc5-89c4-d7e6c1167310 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:07.383379 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b6ae6ca4-3e00-4bc5-89c4-d7e6c1167310 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:07.384301 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.objects.instance [None req-b6ae6ca4-3e00-4bc5-89c4-d7e6c1167310 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lazy-loading 'fault' on Instance uuid da599d16-7a8c-4ced-b129-d692e5b4866f {{(pid=131320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:18:07.498588 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b6ae6ca4-3e00-4bc5-89c4-d7e6c1167310 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf92af08fa94215b4eafcacea6c63f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e7d37a0e3b4b32ae99c3bc15a831e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:18:07.514292 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b6ae6ca4-3e00-4bc5-89c4-d7e6c1167310 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "GET /compute/v2.1/servers/da599d16-7a8c-4ced-b129-d692e5b4866f" status: 200 len: 1309 microversion: 2.1 time: 0.287130 Jul 23 21:18:07.518991 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 597/1193] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:18:07 2022] GET /compute/v2.1/servers/da599d16-7a8c-4ced-b129-d692e5b4866f => generated 1309 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:18:07.536007 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-7eb1e2dd-55a3-4ec3-9f06-7eafcf321690 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:07.537574 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-7eb1e2dd-55a3-4ec3-9f06-7eafcf321690 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] [instance: e753b3c8-e63a-48d5-a349-fa19db134404] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:18:07.547499 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7eb1e2dd-55a3-4ec3-9f06-7eafcf321690 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:07.548334 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7eb1e2dd-55a3-4ec3-9f06-7eafcf321690 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:07.549657 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7eb1e2dd-55a3-4ec3-9f06-7eafcf321690 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:07.550358 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7eb1e2dd-55a3-4ec3-9f06-7eafcf321690 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:07.592021 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:18:07.780141 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-e2c40f9e-340b-4717-9402-2c77308b4cf3 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/images/b69f77e0-151c-4769-8791-18d7474c1ded" status: 200 len: 1422 microversion: 2.1 time: 14.232098 Jul 23 21:18:07.781159 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 597/1194] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:17:53 2022] GET /compute/v2.1/images/b69f77e0-151c-4769-8791-18d7474c1ded => generated 1422 bytes in 14240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:18:07.789721 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-b9f6c5cf-96af-4436-aff9-c8a4c46e5f39 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:07.792630 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-b9f6c5cf-96af-4436-aff9-c8a4c46e5f39 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 760fa31f-a0cf-46df-b456-3af5dc7f9933] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:18:07.821155 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b9f6c5cf-96af-4436-aff9-c8a4c46e5f39 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:07.821794 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b9f6c5cf-96af-4436-aff9-c8a4c46e5f39 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:07.822725 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b9f6c5cf-96af-4436-aff9-c8a4c46e5f39 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:07.823273 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b9f6c5cf-96af-4436-aff9-c8a4c46e5f39 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:07.849404 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-7eb1e2dd-55a3-4ec3-9f06-7eafcf321690 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3ad614d9d24300adb274cc95120fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3811ea868f5649e8a235539a5bf46706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:18:07.857638 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-7eb1e2dd-55a3-4ec3-9f06-7eafcf321690 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] 10.222.0.17 "GET /compute/v2.1/servers/e753b3c8-e63a-48d5-a349-fa19db134404" status: 200 len: 1369 microversion: 2.1 time: 0.330139 Jul 23 21:18:07.861294 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 598/1195] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:18:07 2022] GET /compute/v2.1/servers/e753b3c8-e63a-48d5-a349-fa19db134404 => generated 1369 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:18:07.885301 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-fdae8779-9a8a-40e9-ba10-9d2d5ea8094b tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:07.886236 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-fdae8779-9a8a-40e9-ba10-9d2d5ea8094b tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] [instance: c9f5f0b3-e6bd-447f-9ada-0b34f3bae4fd] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:18:07.905847 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fdae8779-9a8a-40e9-ba10-9d2d5ea8094b tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:07.910265 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fdae8779-9a8a-40e9-ba10-9d2d5ea8094b tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:07.915615 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fdae8779-9a8a-40e9-ba10-9d2d5ea8094b tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:07.916267 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fdae8779-9a8a-40e9-ba10-9d2d5ea8094b tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:08.234531 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-fdae8779-9a8a-40e9-ba10-9d2d5ea8094b tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd18a11b26ded436ab197043a4b90b276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454092f7aaf44ed3a3cdfba882e217b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:18:08.269149 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-fdae8779-9a8a-40e9-ba10-9d2d5ea8094b tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] 10.222.0.17 "GET /compute/v2.1/servers/c9f5f0b3-e6bd-447f-9ada-0b34f3bae4fd" status: 200 len: 1510 microversion: 2.1 time: 0.395013 Jul 23 21:18:08.273418 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 599/1196] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:18:07 2022] GET /compute/v2.1/servers/c9f5f0b3-e6bd-447f-9ada-0b34f3bae4fd => generated 1510 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:18:08.301266 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-7786e4ab-c27e-4bed-b659-13e091846b5e req-c0c8eeb0-bb23-46f3-b971-0d33b88fedb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6de755e-739d-437c-aafb-6bc49f8bb086", "tag": "07b0b8e7-f27b-4cdb-893e-93a9a7e67017"}, {"server_uuid": "da599d16-7a8c-4ced-b129-d692e5b4866f", "name": "network-vif-deleted", "tag": "34a50e7e-5622-49f8-8abb-5386329b37bc"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:18:08.335028 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-b9f6c5cf-96af-4436-aff9-c8a4c46e5f39 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:18:08.353999 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-b9f6c5cf-96af-4436-aff9-c8a4c46e5f39 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933" status: 200 len: 1528 microversion: 2.1 time: 0.571617 Jul 23 21:18:08.357005 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-7786e4ab-c27e-4bed-b659-13e091846b5e req-c0c8eeb0-bb23-46f3-b971-0d33b88fedb0 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:08.357941 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 598/1197] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:18:07 2022] GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933 => generated 1528 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:18:08.361516 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-7786e4ab-c27e-4bed-b659-13e091846b5e req-c0c8eeb0-bb23-46f3-b971-0d33b88fedb0 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:08.385988 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-fa7502ee-0bc4-4807-befc-efce11384e75 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '.version_select at 0x7f0b47e2b820>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:08.396680 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-7786e4ab-c27e-4bed-b659-13e091846b5e req-c0c8eeb0-bb23-46f3-b971-0d33b88fedb0 service nova] Creating event network-changed:07b0b8e7-f27b-4cdb-893e-93a9a7e67017 for instance a6de755e-739d-437c-aafb-6bc49f8bb086 on nch1-master-1 Jul 23 21:18:08.398894 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-7786e4ab-c27e-4bed-b659-13e091846b5e req-c0c8eeb0-bb23-46f3-b971-0d33b88fedb0 service nova] Creating event network-vif-deleted:34a50e7e-5622-49f8-8abb-5386329b37bc for instance da599d16-7a8c-4ced-b129-d692e5b4866f on nch2-master-1 Jul 23 21:18:08.429227 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-7786e4ab-c27e-4bed-b659-13e091846b5e req-c0c8eeb0-bb23-46f3-b971-0d33b88fedb0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.153406 Jul 23 21:18:08.432817 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 600/1198] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:18:08 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:18:08.448544 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-fb4fc888-823b-4369-b4b1-530432fef34e req-3faa99a7-ceba-49dc-b495-3af13de1aab1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f299d55c-90a4-41cc-98a8-e14ca5964eb1", "name": "network-vif-unplugged", "status": "completed", "tag": "6b938da1-d7da-40b9-92a8-95e3181b67b9"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:18:08.478618 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-fb4fc888-823b-4369-b4b1-530432fef34e req-3faa99a7-ceba-49dc-b495-3af13de1aab1 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:08.482094 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-fb4fc888-823b-4369-b4b1-530432fef34e req-3faa99a7-ceba-49dc-b495-3af13de1aab1 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:08.507497 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-fa7502ee-0bc4-4807-befc-efce11384e75 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/images/b69f77e0-151c-4769-8791-18d7474c1ded" status: 200 len: 1422 microversion: 2.1 time: 0.148168 Jul 23 21:18:08.508609 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 599/1199] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:18:08 2022] GET /compute/v2.1/images/b69f77e0-151c-4769-8791-18d7474c1ded => generated 1422 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:18:08.544043 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-fb4fc888-823b-4369-b4b1-530432fef34e req-3faa99a7-ceba-49dc-b495-3af13de1aab1 service nova] Creating event network-vif-unplugged:6b938da1-d7da-40b9-92a8-95e3181b67b9 for instance f299d55c-90a4-41cc-98a8-e14ca5964eb1 on nch2-master-1 Jul 23 21:18:08.546498 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-28edbcb6-907b-4ad3-82e6-8c117e1d000b tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:08.551590 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-28edbcb6-907b-4ad3-82e6-8c117e1d000b tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: a6de755e-739d-437c-aafb-6bc49f8bb086] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:18:08.564639 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-fb4fc888-823b-4369-b4b1-530432fef34e req-3faa99a7-ceba-49dc-b495-3af13de1aab1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.126872 Jul 23 21:18:08.569625 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 601/1200] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:18:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:18:08.578980 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-28edbcb6-907b-4ad3-82e6-8c117e1d000b tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:08.579588 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-28edbcb6-907b-4ad3-82e6-8c117e1d000b tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:08.580381 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-28edbcb6-907b-4ad3-82e6-8c117e1d000b tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:08.588441 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-42854f81-d3f5-4d33-9074-e638c76cf856 tempest-MigrationsAdminTest-19880863 tempest-MigrationsAdminTest-19880863-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:08.592157 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:18:08.592157 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:18:08.598688 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-28edbcb6-907b-4ad3-82e6-8c117e1d000b tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:08.608534 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-42854f81-d3f5-4d33-9074-e638c76cf856 tempest-MigrationsAdminTest-19880863 tempest-MigrationsAdminTest-19880863-project-admin] HTTP exception thrown: Flavor eb0634b6-cfd7-4679-8048-873d526132b7 could not be found. Jul 23 21:18:08.617325 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-42854f81-d3f5-4d33-9074-e638c76cf856 tempest-MigrationsAdminTest-19880863 tempest-MigrationsAdminTest-19880863-project-admin] Request method failure captured: Jul 23 21:18:08.617325 ncdv-master-1 devstack@n-api.service[131320]: request: DELETE /compute/v2.1/flavors/eb0634b6-cfd7-4679-8048-873d526132b7 HTTP/1.1 Jul 23 21:18:08.617325 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:18:08.617325 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:18:08.617325 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:18:08.617325 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:18:08.617325 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:18:08.617325 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:18:08.617325 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:18:08.617325 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:18:08.617325 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GSZj1DbGWgaErm1RJ5ClOFiQp_4EtVIWXueYeieUPjim3hKEu8iWpCCdP17fgJ12uOappmbH108aFTR1meK4HzEvMi3ZSPk9sjrcvvCHe-EYG7dgtWNvHwEjJd7R73omxq_SfQ9NEPMSjJtWq6Et0Ku_4DYKrudBEBg4eIxkSd5tWQ Jul 23 21:18:08.617325 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:18:08.617325 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:18:08.617325 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:18:08.617325 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:18:08.617325 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:18:08.617325 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:18:08.617325 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 06abafd34fdd4fea90decc7bec9dc63f Jul 23 21:18:08.617325 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-MigrationsAdminTest-19880863 Jul 23 21:18:08.617325 ncdv-master-1 devstack@n-api.service[131320]: X-Role: admin,reader,member Jul 23 21:18:08.617325 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: admin,reader,member Jul 23 21:18:08.618848 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/06abafd34fdd4fea90decc7bec9dc63f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/06abafd34fdd4fea90decc7bec9dc63f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_06abafd34fdd4fea90decc7bec9dc63f", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/06abafd34fdd4fea90decc7bec9dc63f"}]}] Jul 23 21:18:08.618848 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-MigrationsAdminTest-19880863 Jul 23 21:18:08.618848 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 06abafd34fdd4fea90decc7bec9dc63f Jul 23 21:18:08.618848 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-MigrationsAdminTest-19880863 Jul 23 21:18:08.618848 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-MigrationsAdminTest-19880863-project-admin Jul 23 21:18:08.618848 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:18:08.618848 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:18:08.618848 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: f740c6611de74dadae72b604cc5c2b33 Jul 23 21:18:08.618848 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-MigrationsAdminTest-19880863-project-admin Jul 23 21:18:08.618848 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:18:08.618848 ncdv-master-1 devstack@n-api.service[131320]: exception: Flavor eb0634b6-cfd7-4679-8048-873d526132b7 could not be found. Jul 23 21:18:08.618848 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': 'eb0634b6-cfd7-4679-8048-873d526132b7'} Jul 23 21:18:08.619805 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:18:08.619805 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:18:08.619805 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Jul 23 21:18:08.619805 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi flavor.destroy() Jul 23 21:18:08.619805 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 23 21:18:08.619805 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 23 21:18:08.619805 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Jul 23 21:18:08.619805 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Jul 23 21:18:08.619805 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Jul 23 21:18:08.619805 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Jul 23 21:18:08.619805 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 23 21:18:08.619805 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 23 21:18:08.619805 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Jul 23 21:18:08.619805 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Jul 23 21:18:08.619805 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor eb0634b6-cfd7-4679-8048-873d526132b7 could not be found. Jul 23 21:18:08.619805 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:18:08.619805 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:18:08.619805 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:18:08.619805 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:18:08.619805 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:18:08.621798 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:18:08.621798 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:18:08.621798 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:18:08.621798 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:18:08.621798 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:18:08.621798 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Jul 23 21:18:08.621798 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:18:08.621798 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor eb0634b6-cfd7-4679-8048-873d526132b7 could not be found. Jul 23 21:18:08.621798 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:18:08.621798 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:18:08.621798 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:18:08.621798 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:18:08.621798 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:18:08.621798 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:18:08.621798 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:18:08.621798 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:18:08.621798 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor eb0634b6-cfd7-4679-8048-873d526132b7 could not be found. Jul 23 21:18:08.621798 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:18:08.631475 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-42854f81-d3f5-4d33-9074-e638c76cf856 tempest-MigrationsAdminTest-19880863 tempest-MigrationsAdminTest-19880863-project-admin] Returning 404 to user: Flavor eb0634b6-cfd7-4679-8048-873d526132b7 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:18:08.633005 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-42854f81-d3f5-4d33-9074-e638c76cf856 tempest-MigrationsAdminTest-19880863 tempest-MigrationsAdminTest-19880863-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/eb0634b6-cfd7-4679-8048-873d526132b7" status: 404 len: 109 microversion: 2.1 time: 0.061357 Jul 23 21:18:08.633584 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 602/1201] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:18:08 2022] DELETE /compute/v2.1/flavors/eb0634b6-cfd7-4679-8048-873d526132b7 => generated 109 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:18:08.651507 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ec69ac6b-2ef8-4e92-b673-df5e8ffd0be2 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '.version_select at 0x7f0b4764b670>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:09.054837 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-28edbcb6-907b-4ad3-82e6-8c117e1d000b tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:18:09.068201 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-28edbcb6-907b-4ad3-82e6-8c117e1d000b tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:18:09.070067 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-28edbcb6-907b-4ad3-82e6-8c117e1d000b tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:18:09.071414 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-28edbcb6-907b-4ad3-82e6-8c117e1d000b tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/a6de755e-739d-437c-aafb-6bc49f8bb086" status: 200 len: 1816 microversion: 2.25 time: 0.561613 Jul 23 21:18:09.071978 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 600/1202] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:18:08 2022] GET /compute/v2.1/servers/a6de755e-739d-437c-aafb-6bc49f8bb086 => generated 1816 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:18:09.118704 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c707d789-3167-43bc-a9b0-7afbb8c08f34 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:09.131332 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-c707d789-3167-43bc-a9b0-7afbb8c08f34 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: da599d16-7a8c-4ced-b129-d692e5b4866f] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:18:09.164632 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c707d789-3167-43bc-a9b0-7afbb8c08f34 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:09.165094 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c707d789-3167-43bc-a9b0-7afbb8c08f34 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:09.165940 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c707d789-3167-43bc-a9b0-7afbb8c08f34 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:09.166449 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c707d789-3167-43bc-a9b0-7afbb8c08f34 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:09.306430 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c707d789-3167-43bc-a9b0-7afbb8c08f34 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:09.306902 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c707d789-3167-43bc-a9b0-7afbb8c08f34 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:09.307367 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.objects.instance [None req-c707d789-3167-43bc-a9b0-7afbb8c08f34 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lazy-loading 'fault' on Instance uuid da599d16-7a8c-4ced-b129-d692e5b4866f {{(pid=131321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:18:09.636842 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c707d789-3167-43bc-a9b0-7afbb8c08f34 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf92af08fa94215b4eafcacea6c63f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e7d37a0e3b4b32ae99c3bc15a831e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:18:09.658895 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-c707d789-3167-43bc-a9b0-7afbb8c08f34 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "GET /compute/v2.1/servers/da599d16-7a8c-4ced-b129-d692e5b4866f" status: 200 len: 1309 microversion: 2.1 time: 0.555208 Jul 23 21:18:09.669396 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 601/1203] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:18:09 2022] GET /compute/v2.1/servers/da599d16-7a8c-4ced-b129-d692e5b4866f => generated 1309 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:18:09.680651 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-10fa6f48-90d1-443e-9cab-69ff8808b89a tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:09.694636 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-10fa6f48-90d1-443e-9cab-69ff8808b89a tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] [instance: e753b3c8-e63a-48d5-a349-fa19db134404] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:18:09.718540 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-10fa6f48-90d1-443e-9cab-69ff8808b89a tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:09.729333 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-10fa6f48-90d1-443e-9cab-69ff8808b89a tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:09.732116 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-10fa6f48-90d1-443e-9cab-69ff8808b89a tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:09.734269 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-10fa6f48-90d1-443e-9cab-69ff8808b89a tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:10.493302 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-10fa6f48-90d1-443e-9cab-69ff8808b89a tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3ad614d9d24300adb274cc95120fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3811ea868f5649e8a235539a5bf46706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:18:10.508767 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-10fa6f48-90d1-443e-9cab-69ff8808b89a tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] 10.222.0.17 "GET /compute/v2.1/servers/e753b3c8-e63a-48d5-a349-fa19db134404" status: 200 len: 1369 microversion: 2.1 time: 0.837742 Jul 23 21:18:10.511237 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 602/1204] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:18:09 2022] GET /compute/v2.1/servers/e753b3c8-e63a-48d5-a349-fa19db134404 => generated 1369 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:18:10.520795 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-98f61a6c-ae58-4d58-9115-57c61dbecf72 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-182839197", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:18:10.679742 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ec69ac6b-2ef8-4e92-b673-df5e8ffd0be2 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "DELETE /compute/v2.1/images/b69f77e0-151c-4769-8791-18d7474c1ded" status: 204 len: 0 microversion: 2.1 time: 2.043350 Jul 23 21:18:10.681850 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 603/1205] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:18:08 2022] DELETE /compute/v2.1/images/b69f77e0-151c-4769-8791-18d7474c1ded => generated 0 bytes in 2046 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:18:10.689981 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6b15dd97-7033-4175-9e76-5c6638e566d0 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:10.691008 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6b15dd97-7033-4175-9e76-5c6638e566d0 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] [instance: c9f5f0b3-e6bd-447f-9ada-0b34f3bae4fd] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:18:10.711342 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6b15dd97-7033-4175-9e76-5c6638e566d0 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:10.711992 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6b15dd97-7033-4175-9e76-5c6638e566d0 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:10.713025 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6b15dd97-7033-4175-9e76-5c6638e566d0 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:10.713622 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6b15dd97-7033-4175-9e76-5c6638e566d0 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:10.830893 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.network.neutron [None req-98f61a6c-ae58-4d58-9115-57c61dbecf72 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] validate_networks() for None {{(pid=131321) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:18:11.276741 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6b15dd97-7033-4175-9e76-5c6638e566d0 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd18a11b26ded436ab197043a4b90b276', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '454092f7aaf44ed3a3cdfba882e217b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:18:11.292778 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6b15dd97-7033-4175-9e76-5c6638e566d0 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] 10.222.0.17 "GET /compute/v2.1/servers/c9f5f0b3-e6bd-447f-9ada-0b34f3bae4fd" status: 200 len: 1510 microversion: 2.1 time: 0.609251 Jul 23 21:18:11.299798 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 604/1206] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:18:10 2022] GET /compute/v2.1/servers/c9f5f0b3-e6bd-447f-9ada-0b34f3bae4fd => generated 1510 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:18:11.322580 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b501bd70-e68e-45d3-9450-b06449378c58 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:11.323297 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b501bd70-e68e-45d3-9450-b06449378c58 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: a6de755e-739d-437c-aafb-6bc49f8bb086] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:18:11.342255 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b501bd70-e68e-45d3-9450-b06449378c58 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:11.345754 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b501bd70-e68e-45d3-9450-b06449378c58 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:11.346845 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b501bd70-e68e-45d3-9450-b06449378c58 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:11.347442 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b501bd70-e68e-45d3-9450-b06449378c58 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:11.836417 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-98f61a6c-ae58-4d58-9115-57c61dbecf72 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Flavor limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:18:11.836944 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-98f61a6c-ae58-4d58-9115-57c61dbecf72 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Image limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:18:11.837281 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-98f61a6c-ae58-4d58-9115-57c61dbecf72 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Flavor pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:18:11.837685 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-98f61a6c-ae58-4d58-9115-57c61dbecf72 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Image pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:18:11.841819 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-98f61a6c-ae58-4d58-9115-57c61dbecf72 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:18:11.889904 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-98f61a6c-ae58-4d58-9115-57c61dbecf72 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:11.892183 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-98f61a6c-ae58-4d58-9115-57c61dbecf72 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:11.893240 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-98f61a6c-ae58-4d58-9115-57c61dbecf72 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:11.906028 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-98f61a6c-ae58-4d58-9115-57c61dbecf72 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:11.980761 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-98f61a6c-ae58-4d58-9115-57c61dbecf72 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Getting quotas for project 5935212e8b6a40768ee3fc90807b0cb1. Resources: {'ram', 'instances', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:18:11.995049 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-98f61a6c-ae58-4d58-9115-57c61dbecf72 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Getting quotas for user 0133d9533fbd4be5b46dc308dbe3a7d9 and project 5935212e8b6a40768ee3fc90807b0cb1. Resources: {'ram', 'instances', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:18:12.046704 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-98f61a6c-ae58-4d58-9115-57c61dbecf72 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Going to run 1 instances... {{(pid=131321) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:18:12.049828 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-98f61a6c-ae58-4d58-9115-57c61dbecf72 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: d1b84776-ab42-4b27-975d-1744b2935bb2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131321) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:18:12.210534 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-98f61a6c-ae58-4d58-9115-57c61dbecf72 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.697545 Jul 23 21:18:12.218055 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 603/1207] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:18:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1706 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 23 21:18:12.231467 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-769ec686-0d09-4e0c-8d8c-9ba3b48ad131 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:12.232875 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-769ec686-0d09-4e0c-8d8c-9ba3b48ad131 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: da599d16-7a8c-4ced-b129-d692e5b4866f] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:18:12.257354 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-769ec686-0d09-4e0c-8d8c-9ba3b48ad131 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:12.263319 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-769ec686-0d09-4e0c-8d8c-9ba3b48ad131 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:12.266060 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-769ec686-0d09-4e0c-8d8c-9ba3b48ad131 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:12.267067 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-769ec686-0d09-4e0c-8d8c-9ba3b48ad131 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:12.342487 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-769ec686-0d09-4e0c-8d8c-9ba3b48ad131 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] HTTP exception thrown: Instance da599d16-7a8c-4ced-b129-d692e5b4866f could not be found. Jul 23 21:18:12.351605 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-769ec686-0d09-4e0c-8d8c-9ba3b48ad131 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Request method failure captured: Jul 23 21:18:12.351605 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/servers/da599d16-7a8c-4ced-b129-d692e5b4866f HTTP/1.1 Jul 23 21:18:12.351605 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:18:12.351605 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:18:12.351605 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:18:12.351605 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:18:12.351605 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:18:12.351605 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:18:12.351605 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:18:12.351605 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:18:12.351605 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GTXg43xsvaDpXj4BMz40UdSnpyPBTbhxj1IdGMcN1ZmThctVpX9T9iG6eRr9MGt1QTpmHEqYNbJp_e-y4RlWttw_Ug9gposZ1FVUrLfy9Hukeo6nEcrmiwqSETVX_CDHg3xVpH7dYYo0t5AjovoUMlG-_EeGSUlkV9963ANN9g-cqA Jul 23 21:18:12.351605 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:18:12.351605 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:18:12.351605 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:18:12.351605 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:18:12.351605 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:18:12.351605 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:18:12.351605 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: f5e7d37a0e3b4b32ae99c3bc15a831e6 Jul 23 21:18:12.351605 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ServersOnMultiNodesTest-62510325 Jul 23 21:18:12.351605 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:18:12.351605 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:18:12.353464 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f5e7d37a0e3b4b32ae99c3bc15a831e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f5e7d37a0e3b4b32ae99c3bc15a831e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f5e7d37a0e3b4b32ae99c3bc15a831e6", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f5e7d37a0e3b4b32ae99c3bc15a831e6"}]}] Jul 23 21:18:12.353464 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ServersOnMultiNodesTest-62510325 Jul 23 21:18:12.353464 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: f5e7d37a0e3b4b32ae99c3bc15a831e6 Jul 23 21:18:12.353464 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-62510325 Jul 23 21:18:12.353464 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ServersOnMultiNodesTest-62510325-project Jul 23 21:18:12.353464 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:18:12.353464 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:18:12.353464 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: ebf92af08fa94215b4eafcacea6c63f6 Jul 23 21:18:12.353464 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ServersOnMultiNodesTest-62510325-project Jul 23 21:18:12.353464 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:18:12.353464 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance da599d16-7a8c-4ced-b129-d692e5b4866f could not be found. Jul 23 21:18:12.353464 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': 'da599d16-7a8c-4ced-b129-d692e5b4866f'} Jul 23 21:18:12.354442 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:18:12.354442 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:18:12.354442 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:18:12.354442 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:18:12.354442 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:18:12.354442 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:18:12.354442 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:18:12.354442 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:18:12.354442 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:18:12.354442 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:18:12.354442 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da599d16-7a8c-4ced-b129-d692e5b4866f could not be found. Jul 23 21:18:12.354442 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:18:12.354442 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:18:12.354442 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:18:12.354442 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:18:12.354442 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:18:12.354442 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:18:12.354442 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:18:12.354442 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:18:12.354442 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:18:12.355877 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:18:12.355877 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:18:12.355877 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:18:12.355877 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:18:12.355877 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:18:12.355877 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:18:12.355877 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:18:12.355877 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da599d16-7a8c-4ced-b129-d692e5b4866f could not be found. Jul 23 21:18:12.355877 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:18:12.355877 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:18:12.355877 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:18:12.355877 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:18:12.355877 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:18:12.355877 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:18:12.355877 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:18:12.355877 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:18:12.355877 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da599d16-7a8c-4ced-b129-d692e5b4866f could not be found. Jul 23 21:18:12.355877 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:18:12.358073 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-769ec686-0d09-4e0c-8d8c-9ba3b48ad131 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Returning 404 to user: Instance da599d16-7a8c-4ced-b129-d692e5b4866f could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:18:12.360128 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-769ec686-0d09-4e0c-8d8c-9ba3b48ad131 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "GET /compute/v2.1/servers/da599d16-7a8c-4ced-b129-d692e5b4866f" status: 404 len: 111 microversion: 2.1 time: 0.138472 Jul 23 21:18:12.368588 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 604/1208] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:18:12 2022] GET /compute/v2.1/servers/da599d16-7a8c-4ced-b129-d692e5b4866f => generated 111 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:18:12.384372 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-2458c717-6e45-4a8c-bcc5-7b6e2bf9ccb3 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:12.386208 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-2458c717-6e45-4a8c-bcc5-7b6e2bf9ccb3 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 8025dc38-59d4-4296-b2c7-5aebb08eacae] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:18:12.419647 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2458c717-6e45-4a8c-bcc5-7b6e2bf9ccb3 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:12.420820 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2458c717-6e45-4a8c-bcc5-7b6e2bf9ccb3 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:12.423137 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2458c717-6e45-4a8c-bcc5-7b6e2bf9ccb3 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:12.424482 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2458c717-6e45-4a8c-bcc5-7b6e2bf9ccb3 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:12.460141 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b501bd70-e68e-45d3-9450-b06449378c58 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:18:12.471905 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b501bd70-e68e-45d3-9450-b06449378c58 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:18:12.487871 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b501bd70-e68e-45d3-9450-b06449378c58 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:18:12.489071 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b501bd70-e68e-45d3-9450-b06449378c58 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/a6de755e-739d-437c-aafb-6bc49f8bb086" status: 200 len: 1816 microversion: 2.25 time: 1.188051 Jul 23 21:18:12.503103 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 605/1209] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:18:11 2022] GET /compute/v2.1/servers/a6de755e-739d-437c-aafb-6bc49f8bb086 => generated 1816 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:18:12.519635 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b05dd445-35c4-4d55-9a4d-95e66dff15d1 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:12.532638 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-2458c717-6e45-4a8c-bcc5-7b6e2bf9ccb3 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 8025dc38-59d4-4296-b2c7-5aebb08eacae] Going to try to terminate instance {{(pid=131321) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:18:12.534313 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b05dd445-35c4-4d55-9a4d-95e66dff15d1 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] [instance: e753b3c8-e63a-48d5-a349-fa19db134404] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:18:12.606034 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b05dd445-35c4-4d55-9a4d-95e66dff15d1 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:12.606034 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b05dd445-35c4-4d55-9a4d-95e66dff15d1 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:12.615269 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b05dd445-35c4-4d55-9a4d-95e66dff15d1 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:12.622377 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b05dd445-35c4-4d55-9a4d-95e66dff15d1 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:12.786400 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-2458c717-6e45-4a8c-bcc5-7b6e2bf9ccb3 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "DELETE /compute/v2.1/servers/8025dc38-59d4-4296-b2c7-5aebb08eacae" status: 204 len: 0 microversion: 2.1 time: 0.411851 Jul 23 21:18:12.787343 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 605/1210] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:18:12 2022] DELETE /compute/v2.1/servers/8025dc38-59d4-4296-b2c7-5aebb08eacae => generated 0 bytes in 418 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:18:12.794575 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-76ea750d-6b53-4c81-9d00-531d66216a55 req-748c80a1-6baf-4ffd-8bde-d0a9c258c663 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "760fa31f-a0cf-46df-b456-3af5dc7f9933", "name": "network-vif-plugged", "status": "completed", "tag": "0eaaed80-36fa-4393-8345-fc0c35160cb5"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:18:12.830843 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-76ea750d-6b53-4c81-9d00-531d66216a55 req-748c80a1-6baf-4ffd-8bde-d0a9c258c663 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:12.831579 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-76ea750d-6b53-4c81-9d00-531d66216a55 req-748c80a1-6baf-4ffd-8bde-d0a9c258c663 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:12.850158 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-76ea750d-6b53-4c81-9d00-531d66216a55 req-748c80a1-6baf-4ffd-8bde-d0a9c258c663 service nova] Creating event network-vif-plugged:0eaaed80-36fa-4393-8345-fc0c35160cb5 for instance 760fa31f-a0cf-46df-b456-3af5dc7f9933 on nch1-master-1 Jul 23 21:18:12.861676 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-76ea750d-6b53-4c81-9d00-531d66216a55 req-748c80a1-6baf-4ffd-8bde-d0a9c258c663 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070466 Jul 23 21:18:12.863962 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 606/1211] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:18:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:18:12.906223 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-d9a272b1-93d4-4278-8a15-29436861ef92 req-e8bff2a6-f20f-40be-a4c6-a6434ba08c6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9f5f0b3-e6bd-447f-9ada-0b34f3bae4fd", "name": "network-vif-deleted", "tag": "a0ccd355-8441-4085-bdca-6a6ad08b732d"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:18:12.934453 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-d9a272b1-93d4-4278-8a15-29436861ef92 req-e8bff2a6-f20f-40be-a4c6-a6434ba08c6d service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:12.939357 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-d9a272b1-93d4-4278-8a15-29436861ef92 req-e8bff2a6-f20f-40be-a4c6-a6434ba08c6d service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:12.981415 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-d9a272b1-93d4-4278-8a15-29436861ef92 req-e8bff2a6-f20f-40be-a4c6-a6434ba08c6d service nova] Creating event network-vif-deleted:a0ccd355-8441-4085-bdca-6a6ad08b732d for instance c9f5f0b3-e6bd-447f-9ada-0b34f3bae4fd on nch2-master-1 Jul 23 21:18:12.995517 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-d9a272b1-93d4-4278-8a15-29436861ef92 req-e8bff2a6-f20f-40be-a4c6-a6434ba08c6d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127271 Jul 23 21:18:12.997410 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 607/1212] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:18:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:18:13.010859 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d9442426-56a7-4307-99f0-7910612f45ec tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:13.013597 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-d9442426-56a7-4307-99f0-7910612f45ec tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: d1b84776-ab42-4b27-975d-1744b2935bb2] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:18:13.153546 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-d9442426-56a7-4307-99f0-7910612f45ec tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:18:13.168048 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-d9442426-56a7-4307-99f0-7910612f45ec tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2" status: 200 len: 1212 microversion: 2.1 time: 0.165331 Jul 23 21:18:13.169521 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 608/1213] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:18:12 2022] GET /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2 => generated 1212 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:18:13.190091 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-36606857-058d-423b-bc69-e9df77bf834d tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:13.192035 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-36606857-058d-423b-bc69-e9df77bf834d tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] [instance: c9f5f0b3-e6bd-447f-9ada-0b34f3bae4fd] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:18:13.205099 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-36606857-058d-423b-bc69-e9df77bf834d tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:13.205746 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-36606857-058d-423b-bc69-e9df77bf834d tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:13.206832 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-36606857-058d-423b-bc69-e9df77bf834d tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:13.207614 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-36606857-058d-423b-bc69-e9df77bf834d tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:13.229128 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-36606857-058d-423b-bc69-e9df77bf834d tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] HTTP exception thrown: Instance c9f5f0b3-e6bd-447f-9ada-0b34f3bae4fd could not be found. Jul 23 21:18:13.232440 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-36606857-058d-423b-bc69-e9df77bf834d tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Request method failure captured: Jul 23 21:18:13.232440 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/servers/c9f5f0b3-e6bd-447f-9ada-0b34f3bae4fd HTTP/1.1 Jul 23 21:18:13.232440 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:18:13.232440 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:18:13.232440 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:18:13.232440 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:18:13.232440 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:18:13.232440 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:18:13.232440 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:18:13.232440 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:18:13.232440 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GVtsAVL4ktWbrXDbEhsxqsxOQ68S6NAhKea3Vka4ddYvkTcS5mSHuGuKbQuXL1chpbztsAcNkJbmrhFkuRmP8cOkMCtU2n7B4bNS2670EGms9nvS6koFBPBEr4eAV23_8a1dYnv6uxutklJ4_BcyPrzZ_iRw_oBoeoAdAWi1KcvrVM Jul 23 21:18:13.232440 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:18:13.232440 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:18:13.232440 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:18:13.232440 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:18:13.232440 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:18:13.232440 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:18:13.232440 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 454092f7aaf44ed3a3cdfba882e217b3 Jul 23 21:18:13.232440 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ImagesNegativeTestJSON-1932433955 Jul 23 21:18:13.232440 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:18:13.232440 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:18:13.233809 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/454092f7aaf44ed3a3cdfba882e217b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/454092f7aaf44ed3a3cdfba882e217b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_454092f7aaf44ed3a3cdfba882e217b3", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/454092f7aaf44ed3a3cdfba882e217b3"}]}] Jul 23 21:18:13.233809 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ImagesNegativeTestJSON-1932433955 Jul 23 21:18:13.233809 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 454092f7aaf44ed3a3cdfba882e217b3 Jul 23 21:18:13.233809 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1932433955 Jul 23 21:18:13.233809 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ImagesNegativeTestJSON-1932433955-project Jul 23 21:18:13.233809 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:18:13.233809 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:18:13.233809 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: d18a11b26ded436ab197043a4b90b276 Jul 23 21:18:13.233809 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ImagesNegativeTestJSON-1932433955-project Jul 23 21:18:13.233809 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:18:13.233809 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance c9f5f0b3-e6bd-447f-9ada-0b34f3bae4fd could not be found. Jul 23 21:18:13.233809 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': 'c9f5f0b3-e6bd-447f-9ada-0b34f3bae4fd'} Jul 23 21:18:13.234669 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:18:13.234669 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:18:13.234669 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:18:13.234669 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:18:13.234669 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:18:13.234669 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:18:13.234669 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:18:13.234669 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:18:13.234669 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:18:13.234669 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:18:13.234669 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9f5f0b3-e6bd-447f-9ada-0b34f3bae4fd could not be found. Jul 23 21:18:13.234669 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:18:13.234669 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:18:13.234669 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:18:13.234669 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:18:13.234669 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:18:13.234669 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:18:13.234669 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:18:13.234669 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:18:13.234669 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:18:13.235893 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:18:13.235893 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:18:13.235893 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:18:13.235893 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:18:13.235893 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:18:13.235893 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:18:13.235893 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:18:13.235893 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9f5f0b3-e6bd-447f-9ada-0b34f3bae4fd could not be found. Jul 23 21:18:13.235893 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:18:13.235893 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:18:13.235893 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:18:13.235893 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:18:13.235893 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:18:13.235893 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:18:13.235893 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:18:13.235893 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:18:13.235893 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9f5f0b3-e6bd-447f-9ada-0b34f3bae4fd could not be found. Jul 23 21:18:13.235893 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:18:13.240305 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-36606857-058d-423b-bc69-e9df77bf834d tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Returning 404 to user: Instance c9f5f0b3-e6bd-447f-9ada-0b34f3bae4fd could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:18:13.241743 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-36606857-058d-423b-bc69-e9df77bf834d tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] 10.222.0.17 "GET /compute/v2.1/servers/c9f5f0b3-e6bd-447f-9ada-0b34f3bae4fd" status: 404 len: 111 microversion: 2.1 time: 0.070974 Jul 23 21:18:13.247120 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 609/1214] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:18:13 2022] GET /compute/v2.1/servers/c9f5f0b3-e6bd-447f-9ada-0b34f3bae4fd => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:18:13.254274 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a60f3fa4-eccc-492f-8145-1129c15d0ac3 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:13.255259 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-a60f3fa4-eccc-492f-8145-1129c15d0ac3 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: f299d55c-90a4-41cc-98a8-e14ca5964eb1] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:18:13.266463 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a60f3fa4-eccc-492f-8145-1129c15d0ac3 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:13.268626 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a60f3fa4-eccc-492f-8145-1129c15d0ac3 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:13.273527 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a60f3fa4-eccc-492f-8145-1129c15d0ac3 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:13.275780 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a60f3fa4-eccc-492f-8145-1129c15d0ac3 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:13.323316 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a60f3fa4-eccc-492f-8145-1129c15d0ac3 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:13.324329 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a60f3fa4-eccc-492f-8145-1129c15d0ac3 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:13.325080 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.objects.instance [None req-a60f3fa4-eccc-492f-8145-1129c15d0ac3 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lazy-loading 'fault' on Instance uuid f299d55c-90a4-41cc-98a8-e14ca5964eb1 {{(pid=131321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:18:13.389707 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-a60f3fa4-eccc-492f-8145-1129c15d0ac3 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf92af08fa94215b4eafcacea6c63f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e7d37a0e3b4b32ae99c3bc15a831e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:18:13.402338 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-a60f3fa4-eccc-492f-8145-1129c15d0ac3 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "GET /compute/v2.1/servers/f299d55c-90a4-41cc-98a8-e14ca5964eb1" status: 200 len: 1309 microversion: 2.1 time: 0.153561 Jul 23 21:18:13.411929 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 610/1215] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:18:13 2022] GET /compute/v2.1/servers/f299d55c-90a4-41cc-98a8-e14ca5964eb1 => generated 1309 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:18:13.430260 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d4679249-bbff-44b6-a628-13a4224045a3 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1894277461", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "networks": [{"uuid": "472a8f36-7623-4bc7-b732-b31d10b9dfde"}]}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:18:13.557301 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b05dd445-35c4-4d55-9a4d-95e66dff15d1 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3ad614d9d24300adb274cc95120fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3811ea868f5649e8a235539a5bf46706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:18:13.573287 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b05dd445-35c4-4d55-9a4d-95e66dff15d1 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] 10.222.0.17 "GET /compute/v2.1/servers/e753b3c8-e63a-48d5-a349-fa19db134404" status: 200 len: 1369 microversion: 2.1 time: 1.065521 Jul 23 21:18:13.574844 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 606/1216] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:18:12 2022] GET /compute/v2.1/servers/e753b3c8-e63a-48d5-a349-fa19db134404 => generated 1369 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:18:13.588490 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-aadcf868-ce7f-422a-a6bd-e2aa6b585805 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1152917260", "metadata": {"image_type": "test"}}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:18:13.595011 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-aadcf868-ce7f-422a-a6bd-e2aa6b585805 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] [instance: c9f5f0b3-e6bd-447f-9ada-0b34f3bae4fd] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:18:13.607063 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-aadcf868-ce7f-422a-a6bd-e2aa6b585805 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:13.608133 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-aadcf868-ce7f-422a-a6bd-e2aa6b585805 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:13.610381 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-aadcf868-ce7f-422a-a6bd-e2aa6b585805 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:13.613227 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-aadcf868-ce7f-422a-a6bd-e2aa6b585805 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:13.644682 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-aadcf868-ce7f-422a-a6bd-e2aa6b585805 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] HTTP exception thrown: Instance c9f5f0b3-e6bd-447f-9ada-0b34f3bae4fd could not be found. Jul 23 21:18:13.646762 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-aadcf868-ce7f-422a-a6bd-e2aa6b585805 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Request method failure captured: Jul 23 21:18:13.646762 ncdv-master-1 devstack@n-api.service[131320]: request: POST /compute/v2.1/servers/c9f5f0b3-e6bd-447f-9ada-0b34f3bae4fd/action HTTP/1.1 Jul 23 21:18:13.646762 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:18:13.646762 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:18:13.646762 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:18:13.646762 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 112 Jul 23 21:18:13.646762 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:18:13.646762 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:18:13.646762 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:18:13.646762 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:18:13.646762 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GVtsAVL4ktWbrXDbEhsxqsxOQ68S6NAhKea3Vka4ddYvkTcS5mSHuGuKbQuXL1chpbztsAcNkJbmrhFkuRmP8cOkMCtU2n7B4bNS2670EGms9nvS6koFBPBEr4eAV23_8a1dYnv6uxutklJ4_BcyPrzZ_iRw_oBoeoAdAWi1KcvrVM Jul 23 21:18:13.646762 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:18:13.646762 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:18:13.646762 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:18:13.646762 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:18:13.646762 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:18:13.646762 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:18:13.646762 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 454092f7aaf44ed3a3cdfba882e217b3 Jul 23 21:18:13.646762 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ImagesNegativeTestJSON-1932433955 Jul 23 21:18:13.646762 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:18:13.646762 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:18:13.648296 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/454092f7aaf44ed3a3cdfba882e217b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/454092f7aaf44ed3a3cdfba882e217b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_454092f7aaf44ed3a3cdfba882e217b3", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/454092f7aaf44ed3a3cdfba882e217b3"}]}] Jul 23 21:18:13.648296 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ImagesNegativeTestJSON-1932433955 Jul 23 21:18:13.648296 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 454092f7aaf44ed3a3cdfba882e217b3 Jul 23 21:18:13.648296 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1932433955 Jul 23 21:18:13.648296 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ImagesNegativeTestJSON-1932433955-project Jul 23 21:18:13.648296 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:18:13.648296 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:18:13.648296 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: d18a11b26ded436ab197043a4b90b276 Jul 23 21:18:13.648296 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ImagesNegativeTestJSON-1932433955-project Jul 23 21:18:13.648296 ncdv-master-1 devstack@n-api.service[131320]: Jul 23 21:18:13.648296 ncdv-master-1 devstack@n-api.service[131320]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1152917260", "metadata": {"image_type": "test"}}} Jul 23 21:18:13.648296 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:18:13.649157 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance c9f5f0b3-e6bd-447f-9ada-0b34f3bae4fd could not be found. Jul 23 21:18:13.649157 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': 'c9f5f0b3-e6bd-447f-9ada-0b34f3bae4fd', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1152917260', 'metadata': {'image_type': 'test'}}}} Jul 23 21:18:13.649157 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:18:13.649157 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:18:13.649157 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:18:13.649157 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:18:13.649157 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:18:13.649157 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:18:13.649157 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:18:13.649157 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:18:13.649157 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:18:13.649157 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:18:13.649157 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9f5f0b3-e6bd-447f-9ada-0b34f3bae4fd could not be found. Jul 23 21:18:13.649157 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:18:13.649157 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:18:13.649157 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:18:13.649157 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:18:13.649157 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:18:13.649157 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:18:13.650522 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:18:13.650522 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:18:13.650522 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:18:13.650522 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:18:13.650522 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:18:13.650522 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:18:13.650522 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:18:13.650522 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:18:13.650522 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 23 21:18:13.650522 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 23 21:18:13.650522 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:18:13.650522 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:18:13.650522 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:18:13.650522 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:18:13.650522 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9f5f0b3-e6bd-447f-9ada-0b34f3bae4fd could not be found. Jul 23 21:18:13.650522 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:18:13.650522 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:18:13.650522 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:18:13.650522 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:18:13.650522 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:18:13.651964 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:18:13.651964 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:18:13.651964 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:18:13.651964 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9f5f0b3-e6bd-447f-9ada-0b34f3bae4fd could not be found. Jul 23 21:18:13.651964 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:18:13.666692 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-aadcf868-ce7f-422a-a6bd-e2aa6b585805 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Returning 404 to user: Instance c9f5f0b3-e6bd-447f-9ada-0b34f3bae4fd could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:18:13.667787 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-aadcf868-ce7f-422a-a6bd-e2aa6b585805 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] 10.222.0.17 "POST /compute/v2.1/servers/c9f5f0b3-e6bd-447f-9ada-0b34f3bae4fd/action" status: 404 len: 111 microversion: 2.1 time: 0.091796 Jul 23 21:18:13.669429 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 607/1217] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 23 21:18:13 2022] POST /compute/v2.1/servers/c9f5f0b3-e6bd-447f-9ada-0b34f3bae4fd/action => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:18:13.675512 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-7a21f426-be73-4d78-828a-a7789924e4c5 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:13.676331 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-7a21f426-be73-4d78-828a-a7789924e4c5 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: a6de755e-739d-437c-aafb-6bc49f8bb086] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:18:13.686399 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7a21f426-be73-4d78-828a-a7789924e4c5 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:13.687193 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7a21f426-be73-4d78-828a-a7789924e4c5 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:13.688123 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7a21f426-be73-4d78-828a-a7789924e4c5 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:13.688760 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7a21f426-be73-4d78-828a-a7789924e4c5 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:14.076432 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-7a21f426-be73-4d78-828a-a7789924e4c5 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:18:14.087986 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-7a21f426-be73-4d78-828a-a7789924e4c5 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:18:14.093296 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-7a21f426-be73-4d78-828a-a7789924e4c5 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:18:14.098597 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-7a21f426-be73-4d78-828a-a7789924e4c5 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/a6de755e-739d-437c-aafb-6bc49f8bb086" status: 200 len: 1816 microversion: 2.25 time: 0.427799 Jul 23 21:18:14.101432 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 608/1218] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:18:13 2022] GET /compute/v2.1/servers/a6de755e-739d-437c-aafb-6bc49f8bb086 => generated 1816 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:18:14.116163 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-379dcc7a-86ea-4e33-8364-5f4c246f218c tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-669241537", "metadata": {"image_type": "test"}}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:18:14.117667 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-379dcc7a-86ea-4e33-8364-5f4c246f218c tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Failed to fetch instance by id tempest-invalid-564420337 {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 23 21:18:14.118448 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-379dcc7a-86ea-4e33-8364-5f4c246f218c tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] HTTP exception thrown: Instance tempest-invalid-564420337 could not be found. Jul 23 21:18:14.121425 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-379dcc7a-86ea-4e33-8364-5f4c246f218c tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Request method failure captured: Jul 23 21:18:14.121425 ncdv-master-1 devstack@n-api.service[131320]: request: POST /compute/v2.1/servers/tempest-invalid-564420337/action HTTP/1.1 Jul 23 21:18:14.121425 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:18:14.121425 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:18:14.121425 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:18:14.121425 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 111 Jul 23 21:18:14.121425 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:18:14.121425 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:18:14.121425 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:18:14.121425 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:18:14.121425 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GVtsAVL4ktWbrXDbEhsxqsxOQ68S6NAhKea3Vka4ddYvkTcS5mSHuGuKbQuXL1chpbztsAcNkJbmrhFkuRmP8cOkMCtU2n7B4bNS2670EGms9nvS6koFBPBEr4eAV23_8a1dYnv6uxutklJ4_BcyPrzZ_iRw_oBoeoAdAWi1KcvrVM Jul 23 21:18:14.121425 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:18:14.121425 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:18:14.121425 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:18:14.121425 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:18:14.121425 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:18:14.121425 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:18:14.121425 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 454092f7aaf44ed3a3cdfba882e217b3 Jul 23 21:18:14.121425 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ImagesNegativeTestJSON-1932433955 Jul 23 21:18:14.121425 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:18:14.121425 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:18:14.122795 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/454092f7aaf44ed3a3cdfba882e217b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/454092f7aaf44ed3a3cdfba882e217b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_454092f7aaf44ed3a3cdfba882e217b3", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/454092f7aaf44ed3a3cdfba882e217b3"}]}] Jul 23 21:18:14.122795 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ImagesNegativeTestJSON-1932433955 Jul 23 21:18:14.122795 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 454092f7aaf44ed3a3cdfba882e217b3 Jul 23 21:18:14.122795 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1932433955 Jul 23 21:18:14.122795 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ImagesNegativeTestJSON-1932433955-project Jul 23 21:18:14.122795 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:18:14.122795 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:18:14.122795 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: d18a11b26ded436ab197043a4b90b276 Jul 23 21:18:14.122795 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ImagesNegativeTestJSON-1932433955-project Jul 23 21:18:14.122795 ncdv-master-1 devstack@n-api.service[131320]: Jul 23 21:18:14.122795 ncdv-master-1 devstack@n-api.service[131320]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-669241537", "metadata": {"image_type": "test"}}} Jul 23 21:18:14.122795 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:18:14.122795 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance tempest-invalid-564420337 could not be found. Jul 23 21:18:14.123586 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': 'tempest-invalid-564420337', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-669241537', 'metadata': {'image_type': 'test'}}}} Jul 23 21:18:14.123586 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:18:14.123586 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:18:14.123586 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:18:14.123586 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:18:14.123586 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 23 21:18:14.123586 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 23 21:18:14.123586 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-564420337 could not be found. Jul 23 21:18:14.123586 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:18:14.123586 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:18:14.123586 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:18:14.123586 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:18:14.123586 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:18:14.123586 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:18:14.123586 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:18:14.123586 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:18:14.123586 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:18:14.123586 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:18:14.123586 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:18:14.123586 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:18:14.124819 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:18:14.124819 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:18:14.124819 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 23 21:18:14.124819 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 23 21:18:14.124819 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:18:14.124819 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:18:14.124819 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:18:14.124819 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:18:14.124819 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-564420337 could not be found. Jul 23 21:18:14.124819 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:18:14.124819 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:18:14.124819 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:18:14.124819 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:18:14.124819 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:18:14.124819 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:18:14.124819 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:18:14.124819 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:18:14.124819 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-564420337 could not be found. Jul 23 21:18:14.124819 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:18:14.130498 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-379dcc7a-86ea-4e33-8364-5f4c246f218c tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Returning 404 to user: Instance tempest-invalid-564420337 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:18:14.132314 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-379dcc7a-86ea-4e33-8364-5f4c246f218c tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] 10.222.0.17 "POST /compute/v2.1/servers/tempest-invalid-564420337/action" status: 404 len: 100 microversion: 2.1 time: 0.022063 Jul 23 21:18:14.133636 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 609/1219] 10.222.0.17 () {60 vars in 1245 bytes} [Sat Jul 23 21:18:14 2022] POST /compute/v2.1/servers/tempest-invalid-564420337/action => generated 100 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:18:14.146165 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-28575943-0d80-4b31-9281-1e21937e44b3 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1821367433"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:18:14.147283 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-28575943-0d80-4b31-9281-1e21937e44b3 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 23 21:18:14.147838 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-28575943-0d80-4b31-9281-1e21937e44b3 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 23 21:18:14.155213 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-28575943-0d80-4b31-9281-1e21937e44b3 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Request method failure captured: Jul 23 21:18:14.155213 ncdv-master-1 devstack@n-api.service[131320]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Jul 23 21:18:14.155213 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:18:14.155213 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:18:14.155213 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:18:14.155213 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 57 Jul 23 21:18:14.155213 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:18:14.155213 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:18:14.155213 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:18:14.155213 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:18:14.155213 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GVtsAVL4ktWbrXDbEhsxqsxOQ68S6NAhKea3Vka4ddYvkTcS5mSHuGuKbQuXL1chpbztsAcNkJbmrhFkuRmP8cOkMCtU2n7B4bNS2670EGms9nvS6koFBPBEr4eAV23_8a1dYnv6uxutklJ4_BcyPrzZ_iRw_oBoeoAdAWi1KcvrVM Jul 23 21:18:14.155213 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:18:14.155213 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:18:14.155213 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:18:14.155213 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:18:14.155213 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:18:14.155213 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:18:14.155213 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 454092f7aaf44ed3a3cdfba882e217b3 Jul 23 21:18:14.155213 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ImagesNegativeTestJSON-1932433955 Jul 23 21:18:14.155213 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:18:14.155213 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:18:14.156824 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/454092f7aaf44ed3a3cdfba882e217b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/454092f7aaf44ed3a3cdfba882e217b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_454092f7aaf44ed3a3cdfba882e217b3", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/454092f7aaf44ed3a3cdfba882e217b3"}]}] Jul 23 21:18:14.156824 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ImagesNegativeTestJSON-1932433955 Jul 23 21:18:14.156824 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 454092f7aaf44ed3a3cdfba882e217b3 Jul 23 21:18:14.156824 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1932433955 Jul 23 21:18:14.156824 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ImagesNegativeTestJSON-1932433955-project Jul 23 21:18:14.156824 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:18:14.156824 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:18:14.156824 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: d18a11b26ded436ab197043a4b90b276 Jul 23 21:18:14.156824 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ImagesNegativeTestJSON-1932433955-project Jul 23 21:18:14.156824 ncdv-master-1 devstack@n-api.service[131320]: Jul 23 21:18:14.156824 ncdv-master-1 devstack@n-api.service[131320]: {"createImage": {"name": "tempest-test-snap-1821367433"}} Jul 23 21:18:14.156824 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:18:14.156824 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 23 21:18:14.157803 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1821367433'}}} Jul 23 21:18:14.157803 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:18:14.157803 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:18:14.157803 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:18:14.157803 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:18:14.157803 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 23 21:18:14.157803 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 23 21:18:14.157803 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 23 21:18:14.157803 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:18:14.157803 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:18:14.157803 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:18:14.157803 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:18:14.157803 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:18:14.157803 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:18:14.157803 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:18:14.157803 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:18:14.157803 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:18:14.157803 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:18:14.157803 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:18:14.157803 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:18:14.160178 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:18:14.160178 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:18:14.160178 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 23 21:18:14.160178 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 23 21:18:14.160178 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:18:14.160178 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:18:14.160178 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:18:14.160178 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:18:14.160178 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 23 21:18:14.160178 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:18:14.160178 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:18:14.160178 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:18:14.160178 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:18:14.160178 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:18:14.160178 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:18:14.160178 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:18:14.160178 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:18:14.160178 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 23 21:18:14.160178 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:18:14.170736 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-28575943-0d80-4b31-9281-1e21937e44b3 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:18:14.172980 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-28575943-0d80-4b31-9281-1e21937e44b3 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] 10.222.0.17 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.032938 Jul 23 21:18:14.185371 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 610/1220] 10.222.0.17 () {60 vars in 1274 bytes} [Sat Jul 23 21:18:14 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:18:14.202255 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8fd15126-5eee-41d0-abf3-a5de10eb43d7 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-973084499"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:18:14.204389 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8fd15126-5eee-41d0-abf3-a5de10eb43d7 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 23 21:18:14.205792 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-8fd15126-5eee-41d0-abf3-a5de10eb43d7 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 23 21:18:14.211296 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8fd15126-5eee-41d0-abf3-a5de10eb43d7 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Request method failure captured: Jul 23 21:18:14.211296 ncdv-master-1 devstack@n-api.service[131320]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Jul 23 21:18:14.211296 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:18:14.211296 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:18:14.211296 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:18:14.211296 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 56 Jul 23 21:18:14.211296 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:18:14.211296 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:18:14.211296 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:18:14.211296 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:18:14.211296 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GVtsAVL4ktWbrXDbEhsxqsxOQ68S6NAhKea3Vka4ddYvkTcS5mSHuGuKbQuXL1chpbztsAcNkJbmrhFkuRmP8cOkMCtU2n7B4bNS2670EGms9nvS6koFBPBEr4eAV23_8a1dYnv6uxutklJ4_BcyPrzZ_iRw_oBoeoAdAWi1KcvrVM Jul 23 21:18:14.211296 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:18:14.211296 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:18:14.211296 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:18:14.211296 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:18:14.211296 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:18:14.211296 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:18:14.211296 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 454092f7aaf44ed3a3cdfba882e217b3 Jul 23 21:18:14.211296 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ImagesNegativeTestJSON-1932433955 Jul 23 21:18:14.211296 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:18:14.211296 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:18:14.212889 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/454092f7aaf44ed3a3cdfba882e217b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/454092f7aaf44ed3a3cdfba882e217b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_454092f7aaf44ed3a3cdfba882e217b3", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/454092f7aaf44ed3a3cdfba882e217b3"}]}] Jul 23 21:18:14.212889 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ImagesNegativeTestJSON-1932433955 Jul 23 21:18:14.212889 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 454092f7aaf44ed3a3cdfba882e217b3 Jul 23 21:18:14.212889 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1932433955 Jul 23 21:18:14.212889 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ImagesNegativeTestJSON-1932433955-project Jul 23 21:18:14.212889 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:18:14.212889 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:18:14.212889 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: d18a11b26ded436ab197043a4b90b276 Jul 23 21:18:14.212889 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ImagesNegativeTestJSON-1932433955-project Jul 23 21:18:14.212889 ncdv-master-1 devstack@n-api.service[131320]: Jul 23 21:18:14.212889 ncdv-master-1 devstack@n-api.service[131320]: {"createImage": {"name": "tempest-test-snap-973084499"}} Jul 23 21:18:14.212889 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:18:14.212889 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 23 21:18:14.213985 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-973084499'}}} Jul 23 21:18:14.213985 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:18:14.213985 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:18:14.213985 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:18:14.213985 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:18:14.213985 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 23 21:18:14.213985 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 23 21:18:14.213985 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 23 21:18:14.213985 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:18:14.213985 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:18:14.213985 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:18:14.213985 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:18:14.213985 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:18:14.213985 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:18:14.213985 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:18:14.213985 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:18:14.213985 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:18:14.213985 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:18:14.213985 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:18:14.213985 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:18:14.215438 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:18:14.215438 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:18:14.215438 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jul 23 21:18:14.215438 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 23 21:18:14.215438 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:18:14.215438 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:18:14.215438 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:18:14.215438 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:18:14.215438 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 23 21:18:14.215438 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:18:14.215438 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:18:14.215438 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:18:14.215438 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:18:14.215438 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:18:14.215438 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:18:14.215438 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:18:14.215438 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:18:14.215438 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 23 21:18:14.215438 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:18:14.216842 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8fd15126-5eee-41d0-abf3-a5de10eb43d7 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:18:14.217751 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8fd15126-5eee-41d0-abf3-a5de10eb43d7 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] 10.222.0.17 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.025992 Jul 23 21:18:14.240430 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 611/1221] 10.222.0.17 () {60 vars in 1280 bytes} [Sat Jul 23 21:18:14 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:18:14.258116 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5c021b14-be37-459e-bbb6-fcf12d30b813 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:14.258742 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5c021b14-be37-459e-bbb6-fcf12d30b813 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: d1b84776-ab42-4b27-975d-1744b2935bb2] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:18:14.285441 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5c021b14-be37-459e-bbb6-fcf12d30b813 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:14.290688 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5c021b14-be37-459e-bbb6-fcf12d30b813 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:14.294737 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5c021b14-be37-459e-bbb6-fcf12d30b813 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:14.295223 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5c021b14-be37-459e-bbb6-fcf12d30b813 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:15.326099 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5c021b14-be37-459e-bbb6-fcf12d30b813 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:18:15.340466 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5c021b14-be37-459e-bbb6-fcf12d30b813 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2" status: 200 len: 1272 microversion: 2.1 time: 1.097635 Jul 23 21:18:15.350976 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 612/1222] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:18:14 2022] GET /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2 => generated 1272 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:18:15.355085 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9feba03f-1a8a-47a4-aabf-055985436e11 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:15.355599 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-9feba03f-1a8a-47a4-aabf-055985436e11 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] [instance: c9f5f0b3-e6bd-447f-9ada-0b34f3bae4fd] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:18:15.379404 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9feba03f-1a8a-47a4-aabf-055985436e11 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:15.379891 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9feba03f-1a8a-47a4-aabf-055985436e11 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:15.380717 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9feba03f-1a8a-47a4-aabf-055985436e11 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:15.381163 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9feba03f-1a8a-47a4-aabf-055985436e11 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:15.419869 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-9feba03f-1a8a-47a4-aabf-055985436e11 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] HTTP exception thrown: Instance c9f5f0b3-e6bd-447f-9ada-0b34f3bae4fd could not be found. Jul 23 21:18:15.421492 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9feba03f-1a8a-47a4-aabf-055985436e11 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Request method failure captured: Jul 23 21:18:15.421492 ncdv-master-1 devstack@n-api.service[131320]: request: DELETE /compute/v2.1/servers/c9f5f0b3-e6bd-447f-9ada-0b34f3bae4fd HTTP/1.1 Jul 23 21:18:15.421492 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:18:15.421492 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:18:15.421492 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:18:15.421492 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:18:15.421492 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:18:15.421492 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:18:15.421492 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:18:15.421492 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:18:15.421492 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GVtsAVL4ktWbrXDbEhsxqsxOQ68S6NAhKea3Vka4ddYvkTcS5mSHuGuKbQuXL1chpbztsAcNkJbmrhFkuRmP8cOkMCtU2n7B4bNS2670EGms9nvS6koFBPBEr4eAV23_8a1dYnv6uxutklJ4_BcyPrzZ_iRw_oBoeoAdAWi1KcvrVM Jul 23 21:18:15.421492 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:18:15.421492 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:18:15.421492 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:18:15.421492 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:18:15.421492 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:18:15.421492 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:18:15.421492 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 454092f7aaf44ed3a3cdfba882e217b3 Jul 23 21:18:15.421492 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ImagesNegativeTestJSON-1932433955 Jul 23 21:18:15.421492 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:18:15.421492 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:18:15.423294 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/454092f7aaf44ed3a3cdfba882e217b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/454092f7aaf44ed3a3cdfba882e217b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_454092f7aaf44ed3a3cdfba882e217b3", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/454092f7aaf44ed3a3cdfba882e217b3"}]}] Jul 23 21:18:15.423294 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ImagesNegativeTestJSON-1932433955 Jul 23 21:18:15.423294 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 454092f7aaf44ed3a3cdfba882e217b3 Jul 23 21:18:15.423294 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1932433955 Jul 23 21:18:15.423294 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ImagesNegativeTestJSON-1932433955-project Jul 23 21:18:15.423294 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:18:15.423294 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:18:15.423294 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: d18a11b26ded436ab197043a4b90b276 Jul 23 21:18:15.423294 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ImagesNegativeTestJSON-1932433955-project Jul 23 21:18:15.423294 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:18:15.423294 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance c9f5f0b3-e6bd-447f-9ada-0b34f3bae4fd could not be found. Jul 23 21:18:15.423294 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': 'c9f5f0b3-e6bd-447f-9ada-0b34f3bae4fd'} Jul 23 21:18:15.424055 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:18:15.424055 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:18:15.424055 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:18:15.424055 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:18:15.424055 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:18:15.424055 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:18:15.424055 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:18:15.424055 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:18:15.424055 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:18:15.424055 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:18:15.424055 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9f5f0b3-e6bd-447f-9ada-0b34f3bae4fd could not be found. Jul 23 21:18:15.424055 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:18:15.424055 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:18:15.424055 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:18:15.424055 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:18:15.424055 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:18:15.424055 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:18:15.424055 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:18:15.424055 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:18:15.424055 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:18:15.425263 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:18:15.425263 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 23 21:18:15.425263 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 23 21:18:15.425263 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 23 21:18:15.425263 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 23 21:18:15.425263 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:18:15.425263 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:18:15.425263 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:18:15.425263 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:18:15.425263 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9f5f0b3-e6bd-447f-9ada-0b34f3bae4fd could not be found. Jul 23 21:18:15.425263 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:18:15.425263 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:18:15.425263 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:18:15.425263 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:18:15.425263 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:18:15.425263 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:18:15.425263 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:18:15.425263 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:18:15.425263 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9f5f0b3-e6bd-447f-9ada-0b34f3bae4fd could not be found. Jul 23 21:18:15.425263 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:18:15.427879 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9feba03f-1a8a-47a4-aabf-055985436e11 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Returning 404 to user: Instance c9f5f0b3-e6bd-447f-9ada-0b34f3bae4fd could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:18:15.431686 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9feba03f-1a8a-47a4-aabf-055985436e11 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] 10.222.0.17 "DELETE /compute/v2.1/servers/c9f5f0b3-e6bd-447f-9ada-0b34f3bae4fd" status: 404 len: 111 microversion: 2.1 time: 0.083973 Jul 23 21:18:15.432285 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 613/1223] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:18:15 2022] DELETE /compute/v2.1/servers/c9f5f0b3-e6bd-447f-9ada-0b34f3bae4fd => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:18:15.452468 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-86d41f90-14b8-4994-a5e4-15bb4a23b627 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:15.453381 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-86d41f90-14b8-4994-a5e4-15bb4a23b627 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: f299d55c-90a4-41cc-98a8-e14ca5964eb1] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:18:15.463507 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-86d41f90-14b8-4994-a5e4-15bb4a23b627 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:15.467517 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-86d41f90-14b8-4994-a5e4-15bb4a23b627 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:15.469056 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-86d41f90-14b8-4994-a5e4-15bb4a23b627 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:15.471483 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-86d41f90-14b8-4994-a5e4-15bb4a23b627 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:15.510422 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-86d41f90-14b8-4994-a5e4-15bb4a23b627 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] HTTP exception thrown: Instance f299d55c-90a4-41cc-98a8-e14ca5964eb1 could not be found. Jul 23 21:18:15.513855 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-86d41f90-14b8-4994-a5e4-15bb4a23b627 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Request method failure captured: Jul 23 21:18:15.513855 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/f299d55c-90a4-41cc-98a8-e14ca5964eb1 HTTP/1.1 Jul 23 21:18:15.513855 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:18:15.513855 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:18:15.513855 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:18:15.513855 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:18:15.513855 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:18:15.513855 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:18:15.513855 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:18:15.513855 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:18:15.513855 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GTXg43xsvaDpXj4BMz40UdSnpyPBTbhxj1IdGMcN1ZmThctVpX9T9iG6eRr9MGt1QTpmHEqYNbJp_e-y4RlWttw_Ug9gposZ1FVUrLfy9Hukeo6nEcrmiwqSETVX_CDHg3xVpH7dYYo0t5AjovoUMlG-_EeGSUlkV9963ANN9g-cqA Jul 23 21:18:15.513855 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:18:15.513855 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:18:15.513855 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:18:15.513855 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:18:15.513855 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:18:15.513855 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:18:15.513855 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: f5e7d37a0e3b4b32ae99c3bc15a831e6 Jul 23 21:18:15.513855 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServersOnMultiNodesTest-62510325 Jul 23 21:18:15.513855 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:18:15.513855 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:18:15.515525 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f5e7d37a0e3b4b32ae99c3bc15a831e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f5e7d37a0e3b4b32ae99c3bc15a831e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f5e7d37a0e3b4b32ae99c3bc15a831e6", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f5e7d37a0e3b4b32ae99c3bc15a831e6"}]}] Jul 23 21:18:15.515525 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServersOnMultiNodesTest-62510325 Jul 23 21:18:15.515525 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: f5e7d37a0e3b4b32ae99c3bc15a831e6 Jul 23 21:18:15.515525 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-62510325 Jul 23 21:18:15.515525 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServersOnMultiNodesTest-62510325-project Jul 23 21:18:15.515525 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:18:15.515525 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:18:15.515525 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: ebf92af08fa94215b4eafcacea6c63f6 Jul 23 21:18:15.515525 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServersOnMultiNodesTest-62510325-project Jul 23 21:18:15.515525 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:18:15.515525 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance f299d55c-90a4-41cc-98a8-e14ca5964eb1 could not be found. Jul 23 21:18:15.515525 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': 'f299d55c-90a4-41cc-98a8-e14ca5964eb1'} Jul 23 21:18:15.516426 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:18:15.516426 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:18:15.516426 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:18:15.516426 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:18:15.516426 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:18:15.516426 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:18:15.516426 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:18:15.516426 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:18:15.516426 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:18:15.516426 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:18:15.516426 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f299d55c-90a4-41cc-98a8-e14ca5964eb1 could not be found. Jul 23 21:18:15.516426 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:18:15.516426 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:18:15.516426 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:18:15.516426 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:18:15.516426 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:18:15.516426 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:18:15.516426 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:18:15.516426 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:18:15.516426 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:18:15.518097 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:18:15.518097 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:18:15.518097 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:18:15.518097 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:18:15.518097 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:18:15.518097 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:18:15.518097 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:18:15.518097 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f299d55c-90a4-41cc-98a8-e14ca5964eb1 could not be found. Jul 23 21:18:15.518097 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:18:15.518097 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:18:15.518097 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:18:15.518097 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:18:15.518097 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:18:15.518097 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:18:15.518097 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:18:15.518097 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:18:15.518097 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f299d55c-90a4-41cc-98a8-e14ca5964eb1 could not be found. Jul 23 21:18:15.518097 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:18:15.523783 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-86d41f90-14b8-4994-a5e4-15bb4a23b627 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Returning 404 to user: Instance f299d55c-90a4-41cc-98a8-e14ca5964eb1 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:18:15.534179 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-86d41f90-14b8-4994-a5e4-15bb4a23b627 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "GET /compute/v2.1/servers/f299d55c-90a4-41cc-98a8-e14ca5964eb1" status: 404 len: 111 microversion: 2.1 time: 0.096071 Jul 23 21:18:15.535320 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 614/1224] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:18:15 2022] GET /compute/v2.1/servers/f299d55c-90a4-41cc-98a8-e14ca5964eb1 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:18:15.541238 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-cbbaec39-93fd-4350-b790-e4e4e1474263 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:15.542147 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-cbbaec39-93fd-4350-b790-e4e4e1474263 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] [instance: e753b3c8-e63a-48d5-a349-fa19db134404] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:18:15.558371 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cbbaec39-93fd-4350-b790-e4e4e1474263 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:15.564526 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cbbaec39-93fd-4350-b790-e4e4e1474263 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:15.568948 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cbbaec39-93fd-4350-b790-e4e4e1474263 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:15.574547 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cbbaec39-93fd-4350-b790-e4e4e1474263 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:16.088145 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.network.neutron [None req-d4679249-bbff-44b6-a628-13a4224045a3 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] validate_networks() for [('472a8f36-7623-4bc7-b732-b31d10b9dfde', None, None, None, None, None)] {{(pid=131321) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:18:16.757673 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-d4679249-bbff-44b6-a628-13a4224045a3 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Flavor limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:18:16.758129 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-d4679249-bbff-44b6-a628-13a4224045a3 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Image limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:18:16.758829 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-d4679249-bbff-44b6-a628-13a4224045a3 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Flavor pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:18:16.759250 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-d4679249-bbff-44b6-a628-13a4224045a3 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Image pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:18:16.759723 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-d4679249-bbff-44b6-a628-13a4224045a3 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:18:16.770201 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d4679249-bbff-44b6-a628-13a4224045a3 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:16.770891 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d4679249-bbff-44b6-a628-13a4224045a3 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:16.771836 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d4679249-bbff-44b6-a628-13a4224045a3 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:16.772438 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d4679249-bbff-44b6-a628-13a4224045a3 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:16.794254 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-d4679249-bbff-44b6-a628-13a4224045a3 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Getting quotas for project 580ed681cbf44d10936259b17f60f1b2. Resources: {'ram', 'instances', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:18:16.807441 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-d4679249-bbff-44b6-a628-13a4224045a3 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Getting quotas for user bb4f9dda4c2a411cb0394bf86e9ae223 and project 580ed681cbf44d10936259b17f60f1b2. Resources: {'ram', 'instances', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:18:16.815953 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-cbbaec39-93fd-4350-b790-e4e4e1474263 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3ad614d9d24300adb274cc95120fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3811ea868f5649e8a235539a5bf46706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:18:16.829776 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-cbbaec39-93fd-4350-b790-e4e4e1474263 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] 10.222.0.17 "GET /compute/v2.1/servers/e753b3c8-e63a-48d5-a349-fa19db134404" status: 200 len: 1369 microversion: 2.1 time: 1.292764 Jul 23 21:18:16.830742 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 615/1225] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:18:15 2022] GET /compute/v2.1/servers/e753b3c8-e63a-48d5-a349-fa19db134404 => generated 1369 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:18:16.843241 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-2a99017c-4871-4f6a-84d3-fa2482f84267 req-c7da8637-26b6-4a0e-a922-739de8eda080 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8025dc38-59d4-4296-b2c7-5aebb08eacae", "name": "network-vif-unplugged", "status": "completed", "tag": "e9c441a4-cbfb-45c6-a442-223a4f1afaf0"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:18:16.846184 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-d4679249-bbff-44b6-a628-13a4224045a3 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Going to run 1 instances... {{(pid=131321) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:18:16.850168 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-d4679249-bbff-44b6-a628-13a4224045a3 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 6f54269a-e144-4b5d-9b78-39120b28e545] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131321) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:18:16.865741 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-2a99017c-4871-4f6a-84d3-fa2482f84267 req-c7da8637-26b6-4a0e-a922-739de8eda080 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:16.866370 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-2a99017c-4871-4f6a-84d3-fa2482f84267 req-c7da8637-26b6-4a0e-a922-739de8eda080 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:16.896476 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-2a99017c-4871-4f6a-84d3-fa2482f84267 req-c7da8637-26b6-4a0e-a922-739de8eda080 service nova] Creating event network-vif-unplugged:e9c441a4-cbfb-45c6-a442-223a4f1afaf0 for instance 8025dc38-59d4-4296-b2c7-5aebb08eacae on nch1-master-1 Jul 23 21:18:16.909097 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-d4679249-bbff-44b6-a628-13a4224045a3 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.504217 Jul 23 21:18:16.909572 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-2a99017c-4871-4f6a-84d3-fa2482f84267 req-c7da8637-26b6-4a0e-a922-739de8eda080 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077294 Jul 23 21:18:16.910646 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 616/1226] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:18:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:18:16.916822 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 611/1227] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:18:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 3513 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 23 21:18:16.917500 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-20da88fa-10ac-4f5d-8f6e-3241ef147845 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:16.918427 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-20da88fa-10ac-4f5d-8f6e-3241ef147845 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: a6de755e-739d-437c-aafb-6bc49f8bb086] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:18:16.921851 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-825b1a92-ad9a-4e26-a4ca-9e4bf2dd2fae req-fdd29156-dc76-4acc-8fb1-51e2ebb179eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f299d55c-90a4-41cc-98a8-e14ca5964eb1", "name": "network-vif-deleted", "tag": "6b938da1-d7da-40b9-92a8-95e3181b67b9"}, {"server_uuid": "a6de755e-739d-437c-aafb-6bc49f8bb086", "name": "network-vif-unplugged", "status": "completed", "tag": "07b0b8e7-f27b-4cdb-893e-93a9a7e67017"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:18:16.926259 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-20da88fa-10ac-4f5d-8f6e-3241ef147845 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:16.926830 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-20da88fa-10ac-4f5d-8f6e-3241ef147845 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:16.927717 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-20da88fa-10ac-4f5d-8f6e-3241ef147845 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:16.928246 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-20da88fa-10ac-4f5d-8f6e-3241ef147845 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:16.936631 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-825b1a92-ad9a-4e26-a4ca-9e4bf2dd2fae req-fdd29156-dc76-4acc-8fb1-51e2ebb179eb service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:16.937480 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-825b1a92-ad9a-4e26-a4ca-9e4bf2dd2fae req-fdd29156-dc76-4acc-8fb1-51e2ebb179eb service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:16.956832 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-825b1a92-ad9a-4e26-a4ca-9e4bf2dd2fae req-fdd29156-dc76-4acc-8fb1-51e2ebb179eb service nova] Creating event network-vif-deleted:6b938da1-d7da-40b9-92a8-95e3181b67b9 for instance f299d55c-90a4-41cc-98a8-e14ca5964eb1 on nch2-master-1 Jul 23 21:18:16.957507 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-825b1a92-ad9a-4e26-a4ca-9e4bf2dd2fae req-fdd29156-dc76-4acc-8fb1-51e2ebb179eb service nova] Creating event network-vif-unplugged:07b0b8e7-f27b-4cdb-893e-93a9a7e67017 for instance a6de755e-739d-437c-aafb-6bc49f8bb086 on nch1-master-1 Jul 23 21:18:16.988620 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-825b1a92-ad9a-4e26-a4ca-9e4bf2dd2fae req-fdd29156-dc76-4acc-8fb1-51e2ebb179eb service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.067481 Jul 23 21:18:16.990023 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 612/1228] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:18:16 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:18:16.999670 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-87cdfee8-20a0-487c-913c-cb5ee4484733 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:17.003849 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-87cdfee8-20a0-487c-913c-cb5ee4484733 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] [instance: c9f5f0b3-e6bd-447f-9ada-0b34f3bae4fd] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:18:17.012345 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-87cdfee8-20a0-487c-913c-cb5ee4484733 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:17.012971 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-87cdfee8-20a0-487c-913c-cb5ee4484733 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:17.013981 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-87cdfee8-20a0-487c-913c-cb5ee4484733 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:17.014522 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-87cdfee8-20a0-487c-913c-cb5ee4484733 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:17.037114 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-87cdfee8-20a0-487c-913c-cb5ee4484733 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] HTTP exception thrown: Instance c9f5f0b3-e6bd-447f-9ada-0b34f3bae4fd could not be found. Jul 23 21:18:17.039663 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-87cdfee8-20a0-487c-913c-cb5ee4484733 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Request method failure captured: Jul 23 21:18:17.039663 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/servers/c9f5f0b3-e6bd-447f-9ada-0b34f3bae4fd HTTP/1.1 Jul 23 21:18:17.039663 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:18:17.039663 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:18:17.039663 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:18:17.039663 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:18:17.039663 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:18:17.039663 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:18:17.039663 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:18:17.039663 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:18:17.039663 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GVtsAVL4ktWbrXDbEhsxqsxOQ68S6NAhKea3Vka4ddYvkTcS5mSHuGuKbQuXL1chpbztsAcNkJbmrhFkuRmP8cOkMCtU2n7B4bNS2670EGms9nvS6koFBPBEr4eAV23_8a1dYnv6uxutklJ4_BcyPrzZ_iRw_oBoeoAdAWi1KcvrVM Jul 23 21:18:17.039663 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:18:17.039663 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:18:17.039663 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:18:17.039663 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:18:17.039663 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:18:17.039663 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:18:17.039663 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 454092f7aaf44ed3a3cdfba882e217b3 Jul 23 21:18:17.039663 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ImagesNegativeTestJSON-1932433955 Jul 23 21:18:17.039663 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:18:17.039663 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:18:17.041340 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/454092f7aaf44ed3a3cdfba882e217b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/454092f7aaf44ed3a3cdfba882e217b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_454092f7aaf44ed3a3cdfba882e217b3", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/454092f7aaf44ed3a3cdfba882e217b3"}]}] Jul 23 21:18:17.041340 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ImagesNegativeTestJSON-1932433955 Jul 23 21:18:17.041340 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 454092f7aaf44ed3a3cdfba882e217b3 Jul 23 21:18:17.041340 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1932433955 Jul 23 21:18:17.041340 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ImagesNegativeTestJSON-1932433955-project Jul 23 21:18:17.041340 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:18:17.041340 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:18:17.041340 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: d18a11b26ded436ab197043a4b90b276 Jul 23 21:18:17.041340 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ImagesNegativeTestJSON-1932433955-project Jul 23 21:18:17.041340 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:18:17.041340 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance c9f5f0b3-e6bd-447f-9ada-0b34f3bae4fd could not be found. Jul 23 21:18:17.041340 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': 'c9f5f0b3-e6bd-447f-9ada-0b34f3bae4fd'} Jul 23 21:18:17.042194 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:18:17.042194 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:18:17.042194 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:18:17.042194 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:18:17.042194 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:18:17.042194 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:18:17.042194 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:18:17.042194 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:18:17.042194 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:18:17.042194 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:18:17.042194 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9f5f0b3-e6bd-447f-9ada-0b34f3bae4fd could not be found. Jul 23 21:18:17.042194 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:18:17.042194 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:18:17.042194 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:18:17.042194 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:18:17.042194 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:18:17.042194 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:18:17.042194 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:18:17.042194 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:18:17.042194 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:18:17.044335 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:18:17.044335 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:18:17.044335 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:18:17.044335 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:18:17.044335 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:18:17.044335 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:18:17.044335 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:18:17.044335 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9f5f0b3-e6bd-447f-9ada-0b34f3bae4fd could not be found. Jul 23 21:18:17.044335 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:18:17.044335 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:18:17.044335 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:18:17.044335 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:18:17.044335 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:18:17.044335 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:18:17.044335 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:18:17.044335 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:18:17.044335 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9f5f0b3-e6bd-447f-9ada-0b34f3bae4fd could not be found. Jul 23 21:18:17.044335 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:18:17.045672 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-87cdfee8-20a0-487c-913c-cb5ee4484733 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] Returning 404 to user: Instance c9f5f0b3-e6bd-447f-9ada-0b34f3bae4fd could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:18:17.045672 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-87cdfee8-20a0-487c-913c-cb5ee4484733 tempest-ImagesNegativeTestJSON-1932433955 tempest-ImagesNegativeTestJSON-1932433955-project] 10.222.0.17 "GET /compute/v2.1/servers/c9f5f0b3-e6bd-447f-9ada-0b34f3bae4fd" status: 404 len: 111 microversion: 2.1 time: 0.050701 Jul 23 21:18:17.046414 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 613/1229] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:18:16 2022] GET /compute/v2.1/servers/c9f5f0b3-e6bd-447f-9ada-0b34f3bae4fd => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:18:17.055119 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e8928bd6-88e3-4cc4-974e-ed58edc6824d tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:17.175446 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-e8928bd6-88e3-4cc4-974e-ed58edc6824d tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "DELETE /compute/v2.1/os-server-groups/b40e815e-b69f-4380-9032-d2af05d5a157" status: 204 len: 0 microversion: 2.1 time: 0.127681 Jul 23 21:18:17.176055 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 614/1230] 10.222.0.17 () {58 vars in 1265 bytes} [Sat Jul 23 21:18:17 2022] DELETE /compute/v2.1/os-server-groups/b40e815e-b69f-4380-9032-d2af05d5a157 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:18:17.184017 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-66ff0344-e64d-404a-99ef-3d8af00fc101 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:17.184638 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-66ff0344-e64d-404a-99ef-3d8af00fc101 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: d1b84776-ab42-4b27-975d-1744b2935bb2] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:18:17.195059 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-66ff0344-e64d-404a-99ef-3d8af00fc101 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:17.199171 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-66ff0344-e64d-404a-99ef-3d8af00fc101 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:17.201752 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-66ff0344-e64d-404a-99ef-3d8af00fc101 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:17.202239 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-66ff0344-e64d-404a-99ef-3d8af00fc101 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:17.395916 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-66ff0344-e64d-404a-99ef-3d8af00fc101 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:18:17.417988 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-66ff0344-e64d-404a-99ef-3d8af00fc101 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2" status: 200 len: 1270 microversion: 2.1 time: 0.237696 Jul 23 21:18:17.418460 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 615/1231] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:18:17 2022] GET /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2 => generated 1270 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:18:17.441807 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-2aca0943-cbe4-42d3-8b19-b637300bf068 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:17.442462 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-2aca0943-cbe4-42d3-8b19-b637300bf068 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 6f54269a-e144-4b5d-9b78-39120b28e545] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:18:17.603538 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-2aca0943-cbe4-42d3-8b19-b637300bf068 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4f9dda4c2a411cb0394bf86e9ae223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580ed681cbf44d10936259b17f60f1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:18:17.615431 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-2aca0943-cbe4-42d3-8b19-b637300bf068 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/servers/6f54269a-e144-4b5d-9b78-39120b28e545" status: 200 len: 1208 microversion: 2.1 time: 0.195861 Jul 23 21:18:17.628629 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 616/1232] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:18:17 2022] GET /compute/v2.1/servers/6f54269a-e144-4b5d-9b78-39120b28e545 => generated 1208 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:18:17.643062 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-957485fe-364a-42c9-9b35-06113cb5331a tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:17.645498 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-957485fe-364a-42c9-9b35-06113cb5331a tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: 9e985a36-586a-4546-a0c0-1a3e3da330c9] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:18:17.663011 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-957485fe-364a-42c9-9b35-06113cb5331a tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:17.665822 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-957485fe-364a-42c9-9b35-06113cb5331a tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:17.668082 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-957485fe-364a-42c9-9b35-06113cb5331a tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:17.670822 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-957485fe-364a-42c9-9b35-06113cb5331a tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:17.784203 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-957485fe-364a-42c9-9b35-06113cb5331a tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: 9e985a36-586a-4546-a0c0-1a3e3da330c9] Going to try to terminate instance {{(pid=131321) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:18:17.973378 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-957485fe-364a-42c9-9b35-06113cb5331a tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "DELETE /compute/v2.1/servers/9e985a36-586a-4546-a0c0-1a3e3da330c9" status: 204 len: 0 microversion: 2.1 time: 0.341068 Jul 23 21:18:17.976878 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 617/1233] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:18:17 2022] DELETE /compute/v2.1/servers/9e985a36-586a-4546-a0c0-1a3e3da330c9 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:18:17.997662 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-4827df16-e716-477f-877a-d882b5adf734 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:17.999339 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-4827df16-e716-477f-877a-d882b5adf734 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] [instance: e753b3c8-e63a-48d5-a349-fa19db134404] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:18:18.016104 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4827df16-e716-477f-877a-d882b5adf734 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:18.016557 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4827df16-e716-477f-877a-d882b5adf734 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:18.017482 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4827df16-e716-477f-877a-d882b5adf734 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:18.017945 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4827df16-e716-477f-877a-d882b5adf734 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:18.036082 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-20da88fa-10ac-4f5d-8f6e-3241ef147845 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:18:18.056813 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-20da88fa-10ac-4f5d-8f6e-3241ef147845 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:18:18.064736 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-20da88fa-10ac-4f5d-8f6e-3241ef147845 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:18:18.069036 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-20da88fa-10ac-4f5d-8f6e-3241ef147845 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/a6de755e-739d-437c-aafb-6bc49f8bb086" status: 200 len: 1816 microversion: 2.25 time: 1.155064 Jul 23 21:18:18.071470 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 617/1234] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:18:16 2022] GET /compute/v2.1/servers/a6de755e-739d-437c-aafb-6bc49f8bb086 => generated 1816 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:18:18.089506 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-537a2d63-0956-46ad-b2be-b2ce8d5e35f9 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:18.093016 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-537a2d63-0956-46ad-b2be-b2ce8d5e35f9 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: 9e985a36-586a-4546-a0c0-1a3e3da330c9] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:18:18.175491 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-537a2d63-0956-46ad-b2be-b2ce8d5e35f9 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:18.177854 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-537a2d63-0956-46ad-b2be-b2ce8d5e35f9 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:18.184026 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-537a2d63-0956-46ad-b2be-b2ce8d5e35f9 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:18.185327 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-537a2d63-0956-46ad-b2be-b2ce8d5e35f9 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:18.436986 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-4827df16-e716-477f-877a-d882b5adf734 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3ad614d9d24300adb274cc95120fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3811ea868f5649e8a235539a5bf46706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:18:18.450461 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-4827df16-e716-477f-877a-d882b5adf734 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] 10.222.0.17 "GET /compute/v2.1/servers/e753b3c8-e63a-48d5-a349-fa19db134404" status: 200 len: 1369 microversion: 2.1 time: 0.468533 Jul 23 21:18:18.462483 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 618/1235] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:18:17 2022] GET /compute/v2.1/servers/e753b3c8-e63a-48d5-a349-fa19db134404 => generated 1369 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:18:18.468393 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-1fbab8b2-503e-479d-9781-4edca7c9ddad tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:18.472532 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-1fbab8b2-503e-479d-9781-4edca7c9ddad tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: d1b84776-ab42-4b27-975d-1744b2935bb2] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:18:18.495558 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1fbab8b2-503e-479d-9781-4edca7c9ddad tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:18.498056 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1fbab8b2-503e-479d-9781-4edca7c9ddad tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:18.505457 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1fbab8b2-503e-479d-9781-4edca7c9ddad tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:18.506940 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1fbab8b2-503e-479d-9781-4edca7c9ddad tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:18.779045 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-1fbab8b2-503e-479d-9781-4edca7c9ddad tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:18:18.784958 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:18:18.794491 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-1fbab8b2-503e-479d-9781-4edca7c9ddad tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2" status: 200 len: 1270 microversion: 2.1 time: 0.330421 Jul 23 21:18:18.808171 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 619/1236] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:18:18 2022] GET /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2 => generated 1270 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:18:18.822749 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c4b58d1f-f5a6-4a64-ae9b-59fb64a964dd tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:18.823672 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-c4b58d1f-f5a6-4a64-ae9b-59fb64a964dd tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 6f54269a-e144-4b5d-9b78-39120b28e545] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:18:18.843166 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c4b58d1f-f5a6-4a64-ae9b-59fb64a964dd tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:18.844156 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c4b58d1f-f5a6-4a64-ae9b-59fb64a964dd tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:18.846165 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c4b58d1f-f5a6-4a64-ae9b-59fb64a964dd tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:18.847307 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c4b58d1f-f5a6-4a64-ae9b-59fb64a964dd tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:18.867478 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-537a2d63-0956-46ad-b2be-b2ce8d5e35f9 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf92af08fa94215b4eafcacea6c63f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e7d37a0e3b4b32ae99c3bc15a831e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:18:18.884341 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-537a2d63-0956-46ad-b2be-b2ce8d5e35f9 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "GET /compute/v2.1/servers/9e985a36-586a-4546-a0c0-1a3e3da330c9" status: 200 len: 1473 microversion: 2.1 time: 0.807384 Jul 23 21:18:18.884937 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 618/1237] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:18:18 2022] GET /compute/v2.1/servers/9e985a36-586a-4546-a0c0-1a3e3da330c9 => generated 1473 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:18:18.998221 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c4b58d1f-f5a6-4a64-ae9b-59fb64a964dd tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4f9dda4c2a411cb0394bf86e9ae223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580ed681cbf44d10936259b17f60f1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:18:19.014574 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-c4b58d1f-f5a6-4a64-ae9b-59fb64a964dd tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/servers/6f54269a-e144-4b5d-9b78-39120b28e545" status: 200 len: 1268 microversion: 2.1 time: 0.204010 Jul 23 21:18:19.016668 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 620/1238] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:18:18 2022] GET /compute/v2.1/servers/6f54269a-e144-4b5d-9b78-39120b28e545 => generated 1268 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:18:19.088711 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-cca00799-083b-43f1-abf4-d98b6e38feab tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:19.089312 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-cca00799-083b-43f1-abf4-d98b6e38feab tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: a6de755e-739d-437c-aafb-6bc49f8bb086] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:18:19.100108 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cca00799-083b-43f1-abf4-d98b6e38feab tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:19.100573 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cca00799-083b-43f1-abf4-d98b6e38feab tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:19.101386 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cca00799-083b-43f1-abf4-d98b6e38feab tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:19.101830 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cca00799-083b-43f1-abf4-d98b6e38feab tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:19.469013 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-9b7e7535-77d7-4bf6-9c3e-7ed0f1b05fa6 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:19.469701 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-9b7e7535-77d7-4bf6-9c3e-7ed0f1b05fa6 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] [instance: e753b3c8-e63a-48d5-a349-fa19db134404] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:18:19.487111 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=6,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:18:19.492310 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9b7e7535-77d7-4bf6-9c3e-7ed0f1b05fa6 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:19.493903 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9b7e7535-77d7-4bf6-9c3e-7ed0f1b05fa6 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:19.503742 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9b7e7535-77d7-4bf6-9c3e-7ed0f1b05fa6 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:19.504212 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9b7e7535-77d7-4bf6-9c3e-7ed0f1b05fa6 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:20.301434 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-cca00799-083b-43f1-abf4-d98b6e38feab tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:18:20.314858 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-cca00799-083b-43f1-abf4-d98b6e38feab tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:18:20.321069 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-cca00799-083b-43f1-abf4-d98b6e38feab tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:18:20.342978 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-cca00799-083b-43f1-abf4-d98b6e38feab tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/a6de755e-739d-437c-aafb-6bc49f8bb086" status: 200 len: 1816 microversion: 2.25 time: 1.257316 Jul 23 21:18:20.344354 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 619/1239] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:18:19 2022] GET /compute/v2.1/servers/a6de755e-739d-437c-aafb-6bc49f8bb086 => generated 1816 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:18:20.349977 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-448ea9d0-87ee-4234-9eb6-21360ae450d9 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:20.350843 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-448ea9d0-87ee-4234-9eb6-21360ae450d9 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: d1b84776-ab42-4b27-975d-1744b2935bb2] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:18:20.395168 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-448ea9d0-87ee-4234-9eb6-21360ae450d9 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:20.401019 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-448ea9d0-87ee-4234-9eb6-21360ae450d9 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:20.404020 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-448ea9d0-87ee-4234-9eb6-21360ae450d9 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:20.410579 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-448ea9d0-87ee-4234-9eb6-21360ae450d9 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:20.558309 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-9b7e7535-77d7-4bf6-9c3e-7ed0f1b05fa6 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3ad614d9d24300adb274cc95120fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3811ea868f5649e8a235539a5bf46706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:18:20.567311 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-9b7e7535-77d7-4bf6-9c3e-7ed0f1b05fa6 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] 10.222.0.17 "GET /compute/v2.1/servers/e753b3c8-e63a-48d5-a349-fa19db134404" status: 200 len: 1369 microversion: 2.1 time: 1.103124 Jul 23 21:18:20.579850 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 621/1240] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:18:19 2022] GET /compute/v2.1/servers/e753b3c8-e63a-48d5-a349-fa19db134404 => generated 1369 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:18:20.585543 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-503f4c60-e22b-4438-bed5-8e27c735fc1e tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:20.593582 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-503f4c60-e22b-4438-bed5-8e27c735fc1e tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: 9e985a36-586a-4546-a0c0-1a3e3da330c9] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:18:20.609899 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-503f4c60-e22b-4438-bed5-8e27c735fc1e tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:20.610352 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-503f4c60-e22b-4438-bed5-8e27c735fc1e tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:20.611295 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-503f4c60-e22b-4438-bed5-8e27c735fc1e tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:20.611697 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-503f4c60-e22b-4438-bed5-8e27c735fc1e tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:21.260050 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-448ea9d0-87ee-4234-9eb6-21360ae450d9 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:18:21.272388 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-448ea9d0-87ee-4234-9eb6-21360ae450d9 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2" status: 200 len: 1312 microversion: 2.1 time: 0.926175 Jul 23 21:18:21.274232 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 620/1241] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:18:20 2022] GET /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2 => generated 1312 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:18:21.287424 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-39fe28fa-234f-46ae-ab72-b3420d3c677e tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:21.290862 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-39fe28fa-234f-46ae-ab72-b3420d3c677e tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 6f54269a-e144-4b5d-9b78-39120b28e545] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:18:21.302782 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-39fe28fa-234f-46ae-ab72-b3420d3c677e tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:21.304163 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-39fe28fa-234f-46ae-ab72-b3420d3c677e tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:21.305632 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-39fe28fa-234f-46ae-ab72-b3420d3c677e tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:21.306117 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-39fe28fa-234f-46ae-ab72-b3420d3c677e tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:21.420373 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-503f4c60-e22b-4438-bed5-8e27c735fc1e tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf92af08fa94215b4eafcacea6c63f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e7d37a0e3b4b32ae99c3bc15a831e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:18:21.428746 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-503f4c60-e22b-4438-bed5-8e27c735fc1e tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "GET /compute/v2.1/servers/9e985a36-586a-4546-a0c0-1a3e3da330c9" status: 200 len: 1473 microversion: 2.1 time: 0.847346 Jul 23 21:18:21.442565 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 622/1242] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:18:20 2022] GET /compute/v2.1/servers/9e985a36-586a-4546-a0c0-1a3e3da330c9 => generated 1473 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:18:21.448169 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-62527001-0397-401f-bae1-843ecd863f9c req-0e865f95-b240-484f-812b-0455df466372 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8025dc38-59d4-4296-b2c7-5aebb08eacae", "name": "network-vif-deleted", "tag": "e9c441a4-cbfb-45c6-a442-223a4f1afaf0"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:18:21.466083 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-62527001-0397-401f-bae1-843ecd863f9c req-0e865f95-b240-484f-812b-0455df466372 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:21.466526 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-62527001-0397-401f-bae1-843ecd863f9c req-0e865f95-b240-484f-812b-0455df466372 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:21.485001 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-62527001-0397-401f-bae1-843ecd863f9c req-0e865f95-b240-484f-812b-0455df466372 service nova] Creating event network-vif-deleted:e9c441a4-cbfb-45c6-a442-223a4f1afaf0 for instance 8025dc38-59d4-4296-b2c7-5aebb08eacae on nch1-master-1 Jul 23 21:18:21.496385 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-62527001-0397-401f-bae1-843ecd863f9c req-0e865f95-b240-484f-812b-0455df466372 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052113 Jul 23 21:18:21.500667 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 623/1243] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:18:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:18:21.514161 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-48b360c9-b0ac-4ac3-afbf-a8aa64c3f3a1 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:21.516374 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-39fe28fa-234f-46ae-ab72-b3420d3c677e tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4f9dda4c2a411cb0394bf86e9ae223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580ed681cbf44d10936259b17f60f1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:18:21.517414 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-48b360c9-b0ac-4ac3-afbf-a8aa64c3f3a1 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: a6de755e-739d-437c-aafb-6bc49f8bb086] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:18:21.528438 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-48b360c9-b0ac-4ac3-afbf-a8aa64c3f3a1 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:21.528981 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-39fe28fa-234f-46ae-ab72-b3420d3c677e tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/servers/6f54269a-e144-4b5d-9b78-39120b28e545" status: 200 len: 1266 microversion: 2.1 time: 0.252218 Jul 23 21:18:21.530492 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 621/1244] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:18:21 2022] GET /compute/v2.1/servers/6f54269a-e144-4b5d-9b78-39120b28e545 => generated 1266 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:18:21.542731 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-48b360c9-b0ac-4ac3-afbf-a8aa64c3f3a1 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:21.543602 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-48b360c9-b0ac-4ac3-afbf-a8aa64c3f3a1 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:21.544048 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-48b360c9-b0ac-4ac3-afbf-a8aa64c3f3a1 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:21.589490 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-53957c37-6c74-4483-bdb0-7fbf1dffd81e tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:21.590540 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-53957c37-6c74-4483-bdb0-7fbf1dffd81e tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] [instance: e753b3c8-e63a-48d5-a349-fa19db134404] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:18:21.615257 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-53957c37-6c74-4483-bdb0-7fbf1dffd81e tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:21.617360 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-53957c37-6c74-4483-bdb0-7fbf1dffd81e tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:21.619716 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-53957c37-6c74-4483-bdb0-7fbf1dffd81e tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:21.621119 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-53957c37-6c74-4483-bdb0-7fbf1dffd81e tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:22.198951 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-48b360c9-b0ac-4ac3-afbf-a8aa64c3f3a1 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:18:22.216453 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-48b360c9-b0ac-4ac3-afbf-a8aa64c3f3a1 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:18:22.223981 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-48b360c9-b0ac-4ac3-afbf-a8aa64c3f3a1 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:18:22.226180 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-48b360c9-b0ac-4ac3-afbf-a8aa64c3f3a1 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/a6de755e-739d-437c-aafb-6bc49f8bb086" status: 200 len: 1806 microversion: 2.25 time: 0.723869 Jul 23 21:18:22.239151 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 624/1245] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:18:21 2022] GET /compute/v2.1/servers/a6de755e-739d-437c-aafb-6bc49f8bb086 => generated 1806 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:18:22.258780 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-f925186d-781a-4dee-b4b2-b6cef84dd3a7 req-7a128823-2787-4415-ba79-bba5bcfcd7a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e753b3c8-e63a-48d5-a349-fa19db134404", "name": "network-vif-plugged", "status": "completed", "tag": "386c18e4-513b-4ac2-a469-5df264df0146"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:18:22.269213 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-f925186d-781a-4dee-b4b2-b6cef84dd3a7 req-7a128823-2787-4415-ba79-bba5bcfcd7a9 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:22.270101 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-f925186d-781a-4dee-b4b2-b6cef84dd3a7 req-7a128823-2787-4415-ba79-bba5bcfcd7a9 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:22.291198 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-53957c37-6c74-4483-bdb0-7fbf1dffd81e tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3ad614d9d24300adb274cc95120fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3811ea868f5649e8a235539a5bf46706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:18:22.302017 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-53957c37-6c74-4483-bdb0-7fbf1dffd81e tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] 10.222.0.17 "GET /compute/v2.1/servers/e753b3c8-e63a-48d5-a349-fa19db134404" status: 200 len: 1369 microversion: 2.1 time: 0.719771 Jul 23 21:18:22.305568 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 622/1246] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:18:21 2022] GET /compute/v2.1/servers/e753b3c8-e63a-48d5-a349-fa19db134404 => generated 1369 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:18:22.319714 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-7099c252-1a36-4545-a408-63bd37660c0a req-8888666c-f25a-4d49-acf9-ad311cc53c04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e985a36-586a-4546-a0c0-1a3e3da330c9", "name": "network-vif-deleted", "tag": "f7d5f9d8-f247-4c0e-b465-0c960879af67"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:18:22.332838 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-7099c252-1a36-4545-a408-63bd37660c0a req-8888666c-f25a-4d49-acf9-ad311cc53c04 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:22.333559 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-7099c252-1a36-4545-a408-63bd37660c0a req-8888666c-f25a-4d49-acf9-ad311cc53c04 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:22.348933 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-7099c252-1a36-4545-a408-63bd37660c0a req-8888666c-f25a-4d49-acf9-ad311cc53c04 service nova] Creating event network-vif-deleted:f7d5f9d8-f247-4c0e-b465-0c960879af67 for instance 9e985a36-586a-4546-a0c0-1a3e3da330c9 on nch1-master-1 Jul 23 21:18:22.352181 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-f925186d-781a-4dee-b4b2-b6cef84dd3a7 req-7a128823-2787-4415-ba79-bba5bcfcd7a9 service nova] Creating event network-vif-plugged:386c18e4-513b-4ac2-a469-5df264df0146 for instance e753b3c8-e63a-48d5-a349-fa19db134404 on nch1-master-1 Jul 23 21:18:22.363797 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-7099c252-1a36-4545-a408-63bd37660c0a req-8888666c-f25a-4d49-acf9-ad311cc53c04 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052391 Jul 23 21:18:22.366441 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 623/1247] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:18:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:18:22.366959 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-f925186d-781a-4dee-b4b2-b6cef84dd3a7 req-7a128823-2787-4415-ba79-bba5bcfcd7a9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121967 Jul 23 21:18:22.372172 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 625/1248] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:18:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:18:22.380385 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-22b5ffb5-35b0-441e-aff2-6d0789d8c2da tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:22.380601 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-95ad70c9-e548-49d6-aac9-4c1fa2cb3af2 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Calling method '.version_select at 0x7f0b4775b0d0>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:22.383289 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-95ad70c9-e548-49d6-aac9-4c1fa2cb3af2 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:22.383506 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-22b5ffb5-35b0-441e-aff2-6d0789d8c2da tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: d1b84776-ab42-4b27-975d-1744b2935bb2] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:18:22.383743 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-95ad70c9-e548-49d6-aac9-4c1fa2cb3af2 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:22.399426 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-22b5ffb5-35b0-441e-aff2-6d0789d8c2da tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:22.399885 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-22b5ffb5-35b0-441e-aff2-6d0789d8c2da tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:22.400704 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-22b5ffb5-35b0-441e-aff2-6d0789d8c2da tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:22.401155 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-22b5ffb5-35b0-441e-aff2-6d0789d8c2da tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:22.411860 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-95ad70c9-e548-49d6-aac9-4c1fa2cb3af2 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] 10.222.0.17 "GET /compute/v2.1/os-migrations" status: 200 len: 4045 microversion: 2.25 time: 0.044933 Jul 23 21:18:22.413038 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 624/1249] 10.222.0.17 () {60 vars in 1183 bytes} [Sat Jul 23 21:18:22 2022] GET /compute/v2.1/os-migrations => generated 4045 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:18:22.436125 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f693eeba-7c46-40e7-afd4-f4b31f146375 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:22.440520 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f693eeba-7c46-40e7-afd4-f4b31f146375 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] [instance: a6de755e-739d-437c-aafb-6bc49f8bb086] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:18:22.470179 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f693eeba-7c46-40e7-afd4-f4b31f146375 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:22.473004 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f693eeba-7c46-40e7-afd4-f4b31f146375 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:22.482911 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f693eeba-7c46-40e7-afd4-f4b31f146375 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:22.483693 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f693eeba-7c46-40e7-afd4-f4b31f146375 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:22.492765 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=100 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:18:22.929942 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-22b5ffb5-35b0-441e-aff2-6d0789d8c2da tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:18:22.946726 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-22b5ffb5-35b0-441e-aff2-6d0789d8c2da tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2" status: 200 len: 1312 microversion: 2.1 time: 0.576319 Jul 23 21:18:22.953326 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 626/1250] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:18:22 2022] GET /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2 => generated 1312 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:18:22.959555 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-90b549c3-12e1-4082-85b4-9cf634e02b66 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:22.962600 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-90b549c3-12e1-4082-85b4-9cf634e02b66 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: 9e985a36-586a-4546-a0c0-1a3e3da330c9] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:18:22.973701 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-90b549c3-12e1-4082-85b4-9cf634e02b66 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:22.974430 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-90b549c3-12e1-4082-85b4-9cf634e02b66 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:22.987761 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-90b549c3-12e1-4082-85b4-9cf634e02b66 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:22.990673 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-90b549c3-12e1-4082-85b4-9cf634e02b66 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:23.078506 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-90b549c3-12e1-4082-85b4-9cf634e02b66 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:23.079826 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-90b549c3-12e1-4082-85b4-9cf634e02b66 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:23.084788 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.objects.instance [None req-90b549c3-12e1-4082-85b4-9cf634e02b66 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lazy-loading 'fault' on Instance uuid 9e985a36-586a-4546-a0c0-1a3e3da330c9 {{(pid=131321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:18:23.167527 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-90b549c3-12e1-4082-85b4-9cf634e02b66 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf92af08fa94215b4eafcacea6c63f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e7d37a0e3b4b32ae99c3bc15a831e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:18:23.185593 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-90b549c3-12e1-4082-85b4-9cf634e02b66 tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "GET /compute/v2.1/servers/9e985a36-586a-4546-a0c0-1a3e3da330c9" status: 200 len: 1307 microversion: 2.1 time: 0.228210 Jul 23 21:18:23.186883 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 627/1251] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:18:22 2022] GET /compute/v2.1/servers/9e985a36-586a-4546-a0c0-1a3e3da330c9 => generated 1307 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:18:23.197797 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-596d13a2-810e-48a4-b892-aec0ea7b736f tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:23.199425 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-596d13a2-810e-48a4-b892-aec0ea7b736f tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 6f54269a-e144-4b5d-9b78-39120b28e545] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:18:23.219280 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-596d13a2-810e-48a4-b892-aec0ea7b736f tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:23.220119 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-596d13a2-810e-48a4-b892-aec0ea7b736f tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:23.221136 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-596d13a2-810e-48a4-b892-aec0ea7b736f tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:23.222332 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-596d13a2-810e-48a4-b892-aec0ea7b736f tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:23.513006 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.objects.instance [None req-f693eeba-7c46-40e7-afd4-f4b31f146375 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lazy-loading 'services' on Instance uuid a6de755e-739d-437c-aafb-6bc49f8bb086 {{(pid=131320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:18:23.550324 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f693eeba-7c46-40e7-afd4-f4b31f146375 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/a6de755e-739d-437c-aafb-6bc49f8bb086" status: 200 len: 2425 microversion: 2.25 time: 1.118873 Jul 23 21:18:23.551426 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 625/1252] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:18:22 2022] GET /compute/v2.1/servers/a6de755e-739d-437c-aafb-6bc49f8bb086 => generated 2425 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:18:23.557676 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8faa26b4-0e3f-456e-a11f-c3383132b52d tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:23.558553 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8faa26b4-0e3f-456e-a11f-c3383132b52d tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] [instance: e753b3c8-e63a-48d5-a349-fa19db134404] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:18:23.573387 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8faa26b4-0e3f-456e-a11f-c3383132b52d tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:23.580748 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8faa26b4-0e3f-456e-a11f-c3383132b52d tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:23.582139 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8faa26b4-0e3f-456e-a11f-c3383132b52d tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:23.582754 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8faa26b4-0e3f-456e-a11f-c3383132b52d tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:23.801577 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-596d13a2-810e-48a4-b892-aec0ea7b736f tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4f9dda4c2a411cb0394bf86e9ae223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580ed681cbf44d10936259b17f60f1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:18:23.828129 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-596d13a2-810e-48a4-b892-aec0ea7b736f tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/servers/6f54269a-e144-4b5d-9b78-39120b28e545" status: 200 len: 1308 microversion: 2.1 time: 0.639908 Jul 23 21:18:23.829638 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 628/1253] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:18:23 2022] GET /compute/v2.1/servers/6f54269a-e144-4b5d-9b78-39120b28e545 => generated 1308 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:18:23.836678 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-695da775-7159-4561-ac02-0b0734aabf35 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:23.837683 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-695da775-7159-4561-ac02-0b0734aabf35 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] [instance: a6de755e-739d-437c-aafb-6bc49f8bb086] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:18:23.848620 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-695da775-7159-4561-ac02-0b0734aabf35 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:23.849294 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-695da775-7159-4561-ac02-0b0734aabf35 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:23.850618 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-695da775-7159-4561-ac02-0b0734aabf35 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:23.851228 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-695da775-7159-4561-ac02-0b0734aabf35 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:23.963678 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8faa26b4-0e3f-456e-a11f-c3383132b52d tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3ad614d9d24300adb274cc95120fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3811ea868f5649e8a235539a5bf46706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:18:23.973647 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8faa26b4-0e3f-456e-a11f-c3383132b52d tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] 10.222.0.17 "GET /compute/v2.1/servers/e753b3c8-e63a-48d5-a349-fa19db134404" status: 200 len: 1369 microversion: 2.1 time: 0.420064 Jul 23 21:18:23.974261 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 626/1254] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:18:23 2022] GET /compute/v2.1/servers/e753b3c8-e63a-48d5-a349-fa19db134404 => generated 1369 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:18:23.986321 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-58e27fc9-d1ce-41b8-aa98-f0d9ec112aac tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:23.994469 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-58e27fc9-d1ce-41b8-aa98-f0d9ec112aac tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: d1b84776-ab42-4b27-975d-1744b2935bb2] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:18:24.004732 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-58e27fc9-d1ce-41b8-aa98-f0d9ec112aac tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:24.005471 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-58e27fc9-d1ce-41b8-aa98-f0d9ec112aac tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:24.006482 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-58e27fc9-d1ce-41b8-aa98-f0d9ec112aac tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:24.011043 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-58e27fc9-d1ce-41b8-aa98-f0d9ec112aac tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:24.338660 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-58e27fc9-d1ce-41b8-aa98-f0d9ec112aac tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:18:24.351188 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-58e27fc9-d1ce-41b8-aa98-f0d9ec112aac tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2" status: 200 len: 1312 microversion: 2.1 time: 0.371487 Jul 23 21:18:24.352197 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 627/1255] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:18:23 2022] GET /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2 => generated 1312 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:18:24.367808 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d37ad22d-4c7f-40ce-b1cc-0ea9724fc48c tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:24.368669 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d37ad22d-4c7f-40ce-b1cc-0ea9724fc48c tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] [instance: 9e985a36-586a-4546-a0c0-1a3e3da330c9] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:18:24.375401 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:DELETE=2,nova_api:SELECT=95,nova_api:UPDATE=3 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:18:24.378289 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d37ad22d-4c7f-40ce-b1cc-0ea9724fc48c tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:24.378978 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d37ad22d-4c7f-40ce-b1cc-0ea9724fc48c tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:24.380372 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d37ad22d-4c7f-40ce-b1cc-0ea9724fc48c tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:24.381050 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d37ad22d-4c7f-40ce-b1cc-0ea9724fc48c tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:24.416913 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-d37ad22d-4c7f-40ce-b1cc-0ea9724fc48c tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] HTTP exception thrown: Instance 9e985a36-586a-4546-a0c0-1a3e3da330c9 could not be found. Jul 23 21:18:24.418858 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d37ad22d-4c7f-40ce-b1cc-0ea9724fc48c tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Request method failure captured: Jul 23 21:18:24.418858 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/9e985a36-586a-4546-a0c0-1a3e3da330c9 HTTP/1.1 Jul 23 21:18:24.418858 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:18:24.418858 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:18:24.418858 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:18:24.418858 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:18:24.418858 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:18:24.418858 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:18:24.418858 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:18:24.418858 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:18:24.418858 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GTXg43xsvaDpXj4BMz40UdSnpyPBTbhxj1IdGMcN1ZmThctVpX9T9iG6eRr9MGt1QTpmHEqYNbJp_e-y4RlWttw_Ug9gposZ1FVUrLfy9Hukeo6nEcrmiwqSETVX_CDHg3xVpH7dYYo0t5AjovoUMlG-_EeGSUlkV9963ANN9g-cqA Jul 23 21:18:24.418858 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:18:24.418858 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:18:24.418858 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:18:24.418858 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:18:24.418858 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:18:24.418858 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:18:24.418858 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: f5e7d37a0e3b4b32ae99c3bc15a831e6 Jul 23 21:18:24.418858 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServersOnMultiNodesTest-62510325 Jul 23 21:18:24.418858 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:18:24.418858 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:18:24.420681 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f5e7d37a0e3b4b32ae99c3bc15a831e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f5e7d37a0e3b4b32ae99c3bc15a831e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f5e7d37a0e3b4b32ae99c3bc15a831e6", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f5e7d37a0e3b4b32ae99c3bc15a831e6"}]}] Jul 23 21:18:24.420681 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServersOnMultiNodesTest-62510325 Jul 23 21:18:24.420681 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: f5e7d37a0e3b4b32ae99c3bc15a831e6 Jul 23 21:18:24.420681 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-62510325 Jul 23 21:18:24.420681 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServersOnMultiNodesTest-62510325-project Jul 23 21:18:24.420681 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:18:24.420681 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:18:24.420681 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: ebf92af08fa94215b4eafcacea6c63f6 Jul 23 21:18:24.420681 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServersOnMultiNodesTest-62510325-project Jul 23 21:18:24.420681 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:18:24.420681 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance 9e985a36-586a-4546-a0c0-1a3e3da330c9 could not be found. Jul 23 21:18:24.420681 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '9e985a36-586a-4546-a0c0-1a3e3da330c9'} Jul 23 21:18:24.421619 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:18:24.421619 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:18:24.421619 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:18:24.421619 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:18:24.421619 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:18:24.421619 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:18:24.421619 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:18:24.421619 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:18:24.421619 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:18:24.421619 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:18:24.421619 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e985a36-586a-4546-a0c0-1a3e3da330c9 could not be found. Jul 23 21:18:24.421619 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:18:24.421619 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:18:24.421619 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:18:24.421619 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:18:24.421619 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:18:24.421619 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:18:24.421619 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:18:24.421619 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:18:24.421619 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:18:24.423241 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:18:24.423241 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:18:24.423241 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:18:24.423241 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:18:24.423241 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:18:24.423241 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:18:24.423241 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:18:24.423241 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e985a36-586a-4546-a0c0-1a3e3da330c9 could not be found. Jul 23 21:18:24.423241 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:18:24.423241 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:18:24.423241 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:18:24.423241 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:18:24.423241 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:18:24.423241 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:18:24.423241 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:18:24.423241 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:18:24.423241 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e985a36-586a-4546-a0c0-1a3e3da330c9 could not be found. Jul 23 21:18:24.423241 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:18:24.442938 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d37ad22d-4c7f-40ce-b1cc-0ea9724fc48c tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] Returning 404 to user: Instance 9e985a36-586a-4546-a0c0-1a3e3da330c9 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:18:24.448085 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d37ad22d-4c7f-40ce-b1cc-0ea9724fc48c tempest-ServersOnMultiNodesTest-62510325 tempest-ServersOnMultiNodesTest-62510325-project] 10.222.0.17 "GET /compute/v2.1/servers/9e985a36-586a-4546-a0c0-1a3e3da330c9" status: 404 len: 111 microversion: 2.1 time: 0.081371 Jul 23 21:18:24.449338 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 628/1256] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:18:24 2022] GET /compute/v2.1/servers/9e985a36-586a-4546-a0c0-1a3e3da330c9 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:18:24.571242 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-a4b0e2e2-414b-47e6-b3ba-85075d19ac25 req-743d103b-a11c-48a3-8d77-e689c372c3d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1b84776-ab42-4b27-975d-1744b2935bb2", "tag": "75148d97-06cd-4836-97fd-6cce38566d93"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:18:24.588273 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-a4b0e2e2-414b-47e6-b3ba-85075d19ac25 req-743d103b-a11c-48a3-8d77-e689c372c3d3 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:24.594174 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-a4b0e2e2-414b-47e6-b3ba-85075d19ac25 req-743d103b-a11c-48a3-8d77-e689c372c3d3 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:24.622097 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.objects.instance [None req-695da775-7159-4561-ac02-0b0734aabf35 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lazy-loading 'services' on Instance uuid a6de755e-739d-437c-aafb-6bc49f8bb086 {{(pid=131321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:18:24.647565 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-a4b0e2e2-414b-47e6-b3ba-85075d19ac25 req-743d103b-a11c-48a3-8d77-e689c372c3d3 service nova] Creating event network-changed:75148d97-06cd-4836-97fd-6cce38566d93 for instance d1b84776-ab42-4b27-975d-1744b2935bb2 on nch2-master-1 Jul 23 21:18:24.655984 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-695da775-7159-4561-ac02-0b0734aabf35 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/a6de755e-739d-437c-aafb-6bc49f8bb086" status: 200 len: 2425 microversion: 2.25 time: 0.824600 Jul 23 21:18:24.660850 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-a4b0e2e2-414b-47e6-b3ba-85075d19ac25 req-743d103b-a11c-48a3-8d77-e689c372c3d3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091565 Jul 23 21:18:24.662034 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 629/1258] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:18:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:18:24.662145 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 629/1258] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:18:23 2022] GET /compute/v2.1/servers/a6de755e-739d-437c-aafb-6bc49f8bb086 => generated 2425 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:18:24.831142 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-84517261-5dad-4dba-b179-19c805ba5736 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:24.831643 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-84517261-5dad-4dba-b179-19c805ba5736 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: a6de755e-739d-437c-aafb-6bc49f8bb086] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:18:24.848448 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-17bcbc6d-7133-4008-acf2-a27d8361a92b tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:24.849061 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-17bcbc6d-7133-4008-acf2-a27d8361a92b tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 6f54269a-e144-4b5d-9b78-39120b28e545] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:18:24.854125 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-84517261-5dad-4dba-b179-19c805ba5736 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:24.856918 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-84517261-5dad-4dba-b179-19c805ba5736 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:24.861578 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-84517261-5dad-4dba-b179-19c805ba5736 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:24.862360 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-84517261-5dad-4dba-b179-19c805ba5736 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:24.886040 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-17bcbc6d-7133-4008-acf2-a27d8361a92b tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:24.892543 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-17bcbc6d-7133-4008-acf2-a27d8361a92b tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:24.894280 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-17bcbc6d-7133-4008-acf2-a27d8361a92b tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:24.894974 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-17bcbc6d-7133-4008-acf2-a27d8361a92b tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:25.168888 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.objects.instance [None req-84517261-5dad-4dba-b179-19c805ba5736 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lazy-loading 'services' on Instance uuid a6de755e-739d-437c-aafb-6bc49f8bb086 {{(pid=131321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:18:25.445050 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-84517261-5dad-4dba-b179-19c805ba5736 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "DELETE /compute/v2.1/servers/a6de755e-739d-437c-aafb-6bc49f8bb086/os-volume_attachments/ae9e1d9d-8480-46b5-b3ec-f6bb2a5341c9" status: 202 len: 0 microversion: 2.25 time: 0.616180 Jul 23 21:18:25.456792 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 630/1259] 10.222.0.17 () {60 vars in 1456 bytes} [Sat Jul 23 21:18:24 2022] DELETE /compute/v2.1/servers/a6de755e-739d-437c-aafb-6bc49f8bb086/os-volume_attachments/ae9e1d9d-8480-46b5-b3ec-f6bb2a5341c9 => generated 0 bytes in 628 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:18:25.471982 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e1fa7d81-63db-4b19-b427-990a58e12779 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:25.473293 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-e1fa7d81-63db-4b19-b427-990a58e12779 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] [instance: e753b3c8-e63a-48d5-a349-fa19db134404] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:18:25.492186 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e1fa7d81-63db-4b19-b427-990a58e12779 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:25.494336 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e1fa7d81-63db-4b19-b427-990a58e12779 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:25.495349 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e1fa7d81-63db-4b19-b427-990a58e12779 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:25.497160 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e1fa7d81-63db-4b19-b427-990a58e12779 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:25.633284 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-17bcbc6d-7133-4008-acf2-a27d8361a92b tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4f9dda4c2a411cb0394bf86e9ae223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580ed681cbf44d10936259b17f60f1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:18:25.653277 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-17bcbc6d-7133-4008-acf2-a27d8361a92b tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/servers/6f54269a-e144-4b5d-9b78-39120b28e545" status: 200 len: 1308 microversion: 2.1 time: 0.802108 Jul 23 21:18:25.654397 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 630/1260] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:18:24 2022] GET /compute/v2.1/servers/6f54269a-e144-4b5d-9b78-39120b28e545 => generated 1308 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:18:25.662655 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-85fe7c16-cda6-4127-a5ce-d61038989ff5 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:25.676189 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-85fe7c16-cda6-4127-a5ce-d61038989ff5 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: d1b84776-ab42-4b27-975d-1744b2935bb2] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:18:25.683802 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-85fe7c16-cda6-4127-a5ce-d61038989ff5 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:25.684354 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-85fe7c16-cda6-4127-a5ce-d61038989ff5 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:25.685221 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-85fe7c16-cda6-4127-a5ce-d61038989ff5 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:25.685724 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-85fe7c16-cda6-4127-a5ce-d61038989ff5 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:25.952286 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-85fe7c16-cda6-4127-a5ce-d61038989ff5 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:18:25.961393 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-85fe7c16-cda6-4127-a5ce-d61038989ff5 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2" status: 200 len: 1312 microversion: 2.1 time: 0.305812 Jul 23 21:18:25.975051 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 631/1261] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:18:25 2022] GET /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2 => generated 1312 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:18:25.978238 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-903f3ef9-d8d7-48d8-a026-9ea99f57a9bb tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:25.981212 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-903f3ef9-d8d7-48d8-a026-9ea99f57a9bb tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: a6de755e-739d-437c-aafb-6bc49f8bb086] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:18:25.994099 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-903f3ef9-d8d7-48d8-a026-9ea99f57a9bb tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:25.994573 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-903f3ef9-d8d7-48d8-a026-9ea99f57a9bb tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:25.995429 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-903f3ef9-d8d7-48d8-a026-9ea99f57a9bb tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:25.995871 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-903f3ef9-d8d7-48d8-a026-9ea99f57a9bb tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:26.041221 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-903f3ef9-d8d7-48d8-a026-9ea99f57a9bb tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/a6de755e-739d-437c-aafb-6bc49f8bb086/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.072855 Jul 23 21:18:26.043212 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 632/1262] 10.222.0.17 () {60 vars in 1342 bytes} [Sat Jul 23 21:18:25 2022] GET /compute/v2.1/servers/a6de755e-739d-437c-aafb-6bc49f8bb086/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 23 21:18:26.209185 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-fea68817-570e-4c87-80c7-2e736983dabc req-5f16aec1-a489-4dba-8b39-60a8bb4266db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f54269a-e144-4b5d-9b78-39120b28e545", "tag": "cb8b469c-a568-415a-85b4-07644be9af70"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:18:26.233644 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-fea68817-570e-4c87-80c7-2e736983dabc req-5f16aec1-a489-4dba-8b39-60a8bb4266db service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:26.234344 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-fea68817-570e-4c87-80c7-2e736983dabc req-5f16aec1-a489-4dba-8b39-60a8bb4266db service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:26.253648 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-e1fa7d81-63db-4b19-b427-990a58e12779 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3ad614d9d24300adb274cc95120fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3811ea868f5649e8a235539a5bf46706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:18:26.263021 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-e1fa7d81-63db-4b19-b427-990a58e12779 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] 10.222.0.17 "GET /compute/v2.1/servers/e753b3c8-e63a-48d5-a349-fa19db134404" status: 200 len: 1554 microversion: 2.1 time: 0.802808 Jul 23 21:18:26.263614 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 631/1263] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:18:25 2022] GET /compute/v2.1/servers/e753b3c8-e63a-48d5-a349-fa19db134404 => generated 1554 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:18:26.275013 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-fea68817-570e-4c87-80c7-2e736983dabc req-5f16aec1-a489-4dba-8b39-60a8bb4266db service nova] Creating event network-changed:cb8b469c-a568-415a-85b4-07644be9af70 for instance 6f54269a-e144-4b5d-9b78-39120b28e545 on nch2-master-1 Jul 23 21:18:26.288433 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-fea68817-570e-4c87-80c7-2e736983dabc req-5f16aec1-a489-4dba-8b39-60a8bb4266db service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083782 Jul 23 21:18:26.289767 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 633/1264] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:18:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:18:26.302988 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f25f94ce-a214-44d1-aa0e-6c932962dc44 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:26.304064 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-f25f94ce-a214-44d1-aa0e-6c932962dc44 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] [instance: e753b3c8-e63a-48d5-a349-fa19db134404] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:18:26.329667 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f25f94ce-a214-44d1-aa0e-6c932962dc44 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:26.337277 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f25f94ce-a214-44d1-aa0e-6c932962dc44 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:26.338258 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f25f94ce-a214-44d1-aa0e-6c932962dc44 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:26.340207 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f25f94ce-a214-44d1-aa0e-6c932962dc44 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:26.671027 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-78775eb3-1b7a-430c-917f-4205fc95e88e tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:26.672044 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-78775eb3-1b7a-430c-917f-4205fc95e88e tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 6f54269a-e144-4b5d-9b78-39120b28e545] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:18:26.684577 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-78775eb3-1b7a-430c-917f-4205fc95e88e tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:26.686687 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-78775eb3-1b7a-430c-917f-4205fc95e88e tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:26.688221 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-78775eb3-1b7a-430c-917f-4205fc95e88e tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:26.689527 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-78775eb3-1b7a-430c-917f-4205fc95e88e tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:26.776253 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-f25f94ce-a214-44d1-aa0e-6c932962dc44 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] 10.222.0.17 "GET /compute/v2.1/servers/e753b3c8-e63a-48d5-a349-fa19db134404/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.482216 Jul 23 21:18:26.777201 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 632/1265] 10.222.0.17 () {58 vars in 1274 bytes} [Sat Jul 23 21:18:26 2022] GET /compute/v2.1/servers/e753b3c8-e63a-48d5-a349-fa19db134404/os-interface => generated 285 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:18:26.926260 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-78775eb3-1b7a-430c-917f-4205fc95e88e tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4f9dda4c2a411cb0394bf86e9ae223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580ed681cbf44d10936259b17f60f1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:18:26.937421 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-78775eb3-1b7a-430c-917f-4205fc95e88e tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/servers/6f54269a-e144-4b5d-9b78-39120b28e545" status: 200 len: 1308 microversion: 2.1 time: 0.270522 Jul 23 21:18:26.947404 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 634/1266] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:18:26 2022] GET /compute/v2.1/servers/6f54269a-e144-4b5d-9b78-39120b28e545 => generated 1308 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:18:26.979816 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell0:SELECT=4 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:18:26.986114 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-8cd31d55-0740-4bbe-b490-0ffc5a12088e tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:26.989939 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-8cd31d55-0740-4bbe-b490-0ffc5a12088e tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: d1b84776-ab42-4b27-975d-1744b2935bb2] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:18:26.999965 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8cd31d55-0740-4bbe-b490-0ffc5a12088e tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:27.001900 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8cd31d55-0740-4bbe-b490-0ffc5a12088e tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:27.003972 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8cd31d55-0740-4bbe-b490-0ffc5a12088e tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:27.005683 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8cd31d55-0740-4bbe-b490-0ffc5a12088e tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:27.057790 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c43cc909-44a2-4538-95d9-4a0025def7e1 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:27.058879 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c43cc909-44a2-4538-95d9-4a0025def7e1 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: a6de755e-739d-437c-aafb-6bc49f8bb086] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:18:27.066527 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c43cc909-44a2-4538-95d9-4a0025def7e1 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:27.066994 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c43cc909-44a2-4538-95d9-4a0025def7e1 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:27.067791 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c43cc909-44a2-4538-95d9-4a0025def7e1 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:27.068269 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c43cc909-44a2-4538-95d9-4a0025def7e1 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:27.131572 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c43cc909-44a2-4538-95d9-4a0025def7e1 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/a6de755e-739d-437c-aafb-6bc49f8bb086/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.075140 Jul 23 21:18:27.136915 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 635/1267] 10.222.0.17 () {60 vars in 1342 bytes} [Sat Jul 23 21:18:27 2022] GET /compute/v2.1/servers/a6de755e-739d-437c-aafb-6bc49f8bb086/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 23 21:18:27.608587 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell0:SELECT=16 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:18:27.955185 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5315ad69-5f49-4986-892e-500f9ebe14ba tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:27.956471 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5315ad69-5f49-4986-892e-500f9ebe14ba tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 6f54269a-e144-4b5d-9b78-39120b28e545] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:18:27.965544 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5315ad69-5f49-4986-892e-500f9ebe14ba tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:27.972109 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5315ad69-5f49-4986-892e-500f9ebe14ba tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:27.973152 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5315ad69-5f49-4986-892e-500f9ebe14ba tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:27.973754 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5315ad69-5f49-4986-892e-500f9ebe14ba tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:28.001179 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-8cd31d55-0740-4bbe-b490-0ffc5a12088e tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:18:28.017427 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-8cd31d55-0740-4bbe-b490-0ffc5a12088e tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2" status: 200 len: 1312 microversion: 2.1 time: 1.038682 Jul 23 21:18:28.019188 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 633/1268] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:18:26 2022] GET /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2 => generated 1312 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:18:28.172126 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-4dbe0780-1e8a-4659-800a-88c87e4880b0 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:28.173436 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-4dbe0780-1e8a-4659-800a-88c87e4880b0 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: a6de755e-739d-437c-aafb-6bc49f8bb086] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:18:28.190839 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4dbe0780-1e8a-4659-800a-88c87e4880b0 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:28.192223 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4dbe0780-1e8a-4659-800a-88c87e4880b0 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:28.193831 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4dbe0780-1e8a-4659-800a-88c87e4880b0 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:28.194434 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4dbe0780-1e8a-4659-800a-88c87e4880b0 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:28.313339 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-4dbe0780-1e8a-4659-800a-88c87e4880b0 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/a6de755e-739d-437c-aafb-6bc49f8bb086/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.173608 Jul 23 21:18:28.322043 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 634/1269] 10.222.0.17 () {60 vars in 1342 bytes} [Sat Jul 23 21:18:28 2022] GET /compute/v2.1/servers/a6de755e-739d-437c-aafb-6bc49f8bb086/os-volume_attachments => generated 25 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:18:28.905789 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5315ad69-5f49-4986-892e-500f9ebe14ba tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4f9dda4c2a411cb0394bf86e9ae223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580ed681cbf44d10936259b17f60f1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:18:28.917694 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5315ad69-5f49-4986-892e-500f9ebe14ba tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/servers/6f54269a-e144-4b5d-9b78-39120b28e545" status: 200 len: 1308 microversion: 2.1 time: 0.967522 Jul 23 21:18:28.929821 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 636/1270] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:18:27 2022] GET /compute/v2.1/servers/6f54269a-e144-4b5d-9b78-39120b28e545 => generated 1308 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:18:29.037426 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-41f3e977-0d03-48fe-8941-9079cb649482 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:29.038984 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-41f3e977-0d03-48fe-8941-9079cb649482 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: d1b84776-ab42-4b27-975d-1744b2935bb2] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:18:29.055119 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-41f3e977-0d03-48fe-8941-9079cb649482 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:29.056837 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-41f3e977-0d03-48fe-8941-9079cb649482 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:29.064350 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-41f3e977-0d03-48fe-8941-9079cb649482 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:29.065618 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-41f3e977-0d03-48fe-8941-9079cb649482 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:29.553808 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-41f3e977-0d03-48fe-8941-9079cb649482 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:18:29.569355 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-41f3e977-0d03-48fe-8941-9079cb649482 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2" status: 200 len: 1312 microversion: 2.1 time: 0.537803 Jul 23 21:18:29.578513 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 635/1271] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:18:29 2022] GET /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2 => generated 1312 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:18:29.936361 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-62d97f8a-9c5f-46bb-a6ab-94e7b6404219 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:29.937367 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-62d97f8a-9c5f-46bb-a6ab-94e7b6404219 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 6f54269a-e144-4b5d-9b78-39120b28e545] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:18:29.951413 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-62d97f8a-9c5f-46bb-a6ab-94e7b6404219 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:29.954610 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-62d97f8a-9c5f-46bb-a6ab-94e7b6404219 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:29.958218 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-62d97f8a-9c5f-46bb-a6ab-94e7b6404219 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:29.960691 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-62d97f8a-9c5f-46bb-a6ab-94e7b6404219 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:30.606463 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-53b3bf43-e892-4a82-a93f-f4da3f67442a tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:30.613416 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-53b3bf43-e892-4a82-a93f-f4da3f67442a tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: d1b84776-ab42-4b27-975d-1744b2935bb2] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:18:30.626678 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-53b3bf43-e892-4a82-a93f-f4da3f67442a tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:30.627425 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-53b3bf43-e892-4a82-a93f-f4da3f67442a tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:30.628438 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-53b3bf43-e892-4a82-a93f-f4da3f67442a tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:30.629169 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-53b3bf43-e892-4a82-a93f-f4da3f67442a tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:31.093085 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-62d97f8a-9c5f-46bb-a6ab-94e7b6404219 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4f9dda4c2a411cb0394bf86e9ae223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580ed681cbf44d10936259b17f60f1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:18:31.101791 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-62d97f8a-9c5f-46bb-a6ab-94e7b6404219 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/servers/6f54269a-e144-4b5d-9b78-39120b28e545" status: 200 len: 1308 microversion: 2.1 time: 1.169187 Jul 23 21:18:31.104787 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 637/1272] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:18:29 2022] GET /compute/v2.1/servers/6f54269a-e144-4b5d-9b78-39120b28e545 => generated 1308 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:18:31.744145 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-70b94026-77c3-46cd-ba33-670193053e03 req-1394f283-d80d-4849-8ff9-426e8864b7e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e753b3c8-e63a-48d5-a349-fa19db134404", "tag": "386c18e4-513b-4ac2-a469-5df264df0146"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:18:31.757203 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-53b3bf43-e892-4a82-a93f-f4da3f67442a tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:18:31.761352 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:18:31.772361 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-70b94026-77c3-46cd-ba33-670193053e03 req-1394f283-d80d-4849-8ff9-426e8864b7e5 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:31.773346 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-70b94026-77c3-46cd-ba33-670193053e03 req-1394f283-d80d-4849-8ff9-426e8864b7e5 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:31.776256 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-53b3bf43-e892-4a82-a93f-f4da3f67442a tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2" status: 200 len: 1312 microversion: 2.1 time: 1.189959 Jul 23 21:18:31.777015 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 636/1273] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:18:30 2022] GET /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2 => generated 1312 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:18:31.801418 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-70b94026-77c3-46cd-ba33-670193053e03 req-1394f283-d80d-4849-8ff9-426e8864b7e5 service nova] Creating event network-changed:386c18e4-513b-4ac2-a469-5df264df0146 for instance e753b3c8-e63a-48d5-a349-fa19db134404 on nch1-master-1 Jul 23 21:18:31.816105 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-70b94026-77c3-46cd-ba33-670193053e03 req-1394f283-d80d-4849-8ff9-426e8864b7e5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075486 Jul 23 21:18:31.817368 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 638/1274] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:18:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:18:32.124252 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a22be438-0d04-4392-bc69-2a816c3b9451 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:32.124252 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-a22be438-0d04-4392-bc69-2a816c3b9451 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 6f54269a-e144-4b5d-9b78-39120b28e545] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:18:32.133760 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a22be438-0d04-4392-bc69-2a816c3b9451 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:32.137073 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a22be438-0d04-4392-bc69-2a816c3b9451 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:32.144865 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a22be438-0d04-4392-bc69-2a816c3b9451 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:32.152205 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a22be438-0d04-4392-bc69-2a816c3b9451 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:32.754174 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-a22be438-0d04-4392-bc69-2a816c3b9451 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4f9dda4c2a411cb0394bf86e9ae223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580ed681cbf44d10936259b17f60f1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:18:32.761898 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-a22be438-0d04-4392-bc69-2a816c3b9451 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/servers/6f54269a-e144-4b5d-9b78-39120b28e545" status: 200 len: 1308 microversion: 2.1 time: 0.645164 Jul 23 21:18:32.770620 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 637/1275] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:18:32 2022] GET /compute/v2.1/servers/6f54269a-e144-4b5d-9b78-39120b28e545 => generated 1308 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:18:32.793104 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-6fdb3e54-7008-4ff6-b988-9f5cb9e2e20f tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:32.793671 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-6fdb3e54-7008-4ff6-b988-9f5cb9e2e20f tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: d1b84776-ab42-4b27-975d-1744b2935bb2] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:18:32.804602 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6fdb3e54-7008-4ff6-b988-9f5cb9e2e20f tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:32.805062 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6fdb3e54-7008-4ff6-b988-9f5cb9e2e20f tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:32.830588 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6fdb3e54-7008-4ff6-b988-9f5cb9e2e20f tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:32.831145 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6fdb3e54-7008-4ff6-b988-9f5cb9e2e20f tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:32.883907 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-13328634-ee45-42fb-b1e6-9cbe55ec1030 tempest-KeyPairsV22TestJSON-390690750 tempest-KeyPairsV22TestJSON-390690750-project] Action: 'create', calling method: .version_select at 0x7f0b475d85e0>, body: {"keypair": {"name": "tempest-keypair-1362346144", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEtTYNPo/iLr9OyMnfTn1raRvuVrjqfwVouDbg8dcm7p5ffnHeDckHTRlzyOmigYGfMhBCEiVVYzHWL+xpGPpcBCdjI1JOnw6zORJaFfTrJ8Kqzm2cf0kazjzJX+apB35g=="}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:18:32.905322 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-13328634-ee45-42fb-b1e6-9cbe55ec1030 tempest-KeyPairsV22TestJSON-390690750 tempest-KeyPairsV22TestJSON-390690750-project] Getting quotas for project ad09cbaf0f384f6fb0cea9879b83f32e. Resources: {'key_pairs'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:18:32.912710 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-13328634-ee45-42fb-b1e6-9cbe55ec1030 tempest-KeyPairsV22TestJSON-390690750 tempest-KeyPairsV22TestJSON-390690750-project] Getting quotas for user 3d71a807adbd4c1082be1437f1b0ace6 and project ad09cbaf0f384f6fb0cea9879b83f32e. Resources: {'key_pairs'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:18:32.963897 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-13328634-ee45-42fb-b1e6-9cbe55ec1030 tempest-KeyPairsV22TestJSON-390690750 tempest-KeyPairsV22TestJSON-390690750-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.280187 Jul 23 21:18:32.965541 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 639/1276] 10.222.0.17 () {62 vars in 1198 bytes} [Sat Jul 23 21:18:32 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 284 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Jul 23 21:18:32.977011 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6cb51f30-f323-43d5-aaab-226a2b7fbff7 tempest-KeyPairsV22TestJSON-390690750 tempest-KeyPairsV22TestJSON-390690750-project] Calling method '.version_select at 0x7f0b475d8700>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:32.999501 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6cb51f30-f323-43d5-aaab-226a2b7fbff7 tempest-KeyPairsV22TestJSON-390690750 tempest-KeyPairsV22TestJSON-390690750-project] 10.222.0.17 "GET /compute/v2.1/os-keypairs/tempest-keypair-1362346144" status: 200 len: 512 microversion: 2.2 time: 0.026653 Jul 23 21:18:33.003024 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 640/1277] 10.222.0.17 () {60 vars in 1257 bytes} [Sat Jul 23 21:18:32 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1362346144 => generated 512 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:18:33.016639 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-fae204c3-1356-42d0-bb44-1b72e4417ae4 tempest-KeyPairsV22TestJSON-390690750 tempest-KeyPairsV22TestJSON-390690750-project] Calling method '.version_select at 0x7f0b4777f4c0>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:33.060882 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-fae204c3-1356-42d0-bb44-1b72e4417ae4 tempest-KeyPairsV22TestJSON-390690750 tempest-KeyPairsV22TestJSON-390690750-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1362346144" status: 204 len: 0 microversion: 2.2 time: 0.051683 Jul 23 21:18:33.061443 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 641/1278] 10.222.0.17 () {60 vars in 1260 bytes} [Sat Jul 23 21:18:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1362346144 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 23 21:18:33.074761 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a462f6fc-23a4-4cd8-93ad-5209d83c7a03 tempest-KeyPairsV22TestJSON-390690750 tempest-KeyPairsV22TestJSON-390690750-project] Action: 'create', calling method: .version_select at 0x7f0b477b0b80>, body: {"keypair": {"name": "tempest-keypair-1843535829", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIgS+hHOMfUSmijl/jSTbGhJB+L8WI+PMM5sQOrI+CLSHiGCRg83hD5EEs22W3iBIdjDONvA1+RMzamK33ysQCgGMgNyZj/BfXxOBHDYbX+EnXbUCwmDWbnNttBETK6/ZQ=="}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:18:33.105722 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-a462f6fc-23a4-4cd8-93ad-5209d83c7a03 tempest-KeyPairsV22TestJSON-390690750 tempest-KeyPairsV22TestJSON-390690750-project] Getting quotas for project ad09cbaf0f384f6fb0cea9879b83f32e. Resources: {'key_pairs'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:18:33.127122 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-a462f6fc-23a4-4cd8-93ad-5209d83c7a03 tempest-KeyPairsV22TestJSON-390690750 tempest-KeyPairsV22TestJSON-390690750-project] Getting quotas for user 3d71a807adbd4c1082be1437f1b0ace6 and project ad09cbaf0f384f6fb0cea9879b83f32e. Resources: {'key_pairs'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:18:33.186038 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a462f6fc-23a4-4cd8-93ad-5209d83c7a03 tempest-KeyPairsV22TestJSON-390690750 tempest-KeyPairsV22TestJSON-390690750-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.115825 Jul 23 21:18:33.187021 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 642/1279] 10.222.0.17 () {62 vars in 1198 bytes} [Sat Jul 23 21:18:33 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 118 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Jul 23 21:18:33.194777 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-6fdb3e54-7008-4ff6-b988-9f5cb9e2e20f tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:18:33.197025 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ee40bdfa-e994-44d6-b992-32b4efcf63e6 tempest-KeyPairsV22TestJSON-390690750 tempest-KeyPairsV22TestJSON-390690750-project] Calling method '.version_select at 0x7f0b477dee50>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:33.210578 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-6fdb3e54-7008-4ff6-b988-9f5cb9e2e20f tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2" status: 200 len: 1312 microversion: 2.1 time: 0.421807 Jul 23 21:18:33.211442 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 638/1280] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:18:32 2022] GET /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2 => generated 1312 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:18:33.249114 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ee40bdfa-e994-44d6-b992-32b4efcf63e6 tempest-KeyPairsV22TestJSON-390690750 tempest-KeyPairsV22TestJSON-390690750-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1843535829" status: 204 len: 0 microversion: 2.2 time: 0.056277 Jul 23 21:18:33.249813 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 643/1281] 10.222.0.17 () {60 vars in 1260 bytes} [Sat Jul 23 21:18:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1843535829 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 23 21:18:33.259974 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-3034fde6-0390-46e7-a6bc-c66238d15e52 tempest-KeyPairsV22TestJSON-390690750 tempest-KeyPairsV22TestJSON-390690750-project] Action: 'create', calling method: .version_select at 0x7f0b47cf6820>, body: {"keypair": {"name": "tempest-keypair-163562406", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:18:33.305766 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-3034fde6-0390-46e7-a6bc-c66238d15e52 tempest-KeyPairsV22TestJSON-390690750 tempest-KeyPairsV22TestJSON-390690750-project] Getting quotas for project ad09cbaf0f384f6fb0cea9879b83f32e. Resources: {'key_pairs'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:18:33.325759 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-3034fde6-0390-46e7-a6bc-c66238d15e52 tempest-KeyPairsV22TestJSON-390690750 tempest-KeyPairsV22TestJSON-390690750-project] Getting quotas for user 3d71a807adbd4c1082be1437f1b0ace6 and project ad09cbaf0f384f6fb0cea9879b83f32e. Resources: {'key_pairs'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:18:33.377174 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-3034fde6-0390-46e7-a6bc-c66238d15e52 tempest-KeyPairsV22TestJSON-390690750 tempest-KeyPairsV22TestJSON-390690750-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 588 microversion: 2.2 time: 0.121320 Jul 23 21:18:33.382823 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 639/1282] 10.222.0.17 () {62 vars in 1198 bytes} [Sat Jul 23 21:18:33 2022] POST /compute/v2.1/os-keypairs => generated 588 bytes in 128 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 23 21:18:33.388731 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6ec88246-0d84-4831-99d1-6bd7586359e8 tempest-KeyPairsV22TestJSON-390690750 tempest-KeyPairsV22TestJSON-390690750-project] Calling method '.version_select at 0x7f0b4764b700>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:33.423562 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6ec88246-0d84-4831-99d1-6bd7586359e8 tempest-KeyPairsV22TestJSON-390690750 tempest-KeyPairsV22TestJSON-390690750-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-163562406" status: 204 len: 0 microversion: 2.2 time: 0.038835 Jul 23 21:18:33.424461 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 644/1283] 10.222.0.17 () {60 vars in 1257 bytes} [Sat Jul 23 21:18:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-163562406 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 23 21:18:33.443828 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-3730d836-17ff-4ffa-9320-51713da068d4 tempest-KeyPairsV22TestJSON-390690750 tempest-KeyPairsV22TestJSON-390690750-project] Action: 'create', calling method: .version_select at 0x7f0b47ceaca0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1443776974", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLWQsJtwiLs31kXp5KUXo1MxHFzvi1YOY7BGEnDPlKNmJW5AcupALA2Hvw67IsI0e36trSQNYuj7lzDKn/Q/d1SKf4wTECCVt4IMj+haZ3jTXWNSTrtJ32PHgxHE1c0Eag=="}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:18:33.473227 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-3730d836-17ff-4ffa-9320-51713da068d4 tempest-KeyPairsV22TestJSON-390690750 tempest-KeyPairsV22TestJSON-390690750-project] Getting quotas for project ad09cbaf0f384f6fb0cea9879b83f32e. Resources: {'key_pairs'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:18:33.480480 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-3730d836-17ff-4ffa-9320-51713da068d4 tempest-KeyPairsV22TestJSON-390690750 tempest-KeyPairsV22TestJSON-390690750-project] Getting quotas for user 3d71a807adbd4c1082be1437f1b0ace6 and project ad09cbaf0f384f6fb0cea9879b83f32e. Resources: {'key_pairs'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:18:33.512024 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-3730d836-17ff-4ffa-9320-51713da068d4 tempest-KeyPairsV22TestJSON-390690750 tempest-KeyPairsV22TestJSON-390690750-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.072615 Jul 23 21:18:33.513532 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 640/1284] 10.222.0.17 () {62 vars in 1198 bytes} [Sat Jul 23 21:18:33 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 75 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 23 21:18:33.531645 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a6218c1b-e7f4-4155-bfde-67554ceb247f tempest-KeyPairsV22TestJSON-390690750 tempest-KeyPairsV22TestJSON-390690750-project] Action: 'create', calling method: .version_select at 0x7f0b476ce700>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-197812111", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIkWh3omd0DaAJEbCoxJX5YKnaRiphciKTiYl5nSfsRKlwrdqbj576Wmb07nZVRRhS10HNBcmqxWBK5xYScZ/VlNOqFT5e/MC1ONkD3HZyhkTMY4BR4HGkBAjLYDnPtfgg=="}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:18:33.567168 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-a6218c1b-e7f4-4155-bfde-67554ceb247f tempest-KeyPairsV22TestJSON-390690750 tempest-KeyPairsV22TestJSON-390690750-project] Getting quotas for project ad09cbaf0f384f6fb0cea9879b83f32e. Resources: {'key_pairs'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:18:33.574736 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-a6218c1b-e7f4-4155-bfde-67554ceb247f tempest-KeyPairsV22TestJSON-390690750 tempest-KeyPairsV22TestJSON-390690750-project] Getting quotas for user 3d71a807adbd4c1082be1437f1b0ace6 and project ad09cbaf0f384f6fb0cea9879b83f32e. Resources: {'key_pairs'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:18:33.585022 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-e1b374b0-0bf4-4926-8560-075d71e06c6e req-80312d82-8543-4ad3-9515-6e7ab0b6b2c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1b84776-ab42-4b27-975d-1744b2935bb2", "name": "network-vif-plugged", "status": "completed", "tag": "75148d97-06cd-4836-97fd-6cce38566d93"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:18:33.595932 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-e1b374b0-0bf4-4926-8560-075d71e06c6e req-80312d82-8543-4ad3-9515-6e7ab0b6b2c8 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:33.596430 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-e1b374b0-0bf4-4926-8560-075d71e06c6e req-80312d82-8543-4ad3-9515-6e7ab0b6b2c8 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:33.617022 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-e1b374b0-0bf4-4926-8560-075d71e06c6e req-80312d82-8543-4ad3-9515-6e7ab0b6b2c8 service nova] Creating event network-vif-plugged:75148d97-06cd-4836-97fd-6cce38566d93 for instance d1b84776-ab42-4b27-975d-1744b2935bb2 on nch2-master-1 Jul 23 21:18:33.623588 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-e1b374b0-0bf4-4926-8560-075d71e06c6e req-80312d82-8543-4ad3-9515-6e7ab0b6b2c8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043121 Jul 23 21:18:33.625265 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a6218c1b-e7f4-4155-bfde-67554ceb247f tempest-KeyPairsV22TestJSON-390690750 tempest-KeyPairsV22TestJSON-390690750-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.103699 Jul 23 21:18:33.626392 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 645/1285] 10.222.0.17 () {62 vars in 1198 bytes} [Sat Jul 23 21:18:33 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 106 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 23 21:18:33.631175 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 641/1286] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:18:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:18:33.639209 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8c4f8521-8dce-494a-b4c1-22e0a6ad622b tempest-KeyPairsV22TestJSON-390690750 tempest-KeyPairsV22TestJSON-390690750-project] Action: 'create', calling method: .version_select at 0x7f0b475d8790>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-435026244", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBASTkaIzl1icsj7q/qQqzSbbcDsHvMCzaz8KOc7XrjMYubEwXhivgL/Vbu4fcouVxGmRraJ5cgYsWPIPqvkaXEOfjsokOD6GSYqain1TF3mSlXZlIMg+J9rK9F+kJEaHhQ=="}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:18:33.656596 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-8c4f8521-8dce-494a-b4c1-22e0a6ad622b tempest-KeyPairsV22TestJSON-390690750 tempest-KeyPairsV22TestJSON-390690750-project] Getting quotas for project ad09cbaf0f384f6fb0cea9879b83f32e. Resources: {'key_pairs'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:18:33.665646 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-8c4f8521-8dce-494a-b4c1-22e0a6ad622b tempest-KeyPairsV22TestJSON-390690750 tempest-KeyPairsV22TestJSON-390690750-project] Getting quotas for user 3d71a807adbd4c1082be1437f1b0ace6 and project ad09cbaf0f384f6fb0cea9879b83f32e. Resources: {'key_pairs'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:18:33.703336 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8c4f8521-8dce-494a-b4c1-22e0a6ad622b tempest-KeyPairsV22TestJSON-390690750 tempest-KeyPairsV22TestJSON-390690750-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.066328 Jul 23 21:18:33.704320 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 646/1287] 10.222.0.17 () {62 vars in 1198 bytes} [Sat Jul 23 21:18:33 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 70 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 23 21:18:33.717115 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-15c8d3df-ba1c-4ae4-9480-0d5cbeb4bff9 tempest-KeyPairsV22TestJSON-390690750 tempest-KeyPairsV22TestJSON-390690750-project] Calling method '.version_select at 0x7f0b47e2b280>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:33.720214 ncdv-master-1 devstack@n-api.service[131321]: WARNING oslo_db.sqlalchemy.utils [None req-15c8d3df-ba1c-4ae4-9480-0d5cbeb4bff9 tempest-KeyPairsV22TestJSON-390690750 tempest-KeyPairsV22TestJSON-390690750-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 23 21:18:33.729403 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-15c8d3df-ba1c-4ae4-9480-0d5cbeb4bff9 tempest-KeyPairsV22TestJSON-390690750 tempest-KeyPairsV22TestJSON-390690750-project] 10.222.0.17 "GET /compute/v2.1/os-keypairs" status: 200 len: 1140 microversion: 2.2 time: 0.017404 Jul 23 21:18:33.731683 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 642/1288] 10.222.0.17 () {60 vars in 1176 bytes} [Sat Jul 23 21:18:33 2022] GET /compute/v2.1/os-keypairs => generated 1140 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:18:33.742719 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ee29498b-bc1e-4b4d-93d5-d88945866bbe tempest-KeyPairsV22TestJSON-390690750 tempest-KeyPairsV22TestJSON-390690750-project] Calling method '.version_select at 0x7f0b4777f4c0>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:33.765294 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ee29498b-bc1e-4b4d-93d5-d88945866bbe tempest-KeyPairsV22TestJSON-390690750 tempest-KeyPairsV22TestJSON-390690750-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-435026244" status: 204 len: 0 microversion: 2.2 time: 0.027127 Jul 23 21:18:33.775665 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-5cf4d250-e676-4559-a1a0-3534aa16fd33 tempest-KeyPairsV22TestJSON-390690750 tempest-KeyPairsV22TestJSON-390690750-project] Calling method '.version_select at 0x7f0b47cd54c0>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:33.779005 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 647/1289] 10.222.0.17 () {60 vars in 1317 bytes} [Sat Jul 23 21:18:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-435026244 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:18:33.792671 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d2b00b49-68ad-40ac-8447-37e05e6ac4b2 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:33.794868 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d2b00b49-68ad-40ac-8447-37e05e6ac4b2 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 6f54269a-e144-4b5d-9b78-39120b28e545] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:18:33.806531 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d2b00b49-68ad-40ac-8447-37e05e6ac4b2 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:33.807362 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d2b00b49-68ad-40ac-8447-37e05e6ac4b2 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:33.808356 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d2b00b49-68ad-40ac-8447-37e05e6ac4b2 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:33.828119 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-5cf4d250-e676-4559-a1a0-3534aa16fd33 tempest-KeyPairsV22TestJSON-390690750 tempest-KeyPairsV22TestJSON-390690750-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-197812111" status: 204 len: 0 microversion: 2.2 time: 0.056719 Jul 23 21:18:33.832617 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 643/1290] 10.222.0.17 () {60 vars in 1317 bytes} [Sat Jul 23 21:18:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-197812111 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:18:33.834480 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d2b00b49-68ad-40ac-8447-37e05e6ac4b2 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:33.839274 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a827e30f-366b-450b-abd5-6f7defb8501e tempest-KeyPairsV22TestJSON-390690750 tempest-KeyPairsV22TestJSON-390690750-project] Calling method '.version_select at 0x7f0b47cf6ca0>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:33.876837 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-a827e30f-366b-450b-abd5-6f7defb8501e tempest-KeyPairsV22TestJSON-390690750 tempest-KeyPairsV22TestJSON-390690750-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1443776974" status: 204 len: 0 microversion: 2.2 time: 0.042672 Jul 23 21:18:33.878965 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 644/1291] 10.222.0.17 () {60 vars in 1320 bytes} [Sat Jul 23 21:18:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1443776974 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:18:33.893755 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-6792e9d6-c8a7-4b6d-ae88-f1d8ce6e3e14 tempest-KeyPairsV22TestJSON-390690750 tempest-KeyPairsV22TestJSON-390690750-project] Action: 'create', calling method: .version_select at 0x7f0b47cc49d0>, body: {"keypair": {"name": "tempest-keypair-1210893145", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFbz2GvgqzDPu2JN2qsrmaPQAsarLgdpHS/Nsvyt7T16gVNZGq9Om8uWAf3rKKeGXw+ZFB+8RdNmzCqhBNnfl5Ud7WhevMe6CBj+MWbbzbo4dPOy022acjNRWnc5xBzBVA=="}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:18:33.915309 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-6792e9d6-c8a7-4b6d-ae88-f1d8ce6e3e14 tempest-KeyPairsV22TestJSON-390690750 tempest-KeyPairsV22TestJSON-390690750-project] Getting quotas for project ad09cbaf0f384f6fb0cea9879b83f32e. Resources: {'key_pairs'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:18:33.922378 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-6792e9d6-c8a7-4b6d-ae88-f1d8ce6e3e14 tempest-KeyPairsV22TestJSON-390690750 tempest-KeyPairsV22TestJSON-390690750-project] Getting quotas for user 3d71a807adbd4c1082be1437f1b0ace6 and project ad09cbaf0f384f6fb0cea9879b83f32e. Resources: {'key_pairs'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:18:33.979894 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-6792e9d6-c8a7-4b6d-ae88-f1d8ce6e3e14 tempest-KeyPairsV22TestJSON-390690750 tempest-KeyPairsV22TestJSON-390690750-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.092672 Jul 23 21:18:33.987030 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 645/1292] 10.222.0.17 () {62 vars in 1198 bytes} [Sat Jul 23 21:18:33 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 100 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 23 21:18:33.993638 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f3d5c7a9-296c-4116-88a6-7a717274135b tempest-KeyPairsV22TestJSON-390690750 tempest-KeyPairsV22TestJSON-390690750-project] Calling method '.version_select at 0x7f0b47cdc1f0>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:34.003708 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-f3d5c7a9-296c-4116-88a6-7a717274135b tempest-KeyPairsV22TestJSON-390690750 tempest-KeyPairsV22TestJSON-390690750-project] 10.222.0.17 "GET /compute/v2.1/os-keypairs/tempest-keypair-1210893145" status: 200 len: 513 microversion: 2.2 time: 0.015087 Jul 23 21:18:34.009881 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 646/1293] 10.222.0.17 () {60 vars in 1257 bytes} [Sat Jul 23 21:18:33 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1210893145 => generated 513 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:18:34.015865 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-da17ab3e-cf16-4303-bf36-a808ba1bbf5e tempest-KeyPairsV22TestJSON-390690750 tempest-KeyPairsV22TestJSON-390690750-project] Calling method '.version_select at 0x7f0b47cf6790>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:34.022524 ncdv-master-1 devstack@n-api.service[131321]: WARNING oslo_db.sqlalchemy.utils [None req-da17ab3e-cf16-4303-bf36-a808ba1bbf5e tempest-KeyPairsV22TestJSON-390690750 tempest-KeyPairsV22TestJSON-390690750-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 23 21:18:34.028515 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-da17ab3e-cf16-4303-bf36-a808ba1bbf5e tempest-KeyPairsV22TestJSON-390690750 tempest-KeyPairsV22TestJSON-390690750-project] 10.222.0.17 "GET /compute/v2.1/os-keypairs" status: 200 len: 370 microversion: 2.2 time: 0.017353 Jul 23 21:18:34.035080 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 647/1294] 10.222.0.17 () {60 vars in 1176 bytes} [Sat Jul 23 21:18:34 2022] GET /compute/v2.1/os-keypairs => generated 370 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:18:34.042415 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-9f563b52-44c2-43a4-b966-88a47630854c tempest-KeyPairsV22TestJSON-390690750 tempest-KeyPairsV22TestJSON-390690750-project] Calling method '.version_select at 0x7f0b47cd5ee0>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:34.070167 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-9f563b52-44c2-43a4-b966-88a47630854c tempest-KeyPairsV22TestJSON-390690750 tempest-KeyPairsV22TestJSON-390690750-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1210893145" status: 204 len: 0 microversion: 2.2 time: 0.033636 Jul 23 21:18:34.075438 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 648/1295] 10.222.0.17 () {60 vars in 1260 bytes} [Sat Jul 23 21:18:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1210893145 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:18:34.080638 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a41a374e-76dc-4a6b-8e8d-53e3a1425c1c tempest-KeyPairsV22TestJSON-390690750 tempest-KeyPairsV22TestJSON-390690750-project] Action: 'create', calling method: .version_select at 0x7f0b47cc4280>, body: {"keypair": {"name": "tempest-keypair-45258570", "type": "x509"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:18:34.099741 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-a41a374e-76dc-4a6b-8e8d-53e3a1425c1c tempest-KeyPairsV22TestJSON-390690750 tempest-KeyPairsV22TestJSON-390690750-project] Getting quotas for project ad09cbaf0f384f6fb0cea9879b83f32e. Resources: {'key_pairs'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:18:34.109149 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-a41a374e-76dc-4a6b-8e8d-53e3a1425c1c tempest-KeyPairsV22TestJSON-390690750 tempest-KeyPairsV22TestJSON-390690750-project] Getting quotas for user 3d71a807adbd4c1082be1437f1b0ace6 and project ad09cbaf0f384f6fb0cea9879b83f32e. Resources: {'key_pairs'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:18:34.113919 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:18:34.161738 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.processutils [None req-a41a374e-76dc-4a6b-8e8d-53e3a1425c1c tempest-KeyPairsV22TestJSON-390690750 tempest-KeyPairsV22TestJSON-390690750-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmp1n9r_4ih/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp1n9r_4ih/temp.key -subj /CN=3d71a807adbd4c1082be1437f1b0ace6 -extensions v3_req_client {{(pid=131321) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 23 21:18:34.175476 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d2b00b49-68ad-40ac-8447-37e05e6ac4b2 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4f9dda4c2a411cb0394bf86e9ae223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580ed681cbf44d10936259b17f60f1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:18:34.185054 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d2b00b49-68ad-40ac-8447-37e05e6ac4b2 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/servers/6f54269a-e144-4b5d-9b78-39120b28e545" status: 200 len: 1308 microversion: 2.1 time: 0.401990 Jul 23 21:18:34.192514 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 648/1296] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:18:33 2022] GET /compute/v2.1/servers/6f54269a-e144-4b5d-9b78-39120b28e545 => generated 1308 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:18:34.229325 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5220e7ec-35ca-4965-a2ac-774e3f7a4ee3 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:34.230559 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5220e7ec-35ca-4965-a2ac-774e3f7a4ee3 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: d1b84776-ab42-4b27-975d-1744b2935bb2] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:18:34.241891 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5220e7ec-35ca-4965-a2ac-774e3f7a4ee3 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:34.244506 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5220e7ec-35ca-4965-a2ac-774e3f7a4ee3 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:34.245580 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5220e7ec-35ca-4965-a2ac-774e3f7a4ee3 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:34.249369 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5220e7ec-35ca-4965-a2ac-774e3f7a4ee3 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:34.595837 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.processutils [None req-a41a374e-76dc-4a6b-8e8d-53e3a1425c1c tempest-KeyPairsV22TestJSON-390690750 tempest-KeyPairsV22TestJSON-390690750-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmp1n9r_4ih/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp1n9r_4ih/temp.key -subj /CN=3d71a807adbd4c1082be1437f1b0ace6 -extensions v3_req_client" returned: 0 in 0.433s {{(pid=131321) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 23 21:18:34.598496 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.processutils [None req-a41a374e-76dc-4a6b-8e8d-53e3a1425c1c tempest-KeyPairsV22TestJSON-390690750 tempest-KeyPairsV22TestJSON-390690750-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmp1n9r_4ih/temp.key -password pass: {{(pid=131321) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 23 21:18:34.645181 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.processutils [None req-a41a374e-76dc-4a6b-8e8d-53e3a1425c1c tempest-KeyPairsV22TestJSON-390690750 tempest-KeyPairsV22TestJSON-390690750-project] CMD "openssl pkcs12 -export -inkey /tmp/tmp1n9r_4ih/temp.key -password pass:" returned: 0 in 0.045s {{(pid=131321) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 23 21:18:34.647074 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5220e7ec-35ca-4965-a2ac-774e3f7a4ee3 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:18:34.654730 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5220e7ec-35ca-4965-a2ac-774e3f7a4ee3 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2" status: 200 len: 1312 microversion: 2.1 time: 0.429840 Jul 23 21:18:34.666741 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 649/1297] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:18:34 2022] GET /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2 => generated 1312 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:18:34.738788 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-a41a374e-76dc-4a6b-8e8d-53e3a1425c1c tempest-KeyPairsV22TestJSON-390690750 tempest-KeyPairsV22TestJSON-390690750-project] Getting quotas for project ad09cbaf0f384f6fb0cea9879b83f32e. Resources: {'key_pairs'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:18:34.750294 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-a41a374e-76dc-4a6b-8e8d-53e3a1425c1c tempest-KeyPairsV22TestJSON-390690750 tempest-KeyPairsV22TestJSON-390690750-project] Getting quotas for user 3d71a807adbd4c1082be1437f1b0ace6 and project ad09cbaf0f384f6fb0cea9879b83f32e. Resources: {'key_pairs'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:18:34.784317 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-a41a374e-76dc-4a6b-8e8d-53e3a1425c1c tempest-KeyPairsV22TestJSON-390690750 tempest-KeyPairsV22TestJSON-390690750-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 4691 microversion: 2.2 time: 0.707605 Jul 23 21:18:34.796255 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 649/1298] 10.222.0.17 () {62 vars in 1197 bytes} [Sat Jul 23 21:18:34 2022] POST /compute/v2.1/os-keypairs => generated 4691 bytes in 716 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:18:34.806988 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-474916d5-b97a-4b56-a8c6-f95f4b39f005 tempest-KeyPairsV22TestJSON-390690750 tempest-KeyPairsV22TestJSON-390690750-project] Calling method '.version_select at 0x7f0b4777fdc0>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:34.826563 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-474916d5-b97a-4b56-a8c6-f95f4b39f005 tempest-KeyPairsV22TestJSON-390690750 tempest-KeyPairsV22TestJSON-390690750-project] 10.222.0.17 "GET /compute/v2.1/os-keypairs/tempest-keypair-45258570" status: 200 len: 1532 microversion: 2.2 time: 0.023261 Jul 23 21:18:34.826563 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 650/1299] 10.222.0.17 () {60 vars in 1251 bytes} [Sat Jul 23 21:18:34 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-45258570 => generated 1532 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:18:34.833036 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ca133161-482c-4a34-ad7a-2a008cdbac6f tempest-KeyPairsV22TestJSON-390690750 tempest-KeyPairsV22TestJSON-390690750-project] Calling method '.version_select at 0x7f0b47cd5d30>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:34.836099 ncdv-master-1 devstack@n-api.service[131321]: WARNING oslo_db.sqlalchemy.utils [None req-ca133161-482c-4a34-ad7a-2a008cdbac6f tempest-KeyPairsV22TestJSON-390690750 tempest-KeyPairsV22TestJSON-390690750-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 23 21:18:34.851248 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-ca133161-482c-4a34-ad7a-2a008cdbac6f tempest-KeyPairsV22TestJSON-390690750 tempest-KeyPairsV22TestJSON-390690750-project] 10.222.0.17 "GET /compute/v2.1/os-keypairs" status: 200 len: 1389 microversion: 2.2 time: 0.023098 Jul 23 21:18:34.852204 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 650/1300] 10.222.0.17 () {60 vars in 1176 bytes} [Sat Jul 23 21:18:34 2022] GET /compute/v2.1/os-keypairs => generated 1389 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:18:34.872433 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-17158856-71d9-40e7-aacf-ea43a7bef205 tempest-KeyPairsV22TestJSON-390690750 tempest-KeyPairsV22TestJSON-390690750-project] Calling method '.version_select at 0x7f0b477de940>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:34.927361 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-17158856-71d9-40e7-aacf-ea43a7bef205 tempest-KeyPairsV22TestJSON-390690750 tempest-KeyPairsV22TestJSON-390690750-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-45258570" status: 204 len: 0 microversion: 2.2 time: 0.068485 Jul 23 21:18:34.932029 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 651/1301] 10.222.0.17 () {60 vars in 1254 bytes} [Sat Jul 23 21:18:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-45258570 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:18:35.205413 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d260d763-5aee-4769-8108-b024fface035 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:35.206395 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-d260d763-5aee-4769-8108-b024fface035 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 6f54269a-e144-4b5d-9b78-39120b28e545] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:18:35.218982 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d260d763-5aee-4769-8108-b024fface035 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:35.222980 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d260d763-5aee-4769-8108-b024fface035 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:35.224483 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d260d763-5aee-4769-8108-b024fface035 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:35.225132 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d260d763-5aee-4769-8108-b024fface035 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:35.461168 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-d260d763-5aee-4769-8108-b024fface035 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4f9dda4c2a411cb0394bf86e9ae223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580ed681cbf44d10936259b17f60f1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:18:35.472904 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-d260d763-5aee-4769-8108-b024fface035 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/servers/6f54269a-e144-4b5d-9b78-39120b28e545" status: 200 len: 1308 microversion: 2.1 time: 0.272366 Jul 23 21:18:35.474472 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 651/1302] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:18:35 2022] GET /compute/v2.1/servers/6f54269a-e144-4b5d-9b78-39120b28e545 => generated 1308 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:18:35.675483 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-dc6a7ffc-57a7-4abd-9197-6717c3698fcb tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:35.676019 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-dc6a7ffc-57a7-4abd-9197-6717c3698fcb tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: d1b84776-ab42-4b27-975d-1744b2935bb2] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:18:35.708104 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dc6a7ffc-57a7-4abd-9197-6717c3698fcb tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:35.711970 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dc6a7ffc-57a7-4abd-9197-6717c3698fcb tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:35.713021 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dc6a7ffc-57a7-4abd-9197-6717c3698fcb tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:35.719295 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dc6a7ffc-57a7-4abd-9197-6717c3698fcb tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:35.860639 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-c3de3a95-fb38-485f-a23d-14cbd57fc98b req-daa1a561-637d-4556-8366-60d433870c72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f54269a-e144-4b5d-9b78-39120b28e545", "name": "network-vif-plugged", "status": "completed", "tag": "cb8b469c-a568-415a-85b4-07644be9af70"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:18:35.882176 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-c3de3a95-fb38-485f-a23d-14cbd57fc98b req-daa1a561-637d-4556-8366-60d433870c72 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:35.882943 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-c3de3a95-fb38-485f-a23d-14cbd57fc98b req-daa1a561-637d-4556-8366-60d433870c72 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:35.918539 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-c3de3a95-fb38-485f-a23d-14cbd57fc98b req-daa1a561-637d-4556-8366-60d433870c72 service nova] Creating event network-vif-plugged:cb8b469c-a568-415a-85b4-07644be9af70 for instance 6f54269a-e144-4b5d-9b78-39120b28e545 on nch2-master-1 Jul 23 21:18:35.941333 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-c3de3a95-fb38-485f-a23d-14cbd57fc98b req-daa1a561-637d-4556-8366-60d433870c72 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082049 Jul 23 21:18:35.942351 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 652/1303] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:18:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:18:36.473071 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-dc6a7ffc-57a7-4abd-9197-6717c3698fcb tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:18:36.501566 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-dc6a7ffc-57a7-4abd-9197-6717c3698fcb tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2" status: 200 len: 1461 microversion: 2.1 time: 0.830805 Jul 23 21:18:36.506287 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-fde827fd-ad8c-4545-a534-8e30b21ceaa1 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:36.507292 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-fde827fd-ad8c-4545-a534-8e30b21ceaa1 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 6f54269a-e144-4b5d-9b78-39120b28e545] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:18:36.513760 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 652/1304] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:18:35 2022] GET /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2 => generated 1461 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:18:36.519822 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8c0b7ab2-b6e3-4dd4-81b1-5c1f5c48360b tempest-MigrationsAdminTest-19880863 tempest-MigrationsAdminTest-19880863-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:36.520552 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fde827fd-ad8c-4545-a534-8e30b21ceaa1 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:36.520887 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8c0b7ab2-b6e3-4dd4-81b1-5c1f5c48360b tempest-MigrationsAdminTest-19880863 tempest-MigrationsAdminTest-19880863-project-admin] [instance: d1b84776-ab42-4b27-975d-1744b2935bb2] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:18:36.521128 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fde827fd-ad8c-4545-a534-8e30b21ceaa1 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:36.524128 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fde827fd-ad8c-4545-a534-8e30b21ceaa1 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:36.524936 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=4,nova_api:DELETE=5 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:18:36.527797 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fde827fd-ad8c-4545-a534-8e30b21ceaa1 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:36.529357 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8c0b7ab2-b6e3-4dd4-81b1-5c1f5c48360b tempest-MigrationsAdminTest-19880863 tempest-MigrationsAdminTest-19880863-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:36.530179 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8c0b7ab2-b6e3-4dd4-81b1-5c1f5c48360b tempest-MigrationsAdminTest-19880863 tempest-MigrationsAdminTest-19880863-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:36.531188 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8c0b7ab2-b6e3-4dd4-81b1-5c1f5c48360b tempest-MigrationsAdminTest-19880863 tempest-MigrationsAdminTest-19880863-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:36.531899 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8c0b7ab2-b6e3-4dd4-81b1-5c1f5c48360b tempest-MigrationsAdminTest-19880863 tempest-MigrationsAdminTest-19880863-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:36.879681 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-fde827fd-ad8c-4545-a534-8e30b21ceaa1 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4f9dda4c2a411cb0394bf86e9ae223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580ed681cbf44d10936259b17f60f1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:18:36.889588 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-fde827fd-ad8c-4545-a534-8e30b21ceaa1 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/servers/6f54269a-e144-4b5d-9b78-39120b28e545" status: 200 len: 1308 microversion: 2.1 time: 0.402278 Jul 23 21:18:36.890821 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 653/1305] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:18:36 2022] GET /compute/v2.1/servers/6f54269a-e144-4b5d-9b78-39120b28e545 => generated 1308 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:18:37.177720 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8c0b7ab2-b6e3-4dd4-81b1-5c1f5c48360b tempest-MigrationsAdminTest-19880863 tempest-MigrationsAdminTest-19880863-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2" status: 200 len: 1612 microversion: 2.1 time: 0.659419 Jul 23 21:18:37.178845 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 653/1306] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:18:36 2022] GET /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2 => generated 1612 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:18:37.195527 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-0060cff2-131b-4447-a5b7-a84642f069d8 tempest-MigrationsAdminTest-19880863 tempest-MigrationsAdminTest-19880863-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:18:37.196296 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-0060cff2-131b-4447-a5b7-a84642f069d8 tempest-MigrationsAdminTest-19880863 tempest-MigrationsAdminTest-19880863-project-admin] [instance: d1b84776-ab42-4b27-975d-1744b2935bb2] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:18:37.209465 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0060cff2-131b-4447-a5b7-a84642f069d8 tempest-MigrationsAdminTest-19880863 tempest-MigrationsAdminTest-19880863-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:37.215385 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0060cff2-131b-4447-a5b7-a84642f069d8 tempest-MigrationsAdminTest-19880863 tempest-MigrationsAdminTest-19880863-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:37.220298 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0060cff2-131b-4447-a5b7-a84642f069d8 tempest-MigrationsAdminTest-19880863 tempest-MigrationsAdminTest-19880863-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:37.221142 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0060cff2-131b-4447-a5b7-a84642f069d8 tempest-MigrationsAdminTest-19880863 tempest-MigrationsAdminTest-19880863-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:37.855443 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-0060cff2-131b-4447-a5b7-a84642f069d8 tempest-MigrationsAdminTest-19880863 tempest-MigrationsAdminTest-19880863-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'f740c6611de74dadae72b604cc5c2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06abafd34fdd4fea90decc7bec9dc63f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:18:37.856062 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-0060cff2-131b-4447-a5b7-a84642f069d8 tempest-MigrationsAdminTest-19880863 tempest-MigrationsAdminTest-19880863-project-admin] [instance: d1b84776-ab42-4b27-975d-1744b2935bb2] flavor_id is None. Assuming migration. {{(pid=131321) resize /opt/stack/nova/nova/compute/api.py:4142}} Jul 23 21:18:37.856507 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-0060cff2-131b-4447-a5b7-a84642f069d8 tempest-MigrationsAdminTest-19880863 tempest-MigrationsAdminTest-19880863-project-admin] [instance: d1b84776-ab42-4b27-975d-1744b2935bb2] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=131321) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 23 21:18:37.907622 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-07169662-87ef-4143-965f-34bf00453bb9 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:37.908390 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-07169662-87ef-4143-965f-34bf00453bb9 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 6f54269a-e144-4b5d-9b78-39120b28e545] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:18:37.922084 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-07169662-87ef-4143-965f-34bf00453bb9 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:37.924254 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-07169662-87ef-4143-965f-34bf00453bb9 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:37.926714 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-07169662-87ef-4143-965f-34bf00453bb9 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:37.927637 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-07169662-87ef-4143-965f-34bf00453bb9 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:38.223616 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-07169662-87ef-4143-965f-34bf00453bb9 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4f9dda4c2a411cb0394bf86e9ae223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580ed681cbf44d10936259b17f60f1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:18:38.253385 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-07169662-87ef-4143-965f-34bf00453bb9 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/servers/6f54269a-e144-4b5d-9b78-39120b28e545" status: 200 len: 1488 microversion: 2.1 time: 0.349958 Jul 23 21:18:38.255185 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 654/1307] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:18:37 2022] GET /compute/v2.1/servers/6f54269a-e144-4b5d-9b78-39120b28e545 => generated 1488 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:18:38.260931 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-0060cff2-131b-4447-a5b7-a84642f069d8 tempest-MigrationsAdminTest-19880863 tempest-MigrationsAdminTest-19880863-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2/action" status: 202 len: 0 microversion: 2.1 time: 1.069825 Jul 23 21:18:38.263891 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 654/1308] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:18:37 2022] POST /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2/action => generated 0 bytes in 1073 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:18:38.277692 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-0f82f9ac-5229-4817-83f3-5b6d3fb27f76 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:18:38.278512 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-0f82f9ac-5229-4817-83f3-5b6d3fb27f76 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 6f54269a-e144-4b5d-9b78-39120b28e545] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:18:38.289549 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0f82f9ac-5229-4817-83f3-5b6d3fb27f76 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:38.292754 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f2b5ef0b-b585-4211-8b5b-878506ff4a74 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:38.293193 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f2b5ef0b-b585-4211-8b5b-878506ff4a74 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: d1b84776-ab42-4b27-975d-1744b2935bb2] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:18:38.293430 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0f82f9ac-5229-4817-83f3-5b6d3fb27f76 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:38.297040 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0f82f9ac-5229-4817-83f3-5b6d3fb27f76 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:38.297831 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0f82f9ac-5229-4817-83f3-5b6d3fb27f76 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:38.315188 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f2b5ef0b-b585-4211-8b5b-878506ff4a74 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:38.317248 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f2b5ef0b-b585-4211-8b5b-878506ff4a74 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:38.321134 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f2b5ef0b-b585-4211-8b5b-878506ff4a74 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:38.324785 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f2b5ef0b-b585-4211-8b5b-878506ff4a74 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:38.372334 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.objects.instance [None req-0f82f9ac-5229-4817-83f3-5b6d3fb27f76 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lazy-loading 'flavor' on Instance uuid 6f54269a-e144-4b5d-9b78-39120b28e545 {{(pid=131321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:18:38.398512 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=100 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:18:38.620446 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-0f82f9ac-5229-4817-83f3-5b6d3fb27f76 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "POST /compute/v2.1/servers/6f54269a-e144-4b5d-9b78-39120b28e545/action" status: 202 len: 0 microversion: 2.1 time: 0.345128 Jul 23 21:18:38.644658 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 655/1309] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:18:38 2022] POST /compute/v2.1/servers/6f54269a-e144-4b5d-9b78-39120b28e545/action => generated 0 bytes in 371 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:18:38.668024 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-36da6ca2-1eae-4cfd-ab05-8cb1d87def3d tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:38.673567 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-36da6ca2-1eae-4cfd-ab05-8cb1d87def3d tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 6f54269a-e144-4b5d-9b78-39120b28e545] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:18:38.692789 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-36da6ca2-1eae-4cfd-ab05-8cb1d87def3d tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:38.693255 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-36da6ca2-1eae-4cfd-ab05-8cb1d87def3d tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:38.695464 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-36da6ca2-1eae-4cfd-ab05-8cb1d87def3d tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:38.695910 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-36da6ca2-1eae-4cfd-ab05-8cb1d87def3d tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:38.717105 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f2b5ef0b-b585-4211-8b5b-878506ff4a74 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:18:38.726727 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f2b5ef0b-b585-4211-8b5b-878506ff4a74 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2" status: 200 len: 1470 microversion: 2.1 time: 0.453643 Jul 23 21:18:38.728867 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 655/1310] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:18:38 2022] GET /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2 => generated 1470 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:18:39.233472 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-36da6ca2-1eae-4cfd-ab05-8cb1d87def3d tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4f9dda4c2a411cb0394bf86e9ae223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580ed681cbf44d10936259b17f60f1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:18:39.243349 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-36da6ca2-1eae-4cfd-ab05-8cb1d87def3d tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/servers/6f54269a-e144-4b5d-9b78-39120b28e545" status: 200 len: 1496 microversion: 2.1 time: 0.589797 Jul 23 21:18:39.257462 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 656/1311] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:18:38 2022] GET /compute/v2.1/servers/6f54269a-e144-4b5d-9b78-39120b28e545 => generated 1496 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:18:39.748333 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9ab20049-287b-4cce-96d1-f259b7065448 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:39.751284 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-9ab20049-287b-4cce-96d1-f259b7065448 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: d1b84776-ab42-4b27-975d-1744b2935bb2] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:18:39.760864 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9ab20049-287b-4cce-96d1-f259b7065448 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:39.761607 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9ab20049-287b-4cce-96d1-f259b7065448 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:39.763291 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9ab20049-287b-4cce-96d1-f259b7065448 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:39.763905 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9ab20049-287b-4cce-96d1-f259b7065448 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:39.987391 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-9ab20049-287b-4cce-96d1-f259b7065448 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:18:40.004088 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9ab20049-287b-4cce-96d1-f259b7065448 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2" status: 200 len: 1470 microversion: 2.1 time: 0.262565 Jul 23 21:18:40.006962 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 656/1312] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:18:39 2022] GET /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2 => generated 1470 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:18:40.266910 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-7beb83fb-679a-46ef-9e9d-71f397fab10d tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:40.269375 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-7beb83fb-679a-46ef-9e9d-71f397fab10d tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 6f54269a-e144-4b5d-9b78-39120b28e545] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:18:40.288712 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7beb83fb-679a-46ef-9e9d-71f397fab10d tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:40.289380 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7beb83fb-679a-46ef-9e9d-71f397fab10d tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:40.293783 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7beb83fb-679a-46ef-9e9d-71f397fab10d tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:40.295163 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7beb83fb-679a-46ef-9e9d-71f397fab10d tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:40.722596 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-7beb83fb-679a-46ef-9e9d-71f397fab10d tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4f9dda4c2a411cb0394bf86e9ae223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580ed681cbf44d10936259b17f60f1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:18:40.734595 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-7beb83fb-679a-46ef-9e9d-71f397fab10d tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/servers/6f54269a-e144-4b5d-9b78-39120b28e545" status: 200 len: 1479 microversion: 2.1 time: 0.470892 Jul 23 21:18:40.736523 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 657/1313] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:18:40 2022] GET /compute/v2.1/servers/6f54269a-e144-4b5d-9b78-39120b28e545 => generated 1479 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:18:40.755815 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8b800d1a-ba6f-4700-aef0-1763618c95e4 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1118801316"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:18:40.757837 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8b800d1a-ba6f-4700-aef0-1763618c95e4 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 6f54269a-e144-4b5d-9b78-39120b28e545] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:18:40.765760 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8b800d1a-ba6f-4700-aef0-1763618c95e4 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:40.766590 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8b800d1a-ba6f-4700-aef0-1763618c95e4 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:40.767814 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8b800d1a-ba6f-4700-aef0-1763618c95e4 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:40.768835 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8b800d1a-ba6f-4700-aef0-1763618c95e4 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:41.024956 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ee99442f-5726-4d77-b891-d9d6fbfd4409 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:41.025698 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-ee99442f-5726-4d77-b891-d9d6fbfd4409 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: d1b84776-ab42-4b27-975d-1744b2935bb2] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:18:41.056369 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ee99442f-5726-4d77-b891-d9d6fbfd4409 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:41.065571 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ee99442f-5726-4d77-b891-d9d6fbfd4409 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:41.067353 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ee99442f-5726-4d77-b891-d9d6fbfd4409 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:41.069053 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ee99442f-5726-4d77-b891-d9d6fbfd4409 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:41.267058 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8b800d1a-ba6f-4700-aef0-1763618c95e4 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "POST /compute/v2.1/servers/6f54269a-e144-4b5d-9b78-39120b28e545/action" status: 202 len: 0 microversion: 2.1 time: 0.517090 Jul 23 21:18:41.269888 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 657/1314] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:18:40 2022] POST /compute/v2.1/servers/6f54269a-e144-4b5d-9b78-39120b28e545/action => generated 0 bytes in 521 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 23 21:18:41.291846 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c2a312ea-8130-442d-85d7-1438f72a3b6c tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '.version_select at 0x7f0b477ad160>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:41.417013 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c2a312ea-8130-442d-85d7-1438f72a3b6c tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/images/0d3d0429-755c-441f-ab98-3c0bd09dd6af" status: 200 len: 1440 microversion: 2.1 time: 0.141718 Jul 23 21:18:41.419303 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 658/1315] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:18:41 2022] GET /compute/v2.1/images/0d3d0429-755c-441f-ab98-3c0bd09dd6af => generated 1440 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:18:42.353593 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ee99442f-5726-4d77-b891-d9d6fbfd4409 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:18:42.368945 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-ee99442f-5726-4d77-b891-d9d6fbfd4409 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2" status: 200 len: 1470 microversion: 2.1 time: 1.350117 Jul 23 21:18:42.380065 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 658/1316] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:18:41 2022] GET /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2 => generated 1470 bytes in 1362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:18:42.432310 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c012f08f-6628-4cfa-ade8-02f3d3470191 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '.version_select at 0x7f0b4762a3a0>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:42.501740 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c012f08f-6628-4cfa-ade8-02f3d3470191 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/images/0d3d0429-755c-441f-ab98-3c0bd09dd6af" status: 200 len: 1440 microversion: 2.1 time: 0.074687 Jul 23 21:18:42.502685 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 659/1317] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:18:42 2022] GET /compute/v2.1/images/0d3d0429-755c-441f-ab98-3c0bd09dd6af => generated 1440 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:18:43.387362 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c3e99763-b40d-4e84-9487-899d98a36643 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:43.388843 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-c3e99763-b40d-4e84-9487-899d98a36643 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: d1b84776-ab42-4b27-975d-1744b2935bb2] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:18:43.402383 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c3e99763-b40d-4e84-9487-899d98a36643 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:43.404999 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c3e99763-b40d-4e84-9487-899d98a36643 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:43.406100 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c3e99763-b40d-4e84-9487-899d98a36643 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:43.409226 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c3e99763-b40d-4e84-9487-899d98a36643 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:43.519408 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-375d9dff-acfc-4999-be05-017ead6dbcf9 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '.version_select at 0x7f0b477ad3a0>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:43.602406 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-375d9dff-acfc-4999-be05-017ead6dbcf9 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/images/0d3d0429-755c-441f-ab98-3c0bd09dd6af" status: 200 len: 1440 microversion: 2.1 time: 0.090293 Jul 23 21:18:43.614819 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 660/1318] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:18:43 2022] GET /compute/v2.1/images/0d3d0429-755c-441f-ab98-3c0bd09dd6af => generated 1440 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:18:43.730888 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c3e99763-b40d-4e84-9487-899d98a36643 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:18:43.742468 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-c3e99763-b40d-4e84-9487-899d98a36643 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2" status: 200 len: 1470 microversion: 2.1 time: 0.359159 Jul 23 21:18:43.756679 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 659/1319] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:18:43 2022] GET /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2 => generated 1470 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:18:44.616540 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9da87776-2d2c-4371-9ba2-c18527774e08 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '.version_select at 0x7f0b477c5dc0>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:44.627378 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=16 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:18:44.752449 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9da87776-2d2c-4371-9ba2-c18527774e08 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/images/0d3d0429-755c-441f-ab98-3c0bd09dd6af" status: 200 len: 1440 microversion: 2.1 time: 0.140491 Jul 23 21:18:44.760995 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 661/1320] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:18:44 2022] GET /compute/v2.1/images/0d3d0429-755c-441f-ab98-3c0bd09dd6af => generated 1440 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:18:44.763356 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d63a8ac1-da1b-4ff3-aa35-bffd19f9a52c tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:44.763983 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-d63a8ac1-da1b-4ff3-aa35-bffd19f9a52c tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: d1b84776-ab42-4b27-975d-1744b2935bb2] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:18:44.778795 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d63a8ac1-da1b-4ff3-aa35-bffd19f9a52c tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:44.779270 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d63a8ac1-da1b-4ff3-aa35-bffd19f9a52c tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:44.780083 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d63a8ac1-da1b-4ff3-aa35-bffd19f9a52c tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:44.780520 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d63a8ac1-da1b-4ff3-aa35-bffd19f9a52c tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:44.796060 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell0:SELECT=20 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:18:45.566989 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-d63a8ac1-da1b-4ff3-aa35-bffd19f9a52c tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:18:45.576342 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-d63a8ac1-da1b-4ff3-aa35-bffd19f9a52c tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2" status: 200 len: 1475 microversion: 2.1 time: 0.816758 Jul 23 21:18:45.579996 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 660/1321] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:18:44 2022] GET /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2 => generated 1475 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:18:45.768197 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-03fbb169-9ccb-4acf-b691-404fff57e320 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '.version_select at 0x7f0b4762a040>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:45.859355 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-03fbb169-9ccb-4acf-b691-404fff57e320 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/images/0d3d0429-755c-441f-ab98-3c0bd09dd6af" status: 200 len: 1440 microversion: 2.1 time: 0.095566 Jul 23 21:18:45.866381 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 662/1322] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:18:45 2022] GET /compute/v2.1/images/0d3d0429-755c-441f-ab98-3c0bd09dd6af => generated 1440 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:18:45.912570 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-940aaf91-fbff-47aa-ab49-0991fc2ba80c req-a9126c4c-1a46-4d96-9649-c14b518af0a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f54269a-e144-4b5d-9b78-39120b28e545", "name": "network-vif-plugged", "status": "completed", "tag": "cb8b469c-a568-415a-85b4-07644be9af70"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:18:45.940260 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-940aaf91-fbff-47aa-ab49-0991fc2ba80c req-a9126c4c-1a46-4d96-9649-c14b518af0a4 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:45.940616 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-940aaf91-fbff-47aa-ab49-0991fc2ba80c req-a9126c4c-1a46-4d96-9649-c14b518af0a4 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:45.974801 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-940aaf91-fbff-47aa-ab49-0991fc2ba80c req-a9126c4c-1a46-4d96-9649-c14b518af0a4 service nova] Creating event network-vif-plugged:cb8b469c-a568-415a-85b4-07644be9af70 for instance 6f54269a-e144-4b5d-9b78-39120b28e545 on nch2-master-1 Jul 23 21:18:46.024188 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-940aaf91-fbff-47aa-ab49-0991fc2ba80c req-a9126c4c-1a46-4d96-9649-c14b518af0a4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116136 Jul 23 21:18:46.027312 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 661/1323] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:18:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:18:46.596917 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-840f4c4a-c488-449f-89f6-7df55ffdc557 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:46.598021 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-840f4c4a-c488-449f-89f6-7df55ffdc557 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: d1b84776-ab42-4b27-975d-1744b2935bb2] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:18:46.611647 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-840f4c4a-c488-449f-89f6-7df55ffdc557 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:46.615001 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-840f4c4a-c488-449f-89f6-7df55ffdc557 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:46.618544 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-840f4c4a-c488-449f-89f6-7df55ffdc557 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:46.619109 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-840f4c4a-c488-449f-89f6-7df55ffdc557 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:46.873364 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ee491eb1-0b5b-4310-9432-175eeaaef261 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '.version_select at 0x7f0b47ceab80>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:46.943009 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-ee491eb1-0b5b-4310-9432-175eeaaef261 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/images/0d3d0429-755c-441f-ab98-3c0bd09dd6af" status: 200 len: 1440 microversion: 2.1 time: 0.073960 Jul 23 21:18:46.943643 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 662/1324] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:18:46 2022] GET /compute/v2.1/images/0d3d0429-755c-441f-ab98-3c0bd09dd6af => generated 1440 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:18:47.958792 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-9e74122c-90c7-4e9f-82ac-6b6298e97eeb tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '.version_select at 0x7f0b47e6a430>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:48.047490 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-9e74122c-90c7-4e9f-82ac-6b6298e97eeb tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/images/0d3d0429-755c-441f-ab98-3c0bd09dd6af" status: 200 len: 1440 microversion: 2.1 time: 0.094350 Jul 23 21:18:48.048204 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 663/1325] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:18:47 2022] GET /compute/v2.1/images/0d3d0429-755c-441f-ab98-3c0bd09dd6af => generated 1440 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:18:48.237203 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-840f4c4a-c488-449f-89f6-7df55ffdc557 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:18:48.257052 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-840f4c4a-c488-449f-89f6-7df55ffdc557 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2" status: 200 len: 1475 microversion: 2.1 time: 1.662764 Jul 23 21:18:48.259901 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 663/1326] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:18:46 2022] GET /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2 => generated 1475 bytes in 1668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:18:49.070240 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f61d07e0-585f-4f11-9884-e08931688520 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '.version_select at 0x7f0b47cea310>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:49.175253 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-f61d07e0-585f-4f11-9884-e08931688520 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/images/0d3d0429-755c-441f-ab98-3c0bd09dd6af" status: 200 len: 1440 microversion: 2.1 time: 0.116590 Jul 23 21:18:49.175877 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 664/1327] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:18:49 2022] GET /compute/v2.1/images/0d3d0429-755c-441f-ab98-3c0bd09dd6af => generated 1440 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:18:49.275350 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a9ab1686-da56-4312-90bb-5490ea85c59e tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:49.276845 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a9ab1686-da56-4312-90bb-5490ea85c59e tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: d1b84776-ab42-4b27-975d-1744b2935bb2] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:18:49.296034 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a9ab1686-da56-4312-90bb-5490ea85c59e tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:49.297237 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a9ab1686-da56-4312-90bb-5490ea85c59e tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:49.298623 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a9ab1686-da56-4312-90bb-5490ea85c59e tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:49.306697 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a9ab1686-da56-4312-90bb-5490ea85c59e tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:49.956106 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a9ab1686-da56-4312-90bb-5490ea85c59e tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:18:49.985592 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a9ab1686-da56-4312-90bb-5490ea85c59e tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2" status: 200 len: 1475 microversion: 2.1 time: 0.715379 Jul 23 21:18:49.986239 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 664/1328] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:18:49 2022] GET /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2 => generated 1475 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:18:50.195630 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f737a3ed-2f39-481e-86dc-565584b73036 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '.version_select at 0x7f0b47e444c0>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:50.289058 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-f737a3ed-2f39-481e-86dc-565584b73036 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/images/0d3d0429-755c-441f-ab98-3c0bd09dd6af" status: 200 len: 1440 microversion: 2.1 time: 0.103212 Jul 23 21:18:50.290102 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 665/1329] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:18:50 2022] GET /compute/v2.1/images/0d3d0429-755c-441f-ab98-3c0bd09dd6af => generated 1440 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:18:51.004479 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4d2de0d7-2480-4edc-9e1b-b988c25e7461 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:51.007032 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-4d2de0d7-2480-4edc-9e1b-b988c25e7461 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: d1b84776-ab42-4b27-975d-1744b2935bb2] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:18:51.030734 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4d2de0d7-2480-4edc-9e1b-b988c25e7461 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:51.037385 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4d2de0d7-2480-4edc-9e1b-b988c25e7461 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:51.041679 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4d2de0d7-2480-4edc-9e1b-b988c25e7461 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:51.042749 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4d2de0d7-2480-4edc-9e1b-b988c25e7461 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:51.303986 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-eb2459a7-11c7-49a9-937b-779cddabe506 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '.version_select at 0x7f0b47dd8af0>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:51.396401 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-eb2459a7-11c7-49a9-937b-779cddabe506 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/images/0d3d0429-755c-441f-ab98-3c0bd09dd6af" status: 200 len: 1440 microversion: 2.1 time: 0.097201 Jul 23 21:18:51.402246 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 666/1330] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:18:51 2022] GET /compute/v2.1/images/0d3d0429-755c-441f-ab98-3c0bd09dd6af => generated 1440 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:18:51.894241 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-4d2de0d7-2480-4edc-9e1b-b988c25e7461 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:18:51.944506 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4d2de0d7-2480-4edc-9e1b-b988c25e7461 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2" status: 200 len: 1475 microversion: 2.1 time: 0.936284 Jul 23 21:18:51.945520 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 665/1331] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:18:50 2022] GET /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2 => generated 1475 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:18:52.416756 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-fb1b0f9d-d405-48ab-b085-456137ebd269 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '.version_select at 0x7f0b47e7e670>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:52.507204 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-fb1b0f9d-d405-48ab-b085-456137ebd269 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/images/0d3d0429-755c-441f-ab98-3c0bd09dd6af" status: 200 len: 1440 microversion: 2.1 time: 0.094997 Jul 23 21:18:52.508440 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 667/1332] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:18:52 2022] GET /compute/v2.1/images/0d3d0429-755c-441f-ab98-3c0bd09dd6af => generated 1440 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:18:52.961173 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-88c25d0e-9583-4f9a-b552-cbc6fbbba111 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:52.961792 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-88c25d0e-9583-4f9a-b552-cbc6fbbba111 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: d1b84776-ab42-4b27-975d-1744b2935bb2] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:18:52.983822 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-88c25d0e-9583-4f9a-b552-cbc6fbbba111 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:52.999320 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-88c25d0e-9583-4f9a-b552-cbc6fbbba111 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:53.006585 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-88c25d0e-9583-4f9a-b552-cbc6fbbba111 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:53.010331 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-88c25d0e-9583-4f9a-b552-cbc6fbbba111 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:53.521254 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-fe43c82f-f2b5-44c0-92a0-5209c8af3645 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '.version_select at 0x7f0b47cc4310>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:53.627994 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-fe43c82f-f2b5-44c0-92a0-5209c8af3645 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/images/0d3d0429-755c-441f-ab98-3c0bd09dd6af" status: 200 len: 1440 microversion: 2.1 time: 0.110852 Jul 23 21:18:53.632854 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 668/1333] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:18:53 2022] GET /compute/v2.1/images/0d3d0429-755c-441f-ab98-3c0bd09dd6af => generated 1440 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:18:54.394519 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-88c25d0e-9583-4f9a-b552-cbc6fbbba111 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:18:54.421655 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-88c25d0e-9583-4f9a-b552-cbc6fbbba111 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2" status: 200 len: 1475 microversion: 2.1 time: 1.464756 Jul 23 21:18:54.429181 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 666/1334] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:18:52 2022] GET /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2 => generated 1475 bytes in 1471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:18:54.650819 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c7e8e109-3cca-4f74-9782-9b8a2d0b2fb1 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '.version_select at 0x7f0b47e7ea60>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:54.754817 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-c7e8e109-3cca-4f74-9782-9b8a2d0b2fb1 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/images/0d3d0429-755c-441f-ab98-3c0bd09dd6af" status: 200 len: 1440 microversion: 2.1 time: 0.108788 Jul 23 21:18:54.779395 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 669/1335] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:18:54 2022] GET /compute/v2.1/images/0d3d0429-755c-441f-ab98-3c0bd09dd6af => generated 1440 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:18:55.442204 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e048bdc8-5bf3-4bb0-99ec-458e820ed353 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:55.444355 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e048bdc8-5bf3-4bb0-99ec-458e820ed353 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: d1b84776-ab42-4b27-975d-1744b2935bb2] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:18:55.462832 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e048bdc8-5bf3-4bb0-99ec-458e820ed353 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:55.464982 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e048bdc8-5bf3-4bb0-99ec-458e820ed353 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:55.477704 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e048bdc8-5bf3-4bb0-99ec-458e820ed353 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:55.479772 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e048bdc8-5bf3-4bb0-99ec-458e820ed353 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:55.790911 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-cb9493f1-1dd4-4e58-833b-181b2c5c70ef tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '.version_select at 0x7f0b47e7e4c0>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:55.935045 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-cb9493f1-1dd4-4e58-833b-181b2c5c70ef tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/images/0d3d0429-755c-441f-ab98-3c0bd09dd6af" status: 200 len: 1440 microversion: 2.1 time: 0.148696 Jul 23 21:18:55.936763 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 670/1336] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:18:55 2022] GET /compute/v2.1/images/0d3d0429-755c-441f-ab98-3c0bd09dd6af => generated 1440 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:18:56.457999 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e048bdc8-5bf3-4bb0-99ec-458e820ed353 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:18:56.479428 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e048bdc8-5bf3-4bb0-99ec-458e820ed353 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2" status: 200 len: 1475 microversion: 2.1 time: 1.041401 Jul 23 21:18:56.482817 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 667/1337] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:18:55 2022] GET /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2 => generated 1475 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:18:56.947463 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:18:56.949824 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:18:56.960153 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-eab55914-5b20-4263-b1e1-832a1ce18b9c tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '.version_select at 0x7f0b47e6a8b0>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:57.099079 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-eab55914-5b20-4263-b1e1-832a1ce18b9c tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/images/0d3d0429-755c-441f-ab98-3c0bd09dd6af" status: 200 len: 1440 microversion: 2.1 time: 0.151338 Jul 23 21:18:57.101122 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 671/1338] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:18:56 2022] GET /compute/v2.1/images/0d3d0429-755c-441f-ab98-3c0bd09dd6af => generated 1440 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:18:57.508475 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-cfd31fe3-ca88-42d3-b8ba-596d7e3c515b tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:57.510584 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-cfd31fe3-ca88-42d3-b8ba-596d7e3c515b tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: d1b84776-ab42-4b27-975d-1744b2935bb2] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:18:57.571119 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cfd31fe3-ca88-42d3-b8ba-596d7e3c515b tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:57.572393 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cfd31fe3-ca88-42d3-b8ba-596d7e3c515b tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.040s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:57.573893 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cfd31fe3-ca88-42d3-b8ba-596d7e3c515b tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:57.574875 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cfd31fe3-ca88-42d3-b8ba-596d7e3c515b tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:58.055098 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-cfd31fe3-ca88-42d3-b8ba-596d7e3c515b tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:18:58.082891 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-cfd31fe3-ca88-42d3-b8ba-596d7e3c515b tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2" status: 200 len: 1475 microversion: 2.1 time: 0.575541 Jul 23 21:18:58.083540 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 668/1339] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:18:57 2022] GET /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2 => generated 1475 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:18:58.116869 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-5db4dfb7-1cc8-445d-9141-b585225232be tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '.version_select at 0x7f0b47e7e550>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:58.233695 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-5db4dfb7-1cc8-445d-9141-b585225232be tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/images/0d3d0429-755c-441f-ab98-3c0bd09dd6af" status: 200 len: 1440 microversion: 2.1 time: 0.124818 Jul 23 21:18:58.234453 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 672/1340] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:18:58 2022] GET /compute/v2.1/images/0d3d0429-755c-441f-ab98-3c0bd09dd6af => generated 1440 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:18:59.099954 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-73c4b884-dbcc-416d-a68b-29a1bb4fe891 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:59.100578 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-73c4b884-dbcc-416d-a68b-29a1bb4fe891 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: d1b84776-ab42-4b27-975d-1744b2935bb2] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:18:59.122822 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-73c4b884-dbcc-416d-a68b-29a1bb4fe891 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:59.123291 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-73c4b884-dbcc-416d-a68b-29a1bb4fe891 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:59.124112 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-73c4b884-dbcc-416d-a68b-29a1bb4fe891 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:18:59.124629 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-73c4b884-dbcc-416d-a68b-29a1bb4fe891 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:18:59.248432 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-5087cb34-0193-4a44-ad9e-be91aba5ed5a tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '.version_select at 0x7f0b47e6a820>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:18:59.375977 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-5087cb34-0193-4a44-ad9e-be91aba5ed5a tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/images/0d3d0429-755c-441f-ab98-3c0bd09dd6af" status: 200 len: 1440 microversion: 2.1 time: 0.131815 Jul 23 21:18:59.376991 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 673/1341] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:18:59 2022] GET /compute/v2.1/images/0d3d0429-755c-441f-ab98-3c0bd09dd6af => generated 1440 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:18:59.871181 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-73c4b884-dbcc-416d-a68b-29a1bb4fe891 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:18:59.886736 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-73c4b884-dbcc-416d-a68b-29a1bb4fe891 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2" status: 200 len: 1475 microversion: 2.1 time: 0.790613 Jul 23 21:18:59.892948 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 669/1342] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:18:59 2022] GET /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2 => generated 1475 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:19:00.390950 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-bd08e8a0-64e3-4597-8cd0-f1a97eb667e8 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '.version_select at 0x7f0b47e441f0>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:00.482829 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-bd08e8a0-64e3-4597-8cd0-f1a97eb667e8 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/images/0d3d0429-755c-441f-ab98-3c0bd09dd6af" status: 200 len: 1440 microversion: 2.1 time: 0.097660 Jul 23 21:19:00.483207 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 674/1343] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:19:00 2022] GET /compute/v2.1/images/0d3d0429-755c-441f-ab98-3c0bd09dd6af => generated 1440 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:19:01.406902 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5d471fb8-a6a7-44a4-8498-685a57541c51 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:01.413499 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5d471fb8-a6a7-44a4-8498-685a57541c51 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: d1b84776-ab42-4b27-975d-1744b2935bb2] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:01.422075 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5d471fb8-a6a7-44a4-8498-685a57541c51 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:01.431464 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5d471fb8-a6a7-44a4-8498-685a57541c51 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:01.436422 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5d471fb8-a6a7-44a4-8498-685a57541c51 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:01.443673 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5d471fb8-a6a7-44a4-8498-685a57541c51 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:01.498532 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-0a55ba48-d662-4fe5-a32d-bf6a8bc99845 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '.version_select at 0x7f0b47e5a9d0>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:01.629507 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-0a55ba48-d662-4fe5-a32d-bf6a8bc99845 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/images/0d3d0429-755c-441f-ab98-3c0bd09dd6af" status: 200 len: 1440 microversion: 2.1 time: 0.136766 Jul 23 21:19:01.631359 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 675/1344] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:19:01 2022] GET /compute/v2.1/images/0d3d0429-755c-441f-ab98-3c0bd09dd6af => generated 1440 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:19:01.682737 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e5b230e0-38cc-48f2-a758-1a453f6022b2 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-441385839", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "dfe0034d-5d2d-4ce5-b256-d87bd84ec0c2"}], "block_device_mapping_v2": [{"uuid": "67709f74-c94d-4ce5-9fc8-64292fc105a9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:19:01.848150 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.network.neutron [None req-e5b230e0-38cc-48f2-a758-1a453f6022b2 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] validate_networks() for [('dfe0034d-5d2d-4ce5-b256-d87bd84ec0c2', None, None, None, None, None)] {{(pid=131321) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:19:02.048546 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5d471fb8-a6a7-44a4-8498-685a57541c51 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:02.076053 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5d471fb8-a6a7-44a4-8498-685a57541c51 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2" status: 200 len: 1475 microversion: 2.1 time: 1.157949 Jul 23 21:19:02.076053 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 670/1345] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:19:00 2022] GET /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2 => generated 1475 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:19:02.866391 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-df80a33e-c539-40ed-996a-917115a59359 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Action: 'create', calling method: .version_select at 0x7f0b4764baf0>, body: {"keypair": {"name": "tempest-keypair-1261648286", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJgEzw9A/VGwoj8BTmVNYbxSlpU6iQTp4YkOCiOf0JpaC2v/qDIKs2C6bllKpZaUPPzz4DC2FR27WYL2K1PetjVJVKwe1aZ5XY8mDXJDX5SMYmHXj2NwzDsPKTZAgPmFjQ=="}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:19:02.916388 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-df80a33e-c539-40ed-996a-917115a59359 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Getting quotas for project f220ba2f42db435a818f3e462aea35a2. Resources: {'key_pairs'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:19:02.942968 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-df80a33e-c539-40ed-996a-917115a59359 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Getting quotas for user 145e518288ce4d70a12a3f2cc6a91810 and project f220ba2f42db435a818f3e462aea35a2. Resources: {'key_pairs'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:19:03.000869 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-df80a33e-c539-40ed-996a-917115a59359 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.928990 Jul 23 21:19:03.002520 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 671/1346] 10.222.0.17 () {60 vars in 1158 bytes} [Sat Jul 23 21:19:02 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:19:03.017490 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2150684f-817c-4303-a096-e40e0fa760a6 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8a819a79-2619-464d-a96a-b3a49144bb57"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:19:03.027106 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-2150684f-817c-4303-a096-e40e0fa760a6 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] [instance: e753b3c8-e63a-48d5-a349-fa19db134404] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:03.038340 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2150684f-817c-4303-a096-e40e0fa760a6 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:03.041009 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2150684f-817c-4303-a096-e40e0fa760a6 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:03.041873 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2150684f-817c-4303-a096-e40e0fa760a6 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:03.042346 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2150684f-817c-4303-a096-e40e0fa760a6 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:03.246450 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-e5b230e0-38cc-48f2-a758-1a453f6022b2 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Flavor limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:19:03.248114 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-e5b230e0-38cc-48f2-a758-1a453f6022b2 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Image limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:19:03.248950 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-e5b230e0-38cc-48f2-a758-1a453f6022b2 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Flavor pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:19:03.249757 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-e5b230e0-38cc-48f2-a758-1a453f6022b2 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Image pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:19:03.251355 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-e5b230e0-38cc-48f2-a758-1a453f6022b2 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:19:03.271390 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e5b230e0-38cc-48f2-a758-1a453f6022b2 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:03.272491 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e5b230e0-38cc-48f2-a758-1a453f6022b2 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:03.274417 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e5b230e0-38cc-48f2-a758-1a453f6022b2 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:03.277237 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e5b230e0-38cc-48f2-a758-1a453f6022b2 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:03.334680 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-e5b230e0-38cc-48f2-a758-1a453f6022b2 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Getting quotas for project 6610a2359aa64f89befcf72e4f3f6a54. Resources: {'ram', 'instances', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:19:03.370264 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-e5b230e0-38cc-48f2-a758-1a453f6022b2 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Getting quotas for user f2672c5db79b4a48a505c3df536594dd and project 6610a2359aa64f89befcf72e4f3f6a54. Resources: {'ram', 'instances', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:19:03.550263 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-e5b230e0-38cc-48f2-a758-1a453f6022b2 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Going to run 1 instances... {{(pid=131321) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:19:03.554058 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-e5b230e0-38cc-48f2-a758-1a453f6022b2 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 784e1fb4-876e-489f-9428-e01412642663] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='67709f74-c94d-4ce5-9fc8-64292fc105a9',volume_size=None,volume_type=None)] {{(pid=131321) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:19:03.657850 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2150684f-817c-4303-a096-e40e0fa760a6 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] 10.222.0.17 "POST /compute/v2.1/servers/e753b3c8-e63a-48d5-a349-fa19db134404/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.646475 Jul 23 21:19:03.660751 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 672/1347] 10.222.0.17 () {60 vars in 1322 bytes} [Sat Jul 23 21:19:03 2022] POST /compute/v2.1/servers/e753b3c8-e63a-48d5-a349-fa19db134404/os-volume_attachments => generated 194 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:19:03.681639 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d6b6aba8-9098-4da0-9adf-c5cb0c3f766c tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '.version_select at 0x7f0b476ce940>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:03.800489 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d6b6aba8-9098-4da0-9adf-c5cb0c3f766c tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/images/0d3d0429-755c-441f-ab98-3c0bd09dd6af" status: 200 len: 1440 microversion: 2.1 time: 0.127335 Jul 23 21:19:03.801089 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 673/1348] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:19:03 2022] GET /compute/v2.1/images/0d3d0429-755c-441f-ab98-3c0bd09dd6af => generated 1440 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:19:03.837669 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3f43c3ef-8093-4501-977d-f240f448a41e tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:03.843495 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-3f43c3ef-8093-4501-977d-f240f448a41e tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: d1b84776-ab42-4b27-975d-1744b2935bb2] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:03.868160 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3f43c3ef-8093-4501-977d-f240f448a41e tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:03.868847 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3f43c3ef-8093-4501-977d-f240f448a41e tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:03.869430 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3f43c3ef-8093-4501-977d-f240f448a41e tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:03.869891 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3f43c3ef-8093-4501-977d-f240f448a41e tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:03.958634 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-e5b230e0-38cc-48f2-a758-1a453f6022b2 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.282479 Jul 23 21:19:03.962048 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 676/1349] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:19:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 2287 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 23 21:19:03.983371 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-1d58221a-5c30-4d3d-ad85-500c5bd93c02 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1657979878", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "290f6ab6-b90e-4acc-9fe0-f410e54c8881"}], "block_device_mapping_v2": [{"uuid": "45722d72-c3a2-4f78-9923-e1cce3fffdf2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:19:04.135715 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.network.neutron [None req-1d58221a-5c30-4d3d-ad85-500c5bd93c02 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] validate_networks() for [('290f6ab6-b90e-4acc-9fe0-f410e54c8881', None, None, None, None, None)] {{(pid=131321) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:19:04.246876 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-3f43c3ef-8093-4501-977d-f240f448a41e tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:04.258734 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-3f43c3ef-8093-4501-977d-f240f448a41e tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2" status: 200 len: 1475 microversion: 2.1 time: 0.456558 Jul 23 21:19:04.274277 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 674/1350] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:19:03 2022] GET /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2 => generated 1475 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:19:04.291358 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ddfcd2c1-c132-483a-a9e8-2ff3f47b0f4f tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:04.292152 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ddfcd2c1-c132-483a-a9e8-2ff3f47b0f4f tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 784e1fb4-876e-489f-9428-e01412642663] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:04.623664 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ddfcd2c1-c132-483a-a9e8-2ff3f47b0f4f tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:04.637332 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ddfcd2c1-c132-483a-a9e8-2ff3f47b0f4f tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/784e1fb4-876e-489f-9428-e01412642663" status: 200 len: 1052 microversion: 2.1 time: 0.370463 Jul 23 21:19:04.640314 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 675/1351] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:19:04 2022] GET /compute/v2.1/servers/784e1fb4-876e-489f-9428-e01412642663 => generated 1052 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:19:05.006001 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-35d99a95-d0cd-4b99-a846-092b3185c306 tempest-NetworksTest-840418673 tempest-NetworksTest-840418673-project-admin] Calling method '.version_select at 0x7f0b4772adc0>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:05.464559 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-35d99a95-d0cd-4b99-a846-092b3185c306 tempest-NetworksTest-840418673 tempest-NetworksTest-840418673-project-admin] 10.222.0.17 "GET /compute/v2.1/os-networks" status: 200 len: 9469 microversion: 2.1 time: 0.819693 Jul 23 21:19:05.465299 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 676/1352] 10.222.0.17 () {58 vars in 1136 bytes} [Sat Jul 23 21:19:04 2022] GET /compute/v2.1/os-networks => generated 9469 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:19:05.470351 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-628c6fe8-65a3-403b-8178-ed7249c162ed tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '.version_select at 0x7f0b477de5e0>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:05.591556 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-628c6fe8-65a3-403b-8178-ed7249c162ed tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/images/0d3d0429-755c-441f-ab98-3c0bd09dd6af" status: 200 len: 1440 microversion: 2.1 time: 0.124522 Jul 23 21:19:05.592960 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 677/1353] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:19:05 2022] GET /compute/v2.1/images/0d3d0429-755c-441f-ab98-3c0bd09dd6af => generated 1440 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:19:05.620160 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-50aae622-a86d-4152-8dc4-47ebe9580e85 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:05.620978 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-50aae622-a86d-4152-8dc4-47ebe9580e85 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: d1b84776-ab42-4b27-975d-1744b2935bb2] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:05.639832 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-50aae622-a86d-4152-8dc4-47ebe9580e85 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:05.650132 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-50aae622-a86d-4152-8dc4-47ebe9580e85 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:05.651729 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-50aae622-a86d-4152-8dc4-47ebe9580e85 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:05.652924 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-50aae622-a86d-4152-8dc4-47ebe9580e85 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:06.043535 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-50aae622-a86d-4152-8dc4-47ebe9580e85 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:06.055191 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-50aae622-a86d-4152-8dc4-47ebe9580e85 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2" status: 200 len: 1475 microversion: 2.1 time: 0.459350 Jul 23 21:19:06.060206 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 678/1354] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:19:05 2022] GET /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2 => generated 1475 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:19:06.075496 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-eaed8cd9-149f-4ce3-929a-087e5a767bd1 tempest-NetworksTest-840418673 tempest-NetworksTest-840418673-project-admin] Calling method '.version_select at 0x7f0b477deee0>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:06.354152 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-eaed8cd9-149f-4ce3-929a-087e5a767bd1 tempest-NetworksTest-840418673 tempest-NetworksTest-840418673-project-admin] 10.222.0.17 "GET /compute/v2.1/os-networks/b6eef43f-b538-43c4-bcc2-ec59ff7e8610" status: 200 len: 652 microversion: 2.1 time: 0.290725 Jul 23 21:19:06.360357 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 679/1355] 10.222.0.17 () {58 vars in 1247 bytes} [Sat Jul 23 21:19:06 2022] GET /compute/v2.1/os-networks/b6eef43f-b538-43c4-bcc2-ec59ff7e8610 => generated 652 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:19:06.372756 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4f6c058c-b140-43e3-adc5-e0636f9f3e5e tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:06.373428 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-4f6c058c-b140-43e3-adc5-e0636f9f3e5e tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 784e1fb4-876e-489f-9428-e01412642663] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:06.405708 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4f6c058c-b140-43e3-adc5-e0636f9f3e5e tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:06.409501 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4f6c058c-b140-43e3-adc5-e0636f9f3e5e tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:06.410943 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4f6c058c-b140-43e3-adc5-e0636f9f3e5e tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:06.413785 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4f6c058c-b140-43e3-adc5-e0636f9f3e5e tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:06.435950 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:19:06.640241 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-4f6c058c-b140-43e3-adc5-e0636f9f3e5e tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:06.677316 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4f6c058c-b140-43e3-adc5-e0636f9f3e5e tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/784e1fb4-876e-489f-9428-e01412642663" status: 200 len: 1168 microversion: 2.1 time: 0.315662 Jul 23 21:19:06.686923 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 680/1356] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:19:06 2022] GET /compute/v2.1/servers/784e1fb4-876e-489f-9428-e01412642663 => generated 1168 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:19:06.700734 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9adf53fa-cdd1-4a80-95b4-dc2e2ebafb08 tempest-NetworksTest-840418673 tempest-NetworksTest-840418673-project-admin] Calling method '.version_select at 0x7f0b477c58b0>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:06.781940 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-1d58221a-5c30-4d3d-ad85-500c5bd93c02 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Flavor limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:19:06.782928 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-1d58221a-5c30-4d3d-ad85-500c5bd93c02 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Image limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:19:06.783576 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-1d58221a-5c30-4d3d-ad85-500c5bd93c02 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Flavor pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:19:06.784166 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-1d58221a-5c30-4d3d-ad85-500c5bd93c02 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Image pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:19:06.784745 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-1d58221a-5c30-4d3d-ad85-500c5bd93c02 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:19:06.800460 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1d58221a-5c30-4d3d-ad85-500c5bd93c02 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:06.810678 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1d58221a-5c30-4d3d-ad85-500c5bd93c02 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:06.814205 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1d58221a-5c30-4d3d-ad85-500c5bd93c02 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:06.814669 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1d58221a-5c30-4d3d-ad85-500c5bd93c02 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:06.869359 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-1d58221a-5c30-4d3d-ad85-500c5bd93c02 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Getting quotas for project b347973dfb204484bdb87ab0094dbe22. Resources: {'ram', 'instances', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:19:06.893670 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-1d58221a-5c30-4d3d-ad85-500c5bd93c02 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Getting quotas for user 3a56b82cf3954f279dd21e17a42462b3 and project b347973dfb204484bdb87ab0094dbe22. Resources: {'ram', 'instances', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:19:07.338122 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9adf53fa-cdd1-4a80-95b4-dc2e2ebafb08 tempest-NetworksTest-840418673 tempest-NetworksTest-840418673-project-admin] 10.222.0.17 "GET /compute/v2.1/os-networks" status: 200 len: 9469 microversion: 2.1 time: 0.649964 Jul 23 21:19:07.339406 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 681/1357] 10.222.0.17 () {58 vars in 1136 bytes} [Sat Jul 23 21:19:06 2022] GET /compute/v2.1/os-networks => generated 9469 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:19:07.353798 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-dc28be4b-a7e9-447f-98a0-50051c2a3ebc tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '.version_select at 0x7f0b475d8f70>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:07.456883 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-dc28be4b-a7e9-447f-98a0-50051c2a3ebc tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/images/0d3d0429-755c-441f-ab98-3c0bd09dd6af" status: 200 len: 1440 microversion: 2.1 time: 0.107864 Jul 23 21:19:07.458022 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 682/1358] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:19:07 2022] GET /compute/v2.1/images/0d3d0429-755c-441f-ab98-3c0bd09dd6af => generated 1440 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:19:07.476344 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c6567256-9a67-48db-a49f-2878eefcf12f tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:07.478159 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c6567256-9a67-48db-a49f-2878eefcf12f tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: d1b84776-ab42-4b27-975d-1744b2935bb2] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:07.501304 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:19:07.507834 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c6567256-9a67-48db-a49f-2878eefcf12f tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:07.508611 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c6567256-9a67-48db-a49f-2878eefcf12f tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:07.512299 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c6567256-9a67-48db-a49f-2878eefcf12f tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:07.514094 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c6567256-9a67-48db-a49f-2878eefcf12f tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:07.539685 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-1d58221a-5c30-4d3d-ad85-500c5bd93c02 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Going to run 1 instances... {{(pid=131321) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:19:07.541730 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-1d58221a-5c30-4d3d-ad85-500c5bd93c02 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: 214b4d99-34d8-48c7-924c-27cd2f6712e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='45722d72-c3a2-4f78-9923-e1cce3fffdf2',volume_size=None,volume_type=None)] {{(pid=131321) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:19:08.172673 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-1d58221a-5c30-4d3d-ad85-500c5bd93c02 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 4.207817 Jul 23 21:19:08.173322 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 677/1359] 10.222.0.17 () {62 vars in 1187 bytes} [Sat Jul 23 21:19:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 4209 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 23 21:19:08.194109 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e87a63a4-724e-485e-8e96-7e9114638a48 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:08.195015 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-e87a63a4-724e-485e-8e96-7e9114638a48 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 784e1fb4-876e-489f-9428-e01412642663] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:08.227359 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e87a63a4-724e-485e-8e96-7e9114638a48 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:08.229571 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e87a63a4-724e-485e-8e96-7e9114638a48 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:08.233126 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e87a63a4-724e-485e-8e96-7e9114638a48 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:08.235079 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e87a63a4-724e-485e-8e96-7e9114638a48 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:09.374556 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c6567256-9a67-48db-a49f-2878eefcf12f tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:09.388329 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c6567256-9a67-48db-a49f-2878eefcf12f tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2" status: 200 len: 1474 microversion: 2.1 time: 1.925026 Jul 23 21:19:09.389855 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 683/1360] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:19:07 2022] GET /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2 => generated 1474 bytes in 1931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:19:09.404069 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-7cffcaad-6f91-435a-bb64-dd0e6b271374 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:09.410158 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-7cffcaad-6f91-435a-bb64-dd0e6b271374 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: 214b4d99-34d8-48c7-924c-27cd2f6712e7] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:09.430928 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7cffcaad-6f91-435a-bb64-dd0e6b271374 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:09.431774 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7cffcaad-6f91-435a-bb64-dd0e6b271374 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:09.433101 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7cffcaad-6f91-435a-bb64-dd0e6b271374 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:09.433802 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7cffcaad-6f91-435a-bb64-dd0e6b271374 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:09.589520 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-7cffcaad-6f91-435a-bb64-dd0e6b271374 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:09.602735 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-7cffcaad-6f91-435a-bb64-dd0e6b271374 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:09.606065 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-7cffcaad-6f91-435a-bb64-dd0e6b271374 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:09.608972 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-7cffcaad-6f91-435a-bb64-dd0e6b271374 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/214b4d99-34d8-48c7-924c-27cd2f6712e7" status: 200 len: 1185 microversion: 2.25 time: 0.215769 Jul 23 21:19:09.610176 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 684/1361] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:19:09 2022] GET /compute/v2.1/servers/214b4d99-34d8-48c7-924c-27cd2f6712e7 => generated 1185 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:19:09.617309 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-32c1abcf-c572-495f-b185-b38aa1a46aae tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '.version_select at 0x7f0b477d4040>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:09.723491 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-32c1abcf-c572-495f-b185-b38aa1a46aae tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/images/0d3d0429-755c-441f-ab98-3c0bd09dd6af" status: 200 len: 1440 microversion: 2.1 time: 0.111032 Jul 23 21:19:09.730200 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 685/1362] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:19:09 2022] GET /compute/v2.1/images/0d3d0429-755c-441f-ab98-3c0bd09dd6af => generated 1440 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:19:09.739817 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6aee8776-1555-4728-bbaa-56b23360f8a8 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:09.747184 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6aee8776-1555-4728-bbaa-56b23360f8a8 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] [instance: e753b3c8-e63a-48d5-a349-fa19db134404] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:09.762464 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6aee8776-1555-4728-bbaa-56b23360f8a8 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:09.763161 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6aee8776-1555-4728-bbaa-56b23360f8a8 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:09.764206 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6aee8776-1555-4728-bbaa-56b23360f8a8 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:09.764818 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6aee8776-1555-4728-bbaa-56b23360f8a8 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:09.867709 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6aee8776-1555-4728-bbaa-56b23360f8a8 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] 10.222.0.17 "GET /compute/v2.1/servers/e753b3c8-e63a-48d5-a349-fa19db134404/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.136158 Jul 23 21:19:09.872845 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 686/1363] 10.222.0.17 () {58 vars in 1301 bytes} [Sat Jul 23 21:19:09 2022] GET /compute/v2.1/servers/e753b3c8-e63a-48d5-a349-fa19db134404/os-volume_attachments => generated 197 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:19:10.041062 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-e87a63a4-724e-485e-8e96-7e9114638a48 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:10.056987 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-e87a63a4-724e-485e-8e96-7e9114638a48 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/784e1fb4-876e-489f-9428-e01412642663" status: 200 len: 1168 microversion: 2.1 time: 1.874871 Jul 23 21:19:10.059635 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 678/1364] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:19:08 2022] GET /compute/v2.1/servers/784e1fb4-876e-489f-9428-e01412642663 => generated 1168 bytes in 1886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:19:10.072819 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-51177ecb-8242-4783-859f-74f67cffff93 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:10.075813 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-51177ecb-8242-4783-859f-74f67cffff93 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] [instance: e753b3c8-e63a-48d5-a349-fa19db134404] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:10.101647 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-51177ecb-8242-4783-859f-74f67cffff93 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:10.102179 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-51177ecb-8242-4783-859f-74f67cffff93 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:10.104870 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-51177ecb-8242-4783-859f-74f67cffff93 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:10.107767 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-51177ecb-8242-4783-859f-74f67cffff93 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:10.379982 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.objects.instance [None req-51177ecb-8242-4783-859f-74f67cffff93 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lazy-loading 'services' on Instance uuid e753b3c8-e63a-48d5-a349-fa19db134404 {{(pid=131321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:19:10.390661 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-4a879f4c-570f-4b99-9d56-0e2669f3038d req-9e809a0f-d174-4830-9ae8-5a9af423d471 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1b84776-ab42-4b27-975d-1744b2935bb2", "name": "network-vif-unplugged", "status": "completed", "tag": "75148d97-06cd-4836-97fd-6cce38566d93"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:19:10.421410 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-4a879f4c-570f-4b99-9d56-0e2669f3038d req-9e809a0f-d174-4830-9ae8-5a9af423d471 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:10.422881 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-4a879f4c-570f-4b99-9d56-0e2669f3038d req-9e809a0f-d174-4830-9ae8-5a9af423d471 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:10.447376 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-4a879f4c-570f-4b99-9d56-0e2669f3038d req-9e809a0f-d174-4830-9ae8-5a9af423d471 service nova] Creating event network-vif-unplugged:75148d97-06cd-4836-97fd-6cce38566d93 for instance d1b84776-ab42-4b27-975d-1744b2935bb2 on nch1-master-1 Jul 23 21:19:10.455730 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [req-4a879f4c-570f-4b99-9d56-0e2669f3038d req-9e809a0f-d174-4830-9ae8-5a9af423d471 service nova] Instance d1b84776-ab42-4b27-975d-1744b2935bb2 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=131320) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 23 21:19:10.468515 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-4a879f4c-570f-4b99-9d56-0e2669f3038d req-9e809a0f-d174-4830-9ae8-5a9af423d471 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.593245 Jul 23 21:19:10.470190 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 687/1365] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:19:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:19:10.476717 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-843a15c8-58bb-4bdb-9a10-ec922edfb8b6 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:10.478520 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-843a15c8-58bb-4bdb-9a10-ec922edfb8b6 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: d1b84776-ab42-4b27-975d-1744b2935bb2] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:10.486967 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-843a15c8-58bb-4bdb-9a10-ec922edfb8b6 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:10.487873 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-843a15c8-58bb-4bdb-9a10-ec922edfb8b6 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:10.510363 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-843a15c8-58bb-4bdb-9a10-ec922edfb8b6 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:10.511708 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-843a15c8-58bb-4bdb-9a10-ec922edfb8b6 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:10.614423 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-51177ecb-8242-4783-859f-74f67cffff93 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] 10.222.0.17 "DELETE /compute/v2.1/servers/e753b3c8-e63a-48d5-a349-fa19db134404/os-volume_attachments/8a819a79-2619-464d-a96a-b3a49144bb57" status: 202 len: 0 microversion: 2.1 time: 0.549484 Jul 23 21:19:10.615423 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 679/1366] 10.222.0.17 () {58 vars in 1415 bytes} [Sat Jul 23 21:19:10 2022] DELETE /compute/v2.1/servers/e753b3c8-e63a-48d5-a349-fa19db134404/os-volume_attachments/8a819a79-2619-464d-a96a-b3a49144bb57 => generated 0 bytes in 555 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:19:10.633321 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-b44d66f1-17d1-4f6d-bb92-ade5fcd5f0e5 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:10.637575 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-b44d66f1-17d1-4f6d-bb92-ade5fcd5f0e5 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: 214b4d99-34d8-48c7-924c-27cd2f6712e7] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:10.654707 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b44d66f1-17d1-4f6d-bb92-ade5fcd5f0e5 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:10.655595 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b44d66f1-17d1-4f6d-bb92-ade5fcd5f0e5 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:10.658404 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b44d66f1-17d1-4f6d-bb92-ade5fcd5f0e5 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:10.660428 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b44d66f1-17d1-4f6d-bb92-ade5fcd5f0e5 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:11.052854 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-843a15c8-58bb-4bdb-9a10-ec922edfb8b6 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:11.068631 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-843a15c8-58bb-4bdb-9a10-ec922edfb8b6 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2" status: 200 len: 1474 microversion: 2.1 time: 0.596737 Jul 23 21:19:11.074403 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 688/1367] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:19:10 2022] GET /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2 => generated 1474 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:19:11.092634 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-14509866-100f-4cb1-aba3-b327640a56c2 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '.version_select at 0x7f0b477b0d30>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:11.219466 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-14509866-100f-4cb1-aba3-b327640a56c2 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/images/0d3d0429-755c-441f-ab98-3c0bd09dd6af" status: 200 len: 1440 microversion: 2.1 time: 0.132921 Jul 23 21:19:11.225523 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 689/1368] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:19:11 2022] GET /compute/v2.1/images/0d3d0429-755c-441f-ab98-3c0bd09dd6af => generated 1440 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:19:11.234050 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-de538a60-cf6c-4b43-92b1-20edec585137 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:11.239180 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-de538a60-cf6c-4b43-92b1-20edec585137 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 784e1fb4-876e-489f-9428-e01412642663] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:11.283523 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-de538a60-cf6c-4b43-92b1-20edec585137 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:11.284153 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-de538a60-cf6c-4b43-92b1-20edec585137 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:11.286676 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-de538a60-cf6c-4b43-92b1-20edec585137 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:11.287346 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-de538a60-cf6c-4b43-92b1-20edec585137 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:11.322428 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-b44d66f1-17d1-4f6d-bb92-ade5fcd5f0e5 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:11.332710 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-b44d66f1-17d1-4f6d-bb92-ade5fcd5f0e5 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:11.348912 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-b44d66f1-17d1-4f6d-bb92-ade5fcd5f0e5 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:11.355007 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-b44d66f1-17d1-4f6d-bb92-ade5fcd5f0e5 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/214b4d99-34d8-48c7-924c-27cd2f6712e7" status: 200 len: 1251 microversion: 2.25 time: 0.731370 Jul 23 21:19:11.365282 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 680/1369] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:19:10 2022] GET /compute/v2.1/servers/214b4d99-34d8-48c7-924c-27cd2f6712e7 => generated 1251 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:19:11.586236 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-de538a60-cf6c-4b43-92b1-20edec585137 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:11.607446 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-de538a60-cf6c-4b43-92b1-20edec585137 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/784e1fb4-876e-489f-9428-e01412642663" status: 200 len: 1156 microversion: 2.1 time: 0.370409 Jul 23 21:19:11.613901 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 690/1370] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:19:11 2022] GET /compute/v2.1/servers/784e1fb4-876e-489f-9428-e01412642663 => generated 1156 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:19:11.934539 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-25418da6-eb19-41aa-a6a2-261fc6e34f7f tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-734191207", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "networks": [{"uuid": "ecbe0029-ff6a-44a3-ae55-f8c24a06320d"}], "security_groups": [{"name": "tempest-securitygroup--1867390753"}], "key_name": "tempest-keypair-1261648286", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:19:11.987101 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e5ec2c18-fdf5-4366-8348-00956aeccfb7 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:11.989725 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e5ec2c18-fdf5-4366-8348-00956aeccfb7 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] [instance: e753b3c8-e63a-48d5-a349-fa19db134404] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:12.006644 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e5ec2c18-fdf5-4366-8348-00956aeccfb7 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:12.008795 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e5ec2c18-fdf5-4366-8348-00956aeccfb7 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:12.010985 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e5ec2c18-fdf5-4366-8348-00956aeccfb7 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:12.013378 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e5ec2c18-fdf5-4366-8348-00956aeccfb7 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:12.082521 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e5ec2c18-fdf5-4366-8348-00956aeccfb7 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] 10.222.0.17 "GET /compute/v2.1/servers/e753b3c8-e63a-48d5-a349-fa19db134404/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.100987 Jul 23 21:19:12.083350 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 691/1371] 10.222.0.17 () {58 vars in 1301 bytes} [Sat Jul 23 21:19:11 2022] GET /compute/v2.1/servers/e753b3c8-e63a-48d5-a349-fa19db134404/os-volume_attachments => generated 25 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 23 21:19:12.099684 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-40d8e6cf-b8d5-4cea-8eb0-742d6eb3af80 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:12.100578 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-40d8e6cf-b8d5-4cea-8eb0-742d6eb3af80 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: d1b84776-ab42-4b27-975d-1744b2935bb2] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:12.113299 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-40d8e6cf-b8d5-4cea-8eb0-742d6eb3af80 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:12.114139 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-40d8e6cf-b8d5-4cea-8eb0-742d6eb3af80 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:12.115308 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-40d8e6cf-b8d5-4cea-8eb0-742d6eb3af80 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:12.116038 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-40d8e6cf-b8d5-4cea-8eb0-742d6eb3af80 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:12.581649 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.network.neutron [None req-25418da6-eb19-41aa-a6a2-261fc6e34f7f tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] validate_networks() for [('ecbe0029-ff6a-44a3-ae55-f8c24a06320d', None, None, None, None, None)] {{(pid=131321) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:19:13.098210 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-40d8e6cf-b8d5-4cea-8eb0-742d6eb3af80 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:13.112076 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-40d8e6cf-b8d5-4cea-8eb0-742d6eb3af80 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2" status: 200 len: 1474 microversion: 2.1 time: 1.024178 Jul 23 21:19:13.123052 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 692/1372] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:19:12 2022] GET /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2 => generated 1474 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:19:13.138407 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-42c99ca7-932b-4966-8c21-3a8d7f471667 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:13.139845 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-42c99ca7-932b-4966-8c21-3a8d7f471667 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] [instance: e753b3c8-e63a-48d5-a349-fa19db134404] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:13.150771 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-42c99ca7-932b-4966-8c21-3a8d7f471667 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:13.151553 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-42c99ca7-932b-4966-8c21-3a8d7f471667 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:13.152648 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-42c99ca7-932b-4966-8c21-3a8d7f471667 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:13.153293 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-42c99ca7-932b-4966-8c21-3a8d7f471667 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:13.211470 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-42c99ca7-932b-4966-8c21-3a8d7f471667 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] 10.222.0.17 "GET /compute/v2.1/servers/e753b3c8-e63a-48d5-a349-fa19db134404/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.084530 Jul 23 21:19:13.212822 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 693/1373] 10.222.0.17 () {58 vars in 1301 bytes} [Sat Jul 23 21:19:13 2022] GET /compute/v2.1/servers/e753b3c8-e63a-48d5-a349-fa19db134404/os-volume_attachments => generated 25 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 23 21:19:13.222902 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f4448f57-56cf-48b3-895c-8911e769613f tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '.version_select at 0x7f0b4772a5e0>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:13.305613 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f4448f57-56cf-48b3-895c-8911e769613f tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/images/0d3d0429-755c-441f-ab98-3c0bd09dd6af" status: 200 len: 1440 microversion: 2.1 time: 0.091033 Jul 23 21:19:13.316297 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 694/1374] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:19:13 2022] GET /compute/v2.1/images/0d3d0429-755c-441f-ab98-3c0bd09dd6af => generated 1440 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:19:13.324116 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-65493527-d71a-49f1-84e2-ebcaf82912ae tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:13.327587 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-65493527-d71a-49f1-84e2-ebcaf82912ae tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: 214b4d99-34d8-48c7-924c-27cd2f6712e7] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:13.338369 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-65493527-d71a-49f1-84e2-ebcaf82912ae tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:13.339028 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-65493527-d71a-49f1-84e2-ebcaf82912ae tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:13.340031 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-65493527-d71a-49f1-84e2-ebcaf82912ae tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:13.340649 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-65493527-d71a-49f1-84e2-ebcaf82912ae tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:13.583603 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-65493527-d71a-49f1-84e2-ebcaf82912ae tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:13.595271 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-65493527-d71a-49f1-84e2-ebcaf82912ae tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:13.603575 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-65493527-d71a-49f1-84e2-ebcaf82912ae tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:13.604554 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-65493527-d71a-49f1-84e2-ebcaf82912ae tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/214b4d99-34d8-48c7-924c-27cd2f6712e7" status: 200 len: 1251 microversion: 2.25 time: 0.286900 Jul 23 21:19:13.609042 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 695/1375] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:19:13 2022] GET /compute/v2.1/servers/214b4d99-34d8-48c7-924c-27cd2f6712e7 => generated 1251 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:19:13.636728 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-7ac87a68-66e6-481b-9aaf-088983ecc069 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:13.637302 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-7ac87a68-66e6-481b-9aaf-088983ecc069 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 784e1fb4-876e-489f-9428-e01412642663] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:13.677631 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7ac87a68-66e6-481b-9aaf-088983ecc069 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:13.678105 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7ac87a68-66e6-481b-9aaf-088983ecc069 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:13.678897 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7ac87a68-66e6-481b-9aaf-088983ecc069 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:13.679335 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7ac87a68-66e6-481b-9aaf-088983ecc069 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:13.852888 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-7ac87a68-66e6-481b-9aaf-088983ecc069 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:13.869776 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-7ac87a68-66e6-481b-9aaf-088983ecc069 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/784e1fb4-876e-489f-9428-e01412642663" status: 200 len: 1156 microversion: 2.1 time: 0.247996 Jul 23 21:19:13.870992 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 696/1376] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:19:13 2022] GET /compute/v2.1/servers/784e1fb4-876e-489f-9428-e01412642663 => generated 1156 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:19:13.888253 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-93b33fae-9c02-435f-98c5-eba6a939dd33 req-81f345ae-59c3-4fef-98ab-425a7afde43c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1b84776-ab42-4b27-975d-1744b2935bb2", "tag": "75148d97-06cd-4836-97fd-6cce38566d93"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:19:13.901686 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-93b33fae-9c02-435f-98c5-eba6a939dd33 req-81f345ae-59c3-4fef-98ab-425a7afde43c service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:13.908741 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-93b33fae-9c02-435f-98c5-eba6a939dd33 req-81f345ae-59c3-4fef-98ab-425a7afde43c service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:13.932008 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-93b33fae-9c02-435f-98c5-eba6a939dd33 req-81f345ae-59c3-4fef-98ab-425a7afde43c service nova] Creating event network-changed:75148d97-06cd-4836-97fd-6cce38566d93 for instance d1b84776-ab42-4b27-975d-1744b2935bb2 on nch1-master-1 Jul 23 21:19:13.949764 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [req-93b33fae-9c02-435f-98c5-eba6a939dd33 req-81f345ae-59c3-4fef-98ab-425a7afde43c service nova] Instance d1b84776-ab42-4b27-975d-1744b2935bb2 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=131320) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 23 21:19:13.971871 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-93b33fae-9c02-435f-98c5-eba6a939dd33 req-81f345ae-59c3-4fef-98ab-425a7afde43c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099304 Jul 23 21:19:13.972505 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 697/1377] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:19:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:19:13.982385 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4dbc9365-0836-4c6e-9a7b-fd20e3e861b8 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:13.983016 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-4dbc9365-0836-4c6e-9a7b-fd20e3e861b8 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] [instance: e753b3c8-e63a-48d5-a349-fa19db134404] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:14.008434 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4dbc9365-0836-4c6e-9a7b-fd20e3e861b8 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:14.016017 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4dbc9365-0836-4c6e-9a7b-fd20e3e861b8 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:14.017003 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4dbc9365-0836-4c6e-9a7b-fd20e3e861b8 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:14.017458 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4dbc9365-0836-4c6e-9a7b-fd20e3e861b8 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:14.127028 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-4dbc9365-0836-4c6e-9a7b-fd20e3e861b8 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] [instance: e753b3c8-e63a-48d5-a349-fa19db134404] Going to try to terminate instance {{(pid=131320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:19:14.336732 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4dbc9365-0836-4c6e-9a7b-fd20e3e861b8 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] 10.222.0.17 "DELETE /compute/v2.1/servers/e753b3c8-e63a-48d5-a349-fa19db134404" status: 204 len: 0 microversion: 2.1 time: 0.362697 Jul 23 21:19:14.341402 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 698/1378] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:19:13 2022] DELETE /compute/v2.1/servers/e753b3c8-e63a-48d5-a349-fa19db134404 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:19:14.350374 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f18d5607-2f03-471e-8384-23c77c544a64 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:14.352277 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f18d5607-2f03-471e-8384-23c77c544a64 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: d1b84776-ab42-4b27-975d-1744b2935bb2] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:14.359924 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f18d5607-2f03-471e-8384-23c77c544a64 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:14.360679 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f18d5607-2f03-471e-8384-23c77c544a64 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:14.362290 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f18d5607-2f03-471e-8384-23c77c544a64 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:14.362985 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f18d5607-2f03-471e-8384-23c77c544a64 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:14.633811 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=6 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:19:15.161905 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-25418da6-eb19-41aa-a6a2-261fc6e34f7f tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Flavor limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:19:15.162405 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-25418da6-eb19-41aa-a6a2-261fc6e34f7f tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Image limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:19:15.162820 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-25418da6-eb19-41aa-a6a2-261fc6e34f7f tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Flavor pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:19:15.163234 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-25418da6-eb19-41aa-a6a2-261fc6e34f7f tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Image pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:19:15.163653 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-25418da6-eb19-41aa-a6a2-261fc6e34f7f tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:19:15.192300 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-25418da6-eb19-41aa-a6a2-261fc6e34f7f tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:15.193150 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-25418da6-eb19-41aa-a6a2-261fc6e34f7f tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:15.197259 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-25418da6-eb19-41aa-a6a2-261fc6e34f7f tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:15.200038 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-25418da6-eb19-41aa-a6a2-261fc6e34f7f tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:15.274628 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f18d5607-2f03-471e-8384-23c77c544a64 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:15.295630 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-25418da6-eb19-41aa-a6a2-261fc6e34f7f tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Getting quotas for project f220ba2f42db435a818f3e462aea35a2. Resources: {'ram', 'instances', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:19:15.305911 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f18d5607-2f03-471e-8384-23c77c544a64 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2" status: 200 len: 1472 microversion: 2.1 time: 0.962356 Jul 23 21:19:15.313066 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 699/1379] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:19:14 2022] GET /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2 => generated 1472 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:19:15.317001 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-25418da6-eb19-41aa-a6a2-261fc6e34f7f tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Getting quotas for user 145e518288ce4d70a12a3f2cc6a91810 and project f220ba2f42db435a818f3e462aea35a2. Resources: {'ram', 'instances', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:19:15.345044 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-61bfc113-9067-46d4-8220-3e1a955d5328 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '.version_select at 0x7f0b4762a940>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:15.400306 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-25418da6-eb19-41aa-a6a2-261fc6e34f7f tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Going to run 1 instances... {{(pid=131321) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:19:15.416895 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-25418da6-eb19-41aa-a6a2-261fc6e34f7f tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] [instance: f53ce882-4694-421d-8075-5e8cfab0b16f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131321) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:19:15.441330 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-61bfc113-9067-46d4-8220-3e1a955d5328 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/images/0d3d0429-755c-441f-ab98-3c0bd09dd6af" status: 200 len: 1440 microversion: 2.1 time: 0.110407 Jul 23 21:19:15.442273 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 700/1380] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:19:15 2022] GET /compute/v2.1/images/0d3d0429-755c-441f-ab98-3c0bd09dd6af => generated 1440 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:19:15.470495 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-046a5336-e3d5-40ec-99b7-6372d105c3af tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:15.471464 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-046a5336-e3d5-40ec-99b7-6372d105c3af tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] [instance: e753b3c8-e63a-48d5-a349-fa19db134404] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:15.495322 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-046a5336-e3d5-40ec-99b7-6372d105c3af tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:15.496218 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-046a5336-e3d5-40ec-99b7-6372d105c3af tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:15.498088 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-046a5336-e3d5-40ec-99b7-6372d105c3af tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:15.498698 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-046a5336-e3d5-40ec-99b7-6372d105c3af tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:15.584808 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-25418da6-eb19-41aa-a6a2-261fc6e34f7f tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.654727 Jul 23 21:19:15.589928 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 681/1381] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:19:11 2022] POST /compute/v2.1/servers => generated 406 bytes in 3660 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 23 21:19:15.595301 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-7356b2bc-ff5d-4ecf-ba8d-1549e07ee39b tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:15.603235 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-7356b2bc-ff5d-4ecf-ba8d-1549e07ee39b tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: 214b4d99-34d8-48c7-924c-27cd2f6712e7] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:15.616542 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7356b2bc-ff5d-4ecf-ba8d-1549e07ee39b tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:15.629289 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7356b2bc-ff5d-4ecf-ba8d-1549e07ee39b tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:15.630689 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7356b2bc-ff5d-4ecf-ba8d-1549e07ee39b tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:15.632055 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7356b2bc-ff5d-4ecf-ba8d-1549e07ee39b tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:15.917853 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-046a5336-e3d5-40ec-99b7-6372d105c3af tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3ad614d9d24300adb274cc95120fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3811ea868f5649e8a235539a5bf46706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:15.921310 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:19:15.929706 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-046a5336-e3d5-40ec-99b7-6372d105c3af tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] 10.222.0.17 "GET /compute/v2.1/servers/e753b3c8-e63a-48d5-a349-fa19db134404" status: 200 len: 1679 microversion: 2.1 time: 0.485884 Jul 23 21:19:15.941273 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 701/1382] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:19:15 2022] GET /compute/v2.1/servers/e753b3c8-e63a-48d5-a349-fa19db134404 => generated 1679 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:19:15.952219 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-435cf0d3-9826-4da2-be38-eff95fec69fd tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:15.953347 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-435cf0d3-9826-4da2-be38-eff95fec69fd tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 784e1fb4-876e-489f-9428-e01412642663] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:15.971470 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-435cf0d3-9826-4da2-be38-eff95fec69fd tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:15.971910 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-435cf0d3-9826-4da2-be38-eff95fec69fd tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:15.975049 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-435cf0d3-9826-4da2-be38-eff95fec69fd tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:15.975512 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-435cf0d3-9826-4da2-be38-eff95fec69fd tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:16.240668 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-435cf0d3-9826-4da2-be38-eff95fec69fd tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:16.249893 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-435cf0d3-9826-4da2-be38-eff95fec69fd tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/784e1fb4-876e-489f-9428-e01412642663" status: 200 len: 1198 microversion: 2.1 time: 0.307330 Jul 23 21:19:16.251612 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 702/1383] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:19:15 2022] GET /compute/v2.1/servers/784e1fb4-876e-489f-9428-e01412642663 => generated 1198 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:19:16.257799 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-cbca7ebd-d894-4c62-b523-9d51ae7cb388 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:16.262509 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-cbca7ebd-d894-4c62-b523-9d51ae7cb388 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] [instance: f53ce882-4694-421d-8075-5e8cfab0b16f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:16.372362 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-cbca7ebd-d894-4c62-b523-9d51ae7cb388 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145e518288ce4d70a12a3f2cc6a91810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f220ba2f42db435a818f3e462aea35a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:16.381016 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-cbca7ebd-d894-4c62-b523-9d51ae7cb388 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] 10.222.0.17 "GET /compute/v2.1/servers/f53ce882-4694-421d-8075-5e8cfab0b16f" status: 200 len: 1241 microversion: 2.1 time: 0.127766 Jul 23 21:19:16.381457 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 703/1384] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:19:16 2022] GET /compute/v2.1/servers/f53ce882-4694-421d-8075-5e8cfab0b16f => generated 1241 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:19:16.392144 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-7326ef9a-2db6-43db-8612-8cb6af77ad6a tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:16.393069 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-7326ef9a-2db6-43db-8612-8cb6af77ad6a tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: d1b84776-ab42-4b27-975d-1744b2935bb2] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:16.403912 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7326ef9a-2db6-43db-8612-8cb6af77ad6a tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:16.404586 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7326ef9a-2db6-43db-8612-8cb6af77ad6a tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:16.405600 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7326ef9a-2db6-43db-8612-8cb6af77ad6a tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:16.409911 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7326ef9a-2db6-43db-8612-8cb6af77ad6a tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:16.616475 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-7326ef9a-2db6-43db-8612-8cb6af77ad6a tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:16.642995 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-7326ef9a-2db6-43db-8612-8cb6af77ad6a tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2" status: 200 len: 1472 microversion: 2.1 time: 0.255516 Jul 23 21:19:16.643701 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 704/1385] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:19:16 2022] GET /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2 => generated 1472 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:19:16.650340 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a84cf842-b437-43bc-a30f-85753d099dd1 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '.version_select at 0x7f0b4762a310>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:16.719841 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a84cf842-b437-43bc-a30f-85753d099dd1 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/images/0d3d0429-755c-441f-ab98-3c0bd09dd6af" status: 200 len: 1440 microversion: 2.1 time: 0.073986 Jul 23 21:19:16.720533 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 705/1386] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:19:16 2022] GET /compute/v2.1/images/0d3d0429-755c-441f-ab98-3c0bd09dd6af => generated 1440 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:19:16.958799 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-74f384d7-42b9-402f-adba-96d15519c8f4 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:16.958799 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-74f384d7-42b9-402f-adba-96d15519c8f4 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] [instance: e753b3c8-e63a-48d5-a349-fa19db134404] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:16.980876 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-74f384d7-42b9-402f-adba-96d15519c8f4 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:16.981537 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-74f384d7-42b9-402f-adba-96d15519c8f4 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:16.983946 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-74f384d7-42b9-402f-adba-96d15519c8f4 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:16.985573 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-74f384d7-42b9-402f-adba-96d15519c8f4 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:17.340470 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-74f384d7-42b9-402f-adba-96d15519c8f4 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3ad614d9d24300adb274cc95120fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3811ea868f5649e8a235539a5bf46706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:17.351780 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-74f384d7-42b9-402f-adba-96d15519c8f4 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] 10.222.0.17 "GET /compute/v2.1/servers/e753b3c8-e63a-48d5-a349-fa19db134404" status: 200 len: 1679 microversion: 2.1 time: 0.407939 Jul 23 21:19:17.361576 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 706/1387] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:19:16 2022] GET /compute/v2.1/servers/e753b3c8-e63a-48d5-a349-fa19db134404 => generated 1679 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:19:17.369096 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-65a3759a-ded4-4d67-ac8b-f4c78d179061 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:17.369737 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-65a3759a-ded4-4d67-ac8b-f4c78d179061 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 784e1fb4-876e-489f-9428-e01412642663] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:17.408314 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-65a3759a-ded4-4d67-ac8b-f4c78d179061 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:17.427111 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-65a3759a-ded4-4d67-ac8b-f4c78d179061 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:17.428424 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-65a3759a-ded4-4d67-ac8b-f4c78d179061 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:17.444464 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-65a3759a-ded4-4d67-ac8b-f4c78d179061 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:17.502075 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-7356b2bc-ff5d-4ecf-ba8d-1549e07ee39b tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:17.522666 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-7356b2bc-ff5d-4ecf-ba8d-1549e07ee39b tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:17.524641 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-7356b2bc-ff5d-4ecf-ba8d-1549e07ee39b tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:17.529998 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-7356b2bc-ff5d-4ecf-ba8d-1549e07ee39b tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/214b4d99-34d8-48c7-924c-27cd2f6712e7" status: 200 len: 1281 microversion: 2.25 time: 1.938699 Jul 23 21:19:17.544464 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 682/1388] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:19:15 2022] GET /compute/v2.1/servers/214b4d99-34d8-48c7-924c-27cd2f6712e7 => generated 1281 bytes in 1954 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:19:17.558200 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-8ea900df-34ca-490f-a530-5912e004ca41 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:17.559351 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-8ea900df-34ca-490f-a530-5912e004ca41 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] [instance: f53ce882-4694-421d-8075-5e8cfab0b16f] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:17.574043 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8ea900df-34ca-490f-a530-5912e004ca41 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:17.574780 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8ea900df-34ca-490f-a530-5912e004ca41 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:17.576531 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8ea900df-34ca-490f-a530-5912e004ca41 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:17.579800 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8ea900df-34ca-490f-a530-5912e004ca41 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:17.847911 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-65a3759a-ded4-4d67-ac8b-f4c78d179061 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:17.859996 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-65a3759a-ded4-4d67-ac8b-f4c78d179061 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/784e1fb4-876e-489f-9428-e01412642663" status: 200 len: 1198 microversion: 2.1 time: 0.503721 Jul 23 21:19:17.861509 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 707/1389] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:19:17 2022] GET /compute/v2.1/servers/784e1fb4-876e-489f-9428-e01412642663 => generated 1198 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:19:17.876050 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6fea4a11-6b7c-4483-89bd-c3f6be857d77 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:17.876677 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6fea4a11-6b7c-4483-89bd-c3f6be857d77 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: d1b84776-ab42-4b27-975d-1744b2935bb2] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:17.895788 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6fea4a11-6b7c-4483-89bd-c3f6be857d77 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:17.900713 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6fea4a11-6b7c-4483-89bd-c3f6be857d77 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:17.903856 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6fea4a11-6b7c-4483-89bd-c3f6be857d77 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:17.904324 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6fea4a11-6b7c-4483-89bd-c3f6be857d77 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:17.969514 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-8ea900df-34ca-490f-a530-5912e004ca41 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145e518288ce4d70a12a3f2cc6a91810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f220ba2f42db435a818f3e462aea35a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:17.986599 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-8ea900df-34ca-490f-a530-5912e004ca41 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] 10.222.0.17 "GET /compute/v2.1/servers/f53ce882-4694-421d-8075-5e8cfab0b16f" status: 200 len: 1237 microversion: 2.1 time: 0.440413 Jul 23 21:19:17.992404 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 683/1390] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:19:17 2022] GET /compute/v2.1/servers/f53ce882-4694-421d-8075-5e8cfab0b16f => generated 1237 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:19:18.014684 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-1ba17524-90b4-48f2-9e64-abec6bc3c75d tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '.version_select at 0x7f0b47e7e9d0>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:18.177929 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-1ba17524-90b4-48f2-9e64-abec6bc3c75d tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/images/0d3d0429-755c-441f-ab98-3c0bd09dd6af" status: 200 len: 1440 microversion: 2.1 time: 0.183640 Jul 23 21:19:18.178841 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 684/1391] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:19:17 2022] GET /compute/v2.1/images/0d3d0429-755c-441f-ab98-3c0bd09dd6af => generated 1440 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:19:18.371083 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-8690dcd1-3f24-4346-80f3-f5cb379f12b9 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:18.372468 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-8690dcd1-3f24-4346-80f3-f5cb379f12b9 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] [instance: e753b3c8-e63a-48d5-a349-fa19db134404] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:18.385736 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8690dcd1-3f24-4346-80f3-f5cb379f12b9 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:18.393645 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8690dcd1-3f24-4346-80f3-f5cb379f12b9 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:18.395421 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8690dcd1-3f24-4346-80f3-f5cb379f12b9 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:18.396167 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8690dcd1-3f24-4346-80f3-f5cb379f12b9 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:18.613014 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6fea4a11-6b7c-4483-89bd-c3f6be857d77 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:18.622008 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6fea4a11-6b7c-4483-89bd-c3f6be857d77 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2" status: 200 len: 1469 microversion: 2.1 time: 0.750735 Jul 23 21:19:18.628684 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 708/1392] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:19:17 2022] GET /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2 => generated 1469 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:19:18.637854 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-51953c42-582a-4e50-8353-4a6cf826c011 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:18.639018 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-51953c42-582a-4e50-8353-4a6cf826c011 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: 214b4d99-34d8-48c7-924c-27cd2f6712e7] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:18.657477 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-51953c42-582a-4e50-8353-4a6cf826c011 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:18.658882 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-51953c42-582a-4e50-8353-4a6cf826c011 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:18.662221 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-51953c42-582a-4e50-8353-4a6cf826c011 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:18.664756 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-51953c42-582a-4e50-8353-4a6cf826c011 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:19.011873 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-51953c42-582a-4e50-8353-4a6cf826c011 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:19.032004 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-51953c42-582a-4e50-8353-4a6cf826c011 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:19.034732 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-51953c42-582a-4e50-8353-4a6cf826c011 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:19.036289 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-51953c42-582a-4e50-8353-4a6cf826c011 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/214b4d99-34d8-48c7-924c-27cd2f6712e7" status: 200 len: 1281 microversion: 2.25 time: 0.405961 Jul 23 21:19:19.051815 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 709/1393] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:19:18 2022] GET /compute/v2.1/servers/214b4d99-34d8-48c7-924c-27cd2f6712e7 => generated 1281 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:19:19.059394 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8fd2fe3f-90dc-454d-a48b-a7bc19631306 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:19:19.059950 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8fd2fe3f-90dc-454d-a48b-a7bc19631306 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: d1b84776-ab42-4b27-975d-1744b2935bb2] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:19.068159 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8fd2fe3f-90dc-454d-a48b-a7bc19631306 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:19.068616 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8fd2fe3f-90dc-454d-a48b-a7bc19631306 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:19.069682 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8fd2fe3f-90dc-454d-a48b-a7bc19631306 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:19.070155 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8fd2fe3f-90dc-454d-a48b-a7bc19631306 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:19.114682 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-8690dcd1-3f24-4346-80f3-f5cb379f12b9 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3ad614d9d24300adb274cc95120fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3811ea868f5649e8a235539a5bf46706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:19.122514 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-8690dcd1-3f24-4346-80f3-f5cb379f12b9 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] 10.222.0.17 "GET /compute/v2.1/servers/e753b3c8-e63a-48d5-a349-fa19db134404" status: 200 len: 1679 microversion: 2.1 time: 0.757398 Jul 23 21:19:19.131479 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 685/1394] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:19:18 2022] GET /compute/v2.1/servers/e753b3c8-e63a-48d5-a349-fa19db134404 => generated 1679 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:19:19.260454 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8fd2fe3f-90dc-454d-a48b-a7bc19631306 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "POST /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2/action" status: 202 len: 0 microversion: 2.1 time: 0.205759 Jul 23 21:19:19.281487 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 710/1395] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:19:19 2022] POST /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2/action => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:19:19.289534 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-69791802-357b-4d94-b07b-24050fe0f397 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:19.290834 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-69791802-357b-4d94-b07b-24050fe0f397 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 784e1fb4-876e-489f-9428-e01412642663] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:19.310916 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-69791802-357b-4d94-b07b-24050fe0f397 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:19.313632 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-69791802-357b-4d94-b07b-24050fe0f397 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:19.317609 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-69791802-357b-4d94-b07b-24050fe0f397 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:19.318527 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-69791802-357b-4d94-b07b-24050fe0f397 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:19.432292 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-da307c8c-a5ee-4a25-a70e-7ffe5ef3d1cd tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] Action: 'update', calling method: .version_select at 0x7f0b47cf6ee0>, body: {"quota_set": {"ram": "5120"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:19:19.552710 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-da307c8c-a5ee-4a25-a70e-7ffe5ef3d1cd tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:19.554374 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-da307c8c-a5ee-4a25-a70e-7ffe5ef3d1cd tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:19.555203 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-da307c8c-a5ee-4a25-a70e-7ffe5ef3d1cd tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:19.555792 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-da307c8c-a5ee-4a25-a70e-7ffe5ef3d1cd tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:19.685716 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-da307c8c-a5ee-4a25-a70e-7ffe5ef3d1cd tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-quota-sets/ae9b2a25ba5f4a479a072b0be6f190c9" status: 200 len: 240 microversion: 2.36 time: 0.552610 Jul 23 21:19:19.687114 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 686/1396] 10.222.0.17 () {62 vars in 1302 bytes} [Sat Jul 23 21:19:19 2022] PUT /compute/v2.1/os-quota-sets/ae9b2a25ba5f4a479a072b0be6f190c9 => generated 240 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 23 21:19:19.692665 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-5caadc32-2d92-4812-a53d-abbea01ce225 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:19.694599 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-5caadc32-2d92-4812-a53d-abbea01ce225 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] [instance: f53ce882-4694-421d-8075-5e8cfab0b16f] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:19.704892 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5caadc32-2d92-4812-a53d-abbea01ce225 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:19.706116 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5caadc32-2d92-4812-a53d-abbea01ce225 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:19.707147 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5caadc32-2d92-4812-a53d-abbea01ce225 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:19.707801 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5caadc32-2d92-4812-a53d-abbea01ce225 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:19.965442 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-69791802-357b-4d94-b07b-24050fe0f397 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:19.982595 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-69791802-357b-4d94-b07b-24050fe0f397 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/784e1fb4-876e-489f-9428-e01412642663" status: 200 len: 1198 microversion: 2.1 time: 0.706958 Jul 23 21:19:20.007264 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 711/1397] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:19:19 2022] GET /compute/v2.1/servers/784e1fb4-876e-489f-9428-e01412642663 => generated 1198 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:19:20.017741 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4b2c39c7-1813-4b1c-b6df-0701e5d67754 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '.version_select at 0x7f0b4779a700>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:20.043998 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-5caadc32-2d92-4812-a53d-abbea01ce225 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145e518288ce4d70a12a3f2cc6a91810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f220ba2f42db435a818f3e462aea35a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:20.075288 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-5caadc32-2d92-4812-a53d-abbea01ce225 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] 10.222.0.17 "GET /compute/v2.1/servers/f53ce882-4694-421d-8075-5e8cfab0b16f" status: 200 len: 1299 microversion: 2.1 time: 0.379117 Jul 23 21:19:20.103266 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 687/1398] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:19:19 2022] GET /compute/v2.1/servers/f53ce882-4694-421d-8075-5e8cfab0b16f => generated 1299 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:19:20.124698 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-757d5adc-186a-49a5-be58-2161b20de4b3 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:20.127682 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-757d5adc-186a-49a5-be58-2161b20de4b3 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: d1b84776-ab42-4b27-975d-1744b2935bb2] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:20.142754 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-757d5adc-186a-49a5-be58-2161b20de4b3 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:20.146707 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-757d5adc-186a-49a5-be58-2161b20de4b3 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:20.157249 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4b2c39c7-1813-4b1c-b6df-0701e5d67754 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/images/0d3d0429-755c-441f-ab98-3c0bd09dd6af" status: 200 len: 1449 microversion: 2.1 time: 0.148709 Jul 23 21:19:20.160413 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 712/1399] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:19:20 2022] GET /compute/v2.1/images/0d3d0429-755c-441f-ab98-3c0bd09dd6af => generated 1449 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:19:20.170862 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-757d5adc-186a-49a5-be58-2161b20de4b3 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:20.186740 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-757d5adc-186a-49a5-be58-2161b20de4b3 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:20.330062 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-672173f0-37f4-480f-84a1-18f9b4c898e6 req-4d5629c7-7d02-4860-905f-a3354f852414 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1b84776-ab42-4b27-975d-1744b2935bb2", "name": "network-vif-plugged", "status": "completed", "tag": "75148d97-06cd-4836-97fd-6cce38566d93"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:19:20.355053 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-672173f0-37f4-480f-84a1-18f9b4c898e6 req-4d5629c7-7d02-4860-905f-a3354f852414 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:20.359713 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-672173f0-37f4-480f-84a1-18f9b4c898e6 req-4d5629c7-7d02-4860-905f-a3354f852414 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:20.408238 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-672173f0-37f4-480f-84a1-18f9b4c898e6 req-4d5629c7-7d02-4860-905f-a3354f852414 service nova] Creating event network-vif-plugged:75148d97-06cd-4836-97fd-6cce38566d93 for instance d1b84776-ab42-4b27-975d-1744b2935bb2 on nch1-master-1 Jul 23 21:19:20.435951 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [req-672173f0-37f4-480f-84a1-18f9b4c898e6 req-4d5629c7-7d02-4860-905f-a3354f852414 service nova] Instance d1b84776-ab42-4b27-975d-1744b2935bb2 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=131320) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 23 21:19:20.468355 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-672173f0-37f4-480f-84a1-18f9b4c898e6 req-4d5629c7-7d02-4860-905f-a3354f852414 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.304022 Jul 23 21:19:20.472283 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 713/1400] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:19:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:19:20.490836 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4bd7cfaf-e01b-4751-97af-67a17b69a490 tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] Calling method '.version_select at 0x7f0b4779ae50>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:20.669642 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4bd7cfaf-e01b-4751-97af-67a17b69a490 tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:20.673914 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4bd7cfaf-e01b-4751-97af-67a17b69a490 tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:20.680490 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4bd7cfaf-e01b-4751-97af-67a17b69a490 tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:20.681418 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4bd7cfaf-e01b-4751-97af-67a17b69a490 tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:20.741958 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4bd7cfaf-e01b-4751-97af-67a17b69a490 tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] 10.222.0.17 "GET /compute/v2.1/os-quota-sets/ae9b2a25ba5f4a479a072b0be6f190c9/detail" status: 200 len: 672 microversion: 2.36 time: 0.261847 Jul 23 21:19:20.744930 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 714/1401] 10.222.0.17 () {60 vars in 1303 bytes} [Sat Jul 23 21:19:20 2022] GET /compute/v2.1/os-quota-sets/ae9b2a25ba5f4a479a072b0be6f190c9/detail => generated 672 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 23 21:19:20.916710 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-86c28290-5336-475e-8b5b-fc061239cec2 req-5858c3b4-069f-4674-b913-1b3c7fa6467d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "784e1fb4-876e-489f-9428-e01412642663", "tag": "4078ff09-4171-488c-a197-d664957df578"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:19:20.927773 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-757d5adc-186a-49a5-be58-2161b20de4b3 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:20.937133 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-757d5adc-186a-49a5-be58-2161b20de4b3 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2" status: 200 len: 1468 microversion: 2.1 time: 0.830193 Jul 23 21:19:20.939398 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 688/1402] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:19:20 2022] GET /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2 => generated 1468 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:19:20.951086 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-10979f52-b9ed-44f4-a5e9-4bc8f17c6c05 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:20.953200 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-10979f52-b9ed-44f4-a5e9-4bc8f17c6c05 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: 214b4d99-34d8-48c7-924c-27cd2f6712e7] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:20.957698 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-86c28290-5336-475e-8b5b-fc061239cec2 req-5858c3b4-069f-4674-b913-1b3c7fa6467d service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:20.961580 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-86c28290-5336-475e-8b5b-fc061239cec2 req-5858c3b4-069f-4674-b913-1b3c7fa6467d service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:20.980102 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-10979f52-b9ed-44f4-a5e9-4bc8f17c6c05 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:20.980102 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-10979f52-b9ed-44f4-a5e9-4bc8f17c6c05 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:20.980102 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-10979f52-b9ed-44f4-a5e9-4bc8f17c6c05 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:20.980102 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-10979f52-b9ed-44f4-a5e9-4bc8f17c6c05 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:21.024867 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-86c28290-5336-475e-8b5b-fc061239cec2 req-5858c3b4-069f-4674-b913-1b3c7fa6467d service nova] Creating event network-changed:4078ff09-4171-488c-a197-d664957df578 for instance 784e1fb4-876e-489f-9428-e01412642663 on nch1-master-1 Jul 23 21:19:21.052180 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-86c28290-5336-475e-8b5b-fc061239cec2 req-5858c3b4-069f-4674-b913-1b3c7fa6467d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.303726 Jul 23 21:19:21.057590 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 715/1403] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:19:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:19:21.087490 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-44bdb0e7-a3d0-4d2f-ba8f-891a90695bdb tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:21.091638 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-44bdb0e7-a3d0-4d2f-ba8f-891a90695bdb tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] [instance: e753b3c8-e63a-48d5-a349-fa19db134404] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:21.122313 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-44bdb0e7-a3d0-4d2f-ba8f-891a90695bdb tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:21.122779 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-44bdb0e7-a3d0-4d2f-ba8f-891a90695bdb tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:21.123977 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-44bdb0e7-a3d0-4d2f-ba8f-891a90695bdb tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:21.124451 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-44bdb0e7-a3d0-4d2f-ba8f-891a90695bdb tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:21.409718 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-44bdb0e7-a3d0-4d2f-ba8f-891a90695bdb tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe3ad614d9d24300adb274cc95120fd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3811ea868f5649e8a235539a5bf46706', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:21.418411 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-44bdb0e7-a3d0-4d2f-ba8f-891a90695bdb tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] 10.222.0.17 "GET /compute/v2.1/servers/e753b3c8-e63a-48d5-a349-fa19db134404" status: 200 len: 1612 microversion: 2.1 time: 0.355797 Jul 23 21:19:21.422991 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 716/1404] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:19:21 2022] GET /compute/v2.1/servers/e753b3c8-e63a-48d5-a349-fa19db134404 => generated 1612 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:19:21.428019 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-cf3fded4-99ff-4987-a10d-61ea2fd2d5ac tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '.version_select at 0x7f0b4772a310>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:21.559349 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-cf3fded4-99ff-4987-a10d-61ea2fd2d5ac tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/images/0d3d0429-755c-441f-ab98-3c0bd09dd6af" status: 200 len: 1449 microversion: 2.1 time: 0.134484 Jul 23 21:19:21.561371 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 717/1405] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:19:21 2022] GET /compute/v2.1/images/0d3d0429-755c-441f-ab98-3c0bd09dd6af => generated 1449 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:19:21.576307 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-764875c1-0990-457f-9709-31411954cb08 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:21.579618 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-764875c1-0990-457f-9709-31411954cb08 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 784e1fb4-876e-489f-9428-e01412642663] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:21.599531 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-764875c1-0990-457f-9709-31411954cb08 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:21.600394 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-764875c1-0990-457f-9709-31411954cb08 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:21.601459 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-764875c1-0990-457f-9709-31411954cb08 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:21.607012 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-764875c1-0990-457f-9709-31411954cb08 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:21.635239 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-10979f52-b9ed-44f4-a5e9-4bc8f17c6c05 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:21.660774 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-10979f52-b9ed-44f4-a5e9-4bc8f17c6c05 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:21.665272 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-10979f52-b9ed-44f4-a5e9-4bc8f17c6c05 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:21.669537 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-10979f52-b9ed-44f4-a5e9-4bc8f17c6c05 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/214b4d99-34d8-48c7-924c-27cd2f6712e7" status: 200 len: 1281 microversion: 2.25 time: 0.725788 Jul 23 21:19:21.673963 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 689/1406] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:19:20 2022] GET /compute/v2.1/servers/214b4d99-34d8-48c7-924c-27cd2f6712e7 => generated 1281 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:19:21.685080 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-02a25634-b843-4ec1-9c73-17e15797ba27 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:21.687188 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-02a25634-b843-4ec1-9c73-17e15797ba27 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] [instance: f53ce882-4694-421d-8075-5e8cfab0b16f] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:21.700394 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-02a25634-b843-4ec1-9c73-17e15797ba27 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:21.701184 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-02a25634-b843-4ec1-9c73-17e15797ba27 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:21.702493 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-02a25634-b843-4ec1-9c73-17e15797ba27 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:21.703167 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-02a25634-b843-4ec1-9c73-17e15797ba27 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:21.844596 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-02a25634-b843-4ec1-9c73-17e15797ba27 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145e518288ce4d70a12a3f2cc6a91810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f220ba2f42db435a818f3e462aea35a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:21.855440 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-02a25634-b843-4ec1-9c73-17e15797ba27 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] 10.222.0.17 "GET /compute/v2.1/servers/f53ce882-4694-421d-8075-5e8cfab0b16f" status: 200 len: 1299 microversion: 2.1 time: 0.178774 Jul 23 21:19:21.857186 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 690/1407] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:19:21 2022] GET /compute/v2.1/servers/f53ce882-4694-421d-8075-5e8cfab0b16f => generated 1299 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:19:21.870991 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-5d8c254c-1efd-4b6a-82b5-a9703a67b934 tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] Action: 'update', calling method: .version_select at 0x7f0b47cc4a60>, body: {"quota_set": {"ram": "2048"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:19:22.065500 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-764875c1-0990-457f-9709-31411954cb08 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:22.086642 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-764875c1-0990-457f-9709-31411954cb08 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/784e1fb4-876e-489f-9428-e01412642663" status: 200 len: 1198 microversion: 2.1 time: 0.515364 Jul 23 21:19:22.088602 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 718/1408] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:19:21 2022] GET /compute/v2.1/servers/784e1fb4-876e-489f-9428-e01412642663 => generated 1198 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:19:22.116890 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-53560118-3a3c-48d7-a61f-5a33c378778f req-7dbb28cd-e72e-4062-b8bd-651fc6a3b783 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e753b3c8-e63a-48d5-a349-fa19db134404", "name": "network-vif-deleted", "tag": "386c18e4-513b-4ac2-a469-5df264df0146"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:19:22.145908 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-53560118-3a3c-48d7-a61f-5a33c378778f req-7dbb28cd-e72e-4062-b8bd-651fc6a3b783 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:22.150205 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-53560118-3a3c-48d7-a61f-5a33c378778f req-7dbb28cd-e72e-4062-b8bd-651fc6a3b783 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:22.172601 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5d8c254c-1efd-4b6a-82b5-a9703a67b934 tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:22.173514 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5d8c254c-1efd-4b6a-82b5-a9703a67b934 tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:22.177129 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5d8c254c-1efd-4b6a-82b5-a9703a67b934 tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:22.177616 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5d8c254c-1efd-4b6a-82b5-a9703a67b934 tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:22.193873 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-53560118-3a3c-48d7-a61f-5a33c378778f req-7dbb28cd-e72e-4062-b8bd-651fc6a3b783 service nova] Creating event network-vif-deleted:386c18e4-513b-4ac2-a469-5df264df0146 for instance e753b3c8-e63a-48d5-a349-fa19db134404 on nch1-master-1 Jul 23 21:19:22.207567 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-53560118-3a3c-48d7-a61f-5a33c378778f req-7dbb28cd-e72e-4062-b8bd-651fc6a3b783 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114239 Jul 23 21:19:22.213006 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 719/1409] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:19:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:19:22.232049 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1d0a19df-64a1-4ef8-ba69-2b17573f8aa8 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '.version_select at 0x7f0b4788e3a0>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:22.300871 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5d8c254c-1efd-4b6a-82b5-a9703a67b934 tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:22.301535 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5d8c254c-1efd-4b6a-82b5-a9703a67b934 tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:22.302729 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5d8c254c-1efd-4b6a-82b5-a9703a67b934 tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:22.303610 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5d8c254c-1efd-4b6a-82b5-a9703a67b934 tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:22.394621 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:19:22.471944 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-5d8c254c-1efd-4b6a-82b5-a9703a67b934 tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-quota-sets/ae9b2a25ba5f4a479a072b0be6f190c9?user_id=5e591c901f354665bc63703be5f2677c" status: 200 len: 240 microversion: 2.36 time: 0.613087 Jul 23 21:19:22.472854 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 691/1410] 10.222.0.17 () {62 vars in 1383 bytes} [Sat Jul 23 21:19:21 2022] PUT /compute/v2.1/os-quota-sets/ae9b2a25ba5f4a479a072b0be6f190c9?user_id=5e591c901f354665bc63703be5f2677c => generated 240 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 23 21:19:22.481921 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-1bbfd95b-20aa-4f9b-9bbb-3d72f713e1a4 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:22.498321 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-1bbfd95b-20aa-4f9b-9bbb-3d72f713e1a4 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: d1b84776-ab42-4b27-975d-1744b2935bb2] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:22.506965 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1bbfd95b-20aa-4f9b-9bbb-3d72f713e1a4 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:22.507524 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1bbfd95b-20aa-4f9b-9bbb-3d72f713e1a4 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:22.508207 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1bbfd95b-20aa-4f9b-9bbb-3d72f713e1a4 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:22.508644 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1bbfd95b-20aa-4f9b-9bbb-3d72f713e1a4 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:23.197805 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1d0a19df-64a1-4ef8-ba69-2b17573f8aa8 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "DELETE /compute/v2.1/images/0d3d0429-755c-441f-ab98-3c0bd09dd6af" status: 204 len: 0 microversion: 2.1 time: 0.980631 Jul 23 21:19:23.198555 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 720/1411] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:19:22 2022] DELETE /compute/v2.1/images/0d3d0429-755c-441f-ab98-3c0bd09dd6af => generated 0 bytes in 985 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:19:23.206371 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-60184c61-dcb9-4b22-8ba3-de9c7b55c190 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:23.207399 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-60184c61-dcb9-4b22-8ba3-de9c7b55c190 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] [instance: e753b3c8-e63a-48d5-a349-fa19db134404] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:23.224948 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-60184c61-dcb9-4b22-8ba3-de9c7b55c190 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:23.225419 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-60184c61-dcb9-4b22-8ba3-de9c7b55c190 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:23.226409 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-60184c61-dcb9-4b22-8ba3-de9c7b55c190 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:23.226882 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-60184c61-dcb9-4b22-8ba3-de9c7b55c190 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:23.262627 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-60184c61-dcb9-4b22-8ba3-de9c7b55c190 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] HTTP exception thrown: Instance e753b3c8-e63a-48d5-a349-fa19db134404 could not be found. Jul 23 21:19:23.265266 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-60184c61-dcb9-4b22-8ba3-de9c7b55c190 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Request method failure captured: Jul 23 21:19:23.265266 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/e753b3c8-e63a-48d5-a349-fa19db134404 HTTP/1.1 Jul 23 21:19:23.265266 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:19:23.265266 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:19:23.265266 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:19:23.265266 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:19:23.265266 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:19:23.265266 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:19:23.265266 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:19:23.265266 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:19:23.265266 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GVEO4EkmIFkIUPPSZuKCftrupJD20EN8UJxUVYN6R6JOEIB5WnZpHOHsKWjtljonhP8Cyavp2OlX2T_Pzqsn3Tz6i9pEdkfPMe9bSFoYDUix3Jvh77bSo2cG1ONxZ0hliLrx1LUa8BMtsjQ6zKd__l9TFe1C4_-nh1Vor_234DVRqg Jul 23 21:19:23.265266 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:19:23.265266 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:19:23.265266 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:19:23.265266 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:19:23.265266 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:19:23.265266 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:19:23.265266 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 3811ea868f5649e8a235539a5bf46706 Jul 23 21:19:23.265266 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-683239709 Jul 23 21:19:23.265266 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:19:23.265266 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:19:23.267523 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3811ea868f5649e8a235539a5bf46706"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3811ea868f5649e8a235539a5bf46706"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3811ea868f5649e8a235539a5bf46706", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3811ea868f5649e8a235539a5bf46706"}]}] Jul 23 21:19:23.267523 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-683239709 Jul 23 21:19:23.267523 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 3811ea868f5649e8a235539a5bf46706 Jul 23 21:19:23.267523 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-683239709 Jul 23 21:19:23.267523 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-AttachSCSIVolumeTestJSON-683239709-project Jul 23 21:19:23.267523 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:19:23.267523 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:19:23.267523 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: fe3ad614d9d24300adb274cc95120fd3 Jul 23 21:19:23.267523 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-683239709-project Jul 23 21:19:23.267523 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:19:23.267523 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance e753b3c8-e63a-48d5-a349-fa19db134404 could not be found. Jul 23 21:19:23.267523 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': 'e753b3c8-e63a-48d5-a349-fa19db134404'} Jul 23 21:19:23.268586 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:19:23.268586 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:19:23.268586 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:19:23.268586 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:19:23.268586 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:19:23.268586 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:19:23.268586 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:19:23.268586 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:19:23.268586 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:19:23.268586 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:19:23.268586 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e753b3c8-e63a-48d5-a349-fa19db134404 could not be found. Jul 23 21:19:23.268586 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:19:23.268586 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:19:23.268586 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:19:23.268586 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:19:23.268586 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:19:23.268586 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:19:23.268586 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:19:23.268586 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:19:23.268586 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:19:23.270020 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:19:23.270020 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:19:23.270020 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:19:23.270020 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:19:23.270020 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:19:23.270020 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:19:23.270020 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:19:23.270020 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e753b3c8-e63a-48d5-a349-fa19db134404 could not be found. Jul 23 21:19:23.270020 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:19:23.270020 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:19:23.270020 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:19:23.270020 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:19:23.270020 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:19:23.270020 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:19:23.270020 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:19:23.270020 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:19:23.270020 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e753b3c8-e63a-48d5-a349-fa19db134404 could not be found. Jul 23 21:19:23.270020 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:19:23.279078 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-60184c61-dcb9-4b22-8ba3-de9c7b55c190 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Returning 404 to user: Instance e753b3c8-e63a-48d5-a349-fa19db134404 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:19:23.280483 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-60184c61-dcb9-4b22-8ba3-de9c7b55c190 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] 10.222.0.17 "GET /compute/v2.1/servers/e753b3c8-e63a-48d5-a349-fa19db134404" status: 404 len: 111 microversion: 2.1 time: 0.080438 Jul 23 21:19:23.281239 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 721/1412] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:19:23 2022] GET /compute/v2.1/servers/e753b3c8-e63a-48d5-a349-fa19db134404 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:19:23.291000 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e9454206-9f23-4916-b7c7-d36e7ce2bd58 tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] Calling method '.version_select at 0x7f0b47bda1f0>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:23.451103 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e9454206-9f23-4916-b7c7-d36e7ce2bd58 tempest-QuotasAdminTestV236-576095878 tempest-QuotasAdminTestV236-576095878-project-admin] 10.222.0.17 "GET /compute/v2.1/os-quota-sets/ae9b2a25ba5f4a479a072b0be6f190c9?user_id=5e591c901f354665bc63703be5f2677c" status: 200 len: 282 microversion: 2.36 time: 0.168095 Jul 23 21:19:23.452316 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 722/1413] 10.222.0.17 () {60 vars in 1363 bytes} [Sat Jul 23 21:19:23 2022] GET /compute/v2.1/os-quota-sets/ae9b2a25ba5f4a479a072b0be6f190c9?user_id=5e591c901f354665bc63703be5f2677c => generated 282 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 23 21:19:23.461219 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c94ae511-5c2e-48fa-8b58-e7f4e6dff263 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:23.462172 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c94ae511-5c2e-48fa-8b58-e7f4e6dff263 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: 214b4d99-34d8-48c7-924c-27cd2f6712e7] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:23.470776 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c94ae511-5c2e-48fa-8b58-e7f4e6dff263 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:23.471689 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c94ae511-5c2e-48fa-8b58-e7f4e6dff263 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:23.472870 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c94ae511-5c2e-48fa-8b58-e7f4e6dff263 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:23.473639 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c94ae511-5c2e-48fa-8b58-e7f4e6dff263 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:23.507455 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-1bbfd95b-20aa-4f9b-9bbb-3d72f713e1a4 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:23.520378 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-1bbfd95b-20aa-4f9b-9bbb-3d72f713e1a4 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2" status: 200 len: 1468 microversion: 2.1 time: 1.046264 Jul 23 21:19:23.530490 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 692/1414] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:19:22 2022] GET /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2 => generated 1468 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:19:23.545971 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-468ad2dd-1fad-4b7f-9434-07f780b462fb tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:23.548794 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-468ad2dd-1fad-4b7f-9434-07f780b462fb tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] [instance: f53ce882-4694-421d-8075-5e8cfab0b16f] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:23.569420 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-468ad2dd-1fad-4b7f-9434-07f780b462fb tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:23.570191 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-468ad2dd-1fad-4b7f-9434-07f780b462fb tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:23.571056 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-468ad2dd-1fad-4b7f-9434-07f780b462fb tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:23.574474 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-468ad2dd-1fad-4b7f-9434-07f780b462fb tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:23.735715 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c94ae511-5c2e-48fa-8b58-e7f4e6dff263 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:23.746908 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c94ae511-5c2e-48fa-8b58-e7f4e6dff263 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:23.749298 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c94ae511-5c2e-48fa-8b58-e7f4e6dff263 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:23.751773 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c94ae511-5c2e-48fa-8b58-e7f4e6dff263 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/214b4d99-34d8-48c7-924c-27cd2f6712e7" status: 200 len: 1281 microversion: 2.25 time: 0.298133 Jul 23 21:19:23.752671 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 723/1415] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:19:23 2022] GET /compute/v2.1/servers/214b4d99-34d8-48c7-924c-27cd2f6712e7 => generated 1281 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:19:23.762151 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e05a3990-a38a-412c-a46b-0b9993a47853 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:23.771290 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e05a3990-a38a-412c-a46b-0b9993a47853 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 784e1fb4-876e-489f-9428-e01412642663] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:23.787831 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e05a3990-a38a-412c-a46b-0b9993a47853 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:23.788289 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e05a3990-a38a-412c-a46b-0b9993a47853 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:23.789140 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e05a3990-a38a-412c-a46b-0b9993a47853 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:23.789620 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e05a3990-a38a-412c-a46b-0b9993a47853 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:23.963193 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-468ad2dd-1fad-4b7f-9434-07f780b462fb tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145e518288ce4d70a12a3f2cc6a91810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f220ba2f42db435a818f3e462aea35a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:23.988631 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-468ad2dd-1fad-4b7f-9434-07f780b462fb tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] 10.222.0.17 "GET /compute/v2.1/servers/f53ce882-4694-421d-8075-5e8cfab0b16f" status: 200 len: 1367 microversion: 2.1 time: 0.456787 Jul 23 21:19:23.992659 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 693/1416] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:19:23 2022] GET /compute/v2.1/servers/f53ce882-4694-421d-8075-5e8cfab0b16f => generated 1367 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:19:23.997477 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-3f6c9fd4-2b92-4c2f-951d-608d872c94bd req-a3a0feca-0710-4a77-a0e2-e620bce68889 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f54269a-e144-4b5d-9b78-39120b28e545", "name": "network-vif-unplugged", "status": "completed", "tag": "cb8b469c-a568-415a-85b4-07644be9af70"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:19:24.034813 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-3f6c9fd4-2b92-4c2f-951d-608d872c94bd req-a3a0feca-0710-4a77-a0e2-e620bce68889 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:24.035356 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-3f6c9fd4-2b92-4c2f-951d-608d872c94bd req-a3a0feca-0710-4a77-a0e2-e620bce68889 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:24.060519 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-3f6c9fd4-2b92-4c2f-951d-608d872c94bd req-a3a0feca-0710-4a77-a0e2-e620bce68889 service nova] Creating event network-vif-unplugged:cb8b469c-a568-415a-85b4-07644be9af70 for instance 6f54269a-e144-4b5d-9b78-39120b28e545 on nch2-master-1 Jul 23 21:19:24.073323 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-3f6c9fd4-2b92-4c2f-951d-608d872c94bd req-a3a0feca-0710-4a77-a0e2-e620bce68889 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079160 Jul 23 21:19:24.077526 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 694/1417] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:19:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:19:24.083696 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-aec95da5-5148-4d15-826f-01af04454b23 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:24.084292 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-aec95da5-5148-4d15-826f-01af04454b23 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 6f54269a-e144-4b5d-9b78-39120b28e545] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:24.099220 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-aec95da5-5148-4d15-826f-01af04454b23 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:24.099703 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-aec95da5-5148-4d15-826f-01af04454b23 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:24.100497 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-aec95da5-5148-4d15-826f-01af04454b23 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:24.100942 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-aec95da5-5148-4d15-826f-01af04454b23 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:24.178491 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-aec95da5-5148-4d15-826f-01af04454b23 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 6f54269a-e144-4b5d-9b78-39120b28e545] Going to try to terminate instance {{(pid=131321) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:19:24.245537 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:19:24.304071 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e05a3990-a38a-412c-a46b-0b9993a47853 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:24.315192 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e05a3990-a38a-412c-a46b-0b9993a47853 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/784e1fb4-876e-489f-9428-e01412642663" status: 200 len: 1198 microversion: 2.1 time: 0.559900 Jul 23 21:19:24.318424 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-aec95da5-5148-4d15-826f-01af04454b23 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "DELETE /compute/v2.1/servers/6f54269a-e144-4b5d-9b78-39120b28e545" status: 204 len: 0 microversion: 2.1 time: 0.239019 Jul 23 21:19:24.319707 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 695/1418] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:19:24 2022] DELETE /compute/v2.1/servers/6f54269a-e144-4b5d-9b78-39120b28e545 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:19:24.337273 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 724/1419] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:19:23 2022] GET /compute/v2.1/servers/784e1fb4-876e-489f-9428-e01412642663 => generated 1198 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:19:24.338819 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f6afde69-2039-45a9-badb-10461f49558f tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Calling method '.version_select at 0x7f0b47ceab80>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:24.365457 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-c7f18ea7-a3af-4aa5-a72b-8ef73c43c59a req-3872dd7f-6c6f-46af-a037-531907a81a79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "214b4d99-34d8-48c7-924c-27cd2f6712e7", "tag": "a741c39b-97c1-40b2-8530-cc020cd5f926"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:19:24.392055 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-f6afde69-2039-45a9-badb-10461f49558f tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-252562887" status: 202 len: 0 microversion: 2.1 time: 0.067491 Jul 23 21:19:24.392978 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 696/1420] 10.222.0.17 () {58 vars in 1217 bytes} [Sat Jul 23 21:19:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-252562887 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:19:24.424565 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-c7f18ea7-a3af-4aa5-a72b-8ef73c43c59a req-3872dd7f-6c6f-46af-a037-531907a81a79 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:24.425000 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-c7f18ea7-a3af-4aa5-a72b-8ef73c43c59a req-3872dd7f-6c6f-46af-a037-531907a81a79 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:24.453212 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-c7f18ea7-a3af-4aa5-a72b-8ef73c43c59a req-3872dd7f-6c6f-46af-a037-531907a81a79 service nova] Creating event network-changed:a741c39b-97c1-40b2-8530-cc020cd5f926 for instance 214b4d99-34d8-48c7-924c-27cd2f6712e7 on nch2-master-1 Jul 23 21:19:24.492508 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-c7f18ea7-a3af-4aa5-a72b-8ef73c43c59a req-3872dd7f-6c6f-46af-a037-531907a81a79 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145481 Jul 23 21:19:24.493225 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 725/1421] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:19:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:19:24.545589 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-1216ee22-c23c-433c-9006-aa04b0506abe tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:24.547109 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-1216ee22-c23c-433c-9006-aa04b0506abe tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: d1b84776-ab42-4b27-975d-1744b2935bb2] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:24.560369 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1216ee22-c23c-433c-9006-aa04b0506abe tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:24.561010 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1216ee22-c23c-433c-9006-aa04b0506abe tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:24.562873 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1216ee22-c23c-433c-9006-aa04b0506abe tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:24.566073 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1216ee22-c23c-433c-9006-aa04b0506abe tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:24.619681 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-85a9f989-d36d-45a0-93b3-3c4c9726b0d1 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1428569107", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "networks": [{"uuid": "472a8f36-7623-4bc7-b732-b31d10b9dfde"}]}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:19:24.760491 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-85a9f989-d36d-45a0-93b3-3c4c9726b0d1 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] validate_networks() for [('472a8f36-7623-4bc7-b732-b31d10b9dfde', None, None, None, None, None)] {{(pid=131320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:19:25.107550 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-1216ee22-c23c-433c-9006-aa04b0506abe tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:25.131796 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-1216ee22-c23c-433c-9006-aa04b0506abe tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2" status: 200 len: 1468 microversion: 2.1 time: 0.594637 Jul 23 21:19:25.140494 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 697/1422] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:19:24 2022] GET /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2 => generated 1468 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:19:25.161814 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-6a5e939a-8732-4761-83c0-70833321df59 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:25.162469 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-6a5e939a-8732-4761-83c0-70833321df59 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: 214b4d99-34d8-48c7-924c-27cd2f6712e7] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:25.186075 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6a5e939a-8732-4761-83c0-70833321df59 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:25.186924 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6a5e939a-8732-4761-83c0-70833321df59 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:25.191556 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6a5e939a-8732-4761-83c0-70833321df59 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:25.197814 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6a5e939a-8732-4761-83c0-70833321df59 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:25.458851 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-6a5e939a-8732-4761-83c0-70833321df59 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:25.470967 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-6a5e939a-8732-4761-83c0-70833321df59 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:25.476121 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-6a5e939a-8732-4761-83c0-70833321df59 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:25.479232 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-6a5e939a-8732-4761-83c0-70833321df59 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/214b4d99-34d8-48c7-924c-27cd2f6712e7" status: 200 len: 1281 microversion: 2.25 time: 0.337748 Jul 23 21:19:25.481203 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 698/1423] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:19:25 2022] GET /compute/v2.1/servers/214b4d99-34d8-48c7-924c-27cd2f6712e7 => generated 1281 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:19:25.496404 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-8aa82a26-2ed3-440f-bf90-b89003f63a2c tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:25.497578 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-8aa82a26-2ed3-440f-bf90-b89003f63a2c tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] [instance: f53ce882-4694-421d-8075-5e8cfab0b16f] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:25.511515 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8aa82a26-2ed3-440f-bf90-b89003f63a2c tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:25.513687 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8aa82a26-2ed3-440f-bf90-b89003f63a2c tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:25.517668 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8aa82a26-2ed3-440f-bf90-b89003f63a2c tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:25.518324 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8aa82a26-2ed3-440f-bf90-b89003f63a2c tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:25.886235 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-8aa82a26-2ed3-440f-bf90-b89003f63a2c tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145e518288ce4d70a12a3f2cc6a91810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f220ba2f42db435a818f3e462aea35a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:25.902650 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-8aa82a26-2ed3-440f-bf90-b89003f63a2c tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] 10.222.0.17 "GET /compute/v2.1/servers/f53ce882-4694-421d-8075-5e8cfab0b16f" status: 200 len: 1367 microversion: 2.1 time: 0.418566 Jul 23 21:19:25.903446 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 699/1424] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:19:25 2022] GET /compute/v2.1/servers/f53ce882-4694-421d-8075-5e8cfab0b16f => generated 1367 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:19:25.917570 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ebe4ce76-9b13-40b5-b913-5e14915fd79b tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:25.918538 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-ebe4ce76-9b13-40b5-b913-5e14915fd79b tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 784e1fb4-876e-489f-9428-e01412642663] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:25.925253 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ebe4ce76-9b13-40b5-b913-5e14915fd79b tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:25.925985 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ebe4ce76-9b13-40b5-b913-5e14915fd79b tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:25.926922 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ebe4ce76-9b13-40b5-b913-5e14915fd79b tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:25.927508 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ebe4ce76-9b13-40b5-b913-5e14915fd79b tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:26.262167 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-85a9f989-d36d-45a0-93b3-3c4c9726b0d1 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:19:26.263288 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-85a9f989-d36d-45a0-93b3-3c4c9726b0d1 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:19:26.263930 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-85a9f989-d36d-45a0-93b3-3c4c9726b0d1 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:19:26.264497 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-85a9f989-d36d-45a0-93b3-3c4c9726b0d1 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:19:26.265067 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-85a9f989-d36d-45a0-93b3-3c4c9726b0d1 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:19:26.274578 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-85a9f989-d36d-45a0-93b3-3c4c9726b0d1 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:26.275523 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-85a9f989-d36d-45a0-93b3-3c4c9726b0d1 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:26.277056 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-85a9f989-d36d-45a0-93b3-3c4c9726b0d1 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:26.277679 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-85a9f989-d36d-45a0-93b3-3c4c9726b0d1 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:26.297710 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-85a9f989-d36d-45a0-93b3-3c4c9726b0d1 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Getting quotas for project 580ed681cbf44d10936259b17f60f1b2. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:19:26.303073 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-85a9f989-d36d-45a0-93b3-3c4c9726b0d1 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Getting quotas for user bb4f9dda4c2a411cb0394bf86e9ae223 and project 580ed681cbf44d10936259b17f60f1b2. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:19:26.313287 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:19:26.317367 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-85a9f989-d36d-45a0-93b3-3c4c9726b0d1 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Going to run 1 instances... {{(pid=131320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:19:26.319828 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-85a9f989-d36d-45a0-93b3-3c4c9726b0d1 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 080674a1-a720-4058-b74a-79bb1a61f5b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:19:26.368158 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-85a9f989-d36d-45a0-93b3-3c4c9726b0d1 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.754420 Jul 23 21:19:26.368837 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 726/1425] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:19:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1756 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 23 21:19:26.373804 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b4ca9c52-0073-4ecf-a94a-88e587b0c699 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:26.374465 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b4ca9c52-0073-4ecf-a94a-88e587b0c699 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: d1b84776-ab42-4b27-975d-1744b2935bb2] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:26.394183 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b4ca9c52-0073-4ecf-a94a-88e587b0c699 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:26.394822 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b4ca9c52-0073-4ecf-a94a-88e587b0c699 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:26.397197 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b4ca9c52-0073-4ecf-a94a-88e587b0c699 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:26.398120 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b4ca9c52-0073-4ecf-a94a-88e587b0c699 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:26.420079 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ebe4ce76-9b13-40b5-b913-5e14915fd79b tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:26.426199 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:19:26.428793 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-ebe4ce76-9b13-40b5-b913-5e14915fd79b tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/784e1fb4-876e-489f-9428-e01412642663" status: 200 len: 1198 microversion: 2.1 time: 0.524295 Jul 23 21:19:26.442194 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 700/1426] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:19:25 2022] GET /compute/v2.1/servers/784e1fb4-876e-489f-9428-e01412642663 => generated 1198 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:19:26.447393 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-0d042abf-2d20-4c5f-ae48-81a96678f189 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:26.448012 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-0d042abf-2d20-4c5f-ae48-81a96678f189 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 080674a1-a720-4058-b74a-79bb1a61f5b1] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:26.645739 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-0d042abf-2d20-4c5f-ae48-81a96678f189 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4f9dda4c2a411cb0394bf86e9ae223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580ed681cbf44d10936259b17f60f1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:26.648598 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell0:SELECT=39 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:19:26.661682 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-0d042abf-2d20-4c5f-ae48-81a96678f189 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/servers/080674a1-a720-4058-b74a-79bb1a61f5b1" status: 200 len: 1208 microversion: 2.1 time: 0.216357 Jul 23 21:19:26.663452 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 701/1427] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:19:26 2022] GET /compute/v2.1/servers/080674a1-a720-4058-b74a-79bb1a61f5b1 => generated 1208 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:19:26.675189 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-9b8b770c-d504-4bb8-b99f-b3e16646eeb6 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:26.678603 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-9b8b770c-d504-4bb8-b99f-b3e16646eeb6 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: 214b4d99-34d8-48c7-924c-27cd2f6712e7] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:26.692409 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9b8b770c-d504-4bb8-b99f-b3e16646eeb6 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:26.694390 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9b8b770c-d504-4bb8-b99f-b3e16646eeb6 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:26.695361 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9b8b770c-d504-4bb8-b99f-b3e16646eeb6 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:26.696356 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9b8b770c-d504-4bb8-b99f-b3e16646eeb6 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:26.912868 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b4ca9c52-0073-4ecf-a94a-88e587b0c699 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:26.936065 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b4ca9c52-0073-4ecf-a94a-88e587b0c699 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2" status: 200 len: 1468 microversion: 2.1 time: 0.562030 Jul 23 21:19:26.938813 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 727/1428] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:19:26 2022] GET /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2 => generated 1468 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:19:26.955538 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-62fb3112-7fb2-45be-9b09-948c8b3714d7 req-2c8c4227-2c22-40db-bc3c-aa17f1733412 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f53ce882-4694-421d-8075-5e8cfab0b16f", "tag": "d1c78feb-5b33-44db-b1bd-998523c96ac3"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:19:26.988101 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-62fb3112-7fb2-45be-9b09-948c8b3714d7 req-2c8c4227-2c22-40db-bc3c-aa17f1733412 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:26.991756 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-62fb3112-7fb2-45be-9b09-948c8b3714d7 req-2c8c4227-2c22-40db-bc3c-aa17f1733412 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:27.024409 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-62fb3112-7fb2-45be-9b09-948c8b3714d7 req-2c8c4227-2c22-40db-bc3c-aa17f1733412 service nova] Creating event network-changed:d1c78feb-5b33-44db-b1bd-998523c96ac3 for instance f53ce882-4694-421d-8075-5e8cfab0b16f on nch1-master-1 Jul 23 21:19:27.038549 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-62fb3112-7fb2-45be-9b09-948c8b3714d7 req-2c8c4227-2c22-40db-bc3c-aa17f1733412 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096132 Jul 23 21:19:27.039842 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 728/1429] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:19:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:19:27.070107 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-9446e0d6-27a8-4214-9438-15f24043c6f3 req-040e4a80-1f69-40d8-bff6-315fb5c6f99c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "214b4d99-34d8-48c7-924c-27cd2f6712e7", "name": "network-vif-plugged", "status": "completed", "tag": "a741c39b-97c1-40b2-8530-cc020cd5f926"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:19:27.093829 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-9446e0d6-27a8-4214-9438-15f24043c6f3 req-040e4a80-1f69-40d8-bff6-315fb5c6f99c service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:27.101707 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-9446e0d6-27a8-4214-9438-15f24043c6f3 req-040e4a80-1f69-40d8-bff6-315fb5c6f99c service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:27.130809 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-9446e0d6-27a8-4214-9438-15f24043c6f3 req-040e4a80-1f69-40d8-bff6-315fb5c6f99c service nova] Creating event network-vif-plugged:a741c39b-97c1-40b2-8530-cc020cd5f926 for instance 214b4d99-34d8-48c7-924c-27cd2f6712e7 on nch2-master-1 Jul 23 21:19:27.139051 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-9446e0d6-27a8-4214-9438-15f24043c6f3 req-040e4a80-1f69-40d8-bff6-315fb5c6f99c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088647 Jul 23 21:19:27.139657 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 729/1430] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:19:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:19:27.162132 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-539c74ee-bb1b-4156-adac-4421c6eed9b7 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:27.164576 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-539c74ee-bb1b-4156-adac-4421c6eed9b7 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] [instance: f53ce882-4694-421d-8075-5e8cfab0b16f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:27.183095 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-539c74ee-bb1b-4156-adac-4421c6eed9b7 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:27.184535 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-539c74ee-bb1b-4156-adac-4421c6eed9b7 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:27.187685 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-539c74ee-bb1b-4156-adac-4421c6eed9b7 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:27.188515 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-539c74ee-bb1b-4156-adac-4421c6eed9b7 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:27.394628 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-9b8b770c-d504-4bb8-b99f-b3e16646eeb6 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:27.411849 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-9b8b770c-d504-4bb8-b99f-b3e16646eeb6 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:27.416614 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-9b8b770c-d504-4bb8-b99f-b3e16646eeb6 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:27.422210 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-9b8b770c-d504-4bb8-b99f-b3e16646eeb6 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/214b4d99-34d8-48c7-924c-27cd2f6712e7" status: 200 len: 1281 microversion: 2.25 time: 0.755762 Jul 23 21:19:27.425601 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 702/1431] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:19:26 2022] GET /compute/v2.1/servers/214b4d99-34d8-48c7-924c-27cd2f6712e7 => generated 1281 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:19:27.449532 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ecd4044b-b8b1-4290-a248-fe6887e3a85d tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:27.450788 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-ecd4044b-b8b1-4290-a248-fe6887e3a85d tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 784e1fb4-876e-489f-9428-e01412642663] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:27.468692 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ecd4044b-b8b1-4290-a248-fe6887e3a85d tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:27.469279 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ecd4044b-b8b1-4290-a248-fe6887e3a85d tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:27.470124 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ecd4044b-b8b1-4290-a248-fe6887e3a85d tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:27.471175 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ecd4044b-b8b1-4290-a248-fe6887e3a85d tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:27.868055 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ecd4044b-b8b1-4290-a248-fe6887e3a85d tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:27.883066 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-ecd4044b-b8b1-4290-a248-fe6887e3a85d tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/784e1fb4-876e-489f-9428-e01412642663" status: 200 len: 1198 microversion: 2.1 time: 0.438758 Jul 23 21:19:27.884098 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 703/1432] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:19:27 2022] GET /compute/v2.1/servers/784e1fb4-876e-489f-9428-e01412642663 => generated 1198 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:19:27.889756 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-57cdec40-470a-40c9-8b0d-40bfe5585857 req-62c92794-4f75-498c-942c-cf4f797ff64f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1b84776-ab42-4b27-975d-1744b2935bb2", "name": "network-vif-unplugged", "status": "completed", "tag": "75148d97-06cd-4836-97fd-6cce38566d93"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:19:27.908798 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-57cdec40-470a-40c9-8b0d-40bfe5585857 req-62c92794-4f75-498c-942c-cf4f797ff64f service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:27.910558 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-57cdec40-470a-40c9-8b0d-40bfe5585857 req-62c92794-4f75-498c-942c-cf4f797ff64f service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:27.929512 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-57cdec40-470a-40c9-8b0d-40bfe5585857 req-62c92794-4f75-498c-942c-cf4f797ff64f service nova] Creating event network-vif-unplugged:75148d97-06cd-4836-97fd-6cce38566d93 for instance d1b84776-ab42-4b27-975d-1744b2935bb2 on nch2-master-1 Jul 23 21:19:27.941943 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [req-57cdec40-470a-40c9-8b0d-40bfe5585857 req-62c92794-4f75-498c-942c-cf4f797ff64f service nova] Instance d1b84776-ab42-4b27-975d-1744b2935bb2 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=131321) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 23 21:19:27.959641 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-57cdec40-470a-40c9-8b0d-40bfe5585857 req-62c92794-4f75-498c-942c-cf4f797ff64f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.073666 Jul 23 21:19:27.970611 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 704/1433] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:19:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:19:27.978882 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-469c49bc-ce10-48b8-a98d-36f1214ae71a tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:27.980008 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-469c49bc-ce10-48b8-a98d-36f1214ae71a tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 080674a1-a720-4058-b74a-79bb1a61f5b1] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:28.003531 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-469c49bc-ce10-48b8-a98d-36f1214ae71a tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:28.006055 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-469c49bc-ce10-48b8-a98d-36f1214ae71a tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:28.007090 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-469c49bc-ce10-48b8-a98d-36f1214ae71a tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:28.007681 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-469c49bc-ce10-48b8-a98d-36f1214ae71a tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:28.017542 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-539c74ee-bb1b-4156-adac-4421c6eed9b7 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145e518288ce4d70a12a3f2cc6a91810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f220ba2f42db435a818f3e462aea35a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:28.029582 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-539c74ee-bb1b-4156-adac-4421c6eed9b7 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] 10.222.0.17 "GET /compute/v2.1/servers/f53ce882-4694-421d-8075-5e8cfab0b16f" status: 200 len: 1367 microversion: 2.1 time: 0.888340 Jul 23 21:19:28.029969 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 730/1434] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:19:27 2022] GET /compute/v2.1/servers/f53ce882-4694-421d-8075-5e8cfab0b16f => generated 1367 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:19:28.046778 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-14c79f72-462d-4a02-9989-24d09ea8b73e tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:28.047981 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-14c79f72-462d-4a02-9989-24d09ea8b73e tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: d1b84776-ab42-4b27-975d-1744b2935bb2] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:28.056312 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-14c79f72-462d-4a02-9989-24d09ea8b73e tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:28.057366 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-14c79f72-462d-4a02-9989-24d09ea8b73e tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:28.058648 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-14c79f72-462d-4a02-9989-24d09ea8b73e tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:28.059654 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-14c79f72-462d-4a02-9989-24d09ea8b73e tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:28.172268 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-469c49bc-ce10-48b8-a98d-36f1214ae71a tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4f9dda4c2a411cb0394bf86e9ae223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580ed681cbf44d10936259b17f60f1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:28.184113 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-469c49bc-ce10-48b8-a98d-36f1214ae71a tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/servers/080674a1-a720-4058-b74a-79bb1a61f5b1" status: 200 len: 1260 microversion: 2.1 time: 0.211548 Jul 23 21:19:28.185777 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 705/1435] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:19:27 2022] GET /compute/v2.1/servers/080674a1-a720-4058-b74a-79bb1a61f5b1 => generated 1260 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:19:28.451675 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-61fe0e91-63e7-4acb-a5d3-1a30ae86d81f tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:28.452653 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-61fe0e91-63e7-4acb-a5d3-1a30ae86d81f tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: 214b4d99-34d8-48c7-924c-27cd2f6712e7] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:28.463198 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-61fe0e91-63e7-4acb-a5d3-1a30ae86d81f tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:28.471325 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-61fe0e91-63e7-4acb-a5d3-1a30ae86d81f tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:28.472388 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-61fe0e91-63e7-4acb-a5d3-1a30ae86d81f tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:28.478331 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-61fe0e91-63e7-4acb-a5d3-1a30ae86d81f tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:28.669730 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-14c79f72-462d-4a02-9989-24d09ea8b73e tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:28.686340 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-14c79f72-462d-4a02-9989-24d09ea8b73e tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2" status: 200 len: 1468 microversion: 2.1 time: 0.643304 Jul 23 21:19:28.686937 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 731/1436] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:19:28 2022] GET /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2 => generated 1468 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:19:28.867274 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-61fe0e91-63e7-4acb-a5d3-1a30ae86d81f tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:28.882639 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-61fe0e91-63e7-4acb-a5d3-1a30ae86d81f tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:28.884558 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-61fe0e91-63e7-4acb-a5d3-1a30ae86d81f tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:28.886116 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-61fe0e91-63e7-4acb-a5d3-1a30ae86d81f tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/214b4d99-34d8-48c7-924c-27cd2f6712e7" status: 200 len: 1281 microversion: 2.25 time: 0.448042 Jul 23 21:19:28.887564 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 706/1437] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:19:28 2022] GET /compute/v2.1/servers/214b4d99-34d8-48c7-924c-27cd2f6712e7 => generated 1281 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:19:28.901439 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-be9f69c2-891e-44be-9f3c-172e5b1fb490 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:28.903036 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-be9f69c2-891e-44be-9f3c-172e5b1fb490 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 784e1fb4-876e-489f-9428-e01412642663] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:28.913019 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-be9f69c2-891e-44be-9f3c-172e5b1fb490 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:28.914067 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-be9f69c2-891e-44be-9f3c-172e5b1fb490 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:28.915140 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-be9f69c2-891e-44be-9f3c-172e5b1fb490 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:28.916010 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-be9f69c2-891e-44be-9f3c-172e5b1fb490 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:29.047864 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e1e088ce-7c12-4f65-8385-bcd46be55d4e tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:29.049041 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-e1e088ce-7c12-4f65-8385-bcd46be55d4e tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] [instance: f53ce882-4694-421d-8075-5e8cfab0b16f] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:29.077543 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e1e088ce-7c12-4f65-8385-bcd46be55d4e tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:29.078811 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e1e088ce-7c12-4f65-8385-bcd46be55d4e tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:29.086474 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e1e088ce-7c12-4f65-8385-bcd46be55d4e tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:29.091585 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e1e088ce-7c12-4f65-8385-bcd46be55d4e tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:29.628559 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-e1e088ce-7c12-4f65-8385-bcd46be55d4e tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145e518288ce4d70a12a3f2cc6a91810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f220ba2f42db435a818f3e462aea35a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:29.641597 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-e1e088ce-7c12-4f65-8385-bcd46be55d4e tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] 10.222.0.17 "GET /compute/v2.1/servers/f53ce882-4694-421d-8075-5e8cfab0b16f" status: 200 len: 1367 microversion: 2.1 time: 0.598123 Jul 23 21:19:29.642722 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 707/1438] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:19:29 2022] GET /compute/v2.1/servers/f53ce882-4694-421d-8075-5e8cfab0b16f => generated 1367 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:19:29.649844 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-eec28df7-539a-4652-8416-11ef384101e7 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:29.651139 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-eec28df7-539a-4652-8416-11ef384101e7 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 080674a1-a720-4058-b74a-79bb1a61f5b1] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:29.663097 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-eec28df7-539a-4652-8416-11ef384101e7 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:29.681554 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-eec28df7-539a-4652-8416-11ef384101e7 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:29.686862 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-eec28df7-539a-4652-8416-11ef384101e7 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:29.688891 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-eec28df7-539a-4652-8416-11ef384101e7 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:29.852853 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-eec28df7-539a-4652-8416-11ef384101e7 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4f9dda4c2a411cb0394bf86e9ae223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580ed681cbf44d10936259b17f60f1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:29.862763 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-eec28df7-539a-4652-8416-11ef384101e7 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/servers/080674a1-a720-4058-b74a-79bb1a61f5b1" status: 200 len: 1266 microversion: 2.1 time: 0.218576 Jul 23 21:19:29.863367 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 708/1439] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:19:29 2022] GET /compute/v2.1/servers/080674a1-a720-4058-b74a-79bb1a61f5b1 => generated 1266 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:19:29.877852 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-0e2f72f0-ba3e-47f3-9d77-0051b2877f81 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:29.881371 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-0e2f72f0-ba3e-47f3-9d77-0051b2877f81 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: d1b84776-ab42-4b27-975d-1744b2935bb2] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:29.894807 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0e2f72f0-ba3e-47f3-9d77-0051b2877f81 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:29.895744 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0e2f72f0-ba3e-47f3-9d77-0051b2877f81 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:29.899926 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0e2f72f0-ba3e-47f3-9d77-0051b2877f81 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:29.900799 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0e2f72f0-ba3e-47f3-9d77-0051b2877f81 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:30.240161 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-be9f69c2-891e-44be-9f3c-172e5b1fb490 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:30.248324 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-be9f69c2-891e-44be-9f3c-172e5b1fb490 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/784e1fb4-876e-489f-9428-e01412642663" status: 200 len: 1198 microversion: 2.1 time: 1.351385 Jul 23 21:19:30.258457 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 732/1440] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:19:28 2022] GET /compute/v2.1/servers/784e1fb4-876e-489f-9428-e01412642663 => generated 1198 bytes in 1362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:19:30.265003 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-72f3b9fd-1ddc-479e-9eb8-56682866f842 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:30.265718 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-72f3b9fd-1ddc-479e-9eb8-56682866f842 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] [instance: e753b3c8-e63a-48d5-a349-fa19db134404] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:30.273920 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-72f3b9fd-1ddc-479e-9eb8-56682866f842 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:30.274696 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-72f3b9fd-1ddc-479e-9eb8-56682866f842 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:30.275673 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-72f3b9fd-1ddc-479e-9eb8-56682866f842 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:30.276270 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-72f3b9fd-1ddc-479e-9eb8-56682866f842 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:30.307172 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-72f3b9fd-1ddc-479e-9eb8-56682866f842 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] HTTP exception thrown: Instance e753b3c8-e63a-48d5-a349-fa19db134404 could not be found. Jul 23 21:19:30.308961 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-72f3b9fd-1ddc-479e-9eb8-56682866f842 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Request method failure captured: Jul 23 21:19:30.308961 ncdv-master-1 devstack@n-api.service[131320]: request: DELETE /compute/v2.1/servers/e753b3c8-e63a-48d5-a349-fa19db134404 HTTP/1.1 Jul 23 21:19:30.308961 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:19:30.308961 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:19:30.308961 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:19:30.308961 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:19:30.308961 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:19:30.308961 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:19:30.308961 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:19:30.308961 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:19:30.308961 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GVEO4EkmIFkIUPPSZuKCftrupJD20EN8UJxUVYN6R6JOEIB5WnZpHOHsKWjtljonhP8Cyavp2OlX2T_Pzqsn3Tz6i9pEdkfPMe9bSFoYDUix3Jvh77bSo2cG1ONxZ0hliLrx1LUa8BMtsjQ6zKd__l9TFe1C4_-nh1Vor_234DVRqg Jul 23 21:19:30.308961 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:19:30.308961 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:19:30.308961 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:19:30.308961 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:19:30.308961 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:19:30.308961 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:19:30.308961 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 3811ea868f5649e8a235539a5bf46706 Jul 23 21:19:30.308961 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-683239709 Jul 23 21:19:30.308961 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:19:30.308961 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:19:30.311066 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3811ea868f5649e8a235539a5bf46706"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3811ea868f5649e8a235539a5bf46706"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3811ea868f5649e8a235539a5bf46706", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3811ea868f5649e8a235539a5bf46706"}]}] Jul 23 21:19:30.311066 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-683239709 Jul 23 21:19:30.311066 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 3811ea868f5649e8a235539a5bf46706 Jul 23 21:19:30.311066 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-683239709 Jul 23 21:19:30.311066 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-AttachSCSIVolumeTestJSON-683239709-project Jul 23 21:19:30.311066 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:19:30.311066 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:19:30.311066 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: fe3ad614d9d24300adb274cc95120fd3 Jul 23 21:19:30.311066 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-683239709-project Jul 23 21:19:30.311066 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:19:30.311066 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance e753b3c8-e63a-48d5-a349-fa19db134404 could not be found. Jul 23 21:19:30.311066 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': 'e753b3c8-e63a-48d5-a349-fa19db134404'} Jul 23 21:19:30.312000 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:19:30.312000 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:19:30.312000 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:19:30.312000 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:19:30.312000 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:19:30.312000 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:19:30.312000 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:19:30.312000 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:19:30.312000 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:19:30.312000 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:19:30.312000 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e753b3c8-e63a-48d5-a349-fa19db134404 could not be found. Jul 23 21:19:30.312000 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:19:30.312000 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:19:30.312000 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:19:30.312000 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:19:30.312000 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:19:30.312000 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:19:30.312000 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:19:30.312000 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:19:30.312000 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:19:30.313583 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:19:30.313583 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 23 21:19:30.313583 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 23 21:19:30.313583 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 23 21:19:30.313583 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 23 21:19:30.313583 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:19:30.313583 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:19:30.313583 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:19:30.313583 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:19:30.313583 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e753b3c8-e63a-48d5-a349-fa19db134404 could not be found. Jul 23 21:19:30.313583 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:19:30.313583 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:19:30.313583 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:19:30.313583 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:19:30.313583 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:19:30.313583 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:19:30.313583 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:19:30.313583 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:19:30.313583 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e753b3c8-e63a-48d5-a349-fa19db134404 could not be found. Jul 23 21:19:30.313583 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:19:30.319580 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-72f3b9fd-1ddc-479e-9eb8-56682866f842 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Returning 404 to user: Instance e753b3c8-e63a-48d5-a349-fa19db134404 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:19:30.320468 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-72f3b9fd-1ddc-479e-9eb8-56682866f842 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] 10.222.0.17 "DELETE /compute/v2.1/servers/e753b3c8-e63a-48d5-a349-fa19db134404" status: 404 len: 111 microversion: 2.1 time: 0.060691 Jul 23 21:19:30.321051 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 733/1441] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:19:30 2022] DELETE /compute/v2.1/servers/e753b3c8-e63a-48d5-a349-fa19db134404 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:19:30.339953 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-27ef42f2-5441-4c75-b487-867b7f813bfc tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:30.340573 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-27ef42f2-5441-4c75-b487-867b7f813bfc tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: 214b4d99-34d8-48c7-924c-27cd2f6712e7] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:30.347287 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-27ef42f2-5441-4c75-b487-867b7f813bfc tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:30.347738 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-27ef42f2-5441-4c75-b487-867b7f813bfc tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:30.348526 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-27ef42f2-5441-4c75-b487-867b7f813bfc tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:30.348962 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-27ef42f2-5441-4c75-b487-867b7f813bfc tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:30.744493 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-0e2f72f0-ba3e-47f3-9d77-0051b2877f81 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:30.754255 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-0e2f72f0-ba3e-47f3-9d77-0051b2877f81 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2" status: 200 len: 1468 microversion: 2.1 time: 0.886462 Jul 23 21:19:30.757037 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 709/1442] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:19:29 2022] GET /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2 => generated 1468 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:19:30.769796 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-03daf090-98d0-4aee-b29a-b8b1dddeff42 req-9027e8a3-2c3a-4bed-afcd-851ca8de9f0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "784e1fb4-876e-489f-9428-e01412642663", "name": "network-vif-plugged", "status": "completed", "tag": "4078ff09-4171-488c-a197-d664957df578"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:19:30.770908 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-27ef42f2-5441-4c75-b487-867b7f813bfc tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:30.785143 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-27ef42f2-5441-4c75-b487-867b7f813bfc tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:30.789083 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-27ef42f2-5441-4c75-b487-867b7f813bfc tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:30.789762 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-03daf090-98d0-4aee-b29a-b8b1dddeff42 req-9027e8a3-2c3a-4bed-afcd-851ca8de9f0a service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:30.790770 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-03daf090-98d0-4aee-b29a-b8b1dddeff42 req-9027e8a3-2c3a-4bed-afcd-851ca8de9f0a service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:30.794469 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-27ef42f2-5441-4c75-b487-867b7f813bfc tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/214b4d99-34d8-48c7-924c-27cd2f6712e7" status: 200 len: 1478 microversion: 2.25 time: 0.458398 Jul 23 21:19:30.796632 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 734/1443] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:19:30 2022] GET /compute/v2.1/servers/214b4d99-34d8-48c7-924c-27cd2f6712e7 => generated 1478 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:19:30.810512 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-76943d1d-b6c4-4937-b888-27571f1c395c req-578314a3-f909-4ad5-b533-fbb6bc84210b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f54269a-e144-4b5d-9b78-39120b28e545", "name": "network-vif-deleted", "tag": "cb8b469c-a568-415a-85b4-07644be9af70"}, {"name": "network-changed", "server_uuid": "d1b84776-ab42-4b27-975d-1744b2935bb2", "tag": "75148d97-06cd-4836-97fd-6cce38566d93"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:19:30.833222 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-03daf090-98d0-4aee-b29a-b8b1dddeff42 req-9027e8a3-2c3a-4bed-afcd-851ca8de9f0a service nova] Creating event network-vif-plugged:4078ff09-4171-488c-a197-d664957df578 for instance 784e1fb4-876e-489f-9428-e01412642663 on nch1-master-1 Jul 23 21:19:30.838254 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-76943d1d-b6c4-4937-b888-27571f1c395c req-578314a3-f909-4ad5-b533-fbb6bc84210b service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:30.839614 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-76943d1d-b6c4-4937-b888-27571f1c395c req-578314a3-f909-4ad5-b533-fbb6bc84210b service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:30.841318 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-03daf090-98d0-4aee-b29a-b8b1dddeff42 req-9027e8a3-2c3a-4bed-afcd-851ca8de9f0a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082943 Jul 23 21:19:30.842269 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 710/1444] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:19:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:19:30.860147 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-5f823406-0dd7-42b8-ba43-f41a17956998 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:30.861255 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-5f823406-0dd7-42b8-ba43-f41a17956998 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] [instance: e753b3c8-e63a-48d5-a349-fa19db134404] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:30.877317 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5f823406-0dd7-42b8-ba43-f41a17956998 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:30.877635 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-76943d1d-b6c4-4937-b888-27571f1c395c req-578314a3-f909-4ad5-b533-fbb6bc84210b service nova] Creating event network-vif-deleted:cb8b469c-a568-415a-85b4-07644be9af70 for instance 6f54269a-e144-4b5d-9b78-39120b28e545 on nch2-master-1 Jul 23 21:19:30.878280 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5f823406-0dd7-42b8-ba43-f41a17956998 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:30.878752 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-76943d1d-b6c4-4937-b888-27571f1c395c req-578314a3-f909-4ad5-b533-fbb6bc84210b service nova] Creating event network-changed:75148d97-06cd-4836-97fd-6cce38566d93 for instance d1b84776-ab42-4b27-975d-1744b2935bb2 on nch2-master-1 Jul 23 21:19:30.881342 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5f823406-0dd7-42b8-ba43-f41a17956998 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:30.883503 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5f823406-0dd7-42b8-ba43-f41a17956998 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:30.914182 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [req-76943d1d-b6c4-4937-b888-27571f1c395c req-578314a3-f909-4ad5-b533-fbb6bc84210b service nova] Instance d1b84776-ab42-4b27-975d-1744b2935bb2 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=131320) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 23 21:19:30.916271 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-5f823406-0dd7-42b8-ba43-f41a17956998 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] HTTP exception thrown: Instance e753b3c8-e63a-48d5-a349-fa19db134404 could not be found. Jul 23 21:19:30.928288 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-5f823406-0dd7-42b8-ba43-f41a17956998 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Request method failure captured: Jul 23 21:19:30.928288 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/servers/e753b3c8-e63a-48d5-a349-fa19db134404 HTTP/1.1 Jul 23 21:19:30.928288 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:19:30.928288 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:19:30.928288 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:19:30.928288 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:19:30.928288 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:19:30.928288 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:19:30.928288 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:19:30.928288 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:19:30.928288 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GVEO4EkmIFkIUPPSZuKCftrupJD20EN8UJxUVYN6R6JOEIB5WnZpHOHsKWjtljonhP8Cyavp2OlX2T_Pzqsn3Tz6i9pEdkfPMe9bSFoYDUix3Jvh77bSo2cG1ONxZ0hliLrx1LUa8BMtsjQ6zKd__l9TFe1C4_-nh1Vor_234DVRqg Jul 23 21:19:30.928288 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:19:30.928288 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:19:30.928288 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:19:30.928288 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:19:30.928288 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:19:30.928288 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:19:30.928288 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 3811ea868f5649e8a235539a5bf46706 Jul 23 21:19:30.928288 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-683239709 Jul 23 21:19:30.928288 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:19:30.928288 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:19:30.929666 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3811ea868f5649e8a235539a5bf46706"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3811ea868f5649e8a235539a5bf46706"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3811ea868f5649e8a235539a5bf46706", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3811ea868f5649e8a235539a5bf46706"}]}] Jul 23 21:19:30.929666 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-683239709 Jul 23 21:19:30.929666 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 3811ea868f5649e8a235539a5bf46706 Jul 23 21:19:30.929666 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-683239709 Jul 23 21:19:30.929666 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-AttachSCSIVolumeTestJSON-683239709-project Jul 23 21:19:30.929666 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:19:30.929666 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:19:30.929666 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: fe3ad614d9d24300adb274cc95120fd3 Jul 23 21:19:30.929666 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-683239709-project Jul 23 21:19:30.929666 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:19:30.929666 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance e753b3c8-e63a-48d5-a349-fa19db134404 could not be found. Jul 23 21:19:30.929666 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': 'e753b3c8-e63a-48d5-a349-fa19db134404'} Jul 23 21:19:30.930578 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:19:30.930578 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:19:30.930578 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:19:30.930578 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:19:30.930578 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:19:30.930578 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:19:30.930578 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:19:30.930578 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:19:30.930578 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:19:30.930578 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:19:30.930578 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e753b3c8-e63a-48d5-a349-fa19db134404 could not be found. Jul 23 21:19:30.930578 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:19:30.930578 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:19:30.930578 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:19:30.930578 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:19:30.930578 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:19:30.930578 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:19:30.930578 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:19:30.930578 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:19:30.930578 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:19:30.931815 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:19:30.931815 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:19:30.931815 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:19:30.931815 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:19:30.931815 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:19:30.931815 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:19:30.931815 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:19:30.931815 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e753b3c8-e63a-48d5-a349-fa19db134404 could not be found. Jul 23 21:19:30.931815 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:19:30.931815 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:19:30.931815 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:19:30.931815 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:19:30.931815 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:19:30.931815 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:19:30.931815 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:19:30.931815 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:19:30.931815 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e753b3c8-e63a-48d5-a349-fa19db134404 could not be found. Jul 23 21:19:30.931815 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:19:30.937062 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-5f823406-0dd7-42b8-ba43-f41a17956998 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] Returning 404 to user: Instance e753b3c8-e63a-48d5-a349-fa19db134404 could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:19:30.938301 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-5f823406-0dd7-42b8-ba43-f41a17956998 tempest-AttachSCSIVolumeTestJSON-683239709 tempest-AttachSCSIVolumeTestJSON-683239709-project] 10.222.0.17 "GET /compute/v2.1/servers/e753b3c8-e63a-48d5-a349-fa19db134404" status: 404 len: 111 microversion: 2.1 time: 0.094703 Jul 23 21:19:30.939804 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 711/1445] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:19:30 2022] GET /compute/v2.1/servers/e753b3c8-e63a-48d5-a349-fa19db134404 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:19:30.948354 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-47b9d212-6782-456b-a222-a20b04d06586 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:30.949090 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-76943d1d-b6c4-4937-b888-27571f1c395c req-578314a3-f909-4ad5-b533-fbb6bc84210b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.146596 Jul 23 21:19:30.949743 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 735/1446] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:19:30 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:19:30.951015 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-47b9d212-6782-456b-a222-a20b04d06586 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] [instance: f53ce882-4694-421d-8075-5e8cfab0b16f] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:30.957725 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-47349fd7-1cd9-4374-b047-03dcefb007ad tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:30.958474 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-47349fd7-1cd9-4374-b047-03dcefb007ad tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] [instance: 214b4d99-34d8-48c7-924c-27cd2f6712e7] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:30.967154 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-47b9d212-6782-456b-a222-a20b04d06586 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:30.967763 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-47b9d212-6782-456b-a222-a20b04d06586 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:30.971292 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-47b9d212-6782-456b-a222-a20b04d06586 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:30.972056 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-47b9d212-6782-456b-a222-a20b04d06586 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:30.988754 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-47349fd7-1cd9-4374-b047-03dcefb007ad tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:30.989524 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-47349fd7-1cd9-4374-b047-03dcefb007ad tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:30.993143 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-47349fd7-1cd9-4374-b047-03dcefb007ad tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:30.993830 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-47349fd7-1cd9-4374-b047-03dcefb007ad tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:31.549484 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-47b9d212-6782-456b-a222-a20b04d06586 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145e518288ce4d70a12a3f2cc6a91810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f220ba2f42db435a818f3e462aea35a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:31.559874 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-47b9d212-6782-456b-a222-a20b04d06586 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] 10.222.0.17 "GET /compute/v2.1/servers/f53ce882-4694-421d-8075-5e8cfab0b16f" status: 200 len: 1367 microversion: 2.1 time: 0.616889 Jul 23 21:19:31.563071 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 712/1447] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:19:30 2022] GET /compute/v2.1/servers/f53ce882-4694-421d-8075-5e8cfab0b16f => generated 1367 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:19:31.575325 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d53da1ab-e924-46fe-95ab-49f9240cb8fa tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:31.576294 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-d53da1ab-e924-46fe-95ab-49f9240cb8fa tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 080674a1-a720-4058-b74a-79bb1a61f5b1] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:31.591534 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d53da1ab-e924-46fe-95ab-49f9240cb8fa tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:31.591932 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d53da1ab-e924-46fe-95ab-49f9240cb8fa tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:31.593093 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d53da1ab-e924-46fe-95ab-49f9240cb8fa tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:31.593711 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d53da1ab-e924-46fe-95ab-49f9240cb8fa tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:31.859566 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.objects.instance [None req-47349fd7-1cd9-4374-b047-03dcefb007ad tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lazy-loading 'services' on Instance uuid 214b4d99-34d8-48c7-924c-27cd2f6712e7 {{(pid=131320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:19:31.888563 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-47349fd7-1cd9-4374-b047-03dcefb007ad tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/214b4d99-34d8-48c7-924c-27cd2f6712e7" status: 200 len: 1971 microversion: 2.25 time: 0.937144 Jul 23 21:19:31.891013 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 736/1448] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:19:30 2022] GET /compute/v2.1/servers/214b4d99-34d8-48c7-924c-27cd2f6712e7 => generated 1971 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:19:31.897770 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6bbd2306-4eee-4f33-ab5a-a7efaee2e53f tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:31.898717 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6bbd2306-4eee-4f33-ab5a-a7efaee2e53f tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 784e1fb4-876e-489f-9428-e01412642663] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:31.905632 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6bbd2306-4eee-4f33-ab5a-a7efaee2e53f tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:31.919392 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6bbd2306-4eee-4f33-ab5a-a7efaee2e53f tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:31.920076 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6bbd2306-4eee-4f33-ab5a-a7efaee2e53f tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:31.920599 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6bbd2306-4eee-4f33-ab5a-a7efaee2e53f tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:31.983406 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-d53da1ab-e924-46fe-95ab-49f9240cb8fa tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4f9dda4c2a411cb0394bf86e9ae223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580ed681cbf44d10936259b17f60f1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:32.011764 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-d53da1ab-e924-46fe-95ab-49f9240cb8fa tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/servers/080674a1-a720-4058-b74a-79bb1a61f5b1" status: 200 len: 1308 microversion: 2.1 time: 0.447396 Jul 23 21:19:32.018077 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 713/1449] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:19:31 2022] GET /compute/v2.1/servers/080674a1-a720-4058-b74a-79bb1a61f5b1 => generated 1308 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:19:32.024037 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-b0b75f1a-a60d-4745-b121-83a928d4e901 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:32.035391 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-b0b75f1a-a60d-4745-b121-83a928d4e901 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: d1b84776-ab42-4b27-975d-1744b2935bb2] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:32.079944 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b0b75f1a-a60d-4745-b121-83a928d4e901 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:32.080753 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b0b75f1a-a60d-4745-b121-83a928d4e901 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:32.081719 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b0b75f1a-a60d-4745-b121-83a928d4e901 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:32.083210 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b0b75f1a-a60d-4745-b121-83a928d4e901 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:32.297190 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6bbd2306-4eee-4f33-ab5a-a7efaee2e53f tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:32.313333 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6bbd2306-4eee-4f33-ab5a-a7efaee2e53f tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/784e1fb4-876e-489f-9428-e01412642663" status: 200 len: 1198 microversion: 2.1 time: 0.420855 Jul 23 21:19:32.314888 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 737/1450] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:19:31 2022] GET /compute/v2.1/servers/784e1fb4-876e-489f-9428-e01412642663 => generated 1198 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:19:32.320164 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell0:SELECT=13 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:19:32.422279 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-b0b75f1a-a60d-4745-b121-83a928d4e901 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:32.434266 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-b0b75f1a-a60d-4745-b121-83a928d4e901 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2" status: 200 len: 1468 microversion: 2.1 time: 0.413877 Jul 23 21:19:32.434873 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 714/1451] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:19:32 2022] GET /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2 => generated 1468 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:19:32.444304 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-2de416a7-f21a-4d95-8905-9a478495af66 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:32.446905 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-2de416a7-f21a-4d95-8905-9a478495af66 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] [instance: 214b4d99-34d8-48c7-924c-27cd2f6712e7] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:32.459216 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2de416a7-f21a-4d95-8905-9a478495af66 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:32.461881 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2de416a7-f21a-4d95-8905-9a478495af66 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:32.464543 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2de416a7-f21a-4d95-8905-9a478495af66 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:32.465181 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2de416a7-f21a-4d95-8905-9a478495af66 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:32.471029 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:19:32.528188 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5b04b5ae-e6b7-43cc-9739-a712e22df36a tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] Action: 'update', calling method: .version_select at 0x7f0b478e61f0>, body: {"quota_set": {"ram": "5120"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:19:32.634036 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5b04b5ae-e6b7-43cc-9739-a712e22df36a tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:32.634881 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5b04b5ae-e6b7-43cc-9739-a712e22df36a tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:32.635855 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5b04b5ae-e6b7-43cc-9739-a712e22df36a tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:32.637794 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5b04b5ae-e6b7-43cc-9739-a712e22df36a tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:32.745334 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5b04b5ae-e6b7-43cc-9739-a712e22df36a tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-quota-sets/49ce2303160e4094b185f091dbec959e" status: 200 len: 148 microversion: 2.57 time: 0.428845 Jul 23 21:19:32.746350 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 738/1452] 10.222.0.17 () {62 vars in 1302 bytes} [Sat Jul 23 21:19:32 2022] PUT /compute/v2.1/os-quota-sets/49ce2303160e4094b185f091dbec959e => generated 148 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 23 21:19:32.765238 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2b3bc9b5-64a3-411d-a771-d521a9e1afd7 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:32.766058 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-2b3bc9b5-64a3-411d-a771-d521a9e1afd7 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] [instance: f53ce882-4694-421d-8075-5e8cfab0b16f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:32.783550 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2b3bc9b5-64a3-411d-a771-d521a9e1afd7 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:32.784002 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2b3bc9b5-64a3-411d-a771-d521a9e1afd7 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:32.784801 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2b3bc9b5-64a3-411d-a771-d521a9e1afd7 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:32.785370 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2b3bc9b5-64a3-411d-a771-d521a9e1afd7 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:33.060018 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.objects.instance [None req-2de416a7-f21a-4d95-8905-9a478495af66 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lazy-loading 'services' on Instance uuid 214b4d99-34d8-48c7-924c-27cd2f6712e7 {{(pid=131321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:19:33.095310 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-2de416a7-f21a-4d95-8905-9a478495af66 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/214b4d99-34d8-48c7-924c-27cd2f6712e7" status: 200 len: 1971 microversion: 2.25 time: 0.658391 Jul 23 21:19:33.098644 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 715/1453] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:19:32 2022] GET /compute/v2.1/servers/214b4d99-34d8-48c7-924c-27cd2f6712e7 => generated 1971 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:19:33.105705 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-57fc6c2e-75a1-4e19-bbd9-10377ae825a8 tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] Calling method '.version_select at 0x7f0b47e47af0>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:33.233608 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-57fc6c2e-75a1-4e19-bbd9-10377ae825a8 tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:33.238286 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-57fc6c2e-75a1-4e19-bbd9-10377ae825a8 tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:33.242284 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-57fc6c2e-75a1-4e19-bbd9-10377ae825a8 tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:33.243454 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-57fc6c2e-75a1-4e19-bbd9-10377ae825a8 tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:33.323637 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-57fc6c2e-75a1-4e19-bbd9-10377ae825a8 tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] 10.222.0.17 "GET /compute/v2.1/os-quota-sets/49ce2303160e4094b185f091dbec959e/detail" status: 200 len: 463 microversion: 2.57 time: 0.223178 Jul 23 21:19:33.324752 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 716/1454] 10.222.0.17 () {60 vars in 1303 bytes} [Sat Jul 23 21:19:33 2022] GET /compute/v2.1/os-quota-sets/49ce2303160e4094b185f091dbec959e/detail => generated 463 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 23 21:19:33.336357 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-3bfe0891-179a-4d0d-b145-7152118d4be4 req-28aa9700-b63d-4a7d-9622-3c5660ca49a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f53ce882-4694-421d-8075-5e8cfab0b16f", "name": "network-vif-plugged", "status": "completed", "tag": "d1c78feb-5b33-44db-b1bd-998523c96ac3"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:19:33.360664 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-3bfe0891-179a-4d0d-b145-7152118d4be4 req-28aa9700-b63d-4a7d-9622-3c5660ca49a8 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:33.361344 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-3bfe0891-179a-4d0d-b145-7152118d4be4 req-28aa9700-b63d-4a7d-9622-3c5660ca49a8 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:33.380950 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-3bfe0891-179a-4d0d-b145-7152118d4be4 req-28aa9700-b63d-4a7d-9622-3c5660ca49a8 service nova] Creating event network-vif-plugged:d1c78feb-5b33-44db-b1bd-998523c96ac3 for instance f53ce882-4694-421d-8075-5e8cfab0b16f on nch1-master-1 Jul 23 21:19:33.399196 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-3bfe0891-179a-4d0d-b145-7152118d4be4 req-28aa9700-b63d-4a7d-9622-3c5660ca49a8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073087 Jul 23 21:19:33.400307 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 717/1455] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:19:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:19:33.407200 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-16a0aef0-b68d-4796-bf49-3c2a8ed867ff tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:33.408088 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-16a0aef0-b68d-4796-bf49-3c2a8ed867ff tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 080674a1-a720-4058-b74a-79bb1a61f5b1] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:33.416425 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-16a0aef0-b68d-4796-bf49-3c2a8ed867ff tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:33.417325 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-16a0aef0-b68d-4796-bf49-3c2a8ed867ff tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:33.418486 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-16a0aef0-b68d-4796-bf49-3c2a8ed867ff tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:33.419166 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-16a0aef0-b68d-4796-bf49-3c2a8ed867ff tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:33.468436 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-2b3bc9b5-64a3-411d-a771-d521a9e1afd7 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145e518288ce4d70a12a3f2cc6a91810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f220ba2f42db435a818f3e462aea35a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:33.480955 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2b3bc9b5-64a3-411d-a771-d521a9e1afd7 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] 10.222.0.17 "GET /compute/v2.1/servers/f53ce882-4694-421d-8075-5e8cfab0b16f" status: 200 len: 1367 microversion: 2.1 time: 0.733430 Jul 23 21:19:33.481564 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 739/1456] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:19:32 2022] GET /compute/v2.1/servers/f53ce882-4694-421d-8075-5e8cfab0b16f => generated 1367 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:19:33.486005 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9f3dd767-cbbf-4b1b-9396-9287047e2fb6 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:33.487398 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:19:33.487398 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:19:33.488602 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9f3dd767-cbbf-4b1b-9396-9287047e2fb6 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:33.489051 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9f3dd767-cbbf-4b1b-9396-9287047e2fb6 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:33.489844 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9f3dd767-cbbf-4b1b-9396-9287047e2fb6 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:33.490547 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9f3dd767-cbbf-4b1b-9396-9287047e2fb6 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:33.537214 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9f3dd767-cbbf-4b1b-9396-9287047e2fb6 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.054553 Jul 23 21:19:33.540068 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 740/1457] 10.222.0.17 () {60 vars in 1216 bytes} [Sat Jul 23 21:19:33 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 23 21:19:33.553613 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9d80dfb4-79c2-45b3-a58b-c9bb7abd3bd0 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:33.555975 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-9d80dfb4-79c2-45b3-a58b-c9bb7abd3bd0 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 784e1fb4-876e-489f-9428-e01412642663] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:33.568118 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9d80dfb4-79c2-45b3-a58b-c9bb7abd3bd0 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:33.569052 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9d80dfb4-79c2-45b3-a58b-c9bb7abd3bd0 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:33.571602 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9d80dfb4-79c2-45b3-a58b-c9bb7abd3bd0 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:33.572469 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9d80dfb4-79c2-45b3-a58b-c9bb7abd3bd0 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:33.780708 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-16a0aef0-b68d-4796-bf49-3c2a8ed867ff tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4f9dda4c2a411cb0394bf86e9ae223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580ed681cbf44d10936259b17f60f1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:33.793249 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-16a0aef0-b68d-4796-bf49-3c2a8ed867ff tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/servers/080674a1-a720-4058-b74a-79bb1a61f5b1" status: 200 len: 1308 microversion: 2.1 time: 0.391341 Jul 23 21:19:33.794510 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 718/1458] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:19:33 2022] GET /compute/v2.1/servers/080674a1-a720-4058-b74a-79bb1a61f5b1 => generated 1308 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:19:33.799728 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-b2fb8478-95fa-479e-a6a6-fcf62938d932 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:33.800616 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-b2fb8478-95fa-479e-a6a6-fcf62938d932 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: d1b84776-ab42-4b27-975d-1744b2935bb2] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:33.807941 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b2fb8478-95fa-479e-a6a6-fcf62938d932 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:33.808754 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b2fb8478-95fa-479e-a6a6-fcf62938d932 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:33.809794 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b2fb8478-95fa-479e-a6a6-fcf62938d932 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:33.810508 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b2fb8478-95fa-479e-a6a6-fcf62938d932 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:34.111996 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-b2fb8478-95fa-479e-a6a6-fcf62938d932 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:34.122493 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-b2fb8478-95fa-479e-a6a6-fcf62938d932 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2" status: 200 len: 1461 microversion: 2.1 time: 0.326531 Jul 23 21:19:34.126629 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 719/1459] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:19:33 2022] GET /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2 => generated 1461 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:19:34.141380 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-cf48f739-6c9c-469c-8d5e-aee88aae9a19 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": "auto"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:19:34.149641 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-cf48f739-6c9c-469c-8d5e-aee88aae9a19 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] [instance: 214b4d99-34d8-48c7-924c-27cd2f6712e7] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:34.168425 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cf48f739-6c9c-469c-8d5e-aee88aae9a19 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:34.171274 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cf48f739-6c9c-469c-8d5e-aee88aae9a19 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:34.173669 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cf48f739-6c9c-469c-8d5e-aee88aae9a19 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:34.176090 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cf48f739-6c9c-469c-8d5e-aee88aae9a19 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:34.246633 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.objects.instance [None req-cf48f739-6c9c-469c-8d5e-aee88aae9a19 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lazy-loading 'flavor' on Instance uuid 214b4d99-34d8-48c7-924c-27cd2f6712e7 {{(pid=131321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:19:34.266936 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-9d80dfb4-79c2-45b3-a58b-c9bb7abd3bd0 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:34.281657 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9d80dfb4-79c2-45b3-a58b-c9bb7abd3bd0 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/784e1fb4-876e-489f-9428-e01412642663" status: 200 len: 1381 microversion: 2.1 time: 0.740242 Jul 23 21:19:34.286639 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 741/1460] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:19:33 2022] GET /compute/v2.1/servers/784e1fb4-876e-489f-9428-e01412642663 => generated 1381 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:19:34.307806 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-cf48f739-6c9c-469c-8d5e-aee88aae9a19 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] [instance: 214b4d99-34d8-48c7-924c-27cd2f6712e7] Going to try to live migrate instance to nch1-master-1 {{(pid=131321) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 23 21:19:34.308931 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-70835bf2-a5c0-4d99-9eeb-10cb7e7191b6 tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] Action: 'update', calling method: .version_select at 0x7f0b5422a160>, body: {"quota_set": {"ram": "2048"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:19:34.457773 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-70835bf2-a5c0-4d99-9eeb-10cb7e7191b6 tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:34.461479 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-70835bf2-a5c0-4d99-9eeb-10cb7e7191b6 tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:34.467602 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-70835bf2-a5c0-4d99-9eeb-10cb7e7191b6 tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:34.468404 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-70835bf2-a5c0-4d99-9eeb-10cb7e7191b6 tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:34.584070 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-70835bf2-a5c0-4d99-9eeb-10cb7e7191b6 tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:34.584665 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-70835bf2-a5c0-4d99-9eeb-10cb7e7191b6 tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:34.587011 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-70835bf2-a5c0-4d99-9eeb-10cb7e7191b6 tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:34.591280 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-70835bf2-a5c0-4d99-9eeb-10cb7e7191b6 tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:34.803466 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-70835bf2-a5c0-4d99-9eeb-10cb7e7191b6 tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-quota-sets/49ce2303160e4094b185f091dbec959e?user_id=b33b55782e5a4c36b9c9d20d87d9c135" status: 200 len: 148 microversion: 2.57 time: 0.515357 Jul 23 21:19:34.804162 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 742/1461] 10.222.0.17 () {62 vars in 1383 bytes} [Sat Jul 23 21:19:34 2022] PUT /compute/v2.1/os-quota-sets/49ce2303160e4094b185f091dbec959e?user_id=b33b55782e5a4c36b9c9d20d87d9c135 => generated 148 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 23 21:19:35.132675 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-fa689eed-5d54-4bad-afd8-5bddeb579c6b tempest-MigrationsAdminTest-19880863 tempest-MigrationsAdminTest-19880863-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:35.133547 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-fa689eed-5d54-4bad-afd8-5bddeb579c6b tempest-MigrationsAdminTest-19880863 tempest-MigrationsAdminTest-19880863-project-admin] [instance: d1b84776-ab42-4b27-975d-1744b2935bb2] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:35.157117 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fa689eed-5d54-4bad-afd8-5bddeb579c6b tempest-MigrationsAdminTest-19880863 tempest-MigrationsAdminTest-19880863-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:35.157591 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fa689eed-5d54-4bad-afd8-5bddeb579c6b tempest-MigrationsAdminTest-19880863 tempest-MigrationsAdminTest-19880863-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:35.158487 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fa689eed-5d54-4bad-afd8-5bddeb579c6b tempest-MigrationsAdminTest-19880863 tempest-MigrationsAdminTest-19880863-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:35.158935 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fa689eed-5d54-4bad-afd8-5bddeb579c6b tempest-MigrationsAdminTest-19880863 tempest-MigrationsAdminTest-19880863-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:35.975855 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-fa689eed-5d54-4bad-afd8-5bddeb579c6b tempest-MigrationsAdminTest-19880863 tempest-MigrationsAdminTest-19880863-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2" status: 200 len: 1612 microversion: 2.1 time: 1.160642 Jul 23 21:19:35.988763 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 743/1462] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:19:34 2022] GET /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2 => generated 1612 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:19:36.140556 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8cdc57ad-7cc1-428b-bf0d-ed7eff433ae2 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:36.141271 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8cdc57ad-7cc1-428b-bf0d-ed7eff433ae2 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] [instance: 784e1fb4-876e-489f-9428-e01412642663] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:36.148888 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8cdc57ad-7cc1-428b-bf0d-ed7eff433ae2 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:36.149511 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8cdc57ad-7cc1-428b-bf0d-ed7eff433ae2 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:36.150647 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8cdc57ad-7cc1-428b-bf0d-ed7eff433ae2 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:36.151234 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8cdc57ad-7cc1-428b-bf0d-ed7eff433ae2 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:36.648633 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8cdc57ad-7cc1-428b-bf0d-ed7eff433ae2 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/784e1fb4-876e-489f-9428-e01412642663" status: 200 len: 1532 microversion: 2.1 time: 0.658408 Jul 23 21:19:36.649199 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 744/1463] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:19:35 2022] GET /compute/v2.1/servers/784e1fb4-876e-489f-9428-e01412642663 => generated 1532 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:19:36.655553 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-bf868e78-1ad8-4015-a6c6-940152b7ee3a tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:36.656468 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-bf868e78-1ad8-4015-a6c6-940152b7ee3a tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] [instance: f53ce882-4694-421d-8075-5e8cfab0b16f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:36.664396 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bf868e78-1ad8-4015-a6c6-940152b7ee3a tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:36.664856 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bf868e78-1ad8-4015-a6c6-940152b7ee3a tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:36.665653 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bf868e78-1ad8-4015-a6c6-940152b7ee3a tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:36.666180 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bf868e78-1ad8-4015-a6c6-940152b7ee3a tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:37.007910 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-bf868e78-1ad8-4015-a6c6-940152b7ee3a tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145e518288ce4d70a12a3f2cc6a91810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f220ba2f42db435a818f3e462aea35a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:37.032051 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-bf868e78-1ad8-4015-a6c6-940152b7ee3a tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] 10.222.0.17 "GET /compute/v2.1/servers/f53ce882-4694-421d-8075-5e8cfab0b16f" status: 200 len: 1557 microversion: 2.1 time: 0.380855 Jul 23 21:19:37.034520 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 745/1464] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:19:36 2022] GET /compute/v2.1/servers/f53ce882-4694-421d-8075-5e8cfab0b16f => generated 1557 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:19:37.039562 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5d0d1ed3-c289-4ff1-a84f-ce2500a15e55 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:37.040351 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5d0d1ed3-c289-4ff1-a84f-ce2500a15e55 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 080674a1-a720-4058-b74a-79bb1a61f5b1] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:37.048020 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5d0d1ed3-c289-4ff1-a84f-ce2500a15e55 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:37.049155 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5d0d1ed3-c289-4ff1-a84f-ce2500a15e55 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:37.049814 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-cf48f739-6c9c-469c-8d5e-aee88aae9a19 tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/214b4d99-34d8-48c7-924c-27cd2f6712e7/action" status: 202 len: 0 microversion: 2.25 time: 2.914803 Jul 23 21:19:37.050727 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5d0d1ed3-c289-4ff1-a84f-ce2500a15e55 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:37.051336 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5d0d1ed3-c289-4ff1-a84f-ce2500a15e55 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:37.052547 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 720/1465] 10.222.0.17 () {62 vars in 1318 bytes} [Sat Jul 23 21:19:34 2022] POST /compute/v2.1/servers/214b4d99-34d8-48c7-924c-27cd2f6712e7/action => generated 0 bytes in 2918 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:19:37.063058 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e984edd3-d7e4-455e-9652-36c575232eb3 tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] Calling method '.version_select at 0x7f0b47e473a0>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:37.171961 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-e984edd3-d7e4-455e-9652-36c575232eb3 tempest-QuotasAdminTestV257-54075716 tempest-QuotasAdminTestV257-54075716-project-admin] 10.222.0.17 "GET /compute/v2.1/os-quota-sets/49ce2303160e4094b185f091dbec959e?user_id=b33b55782e5a4c36b9c9d20d87d9c135" status: 200 len: 190 microversion: 2.57 time: 0.115827 Jul 23 21:19:37.172674 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 721/1466] 10.222.0.17 () {60 vars in 1363 bytes} [Sat Jul 23 21:19:37 2022] GET /compute/v2.1/os-quota-sets/49ce2303160e4094b185f091dbec959e?user_id=b33b55782e5a4c36b9c9d20d87d9c135 => generated 190 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 23 21:19:37.182450 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-233310b8-78db-4973-88ff-a3e7d85e7de0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Action: 'create', calling method: .version_select at 0x7f0b47cf6dc0>, body: {"keypair": {"name": "tempest-keypair-712817914", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNmq2FPFcCFxzWj9jZRqjTsiqYhQ1JXKfbTUtf+S2lo3IKJY/dq3Itz2fgixOw4YSErOq+fUfyZEvcTm0EvE2qCE6xdMe9II78vfC7DAjdGiFptYTUqb0T5Je/U1z/mWFQ=="}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:19:37.198539 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-233310b8-78db-4973-88ff-a3e7d85e7de0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Getting quotas for project 31c41ae7265a4a629521b546a7231319. Resources: {'key_pairs'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:19:37.204020 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-233310b8-78db-4973-88ff-a3e7d85e7de0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Getting quotas for user 7578019c30174bc888279bf5009c0f4b and project 31c41ae7265a4a629521b546a7231319. Resources: {'key_pairs'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:19:37.232486 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-233310b8-78db-4973-88ff-a3e7d85e7de0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.42 time: 0.058644 Jul 23 21:19:37.233414 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 722/1467] 10.222.0.17 () {62 vars in 1199 bytes} [Sat Jul 23 21:19:37 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 60 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 23 21:19:37.238960 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-697fc283-3277-4cba-b275-8902a84d89eb req-2ae9de68-5441-4b99-a57c-2223c55c155c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "080674a1-a720-4058-b74a-79bb1a61f5b1", "tag": "a69505b1-ef69-4514-98f6-e474707e5b3e"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:19:37.246588 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:19:37.264141 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-697fc283-3277-4cba-b275-8902a84d89eb req-2ae9de68-5441-4b99-a57c-2223c55c155c service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:37.266296 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-697fc283-3277-4cba-b275-8902a84d89eb req-2ae9de68-5441-4b99-a57c-2223c55c155c service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:37.270663 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5d0d1ed3-c289-4ff1-a84f-ce2500a15e55 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4f9dda4c2a411cb0394bf86e9ae223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580ed681cbf44d10936259b17f60f1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:37.281045 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5d0d1ed3-c289-4ff1-a84f-ce2500a15e55 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/servers/080674a1-a720-4058-b74a-79bb1a61f5b1" status: 200 len: 1308 microversion: 2.1 time: 0.245121 Jul 23 21:19:37.282283 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 746/1468] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:19:37 2022] GET /compute/v2.1/servers/080674a1-a720-4058-b74a-79bb1a61f5b1 => generated 1308 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:19:37.287543 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-15d8fee1-95fb-4b16-93cc-0689d1b508b6 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:37.288257 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-15d8fee1-95fb-4b16-93cc-0689d1b508b6 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: d1b84776-ab42-4b27-975d-1744b2935bb2] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:37.296850 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-15d8fee1-95fb-4b16-93cc-0689d1b508b6 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:37.297697 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-15d8fee1-95fb-4b16-93cc-0689d1b508b6 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:37.298734 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-15d8fee1-95fb-4b16-93cc-0689d1b508b6 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:37.299339 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-15d8fee1-95fb-4b16-93cc-0689d1b508b6 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:37.304308 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=100 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:19:37.309956 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-697fc283-3277-4cba-b275-8902a84d89eb req-2ae9de68-5441-4b99-a57c-2223c55c155c service nova] Creating event network-changed:a69505b1-ef69-4514-98f6-e474707e5b3e for instance 080674a1-a720-4058-b74a-79bb1a61f5b1 on nch1-master-1 Jul 23 21:19:37.323757 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-697fc283-3277-4cba-b275-8902a84d89eb req-2ae9de68-5441-4b99-a57c-2223c55c155c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086428 Jul 23 21:19:37.324815 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 723/1469] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:19:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:19:37.338302 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f20341ec-28b2-4222-892c-740766febb34 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:37.341117 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-f20341ec-28b2-4222-892c-740766febb34 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] [instance: 784e1fb4-876e-489f-9428-e01412642663] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:37.342383 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-15d8fee1-95fb-4b16-93cc-0689d1b508b6 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: d1b84776-ab42-4b27-975d-1744b2935bb2] Going to try to terminate instance {{(pid=131320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:19:37.360637 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f20341ec-28b2-4222-892c-740766febb34 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:37.361133 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f20341ec-28b2-4222-892c-740766febb34 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:37.364742 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f20341ec-28b2-4222-892c-740766febb34 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:37.367124 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f20341ec-28b2-4222-892c-740766febb34 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:37.458134 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-15d8fee1-95fb-4b16-93cc-0689d1b508b6 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2" status: 204 len: 0 microversion: 2.1 time: 0.172365 Jul 23 21:19:37.459397 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 747/1470] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:19:37 2022] DELETE /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:19:37.465758 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-a02117e4-5f9b-4d6d-9d8c-09f1d91fd2cb req-fa1b6298-2abe-4a16-992d-f5413c24e8ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1b84776-ab42-4b27-975d-1744b2935bb2", "name": "network-vif-plugged", "status": "completed", "tag": "75148d97-06cd-4836-97fd-6cce38566d93"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:19:37.477061 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-a02117e4-5f9b-4d6d-9d8c-09f1d91fd2cb req-fa1b6298-2abe-4a16-992d-f5413c24e8ef service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:37.477524 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-a02117e4-5f9b-4d6d-9d8c-09f1d91fd2cb req-fa1b6298-2abe-4a16-992d-f5413c24e8ef service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:37.491538 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-a02117e4-5f9b-4d6d-9d8c-09f1d91fd2cb req-fa1b6298-2abe-4a16-992d-f5413c24e8ef service nova] Creating event network-vif-plugged:75148d97-06cd-4836-97fd-6cce38566d93 for instance d1b84776-ab42-4b27-975d-1744b2935bb2 on nch2-master-1 Jul 23 21:19:37.498613 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-a02117e4-5f9b-4d6d-9d8c-09f1d91fd2cb req-fa1b6298-2abe-4a16-992d-f5413c24e8ef service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037502 Jul 23 21:19:37.499693 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 748/1471] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:19:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:19:37.508092 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-7a603144-6064-4d06-95d6-38d77bf31ab2 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:37.508688 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-7a603144-6064-4d06-95d6-38d77bf31ab2 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] [instance: f53ce882-4694-421d-8075-5e8cfab0b16f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:37.516215 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7a603144-6064-4d06-95d6-38d77bf31ab2 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:37.516673 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7a603144-6064-4d06-95d6-38d77bf31ab2 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:37.517818 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7a603144-6064-4d06-95d6-38d77bf31ab2 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:37.518434 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7a603144-6064-4d06-95d6-38d77bf31ab2 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:37.617017 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-7a603144-6064-4d06-95d6-38d77bf31ab2 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] 10.222.0.17 "GET /compute/v2.1/servers/f53ce882-4694-421d-8075-5e8cfab0b16f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.115293 Jul 23 21:19:37.618446 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 749/1472] 10.222.0.17 () {58 vars in 1274 bytes} [Sat Jul 23 21:19:37 2022] GET /compute/v2.1/servers/f53ce882-4694-421d-8075-5e8cfab0b16f/os-interface => generated 284 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:19:37.626433 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5c563df2-0204-4b22-acba-b65f96945cc5 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:37.627958 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5c563df2-0204-4b22-acba-b65f96945cc5 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: 214b4d99-34d8-48c7-924c-27cd2f6712e7] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:37.638393 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5c563df2-0204-4b22-acba-b65f96945cc5 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:37.640667 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5c563df2-0204-4b22-acba-b65f96945cc5 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:37.642593 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5c563df2-0204-4b22-acba-b65f96945cc5 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:37.643511 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5c563df2-0204-4b22-acba-b65f96945cc5 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:37.813890 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-f20341ec-28b2-4222-892c-740766febb34 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/784e1fb4-876e-489f-9428-e01412642663" status: 200 len: 1532 microversion: 2.1 time: 0.484046 Jul 23 21:19:37.826304 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 724/1473] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:19:37 2022] GET /compute/v2.1/servers/784e1fb4-876e-489f-9428-e01412642663 => generated 1532 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:19:37.831953 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ef91c43d-bf7e-4b20-8c4f-1c6dcccfd1d3 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:37.833346 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-ef91c43d-bf7e-4b20-8c4f-1c6dcccfd1d3 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: d1b84776-ab42-4b27-975d-1744b2935bb2] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:37.841710 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ef91c43d-bf7e-4b20-8c4f-1c6dcccfd1d3 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:37.842549 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ef91c43d-bf7e-4b20-8c4f-1c6dcccfd1d3 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:37.844020 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ef91c43d-bf7e-4b20-8c4f-1c6dcccfd1d3 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:37.844467 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ef91c43d-bf7e-4b20-8c4f-1c6dcccfd1d3 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:38.235009 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5c563df2-0204-4b22-acba-b65f96945cc5 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:38.246657 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5c563df2-0204-4b22-acba-b65f96945cc5 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:38.248189 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5c563df2-0204-4b22-acba-b65f96945cc5 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:38.256008 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5c563df2-0204-4b22-acba-b65f96945cc5 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/214b4d99-34d8-48c7-924c-27cd2f6712e7" status: 200 len: 1488 microversion: 2.25 time: 0.628320 Jul 23 21:19:38.257281 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 750/1474] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:19:37 2022] GET /compute/v2.1/servers/214b4d99-34d8-48c7-924c-27cd2f6712e7 => generated 1488 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:19:38.263386 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-48e43fd8-3022-4061-a0cf-610471ceef51 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:38.270282 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:19:38.270282 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:19:38.271701 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-48e43fd8-3022-4061-a0cf-610471ceef51 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:38.273290 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-48e43fd8-3022-4061-a0cf-610471ceef51 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:38.274412 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-48e43fd8-3022-4061-a0cf-610471ceef51 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:38.275059 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-48e43fd8-3022-4061-a0cf-610471ceef51 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:38.325631 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-48e43fd8-3022-4061-a0cf-610471ceef51 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.067039 Jul 23 21:19:38.332462 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 751/1475] 10.222.0.17 () {58 vars in 1175 bytes} [Sat Jul 23 21:19:38 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:19:38.349234 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e786c008-a070-4247-9b6a-ea35aeb261ed tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:38.349899 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e786c008-a070-4247-9b6a-ea35aeb261ed tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 080674a1-a720-4058-b74a-79bb1a61f5b1] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:38.366226 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:19:38.368116 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e786c008-a070-4247-9b6a-ea35aeb261ed tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:38.368585 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e786c008-a070-4247-9b6a-ea35aeb261ed tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:38.369408 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e786c008-a070-4247-9b6a-ea35aeb261ed tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:38.369952 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e786c008-a070-4247-9b6a-ea35aeb261ed tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:38.612531 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ef91c43d-bf7e-4b20-8c4f-1c6dcccfd1d3 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:38.624459 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-ef91c43d-bf7e-4b20-8c4f-1c6dcccfd1d3 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2" status: 200 len: 1467 microversion: 2.1 time: 0.796791 Jul 23 21:19:38.625750 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 725/1476] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:19:37 2022] GET /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2 => generated 1467 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:19:38.633193 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d98a3dd5-1095-4af3-9ff3-0b63b44a63b5 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": false, "disk_over_commit": false}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:19:38.642200 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-d98a3dd5-1095-4af3-9ff3-0b63b44a63b5 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] [instance: 784e1fb4-876e-489f-9428-e01412642663] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:38.666218 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d98a3dd5-1095-4af3-9ff3-0b63b44a63b5 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:38.666947 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d98a3dd5-1095-4af3-9ff3-0b63b44a63b5 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:38.669807 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d98a3dd5-1095-4af3-9ff3-0b63b44a63b5 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:38.670543 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d98a3dd5-1095-4af3-9ff3-0b63b44a63b5 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:38.710395 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.objects.instance [None req-d98a3dd5-1095-4af3-9ff3-0b63b44a63b5 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lazy-loading 'flavor' on Instance uuid 784e1fb4-876e-489f-9428-e01412642663 {{(pid=131321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:19:38.733309 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-d98a3dd5-1095-4af3-9ff3-0b63b44a63b5 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] [instance: 784e1fb4-876e-489f-9428-e01412642663] Going to try to live migrate instance to nch2-master-1 {{(pid=131321) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 23 21:19:39.451125 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e786c008-a070-4247-9b6a-ea35aeb261ed tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4f9dda4c2a411cb0394bf86e9ae223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580ed681cbf44d10936259b17f60f1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:39.489072 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e786c008-a070-4247-9b6a-ea35aeb261ed tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/servers/080674a1-a720-4058-b74a-79bb1a61f5b1" status: 200 len: 1308 microversion: 2.1 time: 1.153558 Jul 23 21:19:39.491214 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 752/1477] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:19:38 2022] GET /compute/v2.1/servers/080674a1-a720-4058-b74a-79bb1a61f5b1 => generated 1308 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:19:39.518479 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8e551d61-affb-4e90-b0fa-d9883463c9ef tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:39.521792 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8e551d61-affb-4e90-b0fa-d9883463c9ef tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: 214b4d99-34d8-48c7-924c-27cd2f6712e7] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:39.563612 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8e551d61-affb-4e90-b0fa-d9883463c9ef tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:39.565986 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8e551d61-affb-4e90-b0fa-d9883463c9ef tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:39.571034 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8e551d61-affb-4e90-b0fa-d9883463c9ef tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:39.572405 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8e551d61-affb-4e90-b0fa-d9883463c9ef tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:41.029780 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8e551d61-affb-4e90-b0fa-d9883463c9ef tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:41.039929 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8e551d61-affb-4e90-b0fa-d9883463c9ef tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:41.041779 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8e551d61-affb-4e90-b0fa-d9883463c9ef tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:41.043112 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8e551d61-affb-4e90-b0fa-d9883463c9ef tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/214b4d99-34d8-48c7-924c-27cd2f6712e7" status: 200 len: 1488 microversion: 2.25 time: 1.549004 Jul 23 21:19:41.044222 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 753/1478] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:19:39 2022] GET /compute/v2.1/servers/214b4d99-34d8-48c7-924c-27cd2f6712e7 => generated 1488 bytes in 1551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:19:41.049287 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9ba2b781-601d-4722-bc8f-bb941e78c226 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:41.050458 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-9ba2b781-601d-4722-bc8f-bb941e78c226 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: d1b84776-ab42-4b27-975d-1744b2935bb2] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:41.067530 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9ba2b781-601d-4722-bc8f-bb941e78c226 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:41.068276 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9ba2b781-601d-4722-bc8f-bb941e78c226 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:41.069339 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9ba2b781-601d-4722-bc8f-bb941e78c226 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:41.070749 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9ba2b781-601d-4722-bc8f-bb941e78c226 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:41.353161 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-d98a3dd5-1095-4af3-9ff3-0b63b44a63b5 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/784e1fb4-876e-489f-9428-e01412642663/action" status: 202 len: 0 microversion: 2.1 time: 2.723552 Jul 23 21:19:41.360223 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 726/1479] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:19:38 2022] POST /compute/v2.1/servers/784e1fb4-876e-489f-9428-e01412642663/action => generated 0 bytes in 2733 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:19:41.365594 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-be4fa164-64fa-4c0e-bae1-cbea0df3b08d tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:41.366260 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-be4fa164-64fa-4c0e-bae1-cbea0df3b08d tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 080674a1-a720-4058-b74a-79bb1a61f5b1] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:41.381839 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-be4fa164-64fa-4c0e-bae1-cbea0df3b08d tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:41.382448 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-be4fa164-64fa-4c0e-bae1-cbea0df3b08d tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:41.385467 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-be4fa164-64fa-4c0e-bae1-cbea0df3b08d tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:41.386366 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-be4fa164-64fa-4c0e-bae1-cbea0df3b08d tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:41.592440 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-9ba2b781-601d-4722-bc8f-bb941e78c226 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:41.621283 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9ba2b781-601d-4722-bc8f-bb941e78c226 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2" status: 200 len: 1467 microversion: 2.1 time: 0.573205 Jul 23 21:19:41.622039 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 754/1480] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:19:41 2022] GET /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2 => generated 1467 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:19:41.637501 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-72abcb0c-c6c4-44d2-aacd-6aefd01beab8 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:41.638892 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-72abcb0c-c6c4-44d2-aacd-6aefd01beab8 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 784e1fb4-876e-489f-9428-e01412642663] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:41.668185 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-72abcb0c-c6c4-44d2-aacd-6aefd01beab8 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:41.671663 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-72abcb0c-c6c4-44d2-aacd-6aefd01beab8 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:41.675325 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-72abcb0c-c6c4-44d2-aacd-6aefd01beab8 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:41.675787 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-72abcb0c-c6c4-44d2-aacd-6aefd01beab8 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:41.800857 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-be4fa164-64fa-4c0e-bae1-cbea0df3b08d tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4f9dda4c2a411cb0394bf86e9ae223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580ed681cbf44d10936259b17f60f1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:41.826196 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-be4fa164-64fa-4c0e-bae1-cbea0df3b08d tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/servers/080674a1-a720-4058-b74a-79bb1a61f5b1" status: 200 len: 1308 microversion: 2.1 time: 0.464474 Jul 23 21:19:41.827134 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 727/1481] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:19:41 2022] GET /compute/v2.1/servers/080674a1-a720-4058-b74a-79bb1a61f5b1 => generated 1308 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:19:41.832163 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-d6a8733c-96ac-4999-b88b-e7e59c3de551 req-ee2b7550-d1d6-4a95-a179-533eb47538b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "080674a1-a720-4058-b74a-79bb1a61f5b1", "name": "network-vif-plugged", "status": "completed", "tag": "a69505b1-ef69-4514-98f6-e474707e5b3e"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:19:41.840903 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-d6a8733c-96ac-4999-b88b-e7e59c3de551 req-ee2b7550-d1d6-4a95-a179-533eb47538b0 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:41.841646 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-d6a8733c-96ac-4999-b88b-e7e59c3de551 req-ee2b7550-d1d6-4a95-a179-533eb47538b0 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:41.855552 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-d6a8733c-96ac-4999-b88b-e7e59c3de551 req-ee2b7550-d1d6-4a95-a179-533eb47538b0 service nova] Creating event network-vif-plugged:a69505b1-ef69-4514-98f6-e474707e5b3e for instance 080674a1-a720-4058-b74a-79bb1a61f5b1 on nch1-master-1 Jul 23 21:19:41.862636 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-d6a8733c-96ac-4999-b88b-e7e59c3de551 req-ee2b7550-d1d6-4a95-a179-533eb47538b0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032966 Jul 23 21:19:41.864292 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 728/1482] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:19:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:19:42.061982 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-614d65f4-459b-4ebb-b646-c57aabf0a81c tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:42.062783 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-614d65f4-459b-4ebb-b646-c57aabf0a81c tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: 214b4d99-34d8-48c7-924c-27cd2f6712e7] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:42.080593 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-614d65f4-459b-4ebb-b646-c57aabf0a81c tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:42.081135 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-614d65f4-459b-4ebb-b646-c57aabf0a81c tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:42.081995 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-614d65f4-459b-4ebb-b646-c57aabf0a81c tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:42.082393 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-614d65f4-459b-4ebb-b646-c57aabf0a81c tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:42.279854 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-72abcb0c-c6c4-44d2-aacd-6aefd01beab8 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:42.305791 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-72abcb0c-c6c4-44d2-aacd-6aefd01beab8 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/784e1fb4-876e-489f-9428-e01412642663" status: 200 len: 1391 microversion: 2.1 time: 0.680670 Jul 23 21:19:42.317147 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 755/1483] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:19:41 2022] GET /compute/v2.1/servers/784e1fb4-876e-489f-9428-e01412642663 => generated 1391 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:19:42.331665 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-5c76af8e-2252-4359-982e-3b101e66fed2 req-e4c44c5c-91e3-4edb-b5f4-7aa07133aaef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1b84776-ab42-4b27-975d-1744b2935bb2", "name": "network-vif-deleted", "tag": "75148d97-06cd-4836-97fd-6cce38566d93"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:19:42.352431 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-5c76af8e-2252-4359-982e-3b101e66fed2 req-e4c44c5c-91e3-4edb-b5f4-7aa07133aaef service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:42.353178 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-5c76af8e-2252-4359-982e-3b101e66fed2 req-e4c44c5c-91e3-4edb-b5f4-7aa07133aaef service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:42.393400 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-5c76af8e-2252-4359-982e-3b101e66fed2 req-e4c44c5c-91e3-4edb-b5f4-7aa07133aaef service nova] Creating event network-vif-deleted:75148d97-06cd-4836-97fd-6cce38566d93 for instance d1b84776-ab42-4b27-975d-1744b2935bb2 on nch2-master-1 Jul 23 21:19:42.412628 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-5c76af8e-2252-4359-982e-3b101e66fed2 req-e4c44c5c-91e3-4edb-b5f4-7aa07133aaef service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088799 Jul 23 21:19:42.413649 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 756/1484] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:19:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:19:42.475590 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-614d65f4-459b-4ebb-b646-c57aabf0a81c tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:42.502900 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-614d65f4-459b-4ebb-b646-c57aabf0a81c tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:42.504427 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-614d65f4-459b-4ebb-b646-c57aabf0a81c tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:42.505611 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-614d65f4-459b-4ebb-b646-c57aabf0a81c tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/214b4d99-34d8-48c7-924c-27cd2f6712e7" status: 200 len: 1488 microversion: 2.25 time: 0.448596 Jul 23 21:19:42.518523 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 729/1485] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:19:42 2022] GET /compute/v2.1/servers/214b4d99-34d8-48c7-924c-27cd2f6712e7 => generated 1488 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:19:42.643806 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e5da7780-921f-4c4f-a755-66d23c8bcca8 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:42.644867 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e5da7780-921f-4c4f-a755-66d23c8bcca8 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: d1b84776-ab42-4b27-975d-1744b2935bb2] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:42.660815 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e5da7780-921f-4c4f-a755-66d23c8bcca8 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:42.661719 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e5da7780-921f-4c4f-a755-66d23c8bcca8 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:42.663381 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e5da7780-921f-4c4f-a755-66d23c8bcca8 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:42.669820 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e5da7780-921f-4c4f-a755-66d23c8bcca8 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:42.717784 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e5da7780-921f-4c4f-a755-66d23c8bcca8 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:42.720940 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e5da7780-921f-4c4f-a755-66d23c8bcca8 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:42.721643 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.objects.instance [None req-e5da7780-921f-4c4f-a755-66d23c8bcca8 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lazy-loading 'fault' on Instance uuid d1b84776-ab42-4b27-975d-1744b2935bb2 {{(pid=131320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:19:42.816242 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e5da7780-921f-4c4f-a755-66d23c8bcca8 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:42.833350 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e5da7780-921f-4c4f-a755-66d23c8bcca8 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2" status: 200 len: 1302 microversion: 2.1 time: 0.196844 Jul 23 21:19:42.834186 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 757/1486] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:19:42 2022] GET /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2 => generated 1302 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:19:42.843652 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e44b2c66-1e8a-41bd-b222-ae3168d8c4c4 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:42.844244 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-e44b2c66-1e8a-41bd-b222-ae3168d8c4c4 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 080674a1-a720-4058-b74a-79bb1a61f5b1] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:42.851332 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e44b2c66-1e8a-41bd-b222-ae3168d8c4c4 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:42.851787 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e44b2c66-1e8a-41bd-b222-ae3168d8c4c4 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:42.855270 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e44b2c66-1e8a-41bd-b222-ae3168d8c4c4 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:42.857297 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e44b2c66-1e8a-41bd-b222-ae3168d8c4c4 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:43.276511 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-e44b2c66-1e8a-41bd-b222-ae3168d8c4c4 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4f9dda4c2a411cb0394bf86e9ae223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580ed681cbf44d10936259b17f60f1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:43.283679 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell0:SELECT=2 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:19:43.295848 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-e44b2c66-1e8a-41bd-b222-ae3168d8c4c4 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/servers/080674a1-a720-4058-b74a-79bb1a61f5b1" status: 200 len: 1308 microversion: 2.1 time: 0.456094 Jul 23 21:19:43.298026 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 730/1487] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:19:42 2022] GET /compute/v2.1/servers/080674a1-a720-4058-b74a-79bb1a61f5b1 => generated 1308 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:19:43.326510 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0b37aa9e-ce08-4365-9ad3-65d718190e8f tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:43.327161 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-0b37aa9e-ce08-4365-9ad3-65d718190e8f tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 784e1fb4-876e-489f-9428-e01412642663] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:43.341949 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0b37aa9e-ce08-4365-9ad3-65d718190e8f tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:43.343514 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0b37aa9e-ce08-4365-9ad3-65d718190e8f tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:43.346069 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0b37aa9e-ce08-4365-9ad3-65d718190e8f tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:43.346926 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0b37aa9e-ce08-4365-9ad3-65d718190e8f tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:43.525994 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-8ec32303-3e37-4c5c-a8ea-aa425b7aad5e tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:43.527392 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-8ec32303-3e37-4c5c-a8ea-aa425b7aad5e tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: 214b4d99-34d8-48c7-924c-27cd2f6712e7] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:43.539343 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8ec32303-3e37-4c5c-a8ea-aa425b7aad5e tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:43.547006 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8ec32303-3e37-4c5c-a8ea-aa425b7aad5e tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:43.548123 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8ec32303-3e37-4c5c-a8ea-aa425b7aad5e tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:43.548864 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8ec32303-3e37-4c5c-a8ea-aa425b7aad5e tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:43.663938 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-0b37aa9e-ce08-4365-9ad3-65d718190e8f tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:43.674272 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-0b37aa9e-ce08-4365-9ad3-65d718190e8f tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/784e1fb4-876e-489f-9428-e01412642663" status: 200 len: 1391 microversion: 2.1 time: 0.352155 Jul 23 21:19:43.684984 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 758/1488] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:19:43 2022] GET /compute/v2.1/servers/784e1fb4-876e-489f-9428-e01412642663 => generated 1391 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:19:43.852873 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-433a8b79-2c36-47d4-a7b9-63bd76eb1516 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:43.853979 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-433a8b79-2c36-47d4-a7b9-63bd76eb1516 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: d1b84776-ab42-4b27-975d-1744b2935bb2] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:43.861468 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-433a8b79-2c36-47d4-a7b9-63bd76eb1516 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:43.862192 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-433a8b79-2c36-47d4-a7b9-63bd76eb1516 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:43.870208 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-433a8b79-2c36-47d4-a7b9-63bd76eb1516 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:43.871367 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-433a8b79-2c36-47d4-a7b9-63bd76eb1516 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:43.889071 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-433a8b79-2c36-47d4-a7b9-63bd76eb1516 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] HTTP exception thrown: Instance d1b84776-ab42-4b27-975d-1744b2935bb2 could not be found. Jul 23 21:19:43.891635 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-433a8b79-2c36-47d4-a7b9-63bd76eb1516 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Request method failure captured: Jul 23 21:19:43.891635 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2 HTTP/1.1 Jul 23 21:19:43.891635 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:19:43.891635 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:19:43.891635 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:19:43.891635 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:19:43.891635 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:19:43.891635 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:19:43.891635 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:19:43.891635 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:19:43.891635 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GSXVRtT4D6DOYfgu59iPITKQ5mqcVxrjQp1t1yDZwCjvkDyx4wS8lBIVwN9smI5UFCECIxWKCBOaVPG0VLJTlOJdXdkXVrNU_74esEReGGgA0n9alBex-aEm1JD8sWUZRSrbN_rcHQ4ciIzp29ExKjSpi_IoKu7t3of0FKJObJf45w Jul 23 21:19:43.891635 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:19:43.891635 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:19:43.891635 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:19:43.891635 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:19:43.891635 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:19:43.891635 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:19:43.891635 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 5935212e8b6a40768ee3fc90807b0cb1 Jul 23 21:19:43.891635 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-MigrationsAdminTest-2054055598 Jul 23 21:19:43.891635 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:19:43.891635 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:19:43.893236 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5935212e8b6a40768ee3fc90807b0cb1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5935212e8b6a40768ee3fc90807b0cb1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_5935212e8b6a40768ee3fc90807b0cb1", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/5935212e8b6a40768ee3fc90807b0cb1"}]}] Jul 23 21:19:43.893236 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-MigrationsAdminTest-2054055598 Jul 23 21:19:43.893236 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 5935212e8b6a40768ee3fc90807b0cb1 Jul 23 21:19:43.893236 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-MigrationsAdminTest-2054055598 Jul 23 21:19:43.893236 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-MigrationsAdminTest-2054055598-project Jul 23 21:19:43.893236 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:19:43.893236 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:19:43.893236 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 0133d9533fbd4be5b46dc308dbe3a7d9 Jul 23 21:19:43.893236 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-MigrationsAdminTest-2054055598-project Jul 23 21:19:43.893236 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:19:43.893236 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance d1b84776-ab42-4b27-975d-1744b2935bb2 could not be found. Jul 23 21:19:43.893236 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': 'd1b84776-ab42-4b27-975d-1744b2935bb2'} Jul 23 21:19:43.894203 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:19:43.894203 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:19:43.894203 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:19:43.894203 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:19:43.894203 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:19:43.894203 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:19:43.894203 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:19:43.894203 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:19:43.894203 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:19:43.894203 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:19:43.894203 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1b84776-ab42-4b27-975d-1744b2935bb2 could not be found. Jul 23 21:19:43.894203 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:19:43.894203 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:19:43.894203 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:19:43.894203 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:19:43.894203 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:19:43.894203 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:19:43.894203 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:19:43.894203 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:19:43.894203 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:19:43.895430 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:19:43.895430 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:19:43.895430 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:19:43.895430 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:19:43.895430 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:19:43.895430 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:19:43.895430 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:19:43.895430 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1b84776-ab42-4b27-975d-1744b2935bb2 could not be found. Jul 23 21:19:43.895430 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:19:43.895430 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:19:43.895430 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:19:43.895430 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:19:43.895430 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:19:43.895430 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:19:43.895430 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:19:43.895430 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:19:43.895430 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1b84776-ab42-4b27-975d-1744b2935bb2 could not be found. Jul 23 21:19:43.895430 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:19:43.898070 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-433a8b79-2c36-47d4-a7b9-63bd76eb1516 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Returning 404 to user: Instance d1b84776-ab42-4b27-975d-1744b2935bb2 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:19:43.899183 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-433a8b79-2c36-47d4-a7b9-63bd76eb1516 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2" status: 404 len: 111 microversion: 2.1 time: 0.052931 Jul 23 21:19:43.900320 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 759/1489] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:19:43 2022] GET /compute/v2.1/servers/d1b84776-ab42-4b27-975d-1744b2935bb2 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 23 21:19:43.912089 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-db5a002f-696e-4621-8a5c-9362db19233c tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:43.913090 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-db5a002f-696e-4621-8a5c-9362db19233c tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 760fa31f-a0cf-46df-b456-3af5dc7f9933] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:43.938351 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-db5a002f-696e-4621-8a5c-9362db19233c tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:43.939759 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-db5a002f-696e-4621-8a5c-9362db19233c tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:43.940836 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-db5a002f-696e-4621-8a5c-9362db19233c tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:43.941526 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-db5a002f-696e-4621-8a5c-9362db19233c tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:44.054845 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-db5a002f-696e-4621-8a5c-9362db19233c tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 760fa31f-a0cf-46df-b456-3af5dc7f9933] Going to try to terminate instance {{(pid=131320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:19:44.312081 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-db5a002f-696e-4621-8a5c-9362db19233c tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "DELETE /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933" status: 204 len: 0 microversion: 2.1 time: 0.402414 Jul 23 21:19:44.314173 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 760/1490] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:19:43 2022] DELETE /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:19:44.332720 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-582ab8a4-48de-4bd0-bee4-4696a4ad8661 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:44.334103 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-582ab8a4-48de-4bd0-bee4-4696a4ad8661 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 080674a1-a720-4058-b74a-79bb1a61f5b1] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:44.342867 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-582ab8a4-48de-4bd0-bee4-4696a4ad8661 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:44.343584 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-582ab8a4-48de-4bd0-bee4-4696a4ad8661 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:44.344732 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-582ab8a4-48de-4bd0-bee4-4696a4ad8661 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:44.345615 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-582ab8a4-48de-4bd0-bee4-4696a4ad8661 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:44.459882 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-8ec32303-3e37-4c5c-a8ea-aa425b7aad5e tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:44.487596 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-8ec32303-3e37-4c5c-a8ea-aa425b7aad5e tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:44.495387 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-8ec32303-3e37-4c5c-a8ea-aa425b7aad5e tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:44.497229 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-8ec32303-3e37-4c5c-a8ea-aa425b7aad5e tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/214b4d99-34d8-48c7-924c-27cd2f6712e7" status: 200 len: 1488 microversion: 2.25 time: 0.976293 Jul 23 21:19:44.501027 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 731/1491] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:19:43 2022] GET /compute/v2.1/servers/214b4d99-34d8-48c7-924c-27cd2f6712e7 => generated 1488 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:19:44.509919 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-b5e0bd2c-c38e-4e09-b9c0-c8b1d594109d tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:44.512441 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-b5e0bd2c-c38e-4e09-b9c0-c8b1d594109d tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 760fa31f-a0cf-46df-b456-3af5dc7f9933] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:44.541328 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b5e0bd2c-c38e-4e09-b9c0-c8b1d594109d tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:44.547600 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b5e0bd2c-c38e-4e09-b9c0-c8b1d594109d tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:44.550873 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b5e0bd2c-c38e-4e09-b9c0-c8b1d594109d tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:44.556255 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b5e0bd2c-c38e-4e09-b9c0-c8b1d594109d tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:44.573505 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:19:44.704858 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-582ab8a4-48de-4bd0-bee4-4696a4ad8661 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4f9dda4c2a411cb0394bf86e9ae223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580ed681cbf44d10936259b17f60f1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:44.715168 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-582ab8a4-48de-4bd0-bee4-4696a4ad8661 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/servers/080674a1-a720-4058-b74a-79bb1a61f5b1" status: 200 len: 1308 microversion: 2.1 time: 0.398681 Jul 23 21:19:44.717568 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 761/1492] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:19:44 2022] GET /compute/v2.1/servers/080674a1-a720-4058-b74a-79bb1a61f5b1 => generated 1308 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:19:44.728541 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0dde492d-9ccb-4aa3-8400-e889c85430b5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1485555463", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "5e956570-c579-4c0b-8a10-13b608237caa"}, {"port": "b0482d57-40b3-4cb7-99d9-4b40a0176e1f", "tag": "port-1"}, {"port": "88d392b5-c81c-4709-b717-629afa3c9a7e", "tag": "port-2"}, {"uuid": "b21f0b04-b32e-4cc0-a190-c08c080ebbb8", "tag": "net-1"}, {"uuid": "b21f0b04-b32e-4cc0-a190-c08c080ebbb8"}, {"uuid": "63314698-238e-4d3e-843b-69ab7926e551", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "63314698-238e-4d3e-843b-69ab7926e551", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "45847d66-e6fb-4802-888a-09b3751e9a66", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "d1dcd2ad-1f42-4cd4-ae7b-4f9ec30b5094", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "05a64e2b-5dee-45e2-80f3-6e3860844946", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--703288634"}], "key_name": "tempest-keypair-712817914", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:19:44.784596 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=34 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:19:44.940418 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-0dde492d-9ccb-4aa3-8400-e889c85430b5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] validate_networks() for [('5e956570-c579-4c0b-8a10-13b608237caa', None, None, None, None, None), (None, None, 'b0482d57-40b3-4cb7-99d9-4b40a0176e1f', None, None, None), (None, None, '88d392b5-c81c-4709-b717-629afa3c9a7e', None, None, None), ('b21f0b04-b32e-4cc0-a190-c08c080ebbb8', None, None, None, None, None), ('b21f0b04-b32e-4cc0-a190-c08c080ebbb8', None, None, None, None, None), ('63314698-238e-4d3e-843b-69ab7926e551', '10.2.2.100', None, None, None, None), ('63314698-238e-4d3e-843b-69ab7926e551', '10.2.2.200', None, None, None, None)] {{(pid=131320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:19:45.006693 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-b5e0bd2c-c38e-4e09-b9c0-c8b1d594109d tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:45.026885 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-b5e0bd2c-c38e-4e09-b9c0-c8b1d594109d tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933" status: 200 len: 1534 microversion: 2.1 time: 0.520155 Jul 23 21:19:45.039180 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 732/1493] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:19:44 2022] GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933 => generated 1534 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:19:45.048218 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-6d4abd13-d481-42b4-aecc-eead9034d73c req-02c6c360-b236-41c8-99fa-dcd2807cde7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "214b4d99-34d8-48c7-924c-27cd2f6712e7", "name": "network-vif-unplugged", "status": "completed", "tag": "a741c39b-97c1-40b2-8530-cc020cd5f926"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:19:45.071489 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-6d4abd13-d481-42b4-aecc-eead9034d73c req-02c6c360-b236-41c8-99fa-dcd2807cde7a service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:45.073706 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-6d4abd13-d481-42b4-aecc-eead9034d73c req-02c6c360-b236-41c8-99fa-dcd2807cde7a service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:45.107917 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-6d4abd13-d481-42b4-aecc-eead9034d73c req-02c6c360-b236-41c8-99fa-dcd2807cde7a service nova] Creating event network-vif-unplugged:a741c39b-97c1-40b2-8530-cc020cd5f926 for instance 214b4d99-34d8-48c7-924c-27cd2f6712e7 on nch2-master-1 Jul 23 21:19:45.120482 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-6d4abd13-d481-42b4-aecc-eead9034d73c req-02c6c360-b236-41c8-99fa-dcd2807cde7a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078901 Jul 23 21:19:45.123076 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 733/1494] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:19:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:19:45.135898 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-2c271c50-ef6b-475a-85b8-f836c0ddb229 req-d5a1a909-8537-47ae-a774-4a7b34d781a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f53ce882-4694-421d-8075-5e8cfab0b16f", "tag": "d1c78feb-5b33-44db-b1bd-998523c96ac3"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:19:45.153303 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-2c271c50-ef6b-475a-85b8-f836c0ddb229 req-d5a1a909-8537-47ae-a774-4a7b34d781a4 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:45.157203 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-2c271c50-ef6b-475a-85b8-f836c0ddb229 req-d5a1a909-8537-47ae-a774-4a7b34d781a4 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:45.183670 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-2c271c50-ef6b-475a-85b8-f836c0ddb229 req-d5a1a909-8537-47ae-a774-4a7b34d781a4 service nova] Creating event network-changed:d1c78feb-5b33-44db-b1bd-998523c96ac3 for instance f53ce882-4694-421d-8075-5e8cfab0b16f on nch1-master-1 Jul 23 21:19:45.198475 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-2c271c50-ef6b-475a-85b8-f836c0ddb229 req-d5a1a909-8537-47ae-a774-4a7b34d781a4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072305 Jul 23 21:19:45.201351 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 734/1495] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:19:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:19:45.210486 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-1032438f-3c2d-4c2f-b54c-17ab26f897bd tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:45.214633 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-1032438f-3c2d-4c2f-b54c-17ab26f897bd tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 784e1fb4-876e-489f-9428-e01412642663] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:45.237943 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1032438f-3c2d-4c2f-b54c-17ab26f897bd tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:45.238857 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1032438f-3c2d-4c2f-b54c-17ab26f897bd tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:45.239852 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1032438f-3c2d-4c2f-b54c-17ab26f897bd tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:45.240438 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1032438f-3c2d-4c2f-b54c-17ab26f897bd tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:45.577332 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-1032438f-3c2d-4c2f-b54c-17ab26f897bd tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:45.588719 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-1032438f-3c2d-4c2f-b54c-17ab26f897bd tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/784e1fb4-876e-489f-9428-e01412642663" status: 200 len: 1391 microversion: 2.1 time: 0.385776 Jul 23 21:19:45.589978 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 735/1496] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:19:45 2022] GET /compute/v2.1/servers/784e1fb4-876e-489f-9428-e01412642663 => generated 1391 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:19:45.595896 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-92b26cee-4c7d-42af-826b-be14967b4cf2 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:45.596894 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-92b26cee-4c7d-42af-826b-be14967b4cf2 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: 214b4d99-34d8-48c7-924c-27cd2f6712e7] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:45.604611 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-92b26cee-4c7d-42af-826b-be14967b4cf2 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:45.605619 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-92b26cee-4c7d-42af-826b-be14967b4cf2 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:45.606717 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-92b26cee-4c7d-42af-826b-be14967b4cf2 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:45.607588 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-92b26cee-4c7d-42af-826b-be14967b4cf2 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:45.917584 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-92b26cee-4c7d-42af-826b-be14967b4cf2 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:45.931111 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-92b26cee-4c7d-42af-826b-be14967b4cf2 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:45.933455 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-92b26cee-4c7d-42af-826b-be14967b4cf2 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:45.935274 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-92b26cee-4c7d-42af-826b-be14967b4cf2 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/214b4d99-34d8-48c7-924c-27cd2f6712e7" status: 200 len: 1488 microversion: 2.25 time: 0.344069 Jul 23 21:19:45.936451 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 736/1497] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:19:45 2022] GET /compute/v2.1/servers/214b4d99-34d8-48c7-924c-27cd2f6712e7 => generated 1488 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:19:45.951876 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-aaece34e-4a11-48e5-9d0a-718f3334e5ab tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:45.953450 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-aaece34e-4a11-48e5-9d0a-718f3334e5ab tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 080674a1-a720-4058-b74a-79bb1a61f5b1] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:45.988678 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-aaece34e-4a11-48e5-9d0a-718f3334e5ab tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:45.990430 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-aaece34e-4a11-48e5-9d0a-718f3334e5ab tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:45.994226 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-aaece34e-4a11-48e5-9d0a-718f3334e5ab tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:45.995634 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-aaece34e-4a11-48e5-9d0a-718f3334e5ab tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:46.342737 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-aaece34e-4a11-48e5-9d0a-718f3334e5ab tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4f9dda4c2a411cb0394bf86e9ae223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580ed681cbf44d10936259b17f60f1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:46.354591 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-aaece34e-4a11-48e5-9d0a-718f3334e5ab tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/servers/080674a1-a720-4058-b74a-79bb1a61f5b1" status: 200 len: 1489 microversion: 2.1 time: 0.416772 Jul 23 21:19:46.355510 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 737/1498] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:19:45 2022] GET /compute/v2.1/servers/080674a1-a720-4058-b74a-79bb1a61f5b1 => generated 1489 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:19:46.362095 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-78899a56-d1fc-4335-bb62-8d3cb9880750 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:46.362928 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-78899a56-d1fc-4335-bb62-8d3cb9880750 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 760fa31f-a0cf-46df-b456-3af5dc7f9933] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:46.374021 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-78899a56-d1fc-4335-bb62-8d3cb9880750 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:46.374483 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-78899a56-d1fc-4335-bb62-8d3cb9880750 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:46.375703 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-78899a56-d1fc-4335-bb62-8d3cb9880750 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:46.376330 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-78899a56-d1fc-4335-bb62-8d3cb9880750 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:46.576881 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-78899a56-d1fc-4335-bb62-8d3cb9880750 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:46.585600 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-78899a56-d1fc-4335-bb62-8d3cb9880750 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933" status: 200 len: 1534 microversion: 2.1 time: 0.228839 Jul 23 21:19:46.595145 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 738/1499] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:19:46 2022] GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933 => generated 1534 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:19:46.752254 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-8723b92a-0fa0-4ddb-b64d-ec80736d7654 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-552172833", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "networks": "none"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:19:46.849375 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-8723b92a-0fa0-4ddb-b64d-ec80736d7654 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Flavor limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:19:46.850046 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-8723b92a-0fa0-4ddb-b64d-ec80736d7654 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Image limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:19:46.852278 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-8723b92a-0fa0-4ddb-b64d-ec80736d7654 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Flavor pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:19:46.853656 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-8723b92a-0fa0-4ddb-b64d-ec80736d7654 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Image pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:19:46.854570 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-8723b92a-0fa0-4ddb-b64d-ec80736d7654 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:19:46.869005 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8723b92a-0fa0-4ddb-b64d-ec80736d7654 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:46.870017 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8723b92a-0fa0-4ddb-b64d-ec80736d7654 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:46.870994 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8723b92a-0fa0-4ddb-b64d-ec80736d7654 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:46.871513 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8723b92a-0fa0-4ddb-b64d-ec80736d7654 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:46.892651 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-8723b92a-0fa0-4ddb-b64d-ec80736d7654 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Getting quotas for project c7af16c62b144aa0972331a69e3638c3. Resources: {'ram', 'instances', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:19:46.899011 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-8723b92a-0fa0-4ddb-b64d-ec80736d7654 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Getting quotas for user 3ef41817e4f5478bb7afdcb59ed634cd and project c7af16c62b144aa0972331a69e3638c3. Resources: {'ram', 'instances', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:19:46.913097 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-8723b92a-0fa0-4ddb-b64d-ec80736d7654 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Going to run 1 instances... {{(pid=131321) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:19:46.915371 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-8723b92a-0fa0-4ddb-b64d-ec80736d7654 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] [instance: d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131321) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:19:46.970947 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-8723b92a-0fa0-4ddb-b64d-ec80736d7654 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.374270 Jul 23 21:19:46.974024 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 739/1500] 10.222.0.17 () {62 vars in 1187 bytes} [Sat Jul 23 21:19:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 376 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 23 21:19:46.977837 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ca2179ce-8061-4360-b615-520c794d3fe9 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-711412412"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:19:46.978969 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-ca2179ce-8061-4360-b615-520c794d3fe9 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 080674a1-a720-4058-b74a-79bb1a61f5b1] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:46.996257 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ca2179ce-8061-4360-b615-520c794d3fe9 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:46.996719 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ca2179ce-8061-4360-b615-520c794d3fe9 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:46.997548 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ca2179ce-8061-4360-b615-520c794d3fe9 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:46.998140 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ca2179ce-8061-4360-b615-520c794d3fe9 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:47.410790 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-ca2179ce-8061-4360-b615-520c794d3fe9 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "POST /compute/v2.1/servers/080674a1-a720-4058-b74a-79bb1a61f5b1/action" status: 202 len: 0 microversion: 2.1 time: 0.437043 Jul 23 21:19:47.412220 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 740/1501] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:19:46 2022] POST /compute/v2.1/servers/080674a1-a720-4058-b74a-79bb1a61f5b1/action => generated 0 bytes in 440 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 23 21:19:47.419516 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-2bc8a354-c5f1-4c20-ac6d-18e4cfce15f8 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:47.421058 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-2bc8a354-c5f1-4c20-ac6d-18e4cfce15f8 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 784e1fb4-876e-489f-9428-e01412642663] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:47.430787 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2bc8a354-c5f1-4c20-ac6d-18e4cfce15f8 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:47.431627 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2bc8a354-c5f1-4c20-ac6d-18e4cfce15f8 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:47.432769 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2bc8a354-c5f1-4c20-ac6d-18e4cfce15f8 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:47.433429 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2bc8a354-c5f1-4c20-ac6d-18e4cfce15f8 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:47.698008 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-2bc8a354-c5f1-4c20-ac6d-18e4cfce15f8 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:47.708977 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-2bc8a354-c5f1-4c20-ac6d-18e4cfce15f8 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/784e1fb4-876e-489f-9428-e01412642663" status: 200 len: 1391 microversion: 2.1 time: 0.295243 Jul 23 21:19:47.719510 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 741/1502] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:19:47 2022] GET /compute/v2.1/servers/784e1fb4-876e-489f-9428-e01412642663 => generated 1391 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:19:47.858968 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-83e6832d-d492-464a-bc1e-45f1e4dd7ca8 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:47.859977 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-83e6832d-d492-464a-bc1e-45f1e4dd7ca8 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: 214b4d99-34d8-48c7-924c-27cd2f6712e7] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:47.870320 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-83e6832d-d492-464a-bc1e-45f1e4dd7ca8 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:47.871180 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-83e6832d-d492-464a-bc1e-45f1e4dd7ca8 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:47.872199 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-83e6832d-d492-464a-bc1e-45f1e4dd7ca8 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:47.872881 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-83e6832d-d492-464a-bc1e-45f1e4dd7ca8 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:48.194282 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-83e6832d-d492-464a-bc1e-45f1e4dd7ca8 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:48.202805 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-83e6832d-d492-464a-bc1e-45f1e4dd7ca8 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:48.204386 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-83e6832d-d492-464a-bc1e-45f1e4dd7ca8 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:48.205779 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-83e6832d-d492-464a-bc1e-45f1e4dd7ca8 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/214b4d99-34d8-48c7-924c-27cd2f6712e7" status: 200 len: 1488 microversion: 2.25 time: 0.484686 Jul 23 21:19:48.218961 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 742/1503] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:19:47 2022] GET /compute/v2.1/servers/214b4d99-34d8-48c7-924c-27cd2f6712e7 => generated 1488 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:19:48.230410 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-0a5f1315-d0d9-408c-8a98-903fb9c69506 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:19:48.231639 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-0a5f1315-d0d9-408c-8a98-903fb9c69506 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] [instance: d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:48.257248 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0a5f1315-d0d9-408c-8a98-903fb9c69506 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:48.257996 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0a5f1315-d0d9-408c-8a98-903fb9c69506 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:48.259391 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0a5f1315-d0d9-408c-8a98-903fb9c69506 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:48.260100 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0a5f1315-d0d9-408c-8a98-903fb9c69506 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:48.290964 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=15 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:19:48.443789 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-0a5f1315-d0d9-408c-8a98-903fb9c69506 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ef41817e4f5478bb7afdcb59ed634cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af16c62b144aa0972331a69e3638c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:48.457588 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-0a5f1315-d0d9-408c-8a98-903fb9c69506 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ef41817e4f5478bb7afdcb59ed634cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af16c62b144aa0972331a69e3638c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:48.460271 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-0a5f1315-d0d9-408c-8a98-903fb9c69506 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ef41817e4f5478bb7afdcb59ed634cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af16c62b144aa0972331a69e3638c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:48.469189 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-0a5f1315-d0d9-408c-8a98-903fb9c69506 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] 10.222.0.17 "PUT /compute/v2.1/servers/d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a" status: 200 len: 1410 microversion: 2.75 time: 0.248168 Jul 23 21:19:48.480839 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 743/1504] 10.222.0.17 () {62 vars in 1296 bytes} [Sat Jul 23 21:19:48 2022] PUT /compute/v2.1/servers/d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a => generated 1410 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:19:48.494063 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-ce70ffa9-d23e-429d-9cc8-7c2b533afca9 req-7f11ba25-8957-4dfc-8754-dfaa7284de01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "214b4d99-34d8-48c7-924c-27cd2f6712e7", "tag": "a741c39b-97c1-40b2-8530-cc020cd5f926"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:19:48.517549 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-ce70ffa9-d23e-429d-9cc8-7c2b533afca9 req-7f11ba25-8957-4dfc-8754-dfaa7284de01 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:48.518265 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-ce70ffa9-d23e-429d-9cc8-7c2b533afca9 req-7f11ba25-8957-4dfc-8754-dfaa7284de01 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:48.536391 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-ce70ffa9-d23e-429d-9cc8-7c2b533afca9 req-7f11ba25-8957-4dfc-8754-dfaa7284de01 service nova] Creating event network-changed:a741c39b-97c1-40b2-8530-cc020cd5f926 for instance 214b4d99-34d8-48c7-924c-27cd2f6712e7 on nch2-master-1 Jul 23 21:19:48.542035 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-ce70ffa9-d23e-429d-9cc8-7c2b533afca9 req-7f11ba25-8957-4dfc-8754-dfaa7284de01 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059725 Jul 23 21:19:48.543113 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 744/1505] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:19:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:19:48.551369 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a686d6c4-42e8-4e52-b159-0224681b48d6 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '.version_select at 0x7f0b47f2eca0>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:48.616579 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-a686d6c4-42e8-4e52-b159-0224681b48d6 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/images/4095e8c4-03d9-4453-9850-a7a48a5f0b59" status: 200 len: 1413 microversion: 2.1 time: 0.071046 Jul 23 21:19:48.622558 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 745/1506] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:19:48 2022] GET /compute/v2.1/images/4095e8c4-03d9-4453-9850-a7a48a5f0b59 => generated 1413 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:19:48.642229 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-cc9137c1-435f-4c86-ba7d-9dcc49635307 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:48.644054 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-cc9137c1-435f-4c86-ba7d-9dcc49635307 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 760fa31f-a0cf-46df-b456-3af5dc7f9933] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:48.669454 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cc9137c1-435f-4c86-ba7d-9dcc49635307 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:48.670417 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cc9137c1-435f-4c86-ba7d-9dcc49635307 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:48.671556 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cc9137c1-435f-4c86-ba7d-9dcc49635307 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:48.673599 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cc9137c1-435f-4c86-ba7d-9dcc49635307 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:48.723810 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cc9137c1-435f-4c86-ba7d-9dcc49635307 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:48.725305 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cc9137c1-435f-4c86-ba7d-9dcc49635307 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:48.726023 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.objects.instance [None req-cc9137c1-435f-4c86-ba7d-9dcc49635307 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lazy-loading 'fault' on Instance uuid 760fa31f-a0cf-46df-b456-3af5dc7f9933 {{(pid=131321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:19:48.874434 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-cc9137c1-435f-4c86-ba7d-9dcc49635307 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:48.885749 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-cc9137c1-435f-4c86-ba7d-9dcc49635307 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933" status: 200 len: 1368 microversion: 2.1 time: 0.261891 Jul 23 21:19:48.889125 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 746/1507] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:19:48 2022] GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933 => generated 1368 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:19:48.899019 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-3cfcde39-62f4-421c-943d-7384d27f9de9 req-7967f66c-937e-44b6-8c46-7e287dab781c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "760fa31f-a0cf-46df-b456-3af5dc7f9933", "name": "network-vif-deleted", "tag": "0eaaed80-36fa-4393-8345-fc0c35160cb5"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:19:48.915028 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-3cfcde39-62f4-421c-943d-7384d27f9de9 req-7967f66c-937e-44b6-8c46-7e287dab781c service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:48.915995 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-3cfcde39-62f4-421c-943d-7384d27f9de9 req-7967f66c-937e-44b6-8c46-7e287dab781c service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:48.932943 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-3cfcde39-62f4-421c-943d-7384d27f9de9 req-7967f66c-937e-44b6-8c46-7e287dab781c service nova] Creating event network-vif-deleted:0eaaed80-36fa-4393-8345-fc0c35160cb5 for instance 760fa31f-a0cf-46df-b456-3af5dc7f9933 on nch1-master-1 Jul 23 21:19:48.939587 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-3cfcde39-62f4-421c-943d-7384d27f9de9 req-7967f66c-937e-44b6-8c46-7e287dab781c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046905 Jul 23 21:19:48.940676 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 747/1508] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:19:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:19:48.948859 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-0a5bcab3-d470-457d-bb75-b80e3b820bc4 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:48.949626 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-0a5bcab3-d470-457d-bb75-b80e3b820bc4 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] [instance: d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:48.959408 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0a5bcab3-d470-457d-bb75-b80e3b820bc4 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:48.959882 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0a5bcab3-d470-457d-bb75-b80e3b820bc4 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:48.960831 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0a5bcab3-d470-457d-bb75-b80e3b820bc4 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:48.961314 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0a5bcab3-d470-457d-bb75-b80e3b820bc4 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:49.045540 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-0a5bcab3-d470-457d-bb75-b80e3b820bc4 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ef41817e4f5478bb7afdcb59ed634cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af16c62b144aa0972331a69e3638c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:49.060378 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-0a5bcab3-d470-457d-bb75-b80e3b820bc4 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ef41817e4f5478bb7afdcb59ed634cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af16c62b144aa0972331a69e3638c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:49.062262 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-0a5bcab3-d470-457d-bb75-b80e3b820bc4 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ef41817e4f5478bb7afdcb59ed634cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af16c62b144aa0972331a69e3638c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:49.067827 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-0a5bcab3-d470-457d-bb75-b80e3b820bc4 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] 10.222.0.17 "GET /compute/v2.1/servers/d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a" status: 200 len: 1428 microversion: 2.75 time: 0.125803 Jul 23 21:19:49.068729 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 748/1509] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:19:48 2022] GET /compute/v2.1/servers/d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a => generated 1428 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:19:49.083580 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d305bc0e-e9a7-4f9b-8619-0e21e2abe03f tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '.version_select at 0x7f0b47f13430>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:49.146017 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-d305bc0e-e9a7-4f9b-8619-0e21e2abe03f tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/images/4095e8c4-03d9-4453-9850-a7a48a5f0b59" status: 200 len: 1413 microversion: 2.1 time: 0.075614 Jul 23 21:19:49.146638 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 749/1510] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:19:49 2022] GET /compute/v2.1/images/4095e8c4-03d9-4453-9850-a7a48a5f0b59 => generated 1413 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:19:49.154448 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-cceaaf00-3b08-43da-8325-ce6ce5004033 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:49.155030 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-cceaaf00-3b08-43da-8325-ce6ce5004033 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 784e1fb4-876e-489f-9428-e01412642663] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:49.162085 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cceaaf00-3b08-43da-8325-ce6ce5004033 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:49.162850 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cceaaf00-3b08-43da-8325-ce6ce5004033 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:49.163940 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cceaaf00-3b08-43da-8325-ce6ce5004033 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:49.164704 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cceaaf00-3b08-43da-8325-ce6ce5004033 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:49.312549 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-cceaaf00-3b08-43da-8325-ce6ce5004033 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:49.320519 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-cceaaf00-3b08-43da-8325-ce6ce5004033 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/784e1fb4-876e-489f-9428-e01412642663" status: 200 len: 1391 microversion: 2.1 time: 0.172647 Jul 23 21:19:49.321115 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 750/1511] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:19:49 2022] GET /compute/v2.1/servers/784e1fb4-876e-489f-9428-e01412642663 => generated 1391 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:19:49.326137 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-6ec91399-2a1a-439e-b433-e1708312b685 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '.version_select at 0x7f0b47e7e670>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:49.457555 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-6ec91399-2a1a-439e-b433-e1708312b685 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "DELETE /compute/v2.1/images/4095e8c4-03d9-4453-9850-a7a48a5f0b59" status: 204 len: 0 microversion: 2.1 time: 0.135296 Jul 23 21:19:49.458629 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 751/1512] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:19:49 2022] DELETE /compute/v2.1/images/4095e8c4-03d9-4453-9850-a7a48a5f0b59 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:19:49.467775 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-0bad0101-567f-4ab6-bfbc-0ad4b9c4cf24 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:49.468794 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-0bad0101-567f-4ab6-bfbc-0ad4b9c4cf24 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: 214b4d99-34d8-48c7-924c-27cd2f6712e7] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:49.478479 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0bad0101-567f-4ab6-bfbc-0ad4b9c4cf24 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:49.479196 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0bad0101-567f-4ab6-bfbc-0ad4b9c4cf24 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:49.480175 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0bad0101-567f-4ab6-bfbc-0ad4b9c4cf24 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:49.480830 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0bad0101-567f-4ab6-bfbc-0ad4b9c4cf24 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:49.713172 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-0bad0101-567f-4ab6-bfbc-0ad4b9c4cf24 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:49.725784 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-0bad0101-567f-4ab6-bfbc-0ad4b9c4cf24 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:49.727526 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-0bad0101-567f-4ab6-bfbc-0ad4b9c4cf24 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:49.731786 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-0bad0101-567f-4ab6-bfbc-0ad4b9c4cf24 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/214b4d99-34d8-48c7-924c-27cd2f6712e7" status: 200 len: 1488 microversion: 2.25 time: 0.268641 Jul 23 21:19:49.732888 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 752/1513] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:19:49 2022] GET /compute/v2.1/servers/214b4d99-34d8-48c7-924c-27cd2f6712e7 => generated 1488 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:19:49.746835 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-98c73118-f54f-41b0-850a-4473ef0a3d52 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '.version_select at 0x7f0b47e6a4c0>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:49.774182 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-98c73118-f54f-41b0-850a-4473ef0a3d52 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] HTTP exception thrown: Image not found. Jul 23 21:19:49.825419 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-98c73118-f54f-41b0-850a-4473ef0a3d52 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Request method failure captured: Jul 23 21:19:49.825419 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/images/4095e8c4-03d9-4453-9850-a7a48a5f0b59 HTTP/1.1 Jul 23 21:19:49.825419 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:19:49.825419 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:19:49.825419 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:19:49.825419 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:19:49.825419 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:19:49.825419 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:19:49.825419 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:19:49.825419 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:19:49.825419 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GUJELDL_GsNeJwREywE_3jBr1HvzTVincHoSaHkmz1z6GZZjegpx0r2IR_6PBi9Tra-YYsN5qwdwSaeOz6I0mD6V9yMAx7BFDMUjtY9rJu7mfhQyUGyuxYI08t_rWsJ-odD6MQO0mzNpwl75bL9POwUU9lfytO2Ec0dK9a6mg0ozik Jul 23 21:19:49.825419 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:19:49.825419 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:19:49.825419 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:19:49.825419 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:19:49.825419 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:19:49.825419 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:19:49.825419 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 580ed681cbf44d10936259b17f60f1b2 Jul 23 21:19:49.825419 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ImagesTestJSON-1070983287 Jul 23 21:19:49.825419 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:19:49.825419 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:19:49.827178 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/580ed681cbf44d10936259b17f60f1b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/580ed681cbf44d10936259b17f60f1b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_580ed681cbf44d10936259b17f60f1b2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/580ed681cbf44d10936259b17f60f1b2"}]}] Jul 23 21:19:49.827178 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ImagesTestJSON-1070983287 Jul 23 21:19:49.827178 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 580ed681cbf44d10936259b17f60f1b2 Jul 23 21:19:49.827178 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ImagesTestJSON-1070983287 Jul 23 21:19:49.827178 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ImagesTestJSON-1070983287-project Jul 23 21:19:49.827178 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:19:49.827178 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:19:49.827178 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: bb4f9dda4c2a411cb0394bf86e9ae223 Jul 23 21:19:49.827178 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ImagesTestJSON-1070983287-project Jul 23 21:19:49.827178 ncdv-master-1 devstack@n-api.service[131321]: method: Jul 23 21:19:49.827178 ncdv-master-1 devstack@n-api.service[131321]: exception: Image not found. Jul 23 21:19:49.827178 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': '4095e8c4-03d9-4453-9850-a7a48a5f0b59'} Jul 23 21:19:49.827178 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:19:49.827178 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:19:49.828229 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 23 21:19:49.828229 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 23 21:19:49.828229 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 23 21:19:49.828229 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 23 21:19:49.828229 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 23 21:19:49.828229 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 23 21:19:49.828229 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 23 21:19:49.828229 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 23 21:19:49.828229 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 23 21:19:49.828229 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 23 21:19:49.828229 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 23 21:19:49.828229 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 23 21:19:49.828229 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 23 21:19:49.828229 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 23 21:19:49.828229 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 23 21:19:49.828229 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 23 21:19:49.828229 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 4095e8c4-03d9-4453-9850-a7a48a5f0b59 Jul 23 21:19:49.828229 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:19:49.830553 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:19:49.830553 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:19:49.830553 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:19:49.830553 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 23 21:19:49.830553 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 23 21:19:49.830553 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 23 21:19:49.830553 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 23 21:19:49.830553 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 23 21:19:49.830553 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 23 21:19:49.830553 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 23 21:19:49.830553 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 23 21:19:49.830553 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 23 21:19:49.830553 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 23 21:19:49.830553 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 23 21:19:49.830553 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 23 21:19:49.830553 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 23 21:19:49.830553 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 23 21:19:49.830553 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 23 21:19:49.830553 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 23 21:19:49.833043 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 23 21:19:49.833043 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 23 21:19:49.833043 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 23 21:19:49.833043 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 23 21:19:49.833043 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 23 21:19:49.833043 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 23 21:19:49.833043 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 23 21:19:49.833043 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 23 21:19:49.833043 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4095e8c4-03d9-4453-9850-a7a48a5f0b59 could not be found. Jul 23 21:19:49.833043 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:19:49.833043 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:19:49.833043 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:19:49.833043 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:19:49.833043 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:19:49.833043 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:19:49.833043 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:19:49.833043 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:19:49.833043 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:19:49.833043 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:19:49.836118 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:19:49.836118 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:19:49.836118 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 23 21:19:49.836118 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 23 21:19:49.836118 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 23 21:19:49.836118 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:19:49.836118 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:19:49.836118 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:19:49.836118 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:19:49.836118 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:19:49.836118 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:19:49.836118 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:19:49.836118 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:19:49.836118 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 23 21:19:49.836118 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:19:49.836118 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-98c73118-f54f-41b0-850a-4473ef0a3d52 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Returning 404 to user: Image not found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:19:49.836118 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-98c73118-f54f-41b0-850a-4473ef0a3d52 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/images/4095e8c4-03d9-4453-9850-a7a48a5f0b59" status: 404 len: 62 microversion: 2.1 time: 0.095197 Jul 23 21:19:49.838515 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 753/1514] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:19:49 2022] GET /compute/v2.1/images/4095e8c4-03d9-4453-9850-a7a48a5f0b59 => generated 62 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 23 21:19:49.841543 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-954e9354-9e9c-4a34-8afb-23f1d662b4fc tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:49.842312 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-954e9354-9e9c-4a34-8afb-23f1d662b4fc tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 080674a1-a720-4058-b74a-79bb1a61f5b1] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:49.855820 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-954e9354-9e9c-4a34-8afb-23f1d662b4fc tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:49.856101 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-954e9354-9e9c-4a34-8afb-23f1d662b4fc tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:49.856983 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-954e9354-9e9c-4a34-8afb-23f1d662b4fc tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:49.857548 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-954e9354-9e9c-4a34-8afb-23f1d662b4fc tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:49.881512 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:19:50.072457 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-954e9354-9e9c-4a34-8afb-23f1d662b4fc tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4f9dda4c2a411cb0394bf86e9ae223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580ed681cbf44d10936259b17f60f1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:50.083767 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-954e9354-9e9c-4a34-8afb-23f1d662b4fc tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/servers/080674a1-a720-4058-b74a-79bb1a61f5b1" status: 200 len: 1507 microversion: 2.1 time: 0.248545 Jul 23 21:19:50.094804 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 754/1515] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:19:49 2022] GET /compute/v2.1/servers/080674a1-a720-4058-b74a-79bb1a61f5b1 => generated 1507 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:19:50.094804 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ef3fa1e2-ef14-4d05-980e-99dff4821017 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:50.095128 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-ef3fa1e2-ef14-4d05-980e-99dff4821017 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 760fa31f-a0cf-46df-b456-3af5dc7f9933] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:50.104435 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ef3fa1e2-ef14-4d05-980e-99dff4821017 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:50.105439 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ef3fa1e2-ef14-4d05-980e-99dff4821017 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:50.107824 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ef3fa1e2-ef14-4d05-980e-99dff4821017 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:50.108344 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ef3fa1e2-ef14-4d05-980e-99dff4821017 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:50.132066 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-ef3fa1e2-ef14-4d05-980e-99dff4821017 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] HTTP exception thrown: Instance 760fa31f-a0cf-46df-b456-3af5dc7f9933 could not be found. Jul 23 21:19:50.134743 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ef3fa1e2-ef14-4d05-980e-99dff4821017 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Request method failure captured: Jul 23 21:19:50.134743 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933 HTTP/1.1 Jul 23 21:19:50.134743 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:19:50.134743 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:19:50.134743 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:19:50.134743 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:19:50.134743 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:19:50.134743 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:19:50.134743 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:19:50.134743 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:19:50.134743 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GSXVRtT4D6DOYfgu59iPITKQ5mqcVxrjQp1t1yDZwCjvkDyx4wS8lBIVwN9smI5UFCECIxWKCBOaVPG0VLJTlOJdXdkXVrNU_74esEReGGgA0n9alBex-aEm1JD8sWUZRSrbN_rcHQ4ciIzp29ExKjSpi_IoKu7t3of0FKJObJf45w Jul 23 21:19:50.134743 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:19:50.134743 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:19:50.134743 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:19:50.134743 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:19:50.134743 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:19:50.134743 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:19:50.134743 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 5935212e8b6a40768ee3fc90807b0cb1 Jul 23 21:19:50.134743 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-MigrationsAdminTest-2054055598 Jul 23 21:19:50.134743 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:19:50.134743 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:19:50.136334 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5935212e8b6a40768ee3fc90807b0cb1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5935212e8b6a40768ee3fc90807b0cb1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_5935212e8b6a40768ee3fc90807b0cb1", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/5935212e8b6a40768ee3fc90807b0cb1"}]}] Jul 23 21:19:50.136334 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-MigrationsAdminTest-2054055598 Jul 23 21:19:50.136334 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 5935212e8b6a40768ee3fc90807b0cb1 Jul 23 21:19:50.136334 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-MigrationsAdminTest-2054055598 Jul 23 21:19:50.136334 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-MigrationsAdminTest-2054055598-project Jul 23 21:19:50.136334 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:19:50.136334 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:19:50.136334 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 0133d9533fbd4be5b46dc308dbe3a7d9 Jul 23 21:19:50.136334 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-MigrationsAdminTest-2054055598-project Jul 23 21:19:50.136334 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:19:50.136334 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance 760fa31f-a0cf-46df-b456-3af5dc7f9933 could not be found. Jul 23 21:19:50.136334 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': '760fa31f-a0cf-46df-b456-3af5dc7f9933'} Jul 23 21:19:50.137118 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:19:50.137118 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:19:50.137118 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:19:50.137118 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:19:50.137118 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:19:50.137118 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:19:50.137118 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:19:50.137118 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:19:50.137118 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:19:50.137118 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:19:50.137118 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 760fa31f-a0cf-46df-b456-3af5dc7f9933 could not be found. Jul 23 21:19:50.137118 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:19:50.137118 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:19:50.137118 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:19:50.137118 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:19:50.137118 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:19:50.137118 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:19:50.137118 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:19:50.137118 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:19:50.137118 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:19:50.138882 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:19:50.138882 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:19:50.138882 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:19:50.138882 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:19:50.138882 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:19:50.138882 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:19:50.138882 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:19:50.138882 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 760fa31f-a0cf-46df-b456-3af5dc7f9933 could not be found. Jul 23 21:19:50.138882 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:19:50.138882 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:19:50.138882 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:19:50.138882 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:19:50.138882 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:19:50.138882 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:19:50.138882 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:19:50.138882 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:19:50.138882 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 760fa31f-a0cf-46df-b456-3af5dc7f9933 could not be found. Jul 23 21:19:50.138882 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:19:50.140059 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ef3fa1e2-ef14-4d05-980e-99dff4821017 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Returning 404 to user: Instance 760fa31f-a0cf-46df-b456-3af5dc7f9933 could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:19:50.140059 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-ef3fa1e2-ef14-4d05-980e-99dff4821017 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933" status: 404 len: 111 microversion: 2.1 time: 0.048337 Jul 23 21:19:50.140059 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 755/1516] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:19:50 2022] GET /compute/v2.1/servers/760fa31f-a0cf-46df-b456-3af5dc7f9933 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:19:50.147171 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-abee50d3-8928-48c2-b573-a011c0d6e0d7 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:50.148018 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-abee50d3-8928-48c2-b573-a011c0d6e0d7 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] [instance: d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:50.155497 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-abee50d3-8928-48c2-b573-a011c0d6e0d7 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:50.155991 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-abee50d3-8928-48c2-b573-a011c0d6e0d7 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:50.157145 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-abee50d3-8928-48c2-b573-a011c0d6e0d7 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:50.158376 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-abee50d3-8928-48c2-b573-a011c0d6e0d7 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:50.293744 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-abee50d3-8928-48c2-b573-a011c0d6e0d7 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ef41817e4f5478bb7afdcb59ed634cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af16c62b144aa0972331a69e3638c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:50.305232 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-abee50d3-8928-48c2-b573-a011c0d6e0d7 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ef41817e4f5478bb7afdcb59ed634cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af16c62b144aa0972331a69e3638c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:50.306792 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-abee50d3-8928-48c2-b573-a011c0d6e0d7 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ef41817e4f5478bb7afdcb59ed634cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af16c62b144aa0972331a69e3638c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:50.313725 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-abee50d3-8928-48c2-b573-a011c0d6e0d7 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] 10.222.0.17 "GET /compute/v2.1/servers/d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a" status: 200 len: 1416 microversion: 2.75 time: 0.175729 Jul 23 21:19:50.314720 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 756/1517] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:19:50 2022] GET /compute/v2.1/servers/d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a => generated 1416 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:19:50.320099 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-72c81768-980c-482f-90a5-6ffc61007710 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '.version_select at 0x7f0b47cf60d0>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:50.348426 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-72c81768-980c-482f-90a5-6ffc61007710 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-893784733" status: 202 len: 0 microversion: 2.1 time: 0.030888 Jul 23 21:19:50.348666 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 757/1518] 10.222.0.17 () {58 vars in 1217 bytes} [Sat Jul 23 21:19:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-893784733 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:19:50.371101 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-6b95b085-5c7e-4399-b839-ef7a919bd0cc tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:50.374585 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-6b95b085-5c7e-4399-b839-ef7a919bd0cc tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 784e1fb4-876e-489f-9428-e01412642663] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:50.385766 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6b95b085-5c7e-4399-b839-ef7a919bd0cc tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:50.386395 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6b95b085-5c7e-4399-b839-ef7a919bd0cc tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:50.387907 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6b95b085-5c7e-4399-b839-ef7a919bd0cc tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:50.388492 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6b95b085-5c7e-4399-b839-ef7a919bd0cc tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:50.627938 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-0dde492d-9ccb-4aa3-8400-e889c85430b5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:19:50.628908 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-0dde492d-9ccb-4aa3-8400-e889c85430b5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:19:50.629609 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-0dde492d-9ccb-4aa3-8400-e889c85430b5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:19:50.630387 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-0dde492d-9ccb-4aa3-8400-e889c85430b5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:19:50.631130 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-0dde492d-9ccb-4aa3-8400-e889c85430b5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:19:50.644576 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0dde492d-9ccb-4aa3-8400-e889c85430b5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:50.645079 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0dde492d-9ccb-4aa3-8400-e889c85430b5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:50.646779 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0dde492d-9ccb-4aa3-8400-e889c85430b5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:50.647594 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0dde492d-9ccb-4aa3-8400-e889c85430b5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:50.670159 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-0dde492d-9ccb-4aa3-8400-e889c85430b5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Getting quotas for project 31c41ae7265a4a629521b546a7231319. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:19:50.678436 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-0dde492d-9ccb-4aa3-8400-e889c85430b5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Getting quotas for user 7578019c30174bc888279bf5009c0f4b and project 31c41ae7265a4a629521b546a7231319. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:19:50.763107 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-6b95b085-5c7e-4399-b839-ef7a919bd0cc tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:50.786185 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-6b95b085-5c7e-4399-b839-ef7a919bd0cc tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/784e1fb4-876e-489f-9428-e01412642663" status: 200 len: 1391 microversion: 2.1 time: 0.422977 Jul 23 21:19:50.800371 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 758/1519] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:19:50 2022] GET /compute/v2.1/servers/784e1fb4-876e-489f-9428-e01412642663 => generated 1391 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:19:50.819226 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-fffabe18-bb2b-4bec-94f4-1c471801adba tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:50.819899 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-fffabe18-bb2b-4bec-94f4-1c471801adba tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: 214b4d99-34d8-48c7-924c-27cd2f6712e7] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:50.849524 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fffabe18-bb2b-4bec-94f4-1c471801adba tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:50.850335 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fffabe18-bb2b-4bec-94f4-1c471801adba tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:50.851121 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fffabe18-bb2b-4bec-94f4-1c471801adba tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:50.851564 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fffabe18-bb2b-4bec-94f4-1c471801adba tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:50.939213 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-0dde492d-9ccb-4aa3-8400-e889c85430b5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Going to run 1 instances... {{(pid=131320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:19:50.942217 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-0dde492d-9ccb-4aa3-8400-e889c85430b5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='45847d66-e6fb-4802-888a-09b3751e9a66',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='d1dcd2ad-1f42-4cd4-ae7b-4f9ec30b5094',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='05a64e2b-5dee-45e2-80f3-6e3860844946',volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:19:51.108698 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-fffabe18-bb2b-4bec-94f4-1c471801adba tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:51.127333 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-fffabe18-bb2b-4bec-94f4-1c471801adba tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:51.130589 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-fffabe18-bb2b-4bec-94f4-1c471801adba tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:51.132714 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-fffabe18-bb2b-4bec-94f4-1c471801adba tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/214b4d99-34d8-48c7-924c-27cd2f6712e7" status: 200 len: 1488 microversion: 2.25 time: 0.328276 Jul 23 21:19:51.133296 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 759/1520] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:19:50 2022] GET /compute/v2.1/servers/214b4d99-34d8-48c7-924c-27cd2f6712e7 => generated 1488 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:19:51.147625 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-e92b7f21-a41d-4081-9a35-f61be4eb4cda req-78e2767d-7a0a-4249-8f4e-5cd79d238985 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "784e1fb4-876e-489f-9428-e01412642663", "name": "network-vif-unplugged", "status": "completed", "tag": "4078ff09-4171-488c-a197-d664957df578"}, {"name": "network-changed", "server_uuid": "784e1fb4-876e-489f-9428-e01412642663", "tag": "4078ff09-4171-488c-a197-d664957df578"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:19:51.168982 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-e92b7f21-a41d-4081-9a35-f61be4eb4cda req-78e2767d-7a0a-4249-8f4e-5cd79d238985 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:51.169842 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-e92b7f21-a41d-4081-9a35-f61be4eb4cda req-78e2767d-7a0a-4249-8f4e-5cd79d238985 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:51.221038 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-e92b7f21-a41d-4081-9a35-f61be4eb4cda req-78e2767d-7a0a-4249-8f4e-5cd79d238985 service nova] Creating event network-vif-unplugged:4078ff09-4171-488c-a197-d664957df578 for instance 784e1fb4-876e-489f-9428-e01412642663 on nch1-master-1 Jul 23 21:19:51.223086 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-e92b7f21-a41d-4081-9a35-f61be4eb4cda req-78e2767d-7a0a-4249-8f4e-5cd79d238985 service nova] Creating event network-changed:4078ff09-4171-488c-a197-d664957df578 for instance 784e1fb4-876e-489f-9428-e01412642663 on nch1-master-1 Jul 23 21:19:51.238363 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-e92b7f21-a41d-4081-9a35-f61be4eb4cda req-78e2767d-7a0a-4249-8f4e-5cd79d238985 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.096575 Jul 23 21:19:51.239451 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 760/1521] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:19:51 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:19:51.247637 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-0c613164-03e3-4683-b56e-51616a9273f0 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:51.248504 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-0c613164-03e3-4683-b56e-51616a9273f0 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 080674a1-a720-4058-b74a-79bb1a61f5b1] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:51.272726 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0c613164-03e3-4683-b56e-51616a9273f0 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:51.272726 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0c613164-03e3-4683-b56e-51616a9273f0 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:51.272726 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0c613164-03e3-4683-b56e-51616a9273f0 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:51.272726 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0c613164-03e3-4683-b56e-51616a9273f0 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:51.515799 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-0dde492d-9ccb-4aa3-8400-e889c85430b5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.42 time: 6.796611 Jul 23 21:19:51.522100 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 762/1522] 10.222.0.17 () {62 vars in 1188 bytes} [Sat Jul 23 21:19:44 2022] POST /compute/v2.1/servers => generated 405 bytes in 6803 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 23 21:19:51.527736 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-90bafeaf-03e4-40f7-b9e2-7f53a48cc5be tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:51.528574 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-90bafeaf-03e4-40f7-b9e2-7f53a48cc5be tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] [instance: d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:51.535576 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-90bafeaf-03e4-40f7-b9e2-7f53a48cc5be tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:51.536281 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-90bafeaf-03e4-40f7-b9e2-7f53a48cc5be tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:51.538308 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-90bafeaf-03e4-40f7-b9e2-7f53a48cc5be tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:51.539028 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-90bafeaf-03e4-40f7-b9e2-7f53a48cc5be tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:51.639439 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-0c613164-03e3-4683-b56e-51616a9273f0 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4f9dda4c2a411cb0394bf86e9ae223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580ed681cbf44d10936259b17f60f1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:51.651076 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-0c613164-03e3-4683-b56e-51616a9273f0 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/servers/080674a1-a720-4058-b74a-79bb1a61f5b1" status: 200 len: 1507 microversion: 2.1 time: 0.409141 Jul 23 21:19:51.651769 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 761/1523] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:19:51 2022] GET /compute/v2.1/servers/080674a1-a720-4058-b74a-79bb1a61f5b1 => generated 1507 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:19:51.669202 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d9b4da6b-5f1f-4511-96dd-15dd1da0071a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:51.670204 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-d9b4da6b-5f1f-4511-96dd-15dd1da0071a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:51.770261 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-90bafeaf-03e4-40f7-b9e2-7f53a48cc5be tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ef41817e4f5478bb7afdcb59ed634cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af16c62b144aa0972331a69e3638c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:51.774252 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:19:51.783203 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-90bafeaf-03e4-40f7-b9e2-7f53a48cc5be tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ef41817e4f5478bb7afdcb59ed634cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af16c62b144aa0972331a69e3638c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:51.786525 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-90bafeaf-03e4-40f7-b9e2-7f53a48cc5be tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ef41817e4f5478bb7afdcb59ed634cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af16c62b144aa0972331a69e3638c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:51.797078 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-d9b4da6b-5f1f-4511-96dd-15dd1da0071a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:51.810760 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-d9b4da6b-5f1f-4511-96dd-15dd1da0071a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:51.813017 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-90bafeaf-03e4-40f7-b9e2-7f53a48cc5be tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] 10.222.0.17 "GET /compute/v2.1/servers/d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a" status: 200 len: 1437 microversion: 2.75 time: 0.286578 Jul 23 21:19:51.814345 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-d9b4da6b-5f1f-4511-96dd-15dd1da0071a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:51.820063 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-d9b4da6b-5f1f-4511-96dd-15dd1da0071a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1285 microversion: 2.42 time: 0.162888 Jul 23 21:19:51.820854 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 762/1524] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:19:51 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1285 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:19:51.825952 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-6df7e298-d09d-4382-9cc9-3c327ba91a7b req-c549f20b-6a21-4bc6-b139-ec023cec9e05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "080674a1-a720-4058-b74a-79bb1a61f5b1", "name": "network-vif-plugged", "status": "completed", "tag": "a69505b1-ef69-4514-98f6-e474707e5b3e"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:19:51.827256 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 763/1525] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:19:51 2022] GET /compute/v2.1/servers/d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a => generated 1437 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:19:51.841531 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-880decc2-c900-4336-978f-417c56550085 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:51.843859 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:19:51.845663 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-880decc2-c900-4336-978f-417c56550085 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 784e1fb4-876e-489f-9428-e01412642663] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:51.858321 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-880decc2-c900-4336-978f-417c56550085 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:51.860411 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-6df7e298-d09d-4382-9cc9-3c327ba91a7b req-c549f20b-6a21-4bc6-b139-ec023cec9e05 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:51.860869 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-6df7e298-d09d-4382-9cc9-3c327ba91a7b req-c549f20b-6a21-4bc6-b139-ec023cec9e05 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:51.862596 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-880decc2-c900-4336-978f-417c56550085 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:51.862921 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-880decc2-c900-4336-978f-417c56550085 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:51.863375 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-880decc2-c900-4336-978f-417c56550085 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:51.887971 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-6df7e298-d09d-4382-9cc9-3c327ba91a7b req-c549f20b-6a21-4bc6-b139-ec023cec9e05 service nova] Creating event network-vif-plugged:a69505b1-ef69-4514-98f6-e474707e5b3e for instance 080674a1-a720-4058-b74a-79bb1a61f5b1 on nch1-master-1 Jul 23 21:19:51.919941 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-6df7e298-d09d-4382-9cc9-3c327ba91a7b req-c549f20b-6a21-4bc6-b139-ec023cec9e05 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097254 Jul 23 21:19:51.920728 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 763/1526] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:19:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:19:51.926483 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-b1cba9ff-5a02-42e6-b2f9-5674315c853f tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:19:51.928056 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-b1cba9ff-5a02-42e6-b2f9-5674315c853f tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] [instance: d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:51.940552 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b1cba9ff-5a02-42e6-b2f9-5674315c853f tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:51.941555 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b1cba9ff-5a02-42e6-b2f9-5674315c853f tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:51.941772 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b1cba9ff-5a02-42e6-b2f9-5674315c853f tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:51.942232 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b1cba9ff-5a02-42e6-b2f9-5674315c853f tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:52.060496 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-b1cba9ff-5a02-42e6-b2f9-5674315c853f tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Flavor limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:19:52.061105 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-b1cba9ff-5a02-42e6-b2f9-5674315c853f tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Image limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:19:52.061789 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-b1cba9ff-5a02-42e6-b2f9-5674315c853f tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Flavor pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:19:52.062389 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-b1cba9ff-5a02-42e6-b2f9-5674315c853f tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Image pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:19:52.062873 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-b1cba9ff-5a02-42e6-b2f9-5674315c853f tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:19:52.153514 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-b1cba9ff-5a02-42e6-b2f9-5674315c853f tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] [instance: d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:52.162214 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b1cba9ff-5a02-42e6-b2f9-5674315c853f tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:52.162813 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b1cba9ff-5a02-42e6-b2f9-5674315c853f tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:52.163610 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b1cba9ff-5a02-42e6-b2f9-5674315c853f tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:52.164056 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b1cba9ff-5a02-42e6-b2f9-5674315c853f tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:52.257610 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-b1cba9ff-5a02-42e6-b2f9-5674315c853f tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ef41817e4f5478bb7afdcb59ed634cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af16c62b144aa0972331a69e3638c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:52.271316 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-b1cba9ff-5a02-42e6-b2f9-5674315c853f tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ef41817e4f5478bb7afdcb59ed634cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af16c62b144aa0972331a69e3638c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:52.276033 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-b1cba9ff-5a02-42e6-b2f9-5674315c853f tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ef41817e4f5478bb7afdcb59ed634cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af16c62b144aa0972331a69e3638c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:52.288474 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-b1cba9ff-5a02-42e6-b2f9-5674315c853f tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] 10.222.0.17 "POST /compute/v2.1/servers/d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a/action" status: 202 len: 1494 microversion: 2.75 time: 0.366158 Jul 23 21:19:52.290086 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 764/1527] 10.222.0.17 () {62 vars in 1318 bytes} [Sat Jul 23 21:19:51 2022] POST /compute/v2.1/servers/d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a/action => generated 1494 bytes in 369 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 23 21:19:52.296839 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-9ef4c1a5-3bea-4246-9050-e8f93add7935 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:52.297980 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-9ef4c1a5-3bea-4246-9050-e8f93add7935 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: 214b4d99-34d8-48c7-924c-27cd2f6712e7] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:52.308906 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9ef4c1a5-3bea-4246-9050-e8f93add7935 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:52.309809 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9ef4c1a5-3bea-4246-9050-e8f93add7935 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:52.311033 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9ef4c1a5-3bea-4246-9050-e8f93add7935 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:52.312657 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9ef4c1a5-3bea-4246-9050-e8f93add7935 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:52.399207 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-880decc2-c900-4336-978f-417c56550085 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:52.418711 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-880decc2-c900-4336-978f-417c56550085 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/784e1fb4-876e-489f-9428-e01412642663" status: 200 len: 1391 microversion: 2.1 time: 0.590207 Jul 23 21:19:52.419736 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 764/1528] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:19:51 2022] GET /compute/v2.1/servers/784e1fb4-876e-489f-9428-e01412642663 => generated 1391 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:19:52.434547 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e203c375-a0d8-44e0-8b72-82cebe42bf6b tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:52.452899 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e203c375-a0d8-44e0-8b72-82cebe42bf6b tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] [instance: d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:52.462382 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e203c375-a0d8-44e0-8b72-82cebe42bf6b tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:52.463064 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e203c375-a0d8-44e0-8b72-82cebe42bf6b tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:52.464130 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e203c375-a0d8-44e0-8b72-82cebe42bf6b tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:52.464738 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e203c375-a0d8-44e0-8b72-82cebe42bf6b tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:52.545776 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-9ef4c1a5-3bea-4246-9050-e8f93add7935 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:52.564011 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-9ef4c1a5-3bea-4246-9050-e8f93add7935 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:52.566333 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-9ef4c1a5-3bea-4246-9050-e8f93add7935 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:52.567735 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-9ef4c1a5-3bea-4246-9050-e8f93add7935 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/214b4d99-34d8-48c7-924c-27cd2f6712e7" status: 200 len: 1488 microversion: 2.25 time: 0.276307 Jul 23 21:19:52.579526 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 765/1529] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:19:52 2022] GET /compute/v2.1/servers/214b4d99-34d8-48c7-924c-27cd2f6712e7 => generated 1488 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:19:52.622641 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e203c375-a0d8-44e0-8b72-82cebe42bf6b tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ef41817e4f5478bb7afdcb59ed634cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af16c62b144aa0972331a69e3638c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:52.634354 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e203c375-a0d8-44e0-8b72-82cebe42bf6b tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ef41817e4f5478bb7afdcb59ed634cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af16c62b144aa0972331a69e3638c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:52.636858 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e203c375-a0d8-44e0-8b72-82cebe42bf6b tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ef41817e4f5478bb7afdcb59ed634cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af16c62b144aa0972331a69e3638c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:52.642980 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e203c375-a0d8-44e0-8b72-82cebe42bf6b tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] 10.222.0.17 "GET /compute/v2.1/servers/d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a" status: 200 len: 1446 microversion: 2.75 time: 0.212346 Jul 23 21:19:52.643791 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 765/1530] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:19:52 2022] GET /compute/v2.1/servers/d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a => generated 1446 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:19:52.675542 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-0b73e604-3b66-4c65-8d37-5d6065eb4834 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:52.676284 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-0b73e604-3b66-4c65-8d37-5d6065eb4834 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 080674a1-a720-4058-b74a-79bb1a61f5b1] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:52.698516 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0b73e604-3b66-4c65-8d37-5d6065eb4834 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:52.698926 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0b73e604-3b66-4c65-8d37-5d6065eb4834 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:52.700116 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0b73e604-3b66-4c65-8d37-5d6065eb4834 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:52.704943 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0b73e604-3b66-4c65-8d37-5d6065eb4834 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:52.720439 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d630e86c-a897-44ba-a7b6-59228208b20e tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:52.720972 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d630e86c-a897-44ba-a7b6-59228208b20e tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 5bc4befa-252d-456a-92cd-323bad80fcdf] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:52.745682 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d630e86c-a897-44ba-a7b6-59228208b20e tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:52.746839 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d630e86c-a897-44ba-a7b6-59228208b20e tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:52.748132 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d630e86c-a897-44ba-a7b6-59228208b20e tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:52.749147 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d630e86c-a897-44ba-a7b6-59228208b20e tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:52.796288 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d630e86c-a897-44ba-a7b6-59228208b20e tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 5bc4befa-252d-456a-92cd-323bad80fcdf] Going to try to terminate instance {{(pid=131320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:19:52.905523 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d630e86c-a897-44ba-a7b6-59228208b20e tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "DELETE /compute/v2.1/servers/5bc4befa-252d-456a-92cd-323bad80fcdf" status: 204 len: 0 microversion: 2.1 time: 0.195425 Jul 23 21:19:52.909458 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 766/1531] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:19:52 2022] DELETE /compute/v2.1/servers/5bc4befa-252d-456a-92cd-323bad80fcdf => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:19:52.921229 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c5681a20-ed24-4868-b3b6-72ff3b5a059d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:52.922388 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c5681a20-ed24-4868-b3b6-72ff3b5a059d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:52.931835 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c5681a20-ed24-4868-b3b6-72ff3b5a059d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:52.932665 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c5681a20-ed24-4868-b3b6-72ff3b5a059d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:52.934363 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c5681a20-ed24-4868-b3b6-72ff3b5a059d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:52.935423 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c5681a20-ed24-4868-b3b6-72ff3b5a059d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:53.099661 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-0b73e604-3b66-4c65-8d37-5d6065eb4834 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4f9dda4c2a411cb0394bf86e9ae223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580ed681cbf44d10936259b17f60f1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:53.112040 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-0b73e604-3b66-4c65-8d37-5d6065eb4834 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/servers/080674a1-a720-4058-b74a-79bb1a61f5b1" status: 200 len: 1502 microversion: 2.1 time: 0.445530 Jul 23 21:19:53.112723 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 766/1532] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:19:52 2022] GET /compute/v2.1/servers/080674a1-a720-4058-b74a-79bb1a61f5b1 => generated 1502 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:19:53.131443 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-243f5f55-027e-46b8-b848-64ad8feba2d7 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:53.132143 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-243f5f55-027e-46b8-b848-64ad8feba2d7 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 5bc4befa-252d-456a-92cd-323bad80fcdf] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:53.146917 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-243f5f55-027e-46b8-b848-64ad8feba2d7 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:53.147696 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-243f5f55-027e-46b8-b848-64ad8feba2d7 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:53.148770 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-243f5f55-027e-46b8-b848-64ad8feba2d7 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:53.149543 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-243f5f55-027e-46b8-b848-64ad8feba2d7 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:53.237954 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c5681a20-ed24-4868-b3b6-72ff3b5a059d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:53.252162 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c5681a20-ed24-4868-b3b6-72ff3b5a059d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:53.253845 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c5681a20-ed24-4868-b3b6-72ff3b5a059d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:53.255319 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c5681a20-ed24-4868-b3b6-72ff3b5a059d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1519 microversion: 2.42 time: 0.343456 Jul 23 21:19:53.258629 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 767/1533] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:19:52 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1519 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:19:53.277077 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-7759c755-5a8b-43ab-b6de-55c781cd1e25 req-3a90f463-4487-4d71-bbd9-74ec7665aeec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "214b4d99-34d8-48c7-924c-27cd2f6712e7", "name": "network-vif-unplugged", "status": "completed", "tag": "a741c39b-97c1-40b2-8530-cc020cd5f926"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:19:53.285801 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-7759c755-5a8b-43ab-b6de-55c781cd1e25 req-3a90f463-4487-4d71-bbd9-74ec7665aeec service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:53.286282 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-7759c755-5a8b-43ab-b6de-55c781cd1e25 req-3a90f463-4487-4d71-bbd9-74ec7665aeec service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:53.298701 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-7759c755-5a8b-43ab-b6de-55c781cd1e25 req-3a90f463-4487-4d71-bbd9-74ec7665aeec service nova] Creating event network-vif-unplugged:a741c39b-97c1-40b2-8530-cc020cd5f926 for instance 214b4d99-34d8-48c7-924c-27cd2f6712e7 on nch2-master-1 Jul 23 21:19:53.303763 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-7759c755-5a8b-43ab-b6de-55c781cd1e25 req-3a90f463-4487-4d71-bbd9-74ec7665aeec service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030549 Jul 23 21:19:53.304726 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 768/1534] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:19:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:19:53.409708 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-243f5f55-027e-46b8-b848-64ad8feba2d7 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:53.418282 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-243f5f55-027e-46b8-b848-64ad8feba2d7 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/5bc4befa-252d-456a-92cd-323bad80fcdf" status: 200 len: 1468 microversion: 2.1 time: 0.304452 Jul 23 21:19:53.418847 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 767/1535] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:19:53 2022] GET /compute/v2.1/servers/5bc4befa-252d-456a-92cd-323bad80fcdf => generated 1468 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:19:53.437365 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-bf1b2390-357f-4f3f-9573-2e850b9db1b1 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:53.438098 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-bf1b2390-357f-4f3f-9573-2e850b9db1b1 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 784e1fb4-876e-489f-9428-e01412642663] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:53.444602 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bf1b2390-357f-4f3f-9573-2e850b9db1b1 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:53.445058 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bf1b2390-357f-4f3f-9573-2e850b9db1b1 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:53.445825 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bf1b2390-357f-4f3f-9573-2e850b9db1b1 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:53.446339 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bf1b2390-357f-4f3f-9573-2e850b9db1b1 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:53.588662 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-6e63a5de-c949-422a-abd0-99132374129e tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:53.590108 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-6e63a5de-c949-422a-abd0-99132374129e tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: 214b4d99-34d8-48c7-924c-27cd2f6712e7] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:53.599536 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6e63a5de-c949-422a-abd0-99132374129e tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:53.600339 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6e63a5de-c949-422a-abd0-99132374129e tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:53.601492 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6e63a5de-c949-422a-abd0-99132374129e tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:53.602136 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6e63a5de-c949-422a-abd0-99132374129e tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:53.622502 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-bf1b2390-357f-4f3f-9573-2e850b9db1b1 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:53.632646 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-bf1b2390-357f-4f3f-9573-2e850b9db1b1 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/784e1fb4-876e-489f-9428-e01412642663" status: 200 len: 1391 microversion: 2.1 time: 0.199351 Jul 23 21:19:53.633836 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 769/1536] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:19:53 2022] GET /compute/v2.1/servers/784e1fb4-876e-489f-9428-e01412642663 => generated 1391 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:19:53.665629 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a2678bf6-eeb4-4db0-a407-122d733c957b tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:53.667696 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a2678bf6-eeb4-4db0-a407-122d733c957b tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] [instance: d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:53.677283 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a2678bf6-eeb4-4db0-a407-122d733c957b tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:53.677920 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a2678bf6-eeb4-4db0-a407-122d733c957b tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:53.679044 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a2678bf6-eeb4-4db0-a407-122d733c957b tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:53.679742 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a2678bf6-eeb4-4db0-a407-122d733c957b tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:53.808166 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a2678bf6-eeb4-4db0-a407-122d733c957b tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ef41817e4f5478bb7afdcb59ed634cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af16c62b144aa0972331a69e3638c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:53.825478 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a2678bf6-eeb4-4db0-a407-122d733c957b tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ef41817e4f5478bb7afdcb59ed634cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af16c62b144aa0972331a69e3638c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:53.827358 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a2678bf6-eeb4-4db0-a407-122d733c957b tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ef41817e4f5478bb7afdcb59ed634cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af16c62b144aa0972331a69e3638c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:53.838122 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a2678bf6-eeb4-4db0-a407-122d733c957b tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] 10.222.0.17 "GET /compute/v2.1/servers/d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a" status: 200 len: 1446 microversion: 2.75 time: 0.177349 Jul 23 21:19:53.862431 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 770/1537] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:19:53 2022] GET /compute/v2.1/servers/d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a => generated 1446 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:19:53.901022 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-6e63a5de-c949-422a-abd0-99132374129e tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:53.913291 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-6e63a5de-c949-422a-abd0-99132374129e tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:53.919560 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-6e63a5de-c949-422a-abd0-99132374129e tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:53.921002 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-6e63a5de-c949-422a-abd0-99132374129e tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/214b4d99-34d8-48c7-924c-27cd2f6712e7" status: 200 len: 1488 microversion: 2.25 time: 0.338396 Jul 23 21:19:53.922069 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 768/1538] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:19:53 2022] GET /compute/v2.1/servers/214b4d99-34d8-48c7-924c-27cd2f6712e7 => generated 1488 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:19:54.134258 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-91309317-add4-4518-9727-af2bc4eaa75d tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:54.134901 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-91309317-add4-4518-9727-af2bc4eaa75d tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 080674a1-a720-4058-b74a-79bb1a61f5b1] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:54.145934 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-91309317-add4-4518-9727-af2bc4eaa75d tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:54.146394 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-91309317-add4-4518-9727-af2bc4eaa75d tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:54.147430 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-91309317-add4-4518-9727-af2bc4eaa75d tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:54.147933 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-91309317-add4-4518-9727-af2bc4eaa75d tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:54.297953 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-58425b96-2848-4215-873b-cf356b47b735 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:54.299195 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-58425b96-2848-4215-873b-cf356b47b735 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:54.319700 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-58425b96-2848-4215-873b-cf356b47b735 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:54.320342 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-58425b96-2848-4215-873b-cf356b47b735 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:54.322736 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-58425b96-2848-4215-873b-cf356b47b735 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:54.323724 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-58425b96-2848-4215-873b-cf356b47b735 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:54.414575 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-91309317-add4-4518-9727-af2bc4eaa75d tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4f9dda4c2a411cb0394bf86e9ae223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580ed681cbf44d10936259b17f60f1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:54.427639 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-91309317-add4-4518-9727-af2bc4eaa75d tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/servers/080674a1-a720-4058-b74a-79bb1a61f5b1" status: 200 len: 1489 microversion: 2.1 time: 0.298311 Jul 23 21:19:54.429331 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 771/1539] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:19:54 2022] GET /compute/v2.1/servers/080674a1-a720-4058-b74a-79bb1a61f5b1 => generated 1489 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:19:54.447866 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8701d908-0328-44d1-b012-cf993cded1a1 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:54.448832 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8701d908-0328-44d1-b012-cf993cded1a1 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 5bc4befa-252d-456a-92cd-323bad80fcdf] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:54.456888 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8701d908-0328-44d1-b012-cf993cded1a1 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:54.457661 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8701d908-0328-44d1-b012-cf993cded1a1 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:54.459076 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8701d908-0328-44d1-b012-cf993cded1a1 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:54.460029 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8701d908-0328-44d1-b012-cf993cded1a1 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:54.569304 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-58425b96-2848-4215-873b-cf356b47b735 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:54.583259 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-58425b96-2848-4215-873b-cf356b47b735 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:54.585313 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-58425b96-2848-4215-873b-cf356b47b735 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:54.589481 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-58425b96-2848-4215-873b-cf356b47b735 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1593 microversion: 2.42 time: 0.317822 Jul 23 21:19:54.593288 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 769/1540] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:19:54 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1593 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:19:54.598867 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-564577a5-e597-4e64-a98e-449ccaa8f3bb tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:54.599738 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-564577a5-e597-4e64-a98e-449ccaa8f3bb tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 080674a1-a720-4058-b74a-79bb1a61f5b1] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:54.608356 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-564577a5-e597-4e64-a98e-449ccaa8f3bb tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:54.609219 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-564577a5-e597-4e64-a98e-449ccaa8f3bb tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:54.621386 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-564577a5-e597-4e64-a98e-449ccaa8f3bb tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:54.622161 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-564577a5-e597-4e64-a98e-449ccaa8f3bb tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:54.665948 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-564577a5-e597-4e64-a98e-449ccaa8f3bb tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 080674a1-a720-4058-b74a-79bb1a61f5b1] Going to try to terminate instance {{(pid=131321) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:19:54.862205 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-564577a5-e597-4e64-a98e-449ccaa8f3bb tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "DELETE /compute/v2.1/servers/080674a1-a720-4058-b74a-79bb1a61f5b1" status: 204 len: 0 microversion: 2.1 time: 0.265668 Jul 23 21:19:54.862827 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 770/1541] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:19:54 2022] DELETE /compute/v2.1/servers/080674a1-a720-4058-b74a-79bb1a61f5b1 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:19:54.887515 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-5e553c55-eb7a-4076-a961-a24a0d9b2134 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:54.888533 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-5e553c55-eb7a-4076-a961-a24a0d9b2134 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 784e1fb4-876e-489f-9428-e01412642663] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:54.901162 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5e553c55-eb7a-4076-a961-a24a0d9b2134 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:54.903065 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5e553c55-eb7a-4076-a961-a24a0d9b2134 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:54.909720 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5e553c55-eb7a-4076-a961-a24a0d9b2134 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:54.913469 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5e553c55-eb7a-4076-a961-a24a0d9b2134 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:54.951660 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:19:55.185428 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-5e553c55-eb7a-4076-a961-a24a0d9b2134 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:55.201195 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-5e553c55-eb7a-4076-a961-a24a0d9b2134 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/784e1fb4-876e-489f-9428-e01412642663" status: 200 len: 1391 microversion: 2.1 time: 0.333134 Jul 23 21:19:55.202057 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 771/1542] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:19:54 2022] GET /compute/v2.1/servers/784e1fb4-876e-489f-9428-e01412642663 => generated 1391 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:19:55.221755 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-746aedf0-724a-4530-a229-634cb274a497 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:55.225659 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-746aedf0-724a-4530-a229-634cb274a497 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] [instance: d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:55.242924 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-746aedf0-724a-4530-a229-634cb274a497 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:55.246397 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-746aedf0-724a-4530-a229-634cb274a497 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:55.247870 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-746aedf0-724a-4530-a229-634cb274a497 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:55.248532 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-746aedf0-724a-4530-a229-634cb274a497 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:55.376993 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-746aedf0-724a-4530-a229-634cb274a497 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ef41817e4f5478bb7afdcb59ed634cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af16c62b144aa0972331a69e3638c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:55.386983 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-746aedf0-724a-4530-a229-634cb274a497 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ef41817e4f5478bb7afdcb59ed634cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af16c62b144aa0972331a69e3638c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:55.388667 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-746aedf0-724a-4530-a229-634cb274a497 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ef41817e4f5478bb7afdcb59ed634cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af16c62b144aa0972331a69e3638c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:55.401913 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-746aedf0-724a-4530-a229-634cb274a497 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] 10.222.0.17 "GET /compute/v2.1/servers/d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a" status: 200 len: 1446 microversion: 2.75 time: 0.199014 Jul 23 21:19:55.417889 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 772/1543] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:19:55 2022] GET /compute/v2.1/servers/d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a => generated 1446 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:19:55.422935 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-b9fc7644-2c57-4e02-9101-afa85f308c45 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '.version_select at 0x7f0b47fac0d0>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:55.437379 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8701d908-0328-44d1-b012-cf993cded1a1 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:55.447349 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8701d908-0328-44d1-b012-cf993cded1a1 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/5bc4befa-252d-456a-92cd-323bad80fcdf" status: 200 len: 1468 microversion: 2.1 time: 1.004384 Jul 23 21:19:55.447961 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 772/1544] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:19:54 2022] GET /compute/v2.1/servers/5bc4befa-252d-456a-92cd-323bad80fcdf => generated 1468 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:19:55.459435 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e48018f8-798b-436a-98c4-3df5e5e6172a tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:55.465568 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e48018f8-798b-436a-98c4-3df5e5e6172a tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: 214b4d99-34d8-48c7-924c-27cd2f6712e7] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:55.478819 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e48018f8-798b-436a-98c4-3df5e5e6172a tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:55.479280 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e48018f8-798b-436a-98c4-3df5e5e6172a tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:55.480516 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e48018f8-798b-436a-98c4-3df5e5e6172a tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:55.485555 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e48018f8-798b-436a-98c4-3df5e5e6172a tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:55.501345 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-b9fc7644-2c57-4e02-9101-afa85f308c45 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] HTTP exception thrown: Image not found. Jul 23 21:19:55.505490 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-b9fc7644-2c57-4e02-9101-afa85f308c45 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Request method failure captured: Jul 23 21:19:55.505490 ncdv-master-1 devstack@n-api.service[131321]: request: DELETE /compute/v2.1/images/4095e8c4-03d9-4453-9850-a7a48a5f0b59 HTTP/1.1 Jul 23 21:19:55.505490 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:19:55.505490 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:19:55.505490 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:19:55.505490 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:19:55.505490 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:19:55.505490 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:19:55.505490 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:19:55.505490 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:19:55.505490 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GUJELDL_GsNeJwREywE_3jBr1HvzTVincHoSaHkmz1z6GZZjegpx0r2IR_6PBi9Tra-YYsN5qwdwSaeOz6I0mD6V9yMAx7BFDMUjtY9rJu7mfhQyUGyuxYI08t_rWsJ-odD6MQO0mzNpwl75bL9POwUU9lfytO2Ec0dK9a6mg0ozik Jul 23 21:19:55.505490 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:19:55.505490 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:19:55.505490 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:19:55.505490 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:19:55.505490 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:19:55.505490 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:19:55.505490 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 580ed681cbf44d10936259b17f60f1b2 Jul 23 21:19:55.505490 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ImagesTestJSON-1070983287 Jul 23 21:19:55.505490 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:19:55.505490 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:19:55.507402 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/580ed681cbf44d10936259b17f60f1b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/580ed681cbf44d10936259b17f60f1b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_580ed681cbf44d10936259b17f60f1b2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/580ed681cbf44d10936259b17f60f1b2"}]}] Jul 23 21:19:55.507402 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ImagesTestJSON-1070983287 Jul 23 21:19:55.507402 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 580ed681cbf44d10936259b17f60f1b2 Jul 23 21:19:55.507402 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ImagesTestJSON-1070983287 Jul 23 21:19:55.507402 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ImagesTestJSON-1070983287-project Jul 23 21:19:55.507402 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:19:55.507402 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:19:55.507402 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: bb4f9dda4c2a411cb0394bf86e9ae223 Jul 23 21:19:55.507402 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ImagesTestJSON-1070983287-project Jul 23 21:19:55.507402 ncdv-master-1 devstack@n-api.service[131321]: method: Jul 23 21:19:55.507402 ncdv-master-1 devstack@n-api.service[131321]: exception: Image not found. Jul 23 21:19:55.507402 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': '4095e8c4-03d9-4453-9850-a7a48a5f0b59'} Jul 23 21:19:55.507402 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:19:55.507402 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:19:55.509369 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 23 21:19:55.509369 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 23 21:19:55.509369 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 23 21:19:55.509369 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 23 21:19:55.509369 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 23 21:19:55.509369 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 23 21:19:55.509369 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 23 21:19:55.509369 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 23 21:19:55.509369 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 23 21:19:55.509369 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 23 21:19:55.509369 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 23 21:19:55.509369 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 23 21:19:55.509369 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 23 21:19:55.509369 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 23 21:19:55.509369 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 4095e8c4-03d9-4453-9850-a7a48a5f0b59 to delete Jul 23 21:19:55.509369 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:19:55.509369 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:19:55.509369 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:19:55.509369 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:19:55.511156 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 23 21:19:55.511156 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 23 21:19:55.511156 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 23 21:19:55.511156 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 23 21:19:55.511156 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 23 21:19:55.511156 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 23 21:19:55.511156 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4095e8c4-03d9-4453-9850-a7a48a5f0b59 could not be found. Jul 23 21:19:55.511156 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:19:55.511156 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:19:55.511156 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:19:55.511156 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:19:55.511156 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:19:55.511156 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:19:55.511156 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:19:55.511156 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:19:55.511156 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:19:55.511156 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:19:55.511156 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:19:55.511156 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:19:55.511156 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 23 21:19:55.513967 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 23 21:19:55.513967 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 23 21:19:55.513967 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:19:55.513967 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:19:55.513967 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:19:55.513967 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:19:55.513967 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:19:55.513967 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:19:55.513967 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:19:55.513967 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:19:55.513967 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 23 21:19:55.513967 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:19:55.518790 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-b9fc7644-2c57-4e02-9101-afa85f308c45 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Returning 404 to user: Image not found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:19:55.520174 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-b9fc7644-2c57-4e02-9101-afa85f308c45 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "DELETE /compute/v2.1/images/4095e8c4-03d9-4453-9850-a7a48a5f0b59" status: 404 len: 62 microversion: 2.1 time: 0.101070 Jul 23 21:19:55.521181 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 773/1545] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:19:55 2022] DELETE /compute/v2.1/images/4095e8c4-03d9-4453-9850-a7a48a5f0b59 => generated 62 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 23 21:19:55.537583 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-0c945d64-56f1-47c0-964b-107f08205e80 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:55.538463 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-0c945d64-56f1-47c0-964b-107f08205e80 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 080674a1-a720-4058-b74a-79bb1a61f5b1] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:55.549422 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0c945d64-56f1-47c0-964b-107f08205e80 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:55.550403 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0c945d64-56f1-47c0-964b-107f08205e80 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:55.552010 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0c945d64-56f1-47c0-964b-107f08205e80 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:55.552663 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0c945d64-56f1-47c0-964b-107f08205e80 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:55.608902 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-0c945d64-56f1-47c0-964b-107f08205e80 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 080674a1-a720-4058-b74a-79bb1a61f5b1] Going to try to terminate instance {{(pid=131321) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:19:55.772506 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.compute.api [None req-0c945d64-56f1-47c0-964b-107f08205e80 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 080674a1-a720-4058-b74a-79bb1a61f5b1] Instance is already in deleting state, ignoring this request Jul 23 21:19:55.774234 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-0c945d64-56f1-47c0-964b-107f08205e80 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "DELETE /compute/v2.1/servers/080674a1-a720-4058-b74a-79bb1a61f5b1" status: 204 len: 0 microversion: 2.1 time: 0.242838 Jul 23 21:19:55.791958 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 774/1546] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:19:55 2022] DELETE /compute/v2.1/servers/080674a1-a720-4058-b74a-79bb1a61f5b1 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:19:55.808474 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ac53dfaa-14d7-44ec-97be-5c3fbae367d4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:55.810743 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-ac53dfaa-14d7-44ec-97be-5c3fbae367d4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:55.832596 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ac53dfaa-14d7-44ec-97be-5c3fbae367d4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:55.833294 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ac53dfaa-14d7-44ec-97be-5c3fbae367d4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:55.835414 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ac53dfaa-14d7-44ec-97be-5c3fbae367d4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:55.838174 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ac53dfaa-14d7-44ec-97be-5c3fbae367d4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:55.943835 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e48018f8-798b-436a-98c4-3df5e5e6172a tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:55.960089 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e48018f8-798b-436a-98c4-3df5e5e6172a tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:55.963461 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e48018f8-798b-436a-98c4-3df5e5e6172a tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:55.968310 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e48018f8-798b-436a-98c4-3df5e5e6172a tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/214b4d99-34d8-48c7-924c-27cd2f6712e7" status: 200 len: 1488 microversion: 2.25 time: 0.510718 Jul 23 21:19:55.970333 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 773/1547] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:19:55 2022] GET /compute/v2.1/servers/214b4d99-34d8-48c7-924c-27cd2f6712e7 => generated 1488 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:19:55.977715 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6d21078a-fb9e-4b2f-9dbf-bcdf856ff6bb tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:55.979213 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6d21078a-fb9e-4b2f-9dbf-bcdf856ff6bb tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 080674a1-a720-4058-b74a-79bb1a61f5b1] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:55.990466 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6d21078a-fb9e-4b2f-9dbf-bcdf856ff6bb tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:55.991410 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6d21078a-fb9e-4b2f-9dbf-bcdf856ff6bb tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:56.010666 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6d21078a-fb9e-4b2f-9dbf-bcdf856ff6bb tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:56.012681 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6d21078a-fb9e-4b2f-9dbf-bcdf856ff6bb tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:56.276668 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ac53dfaa-14d7-44ec-97be-5c3fbae367d4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:56.288727 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ac53dfaa-14d7-44ec-97be-5c3fbae367d4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:56.294944 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ac53dfaa-14d7-44ec-97be-5c3fbae367d4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:56.298244 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-ac53dfaa-14d7-44ec-97be-5c3fbae367d4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1660 microversion: 2.42 time: 0.501148 Jul 23 21:19:56.318940 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 775/1548] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:19:55 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1660 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:19:56.332244 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a7e1f0fe-7bc0-4521-be87-3001e47530f3 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:56.332907 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-a7e1f0fe-7bc0-4521-be87-3001e47530f3 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 784e1fb4-876e-489f-9428-e01412642663] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:56.345676 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a7e1f0fe-7bc0-4521-be87-3001e47530f3 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:56.346178 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a7e1f0fe-7bc0-4521-be87-3001e47530f3 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:56.346987 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a7e1f0fe-7bc0-4521-be87-3001e47530f3 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:56.347457 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a7e1f0fe-7bc0-4521-be87-3001e47530f3 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:56.369648 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6d21078a-fb9e-4b2f-9dbf-bcdf856ff6bb tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4f9dda4c2a411cb0394bf86e9ae223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580ed681cbf44d10936259b17f60f1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:56.388732 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6d21078a-fb9e-4b2f-9dbf-bcdf856ff6bb tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/servers/080674a1-a720-4058-b74a-79bb1a61f5b1" status: 200 len: 1495 microversion: 2.1 time: 0.415825 Jul 23 21:19:56.390029 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 774/1549] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:19:55 2022] GET /compute/v2.1/servers/080674a1-a720-4058-b74a-79bb1a61f5b1 => generated 1495 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:19:56.423178 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3a17bc8b-d9ca-4d98-98c5-36dcc4dfc1b6 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:56.424156 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-3a17bc8b-d9ca-4d98-98c5-36dcc4dfc1b6 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] [instance: d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:56.432545 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3a17bc8b-d9ca-4d98-98c5-36dcc4dfc1b6 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:56.433002 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3a17bc8b-d9ca-4d98-98c5-36dcc4dfc1b6 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:56.433807 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3a17bc8b-d9ca-4d98-98c5-36dcc4dfc1b6 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:56.434319 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3a17bc8b-d9ca-4d98-98c5-36dcc4dfc1b6 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:56.622082 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-3a17bc8b-d9ca-4d98-98c5-36dcc4dfc1b6 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ef41817e4f5478bb7afdcb59ed634cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af16c62b144aa0972331a69e3638c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:56.638805 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-3a17bc8b-d9ca-4d98-98c5-36dcc4dfc1b6 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ef41817e4f5478bb7afdcb59ed634cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af16c62b144aa0972331a69e3638c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:56.649320 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-3a17bc8b-d9ca-4d98-98c5-36dcc4dfc1b6 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ef41817e4f5478bb7afdcb59ed634cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af16c62b144aa0972331a69e3638c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:56.661752 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-3a17bc8b-d9ca-4d98-98c5-36dcc4dfc1b6 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] 10.222.0.17 "GET /compute/v2.1/servers/d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a" status: 200 len: 1446 microversion: 2.75 time: 0.242537 Jul 23 21:19:56.664363 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 775/1550] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:19:56 2022] GET /compute/v2.1/servers/d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a => generated 1446 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:19:56.679068 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-209a33a9-e361-469c-8849-b7534d5a36d2 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:56.680204 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-209a33a9-e361-469c-8849-b7534d5a36d2 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 5bc4befa-252d-456a-92cd-323bad80fcdf] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:56.693834 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-209a33a9-e361-469c-8849-b7534d5a36d2 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:56.694333 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-209a33a9-e361-469c-8849-b7534d5a36d2 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:56.695137 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-209a33a9-e361-469c-8849-b7534d5a36d2 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:56.695589 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-209a33a9-e361-469c-8849-b7534d5a36d2 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:56.881743 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell0:SELECT=2 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:19:57.107698 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-209a33a9-e361-469c-8849-b7534d5a36d2 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:57.119918 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-209a33a9-e361-469c-8849-b7534d5a36d2 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/5bc4befa-252d-456a-92cd-323bad80fcdf" status: 200 len: 1468 microversion: 2.1 time: 0.449706 Jul 23 21:19:57.122255 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 776/1551] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:19:56 2022] GET /compute/v2.1/servers/5bc4befa-252d-456a-92cd-323bad80fcdf => generated 1468 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:19:57.135126 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f166d624-379d-492b-8185-e78d8829ca90 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:57.135921 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f166d624-379d-492b-8185-e78d8829ca90 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: 214b4d99-34d8-48c7-924c-27cd2f6712e7] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:57.153522 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f166d624-379d-492b-8185-e78d8829ca90 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:57.156051 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f166d624-379d-492b-8185-e78d8829ca90 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:57.157362 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f166d624-379d-492b-8185-e78d8829ca90 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:57.160288 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f166d624-379d-492b-8185-e78d8829ca90 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:57.559017 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-a7e1f0fe-7bc0-4521-be87-3001e47530f3 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:57.571313 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-a7e1f0fe-7bc0-4521-be87-3001e47530f3 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/784e1fb4-876e-489f-9428-e01412642663" status: 200 len: 1391 microversion: 2.1 time: 1.250561 Jul 23 21:19:57.571963 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 776/1552] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:19:56 2022] GET /compute/v2.1/servers/784e1fb4-876e-489f-9428-e01412642663 => generated 1391 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:19:57.587390 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c58b59ad-353b-40a1-a79d-a17c3aa9340e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:57.589643 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-c58b59ad-353b-40a1-a79d-a17c3aa9340e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:57.605762 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c58b59ad-353b-40a1-a79d-a17c3aa9340e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:57.608780 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c58b59ad-353b-40a1-a79d-a17c3aa9340e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:57.613232 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c58b59ad-353b-40a1-a79d-a17c3aa9340e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:57.616393 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c58b59ad-353b-40a1-a79d-a17c3aa9340e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:57.737359 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f166d624-379d-492b-8185-e78d8829ca90 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:57.756221 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f166d624-379d-492b-8185-e78d8829ca90 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:57.758183 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f166d624-379d-492b-8185-e78d8829ca90 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:57.762748 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f166d624-379d-492b-8185-e78d8829ca90 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/214b4d99-34d8-48c7-924c-27cd2f6712e7" status: 200 len: 1488 microversion: 2.25 time: 0.638412 Jul 23 21:19:57.763479 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 777/1553] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:19:57 2022] GET /compute/v2.1/servers/214b4d99-34d8-48c7-924c-27cd2f6712e7 => generated 1488 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:19:57.775489 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b2c82ba8-a834-4a55-940a-6aff20309a72 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:57.776233 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b2c82ba8-a834-4a55-940a-6aff20309a72 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 080674a1-a720-4058-b74a-79bb1a61f5b1] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:57.793008 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b2c82ba8-a834-4a55-940a-6aff20309a72 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:57.797681 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b2c82ba8-a834-4a55-940a-6aff20309a72 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:57.798729 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b2c82ba8-a834-4a55-940a-6aff20309a72 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:57.799280 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b2c82ba8-a834-4a55-940a-6aff20309a72 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:58.200570 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b2c82ba8-a834-4a55-940a-6aff20309a72 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb4f9dda4c2a411cb0394bf86e9ae223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '580ed681cbf44d10936259b17f60f1b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:58.210556 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b2c82ba8-a834-4a55-940a-6aff20309a72 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/servers/080674a1-a720-4058-b74a-79bb1a61f5b1" status: 200 len: 1495 microversion: 2.1 time: 0.439041 Jul 23 21:19:58.213371 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 778/1554] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:19:57 2022] GET /compute/v2.1/servers/080674a1-a720-4058-b74a-79bb1a61f5b1 => generated 1495 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:19:58.229973 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3c63d418-dbd5-4740-93b9-cd23f8136562 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:58.231516 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-3c63d418-dbd5-4740-93b9-cd23f8136562 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] [instance: d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:58.259807 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3c63d418-dbd5-4740-93b9-cd23f8136562 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:58.263888 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3c63d418-dbd5-4740-93b9-cd23f8136562 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:58.265946 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3c63d418-dbd5-4740-93b9-cd23f8136562 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:58.266688 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3c63d418-dbd5-4740-93b9-cd23f8136562 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:58.354258 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:19:58.528257 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c58b59ad-353b-40a1-a79d-a17c3aa9340e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:58.560650 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c58b59ad-353b-40a1-a79d-a17c3aa9340e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:58.579043 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c58b59ad-353b-40a1-a79d-a17c3aa9340e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:58.583434 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-c58b59ad-353b-40a1-a79d-a17c3aa9340e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1706 microversion: 2.42 time: 1.008650 Jul 23 21:19:58.590683 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 777/1555] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:19:57 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1706 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:19:58.595810 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-b6b11d8a-be7e-4708-be0c-c729241174c0 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:58.598599 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-b6b11d8a-be7e-4708-be0c-c729241174c0 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 5bc4befa-252d-456a-92cd-323bad80fcdf] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:58.619721 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b6b11d8a-be7e-4708-be0c-c729241174c0 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:58.620476 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b6b11d8a-be7e-4708-be0c-c729241174c0 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:58.621471 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b6b11d8a-be7e-4708-be0c-c729241174c0 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:58.622096 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b6b11d8a-be7e-4708-be0c-c729241174c0 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:59.000181 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-3c63d418-dbd5-4740-93b9-cd23f8136562 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ef41817e4f5478bb7afdcb59ed634cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af16c62b144aa0972331a69e3638c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:59.028374 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-3c63d418-dbd5-4740-93b9-cd23f8136562 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ef41817e4f5478bb7afdcb59ed634cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af16c62b144aa0972331a69e3638c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:59.030471 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-3c63d418-dbd5-4740-93b9-cd23f8136562 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ef41817e4f5478bb7afdcb59ed634cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af16c62b144aa0972331a69e3638c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:59.072810 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-3c63d418-dbd5-4740-93b9-cd23f8136562 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] 10.222.0.17 "GET /compute/v2.1/servers/d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a" status: 200 len: 1446 microversion: 2.75 time: 0.857953 Jul 23 21:19:59.076719 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 779/1556] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:19:58 2022] GET /compute/v2.1/servers/d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a => generated 1446 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:19:59.109726 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-0ebb8805-36a3-4d09-8c2d-d6a929a988f9 req-06e54b5a-1d6b-4245-90c1-c3432b4fece6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "784e1fb4-876e-489f-9428-e01412642663", "name": "network-vif-unplugged", "status": "completed", "tag": "4078ff09-4171-488c-a197-d664957df578"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:19:59.156184 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-0ebb8805-36a3-4d09-8c2d-d6a929a988f9 req-06e54b5a-1d6b-4245-90c1-c3432b4fece6 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:59.156988 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-0ebb8805-36a3-4d09-8c2d-d6a929a988f9 req-06e54b5a-1d6b-4245-90c1-c3432b4fece6 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:59.197643 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-0ebb8805-36a3-4d09-8c2d-d6a929a988f9 req-06e54b5a-1d6b-4245-90c1-c3432b4fece6 service nova] Creating event network-vif-unplugged:4078ff09-4171-488c-a197-d664957df578 for instance 784e1fb4-876e-489f-9428-e01412642663 on nch1-master-1 Jul 23 21:19:59.212872 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-0ebb8805-36a3-4d09-8c2d-d6a929a988f9 req-06e54b5a-1d6b-4245-90c1-c3432b4fece6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.129502 Jul 23 21:19:59.216779 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 780/1557] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:19:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:19:59.245984 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1b4ed472-8ed8-421c-a9ec-02032cdc255c tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:59.256473 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1b4ed472-8ed8-421c-a9ec-02032cdc255c tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 784e1fb4-876e-489f-9428-e01412642663] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:59.287116 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1b4ed472-8ed8-421c-a9ec-02032cdc255c tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:59.291698 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1b4ed472-8ed8-421c-a9ec-02032cdc255c tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:59.298070 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1b4ed472-8ed8-421c-a9ec-02032cdc255c tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:59.298921 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1b4ed472-8ed8-421c-a9ec-02032cdc255c tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:59.434143 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-b6b11d8a-be7e-4708-be0c-c729241174c0 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:19:59.448169 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-b6b11d8a-be7e-4708-be0c-c729241174c0 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/5bc4befa-252d-456a-92cd-323bad80fcdf" status: 200 len: 1468 microversion: 2.1 time: 0.855994 Jul 23 21:19:59.449132 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 778/1558] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:19:58 2022] GET /compute/v2.1/servers/5bc4befa-252d-456a-92cd-323bad80fcdf => generated 1468 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:19:59.467601 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-b1acd266-34ad-4a46-bcf6-bfeba26f5926 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:19:59.471098 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-b1acd266-34ad-4a46-bcf6-bfeba26f5926 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: 214b4d99-34d8-48c7-924c-27cd2f6712e7] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:19:59.483656 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b1acd266-34ad-4a46-bcf6-bfeba26f5926 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:59.484158 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b1acd266-34ad-4a46-bcf6-bfeba26f5926 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:19:59.493042 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b1acd266-34ad-4a46-bcf6-bfeba26f5926 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:19:59.500052 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b1acd266-34ad-4a46-bcf6-bfeba26f5926 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:00.020243 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-1b4ed472-8ed8-421c-a9ec-02032cdc255c tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:00.039916 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1b4ed472-8ed8-421c-a9ec-02032cdc255c tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/784e1fb4-876e-489f-9428-e01412642663" status: 200 len: 1391 microversion: 2.1 time: 0.816298 Jul 23 21:20:00.042994 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 781/1559] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:19:59 2022] GET /compute/v2.1/servers/784e1fb4-876e-489f-9428-e01412642663 => generated 1391 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:20:00.051359 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-5f26e47e-9e8c-4a69-928e-902053a4163d req-1d81c9a9-b129-429f-9567-90d01cd3f04f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "080674a1-a720-4058-b74a-79bb1a61f5b1", "name": "network-vif-deleted", "tag": "a69505b1-ef69-4514-98f6-e474707e5b3e"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:20:00.076792 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:20:00.080267 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-5f26e47e-9e8c-4a69-928e-902053a4163d req-1d81c9a9-b129-429f-9567-90d01cd3f04f service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:00.083114 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-5f26e47e-9e8c-4a69-928e-902053a4163d req-1d81c9a9-b129-429f-9567-90d01cd3f04f service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:00.108443 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-5f26e47e-9e8c-4a69-928e-902053a4163d req-1d81c9a9-b129-429f-9567-90d01cd3f04f service nova] Creating event network-vif-deleted:a69505b1-ef69-4514-98f6-e474707e5b3e for instance 080674a1-a720-4058-b74a-79bb1a61f5b1 on nch1-master-1 Jul 23 21:20:00.117496 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-5f26e47e-9e8c-4a69-928e-902053a4163d req-1d81c9a9-b129-429f-9567-90d01cd3f04f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072969 Jul 23 21:20:00.118751 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 782/1560] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:20:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:20:00.125954 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ee4b733d-f9d5-4af7-aa35-dfc8d391e11b tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:00.126962 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ee4b733d-f9d5-4af7-aa35-dfc8d391e11b tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 080674a1-a720-4058-b74a-79bb1a61f5b1] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:00.150100 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ee4b733d-f9d5-4af7-aa35-dfc8d391e11b tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:00.151628 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ee4b733d-f9d5-4af7-aa35-dfc8d391e11b tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:00.152798 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ee4b733d-f9d5-4af7-aa35-dfc8d391e11b tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:00.154111 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ee4b733d-f9d5-4af7-aa35-dfc8d391e11b tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:00.178066 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-ee4b733d-f9d5-4af7-aa35-dfc8d391e11b tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] HTTP exception thrown: Instance 080674a1-a720-4058-b74a-79bb1a61f5b1 could not be found. Jul 23 21:20:00.181048 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ee4b733d-f9d5-4af7-aa35-dfc8d391e11b tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Request method failure captured: Jul 23 21:20:00.181048 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/080674a1-a720-4058-b74a-79bb1a61f5b1 HTTP/1.1 Jul 23 21:20:00.181048 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:20:00.181048 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:20:00.181048 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:20:00.181048 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:20:00.181048 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:20:00.181048 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:20:00.181048 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:20:00.181048 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:20:00.181048 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GUJELDL_GsNeJwREywE_3jBr1HvzTVincHoSaHkmz1z6GZZjegpx0r2IR_6PBi9Tra-YYsN5qwdwSaeOz6I0mD6V9yMAx7BFDMUjtY9rJu7mfhQyUGyuxYI08t_rWsJ-odD6MQO0mzNpwl75bL9POwUU9lfytO2Ec0dK9a6mg0ozik Jul 23 21:20:00.181048 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:20:00.181048 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:20:00.181048 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:20:00.181048 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:20:00.181048 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:20:00.181048 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:20:00.181048 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 580ed681cbf44d10936259b17f60f1b2 Jul 23 21:20:00.181048 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ImagesTestJSON-1070983287 Jul 23 21:20:00.181048 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:20:00.181048 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:20:00.182939 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/580ed681cbf44d10936259b17f60f1b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/580ed681cbf44d10936259b17f60f1b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_580ed681cbf44d10936259b17f60f1b2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/580ed681cbf44d10936259b17f60f1b2"}]}] Jul 23 21:20:00.182939 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ImagesTestJSON-1070983287 Jul 23 21:20:00.182939 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 580ed681cbf44d10936259b17f60f1b2 Jul 23 21:20:00.182939 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ImagesTestJSON-1070983287 Jul 23 21:20:00.182939 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ImagesTestJSON-1070983287-project Jul 23 21:20:00.182939 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:20:00.182939 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:20:00.182939 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: bb4f9dda4c2a411cb0394bf86e9ae223 Jul 23 21:20:00.182939 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ImagesTestJSON-1070983287-project Jul 23 21:20:00.182939 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:20:00.182939 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance 080674a1-a720-4058-b74a-79bb1a61f5b1 could not be found. Jul 23 21:20:00.182939 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '080674a1-a720-4058-b74a-79bb1a61f5b1'} Jul 23 21:20:00.182939 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:20:00.183909 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:00.183909 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:20:00.183909 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:20:00.183909 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:20:00.183909 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:20:00.183909 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:20:00.183909 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:20:00.183909 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:20:00.183909 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:20:00.183909 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 080674a1-a720-4058-b74a-79bb1a61f5b1 could not be found. Jul 23 21:20:00.183909 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:20:00.183909 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:20:00.183909 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:20:00.183909 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:00.183909 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:20:00.183909 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:20:00.183909 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:20:00.183909 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:20:00.183909 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:20:00.183909 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:20:00.185358 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:20:00.185358 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:20:00.185358 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:20:00.185358 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:20:00.185358 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:20:00.185358 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:20:00.185358 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 080674a1-a720-4058-b74a-79bb1a61f5b1 could not be found. Jul 23 21:20:00.185358 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:20:00.185358 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:20:00.185358 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:20:00.185358 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:00.185358 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:20:00.185358 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:20:00.185358 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:20:00.185358 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:20:00.185358 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 080674a1-a720-4058-b74a-79bb1a61f5b1 could not be found. Jul 23 21:20:00.185358 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:20:00.189485 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ee4b733d-f9d5-4af7-aa35-dfc8d391e11b tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Returning 404 to user: Instance 080674a1-a720-4058-b74a-79bb1a61f5b1 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:20:00.190708 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ee4b733d-f9d5-4af7-aa35-dfc8d391e11b tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/servers/080674a1-a720-4058-b74a-79bb1a61f5b1" status: 404 len: 111 microversion: 2.1 time: 0.069971 Jul 23 21:20:00.191892 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 783/1561] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:20:00 2022] GET /compute/v2.1/servers/080674a1-a720-4058-b74a-79bb1a61f5b1 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:20:00.197378 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-41bdb56b-1fd5-46a0-a064-0c92f2b90f7e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:00.199235 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-41bdb56b-1fd5-46a0-a064-0c92f2b90f7e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:00.210042 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-41bdb56b-1fd5-46a0-a064-0c92f2b90f7e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:00.210904 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-41bdb56b-1fd5-46a0-a064-0c92f2b90f7e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:00.211945 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-41bdb56b-1fd5-46a0-a064-0c92f2b90f7e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:00.212640 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-41bdb56b-1fd5-46a0-a064-0c92f2b90f7e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:00.475497 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-b1acd266-34ad-4a46-bcf6-bfeba26f5926 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:00.492585 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-b1acd266-34ad-4a46-bcf6-bfeba26f5926 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:00.495251 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-b1acd266-34ad-4a46-bcf6-bfeba26f5926 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:00.500730 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-b1acd266-34ad-4a46-bcf6-bfeba26f5926 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/214b4d99-34d8-48c7-924c-27cd2f6712e7" status: 200 len: 1488 microversion: 2.25 time: 1.049270 Jul 23 21:20:00.529196 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 779/1562] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:19:59 2022] GET /compute/v2.1/servers/214b4d99-34d8-48c7-924c-27cd2f6712e7 => generated 1488 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:20:00.565890 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-8982fd08-4bbf-4461-95f0-2080e625154f req-24a9ff39-f00d-417a-9da9-f56a5e837339 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "784e1fb4-876e-489f-9428-e01412642663", "name": "network-vif-unplugged", "status": "completed", "tag": "4078ff09-4171-488c-a197-d664957df578"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:20:00.597358 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-8982fd08-4bbf-4461-95f0-2080e625154f req-24a9ff39-f00d-417a-9da9-f56a5e837339 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:00.599056 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-8982fd08-4bbf-4461-95f0-2080e625154f req-24a9ff39-f00d-417a-9da9-f56a5e837339 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:00.619753 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-8982fd08-4bbf-4461-95f0-2080e625154f req-24a9ff39-f00d-417a-9da9-f56a5e837339 service nova] Creating event network-vif-unplugged:4078ff09-4171-488c-a197-d664957df578 for instance 784e1fb4-876e-489f-9428-e01412642663 on nch1-master-1 Jul 23 21:20:00.628494 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-8982fd08-4bbf-4461-95f0-2080e625154f req-24a9ff39-f00d-417a-9da9-f56a5e837339 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.095744 Jul 23 21:20:00.629751 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 780/1563] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:20:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:20:00.637440 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-9c9e62e5-5f5e-4bc6-847b-f04791a15f63 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:00.638671 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-9c9e62e5-5f5e-4bc6-847b-f04791a15f63 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] [instance: d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:00.650931 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9c9e62e5-5f5e-4bc6-847b-f04791a15f63 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:00.653212 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9c9e62e5-5f5e-4bc6-847b-f04791a15f63 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:00.654506 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9c9e62e5-5f5e-4bc6-847b-f04791a15f63 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:00.655787 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:20:00.657096 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9c9e62e5-5f5e-4bc6-847b-f04791a15f63 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:00.685987 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=6 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:20:00.881572 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-9c9e62e5-5f5e-4bc6-847b-f04791a15f63 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ef41817e4f5478bb7afdcb59ed634cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af16c62b144aa0972331a69e3638c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:00.906300 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-9c9e62e5-5f5e-4bc6-847b-f04791a15f63 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ef41817e4f5478bb7afdcb59ed634cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af16c62b144aa0972331a69e3638c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:00.908603 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-9c9e62e5-5f5e-4bc6-847b-f04791a15f63 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ef41817e4f5478bb7afdcb59ed634cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af16c62b144aa0972331a69e3638c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:00.929193 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-9c9e62e5-5f5e-4bc6-847b-f04791a15f63 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] 10.222.0.17 "GET /compute/v2.1/servers/d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a" status: 200 len: 1446 microversion: 2.75 time: 0.297787 Jul 23 21:20:00.933458 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 781/1564] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:20:00 2022] GET /compute/v2.1/servers/d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a => generated 1446 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:20:00.946679 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-7ef5d30d-6577-4385-b088-d7aa4da9c9fc tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '.version_select at 0x7f0b47f7d790>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:01.004532 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-7ef5d30d-6577-4385-b088-d7aa4da9c9fc tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] HTTP exception thrown: Image not found. Jul 23 21:20:01.014013 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-7ef5d30d-6577-4385-b088-d7aa4da9c9fc tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Request method failure captured: Jul 23 21:20:01.014013 ncdv-master-1 devstack@n-api.service[131321]: request: DELETE /compute/v2.1/images/0d3d0429-755c-441f-ab98-3c0bd09dd6af HTTP/1.1 Jul 23 21:20:01.014013 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:20:01.014013 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:20:01.014013 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:20:01.014013 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:20:01.014013 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:20:01.014013 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:20:01.014013 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:20:01.014013 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:20:01.014013 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GUJELDL_GsNeJwREywE_3jBr1HvzTVincHoSaHkmz1z6GZZjegpx0r2IR_6PBi9Tra-YYsN5qwdwSaeOz6I0mD6V9yMAx7BFDMUjtY9rJu7mfhQyUGyuxYI08t_rWsJ-odD6MQO0mzNpwl75bL9POwUU9lfytO2Ec0dK9a6mg0ozik Jul 23 21:20:01.014013 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:20:01.014013 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:20:01.014013 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:20:01.014013 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:20:01.014013 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:20:01.014013 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:20:01.014013 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 580ed681cbf44d10936259b17f60f1b2 Jul 23 21:20:01.014013 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ImagesTestJSON-1070983287 Jul 23 21:20:01.014013 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:20:01.014013 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:20:01.015925 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/580ed681cbf44d10936259b17f60f1b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/580ed681cbf44d10936259b17f60f1b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_580ed681cbf44d10936259b17f60f1b2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/580ed681cbf44d10936259b17f60f1b2"}]}] Jul 23 21:20:01.015925 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ImagesTestJSON-1070983287 Jul 23 21:20:01.015925 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 580ed681cbf44d10936259b17f60f1b2 Jul 23 21:20:01.015925 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ImagesTestJSON-1070983287 Jul 23 21:20:01.015925 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ImagesTestJSON-1070983287-project Jul 23 21:20:01.015925 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:20:01.015925 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:20:01.015925 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: bb4f9dda4c2a411cb0394bf86e9ae223 Jul 23 21:20:01.015925 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ImagesTestJSON-1070983287-project Jul 23 21:20:01.015925 ncdv-master-1 devstack@n-api.service[131321]: method: Jul 23 21:20:01.015925 ncdv-master-1 devstack@n-api.service[131321]: exception: Image not found. Jul 23 21:20:01.015925 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': '0d3d0429-755c-441f-ab98-3c0bd09dd6af'} Jul 23 21:20:01.015925 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:20:01.015925 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:01.017450 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 23 21:20:01.017450 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 23 21:20:01.017450 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 23 21:20:01.017450 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 23 21:20:01.017450 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 23 21:20:01.017450 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 23 21:20:01.017450 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 23 21:20:01.017450 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 23 21:20:01.017450 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 23 21:20:01.017450 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 23 21:20:01.017450 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 23 21:20:01.017450 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 23 21:20:01.017450 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 23 21:20:01.017450 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 23 21:20:01.017450 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 0d3d0429-755c-441f-ab98-3c0bd09dd6af to delete Jul 23 21:20:01.017450 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:20:01.017450 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:20:01.017450 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:20:01.017450 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:01.019859 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 23 21:20:01.019859 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 23 21:20:01.019859 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 23 21:20:01.019859 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 23 21:20:01.019859 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 23 21:20:01.019859 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 23 21:20:01.019859 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0d3d0429-755c-441f-ab98-3c0bd09dd6af could not be found. Jul 23 21:20:01.019859 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:20:01.019859 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:20:01.019859 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:20:01.019859 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:01.019859 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:20:01.019859 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:20:01.019859 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:20:01.019859 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:20:01.019859 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:20:01.019859 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:20:01.019859 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:20:01.019859 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:20:01.019859 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 23 21:20:01.021344 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 23 21:20:01.021344 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 23 21:20:01.021344 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:20:01.021344 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:20:01.021344 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:20:01.021344 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:01.021344 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:20:01.021344 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:20:01.021344 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:20:01.021344 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:20:01.021344 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 23 21:20:01.021344 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:20:01.021344 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-7ef5d30d-6577-4385-b088-d7aa4da9c9fc tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Returning 404 to user: Image not found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:20:01.021344 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-7ef5d30d-6577-4385-b088-d7aa4da9c9fc tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "DELETE /compute/v2.1/images/0d3d0429-755c-441f-ab98-3c0bd09dd6af" status: 404 len: 62 microversion: 2.1 time: 0.081860 Jul 23 21:20:01.021344 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 782/1565] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:20:00 2022] DELETE /compute/v2.1/images/0d3d0429-755c-441f-ab98-3c0bd09dd6af => generated 62 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 23 21:20:01.028474 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-bab3ea51-8b1c-4d70-b8e5-6992c4db26f5 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:01.035000 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-bab3ea51-8b1c-4d70-b8e5-6992c4db26f5 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 5bc4befa-252d-456a-92cd-323bad80fcdf] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:01.040038 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-41bdb56b-1fd5-46a0-a064-0c92f2b90f7e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:01.056062 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bab3ea51-8b1c-4d70-b8e5-6992c4db26f5 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:01.056529 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bab3ea51-8b1c-4d70-b8e5-6992c4db26f5 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:01.057347 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bab3ea51-8b1c-4d70-b8e5-6992c4db26f5 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:01.057798 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bab3ea51-8b1c-4d70-b8e5-6992c4db26f5 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:01.061357 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-41bdb56b-1fd5-46a0-a064-0c92f2b90f7e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:01.066895 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-41bdb56b-1fd5-46a0-a064-0c92f2b90f7e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:01.069285 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-41bdb56b-1fd5-46a0-a064-0c92f2b90f7e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1740 microversion: 2.42 time: 0.876029 Jul 23 21:20:01.070439 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 784/1566] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:20:00 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1740 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:20:01.076618 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-bb9b8449-8605-45cf-b33b-689c54dc8598 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:01.077431 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-bb9b8449-8605-45cf-b33b-689c54dc8598 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 6f54269a-e144-4b5d-9b78-39120b28e545] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:01.087754 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bb9b8449-8605-45cf-b33b-689c54dc8598 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:01.088785 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bb9b8449-8605-45cf-b33b-689c54dc8598 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:01.089819 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bb9b8449-8605-45cf-b33b-689c54dc8598 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:01.091235 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bb9b8449-8605-45cf-b33b-689c54dc8598 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:01.115569 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-bb9b8449-8605-45cf-b33b-689c54dc8598 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] HTTP exception thrown: Instance 6f54269a-e144-4b5d-9b78-39120b28e545 could not be found. Jul 23 21:20:01.118538 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-bb9b8449-8605-45cf-b33b-689c54dc8598 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Request method failure captured: Jul 23 21:20:01.118538 ncdv-master-1 devstack@n-api.service[131320]: request: DELETE /compute/v2.1/servers/6f54269a-e144-4b5d-9b78-39120b28e545 HTTP/1.1 Jul 23 21:20:01.118538 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:20:01.118538 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:20:01.118538 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:20:01.118538 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:20:01.118538 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:20:01.118538 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:20:01.118538 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:20:01.118538 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:20:01.118538 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GUJELDL_GsNeJwREywE_3jBr1HvzTVincHoSaHkmz1z6GZZjegpx0r2IR_6PBi9Tra-YYsN5qwdwSaeOz6I0mD6V9yMAx7BFDMUjtY9rJu7mfhQyUGyuxYI08t_rWsJ-odD6MQO0mzNpwl75bL9POwUU9lfytO2Ec0dK9a6mg0ozik Jul 23 21:20:01.118538 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:20:01.118538 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:20:01.118538 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:20:01.118538 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:20:01.118538 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:20:01.118538 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:20:01.118538 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 580ed681cbf44d10936259b17f60f1b2 Jul 23 21:20:01.118538 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ImagesTestJSON-1070983287 Jul 23 21:20:01.118538 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:20:01.118538 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:20:01.121764 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/580ed681cbf44d10936259b17f60f1b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/580ed681cbf44d10936259b17f60f1b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_580ed681cbf44d10936259b17f60f1b2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/580ed681cbf44d10936259b17f60f1b2"}]}] Jul 23 21:20:01.121764 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ImagesTestJSON-1070983287 Jul 23 21:20:01.121764 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 580ed681cbf44d10936259b17f60f1b2 Jul 23 21:20:01.121764 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ImagesTestJSON-1070983287 Jul 23 21:20:01.121764 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ImagesTestJSON-1070983287-project Jul 23 21:20:01.121764 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:20:01.121764 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:20:01.121764 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: bb4f9dda4c2a411cb0394bf86e9ae223 Jul 23 21:20:01.121764 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ImagesTestJSON-1070983287-project Jul 23 21:20:01.121764 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:20:01.121764 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance 6f54269a-e144-4b5d-9b78-39120b28e545 could not be found. Jul 23 21:20:01.121764 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '6f54269a-e144-4b5d-9b78-39120b28e545'} Jul 23 21:20:01.124347 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:20:01.124347 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:01.124347 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:20:01.124347 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:20:01.124347 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:20:01.124347 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:20:01.124347 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:20:01.124347 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:20:01.124347 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:20:01.124347 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:20:01.124347 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f54269a-e144-4b5d-9b78-39120b28e545 could not be found. Jul 23 21:20:01.124347 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:20:01.124347 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:20:01.124347 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:20:01.124347 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:01.124347 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:20:01.124347 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:20:01.124347 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:20:01.124347 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:20:01.124347 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:20:01.127456 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:20:01.127456 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 23 21:20:01.127456 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 23 21:20:01.127456 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 23 21:20:01.127456 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 23 21:20:01.127456 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:20:01.127456 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:20:01.127456 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:20:01.127456 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:20:01.127456 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f54269a-e144-4b5d-9b78-39120b28e545 could not be found. Jul 23 21:20:01.127456 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:20:01.127456 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:20:01.127456 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:20:01.127456 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:01.127456 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:20:01.127456 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:20:01.127456 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:20:01.127456 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:20:01.127456 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f54269a-e144-4b5d-9b78-39120b28e545 could not be found. Jul 23 21:20:01.127456 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:20:01.130751 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-bb9b8449-8605-45cf-b33b-689c54dc8598 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Returning 404 to user: Instance 6f54269a-e144-4b5d-9b78-39120b28e545 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:20:01.130751 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-bb9b8449-8605-45cf-b33b-689c54dc8598 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "DELETE /compute/v2.1/servers/6f54269a-e144-4b5d-9b78-39120b28e545" status: 404 len: 111 microversion: 2.1 time: 0.048182 Jul 23 21:20:01.130751 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 785/1567] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:20:01 2022] DELETE /compute/v2.1/servers/6f54269a-e144-4b5d-9b78-39120b28e545 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:20:01.132209 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-bab3ea51-8b1c-4d70-b8e5-6992c4db26f5 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] HTTP exception thrown: Instance 5bc4befa-252d-456a-92cd-323bad80fcdf could not be found. Jul 23 21:20:01.133059 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-bab3ea51-8b1c-4d70-b8e5-6992c4db26f5 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Request method failure captured: Jul 23 21:20:01.133059 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/servers/5bc4befa-252d-456a-92cd-323bad80fcdf HTTP/1.1 Jul 23 21:20:01.133059 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:20:01.133059 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:20:01.133059 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:20:01.133059 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:20:01.133059 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:20:01.133059 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:20:01.133059 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:20:01.133059 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:20:01.133059 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GSXVRtT4D6DOYfgu59iPITKQ5mqcVxrjQp1t1yDZwCjvkDyx4wS8lBIVwN9smI5UFCECIxWKCBOaVPG0VLJTlOJdXdkXVrNU_74esEReGGgA0n9alBex-aEm1JD8sWUZRSrbN_rcHQ4ciIzp29ExKjSpi_IoKu7t3of0FKJObJf45w Jul 23 21:20:01.133059 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:20:01.133059 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:20:01.133059 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:20:01.133059 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:20:01.133059 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:20:01.133059 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:20:01.133059 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 5935212e8b6a40768ee3fc90807b0cb1 Jul 23 21:20:01.133059 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-MigrationsAdminTest-2054055598 Jul 23 21:20:01.133059 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:20:01.133059 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:20:01.136963 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5935212e8b6a40768ee3fc90807b0cb1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5935212e8b6a40768ee3fc90807b0cb1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_5935212e8b6a40768ee3fc90807b0cb1", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/5935212e8b6a40768ee3fc90807b0cb1"}]}] Jul 23 21:20:01.136963 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-MigrationsAdminTest-2054055598 Jul 23 21:20:01.136963 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 5935212e8b6a40768ee3fc90807b0cb1 Jul 23 21:20:01.136963 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-MigrationsAdminTest-2054055598 Jul 23 21:20:01.136963 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-MigrationsAdminTest-2054055598-project Jul 23 21:20:01.136963 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:20:01.136963 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:20:01.136963 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 0133d9533fbd4be5b46dc308dbe3a7d9 Jul 23 21:20:01.136963 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-MigrationsAdminTest-2054055598-project Jul 23 21:20:01.136963 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:20:01.136963 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance 5bc4befa-252d-456a-92cd-323bad80fcdf could not be found. Jul 23 21:20:01.136963 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': '5bc4befa-252d-456a-92cd-323bad80fcdf'} Jul 23 21:20:01.138965 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:20:01.138965 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:01.138965 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:20:01.138965 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:20:01.138965 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:20:01.138965 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:20:01.138965 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:20:01.138965 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:20:01.138965 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:20:01.138965 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:20:01.138965 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bc4befa-252d-456a-92cd-323bad80fcdf could not be found. Jul 23 21:20:01.138965 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:20:01.138965 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:20:01.138965 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:20:01.138965 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:01.138965 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:20:01.138965 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:20:01.138965 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:20:01.138965 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:20:01.138965 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:20:01.147202 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:20:01.147202 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:20:01.147202 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:20:01.147202 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:20:01.147202 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:20:01.147202 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:20:01.147202 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:20:01.147202 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bc4befa-252d-456a-92cd-323bad80fcdf could not be found. Jul 23 21:20:01.147202 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:20:01.147202 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:20:01.147202 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:20:01.147202 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:01.147202 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:20:01.147202 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:20:01.147202 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:20:01.147202 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:20:01.147202 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bc4befa-252d-456a-92cd-323bad80fcdf could not be found. Jul 23 21:20:01.147202 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:20:01.152535 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-bab3ea51-8b1c-4d70-b8e5-6992c4db26f5 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Returning 404 to user: Instance 5bc4befa-252d-456a-92cd-323bad80fcdf could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:20:01.152535 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-bab3ea51-8b1c-4d70-b8e5-6992c4db26f5 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/5bc4befa-252d-456a-92cd-323bad80fcdf" status: 404 len: 111 microversion: 2.1 time: 0.114213 Jul 23 21:20:01.152535 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 783/1568] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:20:01 2022] GET /compute/v2.1/servers/5bc4befa-252d-456a-92cd-323bad80fcdf => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:20:01.153035 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d4a6cc73-6c73-4a20-8ee2-f7bfc1456b38 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:01.153035 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d4a6cc73-6c73-4a20-8ee2-f7bfc1456b38 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 784e1fb4-876e-489f-9428-e01412642663] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:01.157260 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-8ad9207d-0528-48a8-8273-f53e1ca4b88c tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:01.157896 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-8ad9207d-0528-48a8-8273-f53e1ca4b88c tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 6f54269a-e144-4b5d-9b78-39120b28e545] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:01.164211 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d4a6cc73-6c73-4a20-8ee2-f7bfc1456b38 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:01.164757 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d4a6cc73-6c73-4a20-8ee2-f7bfc1456b38 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:01.165593 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d4a6cc73-6c73-4a20-8ee2-f7bfc1456b38 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:01.167669 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d4a6cc73-6c73-4a20-8ee2-f7bfc1456b38 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:01.177317 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8ad9207d-0528-48a8-8273-f53e1ca4b88c tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:01.181368 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8ad9207d-0528-48a8-8273-f53e1ca4b88c tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:01.186027 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8ad9207d-0528-48a8-8273-f53e1ca4b88c tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:01.186812 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8ad9207d-0528-48a8-8273-f53e1ca4b88c tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:01.224576 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-8ad9207d-0528-48a8-8273-f53e1ca4b88c tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] HTTP exception thrown: Instance 6f54269a-e144-4b5d-9b78-39120b28e545 could not be found. Jul 23 21:20:01.226232 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-8ad9207d-0528-48a8-8273-f53e1ca4b88c tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Request method failure captured: Jul 23 21:20:01.226232 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/servers/6f54269a-e144-4b5d-9b78-39120b28e545 HTTP/1.1 Jul 23 21:20:01.226232 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:20:01.226232 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:20:01.226232 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:20:01.226232 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:20:01.226232 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:20:01.226232 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:20:01.226232 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:20:01.226232 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:20:01.226232 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GUJELDL_GsNeJwREywE_3jBr1HvzTVincHoSaHkmz1z6GZZjegpx0r2IR_6PBi9Tra-YYsN5qwdwSaeOz6I0mD6V9yMAx7BFDMUjtY9rJu7mfhQyUGyuxYI08t_rWsJ-odD6MQO0mzNpwl75bL9POwUU9lfytO2Ec0dK9a6mg0ozik Jul 23 21:20:01.226232 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:20:01.226232 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:20:01.226232 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:20:01.226232 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:20:01.226232 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:20:01.226232 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:20:01.226232 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 580ed681cbf44d10936259b17f60f1b2 Jul 23 21:20:01.226232 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ImagesTestJSON-1070983287 Jul 23 21:20:01.226232 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:20:01.226232 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:20:01.227709 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/580ed681cbf44d10936259b17f60f1b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/580ed681cbf44d10936259b17f60f1b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_580ed681cbf44d10936259b17f60f1b2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/580ed681cbf44d10936259b17f60f1b2"}]}] Jul 23 21:20:01.227709 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ImagesTestJSON-1070983287 Jul 23 21:20:01.227709 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 580ed681cbf44d10936259b17f60f1b2 Jul 23 21:20:01.227709 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ImagesTestJSON-1070983287 Jul 23 21:20:01.227709 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ImagesTestJSON-1070983287-project Jul 23 21:20:01.227709 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:20:01.227709 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:20:01.227709 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: bb4f9dda4c2a411cb0394bf86e9ae223 Jul 23 21:20:01.227709 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ImagesTestJSON-1070983287-project Jul 23 21:20:01.227709 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:20:01.227709 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance 6f54269a-e144-4b5d-9b78-39120b28e545 could not be found. Jul 23 21:20:01.227709 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': '6f54269a-e144-4b5d-9b78-39120b28e545'} Jul 23 21:20:01.227709 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:20:01.228697 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:01.228697 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:20:01.228697 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:20:01.228697 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:20:01.228697 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:20:01.228697 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:20:01.228697 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:20:01.228697 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:20:01.228697 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:20:01.228697 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f54269a-e144-4b5d-9b78-39120b28e545 could not be found. Jul 23 21:20:01.228697 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:20:01.228697 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:20:01.228697 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:20:01.228697 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:01.228697 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:20:01.228697 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:20:01.228697 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:20:01.228697 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:20:01.228697 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:20:01.228697 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:20:01.230065 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:20:01.230065 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:20:01.230065 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:20:01.230065 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:20:01.230065 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:20:01.230065 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:20:01.230065 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f54269a-e144-4b5d-9b78-39120b28e545 could not be found. Jul 23 21:20:01.230065 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:20:01.230065 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:20:01.230065 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:20:01.230065 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:01.230065 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:20:01.230065 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:20:01.230065 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:20:01.230065 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:20:01.230065 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f54269a-e144-4b5d-9b78-39120b28e545 could not be found. Jul 23 21:20:01.230065 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:20:01.232303 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-8ad9207d-0528-48a8-8273-f53e1ca4b88c tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Returning 404 to user: Instance 6f54269a-e144-4b5d-9b78-39120b28e545 could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:20:01.233428 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-8ad9207d-0528-48a8-8273-f53e1ca4b88c tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/servers/6f54269a-e144-4b5d-9b78-39120b28e545" status: 404 len: 111 microversion: 2.1 time: 0.083725 Jul 23 21:20:01.234536 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 784/1569] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:20:01 2022] GET /compute/v2.1/servers/6f54269a-e144-4b5d-9b78-39120b28e545 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:20:01.240549 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ed8f3888-8c64-4b56-bbde-e98cab9d04d5 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:01.241315 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-ed8f3888-8c64-4b56-bbde-e98cab9d04d5 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 769ee4e5-e4df-4d4e-9f4c-6372c60d9e01] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:01.248661 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ed8f3888-8c64-4b56-bbde-e98cab9d04d5 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:01.250151 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ed8f3888-8c64-4b56-bbde-e98cab9d04d5 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:01.251130 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ed8f3888-8c64-4b56-bbde-e98cab9d04d5 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:01.251729 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ed8f3888-8c64-4b56-bbde-e98cab9d04d5 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:01.310890 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-ed8f3888-8c64-4b56-bbde-e98cab9d04d5 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 769ee4e5-e4df-4d4e-9f4c-6372c60d9e01] Going to try to terminate instance {{(pid=131321) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:20:01.424858 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-ed8f3888-8c64-4b56-bbde-e98cab9d04d5 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "DELETE /compute/v2.1/servers/769ee4e5-e4df-4d4e-9f4c-6372c60d9e01" status: 204 len: 0 microversion: 2.1 time: 0.188790 Jul 23 21:20:01.425456 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 785/1570] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:20:01 2022] DELETE /compute/v2.1/servers/769ee4e5-e4df-4d4e-9f4c-6372c60d9e01 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:20:01.432963 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a8a8e154-75df-43ac-9b3e-b1494fd38605 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '.version_select at 0x7f0b47f13040>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:01.460526 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-a8a8e154-75df-43ac-9b3e-b1494fd38605 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] HTTP exception thrown: Image not found. Jul 23 21:20:01.462570 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a8a8e154-75df-43ac-9b3e-b1494fd38605 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Request method failure captured: Jul 23 21:20:01.462570 ncdv-master-1 devstack@n-api.service[131321]: request: DELETE /compute/v2.1/images/b69f77e0-151c-4769-8791-18d7474c1ded HTTP/1.1 Jul 23 21:20:01.462570 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:20:01.462570 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:20:01.462570 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:20:01.462570 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:20:01.462570 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:20:01.462570 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:20:01.462570 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:20:01.462570 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:20:01.462570 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GUJELDL_GsNeJwREywE_3jBr1HvzTVincHoSaHkmz1z6GZZjegpx0r2IR_6PBi9Tra-YYsN5qwdwSaeOz6I0mD6V9yMAx7BFDMUjtY9rJu7mfhQyUGyuxYI08t_rWsJ-odD6MQO0mzNpwl75bL9POwUU9lfytO2Ec0dK9a6mg0ozik Jul 23 21:20:01.462570 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:20:01.462570 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:20:01.462570 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:20:01.462570 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:20:01.462570 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:20:01.462570 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:20:01.462570 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 580ed681cbf44d10936259b17f60f1b2 Jul 23 21:20:01.462570 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ImagesTestJSON-1070983287 Jul 23 21:20:01.462570 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:20:01.462570 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:20:01.464211 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/580ed681cbf44d10936259b17f60f1b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/580ed681cbf44d10936259b17f60f1b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_580ed681cbf44d10936259b17f60f1b2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/580ed681cbf44d10936259b17f60f1b2"}]}] Jul 23 21:20:01.464211 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ImagesTestJSON-1070983287 Jul 23 21:20:01.464211 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 580ed681cbf44d10936259b17f60f1b2 Jul 23 21:20:01.464211 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ImagesTestJSON-1070983287 Jul 23 21:20:01.464211 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ImagesTestJSON-1070983287-project Jul 23 21:20:01.464211 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:20:01.464211 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:20:01.464211 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: bb4f9dda4c2a411cb0394bf86e9ae223 Jul 23 21:20:01.464211 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ImagesTestJSON-1070983287-project Jul 23 21:20:01.464211 ncdv-master-1 devstack@n-api.service[131321]: method: Jul 23 21:20:01.464211 ncdv-master-1 devstack@n-api.service[131321]: exception: Image not found. Jul 23 21:20:01.464211 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': 'b69f77e0-151c-4769-8791-18d7474c1ded'} Jul 23 21:20:01.464211 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:20:01.464211 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:01.465519 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 23 21:20:01.465519 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 23 21:20:01.465519 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 23 21:20:01.465519 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 23 21:20:01.465519 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 23 21:20:01.465519 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 23 21:20:01.465519 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 23 21:20:01.465519 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 23 21:20:01.465519 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 23 21:20:01.465519 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 23 21:20:01.465519 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 23 21:20:01.465519 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 23 21:20:01.465519 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 23 21:20:01.465519 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 23 21:20:01.465519 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image b69f77e0-151c-4769-8791-18d7474c1ded to delete Jul 23 21:20:01.465519 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:20:01.465519 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:20:01.465519 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:20:01.465519 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:01.467367 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 23 21:20:01.467367 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 23 21:20:01.467367 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 23 21:20:01.467367 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 23 21:20:01.467367 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 23 21:20:01.467367 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 23 21:20:01.467367 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b69f77e0-151c-4769-8791-18d7474c1ded could not be found. Jul 23 21:20:01.467367 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:20:01.467367 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:20:01.467367 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:20:01.467367 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:01.467367 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:20:01.467367 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:20:01.467367 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:20:01.467367 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:20:01.467367 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:20:01.467367 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:20:01.467367 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:20:01.467367 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:20:01.467367 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 23 21:20:01.470185 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 23 21:20:01.470185 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 23 21:20:01.470185 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:20:01.470185 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:20:01.470185 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:20:01.470185 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:01.470185 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:20:01.470185 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:20:01.470185 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:20:01.470185 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:20:01.470185 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 23 21:20:01.470185 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:20:01.470185 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a8a8e154-75df-43ac-9b3e-b1494fd38605 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Returning 404 to user: Image not found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:20:01.470185 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-a8a8e154-75df-43ac-9b3e-b1494fd38605 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "DELETE /compute/v2.1/images/b69f77e0-151c-4769-8791-18d7474c1ded" status: 404 len: 62 microversion: 2.1 time: 0.042190 Jul 23 21:20:01.474240 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 786/1571] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:20:01 2022] DELETE /compute/v2.1/images/b69f77e0-151c-4769-8791-18d7474c1ded => generated 62 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 23 21:20:01.480516 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-9b656b67-3ec1-4ab0-af19-820636711bff tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:01.483395 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-9b656b67-3ec1-4ab0-af19-820636711bff tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 769ee4e5-e4df-4d4e-9f4c-6372c60d9e01] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:01.493817 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9b656b67-3ec1-4ab0-af19-820636711bff tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:01.494640 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9b656b67-3ec1-4ab0-af19-820636711bff tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:01.496227 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9b656b67-3ec1-4ab0-af19-820636711bff tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:01.496834 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9b656b67-3ec1-4ab0-af19-820636711bff tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:01.805923 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-9b656b67-3ec1-4ab0-af19-820636711bff tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:01.814263 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell0:SELECT=19 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:20:01.817680 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-9b656b67-3ec1-4ab0-af19-820636711bff tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/769ee4e5-e4df-4d4e-9f4c-6372c60d9e01" status: 200 len: 1468 microversion: 2.1 time: 0.341604 Jul 23 21:20:01.818962 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 787/1572] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:20:01 2022] GET /compute/v2.1/servers/769ee4e5-e4df-4d4e-9f4c-6372c60d9e01 => generated 1468 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:20:01.828753 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e239da22-0088-437a-890e-d1240ace2e48 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:01.829660 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-e239da22-0088-437a-890e-d1240ace2e48 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 8025dc38-59d4-4296-b2c7-5aebb08eacae] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:01.842703 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e239da22-0088-437a-890e-d1240ace2e48 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:01.845784 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e239da22-0088-437a-890e-d1240ace2e48 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:01.847646 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e239da22-0088-437a-890e-d1240ace2e48 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:01.848508 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e239da22-0088-437a-890e-d1240ace2e48 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:01.876971 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-e239da22-0088-437a-890e-d1240ace2e48 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] HTTP exception thrown: Instance 8025dc38-59d4-4296-b2c7-5aebb08eacae could not be found. Jul 23 21:20:01.879293 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e239da22-0088-437a-890e-d1240ace2e48 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Request method failure captured: Jul 23 21:20:01.879293 ncdv-master-1 devstack@n-api.service[131321]: request: DELETE /compute/v2.1/servers/8025dc38-59d4-4296-b2c7-5aebb08eacae HTTP/1.1 Jul 23 21:20:01.879293 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:20:01.879293 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:20:01.879293 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:20:01.879293 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:20:01.879293 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:20:01.879293 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:20:01.879293 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:20:01.879293 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:20:01.879293 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GUJELDL_GsNeJwREywE_3jBr1HvzTVincHoSaHkmz1z6GZZjegpx0r2IR_6PBi9Tra-YYsN5qwdwSaeOz6I0mD6V9yMAx7BFDMUjtY9rJu7mfhQyUGyuxYI08t_rWsJ-odD6MQO0mzNpwl75bL9POwUU9lfytO2Ec0dK9a6mg0ozik Jul 23 21:20:01.879293 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:20:01.879293 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:20:01.879293 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:20:01.879293 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:20:01.879293 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:20:01.879293 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:20:01.879293 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 580ed681cbf44d10936259b17f60f1b2 Jul 23 21:20:01.879293 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ImagesTestJSON-1070983287 Jul 23 21:20:01.879293 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:20:01.879293 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:20:01.881162 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/580ed681cbf44d10936259b17f60f1b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/580ed681cbf44d10936259b17f60f1b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_580ed681cbf44d10936259b17f60f1b2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/580ed681cbf44d10936259b17f60f1b2"}]}] Jul 23 21:20:01.881162 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ImagesTestJSON-1070983287 Jul 23 21:20:01.881162 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 580ed681cbf44d10936259b17f60f1b2 Jul 23 21:20:01.881162 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ImagesTestJSON-1070983287 Jul 23 21:20:01.881162 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ImagesTestJSON-1070983287-project Jul 23 21:20:01.881162 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:20:01.881162 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:20:01.881162 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: bb4f9dda4c2a411cb0394bf86e9ae223 Jul 23 21:20:01.881162 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ImagesTestJSON-1070983287-project Jul 23 21:20:01.881162 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:20:01.881162 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance 8025dc38-59d4-4296-b2c7-5aebb08eacae could not be found. Jul 23 21:20:01.881162 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': '8025dc38-59d4-4296-b2c7-5aebb08eacae'} Jul 23 21:20:01.882147 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:20:01.882147 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:01.882147 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:20:01.882147 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:20:01.882147 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:20:01.882147 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:20:01.882147 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:20:01.882147 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:20:01.882147 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:20:01.882147 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:20:01.882147 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8025dc38-59d4-4296-b2c7-5aebb08eacae could not be found. Jul 23 21:20:01.882147 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:20:01.882147 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:20:01.882147 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:20:01.882147 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:01.882147 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:20:01.882147 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:20:01.882147 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:20:01.882147 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:20:01.882147 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:20:01.883807 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:20:01.883807 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 23 21:20:01.883807 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 23 21:20:01.883807 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 23 21:20:01.883807 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 23 21:20:01.883807 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:20:01.883807 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:20:01.883807 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:20:01.883807 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:20:01.883807 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8025dc38-59d4-4296-b2c7-5aebb08eacae could not be found. Jul 23 21:20:01.883807 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:20:01.883807 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:20:01.883807 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:20:01.883807 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:01.883807 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:20:01.883807 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:20:01.883807 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:20:01.883807 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:20:01.883807 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8025dc38-59d4-4296-b2c7-5aebb08eacae could not be found. Jul 23 21:20:01.883807 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:20:01.886616 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e239da22-0088-437a-890e-d1240ace2e48 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Returning 404 to user: Instance 8025dc38-59d4-4296-b2c7-5aebb08eacae could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:20:01.887840 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-e239da22-0088-437a-890e-d1240ace2e48 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "DELETE /compute/v2.1/servers/8025dc38-59d4-4296-b2c7-5aebb08eacae" status: 404 len: 111 microversion: 2.1 time: 0.067471 Jul 23 21:20:01.889481 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 788/1573] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:20:01 2022] DELETE /compute/v2.1/servers/8025dc38-59d4-4296-b2c7-5aebb08eacae => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:20:01.898279 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-9d24c898-ec41-45f7-aa65-45f43e94dbae tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:01.899799 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-9d24c898-ec41-45f7-aa65-45f43e94dbae tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: 214b4d99-34d8-48c7-924c-27cd2f6712e7] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:01.907631 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9d24c898-ec41-45f7-aa65-45f43e94dbae tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:01.908519 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9d24c898-ec41-45f7-aa65-45f43e94dbae tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:01.909992 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9d24c898-ec41-45f7-aa65-45f43e94dbae tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:01.910640 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9d24c898-ec41-45f7-aa65-45f43e94dbae tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:02.122929 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-9d24c898-ec41-45f7-aa65-45f43e94dbae tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:02.143112 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-9d24c898-ec41-45f7-aa65-45f43e94dbae tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:02.149002 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-9d24c898-ec41-45f7-aa65-45f43e94dbae tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:02.151275 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-9d24c898-ec41-45f7-aa65-45f43e94dbae tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/214b4d99-34d8-48c7-924c-27cd2f6712e7" status: 200 len: 1488 microversion: 2.25 time: 0.260295 Jul 23 21:20:02.153584 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 789/1574] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:20:01 2022] GET /compute/v2.1/servers/214b4d99-34d8-48c7-924c-27cd2f6712e7 => generated 1488 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:20:02.169135 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-17ca32a6-c065-489d-afd1-fc4ac2c1798a tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:02.172615 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-17ca32a6-c065-489d-afd1-fc4ac2c1798a tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 8025dc38-59d4-4296-b2c7-5aebb08eacae] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:02.188603 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-17ca32a6-c065-489d-afd1-fc4ac2c1798a tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:02.190350 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-17ca32a6-c065-489d-afd1-fc4ac2c1798a tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:02.191414 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-17ca32a6-c065-489d-afd1-fc4ac2c1798a tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:02.192133 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-17ca32a6-c065-489d-afd1-fc4ac2c1798a tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:02.214719 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-17ca32a6-c065-489d-afd1-fc4ac2c1798a tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] HTTP exception thrown: Instance 8025dc38-59d4-4296-b2c7-5aebb08eacae could not be found. Jul 23 21:20:02.217655 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-17ca32a6-c065-489d-afd1-fc4ac2c1798a tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Request method failure captured: Jul 23 21:20:02.217655 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/servers/8025dc38-59d4-4296-b2c7-5aebb08eacae HTTP/1.1 Jul 23 21:20:02.217655 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:20:02.217655 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:20:02.217655 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:20:02.217655 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:20:02.217655 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:20:02.217655 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:20:02.217655 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:20:02.217655 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:20:02.217655 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GUJELDL_GsNeJwREywE_3jBr1HvzTVincHoSaHkmz1z6GZZjegpx0r2IR_6PBi9Tra-YYsN5qwdwSaeOz6I0mD6V9yMAx7BFDMUjtY9rJu7mfhQyUGyuxYI08t_rWsJ-odD6MQO0mzNpwl75bL9POwUU9lfytO2Ec0dK9a6mg0ozik Jul 23 21:20:02.217655 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:20:02.217655 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:20:02.217655 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:20:02.217655 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:20:02.217655 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:20:02.217655 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:20:02.217655 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 580ed681cbf44d10936259b17f60f1b2 Jul 23 21:20:02.217655 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ImagesTestJSON-1070983287 Jul 23 21:20:02.217655 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:20:02.217655 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:20:02.220032 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/580ed681cbf44d10936259b17f60f1b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/580ed681cbf44d10936259b17f60f1b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_580ed681cbf44d10936259b17f60f1b2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/580ed681cbf44d10936259b17f60f1b2"}]}] Jul 23 21:20:02.220032 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ImagesTestJSON-1070983287 Jul 23 21:20:02.220032 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 580ed681cbf44d10936259b17f60f1b2 Jul 23 21:20:02.220032 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ImagesTestJSON-1070983287 Jul 23 21:20:02.220032 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ImagesTestJSON-1070983287-project Jul 23 21:20:02.220032 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:20:02.220032 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:20:02.220032 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: bb4f9dda4c2a411cb0394bf86e9ae223 Jul 23 21:20:02.220032 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ImagesTestJSON-1070983287-project Jul 23 21:20:02.220032 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:20:02.220032 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance 8025dc38-59d4-4296-b2c7-5aebb08eacae could not be found. Jul 23 21:20:02.220032 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': '8025dc38-59d4-4296-b2c7-5aebb08eacae'} Jul 23 21:20:02.220032 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:20:02.221060 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:02.221060 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:20:02.221060 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:20:02.221060 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:20:02.221060 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:20:02.221060 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:20:02.221060 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:20:02.221060 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:20:02.221060 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:20:02.221060 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8025dc38-59d4-4296-b2c7-5aebb08eacae could not be found. Jul 23 21:20:02.221060 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:20:02.221060 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:20:02.221060 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:20:02.221060 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:02.221060 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:20:02.221060 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:20:02.221060 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:20:02.221060 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:20:02.221060 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:20:02.221060 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:20:02.224201 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:20:02.224201 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:20:02.224201 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:20:02.224201 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:20:02.224201 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:20:02.224201 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:20:02.224201 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8025dc38-59d4-4296-b2c7-5aebb08eacae could not be found. Jul 23 21:20:02.224201 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:20:02.224201 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:20:02.224201 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:20:02.224201 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:02.224201 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:20:02.224201 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:20:02.224201 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:20:02.224201 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:20:02.224201 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8025dc38-59d4-4296-b2c7-5aebb08eacae could not be found. Jul 23 21:20:02.224201 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:20:02.228851 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-17ca32a6-c065-489d-afd1-fc4ac2c1798a tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Returning 404 to user: Instance 8025dc38-59d4-4296-b2c7-5aebb08eacae could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:20:02.230579 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-17ca32a6-c065-489d-afd1-fc4ac2c1798a tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/servers/8025dc38-59d4-4296-b2c7-5aebb08eacae" status: 404 len: 111 microversion: 2.1 time: 0.074981 Jul 23 21:20:02.231783 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 790/1575] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:20:02 2022] GET /compute/v2.1/servers/8025dc38-59d4-4296-b2c7-5aebb08eacae => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:20:02.242803 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-771e8b4c-4791-4718-ae3c-d9d77a6bf002 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:02.244198 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-771e8b4c-4791-4718-ae3c-d9d77a6bf002 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] [instance: d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:02.252651 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-771e8b4c-4791-4718-ae3c-d9d77a6bf002 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:02.253472 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-771e8b4c-4791-4718-ae3c-d9d77a6bf002 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:02.254950 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-771e8b4c-4791-4718-ae3c-d9d77a6bf002 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:02.255769 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-771e8b4c-4791-4718-ae3c-d9d77a6bf002 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:02.264699 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:20:02.381648 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-771e8b4c-4791-4718-ae3c-d9d77a6bf002 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ef41817e4f5478bb7afdcb59ed634cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af16c62b144aa0972331a69e3638c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:02.387742 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-771e8b4c-4791-4718-ae3c-d9d77a6bf002 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ef41817e4f5478bb7afdcb59ed634cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af16c62b144aa0972331a69e3638c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:02.389886 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-771e8b4c-4791-4718-ae3c-d9d77a6bf002 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ef41817e4f5478bb7afdcb59ed634cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af16c62b144aa0972331a69e3638c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:02.399703 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d4a6cc73-6c73-4a20-8ee2-f7bfc1456b38 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:02.404812 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-771e8b4c-4791-4718-ae3c-d9d77a6bf002 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] 10.222.0.17 "GET /compute/v2.1/servers/d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a" status: 200 len: 1446 microversion: 2.75 time: 0.170732 Jul 23 21:20:02.406068 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 791/1576] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:20:02 2022] GET /compute/v2.1/servers/d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a => generated 1446 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:20:02.413827 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-42915039-399a-4e8b-91b6-37f385897a3f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:02.414467 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-42915039-399a-4e8b-91b6-37f385897a3f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:02.414857 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d4a6cc73-6c73-4a20-8ee2-f7bfc1456b38 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/784e1fb4-876e-489f-9428-e01412642663" status: 200 len: 1391 microversion: 2.1 time: 1.282847 Jul 23 21:20:02.427214 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 786/1577] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:20:01 2022] GET /compute/v2.1/servers/784e1fb4-876e-489f-9428-e01412642663 => generated 1391 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:20:02.427812 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-42915039-399a-4e8b-91b6-37f385897a3f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:02.430028 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-42915039-399a-4e8b-91b6-37f385897a3f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:02.431092 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-42915039-399a-4e8b-91b6-37f385897a3f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:02.431496 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-42915039-399a-4e8b-91b6-37f385897a3f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:02.435300 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ac728175-d6e5-4b01-b36b-2ca7d135b178 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '.version_select at 0x7f0b47ccdc10>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:02.465969 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-ac728175-d6e5-4b01-b36b-2ca7d135b178 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] HTTP exception thrown: Image not found. Jul 23 21:20:02.472128 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ac728175-d6e5-4b01-b36b-2ca7d135b178 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Request method failure captured: Jul 23 21:20:02.472128 ncdv-master-1 devstack@n-api.service[131320]: request: DELETE /compute/v2.1/images/8a2df693-27eb-4ab8-9b5e-e603a022f603 HTTP/1.1 Jul 23 21:20:02.472128 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:20:02.472128 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:20:02.472128 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:20:02.472128 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:20:02.472128 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:20:02.472128 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:20:02.472128 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:20:02.472128 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:20:02.472128 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GUJELDL_GsNeJwREywE_3jBr1HvzTVincHoSaHkmz1z6GZZjegpx0r2IR_6PBi9Tra-YYsN5qwdwSaeOz6I0mD6V9yMAx7BFDMUjtY9rJu7mfhQyUGyuxYI08t_rWsJ-odD6MQO0mzNpwl75bL9POwUU9lfytO2Ec0dK9a6mg0ozik Jul 23 21:20:02.472128 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:20:02.472128 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:20:02.472128 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:20:02.472128 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:20:02.472128 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:20:02.472128 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:20:02.472128 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 580ed681cbf44d10936259b17f60f1b2 Jul 23 21:20:02.472128 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ImagesTestJSON-1070983287 Jul 23 21:20:02.472128 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:20:02.472128 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:20:02.474078 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/580ed681cbf44d10936259b17f60f1b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/580ed681cbf44d10936259b17f60f1b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_580ed681cbf44d10936259b17f60f1b2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/580ed681cbf44d10936259b17f60f1b2"}]}] Jul 23 21:20:02.474078 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ImagesTestJSON-1070983287 Jul 23 21:20:02.474078 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 580ed681cbf44d10936259b17f60f1b2 Jul 23 21:20:02.474078 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ImagesTestJSON-1070983287 Jul 23 21:20:02.474078 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ImagesTestJSON-1070983287-project Jul 23 21:20:02.474078 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:20:02.474078 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:20:02.474078 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: bb4f9dda4c2a411cb0394bf86e9ae223 Jul 23 21:20:02.474078 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ImagesTestJSON-1070983287-project Jul 23 21:20:02.474078 ncdv-master-1 devstack@n-api.service[131320]: method: Jul 23 21:20:02.474078 ncdv-master-1 devstack@n-api.service[131320]: exception: Image not found. Jul 23 21:20:02.474078 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '8a2df693-27eb-4ab8-9b5e-e603a022f603'} Jul 23 21:20:02.474078 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:20:02.474078 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:02.475240 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 23 21:20:02.475240 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 23 21:20:02.475240 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 23 21:20:02.475240 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 23 21:20:02.475240 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 23 21:20:02.475240 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 23 21:20:02.475240 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 23 21:20:02.475240 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 23 21:20:02.475240 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 23 21:20:02.475240 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 23 21:20:02.475240 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 23 21:20:02.475240 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 23 21:20:02.475240 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 23 21:20:02.475240 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 23 21:20:02.475240 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 8a2df693-27eb-4ab8-9b5e-e603a022f603 to delete Jul 23 21:20:02.475240 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:20:02.475240 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:20:02.475240 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:20:02.475240 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:02.477118 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 23 21:20:02.477118 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 23 21:20:02.477118 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 23 21:20:02.477118 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 23 21:20:02.477118 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 23 21:20:02.477118 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 23 21:20:02.477118 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8a2df693-27eb-4ab8-9b5e-e603a022f603 could not be found. Jul 23 21:20:02.477118 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:20:02.477118 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:20:02.477118 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:20:02.477118 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:02.477118 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:20:02.477118 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:20:02.477118 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:20:02.477118 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:20:02.477118 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:20:02.477118 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:20:02.477118 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:20:02.477118 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:20:02.477118 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 23 21:20:02.478894 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 23 21:20:02.478894 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 23 21:20:02.478894 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:20:02.478894 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:20:02.478894 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:20:02.478894 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:02.478894 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:20:02.478894 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:20:02.478894 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:20:02.478894 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:20:02.478894 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 23 21:20:02.478894 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:20:02.482216 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ac728175-d6e5-4b01-b36b-2ca7d135b178 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Returning 404 to user: Image not found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:20:02.484211 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ac728175-d6e5-4b01-b36b-2ca7d135b178 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "DELETE /compute/v2.1/images/8a2df693-27eb-4ab8-9b5e-e603a022f603" status: 404 len: 62 microversion: 2.1 time: 0.054909 Jul 23 21:20:02.489244 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 787/1578] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:20:02 2022] DELETE /compute/v2.1/images/8a2df693-27eb-4ab8-9b5e-e603a022f603 => generated 62 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 23 21:20:02.495838 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-cb95f120-3c96-4a98-aa77-8203248c9b7a req-159bbfa8-346b-4da7-b191-0a193d02729a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bc4befa-252d-456a-92cd-323bad80fcdf", "name": "network-vif-deleted", "tag": "f00e5169-4343-4b5e-aafd-b0e8eea7078c"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:20:02.514277 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-cb95f120-3c96-4a98-aa77-8203248c9b7a req-159bbfa8-346b-4da7-b191-0a193d02729a service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:02.514726 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-cb95f120-3c96-4a98-aa77-8203248c9b7a req-159bbfa8-346b-4da7-b191-0a193d02729a service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:02.534387 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-cb95f120-3c96-4a98-aa77-8203248c9b7a req-159bbfa8-346b-4da7-b191-0a193d02729a service nova] Creating event network-vif-deleted:f00e5169-4343-4b5e-aafd-b0e8eea7078c for instance 5bc4befa-252d-456a-92cd-323bad80fcdf on nch1-master-1 Jul 23 21:20:02.571429 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-cb95f120-3c96-4a98-aa77-8203248c9b7a req-159bbfa8-346b-4da7-b191-0a193d02729a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079419 Jul 23 21:20:02.572406 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 788/1579] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:20:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:20:02.578207 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-04472ba5-1328-495c-8140-d3a53f1500f5 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:02.581254 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-04472ba5-1328-495c-8140-d3a53f1500f5 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 9b360b14-9ea2-4336-b32e-d6546267664e] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:02.590581 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-04472ba5-1328-495c-8140-d3a53f1500f5 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:02.591339 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-04472ba5-1328-495c-8140-d3a53f1500f5 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:02.592557 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-04472ba5-1328-495c-8140-d3a53f1500f5 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:02.593255 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-04472ba5-1328-495c-8140-d3a53f1500f5 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:02.616138 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-04472ba5-1328-495c-8140-d3a53f1500f5 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] HTTP exception thrown: Instance 9b360b14-9ea2-4336-b32e-d6546267664e could not be found. Jul 23 21:20:02.619449 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-04472ba5-1328-495c-8140-d3a53f1500f5 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Request method failure captured: Jul 23 21:20:02.619449 ncdv-master-1 devstack@n-api.service[131320]: request: DELETE /compute/v2.1/servers/9b360b14-9ea2-4336-b32e-d6546267664e HTTP/1.1 Jul 23 21:20:02.619449 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:20:02.619449 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:20:02.619449 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:20:02.619449 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:20:02.619449 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:20:02.619449 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:20:02.619449 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:20:02.619449 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:20:02.619449 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GUJELDL_GsNeJwREywE_3jBr1HvzTVincHoSaHkmz1z6GZZjegpx0r2IR_6PBi9Tra-YYsN5qwdwSaeOz6I0mD6V9yMAx7BFDMUjtY9rJu7mfhQyUGyuxYI08t_rWsJ-odD6MQO0mzNpwl75bL9POwUU9lfytO2Ec0dK9a6mg0ozik Jul 23 21:20:02.619449 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:20:02.619449 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:20:02.619449 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:20:02.619449 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:20:02.619449 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:20:02.619449 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:20:02.619449 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 580ed681cbf44d10936259b17f60f1b2 Jul 23 21:20:02.619449 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ImagesTestJSON-1070983287 Jul 23 21:20:02.619449 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:20:02.619449 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:20:02.621234 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/580ed681cbf44d10936259b17f60f1b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/580ed681cbf44d10936259b17f60f1b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_580ed681cbf44d10936259b17f60f1b2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/580ed681cbf44d10936259b17f60f1b2"}]}] Jul 23 21:20:02.621234 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ImagesTestJSON-1070983287 Jul 23 21:20:02.621234 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 580ed681cbf44d10936259b17f60f1b2 Jul 23 21:20:02.621234 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ImagesTestJSON-1070983287 Jul 23 21:20:02.621234 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ImagesTestJSON-1070983287-project Jul 23 21:20:02.621234 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:20:02.621234 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:20:02.621234 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: bb4f9dda4c2a411cb0394bf86e9ae223 Jul 23 21:20:02.621234 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ImagesTestJSON-1070983287-project Jul 23 21:20:02.621234 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:20:02.621234 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance 9b360b14-9ea2-4336-b32e-d6546267664e could not be found. Jul 23 21:20:02.621234 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '9b360b14-9ea2-4336-b32e-d6546267664e'} Jul 23 21:20:02.622388 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:20:02.622388 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:02.622388 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:20:02.622388 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:20:02.622388 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:20:02.622388 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:20:02.622388 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:20:02.622388 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:20:02.622388 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:20:02.622388 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:20:02.622388 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b360b14-9ea2-4336-b32e-d6546267664e could not be found. Jul 23 21:20:02.622388 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:20:02.622388 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:20:02.622388 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:20:02.622388 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:02.622388 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:20:02.622388 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:20:02.622388 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:20:02.622388 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:20:02.622388 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:20:02.625162 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:20:02.625162 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 23 21:20:02.625162 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 23 21:20:02.625162 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 23 21:20:02.625162 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 23 21:20:02.625162 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:20:02.625162 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:20:02.625162 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:20:02.625162 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:20:02.625162 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b360b14-9ea2-4336-b32e-d6546267664e could not be found. Jul 23 21:20:02.625162 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:20:02.625162 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:20:02.625162 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:20:02.625162 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:02.625162 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:20:02.625162 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:20:02.625162 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:20:02.625162 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:20:02.625162 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b360b14-9ea2-4336-b32e-d6546267664e could not be found. Jul 23 21:20:02.625162 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:20:02.628107 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-04472ba5-1328-495c-8140-d3a53f1500f5 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Returning 404 to user: Instance 9b360b14-9ea2-4336-b32e-d6546267664e could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:20:02.628107 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-04472ba5-1328-495c-8140-d3a53f1500f5 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "DELETE /compute/v2.1/servers/9b360b14-9ea2-4336-b32e-d6546267664e" status: 404 len: 111 microversion: 2.1 time: 0.047713 Jul 23 21:20:02.628107 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 789/1580] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:20:02 2022] DELETE /compute/v2.1/servers/9b360b14-9ea2-4336-b32e-d6546267664e => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:20:02.654569 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-fac55bce-358d-4a59-a554-39a5c7b3a736 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:02.657456 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-fac55bce-358d-4a59-a554-39a5c7b3a736 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] [instance: 9b360b14-9ea2-4336-b32e-d6546267664e] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:02.668534 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fac55bce-358d-4a59-a554-39a5c7b3a736 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:02.669148 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fac55bce-358d-4a59-a554-39a5c7b3a736 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:02.670218 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fac55bce-358d-4a59-a554-39a5c7b3a736 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:02.670671 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fac55bce-358d-4a59-a554-39a5c7b3a736 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:02.690753 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-fac55bce-358d-4a59-a554-39a5c7b3a736 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] HTTP exception thrown: Instance 9b360b14-9ea2-4336-b32e-d6546267664e could not be found. Jul 23 21:20:02.692922 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-fac55bce-358d-4a59-a554-39a5c7b3a736 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Request method failure captured: Jul 23 21:20:02.692922 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/9b360b14-9ea2-4336-b32e-d6546267664e HTTP/1.1 Jul 23 21:20:02.692922 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:20:02.692922 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:20:02.692922 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:20:02.692922 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:20:02.692922 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:20:02.692922 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:20:02.692922 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:20:02.692922 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:20:02.692922 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GUJELDL_GsNeJwREywE_3jBr1HvzTVincHoSaHkmz1z6GZZjegpx0r2IR_6PBi9Tra-YYsN5qwdwSaeOz6I0mD6V9yMAx7BFDMUjtY9rJu7mfhQyUGyuxYI08t_rWsJ-odD6MQO0mzNpwl75bL9POwUU9lfytO2Ec0dK9a6mg0ozik Jul 23 21:20:02.692922 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:20:02.692922 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:20:02.692922 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:20:02.692922 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:20:02.692922 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:20:02.692922 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:20:02.692922 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 580ed681cbf44d10936259b17f60f1b2 Jul 23 21:20:02.692922 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ImagesTestJSON-1070983287 Jul 23 21:20:02.692922 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:20:02.692922 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:20:02.695304 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/580ed681cbf44d10936259b17f60f1b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/580ed681cbf44d10936259b17f60f1b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_580ed681cbf44d10936259b17f60f1b2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/580ed681cbf44d10936259b17f60f1b2"}]}] Jul 23 21:20:02.695304 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ImagesTestJSON-1070983287 Jul 23 21:20:02.695304 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 580ed681cbf44d10936259b17f60f1b2 Jul 23 21:20:02.695304 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ImagesTestJSON-1070983287 Jul 23 21:20:02.695304 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ImagesTestJSON-1070983287-project Jul 23 21:20:02.695304 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:20:02.695304 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:20:02.695304 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: bb4f9dda4c2a411cb0394bf86e9ae223 Jul 23 21:20:02.695304 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ImagesTestJSON-1070983287-project Jul 23 21:20:02.695304 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:20:02.695304 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance 9b360b14-9ea2-4336-b32e-d6546267664e could not be found. Jul 23 21:20:02.695304 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '9b360b14-9ea2-4336-b32e-d6546267664e'} Jul 23 21:20:02.695304 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:20:02.696576 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:02.696576 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:20:02.696576 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:20:02.696576 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:20:02.696576 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:20:02.696576 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:20:02.696576 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:20:02.696576 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:20:02.696576 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:20:02.696576 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b360b14-9ea2-4336-b32e-d6546267664e could not be found. Jul 23 21:20:02.696576 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:20:02.696576 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:20:02.696576 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:20:02.696576 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:02.696576 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:20:02.696576 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:20:02.696576 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:20:02.696576 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:20:02.696576 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:20:02.696576 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:20:02.698676 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:20:02.698676 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:20:02.698676 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:20:02.698676 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:20:02.698676 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:20:02.698676 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:20:02.698676 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b360b14-9ea2-4336-b32e-d6546267664e could not be found. Jul 23 21:20:02.698676 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:20:02.698676 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:20:02.698676 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:20:02.698676 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:02.698676 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:20:02.698676 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:20:02.698676 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:20:02.698676 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:20:02.698676 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b360b14-9ea2-4336-b32e-d6546267664e could not be found. Jul 23 21:20:02.698676 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:20:02.703520 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-fac55bce-358d-4a59-a554-39a5c7b3a736 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] Returning 404 to user: Instance 9b360b14-9ea2-4336-b32e-d6546267664e could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:20:02.704776 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-fac55bce-358d-4a59-a554-39a5c7b3a736 tempest-ImagesTestJSON-1070983287 tempest-ImagesTestJSON-1070983287-project] 10.222.0.17 "GET /compute/v2.1/servers/9b360b14-9ea2-4336-b32e-d6546267664e" status: 404 len: 111 microversion: 2.1 time: 0.058037 Jul 23 21:20:02.712318 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 790/1581] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:20:02 2022] GET /compute/v2.1/servers/9b360b14-9ea2-4336-b32e-d6546267664e => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:20:02.837813 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-42915039-399a-4e8b-91b6-37f385897a3f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:02.853557 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-42915039-399a-4e8b-91b6-37f385897a3f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:02.856943 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-42915039-399a-4e8b-91b6-37f385897a3f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:02.864043 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-42915039-399a-4e8b-91b6-37f385897a3f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1740 microversion: 2.42 time: 0.454697 Jul 23 21:20:02.865474 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 792/1582] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:20:02 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1740 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:20:02.881970 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-3c4a6c37-2986-47b0-88a3-6305a7732a90 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:02.882861 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-3c4a6c37-2986-47b0-88a3-6305a7732a90 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 769ee4e5-e4df-4d4e-9f4c-6372c60d9e01] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:02.891823 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3c4a6c37-2986-47b0-88a3-6305a7732a90 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:02.901984 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3c4a6c37-2986-47b0-88a3-6305a7732a90 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:02.903399 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3c4a6c37-2986-47b0-88a3-6305a7732a90 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:02.903854 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3c4a6c37-2986-47b0-88a3-6305a7732a90 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:03.054565 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4fe7d699-14c6-42b3-8f04-1da045139ed3 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1816419650", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "networks": [{"uuid": "1bf1175b-8b51-4fe1-8a7e-c57501a7f9a2"}]}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:20:03.169732 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-4fe7d699-14c6-42b3-8f04-1da045139ed3 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] validate_networks() for [('1bf1175b-8b51-4fe1-8a7e-c57501a7f9a2', None, None, None, None, None)] {{(pid=131320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:20:03.819431 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-3c4a6c37-2986-47b0-88a3-6305a7732a90 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:03.828570 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-3c4a6c37-2986-47b0-88a3-6305a7732a90 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/769ee4e5-e4df-4d4e-9f4c-6372c60d9e01" status: 200 len: 1468 microversion: 2.1 time: 0.960741 Jul 23 21:20:03.831248 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 793/1583] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:20:02 2022] GET /compute/v2.1/servers/769ee4e5-e4df-4d4e-9f4c-6372c60d9e01 => generated 1468 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:20:03.836599 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-eef34c8d-4214-4afe-8919-6f38e826dfb4 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:03.837472 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-eef34c8d-4214-4afe-8919-6f38e826dfb4 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: 214b4d99-34d8-48c7-924c-27cd2f6712e7] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:03.846687 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-eef34c8d-4214-4afe-8919-6f38e826dfb4 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:03.847436 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-eef34c8d-4214-4afe-8919-6f38e826dfb4 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:03.848610 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-eef34c8d-4214-4afe-8919-6f38e826dfb4 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:03.849053 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-eef34c8d-4214-4afe-8919-6f38e826dfb4 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:04.251023 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-4fe7d699-14c6-42b3-8f04-1da045139ed3 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:20:04.251903 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-4fe7d699-14c6-42b3-8f04-1da045139ed3 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:20:04.252019 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-4fe7d699-14c6-42b3-8f04-1da045139ed3 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:20:04.252444 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-4fe7d699-14c6-42b3-8f04-1da045139ed3 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:20:04.252864 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-4fe7d699-14c6-42b3-8f04-1da045139ed3 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:20:04.263094 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4fe7d699-14c6-42b3-8f04-1da045139ed3 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:04.263865 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4fe7d699-14c6-42b3-8f04-1da045139ed3 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:04.265067 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4fe7d699-14c6-42b3-8f04-1da045139ed3 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:04.265719 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4fe7d699-14c6-42b3-8f04-1da045139ed3 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:04.286793 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-4fe7d699-14c6-42b3-8f04-1da045139ed3 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Getting quotas for project e165633a87b04bd9bc3f6e575f53fb12. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:20:04.293103 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-4fe7d699-14c6-42b3-8f04-1da045139ed3 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Getting quotas for user 194f98e3c86b48e9952fe02d3648beb0 and project e165633a87b04bd9bc3f6e575f53fb12. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:20:04.307876 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-4fe7d699-14c6-42b3-8f04-1da045139ed3 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Going to run 1 instances... {{(pid=131320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:20:04.310639 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-4fe7d699-14c6-42b3-8f04-1da045139ed3 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] [instance: 059bbe3e-cf86-4689-a696-0161d7d27dfd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:20:04.369291 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4fe7d699-14c6-42b3-8f04-1da045139ed3 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.654307 Jul 23 21:20:04.377212 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 791/1584] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:20:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1664 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 23 21:20:04.382802 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f5dbd428-7bae-4c64-b7f4-2d1318f88786 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:04.384510 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f5dbd428-7bae-4c64-b7f4-2d1318f88786 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] [instance: d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:04.392649 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-eef34c8d-4214-4afe-8919-6f38e826dfb4 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:04.394543 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f5dbd428-7bae-4c64-b7f4-2d1318f88786 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:04.395306 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f5dbd428-7bae-4c64-b7f4-2d1318f88786 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:04.396371 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f5dbd428-7bae-4c64-b7f4-2d1318f88786 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:04.397691 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f5dbd428-7bae-4c64-b7f4-2d1318f88786 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:04.418032 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-eef34c8d-4214-4afe-8919-6f38e826dfb4 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:04.436101 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-eef34c8d-4214-4afe-8919-6f38e826dfb4 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:04.438828 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-eef34c8d-4214-4afe-8919-6f38e826dfb4 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/214b4d99-34d8-48c7-924c-27cd2f6712e7" status: 200 len: 1478 microversion: 2.25 time: 0.605491 Jul 23 21:20:04.440108 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 794/1585] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:20:03 2022] GET /compute/v2.1/servers/214b4d99-34d8-48c7-924c-27cd2f6712e7 => generated 1478 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:20:04.457000 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-91e7d4a2-2139-42ca-b88d-36b6b66d221e tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:04.462673 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-91e7d4a2-2139-42ca-b88d-36b6b66d221e tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 784e1fb4-876e-489f-9428-e01412642663] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:04.484206 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-91e7d4a2-2139-42ca-b88d-36b6b66d221e tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:04.485616 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-91e7d4a2-2139-42ca-b88d-36b6b66d221e tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:04.486756 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-91e7d4a2-2139-42ca-b88d-36b6b66d221e tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:04.488044 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-91e7d4a2-2139-42ca-b88d-36b6b66d221e tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:04.666402 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f5dbd428-7bae-4c64-b7f4-2d1318f88786 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ef41817e4f5478bb7afdcb59ed634cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af16c62b144aa0972331a69e3638c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:04.680266 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f5dbd428-7bae-4c64-b7f4-2d1318f88786 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ef41817e4f5478bb7afdcb59ed634cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af16c62b144aa0972331a69e3638c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:04.686393 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f5dbd428-7bae-4c64-b7f4-2d1318f88786 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ef41817e4f5478bb7afdcb59ed634cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af16c62b144aa0972331a69e3638c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:04.709495 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f5dbd428-7bae-4c64-b7f4-2d1318f88786 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] 10.222.0.17 "GET /compute/v2.1/servers/d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a" status: 200 len: 1446 microversion: 2.75 time: 0.326647 Jul 23 21:20:04.710235 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 792/1586] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:20:04 2022] GET /compute/v2.1/servers/d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a => generated 1446 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:20:04.725623 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ad97a1bb-5217-4a5f-96ec-1fac4c9b6320 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:04.736436 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ad97a1bb-5217-4a5f-96ec-1fac4c9b6320 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:04.761187 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ad97a1bb-5217-4a5f-96ec-1fac4c9b6320 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:04.765330 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ad97a1bb-5217-4a5f-96ec-1fac4c9b6320 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:04.768422 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ad97a1bb-5217-4a5f-96ec-1fac4c9b6320 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:04.787627 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ad97a1bb-5217-4a5f-96ec-1fac4c9b6320 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:04.935089 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-91e7d4a2-2139-42ca-b88d-36b6b66d221e tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:04.993652 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-91e7d4a2-2139-42ca-b88d-36b6b66d221e tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/784e1fb4-876e-489f-9428-e01412642663" status: 200 len: 1391 microversion: 2.1 time: 0.535927 Jul 23 21:20:05.011086 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 795/1587] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:20:04 2022] GET /compute/v2.1/servers/784e1fb4-876e-489f-9428-e01412642663 => generated 1391 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:20:05.025899 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-191700e1-e9b3-41de-af6d-dcc8e852726d tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:05.033941 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-191700e1-e9b3-41de-af6d-dcc8e852726d tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] [instance: 059bbe3e-cf86-4689-a696-0161d7d27dfd] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:05.238004 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-191700e1-e9b3-41de-af6d-dcc8e852726d tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '194f98e3c86b48e9952fe02d3648beb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e165633a87b04bd9bc3f6e575f53fb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:05.248898 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-191700e1-e9b3-41de-af6d-dcc8e852726d tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] 10.222.0.17 "GET /compute/v2.1/servers/059bbe3e-cf86-4689-a696-0161d7d27dfd" status: 200 len: 1224 microversion: 2.1 time: 0.235115 Jul 23 21:20:05.249437 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 796/1588] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:20:05 2022] GET /compute/v2.1/servers/059bbe3e-cf86-4689-a696-0161d7d27dfd => generated 1224 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:20:05.276859 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-0187b713-6be9-44e0-8bd7-9d221998b0ab tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Calling method '.version_select at 0x7f0b47f2edc0>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:05.282914 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0187b713-6be9-44e0-8bd7-9d221998b0ab tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:05.286556 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0187b713-6be9-44e0-8bd7-9d221998b0ab tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:05.322869 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-0187b713-6be9-44e0-8bd7-9d221998b0ab tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] 10.222.0.17 "GET /compute/v2.1/os-migrations" status: 200 len: 4048 microversion: 2.25 time: 0.052920 Jul 23 21:20:05.326713 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 797/1589] 10.222.0.17 () {60 vars in 1183 bytes} [Sat Jul 23 21:20:05 2022] GET /compute/v2.1/os-migrations => generated 4048 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:20:05.353183 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-7ab35397-7ce4-4473-8b7e-d20b5aeccc76 req-2a9767e9-f2b5-4b43-8f29-c3f76952cacc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "769ee4e5-e4df-4d4e-9f4c-6372c60d9e01", "name": "network-vif-deleted", "tag": "ac63fc07-76cc-4d6e-8aca-987edbb6e640"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:20:05.372061 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-7ab35397-7ce4-4473-8b7e-d20b5aeccc76 req-2a9767e9-f2b5-4b43-8f29-c3f76952cacc service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:05.374312 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-7ab35397-7ce4-4473-8b7e-d20b5aeccc76 req-2a9767e9-f2b5-4b43-8f29-c3f76952cacc service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:05.394144 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-7ab35397-7ce4-4473-8b7e-d20b5aeccc76 req-2a9767e9-f2b5-4b43-8f29-c3f76952cacc service nova] Creating event network-vif-deleted:ac63fc07-76cc-4d6e-8aca-987edbb6e640 for instance 769ee4e5-e4df-4d4e-9f4c-6372c60d9e01 on nch2-master-1 Jul 23 21:20:05.400115 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-7ab35397-7ce4-4473-8b7e-d20b5aeccc76 req-2a9767e9-f2b5-4b43-8f29-c3f76952cacc service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061824 Jul 23 21:20:05.400821 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 798/1590] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:20:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:20:05.420285 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a36af0f7-6725-44d9-9196-e4cf13d600f2 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:05.423996 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-a36af0f7-6725-44d9-9196-e4cf13d600f2 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 769ee4e5-e4df-4d4e-9f4c-6372c60d9e01] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:05.447029 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a36af0f7-6725-44d9-9196-e4cf13d600f2 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:05.449805 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a36af0f7-6725-44d9-9196-e4cf13d600f2 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:05.451074 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a36af0f7-6725-44d9-9196-e4cf13d600f2 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:05.451740 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a36af0f7-6725-44d9-9196-e4cf13d600f2 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:05.540375 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a36af0f7-6725-44d9-9196-e4cf13d600f2 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:05.542258 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a36af0f7-6725-44d9-9196-e4cf13d600f2 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:05.542989 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.objects.instance [None req-a36af0f7-6725-44d9-9196-e4cf13d600f2 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lazy-loading 'fault' on Instance uuid 769ee4e5-e4df-4d4e-9f4c-6372c60d9e01 {{(pid=131321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:20:05.663280 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-a36af0f7-6725-44d9-9196-e4cf13d600f2 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0133d9533fbd4be5b46dc308dbe3a7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5935212e8b6a40768ee3fc90807b0cb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:05.677025 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-a36af0f7-6725-44d9-9196-e4cf13d600f2 tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/769ee4e5-e4df-4d4e-9f4c-6372c60d9e01" status: 200 len: 1302 microversion: 2.1 time: 0.266390 Jul 23 21:20:05.681529 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 799/1591] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:20:05 2022] GET /compute/v2.1/servers/769ee4e5-e4df-4d4e-9f4c-6372c60d9e01 => generated 1302 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:20:05.691498 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-319a4a49-75ee-4f73-b7db-88c75caf923a tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:05.694266 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-319a4a49-75ee-4f73-b7db-88c75caf923a tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] [instance: 214b4d99-34d8-48c7-924c-27cd2f6712e7] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:05.710001 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-319a4a49-75ee-4f73-b7db-88c75caf923a tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:05.714657 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-319a4a49-75ee-4f73-b7db-88c75caf923a tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:05.718195 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-319a4a49-75ee-4f73-b7db-88c75caf923a tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:05.720577 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-319a4a49-75ee-4f73-b7db-88c75caf923a tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:05.929147 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ad97a1bb-5217-4a5f-96ec-1fac4c9b6320 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:05.943906 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ad97a1bb-5217-4a5f-96ec-1fac4c9b6320 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:05.951622 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ad97a1bb-5217-4a5f-96ec-1fac4c9b6320 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:05.953055 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ad97a1bb-5217-4a5f-96ec-1fac4c9b6320 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1832 microversion: 2.42 time: 1.240251 Jul 23 21:20:05.968432 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 793/1592] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:20:04 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1832 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:20:05.979759 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2349ff3a-315d-463e-b1f8-1e4dceb6b5be tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:05.980601 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-2349ff3a-315d-463e-b1f8-1e4dceb6b5be tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] [instance: d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:06.001502 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2349ff3a-315d-463e-b1f8-1e4dceb6b5be tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:06.002290 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2349ff3a-315d-463e-b1f8-1e4dceb6b5be tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:06.003288 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2349ff3a-315d-463e-b1f8-1e4dceb6b5be tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:06.003912 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2349ff3a-315d-463e-b1f8-1e4dceb6b5be tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:06.029851 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.objects.instance [None req-319a4a49-75ee-4f73-b7db-88c75caf923a tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] Lazy-loading 'services' on Instance uuid 214b4d99-34d8-48c7-924c-27cd2f6712e7 {{(pid=131321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:20:06.073846 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-319a4a49-75ee-4f73-b7db-88c75caf923a tempest-LiveAutoBlockMigrationV225Test-194022042 tempest-LiveAutoBlockMigrationV225Test-194022042-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/214b4d99-34d8-48c7-924c-27cd2f6712e7" status: 200 len: 1971 microversion: 2.25 time: 0.390070 Jul 23 21:20:06.075886 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 800/1593] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:20:05 2022] GET /compute/v2.1/servers/214b4d99-34d8-48c7-924c-27cd2f6712e7 => generated 1971 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:20:06.097765 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f5f17ca7-3b03-460d-b5fc-ec94e9a278db tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:06.099157 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-f5f17ca7-3b03-460d-b5fc-ec94e9a278db tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 784e1fb4-876e-489f-9428-e01412642663] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:06.119269 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f5f17ca7-3b03-460d-b5fc-ec94e9a278db tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:06.119864 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f5f17ca7-3b03-460d-b5fc-ec94e9a278db tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:06.120751 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f5f17ca7-3b03-460d-b5fc-ec94e9a278db tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:06.121342 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f5f17ca7-3b03-460d-b5fc-ec94e9a278db tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:06.142441 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-2349ff3a-315d-463e-b1f8-1e4dceb6b5be tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ef41817e4f5478bb7afdcb59ed634cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af16c62b144aa0972331a69e3638c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:06.153593 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-2349ff3a-315d-463e-b1f8-1e4dceb6b5be tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ef41817e4f5478bb7afdcb59ed634cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af16c62b144aa0972331a69e3638c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:06.159996 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-2349ff3a-315d-463e-b1f8-1e4dceb6b5be tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ef41817e4f5478bb7afdcb59ed634cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af16c62b144aa0972331a69e3638c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:06.176520 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2349ff3a-315d-463e-b1f8-1e4dceb6b5be tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] 10.222.0.17 "GET /compute/v2.1/servers/d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a" status: 200 len: 1446 microversion: 2.75 time: 0.206644 Jul 23 21:20:06.177178 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 794/1594] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:20:05 2022] GET /compute/v2.1/servers/d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a => generated 1446 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:20:06.187002 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f6106aa0-65f5-424e-9d3c-a0e14c7e59d2 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:06.187844 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f6106aa0-65f5-424e-9d3c-a0e14c7e59d2 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: 214b4d99-34d8-48c7-924c-27cd2f6712e7] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:06.194941 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f6106aa0-65f5-424e-9d3c-a0e14c7e59d2 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:06.195468 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f6106aa0-65f5-424e-9d3c-a0e14c7e59d2 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:06.196448 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f6106aa0-65f5-424e-9d3c-a0e14c7e59d2 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:06.197280 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f6106aa0-65f5-424e-9d3c-a0e14c7e59d2 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:06.226718 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f6106aa0-65f5-424e-9d3c-a0e14c7e59d2 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: 214b4d99-34d8-48c7-924c-27cd2f6712e7] Going to try to terminate instance {{(pid=131320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:20:06.357545 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f6106aa0-65f5-424e-9d3c-a0e14c7e59d2 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "DELETE /compute/v2.1/servers/214b4d99-34d8-48c7-924c-27cd2f6712e7" status: 204 len: 0 microversion: 2.25 time: 0.174266 Jul 23 21:20:06.360835 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 795/1595] 10.222.0.17 () {60 vars in 1279 bytes} [Sat Jul 23 21:20:06 2022] DELETE /compute/v2.1/servers/214b4d99-34d8-48c7-924c-27cd2f6712e7 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 23 21:20:06.368839 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2b4727c4-6a7f-4843-a827-9b81bdacef8a tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:06.370620 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-2b4727c4-6a7f-4843-a827-9b81bdacef8a tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] [instance: 059bbe3e-cf86-4689-a696-0161d7d27dfd] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:06.379891 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2b4727c4-6a7f-4843-a827-9b81bdacef8a tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:06.380998 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2b4727c4-6a7f-4843-a827-9b81bdacef8a tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:06.382229 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2b4727c4-6a7f-4843-a827-9b81bdacef8a tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:06.383114 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2b4727c4-6a7f-4843-a827-9b81bdacef8a tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:06.500136 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-f5f17ca7-3b03-460d-b5fc-ec94e9a278db tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:06.511246 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-f5f17ca7-3b03-460d-b5fc-ec94e9a278db tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/784e1fb4-876e-489f-9428-e01412642663" status: 200 len: 1381 microversion: 2.1 time: 0.433455 Jul 23 21:20:06.512624 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 801/1596] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:20:06 2022] GET /compute/v2.1/servers/784e1fb4-876e-489f-9428-e01412642663 => generated 1381 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:20:06.531355 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-03dc3389-64ea-4778-93d5-cf475b8e4dd7 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:06.532129 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-03dc3389-64ea-4778-93d5-cf475b8e4dd7 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: 214b4d99-34d8-48c7-924c-27cd2f6712e7] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:06.550174 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-03dc3389-64ea-4778-93d5-cf475b8e4dd7 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:06.550673 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-03dc3389-64ea-4778-93d5-cf475b8e4dd7 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:06.553076 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-03dc3389-64ea-4778-93d5-cf475b8e4dd7 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:06.553076 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-03dc3389-64ea-4778-93d5-cf475b8e4dd7 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:06.742408 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-2b4727c4-6a7f-4843-a827-9b81bdacef8a tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '194f98e3c86b48e9952fe02d3648beb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e165633a87b04bd9bc3f6e575f53fb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:06.774763 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2b4727c4-6a7f-4843-a827-9b81bdacef8a tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] 10.222.0.17 "GET /compute/v2.1/servers/059bbe3e-cf86-4689-a696-0161d7d27dfd" status: 200 len: 1276 microversion: 2.1 time: 0.411647 Jul 23 21:20:06.778141 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 796/1597] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:20:06 2022] GET /compute/v2.1/servers/059bbe3e-cf86-4689-a696-0161d7d27dfd => generated 1276 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:20:06.796807 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-251d1d45-9e59-4a85-a3a1-59b6d61cfa83 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Calling method '.version_select at 0x7f0b47bd6f70>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:06.804863 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-251d1d45-9e59-4a85-a3a1-59b6d61cfa83 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:06.807523 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-251d1d45-9e59-4a85-a3a1-59b6d61cfa83 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:06.863862 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-251d1d45-9e59-4a85-a3a1-59b6d61cfa83 tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] 10.222.0.17 "GET /compute/v2.1/os-migrations" status: 200 len: 3088 microversion: 2.1 time: 0.081609 Jul 23 21:20:06.876622 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 797/1598] 10.222.0.17 () {58 vars in 1142 bytes} [Sat Jul 23 21:20:06 2022] GET /compute/v2.1/os-migrations => generated 3088 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:20:06.887150 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-037391a2-a555-404b-8052-b2accdf1a76e tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:06.887781 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-037391a2-a555-404b-8052-b2accdf1a76e tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] [instance: 769ee4e5-e4df-4d4e-9f4c-6372c60d9e01] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:06.904820 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-037391a2-a555-404b-8052-b2accdf1a76e tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:06.905325 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-037391a2-a555-404b-8052-b2accdf1a76e tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:06.907295 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-037391a2-a555-404b-8052-b2accdf1a76e tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:06.909045 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-037391a2-a555-404b-8052-b2accdf1a76e tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:06.944767 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-037391a2-a555-404b-8052-b2accdf1a76e tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] HTTP exception thrown: Instance 769ee4e5-e4df-4d4e-9f4c-6372c60d9e01 could not be found. Jul 23 21:20:06.948909 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-037391a2-a555-404b-8052-b2accdf1a76e tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Request method failure captured: Jul 23 21:20:06.948909 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/769ee4e5-e4df-4d4e-9f4c-6372c60d9e01 HTTP/1.1 Jul 23 21:20:06.948909 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:20:06.948909 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:20:06.948909 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:20:06.948909 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:20:06.948909 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:20:06.948909 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:20:06.948909 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:20:06.948909 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:20:06.948909 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GSXVRtT4D6DOYfgu59iPITKQ5mqcVxrjQp1t1yDZwCjvkDyx4wS8lBIVwN9smI5UFCECIxWKCBOaVPG0VLJTlOJdXdkXVrNU_74esEReGGgA0n9alBex-aEm1JD8sWUZRSrbN_rcHQ4ciIzp29ExKjSpi_IoKu7t3of0FKJObJf45w Jul 23 21:20:06.948909 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:20:06.948909 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:20:06.948909 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:20:06.948909 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:20:06.948909 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:20:06.948909 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:20:06.948909 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 5935212e8b6a40768ee3fc90807b0cb1 Jul 23 21:20:06.948909 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-MigrationsAdminTest-2054055598 Jul 23 21:20:06.948909 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:20:06.948909 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:20:06.950394 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5935212e8b6a40768ee3fc90807b0cb1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5935212e8b6a40768ee3fc90807b0cb1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_5935212e8b6a40768ee3fc90807b0cb1", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/5935212e8b6a40768ee3fc90807b0cb1"}]}] Jul 23 21:20:06.950394 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-MigrationsAdminTest-2054055598 Jul 23 21:20:06.950394 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 5935212e8b6a40768ee3fc90807b0cb1 Jul 23 21:20:06.950394 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-MigrationsAdminTest-2054055598 Jul 23 21:20:06.950394 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-MigrationsAdminTest-2054055598-project Jul 23 21:20:06.950394 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:20:06.950394 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:20:06.950394 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 0133d9533fbd4be5b46dc308dbe3a7d9 Jul 23 21:20:06.950394 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-MigrationsAdminTest-2054055598-project Jul 23 21:20:06.950394 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:20:06.950394 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance 769ee4e5-e4df-4d4e-9f4c-6372c60d9e01 could not be found. Jul 23 21:20:06.950394 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '769ee4e5-e4df-4d4e-9f4c-6372c60d9e01'} Jul 23 21:20:06.951199 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:20:06.951199 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:06.951199 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:20:06.951199 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:20:06.951199 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:20:06.951199 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:20:06.951199 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:20:06.951199 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:20:06.951199 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:20:06.951199 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:20:06.951199 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 769ee4e5-e4df-4d4e-9f4c-6372c60d9e01 could not be found. Jul 23 21:20:06.951199 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:20:06.951199 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:20:06.951199 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:20:06.951199 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:06.951199 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:20:06.951199 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:20:06.951199 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:20:06.951199 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:20:06.951199 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:20:06.953244 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:20:06.953244 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:20:06.953244 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:20:06.953244 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:20:06.953244 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:20:06.953244 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:20:06.953244 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:20:06.953244 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 769ee4e5-e4df-4d4e-9f4c-6372c60d9e01 could not be found. Jul 23 21:20:06.953244 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:20:06.953244 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:20:06.953244 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:20:06.953244 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:06.953244 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:20:06.953244 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:20:06.953244 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:20:06.953244 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:20:06.953244 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 769ee4e5-e4df-4d4e-9f4c-6372c60d9e01 could not be found. Jul 23 21:20:06.953244 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:20:06.955082 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-037391a2-a555-404b-8052-b2accdf1a76e tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] Returning 404 to user: Instance 769ee4e5-e4df-4d4e-9f4c-6372c60d9e01 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:20:06.955082 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-037391a2-a555-404b-8052-b2accdf1a76e tempest-MigrationsAdminTest-2054055598 tempest-MigrationsAdminTest-2054055598-project] 10.222.0.17 "GET /compute/v2.1/servers/769ee4e5-e4df-4d4e-9f4c-6372c60d9e01" status: 404 len: 111 microversion: 2.1 time: 0.072720 Jul 23 21:20:06.955082 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 798/1599] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:20:06 2022] GET /compute/v2.1/servers/769ee4e5-e4df-4d4e-9f4c-6372c60d9e01 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:20:06.965891 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-911db241-dcb3-459a-be04-a3cfd2304eac tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:06.966664 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-911db241-dcb3-459a-be04-a3cfd2304eac tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] [instance: 784e1fb4-876e-489f-9428-e01412642663] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:06.984954 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-911db241-dcb3-459a-be04-a3cfd2304eac tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:06.986404 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-911db241-dcb3-459a-be04-a3cfd2304eac tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:06.987575 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-911db241-dcb3-459a-be04-a3cfd2304eac tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:06.990448 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-911db241-dcb3-459a-be04-a3cfd2304eac tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:07.121027 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-03dc3389-64ea-4778-93d5-cf475b8e4dd7 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:07.137236 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-03dc3389-64ea-4778-93d5-cf475b8e4dd7 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:07.145775 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-03dc3389-64ea-4778-93d5-cf475b8e4dd7 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:07.147726 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-03dc3389-64ea-4778-93d5-cf475b8e4dd7 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/214b4d99-34d8-48c7-924c-27cd2f6712e7" status: 200 len: 1484 microversion: 2.25 time: 0.633625 Jul 23 21:20:07.150918 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 802/1600] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:20:06 2022] GET /compute/v2.1/servers/214b4d99-34d8-48c7-924c-27cd2f6712e7 => generated 1484 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:20:07.170577 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d396ad69-e856-4c6e-b74c-4fdfcbfbd61a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:07.171678 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-d396ad69-e856-4c6e-b74c-4fdfcbfbd61a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:07.176773 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:20:07.189548 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d396ad69-e856-4c6e-b74c-4fdfcbfbd61a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:07.192034 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d396ad69-e856-4c6e-b74c-4fdfcbfbd61a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:07.193169 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d396ad69-e856-4c6e-b74c-4fdfcbfbd61a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:07.195032 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d396ad69-e856-4c6e-b74c-4fdfcbfbd61a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:07.592684 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-d396ad69-e856-4c6e-b74c-4fdfcbfbd61a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:07.612340 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-d396ad69-e856-4c6e-b74c-4fdfcbfbd61a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:07.616267 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-d396ad69-e856-4c6e-b74c-4fdfcbfbd61a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:07.617688 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-d396ad69-e856-4c6e-b74c-4fdfcbfbd61a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1832 microversion: 2.42 time: 0.464748 Jul 23 21:20:07.621944 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 803/1601] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:20:07 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1832 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:20:07.634693 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-5cebe695-a826-4c45-9f4e-2912e70030f3 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:07.635322 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-5cebe695-a826-4c45-9f4e-2912e70030f3 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] [instance: d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:07.642522 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5cebe695-a826-4c45-9f4e-2912e70030f3 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:07.643293 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5cebe695-a826-4c45-9f4e-2912e70030f3 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:07.644238 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5cebe695-a826-4c45-9f4e-2912e70030f3 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:07.644830 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5cebe695-a826-4c45-9f4e-2912e70030f3 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:07.743725 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-5cebe695-a826-4c45-9f4e-2912e70030f3 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ef41817e4f5478bb7afdcb59ed634cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af16c62b144aa0972331a69e3638c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:07.756917 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-5cebe695-a826-4c45-9f4e-2912e70030f3 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ef41817e4f5478bb7afdcb59ed634cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af16c62b144aa0972331a69e3638c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:07.760318 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-5cebe695-a826-4c45-9f4e-2912e70030f3 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ef41817e4f5478bb7afdcb59ed634cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af16c62b144aa0972331a69e3638c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:07.781343 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-5cebe695-a826-4c45-9f4e-2912e70030f3 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] 10.222.0.17 "GET /compute/v2.1/servers/d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a" status: 200 len: 1446 microversion: 2.75 time: 0.157531 Jul 23 21:20:07.782048 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 804/1602] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:20:07 2022] GET /compute/v2.1/servers/d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a => generated 1446 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:20:07.801553 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-55964ff6-1c4f-4631-b5fd-aea7cf6e8867 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:07.802259 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-55964ff6-1c4f-4631-b5fd-aea7cf6e8867 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] [instance: 059bbe3e-cf86-4689-a696-0161d7d27dfd] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:07.806319 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-911db241-dcb3-459a-be04-a3cfd2304eac tempest-LiveMigrationTest-1290036868 tempest-LiveMigrationTest-1290036868-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/784e1fb4-876e-489f-9428-e01412642663" status: 200 len: 1532 microversion: 2.1 time: 0.849688 Jul 23 21:20:07.809798 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-55964ff6-1c4f-4631-b5fd-aea7cf6e8867 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:07.810026 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 799/1603] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:20:06 2022] GET /compute/v2.1/servers/784e1fb4-876e-489f-9428-e01412642663 => generated 1532 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:20:07.822266 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-55964ff6-1c4f-4631-b5fd-aea7cf6e8867 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:07.824157 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-55964ff6-1c4f-4631-b5fd-aea7cf6e8867 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:07.825302 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-55964ff6-1c4f-4631-b5fd-aea7cf6e8867 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:07.839938 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-afaf8eff-62e6-451f-b83e-a560a142656c tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:07.840920 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-afaf8eff-62e6-451f-b83e-a560a142656c tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 784e1fb4-876e-489f-9428-e01412642663] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:07.856417 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-afaf8eff-62e6-451f-b83e-a560a142656c tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:07.856879 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-afaf8eff-62e6-451f-b83e-a560a142656c tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:07.867565 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-afaf8eff-62e6-451f-b83e-a560a142656c tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:07.868024 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-afaf8eff-62e6-451f-b83e-a560a142656c tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:07.940626 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-afaf8eff-62e6-451f-b83e-a560a142656c tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 784e1fb4-876e-489f-9428-e01412642663] Going to try to terminate instance {{(pid=131320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:20:08.036095 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-55964ff6-1c4f-4631-b5fd-aea7cf6e8867 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '194f98e3c86b48e9952fe02d3648beb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e165633a87b04bd9bc3f6e575f53fb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:08.050306 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-55964ff6-1c4f-4631-b5fd-aea7cf6e8867 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] 10.222.0.17 "GET /compute/v2.1/servers/059bbe3e-cf86-4689-a696-0161d7d27dfd" status: 200 len: 1282 microversion: 2.1 time: 0.253427 Jul 23 21:20:08.055619 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 805/1604] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:20:07 2022] GET /compute/v2.1/servers/059bbe3e-cf86-4689-a696-0161d7d27dfd => generated 1282 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:20:08.068931 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:20:08.163669 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-afaf8eff-62e6-451f-b83e-a560a142656c tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "DELETE /compute/v2.1/servers/784e1fb4-876e-489f-9428-e01412642663" status: 204 len: 0 microversion: 2.1 time: 0.327718 Jul 23 21:20:08.167664 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e7e617f9-bd65-46cd-91f9-e5bc71fb1ee4 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:08.168715 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 800/1605] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:20:07 2022] DELETE /compute/v2.1/servers/784e1fb4-876e-489f-9428-e01412642663 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:20:08.169140 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-e7e617f9-bd65-46cd-91f9-e5bc71fb1ee4 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: 214b4d99-34d8-48c7-924c-27cd2f6712e7] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:08.176275 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9962250d-6341-44d2-b4bc-5e466de4a491 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:08.177081 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-9962250d-6341-44d2-b4bc-5e466de4a491 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 784e1fb4-876e-489f-9428-e01412642663] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:08.184492 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9962250d-6341-44d2-b4bc-5e466de4a491 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:08.185006 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9962250d-6341-44d2-b4bc-5e466de4a491 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:08.185812 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9962250d-6341-44d2-b4bc-5e466de4a491 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:08.186274 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9962250d-6341-44d2-b4bc-5e466de4a491 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:08.187737 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e7e617f9-bd65-46cd-91f9-e5bc71fb1ee4 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:08.188444 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e7e617f9-bd65-46cd-91f9-e5bc71fb1ee4 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:08.189435 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e7e617f9-bd65-46cd-91f9-e5bc71fb1ee4 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:08.191406 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e7e617f9-bd65-46cd-91f9-e5bc71fb1ee4 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:08.551746 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-e7e617f9-bd65-46cd-91f9-e5bc71fb1ee4 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:08.563329 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-e7e617f9-bd65-46cd-91f9-e5bc71fb1ee4 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:08.571856 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-e7e617f9-bd65-46cd-91f9-e5bc71fb1ee4 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:08.573154 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-e7e617f9-bd65-46cd-91f9-e5bc71fb1ee4 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/214b4d99-34d8-48c7-924c-27cd2f6712e7" status: 200 len: 1484 microversion: 2.25 time: 0.410206 Jul 23 21:20:08.574290 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 806/1606] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:20:08 2022] GET /compute/v2.1/servers/214b4d99-34d8-48c7-924c-27cd2f6712e7 => generated 1484 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:20:08.642043 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ad9f346b-22de-40ec-bb4f-159cdda9714c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:08.643245 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-ad9f346b-22de-40ec-bb4f-159cdda9714c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:08.661551 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ad9f346b-22de-40ec-bb4f-159cdda9714c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:08.662333 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ad9f346b-22de-40ec-bb4f-159cdda9714c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:08.663463 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ad9f346b-22de-40ec-bb4f-159cdda9714c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:08.664158 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ad9f346b-22de-40ec-bb4f-159cdda9714c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:09.076869 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ad9f346b-22de-40ec-bb4f-159cdda9714c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:09.087656 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ad9f346b-22de-40ec-bb4f-159cdda9714c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:09.092365 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ad9f346b-22de-40ec-bb4f-159cdda9714c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:09.097476 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-ad9f346b-22de-40ec-bb4f-159cdda9714c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1832 microversion: 2.42 time: 0.459821 Jul 23 21:20:09.100857 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 807/1607] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:20:08 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1832 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:20:09.105896 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-b6f4d540-ad09-4bb3-9d31-42304dd1e213 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:09.106634 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-b6f4d540-ad09-4bb3-9d31-42304dd1e213 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] [instance: d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:09.123615 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b6f4d540-ad09-4bb3-9d31-42304dd1e213 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:09.123994 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b6f4d540-ad09-4bb3-9d31-42304dd1e213 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:09.125170 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b6f4d540-ad09-4bb3-9d31-42304dd1e213 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:09.125618 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b6f4d540-ad09-4bb3-9d31-42304dd1e213 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:09.210962 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-9962250d-6341-44d2-b4bc-5e466de4a491 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:09.223927 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9962250d-6341-44d2-b4bc-5e466de4a491 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/784e1fb4-876e-489f-9428-e01412642663" status: 200 len: 1387 microversion: 2.1 time: 1.053662 Jul 23 21:20:09.224701 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 801/1608] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:20:08 2022] GET /compute/v2.1/servers/784e1fb4-876e-489f-9428-e01412642663 => generated 1387 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:20:09.235282 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-9844a992-2399-4d7f-ab71-4df907b01065 req-1393998f-a108-443a-b25e-c7a494502040 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d09f96e-8ea6-4838-8264-4535f77fa39d", "tag": "857743d4-9fc9-4509-a86f-9253f99e2a3c"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:20:09.248205 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-9844a992-2399-4d7f-ab71-4df907b01065 req-1393998f-a108-443a-b25e-c7a494502040 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:09.250687 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-9844a992-2399-4d7f-ab71-4df907b01065 req-1393998f-a108-443a-b25e-c7a494502040 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:09.259686 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-b6f4d540-ad09-4bb3-9d31-42304dd1e213 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ef41817e4f5478bb7afdcb59ed634cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af16c62b144aa0972331a69e3638c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:09.269217 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-b6f4d540-ad09-4bb3-9d31-42304dd1e213 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ef41817e4f5478bb7afdcb59ed634cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af16c62b144aa0972331a69e3638c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:09.270756 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-b6f4d540-ad09-4bb3-9d31-42304dd1e213 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ef41817e4f5478bb7afdcb59ed634cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af16c62b144aa0972331a69e3638c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:09.275266 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-9844a992-2399-4d7f-ab71-4df907b01065 req-1393998f-a108-443a-b25e-c7a494502040 service nova] Creating event network-changed:857743d4-9fc9-4509-a86f-9253f99e2a3c for instance 4d09f96e-8ea6-4838-8264-4535f77fa39d on nch2-master-1 Jul 23 21:20:09.281785 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-9844a992-2399-4d7f-ab71-4df907b01065 req-1393998f-a108-443a-b25e-c7a494502040 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055243 Jul 23 21:20:09.282644 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 802/1609] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:20:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:20:09.288594 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-dceadf69-32f7-492e-a26e-ffd82ff0de8f tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:09.289443 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-dceadf69-32f7-492e-a26e-ffd82ff0de8f tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] [instance: 059bbe3e-cf86-4689-a696-0161d7d27dfd] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:09.290830 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-b6f4d540-ad09-4bb3-9d31-42304dd1e213 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] 10.222.0.17 "GET /compute/v2.1/servers/d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a" status: 200 len: 1446 microversion: 2.75 time: 0.188839 Jul 23 21:20:09.295430 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 808/1610] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:20:09 2022] GET /compute/v2.1/servers/d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a => generated 1446 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:20:09.297697 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dceadf69-32f7-492e-a26e-ffd82ff0de8f tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:09.298703 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dceadf69-32f7-492e-a26e-ffd82ff0de8f tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:09.299601 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dceadf69-32f7-492e-a26e-ffd82ff0de8f tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:09.300130 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dceadf69-32f7-492e-a26e-ffd82ff0de8f tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:09.467146 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-dceadf69-32f7-492e-a26e-ffd82ff0de8f tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '194f98e3c86b48e9952fe02d3648beb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e165633a87b04bd9bc3f6e575f53fb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:09.476004 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-dceadf69-32f7-492e-a26e-ffd82ff0de8f tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] 10.222.0.17 "GET /compute/v2.1/servers/059bbe3e-cf86-4689-a696-0161d7d27dfd" status: 200 len: 1282 microversion: 2.1 time: 0.191756 Jul 23 21:20:09.476522 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 803/1611] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:20:09 2022] GET /compute/v2.1/servers/059bbe3e-cf86-4689-a696-0161d7d27dfd => generated 1282 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:20:09.592017 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-2598bef5-19f0-4816-b6e7-946d81bbef91 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:09.593208 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-2598bef5-19f0-4816-b6e7-946d81bbef91 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: 214b4d99-34d8-48c7-924c-27cd2f6712e7] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:09.606471 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2598bef5-19f0-4816-b6e7-946d81bbef91 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:09.607138 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2598bef5-19f0-4816-b6e7-946d81bbef91 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:09.608252 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2598bef5-19f0-4816-b6e7-946d81bbef91 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:09.608927 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2598bef5-19f0-4816-b6e7-946d81bbef91 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:09.631469 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=100 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:20:10.118637 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2bad65e0-c503-481a-b706-b2b89c61159c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:10.119257 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-2bad65e0-c503-481a-b706-b2b89c61159c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:10.127494 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2bad65e0-c503-481a-b706-b2b89c61159c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:10.127950 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2bad65e0-c503-481a-b706-b2b89c61159c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:10.128854 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2bad65e0-c503-481a-b706-b2b89c61159c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:10.129480 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2bad65e0-c503-481a-b706-b2b89c61159c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:10.270718 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-2598bef5-19f0-4816-b6e7-946d81bbef91 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:10.294525 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-2598bef5-19f0-4816-b6e7-946d81bbef91 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:10.297578 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-2598bef5-19f0-4816-b6e7-946d81bbef91 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:10.299256 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-2598bef5-19f0-4816-b6e7-946d81bbef91 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/214b4d99-34d8-48c7-924c-27cd2f6712e7" status: 200 len: 1442 microversion: 2.25 time: 0.711601 Jul 23 21:20:10.312399 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 809/1612] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:20:09 2022] GET /compute/v2.1/servers/214b4d99-34d8-48c7-924c-27cd2f6712e7 => generated 1442 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:20:10.318934 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-bccf3de2-2012-4202-b8e9-1f588cf7c722 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:10.320267 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-bccf3de2-2012-4202-b8e9-1f588cf7c722 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 784e1fb4-876e-489f-9428-e01412642663] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:10.330179 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bccf3de2-2012-4202-b8e9-1f588cf7c722 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:10.331201 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bccf3de2-2012-4202-b8e9-1f588cf7c722 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:10.332638 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bccf3de2-2012-4202-b8e9-1f588cf7c722 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:10.333368 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bccf3de2-2012-4202-b8e9-1f588cf7c722 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:10.706014 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-2bad65e0-c503-481a-b706-b2b89c61159c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:10.723440 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-2bad65e0-c503-481a-b706-b2b89c61159c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:10.732230 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-2bad65e0-c503-481a-b706-b2b89c61159c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:10.734714 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2bad65e0-c503-481a-b706-b2b89c61159c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1832 microversion: 2.42 time: 0.619946 Jul 23 21:20:10.736284 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 804/1613] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:20:10 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1832 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:20:10.746035 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5969c4ec-491c-4c7f-8baf-6253dfb80be5 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:10.750660 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5969c4ec-491c-4c7f-8baf-6253dfb80be5 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] [instance: d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:10.767237 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5969c4ec-491c-4c7f-8baf-6253dfb80be5 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:10.767731 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5969c4ec-491c-4c7f-8baf-6253dfb80be5 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:10.770571 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5969c4ec-491c-4c7f-8baf-6253dfb80be5 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:10.771858 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5969c4ec-491c-4c7f-8baf-6253dfb80be5 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:11.016756 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5969c4ec-491c-4c7f-8baf-6253dfb80be5 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ef41817e4f5478bb7afdcb59ed634cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af16c62b144aa0972331a69e3638c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:11.031883 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5969c4ec-491c-4c7f-8baf-6253dfb80be5 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ef41817e4f5478bb7afdcb59ed634cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af16c62b144aa0972331a69e3638c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:11.040635 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5969c4ec-491c-4c7f-8baf-6253dfb80be5 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ef41817e4f5478bb7afdcb59ed634cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af16c62b144aa0972331a69e3638c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:11.061835 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5969c4ec-491c-4c7f-8baf-6253dfb80be5 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] 10.222.0.17 "GET /compute/v2.1/servers/d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a" status: 200 len: 1446 microversion: 2.75 time: 0.324321 Jul 23 21:20:11.068301 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 805/1614] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:20:10 2022] GET /compute/v2.1/servers/d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a => generated 1446 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:20:11.083868 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b95ef973-eda7-4bac-99bf-7b7d44e04201 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:11.084492 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b95ef973-eda7-4bac-99bf-7b7d44e04201 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] [instance: 059bbe3e-cf86-4689-a696-0161d7d27dfd] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:11.106929 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b95ef973-eda7-4bac-99bf-7b7d44e04201 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:11.107363 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b95ef973-eda7-4bac-99bf-7b7d44e04201 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:11.108160 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b95ef973-eda7-4bac-99bf-7b7d44e04201 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:11.115846 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b95ef973-eda7-4bac-99bf-7b7d44e04201 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:11.286283 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-bccf3de2-2012-4202-b8e9-1f588cf7c722 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:11.297445 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-bccf3de2-2012-4202-b8e9-1f588cf7c722 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/784e1fb4-876e-489f-9428-e01412642663" status: 200 len: 1387 microversion: 2.1 time: 0.982069 Jul 23 21:20:11.301070 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 810/1615] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:20:10 2022] GET /compute/v2.1/servers/784e1fb4-876e-489f-9428-e01412642663 => generated 1387 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:20:11.317440 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f85f7f51-76f9-4b72-9be8-b51e2c32db07 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:11.318517 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-f85f7f51-76f9-4b72-9be8-b51e2c32db07 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: 214b4d99-34d8-48c7-924c-27cd2f6712e7] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:11.331133 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f85f7f51-76f9-4b72-9be8-b51e2c32db07 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:11.332249 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f85f7f51-76f9-4b72-9be8-b51e2c32db07 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:11.335853 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f85f7f51-76f9-4b72-9be8-b51e2c32db07 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:11.336574 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f85f7f51-76f9-4b72-9be8-b51e2c32db07 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:11.370594 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-f85f7f51-76f9-4b72-9be8-b51e2c32db07 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] HTTP exception thrown: Instance 214b4d99-34d8-48c7-924c-27cd2f6712e7 could not be found. Jul 23 21:20:11.379514 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f85f7f51-76f9-4b72-9be8-b51e2c32db07 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Request method failure captured: Jul 23 21:20:11.379514 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/servers/214b4d99-34d8-48c7-924c-27cd2f6712e7 HTTP/1.1 Jul 23 21:20:11.379514 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:20:11.379514 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:20:11.379514 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:20:11.379514 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:20:11.379514 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:20:11.379514 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:20:11.379514 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:20:11.379514 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:20:11.379514 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GS1JPLCtSl4zlOvUAdW9qDCNvk9KgpAVaHDeDRdhrd5Unc5Jp4VYHiNMr-F0SeJb5CAVBa8vOn03Mdw949XFb_Q9VjvG7WvGRUo-tTRXmW46puqpgRzM_AekQVJ5U4r0msCtB-HRCdhS2W_NBYLeuQ68VDyS01pFaHOoQppmHMvtMQ Jul 23 21:20:11.379514 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:20:11.379514 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:20:11.379514 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:20:11.379514 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:20:11.379514 ncdv-master-1 devstack@n-api.service[131321]: X-Openstack-Nova-Api-Version: 2.25 Jul 23 21:20:11.379514 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:20:11.379514 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:20:11.379514 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: b347973dfb204484bdb87ab0094dbe22 Jul 23 21:20:11.379514 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-2065000324 Jul 23 21:20:11.379514 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:20:11.379514 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:20:11.381187 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b347973dfb204484bdb87ab0094dbe22"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b347973dfb204484bdb87ab0094dbe22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b347973dfb204484bdb87ab0094dbe22", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b347973dfb204484bdb87ab0094dbe22"}]}] Jul 23 21:20:11.381187 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-2065000324 Jul 23 21:20:11.381187 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: b347973dfb204484bdb87ab0094dbe22 Jul 23 21:20:11.381187 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-2065000324 Jul 23 21:20:11.381187 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-LiveAutoBlockMigrationV225Test-2065000324-project Jul 23 21:20:11.381187 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:20:11.381187 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:20:11.381187 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 3a56b82cf3954f279dd21e17a42462b3 Jul 23 21:20:11.381187 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-2065000324-project Jul 23 21:20:11.381187 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:20:11.381187 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance 214b4d99-34d8-48c7-924c-27cd2f6712e7 could not be found. Jul 23 21:20:11.381187 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': '214b4d99-34d8-48c7-924c-27cd2f6712e7'} Jul 23 21:20:11.382076 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:20:11.382076 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:11.382076 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:20:11.382076 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:20:11.382076 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:20:11.382076 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:20:11.382076 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:20:11.382076 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:20:11.382076 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:20:11.382076 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:20:11.382076 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 214b4d99-34d8-48c7-924c-27cd2f6712e7 could not be found. Jul 23 21:20:11.382076 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:20:11.382076 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:20:11.382076 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:20:11.382076 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:11.382076 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:20:11.382076 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:20:11.382076 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:20:11.382076 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:20:11.382076 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:20:11.385996 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:20:11.385996 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:20:11.385996 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:20:11.385996 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:20:11.385996 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:20:11.385996 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:20:11.385996 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:20:11.385996 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 214b4d99-34d8-48c7-924c-27cd2f6712e7 could not be found. Jul 23 21:20:11.385996 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:20:11.385996 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:20:11.385996 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:20:11.385996 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:11.385996 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:20:11.385996 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:20:11.385996 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:20:11.385996 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:20:11.385996 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 214b4d99-34d8-48c7-924c-27cd2f6712e7 could not be found. Jul 23 21:20:11.385996 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:20:11.388486 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f85f7f51-76f9-4b72-9be8-b51e2c32db07 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Returning 404 to user: Instance 214b4d99-34d8-48c7-924c-27cd2f6712e7 could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:20:11.388486 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-f85f7f51-76f9-4b72-9be8-b51e2c32db07 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/214b4d99-34d8-48c7-924c-27cd2f6712e7" status: 404 len: 111 microversion: 2.25 time: 0.067927 Jul 23 21:20:11.388486 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 811/1616] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:20:11 2022] GET /compute/v2.1/servers/214b4d99-34d8-48c7-924c-27cd2f6712e7 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 23 21:20:11.395156 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-3125d87f-fbc2-4fa0-921e-be65c0fd9252 req-acaf7fbd-520b-43db-8788-c8742a474425 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "214b4d99-34d8-48c7-924c-27cd2f6712e7", "name": "network-vif-deleted", "tag": "a741c39b-97c1-40b2-8530-cc020cd5f926"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:20:11.432963 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-3125d87f-fbc2-4fa0-921e-be65c0fd9252 req-acaf7fbd-520b-43db-8788-c8742a474425 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:11.433577 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-3125d87f-fbc2-4fa0-921e-be65c0fd9252 req-acaf7fbd-520b-43db-8788-c8742a474425 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:11.450522 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-3125d87f-fbc2-4fa0-921e-be65c0fd9252 req-acaf7fbd-520b-43db-8788-c8742a474425 service nova] Creating event network-vif-deleted:a741c39b-97c1-40b2-8530-cc020cd5f926 for instance 214b4d99-34d8-48c7-924c-27cd2f6712e7 on nch1-master-1 Jul 23 21:20:11.475055 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-3125d87f-fbc2-4fa0-921e-be65c0fd9252 req-acaf7fbd-520b-43db-8788-c8742a474425 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085223 Jul 23 21:20:11.476031 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 812/1617] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:20:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:20:11.759013 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-675cac75-188a-4a32-bb4d-111cd9fc22e0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:11.760571 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-675cac75-188a-4a32-bb4d-111cd9fc22e0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:11.770189 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-675cac75-188a-4a32-bb4d-111cd9fc22e0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:11.770930 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-675cac75-188a-4a32-bb4d-111cd9fc22e0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:11.772094 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-675cac75-188a-4a32-bb4d-111cd9fc22e0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:11.772706 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-675cac75-188a-4a32-bb4d-111cd9fc22e0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:11.930643 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b95ef973-eda7-4bac-99bf-7b7d44e04201 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '194f98e3c86b48e9952fe02d3648beb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e165633a87b04bd9bc3f6e575f53fb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:11.950380 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b95ef973-eda7-4bac-99bf-7b7d44e04201 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] 10.222.0.17 "GET /compute/v2.1/servers/059bbe3e-cf86-4689-a696-0161d7d27dfd" status: 200 len: 1324 microversion: 2.1 time: 0.879310 Jul 23 21:20:11.953340 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 806/1618] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:20:11 2022] GET /compute/v2.1/servers/059bbe3e-cf86-4689-a696-0161d7d27dfd => generated 1324 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:20:12.091324 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-dd9c653e-e0f3-4817-ac4d-1c104bbf0e16 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:12.092050 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-dd9c653e-e0f3-4817-ac4d-1c104bbf0e16 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] [instance: d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:12.110551 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dd9c653e-e0f3-4817-ac4d-1c104bbf0e16 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:12.111647 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dd9c653e-e0f3-4817-ac4d-1c104bbf0e16 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:12.114635 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dd9c653e-e0f3-4817-ac4d-1c104bbf0e16 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:12.117271 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dd9c653e-e0f3-4817-ac4d-1c104bbf0e16 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:12.319154 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-675cac75-188a-4a32-bb4d-111cd9fc22e0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:12.335590 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-675cac75-188a-4a32-bb4d-111cd9fc22e0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:12.341246 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-675cac75-188a-4a32-bb4d-111cd9fc22e0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:12.343845 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-675cac75-188a-4a32-bb4d-111cd9fc22e0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1853 microversion: 2.42 time: 0.590685 Jul 23 21:20:12.347792 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 813/1619] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:20:11 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1853 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:20:12.362052 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-dba71c88-9eb6-4b71-8457-e70cde856df0 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:12.363378 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-dba71c88-9eb6-4b71-8457-e70cde856df0 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 784e1fb4-876e-489f-9428-e01412642663] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:12.384108 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-dba71c88-9eb6-4b71-8457-e70cde856df0 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:12.384615 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-dba71c88-9eb6-4b71-8457-e70cde856df0 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:12.388631 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-dba71c88-9eb6-4b71-8457-e70cde856df0 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:12.389383 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-dba71c88-9eb6-4b71-8457-e70cde856df0 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:12.411388 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-dd9c653e-e0f3-4817-ac4d-1c104bbf0e16 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ef41817e4f5478bb7afdcb59ed634cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af16c62b144aa0972331a69e3638c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:12.430101 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-dd9c653e-e0f3-4817-ac4d-1c104bbf0e16 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ef41817e4f5478bb7afdcb59ed634cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af16c62b144aa0972331a69e3638c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:12.450325 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-dd9c653e-e0f3-4817-ac4d-1c104bbf0e16 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ef41817e4f5478bb7afdcb59ed634cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af16c62b144aa0972331a69e3638c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:12.472364 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-dd9c653e-e0f3-4817-ac4d-1c104bbf0e16 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] 10.222.0.17 "GET /compute/v2.1/servers/d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a" status: 200 len: 1446 microversion: 2.75 time: 0.389262 Jul 23 21:20:12.489801 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 807/1620] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:20:12 2022] GET /compute/v2.1/servers/d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a => generated 1446 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:20:12.543167 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-dba71c88-9eb6-4b71-8457-e70cde856df0 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:12.544199 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-dba71c88-9eb6-4b71-8457-e70cde856df0 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:12.545114 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.objects.instance [None req-dba71c88-9eb6-4b71-8457-e70cde856df0 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lazy-loading 'fault' on Instance uuid 784e1fb4-876e-489f-9428-e01412642663 {{(pid=131321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:20:12.706296 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-dba71c88-9eb6-4b71-8457-e70cde856df0 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:12.720689 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-dba71c88-9eb6-4b71-8457-e70cde856df0 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/784e1fb4-876e-489f-9428-e01412642663" status: 200 len: 1188 microversion: 2.1 time: 0.371559 Jul 23 21:20:12.723565 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 814/1621] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:20:12 2022] GET /compute/v2.1/servers/784e1fb4-876e-489f-9428-e01412642663 => generated 1188 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:20:12.969403 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-24a976f1-a7d8-4281-b0ca-d4733b0b9645 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:12.970068 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-24a976f1-a7d8-4281-b0ca-d4733b0b9645 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] [instance: 059bbe3e-cf86-4689-a696-0161d7d27dfd] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:12.983706 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-24a976f1-a7d8-4281-b0ca-d4733b0b9645 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:12.984557 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-24a976f1-a7d8-4281-b0ca-d4733b0b9645 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:12.985362 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-24a976f1-a7d8-4281-b0ca-d4733b0b9645 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:12.985803 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-24a976f1-a7d8-4281-b0ca-d4733b0b9645 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:13.363494 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-4a557d3f-451c-4c6e-9631-c83542161737 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:13.364484 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-4a557d3f-451c-4c6e-9631-c83542161737 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:13.379546 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4a557d3f-451c-4c6e-9631-c83542161737 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:13.380012 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4a557d3f-451c-4c6e-9631-c83542161737 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:13.384457 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4a557d3f-451c-4c6e-9631-c83542161737 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:13.384929 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4a557d3f-451c-4c6e-9631-c83542161737 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:13.532160 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-24a976f1-a7d8-4281-b0ca-d4733b0b9645 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '194f98e3c86b48e9952fe02d3648beb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e165633a87b04bd9bc3f6e575f53fb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:13.556711 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-24a976f1-a7d8-4281-b0ca-d4733b0b9645 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] 10.222.0.17 "GET /compute/v2.1/servers/059bbe3e-cf86-4689-a696-0161d7d27dfd" status: 200 len: 1324 microversion: 2.1 time: 0.588744 Jul 23 21:20:13.559271 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 808/1622] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:20:12 2022] GET /compute/v2.1/servers/059bbe3e-cf86-4689-a696-0161d7d27dfd => generated 1324 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:20:13.574048 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b6441675-c2bc-41b3-b707-8260b9cf4942 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:13.576741 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b6441675-c2bc-41b3-b707-8260b9cf4942 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] [instance: d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:13.597377 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b6441675-c2bc-41b3-b707-8260b9cf4942 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:13.598526 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b6441675-c2bc-41b3-b707-8260b9cf4942 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:13.601628 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b6441675-c2bc-41b3-b707-8260b9cf4942 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:13.602238 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b6441675-c2bc-41b3-b707-8260b9cf4942 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:13.789714 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b6441675-c2bc-41b3-b707-8260b9cf4942 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ef41817e4f5478bb7afdcb59ed634cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af16c62b144aa0972331a69e3638c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:13.801322 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b6441675-c2bc-41b3-b707-8260b9cf4942 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ef41817e4f5478bb7afdcb59ed634cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af16c62b144aa0972331a69e3638c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:13.802674 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b6441675-c2bc-41b3-b707-8260b9cf4942 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ef41817e4f5478bb7afdcb59ed634cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af16c62b144aa0972331a69e3638c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:13.807446 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-4a557d3f-451c-4c6e-9631-c83542161737 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:13.822865 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b6441675-c2bc-41b3-b707-8260b9cf4942 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] 10.222.0.17 "GET /compute/v2.1/servers/d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a" status: 200 len: 1446 microversion: 2.75 time: 0.260525 Jul 23 21:20:13.829704 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-4a557d3f-451c-4c6e-9631-c83542161737 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:13.831257 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-4a557d3f-451c-4c6e-9631-c83542161737 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:13.833133 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 809/1623] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:20:13 2022] GET /compute/v2.1/servers/d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a => generated 1446 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:20:13.850290 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-4a557d3f-451c-4c6e-9631-c83542161737 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1853 microversion: 2.42 time: 0.477596 Jul 23 21:20:13.850290 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 815/1624] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:20:13 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1853 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:20:13.850768 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-d930299b-19f0-4cc5-993a-9e64ebdca284 req-2cb6a14e-fc02-4c38-8e38-5d8743f0703b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "784e1fb4-876e-489f-9428-e01412642663", "name": "network-vif-deleted", "tag": "4078ff09-4171-488c-a197-d664957df578"}, {"name": "network-changed", "server_uuid": "4d09f96e-8ea6-4838-8264-4535f77fa39d", "tag": "b0482d57-40b3-4cb7-99d9-4b40a0176e1f"}, {"name": "network-changed", "server_uuid": "059bbe3e-cf86-4689-a696-0161d7d27dfd", "tag": "53a52999-801e-42e8-afb4-ed6908a0b011"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:20:13.852798 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e75518ef-3225-486a-9773-9eac5c59071b tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:13.857737 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-e75518ef-3225-486a-9773-9eac5c59071b tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 784e1fb4-876e-489f-9428-e01412642663] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:13.869952 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e75518ef-3225-486a-9773-9eac5c59071b tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:13.871090 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e75518ef-3225-486a-9773-9eac5c59071b tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:13.872213 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e75518ef-3225-486a-9773-9eac5c59071b tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:13.872850 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e75518ef-3225-486a-9773-9eac5c59071b tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:13.887292 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-d930299b-19f0-4cc5-993a-9e64ebdca284 req-2cb6a14e-fc02-4c38-8e38-5d8743f0703b service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:13.890002 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-d930299b-19f0-4cc5-993a-9e64ebdca284 req-2cb6a14e-fc02-4c38-8e38-5d8743f0703b service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:13.909707 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-e75518ef-3225-486a-9773-9eac5c59071b tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] HTTP exception thrown: Instance 784e1fb4-876e-489f-9428-e01412642663 could not be found. Jul 23 21:20:13.911527 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e75518ef-3225-486a-9773-9eac5c59071b tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Request method failure captured: Jul 23 21:20:13.911527 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/servers/784e1fb4-876e-489f-9428-e01412642663 HTTP/1.1 Jul 23 21:20:13.911527 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:20:13.911527 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:20:13.911527 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:20:13.911527 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:20:13.911527 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:20:13.911527 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:20:13.911527 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:20:13.911527 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:20:13.911527 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GSUadBHV5KQx7oirT38skqnMSdU557uu7W8nycHRhDgemsZLyCYeVkfysUs37F8D_ZUY9UNUJpMdh-nepv8zMyA9ftF8ijyv_SB5vUpZqr7-EHGR3KHXc-GzeRHBEHo83KZ6DeFQv2-Grs6W6blgKIAVzrIFe8rJ_I-lChk_0j0Vww Jul 23 21:20:13.911527 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:20:13.911527 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:20:13.911527 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:20:13.911527 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:20:13.911527 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:20:13.911527 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:20:13.911527 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 6610a2359aa64f89befcf72e4f3f6a54 Jul 23 21:20:13.911527 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-LiveMigrationTest-731745934 Jul 23 21:20:13.911527 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:20:13.911527 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:20:13.913511 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6610a2359aa64f89befcf72e4f3f6a54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6610a2359aa64f89befcf72e4f3f6a54"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6610a2359aa64f89befcf72e4f3f6a54", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6610a2359aa64f89befcf72e4f3f6a54"}]}] Jul 23 21:20:13.913511 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-LiveMigrationTest-731745934 Jul 23 21:20:13.913511 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 6610a2359aa64f89befcf72e4f3f6a54 Jul 23 21:20:13.913511 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-LiveMigrationTest-731745934 Jul 23 21:20:13.913511 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-LiveMigrationTest-731745934-project Jul 23 21:20:13.913511 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:20:13.913511 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:20:13.913511 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: f2672c5db79b4a48a505c3df536594dd Jul 23 21:20:13.913511 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-LiveMigrationTest-731745934-project Jul 23 21:20:13.913511 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:20:13.913511 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance 784e1fb4-876e-489f-9428-e01412642663 could not be found. Jul 23 21:20:13.913511 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': '784e1fb4-876e-489f-9428-e01412642663'} Jul 23 21:20:13.914540 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:20:13.914540 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:13.914540 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:20:13.914540 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:20:13.914540 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:20:13.914540 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:20:13.914540 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:20:13.914540 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:20:13.914540 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:20:13.914540 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:20:13.914540 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 784e1fb4-876e-489f-9428-e01412642663 could not be found. Jul 23 21:20:13.914540 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:20:13.914540 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:20:13.914540 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:20:13.914540 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:13.914540 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:20:13.914540 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:20:13.914540 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:20:13.914540 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:20:13.914540 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:20:13.916545 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:20:13.916545 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:20:13.916545 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:20:13.916545 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:20:13.916545 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:20:13.916545 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:20:13.916545 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:20:13.916545 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 784e1fb4-876e-489f-9428-e01412642663 could not be found. Jul 23 21:20:13.916545 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:20:13.916545 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:20:13.916545 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:20:13.916545 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:13.916545 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:20:13.916545 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:20:13.916545 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:20:13.916545 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:20:13.916545 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 784e1fb4-876e-489f-9428-e01412642663 could not be found. Jul 23 21:20:13.916545 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:20:13.920330 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e75518ef-3225-486a-9773-9eac5c59071b tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Returning 404 to user: Instance 784e1fb4-876e-489f-9428-e01412642663 could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:20:13.920864 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-e75518ef-3225-486a-9773-9eac5c59071b tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/784e1fb4-876e-489f-9428-e01412642663" status: 404 len: 111 microversion: 2.1 time: 0.079638 Jul 23 21:20:13.921497 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 816/1625] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:20:13 2022] GET /compute/v2.1/servers/784e1fb4-876e-489f-9428-e01412642663 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:20:13.925440 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-d930299b-19f0-4cc5-993a-9e64ebdca284 req-2cb6a14e-fc02-4c38-8e38-5d8743f0703b service nova] Creating event network-vif-deleted:4078ff09-4171-488c-a197-d664957df578 for instance 784e1fb4-876e-489f-9428-e01412642663 on nch2-master-1 Jul 23 21:20:13.928920 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-12007fa2-6b96-4e24-80f7-090078f4abe7 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:13.929434 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-12007fa2-6b96-4e24-80f7-090078f4abe7 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: a6de755e-739d-437c-aafb-6bc49f8bb086] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:13.938370 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-d930299b-19f0-4cc5-993a-9e64ebdca284 req-2cb6a14e-fc02-4c38-8e38-5d8743f0703b service nova] Creating event network-changed:b0482d57-40b3-4cb7-99d9-4b40a0176e1f for instance 4d09f96e-8ea6-4838-8264-4535f77fa39d on nch2-master-1 Jul 23 21:20:13.939664 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-d930299b-19f0-4cc5-993a-9e64ebdca284 req-2cb6a14e-fc02-4c38-8e38-5d8743f0703b service nova] Creating event network-changed:53a52999-801e-42e8-afb4-ed6908a0b011 for instance 059bbe3e-cf86-4689-a696-0161d7d27dfd on nch1-master-1 Jul 23 21:20:13.940870 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-12007fa2-6b96-4e24-80f7-090078f4abe7 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:13.941511 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-12007fa2-6b96-4e24-80f7-090078f4abe7 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:13.942816 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-12007fa2-6b96-4e24-80f7-090078f4abe7 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:13.943415 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-12007fa2-6b96-4e24-80f7-090078f4abe7 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:13.965176 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-d930299b-19f0-4cc5-993a-9e64ebdca284 req-2cb6a14e-fc02-4c38-8e38-5d8743f0703b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 517 microversion: 2.1 time: 0.130276 Jul 23 21:20:13.966414 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 810/1626] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:20:13 2022] POST /compute/v2.1/os-server-external-events => generated 517 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:20:13.981180 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-12007fa2-6b96-4e24-80f7-090078f4abe7 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: a6de755e-739d-437c-aafb-6bc49f8bb086] Going to try to terminate instance {{(pid=131321) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:20:14.187982 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-12007fa2-6b96-4e24-80f7-090078f4abe7 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "DELETE /compute/v2.1/servers/a6de755e-739d-437c-aafb-6bc49f8bb086" status: 204 len: 0 microversion: 2.25 time: 0.262542 Jul 23 21:20:14.188879 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 817/1627] 10.222.0.17 () {60 vars in 1279 bytes} [Sat Jul 23 21:20:13 2022] DELETE /compute/v2.1/servers/a6de755e-739d-437c-aafb-6bc49f8bb086 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 23 21:20:14.197480 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-8180bd74-4b79-48aa-aa17-6de246702867 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:14.198215 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-8180bd74-4b79-48aa-aa17-6de246702867 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: a6de755e-739d-437c-aafb-6bc49f8bb086] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:14.216224 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8180bd74-4b79-48aa-aa17-6de246702867 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:14.216766 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8180bd74-4b79-48aa-aa17-6de246702867 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:14.217729 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8180bd74-4b79-48aa-aa17-6de246702867 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:14.219129 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8180bd74-4b79-48aa-aa17-6de246702867 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:14.271874 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-87fe97d2-1934-427b-809c-26c10ecdf5b1 tempest-QuotaClassesAdmin257Test-115794291 tempest-QuotaClassesAdmin257Test-115794291-project-admin] Calling method '.version_select at 0x7f0b47fc4040>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:14.273546 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:20:14.273546 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:20:14.277105 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:20:14.292974 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-87fe97d2-1934-427b-809c-26c10ecdf5b1 tempest-QuotaClassesAdmin257Test-115794291 tempest-QuotaClassesAdmin257Test-115794291-project-admin] 10.222.0.17 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.323833 Jul 23 21:20:14.300564 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 811/1628] 10.222.0.17 () {60 vars in 1225 bytes} [Sat Jul 23 21:20:13 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 23 21:20:14.306279 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e2fb35ef-b06f-4657-99d4-f71f159eb556 tempest-QuotaClassesAdmin257Test-115794291 tempest-QuotaClassesAdmin257Test-115794291-project-admin] Action: 'update', calling method: .version_select at 0x7f0b47d08160>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:20:14.308333 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:20:14.308333 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:20:14.386709 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=3,nova_api:UPDATE=7 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:20:14.484607 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e2fb35ef-b06f-4657-99d4-f71f159eb556 tempest-QuotaClassesAdmin257Test-115794291 tempest-QuotaClassesAdmin257Test-115794291-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.181854 Jul 23 21:20:14.485947 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 812/1629] 10.222.0.17 () {62 vars in 1246 bytes} [Sat Jul 23 21:20:14 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 23 21:20:14.495372 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a9cc924d-42f2-4a20-8af0-f587593b15e3 tempest-QuotaClassesAdmin257Test-115794291 tempest-QuotaClassesAdmin257Test-115794291-project-admin] Calling method '.version_select at 0x7f0b47d4d700>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:14.508624 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a9cc924d-42f2-4a20-8af0-f587593b15e3 tempest-QuotaClassesAdmin257Test-115794291 tempest-QuotaClassesAdmin257Test-115794291-project-admin] 10.222.0.17 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.016694 Jul 23 21:20:14.514678 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 813/1630] 10.222.0.17 () {60 vars in 1225 bytes} [Sat Jul 23 21:20:14 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 23 21:20:14.523989 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-736e7785-d776-4c23-a5f1-b9ed9bb2214d tempest-QuotaClassesAdmin257Test-115794291 tempest-QuotaClassesAdmin257Test-115794291-project-admin] Action: 'update', calling method: .version_select at 0x7f0b47d08700>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:20:14.609209 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-8180bd74-4b79-48aa-aa17-6de246702867 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:14.621713 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-8180bd74-4b79-48aa-aa17-6de246702867 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:14.623258 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-8180bd74-4b79-48aa-aa17-6de246702867 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:14.628250 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-8180bd74-4b79-48aa-aa17-6de246702867 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/a6de755e-739d-437c-aafb-6bc49f8bb086" status: 200 len: 1734 microversion: 2.25 time: 0.431561 Jul 23 21:20:14.633976 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-736e7785-d776-4c23-a5f1-b9ed9bb2214d tempest-QuotaClassesAdmin257Test-115794291 tempest-QuotaClassesAdmin257Test-115794291-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.117431 Jul 23 21:20:14.634750 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 814/1631] 10.222.0.17 () {62 vars in 1246 bytes} [Sat Jul 23 21:20:14 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 23 21:20:14.639308 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 818/1632] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:20:14 2022] GET /compute/v2.1/servers/a6de755e-739d-437c-aafb-6bc49f8bb086 => generated 1734 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:20:14.661670 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8e182bc6-8b06-40a0-b588-dd543d14ad5d tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:14.664454 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8e182bc6-8b06-40a0-b588-dd543d14ad5d tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] [instance: 059bbe3e-cf86-4689-a696-0161d7d27dfd] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:14.676101 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8e182bc6-8b06-40a0-b588-dd543d14ad5d tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:14.682838 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8e182bc6-8b06-40a0-b588-dd543d14ad5d tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:14.684090 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8e182bc6-8b06-40a0-b588-dd543d14ad5d tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:14.684714 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8e182bc6-8b06-40a0-b588-dd543d14ad5d tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:14.846462 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ede71f81-0429-42a8-a266-50ea612cd841 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:14.847414 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-ede71f81-0429-42a8-a266-50ea612cd841 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] [instance: d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:14.869394 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ede71f81-0429-42a8-a266-50ea612cd841 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:14.872033 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ede71f81-0429-42a8-a266-50ea612cd841 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:14.873528 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ede71f81-0429-42a8-a266-50ea612cd841 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:14.874105 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ede71f81-0429-42a8-a266-50ea612cd841 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:15.034255 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ede71f81-0429-42a8-a266-50ea612cd841 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ef41817e4f5478bb7afdcb59ed634cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af16c62b144aa0972331a69e3638c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:15.045430 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ede71f81-0429-42a8-a266-50ea612cd841 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ef41817e4f5478bb7afdcb59ed634cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af16c62b144aa0972331a69e3638c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:15.048466 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ede71f81-0429-42a8-a266-50ea612cd841 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ef41817e4f5478bb7afdcb59ed634cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af16c62b144aa0972331a69e3638c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:15.056088 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-ede71f81-0429-42a8-a266-50ea612cd841 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] 10.222.0.17 "GET /compute/v2.1/servers/d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a" status: 200 len: 1446 microversion: 2.75 time: 0.214777 Jul 23 21:20:15.057312 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 819/1633] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:20:14 2022] GET /compute/v2.1/servers/d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a => generated 1446 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:20:15.063797 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-30277160-3c7a-4a14-8b1a-aeef1a1ad0a8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:15.064934 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-30277160-3c7a-4a14-8b1a-aeef1a1ad0a8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:15.078918 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-30277160-3c7a-4a14-8b1a-aeef1a1ad0a8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:15.079652 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-30277160-3c7a-4a14-8b1a-aeef1a1ad0a8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:15.080733 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-30277160-3c7a-4a14-8b1a-aeef1a1ad0a8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:15.081376 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-30277160-3c7a-4a14-8b1a-aeef1a1ad0a8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:15.243866 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell0:SELECT=2 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:20:15.326216 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-30277160-3c7a-4a14-8b1a-aeef1a1ad0a8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:15.338570 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-30277160-3c7a-4a14-8b1a-aeef1a1ad0a8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:15.340548 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-30277160-3c7a-4a14-8b1a-aeef1a1ad0a8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:15.342220 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-30277160-3c7a-4a14-8b1a-aeef1a1ad0a8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1874 microversion: 2.42 time: 0.283265 Jul 23 21:20:15.342900 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 820/1634] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:20:15 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1874 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:20:15.353747 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-59390bfc-7c4a-44c5-a7f3-3ec1b0812b1b tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:15.354384 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-59390bfc-7c4a-44c5-a7f3-3ec1b0812b1b tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 34eaf1d2-9732-4c0e-b970-02fbb449514b] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:15.363216 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-59390bfc-7c4a-44c5-a7f3-3ec1b0812b1b tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:15.363855 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-59390bfc-7c4a-44c5-a7f3-3ec1b0812b1b tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:15.366235 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-59390bfc-7c4a-44c5-a7f3-3ec1b0812b1b tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:15.366974 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-59390bfc-7c4a-44c5-a7f3-3ec1b0812b1b tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:15.404762 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-59390bfc-7c4a-44c5-a7f3-3ec1b0812b1b tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 34eaf1d2-9732-4c0e-b970-02fbb449514b] Going to try to terminate instance {{(pid=131321) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:20:15.509930 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-59390bfc-7c4a-44c5-a7f3-3ec1b0812b1b tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "DELETE /compute/v2.1/servers/34eaf1d2-9732-4c0e-b970-02fbb449514b" status: 204 len: 0 microversion: 2.1 time: 0.164821 Jul 23 21:20:15.512136 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 821/1635] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:20:15 2022] DELETE /compute/v2.1/servers/34eaf1d2-9732-4c0e-b970-02fbb449514b => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:20:15.523302 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a35a55d1-e10d-4505-8226-0d62090cdcdb tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:15.524451 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-a35a55d1-e10d-4505-8226-0d62090cdcdb tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 34eaf1d2-9732-4c0e-b970-02fbb449514b] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:15.533643 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a35a55d1-e10d-4505-8226-0d62090cdcdb tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:15.534431 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a35a55d1-e10d-4505-8226-0d62090cdcdb tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:15.535498 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a35a55d1-e10d-4505-8226-0d62090cdcdb tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:15.536333 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a35a55d1-e10d-4505-8226-0d62090cdcdb tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:15.661932 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8e182bc6-8b06-40a0-b588-dd543d14ad5d tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '194f98e3c86b48e9952fe02d3648beb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e165633a87b04bd9bc3f6e575f53fb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:15.682946 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8e182bc6-8b06-40a0-b588-dd543d14ad5d tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] 10.222.0.17 "GET /compute/v2.1/servers/059bbe3e-cf86-4689-a696-0161d7d27dfd" status: 200 len: 1324 microversion: 2.1 time: 1.046898 Jul 23 21:20:15.684278 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 815/1636] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:20:14 2022] GET /compute/v2.1/servers/059bbe3e-cf86-4689-a696-0161d7d27dfd => generated 1324 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:20:15.689554 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ae41e3f8-a9a2-419a-bfcb-e695a1464b3b tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:15.690395 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ae41e3f8-a9a2-419a-bfcb-e695a1464b3b tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: a6de755e-739d-437c-aafb-6bc49f8bb086] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:15.707820 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ae41e3f8-a9a2-419a-bfcb-e695a1464b3b tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:15.708262 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ae41e3f8-a9a2-419a-bfcb-e695a1464b3b tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:15.709071 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ae41e3f8-a9a2-419a-bfcb-e695a1464b3b tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:15.709635 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ae41e3f8-a9a2-419a-bfcb-e695a1464b3b tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:15.837309 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-a35a55d1-e10d-4505-8226-0d62090cdcdb tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:15.849332 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-a35a55d1-e10d-4505-8226-0d62090cdcdb tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/34eaf1d2-9732-4c0e-b970-02fbb449514b" status: 200 len: 1668 microversion: 2.1 time: 0.331253 Jul 23 21:20:15.852025 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 822/1637] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:20:15 2022] GET /compute/v2.1/servers/34eaf1d2-9732-4c0e-b970-02fbb449514b => generated 1668 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:20:15.995172 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-02d73ce3-4c9d-4be5-99f4-05417c39c276 req-40dee5bd-7be6-4763-b24d-dfe5158a45cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d09f96e-8ea6-4838-8264-4535f77fa39d", "tag": "88d392b5-c81c-4709-b717-629afa3c9a7e"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:20:16.012294 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-02d73ce3-4c9d-4be5-99f4-05417c39c276 req-40dee5bd-7be6-4763-b24d-dfe5158a45cb service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:16.012748 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-02d73ce3-4c9d-4be5-99f4-05417c39c276 req-40dee5bd-7be6-4763-b24d-dfe5158a45cb service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:16.044960 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-02d73ce3-4c9d-4be5-99f4-05417c39c276 req-40dee5bd-7be6-4763-b24d-dfe5158a45cb service nova] Creating event network-changed:88d392b5-c81c-4709-b717-629afa3c9a7e for instance 4d09f96e-8ea6-4838-8264-4535f77fa39d on nch2-master-1 Jul 23 21:20:16.055366 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-02d73ce3-4c9d-4be5-99f4-05417c39c276 req-40dee5bd-7be6-4763-b24d-dfe5158a45cb service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061257 Jul 23 21:20:16.056396 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 823/1638] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:20:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:20:16.094352 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-2da51672-7098-4c34-9635-629539871121 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:16.095242 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-2da51672-7098-4c34-9635-629539871121 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] [instance: d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:16.106916 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2da51672-7098-4c34-9635-629539871121 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:16.112936 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2da51672-7098-4c34-9635-629539871121 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:16.119090 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2da51672-7098-4c34-9635-629539871121 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:16.121544 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2da51672-7098-4c34-9635-629539871121 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:16.245828 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-2da51672-7098-4c34-9635-629539871121 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ef41817e4f5478bb7afdcb59ed634cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af16c62b144aa0972331a69e3638c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:16.268663 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-2da51672-7098-4c34-9635-629539871121 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ef41817e4f5478bb7afdcb59ed634cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af16c62b144aa0972331a69e3638c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:16.270979 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-2da51672-7098-4c34-9635-629539871121 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ef41817e4f5478bb7afdcb59ed634cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af16c62b144aa0972331a69e3638c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:16.277664 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-2da51672-7098-4c34-9635-629539871121 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] 10.222.0.17 "GET /compute/v2.1/servers/d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a" status: 200 len: 1446 microversion: 2.75 time: 0.204597 Jul 23 21:20:16.278769 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 824/1639] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:20:16 2022] GET /compute/v2.1/servers/d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a => generated 1446 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:20:16.365104 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-1787130d-5066-4901-b04e-50f3adc2d64e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:16.365104 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-1787130d-5066-4901-b04e-50f3adc2d64e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:16.373056 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1787130d-5066-4901-b04e-50f3adc2d64e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:16.374182 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1787130d-5066-4901-b04e-50f3adc2d64e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:16.379378 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1787130d-5066-4901-b04e-50f3adc2d64e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:16.380427 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1787130d-5066-4901-b04e-50f3adc2d64e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:16.393544 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:20:16.491275 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ae41e3f8-a9a2-419a-bfcb-e695a1464b3b tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:16.504225 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ae41e3f8-a9a2-419a-bfcb-e695a1464b3b tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:16.507068 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ae41e3f8-a9a2-419a-bfcb-e695a1464b3b tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:16.508539 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ae41e3f8-a9a2-419a-bfcb-e695a1464b3b tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/a6de755e-739d-437c-aafb-6bc49f8bb086" status: 200 len: 1734 microversion: 2.25 time: 0.823155 Jul 23 21:20:16.509338 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 816/1640] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:20:15 2022] GET /compute/v2.1/servers/a6de755e-739d-437c-aafb-6bc49f8bb086 => generated 1734 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:20:16.686560 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-1787130d-5066-4901-b04e-50f3adc2d64e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:16.701657 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-de504ffd-626c-4159-bbd3-26e165dbccda tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:16.703760 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-de504ffd-626c-4159-bbd3-26e165dbccda tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] [instance: 059bbe3e-cf86-4689-a696-0161d7d27dfd] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:16.713094 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-de504ffd-626c-4159-bbd3-26e165dbccda tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:16.714031 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-de504ffd-626c-4159-bbd3-26e165dbccda tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:16.714536 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-1787130d-5066-4901-b04e-50f3adc2d64e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:16.715377 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-de504ffd-626c-4159-bbd3-26e165dbccda tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:16.716046 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-de504ffd-626c-4159-bbd3-26e165dbccda tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:16.719313 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-1787130d-5066-4901-b04e-50f3adc2d64e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:16.721352 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-1787130d-5066-4901-b04e-50f3adc2d64e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1874 microversion: 2.42 time: 0.364025 Jul 23 21:20:16.726597 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 825/1641] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:20:16 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1874 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:20:16.868913 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-01cf605e-bcb2-4a20-aa7c-eb2e20ace366 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:16.869445 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-01cf605e-bcb2-4a20-aa7c-eb2e20ace366 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 34eaf1d2-9732-4c0e-b970-02fbb449514b] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:16.876432 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-01cf605e-bcb2-4a20-aa7c-eb2e20ace366 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:16.876885 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-01cf605e-bcb2-4a20-aa7c-eb2e20ace366 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:16.877682 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-01cf605e-bcb2-4a20-aa7c-eb2e20ace366 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:16.878594 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-01cf605e-bcb2-4a20-aa7c-eb2e20ace366 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:17.091212 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-01cf605e-bcb2-4a20-aa7c-eb2e20ace366 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:17.099946 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-01cf605e-bcb2-4a20-aa7c-eb2e20ace366 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/34eaf1d2-9732-4c0e-b970-02fbb449514b" status: 200 len: 1668 microversion: 2.1 time: 0.234978 Jul 23 21:20:17.101534 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 826/1642] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:20:16 2022] GET /compute/v2.1/servers/34eaf1d2-9732-4c0e-b970-02fbb449514b => generated 1668 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:20:17.255598 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-de504ffd-626c-4159-bbd3-26e165dbccda tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '194f98e3c86b48e9952fe02d3648beb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e165633a87b04bd9bc3f6e575f53fb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:17.263504 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-de504ffd-626c-4159-bbd3-26e165dbccda tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] 10.222.0.17 "GET /compute/v2.1/servers/059bbe3e-cf86-4689-a696-0161d7d27dfd" status: 200 len: 1324 microversion: 2.1 time: 0.566767 Jul 23 21:20:17.274609 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 817/1643] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:20:16 2022] GET /compute/v2.1/servers/059bbe3e-cf86-4689-a696-0161d7d27dfd => generated 1324 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:20:17.300707 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-850a90b6-d1e2-4875-8a50-94a5dc4f19e5 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:17.301335 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-850a90b6-d1e2-4875-8a50-94a5dc4f19e5 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] [instance: d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:17.310933 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-850a90b6-d1e2-4875-8a50-94a5dc4f19e5 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:17.311537 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-850a90b6-d1e2-4875-8a50-94a5dc4f19e5 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:17.312634 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-850a90b6-d1e2-4875-8a50-94a5dc4f19e5 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:17.313104 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-850a90b6-d1e2-4875-8a50-94a5dc4f19e5 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:17.409076 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-850a90b6-d1e2-4875-8a50-94a5dc4f19e5 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ef41817e4f5478bb7afdcb59ed634cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af16c62b144aa0972331a69e3638c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:17.426915 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-850a90b6-d1e2-4875-8a50-94a5dc4f19e5 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ef41817e4f5478bb7afdcb59ed634cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af16c62b144aa0972331a69e3638c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:17.428609 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-850a90b6-d1e2-4875-8a50-94a5dc4f19e5 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ef41817e4f5478bb7afdcb59ed634cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af16c62b144aa0972331a69e3638c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:17.433624 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-850a90b6-d1e2-4875-8a50-94a5dc4f19e5 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] 10.222.0.17 "GET /compute/v2.1/servers/d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a" status: 200 len: 1446 microversion: 2.75 time: 0.139149 Jul 23 21:20:17.434566 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 827/1644] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:20:17 2022] GET /compute/v2.1/servers/d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a => generated 1446 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:20:17.529767 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-fa897b46-00d0-4a95-b783-9a4684402e46 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:17.530454 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-fa897b46-00d0-4a95-b783-9a4684402e46 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: a6de755e-739d-437c-aafb-6bc49f8bb086] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:17.541195 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fa897b46-00d0-4a95-b783-9a4684402e46 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:17.541654 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fa897b46-00d0-4a95-b783-9a4684402e46 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:17.547920 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fa897b46-00d0-4a95-b783-9a4684402e46 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:17.548378 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fa897b46-00d0-4a95-b783-9a4684402e46 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:17.615791 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e1b4e63a-07ef-430a-a48b-ab8b0937fbd0 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '.version_select at 0x7f0b54230160>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:17.671286 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-e1b4e63a-07ef-430a-a48b-ab8b0937fbd0 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/images/72c67264-f3b8-40f4-83b3-792c48b62291" status: 200 len: 661 microversion: 2.1 time: 0.059585 Jul 23 21:20:17.674914 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 828/1645] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:20:17 2022] GET /compute/v2.1/images/72c67264-f3b8-40f4-83b3-792c48b62291 => generated 661 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:20:17.689635 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-342e6f56-718f-4975-934e-945515fbc493 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '.version_select at 0x7f0b47cf6f70>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:17.751075 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-342e6f56-718f-4975-934e-945515fbc493 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/images/72c67264-f3b8-40f4-83b3-792c48b62291" status: 200 len: 661 microversion: 2.1 time: 0.066218 Jul 23 21:20:17.751075 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 829/1646] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:20:17 2022] GET /compute/v2.1/images/72c67264-f3b8-40f4-83b3-792c48b62291 => generated 661 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:20:17.760541 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-00234497-82c9-4e97-8bce-939e24889117 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:17.761166 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-00234497-82c9-4e97-8bce-939e24889117 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:17.778639 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-00234497-82c9-4e97-8bce-939e24889117 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:17.779096 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-00234497-82c9-4e97-8bce-939e24889117 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:17.779874 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-00234497-82c9-4e97-8bce-939e24889117 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:17.780312 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-00234497-82c9-4e97-8bce-939e24889117 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:17.866120 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-fa897b46-00d0-4a95-b783-9a4684402e46 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:17.888285 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-fa897b46-00d0-4a95-b783-9a4684402e46 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:17.892435 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-fa897b46-00d0-4a95-b783-9a4684402e46 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:17.900405 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-fa897b46-00d0-4a95-b783-9a4684402e46 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/a6de755e-739d-437c-aafb-6bc49f8bb086" status: 200 len: 1666 microversion: 2.25 time: 0.371659 Jul 23 21:20:17.913117 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 818/1647] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:20:17 2022] GET /compute/v2.1/servers/a6de755e-739d-437c-aafb-6bc49f8bb086 => generated 1666 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:20:17.954577 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-21a02bd1-121a-45e6-a572-4c06d247042c req-29483ba8-4835-4c7e-87e0-978ca76f0ef9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "059bbe3e-cf86-4689-a696-0161d7d27dfd", "name": "network-vif-plugged", "status": "completed", "tag": "53a52999-801e-42e8-afb4-ed6908a0b011"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:20:17.994069 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-21a02bd1-121a-45e6-a572-4c06d247042c req-29483ba8-4835-4c7e-87e0-978ca76f0ef9 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:17.995027 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-21a02bd1-121a-45e6-a572-4c06d247042c req-29483ba8-4835-4c7e-87e0-978ca76f0ef9 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:18.021009 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-00234497-82c9-4e97-8bce-939e24889117 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:18.038921 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-00234497-82c9-4e97-8bce-939e24889117 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:18.041331 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-00234497-82c9-4e97-8bce-939e24889117 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:18.044457 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-00234497-82c9-4e97-8bce-939e24889117 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1874 microversion: 2.42 time: 0.292490 Jul 23 21:20:18.045568 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 830/1648] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:20:17 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1874 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:20:18.059969 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-21a02bd1-121a-45e6-a572-4c06d247042c req-29483ba8-4835-4c7e-87e0-978ca76f0ef9 service nova] Creating event network-vif-plugged:53a52999-801e-42e8-afb4-ed6908a0b011 for instance 059bbe3e-cf86-4689-a696-0161d7d27dfd on nch1-master-1 Jul 23 21:20:18.072158 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-21a02bd1-121a-45e6-a572-4c06d247042c req-29483ba8-4835-4c7e-87e0-978ca76f0ef9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142474 Jul 23 21:20:18.078423 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 819/1649] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:20:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:20:18.118607 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-25fc80d7-9d23-40bb-94c1-724a7de1ea5a tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:18.119580 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-25fc80d7-9d23-40bb-94c1-724a7de1ea5a tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 34eaf1d2-9732-4c0e-b970-02fbb449514b] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:18.126701 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-25fc80d7-9d23-40bb-94c1-724a7de1ea5a tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:18.127395 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-25fc80d7-9d23-40bb-94c1-724a7de1ea5a tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:18.128375 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-25fc80d7-9d23-40bb-94c1-724a7de1ea5a tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:18.128979 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-25fc80d7-9d23-40bb-94c1-724a7de1ea5a tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:18.299011 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-703b1793-90b1-48da-b0ab-d6a5d2859403 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:18.300348 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-703b1793-90b1-48da-b0ab-d6a5d2859403 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] [instance: 059bbe3e-cf86-4689-a696-0161d7d27dfd] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:18.321096 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-703b1793-90b1-48da-b0ab-d6a5d2859403 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:18.323655 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-703b1793-90b1-48da-b0ab-d6a5d2859403 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:18.324542 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-703b1793-90b1-48da-b0ab-d6a5d2859403 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:18.325622 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-703b1793-90b1-48da-b0ab-d6a5d2859403 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:18.340198 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-25fc80d7-9d23-40bb-94c1-724a7de1ea5a tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:18.348938 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-25fc80d7-9d23-40bb-94c1-724a7de1ea5a tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/34eaf1d2-9732-4c0e-b970-02fbb449514b" status: 200 len: 1668 microversion: 2.1 time: 0.234614 Jul 23 21:20:18.349582 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 831/1650] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:20:18 2022] GET /compute/v2.1/servers/34eaf1d2-9732-4c0e-b970-02fbb449514b => generated 1668 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:20:18.453188 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ac46d938-0dae-47d7-b7be-7fa4cbcd8be0 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:18.453810 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-ac46d938-0dae-47d7-b7be-7fa4cbcd8be0 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] [instance: d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:18.461389 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ac46d938-0dae-47d7-b7be-7fa4cbcd8be0 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:18.461844 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ac46d938-0dae-47d7-b7be-7fa4cbcd8be0 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:18.462655 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ac46d938-0dae-47d7-b7be-7fa4cbcd8be0 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:18.463680 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ac46d938-0dae-47d7-b7be-7fa4cbcd8be0 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:18.557668 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ac46d938-0dae-47d7-b7be-7fa4cbcd8be0 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ef41817e4f5478bb7afdcb59ed634cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af16c62b144aa0972331a69e3638c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:18.569800 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ac46d938-0dae-47d7-b7be-7fa4cbcd8be0 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ef41817e4f5478bb7afdcb59ed634cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af16c62b144aa0972331a69e3638c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:18.573627 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ac46d938-0dae-47d7-b7be-7fa4cbcd8be0 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ef41817e4f5478bb7afdcb59ed634cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af16c62b144aa0972331a69e3638c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:18.582401 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-ac46d938-0dae-47d7-b7be-7fa4cbcd8be0 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] 10.222.0.17 "GET /compute/v2.1/servers/d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a" status: 200 len: 1446 microversion: 2.75 time: 0.133069 Jul 23 21:20:18.583578 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 832/1651] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:20:18 2022] GET /compute/v2.1/servers/d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a => generated 1446 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:20:18.590377 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-517d909f-e2d3-446c-afad-f95885836387 req-5ce090dd-efc2-4f1b-955d-7d60c99904d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d09f96e-8ea6-4838-8264-4535f77fa39d", "tag": "f0b13207-ab63-4a3b-9a07-970de92220c8"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:20:18.603312 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-517d909f-e2d3-446c-afad-f95885836387 req-5ce090dd-efc2-4f1b-955d-7d60c99904d7 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:18.604309 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-517d909f-e2d3-446c-afad-f95885836387 req-5ce090dd-efc2-4f1b-955d-7d60c99904d7 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:18.621518 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-517d909f-e2d3-446c-afad-f95885836387 req-5ce090dd-efc2-4f1b-955d-7d60c99904d7 service nova] Creating event network-changed:f0b13207-ab63-4a3b-9a07-970de92220c8 for instance 4d09f96e-8ea6-4838-8264-4535f77fa39d on nch2-master-1 Jul 23 21:20:18.628587 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-517d909f-e2d3-446c-afad-f95885836387 req-5ce090dd-efc2-4f1b-955d-7d60c99904d7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043523 Jul 23 21:20:18.629774 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 833/1652] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:20:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:20:18.786060 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-703b1793-90b1-48da-b0ab-d6a5d2859403 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '194f98e3c86b48e9952fe02d3648beb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e165633a87b04bd9bc3f6e575f53fb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:18.803436 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-703b1793-90b1-48da-b0ab-d6a5d2859403 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] 10.222.0.17 "GET /compute/v2.1/servers/059bbe3e-cf86-4689-a696-0161d7d27dfd" status: 200 len: 1324 microversion: 2.1 time: 0.524194 Jul 23 21:20:18.804607 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 820/1653] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:20:18 2022] GET /compute/v2.1/servers/059bbe3e-cf86-4689-a696-0161d7d27dfd => generated 1324 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:20:18.921007 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ce29d5aa-d730-4301-be1d-f6a95c935284 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:18.922268 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-ce29d5aa-d730-4301-be1d-f6a95c935284 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: a6de755e-739d-437c-aafb-6bc49f8bb086] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:18.939828 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ce29d5aa-d730-4301-be1d-f6a95c935284 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:18.940818 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ce29d5aa-d730-4301-be1d-f6a95c935284 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:18.944544 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ce29d5aa-d730-4301-be1d-f6a95c935284 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:18.945787 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ce29d5aa-d730-4301-be1d-f6a95c935284 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:19.076722 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ce29d5aa-d730-4301-be1d-f6a95c935284 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:19.091577 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ce29d5aa-d730-4301-be1d-f6a95c935284 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:19.098942 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ce29d5aa-d730-4301-be1d-f6a95c935284 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:19.102344 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-ce29d5aa-d730-4301-be1d-f6a95c935284 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/a6de755e-739d-437c-aafb-6bc49f8bb086" status: 200 len: 1666 microversion: 2.25 time: 0.184709 Jul 23 21:20:19.103598 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 834/1654] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:20:18 2022] GET /compute/v2.1/servers/a6de755e-739d-437c-aafb-6bc49f8bb086 => generated 1666 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:20:19.120029 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a271a9b9-c555-463d-b7f9-e417eeb218aa tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:19.120921 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-a271a9b9-c555-463d-b7f9-e417eeb218aa tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:19.130549 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a271a9b9-c555-463d-b7f9-e417eeb218aa tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:19.133140 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a271a9b9-c555-463d-b7f9-e417eeb218aa tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:19.134176 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a271a9b9-c555-463d-b7f9-e417eeb218aa tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:19.134929 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a271a9b9-c555-463d-b7f9-e417eeb218aa tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:19.358626 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a4444eb8-bfb0-4504-9269-55308b22fe5d tempest-ServicesAdminNegativeV253TestJSON-56367393 tempest-ServicesAdminNegativeV253TestJSON-56367393-project-admin] Action: 'update', calling method: .version_select at 0x7f0b47772670>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:20:19.360431 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:20:19.360431 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:20:19.361881 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a4444eb8-bfb0-4504-9269-55308b22fe5d tempest-ServicesAdminNegativeV253TestJSON-56367393 tempest-ServicesAdminNegativeV253TestJSON-56367393-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:19.362410 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a4444eb8-bfb0-4504-9269-55308b22fe5d tempest-ServicesAdminNegativeV253TestJSON-56367393 tempest-ServicesAdminNegativeV253TestJSON-56367393-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:19.373208 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a4444eb8-bfb0-4504-9269-55308b22fe5d tempest-ServicesAdminNegativeV253TestJSON-56367393 tempest-ServicesAdminNegativeV253TestJSON-56367393-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:19.373737 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a4444eb8-bfb0-4504-9269-55308b22fe5d tempest-ServicesAdminNegativeV253TestJSON-56367393 tempest-ServicesAdminNegativeV253TestJSON-56367393-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:19.388547 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-a4444eb8-bfb0-4504-9269-55308b22fe5d tempest-ServicesAdminNegativeV253TestJSON-56367393 tempest-ServicesAdminNegativeV253TestJSON-56367393-project-admin] HTTP exception thrown: Service 12aaf56e-ff35-4f4b-aa56-490bd41327b9 could not be found. Jul 23 21:20:19.391093 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a4444eb8-bfb0-4504-9269-55308b22fe5d tempest-ServicesAdminNegativeV253TestJSON-56367393 tempest-ServicesAdminNegativeV253TestJSON-56367393-project-admin] Request method failure captured: Jul 23 21:20:19.391093 ncdv-master-1 devstack@n-api.service[131320]: request: PUT /compute/v2.1/os-services/12aaf56e-ff35-4f4b-aa56-490bd41327b9 HTTP/1.1 Jul 23 21:20:19.391093 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:20:19.391093 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:20:19.391093 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:20:19.391093 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 56 Jul 23 21:20:19.391093 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:20:19.391093 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:20:19.391093 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:20:19.391093 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:20:19.391093 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GYSYrl66KDBZ7QOsIBvUnvYLDDq0szuztg4yk7PfCF_NC7AQi8bTwsZ1m7VSYqoWmMt8uYHOP3IOn3PKw8ImUtaxni018T-9XEmxr9ue9Vgm3CIbx8X75cafqaqfVtBFzu0aJUcytUTu6pkXAFInOIbq0kBUYywwAF3akxrGqqF1qc Jul 23 21:20:19.391093 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:20:19.391093 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:20:19.391093 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:20:19.391093 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:20:19.391093 ncdv-master-1 devstack@n-api.service[131320]: X-Openstack-Nova-Api-Version: 2.53 Jul 23 21:20:19.391093 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:20:19.391093 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:20:19.391093 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 2fecaef03de24c6785543197f3b9d940 Jul 23 21:20:19.391093 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-56367393 Jul 23 21:20:19.391093 ncdv-master-1 devstack@n-api.service[131320]: X-Role: admin,reader,member Jul 23 21:20:19.391093 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: admin,reader,member Jul 23 21:20:19.393144 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2fecaef03de24c6785543197f3b9d940"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2fecaef03de24c6785543197f3b9d940"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2fecaef03de24c6785543197f3b9d940", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2fecaef03de24c6785543197f3b9d940"}]}] Jul 23 21:20:19.393144 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-56367393 Jul 23 21:20:19.393144 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 2fecaef03de24c6785543197f3b9d940 Jul 23 21:20:19.393144 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-56367393 Jul 23 21:20:19.393144 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServicesAdminNegativeV253TestJSON-56367393-project-admin Jul 23 21:20:19.393144 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:20:19.393144 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:20:19.393144 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 179195d5363d4328adea95efb3ab6ce8 Jul 23 21:20:19.393144 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-56367393-project-admin Jul 23 21:20:19.393144 ncdv-master-1 devstack@n-api.service[131320]: Jul 23 21:20:19.393144 ncdv-master-1 devstack@n-api.service[131320]: {"status": "disabled", "disabled_reason": "maintenance"} Jul 23 21:20:19.393144 ncdv-master-1 devstack@n-api.service[131320]: method: Jul 23 21:20:19.393144 ncdv-master-1 devstack@n-api.service[131320]: exception: Service 12aaf56e-ff35-4f4b-aa56-490bd41327b9 could not be found. Jul 23 21:20:19.394314 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '12aaf56e-ff35-4f4b-aa56-490bd41327b9', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Jul 23 21:20:19.394314 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:20:19.394314 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:19.394314 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id Jul 23 21:20:19.394314 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jul 23 21:20:19.394314 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 23 21:20:19.394314 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 23 21:20:19.394314 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 23 21:20:19.394314 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:20:19.394314 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:20:19.394314 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:20:19.394314 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:19.394314 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jul 23 21:20:19.394314 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jul 23 21:20:19.394314 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id Jul 23 21:20:19.394314 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jul 23 21:20:19.394314 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 12aaf56e-ff35-4f4b-aa56-490bd41327b9 could not be found. Jul 23 21:20:19.394314 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:20:19.394314 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:20:19.394314 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:20:19.394314 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:19.396049 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:20:19.396049 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:20:19.396049 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:20:19.396049 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:20:19.396049 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:20:19.396049 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:20:19.396049 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:20:19.396049 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:20:19.396049 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:20:19.396049 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:20:19.396049 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jul 23 21:20:19.396049 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:20:19.396049 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 12aaf56e-ff35-4f4b-aa56-490bd41327b9 could not be found. Jul 23 21:20:19.396049 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:20:19.396049 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:20:19.396049 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:20:19.396049 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:19.396049 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:20:19.396049 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:20:19.396049 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:20:19.397701 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:20:19.397701 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 12aaf56e-ff35-4f4b-aa56-490bd41327b9 could not be found. Jul 23 21:20:19.397701 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:20:19.400017 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a4444eb8-bfb0-4504-9269-55308b22fe5d tempest-ServicesAdminNegativeV253TestJSON-56367393 tempest-ServicesAdminNegativeV253TestJSON-56367393-project-admin] Returning 404 to user: Service 12aaf56e-ff35-4f4b-aa56-490bd41327b9 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:20:19.401086 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a4444eb8-bfb0-4504-9269-55308b22fe5d tempest-ServicesAdminNegativeV253TestJSON-56367393 tempest-ServicesAdminNegativeV253TestJSON-56367393-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-services/12aaf56e-ff35-4f4b-aa56-490bd41327b9" status: 404 len: 110 microversion: 2.53 time: 0.372736 Jul 23 21:20:19.407967 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 821/1655] 10.222.0.17 () {62 vars in 1308 bytes} [Sat Jul 23 21:20:19 2022] PUT /compute/v2.1/os-services/12aaf56e-ff35-4f4b-aa56-490bd41327b9 => generated 110 bytes in 380 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 23 21:20:19.415108 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-7680fdf6-ae33-42d1-ab8c-571f90e525d4 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:19.415975 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-7680fdf6-ae33-42d1-ab8c-571f90e525d4 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 34eaf1d2-9732-4c0e-b970-02fbb449514b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:19.423953 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7680fdf6-ae33-42d1-ab8c-571f90e525d4 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:19.424807 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7680fdf6-ae33-42d1-ab8c-571f90e525d4 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:19.425844 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7680fdf6-ae33-42d1-ab8c-571f90e525d4 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:19.426574 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7680fdf6-ae33-42d1-ab8c-571f90e525d4 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:19.518498 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-a271a9b9-c555-463d-b7f9-e417eeb218aa tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:19.529128 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-a271a9b9-c555-463d-b7f9-e417eeb218aa tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:19.535694 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-a271a9b9-c555-463d-b7f9-e417eeb218aa tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:19.554577 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-a271a9b9-c555-463d-b7f9-e417eeb218aa tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1874 microversion: 2.42 time: 0.432592 Jul 23 21:20:19.555583 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 835/1656] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:20:19 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1874 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:20:19.565370 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ff79090e-8852-408c-98f5-a4726d543adc tempest-ServicesAdminNegativeV253TestJSON-56367393 tempest-ServicesAdminNegativeV253TestJSON-56367393-project-admin] Action: 'update', calling method: .version_select at 0x7f0b542c59d0>, body: {"status": "disabled"} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:20:19.566915 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:20:19.566915 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:20:19.568114 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ff79090e-8852-408c-98f5-a4726d543adc tempest-ServicesAdminNegativeV253TestJSON-56367393 tempest-ServicesAdminNegativeV253TestJSON-56367393-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:19.568746 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ff79090e-8852-408c-98f5-a4726d543adc tempest-ServicesAdminNegativeV253TestJSON-56367393 tempest-ServicesAdminNegativeV253TestJSON-56367393-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:19.577597 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ff79090e-8852-408c-98f5-a4726d543adc tempest-ServicesAdminNegativeV253TestJSON-56367393 tempest-ServicesAdminNegativeV253TestJSON-56367393-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:19.578391 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ff79090e-8852-408c-98f5-a4726d543adc tempest-ServicesAdminNegativeV253TestJSON-56367393 tempest-ServicesAdminNegativeV253TestJSON-56367393-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:19.588616 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-ff79090e-8852-408c-98f5-a4726d543adc tempest-ServicesAdminNegativeV253TestJSON-56367393 tempest-ServicesAdminNegativeV253TestJSON-56367393-project-admin] HTTP exception thrown: Service 12aaf56e-ff35-4f4b-aa56-490bd41327b9 could not be found. Jul 23 21:20:19.591808 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ff79090e-8852-408c-98f5-a4726d543adc tempest-ServicesAdminNegativeV253TestJSON-56367393 tempest-ServicesAdminNegativeV253TestJSON-56367393-project-admin] Request method failure captured: Jul 23 21:20:19.591808 ncdv-master-1 devstack@n-api.service[131321]: request: PUT /compute/v2.1/os-services/12aaf56e-ff35-4f4b-aa56-490bd41327b9 HTTP/1.1 Jul 23 21:20:19.591808 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:20:19.591808 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:20:19.591808 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:20:19.591808 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 22 Jul 23 21:20:19.591808 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:20:19.591808 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:20:19.591808 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:20:19.591808 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:20:19.591808 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GYSYrl66KDBZ7QOsIBvUnvYLDDq0szuztg4yk7PfCF_NC7AQi8bTwsZ1m7VSYqoWmMt8uYHOP3IOn3PKw8ImUtaxni018T-9XEmxr9ue9Vgm3CIbx8X75cafqaqfVtBFzu0aJUcytUTu6pkXAFInOIbq0kBUYywwAF3akxrGqqF1qc Jul 23 21:20:19.591808 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:20:19.591808 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:20:19.591808 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:20:19.591808 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:20:19.591808 ncdv-master-1 devstack@n-api.service[131321]: X-Openstack-Nova-Api-Version: 2.53 Jul 23 21:20:19.591808 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:20:19.591808 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:20:19.591808 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 2fecaef03de24c6785543197f3b9d940 Jul 23 21:20:19.591808 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-56367393 Jul 23 21:20:19.591808 ncdv-master-1 devstack@n-api.service[131321]: X-Role: admin,reader,member Jul 23 21:20:19.591808 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: admin,reader,member Jul 23 21:20:19.593384 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2fecaef03de24c6785543197f3b9d940"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2fecaef03de24c6785543197f3b9d940"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2fecaef03de24c6785543197f3b9d940", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2fecaef03de24c6785543197f3b9d940"}]}] Jul 23 21:20:19.593384 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-56367393 Jul 23 21:20:19.593384 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 2fecaef03de24c6785543197f3b9d940 Jul 23 21:20:19.593384 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-56367393 Jul 23 21:20:19.593384 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ServicesAdminNegativeV253TestJSON-56367393-project-admin Jul 23 21:20:19.593384 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:20:19.593384 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:20:19.593384 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 179195d5363d4328adea95efb3ab6ce8 Jul 23 21:20:19.593384 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-56367393-project-admin Jul 23 21:20:19.593384 ncdv-master-1 devstack@n-api.service[131321]: Jul 23 21:20:19.593384 ncdv-master-1 devstack@n-api.service[131321]: {"status": "disabled"} Jul 23 21:20:19.593384 ncdv-master-1 devstack@n-api.service[131321]: method: Jul 23 21:20:19.593384 ncdv-master-1 devstack@n-api.service[131321]: exception: Service 12aaf56e-ff35-4f4b-aa56-490bd41327b9 could not be found. Jul 23 21:20:19.593384 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': '12aaf56e-ff35-4f4b-aa56-490bd41327b9', 'body': {'status': 'disabled'}} Jul 23 21:20:19.594414 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:20:19.594414 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:19.594414 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id Jul 23 21:20:19.594414 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jul 23 21:20:19.594414 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 23 21:20:19.594414 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 23 21:20:19.594414 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 23 21:20:19.594414 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:20:19.594414 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:20:19.594414 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:20:19.594414 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:19.594414 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jul 23 21:20:19.594414 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jul 23 21:20:19.594414 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id Jul 23 21:20:19.594414 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jul 23 21:20:19.594414 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 12aaf56e-ff35-4f4b-aa56-490bd41327b9 could not be found. Jul 23 21:20:19.594414 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:20:19.594414 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:20:19.594414 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:20:19.594414 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:19.594414 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:20:19.595813 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:20:19.595813 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:20:19.595813 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:20:19.595813 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:20:19.595813 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:20:19.595813 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:20:19.595813 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:20:19.595813 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:20:19.595813 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:20:19.595813 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jul 23 21:20:19.595813 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:20:19.595813 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 12aaf56e-ff35-4f4b-aa56-490bd41327b9 could not be found. Jul 23 21:20:19.595813 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:20:19.595813 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:20:19.595813 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:20:19.595813 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:19.595813 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:20:19.595813 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:20:19.595813 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:20:19.595813 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:20:19.597143 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 12aaf56e-ff35-4f4b-aa56-490bd41327b9 could not be found. Jul 23 21:20:19.597143 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:20:19.597143 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ff79090e-8852-408c-98f5-a4726d543adc tempest-ServicesAdminNegativeV253TestJSON-56367393 tempest-ServicesAdminNegativeV253TestJSON-56367393-project-admin] Returning 404 to user: Service 12aaf56e-ff35-4f4b-aa56-490bd41327b9 could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:20:19.597143 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-ff79090e-8852-408c-98f5-a4726d543adc tempest-ServicesAdminNegativeV253TestJSON-56367393 tempest-ServicesAdminNegativeV253TestJSON-56367393-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-services/12aaf56e-ff35-4f4b-aa56-490bd41327b9" status: 404 len: 110 microversion: 2.53 time: 0.037130 Jul 23 21:20:19.597143 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 836/1657] 10.222.0.17 () {62 vars in 1308 bytes} [Sat Jul 23 21:20:19 2022] PUT /compute/v2.1/os-services/12aaf56e-ff35-4f4b-aa56-490bd41327b9 => generated 110 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 23 21:20:19.607732 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-0fe73b05-1a4c-4cee-bdd9-67fd9f0fbac8 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '.version_select at 0x7f0b47f100d0>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:19.667922 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-0fe73b05-1a4c-4cee-bdd9-67fd9f0fbac8 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/images/6b41dce9-8229-4ecb-9599-ba5c839e08f3" status: 200 len: 662 microversion: 2.1 time: 0.071483 Jul 23 21:20:19.676820 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 837/1658] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:20:19 2022] GET /compute/v2.1/images/6b41dce9-8229-4ecb-9599-ba5c839e08f3 => generated 662 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:20:19.685171 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-7680fdf6-ae33-42d1-ab8c-571f90e525d4 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:19.686065 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-fb897485-1577-462c-bc6c-35a4e671dabf tempest-ServicesAdminNegativeV253TestJSON-56367393 tempest-ServicesAdminNegativeV253TestJSON-56367393-project-admin] Action: 'update', calling method: .version_select at 0x7f0b542c5d30>, body: {"status": "enabled"} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:20:19.690195 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fb897485-1577-462c-bc6c-35a4e671dabf tempest-ServicesAdminNegativeV253TestJSON-56367393 tempest-ServicesAdminNegativeV253TestJSON-56367393-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:19.690808 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fb897485-1577-462c-bc6c-35a4e671dabf tempest-ServicesAdminNegativeV253TestJSON-56367393 tempest-ServicesAdminNegativeV253TestJSON-56367393-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:19.693454 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-7680fdf6-ae33-42d1-ab8c-571f90e525d4 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/34eaf1d2-9732-4c0e-b970-02fbb449514b" status: 200 len: 1601 microversion: 2.1 time: 0.282978 Jul 23 21:20:19.694639 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 822/1659] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:20:19 2022] GET /compute/v2.1/servers/34eaf1d2-9732-4c0e-b970-02fbb449514b => generated 1601 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:20:19.699574 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9f3bdc7f-8662-4fda-8468-1ce104a95688 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:19.700375 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-9f3bdc7f-8662-4fda-8468-1ce104a95688 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] [instance: d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:19.709264 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9f3bdc7f-8662-4fda-8468-1ce104a95688 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:19.710077 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9f3bdc7f-8662-4fda-8468-1ce104a95688 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:19.711636 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9f3bdc7f-8662-4fda-8468-1ce104a95688 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:19.712417 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9f3bdc7f-8662-4fda-8468-1ce104a95688 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:19.731130 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fb897485-1577-462c-bc6c-35a4e671dabf tempest-ServicesAdminNegativeV253TestJSON-56367393 tempest-ServicesAdminNegativeV253TestJSON-56367393-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:19.731733 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fb897485-1577-462c-bc6c-35a4e671dabf tempest-ServicesAdminNegativeV253TestJSON-56367393 tempest-ServicesAdminNegativeV253TestJSON-56367393-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:19.751864 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-fb897485-1577-462c-bc6c-35a4e671dabf tempest-ServicesAdminNegativeV253TestJSON-56367393 tempest-ServicesAdminNegativeV253TestJSON-56367393-project-admin] HTTP exception thrown: Service 12aaf56e-ff35-4f4b-aa56-490bd41327b9 could not be found. Jul 23 21:20:19.753522 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-fb897485-1577-462c-bc6c-35a4e671dabf tempest-ServicesAdminNegativeV253TestJSON-56367393 tempest-ServicesAdminNegativeV253TestJSON-56367393-project-admin] Request method failure captured: Jul 23 21:20:19.753522 ncdv-master-1 devstack@n-api.service[131321]: request: PUT /compute/v2.1/os-services/12aaf56e-ff35-4f4b-aa56-490bd41327b9 HTTP/1.1 Jul 23 21:20:19.753522 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:20:19.753522 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:20:19.753522 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:20:19.753522 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 21 Jul 23 21:20:19.753522 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:20:19.753522 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:20:19.753522 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:20:19.753522 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:20:19.753522 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GYSYrl66KDBZ7QOsIBvUnvYLDDq0szuztg4yk7PfCF_NC7AQi8bTwsZ1m7VSYqoWmMt8uYHOP3IOn3PKw8ImUtaxni018T-9XEmxr9ue9Vgm3CIbx8X75cafqaqfVtBFzu0aJUcytUTu6pkXAFInOIbq0kBUYywwAF3akxrGqqF1qc Jul 23 21:20:19.753522 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:20:19.753522 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:20:19.753522 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:20:19.753522 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:20:19.753522 ncdv-master-1 devstack@n-api.service[131321]: X-Openstack-Nova-Api-Version: 2.53 Jul 23 21:20:19.753522 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:20:19.753522 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:20:19.753522 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 2fecaef03de24c6785543197f3b9d940 Jul 23 21:20:19.753522 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-56367393 Jul 23 21:20:19.753522 ncdv-master-1 devstack@n-api.service[131321]: X-Role: admin,reader,member Jul 23 21:20:19.753522 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: admin,reader,member Jul 23 21:20:19.755375 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2fecaef03de24c6785543197f3b9d940"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2fecaef03de24c6785543197f3b9d940"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2fecaef03de24c6785543197f3b9d940", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2fecaef03de24c6785543197f3b9d940"}]}] Jul 23 21:20:19.755375 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-56367393 Jul 23 21:20:19.755375 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 2fecaef03de24c6785543197f3b9d940 Jul 23 21:20:19.755375 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-56367393 Jul 23 21:20:19.755375 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ServicesAdminNegativeV253TestJSON-56367393-project-admin Jul 23 21:20:19.755375 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:20:19.755375 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:20:19.755375 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 179195d5363d4328adea95efb3ab6ce8 Jul 23 21:20:19.755375 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-56367393-project-admin Jul 23 21:20:19.755375 ncdv-master-1 devstack@n-api.service[131321]: Jul 23 21:20:19.755375 ncdv-master-1 devstack@n-api.service[131321]: {"status": "enabled"} Jul 23 21:20:19.755375 ncdv-master-1 devstack@n-api.service[131321]: method: Jul 23 21:20:19.755375 ncdv-master-1 devstack@n-api.service[131321]: exception: Service 12aaf56e-ff35-4f4b-aa56-490bd41327b9 could not be found. Jul 23 21:20:19.755375 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': '12aaf56e-ff35-4f4b-aa56-490bd41327b9', 'body': {'status': 'enabled'}} Jul 23 21:20:19.756661 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:20:19.756661 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:19.756661 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id Jul 23 21:20:19.756661 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jul 23 21:20:19.756661 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 23 21:20:19.756661 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 23 21:20:19.756661 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 23 21:20:19.756661 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:20:19.756661 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:20:19.756661 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:20:19.756661 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:19.756661 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jul 23 21:20:19.756661 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jul 23 21:20:19.756661 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id Jul 23 21:20:19.756661 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jul 23 21:20:19.756661 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 12aaf56e-ff35-4f4b-aa56-490bd41327b9 could not be found. Jul 23 21:20:19.756661 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:20:19.756661 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:20:19.756661 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:20:19.756661 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:19.756661 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:20:19.758476 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:20:19.758476 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:20:19.758476 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:20:19.758476 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:20:19.758476 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:20:19.758476 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:20:19.758476 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:20:19.758476 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:20:19.758476 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:20:19.758476 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jul 23 21:20:19.758476 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:20:19.758476 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 12aaf56e-ff35-4f4b-aa56-490bd41327b9 could not be found. Jul 23 21:20:19.758476 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:20:19.758476 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:20:19.758476 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:20:19.758476 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:19.758476 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:20:19.758476 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:20:19.758476 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:20:19.758476 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:20:19.760192 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 12aaf56e-ff35-4f4b-aa56-490bd41327b9 could not be found. Jul 23 21:20:19.760192 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:20:19.760192 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-fb897485-1577-462c-bc6c-35a4e671dabf tempest-ServicesAdminNegativeV253TestJSON-56367393 tempest-ServicesAdminNegativeV253TestJSON-56367393-project-admin] Returning 404 to user: Service 12aaf56e-ff35-4f4b-aa56-490bd41327b9 could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:20:19.762110 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-fb897485-1577-462c-bc6c-35a4e671dabf tempest-ServicesAdminNegativeV253TestJSON-56367393 tempest-ServicesAdminNegativeV253TestJSON-56367393-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-services/12aaf56e-ff35-4f4b-aa56-490bd41327b9" status: 404 len: 110 microversion: 2.53 time: 0.083587 Jul 23 21:20:19.763551 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 838/1660] 10.222.0.17 () {62 vars in 1308 bytes} [Sat Jul 23 21:20:19 2022] PUT /compute/v2.1/os-services/12aaf56e-ff35-4f4b-aa56-490bd41327b9 => generated 110 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 23 21:20:19.778005 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-3aa603d6-fc33-4ee7-9bdb-9e2d6665d48f tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '.version_select at 0x7f0b5460ed30>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:19.862635 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-9f3bdc7f-8662-4fda-8468-1ce104a95688 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ef41817e4f5478bb7afdcb59ed634cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af16c62b144aa0972331a69e3638c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:19.866902 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:20:19.881314 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-3aa603d6-fc33-4ee7-9bdb-9e2d6665d48f tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/images/6b41dce9-8229-4ecb-9599-ba5c839e08f3" status: 200 len: 662 microversion: 2.1 time: 0.107707 Jul 23 21:20:19.882269 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-9f3bdc7f-8662-4fda-8468-1ce104a95688 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ef41817e4f5478bb7afdcb59ed634cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af16c62b144aa0972331a69e3638c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:19.883237 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 839/1661] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:20:19 2022] GET /compute/v2.1/images/6b41dce9-8229-4ecb-9599-ba5c839e08f3 => generated 662 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:20:19.888570 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-1fdfa1d3-7603-4b82-8842-7c882b569c6b tempest-ServicesAdminNegativeV253TestJSON-56367393 tempest-ServicesAdminNegativeV253TestJSON-56367393-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:19.890327 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:20:19.890327 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:20:19.893819 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1fdfa1d3-7603-4b82-8842-7c882b569c6b tempest-ServicesAdminNegativeV253TestJSON-56367393 tempest-ServicesAdminNegativeV253TestJSON-56367393-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:19.894099 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-9f3bdc7f-8662-4fda-8468-1ce104a95688 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ef41817e4f5478bb7afdcb59ed634cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af16c62b144aa0972331a69e3638c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:19.894830 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1fdfa1d3-7603-4b82-8842-7c882b569c6b tempest-ServicesAdminNegativeV253TestJSON-56367393 tempest-ServicesAdminNegativeV253TestJSON-56367393-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:19.896045 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1fdfa1d3-7603-4b82-8842-7c882b569c6b tempest-ServicesAdminNegativeV253TestJSON-56367393 tempest-ServicesAdminNegativeV253TestJSON-56367393-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:19.896710 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1fdfa1d3-7603-4b82-8842-7c882b569c6b tempest-ServicesAdminNegativeV253TestJSON-56367393 tempest-ServicesAdminNegativeV253TestJSON-56367393-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:19.913198 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9f3bdc7f-8662-4fda-8468-1ce104a95688 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] 10.222.0.17 "GET /compute/v2.1/servers/d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a" status: 200 len: 1446 microversion: 2.75 time: 0.217033 Jul 23 21:20:19.915414 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 823/1662] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:20:19 2022] GET /compute/v2.1/servers/d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a => generated 1446 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:20:19.937607 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0c3e1c99-2a35-4386-a1b4-a1bb97278348 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:19.945434 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-1fdfa1d3-7603-4b82-8842-7c882b569c6b tempest-ServicesAdminNegativeV253TestJSON-56367393 tempest-ServicesAdminNegativeV253TestJSON-56367393-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.060774 Jul 23 21:20:19.946763 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 840/1663] 10.222.0.17 () {60 vars in 1177 bytes} [Sat Jul 23 21:20:19 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:20:19.950417 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-0c3e1c99-2a35-4386-a1b4-a1bb97278348 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] [instance: 059bbe3e-cf86-4689-a696-0161d7d27dfd] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:19.967287 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-132d7861-0544-49f8-9fcc-81aebbd001b6 tempest-ServicesAdminNegativeV253TestJSON-56367393 tempest-ServicesAdminNegativeV253TestJSON-56367393-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:19.969342 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:20:19.969342 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:20:19.971858 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-132d7861-0544-49f8-9fcc-81aebbd001b6 tempest-ServicesAdminNegativeV253TestJSON-56367393 tempest-ServicesAdminNegativeV253TestJSON-56367393-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:19.972621 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-132d7861-0544-49f8-9fcc-81aebbd001b6 tempest-ServicesAdminNegativeV253TestJSON-56367393 tempest-ServicesAdminNegativeV253TestJSON-56367393-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:19.972826 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0c3e1c99-2a35-4386-a1b4-a1bb97278348 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:19.973504 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0c3e1c99-2a35-4386-a1b4-a1bb97278348 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:19.973920 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-132d7861-0544-49f8-9fcc-81aebbd001b6 tempest-ServicesAdminNegativeV253TestJSON-56367393 tempest-ServicesAdminNegativeV253TestJSON-56367393-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:19.974590 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-132d7861-0544-49f8-9fcc-81aebbd001b6 tempest-ServicesAdminNegativeV253TestJSON-56367393 tempest-ServicesAdminNegativeV253TestJSON-56367393-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:19.977568 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0c3e1c99-2a35-4386-a1b4-a1bb97278348 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:19.978066 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0c3e1c99-2a35-4386-a1b4-a1bb97278348 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:20.035486 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-132d7861-0544-49f8-9fcc-81aebbd001b6 tempest-ServicesAdminNegativeV253TestJSON-56367393 tempest-ServicesAdminNegativeV253TestJSON-56367393-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.079172 Jul 23 21:20:20.037182 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 841/1664] 10.222.0.17 () {60 vars in 1210 bytes} [Sat Jul 23 21:20:19 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1242 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:20:20.056484 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d0dd2269-f49d-4f7f-b925-6d8dd0e68264 tempest-ServicesAdminNegativeV253TestJSON-56367393 tempest-ServicesAdminNegativeV253TestJSON-56367393-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:20.061408 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:20:20.061408 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:20:20.063597 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d0dd2269-f49d-4f7f-b925-6d8dd0e68264 tempest-ServicesAdminNegativeV253TestJSON-56367393 tempest-ServicesAdminNegativeV253TestJSON-56367393-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:20.064302 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d0dd2269-f49d-4f7f-b925-6d8dd0e68264 tempest-ServicesAdminNegativeV253TestJSON-56367393 tempest-ServicesAdminNegativeV253TestJSON-56367393-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:20.065397 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d0dd2269-f49d-4f7f-b925-6d8dd0e68264 tempest-ServicesAdminNegativeV253TestJSON-56367393 tempest-ServicesAdminNegativeV253TestJSON-56367393-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:20.066267 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d0dd2269-f49d-4f7f-b925-6d8dd0e68264 tempest-ServicesAdminNegativeV253TestJSON-56367393 tempest-ServicesAdminNegativeV253TestJSON-56367393-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:20.107418 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-d0dd2269-f49d-4f7f-b925-6d8dd0e68264 tempest-ServicesAdminNegativeV253TestJSON-56367393 tempest-ServicesAdminNegativeV253TestJSON-56367393-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.062852 Jul 23 21:20:20.108476 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 842/1665] 10.222.0.17 () {60 vars in 1177 bytes} [Sat Jul 23 21:20:20 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:20:20.126533 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-fb5b1ff9-39f3-47a7-8825-47741325a16f tempest-ServicesAdminNegativeV253TestJSON-56367393 tempest-ServicesAdminNegativeV253TestJSON-56367393-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:20.128297 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:20:20.128297 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:20:20.130197 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fb5b1ff9-39f3-47a7-8825-47741325a16f tempest-ServicesAdminNegativeV253TestJSON-56367393 tempest-ServicesAdminNegativeV253TestJSON-56367393-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:20.130993 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fb5b1ff9-39f3-47a7-8825-47741325a16f tempest-ServicesAdminNegativeV253TestJSON-56367393 tempest-ServicesAdminNegativeV253TestJSON-56367393-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:20.132086 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fb5b1ff9-39f3-47a7-8825-47741325a16f tempest-ServicesAdminNegativeV253TestJSON-56367393 tempest-ServicesAdminNegativeV253TestJSON-56367393-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:20.132799 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fb5b1ff9-39f3-47a7-8825-47741325a16f tempest-ServicesAdminNegativeV253TestJSON-56367393 tempest-ServicesAdminNegativeV253TestJSON-56367393-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:20.177305 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:20:20.187891 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-fb5b1ff9-39f3-47a7-8825-47741325a16f tempest-ServicesAdminNegativeV253TestJSON-56367393 tempest-ServicesAdminNegativeV253TestJSON-56367393-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.067354 Jul 23 21:20:20.188694 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 843/1666] 10.222.0.17 () {60 vars in 1236 bytes} [Sat Jul 23 21:20:20 2022] GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx => generated 16 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:20:20.223569 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-4bf62862-607d-477f-affc-00fa4d26660d tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:20.227415 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-4bf62862-607d-477f-affc-00fa4d26660d tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: a6de755e-739d-437c-aafb-6bc49f8bb086] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:20.240071 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4bf62862-607d-477f-affc-00fa4d26660d tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:20.241103 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4bf62862-607d-477f-affc-00fa4d26660d tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:20.242223 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4bf62862-607d-477f-affc-00fa4d26660d tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:20.242898 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4bf62862-607d-477f-affc-00fa4d26660d tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:20.291188 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4bf62862-607d-477f-affc-00fa4d26660d tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:20.291948 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4bf62862-607d-477f-affc-00fa4d26660d tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:20.292512 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.objects.instance [None req-4bf62862-607d-477f-affc-00fa4d26660d tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lazy-loading 'fault' on Instance uuid a6de755e-739d-437c-aafb-6bc49f8bb086 {{(pid=131321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:20:20.376820 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-4bf62862-607d-477f-affc-00fa4d26660d tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:20.388919 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-0c3e1c99-2a35-4386-a1b4-a1bb97278348 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '194f98e3c86b48e9952fe02d3648beb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e165633a87b04bd9bc3f6e575f53fb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:20.400643 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-4bf62862-607d-477f-affc-00fa4d26660d tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:20.401802 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-0c3e1c99-2a35-4386-a1b4-a1bb97278348 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] 10.222.0.17 "GET /compute/v2.1/servers/059bbe3e-cf86-4689-a696-0161d7d27dfd" status: 200 len: 1520 microversion: 2.1 time: 0.482691 Jul 23 21:20:20.402884 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-4bf62862-607d-477f-affc-00fa4d26660d tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:20.404310 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-4bf62862-607d-477f-affc-00fa4d26660d tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/a6de755e-739d-437c-aafb-6bc49f8bb086" status: 200 len: 1376 microversion: 2.25 time: 0.196837 Jul 23 21:20:20.405106 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 824/1667] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:20:19 2022] GET /compute/v2.1/servers/059bbe3e-cf86-4689-a696-0161d7d27dfd => generated 1520 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:20:20.410039 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 844/1668] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:20:20 2022] GET /compute/v2.1/servers/a6de755e-739d-437c-aafb-6bc49f8bb086 => generated 1376 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:20:20.423291 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-14ea833b-0bb1-44c5-bcf3-550b12e7f60a tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0f7a6529-1334-4899-b7cd-f77b9a726980"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:20:20.424501 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-14ea833b-0bb1-44c5-bcf3-550b12e7f60a tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] [instance: f53ce882-4694-421d-8075-5e8cfab0b16f] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:20.425961 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-22e00c50-7dfc-4911-b5d5-0ce6488a9f28 tempest-ServicesAdminNegativeV253TestJSON-56367393 tempest-ServicesAdminNegativeV253TestJSON-56367393-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:20.429209 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:20:20.429209 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:20:20.432859 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-14ea833b-0bb1-44c5-bcf3-550b12e7f60a tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:20.433321 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-14ea833b-0bb1-44c5-bcf3-550b12e7f60a tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:20.433950 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-22e00c50-7dfc-4911-b5d5-0ce6488a9f28 tempest-ServicesAdminNegativeV253TestJSON-56367393 tempest-ServicesAdminNegativeV253TestJSON-56367393-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:20.434193 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-14ea833b-0bb1-44c5-bcf3-550b12e7f60a tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:20.434577 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-14ea833b-0bb1-44c5-bcf3-550b12e7f60a tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:20.446545 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-22e00c50-7dfc-4911-b5d5-0ce6488a9f28 tempest-ServicesAdminNegativeV253TestJSON-56367393 tempest-ServicesAdminNegativeV253TestJSON-56367393-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:20.447733 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-22e00c50-7dfc-4911-b5d5-0ce6488a9f28 tempest-ServicesAdminNegativeV253TestJSON-56367393 tempest-ServicesAdminNegativeV253TestJSON-56367393-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:20.447903 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-22e00c50-7dfc-4911-b5d5-0ce6488a9f28 tempest-ServicesAdminNegativeV253TestJSON-56367393 tempest-ServicesAdminNegativeV253TestJSON-56367393-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:20.473266 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-22e00c50-7dfc-4911-b5d5-0ce6488a9f28 tempest-ServicesAdminNegativeV253TestJSON-56367393 tempest-ServicesAdminNegativeV253TestJSON-56367393-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.065620 Jul 23 21:20:20.474234 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 825/1669] 10.222.0.17 () {60 vars in 1177 bytes} [Sat Jul 23 21:20:20 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:20:20.479697 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b4e97f37-95d8-456b-a191-7961860637c2 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Action: 'create', calling method: .version_select at 0x7f0b47cc6d30>, body: {"pool": null} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:20:20.834693 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-14ea833b-0bb1-44c5-bcf3-550b12e7f60a tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] 10.222.0.17 "POST /compute/v2.1/servers/f53ce882-4694-421d-8075-5e8cfab0b16f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.422401 Jul 23 21:20:20.841309 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 845/1670] 10.222.0.17 () {60 vars in 1322 bytes} [Sat Jul 23 21:20:20 2022] POST /compute/v2.1/servers/f53ce882-4694-421d-8075-5e8cfab0b16f/os-volume_attachments => generated 194 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:20:20.852407 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-8804922c-7f8d-4d7e-a1a4-34ba0011e544 tempest-ServicesAdminNegativeV253TestJSON-56367393 tempest-ServicesAdminNegativeV253TestJSON-56367393-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:20.860169 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:20:20.860169 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:20:20.862677 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8804922c-7f8d-4d7e-a1a4-34ba0011e544 tempest-ServicesAdminNegativeV253TestJSON-56367393 tempest-ServicesAdminNegativeV253TestJSON-56367393-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:20.863439 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8804922c-7f8d-4d7e-a1a4-34ba0011e544 tempest-ServicesAdminNegativeV253TestJSON-56367393 tempest-ServicesAdminNegativeV253TestJSON-56367393-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:20.864578 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8804922c-7f8d-4d7e-a1a4-34ba0011e544 tempest-ServicesAdminNegativeV253TestJSON-56367393 tempest-ServicesAdminNegativeV253TestJSON-56367393-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:20.865258 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8804922c-7f8d-4d7e-a1a4-34ba0011e544 tempest-ServicesAdminNegativeV253TestJSON-56367393 tempest-ServicesAdminNegativeV253TestJSON-56367393-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:20.940321 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-8804922c-7f8d-4d7e-a1a4-34ba0011e544 tempest-ServicesAdminNegativeV253TestJSON-56367393 tempest-ServicesAdminNegativeV253TestJSON-56367393-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.097331 Jul 23 21:20:20.942076 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 846/1671] 10.222.0.17 () {60 vars in 1238 bytes} [Sat Jul 23 21:20:20 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:20:20.952183 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-0344b995-76e3-49b8-8814-ca50ade4575c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:20.978580 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-0344b995-76e3-49b8-8814-ca50ade4575c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:20.989795 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0344b995-76e3-49b8-8814-ca50ade4575c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:20.995530 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0344b995-76e3-49b8-8814-ca50ade4575c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:21.001358 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0344b995-76e3-49b8-8814-ca50ade4575c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:21.002136 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0344b995-76e3-49b8-8814-ca50ade4575c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:21.311156 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-0344b995-76e3-49b8-8814-ca50ade4575c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:21.323151 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-0344b995-76e3-49b8-8814-ca50ade4575c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:21.325143 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-0344b995-76e3-49b8-8814-ca50ade4575c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:21.326671 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-0344b995-76e3-49b8-8814-ca50ade4575c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1874 microversion: 2.42 time: 0.382300 Jul 23 21:20:21.327835 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 847/1672] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:20:20 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1874 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:20:21.332920 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-6f668c52-937c-470e-bc58-e846dd451a2f req-b897082c-f550-4bf8-8692-21ebf3426a97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6de755e-739d-437c-aafb-6bc49f8bb086", "name": "network-vif-deleted", "tag": "07b0b8e7-f27b-4cdb-893e-93a9a7e67017"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:20:21.341994 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-6f668c52-937c-470e-bc58-e846dd451a2f req-b897082c-f550-4bf8-8692-21ebf3426a97 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:21.342782 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-6f668c52-937c-470e-bc58-e846dd451a2f req-b897082c-f550-4bf8-8692-21ebf3426a97 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:21.357221 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-6f668c52-937c-470e-bc58-e846dd451a2f req-b897082c-f550-4bf8-8692-21ebf3426a97 service nova] Creating event network-vif-deleted:07b0b8e7-f27b-4cdb-893e-93a9a7e67017 for instance a6de755e-739d-437c-aafb-6bc49f8bb086 on nch2-master-1 Jul 23 21:20:21.363861 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-6f668c52-937c-470e-bc58-e846dd451a2f req-b897082c-f550-4bf8-8692-21ebf3426a97 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034488 Jul 23 21:20:21.365588 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 848/1673] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:20:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:20:21.372092 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-70b42308-8219-4ab2-a3a8-17ca1851b452 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:21.372935 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-70b42308-8219-4ab2-a3a8-17ca1851b452 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 34eaf1d2-9732-4c0e-b970-02fbb449514b] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:21.382480 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-70b42308-8219-4ab2-a3a8-17ca1851b452 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:21.382999 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-70b42308-8219-4ab2-a3a8-17ca1851b452 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:21.383911 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-70b42308-8219-4ab2-a3a8-17ca1851b452 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:21.384500 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-70b42308-8219-4ab2-a3a8-17ca1851b452 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:21.427146 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-70b42308-8219-4ab2-a3a8-17ca1851b452 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:21.427596 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-70b42308-8219-4ab2-a3a8-17ca1851b452 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:21.428064 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.objects.instance [None req-70b42308-8219-4ab2-a3a8-17ca1851b452 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lazy-loading 'fault' on Instance uuid 34eaf1d2-9732-4c0e-b970-02fbb449514b {{(pid=131321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:20:21.476805 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-70b42308-8219-4ab2-a3a8-17ca1851b452 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:21.479433 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:20:21.488004 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-70b42308-8219-4ab2-a3a8-17ca1851b452 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/34eaf1d2-9732-4c0e-b970-02fbb449514b" status: 200 len: 1324 microversion: 2.1 time: 0.120617 Jul 23 21:20:21.489337 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 849/1674] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:20:21 2022] GET /compute/v2.1/servers/34eaf1d2-9732-4c0e-b970-02fbb449514b => generated 1324 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:20:21.504575 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f78cc241-8c01-4db6-90e9-f8a5d2c1bbb7 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:21.505765 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-f78cc241-8c01-4db6-90e9-f8a5d2c1bbb7 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] [instance: d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:21.519566 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f78cc241-8c01-4db6-90e9-f8a5d2c1bbb7 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:21.519566 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f78cc241-8c01-4db6-90e9-f8a5d2c1bbb7 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:21.520534 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f78cc241-8c01-4db6-90e9-f8a5d2c1bbb7 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:21.520984 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f78cc241-8c01-4db6-90e9-f8a5d2c1bbb7 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:21.610236 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-f78cc241-8c01-4db6-90e9-f8a5d2c1bbb7 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ef41817e4f5478bb7afdcb59ed634cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af16c62b144aa0972331a69e3638c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:21.620844 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-f78cc241-8c01-4db6-90e9-f8a5d2c1bbb7 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ef41817e4f5478bb7afdcb59ed634cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af16c62b144aa0972331a69e3638c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:21.625118 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-f78cc241-8c01-4db6-90e9-f8a5d2c1bbb7 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ef41817e4f5478bb7afdcb59ed634cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af16c62b144aa0972331a69e3638c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:21.631824 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-f78cc241-8c01-4db6-90e9-f8a5d2c1bbb7 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] 10.222.0.17 "GET /compute/v2.1/servers/d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a" status: 200 len: 1446 microversion: 2.75 time: 0.141783 Jul 23 21:20:21.632941 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 850/1675] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:20:21 2022] GET /compute/v2.1/servers/d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a => generated 1446 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:20:21.787061 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-93b7dc4c-92ec-4339-affb-5742b36a7db7 tempest-ServicesAdminNegativeV253TestJSON-909195764 tempest-ServicesAdminNegativeV253TestJSON-909195764-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:21.788783 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:20:21.788783 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:20:21.790338 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-93b7dc4c-92ec-4339-affb-5742b36a7db7 tempest-ServicesAdminNegativeV253TestJSON-909195764 tempest-ServicesAdminNegativeV253TestJSON-909195764-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '3c997f5228bc4d529d6766a8c3dbeb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee093d7d580481bb8223f03b75f1def', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:21.792451 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-93b7dc4c-92ec-4339-affb-5742b36a7db7 tempest-ServicesAdminNegativeV253TestJSON-909195764 tempest-ServicesAdminNegativeV253TestJSON-909195764-project] Request method failure captured: Jul 23 21:20:21.792451 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/os-services HTTP/1.1 Jul 23 21:20:21.792451 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:20:21.792451 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:20:21.792451 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:20:21.792451 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:20:21.792451 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:20:21.792451 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:20:21.792451 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:20:21.792451 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:20:21.792451 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GYR3hEoolDEJ_pX7cM_VwBKLiYU6Cz68TEXW812vZsgVmxAKEazD8dI0E76gpISjRogou1IGnMFzdBWluMfeV4dOlz_UxEYvVzkuqddJFlfdOzb57h2kVoCtmkYckj0iSFyPaEZZOex_qCPCB7iO5HHlSj11Pm8xHoMqf-oa6WCvb0 Jul 23 21:20:21.792451 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:20:21.792451 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:20:21.792451 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:20:21.792451 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:20:21.792451 ncdv-master-1 devstack@n-api.service[131321]: X-Openstack-Nova-Api-Version: 2.53 Jul 23 21:20:21.792451 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:20:21.792451 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:20:21.792451 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: cee093d7d580481bb8223f03b75f1def Jul 23 21:20:21.792451 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-909195764 Jul 23 21:20:21.792451 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:20:21.792451 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:20:21.794328 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cee093d7d580481bb8223f03b75f1def"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cee093d7d580481bb8223f03b75f1def"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_cee093d7d580481bb8223f03b75f1def", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/cee093d7d580481bb8223f03b75f1def"}]}] Jul 23 21:20:21.794328 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-909195764 Jul 23 21:20:21.794328 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: cee093d7d580481bb8223f03b75f1def Jul 23 21:20:21.794328 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-909195764 Jul 23 21:20:21.794328 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ServicesAdminNegativeV253TestJSON-909195764-project Jul 23 21:20:21.794328 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:20:21.794328 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:20:21.794328 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 3c997f5228bc4d529d6766a8c3dbeb90 Jul 23 21:20:21.794328 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-909195764-project Jul 23 21:20:21.794328 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:20:21.794328 ncdv-master-1 devstack@n-api.service[131321]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 23 21:20:21.794328 ncdv-master-1 devstack@n-api.service[131321]: action_args: {} Jul 23 21:20:21.795324 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:20:21.795324 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:21.795324 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:20:21.795324 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:20:21.795324 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:20:21.795324 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:20:21.795324 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 23 21:20:21.795324 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:20:21.795324 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 23 21:20:21.795324 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:20:21.795324 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:20:21.795324 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:20:21.795324 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Jul 23 21:20:21.795324 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Jul 23 21:20:21.795324 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 23 21:20:21.795324 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 23 21:20:21.795324 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 23 21:20:21.795324 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 23 21:20:21.795324 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 23 21:20:21.797007 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 23 21:20:21.797007 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 23 21:20:21.797007 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise self.value Jul 23 21:20:21.797007 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 23 21:20:21.797007 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 23 21:20:21.797007 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 23 21:20:21.797007 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 23 21:20:21.797007 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 23 21:20:21.797007 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 23 21:20:21.797007 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 23 21:20:21.797007 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:20:21.797007 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:20:21.797007 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:20:21.797007 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:21.797007 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:20:21.797007 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:20:21.797007 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 23 21:20:21.797007 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 23 21:20:21.797007 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 23 21:20:21.797007 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:20:21.798904 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-93b7dc4c-92ec-4339-affb-5742b36a7db7 tempest-ServicesAdminNegativeV253TestJSON-909195764 tempest-ServicesAdminNegativeV253TestJSON-909195764-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:20:21.803879 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-93b7dc4c-92ec-4339-affb-5742b36a7db7 tempest-ServicesAdminNegativeV253TestJSON-909195764 tempest-ServicesAdminNegativeV253TestJSON-909195764-project] 10.222.0.17 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.169784 Jul 23 21:20:21.812832 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 851/1676] 10.222.0.17 () {60 vars in 1177 bytes} [Sat Jul 23 21:20:21 2022] GET /compute/v2.1/os-services => generated 112 bytes in 179 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Jul 23 21:20:21.819546 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-b1831ff1-9888-4c86-b49e-602f03e55f7f tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '.version_select at 0x7f0b54367940>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:21.876505 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-b1831ff1-9888-4c86-b49e-602f03e55f7f tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/images/c5d7d192-f80e-419a-8ce3-1de44fbcc535" status: 200 len: 661 microversion: 2.1 time: 0.062321 Jul 23 21:20:21.883436 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 852/1677] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:20:21 2022] GET /compute/v2.1/images/c5d7d192-f80e-419a-8ce3-1de44fbcc535 => generated 661 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:20:21.890058 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-295b2303-f42b-4a22-84e0-1b31ad5a129f tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:21.890900 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-295b2303-f42b-4a22-84e0-1b31ad5a129f tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: a6de755e-739d-437c-aafb-6bc49f8bb086] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:21.907497 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-295b2303-f42b-4a22-84e0-1b31ad5a129f tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:21.908759 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-295b2303-f42b-4a22-84e0-1b31ad5a129f tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:21.909829 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-295b2303-f42b-4a22-84e0-1b31ad5a129f tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:21.910581 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-295b2303-f42b-4a22-84e0-1b31ad5a129f tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:21.934736 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-295b2303-f42b-4a22-84e0-1b31ad5a129f tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] HTTP exception thrown: Instance a6de755e-739d-437c-aafb-6bc49f8bb086 could not be found. Jul 23 21:20:21.937526 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-295b2303-f42b-4a22-84e0-1b31ad5a129f tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Request method failure captured: Jul 23 21:20:21.937526 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/servers/a6de755e-739d-437c-aafb-6bc49f8bb086 HTTP/1.1 Jul 23 21:20:21.937526 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:20:21.937526 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:20:21.937526 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:20:21.937526 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:20:21.937526 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:20:21.937526 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:20:21.937526 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:20:21.937526 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:20:21.937526 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GS1JPLCtSl4zlOvUAdW9qDCNvk9KgpAVaHDeDRdhrd5Unc5Jp4VYHiNMr-F0SeJb5CAVBa8vOn03Mdw949XFb_Q9VjvG7WvGRUo-tTRXmW46puqpgRzM_AekQVJ5U4r0msCtB-HRCdhS2W_NBYLeuQ68VDyS01pFaHOoQppmHMvtMQ Jul 23 21:20:21.937526 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:20:21.937526 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:20:21.937526 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:20:21.937526 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:20:21.937526 ncdv-master-1 devstack@n-api.service[131321]: X-Openstack-Nova-Api-Version: 2.25 Jul 23 21:20:21.937526 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:20:21.937526 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:20:21.937526 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: b347973dfb204484bdb87ab0094dbe22 Jul 23 21:20:21.937526 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-2065000324 Jul 23 21:20:21.937526 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:20:21.937526 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:20:21.939351 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b347973dfb204484bdb87ab0094dbe22"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b347973dfb204484bdb87ab0094dbe22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b347973dfb204484bdb87ab0094dbe22", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b347973dfb204484bdb87ab0094dbe22"}]}] Jul 23 21:20:21.939351 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-2065000324 Jul 23 21:20:21.939351 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: b347973dfb204484bdb87ab0094dbe22 Jul 23 21:20:21.939351 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-2065000324 Jul 23 21:20:21.939351 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-LiveAutoBlockMigrationV225Test-2065000324-project Jul 23 21:20:21.939351 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:20:21.939351 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:20:21.939351 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 3a56b82cf3954f279dd21e17a42462b3 Jul 23 21:20:21.939351 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-2065000324-project Jul 23 21:20:21.939351 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:20:21.939351 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance a6de755e-739d-437c-aafb-6bc49f8bb086 could not be found. Jul 23 21:20:21.939351 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': 'a6de755e-739d-437c-aafb-6bc49f8bb086'} Jul 23 21:20:21.940323 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:20:21.940323 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:21.940323 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:20:21.940323 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:20:21.940323 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:20:21.940323 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:20:21.940323 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:20:21.940323 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:20:21.940323 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:20:21.940323 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:20:21.940323 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6de755e-739d-437c-aafb-6bc49f8bb086 could not be found. Jul 23 21:20:21.940323 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:20:21.940323 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:20:21.940323 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:20:21.940323 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:21.940323 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:20:21.940323 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:20:21.940323 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:20:21.940323 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:20:21.940323 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:20:21.941916 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:20:21.941916 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:20:21.941916 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:20:21.941916 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:20:21.941916 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:20:21.941916 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:20:21.941916 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:20:21.941916 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6de755e-739d-437c-aafb-6bc49f8bb086 could not be found. Jul 23 21:20:21.941916 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:20:21.941916 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:20:21.941916 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:20:21.941916 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:21.941916 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:20:21.941916 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:20:21.941916 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:20:21.941916 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:20:21.941916 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6de755e-739d-437c-aafb-6bc49f8bb086 could not be found. Jul 23 21:20:21.941916 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:20:21.944161 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-295b2303-f42b-4a22-84e0-1b31ad5a129f tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Returning 404 to user: Instance a6de755e-739d-437c-aafb-6bc49f8bb086 could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:20:21.945914 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-295b2303-f42b-4a22-84e0-1b31ad5a129f tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/a6de755e-739d-437c-aafb-6bc49f8bb086" status: 404 len: 111 microversion: 2.25 time: 0.061066 Jul 23 21:20:21.946669 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 853/1678] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:20:21 2022] GET /compute/v2.1/servers/a6de755e-739d-437c-aafb-6bc49f8bb086 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 23 21:20:21.952651 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c5e535e0-a839-4b5f-b110-7e77eef77eae tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '.version_select at 0x7f0b47dd4700>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:22.008666 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-c5e535e0-a839-4b5f-b110-7e77eef77eae tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/images/c5d7d192-f80e-419a-8ce3-1de44fbcc535" status: 200 len: 661 microversion: 2.1 time: 0.060162 Jul 23 21:20:22.011738 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 854/1679] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:20:21 2022] GET /compute/v2.1/images/c5d7d192-f80e-419a-8ce3-1de44fbcc535 => generated 661 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:20:22.049134 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-bd361a47-a27c-4201-8ad5-cb6e5dc0eb92 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '.version_select at 0x7f0b54367040>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:22.123174 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-bd361a47-a27c-4201-8ad5-cb6e5dc0eb92 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1790694479" status: 204 len: 0 microversion: 2.25 time: 0.098542 Jul 23 21:20:22.124852 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 855/1680] 10.222.0.17 () {60 vars in 1261 bytes} [Sat Jul 23 21:20:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1790694479 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 23 21:20:22.216871 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-8e1dd893-4a9d-483c-99b0-1dec8ab66ba9 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-55908800", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:20:22.303316 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.network.neutron [None req-8e1dd893-4a9d-483c-99b0-1dec8ab66ba9 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] validate_networks() for None {{(pid=131321) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:20:22.724568 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-8e1dd893-4a9d-483c-99b0-1dec8ab66ba9 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Flavor limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:20:22.725157 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-8e1dd893-4a9d-483c-99b0-1dec8ab66ba9 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Image limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:20:22.725627 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-8e1dd893-4a9d-483c-99b0-1dec8ab66ba9 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Flavor pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:20:22.726158 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-8e1dd893-4a9d-483c-99b0-1dec8ab66ba9 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Image pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:20:22.726595 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-8e1dd893-4a9d-483c-99b0-1dec8ab66ba9 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:20:22.737607 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8e1dd893-4a9d-483c-99b0-1dec8ab66ba9 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:22.738097 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8e1dd893-4a9d-483c-99b0-1dec8ab66ba9 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:22.739286 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8e1dd893-4a9d-483c-99b0-1dec8ab66ba9 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:22.739930 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8e1dd893-4a9d-483c-99b0-1dec8ab66ba9 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:22.763295 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-8e1dd893-4a9d-483c-99b0-1dec8ab66ba9 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Getting quotas for project 629d02efac724fa29fcfff53e370b69b. Resources: {'ram', 'instances', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:20:22.783618 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-8e1dd893-4a9d-483c-99b0-1dec8ab66ba9 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Getting quotas for user f80673ab800441b4bd1f5858e1df7b3c and project 629d02efac724fa29fcfff53e370b69b. Resources: {'ram', 'instances', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:20:22.835590 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-8e1dd893-4a9d-483c-99b0-1dec8ab66ba9 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Going to run 1 instances... {{(pid=131321) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:20:22.839921 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-8e1dd893-4a9d-483c-99b0-1dec8ab66ba9 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] [instance: 9933c901-3692-4f36-9f11-e1a93d902e94] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131321) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:20:22.901942 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-8e1dd893-4a9d-483c-99b0-1dec8ab66ba9 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.688987 Jul 23 21:20:22.902890 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 856/1681] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:20:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 691 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 23 21:20:22.911307 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-4d0bfacf-9a91-435e-9000-715952606173 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:22.912604 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-4d0bfacf-9a91-435e-9000-715952606173 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:22.921854 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4d0bfacf-9a91-435e-9000-715952606173 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:22.922343 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4d0bfacf-9a91-435e-9000-715952606173 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:22.923315 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4d0bfacf-9a91-435e-9000-715952606173 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:22.923756 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4d0bfacf-9a91-435e-9000-715952606173 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:23.538329 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-4d0bfacf-9a91-435e-9000-715952606173 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:23.554525 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-4d0bfacf-9a91-435e-9000-715952606173 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:23.556060 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-4d0bfacf-9a91-435e-9000-715952606173 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:23.557632 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-4d0bfacf-9a91-435e-9000-715952606173 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1874 microversion: 2.42 time: 0.653463 Jul 23 21:20:23.558995 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 857/1682] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:20:22 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1874 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:20:23.565945 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d18d1bc1-59f0-43de-b85f-276b66229c9c tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:23.567865 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-d18d1bc1-59f0-43de-b85f-276b66229c9c tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 34eaf1d2-9732-4c0e-b970-02fbb449514b] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:23.574909 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d18d1bc1-59f0-43de-b85f-276b66229c9c tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:23.575641 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d18d1bc1-59f0-43de-b85f-276b66229c9c tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:23.576425 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d18d1bc1-59f0-43de-b85f-276b66229c9c tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:23.576869 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d18d1bc1-59f0-43de-b85f-276b66229c9c tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:23.598575 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-d18d1bc1-59f0-43de-b85f-276b66229c9c tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] HTTP exception thrown: Instance 34eaf1d2-9732-4c0e-b970-02fbb449514b could not be found. Jul 23 21:20:23.602164 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d18d1bc1-59f0-43de-b85f-276b66229c9c tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Request method failure captured: Jul 23 21:20:23.602164 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/servers/34eaf1d2-9732-4c0e-b970-02fbb449514b HTTP/1.1 Jul 23 21:20:23.602164 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:20:23.602164 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:20:23.602164 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:20:23.602164 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:20:23.602164 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:20:23.602164 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:20:23.602164 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:20:23.602164 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:20:23.602164 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GSUadBHV5KQx7oirT38skqnMSdU557uu7W8nycHRhDgemsZLyCYeVkfysUs37F8D_ZUY9UNUJpMdh-nepv8zMyA9ftF8ijyv_SB5vUpZqr7-EHGR3KHXc-GzeRHBEHo83KZ6DeFQv2-Grs6W6blgKIAVzrIFe8rJ_I-lChk_0j0Vww Jul 23 21:20:23.602164 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:20:23.602164 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:20:23.602164 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:20:23.602164 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:20:23.602164 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:20:23.602164 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:20:23.602164 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 6610a2359aa64f89befcf72e4f3f6a54 Jul 23 21:20:23.602164 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-LiveMigrationTest-731745934 Jul 23 21:20:23.602164 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:20:23.602164 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:20:23.603776 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6610a2359aa64f89befcf72e4f3f6a54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6610a2359aa64f89befcf72e4f3f6a54"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6610a2359aa64f89befcf72e4f3f6a54", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6610a2359aa64f89befcf72e4f3f6a54"}]}] Jul 23 21:20:23.603776 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-LiveMigrationTest-731745934 Jul 23 21:20:23.603776 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 6610a2359aa64f89befcf72e4f3f6a54 Jul 23 21:20:23.603776 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-LiveMigrationTest-731745934 Jul 23 21:20:23.603776 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-LiveMigrationTest-731745934-project Jul 23 21:20:23.603776 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:20:23.603776 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:20:23.603776 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: f2672c5db79b4a48a505c3df536594dd Jul 23 21:20:23.603776 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-LiveMigrationTest-731745934-project Jul 23 21:20:23.603776 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:20:23.603776 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance 34eaf1d2-9732-4c0e-b970-02fbb449514b could not be found. Jul 23 21:20:23.603776 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': '34eaf1d2-9732-4c0e-b970-02fbb449514b'} Jul 23 21:20:23.604618 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:20:23.604618 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:23.604618 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:20:23.604618 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:20:23.604618 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:20:23.604618 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:20:23.604618 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:20:23.604618 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:20:23.604618 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:20:23.604618 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:20:23.604618 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34eaf1d2-9732-4c0e-b970-02fbb449514b could not be found. Jul 23 21:20:23.604618 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:20:23.604618 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:20:23.604618 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:20:23.604618 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:23.604618 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:20:23.604618 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:20:23.604618 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:20:23.604618 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:20:23.604618 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:20:23.607924 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:20:23.607924 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:20:23.607924 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:20:23.607924 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:20:23.607924 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:20:23.607924 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:20:23.607924 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:20:23.607924 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34eaf1d2-9732-4c0e-b970-02fbb449514b could not be found. Jul 23 21:20:23.607924 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:20:23.607924 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:20:23.607924 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:20:23.607924 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:23.607924 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:20:23.607924 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:20:23.607924 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:20:23.607924 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:20:23.607924 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34eaf1d2-9732-4c0e-b970-02fbb449514b could not be found. Jul 23 21:20:23.607924 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:20:23.611355 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d18d1bc1-59f0-43de-b85f-276b66229c9c tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Returning 404 to user: Instance 34eaf1d2-9732-4c0e-b970-02fbb449514b could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:20:23.611355 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-d18d1bc1-59f0-43de-b85f-276b66229c9c tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/34eaf1d2-9732-4c0e-b970-02fbb449514b" status: 404 len: 111 microversion: 2.1 time: 0.043191 Jul 23 21:20:23.611355 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 858/1683] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:20:23 2022] GET /compute/v2.1/servers/34eaf1d2-9732-4c0e-b970-02fbb449514b => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:20:23.617321 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-efb666fe-823b-458c-81bd-c0fe9ae4b4f3 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:23.618193 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-efb666fe-823b-458c-81bd-c0fe9ae4b4f3 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] [instance: d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:23.626808 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-efb666fe-823b-458c-81bd-c0fe9ae4b4f3 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:23.627466 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-efb666fe-823b-458c-81bd-c0fe9ae4b4f3 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:23.628456 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-efb666fe-823b-458c-81bd-c0fe9ae4b4f3 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:23.629309 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-efb666fe-823b-458c-81bd-c0fe9ae4b4f3 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:23.714700 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-efb666fe-823b-458c-81bd-c0fe9ae4b4f3 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ef41817e4f5478bb7afdcb59ed634cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af16c62b144aa0972331a69e3638c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:23.724453 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-efb666fe-823b-458c-81bd-c0fe9ae4b4f3 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ef41817e4f5478bb7afdcb59ed634cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af16c62b144aa0972331a69e3638c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:23.726204 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-efb666fe-823b-458c-81bd-c0fe9ae4b4f3 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ef41817e4f5478bb7afdcb59ed634cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af16c62b144aa0972331a69e3638c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:23.732850 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-efb666fe-823b-458c-81bd-c0fe9ae4b4f3 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] 10.222.0.17 "GET /compute/v2.1/servers/d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a" status: 200 len: 1446 microversion: 2.75 time: 0.127753 Jul 23 21:20:23.733431 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 859/1684] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:20:23 2022] GET /compute/v2.1/servers/d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a => generated 1446 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:20:23.738442 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f0848c75-95b9-4805-a972-e1f862f062c5 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1635730527", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:20:23.799878 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.network.neutron [None req-f0848c75-95b9-4805-a972-e1f862f062c5 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] validate_networks() for None {{(pid=131321) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:20:24.179889 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-f0848c75-95b9-4805-a972-e1f862f062c5 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Flavor limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:20:24.180336 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-f0848c75-95b9-4805-a972-e1f862f062c5 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Image limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:20:24.180826 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-f0848c75-95b9-4805-a972-e1f862f062c5 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Flavor pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:20:24.181310 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-f0848c75-95b9-4805-a972-e1f862f062c5 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Image pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:20:24.181825 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-f0848c75-95b9-4805-a972-e1f862f062c5 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:20:24.211813 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f0848c75-95b9-4805-a972-e1f862f062c5 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:24.212434 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f0848c75-95b9-4805-a972-e1f862f062c5 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:24.213246 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f0848c75-95b9-4805-a972-e1f862f062c5 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:24.213687 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f0848c75-95b9-4805-a972-e1f862f062c5 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:24.256784 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-f0848c75-95b9-4805-a972-e1f862f062c5 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Getting quotas for project 629d02efac724fa29fcfff53e370b69b. Resources: {'ram', 'instances', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:20:24.263395 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-f0848c75-95b9-4805-a972-e1f862f062c5 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Getting quotas for user f80673ab800441b4bd1f5858e1df7b3c and project 629d02efac724fa29fcfff53e370b69b. Resources: {'ram', 'instances', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:20:24.291275 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-f0848c75-95b9-4805-a972-e1f862f062c5 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Going to run 1 instances... {{(pid=131321) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:20:24.295150 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-f0848c75-95b9-4805-a972-e1f862f062c5 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] [instance: c1701f99-a44c-48ca-8946-b84c5e163cee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131321) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:20:24.353069 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-f0848c75-95b9-4805-a972-e1f862f062c5 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.617894 Jul 23 21:20:24.353892 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 860/1685] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:20:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 620 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 23 21:20:24.363065 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-b5477383-6af8-4003-8cde-f5fc435a2623 req-e4f67ff8-0752-460f-ae23-f1136cae7710 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34eaf1d2-9732-4c0e-b970-02fbb449514b", "name": "network-vif-deleted", "tag": "b09648fa-0071-4d7d-ba66-d0da81ab9768"}, {"name": "network-changed", "server_uuid": "4d09f96e-8ea6-4838-8264-4535f77fa39d", "tag": "6a3326c3-3a2b-413d-aced-917b1a1798b5"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:20:24.390863 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-b5477383-6af8-4003-8cde-f5fc435a2623 req-e4f67ff8-0752-460f-ae23-f1136cae7710 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:24.393799 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-b5477383-6af8-4003-8cde-f5fc435a2623 req-e4f67ff8-0752-460f-ae23-f1136cae7710 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:24.415589 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-b5477383-6af8-4003-8cde-f5fc435a2623 req-e4f67ff8-0752-460f-ae23-f1136cae7710 service nova] Creating event network-vif-deleted:b09648fa-0071-4d7d-ba66-d0da81ab9768 for instance 34eaf1d2-9732-4c0e-b970-02fbb449514b on nch1-master-1 Jul 23 21:20:24.424866 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-b5477383-6af8-4003-8cde-f5fc435a2623 req-e4f67ff8-0752-460f-ae23-f1136cae7710 service nova] Creating event network-changed:6a3326c3-3a2b-413d-aced-917b1a1798b5 for instance 4d09f96e-8ea6-4838-8264-4535f77fa39d on nch2-master-1 Jul 23 21:20:24.444362 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-b5477383-6af8-4003-8cde-f5fc435a2623 req-e4f67ff8-0752-460f-ae23-f1136cae7710 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.089058 Jul 23 21:20:24.445501 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 861/1686] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:20:24 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:20:24.457148 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-6806e958-d527-4adc-a735-480c48f83056 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '.version_select at 0x7f0b47dd4b80>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:24.498435 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-6806e958-d527-4adc-a735-480c48f83056 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1830557801" status: 202 len: 0 microversion: 2.1 time: 0.050700 Jul 23 21:20:24.503015 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 862/1687] 10.222.0.17 () {58 vars in 1220 bytes} [Sat Jul 23 21:20:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1830557801 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:20:24.516431 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-50a097b9-3894-4311-ba1e-132a3ab291ef tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:24.517081 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-50a097b9-3894-4311-ba1e-132a3ab291ef tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: 7558d52c-24e7-4115-88f7-ced193819c33] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:24.537279 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-50a097b9-3894-4311-ba1e-132a3ab291ef tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:24.537757 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-50a097b9-3894-4311-ba1e-132a3ab291ef tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:24.539616 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-50a097b9-3894-4311-ba1e-132a3ab291ef tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:24.540068 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-50a097b9-3894-4311-ba1e-132a3ab291ef tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:24.589020 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-50a097b9-3894-4311-ba1e-132a3ab291ef tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: 7558d52c-24e7-4115-88f7-ced193819c33] Going to try to terminate instance {{(pid=131321) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:20:24.611890 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b4e97f37-95d8-456b-a191-7961860637c2 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] 10.222.0.17 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.136151 Jul 23 21:20:24.613405 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 826/1688] 10.222.0.17 () {60 vars in 1169 bytes} [Sat Jul 23 21:20:20 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:20:24.639660 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-598f9185-6bcc-4029-85d6-8ef9ea6c63ab tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:24.641223 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-598f9185-6bcc-4029-85d6-8ef9ea6c63ab tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] [instance: c1701f99-a44c-48ca-8946-b84c5e163cee] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:24.645088 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=20,nova_cell0:UPDATE=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:20:24.739593 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-50a097b9-3894-4311-ba1e-132a3ab291ef tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "DELETE /compute/v2.1/servers/7558d52c-24e7-4115-88f7-ced193819c33" status: 204 len: 0 microversion: 2.25 time: 0.236535 Jul 23 21:20:24.740489 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 863/1689] 10.222.0.17 () {60 vars in 1279 bytes} [Sat Jul 23 21:20:24 2022] DELETE /compute/v2.1/servers/7558d52c-24e7-4115-88f7-ced193819c33 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 23 21:20:24.762084 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-17376979-91ee-4383-babe-6cb64c7aef0c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:24.763325 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-17376979-91ee-4383-babe-6cb64c7aef0c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:24.780641 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-17376979-91ee-4383-babe-6cb64c7aef0c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:24.782120 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-17376979-91ee-4383-babe-6cb64c7aef0c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:24.784140 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-17376979-91ee-4383-babe-6cb64c7aef0c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:24.784616 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-17376979-91ee-4383-babe-6cb64c7aef0c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:24.875669 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-598f9185-6bcc-4029-85d6-8ef9ea6c63ab tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80673ab800441b4bd1f5858e1df7b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629d02efac724fa29fcfff53e370b69b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:24.889830 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-598f9185-6bcc-4029-85d6-8ef9ea6c63ab tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/servers/c1701f99-a44c-48ca-8946-b84c5e163cee" status: 200 len: 1218 microversion: 2.1 time: 0.261344 Jul 23 21:20:24.890542 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 827/1690] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:20:24 2022] GET /compute/v2.1/servers/c1701f99-a44c-48ca-8946-b84c5e163cee => generated 1218 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:20:24.895502 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-01fe843b-ce02-46c1-b5df-f80305991966 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:24.903040 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-01fe843b-ce02-46c1-b5df-f80305991966 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: 7558d52c-24e7-4115-88f7-ced193819c33] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:24.922672 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-01fe843b-ce02-46c1-b5df-f80305991966 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:24.922672 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-01fe843b-ce02-46c1-b5df-f80305991966 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:24.924293 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-01fe843b-ce02-46c1-b5df-f80305991966 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:24.924746 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-01fe843b-ce02-46c1-b5df-f80305991966 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:25.244736 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-17376979-91ee-4383-babe-6cb64c7aef0c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:25.255237 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-17376979-91ee-4383-babe-6cb64c7aef0c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:25.259928 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-17376979-91ee-4383-babe-6cb64c7aef0c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:25.263349 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-17376979-91ee-4383-babe-6cb64c7aef0c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1874 microversion: 2.42 time: 0.513278 Jul 23 21:20:25.274952 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 864/1691] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:20:24 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1874 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:20:25.274952 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e0928e42-dc72-4735-9ab1-b4322ca413de tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:25.274952 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-e0928e42-dc72-4735-9ab1-b4322ca413de tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] [instance: d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:25.287084 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e0928e42-dc72-4735-9ab1-b4322ca413de tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:25.287817 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e0928e42-dc72-4735-9ab1-b4322ca413de tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:25.288956 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e0928e42-dc72-4735-9ab1-b4322ca413de tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:25.289810 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e0928e42-dc72-4735-9ab1-b4322ca413de tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:25.347884 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-01fe843b-ce02-46c1-b5df-f80305991966 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:25.371129 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-01fe843b-ce02-46c1-b5df-f80305991966 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:25.374033 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-01fe843b-ce02-46c1-b5df-f80305991966 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:25.376516 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-01fe843b-ce02-46c1-b5df-f80305991966 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/7558d52c-24e7-4115-88f7-ced193819c33" status: 200 len: 1550 microversion: 2.25 time: 0.484824 Jul 23 21:20:25.377584 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 828/1692] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:20:24 2022] GET /compute/v2.1/servers/7558d52c-24e7-4115-88f7-ced193819c33 => generated 1550 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:20:25.393087 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c3182e09-2a76-4818-8c88-414e20910da8 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1506295790", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "networks": [{"uuid": "1bf1175b-8b51-4fe1-8a7e-c57501a7f9a2"}]}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:20:25.474996 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-e0928e42-dc72-4735-9ab1-b4322ca413de tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ef41817e4f5478bb7afdcb59ed634cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af16c62b144aa0972331a69e3638c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:25.487601 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-c3182e09-2a76-4818-8c88-414e20910da8 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] validate_networks() for [('1bf1175b-8b51-4fe1-8a7e-c57501a7f9a2', None, None, None, None, None)] {{(pid=131320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:20:25.491683 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-e0928e42-dc72-4735-9ab1-b4322ca413de tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ef41817e4f5478bb7afdcb59ed634cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af16c62b144aa0972331a69e3638c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:25.496157 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-e0928e42-dc72-4735-9ab1-b4322ca413de tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ef41817e4f5478bb7afdcb59ed634cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af16c62b144aa0972331a69e3638c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:25.503237 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-e0928e42-dc72-4735-9ab1-b4322ca413de tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] 10.222.0.17 "GET /compute/v2.1/servers/d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a" status: 200 len: 1452 microversion: 2.75 time: 0.235250 Jul 23 21:20:25.518515 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 865/1693] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:20:25 2022] GET /compute/v2.1/servers/d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a => generated 1452 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:20:25.888159 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e4b82794-492d-49b9-bc5c-efcc0f7027c9 tempest-VolumesAdminNegativeTest-1060801855 tempest-VolumesAdminNegativeTest-1060801855-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "ca71abcf-6084-4e71-80f5-56d1d513708c"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:20:25.889719 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-e4b82794-492d-49b9-bc5c-efcc0f7027c9 tempest-VolumesAdminNegativeTest-1060801855 tempest-VolumesAdminNegativeTest-1060801855-project-admin] [instance: f53ce882-4694-421d-8075-5e8cfab0b16f] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:25.897386 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e4b82794-492d-49b9-bc5c-efcc0f7027c9 tempest-VolumesAdminNegativeTest-1060801855 tempest-VolumesAdminNegativeTest-1060801855-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:25.898581 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e4b82794-492d-49b9-bc5c-efcc0f7027c9 tempest-VolumesAdminNegativeTest-1060801855 tempest-VolumesAdminNegativeTest-1060801855-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:25.899413 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e4b82794-492d-49b9-bc5c-efcc0f7027c9 tempest-VolumesAdminNegativeTest-1060801855 tempest-VolumesAdminNegativeTest-1060801855-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:25.900276 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e4b82794-492d-49b9-bc5c-efcc0f7027c9 tempest-VolumesAdminNegativeTest-1060801855 tempest-VolumesAdminNegativeTest-1060801855-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:26.041730 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-e4b82794-492d-49b9-bc5c-efcc0f7027c9 tempest-VolumesAdminNegativeTest-1060801855 tempest-VolumesAdminNegativeTest-1060801855-project-admin] HTTP exception thrown: Volume ca71abcf-6084-4e71-80f5-56d1d513708c could not be found. Jul 23 21:20:26.084209 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e4b82794-492d-49b9-bc5c-efcc0f7027c9 tempest-VolumesAdminNegativeTest-1060801855 tempest-VolumesAdminNegativeTest-1060801855-project-admin] Request method failure captured: Jul 23 21:20:26.084209 ncdv-master-1 devstack@n-api.service[131321]: request: PUT /compute/v2.1/servers/f53ce882-4694-421d-8075-5e8cfab0b16f/os-volume_attachments/0f7a6529-1334-4899-b7cd-f77b9a726980 HTTP/1.1 Jul 23 21:20:26.084209 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:20:26.084209 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:20:26.084209 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:20:26.084209 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 74 Jul 23 21:20:26.084209 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:20:26.084209 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:20:26.084209 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:20:26.084209 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:20:26.084209 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GXFZRsbfRWnB1sWPp8PC6yBwIj_t2XGnb6eij4CrROJXHd9EwCMglkbjVbqRnvS8KEWWhOGLCOt37DFIMTUiCWOgH_lVlztP1_uALVVoI3ccZ3RuGzEJLsaTuKcSZdO5xD4ish0hXDTbnTSgMKFo-JHevRgN4A7hfWGyaA-kZ2DMAk Jul 23 21:20:26.084209 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:20:26.084209 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:20:26.084209 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:20:26.084209 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:20:26.084209 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:20:26.084209 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:20:26.084209 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 2a1692e025cd466cb532b1caa78fa196 Jul 23 21:20:26.084209 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-VolumesAdminNegativeTest-1060801855 Jul 23 21:20:26.084209 ncdv-master-1 devstack@n-api.service[131321]: X-Role: admin,reader,member Jul 23 21:20:26.084209 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: admin,reader,member Jul 23 21:20:26.086029 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2a1692e025cd466cb532b1caa78fa196"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2a1692e025cd466cb532b1caa78fa196"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2a1692e025cd466cb532b1caa78fa196", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2a1692e025cd466cb532b1caa78fa196"}]}] Jul 23 21:20:26.086029 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-VolumesAdminNegativeTest-1060801855 Jul 23 21:20:26.086029 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 2a1692e025cd466cb532b1caa78fa196 Jul 23 21:20:26.086029 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1060801855 Jul 23 21:20:26.086029 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-VolumesAdminNegativeTest-1060801855-project-admin Jul 23 21:20:26.086029 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:20:26.086029 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:20:26.086029 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 460eb04964224ed0a414d2fde153a26a Jul 23 21:20:26.086029 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-VolumesAdminNegativeTest-1060801855-project-admin Jul 23 21:20:26.086029 ncdv-master-1 devstack@n-api.service[131321]: Jul 23 21:20:26.086029 ncdv-master-1 devstack@n-api.service[131321]: {"volumeAttachment": {"volumeId": "ca71abcf-6084-4e71-80f5-56d1d513708c"}} Jul 23 21:20:26.086029 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:20:26.086029 ncdv-master-1 devstack@n-api.service[131321]: exception: Volume ca71abcf-6084-4e71-80f5-56d1d513708c could not be found. Jul 23 21:20:26.087235 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'server_id': 'f53ce882-4694-421d-8075-5e8cfab0b16f', 'id': '0f7a6529-1334-4899-b7cd-f77b9a726980', 'body': {'volumeAttachment': {'volumeId': 'ca71abcf-6084-4e71-80f5-56d1d513708c'}}} Jul 23 21:20:26.087235 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:20:26.087235 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:26.087235 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 23 21:20:26.087235 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 23 21:20:26.087235 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 23 21:20:26.087235 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 23 21:20:26.087235 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 23 21:20:26.087235 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 23 21:20:26.087235 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 23 21:20:26.087235 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 23 21:20:26.087235 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 23 21:20:26.087235 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 23 21:20:26.087235 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 23 21:20:26.087235 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 23 21:20:26.087235 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 23 21:20:26.087235 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 23 21:20:26.088644 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ca71abcf-6084-4e71-80f5-56d1d513708c could not be found. (HTTP 404) (Request-ID: req-08aa69ed-0068-4159-a5b1-80710a48d49e) Jul 23 21:20:26.088644 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:20:26.088644 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:20:26.088644 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:20:26.088644 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:26.088644 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Jul 23 21:20:26.088644 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Jul 23 21:20:26.088644 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 23 21:20:26.088644 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 23 21:20:26.088644 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 23 21:20:26.088644 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 23 21:20:26.088644 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 23 21:20:26.088644 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 23 21:20:26.088644 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 23 21:20:26.088644 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 23 21:20:26.088644 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 23 21:20:26.088644 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 23 21:20:26.088644 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 23 21:20:26.088644 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 23 21:20:26.089972 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 23 21:20:26.089972 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 23 21:20:26.089972 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 23 21:20:26.089972 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 23 21:20:26.089972 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 23 21:20:26.089972 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 23 21:20:26.089972 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 23 21:20:26.089972 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 23 21:20:26.089972 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ca71abcf-6084-4e71-80f5-56d1d513708c could not be found. Jul 23 21:20:26.089972 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:20:26.089972 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:20:26.089972 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:20:26.089972 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:26.089972 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:20:26.089972 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:20:26.089972 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:20:26.089972 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:20:26.089972 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:20:26.089972 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:20:26.092302 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:20:26.092302 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:20:26.092302 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:20:26.092302 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:20:26.092302 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Jul 23 21:20:26.092302 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Jul 23 21:20:26.092302 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Jul 23 21:20:26.092302 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 23 21:20:26.092302 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume ca71abcf-6084-4e71-80f5-56d1d513708c could not be found. Jul 23 21:20:26.092302 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:20:26.092302 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:20:26.092302 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:20:26.092302 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:26.092302 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:20:26.092302 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:20:26.092302 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:20:26.092302 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:20:26.092302 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ca71abcf-6084-4e71-80f5-56d1d513708c could not be found. Jul 23 21:20:26.092302 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:20:26.106692 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e4b82794-492d-49b9-bc5c-efcc0f7027c9 tempest-VolumesAdminNegativeTest-1060801855 tempest-VolumesAdminNegativeTest-1060801855-project-admin] Returning 400 to user: Volume ca71abcf-6084-4e71-80f5-56d1d513708c could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:20:26.112982 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-e4b82794-492d-49b9-bc5c-efcc0f7027c9 tempest-VolumesAdminNegativeTest-1060801855 tempest-VolumesAdminNegativeTest-1060801855-project-admin] 10.222.0.17 "PUT /compute/v2.1/servers/f53ce882-4694-421d-8075-5e8cfab0b16f/os-volume_attachments/0f7a6529-1334-4899-b7cd-f77b9a726980" status: 400 len: 107 microversion: 2.1 time: 0.590337 Jul 23 21:20:26.113923 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 866/1694] 10.222.0.17 () {60 vars in 1432 bytes} [Sat Jul 23 21:20:25 2022] PUT /compute/v2.1/servers/f53ce882-4694-421d-8075-5e8cfab0b16f/os-volume_attachments/0f7a6529-1334-4899-b7cd-f77b9a726980 => generated 107 bytes in 595 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 23 21:20:26.124520 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-1b7209b2-892d-4c34-a2db-d86c433b35ab tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:26.128941 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-1b7209b2-892d-4c34-a2db-d86c433b35ab tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] [instance: c1701f99-a44c-48ca-8946-b84c5e163cee] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:26.152756 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1b7209b2-892d-4c34-a2db-d86c433b35ab tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:26.153145 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1b7209b2-892d-4c34-a2db-d86c433b35ab tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:26.154958 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1b7209b2-892d-4c34-a2db-d86c433b35ab tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:26.155809 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1b7209b2-892d-4c34-a2db-d86c433b35ab tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:26.315759 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-1b7209b2-892d-4c34-a2db-d86c433b35ab tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80673ab800441b4bd1f5858e1df7b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629d02efac724fa29fcfff53e370b69b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:26.326186 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-1b7209b2-892d-4c34-a2db-d86c433b35ab tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/servers/c1701f99-a44c-48ca-8946-b84c5e163cee" status: 200 len: 1270 microversion: 2.1 time: 0.206362 Jul 23 21:20:26.337192 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 867/1695] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:20:26 2022] GET /compute/v2.1/servers/c1701f99-a44c-48ca-8946-b84c5e163cee => generated 1270 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:20:26.344116 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-98d5c1de-760b-4066-8f52-291fd591899f tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:26.345390 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-98d5c1de-760b-4066-8f52-291fd591899f tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:26.353687 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-98d5c1de-760b-4066-8f52-291fd591899f tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:26.354238 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-98d5c1de-760b-4066-8f52-291fd591899f tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:26.355102 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-98d5c1de-760b-4066-8f52-291fd591899f tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:26.355663 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-98d5c1de-760b-4066-8f52-291fd591899f tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:26.395096 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-98d5c1de-760b-4066-8f52-291fd591899f tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b] Going to try to terminate instance {{(pid=131321) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:20:26.608164 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=2,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:20:26.617363 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-98d5c1de-760b-4066-8f52-291fd591899f tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b" status: 204 len: 0 microversion: 2.1 time: 0.278461 Jul 23 21:20:26.623190 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 868/1696] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:20:26 2022] DELETE /compute/v2.1/servers/d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:20:26.631672 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c9c2de44-a585-4c92-a2be-33a46cefe083 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:26.632774 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-c9c2de44-a585-4c92-a2be-33a46cefe083 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] [instance: f53ce882-4694-421d-8075-5e8cfab0b16f] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:26.651706 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c9c2de44-a585-4c92-a2be-33a46cefe083 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:26.652561 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c9c2de44-a585-4c92-a2be-33a46cefe083 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:26.654439 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c9c2de44-a585-4c92-a2be-33a46cefe083 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:26.655019 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c9c2de44-a585-4c92-a2be-33a46cefe083 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:26.834790 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.objects.instance [None req-c9c2de44-a585-4c92-a2be-33a46cefe083 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lazy-loading 'services' on Instance uuid f53ce882-4694-421d-8075-5e8cfab0b16f {{(pid=131321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:20:26.975312 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-c9c2de44-a585-4c92-a2be-33a46cefe083 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] 10.222.0.17 "DELETE /compute/v2.1/servers/f53ce882-4694-421d-8075-5e8cfab0b16f/os-volume_attachments/0f7a6529-1334-4899-b7cd-f77b9a726980" status: 202 len: 0 microversion: 2.1 time: 0.348297 Jul 23 21:20:26.976471 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 869/1697] 10.222.0.17 () {58 vars in 1415 bytes} [Sat Jul 23 21:20:26 2022] DELETE /compute/v2.1/servers/f53ce882-4694-421d-8075-5e8cfab0b16f/os-volume_attachments/0f7a6529-1334-4899-b7cd-f77b9a726980 => generated 0 bytes in 352 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:20:26.988833 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-2035b68b-bdaa-441d-88bd-6bb677cd8174 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:26.989855 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-2035b68b-bdaa-441d-88bd-6bb677cd8174 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:26.998525 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2035b68b-bdaa-441d-88bd-6bb677cd8174 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:26.999869 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2035b68b-bdaa-441d-88bd-6bb677cd8174 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:27.001903 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2035b68b-bdaa-441d-88bd-6bb677cd8174 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:27.002776 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2035b68b-bdaa-441d-88bd-6bb677cd8174 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:27.102791 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-c3182e09-2a76-4818-8c88-414e20910da8 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:20:27.103183 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-c3182e09-2a76-4818-8c88-414e20910da8 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:20:27.104933 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-c3182e09-2a76-4818-8c88-414e20910da8 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:20:27.105368 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-c3182e09-2a76-4818-8c88-414e20910da8 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:20:27.106502 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-c3182e09-2a76-4818-8c88-414e20910da8 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:20:27.143470 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c3182e09-2a76-4818-8c88-414e20910da8 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:27.143798 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c3182e09-2a76-4818-8c88-414e20910da8 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:27.146965 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c3182e09-2a76-4818-8c88-414e20910da8 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:27.149311 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c3182e09-2a76-4818-8c88-414e20910da8 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:27.206413 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-c3182e09-2a76-4818-8c88-414e20910da8 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Getting quotas for project e165633a87b04bd9bc3f6e575f53fb12. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:20:27.218198 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-c3182e09-2a76-4818-8c88-414e20910da8 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Getting quotas for user 194f98e3c86b48e9952fe02d3648beb0 and project e165633a87b04bd9bc3f6e575f53fb12. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:20:27.257301 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c3182e09-2a76-4818-8c88-414e20910da8 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Going to run 1 instances... {{(pid=131320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:20:27.260089 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c3182e09-2a76-4818-8c88-414e20910da8 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] [instance: 3075a998-589a-474c-ac0a-3c53f63ab574] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:20:27.358843 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c3182e09-2a76-4818-8c88-414e20910da8 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.977155 Jul 23 21:20:27.358843 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 829/1698] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:20:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1979 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 23 21:20:27.362344 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b450b75d-232d-4efe-8883-6d95596f5941 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:27.362971 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b450b75d-232d-4efe-8883-6d95596f5941 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: 7558d52c-24e7-4115-88f7-ced193819c33] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:27.370257 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b450b75d-232d-4efe-8883-6d95596f5941 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:27.371096 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b450b75d-232d-4efe-8883-6d95596f5941 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:27.372105 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b450b75d-232d-4efe-8883-6d95596f5941 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:27.372747 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b450b75d-232d-4efe-8883-6d95596f5941 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:27.465110 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-2035b68b-bdaa-441d-88bd-6bb677cd8174 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:27.475277 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-2035b68b-bdaa-441d-88bd-6bb677cd8174 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:27.476806 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-2035b68b-bdaa-441d-88bd-6bb677cd8174 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:27.478034 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-2035b68b-bdaa-441d-88bd-6bb677cd8174 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1874 microversion: 2.42 time: 0.499226 Jul 23 21:20:27.489357 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 870/1699] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:20:26 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1874 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:20:27.489357 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-667f23d3-c602-4be0-8267-a622107550cf req-58d3260a-5e26-462b-a2b7-ae710fc3ea14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d09f96e-8ea6-4838-8264-4535f77fa39d", "tag": "5765f451-685a-407c-8012-c24d49c52d7c"}, {"name": "network-changed", "server_uuid": "4d09f96e-8ea6-4838-8264-4535f77fa39d", "tag": "5b177b16-047c-46e8-9195-fbe5aa317e47"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:20:27.492600 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-667f23d3-c602-4be0-8267-a622107550cf req-58d3260a-5e26-462b-a2b7-ae710fc3ea14 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:27.492977 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-667f23d3-c602-4be0-8267-a622107550cf req-58d3260a-5e26-462b-a2b7-ae710fc3ea14 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:27.497526 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:20:27.506137 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-667f23d3-c602-4be0-8267-a622107550cf req-58d3260a-5e26-462b-a2b7-ae710fc3ea14 service nova] Creating event network-changed:5765f451-685a-407c-8012-c24d49c52d7c for instance 4d09f96e-8ea6-4838-8264-4535f77fa39d on nch2-master-1 Jul 23 21:20:27.506668 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-667f23d3-c602-4be0-8267-a622107550cf req-58d3260a-5e26-462b-a2b7-ae710fc3ea14 service nova] Creating event network-changed:5b177b16-047c-46e8-9195-fbe5aa317e47 for instance 4d09f96e-8ea6-4838-8264-4535f77fa39d on nch2-master-1 Jul 23 21:20:27.512269 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-667f23d3-c602-4be0-8267-a622107550cf req-58d3260a-5e26-462b-a2b7-ae710fc3ea14 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.031954 Jul 23 21:20:27.512801 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 871/1700] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:20:27 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:20:27.518484 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-14a54cd2-5f3b-4d14-9745-a632d5d76c60 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:27.519196 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-14a54cd2-5f3b-4d14-9745-a632d5d76c60 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] [instance: d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:27.527475 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-14a54cd2-5f3b-4d14-9745-a632d5d76c60 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:27.527939 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-14a54cd2-5f3b-4d14-9745-a632d5d76c60 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:27.529105 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-14a54cd2-5f3b-4d14-9745-a632d5d76c60 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:27.529249 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-14a54cd2-5f3b-4d14-9745-a632d5d76c60 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:27.598041 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-14a54cd2-5f3b-4d14-9745-a632d5d76c60 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ef41817e4f5478bb7afdcb59ed634cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af16c62b144aa0972331a69e3638c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:27.610902 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-14a54cd2-5f3b-4d14-9745-a632d5d76c60 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ef41817e4f5478bb7afdcb59ed634cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af16c62b144aa0972331a69e3638c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:27.612451 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-14a54cd2-5f3b-4d14-9745-a632d5d76c60 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ef41817e4f5478bb7afdcb59ed634cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af16c62b144aa0972331a69e3638c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:27.617998 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-14a54cd2-5f3b-4d14-9745-a632d5d76c60 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] 10.222.0.17 "GET /compute/v2.1/servers/d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a" status: 200 len: 1437 microversion: 2.75 time: 0.103966 Jul 23 21:20:27.618791 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 872/1701] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:20:27 2022] GET /compute/v2.1/servers/d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a => generated 1437 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:20:27.629989 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-70385105-46a2-4499-9ee6-4fb2b5dbf594 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:27.631023 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-70385105-46a2-4499-9ee6-4fb2b5dbf594 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:27.639924 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-70385105-46a2-4499-9ee6-4fb2b5dbf594 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:27.641409 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-70385105-46a2-4499-9ee6-4fb2b5dbf594 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:27.642819 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-70385105-46a2-4499-9ee6-4fb2b5dbf594 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:27.643535 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-70385105-46a2-4499-9ee6-4fb2b5dbf594 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:27.783073 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b450b75d-232d-4efe-8883-6d95596f5941 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:27.798112 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b450b75d-232d-4efe-8883-6d95596f5941 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:27.799990 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b450b75d-232d-4efe-8883-6d95596f5941 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:27.801352 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b450b75d-232d-4efe-8883-6d95596f5941 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/7558d52c-24e7-4115-88f7-ced193819c33" status: 200 len: 1332 microversion: 2.25 time: 0.443276 Jul 23 21:20:27.812645 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 830/1702] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:20:27 2022] GET /compute/v2.1/servers/7558d52c-24e7-4115-88f7-ced193819c33 => generated 1332 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:20:27.817947 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-985f75a1-1e8b-4d29-b48e-d5376fa43480 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:27.819121 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-985f75a1-1e8b-4d29-b48e-d5376fa43480 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] [instance: f53ce882-4694-421d-8075-5e8cfab0b16f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:27.829505 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-985f75a1-1e8b-4d29-b48e-d5376fa43480 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:27.830397 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-985f75a1-1e8b-4d29-b48e-d5376fa43480 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:27.832091 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-985f75a1-1e8b-4d29-b48e-d5376fa43480 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:27.832950 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-985f75a1-1e8b-4d29-b48e-d5376fa43480 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:27.864641 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-70385105-46a2-4499-9ee6-4fb2b5dbf594 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:27.876074 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-70385105-46a2-4499-9ee6-4fb2b5dbf594 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b" status: 200 len: 1485 microversion: 2.1 time: 0.249813 Jul 23 21:20:27.882655 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-985f75a1-1e8b-4d29-b48e-d5376fa43480 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] 10.222.0.17 "GET /compute/v2.1/servers/f53ce882-4694-421d-8075-5e8cfab0b16f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069177 Jul 23 21:20:27.887915 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 873/1703] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:20:27 2022] GET /compute/v2.1/servers/d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b => generated 1485 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:20:27.888678 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 831/1704] 10.222.0.17 () {58 vars in 1301 bytes} [Sat Jul 23 21:20:27 2022] GET /compute/v2.1/servers/f53ce882-4694-421d-8075-5e8cfab0b16f/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:20:27.894322 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-90b8dbc2-2526-4b4d-aca2-4f38f8b5a9dd req-1e1ad196-9c7e-41a9-8abd-aa9b0138d8ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7558d52c-24e7-4115-88f7-ced193819c33", "name": "network-vif-deleted", "tag": "ba673080-c139-468a-94c4-8bd962f254a6"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:20:27.895722 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-45f3eff6-2997-4a75-aee7-2c59fe2a2200 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:27.896347 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-45f3eff6-2997-4a75-aee7-2c59fe2a2200 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] [instance: c1701f99-a44c-48ca-8946-b84c5e163cee] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:27.902737 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-45f3eff6-2997-4a75-aee7-2c59fe2a2200 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:27.903658 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-45f3eff6-2997-4a75-aee7-2c59fe2a2200 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:27.904753 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-45f3eff6-2997-4a75-aee7-2c59fe2a2200 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:27.905345 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-45f3eff6-2997-4a75-aee7-2c59fe2a2200 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:27.905612 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-90b8dbc2-2526-4b4d-aca2-4f38f8b5a9dd req-1e1ad196-9c7e-41a9-8abd-aa9b0138d8ee service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:27.907081 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-90b8dbc2-2526-4b4d-aca2-4f38f8b5a9dd req-1e1ad196-9c7e-41a9-8abd-aa9b0138d8ee service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:27.923089 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-90b8dbc2-2526-4b4d-aca2-4f38f8b5a9dd req-1e1ad196-9c7e-41a9-8abd-aa9b0138d8ee service nova] Creating event network-vif-deleted:ba673080-c139-468a-94c4-8bd962f254a6 for instance 7558d52c-24e7-4115-88f7-ced193819c33 on nch2-master-1 Jul 23 21:20:27.929487 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-90b8dbc2-2526-4b4d-aca2-4f38f8b5a9dd req-1e1ad196-9c7e-41a9-8abd-aa9b0138d8ee service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038987 Jul 23 21:20:27.933561 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 874/1705] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:20:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:20:28.078499 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-45f3eff6-2997-4a75-aee7-2c59fe2a2200 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80673ab800441b4bd1f5858e1df7b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629d02efac724fa29fcfff53e370b69b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:28.088079 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-45f3eff6-2997-4a75-aee7-2c59fe2a2200 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/servers/c1701f99-a44c-48ca-8946-b84c5e163cee" status: 200 len: 1276 microversion: 2.1 time: 0.198035 Jul 23 21:20:28.089648 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 832/1706] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:20:27 2022] GET /compute/v2.1/servers/c1701f99-a44c-48ca-8946-b84c5e163cee => generated 1276 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:20:28.100717 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0a9eaabb-ebe5-4069-94e7-060bdc882f41 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:28.101721 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-0a9eaabb-ebe5-4069-94e7-060bdc882f41 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] [instance: 3075a998-589a-474c-ac0a-3c53f63ab574] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:28.108835 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0a9eaabb-ebe5-4069-94e7-060bdc882f41 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:28.109512 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0a9eaabb-ebe5-4069-94e7-060bdc882f41 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:28.110089 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0a9eaabb-ebe5-4069-94e7-060bdc882f41 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:28.110532 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0a9eaabb-ebe5-4069-94e7-060bdc882f41 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:28.112129 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-eaf1178e-ae56-4701-a7ea-7e42a9e0bd92 tempest-ImagesMetadataNegativeTestJSON-1424991219 tempest-ImagesMetadataNegativeTestJSON-1424991219-project] Calling method '.version_select at 0x7f0b59ac2af0>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:28.138348 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-eaf1178e-ae56-4701-a7ea-7e42a9e0bd92 tempest-ImagesMetadataNegativeTestJSON-1424991219 tempest-ImagesMetadataNegativeTestJSON-1424991219-project] HTTP exception thrown: Image not found. Jul 23 21:20:28.143895 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-eaf1178e-ae56-4701-a7ea-7e42a9e0bd92 tempest-ImagesMetadataNegativeTestJSON-1424991219 tempest-ImagesMetadataNegativeTestJSON-1424991219-project] Request method failure captured: Jul 23 21:20:28.143895 ncdv-master-1 devstack@n-api.service[131321]: request: DELETE /compute/v2.1/images/f6ddd702-3a2d-4621-979e-40ed32fbf228/metadata/os_distro HTTP/1.1 Jul 23 21:20:28.143895 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:20:28.143895 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:20:28.143895 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:20:28.143895 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:20:28.143895 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:20:28.143895 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:20:28.143895 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:20:28.143895 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:20:28.143895 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GYbbUHlFyNuGStMTttD_IgJZ_wwYf-iE2r68tM9--tcLIkPc_aTiSJiuymcAOEALtmeJkaTeukVwBWJllCqAvpVrkMbTtvuo31scYKc5TImJvsDnpR10-hh5mXNR9QgueF5tcFaGukEHjSe3HhRsSvGVkHkJmgAxpte68AACJ-qR0s Jul 23 21:20:28.143895 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:20:28.143895 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:20:28.143895 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:20:28.143895 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:20:28.143895 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:20:28.143895 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:20:28.143895 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: bb233ab978c84af6a87b215076bf69dc Jul 23 21:20:28.143895 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1424991219 Jul 23 21:20:28.143895 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:20:28.143895 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:20:28.145681 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bb233ab978c84af6a87b215076bf69dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bb233ab978c84af6a87b215076bf69dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_bb233ab978c84af6a87b215076bf69dc", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/bb233ab978c84af6a87b215076bf69dc"}]}] Jul 23 21:20:28.145681 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1424991219 Jul 23 21:20:28.145681 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: bb233ab978c84af6a87b215076bf69dc Jul 23 21:20:28.145681 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1424991219 Jul 23 21:20:28.145681 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ImagesMetadataNegativeTestJSON-1424991219-project Jul 23 21:20:28.145681 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:20:28.145681 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:20:28.145681 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 5343731b8a9b466ebe93def3e4c50771 Jul 23 21:20:28.145681 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1424991219-project Jul 23 21:20:28.145681 ncdv-master-1 devstack@n-api.service[131321]: method: Jul 23 21:20:28.145681 ncdv-master-1 devstack@n-api.service[131321]: exception: Image not found. Jul 23 21:20:28.145681 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'image_id': 'f6ddd702-3a2d-4621-979e-40ed32fbf228', 'id': 'os_distro'} Jul 23 21:20:28.145681 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:20:28.146877 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:28.146877 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 23 21:20:28.146877 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 23 21:20:28.146877 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 23 21:20:28.146877 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 23 21:20:28.146877 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 23 21:20:28.146877 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 23 21:20:28.146877 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 23 21:20:28.146877 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 23 21:20:28.146877 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 23 21:20:28.146877 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 23 21:20:28.146877 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 23 21:20:28.146877 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 23 21:20:28.146877 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 23 21:20:28.146877 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 23 21:20:28.146877 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 23 21:20:28.146877 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 23 21:20:28.146877 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID f6ddd702-3a2d-4621-979e-40ed32fbf228 Jul 23 21:20:28.148224 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:20:28.148224 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:20:28.148224 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:20:28.148224 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:28.148224 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 23 21:20:28.148224 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 23 21:20:28.148224 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 23 21:20:28.148224 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 23 21:20:28.148224 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 23 21:20:28.148224 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 23 21:20:28.148224 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 23 21:20:28.148224 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 23 21:20:28.148224 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 23 21:20:28.148224 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 23 21:20:28.148224 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 23 21:20:28.148224 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 23 21:20:28.148224 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 23 21:20:28.148224 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 23 21:20:28.148224 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 23 21:20:28.148224 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 23 21:20:28.150180 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 23 21:20:28.150180 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 23 21:20:28.150180 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 23 21:20:28.150180 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 23 21:20:28.150180 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 23 21:20:28.150180 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 23 21:20:28.150180 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 23 21:20:28.150180 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 23 21:20:28.150180 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f6ddd702-3a2d-4621-979e-40ed32fbf228 could not be found. Jul 23 21:20:28.150180 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:20:28.150180 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:20:28.150180 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:20:28.150180 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:28.150180 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:20:28.150180 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:20:28.150180 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:20:28.150180 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:20:28.150180 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:20:28.150180 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:20:28.151710 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:20:28.151710 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:20:28.151710 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Jul 23 21:20:28.151710 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 23 21:20:28.151710 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 23 21:20:28.151710 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 23 21:20:28.151710 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 23 21:20:28.151710 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:20:28.151710 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:20:28.151710 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:20:28.151710 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:28.151710 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:20:28.151710 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:20:28.151710 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:20:28.151710 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:20:28.151710 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 23 21:20:28.151710 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:20:28.151710 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-eaf1178e-ae56-4701-a7ea-7e42a9e0bd92 tempest-ImagesMetadataNegativeTestJSON-1424991219 tempest-ImagesMetadataNegativeTestJSON-1424991219-project] Returning 404 to user: Image not found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:20:28.153138 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-eaf1178e-ae56-4701-a7ea-7e42a9e0bd92 tempest-ImagesMetadataNegativeTestJSON-1424991219 tempest-ImagesMetadataNegativeTestJSON-1424991219-project] 10.222.0.17 "DELETE /compute/v2.1/images/f6ddd702-3a2d-4621-979e-40ed32fbf228/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.213704 Jul 23 21:20:28.155020 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 875/1707] 10.222.0.17 () {58 vars in 1292 bytes} [Sat Jul 23 21:20:27 2022] DELETE /compute/v2.1/images/f6ddd702-3a2d-4621-979e-40ed32fbf228/metadata/os_distro => generated 62 bytes in 220 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 23 21:20:28.271443 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-0a9eaabb-ebe5-4069-94e7-060bdc882f41 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '194f98e3c86b48e9952fe02d3648beb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e165633a87b04bd9bc3f6e575f53fb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:28.283366 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-0a9eaabb-ebe5-4069-94e7-060bdc882f41 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] 10.222.0.17 "GET /compute/v2.1/servers/3075a998-589a-474c-ac0a-3c53f63ab574" status: 200 len: 1228 microversion: 2.1 time: 0.192111 Jul 23 21:20:28.284538 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 833/1708] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:20:28 2022] GET /compute/v2.1/servers/3075a998-589a-474c-ac0a-3c53f63ab574 => generated 1228 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:20:28.290783 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2d3e33fd-39a2-4b07-9808-0f652972cffc tempest-ImagesMetadataNegativeTestJSON-1424991219 tempest-ImagesMetadataNegativeTestJSON-1424991219-project] Calling method '.version_select at 0x7f0b59a95c10>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:28.304361 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-64df9685-35b4-41bb-aff4-bd4d119cdddf tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:20:28.306698 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-64df9685-35b4-41bb-aff4-bd4d119cdddf tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] [instance: d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:28.327550 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-64df9685-35b4-41bb-aff4-bd4d119cdddf tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:28.328263 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-64df9685-35b4-41bb-aff4-bd4d119cdddf tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:28.329243 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-64df9685-35b4-41bb-aff4-bd4d119cdddf tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:28.330093 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-64df9685-35b4-41bb-aff4-bd4d119cdddf tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:28.339392 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-2d3e33fd-39a2-4b07-9808-0f652972cffc tempest-ImagesMetadataNegativeTestJSON-1424991219 tempest-ImagesMetadataNegativeTestJSON-1424991219-project] HTTP exception thrown: Image not found. Jul 23 21:20:28.341833 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2d3e33fd-39a2-4b07-9808-0f652972cffc tempest-ImagesMetadataNegativeTestJSON-1424991219 tempest-ImagesMetadataNegativeTestJSON-1424991219-project] Request method failure captured: Jul 23 21:20:28.341833 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/images/046d961e-5519-48d5-a75e-605f63162cc3/metadata/os_version HTTP/1.1 Jul 23 21:20:28.341833 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:20:28.341833 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:20:28.341833 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:20:28.341833 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:20:28.341833 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:20:28.341833 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:20:28.341833 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:20:28.341833 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:20:28.341833 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GYbbUHlFyNuGStMTttD_IgJZ_wwYf-iE2r68tM9--tcLIkPc_aTiSJiuymcAOEALtmeJkaTeukVwBWJllCqAvpVrkMbTtvuo31scYKc5TImJvsDnpR10-hh5mXNR9QgueF5tcFaGukEHjSe3HhRsSvGVkHkJmgAxpte68AACJ-qR0s Jul 23 21:20:28.341833 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:20:28.341833 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:20:28.341833 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:20:28.341833 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:20:28.341833 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:20:28.341833 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:20:28.341833 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: bb233ab978c84af6a87b215076bf69dc Jul 23 21:20:28.341833 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1424991219 Jul 23 21:20:28.341833 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:20:28.341833 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:20:28.343478 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bb233ab978c84af6a87b215076bf69dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bb233ab978c84af6a87b215076bf69dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_bb233ab978c84af6a87b215076bf69dc", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/bb233ab978c84af6a87b215076bf69dc"}]}] Jul 23 21:20:28.343478 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1424991219 Jul 23 21:20:28.343478 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: bb233ab978c84af6a87b215076bf69dc Jul 23 21:20:28.343478 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1424991219 Jul 23 21:20:28.343478 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ImagesMetadataNegativeTestJSON-1424991219-project Jul 23 21:20:28.343478 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:20:28.343478 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:20:28.343478 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 5343731b8a9b466ebe93def3e4c50771 Jul 23 21:20:28.343478 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1424991219-project Jul 23 21:20:28.343478 ncdv-master-1 devstack@n-api.service[131320]: method: Jul 23 21:20:28.343478 ncdv-master-1 devstack@n-api.service[131320]: exception: Image not found. Jul 23 21:20:28.343478 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'image_id': '046d961e-5519-48d5-a75e-605f63162cc3', 'id': 'os_version'} Jul 23 21:20:28.343478 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:20:28.344377 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:28.344377 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 23 21:20:28.344377 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 23 21:20:28.344377 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 23 21:20:28.344377 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 23 21:20:28.344377 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 23 21:20:28.344377 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 23 21:20:28.344377 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 23 21:20:28.344377 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 23 21:20:28.344377 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 23 21:20:28.344377 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 23 21:20:28.344377 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 23 21:20:28.344377 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 23 21:20:28.344377 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 23 21:20:28.344377 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 23 21:20:28.344377 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 23 21:20:28.344377 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 23 21:20:28.344377 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 046d961e-5519-48d5-a75e-605f63162cc3 Jul 23 21:20:28.346452 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:20:28.346452 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:20:28.346452 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:20:28.346452 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:28.346452 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 23 21:20:28.346452 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 23 21:20:28.346452 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 23 21:20:28.346452 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 23 21:20:28.346452 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 23 21:20:28.346452 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 23 21:20:28.346452 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 23 21:20:28.346452 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 23 21:20:28.346452 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 23 21:20:28.346452 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 23 21:20:28.346452 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 23 21:20:28.346452 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 23 21:20:28.346452 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 23 21:20:28.346452 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 23 21:20:28.346452 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 23 21:20:28.346452 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 23 21:20:28.349074 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 23 21:20:28.349074 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 23 21:20:28.349074 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 23 21:20:28.349074 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 23 21:20:28.349074 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 23 21:20:28.349074 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 23 21:20:28.349074 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 23 21:20:28.349074 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 23 21:20:28.349074 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 046d961e-5519-48d5-a75e-605f63162cc3 could not be found. Jul 23 21:20:28.349074 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:20:28.349074 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:20:28.349074 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:20:28.349074 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:28.349074 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:20:28.349074 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:20:28.349074 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:20:28.349074 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:20:28.349074 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:20:28.349074 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:20:28.350620 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:20:28.350620 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:20:28.350620 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Jul 23 21:20:28.350620 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Jul 23 21:20:28.350620 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 23 21:20:28.350620 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 23 21:20:28.350620 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 23 21:20:28.350620 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:20:28.350620 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:20:28.350620 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:20:28.350620 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:28.350620 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:20:28.350620 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:20:28.350620 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:20:28.350620 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:20:28.350620 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 23 21:20:28.350620 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:20:28.354791 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2d3e33fd-39a2-4b07-9808-0f652972cffc tempest-ImagesMetadataNegativeTestJSON-1424991219 tempest-ImagesMetadataNegativeTestJSON-1424991219-project] Returning 404 to user: Image not found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:20:28.354791 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2d3e33fd-39a2-4b07-9808-0f652972cffc tempest-ImagesMetadataNegativeTestJSON-1424991219 tempest-ImagesMetadataNegativeTestJSON-1424991219-project] 10.222.0.17 "GET /compute/v2.1/images/046d961e-5519-48d5-a75e-605f63162cc3/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.067936 Jul 23 21:20:28.355398 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 834/1709] 10.222.0.17 () {58 vars in 1292 bytes} [Sat Jul 23 21:20:28 2022] GET /compute/v2.1/images/046d961e-5519-48d5-a75e-605f63162cc3/metadata/os_version => generated 62 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 23 21:20:28.365948 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1f3de745-9eef-4551-b594-7a870f3d119a tempest-ImagesMetadataNegativeTestJSON-1424991219 tempest-ImagesMetadataNegativeTestJSON-1424991219-project] Calling method '.version_select at 0x7f0b47d08790>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:28.390199 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-1f3de745-9eef-4551-b594-7a870f3d119a tempest-ImagesMetadataNegativeTestJSON-1424991219 tempest-ImagesMetadataNegativeTestJSON-1424991219-project] HTTP exception thrown: Image not found. Jul 23 21:20:28.392300 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1f3de745-9eef-4551-b594-7a870f3d119a tempest-ImagesMetadataNegativeTestJSON-1424991219 tempest-ImagesMetadataNegativeTestJSON-1424991219-project] Request method failure captured: Jul 23 21:20:28.392300 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/images/4a765560-fb5b-4964-b567-0c4017565fae/metadata HTTP/1.1 Jul 23 21:20:28.392300 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:20:28.392300 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:20:28.392300 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:20:28.392300 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:20:28.392300 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:20:28.392300 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:20:28.392300 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:20:28.392300 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:20:28.392300 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GYbbUHlFyNuGStMTttD_IgJZ_wwYf-iE2r68tM9--tcLIkPc_aTiSJiuymcAOEALtmeJkaTeukVwBWJllCqAvpVrkMbTtvuo31scYKc5TImJvsDnpR10-hh5mXNR9QgueF5tcFaGukEHjSe3HhRsSvGVkHkJmgAxpte68AACJ-qR0s Jul 23 21:20:28.392300 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:20:28.392300 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:20:28.392300 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:20:28.392300 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:20:28.392300 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:20:28.392300 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:20:28.392300 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: bb233ab978c84af6a87b215076bf69dc Jul 23 21:20:28.392300 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1424991219 Jul 23 21:20:28.392300 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:20:28.392300 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:20:28.394139 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bb233ab978c84af6a87b215076bf69dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bb233ab978c84af6a87b215076bf69dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_bb233ab978c84af6a87b215076bf69dc", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/bb233ab978c84af6a87b215076bf69dc"}]}] Jul 23 21:20:28.394139 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1424991219 Jul 23 21:20:28.394139 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: bb233ab978c84af6a87b215076bf69dc Jul 23 21:20:28.394139 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1424991219 Jul 23 21:20:28.394139 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ImagesMetadataNegativeTestJSON-1424991219-project Jul 23 21:20:28.394139 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:20:28.394139 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:20:28.394139 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 5343731b8a9b466ebe93def3e4c50771 Jul 23 21:20:28.394139 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1424991219-project Jul 23 21:20:28.394139 ncdv-master-1 devstack@n-api.service[131320]: method: Jul 23 21:20:28.394139 ncdv-master-1 devstack@n-api.service[131320]: exception: Image not found. Jul 23 21:20:28.394139 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'image_id': '4a765560-fb5b-4964-b567-0c4017565fae'} Jul 23 21:20:28.394139 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:20:28.395119 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:28.395119 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 23 21:20:28.395119 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 23 21:20:28.395119 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 23 21:20:28.395119 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 23 21:20:28.395119 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 23 21:20:28.395119 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 23 21:20:28.395119 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 23 21:20:28.395119 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 23 21:20:28.395119 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 23 21:20:28.395119 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 23 21:20:28.395119 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 23 21:20:28.395119 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 23 21:20:28.395119 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 23 21:20:28.395119 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 23 21:20:28.395119 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 23 21:20:28.395119 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 23 21:20:28.395119 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 4a765560-fb5b-4964-b567-0c4017565fae Jul 23 21:20:28.397978 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:20:28.397978 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:20:28.397978 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:20:28.397978 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:28.397978 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 23 21:20:28.397978 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 23 21:20:28.397978 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 23 21:20:28.397978 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 23 21:20:28.397978 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 23 21:20:28.397978 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 23 21:20:28.397978 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 23 21:20:28.397978 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 23 21:20:28.397978 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 23 21:20:28.397978 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 23 21:20:28.397978 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 23 21:20:28.397978 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 23 21:20:28.397978 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 23 21:20:28.397978 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 23 21:20:28.397978 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 23 21:20:28.397978 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 23 21:20:28.400631 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 23 21:20:28.400631 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 23 21:20:28.400631 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 23 21:20:28.400631 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 23 21:20:28.400631 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 23 21:20:28.400631 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 23 21:20:28.400631 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 23 21:20:28.400631 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 23 21:20:28.400631 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4a765560-fb5b-4964-b567-0c4017565fae could not be found. Jul 23 21:20:28.400631 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:20:28.400631 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:20:28.400631 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:20:28.400631 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:28.400631 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:20:28.400631 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:20:28.400631 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:20:28.400631 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:20:28.400631 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:20:28.400631 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:20:28.403499 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:20:28.403499 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:20:28.403499 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Jul 23 21:20:28.403499 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Jul 23 21:20:28.403499 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 23 21:20:28.403499 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 23 21:20:28.403499 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 23 21:20:28.403499 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:20:28.403499 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:20:28.403499 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:20:28.403499 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:28.403499 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:20:28.403499 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:20:28.403499 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:20:28.403499 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:20:28.403499 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 23 21:20:28.403499 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:20:28.403499 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1f3de745-9eef-4551-b594-7a870f3d119a tempest-ImagesMetadataNegativeTestJSON-1424991219 tempest-ImagesMetadataNegativeTestJSON-1424991219-project] Returning 404 to user: Image not found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:20:28.404710 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1f3de745-9eef-4551-b594-7a870f3d119a tempest-ImagesMetadataNegativeTestJSON-1424991219 tempest-ImagesMetadataNegativeTestJSON-1424991219-project] 10.222.0.17 "GET /compute/v2.1/images/4a765560-fb5b-4964-b567-0c4017565fae/metadata" status: 404 len: 62 microversion: 2.1 time: 0.039516 Jul 23 21:20:28.404710 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 835/1710] 10.222.0.17 () {58 vars in 1259 bytes} [Sat Jul 23 21:20:28 2022] GET /compute/v2.1/images/4a765560-fb5b-4964-b567-0c4017565fae/metadata => generated 62 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 23 21:20:28.413359 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8aeebe70-b23f-4279-bacb-82b00d916e03 tempest-ImagesMetadataNegativeTestJSON-1424991219 tempest-ImagesMetadataNegativeTestJSON-1424991219-project] Action: 'update_all', calling method: .version_select at 0x7f0b47d129d0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:20:28.426171 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-64df9685-35b4-41bb-aff4-bd4d119cdddf tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Flavor limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:20:28.426614 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-64df9685-35b4-41bb-aff4-bd4d119cdddf tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Image limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:20:28.427090 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-64df9685-35b4-41bb-aff4-bd4d119cdddf tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Flavor pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:20:28.428192 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-64df9685-35b4-41bb-aff4-bd4d119cdddf tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Image pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:20:28.428827 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-64df9685-35b4-41bb-aff4-bd4d119cdddf tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:20:28.435972 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-8aeebe70-b23f-4279-bacb-82b00d916e03 tempest-ImagesMetadataNegativeTestJSON-1424991219 tempest-ImagesMetadataNegativeTestJSON-1424991219-project] HTTP exception thrown: Image not found. Jul 23 21:20:28.438304 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8aeebe70-b23f-4279-bacb-82b00d916e03 tempest-ImagesMetadataNegativeTestJSON-1424991219 tempest-ImagesMetadataNegativeTestJSON-1424991219-project] Request method failure captured: Jul 23 21:20:28.438304 ncdv-master-1 devstack@n-api.service[131320]: request: PUT /compute/v2.1/images/be9749e0-f13a-4701-8cdc-8b58f9031ba4/metadata HTTP/1.1 Jul 23 21:20:28.438304 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:20:28.438304 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:20:28.438304 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:20:28.438304 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 57 Jul 23 21:20:28.438304 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:20:28.438304 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:20:28.438304 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:20:28.438304 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:20:28.438304 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GYbbUHlFyNuGStMTttD_IgJZ_wwYf-iE2r68tM9--tcLIkPc_aTiSJiuymcAOEALtmeJkaTeukVwBWJllCqAvpVrkMbTtvuo31scYKc5TImJvsDnpR10-hh5mXNR9QgueF5tcFaGukEHjSe3HhRsSvGVkHkJmgAxpte68AACJ-qR0s Jul 23 21:20:28.438304 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:20:28.438304 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:20:28.438304 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:20:28.438304 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:20:28.438304 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:20:28.438304 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:20:28.438304 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: bb233ab978c84af6a87b215076bf69dc Jul 23 21:20:28.438304 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1424991219 Jul 23 21:20:28.438304 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:20:28.438304 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:20:28.439775 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bb233ab978c84af6a87b215076bf69dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bb233ab978c84af6a87b215076bf69dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_bb233ab978c84af6a87b215076bf69dc", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/bb233ab978c84af6a87b215076bf69dc"}]}] Jul 23 21:20:28.439775 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1424991219 Jul 23 21:20:28.439775 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: bb233ab978c84af6a87b215076bf69dc Jul 23 21:20:28.439775 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1424991219 Jul 23 21:20:28.439775 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ImagesMetadataNegativeTestJSON-1424991219-project Jul 23 21:20:28.439775 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:20:28.439775 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:20:28.439775 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 5343731b8a9b466ebe93def3e4c50771 Jul 23 21:20:28.439775 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1424991219-project Jul 23 21:20:28.439775 ncdv-master-1 devstack@n-api.service[131320]: Jul 23 21:20:28.439775 ncdv-master-1 devstack@n-api.service[131320]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Jul 23 21:20:28.439775 ncdv-master-1 devstack@n-api.service[131320]: method: Jul 23 21:20:28.439775 ncdv-master-1 devstack@n-api.service[131320]: exception: Image not found. Jul 23 21:20:28.439775 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'image_id': 'be9749e0-f13a-4701-8cdc-8b58f9031ba4', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Jul 23 21:20:28.440768 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:20:28.440768 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:28.440768 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 23 21:20:28.440768 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 23 21:20:28.440768 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 23 21:20:28.440768 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 23 21:20:28.440768 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 23 21:20:28.440768 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 23 21:20:28.440768 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 23 21:20:28.440768 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 23 21:20:28.440768 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 23 21:20:28.440768 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 23 21:20:28.440768 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 23 21:20:28.440768 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 23 21:20:28.440768 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 23 21:20:28.440768 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 23 21:20:28.440768 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 23 21:20:28.440768 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 23 21:20:28.442102 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID be9749e0-f13a-4701-8cdc-8b58f9031ba4 Jul 23 21:20:28.442102 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:20:28.442102 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:20:28.442102 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:20:28.442102 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:28.442102 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 23 21:20:28.442102 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 23 21:20:28.442102 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 23 21:20:28.442102 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 23 21:20:28.442102 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 23 21:20:28.442102 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 23 21:20:28.442102 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 23 21:20:28.442102 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 23 21:20:28.442102 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 23 21:20:28.442102 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 23 21:20:28.442102 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 23 21:20:28.442102 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 23 21:20:28.442102 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 23 21:20:28.442102 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 23 21:20:28.443378 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 23 21:20:28.443378 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 23 21:20:28.443378 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 23 21:20:28.443378 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 23 21:20:28.443378 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 23 21:20:28.443378 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 23 21:20:28.443378 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 23 21:20:28.443378 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 23 21:20:28.443378 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 23 21:20:28.443378 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 23 21:20:28.443378 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image be9749e0-f13a-4701-8cdc-8b58f9031ba4 could not be found. Jul 23 21:20:28.443378 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:20:28.443378 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:20:28.443378 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:20:28.443378 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:28.443378 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:20:28.443378 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:20:28.443378 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:20:28.443378 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:20:28.444637 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:20:28.444637 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:20:28.444637 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:20:28.444637 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:20:28.444637 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:20:28.444637 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:20:28.444637 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Jul 23 21:20:28.444637 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 23 21:20:28.444637 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 23 21:20:28.444637 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 23 21:20:28.444637 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 23 21:20:28.444637 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:20:28.444637 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:20:28.444637 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:20:28.444637 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:28.444637 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:20:28.444637 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:20:28.444637 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:20:28.444637 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:20:28.444637 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 23 21:20:28.444637 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:20:28.447231 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8aeebe70-b23f-4279-bacb-82b00d916e03 tempest-ImagesMetadataNegativeTestJSON-1424991219 tempest-ImagesMetadataNegativeTestJSON-1424991219-project] Returning 404 to user: Image not found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:20:28.447231 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8aeebe70-b23f-4279-bacb-82b00d916e03 tempest-ImagesMetadataNegativeTestJSON-1424991219 tempest-ImagesMetadataNegativeTestJSON-1424991219-project] 10.222.0.17 "PUT /compute/v2.1/images/be9749e0-f13a-4701-8cdc-8b58f9031ba4/metadata" status: 404 len: 62 microversion: 2.1 time: 0.034829 Jul 23 21:20:28.450611 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 836/1711] 10.222.0.17 () {60 vars in 1279 bytes} [Sat Jul 23 21:20:28 2022] PUT /compute/v2.1/images/be9749e0-f13a-4701-8cdc-8b58f9031ba4/metadata => generated 62 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 23 21:20:28.456672 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f33032c1-493a-4e30-a15b-e6338710f30c tempest-ImagesMetadataNegativeTestJSON-1424991219 tempest-ImagesMetadataNegativeTestJSON-1424991219-project] Action: 'update', calling method: .version_select at 0x7f0b47dc2dc0>, body: {"meta": {"os_distro": "alt"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:20:28.492936 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-f33032c1-493a-4e30-a15b-e6338710f30c tempest-ImagesMetadataNegativeTestJSON-1424991219 tempest-ImagesMetadataNegativeTestJSON-1424991219-project] HTTP exception thrown: Image not found. Jul 23 21:20:28.494471 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f33032c1-493a-4e30-a15b-e6338710f30c tempest-ImagesMetadataNegativeTestJSON-1424991219 tempest-ImagesMetadataNegativeTestJSON-1424991219-project] Request method failure captured: Jul 23 21:20:28.494471 ncdv-master-1 devstack@n-api.service[131320]: request: PUT /compute/v2.1/images/57652b9f-e744-4f2b-8b62-d14fbb0b419b/metadata/os_distro HTTP/1.1 Jul 23 21:20:28.494471 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:20:28.494471 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:20:28.494471 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:20:28.494471 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 30 Jul 23 21:20:28.494471 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:20:28.494471 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:20:28.494471 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:20:28.494471 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:20:28.494471 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GYbbUHlFyNuGStMTttD_IgJZ_wwYf-iE2r68tM9--tcLIkPc_aTiSJiuymcAOEALtmeJkaTeukVwBWJllCqAvpVrkMbTtvuo31scYKc5TImJvsDnpR10-hh5mXNR9QgueF5tcFaGukEHjSe3HhRsSvGVkHkJmgAxpte68AACJ-qR0s Jul 23 21:20:28.494471 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:20:28.494471 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:20:28.494471 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:20:28.494471 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:20:28.494471 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:20:28.494471 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:20:28.494471 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: bb233ab978c84af6a87b215076bf69dc Jul 23 21:20:28.494471 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1424991219 Jul 23 21:20:28.494471 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:20:28.494471 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:20:28.496005 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bb233ab978c84af6a87b215076bf69dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bb233ab978c84af6a87b215076bf69dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_bb233ab978c84af6a87b215076bf69dc", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/bb233ab978c84af6a87b215076bf69dc"}]}] Jul 23 21:20:28.496005 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1424991219 Jul 23 21:20:28.496005 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: bb233ab978c84af6a87b215076bf69dc Jul 23 21:20:28.496005 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1424991219 Jul 23 21:20:28.496005 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ImagesMetadataNegativeTestJSON-1424991219-project Jul 23 21:20:28.496005 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:20:28.496005 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:20:28.496005 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 5343731b8a9b466ebe93def3e4c50771 Jul 23 21:20:28.496005 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1424991219-project Jul 23 21:20:28.496005 ncdv-master-1 devstack@n-api.service[131320]: Jul 23 21:20:28.496005 ncdv-master-1 devstack@n-api.service[131320]: {"meta": {"os_distro": "alt"}} Jul 23 21:20:28.496005 ncdv-master-1 devstack@n-api.service[131320]: method: Jul 23 21:20:28.496005 ncdv-master-1 devstack@n-api.service[131320]: exception: Image not found. Jul 23 21:20:28.496005 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'image_id': '57652b9f-e744-4f2b-8b62-d14fbb0b419b', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Jul 23 21:20:28.496962 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:20:28.496962 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:28.496962 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 23 21:20:28.496962 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 23 21:20:28.496962 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 23 21:20:28.496962 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 23 21:20:28.496962 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 23 21:20:28.496962 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 23 21:20:28.496962 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 23 21:20:28.496962 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 23 21:20:28.496962 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 23 21:20:28.496962 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 23 21:20:28.496962 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 23 21:20:28.496962 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 23 21:20:28.496962 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 23 21:20:28.496962 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 23 21:20:28.496962 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 23 21:20:28.496962 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 23 21:20:28.498583 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 57652b9f-e744-4f2b-8b62-d14fbb0b419b Jul 23 21:20:28.498583 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:20:28.498583 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:20:28.498583 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:20:28.498583 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:28.498583 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 23 21:20:28.498583 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 23 21:20:28.498583 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 23 21:20:28.498583 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 23 21:20:28.498583 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 23 21:20:28.498583 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 23 21:20:28.498583 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 23 21:20:28.498583 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 23 21:20:28.498583 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 23 21:20:28.498583 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 23 21:20:28.498583 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 23 21:20:28.498583 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 23 21:20:28.498583 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 23 21:20:28.498583 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 23 21:20:28.501817 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 23 21:20:28.501817 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 23 21:20:28.501817 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 23 21:20:28.501817 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 23 21:20:28.501817 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 23 21:20:28.501817 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 23 21:20:28.501817 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 23 21:20:28.501817 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 23 21:20:28.501817 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 23 21:20:28.501817 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 23 21:20:28.501817 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 57652b9f-e744-4f2b-8b62-d14fbb0b419b could not be found. Jul 23 21:20:28.501817 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:20:28.501817 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:20:28.501817 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:20:28.501817 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:28.501817 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:20:28.501817 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:20:28.501817 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:20:28.501817 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:20:28.504306 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:20:28.504306 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:20:28.504306 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:20:28.504306 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:20:28.504306 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:20:28.504306 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:20:28.504306 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Jul 23 21:20:28.504306 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 23 21:20:28.504306 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 23 21:20:28.504306 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 23 21:20:28.504306 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 23 21:20:28.504306 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:20:28.504306 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:20:28.504306 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:20:28.504306 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:28.504306 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:20:28.504306 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:20:28.504306 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:20:28.504306 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:20:28.504306 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 23 21:20:28.504306 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:20:28.507929 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f33032c1-493a-4e30-a15b-e6338710f30c tempest-ImagesMetadataNegativeTestJSON-1424991219 tempest-ImagesMetadataNegativeTestJSON-1424991219-project] Returning 404 to user: Image not found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:20:28.507929 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f33032c1-493a-4e30-a15b-e6338710f30c tempest-ImagesMetadataNegativeTestJSON-1424991219 tempest-ImagesMetadataNegativeTestJSON-1424991219-project] 10.222.0.17 "PUT /compute/v2.1/images/57652b9f-e744-4f2b-8b62-d14fbb0b419b/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.043505 Jul 23 21:20:28.507929 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 837/1712] 10.222.0.17 () {60 vars in 1309 bytes} [Sat Jul 23 21:20:28 2022] PUT /compute/v2.1/images/57652b9f-e744-4f2b-8b62-d14fbb0b419b/metadata/os_distro => generated 62 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 23 21:20:28.507929 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-24d6bb29-65df-4c6e-b44e-4416a7dd6636 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:28.507929 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-24d6bb29-65df-4c6e-b44e-4416a7dd6636 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:28.511667 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-64df9685-35b4-41bb-aff4-bd4d119cdddf tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] [instance: d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:28.517973 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-64df9685-35b4-41bb-aff4-bd4d119cdddf tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:28.518808 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-64df9685-35b4-41bb-aff4-bd4d119cdddf tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:28.519670 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-64df9685-35b4-41bb-aff4-bd4d119cdddf tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:28.520186 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-64df9685-35b4-41bb-aff4-bd4d119cdddf tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:28.528954 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-24d6bb29-65df-4c6e-b44e-4416a7dd6636 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:28.530003 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-24d6bb29-65df-4c6e-b44e-4416a7dd6636 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:28.531683 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-24d6bb29-65df-4c6e-b44e-4416a7dd6636 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:28.532379 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-24d6bb29-65df-4c6e-b44e-4416a7dd6636 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:28.737999 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.objects.instance [None req-64df9685-35b4-41bb-aff4-bd4d119cdddf tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lazy-loading 'services' on Instance uuid d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a {{(pid=131321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:20:28.776299 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-64df9685-35b4-41bb-aff4-bd4d119cdddf tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a/action" status: 202 len: 1940 microversion: 2.75 time: 0.620840 Jul 23 21:20:28.777409 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 876/1713] 10.222.0.17 () {62 vars in 1318 bytes} [Sat Jul 23 21:20:28 2022] POST /compute/v2.1/servers/d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a/action => generated 1940 bytes in 623 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 23 21:20:28.793904 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-77417041-0235-4796-a0ea-8a64fe58fa55 tempest-ImagesMetadataNegativeTestJSON-1424991219 tempest-ImagesMetadataNegativeTestJSON-1424991219-project] Action: 'create', calling method: .version_select at 0x7f0b542c5f70>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:20:28.834704 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-77417041-0235-4796-a0ea-8a64fe58fa55 tempest-ImagesMetadataNegativeTestJSON-1424991219 tempest-ImagesMetadataNegativeTestJSON-1424991219-project] HTTP exception thrown: Image not found. Jul 23 21:20:28.837965 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-77417041-0235-4796-a0ea-8a64fe58fa55 tempest-ImagesMetadataNegativeTestJSON-1424991219 tempest-ImagesMetadataNegativeTestJSON-1424991219-project] Request method failure captured: Jul 23 21:20:28.837965 ncdv-master-1 devstack@n-api.service[131321]: request: POST /compute/v2.1/images/84da753a-e1e9-4874-8e15-c988dda8279c/metadata HTTP/1.1 Jul 23 21:20:28.837965 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:20:28.837965 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:20:28.837965 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:20:28.837965 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 57 Jul 23 21:20:28.837965 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:20:28.837965 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:20:28.837965 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:20:28.837965 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:20:28.837965 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GYbbUHlFyNuGStMTttD_IgJZ_wwYf-iE2r68tM9--tcLIkPc_aTiSJiuymcAOEALtmeJkaTeukVwBWJllCqAvpVrkMbTtvuo31scYKc5TImJvsDnpR10-hh5mXNR9QgueF5tcFaGukEHjSe3HhRsSvGVkHkJmgAxpte68AACJ-qR0s Jul 23 21:20:28.837965 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:20:28.837965 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:20:28.837965 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:20:28.837965 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:20:28.837965 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:20:28.837965 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:20:28.837965 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: bb233ab978c84af6a87b215076bf69dc Jul 23 21:20:28.837965 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1424991219 Jul 23 21:20:28.837965 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:20:28.837965 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:20:28.839568 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bb233ab978c84af6a87b215076bf69dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/bb233ab978c84af6a87b215076bf69dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_bb233ab978c84af6a87b215076bf69dc", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/bb233ab978c84af6a87b215076bf69dc"}]}] Jul 23 21:20:28.839568 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1424991219 Jul 23 21:20:28.839568 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: bb233ab978c84af6a87b215076bf69dc Jul 23 21:20:28.839568 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1424991219 Jul 23 21:20:28.839568 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ImagesMetadataNegativeTestJSON-1424991219-project Jul 23 21:20:28.839568 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:20:28.839568 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:20:28.839568 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 5343731b8a9b466ebe93def3e4c50771 Jul 23 21:20:28.839568 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1424991219-project Jul 23 21:20:28.839568 ncdv-master-1 devstack@n-api.service[131321]: Jul 23 21:20:28.839568 ncdv-master-1 devstack@n-api.service[131321]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Jul 23 21:20:28.839568 ncdv-master-1 devstack@n-api.service[131321]: method: Jul 23 21:20:28.839568 ncdv-master-1 devstack@n-api.service[131321]: exception: Image not found. Jul 23 21:20:28.839568 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'image_id': '84da753a-e1e9-4874-8e15-c988dda8279c', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Jul 23 21:20:28.840542 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:20:28.840542 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:28.840542 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 23 21:20:28.840542 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 23 21:20:28.840542 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 23 21:20:28.840542 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 23 21:20:28.840542 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 23 21:20:28.840542 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 23 21:20:28.840542 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 23 21:20:28.840542 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 23 21:20:28.840542 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 23 21:20:28.840542 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 23 21:20:28.840542 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 23 21:20:28.840542 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 23 21:20:28.840542 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 23 21:20:28.840542 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 23 21:20:28.840542 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 23 21:20:28.840542 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 23 21:20:28.841901 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 84da753a-e1e9-4874-8e15-c988dda8279c Jul 23 21:20:28.841901 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:20:28.841901 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:20:28.841901 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:20:28.841901 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:28.841901 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 23 21:20:28.841901 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 23 21:20:28.841901 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 23 21:20:28.841901 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 23 21:20:28.841901 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 23 21:20:28.841901 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 23 21:20:28.841901 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 23 21:20:28.841901 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 23 21:20:28.841901 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 23 21:20:28.841901 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 23 21:20:28.841901 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 23 21:20:28.841901 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 23 21:20:28.841901 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 23 21:20:28.841901 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 23 21:20:28.843253 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 23 21:20:28.843253 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 23 21:20:28.843253 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 23 21:20:28.843253 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 23 21:20:28.843253 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 23 21:20:28.843253 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 23 21:20:28.843253 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 23 21:20:28.843253 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 23 21:20:28.843253 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 23 21:20:28.843253 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 23 21:20:28.843253 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 84da753a-e1e9-4874-8e15-c988dda8279c could not be found. Jul 23 21:20:28.843253 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:20:28.843253 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:20:28.843253 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:20:28.843253 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:28.843253 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:20:28.843253 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:20:28.843253 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:20:28.843253 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:20:28.844525 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:20:28.844525 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:20:28.844525 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:20:28.844525 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:20:28.844525 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:20:28.844525 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:20:28.844525 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Jul 23 21:20:28.844525 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 23 21:20:28.844525 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 23 21:20:28.844525 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 23 21:20:28.844525 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 23 21:20:28.844525 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:20:28.844525 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:20:28.844525 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:20:28.844525 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:28.844525 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:20:28.844525 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:20:28.844525 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:20:28.844525 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:20:28.844525 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 23 21:20:28.844525 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:20:28.847616 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-77417041-0235-4796-a0ea-8a64fe58fa55 tempest-ImagesMetadataNegativeTestJSON-1424991219 tempest-ImagesMetadataNegativeTestJSON-1424991219-project] Returning 404 to user: Image not found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:20:28.848732 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-77417041-0235-4796-a0ea-8a64fe58fa55 tempest-ImagesMetadataNegativeTestJSON-1424991219 tempest-ImagesMetadataNegativeTestJSON-1424991219-project] 10.222.0.17 "POST /compute/v2.1/images/84da753a-e1e9-4874-8e15-c988dda8279c/metadata" status: 404 len: 62 microversion: 2.1 time: 0.069843 Jul 23 21:20:28.855053 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 877/1714] 10.222.0.17 () {60 vars in 1280 bytes} [Sat Jul 23 21:20:28 2022] POST /compute/v2.1/images/84da753a-e1e9-4874-8e15-c988dda8279c/metadata => generated 62 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 23 21:20:28.859365 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f986a210-4cf0-402a-9cf5-aef067777880 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:28.860876 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-f986a210-4cf0-402a-9cf5-aef067777880 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] [instance: d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:28.919729 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f986a210-4cf0-402a-9cf5-aef067777880 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:28.920263 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f986a210-4cf0-402a-9cf5-aef067777880 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:28.926119 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f986a210-4cf0-402a-9cf5-aef067777880 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:28.928298 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f986a210-4cf0-402a-9cf5-aef067777880 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:29.108460 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.objects.instance [None req-f986a210-4cf0-402a-9cf5-aef067777880 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lazy-loading 'services' on Instance uuid d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a {{(pid=131321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:20:29.156272 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-f986a210-4cf0-402a-9cf5-aef067777880 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a" status: 200 len: 1927 microversion: 2.75 time: 0.304971 Jul 23 21:20:29.157742 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 878/1715] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:20:28 2022] GET /compute/v2.1/servers/d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a => generated 1927 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:20:29.165894 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-4548bf8b-2b1e-4c7a-a890-592ce014c57f tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:29.167011 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-4548bf8b-2b1e-4c7a-a890-592ce014c57f tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: 7558d52c-24e7-4115-88f7-ced193819c33] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:29.173559 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4548bf8b-2b1e-4c7a-a890-592ce014c57f tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:29.174291 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4548bf8b-2b1e-4c7a-a890-592ce014c57f tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:29.175183 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4548bf8b-2b1e-4c7a-a890-592ce014c57f tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:29.175719 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4548bf8b-2b1e-4c7a-a890-592ce014c57f tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:29.192012 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-4548bf8b-2b1e-4c7a-a890-592ce014c57f tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] HTTP exception thrown: Instance 7558d52c-24e7-4115-88f7-ced193819c33 could not be found. Jul 23 21:20:29.194172 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-4548bf8b-2b1e-4c7a-a890-592ce014c57f tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Request method failure captured: Jul 23 21:20:29.194172 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/servers/7558d52c-24e7-4115-88f7-ced193819c33 HTTP/1.1 Jul 23 21:20:29.194172 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:20:29.194172 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:20:29.194172 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:20:29.194172 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:20:29.194172 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:20:29.194172 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:20:29.194172 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:20:29.194172 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:20:29.194172 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GS1JPLCtSl4zlOvUAdW9qDCNvk9KgpAVaHDeDRdhrd5Unc5Jp4VYHiNMr-F0SeJb5CAVBa8vOn03Mdw949XFb_Q9VjvG7WvGRUo-tTRXmW46puqpgRzM_AekQVJ5U4r0msCtB-HRCdhS2W_NBYLeuQ68VDyS01pFaHOoQppmHMvtMQ Jul 23 21:20:29.194172 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:20:29.194172 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:20:29.194172 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:20:29.194172 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:20:29.194172 ncdv-master-1 devstack@n-api.service[131321]: X-Openstack-Nova-Api-Version: 2.25 Jul 23 21:20:29.194172 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:20:29.194172 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:20:29.194172 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: b347973dfb204484bdb87ab0094dbe22 Jul 23 21:20:29.194172 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-2065000324 Jul 23 21:20:29.194172 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:20:29.194172 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:20:29.195819 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b347973dfb204484bdb87ab0094dbe22"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b347973dfb204484bdb87ab0094dbe22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b347973dfb204484bdb87ab0094dbe22", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b347973dfb204484bdb87ab0094dbe22"}]}] Jul 23 21:20:29.195819 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-2065000324 Jul 23 21:20:29.195819 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: b347973dfb204484bdb87ab0094dbe22 Jul 23 21:20:29.195819 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-2065000324 Jul 23 21:20:29.195819 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-LiveAutoBlockMigrationV225Test-2065000324-project Jul 23 21:20:29.195819 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:20:29.195819 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:20:29.195819 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 3a56b82cf3954f279dd21e17a42462b3 Jul 23 21:20:29.195819 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-2065000324-project Jul 23 21:20:29.195819 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:20:29.195819 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance 7558d52c-24e7-4115-88f7-ced193819c33 could not be found. Jul 23 21:20:29.195819 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': '7558d52c-24e7-4115-88f7-ced193819c33'} Jul 23 21:20:29.196693 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:20:29.196693 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:29.196693 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:20:29.196693 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:20:29.196693 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:20:29.196693 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:20:29.196693 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:20:29.196693 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:20:29.196693 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:20:29.196693 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:20:29.196693 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7558d52c-24e7-4115-88f7-ced193819c33 could not be found. Jul 23 21:20:29.196693 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:20:29.196693 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:20:29.196693 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:20:29.196693 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:29.196693 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:20:29.196693 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:20:29.196693 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:20:29.196693 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:20:29.196693 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:20:29.198189 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:20:29.198189 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:20:29.198189 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:20:29.198189 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:20:29.198189 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:20:29.198189 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:20:29.198189 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:20:29.198189 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7558d52c-24e7-4115-88f7-ced193819c33 could not be found. Jul 23 21:20:29.198189 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:20:29.198189 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:20:29.198189 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:20:29.198189 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:29.198189 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:20:29.198189 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:20:29.198189 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:20:29.198189 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:20:29.198189 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7558d52c-24e7-4115-88f7-ced193819c33 could not be found. Jul 23 21:20:29.198189 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:20:29.201231 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-4548bf8b-2b1e-4c7a-a890-592ce014c57f tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Returning 404 to user: Instance 7558d52c-24e7-4115-88f7-ced193819c33 could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:20:29.202462 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-4548bf8b-2b1e-4c7a-a890-592ce014c57f tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/7558d52c-24e7-4115-88f7-ced193819c33" status: 404 len: 111 microversion: 2.25 time: 0.043339 Jul 23 21:20:29.203604 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 879/1716] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:20:29 2022] GET /compute/v2.1/servers/7558d52c-24e7-4115-88f7-ced193819c33 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 23 21:20:29.209783 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-3bfd0cec-e147-4a09-ae27-179c0736325d tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:29.212718 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-3bfd0cec-e147-4a09-ae27-179c0736325d tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:29.223884 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3bfd0cec-e147-4a09-ae27-179c0736325d tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:29.225210 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3bfd0cec-e147-4a09-ae27-179c0736325d tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:29.227641 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3bfd0cec-e147-4a09-ae27-179c0736325d tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:29.230838 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3bfd0cec-e147-4a09-ae27-179c0736325d tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:29.359195 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-24d6bb29-65df-4c6e-b44e-4416a7dd6636 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:29.373316 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-24d6bb29-65df-4c6e-b44e-4416a7dd6636 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:29.382022 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-24d6bb29-65df-4c6e-b44e-4416a7dd6636 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:29.383252 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-24d6bb29-65df-4c6e-b44e-4416a7dd6636 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1874 microversion: 2.42 time: 0.885902 Jul 23 21:20:29.383820 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 838/1717] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:20:28 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1874 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:20:29.388760 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-40a08ab3-6029-430d-9113-735f0a4c9501 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:29.389768 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-40a08ab3-6029-430d-9113-735f0a4c9501 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] [instance: f53ce882-4694-421d-8075-5e8cfab0b16f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:29.396655 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-40a08ab3-6029-430d-9113-735f0a4c9501 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:29.397555 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-40a08ab3-6029-430d-9113-735f0a4c9501 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:29.397951 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-40a08ab3-6029-430d-9113-735f0a4c9501 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:29.398547 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-40a08ab3-6029-430d-9113-735f0a4c9501 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:29.432870 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-40a08ab3-6029-430d-9113-735f0a4c9501 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] 10.222.0.17 "GET /compute/v2.1/servers/f53ce882-4694-421d-8075-5e8cfab0b16f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047845 Jul 23 21:20:29.434434 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 839/1718] 10.222.0.17 () {58 vars in 1301 bytes} [Sat Jul 23 21:20:29 2022] GET /compute/v2.1/servers/f53ce882-4694-421d-8075-5e8cfab0b16f/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 23 21:20:29.440584 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-bbabdab2-b267-4613-b277-16009fa54cb8 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:29.441665 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-bbabdab2-b267-4613-b277-16009fa54cb8 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] [instance: c1701f99-a44c-48ca-8946-b84c5e163cee] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:29.449923 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bbabdab2-b267-4613-b277-16009fa54cb8 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:29.450802 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bbabdab2-b267-4613-b277-16009fa54cb8 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:29.463593 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bbabdab2-b267-4613-b277-16009fa54cb8 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:29.464493 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bbabdab2-b267-4613-b277-16009fa54cb8 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:29.469106 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-3bfd0cec-e147-4a09-ae27-179c0736325d tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:29.486906 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-3bfd0cec-e147-4a09-ae27-179c0736325d tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b" status: 200 len: 1485 microversion: 2.1 time: 0.280421 Jul 23 21:20:29.489049 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 880/1719] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:20:29 2022] GET /compute/v2.1/servers/d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b => generated 1485 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:20:29.512236 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-8b83f747-39e2-4dbf-929e-9bd937169dce tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:29.512807 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-8b83f747-39e2-4dbf-929e-9bd937169dce tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: ed0fdfd2-3506-40c4-8e4a-bb984e946fdd] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:29.520756 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8b83f747-39e2-4dbf-929e-9bd937169dce tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:29.521211 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8b83f747-39e2-4dbf-929e-9bd937169dce tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:29.522378 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8b83f747-39e2-4dbf-929e-9bd937169dce tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:29.523027 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8b83f747-39e2-4dbf-929e-9bd937169dce tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:29.559460 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-8b83f747-39e2-4dbf-929e-9bd937169dce tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: ed0fdfd2-3506-40c4-8e4a-bb984e946fdd] Going to try to terminate instance {{(pid=131321) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:20:29.667496 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-8b83f747-39e2-4dbf-929e-9bd937169dce tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "DELETE /compute/v2.1/servers/ed0fdfd2-3506-40c4-8e4a-bb984e946fdd" status: 204 len: 0 microversion: 2.25 time: 0.176867 Jul 23 21:20:29.669340 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 881/1720] 10.222.0.17 () {60 vars in 1279 bytes} [Sat Jul 23 21:20:29 2022] DELETE /compute/v2.1/servers/ed0fdfd2-3506-40c4-8e4a-bb984e946fdd => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 23 21:20:29.676466 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-8b9bf1c5-8b3c-42a3-8d84-0d2cae0ec556 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:29.677283 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-8b9bf1c5-8b3c-42a3-8d84-0d2cae0ec556 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] [instance: 3075a998-589a-474c-ac0a-3c53f63ab574] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:29.686970 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-bbabdab2-b267-4613-b277-16009fa54cb8 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80673ab800441b4bd1f5858e1df7b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629d02efac724fa29fcfff53e370b69b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:29.698149 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8b9bf1c5-8b3c-42a3-8d84-0d2cae0ec556 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:29.698635 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8b9bf1c5-8b3c-42a3-8d84-0d2cae0ec556 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:29.699549 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8b9bf1c5-8b3c-42a3-8d84-0d2cae0ec556 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:29.699993 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8b9bf1c5-8b3c-42a3-8d84-0d2cae0ec556 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:29.700786 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-bbabdab2-b267-4613-b277-16009fa54cb8 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/servers/c1701f99-a44c-48ca-8946-b84c5e163cee" status: 200 len: 1276 microversion: 2.1 time: 0.264747 Jul 23 21:20:29.702113 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 840/1721] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:20:29 2022] GET /compute/v2.1/servers/c1701f99-a44c-48ca-8946-b84c5e163cee => generated 1276 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:20:29.707330 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-da69ca07-d47b-4aab-9004-e9ccec0d093f tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:29.708377 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-da69ca07-d47b-4aab-9004-e9ccec0d093f tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: ed0fdfd2-3506-40c4-8e4a-bb984e946fdd] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:29.721566 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-da69ca07-d47b-4aab-9004-e9ccec0d093f tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:29.722312 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-da69ca07-d47b-4aab-9004-e9ccec0d093f tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:29.724602 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-da69ca07-d47b-4aab-9004-e9ccec0d093f tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:29.725272 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-da69ca07-d47b-4aab-9004-e9ccec0d093f tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:29.825458 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-8b9bf1c5-8b3c-42a3-8d84-0d2cae0ec556 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '194f98e3c86b48e9952fe02d3648beb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e165633a87b04bd9bc3f6e575f53fb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:29.841394 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-8b9bf1c5-8b3c-42a3-8d84-0d2cae0ec556 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] 10.222.0.17 "GET /compute/v2.1/servers/3075a998-589a-474c-ac0a-3c53f63ab574" status: 200 len: 1282 microversion: 2.1 time: 0.170467 Jul 23 21:20:29.842527 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 882/1722] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:20:29 2022] GET /compute/v2.1/servers/3075a998-589a-474c-ac0a-3c53f63ab574 => generated 1282 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:20:29.855287 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-096aabf2-2d48-45e0-9324-574114a8671d req-d846622d-535b-4b5c-bb65-88e5d79db7ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b", "name": "network-vif-deleted", "tag": "514e8daf-fac6-48ba-9a0d-0c9edf5b2d8e"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:20:29.864037 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-096aabf2-2d48-45e0-9324-574114a8671d req-d846622d-535b-4b5c-bb65-88e5d79db7ff service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:29.864771 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-096aabf2-2d48-45e0-9324-574114a8671d req-d846622d-535b-4b5c-bb65-88e5d79db7ff service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:29.878747 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-096aabf2-2d48-45e0-9324-574114a8671d req-d846622d-535b-4b5c-bb65-88e5d79db7ff service nova] Creating event network-vif-deleted:514e8daf-fac6-48ba-9a0d-0c9edf5b2d8e for instance d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b on nch2-master-1 Jul 23 21:20:29.886486 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-096aabf2-2d48-45e0-9324-574114a8671d req-d846622d-535b-4b5c-bb65-88e5d79db7ff service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042461 Jul 23 21:20:29.888040 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 883/1723] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:20:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:20:29.901771 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-175f1956-6709-45e4-81bf-e47c36313229 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-146016736", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "networks": [{"uuid": "ecbe0029-ff6a-44a3-ae55-f8c24a06320d"}]}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:20:29.988855 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.network.neutron [None req-175f1956-6709-45e4-81bf-e47c36313229 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] validate_networks() for [('ecbe0029-ff6a-44a3-ae55-f8c24a06320d', None, None, None, None, None)] {{(pid=131321) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:20:30.269562 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-da69ca07-d47b-4aab-9004-e9ccec0d093f tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:30.279541 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-da69ca07-d47b-4aab-9004-e9ccec0d093f tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:30.282738 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-da69ca07-d47b-4aab-9004-e9ccec0d093f tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:30.284122 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-da69ca07-d47b-4aab-9004-e9ccec0d093f tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/ed0fdfd2-3506-40c4-8e4a-bb984e946fdd" status: 200 len: 1563 microversion: 2.25 time: 0.580816 Jul 23 21:20:30.284866 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 841/1724] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:20:29 2022] GET /compute/v2.1/servers/ed0fdfd2-3506-40c4-8e4a-bb984e946fdd => generated 1563 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:20:30.302167 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-49534381-6176-44e0-9fa6-98be165cb067 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:30.303147 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-49534381-6176-44e0-9fa6-98be165cb067 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] [instance: d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:30.311750 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-49534381-6176-44e0-9fa6-98be165cb067 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:30.312897 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-49534381-6176-44e0-9fa6-98be165cb067 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:30.314146 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-49534381-6176-44e0-9fa6-98be165cb067 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:30.314810 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-49534381-6176-44e0-9fa6-98be165cb067 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:30.524597 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.objects.instance [None req-49534381-6176-44e0-9fa6-98be165cb067 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lazy-loading 'services' on Instance uuid d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a {{(pid=131320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:20:30.565723 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-49534381-6176-44e0-9fa6-98be165cb067 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a" status: 200 len: 1927 microversion: 2.75 time: 0.267549 Jul 23 21:20:30.569263 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 842/1725] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:20:30 2022] GET /compute/v2.1/servers/d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a => generated 1927 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:20:30.579303 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d9c7b52f-ed9b-40e4-b79f-4d031d3ab603 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:30.579560 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d9c7b52f-ed9b-40e4-b79f-4d031d3ab603 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:30.598385 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d9c7b52f-ed9b-40e4-b79f-4d031d3ab603 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:30.598982 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d9c7b52f-ed9b-40e4-b79f-4d031d3ab603 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:30.601048 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d9c7b52f-ed9b-40e4-b79f-4d031d3ab603 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:30.601735 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d9c7b52f-ed9b-40e4-b79f-4d031d3ab603 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:31.225089 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d9c7b52f-ed9b-40e4-b79f-4d031d3ab603 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:31.235802 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d9c7b52f-ed9b-40e4-b79f-4d031d3ab603 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:31.237317 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d9c7b52f-ed9b-40e4-b79f-4d031d3ab603 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:31.242849 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d9c7b52f-ed9b-40e4-b79f-4d031d3ab603 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1874 microversion: 2.42 time: 0.672469 Jul 23 21:20:31.244088 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 843/1726] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:20:30 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1874 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:20:31.251515 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-7bded7b2-c85c-4df8-ad7e-23bfb07021c8 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:31.260353 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-7bded7b2-c85c-4df8-ad7e-23bfb07021c8 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:31.287925 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=9,nova_api:INSERT=5 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:20:31.295977 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7bded7b2-c85c-4df8-ad7e-23bfb07021c8 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:31.297516 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7bded7b2-c85c-4df8-ad7e-23bfb07021c8 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:31.300419 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7bded7b2-c85c-4df8-ad7e-23bfb07021c8 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:31.302282 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7bded7b2-c85c-4df8-ad7e-23bfb07021c8 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:31.338589 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-175f1956-6709-45e4-81bf-e47c36313229 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Flavor limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:20:31.339106 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-175f1956-6709-45e4-81bf-e47c36313229 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Image limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:20:31.339473 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-175f1956-6709-45e4-81bf-e47c36313229 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Flavor pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:20:31.339880 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-175f1956-6709-45e4-81bf-e47c36313229 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Image pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:20:31.340293 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-175f1956-6709-45e4-81bf-e47c36313229 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:20:31.363624 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-7bded7b2-c85c-4df8-ad7e-23bfb07021c8 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] HTTP exception thrown: Instance d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b could not be found. Jul 23 21:20:31.364667 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-175f1956-6709-45e4-81bf-e47c36313229 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:31.365116 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-175f1956-6709-45e4-81bf-e47c36313229 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:31.365270 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-7bded7b2-c85c-4df8-ad7e-23bfb07021c8 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Request method failure captured: Jul 23 21:20:31.365270 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b HTTP/1.1 Jul 23 21:20:31.365270 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:20:31.365270 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:20:31.365270 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:20:31.365270 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:20:31.365270 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:20:31.365270 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:20:31.365270 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:20:31.365270 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:20:31.365270 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GSUadBHV5KQx7oirT38skqnMSdU557uu7W8nycHRhDgemsZLyCYeVkfysUs37F8D_ZUY9UNUJpMdh-nepv8zMyA9ftF8ijyv_SB5vUpZqr7-EHGR3KHXc-GzeRHBEHo83KZ6DeFQv2-Grs6W6blgKIAVzrIFe8rJ_I-lChk_0j0Vww Jul 23 21:20:31.365270 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:20:31.365270 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:20:31.365270 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:20:31.365270 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:20:31.365270 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:20:31.365270 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:20:31.365270 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 6610a2359aa64f89befcf72e4f3f6a54 Jul 23 21:20:31.365270 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-LiveMigrationTest-731745934 Jul 23 21:20:31.365270 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:20:31.365270 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:20:31.366773 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6610a2359aa64f89befcf72e4f3f6a54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6610a2359aa64f89befcf72e4f3f6a54"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6610a2359aa64f89befcf72e4f3f6a54", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6610a2359aa64f89befcf72e4f3f6a54"}]}] Jul 23 21:20:31.366773 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-LiveMigrationTest-731745934 Jul 23 21:20:31.366773 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 6610a2359aa64f89befcf72e4f3f6a54 Jul 23 21:20:31.366773 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-LiveMigrationTest-731745934 Jul 23 21:20:31.366773 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-LiveMigrationTest-731745934-project Jul 23 21:20:31.366773 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:20:31.366773 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:20:31.366773 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: f2672c5db79b4a48a505c3df536594dd Jul 23 21:20:31.366773 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-LiveMigrationTest-731745934-project Jul 23 21:20:31.366773 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:20:31.366773 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b could not be found. Jul 23 21:20:31.366773 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': 'd8fb1ebd-9ea4-46d1-98f8-1692e05ee41b'} Jul 23 21:20:31.367661 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:20:31.367661 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:31.367661 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:20:31.367661 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:20:31.367661 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:20:31.367661 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:20:31.367661 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:20:31.367661 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:20:31.367661 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:20:31.367661 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:20:31.367661 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b could not be found. Jul 23 21:20:31.367661 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:20:31.367661 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:20:31.367661 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:20:31.367661 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:31.367661 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:20:31.367661 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:20:31.367661 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:20:31.367661 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:20:31.367661 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:20:31.369034 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:20:31.369034 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:20:31.369034 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:20:31.369034 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:20:31.369034 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:20:31.369034 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:20:31.369034 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:20:31.369034 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b could not be found. Jul 23 21:20:31.369034 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:20:31.369034 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:20:31.369034 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:20:31.369034 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:31.369034 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:20:31.369034 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:20:31.369034 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:20:31.369034 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:20:31.369034 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b could not be found. Jul 23 21:20:31.369034 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:20:31.375519 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-7bded7b2-c85c-4df8-ad7e-23bfb07021c8 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Returning 404 to user: Instance d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:20:31.375831 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-175f1956-6709-45e4-81bf-e47c36313229 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:31.375831 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-175f1956-6709-45e4-81bf-e47c36313229 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:31.376252 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-7bded7b2-c85c-4df8-ad7e-23bfb07021c8 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b" status: 404 len: 111 microversion: 2.1 time: 0.125394 Jul 23 21:20:31.376252 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 844/1727] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:20:31 2022] GET /compute/v2.1/servers/d8fb1ebd-9ea4-46d1-98f8-1692e05ee41b => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:20:31.379092 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2a87194f-9259-4245-bf19-1bc1e6ea95ef tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:31.379686 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-2a87194f-9259-4245-bf19-1bc1e6ea95ef tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] [instance: c1701f99-a44c-48ca-8946-b84c5e163cee] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:31.393994 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2a87194f-9259-4245-bf19-1bc1e6ea95ef tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:31.394453 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2a87194f-9259-4245-bf19-1bc1e6ea95ef tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:31.395338 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2a87194f-9259-4245-bf19-1bc1e6ea95ef tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:31.395841 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2a87194f-9259-4245-bf19-1bc1e6ea95ef tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:31.410218 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-175f1956-6709-45e4-81bf-e47c36313229 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Getting quotas for project f220ba2f42db435a818f3e462aea35a2. Resources: {'ram', 'instances', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:20:31.420274 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-175f1956-6709-45e4-81bf-e47c36313229 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Getting quotas for user 145e518288ce4d70a12a3f2cc6a91810 and project f220ba2f42db435a818f3e462aea35a2. Resources: {'ram', 'instances', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:20:31.447181 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-175f1956-6709-45e4-81bf-e47c36313229 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Going to run 1 instances... {{(pid=131321) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:20:31.451572 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-175f1956-6709-45e4-81bf-e47c36313229 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] [instance: 0ff0af19-c9f7-40eb-9c89-f34322c691ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131321) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:20:31.520792 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-175f1956-6709-45e4-81bf-e47c36313229 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.631152 Jul 23 21:20:31.522286 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 884/1728] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:20:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1633 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 23 21:20:31.527744 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a0167083-33a6-4416-b605-e012da755b5e tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:31.542074 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-a0167083-33a6-4416-b605-e012da755b5e tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] [instance: 3075a998-589a-474c-ac0a-3c53f63ab574] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:31.558663 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a0167083-33a6-4416-b605-e012da755b5e tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:31.559539 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a0167083-33a6-4416-b605-e012da755b5e tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:31.560818 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a0167083-33a6-4416-b605-e012da755b5e tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:31.563526 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a0167083-33a6-4416-b605-e012da755b5e tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:32.460481 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-2a87194f-9259-4245-bf19-1bc1e6ea95ef tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80673ab800441b4bd1f5858e1df7b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629d02efac724fa29fcfff53e370b69b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:32.469937 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2a87194f-9259-4245-bf19-1bc1e6ea95ef tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/servers/c1701f99-a44c-48ca-8946-b84c5e163cee" status: 200 len: 1318 microversion: 2.1 time: 1.096191 Jul 23 21:20:32.484835 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 845/1729] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:20:31 2022] GET /compute/v2.1/servers/c1701f99-a44c-48ca-8946-b84c5e163cee => generated 1318 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:20:32.493009 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1731c8b3-2851-4b41-9a9f-84aed2035847 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:32.493985 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1731c8b3-2851-4b41-9a9f-84aed2035847 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: ed0fdfd2-3506-40c4-8e4a-bb984e946fdd] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:32.502526 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1731c8b3-2851-4b41-9a9f-84aed2035847 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:32.503504 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1731c8b3-2851-4b41-9a9f-84aed2035847 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:32.504600 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1731c8b3-2851-4b41-9a9f-84aed2035847 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:32.505268 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1731c8b3-2851-4b41-9a9f-84aed2035847 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:32.543948 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-a0167083-33a6-4416-b605-e012da755b5e tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '194f98e3c86b48e9952fe02d3648beb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e165633a87b04bd9bc3f6e575f53fb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:32.556427 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-a0167083-33a6-4416-b605-e012da755b5e tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] 10.222.0.17 "GET /compute/v2.1/servers/3075a998-589a-474c-ac0a-3c53f63ab574" status: 200 len: 1324 microversion: 2.1 time: 1.032799 Jul 23 21:20:32.557237 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 885/1730] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:20:31 2022] GET /compute/v2.1/servers/3075a998-589a-474c-ac0a-3c53f63ab574 => generated 1324 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:20:32.568132 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-511dfe0d-70ae-4170-91fc-6dcfb80a855c tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:32.568943 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-511dfe0d-70ae-4170-91fc-6dcfb80a855c tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 965630ba-6832-46c9-8f42-7a9fed39e598] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:32.583869 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-511dfe0d-70ae-4170-91fc-6dcfb80a855c tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:32.584337 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-511dfe0d-70ae-4170-91fc-6dcfb80a855c tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:32.585141 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-511dfe0d-70ae-4170-91fc-6dcfb80a855c tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:32.585576 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-511dfe0d-70ae-4170-91fc-6dcfb80a855c tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:32.622780 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-511dfe0d-70ae-4170-91fc-6dcfb80a855c tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 965630ba-6832-46c9-8f42-7a9fed39e598] Going to try to terminate instance {{(pid=131321) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:20:32.664953 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-1731c8b3-2851-4b41-9a9f-84aed2035847 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:32.693745 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-1731c8b3-2851-4b41-9a9f-84aed2035847 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:32.697262 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-1731c8b3-2851-4b41-9a9f-84aed2035847 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3a56b82cf3954f279dd21e17a42462b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b347973dfb204484bdb87ab0094dbe22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:32.700847 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1731c8b3-2851-4b41-9a9f-84aed2035847 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/ed0fdfd2-3506-40c4-8e4a-bb984e946fdd" status: 200 len: 1521 microversion: 2.25 time: 0.212379 Jul 23 21:20:32.703328 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 846/1731] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:20:32 2022] GET /compute/v2.1/servers/ed0fdfd2-3506-40c4-8e4a-bb984e946fdd => generated 1521 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:20:32.710351 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0810f181-b852-4c15-a0c8-04b71b5221cf tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:32.712134 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-0810f181-b852-4c15-a0c8-04b71b5221cf tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] [instance: 0ff0af19-c9f7-40eb-9c89-f34322c691ac] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:32.726565 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:20:32.728693 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0810f181-b852-4c15-a0c8-04b71b5221cf tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:32.729294 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0810f181-b852-4c15-a0c8-04b71b5221cf tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:32.731154 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0810f181-b852-4c15-a0c8-04b71b5221cf tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:32.731919 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0810f181-b852-4c15-a0c8-04b71b5221cf tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:32.767840 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-511dfe0d-70ae-4170-91fc-6dcfb80a855c tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "DELETE /compute/v2.1/servers/965630ba-6832-46c9-8f42-7a9fed39e598" status: 204 len: 0 microversion: 2.1 time: 0.209137 Jul 23 21:20:32.769173 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 886/1732] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:20:32 2022] DELETE /compute/v2.1/servers/965630ba-6832-46c9-8f42-7a9fed39e598 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:20:32.776805 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-934884e6-c10c-42c4-92b0-fd51fd5af365 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:32.778501 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-934884e6-c10c-42c4-92b0-fd51fd5af365 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] [instance: d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:32.786844 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-934884e6-c10c-42c4-92b0-fd51fd5af365 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:32.787700 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-934884e6-c10c-42c4-92b0-fd51fd5af365 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:32.788767 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-934884e6-c10c-42c4-92b0-fd51fd5af365 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:32.789432 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-934884e6-c10c-42c4-92b0-fd51fd5af365 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:32.935369 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.objects.instance [None req-934884e6-c10c-42c4-92b0-fd51fd5af365 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lazy-loading 'services' on Instance uuid d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a {{(pid=131321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:20:32.964957 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-934884e6-c10c-42c4-92b0-fd51fd5af365 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a" status: 200 len: 1927 microversion: 2.75 time: 0.193482 Jul 23 21:20:32.966260 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 887/1733] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:20:32 2022] GET /compute/v2.1/servers/d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a => generated 1927 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:20:33.067069 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-0810f181-b852-4c15-a0c8-04b71b5221cf tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145e518288ce4d70a12a3f2cc6a91810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f220ba2f42db435a818f3e462aea35a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:33.075274 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-0810f181-b852-4c15-a0c8-04b71b5221cf tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] 10.222.0.17 "GET /compute/v2.1/servers/0ff0af19-c9f7-40eb-9c89-f34322c691ac" status: 200 len: 1269 microversion: 2.1 time: 0.370514 Jul 23 21:20:33.076243 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 847/1734] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:20:32 2022] GET /compute/v2.1/servers/0ff0af19-c9f7-40eb-9c89-f34322c691ac => generated 1269 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:20:33.086531 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-65f29feb-743a-4ef2-ad74-6fc2d42a22b2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:33.087432 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-65f29feb-743a-4ef2-ad74-6fc2d42a22b2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:33.100435 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-65f29feb-743a-4ef2-ad74-6fc2d42a22b2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:33.103227 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-65f29feb-743a-4ef2-ad74-6fc2d42a22b2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:33.115019 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-65f29feb-743a-4ef2-ad74-6fc2d42a22b2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:33.117404 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-65f29feb-743a-4ef2-ad74-6fc2d42a22b2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:33.149176 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=100 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:20:33.227905 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-6bb40923-82be-42cc-94cd-1b9237ca63de tempest-KeyPairsV2TestJSON-1629042249 tempest-KeyPairsV2TestJSON-1629042249-project] Action: 'create', calling method: .version_select at 0x7f0b59a99af0>, body: {"keypair": {"name": "tempest-keypair-1922586899", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNA8dZMrKh9k6fEM6RNsty6MuGiDRkFxdPk41B9LtmejkfL1R92fFtxpOlvs6LyOqABC+C0DB7EUqmYZcvLdvBJpPboF8eFEw+pYq/xjUWnWSDHzCeDZmhbBrUufp/56rA=="}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:20:33.265803 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-6bb40923-82be-42cc-94cd-1b9237ca63de tempest-KeyPairsV2TestJSON-1629042249 tempest-KeyPairsV2TestJSON-1629042249-project] Getting quotas for project 17582b242546441dbb9976f7dc09366c. Resources: {'key_pairs'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:20:33.279015 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-6bb40923-82be-42cc-94cd-1b9237ca63de tempest-KeyPairsV2TestJSON-1629042249 tempest-KeyPairsV2TestJSON-1629042249-project] Getting quotas for user 041c034e5da54285833be29dc81e9f9e and project 17582b242546441dbb9976f7dc09366c. Resources: {'key_pairs'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:20:33.338553 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-6bb40923-82be-42cc-94cd-1b9237ca63de tempest-KeyPairsV2TestJSON-1629042249 tempest-KeyPairsV2TestJSON-1629042249-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.370505 Jul 23 21:20:33.340208 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 888/1735] 10.222.0.17 () {60 vars in 1158 bytes} [Sat Jul 23 21:20:32 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:20:33.358408 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-ef6585ef-38b3-452a-8bf7-0b8cf8087731 req-35a47091-aebf-4065-b75d-d3a7318c2bad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed0fdfd2-3506-40c4-8e4a-bb984e946fdd", "name": "network-vif-deleted", "tag": "1e9171bb-cfe1-4d9d-b4e2-14b9c65df29e"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:20:33.387954 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-ef6585ef-38b3-452a-8bf7-0b8cf8087731 req-35a47091-aebf-4065-b75d-d3a7318c2bad service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:33.389238 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-ef6585ef-38b3-452a-8bf7-0b8cf8087731 req-35a47091-aebf-4065-b75d-d3a7318c2bad service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:33.406931 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-ef6585ef-38b3-452a-8bf7-0b8cf8087731 req-35a47091-aebf-4065-b75d-d3a7318c2bad service nova] Creating event network-vif-deleted:1e9171bb-cfe1-4d9d-b4e2-14b9c65df29e for instance ed0fdfd2-3506-40c4-8e4a-bb984e946fdd on nch1-master-1 Jul 23 21:20:33.413348 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-ef6585ef-38b3-452a-8bf7-0b8cf8087731 req-35a47091-aebf-4065-b75d-d3a7318c2bad service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069753 Jul 23 21:20:33.415697 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 889/1736] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:20:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:20:33.422347 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-25340309-cf33-44a3-8bbd-06cd7e6337d8 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:33.423191 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-25340309-cf33-44a3-8bbd-06cd7e6337d8 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 965630ba-6832-46c9-8f42-7a9fed39e598] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:33.430755 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-25340309-cf33-44a3-8bbd-06cd7e6337d8 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:33.431297 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-25340309-cf33-44a3-8bbd-06cd7e6337d8 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:33.432319 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-25340309-cf33-44a3-8bbd-06cd7e6337d8 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:33.432833 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-25340309-cf33-44a3-8bbd-06cd7e6337d8 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:33.783515 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-25340309-cf33-44a3-8bbd-06cd7e6337d8 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:33.786447 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-65f29feb-743a-4ef2-ad74-6fc2d42a22b2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:33.798449 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-25340309-cf33-44a3-8bbd-06cd7e6337d8 tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/965630ba-6832-46c9-8f42-7a9fed39e598" status: 200 len: 1499 microversion: 2.1 time: 0.380579 Jul 23 21:20:33.799500 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 890/1737] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:20:33 2022] GET /compute/v2.1/servers/965630ba-6832-46c9-8f42-7a9fed39e598 => generated 1499 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:20:33.805086 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-65f29feb-743a-4ef2-ad74-6fc2d42a22b2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:33.808469 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-65f29feb-743a-4ef2-ad74-6fc2d42a22b2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:33.817512 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-3158649c-07d7-4c1f-b459-d2a44d7f06af req-c99bb16c-8e10-4335-9975-1c9ab5bd0f95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9933c901-3692-4f36-9f11-e1a93d902e94", "tag": "710f608f-25bd-47cb-9727-946c3bac499f"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:20:33.818098 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-65f29feb-743a-4ef2-ad74-6fc2d42a22b2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1874 microversion: 2.42 time: 0.736221 Jul 23 21:20:33.820458 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 848/1738] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:20:33 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1874 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:20:33.831211 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d52fa93c-d85b-44eb-be5f-988fad00be58 tempest-KeyPairsV2TestJSON-1629042249 tempest-KeyPairsV2TestJSON-1629042249-project] Calling method '.version_select at 0x7f0b540eaf70>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:33.842152 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-3158649c-07d7-4c1f-b459-d2a44d7f06af req-c99bb16c-8e10-4335-9975-1c9ab5bd0f95 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:33.842930 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-3158649c-07d7-4c1f-b459-d2a44d7f06af req-c99bb16c-8e10-4335-9975-1c9ab5bd0f95 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:33.846990 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d52fa93c-d85b-44eb-be5f-988fad00be58 tempest-KeyPairsV2TestJSON-1629042249 tempest-KeyPairsV2TestJSON-1629042249-project] 10.222.0.17 "GET /compute/v2.1/os-keypairs/tempest-keypair-1922586899" status: 200 len: 498 microversion: 2.1 time: 0.025004 Jul 23 21:20:33.848191 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 849/1739] 10.222.0.17 () {58 vars in 1217 bytes} [Sat Jul 23 21:20:33 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1922586899 => generated 498 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:20:33.855621 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b20b28d5-cd98-4233-926d-f8c73ad4fd8b tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:33.856454 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b20b28d5-cd98-4233-926d-f8c73ad4fd8b tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] [instance: c1701f99-a44c-48ca-8946-b84c5e163cee] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:33.857763 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-3158649c-07d7-4c1f-b459-d2a44d7f06af req-c99bb16c-8e10-4335-9975-1c9ab5bd0f95 service nova] Creating event network-changed:710f608f-25bd-47cb-9727-946c3bac499f for instance 9933c901-3692-4f36-9f11-e1a93d902e94 on nch1-master-1 Jul 23 21:20:33.864329 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-3158649c-07d7-4c1f-b459-d2a44d7f06af req-c99bb16c-8e10-4335-9975-1c9ab5bd0f95 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063334 Jul 23 21:20:33.864717 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b20b28d5-cd98-4233-926d-f8c73ad4fd8b tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:33.865336 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b20b28d5-cd98-4233-926d-f8c73ad4fd8b tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:33.865583 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 891/1740] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:20:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:20:33.866482 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b20b28d5-cd98-4233-926d-f8c73ad4fd8b tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:33.867072 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b20b28d5-cd98-4233-926d-f8c73ad4fd8b tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:33.873691 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a8570eb4-aeff-4b3e-b87d-cc16587cdf53 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:33.875258 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-a8570eb4-aeff-4b3e-b87d-cc16587cdf53 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] [instance: 3075a998-589a-474c-ac0a-3c53f63ab574] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:33.885292 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a8570eb4-aeff-4b3e-b87d-cc16587cdf53 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:33.886036 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a8570eb4-aeff-4b3e-b87d-cc16587cdf53 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:33.888557 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a8570eb4-aeff-4b3e-b87d-cc16587cdf53 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:33.889479 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a8570eb4-aeff-4b3e-b87d-cc16587cdf53 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:34.128436 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-a8570eb4-aeff-4b3e-b87d-cc16587cdf53 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '194f98e3c86b48e9952fe02d3648beb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e165633a87b04bd9bc3f6e575f53fb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:34.140807 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-a8570eb4-aeff-4b3e-b87d-cc16587cdf53 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] 10.222.0.17 "GET /compute/v2.1/servers/3075a998-589a-474c-ac0a-3c53f63ab574" status: 200 len: 1324 microversion: 2.1 time: 0.272358 Jul 23 21:20:34.151843 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 892/1741] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:20:33 2022] GET /compute/v2.1/servers/3075a998-589a-474c-ac0a-3c53f63ab574 => generated 1324 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:20:34.159497 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-9c06d6d8-cab0-4542-89d8-44c76670f8a0 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:34.160453 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-9c06d6d8-cab0-4542-89d8-44c76670f8a0 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] [instance: ed0fdfd2-3506-40c4-8e4a-bb984e946fdd] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:34.167987 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9c06d6d8-cab0-4542-89d8-44c76670f8a0 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:34.168732 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9c06d6d8-cab0-4542-89d8-44c76670f8a0 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:34.171922 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9c06d6d8-cab0-4542-89d8-44c76670f8a0 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:34.172549 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9c06d6d8-cab0-4542-89d8-44c76670f8a0 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:34.206200 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-9c06d6d8-cab0-4542-89d8-44c76670f8a0 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] HTTP exception thrown: Instance ed0fdfd2-3506-40c4-8e4a-bb984e946fdd could not be found. Jul 23 21:20:34.233815 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-9c06d6d8-cab0-4542-89d8-44c76670f8a0 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Request method failure captured: Jul 23 21:20:34.233815 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/servers/ed0fdfd2-3506-40c4-8e4a-bb984e946fdd HTTP/1.1 Jul 23 21:20:34.233815 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:20:34.233815 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:20:34.233815 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:20:34.233815 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:20:34.233815 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:20:34.233815 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:20:34.233815 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:20:34.233815 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:20:34.233815 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GS1JPLCtSl4zlOvUAdW9qDCNvk9KgpAVaHDeDRdhrd5Unc5Jp4VYHiNMr-F0SeJb5CAVBa8vOn03Mdw949XFb_Q9VjvG7WvGRUo-tTRXmW46puqpgRzM_AekQVJ5U4r0msCtB-HRCdhS2W_NBYLeuQ68VDyS01pFaHOoQppmHMvtMQ Jul 23 21:20:34.233815 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:20:34.233815 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:20:34.233815 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:20:34.233815 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:20:34.233815 ncdv-master-1 devstack@n-api.service[131321]: X-Openstack-Nova-Api-Version: 2.25 Jul 23 21:20:34.233815 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:20:34.233815 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:20:34.233815 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: b347973dfb204484bdb87ab0094dbe22 Jul 23 21:20:34.233815 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-2065000324 Jul 23 21:20:34.233815 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:20:34.233815 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:20:34.235806 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b347973dfb204484bdb87ab0094dbe22"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b347973dfb204484bdb87ab0094dbe22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b347973dfb204484bdb87ab0094dbe22", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b347973dfb204484bdb87ab0094dbe22"}]}] Jul 23 21:20:34.235806 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-2065000324 Jul 23 21:20:34.235806 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: b347973dfb204484bdb87ab0094dbe22 Jul 23 21:20:34.235806 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-2065000324 Jul 23 21:20:34.235806 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-LiveAutoBlockMigrationV225Test-2065000324-project Jul 23 21:20:34.235806 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:20:34.235806 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:20:34.235806 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 3a56b82cf3954f279dd21e17a42462b3 Jul 23 21:20:34.235806 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-2065000324-project Jul 23 21:20:34.235806 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:20:34.235806 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance ed0fdfd2-3506-40c4-8e4a-bb984e946fdd could not be found. Jul 23 21:20:34.235806 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': 'ed0fdfd2-3506-40c4-8e4a-bb984e946fdd'} Jul 23 21:20:34.236838 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:20:34.236838 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:34.236838 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:20:34.236838 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:20:34.236838 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:20:34.236838 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:20:34.236838 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:20:34.236838 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:20:34.236838 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:20:34.236838 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:20:34.236838 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed0fdfd2-3506-40c4-8e4a-bb984e946fdd could not be found. Jul 23 21:20:34.236838 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:20:34.236838 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:20:34.236838 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:20:34.236838 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:34.236838 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:20:34.236838 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:20:34.236838 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:20:34.236838 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:20:34.236838 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:20:34.238478 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:20:34.238478 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:20:34.238478 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:20:34.238478 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:20:34.238478 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:20:34.238478 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:20:34.238478 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:20:34.238478 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed0fdfd2-3506-40c4-8e4a-bb984e946fdd could not be found. Jul 23 21:20:34.238478 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:20:34.238478 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:20:34.238478 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:20:34.238478 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:34.238478 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:20:34.238478 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:20:34.238478 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:20:34.238478 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:20:34.238478 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed0fdfd2-3506-40c4-8e4a-bb984e946fdd could not be found. Jul 23 21:20:34.238478 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:20:34.241086 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-9c06d6d8-cab0-4542-89d8-44c76670f8a0 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] Returning 404 to user: Instance ed0fdfd2-3506-40c4-8e4a-bb984e946fdd could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:20:34.242319 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-9c06d6d8-cab0-4542-89d8-44c76670f8a0 tempest-LiveAutoBlockMigrationV225Test-2065000324 tempest-LiveAutoBlockMigrationV225Test-2065000324-project] 10.222.0.17 "GET /compute/v2.1/servers/ed0fdfd2-3506-40c4-8e4a-bb984e946fdd" status: 404 len: 111 microversion: 2.25 time: 0.088963 Jul 23 21:20:34.243079 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 893/1742] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:20:34 2022] GET /compute/v2.1/servers/ed0fdfd2-3506-40c4-8e4a-bb984e946fdd => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 23 21:20:34.255946 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-5562b076-c17a-49c3-8109-500b9df39d43 tempest-KeyPairsV2TestJSON-1629042249 tempest-KeyPairsV2TestJSON-1629042249-project] Calling method '.version_select at 0x7f0b59a1baf0>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:34.294333 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=3,nova_api:INSERT=4 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:20:34.318557 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-5562b076-c17a-49c3-8109-500b9df39d43 tempest-KeyPairsV2TestJSON-1629042249 tempest-KeyPairsV2TestJSON-1629042249-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1922586899" status: 202 len: 0 microversion: 2.1 time: 0.069149 Jul 23 21:20:34.328207 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 894/1743] 10.222.0.17 () {58 vars in 1220 bytes} [Sat Jul 23 21:20:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1922586899 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:20:34.352904 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f8071e5e-b972-4509-86f2-6db456ab780b tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:34.353406 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-f8071e5e-b972-4509-86f2-6db456ab780b tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] [instance: d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:34.371138 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f8071e5e-b972-4509-86f2-6db456ab780b tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:34.373963 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f8071e5e-b972-4509-86f2-6db456ab780b tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:34.377235 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f8071e5e-b972-4509-86f2-6db456ab780b tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:34.382870 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f8071e5e-b972-4509-86f2-6db456ab780b tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:34.434108 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b20b28d5-cd98-4233-926d-f8c73ad4fd8b tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80673ab800441b4bd1f5858e1df7b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629d02efac724fa29fcfff53e370b69b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:34.441883 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b20b28d5-cd98-4233-926d-f8c73ad4fd8b tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/servers/c1701f99-a44c-48ca-8946-b84c5e163cee" status: 200 len: 1318 microversion: 2.1 time: 0.592264 Jul 23 21:20:34.442486 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 850/1744] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:20:33 2022] GET /compute/v2.1/servers/c1701f99-a44c-48ca-8946-b84c5e163cee => generated 1318 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:20:34.456630 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a6b84f25-10e0-4799-95af-4525c630cdf0 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:34.457554 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a6b84f25-10e0-4799-95af-4525c630cdf0 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] [instance: 0ff0af19-c9f7-40eb-9c89-f34322c691ac] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:34.471528 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a6b84f25-10e0-4799-95af-4525c630cdf0 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:34.472258 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a6b84f25-10e0-4799-95af-4525c630cdf0 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:34.473625 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a6b84f25-10e0-4799-95af-4525c630cdf0 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:34.474323 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a6b84f25-10e0-4799-95af-4525c630cdf0 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:34.521483 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.objects.instance [None req-f8071e5e-b972-4509-86f2-6db456ab780b tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lazy-loading 'services' on Instance uuid d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a {{(pid=131321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:20:34.553661 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-f8071e5e-b972-4509-86f2-6db456ab780b tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a" status: 200 len: 1927 microversion: 2.75 time: 0.224247 Jul 23 21:20:34.554440 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 895/1745] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:20:34 2022] GET /compute/v2.1/servers/d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a => generated 1927 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:20:34.559199 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-1bd069ee-d8b3-465f-8056-1cf86eaf1e05 tempest-KeyPairsV2TestJSON-1629042249 tempest-KeyPairsV2TestJSON-1629042249-project] Action: 'create', calling method: .version_select at 0x7f0b59a1ba60>, body: {"keypair": {"name": "tempest-keypair-542886809", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFcbB6oJC8Eoy5jb50VOg0f/GpNuaZLdWhUqjmAl3ej0c1hvmbcKFCNcAE+5nNuGaDvcbiE/zaYqRCSgEvrDLHkRww8UKi2sLYVHKWCZzh/8nSMSpJxIaPcc2IxDUK0Z1g=="}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:20:34.575117 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-1bd069ee-d8b3-465f-8056-1cf86eaf1e05 tempest-KeyPairsV2TestJSON-1629042249 tempest-KeyPairsV2TestJSON-1629042249-project] Getting quotas for project 17582b242546441dbb9976f7dc09366c. Resources: {'key_pairs'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:20:34.582339 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-1bd069ee-d8b3-465f-8056-1cf86eaf1e05 tempest-KeyPairsV2TestJSON-1629042249 tempest-KeyPairsV2TestJSON-1629042249-project] Getting quotas for user 041c034e5da54285833be29dc81e9f9e and project 17582b242546441dbb9976f7dc09366c. Resources: {'key_pairs'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:20:34.614453 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-1bd069ee-d8b3-465f-8056-1cf86eaf1e05 tempest-KeyPairsV2TestJSON-1629042249 tempest-KeyPairsV2TestJSON-1629042249-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.058748 Jul 23 21:20:34.615061 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 896/1746] 10.222.0.17 () {60 vars in 1158 bytes} [Sat Jul 23 21:20:34 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:20:34.628010 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-fff9a011-0075-4502-9969-0693869b61a9 tempest-KeyPairsV2TestJSON-1629042249 tempest-KeyPairsV2TestJSON-1629042249-project] Calling method '.version_select at 0x7f0b542c5c10>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:34.651036 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-fff9a011-0075-4502-9969-0693869b61a9 tempest-KeyPairsV2TestJSON-1629042249 tempest-KeyPairsV2TestJSON-1629042249-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-542886809" status: 202 len: 0 microversion: 2.1 time: 0.028548 Jul 23 21:20:34.651992 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 897/1747] 10.222.0.17 () {58 vars in 1217 bytes} [Sat Jul 23 21:20:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-542886809 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:20:34.665182 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e18137be-d057-458a-9d07-4bac52631d75 tempest-KeyPairsV2TestJSON-1629042249 tempest-KeyPairsV2TestJSON-1629042249-project] Action: 'create', calling method: .version_select at 0x7f0b59a99ee0>, body: {"keypair": {"name": "tempest-keypair-264292681", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:20:34.694096 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-e18137be-d057-458a-9d07-4bac52631d75 tempest-KeyPairsV2TestJSON-1629042249 tempest-KeyPairsV2TestJSON-1629042249-project] Getting quotas for project 17582b242546441dbb9976f7dc09366c. Resources: {'key_pairs'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:20:34.707485 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-e18137be-d057-458a-9d07-4bac52631d75 tempest-KeyPairsV2TestJSON-1629042249 tempest-KeyPairsV2TestJSON-1629042249-project] Getting quotas for user 041c034e5da54285833be29dc81e9f9e and project 17582b242546441dbb9976f7dc09366c. Resources: {'key_pairs'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:20:34.742054 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-e18137be-d057-458a-9d07-4bac52631d75 tempest-KeyPairsV2TestJSON-1629042249 tempest-KeyPairsV2TestJSON-1629042249-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 573 microversion: 2.1 time: 0.083178 Jul 23 21:20:34.743140 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 898/1748] 10.222.0.17 () {60 vars in 1158 bytes} [Sat Jul 23 21:20:34 2022] POST /compute/v2.1/os-keypairs => generated 573 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:20:34.753658 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-bc9f72b7-5e39-4593-85d7-c058293c882b tempest-KeyPairsV2TestJSON-1629042249 tempest-KeyPairsV2TestJSON-1629042249-project] Calling method '.version_select at 0x7f0b59a999d0>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:34.785739 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-bc9f72b7-5e39-4593-85d7-c058293c882b tempest-KeyPairsV2TestJSON-1629042249 tempest-KeyPairsV2TestJSON-1629042249-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-264292681" status: 202 len: 0 microversion: 2.1 time: 0.035093 Jul 23 21:20:34.793734 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 899/1749] 10.222.0.17 () {58 vars in 1217 bytes} [Sat Jul 23 21:20:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-264292681 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 23 21:20:34.835373 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-73bacaea-b532-487a-8be2-cbd5ee8eb8ff tempest-KeyPairsV2TestJSON-1629042249 tempest-KeyPairsV2TestJSON-1629042249-project] Action: 'create', calling method: .version_select at 0x7f0b542c5670>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-899653712", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC0eN07j5IX4z5v+e5RG72U0Vr+Ae/5qto0hmCVlg4DJFFdA+rEQIE3GhG60IKheMb2vxReuAoSywfI0Z7S92gMDbkl7sp7QBGvbfsd+0CFq7IRd2nnWBqHq+gvOr9DktQ=="}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:20:34.860128 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-73bacaea-b532-487a-8be2-cbd5ee8eb8ff tempest-KeyPairsV2TestJSON-1629042249 tempest-KeyPairsV2TestJSON-1629042249-project] Getting quotas for project 17582b242546441dbb9976f7dc09366c. Resources: {'key_pairs'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:20:34.867123 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-73bacaea-b532-487a-8be2-cbd5ee8eb8ff tempest-KeyPairsV2TestJSON-1629042249 tempest-KeyPairsV2TestJSON-1629042249-project] Getting quotas for user 041c034e5da54285833be29dc81e9f9e and project 17582b242546441dbb9976f7dc09366c. Resources: {'key_pairs'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:20:34.899883 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-73bacaea-b532-487a-8be2-cbd5ee8eb8ff tempest-KeyPairsV2TestJSON-1629042249 tempest-KeyPairsV2TestJSON-1629042249-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.098545 Jul 23 21:20:34.908777 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 900/1750] 10.222.0.17 () {60 vars in 1158 bytes} [Sat Jul 23 21:20:34 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:20:34.911165 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a6b84f25-10e0-4799-95af-4525c630cdf0 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145e518288ce4d70a12a3f2cc6a91810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f220ba2f42db435a818f3e462aea35a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:34.912372 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-318c3442-6c10-4af7-a590-110fae6e151f tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:34.913502 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-318c3442-6c10-4af7-a590-110fae6e151f tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 965630ba-6832-46c9-8f42-7a9fed39e598] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:34.922333 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-318c3442-6c10-4af7-a590-110fae6e151f tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:34.923070 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-318c3442-6c10-4af7-a590-110fae6e151f tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:34.924003 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a6b84f25-10e0-4799-95af-4525c630cdf0 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] 10.222.0.17 "GET /compute/v2.1/servers/0ff0af19-c9f7-40eb-9c89-f34322c691ac" status: 200 len: 1317 microversion: 2.1 time: 0.471726 Jul 23 21:20:34.924184 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-318c3442-6c10-4af7-a590-110fae6e151f tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:34.924847 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-318c3442-6c10-4af7-a590-110fae6e151f tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:34.936342 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 851/1751] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:20:34 2022] GET /compute/v2.1/servers/0ff0af19-c9f7-40eb-9c89-f34322c691ac => generated 1317 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:20:34.942694 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-36cdf541-797f-454b-b140-c5885d6d64c5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:34.943758 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-36cdf541-797f-454b-b140-c5885d6d64c5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:34.952137 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-36cdf541-797f-454b-b140-c5885d6d64c5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:34.952923 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-36cdf541-797f-454b-b140-c5885d6d64c5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:34.955283 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-36cdf541-797f-454b-b140-c5885d6d64c5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:34.956220 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-36cdf541-797f-454b-b140-c5885d6d64c5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:35.324896 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-318c3442-6c10-4af7-a590-110fae6e151f tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2672c5db79b4a48a505c3df536594dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6610a2359aa64f89befcf72e4f3f6a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:35.332254 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-36cdf541-797f-454b-b140-c5885d6d64c5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:35.340879 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-318c3442-6c10-4af7-a590-110fae6e151f tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/965630ba-6832-46c9-8f42-7a9fed39e598" status: 200 len: 1499 microversion: 2.1 time: 0.434884 Jul 23 21:20:35.343209 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-36cdf541-797f-454b-b140-c5885d6d64c5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:35.345202 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-36cdf541-797f-454b-b140-c5885d6d64c5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:35.345354 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 901/1752] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:20:34 2022] GET /compute/v2.1/servers/965630ba-6832-46c9-8f42-7a9fed39e598 => generated 1499 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:20:35.354590 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f3a5c287-0376-4f3c-9bd8-c21122af8390 tempest-KeyPairsV2TestJSON-1629042249 tempest-KeyPairsV2TestJSON-1629042249-project] Action: 'create', calling method: .version_select at 0x7f0b599b59d0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-544746521", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLJ8WIzuoBDR416C8VzKueUfSHoQzuscrGtXwLE4PmT5H1taGgwQRM64pIEp4vggTTUxKTUTaR09Q/XGk66O2fxio9zElKb1ntrrmvTfbml2JV8uefgX0OqqLit5rQevrg=="}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:20:35.356574 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-36cdf541-797f-454b-b140-c5885d6d64c5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1874 microversion: 2.42 time: 0.418392 Jul 23 21:20:35.357424 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 852/1753] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:20:34 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1874 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:20:35.367720 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4c905d9b-c560-4d54-84b9-9c9d89c38a4c tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:35.368605 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-4c905d9b-c560-4d54-84b9-9c9d89c38a4c tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] [instance: 3075a998-589a-474c-ac0a-3c53f63ab574] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:35.376079 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4c905d9b-c560-4d54-84b9-9c9d89c38a4c tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:35.377602 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4c905d9b-c560-4d54-84b9-9c9d89c38a4c tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:35.378505 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4c905d9b-c560-4d54-84b9-9c9d89c38a4c tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:35.379211 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4c905d9b-c560-4d54-84b9-9c9d89c38a4c tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:35.395222 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-f3a5c287-0376-4f3c-9bd8-c21122af8390 tempest-KeyPairsV2TestJSON-1629042249 tempest-KeyPairsV2TestJSON-1629042249-project] Getting quotas for project 17582b242546441dbb9976f7dc09366c. Resources: {'key_pairs'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:20:35.403662 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-f3a5c287-0376-4f3c-9bd8-c21122af8390 tempest-KeyPairsV2TestJSON-1629042249 tempest-KeyPairsV2TestJSON-1629042249-project] Getting quotas for user 041c034e5da54285833be29dc81e9f9e and project 17582b242546441dbb9976f7dc09366c. Resources: {'key_pairs'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:20:35.450277 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-f3a5c287-0376-4f3c-9bd8-c21122af8390 tempest-KeyPairsV2TestJSON-1629042249 tempest-KeyPairsV2TestJSON-1629042249-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.102130 Jul 23 21:20:35.451179 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 902/1754] 10.222.0.17 () {60 vars in 1158 bytes} [Sat Jul 23 21:20:35 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:20:35.469469 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-29257a68-4027-4686-8dfa-b488cc928041 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:35.470592 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-29257a68-4027-4686-8dfa-b488cc928041 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] [instance: c1701f99-a44c-48ca-8946-b84c5e163cee] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:35.477133 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-29257a68-4027-4686-8dfa-b488cc928041 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:35.477881 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-29257a68-4027-4686-8dfa-b488cc928041 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:35.479103 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-29257a68-4027-4686-8dfa-b488cc928041 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:35.479538 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-29257a68-4027-4686-8dfa-b488cc928041 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:35.597414 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-4c905d9b-c560-4d54-84b9-9c9d89c38a4c tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '194f98e3c86b48e9952fe02d3648beb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e165633a87b04bd9bc3f6e575f53fb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:35.613553 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4c905d9b-c560-4d54-84b9-9c9d89c38a4c tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] 10.222.0.17 "GET /compute/v2.1/servers/3075a998-589a-474c-ac0a-3c53f63ab574" status: 200 len: 1324 microversion: 2.1 time: 0.254239 Jul 23 21:20:35.627586 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 853/1755] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:20:35 2022] GET /compute/v2.1/servers/3075a998-589a-474c-ac0a-3c53f63ab574 => generated 1324 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:20:35.635197 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-7961c858-8f0b-4012-9d62-e4bdae6d1df8 req-2688696d-e317-4a36-90fb-fb8594a7c698 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3075a998-589a-474c-ac0a-3c53f63ab574", "tag": "5b53216a-bd51-4bcb-9d1e-76b2724f0d16"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:20:35.651493 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-7961c858-8f0b-4012-9d62-e4bdae6d1df8 req-2688696d-e317-4a36-90fb-fb8594a7c698 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:35.652142 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-7961c858-8f0b-4012-9d62-e4bdae6d1df8 req-2688696d-e317-4a36-90fb-fb8594a7c698 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:35.670708 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-7961c858-8f0b-4012-9d62-e4bdae6d1df8 req-2688696d-e317-4a36-90fb-fb8594a7c698 service nova] Creating event network-changed:5b53216a-bd51-4bcb-9d1e-76b2724f0d16 for instance 3075a998-589a-474c-ac0a-3c53f63ab574 on nch2-master-1 Jul 23 21:20:35.676825 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-7961c858-8f0b-4012-9d62-e4bdae6d1df8 req-2688696d-e317-4a36-90fb-fb8594a7c698 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047530 Jul 23 21:20:35.679634 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 854/1756] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:20:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:20:35.702558 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f57b95ca-599a-4905-85a9-1d99a41ef5b8 tempest-KeyPairsV2TestJSON-1629042249 tempest-KeyPairsV2TestJSON-1629042249-project] Action: 'create', calling method: .version_select at 0x7f0b540e0700>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1194953378", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNXbhTqFTMTDyRLrLIVLoaeet55sZGAQ5gYjgpVs36wL9evbhWsDCtWhRZ9OGeCRaKNEKXugGrWgyuGnTve3hXLF+Ujzq85j4uNprBEoDBu9unX9GBG+0urjutP3Wxqgmw=="}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:20:35.755550 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-f57b95ca-599a-4905-85a9-1d99a41ef5b8 tempest-KeyPairsV2TestJSON-1629042249 tempest-KeyPairsV2TestJSON-1629042249-project] Getting quotas for project 17582b242546441dbb9976f7dc09366c. Resources: {'key_pairs'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:20:35.775421 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-f57b95ca-599a-4905-85a9-1d99a41ef5b8 tempest-KeyPairsV2TestJSON-1629042249 tempest-KeyPairsV2TestJSON-1629042249-project] Getting quotas for user 041c034e5da54285833be29dc81e9f9e and project 17582b242546441dbb9976f7dc09366c. Resources: {'key_pairs'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:20:35.822111 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f57b95ca-599a-4905-85a9-1d99a41ef5b8 tempest-KeyPairsV2TestJSON-1629042249 tempest-KeyPairsV2TestJSON-1629042249-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.140615 Jul 23 21:20:35.824694 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 855/1757] 10.222.0.17 () {60 vars in 1158 bytes} [Sat Jul 23 21:20:35 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:20:35.830497 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-29257a68-4027-4686-8dfa-b488cc928041 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80673ab800441b4bd1f5858e1df7b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629d02efac724fa29fcfff53e370b69b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:35.833296 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9895b369-12c8-4066-903b-425939b94ee6 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:35.834566 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-9895b369-12c8-4066-903b-425939b94ee6 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] [instance: d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:35.840676 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-29257a68-4027-4686-8dfa-b488cc928041 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/servers/c1701f99-a44c-48ca-8946-b84c5e163cee" status: 200 len: 1318 microversion: 2.1 time: 0.375540 Jul 23 21:20:35.847093 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 903/1758] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:20:35 2022] GET /compute/v2.1/servers/c1701f99-a44c-48ca-8946-b84c5e163cee => generated 1318 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:20:35.847757 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9895b369-12c8-4066-903b-425939b94ee6 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:35.848598 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9895b369-12c8-4066-903b-425939b94ee6 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:35.852602 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-b7ccaa0a-ac04-4ab3-8ac8-70d9cba33262 tempest-KeyPairsV2TestJSON-1629042249 tempest-KeyPairsV2TestJSON-1629042249-project] Calling method '.version_select at 0x7f0b59aa9ee0>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:35.852955 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9895b369-12c8-4066-903b-425939b94ee6 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:35.855120 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9895b369-12c8-4066-903b-425939b94ee6 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:35.865470 ncdv-master-1 devstack@n-api.service[131321]: WARNING oslo_db.sqlalchemy.utils [None req-b7ccaa0a-ac04-4ab3-8ac8-70d9cba33262 tempest-KeyPairsV2TestJSON-1629042249 tempest-KeyPairsV2TestJSON-1629042249-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 23 21:20:35.879411 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-b7ccaa0a-ac04-4ab3-8ac8-70d9cba33262 tempest-KeyPairsV2TestJSON-1629042249 tempest-KeyPairsV2TestJSON-1629042249-project] 10.222.0.17 "GET /compute/v2.1/os-keypairs" status: 200 len: 1092 microversion: 2.1 time: 0.030662 Jul 23 21:20:35.880539 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 904/1759] 10.222.0.17 () {58 vars in 1136 bytes} [Sat Jul 23 21:20:35 2022] GET /compute/v2.1/os-keypairs => generated 1092 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:20:35.890297 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-4e21cd8f-6d57-4885-87f7-f58f8fc03d2c tempest-KeyPairsV2TestJSON-1629042249 tempest-KeyPairsV2TestJSON-1629042249-project] Calling method '.version_select at 0x7f0b59a698b0>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:35.915183 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-4e21cd8f-6d57-4885-87f7-f58f8fc03d2c tempest-KeyPairsV2TestJSON-1629042249 tempest-KeyPairsV2TestJSON-1629042249-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1194953378" status: 202 len: 0 microversion: 2.1 time: 0.028664 Jul 23 21:20:35.920072 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 905/1760] 10.222.0.17 () {58 vars in 1277 bytes} [Sat Jul 23 21:20:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1194953378 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 23 21:20:35.925493 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-10354268-6d14-4b21-8e7d-f4913762ed6a tempest-KeyPairsV2TestJSON-1629042249 tempest-KeyPairsV2TestJSON-1629042249-project] Calling method '.version_select at 0x7f0b599cff70>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:35.959240 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-10354268-6d14-4b21-8e7d-f4913762ed6a tempest-KeyPairsV2TestJSON-1629042249 tempest-KeyPairsV2TestJSON-1629042249-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-544746521" status: 202 len: 0 microversion: 2.1 time: 0.037846 Jul 23 21:20:35.963327 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 906/1761] 10.222.0.17 () {58 vars in 1274 bytes} [Sat Jul 23 21:20:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-544746521 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:20:35.968717 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-07d43793-e819-4f87-8203-008dfa7f50d9 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:35.969334 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-07d43793-e819-4f87-8203-008dfa7f50d9 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] [instance: 0ff0af19-c9f7-40eb-9c89-f34322c691ac] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:35.976220 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-07d43793-e819-4f87-8203-008dfa7f50d9 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:35.977124 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-07d43793-e819-4f87-8203-008dfa7f50d9 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:35.978235 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-07d43793-e819-4f87-8203-008dfa7f50d9 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:35.978828 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-07d43793-e819-4f87-8203-008dfa7f50d9 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:36.265575 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-07d43793-e819-4f87-8203-008dfa7f50d9 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145e518288ce4d70a12a3f2cc6a91810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f220ba2f42db435a818f3e462aea35a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:36.275079 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-07d43793-e819-4f87-8203-008dfa7f50d9 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] 10.222.0.17 "GET /compute/v2.1/servers/0ff0af19-c9f7-40eb-9c89-f34322c691ac" status: 200 len: 1317 microversion: 2.1 time: 0.310585 Jul 23 21:20:36.275861 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 907/1762] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:20:35 2022] GET /compute/v2.1/servers/0ff0af19-c9f7-40eb-9c89-f34322c691ac => generated 1317 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:20:36.288992 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ba105bf4-0f06-4a54-96b7-8113b3c9dca8 tempest-KeyPairsV2TestJSON-1629042249 tempest-KeyPairsV2TestJSON-1629042249-project] Calling method '.version_select at 0x7f0b542131f0>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:36.307315 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.objects.instance [None req-9895b369-12c8-4066-903b-425939b94ee6 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lazy-loading 'services' on Instance uuid d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a {{(pid=131320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:20:36.322757 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-ba105bf4-0f06-4a54-96b7-8113b3c9dca8 tempest-KeyPairsV2TestJSON-1629042249 tempest-KeyPairsV2TestJSON-1629042249-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-899653712" status: 202 len: 0 microversion: 2.1 time: 0.037613 Jul 23 21:20:36.324655 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 908/1763] 10.222.0.17 () {58 vars in 1274 bytes} [Sat Jul 23 21:20:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-899653712 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:20:36.339491 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9895b369-12c8-4066-903b-425939b94ee6 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a" status: 200 len: 1927 microversion: 2.75 time: 0.513258 Jul 23 21:20:36.340751 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 856/1764] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:20:35 2022] GET /compute/v2.1/servers/d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a => generated 1927 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:20:36.353123 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-44b186c4-843d-4126-9feb-bd1644b0fd83 req-82deb027-2f6e-4be6-9bec-99f979ec9e1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1701f99-a44c-48ca-8946-b84c5e163cee", "tag": "ca008065-59c8-45bf-a4e5-409a38a7c991"}, {"server_uuid": "965630ba-6832-46c9-8f42-7a9fed39e598", "name": "network-vif-deleted", "tag": "93e984c6-69bf-434e-b812-af74ab1347d8"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:20:36.363615 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-84790681-d3be-4cf2-b105-5d43ace4babb tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:36.364752 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-84790681-d3be-4cf2-b105-5d43ace4babb tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] [instance: 965630ba-6832-46c9-8f42-7a9fed39e598] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:36.367951 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-44b186c4-843d-4126-9feb-bd1644b0fd83 req-82deb027-2f6e-4be6-9bec-99f979ec9e1c service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:36.368716 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-44b186c4-843d-4126-9feb-bd1644b0fd83 req-82deb027-2f6e-4be6-9bec-99f979ec9e1c service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:36.386345 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-84790681-d3be-4cf2-b105-5d43ace4babb tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:36.386345 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-84790681-d3be-4cf2-b105-5d43ace4babb tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:36.387657 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-84790681-d3be-4cf2-b105-5d43ace4babb tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:36.387808 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-84790681-d3be-4cf2-b105-5d43ace4babb tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:36.401024 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-44b186c4-843d-4126-9feb-bd1644b0fd83 req-82deb027-2f6e-4be6-9bec-99f979ec9e1c service nova] Creating event network-changed:ca008065-59c8-45bf-a4e5-409a38a7c991 for instance c1701f99-a44c-48ca-8946-b84c5e163cee on nch1-master-1 Jul 23 21:20:36.401918 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-44b186c4-843d-4126-9feb-bd1644b0fd83 req-82deb027-2f6e-4be6-9bec-99f979ec9e1c service nova] Creating event network-vif-deleted:93e984c6-69bf-434e-b812-af74ab1347d8 for instance 965630ba-6832-46c9-8f42-7a9fed39e598 on nch2-master-1 Jul 23 21:20:36.418890 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-44b186c4-843d-4126-9feb-bd1644b0fd83 req-82deb027-2f6e-4be6-9bec-99f979ec9e1c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.091483 Jul 23 21:20:36.422572 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 909/1765] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:20:36 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:20:36.427879 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-84790681-d3be-4cf2-b105-5d43ace4babb tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] HTTP exception thrown: Instance 965630ba-6832-46c9-8f42-7a9fed39e598 could not be found. Jul 23 21:20:36.432965 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-977b8b73-afee-49a3-87da-7ec32f3b0789 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:36.435245 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-977b8b73-afee-49a3-87da-7ec32f3b0789 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:36.441436 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-84790681-d3be-4cf2-b105-5d43ace4babb tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Request method failure captured: Jul 23 21:20:36.441436 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/965630ba-6832-46c9-8f42-7a9fed39e598 HTTP/1.1 Jul 23 21:20:36.441436 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:20:36.441436 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:20:36.441436 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:20:36.441436 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:20:36.441436 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:20:36.441436 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:20:36.441436 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:20:36.441436 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:20:36.441436 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GSUadBHV5KQx7oirT38skqnMSdU557uu7W8nycHRhDgemsZLyCYeVkfysUs37F8D_ZUY9UNUJpMdh-nepv8zMyA9ftF8ijyv_SB5vUpZqr7-EHGR3KHXc-GzeRHBEHo83KZ6DeFQv2-Grs6W6blgKIAVzrIFe8rJ_I-lChk_0j0Vww Jul 23 21:20:36.441436 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:20:36.441436 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:20:36.441436 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:20:36.441436 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:20:36.441436 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:20:36.441436 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:20:36.441436 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 6610a2359aa64f89befcf72e4f3f6a54 Jul 23 21:20:36.441436 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-LiveMigrationTest-731745934 Jul 23 21:20:36.441436 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:20:36.441436 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:20:36.443521 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6610a2359aa64f89befcf72e4f3f6a54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6610a2359aa64f89befcf72e4f3f6a54"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6610a2359aa64f89befcf72e4f3f6a54", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6610a2359aa64f89befcf72e4f3f6a54"}]}] Jul 23 21:20:36.443521 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-LiveMigrationTest-731745934 Jul 23 21:20:36.443521 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 6610a2359aa64f89befcf72e4f3f6a54 Jul 23 21:20:36.443521 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-LiveMigrationTest-731745934 Jul 23 21:20:36.443521 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-LiveMigrationTest-731745934-project Jul 23 21:20:36.443521 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:20:36.443521 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:20:36.443521 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: f2672c5db79b4a48a505c3df536594dd Jul 23 21:20:36.443521 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-LiveMigrationTest-731745934-project Jul 23 21:20:36.443521 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:20:36.443521 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance 965630ba-6832-46c9-8f42-7a9fed39e598 could not be found. Jul 23 21:20:36.443521 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '965630ba-6832-46c9-8f42-7a9fed39e598'} Jul 23 21:20:36.444421 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:20:36.444421 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:36.444421 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:20:36.444421 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:20:36.444421 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:20:36.444421 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:20:36.444421 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:20:36.444421 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:20:36.444421 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:20:36.444421 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:20:36.444421 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 965630ba-6832-46c9-8f42-7a9fed39e598 could not be found. Jul 23 21:20:36.444421 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:20:36.444421 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:20:36.444421 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:20:36.444421 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:36.444421 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:20:36.444421 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:20:36.444421 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:20:36.444421 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:20:36.444421 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:20:36.447991 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:20:36.447991 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:20:36.447991 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:20:36.447991 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:20:36.447991 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:20:36.447991 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:20:36.447991 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:20:36.447991 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 965630ba-6832-46c9-8f42-7a9fed39e598 could not be found. Jul 23 21:20:36.447991 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:20:36.447991 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:20:36.447991 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:20:36.447991 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:36.447991 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:20:36.447991 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:20:36.447991 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:20:36.447991 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:20:36.447991 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 965630ba-6832-46c9-8f42-7a9fed39e598 could not be found. Jul 23 21:20:36.447991 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:20:36.454069 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-977b8b73-afee-49a3-87da-7ec32f3b0789 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:36.455143 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-977b8b73-afee-49a3-87da-7ec32f3b0789 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:36.456971 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-977b8b73-afee-49a3-87da-7ec32f3b0789 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:36.457424 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-977b8b73-afee-49a3-87da-7ec32f3b0789 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:36.460565 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-84790681-d3be-4cf2-b105-5d43ace4babb tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] Returning 404 to user: Instance 965630ba-6832-46c9-8f42-7a9fed39e598 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:20:36.462160 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-84790681-d3be-4cf2-b105-5d43ace4babb tempest-LiveMigrationTest-731745934 tempest-LiveMigrationTest-731745934-project] 10.222.0.17 "GET /compute/v2.1/servers/965630ba-6832-46c9-8f42-7a9fed39e598" status: 404 len: 111 microversion: 2.1 time: 0.104194 Jul 23 21:20:36.463356 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 857/1766] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:20:36 2022] GET /compute/v2.1/servers/965630ba-6832-46c9-8f42-7a9fed39e598 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:20:36.635457 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0473d74e-36c4-43bb-9561-2fc5f5f3d455 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:36.636455 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-0473d74e-36c4-43bb-9561-2fc5f5f3d455 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] [instance: 3075a998-589a-474c-ac0a-3c53f63ab574] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:36.645484 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0473d74e-36c4-43bb-9561-2fc5f5f3d455 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:36.646442 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0473d74e-36c4-43bb-9561-2fc5f5f3d455 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:36.647464 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0473d74e-36c4-43bb-9561-2fc5f5f3d455 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:36.648239 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0473d74e-36c4-43bb-9561-2fc5f5f3d455 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:36.989511 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-977b8b73-afee-49a3-87da-7ec32f3b0789 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:37.002566 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-977b8b73-afee-49a3-87da-7ec32f3b0789 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:37.004894 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-977b8b73-afee-49a3-87da-7ec32f3b0789 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:37.006320 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-977b8b73-afee-49a3-87da-7ec32f3b0789 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1874 microversion: 2.42 time: 0.582582 Jul 23 21:20:37.007072 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 910/1767] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:20:36 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1874 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:20:37.024550 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-4d65c9be-c7df-4ea4-a0c6-f2c3321d9aa0 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:37.032390 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-4d65c9be-c7df-4ea4-a0c6-f2c3321d9aa0 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] [instance: c1701f99-a44c-48ca-8946-b84c5e163cee] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:37.040902 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4d65c9be-c7df-4ea4-a0c6-f2c3321d9aa0 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:37.041616 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4d65c9be-c7df-4ea4-a0c6-f2c3321d9aa0 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:37.042633 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4d65c9be-c7df-4ea4-a0c6-f2c3321d9aa0 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:37.043251 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4d65c9be-c7df-4ea4-a0c6-f2c3321d9aa0 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:37.181502 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=6 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:20:37.236427 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-0473d74e-36c4-43bb-9561-2fc5f5f3d455 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '194f98e3c86b48e9952fe02d3648beb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e165633a87b04bd9bc3f6e575f53fb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:37.254664 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-0473d74e-36c4-43bb-9561-2fc5f5f3d455 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] 10.222.0.17 "GET /compute/v2.1/servers/3075a998-589a-474c-ac0a-3c53f63ab574" status: 200 len: 1324 microversion: 2.1 time: 0.626804 Jul 23 21:20:37.255258 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 858/1768] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:20:36 2022] GET /compute/v2.1/servers/3075a998-589a-474c-ac0a-3c53f63ab574 => generated 1324 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:20:37.293280 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-cbf7392c-2f8f-4173-a87f-81d6de5511f3 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:37.294834 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-cbf7392c-2f8f-4173-a87f-81d6de5511f3 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] [instance: 0ff0af19-c9f7-40eb-9c89-f34322c691ac] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:37.305477 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cbf7392c-2f8f-4173-a87f-81d6de5511f3 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:37.307222 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cbf7392c-2f8f-4173-a87f-81d6de5511f3 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:37.308130 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cbf7392c-2f8f-4173-a87f-81d6de5511f3 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:37.309275 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cbf7392c-2f8f-4173-a87f-81d6de5511f3 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:37.694976 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-cbf7392c-2f8f-4173-a87f-81d6de5511f3 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145e518288ce4d70a12a3f2cc6a91810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f220ba2f42db435a818f3e462aea35a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:37.704658 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-cbf7392c-2f8f-4173-a87f-81d6de5511f3 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] 10.222.0.17 "GET /compute/v2.1/servers/0ff0af19-c9f7-40eb-9c89-f34322c691ac" status: 200 len: 1317 microversion: 2.1 time: 0.416315 Jul 23 21:20:37.705669 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 859/1769] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:20:37 2022] GET /compute/v2.1/servers/0ff0af19-c9f7-40eb-9c89-f34322c691ac => generated 1317 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:20:37.711916 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-948b0bae-8aed-4704-99dd-337323f64003 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:37.712720 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-948b0bae-8aed-4704-99dd-337323f64003 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] [instance: d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:37.722607 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-948b0bae-8aed-4704-99dd-337323f64003 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:37.723842 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-948b0bae-8aed-4704-99dd-337323f64003 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:37.724802 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-948b0bae-8aed-4704-99dd-337323f64003 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:37.725404 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-948b0bae-8aed-4704-99dd-337323f64003 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:37.877976 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-4d65c9be-c7df-4ea4-a0c6-f2c3321d9aa0 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80673ab800441b4bd1f5858e1df7b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629d02efac724fa29fcfff53e370b69b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:37.898314 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-4d65c9be-c7df-4ea4-a0c6-f2c3321d9aa0 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/servers/c1701f99-a44c-48ca-8946-b84c5e163cee" status: 200 len: 1318 microversion: 2.1 time: 0.878006 Jul 23 21:20:37.899311 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.objects.instance [None req-948b0bae-8aed-4704-99dd-337323f64003 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lazy-loading 'services' on Instance uuid d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a {{(pid=131320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:20:37.899806 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 911/1770] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:20:37 2022] GET /compute/v2.1/servers/c1701f99-a44c-48ca-8946-b84c5e163cee => generated 1318 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:20:37.904402 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-a1017232-ecd0-4802-a074-43c7806811f3 req-10a17817-9a76-42e1-b80a-210561ca8c56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ff0af19-c9f7-40eb-9c89-f34322c691ac", "tag": "452080b0-7def-4fc9-8a29-c38b2cc4e239"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:20:37.927825 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-948b0bae-8aed-4704-99dd-337323f64003 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a" status: 200 len: 1927 microversion: 2.75 time: 0.220213 Jul 23 21:20:37.929596 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 860/1771] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:20:37 2022] GET /compute/v2.1/servers/d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a => generated 1927 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:20:37.932825 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-a1017232-ecd0-4802-a074-43c7806811f3 req-10a17817-9a76-42e1-b80a-210561ca8c56 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:37.933545 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-a1017232-ecd0-4802-a074-43c7806811f3 req-10a17817-9a76-42e1-b80a-210561ca8c56 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:37.957885 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-a1017232-ecd0-4802-a074-43c7806811f3 req-10a17817-9a76-42e1-b80a-210561ca8c56 service nova] Creating event network-changed:452080b0-7def-4fc9-8a29-c38b2cc4e239 for instance 0ff0af19-c9f7-40eb-9c89-f34322c691ac on nch1-master-1 Jul 23 21:20:37.964472 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-a1017232-ecd0-4802-a074-43c7806811f3 req-10a17817-9a76-42e1-b80a-210561ca8c56 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063316 Jul 23 21:20:37.965605 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 912/1772] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:20:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:20:38.034426 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-92ff3c3e-4586-4888-9e2f-72b189771599 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:38.036117 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-92ff3c3e-4586-4888-9e2f-72b189771599 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:38.045101 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-92ff3c3e-4586-4888-9e2f-72b189771599 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:38.045847 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-92ff3c3e-4586-4888-9e2f-72b189771599 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:38.047093 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-92ff3c3e-4586-4888-9e2f-72b189771599 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:38.048464 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-92ff3c3e-4586-4888-9e2f-72b189771599 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:38.272953 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-48f0d764-f7fd-4c51-b4dd-40e4b18c1f73 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:38.274593 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-48f0d764-f7fd-4c51-b4dd-40e4b18c1f73 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] [instance: 3075a998-589a-474c-ac0a-3c53f63ab574] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:38.289002 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-48f0d764-f7fd-4c51-b4dd-40e4b18c1f73 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:38.290299 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-48f0d764-f7fd-4c51-b4dd-40e4b18c1f73 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:38.294360 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-48f0d764-f7fd-4c51-b4dd-40e4b18c1f73 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:38.295003 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-48f0d764-f7fd-4c51-b4dd-40e4b18c1f73 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:38.513257 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-92ff3c3e-4586-4888-9e2f-72b189771599 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:38.523853 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-92ff3c3e-4586-4888-9e2f-72b189771599 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:38.525432 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-92ff3c3e-4586-4888-9e2f-72b189771599 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:38.535473 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-92ff3c3e-4586-4888-9e2f-72b189771599 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1874 microversion: 2.42 time: 0.506794 Jul 23 21:20:38.537254 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 861/1773] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:20:38 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1874 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:20:38.721978 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-72d50f7b-551e-47d6-8521-ffeb9dcbeba2 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:38.723106 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-72d50f7b-551e-47d6-8521-ffeb9dcbeba2 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] [instance: 0ff0af19-c9f7-40eb-9c89-f34322c691ac] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:38.729970 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-72d50f7b-551e-47d6-8521-ffeb9dcbeba2 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:38.730365 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-72d50f7b-551e-47d6-8521-ffeb9dcbeba2 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:38.731844 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-72d50f7b-551e-47d6-8521-ffeb9dcbeba2 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:38.732162 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-72d50f7b-551e-47d6-8521-ffeb9dcbeba2 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:38.811861 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-48f0d764-f7fd-4c51-b4dd-40e4b18c1f73 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '194f98e3c86b48e9952fe02d3648beb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e165633a87b04bd9bc3f6e575f53fb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:38.846627 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-48f0d764-f7fd-4c51-b4dd-40e4b18c1f73 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] 10.222.0.17 "GET /compute/v2.1/servers/3075a998-589a-474c-ac0a-3c53f63ab574" status: 200 len: 1324 microversion: 2.1 time: 0.576898 Jul 23 21:20:38.863386 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 913/1774] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:20:38 2022] GET /compute/v2.1/servers/3075a998-589a-474c-ac0a-3c53f63ab574 => generated 1324 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:20:38.917449 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-dfe114d9-66e3-4423-99fe-171b5b28c4b0 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:38.918446 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-dfe114d9-66e3-4423-99fe-171b5b28c4b0 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] [instance: c1701f99-a44c-48ca-8946-b84c5e163cee] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:38.928591 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-dfe114d9-66e3-4423-99fe-171b5b28c4b0 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:38.929400 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-dfe114d9-66e3-4423-99fe-171b5b28c4b0 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:38.930222 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-dfe114d9-66e3-4423-99fe-171b5b28c4b0 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:38.930664 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-dfe114d9-66e3-4423-99fe-171b5b28c4b0 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:39.122511 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-72d50f7b-551e-47d6-8521-ffeb9dcbeba2 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145e518288ce4d70a12a3f2cc6a91810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f220ba2f42db435a818f3e462aea35a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:39.134359 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-72d50f7b-551e-47d6-8521-ffeb9dcbeba2 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] 10.222.0.17 "GET /compute/v2.1/servers/0ff0af19-c9f7-40eb-9c89-f34322c691ac" status: 200 len: 1317 microversion: 2.1 time: 0.416596 Jul 23 21:20:39.135397 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 862/1775] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:20:38 2022] GET /compute/v2.1/servers/0ff0af19-c9f7-40eb-9c89-f34322c691ac => generated 1317 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:20:39.145830 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8eff437c-918e-472a-a784-b361e8e5fdfb tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:39.147437 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8eff437c-918e-472a-a784-b361e8e5fdfb tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] [instance: d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:39.157810 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8eff437c-918e-472a-a784-b361e8e5fdfb tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:39.158300 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8eff437c-918e-472a-a784-b361e8e5fdfb tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:39.159112 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8eff437c-918e-472a-a784-b361e8e5fdfb tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:39.159558 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8eff437c-918e-472a-a784-b361e8e5fdfb tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:39.321219 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.objects.instance [None req-8eff437c-918e-472a-a784-b361e8e5fdfb tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lazy-loading 'services' on Instance uuid d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a {{(pid=131320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:20:39.351255 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8eff437c-918e-472a-a784-b361e8e5fdfb tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a" status: 200 len: 1927 microversion: 2.75 time: 0.212198 Jul 23 21:20:39.353892 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 863/1776] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:20:39 2022] GET /compute/v2.1/servers/d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a => generated 1927 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:20:39.364241 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-b7f06e9b-a4c4-45d8-95d6-71e2629b9636 req-8ca6bab0-b06b-4db0-9af9-c2bffbc3add2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3075a998-589a-474c-ac0a-3c53f63ab574", "name": "network-vif-plugged", "status": "completed", "tag": "5b53216a-bd51-4bcb-9d1e-76b2724f0d16"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:20:39.374290 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-b7f06e9b-a4c4-45d8-95d6-71e2629b9636 req-8ca6bab0-b06b-4db0-9af9-c2bffbc3add2 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:39.375158 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-b7f06e9b-a4c4-45d8-95d6-71e2629b9636 req-8ca6bab0-b06b-4db0-9af9-c2bffbc3add2 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:39.389090 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-b7f06e9b-a4c4-45d8-95d6-71e2629b9636 req-8ca6bab0-b06b-4db0-9af9-c2bffbc3add2 service nova] Creating event network-vif-plugged:5b53216a-bd51-4bcb-9d1e-76b2724f0d16 for instance 3075a998-589a-474c-ac0a-3c53f63ab574 on nch2-master-1 Jul 23 21:20:39.396759 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-b7f06e9b-a4c4-45d8-95d6-71e2629b9636 req-8ca6bab0-b06b-4db0-9af9-c2bffbc3add2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041363 Jul 23 21:20:39.397643 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 864/1777] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:20:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:20:39.560654 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6bdee703-6f42-4c06-8306-f3cd8a4ab4b8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:39.561990 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6bdee703-6f42-4c06-8306-f3cd8a4ab4b8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:39.570595 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6bdee703-6f42-4c06-8306-f3cd8a4ab4b8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:39.571422 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6bdee703-6f42-4c06-8306-f3cd8a4ab4b8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:39.572592 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6bdee703-6f42-4c06-8306-f3cd8a4ab4b8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:39.573247 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6bdee703-6f42-4c06-8306-f3cd8a4ab4b8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:39.598720 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-dfe114d9-66e3-4423-99fe-171b5b28c4b0 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80673ab800441b4bd1f5858e1df7b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629d02efac724fa29fcfff53e370b69b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:39.610241 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-dfe114d9-66e3-4423-99fe-171b5b28c4b0 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/servers/c1701f99-a44c-48ca-8946-b84c5e163cee" status: 200 len: 1318 microversion: 2.1 time: 0.695876 Jul 23 21:20:39.617275 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 914/1778] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:20:38 2022] GET /compute/v2.1/servers/c1701f99-a44c-48ca-8946-b84c5e163cee => generated 1318 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:20:39.868270 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-8814bfbf-928e-48d3-aace-1ebc7e06de76 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:39.874941 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-8814bfbf-928e-48d3-aace-1ebc7e06de76 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] [instance: 3075a998-589a-474c-ac0a-3c53f63ab574] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:39.885521 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8814bfbf-928e-48d3-aace-1ebc7e06de76 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:39.886448 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8814bfbf-928e-48d3-aace-1ebc7e06de76 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:39.887530 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8814bfbf-928e-48d3-aace-1ebc7e06de76 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:39.888183 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8814bfbf-928e-48d3-aace-1ebc7e06de76 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:40.390829 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6bdee703-6f42-4c06-8306-f3cd8a4ab4b8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:40.412468 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6bdee703-6f42-4c06-8306-f3cd8a4ab4b8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:40.414033 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6bdee703-6f42-4c06-8306-f3cd8a4ab4b8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:40.415604 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6bdee703-6f42-4c06-8306-f3cd8a4ab4b8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1874 microversion: 2.42 time: 0.862435 Jul 23 21:20:40.416502 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 865/1779] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:20:39 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1874 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:20:40.421435 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5fed5091-112c-4492-8098-58b7b6adf70f tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:40.422338 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5fed5091-112c-4492-8098-58b7b6adf70f tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] [instance: 0ff0af19-c9f7-40eb-9c89-f34322c691ac] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:40.430760 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5fed5091-112c-4492-8098-58b7b6adf70f tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:40.431593 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5fed5091-112c-4492-8098-58b7b6adf70f tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:40.432631 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5fed5091-112c-4492-8098-58b7b6adf70f tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:40.433272 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5fed5091-112c-4492-8098-58b7b6adf70f tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:40.798852 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-8814bfbf-928e-48d3-aace-1ebc7e06de76 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '194f98e3c86b48e9952fe02d3648beb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e165633a87b04bd9bc3f6e575f53fb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:40.804922 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5fed5091-112c-4492-8098-58b7b6adf70f tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145e518288ce4d70a12a3f2cc6a91810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f220ba2f42db435a818f3e462aea35a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:40.809800 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-8814bfbf-928e-48d3-aace-1ebc7e06de76 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] 10.222.0.17 "GET /compute/v2.1/servers/3075a998-589a-474c-ac0a-3c53f63ab574" status: 200 len: 1324 microversion: 2.1 time: 0.948349 Jul 23 21:20:40.817536 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5fed5091-112c-4492-8098-58b7b6adf70f tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] 10.222.0.17 "GET /compute/v2.1/servers/0ff0af19-c9f7-40eb-9c89-f34322c691ac" status: 200 len: 1317 microversion: 2.1 time: 0.399914 Jul 23 21:20:40.818916 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 866/1780] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:20:40 2022] GET /compute/v2.1/servers/0ff0af19-c9f7-40eb-9c89-f34322c691ac => generated 1317 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:20:40.826611 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 915/1781] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:20:39 2022] GET /compute/v2.1/servers/3075a998-589a-474c-ac0a-3c53f63ab574 => generated 1324 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:20:40.836511 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-082657bb-cbb0-4494-8b04-3e707db3a666 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:40.843755 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3f86b740-8b12-4cc7-8f3e-cbebf8c5f089 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:40.844134 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-082657bb-cbb0-4494-8b04-3e707db3a666 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] [instance: c1701f99-a44c-48ca-8946-b84c5e163cee] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:40.845054 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-3f86b740-8b12-4cc7-8f3e-cbebf8c5f089 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] [instance: d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:40.855438 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-082657bb-cbb0-4494-8b04-3e707db3a666 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:40.856096 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-082657bb-cbb0-4494-8b04-3e707db3a666 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:40.856751 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3f86b740-8b12-4cc7-8f3e-cbebf8c5f089 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:40.857220 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3f86b740-8b12-4cc7-8f3e-cbebf8c5f089 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:40.858090 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-082657bb-cbb0-4494-8b04-3e707db3a666 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:40.858209 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3f86b740-8b12-4cc7-8f3e-cbebf8c5f089 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:40.858580 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-082657bb-cbb0-4494-8b04-3e707db3a666 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:40.858714 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3f86b740-8b12-4cc7-8f3e-cbebf8c5f089 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:41.026196 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=100 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:20:41.036018 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.objects.instance [None req-3f86b740-8b12-4cc7-8f3e-cbebf8c5f089 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lazy-loading 'services' on Instance uuid d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a {{(pid=131320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:20:41.055923 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-3f86b740-8b12-4cc7-8f3e-cbebf8c5f089 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a" status: 200 len: 1927 microversion: 2.75 time: 0.235660 Jul 23 21:20:41.068255 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 867/1782] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:20:40 2022] GET /compute/v2.1/servers/d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a => generated 1927 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:20:41.388494 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell0:SELECT=20 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:20:41.427570 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-082657bb-cbb0-4494-8b04-3e707db3a666 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80673ab800441b4bd1f5858e1df7b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629d02efac724fa29fcfff53e370b69b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:41.432137 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-f3c628df-ec84-4537-8b99-040704e3d3b7 req-f1b5a3ef-0002-44fa-a4e5-9ff54c9c94ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9933c901-3692-4f36-9f11-e1a93d902e94", "name": "network-vif-plugged", "status": "completed", "tag": "710f608f-25bd-47cb-9727-946c3bac499f"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:20:41.445402 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-f3c628df-ec84-4537-8b99-040704e3d3b7 req-f1b5a3ef-0002-44fa-a4e5-9ff54c9c94ee service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:41.445881 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-f3c628df-ec84-4537-8b99-040704e3d3b7 req-f1b5a3ef-0002-44fa-a4e5-9ff54c9c94ee service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:41.448670 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-082657bb-cbb0-4494-8b04-3e707db3a666 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/servers/c1701f99-a44c-48ca-8946-b84c5e163cee" status: 200 len: 1318 microversion: 2.1 time: 0.617832 Jul 23 21:20:41.449942 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 916/1783] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:20:40 2022] GET /compute/v2.1/servers/c1701f99-a44c-48ca-8946-b84c5e163cee => generated 1318 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:20:41.479601 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-601a44f4-af5f-4e23-93c9-fc70f95e3209 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:41.482002 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-f3c628df-ec84-4537-8b99-040704e3d3b7 req-f1b5a3ef-0002-44fa-a4e5-9ff54c9c94ee service nova] Creating event network-vif-plugged:710f608f-25bd-47cb-9727-946c3bac499f for instance 9933c901-3692-4f36-9f11-e1a93d902e94 on nch1-master-1 Jul 23 21:20:41.486346 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-601a44f4-af5f-4e23-93c9-fc70f95e3209 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:41.491122 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-f3c628df-ec84-4537-8b99-040704e3d3b7 req-f1b5a3ef-0002-44fa-a4e5-9ff54c9c94ee service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064868 Jul 23 21:20:41.492732 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 868/1784] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:20:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:20:41.502680 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-601a44f4-af5f-4e23-93c9-fc70f95e3209 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:41.504049 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-601a44f4-af5f-4e23-93c9-fc70f95e3209 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:41.505673 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-601a44f4-af5f-4e23-93c9-fc70f95e3209 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:41.506372 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-601a44f4-af5f-4e23-93c9-fc70f95e3209 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:41.830227 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1b4baea6-a09b-423a-8b93-22029dcf1b76 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:41.831751 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1b4baea6-a09b-423a-8b93-22029dcf1b76 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] [instance: 3075a998-589a-474c-ac0a-3c53f63ab574] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:41.852781 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1b4baea6-a09b-423a-8b93-22029dcf1b76 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:41.853234 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1b4baea6-a09b-423a-8b93-22029dcf1b76 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:41.854054 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1b4baea6-a09b-423a-8b93-22029dcf1b76 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:41.854504 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1b4baea6-a09b-423a-8b93-22029dcf1b76 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:42.044158 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-601a44f4-af5f-4e23-93c9-fc70f95e3209 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:42.058405 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-601a44f4-af5f-4e23-93c9-fc70f95e3209 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:42.063180 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-601a44f4-af5f-4e23-93c9-fc70f95e3209 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:42.064678 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-601a44f4-af5f-4e23-93c9-fc70f95e3209 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1874 microversion: 2.42 time: 0.613419 Jul 23 21:20:42.065505 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 917/1785] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:20:41 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1874 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:20:42.071157 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-770f91c6-4837-4866-bb0e-e96ebece8a9d tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:42.072064 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-770f91c6-4837-4866-bb0e-e96ebece8a9d tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] [instance: 0ff0af19-c9f7-40eb-9c89-f34322c691ac] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:42.074264 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_api:DELETE=6,nova_api:SELECT=90,nova_api:INSERT=4 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:20:42.081964 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-770f91c6-4837-4866-bb0e-e96ebece8a9d tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:42.082777 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-770f91c6-4837-4866-bb0e-e96ebece8a9d tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:42.083795 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-770f91c6-4837-4866-bb0e-e96ebece8a9d tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:42.084493 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-770f91c6-4837-4866-bb0e-e96ebece8a9d tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:42.091186 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:20:42.425929 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-1b4baea6-a09b-423a-8b93-22029dcf1b76 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '194f98e3c86b48e9952fe02d3648beb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e165633a87b04bd9bc3f6e575f53fb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:42.444046 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1b4baea6-a09b-423a-8b93-22029dcf1b76 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] 10.222.0.17 "GET /compute/v2.1/servers/3075a998-589a-474c-ac0a-3c53f63ab574" status: 200 len: 1520 microversion: 2.1 time: 0.620028 Jul 23 21:20:42.455864 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-770f91c6-4837-4866-bb0e-e96ebece8a9d tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145e518288ce4d70a12a3f2cc6a91810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f220ba2f42db435a818f3e462aea35a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:42.456036 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 869/1786] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:20:41 2022] GET /compute/v2.1/servers/3075a998-589a-474c-ac0a-3c53f63ab574 => generated 1520 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:20:42.463242 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-770f91c6-4837-4866-bb0e-e96ebece8a9d tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] 10.222.0.17 "GET /compute/v2.1/servers/0ff0af19-c9f7-40eb-9c89-f34322c691ac" status: 200 len: 1317 microversion: 2.1 time: 0.395703 Jul 23 21:20:42.464124 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 918/1787] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:20:42 2022] GET /compute/v2.1/servers/0ff0af19-c9f7-40eb-9c89-f34322c691ac => generated 1317 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:20:42.464691 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b5bd1946-5ba4-4a19-9f42-4adc6201f41a tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:42.470657 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b5bd1946-5ba4-4a19-9f42-4adc6201f41a tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] [instance: d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:42.479070 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d66aa39b-f95a-4b4c-9c6a-67014eaef849 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Action: 'action', calling method: .version_select at 0x7f0b57657550>, body: {"addFloatingIp": {"address": "172.35.4.77"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:20:42.480450 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-d66aa39b-f95a-4b4c-9c6a-67014eaef849 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] [instance: 059bbe3e-cf86-4689-a696-0161d7d27dfd] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:42.491785 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b5bd1946-5ba4-4a19-9f42-4adc6201f41a tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:42.492511 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b5bd1946-5ba4-4a19-9f42-4adc6201f41a tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:42.493401 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b5bd1946-5ba4-4a19-9f42-4adc6201f41a tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:42.493984 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b5bd1946-5ba4-4a19-9f42-4adc6201f41a tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:42.501027 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d66aa39b-f95a-4b4c-9c6a-67014eaef849 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:42.501987 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d66aa39b-f95a-4b4c-9c6a-67014eaef849 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:42.503108 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d66aa39b-f95a-4b4c-9c6a-67014eaef849 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:42.503595 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d66aa39b-f95a-4b4c-9c6a-67014eaef849 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:42.605501 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d66aa39b-f95a-4b4c-9c6a-67014eaef849 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Acquired lock "refresh_cache-059bbe3e-cf86-4689-a696-0161d7d27dfd" {{(pid=131321) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 23 21:20:42.641116 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.objects.instance [None req-b5bd1946-5ba4-4a19-9f42-4adc6201f41a tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lazy-loading 'services' on Instance uuid d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a {{(pid=131320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:20:42.674002 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b5bd1946-5ba4-4a19-9f42-4adc6201f41a tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a" status: 200 len: 1927 microversion: 2.75 time: 0.220375 Jul 23 21:20:42.675150 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 870/1788] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:20:42 2022] GET /compute/v2.1/servers/d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a => generated 1927 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:20:42.682641 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9e247d4a-eb89-439c-962c-bc466036633a tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:42.683747 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-9e247d4a-eb89-439c-962c-bc466036633a tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] [instance: c1701f99-a44c-48ca-8946-b84c5e163cee] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:42.692625 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9e247d4a-eb89-439c-962c-bc466036633a tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:42.693505 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9e247d4a-eb89-439c-962c-bc466036633a tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:42.694953 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9e247d4a-eb89-439c-962c-bc466036633a tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:42.695676 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9e247d4a-eb89-439c-962c-bc466036633a tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:43.042575 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-9e247d4a-eb89-439c-962c-bc466036633a tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80673ab800441b4bd1f5858e1df7b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629d02efac724fa29fcfff53e370b69b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:43.066139 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9e247d4a-eb89-439c-962c-bc466036633a tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/servers/c1701f99-a44c-48ca-8946-b84c5e163cee" status: 200 len: 1318 microversion: 2.1 time: 0.387819 Jul 23 21:20:43.067521 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 871/1789] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:20:42 2022] GET /compute/v2.1/servers/c1701f99-a44c-48ca-8946-b84c5e163cee => generated 1318 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:20:43.083936 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9691d356-8ffc-41b3-a8ab-f19c52bad84c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:43.084812 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-9691d356-8ffc-41b3-a8ab-f19c52bad84c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:43.093033 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9691d356-8ffc-41b3-a8ab-f19c52bad84c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:43.093692 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9691d356-8ffc-41b3-a8ab-f19c52bad84c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:43.094716 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9691d356-8ffc-41b3-a8ab-f19c52bad84c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:43.095335 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9691d356-8ffc-41b3-a8ab-f19c52bad84c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:43.535936 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-9691d356-8ffc-41b3-a8ab-f19c52bad84c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:43.551417 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-9691d356-8ffc-41b3-a8ab-f19c52bad84c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:43.553452 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-9691d356-8ffc-41b3-a8ab-f19c52bad84c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:43.555399 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9691d356-8ffc-41b3-a8ab-f19c52bad84c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1874 microversion: 2.42 time: 0.475357 Jul 23 21:20:43.556538 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 872/1790] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:20:43 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1874 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:20:43.577506 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-937de639-14d0-40e9-b234-bc248b842006 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:43.581806 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-937de639-14d0-40e9-b234-bc248b842006 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] [instance: 0ff0af19-c9f7-40eb-9c89-f34322c691ac] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:43.604797 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-937de639-14d0-40e9-b234-bc248b842006 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:43.605600 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-937de639-14d0-40e9-b234-bc248b842006 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:43.606666 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-937de639-14d0-40e9-b234-bc248b842006 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:43.608666 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-937de639-14d0-40e9-b234-bc248b842006 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:44.440812 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-937de639-14d0-40e9-b234-bc248b842006 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145e518288ce4d70a12a3f2cc6a91810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f220ba2f42db435a818f3e462aea35a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:44.445274 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-937de639-14d0-40e9-b234-bc248b842006 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] 10.222.0.17 "GET /compute/v2.1/servers/0ff0af19-c9f7-40eb-9c89-f34322c691ac" status: 200 len: 1317 microversion: 2.1 time: 0.886396 Jul 23 21:20:44.457888 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 873/1791] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:20:43 2022] GET /compute/v2.1/servers/0ff0af19-c9f7-40eb-9c89-f34322c691ac => generated 1317 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:20:44.469915 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-a35e6196-da53-4365-9881-f5e1093dc3a0 req-a54a962c-3cbb-48f6-b1fd-bc9c0adb02ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1701f99-a44c-48ca-8946-b84c5e163cee", "name": "network-vif-plugged", "status": "completed", "tag": "ca008065-59c8-45bf-a4e5-409a38a7c991"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:20:44.482505 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-a35e6196-da53-4365-9881-f5e1093dc3a0 req-a54a962c-3cbb-48f6-b1fd-bc9c0adb02ba service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:44.483140 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-a35e6196-da53-4365-9881-f5e1093dc3a0 req-a54a962c-3cbb-48f6-b1fd-bc9c0adb02ba service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:44.498646 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-a35e6196-da53-4365-9881-f5e1093dc3a0 req-a54a962c-3cbb-48f6-b1fd-bc9c0adb02ba service nova] Creating event network-vif-plugged:ca008065-59c8-45bf-a4e5-409a38a7c991 for instance c1701f99-a44c-48ca-8946-b84c5e163cee on nch1-master-1 Jul 23 21:20:44.507754 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-a35e6196-da53-4365-9881-f5e1093dc3a0 req-a54a962c-3cbb-48f6-b1fd-bc9c0adb02ba service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048015 Jul 23 21:20:44.515215 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 874/1792] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:20:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:20:44.523684 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-bcc04834-4bf7-405e-a110-f4b8fa088d3e tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:44.524742 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-bcc04834-4bf7-405e-a110-f4b8fa088d3e tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] [instance: d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:44.567511 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bcc04834-4bf7-405e-a110-f4b8fa088d3e tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:44.568216 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bcc04834-4bf7-405e-a110-f4b8fa088d3e tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:44.570926 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bcc04834-4bf7-405e-a110-f4b8fa088d3e tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:44.571563 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bcc04834-4bf7-405e-a110-f4b8fa088d3e tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:44.783775 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.objects.instance [None req-bcc04834-4bf7-405e-a110-f4b8fa088d3e tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lazy-loading 'services' on Instance uuid d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a {{(pid=131320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:20:44.806587 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-bcc04834-4bf7-405e-a110-f4b8fa088d3e tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a" status: 200 len: 1927 microversion: 2.75 time: 0.289056 Jul 23 21:20:44.807405 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 875/1793] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:20:44 2022] GET /compute/v2.1/servers/d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a => generated 1927 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:20:44.814079 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-7e250c0a-ec6a-4c15-8983-de1169ae11dd tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:44.817711 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-7e250c0a-ec6a-4c15-8983-de1169ae11dd tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] [instance: c1701f99-a44c-48ca-8946-b84c5e163cee] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:44.834031 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7e250c0a-ec6a-4c15-8983-de1169ae11dd tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:44.834487 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7e250c0a-ec6a-4c15-8983-de1169ae11dd tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:44.837216 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7e250c0a-ec6a-4c15-8983-de1169ae11dd tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:44.837665 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7e250c0a-ec6a-4c15-8983-de1169ae11dd tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:45.273119 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-7e250c0a-ec6a-4c15-8983-de1169ae11dd tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80673ab800441b4bd1f5858e1df7b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629d02efac724fa29fcfff53e370b69b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:45.283512 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-7e250c0a-ec6a-4c15-8983-de1169ae11dd tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/servers/c1701f99-a44c-48ca-8946-b84c5e163cee" status: 200 len: 1318 microversion: 2.1 time: 0.474675 Jul 23 21:20:45.286941 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 876/1794] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:20:44 2022] GET /compute/v2.1/servers/c1701f99-a44c-48ca-8946-b84c5e163cee => generated 1318 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:20:45.292035 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2e3ced18-f9a0-4f69-91df-83822c28ca26 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:45.298742 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-2e3ced18-f9a0-4f69-91df-83822c28ca26 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:45.312655 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2e3ced18-f9a0-4f69-91df-83822c28ca26 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:45.313490 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2e3ced18-f9a0-4f69-91df-83822c28ca26 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:45.322533 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2e3ced18-f9a0-4f69-91df-83822c28ca26 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:45.323236 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2e3ced18-f9a0-4f69-91df-83822c28ca26 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:45.423485 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell0:SELECT=38 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:20:45.494070 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.network.neutron [None req-d66aa39b-f95a-4b4c-9c6a-67014eaef849 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] [instance: 059bbe3e-cf86-4689-a696-0161d7d27dfd] Building network info cache for instance {{(pid=131321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 23 21:20:45.786920 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=12 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:20:46.064912 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-2e3ced18-f9a0-4f69-91df-83822c28ca26 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:46.080417 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-2e3ced18-f9a0-4f69-91df-83822c28ca26 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:46.082364 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-2e3ced18-f9a0-4f69-91df-83822c28ca26 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:46.083714 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2e3ced18-f9a0-4f69-91df-83822c28ca26 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1874 microversion: 2.42 time: 0.795554 Jul 23 21:20:46.084452 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 877/1795] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:20:45 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1874 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:20:46.092182 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4c817a5d-69cc-4c0a-b5da-3a415e851da9 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:46.093049 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-4c817a5d-69cc-4c0a-b5da-3a415e851da9 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] [instance: 0ff0af19-c9f7-40eb-9c89-f34322c691ac] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:46.103781 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4c817a5d-69cc-4c0a-b5da-3a415e851da9 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:46.104653 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4c817a5d-69cc-4c0a-b5da-3a415e851da9 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:46.105603 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4c817a5d-69cc-4c0a-b5da-3a415e851da9 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:46.106302 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4c817a5d-69cc-4c0a-b5da-3a415e851da9 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:46.378037 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.network.neutron [None req-d66aa39b-f95a-4b4c-9c6a-67014eaef849 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] [instance: 059bbe3e-cf86-4689-a696-0161d7d27dfd] Updating instance_info_cache with network_info: [{"id": "53a52999-801e-42e8-afb4-ed6908a0b011", "address": "fa:16:3e:8d:25:6e", "network": {"id": "1bf1175b-8b51-4fe1-8a7e-c57501a7f9a2", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-689906731-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "e165633a87b04bd9bc3f6e575f53fb12", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap53a52999-80", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=131321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 23 21:20:46.396279 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d66aa39b-f95a-4b4c-9c6a-67014eaef849 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Releasing lock "refresh_cache-059bbe3e-cf86-4689-a696-0161d7d27dfd" {{(pid=131321) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 23 21:20:46.397828 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-d66aa39b-f95a-4b4c-9c6a-67014eaef849 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] 10.222.0.17 "POST /compute/v2.1/servers/059bbe3e-cf86-4689-a696-0161d7d27dfd/action" status: 202 len: 0 microversion: 2.1 time: 3.931805 Jul 23 21:20:46.398984 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 919/1796] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:20:42 2022] POST /compute/v2.1/servers/059bbe3e-cf86-4689-a696-0161d7d27dfd/action => generated 0 bytes in 3934 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 23 21:20:46.407752 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-3b491fc4-1127-49c6-963e-c3c41711db41 req-6d729778-a3ba-40ca-b62b-17cc891ba08d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "059bbe3e-cf86-4689-a696-0161d7d27dfd", "tag": "53a52999-801e-42e8-afb4-ed6908a0b011"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:20:46.421107 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-3b491fc4-1127-49c6-963e-c3c41711db41 req-6d729778-a3ba-40ca-b62b-17cc891ba08d service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:46.422835 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-3b491fc4-1127-49c6-963e-c3c41711db41 req-6d729778-a3ba-40ca-b62b-17cc891ba08d service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:46.449061 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-3b491fc4-1127-49c6-963e-c3c41711db41 req-6d729778-a3ba-40ca-b62b-17cc891ba08d service nova] Creating event network-changed:53a52999-801e-42e8-afb4-ed6908a0b011 for instance 059bbe3e-cf86-4689-a696-0161d7d27dfd on nch1-master-1 Jul 23 21:20:46.460773 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-3b491fc4-1127-49c6-963e-c3c41711db41 req-6d729778-a3ba-40ca-b62b-17cc891ba08d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060012 Jul 23 21:20:46.463312 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 920/1797] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:20:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:20:46.472363 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ac2c9ad0-1620-42ad-8e93-a0793f87ae78 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:46.473507 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-ac2c9ad0-1620-42ad-8e93-a0793f87ae78 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] [instance: d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:46.481965 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ac2c9ad0-1620-42ad-8e93-a0793f87ae78 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:46.482724 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ac2c9ad0-1620-42ad-8e93-a0793f87ae78 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:46.484003 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ac2c9ad0-1620-42ad-8e93-a0793f87ae78 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:46.484643 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ac2c9ad0-1620-42ad-8e93-a0793f87ae78 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:46.608656 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-4c817a5d-69cc-4c0a-b5da-3a415e851da9 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145e518288ce4d70a12a3f2cc6a91810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f220ba2f42db435a818f3e462aea35a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:46.626921 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4c817a5d-69cc-4c0a-b5da-3a415e851da9 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] 10.222.0.17 "GET /compute/v2.1/servers/0ff0af19-c9f7-40eb-9c89-f34322c691ac" status: 200 len: 1317 microversion: 2.1 time: 0.540800 Jul 23 21:20:46.627849 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 878/1798] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:20:46 2022] GET /compute/v2.1/servers/0ff0af19-c9f7-40eb-9c89-f34322c691ac => generated 1317 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:20:46.641717 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b2f8ce40-de56-4e1e-a03a-257cd7cd0ccf tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:46.642598 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b2f8ce40-de56-4e1e-a03a-257cd7cd0ccf tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] [instance: c1701f99-a44c-48ca-8946-b84c5e163cee] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:46.652467 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b2f8ce40-de56-4e1e-a03a-257cd7cd0ccf tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:46.652850 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b2f8ce40-de56-4e1e-a03a-257cd7cd0ccf tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:46.653937 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b2f8ce40-de56-4e1e-a03a-257cd7cd0ccf tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:46.662905 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b2f8ce40-de56-4e1e-a03a-257cd7cd0ccf tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:46.680615 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.objects.instance [None req-ac2c9ad0-1620-42ad-8e93-a0793f87ae78 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lazy-loading 'services' on Instance uuid d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a {{(pid=131321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:20:46.739175 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-ac2c9ad0-1620-42ad-8e93-a0793f87ae78 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a" status: 200 len: 1927 microversion: 2.75 time: 0.274143 Jul 23 21:20:46.754655 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 921/1799] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:20:46 2022] GET /compute/v2.1/servers/d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a => generated 1927 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:20:46.776317 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-db7626ed-14eb-4b6a-b2ff-5574dc35c316 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.4.77"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:20:46.793702 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-db7626ed-14eb-4b6a-b2ff-5574dc35c316 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] [instance: 3075a998-589a-474c-ac0a-3c53f63ab574] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:46.814007 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-db7626ed-14eb-4b6a-b2ff-5574dc35c316 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:46.815297 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-db7626ed-14eb-4b6a-b2ff-5574dc35c316 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:46.820415 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-db7626ed-14eb-4b6a-b2ff-5574dc35c316 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:46.821148 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-db7626ed-14eb-4b6a-b2ff-5574dc35c316 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:46.884301 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-db7626ed-14eb-4b6a-b2ff-5574dc35c316 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Acquired lock "refresh_cache-3075a998-589a-474c-ac0a-3c53f63ab574" {{(pid=131321) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 23 21:20:47.591768 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b2f8ce40-de56-4e1e-a03a-257cd7cd0ccf tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80673ab800441b4bd1f5858e1df7b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629d02efac724fa29fcfff53e370b69b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:47.603040 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b2f8ce40-de56-4e1e-a03a-257cd7cd0ccf tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/servers/c1701f99-a44c-48ca-8946-b84c5e163cee" status: 200 len: 1467 microversion: 2.1 time: 0.973861 Jul 23 21:20:47.603928 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 879/1800] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:20:46 2022] GET /compute/v2.1/servers/c1701f99-a44c-48ca-8946-b84c5e163cee => generated 1467 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:20:47.609353 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-e1ef4933-8606-4dff-a7d3-d91a5815c104 req-2cec212f-0fde-40df-9db5-b39fef3c9802 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ff0af19-c9f7-40eb-9c89-f34322c691ac", "name": "network-vif-plugged", "status": "completed", "tag": "452080b0-7def-4fc9-8a29-c38b2cc4e239"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:20:47.645058 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-e1ef4933-8606-4dff-a7d3-d91a5815c104 req-2cec212f-0fde-40df-9db5-b39fef3c9802 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:47.647806 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-e1ef4933-8606-4dff-a7d3-d91a5815c104 req-2cec212f-0fde-40df-9db5-b39fef3c9802 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:47.670492 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-e1ef4933-8606-4dff-a7d3-d91a5815c104 req-2cec212f-0fde-40df-9db5-b39fef3c9802 service nova] Creating event network-vif-plugged:452080b0-7def-4fc9-8a29-c38b2cc4e239 for instance 0ff0af19-c9f7-40eb-9c89-f34322c691ac on nch1-master-1 Jul 23 21:20:47.680809 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-e1ef4933-8606-4dff-a7d3-d91a5815c104 req-2cec212f-0fde-40df-9db5-b39fef3c9802 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074606 Jul 23 21:20:47.682157 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 880/1801] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:20:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:20:47.689756 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-85a57890-1a1e-49a5-9919-e8fb353b6241 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:47.692656 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-85a57890-1a1e-49a5-9919-e8fb353b6241 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:47.708831 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-85a57890-1a1e-49a5-9919-e8fb353b6241 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:47.709590 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-85a57890-1a1e-49a5-9919-e8fb353b6241 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:47.710685 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-85a57890-1a1e-49a5-9919-e8fb353b6241 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:47.711324 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-85a57890-1a1e-49a5-9919-e8fb353b6241 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:48.799235 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-85a57890-1a1e-49a5-9919-e8fb353b6241 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:48.817273 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-85a57890-1a1e-49a5-9919-e8fb353b6241 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:48.834031 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-85a57890-1a1e-49a5-9919-e8fb353b6241 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:48.837836 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-85a57890-1a1e-49a5-9919-e8fb353b6241 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1874 microversion: 2.42 time: 1.152939 Jul 23 21:20:48.842466 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 881/1802] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:20:47 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1874 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:20:48.848754 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-aefc322a-fc07-4fc1-8360-9c4e3bd6afad tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:48.861083 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-aefc322a-fc07-4fc1-8360-9c4e3bd6afad tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] [instance: 9933c901-3692-4f36-9f11-e1a93d902e94] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:48.870262 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-aefc322a-fc07-4fc1-8360-9c4e3bd6afad tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:48.870964 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-aefc322a-fc07-4fc1-8360-9c4e3bd6afad tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:48.871964 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-aefc322a-fc07-4fc1-8360-9c4e3bd6afad tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:48.872614 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-aefc322a-fc07-4fc1-8360-9c4e3bd6afad tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:49.214190 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-aefc322a-fc07-4fc1-8360-9c4e3bd6afad tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80673ab800441b4bd1f5858e1df7b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629d02efac724fa29fcfff53e370b69b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:49.232339 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-aefc322a-fc07-4fc1-8360-9c4e3bd6afad tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/servers/9933c901-3692-4f36-9f11-e1a93d902e94" status: 200 len: 1466 microversion: 2.1 time: 0.388255 Jul 23 21:20:49.235485 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 882/1803] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:20:48 2022] GET /compute/v2.1/servers/9933c901-3692-4f36-9f11-e1a93d902e94 => generated 1466 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:20:49.248695 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b4e25927-e77f-4fea-91e3-8ce9c2791679 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:49.250024 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b4e25927-e77f-4fea-91e3-8ce9c2791679 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] [instance: 0ff0af19-c9f7-40eb-9c89-f34322c691ac] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:49.256211 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:20:49.258182 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b4e25927-e77f-4fea-91e3-8ce9c2791679 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:49.258797 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b4e25927-e77f-4fea-91e3-8ce9c2791679 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:49.259691 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b4e25927-e77f-4fea-91e3-8ce9c2791679 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:49.260209 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b4e25927-e77f-4fea-91e3-8ce9c2791679 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:49.521741 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b4e25927-e77f-4fea-91e3-8ce9c2791679 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145e518288ce4d70a12a3f2cc6a91810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f220ba2f42db435a818f3e462aea35a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:49.584582 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b4e25927-e77f-4fea-91e3-8ce9c2791679 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] 10.222.0.17 "GET /compute/v2.1/servers/0ff0af19-c9f7-40eb-9c89-f34322c691ac" status: 200 len: 1317 microversion: 2.1 time: 0.347719 Jul 23 21:20:49.611109 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 883/1804] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:20:49 2022] GET /compute/v2.1/servers/0ff0af19-c9f7-40eb-9c89-f34322c691ac => generated 1317 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:20:49.617979 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d61b11a7-c5b1-49e4-a239-ad8c37a063c4 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:49.619075 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d61b11a7-c5b1-49e4-a239-ad8c37a063c4 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] [instance: d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:49.643110 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d61b11a7-c5b1-49e4-a239-ad8c37a063c4 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:49.644578 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d61b11a7-c5b1-49e4-a239-ad8c37a063c4 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:49.656386 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d61b11a7-c5b1-49e4-a239-ad8c37a063c4 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:49.656859 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d61b11a7-c5b1-49e4-a239-ad8c37a063c4 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:49.800853 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.objects.instance [None req-d61b11a7-c5b1-49e4-a239-ad8c37a063c4 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lazy-loading 'services' on Instance uuid d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a {{(pid=131320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:20:49.822570 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d61b11a7-c5b1-49e4-a239-ad8c37a063c4 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a" status: 200 len: 1927 microversion: 2.75 time: 0.209748 Jul 23 21:20:49.836500 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 884/1805] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:20:49 2022] GET /compute/v2.1/servers/d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a => generated 1927 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:20:49.842425 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ce7102de-0d35-4a92-8f06-fdfb17ac7c3a tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1624968509"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:20:49.843993 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ce7102de-0d35-4a92-8f06-fdfb17ac7c3a tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] [instance: 9933c901-3692-4f36-9f11-e1a93d902e94] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:49.852603 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ce7102de-0d35-4a92-8f06-fdfb17ac7c3a tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:49.853948 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ce7102de-0d35-4a92-8f06-fdfb17ac7c3a tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:49.855495 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ce7102de-0d35-4a92-8f06-fdfb17ac7c3a tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:49.856307 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ce7102de-0d35-4a92-8f06-fdfb17ac7c3a tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:49.863681 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=100 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:20:50.304561 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ce7102de-0d35-4a92-8f06-fdfb17ac7c3a tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "POST /compute/v2.1/servers/9933c901-3692-4f36-9f11-e1a93d902e94/action" status: 202 len: 0 microversion: 2.1 time: 0.464371 Jul 23 21:20:50.306758 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 885/1806] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:20:49 2022] POST /compute/v2.1/servers/9933c901-3692-4f36-9f11-e1a93d902e94/action => generated 0 bytes in 469 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 23 21:20:50.334649 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-bbfd8d98-2dec-49c6-9b68-fc0c8a6093c0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:50.336088 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-bbfd8d98-2dec-49c6-9b68-fc0c8a6093c0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:50.352610 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bbfd8d98-2dec-49c6-9b68-fc0c8a6093c0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:50.353073 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bbfd8d98-2dec-49c6-9b68-fc0c8a6093c0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:50.358173 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bbfd8d98-2dec-49c6-9b68-fc0c8a6093c0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:50.358796 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bbfd8d98-2dec-49c6-9b68-fc0c8a6093c0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:50.673989 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-bbfd8d98-2dec-49c6-9b68-fc0c8a6093c0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:50.688898 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-bbfd8d98-2dec-49c6-9b68-fc0c8a6093c0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:50.690555 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-bbfd8d98-2dec-49c6-9b68-fc0c8a6093c0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:50.691777 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-bbfd8d98-2dec-49c6-9b68-fc0c8a6093c0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1874 microversion: 2.42 time: 0.383606 Jul 23 21:20:50.692359 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 886/1807] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:20:50 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1874 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:20:50.698018 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e4bf008b-c672-4f9e-aa8c-9197954db98f tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '.version_select at 0x7f0b599bb040>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:50.749518 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e4bf008b-c672-4f9e-aa8c-9197954db98f tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/images/76af21a6-17d9-434a-b039-2b4f2d2c8a7f" status: 200 len: 1455 microversion: 2.1 time: 0.055634 Jul 23 21:20:50.750682 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 887/1808] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:20:50 2022] GET /compute/v2.1/images/76af21a6-17d9-434a-b039-2b4f2d2c8a7f => generated 1455 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:20:50.755521 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-516ee228-8439-483a-b72c-b375dddb890f tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:50.756525 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-516ee228-8439-483a-b72c-b375dddb890f tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] [instance: 0ff0af19-c9f7-40eb-9c89-f34322c691ac] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:50.763490 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-516ee228-8439-483a-b72c-b375dddb890f tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:50.764259 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-516ee228-8439-483a-b72c-b375dddb890f tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:50.765355 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-516ee228-8439-483a-b72c-b375dddb890f tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:50.766337 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-516ee228-8439-483a-b72c-b375dddb890f tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:51.026923 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-516ee228-8439-483a-b72c-b375dddb890f tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145e518288ce4d70a12a3f2cc6a91810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f220ba2f42db435a818f3e462aea35a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:51.037523 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-516ee228-8439-483a-b72c-b375dddb890f tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] 10.222.0.17 "GET /compute/v2.1/servers/0ff0af19-c9f7-40eb-9c89-f34322c691ac" status: 200 len: 1508 microversion: 2.1 time: 0.285466 Jul 23 21:20:51.038062 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 888/1809] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:20:50 2022] GET /compute/v2.1/servers/0ff0af19-c9f7-40eb-9c89-f34322c691ac => generated 1508 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:20:51.049804 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-cb748919-8da9-4ab3-9292-673ac57b8f3d tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:51.049804 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-cb748919-8da9-4ab3-9292-673ac57b8f3d tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] [instance: d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:51.068607 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cb748919-8da9-4ab3-9292-673ac57b8f3d tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:51.069065 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cb748919-8da9-4ab3-9292-673ac57b8f3d tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:51.069878 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cb748919-8da9-4ab3-9292-673ac57b8f3d tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:51.075171 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cb748919-8da9-4ab3-9292-673ac57b8f3d tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:51.251506 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.objects.instance [None req-cb748919-8da9-4ab3-9292-673ac57b8f3d tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lazy-loading 'services' on Instance uuid d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a {{(pid=131320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:20:51.291143 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-cb748919-8da9-4ab3-9292-673ac57b8f3d tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a" status: 200 len: 1927 microversion: 2.75 time: 0.247539 Jul 23 21:20:51.307233 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 889/1810] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:20:51 2022] GET /compute/v2.1/servers/d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a => generated 1927 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:20:51.714607 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d649872d-5743-4f14-82c1-ea2abcf11401 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:51.715734 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d649872d-5743-4f14-82c1-ea2abcf11401 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:51.726180 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d649872d-5743-4f14-82c1-ea2abcf11401 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:51.728214 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d649872d-5743-4f14-82c1-ea2abcf11401 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:51.731012 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d649872d-5743-4f14-82c1-ea2abcf11401 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:51.731740 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d649872d-5743-4f14-82c1-ea2abcf11401 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:52.175536 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d649872d-5743-4f14-82c1-ea2abcf11401 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:52.186669 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d649872d-5743-4f14-82c1-ea2abcf11401 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:52.188209 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d649872d-5743-4f14-82c1-ea2abcf11401 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:52.189406 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d649872d-5743-4f14-82c1-ea2abcf11401 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1874 microversion: 2.42 time: 0.479497 Jul 23 21:20:52.200492 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 890/1811] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:20:51 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1874 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:20:52.200492 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8ae1f1f5-a37f-47a2-85fe-2534cac8ee41 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '.version_select at 0x7f0b4767caf0>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:52.260713 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8ae1f1f5-a37f-47a2-85fe-2534cac8ee41 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/images/76af21a6-17d9-434a-b039-2b4f2d2c8a7f" status: 200 len: 1455 microversion: 2.1 time: 0.068584 Jul 23 21:20:52.262190 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 891/1812] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:20:52 2022] GET /compute/v2.1/images/76af21a6-17d9-434a-b039-2b4f2d2c8a7f => generated 1455 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:20:52.314873 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-db7067e9-ea8c-4ac4-b92a-4e0cbc1811b4 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:52.316339 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-db7067e9-ea8c-4ac4-b92a-4e0cbc1811b4 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] [instance: d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:52.334021 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-db7067e9-ea8c-4ac4-b92a-4e0cbc1811b4 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:52.337342 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-db7067e9-ea8c-4ac4-b92a-4e0cbc1811b4 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:52.338444 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-db7067e9-ea8c-4ac4-b92a-4e0cbc1811b4 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:52.339998 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-db7067e9-ea8c-4ac4-b92a-4e0cbc1811b4 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:52.496093 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.objects.instance [None req-db7067e9-ea8c-4ac4-b92a-4e0cbc1811b4 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lazy-loading 'services' on Instance uuid d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a {{(pid=131320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:20:52.517525 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-db7067e9-ea8c-4ac4-b92a-4e0cbc1811b4 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a" status: 200 len: 1927 microversion: 2.75 time: 0.208483 Jul 23 21:20:52.518940 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 892/1813] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:20:52 2022] GET /compute/v2.1/servers/d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a => generated 1927 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:20:52.722634 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-73bac194-11dd-4c2b-91a2-f33185cee267 tempest-VolumesAdminNegativeTest-1060801855 tempest-VolumesAdminNegativeTest-1060801855-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "716a9d6f-b654-4f69-8193-47039140b86e"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:20:52.723773 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-73bac194-11dd-4c2b-91a2-f33185cee267 tempest-VolumesAdminNegativeTest-1060801855 tempest-VolumesAdminNegativeTest-1060801855-project-admin] [instance: 0ff0af19-c9f7-40eb-9c89-f34322c691ac] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:52.730329 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-73bac194-11dd-4c2b-91a2-f33185cee267 tempest-VolumesAdminNegativeTest-1060801855 tempest-VolumesAdminNegativeTest-1060801855-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:52.731900 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-73bac194-11dd-4c2b-91a2-f33185cee267 tempest-VolumesAdminNegativeTest-1060801855 tempest-VolumesAdminNegativeTest-1060801855-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:52.732862 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-73bac194-11dd-4c2b-91a2-f33185cee267 tempest-VolumesAdminNegativeTest-1060801855 tempest-VolumesAdminNegativeTest-1060801855-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:52.733542 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-73bac194-11dd-4c2b-91a2-f33185cee267 tempest-VolumesAdminNegativeTest-1060801855 tempest-VolumesAdminNegativeTest-1060801855-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:52.789245 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-73bac194-11dd-4c2b-91a2-f33185cee267 tempest-VolumesAdminNegativeTest-1060801855 tempest-VolumesAdminNegativeTest-1060801855-project-admin] HTTP exception thrown: Volume 2f80033d-c0cb-42ce-be77-e61b5e1c266a could not be found. Jul 23 21:20:52.793384 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-73bac194-11dd-4c2b-91a2-f33185cee267 tempest-VolumesAdminNegativeTest-1060801855 tempest-VolumesAdminNegativeTest-1060801855-project-admin] Request method failure captured: Jul 23 21:20:52.793384 ncdv-master-1 devstack@n-api.service[131320]: request: PUT /compute/v2.1/servers/0ff0af19-c9f7-40eb-9c89-f34322c691ac/os-volume_attachments/2f80033d-c0cb-42ce-be77-e61b5e1c266a HTTP/1.1 Jul 23 21:20:52.793384 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:20:52.793384 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:20:52.793384 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:20:52.793384 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 74 Jul 23 21:20:52.793384 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:20:52.793384 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:20:52.793384 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:20:52.793384 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:20:52.793384 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GXFZRsbfRWnB1sWPp8PC6yBwIj_t2XGnb6eij4CrROJXHd9EwCMglkbjVbqRnvS8KEWWhOGLCOt37DFIMTUiCWOgH_lVlztP1_uALVVoI3ccZ3RuGzEJLsaTuKcSZdO5xD4ish0hXDTbnTSgMKFo-JHevRgN4A7hfWGyaA-kZ2DMAk Jul 23 21:20:52.793384 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:20:52.793384 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:20:52.793384 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:20:52.793384 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:20:52.793384 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:20:52.793384 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:20:52.793384 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 2a1692e025cd466cb532b1caa78fa196 Jul 23 21:20:52.793384 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-VolumesAdminNegativeTest-1060801855 Jul 23 21:20:52.793384 ncdv-master-1 devstack@n-api.service[131320]: X-Role: admin,reader,member Jul 23 21:20:52.793384 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: admin,reader,member Jul 23 21:20:52.795118 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2a1692e025cd466cb532b1caa78fa196"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2a1692e025cd466cb532b1caa78fa196"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2a1692e025cd466cb532b1caa78fa196", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2a1692e025cd466cb532b1caa78fa196"}]}] Jul 23 21:20:52.795118 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-VolumesAdminNegativeTest-1060801855 Jul 23 21:20:52.795118 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 2a1692e025cd466cb532b1caa78fa196 Jul 23 21:20:52.795118 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1060801855 Jul 23 21:20:52.795118 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-VolumesAdminNegativeTest-1060801855-project-admin Jul 23 21:20:52.795118 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:20:52.795118 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:20:52.795118 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 460eb04964224ed0a414d2fde153a26a Jul 23 21:20:52.795118 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-VolumesAdminNegativeTest-1060801855-project-admin Jul 23 21:20:52.795118 ncdv-master-1 devstack@n-api.service[131320]: Jul 23 21:20:52.795118 ncdv-master-1 devstack@n-api.service[131320]: {"volumeAttachment": {"volumeId": "716a9d6f-b654-4f69-8193-47039140b86e"}} Jul 23 21:20:52.795118 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:20:52.795118 ncdv-master-1 devstack@n-api.service[131320]: exception: Volume 2f80033d-c0cb-42ce-be77-e61b5e1c266a could not be found. Jul 23 21:20:52.796140 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'server_id': '0ff0af19-c9f7-40eb-9c89-f34322c691ac', 'id': '2f80033d-c0cb-42ce-be77-e61b5e1c266a', 'body': {'volumeAttachment': {'volumeId': '716a9d6f-b654-4f69-8193-47039140b86e'}}} Jul 23 21:20:52.796140 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:20:52.796140 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:52.796140 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 23 21:20:52.796140 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 23 21:20:52.796140 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 23 21:20:52.796140 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 23 21:20:52.796140 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 23 21:20:52.796140 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 23 21:20:52.796140 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 23 21:20:52.796140 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 23 21:20:52.796140 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 23 21:20:52.796140 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 23 21:20:52.796140 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 23 21:20:52.796140 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 23 21:20:52.796140 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 23 21:20:52.796140 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 23 21:20:52.797307 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2f80033d-c0cb-42ce-be77-e61b5e1c266a could not be found. (HTTP 404) (Request-ID: req-1defe7c0-ff48-4e5e-a789-89a5d8deec15) Jul 23 21:20:52.797307 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:20:52.797307 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:20:52.797307 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:20:52.797307 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:52.797307 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Jul 23 21:20:52.797307 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Jul 23 21:20:52.797307 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 23 21:20:52.797307 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 23 21:20:52.797307 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 23 21:20:52.797307 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 23 21:20:52.797307 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 23 21:20:52.797307 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 23 21:20:52.797307 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 23 21:20:52.797307 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 23 21:20:52.797307 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 23 21:20:52.797307 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 23 21:20:52.797307 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 23 21:20:52.797307 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 23 21:20:52.799263 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 23 21:20:52.799263 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 23 21:20:52.799263 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 23 21:20:52.799263 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 23 21:20:52.799263 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 23 21:20:52.799263 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 23 21:20:52.799263 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 23 21:20:52.799263 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 23 21:20:52.799263 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2f80033d-c0cb-42ce-be77-e61b5e1c266a could not be found. Jul 23 21:20:52.799263 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:20:52.799263 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:20:52.799263 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:20:52.799263 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:52.799263 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:20:52.799263 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:20:52.799263 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:20:52.799263 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:20:52.799263 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:20:52.799263 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:20:52.802240 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:20:52.802240 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:20:52.802240 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:20:52.802240 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:20:52.802240 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Jul 23 21:20:52.802240 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Jul 23 21:20:52.802240 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Jul 23 21:20:52.802240 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:20:52.802240 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2f80033d-c0cb-42ce-be77-e61b5e1c266a could not be found. Jul 23 21:20:52.802240 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:20:52.802240 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:20:52.802240 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:20:52.802240 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:52.802240 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:20:52.802240 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:20:52.802240 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:20:52.802240 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:20:52.802240 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2f80033d-c0cb-42ce-be77-e61b5e1c266a could not be found. Jul 23 21:20:52.802240 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:20:52.808124 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-73bac194-11dd-4c2b-91a2-f33185cee267 tempest-VolumesAdminNegativeTest-1060801855 tempest-VolumesAdminNegativeTest-1060801855-project-admin] Returning 404 to user: Volume 2f80033d-c0cb-42ce-be77-e61b5e1c266a could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:20:52.825371 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-73bac194-11dd-4c2b-91a2-f33185cee267 tempest-VolumesAdminNegativeTest-1060801855 tempest-VolumesAdminNegativeTest-1060801855-project-admin] 10.222.0.17 "PUT /compute/v2.1/servers/0ff0af19-c9f7-40eb-9c89-f34322c691ac/os-volume_attachments/2f80033d-c0cb-42ce-be77-e61b5e1c266a" status: 404 len: 109 microversion: 2.1 time: 0.090594 Jul 23 21:20:52.826709 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 893/1814] 10.222.0.17 () {60 vars in 1432 bytes} [Sat Jul 23 21:20:52 2022] PUT /compute/v2.1/servers/0ff0af19-c9f7-40eb-9c89-f34322c691ac/os-volume_attachments/2f80033d-c0cb-42ce-be77-e61b5e1c266a => generated 109 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 23 21:20:52.924123 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-7b0113e9-4bed-4ba3-8de1-c1b27d85f170 req-dee233be-3486-455e-a5e7-9e10d1d3ce16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d09f96e-8ea6-4838-8264-4535f77fa39d", "name": "network-vif-plugged", "status": "completed", "tag": "b0482d57-40b3-4cb7-99d9-4b40a0176e1f"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:20:52.958377 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-7b0113e9-4bed-4ba3-8de1-c1b27d85f170 req-dee233be-3486-455e-a5e7-9e10d1d3ce16 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:52.960278 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-7b0113e9-4bed-4ba3-8de1-c1b27d85f170 req-dee233be-3486-455e-a5e7-9e10d1d3ce16 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:52.996231 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-7b0113e9-4bed-4ba3-8de1-c1b27d85f170 req-dee233be-3486-455e-a5e7-9e10d1d3ce16 service nova] Creating event network-vif-plugged:b0482d57-40b3-4cb7-99d9-4b40a0176e1f for instance 4d09f96e-8ea6-4838-8264-4535f77fa39d on nch2-master-1 Jul 23 21:20:53.014527 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-7b0113e9-4bed-4ba3-8de1-c1b27d85f170 req-dee233be-3486-455e-a5e7-9e10d1d3ce16 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100092 Jul 23 21:20:53.018918 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 894/1815] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:20:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:20:53.210239 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-fa4d0253-07b1-4222-9a7a-9aa0b50d2915 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:53.212836 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-fa4d0253-07b1-4222-9a7a-9aa0b50d2915 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:53.233005 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fa4d0253-07b1-4222-9a7a-9aa0b50d2915 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:53.235556 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fa4d0253-07b1-4222-9a7a-9aa0b50d2915 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:53.242771 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fa4d0253-07b1-4222-9a7a-9aa0b50d2915 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:53.244602 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fa4d0253-07b1-4222-9a7a-9aa0b50d2915 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:54.234349 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-fa4d0253-07b1-4222-9a7a-9aa0b50d2915 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:54.250020 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-fa4d0253-07b1-4222-9a7a-9aa0b50d2915 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:54.254415 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-fa4d0253-07b1-4222-9a7a-9aa0b50d2915 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:54.256138 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-fa4d0253-07b1-4222-9a7a-9aa0b50d2915 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1874 microversion: 2.42 time: 1.051349 Jul 23 21:20:54.260785 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 895/1816] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:20:53 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1874 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:20:54.519897 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b9bb6089-b1fe-4941-a000-e9f6fe364806 tempest-SecurityGroupRulesNegativeTestJSON-879928424 tempest-SecurityGroupRulesNegativeTestJSON-879928424-project] Action: 'create', calling method: .version_select at 0x7f0b599bb790>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1746216476", "description": "tempest-description-1542089767"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:20:54.781417 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b9bb6089-b1fe-4941-a000-e9f6fe364806 tempest-SecurityGroupRulesNegativeTestJSON-879928424 tempest-SecurityGroupRulesNegativeTestJSON-879928424-project] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.518957 Jul 23 21:20:54.782327 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 896/1817] 10.222.0.17 () {60 vars in 1179 bytes} [Sat Jul 23 21:20:54 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:20:54.787442 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-af45064c-c601-46f0-b194-9abdbead7dbb tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '.version_select at 0x7f0b4767c670>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:54.871928 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-af45064c-c601-46f0-b194-9abdbead7dbb tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/images/76af21a6-17d9-434a-b039-2b4f2d2c8a7f" status: 200 len: 1455 microversion: 2.1 time: 0.086995 Jul 23 21:20:54.872590 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 897/1818] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:20:54 2022] GET /compute/v2.1/images/76af21a6-17d9-434a-b039-2b4f2d2c8a7f => generated 1455 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:20:54.885333 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-52e80dea-30a2-4d87-bff6-58607b8d90c9 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:54.886654 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-52e80dea-30a2-4d87-bff6-58607b8d90c9 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] [instance: d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:54.906018 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-52e80dea-30a2-4d87-bff6-58607b8d90c9 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:54.907719 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-52e80dea-30a2-4d87-bff6-58607b8d90c9 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:54.909352 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-52e80dea-30a2-4d87-bff6-58607b8d90c9 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:54.910089 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-52e80dea-30a2-4d87-bff6-58607b8d90c9 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:55.060588 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.objects.instance [None req-52e80dea-30a2-4d87-bff6-58607b8d90c9 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lazy-loading 'services' on Instance uuid d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a {{(pid=131320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:20:55.105576 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-52e80dea-30a2-4d87-bff6-58607b8d90c9 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a" status: 200 len: 1927 microversion: 2.75 time: 0.228939 Jul 23 21:20:55.114201 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 898/1819] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:20:54 2022] GET /compute/v2.1/servers/d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a => generated 1927 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:20:55.125006 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d0a72a89-9b4a-4dc4-85db-2c18e8d1ab30 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:55.125542 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d0a72a89-9b4a-4dc4-85db-2c18e8d1ab30 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] [instance: 0ff0af19-c9f7-40eb-9c89-f34322c691ac] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:55.135662 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d0a72a89-9b4a-4dc4-85db-2c18e8d1ab30 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:55.136122 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d0a72a89-9b4a-4dc4-85db-2c18e8d1ab30 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:55.136897 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d0a72a89-9b4a-4dc4-85db-2c18e8d1ab30 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:55.137343 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d0a72a89-9b4a-4dc4-85db-2c18e8d1ab30 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:55.143491 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.network.neutron [None req-db7626ed-14eb-4b6a-b2ff-5574dc35c316 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] [instance: 3075a998-589a-474c-ac0a-3c53f63ab574] re-assign floating IP 172.35.4.77 from instance 059bbe3e-cf86-4689-a696-0161d7d27dfd Jul 23 21:20:55.172755 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d0a72a89-9b4a-4dc4-85db-2c18e8d1ab30 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] [instance: 0ff0af19-c9f7-40eb-9c89-f34322c691ac] Going to try to terminate instance {{(pid=131320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:20:55.251114 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.network.neutron [None req-db7626ed-14eb-4b6a-b2ff-5574dc35c316 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] [instance: 059bbe3e-cf86-4689-a696-0161d7d27dfd] Building network info cache for instance {{(pid=131321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 23 21:20:55.354744 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d0a72a89-9b4a-4dc4-85db-2c18e8d1ab30 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0ff0af19-c9f7-40eb-9c89-f34322c691ac" status: 204 len: 0 microversion: 2.1 time: 0.236674 Jul 23 21:20:55.355624 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 899/1820] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:20:55 2022] DELETE /compute/v2.1/servers/0ff0af19-c9f7-40eb-9c89-f34322c691ac => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:20:55.362661 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b888c933-bf16-4732-a512-cbcd3d43aaaa tempest-SecurityGroupRulesNegativeTestJSON-879928424 tempest-SecurityGroupRulesNegativeTestJSON-879928424-project] Action: 'create', calling method: .version_select at 0x7f0b5994d4c0>, body: {"security_group_rule": {"parent_group_id": "7f62fc71-4b74-4a0d-8152-6a891869cc8c", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:20:55.747301 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b888c933-bf16-4732-a512-cbcd3d43aaaa tempest-SecurityGroupRulesNegativeTestJSON-879928424 tempest-SecurityGroupRulesNegativeTestJSON-879928424-project] 10.222.0.17 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.390492 Jul 23 21:20:55.755040 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 900/1821] 10.222.0.17 () {60 vars in 1194 bytes} [Sat Jul 23 21:20:55 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:20:55.755575 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-69757a8b-92a7-4dc8-a492-62689eaa9a1c req-98f5747c-c269-4dc7-be34-19097e16caf8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "059bbe3e-cf86-4689-a696-0161d7d27dfd", "tag": "53a52999-801e-42e8-afb4-ed6908a0b011"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:20:55.790350 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-69757a8b-92a7-4dc8-a492-62689eaa9a1c req-98f5747c-c269-4dc7-be34-19097e16caf8 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:55.798799 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-69757a8b-92a7-4dc8-a492-62689eaa9a1c req-98f5747c-c269-4dc7-be34-19097e16caf8 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:55.847822 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-69757a8b-92a7-4dc8-a492-62689eaa9a1c req-98f5747c-c269-4dc7-be34-19097e16caf8 service nova] Creating event network-changed:53a52999-801e-42e8-afb4-ed6908a0b011 for instance 059bbe3e-cf86-4689-a696-0161d7d27dfd on nch1-master-1 Jul 23 21:20:55.861281 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-69757a8b-92a7-4dc8-a492-62689eaa9a1c req-98f5747c-c269-4dc7-be34-19097e16caf8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110446 Jul 23 21:20:55.863321 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 901/1822] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:20:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:20:55.873447 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-c55e5b03-a447-418d-8c7d-6c00538a891a req-3040f088-8406-4eaa-8d8c-2ccfef06f4e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d09f96e-8ea6-4838-8264-4535f77fa39d", "name": "network-vif-plugged", "status": "completed", "tag": "857743d4-9fc9-4509-a86f-9253f99e2a3c"}, {"server_uuid": "4d09f96e-8ea6-4838-8264-4535f77fa39d", "name": "network-vif-plugged", "status": "completed", "tag": "5b177b16-047c-46e8-9195-fbe5aa317e47"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:20:55.900553 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-c55e5b03-a447-418d-8c7d-6c00538a891a req-3040f088-8406-4eaa-8d8c-2ccfef06f4e1 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:55.901347 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-c55e5b03-a447-418d-8c7d-6c00538a891a req-3040f088-8406-4eaa-8d8c-2ccfef06f4e1 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:55.931293 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-c55e5b03-a447-418d-8c7d-6c00538a891a req-3040f088-8406-4eaa-8d8c-2ccfef06f4e1 service nova] Creating event network-vif-plugged:857743d4-9fc9-4509-a86f-9253f99e2a3c for instance 4d09f96e-8ea6-4838-8264-4535f77fa39d on nch2-master-1 Jul 23 21:20:55.932336 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-c55e5b03-a447-418d-8c7d-6c00538a891a req-3040f088-8406-4eaa-8d8c-2ccfef06f4e1 service nova] Creating event network-vif-plugged:5b177b16-047c-46e8-9195-fbe5aa317e47 for instance 4d09f96e-8ea6-4838-8264-4535f77fa39d on nch2-master-1 Jul 23 21:20:55.943888 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-c55e5b03-a447-418d-8c7d-6c00538a891a req-3040f088-8406-4eaa-8d8c-2ccfef06f4e1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.076962 Jul 23 21:20:55.947259 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 902/1823] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:20:55 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:20:55.959188 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-10125a8c-a481-4c62-aae2-341028a96ea2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:55.961558 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-10125a8c-a481-4c62-aae2-341028a96ea2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:55.976338 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-10125a8c-a481-4c62-aae2-341028a96ea2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:55.979395 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-10125a8c-a481-4c62-aae2-341028a96ea2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:55.982128 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-10125a8c-a481-4c62-aae2-341028a96ea2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:55.985577 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-10125a8c-a481-4c62-aae2-341028a96ea2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:56.497611 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-10125a8c-a481-4c62-aae2-341028a96ea2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:56.510745 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-10125a8c-a481-4c62-aae2-341028a96ea2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:56.512240 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-10125a8c-a481-4c62-aae2-341028a96ea2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:56.513404 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-10125a8c-a481-4c62-aae2-341028a96ea2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1874 microversion: 2.42 time: 0.564868 Jul 23 21:20:56.518578 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 903/1824] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:20:55 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1874 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:20:56.524076 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6493e4a2-54f8-4c6c-8073-ff70c82fc6ac tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:56.530564 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6493e4a2-54f8-4c6c-8073-ff70c82fc6ac tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] [instance: 0ff0af19-c9f7-40eb-9c89-f34322c691ac] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:56.549076 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6493e4a2-54f8-4c6c-8073-ff70c82fc6ac tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:56.549529 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6493e4a2-54f8-4c6c-8073-ff70c82fc6ac tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:56.551156 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6493e4a2-54f8-4c6c-8073-ff70c82fc6ac tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:56.551784 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6493e4a2-54f8-4c6c-8073-ff70c82fc6ac tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:56.725411 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.network.neutron [None req-db7626ed-14eb-4b6a-b2ff-5574dc35c316 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] [instance: 059bbe3e-cf86-4689-a696-0161d7d27dfd] Updating instance_info_cache with network_info: [{"id": "53a52999-801e-42e8-afb4-ed6908a0b011", "address": "fa:16:3e:8d:25:6e", "network": {"id": "1bf1175b-8b51-4fe1-8a7e-c57501a7f9a2", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-689906731-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "e165633a87b04bd9bc3f6e575f53fb12", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap53a52999-80", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=131321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 23 21:20:56.775410 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.network.neutron [None req-db7626ed-14eb-4b6a-b2ff-5574dc35c316 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] [instance: 3075a998-589a-474c-ac0a-3c53f63ab574] Building network info cache for instance {{(pid=131321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 23 21:20:56.814442 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_api:SELECT=11 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:20:57.203023 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6493e4a2-54f8-4c6c-8073-ff70c82fc6ac tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145e518288ce4d70a12a3f2cc6a91810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f220ba2f42db435a818f3e462aea35a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:57.214490 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6493e4a2-54f8-4c6c-8073-ff70c82fc6ac tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] 10.222.0.17 "GET /compute/v2.1/servers/0ff0af19-c9f7-40eb-9c89-f34322c691ac" status: 200 len: 1514 microversion: 2.1 time: 0.694007 Jul 23 21:20:57.215468 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 904/1825] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:20:56 2022] GET /compute/v2.1/servers/0ff0af19-c9f7-40eb-9c89-f34322c691ac => generated 1514 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:20:57.228825 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-60679a88-50f3-4082-964a-1ffbffc78805 tempest-SecurityGroupRulesNegativeTestJSON-879928424 tempest-SecurityGroupRulesNegativeTestJSON-879928424-project] Action: 'create', calling method: .version_select at 0x7f0b59979dc0>, body: {"security_group_rule": {"parent_group_id": "7f62fc71-4b74-4a0d-8152-6a891869cc8c", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:20:57.701445 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-60679a88-50f3-4082-964a-1ffbffc78805 tempest-SecurityGroupRulesNegativeTestJSON-879928424 tempest-SecurityGroupRulesNegativeTestJSON-879928424-project] HTTP exception thrown: This rule already exists in group 7f62fc71-4b74-4a0d-8152-6a891869cc8c Jul 23 21:20:57.735191 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-60679a88-50f3-4082-964a-1ffbffc78805 tempest-SecurityGroupRulesNegativeTestJSON-879928424 tempest-SecurityGroupRulesNegativeTestJSON-879928424-project] Request method failure captured: Jul 23 21:20:57.735191 ncdv-master-1 devstack@n-api.service[131320]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 23 21:20:57.735191 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:20:57.735191 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:20:57.735191 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:20:57.735191 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 138 Jul 23 21:20:57.735191 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:20:57.735191 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:20:57.735191 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:20:57.735191 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:20:57.735191 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GY1eT5aQfbTYSZ8qSNpwkGSg_DXCHXUOvKjBgTUhuJ83CNIIyYSoc1Fyp_B_huq4EDc7We7E8ITnNX5UxEv9gWdlXqN3krL8qZXMPSYkiof2TvhkHegRxhZjbuI0cpmpFuuysvO2I379hyBIfQGw_T_wKXrR1iWN_J3LNhV4DyqvUc Jul 23 21:20:57.735191 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:20:57.735191 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:20:57.735191 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:20:57.735191 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:20:57.735191 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:20:57.735191 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:20:57.735191 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 24d534ba297c4d709c5ccf36c9394842 Jul 23 21:20:57.735191 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-879928424 Jul 23 21:20:57.735191 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:20:57.735191 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:20:57.736971 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/24d534ba297c4d709c5ccf36c9394842"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/24d534ba297c4d709c5ccf36c9394842"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_24d534ba297c4d709c5ccf36c9394842", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/24d534ba297c4d709c5ccf36c9394842"}]}] Jul 23 21:20:57.736971 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-879928424 Jul 23 21:20:57.736971 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 24d534ba297c4d709c5ccf36c9394842 Jul 23 21:20:57.736971 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-879928424 Jul 23 21:20:57.736971 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-879928424-project Jul 23 21:20:57.736971 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:20:57.736971 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:20:57.736971 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: a271336fe39f4bcb94d326ddfb7b4365 Jul 23 21:20:57.736971 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-879928424-project Jul 23 21:20:57.736971 ncdv-master-1 devstack@n-api.service[131320]: Jul 23 21:20:57.736971 ncdv-master-1 devstack@n-api.service[131320]: {"security_group_rule": {"parent_group_id": "7f62fc71-4b74-4a0d-8152-6a891869cc8c", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jul 23 21:20:57.736971 ncdv-master-1 devstack@n-api.service[131320]: method: Jul 23 21:20:57.737833 ncdv-master-1 devstack@n-api.service[131320]: exception: This rule already exists in group 7f62fc71-4b74-4a0d-8152-6a891869cc8c Jul 23 21:20:57.737833 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'body': {'security_group_rule': {'parent_group_id': '7f62fc71-4b74-4a0d-8152-6a891869cc8c', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jul 23 21:20:57.737833 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:20:57.737833 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:57.737833 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Jul 23 21:20:57.737833 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Jul 23 21:20:57.737833 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Jul 23 21:20:57.737833 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Jul 23 21:20:57.737833 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 7f62fc71-4b74-4a0d-8152-6a891869cc8c Jul 23 21:20:57.737833 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:20:57.737833 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:20:57.737833 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:20:57.737833 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:57.737833 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:20:57.737833 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:20:57.737833 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:20:57.737833 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:20:57.737833 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:20:57.737833 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:20:57.737833 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:20:57.739327 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:20:57.739327 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Jul 23 21:20:57.739327 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 23 21:20:57.739327 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 7f62fc71-4b74-4a0d-8152-6a891869cc8c Jul 23 21:20:57.739327 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:20:57.739327 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:20:57.739327 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:20:57.739327 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:20:57.739327 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:20:57.739327 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:20:57.739327 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:20:57.739327 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:20:57.739327 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 7f62fc71-4b74-4a0d-8152-6a891869cc8c Jul 23 21:20:57.739327 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:20:57.739327 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-60679a88-50f3-4082-964a-1ffbffc78805 tempest-SecurityGroupRulesNegativeTestJSON-879928424 tempest-SecurityGroupRulesNegativeTestJSON-879928424-project] Returning 400 to user: This rule already exists in group 7f62fc71-4b74-4a0d-8152-6a891869cc8c {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:20:57.740497 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-60679a88-50f3-4082-964a-1ffbffc78805 tempest-SecurityGroupRulesNegativeTestJSON-879928424 tempest-SecurityGroupRulesNegativeTestJSON-879928424-project] 10.222.0.17 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.521078 Jul 23 21:20:57.740497 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 905/1826] 10.222.0.17 () {60 vars in 1194 bytes} [Sat Jul 23 21:20:57 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 522 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 23 21:20:57.747030 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-feebe1c9-69e7-4dec-94c1-841947874bab tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '.version_select at 0x7f0b59a27f70>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:57.908325 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-feebe1c9-69e7-4dec-94c1-841947874bab tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/images/76af21a6-17d9-434a-b039-2b4f2d2c8a7f" status: 200 len: 1455 microversion: 2.1 time: 0.164964 Jul 23 21:20:57.909263 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 906/1827] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:20:57 2022] GET /compute/v2.1/images/76af21a6-17d9-434a-b039-2b4f2d2c8a7f => generated 1455 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:20:57.921233 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-57d39669-5b0f-495f-9137-b36775cb7638 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:57.922646 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-57d39669-5b0f-495f-9137-b36775cb7638 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] [instance: d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:57.940893 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-57d39669-5b0f-495f-9137-b36775cb7638 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:57.941762 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-57d39669-5b0f-495f-9137-b36775cb7638 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:57.942906 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-57d39669-5b0f-495f-9137-b36775cb7638 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:57.943635 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-57d39669-5b0f-495f-9137-b36775cb7638 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:57.950005 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:20:58.427142 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.objects.instance [None req-57d39669-5b0f-495f-9137-b36775cb7638 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lazy-loading 'services' on Instance uuid d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a {{(pid=131320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:20:58.427390 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.network.neutron [None req-db7626ed-14eb-4b6a-b2ff-5574dc35c316 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] [instance: 3075a998-589a-474c-ac0a-3c53f63ab574] Updating instance_info_cache with network_info: [{"id": "5b53216a-bd51-4bcb-9d1e-76b2724f0d16", "address": "fa:16:3e:26:0f:b8", "network": {"id": "1bf1175b-8b51-4fe1-8a7e-c57501a7f9a2", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-689906731-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "e165633a87b04bd9bc3f6e575f53fb12", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap5b53216a-bd", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=131321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 23 21:20:58.447900 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-db7626ed-14eb-4b6a-b2ff-5574dc35c316 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Releasing lock "refresh_cache-3075a998-589a-474c-ac0a-3c53f63ab574" {{(pid=131321) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 23 21:20:58.448892 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-db7626ed-14eb-4b6a-b2ff-5574dc35c316 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] 10.222.0.17 "POST /compute/v2.1/servers/3075a998-589a-474c-ac0a-3c53f63ab574/action" status: 202 len: 0 microversion: 2.1 time: 11.691178 Jul 23 21:20:58.452213 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 922/1828] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:20:46 2022] POST /compute/v2.1/servers/3075a998-589a-474c-ac0a-3c53f63ab574/action => generated 0 bytes in 11695 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 23 21:20:58.465247 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-170d837b-e746-4692-811a-38ec26c9c0b8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:58.469145 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-170d837b-e746-4692-811a-38ec26c9c0b8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:58.486592 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-170d837b-e746-4692-811a-38ec26c9c0b8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:58.487339 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-170d837b-e746-4692-811a-38ec26c9c0b8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:58.488326 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-170d837b-e746-4692-811a-38ec26c9c0b8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:58.489991 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-57d39669-5b0f-495f-9137-b36775cb7638 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a" status: 200 len: 1927 microversion: 2.75 time: 0.579101 Jul 23 21:20:58.490867 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-170d837b-e746-4692-811a-38ec26c9c0b8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:58.494871 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 907/1829] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:20:57 2022] GET /compute/v2.1/servers/d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a => generated 1927 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:20:58.510337 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-383b8545-4b44-43f1-b5b3-fde08f64a5c7 tempest-SecurityGroupRulesNegativeTestJSON-879928424 tempest-SecurityGroupRulesNegativeTestJSON-879928424-project] Calling method '.version_select at 0x7f0b599cdaf0>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:58.980053 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-170d837b-e746-4692-811a-38ec26c9c0b8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:58.996728 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-170d837b-e746-4692-811a-38ec26c9c0b8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:59.006997 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-170d837b-e746-4692-811a-38ec26c9c0b8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:59.008240 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-170d837b-e746-4692-811a-38ec26c9c0b8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1874 microversion: 2.42 time: 0.553776 Jul 23 21:20:59.008822 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 923/1830] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:20:58 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1874 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:20:59.034964 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-ab0cbc20-2a46-441e-b189-b91ec0b16a88 req-087a1d27-679b-4027-9e6d-35bbf0c50bd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3075a998-589a-474c-ac0a-3c53f63ab574", "tag": "5b53216a-bd51-4bcb-9d1e-76b2724f0d16"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:20:59.080056 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-ab0cbc20-2a46-441e-b189-b91ec0b16a88 req-087a1d27-679b-4027-9e6d-35bbf0c50bd2 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:59.097437 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-ab0cbc20-2a46-441e-b189-b91ec0b16a88 req-087a1d27-679b-4027-9e6d-35bbf0c50bd2 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:59.133163 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-ab0cbc20-2a46-441e-b189-b91ec0b16a88 req-087a1d27-679b-4027-9e6d-35bbf0c50bd2 service nova] Creating event network-changed:5b53216a-bd51-4bcb-9d1e-76b2724f0d16 for instance 3075a998-589a-474c-ac0a-3c53f63ab574 on nch2-master-1 Jul 23 21:20:59.157117 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-ab0cbc20-2a46-441e-b189-b91ec0b16a88 req-087a1d27-679b-4027-9e6d-35bbf0c50bd2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.146949 Jul 23 21:20:59.164576 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 924/1831] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:20:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:20:59.177639 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-b5c4c768-613e-435c-ab5c-01b0ee9f6ea9 req-7afcf333-bb4e-4397-9045-cdea4dbe4d1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d09f96e-8ea6-4838-8264-4535f77fa39d", "name": "network-vif-plugged", "status": "completed", "tag": "88d392b5-c81c-4709-b717-629afa3c9a7e"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:20:59.198992 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-b5c4c768-613e-435c-ab5c-01b0ee9f6ea9 req-7afcf333-bb4e-4397-9045-cdea4dbe4d1f service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:59.204716 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-b5c4c768-613e-435c-ab5c-01b0ee9f6ea9 req-7afcf333-bb4e-4397-9045-cdea4dbe4d1f service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:59.229655 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-b5c4c768-613e-435c-ab5c-01b0ee9f6ea9 req-7afcf333-bb4e-4397-9045-cdea4dbe4d1f service nova] Creating event network-vif-plugged:88d392b5-c81c-4709-b717-629afa3c9a7e for instance 4d09f96e-8ea6-4838-8264-4535f77fa39d on nch2-master-1 Jul 23 21:20:59.245249 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-b5c4c768-613e-435c-ab5c-01b0ee9f6ea9 req-7afcf333-bb4e-4397-9045-cdea4dbe4d1f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077246 Jul 23 21:20:59.264595 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 925/1832] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:20:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:20:59.284194 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c6f9d371-1a9b-4031-8cb8-477e1768db84 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:20:59.286494 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-c6f9d371-1a9b-4031-8cb8-477e1768db84 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] [instance: 0ff0af19-c9f7-40eb-9c89-f34322c691ac] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:20:59.304056 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c6f9d371-1a9b-4031-8cb8-477e1768db84 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:59.306515 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c6f9d371-1a9b-4031-8cb8-477e1768db84 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:59.309290 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c6f9d371-1a9b-4031-8cb8-477e1768db84 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:20:59.310361 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c6f9d371-1a9b-4031-8cb8-477e1768db84 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:20:59.706567 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c6f9d371-1a9b-4031-8cb8-477e1768db84 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145e518288ce4d70a12a3f2cc6a91810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f220ba2f42db435a818f3e462aea35a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:20:59.730644 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-c6f9d371-1a9b-4031-8cb8-477e1768db84 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] 10.222.0.17 "GET /compute/v2.1/servers/0ff0af19-c9f7-40eb-9c89-f34322c691ac" status: 200 len: 1472 microversion: 2.1 time: 0.463256 Jul 23 21:20:59.734231 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 926/1833] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:20:59 2022] GET /compute/v2.1/servers/0ff0af19-c9f7-40eb-9c89-f34322c691ac => generated 1472 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:20:59.742679 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-9be03655-9d07-4622-98c9-a9f149126cc9 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Action: 'action', calling method: .version_select at 0x7f0b56e7c430>, body: {"removeFloatingIp": {"address": "172.35.4.77"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:21:00.008111 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-9be03655-9d07-4622-98c9-a9f149126cc9 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] [instance: 3075a998-589a-474c-ac0a-3c53f63ab574] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:21:00.014596 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9be03655-9d07-4622-98c9-a9f149126cc9 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:00.015057 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9be03655-9d07-4622-98c9-a9f149126cc9 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:00.015852 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9be03655-9d07-4622-98c9-a9f149126cc9 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:00.016295 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9be03655-9d07-4622-98c9-a9f149126cc9 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:00.158473 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-383b8545-4b44-43f1-b5b3-fde08f64a5c7 tempest-SecurityGroupRulesNegativeTestJSON-879928424 tempest-SecurityGroupRulesNegativeTestJSON-879928424-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-group-rules/ccaa595e-9234-4e0c-b6dc-be004a368efa" status: 202 len: 0 microversion: 2.1 time: 1.661997 Jul 23 21:21:00.160808 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 908/1834] 10.222.0.17 () {58 vars in 1286 bytes} [Sat Jul 23 21:20:58 2022] DELETE /compute/v2.1/os-security-group-rules/ccaa595e-9234-4e0c-b6dc-be004a368efa => generated 0 bytes in 1665 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:21:00.167294 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4ce906a5-df18-4e58-b405-767a7c664d06 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '.version_select at 0x7f0b59969940>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:00.274233 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4ce906a5-df18-4e58-b405-767a7c664d06 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/images/76af21a6-17d9-434a-b039-2b4f2d2c8a7f" status: 200 len: 1455 microversion: 2.1 time: 0.110026 Jul 23 21:21:00.277738 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 909/1835] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:21:00 2022] GET /compute/v2.1/images/76af21a6-17d9-434a-b039-2b4f2d2c8a7f => generated 1455 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:21:00.318162 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e68c4b9a-178e-4a5a-8df8-15812ec3b946 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:00.319469 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e68c4b9a-178e-4a5a-8df8-15812ec3b946 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] [instance: d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:21:00.343937 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e68c4b9a-178e-4a5a-8df8-15812ec3b946 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:00.344966 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e68c4b9a-178e-4a5a-8df8-15812ec3b946 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:00.351329 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e68c4b9a-178e-4a5a-8df8-15812ec3b946 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:00.353235 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e68c4b9a-178e-4a5a-8df8-15812ec3b946 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:00.475402 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-9be03655-9d07-4622-98c9-a9f149126cc9 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] HTTP exception thrown: Floating IP 172.35.4.77 is not associated with instance 059bbe3e-cf86-4689-a696-0161d7d27dfd. Jul 23 21:21:00.477127 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-9be03655-9d07-4622-98c9-a9f149126cc9 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Request method failure captured: Jul 23 21:21:00.477127 ncdv-master-1 devstack@n-api.service[131321]: request: POST /compute/v2.1/servers/059bbe3e-cf86-4689-a696-0161d7d27dfd/action HTTP/1.1 Jul 23 21:21:00.477127 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:21:00.477127 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:21:00.477127 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:21:00.477127 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 48 Jul 23 21:21:00.477127 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:21:00.477127 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:21:00.477127 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:21:00.477127 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:21:00.477127 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GYCiCSvABggbkRGyW9tVBfmI6PMsNLVagiAjHSJJNKVuWZoEtduA9IL0lOHdtNx1Ght7MZZFPAHrevWH-4ksCxkiY7Aa9MUFIyCTTle61AJS3x1mKuGfuukBb9LGdOubsvWfe19GFqQP6x_U7hVN7id3QYMj3rofVRJAKlk8fD-LMM Jul 23 21:21:00.477127 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:21:00.477127 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:21:00.477127 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:21:00.477127 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:21:00.477127 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:21:00.477127 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:21:00.477127 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: e165633a87b04bd9bc3f6e575f53fb12 Jul 23 21:21:00.477127 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-268320235 Jul 23 21:21:00.477127 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:21:00.477127 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:21:00.478977 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e165633a87b04bd9bc3f6e575f53fb12"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e165633a87b04bd9bc3f6e575f53fb12"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e165633a87b04bd9bc3f6e575f53fb12", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e165633a87b04bd9bc3f6e575f53fb12"}]}] Jul 23 21:21:00.478977 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-268320235 Jul 23 21:21:00.478977 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: e165633a87b04bd9bc3f6e575f53fb12 Jul 23 21:21:00.478977 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-268320235 Jul 23 21:21:00.478977 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-FloatingIPsAssociationTestJSON-268320235-project Jul 23 21:21:00.478977 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:21:00.478977 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:21:00.478977 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 194f98e3c86b48e9952fe02d3648beb0 Jul 23 21:21:00.478977 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-268320235-project Jul 23 21:21:00.478977 ncdv-master-1 devstack@n-api.service[131321]: Jul 23 21:21:00.478977 ncdv-master-1 devstack@n-api.service[131321]: {"removeFloatingIp": {"address": "172.35.4.77"}} Jul 23 21:21:00.478977 ncdv-master-1 devstack@n-api.service[131321]: method: Jul 23 21:21:00.478977 ncdv-master-1 devstack@n-api.service[131321]: exception: Floating IP 172.35.4.77 is not associated with instance 059bbe3e-cf86-4689-a696-0161d7d27dfd. Jul 23 21:21:00.480159 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': '059bbe3e-cf86-4689-a696-0161d7d27dfd', 'body': {'removeFloatingIp': {'address': '172.35.4.77'}}} Jul 23 21:21:00.480159 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:21:00.480159 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:21:00.480159 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:21:00.480159 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:21:00.480159 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:21:00.480159 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:21:00.480159 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:21:00.480159 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:21:00.480159 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:21:00.480159 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:21:00.480159 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:21:00.480159 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:21:00.480159 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Jul 23 21:21:00.480159 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 23 21:21:00.480159 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.35.4.77 is not associated with instance 059bbe3e-cf86-4689-a696-0161d7d27dfd. Jul 23 21:21:00.480159 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:21:00.480159 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:21:00.480159 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:21:00.480159 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:21:00.481960 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:21:00.481960 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:21:00.481960 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:21:00.481960 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:21:00.481960 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.35.4.77 is not associated with instance 059bbe3e-cf86-4689-a696-0161d7d27dfd. Jul 23 21:21:00.481960 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:21:00.481960 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-9be03655-9d07-4622-98c9-a9f149126cc9 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Returning 409 to user: Floating IP 172.35.4.77 is not associated with instance 059bbe3e-cf86-4689-a696-0161d7d27dfd. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:21:00.483408 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-9be03655-9d07-4622-98c9-a9f149126cc9 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] 10.222.0.17 "POST /compute/v2.1/servers/059bbe3e-cf86-4689-a696-0161d7d27dfd/action" status: 409 len: 145 microversion: 2.1 time: 0.745939 Jul 23 21:21:00.484107 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 927/1836] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:20:59 2022] POST /compute/v2.1/servers/059bbe3e-cf86-4689-a696-0161d7d27dfd/action => generated 145 bytes in 748 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 23 21:21:00.491540 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-eb54398f-0b69-4bee-bb31-f6a4784f6179 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:00.493019 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-eb54398f-0b69-4bee-bb31-f6a4784f6179 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:21:00.501077 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-eb54398f-0b69-4bee-bb31-f6a4784f6179 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:00.502874 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-eb54398f-0b69-4bee-bb31-f6a4784f6179 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:00.504283 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-eb54398f-0b69-4bee-bb31-f6a4784f6179 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:00.504928 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-eb54398f-0b69-4bee-bb31-f6a4784f6179 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:00.685650 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.objects.instance [None req-e68c4b9a-178e-4a5a-8df8-15812ec3b946 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lazy-loading 'services' on Instance uuid d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a {{(pid=131320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:21:00.753839 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e68c4b9a-178e-4a5a-8df8-15812ec3b946 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a" status: 200 len: 1927 microversion: 2.75 time: 0.464044 Jul 23 21:21:00.754477 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 910/1837] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:21:00 2022] GET /compute/v2.1/servers/d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a => generated 1927 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:21:00.805719 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f4f7d94d-2643-4ed6-85c1-14884f772ce8 tempest-SecurityGroupRulesNegativeTestJSON-879928424 tempest-SecurityGroupRulesNegativeTestJSON-879928424-project] Action: 'create', calling method: .version_select at 0x7f0b59a531f0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-750323386", "description": "tempest-description-834809976"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:21:00.847640 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-eb54398f-0b69-4bee-bb31-f6a4784f6179 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:21:00.862010 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-eb54398f-0b69-4bee-bb31-f6a4784f6179 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:21:00.864284 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-eb54398f-0b69-4bee-bb31-f6a4784f6179 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:21:00.865824 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-eb54398f-0b69-4bee-bb31-f6a4784f6179 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1874 microversion: 2.42 time: 0.380440 Jul 23 21:21:00.867135 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 928/1838] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:21:00 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1874 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:21:00.872531 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-6995cf37-b22e-4481-bb04-1b12ba39bb4b tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.4.77"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:21:01.054607 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-6995cf37-b22e-4481-bb04-1b12ba39bb4b tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] [instance: 3075a998-589a-474c-ac0a-3c53f63ab574] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:21:01.063477 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6995cf37-b22e-4481-bb04-1b12ba39bb4b tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:01.064760 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6995cf37-b22e-4481-bb04-1b12ba39bb4b tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:01.067085 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6995cf37-b22e-4481-bb04-1b12ba39bb4b tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:01.069375 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6995cf37-b22e-4481-bb04-1b12ba39bb4b tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:01.363385 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f4f7d94d-2643-4ed6-85c1-14884f772ce8 tempest-SecurityGroupRulesNegativeTestJSON-879928424 tempest-SecurityGroupRulesNegativeTestJSON-879928424-project] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.607098 Jul 23 21:21:01.373483 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 911/1839] 10.222.0.17 () {60 vars in 1179 bytes} [Sat Jul 23 21:21:00 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:21:01.380846 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-cf8b55dd-df93-42b8-b3bc-fcf2e6328781 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:01.383009 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-cf8b55dd-df93-42b8-b3bc-fcf2e6328781 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] [instance: 0ff0af19-c9f7-40eb-9c89-f34322c691ac] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:21:01.399328 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cf8b55dd-df93-42b8-b3bc-fcf2e6328781 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:01.407144 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cf8b55dd-df93-42b8-b3bc-fcf2e6328781 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:01.408396 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cf8b55dd-df93-42b8-b3bc-fcf2e6328781 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:01.409103 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cf8b55dd-df93-42b8-b3bc-fcf2e6328781 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:01.446161 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-cf8b55dd-df93-42b8-b3bc-fcf2e6328781 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] HTTP exception thrown: Instance 0ff0af19-c9f7-40eb-9c89-f34322c691ac could not be found. Jul 23 21:21:01.449020 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-cf8b55dd-df93-42b8-b3bc-fcf2e6328781 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Request method failure captured: Jul 23 21:21:01.449020 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/0ff0af19-c9f7-40eb-9c89-f34322c691ac HTTP/1.1 Jul 23 21:21:01.449020 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:21:01.449020 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:21:01.449020 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:21:01.449020 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:21:01.449020 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:21:01.449020 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:21:01.449020 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:21:01.449020 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:21:01.449020 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GW0-cddaGK9eBv6UaE0b4rJ86Es-hyGCoLUcJZ7OqzpCtEXKWoV6ejzaD7AR8e5rEzcwL5leSIzEFTAG19kNosmO80fcReZJqamEbgNOOg42PtV2W80WFx0iPG3TXCP582qkDJAHK6XEtVGw1MzOa9x3yIHcMf_rEXISa4ce5rjGAk Jul 23 21:21:01.449020 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:21:01.449020 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:21:01.449020 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:21:01.449020 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:21:01.449020 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:21:01.449020 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:21:01.449020 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: f220ba2f42db435a818f3e462aea35a2 Jul 23 21:21:01.449020 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-VolumesAdminNegativeTest-1859024807 Jul 23 21:21:01.449020 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:21:01.449020 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:21:01.450604 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f220ba2f42db435a818f3e462aea35a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f220ba2f42db435a818f3e462aea35a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f220ba2f42db435a818f3e462aea35a2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f220ba2f42db435a818f3e462aea35a2"}]}] Jul 23 21:21:01.450604 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-VolumesAdminNegativeTest-1859024807 Jul 23 21:21:01.450604 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: f220ba2f42db435a818f3e462aea35a2 Jul 23 21:21:01.450604 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1859024807 Jul 23 21:21:01.450604 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-VolumesAdminNegativeTest-1859024807-project Jul 23 21:21:01.450604 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:21:01.450604 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:21:01.450604 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 145e518288ce4d70a12a3f2cc6a91810 Jul 23 21:21:01.450604 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-VolumesAdminNegativeTest-1859024807-project Jul 23 21:21:01.450604 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:21:01.450604 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance 0ff0af19-c9f7-40eb-9c89-f34322c691ac could not be found. Jul 23 21:21:01.450604 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '0ff0af19-c9f7-40eb-9c89-f34322c691ac'} Jul 23 21:21:01.451557 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:21:01.451557 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:21:01.451557 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:21:01.451557 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:21:01.451557 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:21:01.451557 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:21:01.451557 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:21:01.451557 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:21:01.451557 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:21:01.451557 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:21:01.451557 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ff0af19-c9f7-40eb-9c89-f34322c691ac could not be found. Jul 23 21:21:01.451557 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:21:01.451557 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:21:01.451557 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:21:01.451557 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:21:01.451557 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:21:01.451557 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:21:01.451557 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:21:01.451557 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:21:01.451557 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:21:01.453767 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:21:01.453767 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:21:01.453767 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:21:01.453767 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:21:01.453767 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:21:01.453767 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:21:01.453767 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:21:01.453767 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ff0af19-c9f7-40eb-9c89-f34322c691ac could not be found. Jul 23 21:21:01.453767 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:21:01.453767 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:21:01.453767 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:21:01.453767 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:21:01.453767 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:21:01.453767 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:21:01.453767 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:21:01.453767 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:21:01.453767 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ff0af19-c9f7-40eb-9c89-f34322c691ac could not be found. Jul 23 21:21:01.453767 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:21:01.459198 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-cf8b55dd-df93-42b8-b3bc-fcf2e6328781 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Returning 404 to user: Instance 0ff0af19-c9f7-40eb-9c89-f34322c691ac could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:21:01.460161 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-cf8b55dd-df93-42b8-b3bc-fcf2e6328781 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] 10.222.0.17 "GET /compute/v2.1/servers/0ff0af19-c9f7-40eb-9c89-f34322c691ac" status: 404 len: 111 microversion: 2.1 time: 0.084051 Jul 23 21:21:01.465978 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 912/1840] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:21:01 2022] GET /compute/v2.1/servers/0ff0af19-c9f7-40eb-9c89-f34322c691ac => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:21:01.480023 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-00b18d3b-d426-48dc-803e-fd0162467198 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '.version_select at 0x7f0b599699d0>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:01.570885 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-00b18d3b-d426-48dc-803e-fd0162467198 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/images/76af21a6-17d9-434a-b039-2b4f2d2c8a7f" status: 200 len: 1455 microversion: 2.1 time: 0.103386 Jul 23 21:21:01.588014 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 913/1841] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:21:01 2022] GET /compute/v2.1/images/76af21a6-17d9-434a-b039-2b4f2d2c8a7f => generated 1455 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:21:01.597603 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-e0bfbb27-c3b6-4745-a30b-e4553e9f4ce0 req-5e596083-1521-44b0-831e-bf87a213a0dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ff0af19-c9f7-40eb-9c89-f34322c691ac", "name": "network-vif-deleted", "tag": "452080b0-7def-4fc9-8a29-c38b2cc4e239"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:21:01.618967 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-e0bfbb27-c3b6-4745-a30b-e4553e9f4ce0 req-5e596083-1521-44b0-831e-bf87a213a0dd service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:01.619839 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-e0bfbb27-c3b6-4745-a30b-e4553e9f4ce0 req-5e596083-1521-44b0-831e-bf87a213a0dd service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:01.670078 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-e0bfbb27-c3b6-4745-a30b-e4553e9f4ce0 req-5e596083-1521-44b0-831e-bf87a213a0dd service nova] Creating event network-vif-deleted:452080b0-7def-4fc9-8a29-c38b2cc4e239 for instance 0ff0af19-c9f7-40eb-9c89-f34322c691ac on nch1-master-1 Jul 23 21:21:01.696794 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-e0bfbb27-c3b6-4745-a30b-e4553e9f4ce0 req-5e596083-1521-44b0-831e-bf87a213a0dd service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107267 Jul 23 21:21:01.702414 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 914/1842] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:21:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:21:01.717082 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4a3fffb2-55c5-492d-bf32-6043f68854af tempest-SecurityGroupRulesNegativeTestJSON-879928424 tempest-SecurityGroupRulesNegativeTestJSON-879928424-project] Action: 'create', calling method: .version_select at 0x7f0b599cfa60>, body: {"security_group_rule": {"parent_group_id": "b9073519-1daf-40ec-8d45-edfdf7263b2d", "ip_protocol": "tcp", "from_port": 2118831525, "to_port": 22}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:21:01.877948 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-4a3fffb2-55c5-492d-bf32-6043f68854af tempest-SecurityGroupRulesNegativeTestJSON-879928424 tempest-SecurityGroupRulesNegativeTestJSON-879928424-project] HTTP exception thrown: Invalid port range 2118831525:22. Former value cannot be greater than the later Jul 23 21:21:01.880197 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4a3fffb2-55c5-492d-bf32-6043f68854af tempest-SecurityGroupRulesNegativeTestJSON-879928424 tempest-SecurityGroupRulesNegativeTestJSON-879928424-project] Request method failure captured: Jul 23 21:21:01.880197 ncdv-master-1 devstack@n-api.service[131320]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 23 21:21:01.880197 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:21:01.880197 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:21:01.880197 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:21:01.880197 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 146 Jul 23 21:21:01.880197 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:21:01.880197 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:21:01.880197 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:21:01.880197 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:21:01.880197 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GY1eT5aQfbTYSZ8qSNpwkGSg_DXCHXUOvKjBgTUhuJ83CNIIyYSoc1Fyp_B_huq4EDc7We7E8ITnNX5UxEv9gWdlXqN3krL8qZXMPSYkiof2TvhkHegRxhZjbuI0cpmpFuuysvO2I379hyBIfQGw_T_wKXrR1iWN_J3LNhV4DyqvUc Jul 23 21:21:01.880197 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:21:01.880197 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:21:01.880197 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:21:01.880197 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:21:01.880197 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:21:01.880197 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:21:01.880197 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 24d534ba297c4d709c5ccf36c9394842 Jul 23 21:21:01.880197 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-879928424 Jul 23 21:21:01.880197 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:21:01.880197 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:21:01.881797 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/24d534ba297c4d709c5ccf36c9394842"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/24d534ba297c4d709c5ccf36c9394842"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_24d534ba297c4d709c5ccf36c9394842", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/24d534ba297c4d709c5ccf36c9394842"}]}] Jul 23 21:21:01.881797 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-879928424 Jul 23 21:21:01.881797 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 24d534ba297c4d709c5ccf36c9394842 Jul 23 21:21:01.881797 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-879928424 Jul 23 21:21:01.881797 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-879928424-project Jul 23 21:21:01.881797 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:21:01.881797 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:21:01.881797 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: a271336fe39f4bcb94d326ddfb7b4365 Jul 23 21:21:01.881797 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-879928424-project Jul 23 21:21:01.881797 ncdv-master-1 devstack@n-api.service[131320]: Jul 23 21:21:01.881797 ncdv-master-1 devstack@n-api.service[131320]: {"security_group_rule": {"parent_group_id": "b9073519-1daf-40ec-8d45-edfdf7263b2d", "ip_protocol": "tcp", "from_port": 2118831525, "to_port": 22}} Jul 23 21:21:01.881797 ncdv-master-1 devstack@n-api.service[131320]: method: Jul 23 21:21:01.882998 ncdv-master-1 devstack@n-api.service[131320]: exception: Invalid port range 2118831525:22. Former value cannot be greater than the later Jul 23 21:21:01.882998 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'b9073519-1daf-40ec-8d45-edfdf7263b2d', 'ip_protocol': 'tcp', 'from_port': 2118831525, 'to_port': 22}}} Jul 23 21:21:01.882998 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:21:01.882998 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:21:01.882998 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 23 21:21:01.882998 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 23 21:21:01.882998 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 23 21:21:01.882998 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 23 21:21:01.882998 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 23 21:21:01.882998 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 23 21:21:01.882998 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Jul 23 21:21:01.882998 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jul 23 21:21:01.882998 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 2118831525:22. Former value cannot be greater than the later Jul 23 21:21:01.882998 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:21:01.882998 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:21:01.882998 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:21:01.882998 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:21:01.882998 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:21:01.882998 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:21:01.884389 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:21:01.884389 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:21:01.884389 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:21:01.884389 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:21:01.884389 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:21:01.884389 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:21:01.884389 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 23 21:21:01.884389 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 23 21:21:01.884389 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 2118831525:22. Former value cannot be greater than the later Jul 23 21:21:01.884389 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:21:01.884389 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:21:01.884389 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:21:01.884389 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:21:01.884389 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:21:01.884389 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:21:01.884389 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:21:01.884389 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:21:01.884389 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 2118831525:22. Former value cannot be greater than the later Jul 23 21:21:01.884389 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:21:01.887684 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4a3fffb2-55c5-492d-bf32-6043f68854af tempest-SecurityGroupRulesNegativeTestJSON-879928424 tempest-SecurityGroupRulesNegativeTestJSON-879928424-project] Returning 400 to user: Invalid port range 2118831525:22. Former value cannot be greater than the later {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:21:01.888532 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4a3fffb2-55c5-492d-bf32-6043f68854af tempest-SecurityGroupRulesNegativeTestJSON-879928424 tempest-SecurityGroupRulesNegativeTestJSON-879928424-project] 10.222.0.17 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.184825 Jul 23 21:21:01.889718 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 915/1843] 10.222.0.17 () {60 vars in 1194 bytes} [Sat Jul 23 21:21:01 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 187 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 23 21:21:01.900011 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-1cc03044-4521-46c4-95f9-c8fc8ecc44da req-261be53b-937a-4920-959b-1d0a27f41ad6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9933c901-3692-4f36-9f11-e1a93d902e94", "name": "network-vif-plugged", "status": "completed", "tag": "710f608f-25bd-47cb-9727-946c3bac499f"}, {"server_uuid": "4d09f96e-8ea6-4838-8264-4535f77fa39d", "name": "network-vif-plugged", "status": "completed", "tag": "5765f451-685a-407c-8012-c24d49c52d7c"}, {"server_uuid": "4d09f96e-8ea6-4838-8264-4535f77fa39d", "name": "network-vif-plugged", "status": "completed", "tag": "6a3326c3-3a2b-413d-aced-917b1a1798b5"}, {"server_uuid": "4d09f96e-8ea6-4838-8264-4535f77fa39d", "name": "network-vif-plugged", "status": "completed", "tag": "f0b13207-ab63-4a3b-9a07-970de92220c8"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:21:01.921134 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-1cc03044-4521-46c4-95f9-c8fc8ecc44da req-261be53b-937a-4920-959b-1d0a27f41ad6 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:01.921582 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-1cc03044-4521-46c4-95f9-c8fc8ecc44da req-261be53b-937a-4920-959b-1d0a27f41ad6 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:01.928679 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6995cf37-b22e-4481-bb04-1b12ba39bb4b tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Acquired lock "refresh_cache-3075a998-589a-474c-ac0a-3c53f63ab574" {{(pid=131321) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 23 21:21:01.952533 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-1cc03044-4521-46c4-95f9-c8fc8ecc44da req-261be53b-937a-4920-959b-1d0a27f41ad6 service nova] Creating event network-vif-plugged:710f608f-25bd-47cb-9727-946c3bac499f for instance 9933c901-3692-4f36-9f11-e1a93d902e94 on nch1-master-1 Jul 23 21:21:01.953469 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-1cc03044-4521-46c4-95f9-c8fc8ecc44da req-261be53b-937a-4920-959b-1d0a27f41ad6 service nova] Creating event network-vif-plugged:5765f451-685a-407c-8012-c24d49c52d7c for instance 4d09f96e-8ea6-4838-8264-4535f77fa39d on nch2-master-1 Jul 23 21:21:01.954571 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-1cc03044-4521-46c4-95f9-c8fc8ecc44da req-261be53b-937a-4920-959b-1d0a27f41ad6 service nova] Creating event network-vif-plugged:6a3326c3-3a2b-413d-aced-917b1a1798b5 for instance 4d09f96e-8ea6-4838-8264-4535f77fa39d on nch2-master-1 Jul 23 21:21:01.954571 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-1cc03044-4521-46c4-95f9-c8fc8ecc44da req-261be53b-937a-4920-959b-1d0a27f41ad6 service nova] Creating event network-vif-plugged:f0b13207-ab63-4a3b-9a07-970de92220c8 for instance 4d09f96e-8ea6-4838-8264-4535f77fa39d on nch2-master-1 Jul 23 21:21:01.972335 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-1cc03044-4521-46c4-95f9-c8fc8ecc44da req-261be53b-937a-4920-959b-1d0a27f41ad6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.081179 Jul 23 21:21:01.974341 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 916/1844] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:21:01 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:21:01.982808 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-7ba54405-c180-4a1a-9109-989e70dac3ff tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:01.984078 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-7ba54405-c180-4a1a-9109-989e70dac3ff tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] [instance: d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:21:01.994257 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7ba54405-c180-4a1a-9109-989e70dac3ff tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:01.995536 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7ba54405-c180-4a1a-9109-989e70dac3ff tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:01.996324 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7ba54405-c180-4a1a-9109-989e70dac3ff tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:01.996998 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7ba54405-c180-4a1a-9109-989e70dac3ff tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:02.145222 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.objects.instance [None req-7ba54405-c180-4a1a-9109-989e70dac3ff tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lazy-loading 'services' on Instance uuid d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a {{(pid=131320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:21:02.183716 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-7ba54405-c180-4a1a-9109-989e70dac3ff tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a" status: 200 len: 1933 microversion: 2.75 time: 0.207695 Jul 23 21:21:02.200016 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 917/1845] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:21:01 2022] GET /compute/v2.1/servers/d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a => generated 1933 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:21:02.217358 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9b2b4bd7-7eee-4bf7-a525-718eb6939185 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:02.219966 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-9b2b4bd7-7eee-4bf7-a525-718eb6939185 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:21:02.239495 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9b2b4bd7-7eee-4bf7-a525-718eb6939185 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:02.239968 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9b2b4bd7-7eee-4bf7-a525-718eb6939185 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:02.240800 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9b2b4bd7-7eee-4bf7-a525-718eb6939185 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:02.241244 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9b2b4bd7-7eee-4bf7-a525-718eb6939185 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:02.875491 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-9b2b4bd7-7eee-4bf7-a525-718eb6939185 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:21:02.904028 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-9b2b4bd7-7eee-4bf7-a525-718eb6939185 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:21:02.911223 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-9b2b4bd7-7eee-4bf7-a525-718eb6939185 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:21:02.912592 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9b2b4bd7-7eee-4bf7-a525-718eb6939185 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1874 microversion: 2.42 time: 0.711265 Jul 23 21:21:02.914005 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 918/1846] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:21:02 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1874 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:21:02.924859 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-563b0f82-a250-4eac-b869-e8d17c8a8e6d tempest-SecurityGroupRulesNegativeTestJSON-879928424 tempest-SecurityGroupRulesNegativeTestJSON-879928424-project] Action: 'create', calling method: .version_select at 0x7f0b59a27b80>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-298857922", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:21:02.926682 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-563b0f82-a250-4eac-b869-e8d17c8a8e6d tempest-SecurityGroupRulesNegativeTestJSON-879928424 tempest-SecurityGroupRulesNegativeTestJSON-879928424-project] HTTP exception thrown: Security group id should be uuid Jul 23 21:21:02.933058 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-563b0f82-a250-4eac-b869-e8d17c8a8e6d tempest-SecurityGroupRulesNegativeTestJSON-879928424 tempest-SecurityGroupRulesNegativeTestJSON-879928424-project] Request method failure captured: Jul 23 21:21:02.933058 ncdv-master-1 devstack@n-api.service[131320]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 23 21:21:02.933058 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:21:02.933058 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:21:02.933058 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:21:02.933058 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 130 Jul 23 21:21:02.933058 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:21:02.933058 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:21:02.933058 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:21:02.933058 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:21:02.933058 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GY1eT5aQfbTYSZ8qSNpwkGSg_DXCHXUOvKjBgTUhuJ83CNIIyYSoc1Fyp_B_huq4EDc7We7E8ITnNX5UxEv9gWdlXqN3krL8qZXMPSYkiof2TvhkHegRxhZjbuI0cpmpFuuysvO2I379hyBIfQGw_T_wKXrR1iWN_J3LNhV4DyqvUc Jul 23 21:21:02.933058 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:21:02.933058 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:21:02.933058 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:21:02.933058 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:21:02.933058 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:21:02.933058 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:21:02.933058 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 24d534ba297c4d709c5ccf36c9394842 Jul 23 21:21:02.933058 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-879928424 Jul 23 21:21:02.933058 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:21:02.933058 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:21:02.934557 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/24d534ba297c4d709c5ccf36c9394842"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/24d534ba297c4d709c5ccf36c9394842"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_24d534ba297c4d709c5ccf36c9394842", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/24d534ba297c4d709c5ccf36c9394842"}]}] Jul 23 21:21:02.934557 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-879928424 Jul 23 21:21:02.934557 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 24d534ba297c4d709c5ccf36c9394842 Jul 23 21:21:02.934557 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-879928424 Jul 23 21:21:02.934557 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-879928424-project Jul 23 21:21:02.934557 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:21:02.934557 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:21:02.934557 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: a271336fe39f4bcb94d326ddfb7b4365 Jul 23 21:21:02.934557 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-879928424-project Jul 23 21:21:02.934557 ncdv-master-1 devstack@n-api.service[131320]: Jul 23 21:21:02.934557 ncdv-master-1 devstack@n-api.service[131320]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-298857922", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jul 23 21:21:02.934557 ncdv-master-1 devstack@n-api.service[131320]: method: Jul 23 21:21:02.934557 ncdv-master-1 devstack@n-api.service[131320]: exception: Security group id should be uuid Jul 23 21:21:02.935480 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-298857922', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jul 23 21:21:02.935480 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:21:02.935480 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:21:02.935480 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Jul 23 21:21:02.935480 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Jul 23 21:21:02.935480 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Jul 23 21:21:02.935480 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Jul 23 21:21:02.935480 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Jul 23 21:21:02.935480 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:21:02.935480 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:21:02.935480 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:21:02.935480 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:21:02.935480 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:21:02.935480 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:21:02.935480 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:21:02.935480 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:21:02.935480 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:21:02.935480 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:21:02.935480 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:21:02.935480 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:21:02.938246 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 23 21:21:02.938246 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 23 21:21:02.938246 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Jul 23 21:21:02.938246 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:21:02.938246 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:21:02.938246 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:21:02.938246 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:21:02.938246 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:21:02.938246 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:21:02.938246 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:21:02.938246 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:21:02.938246 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Jul 23 21:21:02.938246 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:21:02.938246 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-563b0f82-a250-4eac-b869-e8d17c8a8e6d tempest-SecurityGroupRulesNegativeTestJSON-879928424 tempest-SecurityGroupRulesNegativeTestJSON-879928424-project] Returning 400 to user: Security group id should be uuid {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:21:02.938246 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-563b0f82-a250-4eac-b869-e8d17c8a8e6d tempest-SecurityGroupRulesNegativeTestJSON-879928424 tempest-SecurityGroupRulesNegativeTestJSON-879928424-project] 10.222.0.17 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.019516 Jul 23 21:21:02.940749 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 919/1847] 10.222.0.17 () {60 vars in 1194 bytes} [Sat Jul 23 21:21:02 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 23 21:21:02.950268 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5e8947d5-57e9-4618-9424-4d21ffb103e7 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '.version_select at 0x7f0b59969f70>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:03.042751 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5e8947d5-57e9-4618-9424-4d21ffb103e7 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/images/76af21a6-17d9-434a-b039-2b4f2d2c8a7f" status: 200 len: 1455 microversion: 2.1 time: 0.101733 Jul 23 21:21:03.057065 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 920/1848] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:21:02 2022] GET /compute/v2.1/images/76af21a6-17d9-434a-b039-2b4f2d2c8a7f => generated 1455 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:21:03.068551 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-bf7109c0-9c94-4d25-8eeb-4690c40fe1d3 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:03.068961 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-bf7109c0-9c94-4d25-8eeb-4690c40fe1d3 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] [instance: f53ce882-4694-421d-8075-5e8cfab0b16f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:21:03.083787 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bf7109c0-9c94-4d25-8eeb-4690c40fe1d3 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:03.084605 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bf7109c0-9c94-4d25-8eeb-4690c40fe1d3 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:03.085926 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bf7109c0-9c94-4d25-8eeb-4690c40fe1d3 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:03.086557 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bf7109c0-9c94-4d25-8eeb-4690c40fe1d3 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:03.136469 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-bf7109c0-9c94-4d25-8eeb-4690c40fe1d3 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] [instance: f53ce882-4694-421d-8075-5e8cfab0b16f] Going to try to terminate instance {{(pid=131320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:21:03.367290 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-bf7109c0-9c94-4d25-8eeb-4690c40fe1d3 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] 10.222.0.17 "DELETE /compute/v2.1/servers/f53ce882-4694-421d-8075-5e8cfab0b16f" status: 204 len: 0 microversion: 2.1 time: 0.308655 Jul 23 21:21:03.369844 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 921/1849] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:21:03 2022] DELETE /compute/v2.1/servers/f53ce882-4694-421d-8075-5e8cfab0b16f => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:21:03.384958 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-95ce7dc2-a2e3-4c04-a229-1d2247f614b7 tempest-SecurityGroupRulesNegativeTestJSON-879928424 tempest-SecurityGroupRulesNegativeTestJSON-879928424-project] Action: 'create', calling method: .version_select at 0x7f0b59979820>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1686337918", "description": "tempest-description-541572913"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:21:03.459024 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.network.neutron [None req-6995cf37-b22e-4481-bb04-1b12ba39bb4b tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] [instance: 3075a998-589a-474c-ac0a-3c53f63ab574] Building network info cache for instance {{(pid=131321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 23 21:21:03.806535 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-95ce7dc2-a2e3-4c04-a229-1d2247f614b7 tempest-SecurityGroupRulesNegativeTestJSON-879928424 tempest-SecurityGroupRulesNegativeTestJSON-879928424-project] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.433522 Jul 23 21:21:03.807310 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 922/1850] 10.222.0.17 () {60 vars in 1179 bytes} [Sat Jul 23 21:21:03 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:21:03.813369 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f3ce2fb3-5ada-40c1-936e-1564a5101a37 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:03.814510 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f3ce2fb3-5ada-40c1-936e-1564a5101a37 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] [instance: d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:21:03.837082 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f3ce2fb3-5ada-40c1-936e-1564a5101a37 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:03.837829 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f3ce2fb3-5ada-40c1-936e-1564a5101a37 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:03.839027 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f3ce2fb3-5ada-40c1-936e-1564a5101a37 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:03.839938 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f3ce2fb3-5ada-40c1-936e-1564a5101a37 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:04.047346 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.objects.instance [None req-f3ce2fb3-5ada-40c1-936e-1564a5101a37 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] Lazy-loading 'services' on Instance uuid d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a {{(pid=131320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:21:04.109877 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f3ce2fb3-5ada-40c1-936e-1564a5101a37 tempest-ServersAdmin275Test-964902224 tempest-ServersAdmin275Test-964902224-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a" status: 200 len: 1918 microversion: 2.75 time: 0.300966 Jul 23 21:21:04.114865 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 923/1851] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:21:03 2022] GET /compute/v2.1/servers/d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a => generated 1918 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:21:04.125453 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8a1783f2-0063-464c-ab63-5dad916b4f2b tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:04.136637 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8a1783f2-0063-464c-ab63-5dad916b4f2b tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] [instance: f53ce882-4694-421d-8075-5e8cfab0b16f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:21:04.154045 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8a1783f2-0063-464c-ab63-5dad916b4f2b tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:04.158047 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8a1783f2-0063-464c-ab63-5dad916b4f2b tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:04.159324 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8a1783f2-0063-464c-ab63-5dad916b4f2b tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:04.160335 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8a1783f2-0063-464c-ab63-5dad916b4f2b tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:04.513507 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8a1783f2-0063-464c-ab63-5dad916b4f2b tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145e518288ce4d70a12a3f2cc6a91810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f220ba2f42db435a818f3e462aea35a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:21:04.534444 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8a1783f2-0063-464c-ab63-5dad916b4f2b tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] 10.222.0.17 "GET /compute/v2.1/servers/f53ce882-4694-421d-8075-5e8cfab0b16f" status: 200 len: 1682 microversion: 2.1 time: 0.411608 Jul 23 21:21:04.535946 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 924/1852] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:21:04 2022] GET /compute/v2.1/servers/f53ce882-4694-421d-8075-5e8cfab0b16f => generated 1682 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:21:04.561577 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e91edb89-5842-4a47-9cc3-f561cb84a2ef tempest-SecurityGroupRulesNegativeTestJSON-879928424 tempest-SecurityGroupRulesNegativeTestJSON-879928424-project] Action: 'create', calling method: .version_select at 0x7f0b5998de50>, body: {"security_group_rule": {"parent_group_id": "ba24e399-f11c-4dd8-9716-1d7b56cc9683", "ip_protocol": "tempest-999-1356438312", "from_port": 22, "to_port": 22}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:21:04.681996 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-e91edb89-5842-4a47-9cc3-f561cb84a2ef tempest-SecurityGroupRulesNegativeTestJSON-879928424 tempest-SecurityGroupRulesNegativeTestJSON-879928424-project] HTTP exception thrown: Invalid IP protocol tempest-999-1356438312. Jul 23 21:21:04.683623 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e91edb89-5842-4a47-9cc3-f561cb84a2ef tempest-SecurityGroupRulesNegativeTestJSON-879928424 tempest-SecurityGroupRulesNegativeTestJSON-879928424-project] Request method failure captured: Jul 23 21:21:04.683623 ncdv-master-1 devstack@n-api.service[131320]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 23 21:21:04.683623 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:21:04.683623 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:21:04.683623 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:21:04.683623 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 157 Jul 23 21:21:04.683623 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:21:04.683623 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:21:04.683623 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:21:04.683623 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:21:04.683623 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GY1eT5aQfbTYSZ8qSNpwkGSg_DXCHXUOvKjBgTUhuJ83CNIIyYSoc1Fyp_B_huq4EDc7We7E8ITnNX5UxEv9gWdlXqN3krL8qZXMPSYkiof2TvhkHegRxhZjbuI0cpmpFuuysvO2I379hyBIfQGw_T_wKXrR1iWN_J3LNhV4DyqvUc Jul 23 21:21:04.683623 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:21:04.683623 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:21:04.683623 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:21:04.683623 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:21:04.683623 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:21:04.683623 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:21:04.683623 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 24d534ba297c4d709c5ccf36c9394842 Jul 23 21:21:04.683623 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-879928424 Jul 23 21:21:04.683623 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:21:04.683623 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:21:04.685121 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/24d534ba297c4d709c5ccf36c9394842"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/24d534ba297c4d709c5ccf36c9394842"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_24d534ba297c4d709c5ccf36c9394842", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/24d534ba297c4d709c5ccf36c9394842"}]}] Jul 23 21:21:04.685121 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-879928424 Jul 23 21:21:04.685121 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 24d534ba297c4d709c5ccf36c9394842 Jul 23 21:21:04.685121 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-879928424 Jul 23 21:21:04.685121 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-879928424-project Jul 23 21:21:04.685121 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:21:04.685121 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:21:04.685121 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: a271336fe39f4bcb94d326ddfb7b4365 Jul 23 21:21:04.685121 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-879928424-project Jul 23 21:21:04.685121 ncdv-master-1 devstack@n-api.service[131320]: Jul 23 21:21:04.685121 ncdv-master-1 devstack@n-api.service[131320]: {"security_group_rule": {"parent_group_id": "ba24e399-f11c-4dd8-9716-1d7b56cc9683", "ip_protocol": "tempest-999-1356438312", "from_port": 22, "to_port": 22}} Jul 23 21:21:04.685121 ncdv-master-1 devstack@n-api.service[131320]: method: Jul 23 21:21:04.685121 ncdv-master-1 devstack@n-api.service[131320]: exception: Invalid IP protocol tempest-999-1356438312. Jul 23 21:21:04.686108 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'ba24e399-f11c-4dd8-9716-1d7b56cc9683', 'ip_protocol': 'tempest-999-1356438312', 'from_port': 22, 'to_port': 22}}} Jul 23 21:21:04.686108 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:21:04.686108 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:21:04.686108 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 23 21:21:04.686108 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 23 21:21:04.686108 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 23 21:21:04.686108 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 23 21:21:04.686108 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 23 21:21:04.686108 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 23 21:21:04.686108 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Jul 23 21:21:04.686108 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Jul 23 21:21:04.686108 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-1356438312. Jul 23 21:21:04.686108 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:21:04.686108 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:21:04.686108 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:21:04.686108 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:21:04.686108 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:21:04.686108 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:21:04.686108 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:21:04.687431 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:21:04.687431 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:21:04.687431 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:21:04.687431 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:21:04.687431 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:21:04.687431 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 23 21:21:04.687431 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 23 21:21:04.687431 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-1356438312. Jul 23 21:21:04.687431 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:21:04.687431 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:21:04.687431 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:21:04.687431 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:21:04.687431 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:21:04.687431 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:21:04.687431 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:21:04.687431 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:21:04.687431 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-1356438312. Jul 23 21:21:04.687431 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:21:04.691878 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e91edb89-5842-4a47-9cc3-f561cb84a2ef tempest-SecurityGroupRulesNegativeTestJSON-879928424 tempest-SecurityGroupRulesNegativeTestJSON-879928424-project] Returning 400 to user: Invalid IP protocol tempest-999-1356438312. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:21:04.691878 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e91edb89-5842-4a47-9cc3-f561cb84a2ef tempest-SecurityGroupRulesNegativeTestJSON-879928424 tempest-SecurityGroupRulesNegativeTestJSON-879928424-project] 10.222.0.17 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 87 microversion: 2.1 time: 0.145791 Jul 23 21:21:04.691878 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 925/1853] 10.222.0.17 () {60 vars in 1194 bytes} [Sat Jul 23 21:21:04 2022] POST /compute/v2.1/os-security-group-rules => generated 87 bytes in 147 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 23 21:21:04.692627 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-758753bf-f40c-4df1-bb19-243e9508d314 req-9e9881d3-c1c7-4a7b-9b25-e8f10f879d82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3075a998-589a-474c-ac0a-3c53f63ab574", "tag": "5b53216a-bd51-4bcb-9d1e-76b2724f0d16"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:21:04.696438 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.network.neutron [None req-6995cf37-b22e-4481-bb04-1b12ba39bb4b tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] [instance: 3075a998-589a-474c-ac0a-3c53f63ab574] Updating instance_info_cache with network_info: [{"id": "5b53216a-bd51-4bcb-9d1e-76b2724f0d16", "address": "fa:16:3e:26:0f:b8", "network": {"id": "1bf1175b-8b51-4fe1-8a7e-c57501a7f9a2", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-689906731-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "e165633a87b04bd9bc3f6e575f53fb12", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap5b53216a-bd", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=131321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 23 21:21:04.723310 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-758753bf-f40c-4df1-bb19-243e9508d314 req-9e9881d3-c1c7-4a7b-9b25-e8f10f879d82 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:04.725177 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6995cf37-b22e-4481-bb04-1b12ba39bb4b tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Releasing lock "refresh_cache-3075a998-589a-474c-ac0a-3c53f63ab574" {{(pid=131321) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 23 21:21:04.725620 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-758753bf-f40c-4df1-bb19-243e9508d314 req-9e9881d3-c1c7-4a7b-9b25-e8f10f879d82 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:04.730821 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-6995cf37-b22e-4481-bb04-1b12ba39bb4b tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] 10.222.0.17 "POST /compute/v2.1/servers/3075a998-589a-474c-ac0a-3c53f63ab574/action" status: 202 len: 0 microversion: 2.1 time: 3.860131 Jul 23 21:21:04.731465 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 929/1854] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:21:00 2022] POST /compute/v2.1/servers/3075a998-589a-474c-ac0a-3c53f63ab574/action => generated 0 bytes in 3864 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 23 21:21:04.744855 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f72ec6fa-0ea6-4e4c-ae84-898b7db239ed tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:04.745486 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-f72ec6fa-0ea6-4e4c-ae84-898b7db239ed tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:21:04.752404 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-758753bf-f40c-4df1-bb19-243e9508d314 req-9e9881d3-c1c7-4a7b-9b25-e8f10f879d82 service nova] Creating event network-changed:5b53216a-bd51-4bcb-9d1e-76b2724f0d16 for instance 3075a998-589a-474c-ac0a-3c53f63ab574 on nch2-master-1 Jul 23 21:21:04.761836 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-758753bf-f40c-4df1-bb19-243e9508d314 req-9e9881d3-c1c7-4a7b-9b25-e8f10f879d82 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074556 Jul 23 21:21:04.762202 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f72ec6fa-0ea6-4e4c-ae84-898b7db239ed tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:04.762719 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f72ec6fa-0ea6-4e4c-ae84-898b7db239ed tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:04.764438 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f72ec6fa-0ea6-4e4c-ae84-898b7db239ed tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:04.765319 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f72ec6fa-0ea6-4e4c-ae84-898b7db239ed tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:04.774392 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 926/1855] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:21:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:21:04.783191 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-83e8753b-d64b-4459-a7a1-82b38b0284d8 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '.version_select at 0x7f0b47dc2040>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:04.954094 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-83e8753b-d64b-4459-a7a1-82b38b0284d8 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/images/76af21a6-17d9-434a-b039-2b4f2d2c8a7f" status: 200 len: 1455 microversion: 2.1 time: 0.174679 Jul 23 21:21:04.954697 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 927/1856] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:21:04 2022] GET /compute/v2.1/images/76af21a6-17d9-434a-b039-2b4f2d2c8a7f => generated 1455 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:21:04.968301 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-fa5e2ea3-ff57-41a5-9b35-4bd4c40a44a4 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:04.968935 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-fa5e2ea3-ff57-41a5-9b35-4bd4c40a44a4 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] [instance: d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:21:04.994231 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fa5e2ea3-ff57-41a5-9b35-4bd4c40a44a4 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:04.995589 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fa5e2ea3-ff57-41a5-9b35-4bd4c40a44a4 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:04.997159 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fa5e2ea3-ff57-41a5-9b35-4bd4c40a44a4 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:04.999654 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fa5e2ea3-ff57-41a5-9b35-4bd4c40a44a4 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:05.076978 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-fa5e2ea3-ff57-41a5-9b35-4bd4c40a44a4 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] [instance: d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a] Going to try to terminate instance {{(pid=131320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:21:05.264100 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-fa5e2ea3-ff57-41a5-9b35-4bd4c40a44a4 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a" status: 204 len: 0 microversion: 2.75 time: 0.302652 Jul 23 21:21:05.264883 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 928/1857] 10.222.0.17 () {60 vars in 1279 bytes} [Sat Jul 23 21:21:04 2022] DELETE /compute/v2.1/servers/d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 23 21:21:05.286358 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e6778583-f90e-40e9-b81f-75a23a099fc3 tempest-SecurityGroupRulesNegativeTestJSON-879928424 tempest-SecurityGroupRulesNegativeTestJSON-879928424-project] Action: 'create', calling method: .version_select at 0x7f0b599794c0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-529246413", "description": "tempest-description-1077338217"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:21:05.627213 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-f72ec6fa-0ea6-4e4c-ae84-898b7db239ed tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:21:05.639915 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-f72ec6fa-0ea6-4e4c-ae84-898b7db239ed tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:21:05.646148 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-f72ec6fa-0ea6-4e4c-ae84-898b7db239ed tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:21:05.650328 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-f72ec6fa-0ea6-4e4c-ae84-898b7db239ed tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 2833 microversion: 2.42 time: 0.915039 Jul 23 21:21:05.654001 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 930/1858] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:21:04 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 2833 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:21:05.687841 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a228ef10-c1d8-4a98-b024-2b134a5be6b1 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:05.688396 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-a228ef10-c1d8-4a98-b024-2b134a5be6b1 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] [instance: 3075a998-589a-474c-ac0a-3c53f63ab574] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:21:05.722375 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a228ef10-c1d8-4a98-b024-2b134a5be6b1 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:05.723505 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a228ef10-c1d8-4a98-b024-2b134a5be6b1 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:05.729339 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a228ef10-c1d8-4a98-b024-2b134a5be6b1 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:05.729949 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a228ef10-c1d8-4a98-b024-2b134a5be6b1 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:05.807340 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-a228ef10-c1d8-4a98-b024-2b134a5be6b1 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] [instance: 3075a998-589a-474c-ac0a-3c53f63ab574] Going to try to terminate instance {{(pid=131321) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:21:05.877591 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=87,nova_cell1:SAVEPOINT=4,nova_cell1:UPDATE=5,nova_cell1:RELEASE=4 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:21:05.984223 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-a228ef10-c1d8-4a98-b024-2b134a5be6b1 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] 10.222.0.17 "DELETE /compute/v2.1/servers/3075a998-589a-474c-ac0a-3c53f63ab574" status: 204 len: 0 microversion: 2.1 time: 0.326329 Jul 23 21:21:05.993484 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 931/1859] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:21:05 2022] DELETE /compute/v2.1/servers/3075a998-589a-474c-ac0a-3c53f63ab574 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:21:06.008780 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-991be6d2-0729-4530-aacd-6ee03e6f20de tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:06.010123 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-991be6d2-0729-4530-aacd-6ee03e6f20de tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] [instance: d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:21:06.025794 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-991be6d2-0729-4530-aacd-6ee03e6f20de tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:06.026983 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-991be6d2-0729-4530-aacd-6ee03e6f20de tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:06.029372 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-991be6d2-0729-4530-aacd-6ee03e6f20de tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:06.030135 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-991be6d2-0729-4530-aacd-6ee03e6f20de tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:06.141810 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-991be6d2-0729-4530-aacd-6ee03e6f20de tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ef41817e4f5478bb7afdcb59ed634cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af16c62b144aa0972331a69e3638c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:21:06.151673 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-991be6d2-0729-4530-aacd-6ee03e6f20de tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3ef41817e4f5478bb7afdcb59ed634cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af16c62b144aa0972331a69e3638c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:21:06.153703 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-991be6d2-0729-4530-aacd-6ee03e6f20de tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3ef41817e4f5478bb7afdcb59ed634cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7af16c62b144aa0972331a69e3638c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:21:06.159854 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-991be6d2-0729-4530-aacd-6ee03e6f20de tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] 10.222.0.17 "GET /compute/v2.1/servers/d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a" status: 200 len: 1443 microversion: 2.75 time: 0.164615 Jul 23 21:21:06.161315 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 932/1860] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:21:05 2022] GET /compute/v2.1/servers/d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a => generated 1443 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:21:06.166521 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-369b1b21-70a5-4765-b0b2-424658c92640 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:06.167460 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-369b1b21-70a5-4765-b0b2-424658c92640 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] [instance: f53ce882-4694-421d-8075-5e8cfab0b16f] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:21:06.174602 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-369b1b21-70a5-4765-b0b2-424658c92640 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:06.175392 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-369b1b21-70a5-4765-b0b2-424658c92640 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:06.176484 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-369b1b21-70a5-4765-b0b2-424658c92640 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:06.177143 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-369b1b21-70a5-4765-b0b2-424658c92640 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:06.404156 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-369b1b21-70a5-4765-b0b2-424658c92640 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '145e518288ce4d70a12a3f2cc6a91810', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f220ba2f42db435a818f3e462aea35a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:21:06.416338 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-369b1b21-70a5-4765-b0b2-424658c92640 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] 10.222.0.17 "GET /compute/v2.1/servers/f53ce882-4694-421d-8075-5e8cfab0b16f" status: 200 len: 1682 microversion: 2.1 time: 0.253593 Jul 23 21:21:06.419943 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 933/1861] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:21:06 2022] GET /compute/v2.1/servers/f53ce882-4694-421d-8075-5e8cfab0b16f => generated 1682 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:21:06.434427 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-4f1fd311-a1c9-44d6-9a09-c0037bbb80fd tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:06.434934 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-4f1fd311-a1c9-44d6-9a09-c0037bbb80fd tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:21:06.441405 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4f1fd311-a1c9-44d6-9a09-c0037bbb80fd tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:06.442151 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4f1fd311-a1c9-44d6-9a09-c0037bbb80fd tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:06.443109 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4f1fd311-a1c9-44d6-9a09-c0037bbb80fd tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:06.443756 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4f1fd311-a1c9-44d6-9a09-c0037bbb80fd tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:06.538274 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e6778583-f90e-40e9-b81f-75a23a099fc3 tempest-SecurityGroupRulesNegativeTestJSON-879928424 tempest-SecurityGroupRulesNegativeTestJSON-879928424-project] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 1.266748 Jul 23 21:21:06.539242 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 929/1862] 10.222.0.17 () {60 vars in 1179 bytes} [Sat Jul 23 21:21:05 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:21:06.612948 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-4f1fd311-a1c9-44d6-9a09-c0037bbb80fd tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d/os-interface" status: 200 len: 1832 microversion: 2.42 time: 0.182296 Jul 23 21:21:06.614760 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 934/1863] 10.222.0.17 () {60 vars in 1315 bytes} [Sat Jul 23 21:21:06 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d/os-interface => generated 1832 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:21:06.621379 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-b0eb60c7-b09f-421c-b3ec-773039e7918c tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '.version_select at 0x7f0b47fd6430>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:06.726549 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-b0eb60c7-b09f-421c-b3ec-773039e7918c tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/images/76af21a6-17d9-434a-b039-2b4f2d2c8a7f" status: 200 len: 1455 microversion: 2.1 time: 0.109073 Jul 23 21:21:06.727205 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 935/1864] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:21:06 2022] GET /compute/v2.1/images/76af21a6-17d9-434a-b039-2b4f2d2c8a7f => generated 1455 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:21:06.737586 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-df16da1e-42a5-4b52-bc5e-24ddc0d66992 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.4.77"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:21:06.742316 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-df16da1e-42a5-4b52-bc5e-24ddc0d66992 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] [instance: 059bbe3e-cf86-4689-a696-0161d7d27dfd] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:21:06.772531 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-df16da1e-42a5-4b52-bc5e-24ddc0d66992 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:06.773226 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-df16da1e-42a5-4b52-bc5e-24ddc0d66992 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:06.777097 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-df16da1e-42a5-4b52-bc5e-24ddc0d66992 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:06.777788 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-df16da1e-42a5-4b52-bc5e-24ddc0d66992 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:06.856263 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-df16da1e-42a5-4b52-bc5e-24ddc0d66992 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Acquired lock "refresh_cache-059bbe3e-cf86-4689-a696-0161d7d27dfd" {{(pid=131321) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 23 21:21:06.959313 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-306c1ad0-05d3-486f-bf96-5b693eada7b5 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1768643606", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:21:07.060151 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-306c1ad0-05d3-486f-bf96-5b693eada7b5 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] validate_networks() for None {{(pid=131320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:21:07.934319 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-306c1ad0-05d3-486f-bf96-5b693eada7b5 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:21:07.935607 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-306c1ad0-05d3-486f-bf96-5b693eada7b5 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:21:07.936387 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-306c1ad0-05d3-486f-bf96-5b693eada7b5 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:21:07.937376 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-306c1ad0-05d3-486f-bf96-5b693eada7b5 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:21:07.938430 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-306c1ad0-05d3-486f-bf96-5b693eada7b5 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:21:07.957442 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-306c1ad0-05d3-486f-bf96-5b693eada7b5 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:07.960641 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-306c1ad0-05d3-486f-bf96-5b693eada7b5 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:07.961991 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-306c1ad0-05d3-486f-bf96-5b693eada7b5 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:07.962700 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-306c1ad0-05d3-486f-bf96-5b693eada7b5 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:08.005743 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-306c1ad0-05d3-486f-bf96-5b693eada7b5 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Getting quotas for project 35c1943188684b45b636541caf587247. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:21:08.027668 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-306c1ad0-05d3-486f-bf96-5b693eada7b5 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Getting quotas for user ebf93a4b80cb4e19a36473986950fc75 and project 35c1943188684b45b636541caf587247. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:21:08.034676 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:21:08.052336 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-306c1ad0-05d3-486f-bf96-5b693eada7b5 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Going to run 1 instances... {{(pid=131320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:21:08.055844 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-306c1ad0-05d3-486f-bf96-5b693eada7b5 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] [instance: cef13563-7f83-4281-a26c-d5e420c41daf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:21:08.148572 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-306c1ad0-05d3-486f-bf96-5b693eada7b5 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.608060 Jul 23 21:21:08.150374 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 930/1865] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:21:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1610 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 23 21:21:08.172984 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8295d267-820f-4ecd-b32d-ba9e7e96a882 tempest-SecurityGroupRulesNegativeTestJSON-879928424 tempest-SecurityGroupRulesNegativeTestJSON-879928424-project] Action: 'create', calling method: .version_select at 0x7f0b59901d30>, body: {"security_group_rule": {"parent_group_id": "91d90db7-40e8-47b7-8fcd-a9909ce30aec", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:21:08.488174 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-8295d267-820f-4ecd-b32d-ba9e7e96a882 tempest-SecurityGroupRulesNegativeTestJSON-879928424 tempest-SecurityGroupRulesNegativeTestJSON-879928424-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Jul 23 21:21:08.490476 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8295d267-820f-4ecd-b32d-ba9e7e96a882 tempest-SecurityGroupRulesNegativeTestJSON-879928424 tempest-SecurityGroupRulesNegativeTestJSON-879928424-project] Request method failure captured: Jul 23 21:21:08.490476 ncdv-master-1 devstack@n-api.service[131320]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 23 21:21:08.490476 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:21:08.490476 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:21:08.490476 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:21:08.490476 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 138 Jul 23 21:21:08.490476 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:21:08.490476 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:21:08.490476 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:21:08.490476 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:21:08.490476 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GY1eT5aQfbTYSZ8qSNpwkGSg_DXCHXUOvKjBgTUhuJ83CNIIyYSoc1Fyp_B_huq4EDc7We7E8ITnNX5UxEv9gWdlXqN3krL8qZXMPSYkiof2TvhkHegRxhZjbuI0cpmpFuuysvO2I379hyBIfQGw_T_wKXrR1iWN_J3LNhV4DyqvUc Jul 23 21:21:08.490476 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:21:08.490476 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:21:08.490476 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:21:08.490476 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:21:08.490476 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:21:08.490476 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:21:08.490476 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 24d534ba297c4d709c5ccf36c9394842 Jul 23 21:21:08.490476 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-879928424 Jul 23 21:21:08.490476 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:21:08.490476 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:21:08.492363 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/24d534ba297c4d709c5ccf36c9394842"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/24d534ba297c4d709c5ccf36c9394842"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_24d534ba297c4d709c5ccf36c9394842", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/24d534ba297c4d709c5ccf36c9394842"}]}] Jul 23 21:21:08.492363 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-879928424 Jul 23 21:21:08.492363 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 24d534ba297c4d709c5ccf36c9394842 Jul 23 21:21:08.492363 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-879928424 Jul 23 21:21:08.492363 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-879928424-project Jul 23 21:21:08.492363 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:21:08.492363 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:21:08.492363 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: a271336fe39f4bcb94d326ddfb7b4365 Jul 23 21:21:08.492363 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-879928424-project Jul 23 21:21:08.492363 ncdv-master-1 devstack@n-api.service[131320]: Jul 23 21:21:08.492363 ncdv-master-1 devstack@n-api.service[131320]: {"security_group_rule": {"parent_group_id": "91d90db7-40e8-47b7-8fcd-a9909ce30aec", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Jul 23 21:21:08.492363 ncdv-master-1 devstack@n-api.service[131320]: method: Jul 23 21:21:08.493335 ncdv-master-1 devstack@n-api.service[131320]: exception: Invalid port range 22:21. Former value cannot be greater than the later Jul 23 21:21:08.493335 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'body': {'security_group_rule': {'parent_group_id': '91d90db7-40e8-47b7-8fcd-a9909ce30aec', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Jul 23 21:21:08.493335 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:21:08.493335 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:21:08.493335 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 23 21:21:08.493335 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 23 21:21:08.493335 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 23 21:21:08.493335 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 23 21:21:08.493335 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 23 21:21:08.493335 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 23 21:21:08.493335 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Jul 23 21:21:08.493335 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jul 23 21:21:08.493335 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Jul 23 21:21:08.493335 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:21:08.493335 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:21:08.493335 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:21:08.493335 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:21:08.493335 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:21:08.493335 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:21:08.494981 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:21:08.494981 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:21:08.494981 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:21:08.494981 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:21:08.494981 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:21:08.494981 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:21:08.494981 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 23 21:21:08.494981 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 23 21:21:08.494981 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Jul 23 21:21:08.494981 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:21:08.494981 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:21:08.494981 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:21:08.494981 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:21:08.494981 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:21:08.494981 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:21:08.494981 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:21:08.494981 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:21:08.494981 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Jul 23 21:21:08.494981 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:21:08.496542 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8295d267-820f-4ecd-b32d-ba9e7e96a882 tempest-SecurityGroupRulesNegativeTestJSON-879928424 tempest-SecurityGroupRulesNegativeTestJSON-879928424-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:21:08.496542 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8295d267-820f-4ecd-b32d-ba9e7e96a882 tempest-SecurityGroupRulesNegativeTestJSON-879928424 tempest-SecurityGroupRulesNegativeTestJSON-879928424-project] 10.222.0.17 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.335957 Jul 23 21:21:08.499172 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 931/1866] 10.222.0.17 () {60 vars in 1194 bytes} [Sat Jul 23 21:21:08 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 343 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 23 21:21:09.022357 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5cee3490-c34f-4724-80f6-fee8cf97af29 tempest-SecurityGroupsTestAdminJSON-611736374 tempest-SecurityGroupsTestAdminJSON-611736374-project] Action: 'create', calling method: .version_select at 0x7f0b59910430>, body: {"security_group": {"name": "tempest-securitygroup-1951079167", "description": "tempest-description-10238562"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:21:09.758895 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5cee3490-c34f-4724-80f6-fee8cf97af29 tempest-SecurityGroupsTestAdminJSON-611736374 tempest-SecurityGroupsTestAdminJSON-611736374-project] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 1.258398 Jul 23 21:21:09.759509 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 932/1867] 10.222.0.17 () {60 vars in 1179 bytes} [Sat Jul 23 21:21:08 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:21:09.796754 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-88674f3b-6fa0-43c9-a5ad-0b7659ae4706 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:09.800143 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-88674f3b-6fa0-43c9-a5ad-0b7659ae4706 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] [instance: d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:21:09.825750 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-88674f3b-6fa0-43c9-a5ad-0b7659ae4706 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:09.826508 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-88674f3b-6fa0-43c9-a5ad-0b7659ae4706 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:09.828033 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-88674f3b-6fa0-43c9-a5ad-0b7659ae4706 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:09.828643 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-88674f3b-6fa0-43c9-a5ad-0b7659ae4706 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:09.853150 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-88674f3b-6fa0-43c9-a5ad-0b7659ae4706 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] HTTP exception thrown: Instance d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a could not be found. Jul 23 21:21:09.865813 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-88674f3b-6fa0-43c9-a5ad-0b7659ae4706 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Request method failure captured: Jul 23 21:21:09.865813 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a HTTP/1.1 Jul 23 21:21:09.865813 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:21:09.865813 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:21:09.865813 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:21:09.865813 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:21:09.865813 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:21:09.865813 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:21:09.865813 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:21:09.865813 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:21:09.865813 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GXwLEOgkX74ImGe4aFoFsib0tvOB7t3jOgV4lL8znn8m22tIWg6jf-qab2__ZYIQxJfYClv6x3fwf1NA3DL99sWdP2SyTiNzZ-_roDqHG5FP9lsxnCC19K4K9RUSqZw6NM0tD32cXeOD_qwjqV3cmFvXckHoThYzGw7R2HJx_czbW4 Jul 23 21:21:09.865813 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:21:09.865813 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:21:09.865813 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:21:09.865813 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:21:09.865813 ncdv-master-1 devstack@n-api.service[131320]: X-Openstack-Nova-Api-Version: 2.75 Jul 23 21:21:09.865813 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:21:09.865813 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:21:09.865813 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: c7af16c62b144aa0972331a69e3638c3 Jul 23 21:21:09.865813 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServersAdmin275Test-235955850 Jul 23 21:21:09.865813 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:21:09.865813 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:21:09.867866 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c7af16c62b144aa0972331a69e3638c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c7af16c62b144aa0972331a69e3638c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c7af16c62b144aa0972331a69e3638c3", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c7af16c62b144aa0972331a69e3638c3"}]}] Jul 23 21:21:09.867866 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServersAdmin275Test-235955850 Jul 23 21:21:09.867866 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: c7af16c62b144aa0972331a69e3638c3 Jul 23 21:21:09.867866 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServersAdmin275Test-235955850 Jul 23 21:21:09.867866 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServersAdmin275Test-235955850-project Jul 23 21:21:09.867866 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:21:09.867866 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:21:09.867866 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 3ef41817e4f5478bb7afdcb59ed634cd Jul 23 21:21:09.867866 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServersAdmin275Test-235955850-project Jul 23 21:21:09.867866 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:21:09.867866 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a could not be found. Jul 23 21:21:09.867866 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': 'd0c641e1-b98d-4ae9-aec9-f6cdc54bd69a'} Jul 23 21:21:09.868875 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:21:09.868875 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:21:09.868875 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:21:09.868875 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:21:09.868875 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:21:09.868875 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:21:09.868875 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:21:09.868875 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:21:09.868875 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:21:09.868875 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:21:09.868875 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a could not be found. Jul 23 21:21:09.868875 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:21:09.868875 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:21:09.868875 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:21:09.868875 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:21:09.868875 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:21:09.868875 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:21:09.868875 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:21:09.868875 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:21:09.868875 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:21:09.870417 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:21:09.870417 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:21:09.870417 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:21:09.870417 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:21:09.870417 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:21:09.870417 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:21:09.870417 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:21:09.870417 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a could not be found. Jul 23 21:21:09.870417 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:21:09.870417 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:21:09.870417 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:21:09.870417 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:21:09.870417 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:21:09.870417 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:21:09.870417 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:21:09.870417 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:21:09.870417 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a could not be found. Jul 23 21:21:09.870417 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:21:09.872592 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-88674f3b-6fa0-43c9-a5ad-0b7659ae4706 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] Returning 404 to user: Instance d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:21:09.872592 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-88674f3b-6fa0-43c9-a5ad-0b7659ae4706 tempest-ServersAdmin275Test-235955850 tempest-ServersAdmin275Test-235955850-project] 10.222.0.17 "GET /compute/v2.1/servers/d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a" status: 404 len: 111 microversion: 2.75 time: 0.090012 Jul 23 21:21:09.872592 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 933/1868] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:21:09 2022] GET /compute/v2.1/servers/d0c641e1-b98d-4ae9-aec9-f6cdc54bd69a => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 23 21:21:09.914852 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9b657ad9-f103-47c8-94bb-ffefe7498cfe tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:09.929813 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-9b657ad9-f103-47c8-94bb-ffefe7498cfe tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] [instance: f53ce882-4694-421d-8075-5e8cfab0b16f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:21:09.947470 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9b657ad9-f103-47c8-94bb-ffefe7498cfe tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:09.955254 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9b657ad9-f103-47c8-94bb-ffefe7498cfe tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:09.956410 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9b657ad9-f103-47c8-94bb-ffefe7498cfe tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:09.957462 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9b657ad9-f103-47c8-94bb-ffefe7498cfe tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:09.985545 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-9b657ad9-f103-47c8-94bb-ffefe7498cfe tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] HTTP exception thrown: Instance f53ce882-4694-421d-8075-5e8cfab0b16f could not be found. Jul 23 21:21:09.995368 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9b657ad9-f103-47c8-94bb-ffefe7498cfe tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Request method failure captured: Jul 23 21:21:09.995368 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/f53ce882-4694-421d-8075-5e8cfab0b16f HTTP/1.1 Jul 23 21:21:09.995368 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:21:09.995368 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:21:09.995368 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:21:09.995368 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:21:09.995368 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:21:09.995368 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:21:09.995368 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:21:09.995368 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:21:09.995368 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GW0-cddaGK9eBv6UaE0b4rJ86Es-hyGCoLUcJZ7OqzpCtEXKWoV6ejzaD7AR8e5rEzcwL5leSIzEFTAG19kNosmO80fcReZJqamEbgNOOg42PtV2W80WFx0iPG3TXCP582qkDJAHK6XEtVGw1MzOa9x3yIHcMf_rEXISa4ce5rjGAk Jul 23 21:21:09.995368 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:21:09.995368 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:21:09.995368 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:21:09.995368 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:21:09.995368 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:21:09.995368 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:21:09.995368 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: f220ba2f42db435a818f3e462aea35a2 Jul 23 21:21:09.995368 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-VolumesAdminNegativeTest-1859024807 Jul 23 21:21:09.995368 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:21:09.995368 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:21:09.996945 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f220ba2f42db435a818f3e462aea35a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f220ba2f42db435a818f3e462aea35a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f220ba2f42db435a818f3e462aea35a2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f220ba2f42db435a818f3e462aea35a2"}]}] Jul 23 21:21:09.996945 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-VolumesAdminNegativeTest-1859024807 Jul 23 21:21:09.996945 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: f220ba2f42db435a818f3e462aea35a2 Jul 23 21:21:09.996945 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1859024807 Jul 23 21:21:09.996945 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-VolumesAdminNegativeTest-1859024807-project Jul 23 21:21:09.996945 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:21:09.996945 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:21:09.996945 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 145e518288ce4d70a12a3f2cc6a91810 Jul 23 21:21:09.996945 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-VolumesAdminNegativeTest-1859024807-project Jul 23 21:21:09.996945 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:21:09.996945 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance f53ce882-4694-421d-8075-5e8cfab0b16f could not be found. Jul 23 21:21:09.996945 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': 'f53ce882-4694-421d-8075-5e8cfab0b16f'} Jul 23 21:21:09.997803 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:21:09.997803 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:21:09.997803 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:21:09.997803 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:21:09.997803 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:21:09.997803 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:21:09.997803 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:21:09.997803 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:21:09.997803 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:21:09.997803 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:21:09.997803 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f53ce882-4694-421d-8075-5e8cfab0b16f could not be found. Jul 23 21:21:09.997803 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:21:09.997803 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:21:09.997803 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:21:09.997803 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:21:09.997803 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:21:09.997803 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:21:09.997803 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:21:09.997803 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:21:09.997803 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:21:09.999565 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:21:09.999565 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:21:09.999565 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:21:09.999565 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:21:09.999565 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:21:09.999565 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:21:09.999565 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:21:09.999565 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f53ce882-4694-421d-8075-5e8cfab0b16f could not be found. Jul 23 21:21:09.999565 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:21:09.999565 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:21:09.999565 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:21:09.999565 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:21:09.999565 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:21:09.999565 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:21:09.999565 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:21:09.999565 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:21:09.999565 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f53ce882-4694-421d-8075-5e8cfab0b16f could not be found. Jul 23 21:21:09.999565 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:21:10.006541 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9b657ad9-f103-47c8-94bb-ffefe7498cfe tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Returning 404 to user: Instance f53ce882-4694-421d-8075-5e8cfab0b16f could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:21:10.009383 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9b657ad9-f103-47c8-94bb-ffefe7498cfe tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] 10.222.0.17 "GET /compute/v2.1/servers/f53ce882-4694-421d-8075-5e8cfab0b16f" status: 404 len: 111 microversion: 2.1 time: 0.137468 Jul 23 21:21:10.017443 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 934/1869] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:21:09 2022] GET /compute/v2.1/servers/f53ce882-4694-421d-8075-5e8cfab0b16f => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:21:10.036800 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a9b92f91-1c8e-4799-aa5d-963c322c386e tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '.version_select at 0x7f0b599bb670>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:10.182845 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a9b92f91-1c8e-4799-aa5d-963c322c386e tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/images/76af21a6-17d9-434a-b039-2b4f2d2c8a7f" status: 200 len: 1455 microversion: 2.1 time: 0.162663 Jul 23 21:21:10.184213 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 935/1870] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:21:10 2022] GET /compute/v2.1/images/76af21a6-17d9-434a-b039-2b4f2d2c8a7f => generated 1455 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:21:10.191908 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f49a7374-017d-42a2-b567-acbfb8e3ab67 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-47434931", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:21:10.359362 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-f49a7374-017d-42a2-b567-acbfb8e3ab67 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] validate_networks() for None {{(pid=131320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:21:10.469015 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.network.neutron [None req-df16da1e-42a5-4b52-bc5e-24ddc0d66992 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] [instance: 059bbe3e-cf86-4689-a696-0161d7d27dfd] Building network info cache for instance {{(pid=131321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 23 21:21:11.111430 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-f49a7374-017d-42a2-b567-acbfb8e3ab67 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:21:11.112038 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-f49a7374-017d-42a2-b567-acbfb8e3ab67 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:21:11.112702 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-f49a7374-017d-42a2-b567-acbfb8e3ab67 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:21:11.113495 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-f49a7374-017d-42a2-b567-acbfb8e3ab67 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:21:11.114214 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-f49a7374-017d-42a2-b567-acbfb8e3ab67 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:21:11.131452 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f49a7374-017d-42a2-b567-acbfb8e3ab67 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:11.132303 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f49a7374-017d-42a2-b567-acbfb8e3ab67 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:11.134127 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f49a7374-017d-42a2-b567-acbfb8e3ab67 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:11.137420 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f49a7374-017d-42a2-b567-acbfb8e3ab67 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:11.185665 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-f49a7374-017d-42a2-b567-acbfb8e3ab67 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Getting quotas for project 35c1943188684b45b636541caf587247. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:21:11.201048 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-f49a7374-017d-42a2-b567-acbfb8e3ab67 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Getting quotas for user ebf93a4b80cb4e19a36473986950fc75 and project 35c1943188684b45b636541caf587247. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:21:11.244146 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f49a7374-017d-42a2-b567-acbfb8e3ab67 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Going to run 1 instances... {{(pid=131320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:21:11.250575 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f49a7374-017d-42a2-b567-acbfb8e3ab67 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] [instance: 6435faed-ac55-4f93-ac79-2668c6538209] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:21:11.427388 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f49a7374-017d-42a2-b567-acbfb8e3ab67 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.241171 Jul 23 21:21:11.438652 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 936/1871] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:21:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1254 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 23 21:21:11.464008 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0089c01d-bcca-4093-a84e-314614a38415 tempest-SecurityGroupRulesNegativeTestJSON-879928424 tempest-SecurityGroupRulesNegativeTestJSON-879928424-project] Action: 'create', calling method: .version_select at 0x7f0b599013a0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1058656527", "description": "tempest-description-1820195681"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:21:12.163446 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.network.neutron [None req-df16da1e-42a5-4b52-bc5e-24ddc0d66992 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] [instance: 059bbe3e-cf86-4689-a696-0161d7d27dfd] Updating instance_info_cache with network_info: [{"id": "53a52999-801e-42e8-afb4-ed6908a0b011", "address": "fa:16:3e:8d:25:6e", "network": {"id": "1bf1175b-8b51-4fe1-8a7e-c57501a7f9a2", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-689906731-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "e165633a87b04bd9bc3f6e575f53fb12", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap53a52999-80", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=131321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 23 21:21:12.167886 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-0089c01d-bcca-4093-a84e-314614a38415 tempest-SecurityGroupRulesNegativeTestJSON-879928424 tempest-SecurityGroupRulesNegativeTestJSON-879928424-project] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.721266 Jul 23 21:21:12.169045 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 937/1872] 10.222.0.17 () {60 vars in 1179 bytes} [Sat Jul 23 21:21:11 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:21:12.174789 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-1f77b191-4d25-4aad-9614-0d47a82df214 req-dde31837-3180-463a-a5fb-807a3f424a8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f53ce882-4694-421d-8075-5e8cfab0b16f", "name": "network-vif-deleted", "tag": "d1c78feb-5b33-44db-b1bd-998523c96ac3"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:21:12.184900 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-df16da1e-42a5-4b52-bc5e-24ddc0d66992 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Releasing lock "refresh_cache-059bbe3e-cf86-4689-a696-0161d7d27dfd" {{(pid=131321) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 23 21:21:12.185835 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-df16da1e-42a5-4b52-bc5e-24ddc0d66992 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] 10.222.0.17 "POST /compute/v2.1/servers/059bbe3e-cf86-4689-a696-0161d7d27dfd/action" status: 202 len: 0 microversion: 2.1 time: 5.457760 Jul 23 21:21:12.186540 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 936/1873] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:21:06 2022] POST /compute/v2.1/servers/059bbe3e-cf86-4689-a696-0161d7d27dfd/action => generated 0 bytes in 5459 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 23 21:21:12.191771 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-1f77b191-4d25-4aad-9614-0d47a82df214 req-dde31837-3180-463a-a5fb-807a3f424a8d service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:12.192229 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-1f77b191-4d25-4aad-9614-0d47a82df214 req-dde31837-3180-463a-a5fb-807a3f424a8d service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:12.203233 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-32c28db2-e236-42a5-ab56-39f9145be76c tempest-SecurityGroupsTestAdminJSON-611736374 tempest-SecurityGroupsTestAdminJSON-611736374-project] Action: 'create', calling method: .version_select at 0x7f0b5415d310>, body: {"security_group": {"name": "tempest-securitygroup-1968398244", "description": "tempest-description-2082141248"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:21:12.221062 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-1f77b191-4d25-4aad-9614-0d47a82df214 req-dde31837-3180-463a-a5fb-807a3f424a8d service nova] Creating event network-vif-deleted:d1c78feb-5b33-44db-b1bd-998523c96ac3 for instance f53ce882-4694-421d-8075-5e8cfab0b16f on nch1-master-1 Jul 23 21:21:12.233637 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-1f77b191-4d25-4aad-9614-0d47a82df214 req-dde31837-3180-463a-a5fb-807a3f424a8d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062998 Jul 23 21:21:12.234356 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 938/1874] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:21:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:21:12.262366 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-506069bb-4f60-4acb-869f-701f0a081434 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] Calling method '.version_select at 0x7f0b599019d0>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:12.307332 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-506069bb-4f60-4acb-869f-701f0a081434 tempest-VolumesAdminNegativeTest-1859024807 tempest-VolumesAdminNegativeTest-1859024807-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1261648286" status: 202 len: 0 microversion: 2.1 time: 0.068838 Jul 23 21:21:12.308204 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 939/1875] 10.222.0.17 () {58 vars in 1220 bytes} [Sat Jul 23 21:21:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1261648286 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:21:12.313785 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-3007ff9a-ddd8-4741-8a23-4a40102e99ed req-44d745e2-6351-4e0a-8755-6dbb727553aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d09f96e-8ea6-4838-8264-4535f77fa39d", "tag": "857743d4-9fc9-4509-a86f-9253f99e2a3c"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:21:12.329016 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-3007ff9a-ddd8-4741-8a23-4a40102e99ed req-44d745e2-6351-4e0a-8755-6dbb727553aa service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:12.333502 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-3007ff9a-ddd8-4741-8a23-4a40102e99ed req-44d745e2-6351-4e0a-8755-6dbb727553aa service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:12.362709 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-3007ff9a-ddd8-4741-8a23-4a40102e99ed req-44d745e2-6351-4e0a-8755-6dbb727553aa service nova] Creating event network-changed:857743d4-9fc9-4509-a86f-9253f99e2a3c for instance 4d09f96e-8ea6-4838-8264-4535f77fa39d on nch2-master-1 Jul 23 21:21:12.377615 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-3007ff9a-ddd8-4741-8a23-4a40102e99ed req-44d745e2-6351-4e0a-8755-6dbb727553aa service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067493 Jul 23 21:21:12.379144 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 940/1876] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:21:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:21:12.392773 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-be183ddb-723e-4b68-93d8-1352d2e5f878 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '.version_select at 0x7f0b59910b80>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:12.483876 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-be183ddb-723e-4b68-93d8-1352d2e5f878 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/images/76af21a6-17d9-434a-b039-2b4f2d2c8a7f" status: 200 len: 1455 microversion: 2.1 time: 0.102708 Jul 23 21:21:12.490000 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 941/1877] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:21:12 2022] GET /compute/v2.1/images/76af21a6-17d9-434a-b039-2b4f2d2c8a7f => generated 1455 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:21:12.502707 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-86579a3d-1129-4768-a819-b3d4929721a3 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:12.504781 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-86579a3d-1129-4768-a819-b3d4929721a3 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] [instance: 6435faed-ac55-4f93-ac79-2668c6538209] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:21:12.522702 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-86579a3d-1129-4768-a819-b3d4929721a3 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:12.523227 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-86579a3d-1129-4768-a819-b3d4929721a3 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:12.524410 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-86579a3d-1129-4768-a819-b3d4929721a3 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:12.527559 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-86579a3d-1129-4768-a819-b3d4929721a3 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:12.899016 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-86579a3d-1129-4768-a819-b3d4929721a3 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf93a4b80cb4e19a36473986950fc75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c1943188684b45b636541caf587247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:21:12.903601 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:21:12.916057 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-86579a3d-1129-4768-a819-b3d4929721a3 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] 10.222.0.17 "GET /compute/v2.1/servers/6435faed-ac55-4f93-ac79-2668c6538209" status: 200 len: 1216 microversion: 2.1 time: 0.426849 Jul 23 21:21:12.927813 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 942/1878] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:21:12 2022] GET /compute/v2.1/servers/6435faed-ac55-4f93-ac79-2668c6538209 => generated 1216 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:21:12.935144 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-345b39ac-e422-4aeb-8270-5ce5f2a7699b tempest-SecurityGroupRulesNegativeTestJSON-879928424 tempest-SecurityGroupRulesNegativeTestJSON-879928424-project] Action: 'create', calling method: .version_select at 0x7f0b59910f70>, body: {"security_group_rule": {"parent_group_id": "f6cd4a63-1dec-4e88-8e8b-11acc2dc751c", "ip_protocol": "tcp", "from_port": 22, "to_port": 1358575221}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:21:13.011214 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-32c28db2-e236-42a5-ab56-39f9145be76c tempest-SecurityGroupsTestAdminJSON-611736374 tempest-SecurityGroupsTestAdminJSON-611736374-project] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.812085 Jul 23 21:21:13.012051 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 937/1879] 10.222.0.17 () {60 vars in 1179 bytes} [Sat Jul 23 21:21:12 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:21:13.017169 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-9cd1b2f7-d0b8-4920-b936-c0cab3b9cefe tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Calling method '.version_select at 0x7f0b598b0700>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:13.427787 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-345b39ac-e422-4aeb-8270-5ce5f2a7699b tempest-SecurityGroupRulesNegativeTestJSON-879928424 tempest-SecurityGroupRulesNegativeTestJSON-879928424-project] HTTP exception thrown: Invalid port range 22:1358575221. Valid TCP ports should be between 1-65535 Jul 23 21:21:13.430008 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-345b39ac-e422-4aeb-8270-5ce5f2a7699b tempest-SecurityGroupRulesNegativeTestJSON-879928424 tempest-SecurityGroupRulesNegativeTestJSON-879928424-project] Request method failure captured: Jul 23 21:21:13.430008 ncdv-master-1 devstack@n-api.service[131320]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 23 21:21:13.430008 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:21:13.430008 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:21:13.430008 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:21:13.430008 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 146 Jul 23 21:21:13.430008 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:21:13.430008 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:21:13.430008 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:21:13.430008 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:21:13.430008 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GY1eT5aQfbTYSZ8qSNpwkGSg_DXCHXUOvKjBgTUhuJ83CNIIyYSoc1Fyp_B_huq4EDc7We7E8ITnNX5UxEv9gWdlXqN3krL8qZXMPSYkiof2TvhkHegRxhZjbuI0cpmpFuuysvO2I379hyBIfQGw_T_wKXrR1iWN_J3LNhV4DyqvUc Jul 23 21:21:13.430008 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:21:13.430008 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:21:13.430008 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:21:13.430008 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:21:13.430008 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:21:13.430008 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:21:13.430008 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 24d534ba297c4d709c5ccf36c9394842 Jul 23 21:21:13.430008 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-879928424 Jul 23 21:21:13.430008 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:21:13.430008 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:21:13.431733 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/24d534ba297c4d709c5ccf36c9394842"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/24d534ba297c4d709c5ccf36c9394842"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_24d534ba297c4d709c5ccf36c9394842", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/24d534ba297c4d709c5ccf36c9394842"}]}] Jul 23 21:21:13.431733 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-879928424 Jul 23 21:21:13.431733 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 24d534ba297c4d709c5ccf36c9394842 Jul 23 21:21:13.431733 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-879928424 Jul 23 21:21:13.431733 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-879928424-project Jul 23 21:21:13.431733 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:21:13.431733 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:21:13.431733 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: a271336fe39f4bcb94d326ddfb7b4365 Jul 23 21:21:13.431733 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-879928424-project Jul 23 21:21:13.431733 ncdv-master-1 devstack@n-api.service[131320]: Jul 23 21:21:13.431733 ncdv-master-1 devstack@n-api.service[131320]: {"security_group_rule": {"parent_group_id": "f6cd4a63-1dec-4e88-8e8b-11acc2dc751c", "ip_protocol": "tcp", "from_port": 22, "to_port": 1358575221}} Jul 23 21:21:13.431733 ncdv-master-1 devstack@n-api.service[131320]: method: Jul 23 21:21:13.432717 ncdv-master-1 devstack@n-api.service[131320]: exception: Invalid port range 22:1358575221. Valid TCP ports should be between 1-65535 Jul 23 21:21:13.432717 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'f6cd4a63-1dec-4e88-8e8b-11acc2dc751c', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 1358575221}}} Jul 23 21:21:13.432717 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:21:13.432717 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:21:13.432717 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 23 21:21:13.432717 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 23 21:21:13.432717 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 23 21:21:13.432717 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 23 21:21:13.432717 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 23 21:21:13.432717 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 23 21:21:13.432717 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Jul 23 21:21:13.432717 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jul 23 21:21:13.432717 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:1358575221. Valid TCP ports should be between 1-65535 Jul 23 21:21:13.432717 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:21:13.432717 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:21:13.432717 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:21:13.432717 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:21:13.432717 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:21:13.432717 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:21:13.434244 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:21:13.434244 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:21:13.434244 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:21:13.434244 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:21:13.434244 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:21:13.434244 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:21:13.434244 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 23 21:21:13.434244 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 23 21:21:13.434244 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:1358575221. Valid TCP ports should be between 1-65535 Jul 23 21:21:13.434244 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:21:13.434244 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:21:13.434244 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:21:13.434244 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:21:13.434244 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:21:13.434244 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:21:13.434244 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:21:13.434244 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:21:13.434244 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:1358575221. Valid TCP ports should be between 1-65535 Jul 23 21:21:13.434244 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:21:13.435730 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-345b39ac-e422-4aeb-8270-5ce5f2a7699b tempest-SecurityGroupRulesNegativeTestJSON-879928424 tempest-SecurityGroupRulesNegativeTestJSON-879928424-project] Returning 400 to user: Invalid port range 22:1358575221. Valid TCP ports should be between 1-65535 {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:21:13.435730 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-345b39ac-e422-4aeb-8270-5ce5f2a7699b tempest-SecurityGroupRulesNegativeTestJSON-879928424 tempest-SecurityGroupRulesNegativeTestJSON-879928424-project] 10.222.0.17 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.506351 Jul 23 21:21:13.441089 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 943/1880] 10.222.0.17 () {60 vars in 1194 bytes} [Sat Jul 23 21:21:12 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 508 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 23 21:21:14.052377 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5348bb21-cbf5-4538-ac87-f4d3c578b54c tempest-SecurityGroupsTestAdminJSON-1109381468 tempest-SecurityGroupsTestAdminJSON-1109381468-project-admin] Action: 'create', calling method: .version_select at 0x7f0b5994d280>, body: {"security_group": {"name": "tempest-securitygroup-1864588076", "description": "tempest-description-843004457"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:21:14.547680 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-9cd1b2f7-d0b8-4920-b936-c0cab3b9cefe tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] 10.222.0.17 "GET /compute/v2.1/os-floating-ips/cffb12f8-900f-47de-bac7-73f5eb9725b6" status: 200 len: 184 microversion: 2.1 time: 1.533577 Jul 23 21:21:14.552501 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 938/1881] 10.222.0.17 () {58 vars in 1259 bytes} [Sat Jul 23 21:21:13 2022] GET /compute/v2.1/os-floating-ips/cffb12f8-900f-47de-bac7-73f5eb9725b6 => generated 184 bytes in 1540 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:21:14.558366 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-fd3ae946-37e0-40ec-b1e6-dac421abe2ec tempest-SecurityGroupRulesNegativeTestJSON-879928424 tempest-SecurityGroupRulesNegativeTestJSON-879928424-project] Action: 'create', calling method: .version_select at 0x7f0b59973550>, body: {"security_group_rule": {"parent_group_id": "d0d323dc-3baf-4b58-bc48-a68baed440a7", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:21:14.640877 ncdv-master-1 devstack@n-api.service[131321]: DEBUG neutronclient.v2_0.client [None req-fd3ae946-37e0-40ec-b1e6-dac421abe2ec tempest-SecurityGroupRulesNegativeTestJSON-879928424 tempest-SecurityGroupRulesNegativeTestJSON-879928424-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d0d323dc-3baf-4b58-bc48-a68baed440a7 does not exist", "detail": ""}} {{(pid=131321) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 23 21:21:14.641785 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.network.security_group_api [None req-fd3ae946-37e0-40ec-b1e6-dac421abe2ec tempest-SecurityGroupRulesNegativeTestJSON-879928424 tempest-SecurityGroupRulesNegativeTestJSON-879928424-project] Neutron security group d0d323dc-3baf-4b58-bc48-a68baed440a7 not found {{(pid=131321) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 23 21:21:14.644316 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-fd3ae946-37e0-40ec-b1e6-dac421abe2ec tempest-SecurityGroupRulesNegativeTestJSON-879928424 tempest-SecurityGroupRulesNegativeTestJSON-879928424-project] HTTP exception thrown: Security group d0d323dc-3baf-4b58-bc48-a68baed440a7 does not exist Jul 23 21:21:14.644316 ncdv-master-1 devstack@n-api.service[131321]: Neutron server returns request_ids: ['req-619a79b4-a70d-4fd1-a79f-ea21b943ae8b'] Jul 23 21:21:14.664276 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-fd3ae946-37e0-40ec-b1e6-dac421abe2ec tempest-SecurityGroupRulesNegativeTestJSON-879928424 tempest-SecurityGroupRulesNegativeTestJSON-879928424-project] Request method failure captured: Jul 23 21:21:14.664276 ncdv-master-1 devstack@n-api.service[131321]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 23 21:21:14.664276 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:21:14.664276 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:21:14.664276 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:21:14.664276 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 138 Jul 23 21:21:14.664276 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:21:14.664276 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:21:14.664276 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:21:14.664276 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:21:14.664276 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GY1eT5aQfbTYSZ8qSNpwkGSg_DXCHXUOvKjBgTUhuJ83CNIIyYSoc1Fyp_B_huq4EDc7We7E8ITnNX5UxEv9gWdlXqN3krL8qZXMPSYkiof2TvhkHegRxhZjbuI0cpmpFuuysvO2I379hyBIfQGw_T_wKXrR1iWN_J3LNhV4DyqvUc Jul 23 21:21:14.664276 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:21:14.664276 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:21:14.664276 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:21:14.664276 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:21:14.664276 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:21:14.664276 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:21:14.664276 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 24d534ba297c4d709c5ccf36c9394842 Jul 23 21:21:14.664276 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-879928424 Jul 23 21:21:14.664276 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:21:14.664276 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:21:14.666449 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/24d534ba297c4d709c5ccf36c9394842"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/24d534ba297c4d709c5ccf36c9394842"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_24d534ba297c4d709c5ccf36c9394842", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/24d534ba297c4d709c5ccf36c9394842"}]}] Jul 23 21:21:14.666449 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-879928424 Jul 23 21:21:14.666449 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 24d534ba297c4d709c5ccf36c9394842 Jul 23 21:21:14.666449 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-879928424 Jul 23 21:21:14.666449 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-879928424-project Jul 23 21:21:14.666449 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:21:14.666449 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:21:14.666449 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: a271336fe39f4bcb94d326ddfb7b4365 Jul 23 21:21:14.666449 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-879928424-project Jul 23 21:21:14.666449 ncdv-master-1 devstack@n-api.service[131321]: Jul 23 21:21:14.666449 ncdv-master-1 devstack@n-api.service[131321]: {"security_group_rule": {"parent_group_id": "d0d323dc-3baf-4b58-bc48-a68baed440a7", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jul 23 21:21:14.666449 ncdv-master-1 devstack@n-api.service[131321]: method: Jul 23 21:21:14.667445 ncdv-master-1 devstack@n-api.service[131321]: exception: Security group d0d323dc-3baf-4b58-bc48-a68baed440a7 does not exist Jul 23 21:21:14.667445 ncdv-master-1 devstack@n-api.service[131321]: Neutron server returns request_ids: ['req-619a79b4-a70d-4fd1-a79f-ea21b943ae8b'] Jul 23 21:21:14.667445 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'd0d323dc-3baf-4b58-bc48-a68baed440a7', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jul 23 21:21:14.667445 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:21:14.667445 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:21:14.667445 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 23 21:21:14.667445 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 23 21:21:14.667445 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:21:14.667445 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:21:14.667445 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 23 21:21:14.667445 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 23 21:21:14.667445 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:21:14.667445 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:21:14.667445 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 23 21:21:14.667445 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 23 21:21:14.667445 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:21:14.667445 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:21:14.667445 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 23 21:21:14.667445 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 23 21:21:14.669122 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:21:14.669122 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:21:14.669122 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 23 21:21:14.669122 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 23 21:21:14.669122 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:21:14.669122 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:21:14.669122 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 23 21:21:14.669122 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 23 21:21:14.669122 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 23 21:21:14.669122 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 23 21:21:14.669122 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d0d323dc-3baf-4b58-bc48-a68baed440a7 does not exist Jul 23 21:21:14.669122 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-619a79b4-a70d-4fd1-a79f-ea21b943ae8b'] Jul 23 21:21:14.669122 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:21:14.669122 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:21:14.669122 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:21:14.669122 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:21:14.669122 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Jul 23 21:21:14.669122 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Jul 23 21:21:14.669122 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 23 21:21:14.670731 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 23 21:21:14.670731 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d0d323dc-3baf-4b58-bc48-a68baed440a7 does not exist Jul 23 21:21:14.670731 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-619a79b4-a70d-4fd1-a79f-ea21b943ae8b'] Jul 23 21:21:14.670731 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:21:14.670731 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:21:14.670731 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:21:14.670731 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:21:14.670731 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:21:14.670731 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:21:14.670731 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:21:14.670731 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:21:14.670731 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:21:14.670731 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:21:14.670731 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:21:14.670731 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:21:14.670731 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Jul 23 21:21:14.670731 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 23 21:21:14.670731 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d0d323dc-3baf-4b58-bc48-a68baed440a7 does not exist Jul 23 21:21:14.670731 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-619a79b4-a70d-4fd1-a79f-ea21b943ae8b'] Jul 23 21:21:14.670731 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:21:14.672352 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:21:14.672352 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:21:14.672352 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:21:14.672352 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:21:14.672352 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:21:14.672352 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:21:14.672352 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:21:14.672352 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d0d323dc-3baf-4b58-bc48-a68baed440a7 does not exist Jul 23 21:21:14.672352 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-619a79b4-a70d-4fd1-a79f-ea21b943ae8b'] Jul 23 21:21:14.672352 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:21:14.674008 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-fd3ae946-37e0-40ec-b1e6-dac421abe2ec tempest-SecurityGroupRulesNegativeTestJSON-879928424 tempest-SecurityGroupRulesNegativeTestJSON-879928424-project] Returning 404 to user: Security group d0d323dc-3baf-4b58-bc48-a68baed440a7 does not exist Jul 23 21:21:14.674008 ncdv-master-1 devstack@n-api.service[131321]: Neutron server returns request_ids: ['req-619a79b4-a70d-4fd1-a79f-ea21b943ae8b'] {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:21:14.677372 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-fd3ae946-37e0-40ec-b1e6-dac421abe2ec tempest-SecurityGroupRulesNegativeTestJSON-879928424 tempest-SecurityGroupRulesNegativeTestJSON-879928424-project] 10.222.0.17 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.120370 Jul 23 21:21:14.682872 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 939/1882] 10.222.0.17 () {60 vars in 1194 bytes} [Sat Jul 23 21:21:14 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:21:14.708484 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-0b764615-b39d-4c79-817c-e0939e72d097 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '.version_select at 0x7f0b542c5ee0>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:14.779752 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-0b764615-b39d-4c79-817c-e0939e72d097 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/images/76af21a6-17d9-434a-b039-2b4f2d2c8a7f" status: 200 len: 1455 microversion: 2.1 time: 0.091830 Jul 23 21:21:14.788418 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 940/1883] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:21:14 2022] GET /compute/v2.1/images/76af21a6-17d9-434a-b039-2b4f2d2c8a7f => generated 1455 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:21:14.794098 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-5a60ff91-0021-4ffa-8f78-a6d926f70829 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:14.795107 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-5a60ff91-0021-4ffa-8f78-a6d926f70829 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] [instance: 6435faed-ac55-4f93-ac79-2668c6538209] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:21:14.803741 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5a60ff91-0021-4ffa-8f78-a6d926f70829 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:14.804538 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5a60ff91-0021-4ffa-8f78-a6d926f70829 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:14.806762 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5a60ff91-0021-4ffa-8f78-a6d926f70829 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:14.808245 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5a60ff91-0021-4ffa-8f78-a6d926f70829 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:14.903795 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-5a60ff91-0021-4ffa-8f78-a6d926f70829 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf93a4b80cb4e19a36473986950fc75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c1943188684b45b636541caf587247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:21:14.920916 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-5a60ff91-0021-4ffa-8f78-a6d926f70829 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] 10.222.0.17 "GET /compute/v2.1/servers/6435faed-ac55-4f93-ac79-2668c6538209" status: 200 len: 1270 microversion: 2.1 time: 0.127290 Jul 23 21:21:14.922150 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 941/1884] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:21:14 2022] GET /compute/v2.1/servers/6435faed-ac55-4f93-ac79-2668c6538209 => generated 1270 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:21:14.929230 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-2486063e-27cb-4ba7-a6ca-3af384f99b8f req-f85ac18f-928b-473c-906a-b0eac84377d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3075a998-589a-474c-ac0a-3c53f63ab574", "name": "network-vif-deleted", "tag": "5b53216a-bd51-4bcb-9d1e-76b2724f0d16"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:21:14.944879 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-2486063e-27cb-4ba7-a6ca-3af384f99b8f req-f85ac18f-928b-473c-906a-b0eac84377d8 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:14.946260 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-2486063e-27cb-4ba7-a6ca-3af384f99b8f req-f85ac18f-928b-473c-906a-b0eac84377d8 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:14.975144 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-2486063e-27cb-4ba7-a6ca-3af384f99b8f req-f85ac18f-928b-473c-906a-b0eac84377d8 service nova] Creating event network-vif-deleted:5b53216a-bd51-4bcb-9d1e-76b2724f0d16 for instance 3075a998-589a-474c-ac0a-3c53f63ab574 on nch2-master-1 Jul 23 21:21:14.981427 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-2486063e-27cb-4ba7-a6ca-3af384f99b8f req-f85ac18f-928b-473c-906a-b0eac84377d8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056816 Jul 23 21:21:14.985631 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 942/1885] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:21:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:21:14.992329 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-088cc899-7dd8-4f64-8da3-139d16f0e2fa req-d7d775c6-f9fc-46d7-b138-81a1426902d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "059bbe3e-cf86-4689-a696-0161d7d27dfd", "tag": "53a52999-801e-42e8-afb4-ed6908a0b011"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:21:15.004338 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-088cc899-7dd8-4f64-8da3-139d16f0e2fa req-d7d775c6-f9fc-46d7-b138-81a1426902d4 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:15.004659 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-088cc899-7dd8-4f64-8da3-139d16f0e2fa req-d7d775c6-f9fc-46d7-b138-81a1426902d4 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:15.021103 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-088cc899-7dd8-4f64-8da3-139d16f0e2fa req-d7d775c6-f9fc-46d7-b138-81a1426902d4 service nova] Creating event network-changed:53a52999-801e-42e8-afb4-ed6908a0b011 for instance 059bbe3e-cf86-4689-a696-0161d7d27dfd on nch1-master-1 Jul 23 21:21:15.029930 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-088cc899-7dd8-4f64-8da3-139d16f0e2fa req-d7d775c6-f9fc-46d7-b138-81a1426902d4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042025 Jul 23 21:21:15.031796 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 943/1886] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:21:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:21:15.041119 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-7bb83db2-2d38-4a19-bfaf-45713998601d tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.4.77"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:21:15.470627 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5348bb21-cbf5-4538-ac87-f4d3c578b54c tempest-SecurityGroupsTestAdminJSON-1109381468 tempest-SecurityGroupsTestAdminJSON-1109381468-project-admin] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 2.033071 Jul 23 21:21:15.481275 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 944/1887] 10.222.0.17 () {60 vars in 1179 bytes} [Sat Jul 23 21:21:13 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 2044 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:21:15.491902 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c5f69ecf-ee63-4d15-916c-6dcfee5ba7f9 tempest-SecurityGroupRulesNegativeTestJSON-879928424 tempest-SecurityGroupRulesNegativeTestJSON-879928424-project] Calling method '.version_select at 0x7f0b599d8700>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:15.594213 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-7bb83db2-2d38-4a19-bfaf-45713998601d tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] [instance: 059bbe3e-cf86-4689-a696-0161d7d27dfd] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:21:15.602121 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7bb83db2-2d38-4a19-bfaf-45713998601d tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:15.602871 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7bb83db2-2d38-4a19-bfaf-45713998601d tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:15.603843 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7bb83db2-2d38-4a19-bfaf-45713998601d tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:15.606199 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7bb83db2-2d38-4a19-bfaf-45713998601d tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:16.060627 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7bb83db2-2d38-4a19-bfaf-45713998601d tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Acquired lock "refresh_cache-059bbe3e-cf86-4689-a696-0161d7d27dfd" {{(pid=131321) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 23 21:21:16.273389 ncdv-master-1 devstack@n-api.service[131320]: DEBUG neutronclient.v2_0.client [None req-c5f69ecf-ee63-4d15-916c-6dcfee5ba7f9 tempest-SecurityGroupRulesNegativeTestJSON-879928424 tempest-SecurityGroupRulesNegativeTestJSON-879928424-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule ba6bea17-3275-49e8-9794-c895c832b90c does not exist", "detail": ""}} {{(pid=131320) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 23 21:21:16.274616 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.security_group_api [None req-c5f69ecf-ee63-4d15-916c-6dcfee5ba7f9 tempest-SecurityGroupRulesNegativeTestJSON-879928424 tempest-SecurityGroupRulesNegativeTestJSON-879928424-project] Neutron security group rule ba6bea17-3275-49e8-9794-c895c832b90c not found {{(pid=131320) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Jul 23 21:21:16.275512 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-c5f69ecf-ee63-4d15-916c-6dcfee5ba7f9 tempest-SecurityGroupRulesNegativeTestJSON-879928424 tempest-SecurityGroupRulesNegativeTestJSON-879928424-project] HTTP exception thrown: Security group rule ba6bea17-3275-49e8-9794-c895c832b90c does not exist Jul 23 21:21:16.275512 ncdv-master-1 devstack@n-api.service[131320]: Neutron server returns request_ids: ['req-c850ce00-2ceb-447e-bdc3-df421ae311f0'] Jul 23 21:21:16.277778 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c5f69ecf-ee63-4d15-916c-6dcfee5ba7f9 tempest-SecurityGroupRulesNegativeTestJSON-879928424 tempest-SecurityGroupRulesNegativeTestJSON-879928424-project] Request method failure captured: Jul 23 21:21:16.277778 ncdv-master-1 devstack@n-api.service[131320]: request: DELETE /compute/v2.1/os-security-group-rules/ba6bea17-3275-49e8-9794-c895c832b90c HTTP/1.1 Jul 23 21:21:16.277778 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:21:16.277778 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:21:16.277778 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:21:16.277778 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:21:16.277778 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:21:16.277778 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:21:16.277778 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:21:16.277778 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:21:16.277778 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GY1eT5aQfbTYSZ8qSNpwkGSg_DXCHXUOvKjBgTUhuJ83CNIIyYSoc1Fyp_B_huq4EDc7We7E8ITnNX5UxEv9gWdlXqN3krL8qZXMPSYkiof2TvhkHegRxhZjbuI0cpmpFuuysvO2I379hyBIfQGw_T_wKXrR1iWN_J3LNhV4DyqvUc Jul 23 21:21:16.277778 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:21:16.277778 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:21:16.277778 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:21:16.277778 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:21:16.277778 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:21:16.277778 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:21:16.277778 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 24d534ba297c4d709c5ccf36c9394842 Jul 23 21:21:16.277778 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-879928424 Jul 23 21:21:16.277778 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:21:16.277778 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:21:16.279295 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/24d534ba297c4d709c5ccf36c9394842"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/24d534ba297c4d709c5ccf36c9394842"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_24d534ba297c4d709c5ccf36c9394842", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/24d534ba297c4d709c5ccf36c9394842"}]}] Jul 23 21:21:16.279295 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-879928424 Jul 23 21:21:16.279295 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 24d534ba297c4d709c5ccf36c9394842 Jul 23 21:21:16.279295 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-879928424 Jul 23 21:21:16.279295 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-879928424-project Jul 23 21:21:16.279295 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:21:16.279295 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:21:16.279295 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: a271336fe39f4bcb94d326ddfb7b4365 Jul 23 21:21:16.279295 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-879928424-project Jul 23 21:21:16.279295 ncdv-master-1 devstack@n-api.service[131320]: method: Jul 23 21:21:16.279295 ncdv-master-1 devstack@n-api.service[131320]: exception: Security group rule ba6bea17-3275-49e8-9794-c895c832b90c does not exist Jul 23 21:21:16.279295 ncdv-master-1 devstack@n-api.service[131320]: Neutron server returns request_ids: ['req-c850ce00-2ceb-447e-bdc3-df421ae311f0'] Jul 23 21:21:16.280231 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': 'ba6bea17-3275-49e8-9794-c895c832b90c'} Jul 23 21:21:16.280231 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:21:16.280231 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:21:16.280231 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Jul 23 21:21:16.280231 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Jul 23 21:21:16.280231 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:21:16.280231 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:21:16.280231 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1064, in show_security_group_rule Jul 23 21:21:16.280231 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Jul 23 21:21:16.280231 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:21:16.280231 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:21:16.280231 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 23 21:21:16.280231 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 23 21:21:16.280231 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:21:16.280231 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:21:16.280231 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 23 21:21:16.280231 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 23 21:21:16.280231 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:21:16.280231 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:21:16.281524 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 23 21:21:16.281524 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 23 21:21:16.281524 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:21:16.281524 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:21:16.281524 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 23 21:21:16.281524 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 23 21:21:16.281524 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 23 21:21:16.281524 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 23 21:21:16.281524 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule ba6bea17-3275-49e8-9794-c895c832b90c does not exist Jul 23 21:21:16.281524 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c850ce00-2ceb-447e-bdc3-df421ae311f0'] Jul 23 21:21:16.281524 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:21:16.281524 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:21:16.281524 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:21:16.281524 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:21:16.281524 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Jul 23 21:21:16.281524 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Jul 23 21:21:16.281524 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Jul 23 21:21:16.281524 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 23 21:21:16.286134 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule ba6bea17-3275-49e8-9794-c895c832b90c does not exist Jul 23 21:21:16.286134 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c850ce00-2ceb-447e-bdc3-df421ae311f0'] Jul 23 21:21:16.286134 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:21:16.286134 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:21:16.286134 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:21:16.286134 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:21:16.286134 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:21:16.286134 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:21:16.286134 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:21:16.286134 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:21:16.286134 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:21:16.286134 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:21:16.286134 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:21:16.286134 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:21:16.286134 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Jul 23 21:21:16.286134 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 23 21:21:16.286134 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule ba6bea17-3275-49e8-9794-c895c832b90c does not exist Jul 23 21:21:16.286134 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c850ce00-2ceb-447e-bdc3-df421ae311f0'] Jul 23 21:21:16.286134 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:21:16.286134 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:21:16.289831 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:21:16.289831 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:21:16.289831 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:21:16.289831 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:21:16.289831 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:21:16.289831 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:21:16.289831 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule ba6bea17-3275-49e8-9794-c895c832b90c does not exist Jul 23 21:21:16.289831 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c850ce00-2ceb-447e-bdc3-df421ae311f0'] Jul 23 21:21:16.289831 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:21:16.289831 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c5f69ecf-ee63-4d15-916c-6dcfee5ba7f9 tempest-SecurityGroupRulesNegativeTestJSON-879928424 tempest-SecurityGroupRulesNegativeTestJSON-879928424-project] Returning 404 to user: Security group rule ba6bea17-3275-49e8-9794-c895c832b90c does not exist Jul 23 21:21:16.289831 ncdv-master-1 devstack@n-api.service[131320]: Neutron server returns request_ids: ['req-c850ce00-2ceb-447e-bdc3-df421ae311f0'] {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:21:16.289831 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c5f69ecf-ee63-4d15-916c-6dcfee5ba7f9 tempest-SecurityGroupRulesNegativeTestJSON-879928424 tempest-SecurityGroupRulesNegativeTestJSON-879928424-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-group-rules/ba6bea17-3275-49e8-9794-c895c832b90c" status: 404 len: 199 microversion: 2.1 time: 0.797084 Jul 23 21:21:16.289831 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 945/1888] 10.222.0.17 () {58 vars in 1286 bytes} [Sat Jul 23 21:21:15 2022] DELETE /compute/v2.1/os-security-group-rules/ba6bea17-3275-49e8-9794-c895c832b90c => generated 199 bytes in 798 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:21:16.302498 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-abc4635a-c1a0-4b84-986c-7c10f7b28769 tempest-SecurityGroupsTestAdminJSON-1109381468 tempest-SecurityGroupsTestAdminJSON-1109381468-project-admin] Action: 'create', calling method: .version_select at 0x7f0b5990f280>, body: {"security_group": {"name": "tempest-securitygroup-263949904", "description": "tempest-description-743354656"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:21:17.276248 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-abc4635a-c1a0-4b84-986c-7c10f7b28769 tempest-SecurityGroupsTestAdminJSON-1109381468 tempest-SecurityGroupsTestAdminJSON-1109381468-project-admin] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 0.994506 Jul 23 21:21:17.277193 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 946/1889] 10.222.0.17 () {60 vars in 1179 bytes} [Sat Jul 23 21:21:16 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:21:17.286793 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a51584b2-b5ec-4563-b283-8e108cb60890 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '.version_select at 0x7f0b5994d550>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:17.371955 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a51584b2-b5ec-4563-b283-8e108cb60890 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/images/76af21a6-17d9-434a-b039-2b4f2d2c8a7f" status: 200 len: 1455 microversion: 2.1 time: 0.093005 Jul 23 21:21:17.373104 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 947/1890] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:21:17 2022] GET /compute/v2.1/images/76af21a6-17d9-434a-b039-2b4f2d2c8a7f => generated 1455 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:21:17.380397 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-50d97e1e-101e-49cd-9591-02a2d63d6b30 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:17.381400 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-50d97e1e-101e-49cd-9591-02a2d63d6b30 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] [instance: 6435faed-ac55-4f93-ac79-2668c6538209] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:21:17.392634 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-50d97e1e-101e-49cd-9591-02a2d63d6b30 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:17.393661 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-50d97e1e-101e-49cd-9591-02a2d63d6b30 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:17.395521 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-50d97e1e-101e-49cd-9591-02a2d63d6b30 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:17.396691 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-50d97e1e-101e-49cd-9591-02a2d63d6b30 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:17.913394 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-50d97e1e-101e-49cd-9591-02a2d63d6b30 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf93a4b80cb4e19a36473986950fc75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c1943188684b45b636541caf587247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:21:17.930460 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-50d97e1e-101e-49cd-9591-02a2d63d6b30 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] 10.222.0.17 "GET /compute/v2.1/servers/6435faed-ac55-4f93-ac79-2668c6538209" status: 200 len: 1312 microversion: 2.1 time: 0.555369 Jul 23 21:21:17.939687 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 948/1891] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:21:17 2022] GET /compute/v2.1/servers/6435faed-ac55-4f93-ac79-2668c6538209 => generated 1312 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:21:17.939687 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-73565314-4dc6-4350-8feb-ba841f36b565 tempest-SecurityGroupRulesNegativeTestJSON-879928424 tempest-SecurityGroupRulesNegativeTestJSON-879928424-project] Calling method '.version_select at 0x7f0b5990f5e0>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:18.329721 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.network.neutron [None req-7bb83db2-2d38-4a19-bfaf-45713998601d tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] [instance: 059bbe3e-cf86-4689-a696-0161d7d27dfd] Building network info cache for instance {{(pid=131321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 23 21:21:18.985773 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-73565314-4dc6-4350-8feb-ba841f36b565 tempest-SecurityGroupRulesNegativeTestJSON-879928424 tempest-SecurityGroupRulesNegativeTestJSON-879928424-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/f6cd4a63-1dec-4e88-8e8b-11acc2dc751c" status: 202 len: 0 microversion: 2.1 time: 1.053268 Jul 23 21:21:18.986851 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 949/1892] 10.222.0.17 () {58 vars in 1271 bytes} [Sat Jul 23 21:21:17 2022] DELETE /compute/v2.1/os-security-groups/f6cd4a63-1dec-4e88-8e8b-11acc2dc751c => generated 0 bytes in 1055 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:21:18.991692 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c602e40e-d1fc-40fb-ac35-3d6e57a3d1ca tempest-SecurityGroupsTestAdminJSON-1109381468 tempest-SecurityGroupsTestAdminJSON-1109381468-project-admin] Calling method '.version_select at 0x7f0b5990ff70>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:19.281607 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.network.neutron [None req-7bb83db2-2d38-4a19-bfaf-45713998601d tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] [instance: 059bbe3e-cf86-4689-a696-0161d7d27dfd] Updating instance_info_cache with network_info: [{"id": "53a52999-801e-42e8-afb4-ed6908a0b011", "address": "fa:16:3e:8d:25:6e", "network": {"id": "1bf1175b-8b51-4fe1-8a7e-c57501a7f9a2", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-689906731-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "e165633a87b04bd9bc3f6e575f53fb12", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap53a52999-80", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=131321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 23 21:21:19.316522 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7bb83db2-2d38-4a19-bfaf-45713998601d tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Releasing lock "refresh_cache-059bbe3e-cf86-4689-a696-0161d7d27dfd" {{(pid=131321) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 23 21:21:19.319864 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-7bb83db2-2d38-4a19-bfaf-45713998601d tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] 10.222.0.17 "POST /compute/v2.1/servers/059bbe3e-cf86-4689-a696-0161d7d27dfd/action" status: 202 len: 0 microversion: 2.1 time: 4.286706 Jul 23 21:21:19.323285 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 944/1893] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:21:15 2022] POST /compute/v2.1/servers/059bbe3e-cf86-4689-a696-0161d7d27dfd/action => generated 0 bytes in 4291 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 23 21:21:19.330222 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-dcf94bca-c2c4-4ff2-970e-3f5aaf6594dc req-5d5f760a-5e11-4333-8196-bb01173894f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cef13563-7f83-4281-a26c-d5e420c41daf", "tag": "e6c3948e-9005-4405-9ade-a304ad56f44a"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:21:19.363526 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-dcf94bca-c2c4-4ff2-970e-3f5aaf6594dc req-5d5f760a-5e11-4333-8196-bb01173894f6 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:19.364272 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-dcf94bca-c2c4-4ff2-970e-3f5aaf6594dc req-5d5f760a-5e11-4333-8196-bb01173894f6 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:19.395315 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-dcf94bca-c2c4-4ff2-970e-3f5aaf6594dc req-5d5f760a-5e11-4333-8196-bb01173894f6 service nova] Creating event network-changed:e6c3948e-9005-4405-9ade-a304ad56f44a for instance cef13563-7f83-4281-a26c-d5e420c41daf on nch1-master-1 Jul 23 21:21:19.402010 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-dcf94bca-c2c4-4ff2-970e-3f5aaf6594dc req-5d5f760a-5e11-4333-8196-bb01173894f6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077069 Jul 23 21:21:19.403538 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 945/1894] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:21:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:21:19.409702 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c1bc46e2-f11e-49d7-917c-4f79baa53807 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '.version_select at 0x7f0b47651f70>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:19.467453 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-c1bc46e2-f11e-49d7-917c-4f79baa53807 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/images/76af21a6-17d9-434a-b039-2b4f2d2c8a7f" status: 200 len: 1464 microversion: 2.1 time: 0.062212 Jul 23 21:21:19.468332 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 946/1895] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:21:19 2022] GET /compute/v2.1/images/76af21a6-17d9-434a-b039-2b4f2d2c8a7f => generated 1464 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:21:19.472918 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-c8f50854-4e4e-4660-9b38-c604adc63f4b req-5fb1b6b2-f818-4ac5-a511-5b6d68e3d399 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "059bbe3e-cf86-4689-a696-0161d7d27dfd", "tag": "53a52999-801e-42e8-afb4-ed6908a0b011"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:21:19.483912 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-c8f50854-4e4e-4660-9b38-c604adc63f4b req-5fb1b6b2-f818-4ac5-a511-5b6d68e3d399 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:19.484709 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-c8f50854-4e4e-4660-9b38-c604adc63f4b req-5fb1b6b2-f818-4ac5-a511-5b6d68e3d399 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:19.498101 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-c8f50854-4e4e-4660-9b38-c604adc63f4b req-5fb1b6b2-f818-4ac5-a511-5b6d68e3d399 service nova] Creating event network-changed:53a52999-801e-42e8-afb4-ed6908a0b011 for instance 059bbe3e-cf86-4689-a696-0161d7d27dfd on nch1-master-1 Jul 23 21:21:19.505520 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-c8f50854-4e4e-4660-9b38-c604adc63f4b req-5fb1b6b2-f818-4ac5-a511-5b6d68e3d399 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035798 Jul 23 21:21:19.506989 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 947/1896] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:21:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:21:19.513779 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-37f8a79f-4c8b-43b0-a190-f3e2863acbbe tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:19.515044 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-37f8a79f-4c8b-43b0-a190-f3e2863acbbe tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] [instance: 6435faed-ac55-4f93-ac79-2668c6538209] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:21:19.526585 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-37f8a79f-4c8b-43b0-a190-f3e2863acbbe tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:19.527268 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-37f8a79f-4c8b-43b0-a190-f3e2863acbbe tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:19.529043 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-37f8a79f-4c8b-43b0-a190-f3e2863acbbe tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:19.529658 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-37f8a79f-4c8b-43b0-a190-f3e2863acbbe tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:20.045062 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-37f8a79f-4c8b-43b0-a190-f3e2863acbbe tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf93a4b80cb4e19a36473986950fc75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c1943188684b45b636541caf587247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:21:20.054208 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-37f8a79f-4c8b-43b0-a190-f3e2863acbbe tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] 10.222.0.17 "GET /compute/v2.1/servers/6435faed-ac55-4f93-ac79-2668c6538209" status: 200 len: 1312 microversion: 2.1 time: 0.545704 Jul 23 21:21:20.060476 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 948/1897] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:21:19 2022] GET /compute/v2.1/servers/6435faed-ac55-4f93-ac79-2668c6538209 => generated 1312 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:21:20.074231 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-b8ff071f-1035-467f-9128-2b900ab3b104 tempest-SecurityGroupRulesNegativeTestJSON-879928424 tempest-SecurityGroupRulesNegativeTestJSON-879928424-project] Calling method '.version_select at 0x7f0b476431f0>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:20.842296 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-b8ff071f-1035-467f-9128-2b900ab3b104 tempest-SecurityGroupRulesNegativeTestJSON-879928424 tempest-SecurityGroupRulesNegativeTestJSON-879928424-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/91d90db7-40e8-47b7-8fcd-a9909ce30aec" status: 202 len: 0 microversion: 2.1 time: 0.780031 Jul 23 21:21:20.843371 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 949/1898] 10.222.0.17 () {58 vars in 1271 bytes} [Sat Jul 23 21:21:20 2022] DELETE /compute/v2.1/os-security-groups/91d90db7-40e8-47b7-8fcd-a9909ce30aec => generated 0 bytes in 782 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:21:20.852459 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-fea56dbe-fbae-4094-b0da-97d07a034956 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:20.853335 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-fea56dbe-fbae-4094-b0da-97d07a034956 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] [instance: 3075a998-589a-474c-ac0a-3c53f63ab574] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:21:20.860681 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fea56dbe-fbae-4094-b0da-97d07a034956 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:20.861542 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fea56dbe-fbae-4094-b0da-97d07a034956 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:20.862714 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fea56dbe-fbae-4094-b0da-97d07a034956 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:20.870546 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fea56dbe-fbae-4094-b0da-97d07a034956 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:20.895779 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-fea56dbe-fbae-4094-b0da-97d07a034956 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] HTTP exception thrown: Instance 3075a998-589a-474c-ac0a-3c53f63ab574 could not be found. Jul 23 21:21:20.897833 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-fea56dbe-fbae-4094-b0da-97d07a034956 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Request method failure captured: Jul 23 21:21:20.897833 ncdv-master-1 devstack@n-api.service[131321]: request: DELETE /compute/v2.1/servers/3075a998-589a-474c-ac0a-3c53f63ab574 HTTP/1.1 Jul 23 21:21:20.897833 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:21:20.897833 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:21:20.897833 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:21:20.897833 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:21:20.897833 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:21:20.897833 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:21:20.897833 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:21:20.897833 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:21:20.897833 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GYCiCSvABggbkRGyW9tVBfmI6PMsNLVagiAjHSJJNKVuWZoEtduA9IL0lOHdtNx1Ght7MZZFPAHrevWH-4ksCxkiY7Aa9MUFIyCTTle61AJS3x1mKuGfuukBb9LGdOubsvWfe19GFqQP6x_U7hVN7id3QYMj3rofVRJAKlk8fD-LMM Jul 23 21:21:20.897833 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:21:20.897833 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:21:20.897833 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:21:20.897833 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:21:20.897833 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:21:20.897833 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:21:20.897833 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: e165633a87b04bd9bc3f6e575f53fb12 Jul 23 21:21:20.897833 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-268320235 Jul 23 21:21:20.897833 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:21:20.897833 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:21:20.899364 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e165633a87b04bd9bc3f6e575f53fb12"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e165633a87b04bd9bc3f6e575f53fb12"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e165633a87b04bd9bc3f6e575f53fb12", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e165633a87b04bd9bc3f6e575f53fb12"}]}] Jul 23 21:21:20.899364 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-268320235 Jul 23 21:21:20.899364 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: e165633a87b04bd9bc3f6e575f53fb12 Jul 23 21:21:20.899364 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-268320235 Jul 23 21:21:20.899364 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-FloatingIPsAssociationTestJSON-268320235-project Jul 23 21:21:20.899364 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:21:20.899364 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:21:20.899364 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 194f98e3c86b48e9952fe02d3648beb0 Jul 23 21:21:20.899364 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-268320235-project Jul 23 21:21:20.899364 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:21:20.899364 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance 3075a998-589a-474c-ac0a-3c53f63ab574 could not be found. Jul 23 21:21:20.899364 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': '3075a998-589a-474c-ac0a-3c53f63ab574'} Jul 23 21:21:20.900196 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:21:20.900196 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:21:20.900196 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:21:20.900196 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:21:20.900196 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:21:20.900196 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:21:20.900196 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:21:20.900196 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:21:20.900196 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:21:20.900196 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:21:20.900196 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3075a998-589a-474c-ac0a-3c53f63ab574 could not be found. Jul 23 21:21:20.900196 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:21:20.900196 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:21:20.900196 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:21:20.900196 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:21:20.900196 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:21:20.900196 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:21:20.900196 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:21:20.900196 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:21:20.900196 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:21:20.901528 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:21:20.901528 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 23 21:21:20.901528 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 23 21:21:20.901528 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 23 21:21:20.901528 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 23 21:21:20.901528 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:21:20.901528 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:21:20.901528 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:21:20.901528 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:21:20.901528 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3075a998-589a-474c-ac0a-3c53f63ab574 could not be found. Jul 23 21:21:20.901528 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:21:20.901528 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:21:20.901528 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:21:20.901528 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:21:20.901528 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:21:20.901528 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:21:20.901528 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:21:20.901528 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:21:20.901528 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3075a998-589a-474c-ac0a-3c53f63ab574 could not be found. Jul 23 21:21:20.901528 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:21:20.904823 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-fea56dbe-fbae-4094-b0da-97d07a034956 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Returning 404 to user: Instance 3075a998-589a-474c-ac0a-3c53f63ab574 could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:21:20.905997 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-fea56dbe-fbae-4094-b0da-97d07a034956 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] 10.222.0.17 "DELETE /compute/v2.1/servers/3075a998-589a-474c-ac0a-3c53f63ab574" status: 404 len: 111 microversion: 2.1 time: 0.061275 Jul 23 21:21:20.910641 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 950/1899] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:21:20 2022] DELETE /compute/v2.1/servers/3075a998-589a-474c-ac0a-3c53f63ab574 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:21:20.918830 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-b67d8152-f991-462f-9d63-2eab4d736cd2 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '.version_select at 0x7f0b542c5c10>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:20.978300 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-b67d8152-f991-462f-9d63-2eab4d736cd2 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/images/76af21a6-17d9-434a-b039-2b4f2d2c8a7f" status: 200 len: 1464 microversion: 2.1 time: 0.064838 Jul 23 21:21:20.978999 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 951/1900] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:21:20 2022] GET /compute/v2.1/images/76af21a6-17d9-434a-b039-2b4f2d2c8a7f => generated 1464 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:21:20.984480 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a90f4e10-df29-4bbc-92a2-53c6e45ae8c3 tempest-SecurityGroupRulesNegativeTestJSON-879928424 tempest-SecurityGroupRulesNegativeTestJSON-879928424-project] Calling method '.version_select at 0x7f0b47643550>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:21.165116 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=4 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:21:21.229245 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=12 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:21:21.699378 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-a90f4e10-df29-4bbc-92a2-53c6e45ae8c3 tempest-SecurityGroupRulesNegativeTestJSON-879928424 tempest-SecurityGroupRulesNegativeTestJSON-879928424-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/ba24e399-f11c-4dd8-9716-1d7b56cc9683" status: 202 len: 0 microversion: 2.1 time: 0.717916 Jul 23 21:21:21.702999 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 952/1901] 10.222.0.17 () {58 vars in 1271 bytes} [Sat Jul 23 21:21:20 2022] DELETE /compute/v2.1/os-security-groups/ba24e399-f11c-4dd8-9716-1d7b56cc9683 => generated 0 bytes in 720 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:21:21.711400 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-4e4fbc08-2a9f-47fe-a909-42c05cb06d08 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:21.712876 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-4e4fbc08-2a9f-47fe-a909-42c05cb06d08 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] [instance: 3075a998-589a-474c-ac0a-3c53f63ab574] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:21:21.733729 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4e4fbc08-2a9f-47fe-a909-42c05cb06d08 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:21.734225 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4e4fbc08-2a9f-47fe-a909-42c05cb06d08 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:21.737034 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4e4fbc08-2a9f-47fe-a909-42c05cb06d08 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:21.737675 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4e4fbc08-2a9f-47fe-a909-42c05cb06d08 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:21.783339 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-4e4fbc08-2a9f-47fe-a909-42c05cb06d08 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] HTTP exception thrown: Instance 3075a998-589a-474c-ac0a-3c53f63ab574 could not be found. Jul 23 21:21:21.785223 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-4e4fbc08-2a9f-47fe-a909-42c05cb06d08 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Request method failure captured: Jul 23 21:21:21.785223 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/servers/3075a998-589a-474c-ac0a-3c53f63ab574 HTTP/1.1 Jul 23 21:21:21.785223 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:21:21.785223 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:21:21.785223 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:21:21.785223 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:21:21.785223 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:21:21.785223 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:21:21.785223 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:21:21.785223 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:21:21.785223 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GYCiCSvABggbkRGyW9tVBfmI6PMsNLVagiAjHSJJNKVuWZoEtduA9IL0lOHdtNx1Ght7MZZFPAHrevWH-4ksCxkiY7Aa9MUFIyCTTle61AJS3x1mKuGfuukBb9LGdOubsvWfe19GFqQP6x_U7hVN7id3QYMj3rofVRJAKlk8fD-LMM Jul 23 21:21:21.785223 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:21:21.785223 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:21:21.785223 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:21:21.785223 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:21:21.785223 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:21:21.785223 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:21:21.785223 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: e165633a87b04bd9bc3f6e575f53fb12 Jul 23 21:21:21.785223 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-268320235 Jul 23 21:21:21.785223 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:21:21.785223 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:21:21.787005 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e165633a87b04bd9bc3f6e575f53fb12"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e165633a87b04bd9bc3f6e575f53fb12"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e165633a87b04bd9bc3f6e575f53fb12", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e165633a87b04bd9bc3f6e575f53fb12"}]}] Jul 23 21:21:21.787005 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-268320235 Jul 23 21:21:21.787005 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: e165633a87b04bd9bc3f6e575f53fb12 Jul 23 21:21:21.787005 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-268320235 Jul 23 21:21:21.787005 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-FloatingIPsAssociationTestJSON-268320235-project Jul 23 21:21:21.787005 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:21:21.787005 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:21:21.787005 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 194f98e3c86b48e9952fe02d3648beb0 Jul 23 21:21:21.787005 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-268320235-project Jul 23 21:21:21.787005 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:21:21.787005 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance 3075a998-589a-474c-ac0a-3c53f63ab574 could not be found. Jul 23 21:21:21.787005 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': '3075a998-589a-474c-ac0a-3c53f63ab574'} Jul 23 21:21:21.788038 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:21:21.788038 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:21:21.788038 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:21:21.788038 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:21:21.788038 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:21:21.788038 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:21:21.788038 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:21:21.788038 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:21:21.788038 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:21:21.788038 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:21:21.788038 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3075a998-589a-474c-ac0a-3c53f63ab574 could not be found. Jul 23 21:21:21.788038 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:21:21.788038 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:21:21.788038 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:21:21.788038 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:21:21.788038 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:21:21.788038 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:21:21.788038 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:21:21.788038 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:21:21.788038 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:21:21.789853 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:21:21.789853 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:21:21.789853 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:21:21.789853 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:21:21.789853 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:21:21.789853 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:21:21.789853 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:21:21.789853 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3075a998-589a-474c-ac0a-3c53f63ab574 could not be found. Jul 23 21:21:21.789853 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:21:21.789853 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:21:21.789853 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:21:21.789853 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:21:21.789853 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:21:21.789853 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:21:21.789853 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:21:21.789853 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:21:21.789853 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3075a998-589a-474c-ac0a-3c53f63ab574 could not be found. Jul 23 21:21:21.789853 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:21:21.795285 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-4e4fbc08-2a9f-47fe-a909-42c05cb06d08 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Returning 404 to user: Instance 3075a998-589a-474c-ac0a-3c53f63ab574 could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:21:21.796390 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-4e4fbc08-2a9f-47fe-a909-42c05cb06d08 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] 10.222.0.17 "GET /compute/v2.1/servers/3075a998-589a-474c-ac0a-3c53f63ab574" status: 404 len: 111 microversion: 2.1 time: 0.095155 Jul 23 21:21:21.797132 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 953/1902] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:21:21 2022] GET /compute/v2.1/servers/3075a998-589a-474c-ac0a-3c53f63ab574 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:21:21.803691 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-077e56f4-fd79-4fb1-9f22-28bef92ec7ed tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:21.804528 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-077e56f4-fd79-4fb1-9f22-28bef92ec7ed tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] [instance: 9933c901-3692-4f36-9f11-e1a93d902e94] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:21:21.813388 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-077e56f4-fd79-4fb1-9f22-28bef92ec7ed tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:21.814115 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-077e56f4-fd79-4fb1-9f22-28bef92ec7ed tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:21.815057 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-077e56f4-fd79-4fb1-9f22-28bef92ec7ed tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:21.815658 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-077e56f4-fd79-4fb1-9f22-28bef92ec7ed tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:22.182347 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-077e56f4-fd79-4fb1-9f22-28bef92ec7ed tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80673ab800441b4bd1f5858e1df7b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629d02efac724fa29fcfff53e370b69b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:21:22.191980 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-077e56f4-fd79-4fb1-9f22-28bef92ec7ed tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/servers/9933c901-3692-4f36-9f11-e1a93d902e94" status: 200 len: 1466 microversion: 2.1 time: 0.393636 Jul 23 21:21:22.193218 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 954/1903] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:21:21 2022] GET /compute/v2.1/servers/9933c901-3692-4f36-9f11-e1a93d902e94 => generated 1466 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:21:22.198181 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-73a88891-7437-44c4-8bdd-d7edab86a860 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:22.199682 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-73a88891-7437-44c4-8bdd-d7edab86a860 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] [instance: 6435faed-ac55-4f93-ac79-2668c6538209] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:21:22.212481 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-73a88891-7437-44c4-8bdd-d7edab86a860 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:22.213059 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-73a88891-7437-44c4-8bdd-d7edab86a860 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:22.213960 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-73a88891-7437-44c4-8bdd-d7edab86a860 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:22.214492 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-73a88891-7437-44c4-8bdd-d7edab86a860 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:22.544292 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-73a88891-7437-44c4-8bdd-d7edab86a860 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf93a4b80cb4e19a36473986950fc75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c1943188684b45b636541caf587247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:21:22.566626 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-73a88891-7437-44c4-8bdd-d7edab86a860 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] 10.222.0.17 "GET /compute/v2.1/servers/6435faed-ac55-4f93-ac79-2668c6538209" status: 200 len: 1312 microversion: 2.1 time: 0.372044 Jul 23 21:21:22.568159 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 955/1904] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:21:22 2022] GET /compute/v2.1/servers/6435faed-ac55-4f93-ac79-2668c6538209 => generated 1312 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:21:22.575299 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-0b5718e7-3abd-4d72-8a5c-f83822bcc93e req-c925d738-cff7-4bac-a00a-4644273c9c25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6435faed-ac55-4f93-ac79-2668c6538209", "tag": "8060587e-b8d0-4cf9-a507-563dad5e39bf"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:21:22.588490 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-0b5718e7-3abd-4d72-8a5c-f83822bcc93e req-c925d738-cff7-4bac-a00a-4644273c9c25 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:22.603760 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-0b5718e7-3abd-4d72-8a5c-f83822bcc93e req-c925d738-cff7-4bac-a00a-4644273c9c25 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:22.622733 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-0b5718e7-3abd-4d72-8a5c-f83822bcc93e req-c925d738-cff7-4bac-a00a-4644273c9c25 service nova] Creating event network-changed:8060587e-b8d0-4cf9-a507-563dad5e39bf for instance 6435faed-ac55-4f93-ac79-2668c6538209 on nch2-master-1 Jul 23 21:21:22.663789 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-0b5718e7-3abd-4d72-8a5c-f83822bcc93e req-c925d738-cff7-4bac-a00a-4644273c9c25 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089430 Jul 23 21:21:22.665594 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 956/1905] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:21:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:21:22.680932 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-86fe3a2c-5251-4c2d-84d2-b04581db1a49 tempest-SecurityGroupRulesNegativeTestJSON-879928424 tempest-SecurityGroupRulesNegativeTestJSON-879928424-project] Calling method '.version_select at 0x7f0b47651310>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:23.293933 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-86fe3a2c-5251-4c2d-84d2-b04581db1a49 tempest-SecurityGroupRulesNegativeTestJSON-879928424 tempest-SecurityGroupRulesNegativeTestJSON-879928424-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/b9073519-1daf-40ec-8d45-edfdf7263b2d" status: 202 len: 0 microversion: 2.1 time: 0.624578 Jul 23 21:21:23.298129 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 957/1906] 10.222.0.17 () {58 vars in 1271 bytes} [Sat Jul 23 21:21:22 2022] DELETE /compute/v2.1/os-security-groups/b9073519-1daf-40ec-8d45-edfdf7263b2d => generated 0 bytes in 632 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:21:23.302971 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f023adda-6591-450d-9c50-49da6554fe41 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Calling method '.version_select at 0x7f0b5991e0d0>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:25.439641 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c602e40e-d1fc-40fb-ac35-3d6e57a3d1ca tempest-SecurityGroupsTestAdminJSON-1109381468 tempest-SecurityGroupsTestAdminJSON-1109381468-project-admin] 10.222.0.17 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 12001 microversion: 2.1 time: 6.451126 Jul 23 21:21:25.440888 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 950/1907] 10.222.0.17 () {58 vars in 1190 bytes} [Sat Jul 23 21:21:18 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 12001 bytes in 6453 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 23 21:21:25.447750 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-dc3d464e-0cae-4806-bd45-0aabc29cb39c tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-18948159"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:21:25.451286 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-dc3d464e-0cae-4806-bd45-0aabc29cb39c tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] [instance: c1701f99-a44c-48ca-8946-b84c5e163cee] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:21:25.465550 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dc3d464e-0cae-4806-bd45-0aabc29cb39c tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:25.466029 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dc3d464e-0cae-4806-bd45-0aabc29cb39c tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:25.466828 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dc3d464e-0cae-4806-bd45-0aabc29cb39c tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:25.467478 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dc3d464e-0cae-4806-bd45-0aabc29cb39c tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:26.221512 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-f023adda-6591-450d-9c50-49da6554fe41 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] 10.222.0.17 "DELETE /compute/v2.1/os-floating-ips/cffb12f8-900f-47de-bac7-73f5eb9725b6" status: 202 len: 0 microversion: 2.1 time: 2.922228 Jul 23 21:21:26.224799 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 958/1908] 10.222.0.17 () {58 vars in 1262 bytes} [Sat Jul 23 21:21:23 2022] DELETE /compute/v2.1/os-floating-ips/cffb12f8-900f-47de-bac7-73f5eb9725b6 => generated 0 bytes in 2926 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:21:26.250773 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-8e9ac945-61c7-43d0-8fee-dc79c8c76b51 tempest-SecurityGroupRulesNegativeTestJSON-879928424 tempest-SecurityGroupRulesNegativeTestJSON-879928424-project] Calling method '.version_select at 0x7f0b599ba1f0>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:26.251035 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-dc3d464e-0cae-4806-bd45-0aabc29cb39c tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "POST /compute/v2.1/servers/c1701f99-a44c-48ca-8946-b84c5e163cee/action" status: 202 len: 0 microversion: 2.1 time: 0.796362 Jul 23 21:21:26.252999 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 951/1909] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:21:25 2022] POST /compute/v2.1/servers/c1701f99-a44c-48ca-8946-b84c5e163cee/action => generated 0 bytes in 811 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 23 21:21:26.270806 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-23c671ea-c6ed-4c30-9b2b-0522356aa2ab tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:26.272416 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-23c671ea-c6ed-4c30-9b2b-0522356aa2ab tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] [instance: 6435faed-ac55-4f93-ac79-2668c6538209] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:21:26.292603 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-23c671ea-c6ed-4c30-9b2b-0522356aa2ab tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:26.293076 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-23c671ea-c6ed-4c30-9b2b-0522356aa2ab tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:26.293986 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-23c671ea-c6ed-4c30-9b2b-0522356aa2ab tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:26.297481 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-23c671ea-c6ed-4c30-9b2b-0522356aa2ab tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:26.634281 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-23c671ea-c6ed-4c30-9b2b-0522356aa2ab tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf93a4b80cb4e19a36473986950fc75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c1943188684b45b636541caf587247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:21:26.645708 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-23c671ea-c6ed-4c30-9b2b-0522356aa2ab tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] 10.222.0.17 "GET /compute/v2.1/servers/6435faed-ac55-4f93-ac79-2668c6538209" status: 200 len: 1312 microversion: 2.1 time: 0.389499 Jul 23 21:21:26.648904 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 952/1910] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:21:26 2022] GET /compute/v2.1/servers/6435faed-ac55-4f93-ac79-2668c6538209 => generated 1312 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:21:26.661312 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-22fc7f6f-22af-4484-900c-bf98ffa4f7e7 req-cfc44981-b053-4865-b40a-c6a980fa885c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9933c901-3692-4f36-9f11-e1a93d902e94", "name": "network-vif-unplugged", "status": "completed", "tag": "710f608f-25bd-47cb-9727-946c3bac499f"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:21:26.686623 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-22fc7f6f-22af-4484-900c-bf98ffa4f7e7 req-cfc44981-b053-4865-b40a-c6a980fa885c service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:26.687423 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-22fc7f6f-22af-4484-900c-bf98ffa4f7e7 req-cfc44981-b053-4865-b40a-c6a980fa885c service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:26.708859 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-22fc7f6f-22af-4484-900c-bf98ffa4f7e7 req-cfc44981-b053-4865-b40a-c6a980fa885c service nova] Creating event network-vif-unplugged:710f608f-25bd-47cb-9727-946c3bac499f for instance 9933c901-3692-4f36-9f11-e1a93d902e94 on nch1-master-1 Jul 23 21:21:26.721282 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-22fc7f6f-22af-4484-900c-bf98ffa4f7e7 req-cfc44981-b053-4865-b40a-c6a980fa885c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066437 Jul 23 21:21:26.724162 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 953/1911] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:21:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:21:26.738645 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6ca78332-a377-4e17-a74d-51decf02039d tempest-SecurityGroupsTestAdminJSON-611736374 tempest-SecurityGroupsTestAdminJSON-611736374-project] Calling method '.version_select at 0x7f0b59910dc0>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:26.919305 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-8e9ac945-61c7-43d0-8fee-dc79c8c76b51 tempest-SecurityGroupRulesNegativeTestJSON-879928424 tempest-SecurityGroupRulesNegativeTestJSON-879928424-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/7f62fc71-4b74-4a0d-8152-6a891869cc8c" status: 202 len: 0 microversion: 2.1 time: 0.692961 Jul 23 21:21:26.920045 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 959/1912] 10.222.0.17 () {58 vars in 1271 bytes} [Sat Jul 23 21:21:26 2022] DELETE /compute/v2.1/os-security-groups/7f62fc71-4b74-4a0d-8152-6a891869cc8c => generated 0 bytes in 694 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:21:26.954849 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-dfff3cbc-83f9-4b36-a00e-f8bdd9b561a0 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:26.956030 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-dfff3cbc-83f9-4b36-a00e-f8bdd9b561a0 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] [instance: 059bbe3e-cf86-4689-a696-0161d7d27dfd] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:21:26.976869 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:21:26.991601 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-dfff3cbc-83f9-4b36-a00e-f8bdd9b561a0 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:26.992524 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-dfff3cbc-83f9-4b36-a00e-f8bdd9b561a0 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:26.994048 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-dfff3cbc-83f9-4b36-a00e-f8bdd9b561a0 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:26.994670 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-dfff3cbc-83f9-4b36-a00e-f8bdd9b561a0 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:27.065450 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-dfff3cbc-83f9-4b36-a00e-f8bdd9b561a0 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] [instance: 059bbe3e-cf86-4689-a696-0161d7d27dfd] Going to try to terminate instance {{(pid=131321) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:21:27.207347 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-dfff3cbc-83f9-4b36-a00e-f8bdd9b561a0 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] 10.222.0.17 "DELETE /compute/v2.1/servers/059bbe3e-cf86-4689-a696-0161d7d27dfd" status: 204 len: 0 microversion: 2.1 time: 0.268279 Jul 23 21:21:27.208526 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 960/1913] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:21:26 2022] DELETE /compute/v2.1/servers/059bbe3e-cf86-4689-a696-0161d7d27dfd => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:21:27.216209 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f5fe2de0-c767-4f24-9c93-68056013342e tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '.version_select at 0x7f0b598b0d30>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:27.285112 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-f5fe2de0-c767-4f24-9c93-68056013342e tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/images/ee136f2b-cfa9-44cf-899c-7795cf98e798" status: 200 len: 1453 microversion: 2.1 time: 0.074766 Jul 23 21:21:27.286322 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 961/1914] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:21:27 2022] GET /compute/v2.1/images/ee136f2b-cfa9-44cf-899c-7795cf98e798 => generated 1453 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:21:27.301700 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-5aa1379f-07b2-4d4a-9fc1-13f22637f8cd tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:27.302712 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-5aa1379f-07b2-4d4a-9fc1-13f22637f8cd tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] [instance: 059bbe3e-cf86-4689-a696-0161d7d27dfd] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:21:27.318828 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5aa1379f-07b2-4d4a-9fc1-13f22637f8cd tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:27.319523 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5aa1379f-07b2-4d4a-9fc1-13f22637f8cd tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:27.320568 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5aa1379f-07b2-4d4a-9fc1-13f22637f8cd tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:27.321118 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5aa1379f-07b2-4d4a-9fc1-13f22637f8cd tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:27.340722 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=3,nova_cell1:RELEASE=2 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:21:27.352615 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6ca78332-a377-4e17-a74d-51decf02039d tempest-SecurityGroupsTestAdminJSON-611736374 tempest-SecurityGroupsTestAdminJSON-611736374-project] 10.222.0.17 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1111 microversion: 2.1 time: 0.625987 Jul 23 21:21:27.353518 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 954/1915] 10.222.0.17 () {58 vars in 1190 bytes} [Sat Jul 23 21:21:26 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1111 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:21:27.370822 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-66aac8d7-7ae7-494a-9779-1c0ce7dc0560 tempest-SecurityGroupsTestAdminJSON-1109381468 tempest-SecurityGroupsTestAdminJSON-1109381468-project-admin] Calling method '.version_select at 0x7f0b5990fb80>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:27.625136 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-5aa1379f-07b2-4d4a-9fc1-13f22637f8cd tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '194f98e3c86b48e9952fe02d3648beb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e165633a87b04bd9bc3f6e575f53fb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:21:27.641594 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-5aa1379f-07b2-4d4a-9fc1-13f22637f8cd tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] 10.222.0.17 "GET /compute/v2.1/servers/059bbe3e-cf86-4689-a696-0161d7d27dfd" status: 200 len: 1526 microversion: 2.1 time: 0.349938 Jul 23 21:21:27.644976 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 962/1916] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:21:27 2022] GET /compute/v2.1/servers/059bbe3e-cf86-4689-a696-0161d7d27dfd => generated 1526 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:21:27.683582 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-170e3cda-b145-4caf-b0f2-58210b5ae4ca tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:27.684686 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-170e3cda-b145-4caf-b0f2-58210b5ae4ca tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] [instance: 6435faed-ac55-4f93-ac79-2668c6538209] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:21:27.692061 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-170e3cda-b145-4caf-b0f2-58210b5ae4ca tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:27.693747 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-170e3cda-b145-4caf-b0f2-58210b5ae4ca tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:27.694926 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-170e3cda-b145-4caf-b0f2-58210b5ae4ca tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:27.695559 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-170e3cda-b145-4caf-b0f2-58210b5ae4ca tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:27.816093 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-66aac8d7-7ae7-494a-9779-1c0ce7dc0560 tempest-SecurityGroupsTestAdminJSON-1109381468 tempest-SecurityGroupsTestAdminJSON-1109381468-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/d64e2e2a-eec4-4020-bab0-ec5d4eed654a" status: 202 len: 0 microversion: 2.1 time: 0.449502 Jul 23 21:21:27.817020 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 955/1917] 10.222.0.17 () {58 vars in 1271 bytes} [Sat Jul 23 21:21:27 2022] DELETE /compute/v2.1/os-security-groups/d64e2e2a-eec4-4020-bab0-ec5d4eed654a => generated 0 bytes in 456 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:21:27.828181 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6a5a59d0-c9d9-47a1-9141-3839e08e791e tempest-SecurityGroupsTestAdminJSON-1109381468 tempest-SecurityGroupsTestAdminJSON-1109381468-project-admin] Calling method '.version_select at 0x7f0b59979550>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:28.285375 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6a5a59d0-c9d9-47a1-9141-3839e08e791e tempest-SecurityGroupsTestAdminJSON-1109381468 tempest-SecurityGroupsTestAdminJSON-1109381468-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/2182bcf1-40b4-4bd7-b9e9-840c0e5bbadc" status: 202 len: 0 microversion: 2.1 time: 0.463173 Jul 23 21:21:28.286286 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 956/1918] 10.222.0.17 () {58 vars in 1271 bytes} [Sat Jul 23 21:21:27 2022] DELETE /compute/v2.1/os-security-groups/2182bcf1-40b4-4bd7-b9e9-840c0e5bbadc => generated 0 bytes in 465 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:21:28.294556 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-80f6a717-3a7b-40cd-9a27-fc4e1ad85ee2 tempest-SecurityGroupsTestAdminJSON-611736374 tempest-SecurityGroupsTestAdminJSON-611736374-project] Calling method '.version_select at 0x7f0b599cfb80>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:28.379173 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-170e3cda-b145-4caf-b0f2-58210b5ae4ca tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf93a4b80cb4e19a36473986950fc75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c1943188684b45b636541caf587247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:21:28.403811 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-170e3cda-b145-4caf-b0f2-58210b5ae4ca tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] 10.222.0.17 "GET /compute/v2.1/servers/6435faed-ac55-4f93-ac79-2668c6538209" status: 200 len: 1312 microversion: 2.1 time: 0.722301 Jul 23 21:21:28.408382 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 963/1919] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:21:27 2022] GET /compute/v2.1/servers/6435faed-ac55-4f93-ac79-2668c6538209 => generated 1312 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:21:28.422176 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-5033cf67-593e-4c0b-8396-9d0cf29588dd tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '.version_select at 0x7f0b59979940>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:28.489504 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-5033cf67-593e-4c0b-8396-9d0cf29588dd tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/images/ee136f2b-cfa9-44cf-899c-7795cf98e798" status: 200 len: 1453 microversion: 2.1 time: 0.079502 Jul 23 21:21:28.497045 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 964/1920] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:21:28 2022] GET /compute/v2.1/images/ee136f2b-cfa9-44cf-899c-7795cf98e798 => generated 1453 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:21:28.672916 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c750911e-946d-476b-8081-a971c8909941 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:28.673539 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-c750911e-946d-476b-8081-a971c8909941 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] [instance: 059bbe3e-cf86-4689-a696-0161d7d27dfd] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:21:28.693596 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c750911e-946d-476b-8081-a971c8909941 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:28.694426 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c750911e-946d-476b-8081-a971c8909941 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:28.695540 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c750911e-946d-476b-8081-a971c8909941 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:28.696350 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c750911e-946d-476b-8081-a971c8909941 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:28.775138 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-80f6a717-3a7b-40cd-9a27-fc4e1ad85ee2 tempest-SecurityGroupsTestAdminJSON-611736374 tempest-SecurityGroupsTestAdminJSON-611736374-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/23acafd7-1b31-4576-875a-3b0be97306e4" status: 202 len: 0 microversion: 2.1 time: 0.484332 Jul 23 21:21:28.776647 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 957/1921] 10.222.0.17 () {58 vars in 1271 bytes} [Sat Jul 23 21:21:28 2022] DELETE /compute/v2.1/os-security-groups/23acafd7-1b31-4576-875a-3b0be97306e4 => generated 0 bytes in 487 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 23 21:21:28.960127 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c750911e-946d-476b-8081-a971c8909941 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '194f98e3c86b48e9952fe02d3648beb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e165633a87b04bd9bc3f6e575f53fb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:21:28.974846 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-c750911e-946d-476b-8081-a971c8909941 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] 10.222.0.17 "GET /compute/v2.1/servers/059bbe3e-cf86-4689-a696-0161d7d27dfd" status: 200 len: 1526 microversion: 2.1 time: 0.310596 Jul 23 21:21:28.988449 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 965/1922] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:21:28 2022] GET /compute/v2.1/servers/059bbe3e-cf86-4689-a696-0161d7d27dfd => generated 1526 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:21:28.993343 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5bb6c56a-4f4e-4b10-af53-dcd58909b5bb tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-1923551456", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "networks": [{"uuid": "9aac9607-dc4a-4309-87fe-407e0e39a44b"}]}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:21:29.004439 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-478d34b6-ec27-48f9-91f8-453bfc959adb tempest-SecurityGroupsTestAdminJSON-611736374 tempest-SecurityGroupsTestAdminJSON-611736374-project] Calling method '.version_select at 0x7f0b59ac21f0>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:29.088515 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-5bb6c56a-4f4e-4b10-af53-dcd58909b5bb tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] validate_networks() for [('9aac9607-dc4a-4309-87fe-407e0e39a44b', None, None, None, None, None)] {{(pid=131320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:21:29.496985 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-478d34b6-ec27-48f9-91f8-453bfc959adb tempest-SecurityGroupsTestAdminJSON-611736374 tempest-SecurityGroupsTestAdminJSON-611736374-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/12dbf90a-8aa4-4086-bf3c-aaaea9e86f7a" status: 202 len: 0 microversion: 2.1 time: 0.505237 Jul 23 21:21:29.497951 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 966/1923] 10.222.0.17 () {58 vars in 1271 bytes} [Sat Jul 23 21:21:28 2022] DELETE /compute/v2.1/os-security-groups/12dbf90a-8aa4-4086-bf3c-aaaea9e86f7a => generated 0 bytes in 509 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:21:29.503921 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-86d35777-2870-403c-8aba-7daade87d697 req-8f01dc3c-8b08-4dab-8b3f-944eb3dfc8c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6435faed-ac55-4f93-ac79-2668c6538209", "name": "network-vif-plugged", "status": "completed", "tag": "8060587e-b8d0-4cf9-a507-563dad5e39bf"}, {"server_uuid": "cef13563-7f83-4281-a26c-d5e420c41daf", "name": "network-vif-plugged", "status": "completed", "tag": "e6c3948e-9005-4405-9ade-a304ad56f44a"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:21:29.524705 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-86d35777-2870-403c-8aba-7daade87d697 req-8f01dc3c-8b08-4dab-8b3f-944eb3dfc8c0 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:29.526386 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-86d35777-2870-403c-8aba-7daade87d697 req-8f01dc3c-8b08-4dab-8b3f-944eb3dfc8c0 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:29.564786 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-86d35777-2870-403c-8aba-7daade87d697 req-8f01dc3c-8b08-4dab-8b3f-944eb3dfc8c0 service nova] Creating event network-vif-plugged:8060587e-b8d0-4cf9-a507-563dad5e39bf for instance 6435faed-ac55-4f93-ac79-2668c6538209 on nch2-master-1 Jul 23 21:21:29.565516 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-86d35777-2870-403c-8aba-7daade87d697 req-8f01dc3c-8b08-4dab-8b3f-944eb3dfc8c0 service nova] Creating event network-vif-plugged:e6c3948e-9005-4405-9ade-a304ad56f44a for instance cef13563-7f83-4281-a26c-d5e420c41daf on nch1-master-1 Jul 23 21:21:29.589004 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-86d35777-2870-403c-8aba-7daade87d697 req-8f01dc3c-8b08-4dab-8b3f-944eb3dfc8c0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.084361 Jul 23 21:21:29.589943 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 967/1924] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:21:29 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:21:29.617943 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-5525f96a-3748-4799-b506-c14cd1ab36f4 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:29.626009 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-5525f96a-3748-4799-b506-c14cd1ab36f4 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] [instance: 6435faed-ac55-4f93-ac79-2668c6538209] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:21:29.643122 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5525f96a-3748-4799-b506-c14cd1ab36f4 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:29.643587 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5525f96a-3748-4799-b506-c14cd1ab36f4 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:29.648014 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5525f96a-3748-4799-b506-c14cd1ab36f4 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:29.648480 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5525f96a-3748-4799-b506-c14cd1ab36f4 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:30.154425 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-5525f96a-3748-4799-b506-c14cd1ab36f4 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf93a4b80cb4e19a36473986950fc75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c1943188684b45b636541caf587247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:21:30.163005 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-5525f96a-3748-4799-b506-c14cd1ab36f4 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] 10.222.0.17 "GET /compute/v2.1/servers/6435faed-ac55-4f93-ac79-2668c6538209" status: 200 len: 1312 microversion: 2.1 time: 0.570714 Jul 23 21:21:30.175215 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 968/1925] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:21:29 2022] GET /compute/v2.1/servers/6435faed-ac55-4f93-ac79-2668c6538209 => generated 1312 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:21:30.180700 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-bdbcb988-f445-4426-9ec4-4c8df6a694be tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '.version_select at 0x7f0b599e64c0>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:30.264715 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-bdbcb988-f445-4426-9ec4-4c8df6a694be tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/images/ee136f2b-cfa9-44cf-899c-7795cf98e798" status: 200 len: 1453 microversion: 2.1 time: 0.087802 Jul 23 21:21:30.265892 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 969/1926] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:21:30 2022] GET /compute/v2.1/images/ee136f2b-cfa9-44cf-899c-7795cf98e798 => generated 1453 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:21:30.283168 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-68850555-2150-4815-b039-16c432de8622 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:30.283523 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-68850555-2150-4815-b039-16c432de8622 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] [instance: 059bbe3e-cf86-4689-a696-0161d7d27dfd] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:21:30.302885 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-68850555-2150-4815-b039-16c432de8622 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:30.303892 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-68850555-2150-4815-b039-16c432de8622 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:30.304702 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-68850555-2150-4815-b039-16c432de8622 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:30.305251 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-68850555-2150-4815-b039-16c432de8622 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:30.669235 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-68850555-2150-4815-b039-16c432de8622 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '194f98e3c86b48e9952fe02d3648beb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e165633a87b04bd9bc3f6e575f53fb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:21:30.683973 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-68850555-2150-4815-b039-16c432de8622 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] 10.222.0.17 "GET /compute/v2.1/servers/059bbe3e-cf86-4689-a696-0161d7d27dfd" status: 200 len: 1526 microversion: 2.1 time: 0.417001 Jul 23 21:21:30.685936 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 970/1927] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:21:30 2022] GET /compute/v2.1/servers/059bbe3e-cf86-4689-a696-0161d7d27dfd => generated 1526 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:21:31.032444 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-5c8de339-9e64-4b14-a984-a4cbc9406d23 req-69727dff-8a08-44e1-a675-5ff2a8d8dee3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "059bbe3e-cf86-4689-a696-0161d7d27dfd", "name": "network-vif-deleted", "tag": "53a52999-801e-42e8-afb4-ed6908a0b011"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:21:31.049941 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-5c8de339-9e64-4b14-a984-a4cbc9406d23 req-69727dff-8a08-44e1-a675-5ff2a8d8dee3 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:31.050492 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-5c8de339-9e64-4b14-a984-a4cbc9406d23 req-69727dff-8a08-44e1-a675-5ff2a8d8dee3 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:31.051127 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-5bb6c56a-4f4e-4b10-af53-dcd58909b5bb tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:21:31.051614 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-5bb6c56a-4f4e-4b10-af53-dcd58909b5bb tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:21:31.052029 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-5bb6c56a-4f4e-4b10-af53-dcd58909b5bb tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:21:31.052440 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-5bb6c56a-4f4e-4b10-af53-dcd58909b5bb tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:21:31.053043 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-5bb6c56a-4f4e-4b10-af53-dcd58909b5bb tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:21:31.080901 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-5c8de339-9e64-4b14-a984-a4cbc9406d23 req-69727dff-8a08-44e1-a675-5ff2a8d8dee3 service nova] Creating event network-vif-deleted:53a52999-801e-42e8-afb4-ed6908a0b011 for instance 059bbe3e-cf86-4689-a696-0161d7d27dfd on nch1-master-1 Jul 23 21:21:31.092487 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-5c8de339-9e64-4b14-a984-a4cbc9406d23 req-69727dff-8a08-44e1-a675-5ff2a8d8dee3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062206 Jul 23 21:21:31.093154 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 971/1928] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:21:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:21:31.095070 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5bb6c56a-4f4e-4b10-af53-dcd58909b5bb tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:31.096500 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5bb6c56a-4f4e-4b10-af53-dcd58909b5bb tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:31.102179 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5bb6c56a-4f4e-4b10-af53-dcd58909b5bb tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:31.105662 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5bb6c56a-4f4e-4b10-af53-dcd58909b5bb tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:31.173704 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-5bb6c56a-4f4e-4b10-af53-dcd58909b5bb tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Getting quotas for project 3d87ea887fea457fb07731d47de68333. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:21:31.183430 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-5e7a6ba4-20f1-4362-afc7-1b052358903b tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:31.184146 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-5e7a6ba4-20f1-4362-afc7-1b052358903b tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] [instance: 6435faed-ac55-4f93-ac79-2668c6538209] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:21:31.195557 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-5bb6c56a-4f4e-4b10-af53-dcd58909b5bb tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Getting quotas for user 672d90d732a0419ca669e0055359dcfd and project 3d87ea887fea457fb07731d47de68333. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:21:31.208122 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5e7a6ba4-20f1-4362-afc7-1b052358903b tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:31.208677 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5e7a6ba4-20f1-4362-afc7-1b052358903b tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:31.210886 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5e7a6ba4-20f1-4362-afc7-1b052358903b tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:31.211596 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5e7a6ba4-20f1-4362-afc7-1b052358903b tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:31.253571 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5bb6c56a-4f4e-4b10-af53-dcd58909b5bb tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Going to run 1 instances... {{(pid=131320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:21:31.255909 ncdv-master-1 devstack@n-api.service[131320]: WARNING nova.utils [None req-5bb6c56a-4f4e-4b10-af53-dcd58909b5bb tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-1923551456 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-192355145 Jul 23 21:21:31.256747 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5bb6c56a-4f4e-4b10-af53-dcd58909b5bb tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] [instance: 2cebd0e1-09ca-4eab-bda7-0743043bad23] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:21:31.515739 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5bb6c56a-4f4e-4b10-af53-dcd58909b5bb tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.726184 Jul 23 21:21:31.526217 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 958/1929] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:21:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 2749 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 23 21:21:31.550885 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-134def49-b5dd-47ef-b257-a9a8309a9790 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '.version_select at 0x7f0b59910e50>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:31.646409 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-134def49-b5dd-47ef-b257-a9a8309a9790 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/images/ee136f2b-cfa9-44cf-899c-7795cf98e798" status: 200 len: 1453 microversion: 2.1 time: 0.116515 Jul 23 21:21:31.654337 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 959/1930] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:21:31 2022] GET /compute/v2.1/images/ee136f2b-cfa9-44cf-899c-7795cf98e798 => generated 1453 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:21:31.665736 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0037053a-79c4-4709-912c-d56b993cec7b tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:31.680728 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-0037053a-79c4-4709-912c-d56b993cec7b tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] [instance: 2cebd0e1-09ca-4eab-bda7-0743043bad23] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:21:31.860214 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-5e7a6ba4-20f1-4362-afc7-1b052358903b tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf93a4b80cb4e19a36473986950fc75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c1943188684b45b636541caf587247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:21:31.881346 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-5e7a6ba4-20f1-4362-afc7-1b052358903b tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] 10.222.0.17 "GET /compute/v2.1/servers/6435faed-ac55-4f93-ac79-2668c6538209" status: 200 len: 1312 microversion: 2.1 time: 0.699198 Jul 23 21:21:31.883917 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 972/1931] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:21:31 2022] GET /compute/v2.1/servers/6435faed-ac55-4f93-ac79-2668c6538209 => generated 1312 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:21:31.909967 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-866f3142-969c-40ad-9e1c-12e5765ebb96 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:31.912501 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-866f3142-969c-40ad-9e1c-12e5765ebb96 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] [instance: 059bbe3e-cf86-4689-a696-0161d7d27dfd] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:21:31.939459 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-866f3142-969c-40ad-9e1c-12e5765ebb96 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:31.940219 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-866f3142-969c-40ad-9e1c-12e5765ebb96 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:31.943124 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-866f3142-969c-40ad-9e1c-12e5765ebb96 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:31.944349 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-866f3142-969c-40ad-9e1c-12e5765ebb96 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:31.999324 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-866f3142-969c-40ad-9e1c-12e5765ebb96 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:32.000055 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-866f3142-969c-40ad-9e1c-12e5765ebb96 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:32.000678 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.objects.instance [None req-866f3142-969c-40ad-9e1c-12e5765ebb96 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lazy-loading 'fault' on Instance uuid 059bbe3e-cf86-4689-a696-0161d7d27dfd {{(pid=131321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:21:32.059001 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-0037053a-79c4-4709-912c-d56b993cec7b tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '672d90d732a0419ca669e0055359dcfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d87ea887fea457fb07731d47de68333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:21:32.066645 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-0037053a-79c4-4709-912c-d56b993cec7b tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] 10.222.0.17 "GET /compute/v2.1/servers/2cebd0e1-09ca-4eab-bda7-0743043bad23" status: 200 len: 1232 microversion: 2.1 time: 0.410450 Jul 23 21:21:32.079649 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 960/1932] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:21:31 2022] GET /compute/v2.1/servers/2cebd0e1-09ca-4eab-bda7-0743043bad23 => generated 1232 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:21:32.168625 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-866f3142-969c-40ad-9e1c-12e5765ebb96 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '194f98e3c86b48e9952fe02d3648beb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e165633a87b04bd9bc3f6e575f53fb12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:21:32.184499 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-866f3142-969c-40ad-9e1c-12e5765ebb96 tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] 10.222.0.17 "GET /compute/v2.1/servers/059bbe3e-cf86-4689-a696-0161d7d27dfd" status: 200 len: 1314 microversion: 2.1 time: 0.294381 Jul 23 21:21:32.186563 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 973/1933] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:21:31 2022] GET /compute/v2.1/servers/059bbe3e-cf86-4689-a696-0161d7d27dfd => generated 1314 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:21:32.327602 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-c5465f9e-ea3a-46d2-967a-b196f2910566 req-33498fd0-a5c4-48a3-bfd0-4cea5e3f5b14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1701f99-a44c-48ca-8946-b84c5e163cee", "name": "network-vif-plugged", "status": "completed", "tag": "ca008065-59c8-45bf-a4e5-409a38a7c991"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:21:32.344922 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-c5465f9e-ea3a-46d2-967a-b196f2910566 req-33498fd0-a5c4-48a3-bfd0-4cea5e3f5b14 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:32.355620 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-c5465f9e-ea3a-46d2-967a-b196f2910566 req-33498fd0-a5c4-48a3-bfd0-4cea5e3f5b14 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:32.381280 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-c5465f9e-ea3a-46d2-967a-b196f2910566 req-33498fd0-a5c4-48a3-bfd0-4cea5e3f5b14 service nova] Creating event network-vif-plugged:ca008065-59c8-45bf-a4e5-409a38a7c991 for instance c1701f99-a44c-48ca-8946-b84c5e163cee on nch1-master-1 Jul 23 21:21:32.404003 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-c5465f9e-ea3a-46d2-967a-b196f2910566 req-33498fd0-a5c4-48a3-bfd0-4cea5e3f5b14 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084133 Jul 23 21:21:32.405408 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 961/1934] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:21:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:21:32.663056 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-3415d807-d33b-4d46-9c7e-9ff3eab3a4ab tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '.version_select at 0x7f0b5992a430>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:32.751463 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-3415d807-d33b-4d46-9c7e-9ff3eab3a4ab tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/images/ee136f2b-cfa9-44cf-899c-7795cf98e798" status: 200 len: 1453 microversion: 2.1 time: 0.094871 Jul 23 21:21:32.753534 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 974/1935] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:21:32 2022] GET /compute/v2.1/images/ee136f2b-cfa9-44cf-899c-7795cf98e798 => generated 1453 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:21:32.901144 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4cd39571-470a-4b62-ab8a-cb3debdc8bfd tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:32.902086 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-4cd39571-470a-4b62-ab8a-cb3debdc8bfd tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] [instance: 6435faed-ac55-4f93-ac79-2668c6538209] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:21:32.940641 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4cd39571-470a-4b62-ab8a-cb3debdc8bfd tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:32.942558 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4cd39571-470a-4b62-ab8a-cb3debdc8bfd tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:32.947844 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4cd39571-470a-4b62-ab8a-cb3debdc8bfd tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:32.948487 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4cd39571-470a-4b62-ab8a-cb3debdc8bfd tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:33.088140 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-53f91010-1aef-4f79-a711-f0cbf2927303 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:33.088758 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-53f91010-1aef-4f79-a711-f0cbf2927303 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] [instance: 2cebd0e1-09ca-4eab-bda7-0743043bad23] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:21:33.104040 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-53f91010-1aef-4f79-a711-f0cbf2927303 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:33.104506 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-53f91010-1aef-4f79-a711-f0cbf2927303 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:33.107938 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-53f91010-1aef-4f79-a711-f0cbf2927303 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:33.109254 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-53f91010-1aef-4f79-a711-f0cbf2927303 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:33.318394 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-53f91010-1aef-4f79-a711-f0cbf2927303 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '672d90d732a0419ca669e0055359dcfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d87ea887fea457fb07731d47de68333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:21:33.332043 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-53f91010-1aef-4f79-a711-f0cbf2927303 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] 10.222.0.17 "GET /compute/v2.1/servers/2cebd0e1-09ca-4eab-bda7-0743043bad23" status: 200 len: 1228 microversion: 2.1 time: 0.250449 Jul 23 21:21:33.332641 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 975/1936] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:21:33 2022] GET /compute/v2.1/servers/2cebd0e1-09ca-4eab-bda7-0743043bad23 => generated 1228 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:21:33.350012 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d02caaad-13ad-43b1-9d16-5bbb589e2f7d tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:33.351676 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-d02caaad-13ad-43b1-9d16-5bbb589e2f7d tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] [instance: 059bbe3e-cf86-4689-a696-0161d7d27dfd] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:21:33.387757 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d02caaad-13ad-43b1-9d16-5bbb589e2f7d tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:33.388203 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d02caaad-13ad-43b1-9d16-5bbb589e2f7d tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:33.392644 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d02caaad-13ad-43b1-9d16-5bbb589e2f7d tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:33.395106 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d02caaad-13ad-43b1-9d16-5bbb589e2f7d tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:33.447591 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-d02caaad-13ad-43b1-9d16-5bbb589e2f7d tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] HTTP exception thrown: Instance 059bbe3e-cf86-4689-a696-0161d7d27dfd could not be found. Jul 23 21:21:33.450455 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d02caaad-13ad-43b1-9d16-5bbb589e2f7d tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Request method failure captured: Jul 23 21:21:33.450455 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/servers/059bbe3e-cf86-4689-a696-0161d7d27dfd HTTP/1.1 Jul 23 21:21:33.450455 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:21:33.450455 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:21:33.450455 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:21:33.450455 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:21:33.450455 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:21:33.450455 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:21:33.450455 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:21:33.450455 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:21:33.450455 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GYCiCSvABggbkRGyW9tVBfmI6PMsNLVagiAjHSJJNKVuWZoEtduA9IL0lOHdtNx1Ght7MZZFPAHrevWH-4ksCxkiY7Aa9MUFIyCTTle61AJS3x1mKuGfuukBb9LGdOubsvWfe19GFqQP6x_U7hVN7id3QYMj3rofVRJAKlk8fD-LMM Jul 23 21:21:33.450455 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:21:33.450455 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:21:33.450455 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:21:33.450455 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:21:33.450455 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:21:33.450455 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:21:33.450455 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: e165633a87b04bd9bc3f6e575f53fb12 Jul 23 21:21:33.450455 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-268320235 Jul 23 21:21:33.450455 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:21:33.450455 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:21:33.453617 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e165633a87b04bd9bc3f6e575f53fb12"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e165633a87b04bd9bc3f6e575f53fb12"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e165633a87b04bd9bc3f6e575f53fb12", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e165633a87b04bd9bc3f6e575f53fb12"}]}] Jul 23 21:21:33.453617 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-268320235 Jul 23 21:21:33.453617 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: e165633a87b04bd9bc3f6e575f53fb12 Jul 23 21:21:33.453617 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-268320235 Jul 23 21:21:33.453617 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-FloatingIPsAssociationTestJSON-268320235-project Jul 23 21:21:33.453617 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:21:33.453617 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:21:33.453617 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 194f98e3c86b48e9952fe02d3648beb0 Jul 23 21:21:33.453617 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-268320235-project Jul 23 21:21:33.453617 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:21:33.453617 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance 059bbe3e-cf86-4689-a696-0161d7d27dfd could not be found. Jul 23 21:21:33.453617 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': '059bbe3e-cf86-4689-a696-0161d7d27dfd'} Jul 23 21:21:33.455999 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:21:33.455999 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:21:33.455999 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:21:33.455999 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:21:33.455999 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:21:33.455999 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:21:33.455999 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:21:33.455999 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:21:33.455999 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:21:33.455999 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:21:33.455999 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 059bbe3e-cf86-4689-a696-0161d7d27dfd could not be found. Jul 23 21:21:33.455999 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:21:33.455999 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:21:33.455999 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:21:33.455999 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:21:33.455999 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:21:33.455999 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:21:33.455999 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:21:33.455999 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:21:33.455999 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:21:33.457952 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:21:33.457952 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:21:33.457952 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:21:33.457952 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:21:33.457952 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:21:33.457952 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:21:33.457952 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:21:33.457952 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 059bbe3e-cf86-4689-a696-0161d7d27dfd could not be found. Jul 23 21:21:33.457952 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:21:33.457952 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:21:33.457952 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:21:33.457952 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:21:33.457952 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:21:33.457952 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:21:33.457952 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:21:33.457952 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:21:33.457952 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 059bbe3e-cf86-4689-a696-0161d7d27dfd could not be found. Jul 23 21:21:33.457952 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:21:33.461778 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d02caaad-13ad-43b1-9d16-5bbb589e2f7d tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] Returning 404 to user: Instance 059bbe3e-cf86-4689-a696-0161d7d27dfd could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:21:33.464829 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-d02caaad-13ad-43b1-9d16-5bbb589e2f7d tempest-FloatingIPsAssociationTestJSON-268320235 tempest-FloatingIPsAssociationTestJSON-268320235-project] 10.222.0.17 "GET /compute/v2.1/servers/059bbe3e-cf86-4689-a696-0161d7d27dfd" status: 404 len: 111 microversion: 2.1 time: 0.125351 Jul 23 21:21:33.466115 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 976/1937] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:21:33 2022] GET /compute/v2.1/servers/059bbe3e-cf86-4689-a696-0161d7d27dfd => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:21:33.605665 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-4cd39571-470a-4b62-ab8a-cb3debdc8bfd tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf93a4b80cb4e19a36473986950fc75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c1943188684b45b636541caf587247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:21:33.684888 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4cd39571-470a-4b62-ab8a-cb3debdc8bfd tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] 10.222.0.17 "GET /compute/v2.1/servers/6435faed-ac55-4f93-ac79-2668c6538209" status: 200 len: 1462 microversion: 2.1 time: 0.766261 Jul 23 21:21:33.689419 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 962/1938] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:21:32 2022] GET /compute/v2.1/servers/6435faed-ac55-4f93-ac79-2668c6538209 => generated 1462 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:21:33.707122 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-4322e17f-2017-460b-aeb6-7d2d87359c7a tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:33.707859 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-4322e17f-2017-460b-aeb6-7d2d87359c7a tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] [instance: cef13563-7f83-4281-a26c-d5e420c41daf] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:21:33.720399 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4322e17f-2017-460b-aeb6-7d2d87359c7a tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:33.720953 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4322e17f-2017-460b-aeb6-7d2d87359c7a tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:33.722753 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4322e17f-2017-460b-aeb6-7d2d87359c7a tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:33.724210 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4322e17f-2017-460b-aeb6-7d2d87359c7a tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:33.765912 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0927ff7d-aa68-47a5-b9cc-6850a03d0f28 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '.version_select at 0x7f0b599104c0>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:33.907419 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-0927ff7d-aa68-47a5-b9cc-6850a03d0f28 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/images/ee136f2b-cfa9-44cf-899c-7795cf98e798" status: 200 len: 1453 microversion: 2.1 time: 0.143792 Jul 23 21:21:33.908273 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 963/1939] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:21:33 2022] GET /compute/v2.1/images/ee136f2b-cfa9-44cf-899c-7795cf98e798 => generated 1453 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:21:34.348934 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c75bf1e5-a0aa-4ef1-8c86-3b112d8946e6 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:34.349889 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c75bf1e5-a0aa-4ef1-8c86-3b112d8946e6 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] [instance: 2cebd0e1-09ca-4eab-bda7-0743043bad23] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:21:34.375096 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c75bf1e5-a0aa-4ef1-8c86-3b112d8946e6 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:34.375607 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c75bf1e5-a0aa-4ef1-8c86-3b112d8946e6 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:34.376485 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c75bf1e5-a0aa-4ef1-8c86-3b112d8946e6 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:34.377000 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c75bf1e5-a0aa-4ef1-8c86-3b112d8946e6 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:34.902729 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c75bf1e5-a0aa-4ef1-8c86-3b112d8946e6 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '672d90d732a0419ca669e0055359dcfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d87ea887fea457fb07731d47de68333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:21:34.914607 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c75bf1e5-a0aa-4ef1-8c86-3b112d8946e6 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] 10.222.0.17 "GET /compute/v2.1/servers/2cebd0e1-09ca-4eab-bda7-0743043bad23" status: 200 len: 1290 microversion: 2.1 time: 0.569492 Jul 23 21:21:34.933760 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 964/1940] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:21:34 2022] GET /compute/v2.1/servers/2cebd0e1-09ca-4eab-bda7-0743043bad23 => generated 1290 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:21:34.944055 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b214ef9a-0c46-40ce-b60c-fa0c8d364603 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '.version_select at 0x7f0b5994d280>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:35.094313 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b214ef9a-0c46-40ce-b60c-fa0c8d364603 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/images/ee136f2b-cfa9-44cf-899c-7795cf98e798" status: 200 len: 1453 microversion: 2.1 time: 0.159022 Jul 23 21:21:35.100374 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 965/1941] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:21:34 2022] GET /compute/v2.1/images/ee136f2b-cfa9-44cf-899c-7795cf98e798 => generated 1453 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:21:35.201560 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-4322e17f-2017-460b-aeb6-7d2d87359c7a tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf93a4b80cb4e19a36473986950fc75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c1943188684b45b636541caf587247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:21:35.211565 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-4322e17f-2017-460b-aeb6-7d2d87359c7a tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] 10.222.0.17 "GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf" status: 200 len: 1464 microversion: 2.1 time: 1.508943 Jul 23 21:21:35.240994 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 977/1942] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:21:33 2022] GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf => generated 1464 bytes in 1539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:21:35.503829 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-383bce83-0ade-4f77-b0b8-671664184379 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-911144297", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "cef13563-7f83-4281-a26c-d5e420c41daf"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:21:35.644696 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-383bce83-0ade-4f77-b0b8-671664184379 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] validate_networks() for None {{(pid=131320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:21:35.949600 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-eec9fd9c-5a43-4879-aeac-27927d16a03e tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:35.950489 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-eec9fd9c-5a43-4879-aeac-27927d16a03e tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] [instance: 2cebd0e1-09ca-4eab-bda7-0743043bad23] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:21:35.972322 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-eec9fd9c-5a43-4879-aeac-27927d16a03e tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:35.974081 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-eec9fd9c-5a43-4879-aeac-27927d16a03e tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:35.974937 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-eec9fd9c-5a43-4879-aeac-27927d16a03e tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:35.975380 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-eec9fd9c-5a43-4879-aeac-27927d16a03e tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:36.393556 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-eec9fd9c-5a43-4879-aeac-27927d16a03e tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '672d90d732a0419ca669e0055359dcfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d87ea887fea457fb07731d47de68333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:21:36.404066 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-eec9fd9c-5a43-4879-aeac-27927d16a03e tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] 10.222.0.17 "GET /compute/v2.1/servers/2cebd0e1-09ca-4eab-bda7-0743043bad23" status: 200 len: 1290 microversion: 2.1 time: 0.458267 Jul 23 21:21:36.416095 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 978/1943] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:21:35 2022] GET /compute/v2.1/servers/2cebd0e1-09ca-4eab-bda7-0743043bad23 => generated 1290 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:21:36.423952 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-b5fe9ce5-ed50-43a8-b914-3bd366ae03df tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '.version_select at 0x7f0b5991ea60>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:36.510252 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-b5fe9ce5-ed50-43a8-b914-3bd366ae03df tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/images/ee136f2b-cfa9-44cf-899c-7795cf98e798" status: 200 len: 1453 microversion: 2.1 time: 0.092508 Jul 23 21:21:36.511448 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 979/1944] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:21:36 2022] GET /compute/v2.1/images/ee136f2b-cfa9-44cf-899c-7795cf98e798 => generated 1453 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:21:37.172140 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-383bce83-0ade-4f77-b0b8-671664184379 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:21:37.173455 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-383bce83-0ade-4f77-b0b8-671664184379 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:21:37.174199 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-383bce83-0ade-4f77-b0b8-671664184379 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:21:37.175204 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-383bce83-0ade-4f77-b0b8-671664184379 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:21:37.175851 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-383bce83-0ade-4f77-b0b8-671664184379 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:21:37.197390 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-383bce83-0ade-4f77-b0b8-671664184379 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:37.203540 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-383bce83-0ade-4f77-b0b8-671664184379 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:37.204760 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-383bce83-0ade-4f77-b0b8-671664184379 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:37.205855 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-383bce83-0ade-4f77-b0b8-671664184379 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:37.229431 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-383bce83-0ade-4f77-b0b8-671664184379 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Getting quotas for project 35c1943188684b45b636541caf587247. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:21:37.239421 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-383bce83-0ade-4f77-b0b8-671664184379 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Getting quotas for user ebf93a4b80cb4e19a36473986950fc75 and project 35c1943188684b45b636541caf587247. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:21:37.258312 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-383bce83-0ade-4f77-b0b8-671664184379 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Going to run 1 instances... {{(pid=131320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:21:37.269505 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-383bce83-0ade-4f77-b0b8-671664184379 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] [instance: 53347323-4870-4526-9020-1a3bc821d3fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:21:37.404836 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-383bce83-0ade-4f77-b0b8-671664184379 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.906058 Jul 23 21:21:37.408912 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 966/1945] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:21:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1912 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 23 21:21:37.427668 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a206cccc-d614-4646-8c8e-e100ae8f8442 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:37.428665 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a206cccc-d614-4646-8c8e-e100ae8f8442 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] [instance: 53347323-4870-4526-9020-1a3bc821d3fb] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:21:37.692667 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-245e3d0d-6721-4fc8-9714-e5090447e034 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-979422686", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:21:37.799757 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.network.neutron [None req-245e3d0d-6721-4fc8-9714-e5090447e034 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] validate_networks() for None {{(pid=131321) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:21:38.175424 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a206cccc-d614-4646-8c8e-e100ae8f8442 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf93a4b80cb4e19a36473986950fc75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c1943188684b45b636541caf587247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:21:38.192202 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a206cccc-d614-4646-8c8e-e100ae8f8442 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] 10.222.0.17 "GET /compute/v2.1/servers/53347323-4870-4526-9020-1a3bc821d3fb" status: 200 len: 1213 microversion: 2.1 time: 0.777847 Jul 23 21:21:38.193806 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 967/1946] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:21:37 2022] GET /compute/v2.1/servers/53347323-4870-4526-9020-1a3bc821d3fb => generated 1213 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:21:38.200670 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-41651e21-e09e-4c5c-bafe-c33e28d83ac2 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:38.203009 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-41651e21-e09e-4c5c-bafe-c33e28d83ac2 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] [instance: 2cebd0e1-09ca-4eab-bda7-0743043bad23] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:21:38.210442 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=12,nova_api:DELETE=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:21:38.213732 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-41651e21-e09e-4c5c-bafe-c33e28d83ac2 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:38.214734 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-41651e21-e09e-4c5c-bafe-c33e28d83ac2 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:38.218969 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-41651e21-e09e-4c5c-bafe-c33e28d83ac2 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:38.219714 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-41651e21-e09e-4c5c-bafe-c33e28d83ac2 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:38.425420 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-41651e21-e09e-4c5c-bafe-c33e28d83ac2 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '672d90d732a0419ca669e0055359dcfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d87ea887fea457fb07731d47de68333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:21:38.447863 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-245e3d0d-6721-4fc8-9714-e5090447e034 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Flavor limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:21:38.448359 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-245e3d0d-6721-4fc8-9714-e5090447e034 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Image limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:21:38.451273 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-41651e21-e09e-4c5c-bafe-c33e28d83ac2 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] 10.222.0.17 "GET /compute/v2.1/servers/2cebd0e1-09ca-4eab-bda7-0743043bad23" status: 200 len: 1290 microversion: 2.1 time: 0.246640 Jul 23 21:21:38.453509 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-245e3d0d-6721-4fc8-9714-e5090447e034 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Flavor pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:21:38.454012 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-245e3d0d-6721-4fc8-9714-e5090447e034 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Image pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:21:38.454480 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-245e3d0d-6721-4fc8-9714-e5090447e034 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:21:38.456807 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 968/1947] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:21:38 2022] GET /compute/v2.1/servers/2cebd0e1-09ca-4eab-bda7-0743043bad23 => generated 1290 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:21:38.478500 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-245e3d0d-6721-4fc8-9714-e5090447e034 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:38.484056 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-245e3d0d-6721-4fc8-9714-e5090447e034 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:38.485920 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-245e3d0d-6721-4fc8-9714-e5090447e034 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:38.486703 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-245e3d0d-6721-4fc8-9714-e5090447e034 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:38.486834 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d4574dbd-c19e-4c23-bdf5-278bc4f03fdd tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '.version_select at 0x7f0b5990f670>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:38.555186 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-245e3d0d-6721-4fc8-9714-e5090447e034 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Getting quotas for project 7e0f76ca9b734142a90c27f3d3de3a85. Resources: {'ram', 'instances', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:21:38.570712 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-245e3d0d-6721-4fc8-9714-e5090447e034 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Getting quotas for user c7acc7eae5f946aaac9f0c8ead2c8d58 and project 7e0f76ca9b734142a90c27f3d3de3a85. Resources: {'ram', 'instances', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:21:38.605035 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-245e3d0d-6721-4fc8-9714-e5090447e034 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Going to run 1 instances... {{(pid=131321) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:21:38.607672 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-245e3d0d-6721-4fc8-9714-e5090447e034 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] [instance: a213ec70-d903-4ce2-a577-64b4dacf9c1e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131321) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:21:38.652455 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d4574dbd-c19e-4c23-bdf5-278bc4f03fdd tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/images/ee136f2b-cfa9-44cf-899c-7795cf98e798" status: 200 len: 1453 microversion: 2.1 time: 0.193978 Jul 23 21:21:38.657707 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 969/1948] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:21:38 2022] GET /compute/v2.1/images/ee136f2b-cfa9-44cf-899c-7795cf98e798 => generated 1453 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:21:38.721590 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-245e3d0d-6721-4fc8-9714-e5090447e034 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.421616 Jul 23 21:21:38.724094 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 980/1949] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:21:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1425 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 23 21:21:38.736067 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-71a5df3f-d2f8-4ffc-9edd-1b1367fdb770 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:38.737191 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-71a5df3f-d2f8-4ffc-9edd-1b1367fdb770 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] [instance: a213ec70-d903-4ce2-a577-64b4dacf9c1e] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:21:39.034109 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-71a5df3f-d2f8-4ffc-9edd-1b1367fdb770 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7acc7eae5f946aaac9f0c8ead2c8d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e0f76ca9b734142a90c27f3d3de3a85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:21:39.053711 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-71a5df3f-d2f8-4ffc-9edd-1b1367fdb770 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] 10.222.0.17 "GET /compute/v2.1/servers/a213ec70-d903-4ce2-a577-64b4dacf9c1e" status: 200 len: 1221 microversion: 2.1 time: 0.321560 Jul 23 21:21:39.066108 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 970/1950] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:21:38 2022] GET /compute/v2.1/servers/a213ec70-d903-4ce2-a577-64b4dacf9c1e => generated 1221 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:21:39.211516 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-de6abb9e-1302-4597-8332-7335771ff1ef tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:39.212859 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-de6abb9e-1302-4597-8332-7335771ff1ef tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] [instance: 53347323-4870-4526-9020-1a3bc821d3fb] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:21:39.227859 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-de6abb9e-1302-4597-8332-7335771ff1ef tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:39.244067 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-de6abb9e-1302-4597-8332-7335771ff1ef tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:39.252197 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-de6abb9e-1302-4597-8332-7335771ff1ef tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:39.254810 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-de6abb9e-1302-4597-8332-7335771ff1ef tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:39.474637 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1c283c31-4d12-427a-ae39-c10facc80bb0 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:39.475410 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1c283c31-4d12-427a-ae39-c10facc80bb0 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] [instance: 2cebd0e1-09ca-4eab-bda7-0743043bad23] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:21:39.500993 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1c283c31-4d12-427a-ae39-c10facc80bb0 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:39.501554 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1c283c31-4d12-427a-ae39-c10facc80bb0 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:39.504527 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1c283c31-4d12-427a-ae39-c10facc80bb0 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:39.506858 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1c283c31-4d12-427a-ae39-c10facc80bb0 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:39.513267 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-de6abb9e-1302-4597-8332-7335771ff1ef tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf93a4b80cb4e19a36473986950fc75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c1943188684b45b636541caf587247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:21:39.523381 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-de6abb9e-1302-4597-8332-7335771ff1ef tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] 10.222.0.17 "GET /compute/v2.1/servers/53347323-4870-4526-9020-1a3bc821d3fb" status: 200 len: 1283 microversion: 2.1 time: 0.315953 Jul 23 21:21:39.536451 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 981/1951] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:21:39 2022] GET /compute/v2.1/servers/53347323-4870-4526-9020-1a3bc821d3fb => generated 1283 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:21:39.671245 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-3c9aee3b-5977-43f4-b59f-0358b3e8408d tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '.version_select at 0x7f0b4765b670>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:39.832982 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-3c9aee3b-5977-43f4-b59f-0358b3e8408d tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/images/ee136f2b-cfa9-44cf-899c-7795cf98e798" status: 200 len: 1453 microversion: 2.1 time: 0.166598 Jul 23 21:21:39.835634 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 982/1952] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:21:39 2022] GET /compute/v2.1/images/ee136f2b-cfa9-44cf-899c-7795cf98e798 => generated 1453 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:21:40.072903 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-686dfc22-9e2b-44f4-86d3-d70781d37f99 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:40.073550 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-686dfc22-9e2b-44f4-86d3-d70781d37f99 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] [instance: a213ec70-d903-4ce2-a577-64b4dacf9c1e] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:21:40.086018 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-686dfc22-9e2b-44f4-86d3-d70781d37f99 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:40.086539 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-686dfc22-9e2b-44f4-86d3-d70781d37f99 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:40.087254 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-686dfc22-9e2b-44f4-86d3-d70781d37f99 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:40.087698 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-686dfc22-9e2b-44f4-86d3-d70781d37f99 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:40.236218 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-686dfc22-9e2b-44f4-86d3-d70781d37f99 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7acc7eae5f946aaac9f0c8ead2c8d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e0f76ca9b734142a90c27f3d3de3a85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:21:40.264073 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-686dfc22-9e2b-44f4-86d3-d70781d37f99 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] 10.222.0.17 "GET /compute/v2.1/servers/a213ec70-d903-4ce2-a577-64b4dacf9c1e" status: 200 len: 1217 microversion: 2.1 time: 0.194789 Jul 23 21:21:40.264899 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 983/1953] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:21:40 2022] GET /compute/v2.1/servers/a213ec70-d903-4ce2-a577-64b4dacf9c1e => generated 1217 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:21:40.381081 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-1c283c31-4d12-427a-ae39-c10facc80bb0 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '672d90d732a0419ca669e0055359dcfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d87ea887fea457fb07731d47de68333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:21:40.389163 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1c283c31-4d12-427a-ae39-c10facc80bb0 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] 10.222.0.17 "GET /compute/v2.1/servers/2cebd0e1-09ca-4eab-bda7-0743043bad23" status: 200 len: 1332 microversion: 2.1 time: 0.919716 Jul 23 21:21:40.389772 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 971/1954] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:21:39 2022] GET /compute/v2.1/servers/2cebd0e1-09ca-4eab-bda7-0743043bad23 => generated 1332 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:21:40.544632 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-3e4c9f08-1fdc-446c-a7e1-ae1dda29f437 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:40.545839 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-3e4c9f08-1fdc-446c-a7e1-ae1dda29f437 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] [instance: 53347323-4870-4526-9020-1a3bc821d3fb] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:21:40.558420 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3e4c9f08-1fdc-446c-a7e1-ae1dda29f437 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:40.561015 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3e4c9f08-1fdc-446c-a7e1-ae1dda29f437 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:40.562329 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3e4c9f08-1fdc-446c-a7e1-ae1dda29f437 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:40.564145 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3e4c9f08-1fdc-446c-a7e1-ae1dda29f437 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:40.695212 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-3e4c9f08-1fdc-446c-a7e1-ae1dda29f437 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf93a4b80cb4e19a36473986950fc75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c1943188684b45b636541caf587247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:21:40.713264 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-3e4c9f08-1fdc-446c-a7e1-ae1dda29f437 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] 10.222.0.17 "GET /compute/v2.1/servers/53347323-4870-4526-9020-1a3bc821d3fb" status: 200 len: 1271 microversion: 2.1 time: 0.172700 Jul 23 21:21:40.730603 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 984/1955] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:21:40 2022] GET /compute/v2.1/servers/53347323-4870-4526-9020-1a3bc821d3fb => generated 1271 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:21:40.853385 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3d73ccd0-819a-4e1a-952c-1d5877efdd38 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '.version_select at 0x7f0b598eff70>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:40.911677 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-3d73ccd0-819a-4e1a-952c-1d5877efdd38 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/images/ee136f2b-cfa9-44cf-899c-7795cf98e798" status: 200 len: 1453 microversion: 2.1 time: 0.062866 Jul 23 21:21:40.912517 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 972/1956] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:21:40 2022] GET /compute/v2.1/images/ee136f2b-cfa9-44cf-899c-7795cf98e798 => generated 1453 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:21:41.286662 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-dc924cd7-cb1e-4e67-acf6-4def6f406330 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:41.287645 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-dc924cd7-cb1e-4e67-acf6-4def6f406330 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] [instance: a213ec70-d903-4ce2-a577-64b4dacf9c1e] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:21:41.306898 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-dc924cd7-cb1e-4e67-acf6-4def6f406330 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:41.307361 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-dc924cd7-cb1e-4e67-acf6-4def6f406330 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:41.308916 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-dc924cd7-cb1e-4e67-acf6-4def6f406330 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:41.309355 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-dc924cd7-cb1e-4e67-acf6-4def6f406330 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:41.409186 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-dc924cd7-cb1e-4e67-acf6-4def6f406330 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7acc7eae5f946aaac9f0c8ead2c8d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e0f76ca9b734142a90c27f3d3de3a85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:21:41.419701 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b8674ade-337c-47fb-98f8-e6c7ca671f6b tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:41.420914 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b8674ade-337c-47fb-98f8-e6c7ca671f6b tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] [instance: 2cebd0e1-09ca-4eab-bda7-0743043bad23] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:21:41.422838 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-dc924cd7-cb1e-4e67-acf6-4def6f406330 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] 10.222.0.17 "GET /compute/v2.1/servers/a213ec70-d903-4ce2-a577-64b4dacf9c1e" status: 200 len: 1279 microversion: 2.1 time: 0.140260 Jul 23 21:21:41.430453 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b8674ade-337c-47fb-98f8-e6c7ca671f6b tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:41.431369 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 985/1957] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:21:41 2022] GET /compute/v2.1/servers/a213ec70-d903-4ce2-a577-64b4dacf9c1e => generated 1279 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:21:41.445559 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b8674ade-337c-47fb-98f8-e6c7ca671f6b tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:41.447941 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b8674ade-337c-47fb-98f8-e6c7ca671f6b tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:41.448984 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b8674ade-337c-47fb-98f8-e6c7ca671f6b tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:41.730891 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-3a66eb0f-f0f0-40e6-ac78-61ae1182bad3 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:41.731515 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-3a66eb0f-f0f0-40e6-ac78-61ae1182bad3 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] [instance: 53347323-4870-4526-9020-1a3bc821d3fb] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:21:41.739023 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3a66eb0f-f0f0-40e6-ac78-61ae1182bad3 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:41.739848 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3a66eb0f-f0f0-40e6-ac78-61ae1182bad3 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:41.740909 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3a66eb0f-f0f0-40e6-ac78-61ae1182bad3 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:41.741608 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3a66eb0f-f0f0-40e6-ac78-61ae1182bad3 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:41.839670 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-3a66eb0f-f0f0-40e6-ac78-61ae1182bad3 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf93a4b80cb4e19a36473986950fc75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c1943188684b45b636541caf587247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:21:41.853428 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-3a66eb0f-f0f0-40e6-ac78-61ae1182bad3 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] 10.222.0.17 "GET /compute/v2.1/servers/53347323-4870-4526-9020-1a3bc821d3fb" status: 200 len: 1271 microversion: 2.1 time: 0.125540 Jul 23 21:21:41.863457 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 986/1958] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:21:41 2022] GET /compute/v2.1/servers/53347323-4870-4526-9020-1a3bc821d3fb => generated 1271 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:21:41.938077 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-0985db7f-4e71-4f6b-b3f6-2d036f5262b5 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '.version_select at 0x7f0b47601f70>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:42.023491 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-0985db7f-4e71-4f6b-b3f6-2d036f5262b5 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/images/ee136f2b-cfa9-44cf-899c-7795cf98e798" status: 200 len: 1453 microversion: 2.1 time: 0.101600 Jul 23 21:21:42.025274 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 987/1959] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:21:41 2022] GET /compute/v2.1/images/ee136f2b-cfa9-44cf-899c-7795cf98e798 => generated 1453 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:21:42.225743 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b8674ade-337c-47fb-98f8-e6c7ca671f6b tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '672d90d732a0419ca669e0055359dcfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d87ea887fea457fb07731d47de68333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:21:42.244884 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b8674ade-337c-47fb-98f8-e6c7ca671f6b tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] 10.222.0.17 "GET /compute/v2.1/servers/2cebd0e1-09ca-4eab-bda7-0743043bad23" status: 200 len: 1332 microversion: 2.1 time: 0.841660 Jul 23 21:21:42.248771 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 973/1960] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:21:41 2022] GET /compute/v2.1/servers/2cebd0e1-09ca-4eab-bda7-0743043bad23 => generated 1332 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:21:42.452934 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-483bcfaa-08e5-4c49-b6b2-642fdfa5112c tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:42.453550 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-483bcfaa-08e5-4c49-b6b2-642fdfa5112c tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] [instance: a213ec70-d903-4ce2-a577-64b4dacf9c1e] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:21:42.464163 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-483bcfaa-08e5-4c49-b6b2-642fdfa5112c tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:42.468982 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-483bcfaa-08e5-4c49-b6b2-642fdfa5112c tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:42.481536 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-483bcfaa-08e5-4c49-b6b2-642fdfa5112c tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:42.482574 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-483bcfaa-08e5-4c49-b6b2-642fdfa5112c tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:42.504313 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=100 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:21:42.674680 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-483bcfaa-08e5-4c49-b6b2-642fdfa5112c tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7acc7eae5f946aaac9f0c8ead2c8d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e0f76ca9b734142a90c27f3d3de3a85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:21:42.697233 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-483bcfaa-08e5-4c49-b6b2-642fdfa5112c tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] 10.222.0.17 "GET /compute/v2.1/servers/a213ec70-d903-4ce2-a577-64b4dacf9c1e" status: 200 len: 1279 microversion: 2.1 time: 0.248655 Jul 23 21:21:42.701561 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 988/1961] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:21:42 2022] GET /compute/v2.1/servers/a213ec70-d903-4ce2-a577-64b4dacf9c1e => generated 1279 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:21:42.873162 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-282898b9-4d2a-4c60-ae67-ec76d8513dfb tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:42.874135 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-282898b9-4d2a-4c60-ae67-ec76d8513dfb tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] [instance: 53347323-4870-4526-9020-1a3bc821d3fb] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:21:42.898695 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-282898b9-4d2a-4c60-ae67-ec76d8513dfb tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:42.901979 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-282898b9-4d2a-4c60-ae67-ec76d8513dfb tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:42.904461 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-282898b9-4d2a-4c60-ae67-ec76d8513dfb tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:42.908791 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-282898b9-4d2a-4c60-ae67-ec76d8513dfb tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:43.014571 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:21:43.038729 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-1f56eaec-4033-4e3d-b191-c5edaed556e6 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '.version_select at 0x7f0b4760a940>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:43.119179 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-1f56eaec-4033-4e3d-b191-c5edaed556e6 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/images/ee136f2b-cfa9-44cf-899c-7795cf98e798" status: 200 len: 1453 microversion: 2.1 time: 0.084841 Jul 23 21:21:43.120345 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 989/1962] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:21:43 2022] GET /compute/v2.1/images/ee136f2b-cfa9-44cf-899c-7795cf98e798 => generated 1453 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:21:43.158156 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-282898b9-4d2a-4c60-ae67-ec76d8513dfb tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf93a4b80cb4e19a36473986950fc75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c1943188684b45b636541caf587247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:21:43.170101 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-282898b9-4d2a-4c60-ae67-ec76d8513dfb tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] 10.222.0.17 "GET /compute/v2.1/servers/53347323-4870-4526-9020-1a3bc821d3fb" status: 200 len: 1271 microversion: 2.1 time: 0.301747 Jul 23 21:21:43.182680 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 974/1963] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:21:42 2022] GET /compute/v2.1/servers/53347323-4870-4526-9020-1a3bc821d3fb => generated 1271 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:21:43.266788 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-b2f6fcad-5da9-4256-b7fa-9e1aaf93721d tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:43.268844 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-b2f6fcad-5da9-4256-b7fa-9e1aaf93721d tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] [instance: 2cebd0e1-09ca-4eab-bda7-0743043bad23] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:21:43.296358 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b2f6fcad-5da9-4256-b7fa-9e1aaf93721d tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:43.297468 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b2f6fcad-5da9-4256-b7fa-9e1aaf93721d tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:43.300203 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b2f6fcad-5da9-4256-b7fa-9e1aaf93721d tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:43.301050 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b2f6fcad-5da9-4256-b7fa-9e1aaf93721d tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:43.718483 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-12fc3833-cc66-42ab-a125-17814e4f5d1d tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:43.720443 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-12fc3833-cc66-42ab-a125-17814e4f5d1d tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] [instance: a213ec70-d903-4ce2-a577-64b4dacf9c1e] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:21:43.744163 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-12fc3833-cc66-42ab-a125-17814e4f5d1d tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:43.747017 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-12fc3833-cc66-42ab-a125-17814e4f5d1d tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:43.753005 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-12fc3833-cc66-42ab-a125-17814e4f5d1d tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:43.763859 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-12fc3833-cc66-42ab-a125-17814e4f5d1d tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:43.977201 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-b2f6fcad-5da9-4256-b7fa-9e1aaf93721d tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '672d90d732a0419ca669e0055359dcfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d87ea887fea457fb07731d47de68333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:21:43.989093 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-b2f6fcad-5da9-4256-b7fa-9e1aaf93721d tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] 10.222.0.17 "GET /compute/v2.1/servers/2cebd0e1-09ca-4eab-bda7-0743043bad23" status: 200 len: 1332 microversion: 2.1 time: 0.726962 Jul 23 21:21:43.994609 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 990/1964] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:21:43 2022] GET /compute/v2.1/servers/2cebd0e1-09ca-4eab-bda7-0743043bad23 => generated 1332 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:21:44.125685 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-12fc3833-cc66-42ab-a125-17814e4f5d1d tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7acc7eae5f946aaac9f0c8ead2c8d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e0f76ca9b734142a90c27f3d3de3a85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:21:44.133437 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-0e2c6b18-4fa6-4536-94df-72dad59ff557 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '.version_select at 0x7f0b4765b160>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:44.153053 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-12fc3833-cc66-42ab-a125-17814e4f5d1d tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] 10.222.0.17 "GET /compute/v2.1/servers/a213ec70-d903-4ce2-a577-64b4dacf9c1e" status: 200 len: 1279 microversion: 2.1 time: 0.436344 Jul 23 21:21:44.155336 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 975/1965] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:21:43 2022] GET /compute/v2.1/servers/a213ec70-d903-4ce2-a577-64b4dacf9c1e => generated 1279 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:21:44.190574 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1f4f514e-abc2-4b59-bcb3-10a7124a037f tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:44.191404 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1f4f514e-abc2-4b59-bcb3-10a7124a037f tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] [instance: 53347323-4870-4526-9020-1a3bc821d3fb] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:21:44.208031 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1f4f514e-abc2-4b59-bcb3-10a7124a037f tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:44.208910 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1f4f514e-abc2-4b59-bcb3-10a7124a037f tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:44.209997 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1f4f514e-abc2-4b59-bcb3-10a7124a037f tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:44.213813 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1f4f514e-abc2-4b59-bcb3-10a7124a037f tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:45.183284 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-0e2c6b18-4fa6-4536-94df-72dad59ff557 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/images/ee136f2b-cfa9-44cf-899c-7795cf98e798" status: 200 len: 1453 microversion: 2.1 time: 1.054410 Jul 23 21:21:45.184812 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 991/1966] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:21:44 2022] GET /compute/v2.1/images/ee136f2b-cfa9-44cf-899c-7795cf98e798 => generated 1453 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:21:45.189632 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-40c63c48-0e31-47b5-8a1d-32317dc585f6 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:45.194878 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-40c63c48-0e31-47b5-8a1d-32317dc585f6 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] [instance: 2cebd0e1-09ca-4eab-bda7-0743043bad23] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:21:45.211235 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-40c63c48-0e31-47b5-8a1d-32317dc585f6 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:45.216660 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-40c63c48-0e31-47b5-8a1d-32317dc585f6 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:45.217841 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-40c63c48-0e31-47b5-8a1d-32317dc585f6 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:45.218485 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-40c63c48-0e31-47b5-8a1d-32317dc585f6 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:45.310714 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-1f4f514e-abc2-4b59-bcb3-10a7124a037f tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf93a4b80cb4e19a36473986950fc75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c1943188684b45b636541caf587247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:21:45.319971 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1f4f514e-abc2-4b59-bcb3-10a7124a037f tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] 10.222.0.17 "GET /compute/v2.1/servers/53347323-4870-4526-9020-1a3bc821d3fb" status: 200 len: 1313 microversion: 2.1 time: 1.135720 Jul 23 21:21:45.324021 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 976/1967] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:21:44 2022] GET /compute/v2.1/servers/53347323-4870-4526-9020-1a3bc821d3fb => generated 1313 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:21:45.339395 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e9a5e44c-5ff0-4481-972d-f8b5c750409c tempest-ImagesMetadataTestJSON-297427433 tempest-ImagesMetadataTestJSON-297427433-project] Calling method '.version_select at 0x7f0b599cff70>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:45.459590 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e9a5e44c-5ff0-4481-972d-f8b5c750409c tempest-ImagesMetadataTestJSON-297427433 tempest-ImagesMetadataTestJSON-297427433-project] 10.222.0.17 "GET /compute/v2.1/images/5dceed05-fb65-4806-89a1-17ab50a04465" status: 200 len: 636 microversion: 2.1 time: 0.133667 Jul 23 21:21:45.460961 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 977/1968] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:21:45 2022] GET /compute/v2.1/images/5dceed05-fb65-4806-89a1-17ab50a04465 => generated 636 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:21:45.477228 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-109ff059-89ff-4f1c-b389-c7faeb8b29ea tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:45.482052 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-109ff059-89ff-4f1c-b389-c7faeb8b29ea tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] [instance: a213ec70-d903-4ce2-a577-64b4dacf9c1e] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:21:45.513186 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-109ff059-89ff-4f1c-b389-c7faeb8b29ea tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:45.519771 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-109ff059-89ff-4f1c-b389-c7faeb8b29ea tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:45.521951 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-109ff059-89ff-4f1c-b389-c7faeb8b29ea tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:45.522995 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-109ff059-89ff-4f1c-b389-c7faeb8b29ea tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:45.689286 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-109ff059-89ff-4f1c-b389-c7faeb8b29ea tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7acc7eae5f946aaac9f0c8ead2c8d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e0f76ca9b734142a90c27f3d3de3a85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:21:45.713119 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-109ff059-89ff-4f1c-b389-c7faeb8b29ea tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] 10.222.0.17 "GET /compute/v2.1/servers/a213ec70-d903-4ce2-a577-64b4dacf9c1e" status: 200 len: 1279 microversion: 2.1 time: 0.250754 Jul 23 21:21:45.713685 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 978/1969] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:21:45 2022] GET /compute/v2.1/servers/a213ec70-d903-4ce2-a577-64b4dacf9c1e => generated 1279 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:21:45.770258 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-c977cd1b-e53c-4004-8ae6-cc2db8c17ce9 req-1f7143cf-6a0c-478d-b582-42757d5d8b93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2cebd0e1-09ca-4eab-bda7-0743043bad23", "tag": "d506fd59-3dd8-47d3-b895-177dd8661556"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:21:45.813028 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-c977cd1b-e53c-4004-8ae6-cc2db8c17ce9 req-1f7143cf-6a0c-478d-b582-42757d5d8b93 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:45.813454 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-c977cd1b-e53c-4004-8ae6-cc2db8c17ce9 req-1f7143cf-6a0c-478d-b582-42757d5d8b93 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:45.845049 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-c977cd1b-e53c-4004-8ae6-cc2db8c17ce9 req-1f7143cf-6a0c-478d-b582-42757d5d8b93 service nova] Creating event network-changed:d506fd59-3dd8-47d3-b895-177dd8661556 for instance 2cebd0e1-09ca-4eab-bda7-0743043bad23 on nch2-master-1 Jul 23 21:21:45.852622 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-c977cd1b-e53c-4004-8ae6-cc2db8c17ce9 req-1f7143cf-6a0c-478d-b582-42757d5d8b93 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125092 Jul 23 21:21:45.854170 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 979/1970] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:21:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:21:45.865717 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-468b18f5-da0d-4bc1-b4e1-46588b6f3825 tempest-ImagesMetadataTestJSON-297427433 tempest-ImagesMetadataTestJSON-297427433-project] Action: 'update_all', calling method: .version_select at 0x7f0b599cfaf0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:21:45.990448 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-468b18f5-da0d-4bc1-b4e1-46588b6f3825 tempest-ImagesMetadataTestJSON-297427433 tempest-ImagesMetadataTestJSON-297427433-project] Getting quotas for project fa88d37bfb314835bd592d638db11360. Resources: dict_keys(['metadata_items']) {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:21:46.008441 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-468b18f5-da0d-4bc1-b4e1-46588b6f3825 tempest-ImagesMetadataTestJSON-297427433 tempest-ImagesMetadataTestJSON-297427433-project] Getting quotas for user 22f9f9332aad483281c34422d83ba2fc and project fa88d37bfb314835bd592d638db11360. Resources: dict_keys(['metadata_items']) {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:21:46.404965 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-40c63c48-0e31-47b5-8a1d-32317dc585f6 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '672d90d732a0419ca669e0055359dcfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d87ea887fea457fb07731d47de68333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:21:46.421243 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-40c63c48-0e31-47b5-8a1d-32317dc585f6 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] 10.222.0.17 "GET /compute/v2.1/servers/2cebd0e1-09ca-4eab-bda7-0743043bad23" status: 200 len: 1332 microversion: 2.1 time: 1.235083 Jul 23 21:21:46.435521 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 992/1971] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:21:45 2022] GET /compute/v2.1/servers/2cebd0e1-09ca-4eab-bda7-0743043bad23 => generated 1332 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:21:46.440738 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d99e5934-b2b5-4f3a-bc73-3d1d14b2faad tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '.version_select at 0x7f0b47601ee0>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:46.688977 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-d99e5934-b2b5-4f3a-bc73-3d1d14b2faad tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/images/ee136f2b-cfa9-44cf-899c-7795cf98e798" status: 200 len: 1453 microversion: 2.1 time: 0.251959 Jul 23 21:21:46.689883 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 993/1972] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:21:46 2022] GET /compute/v2.1/images/ee136f2b-cfa9-44cf-899c-7795cf98e798 => generated 1453 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:21:46.694320 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ad467d28-92a2-4152-bb9c-49eeb1d76733 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:46.694880 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-ad467d28-92a2-4152-bb9c-49eeb1d76733 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] [instance: 53347323-4870-4526-9020-1a3bc821d3fb] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:21:46.736226 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ad467d28-92a2-4152-bb9c-49eeb1d76733 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:46.740407 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ad467d28-92a2-4152-bb9c-49eeb1d76733 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:46.745295 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-468b18f5-da0d-4bc1-b4e1-46588b6f3825 tempest-ImagesMetadataTestJSON-297427433 tempest-ImagesMetadataTestJSON-297427433-project] 10.222.0.17 "PUT /compute/v2.1/images/5dceed05-fb65-4806-89a1-17ab50a04465/metadata" status: 200 len: 61 microversion: 2.1 time: 0.889363 Jul 23 21:21:46.745804 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ad467d28-92a2-4152-bb9c-49eeb1d76733 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:46.745942 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 980/1973] 10.222.0.17 () {60 vars in 1279 bytes} [Sat Jul 23 21:21:45 2022] PUT /compute/v2.1/images/5dceed05-fb65-4806-89a1-17ab50a04465/metadata => generated 61 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 23 21:21:46.751520 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ad467d28-92a2-4152-bb9c-49eeb1d76733 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:46.763260 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0a90d053-2685-4c13-9fff-86dc6a5adf4d tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:46.787297 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-0a90d053-2685-4c13-9fff-86dc6a5adf4d tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] [instance: a213ec70-d903-4ce2-a577-64b4dacf9c1e] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:21:46.813347 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0a90d053-2685-4c13-9fff-86dc6a5adf4d tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:46.813898 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0a90d053-2685-4c13-9fff-86dc6a5adf4d tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:46.819582 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0a90d053-2685-4c13-9fff-86dc6a5adf4d tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:46.827337 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0a90d053-2685-4c13-9fff-86dc6a5adf4d tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:47.218402 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=4 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:21:47.334020 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-0a90d053-2685-4c13-9fff-86dc6a5adf4d tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7acc7eae5f946aaac9f0c8ead2c8d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e0f76ca9b734142a90c27f3d3de3a85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:21:47.351840 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-0a90d053-2685-4c13-9fff-86dc6a5adf4d tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] 10.222.0.17 "GET /compute/v2.1/servers/a213ec70-d903-4ce2-a577-64b4dacf9c1e" status: 200 len: 1321 microversion: 2.1 time: 0.602969 Jul 23 21:21:47.358302 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 981/1974] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:21:46 2022] GET /compute/v2.1/servers/a213ec70-d903-4ce2-a577-64b4dacf9c1e => generated 1321 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:21:47.364233 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ad467d28-92a2-4152-bb9c-49eeb1d76733 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf93a4b80cb4e19a36473986950fc75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c1943188684b45b636541caf587247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:21:47.377555 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-ad467d28-92a2-4152-bb9c-49eeb1d76733 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] 10.222.0.17 "GET /compute/v2.1/servers/53347323-4870-4526-9020-1a3bc821d3fb" status: 200 len: 1313 microversion: 2.1 time: 0.686206 Jul 23 21:21:47.381029 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 994/1975] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:21:46 2022] GET /compute/v2.1/servers/53347323-4870-4526-9020-1a3bc821d3fb => generated 1313 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:21:47.395330 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8a46b7a4-3797-4c18-8500-c83fd1df25f3 tempest-ImagesMetadataTestJSON-297427433 tempest-ImagesMetadataTestJSON-297427433-project] Calling method '.version_select at 0x7f0b599bbb80>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:47.438383 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-058aa919-455e-472c-be52-843a85917e91 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:47.439747 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-058aa919-455e-472c-be52-843a85917e91 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] [instance: 2cebd0e1-09ca-4eab-bda7-0743043bad23] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:21:47.454689 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-058aa919-455e-472c-be52-843a85917e91 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:47.461212 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-058aa919-455e-472c-be52-843a85917e91 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:47.465673 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-058aa919-455e-472c-be52-843a85917e91 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:47.467176 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-058aa919-455e-472c-be52-843a85917e91 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:48.189376 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8a46b7a4-3797-4c18-8500-c83fd1df25f3 tempest-ImagesMetadataTestJSON-297427433 tempest-ImagesMetadataTestJSON-297427433-project] 10.222.0.17 "DELETE /compute/v2.1/images/5dceed05-fb65-4806-89a1-17ab50a04465/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.828749 Jul 23 21:21:48.191613 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 982/1976] 10.222.0.17 () {58 vars in 1295 bytes} [Sat Jul 23 21:21:47 2022] DELETE /compute/v2.1/images/5dceed05-fb65-4806-89a1-17ab50a04465/metadata/os_version => generated 0 bytes in 832 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:21:48.208631 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-314cf4f6-da06-44f6-bf53-465c1e418c29 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '.version_select at 0x7f0b59969c10>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:48.218444 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-058aa919-455e-472c-be52-843a85917e91 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '672d90d732a0419ca669e0055359dcfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d87ea887fea457fb07731d47de68333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:21:48.228625 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-058aa919-455e-472c-be52-843a85917e91 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] 10.222.0.17 "GET /compute/v2.1/servers/2cebd0e1-09ca-4eab-bda7-0743043bad23" status: 200 len: 1332 microversion: 2.1 time: 0.794272 Jul 23 21:21:48.234141 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 995/1977] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:21:47 2022] GET /compute/v2.1/servers/2cebd0e1-09ca-4eab-bda7-0743043bad23 => generated 1332 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:21:48.243490 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-afaf2085-77df-47a1-beca-b6ad63d7c25b tempest-ImagesMetadataTestJSON-297427433 tempest-ImagesMetadataTestJSON-297427433-project] Calling method '.version_select at 0x7f0b5991eb80>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:48.387290 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-afaf2085-77df-47a1-beca-b6ad63d7c25b tempest-ImagesMetadataTestJSON-297427433 tempest-ImagesMetadataTestJSON-297427433-project] 10.222.0.17 "GET /compute/v2.1/images/5dceed05-fb65-4806-89a1-17ab50a04465/metadata" status: 200 len: 37 microversion: 2.1 time: 0.151722 Jul 23 21:21:48.388186 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 996/1978] 10.222.0.17 () {58 vars in 1259 bytes} [Sat Jul 23 21:21:48 2022] GET /compute/v2.1/images/5dceed05-fb65-4806-89a1-17ab50a04465/metadata => generated 37 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 23 21:21:48.398280 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ea4caaf4-21af-43c2-9eeb-93e4905ae183 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:48.398872 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-ea4caaf4-21af-43c2-9eeb-93e4905ae183 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] [instance: a213ec70-d903-4ce2-a577-64b4dacf9c1e] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:21:48.399338 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-314cf4f6-da06-44f6-bf53-465c1e418c29 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/images/ee136f2b-cfa9-44cf-899c-7795cf98e798" status: 200 len: 1453 microversion: 2.1 time: 0.201134 Jul 23 21:21:48.403912 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 983/1979] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:21:48 2022] GET /compute/v2.1/images/ee136f2b-cfa9-44cf-899c-7795cf98e798 => generated 1453 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:21:48.430171 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ea4caaf4-21af-43c2-9eeb-93e4905ae183 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:48.432933 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ea4caaf4-21af-43c2-9eeb-93e4905ae183 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:48.437881 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ea4caaf4-21af-43c2-9eeb-93e4905ae183 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:48.438639 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ea4caaf4-21af-43c2-9eeb-93e4905ae183 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:48.439866 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9fdad6b4-f455-4392-9684-eeb1f3459042 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:48.446376 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-9fdad6b4-f455-4392-9684-eeb1f3459042 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] [instance: 53347323-4870-4526-9020-1a3bc821d3fb] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:21:48.473914 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9fdad6b4-f455-4392-9684-eeb1f3459042 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:48.491010 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9fdad6b4-f455-4392-9684-eeb1f3459042 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:48.496582 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9fdad6b4-f455-4392-9684-eeb1f3459042 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:48.497497 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9fdad6b4-f455-4392-9684-eeb1f3459042 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:48.512703 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell0:SELECT=2 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:21:48.581932 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell0:SELECT=6 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:21:49.035509 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ea4caaf4-21af-43c2-9eeb-93e4905ae183 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7acc7eae5f946aaac9f0c8ead2c8d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e0f76ca9b734142a90c27f3d3de3a85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:21:49.091846 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-ea4caaf4-21af-43c2-9eeb-93e4905ae183 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] 10.222.0.17 "GET /compute/v2.1/servers/a213ec70-d903-4ce2-a577-64b4dacf9c1e" status: 200 len: 1321 microversion: 2.1 time: 0.697684 Jul 23 21:21:49.095795 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 997/1980] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:21:48 2022] GET /compute/v2.1/servers/a213ec70-d903-4ce2-a577-64b4dacf9c1e => generated 1321 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:21:49.116520 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-b139710b-014e-42f8-9951-3f6aa5a5a4bd tempest-ImagesMetadataTestJSON-297427433 tempest-ImagesMetadataTestJSON-297427433-project] Action: 'update_all', calling method: .version_select at 0x7f0b5991eca0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:21:49.215611 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-b139710b-014e-42f8-9951-3f6aa5a5a4bd tempest-ImagesMetadataTestJSON-297427433 tempest-ImagesMetadataTestJSON-297427433-project] Getting quotas for project fa88d37bfb314835bd592d638db11360. Resources: dict_keys(['metadata_items']) {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:21:49.234854 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-b139710b-014e-42f8-9951-3f6aa5a5a4bd tempest-ImagesMetadataTestJSON-297427433 tempest-ImagesMetadataTestJSON-297427433-project] Getting quotas for user 22f9f9332aad483281c34422d83ba2fc and project fa88d37bfb314835bd592d638db11360. Resources: dict_keys(['metadata_items']) {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:21:49.447325 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-9fdad6b4-f455-4392-9684-eeb1f3459042 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf93a4b80cb4e19a36473986950fc75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c1943188684b45b636541caf587247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:21:49.456759 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9fdad6b4-f455-4392-9684-eeb1f3459042 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] 10.222.0.17 "GET /compute/v2.1/servers/53347323-4870-4526-9020-1a3bc821d3fb" status: 200 len: 1313 microversion: 2.1 time: 1.051696 Jul 23 21:21:49.470567 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 984/1981] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:21:48 2022] GET /compute/v2.1/servers/53347323-4870-4526-9020-1a3bc821d3fb => generated 1313 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:21:49.482659 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-5f33c2c3-55b3-405a-bcfd-6664a5f858e0 req-473d330d-6bf2-4ebe-be49-5103c7429859 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53347323-4870-4526-9020-1a3bc821d3fb", "tag": "72be27c3-d279-4821-adcd-249529e1fbe0"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:21:49.507618 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-5f33c2c3-55b3-405a-bcfd-6664a5f858e0 req-473d330d-6bf2-4ebe-be49-5103c7429859 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:49.508309 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-5f33c2c3-55b3-405a-bcfd-6664a5f858e0 req-473d330d-6bf2-4ebe-be49-5103c7429859 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:49.527823 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-5f33c2c3-55b3-405a-bcfd-6664a5f858e0 req-473d330d-6bf2-4ebe-be49-5103c7429859 service nova] Creating event network-changed:72be27c3-d279-4821-adcd-249529e1fbe0 for instance 53347323-4870-4526-9020-1a3bc821d3fb on nch1-master-1 Jul 23 21:21:49.536099 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-5f33c2c3-55b3-405a-bcfd-6664a5f858e0 req-473d330d-6bf2-4ebe-be49-5103c7429859 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063754 Jul 23 21:21:49.537552 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 985/1982] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:21:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:21:49.543317 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-32d0bebb-d8f1-4cbf-b20b-38310bb175e6 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:49.548946 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-32d0bebb-d8f1-4cbf-b20b-38310bb175e6 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] [instance: 2cebd0e1-09ca-4eab-bda7-0743043bad23] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:21:49.564075 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-32d0bebb-d8f1-4cbf-b20b-38310bb175e6 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:49.565584 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-32d0bebb-d8f1-4cbf-b20b-38310bb175e6 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:49.568073 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-32d0bebb-d8f1-4cbf-b20b-38310bb175e6 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:49.568530 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-32d0bebb-d8f1-4cbf-b20b-38310bb175e6 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:50.251445 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-b139710b-014e-42f8-9951-3f6aa5a5a4bd tempest-ImagesMetadataTestJSON-297427433 tempest-ImagesMetadataTestJSON-297427433-project] 10.222.0.17 "PUT /compute/v2.1/images/5dceed05-fb65-4806-89a1-17ab50a04465/metadata" status: 200 len: 61 microversion: 2.1 time: 1.154302 Jul 23 21:21:50.252921 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 998/1983] 10.222.0.17 () {60 vars in 1279 bytes} [Sat Jul 23 21:21:49 2022] PUT /compute/v2.1/images/5dceed05-fb65-4806-89a1-17ab50a04465/metadata => generated 61 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 23 21:21:50.258966 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-fd1d407f-eb86-4a05-96ce-d978a757aa27 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '.version_select at 0x7f0b5415dc10>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:50.344090 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-fd1d407f-eb86-4a05-96ce-d978a757aa27 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/images/ee136f2b-cfa9-44cf-899c-7795cf98e798" status: 200 len: 1453 microversion: 2.1 time: 0.089839 Jul 23 21:21:50.344776 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 999/1984] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:21:50 2022] GET /compute/v2.1/images/ee136f2b-cfa9-44cf-899c-7795cf98e798 => generated 1453 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:21:50.351571 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-1c06361b-3c52-43db-ad32-6f99ed0f85e1 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:50.352192 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-1c06361b-3c52-43db-ad32-6f99ed0f85e1 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] [instance: a213ec70-d903-4ce2-a577-64b4dacf9c1e] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:21:50.373490 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1c06361b-3c52-43db-ad32-6f99ed0f85e1 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:50.374819 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1c06361b-3c52-43db-ad32-6f99ed0f85e1 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:50.378558 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1c06361b-3c52-43db-ad32-6f99ed0f85e1 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:50.379978 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1c06361b-3c52-43db-ad32-6f99ed0f85e1 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:50.868930 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-1c06361b-3c52-43db-ad32-6f99ed0f85e1 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7acc7eae5f946aaac9f0c8ead2c8d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e0f76ca9b734142a90c27f3d3de3a85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:21:50.879260 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-1c06361b-3c52-43db-ad32-6f99ed0f85e1 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] 10.222.0.17 "GET /compute/v2.1/servers/a213ec70-d903-4ce2-a577-64b4dacf9c1e" status: 200 len: 1321 microversion: 2.1 time: 0.533234 Jul 23 21:21:50.879859 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1000/1985] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:21:50 2022] GET /compute/v2.1/servers/a213ec70-d903-4ce2-a577-64b4dacf9c1e => generated 1321 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:21:50.902857 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-5b4fd9f3-ea89-42b8-830f-e3ea86685887 tempest-ImagesMetadataTestJSON-297427433 tempest-ImagesMetadataTestJSON-297427433-project] Calling method '.version_select at 0x7f0b5998cdc0>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:50.988118 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-5b4fd9f3-ea89-42b8-830f-e3ea86685887 tempest-ImagesMetadataTestJSON-297427433 tempest-ImagesMetadataTestJSON-297427433-project] 10.222.0.17 "GET /compute/v2.1/images/5dceed05-fb65-4806-89a1-17ab50a04465/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.091636 Jul 23 21:21:50.988867 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1001/1986] 10.222.0.17 () {58 vars in 1289 bytes} [Sat Jul 23 21:21:50 2022] GET /compute/v2.1/images/5dceed05-fb65-4806-89a1-17ab50a04465/metadata/os_distro => generated 33 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 23 21:21:51.007874 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-1112a9f4-4886-4cc7-9cb8-7715f32fc073 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:51.011801 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-1112a9f4-4886-4cc7-9cb8-7715f32fc073 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] [instance: 53347323-4870-4526-9020-1a3bc821d3fb] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:21:51.030339 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1112a9f4-4886-4cc7-9cb8-7715f32fc073 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:51.033747 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1112a9f4-4886-4cc7-9cb8-7715f32fc073 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:51.034930 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1112a9f4-4886-4cc7-9cb8-7715f32fc073 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:51.040934 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1112a9f4-4886-4cc7-9cb8-7715f32fc073 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:51.340496 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-32d0bebb-d8f1-4cbf-b20b-38310bb175e6 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '672d90d732a0419ca669e0055359dcfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d87ea887fea457fb07731d47de68333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:21:51.352855 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-32d0bebb-d8f1-4cbf-b20b-38310bb175e6 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] 10.222.0.17 "GET /compute/v2.1/servers/2cebd0e1-09ca-4eab-bda7-0743043bad23" status: 200 len: 1332 microversion: 2.1 time: 1.813491 Jul 23 21:21:51.353466 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 986/1987] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:21:49 2022] GET /compute/v2.1/servers/2cebd0e1-09ca-4eab-bda7-0743043bad23 => generated 1332 bytes in 1815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:21:51.366216 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a4aa049c-7cab-46c1-b06b-01ae152efbe0 tempest-ImagesMetadataTestJSON-297427433 tempest-ImagesMetadataTestJSON-297427433-project] Action: 'update_all', calling method: .version_select at 0x7f0b5991af70>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:21:51.459179 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=23 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:21:51.464201 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-a4aa049c-7cab-46c1-b06b-01ae152efbe0 tempest-ImagesMetadataTestJSON-297427433 tempest-ImagesMetadataTestJSON-297427433-project] Getting quotas for project fa88d37bfb314835bd592d638db11360. Resources: dict_keys(['metadata_items']) {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:21:51.480242 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-a4aa049c-7cab-46c1-b06b-01ae152efbe0 tempest-ImagesMetadataTestJSON-297427433 tempest-ImagesMetadataTestJSON-297427433-project] Getting quotas for user 22f9f9332aad483281c34422d83ba2fc and project fa88d37bfb314835bd592d638db11360. Resources: dict_keys(['metadata_items']) {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:21:52.010309 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a4aa049c-7cab-46c1-b06b-01ae152efbe0 tempest-ImagesMetadataTestJSON-297427433 tempest-ImagesMetadataTestJSON-297427433-project] 10.222.0.17 "PUT /compute/v2.1/images/5dceed05-fb65-4806-89a1-17ab50a04465/metadata" status: 200 len: 61 microversion: 2.1 time: 0.654595 Jul 23 21:21:52.011207 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 987/1988] 10.222.0.17 () {60 vars in 1279 bytes} [Sat Jul 23 21:21:51 2022] PUT /compute/v2.1/images/5dceed05-fb65-4806-89a1-17ab50a04465/metadata => generated 61 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 23 21:21:52.015974 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c7da719f-9758-489f-87bb-6d71de1f5fbd tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '.version_select at 0x7f0b598adaf0>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:52.106259 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c7da719f-9758-489f-87bb-6d71de1f5fbd tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/images/ee136f2b-cfa9-44cf-899c-7795cf98e798" status: 200 len: 1453 microversion: 2.1 time: 0.093381 Jul 23 21:21:52.106869 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 988/1989] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:21:52 2022] GET /compute/v2.1/images/ee136f2b-cfa9-44cf-899c-7795cf98e798 => generated 1453 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:21:52.117232 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-b104bf5a-504b-4239-8c2f-11bdcb4d302f req-4550b226-4aa1-41d8-af8d-ac9a2134e1db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a213ec70-d903-4ce2-a577-64b4dacf9c1e", "tag": "254c2ec1-d06c-47b7-a65c-fb1c7e84b4a8"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:21:52.137960 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-b104bf5a-504b-4239-8c2f-11bdcb4d302f req-4550b226-4aa1-41d8-af8d-ac9a2134e1db service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:52.138457 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-b104bf5a-504b-4239-8c2f-11bdcb4d302f req-4550b226-4aa1-41d8-af8d-ac9a2134e1db service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:52.167276 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-b104bf5a-504b-4239-8c2f-11bdcb4d302f req-4550b226-4aa1-41d8-af8d-ac9a2134e1db service nova] Creating event network-changed:254c2ec1-d06c-47b7-a65c-fb1c7e84b4a8 for instance a213ec70-d903-4ce2-a577-64b4dacf9c1e on nch2-master-1 Jul 23 21:21:52.180345 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-b104bf5a-504b-4239-8c2f-11bdcb4d302f req-4550b226-4aa1-41d8-af8d-ac9a2134e1db service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071983 Jul 23 21:21:52.181713 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 989/1990] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:21:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:21:52.210919 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-1112a9f4-4886-4cc7-9cb8-7715f32fc073 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf93a4b80cb4e19a36473986950fc75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c1943188684b45b636541caf587247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:21:52.223304 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-1112a9f4-4886-4cc7-9cb8-7715f32fc073 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] 10.222.0.17 "GET /compute/v2.1/servers/53347323-4870-4526-9020-1a3bc821d3fb" status: 200 len: 1313 microversion: 2.1 time: 1.225284 Jul 23 21:21:52.234854 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1002/1991] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:21:50 2022] GET /compute/v2.1/servers/53347323-4870-4526-9020-1a3bc821d3fb => generated 1313 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:21:52.242862 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e097c6bd-a5a8-4779-9614-5a2c5e6f6a13 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:52.243479 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-e097c6bd-a5a8-4779-9614-5a2c5e6f6a13 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] [instance: a213ec70-d903-4ce2-a577-64b4dacf9c1e] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:21:52.260396 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e097c6bd-a5a8-4779-9614-5a2c5e6f6a13 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:52.260935 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e097c6bd-a5a8-4779-9614-5a2c5e6f6a13 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:52.261642 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e097c6bd-a5a8-4779-9614-5a2c5e6f6a13 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:52.262119 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e097c6bd-a5a8-4779-9614-5a2c5e6f6a13 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:52.586513 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2e66f981-8473-4ea8-bd46-b927c941c89d tempest-AbsoluteLimitsTestJSON-292613311 tempest-AbsoluteLimitsTestJSON-292613311-project] Calling method '.version_select at 0x7f0b599794c0>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:52.602554 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2e66f981-8473-4ea8-bd46-b927c941c89d tempest-AbsoluteLimitsTestJSON-292613311 tempest-AbsoluteLimitsTestJSON-292613311-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:52.607326 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2e66f981-8473-4ea8-bd46-b927c941c89d tempest-AbsoluteLimitsTestJSON-292613311 tempest-AbsoluteLimitsTestJSON-292613311-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:52.614596 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2e66f981-8473-4ea8-bd46-b927c941c89d tempest-AbsoluteLimitsTestJSON-292613311 tempest-AbsoluteLimitsTestJSON-292613311-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:52.615545 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2e66f981-8473-4ea8-bd46-b927c941c89d tempest-AbsoluteLimitsTestJSON-292613311 tempest-AbsoluteLimitsTestJSON-292613311-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:52.665552 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2e66f981-8473-4ea8-bd46-b927c941c89d tempest-AbsoluteLimitsTestJSON-292613311 tempest-AbsoluteLimitsTestJSON-292613311-project] 10.222.0.17 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.476902 Jul 23 21:21:52.668762 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 990/1992] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:21:52 2022] GET /compute/v2.1/limits => generated 511 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:21:52.679249 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5577a6b7-8d8d-41a2-87e7-a8c44dd49f97 tempest-ImagesMetadataTestJSON-297427433 tempest-ImagesMetadataTestJSON-297427433-project] Calling method '.version_select at 0x7f0b598efc10>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:52.740944 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5577a6b7-8d8d-41a2-87e7-a8c44dd49f97 tempest-ImagesMetadataTestJSON-297427433 tempest-ImagesMetadataTestJSON-297427433-project] 10.222.0.17 "GET /compute/v2.1/images/5dceed05-fb65-4806-89a1-17ab50a04465/metadata" status: 200 len: 61 microversion: 2.1 time: 0.070219 Jul 23 21:21:52.741694 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 991/1993] 10.222.0.17 () {58 vars in 1259 bytes} [Sat Jul 23 21:21:52 2022] GET /compute/v2.1/images/5dceed05-fb65-4806-89a1-17ab50a04465/metadata => generated 61 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 23 21:21:52.758199 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-fdd81783-51a9-4f79-b05c-76c8f70b9be4 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:52.761837 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-fdd81783-51a9-4f79-b05c-76c8f70b9be4 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] [instance: 2cebd0e1-09ca-4eab-bda7-0743043bad23] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:21:52.780911 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fdd81783-51a9-4f79-b05c-76c8f70b9be4 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:52.784997 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fdd81783-51a9-4f79-b05c-76c8f70b9be4 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:52.787354 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fdd81783-51a9-4f79-b05c-76c8f70b9be4 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:52.790020 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fdd81783-51a9-4f79-b05c-76c8f70b9be4 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:52.956759 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-e097c6bd-a5a8-4779-9614-5a2c5e6f6a13 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7acc7eae5f946aaac9f0c8ead2c8d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e0f76ca9b734142a90c27f3d3de3a85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:21:52.976377 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-e097c6bd-a5a8-4779-9614-5a2c5e6f6a13 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] 10.222.0.17 "GET /compute/v2.1/servers/a213ec70-d903-4ce2-a577-64b4dacf9c1e" status: 200 len: 1321 microversion: 2.1 time: 0.738700 Jul 23 21:21:52.982933 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1003/1994] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:21:52 2022] GET /compute/v2.1/servers/a213ec70-d903-4ce2-a577-64b4dacf9c1e => generated 1321 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:21:53.003228 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-14039ef6-8c38-4cee-a34e-a5bbfd5c7dc4 tempest-ImagesMetadataTestJSON-297427433 tempest-ImagesMetadataTestJSON-297427433-project] Action: 'update_all', calling method: .version_select at 0x7f0b5998cdc0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:21:53.112446 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-14039ef6-8c38-4cee-a34e-a5bbfd5c7dc4 tempest-ImagesMetadataTestJSON-297427433 tempest-ImagesMetadataTestJSON-297427433-project] Getting quotas for project fa88d37bfb314835bd592d638db11360. Resources: dict_keys(['metadata_items']) {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:21:53.136970 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-14039ef6-8c38-4cee-a34e-a5bbfd5c7dc4 tempest-ImagesMetadataTestJSON-297427433 tempest-ImagesMetadataTestJSON-297427433-project] Getting quotas for user 22f9f9332aad483281c34422d83ba2fc and project fa88d37bfb314835bd592d638db11360. Resources: dict_keys(['metadata_items']) {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:21:53.191877 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-fdd81783-51a9-4f79-b05c-76c8f70b9be4 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '672d90d732a0419ca669e0055359dcfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d87ea887fea457fb07731d47de68333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:21:53.202987 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-fdd81783-51a9-4f79-b05c-76c8f70b9be4 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] 10.222.0.17 "GET /compute/v2.1/servers/2cebd0e1-09ca-4eab-bda7-0743043bad23" status: 200 len: 1332 microversion: 2.1 time: 0.459432 Jul 23 21:21:53.204446 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 992/1995] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:21:52 2022] GET /compute/v2.1/servers/2cebd0e1-09ca-4eab-bda7-0743043bad23 => generated 1332 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:21:53.210807 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2025c91c-e623-42bd-8722-868fe18ff0bc tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '.version_select at 0x7f0b59910dc0>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:53.342922 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2025c91c-e623-42bd-8722-868fe18ff0bc tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/images/ee136f2b-cfa9-44cf-899c-7795cf98e798" status: 200 len: 1453 microversion: 2.1 time: 0.137015 Jul 23 21:21:53.353255 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 993/1996] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:21:53 2022] GET /compute/v2.1/images/ee136f2b-cfa9-44cf-899c-7795cf98e798 => generated 1453 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:21:53.374616 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b99e882b-b00c-4d99-9328-c6a9548b035c tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:53.378704 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b99e882b-b00c-4d99-9328-c6a9548b035c tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] [instance: 53347323-4870-4526-9020-1a3bc821d3fb] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:21:53.392022 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b99e882b-b00c-4d99-9328-c6a9548b035c tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:53.392681 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b99e882b-b00c-4d99-9328-c6a9548b035c tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:53.393633 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b99e882b-b00c-4d99-9328-c6a9548b035c tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:53.394285 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b99e882b-b00c-4d99-9328-c6a9548b035c tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:53.861803 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-14039ef6-8c38-4cee-a34e-a5bbfd5c7dc4 tempest-ImagesMetadataTestJSON-297427433 tempest-ImagesMetadataTestJSON-297427433-project] 10.222.0.17 "PUT /compute/v2.1/images/5dceed05-fb65-4806-89a1-17ab50a04465/metadata" status: 200 len: 61 microversion: 2.1 time: 0.877100 Jul 23 21:21:53.863038 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1004/1997] 10.222.0.17 () {60 vars in 1279 bytes} [Sat Jul 23 21:21:52 2022] PUT /compute/v2.1/images/5dceed05-fb65-4806-89a1-17ab50a04465/metadata => generated 61 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 23 21:21:53.871940 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-2a89c825-6501-44d7-b1f2-3f4a5b99b28d tempest-ImagesMetadataTestJSON-297427433 tempest-ImagesMetadataTestJSON-297427433-project] Action: 'update_all', calling method: .version_select at 0x7f0b4760a280>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:21:53.961143 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-2a89c825-6501-44d7-b1f2-3f4a5b99b28d tempest-ImagesMetadataTestJSON-297427433 tempest-ImagesMetadataTestJSON-297427433-project] Getting quotas for project fa88d37bfb314835bd592d638db11360. Resources: dict_keys(['metadata_items']) {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:21:53.974875 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-2a89c825-6501-44d7-b1f2-3f4a5b99b28d tempest-ImagesMetadataTestJSON-297427433 tempest-ImagesMetadataTestJSON-297427433-project] Getting quotas for user 22f9f9332aad483281c34422d83ba2fc and project fa88d37bfb314835bd592d638db11360. Resources: dict_keys(['metadata_items']) {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:21:54.012384 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:21:54.397876 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b99e882b-b00c-4d99-9328-c6a9548b035c tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf93a4b80cb4e19a36473986950fc75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c1943188684b45b636541caf587247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:21:54.411185 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b99e882b-b00c-4d99-9328-c6a9548b035c tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] 10.222.0.17 "GET /compute/v2.1/servers/53347323-4870-4526-9020-1a3bc821d3fb" status: 200 len: 1313 microversion: 2.1 time: 1.055853 Jul 23 21:21:54.411871 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 994/1998] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:21:53 2022] GET /compute/v2.1/servers/53347323-4870-4526-9020-1a3bc821d3fb => generated 1313 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:21:54.443516 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-76e2cd38-2c1d-4e32-a656-c693eeb76f64 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:54.445824 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-76e2cd38-2c1d-4e32-a656-c693eeb76f64 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] [instance: a213ec70-d903-4ce2-a577-64b4dacf9c1e] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:21:54.463114 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-76e2cd38-2c1d-4e32-a656-c693eeb76f64 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:54.463850 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-76e2cd38-2c1d-4e32-a656-c693eeb76f64 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:54.464698 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-76e2cd38-2c1d-4e32-a656-c693eeb76f64 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:54.465151 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-76e2cd38-2c1d-4e32-a656-c693eeb76f64 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:54.618785 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-2a89c825-6501-44d7-b1f2-3f4a5b99b28d tempest-ImagesMetadataTestJSON-297427433 tempest-ImagesMetadataTestJSON-297427433-project] 10.222.0.17 "PUT /compute/v2.1/images/5dceed05-fb65-4806-89a1-17ab50a04465/metadata" status: 200 len: 64 microversion: 2.1 time: 0.750573 Jul 23 21:21:54.620211 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1005/1999] 10.222.0.17 () {60 vars in 1279 bytes} [Sat Jul 23 21:21:53 2022] PUT /compute/v2.1/images/5dceed05-fb65-4806-89a1-17ab50a04465/metadata => generated 64 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 23 21:21:54.625678 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-88afdc6f-9390-443b-a93d-a31a77876e30 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:54.626507 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-88afdc6f-9390-443b-a93d-a31a77876e30 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] [instance: 2cebd0e1-09ca-4eab-bda7-0743043bad23] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:21:54.641741 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-88afdc6f-9390-443b-a93d-a31a77876e30 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:54.642581 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-88afdc6f-9390-443b-a93d-a31a77876e30 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:54.643682 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-88afdc6f-9390-443b-a93d-a31a77876e30 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:54.644342 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-88afdc6f-9390-443b-a93d-a31a77876e30 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:54.860028 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-88afdc6f-9390-443b-a93d-a31a77876e30 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '672d90d732a0419ca669e0055359dcfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d87ea887fea457fb07731d47de68333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:21:54.876303 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-88afdc6f-9390-443b-a93d-a31a77876e30 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] 10.222.0.17 "GET /compute/v2.1/servers/2cebd0e1-09ca-4eab-bda7-0743043bad23" status: 200 len: 1332 microversion: 2.1 time: 0.254706 Jul 23 21:21:54.886209 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1006/2000] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:21:54 2022] GET /compute/v2.1/servers/2cebd0e1-09ca-4eab-bda7-0743043bad23 => generated 1332 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:21:54.901627 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-76e2cd38-2c1d-4e32-a656-c693eeb76f64 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7acc7eae5f946aaac9f0c8ead2c8d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e0f76ca9b734142a90c27f3d3de3a85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:21:54.917143 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-76e2cd38-2c1d-4e32-a656-c693eeb76f64 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] 10.222.0.17 "GET /compute/v2.1/servers/a213ec70-d903-4ce2-a577-64b4dacf9c1e" status: 200 len: 1321 microversion: 2.1 time: 0.498060 Jul 23 21:21:54.917809 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 995/2001] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:21:54 2022] GET /compute/v2.1/servers/a213ec70-d903-4ce2-a577-64b4dacf9c1e => generated 1321 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:21:54.922847 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-13438580-81b6-45d1-81ca-d989b3902fc6 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '.version_select at 0x7f0b59969d30>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:55.006685 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-13438580-81b6-45d1-81ca-d989b3902fc6 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/images/ee136f2b-cfa9-44cf-899c-7795cf98e798" status: 200 len: 1453 microversion: 2.1 time: 0.087517 Jul 23 21:21:55.012897 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 996/2002] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:21:54 2022] GET /compute/v2.1/images/ee136f2b-cfa9-44cf-899c-7795cf98e798 => generated 1453 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:21:55.020565 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-4c2f4396-5eff-423d-8a82-f70fca381846 req-56e3b447-a663-4307-922e-8900bddec72c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cebd0e1-09ca-4eab-bda7-0743043bad23", "name": "network-vif-plugged", "status": "completed", "tag": "d506fd59-3dd8-47d3-b895-177dd8661556"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:21:55.040493 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-4c2f4396-5eff-423d-8a82-f70fca381846 req-56e3b447-a663-4307-922e-8900bddec72c service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:55.041406 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-4c2f4396-5eff-423d-8a82-f70fca381846 req-56e3b447-a663-4307-922e-8900bddec72c service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:55.056448 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-4c2f4396-5eff-423d-8a82-f70fca381846 req-56e3b447-a663-4307-922e-8900bddec72c service nova] Creating event network-vif-plugged:d506fd59-3dd8-47d3-b895-177dd8661556 for instance 2cebd0e1-09ca-4eab-bda7-0743043bad23 on nch2-master-1 Jul 23 21:21:55.065681 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-4c2f4396-5eff-423d-8a82-f70fca381846 req-56e3b447-a663-4307-922e-8900bddec72c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051131 Jul 23 21:21:55.104932 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 997/2003] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:21:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:21:55.122182 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-22b36748-3487-412a-be71-0b01466d85ad tempest-ImagesMetadataTestJSON-297427433 tempest-ImagesMetadataTestJSON-297427433-project] Calling method '.version_select at 0x7f0b59925160>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:55.190700 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-208cd232-0dac-443d-a0f3-026e11518231 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Action: 'create', calling method: .version_select at 0x7f0b4760a9d0>, body: {"keypair": {"name": "tempest-keypair-157589584", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJDlAOOeTNR9GTHygyp61ZHuS5580KAOM5LNbNzy4X3ZR+YL/EgbqpCm92riL0asOvvQ6z1TCkzyCi7Uwnmdyy7tN7PHgem4DHfO+njnvYrcHSkTnsGvhss+t+DkuUCEaw=="}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:21:55.204293 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-22b36748-3487-412a-be71-0b01466d85ad tempest-ImagesMetadataTestJSON-297427433 tempest-ImagesMetadataTestJSON-297427433-project] 10.222.0.17 "GET /compute/v2.1/images/5dceed05-fb65-4806-89a1-17ab50a04465/metadata" status: 200 len: 64 microversion: 2.1 time: 0.092106 Jul 23 21:21:55.209135 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 998/2004] 10.222.0.17 () {58 vars in 1259 bytes} [Sat Jul 23 21:21:55 2022] GET /compute/v2.1/images/5dceed05-fb65-4806-89a1-17ab50a04465/metadata => generated 64 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 23 21:21:55.229397 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-418b6aac-41d7-48a4-850a-215781d91907 tempest-ImagesMetadataTestJSON-297427433 tempest-ImagesMetadataTestJSON-297427433-project] Action: 'update_all', calling method: .version_select at 0x7f0b599cfe50>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:21:55.245297 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-208cd232-0dac-443d-a0f3-026e11518231 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Getting quotas for project 01cd9b8837554b8daf506ca062ec916b. Resources: {'key_pairs'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:21:55.258021 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-208cd232-0dac-443d-a0f3-026e11518231 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Getting quotas for user efc72b47672e46659b1a5ebdfd99224c and project 01cd9b8837554b8daf506ca062ec916b. Resources: {'key_pairs'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:21:55.328351 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-208cd232-0dac-443d-a0f3-026e11518231 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.441062 Jul 23 21:21:55.329915 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1007/2005] 10.222.0.17 () {60 vars in 1158 bytes} [Sat Jul 23 21:21:54 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:21:55.346547 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-418b6aac-41d7-48a4-850a-215781d91907 tempest-ImagesMetadataTestJSON-297427433 tempest-ImagesMetadataTestJSON-297427433-project] Getting quotas for project fa88d37bfb314835bd592d638db11360. Resources: dict_keys(['metadata_items']) {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:21:55.378837 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-418b6aac-41d7-48a4-850a-215781d91907 tempest-ImagesMetadataTestJSON-297427433 tempest-ImagesMetadataTestJSON-297427433-project] Getting quotas for user 22f9f9332aad483281c34422d83ba2fc and project fa88d37bfb314835bd592d638db11360. Resources: dict_keys(['metadata_items']) {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:21:55.427877 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-0e8aa64f-b1e1-4a9e-8417-66f2040207d5 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:55.428694 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-0e8aa64f-b1e1-4a9e-8417-66f2040207d5 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] [instance: 53347323-4870-4526-9020-1a3bc821d3fb] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:21:55.438783 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0e8aa64f-b1e1-4a9e-8417-66f2040207d5 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:55.447709 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0e8aa64f-b1e1-4a9e-8417-66f2040207d5 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:55.448580 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0e8aa64f-b1e1-4a9e-8417-66f2040207d5 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:55.449021 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0e8aa64f-b1e1-4a9e-8417-66f2040207d5 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:55.907258 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-0e8aa64f-b1e1-4a9e-8417-66f2040207d5 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf93a4b80cb4e19a36473986950fc75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c1943188684b45b636541caf587247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:21:55.916537 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-0e8aa64f-b1e1-4a9e-8417-66f2040207d5 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] 10.222.0.17 "GET /compute/v2.1/servers/53347323-4870-4526-9020-1a3bc821d3fb" status: 200 len: 1313 microversion: 2.1 time: 0.492427 Jul 23 21:21:55.922516 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1008/2006] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:21:55 2022] GET /compute/v2.1/servers/53347323-4870-4526-9020-1a3bc821d3fb => generated 1313 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:21:55.932043 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-bde54d10-53c7-4ecd-851a-016401bdbf7b tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:55.935635 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-bde54d10-53c7-4ecd-851a-016401bdbf7b tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] [instance: 2cebd0e1-09ca-4eab-bda7-0743043bad23] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:21:55.960214 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bde54d10-53c7-4ecd-851a-016401bdbf7b tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:55.961121 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bde54d10-53c7-4ecd-851a-016401bdbf7b tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:55.962279 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bde54d10-53c7-4ecd-851a-016401bdbf7b tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:55.962896 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bde54d10-53c7-4ecd-851a-016401bdbf7b tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:56.094343 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-418b6aac-41d7-48a4-850a-215781d91907 tempest-ImagesMetadataTestJSON-297427433 tempest-ImagesMetadataTestJSON-297427433-project] 10.222.0.17 "PUT /compute/v2.1/images/5dceed05-fb65-4806-89a1-17ab50a04465/metadata" status: 200 len: 61 microversion: 2.1 time: 0.872970 Jul 23 21:21:56.096119 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 999/2007] 10.222.0.17 () {60 vars in 1279 bytes} [Sat Jul 23 21:21:55 2022] PUT /compute/v2.1/images/5dceed05-fb65-4806-89a1-17ab50a04465/metadata => generated 61 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 23 21:21:56.106593 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a58736c3-9b50-440a-8fb4-782ff1ec2d58 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:56.108933 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a58736c3-9b50-440a-8fb4-782ff1ec2d58 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] [instance: a213ec70-d903-4ce2-a577-64b4dacf9c1e] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:21:56.126033 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a58736c3-9b50-440a-8fb4-782ff1ec2d58 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:56.126704 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a58736c3-9b50-440a-8fb4-782ff1ec2d58 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:56.127731 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a58736c3-9b50-440a-8fb4-782ff1ec2d58 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:56.128454 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a58736c3-9b50-440a-8fb4-782ff1ec2d58 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:56.368501 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-bde54d10-53c7-4ecd-851a-016401bdbf7b tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '672d90d732a0419ca669e0055359dcfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d87ea887fea457fb07731d47de68333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:21:56.380568 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-bde54d10-53c7-4ecd-851a-016401bdbf7b tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] 10.222.0.17 "GET /compute/v2.1/servers/2cebd0e1-09ca-4eab-bda7-0743043bad23" status: 200 len: 1332 microversion: 2.1 time: 0.456623 Jul 23 21:21:56.381622 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1009/2008] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:21:55 2022] GET /compute/v2.1/servers/2cebd0e1-09ca-4eab-bda7-0743043bad23 => generated 1332 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:21:56.387857 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e09441b9-4960-4505-91d9-8a1043bce311 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '.version_select at 0x7f0b47637040>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:56.472706 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-e09441b9-4960-4505-91d9-8a1043bce311 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/images/ee136f2b-cfa9-44cf-899c-7795cf98e798" status: 200 len: 1453 microversion: 2.1 time: 0.088934 Jul 23 21:21:56.473805 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1010/2009] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:21:56 2022] GET /compute/v2.1/images/ee136f2b-cfa9-44cf-899c-7795cf98e798 => generated 1453 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:21:56.484410 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-cc78d812-d2c5-4f25-82f7-34703f1ef4d5 tempest-ImagesMetadataTestJSON-297427433 tempest-ImagesMetadataTestJSON-297427433-project] Action: 'update', calling method: .version_select at 0x7f0b47603310>, body: {"meta": {"os_version": "alt"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:21:56.509691 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a58736c3-9b50-440a-8fb4-782ff1ec2d58 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7acc7eae5f946aaac9f0c8ead2c8d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e0f76ca9b734142a90c27f3d3de3a85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:21:56.521450 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a58736c3-9b50-440a-8fb4-782ff1ec2d58 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] 10.222.0.17 "GET /compute/v2.1/servers/a213ec70-d903-4ce2-a577-64b4dacf9c1e" status: 200 len: 1321 microversion: 2.1 time: 0.423982 Jul 23 21:21:56.523385 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1000/2010] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:21:56 2022] GET /compute/v2.1/servers/a213ec70-d903-4ce2-a577-64b4dacf9c1e => generated 1321 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:21:56.578155 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-cc78d812-d2c5-4f25-82f7-34703f1ef4d5 tempest-ImagesMetadataTestJSON-297427433 tempest-ImagesMetadataTestJSON-297427433-project] Getting quotas for project fa88d37bfb314835bd592d638db11360. Resources: dict_keys(['metadata_items']) {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:21:56.597012 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-cc78d812-d2c5-4f25-82f7-34703f1ef4d5 tempest-ImagesMetadataTestJSON-297427433 tempest-ImagesMetadataTestJSON-297427433-project] Getting quotas for user 22f9f9332aad483281c34422d83ba2fc and project fa88d37bfb314835bd592d638db11360. Resources: dict_keys(['metadata_items']) {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:21:56.937762 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f36ef808-3d2c-44ab-b3ac-74b4fb5054b9 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:56.938912 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f36ef808-3d2c-44ab-b3ac-74b4fb5054b9 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] [instance: 53347323-4870-4526-9020-1a3bc821d3fb] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:21:56.960112 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f36ef808-3d2c-44ab-b3ac-74b4fb5054b9 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:56.963062 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f36ef808-3d2c-44ab-b3ac-74b4fb5054b9 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:56.968189 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f36ef808-3d2c-44ab-b3ac-74b4fb5054b9 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:56.972449 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f36ef808-3d2c-44ab-b3ac-74b4fb5054b9 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:57.301039 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-cc78d812-d2c5-4f25-82f7-34703f1ef4d5 tempest-ImagesMetadataTestJSON-297427433 tempest-ImagesMetadataTestJSON-297427433-project] 10.222.0.17 "PUT /compute/v2.1/images/5dceed05-fb65-4806-89a1-17ab50a04465/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.825417 Jul 23 21:21:57.301655 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1011/2011] 10.222.0.17 () {60 vars in 1312 bytes} [Sat Jul 23 21:21:56 2022] PUT /compute/v2.1/images/5dceed05-fb65-4806-89a1-17ab50a04465/metadata/os_version => generated 31 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 23 21:21:57.327437 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-02a0c945-1e98-46d8-b6c7-1ae22a8a6594 tempest-ImagesMetadataTestJSON-297427433 tempest-ImagesMetadataTestJSON-297427433-project] Calling method '.version_select at 0x7f0b4761aca0>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:57.440733 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-02a0c945-1e98-46d8-b6c7-1ae22a8a6594 tempest-ImagesMetadataTestJSON-297427433 tempest-ImagesMetadataTestJSON-297427433-project] 10.222.0.17 "GET /compute/v2.1/images/5dceed05-fb65-4806-89a1-17ab50a04465/metadata" status: 200 len: 58 microversion: 2.1 time: 0.117179 Jul 23 21:21:57.441766 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1012/2012] 10.222.0.17 () {58 vars in 1259 bytes} [Sat Jul 23 21:21:57 2022] GET /compute/v2.1/images/5dceed05-fb65-4806-89a1-17ab50a04465/metadata => generated 58 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 23 21:21:57.451417 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-35b52639-7fd8-4348-b22f-0a8d86896460 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:57.458544 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-35b52639-7fd8-4348-b22f-0a8d86896460 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] [instance: 2cebd0e1-09ca-4eab-bda7-0743043bad23] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:21:57.474440 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-35b52639-7fd8-4348-b22f-0a8d86896460 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:57.475130 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-35b52639-7fd8-4348-b22f-0a8d86896460 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:57.476152 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-35b52639-7fd8-4348-b22f-0a8d86896460 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:57.476994 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-35b52639-7fd8-4348-b22f-0a8d86896460 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:57.544492 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f36ef808-3d2c-44ab-b3ac-74b4fb5054b9 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf93a4b80cb4e19a36473986950fc75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c1943188684b45b636541caf587247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:21:57.555936 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f36ef808-3d2c-44ab-b3ac-74b4fb5054b9 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] 10.222.0.17 "GET /compute/v2.1/servers/53347323-4870-4526-9020-1a3bc821d3fb" status: 200 len: 1313 microversion: 2.1 time: 0.623083 Jul 23 21:21:57.558946 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1001/2013] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:21:56 2022] GET /compute/v2.1/servers/53347323-4870-4526-9020-1a3bc821d3fb => generated 1313 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:21:57.570332 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e00e2b3b-453f-456e-94bd-590c370b3980 tempest-ImagesMetadataTestJSON-297427433 tempest-ImagesMetadataTestJSON-297427433-project] Action: 'update_all', calling method: .version_select at 0x7f0b598c9a60>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:21:57.706896 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-e00e2b3b-453f-456e-94bd-590c370b3980 tempest-ImagesMetadataTestJSON-297427433 tempest-ImagesMetadataTestJSON-297427433-project] Getting quotas for project fa88d37bfb314835bd592d638db11360. Resources: dict_keys(['metadata_items']) {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:21:57.720703 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-e00e2b3b-453f-456e-94bd-590c370b3980 tempest-ImagesMetadataTestJSON-297427433 tempest-ImagesMetadataTestJSON-297427433-project] Getting quotas for user 22f9f9332aad483281c34422d83ba2fc and project fa88d37bfb314835bd592d638db11360. Resources: dict_keys(['metadata_items']) {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:21:58.057872 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-35b52639-7fd8-4348-b22f-0a8d86896460 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '672d90d732a0419ca669e0055359dcfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d87ea887fea457fb07731d47de68333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:21:58.070024 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-35b52639-7fd8-4348-b22f-0a8d86896460 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] 10.222.0.17 "GET /compute/v2.1/servers/2cebd0e1-09ca-4eab-bda7-0743043bad23" status: 200 len: 1536 microversion: 2.1 time: 0.623116 Jul 23 21:21:58.076170 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1013/2014] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:21:57 2022] GET /compute/v2.1/servers/2cebd0e1-09ca-4eab-bda7-0743043bad23 => generated 1536 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:21:58.086043 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f878793c-2175-44a9-a993-6164051f6124 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '.version_select at 0x7f0b4760a700>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:58.170475 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-f878793c-2175-44a9-a993-6164051f6124 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/images/ee136f2b-cfa9-44cf-899c-7795cf98e798" status: 200 len: 1453 microversion: 2.1 time: 0.092859 Jul 23 21:21:58.171355 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1014/2015] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:21:58 2022] GET /compute/v2.1/images/ee136f2b-cfa9-44cf-899c-7795cf98e798 => generated 1453 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:21:58.180943 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-4497dc14-c10b-454f-9110-4d1723c548d5 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:58.181791 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-4497dc14-c10b-454f-9110-4d1723c548d5 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] [instance: a213ec70-d903-4ce2-a577-64b4dacf9c1e] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:21:58.200327 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4497dc14-c10b-454f-9110-4d1723c548d5 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:58.201183 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4497dc14-c10b-454f-9110-4d1723c548d5 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:58.202380 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4497dc14-c10b-454f-9110-4d1723c548d5 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:58.202992 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4497dc14-c10b-454f-9110-4d1723c548d5 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:58.540642 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e00e2b3b-453f-456e-94bd-590c370b3980 tempest-ImagesMetadataTestJSON-297427433 tempest-ImagesMetadataTestJSON-297427433-project] 10.222.0.17 "PUT /compute/v2.1/images/5dceed05-fb65-4806-89a1-17ab50a04465/metadata" status: 200 len: 61 microversion: 2.1 time: 0.979908 Jul 23 21:21:58.541522 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1002/2016] 10.222.0.17 () {60 vars in 1279 bytes} [Sat Jul 23 21:21:57 2022] PUT /compute/v2.1/images/5dceed05-fb65-4806-89a1-17ab50a04465/metadata => generated 61 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 23 21:21:58.546612 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-de187c1a-c565-4920-afb9-4b3364745fd7 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Action: 'create', calling method: .version_select at 0x7f0b598d3430>, body: {"pool": "b6eef43f-b538-43c4-bcc2-ec59ff7e8610"} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:21:58.761218 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-4497dc14-c10b-454f-9110-4d1723c548d5 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7acc7eae5f946aaac9f0c8ead2c8d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e0f76ca9b734142a90c27f3d3de3a85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:21:58.781482 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-4497dc14-c10b-454f-9110-4d1723c548d5 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] 10.222.0.17 "GET /compute/v2.1/servers/a213ec70-d903-4ce2-a577-64b4dacf9c1e" status: 200 len: 1321 microversion: 2.1 time: 0.608823 Jul 23 21:21:58.785312 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1015/2017] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:21:58 2022] GET /compute/v2.1/servers/a213ec70-d903-4ce2-a577-64b4dacf9c1e => generated 1321 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:21:58.821916 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-55a74969-1ffa-46a9-8a31-74c0884406df tempest-ImagesMetadataTestJSON-297427433 tempest-ImagesMetadataTestJSON-297427433-project] Action: 'create', calling method: .version_select at 0x7f0b4765b700>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:21:58.917598 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-55a74969-1ffa-46a9-8a31-74c0884406df tempest-ImagesMetadataTestJSON-297427433 tempest-ImagesMetadataTestJSON-297427433-project] Getting quotas for project fa88d37bfb314835bd592d638db11360. Resources: dict_keys(['metadata_items']) {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:21:58.932269 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-55a74969-1ffa-46a9-8a31-74c0884406df tempest-ImagesMetadataTestJSON-297427433 tempest-ImagesMetadataTestJSON-297427433-project] Getting quotas for user 22f9f9332aad483281c34422d83ba2fc and project fa88d37bfb314835bd592d638db11360. Resources: dict_keys(['metadata_items']) {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:21:59.471721 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-55a74969-1ffa-46a9-8a31-74c0884406df tempest-ImagesMetadataTestJSON-297427433 tempest-ImagesMetadataTestJSON-297427433-project] 10.222.0.17 "POST /compute/v2.1/images/5dceed05-fb65-4806-89a1-17ab50a04465/metadata" status: 200 len: 85 microversion: 2.1 time: 0.681087 Jul 23 21:21:59.477247 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1016/2018] 10.222.0.17 () {60 vars in 1280 bytes} [Sat Jul 23 21:21:58 2022] POST /compute/v2.1/images/5dceed05-fb65-4806-89a1-17ab50a04465/metadata => generated 85 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 23 21:21:59.484323 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f7558ebf-bb3b-411b-a4ca-3e87fa17523b tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:59.485476 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-f7558ebf-bb3b-411b-a4ca-3e87fa17523b tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] [instance: 53347323-4870-4526-9020-1a3bc821d3fb] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:21:59.496420 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f7558ebf-bb3b-411b-a4ca-3e87fa17523b tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:59.497000 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f7558ebf-bb3b-411b-a4ca-3e87fa17523b tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:59.500722 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f7558ebf-bb3b-411b-a4ca-3e87fa17523b tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:21:59.508589 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f7558ebf-bb3b-411b-a4ca-3e87fa17523b tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:21:59.826120 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-f7558ebf-bb3b-411b-a4ca-3e87fa17523b tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf93a4b80cb4e19a36473986950fc75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c1943188684b45b636541caf587247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:21:59.839023 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-f7558ebf-bb3b-411b-a4ca-3e87fa17523b tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] 10.222.0.17 "GET /compute/v2.1/servers/53347323-4870-4526-9020-1a3bc821d3fb" status: 200 len: 1313 microversion: 2.1 time: 0.360455 Jul 23 21:21:59.840081 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1017/2019] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:21:59 2022] GET /compute/v2.1/servers/53347323-4870-4526-9020-1a3bc821d3fb => generated 1313 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:21:59.846253 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-dd2ca81d-7db9-4b7b-aa16-65bb78d167e4 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '.version_select at 0x7f0b59a69430>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:21:59.937452 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-dd2ca81d-7db9-4b7b-aa16-65bb78d167e4 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/images/ee136f2b-cfa9-44cf-899c-7795cf98e798" status: 200 len: 1462 microversion: 2.1 time: 0.096012 Jul 23 21:21:59.938123 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1018/2020] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:21:59 2022] GET /compute/v2.1/images/ee136f2b-cfa9-44cf-899c-7795cf98e798 => generated 1462 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:21:59.943596 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-b8f83481-d2b0-4f06-a7fd-c4f5cc53e236 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-577881242", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "f5710226-d2eb-4bfe-8755-cd4ca64ce989"}], "security_groups": [{"name": "tempest-securitygroup--2000081961"}], "key_name": "tempest-keypair-157589584", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:22:00.094949 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.network.neutron [None req-b8f83481-d2b0-4f06-a7fd-c4f5cc53e236 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] validate_networks() for [('f5710226-d2eb-4bfe-8755-cd4ca64ce989', None, None, None, None, None)] {{(pid=131321) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:22:00.717266 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-b8f83481-d2b0-4f06-a7fd-c4f5cc53e236 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Getting quotas for project 01cd9b8837554b8daf506ca062ec916b. Resources: dict_keys(['metadata_items']) {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:22:00.725382 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-b8f83481-d2b0-4f06-a7fd-c4f5cc53e236 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Getting quotas for user efc72b47672e46659b1a5ebdfd99224c and project 01cd9b8837554b8daf506ca062ec916b. Resources: dict_keys(['metadata_items']) {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:22:00.747165 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-b8f83481-d2b0-4f06-a7fd-c4f5cc53e236 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Flavor limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:22:00.748491 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-b8f83481-d2b0-4f06-a7fd-c4f5cc53e236 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Image limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:22:00.749498 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-b8f83481-d2b0-4f06-a7fd-c4f5cc53e236 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Flavor pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:22:00.751011 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-b8f83481-d2b0-4f06-a7fd-c4f5cc53e236 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Image pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:22:00.752548 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-b8f83481-d2b0-4f06-a7fd-c4f5cc53e236 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:22:00.770252 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b8f83481-d2b0-4f06-a7fd-c4f5cc53e236 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:00.771090 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b8f83481-d2b0-4f06-a7fd-c4f5cc53e236 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:00.771924 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b8f83481-d2b0-4f06-a7fd-c4f5cc53e236 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:00.772594 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b8f83481-d2b0-4f06-a7fd-c4f5cc53e236 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:00.809050 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-b8f83481-d2b0-4f06-a7fd-c4f5cc53e236 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Getting quotas for project 01cd9b8837554b8daf506ca062ec916b. Resources: {'ram', 'instances', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:22:00.820786 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-b8f83481-d2b0-4f06-a7fd-c4f5cc53e236 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Getting quotas for user efc72b47672e46659b1a5ebdfd99224c and project 01cd9b8837554b8daf506ca062ec916b. Resources: {'ram', 'instances', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:22:00.842723 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-b8f83481-d2b0-4f06-a7fd-c4f5cc53e236 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Going to run 1 instances... {{(pid=131321) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:22:00.846892 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-b8f83481-d2b0-4f06-a7fd-c4f5cc53e236 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] [instance: 90289981-4474-419e-854a-eb36bbb721f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131321) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:22:00.918691 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-b8f83481-d2b0-4f06-a7fd-c4f5cc53e236 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.979134 Jul 23 21:22:00.920332 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1019/2021] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:21:59 2022] POST /compute/v2.1/servers => generated 409 bytes in 981 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 23 21:22:00.935806 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a30d884f-accc-4844-be5c-066742ca64b2 tempest-ImagesMetadataTestJSON-297427433 tempest-ImagesMetadataTestJSON-297427433-project] Calling method '.version_select at 0x7f0b47fd6430>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:01.072399 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-a30d884f-accc-4844-be5c-066742ca64b2 tempest-ImagesMetadataTestJSON-297427433 tempest-ImagesMetadataTestJSON-297427433-project] 10.222.0.17 "GET /compute/v2.1/images/5dceed05-fb65-4806-89a1-17ab50a04465/metadata" status: 200 len: 85 microversion: 2.1 time: 0.150186 Jul 23 21:22:01.073269 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1020/2022] 10.222.0.17 () {58 vars in 1259 bytes} [Sat Jul 23 21:22:00 2022] GET /compute/v2.1/images/5dceed05-fb65-4806-89a1-17ab50a04465/metadata => generated 85 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 23 21:22:01.088874 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-023c9559-ab3c-4aaf-8584-a9c12da855b9 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:01.089759 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-023c9559-ab3c-4aaf-8584-a9c12da855b9 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] [instance: a213ec70-d903-4ce2-a577-64b4dacf9c1e] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:01.105468 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-023c9559-ab3c-4aaf-8584-a9c12da855b9 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:01.106991 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-023c9559-ab3c-4aaf-8584-a9c12da855b9 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:01.109585 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-023c9559-ab3c-4aaf-8584-a9c12da855b9 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:01.113519 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-023c9559-ab3c-4aaf-8584-a9c12da855b9 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:01.435621 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-023c9559-ab3c-4aaf-8584-a9c12da855b9 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7acc7eae5f946aaac9f0c8ead2c8d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e0f76ca9b734142a90c27f3d3de3a85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:01.448718 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-023c9559-ab3c-4aaf-8584-a9c12da855b9 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] 10.222.0.17 "GET /compute/v2.1/servers/a213ec70-d903-4ce2-a577-64b4dacf9c1e" status: 200 len: 1321 microversion: 2.1 time: 0.371416 Jul 23 21:22:01.450740 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1021/2023] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:01 2022] GET /compute/v2.1/servers/a213ec70-d903-4ce2-a577-64b4dacf9c1e => generated 1321 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:01.457279 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a8a6e216-12bb-4ada-944d-86242a490847 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '.version_select at 0x7f0b4767ed30>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:01.521624 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-a8a6e216-12bb-4ada-944d-86242a490847 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/images/ee136f2b-cfa9-44cf-899c-7795cf98e798" status: 200 len: 1462 microversion: 2.1 time: 0.068947 Jul 23 21:22:01.522251 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1022/2024] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:22:01 2022] GET /compute/v2.1/images/ee136f2b-cfa9-44cf-899c-7795cf98e798 => generated 1462 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:01.526985 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-9d55bb68-e359-4e5e-8341-72142bde333a req-9eb8ab35-0859-4fb5-b2c3-ba4a89d4e895 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a213ec70-d903-4ce2-a577-64b4dacf9c1e", "name": "network-vif-plugged", "status": "completed", "tag": "254c2ec1-d06c-47b7-a65c-fb1c7e84b4a8"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:22:01.537525 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-9d55bb68-e359-4e5e-8341-72142bde333a req-9eb8ab35-0859-4fb5-b2c3-ba4a89d4e895 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:01.538013 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-9d55bb68-e359-4e5e-8341-72142bde333a req-9eb8ab35-0859-4fb5-b2c3-ba4a89d4e895 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:01.552313 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-9d55bb68-e359-4e5e-8341-72142bde333a req-9eb8ab35-0859-4fb5-b2c3-ba4a89d4e895 service nova] Creating event network-vif-plugged:254c2ec1-d06c-47b7-a65c-fb1c7e84b4a8 for instance a213ec70-d903-4ce2-a577-64b4dacf9c1e on nch2-master-1 Jul 23 21:22:01.558222 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-9d55bb68-e359-4e5e-8341-72142bde333a req-9eb8ab35-0859-4fb5-b2c3-ba4a89d4e895 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034700 Jul 23 21:22:01.559985 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1023/2025] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:22:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:22:01.566763 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-5af5d200-be10-42cb-907e-dee804e55ff9 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:01.567479 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-5af5d200-be10-42cb-907e-dee804e55ff9 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] [instance: 53347323-4870-4526-9020-1a3bc821d3fb] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:01.588345 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5af5d200-be10-42cb-907e-dee804e55ff9 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:01.588807 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5af5d200-be10-42cb-907e-dee804e55ff9 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:01.589961 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5af5d200-be10-42cb-907e-dee804e55ff9 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:01.590405 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5af5d200-be10-42cb-907e-dee804e55ff9 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:01.643067 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=100 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:22:01.862123 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-5af5d200-be10-42cb-907e-dee804e55ff9 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf93a4b80cb4e19a36473986950fc75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c1943188684b45b636541caf587247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:01.871550 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-5af5d200-be10-42cb-907e-dee804e55ff9 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] 10.222.0.17 "GET /compute/v2.1/servers/53347323-4870-4526-9020-1a3bc821d3fb" status: 200 len: 1313 microversion: 2.1 time: 0.309885 Jul 23 21:22:01.882367 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1024/2026] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:01 2022] GET /compute/v2.1/servers/53347323-4870-4526-9020-1a3bc821d3fb => generated 1313 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:01.888195 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ba1581e8-c60f-41e6-b763-d537aa06b51b tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:01.889211 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-ba1581e8-c60f-41e6-b763-d537aa06b51b tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] [instance: 90289981-4474-419e-854a-eb36bbb721f4] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:01.902623 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ba1581e8-c60f-41e6-b763-d537aa06b51b tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:01.904630 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ba1581e8-c60f-41e6-b763-d537aa06b51b tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:01.905778 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ba1581e8-c60f-41e6-b763-d537aa06b51b tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:01.906694 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ba1581e8-c60f-41e6-b763-d537aa06b51b tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:02.017910 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ba1581e8-c60f-41e6-b763-d537aa06b51b tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc72b47672e46659b1a5ebdfd99224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cd9b8837554b8daf506ca062ec916b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:02.028176 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-ba1581e8-c60f-41e6-b763-d537aa06b51b tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] 10.222.0.17 "GET /compute/v2.1/servers/90289981-4474-419e-854a-eb36bbb721f4" status: 200 len: 1280 microversion: 2.1 time: 0.144300 Jul 23 21:22:02.031714 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1025/2027] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:01 2022] GET /compute/v2.1/servers/90289981-4474-419e-854a-eb36bbb721f4 => generated 1280 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:02.037730 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-eb48f979-22c2-438c-8d35-8552068826d9 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:02.040066 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-eb48f979-22c2-438c-8d35-8552068826d9 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] [instance: c1701f99-a44c-48ca-8946-b84c5e163cee] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:02.051926 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-eb48f979-22c2-438c-8d35-8552068826d9 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:02.052381 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-eb48f979-22c2-438c-8d35-8552068826d9 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:02.053660 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-eb48f979-22c2-438c-8d35-8552068826d9 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:02.054487 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-eb48f979-22c2-438c-8d35-8552068826d9 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:02.265327 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-eb48f979-22c2-438c-8d35-8552068826d9 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80673ab800441b4bd1f5858e1df7b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629d02efac724fa29fcfff53e370b69b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:02.276105 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-eb48f979-22c2-438c-8d35-8552068826d9 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/servers/c1701f99-a44c-48ca-8946-b84c5e163cee" status: 200 len: 1467 microversion: 2.1 time: 0.243129 Jul 23 21:22:02.278169 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1026/2028] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:02 2022] GET /compute/v2.1/servers/c1701f99-a44c-48ca-8946-b84c5e163cee => generated 1467 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:02.296909 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-08cbdeae-3cd8-4a29-b3ff-67368ae4fb2b tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-38230989"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:22:02.298666 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-08cbdeae-3cd8-4a29-b3ff-67368ae4fb2b tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] [instance: 9933c901-3692-4f36-9f11-e1a93d902e94] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:02.311157 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-08cbdeae-3cd8-4a29-b3ff-67368ae4fb2b tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:02.311157 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-08cbdeae-3cd8-4a29-b3ff-67368ae4fb2b tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:02.311841 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-08cbdeae-3cd8-4a29-b3ff-67368ae4fb2b tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:02.312335 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-08cbdeae-3cd8-4a29-b3ff-67368ae4fb2b tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:02.609546 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-de187c1a-c565-4920-afb9-4b3364745fd7 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] 10.222.0.17 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.066526 Jul 23 21:22:02.611704 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1003/2029] 10.222.0.17 () {60 vars in 1169 bytes} [Sat Jul 23 21:21:58 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4069 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:22:02.621202 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-955de487-6156-47ea-b150-b2fabaf18958 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:02.623096 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-955de487-6156-47ea-b150-b2fabaf18958 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] [instance: a213ec70-d903-4ce2-a577-64b4dacf9c1e] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:02.630594 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-955de487-6156-47ea-b150-b2fabaf18958 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:02.632179 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-955de487-6156-47ea-b150-b2fabaf18958 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:02.633697 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-955de487-6156-47ea-b150-b2fabaf18958 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:02.634419 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-955de487-6156-47ea-b150-b2fabaf18958 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:02.641104 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:22:02.785294 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-08cbdeae-3cd8-4a29-b3ff-67368ae4fb2b tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "POST /compute/v2.1/servers/9933c901-3692-4f36-9f11-e1a93d902e94/action" status: 202 len: 0 microversion: 2.1 time: 0.492923 Jul 23 21:22:02.786338 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1027/2030] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:22:02 2022] POST /compute/v2.1/servers/9933c901-3692-4f36-9f11-e1a93d902e94/action => generated 0 bytes in 495 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 23 21:22:02.796952 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-b4470aa5-1920-4a62-b0c9-ff093a16dac7 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.4.55"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:22:02.802538 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-b4470aa5-1920-4a62-b0c9-ff093a16dac7 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] [instance: 2cebd0e1-09ca-4eab-bda7-0743043bad23] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:02.833052 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b4470aa5-1920-4a62-b0c9-ff093a16dac7 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:02.833501 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b4470aa5-1920-4a62-b0c9-ff093a16dac7 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:02.835235 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b4470aa5-1920-4a62-b0c9-ff093a16dac7 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:02.835677 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b4470aa5-1920-4a62-b0c9-ff093a16dac7 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:02.889150 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b4470aa5-1920-4a62-b0c9-ff093a16dac7 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Acquired lock "refresh_cache-2cebd0e1-09ca-4eab-bda7-0743043bad23" {{(pid=131321) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 23 21:22:03.129053 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-955de487-6156-47ea-b150-b2fabaf18958 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7acc7eae5f946aaac9f0c8ead2c8d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e0f76ca9b734142a90c27f3d3de3a85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:03.143189 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-955de487-6156-47ea-b150-b2fabaf18958 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] 10.222.0.17 "GET /compute/v2.1/servers/a213ec70-d903-4ce2-a577-64b4dacf9c1e" status: 200 len: 1321 microversion: 2.1 time: 0.528576 Jul 23 21:22:03.144611 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1004/2031] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:02 2022] GET /compute/v2.1/servers/a213ec70-d903-4ce2-a577-64b4dacf9c1e => generated 1321 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:03.149714 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c3546ddf-6edc-494c-876e-240b85cf7513 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '.version_select at 0x7f0b5990fdc0>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:03.237884 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c3546ddf-6edc-494c-876e-240b85cf7513 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/images/38623b43-7126-4254-9186-2c489ddd994e" status: 200 len: 1453 microversion: 2.1 time: 0.091382 Jul 23 21:22:03.239506 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1005/2032] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:22:03 2022] GET /compute/v2.1/images/38623b43-7126-4254-9186-2c489ddd994e => generated 1453 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:03.251193 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3bbca128-de02-450b-a9ee-43dbb2aec4dd tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:03.252333 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-3bbca128-de02-450b-a9ee-43dbb2aec4dd tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] [instance: 53347323-4870-4526-9020-1a3bc821d3fb] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:03.269909 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3bbca128-de02-450b-a9ee-43dbb2aec4dd tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:03.270822 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3bbca128-de02-450b-a9ee-43dbb2aec4dd tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:03.275323 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3bbca128-de02-450b-a9ee-43dbb2aec4dd tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:03.283588 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3bbca128-de02-450b-a9ee-43dbb2aec4dd tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:03.652440 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-3bbca128-de02-450b-a9ee-43dbb2aec4dd tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf93a4b80cb4e19a36473986950fc75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c1943188684b45b636541caf587247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:03.672097 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-3bbca128-de02-450b-a9ee-43dbb2aec4dd tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] 10.222.0.17 "GET /compute/v2.1/servers/53347323-4870-4526-9020-1a3bc821d3fb" status: 200 len: 1313 microversion: 2.1 time: 0.428706 Jul 23 21:22:03.684694 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1006/2033] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:03 2022] GET /compute/v2.1/servers/53347323-4870-4526-9020-1a3bc821d3fb => generated 1313 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:03.691597 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-885aa753-1b26-48dd-8c9e-a08bf411751d tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:03.693065 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-885aa753-1b26-48dd-8c9e-a08bf411751d tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] [instance: 90289981-4474-419e-854a-eb36bbb721f4] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:03.701358 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-885aa753-1b26-48dd-8c9e-a08bf411751d tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:03.702196 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-885aa753-1b26-48dd-8c9e-a08bf411751d tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:03.706941 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-885aa753-1b26-48dd-8c9e-a08bf411751d tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:03.707856 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-885aa753-1b26-48dd-8c9e-a08bf411751d tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:03.854914 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-885aa753-1b26-48dd-8c9e-a08bf411751d tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc72b47672e46659b1a5ebdfd99224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cd9b8837554b8daf506ca062ec916b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:03.866607 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-885aa753-1b26-48dd-8c9e-a08bf411751d tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] 10.222.0.17 "GET /compute/v2.1/servers/90289981-4474-419e-854a-eb36bbb721f4" status: 200 len: 1334 microversion: 2.1 time: 0.180209 Jul 23 21:22:03.870363 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1007/2034] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:03 2022] GET /compute/v2.1/servers/90289981-4474-419e-854a-eb36bbb721f4 => generated 1334 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:03.877326 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-20f09033-5410-4a95-be68-22593c04061a req-04638234-4b38-4684-a93a-7dd8f891e4df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53347323-4870-4526-9020-1a3bc821d3fb", "name": "network-vif-plugged", "status": "completed", "tag": "72be27c3-d279-4821-adcd-249529e1fbe0"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:22:03.901477 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-20f09033-5410-4a95-be68-22593c04061a req-04638234-4b38-4684-a93a-7dd8f891e4df service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:03.903032 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-20f09033-5410-4a95-be68-22593c04061a req-04638234-4b38-4684-a93a-7dd8f891e4df service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:03.938135 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-20f09033-5410-4a95-be68-22593c04061a req-04638234-4b38-4684-a93a-7dd8f891e4df service nova] Creating event network-vif-plugged:72be27c3-d279-4821-adcd-249529e1fbe0 for instance 53347323-4870-4526-9020-1a3bc821d3fb on nch1-master-1 Jul 23 21:22:03.953473 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-20f09033-5410-4a95-be68-22593c04061a req-04638234-4b38-4684-a93a-7dd8f891e4df service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080082 Jul 23 21:22:03.959263 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1008/2035] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:22:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:22:04.195879 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-354a913e-dd4f-430a-b026-2a3e6d63c605 tempest-ImagesDeleteNegativeTestJSON-1581898113 tempest-ImagesDeleteNegativeTestJSON-1581898113-project] 10.222.0.17 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.166357 Jul 23 21:22:04.197116 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1009/2036] 10.222.0.17 () {58 vars in 1127 bytes} [Sat Jul 23 21:22:04 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 23 21:22:04.207417 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1dc8620a-212e-413d-b08c-6e84449c566d tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:04.210147 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1dc8620a-212e-413d-b08c-6e84449c566d tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] [instance: a213ec70-d903-4ce2-a577-64b4dacf9c1e] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:04.219056 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1dc8620a-212e-413d-b08c-6e84449c566d tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:04.219673 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1dc8620a-212e-413d-b08c-6e84449c566d tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:04.220561 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1dc8620a-212e-413d-b08c-6e84449c566d tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:04.221650 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1dc8620a-212e-413d-b08c-6e84449c566d tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:04.250040 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=100 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:22:04.916503 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.network.neutron [None req-b4470aa5-1920-4a62-b0c9-ff093a16dac7 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] [instance: 2cebd0e1-09ca-4eab-bda7-0743043bad23] Building network info cache for instance {{(pid=131321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 23 21:22:05.131230 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-1dc8620a-212e-413d-b08c-6e84449c566d tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7acc7eae5f946aaac9f0c8ead2c8d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e0f76ca9b734142a90c27f3d3de3a85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:05.145924 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1dc8620a-212e-413d-b08c-6e84449c566d tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] 10.222.0.17 "GET /compute/v2.1/servers/a213ec70-d903-4ce2-a577-64b4dacf9c1e" status: 200 len: 1471 microversion: 2.1 time: 0.947463 Jul 23 21:22:05.165982 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1010/2037] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:04 2022] GET /compute/v2.1/servers/a213ec70-d903-4ce2-a577-64b4dacf9c1e => generated 1471 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:05.173541 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-15317336-e8a2-49f1-a724-47166a846b63 tempest-ImagesDeleteNegativeTestJSON-1581898113 tempest-ImagesDeleteNegativeTestJSON-1581898113-project] Calling method '.version_select at 0x7f0b5990f5e0>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:05.233239 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-15317336-e8a2-49f1-a724-47166a846b63 tempest-ImagesDeleteNegativeTestJSON-1581898113 tempest-ImagesDeleteNegativeTestJSON-1581898113-project] HTTP exception thrown: Image not found. Jul 23 21:22:05.236687 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-15317336-e8a2-49f1-a724-47166a846b63 tempest-ImagesDeleteNegativeTestJSON-1581898113 tempest-ImagesDeleteNegativeTestJSON-1581898113-project] Request method failure captured: Jul 23 21:22:05.236687 ncdv-master-1 devstack@n-api.service[131320]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Jul 23 21:22:05.236687 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:22:05.236687 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:22:05.236687 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:22:05.236687 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:22:05.236687 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:22:05.236687 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:22:05.236687 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:22:05.236687 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:22:05.236687 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GZ7UOFps0Dtd66sgKHkBe0SJm4jJY-p13a1nbKia_KEtiEotExGK55F3RCb5v1oggkrU0TRZ6ihs3ujwpW2da9GU446YAuTCNO6wAzDBnYhIGwUW0vYoEAUEmiwYpLwXmJhAwL_88ZZ6R4zjXKNKGdjuroYasY_4MCaB-KWtOfk_6I Jul 23 21:22:05.236687 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:22:05.236687 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:22:05.236687 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:22:05.236687 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:22:05.236687 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:22:05.236687 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:22:05.236687 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 1a6595adf7174855bf5dc685b2f3236d Jul 23 21:22:05.236687 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1581898113 Jul 23 21:22:05.236687 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:22:05.236687 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:22:05.238878 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1a6595adf7174855bf5dc685b2f3236d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1a6595adf7174855bf5dc685b2f3236d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1a6595adf7174855bf5dc685b2f3236d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1a6595adf7174855bf5dc685b2f3236d"}]}] Jul 23 21:22:05.238878 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1581898113 Jul 23 21:22:05.238878 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 1a6595adf7174855bf5dc685b2f3236d Jul 23 21:22:05.238878 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1581898113 Jul 23 21:22:05.238878 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ImagesDeleteNegativeTestJSON-1581898113-project Jul 23 21:22:05.238878 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:22:05.238878 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:22:05.238878 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 26d47a6490ce4b078919f59d93d47188 Jul 23 21:22:05.238878 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1581898113-project Jul 23 21:22:05.238878 ncdv-master-1 devstack@n-api.service[131320]: method: Jul 23 21:22:05.238878 ncdv-master-1 devstack@n-api.service[131320]: exception: Image not found. Jul 23 21:22:05.238878 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '-1'} Jul 23 21:22:05.238878 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:22:05.238878 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:22:05.240307 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 23 21:22:05.240307 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 23 21:22:05.240307 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 23 21:22:05.240307 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 23 21:22:05.240307 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 23 21:22:05.240307 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 23 21:22:05.240307 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 23 21:22:05.240307 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 23 21:22:05.240307 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 23 21:22:05.240307 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 23 21:22:05.240307 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 23 21:22:05.240307 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 23 21:22:05.240307 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 23 21:22:05.240307 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 23 21:22:05.240307 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Jul 23 21:22:05.240307 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:22:05.240307 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:22:05.240307 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:22:05.240307 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:22:05.241832 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 23 21:22:05.241832 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 23 21:22:05.241832 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 23 21:22:05.241832 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 23 21:22:05.241832 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 23 21:22:05.241832 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 23 21:22:05.241832 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Jul 23 21:22:05.241832 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:22:05.241832 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:22:05.241832 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:22:05.241832 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:22:05.241832 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:22:05.241832 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:22:05.241832 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:22:05.241832 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:22:05.241832 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:22:05.241832 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:22:05.241832 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:22:05.241832 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:22:05.241832 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 23 21:22:05.243079 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 23 21:22:05.243079 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 23 21:22:05.243079 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:22:05.243079 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:22:05.243079 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:22:05.243079 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:22:05.243079 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:22:05.243079 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:22:05.243079 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:22:05.243079 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:22:05.243079 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 23 21:22:05.243079 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:22:05.246373 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-15317336-e8a2-49f1-a724-47166a846b63 tempest-ImagesDeleteNegativeTestJSON-1581898113 tempest-ImagesDeleteNegativeTestJSON-1581898113-project] Returning 404 to user: Image not found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:22:05.248577 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-15317336-e8a2-49f1-a724-47166a846b63 tempest-ImagesDeleteNegativeTestJSON-1581898113 tempest-ImagesDeleteNegativeTestJSON-1581898113-project] 10.222.0.17 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.080057 Jul 23 21:22:05.251161 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1011/2038] 10.222.0.17 () {58 vars in 1133 bytes} [Sat Jul 23 21:22:05 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 23 21:22:05.261168 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-af8417ec-56a9-4306-a0d8-53aa3f7544cc tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '.version_select at 0x7f0b59979550>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:05.341584 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-af8417ec-56a9-4306-a0d8-53aa3f7544cc tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/images/38623b43-7126-4254-9186-2c489ddd994e" status: 200 len: 1453 microversion: 2.1 time: 0.086488 Jul 23 21:22:05.350697 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1012/2039] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:22:05 2022] GET /compute/v2.1/images/38623b43-7126-4254-9186-2c489ddd994e => generated 1453 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:05.363650 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-fb1790e4-ab47-4dde-a1e3-3764748022ef tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:05.364737 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-fb1790e4-ab47-4dde-a1e3-3764748022ef tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] [instance: 53347323-4870-4526-9020-1a3bc821d3fb] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:05.378453 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fb1790e4-ab47-4dde-a1e3-3764748022ef tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:05.389800 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fb1790e4-ab47-4dde-a1e3-3764748022ef tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:05.391706 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fb1790e4-ab47-4dde-a1e3-3764748022ef tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:05.392224 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fb1790e4-ab47-4dde-a1e3-3764748022ef tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:05.754439 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.network.neutron [None req-b4470aa5-1920-4a62-b0c9-ff093a16dac7 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] [instance: 2cebd0e1-09ca-4eab-bda7-0743043bad23] Updating instance_info_cache with network_info: [{"id": "d506fd59-3dd8-47d3-b895-177dd8661556", "address": "fa:16:3e:70:31:d7", "network": {"id": "9aac9607-dc4a-4309-87fe-407e0e39a44b", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1314645907-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "3d87ea887fea457fb07731d47de68333", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapd506fd59-3d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=131321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 23 21:22:05.776748 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b4470aa5-1920-4a62-b0c9-ff093a16dac7 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Releasing lock "refresh_cache-2cebd0e1-09ca-4eab-bda7-0743043bad23" {{(pid=131321) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 23 21:22:05.777827 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-b4470aa5-1920-4a62-b0c9-ff093a16dac7 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] 10.222.0.17 "POST /compute/v2.1/servers/2cebd0e1-09ca-4eab-bda7-0743043bad23/action" status: 202 len: 0 microversion: 2.1 time: 2.990252 Jul 23 21:22:05.778639 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1028/2040] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:22:02 2022] POST /compute/v2.1/servers/2cebd0e1-09ca-4eab-bda7-0743043bad23/action => generated 0 bytes in 2992 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 23 21:22:05.785993 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e13b6982-483b-4c54-b494-943479a5c2e6 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:05.789039 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-e13b6982-483b-4c54-b494-943479a5c2e6 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] [instance: 90289981-4474-419e-854a-eb36bbb721f4] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:05.815735 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e13b6982-483b-4c54-b494-943479a5c2e6 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:05.818388 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e13b6982-483b-4c54-b494-943479a5c2e6 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:05.819482 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e13b6982-483b-4c54-b494-943479a5c2e6 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:05.824062 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e13b6982-483b-4c54-b494-943479a5c2e6 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:05.869676 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-fb1790e4-ab47-4dde-a1e3-3764748022ef tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf93a4b80cb4e19a36473986950fc75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c1943188684b45b636541caf587247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:05.883685 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-fb1790e4-ab47-4dde-a1e3-3764748022ef tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] 10.222.0.17 "GET /compute/v2.1/servers/53347323-4870-4526-9020-1a3bc821d3fb" status: 200 len: 1313 microversion: 2.1 time: 0.531122 Jul 23 21:22:05.892913 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1013/2041] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:05 2022] GET /compute/v2.1/servers/53347323-4870-4526-9020-1a3bc821d3fb => generated 1313 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:05.897521 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-09873190-3c0e-442a-b87f-16c88fd7a8bd req-dbd85088-928e-4de7-9a85-7f71812cdbf0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2cebd0e1-09ca-4eab-bda7-0743043bad23", "tag": "d506fd59-3dd8-47d3-b895-177dd8661556"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:22:05.914249 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-09873190-3c0e-442a-b87f-16c88fd7a8bd req-dbd85088-928e-4de7-9a85-7f71812cdbf0 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:05.914578 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-09873190-3c0e-442a-b87f-16c88fd7a8bd req-dbd85088-928e-4de7-9a85-7f71812cdbf0 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:05.929891 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-09873190-3c0e-442a-b87f-16c88fd7a8bd req-dbd85088-928e-4de7-9a85-7f71812cdbf0 service nova] Creating event network-changed:d506fd59-3dd8-47d3-b895-177dd8661556 for instance 2cebd0e1-09ca-4eab-bda7-0743043bad23 on nch2-master-1 Jul 23 21:22:05.936088 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-09873190-3c0e-442a-b87f-16c88fd7a8bd req-dbd85088-928e-4de7-9a85-7f71812cdbf0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048289 Jul 23 21:22:05.937602 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1014/2042] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:22:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:22:06.113325 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-e13b6982-483b-4c54-b494-943479a5c2e6 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc72b47672e46659b1a5ebdfd99224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cd9b8837554b8daf506ca062ec916b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:06.125221 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-e13b6982-483b-4c54-b494-943479a5c2e6 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] 10.222.0.17 "GET /compute/v2.1/servers/90289981-4474-419e-854a-eb36bbb721f4" status: 200 len: 1402 microversion: 2.1 time: 0.345223 Jul 23 21:22:06.134808 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1029/2043] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:05 2022] GET /compute/v2.1/servers/90289981-4474-419e-854a-eb36bbb721f4 => generated 1402 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:06.142637 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a9a5a0aa-9952-4512-a5d5-bcd4c2c5fdbe tempest-ImagesDeleteNegativeTestJSON-1581898113 tempest-ImagesDeleteNegativeTestJSON-1581898113-project] Calling method '.version_select at 0x7f0b5991ef70>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:06.184359 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-a9a5a0aa-9952-4512-a5d5-bcd4c2c5fdbe tempest-ImagesDeleteNegativeTestJSON-1581898113 tempest-ImagesDeleteNegativeTestJSON-1581898113-project] HTTP exception thrown: Image not found. Jul 23 21:22:06.186906 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a9a5a0aa-9952-4512-a5d5-bcd4c2c5fdbe tempest-ImagesDeleteNegativeTestJSON-1581898113 tempest-ImagesDeleteNegativeTestJSON-1581898113-project] Request method failure captured: Jul 23 21:22:06.186906 ncdv-master-1 devstack@n-api.service[131321]: request: DELETE /compute/v2.1/images/2bb9c823-8540-4e76-9de0-3236ed7b84ej HTTP/1.1 Jul 23 21:22:06.186906 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:22:06.186906 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:22:06.186906 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:22:06.186906 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:22:06.186906 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:22:06.186906 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:22:06.186906 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:22:06.186906 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:22:06.186906 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GZ7UOFps0Dtd66sgKHkBe0SJm4jJY-p13a1nbKia_KEtiEotExGK55F3RCb5v1oggkrU0TRZ6ihs3ujwpW2da9GU446YAuTCNO6wAzDBnYhIGwUW0vYoEAUEmiwYpLwXmJhAwL_88ZZ6R4zjXKNKGdjuroYasY_4MCaB-KWtOfk_6I Jul 23 21:22:06.186906 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:22:06.186906 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:22:06.186906 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:22:06.186906 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:22:06.186906 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:22:06.186906 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:22:06.186906 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 1a6595adf7174855bf5dc685b2f3236d Jul 23 21:22:06.186906 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1581898113 Jul 23 21:22:06.186906 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:22:06.186906 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:22:06.188487 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1a6595adf7174855bf5dc685b2f3236d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1a6595adf7174855bf5dc685b2f3236d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1a6595adf7174855bf5dc685b2f3236d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1a6595adf7174855bf5dc685b2f3236d"}]}] Jul 23 21:22:06.188487 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1581898113 Jul 23 21:22:06.188487 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 1a6595adf7174855bf5dc685b2f3236d Jul 23 21:22:06.188487 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1581898113 Jul 23 21:22:06.188487 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ImagesDeleteNegativeTestJSON-1581898113-project Jul 23 21:22:06.188487 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:22:06.188487 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:22:06.188487 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 26d47a6490ce4b078919f59d93d47188 Jul 23 21:22:06.188487 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1581898113-project Jul 23 21:22:06.188487 ncdv-master-1 devstack@n-api.service[131321]: method: Jul 23 21:22:06.188487 ncdv-master-1 devstack@n-api.service[131321]: exception: Image not found. Jul 23 21:22:06.188487 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': '2bb9c823-8540-4e76-9de0-3236ed7b84ej'} Jul 23 21:22:06.188487 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:22:06.189393 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:22:06.189393 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 23 21:22:06.189393 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 23 21:22:06.189393 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 23 21:22:06.189393 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 23 21:22:06.189393 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 23 21:22:06.189393 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 23 21:22:06.189393 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 23 21:22:06.189393 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 23 21:22:06.189393 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 23 21:22:06.189393 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 23 21:22:06.189393 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 23 21:22:06.189393 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 23 21:22:06.189393 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 23 21:22:06.189393 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 23 21:22:06.189393 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 2bb9c823-8540-4e76-9de0-3236ed7b84ej to delete Jul 23 21:22:06.189393 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:22:06.189393 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:22:06.189393 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:22:06.190835 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:22:06.190835 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 23 21:22:06.190835 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 23 21:22:06.190835 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 23 21:22:06.190835 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 23 21:22:06.190835 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 23 21:22:06.190835 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 23 21:22:06.190835 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 2bb9c823-8540-4e76-9de0-3236ed7b84ej could not be found. Jul 23 21:22:06.190835 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:22:06.190835 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:22:06.190835 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:22:06.190835 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:22:06.190835 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:22:06.190835 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:22:06.190835 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:22:06.190835 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:22:06.190835 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:22:06.190835 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:22:06.190835 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:22:06.190835 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:22:06.192056 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 23 21:22:06.192056 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 23 21:22:06.192056 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 23 21:22:06.192056 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:22:06.192056 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:22:06.192056 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:22:06.192056 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:22:06.192056 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:22:06.192056 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:22:06.192056 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:22:06.192056 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:22:06.192056 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 23 21:22:06.192056 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:22:06.193706 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a9a5a0aa-9952-4512-a5d5-bcd4c2c5fdbe tempest-ImagesDeleteNegativeTestJSON-1581898113 tempest-ImagesDeleteNegativeTestJSON-1581898113-project] Returning 404 to user: Image not found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:22:06.197409 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-a9a5a0aa-9952-4512-a5d5-bcd4c2c5fdbe tempest-ImagesDeleteNegativeTestJSON-1581898113 tempest-ImagesDeleteNegativeTestJSON-1581898113-project] 10.222.0.17 "DELETE /compute/v2.1/images/2bb9c823-8540-4e76-9de0-3236ed7b84ej" status: 404 len: 62 microversion: 2.1 time: 0.060771 Jul 23 21:22:06.198264 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1030/2044] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:06 2022] DELETE /compute/v2.1/images/2bb9c823-8540-4e76-9de0-3236ed7b84ej => generated 62 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 23 21:22:06.199705 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2477654a-d32c-487b-9caa-4305df9767e4 tempest-ServersAdminNegativeTestJSON-2135340804 tempest-ServersAdminNegativeTestJSON-2135340804-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:22:06.200610 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-2477654a-d32c-487b-9caa-4305df9767e4 tempest-ServersAdminNegativeTestJSON-2135340804 tempest-ServersAdminNegativeTestJSON-2135340804-project-admin] [instance: 34aeb70f-d405-4a7e-aeda-b811907210fb] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:06.210833 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-1be41a8d-b53b-4fce-9aae-5d6523ffa7a5 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Action: 'create', calling method: .version_select at 0x7f0b4765b1f0>, body: {"pool": "b6eef43f-b538-43c4-bcc2-ec59ff7e8610"} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:22:06.217146 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-2477654a-d32c-487b-9caa-4305df9767e4 tempest-ServersAdminNegativeTestJSON-2135340804 tempest-ServersAdminNegativeTestJSON-2135340804-project-admin] HTTP exception thrown: Instance 34aeb70f-d405-4a7e-aeda-b811907210fb could not be found. Jul 23 21:22:06.219910 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2477654a-d32c-487b-9caa-4305df9767e4 tempest-ServersAdminNegativeTestJSON-2135340804 tempest-ServersAdminNegativeTestJSON-2135340804-project-admin] Request method failure captured: Jul 23 21:22:06.219910 ncdv-master-1 devstack@n-api.service[131320]: request: POST /compute/v2.1/servers/34aeb70f-d405-4a7e-aeda-b811907210fb/action HTTP/1.1 Jul 23 21:22:06.219910 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:22:06.219910 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:22:06.219910 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:22:06.219910 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 15 Jul 23 21:22:06.219910 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:22:06.219910 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:22:06.219910 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:22:06.219910 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:22:06.219910 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GZg0cm9DWRWjf0OJT4Y9639GL-ciVgILfnOOBGoZAswVR9P71RAzDlHR6s9INePWY_F85ce9PbVbTjis_cLf2dBk1NMAXeVE83B25rE4IxdT1FKL76DaTV8_QI42WedKYk9CwED5H5VokIDQXmFiwB82BM2mDo6MGgV70HQMVO99nU Jul 23 21:22:06.219910 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:22:06.219910 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:22:06.219910 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:22:06.219910 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:22:06.219910 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:22:06.219910 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:22:06.219910 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: a7a5537ccc0f49c397e9f6bc723a9b7b Jul 23 21:22:06.219910 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2135340804 Jul 23 21:22:06.219910 ncdv-master-1 devstack@n-api.service[131320]: X-Role: admin,reader,member Jul 23 21:22:06.219910 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: admin,reader,member Jul 23 21:22:06.221180 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a7a5537ccc0f49c397e9f6bc723a9b7b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a7a5537ccc0f49c397e9f6bc723a9b7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a7a5537ccc0f49c397e9f6bc723a9b7b", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a7a5537ccc0f49c397e9f6bc723a9b7b"}]}] Jul 23 21:22:06.221180 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2135340804 Jul 23 21:22:06.221180 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: a7a5537ccc0f49c397e9f6bc723a9b7b Jul 23 21:22:06.221180 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2135340804 Jul 23 21:22:06.221180 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServersAdminNegativeTestJSON-2135340804-project-admin Jul 23 21:22:06.221180 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:22:06.221180 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:22:06.221180 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 745c84c03045459f948326f8e11b1c72 Jul 23 21:22:06.221180 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2135340804-project-admin Jul 23 21:22:06.221180 ncdv-master-1 devstack@n-api.service[131320]: Jul 23 21:22:06.221180 ncdv-master-1 devstack@n-api.service[131320]: {"migrate": {}} Jul 23 21:22:06.221180 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:22:06.221180 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance 34aeb70f-d405-4a7e-aeda-b811907210fb could not be found. Jul 23 21:22:06.221827 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '34aeb70f-d405-4a7e-aeda-b811907210fb', 'body': {'migrate': {}}} Jul 23 21:22:06.221827 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:22:06.221827 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:22:06.221827 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:22:06.221827 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:22:06.221827 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:22:06.221827 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:22:06.221827 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 23 21:22:06.221827 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 23 21:22:06.221827 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34aeb70f-d405-4a7e-aeda-b811907210fb could not be found. Jul 23 21:22:06.221827 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:22:06.221827 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:22:06.221827 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:22:06.221827 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:22:06.221827 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:22:06.221827 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:22:06.221827 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:22:06.221827 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:22:06.221827 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:22:06.221827 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:22:06.223099 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:22:06.223099 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:22:06.223099 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Jul 23 21:22:06.223099 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Jul 23 21:22:06.223099 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:22:06.223099 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:22:06.223099 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34aeb70f-d405-4a7e-aeda-b811907210fb could not be found. Jul 23 21:22:06.223099 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:22:06.223099 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:22:06.223099 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:22:06.223099 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:22:06.223099 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:22:06.223099 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:22:06.223099 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:22:06.223099 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:22:06.223099 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34aeb70f-d405-4a7e-aeda-b811907210fb could not be found. Jul 23 21:22:06.223099 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:22:06.228160 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2477654a-d32c-487b-9caa-4305df9767e4 tempest-ServersAdminNegativeTestJSON-2135340804 tempest-ServersAdminNegativeTestJSON-2135340804-project-admin] Returning 404 to user: Instance 34aeb70f-d405-4a7e-aeda-b811907210fb could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:22:06.231094 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2477654a-d32c-487b-9caa-4305df9767e4 tempest-ServersAdminNegativeTestJSON-2135340804 tempest-ServersAdminNegativeTestJSON-2135340804-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/34aeb70f-d405-4a7e-aeda-b811907210fb/action" status: 404 len: 111 microversion: 2.1 time: 0.292189 Jul 23 21:22:06.232515 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1015/2045] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:22:05 2022] POST /compute/v2.1/servers/34aeb70f-d405-4a7e-aeda-b811907210fb/action => generated 111 bytes in 294 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:22:06.257009 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-3ffe4143-eaf5-4c3f-832e-a3bdc525ac2b req-152057ad-ccca-4b87-a736-61dd610532f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1701f99-a44c-48ca-8946-b84c5e163cee", "name": "network-vif-unplugged", "status": "completed", "tag": "ca008065-59c8-45bf-a4e5-409a38a7c991"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:22:06.287481 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-3ffe4143-eaf5-4c3f-832e-a3bdc525ac2b req-152057ad-ccca-4b87-a736-61dd610532f3 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:06.288118 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-3ffe4143-eaf5-4c3f-832e-a3bdc525ac2b req-152057ad-ccca-4b87-a736-61dd610532f3 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:06.303743 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-3ffe4143-eaf5-4c3f-832e-a3bdc525ac2b req-152057ad-ccca-4b87-a736-61dd610532f3 service nova] Creating event network-vif-unplugged:ca008065-59c8-45bf-a4e5-409a38a7c991 for instance c1701f99-a44c-48ca-8946-b84c5e163cee on nch1-master-1 Jul 23 21:22:06.326622 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-3ffe4143-eaf5-4c3f-832e-a3bdc525ac2b req-152057ad-ccca-4b87-a736-61dd610532f3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092062 Jul 23 21:22:06.327958 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1016/2046] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:22:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:22:06.347030 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-22a465c3-53e9-42ce-9ec7-2e79edaabcbb tempest-ImagesDeleteNegativeTestJSON-1581898113 tempest-ImagesDeleteNegativeTestJSON-1581898113-project] Calling method '.version_select at 0x7f0b4767c4c0>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:06.430413 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-22a465c3-53e9-42ce-9ec7-2e79edaabcbb tempest-ImagesDeleteNegativeTestJSON-1581898113 tempest-ImagesDeleteNegativeTestJSON-1581898113-project] HTTP exception thrown: Image not found. Jul 23 21:22:06.444076 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-22a465c3-53e9-42ce-9ec7-2e79edaabcbb tempest-ImagesDeleteNegativeTestJSON-1581898113 tempest-ImagesDeleteNegativeTestJSON-1581898113-project] Request method failure captured: Jul 23 21:22:06.444076 ncdv-master-1 devstack@n-api.service[131320]: request: DELETE /compute/v2.1/images/4f2857e4-39e0-4175-9f26-5e11e5caf8b01 HTTP/1.1 Jul 23 21:22:06.444076 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:22:06.444076 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:22:06.444076 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:22:06.444076 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:22:06.444076 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:22:06.444076 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:22:06.444076 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:22:06.444076 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:22:06.444076 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GZ7UOFps0Dtd66sgKHkBe0SJm4jJY-p13a1nbKia_KEtiEotExGK55F3RCb5v1oggkrU0TRZ6ihs3ujwpW2da9GU446YAuTCNO6wAzDBnYhIGwUW0vYoEAUEmiwYpLwXmJhAwL_88ZZ6R4zjXKNKGdjuroYasY_4MCaB-KWtOfk_6I Jul 23 21:22:06.444076 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:22:06.444076 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:22:06.444076 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:22:06.444076 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:22:06.444076 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:22:06.444076 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:22:06.444076 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 1a6595adf7174855bf5dc685b2f3236d Jul 23 21:22:06.444076 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1581898113 Jul 23 21:22:06.444076 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:22:06.444076 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:22:06.445701 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1a6595adf7174855bf5dc685b2f3236d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1a6595adf7174855bf5dc685b2f3236d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1a6595adf7174855bf5dc685b2f3236d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1a6595adf7174855bf5dc685b2f3236d"}]}] Jul 23 21:22:06.445701 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1581898113 Jul 23 21:22:06.445701 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 1a6595adf7174855bf5dc685b2f3236d Jul 23 21:22:06.445701 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1581898113 Jul 23 21:22:06.445701 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ImagesDeleteNegativeTestJSON-1581898113-project Jul 23 21:22:06.445701 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:22:06.445701 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:22:06.445701 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 26d47a6490ce4b078919f59d93d47188 Jul 23 21:22:06.445701 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1581898113-project Jul 23 21:22:06.445701 ncdv-master-1 devstack@n-api.service[131320]: method: Jul 23 21:22:06.445701 ncdv-master-1 devstack@n-api.service[131320]: exception: Image not found. Jul 23 21:22:06.445701 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '4f2857e4-39e0-4175-9f26-5e11e5caf8b01'} Jul 23 21:22:06.445701 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:22:06.446676 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:22:06.446676 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 23 21:22:06.446676 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 23 21:22:06.446676 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 23 21:22:06.446676 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 23 21:22:06.446676 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 23 21:22:06.446676 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 23 21:22:06.446676 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 23 21:22:06.446676 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 23 21:22:06.446676 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 23 21:22:06.446676 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 23 21:22:06.446676 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 23 21:22:06.446676 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 23 21:22:06.446676 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 23 21:22:06.446676 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 23 21:22:06.446676 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 4f2857e4-39e0-4175-9f26-5e11e5caf8b01 to delete Jul 23 21:22:06.446676 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:22:06.446676 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:22:06.446676 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:22:06.447750 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:22:06.447750 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 23 21:22:06.447750 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 23 21:22:06.447750 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 23 21:22:06.447750 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 23 21:22:06.447750 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 23 21:22:06.447750 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 23 21:22:06.447750 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4f2857e4-39e0-4175-9f26-5e11e5caf8b01 could not be found. Jul 23 21:22:06.447750 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:22:06.447750 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:22:06.447750 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:22:06.447750 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:22:06.447750 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:22:06.447750 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:22:06.447750 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:22:06.447750 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:22:06.447750 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:22:06.447750 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:22:06.447750 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:22:06.447750 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:22:06.448843 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 23 21:22:06.448843 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 23 21:22:06.448843 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 23 21:22:06.448843 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:22:06.448843 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:22:06.448843 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:22:06.448843 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:22:06.448843 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:22:06.448843 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:22:06.448843 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:22:06.448843 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:22:06.448843 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 23 21:22:06.448843 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:22:06.456694 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-22a465c3-53e9-42ce-9ec7-2e79edaabcbb tempest-ImagesDeleteNegativeTestJSON-1581898113 tempest-ImagesDeleteNegativeTestJSON-1581898113-project] Returning 404 to user: Image not found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:22:06.467425 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-22a465c3-53e9-42ce-9ec7-2e79edaabcbb tempest-ImagesDeleteNegativeTestJSON-1581898113 tempest-ImagesDeleteNegativeTestJSON-1581898113-project] 10.222.0.17 "DELETE /compute/v2.1/images/4f2857e4-39e0-4175-9f26-5e11e5caf8b01" status: 404 len: 62 microversion: 2.1 time: 0.133603 Jul 23 21:22:06.472664 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1017/2047] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:22:06 2022] DELETE /compute/v2.1/images/4f2857e4-39e0-4175-9f26-5e11e5caf8b01 => generated 62 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 23 21:22:06.502471 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ea490d99-993e-41f7-ae05-6a5eb6ecfb94 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '.version_select at 0x7f0b598c99d0>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:06.594263 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ea490d99-993e-41f7-ae05-6a5eb6ecfb94 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/images/38623b43-7126-4254-9186-2c489ddd994e" status: 200 len: 1453 microversion: 2.1 time: 0.119375 Jul 23 21:22:06.601529 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1018/2048] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:22:06 2022] GET /compute/v2.1/images/38623b43-7126-4254-9186-2c489ddd994e => generated 1453 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:06.616705 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2a700a4c-e96a-45d3-81ca-aebd33610153 tempest-ImagesDeleteNegativeTestJSON-1581898113 tempest-ImagesDeleteNegativeTestJSON-1581898113-project] Calling method '.version_select at 0x7f0b598c9550>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:06.659765 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-2a700a4c-e96a-45d3-81ca-aebd33610153 tempest-ImagesDeleteNegativeTestJSON-1581898113 tempest-ImagesDeleteNegativeTestJSON-1581898113-project] HTTP exception thrown: Image not found. Jul 23 21:22:06.662350 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2a700a4c-e96a-45d3-81ca-aebd33610153 tempest-ImagesDeleteNegativeTestJSON-1581898113 tempest-ImagesDeleteNegativeTestJSON-1581898113-project] Request method failure captured: Jul 23 21:22:06.662350 ncdv-master-1 devstack@n-api.service[131320]: request: DELETE /compute/v2.1/images/tempest-invalid-1456770159 HTTP/1.1 Jul 23 21:22:06.662350 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:22:06.662350 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:22:06.662350 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:22:06.662350 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:22:06.662350 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:22:06.662350 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:22:06.662350 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:22:06.662350 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:22:06.662350 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GZ7UOFps0Dtd66sgKHkBe0SJm4jJY-p13a1nbKia_KEtiEotExGK55F3RCb5v1oggkrU0TRZ6ihs3ujwpW2da9GU446YAuTCNO6wAzDBnYhIGwUW0vYoEAUEmiwYpLwXmJhAwL_88ZZ6R4zjXKNKGdjuroYasY_4MCaB-KWtOfk_6I Jul 23 21:22:06.662350 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:22:06.662350 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:22:06.662350 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:22:06.662350 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:22:06.662350 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:22:06.662350 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:22:06.662350 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 1a6595adf7174855bf5dc685b2f3236d Jul 23 21:22:06.662350 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1581898113 Jul 23 21:22:06.662350 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:22:06.662350 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:22:06.663435 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1a6595adf7174855bf5dc685b2f3236d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1a6595adf7174855bf5dc685b2f3236d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1a6595adf7174855bf5dc685b2f3236d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1a6595adf7174855bf5dc685b2f3236d"}]}] Jul 23 21:22:06.663435 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1581898113 Jul 23 21:22:06.663435 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 1a6595adf7174855bf5dc685b2f3236d Jul 23 21:22:06.663435 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1581898113 Jul 23 21:22:06.663435 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ImagesDeleteNegativeTestJSON-1581898113-project Jul 23 21:22:06.663435 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:22:06.663435 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:22:06.663435 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 26d47a6490ce4b078919f59d93d47188 Jul 23 21:22:06.663435 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1581898113-project Jul 23 21:22:06.663435 ncdv-master-1 devstack@n-api.service[131320]: method: Jul 23 21:22:06.663435 ncdv-master-1 devstack@n-api.service[131320]: exception: Image not found. Jul 23 21:22:06.663435 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': 'tempest-invalid-1456770159'} Jul 23 21:22:06.663435 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:22:06.664064 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:22:06.664064 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 23 21:22:06.664064 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 23 21:22:06.664064 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 23 21:22:06.664064 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 23 21:22:06.664064 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 23 21:22:06.664064 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 23 21:22:06.664064 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 23 21:22:06.664064 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 23 21:22:06.664064 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 23 21:22:06.664064 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 23 21:22:06.664064 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 23 21:22:06.664064 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 23 21:22:06.664064 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 23 21:22:06.664064 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 23 21:22:06.664064 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-1456770159 to delete Jul 23 21:22:06.664064 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:22:06.664064 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:22:06.664064 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:22:06.664973 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:22:06.664973 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 23 21:22:06.664973 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 23 21:22:06.664973 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 23 21:22:06.664973 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 23 21:22:06.664973 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 23 21:22:06.664973 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 23 21:22:06.664973 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-1456770159 could not be found. Jul 23 21:22:06.664973 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:22:06.664973 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:22:06.664973 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:22:06.664973 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:22:06.664973 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:22:06.664973 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:22:06.664973 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:22:06.664973 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:22:06.664973 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:22:06.664973 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:22:06.664973 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:22:06.664973 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:22:06.665997 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 23 21:22:06.665997 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 23 21:22:06.665997 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 23 21:22:06.665997 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:22:06.665997 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:22:06.665997 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:22:06.665997 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:22:06.665997 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:22:06.665997 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:22:06.665997 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:22:06.665997 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:22:06.665997 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 23 21:22:06.665997 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:22:06.665997 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2a700a4c-e96a-45d3-81ca-aebd33610153 tempest-ImagesDeleteNegativeTestJSON-1581898113 tempest-ImagesDeleteNegativeTestJSON-1581898113-project] Returning 404 to user: Image not found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:22:06.665997 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2a700a4c-e96a-45d3-81ca-aebd33610153 tempest-ImagesDeleteNegativeTestJSON-1581898113 tempest-ImagesDeleteNegativeTestJSON-1581898113-project] 10.222.0.17 "DELETE /compute/v2.1/images/tempest-invalid-1456770159" status: 404 len: 62 microversion: 2.1 time: 0.053375 Jul 23 21:22:06.670827 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1019/2049] 10.222.0.17 () {58 vars in 1205 bytes} [Sat Jul 23 21:22:06 2022] DELETE /compute/v2.1/images/tempest-invalid-1456770159 => generated 62 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 23 21:22:06.679485 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-05360100-43b8-4a23-a4cb-ff861f79a5f7 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-2039535598", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:22:06.769563 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-05360100-43b8-4a23-a4cb-ff861f79a5f7 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] validate_networks() for None {{(pid=131320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:22:07.746466 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=13 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:22:08.190614 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-1be41a8d-b53b-4fce-9aae-5d6523ffa7a5 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] 10.222.0.17 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.989987 Jul 23 21:22:08.191909 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1031/2050] 10.222.0.17 () {60 vars in 1169 bytes} [Sat Jul 23 21:22:06 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1993 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:22:08.197826 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-05360100-43b8-4a23-a4cb-ff861f79a5f7 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:22:08.198290 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-05360100-43b8-4a23-a4cb-ff861f79a5f7 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:22:08.198779 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-05360100-43b8-4a23-a4cb-ff861f79a5f7 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:22:08.199199 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-05360100-43b8-4a23-a4cb-ff861f79a5f7 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:22:08.199625 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-05360100-43b8-4a23-a4cb-ff861f79a5f7 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:22:08.201068 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-be0d464a-7407-4956-9055-d207c2362209 tempest-ImagesDeleteNegativeTestJSON-1581898113 tempest-ImagesDeleteNegativeTestJSON-1581898113-project] Calling method '.version_select at 0x7f0b47601040>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:08.204928 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=100 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:22:08.218479 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-05360100-43b8-4a23-a4cb-ff861f79a5f7 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:08.220509 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-05360100-43b8-4a23-a4cb-ff861f79a5f7 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:08.228769 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-05360100-43b8-4a23-a4cb-ff861f79a5f7 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:08.230083 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-05360100-43b8-4a23-a4cb-ff861f79a5f7 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:08.232799 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-be0d464a-7407-4956-9055-d207c2362209 tempest-ImagesDeleteNegativeTestJSON-1581898113 tempest-ImagesDeleteNegativeTestJSON-1581898113-project] HTTP exception thrown: Image not found. Jul 23 21:22:08.236568 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-be0d464a-7407-4956-9055-d207c2362209 tempest-ImagesDeleteNegativeTestJSON-1581898113 tempest-ImagesDeleteNegativeTestJSON-1581898113-project] Request method failure captured: Jul 23 21:22:08.236568 ncdv-master-1 devstack@n-api.service[131321]: request: DELETE /compute/v2.1/images/5de47764-0c93-472a-8771-a7894f9429cb HTTP/1.1 Jul 23 21:22:08.236568 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:22:08.236568 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:22:08.236568 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:22:08.236568 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:22:08.236568 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:22:08.236568 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:22:08.236568 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:22:08.236568 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:22:08.236568 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GZ7UOFps0Dtd66sgKHkBe0SJm4jJY-p13a1nbKia_KEtiEotExGK55F3RCb5v1oggkrU0TRZ6ihs3ujwpW2da9GU446YAuTCNO6wAzDBnYhIGwUW0vYoEAUEmiwYpLwXmJhAwL_88ZZ6R4zjXKNKGdjuroYasY_4MCaB-KWtOfk_6I Jul 23 21:22:08.236568 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:22:08.236568 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:22:08.236568 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:22:08.236568 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:22:08.236568 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:22:08.236568 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:22:08.236568 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 1a6595adf7174855bf5dc685b2f3236d Jul 23 21:22:08.236568 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1581898113 Jul 23 21:22:08.236568 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:22:08.236568 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:22:08.238181 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1a6595adf7174855bf5dc685b2f3236d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1a6595adf7174855bf5dc685b2f3236d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1a6595adf7174855bf5dc685b2f3236d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1a6595adf7174855bf5dc685b2f3236d"}]}] Jul 23 21:22:08.238181 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1581898113 Jul 23 21:22:08.238181 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 1a6595adf7174855bf5dc685b2f3236d Jul 23 21:22:08.238181 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1581898113 Jul 23 21:22:08.238181 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ImagesDeleteNegativeTestJSON-1581898113-project Jul 23 21:22:08.238181 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:22:08.238181 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:22:08.238181 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 26d47a6490ce4b078919f59d93d47188 Jul 23 21:22:08.238181 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1581898113-project Jul 23 21:22:08.238181 ncdv-master-1 devstack@n-api.service[131321]: method: Jul 23 21:22:08.238181 ncdv-master-1 devstack@n-api.service[131321]: exception: Image not found. Jul 23 21:22:08.238181 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': '5de47764-0c93-472a-8771-a7894f9429cb'} Jul 23 21:22:08.238181 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:22:08.239056 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:22:08.239056 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 23 21:22:08.239056 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 23 21:22:08.239056 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 23 21:22:08.239056 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 23 21:22:08.239056 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 23 21:22:08.239056 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 23 21:22:08.239056 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 23 21:22:08.239056 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 23 21:22:08.239056 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 23 21:22:08.239056 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 23 21:22:08.239056 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 23 21:22:08.239056 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 23 21:22:08.239056 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 23 21:22:08.239056 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 23 21:22:08.239056 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 5de47764-0c93-472a-8771-a7894f9429cb to delete Jul 23 21:22:08.239056 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:22:08.239056 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:22:08.239056 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:22:08.239972 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:22:08.239972 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 23 21:22:08.239972 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 23 21:22:08.239972 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 23 21:22:08.239972 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 23 21:22:08.239972 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 23 21:22:08.239972 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 23 21:22:08.239972 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5de47764-0c93-472a-8771-a7894f9429cb could not be found. Jul 23 21:22:08.239972 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:22:08.239972 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:22:08.239972 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:22:08.239972 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:22:08.239972 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:22:08.239972 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:22:08.239972 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:22:08.239972 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:22:08.239972 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:22:08.239972 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:22:08.239972 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:22:08.239972 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:22:08.244563 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 23 21:22:08.244563 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 23 21:22:08.244563 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 23 21:22:08.244563 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:22:08.244563 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:22:08.244563 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:22:08.244563 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:22:08.244563 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:22:08.244563 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:22:08.244563 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:22:08.244563 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:22:08.244563 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 23 21:22:08.244563 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:22:08.244563 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-be0d464a-7407-4956-9055-d207c2362209 tempest-ImagesDeleteNegativeTestJSON-1581898113 tempest-ImagesDeleteNegativeTestJSON-1581898113-project] Returning 404 to user: Image not found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:22:08.244563 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-be0d464a-7407-4956-9055-d207c2362209 tempest-ImagesDeleteNegativeTestJSON-1581898113 tempest-ImagesDeleteNegativeTestJSON-1581898113-project] 10.222.0.17 "DELETE /compute/v2.1/images/5de47764-0c93-472a-8771-a7894f9429cb" status: 404 len: 62 microversion: 2.1 time: 0.042531 Jul 23 21:22:08.247826 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1032/2051] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:08 2022] DELETE /compute/v2.1/images/5de47764-0c93-472a-8771-a7894f9429cb => generated 62 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 23 21:22:08.255566 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-8633b12f-7e30-45e3-a5eb-c34360c46497 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:08.257788 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-8633b12f-7e30-45e3-a5eb-c34360c46497 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] [instance: 53347323-4870-4526-9020-1a3bc821d3fb] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:08.266477 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8633b12f-7e30-45e3-a5eb-c34360c46497 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:08.267449 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8633b12f-7e30-45e3-a5eb-c34360c46497 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:08.271044 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-05360100-43b8-4a23-a4cb-ff861f79a5f7 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Getting quotas for project 7e0f76ca9b734142a90c27f3d3de3a85. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:22:08.277660 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-05360100-43b8-4a23-a4cb-ff861f79a5f7 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Getting quotas for user c7acc7eae5f946aaac9f0c8ead2c8d58 and project 7e0f76ca9b734142a90c27f3d3de3a85. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:22:08.280134 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8633b12f-7e30-45e3-a5eb-c34360c46497 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:08.282573 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8633b12f-7e30-45e3-a5eb-c34360c46497 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:08.294909 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-05360100-43b8-4a23-a4cb-ff861f79a5f7 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Going to run 1 instances... {{(pid=131320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:22:08.298426 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-05360100-43b8-4a23-a4cb-ff861f79a5f7 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] [instance: 9aaaecf6-105b-4e72-82af-008d7590434f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:22:08.403420 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-05360100-43b8-4a23-a4cb-ff861f79a5f7 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.735726 Jul 23 21:22:08.405236 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1020/2052] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:22:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1739 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 23 21:22:08.412090 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d8ab7990-bbaf-4888-9312-cbc301f08170 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:08.413769 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d8ab7990-bbaf-4888-9312-cbc301f08170 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] [instance: 90289981-4474-419e-854a-eb36bbb721f4] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:08.423620 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d8ab7990-bbaf-4888-9312-cbc301f08170 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:08.424344 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d8ab7990-bbaf-4888-9312-cbc301f08170 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:08.425829 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d8ab7990-bbaf-4888-9312-cbc301f08170 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:08.426532 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d8ab7990-bbaf-4888-9312-cbc301f08170 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:08.759537 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-8633b12f-7e30-45e3-a5eb-c34360c46497 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf93a4b80cb4e19a36473986950fc75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c1943188684b45b636541caf587247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:08.772989 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-8633b12f-7e30-45e3-a5eb-c34360c46497 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] 10.222.0.17 "GET /compute/v2.1/servers/53347323-4870-4526-9020-1a3bc821d3fb" status: 200 len: 1463 microversion: 2.1 time: 0.532751 Jul 23 21:22:08.775203 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1033/2053] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:08 2022] GET /compute/v2.1/servers/53347323-4870-4526-9020-1a3bc821d3fb => generated 1463 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:08.782372 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a0cef9a4-de0b-4c88-a5a1-7ab3760963a1 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '.version_select at 0x7f0b5991e9d0>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:08.857606 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-a0cef9a4-de0b-4c88-a5a1-7ab3760963a1 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/images/38623b43-7126-4254-9186-2c489ddd994e" status: 200 len: 1453 microversion: 2.1 time: 0.080291 Jul 23 21:22:08.858935 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1034/2054] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:22:08 2022] GET /compute/v2.1/images/38623b43-7126-4254-9186-2c489ddd994e => generated 1453 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:08.877591 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-61fd5100-71ed-4374-b738-a4c0acae357b tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.4.243"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:22:08.879214 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-61fd5100-71ed-4374-b738-a4c0acae357b tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] [instance: 2cebd0e1-09ca-4eab-bda7-0743043bad23] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:08.892134 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-61fd5100-71ed-4374-b738-a4c0acae357b tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:08.893083 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-61fd5100-71ed-4374-b738-a4c0acae357b tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:08.894087 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-61fd5100-71ed-4374-b738-a4c0acae357b tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:08.894533 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-61fd5100-71ed-4374-b738-a4c0acae357b tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:08.940201 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-61fd5100-71ed-4374-b738-a4c0acae357b tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Acquired lock "refresh_cache-2cebd0e1-09ca-4eab-bda7-0743043bad23" {{(pid=131321) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 23 21:22:09.055512 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d8ab7990-bbaf-4888-9312-cbc301f08170 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc72b47672e46659b1a5ebdfd99224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cd9b8837554b8daf506ca062ec916b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:09.077290 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d8ab7990-bbaf-4888-9312-cbc301f08170 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] 10.222.0.17 "GET /compute/v2.1/servers/90289981-4474-419e-854a-eb36bbb721f4" status: 200 len: 1402 microversion: 2.1 time: 0.669813 Jul 23 21:22:09.080508 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1021/2055] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:08 2022] GET /compute/v2.1/servers/90289981-4474-419e-854a-eb36bbb721f4 => generated 1402 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:09.098839 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-864d2593-04d0-4024-9888-8bd454846bba tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:09.100616 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-864d2593-04d0-4024-9888-8bd454846bba tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] [instance: 9aaaecf6-105b-4e72-82af-008d7590434f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:09.491670 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-864d2593-04d0-4024-9888-8bd454846bba tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7acc7eae5f946aaac9f0c8ead2c8d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e0f76ca9b734142a90c27f3d3de3a85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:09.507757 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-864d2593-04d0-4024-9888-8bd454846bba tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] 10.222.0.17 "GET /compute/v2.1/servers/9aaaecf6-105b-4e72-82af-008d7590434f" status: 200 len: 1222 microversion: 2.1 time: 0.424072 Jul 23 21:22:09.514285 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1022/2056] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:09 2022] GET /compute/v2.1/servers/9aaaecf6-105b-4e72-82af-008d7590434f => generated 1222 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:09.531338 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-11aea911-725c-44ce-a76c-f91c8ffcfb82 req-5937c0c0-7909-4229-8915-2b3c460c425a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9933c901-3692-4f36-9f11-e1a93d902e94", "name": "network-vif-plugged", "status": "completed", "tag": "710f608f-25bd-47cb-9727-946c3bac499f"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:22:09.585673 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-11aea911-725c-44ce-a76c-f91c8ffcfb82 req-5937c0c0-7909-4229-8915-2b3c460c425a service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:09.586315 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-11aea911-725c-44ce-a76c-f91c8ffcfb82 req-5937c0c0-7909-4229-8915-2b3c460c425a service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:09.621625 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-11aea911-725c-44ce-a76c-f91c8ffcfb82 req-5937c0c0-7909-4229-8915-2b3c460c425a service nova] Creating event network-vif-plugged:710f608f-25bd-47cb-9727-946c3bac499f for instance 9933c901-3692-4f36-9f11-e1a93d902e94 on nch1-master-1 Jul 23 21:22:09.635288 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-11aea911-725c-44ce-a76c-f91c8ffcfb82 req-5937c0c0-7909-4229-8915-2b3c460c425a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118957 Jul 23 21:22:09.638545 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1023/2057] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:22:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:22:09.683798 ncdv-master-1 devstack@n-api.service[131321]: DEBUG neutronclient.v2_0.client [None req-61fd5100-71ed-4374-b738-a4c0acae357b tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.35.4.243 (d2cb0346-2106-42aa-91b3-11ae564faad7) with port d506fd59-3dd8-47d3-b895-177dd8661556 using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network b6eef43f-b538-43c4-bcc2-ec59ff7e8610.", "detail": ""}} {{(pid=131321) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 23 21:22:09.684475 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-61fd5100-71ed-4374-b738-a4c0acae357b tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Releasing lock "refresh_cache-2cebd0e1-09ca-4eab-bda7-0743043bad23" {{(pid=131321) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 23 21:22:09.685112 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-61fd5100-71ed-4374-b738-a4c0acae357b tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] HTTP exception thrown: Cannot associate floating IP 172.35.4.243 (d2cb0346-2106-42aa-91b3-11ae564faad7) with port d506fd59-3dd8-47d3-b895-177dd8661556 using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network b6eef43f-b538-43c4-bcc2-ec59ff7e8610. Jul 23 21:22:09.685112 ncdv-master-1 devstack@n-api.service[131321]: Neutron server returns request_ids: ['req-b0ddeb25-3637-49e4-81d5-658e845a5050'] Jul 23 21:22:09.688103 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-61fd5100-71ed-4374-b738-a4c0acae357b tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Request method failure captured: Jul 23 21:22:09.688103 ncdv-master-1 devstack@n-api.service[131321]: request: POST /compute/v2.1/servers/2cebd0e1-09ca-4eab-bda7-0743043bad23/action HTTP/1.1 Jul 23 21:22:09.688103 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:22:09.688103 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:22:09.688103 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:22:09.688103 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 46 Jul 23 21:22:09.688103 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:22:09.688103 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:22:09.688103 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:22:09.688103 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:22:09.688103 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GZYQX4roJlQevhBkA9pMfkC9djkQNhEXe41-IIk_hz1dSFoIFpPCQ2m5AEPXJJBQGNAMjbsTRRiDmidChznQIU_qEtASKDQUSEMkWkElq02-TRTpVvzgVXEI44D79323V4Xa0KfYl-gncyheU7x0wG3LJWDvwKdFgR5hDKry9HF3Mo Jul 23 21:22:09.688103 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:22:09.688103 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:22:09.688103 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:22:09.688103 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:22:09.688103 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:22:09.688103 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:22:09.688103 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 3d87ea887fea457fb07731d47de68333 Jul 23 21:22:09.688103 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-793914881 Jul 23 21:22:09.688103 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:22:09.688103 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:22:09.689405 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3d87ea887fea457fb07731d47de68333"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3d87ea887fea457fb07731d47de68333"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3d87ea887fea457fb07731d47de68333", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3d87ea887fea457fb07731d47de68333"}]}] Jul 23 21:22:09.689405 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-793914881 Jul 23 21:22:09.689405 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 3d87ea887fea457fb07731d47de68333 Jul 23 21:22:09.689405 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-793914881 Jul 23 21:22:09.689405 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project Jul 23 21:22:09.689405 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:22:09.689405 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:22:09.689405 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 672d90d732a0419ca669e0055359dcfd Jul 23 21:22:09.689405 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project Jul 23 21:22:09.689405 ncdv-master-1 devstack@n-api.service[131321]: Jul 23 21:22:09.689405 ncdv-master-1 devstack@n-api.service[131321]: {"addFloatingIp": {"address": "172.35.4.243"}} Jul 23 21:22:09.689405 ncdv-master-1 devstack@n-api.service[131321]: method: Jul 23 21:22:09.690071 ncdv-master-1 devstack@n-api.service[131321]: exception: Cannot associate floating IP 172.35.4.243 (d2cb0346-2106-42aa-91b3-11ae564faad7) with port d506fd59-3dd8-47d3-b895-177dd8661556 using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network b6eef43f-b538-43c4-bcc2-ec59ff7e8610. Jul 23 21:22:09.690071 ncdv-master-1 devstack@n-api.service[131321]: Neutron server returns request_ids: ['req-b0ddeb25-3637-49e4-81d5-658e845a5050'] Jul 23 21:22:09.690071 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': '2cebd0e1-09ca-4eab-bda7-0743043bad23', 'body': {'addFloatingIp': {'address': '172.35.4.243'}}} Jul 23 21:22:09.690071 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:22:09.690071 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:22:09.690071 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2706, in associate_floating_ip Jul 23 21:22:09.690071 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Jul 23 21:22:09.690071 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:22:09.690071 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:22:09.690071 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1014, in update_floatingip Jul 23 21:22:09.690071 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Jul 23 21:22:09.690071 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:22:09.690071 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:22:09.690071 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2520, in _update_resource Jul 23 21:22:09.690071 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Jul 23 21:22:09.690071 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:22:09.690071 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:22:09.690902 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Jul 23 21:22:09.690902 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Jul 23 21:22:09.690902 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:22:09.690902 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:22:09.690902 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 23 21:22:09.690902 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 23 21:22:09.690902 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:22:09.690902 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:22:09.690902 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 23 21:22:09.690902 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 23 21:22:09.690902 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:22:09.690902 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:22:09.690902 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 23 21:22:09.690902 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 23 21:22:09.690902 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 23 21:22:09.690902 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 23 21:22:09.691837 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.35.4.243 (d2cb0346-2106-42aa-91b3-11ae564faad7) with port d506fd59-3dd8-47d3-b895-177dd8661556 using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network b6eef43f-b538-43c4-bcc2-ec59ff7e8610. Jul 23 21:22:09.691837 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b0ddeb25-3637-49e4-81d5-658e845a5050'] Jul 23 21:22:09.691837 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:22:09.691837 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:22:09.691837 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:22:09.691837 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:22:09.691837 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Jul 23 21:22:09.691837 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Jul 23 21:22:09.691837 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Jul 23 21:22:09.691837 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Jul 23 21:22:09.691837 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2708, in associate_floating_ip Jul 23 21:22:09.691837 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Jul 23 21:22:09.691837 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.35.4.243 (d2cb0346-2106-42aa-91b3-11ae564faad7) with port d506fd59-3dd8-47d3-b895-177dd8661556 using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network b6eef43f-b538-43c4-bcc2-ec59ff7e8610. Jul 23 21:22:09.691837 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b0ddeb25-3637-49e4-81d5-658e845a5050'] Jul 23 21:22:09.691837 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:22:09.691837 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:22:09.694171 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:22:09.694171 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:22:09.694171 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:22:09.694171 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:22:09.694171 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:22:09.694171 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:22:09.694171 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:22:09.694171 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:22:09.694171 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:22:09.694171 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:22:09.694171 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:22:09.694171 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:22:09.694171 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Jul 23 21:22:09.694171 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Jul 23 21:22:09.694171 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.35.4.243 (d2cb0346-2106-42aa-91b3-11ae564faad7) with port d506fd59-3dd8-47d3-b895-177dd8661556 using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network b6eef43f-b538-43c4-bcc2-ec59ff7e8610. Jul 23 21:22:09.694171 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b0ddeb25-3637-49e4-81d5-658e845a5050'] Jul 23 21:22:09.694171 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:22:09.694171 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:22:09.697216 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:22:09.697216 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:22:09.697216 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:22:09.697216 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:22:09.697216 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:22:09.697216 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:22:09.697216 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.35.4.243 (d2cb0346-2106-42aa-91b3-11ae564faad7) with port d506fd59-3dd8-47d3-b895-177dd8661556 using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network b6eef43f-b538-43c4-bcc2-ec59ff7e8610. Jul 23 21:22:09.697216 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b0ddeb25-3637-49e4-81d5-658e845a5050'] Jul 23 21:22:09.697216 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:22:09.699585 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-61fd5100-71ed-4374-b738-a4c0acae357b tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Returning 400 to user: Cannot associate floating IP 172.35.4.243 (d2cb0346-2106-42aa-91b3-11ae564faad7) with port d506fd59-3dd8-47d3-b895-177dd8661556 using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network b6eef43f-b538-43c4-bcc2-ec59ff7e8610. Jul 23 21:22:09.699585 ncdv-master-1 devstack@n-api.service[131321]: Neutron server returns request_ids: ['req-b0ddeb25-3637-49e4-81d5-658e845a5050'] {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:22:09.701131 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-61fd5100-71ed-4374-b738-a4c0acae357b tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] 10.222.0.17 "POST /compute/v2.1/servers/2cebd0e1-09ca-4eab-bda7-0743043bad23/action" status: 400 len: 381 microversion: 2.1 time: 0.840959 Jul 23 21:22:09.707029 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1035/2058] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:22:08 2022] POST /compute/v2.1/servers/2cebd0e1-09ca-4eab-bda7-0743043bad23/action => generated 381 bytes in 847 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 23 21:22:09.719567 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-bf136464-05c4-4245-b211-3cb6e81f575a req-b84b8831-4d3b-4f40-9f98-071995619ab9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90289981-4474-419e-854a-eb36bbb721f4", "tag": "713d4ed6-d82d-4876-a416-2b294c9cd4bd"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:22:09.758183 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-bf136464-05c4-4245-b211-3cb6e81f575a req-b84b8831-4d3b-4f40-9f98-071995619ab9 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:09.761394 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-bf136464-05c4-4245-b211-3cb6e81f575a req-b84b8831-4d3b-4f40-9f98-071995619ab9 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:09.804623 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-bf136464-05c4-4245-b211-3cb6e81f575a req-b84b8831-4d3b-4f40-9f98-071995619ab9 service nova] Creating event network-changed:713d4ed6-d82d-4876-a416-2b294c9cd4bd for instance 90289981-4474-419e-854a-eb36bbb721f4 on nch1-master-1 Jul 23 21:22:09.816669 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-bf136464-05c4-4245-b211-3cb6e81f575a req-b84b8831-4d3b-4f40-9f98-071995619ab9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106729 Jul 23 21:22:09.819914 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1036/2059] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:22:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:22:09.834208 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-af8ef4ba-08eb-44f2-8dad-dee7c3aa3d55 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Calling method '.version_select at 0x7f0b4760be50>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:10.206628 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2c290652-07ab-40a3-83aa-057d1587f049 tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:10.232121 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-2c290652-07ab-40a3-83aa-057d1587f049 tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] Searching by: {'deleted': False, 'project_id': 'f76f4ad9750349ef83781bf6ea23416f'} {{(pid=131320) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 23 21:22:10.257632 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2c290652-07ab-40a3-83aa-057d1587f049 tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:10.259696 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2c290652-07ab-40a3-83aa-057d1587f049 tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:10.261522 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2c290652-07ab-40a3-83aa-057d1587f049 tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:10.262656 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2c290652-07ab-40a3-83aa-057d1587f049 tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:10.466864 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2c290652-07ab-40a3-83aa-057d1587f049 tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.827021 Jul 23 21:22:10.482389 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1024/2060] 10.222.0.17 () {58 vars in 1145 bytes} [Sat Jul 23 21:22:09 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 23 21:22:10.496367 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1f46eb9e-9a40-4ab0-a91c-b49f3139c977 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '.version_select at 0x7f0b598d39d0>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:10.588612 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1f46eb9e-9a40-4ab0-a91c-b49f3139c977 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/images/38623b43-7126-4254-9186-2c489ddd994e" status: 200 len: 1453 microversion: 2.1 time: 0.100536 Jul 23 21:22:10.590736 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1025/2061] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:22:10 2022] GET /compute/v2.1/images/38623b43-7126-4254-9186-2c489ddd994e => generated 1453 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:10.612052 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e549437a-9b69-445f-89bc-6dd1ea074725 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:10.615789 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e549437a-9b69-445f-89bc-6dd1ea074725 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] [instance: 90289981-4474-419e-854a-eb36bbb721f4] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:10.666673 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e549437a-9b69-445f-89bc-6dd1ea074725 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:10.667365 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e549437a-9b69-445f-89bc-6dd1ea074725 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:10.670194 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e549437a-9b69-445f-89bc-6dd1ea074725 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:10.670915 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e549437a-9b69-445f-89bc-6dd1ea074725 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:10.795635 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell0:SELECT=2 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:22:10.839626 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell0:SELECT=34 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:22:11.890761 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-af8ef4ba-08eb-44f2-8dad-dee7c3aa3d55 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] 10.222.0.17 "DELETE /compute/v2.1/os-floating-ips/d2cb0346-2106-42aa-91b3-11ae564faad7" status: 202 len: 0 microversion: 2.1 time: 2.067954 Jul 23 21:22:11.891846 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1037/2062] 10.222.0.17 () {58 vars in 1262 bytes} [Sat Jul 23 21:22:09 2022] DELETE /compute/v2.1/os-floating-ips/d2cb0346-2106-42aa-91b3-11ae564faad7 => generated 0 bytes in 2071 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:22:11.901002 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-32ffe712-333a-4195-94fd-e3d157ecede7 tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:11.911213 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-32ffe712-333a-4195-94fd-e3d157ecede7 tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] Searching by: {'deleted': False} {{(pid=131321) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 23 21:22:11.920514 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-32ffe712-333a-4195-94fd-e3d157ecede7 tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:11.921370 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-32ffe712-333a-4195-94fd-e3d157ecede7 tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:11.922572 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-32ffe712-333a-4195-94fd-e3d157ecede7 tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:11.923160 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-32ffe712-333a-4195-94fd-e3d157ecede7 tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:11.946242 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e549437a-9b69-445f-89bc-6dd1ea074725 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc72b47672e46659b1a5ebdfd99224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cd9b8837554b8daf506ca062ec916b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:11.960409 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e549437a-9b69-445f-89bc-6dd1ea074725 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] 10.222.0.17 "GET /compute/v2.1/servers/90289981-4474-419e-854a-eb36bbb721f4" status: 200 len: 1402 microversion: 2.1 time: 1.360590 Jul 23 21:22:11.961475 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1026/2063] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:10 2022] GET /compute/v2.1/servers/90289981-4474-419e-854a-eb36bbb721f4 => generated 1402 bytes in 1366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:11.974503 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b1a96de9-a44e-4942-a6de-e5445ea012b5 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:11.975499 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b1a96de9-a44e-4942-a6de-e5445ea012b5 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] [instance: 9aaaecf6-105b-4e72-82af-008d7590434f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:11.993278 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b1a96de9-a44e-4942-a6de-e5445ea012b5 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:11.994735 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b1a96de9-a44e-4942-a6de-e5445ea012b5 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:11.996351 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b1a96de9-a44e-4942-a6de-e5445ea012b5 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:11.998194 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b1a96de9-a44e-4942-a6de-e5445ea012b5 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:12.111607 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.multi_cell_list [None req-32ffe712-333a-4195-94fd-e3d157ecede7 tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] Listed batch of 10 results from cell out of 1000 limit. Returned 10 total so far. {{(pid=131321) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 23 21:22:12.202668 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b1a96de9-a44e-4942-a6de-e5445ea012b5 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7acc7eae5f946aaac9f0c8ead2c8d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e0f76ca9b734142a90c27f3d3de3a85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:12.212395 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b1a96de9-a44e-4942-a6de-e5445ea012b5 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] 10.222.0.17 "GET /compute/v2.1/servers/9aaaecf6-105b-4e72-82af-008d7590434f" status: 200 len: 1280 microversion: 2.1 time: 0.248573 Jul 23 21:22:12.213819 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1027/2064] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:11 2022] GET /compute/v2.1/servers/9aaaecf6-105b-4e72-82af-008d7590434f => generated 1280 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:12.214118 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-32ffe712-333a-4195-94fd-e3d157ecede7 tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:12.214841 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-32ffe712-333a-4195-94fd-e3d157ecede7 tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:12.222952 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-529dedfb-8644-4179-b4b3-e34a8b47174c tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '.version_select at 0x7f0b59901b80>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:12.280543 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-529dedfb-8644-4179-b4b3-e34a8b47174c tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/images/38623b43-7126-4254-9186-2c489ddd994e" status: 200 len: 1453 microversion: 2.1 time: 0.063881 Jul 23 21:22:12.281920 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1028/2065] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:22:12 2022] GET /compute/v2.1/images/38623b43-7126-4254-9186-2c489ddd994e => generated 1453 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:12.608432 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a0f75b10-b179-4672-ad72-d0416856e3f4 tempest-ListImagesTestJSON-1486055129 tempest-ListImagesTestJSON-1486055129-project] Calling method '.version_select at 0x7f0b598d3f70>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:12.692729 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a0f75b10-b179-4672-ad72-d0416856e3f4 tempest-ListImagesTestJSON-1486055129 tempest-ListImagesTestJSON-1486055129-project] 10.222.0.17 "GET /compute/v2.1/images/b27b20aa-ef1b-4dd1-989e-321af6343d6a" status: 200 len: 784 microversion: 2.1 time: 0.407884 Jul 23 21:22:12.695122 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1029/2066] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:22:12 2022] GET /compute/v2.1/images/b27b20aa-ef1b-4dd1-989e-321af6343d6a => generated 784 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:22:12.703014 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-112ead3d-a8c6-491d-80c1-58c72c9de487 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Action: 'action', calling method: .version_select at 0x7f0b56e7c430>, body: {"removeFloatingIp": {"address": "172.35.4.55"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:22:12.837606 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-32ffe712-333a-4195-94fd-e3d157ecede7 tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 17371 microversion: 2.1 time: 0.940418 Jul 23 21:22:12.838848 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1038/2067] 10.222.0.17 () {58 vars in 1170 bytes} [Sat Jul 23 21:22:11 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 17371 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 23 21:22:12.939121 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-2121878d-a8f1-4373-8c5b-17a678737488 tempest-ServersTestBootFromVolume-253143402 tempest-ServersTestBootFromVolume-253143402-project] Action: 'create', calling method: .version_select at 0x7f0b47601ee0>, body: {"keypair": {"name": "tempest-keypair-896843045", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMM4lcRGWBb4qmxb2w9zitQoTnWeJoLiiFGsmzYl39xcWvY5FRJHvQ+vWHxawtK1nWZ+jniSZbk8kzfKYs/VFNugYDpxxD69GkBHXwpNSOEbJIrpBrioEsB6fxuepQ6c3A=="}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:22:12.963125 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-2121878d-a8f1-4373-8c5b-17a678737488 tempest-ServersTestBootFromVolume-253143402 tempest-ServersTestBootFromVolume-253143402-project] Getting quotas for project ab066f574cfe4405bf9ed948b81c8f24. Resources: {'key_pairs'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:22:12.965764 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:22:12.973046 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-2121878d-a8f1-4373-8c5b-17a678737488 tempest-ServersTestBootFromVolume-253143402 tempest-ServersTestBootFromVolume-253143402-project] Getting quotas for user ba49c745133b44f99ee9a7e4aa86dd54 and project ab066f574cfe4405bf9ed948b81c8f24. Resources: {'key_pairs'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:22:13.017272 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-2121878d-a8f1-4373-8c5b-17a678737488 tempest-ServersTestBootFromVolume-253143402 tempest-ServersTestBootFromVolume-253143402-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.177108 Jul 23 21:22:13.018013 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1039/2068] 10.222.0.17 () {60 vars in 1158 bytes} [Sat Jul 23 21:22:12 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:22:13.040251 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-9633bece-46f2-473c-84cf-a90e0edc042e tempest-ListImagesTestJSON-1486055129 tempest-ListImagesTestJSON-1486055129-project] Calling method '.version_select at 0x7f0b47601940>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:13.128939 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-112ead3d-a8c6-491d-80c1-58c72c9de487 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] [instance: 2cebd0e1-09ca-4eab-bda7-0743043bad23] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:13.135561 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-112ead3d-a8c6-491d-80c1-58c72c9de487 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:13.136150 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-112ead3d-a8c6-491d-80c1-58c72c9de487 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:13.137045 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-112ead3d-a8c6-491d-80c1-58c72c9de487 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:13.148098 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-112ead3d-a8c6-491d-80c1-58c72c9de487 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:13.270973 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-9633bece-46f2-473c-84cf-a90e0edc042e tempest-ListImagesTestJSON-1486055129 tempest-ListImagesTestJSON-1486055129-project] 10.222.0.17 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.249803 Jul 23 21:22:13.274205 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1040/2069] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:22:13 2022] GET /compute/v2.1/images => generated 445 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:22:13.290273 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c02be058-663e-444b-acfb-e09c085ffbde tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:13.297328 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-c02be058-663e-444b-acfb-e09c085ffbde tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] Searching by: {'deleted': False, 'project_id': 'f76f4ad9750349ef83781bf6ea23416f'} {{(pid=131321) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 23 21:22:13.314439 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c02be058-663e-444b-acfb-e09c085ffbde tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:13.316020 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c02be058-663e-444b-acfb-e09c085ffbde tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:13.317964 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c02be058-663e-444b-acfb-e09c085ffbde tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:13.320933 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c02be058-663e-444b-acfb-e09c085ffbde tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:13.477424 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-c02be058-663e-444b-acfb-e09c085ffbde tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/detail?tenant_id=35c1943188684b45b636541caf587247" status: 200 len: 15 microversion: 2.1 time: 0.201269 Jul 23 21:22:13.478860 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1041/2070] 10.222.0.17 () {58 vars in 1230 bytes} [Sat Jul 23 21:22:13 2022] GET /compute/v2.1/servers/detail?tenant_id=35c1943188684b45b636541caf587247 => generated 15 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 23 21:22:13.484858 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-b2254ade-a124-4566-ab81-3abff2ad3539 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:13.485794 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-b2254ade-a124-4566-ab81-3abff2ad3539 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] [instance: 90289981-4474-419e-854a-eb36bbb721f4] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:13.493530 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b2254ade-a124-4566-ab81-3abff2ad3539 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:13.494946 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b2254ade-a124-4566-ab81-3abff2ad3539 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:13.496373 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b2254ade-a124-4566-ab81-3abff2ad3539 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:13.496966 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b2254ade-a124-4566-ab81-3abff2ad3539 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:14.065931 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-112ead3d-a8c6-491d-80c1-58c72c9de487 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Acquired lock "refresh_cache-2cebd0e1-09ca-4eab-bda7-0743043bad23" {{(pid=131320) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 23 21:22:14.392029 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-b2254ade-a124-4566-ab81-3abff2ad3539 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc72b47672e46659b1a5ebdfd99224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cd9b8837554b8daf506ca062ec916b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:14.409728 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-b2254ade-a124-4566-ab81-3abff2ad3539 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] 10.222.0.17 "GET /compute/v2.1/servers/90289981-4474-419e-854a-eb36bbb721f4" status: 200 len: 1402 microversion: 2.1 time: 0.929393 Jul 23 21:22:14.413513 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1042/2071] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:13 2022] GET /compute/v2.1/servers/90289981-4474-419e-854a-eb36bbb721f4 => generated 1402 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:14.437982 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-b8983521-27a4-4776-8435-a1421b793e42 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:14.441757 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-b8983521-27a4-4776-8435-a1421b793e42 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] [instance: 9aaaecf6-105b-4e72-82af-008d7590434f] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:14.457927 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b8983521-27a4-4776-8435-a1421b793e42 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:14.458608 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b8983521-27a4-4776-8435-a1421b793e42 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:14.461653 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b8983521-27a4-4776-8435-a1421b793e42 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:14.461653 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b8983521-27a4-4776-8435-a1421b793e42 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:14.880409 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-b8983521-27a4-4776-8435-a1421b793e42 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7acc7eae5f946aaac9f0c8ead2c8d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e0f76ca9b734142a90c27f3d3de3a85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:14.898274 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-b8983521-27a4-4776-8435-a1421b793e42 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] 10.222.0.17 "GET /compute/v2.1/servers/9aaaecf6-105b-4e72-82af-008d7590434f" status: 200 len: 1322 microversion: 2.1 time: 0.473404 Jul 23 21:22:14.898886 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1043/2072] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:14 2022] GET /compute/v2.1/servers/9aaaecf6-105b-4e72-82af-008d7590434f => generated 1322 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:14.905740 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ab212995-5983-44d0-945d-60ed595ea7fc tempest-ListImagesTestJSON-1486055129 tempest-ListImagesTestJSON-1486055129-project] Calling method '.version_select at 0x7f0b476014c0>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:15.002874 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-ab212995-5983-44d0-945d-60ed595ea7fc tempest-ListImagesTestJSON-1486055129 tempest-ListImagesTestJSON-1486055129-project] 10.222.0.17 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.102867 Jul 23 21:22:15.003462 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1044/2073] 10.222.0.17 () {58 vars in 1142 bytes} [Sat Jul 23 21:22:14 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:22:15.017080 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e94ca49e-49e1-4c14-a44b-dd415bcc41dc tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '.version_select at 0x7f0b475c4790>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:15.098981 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-e94ca49e-49e1-4c14-a44b-dd415bcc41dc tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/images/38623b43-7126-4254-9186-2c489ddd994e" status: 200 len: 1453 microversion: 2.1 time: 0.094266 Jul 23 21:22:15.105448 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1045/2074] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:22:15 2022] GET /compute/v2.1/images/38623b43-7126-4254-9186-2c489ddd994e => generated 1453 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:15.114453 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-b1de39aa-9e4a-459d-a2fc-aa59e0979c17 tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:15.123532 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-b1de39aa-9e4a-459d-a2fc-aa59e0979c17 tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] Searching by: {'tenant_id': '35c1943188684b45b636541caf587247', 'deleted': False} {{(pid=131321) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 23 21:22:15.129565 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b1de39aa-9e4a-459d-a2fc-aa59e0979c17 tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:15.130259 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b1de39aa-9e4a-459d-a2fc-aa59e0979c17 tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:15.131322 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b1de39aa-9e4a-459d-a2fc-aa59e0979c17 tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:15.131932 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b1de39aa-9e4a-459d-a2fc-aa59e0979c17 tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:15.181090 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.multi_cell_list [None req-b1de39aa-9e4a-459d-a2fc-aa59e0979c17 tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=131321) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 23 21:22:15.416676 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b1de39aa-9e4a-459d-a2fc-aa59e0979c17 tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:15.419116 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b1de39aa-9e4a-459d-a2fc-aa59e0979c17 tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:15.822584 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-b1de39aa-9e4a-459d-a2fc-aa59e0979c17 tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=35c1943188684b45b636541caf587247" status: 200 len: 4825 microversion: 2.1 time: 0.715867 Jul 23 21:22:15.824033 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1046/2075] 10.222.0.17 () {58 vars in 1256 bytes} [Sat Jul 23 21:22:15 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=35c1943188684b45b636541caf587247 => generated 4825 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:15.850297 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-eb8bebd0-a93e-41dc-95a1-e55468c02e83 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:15.861222 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-eb8bebd0-a93e-41dc-95a1-e55468c02e83 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] [instance: 90289981-4474-419e-854a-eb36bbb721f4] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:15.886177 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-eb8bebd0-a93e-41dc-95a1-e55468c02e83 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:15.886716 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-eb8bebd0-a93e-41dc-95a1-e55468c02e83 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:15.887617 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-eb8bebd0-a93e-41dc-95a1-e55468c02e83 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:15.888267 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-eb8bebd0-a93e-41dc-95a1-e55468c02e83 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:16.536786 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-eb8bebd0-a93e-41dc-95a1-e55468c02e83 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc72b47672e46659b1a5ebdfd99224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cd9b8837554b8daf506ca062ec916b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:16.550106 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-eb8bebd0-a93e-41dc-95a1-e55468c02e83 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] 10.222.0.17 "GET /compute/v2.1/servers/90289981-4474-419e-854a-eb36bbb721f4" status: 200 len: 1402 microversion: 2.1 time: 0.723844 Jul 23 21:22:16.551726 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1047/2076] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:15 2022] GET /compute/v2.1/servers/90289981-4474-419e-854a-eb36bbb721f4 => generated 1402 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:16.561439 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e3af2450-4156-4fad-9bc0-9c222c92a8e1 tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:16.567169 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-e3af2450-4156-4fad-9bc0-9c222c92a8e1 tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] Searching by: {'tenant_id': 'f76f4ad9750349ef83781bf6ea23416f', 'deleted': False} {{(pid=131321) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 23 21:22:16.573996 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e3af2450-4156-4fad-9bc0-9c222c92a8e1 tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:16.576363 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e3af2450-4156-4fad-9bc0-9c222c92a8e1 tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:16.582384 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e3af2450-4156-4fad-9bc0-9c222c92a8e1 tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:16.584020 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e3af2450-4156-4fad-9bc0-9c222c92a8e1 tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:16.619977 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:22:16.637579 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-e3af2450-4156-4fad-9bc0-9c222c92a8e1 tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=f76f4ad9750349ef83781bf6ea23416f" status: 200 len: 15 microversion: 2.1 time: 0.083270 Jul 23 21:22:16.639059 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1048/2077] 10.222.0.17 () {58 vars in 1256 bytes} [Sat Jul 23 21:22:16 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=f76f4ad9750349ef83781bf6ea23416f => generated 15 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 23 21:22:16.646371 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-22a17266-aeb6-4e8a-a3fb-ececfcc65518 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:16.647140 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-22a17266-aeb6-4e8a-a3fb-ececfcc65518 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] [instance: 9aaaecf6-105b-4e72-82af-008d7590434f] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:16.659293 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-22a17266-aeb6-4e8a-a3fb-ececfcc65518 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:16.660241 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-22a17266-aeb6-4e8a-a3fb-ececfcc65518 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:16.661250 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-22a17266-aeb6-4e8a-a3fb-ececfcc65518 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:16.661880 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-22a17266-aeb6-4e8a-a3fb-ececfcc65518 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:17.029231 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-22a17266-aeb6-4e8a-a3fb-ececfcc65518 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7acc7eae5f946aaac9f0c8ead2c8d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e0f76ca9b734142a90c27f3d3de3a85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:17.038657 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-22a17266-aeb6-4e8a-a3fb-ececfcc65518 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] 10.222.0.17 "GET /compute/v2.1/servers/9aaaecf6-105b-4e72-82af-008d7590434f" status: 200 len: 1322 microversion: 2.1 time: 0.398155 Jul 23 21:22:17.045719 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1049/2078] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:16 2022] GET /compute/v2.1/servers/9aaaecf6-105b-4e72-82af-008d7590434f => generated 1322 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:17.052676 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e08e375e-ddac-45a0-8c7f-52c39662fd5c tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '.version_select at 0x7f0b5991ea60>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:17.160980 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-e08e375e-ddac-45a0-8c7f-52c39662fd5c tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/images/38623b43-7126-4254-9186-2c489ddd994e" status: 200 len: 1453 microversion: 2.1 time: 0.113274 Jul 23 21:22:17.162314 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1050/2079] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:22:17 2022] GET /compute/v2.1/images/38623b43-7126-4254-9186-2c489ddd994e => generated 1453 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:17.172904 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-935a0f8a-a99c-46dc-802d-4d9becfdb82c tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:17.178630 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-935a0f8a-a99c-46dc-802d-4d9becfdb82c tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.014915 Jul 23 21:22:17.186789 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1051/2080] 10.222.0.17 () {58 vars in 1188 bytes} [Sat Jul 23 21:22:17 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 23 21:22:17.204431 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-4a40d6ed-3564-4d5c-adc2-212698e39586 tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:22:17.205401 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-4a40d6ed-3564-4d5c-adc2-212698e39586 tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] [instance: cef13563-7f83-4281-a26c-d5e420c41daf] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:17.221192 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4a40d6ed-3564-4d5c-adc2-212698e39586 tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:17.221830 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4a40d6ed-3564-4d5c-adc2-212698e39586 tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:17.232309 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4a40d6ed-3564-4d5c-adc2-212698e39586 tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:17.233477 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4a40d6ed-3564-4d5c-adc2-212698e39586 tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:17.449143 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-4a40d6ed-3564-4d5c-adc2-212698e39586 tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf/action" status: 202 len: 0 microversion: 2.1 time: 0.248574 Jul 23 21:22:17.450632 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1052/2081] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:22:17 2022] POST /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf/action => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:22:17.459311 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-4cda1d69-d4c1-4678-9aee-abcb94c206a4 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:17.466397 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-4cda1d69-d4c1-4678-9aee-abcb94c206a4 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ebf93a4b80cb4e19a36473986950fc75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c1943188684b45b636541caf587247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:17.469658 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-4cda1d69-d4c1-4678-9aee-abcb94c206a4 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '35c1943188684b45b636541caf587247'} {{(pid=131321) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 23 21:22:17.488624 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4cda1d69-d4c1-4678-9aee-abcb94c206a4 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:17.494229 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4cda1d69-d4c1-4678-9aee-abcb94c206a4 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:17.495420 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4cda1d69-d4c1-4678-9aee-abcb94c206a4 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:17.496904 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4cda1d69-d4c1-4678-9aee-abcb94c206a4 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:17.669778 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.multi_cell_list [None req-4cda1d69-d4c1-4678-9aee-abcb94c206a4 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131321) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 23 21:22:17.876275 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-4cda1d69-d4c1-4678-9aee-abcb94c206a4 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] 10.222.0.17 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.419723 Jul 23 21:22:17.883907 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1053/2082] 10.222.0.17 () {58 vars in 1149 bytes} [Sat Jul 23 21:22:17 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:22:17.894888 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-166a3873-d68d-4616-9a01-7a900fcae98a tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:17.895588 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-166a3873-d68d-4616-9a01-7a900fcae98a tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] [instance: 90289981-4474-419e-854a-eb36bbb721f4] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:17.916778 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-166a3873-d68d-4616-9a01-7a900fcae98a tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:17.917508 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-166a3873-d68d-4616-9a01-7a900fcae98a tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:17.918741 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-166a3873-d68d-4616-9a01-7a900fcae98a tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:17.919528 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-166a3873-d68d-4616-9a01-7a900fcae98a tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:18.228888 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-166a3873-d68d-4616-9a01-7a900fcae98a tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc72b47672e46659b1a5ebdfd99224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cd9b8837554b8daf506ca062ec916b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:18.252887 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-166a3873-d68d-4616-9a01-7a900fcae98a tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] 10.222.0.17 "GET /compute/v2.1/servers/90289981-4474-419e-854a-eb36bbb721f4" status: 200 len: 1402 microversion: 2.1 time: 0.365829 Jul 23 21:22:18.255110 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1054/2083] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:17 2022] GET /compute/v2.1/servers/90289981-4474-419e-854a-eb36bbb721f4 => generated 1402 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:18.269701 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ba25767f-2df1-43db-b991-88030b942004 tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:22:18.271707 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-ba25767f-2df1-43db-b991-88030b942004 tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] [instance: cef13563-7f83-4281-a26c-d5e420c41daf] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:18.295858 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ba25767f-2df1-43db-b991-88030b942004 tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:18.296180 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ba25767f-2df1-43db-b991-88030b942004 tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:18.299192 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ba25767f-2df1-43db-b991-88030b942004 tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:18.299786 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ba25767f-2df1-43db-b991-88030b942004 tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:18.511863 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-ba25767f-2df1-43db-b991-88030b942004 tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf/action" status: 202 len: 0 microversion: 2.1 time: 0.253581 Jul 23 21:22:18.514013 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1055/2084] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:22:18 2022] POST /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf/action => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:22:18.520488 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-88669ee3-086b-400a-91bb-76377788506d tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:18.521112 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-88669ee3-086b-400a-91bb-76377788506d tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] [instance: 9aaaecf6-105b-4e72-82af-008d7590434f] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:18.542044 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-88669ee3-086b-400a-91bb-76377788506d tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:18.542593 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-88669ee3-086b-400a-91bb-76377788506d tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:18.543376 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-88669ee3-086b-400a-91bb-76377788506d tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:18.543724 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-88669ee3-086b-400a-91bb-76377788506d tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:18.885113 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-88669ee3-086b-400a-91bb-76377788506d tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7acc7eae5f946aaac9f0c8ead2c8d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e0f76ca9b734142a90c27f3d3de3a85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:18.899533 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-88669ee3-086b-400a-91bb-76377788506d tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] 10.222.0.17 "GET /compute/v2.1/servers/9aaaecf6-105b-4e72-82af-008d7590434f" status: 200 len: 1322 microversion: 2.1 time: 0.384119 Jul 23 21:22:18.900843 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1056/2085] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:18 2022] GET /compute/v2.1/servers/9aaaecf6-105b-4e72-82af-008d7590434f => generated 1322 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:18.906911 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-b03b665a-4b33-42ae-8ad1-a4071a389617 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '.version_select at 0x7f0b5991ec10>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:18.978984 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-112ead3d-a8c6-491d-80c1-58c72c9de487 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] [instance: 2cebd0e1-09ca-4eab-bda7-0743043bad23] Building network info cache for instance {{(pid=131320) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 23 21:22:19.029551 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-b03b665a-4b33-42ae-8ad1-a4071a389617 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/images/38623b43-7126-4254-9186-2c489ddd994e" status: 200 len: 1453 microversion: 2.1 time: 0.127411 Jul 23 21:22:19.035237 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1057/2086] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:22:18 2022] GET /compute/v2.1/images/38623b43-7126-4254-9186-2c489ddd994e => generated 1453 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:19.040418 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-959171b2-9927-4bdd-9d87-16c34f0c6282 tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:19.044439 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-959171b2-9927-4bdd-9d87-16c34f0c6282 tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] [instance: cef13563-7f83-4281-a26c-d5e420c41daf] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:19.057899 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-959171b2-9927-4bdd-9d87-16c34f0c6282 tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:19.058383 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-959171b2-9927-4bdd-9d87-16c34f0c6282 tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:19.059305 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-959171b2-9927-4bdd-9d87-16c34f0c6282 tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:19.059679 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-959171b2-9927-4bdd-9d87-16c34f0c6282 tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:19.291582 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-959171b2-9927-4bdd-9d87-16c34f0c6282 tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf" status: 200 len: 1615 microversion: 2.1 time: 0.259834 Jul 23 21:22:19.292666 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1058/2087] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:19 2022] GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf => generated 1615 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:19.501273 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=8 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:22:19.651350 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-54c6372f-2624-4d62-bb01-5d381f4b42ae tempest-AbsoluteLimitsNegativeTestJSON-964742256 tempest-AbsoluteLimitsNegativeTestJSON-964742256-project] Calling method '.version_select at 0x7f0b59a12e50>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:19.672604 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-54c6372f-2624-4d62-bb01-5d381f4b42ae tempest-AbsoluteLimitsNegativeTestJSON-964742256 tempest-AbsoluteLimitsNegativeTestJSON-964742256-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:19.676536 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-54c6372f-2624-4d62-bb01-5d381f4b42ae tempest-AbsoluteLimitsNegativeTestJSON-964742256 tempest-AbsoluteLimitsNegativeTestJSON-964742256-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:19.679752 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-54c6372f-2624-4d62-bb01-5d381f4b42ae tempest-AbsoluteLimitsNegativeTestJSON-964742256 tempest-AbsoluteLimitsNegativeTestJSON-964742256-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:19.685607 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-54c6372f-2624-4d62-bb01-5d381f4b42ae tempest-AbsoluteLimitsNegativeTestJSON-964742256 tempest-AbsoluteLimitsNegativeTestJSON-964742256-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:19.734776 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-54c6372f-2624-4d62-bb01-5d381f4b42ae tempest-AbsoluteLimitsNegativeTestJSON-964742256 tempest-AbsoluteLimitsNegativeTestJSON-964742256-project] 10.222.0.17 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.440817 Jul 23 21:22:19.758285 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1059/2088] 10.222.0.17 () {58 vars in 1121 bytes} [Sat Jul 23 21:22:19 2022] GET /compute/v2.1/limits => generated 511 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:22:19.784712 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-8732db39-437d-437c-bae3-1efa314577e2 req-1ebcce97-6a29-49fc-bef7-addbd31d00ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2cebd0e1-09ca-4eab-bda7-0743043bad23", "tag": "d506fd59-3dd8-47d3-b895-177dd8661556"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:22:19.810662 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-8732db39-437d-437c-bae3-1efa314577e2 req-1ebcce97-6a29-49fc-bef7-addbd31d00ac service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:19.812388 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-8732db39-437d-437c-bae3-1efa314577e2 req-1ebcce97-6a29-49fc-bef7-addbd31d00ac service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:19.850314 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-8732db39-437d-437c-bae3-1efa314577e2 req-1ebcce97-6a29-49fc-bef7-addbd31d00ac service nova] Creating event network-changed:d506fd59-3dd8-47d3-b895-177dd8661556 for instance 2cebd0e1-09ca-4eab-bda7-0743043bad23 on nch2-master-1 Jul 23 21:22:19.864095 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-8732db39-437d-437c-bae3-1efa314577e2 req-1ebcce97-6a29-49fc-bef7-addbd31d00ac service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091158 Jul 23 21:22:19.866062 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1060/2089] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:22:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:22:19.876064 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-42444379-5acc-41f3-8a3d-f10baf30690c tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:19.877431 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-42444379-5acc-41f3-8a3d-f10baf30690c tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] [instance: 90289981-4474-419e-854a-eb36bbb721f4] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:19.889219 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-42444379-5acc-41f3-8a3d-f10baf30690c tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:19.891265 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-42444379-5acc-41f3-8a3d-f10baf30690c tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:19.896491 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-42444379-5acc-41f3-8a3d-f10baf30690c tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:19.897768 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-42444379-5acc-41f3-8a3d-f10baf30690c tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:20.263769 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-42444379-5acc-41f3-8a3d-f10baf30690c tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc72b47672e46659b1a5ebdfd99224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cd9b8837554b8daf506ca062ec916b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:20.278326 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-42444379-5acc-41f3-8a3d-f10baf30690c tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] 10.222.0.17 "GET /compute/v2.1/servers/90289981-4474-419e-854a-eb36bbb721f4" status: 200 len: 1402 microversion: 2.1 time: 0.408850 Jul 23 21:22:20.292994 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1061/2090] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:19 2022] GET /compute/v2.1/servers/90289981-4474-419e-854a-eb36bbb721f4 => generated 1402 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:20.304643 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-92997b8a-f1c4-49af-809b-c5d1b3a8d5fd tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:20.309920 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-92997b8a-f1c4-49af-809b-c5d1b3a8d5fd tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] [instance: cef13563-7f83-4281-a26c-d5e420c41daf] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:20.328197 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-92997b8a-f1c4-49af-809b-c5d1b3a8d5fd tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:20.329543 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-92997b8a-f1c4-49af-809b-c5d1b3a8d5fd tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:20.332863 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-92997b8a-f1c4-49af-809b-c5d1b3a8d5fd tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:20.334470 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-92997b8a-f1c4-49af-809b-c5d1b3a8d5fd tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:20.390887 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=4 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:22:20.687320 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-92997b8a-f1c4-49af-809b-c5d1b3a8d5fd tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf" status: 200 len: 1615 microversion: 2.1 time: 0.383696 Jul 23 21:22:20.688322 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1062/2091] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:20 2022] GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf => generated 1615 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:20.704213 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-ccbd13c1-f3ad-49ec-9a61-661a7fd12c07 req-45c3eae7-e996-4b77-af99-47903d0ea73b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90289981-4474-419e-854a-eb36bbb721f4", "name": "network-vif-plugged", "status": "completed", "tag": "713d4ed6-d82d-4876-a416-2b294c9cd4bd"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:22:20.717428 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-ccbd13c1-f3ad-49ec-9a61-661a7fd12c07 req-45c3eae7-e996-4b77-af99-47903d0ea73b service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:20.721975 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-ccbd13c1-f3ad-49ec-9a61-661a7fd12c07 req-45c3eae7-e996-4b77-af99-47903d0ea73b service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:20.753314 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-ccbd13c1-f3ad-49ec-9a61-661a7fd12c07 req-45c3eae7-e996-4b77-af99-47903d0ea73b service nova] Creating event network-vif-plugged:713d4ed6-d82d-4876-a416-2b294c9cd4bd for instance 90289981-4474-419e-854a-eb36bbb721f4 on nch1-master-1 Jul 23 21:22:20.763804 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-ccbd13c1-f3ad-49ec-9a61-661a7fd12c07 req-45c3eae7-e996-4b77-af99-47903d0ea73b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074224 Jul 23 21:22:20.767295 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1063/2092] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:22:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:22:20.776355 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c2bc9ca1-7bd5-43b6-83f1-6ec6c892a42e tempest-AbsoluteLimitsNegativeTestJSON-964742256 tempest-AbsoluteLimitsNegativeTestJSON-964742256-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-162493918", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:22:20.974953 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.network.neutron [None req-c2bc9ca1-7bd5-43b6-83f1-6ec6c892a42e tempest-AbsoluteLimitsNegativeTestJSON-964742256 tempest-AbsoluteLimitsNegativeTestJSON-964742256-project] validate_networks() for None {{(pid=131321) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:22:21.422024 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-c2bc9ca1-7bd5-43b6-83f1-6ec6c892a42e tempest-AbsoluteLimitsNegativeTestJSON-964742256 tempest-AbsoluteLimitsNegativeTestJSON-964742256-project] Getting quotas for project 3539382b7fc04ee3b0df6e1758251e5d. Resources: dict_keys(['metadata_items']) {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:22:21.430155 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-112ead3d-a8c6-491d-80c1-58c72c9de487 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] [instance: 2cebd0e1-09ca-4eab-bda7-0743043bad23] Updating instance_info_cache with network_info: [{"id": "d506fd59-3dd8-47d3-b895-177dd8661556", "address": "fa:16:3e:70:31:d7", "network": {"id": "9aac9607-dc4a-4309-87fe-407e0e39a44b", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1314645907-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "3d87ea887fea457fb07731d47de68333", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapd506fd59-3d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=131320) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 23 21:22:21.434299 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-c2bc9ca1-7bd5-43b6-83f1-6ec6c892a42e tempest-AbsoluteLimitsNegativeTestJSON-964742256 tempest-AbsoluteLimitsNegativeTestJSON-964742256-project] Getting quotas for user de804903007b4d67a89209614c63e985 and project 3539382b7fc04ee3b0df6e1758251e5d. Resources: dict_keys(['metadata_items']) {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:22:21.467512 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-c2bc9ca1-7bd5-43b6-83f1-6ec6c892a42e tempest-AbsoluteLimitsNegativeTestJSON-964742256 tempest-AbsoluteLimitsNegativeTestJSON-964742256-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Jul 23 21:22:21.469045 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-112ead3d-a8c6-491d-80c1-58c72c9de487 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Releasing lock "refresh_cache-2cebd0e1-09ca-4eab-bda7-0743043bad23" {{(pid=131320) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 23 21:22:21.473586 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-112ead3d-a8c6-491d-80c1-58c72c9de487 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] 10.222.0.17 "POST /compute/v2.1/servers/2cebd0e1-09ca-4eab-bda7-0743043bad23/action" status: 202 len: 0 microversion: 2.1 time: 8.777058 Jul 23 21:22:21.474339 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1030/2093] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:22:12 2022] POST /compute/v2.1/servers/2cebd0e1-09ca-4eab-bda7-0743043bad23/action => generated 0 bytes in 8779 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 23 21:22:21.475669 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c2bc9ca1-7bd5-43b6-83f1-6ec6c892a42e tempest-AbsoluteLimitsNegativeTestJSON-964742256 tempest-AbsoluteLimitsNegativeTestJSON-964742256-project] Request method failure captured: Jul 23 21:22:21.475669 ncdv-master-1 devstack@n-api.service[131321]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 23 21:22:21.475669 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:22:21.475669 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:22:21.475669 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:22:21.475669 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 1751 Jul 23 21:22:21.475669 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:22:21.475669 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:22:21.475669 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:22:21.475669 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:22:21.475669 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GaK8NxpCt-JoahjQ44FobD3JLjqCm3pT18zFDTNRP2RMhgIbye-UYk-sHQbRlCHLsJQoejvls7TeUxInr3q-QLruHxJ9Zy03B7VaNfWGi7bbraMNPhFySeHm7zCs6PhXMAhXrnxeZKO2uYz-01YjfM-yLSqj8eKccef-4kavilzaa0 Jul 23 21:22:21.475669 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:22:21.475669 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:22:21.475669 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:22:21.475669 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:22:21.475669 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:22:21.475669 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:22:21.475669 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 3539382b7fc04ee3b0df6e1758251e5d Jul 23 21:22:21.475669 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-964742256 Jul 23 21:22:21.475669 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:22:21.475669 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:22:21.475669 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3539382b7fc04ee3b0df6e1758251e5d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3539382b7fc04ee3b0df6e1758251e5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3539382b7fc04ee3b0df6e1758251e5d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3539382b7fc04ee3b0df6e1758251e5d"}]}] Jul 23 21:22:21.475669 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-964742256 Jul 23 21:22:21.475669 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 3539382b7fc04ee3b0df6e1758251e5d Jul 23 21:22:21.475669 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-964742256 Jul 23 21:22:21.475669 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-964742256-project Jul 23 21:22:21.475669 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:22:21.475669 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:22:21.475669 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: de804903007b4d67a89209614c63e985 Jul 23 21:22:21.475669 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-964742256-project Jul 23 21:22:21.475669 ncdv-master-1 devstack@n-api.service[131321]: Jul 23 21:22:21.475669 ncdv-master-1 devstack@n-api.service[131321]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-162493918", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Jul 23 21:22:21.475669 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:22:21.475669 ncdv-master-1 devstack@n-api.service[131321]: exception: Maximum number of metadata items exceeds 128 Jul 23 21:22:21.478239 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-162493918', 'imageRef': 'b27b20aa-ef1b-4dd1-989e-321af6343d6a', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Jul 23 21:22:21.478239 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:22:21.478239 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:22:21.478239 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 462, in _check_metadata_properties_quota Jul 23 21:22:21.478239 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Jul 23 21:22:21.478239 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 23 21:22:21.478239 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 23 21:22:21.478239 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Jul 23 21:22:21.478239 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Jul 23 21:22:21.478239 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Jul 23 21:22:21.478239 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Jul 23 21:22:21.478239 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Jul 23 21:22:21.478239 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Jul 23 21:22:21.478239 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Jul 23 21:22:21.478239 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:22:21.478239 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:22:21.478239 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:22:21.478239 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:22:21.478239 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 23 21:22:21.478239 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 23 21:22:21.478239 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 23 21:22:21.478239 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 23 21:22:21.478239 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1667, in _create_instance Jul 23 21:22:21.478239 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Jul 23 21:22:21.478239 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1002, in _checks_for_create_and_rebuild Jul 23 21:22:21.478239 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Jul 23 21:22:21.478239 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 469, in _check_metadata_properties_quota Jul 23 21:22:21.478239 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Jul 23 21:22:21.478239 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Jul 23 21:22:21.478239 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:22:21.478239 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:22:21.478239 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:22:21.478239 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:22:21.478239 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:22:21.478239 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:22:21.478239 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:22:21.478239 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:22:21.478239 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:22:21.478239 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:22:21.478239 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:22:21.478239 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:22:21.478239 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:22:21.478239 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:22:21.478239 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:22:21.480532 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:22:21.480532 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 23 21:22:21.480532 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jul 23 21:22:21.480532 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 23 21:22:21.480532 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Jul 23 21:22:21.480532 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:22:21.480532 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:22:21.480532 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:22:21.480532 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:22:21.480532 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:22:21.480532 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:22:21.480532 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:22:21.480532 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:22:21.480532 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Jul 23 21:22:21.480532 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:22:21.482239 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c2bc9ca1-7bd5-43b6-83f1-6ec6c892a42e tempest-AbsoluteLimitsNegativeTestJSON-964742256 tempest-AbsoluteLimitsNegativeTestJSON-964742256-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:22:21.483525 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-c2bc9ca1-7bd5-43b6-83f1-6ec6c892a42e tempest-AbsoluteLimitsNegativeTestJSON-964742256 tempest-AbsoluteLimitsNegativeTestJSON-964742256-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.712309 Jul 23 21:22:21.490983 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1064/2094] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 23 21:22:20 2022] POST /compute/v2.1/servers => generated 87 bytes in 723 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Jul 23 21:22:21.501187 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e5cd939b-ab01-4924-b1ff-2e2dd87cf4c3 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:21.501835 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e5cd939b-ab01-4924-b1ff-2e2dd87cf4c3 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] [instance: 9aaaecf6-105b-4e72-82af-008d7590434f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:21.507994 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a5a78202-6749-4c8c-a85b-fe7659946fee tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '.version_select at 0x7f0b4761a160>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:21.522065 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e5cd939b-ab01-4924-b1ff-2e2dd87cf4c3 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:21.522531 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e5cd939b-ab01-4924-b1ff-2e2dd87cf4c3 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:21.523855 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e5cd939b-ab01-4924-b1ff-2e2dd87cf4c3 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:21.524311 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e5cd939b-ab01-4924-b1ff-2e2dd87cf4c3 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:21.580884 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-a5a78202-6749-4c8c-a85b-fe7659946fee tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/images/38623b43-7126-4254-9186-2c489ddd994e" status: 200 len: 1453 microversion: 2.1 time: 0.088425 Jul 23 21:22:21.582786 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1065/2095] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:22:21 2022] GET /compute/v2.1/images/38623b43-7126-4254-9186-2c489ddd994e => generated 1453 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:21.594269 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-abf4b8ea-5a82-4da6-847b-059f8e48325b tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:21.602897 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-abf4b8ea-5a82-4da6-847b-059f8e48325b tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] Searching by: {'host': 'nch1-master-1', 'deleted': False} {{(pid=131321) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 23 21:22:21.610645 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-abf4b8ea-5a82-4da6-847b-059f8e48325b tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:21.611101 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-abf4b8ea-5a82-4da6-847b-059f8e48325b tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:21.612032 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-abf4b8ea-5a82-4da6-847b-059f8e48325b tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:21.612357 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-abf4b8ea-5a82-4da6-847b-059f8e48325b tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:21.871348 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.multi_cell_list [None req-abf4b8ea-5a82-4da6-847b-059f8e48325b tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] Listed batch of 5 results from cell out of 1000 limit. Returned 5 total so far. {{(pid=131321) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 23 21:22:21.894354 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e5cd939b-ab01-4924-b1ff-2e2dd87cf4c3 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7acc7eae5f946aaac9f0c8ead2c8d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e0f76ca9b734142a90c27f3d3de3a85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:21.911837 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e5cd939b-ab01-4924-b1ff-2e2dd87cf4c3 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] 10.222.0.17 "GET /compute/v2.1/servers/9aaaecf6-105b-4e72-82af-008d7590434f" status: 200 len: 1322 microversion: 2.1 time: 0.426470 Jul 23 21:22:21.926130 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1031/2096] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:21 2022] GET /compute/v2.1/servers/9aaaecf6-105b-4e72-82af-008d7590434f => generated 1322 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:21.933235 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-fea34ec0-bead-4b88-ad3b-2d97c6f599d8 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:21.935322 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-fea34ec0-bead-4b88-ad3b-2d97c6f599d8 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] [instance: 90289981-4474-419e-854a-eb36bbb721f4] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:21.951377 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fea34ec0-bead-4b88-ad3b-2d97c6f599d8 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:21.956788 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fea34ec0-bead-4b88-ad3b-2d97c6f599d8 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:21.959125 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fea34ec0-bead-4b88-ad3b-2d97c6f599d8 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:21.960652 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fea34ec0-bead-4b88-ad3b-2d97c6f599d8 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:21.998470 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-abf4b8ea-5a82-4da6-847b-059f8e48325b tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] 10.222.0.17 "GET /compute/v2.1/servers?host=nch1-master-1&all_tenants=1" status: 200 len: 1648 microversion: 2.1 time: 0.413189 Jul 23 21:22:22.007444 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1066/2097] 10.222.0.17 () {58 vars in 1189 bytes} [Sat Jul 23 21:22:21 2022] GET /compute/v2.1/servers?host=nch1-master-1&all_tenants=1 => generated 1648 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:22.014092 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-48c73d53-6b35-453c-b960-a65b46e3c701 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Calling method '.version_select at 0x7f0b59979700>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:22.226539 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-fea34ec0-bead-4b88-ad3b-2d97c6f599d8 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc72b47672e46659b1a5ebdfd99224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cd9b8837554b8daf506ca062ec916b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:22.236404 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-fea34ec0-bead-4b88-ad3b-2d97c6f599d8 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] 10.222.0.17 "GET /compute/v2.1/servers/90289981-4474-419e-854a-eb36bbb721f4" status: 200 len: 1402 microversion: 2.1 time: 0.308423 Jul 23 21:22:22.237550 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1032/2098] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:21 2022] GET /compute/v2.1/servers/90289981-4474-419e-854a-eb36bbb721f4 => generated 1402 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:22.243884 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-1097fdd5-b9f9-40fc-94c3-ca8a59b1e3ad req-bab7a43a-e434-477e-9a25-8009751143f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9aaaecf6-105b-4e72-82af-008d7590434f", "tag": "8a7d11dc-bfd9-4d09-88b6-8940c0ee2edb"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:22:22.257195 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-1097fdd5-b9f9-40fc-94c3-ca8a59b1e3ad req-bab7a43a-e434-477e-9a25-8009751143f8 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:22.258007 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-1097fdd5-b9f9-40fc-94c3-ca8a59b1e3ad req-bab7a43a-e434-477e-9a25-8009751143f8 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:22.291207 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-1097fdd5-b9f9-40fc-94c3-ca8a59b1e3ad req-bab7a43a-e434-477e-9a25-8009751143f8 service nova] Creating event network-changed:8a7d11dc-bfd9-4d09-88b6-8940c0ee2edb for instance 9aaaecf6-105b-4e72-82af-008d7590434f on nch2-master-1 Jul 23 21:22:22.300610 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-1097fdd5-b9f9-40fc-94c3-ca8a59b1e3ad req-bab7a43a-e434-477e-9a25-8009751143f8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061256 Jul 23 21:22:22.304203 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1033/2099] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:22:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:22:22.312594 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-427bc1bc-16c1-49e2-938e-6c0834a58a5c tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:22.326219 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-427bc1bc-16c1-49e2-938e-6c0834a58a5c tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=131320) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 23 21:22:22.338708 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-427bc1bc-16c1-49e2-938e-6c0834a58a5c tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:22.342514 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-427bc1bc-16c1-49e2-938e-6c0834a58a5c tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:22.343593 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-427bc1bc-16c1-49e2-938e-6c0834a58a5c tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:22.344203 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-427bc1bc-16c1-49e2-938e-6c0834a58a5c tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:22.454280 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-427bc1bc-16c1-49e2-938e-6c0834a58a5c tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] 10.222.0.17 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.146996 Jul 23 21:22:22.456702 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1034/2100] 10.222.0.17 () {58 vars in 1195 bytes} [Sat Jul 23 21:22:22 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 23 21:22:22.478548 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a70152d7-df55-42bf-8c4b-92c7763f6725 tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:22:22.481155 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a70152d7-df55-42bf-8c4b-92c7763f6725 tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] [instance: cef13563-7f83-4281-a26c-d5e420c41daf] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:22.506729 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a70152d7-df55-42bf-8c4b-92c7763f6725 tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:22.509141 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a70152d7-df55-42bf-8c4b-92c7763f6725 tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:22.515427 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a70152d7-df55-42bf-8c4b-92c7763f6725 tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:22.516367 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a70152d7-df55-42bf-8c4b-92c7763f6725 tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:22.751463 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a70152d7-df55-42bf-8c4b-92c7763f6725 tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf/action" status: 202 len: 0 microversion: 2.1 time: 0.286834 Jul 23 21:22:22.773495 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1035/2101] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:22:22 2022] POST /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf/action => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:22:22.786899 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b423e5dc-e928-41e7-a0bd-5ac435d537b8 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '.version_select at 0x7f0b470359d0>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:22.915786 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b423e5dc-e928-41e7-a0bd-5ac435d537b8 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/images/38623b43-7126-4254-9186-2c489ddd994e" status: 200 len: 1453 microversion: 2.1 time: 0.139585 Jul 23 21:22:22.916815 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1036/2102] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:22:22 2022] GET /compute/v2.1/images/38623b43-7126-4254-9186-2c489ddd994e => generated 1453 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:22.924829 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6cc6a331-9aed-494e-8b0a-c8e025892457 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:22:22.926817 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6cc6a331-9aed-494e-8b0a-c8e025892457 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] [instance: cef13563-7f83-4281-a26c-d5e420c41daf] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:22.934591 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6cc6a331-9aed-494e-8b0a-c8e025892457 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:22.935461 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6cc6a331-9aed-494e-8b0a-c8e025892457 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:22.935892 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6cc6a331-9aed-494e-8b0a-c8e025892457 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:22.936397 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6cc6a331-9aed-494e-8b0a-c8e025892457 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:23.090203 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-6cc6a331-9aed-494e-8b0a-c8e025892457 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:22:23.092243 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-6cc6a331-9aed-494e-8b0a-c8e025892457 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:22:23.093132 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-6cc6a331-9aed-494e-8b0a-c8e025892457 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:22:23.093774 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-6cc6a331-9aed-494e-8b0a-c8e025892457 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:22:23.094439 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-6cc6a331-9aed-494e-8b0a-c8e025892457 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:22:23.472380 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6cc6a331-9aed-494e-8b0a-c8e025892457 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] [instance: cef13563-7f83-4281-a26c-d5e420c41daf] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:23.480397 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6cc6a331-9aed-494e-8b0a-c8e025892457 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:23.483350 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6cc6a331-9aed-494e-8b0a-c8e025892457 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:23.487000 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6cc6a331-9aed-494e-8b0a-c8e025892457 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:23.487254 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6cc6a331-9aed-494e-8b0a-c8e025892457 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:23.527583 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6cc6a331-9aed-494e-8b0a-c8e025892457 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] 10.222.0.17 "POST /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf/action" status: 202 len: 1068 microversion: 2.1 time: 0.607784 Jul 23 21:22:23.534510 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1037/2103] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:22:22 2022] POST /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf/action => generated 1068 bytes in 617 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 23 21:22:23.545634 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-249894dd-d0eb-428f-a9c0-f3b2baea5419 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:23.546478 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-249894dd-d0eb-428f-a9c0-f3b2baea5419 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] [instance: 9aaaecf6-105b-4e72-82af-008d7590434f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:23.563820 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-249894dd-d0eb-428f-a9c0-f3b2baea5419 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:23.564387 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-249894dd-d0eb-428f-a9c0-f3b2baea5419 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:23.565316 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-249894dd-d0eb-428f-a9c0-f3b2baea5419 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:23.565901 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-249894dd-d0eb-428f-a9c0-f3b2baea5419 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:23.569258 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=4,nova_cell1:RELEASE=1,nova_cell1:INSERT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:22:23.714518 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-48c73d53-6b35-453c-b960-a65b46e3c701 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] 10.222.0.17 "DELETE /compute/v2.1/os-floating-ips/8f0e7e8b-063b-4671-b49a-2229468f2280" status: 202 len: 0 microversion: 2.1 time: 1.704925 Jul 23 21:22:23.715082 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1067/2104] 10.222.0.17 () {58 vars in 1262 bytes} [Sat Jul 23 21:22:22 2022] DELETE /compute/v2.1/os-floating-ips/8f0e7e8b-063b-4671-b49a-2229468f2280 => generated 0 bytes in 1707 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:22:23.723349 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-05b5dc75-04fe-47ed-a304-d88862b6c958 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:23.724050 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-05b5dc75-04fe-47ed-a304-d88862b6c958 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] [instance: 90289981-4474-419e-854a-eb36bbb721f4] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:23.750347 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-05b5dc75-04fe-47ed-a304-d88862b6c958 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:23.751331 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-05b5dc75-04fe-47ed-a304-d88862b6c958 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:23.753510 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-05b5dc75-04fe-47ed-a304-d88862b6c958 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:23.754224 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-05b5dc75-04fe-47ed-a304-d88862b6c958 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:24.019702 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-249894dd-d0eb-428f-a9c0-f3b2baea5419 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7acc7eae5f946aaac9f0c8ead2c8d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e0f76ca9b734142a90c27f3d3de3a85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:24.028487 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-249894dd-d0eb-428f-a9c0-f3b2baea5419 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] 10.222.0.17 "GET /compute/v2.1/servers/9aaaecf6-105b-4e72-82af-008d7590434f" status: 200 len: 1322 microversion: 2.1 time: 0.492912 Jul 23 21:22:24.050259 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1038/2105] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:23 2022] GET /compute/v2.1/servers/9aaaecf6-105b-4e72-82af-008d7590434f => generated 1322 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:24.055485 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-fa92a855-fb9a-4c82-a659-6a85b0dcd5a6 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:24.056116 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-fa92a855-fb9a-4c82-a659-6a85b0dcd5a6 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] [instance: cef13563-7f83-4281-a26c-d5e420c41daf] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:24.071759 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fa92a855-fb9a-4c82-a659-6a85b0dcd5a6 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:24.072027 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fa92a855-fb9a-4c82-a659-6a85b0dcd5a6 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:24.072885 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fa92a855-fb9a-4c82-a659-6a85b0dcd5a6 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:24.073320 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fa92a855-fb9a-4c82-a659-6a85b0dcd5a6 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:24.148287 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-05b5dc75-04fe-47ed-a304-d88862b6c958 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc72b47672e46659b1a5ebdfd99224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cd9b8837554b8daf506ca062ec916b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:24.166612 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-05b5dc75-04fe-47ed-a304-d88862b6c958 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] 10.222.0.17 "GET /compute/v2.1/servers/90289981-4474-419e-854a-eb36bbb721f4" status: 200 len: 1590 microversion: 2.1 time: 0.445079 Jul 23 21:22:24.167724 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1068/2106] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:23 2022] GET /compute/v2.1/servers/90289981-4474-419e-854a-eb36bbb721f4 => generated 1590 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:24.180810 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-70f6112a-1164-46db-a032-e430aa6df7a9 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:22:24.188399 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-70f6112a-1164-46db-a032-e430aa6df7a9 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Request method failure captured: Jul 23 21:22:24.188399 ncdv-master-1 devstack@n-api.service[131321]: request: POST /compute/v2.1/servers/2cebd0e1-09ca-4eab-bda7-0743043bad23/action HTTP/1.1 Jul 23 21:22:24.188399 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:22:24.188399 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:22:24.188399 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:22:24.188399 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 34 Jul 23 21:22:24.188399 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:22:24.188399 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:22:24.188399 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:22:24.188399 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:22:24.188399 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GZYQX4roJlQevhBkA9pMfkC9djkQNhEXe41-IIk_hz1dSFoIFpPCQ2m5AEPXJJBQGNAMjbsTRRiDmidChznQIU_qEtASKDQUSEMkWkElq02-TRTpVvzgVXEI44D79323V4Xa0KfYl-gncyheU7x0wG3LJWDvwKdFgR5hDKry9HF3Mo Jul 23 21:22:24.188399 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:22:24.188399 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:22:24.188399 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:22:24.188399 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:22:24.188399 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:22:24.188399 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:22:24.188399 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 3d87ea887fea457fb07731d47de68333 Jul 23 21:22:24.188399 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-793914881 Jul 23 21:22:24.188399 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:22:24.188399 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:22:24.188399 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3d87ea887fea457fb07731d47de68333"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3d87ea887fea457fb07731d47de68333"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3d87ea887fea457fb07731d47de68333", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3d87ea887fea457fb07731d47de68333"}]}] Jul 23 21:22:24.188399 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-793914881 Jul 23 21:22:24.188399 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 3d87ea887fea457fb07731d47de68333 Jul 23 21:22:24.188399 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-793914881 Jul 23 21:22:24.188399 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project Jul 23 21:22:24.188399 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:22:24.188399 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:22:24.188399 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 672d90d732a0419ca669e0055359dcfd Jul 23 21:22:24.188399 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project Jul 23 21:22:24.188399 ncdv-master-1 devstack@n-api.service[131321]: Jul 23 21:22:24.188399 ncdv-master-1 devstack@n-api.service[131321]: {"addFloatingIp": {"address": ""}} Jul 23 21:22:24.188399 ncdv-master-1 devstack@n-api.service[131321]: method: Jul 23 21:22:24.188399 ncdv-master-1 devstack@n-api.service[131321]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jul 23 21:22:24.188399 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': '2cebd0e1-09ca-4eab-bda7-0743043bad23', 'body': {'addFloatingIp': {'address': ''}}} Jul 23 21:22:24.188399 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:22:24.188399 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:22:24.188399 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 23 21:22:24.188399 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 23 21:22:24.188399 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 23 21:22:24.188399 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise error Jul 23 21:22:24.188399 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Jul 23 21:22:24.188399 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:22:24.188399 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Jul 23 21:22:24.188399 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Jul 23 21:22:24.188399 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:22:24.188399 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Jul 23 21:22:24.188399 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi '' Jul 23 21:22:24.188399 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:22:24.188399 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:22:24.188399 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:22:24.188399 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:22:24.188399 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:22:24.188399 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:22:24.188399 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:22:24.188399 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:22:24.188399 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:22:24.188399 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:22:24.188399 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:22:24.188399 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:22:24.188399 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 23 21:22:24.188399 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 23 21:22:24.188399 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 23 21:22:24.188399 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 23 21:22:24.188399 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 23 21:22:24.192703 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 23 21:22:24.192703 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jul 23 21:22:24.192703 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:22:24.192703 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:22:24.192703 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:22:24.192703 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:22:24.192703 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:22:24.192703 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:22:24.192703 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 23 21:22:24.192703 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 23 21:22:24.192703 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jul 23 21:22:24.192703 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:22:24.192703 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-70f6112a-1164-46db-a032-e430aa6df7a9 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:22:24.193631 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-70f6112a-1164-46db-a032-e430aa6df7a9 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] 10.222.0.17 "POST /compute/v2.1/servers/2cebd0e1-09ca-4eab-bda7-0743043bad23/action" status: 400 len: 142 microversion: 2.1 time: 0.024233 Jul 23 21:22:24.195047 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1069/2107] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:22:24 2022] POST /compute/v2.1/servers/2cebd0e1-09ca-4eab-bda7-0743043bad23/action => generated 142 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 23 21:22:24.204552 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-3cb47fb9-7444-4632-8f78-db28f8836988 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '.version_select at 0x7f0b59979af0>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:24.300742 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-3cb47fb9-7444-4632-8f78-db28f8836988 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/images/38623b43-7126-4254-9186-2c489ddd994e" status: 200 len: 1453 microversion: 2.1 time: 0.104585 Jul 23 21:22:24.301974 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1070/2108] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:22:24 2022] GET /compute/v2.1/images/38623b43-7126-4254-9186-2c489ddd994e => generated 1453 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:24.316361 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-831957a0-f96c-495e-9274-7ffb4a44f3f9 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:24.318712 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-831957a0-f96c-495e-9274-7ffb4a44f3f9 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] [instance: 90289981-4474-419e-854a-eb36bbb721f4] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:24.333457 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-831957a0-f96c-495e-9274-7ffb4a44f3f9 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:24.337307 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-831957a0-f96c-495e-9274-7ffb4a44f3f9 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:24.338630 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-831957a0-f96c-495e-9274-7ffb4a44f3f9 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:24.341063 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-831957a0-f96c-495e-9274-7ffb4a44f3f9 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:24.421507 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-fa92a855-fb9a-4c82-a659-6a85b0dcd5a6 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf93a4b80cb4e19a36473986950fc75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c1943188684b45b636541caf587247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:24.437806 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-fa92a855-fb9a-4c82-a659-6a85b0dcd5a6 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] 10.222.0.17 "GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf" status: 200 len: 1472 microversion: 2.1 time: 0.386255 Jul 23 21:22:24.438489 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1039/2109] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:24 2022] GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf => generated 1472 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:24.454718 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b353d12d-c7f8-4c97-b520-e27abdb27dd8 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Action: 'action', calling method: .version_select at 0x7f0b57657550>, body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:22:24.462149 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b353d12d-c7f8-4c97-b520-e27abdb27dd8 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] [instance: 2cebd0e1-09ca-4eab-bda7-0743043bad23] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:24.480042 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b353d12d-c7f8-4c97-b520-e27abdb27dd8 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:24.482434 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b353d12d-c7f8-4c97-b520-e27abdb27dd8 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:24.485077 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b353d12d-c7f8-4c97-b520-e27abdb27dd8 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:24.485531 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b353d12d-c7f8-4c97-b520-e27abdb27dd8 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:24.518449 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-831957a0-f96c-495e-9274-7ffb4a44f3f9 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] 10.222.0.17 "GET /compute/v2.1/servers/90289981-4474-419e-854a-eb36bbb721f4/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.211070 Jul 23 21:22:24.527021 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1071/2110] 10.222.0.17 () {58 vars in 1274 bytes} [Sat Jul 23 21:22:24 2022] GET /compute/v2.1/servers/90289981-4474-419e-854a-eb36bbb721f4/os-interface => generated 285 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:22:24.557602 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b353d12d-c7f8-4c97-b520-e27abdb27dd8 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Acquired lock "refresh_cache-2cebd0e1-09ca-4eab-bda7-0743043bad23" {{(pid=131320) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 23 21:22:25.005073 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b353d12d-c7f8-4c97-b520-e27abdb27dd8 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Releasing lock "refresh_cache-2cebd0e1-09ca-4eab-bda7-0743043bad23" {{(pid=131320) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 23 21:22:25.005877 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-b353d12d-c7f8-4c97-b520-e27abdb27dd8 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] HTTP exception thrown: floating IP not found Jul 23 21:22:25.009313 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b353d12d-c7f8-4c97-b520-e27abdb27dd8 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Request method failure captured: Jul 23 21:22:25.009313 ncdv-master-1 devstack@n-api.service[131320]: request: POST /compute/v2.1/servers/2cebd0e1-09ca-4eab-bda7-0743043bad23/action HTTP/1.1 Jul 23 21:22:25.009313 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:22:25.009313 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:22:25.009313 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:22:25.009313 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 41 Jul 23 21:22:25.009313 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:22:25.009313 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:22:25.009313 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:22:25.009313 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:22:25.009313 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GZYQX4roJlQevhBkA9pMfkC9djkQNhEXe41-IIk_hz1dSFoIFpPCQ2m5AEPXJJBQGNAMjbsTRRiDmidChznQIU_qEtASKDQUSEMkWkElq02-TRTpVvzgVXEI44D79323V4Xa0KfYl-gncyheU7x0wG3LJWDvwKdFgR5hDKry9HF3Mo Jul 23 21:22:25.009313 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:22:25.009313 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:22:25.009313 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:22:25.009313 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:22:25.009313 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:22:25.009313 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:22:25.009313 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 3d87ea887fea457fb07731d47de68333 Jul 23 21:22:25.009313 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-793914881 Jul 23 21:22:25.009313 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:22:25.009313 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:22:25.009313 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3d87ea887fea457fb07731d47de68333"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3d87ea887fea457fb07731d47de68333"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3d87ea887fea457fb07731d47de68333", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3d87ea887fea457fb07731d47de68333"}]}] Jul 23 21:22:25.009313 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-793914881 Jul 23 21:22:25.009313 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 3d87ea887fea457fb07731d47de68333 Jul 23 21:22:25.009313 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-793914881 Jul 23 21:22:25.009313 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project Jul 23 21:22:25.009313 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:22:25.009313 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:22:25.009313 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 672d90d732a0419ca669e0055359dcfd Jul 23 21:22:25.009313 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project Jul 23 21:22:25.009313 ncdv-master-1 devstack@n-api.service[131320]: Jul 23 21:22:25.009313 ncdv-master-1 devstack@n-api.service[131320]: {"addFloatingIp": {"address": "0.0.0.0"}} Jul 23 21:22:25.009313 ncdv-master-1 devstack@n-api.service[131320]: method: Jul 23 21:22:25.009313 ncdv-master-1 devstack@n-api.service[131320]: exception: floating IP not found Jul 23 21:22:25.009313 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '2cebd0e1-09ca-4eab-bda7-0743043bad23', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Jul 23 21:22:25.009313 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:22:25.009313 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:22:25.009313 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Jul 23 21:22:25.009313 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Jul 23 21:22:25.009313 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Jul 23 21:22:25.009313 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Jul 23 21:22:25.009313 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2702, in associate_floating_ip Jul 23 21:22:25.009313 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Jul 23 21:22:25.009313 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Jul 23 21:22:25.009313 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Jul 23 21:22:25.009313 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Jul 23 21:22:25.009313 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:22:25.009313 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:22:25.009313 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:22:25.009313 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:22:25.009313 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:22:25.009313 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:22:25.009313 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:22:25.009313 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:22:25.009313 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:22:25.009313 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:22:25.009313 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:22:25.009313 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:22:25.009313 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:22:25.009313 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:22:25.009313 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Jul 23 21:22:25.009313 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 23 21:22:25.009313 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Jul 23 21:22:25.009313 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:22:25.020497 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:22:25.020497 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:22:25.020497 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:22:25.020497 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:22:25.020497 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:22:25.020497 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:22:25.020497 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:22:25.020497 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Jul 23 21:22:25.020497 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:22:25.020497 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b353d12d-c7f8-4c97-b520-e27abdb27dd8 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Returning 404 to user: floating IP not found {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:22:25.020497 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b353d12d-c7f8-4c97-b520-e27abdb27dd8 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] 10.222.0.17 "POST /compute/v2.1/servers/2cebd0e1-09ca-4eab-bda7-0743043bad23/action" status: 404 len: 67 microversion: 2.1 time: 0.572427 Jul 23 21:22:25.020497 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1040/2111] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:22:24 2022] POST /compute/v2.1/servers/2cebd0e1-09ca-4eab-bda7-0743043bad23/action => generated 67 bytes in 576 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 23 21:22:25.025417 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-2113cfe5-8186-4e02-8596-4803cad7e99c tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:22:25.046921 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-47f0ccaa-73fc-4321-a954-e88de740afb7 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:25.047472 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-47f0ccaa-73fc-4321-a954-e88de740afb7 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] [instance: 9aaaecf6-105b-4e72-82af-008d7590434f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:25.061800 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-47f0ccaa-73fc-4321-a954-e88de740afb7 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:25.062341 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-47f0ccaa-73fc-4321-a954-e88de740afb7 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:25.063403 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-47f0ccaa-73fc-4321-a954-e88de740afb7 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:25.063860 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-47f0ccaa-73fc-4321-a954-e88de740afb7 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:25.404042 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-2113cfe5-8186-4e02-8596-4803cad7e99c tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Jul 23 21:22:25.406475 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-2113cfe5-8186-4e02-8596-4803cad7e99c tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Request method failure captured: Jul 23 21:22:25.406475 ncdv-master-1 devstack@n-api.service[131321]: request: POST /compute/v2.1/servers/2cebd0e1-09ca-4eab-bda7-0743043bad23/action HTTP/1.1 Jul 23 21:22:25.406475 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:22:25.406475 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:22:25.406475 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:22:25.406475 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 44 Jul 23 21:22:25.406475 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:22:25.406475 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:22:25.406475 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:22:25.406475 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:22:25.406475 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GZYQX4roJlQevhBkA9pMfkC9djkQNhEXe41-IIk_hz1dSFoIFpPCQ2m5AEPXJJBQGNAMjbsTRRiDmidChznQIU_qEtASKDQUSEMkWkElq02-TRTpVvzgVXEI44D79323V4Xa0KfYl-gncyheU7x0wG3LJWDvwKdFgR5hDKry9HF3Mo Jul 23 21:22:25.406475 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:22:25.406475 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:22:25.406475 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:22:25.406475 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:22:25.406475 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:22:25.406475 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:22:25.406475 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 3d87ea887fea457fb07731d47de68333 Jul 23 21:22:25.406475 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-793914881 Jul 23 21:22:25.406475 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:22:25.406475 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:22:25.406475 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3d87ea887fea457fb07731d47de68333"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3d87ea887fea457fb07731d47de68333"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3d87ea887fea457fb07731d47de68333", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3d87ea887fea457fb07731d47de68333"}]}] Jul 23 21:22:25.406475 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-793914881 Jul 23 21:22:25.406475 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 3d87ea887fea457fb07731d47de68333 Jul 23 21:22:25.406475 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-793914881 Jul 23 21:22:25.406475 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project Jul 23 21:22:25.406475 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:22:25.406475 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:22:25.406475 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 672d90d732a0419ca669e0055359dcfd Jul 23 21:22:25.406475 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project Jul 23 21:22:25.406475 ncdv-master-1 devstack@n-api.service[131321]: Jul 23 21:22:25.406475 ncdv-master-1 devstack@n-api.service[131321]: {"removeFloatingIp": {"address": "0.0.0.0"}} Jul 23 21:22:25.406475 ncdv-master-1 devstack@n-api.service[131321]: method: Jul 23 21:22:25.406475 ncdv-master-1 devstack@n-api.service[131321]: exception: Floating IP not found for address 0.0.0.0. Jul 23 21:22:25.406475 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': '2cebd0e1-09ca-4eab-bda7-0743043bad23', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Jul 23 21:22:25.406475 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:22:25.406475 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:22:25.406475 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Jul 23 21:22:25.406475 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Jul 23 21:22:25.406475 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2930, in get_instance_id_by_floating_address Jul 23 21:22:25.406475 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Jul 23 21:22:25.406475 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Jul 23 21:22:25.406475 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Jul 23 21:22:25.406475 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Jul 23 21:22:25.406475 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:22:25.406475 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:22:25.406475 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:22:25.406475 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:22:25.406475 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:22:25.406475 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:22:25.406475 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:22:25.406475 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:22:25.406475 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:22:25.406475 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:22:25.406475 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:22:25.406475 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:22:25.406475 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:22:25.406475 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:22:25.406475 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Jul 23 21:22:25.406475 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Jul 23 21:22:25.406475 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Jul 23 21:22:25.406475 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Jul 23 21:22:25.413285 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Jul 23 21:22:25.413285 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:22:25.413285 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:22:25.413285 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:22:25.413285 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:22:25.413285 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:22:25.413285 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:22:25.413285 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:22:25.413285 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:22:25.413285 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Jul 23 21:22:25.413285 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:22:25.413285 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-2113cfe5-8186-4e02-8596-4803cad7e99c tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:22:25.413285 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-2113cfe5-8186-4e02-8596-4803cad7e99c tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] 10.222.0.17 "POST /compute/v2.1/servers/2cebd0e1-09ca-4eab-bda7-0743043bad23/action" status: 404 len: 88 microversion: 2.1 time: 0.389405 Jul 23 21:22:25.417263 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1072/2112] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:22:25 2022] POST /compute/v2.1/servers/2cebd0e1-09ca-4eab-bda7-0743043bad23/action => generated 88 bytes in 397 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 23 21:22:25.423355 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-5f67e5e8-3857-43b8-97b2-0d6395760145 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '.version_select at 0x7f0b59a1b1f0>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:25.432931 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-47f0ccaa-73fc-4321-a954-e88de740afb7 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7acc7eae5f946aaac9f0c8ead2c8d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e0f76ca9b734142a90c27f3d3de3a85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:25.441181 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-47f0ccaa-73fc-4321-a954-e88de740afb7 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] 10.222.0.17 "GET /compute/v2.1/servers/9aaaecf6-105b-4e72-82af-008d7590434f" status: 200 len: 1322 microversion: 2.1 time: 0.398708 Jul 23 21:22:25.441794 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1041/2113] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:25 2022] GET /compute/v2.1/servers/9aaaecf6-105b-4e72-82af-008d7590434f => generated 1322 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:22:25.455317 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-93860df9-77a8-4f33-9051-adf93371fe82 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:25.455842 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-93860df9-77a8-4f33-9051-adf93371fe82 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] [instance: 2cebd0e1-09ca-4eab-bda7-0743043bad23] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:25.474330 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-93860df9-77a8-4f33-9051-adf93371fe82 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:25.475018 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-93860df9-77a8-4f33-9051-adf93371fe82 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:25.475825 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-93860df9-77a8-4f33-9051-adf93371fe82 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:25.477194 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-93860df9-77a8-4f33-9051-adf93371fe82 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:25.527278 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-5f67e5e8-3857-43b8-97b2-0d6395760145 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/images/38623b43-7126-4254-9186-2c489ddd994e" status: 200 len: 1453 microversion: 2.1 time: 0.108564 Jul 23 21:22:25.528993 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1073/2114] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:22:25 2022] GET /compute/v2.1/images/38623b43-7126-4254-9186-2c489ddd994e => generated 1453 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:25.536481 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-64f74803-e3a3-4f05-bb43-988bc8b01f10 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:25.537635 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-64f74803-e3a3-4f05-bb43-988bc8b01f10 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] [instance: cef13563-7f83-4281-a26c-d5e420c41daf] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:25.546342 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-64f74803-e3a3-4f05-bb43-988bc8b01f10 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:25.547170 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-64f74803-e3a3-4f05-bb43-988bc8b01f10 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:25.549093 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-64f74803-e3a3-4f05-bb43-988bc8b01f10 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:25.549744 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-64f74803-e3a3-4f05-bb43-988bc8b01f10 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:25.553713 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-93860df9-77a8-4f33-9051-adf93371fe82 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] [instance: 2cebd0e1-09ca-4eab-bda7-0743043bad23] Going to try to terminate instance {{(pid=131320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:22:25.557079 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:22:25.704132 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-93860df9-77a8-4f33-9051-adf93371fe82 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] 10.222.0.17 "DELETE /compute/v2.1/servers/2cebd0e1-09ca-4eab-bda7-0743043bad23" status: 204 len: 0 microversion: 2.1 time: 0.252322 Jul 23 21:22:25.706153 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1042/2115] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:22:25 2022] DELETE /compute/v2.1/servers/2cebd0e1-09ca-4eab-bda7-0743043bad23 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:22:25.718259 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0ebc39f9-340e-462a-ae67-01071f744f42 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:25.719296 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-0ebc39f9-340e-462a-ae67-01071f744f42 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] [instance: 2cebd0e1-09ca-4eab-bda7-0743043bad23] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:25.729837 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0ebc39f9-340e-462a-ae67-01071f744f42 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:25.731122 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0ebc39f9-340e-462a-ae67-01071f744f42 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:25.733932 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0ebc39f9-340e-462a-ae67-01071f744f42 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:25.734687 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0ebc39f9-340e-462a-ae67-01071f744f42 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:25.934825 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-0ebc39f9-340e-462a-ae67-01071f744f42 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '672d90d732a0419ca669e0055359dcfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d87ea887fea457fb07731d47de68333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:25.954481 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-0ebc39f9-340e-462a-ae67-01071f744f42 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] 10.222.0.17 "GET /compute/v2.1/servers/2cebd0e1-09ca-4eab-bda7-0743043bad23" status: 200 len: 1542 microversion: 2.1 time: 0.233670 Jul 23 21:22:25.956555 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1043/2116] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:25 2022] GET /compute/v2.1/servers/2cebd0e1-09ca-4eab-bda7-0743043bad23 => generated 1542 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:25.979476 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-64f74803-e3a3-4f05-bb43-988bc8b01f10 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf93a4b80cb4e19a36473986950fc75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c1943188684b45b636541caf587247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:25.999894 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-64f74803-e3a3-4f05-bb43-988bc8b01f10 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] 10.222.0.17 "GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf" status: 200 len: 1472 microversion: 2.1 time: 0.468816 Jul 23 21:22:26.006084 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1074/2117] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:25 2022] GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf => generated 1472 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:26.170670 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-3cf3ce55-a0a9-4dc5-a022-36043e1e6438 req-373a612b-9a8d-4778-bddb-ec0f372441e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9aaaecf6-105b-4e72-82af-008d7590434f", "name": "network-vif-plugged", "status": "completed", "tag": "8a7d11dc-bfd9-4d09-88b6-8940c0ee2edb"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:22:26.190886 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-3cf3ce55-a0a9-4dc5-a022-36043e1e6438 req-373a612b-9a8d-4778-bddb-ec0f372441e6 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:26.191344 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-3cf3ce55-a0a9-4dc5-a022-36043e1e6438 req-373a612b-9a8d-4778-bddb-ec0f372441e6 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:26.212498 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-3cf3ce55-a0a9-4dc5-a022-36043e1e6438 req-373a612b-9a8d-4778-bddb-ec0f372441e6 service nova] Creating event network-vif-plugged:8a7d11dc-bfd9-4d09-88b6-8940c0ee2edb for instance 9aaaecf6-105b-4e72-82af-008d7590434f on nch2-master-1 Jul 23 21:22:26.223228 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-3cf3ce55-a0a9-4dc5-a022-36043e1e6438 req-373a612b-9a8d-4778-bddb-ec0f372441e6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055758 Jul 23 21:22:26.227414 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1044/2118] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:22:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:22:26.461015 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-3c54bc20-01e6-4863-92f2-f34aa97cb98a tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:26.465153 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-3c54bc20-01e6-4863-92f2-f34aa97cb98a tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] [instance: 9aaaecf6-105b-4e72-82af-008d7590434f] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:26.477542 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3c54bc20-01e6-4863-92f2-f34aa97cb98a tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:26.478971 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3c54bc20-01e6-4863-92f2-f34aa97cb98a tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:26.480782 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3c54bc20-01e6-4863-92f2-f34aa97cb98a tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:26.481701 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3c54bc20-01e6-4863-92f2-f34aa97cb98a tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:26.549029 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-331d7c90-5441-44e5-b70a-48eb3d3ccbfe tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '.version_select at 0x7f0b598dca60>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:26.623502 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-331d7c90-5441-44e5-b70a-48eb3d3ccbfe tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/images/38623b43-7126-4254-9186-2c489ddd994e" status: 200 len: 1453 microversion: 2.1 time: 0.085481 Jul 23 21:22:26.625097 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1045/2119] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:22:26 2022] GET /compute/v2.1/images/38623b43-7126-4254-9186-2c489ddd994e => generated 1453 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:22:26.739154 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-3c54bc20-01e6-4863-92f2-f34aa97cb98a tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7acc7eae5f946aaac9f0c8ead2c8d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e0f76ca9b734142a90c27f3d3de3a85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:26.748699 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-3c54bc20-01e6-4863-92f2-f34aa97cb98a tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] 10.222.0.17 "GET /compute/v2.1/servers/9aaaecf6-105b-4e72-82af-008d7590434f" status: 200 len: 1322 microversion: 2.1 time: 0.293867 Jul 23 21:22:26.749886 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1075/2120] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:26 2022] GET /compute/v2.1/servers/9aaaecf6-105b-4e72-82af-008d7590434f => generated 1322 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:26.979103 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-96186b6b-dc80-42c3-843e-19df15572d27 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:26.982008 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-96186b6b-dc80-42c3-843e-19df15572d27 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] [instance: 2cebd0e1-09ca-4eab-bda7-0743043bad23] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:27.024822 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-5c67d11b-3a63-43dd-beac-9d65830849ec tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:27.025792 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-5c67d11b-3a63-43dd-beac-9d65830849ec tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] [instance: cef13563-7f83-4281-a26c-d5e420c41daf] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:27.035896 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-96186b6b-dc80-42c3-843e-19df15572d27 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:27.036436 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-96186b6b-dc80-42c3-843e-19df15572d27 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:27.037421 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-96186b6b-dc80-42c3-843e-19df15572d27 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:27.037894 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-96186b6b-dc80-42c3-843e-19df15572d27 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:27.042799 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5c67d11b-3a63-43dd-beac-9d65830849ec tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:27.043603 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5c67d11b-3a63-43dd-beac-9d65830849ec tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:27.046683 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5c67d11b-3a63-43dd-beac-9d65830849ec tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:27.048462 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5c67d11b-3a63-43dd-beac-9d65830849ec tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:27.429754 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-5c67d11b-3a63-43dd-beac-9d65830849ec tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf93a4b80cb4e19a36473986950fc75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c1943188684b45b636541caf587247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:27.440128 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-5c67d11b-3a63-43dd-beac-9d65830849ec tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] 10.222.0.17 "GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf" status: 200 len: 1472 microversion: 2.1 time: 0.420051 Jul 23 21:22:27.445206 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1076/2121] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:27 2022] GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf => generated 1472 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:27.455574 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-daf72455-0912-4c3b-bf0a-bf2eb517b82b tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:27.460099 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-daf72455-0912-4c3b-bf0a-bf2eb517b82b tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] [instance: 90289981-4474-419e-854a-eb36bbb721f4] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:27.476346 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-daf72455-0912-4c3b-bf0a-bf2eb517b82b tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:27.482798 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-daf72455-0912-4c3b-bf0a-bf2eb517b82b tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:27.484685 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-daf72455-0912-4c3b-bf0a-bf2eb517b82b tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:27.490952 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-daf72455-0912-4c3b-bf0a-bf2eb517b82b tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:27.571961 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-96186b6b-dc80-42c3-843e-19df15572d27 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '672d90d732a0419ca669e0055359dcfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d87ea887fea457fb07731d47de68333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:27.586470 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-96186b6b-dc80-42c3-843e-19df15572d27 tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] 10.222.0.17 "GET /compute/v2.1/servers/2cebd0e1-09ca-4eab-bda7-0743043bad23" status: 200 len: 1542 microversion: 2.1 time: 0.612504 Jul 23 21:22:27.602927 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1046/2122] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:26 2022] GET /compute/v2.1/servers/2cebd0e1-09ca-4eab-bda7-0743043bad23 => generated 1542 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:27.634510 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-4c93a30d-94ae-46d8-bf37-75a697e22477 req-86fb65eb-d9d2-4b33-8b9c-decf74332151 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90289981-4474-419e-854a-eb36bbb721f4", "tag": "713d4ed6-d82d-4876-a416-2b294c9cd4bd"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:22:27.660917 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-4c93a30d-94ae-46d8-bf37-75a697e22477 req-86fb65eb-d9d2-4b33-8b9c-decf74332151 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:27.662531 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-4c93a30d-94ae-46d8-bf37-75a697e22477 req-86fb65eb-d9d2-4b33-8b9c-decf74332151 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:27.694712 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-4c93a30d-94ae-46d8-bf37-75a697e22477 req-86fb65eb-d9d2-4b33-8b9c-decf74332151 service nova] Creating event network-changed:713d4ed6-d82d-4876-a416-2b294c9cd4bd for instance 90289981-4474-419e-854a-eb36bbb721f4 on nch1-master-1 Jul 23 21:22:27.703904 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-4c93a30d-94ae-46d8-bf37-75a697e22477 req-86fb65eb-d9d2-4b33-8b9c-decf74332151 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097360 Jul 23 21:22:27.705350 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1047/2123] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:22:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:22:27.716823 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e0a830a0-24a8-4c64-871b-0e7f04e5d6b5 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '.version_select at 0x7f0b598efa60>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:27.936527 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e0a830a0-24a8-4c64-871b-0e7f04e5d6b5 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/images/38623b43-7126-4254-9186-2c489ddd994e" status: 200 len: 1453 microversion: 2.1 time: 0.229273 Jul 23 21:22:27.940275 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1048/2124] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:22:27 2022] GET /compute/v2.1/images/38623b43-7126-4254-9186-2c489ddd994e => generated 1453 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:27.956581 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-08a9da8e-b5d1-44cb-a656-82fefd4e754b tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:27.969315 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-08a9da8e-b5d1-44cb-a656-82fefd4e754b tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] [instance: 9aaaecf6-105b-4e72-82af-008d7590434f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:28.000928 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-08a9da8e-b5d1-44cb-a656-82fefd4e754b tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:28.001820 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-08a9da8e-b5d1-44cb-a656-82fefd4e754b tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:28.004943 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-08a9da8e-b5d1-44cb-a656-82fefd4e754b tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:28.015388 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-08a9da8e-b5d1-44cb-a656-82fefd4e754b tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:28.531645 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-daf72455-0912-4c3b-bf0a-bf2eb517b82b tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc72b47672e46659b1a5ebdfd99224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cd9b8837554b8daf506ca062ec916b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:28.559992 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-daf72455-0912-4c3b-bf0a-bf2eb517b82b tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] 10.222.0.17 "GET /compute/v2.1/servers/90289981-4474-419e-854a-eb36bbb721f4" status: 200 len: 1590 microversion: 2.1 time: 1.112427 Jul 23 21:22:28.576110 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1077/2125] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:27 2022] GET /compute/v2.1/servers/90289981-4474-419e-854a-eb36bbb721f4 => generated 1590 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:28.587393 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-acb2371e-08cb-4839-bcbd-992ba0fbaa70 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:28.588634 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-acb2371e-08cb-4839-bcbd-992ba0fbaa70 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] [instance: cef13563-7f83-4281-a26c-d5e420c41daf] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:28.600511 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-acb2371e-08cb-4839-bcbd-992ba0fbaa70 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:28.601489 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-acb2371e-08cb-4839-bcbd-992ba0fbaa70 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:28.602612 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-acb2371e-08cb-4839-bcbd-992ba0fbaa70 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:28.603246 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-acb2371e-08cb-4839-bcbd-992ba0fbaa70 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:28.827738 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-acb2371e-08cb-4839-bcbd-992ba0fbaa70 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf93a4b80cb4e19a36473986950fc75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c1943188684b45b636541caf587247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:28.842893 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-acb2371e-08cb-4839-bcbd-992ba0fbaa70 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] 10.222.0.17 "GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf" status: 200 len: 1472 microversion: 2.1 time: 0.262708 Jul 23 21:22:28.845150 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1078/2126] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:28 2022] GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf => generated 1472 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:28.866162 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-cd9ac110-70d5-4795-9b24-b7525a2caf0a tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:28.869680 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-cd9ac110-70d5-4795-9b24-b7525a2caf0a tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] [instance: 2cebd0e1-09ca-4eab-bda7-0743043bad23] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:28.889302 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cd9ac110-70d5-4795-9b24-b7525a2caf0a tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:28.891830 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cd9ac110-70d5-4795-9b24-b7525a2caf0a tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:28.892929 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cd9ac110-70d5-4795-9b24-b7525a2caf0a tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:28.894356 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cd9ac110-70d5-4795-9b24-b7525a2caf0a tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:28.951068 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cd9ac110-70d5-4795-9b24-b7525a2caf0a tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:28.951978 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cd9ac110-70d5-4795-9b24-b7525a2caf0a tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:28.952857 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.objects.instance [None req-cd9ac110-70d5-4795-9b24-b7525a2caf0a tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Lazy-loading 'fault' on Instance uuid 2cebd0e1-09ca-4eab-bda7-0743043bad23 {{(pid=131321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:22:29.009612 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-cd9ac110-70d5-4795-9b24-b7525a2caf0a tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '672d90d732a0419ca669e0055359dcfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d87ea887fea457fb07731d47de68333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:29.020667 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-cd9ac110-70d5-4795-9b24-b7525a2caf0a tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] 10.222.0.17 "GET /compute/v2.1/servers/2cebd0e1-09ca-4eab-bda7-0743043bad23" status: 200 len: 1322 microversion: 2.1 time: 0.173170 Jul 23 21:22:29.033945 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1079/2127] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:28 2022] GET /compute/v2.1/servers/2cebd0e1-09ca-4eab-bda7-0743043bad23 => generated 1322 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:29.041941 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-7684ceeb-2b41-43c0-92d4-38d9fa14c96a tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '.version_select at 0x7f0b599e6a60>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:29.135473 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-7684ceeb-2b41-43c0-92d4-38d9fa14c96a tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/images/38623b43-7126-4254-9186-2c489ddd994e" status: 200 len: 1453 microversion: 2.1 time: 0.099850 Jul 23 21:22:29.141604 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1080/2128] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:22:29 2022] GET /compute/v2.1/images/38623b43-7126-4254-9186-2c489ddd994e => generated 1453 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:29.297647 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-08a9da8e-b5d1-44cb-a656-82fefd4e754b tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7acc7eae5f946aaac9f0c8ead2c8d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e0f76ca9b734142a90c27f3d3de3a85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:29.308086 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-08a9da8e-b5d1-44cb-a656-82fefd4e754b tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] 10.222.0.17 "GET /compute/v2.1/servers/9aaaecf6-105b-4e72-82af-008d7590434f" status: 200 len: 1322 microversion: 2.1 time: 1.363723 Jul 23 21:22:29.322143 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1049/2129] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:27 2022] GET /compute/v2.1/servers/9aaaecf6-105b-4e72-82af-008d7590434f => generated 1322 bytes in 1381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:29.863478 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c7432983-3196-4d3f-9351-0dd7e5d0b696 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:29.864094 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-c7432983-3196-4d3f-9351-0dd7e5d0b696 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] [instance: cef13563-7f83-4281-a26c-d5e420c41daf] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:29.877467 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c7432983-3196-4d3f-9351-0dd7e5d0b696 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:29.878611 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c7432983-3196-4d3f-9351-0dd7e5d0b696 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:29.880017 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c7432983-3196-4d3f-9351-0dd7e5d0b696 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:29.880980 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c7432983-3196-4d3f-9351-0dd7e5d0b696 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:30.043896 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-fee7f1be-7f4a-4640-905f-8f906730a20e tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:30.045010 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-fee7f1be-7f4a-4640-905f-8f906730a20e tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] [instance: 2cebd0e1-09ca-4eab-bda7-0743043bad23] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:30.061853 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fee7f1be-7f4a-4640-905f-8f906730a20e tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:30.066558 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fee7f1be-7f4a-4640-905f-8f906730a20e tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:30.071971 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fee7f1be-7f4a-4640-905f-8f906730a20e tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:30.074029 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fee7f1be-7f4a-4640-905f-8f906730a20e tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:30.155119 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-fee7f1be-7f4a-4640-905f-8f906730a20e tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] HTTP exception thrown: Instance 2cebd0e1-09ca-4eab-bda7-0743043bad23 could not be found. Jul 23 21:22:30.160356 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-fee7f1be-7f4a-4640-905f-8f906730a20e tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Request method failure captured: Jul 23 21:22:30.160356 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/2cebd0e1-09ca-4eab-bda7-0743043bad23 HTTP/1.1 Jul 23 21:22:30.160356 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:22:30.160356 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:22:30.160356 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:22:30.160356 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:22:30.160356 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:22:30.160356 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:22:30.160356 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:22:30.160356 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:22:30.160356 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GZYQX4roJlQevhBkA9pMfkC9djkQNhEXe41-IIk_hz1dSFoIFpPCQ2m5AEPXJJBQGNAMjbsTRRiDmidChznQIU_qEtASKDQUSEMkWkElq02-TRTpVvzgVXEI44D79323V4Xa0KfYl-gncyheU7x0wG3LJWDvwKdFgR5hDKry9HF3Mo Jul 23 21:22:30.160356 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:22:30.160356 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:22:30.160356 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:22:30.160356 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:22:30.160356 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:22:30.160356 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:22:30.160356 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 3d87ea887fea457fb07731d47de68333 Jul 23 21:22:30.160356 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-793914881 Jul 23 21:22:30.160356 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:22:30.160356 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:22:30.160356 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3d87ea887fea457fb07731d47de68333"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3d87ea887fea457fb07731d47de68333"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3d87ea887fea457fb07731d47de68333", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3d87ea887fea457fb07731d47de68333"}]}] Jul 23 21:22:30.160356 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-793914881 Jul 23 21:22:30.160356 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 3d87ea887fea457fb07731d47de68333 Jul 23 21:22:30.160356 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-793914881 Jul 23 21:22:30.160356 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project Jul 23 21:22:30.160356 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:22:30.160356 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:22:30.160356 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 672d90d732a0419ca669e0055359dcfd Jul 23 21:22:30.160356 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project Jul 23 21:22:30.160356 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:22:30.160356 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance 2cebd0e1-09ca-4eab-bda7-0743043bad23 could not be found. Jul 23 21:22:30.160356 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '2cebd0e1-09ca-4eab-bda7-0743043bad23'} Jul 23 21:22:30.160356 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:22:30.160356 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:22:30.160356 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:22:30.160356 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:22:30.160356 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:22:30.160356 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:22:30.160356 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:22:30.160356 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:22:30.160356 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:22:30.160356 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:22:30.160356 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2cebd0e1-09ca-4eab-bda7-0743043bad23 could not be found. Jul 23 21:22:30.160356 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:22:30.160356 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:22:30.160356 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:22:30.160356 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:22:30.160356 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:22:30.160356 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:22:30.160356 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:22:30.160356 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:22:30.160356 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:22:30.160356 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:22:30.160356 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:22:30.160356 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:22:30.160356 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:22:30.160356 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:22:30.160356 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:22:30.160356 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:22:30.160356 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2cebd0e1-09ca-4eab-bda7-0743043bad23 could not be found. Jul 23 21:22:30.160356 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:22:30.166065 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:22:30.166065 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:22:30.166065 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:22:30.166065 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:22:30.166065 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:22:30.166065 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:22:30.166065 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:22:30.166065 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2cebd0e1-09ca-4eab-bda7-0743043bad23 could not be found. Jul 23 21:22:30.166065 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:22:30.167242 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-fee7f1be-7f4a-4640-905f-8f906730a20e tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] Returning 404 to user: Instance 2cebd0e1-09ca-4eab-bda7-0743043bad23 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:22:30.177647 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-fee7f1be-7f4a-4640-905f-8f906730a20e tempest-FloatingIPsAssociationNegativeTestJSON-793914881 tempest-FloatingIPsAssociationNegativeTestJSON-793914881-project] 10.222.0.17 "GET /compute/v2.1/servers/2cebd0e1-09ca-4eab-bda7-0743043bad23" status: 404 len: 111 microversion: 2.1 time: 0.136559 Jul 23 21:22:30.197699 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1050/2130] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:30 2022] GET /compute/v2.1/servers/2cebd0e1-09ca-4eab-bda7-0743043bad23 => generated 111 bytes in 162 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 23 21:22:30.223126 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-eea97e3b-8fdf-465e-8a0a-d3a20e39899c tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '.version_select at 0x7f0b47eacca0>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:30.276160 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c7432983-3196-4d3f-9351-0dd7e5d0b696 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf93a4b80cb4e19a36473986950fc75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c1943188684b45b636541caf587247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:30.289047 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-c7432983-3196-4d3f-9351-0dd7e5d0b696 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] 10.222.0.17 "GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf" status: 200 len: 1472 microversion: 2.1 time: 0.430356 Jul 23 21:22:30.298576 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1081/2131] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:29 2022] GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf => generated 1472 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:30.329232 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-29800cf5-29aa-4c9b-a7d8-7728376d92ec tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:30.330142 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-29800cf5-29aa-4c9b-a7d8-7728376d92ec tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] [instance: 9aaaecf6-105b-4e72-82af-008d7590434f] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:30.337504 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-eea97e3b-8fdf-465e-8a0a-d3a20e39899c tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/images/38623b43-7126-4254-9186-2c489ddd994e" status: 200 len: 1453 microversion: 2.1 time: 0.138188 Jul 23 21:22:30.338168 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1051/2132] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:22:30 2022] GET /compute/v2.1/images/38623b43-7126-4254-9186-2c489ddd994e => generated 1453 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:30.341485 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-29800cf5-29aa-4c9b-a7d8-7728376d92ec tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:30.343982 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-29800cf5-29aa-4c9b-a7d8-7728376d92ec tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:30.344996 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-29800cf5-29aa-4c9b-a7d8-7728376d92ec tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:30.347270 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-29800cf5-29aa-4c9b-a7d8-7728376d92ec tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:30.363275 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-3fb89a88-d7f5-4781-969d-5550b1dea23d req-de9fa9de-e789-446d-a119-5359270af11a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cebd0e1-09ca-4eab-bda7-0743043bad23", "name": "network-vif-deleted", "tag": "d506fd59-3dd8-47d3-b895-177dd8661556"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:22:30.385600 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-3fb89a88-d7f5-4781-969d-5550b1dea23d req-de9fa9de-e789-446d-a119-5359270af11a service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:30.386386 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-3fb89a88-d7f5-4781-969d-5550b1dea23d req-de9fa9de-e789-446d-a119-5359270af11a service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:30.417295 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-3fb89a88-d7f5-4781-969d-5550b1dea23d req-de9fa9de-e789-446d-a119-5359270af11a service nova] Creating event network-vif-deleted:d506fd59-3dd8-47d3-b895-177dd8661556 for instance 2cebd0e1-09ca-4eab-bda7-0743043bad23 on nch2-master-1 Jul 23 21:22:30.431361 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-3fb89a88-d7f5-4781-969d-5550b1dea23d req-de9fa9de-e789-446d-a119-5359270af11a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073364 Jul 23 21:22:30.432855 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1052/2133] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:22:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:22:30.650622 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-29800cf5-29aa-4c9b-a7d8-7728376d92ec tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7acc7eae5f946aaac9f0c8ead2c8d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e0f76ca9b734142a90c27f3d3de3a85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:30.664511 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-29800cf5-29aa-4c9b-a7d8-7728376d92ec tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] 10.222.0.17 "GET /compute/v2.1/servers/9aaaecf6-105b-4e72-82af-008d7590434f" status: 200 len: 1471 microversion: 2.1 time: 0.339640 Jul 23 21:22:30.665404 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1082/2134] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:30 2022] GET /compute/v2.1/servers/9aaaecf6-105b-4e72-82af-008d7590434f => generated 1471 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:22:30.697954 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-19836791-9a86-437d-8845-1475cd9d47e0 tempest-ServersAdminNegativeTestJSON-2135340804 tempest-ServersAdminNegativeTestJSON-2135340804-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:22:30.713000 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-19836791-9a86-437d-8845-1475cd9d47e0 tempest-ServersAdminNegativeTestJSON-2135340804 tempest-ServersAdminNegativeTestJSON-2135340804-project-admin] [instance: 9aaaecf6-105b-4e72-82af-008d7590434f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:30.725892 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-19836791-9a86-437d-8845-1475cd9d47e0 tempest-ServersAdminNegativeTestJSON-2135340804 tempest-ServersAdminNegativeTestJSON-2135340804-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:30.731653 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-19836791-9a86-437d-8845-1475cd9d47e0 tempest-ServersAdminNegativeTestJSON-2135340804 tempest-ServersAdminNegativeTestJSON-2135340804-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:30.733094 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-19836791-9a86-437d-8845-1475cd9d47e0 tempest-ServersAdminNegativeTestJSON-2135340804 tempest-ServersAdminNegativeTestJSON-2135340804-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:30.733632 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-19836791-9a86-437d-8845-1475cd9d47e0 tempest-ServersAdminNegativeTestJSON-2135340804 tempest-ServersAdminNegativeTestJSON-2135340804-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:30.806870 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.objects.instance [None req-19836791-9a86-437d-8845-1475cd9d47e0 tempest-ServersAdminNegativeTestJSON-2135340804 tempest-ServersAdminNegativeTestJSON-2135340804-project-admin] Lazy-loading 'flavor' on Instance uuid 9aaaecf6-105b-4e72-82af-008d7590434f {{(pid=131320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:22:30.964361 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-19836791-9a86-437d-8845-1475cd9d47e0 tempest-ServersAdminNegativeTestJSON-2135340804 tempest-ServersAdminNegativeTestJSON-2135340804-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/9aaaecf6-105b-4e72-82af-008d7590434f/action" status: 202 len: 0 microversion: 2.1 time: 0.275022 Jul 23 21:22:30.965746 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1053/2135] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:22:30 2022] POST /compute/v2.1/servers/9aaaecf6-105b-4e72-82af-008d7590434f/action => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:22:30.975942 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-3e4d4c41-cb9d-4149-afae-b27c12f6a88e tempest-ServersAdminNegativeTestJSON-2135340804 tempest-ServersAdminNegativeTestJSON-2135340804-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:30.977175 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-3e4d4c41-cb9d-4149-afae-b27c12f6a88e tempest-ServersAdminNegativeTestJSON-2135340804 tempest-ServersAdminNegativeTestJSON-2135340804-project-admin] [instance: 9aaaecf6-105b-4e72-82af-008d7590434f] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:30.988271 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3e4d4c41-cb9d-4149-afae-b27c12f6a88e tempest-ServersAdminNegativeTestJSON-2135340804 tempest-ServersAdminNegativeTestJSON-2135340804-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:30.990475 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3e4d4c41-cb9d-4149-afae-b27c12f6a88e tempest-ServersAdminNegativeTestJSON-2135340804 tempest-ServersAdminNegativeTestJSON-2135340804-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:30.995022 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3e4d4c41-cb9d-4149-afae-b27c12f6a88e tempest-ServersAdminNegativeTestJSON-2135340804 tempest-ServersAdminNegativeTestJSON-2135340804-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:30.995674 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3e4d4c41-cb9d-4149-afae-b27c12f6a88e tempest-ServersAdminNegativeTestJSON-2135340804 tempest-ServersAdminNegativeTestJSON-2135340804-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:31.307988 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-eb649bbb-a81e-46a0-967e-ae2c30be6859 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:31.309383 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-eb649bbb-a81e-46a0-967e-ae2c30be6859 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] [instance: cef13563-7f83-4281-a26c-d5e420c41daf] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:31.319027 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-eb649bbb-a81e-46a0-967e-ae2c30be6859 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:31.319899 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-eb649bbb-a81e-46a0-967e-ae2c30be6859 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:31.321067 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-eb649bbb-a81e-46a0-967e-ae2c30be6859 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:31.321815 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-eb649bbb-a81e-46a0-967e-ae2c30be6859 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:31.457287 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell0:SELECT=14 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:22:31.542633 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-3e4d4c41-cb9d-4149-afae-b27c12f6a88e tempest-ServersAdminNegativeTestJSON-2135340804 tempest-ServersAdminNegativeTestJSON-2135340804-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/9aaaecf6-105b-4e72-82af-008d7590434f" status: 200 len: 1630 microversion: 2.1 time: 0.571384 Jul 23 21:22:31.545563 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1083/2136] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:30 2022] GET /compute/v2.1/servers/9aaaecf6-105b-4e72-82af-008d7590434f => generated 1630 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:31.556000 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-9a42f81d-3499-4729-b8f6-67ca18ecc050 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '.version_select at 0x7f0b59a69820>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:31.642565 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-9a42f81d-3499-4729-b8f6-67ca18ecc050 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/images/38623b43-7126-4254-9186-2c489ddd994e" status: 200 len: 1462 microversion: 2.1 time: 0.094731 Jul 23 21:22:31.643162 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1084/2137] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:22:31 2022] GET /compute/v2.1/images/38623b43-7126-4254-9186-2c489ddd994e => generated 1462 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:31.656540 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d922ea72-4817-41ac-a219-bdc4b9de0c95 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '.version_select at 0x7f0b59a12ee0>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:31.687117 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell0:SELECT=14 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:22:31.740677 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-d922ea72-4817-41ac-a219-bdc4b9de0c95 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/images/38623b43-7126-4254-9186-2c489ddd994e" status: 200 len: 1462 microversion: 2.1 time: 0.089634 Jul 23 21:22:31.755269 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1085/2138] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:22:31 2022] GET /compute/v2.1/images/38623b43-7126-4254-9186-2c489ddd994e => generated 1462 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:31.764899 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c644df21-83ff-428a-866f-f9f824823241 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:31.765812 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-c644df21-83ff-428a-866f-f9f824823241 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] [instance: 9933c901-3692-4f36-9f11-e1a93d902e94] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:31.774066 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c644df21-83ff-428a-866f-f9f824823241 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:31.774912 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c644df21-83ff-428a-866f-f9f824823241 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:31.776080 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c644df21-83ff-428a-866f-f9f824823241 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:31.776704 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c644df21-83ff-428a-866f-f9f824823241 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:31.779707 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-eb649bbb-a81e-46a0-967e-ae2c30be6859 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf93a4b80cb4e19a36473986950fc75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c1943188684b45b636541caf587247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:31.787939 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-eb649bbb-a81e-46a0-967e-ae2c30be6859 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] 10.222.0.17 "GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf" status: 200 len: 1472 microversion: 2.1 time: 0.484701 Jul 23 21:22:31.794277 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1054/2139] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:31 2022] GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf => generated 1472 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:32.114572 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c644df21-83ff-428a-866f-f9f824823241 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80673ab800441b4bd1f5858e1df7b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629d02efac724fa29fcfff53e370b69b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:32.129286 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-c644df21-83ff-428a-866f-f9f824823241 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/servers/9933c901-3692-4f36-9f11-e1a93d902e94" status: 200 len: 1466 microversion: 2.1 time: 0.371571 Jul 23 21:22:32.129767 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1086/2140] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:31 2022] GET /compute/v2.1/servers/9933c901-3692-4f36-9f11-e1a93d902e94 => generated 1466 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:32.147538 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-34e6bff3-0848-4da0-9279-d001149903ad tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '.version_select at 0x7f0b599105e0>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:32.316749 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-34e6bff3-0848-4da0-9279-d001149903ad tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/images?changes-since=2022-07-23T21%3A20%3A20Z" status: 200 len: 1899 microversion: 2.1 time: 0.173919 Jul 23 21:22:32.331734 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1055/2141] 10.222.0.17 () {58 vars in 1198 bytes} [Sat Jul 23 21:22:32 2022] GET /compute/v2.1/images?changes-since=2022-07-23T21%3A20%3A20Z => generated 1899 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:32.334100 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-344ab82b-ba23-4768-9fb4-35b8f39fd50c tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '.version_select at 0x7f0b545e8040>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:32.432616 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-344ab82b-ba23-4768-9fb4-35b8f39fd50c tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-226804869" status: 200 len: 484 microversion: 2.1 time: 0.102988 Jul 23 21:22:32.434084 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1087/2142] 10.222.0.17 () {58 vars in 1228 bytes} [Sat Jul 23 21:22:32 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-226804869 => generated 484 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:22:32.447552 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5aa042fe-b38c-42d5-8fda-6041032f63db tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '.version_select at 0x7f0b598ad0d0>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:32.459835 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:22:32.562863 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5aa042fe-b38c-42d5-8fda-6041032f63db tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/images?server=9933c901-3692-4f36-9f11-e1a93d902e94" status: 200 len: 956 microversion: 2.1 time: 0.120172 Jul 23 21:22:32.564196 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-05a38039-23ac-40eb-bf78-bfda0ce8d6db tempest-ServersAdminNegativeTestJSON-2135340804 tempest-ServersAdminNegativeTestJSON-2135340804-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:32.565126 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-05a38039-23ac-40eb-bf78-bfda0ce8d6db tempest-ServersAdminNegativeTestJSON-2135340804 tempest-ServersAdminNegativeTestJSON-2135340804-project-admin] [instance: 9aaaecf6-105b-4e72-82af-008d7590434f] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:32.572576 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1056/2143] 10.222.0.17 () {58 vars in 1208 bytes} [Sat Jul 23 21:22:32 2022] GET /compute/v2.1/images?server=9933c901-3692-4f36-9f11-e1a93d902e94 => generated 956 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:22:32.573956 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-05a38039-23ac-40eb-bf78-bfda0ce8d6db tempest-ServersAdminNegativeTestJSON-2135340804 tempest-ServersAdminNegativeTestJSON-2135340804-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:32.574674 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-05a38039-23ac-40eb-bf78-bfda0ce8d6db tempest-ServersAdminNegativeTestJSON-2135340804 tempest-ServersAdminNegativeTestJSON-2135340804-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:32.576035 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-05a38039-23ac-40eb-bf78-bfda0ce8d6db tempest-ServersAdminNegativeTestJSON-2135340804 tempest-ServersAdminNegativeTestJSON-2135340804-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:32.576647 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-05a38039-23ac-40eb-bf78-bfda0ce8d6db tempest-ServersAdminNegativeTestJSON-2135340804 tempest-ServersAdminNegativeTestJSON-2135340804-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:32.580655 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c626da18-8a58-41a4-95f9-93b369def6a9 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '.version_select at 0x7f0b47eace50>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:32.685090 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c626da18-8a58-41a4-95f9-93b369def6a9 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.17%2Fcompute%2Fv2.1%2Fservers%2Fc1701f99-a44c-48ca-8946-b84c5e163cee" status: 200 len: 483 microversion: 2.1 time: 0.111263 Jul 23 21:22:32.685716 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1057/2144] 10.222.0.17 () {58 vars in 1316 bytes} [Sat Jul 23 21:22:32 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.17%2Fcompute%2Fv2.1%2Fservers%2Fc1701f99-a44c-48ca-8946-b84c5e163cee => generated 483 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:22:32.705063 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ff253d45-8088-440d-b16e-205f630d965d tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '.version_select at 0x7f0b59910700>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:32.768669 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ff253d45-8088-440d-b16e-205f630d965d tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.17%2Fcompute%2Fservers%2Fc1701f99-a44c-48ca-8946-b84c5e163cee" status: 200 len: 483 microversion: 2.1 time: 0.071627 Jul 23 21:22:32.769593 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1058/2145] 10.222.0.17 () {58 vars in 1302 bytes} [Sat Jul 23 21:22:32 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.17%2Fcompute%2Fservers%2Fc1701f99-a44c-48ca-8946-b84c5e163cee => generated 483 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:22:32.783914 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-7bb28405-3191-4db2-aa2a-9976aa656875 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '.version_select at 0x7f0b5991a430>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:32.945013 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-05a38039-23ac-40eb-bf78-bfda0ce8d6db tempest-ServersAdminNegativeTestJSON-2135340804 tempest-ServersAdminNegativeTestJSON-2135340804-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/9aaaecf6-105b-4e72-82af-008d7590434f" status: 200 len: 1613 microversion: 2.1 time: 0.385769 Jul 23 21:22:32.948047 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1088/2146] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:32 2022] GET /compute/v2.1/servers/9aaaecf6-105b-4e72-82af-008d7590434f => generated 1613 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:22:32.955606 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-1fbfa48d-baae-424f-b9f2-7990b9f1cebc tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:32.958244 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-1fbfa48d-baae-424f-b9f2-7990b9f1cebc tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] [instance: cef13563-7f83-4281-a26c-d5e420c41daf] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:32.973982 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1fbfa48d-baae-424f-b9f2-7990b9f1cebc tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:32.975980 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1fbfa48d-baae-424f-b9f2-7990b9f1cebc tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:32.978652 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1fbfa48d-baae-424f-b9f2-7990b9f1cebc tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:32.979326 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1fbfa48d-baae-424f-b9f2-7990b9f1cebc tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:32.984612 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-7bb28405-3191-4db2-aa2a-9976aa656875 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3277 microversion: 2.1 time: 0.207271 Jul 23 21:22:32.987944 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1059/2147] 10.222.0.17 () {58 vars in 1148 bytes} [Sat Jul 23 21:22:32 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3277 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:33.000436 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e304d329-28cc-448c-8bed-f6857dc5b18a tempest-ServersAdminNegativeTestJSON-2135340804 tempest-ServersAdminNegativeTestJSON-2135340804-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:22:33.001140 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e304d329-28cc-448c-8bed-f6857dc5b18a tempest-ServersAdminNegativeTestJSON-2135340804 tempest-ServersAdminNegativeTestJSON-2135340804-project-admin] [instance: 9aaaecf6-105b-4e72-82af-008d7590434f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:33.022249 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e304d329-28cc-448c-8bed-f6857dc5b18a tempest-ServersAdminNegativeTestJSON-2135340804 tempest-ServersAdminNegativeTestJSON-2135340804-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:33.022868 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e304d329-28cc-448c-8bed-f6857dc5b18a tempest-ServersAdminNegativeTestJSON-2135340804 tempest-ServersAdminNegativeTestJSON-2135340804-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:33.023904 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e304d329-28cc-448c-8bed-f6857dc5b18a tempest-ServersAdminNegativeTestJSON-2135340804 tempest-ServersAdminNegativeTestJSON-2135340804-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:33.026590 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e304d329-28cc-448c-8bed-f6857dc5b18a tempest-ServersAdminNegativeTestJSON-2135340804 tempest-ServersAdminNegativeTestJSON-2135340804-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:33.207442 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-e304d329-28cc-448c-8bed-f6857dc5b18a tempest-ServersAdminNegativeTestJSON-2135340804 tempest-ServersAdminNegativeTestJSON-2135340804-project-admin] HTTP exception thrown: Cannot 'migrate' instance 9aaaecf6-105b-4e72-82af-008d7590434f while it is in vm_state suspended Jul 23 21:22:33.209307 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e304d329-28cc-448c-8bed-f6857dc5b18a tempest-ServersAdminNegativeTestJSON-2135340804 tempest-ServersAdminNegativeTestJSON-2135340804-project-admin] Request method failure captured: Jul 23 21:22:33.209307 ncdv-master-1 devstack@n-api.service[131320]: request: POST /compute/v2.1/servers/9aaaecf6-105b-4e72-82af-008d7590434f/action HTTP/1.1 Jul 23 21:22:33.209307 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:22:33.209307 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:22:33.209307 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:22:33.209307 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 15 Jul 23 21:22:33.209307 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:22:33.209307 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:22:33.209307 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:22:33.209307 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:22:33.209307 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GZg0cm9DWRWjf0OJT4Y9639GL-ciVgILfnOOBGoZAswVR9P71RAzDlHR6s9INePWY_F85ce9PbVbTjis_cLf2dBk1NMAXeVE83B25rE4IxdT1FKL76DaTV8_QI42WedKYk9CwED5H5VokIDQXmFiwB82BM2mDo6MGgV70HQMVO99nU Jul 23 21:22:33.209307 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:22:33.209307 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:22:33.209307 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:22:33.209307 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:22:33.209307 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:22:33.209307 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:22:33.209307 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: a7a5537ccc0f49c397e9f6bc723a9b7b Jul 23 21:22:33.209307 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2135340804 Jul 23 21:22:33.209307 ncdv-master-1 devstack@n-api.service[131320]: X-Role: admin,reader,member Jul 23 21:22:33.209307 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: admin,reader,member Jul 23 21:22:33.209307 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a7a5537ccc0f49c397e9f6bc723a9b7b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a7a5537ccc0f49c397e9f6bc723a9b7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a7a5537ccc0f49c397e9f6bc723a9b7b", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a7a5537ccc0f49c397e9f6bc723a9b7b"}]}] Jul 23 21:22:33.209307 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2135340804 Jul 23 21:22:33.209307 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: a7a5537ccc0f49c397e9f6bc723a9b7b Jul 23 21:22:33.209307 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2135340804 Jul 23 21:22:33.209307 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServersAdminNegativeTestJSON-2135340804-project-admin Jul 23 21:22:33.209307 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:22:33.209307 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:22:33.209307 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 745c84c03045459f948326f8e11b1c72 Jul 23 21:22:33.209307 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2135340804-project-admin Jul 23 21:22:33.209307 ncdv-master-1 devstack@n-api.service[131320]: Jul 23 21:22:33.209307 ncdv-master-1 devstack@n-api.service[131320]: {"migrate": {}} Jul 23 21:22:33.209307 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:22:33.209307 ncdv-master-1 devstack@n-api.service[131320]: exception: Cannot 'migrate' instance 9aaaecf6-105b-4e72-82af-008d7590434f while it is in vm_state suspended Jul 23 21:22:33.209307 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '9aaaecf6-105b-4e72-82af-008d7590434f', 'body': {'migrate': {}}} Jul 23 21:22:33.209307 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:22:33.209307 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:22:33.209307 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Jul 23 21:22:33.209307 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Jul 23 21:22:33.209307 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 23 21:22:33.209307 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 23 21:22:33.209307 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 23 21:22:33.209307 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 23 21:22:33.209307 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 23 21:22:33.209307 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 23 21:22:33.209307 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 23 21:22:33.209307 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 23 21:22:33.209307 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 23 21:22:33.209307 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 23 21:22:33.209307 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 23 21:22:33.209307 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 23 21:22:33.209307 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9aaaecf6-105b-4e72-82af-008d7590434f in vm_state suspended. Cannot resize while the instance is in this state. Jul 23 21:22:33.209307 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:22:33.209307 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:22:33.209307 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:22:33.209307 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:22:33.209307 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:22:33.209307 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:22:33.209307 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:22:33.209307 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:22:33.209307 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:22:33.209307 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:22:33.209307 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:22:33.214499 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:22:33.214499 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Jul 23 21:22:33.214499 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 23 21:22:33.214499 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 23 21:22:33.214499 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 23 21:22:33.214499 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 9aaaecf6-105b-4e72-82af-008d7590434f while it is in vm_state suspended Jul 23 21:22:33.214499 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:22:33.214499 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:22:33.214499 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:22:33.214499 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:22:33.214499 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:22:33.214499 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:22:33.214499 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:22:33.214499 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:22:33.214499 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 9aaaecf6-105b-4e72-82af-008d7590434f while it is in vm_state suspended Jul 23 21:22:33.214499 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:22:33.219065 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e304d329-28cc-448c-8bed-f6857dc5b18a tempest-ServersAdminNegativeTestJSON-2135340804 tempest-ServersAdminNegativeTestJSON-2135340804-project-admin] Returning 409 to user: Cannot 'migrate' instance 9aaaecf6-105b-4e72-82af-008d7590434f while it is in vm_state suspended {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:22:33.219065 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e304d329-28cc-448c-8bed-f6857dc5b18a tempest-ServersAdminNegativeTestJSON-2135340804 tempest-ServersAdminNegativeTestJSON-2135340804-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/9aaaecf6-105b-4e72-82af-008d7590434f/action" status: 409 len: 148 microversion: 2.1 time: 0.225987 Jul 23 21:22:33.219466 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1060/2148] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:22:32 2022] POST /compute/v2.1/servers/9aaaecf6-105b-4e72-82af-008d7590434f/action => generated 148 bytes in 229 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 23 21:22:33.227718 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-bdb951db-4a85-4172-8163-41f6b56bd846 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '.version_select at 0x7f0b598dcb80>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:33.313854 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-1fbfa48d-baae-424f-b9f2-7990b9f1cebc tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf93a4b80cb4e19a36473986950fc75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c1943188684b45b636541caf587247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:33.324794 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-1fbfa48d-baae-424f-b9f2-7990b9f1cebc tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] 10.222.0.17 "GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf" status: 200 len: 1472 microversion: 2.1 time: 0.375256 Jul 23 21:22:33.325429 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1089/2149] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:32 2022] GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf => generated 1472 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:33.330561 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-bdb951db-4a85-4172-8163-41f6b56bd846 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1427 microversion: 2.1 time: 0.106503 Jul 23 21:22:33.338281 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-24e7e067-453e-430f-a136-dc5832fa4c1f tempest-ServersAdminNegativeTestJSON-2135340804 tempest-ServersAdminNegativeTestJSON-2135340804-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:22:33.341619 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1061/2150] 10.222.0.17 () {58 vars in 1148 bytes} [Sat Jul 23 21:22:33 2022] GET /compute/v2.1/images?type=snapshot => generated 1427 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:33.349592 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-24e7e067-453e-430f-a136-dc5832fa4c1f tempest-ServersAdminNegativeTestJSON-2135340804 tempest-ServersAdminNegativeTestJSON-2135340804-project-admin] Request method failure captured: Jul 23 21:22:33.349592 ncdv-master-1 devstack@n-api.service[131321]: request: POST /compute/v2.1/servers/a213ec70-d903-4ce2-a577-64b4dacf9c1e/action HTTP/1.1 Jul 23 21:22:33.349592 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:22:33.349592 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:22:33.349592 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:22:33.349592 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 39 Jul 23 21:22:33.349592 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:22:33.349592 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:22:33.349592 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:22:33.349592 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:22:33.349592 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GZg0cm9DWRWjf0OJT4Y9639GL-ciVgILfnOOBGoZAswVR9P71RAzDlHR6s9INePWY_F85ce9PbVbTjis_cLf2dBk1NMAXeVE83B25rE4IxdT1FKL76DaTV8_QI42WedKYk9CwED5H5VokIDQXmFiwB82BM2mDo6MGgV70HQMVO99nU Jul 23 21:22:33.349592 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:22:33.349592 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:22:33.349592 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:22:33.349592 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:22:33.349592 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:22:33.349592 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:22:33.349592 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: a7a5537ccc0f49c397e9f6bc723a9b7b Jul 23 21:22:33.349592 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2135340804 Jul 23 21:22:33.349592 ncdv-master-1 devstack@n-api.service[131321]: X-Role: admin,reader,member Jul 23 21:22:33.349592 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: admin,reader,member Jul 23 21:22:33.349592 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a7a5537ccc0f49c397e9f6bc723a9b7b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a7a5537ccc0f49c397e9f6bc723a9b7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a7a5537ccc0f49c397e9f6bc723a9b7b", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a7a5537ccc0f49c397e9f6bc723a9b7b"}]}] Jul 23 21:22:33.349592 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2135340804 Jul 23 21:22:33.349592 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: a7a5537ccc0f49c397e9f6bc723a9b7b Jul 23 21:22:33.349592 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2135340804 Jul 23 21:22:33.349592 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ServersAdminNegativeTestJSON-2135340804-project-admin Jul 23 21:22:33.349592 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:22:33.349592 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:22:33.349592 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 745c84c03045459f948326f8e11b1c72 Jul 23 21:22:33.349592 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2135340804-project-admin Jul 23 21:22:33.349592 ncdv-master-1 devstack@n-api.service[131321]: Jul 23 21:22:33.349592 ncdv-master-1 devstack@n-api.service[131321]: {"os-resetState": {"state": "invalid"}} Jul 23 21:22:33.349592 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:22:33.349592 ncdv-master-1 devstack@n-api.service[131321]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jul 23 21:22:33.349592 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': 'a213ec70-d903-4ce2-a577-64b4dacf9c1e', 'body': {'os-resetState': {'state': 'invalid'}}} Jul 23 21:22:33.349592 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:22:33.349592 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:22:33.349592 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 23 21:22:33.349592 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 23 21:22:33.349592 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 23 21:22:33.349592 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise error Jul 23 21:22:33.349592 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Jul 23 21:22:33.349592 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:22:33.349592 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Jul 23 21:22:33.349592 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Jul 23 21:22:33.349592 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:22:33.349592 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Jul 23 21:22:33.349592 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi 'invalid' Jul 23 21:22:33.349592 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:22:33.349592 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:22:33.349592 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:22:33.349592 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:22:33.349592 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:22:33.349592 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:22:33.349592 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:22:33.349592 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:22:33.349592 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:22:33.349592 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:22:33.349592 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 23 21:22:33.349592 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 23 21:22:33.349592 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 23 21:22:33.349592 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 23 21:22:33.349592 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 23 21:22:33.349592 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 23 21:22:33.354123 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jul 23 21:22:33.354123 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:22:33.354123 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:22:33.354123 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:22:33.354123 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:22:33.354123 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:22:33.354123 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:22:33.354123 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 23 21:22:33.354123 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 23 21:22:33.354123 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jul 23 21:22:33.354123 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:22:33.354123 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-24e7e067-453e-430f-a136-dc5832fa4c1f tempest-ServersAdminNegativeTestJSON-2135340804 tempest-ServersAdminNegativeTestJSON-2135340804-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:22:33.354123 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-24e7e067-453e-430f-a136-dc5832fa4c1f tempest-ServersAdminNegativeTestJSON-2135340804 tempest-ServersAdminNegativeTestJSON-2135340804-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/a213ec70-d903-4ce2-a577-64b4dacf9c1e/action" status: 400 len: 144 microversion: 2.1 time: 0.022799 Jul 23 21:22:33.354123 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1090/2151] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:22:33 2022] POST /compute/v2.1/servers/a213ec70-d903-4ce2-a577-64b4dacf9c1e/action => generated 144 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 23 21:22:33.364145 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1582a724-bc75-4819-8d85-36dd5db95b39 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '.version_select at 0x7f0b5991a310>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:33.367621 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-911f8236-fdaa-443b-b385-3f9466f2bbe9 tempest-ServersAdminNegativeTestJSON-2135340804 tempest-ServersAdminNegativeTestJSON-2135340804-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:22:33.374368 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-911f8236-fdaa-443b-b385-3f9466f2bbe9 tempest-ServersAdminNegativeTestJSON-2135340804 tempest-ServersAdminNegativeTestJSON-2135340804-project-admin] Request method failure captured: Jul 23 21:22:33.374368 ncdv-master-1 devstack@n-api.service[131321]: request: POST /compute/v2.1/servers/a213ec70-d903-4ce2-a577-64b4dacf9c1e/action HTTP/1.1 Jul 23 21:22:33.374368 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:22:33.374368 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:22:33.374368 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:22:33.374368 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 31 Jul 23 21:22:33.374368 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:22:33.374368 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:22:33.374368 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:22:33.374368 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:22:33.374368 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GZg0cm9DWRWjf0OJT4Y9639GL-ciVgILfnOOBGoZAswVR9P71RAzDlHR6s9INePWY_F85ce9PbVbTjis_cLf2dBk1NMAXeVE83B25rE4IxdT1FKL76DaTV8_QI42WedKYk9CwED5H5VokIDQXmFiwB82BM2mDo6MGgV70HQMVO99nU Jul 23 21:22:33.374368 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:22:33.374368 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:22:33.374368 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:22:33.374368 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:22:33.374368 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:22:33.374368 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:22:33.374368 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: a7a5537ccc0f49c397e9f6bc723a9b7b Jul 23 21:22:33.374368 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2135340804 Jul 23 21:22:33.374368 ncdv-master-1 devstack@n-api.service[131321]: X-Role: admin,reader,member Jul 23 21:22:33.374368 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: admin,reader,member Jul 23 21:22:33.374368 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a7a5537ccc0f49c397e9f6bc723a9b7b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a7a5537ccc0f49c397e9f6bc723a9b7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a7a5537ccc0f49c397e9f6bc723a9b7b", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a7a5537ccc0f49c397e9f6bc723a9b7b"}]}] Jul 23 21:22:33.374368 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2135340804 Jul 23 21:22:33.374368 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: a7a5537ccc0f49c397e9f6bc723a9b7b Jul 23 21:22:33.374368 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2135340804 Jul 23 21:22:33.374368 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ServersAdminNegativeTestJSON-2135340804-project-admin Jul 23 21:22:33.374368 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:22:33.374368 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:22:33.374368 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 745c84c03045459f948326f8e11b1c72 Jul 23 21:22:33.374368 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2135340804-project-admin Jul 23 21:22:33.374368 ncdv-master-1 devstack@n-api.service[131321]: Jul 23 21:22:33.374368 ncdv-master-1 devstack@n-api.service[131321]: {"os-resetState": {"state": 1}} Jul 23 21:22:33.374368 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:22:33.374368 ncdv-master-1 devstack@n-api.service[131321]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jul 23 21:22:33.374368 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': 'a213ec70-d903-4ce2-a577-64b4dacf9c1e', 'body': {'os-resetState': {'state': 1}}} Jul 23 21:22:33.374368 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:22:33.374368 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:22:33.374368 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 23 21:22:33.374368 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 23 21:22:33.374368 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 23 21:22:33.374368 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise error Jul 23 21:22:33.374368 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Jul 23 21:22:33.374368 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:22:33.374368 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Jul 23 21:22:33.374368 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Jul 23 21:22:33.374368 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:22:33.374368 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Jul 23 21:22:33.374368 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi 1 Jul 23 21:22:33.374368 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:22:33.374368 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:22:33.374368 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:22:33.374368 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:22:33.374368 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:22:33.374368 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:22:33.374368 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:22:33.374368 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:22:33.374368 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:22:33.374368 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:22:33.374368 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 23 21:22:33.374368 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 23 21:22:33.374368 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 23 21:22:33.374368 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 23 21:22:33.374368 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 23 21:22:33.374368 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 23 21:22:33.374368 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jul 23 21:22:33.374368 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:22:33.378933 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:22:33.378933 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:22:33.378933 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:22:33.378933 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:22:33.378933 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:22:33.378933 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 23 21:22:33.378933 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 23 21:22:33.378933 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jul 23 21:22:33.378933 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:22:33.383291 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-911f8236-fdaa-443b-b385-3f9466f2bbe9 tempest-ServersAdminNegativeTestJSON-2135340804 tempest-ServersAdminNegativeTestJSON-2135340804-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:22:33.386057 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-911f8236-fdaa-443b-b385-3f9466f2bbe9 tempest-ServersAdminNegativeTestJSON-2135340804 tempest-ServersAdminNegativeTestJSON-2135340804-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/a213ec70-d903-4ce2-a577-64b4dacf9c1e/action" status: 400 len: 120 microversion: 2.1 time: 0.026323 Jul 23 21:22:33.388844 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1091/2152] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:22:33 2022] POST /compute/v2.1/servers/a213ec70-d903-4ce2-a577-64b4dacf9c1e/action => generated 120 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 23 21:22:33.412853 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-24359406-bbc3-4453-83b9-3761a845bc17 tempest-ServersAdminNegativeTestJSON-2135340804 tempest-ServersAdminNegativeTestJSON-2135340804-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:22:33.415851 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-24359406-bbc3-4453-83b9-3761a845bc17 tempest-ServersAdminNegativeTestJSON-2135340804 tempest-ServersAdminNegativeTestJSON-2135340804-project-admin] Failed to fetch instance by id 999 {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 23 21:22:33.417157 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-24359406-bbc3-4453-83b9-3761a845bc17 tempest-ServersAdminNegativeTestJSON-2135340804 tempest-ServersAdminNegativeTestJSON-2135340804-project-admin] HTTP exception thrown: Instance 999 could not be found. Jul 23 21:22:33.427878 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-24359406-bbc3-4453-83b9-3761a845bc17 tempest-ServersAdminNegativeTestJSON-2135340804 tempest-ServersAdminNegativeTestJSON-2135340804-project-admin] Request method failure captured: Jul 23 21:22:33.427878 ncdv-master-1 devstack@n-api.service[131321]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Jul 23 21:22:33.427878 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:22:33.427878 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:22:33.427878 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:22:33.427878 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 37 Jul 23 21:22:33.427878 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:22:33.427878 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:22:33.427878 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:22:33.427878 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:22:33.427878 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GZg0cm9DWRWjf0OJT4Y9639GL-ciVgILfnOOBGoZAswVR9P71RAzDlHR6s9INePWY_F85ce9PbVbTjis_cLf2dBk1NMAXeVE83B25rE4IxdT1FKL76DaTV8_QI42WedKYk9CwED5H5VokIDQXmFiwB82BM2mDo6MGgV70HQMVO99nU Jul 23 21:22:33.427878 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:22:33.427878 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:22:33.427878 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:22:33.427878 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:22:33.427878 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:22:33.427878 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:22:33.427878 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: a7a5537ccc0f49c397e9f6bc723a9b7b Jul 23 21:22:33.427878 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2135340804 Jul 23 21:22:33.427878 ncdv-master-1 devstack@n-api.service[131321]: X-Role: admin,reader,member Jul 23 21:22:33.427878 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: admin,reader,member Jul 23 21:22:33.427878 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a7a5537ccc0f49c397e9f6bc723a9b7b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a7a5537ccc0f49c397e9f6bc723a9b7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a7a5537ccc0f49c397e9f6bc723a9b7b", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a7a5537ccc0f49c397e9f6bc723a9b7b"}]}] Jul 23 21:22:33.427878 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2135340804 Jul 23 21:22:33.427878 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: a7a5537ccc0f49c397e9f6bc723a9b7b Jul 23 21:22:33.427878 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2135340804 Jul 23 21:22:33.427878 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ServersAdminNegativeTestJSON-2135340804-project-admin Jul 23 21:22:33.427878 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:22:33.427878 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:22:33.427878 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 745c84c03045459f948326f8e11b1c72 Jul 23 21:22:33.427878 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2135340804-project-admin Jul 23 21:22:33.427878 ncdv-master-1 devstack@n-api.service[131321]: Jul 23 21:22:33.427878 ncdv-master-1 devstack@n-api.service[131321]: {"os-resetState": {"state": "error"}} Jul 23 21:22:33.427878 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:22:33.427878 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance 999 could not be found. Jul 23 21:22:33.427878 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Jul 23 21:22:33.427878 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:22:33.427878 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:22:33.427878 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:22:33.427878 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:22:33.427878 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 23 21:22:33.427878 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 23 21:22:33.427878 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Jul 23 21:22:33.427878 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:22:33.427878 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:22:33.427878 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:22:33.427878 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:22:33.427878 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:22:33.427878 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:22:33.427878 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:22:33.427878 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:22:33.427878 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:22:33.427878 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:22:33.427878 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:22:33.427878 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:22:33.427878 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Jul 23 21:22:33.427878 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 23 21:22:33.427878 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:22:33.427878 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:22:33.427878 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Jul 23 21:22:33.427878 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:22:33.427878 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:22:33.427878 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:22:33.427878 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:22:33.427878 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:22:33.427878 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:22:33.427878 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:22:33.432156 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:22:33.432156 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Jul 23 21:22:33.432156 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:22:33.433421 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-24359406-bbc3-4453-83b9-3761a845bc17 tempest-ServersAdminNegativeTestJSON-2135340804 tempest-ServersAdminNegativeTestJSON-2135340804-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:22:33.435069 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-24359406-bbc3-4453-83b9-3761a845bc17 tempest-ServersAdminNegativeTestJSON-2135340804 tempest-ServersAdminNegativeTestJSON-2135340804-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.039595 Jul 23 21:22:33.436425 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1092/2153] 10.222.0.17 () {60 vars in 1178 bytes} [Sat Jul 23 21:22:33 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 23 21:22:33.446615 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-5e4dc895-ce09-4503-a16e-a549728e807d tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:33.449956 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-5e4dc895-ce09-4503-a16e-a549728e807d tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] [instance: 9aaaecf6-105b-4e72-82af-008d7590434f] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:33.466815 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5e4dc895-ce09-4503-a16e-a549728e807d tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:33.467841 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5e4dc895-ce09-4503-a16e-a549728e807d tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:33.470397 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5e4dc895-ce09-4503-a16e-a549728e807d tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:33.471031 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5e4dc895-ce09-4503-a16e-a549728e807d tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:33.528179 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-5e4dc895-ce09-4503-a16e-a549728e807d tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] [instance: 9aaaecf6-105b-4e72-82af-008d7590434f] Going to try to terminate instance {{(pid=131321) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:22:33.606313 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1582a724-bc75-4819-8d85-36dd5db95b39 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/images?limit=1" status: 200 len: 620 microversion: 2.1 time: 0.256862 Jul 23 21:22:33.607080 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1062/2154] 10.222.0.17 () {58 vars in 1136 bytes} [Sat Jul 23 21:22:33 2022] GET /compute/v2.1/images?limit=1 => generated 620 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:22:33.625150 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c8019de9-858a-4389-aa38-8f5435d79b12 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '.version_select at 0x7f0b59910ee0>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:33.757419 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c8019de9-858a-4389-aa38-8f5435d79b12 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/images/detail?changes-since=2022-07-23T21%3A20%3A16Z" status: 200 len: 6330 microversion: 2.1 time: 0.141390 Jul 23 21:22:33.759930 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1063/2155] 10.222.0.17 () {58 vars in 1219 bytes} [Sat Jul 23 21:22:33 2022] GET /compute/v2.1/images/detail?changes-since=2022-07-23T21%3A20%3A16Z => generated 6330 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:22:33.765756 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:22:33.772104 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-5e4dc895-ce09-4503-a16e-a549728e807d tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] 10.222.0.17 "DELETE /compute/v2.1/servers/9aaaecf6-105b-4e72-82af-008d7590434f" status: 204 len: 0 microversion: 2.1 time: 0.329688 Jul 23 21:22:33.773488 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1093/2156] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:22:33 2022] DELETE /compute/v2.1/servers/9aaaecf6-105b-4e72-82af-008d7590434f => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 23 21:22:33.776972 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-fe596879-c0e1-4b0b-a194-b36b53cecd71 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '.version_select at 0x7f0b5991aaf0>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:33.788660 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-92e2bc36-338d-4943-a8c3-1d25ddd051b2 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:33.790396 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-92e2bc36-338d-4943-a8c3-1d25ddd051b2 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] [instance: 9aaaecf6-105b-4e72-82af-008d7590434f] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:33.803583 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-92e2bc36-338d-4943-a8c3-1d25ddd051b2 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:33.804557 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-92e2bc36-338d-4943-a8c3-1d25ddd051b2 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:33.805700 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-92e2bc36-338d-4943-a8c3-1d25ddd051b2 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:33.806365 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-92e2bc36-338d-4943-a8c3-1d25ddd051b2 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:33.857380 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-fe596879-c0e1-4b0b-a194-b36b53cecd71 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-226804869" status: 200 len: 664 microversion: 2.1 time: 0.084400 Jul 23 21:22:33.858984 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1064/2157] 10.222.0.17 () {58 vars in 1249 bytes} [Sat Jul 23 21:22:33 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-226804869 => generated 664 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:22:33.884217 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5b1fba53-8538-490b-9a34-69b46b05fc9d tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '.version_select at 0x7f0b5991a1f0>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:33.957718 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5b1fba53-8538-490b-9a34-69b46b05fc9d tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.17%2Fcompute%2Fv2.1%2Fservers%2Fc1701f99-a44c-48ca-8946-b84c5e163cee" status: 200 len: 1465 microversion: 2.1 time: 0.088923 Jul 23 21:22:33.961674 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1065/2158] 10.222.0.17 () {58 vars in 1337 bytes} [Sat Jul 23 21:22:33 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.17%2Fcompute%2Fv2.1%2Fservers%2Fc1701f99-a44c-48ca-8946-b84c5e163cee => generated 1465 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:33.977044 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-802d63c4-e505-4df5-af6a-f301921093a6 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '.version_select at 0x7f0b5990fdc0>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:34.043965 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-802d63c4-e505-4df5-af6a-f301921093a6 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.17%2Fcompute%2Fservers%2Fc1701f99-a44c-48ca-8946-b84c5e163cee" status: 200 len: 1465 microversion: 2.1 time: 0.073309 Jul 23 21:22:34.044676 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1066/2159] 10.222.0.17 () {58 vars in 1323 bytes} [Sat Jul 23 21:22:33 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.17%2Fcompute%2Fservers%2Fc1701f99-a44c-48ca-8946-b84c5e163cee => generated 1465 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:22:34.060530 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-622106f9-0559-4457-b91a-337353ebc7b0 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '.version_select at 0x7f0b598dc820>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:34.160056 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-622106f9-0559-4457-b91a-337353ebc7b0 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7105 microversion: 2.1 time: 0.104650 Jul 23 21:22:34.162310 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1067/2160] 10.222.0.17 () {58 vars in 1169 bytes} [Sat Jul 23 21:22:34 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7105 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:34.181499 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2172c3cb-0107-49f1-8cdc-c71ef92ec4e5 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '.version_select at 0x7f0b5990f550>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:34.255643 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-92e2bc36-338d-4943-a8c3-1d25ddd051b2 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7acc7eae5f946aaac9f0c8ead2c8d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e0f76ca9b734142a90c27f3d3de3a85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:34.270352 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-92e2bc36-338d-4943-a8c3-1d25ddd051b2 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] 10.222.0.17 "GET /compute/v2.1/servers/9aaaecf6-105b-4e72-82af-008d7590434f" status: 200 len: 1468 microversion: 2.1 time: 0.490506 Jul 23 21:22:34.271857 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1094/2161] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:33 2022] GET /compute/v2.1/servers/9aaaecf6-105b-4e72-82af-008d7590434f => generated 1468 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:22:34.280171 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2172c3cb-0107-49f1-8cdc-c71ef92ec4e5 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4373 microversion: 2.1 time: 0.102726 Jul 23 21:22:34.281978 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1068/2162] 10.222.0.17 () {58 vars in 1169 bytes} [Sat Jul 23 21:22:34 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4373 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:22:34.295317 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-52598734-34ba-4d74-a8b8-198d51f4e171 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '.version_select at 0x7f0b59a1b0d0>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:34.344266 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-dd18981c-0f20-4e5c-9d0f-db76958e0687 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:34.345011 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-dd18981c-0f20-4e5c-9d0f-db76958e0687 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] [instance: cef13563-7f83-4281-a26c-d5e420c41daf] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:34.366547 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-52598734-34ba-4d74-a8b8-198d51f4e171 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/images/b27b20aa-ef1b-4dd1-989e-321af6343d6a" status: 200 len: 784 microversion: 2.1 time: 0.076130 Jul 23 21:22:34.367726 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1095/2163] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:22:34 2022] GET /compute/v2.1/images/b27b20aa-ef1b-4dd1-989e-321af6343d6a => generated 784 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:22:34.367918 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dd18981c-0f20-4e5c-9d0f-db76958e0687 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:34.369090 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dd18981c-0f20-4e5c-9d0f-db76958e0687 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:34.370654 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dd18981c-0f20-4e5c-9d0f-db76958e0687 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:34.372586 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dd18981c-0f20-4e5c-9d0f-db76958e0687 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:34.380845 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d1e06e5c-5ab7-4033-9c4c-6206c03fd46d tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '.version_select at 0x7f0b541f70d0>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:34.475319 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-d1e06e5c-5ab7-4033-9c4c-6206c03fd46d tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1609 microversion: 2.1 time: 0.098451 Jul 23 21:22:34.475920 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1096/2164] 10.222.0.17 () {58 vars in 1157 bytes} [Sat Jul 23 21:22:34 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1609 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:22:34.490136 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-91faabdd-b416-41fc-a20a-6c1d73887e37 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '.version_select at 0x7f0b47601e50>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:34.738954 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-dd18981c-0f20-4e5c-9d0f-db76958e0687 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf93a4b80cb4e19a36473986950fc75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c1943188684b45b636541caf587247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:34.749706 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-dd18981c-0f20-4e5c-9d0f-db76958e0687 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] 10.222.0.17 "GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf" status: 200 len: 1472 microversion: 2.1 time: 0.410700 Jul 23 21:22:34.781962 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1069/2165] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:34 2022] GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf => generated 1472 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:22:35.299467 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5704cb48-dc3b-4167-b325-85404181596e tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:35.300266 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5704cb48-dc3b-4167-b325-85404181596e tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] [instance: 9aaaecf6-105b-4e72-82af-008d7590434f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:35.310452 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5704cb48-dc3b-4167-b325-85404181596e tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:35.311689 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5704cb48-dc3b-4167-b325-85404181596e tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:35.312587 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5704cb48-dc3b-4167-b325-85404181596e tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:35.313165 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5704cb48-dc3b-4167-b325-85404181596e tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:35.570252 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5704cb48-dc3b-4167-b325-85404181596e tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7acc7eae5f946aaac9f0c8ead2c8d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e0f76ca9b734142a90c27f3d3de3a85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:35.577190 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:22:35.581907 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5704cb48-dc3b-4167-b325-85404181596e tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] 10.222.0.17 "GET /compute/v2.1/servers/9aaaecf6-105b-4e72-82af-008d7590434f" status: 200 len: 1468 microversion: 2.1 time: 0.296069 Jul 23 21:22:35.594067 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1070/2166] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:35 2022] GET /compute/v2.1/servers/9aaaecf6-105b-4e72-82af-008d7590434f => generated 1468 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:35.645438 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-91faabdd-b416-41fc-a20a-6c1d73887e37 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "DELETE /compute/v2.1/images/38623b43-7126-4254-9186-2c489ddd994e" status: 204 len: 0 microversion: 2.1 time: 1.159871 Jul 23 21:22:35.646373 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1097/2167] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:34 2022] DELETE /compute/v2.1/images/38623b43-7126-4254-9186-2c489ddd994e => generated 0 bytes in 1162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 23 21:22:35.657797 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-7dca676c-510e-488c-9c6a-dadf2a55760e tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '.version_select at 0x7f0b598b09d0>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:35.773577 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-78188b08-18ec-46cd-a980-767e3c7ca7ed tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Action: 'create', calling method: .version_select at 0x7f0b470059d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1061381681", "description": "tempest-description-1260433827"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:22:36.164651 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-78188b08-18ec-46cd-a980-767e3c7ca7ed tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.580667 Jul 23 21:22:36.165630 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1071/2168] 10.222.0.17 () {60 vars in 1179 bytes} [Sat Jul 23 21:22:35 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:22:36.173235 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-53ec934c-5571-4641-8325-752b4f46789b tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:36.175741 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-53ec934c-5571-4641-8325-752b4f46789b tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] [instance: cef13563-7f83-4281-a26c-d5e420c41daf] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:36.195755 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-53ec934c-5571-4641-8325-752b4f46789b tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:36.197251 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-53ec934c-5571-4641-8325-752b4f46789b tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:36.198256 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-53ec934c-5571-4641-8325-752b4f46789b tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:36.199442 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-53ec934c-5571-4641-8325-752b4f46789b tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:36.481704 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-53ec934c-5571-4641-8325-752b4f46789b tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf93a4b80cb4e19a36473986950fc75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c1943188684b45b636541caf587247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:36.494150 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-53ec934c-5571-4641-8325-752b4f46789b tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] 10.222.0.17 "GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf" status: 200 len: 1472 microversion: 2.1 time: 0.326773 Jul 23 21:22:36.498799 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1072/2169] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:36 2022] GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf => generated 1472 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:36.510943 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b7b62991-fb74-4401-8c1f-90d6416abd6a tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Action: 'create', calling method: .version_select at 0x7f0b47005d30>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1262830324", "description": "tempest-description-839058062"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:22:36.576070 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-7dca676c-510e-488c-9c6a-dadf2a55760e tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "DELETE /compute/v2.1/images/ee136f2b-cfa9-44cf-899c-7795cf98e798" status: 204 len: 0 microversion: 2.1 time: 0.924178 Jul 23 21:22:36.576847 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1098/2170] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:35 2022] DELETE /compute/v2.1/images/ee136f2b-cfa9-44cf-899c-7795cf98e798 => generated 0 bytes in 926 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 23 21:22:36.586381 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-cb13b783-4feb-4e95-a0c9-45a6f9de830b tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '.version_select at 0x7f0b599e6b80>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:36.921227 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b7b62991-fb74-4401-8c1f-90d6416abd6a tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.421006 Jul 23 21:22:36.924825 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1073/2171] 10.222.0.17 () {60 vars in 1179 bytes} [Sat Jul 23 21:22:36 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:22:36.932895 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-896c1f5c-030c-4fae-99f6-04ea1af08858 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:36.933530 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-896c1f5c-030c-4fae-99f6-04ea1af08858 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] [instance: 9aaaecf6-105b-4e72-82af-008d7590434f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:36.971943 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-896c1f5c-030c-4fae-99f6-04ea1af08858 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:36.974305 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-896c1f5c-030c-4fae-99f6-04ea1af08858 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:36.978785 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-896c1f5c-030c-4fae-99f6-04ea1af08858 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:36.982063 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-896c1f5c-030c-4fae-99f6-04ea1af08858 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:37.049143 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-896c1f5c-030c-4fae-99f6-04ea1af08858 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:37.049694 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-896c1f5c-030c-4fae-99f6-04ea1af08858 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:37.050811 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.objects.instance [None req-896c1f5c-030c-4fae-99f6-04ea1af08858 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lazy-loading 'fault' on Instance uuid 9aaaecf6-105b-4e72-82af-008d7590434f {{(pid=131320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:22:37.125053 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-896c1f5c-030c-4fae-99f6-04ea1af08858 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7acc7eae5f946aaac9f0c8ead2c8d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e0f76ca9b734142a90c27f3d3de3a85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:37.145017 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-896c1f5c-030c-4fae-99f6-04ea1af08858 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] 10.222.0.17 "GET /compute/v2.1/servers/9aaaecf6-105b-4e72-82af-008d7590434f" status: 200 len: 1312 microversion: 2.1 time: 0.217081 Jul 23 21:22:37.146519 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1074/2172] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:36 2022] GET /compute/v2.1/servers/9aaaecf6-105b-4e72-82af-008d7590434f => generated 1312 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:37.151232 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-bec91826-2cc5-453c-a4f1-b37960b00e25 req-0882b111-ea3c-4d5d-bde0-a7e69aaf0375 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9aaaecf6-105b-4e72-82af-008d7590434f", "name": "network-vif-deleted", "tag": "8a7d11dc-bfd9-4d09-88b6-8940c0ee2edb"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:22:37.186294 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-bec91826-2cc5-453c-a4f1-b37960b00e25 req-0882b111-ea3c-4d5d-bde0-a7e69aaf0375 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:37.187123 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-bec91826-2cc5-453c-a4f1-b37960b00e25 req-0882b111-ea3c-4d5d-bde0-a7e69aaf0375 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:37.203372 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-bec91826-2cc5-453c-a4f1-b37960b00e25 req-0882b111-ea3c-4d5d-bde0-a7e69aaf0375 service nova] Creating event network-vif-deleted:8a7d11dc-bfd9-4d09-88b6-8940c0ee2edb for instance 9aaaecf6-105b-4e72-82af-008d7590434f on nch2-master-1 Jul 23 21:22:37.211749 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-bec91826-2cc5-453c-a4f1-b37960b00e25 req-0882b111-ea3c-4d5d-bde0-a7e69aaf0375 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063828 Jul 23 21:22:37.213048 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1075/2173] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:22:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:22:37.220789 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-cac45a5b-e4e3-4d1d-a774-dfe7ed007f8d tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1908201048", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "networks": [{"uuid": "caefaca5-3204-4393-accf-e178aadc9c77"}]}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:22:37.330239 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-cac45a5b-e4e3-4d1d-a774-dfe7ed007f8d tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] validate_networks() for [('caefaca5-3204-4393-accf-e178aadc9c77', None, None, None, None, None)] {{(pid=131320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:22:37.356639 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-cb13b783-4feb-4e95-a0c9-45a6f9de830b tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "DELETE /compute/v2.1/images/76af21a6-17d9-434a-b039-2b4f2d2c8a7f" status: 204 len: 0 microversion: 2.1 time: 0.773978 Jul 23 21:22:37.357578 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1099/2174] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:36 2022] DELETE /compute/v2.1/images/76af21a6-17d9-434a-b039-2b4f2d2c8a7f => generated 0 bytes in 777 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:22:37.368656 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-3f06beb0-5191-4b2f-a517-df116c67162b req-b9afd181-c727-4fa9-bb01-19c8d2c3d48c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9933c901-3692-4f36-9f11-e1a93d902e94", "name": "network-vif-unplugged", "status": "completed", "tag": "710f608f-25bd-47cb-9727-946c3bac499f"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:22:37.384270 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-3f06beb0-5191-4b2f-a517-df116c67162b req-b9afd181-c727-4fa9-bb01-19c8d2c3d48c service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:37.385915 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-3f06beb0-5191-4b2f-a517-df116c67162b req-b9afd181-c727-4fa9-bb01-19c8d2c3d48c service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:37.401295 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-3f06beb0-5191-4b2f-a517-df116c67162b req-b9afd181-c727-4fa9-bb01-19c8d2c3d48c service nova] Creating event network-vif-unplugged:710f608f-25bd-47cb-9727-946c3bac499f for instance 9933c901-3692-4f36-9f11-e1a93d902e94 on nch1-master-1 Jul 23 21:22:37.408532 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-3f06beb0-5191-4b2f-a517-df116c67162b req-b9afd181-c727-4fa9-bb01-19c8d2c3d48c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044870 Jul 23 21:22:37.409647 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1100/2175] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:22:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:22:37.415898 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-23430a42-1bf0-4d89-a1cc-6723de9fb797 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:37.416823 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-23430a42-1bf0-4d89-a1cc-6723de9fb797 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] [instance: c1701f99-a44c-48ca-8946-b84c5e163cee] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:37.425252 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-23430a42-1bf0-4d89-a1cc-6723de9fb797 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:37.425788 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-23430a42-1bf0-4d89-a1cc-6723de9fb797 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:37.426767 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-23430a42-1bf0-4d89-a1cc-6723de9fb797 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:37.427212 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-23430a42-1bf0-4d89-a1cc-6723de9fb797 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:37.457327 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:22:37.469532 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-23430a42-1bf0-4d89-a1cc-6723de9fb797 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] [instance: c1701f99-a44c-48ca-8946-b84c5e163cee] Going to try to terminate instance {{(pid=131321) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:22:37.596878 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-23430a42-1bf0-4d89-a1cc-6723de9fb797 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "DELETE /compute/v2.1/servers/c1701f99-a44c-48ca-8946-b84c5e163cee" status: 204 len: 0 microversion: 2.1 time: 0.184296 Jul 23 21:22:37.597483 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1101/2176] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:22:37 2022] DELETE /compute/v2.1/servers/c1701f99-a44c-48ca-8946-b84c5e163cee => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:22:37.607001 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-aad08400-057a-4e5c-9c73-ce2a25157854 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:37.607779 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-aad08400-057a-4e5c-9c73-ce2a25157854 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] [instance: cef13563-7f83-4281-a26c-d5e420c41daf] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:37.614840 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-aad08400-057a-4e5c-9c73-ce2a25157854 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:37.615401 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-aad08400-057a-4e5c-9c73-ce2a25157854 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:37.616256 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-aad08400-057a-4e5c-9c73-ce2a25157854 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:37.616734 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-aad08400-057a-4e5c-9c73-ce2a25157854 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:37.784469 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-aad08400-057a-4e5c-9c73-ce2a25157854 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf93a4b80cb4e19a36473986950fc75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c1943188684b45b636541caf587247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:37.795474 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-aad08400-057a-4e5c-9c73-ce2a25157854 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] 10.222.0.17 "GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf" status: 200 len: 1472 microversion: 2.1 time: 0.192973 Jul 23 21:22:37.796076 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1102/2177] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:37 2022] GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf => generated 1472 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:37.811299 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-872aab15-4467-4021-9313-1225809aeacd tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:37.812302 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-872aab15-4467-4021-9313-1225809aeacd tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] [instance: c1701f99-a44c-48ca-8946-b84c5e163cee] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:37.820509 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-872aab15-4467-4021-9313-1225809aeacd tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:37.821253 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-872aab15-4467-4021-9313-1225809aeacd tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:37.822251 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-872aab15-4467-4021-9313-1225809aeacd tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:37.822836 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-872aab15-4467-4021-9313-1225809aeacd tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:38.052498 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-872aab15-4467-4021-9313-1225809aeacd tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80673ab800441b4bd1f5858e1df7b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629d02efac724fa29fcfff53e370b69b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:38.066899 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-872aab15-4467-4021-9313-1225809aeacd tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/servers/c1701f99-a44c-48ca-8946-b84c5e163cee" status: 200 len: 1473 microversion: 2.1 time: 0.269726 Jul 23 21:22:38.067666 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1103/2178] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:37 2022] GET /compute/v2.1/servers/c1701f99-a44c-48ca-8946-b84c5e163cee => generated 1473 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:38.106602 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-cac45a5b-e4e3-4d1d-a774-dfe7ed007f8d tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:22:38.108048 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-cac45a5b-e4e3-4d1d-a774-dfe7ed007f8d tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:22:38.109502 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-cac45a5b-e4e3-4d1d-a774-dfe7ed007f8d tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:22:38.110780 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-cac45a5b-e4e3-4d1d-a774-dfe7ed007f8d tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:22:38.111218 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-cac45a5b-e4e3-4d1d-a774-dfe7ed007f8d tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:22:38.127433 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cac45a5b-e4e3-4d1d-a774-dfe7ed007f8d tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:38.128167 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cac45a5b-e4e3-4d1d-a774-dfe7ed007f8d tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:38.129261 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cac45a5b-e4e3-4d1d-a774-dfe7ed007f8d tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:38.130244 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cac45a5b-e4e3-4d1d-a774-dfe7ed007f8d tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:38.151304 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:22:38.160402 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-cac45a5b-e4e3-4d1d-a774-dfe7ed007f8d tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Getting quotas for project 55cfd65431cf4b878ab1c0e25a0ac629. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:22:38.167238 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-cac45a5b-e4e3-4d1d-a774-dfe7ed007f8d tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Getting quotas for user 63ca7a39a8174a4b97767245e80b2bf7 and project 55cfd65431cf4b878ab1c0e25a0ac629. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:22:38.172207 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-60a12c0a-cc0c-4067-a4e5-92d06c8590b5 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:38.174903 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-60a12c0a-cc0c-4067-a4e5-92d06c8590b5 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] [instance: 9aaaecf6-105b-4e72-82af-008d7590434f] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:38.184935 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-cac45a5b-e4e3-4d1d-a774-dfe7ed007f8d tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Going to run 1 instances... {{(pid=131320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:22:38.188060 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-cac45a5b-e4e3-4d1d-a774-dfe7ed007f8d tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] [instance: 4824dd17-e11d-4def-ab59-9eb6279e46e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:22:38.190932 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-60a12c0a-cc0c-4067-a4e5-92d06c8590b5 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:38.192208 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-60a12c0a-cc0c-4067-a4e5-92d06c8590b5 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:38.193244 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-60a12c0a-cc0c-4067-a4e5-92d06c8590b5 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:38.194895 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-60a12c0a-cc0c-4067-a4e5-92d06c8590b5 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:38.219881 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-60a12c0a-cc0c-4067-a4e5-92d06c8590b5 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] HTTP exception thrown: Instance 9aaaecf6-105b-4e72-82af-008d7590434f could not be found. Jul 23 21:22:38.220864 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-60a12c0a-cc0c-4067-a4e5-92d06c8590b5 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Request method failure captured: Jul 23 21:22:38.220864 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/servers/9aaaecf6-105b-4e72-82af-008d7590434f HTTP/1.1 Jul 23 21:22:38.220864 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:22:38.220864 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:22:38.220864 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:22:38.220864 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:22:38.220864 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:22:38.220864 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:22:38.220864 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:22:38.220864 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:22:38.220864 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GZfRj-WFRZoxZcUf8Yx0hkg8bIZqzDhmmXQFJXqflfqyQv9ha6pKRA_dMTT9WsR3MGaBO0FtYffXVGltDrI7eZ02R_QGUO-xXtsvNjWsNGjkQOF4HNwoWgyrTsmXm3fBSIHZI-LuX7WY6o74l3YgvAbe35eCjnNMV3DD6j5SlCTX9o Jul 23 21:22:38.220864 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:22:38.220864 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:22:38.220864 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:22:38.220864 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:22:38.220864 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:22:38.220864 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:22:38.220864 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 7e0f76ca9b734142a90c27f3d3de3a85 Jul 23 21:22:38.220864 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-420496500 Jul 23 21:22:38.220864 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:22:38.220864 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:22:38.220864 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7e0f76ca9b734142a90c27f3d3de3a85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7e0f76ca9b734142a90c27f3d3de3a85"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_7e0f76ca9b734142a90c27f3d3de3a85", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/7e0f76ca9b734142a90c27f3d3de3a85"}]}] Jul 23 21:22:38.220864 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ServersAdminNegativeTestJSON-420496500 Jul 23 21:22:38.220864 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 7e0f76ca9b734142a90c27f3d3de3a85 Jul 23 21:22:38.220864 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-420496500 Jul 23 21:22:38.220864 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ServersAdminNegativeTestJSON-420496500-project Jul 23 21:22:38.220864 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:22:38.220864 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:22:38.220864 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: c7acc7eae5f946aaac9f0c8ead2c8d58 Jul 23 21:22:38.220864 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ServersAdminNegativeTestJSON-420496500-project Jul 23 21:22:38.220864 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:22:38.220864 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance 9aaaecf6-105b-4e72-82af-008d7590434f could not be found. Jul 23 21:22:38.220864 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': '9aaaecf6-105b-4e72-82af-008d7590434f'} Jul 23 21:22:38.220864 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:22:38.220864 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:22:38.220864 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:22:38.220864 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:22:38.220864 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:22:38.220864 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:22:38.220864 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:22:38.220864 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:22:38.220864 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:22:38.220864 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:22:38.220864 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9aaaecf6-105b-4e72-82af-008d7590434f could not be found. Jul 23 21:22:38.220864 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:22:38.220864 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:22:38.220864 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:22:38.220864 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:22:38.220864 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:22:38.220864 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:22:38.220864 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:22:38.220864 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:22:38.220864 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:22:38.220864 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:22:38.220864 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:22:38.220864 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:22:38.220864 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:22:38.220864 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:22:38.220864 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:22:38.220864 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:22:38.220864 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9aaaecf6-105b-4e72-82af-008d7590434f could not be found. Jul 23 21:22:38.220864 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:22:38.220864 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:22:38.220864 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:22:38.224543 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:22:38.224543 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:22:38.224543 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:22:38.224543 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:22:38.224543 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:22:38.224543 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9aaaecf6-105b-4e72-82af-008d7590434f could not be found. Jul 23 21:22:38.224543 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:22:38.224543 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-60a12c0a-cc0c-4067-a4e5-92d06c8590b5 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Returning 404 to user: Instance 9aaaecf6-105b-4e72-82af-008d7590434f could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:22:38.224543 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-60a12c0a-cc0c-4067-a4e5-92d06c8590b5 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] 10.222.0.17 "GET /compute/v2.1/servers/9aaaecf6-105b-4e72-82af-008d7590434f" status: 404 len: 111 microversion: 2.1 time: 0.062857 Jul 23 21:22:38.224543 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1104/2179] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:38 2022] GET /compute/v2.1/servers/9aaaecf6-105b-4e72-82af-008d7590434f => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:22:38.244232 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f39b99c6-113b-4a80-aeef-1e12dd1d6c8b tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:38.244793 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-f39b99c6-113b-4a80-aeef-1e12dd1d6c8b tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] [instance: a213ec70-d903-4ce2-a577-64b4dacf9c1e] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:38.253825 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f39b99c6-113b-4a80-aeef-1e12dd1d6c8b tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:38.254594 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f39b99c6-113b-4a80-aeef-1e12dd1d6c8b tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:38.255189 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f39b99c6-113b-4a80-aeef-1e12dd1d6c8b tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:38.255759 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f39b99c6-113b-4a80-aeef-1e12dd1d6c8b tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:38.275743 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-cac45a5b-e4e3-4d1d-a774-dfe7ed007f8d tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.060029 Jul 23 21:22:38.278462 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1076/2180] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:22:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1065 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 23 21:22:38.287547 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-f39b99c6-113b-4a80-aeef-1e12dd1d6c8b tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] [instance: a213ec70-d903-4ce2-a577-64b4dacf9c1e] Going to try to terminate instance {{(pid=131321) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:22:38.290976 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9efbc7ed-a4c6-4032-8a5a-ce1982a3ea84 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:38.294801 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-9efbc7ed-a4c6-4032-8a5a-ce1982a3ea84 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] [instance: 4824dd17-e11d-4def-ab59-9eb6279e46e8] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:38.408471 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-f39b99c6-113b-4a80-aeef-1e12dd1d6c8b tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] 10.222.0.17 "DELETE /compute/v2.1/servers/a213ec70-d903-4ce2-a577-64b4dacf9c1e" status: 204 len: 0 microversion: 2.1 time: 0.178161 Jul 23 21:22:38.412086 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1105/2181] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:22:38 2022] DELETE /compute/v2.1/servers/a213ec70-d903-4ce2-a577-64b4dacf9c1e => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:22:38.421736 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-9efbc7ed-a4c6-4032-8a5a-ce1982a3ea84 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ca7a39a8174a4b97767245e80b2bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55cfd65431cf4b878ab1c0e25a0ac629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:38.432174 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-7bb1202a-3a22-4ea6-b52c-33664d87abe0 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:38.433977 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-7bb1202a-3a22-4ea6-b52c-33664d87abe0 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] [instance: a213ec70-d903-4ce2-a577-64b4dacf9c1e] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:38.434965 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9efbc7ed-a4c6-4032-8a5a-ce1982a3ea84 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] 10.222.0.17 "GET /compute/v2.1/servers/4824dd17-e11d-4def-ab59-9eb6279e46e8" status: 200 len: 1216 microversion: 2.1 time: 0.148383 Jul 23 21:22:38.443565 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1077/2182] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:38 2022] GET /compute/v2.1/servers/4824dd17-e11d-4def-ab59-9eb6279e46e8 => generated 1216 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:22:38.446823 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7bb1202a-3a22-4ea6-b52c-33664d87abe0 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:38.447982 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7bb1202a-3a22-4ea6-b52c-33664d87abe0 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:38.448804 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7bb1202a-3a22-4ea6-b52c-33664d87abe0 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:38.449504 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7bb1202a-3a22-4ea6-b52c-33664d87abe0 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:38.678651 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-7bb1202a-3a22-4ea6-b52c-33664d87abe0 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7acc7eae5f946aaac9f0c8ead2c8d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e0f76ca9b734142a90c27f3d3de3a85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:38.688733 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-7bb1202a-3a22-4ea6-b52c-33664d87abe0 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] 10.222.0.17 "GET /compute/v2.1/servers/a213ec70-d903-4ce2-a577-64b4dacf9c1e" status: 200 len: 1477 microversion: 2.1 time: 0.269060 Jul 23 21:22:38.689930 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1106/2183] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:38 2022] GET /compute/v2.1/servers/a213ec70-d903-4ce2-a577-64b4dacf9c1e => generated 1477 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:38.815242 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-62abd60b-5be6-4ec8-b16f-00d97a67937c tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:38.815938 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-62abd60b-5be6-4ec8-b16f-00d97a67937c tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] [instance: cef13563-7f83-4281-a26c-d5e420c41daf] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:38.830666 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-62abd60b-5be6-4ec8-b16f-00d97a67937c tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:38.830940 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-62abd60b-5be6-4ec8-b16f-00d97a67937c tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:38.831843 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-62abd60b-5be6-4ec8-b16f-00d97a67937c tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:38.832288 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-62abd60b-5be6-4ec8-b16f-00d97a67937c tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:38.990088 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-62abd60b-5be6-4ec8-b16f-00d97a67937c tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf93a4b80cb4e19a36473986950fc75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c1943188684b45b636541caf587247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:39.000068 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-62abd60b-5be6-4ec8-b16f-00d97a67937c tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] 10.222.0.17 "GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf" status: 200 len: 1472 microversion: 2.1 time: 0.189995 Jul 23 21:22:39.001154 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1078/2184] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:38 2022] GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf => generated 1472 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:39.084678 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e11067ea-bbc3-4966-bf14-11ae34aa5db9 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:39.085212 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-e11067ea-bbc3-4966-bf14-11ae34aa5db9 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] [instance: c1701f99-a44c-48ca-8946-b84c5e163cee] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:39.094303 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e11067ea-bbc3-4966-bf14-11ae34aa5db9 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:39.095114 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e11067ea-bbc3-4966-bf14-11ae34aa5db9 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:39.095997 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e11067ea-bbc3-4966-bf14-11ae34aa5db9 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:39.096635 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e11067ea-bbc3-4966-bf14-11ae34aa5db9 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:39.293403 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-e11067ea-bbc3-4966-bf14-11ae34aa5db9 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80673ab800441b4bd1f5858e1df7b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629d02efac724fa29fcfff53e370b69b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:39.305163 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-e11067ea-bbc3-4966-bf14-11ae34aa5db9 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/servers/c1701f99-a44c-48ca-8946-b84c5e163cee" status: 200 len: 1473 microversion: 2.1 time: 0.221366 Jul 23 21:22:39.321411 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1107/2185] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:39 2022] GET /compute/v2.1/servers/c1701f99-a44c-48ca-8946-b84c5e163cee => generated 1473 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:39.453185 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6ad456ef-dea0-49b6-a0d9-87b45d0f5599 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:39.454658 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6ad456ef-dea0-49b6-a0d9-87b45d0f5599 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] [instance: 4824dd17-e11d-4def-ab59-9eb6279e46e8] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:39.474089 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6ad456ef-dea0-49b6-a0d9-87b45d0f5599 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:39.474970 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6ad456ef-dea0-49b6-a0d9-87b45d0f5599 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:39.476003 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6ad456ef-dea0-49b6-a0d9-87b45d0f5599 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:39.476664 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6ad456ef-dea0-49b6-a0d9-87b45d0f5599 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:39.559062 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6ad456ef-dea0-49b6-a0d9-87b45d0f5599 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ca7a39a8174a4b97767245e80b2bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55cfd65431cf4b878ab1c0e25a0ac629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:39.579773 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6ad456ef-dea0-49b6-a0d9-87b45d0f5599 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] 10.222.0.17 "GET /compute/v2.1/servers/4824dd17-e11d-4def-ab59-9eb6279e46e8" status: 200 len: 1220 microversion: 2.1 time: 0.129951 Jul 23 21:22:39.580585 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1079/2186] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:39 2022] GET /compute/v2.1/servers/4824dd17-e11d-4def-ab59-9eb6279e46e8 => generated 1220 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:39.707446 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c1023bd7-9e24-4343-9aaf-071bdf33eb6c tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:39.708795 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c1023bd7-9e24-4343-9aaf-071bdf33eb6c tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] [instance: a213ec70-d903-4ce2-a577-64b4dacf9c1e] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:39.719806 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c1023bd7-9e24-4343-9aaf-071bdf33eb6c tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:39.720844 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c1023bd7-9e24-4343-9aaf-071bdf33eb6c tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:39.722025 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c1023bd7-9e24-4343-9aaf-071bdf33eb6c tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:39.722587 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c1023bd7-9e24-4343-9aaf-071bdf33eb6c tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:39.779970 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-53cb1d37-2766-4858-a683-6e3b8730f675 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-1600466505", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:22:39.831248 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.network.neutron [None req-53cb1d37-2766-4858-a683-6e3b8730f675 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] validate_networks() for None {{(pid=131321) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:22:39.892017 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c1023bd7-9e24-4343-9aaf-071bdf33eb6c tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7acc7eae5f946aaac9f0c8ead2c8d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e0f76ca9b734142a90c27f3d3de3a85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:39.916101 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c1023bd7-9e24-4343-9aaf-071bdf33eb6c tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] 10.222.0.17 "GET /compute/v2.1/servers/a213ec70-d903-4ce2-a577-64b4dacf9c1e" status: 200 len: 1477 microversion: 2.1 time: 0.213439 Jul 23 21:22:39.917173 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1080/2187] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:39 2022] GET /compute/v2.1/servers/a213ec70-d903-4ce2-a577-64b4dacf9c1e => generated 1477 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:22:40.017576 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-68bd3299-d737-48b2-9d37-8a72e231091b tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:40.017794 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-68bd3299-d737-48b2-9d37-8a72e231091b tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] [instance: cef13563-7f83-4281-a26c-d5e420c41daf] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:40.029652 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-68bd3299-d737-48b2-9d37-8a72e231091b tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:40.030138 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-68bd3299-d737-48b2-9d37-8a72e231091b tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:40.030946 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-68bd3299-d737-48b2-9d37-8a72e231091b tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:40.031401 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-68bd3299-d737-48b2-9d37-8a72e231091b tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:40.185060 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-53cb1d37-2766-4858-a683-6e3b8730f675 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Flavor limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:22:40.185498 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-53cb1d37-2766-4858-a683-6e3b8730f675 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Image limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:22:40.186018 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-53cb1d37-2766-4858-a683-6e3b8730f675 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Flavor pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:22:40.186439 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-53cb1d37-2766-4858-a683-6e3b8730f675 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Image pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:22:40.186867 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-53cb1d37-2766-4858-a683-6e3b8730f675 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:22:40.199362 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-53cb1d37-2766-4858-a683-6e3b8730f675 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:40.200474 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-53cb1d37-2766-4858-a683-6e3b8730f675 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:40.201373 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-53cb1d37-2766-4858-a683-6e3b8730f675 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:40.201898 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-53cb1d37-2766-4858-a683-6e3b8730f675 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:40.220771 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-68bd3299-d737-48b2-9d37-8a72e231091b tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf93a4b80cb4e19a36473986950fc75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c1943188684b45b636541caf587247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:40.220989 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-53cb1d37-2766-4858-a683-6e3b8730f675 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Getting quotas for project 4ebf7cadb7af43beb0b85669f8e1f36c. Resources: {'ram', 'instances', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:22:40.226461 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-53cb1d37-2766-4858-a683-6e3b8730f675 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Getting quotas for user 73bde36fce49439bbe49caa877b1b630 and project 4ebf7cadb7af43beb0b85669f8e1f36c. Resources: {'ram', 'instances', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:22:40.242451 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-53cb1d37-2766-4858-a683-6e3b8730f675 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Going to run 1 instances... {{(pid=131321) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:22:40.245040 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-53cb1d37-2766-4858-a683-6e3b8730f675 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] [instance: 6929bb48-ae83-4078-8df7-60124c837ea3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131321) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:22:40.248634 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-68bd3299-d737-48b2-9d37-8a72e231091b tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] 10.222.0.17 "GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf" status: 200 len: 1472 microversion: 2.1 time: 0.235462 Jul 23 21:22:40.249449 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1081/2188] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:40 2022] GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf => generated 1472 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:22:40.317028 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-53cb1d37-2766-4858-a683-6e3b8730f675 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.697734 Jul 23 21:22:40.322818 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1108/2189] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:22:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 703 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 23 21:22:40.335157 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2fd02106-658d-461b-af84-e71e60eb4bd0 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:40.335793 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-2fd02106-658d-461b-af84-e71e60eb4bd0 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] [instance: c1701f99-a44c-48ca-8946-b84c5e163cee] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:40.349433 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2fd02106-658d-461b-af84-e71e60eb4bd0 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:40.349905 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2fd02106-658d-461b-af84-e71e60eb4bd0 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:40.350710 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2fd02106-658d-461b-af84-e71e60eb4bd0 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:40.351157 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2fd02106-658d-461b-af84-e71e60eb4bd0 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:40.356318 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-3d9e7170-4328-4e49-b57f-24a9e053e3ef tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:40.356957 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-3d9e7170-4328-4e49-b57f-24a9e053e3ef tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] [instance: 6929bb48-ae83-4078-8df7-60124c837ea3] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:40.568582 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-3d9e7170-4328-4e49-b57f-24a9e053e3ef tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bde36fce49439bbe49caa877b1b630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebf7cadb7af43beb0b85669f8e1f36c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:40.580082 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-3d9e7170-4328-4e49-b57f-24a9e053e3ef tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] 10.222.0.17 "GET /compute/v2.1/servers/6929bb48-ae83-4078-8df7-60124c837ea3" status: 200 len: 1217 microversion: 2.1 time: 0.239172 Jul 23 21:22:40.583456 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1109/2190] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:40 2022] GET /compute/v2.1/servers/6929bb48-ae83-4078-8df7-60124c837ea3 => generated 1217 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:40.605384 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-4bd87db1-ace9-48ba-8188-e8b96e0a2c9d tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:40.607884 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-4bd87db1-ace9-48ba-8188-e8b96e0a2c9d tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] [instance: 4824dd17-e11d-4def-ab59-9eb6279e46e8] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:40.628117 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4bd87db1-ace9-48ba-8188-e8b96e0a2c9d tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:40.631482 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4bd87db1-ace9-48ba-8188-e8b96e0a2c9d tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:40.632545 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4bd87db1-ace9-48ba-8188-e8b96e0a2c9d tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:40.633205 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4bd87db1-ace9-48ba-8188-e8b96e0a2c9d tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:40.708315 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-2fd02106-658d-461b-af84-e71e60eb4bd0 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80673ab800441b4bd1f5858e1df7b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629d02efac724fa29fcfff53e370b69b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:40.727314 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-4bd87db1-ace9-48ba-8188-e8b96e0a2c9d tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ca7a39a8174a4b97767245e80b2bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55cfd65431cf4b878ab1c0e25a0ac629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:40.731251 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2fd02106-658d-461b-af84-e71e60eb4bd0 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/servers/c1701f99-a44c-48ca-8946-b84c5e163cee" status: 200 len: 1473 microversion: 2.1 time: 0.396593 Jul 23 21:22:40.731917 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1082/2191] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:40 2022] GET /compute/v2.1/servers/c1701f99-a44c-48ca-8946-b84c5e163cee => generated 1473 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:40.744504 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-4bd87db1-ace9-48ba-8188-e8b96e0a2c9d tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] 10.222.0.17 "GET /compute/v2.1/servers/4824dd17-e11d-4def-ab59-9eb6279e46e8" status: 200 len: 1274 microversion: 2.1 time: 0.149783 Jul 23 21:22:40.745518 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1110/2192] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:40 2022] GET /compute/v2.1/servers/4824dd17-e11d-4def-ab59-9eb6279e46e8 => generated 1274 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:40.935841 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-15481800-1a53-48e3-be14-0bb2911f203b req-39c58485-3fc4-4417-abe7-386826759550 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a213ec70-d903-4ce2-a577-64b4dacf9c1e", "name": "network-vif-deleted", "tag": "254c2ec1-d06c-47b7-a65c-fb1c7e84b4a8"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:22:40.936715 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9f28f036-3733-4569-8a70-a8dbb87ea260 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:40.942953 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-9f28f036-3733-4569-8a70-a8dbb87ea260 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] [instance: a213ec70-d903-4ce2-a577-64b4dacf9c1e] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:40.958272 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9f28f036-3733-4569-8a70-a8dbb87ea260 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:40.959646 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-15481800-1a53-48e3-be14-0bb2911f203b req-39c58485-3fc4-4417-abe7-386826759550 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:40.960337 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-15481800-1a53-48e3-be14-0bb2911f203b req-39c58485-3fc4-4417-abe7-386826759550 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:40.962641 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9f28f036-3733-4569-8a70-a8dbb87ea260 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:40.963499 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9f28f036-3733-4569-8a70-a8dbb87ea260 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:40.963958 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9f28f036-3733-4569-8a70-a8dbb87ea260 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:40.979683 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-15481800-1a53-48e3-be14-0bb2911f203b req-39c58485-3fc4-4417-abe7-386826759550 service nova] Creating event network-vif-deleted:254c2ec1-d06c-47b7-a65c-fb1c7e84b4a8 for instance a213ec70-d903-4ce2-a577-64b4dacf9c1e on nch2-master-1 Jul 23 21:22:40.986405 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-15481800-1a53-48e3-be14-0bb2911f203b req-39c58485-3fc4-4417-abe7-386826759550 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053748 Jul 23 21:22:40.987687 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1111/2193] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:22:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:22:41.105169 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-9f28f036-3733-4569-8a70-a8dbb87ea260 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7acc7eae5f946aaac9f0c8ead2c8d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e0f76ca9b734142a90c27f3d3de3a85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:41.118667 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9f28f036-3733-4569-8a70-a8dbb87ea260 tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] 10.222.0.17 "GET /compute/v2.1/servers/a213ec70-d903-4ce2-a577-64b4dacf9c1e" status: 200 len: 1435 microversion: 2.1 time: 0.188783 Jul 23 21:22:41.123717 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1083/2194] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:40 2022] GET /compute/v2.1/servers/a213ec70-d903-4ce2-a577-64b4dacf9c1e => generated 1435 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:41.267560 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-6dfd8b94-c808-4e59-b7fc-560d70e4345f tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:41.268957 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-6dfd8b94-c808-4e59-b7fc-560d70e4345f tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] [instance: cef13563-7f83-4281-a26c-d5e420c41daf] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:41.276993 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6dfd8b94-c808-4e59-b7fc-560d70e4345f tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:41.278036 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6dfd8b94-c808-4e59-b7fc-560d70e4345f tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:41.279474 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6dfd8b94-c808-4e59-b7fc-560d70e4345f tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:41.279934 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6dfd8b94-c808-4e59-b7fc-560d70e4345f tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:41.518551 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-6dfd8b94-c808-4e59-b7fc-560d70e4345f tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf93a4b80cb4e19a36473986950fc75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c1943188684b45b636541caf587247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:41.529498 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-6dfd8b94-c808-4e59-b7fc-560d70e4345f tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] 10.222.0.17 "GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf" status: 200 len: 1478 microversion: 2.1 time: 0.267074 Jul 23 21:22:41.531111 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1112/2195] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:41 2022] GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf => generated 1478 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:41.603011 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-85571dae-933a-4059-8793-05f6b5a2f8dd tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:41.605952 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-85571dae-933a-4059-8793-05f6b5a2f8dd tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] [instance: 6929bb48-ae83-4078-8df7-60124c837ea3] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:41.622755 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-85571dae-933a-4059-8793-05f6b5a2f8dd tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:41.623551 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-85571dae-933a-4059-8793-05f6b5a2f8dd tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:41.624868 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-85571dae-933a-4059-8793-05f6b5a2f8dd tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:41.625477 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-85571dae-933a-4059-8793-05f6b5a2f8dd tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:41.711973 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-85571dae-933a-4059-8793-05f6b5a2f8dd tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bde36fce49439bbe49caa877b1b630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebf7cadb7af43beb0b85669f8e1f36c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:41.724508 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-85571dae-933a-4059-8793-05f6b5a2f8dd tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] 10.222.0.17 "GET /compute/v2.1/servers/6929bb48-ae83-4078-8df7-60124c837ea3" status: 200 len: 1213 microversion: 2.1 time: 0.128068 Jul 23 21:22:41.734461 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1084/2196] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:41 2022] GET /compute/v2.1/servers/6929bb48-ae83-4078-8df7-60124c837ea3 => generated 1213 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:41.749521 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-232599c4-c817-475a-b44c-050ea2570662 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:41.750523 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-232599c4-c817-475a-b44c-050ea2570662 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] [instance: c1701f99-a44c-48ca-8946-b84c5e163cee] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:41.761837 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-232599c4-c817-475a-b44c-050ea2570662 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:41.763848 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-232599c4-c817-475a-b44c-050ea2570662 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:41.764685 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-232599c4-c817-475a-b44c-050ea2570662 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:41.765138 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-232599c4-c817-475a-b44c-050ea2570662 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:41.768786 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9f2b8e39-4e6b-4284-a171-5c972800408c tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:41.769417 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-9f2b8e39-4e6b-4284-a171-5c972800408c tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] [instance: 4824dd17-e11d-4def-ab59-9eb6279e46e8] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:41.793765 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9f2b8e39-4e6b-4284-a171-5c972800408c tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:41.794251 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9f2b8e39-4e6b-4284-a171-5c972800408c tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:41.795039 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9f2b8e39-4e6b-4284-a171-5c972800408c tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:41.795484 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9f2b8e39-4e6b-4284-a171-5c972800408c tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:41.854864 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-232599c4-c817-475a-b44c-050ea2570662 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80673ab800441b4bd1f5858e1df7b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629d02efac724fa29fcfff53e370b69b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:41.863242 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-232599c4-c817-475a-b44c-050ea2570662 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/servers/c1701f99-a44c-48ca-8946-b84c5e163cee" status: 200 len: 1431 microversion: 2.1 time: 0.118787 Jul 23 21:22:41.871442 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1113/2197] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:41 2022] GET /compute/v2.1/servers/c1701f99-a44c-48ca-8946-b84c5e163cee => generated 1431 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:22:42.141056 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-8d772514-3d18-436c-a07b-06d6f1f35efc tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:42.142340 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-8d772514-3d18-436c-a07b-06d6f1f35efc tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] [instance: a213ec70-d903-4ce2-a577-64b4dacf9c1e] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:42.162658 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8d772514-3d18-436c-a07b-06d6f1f35efc tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:42.163478 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8d772514-3d18-436c-a07b-06d6f1f35efc tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:42.164488 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8d772514-3d18-436c-a07b-06d6f1f35efc tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:42.165171 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8d772514-3d18-436c-a07b-06d6f1f35efc tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:42.189026 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-9f2b8e39-4e6b-4284-a171-5c972800408c tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ca7a39a8174a4b97767245e80b2bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55cfd65431cf4b878ab1c0e25a0ac629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:42.202257 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9f2b8e39-4e6b-4284-a171-5c972800408c tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] 10.222.0.17 "GET /compute/v2.1/servers/4824dd17-e11d-4def-ab59-9eb6279e46e8" status: 200 len: 1274 microversion: 2.1 time: 0.437620 Jul 23 21:22:42.203461 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-8d772514-3d18-436c-a07b-06d6f1f35efc tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] HTTP exception thrown: Instance a213ec70-d903-4ce2-a577-64b4dacf9c1e could not be found. Jul 23 21:22:42.205738 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-8d772514-3d18-436c-a07b-06d6f1f35efc tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Request method failure captured: Jul 23 21:22:42.205738 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/servers/a213ec70-d903-4ce2-a577-64b4dacf9c1e HTTP/1.1 Jul 23 21:22:42.205738 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:22:42.205738 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:22:42.205738 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:22:42.205738 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:22:42.205738 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:22:42.205738 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:22:42.205738 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:22:42.205738 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:22:42.205738 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GZfRj-WFRZoxZcUf8Yx0hkg8bIZqzDhmmXQFJXqflfqyQv9ha6pKRA_dMTT9WsR3MGaBO0FtYffXVGltDrI7eZ02R_QGUO-xXtsvNjWsNGjkQOF4HNwoWgyrTsmXm3fBSIHZI-LuX7WY6o74l3YgvAbe35eCjnNMV3DD6j5SlCTX9o Jul 23 21:22:42.205738 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:22:42.205738 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:22:42.205738 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:22:42.205738 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:22:42.205738 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:22:42.205738 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:22:42.205738 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 7e0f76ca9b734142a90c27f3d3de3a85 Jul 23 21:22:42.205738 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-420496500 Jul 23 21:22:42.205738 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:22:42.205738 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:22:42.205738 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7e0f76ca9b734142a90c27f3d3de3a85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7e0f76ca9b734142a90c27f3d3de3a85"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_7e0f76ca9b734142a90c27f3d3de3a85", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/7e0f76ca9b734142a90c27f3d3de3a85"}]}] Jul 23 21:22:42.205738 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ServersAdminNegativeTestJSON-420496500 Jul 23 21:22:42.205738 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 7e0f76ca9b734142a90c27f3d3de3a85 Jul 23 21:22:42.205738 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-420496500 Jul 23 21:22:42.205738 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ServersAdminNegativeTestJSON-420496500-project Jul 23 21:22:42.205738 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:22:42.205738 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:22:42.205738 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: c7acc7eae5f946aaac9f0c8ead2c8d58 Jul 23 21:22:42.205738 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ServersAdminNegativeTestJSON-420496500-project Jul 23 21:22:42.205738 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:22:42.205738 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance a213ec70-d903-4ce2-a577-64b4dacf9c1e could not be found. Jul 23 21:22:42.205738 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': 'a213ec70-d903-4ce2-a577-64b4dacf9c1e'} Jul 23 21:22:42.205738 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:22:42.205738 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:22:42.205738 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:22:42.205738 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:22:42.205738 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:22:42.205738 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:22:42.205738 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:22:42.205738 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:22:42.205738 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:22:42.205738 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:22:42.205738 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a213ec70-d903-4ce2-a577-64b4dacf9c1e could not be found. Jul 23 21:22:42.205738 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:22:42.205738 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:22:42.205738 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:22:42.205738 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:22:42.205738 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:22:42.205738 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:22:42.205738 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:22:42.205738 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:22:42.205738 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:22:42.205738 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:22:42.205738 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:22:42.205738 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:22:42.205738 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:22:42.205738 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:22:42.205738 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:22:42.205738 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:22:42.205738 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a213ec70-d903-4ce2-a577-64b4dacf9c1e could not be found. Jul 23 21:22:42.205738 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:22:42.205738 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:22:42.205738 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:22:42.209435 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:22:42.209435 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:22:42.209435 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:22:42.209435 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:22:42.209435 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:22:42.209435 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a213ec70-d903-4ce2-a577-64b4dacf9c1e could not be found. Jul 23 21:22:42.209435 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:22:42.211320 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-8d772514-3d18-436c-a07b-06d6f1f35efc tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] Returning 404 to user: Instance a213ec70-d903-4ce2-a577-64b4dacf9c1e could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:22:42.212422 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-8d772514-3d18-436c-a07b-06d6f1f35efc tempest-ServersAdminNegativeTestJSON-420496500 tempest-ServersAdminNegativeTestJSON-420496500-project] 10.222.0.17 "GET /compute/v2.1/servers/a213ec70-d903-4ce2-a577-64b4dacf9c1e" status: 404 len: 111 microversion: 2.1 time: 0.076761 Jul 23 21:22:42.221771 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1114/2198] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:42 2022] GET /compute/v2.1/servers/a213ec70-d903-4ce2-a577-64b4dacf9c1e => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:22:42.226958 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1085/2199] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:41 2022] GET /compute/v2.1/servers/4824dd17-e11d-4def-ab59-9eb6279e46e8 => generated 1274 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:42.242253 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-82f756f2-5c2f-46f8-b0fb-59d87d6d65f0 req-45e94958-f4d1-4665-bc66-11b7cff75cfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1701f99-a44c-48ca-8946-b84c5e163cee", "name": "network-vif-deleted", "tag": "ca008065-59c8-45bf-a4e5-409a38a7c991"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:22:42.267140 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-82f756f2-5c2f-46f8-b0fb-59d87d6d65f0 req-45e94958-f4d1-4665-bc66-11b7cff75cfe service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:42.268229 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-82f756f2-5c2f-46f8-b0fb-59d87d6d65f0 req-45e94958-f4d1-4665-bc66-11b7cff75cfe service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:42.293451 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-82f756f2-5c2f-46f8-b0fb-59d87d6d65f0 req-45e94958-f4d1-4665-bc66-11b7cff75cfe service nova] Creating event network-vif-deleted:ca008065-59c8-45bf-a4e5-409a38a7c991 for instance c1701f99-a44c-48ca-8946-b84c5e163cee on nch1-master-1 Jul 23 21:22:42.303040 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-82f756f2-5c2f-46f8-b0fb-59d87d6d65f0 req-45e94958-f4d1-4665-bc66-11b7cff75cfe service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070935 Jul 23 21:22:42.304056 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1115/2200] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:22:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:22:42.553471 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-fd95efe4-4978-499d-974d-116ed2bd6540 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:42.554143 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-fd95efe4-4978-499d-974d-116ed2bd6540 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] [instance: cef13563-7f83-4281-a26c-d5e420c41daf] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:42.565978 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fd95efe4-4978-499d-974d-116ed2bd6540 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:42.572621 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fd95efe4-4978-499d-974d-116ed2bd6540 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:42.573482 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fd95efe4-4978-499d-974d-116ed2bd6540 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:42.577145 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fd95efe4-4978-499d-974d-116ed2bd6540 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:42.743276 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-2f7a843e-651e-40d8-be66-00c326529b85 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:42.743989 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-2f7a843e-651e-40d8-be66-00c326529b85 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] [instance: 6929bb48-ae83-4078-8df7-60124c837ea3] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:42.768330 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2f7a843e-651e-40d8-be66-00c326529b85 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:42.769027 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2f7a843e-651e-40d8-be66-00c326529b85 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:42.770014 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2f7a843e-651e-40d8-be66-00c326529b85 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:42.770651 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2f7a843e-651e-40d8-be66-00c326529b85 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:42.892137 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-2f7a843e-651e-40d8-be66-00c326529b85 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bde36fce49439bbe49caa877b1b630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebf7cadb7af43beb0b85669f8e1f36c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:42.906234 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-2f7a843e-651e-40d8-be66-00c326529b85 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] 10.222.0.17 "GET /compute/v2.1/servers/6929bb48-ae83-4078-8df7-60124c837ea3" status: 200 len: 1275 microversion: 2.1 time: 0.167616 Jul 23 21:22:42.915950 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1116/2201] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:42 2022] GET /compute/v2.1/servers/6929bb48-ae83-4078-8df7-60124c837ea3 => generated 1275 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:42.916271 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-fd95efe4-4978-499d-974d-116ed2bd6540 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf93a4b80cb4e19a36473986950fc75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c1943188684b45b636541caf587247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:42.916718 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-40e44547-e584-4054-81af-70875b109df3 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:42.916718 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-40e44547-e584-4054-81af-70875b109df3 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] [instance: c1701f99-a44c-48ca-8946-b84c5e163cee] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:42.924723 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-40e44547-e584-4054-81af-70875b109df3 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:42.925301 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-40e44547-e584-4054-81af-70875b109df3 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:42.926241 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-40e44547-e584-4054-81af-70875b109df3 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:42.926828 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-40e44547-e584-4054-81af-70875b109df3 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:42.927488 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-fd95efe4-4978-499d-974d-116ed2bd6540 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] 10.222.0.17 "GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf" status: 200 len: 1478 microversion: 2.1 time: 0.378872 Jul 23 21:22:42.939059 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1086/2202] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:42 2022] GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf => generated 1478 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:42.989845 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-40e44547-e584-4054-81af-70875b109df3 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:42.990435 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-40e44547-e584-4054-81af-70875b109df3 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:42.991078 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.objects.instance [None req-40e44547-e584-4054-81af-70875b109df3 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lazy-loading 'fault' on Instance uuid c1701f99-a44c-48ca-8946-b84c5e163cee {{(pid=131321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:22:43.060079 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-40e44547-e584-4054-81af-70875b109df3 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80673ab800441b4bd1f5858e1df7b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629d02efac724fa29fcfff53e370b69b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:43.068761 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-40e44547-e584-4054-81af-70875b109df3 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/servers/c1701f99-a44c-48ca-8946-b84c5e163cee" status: 200 len: 1308 microversion: 2.1 time: 0.158531 Jul 23 21:22:43.070010 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1117/2203] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:42 2022] GET /compute/v2.1/servers/c1701f99-a44c-48ca-8946-b84c5e163cee => generated 1308 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:43.221926 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-31b608be-b35d-4ae5-b5b3-def7c3c3e6bd tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:43.222795 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-31b608be-b35d-4ae5-b5b3-def7c3c3e6bd tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] [instance: 4824dd17-e11d-4def-ab59-9eb6279e46e8] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:43.234488 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-31b608be-b35d-4ae5-b5b3-def7c3c3e6bd tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:43.234930 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-31b608be-b35d-4ae5-b5b3-def7c3c3e6bd tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:43.239265 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-31b608be-b35d-4ae5-b5b3-def7c3c3e6bd tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:43.239753 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-31b608be-b35d-4ae5-b5b3-def7c3c3e6bd tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:43.474027 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-31b608be-b35d-4ae5-b5b3-def7c3c3e6bd tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ca7a39a8174a4b97767245e80b2bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55cfd65431cf4b878ab1c0e25a0ac629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:43.500449 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-31b608be-b35d-4ae5-b5b3-def7c3c3e6bd tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] 10.222.0.17 "GET /compute/v2.1/servers/4824dd17-e11d-4def-ab59-9eb6279e46e8" status: 200 len: 1316 microversion: 2.1 time: 0.277096 Jul 23 21:22:43.501494 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1087/2204] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:43 2022] GET /compute/v2.1/servers/4824dd17-e11d-4def-ab59-9eb6279e46e8 => generated 1316 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:43.928271 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a7eb00df-7f66-48de-ad20-5b7f0c823935 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:43.929197 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-a7eb00df-7f66-48de-ad20-5b7f0c823935 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] [instance: 6929bb48-ae83-4078-8df7-60124c837ea3] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:43.947240 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-bd5c49e2-d514-40f7-83b9-2458b12f198a tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:43.947861 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-bd5c49e2-d514-40f7-83b9-2458b12f198a tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] [instance: cef13563-7f83-4281-a26c-d5e420c41daf] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:43.952246 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a7eb00df-7f66-48de-ad20-5b7f0c823935 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:43.952696 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a7eb00df-7f66-48de-ad20-5b7f0c823935 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:43.953490 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a7eb00df-7f66-48de-ad20-5b7f0c823935 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:43.953949 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a7eb00df-7f66-48de-ad20-5b7f0c823935 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:43.961471 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bd5c49e2-d514-40f7-83b9-2458b12f198a tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:43.961945 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bd5c49e2-d514-40f7-83b9-2458b12f198a tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:43.962738 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bd5c49e2-d514-40f7-83b9-2458b12f198a tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:43.963173 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bd5c49e2-d514-40f7-83b9-2458b12f198a tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:44.187938 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-bd5c49e2-d514-40f7-83b9-2458b12f198a tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf93a4b80cb4e19a36473986950fc75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c1943188684b45b636541caf587247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:44.196669 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-bd5c49e2-d514-40f7-83b9-2458b12f198a tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] 10.222.0.17 "GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf" status: 200 len: 1478 microversion: 2.1 time: 0.253567 Jul 23 21:22:44.197599 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1088/2205] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:43 2022] GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf => generated 1478 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:44.202469 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-7d397ca2-7e05-48a8-874b-28e7676bb242 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:44.203238 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-7d397ca2-7e05-48a8-874b-28e7676bb242 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] [instance: c1701f99-a44c-48ca-8946-b84c5e163cee] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:44.218422 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7d397ca2-7e05-48a8-874b-28e7676bb242 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:44.219110 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7d397ca2-7e05-48a8-874b-28e7676bb242 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:44.220038 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7d397ca2-7e05-48a8-874b-28e7676bb242 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:44.220619 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7d397ca2-7e05-48a8-874b-28e7676bb242 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:44.240206 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-7d397ca2-7e05-48a8-874b-28e7676bb242 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] HTTP exception thrown: Instance c1701f99-a44c-48ca-8946-b84c5e163cee could not be found. Jul 23 21:22:44.242257 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-7d397ca2-7e05-48a8-874b-28e7676bb242 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Request method failure captured: Jul 23 21:22:44.242257 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/c1701f99-a44c-48ca-8946-b84c5e163cee HTTP/1.1 Jul 23 21:22:44.242257 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:22:44.242257 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:22:44.242257 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:22:44.242257 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:22:44.242257 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:22:44.242257 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:22:44.242257 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:22:44.242257 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:22:44.242257 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GYPBc-2n_lFJtRohuZSpAyDT3eZjBmd4RdqX2JYsTdTGJiAqb2uQL3seTae7vi9R7WcyVWSUwgmdD0_jLPebbVqy6P1Wz36z_C_lcIL9rKLBl05EozRB0eNpgfYMEAoS-VFfrz6kI2m3HaY6MoLHdvN_YwAQjIh1kWbg_z_KEGlDuA Jul 23 21:22:44.242257 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:22:44.242257 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:22:44.242257 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:22:44.242257 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:22:44.242257 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:22:44.242257 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:22:44.242257 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 629d02efac724fa29fcfff53e370b69b Jul 23 21:22:44.242257 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ListImageFiltersTestJSON-1562631288 Jul 23 21:22:44.242257 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:22:44.242257 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:22:44.242257 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/629d02efac724fa29fcfff53e370b69b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/629d02efac724fa29fcfff53e370b69b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_629d02efac724fa29fcfff53e370b69b", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/629d02efac724fa29fcfff53e370b69b"}]}] Jul 23 21:22:44.242257 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ListImageFiltersTestJSON-1562631288 Jul 23 21:22:44.242257 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 629d02efac724fa29fcfff53e370b69b Jul 23 21:22:44.242257 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1562631288 Jul 23 21:22:44.242257 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ListImageFiltersTestJSON-1562631288-project Jul 23 21:22:44.242257 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:22:44.242257 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:22:44.242257 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: f80673ab800441b4bd1f5858e1df7b3c Jul 23 21:22:44.242257 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ListImageFiltersTestJSON-1562631288-project Jul 23 21:22:44.242257 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:22:44.242257 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance c1701f99-a44c-48ca-8946-b84c5e163cee could not be found. Jul 23 21:22:44.242257 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': 'c1701f99-a44c-48ca-8946-b84c5e163cee'} Jul 23 21:22:44.242257 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:22:44.242257 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:22:44.242257 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:22:44.242257 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:22:44.242257 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:22:44.242257 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:22:44.242257 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:22:44.242257 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:22:44.242257 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:22:44.242257 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:22:44.242257 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1701f99-a44c-48ca-8946-b84c5e163cee could not be found. Jul 23 21:22:44.242257 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:22:44.242257 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:22:44.242257 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:22:44.242257 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:22:44.242257 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:22:44.242257 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:22:44.242257 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:22:44.242257 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:22:44.242257 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:22:44.242257 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:22:44.242257 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:22:44.242257 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:22:44.242257 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:22:44.242257 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:22:44.242257 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:22:44.242257 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:22:44.242257 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1701f99-a44c-48ca-8946-b84c5e163cee could not be found. Jul 23 21:22:44.242257 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:22:44.242257 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:22:44.242257 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:22:44.245706 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:22:44.245706 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:22:44.245706 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:22:44.245706 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:22:44.245706 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:22:44.245706 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1701f99-a44c-48ca-8946-b84c5e163cee could not be found. Jul 23 21:22:44.245706 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:22:44.247517 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-7d397ca2-7e05-48a8-874b-28e7676bb242 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Returning 404 to user: Instance c1701f99-a44c-48ca-8946-b84c5e163cee could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:22:44.248088 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-7d397ca2-7e05-48a8-874b-28e7676bb242 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/servers/c1701f99-a44c-48ca-8946-b84c5e163cee" status: 404 len: 111 microversion: 2.1 time: 0.049312 Jul 23 21:22:44.248860 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1089/2206] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:44 2022] GET /compute/v2.1/servers/c1701f99-a44c-48ca-8946-b84c5e163cee => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:22:44.258338 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-47297186-616c-4e8a-bd55-80d3999df862 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:44.258842 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-47297186-616c-4e8a-bd55-80d3999df862 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] [instance: 9933c901-3692-4f36-9f11-e1a93d902e94] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:44.265377 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-47297186-616c-4e8a-bd55-80d3999df862 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:44.265834 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-47297186-616c-4e8a-bd55-80d3999df862 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:44.266644 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-47297186-616c-4e8a-bd55-80d3999df862 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:44.267331 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-47297186-616c-4e8a-bd55-80d3999df862 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:44.293562 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-47297186-616c-4e8a-bd55-80d3999df862 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] [instance: 9933c901-3692-4f36-9f11-e1a93d902e94] Going to try to terminate instance {{(pid=131320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:22:44.319738 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-a7eb00df-7f66-48de-ad20-5b7f0c823935 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bde36fce49439bbe49caa877b1b630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebf7cadb7af43beb0b85669f8e1f36c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:44.326231 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:22:44.333734 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-a7eb00df-7f66-48de-ad20-5b7f0c823935 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] 10.222.0.17 "GET /compute/v2.1/servers/6929bb48-ae83-4078-8df7-60124c837ea3" status: 200 len: 1317 microversion: 2.1 time: 0.408435 Jul 23 21:22:44.335185 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1118/2207] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:43 2022] GET /compute/v2.1/servers/6929bb48-ae83-4078-8df7-60124c837ea3 => generated 1317 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:44.341592 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-1860c2a3-f02f-4b16-8d83-2ecb5657cec5 req-e7ca6381-26b9-42fc-ae20-b8b56c0ed0e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4824dd17-e11d-4def-ab59-9eb6279e46e8", "tag": "bb88db37-af82-4c73-af5d-d2e71214c2df"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:22:44.353726 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:22:44.356959 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-1860c2a3-f02f-4b16-8d83-2ecb5657cec5 req-e7ca6381-26b9-42fc-ae20-b8b56c0ed0e8 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:44.357625 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-1860c2a3-f02f-4b16-8d83-2ecb5657cec5 req-e7ca6381-26b9-42fc-ae20-b8b56c0ed0e8 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:44.373483 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-1860c2a3-f02f-4b16-8d83-2ecb5657cec5 req-e7ca6381-26b9-42fc-ae20-b8b56c0ed0e8 service nova] Creating event network-changed:bb88db37-af82-4c73-af5d-d2e71214c2df for instance 4824dd17-e11d-4def-ab59-9eb6279e46e8 on nch2-master-1 Jul 23 21:22:44.380544 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-1860c2a3-f02f-4b16-8d83-2ecb5657cec5 req-e7ca6381-26b9-42fc-ae20-b8b56c0ed0e8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043869 Jul 23 21:22:44.382248 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1119/2208] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:22:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:22:44.411365 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-47297186-616c-4e8a-bd55-80d3999df862 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "DELETE /compute/v2.1/servers/9933c901-3692-4f36-9f11-e1a93d902e94" status: 204 len: 0 microversion: 2.1 time: 0.156503 Jul 23 21:22:44.412053 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1090/2209] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:22:44 2022] DELETE /compute/v2.1/servers/9933c901-3692-4f36-9f11-e1a93d902e94 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:22:44.420677 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-dcc78818-e8b2-4628-9a14-49691866427d tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:44.421727 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-dcc78818-e8b2-4628-9a14-49691866427d tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] [instance: 9933c901-3692-4f36-9f11-e1a93d902e94] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:44.428256 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-dcc78818-e8b2-4628-9a14-49691866427d tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:44.428705 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-dcc78818-e8b2-4628-9a14-49691866427d tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:44.429480 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-dcc78818-e8b2-4628-9a14-49691866427d tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:44.429949 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-dcc78818-e8b2-4628-9a14-49691866427d tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:44.523521 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4d0afdfa-3e1d-4f2c-b83f-e367bf154460 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:44.524705 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-4d0afdfa-3e1d-4f2c-b83f-e367bf154460 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] [instance: 4824dd17-e11d-4def-ab59-9eb6279e46e8] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:44.532118 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4d0afdfa-3e1d-4f2c-b83f-e367bf154460 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:44.532981 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4d0afdfa-3e1d-4f2c-b83f-e367bf154460 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:44.535162 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4d0afdfa-3e1d-4f2c-b83f-e367bf154460 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:44.535894 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4d0afdfa-3e1d-4f2c-b83f-e367bf154460 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:44.698195 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-dcc78818-e8b2-4628-9a14-49691866427d tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80673ab800441b4bd1f5858e1df7b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629d02efac724fa29fcfff53e370b69b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:44.711416 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-dcc78818-e8b2-4628-9a14-49691866427d tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/servers/9933c901-3692-4f36-9f11-e1a93d902e94" status: 200 len: 1472 microversion: 2.1 time: 0.292773 Jul 23 21:22:44.726153 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1120/2210] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:44 2022] GET /compute/v2.1/servers/9933c901-3692-4f36-9f11-e1a93d902e94 => generated 1472 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:44.744540 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-4d0afdfa-3e1d-4f2c-b83f-e367bf154460 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ca7a39a8174a4b97767245e80b2bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55cfd65431cf4b878ab1c0e25a0ac629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:44.754542 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4d0afdfa-3e1d-4f2c-b83f-e367bf154460 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] 10.222.0.17 "GET /compute/v2.1/servers/4824dd17-e11d-4def-ab59-9eb6279e46e8" status: 200 len: 1316 microversion: 2.1 time: 0.239891 Jul 23 21:22:44.755143 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1091/2211] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:44 2022] GET /compute/v2.1/servers/4824dd17-e11d-4def-ab59-9eb6279e46e8 => generated 1316 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:22:44.919147 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-948fe11a-5b24-47ac-9619-a27427209ade req-94def83e-9295-49ec-ac0a-86786cd4b77f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6929bb48-ae83-4078-8df7-60124c837ea3", "tag": "1e3e8f57-3c77-4c90-ad4e-1a9f4efa146d"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:22:44.941757 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-948fe11a-5b24-47ac-9619-a27427209ade req-94def83e-9295-49ec-ac0a-86786cd4b77f service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:44.942518 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-948fe11a-5b24-47ac-9619-a27427209ade req-94def83e-9295-49ec-ac0a-86786cd4b77f service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:44.973739 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-948fe11a-5b24-47ac-9619-a27427209ade req-94def83e-9295-49ec-ac0a-86786cd4b77f service nova] Creating event network-changed:1e3e8f57-3c77-4c90-ad4e-1a9f4efa146d for instance 6929bb48-ae83-4078-8df7-60124c837ea3 on nch2-master-1 Jul 23 21:22:44.979574 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-948fe11a-5b24-47ac-9619-a27427209ade req-94def83e-9295-49ec-ac0a-86786cd4b77f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065017 Jul 23 21:22:44.982319 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1121/2212] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:22:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:22:45.215490 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3d61dae6-fd16-4c8e-bf90-2166ff2e1a3f tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:45.216118 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-3d61dae6-fd16-4c8e-bf90-2166ff2e1a3f tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] [instance: cef13563-7f83-4281-a26c-d5e420c41daf] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:45.223276 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3d61dae6-fd16-4c8e-bf90-2166ff2e1a3f tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:45.223732 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3d61dae6-fd16-4c8e-bf90-2166ff2e1a3f tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:45.224533 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3d61dae6-fd16-4c8e-bf90-2166ff2e1a3f tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:45.224975 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3d61dae6-fd16-4c8e-bf90-2166ff2e1a3f tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:45.317115 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-43b091dd-9490-4032-b47e-9ba9b7e00574 req-59b2a149-cf8a-40eb-9335-ac94e862722b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cef13563-7f83-4281-a26c-d5e420c41daf", "name": "network-vif-plugged", "status": "completed", "tag": "e6c3948e-9005-4405-9ade-a304ad56f44a"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:22:45.339180 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-43b091dd-9490-4032-b47e-9ba9b7e00574 req-59b2a149-cf8a-40eb-9335-ac94e862722b service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:45.339942 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-43b091dd-9490-4032-b47e-9ba9b7e00574 req-59b2a149-cf8a-40eb-9335-ac94e862722b service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:45.366825 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-43b091dd-9490-4032-b47e-9ba9b7e00574 req-59b2a149-cf8a-40eb-9335-ac94e862722b service nova] Creating event network-vif-plugged:e6c3948e-9005-4405-9ade-a304ad56f44a for instance cef13563-7f83-4281-a26c-d5e420c41daf on nch1-master-1 Jul 23 21:22:45.383160 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-43b091dd-9490-4032-b47e-9ba9b7e00574 req-59b2a149-cf8a-40eb-9335-ac94e862722b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071445 Jul 23 21:22:45.387786 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1122/2213] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:22:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:22:45.394072 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-4373e6b0-ae5a-4c84-aff7-1b36c8497f1f tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:45.397661 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-4373e6b0-ae5a-4c84-aff7-1b36c8497f1f tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] [instance: 6929bb48-ae83-4078-8df7-60124c837ea3] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:45.415996 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4373e6b0-ae5a-4c84-aff7-1b36c8497f1f tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:45.416702 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4373e6b0-ae5a-4c84-aff7-1b36c8497f1f tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:45.417686 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4373e6b0-ae5a-4c84-aff7-1b36c8497f1f tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:45.418431 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4373e6b0-ae5a-4c84-aff7-1b36c8497f1f tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:45.485063 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-3d61dae6-fd16-4c8e-bf90-2166ff2e1a3f tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf93a4b80cb4e19a36473986950fc75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c1943188684b45b636541caf587247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:45.504062 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-3d61dae6-fd16-4c8e-bf90-2166ff2e1a3f tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] 10.222.0.17 "GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf" status: 200 len: 1478 microversion: 2.1 time: 0.293098 Jul 23 21:22:45.507785 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1092/2214] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:45 2022] GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf => generated 1478 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:45.677389 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-4373e6b0-ae5a-4c84-aff7-1b36c8497f1f tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bde36fce49439bbe49caa877b1b630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebf7cadb7af43beb0b85669f8e1f36c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:45.686299 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-4373e6b0-ae5a-4c84-aff7-1b36c8497f1f tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] 10.222.0.17 "GET /compute/v2.1/servers/6929bb48-ae83-4078-8df7-60124c837ea3" status: 200 len: 1317 microversion: 2.1 time: 0.296914 Jul 23 21:22:45.687098 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1123/2215] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:45 2022] GET /compute/v2.1/servers/6929bb48-ae83-4078-8df7-60124c837ea3 => generated 1317 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:45.729299 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-cda474f3-9d62-4404-90ee-a43e08179ee2 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:45.729979 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-cda474f3-9d62-4404-90ee-a43e08179ee2 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] [instance: 9933c901-3692-4f36-9f11-e1a93d902e94] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:45.736768 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cda474f3-9d62-4404-90ee-a43e08179ee2 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:45.737297 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cda474f3-9d62-4404-90ee-a43e08179ee2 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:45.740305 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cda474f3-9d62-4404-90ee-a43e08179ee2 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:45.740754 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cda474f3-9d62-4404-90ee-a43e08179ee2 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:45.771544 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-2809d68c-9acf-4d07-a3c4-189257fbac9e tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:45.772145 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-2809d68c-9acf-4d07-a3c4-189257fbac9e tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] [instance: 4824dd17-e11d-4def-ab59-9eb6279e46e8] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:45.782268 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2809d68c-9acf-4d07-a3c4-189257fbac9e tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:45.784699 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2809d68c-9acf-4d07-a3c4-189257fbac9e tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:45.785545 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2809d68c-9acf-4d07-a3c4-189257fbac9e tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:45.786245 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2809d68c-9acf-4d07-a3c4-189257fbac9e tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:45.920430 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-cda474f3-9d62-4404-90ee-a43e08179ee2 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80673ab800441b4bd1f5858e1df7b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629d02efac724fa29fcfff53e370b69b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:45.928756 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-cda474f3-9d62-4404-90ee-a43e08179ee2 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/servers/9933c901-3692-4f36-9f11-e1a93d902e94" status: 200 len: 1472 microversion: 2.1 time: 0.203559 Jul 23 21:22:45.929633 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1093/2216] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:45 2022] GET /compute/v2.1/servers/9933c901-3692-4f36-9f11-e1a93d902e94 => generated 1472 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:46.046684 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-2809d68c-9acf-4d07-a3c4-189257fbac9e tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ca7a39a8174a4b97767245e80b2bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55cfd65431cf4b878ab1c0e25a0ac629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:46.055767 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-2809d68c-9acf-4d07-a3c4-189257fbac9e tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] 10.222.0.17 "GET /compute/v2.1/servers/4824dd17-e11d-4def-ab59-9eb6279e46e8" status: 200 len: 1316 microversion: 2.1 time: 0.288291 Jul 23 21:22:46.056401 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1124/2217] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:45 2022] GET /compute/v2.1/servers/4824dd17-e11d-4def-ab59-9eb6279e46e8 => generated 1316 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:22:46.526349 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1d38a8da-b5e1-4863-b607-cafbee464e65 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:46.527304 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1d38a8da-b5e1-4863-b607-cafbee464e65 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] [instance: cef13563-7f83-4281-a26c-d5e420c41daf] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:46.536607 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1d38a8da-b5e1-4863-b607-cafbee464e65 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:46.537608 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1d38a8da-b5e1-4863-b607-cafbee464e65 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:46.538574 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1d38a8da-b5e1-4863-b607-cafbee464e65 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:46.539234 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1d38a8da-b5e1-4863-b607-cafbee464e65 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:46.704320 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-9389a6a3-6bba-4e0e-a753-631b404c6eed tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:46.704946 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-9389a6a3-6bba-4e0e-a753-631b404c6eed tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] [instance: 6929bb48-ae83-4078-8df7-60124c837ea3] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:46.715634 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9389a6a3-6bba-4e0e-a753-631b404c6eed tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:46.716163 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9389a6a3-6bba-4e0e-a753-631b404c6eed tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:46.716950 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9389a6a3-6bba-4e0e-a753-631b404c6eed tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:46.717449 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9389a6a3-6bba-4e0e-a753-631b404c6eed tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:46.874241 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-1d38a8da-b5e1-4863-b607-cafbee464e65 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf93a4b80cb4e19a36473986950fc75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c1943188684b45b636541caf587247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:46.882409 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1d38a8da-b5e1-4863-b607-cafbee464e65 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] 10.222.0.17 "GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf" status: 200 len: 1478 microversion: 2.1 time: 0.362339 Jul 23 21:22:46.883018 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1094/2218] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:46 2022] GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf => generated 1478 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:46.951995 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-166ea6bd-72e7-4b64-b6ee-0740d6a246f5 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:46.952929 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-166ea6bd-72e7-4b64-b6ee-0740d6a246f5 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] [instance: 9933c901-3692-4f36-9f11-e1a93d902e94] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:46.960705 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-166ea6bd-72e7-4b64-b6ee-0740d6a246f5 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:46.962391 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-166ea6bd-72e7-4b64-b6ee-0740d6a246f5 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:46.963625 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-166ea6bd-72e7-4b64-b6ee-0740d6a246f5 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:46.964505 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-166ea6bd-72e7-4b64-b6ee-0740d6a246f5 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:47.115217 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-9389a6a3-6bba-4e0e-a753-631b404c6eed tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bde36fce49439bbe49caa877b1b630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebf7cadb7af43beb0b85669f8e1f36c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:47.125812 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-9389a6a3-6bba-4e0e-a753-631b404c6eed tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] 10.222.0.17 "GET /compute/v2.1/servers/6929bb48-ae83-4078-8df7-60124c837ea3" status: 200 len: 1317 microversion: 2.1 time: 0.425320 Jul 23 21:22:47.127308 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1125/2219] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:46 2022] GET /compute/v2.1/servers/6929bb48-ae83-4078-8df7-60124c837ea3 => generated 1317 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:22:47.132830 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a6a02086-b692-4306-ad9f-2b391e7a061e tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:47.133796 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-a6a02086-b692-4306-ad9f-2b391e7a061e tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] [instance: 4824dd17-e11d-4def-ab59-9eb6279e46e8] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:47.141628 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a6a02086-b692-4306-ad9f-2b391e7a061e tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:47.142450 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a6a02086-b692-4306-ad9f-2b391e7a061e tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:47.143577 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a6a02086-b692-4306-ad9f-2b391e7a061e tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:47.144447 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a6a02086-b692-4306-ad9f-2b391e7a061e tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:47.459082 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-a6a02086-b692-4306-ad9f-2b391e7a061e tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ca7a39a8174a4b97767245e80b2bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55cfd65431cf4b878ab1c0e25a0ac629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:47.471810 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-a6a02086-b692-4306-ad9f-2b391e7a061e tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] 10.222.0.17 "GET /compute/v2.1/servers/4824dd17-e11d-4def-ab59-9eb6279e46e8" status: 200 len: 1316 microversion: 2.1 time: 0.343132 Jul 23 21:22:47.472408 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1126/2220] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:47 2022] GET /compute/v2.1/servers/4824dd17-e11d-4def-ab59-9eb6279e46e8 => generated 1316 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:47.567533 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-166ea6bd-72e7-4b64-b6ee-0740d6a246f5 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f80673ab800441b4bd1f5858e1df7b3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629d02efac724fa29fcfff53e370b69b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:47.576294 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-166ea6bd-72e7-4b64-b6ee-0740d6a246f5 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/servers/9933c901-3692-4f36-9f11-e1a93d902e94" status: 200 len: 1472 microversion: 2.1 time: 0.632917 Jul 23 21:22:47.577458 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1095/2221] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:46 2022] GET /compute/v2.1/servers/9933c901-3692-4f36-9f11-e1a93d902e94 => generated 1472 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:22:47.905184 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-6de6235b-3203-4850-8939-a5464c5a0e5b tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:47.906273 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-6de6235b-3203-4850-8939-a5464c5a0e5b tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] [instance: cef13563-7f83-4281-a26c-d5e420c41daf] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:47.916805 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6de6235b-3203-4850-8939-a5464c5a0e5b tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:47.918176 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6de6235b-3203-4850-8939-a5464c5a0e5b tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:47.920101 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6de6235b-3203-4850-8939-a5464c5a0e5b tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:47.920685 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6de6235b-3203-4850-8939-a5464c5a0e5b tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:47.982831 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-8e6c602d-e316-4221-8b56-2321d5ed8bdb req-d8136324-7929-4a10-832a-a129b51d09ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9933c901-3692-4f36-9f11-e1a93d902e94", "name": "network-vif-deleted", "tag": "710f608f-25bd-47cb-9727-946c3bac499f"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:22:48.010680 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-8e6c602d-e316-4221-8b56-2321d5ed8bdb req-d8136324-7929-4a10-832a-a129b51d09ef service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:48.019158 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-8e6c602d-e316-4221-8b56-2321d5ed8bdb req-d8136324-7929-4a10-832a-a129b51d09ef service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:48.046655 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-8e6c602d-e316-4221-8b56-2321d5ed8bdb req-d8136324-7929-4a10-832a-a129b51d09ef service nova] Creating event network-vif-deleted:710f608f-25bd-47cb-9727-946c3bac499f for instance 9933c901-3692-4f36-9f11-e1a93d902e94 on nch1-master-1 Jul 23 21:22:48.082235 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-8e6c602d-e316-4221-8b56-2321d5ed8bdb req-d8136324-7929-4a10-832a-a129b51d09ef service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103608 Jul 23 21:22:48.093130 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1096/2222] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:22:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:22:48.151295 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-aff5fa06-4cc5-4053-8b75-d8ad79546f4f tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:48.152376 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-aff5fa06-4cc5-4053-8b75-d8ad79546f4f tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] [instance: 6929bb48-ae83-4078-8df7-60124c837ea3] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:48.167530 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:22:48.177657 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-aff5fa06-4cc5-4053-8b75-d8ad79546f4f tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:48.179365 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-aff5fa06-4cc5-4053-8b75-d8ad79546f4f tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:48.193618 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-aff5fa06-4cc5-4053-8b75-d8ad79546f4f tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:48.196334 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-aff5fa06-4cc5-4053-8b75-d8ad79546f4f tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:48.336942 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-6de6235b-3203-4850-8939-a5464c5a0e5b tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf93a4b80cb4e19a36473986950fc75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c1943188684b45b636541caf587247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:48.361739 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-6de6235b-3203-4850-8939-a5464c5a0e5b tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] 10.222.0.17 "GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf" status: 200 len: 1464 microversion: 2.1 time: 0.463946 Jul 23 21:22:48.365518 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1127/2223] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:47 2022] GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf => generated 1464 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:48.385901 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-fd9a6c89-6a7c-433f-9229-7492519811d1 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:48.386711 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-fd9a6c89-6a7c-433f-9229-7492519811d1 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] [instance: cef13563-7f83-4281-a26c-d5e420c41daf] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:48.398021 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fd9a6c89-6a7c-433f-9229-7492519811d1 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:48.398521 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fd9a6c89-6a7c-433f-9229-7492519811d1 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:48.399762 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fd9a6c89-6a7c-433f-9229-7492519811d1 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:48.400261 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fd9a6c89-6a7c-433f-9229-7492519811d1 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:48.436144 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=8 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:22:48.566610 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-aff5fa06-4cc5-4053-8b75-d8ad79546f4f tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bde36fce49439bbe49caa877b1b630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebf7cadb7af43beb0b85669f8e1f36c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:48.578077 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-aff5fa06-4cc5-4053-8b75-d8ad79546f4f tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] 10.222.0.17 "GET /compute/v2.1/servers/6929bb48-ae83-4078-8df7-60124c837ea3" status: 200 len: 1317 microversion: 2.1 time: 0.434767 Jul 23 21:22:48.578747 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1097/2224] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:48 2022] GET /compute/v2.1/servers/6929bb48-ae83-4078-8df7-60124c837ea3 => generated 1317 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:48.585790 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1433a810-1a7c-489a-9193-637c41d3ec1a tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:48.586445 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1433a810-1a7c-489a-9193-637c41d3ec1a tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] [instance: 4824dd17-e11d-4def-ab59-9eb6279e46e8] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:48.605929 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1433a810-1a7c-489a-9193-637c41d3ec1a tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:48.606385 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1433a810-1a7c-489a-9193-637c41d3ec1a tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:48.607178 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1433a810-1a7c-489a-9193-637c41d3ec1a tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:48.607783 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1433a810-1a7c-489a-9193-637c41d3ec1a tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:48.669496 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-fd9a6c89-6a7c-433f-9229-7492519811d1 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf93a4b80cb4e19a36473986950fc75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c1943188684b45b636541caf587247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:48.703068 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-fd9a6c89-6a7c-433f-9229-7492519811d1 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] 10.222.0.17 "GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf" status: 200 len: 1464 microversion: 2.1 time: 0.322173 Jul 23 21:22:48.714640 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1128/2225] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:48 2022] GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf => generated 1464 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:48.721760 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f20d78e6-eb98-42f4-97c7-618d0cedbb96 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:48.726503 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-f20d78e6-eb98-42f4-97c7-618d0cedbb96 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] [instance: 9933c901-3692-4f36-9f11-e1a93d902e94] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:48.735756 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f20d78e6-eb98-42f4-97c7-618d0cedbb96 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:48.736344 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f20d78e6-eb98-42f4-97c7-618d0cedbb96 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:48.738432 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f20d78e6-eb98-42f4-97c7-618d0cedbb96 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:48.739043 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f20d78e6-eb98-42f4-97c7-618d0cedbb96 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:48.760577 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-f20d78e6-eb98-42f4-97c7-618d0cedbb96 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] HTTP exception thrown: Instance 9933c901-3692-4f36-9f11-e1a93d902e94 could not be found. Jul 23 21:22:48.763855 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f20d78e6-eb98-42f4-97c7-618d0cedbb96 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Request method failure captured: Jul 23 21:22:48.763855 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/servers/9933c901-3692-4f36-9f11-e1a93d902e94 HTTP/1.1 Jul 23 21:22:48.763855 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:22:48.763855 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:22:48.763855 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:22:48.763855 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:22:48.763855 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:22:48.763855 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:22:48.763855 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:22:48.763855 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:22:48.763855 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GYPBc-2n_lFJtRohuZSpAyDT3eZjBmd4RdqX2JYsTdTGJiAqb2uQL3seTae7vi9R7WcyVWSUwgmdD0_jLPebbVqy6P1Wz36z_C_lcIL9rKLBl05EozRB0eNpgfYMEAoS-VFfrz6kI2m3HaY6MoLHdvN_YwAQjIh1kWbg_z_KEGlDuA Jul 23 21:22:48.763855 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:22:48.763855 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:22:48.763855 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:22:48.763855 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:22:48.763855 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:22:48.763855 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:22:48.763855 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 629d02efac724fa29fcfff53e370b69b Jul 23 21:22:48.763855 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ListImageFiltersTestJSON-1562631288 Jul 23 21:22:48.763855 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:22:48.763855 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:22:48.763855 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/629d02efac724fa29fcfff53e370b69b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/629d02efac724fa29fcfff53e370b69b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_629d02efac724fa29fcfff53e370b69b", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/629d02efac724fa29fcfff53e370b69b"}]}] Jul 23 21:22:48.763855 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ListImageFiltersTestJSON-1562631288 Jul 23 21:22:48.763855 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 629d02efac724fa29fcfff53e370b69b Jul 23 21:22:48.763855 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1562631288 Jul 23 21:22:48.763855 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ListImageFiltersTestJSON-1562631288-project Jul 23 21:22:48.763855 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:22:48.763855 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:22:48.763855 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: f80673ab800441b4bd1f5858e1df7b3c Jul 23 21:22:48.763855 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ListImageFiltersTestJSON-1562631288-project Jul 23 21:22:48.763855 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:22:48.763855 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance 9933c901-3692-4f36-9f11-e1a93d902e94 could not be found. Jul 23 21:22:48.763855 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': '9933c901-3692-4f36-9f11-e1a93d902e94'} Jul 23 21:22:48.763855 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:22:48.763855 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:22:48.763855 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:22:48.763855 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:22:48.763855 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:22:48.763855 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:22:48.763855 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:22:48.763855 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:22:48.763855 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:22:48.763855 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:22:48.763855 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9933c901-3692-4f36-9f11-e1a93d902e94 could not be found. Jul 23 21:22:48.763855 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:22:48.763855 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:22:48.763855 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:22:48.763855 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:22:48.763855 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:22:48.763855 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:22:48.763855 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:22:48.763855 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:22:48.763855 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:22:48.763855 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:22:48.763855 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:22:48.763855 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:22:48.763855 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:22:48.763855 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:22:48.763855 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:22:48.763855 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:22:48.763855 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9933c901-3692-4f36-9f11-e1a93d902e94 could not be found. Jul 23 21:22:48.763855 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:22:48.763855 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:22:48.763855 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:22:48.769291 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:22:48.769291 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:22:48.769291 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:22:48.769291 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:22:48.769291 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:22:48.769291 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9933c901-3692-4f36-9f11-e1a93d902e94 could not be found. Jul 23 21:22:48.769291 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:22:48.771115 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f20d78e6-eb98-42f4-97c7-618d0cedbb96 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Returning 404 to user: Instance 9933c901-3692-4f36-9f11-e1a93d902e94 could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:22:48.772406 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-f20d78e6-eb98-42f4-97c7-618d0cedbb96 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "GET /compute/v2.1/servers/9933c901-3692-4f36-9f11-e1a93d902e94" status: 404 len: 111 microversion: 2.1 time: 0.066579 Jul 23 21:22:48.773334 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1129/2226] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:48 2022] GET /compute/v2.1/servers/9933c901-3692-4f36-9f11-e1a93d902e94 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:22:48.781936 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-13f602df-baf5-4f8f-a8eb-7f9b032e5d50 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:22:48.784156 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-13f602df-baf5-4f8f-a8eb-7f9b032e5d50 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] [instance: cef13563-7f83-4281-a26c-d5e420c41daf] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:48.793591 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-13f602df-baf5-4f8f-a8eb-7f9b032e5d50 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:48.794401 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-13f602df-baf5-4f8f-a8eb-7f9b032e5d50 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:48.795303 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-13f602df-baf5-4f8f-a8eb-7f9b032e5d50 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:48.795985 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-13f602df-baf5-4f8f-a8eb-7f9b032e5d50 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:48.925452 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-13f602df-baf5-4f8f-a8eb-7f9b032e5d50 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Flavor limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:22:48.926529 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-13f602df-baf5-4f8f-a8eb-7f9b032e5d50 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Image limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:22:48.927258 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-13f602df-baf5-4f8f-a8eb-7f9b032e5d50 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Flavor pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:22:48.927878 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-13f602df-baf5-4f8f-a8eb-7f9b032e5d50 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Image pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:22:48.928437 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-13f602df-baf5-4f8f-a8eb-7f9b032e5d50 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:22:48.974573 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-1433a810-1a7c-489a-9193-637c41d3ec1a tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ca7a39a8174a4b97767245e80b2bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55cfd65431cf4b878ab1c0e25a0ac629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:48.986144 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1433a810-1a7c-489a-9193-637c41d3ec1a tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] 10.222.0.17 "GET /compute/v2.1/servers/4824dd17-e11d-4def-ab59-9eb6279e46e8" status: 200 len: 1316 microversion: 2.1 time: 0.406319 Jul 23 21:22:48.987065 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1098/2227] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:48 2022] GET /compute/v2.1/servers/4824dd17-e11d-4def-ab59-9eb6279e46e8 => generated 1316 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:48.991993 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-50b8decc-d22b-4ef4-b920-396bd0ea2676 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '.version_select at 0x7f0b59925a60>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:49.040148 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-13f602df-baf5-4f8f-a8eb-7f9b032e5d50 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] [instance: cef13563-7f83-4281-a26c-d5e420c41daf] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:49.051520 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:22:49.067186 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-13f602df-baf5-4f8f-a8eb-7f9b032e5d50 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:49.068415 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-13f602df-baf5-4f8f-a8eb-7f9b032e5d50 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:49.070836 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-13f602df-baf5-4f8f-a8eb-7f9b032e5d50 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:49.071835 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-13f602df-baf5-4f8f-a8eb-7f9b032e5d50 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:49.157133 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-13f602df-baf5-4f8f-a8eb-7f9b032e5d50 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] 10.222.0.17 "POST /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf/action" status: 202 len: 1068 microversion: 2.1 time: 0.381888 Jul 23 21:22:49.157932 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1130/2228] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:22:48 2022] POST /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf/action => generated 1068 bytes in 384 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 23 21:22:49.177805 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-b21942f0-7751-4673-8669-f88f96ccdf6b tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:49.179417 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-b21942f0-7751-4673-8669-f88f96ccdf6b tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] [instance: cef13563-7f83-4281-a26c-d5e420c41daf] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:49.189264 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b21942f0-7751-4673-8669-f88f96ccdf6b tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:49.190938 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b21942f0-7751-4673-8669-f88f96ccdf6b tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:49.192287 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b21942f0-7751-4673-8669-f88f96ccdf6b tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:49.193399 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b21942f0-7751-4673-8669-f88f96ccdf6b tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:49.396252 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-b21942f0-7751-4673-8669-f88f96ccdf6b tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf93a4b80cb4e19a36473986950fc75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c1943188684b45b636541caf587247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:49.404731 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-b21942f0-7751-4673-8669-f88f96ccdf6b tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] 10.222.0.17 "GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf" status: 200 len: 1473 microversion: 2.1 time: 0.234906 Jul 23 21:22:49.415202 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1131/2229] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:49 2022] GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf => generated 1473 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:49.591483 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-50b8decc-d22b-4ef4-b920-396bd0ea2676 tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "DELETE /compute/v2.1/images/c5d7d192-f80e-419a-8ce3-1de44fbcc535" status: 204 len: 0 microversion: 2.1 time: 0.603270 Jul 23 21:22:49.592921 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1099/2230] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:48 2022] DELETE /compute/v2.1/images/c5d7d192-f80e-419a-8ce3-1de44fbcc535 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:22:49.599491 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-12442b2f-5f01-427d-9628-bcc38798d09f tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:49.600476 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-12442b2f-5f01-427d-9628-bcc38798d09f tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] [instance: 6929bb48-ae83-4078-8df7-60124c837ea3] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:49.604012 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-25617c02-b203-4230-ba53-13545420c3fc tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '.version_select at 0x7f0b599791f0>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:49.615121 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-12442b2f-5f01-427d-9628-bcc38798d09f tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:49.616519 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-12442b2f-5f01-427d-9628-bcc38798d09f tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:49.622056 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-12442b2f-5f01-427d-9628-bcc38798d09f tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:49.624476 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-12442b2f-5f01-427d-9628-bcc38798d09f tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:49.850694 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-12442b2f-5f01-427d-9628-bcc38798d09f tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bde36fce49439bbe49caa877b1b630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebf7cadb7af43beb0b85669f8e1f36c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:49.862318 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-12442b2f-5f01-427d-9628-bcc38798d09f tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] 10.222.0.17 "GET /compute/v2.1/servers/6929bb48-ae83-4078-8df7-60124c837ea3" status: 200 len: 1317 microversion: 2.1 time: 0.266643 Jul 23 21:22:49.872878 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1132/2231] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:49 2022] GET /compute/v2.1/servers/6929bb48-ae83-4078-8df7-60124c837ea3 => generated 1317 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:22:49.880041 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f4908ee0-bb54-4c9a-a56d-e781466b6046 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:49.880684 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-f4908ee0-bb54-4c9a-a56d-e781466b6046 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:49.892045 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f4908ee0-bb54-4c9a-a56d-e781466b6046 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:49.892508 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f4908ee0-bb54-4c9a-a56d-e781466b6046 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:49.893768 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f4908ee0-bb54-4c9a-a56d-e781466b6046 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:49.894256 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f4908ee0-bb54-4c9a-a56d-e781466b6046 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:50.037591 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-25617c02-b203-4230-ba53-13545420c3fc tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "DELETE /compute/v2.1/images/6b41dce9-8229-4ecb-9599-ba5c839e08f3" status: 204 len: 0 microversion: 2.1 time: 0.440523 Jul 23 21:22:50.042259 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1100/2232] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:49 2022] DELETE /compute/v2.1/images/6b41dce9-8229-4ecb-9599-ba5c839e08f3 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 23 21:22:50.049160 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c9e71b30-4ef1-4720-acf1-cecac5013842 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:50.051823 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c9e71b30-4ef1-4720-acf1-cecac5013842 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] [instance: 4824dd17-e11d-4def-ab59-9eb6279e46e8] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:50.061178 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c9e71b30-4ef1-4720-acf1-cecac5013842 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:50.062375 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c9e71b30-4ef1-4720-acf1-cecac5013842 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:50.063486 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c9e71b30-4ef1-4720-acf1-cecac5013842 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:50.064083 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c9e71b30-4ef1-4720-acf1-cecac5013842 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:50.210521 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell0:SELECT=2 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:22:50.215949 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-f4908ee0-bb54-4c9a-a56d-e781466b6046 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:50.227661 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-f4908ee0-bb54-4c9a-a56d-e781466b6046 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:50.230547 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-f4908ee0-bb54-4c9a-a56d-e781466b6046 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:50.232368 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-f4908ee0-bb54-4c9a-a56d-e781466b6046 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 2952 microversion: 2.42 time: 0.358260 Jul 23 21:22:50.234088 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1133/2233] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:22:49 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 2952 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:22:50.239696 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-dc3eb55d-6148-4750-a6b6-c3ff7f4ae61c tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] Calling method '.version_select at 0x7f0b5415dee0>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:50.437015 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c9e71b30-4ef1-4720-acf1-cecac5013842 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ca7a39a8174a4b97767245e80b2bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55cfd65431cf4b878ab1c0e25a0ac629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:50.448345 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c9e71b30-4ef1-4720-acf1-cecac5013842 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] 10.222.0.17 "GET /compute/v2.1/servers/4824dd17-e11d-4def-ab59-9eb6279e46e8" status: 200 len: 1316 microversion: 2.1 time: 0.404093 Jul 23 21:22:50.451471 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1101/2234] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:50 2022] GET /compute/v2.1/servers/4824dd17-e11d-4def-ab59-9eb6279e46e8 => generated 1316 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:50.464301 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ae492bd5-42b9-4ea9-b266-6fffbfb3a1bc tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:50.467239 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ae492bd5-42b9-4ea9-b266-6fffbfb3a1bc tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:50.491746 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ae492bd5-42b9-4ea9-b266-6fffbfb3a1bc tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:50.495980 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ae492bd5-42b9-4ea9-b266-6fffbfb3a1bc tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:50.497464 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ae492bd5-42b9-4ea9-b266-6fffbfb3a1bc tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:50.502958 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ae492bd5-42b9-4ea9-b266-6fffbfb3a1bc tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:50.577797 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell0:SELECT=8 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:22:50.599767 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-dc3eb55d-6148-4750-a6b6-c3ff7f4ae61c tempest-ListImageFiltersTestJSON-1562631288 tempest-ListImageFiltersTestJSON-1562631288-project] 10.222.0.17 "DELETE /compute/v2.1/images/72c67264-f3b8-40f4-83b3-792c48b62291" status: 204 len: 0 microversion: 2.1 time: 0.364385 Jul 23 21:22:50.600345 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1134/2235] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:50 2022] DELETE /compute/v2.1/images/72c67264-f3b8-40f4-83b3-792c48b62291 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:22:50.609979 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-55c00894-31ea-4347-aad1-f4c3bb0b4a52 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:50.610728 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-55c00894-31ea-4347-aad1-f4c3bb0b4a52 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] [instance: cef13563-7f83-4281-a26c-d5e420c41daf] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:50.634200 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-55c00894-31ea-4347-aad1-f4c3bb0b4a52 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:50.634961 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-55c00894-31ea-4347-aad1-f4c3bb0b4a52 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:50.635935 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-55c00894-31ea-4347-aad1-f4c3bb0b4a52 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:50.637387 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-55c00894-31ea-4347-aad1-f4c3bb0b4a52 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:50.770504 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ae492bd5-42b9-4ea9-b266-6fffbfb3a1bc tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d/os-interface" status: 200 len: 1832 microversion: 2.42 time: 0.317601 Jul 23 21:22:50.778841 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1102/2236] 10.222.0.17 () {60 vars in 1315 bytes} [Sat Jul 23 21:22:50 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d/os-interface => generated 1832 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:22:50.784527 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-be7c3ddf-84a6-496a-81da-027d08294992 req-b33df342-b813-4760-aa58-f754cb44a414 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4824dd17-e11d-4def-ab59-9eb6279e46e8", "name": "network-vif-plugged", "status": "completed", "tag": "bb88db37-af82-4c73-af5d-d2e71214c2df"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:22:50.809478 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-be7c3ddf-84a6-496a-81da-027d08294992 req-b33df342-b813-4760-aa58-f754cb44a414 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:50.809774 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-be7c3ddf-84a6-496a-81da-027d08294992 req-b33df342-b813-4760-aa58-f754cb44a414 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:50.853609 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-be7c3ddf-84a6-496a-81da-027d08294992 req-b33df342-b813-4760-aa58-f754cb44a414 service nova] Creating event network-vif-plugged:bb88db37-af82-4c73-af5d-d2e71214c2df for instance 4824dd17-e11d-4def-ab59-9eb6279e46e8 on nch2-master-1 Jul 23 21:22:50.864602 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-be7c3ddf-84a6-496a-81da-027d08294992 req-b33df342-b813-4760-aa58-f754cb44a414 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084339 Jul 23 21:22:50.869519 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1103/2237] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:22:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:22:50.881891 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-14b4f95f-28be-4880-80cd-e5ded0e453c4 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:50.883847 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-14b4f95f-28be-4880-80cd-e5ded0e453c4 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] [instance: 6929bb48-ae83-4078-8df7-60124c837ea3] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:50.890928 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-55c00894-31ea-4347-aad1-f4c3bb0b4a52 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf93a4b80cb4e19a36473986950fc75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c1943188684b45b636541caf587247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:50.901098 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-55c00894-31ea-4347-aad1-f4c3bb0b4a52 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] 10.222.0.17 "GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf" status: 200 len: 1473 microversion: 2.1 time: 0.295838 Jul 23 21:22:50.901332 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-14b4f95f-28be-4880-80cd-e5ded0e453c4 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:50.901782 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-14b4f95f-28be-4880-80cd-e5ded0e453c4 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:50.910135 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1135/2238] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:50 2022] GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf => generated 1473 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:50.911944 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-14b4f95f-28be-4880-80cd-e5ded0e453c4 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:50.912399 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-14b4f95f-28be-4880-80cd-e5ded0e453c4 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:51.259064 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-14b4f95f-28be-4880-80cd-e5ded0e453c4 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bde36fce49439bbe49caa877b1b630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebf7cadb7af43beb0b85669f8e1f36c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:51.281950 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-14b4f95f-28be-4880-80cd-e5ded0e453c4 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] 10.222.0.17 "GET /compute/v2.1/servers/6929bb48-ae83-4078-8df7-60124c837ea3" status: 200 len: 1317 microversion: 2.1 time: 0.401671 Jul 23 21:22:51.283350 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1104/2239] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:50 2022] GET /compute/v2.1/servers/6929bb48-ae83-4078-8df7-60124c837ea3 => generated 1317 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:22:51.467188 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-4dcf8412-7dcc-42d5-8406-56a70ed9ac9d tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:51.467791 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-4dcf8412-7dcc-42d5-8406-56a70ed9ac9d tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] [instance: 4824dd17-e11d-4def-ab59-9eb6279e46e8] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:51.481736 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4dcf8412-7dcc-42d5-8406-56a70ed9ac9d tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:51.482768 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4dcf8412-7dcc-42d5-8406-56a70ed9ac9d tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:51.484630 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4dcf8412-7dcc-42d5-8406-56a70ed9ac9d tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:51.486376 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4dcf8412-7dcc-42d5-8406-56a70ed9ac9d tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:51.717558 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-4dcf8412-7dcc-42d5-8406-56a70ed9ac9d tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ca7a39a8174a4b97767245e80b2bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55cfd65431cf4b878ab1c0e25a0ac629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:51.731368 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-4dcf8412-7dcc-42d5-8406-56a70ed9ac9d tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] 10.222.0.17 "GET /compute/v2.1/servers/4824dd17-e11d-4def-ab59-9eb6279e46e8" status: 200 len: 1316 microversion: 2.1 time: 0.267812 Jul 23 21:22:51.732752 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1136/2240] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:51 2022] GET /compute/v2.1/servers/4824dd17-e11d-4def-ab59-9eb6279e46e8 => generated 1316 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:51.930982 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-646d26d6-fcee-4f2e-a6e3-1d3e30b63aee tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:51.939938 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-646d26d6-fcee-4f2e-a6e3-1d3e30b63aee tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] [instance: cef13563-7f83-4281-a26c-d5e420c41daf] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:51.952629 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-646d26d6-fcee-4f2e-a6e3-1d3e30b63aee tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:51.953169 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-646d26d6-fcee-4f2e-a6e3-1d3e30b63aee tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:51.954161 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-646d26d6-fcee-4f2e-a6e3-1d3e30b63aee tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:51.954607 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-646d26d6-fcee-4f2e-a6e3-1d3e30b63aee tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:52.245301 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-646d26d6-fcee-4f2e-a6e3-1d3e30b63aee tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf93a4b80cb4e19a36473986950fc75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c1943188684b45b636541caf587247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:52.257369 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-646d26d6-fcee-4f2e-a6e3-1d3e30b63aee tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] 10.222.0.17 "GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf" status: 200 len: 1473 microversion: 2.1 time: 0.335123 Jul 23 21:22:52.258758 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1105/2241] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:51 2022] GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf => generated 1473 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:52.300019 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-29b6f5d3-6785-453a-9a23-59d074fc7c8e tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:52.300733 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-29b6f5d3-6785-453a-9a23-59d074fc7c8e tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] [instance: 6929bb48-ae83-4078-8df7-60124c837ea3] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:52.314547 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-29b6f5d3-6785-453a-9a23-59d074fc7c8e tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:52.315399 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-29b6f5d3-6785-453a-9a23-59d074fc7c8e tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:52.317128 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-29b6f5d3-6785-453a-9a23-59d074fc7c8e tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:52.318254 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-29b6f5d3-6785-453a-9a23-59d074fc7c8e tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:52.330247 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:22:52.697748 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-29b6f5d3-6785-453a-9a23-59d074fc7c8e tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bde36fce49439bbe49caa877b1b630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebf7cadb7af43beb0b85669f8e1f36c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:52.708736 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-29b6f5d3-6785-453a-9a23-59d074fc7c8e tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] 10.222.0.17 "GET /compute/v2.1/servers/6929bb48-ae83-4078-8df7-60124c837ea3" status: 200 len: 1317 microversion: 2.1 time: 0.413084 Jul 23 21:22:52.709666 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1137/2242] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:52 2022] GET /compute/v2.1/servers/6929bb48-ae83-4078-8df7-60124c837ea3 => generated 1317 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:52.752626 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1c2d3689-4fd4-4e22-8d6a-4c23db4173d3 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:52.753340 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1c2d3689-4fd4-4e22-8d6a-4c23db4173d3 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] [instance: 4824dd17-e11d-4def-ab59-9eb6279e46e8] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:52.767022 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1c2d3689-4fd4-4e22-8d6a-4c23db4173d3 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:52.767708 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1c2d3689-4fd4-4e22-8d6a-4c23db4173d3 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:52.768816 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1c2d3689-4fd4-4e22-8d6a-4c23db4173d3 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:52.771181 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1c2d3689-4fd4-4e22-8d6a-4c23db4173d3 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:52.940994 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-09974cc6-8e66-4e7b-b285-6592f88076bb tempest-ListImageFiltersNegativeTestJSON-849526409 tempest-ListImageFiltersNegativeTestJSON-849526409-project] Calling method '.version_select at 0x7f0b541a8430>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:52.974780 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-09974cc6-8e66-4e7b-b285-6592f88076bb tempest-ListImageFiltersNegativeTestJSON-849526409 tempest-ListImageFiltersNegativeTestJSON-849526409-project] HTTP exception thrown: Image not found. Jul 23 21:22:52.978983 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-09974cc6-8e66-4e7b-b285-6592f88076bb tempest-ListImageFiltersNegativeTestJSON-849526409 tempest-ListImageFiltersNegativeTestJSON-849526409-project] Request method failure captured: Jul 23 21:22:52.978983 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/images/77da765c-a56c-4d7f-9d6a-71a6537ec3d6 HTTP/1.1 Jul 23 21:22:52.978983 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:22:52.978983 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:22:52.978983 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:22:52.978983 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:22:52.978983 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:22:52.978983 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:22:52.978983 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:22:52.978983 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:22:52.978983 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3Gas7t74l_OKe0yyOWKYNt6BWqg79SNMY2-x1vH_oJgKyJzdvI8NewsRV0fFI5TxCbDmWgjQ7N2c3_JqozlTLt1xa60jMzrysQVOPtBwltfdpeGqD8aJgGTrjOD5G30-M75GSjhVm8xyypC0kvyzCGOFqjhbSul7bjzHmyrVMxueSCE Jul 23 21:22:52.978983 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:22:52.978983 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:22:52.978983 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:22:52.978983 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:22:52.978983 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:22:52.978983 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:22:52.978983 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: df514a56fdad4584b0f15212ff29698c Jul 23 21:22:52.978983 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-849526409 Jul 23 21:22:52.978983 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:22:52.978983 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:22:52.978983 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/df514a56fdad4584b0f15212ff29698c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/df514a56fdad4584b0f15212ff29698c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_df514a56fdad4584b0f15212ff29698c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/df514a56fdad4584b0f15212ff29698c"}]}] Jul 23 21:22:52.978983 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-849526409 Jul 23 21:22:52.978983 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: df514a56fdad4584b0f15212ff29698c Jul 23 21:22:52.978983 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-849526409 Jul 23 21:22:52.978983 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ListImageFiltersNegativeTestJSON-849526409-project Jul 23 21:22:52.978983 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:22:52.978983 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:22:52.978983 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 527ad10d4b174992a7e90ae9cd464f42 Jul 23 21:22:52.978983 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-849526409-project Jul 23 21:22:52.978983 ncdv-master-1 devstack@n-api.service[131321]: method: Jul 23 21:22:52.978983 ncdv-master-1 devstack@n-api.service[131321]: exception: Image not found. Jul 23 21:22:52.978983 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': '77da765c-a56c-4d7f-9d6a-71a6537ec3d6'} Jul 23 21:22:52.978983 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:22:52.978983 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:22:52.978983 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 23 21:22:52.978983 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 23 21:22:52.978983 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 23 21:22:52.978983 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 23 21:22:52.978983 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 23 21:22:52.978983 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 23 21:22:52.978983 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 23 21:22:52.978983 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 23 21:22:52.978983 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 23 21:22:52.978983 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 23 21:22:52.978983 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 23 21:22:52.978983 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 23 21:22:52.978983 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 23 21:22:52.978983 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 23 21:22:52.978983 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 23 21:22:52.978983 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 23 21:22:52.978983 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 77da765c-a56c-4d7f-9d6a-71a6537ec3d6 Jul 23 21:22:52.978983 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:22:52.978983 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:22:52.978983 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:22:52.978983 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:22:52.978983 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 23 21:22:52.978983 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 23 21:22:52.978983 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 23 21:22:52.978983 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 23 21:22:52.978983 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 23 21:22:52.978983 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 23 21:22:52.978983 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 23 21:22:52.983305 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 23 21:22:52.983305 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 23 21:22:52.983305 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 23 21:22:52.983305 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 23 21:22:52.983305 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 23 21:22:52.983305 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 23 21:22:52.983305 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 23 21:22:52.983305 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 23 21:22:52.983305 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 23 21:22:52.983305 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 23 21:22:52.983305 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 23 21:22:52.983305 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 23 21:22:52.983305 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 23 21:22:52.983305 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 23 21:22:52.983305 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 23 21:22:52.983305 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 23 21:22:52.983305 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 23 21:22:52.983305 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 77da765c-a56c-4d7f-9d6a-71a6537ec3d6 could not be found. Jul 23 21:22:52.983305 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:22:52.983305 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:22:52.983305 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:22:52.983305 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:22:52.983305 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:22:52.983305 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:22:52.983305 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:22:52.983305 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:22:52.983305 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:22:52.983305 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:22:52.983305 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:22:52.983305 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:22:52.983305 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 23 21:22:52.983305 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 23 21:22:52.983305 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 23 21:22:52.983305 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:22:52.983305 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:22:52.983305 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:22:52.983305 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:22:52.983305 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:22:52.983305 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:22:52.983305 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:22:52.983305 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:22:52.983305 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 23 21:22:52.983305 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:22:52.991371 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-09974cc6-8e66-4e7b-b285-6592f88076bb tempest-ListImageFiltersNegativeTestJSON-849526409 tempest-ListImageFiltersNegativeTestJSON-849526409-project] Returning 404 to user: Image not found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:22:52.993790 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-09974cc6-8e66-4e7b-b285-6592f88076bb tempest-ListImageFiltersNegativeTestJSON-849526409 tempest-ListImageFiltersNegativeTestJSON-849526409-project] 10.222.0.17 "GET /compute/v2.1/images/77da765c-a56c-4d7f-9d6a-71a6537ec3d6" status: 404 len: 62 microversion: 2.1 time: 0.218561 Jul 23 21:22:52.994740 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1138/2243] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:22:52 2022] GET /compute/v2.1/images/77da765c-a56c-4d7f-9d6a-71a6537ec3d6 => generated 62 bytes in 221 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 23 21:22:53.009971 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-85a19d4b-b303-4552-8179-d395385797a1 req-51272219-a294-479a-88b9-b4c1bbd5a198 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6929bb48-ae83-4078-8df7-60124c837ea3", "name": "network-vif-plugged", "status": "completed", "tag": "1e3e8f57-3c77-4c90-ad4e-1a9f4efa146d"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:22:53.035582 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-85a19d4b-b303-4552-8179-d395385797a1 req-51272219-a294-479a-88b9-b4c1bbd5a198 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:53.051244 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-85a19d4b-b303-4552-8179-d395385797a1 req-51272219-a294-479a-88b9-b4c1bbd5a198 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:53.075955 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-85a19d4b-b303-4552-8179-d395385797a1 req-51272219-a294-479a-88b9-b4c1bbd5a198 service nova] Creating event network-vif-plugged:1e3e8f57-3c77-4c90-ad4e-1a9f4efa146d for instance 6929bb48-ae83-4078-8df7-60124c837ea3 on nch2-master-1 Jul 23 21:22:53.092634 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-85a19d4b-b303-4552-8179-d395385797a1 req-51272219-a294-479a-88b9-b4c1bbd5a198 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096110 Jul 23 21:22:53.093553 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1139/2244] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:22:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:22:53.276893 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-0d75bb48-c047-4fe0-b1bf-a81bb47fec75 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:53.278204 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-0d75bb48-c047-4fe0-b1bf-a81bb47fec75 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] [instance: cef13563-7f83-4281-a26c-d5e420c41daf] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:53.292544 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0d75bb48-c047-4fe0-b1bf-a81bb47fec75 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:53.293678 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0d75bb48-c047-4fe0-b1bf-a81bb47fec75 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:53.294929 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0d75bb48-c047-4fe0-b1bf-a81bb47fec75 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:53.300003 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0d75bb48-c047-4fe0-b1bf-a81bb47fec75 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:53.468587 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-1c2d3689-4fd4-4e22-8d6a-4c23db4173d3 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ca7a39a8174a4b97767245e80b2bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55cfd65431cf4b878ab1c0e25a0ac629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:53.480766 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-0d75bb48-c047-4fe0-b1bf-a81bb47fec75 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf93a4b80cb4e19a36473986950fc75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c1943188684b45b636541caf587247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:53.487498 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1c2d3689-4fd4-4e22-8d6a-4c23db4173d3 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] 10.222.0.17 "GET /compute/v2.1/servers/4824dd17-e11d-4def-ab59-9eb6279e46e8" status: 200 len: 1502 microversion: 2.1 time: 0.737998 Jul 23 21:22:53.490336 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-0d75bb48-c047-4fe0-b1bf-a81bb47fec75 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] 10.222.0.17 "GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf" status: 200 len: 1473 microversion: 2.1 time: 0.219839 Jul 23 21:22:53.500413 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1140/2245] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:53 2022] GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf => generated 1473 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:22:53.502471 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1106/2246] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:52 2022] GET /compute/v2.1/servers/4824dd17-e11d-4def-ab59-9eb6279e46e8 => generated 1502 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:53.519969 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-81b92c95-8db1-4518-88a6-4fcc779e78c1 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1061381681"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:22:53.520622 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-81b92c95-8db1-4518-88a6-4fcc779e78c1 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] [instance: 4824dd17-e11d-4def-ab59-9eb6279e46e8] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:53.527396 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-81b92c95-8db1-4518-88a6-4fcc779e78c1 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:53.528159 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-81b92c95-8db1-4518-88a6-4fcc779e78c1 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:53.529161 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-81b92c95-8db1-4518-88a6-4fcc779e78c1 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:53.530002 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-81b92c95-8db1-4518-88a6-4fcc779e78c1 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:53.815722 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.network.security_group_api [None req-81b92c95-8db1-4518-88a6-4fcc779e78c1 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Adding security group bf78122c-7329-4d84-a0e3-3559c728fae7 to port bb88db37-af82-4c73-af5d-d2e71214c2df Jul 23 21:22:53.900396 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-168fa531-e522-48ad-b370-7e76dd8d2c86 tempest-SecurityGroupRulesTestJSON-841550850 tempest-SecurityGroupRulesTestJSON-841550850-project] Action: 'create', calling method: .version_select at 0x7f0b59901550>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-432803601", "description": "tempest-description-1159631191"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:22:54.131731 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-168fa531-e522-48ad-b370-7e76dd8d2c86 tempest-SecurityGroupRulesTestJSON-841550850 tempest-SecurityGroupRulesTestJSON-841550850-project] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.412272 Jul 23 21:22:54.135442 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1107/2247] 10.222.0.17 () {60 vars in 1179 bytes} [Sat Jul 23 21:22:53 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:22:54.145686 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-cc58411d-8b40-4293-a005-bcd6d83538c2 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:54.146983 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-cc58411d-8b40-4293-a005-bcd6d83538c2 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] [instance: 6929bb48-ae83-4078-8df7-60124c837ea3] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:54.157240 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cc58411d-8b40-4293-a005-bcd6d83538c2 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:54.158287 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cc58411d-8b40-4293-a005-bcd6d83538c2 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:54.159809 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cc58411d-8b40-4293-a005-bcd6d83538c2 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:54.160642 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cc58411d-8b40-4293-a005-bcd6d83538c2 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:54.343318 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-81b92c95-8db1-4518-88a6-4fcc779e78c1 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] 10.222.0.17 "POST /compute/v2.1/servers/4824dd17-e11d-4def-ab59-9eb6279e46e8/action" status: 202 len: 0 microversion: 2.1 time: 0.826060 Jul 23 21:22:54.345373 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1141/2248] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:22:53 2022] POST /compute/v2.1/servers/4824dd17-e11d-4def-ab59-9eb6279e46e8/action => generated 0 bytes in 831 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:22:54.350860 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-2aebc072-0ac8-490b-b8b8-d3597c064cb3 tempest-SecurityGroupRulesTestJSON-841550850 tempest-SecurityGroupRulesTestJSON-841550850-project] Action: 'create', calling method: .version_select at 0x7f0b599e6b80>, body: {"security_group_rule": {"parent_group_id": "750c54c2-d8fd-427e-b1ef-e2e5f48ed8e9", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:22:54.523890 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-cc58411d-8b40-4293-a005-bcd6d83538c2 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bde36fce49439bbe49caa877b1b630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebf7cadb7af43beb0b85669f8e1f36c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:54.539521 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-cc58411d-8b40-4293-a005-bcd6d83538c2 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] 10.222.0.17 "GET /compute/v2.1/servers/6929bb48-ae83-4078-8df7-60124c837ea3" status: 200 len: 1317 microversion: 2.1 time: 0.402566 Jul 23 21:22:54.556086 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1108/2249] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:54 2022] GET /compute/v2.1/servers/6929bb48-ae83-4078-8df7-60124c837ea3 => generated 1317 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:54.561783 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4c3b1500-7d6b-4d15-92e8-0204afa0781b tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1262830324"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:22:54.574043 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-4c3b1500-7d6b-4d15-92e8-0204afa0781b tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] [instance: 4824dd17-e11d-4def-ab59-9eb6279e46e8] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:54.588620 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4c3b1500-7d6b-4d15-92e8-0204afa0781b tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:54.600625 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4c3b1500-7d6b-4d15-92e8-0204afa0781b tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:54.602871 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4c3b1500-7d6b-4d15-92e8-0204afa0781b tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:54.603451 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4c3b1500-7d6b-4d15-92e8-0204afa0781b tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:54.713593 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-2aebc072-0ac8-490b-b8b8-d3597c064cb3 tempest-SecurityGroupRulesTestJSON-841550850 tempest-SecurityGroupRulesTestJSON-841550850-project] 10.222.0.17 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.366582 Jul 23 21:22:54.716582 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1142/2250] 10.222.0.17 () {60 vars in 1194 bytes} [Sat Jul 23 21:22:54 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:22:54.729052 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-dc9b67c4-a3bc-4da1-bda9-29107057e17a req-89608121-2d1a-4435-a17c-7be4a5dac5e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4824dd17-e11d-4def-ab59-9eb6279e46e8", "tag": "bb88db37-af82-4c73-af5d-d2e71214c2df"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:22:54.741260 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-dc9b67c4-a3bc-4da1-bda9-29107057e17a req-89608121-2d1a-4435-a17c-7be4a5dac5e6 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:54.741995 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-dc9b67c4-a3bc-4da1-bda9-29107057e17a req-89608121-2d1a-4435-a17c-7be4a5dac5e6 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:54.767362 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-dc9b67c4-a3bc-4da1-bda9-29107057e17a req-89608121-2d1a-4435-a17c-7be4a5dac5e6 service nova] Creating event network-changed:bb88db37-af82-4c73-af5d-d2e71214c2df for instance 4824dd17-e11d-4def-ab59-9eb6279e46e8 on nch2-master-1 Jul 23 21:22:54.774701 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-dc9b67c4-a3bc-4da1-bda9-29107057e17a req-89608121-2d1a-4435-a17c-7be4a5dac5e6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050116 Jul 23 21:22:54.775554 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1143/2251] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:22:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:22:54.808101 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-27ff163a-a5a1-4727-ac38-53f911acc466 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:54.809082 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-27ff163a-a5a1-4727-ac38-53f911acc466 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] [instance: cef13563-7f83-4281-a26c-d5e420c41daf] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:54.817511 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-27ff163a-a5a1-4727-ac38-53f911acc466 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:54.818243 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-27ff163a-a5a1-4727-ac38-53f911acc466 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:54.819194 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-27ff163a-a5a1-4727-ac38-53f911acc466 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:54.819782 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-27ff163a-a5a1-4727-ac38-53f911acc466 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:54.895801 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.network.security_group_api [None req-4c3b1500-7d6b-4d15-92e8-0204afa0781b tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Adding security group 6c10e161-9f57-48cb-a087-3868d686aeec to port bb88db37-af82-4c73-af5d-d2e71214c2df Jul 23 21:22:55.107742 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-27ff163a-a5a1-4727-ac38-53f911acc466 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf93a4b80cb4e19a36473986950fc75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c1943188684b45b636541caf587247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:55.118734 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-27ff163a-a5a1-4727-ac38-53f911acc466 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] 10.222.0.17 "GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf" status: 200 len: 1473 microversion: 2.1 time: 0.338878 Jul 23 21:22:55.118734 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1144/2252] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:54 2022] GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf => generated 1473 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:55.126206 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-281d94c0-f6c9-4b6f-b6c8-4e6d67febc82 tempest-SecurityGroupRulesTestJSON-841550850 tempest-SecurityGroupRulesTestJSON-841550850-project] Action: 'create', calling method: .version_select at 0x7f0b5460e310>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1071955891", "description": "tempest-description-69881201"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:22:55.510582 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4c3b1500-7d6b-4d15-92e8-0204afa0781b tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] 10.222.0.17 "POST /compute/v2.1/servers/4824dd17-e11d-4def-ab59-9eb6279e46e8/action" status: 202 len: 0 microversion: 2.1 time: 0.952602 Jul 23 21:22:55.514571 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1109/2253] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:22:54 2022] POST /compute/v2.1/servers/4824dd17-e11d-4def-ab59-9eb6279e46e8/action => generated 0 bytes in 955 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:22:55.520511 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-2a0e7795-e2b7-4253-90b8-8d81acadf196 req-4df33921-d358-40cf-b2da-13c7ec2f1293 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4824dd17-e11d-4def-ab59-9eb6279e46e8", "tag": "bb88db37-af82-4c73-af5d-d2e71214c2df"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:22:55.539596 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-2a0e7795-e2b7-4253-90b8-8d81acadf196 req-4df33921-d358-40cf-b2da-13c7ec2f1293 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:55.541480 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-2a0e7795-e2b7-4253-90b8-8d81acadf196 req-4df33921-d358-40cf-b2da-13c7ec2f1293 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:55.559354 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-2a0e7795-e2b7-4253-90b8-8d81acadf196 req-4df33921-d358-40cf-b2da-13c7ec2f1293 service nova] Creating event network-changed:bb88db37-af82-4c73-af5d-d2e71214c2df for instance 4824dd17-e11d-4def-ab59-9eb6279e46e8 on nch2-master-1 Jul 23 21:22:55.565370 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-2a0e7795-e2b7-4253-90b8-8d81acadf196 req-4df33921-d358-40cf-b2da-13c7ec2f1293 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049856 Jul 23 21:22:55.566087 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1110/2254] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:22:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:22:55.573825 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2e717017-2b80-4cf0-9ffc-a4d2b5d0aa34 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:55.574531 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-2e717017-2b80-4cf0-9ffc-a4d2b5d0aa34 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] [instance: 4824dd17-e11d-4def-ab59-9eb6279e46e8] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:55.582455 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2e717017-2b80-4cf0-9ffc-a4d2b5d0aa34 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:55.582959 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2e717017-2b80-4cf0-9ffc-a4d2b5d0aa34 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:55.583829 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2e717017-2b80-4cf0-9ffc-a4d2b5d0aa34 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:55.584375 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2e717017-2b80-4cf0-9ffc-a4d2b5d0aa34 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:55.824078 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2e717017-2b80-4cf0-9ffc-a4d2b5d0aa34 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] 10.222.0.17 "GET /compute/v2.1/servers/4824dd17-e11d-4def-ab59-9eb6279e46e8/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 0.256111 Jul 23 21:22:55.825651 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1111/2255] 10.222.0.17 () {58 vars in 1292 bytes} [Sat Jul 23 21:22:55 2022] GET /compute/v2.1/servers/4824dd17-e11d-4def-ab59-9eb6279e46e8/os-security-groups => generated 1158 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:55.830976 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a2a6384b-7ec4-4fa0-8cf8-44ba9fbf8027 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:55.836363 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a2a6384b-7ec4-4fa0-8cf8-44ba9fbf8027 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] [instance: 6929bb48-ae83-4078-8df7-60124c837ea3] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:55.844731 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a2a6384b-7ec4-4fa0-8cf8-44ba9fbf8027 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:55.845187 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a2a6384b-7ec4-4fa0-8cf8-44ba9fbf8027 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:55.846783 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a2a6384b-7ec4-4fa0-8cf8-44ba9fbf8027 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:55.847230 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a2a6384b-7ec4-4fa0-8cf8-44ba9fbf8027 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:55.938203 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-281d94c0-f6c9-4b6f-b6c8-4e6d67febc82 tempest-SecurityGroupRulesTestJSON-841550850 tempest-SecurityGroupRulesTestJSON-841550850-project] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.819463 Jul 23 21:22:55.945182 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1145/2256] 10.222.0.17 () {60 vars in 1179 bytes} [Sat Jul 23 21:22:55 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:22:55.945182 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-7313c7a2-1bb4-4691-81e5-6b9ed7324c1f tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Action: 'create', calling method: .version_select at 0x7f0b541a8430>, body: {"security_group": {"name": " tempest-securitygroup -1975568829 ", "description": "tempest-description-8216375"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:22:56.049336 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a2a6384b-7ec4-4fa0-8cf8-44ba9fbf8027 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bde36fce49439bbe49caa877b1b630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebf7cadb7af43beb0b85669f8e1f36c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:56.058672 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a2a6384b-7ec4-4fa0-8cf8-44ba9fbf8027 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] 10.222.0.17 "GET /compute/v2.1/servers/6929bb48-ae83-4078-8df7-60124c837ea3" status: 200 len: 1467 microversion: 2.1 time: 0.231712 Jul 23 21:22:56.062474 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1112/2257] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:55 2022] GET /compute/v2.1/servers/6929bb48-ae83-4078-8df7-60124c837ea3 => generated 1467 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:56.076088 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0a4197f2-7f0c-4adb-bbc6-cceb83a7b516 tempest-SecurityGroupRulesTestJSON-841550850 tempest-SecurityGroupRulesTestJSON-841550850-project] Action: 'create', calling method: .version_select at 0x7f0b59a954c0>, body: {"security_group_rule": {"parent_group_id": "76c1de84-908e-4b08-b9b6-d3617f4b9625", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:22:56.342051 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-0a4197f2-7f0c-4adb-bbc6-cceb83a7b516 tempest-SecurityGroupRulesTestJSON-841550850 tempest-SecurityGroupRulesTestJSON-841550850-project] 10.222.0.17 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.277591 Jul 23 21:22:56.344821 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1113/2258] 10.222.0.17 () {60 vars in 1194 bytes} [Sat Jul 23 21:22:56 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:22:56.356458 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-98593eb8-34e0-4563-9e55-497115e955a3 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-857897576", "metadata": {"image_type": "test"}}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:22:56.357650 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-98593eb8-34e0-4563-9e55-497115e955a3 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] [instance: 6929bb48-ae83-4078-8df7-60124c837ea3] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:56.364609 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-98593eb8-34e0-4563-9e55-497115e955a3 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:56.365285 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-98593eb8-34e0-4563-9e55-497115e955a3 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:56.366101 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-98593eb8-34e0-4563-9e55-497115e955a3 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:56.366699 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-98593eb8-34e0-4563-9e55-497115e955a3 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:56.374962 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:22:56.414698 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-98593eb8-34e0-4563-9e55-497115e955a3 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Getting quotas for project 4ebf7cadb7af43beb0b85669f8e1f36c. Resources: dict_keys(['metadata_items']) {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:22:56.421455 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-98593eb8-34e0-4563-9e55-497115e955a3 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Getting quotas for user 73bde36fce49439bbe49caa877b1b630 and project 4ebf7cadb7af43beb0b85669f8e1f36c. Resources: dict_keys(['metadata_items']) {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:22:56.428304 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-7313c7a2-1bb4-4691-81e5-6b9ed7324c1f tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.487171 Jul 23 21:22:56.430603 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1146/2259] 10.222.0.17 () {60 vars in 1179 bytes} [Sat Jul 23 21:22:55 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:22:56.438632 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-76953876-cebc-4c50-81cf-a88dde0b5bb9 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:56.456734 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-76953876-cebc-4c50-81cf-a88dde0b5bb9 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] [instance: cef13563-7f83-4281-a26c-d5e420c41daf] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:56.470921 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-76953876-cebc-4c50-81cf-a88dde0b5bb9 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:56.471560 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-76953876-cebc-4c50-81cf-a88dde0b5bb9 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:56.472407 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-76953876-cebc-4c50-81cf-a88dde0b5bb9 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:56.473125 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-76953876-cebc-4c50-81cf-a88dde0b5bb9 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:56.743346 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-98593eb8-34e0-4563-9e55-497115e955a3 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] 10.222.0.17 "POST /compute/v2.1/servers/6929bb48-ae83-4078-8df7-60124c837ea3/action" status: 202 len: 0 microversion: 2.1 time: 0.395314 Jul 23 21:22:56.745305 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1114/2260] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:22:56 2022] POST /compute/v2.1/servers/6929bb48-ae83-4078-8df7-60124c837ea3/action => generated 0 bytes in 399 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 23 21:22:56.755304 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-09eda3c8-1f23-4837-80e5-964305e247a6 tempest-SecurityGroupRulesTestJSON-841550850 tempest-SecurityGroupRulesTestJSON-841550850-project] Action: 'create', calling method: .version_select at 0x7f0b540e54c0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-493739622", "description": "tempest-description-1839174395"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:22:56.999585 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-09eda3c8-1f23-4837-80e5-964305e247a6 tempest-SecurityGroupRulesTestJSON-841550850 tempest-SecurityGroupRulesTestJSON-841550850-project] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.250323 Jul 23 21:22:57.000447 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1115/2261] 10.222.0.17 () {60 vars in 1179 bytes} [Sat Jul 23 21:22:56 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:22:57.010770 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9afab404-c1fb-415e-9f2c-abcdcb1ca667 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Calling method '.version_select at 0x7f0b59925a60>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:57.028764 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-76953876-cebc-4c50-81cf-a88dde0b5bb9 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf93a4b80cb4e19a36473986950fc75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c1943188684b45b636541caf587247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:57.041653 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-76953876-cebc-4c50-81cf-a88dde0b5bb9 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] 10.222.0.17 "GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf" status: 200 len: 1473 microversion: 2.1 time: 0.608000 Jul 23 21:22:57.042602 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1147/2262] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:56 2022] GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf => generated 1473 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:57.048720 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a85dfc1b-649a-4ebe-a50e-5f213d656235 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Calling method '.version_select at 0x7f0b5431d700>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:57.106357 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9afab404-c1fb-415e-9f2c-abcdcb1ca667 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] 10.222.0.17 "GET /compute/v2.1/os-security-groups/0f61276a-4635-4afc-9cc7-7dfc52c098e5" status: 200 len: 221 microversion: 2.1 time: 0.104358 Jul 23 21:22:57.107235 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1116/2263] 10.222.0.17 () {58 vars in 1268 bytes} [Sat Jul 23 21:22:57 2022] GET /compute/v2.1/os-security-groups/0f61276a-4635-4afc-9cc7-7dfc52c098e5 => generated 221 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:22:57.112330 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d7c96d20-84a1-49e8-a960-52c5a03477cb tempest-SecurityGroupRulesTestJSON-841550850 tempest-SecurityGroupRulesTestJSON-841550850-project] Action: 'create', calling method: .version_select at 0x7f0b59979790>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1503235408", "description": "tempest-description-308283055"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:22:57.113626 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-a85dfc1b-649a-4ebe-a50e-5f213d656235 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] 10.222.0.17 "GET /compute/v2.1/images/d899d6d5-3173-446f-9605-a7e38cdde92c" status: 200 len: 1423 microversion: 2.1 time: 0.069352 Jul 23 21:22:57.114222 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1148/2264] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:22:57 2022] GET /compute/v2.1/images/d899d6d5-3173-446f-9605-a7e38cdde92c => generated 1423 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:57.121001 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-3ff109ee-d5a0-43d3-b141-e381ea67b845 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Calling method '.version_select at 0x7f0b542c5670>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:57.307794 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d7c96d20-84a1-49e8-a960-52c5a03477cb tempest-SecurityGroupRulesTestJSON-841550850 tempest-SecurityGroupRulesTestJSON-841550850-project] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.199302 Jul 23 21:22:57.308386 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1117/2265] 10.222.0.17 () {60 vars in 1179 bytes} [Sat Jul 23 21:22:57 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:22:57.319302 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e57411d0-86ba-4ed6-8b63-1896b535d7e8 tempest-SecurityGroupRulesTestJSON-841550850 tempest-SecurityGroupRulesTestJSON-841550850-project] Action: 'create', calling method: .version_select at 0x7f0b598d3ca0>, body: {"security_group_rule": {"parent_group_id": "34850527-1319-4ffc-b0ff-48c346a18471", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "2ec0a1d9-c668-451a-bb11-cd9ce49016a8"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:22:57.666530 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e57411d0-86ba-4ed6-8b63-1896b535d7e8 tempest-SecurityGroupRulesTestJSON-841550850 tempest-SecurityGroupRulesTestJSON-841550850-project] 10.222.0.17 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.351008 Jul 23 21:22:57.667490 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1118/2266] 10.222.0.17 () {60 vars in 1194 bytes} [Sat Jul 23 21:22:57 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:22:57.681938 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6d150eeb-3c08-45c5-b549-2747d361e97b tempest-SecurityGroupRulesTestJSON-841550850 tempest-SecurityGroupRulesTestJSON-841550850-project] Action: 'create', calling method: .version_select at 0x7f0b59901dc0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1874091580", "description": "tempest-description-1605960007"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:22:57.684768 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-3ff109ee-d5a0-43d3-b141-e381ea67b845 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/0f61276a-4635-4afc-9cc7-7dfc52c098e5" status: 202 len: 0 microversion: 2.1 time: 0.568869 Jul 23 21:22:57.685475 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1149/2267] 10.222.0.17 () {58 vars in 1271 bytes} [Sat Jul 23 21:22:57 2022] DELETE /compute/v2.1/os-security-groups/0f61276a-4635-4afc-9cc7-7dfc52c098e5 => generated 0 bytes in 571 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:22:57.694050 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-551816f3-21fb-40df-9030-69317f246fbf tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Calling method '.version_select at 0x7f0b47fdc700>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:57.742960 ncdv-master-1 devstack@n-api.service[131321]: DEBUG neutronclient.v2_0.client [None req-551816f3-21fb-40df-9030-69317f246fbf tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 0f61276a-4635-4afc-9cc7-7dfc52c098e5 does not exist", "detail": ""}} {{(pid=131321) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 23 21:22:57.744435 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.network.security_group_api [None req-551816f3-21fb-40df-9030-69317f246fbf tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Neutron security group 0f61276a-4635-4afc-9cc7-7dfc52c098e5 not found {{(pid=131321) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 23 21:22:57.745187 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-551816f3-21fb-40df-9030-69317f246fbf tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] HTTP exception thrown: Security group 0f61276a-4635-4afc-9cc7-7dfc52c098e5 does not exist Jul 23 21:22:57.745187 ncdv-master-1 devstack@n-api.service[131321]: Neutron server returns request_ids: ['req-c8ed1fbc-f7e7-4e70-9ae8-183469ccdb08'] Jul 23 21:22:57.748315 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-551816f3-21fb-40df-9030-69317f246fbf tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Request method failure captured: Jul 23 21:22:57.748315 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/os-security-groups/0f61276a-4635-4afc-9cc7-7dfc52c098e5 HTTP/1.1 Jul 23 21:22:57.748315 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:22:57.748315 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:22:57.748315 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:22:57.748315 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:22:57.748315 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:22:57.748315 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:22:57.748315 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:22:57.748315 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:22:57.748315 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GabcedAy4zvEWDBz4psoyymQjd20otmwoBk14VBCrO5T_u930hsqstuKWfxSIIHSaoINyY7aouwTaS_UH5MldJcqSCrcSo-BYQbnUPzf2q6ne_dSigo_8PievK59Q_5ElGzDVdSYredgO26R1rdGGAuE9yewD0hcCJzYqqhzyGW3Zk Jul 23 21:22:57.748315 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:22:57.748315 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:22:57.748315 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:22:57.748315 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:22:57.748315 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:22:57.748315 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:22:57.748315 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 55cfd65431cf4b878ab1c0e25a0ac629 Jul 23 21:22:57.748315 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-SecurityGroupsTestJSON-553336269 Jul 23 21:22:57.748315 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:22:57.748315 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:22:57.748315 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/55cfd65431cf4b878ab1c0e25a0ac629"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/55cfd65431cf4b878ab1c0e25a0ac629"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_55cfd65431cf4b878ab1c0e25a0ac629", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/55cfd65431cf4b878ab1c0e25a0ac629"}]}] Jul 23 21:22:57.748315 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-SecurityGroupsTestJSON-553336269 Jul 23 21:22:57.748315 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 55cfd65431cf4b878ab1c0e25a0ac629 Jul 23 21:22:57.748315 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-553336269 Jul 23 21:22:57.748315 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-SecurityGroupsTestJSON-553336269-project Jul 23 21:22:57.748315 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:22:57.748315 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:22:57.748315 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 63ca7a39a8174a4b97767245e80b2bf7 Jul 23 21:22:57.748315 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-SecurityGroupsTestJSON-553336269-project Jul 23 21:22:57.748315 ncdv-master-1 devstack@n-api.service[131321]: method: Jul 23 21:22:57.748315 ncdv-master-1 devstack@n-api.service[131321]: exception: Security group 0f61276a-4635-4afc-9cc7-7dfc52c098e5 does not exist Jul 23 21:22:57.748315 ncdv-master-1 devstack@n-api.service[131321]: Neutron server returns request_ids: ['req-c8ed1fbc-f7e7-4e70-9ae8-183469ccdb08'] Jul 23 21:22:57.748315 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': '0f61276a-4635-4afc-9cc7-7dfc52c098e5'} Jul 23 21:22:57.748315 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:22:57.748315 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:22:57.748315 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 23 21:22:57.748315 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 23 21:22:57.748315 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:22:57.748315 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:22:57.748315 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 23 21:22:57.748315 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 23 21:22:57.748315 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:22:57.748315 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:22:57.748315 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 23 21:22:57.748315 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 23 21:22:57.748315 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:22:57.748315 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:22:57.748315 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 23 21:22:57.748315 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 23 21:22:57.748315 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:22:57.748315 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:22:57.748315 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 23 21:22:57.748315 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 23 21:22:57.748315 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:22:57.748315 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:22:57.748315 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 23 21:22:57.748315 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 23 21:22:57.748315 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 23 21:22:57.748315 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 23 21:22:57.748315 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 0f61276a-4635-4afc-9cc7-7dfc52c098e5 does not exist Jul 23 21:22:57.751616 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c8ed1fbc-f7e7-4e70-9ae8-183469ccdb08'] Jul 23 21:22:57.751616 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:22:57.751616 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:22:57.751616 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:22:57.751616 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:22:57.751616 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 23 21:22:57.751616 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 23 21:22:57.751616 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 23 21:22:57.751616 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 23 21:22:57.751616 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 0f61276a-4635-4afc-9cc7-7dfc52c098e5 does not exist Jul 23 21:22:57.751616 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c8ed1fbc-f7e7-4e70-9ae8-183469ccdb08'] Jul 23 21:22:57.751616 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:22:57.751616 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:22:57.751616 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:22:57.751616 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:22:57.751616 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:22:57.751616 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:22:57.751616 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:22:57.751616 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:22:57.751616 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:22:57.751616 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:22:57.751616 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:22:57.751616 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:22:57.751616 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 23 21:22:57.751616 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 23 21:22:57.751616 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 0f61276a-4635-4afc-9cc7-7dfc52c098e5 does not exist Jul 23 21:22:57.751616 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c8ed1fbc-f7e7-4e70-9ae8-183469ccdb08'] Jul 23 21:22:57.751616 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:22:57.751616 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:22:57.751616 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:22:57.751616 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:22:57.751616 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:22:57.751616 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:22:57.751616 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:22:57.751616 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:22:57.751616 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 0f61276a-4635-4afc-9cc7-7dfc52c098e5 does not exist Jul 23 21:22:57.751616 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c8ed1fbc-f7e7-4e70-9ae8-183469ccdb08'] Jul 23 21:22:57.751616 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:22:57.755550 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-551816f3-21fb-40df-9030-69317f246fbf tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Returning 404 to user: Security group 0f61276a-4635-4afc-9cc7-7dfc52c098e5 does not exist Jul 23 21:22:57.755550 ncdv-master-1 devstack@n-api.service[131321]: Neutron server returns request_ids: ['req-c8ed1fbc-f7e7-4e70-9ae8-183469ccdb08'] {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:22:57.756710 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-551816f3-21fb-40df-9030-69317f246fbf tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] 10.222.0.17 "GET /compute/v2.1/os-security-groups/0f61276a-4635-4afc-9cc7-7dfc52c098e5" status: 404 len: 194 microversion: 2.1 time: 0.067037 Jul 23 21:22:57.757477 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1150/2268] 10.222.0.17 () {58 vars in 1268 bytes} [Sat Jul 23 21:22:57 2022] GET /compute/v2.1/os-security-groups/0f61276a-4635-4afc-9cc7-7dfc52c098e5 => generated 194 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 23 21:22:57.766937 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d74d3b2f-3392-4cde-9bfb-897466f0e831 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Action: 'create', calling method: .version_select at 0x7f0b542c5ca0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1680038876", "description": "tempest-description-1192379240"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:22:57.976696 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-d74d3b2f-3392-4cde-9bfb-897466f0e831 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.213333 Jul 23 21:22:57.982797 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1151/2269] 10.222.0.17 () {60 vars in 1179 bytes} [Sat Jul 23 21:22:57 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:22:57.992222 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ed98dad3-89ca-4556-a3c4-99fb66bf905c tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Action: 'create', calling method: .version_select at 0x7f0b5460e790>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1951966151", "description": "tempest-description-1553547343"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:22:58.078402 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6d150eeb-3c08-45c5-b549-2747d361e97b tempest-SecurityGroupRulesTestJSON-841550850 tempest-SecurityGroupRulesTestJSON-841550850-project] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.398810 Jul 23 21:22:58.080771 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1119/2270] 10.222.0.17 () {60 vars in 1179 bytes} [Sat Jul 23 21:22:57 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:22:58.088738 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-667bdaf4-ef50-409b-bc7a-692aac8951ba tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:58.089950 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-667bdaf4-ef50-409b-bc7a-692aac8951ba tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] [instance: cef13563-7f83-4281-a26c-d5e420c41daf] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:58.099829 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-667bdaf4-ef50-409b-bc7a-692aac8951ba tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:58.100678 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-667bdaf4-ef50-409b-bc7a-692aac8951ba tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:58.101989 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-667bdaf4-ef50-409b-bc7a-692aac8951ba tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:58.102658 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-667bdaf4-ef50-409b-bc7a-692aac8951ba tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:58.173127 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-ed98dad3-89ca-4556-a3c4-99fb66bf905c tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.185785 Jul 23 21:22:58.173783 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1152/2271] 10.222.0.17 () {60 vars in 1179 bytes} [Sat Jul 23 21:22:57 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:22:58.180150 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-006e4385-90cd-460b-9142-1e5c84de0fcc tempest-SecurityGroupRulesTestJSON-841550850 tempest-SecurityGroupRulesTestJSON-841550850-project] Action: 'create', calling method: .version_select at 0x7f0b47fac8b0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1261783234", "description": "tempest-description-432080913"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:22:58.347897 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-006e4385-90cd-460b-9142-1e5c84de0fcc tempest-SecurityGroupRulesTestJSON-841550850 tempest-SecurityGroupRulesTestJSON-841550850-project] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.172126 Jul 23 21:22:58.348742 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1153/2272] 10.222.0.17 () {60 vars in 1179 bytes} [Sat Jul 23 21:22:58 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:22:58.350403 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-667bdaf4-ef50-409b-bc7a-692aac8951ba tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf93a4b80cb4e19a36473986950fc75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c1943188684b45b636541caf587247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:58.363102 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c0b35c86-a30b-45ad-8f5c-c3968fe661d3 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Calling method '.version_select at 0x7f0b59b28700>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:58.379925 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-667bdaf4-ef50-409b-bc7a-692aac8951ba tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] 10.222.0.17 "GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf" status: 200 len: 1473 microversion: 2.1 time: 0.294930 Jul 23 21:22:58.380715 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1120/2273] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:58 2022] GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf => generated 1473 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:58.387580 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4389f775-789e-4e77-b009-0f4b78e9c0c3 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Action: 'create', calling method: .version_select at 0x7f0b59901550>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-638171896", "description": "tempest-description-1920013607"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:22:58.409489 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-c0b35c86-a30b-45ad-8f5c-c3968fe661d3 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] 10.222.0.17 "GET /compute/v2.1/images/d899d6d5-3173-446f-9605-a7e38cdde92c" status: 200 len: 1423 microversion: 2.1 time: 0.053469 Jul 23 21:22:58.410412 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1154/2274] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:22:58 2022] GET /compute/v2.1/images/d899d6d5-3173-446f-9605-a7e38cdde92c => generated 1423 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:58.422094 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-204ee72a-8a80-4c17-95cd-fcc3cbcc554a tempest-SecurityGroupRulesTestJSON-841550850 tempest-SecurityGroupRulesTestJSON-841550850-project] Action: 'create', calling method: .version_select at 0x7f0b47facd30>, body: {"security_group_rule": {"parent_group_id": "ff92d97b-f026-476c-b631-59faa49cb047", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "7699af9b-a123-4b8a-b47a-104a5f2da42d"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:22:58.785896 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-204ee72a-8a80-4c17-95cd-fcc3cbcc554a tempest-SecurityGroupRulesTestJSON-841550850 tempest-SecurityGroupRulesTestJSON-841550850-project] 10.222.0.17 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.370508 Jul 23 21:22:58.786613 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1155/2275] 10.222.0.17 () {60 vars in 1194 bytes} [Sat Jul 23 21:22:58 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:22:58.799381 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d2afed3e-90de-426e-bea3-d94cd538b7af tempest-SecurityGroupRulesTestJSON-841550850 tempest-SecurityGroupRulesTestJSON-841550850-project] Calling method '.version_select at 0x7f0b47f1d430>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:58.832197 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4389f775-789e-4e77-b009-0f4b78e9c0c3 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.450077 Jul 23 21:22:58.832759 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1121/2276] 10.222.0.17 () {60 vars in 1179 bytes} [Sat Jul 23 21:22:58 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:22:58.843792 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-74008f0e-ae10-4d85-8053-949c33eb0ca8 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Calling method '.version_select at 0x7f0b5990f430>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:59.128372 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-d2afed3e-90de-426e-bea3-d94cd538b7af tempest-SecurityGroupRulesTestJSON-841550850 tempest-SecurityGroupRulesTestJSON-841550850-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/7699af9b-a123-4b8a-b47a-104a5f2da42d" status: 202 len: 0 microversion: 2.1 time: 0.334003 Jul 23 21:22:59.129031 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1156/2277] 10.222.0.17 () {58 vars in 1271 bytes} [Sat Jul 23 21:22:58 2022] DELETE /compute/v2.1/os-security-groups/7699af9b-a123-4b8a-b47a-104a5f2da42d => generated 0 bytes in 337 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 23 21:22:59.138144 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a2af7985-7a04-4ca5-a242-5fa44cf36c32 tempest-SecurityGroupRulesTestJSON-841550850 tempest-SecurityGroupRulesTestJSON-841550850-project] Calling method '.version_select at 0x7f0b47f2e0d0>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:59.233003 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-a2af7985-7a04-4ca5-a242-5fa44cf36c32 tempest-SecurityGroupRulesTestJSON-841550850 tempest-SecurityGroupRulesTestJSON-841550850-project] 10.222.0.17 "GET /compute/v2.1/os-security-groups/ff92d97b-f026-476c-b631-59faa49cb047" status: 200 len: 248 microversion: 2.1 time: 0.099500 Jul 23 21:22:59.234075 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1157/2278] 10.222.0.17 () {58 vars in 1268 bytes} [Sat Jul 23 21:22:59 2022] GET /compute/v2.1/os-security-groups/ff92d97b-f026-476c-b631-59faa49cb047 => generated 248 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:22:59.248217 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-462354c0-c9d0-44c1-a143-2fa7cb9ac526 tempest-SecurityGroupRulesTestJSON-841550850 tempest-SecurityGroupRulesTestJSON-841550850-project] Action: 'create', calling method: .version_select at 0x7f0b47e6a820>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1127442581", "description": "tempest-description-1284682758"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:22:59.265452 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-74008f0e-ae10-4d85-8053-949c33eb0ca8 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] 10.222.0.17 "GET /compute/v2.1/os-security-groups" status: 200 len: 1835 microversion: 2.1 time: 0.425462 Jul 23 21:22:59.266092 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1122/2279] 10.222.0.17 () {58 vars in 1157 bytes} [Sat Jul 23 21:22:58 2022] GET /compute/v2.1/os-security-groups => generated 1835 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:22:59.280653 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-48aa024f-ad9f-4126-b3b9-f812d30256bc tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Calling method '.version_select at 0x7f0b4767cf70>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:59.542002 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-462354c0-c9d0-44c1-a143-2fa7cb9ac526 tempest-SecurityGroupRulesTestJSON-841550850 tempest-SecurityGroupRulesTestJSON-841550850-project] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.298852 Jul 23 21:22:59.549542 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1158/2280] 10.222.0.17 () {60 vars in 1179 bytes} [Sat Jul 23 21:22:59 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:22:59.560073 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-40559f2d-6259-4160-ba16-335b7f61c737 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:59.562855 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-40559f2d-6259-4160-ba16-335b7f61c737 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] [instance: cef13563-7f83-4281-a26c-d5e420c41daf] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:22:59.572609 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-40559f2d-6259-4160-ba16-335b7f61c737 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:59.573295 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-40559f2d-6259-4160-ba16-335b7f61c737 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:59.574383 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-40559f2d-6259-4160-ba16-335b7f61c737 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:22:59.575150 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-40559f2d-6259-4160-ba16-335b7f61c737 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:22:59.810996 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-40559f2d-6259-4160-ba16-335b7f61c737 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf93a4b80cb4e19a36473986950fc75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c1943188684b45b636541caf587247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:22:59.820830 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-40559f2d-6259-4160-ba16-335b7f61c737 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] 10.222.0.17 "GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf" status: 200 len: 1473 microversion: 2.1 time: 0.267923 Jul 23 21:22:59.821760 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1159/2281] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:22:59 2022] GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf => generated 1473 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:59.836411 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-735949a2-afd2-4e54-ae83-dd75f5a951de tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Calling method '.version_select at 0x7f0b47de3b80>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:22:59.899482 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-735949a2-afd2-4e54-ae83-dd75f5a951de tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] 10.222.0.17 "GET /compute/v2.1/images/d899d6d5-3173-446f-9605-a7e38cdde92c" status: 200 len: 1423 microversion: 2.1 time: 0.067035 Jul 23 21:22:59.900271 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1160/2282] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:22:59 2022] GET /compute/v2.1/images/d899d6d5-3173-446f-9605-a7e38cdde92c => generated 1423 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:22:59.907614 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-fa4e8fbc-2a45-4a2d-b9c2-83fffefdbbcc tempest-SecurityGroupRulesTestJSON-841550850 tempest-SecurityGroupRulesTestJSON-841550850-project] Action: 'create', calling method: .version_select at 0x7f0b568e1790>, body: {"security_group_rule": {"parent_group_id": "d36ed8cc-b6a7-4e78-ad82-f8df8cc64080", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:23:00.015514 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-48aa024f-ad9f-4126-b3b9-f812d30256bc tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/c90a9b12-6e49-4196-a98f-7fa245c3f86f" status: 202 len: 0 microversion: 2.1 time: 0.734178 Jul 23 21:23:00.020151 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1123/2283] 10.222.0.17 () {58 vars in 1271 bytes} [Sat Jul 23 21:22:59 2022] DELETE /compute/v2.1/os-security-groups/c90a9b12-6e49-4196-a98f-7fa245c3f86f => generated 0 bytes in 746 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:23:00.037897 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-070c9e34-1672-4960-bac1-b2833d0d68c5 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Calling method '.version_select at 0x7f0b5990faf0>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:00.145640 ncdv-master-1 devstack@n-api.service[131320]: DEBUG neutronclient.v2_0.client [None req-070c9e34-1672-4960-bac1-b2833d0d68c5 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c90a9b12-6e49-4196-a98f-7fa245c3f86f does not exist", "detail": ""}} {{(pid=131320) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 23 21:23:00.146544 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.security_group_api [None req-070c9e34-1672-4960-bac1-b2833d0d68c5 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Neutron security group c90a9b12-6e49-4196-a98f-7fa245c3f86f not found {{(pid=131320) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 23 21:23:00.147274 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-070c9e34-1672-4960-bac1-b2833d0d68c5 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] HTTP exception thrown: Security group c90a9b12-6e49-4196-a98f-7fa245c3f86f does not exist Jul 23 21:23:00.147274 ncdv-master-1 devstack@n-api.service[131320]: Neutron server returns request_ids: ['req-0a5f31eb-3a6a-4321-9c32-7e8812222b84'] Jul 23 21:23:00.151328 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-070c9e34-1672-4960-bac1-b2833d0d68c5 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Request method failure captured: Jul 23 21:23:00.151328 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/os-security-groups/c90a9b12-6e49-4196-a98f-7fa245c3f86f HTTP/1.1 Jul 23 21:23:00.151328 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:23:00.151328 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:23:00.151328 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:23:00.151328 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:23:00.151328 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:23:00.151328 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:23:00.151328 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:23:00.151328 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:23:00.151328 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GabcedAy4zvEWDBz4psoyymQjd20otmwoBk14VBCrO5T_u930hsqstuKWfxSIIHSaoINyY7aouwTaS_UH5MldJcqSCrcSo-BYQbnUPzf2q6ne_dSigo_8PievK59Q_5ElGzDVdSYredgO26R1rdGGAuE9yewD0hcCJzYqqhzyGW3Zk Jul 23 21:23:00.151328 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:23:00.151328 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:23:00.151328 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:23:00.151328 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:23:00.151328 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:23:00.151328 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:23:00.151328 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 55cfd65431cf4b878ab1c0e25a0ac629 Jul 23 21:23:00.151328 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-SecurityGroupsTestJSON-553336269 Jul 23 21:23:00.151328 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:23:00.151328 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:23:00.151328 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/55cfd65431cf4b878ab1c0e25a0ac629"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/55cfd65431cf4b878ab1c0e25a0ac629"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_55cfd65431cf4b878ab1c0e25a0ac629", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/55cfd65431cf4b878ab1c0e25a0ac629"}]}] Jul 23 21:23:00.151328 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-SecurityGroupsTestJSON-553336269 Jul 23 21:23:00.151328 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 55cfd65431cf4b878ab1c0e25a0ac629 Jul 23 21:23:00.151328 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-553336269 Jul 23 21:23:00.151328 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-SecurityGroupsTestJSON-553336269-project Jul 23 21:23:00.151328 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:23:00.151328 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:23:00.151328 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 63ca7a39a8174a4b97767245e80b2bf7 Jul 23 21:23:00.151328 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-SecurityGroupsTestJSON-553336269-project Jul 23 21:23:00.151328 ncdv-master-1 devstack@n-api.service[131320]: method: Jul 23 21:23:00.151328 ncdv-master-1 devstack@n-api.service[131320]: exception: Security group c90a9b12-6e49-4196-a98f-7fa245c3f86f does not exist Jul 23 21:23:00.151328 ncdv-master-1 devstack@n-api.service[131320]: Neutron server returns request_ids: ['req-0a5f31eb-3a6a-4321-9c32-7e8812222b84'] Jul 23 21:23:00.151328 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': 'c90a9b12-6e49-4196-a98f-7fa245c3f86f'} Jul 23 21:23:00.151328 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:23:00.151328 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:23:00.151328 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 23 21:23:00.151328 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 23 21:23:00.151328 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:23:00.151328 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:23:00.151328 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 23 21:23:00.151328 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 23 21:23:00.151328 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:23:00.151328 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:23:00.151328 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 23 21:23:00.151328 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 23 21:23:00.151328 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:23:00.151328 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:23:00.151328 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 23 21:23:00.151328 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 23 21:23:00.151328 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:23:00.151328 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:23:00.151328 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 23 21:23:00.151328 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 23 21:23:00.151328 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:23:00.151328 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:23:00.151328 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 23 21:23:00.151328 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 23 21:23:00.151328 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 23 21:23:00.151328 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 23 21:23:00.151328 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c90a9b12-6e49-4196-a98f-7fa245c3f86f does not exist Jul 23 21:23:00.155782 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0a5f31eb-3a6a-4321-9c32-7e8812222b84'] Jul 23 21:23:00.155782 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:23:00.155782 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:23:00.155782 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:23:00.155782 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:23:00.155782 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 23 21:23:00.155782 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 23 21:23:00.155782 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 23 21:23:00.155782 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 23 21:23:00.155782 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c90a9b12-6e49-4196-a98f-7fa245c3f86f does not exist Jul 23 21:23:00.155782 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0a5f31eb-3a6a-4321-9c32-7e8812222b84'] Jul 23 21:23:00.155782 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:23:00.155782 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:23:00.155782 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:23:00.155782 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:23:00.155782 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:23:00.155782 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:23:00.155782 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:23:00.155782 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:23:00.155782 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:23:00.155782 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:23:00.155782 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:23:00.155782 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:23:00.155782 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 23 21:23:00.155782 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 23 21:23:00.155782 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c90a9b12-6e49-4196-a98f-7fa245c3f86f does not exist Jul 23 21:23:00.155782 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0a5f31eb-3a6a-4321-9c32-7e8812222b84'] Jul 23 21:23:00.155782 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:23:00.155782 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:23:00.155782 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:23:00.155782 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:23:00.155782 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:23:00.155782 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:23:00.155782 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:23:00.155782 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:23:00.155782 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c90a9b12-6e49-4196-a98f-7fa245c3f86f does not exist Jul 23 21:23:00.155782 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0a5f31eb-3a6a-4321-9c32-7e8812222b84'] Jul 23 21:23:00.155782 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:23:00.159830 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-070c9e34-1672-4960-bac1-b2833d0d68c5 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Returning 404 to user: Security group c90a9b12-6e49-4196-a98f-7fa245c3f86f does not exist Jul 23 21:23:00.159830 ncdv-master-1 devstack@n-api.service[131320]: Neutron server returns request_ids: ['req-0a5f31eb-3a6a-4321-9c32-7e8812222b84'] {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:23:00.160995 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-070c9e34-1672-4960-bac1-b2833d0d68c5 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] 10.222.0.17 "GET /compute/v2.1/os-security-groups/c90a9b12-6e49-4196-a98f-7fa245c3f86f" status: 404 len: 194 microversion: 2.1 time: 0.137096 Jul 23 21:23:00.163308 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1124/2284] 10.222.0.17 () {58 vars in 1268 bytes} [Sat Jul 23 21:23:00 2022] GET /compute/v2.1/os-security-groups/c90a9b12-6e49-4196-a98f-7fa245c3f86f => generated 194 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:23:00.183761 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-525abf0b-72fe-4191-9fd9-922c486fb4ca tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Calling method '.version_select at 0x7f0b598d3c10>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:00.293463 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-fa4e8fbc-2a45-4a2d-b9c2-83fffefdbbcc tempest-SecurityGroupRulesTestJSON-841550850 tempest-SecurityGroupRulesTestJSON-841550850-project] 10.222.0.17 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.391304 Jul 23 21:23:00.294449 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1161/2285] 10.222.0.17 () {60 vars in 1194 bytes} [Sat Jul 23 21:22:59 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:23:00.305916 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-df8e2442-1422-4c32-9f81-5c533de83a16 tempest-SecurityGroupRulesTestJSON-841550850 tempest-SecurityGroupRulesTestJSON-841550850-project] Action: 'create', calling method: .version_select at 0x7f0b5460e790>, body: {"security_group_rule": {"parent_group_id": "d36ed8cc-b6a7-4e78-ad82-f8df8cc64080", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:23:00.717104 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-df8e2442-1422-4c32-9f81-5c533de83a16 tempest-SecurityGroupRulesTestJSON-841550850 tempest-SecurityGroupRulesTestJSON-841550850-project] 10.222.0.17 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.415559 Jul 23 21:23:00.718344 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1162/2286] 10.222.0.17 () {60 vars in 1194 bytes} [Sat Jul 23 21:23:00 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:23:00.728564 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-de31d0d5-3706-4930-9c78-d02a7bc69d1c tempest-SecurityGroupRulesTestJSON-841550850 tempest-SecurityGroupRulesTestJSON-841550850-project] Calling method '.version_select at 0x7f0b47fdc700>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:00.854976 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-de31d0d5-3706-4930-9c78-d02a7bc69d1c tempest-SecurityGroupRulesTestJSON-841550850 tempest-SecurityGroupRulesTestJSON-841550850-project] 10.222.0.17 "GET /compute/v2.1/os-security-groups/d36ed8cc-b6a7-4e78-ad82-f8df8cc64080" status: 200 len: 665 microversion: 2.1 time: 0.130318 Jul 23 21:23:00.855988 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1163/2287] 10.222.0.17 () {58 vars in 1268 bytes} [Sat Jul 23 21:23:00 2022] GET /compute/v2.1/os-security-groups/d36ed8cc-b6a7-4e78-ad82-f8df8cc64080 => generated 665 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:23:00.866029 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ff81ef45-e982-49ca-8a12-0dad23ee66ca tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:00.866661 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-ff81ef45-e982-49ca-8a12-0dad23ee66ca tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] [instance: cef13563-7f83-4281-a26c-d5e420c41daf] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:00.882029 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ff81ef45-e982-49ca-8a12-0dad23ee66ca tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:00.882394 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ff81ef45-e982-49ca-8a12-0dad23ee66ca tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:00.883383 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ff81ef45-e982-49ca-8a12-0dad23ee66ca tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:00.883990 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ff81ef45-e982-49ca-8a12-0dad23ee66ca tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:01.065831 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ff81ef45-e982-49ca-8a12-0dad23ee66ca tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf93a4b80cb4e19a36473986950fc75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c1943188684b45b636541caf587247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:23:01.074908 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-ff81ef45-e982-49ca-8a12-0dad23ee66ca tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] 10.222.0.17 "GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf" status: 200 len: 1473 microversion: 2.1 time: 0.217690 Jul 23 21:23:01.075863 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1164/2288] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:00 2022] GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf => generated 1473 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:01.081215 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-3fc9d2f4-890b-4718-8578-af27a2c86e4d tempest-SecurityGroupRulesTestJSON-841550850 tempest-SecurityGroupRulesTestJSON-841550850-project] Calling method '.version_select at 0x7f0b47e6a940>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:01.187653 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-525abf0b-72fe-4191-9fd9-922c486fb4ca tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/076aae80-8291-4292-8530-e3bc0faeb66f" status: 202 len: 0 microversion: 2.1 time: 1.017166 Jul 23 21:23:01.193439 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1125/2289] 10.222.0.17 () {58 vars in 1271 bytes} [Sat Jul 23 21:23:00 2022] DELETE /compute/v2.1/os-security-groups/076aae80-8291-4292-8530-e3bc0faeb66f => generated 0 bytes in 1023 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:23:01.198515 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-36dff3b5-8699-449e-98a9-bcd84e33b538 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Calling method '.version_select at 0x7f0b5990f8b0>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:01.274319 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-36dff3b5-8699-449e-98a9-bcd84e33b538 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] 10.222.0.17 "GET /compute/v2.1/images/d899d6d5-3173-446f-9605-a7e38cdde92c" status: 200 len: 1423 microversion: 2.1 time: 0.079137 Jul 23 21:23:01.283689 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1126/2290] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:23:01 2022] GET /compute/v2.1/images/d899d6d5-3173-446f-9605-a7e38cdde92c => generated 1423 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:01.291987 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0b0f1043-a106-4235-a044-b1699efe33c4 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Calling method '.version_select at 0x7f0b47d4d0d0>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:01.338233 ncdv-master-1 devstack@n-api.service[131320]: DEBUG neutronclient.v2_0.client [None req-0b0f1043-a106-4235-a044-b1699efe33c4 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 076aae80-8291-4292-8530-e3bc0faeb66f does not exist", "detail": ""}} {{(pid=131320) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 23 21:23:01.338907 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.security_group_api [None req-0b0f1043-a106-4235-a044-b1699efe33c4 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Neutron security group 076aae80-8291-4292-8530-e3bc0faeb66f not found {{(pid=131320) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 23 21:23:01.339686 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-0b0f1043-a106-4235-a044-b1699efe33c4 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] HTTP exception thrown: Security group 076aae80-8291-4292-8530-e3bc0faeb66f does not exist Jul 23 21:23:01.339686 ncdv-master-1 devstack@n-api.service[131320]: Neutron server returns request_ids: ['req-ba632286-4d2a-4d65-85e6-ff984186a5bc'] Jul 23 21:23:01.342552 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0b0f1043-a106-4235-a044-b1699efe33c4 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Request method failure captured: Jul 23 21:23:01.342552 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/os-security-groups/076aae80-8291-4292-8530-e3bc0faeb66f HTTP/1.1 Jul 23 21:23:01.342552 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:23:01.342552 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:23:01.342552 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:23:01.342552 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:23:01.342552 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:23:01.342552 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:23:01.342552 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:23:01.342552 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:23:01.342552 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GabcedAy4zvEWDBz4psoyymQjd20otmwoBk14VBCrO5T_u930hsqstuKWfxSIIHSaoINyY7aouwTaS_UH5MldJcqSCrcSo-BYQbnUPzf2q6ne_dSigo_8PievK59Q_5ElGzDVdSYredgO26R1rdGGAuE9yewD0hcCJzYqqhzyGW3Zk Jul 23 21:23:01.342552 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:23:01.342552 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:23:01.342552 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:23:01.342552 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:23:01.342552 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:23:01.342552 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:23:01.342552 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 55cfd65431cf4b878ab1c0e25a0ac629 Jul 23 21:23:01.342552 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-SecurityGroupsTestJSON-553336269 Jul 23 21:23:01.342552 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:23:01.342552 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:23:01.342552 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/55cfd65431cf4b878ab1c0e25a0ac629"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/55cfd65431cf4b878ab1c0e25a0ac629"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_55cfd65431cf4b878ab1c0e25a0ac629", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/55cfd65431cf4b878ab1c0e25a0ac629"}]}] Jul 23 21:23:01.342552 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-SecurityGroupsTestJSON-553336269 Jul 23 21:23:01.342552 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 55cfd65431cf4b878ab1c0e25a0ac629 Jul 23 21:23:01.342552 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-553336269 Jul 23 21:23:01.342552 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-SecurityGroupsTestJSON-553336269-project Jul 23 21:23:01.342552 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:23:01.342552 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:23:01.342552 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 63ca7a39a8174a4b97767245e80b2bf7 Jul 23 21:23:01.342552 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-SecurityGroupsTestJSON-553336269-project Jul 23 21:23:01.342552 ncdv-master-1 devstack@n-api.service[131320]: method: Jul 23 21:23:01.342552 ncdv-master-1 devstack@n-api.service[131320]: exception: Security group 076aae80-8291-4292-8530-e3bc0faeb66f does not exist Jul 23 21:23:01.342552 ncdv-master-1 devstack@n-api.service[131320]: Neutron server returns request_ids: ['req-ba632286-4d2a-4d65-85e6-ff984186a5bc'] Jul 23 21:23:01.342552 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '076aae80-8291-4292-8530-e3bc0faeb66f'} Jul 23 21:23:01.342552 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:23:01.342552 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:23:01.342552 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 23 21:23:01.342552 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 23 21:23:01.342552 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:23:01.342552 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:23:01.342552 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 23 21:23:01.342552 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 23 21:23:01.342552 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:23:01.342552 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:23:01.342552 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 23 21:23:01.342552 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 23 21:23:01.342552 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:23:01.342552 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:23:01.342552 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 23 21:23:01.342552 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 23 21:23:01.342552 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:23:01.342552 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:23:01.342552 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 23 21:23:01.342552 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 23 21:23:01.342552 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:23:01.342552 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:23:01.342552 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 23 21:23:01.342552 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 23 21:23:01.342552 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 23 21:23:01.342552 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 23 21:23:01.342552 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 076aae80-8291-4292-8530-e3bc0faeb66f does not exist Jul 23 21:23:01.346697 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ba632286-4d2a-4d65-85e6-ff984186a5bc'] Jul 23 21:23:01.346697 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:23:01.346697 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:23:01.346697 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:23:01.346697 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:23:01.346697 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 23 21:23:01.346697 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 23 21:23:01.346697 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 23 21:23:01.346697 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 23 21:23:01.346697 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 076aae80-8291-4292-8530-e3bc0faeb66f does not exist Jul 23 21:23:01.346697 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ba632286-4d2a-4d65-85e6-ff984186a5bc'] Jul 23 21:23:01.346697 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:23:01.346697 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:23:01.346697 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:23:01.346697 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:23:01.346697 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:23:01.346697 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:23:01.346697 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:23:01.346697 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:23:01.346697 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:23:01.346697 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:23:01.346697 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:23:01.346697 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:23:01.346697 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 23 21:23:01.346697 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 23 21:23:01.346697 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 076aae80-8291-4292-8530-e3bc0faeb66f does not exist Jul 23 21:23:01.346697 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ba632286-4d2a-4d65-85e6-ff984186a5bc'] Jul 23 21:23:01.346697 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:23:01.346697 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:23:01.346697 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:23:01.346697 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:23:01.346697 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:23:01.346697 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:23:01.346697 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:23:01.346697 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:23:01.346697 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 076aae80-8291-4292-8530-e3bc0faeb66f does not exist Jul 23 21:23:01.346697 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ba632286-4d2a-4d65-85e6-ff984186a5bc'] Jul 23 21:23:01.346697 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:23:01.352576 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-3fc9d2f4-890b-4718-8578-af27a2c86e4d tempest-SecurityGroupRulesTestJSON-841550850 tempest-SecurityGroupRulesTestJSON-841550850-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-group-rules/b6052f2d-627e-4c89-81ed-4a103d392f0a" status: 202 len: 0 microversion: 2.1 time: 0.275415 Jul 23 21:23:01.354152 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1165/2291] 10.222.0.17 () {58 vars in 1286 bytes} [Sat Jul 23 21:23:01 2022] DELETE /compute/v2.1/os-security-group-rules/b6052f2d-627e-4c89-81ed-4a103d392f0a => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:23:01.363243 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0b0f1043-a106-4235-a044-b1699efe33c4 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Returning 404 to user: Security group 076aae80-8291-4292-8530-e3bc0faeb66f does not exist Jul 23 21:23:01.363243 ncdv-master-1 devstack@n-api.service[131320]: Neutron server returns request_ids: ['req-ba632286-4d2a-4d65-85e6-ff984186a5bc'] {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:23:01.366272 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-0b0f1043-a106-4235-a044-b1699efe33c4 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] 10.222.0.17 "GET /compute/v2.1/os-security-groups/076aae80-8291-4292-8530-e3bc0faeb66f" status: 404 len: 194 microversion: 2.1 time: 0.080535 Jul 23 21:23:01.368394 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f6a70912-340f-4ce7-9ad7-6aa03a756aa6 tempest-SecurityGroupRulesTestJSON-841550850 tempest-SecurityGroupRulesTestJSON-841550850-project] Calling method '.version_select at 0x7f0b47f2eca0>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:01.368665 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1127/2292] 10.222.0.17 () {58 vars in 1268 bytes} [Sat Jul 23 21:23:01 2022] GET /compute/v2.1/os-security-groups/076aae80-8291-4292-8530-e3bc0faeb66f => generated 194 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:23:01.380094 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c826b326-b872-46f7-9fac-2b6a90c59ae0 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Calling method '.version_select at 0x7f0b47772040>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:01.634431 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-f6a70912-340f-4ce7-9ad7-6aa03a756aa6 tempest-SecurityGroupRulesTestJSON-841550850 tempest-SecurityGroupRulesTestJSON-841550850-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/d36ed8cc-b6a7-4e78-ad82-f8df8cc64080" status: 202 len: 0 microversion: 2.1 time: 0.273708 Jul 23 21:23:01.635437 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1166/2293] 10.222.0.17 () {58 vars in 1271 bytes} [Sat Jul 23 21:23:01 2022] DELETE /compute/v2.1/os-security-groups/d36ed8cc-b6a7-4e78-ad82-f8df8cc64080 => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:23:01.645320 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a3ce4d0d-ea50-4040-a5f5-585bd360fbea tempest-SecurityGroupRulesTestJSON-841550850 tempest-SecurityGroupRulesTestJSON-841550850-project] Calling method '.version_select at 0x7f0b5460e5e0>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:01.756778 ncdv-master-1 devstack@n-api.service[131321]: DEBUG neutronclient.v2_0.client [None req-a3ce4d0d-ea50-4040-a5f5-585bd360fbea tempest-SecurityGroupRulesTestJSON-841550850 tempest-SecurityGroupRulesTestJSON-841550850-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7699af9b-a123-4b8a-b47a-104a5f2da42d does not exist", "detail": ""}} {{(pid=131321) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 23 21:23:01.757609 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.network.security_group_api [None req-a3ce4d0d-ea50-4040-a5f5-585bd360fbea tempest-SecurityGroupRulesTestJSON-841550850 tempest-SecurityGroupRulesTestJSON-841550850-project] Neutron security group 7699af9b-a123-4b8a-b47a-104a5f2da42d not found {{(pid=131321) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 23 21:23:01.758426 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-a3ce4d0d-ea50-4040-a5f5-585bd360fbea tempest-SecurityGroupRulesTestJSON-841550850 tempest-SecurityGroupRulesTestJSON-841550850-project] HTTP exception thrown: Security group 7699af9b-a123-4b8a-b47a-104a5f2da42d does not exist Jul 23 21:23:01.758426 ncdv-master-1 devstack@n-api.service[131321]: Neutron server returns request_ids: ['req-7b554811-02e7-46a9-9a4f-0a445470a979'] Jul 23 21:23:01.760548 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a3ce4d0d-ea50-4040-a5f5-585bd360fbea tempest-SecurityGroupRulesTestJSON-841550850 tempest-SecurityGroupRulesTestJSON-841550850-project] Request method failure captured: Jul 23 21:23:01.760548 ncdv-master-1 devstack@n-api.service[131321]: request: DELETE /compute/v2.1/os-security-groups/7699af9b-a123-4b8a-b47a-104a5f2da42d HTTP/1.1 Jul 23 21:23:01.760548 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:23:01.760548 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:23:01.760548 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:23:01.760548 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:23:01.760548 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:23:01.760548 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:23:01.760548 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:23:01.760548 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:23:01.760548 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3Gat1RUsK8oRxwIOQbJHJezjQDVzbtDndgbkfcSv_yYWpkv7Cr1cW4hKez9THis9YKYCNP1kKosN5f-2rf039f5KdNPjPe-hrSuTh67ZiTf_YRY1IGhre0gE7vw92OqybrhpvmfYiYjZrmGUHnYsdP92F_zDnkpQHR6xOCCIM6N_IZA Jul 23 21:23:01.760548 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:23:01.760548 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:23:01.760548 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:23:01.760548 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:23:01.760548 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:23:01.760548 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:23:01.760548 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 1e5883af23b74caead47ef27b4fbb7bf Jul 23 21:23:01.760548 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-841550850 Jul 23 21:23:01.760548 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:23:01.760548 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:23:01.760548 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1e5883af23b74caead47ef27b4fbb7bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1e5883af23b74caead47ef27b4fbb7bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1e5883af23b74caead47ef27b4fbb7bf", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1e5883af23b74caead47ef27b4fbb7bf"}]}] Jul 23 21:23:01.760548 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-SecurityGroupRulesTestJSON-841550850 Jul 23 21:23:01.760548 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 1e5883af23b74caead47ef27b4fbb7bf Jul 23 21:23:01.760548 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-841550850 Jul 23 21:23:01.760548 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-SecurityGroupRulesTestJSON-841550850-project Jul 23 21:23:01.760548 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:23:01.760548 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:23:01.760548 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 0e6d2a0cb8d14246bb42268a159968f7 Jul 23 21:23:01.760548 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-SecurityGroupRulesTestJSON-841550850-project Jul 23 21:23:01.760548 ncdv-master-1 devstack@n-api.service[131321]: method: Jul 23 21:23:01.760548 ncdv-master-1 devstack@n-api.service[131321]: exception: Security group 7699af9b-a123-4b8a-b47a-104a5f2da42d does not exist Jul 23 21:23:01.760548 ncdv-master-1 devstack@n-api.service[131321]: Neutron server returns request_ids: ['req-7b554811-02e7-46a9-9a4f-0a445470a979'] Jul 23 21:23:01.760548 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': '7699af9b-a123-4b8a-b47a-104a5f2da42d'} Jul 23 21:23:01.760548 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:23:01.760548 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:23:01.760548 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 23 21:23:01.760548 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 23 21:23:01.760548 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:23:01.760548 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:23:01.760548 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 23 21:23:01.760548 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 23 21:23:01.760548 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:23:01.760548 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:23:01.760548 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 23 21:23:01.760548 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 23 21:23:01.760548 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:23:01.760548 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:23:01.760548 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 23 21:23:01.760548 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 23 21:23:01.760548 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:23:01.760548 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:23:01.760548 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 23 21:23:01.760548 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 23 21:23:01.760548 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:23:01.760548 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:23:01.760548 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 23 21:23:01.760548 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 23 21:23:01.760548 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 23 21:23:01.760548 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 23 21:23:01.760548 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 7699af9b-a123-4b8a-b47a-104a5f2da42d does not exist Jul 23 21:23:01.764746 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7b554811-02e7-46a9-9a4f-0a445470a979'] Jul 23 21:23:01.764746 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:23:01.764746 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:23:01.764746 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:23:01.764746 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:23:01.764746 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 23 21:23:01.764746 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 23 21:23:01.764746 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 23 21:23:01.764746 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 23 21:23:01.764746 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 7699af9b-a123-4b8a-b47a-104a5f2da42d does not exist Jul 23 21:23:01.764746 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7b554811-02e7-46a9-9a4f-0a445470a979'] Jul 23 21:23:01.764746 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:23:01.764746 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:23:01.764746 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:23:01.764746 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:23:01.764746 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:23:01.764746 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:23:01.764746 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:23:01.764746 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:23:01.764746 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:23:01.764746 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:23:01.764746 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:23:01.764746 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:23:01.764746 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 23 21:23:01.764746 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 23 21:23:01.764746 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 7699af9b-a123-4b8a-b47a-104a5f2da42d does not exist Jul 23 21:23:01.764746 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7b554811-02e7-46a9-9a4f-0a445470a979'] Jul 23 21:23:01.764746 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:23:01.764746 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:23:01.764746 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:23:01.764746 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:23:01.764746 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:23:01.764746 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:23:01.764746 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:23:01.764746 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:23:01.764746 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 7699af9b-a123-4b8a-b47a-104a5f2da42d does not exist Jul 23 21:23:01.764746 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7b554811-02e7-46a9-9a4f-0a445470a979'] Jul 23 21:23:01.764746 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:23:01.768685 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a3ce4d0d-ea50-4040-a5f5-585bd360fbea tempest-SecurityGroupRulesTestJSON-841550850 tempest-SecurityGroupRulesTestJSON-841550850-project] Returning 404 to user: Security group 7699af9b-a123-4b8a-b47a-104a5f2da42d does not exist Jul 23 21:23:01.768685 ncdv-master-1 devstack@n-api.service[131321]: Neutron server returns request_ids: ['req-7b554811-02e7-46a9-9a4f-0a445470a979'] {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:23:01.769943 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-a3ce4d0d-ea50-4040-a5f5-585bd360fbea tempest-SecurityGroupRulesTestJSON-841550850 tempest-SecurityGroupRulesTestJSON-841550850-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/7699af9b-a123-4b8a-b47a-104a5f2da42d" status: 404 len: 194 microversion: 2.1 time: 0.129926 Jul 23 21:23:01.771274 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1167/2294] 10.222.0.17 () {58 vars in 1271 bytes} [Sat Jul 23 21:23:01 2022] DELETE /compute/v2.1/os-security-groups/7699af9b-a123-4b8a-b47a-104a5f2da42d => generated 194 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:23:01.785277 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-df5012f1-2cf7-4b6d-8915-bda07eba1896 tempest-SecurityGroupRulesTestJSON-841550850 tempest-SecurityGroupRulesTestJSON-841550850-project] Calling method '.version_select at 0x7f0b4761a5e0>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:01.805097 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c826b326-b872-46f7-9fac-2b6a90c59ae0 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/3f9d638d-73b6-4e7d-b9bd-68ad9b9598b1" status: 202 len: 0 microversion: 2.1 time: 0.426207 Jul 23 21:23:01.805097 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1128/2295] 10.222.0.17 () {58 vars in 1271 bytes} [Sat Jul 23 21:23:01 2022] DELETE /compute/v2.1/os-security-groups/3f9d638d-73b6-4e7d-b9bd-68ad9b9598b1 => generated 0 bytes in 427 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:23:01.810664 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-27d9f32d-9702-4fbf-849f-1e628597b7e7 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Calling method '.version_select at 0x7f0b47d4d280>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:01.966094 ncdv-master-1 devstack@n-api.service[131320]: DEBUG neutronclient.v2_0.client [None req-27d9f32d-9702-4fbf-849f-1e628597b7e7 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 3f9d638d-73b6-4e7d-b9bd-68ad9b9598b1 does not exist", "detail": ""}} {{(pid=131320) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 23 21:23:01.966957 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.security_group_api [None req-27d9f32d-9702-4fbf-849f-1e628597b7e7 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Neutron security group 3f9d638d-73b6-4e7d-b9bd-68ad9b9598b1 not found {{(pid=131320) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 23 21:23:01.967509 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-27d9f32d-9702-4fbf-849f-1e628597b7e7 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] HTTP exception thrown: Security group 3f9d638d-73b6-4e7d-b9bd-68ad9b9598b1 does not exist Jul 23 21:23:01.967509 ncdv-master-1 devstack@n-api.service[131320]: Neutron server returns request_ids: ['req-af903fe8-4462-471b-9bd9-eba78a206fba'] Jul 23 21:23:01.971577 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-27d9f32d-9702-4fbf-849f-1e628597b7e7 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Request method failure captured: Jul 23 21:23:01.971577 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/os-security-groups/3f9d638d-73b6-4e7d-b9bd-68ad9b9598b1 HTTP/1.1 Jul 23 21:23:01.971577 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:23:01.971577 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:23:01.971577 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:23:01.971577 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:23:01.971577 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:23:01.971577 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:23:01.971577 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:23:01.971577 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:23:01.971577 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GabcedAy4zvEWDBz4psoyymQjd20otmwoBk14VBCrO5T_u930hsqstuKWfxSIIHSaoINyY7aouwTaS_UH5MldJcqSCrcSo-BYQbnUPzf2q6ne_dSigo_8PievK59Q_5ElGzDVdSYredgO26R1rdGGAuE9yewD0hcCJzYqqhzyGW3Zk Jul 23 21:23:01.971577 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:23:01.971577 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:23:01.971577 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:23:01.971577 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:23:01.971577 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:23:01.971577 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:23:01.971577 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 55cfd65431cf4b878ab1c0e25a0ac629 Jul 23 21:23:01.971577 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-SecurityGroupsTestJSON-553336269 Jul 23 21:23:01.971577 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:23:01.971577 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:23:01.971577 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/55cfd65431cf4b878ab1c0e25a0ac629"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/55cfd65431cf4b878ab1c0e25a0ac629"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_55cfd65431cf4b878ab1c0e25a0ac629", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/55cfd65431cf4b878ab1c0e25a0ac629"}]}] Jul 23 21:23:01.971577 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-SecurityGroupsTestJSON-553336269 Jul 23 21:23:01.971577 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 55cfd65431cf4b878ab1c0e25a0ac629 Jul 23 21:23:01.971577 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-553336269 Jul 23 21:23:01.971577 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-SecurityGroupsTestJSON-553336269-project Jul 23 21:23:01.971577 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:23:01.971577 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:23:01.971577 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 63ca7a39a8174a4b97767245e80b2bf7 Jul 23 21:23:01.971577 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-SecurityGroupsTestJSON-553336269-project Jul 23 21:23:01.971577 ncdv-master-1 devstack@n-api.service[131320]: method: Jul 23 21:23:01.971577 ncdv-master-1 devstack@n-api.service[131320]: exception: Security group 3f9d638d-73b6-4e7d-b9bd-68ad9b9598b1 does not exist Jul 23 21:23:01.971577 ncdv-master-1 devstack@n-api.service[131320]: Neutron server returns request_ids: ['req-af903fe8-4462-471b-9bd9-eba78a206fba'] Jul 23 21:23:01.971577 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '3f9d638d-73b6-4e7d-b9bd-68ad9b9598b1'} Jul 23 21:23:01.971577 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:23:01.971577 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:23:01.971577 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 23 21:23:01.971577 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 23 21:23:01.971577 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:23:01.971577 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:23:01.971577 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 23 21:23:01.971577 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 23 21:23:01.971577 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:23:01.971577 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:23:01.971577 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 23 21:23:01.971577 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 23 21:23:01.971577 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:23:01.971577 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:23:01.971577 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 23 21:23:01.971577 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 23 21:23:01.971577 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:23:01.971577 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:23:01.971577 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 23 21:23:01.971577 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 23 21:23:01.971577 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:23:01.971577 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:23:01.971577 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 23 21:23:01.971577 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 23 21:23:01.971577 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 23 21:23:01.971577 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 23 21:23:01.971577 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 3f9d638d-73b6-4e7d-b9bd-68ad9b9598b1 does not exist Jul 23 21:23:01.975764 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-af903fe8-4462-471b-9bd9-eba78a206fba'] Jul 23 21:23:01.975764 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:23:01.975764 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:23:01.975764 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:23:01.975764 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:23:01.975764 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 23 21:23:01.975764 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 23 21:23:01.975764 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 23 21:23:01.975764 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 23 21:23:01.975764 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 3f9d638d-73b6-4e7d-b9bd-68ad9b9598b1 does not exist Jul 23 21:23:01.975764 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-af903fe8-4462-471b-9bd9-eba78a206fba'] Jul 23 21:23:01.975764 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:23:01.975764 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:23:01.975764 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:23:01.975764 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:23:01.975764 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:23:01.975764 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:23:01.975764 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:23:01.975764 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:23:01.975764 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:23:01.975764 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:23:01.975764 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:23:01.975764 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:23:01.975764 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 23 21:23:01.975764 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 23 21:23:01.975764 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 3f9d638d-73b6-4e7d-b9bd-68ad9b9598b1 does not exist Jul 23 21:23:01.975764 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-af903fe8-4462-471b-9bd9-eba78a206fba'] Jul 23 21:23:01.975764 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:23:01.975764 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:23:01.975764 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:23:01.975764 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:23:01.975764 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:23:01.975764 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:23:01.975764 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:23:01.975764 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:23:01.975764 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 3f9d638d-73b6-4e7d-b9bd-68ad9b9598b1 does not exist Jul 23 21:23:01.975764 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-af903fe8-4462-471b-9bd9-eba78a206fba'] Jul 23 21:23:01.975764 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:23:01.975764 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-27d9f32d-9702-4fbf-849f-1e628597b7e7 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Returning 404 to user: Security group 3f9d638d-73b6-4e7d-b9bd-68ad9b9598b1 does not exist Jul 23 21:23:01.975764 ncdv-master-1 devstack@n-api.service[131320]: Neutron server returns request_ids: ['req-af903fe8-4462-471b-9bd9-eba78a206fba'] {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:23:01.975764 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-27d9f32d-9702-4fbf-849f-1e628597b7e7 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] 10.222.0.17 "GET /compute/v2.1/os-security-groups/3f9d638d-73b6-4e7d-b9bd-68ad9b9598b1" status: 404 len: 194 microversion: 2.1 time: 0.166822 Jul 23 21:23:01.975764 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1129/2296] 10.222.0.17 () {58 vars in 1268 bytes} [Sat Jul 23 21:23:01 2022] GET /compute/v2.1/os-security-groups/3f9d638d-73b6-4e7d-b9bd-68ad9b9598b1 => generated 194 bytes in 168 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:23:01.994435 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-17247f3a-ddbc-4365-b146-b7592f2a7626 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Calling method '.version_select at 0x7f0b5990f8b0>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:02.346573 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-df5012f1-2cf7-4b6d-8915-bda07eba1896 tempest-SecurityGroupRulesTestJSON-841550850 tempest-SecurityGroupRulesTestJSON-841550850-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/ff92d97b-f026-476c-b631-59faa49cb047" status: 202 len: 0 microversion: 2.1 time: 0.569994 Jul 23 21:23:02.348844 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1168/2297] 10.222.0.17 () {58 vars in 1271 bytes} [Sat Jul 23 21:23:01 2022] DELETE /compute/v2.1/os-security-groups/ff92d97b-f026-476c-b631-59faa49cb047 => generated 0 bytes in 572 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:23:02.362840 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-8f0aa326-12e1-4895-ae02-890ddf29e206 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:02.364023 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-8f0aa326-12e1-4895-ae02-890ddf29e206 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] [instance: cef13563-7f83-4281-a26c-d5e420c41daf] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:02.375782 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8f0aa326-12e1-4895-ae02-890ddf29e206 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:02.384331 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8f0aa326-12e1-4895-ae02-890ddf29e206 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:02.386073 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8f0aa326-12e1-4895-ae02-890ddf29e206 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:02.386778 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8f0aa326-12e1-4895-ae02-890ddf29e206 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:02.443103 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-17247f3a-ddbc-4365-b146-b7592f2a7626 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] 10.222.0.17 "GET /compute/v2.1/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 0.464710 Jul 23 21:23:02.444591 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1130/2298] 10.222.0.17 () {58 vars in 1157 bytes} [Sat Jul 23 21:23:01 2022] GET /compute/v2.1/os-security-groups => generated 1158 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:02.450611 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-8e2872c7-c1c0-4df1-ab26-b9ace9654db0 req-e7860852-d397-4a74-9fc8-14082afb110d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6929bb48-ae83-4078-8df7-60124c837ea3", "name": "network-vif-plugged", "status": "completed", "tag": "1e3e8f57-3c77-4c90-ad4e-1a9f4efa146d"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:23:02.485437 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-8e2872c7-c1c0-4df1-ab26-b9ace9654db0 req-e7860852-d397-4a74-9fc8-14082afb110d service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:02.485988 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-8e2872c7-c1c0-4df1-ab26-b9ace9654db0 req-e7860852-d397-4a74-9fc8-14082afb110d service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:02.518533 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-8e2872c7-c1c0-4df1-ab26-b9ace9654db0 req-e7860852-d397-4a74-9fc8-14082afb110d service nova] Creating event network-vif-plugged:1e3e8f57-3c77-4c90-ad4e-1a9f4efa146d for instance 6929bb48-ae83-4078-8df7-60124c837ea3 on nch2-master-1 Jul 23 21:23:02.535815 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-8e2872c7-c1c0-4df1-ab26-b9ace9654db0 req-e7860852-d397-4a74-9fc8-14082afb110d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087766 Jul 23 21:23:02.538433 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1131/2299] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:23:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:23:02.554437 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-00660783-e4af-4564-bd78-a94efa509c4c tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Calling method '.version_select at 0x7f0b47f38d30>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:02.639732 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-8f0aa326-12e1-4895-ae02-890ddf29e206 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf93a4b80cb4e19a36473986950fc75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c1943188684b45b636541caf587247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:23:02.656424 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-8f0aa326-12e1-4895-ae02-890ddf29e206 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] 10.222.0.17 "GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf" status: 200 len: 1473 microversion: 2.1 time: 0.306398 Jul 23 21:23:02.661425 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-00660783-e4af-4564-bd78-a94efa509c4c tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] 10.222.0.17 "GET /compute/v2.1/images/d899d6d5-3173-446f-9605-a7e38cdde92c" status: 200 len: 1423 microversion: 2.1 time: 0.102823 Jul 23 21:23:02.661988 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1169/2300] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:02 2022] GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf => generated 1473 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:02.670234 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1132/2301] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:23:02 2022] GET /compute/v2.1/images/d899d6d5-3173-446f-9605-a7e38cdde92c => generated 1423 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:02.678612 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-22a9d108-ec4e-44d1-9e6d-525171e4cd93 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Action: 'create', calling method: .version_select at 0x7f0b47d4dca0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2043306655", "description": "tempest-description-864783038"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:23:02.683164 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ce6a3144-3281-4492-92db-fc5c3e58ca3a tempest-SecurityGroupRulesTestJSON-841550850 tempest-SecurityGroupRulesTestJSON-841550850-project] Calling method '.version_select at 0x7f0b540ebe50>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:02.908174 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-22a9d108-ec4e-44d1-9e6d-525171e4cd93 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.236417 Jul 23 21:23:02.909286 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1133/2302] 10.222.0.17 () {60 vars in 1179 bytes} [Sat Jul 23 21:23:02 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:23:02.933931 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b88687da-d4da-4d17-b5e8-39f88623974e tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Action: 'create', calling method: .version_select at 0x7f0b47772670>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-66294799", "description": "tempest-description-2005782985"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:23:03.175558 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-ce6a3144-3281-4492-92db-fc5c3e58ca3a tempest-SecurityGroupRulesTestJSON-841550850 tempest-SecurityGroupRulesTestJSON-841550850-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/2ec0a1d9-c668-451a-bb11-cd9ce49016a8" status: 202 len: 0 microversion: 2.1 time: 0.509018 Jul 23 21:23:03.176764 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1170/2303] 10.222.0.17 () {58 vars in 1271 bytes} [Sat Jul 23 21:23:02 2022] DELETE /compute/v2.1/os-security-groups/2ec0a1d9-c668-451a-bb11-cd9ce49016a8 => generated 0 bytes in 513 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:23:03.185701 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f276a909-072e-4d77-9ad6-cc3a314d80be tempest-SecurityGroupRulesTestJSON-841550850 tempest-SecurityGroupRulesTestJSON-841550850-project] Calling method '.version_select at 0x7f0b47de3940>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:03.204118 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b88687da-d4da-4d17-b5e8-39f88623974e tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.287919 Jul 23 21:23:03.204892 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1134/2304] 10.222.0.17 () {60 vars in 1179 bytes} [Sat Jul 23 21:23:02 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:23:03.341643 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2dfcf0ba-66a5-4a3f-be3c-4b2afdf9aee7 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1860831639", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "networks": [{"uuid": "caefaca5-3204-4393-accf-e178aadc9c77"}]}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:23:03.349149 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:23:03.423966 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-2dfcf0ba-66a5-4a3f-be3c-4b2afdf9aee7 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] validate_networks() for [('caefaca5-3204-4393-accf-e178aadc9c77', None, None, None, None, None)] {{(pid=131320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:23:03.767557 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-f276a909-072e-4d77-9ad6-cc3a314d80be tempest-SecurityGroupRulesTestJSON-841550850 tempest-SecurityGroupRulesTestJSON-841550850-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/34850527-1319-4ffc-b0ff-48c346a18471" status: 202 len: 0 microversion: 2.1 time: 0.585502 Jul 23 21:23:03.768623 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1171/2305] 10.222.0.17 () {58 vars in 1271 bytes} [Sat Jul 23 21:23:03 2022] DELETE /compute/v2.1/os-security-groups/34850527-1319-4ffc-b0ff-48c346a18471 => generated 0 bytes in 588 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:23:03.774841 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-849279a6-f4ef-4e92-9bdb-32331fa5ce95 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Calling method '.version_select at 0x7f0b5410ddc0>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:03.915327 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-849279a6-f4ef-4e92-9bdb-32331fa5ce95 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] 10.222.0.17 "GET /compute/v2.1/images/d899d6d5-3173-446f-9605-a7e38cdde92c" status: 200 len: 1423 microversion: 2.1 time: 0.145309 Jul 23 21:23:03.915944 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1172/2306] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:23:03 2022] GET /compute/v2.1/images/d899d6d5-3173-446f-9605-a7e38cdde92c => generated 1423 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:03.931617 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-98fe71b3-8ecc-4279-88e8-63cbb87b5f5b tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:03.932253 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-98fe71b3-8ecc-4279-88e8-63cbb87b5f5b tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] [instance: cef13563-7f83-4281-a26c-d5e420c41daf] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:03.962830 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-98fe71b3-8ecc-4279-88e8-63cbb87b5f5b tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:03.963586 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-98fe71b3-8ecc-4279-88e8-63cbb87b5f5b tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:03.964558 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-98fe71b3-8ecc-4279-88e8-63cbb87b5f5b tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:03.965208 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-98fe71b3-8ecc-4279-88e8-63cbb87b5f5b tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:04.104976 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-2dfcf0ba-66a5-4a3f-be3c-4b2afdf9aee7 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:23:04.105603 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-2dfcf0ba-66a5-4a3f-be3c-4b2afdf9aee7 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:23:04.106010 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-2dfcf0ba-66a5-4a3f-be3c-4b2afdf9aee7 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:23:04.106436 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-2dfcf0ba-66a5-4a3f-be3c-4b2afdf9aee7 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:23:04.106855 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-2dfcf0ba-66a5-4a3f-be3c-4b2afdf9aee7 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:23:04.126473 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2dfcf0ba-66a5-4a3f-be3c-4b2afdf9aee7 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:04.126938 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2dfcf0ba-66a5-4a3f-be3c-4b2afdf9aee7 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:04.127770 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2dfcf0ba-66a5-4a3f-be3c-4b2afdf9aee7 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:04.128218 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2dfcf0ba-66a5-4a3f-be3c-4b2afdf9aee7 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:04.163381 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-2dfcf0ba-66a5-4a3f-be3c-4b2afdf9aee7 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Getting quotas for project 55cfd65431cf4b878ab1c0e25a0ac629. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:23:04.182193 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-2dfcf0ba-66a5-4a3f-be3c-4b2afdf9aee7 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Getting quotas for user 63ca7a39a8174a4b97767245e80b2bf7 and project 55cfd65431cf4b878ab1c0e25a0ac629. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:23:04.199030 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-2dfcf0ba-66a5-4a3f-be3c-4b2afdf9aee7 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Going to run 1 instances... {{(pid=131320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:23:04.202488 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-2dfcf0ba-66a5-4a3f-be3c-4b2afdf9aee7 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] [instance: 4ef8cf58-9580-495b-9212-8cb8c837354c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:23:04.263449 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2dfcf0ba-66a5-4a3f-be3c-4b2afdf9aee7 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.925510 Jul 23 21:23:04.270099 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1135/2307] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:23:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 933 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 23 21:23:04.275472 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5c8c4005-e646-43ae-af40-f178aaa31c89 tempest-SecurityGroupRulesTestJSON-841550850 tempest-SecurityGroupRulesTestJSON-841550850-project] Calling method '.version_select at 0x7f0b47b04f70>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:04.314421 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-98fe71b3-8ecc-4279-88e8-63cbb87b5f5b tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf93a4b80cb4e19a36473986950fc75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c1943188684b45b636541caf587247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:23:04.343707 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-98fe71b3-8ecc-4279-88e8-63cbb87b5f5b tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] 10.222.0.17 "GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf" status: 200 len: 1473 microversion: 2.1 time: 0.426632 Jul 23 21:23:04.354056 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1173/2308] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:03 2022] GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf => generated 1473 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:04.368716 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-acad49dc-3d42-4d23-bbb4-6d4e73586803 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:04.373193 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-acad49dc-3d42-4d23-bbb4-6d4e73586803 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] [instance: 4ef8cf58-9580-495b-9212-8cb8c837354c] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:04.512145 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-acad49dc-3d42-4d23-bbb4-6d4e73586803 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ca7a39a8174a4b97767245e80b2bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55cfd65431cf4b878ab1c0e25a0ac629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:23:04.521019 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-acad49dc-3d42-4d23-bbb4-6d4e73586803 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] 10.222.0.17 "GET /compute/v2.1/servers/4ef8cf58-9580-495b-9212-8cb8c837354c" status: 200 len: 1216 microversion: 2.1 time: 0.164306 Jul 23 21:23:04.521781 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1174/2309] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:04 2022] GET /compute/v2.1/servers/4ef8cf58-9580-495b-9212-8cb8c837354c => generated 1216 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:04.691020 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5c8c4005-e646-43ae-af40-f178aaa31c89 tempest-SecurityGroupRulesTestJSON-841550850 tempest-SecurityGroupRulesTestJSON-841550850-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/76c1de84-908e-4b08-b9b6-d3617f4b9625" status: 202 len: 0 microversion: 2.1 time: 0.419126 Jul 23 21:23:04.692331 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1136/2310] 10.222.0.17 () {58 vars in 1271 bytes} [Sat Jul 23 21:23:04 2022] DELETE /compute/v2.1/os-security-groups/76c1de84-908e-4b08-b9b6-d3617f4b9625 => generated 0 bytes in 421 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:23:04.702038 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-0043cd01-812e-4595-a7b9-08248a98e7db tempest-SecurityGroupRulesTestJSON-841550850 tempest-SecurityGroupRulesTestJSON-841550850-project] Calling method '.version_select at 0x7f0b5410d820>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:04.929720 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-bec0010b-86fd-44a8-8290-5ee1741b94c2 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Calling method '.version_select at 0x7f0b47ce89d0>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:05.006404 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-bec0010b-86fd-44a8-8290-5ee1741b94c2 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] 10.222.0.17 "GET /compute/v2.1/images/d899d6d5-3173-446f-9605-a7e38cdde92c" status: 200 len: 1423 microversion: 2.1 time: 0.081249 Jul 23 21:23:05.007683 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1137/2311] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:23:04 2022] GET /compute/v2.1/images/d899d6d5-3173-446f-9605-a7e38cdde92c => generated 1423 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:23:05.276426 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-abad234a-1e1f-49c4-ae6d-a17d78a6d64a tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:05.280693 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-abad234a-1e1f-49c4-ae6d-a17d78a6d64a tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'efc72b47672e46659b1a5ebdfd99224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cd9b8837554b8daf506ca062ec916b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:23:05.284947 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-abad234a-1e1f-49c4-ae6d-a17d78a6d64a tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Searching by: {'deleted': False, 'project_id': '01cd9b8837554b8daf506ca062ec916b'} {{(pid=131320) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 23 21:23:05.320974 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-abad234a-1e1f-49c4-ae6d-a17d78a6d64a tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:05.322403 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-abad234a-1e1f-49c4-ae6d-a17d78a6d64a tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:05.326519 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-abad234a-1e1f-49c4-ae6d-a17d78a6d64a tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:05.326966 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-abad234a-1e1f-49c4-ae6d-a17d78a6d64a tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:05.484372 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.multi_cell_list [None req-abad234a-1e1f-49c4-ae6d-a17d78a6d64a tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131320) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 23 21:23:05.558048 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-abad234a-1e1f-49c4-ae6d-a17d78a6d64a tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] 10.222.0.17 "GET /compute/v2.1/servers" status: 200 len: 339 microversion: 2.1 time: 0.286968 Jul 23 21:23:05.559238 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1138/2312] 10.222.0.17 () {58 vars in 1124 bytes} [Sat Jul 23 21:23:05 2022] GET /compute/v2.1/servers => generated 339 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:23:05.567643 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-24aa865c-f674-427a-bd19-fbe14b9b9f0a tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:05.568538 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-24aa865c-f674-427a-bd19-fbe14b9b9f0a tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] [instance: cef13563-7f83-4281-a26c-d5e420c41daf] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:05.580581 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-24aa865c-f674-427a-bd19-fbe14b9b9f0a tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:05.581286 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-24aa865c-f674-427a-bd19-fbe14b9b9f0a tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:05.582373 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-24aa865c-f674-427a-bd19-fbe14b9b9f0a tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:05.582986 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-24aa865c-f674-427a-bd19-fbe14b9b9f0a tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:05.601079 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-0043cd01-812e-4595-a7b9-08248a98e7db tempest-SecurityGroupRulesTestJSON-841550850 tempest-SecurityGroupRulesTestJSON-841550850-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/750c54c2-d8fd-427e-b1ef-e2e5f48ed8e9" status: 202 len: 0 microversion: 2.1 time: 0.903527 Jul 23 21:23:05.601775 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1175/2313] 10.222.0.17 () {58 vars in 1271 bytes} [Sat Jul 23 21:23:04 2022] DELETE /compute/v2.1/os-security-groups/750c54c2-d8fd-427e-b1ef-e2e5f48ed8e9 => generated 0 bytes in 905 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:23:05.618039 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-9e6d12a1-192f-45f6-83b5-2dc0ccf74daa tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:05.618701 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-9e6d12a1-192f-45f6-83b5-2dc0ccf74daa tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] [instance: 4ef8cf58-9580-495b-9212-8cb8c837354c] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:05.664560 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9e6d12a1-192f-45f6-83b5-2dc0ccf74daa tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:05.667017 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9e6d12a1-192f-45f6-83b5-2dc0ccf74daa tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:05.671047 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9e6d12a1-192f-45f6-83b5-2dc0ccf74daa tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:05.674837 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9e6d12a1-192f-45f6-83b5-2dc0ccf74daa tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:05.869631 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-9e6d12a1-192f-45f6-83b5-2dc0ccf74daa tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ca7a39a8174a4b97767245e80b2bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55cfd65431cf4b878ab1c0e25a0ac629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:23:05.881201 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-9e6d12a1-192f-45f6-83b5-2dc0ccf74daa tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] 10.222.0.17 "GET /compute/v2.1/servers/4ef8cf58-9580-495b-9212-8cb8c837354c" status: 200 len: 1268 microversion: 2.1 time: 0.277495 Jul 23 21:23:05.890732 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1176/2314] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:05 2022] GET /compute/v2.1/servers/4ef8cf58-9580-495b-9212-8cb8c837354c => generated 1268 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:05.914583 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-976e7472-e0b8-47cf-aa71-6c07db870e66 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:05.918484 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-976e7472-e0b8-47cf-aa71-6c07db870e66 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'efc72b47672e46659b1a5ebdfd99224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cd9b8837554b8daf506ca062ec916b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:23:05.938858 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-976e7472-e0b8-47cf-aa71-6c07db870e66 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Searching by: {'deleted': False, 'project_id': '01cd9b8837554b8daf506ca062ec916b'} {{(pid=131321) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 23 21:23:05.953372 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-976e7472-e0b8-47cf-aa71-6c07db870e66 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:05.954150 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-976e7472-e0b8-47cf-aa71-6c07db870e66 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:05.955305 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-976e7472-e0b8-47cf-aa71-6c07db870e66 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:05.955889 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-976e7472-e0b8-47cf-aa71-6c07db870e66 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:06.043686 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.multi_cell_list [None req-976e7472-e0b8-47cf-aa71-6c07db870e66 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131321) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 23 21:23:06.119776 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-976e7472-e0b8-47cf-aa71-6c07db870e66 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc72b47672e46659b1a5ebdfd99224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cd9b8837554b8daf506ca062ec916b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:23:06.128011 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-976e7472-e0b8-47cf-aa71-6c07db870e66 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:06.128739 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-976e7472-e0b8-47cf-aa71-6c07db870e66 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:06.205841 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-24aa865c-f674-427a-bd19-fbe14b9b9f0a tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf93a4b80cb4e19a36473986950fc75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c1943188684b45b636541caf587247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:23:06.218429 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-24aa865c-f674-427a-bd19-fbe14b9b9f0a tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] 10.222.0.17 "GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf" status: 200 len: 1473 microversion: 2.1 time: 0.657705 Jul 23 21:23:06.232707 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1139/2315] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:05 2022] GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf => generated 1473 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:06.250684 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f3df9ce7-a841-442a-afa4-af301542a80d tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Calling method '.version_select at 0x7f0b5990fa60>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:06.373606 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f3df9ce7-a841-442a-afa4-af301542a80d tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] 10.222.0.17 "GET /compute/v2.1/images/d899d6d5-3173-446f-9605-a7e38cdde92c" status: 200 len: 1423 microversion: 2.1 time: 0.136917 Jul 23 21:23:06.375352 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1140/2316] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:23:06 2022] GET /compute/v2.1/images/d899d6d5-3173-446f-9605-a7e38cdde92c => generated 1423 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:06.548393 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-976e7472-e0b8-47cf-aa71-6c07db870e66 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] 10.222.0.17 "GET /compute/v2.1/servers/detail" status: 200 len: 1712 microversion: 2.1 time: 0.656158 Jul 23 21:23:06.549337 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1177/2317] 10.222.0.17 () {58 vars in 1145 bytes} [Sat Jul 23 21:23:05 2022] GET /compute/v2.1/servers/detail => generated 1712 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:06.569194 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0a210d87-a280-439f-be4e-2634f7ede8f2 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:06.600196 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-0a210d87-a280-439f-be4e-2634f7ede8f2 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] 10.222.0.17 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.038055 Jul 23 21:23:06.608489 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1141/2318] 10.222.0.17 () {58 vars in 1136 bytes} [Sat Jul 23 21:23:06 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:23:06.901026 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-23469d48-5ec3-4075-9825-e960fcc9caa3 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:06.902585 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-23469d48-5ec3-4075-9825-e960fcc9caa3 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] [instance: 4ef8cf58-9580-495b-9212-8cb8c837354c] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:06.909992 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-23469d48-5ec3-4075-9825-e960fcc9caa3 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:06.910736 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-23469d48-5ec3-4075-9825-e960fcc9caa3 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:06.911667 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-23469d48-5ec3-4075-9825-e960fcc9caa3 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:06.912256 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-23469d48-5ec3-4075-9825-e960fcc9caa3 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:06.918730 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c27af43d-65f9-433f-8eed-8d45eacd0c1d tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:06.919526 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c27af43d-65f9-433f-8eed-8d45eacd0c1d tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] [instance: 90289981-4474-419e-854a-eb36bbb721f4] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:06.935338 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c27af43d-65f9-433f-8eed-8d45eacd0c1d tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:06.936195 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c27af43d-65f9-433f-8eed-8d45eacd0c1d tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:06.937749 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c27af43d-65f9-433f-8eed-8d45eacd0c1d tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:06.940147 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c27af43d-65f9-433f-8eed-8d45eacd0c1d tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:07.020599 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c27af43d-65f9-433f-8eed-8d45eacd0c1d tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] [instance: 90289981-4474-419e-854a-eb36bbb721f4] Going to try to terminate instance {{(pid=131320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:23:07.061873 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-23469d48-5ec3-4075-9825-e960fcc9caa3 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ca7a39a8174a4b97767245e80b2bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55cfd65431cf4b878ab1c0e25a0ac629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:23:07.075058 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-23469d48-5ec3-4075-9825-e960fcc9caa3 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] 10.222.0.17 "GET /compute/v2.1/servers/4ef8cf58-9580-495b-9212-8cb8c837354c" status: 200 len: 1274 microversion: 2.1 time: 0.180093 Jul 23 21:23:07.077712 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1178/2319] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:06 2022] GET /compute/v2.1/servers/4ef8cf58-9580-495b-9212-8cb8c837354c => generated 1274 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:07.172209 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c27af43d-65f9-433f-8eed-8d45eacd0c1d tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] 10.222.0.17 "DELETE /compute/v2.1/servers/90289981-4474-419e-854a-eb36bbb721f4" status: 204 len: 0 microversion: 2.1 time: 0.257539 Jul 23 21:23:07.173150 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1142/2320] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:23:06 2022] DELETE /compute/v2.1/servers/90289981-4474-419e-854a-eb36bbb721f4 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:23:07.183071 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-4ea5533f-c929-45dc-8440-52bd34b57a0d tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:07.184192 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-4ea5533f-c929-45dc-8440-52bd34b57a0d tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] [instance: 90289981-4474-419e-854a-eb36bbb721f4] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:07.195543 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4ea5533f-c929-45dc-8440-52bd34b57a0d tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:07.196134 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4ea5533f-c929-45dc-8440-52bd34b57a0d tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:07.197115 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4ea5533f-c929-45dc-8440-52bd34b57a0d tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:07.197691 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4ea5533f-c929-45dc-8440-52bd34b57a0d tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:07.240067 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b7ce6687-ede1-42ad-a0b5-a3007107392a tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:07.241051 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b7ce6687-ede1-42ad-a0b5-a3007107392a tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] [instance: cef13563-7f83-4281-a26c-d5e420c41daf] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:07.257906 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b7ce6687-ede1-42ad-a0b5-a3007107392a tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:07.258717 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b7ce6687-ede1-42ad-a0b5-a3007107392a tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:07.259837 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b7ce6687-ede1-42ad-a0b5-a3007107392a tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:07.260608 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b7ce6687-ede1-42ad-a0b5-a3007107392a tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:07.397774 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-4ea5533f-c929-45dc-8440-52bd34b57a0d tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc72b47672e46659b1a5ebdfd99224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cd9b8837554b8daf506ca062ec916b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:23:07.409218 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-4ea5533f-c929-45dc-8440-52bd34b57a0d tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] 10.222.0.17 "GET /compute/v2.1/servers/90289981-4474-419e-854a-eb36bbb721f4" status: 200 len: 1715 microversion: 2.1 time: 0.230523 Jul 23 21:23:07.410201 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1179/2321] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:07 2022] GET /compute/v2.1/servers/90289981-4474-419e-854a-eb36bbb721f4 => generated 1715 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:07.416633 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-1613d6a6-1f40-42aa-a4f9-764debdef37c tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Calling method '.version_select at 0x7f0b542304c0>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:07.476281 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-1613d6a6-1f40-42aa-a4f9-764debdef37c tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] 10.222.0.17 "GET /compute/v2.1/images/d899d6d5-3173-446f-9605-a7e38cdde92c" status: 200 len: 1423 microversion: 2.1 time: 0.064891 Jul 23 21:23:07.483671 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1180/2322] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:23:07 2022] GET /compute/v2.1/images/d899d6d5-3173-446f-9605-a7e38cdde92c => generated 1423 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:08.094415 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-17ff5a24-cc6c-45a3-afc3-129558489d11 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:08.096007 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-17ff5a24-cc6c-45a3-afc3-129558489d11 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] [instance: 4ef8cf58-9580-495b-9212-8cb8c837354c] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:08.117951 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-17ff5a24-cc6c-45a3-afc3-129558489d11 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:08.119115 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-17ff5a24-cc6c-45a3-afc3-129558489d11 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:08.120516 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-17ff5a24-cc6c-45a3-afc3-129558489d11 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:08.121552 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-17ff5a24-cc6c-45a3-afc3-129558489d11 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:08.337376 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b7ce6687-ede1-42ad-a0b5-a3007107392a tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf93a4b80cb4e19a36473986950fc75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c1943188684b45b636541caf587247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:23:08.342292 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-17ff5a24-cc6c-45a3-afc3-129558489d11 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ca7a39a8174a4b97767245e80b2bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55cfd65431cf4b878ab1c0e25a0ac629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:23:08.350790 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b7ce6687-ede1-42ad-a0b5-a3007107392a tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] 10.222.0.17 "GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf" status: 200 len: 1473 microversion: 2.1 time: 1.116403 Jul 23 21:23:08.351323 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1143/2323] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:07 2022] GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf => generated 1473 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:08.365457 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-17ff5a24-cc6c-45a3-afc3-129558489d11 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] 10.222.0.17 "GET /compute/v2.1/servers/4ef8cf58-9580-495b-9212-8cb8c837354c" status: 200 len: 1316 microversion: 2.1 time: 0.276378 Jul 23 21:23:08.366693 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1181/2324] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:08 2022] GET /compute/v2.1/servers/4ef8cf58-9580-495b-9212-8cb8c837354c => generated 1316 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:23:08.428448 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b6747999-6eae-491d-9d85-09f9f28579a4 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:08.429261 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b6747999-6eae-491d-9d85-09f9f28579a4 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] [instance: 90289981-4474-419e-854a-eb36bbb721f4] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:08.436524 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b6747999-6eae-491d-9d85-09f9f28579a4 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:08.453097 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b6747999-6eae-491d-9d85-09f9f28579a4 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:08.454210 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b6747999-6eae-491d-9d85-09f9f28579a4 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:08.455916 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b6747999-6eae-491d-9d85-09f9f28579a4 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:08.492295 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-4b7be884-8c0e-4bef-9799-53645cc88ab9 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Calling method '.version_select at 0x7f0b544a78b0>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:08.568495 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-4b7be884-8c0e-4bef-9799-53645cc88ab9 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] 10.222.0.17 "GET /compute/v2.1/images/d899d6d5-3173-446f-9605-a7e38cdde92c" status: 200 len: 1423 microversion: 2.1 time: 0.082722 Jul 23 21:23:08.575302 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1182/2325] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:23:08 2022] GET /compute/v2.1/images/d899d6d5-3173-446f-9605-a7e38cdde92c => generated 1423 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:23:08.779410 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b6747999-6eae-491d-9d85-09f9f28579a4 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc72b47672e46659b1a5ebdfd99224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cd9b8837554b8daf506ca062ec916b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:23:08.792907 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b6747999-6eae-491d-9d85-09f9f28579a4 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] 10.222.0.17 "GET /compute/v2.1/servers/90289981-4474-419e-854a-eb36bbb721f4" status: 200 len: 1715 microversion: 2.1 time: 0.368531 Jul 23 21:23:08.800992 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1144/2326] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:08 2022] GET /compute/v2.1/servers/90289981-4474-419e-854a-eb36bbb721f4 => generated 1715 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:09.370439 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-89684311-77ff-4d11-b8f9-a7f3edffce82 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:09.371544 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-89684311-77ff-4d11-b8f9-a7f3edffce82 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] [instance: cef13563-7f83-4281-a26c-d5e420c41daf] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:09.386245 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-08ac7a45-5b4d-44da-bfb9-17b644e3200c tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:09.389147 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-08ac7a45-5b4d-44da-bfb9-17b644e3200c tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] [instance: 4ef8cf58-9580-495b-9212-8cb8c837354c] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:09.391993 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-89684311-77ff-4d11-b8f9-a7f3edffce82 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:09.395697 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-89684311-77ff-4d11-b8f9-a7f3edffce82 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:09.397636 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-89684311-77ff-4d11-b8f9-a7f3edffce82 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:09.399707 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-89684311-77ff-4d11-b8f9-a7f3edffce82 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:09.411207 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-08ac7a45-5b4d-44da-bfb9-17b644e3200c tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:09.411519 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-08ac7a45-5b4d-44da-bfb9-17b644e3200c tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:09.412685 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-08ac7a45-5b4d-44da-bfb9-17b644e3200c tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:09.413313 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-08ac7a45-5b4d-44da-bfb9-17b644e3200c tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:09.888199 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-89684311-77ff-4d11-b8f9-a7f3edffce82 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf93a4b80cb4e19a36473986950fc75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c1943188684b45b636541caf587247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:23:09.901125 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-89684311-77ff-4d11-b8f9-a7f3edffce82 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] 10.222.0.17 "GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf" status: 200 len: 1473 microversion: 2.1 time: 0.534899 Jul 23 21:23:09.901505 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1183/2327] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:09 2022] GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf => generated 1473 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:09.908234 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-874820ee-b684-484c-8d57-d37f33354d48 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Calling method '.version_select at 0x7f0b542c5040>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:10.003090 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-874820ee-b684-484c-8d57-d37f33354d48 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] 10.222.0.17 "GET /compute/v2.1/images/d899d6d5-3173-446f-9605-a7e38cdde92c" status: 200 len: 1423 microversion: 2.1 time: 0.100352 Jul 23 21:23:10.003819 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1184/2328] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:23:09 2022] GET /compute/v2.1/images/d899d6d5-3173-446f-9605-a7e38cdde92c => generated 1423 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:10.017650 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-0e3c191e-2731-4284-a203-16b3882f89d6 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:10.018320 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-0e3c191e-2731-4284-a203-16b3882f89d6 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] [instance: 90289981-4474-419e-854a-eb36bbb721f4] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:10.049547 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0e3c191e-2731-4284-a203-16b3882f89d6 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:10.050041 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0e3c191e-2731-4284-a203-16b3882f89d6 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:10.051013 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0e3c191e-2731-4284-a203-16b3882f89d6 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:10.051466 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0e3c191e-2731-4284-a203-16b3882f89d6 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:10.308852 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-0e3c191e-2731-4284-a203-16b3882f89d6 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc72b47672e46659b1a5ebdfd99224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cd9b8837554b8daf506ca062ec916b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:23:10.324270 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=100 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:23:10.341087 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-0e3c191e-2731-4284-a203-16b3882f89d6 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] 10.222.0.17 "GET /compute/v2.1/servers/90289981-4474-419e-854a-eb36bbb721f4" status: 200 len: 1647 microversion: 2.1 time: 0.335819 Jul 23 21:23:10.346495 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1185/2329] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:10 2022] GET /compute/v2.1/servers/90289981-4474-419e-854a-eb36bbb721f4 => generated 1647 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:10.507667 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-08ac7a45-5b4d-44da-bfb9-17b644e3200c tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ca7a39a8174a4b97767245e80b2bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55cfd65431cf4b878ab1c0e25a0ac629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:23:10.526411 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-08ac7a45-5b4d-44da-bfb9-17b644e3200c tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] 10.222.0.17 "GET /compute/v2.1/servers/4ef8cf58-9580-495b-9212-8cb8c837354c" status: 200 len: 1316 microversion: 2.1 time: 1.144133 Jul 23 21:23:10.528407 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1145/2330] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:09 2022] GET /compute/v2.1/servers/4ef8cf58-9580-495b-9212-8cb8c837354c => generated 1316 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:10.919173 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-0348eed0-5870-4a72-b5d2-57f99297ed62 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:10.919799 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-0348eed0-5870-4a72-b5d2-57f99297ed62 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] [instance: cef13563-7f83-4281-a26c-d5e420c41daf] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:10.932858 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0348eed0-5870-4a72-b5d2-57f99297ed62 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:10.933406 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0348eed0-5870-4a72-b5d2-57f99297ed62 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:10.934240 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0348eed0-5870-4a72-b5d2-57f99297ed62 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:10.934686 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0348eed0-5870-4a72-b5d2-57f99297ed62 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:11.016927 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c7f94804-c91f-410d-909d-4f27a467eb2b tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Calling method '.version_select at 0x7f0b598dc700>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:11.142189 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c7f94804-c91f-410d-909d-4f27a467eb2b tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] 10.222.0.17 "GET /compute/v2.1/images/d899d6d5-3173-446f-9605-a7e38cdde92c" status: 200 len: 1423 microversion: 2.1 time: 0.129117 Jul 23 21:23:11.142728 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1146/2331] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:23:11 2022] GET /compute/v2.1/images/d899d6d5-3173-446f-9605-a7e38cdde92c => generated 1423 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:11.362595 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-722bb51c-9500-4ec9-9738-2777b9116235 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:11.363288 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-722bb51c-9500-4ec9-9738-2777b9116235 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] [instance: 90289981-4474-419e-854a-eb36bbb721f4] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:11.381414 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-722bb51c-9500-4ec9-9738-2777b9116235 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:11.381797 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-722bb51c-9500-4ec9-9738-2777b9116235 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:11.382631 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-722bb51c-9500-4ec9-9738-2777b9116235 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:11.383072 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-722bb51c-9500-4ec9-9738-2777b9116235 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:11.491517 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-0348eed0-5870-4a72-b5d2-57f99297ed62 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf93a4b80cb4e19a36473986950fc75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c1943188684b45b636541caf587247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:23:11.502174 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-0348eed0-5870-4a72-b5d2-57f99297ed62 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] 10.222.0.17 "GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf" status: 200 len: 1473 microversion: 2.1 time: 0.587273 Jul 23 21:23:11.515924 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1186/2332] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:10 2022] GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf => generated 1473 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:11.547768 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-bc787966-3a32-4cdd-9108-f4a6e9c627ad tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:11.548890 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-bc787966-3a32-4cdd-9108-f4a6e9c627ad tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] [instance: 4ef8cf58-9580-495b-9212-8cb8c837354c] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:11.564625 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-722bb51c-9500-4ec9-9738-2777b9116235 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc72b47672e46659b1a5ebdfd99224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cd9b8837554b8daf506ca062ec916b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:23:11.568728 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bc787966-3a32-4cdd-9108-f4a6e9c627ad tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:11.569539 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bc787966-3a32-4cdd-9108-f4a6e9c627ad tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:11.574068 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bc787966-3a32-4cdd-9108-f4a6e9c627ad tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:11.575387 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bc787966-3a32-4cdd-9108-f4a6e9c627ad tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:11.595002 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-722bb51c-9500-4ec9-9738-2777b9116235 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] 10.222.0.17 "GET /compute/v2.1/servers/90289981-4474-419e-854a-eb36bbb721f4" status: 200 len: 1647 microversion: 2.1 time: 0.223264 Jul 23 21:23:11.606139 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1147/2333] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:11 2022] GET /compute/v2.1/servers/90289981-4474-419e-854a-eb36bbb721f4 => generated 1647 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:23:11.954893 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-a3968d9b-948f-4eda-8711-38447dcf168f req-d1bd90d9-c2af-455d-bfa7-67b7f784c9cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90289981-4474-419e-854a-eb36bbb721f4", "name": "network-vif-deleted", "tag": "713d4ed6-d82d-4876-a416-2b294c9cd4bd"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:23:11.979845 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-a3968d9b-948f-4eda-8711-38447dcf168f req-d1bd90d9-c2af-455d-bfa7-67b7f784c9cd service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:11.980610 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-a3968d9b-948f-4eda-8711-38447dcf168f req-d1bd90d9-c2af-455d-bfa7-67b7f784c9cd service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:12.026040 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-a3968d9b-948f-4eda-8711-38447dcf168f req-d1bd90d9-c2af-455d-bfa7-67b7f784c9cd service nova] Creating event network-vif-deleted:713d4ed6-d82d-4876-a416-2b294c9cd4bd for instance 90289981-4474-419e-854a-eb36bbb721f4 on nch1-master-1 Jul 23 21:23:12.040280 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-a3968d9b-948f-4eda-8711-38447dcf168f req-d1bd90d9-c2af-455d-bfa7-67b7f784c9cd service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089393 Jul 23 21:23:12.049472 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1148/2334] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:23:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:23:12.155616 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2a36eea3-e162-4b75-b5ae-883db163cfd6 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Calling method '.version_select at 0x7f0b599d83a0>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:12.263717 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2a36eea3-e162-4b75-b5ae-883db163cfd6 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] 10.222.0.17 "GET /compute/v2.1/images/d899d6d5-3173-446f-9605-a7e38cdde92c" status: 200 len: 1423 microversion: 2.1 time: 0.112127 Jul 23 21:23:12.264603 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1149/2335] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:23:12 2022] GET /compute/v2.1/images/d899d6d5-3173-446f-9605-a7e38cdde92c => generated 1423 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:12.394101 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-7c76d581-8478-4931-a234-7be2b92ee85c req-6a1ce177-a81f-4701-ab1a-937b2cd7dc0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ef8cf58-9580-495b-9212-8cb8c837354c", "tag": "f3b1c335-5a3b-4dfb-922c-b66dcb9104fd"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:23:12.428572 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-7c76d581-8478-4931-a234-7be2b92ee85c req-6a1ce177-a81f-4701-ab1a-937b2cd7dc0e service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:12.444274 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-7c76d581-8478-4931-a234-7be2b92ee85c req-6a1ce177-a81f-4701-ab1a-937b2cd7dc0e service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:12.480693 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-7c76d581-8478-4931-a234-7be2b92ee85c req-6a1ce177-a81f-4701-ab1a-937b2cd7dc0e service nova] Creating event network-changed:f3b1c335-5a3b-4dfb-922c-b66dcb9104fd for instance 4ef8cf58-9580-495b-9212-8cb8c837354c on nch1-master-1 Jul 23 21:23:12.497281 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-7c76d581-8478-4931-a234-7be2b92ee85c req-6a1ce177-a81f-4701-ab1a-937b2cd7dc0e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109664 Jul 23 21:23:12.500284 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1150/2336] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:23:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:23:12.533243 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8e114806-a65e-4698-b40c-c937762c4770 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:12.534301 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8e114806-a65e-4698-b40c-c937762c4770 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] [instance: cef13563-7f83-4281-a26c-d5e420c41daf] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:12.535197 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-bc787966-3a32-4cdd-9108-f4a6e9c627ad tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ca7a39a8174a4b97767245e80b2bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55cfd65431cf4b878ab1c0e25a0ac629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:23:12.551281 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-bc787966-3a32-4cdd-9108-f4a6e9c627ad tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] 10.222.0.17 "GET /compute/v2.1/servers/4ef8cf58-9580-495b-9212-8cb8c837354c" status: 200 len: 1316 microversion: 2.1 time: 1.006979 Jul 23 21:23:12.553679 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8e114806-a65e-4698-b40c-c937762c4770 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:12.554515 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8e114806-a65e-4698-b40c-c937762c4770 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:12.555792 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1187/2337] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:11 2022] GET /compute/v2.1/servers/4ef8cf58-9580-495b-9212-8cb8c837354c => generated 1316 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:23:12.559708 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8e114806-a65e-4698-b40c-c937762c4770 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:12.561922 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8e114806-a65e-4698-b40c-c937762c4770 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:12.613996 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-61277e5f-33df-443f-ac44-49036919b56e tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:12.614793 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-61277e5f-33df-443f-ac44-49036919b56e tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] [instance: 90289981-4474-419e-854a-eb36bbb721f4] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:12.625715 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-61277e5f-33df-443f-ac44-49036919b56e tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:12.628598 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-61277e5f-33df-443f-ac44-49036919b56e tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:12.629704 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-61277e5f-33df-443f-ac44-49036919b56e tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:12.632585 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-61277e5f-33df-443f-ac44-49036919b56e tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:12.747029 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-61277e5f-33df-443f-ac44-49036919b56e tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:12.749698 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-61277e5f-33df-443f-ac44-49036919b56e tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:12.750370 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.objects.instance [None req-61277e5f-33df-443f-ac44-49036919b56e tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Lazy-loading 'fault' on Instance uuid 90289981-4474-419e-854a-eb36bbb721f4 {{(pid=131321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:23:12.953669 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-61277e5f-33df-443f-ac44-49036919b56e tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc72b47672e46659b1a5ebdfd99224c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cd9b8837554b8daf506ca062ec916b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:23:12.962317 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-61277e5f-33df-443f-ac44-49036919b56e tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] 10.222.0.17 "GET /compute/v2.1/servers/90289981-4474-419e-854a-eb36bbb721f4" status: 200 len: 1366 microversion: 2.1 time: 0.352939 Jul 23 21:23:12.966712 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1188/2338] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:12 2022] GET /compute/v2.1/servers/90289981-4474-419e-854a-eb36bbb721f4 => generated 1366 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:13.286518 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-01ee3bc7-bb6e-46bf-8add-a207e352caf9 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Calling method '.version_select at 0x7f0b542c5ca0>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:13.363222 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-01ee3bc7-bb6e-46bf-8add-a207e352caf9 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] 10.222.0.17 "GET /compute/v2.1/images/d899d6d5-3173-446f-9605-a7e38cdde92c" status: 200 len: 1423 microversion: 2.1 time: 0.088171 Jul 23 21:23:13.366175 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1189/2339] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:23:13 2022] GET /compute/v2.1/images/d899d6d5-3173-446f-9605-a7e38cdde92c => generated 1423 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:13.556914 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-7c004802-97ff-457f-ba20-553ea227faa9 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1351352179", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "networks": [{"uuid": "602d1f35-5f57-4a74-bd2b-80dc8cd4e09e"}, {"uuid": "b7cdcba4-1e19-4b2a-8df5-1b8d93121c44"}, {"uuid": "602d1f35-5f57-4a74-bd2b-80dc8cd4e09e"}]}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:23:13.594100 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8e114806-a65e-4698-b40c-c937762c4770 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf93a4b80cb4e19a36473986950fc75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c1943188684b45b636541caf587247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:23:13.604199 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8e114806-a65e-4698-b40c-c937762c4770 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] 10.222.0.17 "GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf" status: 200 len: 1473 microversion: 2.1 time: 1.075325 Jul 23 21:23:13.615760 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1151/2340] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:12 2022] GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf => generated 1473 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:13.620701 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-74b235ec-9d8c-49d6-a16e-7604f96d823e tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:13.621693 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-74b235ec-9d8c-49d6-a16e-7604f96d823e tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] [instance: 4ef8cf58-9580-495b-9212-8cb8c837354c] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:13.633481 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-74b235ec-9d8c-49d6-a16e-7604f96d823e tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:13.636997 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-74b235ec-9d8c-49d6-a16e-7604f96d823e tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:13.638059 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-74b235ec-9d8c-49d6-a16e-7604f96d823e tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:13.638831 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-74b235ec-9d8c-49d6-a16e-7604f96d823e tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:13.694356 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.network.neutron [None req-7c004802-97ff-457f-ba20-553ea227faa9 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] validate_networks() for [('602d1f35-5f57-4a74-bd2b-80dc8cd4e09e', None, None, None, None, None), ('b7cdcba4-1e19-4b2a-8df5-1b8d93121c44', None, None, None, None, None), ('602d1f35-5f57-4a74-bd2b-80dc8cd4e09e', None, None, None, None, None)] {{(pid=131321) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:23:14.172455 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-74b235ec-9d8c-49d6-a16e-7604f96d823e tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ca7a39a8174a4b97767245e80b2bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55cfd65431cf4b878ab1c0e25a0ac629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:23:14.207044 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-74b235ec-9d8c-49d6-a16e-7604f96d823e tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] 10.222.0.17 "GET /compute/v2.1/servers/4ef8cf58-9580-495b-9212-8cb8c837354c" status: 200 len: 1316 microversion: 2.1 time: 0.589962 Jul 23 21:23:14.222103 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1152/2341] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:13 2022] GET /compute/v2.1/servers/4ef8cf58-9580-495b-9212-8cb8c837354c => generated 1316 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:14.237453 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-94b5f1fa-b1fb-459b-b182-ff5792e9cab9 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:14.240275 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-94b5f1fa-b1fb-459b-b182-ff5792e9cab9 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] [instance: 90289981-4474-419e-854a-eb36bbb721f4] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:14.255743 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=6 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:23:14.269318 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-94b5f1fa-b1fb-459b-b182-ff5792e9cab9 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:14.269777 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-94b5f1fa-b1fb-459b-b182-ff5792e9cab9 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:14.275591 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-94b5f1fa-b1fb-459b-b182-ff5792e9cab9 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:14.276288 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-94b5f1fa-b1fb-459b-b182-ff5792e9cab9 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:14.331209 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-94b5f1fa-b1fb-459b-b182-ff5792e9cab9 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] HTTP exception thrown: Instance 90289981-4474-419e-854a-eb36bbb721f4 could not be found. Jul 23 21:23:14.333682 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-94b5f1fa-b1fb-459b-b182-ff5792e9cab9 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Request method failure captured: Jul 23 21:23:14.333682 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/90289981-4474-419e-854a-eb36bbb721f4 HTTP/1.1 Jul 23 21:23:14.333682 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:23:14.333682 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:23:14.333682 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:23:14.333682 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:23:14.333682 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:23:14.333682 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:23:14.333682 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:23:14.333682 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:23:14.333682 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GZycRULOJAbI3yl71S5odElMSseBa3mZpoR9zSoaxD2exEax_mZd1EjNtDu7s04tPY7Kd3tLHLbE0C63dvN-5x8-YAQSw19NBJbhtASRanwh0_5OXXik3woqwsAoP5CXicfADwzQXsUnNagNehzTkEA3-pXGvD6FBElTjUWV4wUl_s Jul 23 21:23:14.333682 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:23:14.333682 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:23:14.333682 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:23:14.333682 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:23:14.333682 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:23:14.333682 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:23:14.333682 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 01cd9b8837554b8daf506ca062ec916b Jul 23 21:23:14.333682 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServersTestManualDisk-276284736 Jul 23 21:23:14.333682 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:23:14.333682 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:23:14.333682 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/01cd9b8837554b8daf506ca062ec916b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/01cd9b8837554b8daf506ca062ec916b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_01cd9b8837554b8daf506ca062ec916b", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/01cd9b8837554b8daf506ca062ec916b"}]}] Jul 23 21:23:14.333682 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServersTestManualDisk-276284736 Jul 23 21:23:14.333682 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 01cd9b8837554b8daf506ca062ec916b Jul 23 21:23:14.333682 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServersTestManualDisk-276284736 Jul 23 21:23:14.333682 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServersTestManualDisk-276284736-project Jul 23 21:23:14.333682 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:23:14.333682 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:23:14.333682 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: efc72b47672e46659b1a5ebdfd99224c Jul 23 21:23:14.333682 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServersTestManualDisk-276284736-project Jul 23 21:23:14.333682 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:23:14.333682 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance 90289981-4474-419e-854a-eb36bbb721f4 could not be found. Jul 23 21:23:14.333682 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '90289981-4474-419e-854a-eb36bbb721f4'} Jul 23 21:23:14.333682 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:23:14.333682 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:23:14.333682 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:23:14.333682 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:23:14.333682 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:23:14.333682 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:23:14.333682 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:23:14.333682 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:23:14.333682 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:23:14.333682 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:23:14.333682 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90289981-4474-419e-854a-eb36bbb721f4 could not be found. Jul 23 21:23:14.333682 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:23:14.333682 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:23:14.333682 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:23:14.333682 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:23:14.333682 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:23:14.333682 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:23:14.333682 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:23:14.333682 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:23:14.333682 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:23:14.333682 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:23:14.333682 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:23:14.333682 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:23:14.333682 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:23:14.333682 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:23:14.333682 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:23:14.333682 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:23:14.333682 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90289981-4474-419e-854a-eb36bbb721f4 could not be found. Jul 23 21:23:14.333682 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:23:14.333682 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:23:14.333682 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:23:14.337842 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:23:14.337842 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:23:14.337842 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:23:14.337842 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:23:14.337842 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:23:14.337842 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90289981-4474-419e-854a-eb36bbb721f4 could not be found. Jul 23 21:23:14.337842 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:23:14.339720 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-94b5f1fa-b1fb-459b-b182-ff5792e9cab9 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Returning 404 to user: Instance 90289981-4474-419e-854a-eb36bbb721f4 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:23:14.341843 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-94b5f1fa-b1fb-459b-b182-ff5792e9cab9 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] 10.222.0.17 "GET /compute/v2.1/servers/90289981-4474-419e-854a-eb36bbb721f4" status: 404 len: 111 microversion: 2.1 time: 0.124134 Jul 23 21:23:14.347712 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1153/2342] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:14 2022] GET /compute/v2.1/servers/90289981-4474-419e-854a-eb36bbb721f4 => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:23:14.353444 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-de6f2b7a-c3f0-4923-987b-8ede6de51ec0 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] Calling method '.version_select at 0x7f0b47b91790>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:14.396826 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-de6f2b7a-c3f0-4923-987b-8ede6de51ec0 tempest-ServersTestManualDisk-276284736 tempest-ServersTestManualDisk-276284736-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-157589584" status: 202 len: 0 microversion: 2.1 time: 0.047175 Jul 23 21:23:14.398038 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1154/2343] 10.222.0.17 () {58 vars in 1217 bytes} [Sat Jul 23 21:23:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-157589584 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:23:14.408555 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c96fdaf5-8321-4977-9117-5bf67dec4975 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Calling method '.version_select at 0x7f0b4767ca60>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:14.485282 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c96fdaf5-8321-4977-9117-5bf67dec4975 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] 10.222.0.17 "GET /compute/v2.1/images/d899d6d5-3173-446f-9605-a7e38cdde92c" status: 200 len: 1423 microversion: 2.1 time: 0.080965 Jul 23 21:23:14.491461 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1155/2344] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:23:14 2022] GET /compute/v2.1/images/d899d6d5-3173-446f-9605-a7e38cdde92c => generated 1423 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:14.623417 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-379f9933-d2ae-4bf3-805c-e62ff48cba0b tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:14.624064 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-379f9933-d2ae-4bf3-805c-e62ff48cba0b tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] [instance: cef13563-7f83-4281-a26c-d5e420c41daf] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:14.633411 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-379f9933-d2ae-4bf3-805c-e62ff48cba0b tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:14.633910 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-379f9933-d2ae-4bf3-805c-e62ff48cba0b tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:14.634672 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-379f9933-d2ae-4bf3-805c-e62ff48cba0b tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:14.637548 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-379f9933-d2ae-4bf3-805c-e62ff48cba0b tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:14.669994 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:23:15.130269 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-379f9933-d2ae-4bf3-805c-e62ff48cba0b tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf93a4b80cb4e19a36473986950fc75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c1943188684b45b636541caf587247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:23:15.141626 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-379f9933-d2ae-4bf3-805c-e62ff48cba0b tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] 10.222.0.17 "GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf" status: 200 len: 1473 microversion: 2.1 time: 0.523701 Jul 23 21:23:15.143557 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1156/2345] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:14 2022] GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf => generated 1473 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:15.230576 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-65158a11-2449-4cb7-a685-493a63423207 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:15.231318 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-65158a11-2449-4cb7-a685-493a63423207 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] [instance: 4ef8cf58-9580-495b-9212-8cb8c837354c] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:15.245093 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-65158a11-2449-4cb7-a685-493a63423207 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:15.245690 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-65158a11-2449-4cb7-a685-493a63423207 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:15.246964 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-65158a11-2449-4cb7-a685-493a63423207 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:15.247326 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-65158a11-2449-4cb7-a685-493a63423207 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:15.408988 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=4 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:23:15.939435 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-65158a11-2449-4cb7-a685-493a63423207 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ca7a39a8174a4b97767245e80b2bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55cfd65431cf4b878ab1c0e25a0ac629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:23:15.949320 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-65158a11-2449-4cb7-a685-493a63423207 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] 10.222.0.17 "GET /compute/v2.1/servers/4ef8cf58-9580-495b-9212-8cb8c837354c" status: 200 len: 1316 microversion: 2.1 time: 0.723244 Jul 23 21:23:15.951413 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1157/2346] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:15 2022] GET /compute/v2.1/servers/4ef8cf58-9580-495b-9212-8cb8c837354c => generated 1316 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:23:15.967255 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell0:SELECT=2 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:23:15.970430 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f920724b-6b2c-43c0-a6c8-77af19507cf4 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Calling method '.version_select at 0x7f0b47f38d30>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:16.034825 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f920724b-6b2c-43c0-a6c8-77af19507cf4 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] 10.222.0.17 "GET /compute/v2.1/images/d899d6d5-3173-446f-9605-a7e38cdde92c" status: 200 len: 1423 microversion: 2.1 time: 0.079297 Jul 23 21:23:16.036195 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1158/2347] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:23:15 2022] GET /compute/v2.1/images/d899d6d5-3173-446f-9605-a7e38cdde92c => generated 1423 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:16.118561 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell0:SELECT=4 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:23:16.168009 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5a78e591-fc64-44ea-b2f1-8907b8980082 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:16.175436 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5a78e591-fc64-44ea-b2f1-8907b8980082 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] [instance: cef13563-7f83-4281-a26c-d5e420c41daf] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:16.202539 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5a78e591-fc64-44ea-b2f1-8907b8980082 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:16.204023 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5a78e591-fc64-44ea-b2f1-8907b8980082 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:16.205163 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5a78e591-fc64-44ea-b2f1-8907b8980082 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:16.208518 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5a78e591-fc64-44ea-b2f1-8907b8980082 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:16.581905 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5a78e591-fc64-44ea-b2f1-8907b8980082 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf93a4b80cb4e19a36473986950fc75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c1943188684b45b636541caf587247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:23:16.590956 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5a78e591-fc64-44ea-b2f1-8907b8980082 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] 10.222.0.17 "GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf" status: 200 len: 1473 microversion: 2.1 time: 0.434585 Jul 23 21:23:16.600485 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1159/2348] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:16 2022] GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf => generated 1473 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:16.777367 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-7c004802-97ff-457f-ba20-553ea227faa9 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Flavor limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:23:16.783150 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-7c004802-97ff-457f-ba20-553ea227faa9 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Image limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:23:16.785073 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-7c004802-97ff-457f-ba20-553ea227faa9 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Flavor pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:23:16.786345 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-7c004802-97ff-457f-ba20-553ea227faa9 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Image pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:23:16.787505 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-7c004802-97ff-457f-ba20-553ea227faa9 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:23:16.807439 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7c004802-97ff-457f-ba20-553ea227faa9 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:16.811018 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7c004802-97ff-457f-ba20-553ea227faa9 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:16.812766 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7c004802-97ff-457f-ba20-553ea227faa9 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:16.814446 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7c004802-97ff-457f-ba20-553ea227faa9 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:16.864810 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-7c004802-97ff-457f-ba20-553ea227faa9 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Getting quotas for project d3ff73d603ec4069a908452514a59451. Resources: {'ram', 'instances', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:23:16.877175 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-7c004802-97ff-457f-ba20-553ea227faa9 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Getting quotas for user e74c139b38d74d9ab93695471ccd3a2c and project d3ff73d603ec4069a908452514a59451. Resources: {'ram', 'instances', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:23:16.936103 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-7c004802-97ff-457f-ba20-553ea227faa9 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Going to run 1 instances... {{(pid=131321) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:23:16.939985 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-7c004802-97ff-457f-ba20-553ea227faa9 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] [instance: dd8dace4-4427-490e-ad29-73092c943515] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131321) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:23:16.969186 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c75d8188-beb4-4722-9e86-6cdb7cbbd86e tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:16.969824 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c75d8188-beb4-4722-9e86-6cdb7cbbd86e tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] [instance: 4ef8cf58-9580-495b-9212-8cb8c837354c] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:16.985352 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c75d8188-beb4-4722-9e86-6cdb7cbbd86e tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:16.997101 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c75d8188-beb4-4722-9e86-6cdb7cbbd86e tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:17.004756 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c75d8188-beb4-4722-9e86-6cdb7cbbd86e tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:17.007353 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c75d8188-beb4-4722-9e86-6cdb7cbbd86e tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:17.112807 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-7c004802-97ff-457f-ba20-553ea227faa9 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.561853 Jul 23 21:23:17.115525 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1190/2349] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:23:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 3566 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 23 21:23:17.146738 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-59af400b-835c-465e-922e-377b3f38c1ef tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Calling method '.version_select at 0x7f0b47fdc700>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:17.259191 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-59af400b-835c-465e-922e-377b3f38c1ef tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] 10.222.0.17 "GET /compute/v2.1/images/d899d6d5-3173-446f-9605-a7e38cdde92c" status: 200 len: 1423 microversion: 2.1 time: 0.119739 Jul 23 21:23:17.260014 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1191/2350] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:23:17 2022] GET /compute/v2.1/images/d899d6d5-3173-446f-9605-a7e38cdde92c => generated 1423 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:17.278138 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-baceda4e-0533-469d-a402-ae61884b1127 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:17.280354 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-baceda4e-0533-469d-a402-ae61884b1127 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] [instance: dd8dace4-4427-490e-ad29-73092c943515] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:17.423095 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-baceda4e-0533-469d-a402-ae61884b1127 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e74c139b38d74d9ab93695471ccd3a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ff73d603ec4069a908452514a59451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:23:17.435703 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-baceda4e-0533-469d-a402-ae61884b1127 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] 10.222.0.17 "GET /compute/v2.1/servers/dd8dace4-4427-490e-ad29-73092c943515" status: 200 len: 1213 microversion: 2.1 time: 0.168297 Jul 23 21:23:17.439908 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1192/2351] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:17 2022] GET /compute/v2.1/servers/dd8dace4-4427-490e-ad29-73092c943515 => generated 1213 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:17.618588 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ec99ef58-4950-4b5f-96e5-d9f62f086c7b tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:17.619408 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-ec99ef58-4950-4b5f-96e5-d9f62f086c7b tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] [instance: cef13563-7f83-4281-a26c-d5e420c41daf] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:17.642819 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ec99ef58-4950-4b5f-96e5-d9f62f086c7b tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:17.643279 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ec99ef58-4950-4b5f-96e5-d9f62f086c7b tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:17.644084 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ec99ef58-4950-4b5f-96e5-d9f62f086c7b tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:17.644529 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ec99ef58-4950-4b5f-96e5-d9f62f086c7b tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:17.703443 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c75d8188-beb4-4722-9e86-6cdb7cbbd86e tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ca7a39a8174a4b97767245e80b2bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55cfd65431cf4b878ab1c0e25a0ac629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:23:17.717474 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c75d8188-beb4-4722-9e86-6cdb7cbbd86e tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] 10.222.0.17 "GET /compute/v2.1/servers/4ef8cf58-9580-495b-9212-8cb8c837354c" status: 200 len: 1316 microversion: 2.1 time: 0.753661 Jul 23 21:23:17.736043 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1160/2352] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:16 2022] GET /compute/v2.1/servers/4ef8cf58-9580-495b-9212-8cb8c837354c => generated 1316 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:23:18.108607 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ec99ef58-4950-4b5f-96e5-d9f62f086c7b tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf93a4b80cb4e19a36473986950fc75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c1943188684b45b636541caf587247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:23:18.117404 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-ec99ef58-4950-4b5f-96e5-d9f62f086c7b tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] 10.222.0.17 "GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf" status: 200 len: 1479 microversion: 2.1 time: 0.504572 Jul 23 21:23:18.135099 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1193/2353] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:17 2022] GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf => generated 1479 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:23:18.273377 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-46363ab5-3068-475e-af7c-ba973ab0877e tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Calling method '.version_select at 0x7f0b47f38a60>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:18.395851 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-46363ab5-3068-475e-af7c-ba973ab0877e tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] 10.222.0.17 "GET /compute/v2.1/images/d899d6d5-3173-446f-9605-a7e38cdde92c" status: 200 len: 1423 microversion: 2.1 time: 0.126765 Jul 23 21:23:18.396560 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1161/2354] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:23:18 2022] GET /compute/v2.1/images/d899d6d5-3173-446f-9605-a7e38cdde92c => generated 1423 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:18.453666 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-2f79a7a5-37a5-4cb9-bfd3-98b28d7e380e tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:18.454717 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-2f79a7a5-37a5-4cb9-bfd3-98b28d7e380e tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] [instance: dd8dace4-4427-490e-ad29-73092c943515] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:18.471748 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2f79a7a5-37a5-4cb9-bfd3-98b28d7e380e tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:18.473060 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2f79a7a5-37a5-4cb9-bfd3-98b28d7e380e tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:18.475725 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2f79a7a5-37a5-4cb9-bfd3-98b28d7e380e tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:18.476477 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2f79a7a5-37a5-4cb9-bfd3-98b28d7e380e tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:18.678110 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-2f79a7a5-37a5-4cb9-bfd3-98b28d7e380e tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e74c139b38d74d9ab93695471ccd3a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ff73d603ec4069a908452514a59451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:23:18.696525 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-2f79a7a5-37a5-4cb9-bfd3-98b28d7e380e tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] 10.222.0.17 "GET /compute/v2.1/servers/dd8dace4-4427-490e-ad29-73092c943515" status: 200 len: 1265 microversion: 2.1 time: 0.245505 Jul 23 21:23:18.708095 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1194/2355] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:18 2022] GET /compute/v2.1/servers/dd8dace4-4427-490e-ad29-73092c943515 => generated 1265 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:18.741026 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1c84b04f-9cf5-41e4-b015-ad219e00574f tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:18.741822 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1c84b04f-9cf5-41e4-b015-ad219e00574f tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] [instance: 4ef8cf58-9580-495b-9212-8cb8c837354c] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:18.752426 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1c84b04f-9cf5-41e4-b015-ad219e00574f tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:18.756756 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1c84b04f-9cf5-41e4-b015-ad219e00574f tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:18.757956 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1c84b04f-9cf5-41e4-b015-ad219e00574f tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:18.758484 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1c84b04f-9cf5-41e4-b015-ad219e00574f tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:19.136622 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-88875fb6-7b6f-430d-84f2-71bc41fd034f tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:19.140410 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-88875fb6-7b6f-430d-84f2-71bc41fd034f tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] [instance: cef13563-7f83-4281-a26c-d5e420c41daf] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:19.152426 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:23:19.158149 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-88875fb6-7b6f-430d-84f2-71bc41fd034f tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:19.158510 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-88875fb6-7b6f-430d-84f2-71bc41fd034f tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:19.161058 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-88875fb6-7b6f-430d-84f2-71bc41fd034f tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:19.165913 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-88875fb6-7b6f-430d-84f2-71bc41fd034f tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:19.326780 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-1c84b04f-9cf5-41e4-b015-ad219e00574f tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ca7a39a8174a4b97767245e80b2bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55cfd65431cf4b878ab1c0e25a0ac629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:23:19.342932 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1c84b04f-9cf5-41e4-b015-ad219e00574f tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] 10.222.0.17 "GET /compute/v2.1/servers/4ef8cf58-9580-495b-9212-8cb8c837354c" status: 200 len: 1316 microversion: 2.1 time: 0.605957 Jul 23 21:23:19.346502 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1162/2356] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:18 2022] GET /compute/v2.1/servers/4ef8cf58-9580-495b-9212-8cb8c837354c => generated 1316 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:19.409136 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-7e5c0bed-3f05-495b-b8b5-777b6c06cec3 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Calling method '.version_select at 0x7f0b47cac1f0>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:19.473797 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-7e5c0bed-3f05-495b-b8b5-777b6c06cec3 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] 10.222.0.17 "GET /compute/v2.1/images/d899d6d5-3173-446f-9605-a7e38cdde92c" status: 200 len: 1423 microversion: 2.1 time: 0.068980 Jul 23 21:23:19.480848 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1163/2357] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:23:19 2022] GET /compute/v2.1/images/d899d6d5-3173-446f-9605-a7e38cdde92c => generated 1423 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:19.715297 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-391c0cb4-41ab-49d8-b8f2-e3e2a8e37740 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:19.715923 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-391c0cb4-41ab-49d8-b8f2-e3e2a8e37740 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] [instance: dd8dace4-4427-490e-ad29-73092c943515] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:19.727834 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-391c0cb4-41ab-49d8-b8f2-e3e2a8e37740 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:19.728307 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-391c0cb4-41ab-49d8-b8f2-e3e2a8e37740 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:19.729133 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-391c0cb4-41ab-49d8-b8f2-e3e2a8e37740 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:19.730780 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-391c0cb4-41ab-49d8-b8f2-e3e2a8e37740 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:19.851427 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-88875fb6-7b6f-430d-84f2-71bc41fd034f tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf93a4b80cb4e19a36473986950fc75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c1943188684b45b636541caf587247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:23:19.864004 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-88875fb6-7b6f-430d-84f2-71bc41fd034f tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] 10.222.0.17 "GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf" status: 200 len: 1479 microversion: 2.1 time: 0.728128 Jul 23 21:23:19.865763 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1195/2358] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:19 2022] GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf => generated 1479 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:19.907061 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-391c0cb4-41ab-49d8-b8f2-e3e2a8e37740 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e74c139b38d74d9ab93695471ccd3a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ff73d603ec4069a908452514a59451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:23:19.920649 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-391c0cb4-41ab-49d8-b8f2-e3e2a8e37740 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] 10.222.0.17 "GET /compute/v2.1/servers/dd8dace4-4427-490e-ad29-73092c943515" status: 200 len: 1271 microversion: 2.1 time: 0.209883 Jul 23 21:23:19.922049 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1164/2359] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:19 2022] GET /compute/v2.1/servers/dd8dace4-4427-490e-ad29-73092c943515 => generated 1271 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:19.954496 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-8696160a-8f75-42cd-b64f-7dbaa154cce1 req-9ff51421-cace-4d0b-8547-dd67e4f89446 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cef13563-7f83-4281-a26c-d5e420c41daf", "name": "network-vif-unplugged", "status": "completed", "tag": "e6c3948e-9005-4405-9ade-a304ad56f44a"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:23:19.969203 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-8696160a-8f75-42cd-b64f-7dbaa154cce1 req-9ff51421-cace-4d0b-8547-dd67e4f89446 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:19.970424 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-8696160a-8f75-42cd-b64f-7dbaa154cce1 req-9ff51421-cace-4d0b-8547-dd67e4f89446 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:19.999240 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-8696160a-8f75-42cd-b64f-7dbaa154cce1 req-9ff51421-cace-4d0b-8547-dd67e4f89446 service nova] Creating event network-vif-unplugged:e6c3948e-9005-4405-9ade-a304ad56f44a for instance cef13563-7f83-4281-a26c-d5e420c41daf on nch1-master-1 Jul 23 21:23:20.007024 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-8696160a-8f75-42cd-b64f-7dbaa154cce1 req-9ff51421-cace-4d0b-8547-dd67e4f89446 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060878 Jul 23 21:23:20.008871 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1196/2360] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:23:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:23:20.364154 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-dad767be-26b9-4530-b9e7-8a4ef2facd09 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:20.365579 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-dad767be-26b9-4530-b9e7-8a4ef2facd09 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] [instance: 4ef8cf58-9580-495b-9212-8cb8c837354c] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:20.388504 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dad767be-26b9-4530-b9e7-8a4ef2facd09 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:20.393118 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dad767be-26b9-4530-b9e7-8a4ef2facd09 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:20.394364 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dad767be-26b9-4530-b9e7-8a4ef2facd09 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:20.396285 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dad767be-26b9-4530-b9e7-8a4ef2facd09 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:20.489542 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-70f003be-ff8c-4206-adfa-f958bc3a8e07 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Calling method '.version_select at 0x7f0b47e5aca0>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:20.580093 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-70f003be-ff8c-4206-adfa-f958bc3a8e07 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] 10.222.0.17 "GET /compute/v2.1/images/d899d6d5-3173-446f-9605-a7e38cdde92c" status: 200 len: 1423 microversion: 2.1 time: 0.096007 Jul 23 21:23:20.587843 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1197/2361] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:23:20 2022] GET /compute/v2.1/images/d899d6d5-3173-446f-9605-a7e38cdde92c => generated 1423 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:20.884195 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ed96e629-f9bb-417f-ae00-ecf85c3e383e tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:20.884946 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-ed96e629-f9bb-417f-ae00-ecf85c3e383e tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] [instance: cef13563-7f83-4281-a26c-d5e420c41daf] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:20.897472 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ed96e629-f9bb-417f-ae00-ecf85c3e383e tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:20.898240 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ed96e629-f9bb-417f-ae00-ecf85c3e383e tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:20.900026 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ed96e629-f9bb-417f-ae00-ecf85c3e383e tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:20.900691 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ed96e629-f9bb-417f-ae00-ecf85c3e383e tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:21.177638 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ed96e629-f9bb-417f-ae00-ecf85c3e383e tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf93a4b80cb4e19a36473986950fc75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c1943188684b45b636541caf587247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:23:21.196024 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-ed96e629-f9bb-417f-ae00-ecf85c3e383e tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] 10.222.0.17 "GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf" status: 200 len: 1479 microversion: 2.1 time: 0.316726 Jul 23 21:23:21.196811 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1198/2362] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:20 2022] GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf => generated 1479 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:21.209883 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-0e5270cd-56e7-4c7d-a949-80236daa25c3 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:21.210763 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-0e5270cd-56e7-4c7d-a949-80236daa25c3 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] [instance: dd8dace4-4427-490e-ad29-73092c943515] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:21.217764 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0e5270cd-56e7-4c7d-a949-80236daa25c3 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:21.222661 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0e5270cd-56e7-4c7d-a949-80236daa25c3 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:21.223670 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0e5270cd-56e7-4c7d-a949-80236daa25c3 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:21.224271 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0e5270cd-56e7-4c7d-a949-80236daa25c3 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:21.266553 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-dad767be-26b9-4530-b9e7-8a4ef2facd09 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ca7a39a8174a4b97767245e80b2bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55cfd65431cf4b878ab1c0e25a0ac629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:23:21.274833 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-dad767be-26b9-4530-b9e7-8a4ef2facd09 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] 10.222.0.17 "GET /compute/v2.1/servers/4ef8cf58-9580-495b-9212-8cb8c837354c" status: 200 len: 1316 microversion: 2.1 time: 0.915185 Jul 23 21:23:21.275433 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1165/2363] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:20 2022] GET /compute/v2.1/servers/4ef8cf58-9580-495b-9212-8cb8c837354c => generated 1316 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:23:21.594373 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-fe75eef9-a30d-40bb-9bae-1b53df2af1c5 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Calling method '.version_select at 0x7f0b47cc6d30>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:21.671371 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-fe75eef9-a30d-40bb-9bae-1b53df2af1c5 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] 10.222.0.17 "GET /compute/v2.1/images/d899d6d5-3173-446f-9605-a7e38cdde92c" status: 200 len: 1423 microversion: 2.1 time: 0.081126 Jul 23 21:23:21.680520 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1166/2364] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:23:21 2022] GET /compute/v2.1/images/d899d6d5-3173-446f-9605-a7e38cdde92c => generated 1423 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:23:22.071640 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-2117cbfc-44e8-4a98-80d6-11f08668b8d3 req-ddcf4b9f-9d6a-4613-8293-283332ba40e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ef8cf58-9580-495b-9212-8cb8c837354c", "name": "network-vif-plugged", "status": "completed", "tag": "f3b1c335-5a3b-4dfb-922c-b66dcb9104fd"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:23:22.085337 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-2117cbfc-44e8-4a98-80d6-11f08668b8d3 req-ddcf4b9f-9d6a-4613-8293-283332ba40e7 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:22.086423 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-2117cbfc-44e8-4a98-80d6-11f08668b8d3 req-ddcf4b9f-9d6a-4613-8293-283332ba40e7 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:22.100661 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-2117cbfc-44e8-4a98-80d6-11f08668b8d3 req-ddcf4b9f-9d6a-4613-8293-283332ba40e7 service nova] Creating event network-vif-plugged:f3b1c335-5a3b-4dfb-922c-b66dcb9104fd for instance 4ef8cf58-9580-495b-9212-8cb8c837354c on nch1-master-1 Jul 23 21:23:22.106883 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-2117cbfc-44e8-4a98-80d6-11f08668b8d3 req-ddcf4b9f-9d6a-4613-8293-283332ba40e7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042129 Jul 23 21:23:22.107547 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1167/2365] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:23:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:23:22.217438 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b71bd0e3-00de-4add-b626-25e35ecbeeed tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:22.220462 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b71bd0e3-00de-4add-b626-25e35ecbeeed tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] [instance: cef13563-7f83-4281-a26c-d5e420c41daf] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:22.245603 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-0e5270cd-56e7-4c7d-a949-80236daa25c3 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e74c139b38d74d9ab93695471ccd3a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ff73d603ec4069a908452514a59451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:23:22.248915 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b71bd0e3-00de-4add-b626-25e35ecbeeed tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:22.249517 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b71bd0e3-00de-4add-b626-25e35ecbeeed tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:22.261266 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b71bd0e3-00de-4add-b626-25e35ecbeeed tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:22.266092 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b71bd0e3-00de-4add-b626-25e35ecbeeed tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:22.302451 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-0e5270cd-56e7-4c7d-a949-80236daa25c3 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] 10.222.0.17 "GET /compute/v2.1/servers/dd8dace4-4427-490e-ad29-73092c943515" status: 200 len: 1313 microversion: 2.1 time: 1.104242 Jul 23 21:23:22.303636 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1199/2366] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:21 2022] GET /compute/v2.1/servers/dd8dace4-4427-490e-ad29-73092c943515 => generated 1313 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:22.316179 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-5bf1b530-4a66-4c14-8c2b-7c7acc7ffe7e tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:22.317058 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-5bf1b530-4a66-4c14-8c2b-7c7acc7ffe7e tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] [instance: 4ef8cf58-9580-495b-9212-8cb8c837354c] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:22.327104 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5bf1b530-4a66-4c14-8c2b-7c7acc7ffe7e tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:22.327846 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5bf1b530-4a66-4c14-8c2b-7c7acc7ffe7e tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:22.328814 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5bf1b530-4a66-4c14-8c2b-7c7acc7ffe7e tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:22.332681 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5bf1b530-4a66-4c14-8c2b-7c7acc7ffe7e tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:22.843578 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b71bd0e3-00de-4add-b626-25e35ecbeeed tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf93a4b80cb4e19a36473986950fc75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c1943188684b45b636541caf587247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:23:22.856500 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b71bd0e3-00de-4add-b626-25e35ecbeeed tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] 10.222.0.17 "GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf" status: 200 len: 1479 microversion: 2.1 time: 0.645118 Jul 23 21:23:22.858484 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1168/2367] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:22 2022] GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf => generated 1479 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:22.866874 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-87c15253-0cb9-4144-9692-a4eacf0c6732 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Calling method '.version_select at 0x7f0b47cac310>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:22.960626 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-87c15253-0cb9-4144-9692-a4eacf0c6732 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] 10.222.0.17 "GET /compute/v2.1/images/d899d6d5-3173-446f-9605-a7e38cdde92c" status: 200 len: 1423 microversion: 2.1 time: 0.100767 Jul 23 21:23:22.961628 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1169/2368] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:23:22 2022] GET /compute/v2.1/images/d899d6d5-3173-446f-9605-a7e38cdde92c => generated 1423 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:23.134700 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-5bf1b530-4a66-4c14-8c2b-7c7acc7ffe7e tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ca7a39a8174a4b97767245e80b2bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55cfd65431cf4b878ab1c0e25a0ac629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:23:23.142604 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-5bf1b530-4a66-4c14-8c2b-7c7acc7ffe7e tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] 10.222.0.17 "GET /compute/v2.1/servers/4ef8cf58-9580-495b-9212-8cb8c837354c" status: 200 len: 1316 microversion: 2.1 time: 0.837742 Jul 23 21:23:23.143207 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1200/2369] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:22 2022] GET /compute/v2.1/servers/4ef8cf58-9580-495b-9212-8cb8c837354c => generated 1316 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:23.328016 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-98365a9d-a69b-496c-ac43-121399f556c0 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:23.329013 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-98365a9d-a69b-496c-ac43-121399f556c0 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] [instance: dd8dace4-4427-490e-ad29-73092c943515] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:23.349677 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-98365a9d-a69b-496c-ac43-121399f556c0 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:23.355790 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-98365a9d-a69b-496c-ac43-121399f556c0 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:23.356913 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-98365a9d-a69b-496c-ac43-121399f556c0 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:23.360235 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-98365a9d-a69b-496c-ac43-121399f556c0 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:23.880737 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-90d5ad24-45e3-4598-85ce-04b347af4c09 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:23.882414 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-90d5ad24-45e3-4598-85ce-04b347af4c09 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] [instance: cef13563-7f83-4281-a26c-d5e420c41daf] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:23.907582 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-90d5ad24-45e3-4598-85ce-04b347af4c09 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:23.908352 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-90d5ad24-45e3-4598-85ce-04b347af4c09 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:23.925391 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-90d5ad24-45e3-4598-85ce-04b347af4c09 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:23.951166 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-90d5ad24-45e3-4598-85ce-04b347af4c09 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:24.226053 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-90d5ad24-45e3-4598-85ce-04b347af4c09 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf93a4b80cb4e19a36473986950fc75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c1943188684b45b636541caf587247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:23:24.231663 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-98365a9d-a69b-496c-ac43-121399f556c0 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e74c139b38d74d9ab93695471ccd3a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ff73d603ec4069a908452514a59451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:23:24.237028 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-90d5ad24-45e3-4598-85ce-04b347af4c09 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] 10.222.0.17 "GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf" status: 200 len: 1479 microversion: 2.1 time: 0.365187 Jul 23 21:23:24.238549 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1201/2370] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:23 2022] GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf => generated 1479 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:24.241815 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-98365a9d-a69b-496c-ac43-121399f556c0 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] 10.222.0.17 "GET /compute/v2.1/servers/dd8dace4-4427-490e-ad29-73092c943515" status: 200 len: 1334 microversion: 2.1 time: 0.923457 Jul 23 21:23:24.245511 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-94da4b69-b030-4432-b3b8-7760f1464ac6 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Calling method '.version_select at 0x7f0b540eb1f0>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:24.255472 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1170/2371] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:23 2022] GET /compute/v2.1/servers/dd8dace4-4427-490e-ad29-73092c943515 => generated 1334 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:24.260830 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-b1685b2d-47a3-4272-b5ca-83708a8ddc96 req-67bf69fa-3a77-4938-8482-d5e033596d67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cef13563-7f83-4281-a26c-d5e420c41daf", "name": "network-vif-plugged", "status": "completed", "tag": "e6c3948e-9005-4405-9ade-a304ad56f44a"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:23:24.280283 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-b1685b2d-47a3-4272-b5ca-83708a8ddc96 req-67bf69fa-3a77-4938-8482-d5e033596d67 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:24.280740 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-b1685b2d-47a3-4272-b5ca-83708a8ddc96 req-67bf69fa-3a77-4938-8482-d5e033596d67 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:24.304024 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-94da4b69-b030-4432-b3b8-7760f1464ac6 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] 10.222.0.17 "GET /compute/v2.1/images/d899d6d5-3173-446f-9605-a7e38cdde92c" status: 200 len: 1432 microversion: 2.1 time: 0.061021 Jul 23 21:23:24.305901 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1202/2372] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:23:24 2022] GET /compute/v2.1/images/d899d6d5-3173-446f-9605-a7e38cdde92c => generated 1432 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:24.313684 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-552950a3-7f58-4cde-b489-53bc9db9a2f5 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:24.313928 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-b1685b2d-47a3-4272-b5ca-83708a8ddc96 req-67bf69fa-3a77-4938-8482-d5e033596d67 service nova] Creating event network-vif-plugged:e6c3948e-9005-4405-9ade-a304ad56f44a for instance cef13563-7f83-4281-a26c-d5e420c41daf on nch1-master-1 Jul 23 21:23:24.315420 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-552950a3-7f58-4cde-b489-53bc9db9a2f5 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] [instance: 4ef8cf58-9580-495b-9212-8cb8c837354c] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:24.321358 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-b1685b2d-47a3-4272-b5ca-83708a8ddc96 req-67bf69fa-3a77-4938-8482-d5e033596d67 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062565 Jul 23 21:23:24.323689 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1171/2373] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:23:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:23:24.325769 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-552950a3-7f58-4cde-b489-53bc9db9a2f5 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:24.326499 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-552950a3-7f58-4cde-b489-53bc9db9a2f5 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:24.327729 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-552950a3-7f58-4cde-b489-53bc9db9a2f5 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:24.328382 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-552950a3-7f58-4cde-b489-53bc9db9a2f5 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:24.339537 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-39b14e7d-7252-4dc3-a4fb-68b9bc6192d4 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Calling method '.version_select at 0x7f0b59a4ca60>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:24.420220 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-39b14e7d-7252-4dc3-a4fb-68b9bc6192d4 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] 10.222.0.17 "GET /compute/v2.1/images/d899d6d5-3173-446f-9605-a7e38cdde92c" status: 200 len: 1432 microversion: 2.1 time: 0.094684 Jul 23 21:23:24.420878 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1172/2374] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:23:24 2022] GET /compute/v2.1/images/d899d6d5-3173-446f-9605-a7e38cdde92c => generated 1432 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:24.434528 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4a6af0d4-a840-43a2-8a2a-b41340f59522 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:24.437151 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-4a6af0d4-a840-43a2-8a2a-b41340f59522 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] [instance: 6929bb48-ae83-4078-8df7-60124c837ea3] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:24.455368 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4a6af0d4-a840-43a2-8a2a-b41340f59522 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:24.455841 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4a6af0d4-a840-43a2-8a2a-b41340f59522 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:24.456673 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4a6af0d4-a840-43a2-8a2a-b41340f59522 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:24.457105 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4a6af0d4-a840-43a2-8a2a-b41340f59522 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:24.798506 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-552950a3-7f58-4cde-b489-53bc9db9a2f5 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ca7a39a8174a4b97767245e80b2bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55cfd65431cf4b878ab1c0e25a0ac629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:23:24.807139 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-552950a3-7f58-4cde-b489-53bc9db9a2f5 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] 10.222.0.17 "GET /compute/v2.1/servers/4ef8cf58-9580-495b-9212-8cb8c837354c" status: 200 len: 1503 microversion: 2.1 time: 0.499741 Jul 23 21:23:24.810966 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1203/2375] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:24 2022] GET /compute/v2.1/servers/4ef8cf58-9580-495b-9212-8cb8c837354c => generated 1503 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:24.828684 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-137e4c92-6eef-4419-82b8-810bac4b3040 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2043306655"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:23:24.829622 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-137e4c92-6eef-4419-82b8-810bac4b3040 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] [instance: 4ef8cf58-9580-495b-9212-8cb8c837354c] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:24.841521 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-137e4c92-6eef-4419-82b8-810bac4b3040 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:24.847875 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-137e4c92-6eef-4419-82b8-810bac4b3040 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:24.849062 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-137e4c92-6eef-4419-82b8-810bac4b3040 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:24.849732 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-137e4c92-6eef-4419-82b8-810bac4b3040 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:25.058324 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-4a6af0d4-a840-43a2-8a2a-b41340f59522 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bde36fce49439bbe49caa877b1b630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebf7cadb7af43beb0b85669f8e1f36c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:23:25.066631 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4a6af0d4-a840-43a2-8a2a-b41340f59522 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] 10.222.0.17 "GET /compute/v2.1/servers/6929bb48-ae83-4078-8df7-60124c837ea3" status: 200 len: 1467 microversion: 2.1 time: 0.636625 Jul 23 21:23:25.079395 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1173/2376] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:24 2022] GET /compute/v2.1/servers/6929bb48-ae83-4078-8df7-60124c837ea3 => generated 1467 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:25.085220 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-cb044c87-702f-4bf8-b03f-25e59bcf46d3 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Calling method '.version_select at 0x7f0b599cd310>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:25.149101 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.network.security_group_api [None req-137e4c92-6eef-4419-82b8-810bac4b3040 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Adding security group 4b0e40dc-a08b-49e5-a853-4a60160bff96 to port f3b1c335-5a3b-4dfb-922c-b66dcb9104fd Jul 23 21:23:25.166811 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-cb044c87-702f-4bf8-b03f-25e59bcf46d3 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] 10.222.0.17 "GET /compute/v2.1/images/b27b20aa-ef1b-4dd1-989e-321af6343d6a" status: 200 len: 784 microversion: 2.1 time: 0.085155 Jul 23 21:23:25.167754 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1174/2377] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:23:25 2022] GET /compute/v2.1/images/b27b20aa-ef1b-4dd1-989e-321af6343d6a => generated 784 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:23:25.181648 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-141969c6-349c-4c5b-bada-e6de26b8dec2 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:25.192522 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-141969c6-349c-4c5b-bada-e6de26b8dec2 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] 10.222.0.17 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014627 Jul 23 21:23:25.193450 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1175/2378] 10.222.0.17 () {58 vars in 1136 bytes} [Sat Jul 23 21:23:25 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:23:25.204598 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-db89401c-dfb6-449b-84a7-a90168b2919f tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Calling method '.version_select at 0x7f0b47d7f5e0>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:25.919396 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-137e4c92-6eef-4419-82b8-810bac4b3040 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] 10.222.0.17 "POST /compute/v2.1/servers/4ef8cf58-9580-495b-9212-8cb8c837354c/action" status: 202 len: 0 microversion: 2.1 time: 1.097138 Jul 23 21:23:25.920734 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1204/2379] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:23:24 2022] POST /compute/v2.1/servers/4ef8cf58-9580-495b-9212-8cb8c837354c/action => generated 0 bytes in 1099 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:23:25.927374 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-b74a1839-9895-42b5-ab8d-f880dcffdf40 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:25.927998 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-b74a1839-9895-42b5-ab8d-f880dcffdf40 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] [instance: cef13563-7f83-4281-a26c-d5e420c41daf] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:25.938644 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b74a1839-9895-42b5-ab8d-f880dcffdf40 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:25.939093 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b74a1839-9895-42b5-ab8d-f880dcffdf40 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:25.939959 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b74a1839-9895-42b5-ab8d-f880dcffdf40 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:25.954304 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b74a1839-9895-42b5-ab8d-f880dcffdf40 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:26.035608 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-db89401c-dfb6-449b-84a7-a90168b2919f tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] 10.222.0.17 "DELETE /compute/v2.1/images/d899d6d5-3173-446f-9605-a7e38cdde92c" status: 204 len: 0 microversion: 2.1 time: 0.835247 Jul 23 21:23:26.036506 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1176/2380] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:25 2022] DELETE /compute/v2.1/images/d899d6d5-3173-446f-9605-a7e38cdde92c => generated 0 bytes in 837 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 23 21:23:26.043276 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0ecd7ad1-2f74-47e9-83b3-5f528db53153 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:26.044611 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-0ecd7ad1-2f74-47e9-83b3-5f528db53153 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] [instance: dd8dace4-4427-490e-ad29-73092c943515] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:26.094206 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0ecd7ad1-2f74-47e9-83b3-5f528db53153 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:26.094663 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0ecd7ad1-2f74-47e9-83b3-5f528db53153 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:26.095464 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0ecd7ad1-2f74-47e9-83b3-5f528db53153 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:26.095908 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0ecd7ad1-2f74-47e9-83b3-5f528db53153 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:26.480121 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-b74a1839-9895-42b5-ab8d-f880dcffdf40 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf93a4b80cb4e19a36473986950fc75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c1943188684b45b636541caf587247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:23:26.490405 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-b74a1839-9895-42b5-ab8d-f880dcffdf40 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] 10.222.0.17 "GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf" status: 200 len: 1479 microversion: 2.1 time: 0.568374 Jul 23 21:23:26.492871 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1205/2381] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:25 2022] GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf => generated 1479 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:26.510077 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-99888c23-1eee-4fd7-b9c5-1a0fb9279ed9 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Calling method '.version_select at 0x7f0b540c5a60>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:26.723696 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-0ecd7ad1-2f74-47e9-83b3-5f528db53153 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e74c139b38d74d9ab93695471ccd3a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ff73d603ec4069a908452514a59451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:23:26.742408 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-0ecd7ad1-2f74-47e9-83b3-5f528db53153 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] 10.222.0.17 "GET /compute/v2.1/servers/dd8dace4-4427-490e-ad29-73092c943515" status: 200 len: 1355 microversion: 2.1 time: 0.701479 Jul 23 21:23:26.750600 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1177/2382] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:26 2022] GET /compute/v2.1/servers/dd8dace4-4427-490e-ad29-73092c943515 => generated 1355 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:26.769448 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-d6cabcb3-22f9-4187-8628-9997a02c0162 req-71cfa2a2-faca-42d5-b83d-8d6487ed5882 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ef8cf58-9580-495b-9212-8cb8c837354c", "tag": "f3b1c335-5a3b-4dfb-922c-b66dcb9104fd"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:23:26.794914 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-d6cabcb3-22f9-4187-8628-9997a02c0162 req-71cfa2a2-faca-42d5-b83d-8d6487ed5882 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:26.795930 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-d6cabcb3-22f9-4187-8628-9997a02c0162 req-71cfa2a2-faca-42d5-b83d-8d6487ed5882 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:26.819198 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-d6cabcb3-22f9-4187-8628-9997a02c0162 req-71cfa2a2-faca-42d5-b83d-8d6487ed5882 service nova] Creating event network-changed:f3b1c335-5a3b-4dfb-922c-b66dcb9104fd for instance 4ef8cf58-9580-495b-9212-8cb8c837354c on nch1-master-1 Jul 23 21:23:26.826217 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-d6cabcb3-22f9-4187-8628-9997a02c0162 req-71cfa2a2-faca-42d5-b83d-8d6487ed5882 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073313 Jul 23 21:23:26.827541 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1178/2383] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:23:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:23:26.835404 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell0:SELECT=2 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:23:26.882815 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-aee70bb0-b830-4a11-be71-931527c20c38 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Calling method '.version_select at 0x7f0b5411dd30>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:26.889491 ncdv-master-1 devstack@n-api.service[131321]: DEBUG neutronclient.v2_0.client [None req-99888c23-1eee-4fd7-b9c5-1a0fb9279ed9 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 4b0e40dc-a08b-49e5-a853-4a60160bff96 in use.", "detail": ""}} {{(pid=131321) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 23 21:23:26.890244 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-99888c23-1eee-4fd7-b9c5-1a0fb9279ed9 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] HTTP exception thrown: Security Group 4b0e40dc-a08b-49e5-a853-4a60160bff96 in use. Jul 23 21:23:26.890244 ncdv-master-1 devstack@n-api.service[131321]: Neutron server returns request_ids: ['req-480ed4ee-4c05-4656-a09e-bd8ec855b151'] Jul 23 21:23:26.892687 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-99888c23-1eee-4fd7-b9c5-1a0fb9279ed9 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Request method failure captured: Jul 23 21:23:26.892687 ncdv-master-1 devstack@n-api.service[131321]: request: DELETE /compute/v2.1/os-security-groups/4b0e40dc-a08b-49e5-a853-4a60160bff96 HTTP/1.1 Jul 23 21:23:26.892687 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:23:26.892687 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:23:26.892687 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:23:26.892687 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:23:26.892687 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:23:26.892687 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:23:26.892687 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:23:26.892687 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:23:26.892687 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GabcedAy4zvEWDBz4psoyymQjd20otmwoBk14VBCrO5T_u930hsqstuKWfxSIIHSaoINyY7aouwTaS_UH5MldJcqSCrcSo-BYQbnUPzf2q6ne_dSigo_8PievK59Q_5ElGzDVdSYredgO26R1rdGGAuE9yewD0hcCJzYqqhzyGW3Zk Jul 23 21:23:26.892687 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:23:26.892687 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:23:26.892687 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:23:26.892687 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:23:26.892687 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:23:26.892687 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:23:26.892687 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 55cfd65431cf4b878ab1c0e25a0ac629 Jul 23 21:23:26.892687 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-SecurityGroupsTestJSON-553336269 Jul 23 21:23:26.892687 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:23:26.892687 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:23:26.892687 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/55cfd65431cf4b878ab1c0e25a0ac629"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/55cfd65431cf4b878ab1c0e25a0ac629"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_55cfd65431cf4b878ab1c0e25a0ac629", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/55cfd65431cf4b878ab1c0e25a0ac629"}]}] Jul 23 21:23:26.892687 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-SecurityGroupsTestJSON-553336269 Jul 23 21:23:26.892687 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 55cfd65431cf4b878ab1c0e25a0ac629 Jul 23 21:23:26.892687 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-553336269 Jul 23 21:23:26.892687 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-SecurityGroupsTestJSON-553336269-project Jul 23 21:23:26.892687 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:23:26.892687 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:23:26.892687 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 63ca7a39a8174a4b97767245e80b2bf7 Jul 23 21:23:26.892687 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-SecurityGroupsTestJSON-553336269-project Jul 23 21:23:26.892687 ncdv-master-1 devstack@n-api.service[131321]: method: Jul 23 21:23:26.892687 ncdv-master-1 devstack@n-api.service[131321]: exception: Security Group 4b0e40dc-a08b-49e5-a853-4a60160bff96 in use. Jul 23 21:23:26.892687 ncdv-master-1 devstack@n-api.service[131321]: Neutron server returns request_ids: ['req-480ed4ee-4c05-4656-a09e-bd8ec855b151'] Jul 23 21:23:26.892687 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': '4b0e40dc-a08b-49e5-a853-4a60160bff96'} Jul 23 21:23:26.892687 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:23:26.892687 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:23:26.892687 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jul 23 21:23:26.892687 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jul 23 21:23:26.892687 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:23:26.892687 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:23:26.892687 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jul 23 21:23:26.892687 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jul 23 21:23:26.892687 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:23:26.892687 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:23:26.892687 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jul 23 21:23:26.892687 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jul 23 21:23:26.892687 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:23:26.892687 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:23:26.892687 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 23 21:23:26.892687 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 23 21:23:26.892687 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:23:26.892687 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:23:26.892687 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 23 21:23:26.892687 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 23 21:23:26.892687 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:23:26.892687 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:23:26.892687 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 23 21:23:26.892687 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 23 21:23:26.892687 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 23 21:23:26.892687 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 23 21:23:26.892687 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 4b0e40dc-a08b-49e5-a853-4a60160bff96 in use. Jul 23 21:23:26.897749 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-480ed4ee-4c05-4656-a09e-bd8ec855b151'] Jul 23 21:23:26.897749 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:23:26.897749 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:23:26.897749 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:23:26.897749 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:23:26.897749 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jul 23 21:23:26.897749 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jul 23 21:23:26.897749 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jul 23 21:23:26.897749 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jul 23 21:23:26.897749 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 4b0e40dc-a08b-49e5-a853-4a60160bff96 in use. Jul 23 21:23:26.897749 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-480ed4ee-4c05-4656-a09e-bd8ec855b151'] Jul 23 21:23:26.897749 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:23:26.897749 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:23:26.897749 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:23:26.897749 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:23:26.897749 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:23:26.897749 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:23:26.897749 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:23:26.897749 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:23:26.897749 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:23:26.897749 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:23:26.897749 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:23:26.897749 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:23:26.897749 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jul 23 21:23:26.897749 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 23 21:23:26.897749 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 4b0e40dc-a08b-49e5-a853-4a60160bff96 in use. Jul 23 21:23:26.897749 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-480ed4ee-4c05-4656-a09e-bd8ec855b151'] Jul 23 21:23:26.897749 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:23:26.897749 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:23:26.897749 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:23:26.897749 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:23:26.897749 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:23:26.897749 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:23:26.897749 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:23:26.897749 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:23:26.897749 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 4b0e40dc-a08b-49e5-a853-4a60160bff96 in use. Jul 23 21:23:26.897749 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-480ed4ee-4c05-4656-a09e-bd8ec855b151'] Jul 23 21:23:26.897749 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:23:26.897749 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-99888c23-1eee-4fd7-b9c5-1a0fb9279ed9 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Returning 400 to user: Security Group 4b0e40dc-a08b-49e5-a853-4a60160bff96 in use. Jul 23 21:23:26.897749 ncdv-master-1 devstack@n-api.service[131321]: Neutron server returns request_ids: ['req-480ed4ee-4c05-4656-a09e-bd8ec855b151'] {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:23:26.897749 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-99888c23-1eee-4fd7-b9c5-1a0fb9279ed9 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/4b0e40dc-a08b-49e5-a853-4a60160bff96" status: 400 len: 185 microversion: 2.1 time: 0.399246 Jul 23 21:23:26.897749 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1206/2384] 10.222.0.17 () {58 vars in 1271 bytes} [Sat Jul 23 21:23:26 2022] DELETE /compute/v2.1/os-security-groups/4b0e40dc-a08b-49e5-a853-4a60160bff96 => generated 185 bytes in 401 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 23 21:23:26.906378 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-08e45129-dd1b-4c53-b235-aeb0fb35bb6f tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:23:26.919155 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-08e45129-dd1b-4c53-b235-aeb0fb35bb6f tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] [instance: 4ef8cf58-9580-495b-9212-8cb8c837354c] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:26.940295 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-08e45129-dd1b-4c53-b235-aeb0fb35bb6f tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:26.940767 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-08e45129-dd1b-4c53-b235-aeb0fb35bb6f tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:26.941583 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-08e45129-dd1b-4c53-b235-aeb0fb35bb6f tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:26.942067 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-08e45129-dd1b-4c53-b235-aeb0fb35bb6f tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:26.950489 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-aee70bb0-b830-4a11-be71-931527c20c38 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] HTTP exception thrown: Image not found. Jul 23 21:23:26.953757 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-aee70bb0-b830-4a11-be71-931527c20c38 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Request method failure captured: Jul 23 21:23:26.953757 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/images/d899d6d5-3173-446f-9605-a7e38cdde92c HTTP/1.1 Jul 23 21:23:26.953757 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:23:26.953757 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:23:26.953757 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:23:26.953757 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:23:26.953757 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:23:26.953757 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:23:26.953757 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:23:26.953757 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:23:26.953757 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GafteRsEHiv_4T3fV2KOPCK-8fy57Kvjr25eXRlaLR75L3Xq8mPTfq3gR2B85ZHhhdWZ3fgWcnd1z0dGOXW8id9ZYFLwmcndl2f-I_L_5TsknPkE4Pz67eGdSP8LTdx4JobHNZABuRvbEyB9ZPXuKd0DQ7rfgd5ePRec4jBGE8qnqc Jul 23 21:23:26.953757 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:23:26.953757 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:23:26.953757 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:23:26.953757 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:23:26.953757 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:23:26.953757 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:23:26.953757 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 4ebf7cadb7af43beb0b85669f8e1f36c Jul 23 21:23:26.953757 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ImagesOneServerTestJSON-1078133334 Jul 23 21:23:26.953757 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:23:26.953757 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:23:26.953757 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4ebf7cadb7af43beb0b85669f8e1f36c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4ebf7cadb7af43beb0b85669f8e1f36c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4ebf7cadb7af43beb0b85669f8e1f36c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4ebf7cadb7af43beb0b85669f8e1f36c"}]}] Jul 23 21:23:26.953757 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ImagesOneServerTestJSON-1078133334 Jul 23 21:23:26.953757 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 4ebf7cadb7af43beb0b85669f8e1f36c Jul 23 21:23:26.953757 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1078133334 Jul 23 21:23:26.953757 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ImagesOneServerTestJSON-1078133334-project Jul 23 21:23:26.953757 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:23:26.953757 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:23:26.953757 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 73bde36fce49439bbe49caa877b1b630 Jul 23 21:23:26.953757 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ImagesOneServerTestJSON-1078133334-project Jul 23 21:23:26.953757 ncdv-master-1 devstack@n-api.service[131320]: method: Jul 23 21:23:26.953757 ncdv-master-1 devstack@n-api.service[131320]: exception: Image not found. Jul 23 21:23:26.953757 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': 'd899d6d5-3173-446f-9605-a7e38cdde92c'} Jul 23 21:23:26.953757 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:23:26.953757 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:23:26.953757 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 23 21:23:26.953757 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 23 21:23:26.953757 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 23 21:23:26.953757 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 23 21:23:26.953757 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 23 21:23:26.953757 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 23 21:23:26.953757 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 23 21:23:26.953757 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 23 21:23:26.953757 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 23 21:23:26.953757 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 23 21:23:26.953757 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 23 21:23:26.953757 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 23 21:23:26.953757 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 23 21:23:26.953757 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 23 21:23:26.953757 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 23 21:23:26.953757 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 23 21:23:26.953757 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID d899d6d5-3173-446f-9605-a7e38cdde92c Jul 23 21:23:26.953757 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:23:26.953757 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:23:26.953757 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:23:26.953757 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:23:26.953757 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 23 21:23:26.953757 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 23 21:23:26.953757 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 23 21:23:26.953757 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 23 21:23:26.953757 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 23 21:23:26.953757 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 23 21:23:26.953757 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 23 21:23:26.953757 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 23 21:23:26.957411 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 23 21:23:26.957411 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 23 21:23:26.957411 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 23 21:23:26.957411 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 23 21:23:26.957411 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 23 21:23:26.957411 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 23 21:23:26.957411 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 23 21:23:26.957411 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 23 21:23:26.957411 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 23 21:23:26.957411 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 23 21:23:26.957411 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 23 21:23:26.957411 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 23 21:23:26.957411 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 23 21:23:26.957411 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 23 21:23:26.957411 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 23 21:23:26.957411 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 23 21:23:26.957411 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d899d6d5-3173-446f-9605-a7e38cdde92c could not be found. Jul 23 21:23:26.957411 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:23:26.957411 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:23:26.957411 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:23:26.957411 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:23:26.957411 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:23:26.957411 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:23:26.957411 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:23:26.957411 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:23:26.957411 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:23:26.957411 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:23:26.957411 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:23:26.957411 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:23:26.957411 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 23 21:23:26.957411 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 23 21:23:26.957411 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 23 21:23:26.957411 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:23:26.957411 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:23:26.957411 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:23:26.957411 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:23:26.957411 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:23:26.957411 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:23:26.957411 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:23:26.957411 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:23:26.957411 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 23 21:23:26.957411 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:23:26.963911 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-aee70bb0-b830-4a11-be71-931527c20c38 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Returning 404 to user: Image not found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:23:26.966228 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-aee70bb0-b830-4a11-be71-931527c20c38 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] 10.222.0.17 "GET /compute/v2.1/images/d899d6d5-3173-446f-9605-a7e38cdde92c" status: 404 len: 62 microversion: 2.1 time: 0.120545 Jul 23 21:23:26.975604 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1179/2385] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:23:26 2022] GET /compute/v2.1/images/d899d6d5-3173-446f-9605-a7e38cdde92c => generated 62 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 23 21:23:26.984729 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5343872a-c0d2-4751-9262-209463cf4bfa tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-246165561"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:23:26.986566 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5343872a-c0d2-4751-9262-209463cf4bfa tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] [instance: 6929bb48-ae83-4078-8df7-60124c837ea3] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:26.997898 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5343872a-c0d2-4751-9262-209463cf4bfa tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:26.998631 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5343872a-c0d2-4751-9262-209463cf4bfa tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:26.999644 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5343872a-c0d2-4751-9262-209463cf4bfa tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:27.000219 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5343872a-c0d2-4751-9262-209463cf4bfa tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:27.134268 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-08e45129-dd1b-4c53-b235-aeb0fb35bb6f tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] 10.222.0.17 "POST /compute/v2.1/servers/4ef8cf58-9580-495b-9212-8cb8c837354c/action" status: 202 len: 0 microversion: 2.1 time: 0.234028 Jul 23 21:23:27.138217 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1207/2386] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:23:26 2022] POST /compute/v2.1/servers/4ef8cf58-9580-495b-9212-8cb8c837354c/action => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 23 21:23:27.147912 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-6ac659c6-08bc-4be0-b0a2-aa97e56a0023 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:27.148641 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-6ac659c6-08bc-4be0-b0a2-aa97e56a0023 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] [instance: 4ef8cf58-9580-495b-9212-8cb8c837354c] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:27.163132 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6ac659c6-08bc-4be0-b0a2-aa97e56a0023 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:27.163644 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6ac659c6-08bc-4be0-b0a2-aa97e56a0023 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:27.164450 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6ac659c6-08bc-4be0-b0a2-aa97e56a0023 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:27.164893 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6ac659c6-08bc-4be0-b0a2-aa97e56a0023 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:27.429379 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell0:SELECT=8 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:23:27.492781 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-6ac659c6-08bc-4be0-b0a2-aa97e56a0023 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ca7a39a8174a4b97767245e80b2bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55cfd65431cf4b878ab1c0e25a0ac629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:23:27.497405 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:23:27.522975 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-6ac659c6-08bc-4be0-b0a2-aa97e56a0023 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] 10.222.0.17 "GET /compute/v2.1/servers/4ef8cf58-9580-495b-9212-8cb8c837354c" status: 200 len: 1574 microversion: 2.1 time: 0.381268 Jul 23 21:23:27.524417 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1208/2387] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:27 2022] GET /compute/v2.1/servers/4ef8cf58-9580-495b-9212-8cb8c837354c => generated 1574 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:27.532643 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-78da7d53-d36f-412d-806e-6eb0d663e4e6 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:27.533599 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-78da7d53-d36f-412d-806e-6eb0d663e4e6 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] [instance: cef13563-7f83-4281-a26c-d5e420c41daf] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:27.548070 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-78da7d53-d36f-412d-806e-6eb0d663e4e6 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:27.548566 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-78da7d53-d36f-412d-806e-6eb0d663e4e6 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:27.556028 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-78da7d53-d36f-412d-806e-6eb0d663e4e6 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:27.557265 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-78da7d53-d36f-412d-806e-6eb0d663e4e6 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:27.567264 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5343872a-c0d2-4751-9262-209463cf4bfa tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] 10.222.0.17 "POST /compute/v2.1/servers/6929bb48-ae83-4078-8df7-60124c837ea3/action" status: 202 len: 0 microversion: 2.1 time: 0.576334 Jul 23 21:23:27.568994 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1180/2388] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:23:26 2022] POST /compute/v2.1/servers/6929bb48-ae83-4078-8df7-60124c837ea3/action => generated 0 bytes in 592 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 23 21:23:27.583100 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6c781526-6a69-4a13-ae30-44a80f99da1f tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Calling method '.version_select at 0x7f0b47cac430>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:27.687315 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6c781526-6a69-4a13-ae30-44a80f99da1f tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] 10.222.0.17 "GET /compute/v2.1/images/e57c215e-ddc6-4510-9626-f3760a490e39" status: 200 len: 1428 microversion: 2.1 time: 0.111450 Jul 23 21:23:27.690212 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1181/2389] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:23:27 2022] GET /compute/v2.1/images/e57c215e-ddc6-4510-9626-f3760a490e39 => generated 1428 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:27.771269 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-47397c8f-3c56-475c-9f72-ee4cf74dec53 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:27.784474 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-47397c8f-3c56-475c-9f72-ee4cf74dec53 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] [instance: dd8dace4-4427-490e-ad29-73092c943515] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:27.796301 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-47397c8f-3c56-475c-9f72-ee4cf74dec53 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:27.797182 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-47397c8f-3c56-475c-9f72-ee4cf74dec53 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:27.798211 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-47397c8f-3c56-475c-9f72-ee4cf74dec53 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:27.798847 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-47397c8f-3c56-475c-9f72-ee4cf74dec53 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:28.012226 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-78da7d53-d36f-412d-806e-6eb0d663e4e6 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf93a4b80cb4e19a36473986950fc75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c1943188684b45b636541caf587247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:23:28.024556 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-78da7d53-d36f-412d-806e-6eb0d663e4e6 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] 10.222.0.17 "GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf" status: 200 len: 1464 microversion: 2.1 time: 0.498774 Jul 23 21:23:28.025750 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1209/2390] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:27 2022] GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf => generated 1464 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:28.049235 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-13f82109-0801-46e2-b9f6-3a2a6c984474 tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:23:28.050703 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-13f82109-0801-46e2-b9f6-3a2a6c984474 tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] [instance: cef13563-7f83-4281-a26c-d5e420c41daf] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:28.064926 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-13f82109-0801-46e2-b9f6-3a2a6c984474 tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:28.065841 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-13f82109-0801-46e2-b9f6-3a2a6c984474 tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:28.068490 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-13f82109-0801-46e2-b9f6-3a2a6c984474 tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:28.071406 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-13f82109-0801-46e2-b9f6-3a2a6c984474 tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:28.266390 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-13f82109-0801-46e2-b9f6-3a2a6c984474 tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf/action" status: 202 len: 0 microversion: 2.1 time: 0.221222 Jul 23 21:23:28.273784 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1210/2391] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:23:28 2022] POST /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf/action => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:23:28.280039 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c882c99b-d320-406c-9223-aa1811544150 tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:28.283313 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-c882c99b-d320-406c-9223-aa1811544150 tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] [instance: cef13563-7f83-4281-a26c-d5e420c41daf] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:28.301386 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c882c99b-d320-406c-9223-aa1811544150 tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:28.302119 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c882c99b-d320-406c-9223-aa1811544150 tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:28.313333 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c882c99b-d320-406c-9223-aa1811544150 tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:28.315657 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c882c99b-d320-406c-9223-aa1811544150 tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:28.391598 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c882c99b-d320-406c-9223-aa1811544150 tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:28.392295 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c882c99b-d320-406c-9223-aa1811544150 tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:28.393136 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.objects.instance [None req-c882c99b-d320-406c-9223-aa1811544150 tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] Lazy-loading 'fault' on Instance uuid cef13563-7f83-4281-a26c-d5e420c41daf {{(pid=131321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:23:28.416354 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-47397c8f-3c56-475c-9f72-ee4cf74dec53 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e74c139b38d74d9ab93695471ccd3a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ff73d603ec4069a908452514a59451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:23:28.427957 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-47397c8f-3c56-475c-9f72-ee4cf74dec53 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] 10.222.0.17 "GET /compute/v2.1/servers/dd8dace4-4427-490e-ad29-73092c943515" status: 200 len: 1355 microversion: 2.1 time: 0.663649 Jul 23 21:23:28.430489 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1182/2392] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:27 2022] GET /compute/v2.1/servers/dd8dace4-4427-490e-ad29-73092c943515 => generated 1355 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:28.489495 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-8c514f68-91ff-4fa3-9b43-a71c166f4623 req-3897e9fe-55d2-4c57-af1d-003987fe7cfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6929bb48-ae83-4078-8df7-60124c837ea3", "name": "network-vif-unplugged", "status": "completed", "tag": "1e3e8f57-3c77-4c90-ad4e-1a9f4efa146d"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:23:28.520967 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-8c514f68-91ff-4fa3-9b43-a71c166f4623 req-3897e9fe-55d2-4c57-af1d-003987fe7cfc service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:28.522053 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-8c514f68-91ff-4fa3-9b43-a71c166f4623 req-3897e9fe-55d2-4c57-af1d-003987fe7cfc service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:28.551881 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-8c514f68-91ff-4fa3-9b43-a71c166f4623 req-3897e9fe-55d2-4c57-af1d-003987fe7cfc service nova] Creating event network-vif-unplugged:1e3e8f57-3c77-4c90-ad4e-1a9f4efa146d for instance 6929bb48-ae83-4078-8df7-60124c837ea3 on nch2-master-1 Jul 23 21:23:28.560419 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-8c514f68-91ff-4fa3-9b43-a71c166f4623 req-3897e9fe-55d2-4c57-af1d-003987fe7cfc service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.075568 Jul 23 21:23:28.561714 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1183/2393] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:23:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:23:28.575023 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c9f7f5e8-af0d-48c6-85ab-5cb16b4aca6a tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:28.576786 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c9f7f5e8-af0d-48c6-85ab-5cb16b4aca6a tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] [instance: 4ef8cf58-9580-495b-9212-8cb8c837354c] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:28.591593 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c9f7f5e8-af0d-48c6-85ab-5cb16b4aca6a tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:28.592298 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c9f7f5e8-af0d-48c6-85ab-5cb16b4aca6a tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:28.593321 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c9f7f5e8-af0d-48c6-85ab-5cb16b4aca6a tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:28.593946 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c9f7f5e8-af0d-48c6-85ab-5cb16b4aca6a tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:28.645494 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-c882c99b-d320-406c-9223-aa1811544150 tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf" status: 200 len: 1598 microversion: 2.1 time: 0.369921 Jul 23 21:23:28.660382 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1211/2394] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:28 2022] GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf => generated 1598 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:28.667613 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-6cf1c73a-7a71-45d9-a3a7-58de0f79fc43 tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:23:28.668918 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-6cf1c73a-7a71-45d9-a3a7-58de0f79fc43 tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] [instance: cef13563-7f83-4281-a26c-d5e420c41daf] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:28.677601 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6cf1c73a-7a71-45d9-a3a7-58de0f79fc43 tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:28.683750 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6cf1c73a-7a71-45d9-a3a7-58de0f79fc43 tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:28.685247 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6cf1c73a-7a71-45d9-a3a7-58de0f79fc43 tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:28.686140 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6cf1c73a-7a71-45d9-a3a7-58de0f79fc43 tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:28.803620 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-6cf1c73a-7a71-45d9-a3a7-58de0f79fc43 tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf/action" status: 202 len: 0 microversion: 2.1 time: 0.140610 Jul 23 21:23:28.808704 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1212/2395] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:23:28 2022] POST /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf/action => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:23:28.813840 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-749afc71-6e4a-415e-8b2d-881b90e4b71a tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Calling method '.version_select at 0x7f0b47e5af70>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:28.881967 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-749afc71-6e4a-415e-8b2d-881b90e4b71a tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] 10.222.0.17 "GET /compute/v2.1/images/e57c215e-ddc6-4510-9626-f3760a490e39" status: 200 len: 1428 microversion: 2.1 time: 0.072054 Jul 23 21:23:28.883273 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1213/2396] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:23:28 2022] GET /compute/v2.1/images/e57c215e-ddc6-4510-9626-f3760a490e39 => generated 1428 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:28.892045 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-09e24a0d-516f-48c9-bc86-53975a9a8658 tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:28.893273 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-09e24a0d-516f-48c9-bc86-53975a9a8658 tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] [instance: cef13563-7f83-4281-a26c-d5e420c41daf] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:28.903995 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-09e24a0d-516f-48c9-bc86-53975a9a8658 tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:28.904400 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-09e24a0d-516f-48c9-bc86-53975a9a8658 tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:28.905954 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-09e24a0d-516f-48c9-bc86-53975a9a8658 tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:28.905954 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-09e24a0d-516f-48c9-bc86-53975a9a8658 tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:29.225708 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-09e24a0d-516f-48c9-bc86-53975a9a8658 tempest-ServersAdminTestJSON-1307276387 tempest-ServersAdminTestJSON-1307276387-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf" status: 200 len: 1615 microversion: 2.1 time: 0.340679 Jul 23 21:23:29.226842 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1214/2397] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:28 2022] GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf => generated 1615 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:29.232559 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-cdde89cb-bdf7-47b9-9a30-03bb74f3ae06 req-9ab348a5-3a39-4725-bb4b-7a4b500cecdd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd8dace4-4427-490e-ad29-73092c943515", "tag": "f5ad3cc2-0f6f-4876-bcd7-fbf8f64bb82f"}, {"name": "network-changed", "server_uuid": "dd8dace4-4427-490e-ad29-73092c943515", "tag": "a7c2389d-d3e3-45ba-a0f7-f037c086060d"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:23:29.251279 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-cdde89cb-bdf7-47b9-9a30-03bb74f3ae06 req-9ab348a5-3a39-4725-bb4b-7a4b500cecdd service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:29.251690 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-cdde89cb-bdf7-47b9-9a30-03bb74f3ae06 req-9ab348a5-3a39-4725-bb4b-7a4b500cecdd service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:29.251817 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c9f7f5e8-af0d-48c6-85ab-5cb16b4aca6a tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ca7a39a8174a4b97767245e80b2bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55cfd65431cf4b878ab1c0e25a0ac629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:23:29.262194 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c9f7f5e8-af0d-48c6-85ab-5cb16b4aca6a tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] 10.222.0.17 "GET /compute/v2.1/servers/4ef8cf58-9580-495b-9212-8cb8c837354c" status: 200 len: 1574 microversion: 2.1 time: 0.698475 Jul 23 21:23:29.263104 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1184/2398] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:28 2022] GET /compute/v2.1/servers/4ef8cf58-9580-495b-9212-8cb8c837354c => generated 1574 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:29.285205 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a1d347ae-3a0f-471b-8356-b3d7b610fa1f tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:29.286257 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a1d347ae-3a0f-471b-8356-b3d7b610fa1f tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] [instance: 53347323-4870-4526-9020-1a3bc821d3fb] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:29.294278 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-cdde89cb-bdf7-47b9-9a30-03bb74f3ae06 req-9ab348a5-3a39-4725-bb4b-7a4b500cecdd service nova] Creating event network-changed:f5ad3cc2-0f6f-4876-bcd7-fbf8f64bb82f for instance dd8dace4-4427-490e-ad29-73092c943515 on nch2-master-1 Jul 23 21:23:29.296198 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-cdde89cb-bdf7-47b9-9a30-03bb74f3ae06 req-9ab348a5-3a39-4725-bb4b-7a4b500cecdd service nova] Creating event network-changed:a7c2389d-d3e3-45ba-a0f7-f037c086060d for instance dd8dace4-4427-490e-ad29-73092c943515 on nch2-master-1 Jul 23 21:23:29.311412 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-cdde89cb-bdf7-47b9-9a30-03bb74f3ae06 req-9ab348a5-3a39-4725-bb4b-7a4b500cecdd service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.082789 Jul 23 21:23:29.315319 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1215/2399] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:23:29 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:23:29.333314 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a1d347ae-3a0f-471b-8356-b3d7b610fa1f tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:29.334325 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a1d347ae-3a0f-471b-8356-b3d7b610fa1f tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:29.335681 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a1d347ae-3a0f-471b-8356-b3d7b610fa1f tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:29.336326 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a1d347ae-3a0f-471b-8356-b3d7b610fa1f tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:29.344514 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:23:29.378214 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a1d347ae-3a0f-471b-8356-b3d7b610fa1f tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] [instance: 53347323-4870-4526-9020-1a3bc821d3fb] Going to try to terminate instance {{(pid=131320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:23:29.448402 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-1a65e99b-e6ea-4a6a-b9e6-959d624d83d5 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:29.449648 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-1a65e99b-e6ea-4a6a-b9e6-959d624d83d5 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] [instance: dd8dace4-4427-490e-ad29-73092c943515] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:29.458180 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1a65e99b-e6ea-4a6a-b9e6-959d624d83d5 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:29.458944 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1a65e99b-e6ea-4a6a-b9e6-959d624d83d5 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:29.460086 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1a65e99b-e6ea-4a6a-b9e6-959d624d83d5 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:29.460731 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1a65e99b-e6ea-4a6a-b9e6-959d624d83d5 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:29.560408 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a1d347ae-3a0f-471b-8356-b3d7b610fa1f tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] 10.222.0.17 "DELETE /compute/v2.1/servers/53347323-4870-4526-9020-1a3bc821d3fb" status: 204 len: 0 microversion: 2.1 time: 0.295652 Jul 23 21:23:29.567084 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1185/2400] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:23:29 2022] DELETE /compute/v2.1/servers/53347323-4870-4526-9020-1a3bc821d3fb => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:23:29.574500 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c07b53ec-beec-44e0-a806-0b6e01eca0f0 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:29.575927 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c07b53ec-beec-44e0-a806-0b6e01eca0f0 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] [instance: 53347323-4870-4526-9020-1a3bc821d3fb] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:29.585698 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c07b53ec-beec-44e0-a806-0b6e01eca0f0 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:29.587299 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c07b53ec-beec-44e0-a806-0b6e01eca0f0 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:29.591761 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c07b53ec-beec-44e0-a806-0b6e01eca0f0 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:29.592563 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c07b53ec-beec-44e0-a806-0b6e01eca0f0 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:29.751256 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-1a65e99b-e6ea-4a6a-b9e6-959d624d83d5 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e74c139b38d74d9ab93695471ccd3a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ff73d603ec4069a908452514a59451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:23:29.760034 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-1a65e99b-e6ea-4a6a-b9e6-959d624d83d5 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] 10.222.0.17 "GET /compute/v2.1/servers/dd8dace4-4427-490e-ad29-73092c943515" status: 200 len: 1355 microversion: 2.1 time: 0.316908 Jul 23 21:23:29.769825 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1216/2401] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:29 2022] GET /compute/v2.1/servers/dd8dace4-4427-490e-ad29-73092c943515 => generated 1355 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:29.894985 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-3841a4c8-b556-49b4-b10f-1a0f96142a2b tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Calling method '.version_select at 0x7f0b47e5a670>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:29.958570 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-3841a4c8-b556-49b4-b10f-1a0f96142a2b tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] 10.222.0.17 "GET /compute/v2.1/images/e57c215e-ddc6-4510-9626-f3760a490e39" status: 200 len: 1428 microversion: 2.1 time: 0.067215 Jul 23 21:23:29.962238 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1217/2402] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:23:29 2022] GET /compute/v2.1/images/e57c215e-ddc6-4510-9626-f3760a490e39 => generated 1428 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:30.292012 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-14b93547-707e-424b-b0c2-27395f6eebc3 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:30.292789 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-14b93547-707e-424b-b0c2-27395f6eebc3 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] [instance: 4ef8cf58-9580-495b-9212-8cb8c837354c] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:30.303049 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-14b93547-707e-424b-b0c2-27395f6eebc3 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:30.303513 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-14b93547-707e-424b-b0c2-27395f6eebc3 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:30.304319 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-14b93547-707e-424b-b0c2-27395f6eebc3 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:30.304766 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-14b93547-707e-424b-b0c2-27395f6eebc3 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:30.434638 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c07b53ec-beec-44e0-a806-0b6e01eca0f0 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf93a4b80cb4e19a36473986950fc75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c1943188684b45b636541caf587247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:23:30.446718 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c07b53ec-beec-44e0-a806-0b6e01eca0f0 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] 10.222.0.17 "GET /compute/v2.1/servers/53347323-4870-4526-9020-1a3bc821d3fb" status: 200 len: 1469 microversion: 2.1 time: 0.877972 Jul 23 21:23:30.452078 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1186/2403] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:29 2022] GET /compute/v2.1/servers/53347323-4870-4526-9020-1a3bc821d3fb => generated 1469 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:30.777003 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-061c6adb-37bd-4a9e-a3b4-50088fa63128 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:30.777730 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-061c6adb-37bd-4a9e-a3b4-50088fa63128 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] [instance: dd8dace4-4427-490e-ad29-73092c943515] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:30.780181 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:23:30.788726 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-061c6adb-37bd-4a9e-a3b4-50088fa63128 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:30.790382 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-14b93547-707e-424b-b0c2-27395f6eebc3 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ca7a39a8174a4b97767245e80b2bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55cfd65431cf4b878ab1c0e25a0ac629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:23:30.794453 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-061c6adb-37bd-4a9e-a3b4-50088fa63128 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:30.796583 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-061c6adb-37bd-4a9e-a3b4-50088fa63128 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:30.797352 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-061c6adb-37bd-4a9e-a3b4-50088fa63128 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:30.817610 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-14b93547-707e-424b-b0c2-27395f6eebc3 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] 10.222.0.17 "GET /compute/v2.1/servers/4ef8cf58-9580-495b-9212-8cb8c837354c" status: 200 len: 1574 microversion: 2.1 time: 0.534094 Jul 23 21:23:30.831108 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1218/2404] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:30 2022] GET /compute/v2.1/servers/4ef8cf58-9580-495b-9212-8cb8c837354c => generated 1574 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:30.986821 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-cfb1e81a-bcb7-43c3-a2c0-960c67f89e22 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Calling method '.version_select at 0x7f0b47e5ac10>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:31.278654 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-cfb1e81a-bcb7-43c3-a2c0-960c67f89e22 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] 10.222.0.17 "GET /compute/v2.1/images/e57c215e-ddc6-4510-9626-f3760a490e39" status: 200 len: 1428 microversion: 2.1 time: 0.310066 Jul 23 21:23:31.279765 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1219/2405] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:23:30 2022] GET /compute/v2.1/images/e57c215e-ddc6-4510-9626-f3760a490e39 => generated 1428 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:31.388802 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-dd7c7b6c-4850-4e59-bdf6-4972c3c9fdbf req-478f19a0-e2bd-43ed-9313-b694d153047a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd8dace4-4427-490e-ad29-73092c943515", "tag": "08d3703a-fc82-45d7-a979-0da0e96e3452"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:23:31.416009 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-dd7c7b6c-4850-4e59-bdf6-4972c3c9fdbf req-478f19a0-e2bd-43ed-9313-b694d153047a service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:31.418525 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-dd7c7b6c-4850-4e59-bdf6-4972c3c9fdbf req-478f19a0-e2bd-43ed-9313-b694d153047a service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:31.438839 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-dd7c7b6c-4850-4e59-bdf6-4972c3c9fdbf req-478f19a0-e2bd-43ed-9313-b694d153047a service nova] Creating event network-changed:08d3703a-fc82-45d7-a979-0da0e96e3452 for instance dd8dace4-4427-490e-ad29-73092c943515 on nch2-master-1 Jul 23 21:23:31.447495 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-dd7c7b6c-4850-4e59-bdf6-4972c3c9fdbf req-478f19a0-e2bd-43ed-9313-b694d153047a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062772 Jul 23 21:23:31.450244 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1220/2406] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:23:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:23:31.470956 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-3f7cef28-6d8f-4ec1-9e50-a687640d2fdf tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:31.472735 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-3f7cef28-6d8f-4ec1-9e50-a687640d2fdf tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] [instance: 53347323-4870-4526-9020-1a3bc821d3fb] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:31.484439 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3f7cef28-6d8f-4ec1-9e50-a687640d2fdf tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:31.486043 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3f7cef28-6d8f-4ec1-9e50-a687640d2fdf tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:31.487765 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3f7cef28-6d8f-4ec1-9e50-a687640d2fdf tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:31.488403 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3f7cef28-6d8f-4ec1-9e50-a687640d2fdf tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:31.598732 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-061c6adb-37bd-4a9e-a3b4-50088fa63128 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e74c139b38d74d9ab93695471ccd3a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ff73d603ec4069a908452514a59451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:23:31.619858 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-061c6adb-37bd-4a9e-a3b4-50088fa63128 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] 10.222.0.17 "GET /compute/v2.1/servers/dd8dace4-4427-490e-ad29-73092c943515" status: 200 len: 1355 microversion: 2.1 time: 0.846400 Jul 23 21:23:31.621197 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1187/2407] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:30 2022] GET /compute/v2.1/servers/dd8dace4-4427-490e-ad29-73092c943515 => generated 1355 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:23:31.836504 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-26b9b07f-1a77-4b63-8d95-a4960dd9bb96 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:31.837943 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-26b9b07f-1a77-4b63-8d95-a4960dd9bb96 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] [instance: 4ef8cf58-9580-495b-9212-8cb8c837354c] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:31.847535 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-26b9b07f-1a77-4b63-8d95-a4960dd9bb96 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:31.848209 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-26b9b07f-1a77-4b63-8d95-a4960dd9bb96 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:31.851215 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-26b9b07f-1a77-4b63-8d95-a4960dd9bb96 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:31.851932 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-26b9b07f-1a77-4b63-8d95-a4960dd9bb96 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:31.875957 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-3f7cef28-6d8f-4ec1-9e50-a687640d2fdf tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf93a4b80cb4e19a36473986950fc75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c1943188684b45b636541caf587247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:23:31.891444 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-3f7cef28-6d8f-4ec1-9e50-a687640d2fdf tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] 10.222.0.17 "GET /compute/v2.1/servers/53347323-4870-4526-9020-1a3bc821d3fb" status: 200 len: 1469 microversion: 2.1 time: 0.424633 Jul 23 21:23:31.902640 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1221/2408] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:31 2022] GET /compute/v2.1/servers/53347323-4870-4526-9020-1a3bc821d3fb => generated 1469 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:32.291176 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-b1ce4cec-e82d-4208-86dc-e59b082aa409 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Calling method '.version_select at 0x7f0b541a8dc0>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:32.378791 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-b1ce4cec-e82d-4208-86dc-e59b082aa409 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] 10.222.0.17 "GET /compute/v2.1/images/e57c215e-ddc6-4510-9626-f3760a490e39" status: 200 len: 1428 microversion: 2.1 time: 0.091548 Jul 23 21:23:32.379583 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1222/2409] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:23:32 2022] GET /compute/v2.1/images/e57c215e-ddc6-4510-9626-f3760a490e39 => generated 1428 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:23:32.637041 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-93edbb70-3dc3-4d51-b482-ee667bb3aad9 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:32.638126 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-93edbb70-3dc3-4d51-b482-ee667bb3aad9 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] [instance: dd8dace4-4427-490e-ad29-73092c943515] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:32.649980 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-93edbb70-3dc3-4d51-b482-ee667bb3aad9 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:32.652470 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-93edbb70-3dc3-4d51-b482-ee667bb3aad9 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:32.654671 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-93edbb70-3dc3-4d51-b482-ee667bb3aad9 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:32.655458 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-93edbb70-3dc3-4d51-b482-ee667bb3aad9 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:32.688944 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-26b9b07f-1a77-4b63-8d95-a4960dd9bb96 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ca7a39a8174a4b97767245e80b2bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55cfd65431cf4b878ab1c0e25a0ac629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:23:32.700466 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-26b9b07f-1a77-4b63-8d95-a4960dd9bb96 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] 10.222.0.17 "GET /compute/v2.1/servers/4ef8cf58-9580-495b-9212-8cb8c837354c" status: 200 len: 1574 microversion: 2.1 time: 0.868352 Jul 23 21:23:32.701075 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1188/2410] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:31 2022] GET /compute/v2.1/servers/4ef8cf58-9580-495b-9212-8cb8c837354c => generated 1574 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:32.909907 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6ac0df73-6bc2-4b1f-ab5a-98fc65d41536 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:32.910590 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6ac0df73-6bc2-4b1f-ab5a-98fc65d41536 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] [instance: 53347323-4870-4526-9020-1a3bc821d3fb] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:32.928073 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6ac0df73-6bc2-4b1f-ab5a-98fc65d41536 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:32.928726 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6ac0df73-6bc2-4b1f-ab5a-98fc65d41536 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:32.929531 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6ac0df73-6bc2-4b1f-ab5a-98fc65d41536 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:32.929988 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6ac0df73-6bc2-4b1f-ab5a-98fc65d41536 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:33.031999 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6ac0df73-6bc2-4b1f-ab5a-98fc65d41536 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:33.032447 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6ac0df73-6bc2-4b1f-ab5a-98fc65d41536 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:33.033076 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.objects.instance [None req-6ac0df73-6bc2-4b1f-ab5a-98fc65d41536 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lazy-loading 'fault' on Instance uuid 53347323-4870-4526-9020-1a3bc821d3fb {{(pid=131320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:23:33.229791 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-93edbb70-3dc3-4d51-b482-ee667bb3aad9 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e74c139b38d74d9ab93695471ccd3a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ff73d603ec4069a908452514a59451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:23:33.243739 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-93edbb70-3dc3-4d51-b482-ee667bb3aad9 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] 10.222.0.17 "GET /compute/v2.1/servers/dd8dace4-4427-490e-ad29-73092c943515" status: 200 len: 1355 microversion: 2.1 time: 0.610948 Jul 23 21:23:33.247521 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6ac0df73-6bc2-4b1f-ab5a-98fc65d41536 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf93a4b80cb4e19a36473986950fc75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c1943188684b45b636541caf587247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:23:33.255730 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1223/2411] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:32 2022] GET /compute/v2.1/servers/dd8dace4-4427-490e-ad29-73092c943515 => generated 1355 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:23:33.257088 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6ac0df73-6bc2-4b1f-ab5a-98fc65d41536 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] 10.222.0.17 "GET /compute/v2.1/servers/53347323-4870-4526-9020-1a3bc821d3fb" status: 200 len: 1303 microversion: 2.1 time: 0.351105 Jul 23 21:23:33.260523 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1189/2412] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:32 2022] GET /compute/v2.1/servers/53347323-4870-4526-9020-1a3bc821d3fb => generated 1303 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:33.393952 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-91b71f75-d524-4c5c-97fc-b9703b8d59b3 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Calling method '.version_select at 0x7f0b542301f0>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:33.478028 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-91b71f75-d524-4c5c-97fc-b9703b8d59b3 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] 10.222.0.17 "GET /compute/v2.1/images/e57c215e-ddc6-4510-9626-f3760a490e39" status: 200 len: 1428 microversion: 2.1 time: 0.089253 Jul 23 21:23:33.482439 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1224/2413] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:23:33 2022] GET /compute/v2.1/images/e57c215e-ddc6-4510-9626-f3760a490e39 => generated 1428 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:33.512263 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-4dce4952-716d-48b7-8803-bd556883ed4f req-4a7713a0-f920-427f-99fc-5101d2868105 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53347323-4870-4526-9020-1a3bc821d3fb", "name": "network-vif-deleted", "tag": "72be27c3-d279-4821-adcd-249529e1fbe0"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:23:33.528471 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-4dce4952-716d-48b7-8803-bd556883ed4f req-4a7713a0-f920-427f-99fc-5101d2868105 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:33.529172 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-4dce4952-716d-48b7-8803-bd556883ed4f req-4a7713a0-f920-427f-99fc-5101d2868105 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:33.552934 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-4dce4952-716d-48b7-8803-bd556883ed4f req-4a7713a0-f920-427f-99fc-5101d2868105 service nova] Creating event network-vif-deleted:72be27c3-d279-4821-adcd-249529e1fbe0 for instance 53347323-4870-4526-9020-1a3bc821d3fb on nch1-master-1 Jul 23 21:23:33.572005 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-4dce4952-716d-48b7-8803-bd556883ed4f req-4a7713a0-f920-427f-99fc-5101d2868105 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063784 Jul 23 21:23:33.572923 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1190/2414] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:23:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:23:33.722004 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-63453273-aecf-45d0-a588-e1e21b6a6cb1 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:33.723034 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-63453273-aecf-45d0-a588-e1e21b6a6cb1 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] [instance: 4ef8cf58-9580-495b-9212-8cb8c837354c] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:33.741443 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-63453273-aecf-45d0-a588-e1e21b6a6cb1 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:33.752071 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-63453273-aecf-45d0-a588-e1e21b6a6cb1 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:33.758642 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-63453273-aecf-45d0-a588-e1e21b6a6cb1 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:33.761534 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-63453273-aecf-45d0-a588-e1e21b6a6cb1 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:34.262561 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-818aaed2-fd83-4713-9bda-f017e4513715 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:34.264724 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-818aaed2-fd83-4713-9bda-f017e4513715 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] [instance: dd8dace4-4427-490e-ad29-73092c943515] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:34.284189 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-818aaed2-fd83-4713-9bda-f017e4513715 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:34.288904 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-818aaed2-fd83-4713-9bda-f017e4513715 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:34.290174 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-818aaed2-fd83-4713-9bda-f017e4513715 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:34.290816 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-818aaed2-fd83-4713-9bda-f017e4513715 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:34.308649 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-63453273-aecf-45d0-a588-e1e21b6a6cb1 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ca7a39a8174a4b97767245e80b2bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55cfd65431cf4b878ab1c0e25a0ac629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:23:34.324910 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-63453273-aecf-45d0-a588-e1e21b6a6cb1 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] 10.222.0.17 "GET /compute/v2.1/servers/4ef8cf58-9580-495b-9212-8cb8c837354c" status: 200 len: 1572 microversion: 2.1 time: 0.606813 Jul 23 21:23:34.327619 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1225/2415] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:33 2022] GET /compute/v2.1/servers/4ef8cf58-9580-495b-9212-8cb8c837354c => generated 1572 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:34.342160 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-9587bfe8-9c86-4c1b-ba81-7f17ab36762d tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:34.343704 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-9587bfe8-9c86-4c1b-ba81-7f17ab36762d tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] [instance: 53347323-4870-4526-9020-1a3bc821d3fb] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:34.364395 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9587bfe8-9c86-4c1b-ba81-7f17ab36762d tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:34.365448 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9587bfe8-9c86-4c1b-ba81-7f17ab36762d tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:34.366967 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9587bfe8-9c86-4c1b-ba81-7f17ab36762d tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:34.367626 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9587bfe8-9c86-4c1b-ba81-7f17ab36762d tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:34.401174 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-9587bfe8-9c86-4c1b-ba81-7f17ab36762d tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] HTTP exception thrown: Instance 53347323-4870-4526-9020-1a3bc821d3fb could not be found. Jul 23 21:23:34.403668 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-9587bfe8-9c86-4c1b-ba81-7f17ab36762d tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Request method failure captured: Jul 23 21:23:34.403668 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/servers/53347323-4870-4526-9020-1a3bc821d3fb HTTP/1.1 Jul 23 21:23:34.403668 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:23:34.403668 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:23:34.403668 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:23:34.403668 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:23:34.403668 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:23:34.403668 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:23:34.403668 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:23:34.403668 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:23:34.403668 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GZAonwSDWtmSSoetBzZo6VFSnCPJBYrpHZTQMwPtEFsaedad-XtITkUU8d1u55uykAKkKYVRZBW2KiJ3kX9zCz6j-GHNtNSMeDCWsZ9PY9Qcw-Jom4quZnr5YUF2_4VDrqqFcdVv0SDG9AZGjSVpIuXFdhlht4nr8jpg0BRSrvN7eQ Jul 23 21:23:34.403668 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:23:34.403668 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:23:34.403668 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:23:34.403668 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:23:34.403668 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:23:34.403668 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:23:34.403668 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 35c1943188684b45b636541caf587247 Jul 23 21:23:34.403668 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ServersAdminTestJSON-677192649 Jul 23 21:23:34.403668 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:23:34.403668 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:23:34.403668 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/35c1943188684b45b636541caf587247"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/35c1943188684b45b636541caf587247"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_35c1943188684b45b636541caf587247", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/35c1943188684b45b636541caf587247"}]}] Jul 23 21:23:34.403668 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ServersAdminTestJSON-677192649 Jul 23 21:23:34.403668 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 35c1943188684b45b636541caf587247 Jul 23 21:23:34.403668 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ServersAdminTestJSON-677192649 Jul 23 21:23:34.403668 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ServersAdminTestJSON-677192649-project Jul 23 21:23:34.403668 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:23:34.403668 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:23:34.403668 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: ebf93a4b80cb4e19a36473986950fc75 Jul 23 21:23:34.403668 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ServersAdminTestJSON-677192649-project Jul 23 21:23:34.403668 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:23:34.403668 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance 53347323-4870-4526-9020-1a3bc821d3fb could not be found. Jul 23 21:23:34.403668 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': '53347323-4870-4526-9020-1a3bc821d3fb'} Jul 23 21:23:34.403668 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:23:34.403668 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:23:34.403668 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:23:34.403668 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:23:34.403668 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:23:34.403668 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:23:34.403668 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:23:34.403668 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:23:34.403668 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:23:34.403668 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:23:34.403668 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53347323-4870-4526-9020-1a3bc821d3fb could not be found. Jul 23 21:23:34.403668 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:23:34.403668 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:23:34.403668 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:23:34.403668 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:23:34.403668 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:23:34.403668 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:23:34.403668 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:23:34.403668 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:23:34.403668 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:23:34.403668 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:23:34.403668 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:23:34.403668 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:23:34.403668 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:23:34.403668 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:23:34.403668 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:23:34.403668 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:23:34.403668 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53347323-4870-4526-9020-1a3bc821d3fb could not be found. Jul 23 21:23:34.403668 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:23:34.403668 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:23:34.403668 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:23:34.407259 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:23:34.407259 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:23:34.407259 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:23:34.407259 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:23:34.407259 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:23:34.407259 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53347323-4870-4526-9020-1a3bc821d3fb could not be found. Jul 23 21:23:34.407259 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:23:34.409455 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-9587bfe8-9c86-4c1b-ba81-7f17ab36762d tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Returning 404 to user: Instance 53347323-4870-4526-9020-1a3bc821d3fb could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:23:34.410581 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-9587bfe8-9c86-4c1b-ba81-7f17ab36762d tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] 10.222.0.17 "GET /compute/v2.1/servers/53347323-4870-4526-9020-1a3bc821d3fb" status: 404 len: 111 microversion: 2.1 time: 0.081223 Jul 23 21:23:34.411332 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1226/2416] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:34 2022] GET /compute/v2.1/servers/53347323-4870-4526-9020-1a3bc821d3fb => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:23:34.422599 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e55fb02f-a1c8-4102-b3ec-9fa6adf0f209 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-66294799"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:23:34.427486 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-e55fb02f-a1c8-4102-b3ec-9fa6adf0f209 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] [instance: 4ef8cf58-9580-495b-9212-8cb8c837354c] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:34.445470 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e55fb02f-a1c8-4102-b3ec-9fa6adf0f209 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:34.446344 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e55fb02f-a1c8-4102-b3ec-9fa6adf0f209 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:34.449091 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e55fb02f-a1c8-4102-b3ec-9fa6adf0f209 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:34.449822 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e55fb02f-a1c8-4102-b3ec-9fa6adf0f209 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:34.745319 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.network.security_group_api [None req-e55fb02f-a1c8-4102-b3ec-9fa6adf0f209 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Adding security group d7e90c28-a20c-4df7-8357-81391faf06c4 to port f3b1c335-5a3b-4dfb-922c-b66dcb9104fd Jul 23 21:23:34.973444 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-818aaed2-fd83-4713-9bda-f017e4513715 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e74c139b38d74d9ab93695471ccd3a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ff73d603ec4069a908452514a59451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:23:34.981955 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-818aaed2-fd83-4713-9bda-f017e4513715 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] 10.222.0.17 "GET /compute/v2.1/servers/dd8dace4-4427-490e-ad29-73092c943515" status: 200 len: 1355 microversion: 2.1 time: 0.724714 Jul 23 21:23:34.985694 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1191/2417] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:34 2022] GET /compute/v2.1/servers/dd8dace4-4427-490e-ad29-73092c943515 => generated 1355 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:34.993218 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1c4ff8af-7af2-44d4-96fd-565977d50757 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:34.993711 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1c4ff8af-7af2-44d4-96fd-565977d50757 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] [instance: 6435faed-ac55-4f93-ac79-2668c6538209] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:35.017357 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1c4ff8af-7af2-44d4-96fd-565977d50757 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:35.018634 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1c4ff8af-7af2-44d4-96fd-565977d50757 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:35.018770 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1c4ff8af-7af2-44d4-96fd-565977d50757 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:35.019383 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1c4ff8af-7af2-44d4-96fd-565977d50757 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:35.072152 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1c4ff8af-7af2-44d4-96fd-565977d50757 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] [instance: 6435faed-ac55-4f93-ac79-2668c6538209] Going to try to terminate instance {{(pid=131320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:23:35.235196 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1c4ff8af-7af2-44d4-96fd-565977d50757 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] 10.222.0.17 "DELETE /compute/v2.1/servers/6435faed-ac55-4f93-ac79-2668c6538209" status: 204 len: 0 microversion: 2.1 time: 0.247865 Jul 23 21:23:35.244151 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1192/2418] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:23:34 2022] DELETE /compute/v2.1/servers/6435faed-ac55-4f93-ac79-2668c6538209 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:23:35.264778 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8508cd3e-c5a3-43fc-bf91-6205f20a4c8d tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Calling method '.version_select at 0x7f0b47d12790>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:35.378098 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8508cd3e-c5a3-43fc-bf91-6205f20a4c8d tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] 10.222.0.17 "GET /compute/v2.1/images/e57c215e-ddc6-4510-9626-f3760a490e39" status: 200 len: 1428 microversion: 2.1 time: 0.129994 Jul 23 21:23:35.378944 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1193/2419] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:23:35 2022] GET /compute/v2.1/images/e57c215e-ddc6-4510-9626-f3760a490e39 => generated 1428 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:35.435515 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-e55fb02f-a1c8-4102-b3ec-9fa6adf0f209 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] 10.222.0.17 "POST /compute/v2.1/servers/4ef8cf58-9580-495b-9212-8cb8c837354c/action" status: 202 len: 0 microversion: 2.1 time: 1.017194 Jul 23 21:23:35.436461 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1227/2420] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:23:34 2022] POST /compute/v2.1/servers/4ef8cf58-9580-495b-9212-8cb8c837354c/action => generated 0 bytes in 1024 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:23:35.448651 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-2d798ed3-4707-4bb0-bf48-596f3a6a5616 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:35.450095 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-2d798ed3-4707-4bb0-bf48-596f3a6a5616 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] [instance: 6435faed-ac55-4f93-ac79-2668c6538209] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:35.466744 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2d798ed3-4707-4bb0-bf48-596f3a6a5616 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:35.467202 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2d798ed3-4707-4bb0-bf48-596f3a6a5616 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:35.469957 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2d798ed3-4707-4bb0-bf48-596f3a6a5616 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:35.473703 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2d798ed3-4707-4bb0-bf48-596f3a6a5616 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:35.539810 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-698b9fca-06f8-4857-afc2-d9fac83a6614 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Action: 'create', calling method: .version_select at 0x7f0b540a8e50>, body: {"keypair": {"name": "tempest-keypair-1667120724", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLKjwCjsPTJzl5GstTqwt+WZb4Nh87lfrf5LmFNiSB2hq7NaXrrYRjRJyWLFxGRurK7imoZEzwt/Wjq0uQnsIoIGHn06/tZzKjfEW+y1aj3ZEmv5JsbrY6ocKVprJXAz4Q=="}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:23:35.569719 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-698b9fca-06f8-4857-afc2-d9fac83a6614 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Getting quotas for project 1432b2e152894407afae7b6419d80a8c. Resources: {'key_pairs'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:23:35.592287 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-698b9fca-06f8-4857-afc2-d9fac83a6614 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Getting quotas for user 013b521930d54d6d952e566f8e67f466 and project 1432b2e152894407afae7b6419d80a8c. Resources: {'key_pairs'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:23:35.633299 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-698b9fca-06f8-4857-afc2-d9fac83a6614 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.252090 Jul 23 21:23:35.640417 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1194/2421] 10.222.0.17 () {60 vars in 1158 bytes} [Sat Jul 23 21:23:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:23:35.641413 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-733651bb-8b6b-4c0b-9659-dfbbf315316e tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Calling method '.version_select at 0x7f0b47de68b0>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:35.934120 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-2d798ed3-4707-4bb0-bf48-596f3a6a5616 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf93a4b80cb4e19a36473986950fc75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c1943188684b45b636541caf587247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:23:35.945644 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-2d798ed3-4707-4bb0-bf48-596f3a6a5616 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] 10.222.0.17 "GET /compute/v2.1/servers/6435faed-ac55-4f93-ac79-2668c6538209" status: 200 len: 1468 microversion: 2.1 time: 0.507872 Jul 23 21:23:35.946358 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1228/2422] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:35 2022] GET /compute/v2.1/servers/6435faed-ac55-4f93-ac79-2668c6538209 => generated 1468 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:35.978875 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-3eca5334-23c1-4a81-b74c-883f659a91ef req-9fe4c0f7-0036-4c0d-8b38-dfce88b8bb31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ef8cf58-9580-495b-9212-8cb8c837354c", "tag": "f3b1c335-5a3b-4dfb-922c-b66dcb9104fd"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:23:36.002434 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-3eca5334-23c1-4a81-b74c-883f659a91ef req-9fe4c0f7-0036-4c0d-8b38-dfce88b8bb31 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:36.002892 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-3eca5334-23c1-4a81-b74c-883f659a91ef req-9fe4c0f7-0036-4c0d-8b38-dfce88b8bb31 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:36.045081 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-3eca5334-23c1-4a81-b74c-883f659a91ef req-9fe4c0f7-0036-4c0d-8b38-dfce88b8bb31 service nova] Creating event network-changed:f3b1c335-5a3b-4dfb-922c-b66dcb9104fd for instance 4ef8cf58-9580-495b-9212-8cb8c837354c on nch1-master-1 Jul 23 21:23:36.068943 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-3eca5334-23c1-4a81-b74c-883f659a91ef req-9fe4c0f7-0036-4c0d-8b38-dfce88b8bb31 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120955 Jul 23 21:23:36.069570 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1229/2423] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:23:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:23:36.082612 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-297903dc-a762-49c1-8bfc-3723a472d9b0 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:36.098551 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-297903dc-a762-49c1-8bfc-3723a472d9b0 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] [instance: dd8dace4-4427-490e-ad29-73092c943515] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:36.113887 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-297903dc-a762-49c1-8bfc-3723a472d9b0 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:36.114334 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-297903dc-a762-49c1-8bfc-3723a472d9b0 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:36.115089 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-297903dc-a762-49c1-8bfc-3723a472d9b0 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:36.115639 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-297903dc-a762-49c1-8bfc-3723a472d9b0 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:36.143571 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:23:36.348268 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-297903dc-a762-49c1-8bfc-3723a472d9b0 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e74c139b38d74d9ab93695471ccd3a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ff73d603ec4069a908452514a59451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:23:36.356860 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-297903dc-a762-49c1-8bfc-3723a472d9b0 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] 10.222.0.17 "GET /compute/v2.1/servers/dd8dace4-4427-490e-ad29-73092c943515" status: 200 len: 1355 microversion: 2.1 time: 0.278356 Jul 23 21:23:36.364162 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1230/2424] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:36 2022] GET /compute/v2.1/servers/dd8dace4-4427-490e-ad29-73092c943515 => generated 1355 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:36.392533 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-1057ade8-cd35-4acd-8a0c-7df324ab72a0 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Calling method '.version_select at 0x7f0b47ee60d0>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:36.472306 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-1057ade8-cd35-4acd-8a0c-7df324ab72a0 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] 10.222.0.17 "GET /compute/v2.1/images/e57c215e-ddc6-4510-9626-f3760a490e39" status: 200 len: 1428 microversion: 2.1 time: 0.084002 Jul 23 21:23:36.478346 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1231/2425] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:23:36 2022] GET /compute/v2.1/images/e57c215e-ddc6-4510-9626-f3760a490e39 => generated 1428 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:36.822105 ncdv-master-1 devstack@n-api.service[131320]: DEBUG neutronclient.v2_0.client [None req-733651bb-8b6b-4c0b-9659-dfbbf315316e tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group d7e90c28-a20c-4df7-8357-81391faf06c4 in use.", "detail": ""}} {{(pid=131320) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 23 21:23:36.823785 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-733651bb-8b6b-4c0b-9659-dfbbf315316e tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] HTTP exception thrown: Security Group d7e90c28-a20c-4df7-8357-81391faf06c4 in use. Jul 23 21:23:36.823785 ncdv-master-1 devstack@n-api.service[131320]: Neutron server returns request_ids: ['req-c81df3cf-98ac-46b2-a7a5-aa93de1c7621'] Jul 23 21:23:36.827119 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-733651bb-8b6b-4c0b-9659-dfbbf315316e tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Request method failure captured: Jul 23 21:23:36.827119 ncdv-master-1 devstack@n-api.service[131320]: request: DELETE /compute/v2.1/os-security-groups/d7e90c28-a20c-4df7-8357-81391faf06c4 HTTP/1.1 Jul 23 21:23:36.827119 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:23:36.827119 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:23:36.827119 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:23:36.827119 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:23:36.827119 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:23:36.827119 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:23:36.827119 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:23:36.827119 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:23:36.827119 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GabcedAy4zvEWDBz4psoyymQjd20otmwoBk14VBCrO5T_u930hsqstuKWfxSIIHSaoINyY7aouwTaS_UH5MldJcqSCrcSo-BYQbnUPzf2q6ne_dSigo_8PievK59Q_5ElGzDVdSYredgO26R1rdGGAuE9yewD0hcCJzYqqhzyGW3Zk Jul 23 21:23:36.827119 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:23:36.827119 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:23:36.827119 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:23:36.827119 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:23:36.827119 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:23:36.827119 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:23:36.827119 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 55cfd65431cf4b878ab1c0e25a0ac629 Jul 23 21:23:36.827119 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-SecurityGroupsTestJSON-553336269 Jul 23 21:23:36.827119 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:23:36.827119 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:23:36.827119 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/55cfd65431cf4b878ab1c0e25a0ac629"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/55cfd65431cf4b878ab1c0e25a0ac629"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_55cfd65431cf4b878ab1c0e25a0ac629", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/55cfd65431cf4b878ab1c0e25a0ac629"}]}] Jul 23 21:23:36.827119 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-SecurityGroupsTestJSON-553336269 Jul 23 21:23:36.827119 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 55cfd65431cf4b878ab1c0e25a0ac629 Jul 23 21:23:36.827119 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-553336269 Jul 23 21:23:36.827119 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-SecurityGroupsTestJSON-553336269-project Jul 23 21:23:36.827119 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:23:36.827119 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:23:36.827119 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 63ca7a39a8174a4b97767245e80b2bf7 Jul 23 21:23:36.827119 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-SecurityGroupsTestJSON-553336269-project Jul 23 21:23:36.827119 ncdv-master-1 devstack@n-api.service[131320]: method: Jul 23 21:23:36.827119 ncdv-master-1 devstack@n-api.service[131320]: exception: Security Group d7e90c28-a20c-4df7-8357-81391faf06c4 in use. Jul 23 21:23:36.827119 ncdv-master-1 devstack@n-api.service[131320]: Neutron server returns request_ids: ['req-c81df3cf-98ac-46b2-a7a5-aa93de1c7621'] Jul 23 21:23:36.827119 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': 'd7e90c28-a20c-4df7-8357-81391faf06c4'} Jul 23 21:23:36.827119 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:23:36.827119 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:23:36.827119 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jul 23 21:23:36.827119 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jul 23 21:23:36.827119 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:23:36.827119 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:23:36.827119 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jul 23 21:23:36.827119 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jul 23 21:23:36.827119 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:23:36.827119 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:23:36.827119 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jul 23 21:23:36.827119 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jul 23 21:23:36.827119 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:23:36.827119 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:23:36.827119 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 23 21:23:36.827119 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 23 21:23:36.827119 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:23:36.827119 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:23:36.827119 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 23 21:23:36.827119 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 23 21:23:36.827119 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:23:36.827119 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:23:36.827119 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 23 21:23:36.827119 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 23 21:23:36.827119 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 23 21:23:36.827119 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 23 21:23:36.827119 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group d7e90c28-a20c-4df7-8357-81391faf06c4 in use. Jul 23 21:23:36.831403 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c81df3cf-98ac-46b2-a7a5-aa93de1c7621'] Jul 23 21:23:36.831403 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:23:36.831403 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:23:36.831403 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:23:36.831403 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:23:36.831403 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jul 23 21:23:36.831403 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jul 23 21:23:36.831403 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jul 23 21:23:36.831403 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jul 23 21:23:36.831403 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group d7e90c28-a20c-4df7-8357-81391faf06c4 in use. Jul 23 21:23:36.831403 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c81df3cf-98ac-46b2-a7a5-aa93de1c7621'] Jul 23 21:23:36.831403 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:23:36.831403 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:23:36.831403 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:23:36.831403 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:23:36.831403 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:23:36.831403 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:23:36.831403 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:23:36.831403 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:23:36.831403 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:23:36.831403 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:23:36.831403 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:23:36.831403 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:23:36.831403 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jul 23 21:23:36.831403 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 23 21:23:36.831403 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group d7e90c28-a20c-4df7-8357-81391faf06c4 in use. Jul 23 21:23:36.831403 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c81df3cf-98ac-46b2-a7a5-aa93de1c7621'] Jul 23 21:23:36.831403 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:23:36.831403 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:23:36.831403 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:23:36.831403 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:23:36.831403 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:23:36.831403 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:23:36.831403 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:23:36.831403 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:23:36.831403 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group d7e90c28-a20c-4df7-8357-81391faf06c4 in use. Jul 23 21:23:36.831403 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c81df3cf-98ac-46b2-a7a5-aa93de1c7621'] Jul 23 21:23:36.831403 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:23:36.838318 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-733651bb-8b6b-4c0b-9659-dfbbf315316e tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Returning 400 to user: Security Group d7e90c28-a20c-4df7-8357-81391faf06c4 in use. Jul 23 21:23:36.838318 ncdv-master-1 devstack@n-api.service[131320]: Neutron server returns request_ids: ['req-c81df3cf-98ac-46b2-a7a5-aa93de1c7621'] {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:23:36.839737 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-733651bb-8b6b-4c0b-9659-dfbbf315316e tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/d7e90c28-a20c-4df7-8357-81391faf06c4" status: 400 len: 185 microversion: 2.1 time: 1.202723 Jul 23 21:23:36.840846 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1195/2426] 10.222.0.17 () {58 vars in 1271 bytes} [Sat Jul 23 21:23:35 2022] DELETE /compute/v2.1/os-security-groups/d7e90c28-a20c-4df7-8357-81391faf06c4 => generated 185 bytes in 1205 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 23 21:23:36.849493 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-b6e0e618-fcd7-4ef0-bf15-caf6fc366106 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:36.852394 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-b6e0e618-fcd7-4ef0-bf15-caf6fc366106 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] [instance: 4ef8cf58-9580-495b-9212-8cb8c837354c] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:36.867246 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b6e0e618-fcd7-4ef0-bf15-caf6fc366106 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:36.867705 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b6e0e618-fcd7-4ef0-bf15-caf6fc366106 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:36.868504 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b6e0e618-fcd7-4ef0-bf15-caf6fc366106 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:36.868941 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b6e0e618-fcd7-4ef0-bf15-caf6fc366106 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:36.900865 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-b6e0e618-fcd7-4ef0-bf15-caf6fc366106 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] [instance: 4ef8cf58-9580-495b-9212-8cb8c837354c] Going to try to terminate instance {{(pid=131321) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:23:36.963567 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9c3219c2-0cc7-4612-86ae-9a473b0668a4 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:36.964381 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-9c3219c2-0cc7-4612-86ae-9a473b0668a4 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] [instance: 6435faed-ac55-4f93-ac79-2668c6538209] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:37.011866 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9c3219c2-0cc7-4612-86ae-9a473b0668a4 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:37.012336 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9c3219c2-0cc7-4612-86ae-9a473b0668a4 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:37.018868 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9c3219c2-0cc7-4612-86ae-9a473b0668a4 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:37.028090 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9c3219c2-0cc7-4612-86ae-9a473b0668a4 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:37.188745 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-b6e0e618-fcd7-4ef0-bf15-caf6fc366106 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] 10.222.0.17 "DELETE /compute/v2.1/servers/4ef8cf58-9580-495b-9212-8cb8c837354c" status: 204 len: 0 microversion: 2.1 time: 0.340620 Jul 23 21:23:37.195679 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1232/2427] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:23:36 2022] DELETE /compute/v2.1/servers/4ef8cf58-9580-495b-9212-8cb8c837354c => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:23:37.215511 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f3cfd1a1-3742-4251-ae3d-617fe70a88b4 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:37.216292 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-f3cfd1a1-3742-4251-ae3d-617fe70a88b4 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] [instance: 4ef8cf58-9580-495b-9212-8cb8c837354c] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:37.234449 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f3cfd1a1-3742-4251-ae3d-617fe70a88b4 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:37.234907 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f3cfd1a1-3742-4251-ae3d-617fe70a88b4 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:37.238267 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f3cfd1a1-3742-4251-ae3d-617fe70a88b4 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:37.238715 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f3cfd1a1-3742-4251-ae3d-617fe70a88b4 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:37.469847 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-9c3219c2-0cc7-4612-86ae-9a473b0668a4 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf93a4b80cb4e19a36473986950fc75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c1943188684b45b636541caf587247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:23:37.480991 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9c3219c2-0cc7-4612-86ae-9a473b0668a4 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] 10.222.0.17 "GET /compute/v2.1/servers/6435faed-ac55-4f93-ac79-2668c6538209" status: 200 len: 1468 microversion: 2.1 time: 0.521886 Jul 23 21:23:37.481585 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1196/2428] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:36 2022] GET /compute/v2.1/servers/6435faed-ac55-4f93-ac79-2668c6538209 => generated 1468 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:23:37.490408 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f942104b-2499-4f6f-887a-f61e1cfc5258 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:37.493061 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f942104b-2499-4f6f-887a-f61e1cfc5258 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] [instance: dd8dace4-4427-490e-ad29-73092c943515] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:37.509554 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f942104b-2499-4f6f-887a-f61e1cfc5258 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:37.510422 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f942104b-2499-4f6f-887a-f61e1cfc5258 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:37.511601 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f942104b-2499-4f6f-887a-f61e1cfc5258 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:37.512192 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f942104b-2499-4f6f-887a-f61e1cfc5258 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:37.891824 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f942104b-2499-4f6f-887a-f61e1cfc5258 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e74c139b38d74d9ab93695471ccd3a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ff73d603ec4069a908452514a59451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:23:37.907611 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f942104b-2499-4f6f-887a-f61e1cfc5258 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] 10.222.0.17 "GET /compute/v2.1/servers/dd8dace4-4427-490e-ad29-73092c943515" status: 200 len: 1355 microversion: 2.1 time: 0.420177 Jul 23 21:23:37.907611 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1197/2429] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:37 2022] GET /compute/v2.1/servers/dd8dace4-4427-490e-ad29-73092c943515 => generated 1355 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:37.911547 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d5ec6559-67a0-4fc0-bf04-4aa98246c081 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Calling method '.version_select at 0x7f0b59901550>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:38.006398 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d5ec6559-67a0-4fc0-bf04-4aa98246c081 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] 10.222.0.17 "GET /compute/v2.1/images/e57c215e-ddc6-4510-9626-f3760a490e39" status: 200 len: 1428 microversion: 2.1 time: 0.100999 Jul 23 21:23:38.015711 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1198/2430] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:23:37 2022] GET /compute/v2.1/images/e57c215e-ddc6-4510-9626-f3760a490e39 => generated 1428 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:38.242076 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-f3cfd1a1-3742-4251-ae3d-617fe70a88b4 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ca7a39a8174a4b97767245e80b2bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55cfd65431cf4b878ab1c0e25a0ac629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:23:38.257527 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-f3cfd1a1-3742-4251-ae3d-617fe70a88b4 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] 10.222.0.17 "GET /compute/v2.1/servers/4ef8cf58-9580-495b-9212-8cb8c837354c" status: 200 len: 1645 microversion: 2.1 time: 1.056243 Jul 23 21:23:38.258505 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1233/2431] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:37 2022] GET /compute/v2.1/servers/4ef8cf58-9580-495b-9212-8cb8c837354c => generated 1645 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:38.312906 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-4d567e25-0401-4b41-bcd4-9dcd43de3eba req-3da02bf9-7343-4fee-a3d7-90038d6bb094 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6929bb48-ae83-4078-8df7-60124c837ea3", "name": "network-vif-plugged", "status": "completed", "tag": "1e3e8f57-3c77-4c90-ad4e-1a9f4efa146d"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:23:38.339699 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-4d567e25-0401-4b41-bcd4-9dcd43de3eba req-3da02bf9-7343-4fee-a3d7-90038d6bb094 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:38.340639 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-4d567e25-0401-4b41-bcd4-9dcd43de3eba req-3da02bf9-7343-4fee-a3d7-90038d6bb094 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:38.357446 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-4d567e25-0401-4b41-bcd4-9dcd43de3eba req-3da02bf9-7343-4fee-a3d7-90038d6bb094 service nova] Creating event network-vif-plugged:1e3e8f57-3c77-4c90-ad4e-1a9f4efa146d for instance 6929bb48-ae83-4078-8df7-60124c837ea3 on nch2-master-1 Jul 23 21:23:38.387538 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-4d567e25-0401-4b41-bcd4-9dcd43de3eba req-3da02bf9-7343-4fee-a3d7-90038d6bb094 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080604 Jul 23 21:23:38.388701 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1199/2432] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:23:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:23:38.497835 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-06b39c5b-d5f7-45db-8ed0-441ff535c3ec tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:38.499236 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-06b39c5b-d5f7-45db-8ed0-441ff535c3ec tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] [instance: 6435faed-ac55-4f93-ac79-2668c6538209] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:38.512044 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-06b39c5b-d5f7-45db-8ed0-441ff535c3ec tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:38.515921 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-06b39c5b-d5f7-45db-8ed0-441ff535c3ec tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:38.516990 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-06b39c5b-d5f7-45db-8ed0-441ff535c3ec tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:38.517677 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-06b39c5b-d5f7-45db-8ed0-441ff535c3ec tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:38.921162 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-12ecc72a-d67b-4815-ae96-2521cd339877 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:38.922782 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-12ecc72a-d67b-4815-ae96-2521cd339877 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] [instance: dd8dace4-4427-490e-ad29-73092c943515] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:38.937552 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-12ecc72a-d67b-4815-ae96-2521cd339877 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:38.939269 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-12ecc72a-d67b-4815-ae96-2521cd339877 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:38.946107 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-12ecc72a-d67b-4815-ae96-2521cd339877 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:38.946570 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-12ecc72a-d67b-4815-ae96-2521cd339877 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:39.636033 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-12ecc72a-d67b-4815-ae96-2521cd339877 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e74c139b38d74d9ab93695471ccd3a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ff73d603ec4069a908452514a59451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:23:39.650350 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-12ecc72a-d67b-4815-ae96-2521cd339877 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] 10.222.0.17 "GET /compute/v2.1/servers/dd8dace4-4427-490e-ad29-73092c943515" status: 200 len: 1355 microversion: 2.1 time: 0.733763 Jul 23 21:23:39.653989 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1200/2433] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:38 2022] GET /compute/v2.1/servers/dd8dace4-4427-490e-ad29-73092c943515 => generated 1355 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:39.666008 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-7d70a368-e389-4e7c-a4f5-039a6940d58c tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Calling method '.version_select at 0x7f0b47e60f70>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:39.774987 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-7d70a368-e389-4e7c-a4f5-039a6940d58c tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] 10.222.0.17 "GET /compute/v2.1/images/e57c215e-ddc6-4510-9626-f3760a490e39" status: 200 len: 1428 microversion: 2.1 time: 0.119620 Jul 23 21:23:39.775228 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-06b39c5b-d5f7-45db-8ed0-441ff535c3ec tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf93a4b80cb4e19a36473986950fc75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c1943188684b45b636541caf587247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:23:39.781818 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1201/2434] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:23:39 2022] GET /compute/v2.1/images/e57c215e-ddc6-4510-9626-f3760a490e39 => generated 1428 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:39.791281 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-06b39c5b-d5f7-45db-8ed0-441ff535c3ec tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] 10.222.0.17 "GET /compute/v2.1/servers/6435faed-ac55-4f93-ac79-2668c6538209" status: 200 len: 1468 microversion: 2.1 time: 1.296309 Jul 23 21:23:39.825172 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1234/2435] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:38 2022] GET /compute/v2.1/servers/6435faed-ac55-4f93-ac79-2668c6538209 => generated 1468 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:39.845953 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1cba0756-9e2f-4c64-8bdd-1771c9269e15 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:39.847147 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1cba0756-9e2f-4c64-8bdd-1771c9269e15 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] [instance: 4ef8cf58-9580-495b-9212-8cb8c837354c] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:39.863470 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1cba0756-9e2f-4c64-8bdd-1771c9269e15 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:39.864397 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1cba0756-9e2f-4c64-8bdd-1771c9269e15 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:39.871848 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1cba0756-9e2f-4c64-8bdd-1771c9269e15 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:39.872508 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-cba44d5e-4599-4db8-be52-383a32361682 req-1d82f0b1-bfad-47e6-a408-910961016ca5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6435faed-ac55-4f93-ac79-2668c6538209", "name": "network-vif-deleted", "tag": "8060587e-b8d0-4cf9-a507-563dad5e39bf"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:23:39.878096 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1cba0756-9e2f-4c64-8bdd-1771c9269e15 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:39.918340 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-cba44d5e-4599-4db8-be52-383a32361682 req-1d82f0b1-bfad-47e6-a408-910961016ca5 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:39.919110 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-cba44d5e-4599-4db8-be52-383a32361682 req-1d82f0b1-bfad-47e6-a408-910961016ca5 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:39.990216 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-cba44d5e-4599-4db8-be52-383a32361682 req-1d82f0b1-bfad-47e6-a408-910961016ca5 service nova] Creating event network-vif-deleted:8060587e-b8d0-4cf9-a507-563dad5e39bf for instance 6435faed-ac55-4f93-ac79-2668c6538209 on nch2-master-1 Jul 23 21:23:40.011733 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-cba44d5e-4599-4db8-be52-383a32361682 req-1d82f0b1-bfad-47e6-a408-910961016ca5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.162103 Jul 23 21:23:40.013115 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1235/2436] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:23:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:23:40.676416 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-55d829fb-25e4-49bd-bc36-efd108af0328 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:40.677145 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-55d829fb-25e4-49bd-bc36-efd108af0328 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] [instance: dd8dace4-4427-490e-ad29-73092c943515] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:40.710622 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-55d829fb-25e4-49bd-bc36-efd108af0328 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:40.725916 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-55d829fb-25e4-49bd-bc36-efd108af0328 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:40.727730 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-55d829fb-25e4-49bd-bc36-efd108af0328 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:40.728048 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-55d829fb-25e4-49bd-bc36-efd108af0328 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:41.096265 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-55d829fb-25e4-49bd-bc36-efd108af0328 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e74c139b38d74d9ab93695471ccd3a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ff73d603ec4069a908452514a59451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:23:41.111789 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-55d829fb-25e4-49bd-bc36-efd108af0328 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] 10.222.0.17 "GET /compute/v2.1/servers/dd8dace4-4427-490e-ad29-73092c943515" status: 200 len: 1355 microversion: 2.1 time: 0.443465 Jul 23 21:23:41.115247 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1236/2437] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:40 2022] GET /compute/v2.1/servers/dd8dace4-4427-490e-ad29-73092c943515 => generated 1355 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:41.133370 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-41c22e11-b584-4c59-a59d-ee9d9b9e3766 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Calling method '.version_select at 0x7f0b599e6af0>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:41.228806 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-41c22e11-b584-4c59-a59d-ee9d9b9e3766 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] 10.222.0.17 "GET /compute/v2.1/images/e57c215e-ddc6-4510-9626-f3760a490e39" status: 200 len: 1428 microversion: 2.1 time: 0.110964 Jul 23 21:23:41.229449 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1237/2438] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:23:41 2022] GET /compute/v2.1/images/e57c215e-ddc6-4510-9626-f3760a490e39 => generated 1428 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:41.244196 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-9bca3405-5b27-405e-b762-47a802768f08 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "f84f2434-0a11-4e95-94c8-56786f5aea37"}], "security_groups": [{"name": "tempest-securitygroup--2021013398"}], "key_name": "tempest-keypair-1667120724", "user_data": "}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:23:41.287127 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-1cba0756-9e2f-4c64-8bdd-1771c9269e15 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ca7a39a8174a4b97767245e80b2bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55cfd65431cf4b878ab1c0e25a0ac629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:23:41.299937 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1cba0756-9e2f-4c64-8bdd-1771c9269e15 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] 10.222.0.17 "GET /compute/v2.1/servers/4ef8cf58-9580-495b-9212-8cb8c837354c" status: 200 len: 1645 microversion: 2.1 time: 1.512219 Jul 23 21:23:41.300840 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1202/2439] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:39 2022] GET /compute/v2.1/servers/4ef8cf58-9580-495b-9212-8cb8c837354c => generated 1645 bytes in 1518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:41.315421 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5d24b05f-78d4-432d-b407-a8d2df9b5e76 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:41.316457 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5d24b05f-78d4-432d-b407-a8d2df9b5e76 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] [instance: 6435faed-ac55-4f93-ac79-2668c6538209] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:41.328864 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5d24b05f-78d4-432d-b407-a8d2df9b5e76 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:41.329813 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5d24b05f-78d4-432d-b407-a8d2df9b5e76 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:41.330744 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5d24b05f-78d4-432d-b407-a8d2df9b5e76 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:41.331251 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5d24b05f-78d4-432d-b407-a8d2df9b5e76 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:41.380324 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-5d24b05f-78d4-432d-b407-a8d2df9b5e76 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] HTTP exception thrown: Instance 6435faed-ac55-4f93-ac79-2668c6538209 could not be found. Jul 23 21:23:41.386394 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5d24b05f-78d4-432d-b407-a8d2df9b5e76 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Request method failure captured: Jul 23 21:23:41.386394 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/6435faed-ac55-4f93-ac79-2668c6538209 HTTP/1.1 Jul 23 21:23:41.386394 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:23:41.386394 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:23:41.386394 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:23:41.386394 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:23:41.386394 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:23:41.386394 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:23:41.386394 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:23:41.386394 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:23:41.386394 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GZAonwSDWtmSSoetBzZo6VFSnCPJBYrpHZTQMwPtEFsaedad-XtITkUU8d1u55uykAKkKYVRZBW2KiJ3kX9zCz6j-GHNtNSMeDCWsZ9PY9Qcw-Jom4quZnr5YUF2_4VDrqqFcdVv0SDG9AZGjSVpIuXFdhlht4nr8jpg0BRSrvN7eQ Jul 23 21:23:41.386394 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:23:41.386394 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:23:41.386394 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:23:41.386394 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:23:41.386394 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:23:41.386394 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:23:41.386394 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 35c1943188684b45b636541caf587247 Jul 23 21:23:41.386394 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServersAdminTestJSON-677192649 Jul 23 21:23:41.386394 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:23:41.386394 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:23:41.386394 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/35c1943188684b45b636541caf587247"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/35c1943188684b45b636541caf587247"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_35c1943188684b45b636541caf587247", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/35c1943188684b45b636541caf587247"}]}] Jul 23 21:23:41.386394 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServersAdminTestJSON-677192649 Jul 23 21:23:41.386394 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 35c1943188684b45b636541caf587247 Jul 23 21:23:41.386394 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServersAdminTestJSON-677192649 Jul 23 21:23:41.386394 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServersAdminTestJSON-677192649-project Jul 23 21:23:41.386394 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:23:41.386394 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:23:41.386394 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: ebf93a4b80cb4e19a36473986950fc75 Jul 23 21:23:41.386394 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServersAdminTestJSON-677192649-project Jul 23 21:23:41.386394 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:23:41.386394 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance 6435faed-ac55-4f93-ac79-2668c6538209 could not be found. Jul 23 21:23:41.386394 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '6435faed-ac55-4f93-ac79-2668c6538209'} Jul 23 21:23:41.386394 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:23:41.386394 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:23:41.386394 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:23:41.386394 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:23:41.386394 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:23:41.386394 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:23:41.386394 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:23:41.386394 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:23:41.386394 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:23:41.386394 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:23:41.386394 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6435faed-ac55-4f93-ac79-2668c6538209 could not be found. Jul 23 21:23:41.386394 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:23:41.386394 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:23:41.386394 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:23:41.386394 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:23:41.386394 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:23:41.386394 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:23:41.386394 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:23:41.386394 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:23:41.386394 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:23:41.386394 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:23:41.386394 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:23:41.386394 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:23:41.386394 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:23:41.386394 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:23:41.386394 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:23:41.386394 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:23:41.386394 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6435faed-ac55-4f93-ac79-2668c6538209 could not be found. Jul 23 21:23:41.386394 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:23:41.386394 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:23:41.386394 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:23:41.390127 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:23:41.390127 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:23:41.390127 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:23:41.390127 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:23:41.390127 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:23:41.390127 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6435faed-ac55-4f93-ac79-2668c6538209 could not be found. Jul 23 21:23:41.390127 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:23:41.390127 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5d24b05f-78d4-432d-b407-a8d2df9b5e76 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Returning 404 to user: Instance 6435faed-ac55-4f93-ac79-2668c6538209 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:23:41.390127 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5d24b05f-78d4-432d-b407-a8d2df9b5e76 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] 10.222.0.17 "GET /compute/v2.1/servers/6435faed-ac55-4f93-ac79-2668c6538209" status: 404 len: 111 microversion: 2.1 time: 0.082942 Jul 23 21:23:41.390127 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1203/2440] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:41 2022] GET /compute/v2.1/servers/6435faed-ac55-4f93-ac79-2668c6538209 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:23:41.405783 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-78d950cf-3e1e-494d-a419-263856e320e5 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:41.406462 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-78d950cf-3e1e-494d-a419-263856e320e5 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] [instance: cef13563-7f83-4281-a26c-d5e420c41daf] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:41.433217 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-78d950cf-3e1e-494d-a419-263856e320e5 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:41.433723 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-78d950cf-3e1e-494d-a419-263856e320e5 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:41.437367 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-78d950cf-3e1e-494d-a419-263856e320e5 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:41.438066 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-78d950cf-3e1e-494d-a419-263856e320e5 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:41.489369 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-78d950cf-3e1e-494d-a419-263856e320e5 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] [instance: cef13563-7f83-4281-a26c-d5e420c41daf] Going to try to terminate instance {{(pid=131320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:23:41.584339 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.network.neutron [None req-9bca3405-5b27-405e-b762-47a802768f08 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] validate_networks() for [('f84f2434-0a11-4e95-94c8-56786f5aea37', None, None, None, None, None)] {{(pid=131321) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:23:41.596596 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:23:41.930139 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-78d950cf-3e1e-494d-a419-263856e320e5 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] 10.222.0.17 "DELETE /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf" status: 204 len: 0 microversion: 2.1 time: 0.534007 Jul 23 21:23:41.931473 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1204/2441] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:23:41 2022] DELETE /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf => generated 0 bytes in 539 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:23:41.950482 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-06f4e1b0-93c7-4dd3-b6d1-ef45c075b692 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:41.953339 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-06f4e1b0-93c7-4dd3-b6d1-ef45c075b692 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] [instance: cef13563-7f83-4281-a26c-d5e420c41daf] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:41.977334 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-06f4e1b0-93c7-4dd3-b6d1-ef45c075b692 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:41.979932 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-06f4e1b0-93c7-4dd3-b6d1-ef45c075b692 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:41.980851 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-06f4e1b0-93c7-4dd3-b6d1-ef45c075b692 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:41.981303 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-06f4e1b0-93c7-4dd3-b6d1-ef45c075b692 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:42.369519 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-06f4e1b0-93c7-4dd3-b6d1-ef45c075b692 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf93a4b80cb4e19a36473986950fc75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c1943188684b45b636541caf587247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:23:42.386371 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-06f4e1b0-93c7-4dd3-b6d1-ef45c075b692 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] 10.222.0.17 "GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf" status: 200 len: 1470 microversion: 2.1 time: 0.449851 Jul 23 21:23:42.389388 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1205/2442] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:41 2022] GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf => generated 1470 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:42.394645 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-5926ab97-2ea9-4483-8a95-346d1c5f2d73 req-09a66ee3-5334-4d65-b315-adc82f5eee99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ef8cf58-9580-495b-9212-8cb8c837354c", "name": "network-vif-deleted", "tag": "f3b1c335-5a3b-4dfb-922c-b66dcb9104fd"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:23:42.403208 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-9bca3405-5b27-405e-b762-47a802768f08 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Flavor limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:23:42.404158 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-9bca3405-5b27-405e-b762-47a802768f08 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Image limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:23:42.404798 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-9bca3405-5b27-405e-b762-47a802768f08 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Flavor pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:23:42.405370 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-9bca3405-5b27-405e-b762-47a802768f08 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Image pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:23:42.406241 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-9bca3405-5b27-405e-b762-47a802768f08 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:23:42.420521 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-5926ab97-2ea9-4483-8a95-346d1c5f2d73 req-09a66ee3-5334-4d65-b315-adc82f5eee99 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:42.429587 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-5926ab97-2ea9-4483-8a95-346d1c5f2d73 req-09a66ee3-5334-4d65-b315-adc82f5eee99 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:42.430257 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9bca3405-5b27-405e-b762-47a802768f08 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:42.430794 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9bca3405-5b27-405e-b762-47a802768f08 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:42.431690 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9bca3405-5b27-405e-b762-47a802768f08 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:42.436595 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9bca3405-5b27-405e-b762-47a802768f08 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:42.466476 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-5926ab97-2ea9-4483-8a95-346d1c5f2d73 req-09a66ee3-5334-4d65-b315-adc82f5eee99 service nova] Creating event network-vif-deleted:f3b1c335-5a3b-4dfb-922c-b66dcb9104fd for instance 4ef8cf58-9580-495b-9212-8cb8c837354c on nch1-master-1 Jul 23 21:23:42.484733 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-5926ab97-2ea9-4483-8a95-346d1c5f2d73 req-09a66ee3-5334-4d65-b315-adc82f5eee99 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093354 Jul 23 21:23:42.486343 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1206/2443] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:23:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:23:42.493213 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e3c170a6-ffe5-4d00-bf37-a78df1805bb8 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:42.494313 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e3c170a6-ffe5-4d00-bf37-a78df1805bb8 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] [instance: dd8dace4-4427-490e-ad29-73092c943515] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:42.502602 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-9bca3405-5b27-405e-b762-47a802768f08 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Getting quotas for project 1432b2e152894407afae7b6419d80a8c. Resources: {'ram', 'instances', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:23:42.506591 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e3c170a6-ffe5-4d00-bf37-a78df1805bb8 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:42.507401 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e3c170a6-ffe5-4d00-bf37-a78df1805bb8 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:42.515756 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e3c170a6-ffe5-4d00-bf37-a78df1805bb8 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:42.516548 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e3c170a6-ffe5-4d00-bf37-a78df1805bb8 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:42.532614 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-9bca3405-5b27-405e-b762-47a802768f08 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Getting quotas for user 013b521930d54d6d952e566f8e67f466 and project 1432b2e152894407afae7b6419d80a8c. Resources: {'ram', 'instances', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:23:42.579761 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-9bca3405-5b27-405e-b762-47a802768f08 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Going to run 1 instances... {{(pid=131321) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:23:42.584306 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-9bca3405-5b27-405e-b762-47a802768f08 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] [instance: 011c4ff9-9d46-44df-bf9b-e0269c71c417] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131321) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:23:42.729223 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-9bca3405-5b27-405e-b762-47a802768f08 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.496644 Jul 23 21:23:42.740555 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1238/2444] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:23:41 2022] POST /compute/v2.1/servers => generated 409 bytes in 1506 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 23 21:23:42.765524 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-0bfb54fb-f7a0-4b45-8afa-9a5a884468f1 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Calling method '.version_select at 0x7f0b47f1d0d0>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:42.882313 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-0bfb54fb-f7a0-4b45-8afa-9a5a884468f1 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] 10.222.0.17 "GET /compute/v2.1/images/e57c215e-ddc6-4510-9626-f3760a490e39" status: 200 len: 1428 microversion: 2.1 time: 0.145036 Jul 23 21:23:42.890071 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1239/2445] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:23:42 2022] GET /compute/v2.1/images/e57c215e-ddc6-4510-9626-f3760a490e39 => generated 1428 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:42.895049 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a5c6f8c1-626f-433e-8f1f-c3e33192332a tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:42.895664 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-a5c6f8c1-626f-433e-8f1f-c3e33192332a tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] [instance: 4ef8cf58-9580-495b-9212-8cb8c837354c] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:42.909992 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a5c6f8c1-626f-433e-8f1f-c3e33192332a tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:42.910851 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a5c6f8c1-626f-433e-8f1f-c3e33192332a tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:42.912205 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a5c6f8c1-626f-433e-8f1f-c3e33192332a tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:42.913019 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a5c6f8c1-626f-433e-8f1f-c3e33192332a tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:43.028984 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a5c6f8c1-626f-433e-8f1f-c3e33192332a tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:43.030962 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a5c6f8c1-626f-433e-8f1f-c3e33192332a tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:43.031559 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.objects.instance [None req-a5c6f8c1-626f-433e-8f1f-c3e33192332a tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lazy-loading 'fault' on Instance uuid 4ef8cf58-9580-495b-9212-8cb8c837354c {{(pid=131321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:23:43.133688 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-a5c6f8c1-626f-433e-8f1f-c3e33192332a tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ca7a39a8174a4b97767245e80b2bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55cfd65431cf4b878ab1c0e25a0ac629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:23:43.147571 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-a5c6f8c1-626f-433e-8f1f-c3e33192332a tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] 10.222.0.17 "GET /compute/v2.1/servers/4ef8cf58-9580-495b-9212-8cb8c837354c" status: 200 len: 1306 microversion: 2.1 time: 0.254155 Jul 23 21:23:43.150081 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1240/2446] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:42 2022] GET /compute/v2.1/servers/4ef8cf58-9580-495b-9212-8cb8c837354c => generated 1306 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:43.168456 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-b663bf47-d218-4dc1-9a21-888859ce4b08 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:43.176059 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-b663bf47-d218-4dc1-9a21-888859ce4b08 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] [instance: 011c4ff9-9d46-44df-bf9b-e0269c71c417] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:43.195514 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e3c170a6-ffe5-4d00-bf37-a78df1805bb8 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e74c139b38d74d9ab93695471ccd3a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ff73d603ec4069a908452514a59451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:23:43.203702 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e3c170a6-ffe5-4d00-bf37-a78df1805bb8 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] 10.222.0.17 "GET /compute/v2.1/servers/dd8dace4-4427-490e-ad29-73092c943515" status: 200 len: 1355 microversion: 2.1 time: 0.715766 Jul 23 21:23:43.213919 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1207/2447] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:42 2022] GET /compute/v2.1/servers/dd8dace4-4427-490e-ad29-73092c943515 => generated 1355 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:43.400460 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-b663bf47-d218-4dc1-9a21-888859ce4b08 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013b521930d54d6d952e566f8e67f466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1432b2e152894407afae7b6419d80a8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:23:43.405695 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-239fda6b-1e08-4bb7-96e3-cf41288084c8 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:43.406358 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-239fda6b-1e08-4bb7-96e3-cf41288084c8 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] [instance: cef13563-7f83-4281-a26c-d5e420c41daf] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:43.413692 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-b663bf47-d218-4dc1-9a21-888859ce4b08 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] 10.222.0.17 "GET /compute/v2.1/servers/011c4ff9-9d46-44df-bf9b-e0269c71c417" status: 200 len: 1226 microversion: 2.1 time: 0.256503 Jul 23 21:23:43.417707 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1241/2448] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:43 2022] GET /compute/v2.1/servers/011c4ff9-9d46-44df-bf9b-e0269c71c417 => generated 1226 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:43.425578 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-239fda6b-1e08-4bb7-96e3-cf41288084c8 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:43.426069 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-239fda6b-1e08-4bb7-96e3-cf41288084c8 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:43.426866 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-239fda6b-1e08-4bb7-96e3-cf41288084c8 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:43.446903 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-239fda6b-1e08-4bb7-96e3-cf41288084c8 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:43.896477 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-440eeb6f-5975-4f14-9a33-b2628436114d tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Calling method '.version_select at 0x7f0b47f7d790>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:44.016842 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-440eeb6f-5975-4f14-9a33-b2628436114d tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] 10.222.0.17 "GET /compute/v2.1/images/e57c215e-ddc6-4510-9626-f3760a490e39" status: 200 len: 1428 microversion: 2.1 time: 0.124967 Jul 23 21:23:44.019909 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1242/2449] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:23:43 2022] GET /compute/v2.1/images/e57c215e-ddc6-4510-9626-f3760a490e39 => generated 1428 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:44.171959 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-dafc5e63-1013-46b2-b85f-b1626378913d tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:44.173056 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-dafc5e63-1013-46b2-b85f-b1626378913d tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] [instance: 4ef8cf58-9580-495b-9212-8cb8c837354c] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:44.187189 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:23:44.192396 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-dafc5e63-1013-46b2-b85f-b1626378913d tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:44.193151 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-dafc5e63-1013-46b2-b85f-b1626378913d tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:44.194762 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-dafc5e63-1013-46b2-b85f-b1626378913d tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:44.196698 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-dafc5e63-1013-46b2-b85f-b1626378913d tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:44.245495 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-dafc5e63-1013-46b2-b85f-b1626378913d tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] HTTP exception thrown: Instance 4ef8cf58-9580-495b-9212-8cb8c837354c could not be found. Jul 23 21:23:44.250413 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-dafc5e63-1013-46b2-b85f-b1626378913d tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Request method failure captured: Jul 23 21:23:44.250413 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/servers/4ef8cf58-9580-495b-9212-8cb8c837354c HTTP/1.1 Jul 23 21:23:44.250413 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:23:44.250413 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:23:44.250413 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:23:44.250413 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:23:44.250413 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:23:44.250413 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:23:44.250413 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:23:44.250413 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:23:44.250413 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GabcedAy4zvEWDBz4psoyymQjd20otmwoBk14VBCrO5T_u930hsqstuKWfxSIIHSaoINyY7aouwTaS_UH5MldJcqSCrcSo-BYQbnUPzf2q6ne_dSigo_8PievK59Q_5ElGzDVdSYredgO26R1rdGGAuE9yewD0hcCJzYqqhzyGW3Zk Jul 23 21:23:44.250413 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:23:44.250413 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:23:44.250413 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:23:44.250413 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:23:44.250413 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:23:44.250413 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:23:44.250413 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 55cfd65431cf4b878ab1c0e25a0ac629 Jul 23 21:23:44.250413 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-SecurityGroupsTestJSON-553336269 Jul 23 21:23:44.250413 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:23:44.250413 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:23:44.250413 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/55cfd65431cf4b878ab1c0e25a0ac629"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/55cfd65431cf4b878ab1c0e25a0ac629"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_55cfd65431cf4b878ab1c0e25a0ac629", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/55cfd65431cf4b878ab1c0e25a0ac629"}]}] Jul 23 21:23:44.250413 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-SecurityGroupsTestJSON-553336269 Jul 23 21:23:44.250413 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 55cfd65431cf4b878ab1c0e25a0ac629 Jul 23 21:23:44.250413 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-553336269 Jul 23 21:23:44.250413 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-SecurityGroupsTestJSON-553336269-project Jul 23 21:23:44.250413 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:23:44.250413 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:23:44.250413 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 63ca7a39a8174a4b97767245e80b2bf7 Jul 23 21:23:44.250413 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-SecurityGroupsTestJSON-553336269-project Jul 23 21:23:44.250413 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:23:44.250413 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance 4ef8cf58-9580-495b-9212-8cb8c837354c could not be found. Jul 23 21:23:44.250413 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': '4ef8cf58-9580-495b-9212-8cb8c837354c'} Jul 23 21:23:44.250413 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:23:44.250413 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:23:44.250413 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:23:44.250413 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:23:44.250413 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:23:44.250413 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:23:44.250413 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:23:44.250413 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:23:44.250413 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:23:44.250413 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:23:44.250413 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ef8cf58-9580-495b-9212-8cb8c837354c could not be found. Jul 23 21:23:44.250413 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:23:44.250413 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:23:44.250413 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:23:44.250413 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:23:44.250413 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:23:44.250413 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:23:44.250413 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:23:44.250413 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:23:44.250413 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:23:44.250413 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:23:44.250413 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:23:44.250413 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:23:44.250413 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:23:44.250413 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:23:44.250413 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:23:44.250413 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:23:44.250413 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ef8cf58-9580-495b-9212-8cb8c837354c could not be found. Jul 23 21:23:44.250413 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:23:44.250413 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:23:44.250413 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:23:44.254178 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:23:44.254178 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:23:44.254178 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:23:44.254178 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:23:44.254178 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:23:44.254178 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ef8cf58-9580-495b-9212-8cb8c837354c could not be found. Jul 23 21:23:44.254178 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:23:44.259580 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-dafc5e63-1013-46b2-b85f-b1626378913d tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Returning 404 to user: Instance 4ef8cf58-9580-495b-9212-8cb8c837354c could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:23:44.261836 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-dafc5e63-1013-46b2-b85f-b1626378913d tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] 10.222.0.17 "GET /compute/v2.1/servers/4ef8cf58-9580-495b-9212-8cb8c837354c" status: 404 len: 111 microversion: 2.1 time: 0.095803 Jul 23 21:23:44.262906 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1243/2450] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:44 2022] GET /compute/v2.1/servers/4ef8cf58-9580-495b-9212-8cb8c837354c => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 23 21:23:44.268345 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-de7a2f24-6e35-47c9-a1ca-673442a3dc11 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:44.269533 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-de7a2f24-6e35-47c9-a1ca-673442a3dc11 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] [instance: dd8dace4-4427-490e-ad29-73092c943515] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:44.276832 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-de7a2f24-6e35-47c9-a1ca-673442a3dc11 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:44.278383 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-de7a2f24-6e35-47c9-a1ca-673442a3dc11 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:44.279813 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-de7a2f24-6e35-47c9-a1ca-673442a3dc11 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:44.280954 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-de7a2f24-6e35-47c9-a1ca-673442a3dc11 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:44.301073 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-239fda6b-1e08-4bb7-96e3-cf41288084c8 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf93a4b80cb4e19a36473986950fc75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c1943188684b45b636541caf587247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:23:44.319319 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-239fda6b-1e08-4bb7-96e3-cf41288084c8 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] 10.222.0.17 "GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf" status: 200 len: 1470 microversion: 2.1 time: 0.917341 Jul 23 21:23:44.320398 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1208/2451] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:43 2022] GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf => generated 1470 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:23:44.336178 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-34e1777b-8af5-45ba-bc94-685753c07714 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Calling method '.version_select at 0x7f0b599d8940>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:45.021378 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-de7a2f24-6e35-47c9-a1ca-673442a3dc11 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e74c139b38d74d9ab93695471ccd3a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ff73d603ec4069a908452514a59451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:23:45.043449 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-de7a2f24-6e35-47c9-a1ca-673442a3dc11 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] 10.222.0.17 "GET /compute/v2.1/servers/dd8dace4-4427-490e-ad29-73092c943515" status: 200 len: 1355 microversion: 2.1 time: 0.767582 Jul 23 21:23:45.052961 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1244/2452] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:44 2022] GET /compute/v2.1/servers/dd8dace4-4427-490e-ad29-73092c943515 => generated 1355 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:45.070795 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-0feb9b49-97ea-498d-8148-5ed2a31381dc tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:45.074131 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-0feb9b49-97ea-498d-8148-5ed2a31381dc tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] [instance: 011c4ff9-9d46-44df-bf9b-e0269c71c417] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:45.087806 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0feb9b49-97ea-498d-8148-5ed2a31381dc tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:45.090523 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0feb9b49-97ea-498d-8148-5ed2a31381dc tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:45.093392 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0feb9b49-97ea-498d-8148-5ed2a31381dc tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:45.094059 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0feb9b49-97ea-498d-8148-5ed2a31381dc tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:45.208025 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-34e1777b-8af5-45ba-bc94-685753c07714 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/4b0e40dc-a08b-49e5-a853-4a60160bff96" status: 202 len: 0 microversion: 2.1 time: 0.884166 Jul 23 21:23:45.209207 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1209/2453] 10.222.0.17 () {58 vars in 1271 bytes} [Sat Jul 23 21:23:44 2022] DELETE /compute/v2.1/os-security-groups/4b0e40dc-a08b-49e5-a853-4a60160bff96 => generated 0 bytes in 887 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:23:45.214661 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-81d10b43-f4d8-47cb-8420-89213e4fb97a tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Calling method '.version_select at 0x7f0b47f38d30>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:45.343847 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-81d10b43-f4d8-47cb-8420-89213e4fb97a tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] 10.222.0.17 "GET /compute/v2.1/images/e57c215e-ddc6-4510-9626-f3760a490e39" status: 200 len: 1428 microversion: 2.1 time: 0.133249 Jul 23 21:23:45.346822 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1210/2454] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:23:45 2022] GET /compute/v2.1/images/e57c215e-ddc6-4510-9626-f3760a490e39 => generated 1428 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:45.352716 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c402206c-8724-4be0-a353-3f29cfb2cdc9 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Calling method '.version_select at 0x7f0b59910820>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:45.371398 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-0feb9b49-97ea-498d-8148-5ed2a31381dc tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013b521930d54d6d952e566f8e67f466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1432b2e152894407afae7b6419d80a8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:23:45.379621 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-0feb9b49-97ea-498d-8148-5ed2a31381dc tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] 10.222.0.17 "GET /compute/v2.1/servers/011c4ff9-9d46-44df-bf9b-e0269c71c417" status: 200 len: 1278 microversion: 2.1 time: 0.324994 Jul 23 21:23:45.389418 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1245/2455] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:45 2022] GET /compute/v2.1/servers/011c4ff9-9d46-44df-bf9b-e0269c71c417 => generated 1278 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:45.405818 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-dc1d9a8e-7ed5-443c-a919-9c6e11dc1492 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:45.406588 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-dc1d9a8e-7ed5-443c-a919-9c6e11dc1492 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] [instance: cef13563-7f83-4281-a26c-d5e420c41daf] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:45.425923 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-dc1d9a8e-7ed5-443c-a919-9c6e11dc1492 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:45.429985 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-dc1d9a8e-7ed5-443c-a919-9c6e11dc1492 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:45.430971 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-dc1d9a8e-7ed5-443c-a919-9c6e11dc1492 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:45.432408 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-dc1d9a8e-7ed5-443c-a919-9c6e11dc1492 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:45.583614 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-dc1d9a8e-7ed5-443c-a919-9c6e11dc1492 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebf93a4b80cb4e19a36473986950fc75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35c1943188684b45b636541caf587247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:23:45.598157 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-dc1d9a8e-7ed5-443c-a919-9c6e11dc1492 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] 10.222.0.17 "GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf" status: 200 len: 1299 microversion: 2.1 time: 0.202351 Jul 23 21:23:45.599299 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1246/2456] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:45 2022] GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf => generated 1299 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:45.604071 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=4 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:23:45.606632 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-b2eec204-bc74-4c3c-8a90-18fbbdeaeab8 req-01a2e1ca-5fc4-4a16-841c-e1da11641b60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cef13563-7f83-4281-a26c-d5e420c41daf", "name": "network-vif-deleted", "tag": "e6c3948e-9005-4405-9ade-a304ad56f44a"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:23:45.616793 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-b2eec204-bc74-4c3c-8a90-18fbbdeaeab8 req-01a2e1ca-5fc4-4a16-841c-e1da11641b60 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:45.617595 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-b2eec204-bc74-4c3c-8a90-18fbbdeaeab8 req-01a2e1ca-5fc4-4a16-841c-e1da11641b60 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:45.638024 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-b2eec204-bc74-4c3c-8a90-18fbbdeaeab8 req-01a2e1ca-5fc4-4a16-841c-e1da11641b60 service nova] Creating event network-vif-deleted:e6c3948e-9005-4405-9ade-a304ad56f44a for instance cef13563-7f83-4281-a26c-d5e420c41daf on nch1-master-1 Jul 23 21:23:45.655563 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-b2eec204-bc74-4c3c-8a90-18fbbdeaeab8 req-01a2e1ca-5fc4-4a16-841c-e1da11641b60 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053395 Jul 23 21:23:45.657733 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1247/2457] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:23:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:23:46.061346 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c402206c-8724-4be0-a353-3f29cfb2cdc9 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/d7e90c28-a20c-4df7-8357-81391faf06c4" status: 202 len: 0 microversion: 2.1 time: 0.713288 Jul 23 21:23:46.062164 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-b8d97e67-7aef-438d-a272-d7a0b28f071b tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:46.062641 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1211/2458] 10.222.0.17 () {58 vars in 1271 bytes} [Sat Jul 23 21:23:45 2022] DELETE /compute/v2.1/os-security-groups/d7e90c28-a20c-4df7-8357-81391faf06c4 => generated 0 bytes in 715 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:23:46.063834 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-b8d97e67-7aef-438d-a272-d7a0b28f071b tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] [instance: dd8dace4-4427-490e-ad29-73092c943515] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:46.079562 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2f2ad4a0-4ccb-402b-96ec-0058050f1db1 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Action: 'create', calling method: .version_select at 0x7f0b599bbd30>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-932973050", "description": "tempest-description-166746619"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:23:46.081831 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b8d97e67-7aef-438d-a272-d7a0b28f071b tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:46.087484 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b8d97e67-7aef-438d-a272-d7a0b28f071b tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:46.090334 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b8d97e67-7aef-438d-a272-d7a0b28f071b tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:46.092704 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b8d97e67-7aef-438d-a272-d7a0b28f071b tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:46.497106 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2f2ad4a0-4ccb-402b-96ec-0058050f1db1 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.421907 Jul 23 21:23:46.506622 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1212/2459] 10.222.0.17 () {60 vars in 1179 bytes} [Sat Jul 23 21:23:46 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:23:46.565736 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-b8d97e67-7aef-438d-a272-d7a0b28f071b tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e74c139b38d74d9ab93695471ccd3a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ff73d603ec4069a908452514a59451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:23:46.576328 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-b8d97e67-7aef-438d-a272-d7a0b28f071b tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] 10.222.0.17 "GET /compute/v2.1/servers/dd8dace4-4427-490e-ad29-73092c943515" status: 200 len: 1355 microversion: 2.1 time: 0.519849 Jul 23 21:23:46.580458 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1248/2460] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:46 2022] GET /compute/v2.1/servers/dd8dace4-4427-490e-ad29-73092c943515 => generated 1355 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:46.589458 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-eeb1a3c2-5092-41dc-8a66-e1387d34a093 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Calling method '.version_select at 0x7f0b47ee64c0>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:46.604465 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d2222c9a-22d6-4f87-a205-32896442be36 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-1755276528", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "networks": [{"uuid": "09c46802-142b-48a6-8df1-0090edb46eac"}]}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:23:46.687411 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-d2222c9a-22d6-4f87-a205-32896442be36 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] validate_networks() for [('09c46802-142b-48a6-8df1-0090edb46eac', None, None, None, None, None)] {{(pid=131320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:23:46.687772 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-eeb1a3c2-5092-41dc-8a66-e1387d34a093 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] 10.222.0.17 "GET /compute/v2.1/images/e57c215e-ddc6-4510-9626-f3760a490e39" status: 200 len: 1428 microversion: 2.1 time: 0.105758 Jul 23 21:23:46.688583 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1249/2461] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:23:46 2022] GET /compute/v2.1/images/e57c215e-ddc6-4510-9626-f3760a490e39 => generated 1428 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:46.703442 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-395eef96-b247-4a86-aa37-91f48f598915 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:46.704716 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-395eef96-b247-4a86-aa37-91f48f598915 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] [instance: 011c4ff9-9d46-44df-bf9b-e0269c71c417] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:46.712051 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-395eef96-b247-4a86-aa37-91f48f598915 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:46.713774 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-395eef96-b247-4a86-aa37-91f48f598915 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:46.716009 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-395eef96-b247-4a86-aa37-91f48f598915 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:46.717991 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-395eef96-b247-4a86-aa37-91f48f598915 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:46.863855 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-395eef96-b247-4a86-aa37-91f48f598915 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013b521930d54d6d952e566f8e67f466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1432b2e152894407afae7b6419d80a8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:23:46.873282 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-395eef96-b247-4a86-aa37-91f48f598915 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] 10.222.0.17 "GET /compute/v2.1/servers/011c4ff9-9d46-44df-bf9b-e0269c71c417" status: 200 len: 1284 microversion: 2.1 time: 0.181091 Jul 23 21:23:46.877132 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1250/2462] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:46 2022] GET /compute/v2.1/servers/011c4ff9-9d46-44df-bf9b-e0269c71c417 => generated 1284 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:46.894246 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-5a8ec2ed-a0c5-46e1-8e8b-84bd6f998bc0 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Action: 'update', calling method: .version_select at 0x7f0b47ee60d0>, body: {"security_group": {"name": "tempest-sg-hth-81031196", "description": "tempest-description-hth-1962471055"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:23:47.165020 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-5a8ec2ed-a0c5-46e1-8e8b-84bd6f998bc0 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] 10.222.0.17 "PUT /compute/v2.1/os-security-groups/f7b2878d-9c24-44b5-b166-2260e0e55e2b" status: 200 len: 216 microversion: 2.1 time: 0.285182 Jul 23 21:23:47.172488 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1251/2463] 10.222.0.17 () {60 vars in 1289 bytes} [Sat Jul 23 21:23:46 2022] PUT /compute/v2.1/os-security-groups/f7b2878d-9c24-44b5-b166-2260e0e55e2b => generated 216 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:23:47.177370 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-fc24b769-0758-4f9a-a800-b5ac3f205f32 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:47.178295 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-fc24b769-0758-4f9a-a800-b5ac3f205f32 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] [instance: cef13563-7f83-4281-a26c-d5e420c41daf] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:47.189097 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fc24b769-0758-4f9a-a800-b5ac3f205f32 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:47.189560 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fc24b769-0758-4f9a-a800-b5ac3f205f32 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:47.194731 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fc24b769-0758-4f9a-a800-b5ac3f205f32 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:47.195206 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fc24b769-0758-4f9a-a800-b5ac3f205f32 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:47.227591 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-fc24b769-0758-4f9a-a800-b5ac3f205f32 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] HTTP exception thrown: Instance cef13563-7f83-4281-a26c-d5e420c41daf could not be found. Jul 23 21:23:47.229341 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-fc24b769-0758-4f9a-a800-b5ac3f205f32 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Request method failure captured: Jul 23 21:23:47.229341 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf HTTP/1.1 Jul 23 21:23:47.229341 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:23:47.229341 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:23:47.229341 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:23:47.229341 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:23:47.229341 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:23:47.229341 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:23:47.229341 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:23:47.229341 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:23:47.229341 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GZAonwSDWtmSSoetBzZo6VFSnCPJBYrpHZTQMwPtEFsaedad-XtITkUU8d1u55uykAKkKYVRZBW2KiJ3kX9zCz6j-GHNtNSMeDCWsZ9PY9Qcw-Jom4quZnr5YUF2_4VDrqqFcdVv0SDG9AZGjSVpIuXFdhlht4nr8jpg0BRSrvN7eQ Jul 23 21:23:47.229341 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:23:47.229341 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:23:47.229341 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:23:47.229341 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:23:47.229341 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:23:47.229341 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:23:47.229341 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 35c1943188684b45b636541caf587247 Jul 23 21:23:47.229341 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ServersAdminTestJSON-677192649 Jul 23 21:23:47.229341 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:23:47.229341 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:23:47.229341 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/35c1943188684b45b636541caf587247"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/35c1943188684b45b636541caf587247"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_35c1943188684b45b636541caf587247", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/35c1943188684b45b636541caf587247"}]}] Jul 23 21:23:47.229341 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ServersAdminTestJSON-677192649 Jul 23 21:23:47.229341 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 35c1943188684b45b636541caf587247 Jul 23 21:23:47.229341 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ServersAdminTestJSON-677192649 Jul 23 21:23:47.229341 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ServersAdminTestJSON-677192649-project Jul 23 21:23:47.229341 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:23:47.229341 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:23:47.229341 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: ebf93a4b80cb4e19a36473986950fc75 Jul 23 21:23:47.229341 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ServersAdminTestJSON-677192649-project Jul 23 21:23:47.229341 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:23:47.229341 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance cef13563-7f83-4281-a26c-d5e420c41daf could not be found. Jul 23 21:23:47.229341 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': 'cef13563-7f83-4281-a26c-d5e420c41daf'} Jul 23 21:23:47.229341 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:23:47.229341 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:23:47.229341 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:23:47.229341 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:23:47.229341 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:23:47.229341 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:23:47.229341 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:23:47.229341 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:23:47.229341 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:23:47.229341 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:23:47.229341 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cef13563-7f83-4281-a26c-d5e420c41daf could not be found. Jul 23 21:23:47.229341 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:23:47.229341 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:23:47.229341 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:23:47.229341 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:23:47.229341 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:23:47.229341 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:23:47.229341 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:23:47.229341 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:23:47.229341 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:23:47.229341 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:23:47.229341 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:23:47.229341 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:23:47.229341 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:23:47.229341 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:23:47.229341 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:23:47.229341 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:23:47.229341 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cef13563-7f83-4281-a26c-d5e420c41daf could not be found. Jul 23 21:23:47.229341 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:23:47.229341 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:23:47.229341 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:23:47.233189 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:23:47.233189 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:23:47.233189 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:23:47.233189 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:23:47.233189 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:23:47.233189 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cef13563-7f83-4281-a26c-d5e420c41daf could not be found. Jul 23 21:23:47.233189 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:23:47.239101 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-fc24b769-0758-4f9a-a800-b5ac3f205f32 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] Returning 404 to user: Instance cef13563-7f83-4281-a26c-d5e420c41daf could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:23:47.240243 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-fc24b769-0758-4f9a-a800-b5ac3f205f32 tempest-ServersAdminTestJSON-677192649 tempest-ServersAdminTestJSON-677192649-project] 10.222.0.17 "GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf" status: 404 len: 111 microversion: 2.1 time: 0.066936 Jul 23 21:23:47.241377 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1252/2464] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:47 2022] GET /compute/v2.1/servers/cef13563-7f83-4281-a26c-d5e420c41daf => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:23:47.252223 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-6094ec06-f1c5-4794-a9dd-48397c2b94de tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Calling method '.version_select at 0x7f0b47f138b0>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:47.401809 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-6094ec06-f1c5-4794-a9dd-48397c2b94de tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] 10.222.0.17 "GET /compute/v2.1/os-security-groups/f7b2878d-9c24-44b5-b166-2260e0e55e2b" status: 200 len: 216 microversion: 2.1 time: 0.158375 Jul 23 21:23:47.402440 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1253/2465] 10.222.0.17 () {58 vars in 1268 bytes} [Sat Jul 23 21:23:47 2022] GET /compute/v2.1/os-security-groups/f7b2878d-9c24-44b5-b166-2260e0e55e2b => generated 216 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:23:47.417854 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-6d354ef8-7840-4cee-a027-c92004d23534 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Calling method '.version_select at 0x7f0b47e2b8b0>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:47.531475 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-d2222c9a-22d6-4f87-a205-32896442be36 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:23:47.531904 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-d2222c9a-22d6-4f87-a205-32896442be36 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:23:47.532635 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-d2222c9a-22d6-4f87-a205-32896442be36 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:23:47.533215 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-d2222c9a-22d6-4f87-a205-32896442be36 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:23:47.533933 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-d2222c9a-22d6-4f87-a205-32896442be36 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:23:47.550903 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d2222c9a-22d6-4f87-a205-32896442be36 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:47.551640 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d2222c9a-22d6-4f87-a205-32896442be36 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:47.552683 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d2222c9a-22d6-4f87-a205-32896442be36 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:47.554391 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d2222c9a-22d6-4f87-a205-32896442be36 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:47.611486 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-d2222c9a-22d6-4f87-a205-32896442be36 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Getting quotas for project a14294b18c6e4936b1272a57d4faccce. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:23:47.624689 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-d2222c9a-22d6-4f87-a205-32896442be36 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Getting quotas for user 7a812b6571db40a1a2f138dc03d4e1be and project a14294b18c6e4936b1272a57d4faccce. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:23:47.658843 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d2222c9a-22d6-4f87-a205-32896442be36 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Going to run 1 instances... {{(pid=131320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:23:47.667710 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d2222c9a-22d6-4f87-a205-32896442be36 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] [instance: c73f1c6e-9c56-453d-89bf-b9e24f360f33] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:23:47.783007 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d2222c9a-22d6-4f87-a205-32896442be36 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.275012 Jul 23 21:23:47.784005 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1213/2466] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:23:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1277 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 23 21:23:47.798686 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c8986f6e-63e2-43eb-a016-fd4a3f375e6e tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:47.799567 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c8986f6e-63e2-43eb-a016-fd4a3f375e6e tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] [instance: dd8dace4-4427-490e-ad29-73092c943515] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:47.847020 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c8986f6e-63e2-43eb-a016-fd4a3f375e6e tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:47.855078 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c8986f6e-63e2-43eb-a016-fd4a3f375e6e tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:47.859960 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c8986f6e-63e2-43eb-a016-fd4a3f375e6e tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:47.864107 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c8986f6e-63e2-43eb-a016-fd4a3f375e6e tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:48.224947 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-6d354ef8-7840-4cee-a027-c92004d23534 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/f7b2878d-9c24-44b5-b166-2260e0e55e2b" status: 202 len: 0 microversion: 2.1 time: 0.811673 Jul 23 21:23:48.230687 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1254/2467] 10.222.0.17 () {58 vars in 1271 bytes} [Sat Jul 23 21:23:47 2022] DELETE /compute/v2.1/os-security-groups/f7b2878d-9c24-44b5-b166-2260e0e55e2b => generated 0 bytes in 818 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:23:48.238089 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-216c3529-0293-4f23-97f9-d80fe6e0b721 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Calling method '.version_select at 0x7f0b47cea940>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:48.333649 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-216c3529-0293-4f23-97f9-d80fe6e0b721 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] 10.222.0.17 "GET /compute/v2.1/images/e57c215e-ddc6-4510-9626-f3760a490e39" status: 200 len: 1428 microversion: 2.1 time: 0.100940 Jul 23 21:23:48.334994 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1255/2468] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:23:48 2022] GET /compute/v2.1/images/e57c215e-ddc6-4510-9626-f3760a490e39 => generated 1428 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:48.353549 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-6cc39cf0-faa6-49f1-b4fa-1afb5fb41b56 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:48.357737 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-6cc39cf0-faa6-49f1-b4fa-1afb5fb41b56 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] [instance: c73f1c6e-9c56-453d-89bf-b9e24f360f33] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:48.396703 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c8986f6e-63e2-43eb-a016-fd4a3f375e6e tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e74c139b38d74d9ab93695471ccd3a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ff73d603ec4069a908452514a59451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:23:48.408316 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c8986f6e-63e2-43eb-a016-fd4a3f375e6e tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] 10.222.0.17 "GET /compute/v2.1/servers/dd8dace4-4427-490e-ad29-73092c943515" status: 200 len: 1355 microversion: 2.1 time: 0.622162 Jul 23 21:23:48.420921 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1214/2469] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:47 2022] GET /compute/v2.1/servers/dd8dace4-4427-490e-ad29-73092c943515 => generated 1355 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:48.428545 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-407957a2-231e-4651-81a4-11655ce84d22 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:48.429176 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-407957a2-231e-4651-81a4-11655ce84d22 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] [instance: 011c4ff9-9d46-44df-bf9b-e0269c71c417] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:48.441600 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-407957a2-231e-4651-81a4-11655ce84d22 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:48.445930 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-407957a2-231e-4651-81a4-11655ce84d22 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:48.450087 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-407957a2-231e-4651-81a4-11655ce84d22 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:48.450786 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-407957a2-231e-4651-81a4-11655ce84d22 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:48.539044 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-6cc39cf0-faa6-49f1-b4fa-1afb5fb41b56 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a812b6571db40a1a2f138dc03d4e1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14294b18c6e4936b1272a57d4faccce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:23:48.548034 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-6cc39cf0-faa6-49f1-b4fa-1afb5fb41b56 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] 10.222.0.17 "GET /compute/v2.1/servers/c73f1c6e-9c56-453d-89bf-b9e24f360f33" status: 200 len: 1225 microversion: 2.1 time: 0.209513 Jul 23 21:23:48.548659 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1256/2470] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:48 2022] GET /compute/v2.1/servers/c73f1c6e-9c56-453d-89bf-b9e24f360f33 => generated 1225 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:48.561704 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f2014fa2-7ca3-4ef9-8bc3-d3ec89193460 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:48.562566 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-f2014fa2-7ca3-4ef9-8bc3-d3ec89193460 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] [instance: 4ef8cf58-9580-495b-9212-8cb8c837354c] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:48.587980 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f2014fa2-7ca3-4ef9-8bc3-d3ec89193460 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:48.588998 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f2014fa2-7ca3-4ef9-8bc3-d3ec89193460 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:48.590760 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f2014fa2-7ca3-4ef9-8bc3-d3ec89193460 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:48.591395 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f2014fa2-7ca3-4ef9-8bc3-d3ec89193460 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:48.610395 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-f2014fa2-7ca3-4ef9-8bc3-d3ec89193460 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] HTTP exception thrown: Instance 4ef8cf58-9580-495b-9212-8cb8c837354c could not be found. Jul 23 21:23:48.614131 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f2014fa2-7ca3-4ef9-8bc3-d3ec89193460 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Request method failure captured: Jul 23 21:23:48.614131 ncdv-master-1 devstack@n-api.service[131321]: request: DELETE /compute/v2.1/servers/4ef8cf58-9580-495b-9212-8cb8c837354c HTTP/1.1 Jul 23 21:23:48.614131 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:23:48.614131 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:23:48.614131 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:23:48.614131 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:23:48.614131 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:23:48.614131 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:23:48.614131 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:23:48.614131 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:23:48.614131 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GabcedAy4zvEWDBz4psoyymQjd20otmwoBk14VBCrO5T_u930hsqstuKWfxSIIHSaoINyY7aouwTaS_UH5MldJcqSCrcSo-BYQbnUPzf2q6ne_dSigo_8PievK59Q_5ElGzDVdSYredgO26R1rdGGAuE9yewD0hcCJzYqqhzyGW3Zk Jul 23 21:23:48.614131 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:23:48.614131 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:23:48.614131 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:23:48.614131 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:23:48.614131 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:23:48.614131 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:23:48.614131 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 55cfd65431cf4b878ab1c0e25a0ac629 Jul 23 21:23:48.614131 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-SecurityGroupsTestJSON-553336269 Jul 23 21:23:48.614131 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:23:48.614131 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:23:48.614131 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/55cfd65431cf4b878ab1c0e25a0ac629"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/55cfd65431cf4b878ab1c0e25a0ac629"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_55cfd65431cf4b878ab1c0e25a0ac629", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/55cfd65431cf4b878ab1c0e25a0ac629"}]}] Jul 23 21:23:48.614131 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-SecurityGroupsTestJSON-553336269 Jul 23 21:23:48.614131 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 55cfd65431cf4b878ab1c0e25a0ac629 Jul 23 21:23:48.614131 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-553336269 Jul 23 21:23:48.614131 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-SecurityGroupsTestJSON-553336269-project Jul 23 21:23:48.614131 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:23:48.614131 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:23:48.614131 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 63ca7a39a8174a4b97767245e80b2bf7 Jul 23 21:23:48.614131 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-SecurityGroupsTestJSON-553336269-project Jul 23 21:23:48.614131 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:23:48.614131 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance 4ef8cf58-9580-495b-9212-8cb8c837354c could not be found. Jul 23 21:23:48.614131 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': '4ef8cf58-9580-495b-9212-8cb8c837354c'} Jul 23 21:23:48.614131 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:23:48.614131 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:23:48.614131 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:23:48.614131 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:23:48.614131 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:23:48.614131 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:23:48.614131 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:23:48.614131 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:23:48.614131 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:23:48.614131 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:23:48.614131 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ef8cf58-9580-495b-9212-8cb8c837354c could not be found. Jul 23 21:23:48.614131 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:23:48.614131 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:23:48.614131 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:23:48.614131 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:23:48.614131 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:23:48.614131 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:23:48.614131 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:23:48.614131 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:23:48.614131 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:23:48.614131 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:23:48.614131 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 23 21:23:48.614131 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 23 21:23:48.614131 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 23 21:23:48.614131 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 23 21:23:48.614131 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:23:48.614131 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:23:48.614131 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:23:48.614131 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:23:48.618753 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ef8cf58-9580-495b-9212-8cb8c837354c could not be found. Jul 23 21:23:48.618753 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:23:48.618753 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:23:48.618753 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:23:48.618753 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:23:48.618753 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:23:48.618753 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:23:48.618753 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:23:48.618753 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:23:48.618753 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ef8cf58-9580-495b-9212-8cb8c837354c could not be found. Jul 23 21:23:48.618753 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:23:48.623347 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f2014fa2-7ca3-4ef9-8bc3-d3ec89193460 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Returning 404 to user: Instance 4ef8cf58-9580-495b-9212-8cb8c837354c could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:23:48.625895 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-f2014fa2-7ca3-4ef9-8bc3-d3ec89193460 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] 10.222.0.17 "DELETE /compute/v2.1/servers/4ef8cf58-9580-495b-9212-8cb8c837354c" status: 404 len: 111 microversion: 2.1 time: 0.075498 Jul 23 21:23:48.626718 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1257/2471] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:23:48 2022] DELETE /compute/v2.1/servers/4ef8cf58-9580-495b-9212-8cb8c837354c => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:23:48.643605 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e8b44aa6-f948-468a-a520-629a5857b4d0 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:48.651696 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-e8b44aa6-f948-468a-a520-629a5857b4d0 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] [instance: 4ef8cf58-9580-495b-9212-8cb8c837354c] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:48.666866 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e8b44aa6-f948-468a-a520-629a5857b4d0 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:48.674681 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e8b44aa6-f948-468a-a520-629a5857b4d0 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:48.675972 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e8b44aa6-f948-468a-a520-629a5857b4d0 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:48.676546 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e8b44aa6-f948-468a-a520-629a5857b4d0 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:48.714110 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-e8b44aa6-f948-468a-a520-629a5857b4d0 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] HTTP exception thrown: Instance 4ef8cf58-9580-495b-9212-8cb8c837354c could not be found. Jul 23 21:23:48.719384 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e8b44aa6-f948-468a-a520-629a5857b4d0 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Request method failure captured: Jul 23 21:23:48.719384 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/servers/4ef8cf58-9580-495b-9212-8cb8c837354c HTTP/1.1 Jul 23 21:23:48.719384 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:23:48.719384 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:23:48.719384 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:23:48.719384 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:23:48.719384 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:23:48.719384 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:23:48.719384 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:23:48.719384 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:23:48.719384 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GabcedAy4zvEWDBz4psoyymQjd20otmwoBk14VBCrO5T_u930hsqstuKWfxSIIHSaoINyY7aouwTaS_UH5MldJcqSCrcSo-BYQbnUPzf2q6ne_dSigo_8PievK59Q_5ElGzDVdSYredgO26R1rdGGAuE9yewD0hcCJzYqqhzyGW3Zk Jul 23 21:23:48.719384 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:23:48.719384 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:23:48.719384 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:23:48.719384 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:23:48.719384 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:23:48.719384 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:23:48.719384 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 55cfd65431cf4b878ab1c0e25a0ac629 Jul 23 21:23:48.719384 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-SecurityGroupsTestJSON-553336269 Jul 23 21:23:48.719384 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:23:48.719384 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:23:48.719384 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/55cfd65431cf4b878ab1c0e25a0ac629"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/55cfd65431cf4b878ab1c0e25a0ac629"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_55cfd65431cf4b878ab1c0e25a0ac629", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/55cfd65431cf4b878ab1c0e25a0ac629"}]}] Jul 23 21:23:48.719384 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-SecurityGroupsTestJSON-553336269 Jul 23 21:23:48.719384 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 55cfd65431cf4b878ab1c0e25a0ac629 Jul 23 21:23:48.719384 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-553336269 Jul 23 21:23:48.719384 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-SecurityGroupsTestJSON-553336269-project Jul 23 21:23:48.719384 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:23:48.719384 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:23:48.719384 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 63ca7a39a8174a4b97767245e80b2bf7 Jul 23 21:23:48.719384 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-SecurityGroupsTestJSON-553336269-project Jul 23 21:23:48.719384 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:23:48.719384 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance 4ef8cf58-9580-495b-9212-8cb8c837354c could not be found. Jul 23 21:23:48.719384 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': '4ef8cf58-9580-495b-9212-8cb8c837354c'} Jul 23 21:23:48.719384 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:23:48.719384 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:23:48.719384 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:23:48.719384 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:23:48.719384 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:23:48.719384 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:23:48.719384 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:23:48.719384 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:23:48.719384 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:23:48.719384 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:23:48.719384 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ef8cf58-9580-495b-9212-8cb8c837354c could not be found. Jul 23 21:23:48.719384 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:23:48.719384 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:23:48.719384 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:23:48.719384 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:23:48.719384 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:23:48.719384 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:23:48.719384 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:23:48.719384 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:23:48.719384 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:23:48.719384 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:23:48.719384 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:23:48.719384 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:23:48.719384 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:23:48.719384 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:23:48.719384 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:23:48.719384 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:23:48.719384 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ef8cf58-9580-495b-9212-8cb8c837354c could not be found. Jul 23 21:23:48.719384 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:23:48.719384 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:23:48.719384 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:23:48.723937 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:23:48.723937 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:23:48.723937 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:23:48.723937 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:23:48.723937 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:23:48.723937 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ef8cf58-9580-495b-9212-8cb8c837354c could not be found. Jul 23 21:23:48.723937 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:23:48.726891 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e8b44aa6-f948-468a-a520-629a5857b4d0 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Returning 404 to user: Instance 4ef8cf58-9580-495b-9212-8cb8c837354c could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:23:48.729185 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-e8b44aa6-f948-468a-a520-629a5857b4d0 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] 10.222.0.17 "GET /compute/v2.1/servers/4ef8cf58-9580-495b-9212-8cb8c837354c" status: 404 len: 111 microversion: 2.1 time: 0.096763 Jul 23 21:23:48.731686 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1258/2472] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:48 2022] GET /compute/v2.1/servers/4ef8cf58-9580-495b-9212-8cb8c837354c => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:23:48.747357 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-20aca22c-e6b9-48a1-b496-75368e936fce tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Calling method '.version_select at 0x7f0b47f10310>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:48.838762 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-407957a2-231e-4651-81a4-11655ce84d22 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013b521930d54d6d952e566f8e67f466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1432b2e152894407afae7b6419d80a8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:23:48.858232 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-407957a2-231e-4651-81a4-11655ce84d22 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] 10.222.0.17 "GET /compute/v2.1/servers/011c4ff9-9d46-44df-bf9b-e0269c71c417" status: 200 len: 1352 microversion: 2.1 time: 0.436527 Jul 23 21:23:48.861463 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1215/2473] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:48 2022] GET /compute/v2.1/servers/011c4ff9-9d46-44df-bf9b-e0269c71c417 => generated 1352 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:49.007625 ncdv-master-1 devstack@n-api.service[131321]: DEBUG neutronclient.v2_0.client [None req-20aca22c-e6b9-48a1-b496-75368e936fce tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d7e90c28-a20c-4df7-8357-81391faf06c4 does not exist", "detail": ""}} {{(pid=131321) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 23 21:23:49.008835 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.network.security_group_api [None req-20aca22c-e6b9-48a1-b496-75368e936fce tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Neutron security group d7e90c28-a20c-4df7-8357-81391faf06c4 not found {{(pid=131321) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 23 21:23:49.009595 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-20aca22c-e6b9-48a1-b496-75368e936fce tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] HTTP exception thrown: Security group d7e90c28-a20c-4df7-8357-81391faf06c4 does not exist Jul 23 21:23:49.009595 ncdv-master-1 devstack@n-api.service[131321]: Neutron server returns request_ids: ['req-ece5c42e-6859-4419-b0d5-43501f90c6f6'] Jul 23 21:23:49.012437 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-20aca22c-e6b9-48a1-b496-75368e936fce tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Request method failure captured: Jul 23 21:23:49.012437 ncdv-master-1 devstack@n-api.service[131321]: request: DELETE /compute/v2.1/os-security-groups/d7e90c28-a20c-4df7-8357-81391faf06c4 HTTP/1.1 Jul 23 21:23:49.012437 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:23:49.012437 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:23:49.012437 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:23:49.012437 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:23:49.012437 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:23:49.012437 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:23:49.012437 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:23:49.012437 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:23:49.012437 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GabcedAy4zvEWDBz4psoyymQjd20otmwoBk14VBCrO5T_u930hsqstuKWfxSIIHSaoINyY7aouwTaS_UH5MldJcqSCrcSo-BYQbnUPzf2q6ne_dSigo_8PievK59Q_5ElGzDVdSYredgO26R1rdGGAuE9yewD0hcCJzYqqhzyGW3Zk Jul 23 21:23:49.012437 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:23:49.012437 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:23:49.012437 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:23:49.012437 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:23:49.012437 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:23:49.012437 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:23:49.012437 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 55cfd65431cf4b878ab1c0e25a0ac629 Jul 23 21:23:49.012437 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-SecurityGroupsTestJSON-553336269 Jul 23 21:23:49.012437 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:23:49.012437 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:23:49.012437 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/55cfd65431cf4b878ab1c0e25a0ac629"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/55cfd65431cf4b878ab1c0e25a0ac629"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_55cfd65431cf4b878ab1c0e25a0ac629", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/55cfd65431cf4b878ab1c0e25a0ac629"}]}] Jul 23 21:23:49.012437 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-SecurityGroupsTestJSON-553336269 Jul 23 21:23:49.012437 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 55cfd65431cf4b878ab1c0e25a0ac629 Jul 23 21:23:49.012437 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-553336269 Jul 23 21:23:49.012437 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-SecurityGroupsTestJSON-553336269-project Jul 23 21:23:49.012437 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:23:49.012437 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:23:49.012437 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 63ca7a39a8174a4b97767245e80b2bf7 Jul 23 21:23:49.012437 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-SecurityGroupsTestJSON-553336269-project Jul 23 21:23:49.012437 ncdv-master-1 devstack@n-api.service[131321]: method: Jul 23 21:23:49.012437 ncdv-master-1 devstack@n-api.service[131321]: exception: Security group d7e90c28-a20c-4df7-8357-81391faf06c4 does not exist Jul 23 21:23:49.012437 ncdv-master-1 devstack@n-api.service[131321]: Neutron server returns request_ids: ['req-ece5c42e-6859-4419-b0d5-43501f90c6f6'] Jul 23 21:23:49.012437 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': 'd7e90c28-a20c-4df7-8357-81391faf06c4'} Jul 23 21:23:49.012437 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:23:49.012437 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:23:49.012437 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 23 21:23:49.012437 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 23 21:23:49.012437 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:23:49.012437 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:23:49.012437 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 23 21:23:49.012437 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 23 21:23:49.012437 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:23:49.012437 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:23:49.012437 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 23 21:23:49.012437 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 23 21:23:49.012437 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:23:49.012437 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:23:49.012437 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 23 21:23:49.012437 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 23 21:23:49.012437 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:23:49.012437 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:23:49.012437 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 23 21:23:49.012437 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 23 21:23:49.012437 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:23:49.012437 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:23:49.012437 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 23 21:23:49.012437 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 23 21:23:49.012437 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 23 21:23:49.012437 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 23 21:23:49.012437 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d7e90c28-a20c-4df7-8357-81391faf06c4 does not exist Jul 23 21:23:49.016054 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ece5c42e-6859-4419-b0d5-43501f90c6f6'] Jul 23 21:23:49.016054 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:23:49.016054 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:23:49.016054 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:23:49.016054 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:23:49.016054 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 23 21:23:49.016054 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 23 21:23:49.016054 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 23 21:23:49.016054 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 23 21:23:49.016054 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d7e90c28-a20c-4df7-8357-81391faf06c4 does not exist Jul 23 21:23:49.016054 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ece5c42e-6859-4419-b0d5-43501f90c6f6'] Jul 23 21:23:49.016054 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:23:49.016054 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:23:49.016054 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:23:49.016054 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:23:49.016054 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:23:49.016054 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:23:49.016054 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:23:49.016054 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:23:49.016054 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:23:49.016054 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:23:49.016054 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:23:49.016054 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:23:49.016054 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 23 21:23:49.016054 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 23 21:23:49.016054 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d7e90c28-a20c-4df7-8357-81391faf06c4 does not exist Jul 23 21:23:49.016054 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ece5c42e-6859-4419-b0d5-43501f90c6f6'] Jul 23 21:23:49.016054 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:23:49.016054 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:23:49.016054 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:23:49.016054 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:23:49.016054 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:23:49.016054 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:23:49.016054 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:23:49.016054 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:23:49.016054 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d7e90c28-a20c-4df7-8357-81391faf06c4 does not exist Jul 23 21:23:49.016054 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ece5c42e-6859-4419-b0d5-43501f90c6f6'] Jul 23 21:23:49.016054 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:23:49.020765 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-20aca22c-e6b9-48a1-b496-75368e936fce tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Returning 404 to user: Security group d7e90c28-a20c-4df7-8357-81391faf06c4 does not exist Jul 23 21:23:49.020765 ncdv-master-1 devstack@n-api.service[131321]: Neutron server returns request_ids: ['req-ece5c42e-6859-4419-b0d5-43501f90c6f6'] {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:23:49.022008 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-20aca22c-e6b9-48a1-b496-75368e936fce tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/d7e90c28-a20c-4df7-8357-81391faf06c4" status: 404 len: 194 microversion: 2.1 time: 0.284048 Jul 23 21:23:49.023150 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1259/2474] 10.222.0.17 () {58 vars in 1271 bytes} [Sat Jul 23 21:23:48 2022] DELETE /compute/v2.1/os-security-groups/d7e90c28-a20c-4df7-8357-81391faf06c4 => generated 194 bytes in 289 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:23:49.031606 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-318bd819-a115-4a2d-aea7-28d588a4eed4 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Calling method '.version_select at 0x7f0b540e0940>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:49.089726 ncdv-master-1 devstack@n-api.service[131320]: DEBUG neutronclient.v2_0.client [None req-318bd819-a115-4a2d-aea7-28d588a4eed4 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 4b0e40dc-a08b-49e5-a853-4a60160bff96 does not exist", "detail": ""}} {{(pid=131320) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 23 21:23:49.090878 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.security_group_api [None req-318bd819-a115-4a2d-aea7-28d588a4eed4 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Neutron security group 4b0e40dc-a08b-49e5-a853-4a60160bff96 not found {{(pid=131320) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 23 21:23:49.091594 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-318bd819-a115-4a2d-aea7-28d588a4eed4 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] HTTP exception thrown: Security group 4b0e40dc-a08b-49e5-a853-4a60160bff96 does not exist Jul 23 21:23:49.091594 ncdv-master-1 devstack@n-api.service[131320]: Neutron server returns request_ids: ['req-771a7717-6b12-41ee-9012-5301bc9a3bf8'] Jul 23 21:23:49.093755 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-318bd819-a115-4a2d-aea7-28d588a4eed4 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Request method failure captured: Jul 23 21:23:49.093755 ncdv-master-1 devstack@n-api.service[131320]: request: DELETE /compute/v2.1/os-security-groups/4b0e40dc-a08b-49e5-a853-4a60160bff96 HTTP/1.1 Jul 23 21:23:49.093755 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:23:49.093755 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:23:49.093755 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:23:49.093755 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:23:49.093755 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:23:49.093755 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:23:49.093755 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:23:49.093755 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:23:49.093755 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GabcedAy4zvEWDBz4psoyymQjd20otmwoBk14VBCrO5T_u930hsqstuKWfxSIIHSaoINyY7aouwTaS_UH5MldJcqSCrcSo-BYQbnUPzf2q6ne_dSigo_8PievK59Q_5ElGzDVdSYredgO26R1rdGGAuE9yewD0hcCJzYqqhzyGW3Zk Jul 23 21:23:49.093755 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:23:49.093755 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:23:49.093755 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:23:49.093755 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:23:49.093755 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:23:49.093755 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:23:49.093755 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 55cfd65431cf4b878ab1c0e25a0ac629 Jul 23 21:23:49.093755 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-SecurityGroupsTestJSON-553336269 Jul 23 21:23:49.093755 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:23:49.093755 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:23:49.093755 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/55cfd65431cf4b878ab1c0e25a0ac629"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/55cfd65431cf4b878ab1c0e25a0ac629"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_55cfd65431cf4b878ab1c0e25a0ac629", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/55cfd65431cf4b878ab1c0e25a0ac629"}]}] Jul 23 21:23:49.093755 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-SecurityGroupsTestJSON-553336269 Jul 23 21:23:49.093755 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 55cfd65431cf4b878ab1c0e25a0ac629 Jul 23 21:23:49.093755 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-553336269 Jul 23 21:23:49.093755 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-SecurityGroupsTestJSON-553336269-project Jul 23 21:23:49.093755 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:23:49.093755 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:23:49.093755 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 63ca7a39a8174a4b97767245e80b2bf7 Jul 23 21:23:49.093755 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-SecurityGroupsTestJSON-553336269-project Jul 23 21:23:49.093755 ncdv-master-1 devstack@n-api.service[131320]: method: Jul 23 21:23:49.093755 ncdv-master-1 devstack@n-api.service[131320]: exception: Security group 4b0e40dc-a08b-49e5-a853-4a60160bff96 does not exist Jul 23 21:23:49.093755 ncdv-master-1 devstack@n-api.service[131320]: Neutron server returns request_ids: ['req-771a7717-6b12-41ee-9012-5301bc9a3bf8'] Jul 23 21:23:49.093755 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '4b0e40dc-a08b-49e5-a853-4a60160bff96'} Jul 23 21:23:49.093755 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:23:49.093755 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:23:49.093755 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 23 21:23:49.093755 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 23 21:23:49.093755 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:23:49.093755 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:23:49.093755 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 23 21:23:49.093755 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 23 21:23:49.093755 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:23:49.093755 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:23:49.093755 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 23 21:23:49.093755 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 23 21:23:49.093755 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:23:49.093755 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:23:49.093755 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 23 21:23:49.093755 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 23 21:23:49.093755 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:23:49.093755 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:23:49.093755 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 23 21:23:49.093755 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 23 21:23:49.093755 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:23:49.093755 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:23:49.093755 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 23 21:23:49.093755 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 23 21:23:49.093755 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 23 21:23:49.093755 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 23 21:23:49.093755 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 4b0e40dc-a08b-49e5-a853-4a60160bff96 does not exist Jul 23 21:23:49.097951 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-771a7717-6b12-41ee-9012-5301bc9a3bf8'] Jul 23 21:23:49.097951 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:23:49.097951 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:23:49.097951 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:23:49.097951 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:23:49.097951 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 23 21:23:49.097951 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 23 21:23:49.097951 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 23 21:23:49.097951 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 23 21:23:49.097951 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 4b0e40dc-a08b-49e5-a853-4a60160bff96 does not exist Jul 23 21:23:49.097951 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-771a7717-6b12-41ee-9012-5301bc9a3bf8'] Jul 23 21:23:49.097951 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:23:49.097951 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:23:49.097951 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:23:49.097951 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:23:49.097951 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:23:49.097951 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:23:49.097951 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:23:49.097951 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:23:49.097951 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:23:49.097951 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:23:49.097951 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:23:49.097951 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:23:49.097951 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 23 21:23:49.097951 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 23 21:23:49.097951 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 4b0e40dc-a08b-49e5-a853-4a60160bff96 does not exist Jul 23 21:23:49.097951 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-771a7717-6b12-41ee-9012-5301bc9a3bf8'] Jul 23 21:23:49.097951 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:23:49.097951 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:23:49.097951 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:23:49.097951 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:23:49.097951 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:23:49.097951 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:23:49.097951 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:23:49.097951 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:23:49.097951 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 4b0e40dc-a08b-49e5-a853-4a60160bff96 does not exist Jul 23 21:23:49.097951 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-771a7717-6b12-41ee-9012-5301bc9a3bf8'] Jul 23 21:23:49.097951 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:23:49.101830 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-318bd819-a115-4a2d-aea7-28d588a4eed4 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Returning 404 to user: Security group 4b0e40dc-a08b-49e5-a853-4a60160bff96 does not exist Jul 23 21:23:49.101830 ncdv-master-1 devstack@n-api.service[131320]: Neutron server returns request_ids: ['req-771a7717-6b12-41ee-9012-5301bc9a3bf8'] {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:23:49.102999 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-318bd819-a115-4a2d-aea7-28d588a4eed4 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/4b0e40dc-a08b-49e5-a853-4a60160bff96" status: 404 len: 194 microversion: 2.1 time: 0.075561 Jul 23 21:23:49.104012 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1216/2475] 10.222.0.17 () {58 vars in 1271 bytes} [Sat Jul 23 21:23:49 2022] DELETE /compute/v2.1/os-security-groups/4b0e40dc-a08b-49e5-a853-4a60160bff96 => generated 194 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:23:49.146226 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-484bca72-f047-49ab-9f26-ed39071a1cb8 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Calling method '.version_select at 0x7f0b5415dd30>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:49.214612 ncdv-master-1 devstack@n-api.service[131321]: DEBUG neutronclient.v2_0.client [None req-484bca72-f047-49ab-9f26-ed39071a1cb8 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 3f9d638d-73b6-4e7d-b9bd-68ad9b9598b1 does not exist", "detail": ""}} {{(pid=131321) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 23 21:23:49.215097 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.network.security_group_api [None req-484bca72-f047-49ab-9f26-ed39071a1cb8 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Neutron security group 3f9d638d-73b6-4e7d-b9bd-68ad9b9598b1 not found {{(pid=131321) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 23 21:23:49.215630 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-484bca72-f047-49ab-9f26-ed39071a1cb8 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] HTTP exception thrown: Security group 3f9d638d-73b6-4e7d-b9bd-68ad9b9598b1 does not exist Jul 23 21:23:49.215630 ncdv-master-1 devstack@n-api.service[131321]: Neutron server returns request_ids: ['req-3df2789f-07fe-4897-b347-adaf82a68fdd'] Jul 23 21:23:49.217932 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-484bca72-f047-49ab-9f26-ed39071a1cb8 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Request method failure captured: Jul 23 21:23:49.217932 ncdv-master-1 devstack@n-api.service[131321]: request: DELETE /compute/v2.1/os-security-groups/3f9d638d-73b6-4e7d-b9bd-68ad9b9598b1 HTTP/1.1 Jul 23 21:23:49.217932 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:23:49.217932 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:23:49.217932 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:23:49.217932 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:23:49.217932 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:23:49.217932 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:23:49.217932 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:23:49.217932 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:23:49.217932 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GabcedAy4zvEWDBz4psoyymQjd20otmwoBk14VBCrO5T_u930hsqstuKWfxSIIHSaoINyY7aouwTaS_UH5MldJcqSCrcSo-BYQbnUPzf2q6ne_dSigo_8PievK59Q_5ElGzDVdSYredgO26R1rdGGAuE9yewD0hcCJzYqqhzyGW3Zk Jul 23 21:23:49.217932 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:23:49.217932 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:23:49.217932 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:23:49.217932 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:23:49.217932 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:23:49.217932 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:23:49.217932 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 55cfd65431cf4b878ab1c0e25a0ac629 Jul 23 21:23:49.217932 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-SecurityGroupsTestJSON-553336269 Jul 23 21:23:49.217932 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:23:49.217932 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:23:49.217932 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/55cfd65431cf4b878ab1c0e25a0ac629"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/55cfd65431cf4b878ab1c0e25a0ac629"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_55cfd65431cf4b878ab1c0e25a0ac629", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/55cfd65431cf4b878ab1c0e25a0ac629"}]}] Jul 23 21:23:49.217932 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-SecurityGroupsTestJSON-553336269 Jul 23 21:23:49.217932 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 55cfd65431cf4b878ab1c0e25a0ac629 Jul 23 21:23:49.217932 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-553336269 Jul 23 21:23:49.217932 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-SecurityGroupsTestJSON-553336269-project Jul 23 21:23:49.217932 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:23:49.217932 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:23:49.217932 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 63ca7a39a8174a4b97767245e80b2bf7 Jul 23 21:23:49.217932 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-SecurityGroupsTestJSON-553336269-project Jul 23 21:23:49.217932 ncdv-master-1 devstack@n-api.service[131321]: method: Jul 23 21:23:49.217932 ncdv-master-1 devstack@n-api.service[131321]: exception: Security group 3f9d638d-73b6-4e7d-b9bd-68ad9b9598b1 does not exist Jul 23 21:23:49.217932 ncdv-master-1 devstack@n-api.service[131321]: Neutron server returns request_ids: ['req-3df2789f-07fe-4897-b347-adaf82a68fdd'] Jul 23 21:23:49.217932 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': '3f9d638d-73b6-4e7d-b9bd-68ad9b9598b1'} Jul 23 21:23:49.217932 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:23:49.217932 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:23:49.217932 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 23 21:23:49.217932 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 23 21:23:49.217932 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:23:49.217932 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:23:49.217932 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 23 21:23:49.217932 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 23 21:23:49.217932 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:23:49.217932 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:23:49.217932 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 23 21:23:49.217932 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 23 21:23:49.217932 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:23:49.217932 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:23:49.217932 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 23 21:23:49.217932 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 23 21:23:49.217932 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:23:49.217932 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:23:49.217932 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 23 21:23:49.217932 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 23 21:23:49.217932 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:23:49.217932 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:23:49.217932 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 23 21:23:49.217932 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 23 21:23:49.217932 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 23 21:23:49.217932 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 23 21:23:49.217932 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 3f9d638d-73b6-4e7d-b9bd-68ad9b9598b1 does not exist Jul 23 21:23:49.226689 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3df2789f-07fe-4897-b347-adaf82a68fdd'] Jul 23 21:23:49.226689 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:23:49.226689 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:23:49.226689 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:23:49.226689 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:23:49.226689 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 23 21:23:49.226689 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 23 21:23:49.226689 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 23 21:23:49.226689 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 23 21:23:49.226689 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 3f9d638d-73b6-4e7d-b9bd-68ad9b9598b1 does not exist Jul 23 21:23:49.226689 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3df2789f-07fe-4897-b347-adaf82a68fdd'] Jul 23 21:23:49.226689 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:23:49.226689 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:23:49.226689 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:23:49.226689 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:23:49.226689 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:23:49.226689 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:23:49.226689 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:23:49.226689 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:23:49.226689 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:23:49.226689 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:23:49.226689 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:23:49.226689 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:23:49.226689 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 23 21:23:49.226689 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 23 21:23:49.226689 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 3f9d638d-73b6-4e7d-b9bd-68ad9b9598b1 does not exist Jul 23 21:23:49.226689 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3df2789f-07fe-4897-b347-adaf82a68fdd'] Jul 23 21:23:49.226689 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:23:49.226689 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:23:49.226689 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:23:49.226689 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:23:49.226689 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:23:49.226689 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:23:49.226689 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:23:49.226689 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:23:49.226689 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 3f9d638d-73b6-4e7d-b9bd-68ad9b9598b1 does not exist Jul 23 21:23:49.226689 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3df2789f-07fe-4897-b347-adaf82a68fdd'] Jul 23 21:23:49.226689 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:23:49.226689 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-484bca72-f047-49ab-9f26-ed39071a1cb8 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Returning 404 to user: Security group 3f9d638d-73b6-4e7d-b9bd-68ad9b9598b1 does not exist Jul 23 21:23:49.226689 ncdv-master-1 devstack@n-api.service[131321]: Neutron server returns request_ids: ['req-3df2789f-07fe-4897-b347-adaf82a68fdd'] {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:23:49.226689 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-484bca72-f047-49ab-9f26-ed39071a1cb8 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/3f9d638d-73b6-4e7d-b9bd-68ad9b9598b1" status: 404 len: 194 microversion: 2.1 time: 0.086980 Jul 23 21:23:49.226689 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1260/2476] 10.222.0.17 () {58 vars in 1271 bytes} [Sat Jul 23 21:23:49 2022] DELETE /compute/v2.1/os-security-groups/3f9d638d-73b6-4e7d-b9bd-68ad9b9598b1 => generated 194 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:23:49.233715 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4bc5cf71-bb29-4c27-af34-124151309bce tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Calling method '.version_select at 0x7f0b47d7fee0>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:49.279732 ncdv-master-1 devstack@n-api.service[131320]: DEBUG neutronclient.v2_0.client [None req-4bc5cf71-bb29-4c27-af34-124151309bce tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 076aae80-8291-4292-8530-e3bc0faeb66f does not exist", "detail": ""}} {{(pid=131320) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 23 21:23:49.280493 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.security_group_api [None req-4bc5cf71-bb29-4c27-af34-124151309bce tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Neutron security group 076aae80-8291-4292-8530-e3bc0faeb66f not found {{(pid=131320) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 23 21:23:49.281253 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-4bc5cf71-bb29-4c27-af34-124151309bce tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] HTTP exception thrown: Security group 076aae80-8291-4292-8530-e3bc0faeb66f does not exist Jul 23 21:23:49.281253 ncdv-master-1 devstack@n-api.service[131320]: Neutron server returns request_ids: ['req-325e3869-0399-49bb-b266-23858c6abe5a'] Jul 23 21:23:49.283863 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4bc5cf71-bb29-4c27-af34-124151309bce tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Request method failure captured: Jul 23 21:23:49.283863 ncdv-master-1 devstack@n-api.service[131320]: request: DELETE /compute/v2.1/os-security-groups/076aae80-8291-4292-8530-e3bc0faeb66f HTTP/1.1 Jul 23 21:23:49.283863 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:23:49.283863 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:23:49.283863 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:23:49.283863 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:23:49.283863 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:23:49.283863 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:23:49.283863 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:23:49.283863 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:23:49.283863 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GabcedAy4zvEWDBz4psoyymQjd20otmwoBk14VBCrO5T_u930hsqstuKWfxSIIHSaoINyY7aouwTaS_UH5MldJcqSCrcSo-BYQbnUPzf2q6ne_dSigo_8PievK59Q_5ElGzDVdSYredgO26R1rdGGAuE9yewD0hcCJzYqqhzyGW3Zk Jul 23 21:23:49.283863 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:23:49.283863 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:23:49.283863 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:23:49.283863 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:23:49.283863 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:23:49.283863 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:23:49.283863 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 55cfd65431cf4b878ab1c0e25a0ac629 Jul 23 21:23:49.283863 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-SecurityGroupsTestJSON-553336269 Jul 23 21:23:49.283863 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:23:49.283863 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:23:49.283863 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/55cfd65431cf4b878ab1c0e25a0ac629"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/55cfd65431cf4b878ab1c0e25a0ac629"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_55cfd65431cf4b878ab1c0e25a0ac629", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/55cfd65431cf4b878ab1c0e25a0ac629"}]}] Jul 23 21:23:49.283863 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-SecurityGroupsTestJSON-553336269 Jul 23 21:23:49.283863 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 55cfd65431cf4b878ab1c0e25a0ac629 Jul 23 21:23:49.283863 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-553336269 Jul 23 21:23:49.283863 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-SecurityGroupsTestJSON-553336269-project Jul 23 21:23:49.283863 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:23:49.283863 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:23:49.283863 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 63ca7a39a8174a4b97767245e80b2bf7 Jul 23 21:23:49.283863 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-SecurityGroupsTestJSON-553336269-project Jul 23 21:23:49.283863 ncdv-master-1 devstack@n-api.service[131320]: method: Jul 23 21:23:49.283863 ncdv-master-1 devstack@n-api.service[131320]: exception: Security group 076aae80-8291-4292-8530-e3bc0faeb66f does not exist Jul 23 21:23:49.283863 ncdv-master-1 devstack@n-api.service[131320]: Neutron server returns request_ids: ['req-325e3869-0399-49bb-b266-23858c6abe5a'] Jul 23 21:23:49.283863 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '076aae80-8291-4292-8530-e3bc0faeb66f'} Jul 23 21:23:49.283863 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:23:49.283863 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:23:49.283863 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 23 21:23:49.283863 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 23 21:23:49.283863 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:23:49.283863 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:23:49.283863 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 23 21:23:49.283863 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 23 21:23:49.283863 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:23:49.283863 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:23:49.283863 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 23 21:23:49.283863 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 23 21:23:49.283863 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:23:49.283863 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:23:49.283863 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 23 21:23:49.283863 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 23 21:23:49.283863 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:23:49.283863 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:23:49.283863 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 23 21:23:49.283863 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 23 21:23:49.283863 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:23:49.283863 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:23:49.283863 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 23 21:23:49.283863 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 23 21:23:49.283863 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 23 21:23:49.283863 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 23 21:23:49.283863 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 076aae80-8291-4292-8530-e3bc0faeb66f does not exist Jul 23 21:23:49.288630 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-325e3869-0399-49bb-b266-23858c6abe5a'] Jul 23 21:23:49.288630 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:23:49.288630 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:23:49.288630 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:23:49.288630 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:23:49.288630 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 23 21:23:49.288630 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 23 21:23:49.288630 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 23 21:23:49.288630 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 23 21:23:49.288630 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 076aae80-8291-4292-8530-e3bc0faeb66f does not exist Jul 23 21:23:49.288630 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-325e3869-0399-49bb-b266-23858c6abe5a'] Jul 23 21:23:49.288630 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:23:49.288630 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:23:49.288630 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:23:49.288630 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:23:49.288630 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:23:49.288630 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:23:49.288630 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:23:49.288630 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:23:49.288630 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:23:49.288630 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:23:49.288630 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:23:49.288630 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:23:49.288630 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 23 21:23:49.288630 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 23 21:23:49.288630 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 076aae80-8291-4292-8530-e3bc0faeb66f does not exist Jul 23 21:23:49.288630 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-325e3869-0399-49bb-b266-23858c6abe5a'] Jul 23 21:23:49.288630 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:23:49.288630 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:23:49.288630 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:23:49.288630 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:23:49.288630 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:23:49.288630 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:23:49.288630 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:23:49.288630 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:23:49.288630 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 076aae80-8291-4292-8530-e3bc0faeb66f does not exist Jul 23 21:23:49.288630 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-325e3869-0399-49bb-b266-23858c6abe5a'] Jul 23 21:23:49.288630 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:23:49.295010 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4bc5cf71-bb29-4c27-af34-124151309bce tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Returning 404 to user: Security group 076aae80-8291-4292-8530-e3bc0faeb66f does not exist Jul 23 21:23:49.295010 ncdv-master-1 devstack@n-api.service[131320]: Neutron server returns request_ids: ['req-325e3869-0399-49bb-b266-23858c6abe5a'] {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:23:49.299364 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4bc5cf71-bb29-4c27-af34-124151309bce tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/076aae80-8291-4292-8530-e3bc0faeb66f" status: 404 len: 194 microversion: 2.1 time: 0.073557 Jul 23 21:23:49.302808 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1217/2477] 10.222.0.17 () {58 vars in 1271 bytes} [Sat Jul 23 21:23:49 2022] DELETE /compute/v2.1/os-security-groups/076aae80-8291-4292-8530-e3bc0faeb66f => generated 194 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:23:49.311992 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-93a31180-ca05-4c3d-8888-31f9dbae2d8b tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Calling method '.version_select at 0x7f0b47e2b8b0>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:49.355675 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-189c15ec-412a-4fe5-a856-7fa5697fa8f7 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Calling method '.version_select at 0x7f0b59901160>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:49.444325 ncdv-master-1 devstack@n-api.service[131321]: DEBUG neutronclient.v2_0.client [None req-93a31180-ca05-4c3d-8888-31f9dbae2d8b tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c90a9b12-6e49-4196-a98f-7fa245c3f86f does not exist", "detail": ""}} {{(pid=131321) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 23 21:23:49.445272 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.network.security_group_api [None req-93a31180-ca05-4c3d-8888-31f9dbae2d8b tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Neutron security group c90a9b12-6e49-4196-a98f-7fa245c3f86f not found {{(pid=131321) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 23 21:23:49.446167 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-93a31180-ca05-4c3d-8888-31f9dbae2d8b tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] HTTP exception thrown: Security group c90a9b12-6e49-4196-a98f-7fa245c3f86f does not exist Jul 23 21:23:49.446167 ncdv-master-1 devstack@n-api.service[131321]: Neutron server returns request_ids: ['req-ecadf1df-c847-45e6-a60e-0326b712dc98'] Jul 23 21:23:49.448610 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-93a31180-ca05-4c3d-8888-31f9dbae2d8b tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Request method failure captured: Jul 23 21:23:49.448610 ncdv-master-1 devstack@n-api.service[131321]: request: DELETE /compute/v2.1/os-security-groups/c90a9b12-6e49-4196-a98f-7fa245c3f86f HTTP/1.1 Jul 23 21:23:49.448610 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:23:49.448610 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:23:49.448610 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:23:49.448610 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:23:49.448610 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:23:49.448610 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:23:49.448610 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:23:49.448610 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:23:49.448610 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GabcedAy4zvEWDBz4psoyymQjd20otmwoBk14VBCrO5T_u930hsqstuKWfxSIIHSaoINyY7aouwTaS_UH5MldJcqSCrcSo-BYQbnUPzf2q6ne_dSigo_8PievK59Q_5ElGzDVdSYredgO26R1rdGGAuE9yewD0hcCJzYqqhzyGW3Zk Jul 23 21:23:49.448610 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:23:49.448610 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:23:49.448610 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:23:49.448610 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:23:49.448610 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:23:49.448610 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:23:49.448610 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 55cfd65431cf4b878ab1c0e25a0ac629 Jul 23 21:23:49.448610 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-SecurityGroupsTestJSON-553336269 Jul 23 21:23:49.448610 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:23:49.448610 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:23:49.448610 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/55cfd65431cf4b878ab1c0e25a0ac629"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/55cfd65431cf4b878ab1c0e25a0ac629"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_55cfd65431cf4b878ab1c0e25a0ac629", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/55cfd65431cf4b878ab1c0e25a0ac629"}]}] Jul 23 21:23:49.448610 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-SecurityGroupsTestJSON-553336269 Jul 23 21:23:49.448610 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 55cfd65431cf4b878ab1c0e25a0ac629 Jul 23 21:23:49.448610 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-553336269 Jul 23 21:23:49.448610 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-SecurityGroupsTestJSON-553336269-project Jul 23 21:23:49.448610 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:23:49.448610 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:23:49.448610 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 63ca7a39a8174a4b97767245e80b2bf7 Jul 23 21:23:49.448610 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-SecurityGroupsTestJSON-553336269-project Jul 23 21:23:49.448610 ncdv-master-1 devstack@n-api.service[131321]: method: Jul 23 21:23:49.448610 ncdv-master-1 devstack@n-api.service[131321]: exception: Security group c90a9b12-6e49-4196-a98f-7fa245c3f86f does not exist Jul 23 21:23:49.448610 ncdv-master-1 devstack@n-api.service[131321]: Neutron server returns request_ids: ['req-ecadf1df-c847-45e6-a60e-0326b712dc98'] Jul 23 21:23:49.448610 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': 'c90a9b12-6e49-4196-a98f-7fa245c3f86f'} Jul 23 21:23:49.448610 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:23:49.448610 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:23:49.448610 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 23 21:23:49.448610 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 23 21:23:49.448610 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:23:49.448610 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:23:49.448610 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 23 21:23:49.448610 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 23 21:23:49.448610 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:23:49.448610 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:23:49.448610 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 23 21:23:49.448610 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 23 21:23:49.448610 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:23:49.448610 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:23:49.448610 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 23 21:23:49.448610 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 23 21:23:49.448610 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:23:49.448610 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:23:49.448610 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 23 21:23:49.448610 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 23 21:23:49.448610 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:23:49.448610 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:23:49.448610 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 23 21:23:49.448610 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 23 21:23:49.448610 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 23 21:23:49.448610 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 23 21:23:49.448610 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c90a9b12-6e49-4196-a98f-7fa245c3f86f does not exist Jul 23 21:23:49.454225 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ecadf1df-c847-45e6-a60e-0326b712dc98'] Jul 23 21:23:49.454225 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:23:49.454225 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:23:49.454225 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:23:49.454225 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:23:49.454225 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 23 21:23:49.454225 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 23 21:23:49.454225 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 23 21:23:49.454225 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 23 21:23:49.454225 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c90a9b12-6e49-4196-a98f-7fa245c3f86f does not exist Jul 23 21:23:49.454225 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ecadf1df-c847-45e6-a60e-0326b712dc98'] Jul 23 21:23:49.454225 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:23:49.454225 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:23:49.454225 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:23:49.454225 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:23:49.454225 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:23:49.454225 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:23:49.454225 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:23:49.454225 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:23:49.454225 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:23:49.454225 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:23:49.454225 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:23:49.454225 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:23:49.454225 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 23 21:23:49.454225 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 23 21:23:49.454225 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c90a9b12-6e49-4196-a98f-7fa245c3f86f does not exist Jul 23 21:23:49.454225 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ecadf1df-c847-45e6-a60e-0326b712dc98'] Jul 23 21:23:49.454225 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:23:49.454225 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:23:49.454225 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:23:49.454225 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:23:49.454225 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:23:49.454225 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:23:49.454225 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:23:49.454225 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:23:49.454225 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c90a9b12-6e49-4196-a98f-7fa245c3f86f does not exist Jul 23 21:23:49.454225 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ecadf1df-c847-45e6-a60e-0326b712dc98'] Jul 23 21:23:49.454225 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:23:49.456808 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-93a31180-ca05-4c3d-8888-31f9dbae2d8b tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Returning 404 to user: Security group c90a9b12-6e49-4196-a98f-7fa245c3f86f does not exist Jul 23 21:23:49.456808 ncdv-master-1 devstack@n-api.service[131321]: Neutron server returns request_ids: ['req-ecadf1df-c847-45e6-a60e-0326b712dc98'] {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:23:49.456808 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-93a31180-ca05-4c3d-8888-31f9dbae2d8b tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/c90a9b12-6e49-4196-a98f-7fa245c3f86f" status: 404 len: 194 microversion: 2.1 time: 0.149770 Jul 23 21:23:49.467154 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1261/2478] 10.222.0.17 () {58 vars in 1271 bytes} [Sat Jul 23 21:23:49 2022] DELETE /compute/v2.1/os-security-groups/c90a9b12-6e49-4196-a98f-7fa245c3f86f => generated 194 bytes in 162 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:23:49.468368 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-189c15ec-412a-4fe5-a856-7fa5697fa8f7 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] 10.222.0.17 "GET /compute/v2.1/images/e57c215e-ddc6-4510-9626-f3760a490e39" status: 200 len: 1428 microversion: 2.1 time: 0.123157 Jul 23 21:23:49.470348 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1218/2479] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:23:49 2022] GET /compute/v2.1/images/e57c215e-ddc6-4510-9626-f3760a490e39 => generated 1428 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:23:49.482077 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-25f94879-2b07-45dc-94f7-2f1b4fddf522 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Calling method '.version_select at 0x7f0b598dcaf0>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:49.482534 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-bceb0f98-3057-40fc-b01d-b846b76f1b2d tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:49.483172 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-bceb0f98-3057-40fc-b01d-b846b76f1b2d tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] [instance: dd8dace4-4427-490e-ad29-73092c943515] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:49.505641 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bceb0f98-3057-40fc-b01d-b846b76f1b2d tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:49.509130 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bceb0f98-3057-40fc-b01d-b846b76f1b2d tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:49.510024 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bceb0f98-3057-40fc-b01d-b846b76f1b2d tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:49.510844 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bceb0f98-3057-40fc-b01d-b846b76f1b2d tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:49.533365 ncdv-master-1 devstack@n-api.service[131320]: DEBUG neutronclient.v2_0.client [None req-25f94879-2b07-45dc-94f7-2f1b4fddf522 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 0f61276a-4635-4afc-9cc7-7dfc52c098e5 does not exist", "detail": ""}} {{(pid=131320) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 23 21:23:49.534255 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.security_group_api [None req-25f94879-2b07-45dc-94f7-2f1b4fddf522 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Neutron security group 0f61276a-4635-4afc-9cc7-7dfc52c098e5 not found {{(pid=131320) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 23 21:23:49.534995 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-25f94879-2b07-45dc-94f7-2f1b4fddf522 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] HTTP exception thrown: Security group 0f61276a-4635-4afc-9cc7-7dfc52c098e5 does not exist Jul 23 21:23:49.534995 ncdv-master-1 devstack@n-api.service[131320]: Neutron server returns request_ids: ['req-bd3f67e2-2552-481a-aa17-164518baeb15'] Jul 23 21:23:49.537326 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-25f94879-2b07-45dc-94f7-2f1b4fddf522 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Request method failure captured: Jul 23 21:23:49.537326 ncdv-master-1 devstack@n-api.service[131320]: request: DELETE /compute/v2.1/os-security-groups/0f61276a-4635-4afc-9cc7-7dfc52c098e5 HTTP/1.1 Jul 23 21:23:49.537326 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:23:49.537326 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:23:49.537326 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:23:49.537326 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:23:49.537326 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:23:49.537326 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:23:49.537326 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:23:49.537326 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:23:49.537326 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GabcedAy4zvEWDBz4psoyymQjd20otmwoBk14VBCrO5T_u930hsqstuKWfxSIIHSaoINyY7aouwTaS_UH5MldJcqSCrcSo-BYQbnUPzf2q6ne_dSigo_8PievK59Q_5ElGzDVdSYredgO26R1rdGGAuE9yewD0hcCJzYqqhzyGW3Zk Jul 23 21:23:49.537326 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:23:49.537326 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:23:49.537326 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:23:49.537326 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:23:49.537326 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:23:49.537326 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:23:49.537326 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 55cfd65431cf4b878ab1c0e25a0ac629 Jul 23 21:23:49.537326 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-SecurityGroupsTestJSON-553336269 Jul 23 21:23:49.537326 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:23:49.537326 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:23:49.537326 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/55cfd65431cf4b878ab1c0e25a0ac629"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/55cfd65431cf4b878ab1c0e25a0ac629"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_55cfd65431cf4b878ab1c0e25a0ac629", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/55cfd65431cf4b878ab1c0e25a0ac629"}]}] Jul 23 21:23:49.537326 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-SecurityGroupsTestJSON-553336269 Jul 23 21:23:49.537326 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 55cfd65431cf4b878ab1c0e25a0ac629 Jul 23 21:23:49.537326 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-553336269 Jul 23 21:23:49.537326 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-SecurityGroupsTestJSON-553336269-project Jul 23 21:23:49.537326 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:23:49.537326 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:23:49.537326 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 63ca7a39a8174a4b97767245e80b2bf7 Jul 23 21:23:49.537326 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-SecurityGroupsTestJSON-553336269-project Jul 23 21:23:49.537326 ncdv-master-1 devstack@n-api.service[131320]: method: Jul 23 21:23:49.537326 ncdv-master-1 devstack@n-api.service[131320]: exception: Security group 0f61276a-4635-4afc-9cc7-7dfc52c098e5 does not exist Jul 23 21:23:49.537326 ncdv-master-1 devstack@n-api.service[131320]: Neutron server returns request_ids: ['req-bd3f67e2-2552-481a-aa17-164518baeb15'] Jul 23 21:23:49.537326 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '0f61276a-4635-4afc-9cc7-7dfc52c098e5'} Jul 23 21:23:49.537326 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:23:49.537326 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:23:49.537326 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 23 21:23:49.537326 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 23 21:23:49.537326 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:23:49.537326 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:23:49.537326 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 23 21:23:49.537326 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 23 21:23:49.537326 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:23:49.537326 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:23:49.537326 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 23 21:23:49.537326 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 23 21:23:49.537326 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:23:49.537326 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:23:49.537326 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 23 21:23:49.537326 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 23 21:23:49.537326 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:23:49.537326 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:23:49.537326 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 23 21:23:49.537326 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 23 21:23:49.537326 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:23:49.537326 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:23:49.537326 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 23 21:23:49.537326 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 23 21:23:49.537326 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 23 21:23:49.537326 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 23 21:23:49.537326 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 0f61276a-4635-4afc-9cc7-7dfc52c098e5 does not exist Jul 23 21:23:49.540751 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bd3f67e2-2552-481a-aa17-164518baeb15'] Jul 23 21:23:49.540751 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:23:49.540751 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:23:49.540751 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:23:49.540751 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:23:49.540751 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 23 21:23:49.540751 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 23 21:23:49.540751 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 23 21:23:49.540751 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 23 21:23:49.540751 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 0f61276a-4635-4afc-9cc7-7dfc52c098e5 does not exist Jul 23 21:23:49.540751 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bd3f67e2-2552-481a-aa17-164518baeb15'] Jul 23 21:23:49.540751 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:23:49.540751 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:23:49.540751 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:23:49.540751 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:23:49.540751 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:23:49.540751 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:23:49.540751 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:23:49.540751 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:23:49.540751 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:23:49.540751 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:23:49.540751 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:23:49.540751 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:23:49.540751 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 23 21:23:49.540751 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 23 21:23:49.540751 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 0f61276a-4635-4afc-9cc7-7dfc52c098e5 does not exist Jul 23 21:23:49.540751 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bd3f67e2-2552-481a-aa17-164518baeb15'] Jul 23 21:23:49.540751 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:23:49.540751 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:23:49.540751 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:23:49.540751 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:23:49.540751 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:23:49.540751 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:23:49.540751 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:23:49.540751 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:23:49.540751 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 0f61276a-4635-4afc-9cc7-7dfc52c098e5 does not exist Jul 23 21:23:49.540751 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bd3f67e2-2552-481a-aa17-164518baeb15'] Jul 23 21:23:49.540751 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:23:49.547760 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-25f94879-2b07-45dc-94f7-2f1b4fddf522 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Returning 404 to user: Security group 0f61276a-4635-4afc-9cc7-7dfc52c098e5 does not exist Jul 23 21:23:49.547760 ncdv-master-1 devstack@n-api.service[131320]: Neutron server returns request_ids: ['req-bd3f67e2-2552-481a-aa17-164518baeb15'] {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:23:49.548957 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-25f94879-2b07-45dc-94f7-2f1b4fddf522 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/0f61276a-4635-4afc-9cc7-7dfc52c098e5" status: 404 len: 194 microversion: 2.1 time: 0.077466 Jul 23 21:23:49.550162 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1219/2480] 10.222.0.17 () {58 vars in 1271 bytes} [Sat Jul 23 21:23:49 2022] DELETE /compute/v2.1/os-security-groups/0f61276a-4635-4afc-9cc7-7dfc52c098e5 => generated 194 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:23:49.587994 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5d17d738-e4af-4f4c-b0e3-26603fe021d9 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:49.589972 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5d17d738-e4af-4f4c-b0e3-26603fe021d9 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] [instance: 4824dd17-e11d-4def-ab59-9eb6279e46e8] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:49.612804 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5d17d738-e4af-4f4c-b0e3-26603fe021d9 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:49.620355 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5d17d738-e4af-4f4c-b0e3-26603fe021d9 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:49.624387 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5d17d738-e4af-4f4c-b0e3-26603fe021d9 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:49.626814 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5d17d738-e4af-4f4c-b0e3-26603fe021d9 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:49.732946 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5d17d738-e4af-4f4c-b0e3-26603fe021d9 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] [instance: 4824dd17-e11d-4def-ab59-9eb6279e46e8] Going to try to terminate instance {{(pid=131320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:23:49.999398 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5d17d738-e4af-4f4c-b0e3-26603fe021d9 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] 10.222.0.17 "DELETE /compute/v2.1/servers/4824dd17-e11d-4def-ab59-9eb6279e46e8" status: 204 len: 0 microversion: 2.1 time: 0.443200 Jul 23 21:23:50.002940 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1220/2481] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:23:49 2022] DELETE /compute/v2.1/servers/4824dd17-e11d-4def-ab59-9eb6279e46e8 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:23:50.013362 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-fc493560-12b2-40af-b50e-dd766019f564 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:50.017477 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-fc493560-12b2-40af-b50e-dd766019f564 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] [instance: c73f1c6e-9c56-453d-89bf-b9e24f360f33] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:50.033443 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fc493560-12b2-40af-b50e-dd766019f564 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:50.037796 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fc493560-12b2-40af-b50e-dd766019f564 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:50.040055 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fc493560-12b2-40af-b50e-dd766019f564 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:50.042720 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fc493560-12b2-40af-b50e-dd766019f564 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:50.298670 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-fc493560-12b2-40af-b50e-dd766019f564 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a812b6571db40a1a2f138dc03d4e1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14294b18c6e4936b1272a57d4faccce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:23:50.307508 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-fc493560-12b2-40af-b50e-dd766019f564 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] 10.222.0.17 "GET /compute/v2.1/servers/c73f1c6e-9c56-453d-89bf-b9e24f360f33" status: 200 len: 1295 microversion: 2.1 time: 0.302987 Jul 23 21:23:50.308734 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1221/2482] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:50 2022] GET /compute/v2.1/servers/c73f1c6e-9c56-453d-89bf-b9e24f360f33 => generated 1295 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:50.313747 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-7e3760cd-445c-48fa-8691-8e59e6400d50 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:50.314811 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-7e3760cd-445c-48fa-8691-8e59e6400d50 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] [instance: 011c4ff9-9d46-44df-bf9b-e0269c71c417] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:50.326539 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7e3760cd-445c-48fa-8691-8e59e6400d50 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:50.328961 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7e3760cd-445c-48fa-8691-8e59e6400d50 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:50.330253 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7e3760cd-445c-48fa-8691-8e59e6400d50 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:50.330917 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7e3760cd-445c-48fa-8691-8e59e6400d50 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:50.566929 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-bceb0f98-3057-40fc-b01d-b846b76f1b2d tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e74c139b38d74d9ab93695471ccd3a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ff73d603ec4069a908452514a59451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:23:50.579847 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-bceb0f98-3057-40fc-b01d-b846b76f1b2d tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] 10.222.0.17 "GET /compute/v2.1/servers/dd8dace4-4427-490e-ad29-73092c943515" status: 200 len: 1355 microversion: 2.1 time: 1.111516 Jul 23 21:23:50.584852 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1262/2483] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:49 2022] GET /compute/v2.1/servers/dd8dace4-4427-490e-ad29-73092c943515 => generated 1355 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:50.597707 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a72fccbe-808a-4179-a99a-edafa3db91f8 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:50.598725 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-a72fccbe-808a-4179-a99a-edafa3db91f8 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] [instance: 4824dd17-e11d-4def-ab59-9eb6279e46e8] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:50.626261 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a72fccbe-808a-4179-a99a-edafa3db91f8 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:50.636100 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a72fccbe-808a-4179-a99a-edafa3db91f8 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:50.640294 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a72fccbe-808a-4179-a99a-edafa3db91f8 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:50.641173 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a72fccbe-808a-4179-a99a-edafa3db91f8 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:50.688786 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:23:50.867670 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-7e3760cd-445c-48fa-8691-8e59e6400d50 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013b521930d54d6d952e566f8e67f466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1432b2e152894407afae7b6419d80a8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:23:50.888234 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-7e3760cd-445c-48fa-8691-8e59e6400d50 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] 10.222.0.17 "GET /compute/v2.1/servers/011c4ff9-9d46-44df-bf9b-e0269c71c417" status: 200 len: 1352 microversion: 2.1 time: 0.577875 Jul 23 21:23:50.894397 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1222/2484] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:50 2022] GET /compute/v2.1/servers/011c4ff9-9d46-44df-bf9b-e0269c71c417 => generated 1352 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:50.899556 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-465dc10c-2a54-43e7-ae29-2f8f1f974d33 req-6cdb0c66-0404-4236-9392-ee6b64b06903 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "011c4ff9-9d46-44df-bf9b-e0269c71c417", "tag": "e9103d4a-4c54-4f9a-a910-26edefe5de92"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:23:50.917056 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-465dc10c-2a54-43e7-ae29-2f8f1f974d33 req-6cdb0c66-0404-4236-9392-ee6b64b06903 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:50.924196 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-465dc10c-2a54-43e7-ae29-2f8f1f974d33 req-6cdb0c66-0404-4236-9392-ee6b64b06903 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:50.968391 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-465dc10c-2a54-43e7-ae29-2f8f1f974d33 req-6cdb0c66-0404-4236-9392-ee6b64b06903 service nova] Creating event network-changed:e9103d4a-4c54-4f9a-a910-26edefe5de92 for instance 011c4ff9-9d46-44df-bf9b-e0269c71c417 on nch1-master-1 Jul 23 21:23:50.976350 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-465dc10c-2a54-43e7-ae29-2f8f1f974d33 req-6cdb0c66-0404-4236-9392-ee6b64b06903 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080454 Jul 23 21:23:50.980277 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1223/2485] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:23:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:23:50.985826 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b9cf88f5-93e1-48a3-b7f9-4e139b13c4b2 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Calling method '.version_select at 0x7f0b599bb160>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:51.082846 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b9cf88f5-93e1-48a3-b7f9-4e139b13c4b2 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] 10.222.0.17 "GET /compute/v2.1/images/e57c215e-ddc6-4510-9626-f3760a490e39" status: 200 len: 1428 microversion: 2.1 time: 0.100910 Jul 23 21:23:51.088610 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1224/2486] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:23:50 2022] GET /compute/v2.1/images/e57c215e-ddc6-4510-9626-f3760a490e39 => generated 1428 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:51.100956 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-87e90e25-30c1-435b-ac64-34927ced4b7f req-e6140dd2-b951-421d-9c17-466f0de5c7d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd8dace4-4427-490e-ad29-73092c943515", "name": "network-vif-plugged", "status": "completed", "tag": "f5ad3cc2-0f6f-4876-bcd7-fbf8f64bb82f"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:23:51.158859 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-87e90e25-30c1-435b-ac64-34927ced4b7f req-e6140dd2-b951-421d-9c17-466f0de5c7d0 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:51.159305 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-87e90e25-30c1-435b-ac64-34927ced4b7f req-e6140dd2-b951-421d-9c17-466f0de5c7d0 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:51.201639 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-87e90e25-30c1-435b-ac64-34927ced4b7f req-e6140dd2-b951-421d-9c17-466f0de5c7d0 service nova] Creating event network-vif-plugged:f5ad3cc2-0f6f-4876-bcd7-fbf8f64bb82f for instance dd8dace4-4427-490e-ad29-73092c943515 on nch2-master-1 Jul 23 21:23:51.208098 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-87e90e25-30c1-435b-ac64-34927ced4b7f req-e6140dd2-b951-421d-9c17-466f0de5c7d0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122225 Jul 23 21:23:51.209678 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1225/2487] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:23:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:23:51.328653 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b2e1d001-1664-4f45-a2f1-03625b642136 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:51.330235 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b2e1d001-1664-4f45-a2f1-03625b642136 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] [instance: c73f1c6e-9c56-453d-89bf-b9e24f360f33] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:51.363605 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b2e1d001-1664-4f45-a2f1-03625b642136 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:51.364137 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b2e1d001-1664-4f45-a2f1-03625b642136 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:51.365008 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b2e1d001-1664-4f45-a2f1-03625b642136 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:51.373548 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b2e1d001-1664-4f45-a2f1-03625b642136 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:51.661669 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b2e1d001-1664-4f45-a2f1-03625b642136 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a812b6571db40a1a2f138dc03d4e1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14294b18c6e4936b1272a57d4faccce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:23:51.676563 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b2e1d001-1664-4f45-a2f1-03625b642136 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] 10.222.0.17 "GET /compute/v2.1/servers/c73f1c6e-9c56-453d-89bf-b9e24f360f33" status: 200 len: 1283 microversion: 2.1 time: 0.354507 Jul 23 21:23:51.677346 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1226/2488] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:51 2022] GET /compute/v2.1/servers/c73f1c6e-9c56-453d-89bf-b9e24f360f33 => generated 1283 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:51.691987 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-08fdc2e6-99da-4742-b292-c28773025099 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:51.699345 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-08fdc2e6-99da-4742-b292-c28773025099 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] [instance: dd8dace4-4427-490e-ad29-73092c943515] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:51.706696 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-08fdc2e6-99da-4742-b292-c28773025099 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:51.707671 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-08fdc2e6-99da-4742-b292-c28773025099 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:51.714178 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-08fdc2e6-99da-4742-b292-c28773025099 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:51.714988 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-08fdc2e6-99da-4742-b292-c28773025099 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:52.104449 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-a72fccbe-808a-4179-a99a-edafa3db91f8 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ca7a39a8174a4b97767245e80b2bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55cfd65431cf4b878ab1c0e25a0ac629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:23:52.130457 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-a72fccbe-808a-4179-a99a-edafa3db91f8 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] 10.222.0.17 "GET /compute/v2.1/servers/4824dd17-e11d-4def-ab59-9eb6279e46e8" status: 200 len: 1646 microversion: 2.1 time: 1.541727 Jul 23 21:23:52.131252 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1263/2489] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:50 2022] GET /compute/v2.1/servers/4824dd17-e11d-4def-ab59-9eb6279e46e8 => generated 1646 bytes in 1546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:52.139386 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-039e40f9-5026-44dd-84fc-593ca8b1cbe6 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:52.140624 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-039e40f9-5026-44dd-84fc-593ca8b1cbe6 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] [instance: 011c4ff9-9d46-44df-bf9b-e0269c71c417] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:52.162410 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-039e40f9-5026-44dd-84fc-593ca8b1cbe6 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:52.163087 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-039e40f9-5026-44dd-84fc-593ca8b1cbe6 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:52.165834 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-039e40f9-5026-44dd-84fc-593ca8b1cbe6 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:52.168073 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-039e40f9-5026-44dd-84fc-593ca8b1cbe6 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:52.481373 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell0:SELECT=2 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:23:52.758686 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-039e40f9-5026-44dd-84fc-593ca8b1cbe6 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013b521930d54d6d952e566f8e67f466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1432b2e152894407afae7b6419d80a8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:23:52.767614 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-039e40f9-5026-44dd-84fc-593ca8b1cbe6 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] 10.222.0.17 "GET /compute/v2.1/servers/011c4ff9-9d46-44df-bf9b-e0269c71c417" status: 200 len: 1352 microversion: 2.1 time: 0.635063 Jul 23 21:23:52.768208 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1264/2490] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:52 2022] GET /compute/v2.1/servers/011c4ff9-9d46-44df-bf9b-e0269c71c417 => generated 1352 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:52.779848 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-25bb0b74-467b-42e3-9c8e-bed964d3c3a1 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Calling method '.version_select at 0x7f0b599b5e50>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:52.850782 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-25bb0b74-467b-42e3-9c8e-bed964d3c3a1 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] 10.222.0.17 "GET /compute/v2.1/images/e57c215e-ddc6-4510-9626-f3760a490e39" status: 200 len: 1428 microversion: 2.1 time: 0.081493 Jul 23 21:23:52.856289 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1265/2491] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:23:52 2022] GET /compute/v2.1/images/e57c215e-ddc6-4510-9626-f3760a490e39 => generated 1428 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:52.867410 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-7a0e9d58-834f-4b61-ab5b-fb4b56d7175e tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:52.868287 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-7a0e9d58-834f-4b61-ab5b-fb4b56d7175e tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] [instance: c73f1c6e-9c56-453d-89bf-b9e24f360f33] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:52.883171 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7a0e9d58-834f-4b61-ab5b-fb4b56d7175e tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:52.885130 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7a0e9d58-834f-4b61-ab5b-fb4b56d7175e tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:52.886190 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7a0e9d58-834f-4b61-ab5b-fb4b56d7175e tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:52.886798 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7a0e9d58-834f-4b61-ab5b-fb4b56d7175e tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:52.913468 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-08fdc2e6-99da-4742-b292-c28773025099 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e74c139b38d74d9ab93695471ccd3a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ff73d603ec4069a908452514a59451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:23:52.926199 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-08fdc2e6-99da-4742-b292-c28773025099 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] 10.222.0.17 "GET /compute/v2.1/servers/dd8dace4-4427-490e-ad29-73092c943515" status: 200 len: 1355 microversion: 2.1 time: 1.234267 Jul 23 21:23:52.936935 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1227/2492] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:51 2022] GET /compute/v2.1/servers/dd8dace4-4427-490e-ad29-73092c943515 => generated 1355 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:53.037081 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-7a0e9d58-834f-4b61-ab5b-fb4b56d7175e tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a812b6571db40a1a2f138dc03d4e1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14294b18c6e4936b1272a57d4faccce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:23:53.046220 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-7a0e9d58-834f-4b61-ab5b-fb4b56d7175e tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] 10.222.0.17 "GET /compute/v2.1/servers/c73f1c6e-9c56-453d-89bf-b9e24f360f33" status: 200 len: 1283 microversion: 2.1 time: 0.188628 Jul 23 21:23:53.051283 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1266/2493] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:52 2022] GET /compute/v2.1/servers/c73f1c6e-9c56-453d-89bf-b9e24f360f33 => generated 1283 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:53.149662 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-54a83aa7-7b74-47a2-8925-adcde27b81d7 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:53.150514 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-54a83aa7-7b74-47a2-8925-adcde27b81d7 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] [instance: 4824dd17-e11d-4def-ab59-9eb6279e46e8] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:53.153759 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=3,nova_api:INSERT=4 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:23:53.178344 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-54a83aa7-7b74-47a2-8925-adcde27b81d7 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:53.178883 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-54a83aa7-7b74-47a2-8925-adcde27b81d7 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:53.179690 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-54a83aa7-7b74-47a2-8925-adcde27b81d7 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:53.194930 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-54a83aa7-7b74-47a2-8925-adcde27b81d7 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:53.246925 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-0c16ea9d-eb36-44da-b3da-30f881cd251e req-fd8e5d8c-a698-4253-b9bc-2f9a924eb233 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd8dace4-4427-490e-ad29-73092c943515", "name": "network-vif-plugged", "status": "completed", "tag": "08d3703a-fc82-45d7-a979-0da0e96e3452"}, {"server_uuid": "dd8dace4-4427-490e-ad29-73092c943515", "name": "network-vif-plugged", "status": "completed", "tag": "a7c2389d-d3e3-45ba-a0f7-f037c086060d"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:23:53.270807 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-0c16ea9d-eb36-44da-b3da-30f881cd251e req-fd8e5d8c-a698-4253-b9bc-2f9a924eb233 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:53.271306 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-0c16ea9d-eb36-44da-b3da-30f881cd251e req-fd8e5d8c-a698-4253-b9bc-2f9a924eb233 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:53.339339 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-0c16ea9d-eb36-44da-b3da-30f881cd251e req-fd8e5d8c-a698-4253-b9bc-2f9a924eb233 service nova] Creating event network-vif-plugged:08d3703a-fc82-45d7-a979-0da0e96e3452 for instance dd8dace4-4427-490e-ad29-73092c943515 on nch2-master-1 Jul 23 21:23:53.339881 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-0c16ea9d-eb36-44da-b3da-30f881cd251e req-fd8e5d8c-a698-4253-b9bc-2f9a924eb233 service nova] Creating event network-vif-plugged:a7c2389d-d3e3-45ba-a0f7-f037c086060d for instance dd8dace4-4427-490e-ad29-73092c943515 on nch2-master-1 Jul 23 21:23:53.357793 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-0c16ea9d-eb36-44da-b3da-30f881cd251e req-fd8e5d8c-a698-4253-b9bc-2f9a924eb233 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.116686 Jul 23 21:23:53.359253 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1267/2494] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:23:53 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:23:53.509224 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-54a83aa7-7b74-47a2-8925-adcde27b81d7 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63ca7a39a8174a4b97767245e80b2bf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55cfd65431cf4b878ab1c0e25a0ac629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:23:53.517432 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-54a83aa7-7b74-47a2-8925-adcde27b81d7 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] 10.222.0.17 "GET /compute/v2.1/servers/4824dd17-e11d-4def-ab59-9eb6279e46e8" status: 200 len: 1466 microversion: 2.1 time: 0.372301 Jul 23 21:23:53.526897 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1228/2495] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:53 2022] GET /compute/v2.1/servers/4824dd17-e11d-4def-ab59-9eb6279e46e8 => generated 1466 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:53.695659 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-ccfb3c1f-5e07-4311-9efb-67d28892fdfc req-f67541ea-873f-4016-bc4f-37ef42eaf5d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4824dd17-e11d-4def-ab59-9eb6279e46e8", "name": "network-vif-deleted", "tag": "bb88db37-af82-4c73-af5d-d2e71214c2df"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:23:53.709119 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-ccfb3c1f-5e07-4311-9efb-67d28892fdfc req-f67541ea-873f-4016-bc4f-37ef42eaf5d7 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:53.709575 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-ccfb3c1f-5e07-4311-9efb-67d28892fdfc req-f67541ea-873f-4016-bc4f-37ef42eaf5d7 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:53.721979 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-ccfb3c1f-5e07-4311-9efb-67d28892fdfc req-f67541ea-873f-4016-bc4f-37ef42eaf5d7 service nova] Creating event network-vif-deleted:bb88db37-af82-4c73-af5d-d2e71214c2df for instance 4824dd17-e11d-4def-ab59-9eb6279e46e8 on nch2-master-1 Jul 23 21:23:53.728853 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-ccfb3c1f-5e07-4311-9efb-67d28892fdfc req-f67541ea-873f-4016-bc4f-37ef42eaf5d7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038297 Jul 23 21:23:53.730045 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1268/2496] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:23:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:23:53.785498 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a407242a-17cd-4015-bdd5-bbd0293cd933 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:53.786151 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a407242a-17cd-4015-bdd5-bbd0293cd933 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] [instance: 011c4ff9-9d46-44df-bf9b-e0269c71c417] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:53.800762 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a407242a-17cd-4015-bdd5-bbd0293cd933 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:53.801221 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a407242a-17cd-4015-bdd5-bbd0293cd933 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:53.802096 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a407242a-17cd-4015-bdd5-bbd0293cd933 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:53.802535 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a407242a-17cd-4015-bdd5-bbd0293cd933 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:53.867921 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-5c6f8c9a-5b08-4b13-8f08-d5f58a81b242 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Calling method '.version_select at 0x7f0b599b5670>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:53.995332 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-5c6f8c9a-5b08-4b13-8f08-d5f58a81b242 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] 10.222.0.17 "GET /compute/v2.1/images/e57c215e-ddc6-4510-9626-f3760a490e39" status: 200 len: 1428 microversion: 2.1 time: 0.131811 Jul 23 21:23:53.999661 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1269/2497] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:23:53 2022] GET /compute/v2.1/images/e57c215e-ddc6-4510-9626-f3760a490e39 => generated 1428 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:54.130405 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a407242a-17cd-4015-bdd5-bbd0293cd933 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013b521930d54d6d952e566f8e67f466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1432b2e152894407afae7b6419d80a8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:23:54.143589 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a407242a-17cd-4015-bdd5-bbd0293cd933 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] 10.222.0.17 "GET /compute/v2.1/servers/011c4ff9-9d46-44df-bf9b-e0269c71c417" status: 200 len: 1352 microversion: 2.1 time: 0.362447 Jul 23 21:23:54.154511 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1229/2498] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:53 2022] GET /compute/v2.1/servers/011c4ff9-9d46-44df-bf9b-e0269c71c417 => generated 1352 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:54.160234 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b7b19b21-ce85-402e-835f-11037287c65f tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:54.161092 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b7b19b21-ce85-402e-835f-11037287c65f tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] [instance: dd8dace4-4427-490e-ad29-73092c943515] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:54.169040 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b7b19b21-ce85-402e-835f-11037287c65f tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:54.169922 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b7b19b21-ce85-402e-835f-11037287c65f tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:54.171033 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b7b19b21-ce85-402e-835f-11037287c65f tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:54.171658 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b7b19b21-ce85-402e-835f-11037287c65f tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:54.176351 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:23:54.204457 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e802037b-6133-4f47-9745-00c970166ff1 tempest-ServicesAdminTestJSON-209624940 tempest-ServicesAdminTestJSON-209624940-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:54.205816 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:23:54.205816 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:23:54.207079 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e802037b-6133-4f47-9745-00c970166ff1 tempest-ServicesAdminTestJSON-209624940 tempest-ServicesAdminTestJSON-209624940-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:54.207533 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e802037b-6133-4f47-9745-00c970166ff1 tempest-ServicesAdminTestJSON-209624940 tempest-ServicesAdminTestJSON-209624940-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:54.208347 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e802037b-6133-4f47-9745-00c970166ff1 tempest-ServicesAdminTestJSON-209624940 tempest-ServicesAdminTestJSON-209624940-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:54.213046 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e802037b-6133-4f47-9745-00c970166ff1 tempest-ServicesAdminTestJSON-209624940 tempest-ServicesAdminTestJSON-209624940-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:54.262432 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-e802037b-6133-4f47-9745-00c970166ff1 tempest-ServicesAdminTestJSON-209624940 tempest-ServicesAdminTestJSON-209624940-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.259974 Jul 23 21:23:54.264075 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1270/2499] 10.222.0.17 () {58 vars in 1136 bytes} [Sat Jul 23 21:23:54 2022] GET /compute/v2.1/os-services => generated 947 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:23:54.275807 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-feb60906-419f-4f5b-bdf5-80069a5fe325 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:54.276869 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-feb60906-419f-4f5b-bdf5-80069a5fe325 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] [instance: c73f1c6e-9c56-453d-89bf-b9e24f360f33] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:54.284677 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-feb60906-419f-4f5b-bdf5-80069a5fe325 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:54.285847 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-feb60906-419f-4f5b-bdf5-80069a5fe325 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:54.286839 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-feb60906-419f-4f5b-bdf5-80069a5fe325 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:54.287429 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-feb60906-419f-4f5b-bdf5-80069a5fe325 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:54.448796 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b7b19b21-ce85-402e-835f-11037287c65f tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e74c139b38d74d9ab93695471ccd3a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ff73d603ec4069a908452514a59451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:23:54.457654 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b7b19b21-ce85-402e-835f-11037287c65f tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] 10.222.0.17 "GET /compute/v2.1/servers/dd8dace4-4427-490e-ad29-73092c943515" status: 200 len: 1355 microversion: 2.1 time: 0.301758 Jul 23 21:23:54.461760 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1230/2500] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:54 2022] GET /compute/v2.1/servers/dd8dace4-4427-490e-ad29-73092c943515 => generated 1355 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:54.466618 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0642c1a9-8cde-47f3-9bfb-03a1e236432c tempest-ServicesAdminTestJSON-209624940 tempest-ServicesAdminTestJSON-209624940-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:54.468088 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:23:54.468088 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:23:54.469308 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0642c1a9-8cde-47f3-9bfb-03a1e236432c tempest-ServicesAdminTestJSON-209624940 tempest-ServicesAdminTestJSON-209624940-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:54.473527 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0642c1a9-8cde-47f3-9bfb-03a1e236432c tempest-ServicesAdminTestJSON-209624940 tempest-ServicesAdminTestJSON-209624940-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:54.476372 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0642c1a9-8cde-47f3-9bfb-03a1e236432c tempest-ServicesAdminTestJSON-209624940 tempest-ServicesAdminTestJSON-209624940-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:54.480790 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0642c1a9-8cde-47f3-9bfb-03a1e236432c tempest-ServicesAdminTestJSON-209624940 tempest-ServicesAdminTestJSON-209624940-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:54.524737 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-0642c1a9-8cde-47f3-9bfb-03a1e236432c tempest-ServicesAdminTestJSON-209624940 tempest-ServicesAdminTestJSON-209624940-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services?host=ncdv-master-1" status: 200 len: 581 microversion: 2.1 time: 0.061653 Jul 23 21:23:54.532875 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1231/2501] 10.222.0.17 () {58 vars in 1173 bytes} [Sat Jul 23 21:23:54 2022] GET /compute/v2.1/os-services?host=ncdv-master-1 => generated 581 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:23:54.546769 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-45e5fc29-74bb-440f-9eb4-e41d897cd41f tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:54.547670 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-45e5fc29-74bb-440f-9eb4-e41d897cd41f tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] [instance: 4824dd17-e11d-4def-ab59-9eb6279e46e8] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:54.559035 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-45e5fc29-74bb-440f-9eb4-e41d897cd41f tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:54.559759 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-45e5fc29-74bb-440f-9eb4-e41d897cd41f tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:54.560706 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-45e5fc29-74bb-440f-9eb4-e41d897cd41f tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:54.561306 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-45e5fc29-74bb-440f-9eb4-e41d897cd41f tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:54.588059 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-feb60906-419f-4f5b-bdf5-80069a5fe325 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a812b6571db40a1a2f138dc03d4e1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14294b18c6e4936b1272a57d4faccce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:23:54.590749 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-45e5fc29-74bb-440f-9eb4-e41d897cd41f tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] HTTP exception thrown: Instance 4824dd17-e11d-4def-ab59-9eb6279e46e8 could not be found. Jul 23 21:23:54.592616 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-45e5fc29-74bb-440f-9eb4-e41d897cd41f tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Request method failure captured: Jul 23 21:23:54.592616 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/4824dd17-e11d-4def-ab59-9eb6279e46e8 HTTP/1.1 Jul 23 21:23:54.592616 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:23:54.592616 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:23:54.592616 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:23:54.592616 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:23:54.592616 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:23:54.592616 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:23:54.592616 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:23:54.592616 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:23:54.592616 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GabcedAy4zvEWDBz4psoyymQjd20otmwoBk14VBCrO5T_u930hsqstuKWfxSIIHSaoINyY7aouwTaS_UH5MldJcqSCrcSo-BYQbnUPzf2q6ne_dSigo_8PievK59Q_5ElGzDVdSYredgO26R1rdGGAuE9yewD0hcCJzYqqhzyGW3Zk Jul 23 21:23:54.592616 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:23:54.592616 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:23:54.592616 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:23:54.592616 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:23:54.592616 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:23:54.592616 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:23:54.592616 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 55cfd65431cf4b878ab1c0e25a0ac629 Jul 23 21:23:54.592616 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-SecurityGroupsTestJSON-553336269 Jul 23 21:23:54.592616 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:23:54.592616 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:23:54.592616 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/55cfd65431cf4b878ab1c0e25a0ac629"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/55cfd65431cf4b878ab1c0e25a0ac629"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_55cfd65431cf4b878ab1c0e25a0ac629", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/55cfd65431cf4b878ab1c0e25a0ac629"}]}] Jul 23 21:23:54.592616 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-SecurityGroupsTestJSON-553336269 Jul 23 21:23:54.592616 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 55cfd65431cf4b878ab1c0e25a0ac629 Jul 23 21:23:54.592616 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-553336269 Jul 23 21:23:54.592616 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-SecurityGroupsTestJSON-553336269-project Jul 23 21:23:54.592616 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:23:54.592616 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:23:54.592616 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 63ca7a39a8174a4b97767245e80b2bf7 Jul 23 21:23:54.592616 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-SecurityGroupsTestJSON-553336269-project Jul 23 21:23:54.592616 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:23:54.592616 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance 4824dd17-e11d-4def-ab59-9eb6279e46e8 could not be found. Jul 23 21:23:54.592616 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '4824dd17-e11d-4def-ab59-9eb6279e46e8'} Jul 23 21:23:54.592616 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:23:54.592616 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:23:54.592616 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:23:54.592616 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:23:54.592616 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:23:54.592616 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:23:54.592616 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:23:54.592616 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:23:54.592616 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:23:54.592616 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:23:54.592616 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4824dd17-e11d-4def-ab59-9eb6279e46e8 could not be found. Jul 23 21:23:54.592616 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:23:54.592616 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:23:54.592616 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:23:54.592616 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:23:54.592616 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:23:54.592616 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:23:54.592616 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:23:54.592616 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:23:54.592616 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:23:54.592616 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:23:54.592616 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:23:54.592616 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:23:54.592616 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:23:54.592616 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:23:54.592616 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:23:54.592616 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:23:54.592616 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4824dd17-e11d-4def-ab59-9eb6279e46e8 could not be found. Jul 23 21:23:54.592616 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:23:54.592616 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:23:54.592616 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:23:54.596631 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:23:54.596631 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:23:54.596631 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:23:54.596631 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:23:54.596631 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:23:54.596631 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4824dd17-e11d-4def-ab59-9eb6279e46e8 could not be found. Jul 23 21:23:54.596631 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:23:54.598506 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-45e5fc29-74bb-440f-9eb4-e41d897cd41f tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Returning 404 to user: Instance 4824dd17-e11d-4def-ab59-9eb6279e46e8 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:23:54.599605 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-45e5fc29-74bb-440f-9eb4-e41d897cd41f tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] 10.222.0.17 "GET /compute/v2.1/servers/4824dd17-e11d-4def-ab59-9eb6279e46e8" status: 404 len: 111 microversion: 2.1 time: 0.065479 Jul 23 21:23:54.600489 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1232/2502] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:54 2022] GET /compute/v2.1/servers/4824dd17-e11d-4def-ab59-9eb6279e46e8 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:23:54.605597 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9de100b3-8eb8-4413-99d5-a3868e0da82a tempest-ServicesAdminTestJSON-209624940 tempest-ServicesAdminTestJSON-209624940-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:54.607179 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:23:54.607179 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:23:54.608867 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9de100b3-8eb8-4413-99d5-a3868e0da82a tempest-ServicesAdminTestJSON-209624940 tempest-ServicesAdminTestJSON-209624940-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:54.609344 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9de100b3-8eb8-4413-99d5-a3868e0da82a tempest-ServicesAdminTestJSON-209624940 tempest-ServicesAdminTestJSON-209624940-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:54.610169 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9de100b3-8eb8-4413-99d5-a3868e0da82a tempest-ServicesAdminTestJSON-209624940 tempest-ServicesAdminTestJSON-209624940-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:54.610612 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9de100b3-8eb8-4413-99d5-a3868e0da82a tempest-ServicesAdminTestJSON-209624940 tempest-ServicesAdminTestJSON-209624940-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:54.615188 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-feb60906-419f-4f5b-bdf5-80069a5fe325 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] 10.222.0.17 "GET /compute/v2.1/servers/c73f1c6e-9c56-453d-89bf-b9e24f360f33" status: 200 len: 1325 microversion: 2.1 time: 0.349458 Jul 23 21:23:54.615809 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1271/2503] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:54 2022] GET /compute/v2.1/servers/c73f1c6e-9c56-453d-89bf-b9e24f360f33 => generated 1325 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:54.625479 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a4974823-6b5e-4118-b5f8-a264cfd04487 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Calling method '.version_select at 0x7f0b47cc4280>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:54.638490 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9de100b3-8eb8-4413-99d5-a3868e0da82a tempest-ServicesAdminTestJSON-209624940 tempest-ServicesAdminTestJSON-209624940-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.036441 Jul 23 21:23:54.645609 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1233/2504] 10.222.0.17 () {58 vars in 1175 bytes} [Sat Jul 23 21:23:54 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:23:54.651327 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6a0481b0-200f-49fe-ad37-2933037f022b tempest-ServicesAdminTestJSON-209624940 tempest-ServicesAdminTestJSON-209624940-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:54.652764 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:23:54.652764 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:23:54.654308 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6a0481b0-200f-49fe-ad37-2933037f022b tempest-ServicesAdminTestJSON-209624940 tempest-ServicesAdminTestJSON-209624940-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:54.655030 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6a0481b0-200f-49fe-ad37-2933037f022b tempest-ServicesAdminTestJSON-209624940 tempest-ServicesAdminTestJSON-209624940-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:54.655925 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6a0481b0-200f-49fe-ad37-2933037f022b tempest-ServicesAdminTestJSON-209624940 tempest-ServicesAdminTestJSON-209624940-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:54.656435 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6a0481b0-200f-49fe-ad37-2933037f022b tempest-ServicesAdminTestJSON-209624940 tempest-ServicesAdminTestJSON-209624940-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:54.687300 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6a0481b0-200f-49fe-ad37-2933037f022b tempest-ServicesAdminTestJSON-209624940 tempest-ServicesAdminTestJSON-209624940-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.039916 Jul 23 21:23:54.696037 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1234/2505] 10.222.0.17 () {58 vars in 1136 bytes} [Sat Jul 23 21:23:54 2022] GET /compute/v2.1/os-services => generated 947 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:23:54.973066 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-a4974823-6b5e-4118-b5f8-a264cfd04487 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/6c10e161-9f57-48cb-a087-3868d686aeec" status: 202 len: 0 microversion: 2.1 time: 0.353278 Jul 23 21:23:54.973703 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1272/2506] 10.222.0.17 () {58 vars in 1271 bytes} [Sat Jul 23 21:23:54 2022] DELETE /compute/v2.1/os-security-groups/6c10e161-9f57-48cb-a087-3868d686aeec => generated 0 bytes in 355 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:23:54.984020 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3e3ddf85-fbd6-4691-8ca3-a0163042a0f8 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] Calling method '.version_select at 0x7f0b598d3280>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:55.017129 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-8f99815a-4a95-41f3-ad01-1f4957b9f1f2 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Calling method '.version_select at 0x7f0b59aa9940>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:55.071945 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-8f99815a-4a95-41f3-ad01-1f4957b9f1f2 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] 10.222.0.17 "GET /compute/v2.1/images/e57c215e-ddc6-4510-9626-f3760a490e39" status: 200 len: 1428 microversion: 2.1 time: 0.062378 Jul 23 21:23:55.075846 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1273/2507] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:23:55 2022] GET /compute/v2.1/images/e57c215e-ddc6-4510-9626-f3760a490e39 => generated 1428 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:23:55.170216 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-b0ac5a16-3e80-46e6-9b16-e138fde039a3 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:55.171639 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-b0ac5a16-3e80-46e6-9b16-e138fde039a3 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] [instance: 011c4ff9-9d46-44df-bf9b-e0269c71c417] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:55.181062 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b0ac5a16-3e80-46e6-9b16-e138fde039a3 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:55.181843 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b0ac5a16-3e80-46e6-9b16-e138fde039a3 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:55.183099 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b0ac5a16-3e80-46e6-9b16-e138fde039a3 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:55.183978 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b0ac5a16-3e80-46e6-9b16-e138fde039a3 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:55.427677 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-b0ac5a16-3e80-46e6-9b16-e138fde039a3 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013b521930d54d6d952e566f8e67f466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1432b2e152894407afae7b6419d80a8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:23:55.444124 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-b0ac5a16-3e80-46e6-9b16-e138fde039a3 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] 10.222.0.17 "GET /compute/v2.1/servers/011c4ff9-9d46-44df-bf9b-e0269c71c417" status: 200 len: 1352 microversion: 2.1 time: 0.280233 Jul 23 21:23:55.464610 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1274/2508] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:55 2022] GET /compute/v2.1/servers/011c4ff9-9d46-44df-bf9b-e0269c71c417 => generated 1352 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:23:55.471318 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-d288a3b3-3e6f-4542-bf95-5148afc9525e req-ca1dbe36-bd94-47a1-86d1-26bf65b143d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c73f1c6e-9c56-453d-89bf-b9e24f360f33", "tag": "c8fa132f-9e09-4abf-83e3-251ec6a45805"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:23:55.509757 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-d288a3b3-3e6f-4542-bf95-5148afc9525e req-ca1dbe36-bd94-47a1-86d1-26bf65b143d5 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:55.512032 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-d288a3b3-3e6f-4542-bf95-5148afc9525e req-ca1dbe36-bd94-47a1-86d1-26bf65b143d5 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:55.547824 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-d288a3b3-3e6f-4542-bf95-5148afc9525e req-ca1dbe36-bd94-47a1-86d1-26bf65b143d5 service nova] Creating event network-changed:c8fa132f-9e09-4abf-83e3-251ec6a45805 for instance c73f1c6e-9c56-453d-89bf-b9e24f360f33 on nch1-master-1 Jul 23 21:23:55.563712 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-3e3ddf85-fbd6-4691-8ca3-a0163042a0f8 tempest-SecurityGroupsTestJSON-553336269 tempest-SecurityGroupsTestJSON-553336269-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/bf78122c-7329-4d84-a0e3-3559c728fae7" status: 202 len: 0 microversion: 2.1 time: 0.585664 Jul 23 21:23:55.564892 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1235/2509] 10.222.0.17 () {58 vars in 1271 bytes} [Sat Jul 23 21:23:54 2022] DELETE /compute/v2.1/os-security-groups/bf78122c-7329-4d84-a0e3-3559c728fae7 => generated 0 bytes in 587 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:23:55.566388 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-d288a3b3-3e6f-4542-bf95-5148afc9525e req-ca1dbe36-bd94-47a1-86d1-26bf65b143d5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098271 Jul 23 21:23:55.569355 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1275/2510] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:23:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:23:55.572512 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3cc07401-b354-4adb-9db6-9c9b45df0c13 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:55.573523 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-3cc07401-b354-4adb-9db6-9c9b45df0c13 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] [instance: dd8dace4-4427-490e-ad29-73092c943515] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:55.606916 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3cc07401-b354-4adb-9db6-9c9b45df0c13 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:55.613174 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3cc07401-b354-4adb-9db6-9c9b45df0c13 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:55.616458 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3cc07401-b354-4adb-9db6-9c9b45df0c13 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:55.619156 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3cc07401-b354-4adb-9db6-9c9b45df0c13 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:55.635154 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-7b328559-e66e-484c-ab60-e1931fb3ec07 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:55.635952 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-7b328559-e66e-484c-ab60-e1931fb3ec07 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] [instance: c73f1c6e-9c56-453d-89bf-b9e24f360f33] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:55.654827 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7b328559-e66e-484c-ab60-e1931fb3ec07 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:55.660561 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7b328559-e66e-484c-ab60-e1931fb3ec07 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:55.662281 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7b328559-e66e-484c-ab60-e1931fb3ec07 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:55.672108 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7b328559-e66e-484c-ab60-e1931fb3ec07 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:56.032538 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-3cc07401-b354-4adb-9db6-9c9b45df0c13 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e74c139b38d74d9ab93695471ccd3a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ff73d603ec4069a908452514a59451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:23:56.045585 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-3cc07401-b354-4adb-9db6-9c9b45df0c13 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] 10.222.0.17 "GET /compute/v2.1/servers/dd8dace4-4427-490e-ad29-73092c943515" status: 200 len: 1804 microversion: 2.1 time: 0.478883 Jul 23 21:23:56.049900 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1236/2511] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:55 2022] GET /compute/v2.1/servers/dd8dace4-4427-490e-ad29-73092c943515 => generated 1804 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:56.071619 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9f6f2c52-70f0-4d82-9952-019c827dd0c2 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:56.076578 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-9f6f2c52-70f0-4d82-9952-019c827dd0c2 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] [instance: dd8dace4-4427-490e-ad29-73092c943515] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:56.088043 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9f6f2c52-70f0-4d82-9952-019c827dd0c2 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:56.088666 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9f6f2c52-70f0-4d82-9952-019c827dd0c2 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:56.089722 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9f6f2c52-70f0-4d82-9952-019c827dd0c2 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:56.090421 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9f6f2c52-70f0-4d82-9952-019c827dd0c2 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:56.125889 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9f6f2c52-70f0-4d82-9952-019c827dd0c2 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] 10.222.0.17 "GET /compute/v2.1/servers/dd8dace4-4427-490e-ad29-73092c943515/ips" status: 200 len: 217 microversion: 2.1 time: 0.063215 Jul 23 21:23:56.127706 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1237/2512] 10.222.0.17 () {58 vars in 1247 bytes} [Sat Jul 23 21:23:56 2022] GET /compute/v2.1/servers/dd8dace4-4427-490e-ad29-73092c943515/ips => generated 217 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:23:56.133200 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9cec5464-73bf-4788-8561-c296a541a710 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Calling method '.version_select at 0x7f0b47b910d0>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:56.214702 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9cec5464-73bf-4788-8561-c296a541a710 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] 10.222.0.17 "GET /compute/v2.1/images/e57c215e-ddc6-4510-9626-f3760a490e39" status: 200 len: 1428 microversion: 2.1 time: 0.083738 Jul 23 21:23:56.216163 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1238/2513] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:23:56 2022] GET /compute/v2.1/images/e57c215e-ddc6-4510-9626-f3760a490e39 => generated 1428 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:56.228851 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9b7c1690-08ba-49a2-8064-cf0b349803dd tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:56.230527 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-9b7c1690-08ba-49a2-8064-cf0b349803dd tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] [instance: dd8dace4-4427-490e-ad29-73092c943515] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:56.246058 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9b7c1690-08ba-49a2-8064-cf0b349803dd tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:56.246808 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9b7c1690-08ba-49a2-8064-cf0b349803dd tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:56.248846 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9b7c1690-08ba-49a2-8064-cf0b349803dd tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:56.251058 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9b7c1690-08ba-49a2-8064-cf0b349803dd tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:56.279410 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-7b328559-e66e-484c-ab60-e1931fb3ec07 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a812b6571db40a1a2f138dc03d4e1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14294b18c6e4936b1272a57d4faccce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:23:56.293804 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-7b328559-e66e-484c-ab60-e1931fb3ec07 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] 10.222.0.17 "GET /compute/v2.1/servers/c73f1c6e-9c56-453d-89bf-b9e24f360f33" status: 200 len: 1325 microversion: 2.1 time: 0.664213 Jul 23 21:23:56.294761 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1276/2514] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:55 2022] GET /compute/v2.1/servers/c73f1c6e-9c56-453d-89bf-b9e24f360f33 => generated 1325 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:23:56.299133 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-9b7c1690-08ba-49a2-8064-cf0b349803dd tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] [instance: dd8dace4-4427-490e-ad29-73092c943515] Going to try to terminate instance {{(pid=131320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:23:56.468865 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-500a5113-5f54-41ab-85bc-ef90e8f13e45 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:56.470188 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-500a5113-5f54-41ab-85bc-ef90e8f13e45 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] [instance: 011c4ff9-9d46-44df-bf9b-e0269c71c417] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:56.483977 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-500a5113-5f54-41ab-85bc-ef90e8f13e45 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:56.484828 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-500a5113-5f54-41ab-85bc-ef90e8f13e45 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:56.486057 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-500a5113-5f54-41ab-85bc-ef90e8f13e45 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:56.486734 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-500a5113-5f54-41ab-85bc-ef90e8f13e45 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:56.508558 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9b7c1690-08ba-49a2-8064-cf0b349803dd tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] 10.222.0.17 "DELETE /compute/v2.1/servers/dd8dace4-4427-490e-ad29-73092c943515" status: 204 len: 0 microversion: 2.1 time: 0.286982 Jul 23 21:23:56.509833 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1239/2515] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:23:56 2022] DELETE /compute/v2.1/servers/dd8dace4-4427-490e-ad29-73092c943515 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:23:56.524078 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-fcbac3ad-07d8-4cce-a7cd-7a0502798cfb tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:56.525411 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-fcbac3ad-07d8-4cce-a7cd-7a0502798cfb tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] [instance: dd8dace4-4427-490e-ad29-73092c943515] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:56.545989 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fcbac3ad-07d8-4cce-a7cd-7a0502798cfb tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:56.546843 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fcbac3ad-07d8-4cce-a7cd-7a0502798cfb tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:56.550431 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fcbac3ad-07d8-4cce-a7cd-7a0502798cfb tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:56.552592 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fcbac3ad-07d8-4cce-a7cd-7a0502798cfb tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:56.817530 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-500a5113-5f54-41ab-85bc-ef90e8f13e45 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013b521930d54d6d952e566f8e67f466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1432b2e152894407afae7b6419d80a8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:23:56.843679 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-fcbac3ad-07d8-4cce-a7cd-7a0502798cfb tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e74c139b38d74d9ab93695471ccd3a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ff73d603ec4069a908452514a59451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:23:56.852938 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-500a5113-5f54-41ab-85bc-ef90e8f13e45 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] 10.222.0.17 "GET /compute/v2.1/servers/011c4ff9-9d46-44df-bf9b-e0269c71c417" status: 200 len: 1352 microversion: 2.1 time: 0.391871 Jul 23 21:23:56.856946 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1277/2516] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:56 2022] GET /compute/v2.1/servers/011c4ff9-9d46-44df-bf9b-e0269c71c417 => generated 1352 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:56.859926 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-fcbac3ad-07d8-4cce-a7cd-7a0502798cfb tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] 10.222.0.17 "GET /compute/v2.1/servers/dd8dace4-4427-490e-ad29-73092c943515" status: 200 len: 1810 microversion: 2.1 time: 0.341634 Jul 23 21:23:56.863431 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1240/2517] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:56 2022] GET /compute/v2.1/servers/dd8dace4-4427-490e-ad29-73092c943515 => generated 1810 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:57.229960 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-6e17bd11-45cc-4544-9d4e-45b299c498a6 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Calling method '.version_select at 0x7f0b540eb4c0>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:57.314113 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b9af64be-b3d8-4c7c-b978-ed188cd584fd tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:57.315122 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b9af64be-b3d8-4c7c-b978-ed188cd584fd tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] [instance: c73f1c6e-9c56-453d-89bf-b9e24f360f33] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:57.317832 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-6e17bd11-45cc-4544-9d4e-45b299c498a6 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] 10.222.0.17 "GET /compute/v2.1/images/e57c215e-ddc6-4510-9626-f3760a490e39" status: 200 len: 1428 microversion: 2.1 time: 0.088298 Jul 23 21:23:57.324517 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b9af64be-b3d8-4c7c-b978-ed188cd584fd tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:57.325213 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b9af64be-b3d8-4c7c-b978-ed188cd584fd tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:57.326442 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b9af64be-b3d8-4c7c-b978-ed188cd584fd tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:57.327600 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b9af64be-b3d8-4c7c-b978-ed188cd584fd tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:57.328513 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1278/2518] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:23:57 2022] GET /compute/v2.1/images/e57c215e-ddc6-4510-9626-f3760a490e39 => generated 1428 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:57.646080 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=6 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:23:57.690914 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-b9de4daa-5574-44dc-97d2-9bf723f5c427 req-4b46ccad-bbe5-4385-a36b-0bbc8f167f6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "011c4ff9-9d46-44df-bf9b-e0269c71c417", "name": "network-vif-plugged", "status": "completed", "tag": "e9103d4a-4c54-4f9a-a910-26edefe5de92"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:23:57.717026 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-b9de4daa-5574-44dc-97d2-9bf723f5c427 req-4b46ccad-bbe5-4385-a36b-0bbc8f167f6e service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:57.719704 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-b9de4daa-5574-44dc-97d2-9bf723f5c427 req-4b46ccad-bbe5-4385-a36b-0bbc8f167f6e service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:57.758401 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-b9de4daa-5574-44dc-97d2-9bf723f5c427 req-4b46ccad-bbe5-4385-a36b-0bbc8f167f6e service nova] Creating event network-vif-plugged:e9103d4a-4c54-4f9a-a910-26edefe5de92 for instance 011c4ff9-9d46-44df-bf9b-e0269c71c417 on nch1-master-1 Jul 23 21:23:57.770944 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-b9de4daa-5574-44dc-97d2-9bf723f5c427 req-4b46ccad-bbe5-4385-a36b-0bbc8f167f6e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093363 Jul 23 21:23:57.775104 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1279/2519] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:23:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:23:57.874515 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-5461c30d-e487-4a76-a755-29397f8d8eb2 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:57.875358 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-5461c30d-e487-4a76-a755-29397f8d8eb2 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] [instance: 011c4ff9-9d46-44df-bf9b-e0269c71c417] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:57.900715 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b9af64be-b3d8-4c7c-b978-ed188cd584fd tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a812b6571db40a1a2f138dc03d4e1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14294b18c6e4936b1272a57d4faccce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:23:57.910639 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5461c30d-e487-4a76-a755-29397f8d8eb2 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:57.912087 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5461c30d-e487-4a76-a755-29397f8d8eb2 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:57.913186 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b9af64be-b3d8-4c7c-b978-ed188cd584fd tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] 10.222.0.17 "GET /compute/v2.1/servers/c73f1c6e-9c56-453d-89bf-b9e24f360f33" status: 200 len: 1325 microversion: 2.1 time: 0.604515 Jul 23 21:23:57.914489 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5461c30d-e487-4a76-a755-29397f8d8eb2 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:57.915054 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5461c30d-e487-4a76-a755-29397f8d8eb2 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:57.917147 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1241/2520] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:57 2022] GET /compute/v2.1/servers/c73f1c6e-9c56-453d-89bf-b9e24f360f33 => generated 1325 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:23:57.930280 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c7858101-8563-4a9a-835a-66174ff76717 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:57.931176 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c7858101-8563-4a9a-835a-66174ff76717 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] [instance: dd8dace4-4427-490e-ad29-73092c943515] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:57.947843 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c7858101-8563-4a9a-835a-66174ff76717 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:57.953685 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c7858101-8563-4a9a-835a-66174ff76717 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:57.955358 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c7858101-8563-4a9a-835a-66174ff76717 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:57.955974 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c7858101-8563-4a9a-835a-66174ff76717 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:58.273551 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c7858101-8563-4a9a-835a-66174ff76717 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e74c139b38d74d9ab93695471ccd3a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ff73d603ec4069a908452514a59451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:23:58.284147 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c7858101-8563-4a9a-835a-66174ff76717 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] 10.222.0.17 "GET /compute/v2.1/servers/dd8dace4-4427-490e-ad29-73092c943515" status: 200 len: 1810 microversion: 2.1 time: 0.365059 Jul 23 21:23:58.285555 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1242/2521] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:57 2022] GET /compute/v2.1/servers/dd8dace4-4427-490e-ad29-73092c943515 => generated 1810 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:58.338038 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8143d5ee-5559-4640-a220-902c84ceb606 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Calling method '.version_select at 0x7f0b54029670>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:58.417095 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8143d5ee-5559-4640-a220-902c84ceb606 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] 10.222.0.17 "GET /compute/v2.1/images/e57c215e-ddc6-4510-9626-f3760a490e39" status: 200 len: 1437 microversion: 2.1 time: 0.084849 Jul 23 21:23:58.417725 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1243/2522] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:23:58 2022] GET /compute/v2.1/images/e57c215e-ddc6-4510-9626-f3760a490e39 => generated 1437 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:23:58.429985 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f9d78f75-021b-49db-a02b-8bc23944a422 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Calling method '.version_select at 0x7f0b4788e5e0>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:58.446866 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-5461c30d-e487-4a76-a755-29397f8d8eb2 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013b521930d54d6d952e566f8e67f466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1432b2e152894407afae7b6419d80a8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:23:58.454907 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-5461c30d-e487-4a76-a755-29397f8d8eb2 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] 10.222.0.17 "GET /compute/v2.1/servers/011c4ff9-9d46-44df-bf9b-e0269c71c417" status: 200 len: 1352 microversion: 2.1 time: 0.585839 Jul 23 21:23:58.466183 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1280/2523] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:57 2022] GET /compute/v2.1/servers/011c4ff9-9d46-44df-bf9b-e0269c71c417 => generated 1352 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:23:58.482679 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f9d78f75-021b-49db-a02b-8bc23944a422 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] 10.222.0.17 "GET /compute/v2.1/images/e57c215e-ddc6-4510-9626-f3760a490e39" status: 200 len: 1437 microversion: 2.1 time: 0.057010 Jul 23 21:23:58.483265 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1244/2524] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:23:58 2022] GET /compute/v2.1/images/e57c215e-ddc6-4510-9626-f3760a490e39 => generated 1437 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:23:58.495289 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c23cb9a6-d7ed-499b-b08b-bb2cfe1f920f tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:58.495907 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-c23cb9a6-d7ed-499b-b08b-bb2cfe1f920f tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] [instance: 6929bb48-ae83-4078-8df7-60124c837ea3] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:58.502239 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c23cb9a6-d7ed-499b-b08b-bb2cfe1f920f tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:58.502968 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c23cb9a6-d7ed-499b-b08b-bb2cfe1f920f tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:58.503750 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c23cb9a6-d7ed-499b-b08b-bb2cfe1f920f tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:58.504190 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c23cb9a6-d7ed-499b-b08b-bb2cfe1f920f tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:58.545813 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell0:SELECT=10 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:23:58.932707 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4c3d2848-6ce1-428d-8ed5-6eff28ffbf17 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:58.934019 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-4c3d2848-6ce1-428d-8ed5-6eff28ffbf17 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] [instance: c73f1c6e-9c56-453d-89bf-b9e24f360f33] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:58.941040 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4c3d2848-6ce1-428d-8ed5-6eff28ffbf17 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:58.942369 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4c3d2848-6ce1-428d-8ed5-6eff28ffbf17 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:58.943384 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4c3d2848-6ce1-428d-8ed5-6eff28ffbf17 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:58.944008 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4c3d2848-6ce1-428d-8ed5-6eff28ffbf17 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:59.117592 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-4c3d2848-6ce1-428d-8ed5-6eff28ffbf17 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a812b6571db40a1a2f138dc03d4e1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14294b18c6e4936b1272a57d4faccce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:23:59.131763 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4c3d2848-6ce1-428d-8ed5-6eff28ffbf17 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] 10.222.0.17 "GET /compute/v2.1/servers/c73f1c6e-9c56-453d-89bf-b9e24f360f33" status: 200 len: 1325 microversion: 2.1 time: 0.203605 Jul 23 21:23:59.132636 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1245/2525] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:58 2022] GET /compute/v2.1/servers/c73f1c6e-9c56-453d-89bf-b9e24f360f33 => generated 1325 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:59.161025 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c23cb9a6-d7ed-499b-b08b-bb2cfe1f920f tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bde36fce49439bbe49caa877b1b630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebf7cadb7af43beb0b85669f8e1f36c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:23:59.169995 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-c23cb9a6-d7ed-499b-b08b-bb2cfe1f920f tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] 10.222.0.17 "GET /compute/v2.1/servers/6929bb48-ae83-4078-8df7-60124c837ea3" status: 200 len: 1480 microversion: 2.1 time: 0.678921 Jul 23 21:23:59.170868 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1281/2526] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:58 2022] GET /compute/v2.1/servers/6929bb48-ae83-4078-8df7-60124c837ea3 => generated 1480 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:23:59.305363 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-331f6db6-4e45-4e80-9b27-8aa2421b2c53 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:59.306462 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-331f6db6-4e45-4e80-9b27-8aa2421b2c53 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] [instance: dd8dace4-4427-490e-ad29-73092c943515] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:59.317213 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-331f6db6-4e45-4e80-9b27-8aa2421b2c53 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:59.318016 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-331f6db6-4e45-4e80-9b27-8aa2421b2c53 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:59.319279 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-331f6db6-4e45-4e80-9b27-8aa2421b2c53 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:59.319872 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-331f6db6-4e45-4e80-9b27-8aa2421b2c53 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:59.473691 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-4b44cd1e-2f4f-4a39-82f7-4d553ddae1e3 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:23:59.474633 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-4b44cd1e-2f4f-4a39-82f7-4d553ddae1e3 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] [instance: 011c4ff9-9d46-44df-bf9b-e0269c71c417] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:23:59.487854 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4b44cd1e-2f4f-4a39-82f7-4d553ddae1e3 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:59.494636 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4b44cd1e-2f4f-4a39-82f7-4d553ddae1e3 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:23:59.498795 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4b44cd1e-2f4f-4a39-82f7-4d553ddae1e3 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:23:59.501576 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4b44cd1e-2f4f-4a39-82f7-4d553ddae1e3 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:00.052067 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-331f6db6-4e45-4e80-9b27-8aa2421b2c53 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e74c139b38d74d9ab93695471ccd3a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ff73d603ec4069a908452514a59451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:00.073788 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-331f6db6-4e45-4e80-9b27-8aa2421b2c53 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] 10.222.0.17 "GET /compute/v2.1/servers/dd8dace4-4427-490e-ad29-73092c943515" status: 200 len: 1789 microversion: 2.1 time: 0.774476 Jul 23 21:24:00.076907 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1246/2527] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:59 2022] GET /compute/v2.1/servers/dd8dace4-4427-490e-ad29-73092c943515 => generated 1789 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:24:00.092042 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-55422f59-d1e8-4c4a-82e5-cbab6ae3769c req-0c6be17d-9775-462e-bd87-d0b6b39fc070 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd8dace4-4427-490e-ad29-73092c943515", "name": "network-vif-deleted", "tag": "f5ad3cc2-0f6f-4876-bcd7-fbf8f64bb82f"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:24:00.116546 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-55422f59-d1e8-4c4a-82e5-cbab6ae3769c req-0c6be17d-9775-462e-bd87-d0b6b39fc070 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:00.118024 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-55422f59-d1e8-4c4a-82e5-cbab6ae3769c req-0c6be17d-9775-462e-bd87-d0b6b39fc070 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:00.137277 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-55422f59-d1e8-4c4a-82e5-cbab6ae3769c req-0c6be17d-9775-462e-bd87-d0b6b39fc070 service nova] Creating event network-vif-deleted:f5ad3cc2-0f6f-4876-bcd7-fbf8f64bb82f for instance dd8dace4-4427-490e-ad29-73092c943515 on nch2-master-1 Jul 23 21:24:00.145583 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-55422f59-d1e8-4c4a-82e5-cbab6ae3769c req-0c6be17d-9775-462e-bd87-d0b6b39fc070 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066223 Jul 23 21:24:00.147379 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1247/2528] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:24:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:24:00.175911 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-104c4c7c-2a6f-4ced-a672-3292766d781e tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:00.177956 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-104c4c7c-2a6f-4ced-a672-3292766d781e tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] [instance: c73f1c6e-9c56-453d-89bf-b9e24f360f33] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:00.200103 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-104c4c7c-2a6f-4ced-a672-3292766d781e tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:00.200993 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-104c4c7c-2a6f-4ced-a672-3292766d781e tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:00.202317 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-104c4c7c-2a6f-4ced-a672-3292766d781e tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:00.203171 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-104c4c7c-2a6f-4ced-a672-3292766d781e tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:00.237498 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-4b44cd1e-2f4f-4a39-82f7-4d553ddae1e3 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013b521930d54d6d952e566f8e67f466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1432b2e152894407afae7b6419d80a8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:00.251828 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-4b44cd1e-2f4f-4a39-82f7-4d553ddae1e3 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] 10.222.0.17 "GET /compute/v2.1/servers/011c4ff9-9d46-44df-bf9b-e0269c71c417" status: 200 len: 1352 microversion: 2.1 time: 0.783147 Jul 23 21:24:00.261955 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1282/2529] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:23:59 2022] GET /compute/v2.1/servers/011c4ff9-9d46-44df-bf9b-e0269c71c417 => generated 1352 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:24:00.272105 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-beb3d603-2a9e-4aa3-a0d0-00b34ff165fa tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:00.273724 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-beb3d603-2a9e-4aa3-a0d0-00b34ff165fa tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] [instance: 6929bb48-ae83-4078-8df7-60124c837ea3] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:00.294884 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-beb3d603-2a9e-4aa3-a0d0-00b34ff165fa tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:00.300677 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-beb3d603-2a9e-4aa3-a0d0-00b34ff165fa tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:00.303002 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-beb3d603-2a9e-4aa3-a0d0-00b34ff165fa tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:00.303732 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-beb3d603-2a9e-4aa3-a0d0-00b34ff165fa tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:00.592873 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-104c4c7c-2a6f-4ced-a672-3292766d781e tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a812b6571db40a1a2f138dc03d4e1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14294b18c6e4936b1272a57d4faccce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:00.603708 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-104c4c7c-2a6f-4ced-a672-3292766d781e tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] 10.222.0.17 "GET /compute/v2.1/servers/c73f1c6e-9c56-453d-89bf-b9e24f360f33" status: 200 len: 1325 microversion: 2.1 time: 0.454541 Jul 23 21:24:00.608448 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1248/2530] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:00 2022] GET /compute/v2.1/servers/c73f1c6e-9c56-453d-89bf-b9e24f360f33 => generated 1325 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:24:00.667168 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-beb3d603-2a9e-4aa3-a0d0-00b34ff165fa tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bde36fce49439bbe49caa877b1b630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebf7cadb7af43beb0b85669f8e1f36c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:00.679872 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-beb3d603-2a9e-4aa3-a0d0-00b34ff165fa tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] 10.222.0.17 "GET /compute/v2.1/servers/6929bb48-ae83-4078-8df7-60124c837ea3" status: 200 len: 1467 microversion: 2.1 time: 0.422920 Jul 23 21:24:00.681703 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1283/2531] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:00 2022] GET /compute/v2.1/servers/6929bb48-ae83-4078-8df7-60124c837ea3 => generated 1467 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:24:00.701232 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-684b4104-ac47-4d1c-83b4-1b4ac815d720 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Calling method '.version_select at 0x7f0b47de6430>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:01.187910 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-1ca21a6e-5f25-4ab5-804a-a0f3c1ff8341 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-115558295", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:24:01.273897 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.network.neutron [None req-1ca21a6e-5f25-4ab5-804a-a0f3c1ff8341 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] validate_networks() for None {{(pid=131321) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:24:01.579136 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-1ca21a6e-5f25-4ab5-804a-a0f3c1ff8341 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Flavor limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:24:01.579617 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-1ca21a6e-5f25-4ab5-804a-a0f3c1ff8341 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Image limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:24:01.583118 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-1ca21a6e-5f25-4ab5-804a-a0f3c1ff8341 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Flavor pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:24:01.584085 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-1ca21a6e-5f25-4ab5-804a-a0f3c1ff8341 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Image pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:24:01.585035 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-1ca21a6e-5f25-4ab5-804a-a0f3c1ff8341 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:24:01.612396 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1ca21a6e-5f25-4ab5-804a-a0f3c1ff8341 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:01.616331 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1ca21a6e-5f25-4ab5-804a-a0f3c1ff8341 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:01.621035 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1ca21a6e-5f25-4ab5-804a-a0f3c1ff8341 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:01.634695 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1ca21a6e-5f25-4ab5-804a-a0f3c1ff8341 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:01.681568 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-1ca21a6e-5f25-4ab5-804a-a0f3c1ff8341 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Getting quotas for project 37510f38df0a45a6bb7771bdb0fbe271. Resources: {'ram', 'instances', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:24:01.691504 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-1ca21a6e-5f25-4ab5-804a-a0f3c1ff8341 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Getting quotas for user 8bfb831babfd456e9cd186bab2ca14bb and project 37510f38df0a45a6bb7771bdb0fbe271. Resources: {'ram', 'instances', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:24:01.715270 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-1ca21a6e-5f25-4ab5-804a-a0f3c1ff8341 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Going to run 1 instances... {{(pid=131321) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:24:01.718659 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-1ca21a6e-5f25-4ab5-804a-a0f3c1ff8341 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] [instance: 461367a0-c929-4951-98f4-d5194ae688f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131321) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:24:01.897473 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-1ca21a6e-5f25-4ab5-804a-a0f3c1ff8341 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.950113 Jul 23 21:24:01.903159 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1284/2532] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:24:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 955 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 23 21:24:01.913770 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-630090db-4a08-41a3-a2cc-9d9a274053b9 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:01.915856 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-630090db-4a08-41a3-a2cc-9d9a274053b9 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] [instance: dd8dace4-4427-490e-ad29-73092c943515] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:01.926721 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-630090db-4a08-41a3-a2cc-9d9a274053b9 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:01.927398 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-630090db-4a08-41a3-a2cc-9d9a274053b9 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:01.928221 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-630090db-4a08-41a3-a2cc-9d9a274053b9 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:01.928898 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-630090db-4a08-41a3-a2cc-9d9a274053b9 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:01.989145 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-684b4104-ac47-4d1c-83b4-1b4ac815d720 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] 10.222.0.17 "DELETE /compute/v2.1/images/e57c215e-ddc6-4510-9626-f3760a490e39" status: 204 len: 0 microversion: 2.1 time: 1.293192 Jul 23 21:24:01.990003 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1249/2533] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:00 2022] DELETE /compute/v2.1/images/e57c215e-ddc6-4510-9626-f3760a490e39 => generated 0 bytes in 1295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:24:01.998052 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4ef372be-4f12-4c2a-bbc9-92c57c513504 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:01.998893 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-4ef372be-4f12-4c2a-bbc9-92c57c513504 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] [instance: 011c4ff9-9d46-44df-bf9b-e0269c71c417] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:02.026976 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4ef372be-4f12-4c2a-bbc9-92c57c513504 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:02.027763 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4ef372be-4f12-4c2a-bbc9-92c57c513504 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:02.028665 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4ef372be-4f12-4c2a-bbc9-92c57c513504 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:02.029289 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4ef372be-4f12-4c2a-bbc9-92c57c513504 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:02.117543 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-630090db-4a08-41a3-a2cc-9d9a274053b9 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e74c139b38d74d9ab93695471ccd3a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ff73d603ec4069a908452514a59451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:02.131093 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-630090db-4a08-41a3-a2cc-9d9a274053b9 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] 10.222.0.17 "GET /compute/v2.1/servers/dd8dace4-4427-490e-ad29-73092c943515" status: 200 len: 1298 microversion: 2.1 time: 0.230211 Jul 23 21:24:02.134927 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1285/2534] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:01 2022] GET /compute/v2.1/servers/dd8dace4-4427-490e-ad29-73092c943515 => generated 1298 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:24:02.149270 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-82dcb5a6-b467-44bb-8cb3-aab11f4634c0 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:02.168607 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-82dcb5a6-b467-44bb-8cb3-aab11f4634c0 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] [instance: c73f1c6e-9c56-453d-89bf-b9e24f360f33] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:02.180603 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-82dcb5a6-b467-44bb-8cb3-aab11f4634c0 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:02.181406 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-82dcb5a6-b467-44bb-8cb3-aab11f4634c0 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:02.183369 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-82dcb5a6-b467-44bb-8cb3-aab11f4634c0 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:02.184214 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-82dcb5a6-b467-44bb-8cb3-aab11f4634c0 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:02.341094 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-4ef372be-4f12-4c2a-bbc9-92c57c513504 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013b521930d54d6d952e566f8e67f466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1432b2e152894407afae7b6419d80a8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:02.359953 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4ef372be-4f12-4c2a-bbc9-92c57c513504 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] 10.222.0.17 "GET /compute/v2.1/servers/011c4ff9-9d46-44df-bf9b-e0269c71c417" status: 200 len: 1543 microversion: 2.1 time: 0.368580 Jul 23 21:24:02.360588 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1250/2535] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:01 2022] GET /compute/v2.1/servers/011c4ff9-9d46-44df-bf9b-e0269c71c417 => generated 1543 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:24:02.367507 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-e68112cc-81a4-4b49-b82b-6c735b584c61 req-f6382c71-15cb-470b-bd46-0a24b55294f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c73f1c6e-9c56-453d-89bf-b9e24f360f33", "name": "network-vif-plugged", "status": "completed", "tag": "c8fa132f-9e09-4abf-83e3-251ec6a45805"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:24:02.379372 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-e68112cc-81a4-4b49-b82b-6c735b584c61 req-f6382c71-15cb-470b-bd46-0a24b55294f0 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:02.382898 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-e68112cc-81a4-4b49-b82b-6c735b584c61 req-f6382c71-15cb-470b-bd46-0a24b55294f0 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:02.416519 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-e68112cc-81a4-4b49-b82b-6c735b584c61 req-f6382c71-15cb-470b-bd46-0a24b55294f0 service nova] Creating event network-vif-plugged:c8fa132f-9e09-4abf-83e3-251ec6a45805 for instance c73f1c6e-9c56-453d-89bf-b9e24f360f33 on nch1-master-1 Jul 23 21:24:02.429412 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-e68112cc-81a4-4b49-b82b-6c735b584c61 req-f6382c71-15cb-470b-bd46-0a24b55294f0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066862 Jul 23 21:24:02.431356 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1251/2536] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:24:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:24:02.434874 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-82dcb5a6-b467-44bb-8cb3-aab11f4634c0 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a812b6571db40a1a2f138dc03d4e1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14294b18c6e4936b1272a57d4faccce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:02.439846 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4b5d0e61-762c-4e38-b4e3-de030d0c7912 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:02.441778 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-4b5d0e61-762c-4e38-b4e3-de030d0c7912 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] [instance: 461367a0-c929-4951-98f4-d5194ae688f3] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:02.444160 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-82dcb5a6-b467-44bb-8cb3-aab11f4634c0 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] 10.222.0.17 "GET /compute/v2.1/servers/c73f1c6e-9c56-453d-89bf-b9e24f360f33" status: 200 len: 1325 microversion: 2.1 time: 0.306243 Jul 23 21:24:02.447226 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1286/2537] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:02 2022] GET /compute/v2.1/servers/c73f1c6e-9c56-453d-89bf-b9e24f360f33 => generated 1325 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:24:02.452492 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-8f23837d-13c8-49ac-9a6c-b5edc768d74f tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Calling method '.version_select at 0x7f0b47cc4c10>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:02.504403 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-8f23837d-13c8-49ac-9a6c-b5edc768d74f tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] HTTP exception thrown: Image not found. Jul 23 21:24:02.506423 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-8f23837d-13c8-49ac-9a6c-b5edc768d74f tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Request method failure captured: Jul 23 21:24:02.506423 ncdv-master-1 devstack@n-api.service[131321]: request: DELETE /compute/v2.1/images/d899d6d5-3173-446f-9605-a7e38cdde92c HTTP/1.1 Jul 23 21:24:02.506423 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:24:02.506423 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:24:02.506423 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:24:02.506423 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:24:02.506423 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:24:02.506423 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:24:02.506423 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:24:02.506423 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:24:02.506423 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GafteRsEHiv_4T3fV2KOPCK-8fy57Kvjr25eXRlaLR75L3Xq8mPTfq3gR2B85ZHhhdWZ3fgWcnd1z0dGOXW8id9ZYFLwmcndl2f-I_L_5TsknPkE4Pz67eGdSP8LTdx4JobHNZABuRvbEyB9ZPXuKd0DQ7rfgd5ePRec4jBGE8qnqc Jul 23 21:24:02.506423 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:24:02.506423 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:24:02.506423 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:24:02.506423 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:24:02.506423 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:24:02.506423 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:24:02.506423 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 4ebf7cadb7af43beb0b85669f8e1f36c Jul 23 21:24:02.506423 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ImagesOneServerTestJSON-1078133334 Jul 23 21:24:02.506423 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:24:02.506423 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:24:02.506423 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4ebf7cadb7af43beb0b85669f8e1f36c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4ebf7cadb7af43beb0b85669f8e1f36c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4ebf7cadb7af43beb0b85669f8e1f36c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4ebf7cadb7af43beb0b85669f8e1f36c"}]}] Jul 23 21:24:02.506423 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ImagesOneServerTestJSON-1078133334 Jul 23 21:24:02.506423 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 4ebf7cadb7af43beb0b85669f8e1f36c Jul 23 21:24:02.506423 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1078133334 Jul 23 21:24:02.506423 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ImagesOneServerTestJSON-1078133334-project Jul 23 21:24:02.506423 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:24:02.506423 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:24:02.506423 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 73bde36fce49439bbe49caa877b1b630 Jul 23 21:24:02.506423 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ImagesOneServerTestJSON-1078133334-project Jul 23 21:24:02.506423 ncdv-master-1 devstack@n-api.service[131321]: method: Jul 23 21:24:02.506423 ncdv-master-1 devstack@n-api.service[131321]: exception: Image not found. Jul 23 21:24:02.506423 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': 'd899d6d5-3173-446f-9605-a7e38cdde92c'} Jul 23 21:24:02.506423 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:24:02.506423 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:24:02.506423 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 23 21:24:02.506423 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 23 21:24:02.506423 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 23 21:24:02.506423 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 23 21:24:02.506423 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 23 21:24:02.506423 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 23 21:24:02.506423 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 23 21:24:02.506423 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 23 21:24:02.506423 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 23 21:24:02.506423 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 23 21:24:02.506423 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 23 21:24:02.506423 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 23 21:24:02.506423 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 23 21:24:02.506423 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 23 21:24:02.506423 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image d899d6d5-3173-446f-9605-a7e38cdde92c to delete Jul 23 21:24:02.506423 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:24:02.506423 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:24:02.506423 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:24:02.506423 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:24:02.506423 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 23 21:24:02.506423 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 23 21:24:02.506423 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 23 21:24:02.506423 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 23 21:24:02.506423 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 23 21:24:02.506423 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 23 21:24:02.506423 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d899d6d5-3173-446f-9605-a7e38cdde92c could not be found. Jul 23 21:24:02.506423 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:24:02.506423 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:24:02.506423 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:24:02.506423 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:24:02.513149 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:24:02.513149 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:24:02.513149 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:24:02.513149 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:24:02.513149 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:24:02.513149 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:24:02.513149 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:24:02.513149 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:24:02.513149 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 23 21:24:02.513149 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 23 21:24:02.513149 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 23 21:24:02.513149 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:24:02.513149 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:24:02.513149 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:24:02.513149 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:24:02.513149 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:24:02.513149 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:24:02.513149 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:24:02.513149 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:24:02.513149 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 23 21:24:02.513149 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:24:02.513149 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-8f23837d-13c8-49ac-9a6c-b5edc768d74f tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Returning 404 to user: Image not found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:24:02.513149 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-8f23837d-13c8-49ac-9a6c-b5edc768d74f tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] 10.222.0.17 "DELETE /compute/v2.1/images/d899d6d5-3173-446f-9605-a7e38cdde92c" status: 404 len: 62 microversion: 2.1 time: 0.059371 Jul 23 21:24:02.513149 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1287/2538] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:02 2022] DELETE /compute/v2.1/images/d899d6d5-3173-446f-9605-a7e38cdde92c => generated 62 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 23 21:24:02.525938 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-c95cf175-9200-44a3-95d0-ae0d16de47b9 req-a4c9ac4d-1713-4884-955b-1da828b4491e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd8dace4-4427-490e-ad29-73092c943515", "name": "network-vif-deleted", "tag": "08d3703a-fc82-45d7-a979-0da0e96e3452"}, {"server_uuid": "dd8dace4-4427-490e-ad29-73092c943515", "name": "network-vif-deleted", "tag": "a7c2389d-d3e3-45ba-a0f7-f037c086060d"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:24:02.546621 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-c95cf175-9200-44a3-95d0-ae0d16de47b9 req-a4c9ac4d-1713-4884-955b-1da828b4491e service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:02.547255 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-c95cf175-9200-44a3-95d0-ae0d16de47b9 req-a4c9ac4d-1713-4884-955b-1da828b4491e service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:02.552418 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-4b5d0e61-762c-4e38-b4e3-de030d0c7912 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfb831babfd456e9cd186bab2ca14bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37510f38df0a45a6bb7771bdb0fbe271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:02.562938 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4b5d0e61-762c-4e38-b4e3-de030d0c7912 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] 10.222.0.17 "GET /compute/v2.1/servers/461367a0-c929-4951-98f4-d5194ae688f3" status: 200 len: 1213 microversion: 2.1 time: 0.128824 Jul 23 21:24:02.571095 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-c95cf175-9200-44a3-95d0-ae0d16de47b9 req-a4c9ac4d-1713-4884-955b-1da828b4491e service nova] Creating event network-vif-deleted:08d3703a-fc82-45d7-a979-0da0e96e3452 for instance dd8dace4-4427-490e-ad29-73092c943515 on nch2-master-1 Jul 23 21:24:02.572550 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-c95cf175-9200-44a3-95d0-ae0d16de47b9 req-a4c9ac4d-1713-4884-955b-1da828b4491e service nova] Creating event network-vif-deleted:a7c2389d-d3e3-45ba-a0f7-f037c086060d for instance dd8dace4-4427-490e-ad29-73092c943515 on nch2-master-1 Jul 23 21:24:02.579624 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-c95cf175-9200-44a3-95d0-ae0d16de47b9 req-a4c9ac4d-1713-4884-955b-1da828b4491e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.067435 Jul 23 21:24:02.584658 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1252/2539] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:02 2022] GET /compute/v2.1/servers/461367a0-c929-4951-98f4-d5194ae688f3 => generated 1213 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:24:02.594666 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-175b8beb-1804-4df9-b3bd-8105926648e7 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:02.595222 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-175b8beb-1804-4df9-b3bd-8105926648e7 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] [instance: 011c4ff9-9d46-44df-bf9b-e0269c71c417] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:02.604046 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-175b8beb-1804-4df9-b3bd-8105926648e7 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:02.604321 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1288/2540] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:24:02 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:24:02.604998 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-175b8beb-1804-4df9-b3bd-8105926648e7 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:02.606763 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-175b8beb-1804-4df9-b3bd-8105926648e7 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:02.607507 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-175b8beb-1804-4df9-b3bd-8105926648e7 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:02.610336 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d98830de-06c0-4ae3-b459-e75f7b177661 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:02.610935 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-d98830de-06c0-4ae3-b459-e75f7b177661 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] [instance: 6929bb48-ae83-4078-8df7-60124c837ea3] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:02.633312 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d98830de-06c0-4ae3-b459-e75f7b177661 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:02.638441 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d98830de-06c0-4ae3-b459-e75f7b177661 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:02.640108 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d98830de-06c0-4ae3-b459-e75f7b177661 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:02.650966 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d98830de-06c0-4ae3-b459-e75f7b177661 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:02.703728 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-d98830de-06c0-4ae3-b459-e75f7b177661 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] [instance: 6929bb48-ae83-4078-8df7-60124c837ea3] Going to try to terminate instance {{(pid=131321) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:24:02.765078 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:24:02.873225 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-175b8beb-1804-4df9-b3bd-8105926648e7 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] 10.222.0.17 "GET /compute/v2.1/servers/011c4ff9-9d46-44df-bf9b-e0269c71c417/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.285046 Jul 23 21:24:02.874215 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1253/2541] 10.222.0.17 () {58 vars in 1274 bytes} [Sat Jul 23 21:24:02 2022] GET /compute/v2.1/servers/011c4ff9-9d46-44df-bf9b-e0269c71c417/os-interface => generated 285 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:24:02.917337 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-d98830de-06c0-4ae3-b459-e75f7b177661 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] 10.222.0.17 "DELETE /compute/v2.1/servers/6929bb48-ae83-4078-8df7-60124c837ea3" status: 204 len: 0 microversion: 2.1 time: 0.311177 Jul 23 21:24:02.918153 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1289/2542] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:24:02 2022] DELETE /compute/v2.1/servers/6929bb48-ae83-4078-8df7-60124c837ea3 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:24:02.928714 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f4bc23df-f09b-4867-b93c-3f8547356b63 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:02.929995 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f4bc23df-f09b-4867-b93c-3f8547356b63 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] [instance: 6929bb48-ae83-4078-8df7-60124c837ea3] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:02.938634 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f4bc23df-f09b-4867-b93c-3f8547356b63 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:02.939431 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f4bc23df-f09b-4867-b93c-3f8547356b63 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:02.940710 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f4bc23df-f09b-4867-b93c-3f8547356b63 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:02.941173 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f4bc23df-f09b-4867-b93c-3f8547356b63 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:03.140078 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f4bc23df-f09b-4867-b93c-3f8547356b63 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bde36fce49439bbe49caa877b1b630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebf7cadb7af43beb0b85669f8e1f36c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:03.150706 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f4bc23df-f09b-4867-b93c-3f8547356b63 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] 10.222.0.17 "GET /compute/v2.1/servers/6929bb48-ae83-4078-8df7-60124c837ea3" status: 200 len: 1473 microversion: 2.1 time: 0.227659 Jul 23 21:24:03.151612 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1254/2543] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:02 2022] GET /compute/v2.1/servers/6929bb48-ae83-4078-8df7-60124c837ea3 => generated 1473 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:24:03.157463 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-32591e5a-02c3-4bf9-a316-dff9143537a9 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:03.158623 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-32591e5a-02c3-4bf9-a316-dff9143537a9 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] [instance: dd8dace4-4427-490e-ad29-73092c943515] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:03.167924 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-32591e5a-02c3-4bf9-a316-dff9143537a9 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:03.170565 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-32591e5a-02c3-4bf9-a316-dff9143537a9 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:03.171749 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-32591e5a-02c3-4bf9-a316-dff9143537a9 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:03.172327 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-32591e5a-02c3-4bf9-a316-dff9143537a9 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:03.194643 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-32591e5a-02c3-4bf9-a316-dff9143537a9 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] HTTP exception thrown: Instance dd8dace4-4427-490e-ad29-73092c943515 could not be found. Jul 23 21:24:03.196622 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-32591e5a-02c3-4bf9-a316-dff9143537a9 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Request method failure captured: Jul 23 21:24:03.196622 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/servers/dd8dace4-4427-490e-ad29-73092c943515 HTTP/1.1 Jul 23 21:24:03.196622 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:24:03.196622 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:24:03.196622 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:24:03.196622 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:24:03.196622 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:24:03.196622 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:24:03.196622 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:24:03.196622 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:24:03.196622 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3Ga5Nqf2OzbQ0VMu8-Q8oUXfLZWohVQycxzj4BjNzTTJha-mu0AebChee67u7O8mAQ9INyILZaQaEcXxo98a3YBIXtbgkOp12vSOS_jUcC6637luRAbm5am_Hsp98g8CItnJOqh857H3h8_GAIRDnfKg6TgexWSssvhOXDhoew_FnVs Jul 23 21:24:03.196622 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:24:03.196622 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:24:03.196622 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:24:03.196622 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:24:03.196622 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:24:03.196622 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:24:03.196622 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: d3ff73d603ec4069a908452514a59451 Jul 23 21:24:03.196622 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ServersTestMultiNic-1266215266 Jul 23 21:24:03.196622 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:24:03.196622 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:24:03.196622 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d3ff73d603ec4069a908452514a59451"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d3ff73d603ec4069a908452514a59451"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d3ff73d603ec4069a908452514a59451", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d3ff73d603ec4069a908452514a59451"}]}] Jul 23 21:24:03.196622 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ServersTestMultiNic-1266215266 Jul 23 21:24:03.196622 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: d3ff73d603ec4069a908452514a59451 Jul 23 21:24:03.196622 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ServersTestMultiNic-1266215266 Jul 23 21:24:03.196622 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ServersTestMultiNic-1266215266-project Jul 23 21:24:03.196622 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:24:03.196622 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:24:03.196622 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: e74c139b38d74d9ab93695471ccd3a2c Jul 23 21:24:03.196622 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ServersTestMultiNic-1266215266-project Jul 23 21:24:03.196622 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:24:03.196622 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance dd8dace4-4427-490e-ad29-73092c943515 could not be found. Jul 23 21:24:03.196622 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': 'dd8dace4-4427-490e-ad29-73092c943515'} Jul 23 21:24:03.196622 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:24:03.196622 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:24:03.196622 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:24:03.196622 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:24:03.196622 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:24:03.196622 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:24:03.196622 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:24:03.196622 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:24:03.196622 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:24:03.196622 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:24:03.196622 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd8dace4-4427-490e-ad29-73092c943515 could not be found. Jul 23 21:24:03.196622 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:24:03.196622 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:24:03.196622 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:24:03.196622 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:24:03.196622 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:24:03.196622 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:24:03.196622 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:24:03.196622 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:24:03.196622 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:24:03.196622 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:24:03.196622 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:24:03.196622 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:24:03.196622 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:24:03.196622 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:24:03.196622 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:24:03.196622 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:24:03.196622 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd8dace4-4427-490e-ad29-73092c943515 could not be found. Jul 23 21:24:03.196622 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:24:03.196622 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:24:03.196622 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:24:03.201533 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:24:03.201533 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:24:03.201533 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:24:03.201533 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:24:03.201533 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:24:03.201533 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd8dace4-4427-490e-ad29-73092c943515 could not be found. Jul 23 21:24:03.201533 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:24:03.201533 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-32591e5a-02c3-4bf9-a316-dff9143537a9 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Returning 404 to user: Instance dd8dace4-4427-490e-ad29-73092c943515 could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:24:03.201533 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-32591e5a-02c3-4bf9-a316-dff9143537a9 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] 10.222.0.17 "GET /compute/v2.1/servers/dd8dace4-4427-490e-ad29-73092c943515" status: 404 len: 111 microversion: 2.1 time: 0.052077 Jul 23 21:24:03.201533 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1290/2544] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:03 2022] GET /compute/v2.1/servers/dd8dace4-4427-490e-ad29-73092c943515 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 23 21:24:03.468128 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9f4a8adf-4f8a-401c-aea3-8c9bd61a1da7 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:03.468731 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-9f4a8adf-4f8a-401c-aea3-8c9bd61a1da7 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] [instance: c73f1c6e-9c56-453d-89bf-b9e24f360f33] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:03.476735 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9f4a8adf-4f8a-401c-aea3-8c9bd61a1da7 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:03.477469 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9f4a8adf-4f8a-401c-aea3-8c9bd61a1da7 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:03.478754 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9f4a8adf-4f8a-401c-aea3-8c9bd61a1da7 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:03.479382 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9f4a8adf-4f8a-401c-aea3-8c9bd61a1da7 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:03.600976 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-fb04145d-8bb7-4712-8e67-f02c217ceef3 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:03.601821 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-fb04145d-8bb7-4712-8e67-f02c217ceef3 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] [instance: 461367a0-c929-4951-98f4-d5194ae688f3] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:03.609079 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fb04145d-8bb7-4712-8e67-f02c217ceef3 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:03.609532 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fb04145d-8bb7-4712-8e67-f02c217ceef3 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:03.610375 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fb04145d-8bb7-4712-8e67-f02c217ceef3 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:03.610811 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fb04145d-8bb7-4712-8e67-f02c217ceef3 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:03.693818 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-fb04145d-8bb7-4712-8e67-f02c217ceef3 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfb831babfd456e9cd186bab2ca14bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37510f38df0a45a6bb7771bdb0fbe271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:03.703180 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-fb04145d-8bb7-4712-8e67-f02c217ceef3 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] 10.222.0.17 "GET /compute/v2.1/servers/461367a0-c929-4951-98f4-d5194ae688f3" status: 200 len: 1217 microversion: 2.1 time: 0.106112 Jul 23 21:24:03.703969 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1291/2545] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:03 2022] GET /compute/v2.1/servers/461367a0-c929-4951-98f4-d5194ae688f3 => generated 1217 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:24:03.949552 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-9f4a8adf-4f8a-401c-aea3-8c9bd61a1da7 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a812b6571db40a1a2f138dc03d4e1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14294b18c6e4936b1272a57d4faccce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:03.952040 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:24:03.970137 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9f4a8adf-4f8a-401c-aea3-8c9bd61a1da7 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] 10.222.0.17 "GET /compute/v2.1/servers/c73f1c6e-9c56-453d-89bf-b9e24f360f33" status: 200 len: 1325 microversion: 2.1 time: 0.503167 Jul 23 21:24:03.970137 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1255/2546] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:03 2022] GET /compute/v2.1/servers/c73f1c6e-9c56-453d-89bf-b9e24f360f33 => generated 1325 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:24:04.175914 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-7cee5279-d543-452d-8782-5d1b8f6d6ec0 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:04.177184 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-7cee5279-d543-452d-8782-5d1b8f6d6ec0 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] [instance: 6929bb48-ae83-4078-8df7-60124c837ea3] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:04.185037 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7cee5279-d543-452d-8782-5d1b8f6d6ec0 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:04.185746 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7cee5279-d543-452d-8782-5d1b8f6d6ec0 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:04.187097 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7cee5279-d543-452d-8782-5d1b8f6d6ec0 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:04.187820 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7cee5279-d543-452d-8782-5d1b8f6d6ec0 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:04.673742 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-679aac5e-d103-4e7a-bd5b-e2d6035911b2 req-66d9c5f6-b159-4cde-8c81-ac6c8f588090 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6929bb48-ae83-4078-8df7-60124c837ea3", "name": "network-vif-unplugged", "status": "completed", "tag": "1e3e8f57-3c77-4c90-ad4e-1a9f4efa146d"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:24:04.684734 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=8 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:24:04.707842 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-679aac5e-d103-4e7a-bd5b-e2d6035911b2 req-66d9c5f6-b159-4cde-8c81-ac6c8f588090 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:04.708516 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-679aac5e-d103-4e7a-bd5b-e2d6035911b2 req-66d9c5f6-b159-4cde-8c81-ac6c8f588090 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:04.751357 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-679aac5e-d103-4e7a-bd5b-e2d6035911b2 req-66d9c5f6-b159-4cde-8c81-ac6c8f588090 service nova] Creating event network-vif-unplugged:1e3e8f57-3c77-4c90-ad4e-1a9f4efa146d for instance 6929bb48-ae83-4078-8df7-60124c837ea3 on nch2-master-1 Jul 23 21:24:04.757404 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-679aac5e-d103-4e7a-bd5b-e2d6035911b2 req-66d9c5f6-b159-4cde-8c81-ac6c8f588090 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.088599 Jul 23 21:24:04.758663 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1256/2547] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:24:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:24:04.764662 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-15a04417-0b68-4a5d-882a-9055264744f1 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:04.765564 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-15a04417-0b68-4a5d-882a-9055264744f1 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] [instance: 461367a0-c929-4951-98f4-d5194ae688f3] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:04.777601 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-15a04417-0b68-4a5d-882a-9055264744f1 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:04.778443 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-15a04417-0b68-4a5d-882a-9055264744f1 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:04.779450 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-15a04417-0b68-4a5d-882a-9055264744f1 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:04.780052 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-15a04417-0b68-4a5d-882a-9055264744f1 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:04.886149 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-15a04417-0b68-4a5d-882a-9055264744f1 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfb831babfd456e9cd186bab2ca14bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37510f38df0a45a6bb7771bdb0fbe271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:04.895614 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-15a04417-0b68-4a5d-882a-9055264744f1 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] 10.222.0.17 "GET /compute/v2.1/servers/461367a0-c929-4951-98f4-d5194ae688f3" status: 200 len: 1265 microversion: 2.1 time: 0.135398 Jul 23 21:24:04.907309 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1257/2548] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:04 2022] GET /compute/v2.1/servers/461367a0-c929-4951-98f4-d5194ae688f3 => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:24:04.953238 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-7cee5279-d543-452d-8782-5d1b8f6d6ec0 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bde36fce49439bbe49caa877b1b630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebf7cadb7af43beb0b85669f8e1f36c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:04.968011 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-7cee5279-d543-452d-8782-5d1b8f6d6ec0 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] 10.222.0.17 "GET /compute/v2.1/servers/6929bb48-ae83-4078-8df7-60124c837ea3" status: 200 len: 1473 microversion: 2.1 time: 0.791397 Jul 23 21:24:04.968883 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1292/2549] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:04 2022] GET /compute/v2.1/servers/6929bb48-ae83-4078-8df7-60124c837ea3 => generated 1473 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:24:04.999139 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-cc8bae25-eb7b-445c-ba8f-e7d112efdebe tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:05.000429 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-d333d0ac-6724-46dc-87b3-1ae1ba625cf6 req-fcee9baf-1adf-4e9f-b41f-59c8a76e1600 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "011c4ff9-9d46-44df-bf9b-e0269c71c417", "tag": "e9103d4a-4c54-4f9a-a910-26edefe5de92"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:24:05.002307 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-cc8bae25-eb7b-445c-ba8f-e7d112efdebe tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] [instance: c73f1c6e-9c56-453d-89bf-b9e24f360f33] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:05.018783 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cc8bae25-eb7b-445c-ba8f-e7d112efdebe tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:05.019201 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cc8bae25-eb7b-445c-ba8f-e7d112efdebe tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:05.020200 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-d333d0ac-6724-46dc-87b3-1ae1ba625cf6 req-fcee9baf-1adf-4e9f-b41f-59c8a76e1600 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:05.020862 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cc8bae25-eb7b-445c-ba8f-e7d112efdebe tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:05.021308 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cc8bae25-eb7b-445c-ba8f-e7d112efdebe tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:05.023691 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-d333d0ac-6724-46dc-87b3-1ae1ba625cf6 req-fcee9baf-1adf-4e9f-b41f-59c8a76e1600 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:05.068646 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-d333d0ac-6724-46dc-87b3-1ae1ba625cf6 req-fcee9baf-1adf-4e9f-b41f-59c8a76e1600 service nova] Creating event network-changed:e9103d4a-4c54-4f9a-a910-26edefe5de92 for instance 011c4ff9-9d46-44df-bf9b-e0269c71c417 on nch1-master-1 Jul 23 21:24:05.088535 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-d333d0ac-6724-46dc-87b3-1ae1ba625cf6 req-fcee9baf-1adf-4e9f-b41f-59c8a76e1600 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096937 Jul 23 21:24:05.091301 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1293/2550] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:24:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:24:05.332783 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-cc8bae25-eb7b-445c-ba8f-e7d112efdebe tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a812b6571db40a1a2f138dc03d4e1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14294b18c6e4936b1272a57d4faccce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:05.357035 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-cc8bae25-eb7b-445c-ba8f-e7d112efdebe tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] 10.222.0.17 "GET /compute/v2.1/servers/c73f1c6e-9c56-453d-89bf-b9e24f360f33" status: 200 len: 1520 microversion: 2.1 time: 0.374367 Jul 23 21:24:05.364972 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1258/2551] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:04 2022] GET /compute/v2.1/servers/c73f1c6e-9c56-453d-89bf-b9e24f360f33 => generated 1520 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:24:05.388064 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-23f94dc6-84e0-429d-86dd-030746e6980c tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:05.388941 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-23f94dc6-84e0-429d-86dd-030746e6980c tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] [instance: c73f1c6e-9c56-453d-89bf-b9e24f360f33] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:05.408198 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-23f94dc6-84e0-429d-86dd-030746e6980c tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:05.410435 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-23f94dc6-84e0-429d-86dd-030746e6980c tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:05.412634 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-23f94dc6-84e0-429d-86dd-030746e6980c tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:05.413856 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-23f94dc6-84e0-429d-86dd-030746e6980c tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:05.480161 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-23f94dc6-84e0-429d-86dd-030746e6980c tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] HTTP exception thrown: Instance is not a member of specified network Jul 23 21:24:05.486448 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-23f94dc6-84e0-429d-86dd-030746e6980c tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Request method failure captured: Jul 23 21:24:05.486448 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/servers/c73f1c6e-9c56-453d-89bf-b9e24f360f33/ips/invalid HTTP/1.1 Jul 23 21:24:05.486448 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:24:05.486448 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:24:05.486448 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:24:05.486448 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:24:05.486448 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:24:05.486448 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:24:05.486448 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:24:05.486448 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:24:05.486448 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GbhfeinMQk43e3WqP7q9xznq59RoOD2N9f6Fy1kaGenABNo6TIIi5E95KTMjSx9MWz4NvGJpv3_JzYUG7MviC-_pAkZVJPmesintvIqmbY_PppRR34REkUEEFE9PEsOIHN6GH-F7EKKuOESAoRDLhk7Ti5leZk4ccrsL4FqFAyL5uw Jul 23 21:24:05.486448 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:24:05.486448 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:24:05.486448 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:24:05.486448 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:24:05.486448 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:24:05.486448 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:24:05.486448 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: a14294b18c6e4936b1272a57d4faccce Jul 23 21:24:05.486448 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-586135632 Jul 23 21:24:05.486448 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:24:05.486448 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:24:05.486448 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a14294b18c6e4936b1272a57d4faccce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a14294b18c6e4936b1272a57d4faccce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a14294b18c6e4936b1272a57d4faccce", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a14294b18c6e4936b1272a57d4faccce"}]}] Jul 23 21:24:05.486448 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-586135632 Jul 23 21:24:05.486448 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: a14294b18c6e4936b1272a57d4faccce Jul 23 21:24:05.486448 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-586135632 Jul 23 21:24:05.486448 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ServerAddressesNegativeTestJSON-586135632-project Jul 23 21:24:05.486448 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:24:05.486448 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:24:05.486448 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 7a812b6571db40a1a2f138dc03d4e1be Jul 23 21:24:05.486448 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-586135632-project Jul 23 21:24:05.486448 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:24:05.486448 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance is not a member of specified network Jul 23 21:24:05.486448 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'server_id': 'c73f1c6e-9c56-453d-89bf-b9e24f360f33', 'id': 'invalid'} Jul 23 21:24:05.486448 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:24:05.486448 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:24:05.486448 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:24:05.486448 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:24:05.486448 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:24:05.486448 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:24:05.486448 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:24:05.486448 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:24:05.486448 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Jul 23 21:24:05.486448 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 23 21:24:05.486448 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Jul 23 21:24:05.486448 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:24:05.486448 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:24:05.486448 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:24:05.486448 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:24:05.486448 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:24:05.486448 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:24:05.486448 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:24:05.486448 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:24:05.486448 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Jul 23 21:24:05.486448 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:24:05.492543 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-23f94dc6-84e0-429d-86dd-030746e6980c tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Returning 404 to user: Instance is not a member of specified network {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:24:05.493910 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-23f94dc6-84e0-429d-86dd-030746e6980c tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] 10.222.0.17 "GET /compute/v2.1/servers/c73f1c6e-9c56-453d-89bf-b9e24f360f33/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.112736 Jul 23 21:24:05.500673 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1294/2552] 10.222.0.17 () {58 vars in 1271 bytes} [Sat Jul 23 21:24:05 2022] GET /compute/v2.1/servers/c73f1c6e-9c56-453d-89bf-b9e24f360f33/ips/invalid => generated 91 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 23 21:24:05.506925 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9b9fd2cf-fe6e-4992-a186-7c21f4402bb4 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:05.507957 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-9b9fd2cf-fe6e-4992-a186-7c21f4402bb4 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Failed to fetch instance by id 999 {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 23 21:24:05.508771 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-9b9fd2cf-fe6e-4992-a186-7c21f4402bb4 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] HTTP exception thrown: Instance 999 could not be found. Jul 23 21:24:05.510994 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9b9fd2cf-fe6e-4992-a186-7c21f4402bb4 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Request method failure captured: Jul 23 21:24:05.510994 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Jul 23 21:24:05.510994 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:24:05.510994 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:24:05.510994 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:24:05.510994 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:24:05.510994 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:24:05.510994 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:24:05.510994 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:24:05.510994 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:24:05.510994 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GbhfeinMQk43e3WqP7q9xznq59RoOD2N9f6Fy1kaGenABNo6TIIi5E95KTMjSx9MWz4NvGJpv3_JzYUG7MviC-_pAkZVJPmesintvIqmbY_PppRR34REkUEEFE9PEsOIHN6GH-F7EKKuOESAoRDLhk7Ti5leZk4ccrsL4FqFAyL5uw Jul 23 21:24:05.510994 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:24:05.510994 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:24:05.510994 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:24:05.510994 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:24:05.510994 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:24:05.510994 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:24:05.510994 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: a14294b18c6e4936b1272a57d4faccce Jul 23 21:24:05.510994 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-586135632 Jul 23 21:24:05.510994 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:24:05.510994 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:24:05.510994 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a14294b18c6e4936b1272a57d4faccce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a14294b18c6e4936b1272a57d4faccce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a14294b18c6e4936b1272a57d4faccce", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a14294b18c6e4936b1272a57d4faccce"}]}] Jul 23 21:24:05.510994 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-586135632 Jul 23 21:24:05.510994 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: a14294b18c6e4936b1272a57d4faccce Jul 23 21:24:05.510994 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-586135632 Jul 23 21:24:05.510994 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServerAddressesNegativeTestJSON-586135632-project Jul 23 21:24:05.510994 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:24:05.510994 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:24:05.510994 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 7a812b6571db40a1a2f138dc03d4e1be Jul 23 21:24:05.510994 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-586135632-project Jul 23 21:24:05.510994 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:24:05.510994 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance 999 could not be found. Jul 23 21:24:05.510994 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'server_id': '999'} Jul 23 21:24:05.510994 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:24:05.510994 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:24:05.510994 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:24:05.510994 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:24:05.510994 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 23 21:24:05.510994 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 23 21:24:05.510994 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Jul 23 21:24:05.510994 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:24:05.510994 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:24:05.510994 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:24:05.510994 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:24:05.510994 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:24:05.510994 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:24:05.510994 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:24:05.510994 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:24:05.510994 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:24:05.510994 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:24:05.510994 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Jul 23 21:24:05.510994 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Jul 23 21:24:05.510994 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:24:05.510994 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:24:05.510994 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Jul 23 21:24:05.510994 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:24:05.510994 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:24:05.510994 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:24:05.510994 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:24:05.510994 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:24:05.510994 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:24:05.510994 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:24:05.510994 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:24:05.510994 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Jul 23 21:24:05.510994 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:24:05.517777 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9b9fd2cf-fe6e-4992-a186-7c21f4402bb4 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Returning 404 to user: Instance 999 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:24:05.524159 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9b9fd2cf-fe6e-4992-a186-7c21f4402bb4 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] 10.222.0.17 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.016752 Jul 23 21:24:05.524159 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1259/2553] 10.222.0.17 () {58 vars in 1148 bytes} [Sat Jul 23 21:24:05 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 23 21:24:05.533193 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c36b2211-affc-4613-ad05-8d69cc032bfc tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:05.534019 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-c36b2211-affc-4613-ad05-8d69cc032bfc tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] [instance: c73f1c6e-9c56-453d-89bf-b9e24f360f33] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:05.537263 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:24:05.545008 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c36b2211-affc-4613-ad05-8d69cc032bfc tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:05.546718 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c36b2211-affc-4613-ad05-8d69cc032bfc tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:05.547952 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c36b2211-affc-4613-ad05-8d69cc032bfc tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:05.548395 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c36b2211-affc-4613-ad05-8d69cc032bfc tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:05.588349 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-c36b2211-affc-4613-ad05-8d69cc032bfc tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] [instance: c73f1c6e-9c56-453d-89bf-b9e24f360f33] Going to try to terminate instance {{(pid=131321) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:24:05.758660 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-c36b2211-affc-4613-ad05-8d69cc032bfc tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] 10.222.0.17 "DELETE /compute/v2.1/servers/c73f1c6e-9c56-453d-89bf-b9e24f360f33" status: 204 len: 0 microversion: 2.1 time: 0.232322 Jul 23 21:24:05.759294 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1295/2554] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:24:05 2022] DELETE /compute/v2.1/servers/c73f1c6e-9c56-453d-89bf-b9e24f360f33 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:24:05.768495 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-20c5bf03-6cbf-4076-8401-e437e7b1be70 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:05.769277 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-20c5bf03-6cbf-4076-8401-e437e7b1be70 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] [instance: c73f1c6e-9c56-453d-89bf-b9e24f360f33] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:05.784044 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-20c5bf03-6cbf-4076-8401-e437e7b1be70 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:05.784768 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-20c5bf03-6cbf-4076-8401-e437e7b1be70 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:05.785754 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-20c5bf03-6cbf-4076-8401-e437e7b1be70 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:05.786388 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-20c5bf03-6cbf-4076-8401-e437e7b1be70 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:05.915945 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-896575e6-79ac-4681-9645-e307bfe787ea tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:05.916707 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-896575e6-79ac-4681-9645-e307bfe787ea tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] [instance: 461367a0-c929-4951-98f4-d5194ae688f3] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:05.926583 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-896575e6-79ac-4681-9645-e307bfe787ea tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:05.927036 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-896575e6-79ac-4681-9645-e307bfe787ea tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:05.932448 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-896575e6-79ac-4681-9645-e307bfe787ea tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:05.932965 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-896575e6-79ac-4681-9645-e307bfe787ea tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:06.061074 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-20c5bf03-6cbf-4076-8401-e437e7b1be70 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a812b6571db40a1a2f138dc03d4e1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14294b18c6e4936b1272a57d4faccce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:06.092919 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-20c5bf03-6cbf-4076-8401-e437e7b1be70 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] 10.222.0.17 "GET /compute/v2.1/servers/c73f1c6e-9c56-453d-89bf-b9e24f360f33" status: 200 len: 1526 microversion: 2.1 time: 0.328449 Jul 23 21:24:06.095179 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1260/2555] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:05 2022] GET /compute/v2.1/servers/c73f1c6e-9c56-453d-89bf-b9e24f360f33 => generated 1526 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:24:06.113876 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5cc4e66d-7843-474c-806f-0fd6c54ece50 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:06.115961 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5cc4e66d-7843-474c-806f-0fd6c54ece50 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] [instance: 6929bb48-ae83-4078-8df7-60124c837ea3] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:06.128721 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5cc4e66d-7843-474c-806f-0fd6c54ece50 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:06.140313 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-896575e6-79ac-4681-9645-e307bfe787ea tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfb831babfd456e9cd186bab2ca14bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37510f38df0a45a6bb7771bdb0fbe271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:06.141847 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5cc4e66d-7843-474c-806f-0fd6c54ece50 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:06.143357 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5cc4e66d-7843-474c-806f-0fd6c54ece50 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:06.144263 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5cc4e66d-7843-474c-806f-0fd6c54ece50 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:06.157958 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-896575e6-79ac-4681-9645-e307bfe787ea tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] 10.222.0.17 "GET /compute/v2.1/servers/461367a0-c929-4951-98f4-d5194ae688f3" status: 200 len: 1271 microversion: 2.1 time: 0.246911 Jul 23 21:24:06.158657 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1296/2556] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:05 2022] GET /compute/v2.1/servers/461367a0-c929-4951-98f4-d5194ae688f3 => generated 1271 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:24:06.299580 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5cc4e66d-7843-474c-806f-0fd6c54ece50 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73bde36fce49439bbe49caa877b1b630', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ebf7cadb7af43beb0b85669f8e1f36c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:06.343959 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5cc4e66d-7843-474c-806f-0fd6c54ece50 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] 10.222.0.17 "GET /compute/v2.1/servers/6929bb48-ae83-4078-8df7-60124c837ea3" status: 200 len: 1431 microversion: 2.1 time: 0.244146 Jul 23 21:24:06.347690 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1261/2557] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:06 2022] GET /compute/v2.1/servers/6929bb48-ae83-4078-8df7-60124c837ea3 => generated 1431 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:24:07.110435 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-ac074d91-5f8b-487d-b4bf-46df3f64b3a3 req-70161a60-d8e2-4ebe-b60c-a83f4a6b7245 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6929bb48-ae83-4078-8df7-60124c837ea3", "name": "network-vif-deleted", "tag": "1e3e8f57-3c77-4c90-ad4e-1a9f4efa146d"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:24:07.112591 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-398a592f-6645-4cb2-aca4-c772041ae7c1 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:07.114211 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-398a592f-6645-4cb2-aca4-c772041ae7c1 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] [instance: c73f1c6e-9c56-453d-89bf-b9e24f360f33] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:07.121502 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-ac074d91-5f8b-487d-b4bf-46df3f64b3a3 req-70161a60-d8e2-4ebe-b60c-a83f4a6b7245 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:07.122040 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-ac074d91-5f8b-487d-b4bf-46df3f64b3a3 req-70161a60-d8e2-4ebe-b60c-a83f4a6b7245 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:07.122644 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-398a592f-6645-4cb2-aca4-c772041ae7c1 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:07.123403 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-398a592f-6645-4cb2-aca4-c772041ae7c1 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:07.124514 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-398a592f-6645-4cb2-aca4-c772041ae7c1 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:07.125271 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-398a592f-6645-4cb2-aca4-c772041ae7c1 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:07.135093 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-ac074d91-5f8b-487d-b4bf-46df3f64b3a3 req-70161a60-d8e2-4ebe-b60c-a83f4a6b7245 service nova] Creating event network-vif-deleted:1e3e8f57-3c77-4c90-ad4e-1a9f4efa146d for instance 6929bb48-ae83-4078-8df7-60124c837ea3 on nch2-master-1 Jul 23 21:24:07.140352 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-ac074d91-5f8b-487d-b4bf-46df3f64b3a3 req-70161a60-d8e2-4ebe-b60c-a83f4a6b7245 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034004 Jul 23 21:24:07.142341 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1297/2558] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:24:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:24:07.176370 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a5303c3d-4f40-49b7-bf21-6ce6dedfe02d tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:07.177072 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-a5303c3d-4f40-49b7-bf21-6ce6dedfe02d tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] [instance: 461367a0-c929-4951-98f4-d5194ae688f3] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:07.184081 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a5303c3d-4f40-49b7-bf21-6ce6dedfe02d tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:07.184795 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a5303c3d-4f40-49b7-bf21-6ce6dedfe02d tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:07.185390 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a5303c3d-4f40-49b7-bf21-6ce6dedfe02d tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:07.185828 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a5303c3d-4f40-49b7-bf21-6ce6dedfe02d tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:07.322333 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-a5303c3d-4f40-49b7-bf21-6ce6dedfe02d tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfb831babfd456e9cd186bab2ca14bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37510f38df0a45a6bb7771bdb0fbe271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:07.335141 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-a5303c3d-4f40-49b7-bf21-6ce6dedfe02d tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] 10.222.0.17 "GET /compute/v2.1/servers/461367a0-c929-4951-98f4-d5194ae688f3" status: 200 len: 1271 microversion: 2.1 time: 0.162426 Jul 23 21:24:07.336136 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1298/2559] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:07 2022] GET /compute/v2.1/servers/461367a0-c929-4951-98f4-d5194ae688f3 => generated 1271 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:24:07.369415 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ae5577ae-9346-4b34-93f6-1b068ef88161 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:07.370693 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-ae5577ae-9346-4b34-93f6-1b068ef88161 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] [instance: 6929bb48-ae83-4078-8df7-60124c837ea3] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:07.397298 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ae5577ae-9346-4b34-93f6-1b068ef88161 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:07.398245 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ae5577ae-9346-4b34-93f6-1b068ef88161 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:07.404513 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ae5577ae-9346-4b34-93f6-1b068ef88161 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:07.405269 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ae5577ae-9346-4b34-93f6-1b068ef88161 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:07.424458 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-ae5577ae-9346-4b34-93f6-1b068ef88161 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] HTTP exception thrown: Instance 6929bb48-ae83-4078-8df7-60124c837ea3 could not be found. Jul 23 21:24:07.428205 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ae5577ae-9346-4b34-93f6-1b068ef88161 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Request method failure captured: Jul 23 21:24:07.428205 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/servers/6929bb48-ae83-4078-8df7-60124c837ea3 HTTP/1.1 Jul 23 21:24:07.428205 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:24:07.428205 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:24:07.428205 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:24:07.428205 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:24:07.428205 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:24:07.428205 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:24:07.428205 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:24:07.428205 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:24:07.428205 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GafteRsEHiv_4T3fV2KOPCK-8fy57Kvjr25eXRlaLR75L3Xq8mPTfq3gR2B85ZHhhdWZ3fgWcnd1z0dGOXW8id9ZYFLwmcndl2f-I_L_5TsknPkE4Pz67eGdSP8LTdx4JobHNZABuRvbEyB9ZPXuKd0DQ7rfgd5ePRec4jBGE8qnqc Jul 23 21:24:07.428205 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:24:07.428205 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:24:07.428205 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:24:07.428205 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:24:07.428205 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:24:07.428205 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:24:07.428205 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 4ebf7cadb7af43beb0b85669f8e1f36c Jul 23 21:24:07.428205 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ImagesOneServerTestJSON-1078133334 Jul 23 21:24:07.428205 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:24:07.428205 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:24:07.428205 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4ebf7cadb7af43beb0b85669f8e1f36c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4ebf7cadb7af43beb0b85669f8e1f36c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4ebf7cadb7af43beb0b85669f8e1f36c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4ebf7cadb7af43beb0b85669f8e1f36c"}]}] Jul 23 21:24:07.428205 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ImagesOneServerTestJSON-1078133334 Jul 23 21:24:07.428205 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 4ebf7cadb7af43beb0b85669f8e1f36c Jul 23 21:24:07.428205 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1078133334 Jul 23 21:24:07.428205 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ImagesOneServerTestJSON-1078133334-project Jul 23 21:24:07.428205 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:24:07.428205 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:24:07.428205 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 73bde36fce49439bbe49caa877b1b630 Jul 23 21:24:07.428205 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ImagesOneServerTestJSON-1078133334-project Jul 23 21:24:07.428205 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:24:07.428205 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance 6929bb48-ae83-4078-8df7-60124c837ea3 could not be found. Jul 23 21:24:07.428205 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': '6929bb48-ae83-4078-8df7-60124c837ea3'} Jul 23 21:24:07.428205 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:24:07.428205 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:24:07.428205 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:24:07.428205 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:24:07.428205 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:24:07.428205 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:24:07.428205 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:24:07.428205 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:24:07.428205 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:24:07.428205 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:24:07.428205 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6929bb48-ae83-4078-8df7-60124c837ea3 could not be found. Jul 23 21:24:07.428205 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:24:07.428205 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:24:07.428205 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:24:07.428205 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:24:07.428205 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:24:07.428205 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:24:07.428205 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:24:07.428205 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:24:07.428205 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:24:07.428205 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:24:07.428205 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:24:07.428205 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:24:07.428205 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:24:07.428205 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:24:07.428205 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:24:07.428205 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:24:07.428205 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6929bb48-ae83-4078-8df7-60124c837ea3 could not be found. Jul 23 21:24:07.428205 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:24:07.428205 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:24:07.428205 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:24:07.432082 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:24:07.432082 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:24:07.432082 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:24:07.432082 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:24:07.432082 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:24:07.432082 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6929bb48-ae83-4078-8df7-60124c837ea3 could not be found. Jul 23 21:24:07.432082 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:24:07.436047 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ae5577ae-9346-4b34-93f6-1b068ef88161 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] Returning 404 to user: Instance 6929bb48-ae83-4078-8df7-60124c837ea3 could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:24:07.437543 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-ae5577ae-9346-4b34-93f6-1b068ef88161 tempest-ImagesOneServerTestJSON-1078133334 tempest-ImagesOneServerTestJSON-1078133334-project] 10.222.0.17 "GET /compute/v2.1/servers/6929bb48-ae83-4078-8df7-60124c837ea3" status: 404 len: 111 microversion: 2.1 time: 0.076092 Jul 23 21:24:07.439417 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1299/2560] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:07 2022] GET /compute/v2.1/servers/6929bb48-ae83-4078-8df7-60124c837ea3 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 23 21:24:07.625635 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-398a592f-6645-4cb2-aca4-c772041ae7c1 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a812b6571db40a1a2f138dc03d4e1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14294b18c6e4936b1272a57d4faccce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:07.639811 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-398a592f-6645-4cb2-aca4-c772041ae7c1 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] 10.222.0.17 "GET /compute/v2.1/servers/c73f1c6e-9c56-453d-89bf-b9e24f360f33" status: 200 len: 1526 microversion: 2.1 time: 0.530987 Jul 23 21:24:07.651992 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1262/2561] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:07 2022] GET /compute/v2.1/servers/c73f1c6e-9c56-453d-89bf-b9e24f360f33 => generated 1526 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:24:08.355529 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d155a0f5-c64c-47ad-af3e-8d90745e3d55 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:08.357242 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-d155a0f5-c64c-47ad-af3e-8d90745e3d55 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] [instance: 461367a0-c929-4951-98f4-d5194ae688f3] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:08.371596 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d155a0f5-c64c-47ad-af3e-8d90745e3d55 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:08.375464 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d155a0f5-c64c-47ad-af3e-8d90745e3d55 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:08.376606 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d155a0f5-c64c-47ad-af3e-8d90745e3d55 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:08.379997 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d155a0f5-c64c-47ad-af3e-8d90745e3d55 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:08.657445 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-09ff6005-ae1a-4291-896a-2ef16a17ed0f tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:08.659626 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-09ff6005-ae1a-4291-896a-2ef16a17ed0f tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] [instance: c73f1c6e-9c56-453d-89bf-b9e24f360f33] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:08.676511 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-09ff6005-ae1a-4291-896a-2ef16a17ed0f tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:08.677168 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-09ff6005-ae1a-4291-896a-2ef16a17ed0f tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:08.678587 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-09ff6005-ae1a-4291-896a-2ef16a17ed0f tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:08.679367 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-09ff6005-ae1a-4291-896a-2ef16a17ed0f tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:08.733894 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-09ff6005-ae1a-4291-896a-2ef16a17ed0f tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:08.734610 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-09ff6005-ae1a-4291-896a-2ef16a17ed0f tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:08.735231 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.objects.instance [None req-09ff6005-ae1a-4291-896a-2ef16a17ed0f tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Lazy-loading 'fault' on Instance uuid c73f1c6e-9c56-453d-89bf-b9e24f360f33 {{(pid=131320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:24:08.879398 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-d155a0f5-c64c-47ad-af3e-8d90745e3d55 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfb831babfd456e9cd186bab2ca14bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37510f38df0a45a6bb7771bdb0fbe271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:08.894295 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-d155a0f5-c64c-47ad-af3e-8d90745e3d55 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] 10.222.0.17 "GET /compute/v2.1/servers/461367a0-c929-4951-98f4-d5194ae688f3" status: 200 len: 1313 microversion: 2.1 time: 0.543162 Jul 23 21:24:08.896292 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1300/2562] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:08 2022] GET /compute/v2.1/servers/461367a0-c929-4951-98f4-d5194ae688f3 => generated 1313 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:24:08.987801 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-09ff6005-ae1a-4291-896a-2ef16a17ed0f tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a812b6571db40a1a2f138dc03d4e1be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14294b18c6e4936b1272a57d4faccce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:09.015237 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-09ff6005-ae1a-4291-896a-2ef16a17ed0f tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] 10.222.0.17 "GET /compute/v2.1/servers/c73f1c6e-9c56-453d-89bf-b9e24f360f33" status: 200 len: 1315 microversion: 2.1 time: 0.362013 Jul 23 21:24:09.022994 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1263/2563] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:08 2022] GET /compute/v2.1/servers/c73f1c6e-9c56-453d-89bf-b9e24f360f33 => generated 1315 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:24:09.166496 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-3d5c58b6-48e7-4090-b209-219dedc21356 req-715e128c-d4fc-42cb-8f1c-50ad4445d1aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c73f1c6e-9c56-453d-89bf-b9e24f360f33", "name": "network-vif-deleted", "tag": "c8fa132f-9e09-4abf-83e3-251ec6a45805"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:24:09.185517 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-3d5c58b6-48e7-4090-b209-219dedc21356 req-715e128c-d4fc-42cb-8f1c-50ad4445d1aa service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:09.189885 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-3d5c58b6-48e7-4090-b209-219dedc21356 req-715e128c-d4fc-42cb-8f1c-50ad4445d1aa service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:09.241791 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-3d5c58b6-48e7-4090-b209-219dedc21356 req-715e128c-d4fc-42cb-8f1c-50ad4445d1aa service nova] Creating event network-vif-deleted:c8fa132f-9e09-4abf-83e3-251ec6a45805 for instance c73f1c6e-9c56-453d-89bf-b9e24f360f33 on nch1-master-1 Jul 23 21:24:09.252785 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-3d5c58b6-48e7-4090-b209-219dedc21356 req-715e128c-d4fc-42cb-8f1c-50ad4445d1aa service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092807 Jul 23 21:24:09.253408 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1301/2564] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:24:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:24:09.919582 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a28f0372-86c5-40e6-9278-3adc11f0fcef tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:09.922540 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-a28f0372-86c5-40e6-9278-3adc11f0fcef tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] [instance: 461367a0-c929-4951-98f4-d5194ae688f3] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:09.941976 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a28f0372-86c5-40e6-9278-3adc11f0fcef tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:09.942815 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a28f0372-86c5-40e6-9278-3adc11f0fcef tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:09.944459 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a28f0372-86c5-40e6-9278-3adc11f0fcef tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:09.945068 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a28f0372-86c5-40e6-9278-3adc11f0fcef tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:10.111894 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-175d6628-9dd9-483e-b219-335dd8e65f42 tempest-KeyPairsNegativeTestJSON-972944477 tempest-KeyPairsNegativeTestJSON-972944477-project] Action: 'create', calling method: .version_select at 0x7f0b478e6af0>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJKr0v84+VABnQjTqLUanBYoKIvPhS25hPygHzHRCO9onWQLFj5dOUnium1iZdsZDO60XsGQNNSEw0wfY4zL1DGNbuLPGq1uxtxHRQcItwaK/AW0ZEYdFYKRmK3z4aIN1g=="}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:24:10.126789 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-175d6628-9dd9-483e-b219-335dd8e65f42 tempest-KeyPairsNegativeTestJSON-972944477 tempest-KeyPairsNegativeTestJSON-972944477-project] HTTP exception thrown: Keypair data is invalid: Keypair name contains unsafe characters Jul 23 21:24:10.135231 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-175d6628-9dd9-483e-b219-335dd8e65f42 tempest-KeyPairsNegativeTestJSON-972944477 tempest-KeyPairsNegativeTestJSON-972944477-project] Request method failure captured: Jul 23 21:24:10.135231 ncdv-master-1 devstack@n-api.service[131320]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 23 21:24:10.135231 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:24:10.135231 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:24:10.135231 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:24:10.135231 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 257 Jul 23 21:24:10.135231 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:24:10.135231 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:24:10.135231 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:24:10.135231 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:24:10.135231 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3Gb5K79x6BLLyr1BlxrGcaVwbDCWSCclki18rkMFISsowp-65fnZMU1RiK_5KZWQLQosqndmsmk63vTsaScoypy9lZYL-WPrrTMUzv5BjN5o-0QN8_-OgZb0KNR060cFuvXdPxqOlGYMQKuhw2GlMqKIu7clR385OboxuJunWsRhetM Jul 23 21:24:10.135231 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:24:10.135231 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:24:10.135231 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:24:10.135231 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:24:10.135231 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:24:10.135231 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:24:10.135231 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: e009045b8f044e818c4a3cb8d72d9dbc Jul 23 21:24:10.135231 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-972944477 Jul 23 21:24:10.135231 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:24:10.135231 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:24:10.135231 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e009045b8f044e818c4a3cb8d72d9dbc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e009045b8f044e818c4a3cb8d72d9dbc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e009045b8f044e818c4a3cb8d72d9dbc", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e009045b8f044e818c4a3cb8d72d9dbc"}]}] Jul 23 21:24:10.135231 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-KeyPairsNegativeTestJSON-972944477 Jul 23 21:24:10.135231 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: e009045b8f044e818c4a3cb8d72d9dbc Jul 23 21:24:10.135231 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-972944477 Jul 23 21:24:10.135231 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-KeyPairsNegativeTestJSON-972944477-project Jul 23 21:24:10.135231 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:24:10.135231 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:24:10.135231 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 240206b0a6934c64aee715559ce134bd Jul 23 21:24:10.135231 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-KeyPairsNegativeTestJSON-972944477-project Jul 23 21:24:10.135231 ncdv-master-1 devstack@n-api.service[131320]: Jul 23 21:24:10.135231 ncdv-master-1 devstack@n-api.service[131320]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJKr0v84+VABnQjTqLUanBYoKIvPhS25hPygHzHRCO9onWQLFj5dOUnium1iZdsZDO60XsGQNNSEw0wfY4zL1DGNbuLPGq1uxtxHRQcItwaK/AW0ZEYdFYKRmK3z4aIN1g=="}} Jul 23 21:24:10.135231 ncdv-master-1 devstack@n-api.service[131320]: method: Jul 23 21:24:10.135231 ncdv-master-1 devstack@n-api.service[131320]: exception: Keypair data is invalid: Keypair name contains unsafe characters Jul 23 21:24:10.135231 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJKr0v84+VABnQjTqLUanBYoKIvPhS25hPygHzHRCO9onWQLFj5dOUnium1iZdsZDO60XsGQNNSEw0wfY4zL1DGNbuLPGq1uxtxHRQcItwaK/AW0ZEYdFYKRmK3z4aIN1g=='}}} Jul 23 21:24:10.135231 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:24:10.135231 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:24:10.135231 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 23 21:24:10.135231 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 23 21:24:10.135231 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 23 21:24:10.135231 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 23 21:24:10.135231 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 23 21:24:10.135231 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 23 21:24:10.135231 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 23 21:24:10.135231 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise self.value Jul 23 21:24:10.135231 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 23 21:24:10.135231 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 23 21:24:10.135231 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in import_key_pair Jul 23 21:24:10.135231 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self._validate_new_key_pair(context, user_id, key_name, key_type) Jul 23 21:24:10.135231 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6619, in _validate_new_key_pair Jul 23 21:24:10.135231 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 23 21:24:10.135231 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: Keypair name contains unsafe characters Jul 23 21:24:10.135231 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:24:10.135231 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:24:10.135231 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:24:10.135231 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:24:10.135231 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:24:10.135231 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:24:10.135231 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:24:10.135231 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:24:10.135231 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:24:10.135231 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:24:10.138930 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:24:10.138930 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:24:10.138930 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:24:10.138930 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:24:10.138930 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:24:10.138930 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:24:10.138930 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 23 21:24:10.138930 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 23 21:24:10.138930 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 23 21:24:10.138930 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 23 21:24:10.138930 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: Keypair name contains unsafe characters Jul 23 21:24:10.138930 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:24:10.138930 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:24:10.138930 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:24:10.138930 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:24:10.138930 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:24:10.138930 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:24:10.138930 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:24:10.138930 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:24:10.138930 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: Keypair name contains unsafe characters Jul 23 21:24:10.138930 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:24:10.143414 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-175d6628-9dd9-483e-b219-335dd8e65f42 tempest-KeyPairsNegativeTestJSON-972944477 tempest-KeyPairsNegativeTestJSON-972944477-project] Returning 400 to user: Keypair data is invalid: Keypair name contains unsafe characters {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:24:10.147369 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-175d6628-9dd9-483e-b219-335dd8e65f42 tempest-KeyPairsNegativeTestJSON-972944477 tempest-KeyPairsNegativeTestJSON-972944477-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.283046 Jul 23 21:24:10.151291 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1264/2565] 10.222.0.17 () {60 vars in 1158 bytes} [Sat Jul 23 21:24:09 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 288 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 23 21:24:10.164786 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ade08cc8-b57f-4710-866b-2a63a9d580e1 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:10.165766 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ade08cc8-b57f-4710-866b-2a63a9d580e1 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] [instance: c73f1c6e-9c56-453d-89bf-b9e24f360f33] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:10.176018 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ade08cc8-b57f-4710-866b-2a63a9d580e1 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:10.177013 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ade08cc8-b57f-4710-866b-2a63a9d580e1 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:10.178796 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ade08cc8-b57f-4710-866b-2a63a9d580e1 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:10.179704 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ade08cc8-b57f-4710-866b-2a63a9d580e1 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:10.206809 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-ade08cc8-b57f-4710-866b-2a63a9d580e1 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] HTTP exception thrown: Instance c73f1c6e-9c56-453d-89bf-b9e24f360f33 could not be found. Jul 23 21:24:10.209345 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ade08cc8-b57f-4710-866b-2a63a9d580e1 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Request method failure captured: Jul 23 21:24:10.209345 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/c73f1c6e-9c56-453d-89bf-b9e24f360f33 HTTP/1.1 Jul 23 21:24:10.209345 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:24:10.209345 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:24:10.209345 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:24:10.209345 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:24:10.209345 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:24:10.209345 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:24:10.209345 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:24:10.209345 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:24:10.209345 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GbhfeinMQk43e3WqP7q9xznq59RoOD2N9f6Fy1kaGenABNo6TIIi5E95KTMjSx9MWz4NvGJpv3_JzYUG7MviC-_pAkZVJPmesintvIqmbY_PppRR34REkUEEFE9PEsOIHN6GH-F7EKKuOESAoRDLhk7Ti5leZk4ccrsL4FqFAyL5uw Jul 23 21:24:10.209345 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:24:10.209345 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:24:10.209345 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:24:10.209345 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:24:10.209345 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:24:10.209345 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:24:10.209345 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: a14294b18c6e4936b1272a57d4faccce Jul 23 21:24:10.209345 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-586135632 Jul 23 21:24:10.209345 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:24:10.209345 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:24:10.209345 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a14294b18c6e4936b1272a57d4faccce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a14294b18c6e4936b1272a57d4faccce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a14294b18c6e4936b1272a57d4faccce", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a14294b18c6e4936b1272a57d4faccce"}]}] Jul 23 21:24:10.209345 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-586135632 Jul 23 21:24:10.209345 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: a14294b18c6e4936b1272a57d4faccce Jul 23 21:24:10.209345 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-586135632 Jul 23 21:24:10.209345 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServerAddressesNegativeTestJSON-586135632-project Jul 23 21:24:10.209345 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:24:10.209345 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:24:10.209345 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 7a812b6571db40a1a2f138dc03d4e1be Jul 23 21:24:10.209345 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-586135632-project Jul 23 21:24:10.209345 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:24:10.209345 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance c73f1c6e-9c56-453d-89bf-b9e24f360f33 could not be found. Jul 23 21:24:10.209345 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': 'c73f1c6e-9c56-453d-89bf-b9e24f360f33'} Jul 23 21:24:10.209345 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:24:10.209345 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:24:10.209345 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:24:10.209345 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:24:10.209345 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:24:10.209345 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:24:10.209345 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:24:10.209345 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:24:10.209345 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:24:10.209345 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:24:10.209345 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c73f1c6e-9c56-453d-89bf-b9e24f360f33 could not be found. Jul 23 21:24:10.209345 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:24:10.209345 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:24:10.209345 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:24:10.209345 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:24:10.209345 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:24:10.209345 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:24:10.209345 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:24:10.209345 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:24:10.209345 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:24:10.209345 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:24:10.209345 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:24:10.209345 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:24:10.209345 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:24:10.209345 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:24:10.209345 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:24:10.209345 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:24:10.209345 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c73f1c6e-9c56-453d-89bf-b9e24f360f33 could not be found. Jul 23 21:24:10.209345 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:24:10.209345 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:24:10.214767 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:24:10.214767 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:24:10.214767 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:24:10.214767 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:24:10.214767 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:24:10.214767 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:24:10.214767 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c73f1c6e-9c56-453d-89bf-b9e24f360f33 could not be found. Jul 23 21:24:10.214767 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:24:10.217725 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ade08cc8-b57f-4710-866b-2a63a9d580e1 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] Returning 404 to user: Instance c73f1c6e-9c56-453d-89bf-b9e24f360f33 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:24:10.219533 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ade08cc8-b57f-4710-866b-2a63a9d580e1 tempest-ServerAddressesNegativeTestJSON-586135632 tempest-ServerAddressesNegativeTestJSON-586135632-project] 10.222.0.17 "GET /compute/v2.1/servers/c73f1c6e-9c56-453d-89bf-b9e24f360f33" status: 404 len: 111 microversion: 2.1 time: 0.065959 Jul 23 21:24:10.220551 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1265/2566] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:10 2022] GET /compute/v2.1/servers/c73f1c6e-9c56-453d-89bf-b9e24f360f33 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:24:10.267782 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-a28f0372-86c5-40e6-9278-3adc11f0fcef tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfb831babfd456e9cd186bab2ca14bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37510f38df0a45a6bb7771bdb0fbe271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:10.285031 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-a28f0372-86c5-40e6-9278-3adc11f0fcef tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] 10.222.0.17 "GET /compute/v2.1/servers/461367a0-c929-4951-98f4-d5194ae688f3" status: 200 len: 1313 microversion: 2.1 time: 0.373944 Jul 23 21:24:10.286940 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1302/2567] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:09 2022] GET /compute/v2.1/servers/461367a0-c929-4951-98f4-d5194ae688f3 => generated 1313 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:24:10.299588 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f585688c-e803-47e5-99fc-03c49918047d tempest-KeyPairsNegativeTestJSON-972944477 tempest-KeyPairsNegativeTestJSON-972944477-project] Action: 'create', calling method: .version_select at 0x7f0b59aa9430>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-901251388", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:24:10.343118 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-f585688c-e803-47e5-99fc-03c49918047d tempest-KeyPairsNegativeTestJSON-972944477 tempest-KeyPairsNegativeTestJSON-972944477-project] Getting quotas for project e009045b8f044e818c4a3cb8d72d9dbc. Resources: {'key_pairs'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:24:10.361635 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-f585688c-e803-47e5-99fc-03c49918047d tempest-KeyPairsNegativeTestJSON-972944477 tempest-KeyPairsNegativeTestJSON-972944477-project] Getting quotas for user 240206b0a6934c64aee715559ce134bd and project e009045b8f044e818c4a3cb8d72d9dbc. Resources: {'key_pairs'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:24:10.391582 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-29fb2051-7d9b-43b8-ac48-a8ae6882ad80 req-8513e9e0-0c77-4384-b525-3041192f445e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "461367a0-c929-4951-98f4-d5194ae688f3", "tag": "12250d34-c0e9-47d6-acd5-3c062cf5a19a"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:24:10.403103 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-29fb2051-7d9b-43b8-ac48-a8ae6882ad80 req-8513e9e0-0c77-4384-b525-3041192f445e service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:10.404196 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-29fb2051-7d9b-43b8-ac48-a8ae6882ad80 req-8513e9e0-0c77-4384-b525-3041192f445e service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:10.412618 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-f585688c-e803-47e5-99fc-03c49918047d tempest-KeyPairsNegativeTestJSON-972944477 tempest-KeyPairsNegativeTestJSON-972944477-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jul 23 21:24:10.426200 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-29fb2051-7d9b-43b8-ac48-a8ae6882ad80 req-8513e9e0-0c77-4384-b525-3041192f445e service nova] Creating event network-changed:12250d34-c0e9-47d6-acd5-3c062cf5a19a for instance 461367a0-c929-4951-98f4-d5194ae688f3 on nch2-master-1 Jul 23 21:24:10.432658 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-29fb2051-7d9b-43b8-ac48-a8ae6882ad80 req-8513e9e0-0c77-4384-b525-3041192f445e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.210380 Jul 23 21:24:10.432884 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f585688c-e803-47e5-99fc-03c49918047d tempest-KeyPairsNegativeTestJSON-972944477 tempest-KeyPairsNegativeTestJSON-972944477-project] Request method failure captured: Jul 23 21:24:10.432884 ncdv-master-1 devstack@n-api.service[131321]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 23 21:24:10.432884 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:24:10.432884 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:24:10.432884 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:24:10.432884 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 2166 Jul 23 21:24:10.432884 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:24:10.432884 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:24:10.432884 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:24:10.432884 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:24:10.432884 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3Gb5K79x6BLLyr1BlxrGcaVwbDCWSCclki18rkMFISsowp-65fnZMU1RiK_5KZWQLQosqndmsmk63vTsaScoypy9lZYL-WPrrTMUzv5BjN5o-0QN8_-OgZb0KNR060cFuvXdPxqOlGYMQKuhw2GlMqKIu7clR385OboxuJunWsRhetM Jul 23 21:24:10.432884 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:24:10.432884 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:24:10.432884 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:24:10.432884 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:24:10.432884 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:24:10.432884 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:24:10.432884 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: e009045b8f044e818c4a3cb8d72d9dbc Jul 23 21:24:10.432884 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-972944477 Jul 23 21:24:10.432884 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:24:10.432884 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:24:10.432884 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e009045b8f044e818c4a3cb8d72d9dbc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e009045b8f044e818c4a3cb8d72d9dbc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e009045b8f044e818c4a3cb8d72d9dbc", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e009045b8f044e818c4a3cb8d72d9dbc"}]}] Jul 23 21:24:10.432884 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-KeyPairsNegativeTestJSON-972944477 Jul 23 21:24:10.432884 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: e009045b8f044e818c4a3cb8d72d9dbc Jul 23 21:24:10.432884 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-972944477 Jul 23 21:24:10.432884 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-KeyPairsNegativeTestJSON-972944477-project Jul 23 21:24:10.432884 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:24:10.432884 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:24:10.432884 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 240206b0a6934c64aee715559ce134bd Jul 23 21:24:10.432884 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-KeyPairsNegativeTestJSON-972944477-project Jul 23 21:24:10.432884 ncdv-master-1 devstack@n-api.service[131321]: Jul 23 21:24:10.432884 ncdv-master-1 devstack@n-api.service[131321]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-901251388", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Jul 23 21:24:10.432884 ncdv-master-1 devstack@n-api.service[131321]: method: Jul 23 21:24:10.432884 ncdv-master-1 devstack@n-api.service[131321]: exception: Keypair data is invalid: failed to generate fingerprint Jul 23 21:24:10.434936 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-901251388', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Jul 23 21:24:10.434936 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:24:10.434936 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:24:10.434936 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jul 23 21:24:10.434936 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jul 23 21:24:10.434936 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Jul 23 21:24:10.434936 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Jul 23 21:24:10.434936 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Jul 23 21:24:10.434936 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:24:10.434936 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:24:10.434936 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:24:10.434936 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:24:10.434936 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 23 21:24:10.434936 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 23 21:24:10.434936 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 23 21:24:10.434936 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 23 21:24:10.434936 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 23 21:24:10.434936 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 23 21:24:10.434936 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 23 21:24:10.434936 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise self.value Jul 23 21:24:10.434936 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 23 21:24:10.434936 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 23 21:24:10.434936 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair Jul 23 21:24:10.434936 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jul 23 21:24:10.434936 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint Jul 23 21:24:10.434936 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jul 23 21:24:10.434936 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jul 23 21:24:10.434936 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 23 21:24:10.434936 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jul 23 21:24:10.434936 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:24:10.434936 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:24:10.434936 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:24:10.434936 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:24:10.434936 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:24:10.434936 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:24:10.434936 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:24:10.434936 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:24:10.434936 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:24:10.434936 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:24:10.434936 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:24:10.434936 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:24:10.437374 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:24:10.437374 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:24:10.437374 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:24:10.437374 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:24:10.437374 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 23 21:24:10.437374 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 23 21:24:10.437374 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 23 21:24:10.437374 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 23 21:24:10.437374 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jul 23 21:24:10.437374 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:24:10.437374 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:24:10.437374 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:24:10.437374 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:24:10.437374 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:24:10.437374 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:24:10.437374 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:24:10.437374 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:24:10.437374 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jul 23 21:24:10.437374 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:24:10.437374 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f585688c-e803-47e5-99fc-03c49918047d tempest-KeyPairsNegativeTestJSON-972944477 tempest-KeyPairsNegativeTestJSON-972944477-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:24:10.437374 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-f585688c-e803-47e5-99fc-03c49918047d tempest-KeyPairsNegativeTestJSON-972944477 tempest-KeyPairsNegativeTestJSON-972944477-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.144428 Jul 23 21:24:10.437374 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1303/2568] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Jul 23 21:24:10 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 147 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 23 21:24:10.441961 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1266/2569] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:24:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:24:10.447352 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-49ecf446-bb98-45fd-ab49-8a2fde27f8ec tempest-KeyPairsNegativeTestJSON-972944477 tempest-KeyPairsNegativeTestJSON-972944477-project] Action: 'create', calling method: .version_select at 0x7f0b4739f9d0>, body: {"keypair": {"name": "tempest-keypair-163940469", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF6499J6L/A7pYgWuHMAVvmWUQYgLFPDl9N0wH0Xv+upaPqPsM/o9AKLRVIM1jSwhGgKgbNYMICOAAlHsNN+A/8SttzbaUfjl2JiTEfFnhpRT3CkDn8dJ1E3+YvUcQVobA=="}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:24:10.481803 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-49ecf446-bb98-45fd-ab49-8a2fde27f8ec tempest-KeyPairsNegativeTestJSON-972944477 tempest-KeyPairsNegativeTestJSON-972944477-project] Getting quotas for project e009045b8f044e818c4a3cb8d72d9dbc. Resources: {'key_pairs'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:24:10.493676 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-49ecf446-bb98-45fd-ab49-8a2fde27f8ec tempest-KeyPairsNegativeTestJSON-972944477 tempest-KeyPairsNegativeTestJSON-972944477-project] Getting quotas for user 240206b0a6934c64aee715559ce134bd and project e009045b8f044e818c4a3cb8d72d9dbc. Resources: {'key_pairs'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:24:10.566749 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-49ecf446-bb98-45fd-ab49-8a2fde27f8ec tempest-KeyPairsNegativeTestJSON-972944477 tempest-KeyPairsNegativeTestJSON-972944477-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.123120 Jul 23 21:24:10.568228 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1304/2570] 10.222.0.17 () {60 vars in 1158 bytes} [Sat Jul 23 21:24:10 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:24:10.581776 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f52b3cf5-c77d-4800-bf22-37822b464fa3 tempest-KeyPairsNegativeTestJSON-972944477 tempest-KeyPairsNegativeTestJSON-972944477-project] Action: 'create', calling method: .version_select at 0x7f0b478e6040>, body: {"keypair": {"name": "tempest-keypair-163940469", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2hoSWM+xqzssk8TdPxWgE98j5j+PXfBVNMRtmMXgSrA5+fOeY5bzRBl1gn26gGIvZf2Fn03oPVIsfNlppgGmmg+QBT9WdGixV+xBzUDru3aSbWVn5I5yDzOI+zj0HM4g=="}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:24:10.602321 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-f52b3cf5-c77d-4800-bf22-37822b464fa3 tempest-KeyPairsNegativeTestJSON-972944477 tempest-KeyPairsNegativeTestJSON-972944477-project] Getting quotas for project e009045b8f044e818c4a3cb8d72d9dbc. Resources: {'key_pairs'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:24:10.621480 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-f52b3cf5-c77d-4800-bf22-37822b464fa3 tempest-KeyPairsNegativeTestJSON-972944477 tempest-KeyPairsNegativeTestJSON-972944477-project] Getting quotas for user 240206b0a6934c64aee715559ce134bd and project e009045b8f044e818c4a3cb8d72d9dbc. Resources: {'key_pairs'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:24:10.664954 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-f52b3cf5-c77d-4800-bf22-37822b464fa3 tempest-KeyPairsNegativeTestJSON-972944477 tempest-KeyPairsNegativeTestJSON-972944477-project] HTTP exception thrown: Key pair 'tempest-keypair-163940469' already exists. Jul 23 21:24:10.671770 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f52b3cf5-c77d-4800-bf22-37822b464fa3 tempest-KeyPairsNegativeTestJSON-972944477 tempest-KeyPairsNegativeTestJSON-972944477-project] Request method failure captured: Jul 23 21:24:10.671770 ncdv-master-1 devstack@n-api.service[131320]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 23 21:24:10.671770 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:24:10.671770 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:24:10.671770 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:24:10.671770 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 272 Jul 23 21:24:10.671770 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:24:10.671770 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:24:10.671770 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:24:10.671770 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:24:10.671770 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3Gb5K79x6BLLyr1BlxrGcaVwbDCWSCclki18rkMFISsowp-65fnZMU1RiK_5KZWQLQosqndmsmk63vTsaScoypy9lZYL-WPrrTMUzv5BjN5o-0QN8_-OgZb0KNR060cFuvXdPxqOlGYMQKuhw2GlMqKIu7clR385OboxuJunWsRhetM Jul 23 21:24:10.671770 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:24:10.671770 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:24:10.671770 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:24:10.671770 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:24:10.671770 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:24:10.671770 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:24:10.671770 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: e009045b8f044e818c4a3cb8d72d9dbc Jul 23 21:24:10.671770 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-972944477 Jul 23 21:24:10.671770 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:24:10.671770 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:24:10.671770 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e009045b8f044e818c4a3cb8d72d9dbc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e009045b8f044e818c4a3cb8d72d9dbc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e009045b8f044e818c4a3cb8d72d9dbc", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e009045b8f044e818c4a3cb8d72d9dbc"}]}] Jul 23 21:24:10.671770 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-KeyPairsNegativeTestJSON-972944477 Jul 23 21:24:10.671770 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: e009045b8f044e818c4a3cb8d72d9dbc Jul 23 21:24:10.671770 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-972944477 Jul 23 21:24:10.671770 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-KeyPairsNegativeTestJSON-972944477-project Jul 23 21:24:10.671770 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:24:10.671770 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:24:10.671770 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 240206b0a6934c64aee715559ce134bd Jul 23 21:24:10.671770 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-KeyPairsNegativeTestJSON-972944477-project Jul 23 21:24:10.671770 ncdv-master-1 devstack@n-api.service[131320]: Jul 23 21:24:10.671770 ncdv-master-1 devstack@n-api.service[131320]: {"keypair": {"name": "tempest-keypair-163940469", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2hoSWM+xqzssk8TdPxWgE98j5j+PXfBVNMRtmMXgSrA5+fOeY5bzRBl1gn26gGIvZf2Fn03oPVIsfNlppgGmmg+QBT9WdGixV+xBzUDru3aSbWVn5I5yDzOI+zj0HM4g=="}} Jul 23 21:24:10.671770 ncdv-master-1 devstack@n-api.service[131320]: method: Jul 23 21:24:10.671770 ncdv-master-1 devstack@n-api.service[131320]: exception: Key pair 'tempest-keypair-163940469' already exists. Jul 23 21:24:10.671770 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-163940469', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2hoSWM+xqzssk8TdPxWgE98j5j+PXfBVNMRtmMXgSrA5+fOeY5bzRBl1gn26gGIvZf2Fn03oPVIsfNlppgGmmg+QBT9WdGixV+xBzUDru3aSbWVn5I5yDzOI+zj0HM4g=='}}} Jul 23 21:24:10.671770 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:24:10.671770 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:24:10.671770 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 23 21:24:10.671770 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 23 21:24:10.671770 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 23 21:24:10.671770 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 23 21:24:10.671770 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 23 21:24:10.671770 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 23 21:24:10.671770 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 23 21:24:10.671770 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 23 21:24:10.671770 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 23 21:24:10.671770 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 23 21:24:10.671770 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 23 21:24:10.671770 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi result.read() Jul 23 21:24:10.671770 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 23 21:24:10.671770 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 23 21:24:10.671770 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 23 21:24:10.671770 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 23 21:24:10.671770 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 23 21:24:10.671770 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 23 21:24:10.671770 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 23 21:24:10.671770 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 23 21:24:10.671770 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '240206b0a6934c64aee715559ce134bd-tempest-keypair-163940469' for key 'key_pairs.uniq_key_pairs0user_id0name'") Jul 23 21:24:10.671770 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:24:10.678960 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 23 21:24:10.678960 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:24:10.678960 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:24:10.678960 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Jul 23 21:24:10.678960 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi kp.save(context.session) Jul 23 21:24:10.678960 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jul 23 21:24:10.678960 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi session.flush() Jul 23 21:24:10.678960 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 23 21:24:10.678960 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self._flush(objects) Jul 23 21:24:10.678960 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 23 21:24:10.678960 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jul 23 21:24:10.678960 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 23 21:24:10.678960 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi compat.raise_( Jul 23 21:24:10.678960 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 23 21:24:10.678960 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception Jul 23 21:24:10.678960 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 23 21:24:10.678960 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi flush_context.execute() Jul 23 21:24:10.678960 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 23 21:24:10.678960 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi rec.execute(self) Jul 23 21:24:10.678960 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 23 21:24:10.678960 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jul 23 21:24:10.678960 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 23 21:24:10.678960 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jul 23 21:24:10.678960 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 23 21:24:10.678960 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jul 23 21:24:10.678960 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 23 21:24:10.678960 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jul 23 21:24:10.678960 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 23 21:24:10.678960 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jul 23 21:24:10.678960 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 23 21:24:10.678960 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jul 23 21:24:10.678960 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 23 21:24:10.678960 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jul 23 21:24:10.678960 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 23 21:24:10.678960 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 23 21:24:10.678960 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 23 21:24:10.678960 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception Jul 23 21:24:10.678960 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 23 21:24:10.678960 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 23 21:24:10.678960 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 23 21:24:10.678960 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 23 21:24:10.678960 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 23 21:24:10.678960 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 23 21:24:10.678960 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 23 21:24:10.678960 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 23 21:24:10.678960 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 23 21:24:10.678960 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 23 21:24:10.678960 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 23 21:24:10.678960 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi result.read() Jul 23 21:24:10.678960 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 23 21:24:10.678960 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 23 21:24:10.678960 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 23 21:24:10.678960 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 23 21:24:10.678960 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 23 21:24:10.678960 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 23 21:24:10.678960 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 23 21:24:10.685887 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 23 21:24:10.685887 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '240206b0a6934c64aee715559ce134bd-tempest-keypair-163940469' for key 'key_pairs.uniq_key_pairs0user_id0name'") Jul 23 21:24:10.685887 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Jul 23 21:24:10.685887 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 7, 23, 21, 24, 10, 651445), 'updated_at': None, 'name': 'tempest-keypair-163940469', 'user_id': '240206b0a6934c64aee715559ce134bd', 'fingerprint': '9e:08:83:6a:f9:40:fb:2d:7d:f0:db:2e:05:05:0f:e7', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2hoSWM+xqzssk8TdPxWgE98j5j+PXfBVNMRtmMXgSrA5+fOeY5bzRBl1gn26gGIvZf2Fn03oPVIsfNlppgGmmg+QBT9WdGixV+xBzUDru3aSbWVn5I5yDzOI+zj0HM4g==', 'type': 'ssh'}] Jul 23 21:24:10.685887 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 23 21:24:10.685887 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:24:10.685887 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:24:10.685887 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:24:10.685887 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:24:10.685887 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 23 21:24:10.685887 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 23 21:24:10.685887 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 23 21:24:10.685887 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 23 21:24:10.685887 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 23 21:24:10.685887 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 23 21:24:10.685887 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 23 21:24:10.685887 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise self.value Jul 23 21:24:10.685887 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 23 21:24:10.685887 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 23 21:24:10.685887 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6661, in import_key_pair Jul 23 21:24:10.685887 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi keypair.create() Jul 23 21:24:10.685887 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 23 21:24:10.685887 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 23 21:24:10.685887 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Jul 23 21:24:10.685887 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self._create() Jul 23 21:24:10.685887 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Jul 23 21:24:10.685887 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Jul 23 21:24:10.685887 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Jul 23 21:24:10.685887 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Jul 23 21:24:10.685887 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 23 21:24:10.685887 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 23 21:24:10.685887 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Jul 23 21:24:10.685887 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Jul 23 21:24:10.685887 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-163940469' already exists. Jul 23 21:24:10.685887 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:24:10.685887 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:24:10.685887 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:24:10.685887 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:24:10.685887 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:24:10.685887 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:24:10.685887 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:24:10.685887 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:24:10.685887 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:24:10.685887 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:24:10.685887 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:24:10.685887 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:24:10.685887 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:24:10.685887 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:24:10.685887 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:24:10.685887 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:24:10.685887 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 23 21:24:10.685887 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 23 21:24:10.685887 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 126, in _create Jul 23 21:24:10.685887 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Jul 23 21:24:10.685887 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-163940469' already exists. Jul 23 21:24:10.692171 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:24:10.692171 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:24:10.692171 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:24:10.692171 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:24:10.692171 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:24:10.692171 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:24:10.692171 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:24:10.692171 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:24:10.692171 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-163940469' already exists. Jul 23 21:24:10.692171 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:24:10.692171 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f52b3cf5-c77d-4800-bf22-37822b464fa3 tempest-KeyPairsNegativeTestJSON-972944477 tempest-KeyPairsNegativeTestJSON-972944477-project] Returning 409 to user: Key pair 'tempest-keypair-163940469' already exists. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:24:10.692171 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f52b3cf5-c77d-4800-bf22-37822b464fa3 tempest-KeyPairsNegativeTestJSON-972944477 tempest-KeyPairsNegativeTestJSON-972944477-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 409 len: 104 microversion: 2.1 time: 0.096622 Jul 23 21:24:10.692171 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1267/2571] 10.222.0.17 () {60 vars in 1158 bytes} [Sat Jul 23 21:24:10 2022] POST /compute/v2.1/os-keypairs => generated 104 bytes in 101 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 23 21:24:10.700090 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a7a2ec55-ad7e-4080-9ac0-f86847922b9a tempest-KeyPairsNegativeTestJSON-972944477 tempest-KeyPairsNegativeTestJSON-972944477-project] Calling method '.version_select at 0x7f0b4760ba60>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:10.724619 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-a7a2ec55-ad7e-4080-9ac0-f86847922b9a tempest-KeyPairsNegativeTestJSON-972944477 tempest-KeyPairsNegativeTestJSON-972944477-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-163940469" status: 202 len: 0 microversion: 2.1 time: 0.036066 Jul 23 21:24:10.726251 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1305/2572] 10.222.0.17 () {58 vars in 1217 bytes} [Sat Jul 23 21:24:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-163940469 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:24:10.745428 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ae84278d-6f82-44b7-95d7-a28115248486 tempest-KeyPairsNegativeTestJSON-972944477 tempest-KeyPairsNegativeTestJSON-972944477-project] Action: 'create', calling method: .version_select at 0x7f0b59979280>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCZq2bYMmAIpSYPXAUjkH8G2fPnR5BO5oFyV/861GJ/XfEHZMFWW4okGE1YzhNbO7/HNqQtgoH9s7HqIwOYMO0lavXOHhTVj2roykrnC11IqjeyPw4289Hywozl5yiCmTQ=="}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:24:10.749017 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ae84278d-6f82-44b7-95d7-a28115248486 tempest-KeyPairsNegativeTestJSON-972944477 tempest-KeyPairsNegativeTestJSON-972944477-project] Request method failure captured: Jul 23 21:24:10.749017 ncdv-master-1 devstack@n-api.service[131320]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 23 21:24:10.749017 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:24:10.749017 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:24:10.749017 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:24:10.749017 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 247 Jul 23 21:24:10.749017 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:24:10.749017 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:24:10.749017 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:24:10.749017 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:24:10.749017 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3Gb5K79x6BLLyr1BlxrGcaVwbDCWSCclki18rkMFISsowp-65fnZMU1RiK_5KZWQLQosqndmsmk63vTsaScoypy9lZYL-WPrrTMUzv5BjN5o-0QN8_-OgZb0KNR060cFuvXdPxqOlGYMQKuhw2GlMqKIu7clR385OboxuJunWsRhetM Jul 23 21:24:10.749017 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:24:10.749017 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:24:10.749017 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:24:10.749017 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:24:10.749017 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:24:10.749017 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:24:10.749017 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: e009045b8f044e818c4a3cb8d72d9dbc Jul 23 21:24:10.749017 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-972944477 Jul 23 21:24:10.749017 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:24:10.749017 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:24:10.749017 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e009045b8f044e818c4a3cb8d72d9dbc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e009045b8f044e818c4a3cb8d72d9dbc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e009045b8f044e818c4a3cb8d72d9dbc", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e009045b8f044e818c4a3cb8d72d9dbc"}]}] Jul 23 21:24:10.749017 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-KeyPairsNegativeTestJSON-972944477 Jul 23 21:24:10.749017 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: e009045b8f044e818c4a3cb8d72d9dbc Jul 23 21:24:10.749017 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-972944477 Jul 23 21:24:10.749017 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-KeyPairsNegativeTestJSON-972944477-project Jul 23 21:24:10.749017 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:24:10.749017 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:24:10.749017 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 240206b0a6934c64aee715559ce134bd Jul 23 21:24:10.749017 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-KeyPairsNegativeTestJSON-972944477-project Jul 23 21:24:10.749017 ncdv-master-1 devstack@n-api.service[131320]: Jul 23 21:24:10.749017 ncdv-master-1 devstack@n-api.service[131320]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCZq2bYMmAIpSYPXAUjkH8G2fPnR5BO5oFyV/861GJ/XfEHZMFWW4okGE1YzhNbO7/HNqQtgoH9s7HqIwOYMO0lavXOHhTVj2roykrnC11IqjeyPw4289Hywozl5yiCmTQ=="}} Jul 23 21:24:10.749017 ncdv-master-1 devstack@n-api.service[131320]: method: Jul 23 21:24:10.749017 ncdv-master-1 devstack@n-api.service[131320]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 23 21:24:10.749017 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCZq2bYMmAIpSYPXAUjkH8G2fPnR5BO5oFyV/861GJ/XfEHZMFWW4okGE1YzhNbO7/HNqQtgoH9s7HqIwOYMO0lavXOHhTVj2roykrnC11IqjeyPw4289Hywozl5yiCmTQ=='}}} Jul 23 21:24:10.749017 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:24:10.749017 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:24:10.749017 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 23 21:24:10.749017 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 23 21:24:10.749017 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 23 21:24:10.749017 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise error Jul 23 21:24:10.749017 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 23 21:24:10.749017 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:24:10.749017 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']: Jul 23 21:24:10.749017 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 23 21:24:10.749017 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:24:10.749017 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi On instance['keypair']: Jul 23 21:24:10.749017 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi '' Jul 23 21:24:10.749017 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:24:10.749017 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:24:10.749017 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:24:10.749017 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:24:10.749017 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:24:10.749017 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:24:10.749017 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:24:10.749017 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:24:10.749017 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:24:10.749017 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:24:10.749017 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:24:10.749017 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:24:10.749017 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:24:10.749017 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:24:10.749017 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 23 21:24:10.749017 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 23 21:24:10.756102 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 23 21:24:10.756102 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 23 21:24:10.756102 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 23 21:24:10.756102 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 23 21:24:10.756102 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 23 21:24:10.756102 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:24:10.756102 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:24:10.756102 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:24:10.756102 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:24:10.756102 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:24:10.756102 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:24:10.756102 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 23 21:24:10.756102 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 23 21:24:10.756102 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 23 21:24:10.756102 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:24:10.756102 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ae84278d-6f82-44b7-95d7-a28115248486 tempest-KeyPairsNegativeTestJSON-972944477 tempest-KeyPairsNegativeTestJSON-972944477-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:24:10.756102 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ae84278d-6f82-44b7-95d7-a28115248486 tempest-KeyPairsNegativeTestJSON-972944477 tempest-KeyPairsNegativeTestJSON-972944477-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.015864 Jul 23 21:24:10.756102 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1268/2573] 10.222.0.17 () {60 vars in 1158 bytes} [Sat Jul 23 21:24:10 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 23 21:24:10.763926 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e2c64445-7769-49f8-a1e1-9867c1c90216 tempest-KeyPairsNegativeTestJSON-972944477 tempest-KeyPairsNegativeTestJSON-972944477-project] Action: 'create', calling method: .version_select at 0x7f0b47cf6af0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1419383936", "public_key": " "}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:24:10.794728 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-e2c64445-7769-49f8-a1e1-9867c1c90216 tempest-KeyPairsNegativeTestJSON-972944477 tempest-KeyPairsNegativeTestJSON-972944477-project] Getting quotas for project e009045b8f044e818c4a3cb8d72d9dbc. Resources: {'key_pairs'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:24:10.803884 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-e2c64445-7769-49f8-a1e1-9867c1c90216 tempest-KeyPairsNegativeTestJSON-972944477 tempest-KeyPairsNegativeTestJSON-972944477-project] Getting quotas for user 240206b0a6934c64aee715559ce134bd and project e009045b8f044e818c4a3cb8d72d9dbc. Resources: {'key_pairs'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:24:10.871378 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-e2c64445-7769-49f8-a1e1-9867c1c90216 tempest-KeyPairsNegativeTestJSON-972944477 tempest-KeyPairsNegativeTestJSON-972944477-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jul 23 21:24:10.874360 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e2c64445-7769-49f8-a1e1-9867c1c90216 tempest-KeyPairsNegativeTestJSON-972944477 tempest-KeyPairsNegativeTestJSON-972944477-project] Request method failure captured: Jul 23 21:24:10.874360 ncdv-master-1 devstack@n-api.service[131321]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 23 21:24:10.874360 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:24:10.874360 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:24:10.874360 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:24:10.874360 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 95 Jul 23 21:24:10.874360 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:24:10.874360 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:24:10.874360 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:24:10.874360 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:24:10.874360 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3Gb5K79x6BLLyr1BlxrGcaVwbDCWSCclki18rkMFISsowp-65fnZMU1RiK_5KZWQLQosqndmsmk63vTsaScoypy9lZYL-WPrrTMUzv5BjN5o-0QN8_-OgZb0KNR060cFuvXdPxqOlGYMQKuhw2GlMqKIu7clR385OboxuJunWsRhetM Jul 23 21:24:10.874360 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:24:10.874360 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:24:10.874360 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:24:10.874360 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:24:10.874360 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:24:10.874360 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:24:10.874360 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: e009045b8f044e818c4a3cb8d72d9dbc Jul 23 21:24:10.874360 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-972944477 Jul 23 21:24:10.874360 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:24:10.874360 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:24:10.874360 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e009045b8f044e818c4a3cb8d72d9dbc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e009045b8f044e818c4a3cb8d72d9dbc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e009045b8f044e818c4a3cb8d72d9dbc", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e009045b8f044e818c4a3cb8d72d9dbc"}]}] Jul 23 21:24:10.874360 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-KeyPairsNegativeTestJSON-972944477 Jul 23 21:24:10.874360 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: e009045b8f044e818c4a3cb8d72d9dbc Jul 23 21:24:10.874360 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-972944477 Jul 23 21:24:10.874360 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-KeyPairsNegativeTestJSON-972944477-project Jul 23 21:24:10.874360 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:24:10.874360 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:24:10.874360 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 240206b0a6934c64aee715559ce134bd Jul 23 21:24:10.874360 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-KeyPairsNegativeTestJSON-972944477-project Jul 23 21:24:10.874360 ncdv-master-1 devstack@n-api.service[131321]: Jul 23 21:24:10.874360 ncdv-master-1 devstack@n-api.service[131321]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1419383936", "public_key": " "}} Jul 23 21:24:10.874360 ncdv-master-1 devstack@n-api.service[131321]: method: Jul 23 21:24:10.874360 ncdv-master-1 devstack@n-api.service[131321]: exception: Keypair data is invalid: failed to generate fingerprint Jul 23 21:24:10.874360 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1419383936', 'public_key': ' '}}} Jul 23 21:24:10.874360 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:24:10.874360 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:24:10.874360 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jul 23 21:24:10.874360 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jul 23 21:24:10.874360 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Jul 23 21:24:10.874360 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Jul 23 21:24:10.874360 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Jul 23 21:24:10.874360 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:24:10.874360 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:24:10.874360 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:24:10.874360 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:24:10.874360 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 23 21:24:10.874360 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 23 21:24:10.874360 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 23 21:24:10.874360 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 23 21:24:10.874360 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 23 21:24:10.874360 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 23 21:24:10.874360 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 23 21:24:10.874360 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise self.value Jul 23 21:24:10.874360 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 23 21:24:10.874360 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 23 21:24:10.874360 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair Jul 23 21:24:10.874360 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jul 23 21:24:10.874360 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint Jul 23 21:24:10.874360 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jul 23 21:24:10.874360 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jul 23 21:24:10.874360 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 23 21:24:10.874360 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jul 23 21:24:10.874360 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:24:10.874360 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:24:10.874360 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:24:10.874360 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:24:10.878962 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:24:10.878962 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:24:10.878962 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:24:10.878962 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:24:10.878962 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:24:10.878962 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:24:10.878962 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:24:10.878962 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:24:10.878962 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:24:10.878962 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:24:10.878962 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:24:10.878962 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:24:10.878962 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 23 21:24:10.878962 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 23 21:24:10.878962 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 23 21:24:10.878962 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 23 21:24:10.878962 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jul 23 21:24:10.878962 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:24:10.878962 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:24:10.878962 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:24:10.878962 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:24:10.878962 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:24:10.878962 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:24:10.878962 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:24:10.878962 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:24:10.878962 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jul 23 21:24:10.878962 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:24:10.878962 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e2c64445-7769-49f8-a1e1-9867c1c90216 tempest-KeyPairsNegativeTestJSON-972944477 tempest-KeyPairsNegativeTestJSON-972944477-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:24:10.878962 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-e2c64445-7769-49f8-a1e1-9867c1c90216 tempest-KeyPairsNegativeTestJSON-972944477 tempest-KeyPairsNegativeTestJSON-972944477-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.120868 Jul 23 21:24:10.887980 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1306/2574] 10.222.0.17 () {60 vars in 1157 bytes} [Sat Jul 23 21:24:10 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 132 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 23 21:24:10.893798 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0a92096e-50b3-408c-8432-1dbe4edc15b3 tempest-KeyPairsNegativeTestJSON-972944477 tempest-KeyPairsNegativeTestJSON-972944477-project] Action: 'create', calling method: .version_select at 0x7f0b478e60d0>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDivqIYyJrqQuHELCMWGrGT8wPcYLaU+W9D3qfTuVq8kVntieefqZGU174LQmn+yvsDrUWgBhQZ6sCfvhEBcPv6K6KXj9jespyqW4w3YGy1m/RFfVhwAFeQ2X3TNkjhIQQ=="}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:24:10.900690 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0a92096e-50b3-408c-8432-1dbe4edc15b3 tempest-KeyPairsNegativeTestJSON-972944477 tempest-KeyPairsNegativeTestJSON-972944477-project] Request method failure captured: Jul 23 21:24:10.900690 ncdv-master-1 devstack@n-api.service[131320]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 23 21:24:10.900690 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:24:10.900690 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:24:10.900690 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:24:10.900690 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 507 Jul 23 21:24:10.900690 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:24:10.900690 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:24:10.900690 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:24:10.900690 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:24:10.900690 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3Gb5K79x6BLLyr1BlxrGcaVwbDCWSCclki18rkMFISsowp-65fnZMU1RiK_5KZWQLQosqndmsmk63vTsaScoypy9lZYL-WPrrTMUzv5BjN5o-0QN8_-OgZb0KNR060cFuvXdPxqOlGYMQKuhw2GlMqKIu7clR385OboxuJunWsRhetM Jul 23 21:24:10.900690 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:24:10.900690 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:24:10.900690 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:24:10.900690 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:24:10.900690 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:24:10.900690 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:24:10.900690 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: e009045b8f044e818c4a3cb8d72d9dbc Jul 23 21:24:10.900690 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-972944477 Jul 23 21:24:10.900690 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:24:10.900690 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:24:10.900690 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e009045b8f044e818c4a3cb8d72d9dbc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e009045b8f044e818c4a3cb8d72d9dbc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e009045b8f044e818c4a3cb8d72d9dbc", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e009045b8f044e818c4a3cb8d72d9dbc"}]}] Jul 23 21:24:10.900690 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-KeyPairsNegativeTestJSON-972944477 Jul 23 21:24:10.900690 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: e009045b8f044e818c4a3cb8d72d9dbc Jul 23 21:24:10.900690 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-972944477 Jul 23 21:24:10.900690 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-KeyPairsNegativeTestJSON-972944477-project Jul 23 21:24:10.900690 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:24:10.900690 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:24:10.900690 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 240206b0a6934c64aee715559ce134bd Jul 23 21:24:10.900690 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-KeyPairsNegativeTestJSON-972944477-project Jul 23 21:24:10.900690 ncdv-master-1 devstack@n-api.service[131320]: Jul 23 21:24:10.900690 ncdv-master-1 devstack@n-api.service[131320]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDivqIYyJrqQuHELCMWGrGT8wPcYLaU+W9D3qfTuVq8kVntieefqZGU174LQmn+yvsDrUWgBhQZ6sCfvhEBcPv6K6KXj9jespyqW4w3YGy1m/RFfVhwAFeQ2X3TNkjhIQQ=="}} Jul 23 21:24:10.900690 ncdv-master-1 devstack@n-api.service[131320]: method: Jul 23 21:24:10.900690 ncdv-master-1 devstack@n-api.service[131320]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 23 21:24:10.900690 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDivqIYyJrqQuHELCMWGrGT8wPcYLaU+W9D3qfTuVq8kVntieefqZGU174LQmn+yvsDrUWgBhQZ6sCfvhEBcPv6K6KXj9jespyqW4w3YGy1m/RFfVhwAFeQ2X3TNkjhIQQ=='}}} Jul 23 21:24:10.900690 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:24:10.900690 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:24:10.900690 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 23 21:24:10.900690 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 23 21:24:10.900690 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 23 21:24:10.900690 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise error Jul 23 21:24:10.900690 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 23 21:24:10.900690 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:24:10.900690 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']: Jul 23 21:24:10.900690 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 23 21:24:10.900690 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:24:10.900690 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi On instance['keypair']: Jul 23 21:24:10.900690 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Jul 23 21:24:10.900690 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:24:10.904303 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:24:10.904303 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:24:10.904303 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:24:10.904303 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:24:10.904303 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:24:10.904303 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:24:10.904303 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:24:10.904303 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:24:10.904303 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:24:10.904303 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:24:10.904303 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:24:10.904303 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:24:10.904303 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:24:10.904303 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 23 21:24:10.904303 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 23 21:24:10.904303 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 23 21:24:10.904303 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 23 21:24:10.904303 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 23 21:24:10.904303 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 23 21:24:10.904303 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 23 21:24:10.904303 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:24:10.904303 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:24:10.904303 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:24:10.904303 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:24:10.904303 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:24:10.904303 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:24:10.904303 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 23 21:24:10.904303 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 23 21:24:10.904303 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 23 21:24:10.904303 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:24:10.908794 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0a92096e-50b3-408c-8432-1dbe4edc15b3 tempest-KeyPairsNegativeTestJSON-972944477 tempest-KeyPairsNegativeTestJSON-972944477-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:24:10.912301 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-0a92096e-50b3-408c-8432-1dbe4edc15b3 tempest-KeyPairsNegativeTestJSON-972944477 tempest-KeyPairsNegativeTestJSON-972944477-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.023861 Jul 23 21:24:10.914355 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1269/2575] 10.222.0.17 () {60 vars in 1158 bytes} [Sat Jul 23 21:24:10 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 23 21:24:10.926971 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-214f15dc-71cd-4ab1-b208-d3effcbe8111 tempest-KeyPairsNegativeTestJSON-972944477 tempest-KeyPairsNegativeTestJSON-972944477-project] Action: 'create', calling method: .version_select at 0x7f0b59aa99d0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1969742831", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:24:10.944082 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-214f15dc-71cd-4ab1-b208-d3effcbe8111 tempest-KeyPairsNegativeTestJSON-972944477 tempest-KeyPairsNegativeTestJSON-972944477-project] Getting quotas for project e009045b8f044e818c4a3cb8d72d9dbc. Resources: {'key_pairs'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:24:10.951980 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-214f15dc-71cd-4ab1-b208-d3effcbe8111 tempest-KeyPairsNegativeTestJSON-972944477 tempest-KeyPairsNegativeTestJSON-972944477-project] Getting quotas for user 240206b0a6934c64aee715559ce134bd and project e009045b8f044e818c4a3cb8d72d9dbc. Resources: {'key_pairs'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:24:10.970706 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-214f15dc-71cd-4ab1-b208-d3effcbe8111 tempest-KeyPairsNegativeTestJSON-972944477 tempest-KeyPairsNegativeTestJSON-972944477-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jul 23 21:24:10.972776 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-214f15dc-71cd-4ab1-b208-d3effcbe8111 tempest-KeyPairsNegativeTestJSON-972944477 tempest-KeyPairsNegativeTestJSON-972944477-project] Request method failure captured: Jul 23 21:24:10.972776 ncdv-master-1 devstack@n-api.service[131321]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 23 21:24:10.972776 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:24:10.972776 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:24:10.972776 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:24:10.972776 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 118 Jul 23 21:24:10.972776 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:24:10.972776 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:24:10.972776 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:24:10.972776 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:24:10.972776 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3Gb5K79x6BLLyr1BlxrGcaVwbDCWSCclki18rkMFISsowp-65fnZMU1RiK_5KZWQLQosqndmsmk63vTsaScoypy9lZYL-WPrrTMUzv5BjN5o-0QN8_-OgZb0KNR060cFuvXdPxqOlGYMQKuhw2GlMqKIu7clR385OboxuJunWsRhetM Jul 23 21:24:10.972776 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:24:10.972776 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:24:10.972776 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:24:10.972776 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:24:10.972776 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:24:10.972776 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:24:10.972776 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: e009045b8f044e818c4a3cb8d72d9dbc Jul 23 21:24:10.972776 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-972944477 Jul 23 21:24:10.972776 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:24:10.972776 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:24:10.972776 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e009045b8f044e818c4a3cb8d72d9dbc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e009045b8f044e818c4a3cb8d72d9dbc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e009045b8f044e818c4a3cb8d72d9dbc", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e009045b8f044e818c4a3cb8d72d9dbc"}]}] Jul 23 21:24:10.972776 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-KeyPairsNegativeTestJSON-972944477 Jul 23 21:24:10.972776 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: e009045b8f044e818c4a3cb8d72d9dbc Jul 23 21:24:10.972776 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-972944477 Jul 23 21:24:10.972776 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-KeyPairsNegativeTestJSON-972944477-project Jul 23 21:24:10.972776 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:24:10.972776 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:24:10.972776 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 240206b0a6934c64aee715559ce134bd Jul 23 21:24:10.972776 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-KeyPairsNegativeTestJSON-972944477-project Jul 23 21:24:10.972776 ncdv-master-1 devstack@n-api.service[131321]: Jul 23 21:24:10.972776 ncdv-master-1 devstack@n-api.service[131321]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1969742831", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Jul 23 21:24:10.972776 ncdv-master-1 devstack@n-api.service[131321]: method: Jul 23 21:24:10.972776 ncdv-master-1 devstack@n-api.service[131321]: exception: Keypair data is invalid: failed to generate fingerprint Jul 23 21:24:10.972776 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1969742831', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Jul 23 21:24:10.972776 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:24:10.972776 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:24:10.972776 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jul 23 21:24:10.972776 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jul 23 21:24:10.972776 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Jul 23 21:24:10.972776 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Jul 23 21:24:10.972776 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Jul 23 21:24:10.972776 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Jul 23 21:24:10.972776 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Jul 23 21:24:10.972776 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Jul 23 21:24:10.972776 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Jul 23 21:24:10.972776 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:24:10.972776 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:24:10.972776 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:24:10.972776 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:24:10.972776 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 23 21:24:10.972776 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 23 21:24:10.972776 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 23 21:24:10.972776 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 23 21:24:10.972776 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 23 21:24:10.972776 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 23 21:24:10.972776 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 23 21:24:10.972776 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise self.value Jul 23 21:24:10.972776 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 23 21:24:10.972776 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 23 21:24:10.972776 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair Jul 23 21:24:10.972776 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jul 23 21:24:10.972776 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint Jul 23 21:24:10.972776 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jul 23 21:24:10.976778 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jul 23 21:24:10.976778 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 23 21:24:10.976778 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jul 23 21:24:10.976778 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:24:10.976778 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:24:10.976778 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:24:10.976778 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:24:10.976778 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:24:10.976778 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:24:10.976778 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:24:10.976778 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:24:10.976778 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:24:10.976778 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:24:10.976778 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:24:10.976778 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:24:10.976778 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:24:10.976778 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:24:10.976778 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:24:10.976778 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:24:10.976778 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 23 21:24:10.976778 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 23 21:24:10.976778 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 23 21:24:10.976778 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 23 21:24:10.976778 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jul 23 21:24:10.976778 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:24:10.976778 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:24:10.976778 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:24:10.976778 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:24:10.976778 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:24:10.976778 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:24:10.976778 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:24:10.976778 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:24:10.976778 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jul 23 21:24:10.976778 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:24:10.979398 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-214f15dc-71cd-4ab1-b208-d3effcbe8111 tempest-KeyPairsNegativeTestJSON-972944477 tempest-KeyPairsNegativeTestJSON-972944477-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:24:10.980441 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-214f15dc-71cd-4ab1-b208-d3effcbe8111 tempest-KeyPairsNegativeTestJSON-972944477 tempest-KeyPairsNegativeTestJSON-972944477-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.060443 Jul 23 21:24:10.981265 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1307/2576] 10.222.0.17 () {60 vars in 1158 bytes} [Sat Jul 23 21:24:10 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 62 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 23 21:24:10.991719 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-045590c8-b73a-4f08-9510-7ab95c102e1e tempest-KeyPairsNegativeTestJSON-972944477 tempest-KeyPairsNegativeTestJSON-972944477-project] Calling method '.version_select at 0x7f0b47772ee0>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:11.003859 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-045590c8-b73a-4f08-9510-7ab95c102e1e tempest-KeyPairsNegativeTestJSON-972944477 tempest-KeyPairsNegativeTestJSON-972944477-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-1460312232 not found for user 240206b0a6934c64aee715559ce134bd Jul 23 21:24:11.006000 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-045590c8-b73a-4f08-9510-7ab95c102e1e tempest-KeyPairsNegativeTestJSON-972944477 tempest-KeyPairsNegativeTestJSON-972944477-project] Request method failure captured: Jul 23 21:24:11.006000 ncdv-master-1 devstack@n-api.service[131320]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1460312232 HTTP/1.1 Jul 23 21:24:11.006000 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:24:11.006000 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:24:11.006000 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:24:11.006000 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:24:11.006000 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:24:11.006000 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:24:11.006000 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:24:11.006000 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:24:11.006000 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3Gb5K79x6BLLyr1BlxrGcaVwbDCWSCclki18rkMFISsowp-65fnZMU1RiK_5KZWQLQosqndmsmk63vTsaScoypy9lZYL-WPrrTMUzv5BjN5o-0QN8_-OgZb0KNR060cFuvXdPxqOlGYMQKuhw2GlMqKIu7clR385OboxuJunWsRhetM Jul 23 21:24:11.006000 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:24:11.006000 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:24:11.006000 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:24:11.006000 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:24:11.006000 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:24:11.006000 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:24:11.006000 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: e009045b8f044e818c4a3cb8d72d9dbc Jul 23 21:24:11.006000 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-972944477 Jul 23 21:24:11.006000 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:24:11.006000 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:24:11.006000 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e009045b8f044e818c4a3cb8d72d9dbc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e009045b8f044e818c4a3cb8d72d9dbc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e009045b8f044e818c4a3cb8d72d9dbc", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e009045b8f044e818c4a3cb8d72d9dbc"}]}] Jul 23 21:24:11.006000 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-KeyPairsNegativeTestJSON-972944477 Jul 23 21:24:11.006000 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: e009045b8f044e818c4a3cb8d72d9dbc Jul 23 21:24:11.006000 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-972944477 Jul 23 21:24:11.006000 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-KeyPairsNegativeTestJSON-972944477-project Jul 23 21:24:11.006000 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:24:11.006000 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:24:11.006000 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 240206b0a6934c64aee715559ce134bd Jul 23 21:24:11.006000 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-KeyPairsNegativeTestJSON-972944477-project Jul 23 21:24:11.006000 ncdv-master-1 devstack@n-api.service[131320]: method: Jul 23 21:24:11.006000 ncdv-master-1 devstack@n-api.service[131320]: exception: Keypair tempest-keypair-non-existent-1460312232 not found for user 240206b0a6934c64aee715559ce134bd Jul 23 21:24:11.006000 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': 'tempest-keypair-non-existent-1460312232'} Jul 23 21:24:11.006000 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:24:11.006000 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:24:11.006000 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 164, in _delete Jul 23 21:24:11.006000 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Jul 23 21:24:11.006000 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 23 21:24:11.006000 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 23 21:24:11.006000 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 23 21:24:11.006000 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 23 21:24:11.006000 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 23 21:24:11.006000 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise self.value Jul 23 21:24:11.006000 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 23 21:24:11.006000 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 23 21:24:11.006000 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6745, in delete_key_pair Jul 23 21:24:11.006000 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Jul 23 21:24:11.006000 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6766, in get_key_pair Jul 23 21:24:11.006000 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Jul 23 21:24:11.006000 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 23 21:24:11.006000 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 23 21:24:11.006000 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Jul 23 21:24:11.006000 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Jul 23 21:24:11.006000 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Jul 23 21:24:11.006000 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Jul 23 21:24:11.006000 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 23 21:24:11.006000 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 23 21:24:11.006000 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Jul 23 21:24:11.006000 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Jul 23 21:24:11.006000 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-1460312232 not found for user 240206b0a6934c64aee715559ce134bd Jul 23 21:24:11.006000 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:24:11.006000 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:24:11.014700 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:24:11.014700 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:24:11.014700 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:24:11.014700 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:24:11.014700 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:24:11.014700 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:24:11.014700 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:24:11.014700 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:24:11.014700 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 23 21:24:11.014700 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:24:11.014700 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:24:11.014700 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:24:11.014700 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 137, in delete Jul 23 21:24:11.014700 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self._delete(req, id) Jul 23 21:24:11.014700 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 166, in _delete Jul 23 21:24:11.014700 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Jul 23 21:24:11.014700 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-1460312232 not found for user 240206b0a6934c64aee715559ce134bd Jul 23 21:24:11.014700 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:24:11.014700 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:24:11.014700 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:24:11.014700 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:24:11.014700 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:24:11.014700 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:24:11.014700 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:24:11.014700 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:24:11.014700 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-1460312232 not found for user 240206b0a6934c64aee715559ce134bd Jul 23 21:24:11.014700 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:24:11.014700 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-045590c8-b73a-4f08-9510-7ab95c102e1e tempest-KeyPairsNegativeTestJSON-972944477 tempest-KeyPairsNegativeTestJSON-972944477-project] Returning 404 to user: Keypair tempest-keypair-non-existent-1460312232 not found for user 240206b0a6934c64aee715559ce134bd {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:24:11.014700 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-045590c8-b73a-4f08-9510-7ab95c102e1e tempest-KeyPairsNegativeTestJSON-972944477 tempest-KeyPairsNegativeTestJSON-972944477-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1460312232" status: 404 len: 145 microversion: 2.1 time: 0.020701 Jul 23 21:24:11.014700 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1270/2577] 10.222.0.17 () {58 vars in 1259 bytes} [Sat Jul 23 21:24:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1460312232 => generated 145 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:24:11.306178 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-3eabc328-368d-49b0-b27a-221b59ba0d28 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:11.306953 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-3eabc328-368d-49b0-b27a-221b59ba0d28 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] [instance: 461367a0-c929-4951-98f4-d5194ae688f3] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:11.323187 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3eabc328-368d-49b0-b27a-221b59ba0d28 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:11.324786 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3eabc328-368d-49b0-b27a-221b59ba0d28 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:11.325796 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3eabc328-368d-49b0-b27a-221b59ba0d28 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:11.328692 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3eabc328-368d-49b0-b27a-221b59ba0d28 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:11.661194 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell0:SELECT=4 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:24:11.871799 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-3eabc328-368d-49b0-b27a-221b59ba0d28 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfb831babfd456e9cd186bab2ca14bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37510f38df0a45a6bb7771bdb0fbe271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:11.884942 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-3eabc328-368d-49b0-b27a-221b59ba0d28 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] 10.222.0.17 "GET /compute/v2.1/servers/461367a0-c929-4951-98f4-d5194ae688f3" status: 200 len: 1313 microversion: 2.1 time: 0.583000 Jul 23 21:24:11.886178 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1308/2578] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:11 2022] GET /compute/v2.1/servers/461367a0-c929-4951-98f4-d5194ae688f3 => generated 1313 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:24:12.907162 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4ccc7254-d248-48f8-943c-382ee4d37298 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:12.907924 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-4ccc7254-d248-48f8-943c-382ee4d37298 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] [instance: 461367a0-c929-4951-98f4-d5194ae688f3] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:12.932202 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4ccc7254-d248-48f8-943c-382ee4d37298 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:12.932667 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4ccc7254-d248-48f8-943c-382ee4d37298 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:12.933474 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4ccc7254-d248-48f8-943c-382ee4d37298 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:12.933948 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4ccc7254-d248-48f8-943c-382ee4d37298 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:13.125154 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-4ccc7254-d248-48f8-943c-382ee4d37298 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfb831babfd456e9cd186bab2ca14bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37510f38df0a45a6bb7771bdb0fbe271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:13.134783 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4ccc7254-d248-48f8-943c-382ee4d37298 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] 10.222.0.17 "GET /compute/v2.1/servers/461367a0-c929-4951-98f4-d5194ae688f3" status: 200 len: 1313 microversion: 2.1 time: 0.237359 Jul 23 21:24:13.146030 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1271/2579] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:12 2022] GET /compute/v2.1/servers/461367a0-c929-4951-98f4-d5194ae688f3 => generated 1313 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:24:13.177910 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-5a1e4ee9-3f72-4e9c-90e5-75ceb92485d6 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1496750306", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "networks": [{"uuid": "67a3a4a5-d93b-413b-a212-c9a10c8436e8"}, {"uuid": "978e1227-c5c9-4b07-b5c9-6eccdfad49f8"}]}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:24:13.280415 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.network.neutron [None req-5a1e4ee9-3f72-4e9c-90e5-75ceb92485d6 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] validate_networks() for [('67a3a4a5-d93b-413b-a212-c9a10c8436e8', None, None, None, None, None), ('978e1227-c5c9-4b07-b5c9-6eccdfad49f8', None, None, None, None, None)] {{(pid=131321) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:24:14.156308 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-dd2b4080-6ac8-41b4-aa48-b9b1201c3c1a tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:14.157486 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-dd2b4080-6ac8-41b4-aa48-b9b1201c3c1a tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] [instance: 461367a0-c929-4951-98f4-d5194ae688f3] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:14.186812 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dd2b4080-6ac8-41b4-aa48-b9b1201c3c1a tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:14.194744 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dd2b4080-6ac8-41b4-aa48-b9b1201c3c1a tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:14.196552 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dd2b4080-6ac8-41b4-aa48-b9b1201c3c1a tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:14.197055 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dd2b4080-6ac8-41b4-aa48-b9b1201c3c1a tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:14.506108 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-dd2b4080-6ac8-41b4-aa48-b9b1201c3c1a tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfb831babfd456e9cd186bab2ca14bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37510f38df0a45a6bb7771bdb0fbe271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:14.522681 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-dd2b4080-6ac8-41b4-aa48-b9b1201c3c1a tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] 10.222.0.17 "GET /compute/v2.1/servers/461367a0-c929-4951-98f4-d5194ae688f3" status: 200 len: 1313 microversion: 2.1 time: 0.372841 Jul 23 21:24:14.524826 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1272/2580] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:14 2022] GET /compute/v2.1/servers/461367a0-c929-4951-98f4-d5194ae688f3 => generated 1313 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:24:15.456869 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-5a1e4ee9-3f72-4e9c-90e5-75ceb92485d6 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Flavor limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:24:15.457961 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-5a1e4ee9-3f72-4e9c-90e5-75ceb92485d6 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Image limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:24:15.458672 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-5a1e4ee9-3f72-4e9c-90e5-75ceb92485d6 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Flavor pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:24:15.459247 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-5a1e4ee9-3f72-4e9c-90e5-75ceb92485d6 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Image pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:24:15.459854 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-5a1e4ee9-3f72-4e9c-90e5-75ceb92485d6 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:24:15.475405 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5a1e4ee9-3f72-4e9c-90e5-75ceb92485d6 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:15.477516 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5a1e4ee9-3f72-4e9c-90e5-75ceb92485d6 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:15.486518 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5a1e4ee9-3f72-4e9c-90e5-75ceb92485d6 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:15.487221 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5a1e4ee9-3f72-4e9c-90e5-75ceb92485d6 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:15.543179 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b1c28f70-f1e8-4beb-b886-05303d1f021b tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:15.543851 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b1c28f70-f1e8-4beb-b886-05303d1f021b tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] [instance: 461367a0-c929-4951-98f4-d5194ae688f3] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:15.546643 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-5a1e4ee9-3f72-4e9c-90e5-75ceb92485d6 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Getting quotas for project d3ff73d603ec4069a908452514a59451. Resources: {'ram', 'instances', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:24:15.552772 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-5a1e4ee9-3f72-4e9c-90e5-75ceb92485d6 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Getting quotas for user e74c139b38d74d9ab93695471ccd3a2c and project d3ff73d603ec4069a908452514a59451. Resources: {'ram', 'instances', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:24:15.561278 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b1c28f70-f1e8-4beb-b886-05303d1f021b tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:15.562698 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b1c28f70-f1e8-4beb-b886-05303d1f021b tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:15.563896 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b1c28f70-f1e8-4beb-b886-05303d1f021b tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:15.564630 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b1c28f70-f1e8-4beb-b886-05303d1f021b tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:15.579841 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-5a1e4ee9-3f72-4e9c-90e5-75ceb92485d6 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Going to run 1 instances... {{(pid=131321) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:24:15.582244 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-5a1e4ee9-3f72-4e9c-90e5-75ceb92485d6 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] [instance: f5ac0849-7849-4a9e-8168-130483d564b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131321) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:24:15.685961 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-5a1e4ee9-3f72-4e9c-90e5-75ceb92485d6 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.514090 Jul 23 21:24:15.686838 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1309/2581] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:24:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 2516 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 23 21:24:15.698663 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-91240b68-f6d9-44a4-bb52-335a23ea88d6 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:15.699199 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-91240b68-f6d9-44a4-bb52-335a23ea88d6 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] [instance: f5ac0849-7849-4a9e-8168-130483d564b0] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:15.867527 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-91240b68-f6d9-44a4-bb52-335a23ea88d6 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e74c139b38d74d9ab93695471ccd3a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ff73d603ec4069a908452514a59451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:15.878109 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-91240b68-f6d9-44a4-bb52-335a23ea88d6 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] 10.222.0.17 "GET /compute/v2.1/servers/f5ac0849-7849-4a9e-8168-130483d564b0" status: 200 len: 1213 microversion: 2.1 time: 0.184093 Jul 23 21:24:15.879170 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1310/2582] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:15 2022] GET /compute/v2.1/servers/f5ac0849-7849-4a9e-8168-130483d564b0 => generated 1213 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:24:16.440491 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b1c28f70-f1e8-4beb-b886-05303d1f021b tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfb831babfd456e9cd186bab2ca14bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37510f38df0a45a6bb7771bdb0fbe271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:16.454069 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b1c28f70-f1e8-4beb-b886-05303d1f021b tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] 10.222.0.17 "GET /compute/v2.1/servers/461367a0-c929-4951-98f4-d5194ae688f3" status: 200 len: 1313 microversion: 2.1 time: 0.916677 Jul 23 21:24:16.461509 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1273/2583] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:15 2022] GET /compute/v2.1/servers/461367a0-c929-4951-98f4-d5194ae688f3 => generated 1313 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:24:16.897233 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ef72182a-55a9-47ed-9f6e-efe3c20ec476 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:16.898517 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-ef72182a-55a9-47ed-9f6e-efe3c20ec476 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] [instance: f5ac0849-7849-4a9e-8168-130483d564b0] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:16.931138 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ef72182a-55a9-47ed-9f6e-efe3c20ec476 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:16.932280 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ef72182a-55a9-47ed-9f6e-efe3c20ec476 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:16.935174 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ef72182a-55a9-47ed-9f6e-efe3c20ec476 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:16.937202 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ef72182a-55a9-47ed-9f6e-efe3c20ec476 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:17.176444 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ef72182a-55a9-47ed-9f6e-efe3c20ec476 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e74c139b38d74d9ab93695471ccd3a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ff73d603ec4069a908452514a59451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:17.195578 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-ef72182a-55a9-47ed-9f6e-efe3c20ec476 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] 10.222.0.17 "GET /compute/v2.1/servers/f5ac0849-7849-4a9e-8168-130483d564b0" status: 200 len: 1265 microversion: 2.1 time: 0.303090 Jul 23 21:24:17.196211 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1311/2584] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:16 2022] GET /compute/v2.1/servers/f5ac0849-7849-4a9e-8168-130483d564b0 => generated 1265 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:24:17.476898 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-790a8c70-66db-4d62-a197-a518616f81aa tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:17.477524 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-790a8c70-66db-4d62-a197-a518616f81aa tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] [instance: 461367a0-c929-4951-98f4-d5194ae688f3] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:17.480820 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:24:17.492092 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-790a8c70-66db-4d62-a197-a518616f81aa tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:17.492819 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-790a8c70-66db-4d62-a197-a518616f81aa tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:17.494904 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-790a8c70-66db-4d62-a197-a518616f81aa tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:17.500495 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-790a8c70-66db-4d62-a197-a518616f81aa tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:17.817497 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-790a8c70-66db-4d62-a197-a518616f81aa tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfb831babfd456e9cd186bab2ca14bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37510f38df0a45a6bb7771bdb0fbe271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:17.835057 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-790a8c70-66db-4d62-a197-a518616f81aa tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] 10.222.0.17 "GET /compute/v2.1/servers/461367a0-c929-4951-98f4-d5194ae688f3" status: 200 len: 1313 microversion: 2.1 time: 0.361675 Jul 23 21:24:17.835701 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1274/2585] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:17 2022] GET /compute/v2.1/servers/461367a0-c929-4951-98f4-d5194ae688f3 => generated 1313 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:24:18.213147 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e678c14d-91f4-4300-82b6-6eb4bd5378df tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:18.215386 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-e678c14d-91f4-4300-82b6-6eb4bd5378df tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] [instance: f5ac0849-7849-4a9e-8168-130483d564b0] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:18.231039 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e678c14d-91f4-4300-82b6-6eb4bd5378df tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:18.231689 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e678c14d-91f4-4300-82b6-6eb4bd5378df tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:18.237152 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e678c14d-91f4-4300-82b6-6eb4bd5378df tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:18.243099 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e678c14d-91f4-4300-82b6-6eb4bd5378df tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:18.568308 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-e678c14d-91f4-4300-82b6-6eb4bd5378df tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e74c139b38d74d9ab93695471ccd3a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ff73d603ec4069a908452514a59451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:18.578723 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-e678c14d-91f4-4300-82b6-6eb4bd5378df tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] 10.222.0.17 "GET /compute/v2.1/servers/f5ac0849-7849-4a9e-8168-130483d564b0" status: 200 len: 1271 microversion: 2.1 time: 0.369510 Jul 23 21:24:18.580036 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1312/2586] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:18 2022] GET /compute/v2.1/servers/f5ac0849-7849-4a9e-8168-130483d564b0 => generated 1271 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:24:18.851942 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c40d48da-2e46-4ec2-b95f-d41bf836e918 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:18.852578 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c40d48da-2e46-4ec2-b95f-d41bf836e918 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] [instance: 461367a0-c929-4951-98f4-d5194ae688f3] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:18.865949 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c40d48da-2e46-4ec2-b95f-d41bf836e918 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:18.866847 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c40d48da-2e46-4ec2-b95f-d41bf836e918 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:18.874113 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c40d48da-2e46-4ec2-b95f-d41bf836e918 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:18.874842 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c40d48da-2e46-4ec2-b95f-d41bf836e918 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:19.454031 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d4fd7fa8-8280-496e-8ec6-3a051a9fbca2 tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Action: 'create', calling method: .version_select at 0x7f0b59aa9430>, body: {"keypair": {"name": "tempest-keypair-276346102", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBERHnf3yYrck5tHJmIhfhXuFXQtS/Kte/ibYcIH8LXJ73RobJ825CYlNUaumP6BQNx7c8nm3KO9zdom3Ah+fRyvljFYd/fhAukME1ERyiHPPUHRAPPx6IPkedfmYum2K5g=="}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:24:19.480911 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c40d48da-2e46-4ec2-b95f-d41bf836e918 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfb831babfd456e9cd186bab2ca14bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37510f38df0a45a6bb7771bdb0fbe271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:19.489484 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-d4fd7fa8-8280-496e-8ec6-3a051a9fbca2 tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Getting quotas for project a136ff692aeb4fdeae12dcacd09b3d6f. Resources: {'key_pairs'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:24:19.498985 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c40d48da-2e46-4ec2-b95f-d41bf836e918 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] 10.222.0.17 "GET /compute/v2.1/servers/461367a0-c929-4951-98f4-d5194ae688f3" status: 200 len: 1313 microversion: 2.1 time: 0.651400 Jul 23 21:24:19.499846 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1275/2587] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:18 2022] GET /compute/v2.1/servers/461367a0-c929-4951-98f4-d5194ae688f3 => generated 1313 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:24:19.504528 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-c7c664c9-6277-4402-a78e-38c4f5f58cbd req-85b323e2-cb38-4660-9470-3742ab08bb61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "461367a0-c929-4951-98f4-d5194ae688f3", "name": "network-vif-plugged", "status": "completed", "tag": "12250d34-c0e9-47d6-acd5-3c062cf5a19a"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:24:19.509432 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-d4fd7fa8-8280-496e-8ec6-3a051a9fbca2 tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Getting quotas for user 7cd8823a2d134f4ea1e31f92e65df040 and project a136ff692aeb4fdeae12dcacd09b3d6f. Resources: {'key_pairs'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:24:19.515359 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:24:19.520348 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-c7c664c9-6277-4402-a78e-38c4f5f58cbd req-85b323e2-cb38-4660-9470-3742ab08bb61 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:19.523167 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-c7c664c9-6277-4402-a78e-38c4f5f58cbd req-85b323e2-cb38-4660-9470-3742ab08bb61 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:19.585829 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-c7c664c9-6277-4402-a78e-38c4f5f58cbd req-85b323e2-cb38-4660-9470-3742ab08bb61 service nova] Creating event network-vif-plugged:12250d34-c0e9-47d6-acd5-3c062cf5a19a for instance 461367a0-c929-4951-98f4-d5194ae688f3 on nch2-master-1 Jul 23 21:24:19.602152 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-c7c664c9-6277-4402-a78e-38c4f5f58cbd req-85b323e2-cb38-4660-9470-3742ab08bb61 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100823 Jul 23 21:24:19.603727 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-d4fd7fa8-8280-496e-8ec6-3a051a9fbca2 tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.398022 Jul 23 21:24:19.603882 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1276/2588] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:24:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:24:19.604793 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1313/2589] 10.222.0.17 () {60 vars in 1158 bytes} [Sat Jul 23 21:24:19 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:24:19.614497 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-32fc4e90-99e5-48df-b6cd-7a91b9c1b0e5 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:19.615609 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-32fc4e90-99e5-48df-b6cd-7a91b9c1b0e5 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] [instance: f5ac0849-7849-4a9e-8168-130483d564b0] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:19.636955 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-32fc4e90-99e5-48df-b6cd-7a91b9c1b0e5 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:19.639206 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-32fc4e90-99e5-48df-b6cd-7a91b9c1b0e5 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:19.653210 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-32fc4e90-99e5-48df-b6cd-7a91b9c1b0e5 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:19.654842 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-32fc4e90-99e5-48df-b6cd-7a91b9c1b0e5 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:19.921586 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-32fc4e90-99e5-48df-b6cd-7a91b9c1b0e5 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e74c139b38d74d9ab93695471ccd3a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ff73d603ec4069a908452514a59451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:19.930770 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-32fc4e90-99e5-48df-b6cd-7a91b9c1b0e5 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] 10.222.0.17 "GET /compute/v2.1/servers/f5ac0849-7849-4a9e-8168-130483d564b0" status: 200 len: 1271 microversion: 2.1 time: 0.325631 Jul 23 21:24:19.931811 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1277/2590] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:19 2022] GET /compute/v2.1/servers/f5ac0849-7849-4a9e-8168-130483d564b0 => generated 1271 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:24:20.516657 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-bab33d4e-831b-410b-bc48-7e530ada1291 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:20.517325 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-bab33d4e-831b-410b-bc48-7e530ada1291 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] [instance: 461367a0-c929-4951-98f4-d5194ae688f3] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:20.533903 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bab33d4e-831b-410b-bc48-7e530ada1291 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:20.534360 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bab33d4e-831b-410b-bc48-7e530ada1291 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:20.535836 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bab33d4e-831b-410b-bc48-7e530ada1291 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:20.536296 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bab33d4e-831b-410b-bc48-7e530ada1291 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:20.895969 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-bab33d4e-831b-410b-bc48-7e530ada1291 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfb831babfd456e9cd186bab2ca14bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37510f38df0a45a6bb7771bdb0fbe271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:20.910318 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-bab33d4e-831b-410b-bc48-7e530ada1291 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] 10.222.0.17 "GET /compute/v2.1/servers/461367a0-c929-4951-98f4-d5194ae688f3" status: 200 len: 1313 microversion: 2.1 time: 0.394467 Jul 23 21:24:20.911366 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1314/2591] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:20 2022] GET /compute/v2.1/servers/461367a0-c929-4951-98f4-d5194ae688f3 => generated 1313 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:24:20.947524 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-654b9704-282a-4a60-93a6-7d7e72f9962b tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:20.948321 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-654b9704-282a-4a60-93a6-7d7e72f9962b tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] [instance: f5ac0849-7849-4a9e-8168-130483d564b0] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:20.950656 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=6 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:24:20.965215 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-654b9704-282a-4a60-93a6-7d7e72f9962b tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:20.966227 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-654b9704-282a-4a60-93a6-7d7e72f9962b tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:20.969697 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-654b9704-282a-4a60-93a6-7d7e72f9962b tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:20.971116 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-654b9704-282a-4a60-93a6-7d7e72f9962b tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:21.928156 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-913bb78b-4140-4cba-a8d7-639ee0a74387 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:21.928793 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-913bb78b-4140-4cba-a8d7-639ee0a74387 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] [instance: 461367a0-c929-4951-98f4-d5194ae688f3] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:21.942956 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-913bb78b-4140-4cba-a8d7-639ee0a74387 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:21.945008 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-913bb78b-4140-4cba-a8d7-639ee0a74387 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:21.949749 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-913bb78b-4140-4cba-a8d7-639ee0a74387 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:21.950524 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-913bb78b-4140-4cba-a8d7-639ee0a74387 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:22.026036 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:24:22.090732 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-654b9704-282a-4a60-93a6-7d7e72f9962b tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e74c139b38d74d9ab93695471ccd3a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ff73d603ec4069a908452514a59451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:22.104657 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-654b9704-282a-4a60-93a6-7d7e72f9962b tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] 10.222.0.17 "GET /compute/v2.1/servers/f5ac0849-7849-4a9e-8168-130483d564b0" status: 200 len: 1334 microversion: 2.1 time: 1.160928 Jul 23 21:24:22.116430 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1278/2592] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:20 2022] GET /compute/v2.1/servers/f5ac0849-7849-4a9e-8168-130483d564b0 => generated 1334 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:24:22.427230 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-913bb78b-4140-4cba-a8d7-639ee0a74387 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfb831babfd456e9cd186bab2ca14bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37510f38df0a45a6bb7771bdb0fbe271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:22.443478 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-913bb78b-4140-4cba-a8d7-639ee0a74387 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] 10.222.0.17 "GET /compute/v2.1/servers/461367a0-c929-4951-98f4-d5194ae688f3" status: 200 len: 1463 microversion: 2.1 time: 0.519450 Jul 23 21:24:22.454336 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1315/2593] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:21 2022] GET /compute/v2.1/servers/461367a0-c929-4951-98f4-d5194ae688f3 => generated 1463 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:24:22.805197 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-90c4e75f-68e5-4e16-a192-be44c037a6e6 tempest-TenantUsagesTestJSON-1849442326 tempest-TenantUsagesTestJSON-1849442326-project-admin] Calling method '.version_select at 0x7f0b47e0f430>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:22.825756 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-90c4e75f-68e5-4e16-a192-be44c037a6e6 tempest-TenantUsagesTestJSON-1849442326 tempest-TenantUsagesTestJSON-1849442326-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:22.828816 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-90c4e75f-68e5-4e16-a192-be44c037a6e6 tempest-TenantUsagesTestJSON-1849442326 tempest-TenantUsagesTestJSON-1849442326-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:22.885238 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-90c4e75f-68e5-4e16-a192-be44c037a6e6 tempest-TenantUsagesTestJSON-1849442326 tempest-TenantUsagesTestJSON-1849442326-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:22.885715 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-90c4e75f-68e5-4e16-a192-be44c037a6e6 tempest-TenantUsagesTestJSON-1849442326 tempest-TenantUsagesTestJSON-1849442326-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:22.919766 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-90c4e75f-68e5-4e16-a192-be44c037a6e6 tempest-TenantUsagesTestJSON-1849442326 tempest-TenantUsagesTestJSON-1849442326-project-admin] 10.222.0.17 "GET /compute/v2.1/os-simple-tenant-usage/37510f38df0a45a6bb7771bdb0fbe271?start=2022-07-22T21%3A24%3A22.453272&end=2022-07-24T21%3A24%3A22.453272" status: 200 len: 694 microversion: 2.1 time: 0.462182 Jul 23 21:24:22.926760 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1279/2594] 10.222.0.17 () {58 vars in 1411 bytes} [Sat Jul 23 21:24:22 2022] GET /compute/v2.1/os-simple-tenant-usage/37510f38df0a45a6bb7771bdb0fbe271?start=2022-07-22T21%3A24%3A22.453272&end=2022-07-24T21%3A24%3A22.453272 => generated 694 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:24:22.940021 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-66e59f26-74fe-4fd6-a721-6ece186368f4 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Calling method '.version_select at 0x7f0b473beee0>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:22.961454 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-66e59f26-74fe-4fd6-a721-6ece186368f4 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:22.965322 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-66e59f26-74fe-4fd6-a721-6ece186368f4 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:23.003494 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-66e59f26-74fe-4fd6-a721-6ece186368f4 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:23.003972 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-66e59f26-74fe-4fd6-a721-6ece186368f4 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:23.047356 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-66e59f26-74fe-4fd6-a721-6ece186368f4 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] 10.222.0.17 "GET /compute/v2.1/os-simple-tenant-usage/37510f38df0a45a6bb7771bdb0fbe271?start=2022-07-22T21%3A24%3A22.453272&end=2022-07-24T21%3A24%3A22.453272" status: 200 len: 694 microversion: 2.1 time: 0.111663 Jul 23 21:24:23.050722 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1316/2595] 10.222.0.17 () {58 vars in 1411 bytes} [Sat Jul 23 21:24:22 2022] GET /compute/v2.1/os-simple-tenant-usage/37510f38df0a45a6bb7771bdb0fbe271?start=2022-07-22T21%3A24%3A22.453272&end=2022-07-24T21%3A24%3A22.453272 => generated 694 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:24:23.068350 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1fad3190-b2f6-4133-a3c6-79d5b3b8fac1 tempest-TenantUsagesTestJSON-1849442326 tempest-TenantUsagesTestJSON-1849442326-project-admin] Calling method '.version_select at 0x7f0b54ac10d0>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:23.077991 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1fad3190-b2f6-4133-a3c6-79d5b3b8fac1 tempest-TenantUsagesTestJSON-1849442326 tempest-TenantUsagesTestJSON-1849442326-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:23.078463 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1fad3190-b2f6-4133-a3c6-79d5b3b8fac1 tempest-TenantUsagesTestJSON-1849442326 tempest-TenantUsagesTestJSON-1849442326-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:23.125209 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-9b08f9b9-fc48-491b-a846-501b9f1ab7d2 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:23.129659 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1fad3190-b2f6-4133-a3c6-79d5b3b8fac1 tempest-TenantUsagesTestJSON-1849442326 tempest-TenantUsagesTestJSON-1849442326-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:23.130563 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-9b08f9b9-fc48-491b-a846-501b9f1ab7d2 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] [instance: f5ac0849-7849-4a9e-8168-130483d564b0] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:23.137541 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1fad3190-b2f6-4133-a3c6-79d5b3b8fac1 tempest-TenantUsagesTestJSON-1849442326 tempest-TenantUsagesTestJSON-1849442326-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:23.151830 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9b08f9b9-fc48-491b-a846-501b9f1ab7d2 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:23.154917 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9b08f9b9-fc48-491b-a846-501b9f1ab7d2 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:23.155752 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9b08f9b9-fc48-491b-a846-501b9f1ab7d2 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:23.156203 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9b08f9b9-fc48-491b-a846-501b9f1ab7d2 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:23.392057 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1fad3190-b2f6-4133-a3c6-79d5b3b8fac1 tempest-TenantUsagesTestJSON-1849442326 tempest-TenantUsagesTestJSON-1849442326-project-admin] 10.222.0.17 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-22T21%3A24%3A22.453272&end=2022-07-24T21%3A24%3A22.453272&detailed=1" status: 200 len: 30132 microversion: 2.1 time: 0.332544 Jul 23 21:24:23.406428 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1280/2596] 10.222.0.17 () {58 vars in 1334 bytes} [Sat Jul 23 21:24:23 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-22T21%3A24%3A22.453272&end=2022-07-24T21%3A24%3A22.453272&detailed=1 => generated 30132 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 23 21:24:23.433584 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-15e919a1-37d4-44ad-a893-4a84c00ae078 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:23.436372 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-15e919a1-37d4-44ad-a893-4a84c00ae078 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] [instance: 461367a0-c929-4951-98f4-d5194ae688f3] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:23.454387 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-15e919a1-37d4-44ad-a893-4a84c00ae078 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:23.454847 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-15e919a1-37d4-44ad-a893-4a84c00ae078 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:23.455643 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-15e919a1-37d4-44ad-a893-4a84c00ae078 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:23.463272 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-15e919a1-37d4-44ad-a893-4a84c00ae078 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:23.528358 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-15e919a1-37d4-44ad-a893-4a84c00ae078 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] [instance: 461367a0-c929-4951-98f4-d5194ae688f3] Going to try to terminate instance {{(pid=131320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:24:23.631579 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=100 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:24:23.738184 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-15e919a1-37d4-44ad-a893-4a84c00ae078 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] 10.222.0.17 "DELETE /compute/v2.1/servers/461367a0-c929-4951-98f4-d5194ae688f3" status: 204 len: 0 microversion: 2.1 time: 0.309777 Jul 23 21:24:23.739944 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1281/2597] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:24:23 2022] DELETE /compute/v2.1/servers/461367a0-c929-4951-98f4-d5194ae688f3 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:24:23.950362 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-9b08f9b9-fc48-491b-a846-501b9f1ab7d2 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e74c139b38d74d9ab93695471ccd3a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ff73d603ec4069a908452514a59451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:23.965950 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-9b08f9b9-fc48-491b-a846-501b9f1ab7d2 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] 10.222.0.17 "GET /compute/v2.1/servers/f5ac0849-7849-4a9e-8168-130483d564b0" status: 200 len: 1334 microversion: 2.1 time: 0.846981 Jul 23 21:24:23.970701 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1317/2598] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:23 2022] GET /compute/v2.1/servers/f5ac0849-7849-4a9e-8168-130483d564b0 => generated 1334 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:24:23.985643 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-1b42009e-882a-48bd-a335-46a6412a6d07 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:23.986376 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-1b42009e-882a-48bd-a335-46a6412a6d07 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] [instance: 461367a0-c929-4951-98f4-d5194ae688f3] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:24.010594 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1b42009e-882a-48bd-a335-46a6412a6d07 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:24.011208 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1b42009e-882a-48bd-a335-46a6412a6d07 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:24.013754 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1b42009e-882a-48bd-a335-46a6412a6d07 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:24.014351 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1b42009e-882a-48bd-a335-46a6412a6d07 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:24.097057 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b1d7a7a7-f9ee-4a57-9d0a-9bdb31190ce8 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-836217183", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "networks": [{"uuid": "adb123a2-d311-4f7a-9eb7-3d6e038ac741"}]}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:24:24.193136 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-b1d7a7a7-f9ee-4a57-9d0a-9bdb31190ce8 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] validate_networks() for [('adb123a2-d311-4f7a-9eb7-3d6e038ac741', None, None, None, None, None)] {{(pid=131320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:24:24.568274 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-1b42009e-882a-48bd-a335-46a6412a6d07 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfb831babfd456e9cd186bab2ca14bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37510f38df0a45a6bb7771bdb0fbe271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:24.580158 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-1b42009e-882a-48bd-a335-46a6412a6d07 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] 10.222.0.17 "GET /compute/v2.1/servers/461367a0-c929-4951-98f4-d5194ae688f3" status: 200 len: 1469 microversion: 2.1 time: 0.608235 Jul 23 21:24:24.580750 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1318/2599] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:23 2022] GET /compute/v2.1/servers/461367a0-c929-4951-98f4-d5194ae688f3 => generated 1469 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:24:24.860777 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-8011fe4c-db52-4c4b-a7f4-66503c868689 req-925a79e8-224f-45aa-911f-e367cc1b58e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5ac0849-7849-4a9e-8168-130483d564b0", "tag": "e3eb1216-244f-4a92-a04f-baba4206aba1"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:24:24.888296 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-8011fe4c-db52-4c4b-a7f4-66503c868689 req-925a79e8-224f-45aa-911f-e367cc1b58e0 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:24.888752 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-8011fe4c-db52-4c4b-a7f4-66503c868689 req-925a79e8-224f-45aa-911f-e367cc1b58e0 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:24.900789 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-b1d7a7a7-f9ee-4a57-9d0a-9bdb31190ce8 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:24:24.902218 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-b1d7a7a7-f9ee-4a57-9d0a-9bdb31190ce8 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:24:24.902934 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-b1d7a7a7-f9ee-4a57-9d0a-9bdb31190ce8 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:24:24.904056 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-b1d7a7a7-f9ee-4a57-9d0a-9bdb31190ce8 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:24:24.904783 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-b1d7a7a7-f9ee-4a57-9d0a-9bdb31190ce8 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:24:24.923922 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-8011fe4c-db52-4c4b-a7f4-66503c868689 req-925a79e8-224f-45aa-911f-e367cc1b58e0 service nova] Creating event network-changed:e3eb1216-244f-4a92-a04f-baba4206aba1 for instance f5ac0849-7849-4a9e-8168-130483d564b0 on nch1-master-1 Jul 23 21:24:24.926029 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b1d7a7a7-f9ee-4a57-9d0a-9bdb31190ce8 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:24.926776 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b1d7a7a7-f9ee-4a57-9d0a-9bdb31190ce8 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:24.928000 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b1d7a7a7-f9ee-4a57-9d0a-9bdb31190ce8 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:24.929945 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b1d7a7a7-f9ee-4a57-9d0a-9bdb31190ce8 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:24.933700 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-8011fe4c-db52-4c4b-a7f4-66503c868689 req-925a79e8-224f-45aa-911f-e367cc1b58e0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.350409 Jul 23 21:24:24.934537 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1319/2600] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:24:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:24:24.963687 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-b1d7a7a7-f9ee-4a57-9d0a-9bdb31190ce8 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Getting quotas for project 8d6e531d129741b780236ffba8a4c2f9. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:24:24.986136 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-90954d12-8d0f-43ae-9f51-587860dda4a3 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:24.986848 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-90954d12-8d0f-43ae-9f51-587860dda4a3 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] [instance: f5ac0849-7849-4a9e-8168-130483d564b0] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:24.997174 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-b1d7a7a7-f9ee-4a57-9d0a-9bdb31190ce8 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Getting quotas for user b8b96ecba600424682ee7d55a16b6675 and project 8d6e531d129741b780236ffba8a4c2f9. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:24:24.997381 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-90954d12-8d0f-43ae-9f51-587860dda4a3 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:24.997791 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-90954d12-8d0f-43ae-9f51-587860dda4a3 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:24.998603 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-90954d12-8d0f-43ae-9f51-587860dda4a3 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:24.999059 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-90954d12-8d0f-43ae-9f51-587860dda4a3 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:25.041982 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b1d7a7a7-f9ee-4a57-9d0a-9bdb31190ce8 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Going to run 1 instances... {{(pid=131320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:24:25.046013 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b1d7a7a7-f9ee-4a57-9d0a-9bdb31190ce8 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] [instance: 1051c29e-9680-4e26-80f9-b46c3a0dd1f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:24:25.163242 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b1d7a7a7-f9ee-4a57-9d0a-9bdb31190ce8 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.421404 Jul 23 21:24:25.164071 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1282/2601] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:24:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1423 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 23 21:24:25.177419 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-92625544-7a62-42e6-adc6-d5998bd9b607 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:25.190702 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-92625544-7a62-42e6-adc6-d5998bd9b607 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] [instance: 1051c29e-9680-4e26-80f9-b46c3a0dd1f9] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:25.425568 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-90954d12-8d0f-43ae-9f51-587860dda4a3 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e74c139b38d74d9ab93695471ccd3a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ff73d603ec4069a908452514a59451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:25.443371 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-90954d12-8d0f-43ae-9f51-587860dda4a3 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] 10.222.0.17 "GET /compute/v2.1/servers/f5ac0849-7849-4a9e-8168-130483d564b0" status: 200 len: 1334 microversion: 2.1 time: 0.454902 Jul 23 21:24:25.444236 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1320/2602] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:24 2022] GET /compute/v2.1/servers/f5ac0849-7849-4a9e-8168-130483d564b0 => generated 1334 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:24:25.467278 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-92625544-7a62-42e6-adc6-d5998bd9b607 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8b96ecba600424682ee7d55a16b6675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d6e531d129741b780236ffba8a4c2f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:25.482499 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-92625544-7a62-42e6-adc6-d5998bd9b607 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] 10.222.0.17 "GET /compute/v2.1/servers/1051c29e-9680-4e26-80f9-b46c3a0dd1f9" status: 200 len: 1216 microversion: 2.1 time: 0.308215 Jul 23 21:24:25.494854 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1283/2603] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:25 2022] GET /compute/v2.1/servers/1051c29e-9680-4e26-80f9-b46c3a0dd1f9 => generated 1216 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:24:25.596947 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c2114f41-0013-4e06-9881-3815df478393 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:25.597725 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-c2114f41-0013-4e06-9881-3815df478393 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] [instance: 461367a0-c929-4951-98f4-d5194ae688f3] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:25.607956 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c2114f41-0013-4e06-9881-3815df478393 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:25.608893 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c2114f41-0013-4e06-9881-3815df478393 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:25.615345 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c2114f41-0013-4e06-9881-3815df478393 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:25.621058 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c2114f41-0013-4e06-9881-3815df478393 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:26.460895 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4a1d1a99-879e-48c5-9c69-7e93f9beb056 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:26.461520 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-4a1d1a99-879e-48c5-9c69-7e93f9beb056 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] [instance: f5ac0849-7849-4a9e-8168-130483d564b0] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:26.474745 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4a1d1a99-879e-48c5-9c69-7e93f9beb056 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:26.475403 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4a1d1a99-879e-48c5-9c69-7e93f9beb056 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:26.476041 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4a1d1a99-879e-48c5-9c69-7e93f9beb056 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:26.476496 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4a1d1a99-879e-48c5-9c69-7e93f9beb056 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:26.707764 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c2114f41-0013-4e06-9881-3815df478393 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bfb831babfd456e9cd186bab2ca14bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37510f38df0a45a6bb7771bdb0fbe271', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:26.716009 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-c2114f41-0013-4e06-9881-3815df478393 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] 10.222.0.17 "GET /compute/v2.1/servers/461367a0-c929-4951-98f4-d5194ae688f3" status: 200 len: 1469 microversion: 2.1 time: 1.122904 Jul 23 21:24:26.725466 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1321/2604] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:25 2022] GET /compute/v2.1/servers/461367a0-c929-4951-98f4-d5194ae688f3 => generated 1469 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:24:26.734669 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-fe057d6d-a499-4964-92c8-ee72eca62996 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:26.735310 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-fe057d6d-a499-4964-92c8-ee72eca62996 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] [instance: 1051c29e-9680-4e26-80f9-b46c3a0dd1f9] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:26.743128 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fe057d6d-a499-4964-92c8-ee72eca62996 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:26.743869 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fe057d6d-a499-4964-92c8-ee72eca62996 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:26.745372 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fe057d6d-a499-4964-92c8-ee72eca62996 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:26.754717 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fe057d6d-a499-4964-92c8-ee72eca62996 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:26.876675 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-4a1d1a99-879e-48c5-9c69-7e93f9beb056 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e74c139b38d74d9ab93695471ccd3a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ff73d603ec4069a908452514a59451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:26.893628 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4a1d1a99-879e-48c5-9c69-7e93f9beb056 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] 10.222.0.17 "GET /compute/v2.1/servers/f5ac0849-7849-4a9e-8168-130483d564b0" status: 200 len: 1334 microversion: 2.1 time: 0.436740 Jul 23 21:24:26.893628 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1284/2605] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:26 2022] GET /compute/v2.1/servers/f5ac0849-7849-4a9e-8168-130483d564b0 => generated 1334 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:24:26.916465 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-fe057d6d-a499-4964-92c8-ee72eca62996 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8b96ecba600424682ee7d55a16b6675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d6e531d129741b780236ffba8a4c2f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:26.940307 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-fe057d6d-a499-4964-92c8-ee72eca62996 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] 10.222.0.17 "GET /compute/v2.1/servers/1051c29e-9680-4e26-80f9-b46c3a0dd1f9" status: 200 len: 1268 microversion: 2.1 time: 0.213553 Jul 23 21:24:26.952126 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1322/2606] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:26 2022] GET /compute/v2.1/servers/1051c29e-9680-4e26-80f9-b46c3a0dd1f9 => generated 1268 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:24:26.975666 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-3d78f101-6016-465f-aa6c-362f9bc97abd req-0a4f0f44-f840-4caa-a424-5623d1d62997 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "461367a0-c929-4951-98f4-d5194ae688f3", "name": "network-vif-deleted", "tag": "12250d34-c0e9-47d6-acd5-3c062cf5a19a"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:24:26.992789 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-3d78f101-6016-465f-aa6c-362f9bc97abd req-0a4f0f44-f840-4caa-a424-5623d1d62997 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:26.993934 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-3d78f101-6016-465f-aa6c-362f9bc97abd req-0a4f0f44-f840-4caa-a424-5623d1d62997 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:27.021487 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-3d78f101-6016-465f-aa6c-362f9bc97abd req-0a4f0f44-f840-4caa-a424-5623d1d62997 service nova] Creating event network-vif-deleted:12250d34-c0e9-47d6-acd5-3c062cf5a19a for instance 461367a0-c929-4951-98f4-d5194ae688f3 on nch2-master-1 Jul 23 21:24:27.030670 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-3d78f101-6016-465f-aa6c-362f9bc97abd req-0a4f0f44-f840-4caa-a424-5623d1d62997 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059014 Jul 23 21:24:27.036629 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1285/2607] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:24:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:24:27.176392 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-48fdc3ba-9c3b-4e79-adad-3b50091b7aec req-b384c10d-813a-4b29-88ce-6e1f5feedac5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5ac0849-7849-4a9e-8168-130483d564b0", "tag": "4aa4d60b-2311-4afc-9675-e0c5b4acc98a"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:24:27.212802 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-48fdc3ba-9c3b-4e79-adad-3b50091b7aec req-b384c10d-813a-4b29-88ce-6e1f5feedac5 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:27.215118 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-48fdc3ba-9c3b-4e79-adad-3b50091b7aec req-b384c10d-813a-4b29-88ce-6e1f5feedac5 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:27.250091 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-48fdc3ba-9c3b-4e79-adad-3b50091b7aec req-b384c10d-813a-4b29-88ce-6e1f5feedac5 service nova] Creating event network-changed:4aa4d60b-2311-4afc-9675-e0c5b4acc98a for instance f5ac0849-7849-4a9e-8168-130483d564b0 on nch1-master-1 Jul 23 21:24:27.265055 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-dd0c30ff-3c70-4b01-a321-9e7ab4aaae4b tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1869755953", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "45c8849d-f734-4a5d-9e51-2592ccb2a161"}], "security_groups": [{"name": "tempest-securitygroup--721376072"}], "key_name": "tempest-keypair-276346102", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:24:27.271867 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-48fdc3ba-9c3b-4e79-adad-3b50091b7aec req-b384c10d-813a-4b29-88ce-6e1f5feedac5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098183 Jul 23 21:24:27.272679 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1323/2608] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:24:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:24:27.533230 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-dd0c30ff-3c70-4b01-a321-9e7ab4aaae4b tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] validate_networks() for [('45c8849d-f734-4a5d-9e51-2592ccb2a161', None, None, None, None, None)] {{(pid=131320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:24:27.733360 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-5c8375d2-9a28-4500-a05a-97f330d11921 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:27.735899 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-5c8375d2-9a28-4500-a05a-97f330d11921 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] [instance: 461367a0-c929-4951-98f4-d5194ae688f3] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:27.747406 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5c8375d2-9a28-4500-a05a-97f330d11921 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:27.751476 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5c8375d2-9a28-4500-a05a-97f330d11921 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:27.755695 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5c8375d2-9a28-4500-a05a-97f330d11921 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:27.756956 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5c8375d2-9a28-4500-a05a-97f330d11921 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:27.780941 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-5c8375d2-9a28-4500-a05a-97f330d11921 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] HTTP exception thrown: Instance 461367a0-c929-4951-98f4-d5194ae688f3 could not be found. Jul 23 21:24:27.782750 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-5c8375d2-9a28-4500-a05a-97f330d11921 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Request method failure captured: Jul 23 21:24:27.782750 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/servers/461367a0-c929-4951-98f4-d5194ae688f3 HTTP/1.1 Jul 23 21:24:27.782750 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:24:27.782750 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:24:27.782750 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:24:27.782750 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:24:27.782750 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:24:27.782750 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:24:27.782750 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:24:27.782750 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:24:27.782750 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GbvOA0b8Ce4qPy92LhzhOJzhl1d3950d6uzTBdgndVoVivFN5Zc0KaOITf8KxDG0Zg_RO1j-j-ZCnys_etLeZtLm70VCA3YURnePJdrW-zu15NAFtY7Kq_zjuJC6a9LUeLJA2NvXbgJuJo1Cj2sf-bpdaerUSHkElQMlJv0qzoNNXQ Jul 23 21:24:27.782750 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:24:27.782750 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:24:27.782750 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:24:27.782750 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:24:27.782750 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:24:27.782750 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:24:27.782750 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 37510f38df0a45a6bb7771bdb0fbe271 Jul 23 21:24:27.782750 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-TenantUsagesTestJSON-486196942 Jul 23 21:24:27.782750 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:24:27.782750 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:24:27.782750 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/37510f38df0a45a6bb7771bdb0fbe271"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/37510f38df0a45a6bb7771bdb0fbe271"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_37510f38df0a45a6bb7771bdb0fbe271", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/37510f38df0a45a6bb7771bdb0fbe271"}]}] Jul 23 21:24:27.782750 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-TenantUsagesTestJSON-486196942 Jul 23 21:24:27.782750 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 37510f38df0a45a6bb7771bdb0fbe271 Jul 23 21:24:27.782750 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-TenantUsagesTestJSON-486196942 Jul 23 21:24:27.782750 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-TenantUsagesTestJSON-486196942-project Jul 23 21:24:27.782750 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:24:27.782750 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:24:27.782750 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 8bfb831babfd456e9cd186bab2ca14bb Jul 23 21:24:27.782750 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-TenantUsagesTestJSON-486196942-project Jul 23 21:24:27.782750 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:24:27.782750 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance 461367a0-c929-4951-98f4-d5194ae688f3 could not be found. Jul 23 21:24:27.782750 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': '461367a0-c929-4951-98f4-d5194ae688f3'} Jul 23 21:24:27.782750 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:24:27.782750 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:24:27.782750 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:24:27.782750 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:24:27.782750 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:24:27.782750 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:24:27.782750 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:24:27.782750 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:24:27.782750 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:24:27.782750 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:24:27.782750 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 461367a0-c929-4951-98f4-d5194ae688f3 could not be found. Jul 23 21:24:27.782750 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:24:27.782750 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:24:27.782750 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:24:27.782750 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:24:27.782750 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:24:27.782750 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:24:27.782750 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:24:27.782750 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:24:27.782750 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:24:27.782750 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:24:27.782750 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:24:27.782750 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:24:27.782750 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:24:27.782750 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:24:27.782750 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:24:27.782750 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:24:27.782750 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 461367a0-c929-4951-98f4-d5194ae688f3 could not be found. Jul 23 21:24:27.782750 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:24:27.782750 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:24:27.782750 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:24:27.787118 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:24:27.787118 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:24:27.787118 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:24:27.787118 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:24:27.787118 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:24:27.787118 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 461367a0-c929-4951-98f4-d5194ae688f3 could not be found. Jul 23 21:24:27.787118 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:24:27.787118 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-5c8375d2-9a28-4500-a05a-97f330d11921 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] Returning 404 to user: Instance 461367a0-c929-4951-98f4-d5194ae688f3 could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:24:27.787118 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-5c8375d2-9a28-4500-a05a-97f330d11921 tempest-TenantUsagesTestJSON-486196942 tempest-TenantUsagesTestJSON-486196942-project] 10.222.0.17 "GET /compute/v2.1/servers/461367a0-c929-4951-98f4-d5194ae688f3" status: 404 len: 111 microversion: 2.1 time: 0.055143 Jul 23 21:24:27.787118 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1324/2609] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:27 2022] GET /compute/v2.1/servers/461367a0-c929-4951-98f4-d5194ae688f3 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 23 21:24:27.913452 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f2d64c46-8dce-4f8c-b2c7-c27a7e144de1 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:27.914117 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-f2d64c46-8dce-4f8c-b2c7-c27a7e144de1 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] [instance: f5ac0849-7849-4a9e-8168-130483d564b0] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:27.926717 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f2d64c46-8dce-4f8c-b2c7-c27a7e144de1 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:27.929176 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f2d64c46-8dce-4f8c-b2c7-c27a7e144de1 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:27.933309 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f2d64c46-8dce-4f8c-b2c7-c27a7e144de1 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:27.936457 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f2d64c46-8dce-4f8c-b2c7-c27a7e144de1 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:28.114587 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-dd0c30ff-3c70-4b01-a321-9e7ab4aaae4b tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Getting quotas for project a136ff692aeb4fdeae12dcacd09b3d6f. Resources: dict_keys(['metadata_items']) {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:24:28.128529 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-dd0c30ff-3c70-4b01-a321-9e7ab4aaae4b tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Getting quotas for user 7cd8823a2d134f4ea1e31f92e65df040 and project a136ff692aeb4fdeae12dcacd09b3d6f. Resources: dict_keys(['metadata_items']) {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:24:28.145320 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-dd0c30ff-3c70-4b01-a321-9e7ab4aaae4b tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:24:28.146015 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-dd0c30ff-3c70-4b01-a321-9e7ab4aaae4b tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:24:28.146721 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-dd0c30ff-3c70-4b01-a321-9e7ab4aaae4b tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:24:28.147288 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-dd0c30ff-3c70-4b01-a321-9e7ab4aaae4b tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:24:28.148352 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-dd0c30ff-3c70-4b01-a321-9e7ab4aaae4b tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:24:28.167643 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dd0c30ff-3c70-4b01-a321-9e7ab4aaae4b tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:28.170168 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dd0c30ff-3c70-4b01-a321-9e7ab4aaae4b tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:28.171381 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dd0c30ff-3c70-4b01-a321-9e7ab4aaae4b tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:28.172038 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dd0c30ff-3c70-4b01-a321-9e7ab4aaae4b tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:28.198228 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-dd0c30ff-3c70-4b01-a321-9e7ab4aaae4b tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Getting quotas for project a136ff692aeb4fdeae12dcacd09b3d6f. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:24:28.205979 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-dd0c30ff-3c70-4b01-a321-9e7ab4aaae4b tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Getting quotas for user 7cd8823a2d134f4ea1e31f92e65df040 and project a136ff692aeb4fdeae12dcacd09b3d6f. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:24:28.238786 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-dd0c30ff-3c70-4b01-a321-9e7ab4aaae4b tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Going to run 1 instances... {{(pid=131320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:24:28.242515 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-dd0c30ff-3c70-4b01-a321-9e7ab4aaae4b tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] [instance: c9e47e97-31f2-41d6-a49b-66efaa974c65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:24:28.304152 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-dd0c30ff-3c70-4b01-a321-9e7ab4aaae4b tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.052081 Jul 23 21:24:28.310338 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1286/2610] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:24:27 2022] POST /compute/v2.1/servers => generated 406 bytes in 1055 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 23 21:24:28.311875 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-42880387-673f-4a11-8da9-b5e514a84e68 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:28.312862 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-42880387-673f-4a11-8da9-b5e514a84e68 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] [instance: 1051c29e-9680-4e26-80f9-b46c3a0dd1f9] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:28.323378 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-42880387-673f-4a11-8da9-b5e514a84e68 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:28.323918 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-42880387-673f-4a11-8da9-b5e514a84e68 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:28.324981 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-42880387-673f-4a11-8da9-b5e514a84e68 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:28.325515 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-42880387-673f-4a11-8da9-b5e514a84e68 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:28.489017 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-42880387-673f-4a11-8da9-b5e514a84e68 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8b96ecba600424682ee7d55a16b6675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d6e531d129741b780236ffba8a4c2f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:28.500084 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-42880387-673f-4a11-8da9-b5e514a84e68 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] 10.222.0.17 "GET /compute/v2.1/servers/1051c29e-9680-4e26-80f9-b46c3a0dd1f9" status: 200 len: 1274 microversion: 2.1 time: 0.193600 Jul 23 21:24:28.501428 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1287/2611] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:28 2022] GET /compute/v2.1/servers/1051c29e-9680-4e26-80f9-b46c3a0dd1f9 => generated 1274 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:24:28.512401 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1e1595ca-9845-482c-8325-4d92aaf9c045 tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:28.513639 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1e1595ca-9845-482c-8325-4d92aaf9c045 tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] [instance: c9e47e97-31f2-41d6-a49b-66efaa974c65] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:28.557774 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-f2d64c46-8dce-4f8c-b2c7-c27a7e144de1 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e74c139b38d74d9ab93695471ccd3a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ff73d603ec4069a908452514a59451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:28.567333 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-f2d64c46-8dce-4f8c-b2c7-c27a7e144de1 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] 10.222.0.17 "GET /compute/v2.1/servers/f5ac0849-7849-4a9e-8168-130483d564b0" status: 200 len: 1334 microversion: 2.1 time: 0.660826 Jul 23 21:24:28.572532 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1325/2612] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:27 2022] GET /compute/v2.1/servers/f5ac0849-7849-4a9e-8168-130483d564b0 => generated 1334 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:24:28.624984 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-1e1595ca-9845-482c-8325-4d92aaf9c045 tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cd8823a2d134f4ea1e31f92e65df040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a136ff692aeb4fdeae12dcacd09b3d6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:28.634719 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1e1595ca-9845-482c-8325-4d92aaf9c045 tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] 10.222.0.17 "GET /compute/v2.1/servers/c9e47e97-31f2-41d6-a49b-66efaa974c65" status: 200 len: 1269 microversion: 2.1 time: 0.130782 Jul 23 21:24:28.636005 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1288/2613] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:28 2022] GET /compute/v2.1/servers/c9e47e97-31f2-41d6-a49b-66efaa974c65 => generated 1269 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:24:29.519843 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ac462e0b-805e-428c-a82d-0ce5dc43462a tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:29.521074 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-ac462e0b-805e-428c-a82d-0ce5dc43462a tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] [instance: 1051c29e-9680-4e26-80f9-b46c3a0dd1f9] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:29.531927 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell0:SELECT=34 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:24:29.535952 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ac462e0b-805e-428c-a82d-0ce5dc43462a tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:29.539261 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ac462e0b-805e-428c-a82d-0ce5dc43462a tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:29.542291 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ac462e0b-805e-428c-a82d-0ce5dc43462a tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:29.544376 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ac462e0b-805e-428c-a82d-0ce5dc43462a tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:29.589226 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-aca394da-b77e-4848-b881-ea9f8f8537d8 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:29.590684 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-aca394da-b77e-4848-b881-ea9f8f8537d8 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] [instance: f5ac0849-7849-4a9e-8168-130483d564b0] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:29.606067 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-aca394da-b77e-4848-b881-ea9f8f8537d8 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:29.611518 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-aca394da-b77e-4848-b881-ea9f8f8537d8 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:29.613969 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-aca394da-b77e-4848-b881-ea9f8f8537d8 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:29.617238 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-aca394da-b77e-4848-b881-ea9f8f8537d8 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:30.284582 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-aca394da-b77e-4848-b881-ea9f8f8537d8 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e74c139b38d74d9ab93695471ccd3a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ff73d603ec4069a908452514a59451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:30.302010 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-aca394da-b77e-4848-b881-ea9f8f8537d8 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] 10.222.0.17 "GET /compute/v2.1/servers/f5ac0849-7849-4a9e-8168-130483d564b0" status: 200 len: 1334 microversion: 2.1 time: 0.717001 Jul 23 21:24:30.302938 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1289/2614] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:29 2022] GET /compute/v2.1/servers/f5ac0849-7849-4a9e-8168-130483d564b0 => generated 1334 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:24:30.307938 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-cff71180-7c42-4b7a-a237-6ee1d99ff045 tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:30.308551 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-cff71180-7c42-4b7a-a237-6ee1d99ff045 tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] [instance: c9e47e97-31f2-41d6-a49b-66efaa974c65] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:30.329401 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cff71180-7c42-4b7a-a237-6ee1d99ff045 tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:30.330196 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cff71180-7c42-4b7a-a237-6ee1d99ff045 tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:30.331286 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cff71180-7c42-4b7a-a237-6ee1d99ff045 tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:30.332948 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cff71180-7c42-4b7a-a237-6ee1d99ff045 tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:30.622202 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-cff71180-7c42-4b7a-a237-6ee1d99ff045 tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cd8823a2d134f4ea1e31f92e65df040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a136ff692aeb4fdeae12dcacd09b3d6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:30.640050 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-cff71180-7c42-4b7a-a237-6ee1d99ff045 tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] 10.222.0.17 "GET /compute/v2.1/servers/c9e47e97-31f2-41d6-a49b-66efaa974c65" status: 200 len: 1327 microversion: 2.1 time: 0.335684 Jul 23 21:24:30.641493 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1290/2615] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:30 2022] GET /compute/v2.1/servers/c9e47e97-31f2-41d6-a49b-66efaa974c65 => generated 1327 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:24:30.707828 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ac462e0b-805e-428c-a82d-0ce5dc43462a tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8b96ecba600424682ee7d55a16b6675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d6e531d129741b780236ffba8a4c2f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:30.718433 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-ac462e0b-805e-428c-a82d-0ce5dc43462a tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] 10.222.0.17 "GET /compute/v2.1/servers/1051c29e-9680-4e26-80f9-b46c3a0dd1f9" status: 200 len: 1316 microversion: 2.1 time: 1.202800 Jul 23 21:24:30.721450 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1326/2616] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:29 2022] GET /compute/v2.1/servers/1051c29e-9680-4e26-80f9-b46c3a0dd1f9 => generated 1316 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:24:30.928785 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8b61b017-2852-4305-b904-0c5e32282ae2 tempest-FlavorsV2NegativeTest-2005196794 tempest-FlavorsV2NegativeTest-2005196794-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:30.941193 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8b61b017-2852-4305-b904-0c5e32282ae2 tempest-FlavorsV2NegativeTest-2005196794 tempest-FlavorsV2NegativeTest-2005196794-project] 10.222.0.17 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.208678 Jul 23 21:24:30.942017 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1291/2617] 10.222.0.17 () {58 vars in 1136 bytes} [Sat Jul 23 21:24:30 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:24:31.322653 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-97fbb5c0-fbb4-4193-b5fc-fda02ad76f80 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:31.323546 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-97fbb5c0-fbb4-4193-b5fc-fda02ad76f80 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] [instance: f5ac0849-7849-4a9e-8168-130483d564b0] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:31.352133 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-97fbb5c0-fbb4-4193-b5fc-fda02ad76f80 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:31.352784 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-97fbb5c0-fbb4-4193-b5fc-fda02ad76f80 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:31.354726 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-97fbb5c0-fbb4-4193-b5fc-fda02ad76f80 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:31.356059 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-97fbb5c0-fbb4-4193-b5fc-fda02ad76f80 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:31.658207 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6871ff87-1ae8-4181-ade8-26c7f3fd794c tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:31.658831 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6871ff87-1ae8-4181-ade8-26c7f3fd794c tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] [instance: c9e47e97-31f2-41d6-a49b-66efaa974c65] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:31.672693 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6871ff87-1ae8-4181-ade8-26c7f3fd794c tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:31.674800 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6871ff87-1ae8-4181-ade8-26c7f3fd794c tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:31.677439 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6871ff87-1ae8-4181-ade8-26c7f3fd794c tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:31.678249 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6871ff87-1ae8-4181-ade8-26c7f3fd794c tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:32.068338 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6871ff87-1ae8-4181-ade8-26c7f3fd794c tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cd8823a2d134f4ea1e31f92e65df040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a136ff692aeb4fdeae12dcacd09b3d6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:32.089343 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6871ff87-1ae8-4181-ade8-26c7f3fd794c tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] 10.222.0.17 "GET /compute/v2.1/servers/c9e47e97-31f2-41d6-a49b-66efaa974c65" status: 200 len: 1394 microversion: 2.1 time: 0.435196 Jul 23 21:24:32.093844 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1292/2618] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:31 2022] GET /compute/v2.1/servers/c9e47e97-31f2-41d6-a49b-66efaa974c65 => generated 1394 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:24:32.125549 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-07009611-3bdc-41f4-84b3-4cf8a48506b5 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:32.126449 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-07009611-3bdc-41f4-84b3-4cf8a48506b5 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] [instance: 1051c29e-9680-4e26-80f9-b46c3a0dd1f9] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:32.135083 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-07009611-3bdc-41f4-84b3-4cf8a48506b5 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:32.135778 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-07009611-3bdc-41f4-84b3-4cf8a48506b5 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:32.136742 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-07009611-3bdc-41f4-84b3-4cf8a48506b5 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:32.137333 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-07009611-3bdc-41f4-84b3-4cf8a48506b5 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:32.151501 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-97fbb5c0-fbb4-4193-b5fc-fda02ad76f80 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e74c139b38d74d9ab93695471ccd3a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ff73d603ec4069a908452514a59451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:32.161604 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-97fbb5c0-fbb4-4193-b5fc-fda02ad76f80 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] 10.222.0.17 "GET /compute/v2.1/servers/f5ac0849-7849-4a9e-8168-130483d564b0" status: 200 len: 1334 microversion: 2.1 time: 0.844834 Jul 23 21:24:32.170657 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1327/2619] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:31 2022] GET /compute/v2.1/servers/f5ac0849-7849-4a9e-8168-130483d564b0 => generated 1334 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:24:32.195257 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ebc7674a-bcd5-4d7f-840e-ebda9d53666e tempest-FlavorsV2NegativeTest-2005196794 tempest-FlavorsV2NegativeTest-2005196794-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1205961368", "imageRef": "9a9338ac-9839-46dc-9981-34b64d765e2e", "flavorRef": "452"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:24:32.285855 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.network.neutron [None req-ebc7674a-bcd5-4d7f-840e-ebda9d53666e tempest-FlavorsV2NegativeTest-2005196794 tempest-FlavorsV2NegativeTest-2005196794-project] validate_networks() for None {{(pid=131321) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:24:32.458860 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-07009611-3bdc-41f4-84b3-4cf8a48506b5 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8b96ecba600424682ee7d55a16b6675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d6e531d129741b780236ffba8a4c2f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:32.479339 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-07009611-3bdc-41f4-84b3-4cf8a48506b5 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] 10.222.0.17 "GET /compute/v2.1/servers/1051c29e-9680-4e26-80f9-b46c3a0dd1f9" status: 200 len: 1316 microversion: 2.1 time: 0.383924 Jul 23 21:24:32.480597 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1293/2620] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:32 2022] GET /compute/v2.1/servers/1051c29e-9680-4e26-80f9-b46c3a0dd1f9 => generated 1316 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:24:32.665117 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-ab8da5d4-303c-4305-9e15-965332b8e9c8 req-4f0065fc-9b55-4c26-822d-23ba90df6d25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9e47e97-31f2-41d6-a49b-66efaa974c65", "tag": "d3a997e1-ef36-49cc-923f-fa9696e77441"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:24:32.696643 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-ab8da5d4-303c-4305-9e15-965332b8e9c8 req-4f0065fc-9b55-4c26-822d-23ba90df6d25 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:32.697138 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-ab8da5d4-303c-4305-9e15-965332b8e9c8 req-4f0065fc-9b55-4c26-822d-23ba90df6d25 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:32.728081 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-ab8da5d4-303c-4305-9e15-965332b8e9c8 req-4f0065fc-9b55-4c26-822d-23ba90df6d25 service nova] Creating event network-changed:d3a997e1-ef36-49cc-923f-fa9696e77441 for instance c9e47e97-31f2-41d6-a49b-66efaa974c65 on nch2-master-1 Jul 23 21:24:32.733381 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-ab8da5d4-303c-4305-9e15-965332b8e9c8 req-4f0065fc-9b55-4c26-822d-23ba90df6d25 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078019 Jul 23 21:24:32.734545 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1294/2621] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:24:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:24:32.852040 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-ebc7674a-bcd5-4d7f-840e-ebda9d53666e tempest-FlavorsV2NegativeTest-2005196794 tempest-FlavorsV2NegativeTest-2005196794-project] HTTP exception thrown: Flavor's memory is too small for requested image. Jul 23 21:24:32.856385 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ebc7674a-bcd5-4d7f-840e-ebda9d53666e tempest-FlavorsV2NegativeTest-2005196794 tempest-FlavorsV2NegativeTest-2005196794-project] Request method failure captured: Jul 23 21:24:32.856385 ncdv-master-1 devstack@n-api.service[131321]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 23 21:24:32.856385 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:24:32.856385 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:24:32.856385 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:24:32.856385 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 143 Jul 23 21:24:32.856385 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:24:32.856385 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:24:32.856385 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:24:32.856385 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:24:32.856385 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GcO4y312O5MQaCWOz9oLT_3U3ANGq6R1TvcAs-lCnMR5dmB8uZ4ABAeOuLg4F2yO_HNOx6CLvbUHsECgcvVRYL_lxEa44njM5Y_RKX2BMbR7HbVr-O34CV5RWZSL4bsWuF1X-OPw-BpK7n0hURHle1vpuxBgNdsafGDkeFFR9jQM_g Jul 23 21:24:32.856385 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:24:32.856385 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:24:32.856385 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:24:32.856385 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:24:32.856385 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:24:32.856385 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:24:32.856385 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 55c6d68f7ee944a098da7c002ebce6eb Jul 23 21:24:32.856385 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-FlavorsV2NegativeTest-2005196794 Jul 23 21:24:32.856385 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:24:32.856385 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:24:32.856385 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/55c6d68f7ee944a098da7c002ebce6eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/55c6d68f7ee944a098da7c002ebce6eb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_55c6d68f7ee944a098da7c002ebce6eb", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/55c6d68f7ee944a098da7c002ebce6eb"}]}] Jul 23 21:24:32.856385 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-FlavorsV2NegativeTest-2005196794 Jul 23 21:24:32.856385 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 55c6d68f7ee944a098da7c002ebce6eb Jul 23 21:24:32.856385 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-2005196794 Jul 23 21:24:32.856385 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-FlavorsV2NegativeTest-2005196794-project Jul 23 21:24:32.856385 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:24:32.856385 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:24:32.856385 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 2c562b1e809c457ca1fc2f1703075c8c Jul 23 21:24:32.856385 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-FlavorsV2NegativeTest-2005196794-project Jul 23 21:24:32.856385 ncdv-master-1 devstack@n-api.service[131321]: Jul 23 21:24:32.856385 ncdv-master-1 devstack@n-api.service[131321]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1205961368", "imageRef": "9a9338ac-9839-46dc-9981-34b64d765e2e", "flavorRef": "452"}} Jul 23 21:24:32.856385 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:24:32.856385 ncdv-master-1 devstack@n-api.service[131321]: exception: Flavor's memory is too small for requested image. Jul 23 21:24:32.856385 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-1205961368', 'imageRef': '9a9338ac-9839-46dc-9981-34b64d765e2e', 'flavorRef': '452'}}} Jul 23 21:24:32.856385 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:24:32.856385 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:24:32.856385 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 23 21:24:32.856385 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 23 21:24:32.856385 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 23 21:24:32.856385 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 23 21:24:32.856385 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1667, in _create_instance Jul 23 21:24:32.856385 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Jul 23 21:24:32.856385 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1005, in _checks_for_create_and_rebuild Jul 23 21:24:32.856385 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Jul 23 21:24:32.856385 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 669, in _validate_flavor_image Jul 23 21:24:32.856385 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Jul 23 21:24:32.856385 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 737, in _validate_flavor_image_nostatus Jul 23 21:24:32.856385 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Jul 23 21:24:32.856385 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Jul 23 21:24:32.856385 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:24:32.856385 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:24:32.856385 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:24:32.856385 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:24:32.856385 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:24:32.856385 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:24:32.856385 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:24:32.856385 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:24:32.856385 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:24:32.856385 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:24:32.856385 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:24:32.856385 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:24:32.856385 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:24:32.856385 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:24:32.864954 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:24:32.864954 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:24:32.864954 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 23 21:24:32.864954 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Jul 23 21:24:32.864954 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 23 21:24:32.864954 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Jul 23 21:24:32.864954 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:24:32.864954 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:24:32.864954 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:24:32.864954 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:24:32.864954 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:24:32.864954 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:24:32.864954 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:24:32.864954 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:24:32.864954 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Jul 23 21:24:32.864954 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:24:32.864954 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ebc7674a-bcd5-4d7f-840e-ebda9d53666e tempest-FlavorsV2NegativeTest-2005196794 tempest-FlavorsV2NegativeTest-2005196794-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:24:32.864954 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-ebc7674a-bcd5-4d7f-840e-ebda9d53666e tempest-FlavorsV2NegativeTest-2005196794 tempest-FlavorsV2NegativeTest-2005196794-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.685566 Jul 23 21:24:32.864954 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1328/2622] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:24:32 2022] POST /compute/v2.1/servers => generated 93 bytes in 687 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 23 21:24:32.951451 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-520b0a72-0688-42c4-9922-d03415eefdf7 req-52bdda4a-cb5b-4921-8aff-76c9426a9e01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1051c29e-9680-4e26-80f9-b46c3a0dd1f9", "tag": "18720ccd-5e17-4fb5-b76e-3ddf8cf9fd5c"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:24:32.987593 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-520b0a72-0688-42c4-9922-d03415eefdf7 req-52bdda4a-cb5b-4921-8aff-76c9426a9e01 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:32.987835 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-520b0a72-0688-42c4-9922-d03415eefdf7 req-52bdda4a-cb5b-4921-8aff-76c9426a9e01 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:33.017834 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-520b0a72-0688-42c4-9922-d03415eefdf7 req-52bdda4a-cb5b-4921-8aff-76c9426a9e01 service nova] Creating event network-changed:18720ccd-5e17-4fb5-b76e-3ddf8cf9fd5c for instance 1051c29e-9680-4e26-80f9-b46c3a0dd1f9 on nch2-master-1 Jul 23 21:24:33.025683 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-520b0a72-0688-42c4-9922-d03415eefdf7 req-52bdda4a-cb5b-4921-8aff-76c9426a9e01 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079691 Jul 23 21:24:33.026911 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1295/2623] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:24:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:24:33.107750 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell0:SELECT=4 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:24:33.113111 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-0e9ccd91-fe38-4bba-b465-0328b313c6d1 tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:33.113969 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-0e9ccd91-fe38-4bba-b465-0328b313c6d1 tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] [instance: c9e47e97-31f2-41d6-a49b-66efaa974c65] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:33.126382 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0e9ccd91-fe38-4bba-b465-0328b313c6d1 tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:33.126840 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0e9ccd91-fe38-4bba-b465-0328b313c6d1 tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:33.127622 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0e9ccd91-fe38-4bba-b465-0328b313c6d1 tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:33.130558 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0e9ccd91-fe38-4bba-b465-0328b313c6d1 tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:33.192661 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a8fec0d8-d3d8-4e5a-87ae-ff4e15abc0ff tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:33.193556 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a8fec0d8-d3d8-4e5a-87ae-ff4e15abc0ff tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] [instance: f5ac0849-7849-4a9e-8168-130483d564b0] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:33.207926 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a8fec0d8-d3d8-4e5a-87ae-ff4e15abc0ff tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:33.208622 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a8fec0d8-d3d8-4e5a-87ae-ff4e15abc0ff tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:33.209773 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a8fec0d8-d3d8-4e5a-87ae-ff4e15abc0ff tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:33.210259 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a8fec0d8-d3d8-4e5a-87ae-ff4e15abc0ff tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:33.453464 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-0e9ccd91-fe38-4bba-b465-0328b313c6d1 tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cd8823a2d134f4ea1e31f92e65df040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a136ff692aeb4fdeae12dcacd09b3d6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:33.465538 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-0e9ccd91-fe38-4bba-b465-0328b313c6d1 tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] 10.222.0.17 "GET /compute/v2.1/servers/c9e47e97-31f2-41d6-a49b-66efaa974c65" status: 200 len: 1394 microversion: 2.1 time: 0.358487 Jul 23 21:24:33.479335 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1329/2624] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:33 2022] GET /compute/v2.1/servers/c9e47e97-31f2-41d6-a49b-66efaa974c65 => generated 1394 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:24:33.507023 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c15cae7e-4b41-4c2c-a721-a79799cc4f15 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:33.509641 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-c15cae7e-4b41-4c2c-a721-a79799cc4f15 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] [instance: 1051c29e-9680-4e26-80f9-b46c3a0dd1f9] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:33.534112 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c15cae7e-4b41-4c2c-a721-a79799cc4f15 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:33.536964 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c15cae7e-4b41-4c2c-a721-a79799cc4f15 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:33.540032 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c15cae7e-4b41-4c2c-a721-a79799cc4f15 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:33.540794 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c15cae7e-4b41-4c2c-a721-a79799cc4f15 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:33.569392 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a8fec0d8-d3d8-4e5a-87ae-ff4e15abc0ff tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e74c139b38d74d9ab93695471ccd3a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ff73d603ec4069a908452514a59451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:33.578993 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a8fec0d8-d3d8-4e5a-87ae-ff4e15abc0ff tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] 10.222.0.17 "GET /compute/v2.1/servers/f5ac0849-7849-4a9e-8168-130483d564b0" status: 200 len: 1334 microversion: 2.1 time: 0.395410 Jul 23 21:24:33.585760 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1296/2625] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:33 2022] GET /compute/v2.1/servers/f5ac0849-7849-4a9e-8168-130483d564b0 => generated 1334 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:24:33.810397 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c15cae7e-4b41-4c2c-a721-a79799cc4f15 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8b96ecba600424682ee7d55a16b6675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d6e531d129741b780236ffba8a4c2f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:33.822250 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-c15cae7e-4b41-4c2c-a721-a79799cc4f15 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] 10.222.0.17 "GET /compute/v2.1/servers/1051c29e-9680-4e26-80f9-b46c3a0dd1f9" status: 200 len: 1316 microversion: 2.1 time: 0.323056 Jul 23 21:24:33.831975 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1330/2626] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:33 2022] GET /compute/v2.1/servers/1051c29e-9680-4e26-80f9-b46c3a0dd1f9 => generated 1316 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:24:34.484221 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f03de33d-66ae-4c27-9cd0-e18fda248076 tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:34.485627 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f03de33d-66ae-4c27-9cd0-e18fda248076 tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] [instance: c9e47e97-31f2-41d6-a49b-66efaa974c65] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:34.498166 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f03de33d-66ae-4c27-9cd0-e18fda248076 tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:34.499096 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f03de33d-66ae-4c27-9cd0-e18fda248076 tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:34.502589 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f03de33d-66ae-4c27-9cd0-e18fda248076 tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:34.503335 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f03de33d-66ae-4c27-9cd0-e18fda248076 tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:34.596200 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-5f86a271-174a-49fd-afb7-b8e5f2a873d5 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:34.597002 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-5f86a271-174a-49fd-afb7-b8e5f2a873d5 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] [instance: f5ac0849-7849-4a9e-8168-130483d564b0] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:34.609412 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5f86a271-174a-49fd-afb7-b8e5f2a873d5 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:34.611128 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5f86a271-174a-49fd-afb7-b8e5f2a873d5 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:34.613117 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5f86a271-174a-49fd-afb7-b8e5f2a873d5 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:34.613578 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5f86a271-174a-49fd-afb7-b8e5f2a873d5 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:34.859605 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f03de33d-66ae-4c27-9cd0-e18fda248076 tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cd8823a2d134f4ea1e31f92e65df040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a136ff692aeb4fdeae12dcacd09b3d6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:34.875900 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f03de33d-66ae-4c27-9cd0-e18fda248076 tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] 10.222.0.17 "GET /compute/v2.1/servers/c9e47e97-31f2-41d6-a49b-66efaa974c65" status: 200 len: 1394 microversion: 2.1 time: 0.389538 Jul 23 21:24:34.876865 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1297/2627] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:34 2022] GET /compute/v2.1/servers/c9e47e97-31f2-41d6-a49b-66efaa974c65 => generated 1394 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:24:34.889585 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8ac48860-58f1-4703-b717-99dee74ac570 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:34.890443 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8ac48860-58f1-4703-b717-99dee74ac570 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] [instance: 1051c29e-9680-4e26-80f9-b46c3a0dd1f9] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:34.897651 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8ac48860-58f1-4703-b717-99dee74ac570 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:34.899912 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8ac48860-58f1-4703-b717-99dee74ac570 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:34.900691 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8ac48860-58f1-4703-b717-99dee74ac570 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:34.901132 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8ac48860-58f1-4703-b717-99dee74ac570 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:34.902001 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-5f86a271-174a-49fd-afb7-b8e5f2a873d5 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e74c139b38d74d9ab93695471ccd3a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ff73d603ec4069a908452514a59451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:34.914608 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-5f86a271-174a-49fd-afb7-b8e5f2a873d5 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] 10.222.0.17 "GET /compute/v2.1/servers/f5ac0849-7849-4a9e-8168-130483d564b0" status: 200 len: 1334 microversion: 2.1 time: 0.319918 Jul 23 21:24:34.925363 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1331/2628] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:34 2022] GET /compute/v2.1/servers/f5ac0849-7849-4a9e-8168-130483d564b0 => generated 1334 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:24:35.204763 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8ac48860-58f1-4703-b717-99dee74ac570 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8b96ecba600424682ee7d55a16b6675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d6e531d129741b780236ffba8a4c2f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:35.213287 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8ac48860-58f1-4703-b717-99dee74ac570 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] 10.222.0.17 "GET /compute/v2.1/servers/1051c29e-9680-4e26-80f9-b46c3a0dd1f9" status: 200 len: 1316 microversion: 2.1 time: 0.335173 Jul 23 21:24:35.213892 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1298/2629] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:34 2022] GET /compute/v2.1/servers/1051c29e-9680-4e26-80f9-b46c3a0dd1f9 => generated 1316 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:24:35.893726 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-dd58022a-da14-4707-8681-31d505572cf0 tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:35.894378 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-dd58022a-da14-4707-8681-31d505572cf0 tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] [instance: c9e47e97-31f2-41d6-a49b-66efaa974c65] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:35.912898 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-dd58022a-da14-4707-8681-31d505572cf0 tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:35.916350 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-dd58022a-da14-4707-8681-31d505572cf0 tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:35.917360 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-dd58022a-da14-4707-8681-31d505572cf0 tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:35.918014 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-dd58022a-da14-4707-8681-31d505572cf0 tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:35.932171 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-84aaddcb-e5bf-4a77-b58e-1de9c4c0a8bb tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:35.932796 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-84aaddcb-e5bf-4a77-b58e-1de9c4c0a8bb tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] [instance: f5ac0849-7849-4a9e-8168-130483d564b0] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:35.946328 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-84aaddcb-e5bf-4a77-b58e-1de9c4c0a8bb tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:35.946853 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-84aaddcb-e5bf-4a77-b58e-1de9c4c0a8bb tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:35.947678 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-84aaddcb-e5bf-4a77-b58e-1de9c4c0a8bb tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:35.948115 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-84aaddcb-e5bf-4a77-b58e-1de9c4c0a8bb tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:36.222974 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-dd58022a-da14-4707-8681-31d505572cf0 tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cd8823a2d134f4ea1e31f92e65df040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a136ff692aeb4fdeae12dcacd09b3d6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:36.237811 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-dd58022a-da14-4707-8681-31d505572cf0 tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] 10.222.0.17 "GET /compute/v2.1/servers/c9e47e97-31f2-41d6-a49b-66efaa974c65" status: 200 len: 1394 microversion: 2.1 time: 0.348917 Jul 23 21:24:36.243683 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1332/2630] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:35 2022] GET /compute/v2.1/servers/c9e47e97-31f2-41d6-a49b-66efaa974c65 => generated 1394 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:24:36.251483 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-3d98c18f-aac0-433c-b19c-312d204fb387 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:36.254372 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-3d98c18f-aac0-433c-b19c-312d204fb387 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] [instance: 1051c29e-9680-4e26-80f9-b46c3a0dd1f9] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:36.269040 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3d98c18f-aac0-433c-b19c-312d204fb387 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:36.269498 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3d98c18f-aac0-433c-b19c-312d204fb387 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:36.270473 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3d98c18f-aac0-433c-b19c-312d204fb387 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:36.271508 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3d98c18f-aac0-433c-b19c-312d204fb387 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:36.415470 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-84aaddcb-e5bf-4a77-b58e-1de9c4c0a8bb tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e74c139b38d74d9ab93695471ccd3a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ff73d603ec4069a908452514a59451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:36.423418 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-84aaddcb-e5bf-4a77-b58e-1de9c4c0a8bb tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] 10.222.0.17 "GET /compute/v2.1/servers/f5ac0849-7849-4a9e-8168-130483d564b0" status: 200 len: 1334 microversion: 2.1 time: 0.495559 Jul 23 21:24:36.433060 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1299/2631] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:35 2022] GET /compute/v2.1/servers/f5ac0849-7849-4a9e-8168-130483d564b0 => generated 1334 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:24:36.559242 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-3d98c18f-aac0-433c-b19c-312d204fb387 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8b96ecba600424682ee7d55a16b6675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d6e531d129741b780236ffba8a4c2f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:36.572553 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-3d98c18f-aac0-433c-b19c-312d204fb387 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] 10.222.0.17 "GET /compute/v2.1/servers/1051c29e-9680-4e26-80f9-b46c3a0dd1f9" status: 200 len: 1316 microversion: 2.1 time: 0.327229 Jul 23 21:24:36.573315 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1333/2632] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:36 2022] GET /compute/v2.1/servers/1051c29e-9680-4e26-80f9-b46c3a0dd1f9 => generated 1316 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:24:36.733337 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-a27fe65f-a957-482e-aad4-bcd74bc41c29 req-89d106f5-530e-492f-bf2b-8a5154ea4557 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5ac0849-7849-4a9e-8168-130483d564b0", "name": "network-vif-plugged", "status": "completed", "tag": "e3eb1216-244f-4a92-a04f-baba4206aba1"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:24:36.739599 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:24:36.745012 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-a27fe65f-a957-482e-aad4-bcd74bc41c29 req-89d106f5-530e-492f-bf2b-8a5154ea4557 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:36.745579 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-a27fe65f-a957-482e-aad4-bcd74bc41c29 req-89d106f5-530e-492f-bf2b-8a5154ea4557 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:36.758922 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-a27fe65f-a957-482e-aad4-bcd74bc41c29 req-89d106f5-530e-492f-bf2b-8a5154ea4557 service nova] Creating event network-vif-plugged:e3eb1216-244f-4a92-a04f-baba4206aba1 for instance f5ac0849-7849-4a9e-8168-130483d564b0 on nch1-master-1 Jul 23 21:24:36.764588 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-a27fe65f-a957-482e-aad4-bcd74bc41c29 req-89d106f5-530e-492f-bf2b-8a5154ea4557 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.235391 Jul 23 21:24:36.765515 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1300/2633] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:24:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:24:37.261159 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-001ea295-b875-4fdf-8cc1-0f9e3f1d4202 tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:37.261895 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-001ea295-b875-4fdf-8cc1-0f9e3f1d4202 tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] [instance: c9e47e97-31f2-41d6-a49b-66efaa974c65] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:37.271991 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-001ea295-b875-4fdf-8cc1-0f9e3f1d4202 tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:37.273242 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-001ea295-b875-4fdf-8cc1-0f9e3f1d4202 tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:37.278350 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-001ea295-b875-4fdf-8cc1-0f9e3f1d4202 tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:37.279122 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-001ea295-b875-4fdf-8cc1-0f9e3f1d4202 tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:37.403780 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5881ec08-28d6-469d-acaf-2c361fff2e3e tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-752368569", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:24:37.463755 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-5881ec08-28d6-469d-acaf-2c361fff2e3e tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] validate_networks() for [('92d8b6c8-55fb-4a21-a58b-da2fc6e4b22b', None, None, None, None, None)] {{(pid=131320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:24:37.487960 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-001ea295-b875-4fdf-8cc1-0f9e3f1d4202 tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cd8823a2d134f4ea1e31f92e65df040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a136ff692aeb4fdeae12dcacd09b3d6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:37.500491 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-001ea295-b875-4fdf-8cc1-0f9e3f1d4202 tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] 10.222.0.17 "GET /compute/v2.1/servers/c9e47e97-31f2-41d6-a49b-66efaa974c65" status: 200 len: 1394 microversion: 2.1 time: 0.243419 Jul 23 21:24:37.501093 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1334/2634] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:37 2022] GET /compute/v2.1/servers/c9e47e97-31f2-41d6-a49b-66efaa974c65 => generated 1394 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:24:37.505586 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-53b66302-01b8-4562-ad79-4cc2848f969a tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:37.508646 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-53b66302-01b8-4562-ad79-4cc2848f969a tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] [instance: f5ac0849-7849-4a9e-8168-130483d564b0] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:37.515054 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-53b66302-01b8-4562-ad79-4cc2848f969a tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:37.515611 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-53b66302-01b8-4562-ad79-4cc2848f969a tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:37.516378 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-53b66302-01b8-4562-ad79-4cc2848f969a tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:37.517058 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-53b66302-01b8-4562-ad79-4cc2848f969a tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:37.747270 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-53b66302-01b8-4562-ad79-4cc2848f969a tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e74c139b38d74d9ab93695471ccd3a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ff73d603ec4069a908452514a59451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:37.751215 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=100 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:24:37.761073 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-53b66302-01b8-4562-ad79-4cc2848f969a tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] 10.222.0.17 "GET /compute/v2.1/servers/f5ac0849-7849-4a9e-8168-130483d564b0" status: 200 len: 1334 microversion: 2.1 time: 0.256925 Jul 23 21:24:37.762048 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1335/2635] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:37 2022] GET /compute/v2.1/servers/f5ac0849-7849-4a9e-8168-130483d564b0 => generated 1334 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:24:37.769556 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-5b51a8ae-52fd-4bf6-a8e4-8466871cc0b6 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:37.770211 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-5b51a8ae-52fd-4bf6-a8e4-8466871cc0b6 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] [instance: 1051c29e-9680-4e26-80f9-b46c3a0dd1f9] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:37.798750 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5b51a8ae-52fd-4bf6-a8e4-8466871cc0b6 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:37.799478 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5b51a8ae-52fd-4bf6-a8e4-8466871cc0b6 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:37.800467 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5b51a8ae-52fd-4bf6-a8e4-8466871cc0b6 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:37.801165 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5b51a8ae-52fd-4bf6-a8e4-8466871cc0b6 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:37.954664 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-5881ec08-28d6-469d-acaf-2c361fff2e3e tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:24:37.955288 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-5881ec08-28d6-469d-acaf-2c361fff2e3e tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:24:37.958177 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-5881ec08-28d6-469d-acaf-2c361fff2e3e tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:24:37.958636 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-5881ec08-28d6-469d-acaf-2c361fff2e3e tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:24:37.959058 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-5881ec08-28d6-469d-acaf-2c361fff2e3e tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:24:37.969586 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5881ec08-28d6-469d-acaf-2c361fff2e3e tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:37.970328 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5881ec08-28d6-469d-acaf-2c361fff2e3e tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:37.971288 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5881ec08-28d6-469d-acaf-2c361fff2e3e tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:37.971723 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5881ec08-28d6-469d-acaf-2c361fff2e3e tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:37.997156 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-5881ec08-28d6-469d-acaf-2c361fff2e3e tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Getting quotas for project 9116def61aba4631be91f67df63ebab0. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:24:38.004967 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-5881ec08-28d6-469d-acaf-2c361fff2e3e tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Getting quotas for user 2a609c39c14343e1bc1edd4b3cd56dd4 and project 9116def61aba4631be91f67df63ebab0. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:24:38.023625 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5881ec08-28d6-469d-acaf-2c361fff2e3e tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Going to run 1 instances... {{(pid=131320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:24:38.029292 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5881ec08-28d6-469d-acaf-2c361fff2e3e tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] [instance: 73362a63-78d8-4890-8588-d112fb85c2bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:24:38.071186 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-5b51a8ae-52fd-4bf6-a8e4-8466871cc0b6 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8b96ecba600424682ee7d55a16b6675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d6e531d129741b780236ffba8a4c2f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:38.090456 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-5b51a8ae-52fd-4bf6-a8e4-8466871cc0b6 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] 10.222.0.17 "GET /compute/v2.1/servers/1051c29e-9680-4e26-80f9-b46c3a0dd1f9" status: 200 len: 1316 microversion: 2.1 time: 0.326664 Jul 23 21:24:38.092485 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1336/2636] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:37 2022] GET /compute/v2.1/servers/1051c29e-9680-4e26-80f9-b46c3a0dd1f9 => generated 1316 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:24:38.098899 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-60e6c29e-7767-4eb6-a19e-93bd55f73957 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:38.100289 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-60e6c29e-7767-4eb6-a19e-93bd55f73957 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] [instance: 011c4ff9-9d46-44df-bf9b-e0269c71c417] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:38.109427 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-60e6c29e-7767-4eb6-a19e-93bd55f73957 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:38.110112 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-60e6c29e-7767-4eb6-a19e-93bd55f73957 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:38.111082 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-60e6c29e-7767-4eb6-a19e-93bd55f73957 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:38.111679 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-60e6c29e-7767-4eb6-a19e-93bd55f73957 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:38.130197 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5881ec08-28d6-469d-acaf-2c361fff2e3e tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.791318 Jul 23 21:24:38.132317 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1301/2637] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:24:37 2022] POST /compute/v2.1/servers => generated 383 bytes in 796 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 23 21:24:38.141080 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f80f3add-283c-474f-bee4-6554e4c2c6bc tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:38.143857 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f80f3add-283c-474f-bee4-6554e4c2c6bc tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] [instance: 73362a63-78d8-4890-8588-d112fb85c2bf] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:38.213765 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-60e6c29e-7767-4eb6-a19e-93bd55f73957 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] [instance: 011c4ff9-9d46-44df-bf9b-e0269c71c417] Going to try to terminate instance {{(pid=131321) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:24:38.221121 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f80f3add-283c-474f-bee4-6554e4c2c6bc tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a609c39c14343e1bc1edd4b3cd56dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116def61aba4631be91f67df63ebab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:38.233049 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f80f3add-283c-474f-bee4-6554e4c2c6bc tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] 10.222.0.17 "GET /compute/v2.1/servers/73362a63-78d8-4890-8588-d112fb85c2bf" status: 200 len: 1213 microversion: 2.1 time: 0.094751 Jul 23 21:24:38.242491 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1302/2638] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:38 2022] GET /compute/v2.1/servers/73362a63-78d8-4890-8588-d112fb85c2bf => generated 1213 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:24:38.332872 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-60e6c29e-7767-4eb6-a19e-93bd55f73957 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] 10.222.0.17 "DELETE /compute/v2.1/servers/011c4ff9-9d46-44df-bf9b-e0269c71c417" status: 204 len: 0 microversion: 2.1 time: 0.237378 Jul 23 21:24:38.337079 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1337/2639] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:24:38 2022] DELETE /compute/v2.1/servers/011c4ff9-9d46-44df-bf9b-e0269c71c417 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:24:38.343578 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f208ea26-bdeb-466b-a6cf-245656df5d73 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:38.344482 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f208ea26-bdeb-466b-a6cf-245656df5d73 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] [instance: 011c4ff9-9d46-44df-bf9b-e0269c71c417] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:38.358924 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f208ea26-bdeb-466b-a6cf-245656df5d73 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:38.359380 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f208ea26-bdeb-466b-a6cf-245656df5d73 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:38.360172 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f208ea26-bdeb-466b-a6cf-245656df5d73 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:38.360611 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f208ea26-bdeb-466b-a6cf-245656df5d73 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:38.517475 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-4970d917-cc76-4ea8-ac78-f7392d01c321 tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:38.518416 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-4970d917-cc76-4ea8-ac78-f7392d01c321 tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] [instance: c9e47e97-31f2-41d6-a49b-66efaa974c65] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:38.527547 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4970d917-cc76-4ea8-ac78-f7392d01c321 tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:38.528230 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4970d917-cc76-4ea8-ac78-f7392d01c321 tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:38.530397 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4970d917-cc76-4ea8-ac78-f7392d01c321 tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:38.531054 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4970d917-cc76-4ea8-ac78-f7392d01c321 tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:38.546194 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f208ea26-bdeb-466b-a6cf-245656df5d73 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013b521930d54d6d952e566f8e67f466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1432b2e152894407afae7b6419d80a8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:38.555779 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f208ea26-bdeb-466b-a6cf-245656df5d73 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] 10.222.0.17 "GET /compute/v2.1/servers/011c4ff9-9d46-44df-bf9b-e0269c71c417" status: 200 len: 1667 microversion: 2.1 time: 0.217203 Jul 23 21:24:38.557337 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1303/2640] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:38 2022] GET /compute/v2.1/servers/011c4ff9-9d46-44df-bf9b-e0269c71c417 => generated 1667 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:24:38.779836 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e5a457d6-af82-414e-ba3d-a6742b58dbc2 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:38.780612 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e5a457d6-af82-414e-ba3d-a6742b58dbc2 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] [instance: f5ac0849-7849-4a9e-8168-130483d564b0] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:38.788147 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e5a457d6-af82-414e-ba3d-a6742b58dbc2 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:38.788961 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e5a457d6-af82-414e-ba3d-a6742b58dbc2 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:38.790458 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e5a457d6-af82-414e-ba3d-a6742b58dbc2 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:38.791777 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e5a457d6-af82-414e-ba3d-a6742b58dbc2 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:38.832966 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-4970d917-cc76-4ea8-ac78-f7392d01c321 tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cd8823a2d134f4ea1e31f92e65df040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a136ff692aeb4fdeae12dcacd09b3d6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:38.843443 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-4970d917-cc76-4ea8-ac78-f7392d01c321 tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] 10.222.0.17 "GET /compute/v2.1/servers/c9e47e97-31f2-41d6-a49b-66efaa974c65" status: 200 len: 1394 microversion: 2.1 time: 0.330216 Jul 23 21:24:38.846407 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1338/2641] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:38 2022] GET /compute/v2.1/servers/c9e47e97-31f2-41d6-a49b-66efaa974c65 => generated 1394 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:24:38.858338 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-89c0a963-a77b-4284-bf33-bf9954192397 req-812497c9-6a5e-408b-8901-5611e23f2799 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5ac0849-7849-4a9e-8168-130483d564b0", "name": "network-vif-plugged", "status": "completed", "tag": "4aa4d60b-2311-4afc-9675-e0c5b4acc98a"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:24:38.871598 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-89c0a963-a77b-4284-bf33-bf9954192397 req-812497c9-6a5e-408b-8901-5611e23f2799 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:38.872360 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-89c0a963-a77b-4284-bf33-bf9954192397 req-812497c9-6a5e-408b-8901-5611e23f2799 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:38.902464 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-89c0a963-a77b-4284-bf33-bf9954192397 req-812497c9-6a5e-408b-8901-5611e23f2799 service nova] Creating event network-vif-plugged:4aa4d60b-2311-4afc-9675-e0c5b4acc98a for instance f5ac0849-7849-4a9e-8168-130483d564b0 on nch1-master-1 Jul 23 21:24:38.911970 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-89c0a963-a77b-4284-bf33-bf9954192397 req-812497c9-6a5e-408b-8901-5611e23f2799 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063785 Jul 23 21:24:38.912881 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1339/2642] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:24:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:24:38.967113 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e5a457d6-af82-414e-ba3d-a6742b58dbc2 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e74c139b38d74d9ab93695471ccd3a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ff73d603ec4069a908452514a59451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:38.976807 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e5a457d6-af82-414e-ba3d-a6742b58dbc2 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] 10.222.0.17 "GET /compute/v2.1/servers/f5ac0849-7849-4a9e-8168-130483d564b0" status: 200 len: 1334 microversion: 2.1 time: 0.202064 Jul 23 21:24:38.978386 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1304/2643] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:38 2022] GET /compute/v2.1/servers/f5ac0849-7849-4a9e-8168-130483d564b0 => generated 1334 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:24:39.109250 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-4a2e34be-d7cf-4680-ba6c-4f2070c523d1 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:39.110016 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-4a2e34be-d7cf-4680-ba6c-4f2070c523d1 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] [instance: 1051c29e-9680-4e26-80f9-b46c3a0dd1f9] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:39.118046 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4a2e34be-d7cf-4680-ba6c-4f2070c523d1 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:39.118544 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4a2e34be-d7cf-4680-ba6c-4f2070c523d1 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:39.119875 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4a2e34be-d7cf-4680-ba6c-4f2070c523d1 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:39.120350 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4a2e34be-d7cf-4680-ba6c-4f2070c523d1 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:39.250705 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1b4faf64-7547-44e0-bfa3-c9e8729be1a3 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:39.251329 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1b4faf64-7547-44e0-bfa3-c9e8729be1a3 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] [instance: 73362a63-78d8-4890-8588-d112fb85c2bf] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:39.259891 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1b4faf64-7547-44e0-bfa3-c9e8729be1a3 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:39.260343 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1b4faf64-7547-44e0-bfa3-c9e8729be1a3 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:39.261135 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1b4faf64-7547-44e0-bfa3-c9e8729be1a3 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:39.261578 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1b4faf64-7547-44e0-bfa3-c9e8729be1a3 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:39.332729 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-1b4faf64-7547-44e0-bfa3-c9e8729be1a3 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a609c39c14343e1bc1edd4b3cd56dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116def61aba4631be91f67df63ebab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:39.336084 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:24:39.353758 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1b4faf64-7547-44e0-bfa3-c9e8729be1a3 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] 10.222.0.17 "GET /compute/v2.1/servers/73362a63-78d8-4890-8588-d112fb85c2bf" status: 200 len: 1217 microversion: 2.1 time: 0.106630 Jul 23 21:24:39.354918 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1305/2644] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:39 2022] GET /compute/v2.1/servers/73362a63-78d8-4890-8588-d112fb85c2bf => generated 1217 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:24:39.360640 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-4a2e34be-d7cf-4680-ba6c-4f2070c523d1 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8b96ecba600424682ee7d55a16b6675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d6e531d129741b780236ffba8a4c2f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:39.369431 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-4a2e34be-d7cf-4680-ba6c-4f2070c523d1 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] 10.222.0.17 "GET /compute/v2.1/servers/1051c29e-9680-4e26-80f9-b46c3a0dd1f9" status: 200 len: 1316 microversion: 2.1 time: 0.264041 Jul 23 21:24:39.370495 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1340/2645] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:39 2022] GET /compute/v2.1/servers/1051c29e-9680-4e26-80f9-b46c3a0dd1f9 => generated 1316 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:24:39.574145 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-91b19305-434b-4dfe-a9e4-cb014d9485e0 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:39.575516 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-91b19305-434b-4dfe-a9e4-cb014d9485e0 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] [instance: 011c4ff9-9d46-44df-bf9b-e0269c71c417] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:39.583305 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-91b19305-434b-4dfe-a9e4-cb014d9485e0 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:39.584941 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-91b19305-434b-4dfe-a9e4-cb014d9485e0 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:39.586038 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-91b19305-434b-4dfe-a9e4-cb014d9485e0 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:39.586921 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-91b19305-434b-4dfe-a9e4-cb014d9485e0 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:39.860654 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-2319dee6-01a1-4976-8511-05b16939489f tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:39.861381 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-2319dee6-01a1-4976-8511-05b16939489f tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] [instance: c9e47e97-31f2-41d6-a49b-66efaa974c65] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:39.873571 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2319dee6-01a1-4976-8511-05b16939489f tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:39.874371 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2319dee6-01a1-4976-8511-05b16939489f tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:39.875442 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2319dee6-01a1-4976-8511-05b16939489f tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:39.876088 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2319dee6-01a1-4976-8511-05b16939489f tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:39.918359 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-91b19305-434b-4dfe-a9e4-cb014d9485e0 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013b521930d54d6d952e566f8e67f466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1432b2e152894407afae7b6419d80a8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:39.935584 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-91b19305-434b-4dfe-a9e4-cb014d9485e0 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] 10.222.0.17 "GET /compute/v2.1/servers/011c4ff9-9d46-44df-bf9b-e0269c71c417" status: 200 len: 1667 microversion: 2.1 time: 0.361221 Jul 23 21:24:39.936765 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1306/2646] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:39 2022] GET /compute/v2.1/servers/011c4ff9-9d46-44df-bf9b-e0269c71c417 => generated 1667 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:24:39.997099 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ef1eca72-275d-4146-be19-36b1119630c0 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:39.998612 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ef1eca72-275d-4146-be19-36b1119630c0 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] [instance: f5ac0849-7849-4a9e-8168-130483d564b0] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:40.007929 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ef1eca72-275d-4146-be19-36b1119630c0 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:40.008903 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ef1eca72-275d-4146-be19-36b1119630c0 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:40.011877 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ef1eca72-275d-4146-be19-36b1119630c0 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:40.012543 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ef1eca72-275d-4146-be19-36b1119630c0 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:40.290938 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ef1eca72-275d-4146-be19-36b1119630c0 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e74c139b38d74d9ab93695471ccd3a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ff73d603ec4069a908452514a59451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:40.300244 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ef1eca72-275d-4146-be19-36b1119630c0 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] 10.222.0.17 "GET /compute/v2.1/servers/f5ac0849-7849-4a9e-8168-130483d564b0" status: 200 len: 1334 microversion: 2.1 time: 0.309733 Jul 23 21:24:40.304234 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1307/2647] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:39 2022] GET /compute/v2.1/servers/f5ac0849-7849-4a9e-8168-130483d564b0 => generated 1334 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:24:40.378174 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-dcb53f18-2aa4-4b2c-87f6-e9bf5d6dafa6 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:40.379687 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-dcb53f18-2aa4-4b2c-87f6-e9bf5d6dafa6 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] [instance: 73362a63-78d8-4890-8588-d112fb85c2bf] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:40.386996 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dcb53f18-2aa4-4b2c-87f6-e9bf5d6dafa6 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:40.387450 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dcb53f18-2aa4-4b2c-87f6-e9bf5d6dafa6 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:40.388248 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dcb53f18-2aa4-4b2c-87f6-e9bf5d6dafa6 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:40.388700 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dcb53f18-2aa4-4b2c-87f6-e9bf5d6dafa6 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:40.534122 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-dcb53f18-2aa4-4b2c-87f6-e9bf5d6dafa6 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a609c39c14343e1bc1edd4b3cd56dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116def61aba4631be91f67df63ebab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:40.543125 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-dcb53f18-2aa4-4b2c-87f6-e9bf5d6dafa6 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] 10.222.0.17 "GET /compute/v2.1/servers/73362a63-78d8-4890-8588-d112fb85c2bf" status: 200 len: 1265 microversion: 2.1 time: 0.175773 Jul 23 21:24:40.543724 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1308/2648] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:40 2022] GET /compute/v2.1/servers/73362a63-78d8-4890-8588-d112fb85c2bf => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:24:40.552697 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0054e05f-b944-4e77-b8b2-ca44e9391c38 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:40.552697 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-0054e05f-b944-4e77-b8b2-ca44e9391c38 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] [instance: 1051c29e-9680-4e26-80f9-b46c3a0dd1f9] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:40.566438 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0054e05f-b944-4e77-b8b2-ca44e9391c38 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:40.566891 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0054e05f-b944-4e77-b8b2-ca44e9391c38 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:40.567686 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0054e05f-b944-4e77-b8b2-ca44e9391c38 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:40.577934 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0054e05f-b944-4e77-b8b2-ca44e9391c38 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:40.808231 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-2319dee6-01a1-4976-8511-05b16939489f tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cd8823a2d134f4ea1e31f92e65df040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a136ff692aeb4fdeae12dcacd09b3d6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:40.839980 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-2319dee6-01a1-4976-8511-05b16939489f tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] 10.222.0.17 "GET /compute/v2.1/servers/c9e47e97-31f2-41d6-a49b-66efaa974c65" status: 200 len: 1394 microversion: 2.1 time: 0.983128 Jul 23 21:24:40.840598 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1341/2649] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:39 2022] GET /compute/v2.1/servers/c9e47e97-31f2-41d6-a49b-66efaa974c65 => generated 1394 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:24:40.953555 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e2912846-906b-4255-95d6-8e9535d6444d tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:40.954453 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-e2912846-906b-4255-95d6-8e9535d6444d tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] [instance: 011c4ff9-9d46-44df-bf9b-e0269c71c417] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:40.968086 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e2912846-906b-4255-95d6-8e9535d6444d tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:40.968780 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e2912846-906b-4255-95d6-8e9535d6444d tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:40.969521 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e2912846-906b-4255-95d6-8e9535d6444d tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:40.970038 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e2912846-906b-4255-95d6-8e9535d6444d tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:41.103612 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-0054e05f-b944-4e77-b8b2-ca44e9391c38 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8b96ecba600424682ee7d55a16b6675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d6e531d129741b780236ffba8a4c2f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:41.111937 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-0054e05f-b944-4e77-b8b2-ca44e9391c38 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] 10.222.0.17 "GET /compute/v2.1/servers/1051c29e-9680-4e26-80f9-b46c3a0dd1f9" status: 200 len: 1316 microversion: 2.1 time: 0.567093 Jul 23 21:24:41.134349 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1309/2650] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:40 2022] GET /compute/v2.1/servers/1051c29e-9680-4e26-80f9-b46c3a0dd1f9 => generated 1316 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:24:41.139416 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-83335032-197f-407d-b8d5-d9f1786b858d req-22b86890-5bf2-490a-bbe2-8a0eb802f9f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9e47e97-31f2-41d6-a49b-66efaa974c65", "name": "network-vif-plugged", "status": "completed", "tag": "d3a997e1-ef36-49cc-923f-fa9696e77441"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:24:41.149181 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-83335032-197f-407d-b8d5-d9f1786b858d req-22b86890-5bf2-490a-bbe2-8a0eb802f9f6 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:41.149708 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-83335032-197f-407d-b8d5-d9f1786b858d req-22b86890-5bf2-490a-bbe2-8a0eb802f9f6 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:41.179535 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-83335032-197f-407d-b8d5-d9f1786b858d req-22b86890-5bf2-490a-bbe2-8a0eb802f9f6 service nova] Creating event network-vif-plugged:d3a997e1-ef36-49cc-923f-fa9696e77441 for instance c9e47e97-31f2-41d6-a49b-66efaa974c65 on nch2-master-1 Jul 23 21:24:41.196146 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-83335032-197f-407d-b8d5-d9f1786b858d req-22b86890-5bf2-490a-bbe2-8a0eb802f9f6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055523 Jul 23 21:24:41.197132 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1310/2651] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:24:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:24:41.318613 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-91824d4f-45f1-4d95-b1af-ad74a913bc9c tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:41.321058 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-91824d4f-45f1-4d95-b1af-ad74a913bc9c tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] [instance: f5ac0849-7849-4a9e-8168-130483d564b0] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:41.334121 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-91824d4f-45f1-4d95-b1af-ad74a913bc9c tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:41.334885 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-91824d4f-45f1-4d95-b1af-ad74a913bc9c tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:41.335992 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-91824d4f-45f1-4d95-b1af-ad74a913bc9c tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:41.339310 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-91824d4f-45f1-4d95-b1af-ad74a913bc9c tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:41.540827 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-e2912846-906b-4255-95d6-8e9535d6444d tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013b521930d54d6d952e566f8e67f466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1432b2e152894407afae7b6419d80a8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:41.558265 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-e2912846-906b-4255-95d6-8e9535d6444d tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] 10.222.0.17 "GET /compute/v2.1/servers/011c4ff9-9d46-44df-bf9b-e0269c71c417" status: 200 len: 1667 microversion: 2.1 time: 0.600331 Jul 23 21:24:41.559522 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1342/2652] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:40 2022] GET /compute/v2.1/servers/011c4ff9-9d46-44df-bf9b-e0269c71c417 => generated 1667 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:24:41.573673 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-b36a8245-b4eb-474a-9c3c-2afa280be3c9 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:41.574349 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-b36a8245-b4eb-474a-9c3c-2afa280be3c9 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] [instance: 73362a63-78d8-4890-8588-d112fb85c2bf] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:41.588265 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b36a8245-b4eb-474a-9c3c-2afa280be3c9 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:41.601916 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b36a8245-b4eb-474a-9c3c-2afa280be3c9 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:41.603852 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b36a8245-b4eb-474a-9c3c-2afa280be3c9 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:41.604311 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b36a8245-b4eb-474a-9c3c-2afa280be3c9 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:41.741211 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-b36a8245-b4eb-474a-9c3c-2afa280be3c9 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a609c39c14343e1bc1edd4b3cd56dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116def61aba4631be91f67df63ebab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:41.758634 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-b36a8245-b4eb-474a-9c3c-2afa280be3c9 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] 10.222.0.17 "GET /compute/v2.1/servers/73362a63-78d8-4890-8588-d112fb85c2bf" status: 200 len: 1271 microversion: 2.1 time: 0.197678 Jul 23 21:24:41.760586 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1343/2653] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:41 2022] GET /compute/v2.1/servers/73362a63-78d8-4890-8588-d112fb85c2bf => generated 1271 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:24:41.860931 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-138b3ebb-541b-45a1-b33a-067fd6c7c09e tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:41.862366 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-138b3ebb-541b-45a1-b33a-067fd6c7c09e tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] [instance: c9e47e97-31f2-41d6-a49b-66efaa974c65] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:41.876636 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-138b3ebb-541b-45a1-b33a-067fd6c7c09e tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:41.879634 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-138b3ebb-541b-45a1-b33a-067fd6c7c09e tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:41.881508 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-138b3ebb-541b-45a1-b33a-067fd6c7c09e tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:41.884342 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-138b3ebb-541b-45a1-b33a-067fd6c7c09e tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:41.981067 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-91824d4f-45f1-4d95-b1af-ad74a913bc9c tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e74c139b38d74d9ab93695471ccd3a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ff73d603ec4069a908452514a59451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:41.989551 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-91824d4f-45f1-4d95-b1af-ad74a913bc9c tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] 10.222.0.17 "GET /compute/v2.1/servers/f5ac0849-7849-4a9e-8168-130483d564b0" status: 200 len: 1334 microversion: 2.1 time: 0.675052 Jul 23 21:24:41.995615 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1311/2654] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:41 2022] GET /compute/v2.1/servers/f5ac0849-7849-4a9e-8168-130483d564b0 => generated 1334 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:24:42.128885 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d1015696-60aa-49c7-ad05-d7bbe0b02480 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:42.129776 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d1015696-60aa-49c7-ad05-d7bbe0b02480 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] [instance: 1051c29e-9680-4e26-80f9-b46c3a0dd1f9] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:42.141323 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d1015696-60aa-49c7-ad05-d7bbe0b02480 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:42.142836 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d1015696-60aa-49c7-ad05-d7bbe0b02480 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:42.150769 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d1015696-60aa-49c7-ad05-d7bbe0b02480 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:42.151403 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d1015696-60aa-49c7-ad05-d7bbe0b02480 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:42.341275 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-138b3ebb-541b-45a1-b33a-067fd6c7c09e tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cd8823a2d134f4ea1e31f92e65df040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a136ff692aeb4fdeae12dcacd09b3d6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:42.356467 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-138b3ebb-541b-45a1-b33a-067fd6c7c09e tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] 10.222.0.17 "GET /compute/v2.1/servers/c9e47e97-31f2-41d6-a49b-66efaa974c65" status: 200 len: 1394 microversion: 2.1 time: 0.503285 Jul 23 21:24:42.357456 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1344/2655] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:41 2022] GET /compute/v2.1/servers/c9e47e97-31f2-41d6-a49b-66efaa974c65 => generated 1394 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:24:42.483907 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d1015696-60aa-49c7-ad05-d7bbe0b02480 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8b96ecba600424682ee7d55a16b6675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d6e531d129741b780236ffba8a4c2f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:42.510260 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d1015696-60aa-49c7-ad05-d7bbe0b02480 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] 10.222.0.17 "GET /compute/v2.1/servers/1051c29e-9680-4e26-80f9-b46c3a0dd1f9" status: 200 len: 1316 microversion: 2.1 time: 0.385323 Jul 23 21:24:42.513651 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1312/2656] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:42 2022] GET /compute/v2.1/servers/1051c29e-9680-4e26-80f9-b46c3a0dd1f9 => generated 1316 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:24:42.579359 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-098e1302-14b5-444c-96ae-38905de941f3 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:42.580628 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-098e1302-14b5-444c-96ae-38905de941f3 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] [instance: 011c4ff9-9d46-44df-bf9b-e0269c71c417] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:42.604313 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-098e1302-14b5-444c-96ae-38905de941f3 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:42.605525 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-098e1302-14b5-444c-96ae-38905de941f3 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:42.606928 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-098e1302-14b5-444c-96ae-38905de941f3 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:42.607594 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-098e1302-14b5-444c-96ae-38905de941f3 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:42.644849 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-84d0f309-0a29-44c8-b80d-f0f9ac7c49a9 req-d750c232-2a85-4d54-a254-aeb53c77f3e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "011c4ff9-9d46-44df-bf9b-e0269c71c417", "name": "network-vif-deleted", "tag": "e9103d4a-4c54-4f9a-a910-26edefe5de92"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:24:42.661754 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-84d0f309-0a29-44c8-b80d-f0f9ac7c49a9 req-d750c232-2a85-4d54-a254-aeb53c77f3e4 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:42.662377 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-84d0f309-0a29-44c8-b80d-f0f9ac7c49a9 req-d750c232-2a85-4d54-a254-aeb53c77f3e4 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:42.686328 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-84d0f309-0a29-44c8-b80d-f0f9ac7c49a9 req-d750c232-2a85-4d54-a254-aeb53c77f3e4 service nova] Creating event network-vif-deleted:e9103d4a-4c54-4f9a-a910-26edefe5de92 for instance 011c4ff9-9d46-44df-bf9b-e0269c71c417 on nch1-master-1 Jul 23 21:24:42.717484 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-84d0f309-0a29-44c8-b80d-f0f9ac7c49a9 req-d750c232-2a85-4d54-a254-aeb53c77f3e4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070935 Jul 23 21:24:42.724192 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1313/2657] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:24:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:24:42.782142 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0129d92e-674c-4b5b-86d4-bab9343cf1d9 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:42.782956 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-0129d92e-674c-4b5b-86d4-bab9343cf1d9 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] [instance: 73362a63-78d8-4890-8588-d112fb85c2bf] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:42.801248 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0129d92e-674c-4b5b-86d4-bab9343cf1d9 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:42.801946 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0129d92e-674c-4b5b-86d4-bab9343cf1d9 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:42.802826 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0129d92e-674c-4b5b-86d4-bab9343cf1d9 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:42.803275 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0129d92e-674c-4b5b-86d4-bab9343cf1d9 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:42.922554 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-098e1302-14b5-444c-96ae-38905de941f3 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '013b521930d54d6d952e566f8e67f466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1432b2e152894407afae7b6419d80a8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:42.932724 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-098e1302-14b5-444c-96ae-38905de941f3 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] 10.222.0.17 "GET /compute/v2.1/servers/011c4ff9-9d46-44df-bf9b-e0269c71c417" status: 200 len: 1599 microversion: 2.1 time: 0.359176 Jul 23 21:24:42.933973 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1345/2658] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:42 2022] GET /compute/v2.1/servers/011c4ff9-9d46-44df-bf9b-e0269c71c417 => generated 1599 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:24:43.009951 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-0129d92e-674c-4b5b-86d4-bab9343cf1d9 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a609c39c14343e1bc1edd4b3cd56dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116def61aba4631be91f67df63ebab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:43.012798 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c0a6db4a-497c-4363-83e8-523811fa8855 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:43.013615 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-c0a6db4a-497c-4363-83e8-523811fa8855 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] [instance: f5ac0849-7849-4a9e-8168-130483d564b0] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:43.022679 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-0129d92e-674c-4b5b-86d4-bab9343cf1d9 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] 10.222.0.17 "GET /compute/v2.1/servers/73362a63-78d8-4890-8588-d112fb85c2bf" status: 200 len: 1271 microversion: 2.1 time: 0.249539 Jul 23 21:24:43.024846 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1314/2659] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:42 2022] GET /compute/v2.1/servers/73362a63-78d8-4890-8588-d112fb85c2bf => generated 1271 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:24:43.025329 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c0a6db4a-497c-4363-83e8-523811fa8855 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:43.025846 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c0a6db4a-497c-4363-83e8-523811fa8855 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:43.026906 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c0a6db4a-497c-4363-83e8-523811fa8855 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:43.027352 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c0a6db4a-497c-4363-83e8-523811fa8855 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:43.376812 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c7459d41-ec08-4e11-ac08-367a2e5a43e7 tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:43.377665 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c7459d41-ec08-4e11-ac08-367a2e5a43e7 tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] [instance: c9e47e97-31f2-41d6-a49b-66efaa974c65] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:43.388431 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c7459d41-ec08-4e11-ac08-367a2e5a43e7 tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:43.389260 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c7459d41-ec08-4e11-ac08-367a2e5a43e7 tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:43.390584 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c7459d41-ec08-4e11-ac08-367a2e5a43e7 tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:43.391313 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c7459d41-ec08-4e11-ac08-367a2e5a43e7 tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:43.397759 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c0a6db4a-497c-4363-83e8-523811fa8855 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e74c139b38d74d9ab93695471ccd3a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ff73d603ec4069a908452514a59451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:43.406799 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-c0a6db4a-497c-4363-83e8-523811fa8855 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] 10.222.0.17 "GET /compute/v2.1/servers/f5ac0849-7849-4a9e-8168-130483d564b0" status: 200 len: 1670 microversion: 2.1 time: 0.399484 Jul 23 21:24:43.407496 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1346/2660] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:43 2022] GET /compute/v2.1/servers/f5ac0849-7849-4a9e-8168-130483d564b0 => generated 1670 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:24:43.425534 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-39b706e1-fab5-438e-a5f6-7c568fd1bc79 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:43.426106 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-39b706e1-fab5-438e-a5f6-7c568fd1bc79 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] [instance: f5ac0849-7849-4a9e-8168-130483d564b0] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:43.438308 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-39b706e1-fab5-438e-a5f6-7c568fd1bc79 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:43.438782 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-39b706e1-fab5-438e-a5f6-7c568fd1bc79 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:43.439739 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-39b706e1-fab5-438e-a5f6-7c568fd1bc79 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:43.447386 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-39b706e1-fab5-438e-a5f6-7c568fd1bc79 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:43.508726 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-39b706e1-fab5-438e-a5f6-7c568fd1bc79 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] 10.222.0.17 "GET /compute/v2.1/servers/f5ac0849-7849-4a9e-8168-130483d564b0/ips" status: 200 len: 180 microversion: 2.1 time: 0.087020 Jul 23 21:24:43.509748 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1347/2661] 10.222.0.17 () {58 vars in 1247 bytes} [Sat Jul 23 21:24:43 2022] GET /compute/v2.1/servers/f5ac0849-7849-4a9e-8168-130483d564b0/ips => generated 180 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:24:43.514665 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-58f11d27-57bb-4df7-8340-1569ead680e2 req-496292e1-3411-46c5-b108-beff045bed2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1051c29e-9680-4e26-80f9-b46c3a0dd1f9", "name": "network-vif-plugged", "status": "completed", "tag": "18720ccd-5e17-4fb5-b76e-3ddf8cf9fd5c"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:24:43.527246 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-58f11d27-57bb-4df7-8340-1569ead680e2 req-496292e1-3411-46c5-b108-beff045bed2b service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:43.528352 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-58f11d27-57bb-4df7-8340-1569ead680e2 req-496292e1-3411-46c5-b108-beff045bed2b service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:43.542735 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-58f11d27-57bb-4df7-8340-1569ead680e2 req-496292e1-3411-46c5-b108-beff045bed2b service nova] Creating event network-vif-plugged:18720ccd-5e17-4fb5-b76e-3ddf8cf9fd5c for instance 1051c29e-9680-4e26-80f9-b46c3a0dd1f9 on nch2-master-1 Jul 23 21:24:43.570443 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-58f11d27-57bb-4df7-8340-1569ead680e2 req-496292e1-3411-46c5-b108-beff045bed2b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050816 Jul 23 21:24:43.574181 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1348/2662] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:24:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:24:43.584336 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-4d76f77e-3de6-4353-8e12-0ffd46cd3c3f tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:43.585266 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-4d76f77e-3de6-4353-8e12-0ffd46cd3c3f tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] [instance: f5ac0849-7849-4a9e-8168-130483d564b0] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:43.593772 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4d76f77e-3de6-4353-8e12-0ffd46cd3c3f tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:43.594732 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4d76f77e-3de6-4353-8e12-0ffd46cd3c3f tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:43.596050 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4d76f77e-3de6-4353-8e12-0ffd46cd3c3f tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:43.596854 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4d76f77e-3de6-4353-8e12-0ffd46cd3c3f tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:43.629203 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-4d76f77e-3de6-4353-8e12-0ffd46cd3c3f tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] [instance: f5ac0849-7849-4a9e-8168-130483d564b0] Going to try to terminate instance {{(pid=131321) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:24:43.664347 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c7459d41-ec08-4e11-ac08-367a2e5a43e7 tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cd8823a2d134f4ea1e31f92e65df040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a136ff692aeb4fdeae12dcacd09b3d6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:43.676351 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c7459d41-ec08-4e11-ac08-367a2e5a43e7 tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] 10.222.0.17 "GET /compute/v2.1/servers/c9e47e97-31f2-41d6-a49b-66efaa974c65" status: 200 len: 1574 microversion: 2.1 time: 0.306723 Jul 23 21:24:43.678466 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1315/2663] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:43 2022] GET /compute/v2.1/servers/c9e47e97-31f2-41d6-a49b-66efaa974c65 => generated 1574 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:24:43.693199 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-dd5f1a08-98c5-4ec6-843b-a01dab3ce1bf tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:43.695470 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-dd5f1a08-98c5-4ec6-843b-a01dab3ce1bf tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] [instance: 1051c29e-9680-4e26-80f9-b46c3a0dd1f9] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:43.716403 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dd5f1a08-98c5-4ec6-843b-a01dab3ce1bf tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:43.723517 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dd5f1a08-98c5-4ec6-843b-a01dab3ce1bf tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:43.724542 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dd5f1a08-98c5-4ec6-843b-a01dab3ce1bf tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:43.728473 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dd5f1a08-98c5-4ec6-843b-a01dab3ce1bf tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:43.803391 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-4d76f77e-3de6-4353-8e12-0ffd46cd3c3f tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] 10.222.0.17 "DELETE /compute/v2.1/servers/f5ac0849-7849-4a9e-8168-130483d564b0" status: 204 len: 0 microversion: 2.1 time: 0.227087 Jul 23 21:24:43.804346 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1349/2664] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:24:43 2022] DELETE /compute/v2.1/servers/f5ac0849-7849-4a9e-8168-130483d564b0 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:24:43.809922 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-eb33b879-8c37-4ff7-9447-28bcc320e03c tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:43.810513 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-eb33b879-8c37-4ff7-9447-28bcc320e03c tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] [instance: c9e47e97-31f2-41d6-a49b-66efaa974c65] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:43.817779 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-eb33b879-8c37-4ff7-9447-28bcc320e03c tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:43.818122 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-eb33b879-8c37-4ff7-9447-28bcc320e03c tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:43.819106 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-eb33b879-8c37-4ff7-9447-28bcc320e03c tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:43.819700 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-eb33b879-8c37-4ff7-9447-28bcc320e03c tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:44.005463 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-dd5f1a08-98c5-4ec6-843b-a01dab3ce1bf tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8b96ecba600424682ee7d55a16b6675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d6e531d129741b780236ffba8a4c2f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:44.014474 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-dd5f1a08-98c5-4ec6-843b-a01dab3ce1bf tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] 10.222.0.17 "GET /compute/v2.1/servers/1051c29e-9680-4e26-80f9-b46c3a0dd1f9" status: 200 len: 1316 microversion: 2.1 time: 0.334869 Jul 23 21:24:44.015066 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1316/2665] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:43 2022] GET /compute/v2.1/servers/1051c29e-9680-4e26-80f9-b46c3a0dd1f9 => generated 1316 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:24:44.024726 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-91dd3312-c269-42df-bb0b-287994a07b94 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:44.025396 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-91dd3312-c269-42df-bb0b-287994a07b94 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] [instance: f5ac0849-7849-4a9e-8168-130483d564b0] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:44.038761 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-91dd3312-c269-42df-bb0b-287994a07b94 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:44.039452 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-91dd3312-c269-42df-bb0b-287994a07b94 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:44.041020 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-91dd3312-c269-42df-bb0b-287994a07b94 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:44.041589 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-91dd3312-c269-42df-bb0b-287994a07b94 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:44.115422 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-eb33b879-8c37-4ff7-9447-28bcc320e03c tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] 10.222.0.17 "GET /compute/v2.1/servers/c9e47e97-31f2-41d6-a49b-66efaa974c65/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.303311 Jul 23 21:24:44.116109 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1350/2666] 10.222.0.17 () {58 vars in 1274 bytes} [Sat Jul 23 21:24:43 2022] GET /compute/v2.1/servers/c9e47e97-31f2-41d6-a49b-66efaa974c65/os-interface => generated 284 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:24:44.127356 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-83e4f5cc-ed83-448e-9af9-47f92f20c50e tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:44.128133 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-83e4f5cc-ed83-448e-9af9-47f92f20c50e tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] [instance: 011c4ff9-9d46-44df-bf9b-e0269c71c417] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:44.145785 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-83e4f5cc-ed83-448e-9af9-47f92f20c50e tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:44.146562 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-83e4f5cc-ed83-448e-9af9-47f92f20c50e tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:44.147541 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-83e4f5cc-ed83-448e-9af9-47f92f20c50e tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:44.148138 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-83e4f5cc-ed83-448e-9af9-47f92f20c50e tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:44.153760 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:24:44.172011 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-83e4f5cc-ed83-448e-9af9-47f92f20c50e tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] HTTP exception thrown: Instance 011c4ff9-9d46-44df-bf9b-e0269c71c417 could not be found. Jul 23 21:24:44.174202 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-83e4f5cc-ed83-448e-9af9-47f92f20c50e tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Request method failure captured: Jul 23 21:24:44.174202 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/servers/011c4ff9-9d46-44df-bf9b-e0269c71c417 HTTP/1.1 Jul 23 21:24:44.174202 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:24:44.174202 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:24:44.174202 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:24:44.174202 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:24:44.174202 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:24:44.174202 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:24:44.174202 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:24:44.174202 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:24:44.174202 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GbWw5iovtdAnoS9tX38AMg2R_LvYHc4AqsNz9Xur-HTfmWbhTYjoxtJInuyXs_Aj2ReVBCSLh7yUyn7bk1cAjCisnaF3XjTEE7mJfmznD1iK24KiR1DYRy26f4PE0A6BxQr2OIhyV8EvNHILnUlViDA-vz1eWzKwuC5brpITkI5F-4 Jul 23 21:24:44.174202 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:24:44.174202 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:24:44.174202 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:24:44.174202 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:24:44.174202 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:24:44.174202 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:24:44.174202 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 1432b2e152894407afae7b6419d80a8c Jul 23 21:24:44.174202 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ServersTestFqdnHostnames-602868332 Jul 23 21:24:44.174202 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:24:44.174202 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:24:44.174202 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1432b2e152894407afae7b6419d80a8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1432b2e152894407afae7b6419d80a8c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1432b2e152894407afae7b6419d80a8c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1432b2e152894407afae7b6419d80a8c"}]}] Jul 23 21:24:44.174202 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ServersTestFqdnHostnames-602868332 Jul 23 21:24:44.174202 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 1432b2e152894407afae7b6419d80a8c Jul 23 21:24:44.174202 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-602868332 Jul 23 21:24:44.174202 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ServersTestFqdnHostnames-602868332-project Jul 23 21:24:44.174202 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:24:44.174202 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:24:44.174202 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 013b521930d54d6d952e566f8e67f466 Jul 23 21:24:44.174202 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ServersTestFqdnHostnames-602868332-project Jul 23 21:24:44.174202 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:24:44.174202 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance 011c4ff9-9d46-44df-bf9b-e0269c71c417 could not be found. Jul 23 21:24:44.174202 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': '011c4ff9-9d46-44df-bf9b-e0269c71c417'} Jul 23 21:24:44.174202 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:24:44.174202 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:24:44.174202 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:24:44.174202 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:24:44.174202 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:24:44.174202 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:24:44.174202 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:24:44.174202 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:24:44.174202 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:24:44.174202 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:24:44.174202 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 011c4ff9-9d46-44df-bf9b-e0269c71c417 could not be found. Jul 23 21:24:44.174202 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:24:44.174202 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:24:44.174202 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:24:44.174202 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:24:44.174202 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:24:44.174202 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:24:44.174202 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:24:44.174202 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:24:44.174202 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:24:44.174202 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:24:44.174202 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:24:44.174202 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:24:44.174202 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:24:44.174202 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:24:44.174202 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:24:44.174202 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:24:44.174202 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 011c4ff9-9d46-44df-bf9b-e0269c71c417 could not be found. Jul 23 21:24:44.174202 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:24:44.174202 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:24:44.174202 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:24:44.180180 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:24:44.180180 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:24:44.180180 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:24:44.180180 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:24:44.180180 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:24:44.180180 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 011c4ff9-9d46-44df-bf9b-e0269c71c417 could not be found. Jul 23 21:24:44.180180 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:24:44.181835 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-83e4f5cc-ed83-448e-9af9-47f92f20c50e tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Returning 404 to user: Instance 011c4ff9-9d46-44df-bf9b-e0269c71c417 could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:24:44.183076 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-83e4f5cc-ed83-448e-9af9-47f92f20c50e tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] 10.222.0.17 "GET /compute/v2.1/servers/011c4ff9-9d46-44df-bf9b-e0269c71c417" status: 404 len: 111 microversion: 2.1 time: 0.062224 Jul 23 21:24:44.183821 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1351/2667] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:44 2022] GET /compute/v2.1/servers/011c4ff9-9d46-44df-bf9b-e0269c71c417 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:24:44.189629 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-50196311-0c5e-4cfd-a510-0f0fd62899ff tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:44.193834 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-50196311-0c5e-4cfd-a510-0f0fd62899ff tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] [instance: 73362a63-78d8-4890-8588-d112fb85c2bf] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:44.200501 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-50196311-0c5e-4cfd-a510-0f0fd62899ff tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:44.202346 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-50196311-0c5e-4cfd-a510-0f0fd62899ff tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:44.203337 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-50196311-0c5e-4cfd-a510-0f0fd62899ff tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:44.203932 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-50196311-0c5e-4cfd-a510-0f0fd62899ff tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:44.253334 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-91dd3312-c269-42df-bb0b-287994a07b94 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e74c139b38d74d9ab93695471ccd3a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ff73d603ec4069a908452514a59451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:44.268612 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-91dd3312-c269-42df-bb0b-287994a07b94 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] 10.222.0.17 "GET /compute/v2.1/servers/f5ac0849-7849-4a9e-8168-130483d564b0" status: 200 len: 1676 microversion: 2.1 time: 0.251798 Jul 23 21:24:44.269681 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1317/2668] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:44 2022] GET /compute/v2.1/servers/f5ac0849-7849-4a9e-8168-130483d564b0 => generated 1676 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:24:44.274614 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-fed578c0-a22d-489b-a52e-0504ef43a7b0 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] Calling method '.version_select at 0x7f0b54acaa60>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:44.296268 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-fed578c0-a22d-489b-a52e-0504ef43a7b0 tempest-ServersTestFqdnHostnames-602868332 tempest-ServersTestFqdnHostnames-602868332-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1667120724" status: 202 len: 0 microversion: 2.1 time: 0.025228 Jul 23 21:24:44.296930 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1318/2669] 10.222.0.17 () {58 vars in 1220 bytes} [Sat Jul 23 21:24:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1667120724 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:24:44.754989 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-50196311-0c5e-4cfd-a510-0f0fd62899ff tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a609c39c14343e1bc1edd4b3cd56dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116def61aba4631be91f67df63ebab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:44.765774 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-50196311-0c5e-4cfd-a510-0f0fd62899ff tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] 10.222.0.17 "GET /compute/v2.1/servers/73362a63-78d8-4890-8588-d112fb85c2bf" status: 200 len: 1313 microversion: 2.1 time: 0.580453 Jul 23 21:24:44.786541 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1352/2670] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:44 2022] GET /compute/v2.1/servers/73362a63-78d8-4890-8588-d112fb85c2bf => generated 1313 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:24:45.031652 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a788c2dc-bdcf-41eb-bf1f-17c10cd440cf tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:45.034242 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a788c2dc-bdcf-41eb-bf1f-17c10cd440cf tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] [instance: 1051c29e-9680-4e26-80f9-b46c3a0dd1f9] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:45.058075 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a788c2dc-bdcf-41eb-bf1f-17c10cd440cf tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:45.058909 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a788c2dc-bdcf-41eb-bf1f-17c10cd440cf tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:45.060002 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a788c2dc-bdcf-41eb-bf1f-17c10cd440cf tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:45.060653 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a788c2dc-bdcf-41eb-bf1f-17c10cd440cf tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:45.286785 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a91e5843-d965-4fe8-8a4e-8394f63efd22 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:45.287983 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-a91e5843-d965-4fe8-8a4e-8394f63efd22 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] [instance: f5ac0849-7849-4a9e-8168-130483d564b0] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:45.300277 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a91e5843-d965-4fe8-8a4e-8394f63efd22 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:45.301068 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a91e5843-d965-4fe8-8a4e-8394f63efd22 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:45.302071 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a91e5843-d965-4fe8-8a4e-8394f63efd22 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:45.302719 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a91e5843-d965-4fe8-8a4e-8394f63efd22 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:45.713167 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a788c2dc-bdcf-41eb-bf1f-17c10cd440cf tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8b96ecba600424682ee7d55a16b6675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d6e531d129741b780236ffba8a4c2f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:45.721622 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a788c2dc-bdcf-41eb-bf1f-17c10cd440cf tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] 10.222.0.17 "GET /compute/v2.1/servers/1051c29e-9680-4e26-80f9-b46c3a0dd1f9" status: 200 len: 1505 microversion: 2.1 time: 0.693800 Jul 23 21:24:45.722481 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1319/2671] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:45 2022] GET /compute/v2.1/servers/1051c29e-9680-4e26-80f9-b46c3a0dd1f9 => generated 1505 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:24:45.741692 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a1c6e3e8-0cb2-4173-b848-698a66dba9fb tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:45.742563 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a1c6e3e8-0cb2-4173-b848-698a66dba9fb tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] [instance: 1051c29e-9680-4e26-80f9-b46c3a0dd1f9] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:45.749646 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a1c6e3e8-0cb2-4173-b848-698a66dba9fb tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:45.750248 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a1c6e3e8-0cb2-4173-b848-698a66dba9fb tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:45.751089 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a1c6e3e8-0cb2-4173-b848-698a66dba9fb tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:45.751589 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a1c6e3e8-0cb2-4173-b848-698a66dba9fb tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:45.794817 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a1c6e3e8-0cb2-4173-b848-698a66dba9fb tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': 'b8b96ecba600424682ee7d55a16b6675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d6e531d129741b780236ffba8a4c2f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:45.796444 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a1c6e3e8-0cb2-4173-b848-698a66dba9fb tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] 10.222.0.17 "GET /compute/v2.1/servers/1051c29e-9680-4e26-80f9-b46c3a0dd1f9/os-instance-actions/req-b1d7a7a7-f9ee-4a57-9d0a-9bdb31190ce8" status: 200 len: 313 microversion: 2.1 time: 0.060428 Jul 23 21:24:45.803673 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1320/2672] 10.222.0.17 () {58 vars in 1418 bytes} [Sat Jul 23 21:24:45 2022] GET /compute/v2.1/servers/1051c29e-9680-4e26-80f9-b46c3a0dd1f9/os-instance-actions/req-b1d7a7a7-f9ee-4a57-9d0a-9bdb31190ce8 => generated 313 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:24:45.803673 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-99168120-ab74-467f-99d3-23e5a47cf3da tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:45.804728 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-99168120-ab74-467f-99d3-23e5a47cf3da tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] [instance: 73362a63-78d8-4890-8588-d112fb85c2bf] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:45.812853 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-99168120-ab74-467f-99d3-23e5a47cf3da tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:45.813482 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-99168120-ab74-467f-99d3-23e5a47cf3da tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:45.814447 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-99168120-ab74-467f-99d3-23e5a47cf3da tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:45.815033 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-99168120-ab74-467f-99d3-23e5a47cf3da tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:46.063205 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-a91e5843-d965-4fe8-8a4e-8394f63efd22 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e74c139b38d74d9ab93695471ccd3a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ff73d603ec4069a908452514a59451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:46.075210 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-a91e5843-d965-4fe8-8a4e-8394f63efd22 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] 10.222.0.17 "GET /compute/v2.1/servers/f5ac0849-7849-4a9e-8168-130483d564b0" status: 200 len: 1676 microversion: 2.1 time: 0.792804 Jul 23 21:24:46.087260 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1353/2673] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:45 2022] GET /compute/v2.1/servers/f5ac0849-7849-4a9e-8168-130483d564b0 => generated 1676 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:24:46.092898 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-18241a91-7bf8-4a86-acd1-2d3dc86f4f9b tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:24:46.094209 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-18241a91-7bf8-4a86-acd1-2d3dc86f4f9b tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] [instance: 1051c29e-9680-4e26-80f9-b46c3a0dd1f9] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:46.100985 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-18241a91-7bf8-4a86-acd1-2d3dc86f4f9b tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:46.101687 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-18241a91-7bf8-4a86-acd1-2d3dc86f4f9b tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:46.102806 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-18241a91-7bf8-4a86-acd1-2d3dc86f4f9b tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:46.103401 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-18241a91-7bf8-4a86-acd1-2d3dc86f4f9b tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:46.122152 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-99168120-ab74-467f-99d3-23e5a47cf3da tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a609c39c14343e1bc1edd4b3cd56dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116def61aba4631be91f67df63ebab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:46.137132 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-99168120-ab74-467f-99d3-23e5a47cf3da tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] 10.222.0.17 "GET /compute/v2.1/servers/73362a63-78d8-4890-8588-d112fb85c2bf" status: 200 len: 1313 microversion: 2.1 time: 0.336022 Jul 23 21:24:46.142581 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1321/2674] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:45 2022] GET /compute/v2.1/servers/73362a63-78d8-4890-8588-d112fb85c2bf => generated 1313 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:24:46.209217 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-18241a91-7bf8-4a86-acd1-2d3dc86f4f9b tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] 10.222.0.17 "POST /compute/v2.1/servers/1051c29e-9680-4e26-80f9-b46c3a0dd1f9/action" status: 202 len: 0 microversion: 2.1 time: 0.120160 Jul 23 21:24:46.210792 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1354/2675] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:24:46 2022] POST /compute/v2.1/servers/1051c29e-9680-4e26-80f9-b46c3a0dd1f9/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:24:46.221657 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-dc16cbf9-90aa-440a-a91f-e3f69f9c6d80 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:46.223056 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-dc16cbf9-90aa-440a-a91f-e3f69f9c6d80 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] [instance: 1051c29e-9680-4e26-80f9-b46c3a0dd1f9] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:46.228873 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:24:46.234510 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-dc16cbf9-90aa-440a-a91f-e3f69f9c6d80 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:46.235371 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-dc16cbf9-90aa-440a-a91f-e3f69f9c6d80 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:46.236695 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-dc16cbf9-90aa-440a-a91f-e3f69f9c6d80 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:46.238214 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-dc16cbf9-90aa-440a-a91f-e3f69f9c6d80 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:46.247260 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d92828bd-985c-4430-a905-bc8e2eb5fdc2 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1401225881", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "networks": [{"uuid": "b32dd772-4f2a-4847-b3c5-349ce055ea43"}]}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:24:46.352448 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-d92828bd-985c-4430-a905-bc8e2eb5fdc2 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] validate_networks() for [('b32dd772-4f2a-4847-b3c5-349ce055ea43', None, None, None, None, None)] {{(pid=131320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:24:46.618997 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-dc16cbf9-90aa-440a-a91f-e3f69f9c6d80 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8b96ecba600424682ee7d55a16b6675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d6e531d129741b780236ffba8a4c2f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:46.628941 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-dc16cbf9-90aa-440a-a91f-e3f69f9c6d80 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] 10.222.0.17 "GET /compute/v2.1/servers/1051c29e-9680-4e26-80f9-b46c3a0dd1f9" status: 200 len: 1507 microversion: 2.1 time: 0.413122 Jul 23 21:24:46.631592 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1355/2676] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:46 2022] GET /compute/v2.1/servers/1051c29e-9680-4e26-80f9-b46c3a0dd1f9 => generated 1507 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:24:46.998196 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-414cb5d4-5297-48af-9a69-0b8081951a0c tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:46.999280 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-414cb5d4-5297-48af-9a69-0b8081951a0c tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] [instance: c9e47e97-31f2-41d6-a49b-66efaa974c65] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:47.010150 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-414cb5d4-5297-48af-9a69-0b8081951a0c tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:47.013572 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-414cb5d4-5297-48af-9a69-0b8081951a0c tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:47.014464 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-414cb5d4-5297-48af-9a69-0b8081951a0c tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:47.015397 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-414cb5d4-5297-48af-9a69-0b8081951a0c tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:47.377291 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-414cb5d4-5297-48af-9a69-0b8081951a0c tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cd8823a2d134f4ea1e31f92e65df040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a136ff692aeb4fdeae12dcacd09b3d6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:47.390423 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-414cb5d4-5297-48af-9a69-0b8081951a0c tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] 10.222.0.17 "GET /compute/v2.1/servers/c9e47e97-31f2-41d6-a49b-66efaa974c65" status: 200 len: 1574 microversion: 2.1 time: 0.395696 Jul 23 21:24:47.391659 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1356/2677] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:46 2022] GET /compute/v2.1/servers/c9e47e97-31f2-41d6-a49b-66efaa974c65 => generated 1574 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:24:47.404447 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-57bf1232-fb8a-4892-821f-b8f346ac05b8 req-8a3873a0-963a-452a-9163-57b3cad55c01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9e47e97-31f2-41d6-a49b-66efaa974c65", "tag": "d3a997e1-ef36-49cc-923f-fa9696e77441"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:24:47.427759 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-57bf1232-fb8a-4892-821f-b8f346ac05b8 req-8a3873a0-963a-452a-9163-57b3cad55c01 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:47.428574 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-57bf1232-fb8a-4892-821f-b8f346ac05b8 req-8a3873a0-963a-452a-9163-57b3cad55c01 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:47.460404 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-57bf1232-fb8a-4892-821f-b8f346ac05b8 req-8a3873a0-963a-452a-9163-57b3cad55c01 service nova] Creating event network-changed:d3a997e1-ef36-49cc-923f-fa9696e77441 for instance c9e47e97-31f2-41d6-a49b-66efaa974c65 on nch2-master-1 Jul 23 21:24:47.472732 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-57bf1232-fb8a-4892-821f-b8f346ac05b8 req-8a3873a0-963a-452a-9163-57b3cad55c01 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079627 Jul 23 21:24:47.475357 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1357/2678] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:24:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:24:47.492388 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-1f338b3d-3a7e-4966-aa5d-7fb14a737afa tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:47.493824 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-1f338b3d-3a7e-4966-aa5d-7fb14a737afa tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] [instance: f5ac0849-7849-4a9e-8168-130483d564b0] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:47.501903 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1f338b3d-3a7e-4966-aa5d-7fb14a737afa tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:47.502910 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1f338b3d-3a7e-4966-aa5d-7fb14a737afa tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:47.503939 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1f338b3d-3a7e-4966-aa5d-7fb14a737afa tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:47.504586 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1f338b3d-3a7e-4966-aa5d-7fb14a737afa tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:47.982248 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=10 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:24:47.989788 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-1f338b3d-3a7e-4966-aa5d-7fb14a737afa tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e74c139b38d74d9ab93695471ccd3a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ff73d603ec4069a908452514a59451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:47.998803 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-1f338b3d-3a7e-4966-aa5d-7fb14a737afa tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] 10.222.0.17 "GET /compute/v2.1/servers/f5ac0849-7849-4a9e-8168-130483d564b0" status: 200 len: 1655 microversion: 2.1 time: 0.519835 Jul 23 21:24:48.010716 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1358/2679] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:47 2022] GET /compute/v2.1/servers/f5ac0849-7849-4a9e-8168-130483d564b0 => generated 1655 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:24:48.017295 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-4935b695-ee32-43be-bab6-c4b55f7a425a tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:48.030881 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-4935b695-ee32-43be-bab6-c4b55f7a425a tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] [instance: 73362a63-78d8-4890-8588-d112fb85c2bf] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:48.036401 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-d92828bd-985c-4430-a905-bc8e2eb5fdc2 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:24:48.037022 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-d92828bd-985c-4430-a905-bc8e2eb5fdc2 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:24:48.037576 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-d92828bd-985c-4430-a905-bc8e2eb5fdc2 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:24:48.038094 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-d92828bd-985c-4430-a905-bc8e2eb5fdc2 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:24:48.038342 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4935b695-ee32-43be-bab6-c4b55f7a425a tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:48.038657 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-d92828bd-985c-4430-a905-bc8e2eb5fdc2 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:24:48.039119 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4935b695-ee32-43be-bab6-c4b55f7a425a tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:48.040132 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4935b695-ee32-43be-bab6-c4b55f7a425a tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:48.040723 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4935b695-ee32-43be-bab6-c4b55f7a425a tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:48.059825 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d92828bd-985c-4430-a905-bc8e2eb5fdc2 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:48.060381 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d92828bd-985c-4430-a905-bc8e2eb5fdc2 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:48.063104 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d92828bd-985c-4430-a905-bc8e2eb5fdc2 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:48.065610 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d92828bd-985c-4430-a905-bc8e2eb5fdc2 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:48.104421 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-d92828bd-985c-4430-a905-bc8e2eb5fdc2 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Getting quotas for project 8305585b60d54beeb2b087a37260a89a. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:24:48.115979 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-d92828bd-985c-4430-a905-bc8e2eb5fdc2 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Getting quotas for user e961e46ab94f4fffbc606485935ce64d and project 8305585b60d54beeb2b087a37260a89a. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:24:48.146820 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d92828bd-985c-4430-a905-bc8e2eb5fdc2 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Going to run 1 instances... {{(pid=131320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:24:48.152937 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d92828bd-985c-4430-a905-bc8e2eb5fdc2 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] [instance: d73bae1c-be56-4a5e-8e8d-56683aae946a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:24:48.268164 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d92828bd-985c-4430-a905-bc8e2eb5fdc2 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.123894 Jul 23 21:24:48.268838 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1322/2680] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:24:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 2125 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 23 21:24:48.285734 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-799727e7-b524-4126-afe8-f1f2de1c0f1e tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:48.286736 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-799727e7-b524-4126-afe8-f1f2de1c0f1e tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] [instance: 1051c29e-9680-4e26-80f9-b46c3a0dd1f9] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:48.299818 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-799727e7-b524-4126-afe8-f1f2de1c0f1e tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:48.311901 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-799727e7-b524-4126-afe8-f1f2de1c0f1e tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:48.313531 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-799727e7-b524-4126-afe8-f1f2de1c0f1e tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:48.314259 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-799727e7-b524-4126-afe8-f1f2de1c0f1e tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:48.500166 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-4935b695-ee32-43be-bab6-c4b55f7a425a tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a609c39c14343e1bc1edd4b3cd56dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116def61aba4631be91f67df63ebab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:48.512717 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-4935b695-ee32-43be-bab6-c4b55f7a425a tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] 10.222.0.17 "GET /compute/v2.1/servers/73362a63-78d8-4890-8588-d112fb85c2bf" status: 200 len: 1313 microversion: 2.1 time: 0.500507 Jul 23 21:24:48.513327 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1359/2681] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:48 2022] GET /compute/v2.1/servers/73362a63-78d8-4890-8588-d112fb85c2bf => generated 1313 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:24:48.554303 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-a7f83ff3-74dc-4ca0-9286-fd49f179a652 req-0f26ef7a-073e-40de-a39d-01ffda108953 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5ac0849-7849-4a9e-8168-130483d564b0", "name": "network-vif-deleted", "tag": "4aa4d60b-2311-4afc-9675-e0c5b4acc98a"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:24:48.563648 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-a7f83ff3-74dc-4ca0-9286-fd49f179a652 req-0f26ef7a-073e-40de-a39d-01ffda108953 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:48.564518 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-a7f83ff3-74dc-4ca0-9286-fd49f179a652 req-0f26ef7a-073e-40de-a39d-01ffda108953 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:48.593016 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-a7f83ff3-74dc-4ca0-9286-fd49f179a652 req-0f26ef7a-073e-40de-a39d-01ffda108953 service nova] Creating event network-vif-deleted:4aa4d60b-2311-4afc-9675-e0c5b4acc98a for instance f5ac0849-7849-4a9e-8168-130483d564b0 on nch1-master-1 Jul 23 21:24:48.603380 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-a7f83ff3-74dc-4ca0-9286-fd49f179a652 req-0f26ef7a-073e-40de-a39d-01ffda108953 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071004 Jul 23 21:24:48.605654 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1360/2682] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:24:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:24:48.636535 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-cec8ea4e-f766-4432-a155-d22b1faceec2 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:48.637812 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-cec8ea4e-f766-4432-a155-d22b1faceec2 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] [instance: d73bae1c-be56-4a5e-8e8d-56683aae946a] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:48.828738 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-cec8ea4e-f766-4432-a155-d22b1faceec2 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961e46ab94f4fffbc606485935ce64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8305585b60d54beeb2b087a37260a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:48.841616 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-cec8ea4e-f766-4432-a155-d22b1faceec2 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] 10.222.0.17 "GET /compute/v2.1/servers/d73bae1c-be56-4a5e-8e8d-56683aae946a" status: 200 len: 1225 microversion: 2.1 time: 0.233855 Jul 23 21:24:48.854632 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1361/2683] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:48 2022] GET /compute/v2.1/servers/d73bae1c-be56-4a5e-8e8d-56683aae946a => generated 1225 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:24:49.030977 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ddfb3b35-4c10-427b-900d-9e22759f42ce tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:49.031674 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-ddfb3b35-4c10-427b-900d-9e22759f42ce tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] [instance: f5ac0849-7849-4a9e-8168-130483d564b0] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:49.053415 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ddfb3b35-4c10-427b-900d-9e22759f42ce tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:49.056041 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ddfb3b35-4c10-427b-900d-9e22759f42ce tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:49.064514 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ddfb3b35-4c10-427b-900d-9e22759f42ce tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:49.069185 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ddfb3b35-4c10-427b-900d-9e22759f42ce tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:49.233039 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-799727e7-b524-4126-afe8-f1f2de1c0f1e tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8b96ecba600424682ee7d55a16b6675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d6e531d129741b780236ffba8a4c2f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:49.244107 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-799727e7-b524-4126-afe8-f1f2de1c0f1e tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] 10.222.0.17 "GET /compute/v2.1/servers/1051c29e-9680-4e26-80f9-b46c3a0dd1f9" status: 200 len: 1507 microversion: 2.1 time: 0.973558 Jul 23 21:24:49.255986 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1323/2684] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:48 2022] GET /compute/v2.1/servers/1051c29e-9680-4e26-80f9-b46c3a0dd1f9 => generated 1507 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:24:49.460717 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ddfb3b35-4c10-427b-900d-9e22759f42ce tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e74c139b38d74d9ab93695471ccd3a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ff73d603ec4069a908452514a59451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:49.468035 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-ddfb3b35-4c10-427b-900d-9e22759f42ce tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] 10.222.0.17 "GET /compute/v2.1/servers/f5ac0849-7849-4a9e-8168-130483d564b0" status: 200 len: 1496 microversion: 2.1 time: 0.444429 Jul 23 21:24:49.468648 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1362/2685] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:49 2022] GET /compute/v2.1/servers/f5ac0849-7849-4a9e-8168-130483d564b0 => generated 1496 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:24:49.511928 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-8674416d-9970-46af-89a5-da4cf1d53d5f req-e64f1058-9e81-4614-8584-a4861c06202b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73362a63-78d8-4890-8588-d112fb85c2bf", "tag": "53cbd32e-7839-4bd5-bd13-f1cc7de68a33"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:24:49.521456 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-8674416d-9970-46af-89a5-da4cf1d53d5f req-e64f1058-9e81-4614-8584-a4861c06202b service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:49.522334 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-8674416d-9970-46af-89a5-da4cf1d53d5f req-e64f1058-9e81-4614-8584-a4861c06202b service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:49.528843 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-214281c9-ca82-4ce3-a4c4-ee7072165c08 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:49.529752 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-214281c9-ca82-4ce3-a4c4-ee7072165c08 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] [instance: 73362a63-78d8-4890-8588-d112fb85c2bf] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:49.545679 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-214281c9-ca82-4ce3-a4c4-ee7072165c08 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:49.547133 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-214281c9-ca82-4ce3-a4c4-ee7072165c08 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:49.549822 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-214281c9-ca82-4ce3-a4c4-ee7072165c08 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:49.550255 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-214281c9-ca82-4ce3-a4c4-ee7072165c08 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:49.583657 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-8674416d-9970-46af-89a5-da4cf1d53d5f req-e64f1058-9e81-4614-8584-a4861c06202b service nova] Creating event network-changed:53cbd32e-7839-4bd5-bd13-f1cc7de68a33 for instance 73362a63-78d8-4890-8588-d112fb85c2bf on nch1-master-1 Jul 23 21:24:49.596099 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-8674416d-9970-46af-89a5-da4cf1d53d5f req-e64f1058-9e81-4614-8584-a4861c06202b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088841 Jul 23 21:24:49.598530 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1324/2686] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:24:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:24:49.770232 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-214281c9-ca82-4ce3-a4c4-ee7072165c08 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a609c39c14343e1bc1edd4b3cd56dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116def61aba4631be91f67df63ebab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:49.782619 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-214281c9-ca82-4ce3-a4c4-ee7072165c08 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] 10.222.0.17 "GET /compute/v2.1/servers/73362a63-78d8-4890-8588-d112fb85c2bf" status: 200 len: 1313 microversion: 2.1 time: 0.257278 Jul 23 21:24:49.783889 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1363/2687] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:49 2022] GET /compute/v2.1/servers/73362a63-78d8-4890-8588-d112fb85c2bf => generated 1313 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:24:49.862276 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-35ff357c-6e58-46fe-acc1-0bc0efb62dd7 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:49.863286 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-35ff357c-6e58-46fe-acc1-0bc0efb62dd7 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] [instance: d73bae1c-be56-4a5e-8e8d-56683aae946a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:49.875202 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-35ff357c-6e58-46fe-acc1-0bc0efb62dd7 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:49.878912 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-35ff357c-6e58-46fe-acc1-0bc0efb62dd7 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:49.880117 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-35ff357c-6e58-46fe-acc1-0bc0efb62dd7 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:49.880380 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-35ff357c-6e58-46fe-acc1-0bc0efb62dd7 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:50.005112 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-35ff357c-6e58-46fe-acc1-0bc0efb62dd7 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961e46ab94f4fffbc606485935ce64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8305585b60d54beeb2b087a37260a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:50.014532 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-35ff357c-6e58-46fe-acc1-0bc0efb62dd7 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] 10.222.0.17 "GET /compute/v2.1/servers/d73bae1c-be56-4a5e-8e8d-56683aae946a" status: 200 len: 1221 microversion: 2.1 time: 0.156873 Jul 23 21:24:50.016011 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1325/2688] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:49 2022] GET /compute/v2.1/servers/d73bae1c-be56-4a5e-8e8d-56683aae946a => generated 1221 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:24:50.273773 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a7f943f0-947a-47ce-831a-f82a6e6e503c tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:50.275209 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-a7f943f0-947a-47ce-831a-f82a6e6e503c tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] [instance: 1051c29e-9680-4e26-80f9-b46c3a0dd1f9] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:50.283789 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a7f943f0-947a-47ce-831a-f82a6e6e503c tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:50.284604 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a7f943f0-947a-47ce-831a-f82a6e6e503c tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:50.285485 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a7f943f0-947a-47ce-831a-f82a6e6e503c tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:50.286013 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a7f943f0-947a-47ce-831a-f82a6e6e503c tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:50.432203 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-a7f943f0-947a-47ce-831a-f82a6e6e503c tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8b96ecba600424682ee7d55a16b6675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d6e531d129741b780236ffba8a4c2f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:50.441090 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-a7f943f0-947a-47ce-831a-f82a6e6e503c tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] 10.222.0.17 "GET /compute/v2.1/servers/1051c29e-9680-4e26-80f9-b46c3a0dd1f9" status: 200 len: 1505 microversion: 2.1 time: 0.172774 Jul 23 21:24:50.444389 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1364/2689] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:50 2022] GET /compute/v2.1/servers/1051c29e-9680-4e26-80f9-b46c3a0dd1f9 => generated 1505 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:24:50.473108 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c656b625-519b-44af-aca2-4b4845f63af6 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Calling method '.version_select at 0x7f0b47e7d430>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:50.479329 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c656b625-519b-44af-aca2-4b4845f63af6 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] [instance: 1051c29e-9680-4e26-80f9-b46c3a0dd1f9] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:50.499788 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c656b625-519b-44af-aca2-4b4845f63af6 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:50.500094 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-4e946e55-4e6a-41a6-9444-090f8eee3339 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:50.501837 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-4e946e55-4e6a-41a6-9444-090f8eee3339 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] [instance: f5ac0849-7849-4a9e-8168-130483d564b0] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:50.502091 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c656b625-519b-44af-aca2-4b4845f63af6 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:50.504882 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c656b625-519b-44af-aca2-4b4845f63af6 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:50.505598 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c656b625-519b-44af-aca2-4b4845f63af6 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:50.523128 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=100 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:24:50.527266 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4e946e55-4e6a-41a6-9444-090f8eee3339 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:50.534005 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4e946e55-4e6a-41a6-9444-090f8eee3339 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:50.538509 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4e946e55-4e6a-41a6-9444-090f8eee3339 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:50.539807 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4e946e55-4e6a-41a6-9444-090f8eee3339 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:50.599663 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c656b625-519b-44af-aca2-4b4845f63af6 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] 10.222.0.17 "GET /compute/v2.1/servers/1051c29e-9680-4e26-80f9-b46c3a0dd1f9/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.140445 Jul 23 21:24:50.601121 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1326/2690] 10.222.0.17 () {58 vars in 1295 bytes} [Sat Jul 23 21:24:50 2022] GET /compute/v2.1/servers/1051c29e-9680-4e26-80f9-b46c3a0dd1f9/os-instance-actions => generated 611 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:24:50.614073 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-636667dd-6bea-4f52-ab50-0bc0f86c2b02 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:50.616481 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-636667dd-6bea-4f52-ab50-0bc0f86c2b02 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] [instance: 1051c29e-9680-4e26-80f9-b46c3a0dd1f9] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:50.626116 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4e946e55-4e6a-41a6-9444-090f8eee3339 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:50.626929 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4e946e55-4e6a-41a6-9444-090f8eee3339 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:50.627591 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.objects.instance [None req-4e946e55-4e6a-41a6-9444-090f8eee3339 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lazy-loading 'fault' on Instance uuid f5ac0849-7849-4a9e-8168-130483d564b0 {{(pid=131321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:24:50.636309 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-636667dd-6bea-4f52-ab50-0bc0f86c2b02 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:50.636981 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-636667dd-6bea-4f52-ab50-0bc0f86c2b02 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:50.639950 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-636667dd-6bea-4f52-ab50-0bc0f86c2b02 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:50.640568 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-636667dd-6bea-4f52-ab50-0bc0f86c2b02 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:50.698875 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-636667dd-6bea-4f52-ab50-0bc0f86c2b02 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] [instance: 1051c29e-9680-4e26-80f9-b46c3a0dd1f9] Going to try to terminate instance {{(pid=131320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:24:50.868991 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-636667dd-6bea-4f52-ab50-0bc0f86c2b02 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] 10.222.0.17 "DELETE /compute/v2.1/servers/1051c29e-9680-4e26-80f9-b46c3a0dd1f9" status: 204 len: 0 microversion: 2.1 time: 0.257827 Jul 23 21:24:50.869907 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1327/2691] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:24:50 2022] DELETE /compute/v2.1/servers/1051c29e-9680-4e26-80f9-b46c3a0dd1f9 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:24:50.883898 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-4e946e55-4e6a-41a6-9444-090f8eee3339 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e74c139b38d74d9ab93695471ccd3a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3ff73d603ec4069a908452514a59451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:50.885742 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f86d2829-9e22-41f2-bc2e-e878b4c5e269 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:50.888796 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f86d2829-9e22-41f2-bc2e-e878b4c5e269 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] [instance: 73362a63-78d8-4890-8588-d112fb85c2bf] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:50.892329 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-4e946e55-4e6a-41a6-9444-090f8eee3339 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] 10.222.0.17 "GET /compute/v2.1/servers/f5ac0849-7849-4a9e-8168-130483d564b0" status: 200 len: 1303 microversion: 2.1 time: 0.406677 Jul 23 21:24:50.893172 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1365/2692] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:50 2022] GET /compute/v2.1/servers/f5ac0849-7849-4a9e-8168-130483d564b0 => generated 1303 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:24:50.909314 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-63fd6849-2d22-42c8-8e76-6b8963785e62 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:50.910582 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-63fd6849-2d22-42c8-8e76-6b8963785e62 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] [instance: 1051c29e-9680-4e26-80f9-b46c3a0dd1f9] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:50.911331 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f86d2829-9e22-41f2-bc2e-e878b4c5e269 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:50.911797 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f86d2829-9e22-41f2-bc2e-e878b4c5e269 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:50.919034 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f86d2829-9e22-41f2-bc2e-e878b4c5e269 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:50.919502 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f86d2829-9e22-41f2-bc2e-e878b4c5e269 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:50.926269 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-63fd6849-2d22-42c8-8e76-6b8963785e62 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:50.927110 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-63fd6849-2d22-42c8-8e76-6b8963785e62 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:50.928160 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-63fd6849-2d22-42c8-8e76-6b8963785e62 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:50.929855 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-63fd6849-2d22-42c8-8e76-6b8963785e62 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:51.147263 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-63fd6849-2d22-42c8-8e76-6b8963785e62 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8b96ecba600424682ee7d55a16b6675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d6e531d129741b780236ffba8a4c2f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:51.156947 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-63fd6849-2d22-42c8-8e76-6b8963785e62 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] 10.222.0.17 "GET /compute/v2.1/servers/1051c29e-9680-4e26-80f9-b46c3a0dd1f9" status: 200 len: 1511 microversion: 2.1 time: 0.251952 Jul 23 21:24:51.174130 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1366/2693] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:50 2022] GET /compute/v2.1/servers/1051c29e-9680-4e26-80f9-b46c3a0dd1f9 => generated 1511 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:24:51.180708 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-f9c2be34-72f3-45e3-a3c4-70a0b24f3356 req-22282285-a339-4838-8fda-367a564d419b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5ac0849-7849-4a9e-8168-130483d564b0", "name": "network-vif-deleted", "tag": "e3eb1216-244f-4a92-a04f-baba4206aba1"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:24:51.203014 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-f9c2be34-72f3-45e3-a3c4-70a0b24f3356 req-22282285-a339-4838-8fda-367a564d419b service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:51.203481 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-f9c2be34-72f3-45e3-a3c4-70a0b24f3356 req-22282285-a339-4838-8fda-367a564d419b service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:51.236114 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-f9c2be34-72f3-45e3-a3c4-70a0b24f3356 req-22282285-a339-4838-8fda-367a564d419b service nova] Creating event network-vif-deleted:e3eb1216-244f-4a92-a04f-baba4206aba1 for instance f5ac0849-7849-4a9e-8168-130483d564b0 on nch1-master-1 Jul 23 21:24:51.241552 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-f9c2be34-72f3-45e3-a3c4-70a0b24f3356 req-22282285-a339-4838-8fda-367a564d419b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065839 Jul 23 21:24:51.242888 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1367/2694] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:24:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:24:51.251282 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-92a66c4a-4ef8-4428-85c3-7c59e449a3df tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:51.252146 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-92a66c4a-4ef8-4428-85c3-7c59e449a3df tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] [instance: d73bae1c-be56-4a5e-8e8d-56683aae946a] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:51.259149 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-92a66c4a-4ef8-4428-85c3-7c59e449a3df tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:51.259969 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-92a66c4a-4ef8-4428-85c3-7c59e449a3df tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:51.261024 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-92a66c4a-4ef8-4428-85c3-7c59e449a3df tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:51.261684 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-92a66c4a-4ef8-4428-85c3-7c59e449a3df tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:51.261803 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f86d2829-9e22-41f2-bc2e-e878b4c5e269 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a609c39c14343e1bc1edd4b3cd56dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116def61aba4631be91f67df63ebab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:51.269779 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f86d2829-9e22-41f2-bc2e-e878b4c5e269 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] 10.222.0.17 "GET /compute/v2.1/servers/73362a63-78d8-4890-8588-d112fb85c2bf" status: 200 len: 1313 microversion: 2.1 time: 0.398416 Jul 23 21:24:51.270417 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1328/2695] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:50 2022] GET /compute/v2.1/servers/73362a63-78d8-4890-8588-d112fb85c2bf => generated 1313 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:24:51.616146 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-92a66c4a-4ef8-4428-85c3-7c59e449a3df tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961e46ab94f4fffbc606485935ce64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8305585b60d54beeb2b087a37260a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:51.625017 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-92a66c4a-4ef8-4428-85c3-7c59e449a3df tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] 10.222.0.17 "GET /compute/v2.1/servers/d73bae1c-be56-4a5e-8e8d-56683aae946a" status: 200 len: 1283 microversion: 2.1 time: 0.379965 Jul 23 21:24:51.625933 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1368/2696] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:51 2022] GET /compute/v2.1/servers/d73bae1c-be56-4a5e-8e8d-56683aae946a => generated 1283 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:24:51.910320 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1593b95a-7700-483c-bdab-d33bd6d4c26b tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:51.910921 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1593b95a-7700-483c-bdab-d33bd6d4c26b tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] [instance: f5ac0849-7849-4a9e-8168-130483d564b0] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:51.925086 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1593b95a-7700-483c-bdab-d33bd6d4c26b tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:51.925543 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1593b95a-7700-483c-bdab-d33bd6d4c26b tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:51.926372 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1593b95a-7700-483c-bdab-d33bd6d4c26b tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:51.926817 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1593b95a-7700-483c-bdab-d33bd6d4c26b tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:51.959575 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-1593b95a-7700-483c-bdab-d33bd6d4c26b tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] HTTP exception thrown: Instance f5ac0849-7849-4a9e-8168-130483d564b0 could not be found. Jul 23 21:24:51.961282 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1593b95a-7700-483c-bdab-d33bd6d4c26b tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Request method failure captured: Jul 23 21:24:51.961282 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/f5ac0849-7849-4a9e-8168-130483d564b0 HTTP/1.1 Jul 23 21:24:51.961282 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:24:51.961282 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:24:51.961282 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:24:51.961282 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:24:51.961282 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:24:51.961282 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:24:51.961282 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:24:51.961282 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:24:51.961282 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3Ga5Nqf2OzbQ0VMu8-Q8oUXfLZWohVQycxzj4BjNzTTJha-mu0AebChee67u7O8mAQ9INyILZaQaEcXxo98a3YBIXtbgkOp12vSOS_jUcC6637luRAbm5am_Hsp98g8CItnJOqh857H3h8_GAIRDnfKg6TgexWSssvhOXDhoew_FnVs Jul 23 21:24:51.961282 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:24:51.961282 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:24:51.961282 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:24:51.961282 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:24:51.961282 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:24:51.961282 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:24:51.961282 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: d3ff73d603ec4069a908452514a59451 Jul 23 21:24:51.961282 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServersTestMultiNic-1266215266 Jul 23 21:24:51.961282 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:24:51.961282 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:24:51.961282 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d3ff73d603ec4069a908452514a59451"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d3ff73d603ec4069a908452514a59451"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d3ff73d603ec4069a908452514a59451", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d3ff73d603ec4069a908452514a59451"}]}] Jul 23 21:24:51.961282 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServersTestMultiNic-1266215266 Jul 23 21:24:51.961282 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: d3ff73d603ec4069a908452514a59451 Jul 23 21:24:51.961282 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServersTestMultiNic-1266215266 Jul 23 21:24:51.961282 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServersTestMultiNic-1266215266-project Jul 23 21:24:51.961282 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:24:51.961282 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:24:51.961282 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: e74c139b38d74d9ab93695471ccd3a2c Jul 23 21:24:51.961282 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServersTestMultiNic-1266215266-project Jul 23 21:24:51.961282 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:24:51.961282 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance f5ac0849-7849-4a9e-8168-130483d564b0 could not be found. Jul 23 21:24:51.961282 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': 'f5ac0849-7849-4a9e-8168-130483d564b0'} Jul 23 21:24:51.961282 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:24:51.961282 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:24:51.961282 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:24:51.961282 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:24:51.961282 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:24:51.961282 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:24:51.961282 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:24:51.961282 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:24:51.961282 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:24:51.961282 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:24:51.961282 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5ac0849-7849-4a9e-8168-130483d564b0 could not be found. Jul 23 21:24:51.961282 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:24:51.961282 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:24:51.961282 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:24:51.961282 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:24:51.961282 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:24:51.961282 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:24:51.961282 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:24:51.961282 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:24:51.961282 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:24:51.961282 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:24:51.961282 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:24:51.961282 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:24:51.961282 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:24:51.961282 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:24:51.961282 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:24:51.961282 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:24:51.961282 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5ac0849-7849-4a9e-8168-130483d564b0 could not be found. Jul 23 21:24:51.961282 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:24:51.961282 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:24:51.961282 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:24:51.965403 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:24:51.965403 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:24:51.965403 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:24:51.965403 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:24:51.965403 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:24:51.965403 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5ac0849-7849-4a9e-8168-130483d564b0 could not be found. Jul 23 21:24:51.965403 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:24:51.965403 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1593b95a-7700-483c-bdab-d33bd6d4c26b tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Returning 404 to user: Instance f5ac0849-7849-4a9e-8168-130483d564b0 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:24:51.966560 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1593b95a-7700-483c-bdab-d33bd6d4c26b tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] 10.222.0.17 "GET /compute/v2.1/servers/f5ac0849-7849-4a9e-8168-130483d564b0" status: 404 len: 111 microversion: 2.1 time: 0.060026 Jul 23 21:24:51.969028 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1329/2697] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:51 2022] GET /compute/v2.1/servers/f5ac0849-7849-4a9e-8168-130483d564b0 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:24:52.179586 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-94feae98-31f5-436e-bc3f-36a21f8c6980 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:52.180447 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-94feae98-31f5-436e-bc3f-36a21f8c6980 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] [instance: 1051c29e-9680-4e26-80f9-b46c3a0dd1f9] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:52.204000 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-94feae98-31f5-436e-bc3f-36a21f8c6980 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:52.204759 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-94feae98-31f5-436e-bc3f-36a21f8c6980 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:52.207660 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-94feae98-31f5-436e-bc3f-36a21f8c6980 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:52.209579 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-94feae98-31f5-436e-bc3f-36a21f8c6980 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:52.288169 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8ced07af-03d9-4dfb-9a80-64445db4ad96 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:52.288858 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8ced07af-03d9-4dfb-9a80-64445db4ad96 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] [instance: 73362a63-78d8-4890-8588-d112fb85c2bf] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:52.316752 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8ced07af-03d9-4dfb-9a80-64445db4ad96 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:52.317704 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8ced07af-03d9-4dfb-9a80-64445db4ad96 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:52.318956 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8ced07af-03d9-4dfb-9a80-64445db4ad96 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:52.319672 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8ced07af-03d9-4dfb-9a80-64445db4ad96 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:52.613565 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8ced07af-03d9-4dfb-9a80-64445db4ad96 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a609c39c14343e1bc1edd4b3cd56dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116def61aba4631be91f67df63ebab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:52.630690 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8ced07af-03d9-4dfb-9a80-64445db4ad96 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] 10.222.0.17 "GET /compute/v2.1/servers/73362a63-78d8-4890-8588-d112fb85c2bf" status: 200 len: 1313 microversion: 2.1 time: 0.348144 Jul 23 21:24:52.642891 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1330/2698] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:52 2022] GET /compute/v2.1/servers/73362a63-78d8-4890-8588-d112fb85c2bf => generated 1313 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:24:52.661763 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-dc892365-541f-420b-b314-aa56ed1defb0 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:52.663176 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-dc892365-541f-420b-b314-aa56ed1defb0 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] [instance: d73bae1c-be56-4a5e-8e8d-56683aae946a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:52.677588 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-94feae98-31f5-436e-bc3f-36a21f8c6980 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8b96ecba600424682ee7d55a16b6675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d6e531d129741b780236ffba8a4c2f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:52.680123 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:24:52.684326 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dc892365-541f-420b-b314-aa56ed1defb0 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:52.684830 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dc892365-541f-420b-b314-aa56ed1defb0 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:52.686049 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dc892365-541f-420b-b314-aa56ed1defb0 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:52.686824 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dc892365-541f-420b-b314-aa56ed1defb0 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:52.688779 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-94feae98-31f5-436e-bc3f-36a21f8c6980 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] 10.222.0.17 "GET /compute/v2.1/servers/1051c29e-9680-4e26-80f9-b46c3a0dd1f9" status: 200 len: 1511 microversion: 2.1 time: 0.514413 Jul 23 21:24:52.691780 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1369/2699] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:52 2022] GET /compute/v2.1/servers/1051c29e-9680-4e26-80f9-b46c3a0dd1f9 => generated 1511 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:24:52.969716 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-dc892365-541f-420b-b314-aa56ed1defb0 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961e46ab94f4fffbc606485935ce64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8305585b60d54beeb2b087a37260a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:52.987299 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-dc892365-541f-420b-b314-aa56ed1defb0 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] 10.222.0.17 "GET /compute/v2.1/servers/d73bae1c-be56-4a5e-8e8d-56683aae946a" status: 200 len: 1325 microversion: 2.1 time: 0.343325 Jul 23 21:24:52.988576 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1331/2700] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:52 2022] GET /compute/v2.1/servers/d73bae1c-be56-4a5e-8e8d-56683aae946a => generated 1325 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:24:53.650227 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-6dd92688-6042-4224-8765-4ead7ad077a6 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:53.650843 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-6dd92688-6042-4224-8765-4ead7ad077a6 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] [instance: 73362a63-78d8-4890-8588-d112fb85c2bf] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:53.659841 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6dd92688-6042-4224-8765-4ead7ad077a6 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:53.660648 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6dd92688-6042-4224-8765-4ead7ad077a6 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:53.662697 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6dd92688-6042-4224-8765-4ead7ad077a6 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:53.663392 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6dd92688-6042-4224-8765-4ead7ad077a6 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:53.692471 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:24:53.710017 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-02df407f-cf05-405e-836f-c11c127266c6 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:53.713292 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-02df407f-cf05-405e-836f-c11c127266c6 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] [instance: 1051c29e-9680-4e26-80f9-b46c3a0dd1f9] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:53.737896 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-02df407f-cf05-405e-836f-c11c127266c6 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:53.740870 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-02df407f-cf05-405e-836f-c11c127266c6 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:53.742551 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-02df407f-cf05-405e-836f-c11c127266c6 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:53.745315 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-02df407f-cf05-405e-836f-c11c127266c6 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:53.828669 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-02df407f-cf05-405e-836f-c11c127266c6 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8b96ecba600424682ee7d55a16b6675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d6e531d129741b780236ffba8a4c2f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:53.850367 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-02df407f-cf05-405e-836f-c11c127266c6 tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] 10.222.0.17 "GET /compute/v2.1/servers/1051c29e-9680-4e26-80f9-b46c3a0dd1f9" status: 200 len: 1469 microversion: 2.1 time: 0.144804 Jul 23 21:24:53.860140 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1332/2701] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:53 2022] GET /compute/v2.1/servers/1051c29e-9680-4e26-80f9-b46c3a0dd1f9 => generated 1469 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:24:53.952194 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-97ef7e6d-bf21-4a25-b9ec-1a0fbb938bc3 req-88e646ee-81de-45d8-ac9d-a23f9a655d3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1051c29e-9680-4e26-80f9-b46c3a0dd1f9", "name": "network-vif-deleted", "tag": "18720ccd-5e17-4fb5-b76e-3ddf8cf9fd5c"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:24:53.967686 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-97ef7e6d-bf21-4a25-b9ec-1a0fbb938bc3 req-88e646ee-81de-45d8-ac9d-a23f9a655d3a service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:53.968790 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-97ef7e6d-bf21-4a25-b9ec-1a0fbb938bc3 req-88e646ee-81de-45d8-ac9d-a23f9a655d3a service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:54.002827 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-97ef7e6d-bf21-4a25-b9ec-1a0fbb938bc3 req-88e646ee-81de-45d8-ac9d-a23f9a655d3a service nova] Creating event network-vif-deleted:18720ccd-5e17-4fb5-b76e-3ddf8cf9fd5c for instance 1051c29e-9680-4e26-80f9-b46c3a0dd1f9 on nch2-master-1 Jul 23 21:24:54.017255 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-97ef7e6d-bf21-4a25-b9ec-1a0fbb938bc3 req-88e646ee-81de-45d8-ac9d-a23f9a655d3a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068578 Jul 23 21:24:54.018437 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1333/2702] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:24:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:24:54.024951 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-eaa55e34-3b72-47ba-9802-2682c1961296 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:54.028362 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-eaa55e34-3b72-47ba-9802-2682c1961296 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] [instance: d73bae1c-be56-4a5e-8e8d-56683aae946a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:54.046500 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-eaa55e34-3b72-47ba-9802-2682c1961296 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:54.059754 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-eaa55e34-3b72-47ba-9802-2682c1961296 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:54.059754 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-eaa55e34-3b72-47ba-9802-2682c1961296 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:54.059754 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-eaa55e34-3b72-47ba-9802-2682c1961296 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:54.190792 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-6dd92688-6042-4224-8765-4ead7ad077a6 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a609c39c14343e1bc1edd4b3cd56dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116def61aba4631be91f67df63ebab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:54.200597 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-6dd92688-6042-4224-8765-4ead7ad077a6 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] 10.222.0.17 "GET /compute/v2.1/servers/73362a63-78d8-4890-8588-d112fb85c2bf" status: 200 len: 1313 microversion: 2.1 time: 0.556146 Jul 23 21:24:54.201191 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1370/2703] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:53 2022] GET /compute/v2.1/servers/73362a63-78d8-4890-8588-d112fb85c2bf => generated 1313 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:24:54.208116 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-6b2664da-fdec-4382-8b51-afd9ca72ef58 req-ef4619ea-1cd2-413c-a7de-e08cbfcf7f10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73362a63-78d8-4890-8588-d112fb85c2bf", "name": "network-vif-plugged", "status": "completed", "tag": "53cbd32e-7839-4bd5-bd13-f1cc7de68a33"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:24:54.216700 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-6b2664da-fdec-4382-8b51-afd9ca72ef58 req-ef4619ea-1cd2-413c-a7de-e08cbfcf7f10 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:54.217422 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-6b2664da-fdec-4382-8b51-afd9ca72ef58 req-ef4619ea-1cd2-413c-a7de-e08cbfcf7f10 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:54.230489 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-6b2664da-fdec-4382-8b51-afd9ca72ef58 req-ef4619ea-1cd2-413c-a7de-e08cbfcf7f10 service nova] Creating event network-vif-plugged:53cbd32e-7839-4bd5-bd13-f1cc7de68a33 for instance 73362a63-78d8-4890-8588-d112fb85c2bf on nch1-master-1 Jul 23 21:24:54.236212 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-6b2664da-fdec-4382-8b51-afd9ca72ef58 req-ef4619ea-1cd2-413c-a7de-e08cbfcf7f10 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032134 Jul 23 21:24:54.237213 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1371/2704] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:24:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:24:54.298783 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-eaa55e34-3b72-47ba-9802-2682c1961296 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961e46ab94f4fffbc606485935ce64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8305585b60d54beeb2b087a37260a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:54.311910 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-eaa55e34-3b72-47ba-9802-2682c1961296 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] 10.222.0.17 "GET /compute/v2.1/servers/d73bae1c-be56-4a5e-8e8d-56683aae946a" status: 200 len: 1325 microversion: 2.1 time: 0.291635 Jul 23 21:24:54.313070 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1334/2705] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:54 2022] GET /compute/v2.1/servers/d73bae1c-be56-4a5e-8e8d-56683aae946a => generated 1325 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:24:54.869284 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-1c91b1b6-d9ce-4b3a-a3eb-73f585714c1f tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:54.870106 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-1c91b1b6-d9ce-4b3a-a3eb-73f585714c1f tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] [instance: 1051c29e-9680-4e26-80f9-b46c3a0dd1f9] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:54.879323 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1c91b1b6-d9ce-4b3a-a3eb-73f585714c1f tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:54.880039 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1c91b1b6-d9ce-4b3a-a3eb-73f585714c1f tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:54.880982 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1c91b1b6-d9ce-4b3a-a3eb-73f585714c1f tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:54.881733 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1c91b1b6-d9ce-4b3a-a3eb-73f585714c1f tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:54.896497 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-1c91b1b6-d9ce-4b3a-a3eb-73f585714c1f tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] HTTP exception thrown: Instance 1051c29e-9680-4e26-80f9-b46c3a0dd1f9 could not be found. Jul 23 21:24:54.898484 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-1c91b1b6-d9ce-4b3a-a3eb-73f585714c1f tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Request method failure captured: Jul 23 21:24:54.898484 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/servers/1051c29e-9680-4e26-80f9-b46c3a0dd1f9 HTTP/1.1 Jul 23 21:24:54.898484 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:24:54.898484 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:24:54.898484 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:24:54.898484 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:24:54.898484 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:24:54.898484 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:24:54.898484 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:24:54.898484 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:24:54.898484 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GcH8JTJ2WcsRgqcWdQdm3cWwfQ1XxUraUyrP7z3qyZP84eHBASAMcXmUgs8PknEx_SjK0SdBEZUdR0wfOiU_kE2u22h0zu4lhCgtPu-PGE_TZeDbJcmDioFqKjjk3vbbGwNiE7J5o6H3xuG3Qvv9fB-64ZnD3dnVEECoy75ZTqsXCU Jul 23 21:24:54.898484 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:24:54.898484 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:24:54.898484 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:24:54.898484 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:24:54.898484 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:24:54.898484 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:24:54.898484 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 8d6e531d129741b780236ffba8a4c2f9 Jul 23 21:24:54.898484 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-InstanceActionsTestJSON-1480964599 Jul 23 21:24:54.898484 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:24:54.898484 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:24:54.898484 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8d6e531d129741b780236ffba8a4c2f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8d6e531d129741b780236ffba8a4c2f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8d6e531d129741b780236ffba8a4c2f9", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8d6e531d129741b780236ffba8a4c2f9"}]}] Jul 23 21:24:54.898484 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-InstanceActionsTestJSON-1480964599 Jul 23 21:24:54.898484 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 8d6e531d129741b780236ffba8a4c2f9 Jul 23 21:24:54.898484 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-InstanceActionsTestJSON-1480964599 Jul 23 21:24:54.898484 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-InstanceActionsTestJSON-1480964599-project Jul 23 21:24:54.898484 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:24:54.898484 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:24:54.898484 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: b8b96ecba600424682ee7d55a16b6675 Jul 23 21:24:54.898484 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-InstanceActionsTestJSON-1480964599-project Jul 23 21:24:54.898484 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:24:54.898484 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance 1051c29e-9680-4e26-80f9-b46c3a0dd1f9 could not be found. Jul 23 21:24:54.898484 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': '1051c29e-9680-4e26-80f9-b46c3a0dd1f9'} Jul 23 21:24:54.898484 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:24:54.898484 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:24:54.898484 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:24:54.898484 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:24:54.898484 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:24:54.898484 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:24:54.898484 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:24:54.898484 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:24:54.898484 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:24:54.898484 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:24:54.898484 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1051c29e-9680-4e26-80f9-b46c3a0dd1f9 could not be found. Jul 23 21:24:54.898484 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:24:54.898484 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:24:54.898484 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:24:54.898484 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:24:54.898484 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:24:54.898484 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:24:54.898484 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:24:54.898484 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:24:54.898484 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:24:54.898484 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:24:54.898484 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:24:54.898484 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:24:54.898484 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:24:54.898484 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:24:54.898484 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:24:54.898484 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:24:54.898484 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1051c29e-9680-4e26-80f9-b46c3a0dd1f9 could not be found. Jul 23 21:24:54.898484 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:24:54.898484 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:24:54.898484 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:24:54.903002 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:24:54.903002 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:24:54.903002 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:24:54.903002 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:24:54.903002 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:24:54.903002 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1051c29e-9680-4e26-80f9-b46c3a0dd1f9 could not be found. Jul 23 21:24:54.903002 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:24:54.904300 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-1c91b1b6-d9ce-4b3a-a3eb-73f585714c1f tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] Returning 404 to user: Instance 1051c29e-9680-4e26-80f9-b46c3a0dd1f9 could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:24:54.905454 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-1c91b1b6-d9ce-4b3a-a3eb-73f585714c1f tempest-InstanceActionsTestJSON-1480964599 tempest-InstanceActionsTestJSON-1480964599-project] 10.222.0.17 "GET /compute/v2.1/servers/1051c29e-9680-4e26-80f9-b46c3a0dd1f9" status: 404 len: 111 microversion: 2.1 time: 0.042800 Jul 23 21:24:54.906047 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1372/2706] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:54 2022] GET /compute/v2.1/servers/1051c29e-9680-4e26-80f9-b46c3a0dd1f9 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:24:55.216740 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-93022a5a-9423-4d38-88ce-f2c348877395 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:55.217957 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-93022a5a-9423-4d38-88ce-f2c348877395 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] [instance: 73362a63-78d8-4890-8588-d112fb85c2bf] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:55.231775 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-93022a5a-9423-4d38-88ce-f2c348877395 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:55.232787 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-93022a5a-9423-4d38-88ce-f2c348877395 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:55.233942 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-93022a5a-9423-4d38-88ce-f2c348877395 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:55.234537 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-93022a5a-9423-4d38-88ce-f2c348877395 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:55.328550 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e87a089e-f250-41a0-9060-2061bea756bf tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:55.329183 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-e87a089e-f250-41a0-9060-2061bea756bf tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] [instance: d73bae1c-be56-4a5e-8e8d-56683aae946a] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:55.339634 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e87a089e-f250-41a0-9060-2061bea756bf tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:55.343093 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e87a089e-f250-41a0-9060-2061bea756bf tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:55.343963 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e87a089e-f250-41a0-9060-2061bea756bf tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:55.344443 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e87a089e-f250-41a0-9060-2061bea756bf tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:55.509426 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-93022a5a-9423-4d38-88ce-f2c348877395 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a609c39c14343e1bc1edd4b3cd56dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116def61aba4631be91f67df63ebab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:55.517997 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-93022a5a-9423-4d38-88ce-f2c348877395 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] 10.222.0.17 "GET /compute/v2.1/servers/73362a63-78d8-4890-8588-d112fb85c2bf" status: 200 len: 1313 microversion: 2.1 time: 0.305099 Jul 23 21:24:55.521891 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1335/2707] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:55 2022] GET /compute/v2.1/servers/73362a63-78d8-4890-8588-d112fb85c2bf => generated 1313 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:24:55.744750 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-e87a089e-f250-41a0-9060-2061bea756bf tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961e46ab94f4fffbc606485935ce64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8305585b60d54beeb2b087a37260a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:55.755157 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-e87a089e-f250-41a0-9060-2061bea756bf tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] 10.222.0.17 "GET /compute/v2.1/servers/d73bae1c-be56-4a5e-8e8d-56683aae946a" status: 200 len: 1325 microversion: 2.1 time: 0.429905 Jul 23 21:24:55.758228 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1373/2708] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:55 2022] GET /compute/v2.1/servers/d73bae1c-be56-4a5e-8e8d-56683aae946a => generated 1325 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:24:55.922564 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-071f5764-b645-4181-ab08-a0f1c5bb4f3d tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:55.925672 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-071f5764-b645-4181-ab08-a0f1c5bb4f3d tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] [instance: f5ac0849-7849-4a9e-8168-130483d564b0] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:55.941126 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-071f5764-b645-4181-ab08-a0f1c5bb4f3d tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:55.941702 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-071f5764-b645-4181-ab08-a0f1c5bb4f3d tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:55.946187 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-071f5764-b645-4181-ab08-a0f1c5bb4f3d tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:55.946988 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-071f5764-b645-4181-ab08-a0f1c5bb4f3d tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:55.971297 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-071f5764-b645-4181-ab08-a0f1c5bb4f3d tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] HTTP exception thrown: Instance f5ac0849-7849-4a9e-8168-130483d564b0 could not be found. Jul 23 21:24:55.973275 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-071f5764-b645-4181-ab08-a0f1c5bb4f3d tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Request method failure captured: Jul 23 21:24:55.973275 ncdv-master-1 devstack@n-api.service[131321]: request: DELETE /compute/v2.1/servers/f5ac0849-7849-4a9e-8168-130483d564b0 HTTP/1.1 Jul 23 21:24:55.973275 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:24:55.973275 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:24:55.973275 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:24:55.973275 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:24:55.973275 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:24:55.973275 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:24:55.973275 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:24:55.973275 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:24:55.973275 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3Ga5Nqf2OzbQ0VMu8-Q8oUXfLZWohVQycxzj4BjNzTTJha-mu0AebChee67u7O8mAQ9INyILZaQaEcXxo98a3YBIXtbgkOp12vSOS_jUcC6637luRAbm5am_Hsp98g8CItnJOqh857H3h8_GAIRDnfKg6TgexWSssvhOXDhoew_FnVs Jul 23 21:24:55.973275 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:24:55.973275 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:24:55.973275 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:24:55.973275 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:24:55.973275 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:24:55.973275 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:24:55.973275 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: d3ff73d603ec4069a908452514a59451 Jul 23 21:24:55.973275 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ServersTestMultiNic-1266215266 Jul 23 21:24:55.973275 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:24:55.973275 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:24:55.973275 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d3ff73d603ec4069a908452514a59451"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d3ff73d603ec4069a908452514a59451"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d3ff73d603ec4069a908452514a59451", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d3ff73d603ec4069a908452514a59451"}]}] Jul 23 21:24:55.973275 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ServersTestMultiNic-1266215266 Jul 23 21:24:55.973275 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: d3ff73d603ec4069a908452514a59451 Jul 23 21:24:55.973275 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ServersTestMultiNic-1266215266 Jul 23 21:24:55.973275 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ServersTestMultiNic-1266215266-project Jul 23 21:24:55.973275 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:24:55.973275 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:24:55.973275 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: e74c139b38d74d9ab93695471ccd3a2c Jul 23 21:24:55.973275 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ServersTestMultiNic-1266215266-project Jul 23 21:24:55.973275 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:24:55.973275 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance f5ac0849-7849-4a9e-8168-130483d564b0 could not be found. Jul 23 21:24:55.973275 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': 'f5ac0849-7849-4a9e-8168-130483d564b0'} Jul 23 21:24:55.973275 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:24:55.973275 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:24:55.973275 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:24:55.973275 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:24:55.973275 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:24:55.973275 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:24:55.973275 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:24:55.973275 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:24:55.973275 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:24:55.973275 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:24:55.973275 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5ac0849-7849-4a9e-8168-130483d564b0 could not be found. Jul 23 21:24:55.973275 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:24:55.973275 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:24:55.973275 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:24:55.973275 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:24:55.973275 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:24:55.973275 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:24:55.973275 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:24:55.973275 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:24:55.973275 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:24:55.973275 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:24:55.973275 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 23 21:24:55.973275 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 23 21:24:55.973275 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 23 21:24:55.973275 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 23 21:24:55.973275 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:24:55.973275 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:24:55.973275 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:24:55.973275 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:24:55.978386 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5ac0849-7849-4a9e-8168-130483d564b0 could not be found. Jul 23 21:24:55.978386 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:24:55.978386 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:24:55.978386 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:24:55.978386 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:24:55.978386 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:24:55.978386 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:24:55.978386 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:24:55.978386 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:24:55.978386 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5ac0849-7849-4a9e-8168-130483d564b0 could not be found. Jul 23 21:24:55.978386 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:24:55.981092 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-071f5764-b645-4181-ab08-a0f1c5bb4f3d tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Returning 404 to user: Instance f5ac0849-7849-4a9e-8168-130483d564b0 could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:24:55.982276 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-071f5764-b645-4181-ab08-a0f1c5bb4f3d tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] 10.222.0.17 "DELETE /compute/v2.1/servers/f5ac0849-7849-4a9e-8168-130483d564b0" status: 404 len: 111 microversion: 2.1 time: 0.064143 Jul 23 21:24:55.983465 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1374/2709] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:24:55 2022] DELETE /compute/v2.1/servers/f5ac0849-7849-4a9e-8168-130483d564b0 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 23 21:24:55.996072 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-539a2c27-b7ae-4967-8b7b-af84e2dd2c27 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:55.997220 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-539a2c27-b7ae-4967-8b7b-af84e2dd2c27 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] [instance: f5ac0849-7849-4a9e-8168-130483d564b0] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:56.007439 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-539a2c27-b7ae-4967-8b7b-af84e2dd2c27 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:56.008323 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-539a2c27-b7ae-4967-8b7b-af84e2dd2c27 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:56.009553 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-539a2c27-b7ae-4967-8b7b-af84e2dd2c27 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:56.011041 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-539a2c27-b7ae-4967-8b7b-af84e2dd2c27 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:56.032057 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-20a915a5-d0eb-4e54-ae16-42048751fce8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:56.033531 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-20a915a5-d0eb-4e54-ae16-42048751fce8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:56.035754 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-539a2c27-b7ae-4967-8b7b-af84e2dd2c27 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] HTTP exception thrown: Instance f5ac0849-7849-4a9e-8168-130483d564b0 could not be found. Jul 23 21:24:56.037643 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-539a2c27-b7ae-4967-8b7b-af84e2dd2c27 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Request method failure captured: Jul 23 21:24:56.037643 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/servers/f5ac0849-7849-4a9e-8168-130483d564b0 HTTP/1.1 Jul 23 21:24:56.037643 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:24:56.037643 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:24:56.037643 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:24:56.037643 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:24:56.037643 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:24:56.037643 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:24:56.037643 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:24:56.037643 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:24:56.037643 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3Ga5Nqf2OzbQ0VMu8-Q8oUXfLZWohVQycxzj4BjNzTTJha-mu0AebChee67u7O8mAQ9INyILZaQaEcXxo98a3YBIXtbgkOp12vSOS_jUcC6637luRAbm5am_Hsp98g8CItnJOqh857H3h8_GAIRDnfKg6TgexWSssvhOXDhoew_FnVs Jul 23 21:24:56.037643 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:24:56.037643 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:24:56.037643 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:24:56.037643 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:24:56.037643 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:24:56.037643 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:24:56.037643 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: d3ff73d603ec4069a908452514a59451 Jul 23 21:24:56.037643 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ServersTestMultiNic-1266215266 Jul 23 21:24:56.037643 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:24:56.037643 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:24:56.037643 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d3ff73d603ec4069a908452514a59451"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d3ff73d603ec4069a908452514a59451"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d3ff73d603ec4069a908452514a59451", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d3ff73d603ec4069a908452514a59451"}]}] Jul 23 21:24:56.037643 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ServersTestMultiNic-1266215266 Jul 23 21:24:56.037643 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: d3ff73d603ec4069a908452514a59451 Jul 23 21:24:56.037643 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ServersTestMultiNic-1266215266 Jul 23 21:24:56.037643 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ServersTestMultiNic-1266215266-project Jul 23 21:24:56.037643 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:24:56.037643 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:24:56.037643 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: e74c139b38d74d9ab93695471ccd3a2c Jul 23 21:24:56.037643 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ServersTestMultiNic-1266215266-project Jul 23 21:24:56.037643 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:24:56.037643 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance f5ac0849-7849-4a9e-8168-130483d564b0 could not be found. Jul 23 21:24:56.037643 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': 'f5ac0849-7849-4a9e-8168-130483d564b0'} Jul 23 21:24:56.037643 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:24:56.037643 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:24:56.037643 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:24:56.037643 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:24:56.037643 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:24:56.037643 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:24:56.037643 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:24:56.037643 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:24:56.037643 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:24:56.037643 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:24:56.037643 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5ac0849-7849-4a9e-8168-130483d564b0 could not be found. Jul 23 21:24:56.037643 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:24:56.037643 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:24:56.037643 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:24:56.037643 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:24:56.037643 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:24:56.037643 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:24:56.037643 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:24:56.037643 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:24:56.037643 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:24:56.037643 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:24:56.037643 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:24:56.037643 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:24:56.037643 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:24:56.037643 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:24:56.037643 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:24:56.037643 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:24:56.037643 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5ac0849-7849-4a9e-8168-130483d564b0 could not be found. Jul 23 21:24:56.037643 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:24:56.037643 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:24:56.037643 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:24:56.042305 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:24:56.042305 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:24:56.042305 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:24:56.042305 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:24:56.042305 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:24:56.042305 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5ac0849-7849-4a9e-8168-130483d564b0 could not be found. Jul 23 21:24:56.042305 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:24:56.042305 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-539a2c27-b7ae-4967-8b7b-af84e2dd2c27 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Returning 404 to user: Instance f5ac0849-7849-4a9e-8168-130483d564b0 could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:24:56.042305 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-539a2c27-b7ae-4967-8b7b-af84e2dd2c27 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] 10.222.0.17 "GET /compute/v2.1/servers/f5ac0849-7849-4a9e-8168-130483d564b0" status: 404 len: 111 microversion: 2.1 time: 0.051898 Jul 23 21:24:56.042305 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1375/2710] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:55 2022] GET /compute/v2.1/servers/f5ac0849-7849-4a9e-8168-130483d564b0 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:24:56.051458 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-20a915a5-d0eb-4e54-ae16-42048751fce8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:56.051924 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-20a915a5-d0eb-4e54-ae16-42048751fce8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:56.052757 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-20a915a5-d0eb-4e54-ae16-42048751fce8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:56.053497 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-20a915a5-d0eb-4e54-ae16-42048751fce8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:56.054005 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-cb6f18cd-ff38-4199-a493-149c4ca6999e tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:56.054614 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-cb6f18cd-ff38-4199-a493-149c4ca6999e tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] [instance: dd8dace4-4427-490e-ad29-73092c943515] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:56.069306 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cb6f18cd-ff38-4199-a493-149c4ca6999e tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:56.069825 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cb6f18cd-ff38-4199-a493-149c4ca6999e tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:56.070836 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cb6f18cd-ff38-4199-a493-149c4ca6999e tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:56.071381 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cb6f18cd-ff38-4199-a493-149c4ca6999e tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:56.093952 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-20a915a5-d0eb-4e54-ae16-42048751fce8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Going to try to terminate instance {{(pid=131320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:24:56.098618 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-cb6f18cd-ff38-4199-a493-149c4ca6999e tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] HTTP exception thrown: Instance dd8dace4-4427-490e-ad29-73092c943515 could not be found. Jul 23 21:24:56.101000 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-cb6f18cd-ff38-4199-a493-149c4ca6999e tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Request method failure captured: Jul 23 21:24:56.101000 ncdv-master-1 devstack@n-api.service[131321]: request: DELETE /compute/v2.1/servers/dd8dace4-4427-490e-ad29-73092c943515 HTTP/1.1 Jul 23 21:24:56.101000 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:24:56.101000 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:24:56.101000 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:24:56.101000 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:24:56.101000 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:24:56.101000 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:24:56.101000 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:24:56.101000 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:24:56.101000 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3Ga5Nqf2OzbQ0VMu8-Q8oUXfLZWohVQycxzj4BjNzTTJha-mu0AebChee67u7O8mAQ9INyILZaQaEcXxo98a3YBIXtbgkOp12vSOS_jUcC6637luRAbm5am_Hsp98g8CItnJOqh857H3h8_GAIRDnfKg6TgexWSssvhOXDhoew_FnVs Jul 23 21:24:56.101000 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:24:56.101000 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:24:56.101000 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:24:56.101000 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:24:56.101000 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:24:56.101000 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:24:56.101000 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: d3ff73d603ec4069a908452514a59451 Jul 23 21:24:56.101000 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ServersTestMultiNic-1266215266 Jul 23 21:24:56.101000 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:24:56.101000 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:24:56.101000 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d3ff73d603ec4069a908452514a59451"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d3ff73d603ec4069a908452514a59451"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d3ff73d603ec4069a908452514a59451", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d3ff73d603ec4069a908452514a59451"}]}] Jul 23 21:24:56.101000 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ServersTestMultiNic-1266215266 Jul 23 21:24:56.101000 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: d3ff73d603ec4069a908452514a59451 Jul 23 21:24:56.101000 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ServersTestMultiNic-1266215266 Jul 23 21:24:56.101000 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ServersTestMultiNic-1266215266-project Jul 23 21:24:56.101000 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:24:56.101000 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:24:56.101000 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: e74c139b38d74d9ab93695471ccd3a2c Jul 23 21:24:56.101000 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ServersTestMultiNic-1266215266-project Jul 23 21:24:56.101000 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:24:56.101000 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance dd8dace4-4427-490e-ad29-73092c943515 could not be found. Jul 23 21:24:56.101000 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': 'dd8dace4-4427-490e-ad29-73092c943515'} Jul 23 21:24:56.101000 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:24:56.101000 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:24:56.101000 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:24:56.101000 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:24:56.101000 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:24:56.101000 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:24:56.101000 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:24:56.101000 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:24:56.101000 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:24:56.101000 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:24:56.101000 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd8dace4-4427-490e-ad29-73092c943515 could not be found. Jul 23 21:24:56.101000 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:24:56.101000 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:24:56.101000 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:24:56.101000 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:24:56.101000 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:24:56.101000 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:24:56.101000 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:24:56.101000 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:24:56.101000 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:24:56.101000 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:24:56.101000 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 23 21:24:56.101000 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 23 21:24:56.101000 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 23 21:24:56.101000 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 23 21:24:56.101000 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:24:56.101000 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:24:56.101000 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:24:56.101000 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:24:56.105819 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd8dace4-4427-490e-ad29-73092c943515 could not be found. Jul 23 21:24:56.105819 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:24:56.105819 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:24:56.105819 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:24:56.105819 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:24:56.105819 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:24:56.105819 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:24:56.105819 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:24:56.105819 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:24:56.105819 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd8dace4-4427-490e-ad29-73092c943515 could not be found. Jul 23 21:24:56.105819 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:24:56.105819 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-cb6f18cd-ff38-4199-a493-149c4ca6999e tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Returning 404 to user: Instance dd8dace4-4427-490e-ad29-73092c943515 could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:24:56.105819 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-cb6f18cd-ff38-4199-a493-149c4ca6999e tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] 10.222.0.17 "DELETE /compute/v2.1/servers/dd8dace4-4427-490e-ad29-73092c943515" status: 404 len: 111 microversion: 2.1 time: 0.056547 Jul 23 21:24:56.105819 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1376/2711] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:24:56 2022] DELETE /compute/v2.1/servers/dd8dace4-4427-490e-ad29-73092c943515 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:24:56.111959 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-555fdf2f-ebff-4d5a-9864-12badb0900b7 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:56.113719 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-555fdf2f-ebff-4d5a-9864-12badb0900b7 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] [instance: dd8dace4-4427-490e-ad29-73092c943515] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:56.123375 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-555fdf2f-ebff-4d5a-9864-12badb0900b7 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:56.124096 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-555fdf2f-ebff-4d5a-9864-12badb0900b7 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:56.125767 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-555fdf2f-ebff-4d5a-9864-12badb0900b7 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:56.126363 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-555fdf2f-ebff-4d5a-9864-12badb0900b7 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:56.155825 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-555fdf2f-ebff-4d5a-9864-12badb0900b7 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] HTTP exception thrown: Instance dd8dace4-4427-490e-ad29-73092c943515 could not be found. Jul 23 21:24:56.157828 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-555fdf2f-ebff-4d5a-9864-12badb0900b7 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Request method failure captured: Jul 23 21:24:56.157828 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/servers/dd8dace4-4427-490e-ad29-73092c943515 HTTP/1.1 Jul 23 21:24:56.157828 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:24:56.157828 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:24:56.157828 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:24:56.157828 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:24:56.157828 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:24:56.157828 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:24:56.157828 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:24:56.157828 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:24:56.157828 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3Ga5Nqf2OzbQ0VMu8-Q8oUXfLZWohVQycxzj4BjNzTTJha-mu0AebChee67u7O8mAQ9INyILZaQaEcXxo98a3YBIXtbgkOp12vSOS_jUcC6637luRAbm5am_Hsp98g8CItnJOqh857H3h8_GAIRDnfKg6TgexWSssvhOXDhoew_FnVs Jul 23 21:24:56.157828 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:24:56.157828 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:24:56.157828 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:24:56.157828 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:24:56.157828 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:24:56.157828 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:24:56.157828 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: d3ff73d603ec4069a908452514a59451 Jul 23 21:24:56.157828 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ServersTestMultiNic-1266215266 Jul 23 21:24:56.157828 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:24:56.157828 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:24:56.157828 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d3ff73d603ec4069a908452514a59451"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d3ff73d603ec4069a908452514a59451"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d3ff73d603ec4069a908452514a59451", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d3ff73d603ec4069a908452514a59451"}]}] Jul 23 21:24:56.157828 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ServersTestMultiNic-1266215266 Jul 23 21:24:56.157828 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: d3ff73d603ec4069a908452514a59451 Jul 23 21:24:56.157828 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ServersTestMultiNic-1266215266 Jul 23 21:24:56.157828 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ServersTestMultiNic-1266215266-project Jul 23 21:24:56.157828 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:24:56.157828 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:24:56.157828 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: e74c139b38d74d9ab93695471ccd3a2c Jul 23 21:24:56.157828 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ServersTestMultiNic-1266215266-project Jul 23 21:24:56.157828 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:24:56.157828 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance dd8dace4-4427-490e-ad29-73092c943515 could not be found. Jul 23 21:24:56.157828 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': 'dd8dace4-4427-490e-ad29-73092c943515'} Jul 23 21:24:56.157828 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:24:56.157828 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:24:56.157828 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:24:56.157828 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:24:56.157828 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:24:56.157828 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:24:56.157828 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:24:56.157828 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:24:56.157828 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:24:56.157828 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:24:56.157828 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd8dace4-4427-490e-ad29-73092c943515 could not be found. Jul 23 21:24:56.157828 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:24:56.157828 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:24:56.157828 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:24:56.157828 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:24:56.157828 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:24:56.157828 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:24:56.157828 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:24:56.157828 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:24:56.157828 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:24:56.157828 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:24:56.157828 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:24:56.157828 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:24:56.157828 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:24:56.157828 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:24:56.157828 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:24:56.157828 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:24:56.157828 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd8dace4-4427-490e-ad29-73092c943515 could not be found. Jul 23 21:24:56.157828 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:24:56.157828 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:24:56.157828 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:24:56.162506 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:24:56.162506 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:24:56.162506 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:24:56.162506 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:24:56.162506 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:24:56.162506 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd8dace4-4427-490e-ad29-73092c943515 could not be found. Jul 23 21:24:56.162506 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:24:56.163815 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-555fdf2f-ebff-4d5a-9864-12badb0900b7 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] Returning 404 to user: Instance dd8dace4-4427-490e-ad29-73092c943515 could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:24:56.164872 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-555fdf2f-ebff-4d5a-9864-12badb0900b7 tempest-ServersTestMultiNic-1266215266 tempest-ServersTestMultiNic-1266215266-project] 10.222.0.17 "GET /compute/v2.1/servers/dd8dace4-4427-490e-ad29-73092c943515" status: 404 len: 111 microversion: 2.1 time: 0.057536 Jul 23 21:24:56.166110 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1377/2712] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:56 2022] GET /compute/v2.1/servers/dd8dace4-4427-490e-ad29-73092c943515 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:24:56.207639 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-20a915a5-d0eb-4e54-ae16-42048751fce8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "DELETE /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 204 len: 0 microversion: 2.42 time: 0.537430 Jul 23 21:24:56.217820 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1336/2713] 10.222.0.17 () {60 vars in 1279 bytes} [Sat Jul 23 21:24:55 2022] DELETE /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 0 bytes in 539 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 23 21:24:56.227640 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-8b2c543f-670c-43b9-a98d-bd6a56aa34cb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:56.228838 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-8b2c543f-670c-43b9-a98d-bd6a56aa34cb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:56.235711 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-0c00a352-43c4-4fad-a4ce-a38fce5fd482 req-55ff5523-6bea-4a97-8fd5-211256b796a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d73bae1c-be56-4a5e-8e8d-56683aae946a", "tag": "897299b4-bb02-495a-98bb-caa17d6ecc8b"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:24:56.245295 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8b2c543f-670c-43b9-a98d-bd6a56aa34cb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:56.245754 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8b2c543f-670c-43b9-a98d-bd6a56aa34cb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:56.247221 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8b2c543f-670c-43b9-a98d-bd6a56aa34cb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:56.248017 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8b2c543f-670c-43b9-a98d-bd6a56aa34cb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:56.261356 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-0c00a352-43c4-4fad-a4ce-a38fce5fd482 req-55ff5523-6bea-4a97-8fd5-211256b796a4 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:56.261792 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-0c00a352-43c4-4fad-a4ce-a38fce5fd482 req-55ff5523-6bea-4a97-8fd5-211256b796a4 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:56.275210 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-0c00a352-43c4-4fad-a4ce-a38fce5fd482 req-55ff5523-6bea-4a97-8fd5-211256b796a4 service nova] Creating event network-changed:897299b4-bb02-495a-98bb-caa17d6ecc8b for instance d73bae1c-be56-4a5e-8e8d-56683aae946a on nch1-master-1 Jul 23 21:24:56.280162 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-0c00a352-43c4-4fad-a4ce-a38fce5fd482 req-55ff5523-6bea-4a97-8fd5-211256b796a4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049161 Jul 23 21:24:56.281106 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1337/2714] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:24:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:24:56.540693 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d3894789-1f14-41d1-ab99-9980d99a1181 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:56.541428 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d3894789-1f14-41d1-ab99-9980d99a1181 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] [instance: 73362a63-78d8-4890-8588-d112fb85c2bf] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:56.550022 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d3894789-1f14-41d1-ab99-9980d99a1181 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:56.550756 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d3894789-1f14-41d1-ab99-9980d99a1181 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:56.553342 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d3894789-1f14-41d1-ab99-9980d99a1181 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:56.553990 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d3894789-1f14-41d1-ab99-9980d99a1181 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:56.559684 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-8b2c543f-670c-43b9-a98d-bd6a56aa34cb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:56.579713 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-8b2c543f-670c-43b9-a98d-bd6a56aa34cb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:56.590006 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-8b2c543f-670c-43b9-a98d-bd6a56aa34cb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:56.591872 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-8b2c543f-670c-43b9-a98d-bd6a56aa34cb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 2958 microversion: 2.42 time: 0.376360 Jul 23 21:24:56.605906 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1378/2715] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:24:56 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 2958 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:24:56.774795 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ba3bfc1e-ddea-4350-9a55-1898108a5297 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:56.775423 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-ba3bfc1e-ddea-4350-9a55-1898108a5297 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] [instance: d73bae1c-be56-4a5e-8e8d-56683aae946a] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:56.782765 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ba3bfc1e-ddea-4350-9a55-1898108a5297 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:56.782765 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ba3bfc1e-ddea-4350-9a55-1898108a5297 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:56.783635 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ba3bfc1e-ddea-4350-9a55-1898108a5297 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:56.783928 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ba3bfc1e-ddea-4350-9a55-1898108a5297 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:56.931429 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d3894789-1f14-41d1-ab99-9980d99a1181 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a609c39c14343e1bc1edd4b3cd56dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116def61aba4631be91f67df63ebab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:56.940605 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d3894789-1f14-41d1-ab99-9980d99a1181 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] 10.222.0.17 "GET /compute/v2.1/servers/73362a63-78d8-4890-8588-d112fb85c2bf" status: 200 len: 1499 microversion: 2.1 time: 0.405232 Jul 23 21:24:56.952315 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1338/2716] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:56 2022] GET /compute/v2.1/servers/73362a63-78d8-4890-8588-d112fb85c2bf => generated 1499 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:24:56.962207 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d70be80d-b6d0-4a2e-80a5-037e69d3b1a8 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:24:56.963484 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d70be80d-b6d0-4a2e-80a5-037e69d3b1a8 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] [instance: 73362a63-78d8-4890-8588-d112fb85c2bf] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:56.973276 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d70be80d-b6d0-4a2e-80a5-037e69d3b1a8 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:56.974086 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d70be80d-b6d0-4a2e-80a5-037e69d3b1a8 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:56.975265 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d70be80d-b6d0-4a2e-80a5-037e69d3b1a8 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:56.982212 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d70be80d-b6d0-4a2e-80a5-037e69d3b1a8 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:57.021434 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.objects.instance [None req-d70be80d-b6d0-4a2e-80a5-037e69d3b1a8 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lazy-loading 'flavor' on Instance uuid 73362a63-78d8-4890-8588-d112fb85c2bf {{(pid=131320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:24:57.061599 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ba3bfc1e-ddea-4350-9a55-1898108a5297 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961e46ab94f4fffbc606485935ce64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8305585b60d54beeb2b087a37260a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:57.073736 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-ba3bfc1e-ddea-4350-9a55-1898108a5297 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] 10.222.0.17 "GET /compute/v2.1/servers/d73bae1c-be56-4a5e-8e8d-56683aae946a" status: 200 len: 1325 microversion: 2.1 time: 0.302807 Jul 23 21:24:57.074650 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1379/2717] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:56 2022] GET /compute/v2.1/servers/d73bae1c-be56-4a5e-8e8d-56683aae946a => generated 1325 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:24:57.126532 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:24:57.159176 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d70be80d-b6d0-4a2e-80a5-037e69d3b1a8 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] 10.222.0.17 "POST /compute/v2.1/servers/73362a63-78d8-4890-8588-d112fb85c2bf/action" status: 200 len: 32 microversion: 2.1 time: 0.200077 Jul 23 21:24:57.160140 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1339/2718] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:24:56 2022] POST /compute/v2.1/servers/73362a63-78d8-4890-8588-d112fb85c2bf/action => generated 32 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 23 21:24:57.170519 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-3b49816b-0a90-4f21-9547-358864f92abf tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:57.170865 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-3b49816b-0a90-4f21-9547-358864f92abf tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] [instance: 73362a63-78d8-4890-8588-d112fb85c2bf] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:57.177141 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3b49816b-0a90-4f21-9547-358864f92abf tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:57.177671 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3b49816b-0a90-4f21-9547-358864f92abf tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:57.178545 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3b49816b-0a90-4f21-9547-358864f92abf tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:57.179193 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3b49816b-0a90-4f21-9547-358864f92abf tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:57.541232 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-3b49816b-0a90-4f21-9547-358864f92abf tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a609c39c14343e1bc1edd4b3cd56dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116def61aba4631be91f67df63ebab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:57.580616 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-3b49816b-0a90-4f21-9547-358864f92abf tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] 10.222.0.17 "GET /compute/v2.1/servers/73362a63-78d8-4890-8588-d112fb85c2bf" status: 200 len: 1505 microversion: 2.1 time: 0.403141 Jul 23 21:24:57.585388 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1380/2719] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:57 2022] GET /compute/v2.1/servers/73362a63-78d8-4890-8588-d112fb85c2bf => generated 1505 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:24:57.617212 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d260fcbc-610a-4ca1-9471-fad3bcfb4160 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:57.619021 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d260fcbc-610a-4ca1-9471-fad3bcfb4160 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:57.643323 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d260fcbc-610a-4ca1-9471-fad3bcfb4160 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:57.650955 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d260fcbc-610a-4ca1-9471-fad3bcfb4160 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:57.655315 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d260fcbc-610a-4ca1-9471-fad3bcfb4160 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:57.655805 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d260fcbc-610a-4ca1-9471-fad3bcfb4160 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:58.079968 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:24:58.096231 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f6457e61-4c64-4a5c-9228-106590829cac tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:58.098811 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-f6457e61-4c64-4a5c-9228-106590829cac tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] [instance: d73bae1c-be56-4a5e-8e8d-56683aae946a] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:58.107877 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f6457e61-4c64-4a5c-9228-106590829cac tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:58.113777 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f6457e61-4c64-4a5c-9228-106590829cac tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:58.115214 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f6457e61-4c64-4a5c-9228-106590829cac tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:58.115993 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f6457e61-4c64-4a5c-9228-106590829cac tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:58.137194 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=34 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:24:58.432835 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-f6457e61-4c64-4a5c-9228-106590829cac tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961e46ab94f4fffbc606485935ce64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8305585b60d54beeb2b087a37260a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:58.469376 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d260fcbc-610a-4ca1-9471-fad3bcfb4160 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:58.477519 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-f6457e61-4c64-4a5c-9228-106590829cac tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] 10.222.0.17 "GET /compute/v2.1/servers/d73bae1c-be56-4a5e-8e8d-56683aae946a" status: 200 len: 1325 microversion: 2.1 time: 0.387619 Jul 23 21:24:58.487967 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d260fcbc-610a-4ca1-9471-fad3bcfb4160 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:58.488243 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1381/2720] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:58 2022] GET /compute/v2.1/servers/d73bae1c-be56-4a5e-8e8d-56683aae946a => generated 1325 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:24:58.489476 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d260fcbc-610a-4ca1-9471-fad3bcfb4160 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:58.490773 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d260fcbc-610a-4ca1-9471-fad3bcfb4160 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 2958 microversion: 2.42 time: 0.877882 Jul 23 21:24:58.503943 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1340/2721] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:24:57 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 2958 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:24:58.599997 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ba99166b-ae5b-4718-bc51-859c5f216c8a tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:58.600753 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-ba99166b-ae5b-4718-bc51-859c5f216c8a tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] [instance: 73362a63-78d8-4890-8588-d112fb85c2bf] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:58.618703 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ba99166b-ae5b-4718-bc51-859c5f216c8a tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:58.619311 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ba99166b-ae5b-4718-bc51-859c5f216c8a tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:58.620172 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ba99166b-ae5b-4718-bc51-859c5f216c8a tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:58.620624 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ba99166b-ae5b-4718-bc51-859c5f216c8a tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:58.833892 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell0:SELECT=2 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:24:58.950603 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ba99166b-ae5b-4718-bc51-859c5f216c8a tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a609c39c14343e1bc1edd4b3cd56dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116def61aba4631be91f67df63ebab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:24:58.960383 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-ba99166b-ae5b-4718-bc51-859c5f216c8a tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] 10.222.0.17 "GET /compute/v2.1/servers/73362a63-78d8-4890-8588-d112fb85c2bf" status: 200 len: 1505 microversion: 2.1 time: 0.364560 Jul 23 21:24:58.975007 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1382/2722] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:58 2022] GET /compute/v2.1/servers/73362a63-78d8-4890-8588-d112fb85c2bf => generated 1505 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:24:59.496902 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-31ec90c7-701a-4140-86af-b3d931bd2919 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:59.498707 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-31ec90c7-701a-4140-86af-b3d931bd2919 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] [instance: d73bae1c-be56-4a5e-8e8d-56683aae946a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:59.512336 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-55f6dc0c-103d-4918-b4a8-1c1fd8db92f9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:24:59.513684 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-55f6dc0c-103d-4918-b4a8-1c1fd8db92f9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:24:59.524404 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-55f6dc0c-103d-4918-b4a8-1c1fd8db92f9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:59.524905 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-31ec90c7-701a-4140-86af-b3d931bd2919 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:59.525714 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-31ec90c7-701a-4140-86af-b3d931bd2919 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:59.526732 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-31ec90c7-701a-4140-86af-b3d931bd2919 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:59.527684 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-55f6dc0c-103d-4918-b4a8-1c1fd8db92f9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:59.528176 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-31ec90c7-701a-4140-86af-b3d931bd2919 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:24:59.530973 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-55f6dc0c-103d-4918-b4a8-1c1fd8db92f9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:24:59.531689 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-55f6dc0c-103d-4918-b4a8-1c1fd8db92f9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:00.029953 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-31ec90c7-701a-4140-86af-b3d931bd2919 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961e46ab94f4fffbc606485935ce64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8305585b60d54beeb2b087a37260a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:00.046803 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-31ec90c7-701a-4140-86af-b3d931bd2919 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] 10.222.0.17 "GET /compute/v2.1/servers/d73bae1c-be56-4a5e-8e8d-56683aae946a" status: 200 len: 1325 microversion: 2.1 time: 0.555236 Jul 23 21:25:00.048904 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1341/2723] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:24:59 2022] GET /compute/v2.1/servers/d73bae1c-be56-4a5e-8e8d-56683aae946a => generated 1325 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:00.058845 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4aa4495f-91c4-4b5d-a697-c90e16d814ba tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:00.062789 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-4aa4495f-91c4-4b5d-a697-c90e16d814ba tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] [instance: 73362a63-78d8-4890-8588-d112fb85c2bf] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:00.087897 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4aa4495f-91c4-4b5d-a697-c90e16d814ba tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:00.090157 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4aa4495f-91c4-4b5d-a697-c90e16d814ba tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:00.091131 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4aa4495f-91c4-4b5d-a697-c90e16d814ba tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:00.091685 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4aa4495f-91c4-4b5d-a697-c90e16d814ba tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:00.224133 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-55f6dc0c-103d-4918-b4a8-1c1fd8db92f9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:00.237179 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-55f6dc0c-103d-4918-b4a8-1c1fd8db92f9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:00.240545 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-55f6dc0c-103d-4918-b4a8-1c1fd8db92f9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:00.256282 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-55f6dc0c-103d-4918-b4a8-1c1fd8db92f9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 2958 microversion: 2.42 time: 0.736498 Jul 23 21:25:00.262518 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1383/2724] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:24:59 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 2958 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:25:00.268568 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-fb224b5d-9ed2-4de9-88c3-717cd3005118 req-63768033-9009-4697-a657-d6d98c415d1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d73bae1c-be56-4a5e-8e8d-56683aae946a", "name": "network-vif-plugged", "status": "completed", "tag": "897299b4-bb02-495a-98bb-caa17d6ecc8b"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:25:00.277584 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-fb224b5d-9ed2-4de9-88c3-717cd3005118 req-63768033-9009-4697-a657-d6d98c415d1c service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:00.278183 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-fb224b5d-9ed2-4de9-88c3-717cd3005118 req-63768033-9009-4697-a657-d6d98c415d1c service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:00.307081 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-fb224b5d-9ed2-4de9-88c3-717cd3005118 req-63768033-9009-4697-a657-d6d98c415d1c service nova] Creating event network-vif-plugged:897299b4-bb02-495a-98bb-caa17d6ecc8b for instance d73bae1c-be56-4a5e-8e8d-56683aae946a on nch1-master-1 Jul 23 21:25:00.317487 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-fb224b5d-9ed2-4de9-88c3-717cd3005118 req-63768033-9009-4697-a657-d6d98c415d1c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053214 Jul 23 21:25:00.318639 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1384/2725] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:25:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:25:00.751573 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-4aa4495f-91c4-4b5d-a697-c90e16d814ba tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a609c39c14343e1bc1edd4b3cd56dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116def61aba4631be91f67df63ebab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:00.760589 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4aa4495f-91c4-4b5d-a697-c90e16d814ba tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] 10.222.0.17 "GET /compute/v2.1/servers/73362a63-78d8-4890-8588-d112fb85c2bf" status: 200 len: 1505 microversion: 2.1 time: 0.708238 Jul 23 21:25:00.782831 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1342/2726] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:00 2022] GET /compute/v2.1/servers/73362a63-78d8-4890-8588-d112fb85c2bf => generated 1505 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:01.068834 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-b7c6c521-fa50-4b08-8464-8d8a2cb13991 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:01.072388 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-b7c6c521-fa50-4b08-8464-8d8a2cb13991 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] [instance: d73bae1c-be56-4a5e-8e8d-56683aae946a] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:01.103483 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b7c6c521-fa50-4b08-8464-8d8a2cb13991 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:01.105306 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b7c6c521-fa50-4b08-8464-8d8a2cb13991 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:01.106373 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b7c6c521-fa50-4b08-8464-8d8a2cb13991 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:01.107864 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b7c6c521-fa50-4b08-8464-8d8a2cb13991 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:01.281476 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c6114fc0-5180-4cb8-b6cb-bf6d664bd600 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:01.282921 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c6114fc0-5180-4cb8-b6cb-bf6d664bd600 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:01.295777 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c6114fc0-5180-4cb8-b6cb-bf6d664bd600 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:01.297947 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c6114fc0-5180-4cb8-b6cb-bf6d664bd600 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:01.298755 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c6114fc0-5180-4cb8-b6cb-bf6d664bd600 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:01.299209 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c6114fc0-5180-4cb8-b6cb-bf6d664bd600 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:01.825935 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c6114fc0-5180-4cb8-b6cb-bf6d664bd600 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:01.842480 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-b7c6c521-fa50-4b08-8464-8d8a2cb13991 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961e46ab94f4fffbc606485935ce64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8305585b60d54beeb2b087a37260a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:01.844496 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c6114fc0-5180-4cb8-b6cb-bf6d664bd600 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:01.846056 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c6114fc0-5180-4cb8-b6cb-bf6d664bd600 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:01.847355 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c6114fc0-5180-4cb8-b6cb-bf6d664bd600 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 2958 microversion: 2.42 time: 0.570876 Jul 23 21:25:01.847937 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1343/2727] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:25:01 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 2958 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:25:01.863950 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-b7c6c521-fa50-4b08-8464-8d8a2cb13991 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] 10.222.0.17 "GET /compute/v2.1/servers/d73bae1c-be56-4a5e-8e8d-56683aae946a" status: 200 len: 1325 microversion: 2.1 time: 0.800967 Jul 23 21:25:01.864990 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1385/2728] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:01 2022] GET /compute/v2.1/servers/d73bae1c-be56-4a5e-8e8d-56683aae946a => generated 1325 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:01.872392 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-814167a9-9cd3-4f39-9cf8-509f2686beec tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:01.873008 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-814167a9-9cd3-4f39-9cf8-509f2686beec tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] [instance: 73362a63-78d8-4890-8588-d112fb85c2bf] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:01.879661 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-814167a9-9cd3-4f39-9cf8-509f2686beec tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:01.880228 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-814167a9-9cd3-4f39-9cf8-509f2686beec tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:01.881023 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-814167a9-9cd3-4f39-9cf8-509f2686beec tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:01.881461 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-814167a9-9cd3-4f39-9cf8-509f2686beec tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:02.402562 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-814167a9-9cd3-4f39-9cf8-509f2686beec tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a609c39c14343e1bc1edd4b3cd56dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116def61aba4631be91f67df63ebab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:02.452096 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-814167a9-9cd3-4f39-9cf8-509f2686beec tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] 10.222.0.17 "GET /compute/v2.1/servers/73362a63-78d8-4890-8588-d112fb85c2bf" status: 200 len: 1505 microversion: 2.1 time: 0.602947 Jul 23 21:25:02.452815 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1344/2729] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:01 2022] GET /compute/v2.1/servers/73362a63-78d8-4890-8588-d112fb85c2bf => generated 1505 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:02.799997 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-0744573c-e599-47b1-9419-09563cde1840 req-eda7b35f-dd05-4872-b9b0-c7e3763e85ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d09f96e-8ea6-4838-8264-4535f77fa39d", "name": "network-vif-unplugged", "status": "completed", "tag": "857743d4-9fc9-4509-a86f-9253f99e2a3c"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:25:02.816438 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-0744573c-e599-47b1-9419-09563cde1840 req-eda7b35f-dd05-4872-b9b0-c7e3763e85ff service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:02.820338 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-0744573c-e599-47b1-9419-09563cde1840 req-eda7b35f-dd05-4872-b9b0-c7e3763e85ff service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:02.847958 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-0744573c-e599-47b1-9419-09563cde1840 req-eda7b35f-dd05-4872-b9b0-c7e3763e85ff service nova] Creating event network-vif-unplugged:857743d4-9fc9-4509-a86f-9253f99e2a3c for instance 4d09f96e-8ea6-4838-8264-4535f77fa39d on nch2-master-1 Jul 23 21:25:02.860684 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-0744573c-e599-47b1-9419-09563cde1840 req-eda7b35f-dd05-4872-b9b0-c7e3763e85ff service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061289 Jul 23 21:25:02.864495 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1386/2730] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:25:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:25:02.869886 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-35b7d80b-f099-4247-8552-6d7f4db52e64 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:02.870503 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-35b7d80b-f099-4247-8552-6d7f4db52e64 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:02.888084 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-361eab0d-e6bd-4fe3-8df8-4eaca64b54bb tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:02.888912 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-361eab0d-e6bd-4fe3-8df8-4eaca64b54bb tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] [instance: d73bae1c-be56-4a5e-8e8d-56683aae946a] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:02.897289 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-35b7d80b-f099-4247-8552-6d7f4db52e64 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:02.898099 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-35b7d80b-f099-4247-8552-6d7f4db52e64 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:02.899343 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-35b7d80b-f099-4247-8552-6d7f4db52e64 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:02.908441 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-35b7d80b-f099-4247-8552-6d7f4db52e64 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:02.912038 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-361eab0d-e6bd-4fe3-8df8-4eaca64b54bb tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:02.912490 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-361eab0d-e6bd-4fe3-8df8-4eaca64b54bb tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:02.913493 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-361eab0d-e6bd-4fe3-8df8-4eaca64b54bb tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:02.914133 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-361eab0d-e6bd-4fe3-8df8-4eaca64b54bb tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:03.185809 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-361eab0d-e6bd-4fe3-8df8-4eaca64b54bb tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961e46ab94f4fffbc606485935ce64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8305585b60d54beeb2b087a37260a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:03.209025 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-361eab0d-e6bd-4fe3-8df8-4eaca64b54bb tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] 10.222.0.17 "GET /compute/v2.1/servers/d73bae1c-be56-4a5e-8e8d-56683aae946a" status: 200 len: 1522 microversion: 2.1 time: 0.330591 Jul 23 21:25:03.209944 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1387/2731] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:02 2022] GET /compute/v2.1/servers/d73bae1c-be56-4a5e-8e8d-56683aae946a => generated 1522 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:03.233163 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-84ab60eb-6bf8-4691-8313-f7b84aeb6774 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:03.236118 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-84ab60eb-6bf8-4691-8313-f7b84aeb6774 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] [instance: d73bae1c-be56-4a5e-8e8d-56683aae946a] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:03.254534 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-84ab60eb-6bf8-4691-8313-f7b84aeb6774 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:03.255564 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-84ab60eb-6bf8-4691-8313-f7b84aeb6774 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:03.256610 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-84ab60eb-6bf8-4691-8313-f7b84aeb6774 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:03.257323 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-84ab60eb-6bf8-4691-8313-f7b84aeb6774 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:03.485924 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-35b7d80b-f099-4247-8552-6d7f4db52e64 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:03.504232 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-35b7d80b-f099-4247-8552-6d7f4db52e64 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:03.506428 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-35b7d80b-f099-4247-8552-6d7f4db52e64 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:03.508190 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-35b7d80b-f099-4247-8552-6d7f4db52e64 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 2916 microversion: 2.42 time: 0.644216 Jul 23 21:25:03.511895 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1345/2732] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:25:02 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 2916 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:25:03.517651 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a5a67bd3-45b2-400b-8c20-0fce6d01c80d tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:03.518519 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a5a67bd3-45b2-400b-8c20-0fce6d01c80d tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] [instance: 73362a63-78d8-4890-8588-d112fb85c2bf] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:03.526682 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a5a67bd3-45b2-400b-8c20-0fce6d01c80d tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:03.528405 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a5a67bd3-45b2-400b-8c20-0fce6d01c80d tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:03.529814 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a5a67bd3-45b2-400b-8c20-0fce6d01c80d tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:03.530829 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a5a67bd3-45b2-400b-8c20-0fce6d01c80d tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:03.656722 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-84ab60eb-6bf8-4691-8313-f7b84aeb6774 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961e46ab94f4fffbc606485935ce64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8305585b60d54beeb2b087a37260a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:03.669852 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-84ab60eb-6bf8-4691-8313-f7b84aeb6774 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] 10.222.0.17 "GET /compute/v2.1/servers/d73bae1c-be56-4a5e-8e8d-56683aae946a" status: 200 len: 1522 microversion: 2.1 time: 0.444700 Jul 23 21:25:03.671156 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1388/2733] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:03 2022] GET /compute/v2.1/servers/d73bae1c-be56-4a5e-8e8d-56683aae946a => generated 1522 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:03.682800 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-10ca2b1d-05bb-490a-80e3-de04460875fe req-e2719886-9132-4a9e-9080-d0b5f36d69df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d09f96e-8ea6-4838-8264-4535f77fa39d", "name": "network-vif-deleted", "tag": "6a3326c3-3a2b-413d-aced-917b1a1798b5"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:25:03.700150 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-10ca2b1d-05bb-490a-80e3-de04460875fe req-e2719886-9132-4a9e-9080-d0b5f36d69df service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:03.700592 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-10ca2b1d-05bb-490a-80e3-de04460875fe req-e2719886-9132-4a9e-9080-d0b5f36d69df service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:03.726788 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-10ca2b1d-05bb-490a-80e3-de04460875fe req-e2719886-9132-4a9e-9080-d0b5f36d69df service nova] Creating event network-vif-deleted:6a3326c3-3a2b-413d-aced-917b1a1798b5 for instance 4d09f96e-8ea6-4838-8264-4535f77fa39d on nch2-master-1 Jul 23 21:25:03.739011 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-10ca2b1d-05bb-490a-80e3-de04460875fe req-e2719886-9132-4a9e-9080-d0b5f36d69df service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066223 Jul 23 21:25:03.747666 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1389/2734] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:25:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:25:03.753816 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-02b0a9d4-e03a-4f3c-af9e-7868b4274d03 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1818171602", "metadata": {"": ""}}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:25:03.756469 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-02b0a9d4-e03a-4f3c-af9e-7868b4274d03 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Request method failure captured: Jul 23 21:25:03.756469 ncdv-master-1 devstack@n-api.service[131321]: request: POST /compute/v2.1/servers/d73bae1c-be56-4a5e-8e8d-56683aae946a/action HTTP/1.1 Jul 23 21:25:03.756469 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:25:03.756469 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:25:03.756469 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:25:03.756469 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 107 Jul 23 21:25:03.756469 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:25:03.756469 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:25:03.756469 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:25:03.756469 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:25:03.756469 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GcdFkVYIK2DtJm403sM7IG79jHXbShtkQheCHNeqOWOy-LrSxvgAeYLVbMoRM5VFKN6qfODnVk_B5qM-rDymLVGR4aR0RY1RwNvXXeBnLkJldpttrzdMpyZMOqZL8mI9RN_pqnVy4UDfpP9Qj4sUGOBflgakohNp1Y8WLMI7QhzBds Jul 23 21:25:03.756469 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:25:03.756469 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:25:03.756469 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:25:03.756469 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:25:03.756469 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:25:03.756469 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:25:03.756469 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 8305585b60d54beeb2b087a37260a89a Jul 23 21:25:03.756469 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1030577641 Jul 23 21:25:03.756469 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:25:03.756469 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:25:03.756469 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8305585b60d54beeb2b087a37260a89a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8305585b60d54beeb2b087a37260a89a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8305585b60d54beeb2b087a37260a89a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8305585b60d54beeb2b087a37260a89a"}]}] Jul 23 21:25:03.756469 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1030577641 Jul 23 21:25:03.756469 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 8305585b60d54beeb2b087a37260a89a Jul 23 21:25:03.756469 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1030577641 Jul 23 21:25:03.756469 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ImagesOneServerNegativeTestJSON-1030577641-project Jul 23 21:25:03.756469 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:25:03.756469 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:25:03.756469 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: e961e46ab94f4fffbc606485935ce64d Jul 23 21:25:03.756469 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1030577641-project Jul 23 21:25:03.756469 ncdv-master-1 devstack@n-api.service[131321]: Jul 23 21:25:03.756469 ncdv-master-1 devstack@n-api.service[131321]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1818171602", "metadata": {"": ""}}} Jul 23 21:25:03.756469 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:25:03.756469 ncdv-master-1 devstack@n-api.service[131321]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 23 21:25:03.756469 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': 'd73bae1c-be56-4a5e-8e8d-56683aae946a', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1818171602', 'metadata': {'': ''}}}} Jul 23 21:25:03.756469 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:25:03.756469 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:25:03.756469 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 23 21:25:03.756469 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 23 21:25:03.756469 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 23 21:25:03.756469 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise error Jul 23 21:25:03.756469 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 23 21:25:03.756469 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:25:03.756469 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Jul 23 21:25:03.756469 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 23 21:25:03.756469 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 23 21:25:03.756469 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 23 21:25:03.756469 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 23 21:25:03.756469 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:25:03.756469 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jul 23 21:25:03.756469 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi {'': ''} Jul 23 21:25:03.756469 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:25:03.756469 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:25:03.756469 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:25:03.756469 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:25:03.756469 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:25:03.756469 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:25:03.756469 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:25:03.756469 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:25:03.756469 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:25:03.756469 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:25:03.756469 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:25:03.756469 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:25:03.756469 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 23 21:25:03.765911 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 23 21:25:03.765911 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 23 21:25:03.765911 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 23 21:25:03.765911 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 23 21:25:03.765911 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 23 21:25:03.765911 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 23 21:25:03.765911 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:25:03.765911 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:25:03.765911 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:25:03.765911 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:25:03.765911 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:25:03.765911 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:25:03.765911 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 23 21:25:03.765911 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 23 21:25:03.765911 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 23 21:25:03.765911 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:25:03.765911 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-02b0a9d4-e03a-4f3c-af9e-7868b4274d03 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:25:03.765911 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-02b0a9d4-e03a-4f3c-af9e-7868b4274d03 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] 10.222.0.17 "POST /compute/v2.1/servers/d73bae1c-be56-4a5e-8e8d-56683aae946a/action" status: 400 len: 170 microversion: 2.1 time: 0.008567 Jul 23 21:25:03.765911 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1390/2735] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 23 21:25:03 2022] POST /compute/v2.1/servers/d73bae1c-be56-4a5e-8e8d-56683aae946a/action => generated 170 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 23 21:25:03.775990 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-fd9721dc-0dbd-494c-ad1a-c1847357f98e tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:03.778447 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-fd9721dc-0dbd-494c-ad1a-c1847357f98e tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] [instance: d73bae1c-be56-4a5e-8e8d-56683aae946a] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:03.799592 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fd9721dc-0dbd-494c-ad1a-c1847357f98e tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:03.800055 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fd9721dc-0dbd-494c-ad1a-c1847357f98e tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:03.800856 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fd9721dc-0dbd-494c-ad1a-c1847357f98e tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:03.804531 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fd9721dc-0dbd-494c-ad1a-c1847357f98e tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:04.097476 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-fd9721dc-0dbd-494c-ad1a-c1847357f98e tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961e46ab94f4fffbc606485935ce64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8305585b60d54beeb2b087a37260a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:04.107920 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-fd9721dc-0dbd-494c-ad1a-c1847357f98e tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] 10.222.0.17 "GET /compute/v2.1/servers/d73bae1c-be56-4a5e-8e8d-56683aae946a" status: 200 len: 1522 microversion: 2.1 time: 0.343493 Jul 23 21:25:04.123444 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1391/2736] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:03 2022] GET /compute/v2.1/servers/d73bae1c-be56-4a5e-8e8d-56683aae946a => generated 1522 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:04.132932 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-9b8db423-6830-4a8a-8e57-323c78c75658 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:04.133812 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-9b8db423-6830-4a8a-8e57-323c78c75658 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] [instance: d73bae1c-be56-4a5e-8e8d-56683aae946a] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:04.157658 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9b8db423-6830-4a8a-8e57-323c78c75658 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:04.158235 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9b8db423-6830-4a8a-8e57-323c78c75658 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:04.159061 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9b8db423-6830-4a8a-8e57-323c78c75658 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:04.162313 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9b8db423-6830-4a8a-8e57-323c78c75658 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:04.506811 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a5a67bd3-45b2-400b-8c20-0fce6d01c80d tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a609c39c14343e1bc1edd4b3cd56dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116def61aba4631be91f67df63ebab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:04.523314 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a5a67bd3-45b2-400b-8c20-0fce6d01c80d tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] 10.222.0.17 "GET /compute/v2.1/servers/73362a63-78d8-4890-8588-d112fb85c2bf" status: 200 len: 1505 microversion: 2.1 time: 1.010054 Jul 23 21:25:04.525734 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1346/2737] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:03 2022] GET /compute/v2.1/servers/73362a63-78d8-4890-8588-d112fb85c2bf => generated 1505 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:04.536961 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0bdca676-6559-4666-a068-2f8841bdb227 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:04.539159 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-0bdca676-6559-4666-a068-2f8841bdb227 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:04.553517 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0bdca676-6559-4666-a068-2f8841bdb227 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:04.554232 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0bdca676-6559-4666-a068-2f8841bdb227 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:04.555219 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0bdca676-6559-4666-a068-2f8841bdb227 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:04.555810 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0bdca676-6559-4666-a068-2f8841bdb227 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:04.560284 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-9b8db423-6830-4a8a-8e57-323c78c75658 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961e46ab94f4fffbc606485935ce64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8305585b60d54beeb2b087a37260a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:04.579830 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-9b8db423-6830-4a8a-8e57-323c78c75658 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] 10.222.0.17 "GET /compute/v2.1/servers/d73bae1c-be56-4a5e-8e8d-56683aae946a" status: 200 len: 1522 microversion: 2.1 time: 0.454419 Jul 23 21:25:04.581110 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1392/2738] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:04 2022] GET /compute/v2.1/servers/d73bae1c-be56-4a5e-8e8d-56683aae946a => generated 1522 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:04.597397 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-fbff831c-a74f-4690-963d-ec6ba0ac3720 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1311077566", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:25:04.601660 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-fbff831c-a74f-4690-963d-ec6ba0ac3720 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Request method failure captured: Jul 23 21:25:04.601660 ncdv-master-1 devstack@n-api.service[131321]: request: POST /compute/v2.1/servers/d73bae1c-be56-4a5e-8e8d-56683aae946a/action HTTP/1.1 Jul 23 21:25:04.601660 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:25:04.601660 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:25:04.601660 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:25:04.601660 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 619 Jul 23 21:25:04.601660 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:25:04.601660 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:25:04.601660 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:25:04.601660 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:25:04.601660 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GcdFkVYIK2DtJm403sM7IG79jHXbShtkQheCHNeqOWOy-LrSxvgAeYLVbMoRM5VFKN6qfODnVk_B5qM-rDymLVGR4aR0RY1RwNvXXeBnLkJldpttrzdMpyZMOqZL8mI9RN_pqnVy4UDfpP9Qj4sUGOBflgakohNp1Y8WLMI7QhzBds Jul 23 21:25:04.601660 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:25:04.601660 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:25:04.601660 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:25:04.601660 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:25:04.601660 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:25:04.601660 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:25:04.601660 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 8305585b60d54beeb2b087a37260a89a Jul 23 21:25:04.601660 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1030577641 Jul 23 21:25:04.601660 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:25:04.601660 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:25:04.601660 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8305585b60d54beeb2b087a37260a89a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8305585b60d54beeb2b087a37260a89a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8305585b60d54beeb2b087a37260a89a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8305585b60d54beeb2b087a37260a89a"}]}] Jul 23 21:25:04.601660 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1030577641 Jul 23 21:25:04.601660 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 8305585b60d54beeb2b087a37260a89a Jul 23 21:25:04.601660 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1030577641 Jul 23 21:25:04.601660 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ImagesOneServerNegativeTestJSON-1030577641-project Jul 23 21:25:04.601660 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:25:04.601660 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:25:04.601660 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: e961e46ab94f4fffbc606485935ce64d Jul 23 21:25:04.601660 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1030577641-project Jul 23 21:25:04.601660 ncdv-master-1 devstack@n-api.service[131321]: Jul 23 21:25:04.601660 ncdv-master-1 devstack@n-api.service[131321]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1311077566", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Jul 23 21:25:04.601660 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:25:04.601660 ncdv-master-1 devstack@n-api.service[131321]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 23 21:25:04.601660 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': 'd73bae1c-be56-4a5e-8e8d-56683aae946a', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1311077566', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Jul 23 21:25:04.601660 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:25:04.601660 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:25:04.601660 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 23 21:25:04.601660 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 23 21:25:04.601660 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 23 21:25:04.601660 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise error Jul 23 21:25:04.608339 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 23 21:25:04.608339 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:25:04.608339 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Jul 23 21:25:04.608339 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 23 21:25:04.608339 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 23 21:25:04.608339 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 23 21:25:04.608339 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 23 21:25:04.608339 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:25:04.608339 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jul 23 21:25:04.608339 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Jul 23 21:25:04.608339 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:25:04.608339 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:25:04.608339 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:25:04.608339 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:25:04.608339 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:25:04.608339 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:25:04.608339 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:25:04.608339 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:25:04.608339 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:25:04.608339 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:25:04.608339 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:25:04.608339 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:25:04.608339 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 23 21:25:04.608339 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 23 21:25:04.608339 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 23 21:25:04.608339 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 23 21:25:04.608339 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 23 21:25:04.608339 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 23 21:25:04.608339 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 23 21:25:04.608339 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:25:04.608339 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:25:04.608339 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:25:04.608339 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:25:04.608339 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:25:04.608339 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:25:04.608339 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 23 21:25:04.608339 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 23 21:25:04.608339 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 23 21:25:04.608339 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:25:04.611322 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-fbff831c-a74f-4690-963d-ec6ba0ac3720 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:25:04.611322 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-fbff831c-a74f-4690-963d-ec6ba0ac3720 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] 10.222.0.17 "POST /compute/v2.1/servers/d73bae1c-be56-4a5e-8e8d-56683aae946a/action" status: 400 len: 938 microversion: 2.1 time: 0.010418 Jul 23 21:25:04.611322 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1393/2739] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 23 21:25:04 2022] POST /compute/v2.1/servers/d73bae1c-be56-4a5e-8e8d-56683aae946a/action => generated 938 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 23 21:25:04.612450 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c3f12402-4bbb-45f1-ad7d-6b223848fa76 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:04.613235 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-c3f12402-4bbb-45f1-ad7d-6b223848fa76 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] [instance: d73bae1c-be56-4a5e-8e8d-56683aae946a] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:04.623335 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c3f12402-4bbb-45f1-ad7d-6b223848fa76 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:04.623773 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c3f12402-4bbb-45f1-ad7d-6b223848fa76 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:04.624594 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c3f12402-4bbb-45f1-ad7d-6b223848fa76 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:04.625036 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c3f12402-4bbb-45f1-ad7d-6b223848fa76 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:04.871705 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-0bdca676-6559-4666-a068-2f8841bdb227 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:04.886318 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-0bdca676-6559-4666-a068-2f8841bdb227 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:04.889494 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-0bdca676-6559-4666-a068-2f8841bdb227 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:04.892485 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-0bdca676-6559-4666-a068-2f8841bdb227 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 2756 microversion: 2.42 time: 0.365531 Jul 23 21:25:04.894135 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1347/2740] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:25:04 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 2756 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:25:04.935050 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-1ee8e15f-71c4-4549-b305-b9496dec9516 req-8918f5f7-d171-4b47-afb2-e503ca43800c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d09f96e-8ea6-4838-8264-4535f77fa39d", "name": "network-vif-unplugged", "status": "completed", "tag": "5b177b16-047c-46e8-9195-fbe5aa317e47"}, {"server_uuid": "4d09f96e-8ea6-4838-8264-4535f77fa39d", "name": "network-vif-unplugged", "status": "completed", "tag": "f0b13207-ab63-4a3b-9a07-970de92220c8"}, {"server_uuid": "4d09f96e-8ea6-4838-8264-4535f77fa39d", "name": "network-vif-unplugged", "status": "completed", "tag": "5765f451-685a-407c-8012-c24d49c52d7c"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:25:04.952375 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-1ee8e15f-71c4-4549-b305-b9496dec9516 req-8918f5f7-d171-4b47-afb2-e503ca43800c service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:04.952835 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-1ee8e15f-71c4-4549-b305-b9496dec9516 req-8918f5f7-d171-4b47-afb2-e503ca43800c service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:04.969411 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-1ee8e15f-71c4-4549-b305-b9496dec9516 req-8918f5f7-d171-4b47-afb2-e503ca43800c service nova] Creating event network-vif-unplugged:5b177b16-047c-46e8-9195-fbe5aa317e47 for instance 4d09f96e-8ea6-4838-8264-4535f77fa39d on nch2-master-1 Jul 23 21:25:04.970309 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-1ee8e15f-71c4-4549-b305-b9496dec9516 req-8918f5f7-d171-4b47-afb2-e503ca43800c service nova] Creating event network-vif-unplugged:f0b13207-ab63-4a3b-9a07-970de92220c8 for instance 4d09f96e-8ea6-4838-8264-4535f77fa39d on nch2-master-1 Jul 23 21:25:04.971499 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-1ee8e15f-71c4-4549-b305-b9496dec9516 req-8918f5f7-d171-4b47-afb2-e503ca43800c service nova] Creating event network-vif-unplugged:5765f451-685a-407c-8012-c24d49c52d7c for instance 4d09f96e-8ea6-4838-8264-4535f77fa39d on nch2-master-1 Jul 23 21:25:04.983750 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-1ee8e15f-71c4-4549-b305-b9496dec9516 req-8918f5f7-d171-4b47-afb2-e503ca43800c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.052896 Jul 23 21:25:04.985329 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1348/2741] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:25:04 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:25:05.017611 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c3f12402-4bbb-45f1-ad7d-6b223848fa76 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961e46ab94f4fffbc606485935ce64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8305585b60d54beeb2b087a37260a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:05.022599 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=100 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:25:05.037673 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-c3f12402-4bbb-45f1-ad7d-6b223848fa76 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] 10.222.0.17 "GET /compute/v2.1/servers/d73bae1c-be56-4a5e-8e8d-56683aae946a" status: 200 len: 1522 microversion: 2.1 time: 0.428016 Jul 23 21:25:05.038303 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1394/2742] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:04 2022] GET /compute/v2.1/servers/d73bae1c-be56-4a5e-8e8d-56683aae946a => generated 1522 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:05.057598 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0cbb97c2-a0c1-4d50-90dc-143066c01253 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:05.058572 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-0cbb97c2-a0c1-4d50-90dc-143066c01253 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] [instance: d73bae1c-be56-4a5e-8e8d-56683aae946a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:05.068720 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0cbb97c2-a0c1-4d50-90dc-143066c01253 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:05.069382 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0cbb97c2-a0c1-4d50-90dc-143066c01253 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:05.070373 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0cbb97c2-a0c1-4d50-90dc-143066c01253 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:05.070859 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0cbb97c2-a0c1-4d50-90dc-143066c01253 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:05.547811 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-64edbab1-271e-4d1c-8541-ab2138121882 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:05.548787 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-64edbab1-271e-4d1c-8541-ab2138121882 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] [instance: 73362a63-78d8-4890-8588-d112fb85c2bf] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:05.565243 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-64edbab1-271e-4d1c-8541-ab2138121882 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:05.566026 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-64edbab1-271e-4d1c-8541-ab2138121882 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:05.568416 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-64edbab1-271e-4d1c-8541-ab2138121882 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:05.569090 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-64edbab1-271e-4d1c-8541-ab2138121882 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:05.594903 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-0cbb97c2-a0c1-4d50-90dc-143066c01253 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961e46ab94f4fffbc606485935ce64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8305585b60d54beeb2b087a37260a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:05.606758 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-0cbb97c2-a0c1-4d50-90dc-143066c01253 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] 10.222.0.17 "GET /compute/v2.1/servers/d73bae1c-be56-4a5e-8e8d-56683aae946a" status: 200 len: 1522 microversion: 2.1 time: 0.554642 Jul 23 21:25:05.626994 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1349/2743] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:05 2022] GET /compute/v2.1/servers/d73bae1c-be56-4a5e-8e8d-56683aae946a => generated 1522 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:05.637792 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e481b5b5-13ae-411f-95b2-e9e7f55eaa73 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:25:05.641390 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e481b5b5-13ae-411f-95b2-e9e7f55eaa73 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Request method failure captured: Jul 23 21:25:05.641390 ncdv-master-1 devstack@n-api.service[131320]: request: POST /compute/v2.1/servers/d73bae1c-be56-4a5e-8e8d-56683aae946a/action HTTP/1.1 Jul 23 21:25:05.641390 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:25:05.641390 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:25:05.641390 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:25:05.641390 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 285 Jul 23 21:25:05.641390 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:25:05.641390 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:25:05.641390 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:25:05.641390 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:25:05.641390 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GcdFkVYIK2DtJm403sM7IG79jHXbShtkQheCHNeqOWOy-LrSxvgAeYLVbMoRM5VFKN6qfODnVk_B5qM-rDymLVGR4aR0RY1RwNvXXeBnLkJldpttrzdMpyZMOqZL8mI9RN_pqnVy4UDfpP9Qj4sUGOBflgakohNp1Y8WLMI7QhzBds Jul 23 21:25:05.641390 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:25:05.641390 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:25:05.641390 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:25:05.641390 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:25:05.641390 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:25:05.641390 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:25:05.641390 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 8305585b60d54beeb2b087a37260a89a Jul 23 21:25:05.641390 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1030577641 Jul 23 21:25:05.641390 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:25:05.641390 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:25:05.641390 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8305585b60d54beeb2b087a37260a89a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8305585b60d54beeb2b087a37260a89a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8305585b60d54beeb2b087a37260a89a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8305585b60d54beeb2b087a37260a89a"}]}] Jul 23 21:25:05.641390 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1030577641 Jul 23 21:25:05.641390 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 8305585b60d54beeb2b087a37260a89a Jul 23 21:25:05.641390 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1030577641 Jul 23 21:25:05.641390 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ImagesOneServerNegativeTestJSON-1030577641-project Jul 23 21:25:05.641390 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:25:05.641390 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:25:05.641390 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: e961e46ab94f4fffbc606485935ce64d Jul 23 21:25:05.641390 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1030577641-project Jul 23 21:25:05.641390 ncdv-master-1 devstack@n-api.service[131320]: Jul 23 21:25:05.641390 ncdv-master-1 devstack@n-api.service[131320]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jul 23 21:25:05.641390 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:25:05.641390 ncdv-master-1 devstack@n-api.service[131320]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 23 21:25:05.641390 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': 'd73bae1c-be56-4a5e-8e8d-56683aae946a', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jul 23 21:25:05.641390 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:25:05.641390 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:25:05.641390 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 23 21:25:05.641390 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 23 21:25:05.641390 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 23 21:25:05.641390 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise error Jul 23 21:25:05.641390 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 23 21:25:05.641390 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:25:05.641390 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Jul 23 21:25:05.641390 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 23 21:25:05.641390 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:25:05.641390 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jul 23 21:25:05.641390 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 23 21:25:05.641390 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:25:05.641390 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:25:05.641390 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:25:05.641390 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:25:05.644814 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:25:05.644814 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:25:05.644814 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:25:05.644814 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:25:05.644814 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:25:05.644814 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:25:05.644814 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:25:05.644814 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:25:05.644814 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 23 21:25:05.644814 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 23 21:25:05.644814 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 23 21:25:05.644814 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 23 21:25:05.644814 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 23 21:25:05.644814 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 23 21:25:05.644814 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 23 21:25:05.644814 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:25:05.644814 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:25:05.644814 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:25:05.644814 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:25:05.644814 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:25:05.644814 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:25:05.644814 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 23 21:25:05.644814 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 23 21:25:05.644814 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 23 21:25:05.644814 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:25:05.650775 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e481b5b5-13ae-411f-95b2-e9e7f55eaa73 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:25:05.658965 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e481b5b5-13ae-411f-95b2-e9e7f55eaa73 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] 10.222.0.17 "POST /compute/v2.1/servers/d73bae1c-be56-4a5e-8e8d-56683aae946a/action" status: 400 len: 619 microversion: 2.1 time: 0.030490 Jul 23 21:25:05.664296 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1350/2744] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Jul 23 21:25:05 2022] POST /compute/v2.1/servers/d73bae1c-be56-4a5e-8e8d-56683aae946a/action => generated 619 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 23 21:25:05.671621 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6432d403-f008-4557-8938-badbd0fa6cc9 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:05.672521 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6432d403-f008-4557-8938-badbd0fa6cc9 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] [instance: d73bae1c-be56-4a5e-8e8d-56683aae946a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:05.681333 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6432d403-f008-4557-8938-badbd0fa6cc9 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:05.682075 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6432d403-f008-4557-8938-badbd0fa6cc9 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:05.683084 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6432d403-f008-4557-8938-badbd0fa6cc9 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:05.683736 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6432d403-f008-4557-8938-badbd0fa6cc9 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:06.310314 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-64edbab1-271e-4d1c-8541-ab2138121882 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a609c39c14343e1bc1edd4b3cd56dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116def61aba4631be91f67df63ebab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:06.329255 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-64edbab1-271e-4d1c-8541-ab2138121882 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] 10.222.0.17 "GET /compute/v2.1/servers/73362a63-78d8-4890-8588-d112fb85c2bf" status: 200 len: 1505 microversion: 2.1 time: 0.788413 Jul 23 21:25:06.332304 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1395/2745] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:05 2022] GET /compute/v2.1/servers/73362a63-78d8-4890-8588-d112fb85c2bf => generated 1505 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:06.340405 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-81a41410-f3cf-4ae6-ab07-3b1fc016ea8a req-b158fa8c-103d-4a1b-9cc2-e5133d633dd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d09f96e-8ea6-4838-8264-4535f77fa39d", "name": "network-vif-deleted", "tag": "857743d4-9fc9-4509-a86f-9253f99e2a3c"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:25:06.357430 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-81a41410-f3cf-4ae6-ab07-3b1fc016ea8a req-b158fa8c-103d-4a1b-9cc2-e5133d633dd1 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:06.358346 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-81a41410-f3cf-4ae6-ab07-3b1fc016ea8a req-b158fa8c-103d-4a1b-9cc2-e5133d633dd1 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:06.386050 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6432d403-f008-4557-8938-badbd0fa6cc9 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961e46ab94f4fffbc606485935ce64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8305585b60d54beeb2b087a37260a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:06.406796 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-81a41410-f3cf-4ae6-ab07-3b1fc016ea8a req-b158fa8c-103d-4a1b-9cc2-e5133d633dd1 service nova] Creating event network-vif-deleted:857743d4-9fc9-4509-a86f-9253f99e2a3c for instance 4d09f96e-8ea6-4838-8264-4535f77fa39d on nch2-master-1 Jul 23 21:25:06.407589 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6432d403-f008-4557-8938-badbd0fa6cc9 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] 10.222.0.17 "GET /compute/v2.1/servers/d73bae1c-be56-4a5e-8e8d-56683aae946a" status: 200 len: 1522 microversion: 2.1 time: 0.739106 Jul 23 21:25:06.409223 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1351/2746] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:05 2022] GET /compute/v2.1/servers/d73bae1c-be56-4a5e-8e8d-56683aae946a => generated 1522 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:06.418758 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a5290b05-fa32-4a64-a544-d1e122edf907 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:06.421403 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-81a41410-f3cf-4ae6-ab07-3b1fc016ea8a req-b158fa8c-103d-4a1b-9cc2-e5133d633dd1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087171 Jul 23 21:25:06.422600 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a5290b05-fa32-4a64-a544-d1e122edf907 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:06.423871 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1396/2747] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:25:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:25:06.458344 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a5290b05-fa32-4a64-a544-d1e122edf907 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:06.458901 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-127b4aa9-e663-4cdc-8023-922344c70af0 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:06.460321 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a5290b05-fa32-4a64-a544-d1e122edf907 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:06.462238 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-127b4aa9-e663-4cdc-8023-922344c70af0 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] [instance: d73bae1c-be56-4a5e-8e8d-56683aae946a] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:06.464355 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a5290b05-fa32-4a64-a544-d1e122edf907 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:06.464956 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a5290b05-fa32-4a64-a544-d1e122edf907 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:06.495303 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-127b4aa9-e663-4cdc-8023-922344c70af0 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:06.496842 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-127b4aa9-e663-4cdc-8023-922344c70af0 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:06.498254 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-127b4aa9-e663-4cdc-8023-922344c70af0 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:06.504819 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-127b4aa9-e663-4cdc-8023-922344c70af0 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:06.936635 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-127b4aa9-e663-4cdc-8023-922344c70af0 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961e46ab94f4fffbc606485935ce64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8305585b60d54beeb2b087a37260a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:06.946505 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-127b4aa9-e663-4cdc-8023-922344c70af0 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] 10.222.0.17 "GET /compute/v2.1/servers/d73bae1c-be56-4a5e-8e8d-56683aae946a" status: 200 len: 1522 microversion: 2.1 time: 0.519349 Jul 23 21:25:06.947563 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1397/2748] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:06 2022] GET /compute/v2.1/servers/d73bae1c-be56-4a5e-8e8d-56683aae946a => generated 1522 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:06.965086 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e73555df-ad01-41d5-8a44-0b2f734e595d tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-533872695"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:25:06.966330 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-e73555df-ad01-41d5-8a44-0b2f734e595d tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] [instance: d73bae1c-be56-4a5e-8e8d-56683aae946a] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:06.972855 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e73555df-ad01-41d5-8a44-0b2f734e595d tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:06.973653 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e73555df-ad01-41d5-8a44-0b2f734e595d tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:06.974711 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e73555df-ad01-41d5-8a44-0b2f734e595d tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:06.975376 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e73555df-ad01-41d5-8a44-0b2f734e595d tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:07.099654 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a5290b05-fa32-4a64-a544-d1e122edf907 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:07.126536 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a5290b05-fa32-4a64-a544-d1e122edf907 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:07.131284 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a5290b05-fa32-4a64-a544-d1e122edf907 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:07.132901 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a5290b05-fa32-4a64-a544-d1e122edf907 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 2418 microversion: 2.42 time: 0.721858 Jul 23 21:25:07.136655 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1352/2749] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:25:06 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 2418 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:25:07.348511 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ca395b97-1b43-499b-a37e-bb3775b1f800 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:07.349135 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ca395b97-1b43-499b-a37e-bb3775b1f800 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] [instance: 73362a63-78d8-4890-8588-d112fb85c2bf] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:07.356416 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ca395b97-1b43-499b-a37e-bb3775b1f800 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:07.357075 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ca395b97-1b43-499b-a37e-bb3775b1f800 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:07.358043 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ca395b97-1b43-499b-a37e-bb3775b1f800 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:07.359109 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ca395b97-1b43-499b-a37e-bb3775b1f800 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:07.520843 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-e73555df-ad01-41d5-8a44-0b2f734e595d tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] 10.222.0.17 "POST /compute/v2.1/servers/d73bae1c-be56-4a5e-8e8d-56683aae946a/action" status: 202 len: 0 microversion: 2.1 time: 0.561133 Jul 23 21:25:07.528527 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1398/2750] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:25:06 2022] POST /compute/v2.1/servers/d73bae1c-be56-4a5e-8e8d-56683aae946a/action => generated 0 bytes in 570 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Jul 23 21:25:07.549724 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-922c53df-0aec-46ba-8253-1f4018539a42 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1748652998"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:25:07.550713 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-922c53df-0aec-46ba-8253-1f4018539a42 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] [instance: d73bae1c-be56-4a5e-8e8d-56683aae946a] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:07.588266 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-922c53df-0aec-46ba-8253-1f4018539a42 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:07.590429 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-922c53df-0aec-46ba-8253-1f4018539a42 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:07.591584 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-922c53df-0aec-46ba-8253-1f4018539a42 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:07.593201 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-922c53df-0aec-46ba-8253-1f4018539a42 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:07.729789 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-922c53df-0aec-46ba-8253-1f4018539a42 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] HTTP exception thrown: Cannot 'createImage' instance d73bae1c-be56-4a5e-8e8d-56683aae946a while it is in task_state image_snapshot_pending Jul 23 21:25:07.731538 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-922c53df-0aec-46ba-8253-1f4018539a42 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Request method failure captured: Jul 23 21:25:07.731538 ncdv-master-1 devstack@n-api.service[131321]: request: POST /compute/v2.1/servers/d73bae1c-be56-4a5e-8e8d-56683aae946a/action HTTP/1.1 Jul 23 21:25:07.731538 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:25:07.731538 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:25:07.731538 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:25:07.731538 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 85 Jul 23 21:25:07.731538 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:25:07.731538 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:25:07.731538 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:25:07.731538 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:25:07.731538 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GcdFkVYIK2DtJm403sM7IG79jHXbShtkQheCHNeqOWOy-LrSxvgAeYLVbMoRM5VFKN6qfODnVk_B5qM-rDymLVGR4aR0RY1RwNvXXeBnLkJldpttrzdMpyZMOqZL8mI9RN_pqnVy4UDfpP9Qj4sUGOBflgakohNp1Y8WLMI7QhzBds Jul 23 21:25:07.731538 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:25:07.731538 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:25:07.731538 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:25:07.731538 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:25:07.731538 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:25:07.731538 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:25:07.731538 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 8305585b60d54beeb2b087a37260a89a Jul 23 21:25:07.731538 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1030577641 Jul 23 21:25:07.731538 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:25:07.731538 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:25:07.731538 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8305585b60d54beeb2b087a37260a89a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8305585b60d54beeb2b087a37260a89a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8305585b60d54beeb2b087a37260a89a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8305585b60d54beeb2b087a37260a89a"}]}] Jul 23 21:25:07.731538 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1030577641 Jul 23 21:25:07.731538 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 8305585b60d54beeb2b087a37260a89a Jul 23 21:25:07.731538 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1030577641 Jul 23 21:25:07.731538 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ImagesOneServerNegativeTestJSON-1030577641-project Jul 23 21:25:07.731538 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:25:07.731538 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:25:07.731538 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: e961e46ab94f4fffbc606485935ce64d Jul 23 21:25:07.731538 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1030577641-project Jul 23 21:25:07.731538 ncdv-master-1 devstack@n-api.service[131321]: Jul 23 21:25:07.731538 ncdv-master-1 devstack@n-api.service[131321]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1748652998"}} Jul 23 21:25:07.731538 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:25:07.731538 ncdv-master-1 devstack@n-api.service[131321]: exception: Cannot 'createImage' instance d73bae1c-be56-4a5e-8e8d-56683aae946a while it is in task_state image_snapshot_pending Jul 23 21:25:07.731538 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': 'd73bae1c-be56-4a5e-8e8d-56683aae946a', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1748652998'}}} Jul 23 21:25:07.731538 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:25:07.731538 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:25:07.731538 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1346, in _action_create_image Jul 23 21:25:07.731538 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Jul 23 21:25:07.731538 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 152, in inner Jul 23 21:25:07.731538 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 23 21:25:07.731538 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d73bae1c-be56-4a5e-8e8d-56683aae946a in task_state image_snapshot_pending. Cannot snapshot while the instance is in this state. Jul 23 21:25:07.731538 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:25:07.731538 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:25:07.731538 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:25:07.731538 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:25:07.731538 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:25:07.731538 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:25:07.731538 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:25:07.731538 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:25:07.731538 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:25:07.731538 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:25:07.731538 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:25:07.731538 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:25:07.731538 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:25:07.731538 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:25:07.731538 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1351, in _action_create_image Jul 23 21:25:07.731538 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 23 21:25:07.731538 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 23 21:25:07.731538 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 23 21:25:07.735231 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance d73bae1c-be56-4a5e-8e8d-56683aae946a while it is in task_state image_snapshot_pending Jul 23 21:25:07.735231 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:25:07.735231 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:25:07.735231 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:25:07.735231 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:25:07.735231 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:25:07.735231 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:25:07.735231 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:25:07.735231 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:25:07.735231 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance d73bae1c-be56-4a5e-8e8d-56683aae946a while it is in task_state image_snapshot_pending Jul 23 21:25:07.735231 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:25:07.735231 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-922c53df-0aec-46ba-8253-1f4018539a42 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Returning 409 to user: Cannot 'createImage' instance d73bae1c-be56-4a5e-8e8d-56683aae946a while it is in task_state image_snapshot_pending {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:25:07.746045 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-922c53df-0aec-46ba-8253-1f4018539a42 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] 10.222.0.17 "POST /compute/v2.1/servers/d73bae1c-be56-4a5e-8e8d-56683aae946a/action" status: 409 len: 167 microversion: 2.1 time: 0.197775 Jul 23 21:25:07.747411 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1399/2751] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:25:07 2022] POST /compute/v2.1/servers/d73bae1c-be56-4a5e-8e8d-56683aae946a/action => generated 167 bytes in 213 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 23 21:25:07.755925 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-298fbe3f-0b36-4ef4-aca2-5289fd432104 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Calling method '.version_select at 0x7f0b472c1b80>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:08.051718 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ca395b97-1b43-499b-a37e-bb3775b1f800 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a609c39c14343e1bc1edd4b3cd56dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116def61aba4631be91f67df63ebab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:08.065820 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-298fbe3f-0b36-4ef4-aca2-5289fd432104 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] 10.222.0.17 "DELETE /compute/v2.1/images/d942e3c3-be75-4451-abba-ba6f877edc00" status: 204 len: 0 microversion: 2.1 time: 0.313654 Jul 23 21:25:08.066646 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1400/2752] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:07 2022] DELETE /compute/v2.1/images/d942e3c3-be75-4451-abba-ba6f877edc00 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 23 21:25:08.081756 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ca395b97-1b43-499b-a37e-bb3775b1f800 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] 10.222.0.17 "GET /compute/v2.1/servers/73362a63-78d8-4890-8588-d112fb85c2bf" status: 200 len: 1505 microversion: 2.1 time: 0.718170 Jul 23 21:25:08.082637 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1353/2753] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:07 2022] GET /compute/v2.1/servers/73362a63-78d8-4890-8588-d112fb85c2bf => generated 1505 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:08.092717 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8739707b-3668-49e1-83fa-06219cd7df7e tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:08.093794 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8739707b-3668-49e1-83fa-06219cd7df7e tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] [instance: d73bae1c-be56-4a5e-8e8d-56683aae946a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:08.101565 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8739707b-3668-49e1-83fa-06219cd7df7e tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:08.109423 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8739707b-3668-49e1-83fa-06219cd7df7e tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:08.110672 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8739707b-3668-49e1-83fa-06219cd7df7e tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:08.119389 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8739707b-3668-49e1-83fa-06219cd7df7e tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:08.294395 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-7b05a168-e057-484e-9bd6-8ba437d7e057 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-649361757", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "networks": [{"uuid": "4b9e65e8-f055-48cd-b4dd-6600f7078a23"}]}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:25:08.396226 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.network.neutron [None req-7b05a168-e057-484e-9bd6-8ba437d7e057 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] validate_networks() for [('4b9e65e8-f055-48cd-b4dd-6600f7078a23', None, None, None, None, None)] {{(pid=131321) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:25:08.575849 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8739707b-3668-49e1-83fa-06219cd7df7e tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961e46ab94f4fffbc606485935ce64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8305585b60d54beeb2b087a37260a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:08.584701 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8739707b-3668-49e1-83fa-06219cd7df7e tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] 10.222.0.17 "GET /compute/v2.1/servers/d73bae1c-be56-4a5e-8e8d-56683aae946a" status: 200 len: 1534 microversion: 2.1 time: 0.500792 Jul 23 21:25:08.590864 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1354/2754] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:08 2022] GET /compute/v2.1/servers/d73bae1c-be56-4a5e-8e8d-56683aae946a => generated 1534 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:08.603102 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f5c44df4-a436-4532-b879-6e753a21f067 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:08.618999 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f5c44df4-a436-4532-b879-6e753a21f067 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:08.634308 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f5c44df4-a436-4532-b879-6e753a21f067 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:08.639754 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f5c44df4-a436-4532-b879-6e753a21f067 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:08.642439 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f5c44df4-a436-4532-b879-6e753a21f067 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:08.642903 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f5c44df4-a436-4532-b879-6e753a21f067 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:09.087485 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f5c44df4-a436-4532-b879-6e753a21f067 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:09.114559 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f5c44df4-a436-4532-b879-6e753a21f067 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:09.115970 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f5c44df4-a436-4532-b879-6e753a21f067 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:09.120234 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f5c44df4-a436-4532-b879-6e753a21f067 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 2326 microversion: 2.42 time: 0.527381 Jul 23 21:25:09.141539 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1355/2755] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:25:08 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 2326 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:25:09.153906 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-77bd1779-7d8b-4bb7-bf4a-6344d554e321 req-5f93ccb1-c8ce-4ab9-b397-fd986b90ec28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d09f96e-8ea6-4838-8264-4535f77fa39d", "name": "network-vif-deleted", "tag": "5765f451-685a-407c-8012-c24d49c52d7c"}, {"server_uuid": "4d09f96e-8ea6-4838-8264-4535f77fa39d", "name": "network-vif-deleted", "tag": "5b177b16-047c-46e8-9195-fbe5aa317e47"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:25:09.172760 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-77bd1779-7d8b-4bb7-bf4a-6344d554e321 req-5f93ccb1-c8ce-4ab9-b397-fd986b90ec28 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:09.173523 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-77bd1779-7d8b-4bb7-bf4a-6344d554e321 req-5f93ccb1-c8ce-4ab9-b397-fd986b90ec28 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:09.193752 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-77bd1779-7d8b-4bb7-bf4a-6344d554e321 req-5f93ccb1-c8ce-4ab9-b397-fd986b90ec28 service nova] Creating event network-vif-deleted:5765f451-685a-407c-8012-c24d49c52d7c for instance 4d09f96e-8ea6-4838-8264-4535f77fa39d on nch2-master-1 Jul 23 21:25:09.194658 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-77bd1779-7d8b-4bb7-bf4a-6344d554e321 req-5f93ccb1-c8ce-4ab9-b397-fd986b90ec28 service nova] Creating event network-vif-deleted:5b177b16-047c-46e8-9195-fbe5aa317e47 for instance 4d09f96e-8ea6-4838-8264-4535f77fa39d on nch2-master-1 Jul 23 21:25:09.209891 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-77bd1779-7d8b-4bb7-bf4a-6344d554e321 req-5f93ccb1-c8ce-4ab9-b397-fd986b90ec28 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.065698 Jul 23 21:25:09.210734 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1356/2756] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:25:09 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:25:09.223428 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1fd5a1f1-f91f-4dfb-974a-ea8ca505336d tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:09.224604 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1fd5a1f1-f91f-4dfb-974a-ea8ca505336d tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] [instance: 73362a63-78d8-4890-8588-d112fb85c2bf] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:09.234584 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1fd5a1f1-f91f-4dfb-974a-ea8ca505336d tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:09.235321 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1fd5a1f1-f91f-4dfb-974a-ea8ca505336d tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:09.241661 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1fd5a1f1-f91f-4dfb-974a-ea8ca505336d tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:09.248105 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1fd5a1f1-f91f-4dfb-974a-ea8ca505336d tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:09.506337 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-1fd5a1f1-f91f-4dfb-974a-ea8ca505336d tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a609c39c14343e1bc1edd4b3cd56dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116def61aba4631be91f67df63ebab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:09.545442 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1fd5a1f1-f91f-4dfb-974a-ea8ca505336d tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] 10.222.0.17 "GET /compute/v2.1/servers/73362a63-78d8-4890-8588-d112fb85c2bf" status: 200 len: 1505 microversion: 2.1 time: 0.333013 Jul 23 21:25:09.547524 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1357/2757] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:09 2022] GET /compute/v2.1/servers/73362a63-78d8-4890-8588-d112fb85c2bf => generated 1505 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:09.892478 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b195f9b1-1620-4c62-a523-ae897cf3b1ca tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-357551285", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "fd38a33f-b1fb-4be5-84f6-29859edc8b69"}]}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:25:09.910775 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-7b05a168-e057-484e-9bd6-8ba437d7e057 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Flavor limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:25:09.911291 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-7b05a168-e057-484e-9bd6-8ba437d7e057 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Image limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:25:09.911668 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-7b05a168-e057-484e-9bd6-8ba437d7e057 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Flavor pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:25:09.912074 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-7b05a168-e057-484e-9bd6-8ba437d7e057 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Image pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:25:09.912682 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-7b05a168-e057-484e-9bd6-8ba437d7e057 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:25:09.927139 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7b05a168-e057-484e-9bd6-8ba437d7e057 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:09.927772 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7b05a168-e057-484e-9bd6-8ba437d7e057 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:09.928737 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7b05a168-e057-484e-9bd6-8ba437d7e057 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:09.929363 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7b05a168-e057-484e-9bd6-8ba437d7e057 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:09.957605 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-7b05a168-e057-484e-9bd6-8ba437d7e057 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Getting quotas for project b3efb8824be84323b6ec04b604775bd0. Resources: {'ram', 'instances', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:25:09.970197 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-7b05a168-e057-484e-9bd6-8ba437d7e057 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Getting quotas for user 859c1493a30d4386b74377ab2b9bc81d and project b3efb8824be84323b6ec04b604775bd0. Resources: {'ram', 'instances', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:25:09.974086 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-b195f9b1-1620-4c62-a523-ae897cf3b1ca tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] validate_networks() for [('fd38a33f-b1fb-4be5-84f6-29859edc8b69', None, None, None, None, None)] {{(pid=131320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:25:09.989387 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_api:SELECT=100 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:25:09.991421 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-7b05a168-e057-484e-9bd6-8ba437d7e057 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Going to run 1 instances... {{(pid=131321) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:25:09.994627 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-7b05a168-e057-484e-9bd6-8ba437d7e057 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] [instance: 35d0d067-4f24-45a4-b03c-32346b764d3c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131321) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:25:10.054229 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-7b05a168-e057-484e-9bd6-8ba437d7e057 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.986358 Jul 23 21:25:10.066849 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1401/2758] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:25:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1999 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 23 21:25:10.073344 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-2620cf2f-9594-4541-afd3-21c76330c76f tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:10.074725 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-2620cf2f-9594-4541-afd3-21c76330c76f tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] [instance: d73bae1c-be56-4a5e-8e8d-56683aae946a] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:10.082744 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2620cf2f-9594-4541-afd3-21c76330c76f tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:10.083501 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2620cf2f-9594-4541-afd3-21c76330c76f tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:10.087195 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2620cf2f-9594-4541-afd3-21c76330c76f tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:10.087869 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2620cf2f-9594-4541-afd3-21c76330c76f tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:10.404041 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-2620cf2f-9594-4541-afd3-21c76330c76f tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961e46ab94f4fffbc606485935ce64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8305585b60d54beeb2b087a37260a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:10.419397 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-2620cf2f-9594-4541-afd3-21c76330c76f tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] 10.222.0.17 "GET /compute/v2.1/servers/d73bae1c-be56-4a5e-8e8d-56683aae946a" status: 200 len: 1540 microversion: 2.1 time: 0.350856 Jul 23 21:25:10.420682 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1402/2759] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:10 2022] GET /compute/v2.1/servers/d73bae1c-be56-4a5e-8e8d-56683aae946a => generated 1540 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:10.427409 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-16dc9169-d600-41e7-a4a0-d9e5d8b012f3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:10.428303 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-16dc9169-d600-41e7-a4a0-d9e5d8b012f3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:10.443467 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-16dc9169-d600-41e7-a4a0-d9e5d8b012f3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:10.444207 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-16dc9169-d600-41e7-a4a0-d9e5d8b012f3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:10.445470 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-16dc9169-d600-41e7-a4a0-d9e5d8b012f3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:10.446281 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-16dc9169-d600-41e7-a4a0-d9e5d8b012f3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:10.542953 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-16dc9169-d600-41e7-a4a0-d9e5d8b012f3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:10.568487 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-16dc9169-d600-41e7-a4a0-d9e5d8b012f3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:10.570229 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-16dc9169-d600-41e7-a4a0-d9e5d8b012f3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:10.571994 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-16dc9169-d600-41e7-a4a0-d9e5d8b012f3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.149294 Jul 23 21:25:10.572731 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1403/2760] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:25:10 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:25:10.577625 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-0bce309a-2878-41b8-af4e-76523955fec7 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-137057156", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "networks": [{"uuid": "4b9e65e8-f055-48cd-b4dd-6600f7078a23"}]}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:25:10.672784 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.network.neutron [None req-0bce309a-2878-41b8-af4e-76523955fec7 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] validate_networks() for [('4b9e65e8-f055-48cd-b4dd-6600f7078a23', None, None, None, None, None)] {{(pid=131321) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:25:11.167047 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-b195f9b1-1620-4c62-a523-ae897cf3b1ca tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:25:11.167665 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-b195f9b1-1620-4c62-a523-ae897cf3b1ca tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:25:11.168147 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-b195f9b1-1620-4c62-a523-ae897cf3b1ca tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:25:11.168630 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-b195f9b1-1620-4c62-a523-ae897cf3b1ca tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:25:11.169161 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-b195f9b1-1620-4c62-a523-ae897cf3b1ca tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:25:11.187454 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b195f9b1-1620-4c62-a523-ae897cf3b1ca tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:11.188224 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b195f9b1-1620-4c62-a523-ae897cf3b1ca tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:11.189266 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b195f9b1-1620-4c62-a523-ae897cf3b1ca tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:11.189898 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b195f9b1-1620-4c62-a523-ae897cf3b1ca tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:11.234954 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-b195f9b1-1620-4c62-a523-ae897cf3b1ca tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Getting quotas for project 892f8e8d61274d54bd996140a9ab38f9. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:25:11.250944 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-b195f9b1-1620-4c62-a523-ae897cf3b1ca tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Getting quotas for user 8a7b95c6fb6743cf9f1942a6328a1ba7 and project 892f8e8d61274d54bd996140a9ab38f9. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:25:11.271551 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b195f9b1-1620-4c62-a523-ae897cf3b1ca tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Going to run 3 instances... {{(pid=131320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:25:11.274330 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b195f9b1-1620-4c62-a523-ae897cf3b1ca tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] [instance: acfc85ad-35a7-4cfd-935d-89707e3bc08c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:25:11.340244 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b195f9b1-1620-4c62-a523-ae897cf3b1ca tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] [instance: 34973378-2075-4fc5-88c2-ab65d5d9fcb8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=acfc85ad-35a7-4cfd-935d-89707e3bc08c,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:25:11.401466 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b195f9b1-1620-4c62-a523-ae897cf3b1ca tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] [instance: 7da7a2f3-d7d5-4413-9967-4be43db261fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=34973378-2075-4fc5-88c2-ab65d5d9fcb8,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:25:11.447658 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-0bce309a-2878-41b8-af4e-76523955fec7 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Flavor limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:25:11.448925 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-0bce309a-2878-41b8-af4e-76523955fec7 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Image limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:25:11.449615 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-0bce309a-2878-41b8-af4e-76523955fec7 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Flavor pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:25:11.450242 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-0bce309a-2878-41b8-af4e-76523955fec7 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Image pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:25:11.450669 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-0bce309a-2878-41b8-af4e-76523955fec7 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:25:11.462184 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0bce309a-2878-41b8-af4e-76523955fec7 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:11.462992 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0bce309a-2878-41b8-af4e-76523955fec7 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:11.464523 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0bce309a-2878-41b8-af4e-76523955fec7 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:11.465222 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0bce309a-2878-41b8-af4e-76523955fec7 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:11.495521 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-0bce309a-2878-41b8-af4e-76523955fec7 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Getting quotas for project b3efb8824be84323b6ec04b604775bd0. Resources: {'ram', 'instances', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:25:11.503012 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-0bce309a-2878-41b8-af4e-76523955fec7 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Getting quotas for user 859c1493a30d4386b74377ab2b9bc81d and project b3efb8824be84323b6ec04b604775bd0. Resources: {'ram', 'instances', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:25:11.512748 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b195f9b1-1620-4c62-a523-ae897cf3b1ca tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.963406 Jul 23 21:25:11.513389 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1358/2761] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:25:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1965 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 23 21:25:11.518940 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6d5618ec-4dae-486c-b2b7-647fb3540b4b tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:11.527138 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-0bce309a-2878-41b8-af4e-76523955fec7 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Going to run 1 instances... {{(pid=131321) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:25:11.528398 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6d5618ec-4dae-486c-b2b7-647fb3540b4b tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] [instance: 73362a63-78d8-4890-8588-d112fb85c2bf] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:11.531697 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-0bce309a-2878-41b8-af4e-76523955fec7 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] [instance: dcb1aa47-1abb-4c2f-9686-7268d2b86967] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131321) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:25:11.553198 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6d5618ec-4dae-486c-b2b7-647fb3540b4b tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:11.553754 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6d5618ec-4dae-486c-b2b7-647fb3540b4b tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:11.555139 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6d5618ec-4dae-486c-b2b7-647fb3540b4b tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:11.555859 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6d5618ec-4dae-486c-b2b7-647fb3540b4b tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:11.561736 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:25:11.650700 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-0bce309a-2878-41b8-af4e-76523955fec7 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.074994 Jul 23 21:25:11.653575 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1404/2762] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:25:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1079 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 23 21:25:11.667480 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-2f725479-83c3-4b27-b55e-b09fbf0cab0c req-fde87b76-f268-4ee9-80f2-77a0fe807025 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d09f96e-8ea6-4838-8264-4535f77fa39d", "name": "network-vif-deleted", "tag": "f0b13207-ab63-4a3b-9a07-970de92220c8"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:25:11.719908 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-2f725479-83c3-4b27-b55e-b09fbf0cab0c req-fde87b76-f268-4ee9-80f2-77a0fe807025 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:11.720370 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-2f725479-83c3-4b27-b55e-b09fbf0cab0c req-fde87b76-f268-4ee9-80f2-77a0fe807025 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:11.776945 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-2f725479-83c3-4b27-b55e-b09fbf0cab0c req-fde87b76-f268-4ee9-80f2-77a0fe807025 service nova] Creating event network-vif-deleted:f0b13207-ab63-4a3b-9a07-970de92220c8 for instance 4d09f96e-8ea6-4838-8264-4535f77fa39d on nch2-master-1 Jul 23 21:25:11.809103 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-2f725479-83c3-4b27-b55e-b09fbf0cab0c req-fde87b76-f268-4ee9-80f2-77a0fe807025 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153538 Jul 23 21:25:11.833645 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1405/2763] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:25:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:25:11.842478 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-90749e6c-4adb-44e8-bb55-e27e9e061f86 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:11.843199 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-90749e6c-4adb-44e8-bb55-e27e9e061f86 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] [instance: d73bae1c-be56-4a5e-8e8d-56683aae946a] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:11.881415 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-90749e6c-4adb-44e8-bb55-e27e9e061f86 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:11.881907 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-90749e6c-4adb-44e8-bb55-e27e9e061f86 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:11.882696 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-90749e6c-4adb-44e8-bb55-e27e9e061f86 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:11.883182 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-90749e6c-4adb-44e8-bb55-e27e9e061f86 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:12.079152 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6d5618ec-4dae-486c-b2b7-647fb3540b4b tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a609c39c14343e1bc1edd4b3cd56dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116def61aba4631be91f67df63ebab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:12.113021 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6d5618ec-4dae-486c-b2b7-647fb3540b4b tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] 10.222.0.17 "GET /compute/v2.1/servers/73362a63-78d8-4890-8588-d112fb85c2bf" status: 200 len: 1505 microversion: 2.1 time: 0.596984 Jul 23 21:25:12.114582 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1359/2764] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:11 2022] GET /compute/v2.1/servers/73362a63-78d8-4890-8588-d112fb85c2bf => generated 1505 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:12.121391 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a79a6551-6667-4601-992d-390fadae84fd tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:12.125342 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a79a6551-6667-4601-992d-390fadae84fd tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8a7b95c6fb6743cf9f1942a6328a1ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f8e8d61274d54bd996140a9ab38f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:12.126759 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a79a6551-6667-4601-992d-390fadae84fd tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Searching by: {'deleted': False, 'project_id': '892f8e8d61274d54bd996140a9ab38f9'} {{(pid=131320) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 23 21:25:12.187246 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a79a6551-6667-4601-992d-390fadae84fd tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:12.188435 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a79a6551-6667-4601-992d-390fadae84fd tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:12.189856 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a79a6551-6667-4601-992d-390fadae84fd tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:12.190646 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a79a6551-6667-4601-992d-390fadae84fd tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:12.252483 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a79a6551-6667-4601-992d-390fadae84fd tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] 10.222.0.17 "GET /compute/v2.1/servers" status: 200 len: 1015 microversion: 2.1 time: 0.136695 Jul 23 21:25:12.279166 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1360/2765] 10.222.0.17 () {58 vars in 1124 bytes} [Sat Jul 23 21:25:12 2022] GET /compute/v2.1/servers => generated 1015 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:12.288705 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6cef4b84-fc5d-4d36-86ed-27d5c3bd230d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:12.307696 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6cef4b84-fc5d-4d36-86ed-27d5c3bd230d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:12.336648 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6cef4b84-fc5d-4d36-86ed-27d5c3bd230d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:12.337577 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6cef4b84-fc5d-4d36-86ed-27d5c3bd230d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:12.339980 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6cef4b84-fc5d-4d36-86ed-27d5c3bd230d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:12.341816 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6cef4b84-fc5d-4d36-86ed-27d5c3bd230d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:12.499639 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6cef4b84-fc5d-4d36-86ed-27d5c3bd230d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:12.534323 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6cef4b84-fc5d-4d36-86ed-27d5c3bd230d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:12.535977 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6cef4b84-fc5d-4d36-86ed-27d5c3bd230d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:12.537244 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6cef4b84-fc5d-4d36-86ed-27d5c3bd230d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.256703 Jul 23 21:25:12.539101 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1361/2766] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:25:12 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:25:12.580341 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-491350a2-8a5d-43ac-8273-654d5fa19e32 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-534759681", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "451", "networks": [{"uuid": "4b9e65e8-f055-48cd-b4dd-6600f7078a23"}]}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:25:12.686633 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-491350a2-8a5d-43ac-8273-654d5fa19e32 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] validate_networks() for [('4b9e65e8-f055-48cd-b4dd-6600f7078a23', None, None, None, None, None)] {{(pid=131320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:25:13.462660 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-90749e6c-4adb-44e8-bb55-e27e9e061f86 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961e46ab94f4fffbc606485935ce64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8305585b60d54beeb2b087a37260a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:13.481841 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-90749e6c-4adb-44e8-bb55-e27e9e061f86 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] 10.222.0.17 "GET /compute/v2.1/servers/d73bae1c-be56-4a5e-8e8d-56683aae946a" status: 200 len: 1522 microversion: 2.1 time: 1.646099 Jul 23 21:25:13.488702 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1406/2767] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:11 2022] GET /compute/v2.1/servers/d73bae1c-be56-4a5e-8e8d-56683aae946a => generated 1522 bytes in 1654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:13.510391 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-2c1a9799-26fa-414a-8a37-fd9bec6fc8b6 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:13.511444 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-2c1a9799-26fa-414a-8a37-fd9bec6fc8b6 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] [instance: 7da7a2f3-d7d5-4413-9967-4be43db261fa] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:13.721408 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-2c1a9799-26fa-414a-8a37-fd9bec6fc8b6 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7b95c6fb6743cf9f1942a6328a1ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f8e8d61274d54bd996140a9ab38f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:13.730431 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-2c1a9799-26fa-414a-8a37-fd9bec6fc8b6 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] 10.222.0.17 "GET /compute/v2.1/servers/7da7a2f3-d7d5-4413-9967-4be43db261fa" status: 200 len: 1222 microversion: 2.1 time: 0.240286 Jul 23 21:25:13.733229 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1407/2768] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:13 2022] GET /compute/v2.1/servers/7da7a2f3-d7d5-4413-9967-4be43db261fa => generated 1222 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:13.752375 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-be870118-28d9-482c-9f42-1c4f8bc092e5 req-de32cdcd-45f3-4788-8bb9-f1106000d1d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d73bae1c-be56-4a5e-8e8d-56683aae946a", "name": "network-vif-plugged", "status": "completed", "tag": "897299b4-bb02-495a-98bb-caa17d6ecc8b"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:25:13.773060 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-be870118-28d9-482c-9f42-1c4f8bc092e5 req-de32cdcd-45f3-4788-8bb9-f1106000d1d5 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:13.774208 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-be870118-28d9-482c-9f42-1c4f8bc092e5 req-de32cdcd-45f3-4788-8bb9-f1106000d1d5 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:13.793903 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-be870118-28d9-482c-9f42-1c4f8bc092e5 req-de32cdcd-45f3-4788-8bb9-f1106000d1d5 service nova] Creating event network-vif-plugged:897299b4-bb02-495a-98bb-caa17d6ecc8b for instance d73bae1c-be56-4a5e-8e8d-56683aae946a on nch1-master-1 Jul 23 21:25:13.807497 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-be870118-28d9-482c-9f42-1c4f8bc092e5 req-de32cdcd-45f3-4788-8bb9-f1106000d1d5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069015 Jul 23 21:25:13.810990 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1408/2769] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:25:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:25:13.832860 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e5025d5e-9ff2-4994-8ff7-f40c3abb263c tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:13.834072 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-e5025d5e-9ff2-4994-8ff7-f40c3abb263c tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] [instance: 73362a63-78d8-4890-8588-d112fb85c2bf] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:13.844379 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e5025d5e-9ff2-4994-8ff7-f40c3abb263c tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:13.845855 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e5025d5e-9ff2-4994-8ff7-f40c3abb263c tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:13.847876 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e5025d5e-9ff2-4994-8ff7-f40c3abb263c tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:13.849597 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e5025d5e-9ff2-4994-8ff7-f40c3abb263c tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:13.892024 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-491350a2-8a5d-43ac-8273-654d5fa19e32 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:25:13.892686 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-491350a2-8a5d-43ac-8273-654d5fa19e32 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:25:13.893001 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-491350a2-8a5d-43ac-8273-654d5fa19e32 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:25:13.893425 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-491350a2-8a5d-43ac-8273-654d5fa19e32 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:25:13.894159 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-491350a2-8a5d-43ac-8273-654d5fa19e32 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:25:13.916316 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-491350a2-8a5d-43ac-8273-654d5fa19e32 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:13.918929 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-491350a2-8a5d-43ac-8273-654d5fa19e32 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:13.921928 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-491350a2-8a5d-43ac-8273-654d5fa19e32 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:13.922721 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-491350a2-8a5d-43ac-8273-654d5fa19e32 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:13.965625 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-491350a2-8a5d-43ac-8273-654d5fa19e32 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Getting quotas for project b3efb8824be84323b6ec04b604775bd0. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:25:13.978164 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-491350a2-8a5d-43ac-8273-654d5fa19e32 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Getting quotas for user 859c1493a30d4386b74377ab2b9bc81d and project b3efb8824be84323b6ec04b604775bd0. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:25:14.013023 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-491350a2-8a5d-43ac-8273-654d5fa19e32 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Going to run 1 instances... {{(pid=131320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:25:14.015543 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-491350a2-8a5d-43ac-8273-654d5fa19e32 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] [instance: d9c0391f-e638-415e-b079-ab7b429492c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:25:14.052015 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=9 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:25:14.120479 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-491350a2-8a5d-43ac-8273-654d5fa19e32 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.580014 Jul 23 21:25:14.121187 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1362/2770] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:25:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1581 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 23 21:25:14.140168 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-85116f2f-cea6-4864-84cd-d0db6682013d tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:14.140885 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-85116f2f-cea6-4864-84cd-d0db6682013d tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] [instance: d73bae1c-be56-4a5e-8e8d-56683aae946a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:14.148357 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-85116f2f-cea6-4864-84cd-d0db6682013d tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:14.157490 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-85116f2f-cea6-4864-84cd-d0db6682013d tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:14.158727 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-85116f2f-cea6-4864-84cd-d0db6682013d tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:14.159357 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-85116f2f-cea6-4864-84cd-d0db6682013d tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:14.238405 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-85116f2f-cea6-4864-84cd-d0db6682013d tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] [instance: d73bae1c-be56-4a5e-8e8d-56683aae946a] Going to try to terminate instance {{(pid=131320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:25:14.457839 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-e5025d5e-9ff2-4994-8ff7-f40c3abb263c tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a609c39c14343e1bc1edd4b3cd56dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116def61aba4631be91f67df63ebab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:14.470718 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-85116f2f-cea6-4864-84cd-d0db6682013d tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d73bae1c-be56-4a5e-8e8d-56683aae946a" status: 204 len: 0 microversion: 2.1 time: 0.343127 Jul 23 21:25:14.471440 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1363/2771] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:25:14 2022] DELETE /compute/v2.1/servers/d73bae1c-be56-4a5e-8e8d-56683aae946a => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:25:14.476350 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-e5025d5e-9ff2-4994-8ff7-f40c3abb263c tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] 10.222.0.17 "GET /compute/v2.1/servers/73362a63-78d8-4890-8588-d112fb85c2bf" status: 200 len: 1505 microversion: 2.1 time: 0.659840 Jul 23 21:25:14.477415 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1409/2772] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:13 2022] GET /compute/v2.1/servers/73362a63-78d8-4890-8588-d112fb85c2bf => generated 1505 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:14.487791 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-959194c5-7319-44e6-82c0-2eb2064bfe2d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:14.487791 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-959194c5-7319-44e6-82c0-2eb2064bfe2d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:14.490195 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ad54d19b-fb51-47dd-bcb6-a2fcd8ded77b tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:14.492110 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-ad54d19b-fb51-47dd-bcb6-a2fcd8ded77b tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] [instance: d9c0391f-e638-415e-b079-ab7b429492c3] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:14.501460 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-959194c5-7319-44e6-82c0-2eb2064bfe2d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:14.501955 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-959194c5-7319-44e6-82c0-2eb2064bfe2d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:14.502739 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-959194c5-7319-44e6-82c0-2eb2064bfe2d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:14.503171 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-959194c5-7319-44e6-82c0-2eb2064bfe2d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:14.617107 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-959194c5-7319-44e6-82c0-2eb2064bfe2d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:14.643436 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-959194c5-7319-44e6-82c0-2eb2064bfe2d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:14.647915 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-959194c5-7319-44e6-82c0-2eb2064bfe2d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:14.651839 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-959194c5-7319-44e6-82c0-2eb2064bfe2d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.171554 Jul 23 21:25:14.652561 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1364/2773] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:25:14 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:25:14.662612 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ad54d19b-fb51-47dd-bcb6-a2fcd8ded77b tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859c1493a30d4386b74377ab2b9bc81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3efb8824be84323b6ec04b604775bd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:14.668560 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b20d9369-273e-4f46-b5ce-06df70b8823a tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:14.671256 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b20d9369-273e-4f46-b5ce-06df70b8823a tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] [instance: d73bae1c-be56-4a5e-8e8d-56683aae946a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:14.672259 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-ad54d19b-fb51-47dd-bcb6-a2fcd8ded77b tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] 10.222.0.17 "GET /compute/v2.1/servers/d9c0391f-e638-415e-b079-ab7b429492c3" status: 200 len: 1220 microversion: 2.1 time: 0.191698 Jul 23 21:25:14.687565 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b20d9369-273e-4f46-b5ce-06df70b8823a tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:14.689555 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b20d9369-273e-4f46-b5ce-06df70b8823a tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:14.689942 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1410/2774] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:14 2022] GET /compute/v2.1/servers/d9c0391f-e638-415e-b079-ab7b429492c3 => generated 1220 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:14.693842 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b20d9369-273e-4f46-b5ce-06df70b8823a tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:14.694672 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b20d9369-273e-4f46-b5ce-06df70b8823a tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:14.750049 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-cb319639-3d7a-4470-bc44-91f6c89781d3 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:14.750656 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-cb319639-3d7a-4470-bc44-91f6c89781d3 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] [instance: 7da7a2f3-d7d5-4413-9967-4be43db261fa] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:14.762678 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cb319639-3d7a-4470-bc44-91f6c89781d3 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:14.763240 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cb319639-3d7a-4470-bc44-91f6c89781d3 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:14.764094 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cb319639-3d7a-4470-bc44-91f6c89781d3 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:14.771886 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cb319639-3d7a-4470-bc44-91f6c89781d3 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:15.031900 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-cb319639-3d7a-4470-bc44-91f6c89781d3 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7b95c6fb6743cf9f1942a6328a1ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f8e8d61274d54bd996140a9ab38f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:15.040180 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-cb319639-3d7a-4470-bc44-91f6c89781d3 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] 10.222.0.17 "GET /compute/v2.1/servers/7da7a2f3-d7d5-4413-9967-4be43db261fa" status: 200 len: 1274 microversion: 2.1 time: 0.293914 Jul 23 21:25:15.050753 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1411/2775] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:14 2022] GET /compute/v2.1/servers/7da7a2f3-d7d5-4413-9967-4be43db261fa => generated 1274 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:25:15.497478 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-aa9b1ec8-677c-45c0-8b1b-840f59f572f4 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:15.499871 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-aa9b1ec8-677c-45c0-8b1b-840f59f572f4 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] [instance: 73362a63-78d8-4890-8588-d112fb85c2bf] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:15.511787 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-aa9b1ec8-677c-45c0-8b1b-840f59f572f4 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:15.512550 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-aa9b1ec8-677c-45c0-8b1b-840f59f572f4 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:15.513676 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-aa9b1ec8-677c-45c0-8b1b-840f59f572f4 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:15.514623 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-aa9b1ec8-677c-45c0-8b1b-840f59f572f4 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:15.630951 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b20d9369-273e-4f46-b5ce-06df70b8823a tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961e46ab94f4fffbc606485935ce64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8305585b60d54beeb2b087a37260a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:15.650128 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b20d9369-273e-4f46-b5ce-06df70b8823a tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] 10.222.0.17 "GET /compute/v2.1/servers/d73bae1c-be56-4a5e-8e8d-56683aae946a" status: 200 len: 1528 microversion: 2.1 time: 0.994279 Jul 23 21:25:15.661939 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1365/2776] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:14 2022] GET /compute/v2.1/servers/d73bae1c-be56-4a5e-8e8d-56683aae946a => generated 1528 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:15.671520 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-24db2a84-5c5f-4b95-8957-704c7936de1f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:15.672447 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-24db2a84-5c5f-4b95-8957-704c7936de1f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:15.681289 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-24db2a84-5c5f-4b95-8957-704c7936de1f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:15.682232 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-24db2a84-5c5f-4b95-8957-704c7936de1f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:15.683330 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-24db2a84-5c5f-4b95-8957-704c7936de1f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:15.684002 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-24db2a84-5c5f-4b95-8957-704c7936de1f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:15.829180 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-24db2a84-5c5f-4b95-8957-704c7936de1f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:15.844262 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-24db2a84-5c5f-4b95-8957-704c7936de1f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:15.847220 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-24db2a84-5c5f-4b95-8957-704c7936de1f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:15.851472 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-24db2a84-5c5f-4b95-8957-704c7936de1f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.185118 Jul 23 21:25:15.856314 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1366/2777] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:25:15 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:25:15.865250 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-cda61e51-de97-4da1-a46e-9f0b54ddfc07 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:15.866482 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-cda61e51-de97-4da1-a46e-9f0b54ddfc07 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] [instance: d9c0391f-e638-415e-b079-ab7b429492c3] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:15.873433 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cda61e51-de97-4da1-a46e-9f0b54ddfc07 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:15.874359 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cda61e51-de97-4da1-a46e-9f0b54ddfc07 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:15.875359 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cda61e51-de97-4da1-a46e-9f0b54ddfc07 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:15.875999 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cda61e51-de97-4da1-a46e-9f0b54ddfc07 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:15.970966 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-cda61e51-de97-4da1-a46e-9f0b54ddfc07 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859c1493a30d4386b74377ab2b9bc81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3efb8824be84323b6ec04b604775bd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:15.988829 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-cda61e51-de97-4da1-a46e-9f0b54ddfc07 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] 10.222.0.17 "GET /compute/v2.1/servers/d9c0391f-e638-415e-b079-ab7b429492c3" status: 200 len: 1224 microversion: 2.1 time: 0.130837 Jul 23 21:25:15.989814 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1367/2778] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:15 2022] GET /compute/v2.1/servers/d9c0391f-e638-415e-b079-ab7b429492c3 => generated 1224 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:15.998822 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-eb628bb6-74fc-4b11-b994-b14dc05bcd61 req-fe94cbb2-db9e-475b-9520-7f8f36fd9a95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d73bae1c-be56-4a5e-8e8d-56683aae946a", "name": "network-vif-unplugged", "status": "completed", "tag": "897299b4-bb02-495a-98bb-caa17d6ecc8b"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:25:16.014080 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-eb628bb6-74fc-4b11-b994-b14dc05bcd61 req-fe94cbb2-db9e-475b-9520-7f8f36fd9a95 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:16.014985 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-eb628bb6-74fc-4b11-b994-b14dc05bcd61 req-fe94cbb2-db9e-475b-9520-7f8f36fd9a95 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:16.034008 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-eb628bb6-74fc-4b11-b994-b14dc05bcd61 req-fe94cbb2-db9e-475b-9520-7f8f36fd9a95 service nova] Creating event network-vif-unplugged:897299b4-bb02-495a-98bb-caa17d6ecc8b for instance d73bae1c-be56-4a5e-8e8d-56683aae946a on nch1-master-1 Jul 23 21:25:16.040845 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-eb628bb6-74fc-4b11-b994-b14dc05bcd61 req-fe94cbb2-db9e-475b-9520-7f8f36fd9a95 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048247 Jul 23 21:25:16.041817 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1368/2779] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:25:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:25:16.069535 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-60946e7b-3bc5-4785-9ef7-9386b8a51297 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:16.073990 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-60946e7b-3bc5-4785-9ef7-9386b8a51297 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] [instance: 7da7a2f3-d7d5-4413-9967-4be43db261fa] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:16.082414 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-60946e7b-3bc5-4785-9ef7-9386b8a51297 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:16.083346 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-60946e7b-3bc5-4785-9ef7-9386b8a51297 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:16.084427 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-60946e7b-3bc5-4785-9ef7-9386b8a51297 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:16.085098 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-60946e7b-3bc5-4785-9ef7-9386b8a51297 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:16.187245 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-aa9b1ec8-677c-45c0-8b1b-840f59f572f4 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a609c39c14343e1bc1edd4b3cd56dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116def61aba4631be91f67df63ebab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:16.205141 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-aa9b1ec8-677c-45c0-8b1b-840f59f572f4 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] 10.222.0.17 "GET /compute/v2.1/servers/73362a63-78d8-4890-8588-d112fb85c2bf" status: 200 len: 1505 microversion: 2.1 time: 0.712686 Jul 23 21:25:16.206504 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1412/2780] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:15 2022] GET /compute/v2.1/servers/73362a63-78d8-4890-8588-d112fb85c2bf => generated 1505 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:16.219589 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-60946e7b-3bc5-4785-9ef7-9386b8a51297 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7b95c6fb6743cf9f1942a6328a1ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f8e8d61274d54bd996140a9ab38f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:16.240536 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-60946e7b-3bc5-4785-9ef7-9386b8a51297 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] 10.222.0.17 "GET /compute/v2.1/servers/7da7a2f3-d7d5-4413-9967-4be43db261fa" status: 200 len: 1280 microversion: 2.1 time: 0.176123 Jul 23 21:25:16.242464 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1369/2781] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:16 2022] GET /compute/v2.1/servers/7da7a2f3-d7d5-4413-9967-4be43db261fa => generated 1280 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:25:16.684582 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e47ae4ed-9159-4ff0-a581-e962b2cf7059 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:16.685480 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-e47ae4ed-9159-4ff0-a581-e962b2cf7059 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] [instance: d73bae1c-be56-4a5e-8e8d-56683aae946a] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:16.699866 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e47ae4ed-9159-4ff0-a581-e962b2cf7059 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:16.701156 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e47ae4ed-9159-4ff0-a581-e962b2cf7059 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:16.702680 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e47ae4ed-9159-4ff0-a581-e962b2cf7059 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:16.703369 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e47ae4ed-9159-4ff0-a581-e962b2cf7059 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:16.878290 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f651e493-acd4-4707-8a8c-57733a82b865 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:16.878905 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f651e493-acd4-4707-8a8c-57733a82b865 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:16.891632 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f651e493-acd4-4707-8a8c-57733a82b865 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:16.892081 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f651e493-acd4-4707-8a8c-57733a82b865 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:16.892854 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f651e493-acd4-4707-8a8c-57733a82b865 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:16.893460 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f651e493-acd4-4707-8a8c-57733a82b865 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:17.074172 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f651e493-acd4-4707-8a8c-57733a82b865 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:17.086924 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f651e493-acd4-4707-8a8c-57733a82b865 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:17.089036 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f651e493-acd4-4707-8a8c-57733a82b865 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:17.090558 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f651e493-acd4-4707-8a8c-57733a82b865 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.219442 Jul 23 21:25:17.104888 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1370/2782] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:25:16 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:25:17.112219 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6a8884fb-c7ce-4e2c-bd2d-3f916f856e6f tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:17.113195 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6a8884fb-c7ce-4e2c-bd2d-3f916f856e6f tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] [instance: d9c0391f-e638-415e-b079-ab7b429492c3] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:17.126183 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6a8884fb-c7ce-4e2c-bd2d-3f916f856e6f tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:17.126640 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6a8884fb-c7ce-4e2c-bd2d-3f916f856e6f tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:17.127429 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6a8884fb-c7ce-4e2c-bd2d-3f916f856e6f tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:17.127934 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6a8884fb-c7ce-4e2c-bd2d-3f916f856e6f tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:17.364425 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6a8884fb-c7ce-4e2c-bd2d-3f916f856e6f tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859c1493a30d4386b74377ab2b9bc81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3efb8824be84323b6ec04b604775bd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:17.378761 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6a8884fb-c7ce-4e2c-bd2d-3f916f856e6f tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] 10.222.0.17 "GET /compute/v2.1/servers/d9c0391f-e638-415e-b079-ab7b429492c3" status: 200 len: 1272 microversion: 2.1 time: 0.271620 Jul 23 21:25:17.382569 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1371/2783] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:17 2022] GET /compute/v2.1/servers/d9c0391f-e638-415e-b079-ab7b429492c3 => generated 1272 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:17.394807 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3710b775-57ef-419b-9151-7953f0c6601f tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:17.398186 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-3710b775-57ef-419b-9151-7953f0c6601f tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] [instance: 73362a63-78d8-4890-8588-d112fb85c2bf] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:17.412993 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3710b775-57ef-419b-9151-7953f0c6601f tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:17.414160 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3710b775-57ef-419b-9151-7953f0c6601f tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:17.415405 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3710b775-57ef-419b-9151-7953f0c6601f tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:17.416106 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3710b775-57ef-419b-9151-7953f0c6601f tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:18.094160 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-e47ae4ed-9159-4ff0-a581-e962b2cf7059 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961e46ab94f4fffbc606485935ce64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8305585b60d54beeb2b087a37260a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:18.103926 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-e47ae4ed-9159-4ff0-a581-e962b2cf7059 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] 10.222.0.17 "GET /compute/v2.1/servers/d73bae1c-be56-4a5e-8e8d-56683aae946a" status: 200 len: 1528 microversion: 2.1 time: 1.438777 Jul 23 21:25:18.104909 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1413/2784] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:16 2022] GET /compute/v2.1/servers/d73bae1c-be56-4a5e-8e8d-56683aae946a => generated 1528 bytes in 1441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:25:18.110812 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a1ed40a6-740c-45f2-b162-591dda0ace76 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:18.111903 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-a1ed40a6-740c-45f2-b162-591dda0ace76 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] [instance: 7da7a2f3-d7d5-4413-9967-4be43db261fa] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:18.121032 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a1ed40a6-740c-45f2-b162-591dda0ace76 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:18.121965 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a1ed40a6-740c-45f2-b162-591dda0ace76 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:18.122999 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a1ed40a6-740c-45f2-b162-591dda0ace76 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:18.123441 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a1ed40a6-740c-45f2-b162-591dda0ace76 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:18.255424 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-3710b775-57ef-419b-9151-7953f0c6601f tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a609c39c14343e1bc1edd4b3cd56dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116def61aba4631be91f67df63ebab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:18.270574 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-3710b775-57ef-419b-9151-7953f0c6601f tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] 10.222.0.17 "GET /compute/v2.1/servers/73362a63-78d8-4890-8588-d112fb85c2bf" status: 200 len: 1505 microversion: 2.1 time: 0.885329 Jul 23 21:25:18.271491 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1372/2785] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:17 2022] GET /compute/v2.1/servers/73362a63-78d8-4890-8588-d112fb85c2bf => generated 1505 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:18.276349 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-dc85f2c6-7f71-49ef-96ad-c019acfc16cb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:18.278530 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-dc85f2c6-7f71-49ef-96ad-c019acfc16cb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:18.289800 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dc85f2c6-7f71-49ef-96ad-c019acfc16cb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:18.296785 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dc85f2c6-7f71-49ef-96ad-c019acfc16cb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:18.297808 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dc85f2c6-7f71-49ef-96ad-c019acfc16cb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:18.298548 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dc85f2c6-7f71-49ef-96ad-c019acfc16cb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:18.451145 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-dc85f2c6-7f71-49ef-96ad-c019acfc16cb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:18.484002 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-dc85f2c6-7f71-49ef-96ad-c019acfc16cb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:18.487384 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-dc85f2c6-7f71-49ef-96ad-c019acfc16cb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:18.488634 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-dc85f2c6-7f71-49ef-96ad-c019acfc16cb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.215974 Jul 23 21:25:18.489281 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1373/2786] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:25:18 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:25:18.494520 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0ef635dd-c4a2-4740-b4e1-60b9c34f9a48 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:18.495131 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-0ef635dd-c4a2-4740-b4e1-60b9c34f9a48 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] [instance: d9c0391f-e638-415e-b079-ab7b429492c3] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:18.501940 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0ef635dd-c4a2-4740-b4e1-60b9c34f9a48 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:18.502397 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0ef635dd-c4a2-4740-b4e1-60b9c34f9a48 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:18.503519 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0ef635dd-c4a2-4740-b4e1-60b9c34f9a48 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:18.503966 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0ef635dd-c4a2-4740-b4e1-60b9c34f9a48 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:18.685033 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-0ef635dd-c4a2-4740-b4e1-60b9c34f9a48 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859c1493a30d4386b74377ab2b9bc81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3efb8824be84323b6ec04b604775bd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:18.686756 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-a1ed40a6-740c-45f2-b162-591dda0ace76 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7b95c6fb6743cf9f1942a6328a1ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f8e8d61274d54bd996140a9ab38f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:18.695057 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-0ef635dd-c4a2-4740-b4e1-60b9c34f9a48 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] 10.222.0.17 "GET /compute/v2.1/servers/d9c0391f-e638-415e-b079-ab7b429492c3" status: 200 len: 1278 microversion: 2.1 time: 0.204493 Jul 23 21:25:18.698728 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1374/2787] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:18 2022] GET /compute/v2.1/servers/d9c0391f-e638-415e-b079-ab7b429492c3 => generated 1278 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:18.702584 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-a1ed40a6-740c-45f2-b162-591dda0ace76 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] 10.222.0.17 "GET /compute/v2.1/servers/7da7a2f3-d7d5-4413-9967-4be43db261fa" status: 200 len: 1322 microversion: 2.1 time: 0.594654 Jul 23 21:25:18.703759 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1414/2788] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:18 2022] GET /compute/v2.1/servers/7da7a2f3-d7d5-4413-9967-4be43db261fa => generated 1322 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:18.959202 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-560900dc-dedf-423a-a803-1e36fd01c115 req-b9020875-cd35-4d00-8680-c33c3b8b3935 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d73bae1c-be56-4a5e-8e8d-56683aae946a", "name": "network-vif-deleted", "tag": "897299b4-bb02-495a-98bb-caa17d6ecc8b"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:25:18.982363 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-560900dc-dedf-423a-a803-1e36fd01c115 req-b9020875-cd35-4d00-8680-c33c3b8b3935 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:18.990337 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-560900dc-dedf-423a-a803-1e36fd01c115 req-b9020875-cd35-4d00-8680-c33c3b8b3935 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:19.047430 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-560900dc-dedf-423a-a803-1e36fd01c115 req-b9020875-cd35-4d00-8680-c33c3b8b3935 service nova] Creating event network-vif-deleted:897299b4-bb02-495a-98bb-caa17d6ecc8b for instance d73bae1c-be56-4a5e-8e8d-56683aae946a on nch1-master-1 Jul 23 21:25:19.061106 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-560900dc-dedf-423a-a803-1e36fd01c115 req-b9020875-cd35-4d00-8680-c33c3b8b3935 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107945 Jul 23 21:25:19.065973 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1375/2789] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:25:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:25:19.127283 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-474eaf50-ca66-48ca-b9ef-71f506e093d1 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:19.131083 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-474eaf50-ca66-48ca-b9ef-71f506e093d1 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] [instance: d73bae1c-be56-4a5e-8e8d-56683aae946a] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:19.147158 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-474eaf50-ca66-48ca-b9ef-71f506e093d1 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:19.149053 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-474eaf50-ca66-48ca-b9ef-71f506e093d1 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:19.151888 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-474eaf50-ca66-48ca-b9ef-71f506e093d1 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:19.152678 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-474eaf50-ca66-48ca-b9ef-71f506e093d1 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:19.205291 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-474eaf50-ca66-48ca-b9ef-71f506e093d1 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:19.205757 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-474eaf50-ca66-48ca-b9ef-71f506e093d1 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:19.207599 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.objects.instance [None req-474eaf50-ca66-48ca-b9ef-71f506e093d1 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lazy-loading 'fault' on Instance uuid d73bae1c-be56-4a5e-8e8d-56683aae946a {{(pid=131321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:25:19.288366 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-085f3acd-fd48-4f4e-8d99-9efccfd1dacb tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:19.289616 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-085f3acd-fd48-4f4e-8d99-9efccfd1dacb tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] [instance: 73362a63-78d8-4890-8588-d112fb85c2bf] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:19.296452 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-085f3acd-fd48-4f4e-8d99-9efccfd1dacb tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:19.296911 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-085f3acd-fd48-4f4e-8d99-9efccfd1dacb tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:19.298432 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-085f3acd-fd48-4f4e-8d99-9efccfd1dacb tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:19.298851 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-085f3acd-fd48-4f4e-8d99-9efccfd1dacb tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:19.562233 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-474eaf50-ca66-48ca-b9ef-71f506e093d1 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961e46ab94f4fffbc606485935ce64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8305585b60d54beeb2b087a37260a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:19.573684 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-474eaf50-ca66-48ca-b9ef-71f506e093d1 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] 10.222.0.17 "GET /compute/v2.1/servers/d73bae1c-be56-4a5e-8e8d-56683aae946a" status: 200 len: 1315 microversion: 2.1 time: 0.453334 Jul 23 21:25:19.576068 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1415/2790] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:19 2022] GET /compute/v2.1/servers/d73bae1c-be56-4a5e-8e8d-56683aae946a => generated 1315 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:19.589049 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-928321ed-7e84-495a-a5e1-4f86beca5873 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:19.589738 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-928321ed-7e84-495a-a5e1-4f86beca5873 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:19.596663 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-928321ed-7e84-495a-a5e1-4f86beca5873 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:19.598803 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-928321ed-7e84-495a-a5e1-4f86beca5873 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:19.599819 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-928321ed-7e84-495a-a5e1-4f86beca5873 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:19.600417 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-928321ed-7e84-495a-a5e1-4f86beca5873 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:19.626164 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:25:19.661672 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-085f3acd-fd48-4f4e-8d99-9efccfd1dacb tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a609c39c14343e1bc1edd4b3cd56dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116def61aba4631be91f67df63ebab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:19.664586 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:25:19.674940 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-085f3acd-fd48-4f4e-8d99-9efccfd1dacb tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] 10.222.0.17 "GET /compute/v2.1/servers/73362a63-78d8-4890-8588-d112fb85c2bf" status: 200 len: 1505 microversion: 2.1 time: 0.390914 Jul 23 21:25:19.675992 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1376/2791] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:19 2022] GET /compute/v2.1/servers/73362a63-78d8-4890-8588-d112fb85c2bf => generated 1505 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:19.716027 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ff41ca21-5b3c-4f9d-a6c0-d21f56a45859 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:19.716851 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ff41ca21-5b3c-4f9d-a6c0-d21f56a45859 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] [instance: d9c0391f-e638-415e-b079-ab7b429492c3] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:19.725304 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ff41ca21-5b3c-4f9d-a6c0-d21f56a45859 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:19.726121 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ff41ca21-5b3c-4f9d-a6c0-d21f56a45859 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:19.726977 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ff41ca21-5b3c-4f9d-a6c0-d21f56a45859 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:19.727825 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ff41ca21-5b3c-4f9d-a6c0-d21f56a45859 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:19.811789 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-928321ed-7e84-495a-a5e1-4f86beca5873 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:19.841358 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ff41ca21-5b3c-4f9d-a6c0-d21f56a45859 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859c1493a30d4386b74377ab2b9bc81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3efb8824be84323b6ec04b604775bd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:19.851666 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-928321ed-7e84-495a-a5e1-4f86beca5873 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:19.853260 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-928321ed-7e84-495a-a5e1-4f86beca5873 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:19.854540 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-928321ed-7e84-495a-a5e1-4f86beca5873 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.276556 Jul 23 21:25:19.859283 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ff41ca21-5b3c-4f9d-a6c0-d21f56a45859 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] 10.222.0.17 "GET /compute/v2.1/servers/d9c0391f-e638-415e-b079-ab7b429492c3" status: 200 len: 1278 microversion: 2.1 time: 0.148015 Jul 23 21:25:19.859890 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1377/2792] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:19 2022] GET /compute/v2.1/servers/d9c0391f-e638-415e-b079-ab7b429492c3 => generated 1278 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:19.861917 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1416/2793] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:25:19 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:25:19.866177 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-657b14de-fd2d-4d83-bcda-46b6c6cffe38 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:19.866971 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-657b14de-fd2d-4d83-bcda-46b6c6cffe38 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] [instance: 7da7a2f3-d7d5-4413-9967-4be43db261fa] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:19.874897 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-657b14de-fd2d-4d83-bcda-46b6c6cffe38 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:19.875626 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-657b14de-fd2d-4d83-bcda-46b6c6cffe38 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:19.876707 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-657b14de-fd2d-4d83-bcda-46b6c6cffe38 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:19.877385 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-657b14de-fd2d-4d83-bcda-46b6c6cffe38 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:20.221706 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-9c4ba88a-eed8-4de8-8e7d-5a8fa8c10652 req-477b8879-0711-4d99-96bc-b3cf32baf313 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35d0d067-4f24-45a4-b03c-32346b764d3c", "tag": "9a5bd934-baf8-40bb-b356-bd97f6909cf5"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:25:20.246433 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-9c4ba88a-eed8-4de8-8e7d-5a8fa8c10652 req-477b8879-0711-4d99-96bc-b3cf32baf313 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:20.256031 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-9c4ba88a-eed8-4de8-8e7d-5a8fa8c10652 req-477b8879-0711-4d99-96bc-b3cf32baf313 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:20.279371 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-9c4ba88a-eed8-4de8-8e7d-5a8fa8c10652 req-477b8879-0711-4d99-96bc-b3cf32baf313 service nova] Creating event network-changed:9a5bd934-baf8-40bb-b356-bd97f6909cf5 for instance 35d0d067-4f24-45a4-b03c-32346b764d3c on nch2-master-1 Jul 23 21:25:20.286788 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-9c4ba88a-eed8-4de8-8e7d-5a8fa8c10652 req-477b8879-0711-4d99-96bc-b3cf32baf313 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068557 Jul 23 21:25:20.289354 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1417/2794] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:25:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:25:20.377417 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-657b14de-fd2d-4d83-bcda-46b6c6cffe38 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7b95c6fb6743cf9f1942a6328a1ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f8e8d61274d54bd996140a9ab38f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:20.400572 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-657b14de-fd2d-4d83-bcda-46b6c6cffe38 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] 10.222.0.17 "GET /compute/v2.1/servers/7da7a2f3-d7d5-4413-9967-4be43db261fa" status: 200 len: 1322 microversion: 2.1 time: 0.538260 Jul 23 21:25:20.410625 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1378/2795] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:19 2022] GET /compute/v2.1/servers/7da7a2f3-d7d5-4413-9967-4be43db261fa => generated 1322 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:20.594571 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-90a11d7e-e201-4d06-9660-6979078750cd tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:20.595281 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-90a11d7e-e201-4d06-9660-6979078750cd tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] [instance: d73bae1c-be56-4a5e-8e8d-56683aae946a] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:20.612573 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-90a11d7e-e201-4d06-9660-6979078750cd tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:20.613021 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-90a11d7e-e201-4d06-9660-6979078750cd tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:20.613815 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-90a11d7e-e201-4d06-9660-6979078750cd tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:20.614277 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-90a11d7e-e201-4d06-9660-6979078750cd tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:20.641746 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-90a11d7e-e201-4d06-9660-6979078750cd tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] HTTP exception thrown: Instance d73bae1c-be56-4a5e-8e8d-56683aae946a could not be found. Jul 23 21:25:20.649484 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-90a11d7e-e201-4d06-9660-6979078750cd tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Request method failure captured: Jul 23 21:25:20.649484 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/servers/d73bae1c-be56-4a5e-8e8d-56683aae946a HTTP/1.1 Jul 23 21:25:20.649484 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:25:20.649484 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:25:20.649484 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:25:20.649484 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:25:20.649484 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:25:20.649484 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:25:20.649484 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:25:20.649484 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:25:20.649484 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GcdFkVYIK2DtJm403sM7IG79jHXbShtkQheCHNeqOWOy-LrSxvgAeYLVbMoRM5VFKN6qfODnVk_B5qM-rDymLVGR4aR0RY1RwNvXXeBnLkJldpttrzdMpyZMOqZL8mI9RN_pqnVy4UDfpP9Qj4sUGOBflgakohNp1Y8WLMI7QhzBds Jul 23 21:25:20.649484 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:25:20.649484 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:25:20.649484 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:25:20.649484 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:25:20.649484 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:25:20.649484 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:25:20.649484 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 8305585b60d54beeb2b087a37260a89a Jul 23 21:25:20.649484 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1030577641 Jul 23 21:25:20.649484 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:25:20.649484 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:25:20.649484 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8305585b60d54beeb2b087a37260a89a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8305585b60d54beeb2b087a37260a89a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8305585b60d54beeb2b087a37260a89a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8305585b60d54beeb2b087a37260a89a"}]}] Jul 23 21:25:20.649484 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1030577641 Jul 23 21:25:20.649484 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 8305585b60d54beeb2b087a37260a89a Jul 23 21:25:20.649484 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1030577641 Jul 23 21:25:20.649484 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ImagesOneServerNegativeTestJSON-1030577641-project Jul 23 21:25:20.649484 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:25:20.649484 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:25:20.649484 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: e961e46ab94f4fffbc606485935ce64d Jul 23 21:25:20.649484 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1030577641-project Jul 23 21:25:20.649484 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:25:20.649484 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance d73bae1c-be56-4a5e-8e8d-56683aae946a could not be found. Jul 23 21:25:20.649484 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': 'd73bae1c-be56-4a5e-8e8d-56683aae946a'} Jul 23 21:25:20.649484 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:25:20.649484 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:25:20.649484 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:25:20.649484 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:25:20.649484 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:25:20.649484 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:25:20.649484 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:25:20.649484 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:25:20.649484 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:25:20.649484 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:25:20.649484 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d73bae1c-be56-4a5e-8e8d-56683aae946a could not be found. Jul 23 21:25:20.649484 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:25:20.649484 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:25:20.649484 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:25:20.649484 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:25:20.649484 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:25:20.649484 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:25:20.649484 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:25:20.649484 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:25:20.649484 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:25:20.649484 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:25:20.649484 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:25:20.649484 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:25:20.649484 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:25:20.649484 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:25:20.649484 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:25:20.649484 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:25:20.649484 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d73bae1c-be56-4a5e-8e8d-56683aae946a could not be found. Jul 23 21:25:20.649484 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:25:20.649484 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:25:20.655672 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:25:20.655672 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:25:20.655672 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:25:20.655672 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:25:20.655672 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:25:20.655672 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:25:20.655672 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d73bae1c-be56-4a5e-8e8d-56683aae946a could not be found. Jul 23 21:25:20.655672 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:25:20.655672 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-90a11d7e-e201-4d06-9660-6979078750cd tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Returning 404 to user: Instance d73bae1c-be56-4a5e-8e8d-56683aae946a could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:25:20.655672 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-90a11d7e-e201-4d06-9660-6979078750cd tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] 10.222.0.17 "GET /compute/v2.1/servers/d73bae1c-be56-4a5e-8e8d-56683aae946a" status: 404 len: 111 microversion: 2.1 time: 0.062396 Jul 23 21:25:20.655672 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1418/2796] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:20 2022] GET /compute/v2.1/servers/d73bae1c-be56-4a5e-8e8d-56683aae946a => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:25:20.668707 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c493f9e2-e04e-4dd8-922b-a165b3e55373 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Action: 'create', calling method: .version_select at 0x7f0b47f21280>, body: {"keypair": {"name": "tempest-keypair-949857379", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCZJtAacEok/KlUEfMNbhbRsEfpwn79rkj1kMWv4j/yM3uDCz2kp7LO4eOWEpWdUQVyS3YjRMKASEie5pKA0a0GxXjoW6O5Sts27JkDMNOhndgXO9fmVGrAIFg6V3gejkQ=="}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:25:20.695495 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-b7679a50-8842-4a0d-86a0-f7a957185f27 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:20.696123 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-b7679a50-8842-4a0d-86a0-f7a957185f27 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] [instance: 73362a63-78d8-4890-8588-d112fb85c2bf] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:20.706176 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-c493f9e2-e04e-4dd8-922b-a165b3e55373 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Getting quotas for project 8305585b60d54beeb2b087a37260a89a. Resources: {'key_pairs'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:25:20.707939 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b7679a50-8842-4a0d-86a0-f7a957185f27 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:20.708627 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b7679a50-8842-4a0d-86a0-f7a957185f27 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:20.710603 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b7679a50-8842-4a0d-86a0-f7a957185f27 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:20.711856 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b7679a50-8842-4a0d-86a0-f7a957185f27 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:20.714622 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-c493f9e2-e04e-4dd8-922b-a165b3e55373 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Getting quotas for user e961e46ab94f4fffbc606485935ce64d and project 8305585b60d54beeb2b087a37260a89a. Resources: {'key_pairs'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:25:20.762979 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c493f9e2-e04e-4dd8-922b-a165b3e55373 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.102780 Jul 23 21:25:20.764458 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1379/2797] 10.222.0.17 () {60 vars in 1158 bytes} [Sat Jul 23 21:25:20 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:25:20.881684 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c8c5c04e-fe86-4e6b-81f4-d6a07d78375f tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:20.886172 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c8c5c04e-fe86-4e6b-81f4-d6a07d78375f tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] [instance: d9c0391f-e638-415e-b079-ab7b429492c3] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:20.895316 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c8c5c04e-fe86-4e6b-81f4-d6a07d78375f tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:20.896306 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c8c5c04e-fe86-4e6b-81f4-d6a07d78375f tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:20.899886 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c8c5c04e-fe86-4e6b-81f4-d6a07d78375f tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:20.914202 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c8c5c04e-fe86-4e6b-81f4-d6a07d78375f tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:21.449785 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-b7679a50-8842-4a0d-86a0-f7a957185f27 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a609c39c14343e1bc1edd4b3cd56dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116def61aba4631be91f67df63ebab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:21.459139 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-b7679a50-8842-4a0d-86a0-f7a957185f27 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] 10.222.0.17 "GET /compute/v2.1/servers/73362a63-78d8-4890-8588-d112fb85c2bf" status: 200 len: 1505 microversion: 2.1 time: 0.769757 Jul 23 21:25:21.469757 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1419/2798] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:20 2022] GET /compute/v2.1/servers/73362a63-78d8-4890-8588-d112fb85c2bf => generated 1505 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:21.476253 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d8882265-a4e0-416b-9686-ebf3f50b4d82 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:21.477221 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-d8882265-a4e0-416b-9686-ebf3f50b4d82 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:21.482129 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell0:SELECT=4 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:25:21.486961 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d8882265-a4e0-416b-9686-ebf3f50b4d82 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:21.487634 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d8882265-a4e0-416b-9686-ebf3f50b4d82 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:21.488718 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d8882265-a4e0-416b-9686-ebf3f50b4d82 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:21.489305 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d8882265-a4e0-416b-9686-ebf3f50b4d82 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:21.702044 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c8c5c04e-fe86-4e6b-81f4-d6a07d78375f tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859c1493a30d4386b74377ab2b9bc81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3efb8824be84323b6ec04b604775bd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:21.722763 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c8c5c04e-fe86-4e6b-81f4-d6a07d78375f tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] 10.222.0.17 "GET /compute/v2.1/servers/d9c0391f-e638-415e-b079-ab7b429492c3" status: 200 len: 1320 microversion: 2.1 time: 0.849199 Jul 23 21:25:21.724023 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1380/2799] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:20 2022] GET /compute/v2.1/servers/d9c0391f-e638-415e-b079-ab7b429492c3 => generated 1320 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:21.729696 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-39b6fae4-34cf-4936-8140-b515b26d051f req-0caacfd5-75b6-4f94-ad96-ef7487115ec3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcb1aa47-1abb-4c2f-9686-7268d2b86967", "tag": "fd27373f-0bdd-45aa-abd0-2caec10e18cf"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:25:21.743716 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-39b6fae4-34cf-4936-8140-b515b26d051f req-0caacfd5-75b6-4f94-ad96-ef7487115ec3 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:21.744501 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-39b6fae4-34cf-4936-8140-b515b26d051f req-0caacfd5-75b6-4f94-ad96-ef7487115ec3 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:21.764867 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-39b6fae4-34cf-4936-8140-b515b26d051f req-0caacfd5-75b6-4f94-ad96-ef7487115ec3 service nova] Creating event network-changed:fd27373f-0bdd-45aa-abd0-2caec10e18cf for instance dcb1aa47-1abb-4c2f-9686-7268d2b86967 on nch2-master-1 Jul 23 21:25:21.777249 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-39b6fae4-34cf-4936-8140-b515b26d051f req-0caacfd5-75b6-4f94-ad96-ef7487115ec3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051392 Jul 23 21:25:21.778439 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1381/2800] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:25:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:25:21.785373 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d0978943-bd1f-41fc-b4ba-ad6b94835197 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:21.786116 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d0978943-bd1f-41fc-b4ba-ad6b94835197 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] [instance: 7da7a2f3-d7d5-4413-9967-4be43db261fa] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:21.792985 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d0978943-bd1f-41fc-b4ba-ad6b94835197 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:21.794849 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d0978943-bd1f-41fc-b4ba-ad6b94835197 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:21.795873 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d0978943-bd1f-41fc-b4ba-ad6b94835197 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:21.796527 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d0978943-bd1f-41fc-b4ba-ad6b94835197 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:21.799149 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-d8882265-a4e0-416b-9686-ebf3f50b4d82 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:21.817073 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-d8882265-a4e0-416b-9686-ebf3f50b4d82 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:21.818550 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-d8882265-a4e0-416b-9686-ebf3f50b4d82 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:21.826473 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-d8882265-a4e0-416b-9686-ebf3f50b4d82 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.347799 Jul 23 21:25:21.827989 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1420/2801] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:25:21 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:25:21.842046 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-dc266483-7c3c-4811-8c27-eb2ec2868af9 tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:21.846536 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-dc266483-7c3c-4811-8c27-eb2ec2868af9 tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7cd8823a2d134f4ea1e31f92e65df040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a136ff692aeb4fdeae12dcacd09b3d6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:21.847537 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-dc266483-7c3c-4811-8c27-eb2ec2868af9 tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Searching by: {'deleted': False, 'project_id': 'a136ff692aeb4fdeae12dcacd09b3d6f'} {{(pid=131321) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 23 21:25:21.857345 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-dc266483-7c3c-4811-8c27-eb2ec2868af9 tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:21.862509 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-dc266483-7c3c-4811-8c27-eb2ec2868af9 tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:21.863941 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-dc266483-7c3c-4811-8c27-eb2ec2868af9 tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:21.864445 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-dc266483-7c3c-4811-8c27-eb2ec2868af9 tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:21.924292 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.multi_cell_list [None req-dc266483-7c3c-4811-8c27-eb2ec2868af9 tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131321) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 23 21:25:21.963155 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-dc266483-7c3c-4811-8c27-eb2ec2868af9 tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] 10.222.0.17 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.133728 Jul 23 21:25:21.964551 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1421/2802] 10.222.0.17 () {58 vars in 1124 bytes} [Sat Jul 23 21:25:21 2022] GET /compute/v2.1/servers => generated 334 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:25:21.981291 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-48355776-6e8f-4ccc-a4ec-6547abd90a8d tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:21.986083 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-48355776-6e8f-4ccc-a4ec-6547abd90a8d tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7cd8823a2d134f4ea1e31f92e65df040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a136ff692aeb4fdeae12dcacd09b3d6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:21.987152 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-48355776-6e8f-4ccc-a4ec-6547abd90a8d tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Searching by: {'deleted': False, 'project_id': 'a136ff692aeb4fdeae12dcacd09b3d6f'} {{(pid=131321) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 23 21:25:21.993254 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-48355776-6e8f-4ccc-a4ec-6547abd90a8d tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:21.994135 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-48355776-6e8f-4ccc-a4ec-6547abd90a8d tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:21.995148 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-48355776-6e8f-4ccc-a4ec-6547abd90a8d tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:21.995784 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-48355776-6e8f-4ccc-a4ec-6547abd90a8d tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:22.023851 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.multi_cell_list [None req-48355776-6e8f-4ccc-a4ec-6547abd90a8d tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131321) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 23 21:25:22.085455 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-48355776-6e8f-4ccc-a4ec-6547abd90a8d tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cd8823a2d134f4ea1e31f92e65df040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a136ff692aeb4fdeae12dcacd09b3d6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:22.101295 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-48355776-6e8f-4ccc-a4ec-6547abd90a8d tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:22.106216 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-48355776-6e8f-4ccc-a4ec-6547abd90a8d tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:22.179100 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d0978943-bd1f-41fc-b4ba-ad6b94835197 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7b95c6fb6743cf9f1942a6328a1ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f8e8d61274d54bd996140a9ab38f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:22.188501 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d0978943-bd1f-41fc-b4ba-ad6b94835197 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] 10.222.0.17 "GET /compute/v2.1/servers/7da7a2f3-d7d5-4413-9967-4be43db261fa" status: 200 len: 1322 microversion: 2.1 time: 0.407851 Jul 23 21:25:22.200114 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1382/2803] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:21 2022] GET /compute/v2.1/servers/7da7a2f3-d7d5-4413-9967-4be43db261fa => generated 1322 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:22.492321 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2c3044e8-c4d8-4d08-83ee-faddfb736590 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:22.493311 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-2c3044e8-c4d8-4d08-83ee-faddfb736590 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] [instance: 73362a63-78d8-4890-8588-d112fb85c2bf] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:22.506232 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2c3044e8-c4d8-4d08-83ee-faddfb736590 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:22.506710 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2c3044e8-c4d8-4d08-83ee-faddfb736590 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:22.507497 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2c3044e8-c4d8-4d08-83ee-faddfb736590 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:22.508022 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2c3044e8-c4d8-4d08-83ee-faddfb736590 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:22.856510 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-2c3044e8-c4d8-4d08-83ee-faddfb736590 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a609c39c14343e1bc1edd4b3cd56dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116def61aba4631be91f67df63ebab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:22.869291 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2c3044e8-c4d8-4d08-83ee-faddfb736590 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] 10.222.0.17 "GET /compute/v2.1/servers/73362a63-78d8-4890-8588-d112fb85c2bf" status: 200 len: 1505 microversion: 2.1 time: 0.394963 Jul 23 21:25:22.869914 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1383/2804] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:22 2022] GET /compute/v2.1/servers/73362a63-78d8-4890-8588-d112fb85c2bf => generated 1505 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:22.883819 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f15c805e-4cda-41d3-abb7-210da62549d4 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:22.886770 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f15c805e-4cda-41d3-abb7-210da62549d4 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] [instance: d9c0391f-e638-415e-b079-ab7b429492c3] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:22.895592 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f15c805e-4cda-41d3-abb7-210da62549d4 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:22.899638 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f15c805e-4cda-41d3-abb7-210da62549d4 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:22.901501 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f15c805e-4cda-41d3-abb7-210da62549d4 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:22.902305 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f15c805e-4cda-41d3-abb7-210da62549d4 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:23.148272 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-48355776-6e8f-4ccc-a4ec-6547abd90a8d tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] 10.222.0.17 "GET /compute/v2.1/servers/detail" status: 200 len: 1696 microversion: 2.1 time: 1.173709 Jul 23 21:25:23.148968 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1422/2805] 10.222.0.17 () {58 vars in 1145 bytes} [Sat Jul 23 21:25:21 2022] GET /compute/v2.1/servers/detail => generated 1696 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:23.159919 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-30d4c3ed-699f-449b-b7ee-cc25f0f4ac75 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:23.169432 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-30d4c3ed-699f-449b-b7ee-cc25f0f4ac75 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:23.176058 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-30d4c3ed-699f-449b-b7ee-cc25f0f4ac75 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:23.177757 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-30d4c3ed-699f-449b-b7ee-cc25f0f4ac75 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:23.178753 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-30d4c3ed-699f-449b-b7ee-cc25f0f4ac75 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:23.179353 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-30d4c3ed-699f-449b-b7ee-cc25f0f4ac75 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:23.468614 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f15c805e-4cda-41d3-abb7-210da62549d4 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859c1493a30d4386b74377ab2b9bc81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3efb8824be84323b6ec04b604775bd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:23.495214 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f15c805e-4cda-41d3-abb7-210da62549d4 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] 10.222.0.17 "GET /compute/v2.1/servers/d9c0391f-e638-415e-b079-ab7b429492c3" status: 200 len: 1320 microversion: 2.1 time: 0.620319 Jul 23 21:25:23.496522 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1384/2806] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:22 2022] GET /compute/v2.1/servers/d9c0391f-e638-415e-b079-ab7b429492c3 => generated 1320 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:23.517644 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3dd5551a-dbc4-45ab-9447-83149e6796b5 tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:23.531378 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-3dd5551a-dbc4-45ab-9447-83149e6796b5 tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] 10.222.0.17 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.032600 Jul 23 21:25:23.533792 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1385/2807] 10.222.0.17 () {58 vars in 1136 bytes} [Sat Jul 23 21:25:23 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:25:23.539618 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-69d90245-d525-4a42-b76b-622860c5a6b7 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:23.542698 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-69d90245-d525-4a42-b76b-622860c5a6b7 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] [instance: 7da7a2f3-d7d5-4413-9967-4be43db261fa] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:23.572938 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-69d90245-d525-4a42-b76b-622860c5a6b7 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:23.574987 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-69d90245-d525-4a42-b76b-622860c5a6b7 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:23.575982 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-69d90245-d525-4a42-b76b-622860c5a6b7 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:23.584449 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-69d90245-d525-4a42-b76b-622860c5a6b7 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:23.663957 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-30d4c3ed-699f-449b-b7ee-cc25f0f4ac75 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:23.675682 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-30d4c3ed-699f-449b-b7ee-cc25f0f4ac75 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:23.678173 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-30d4c3ed-699f-449b-b7ee-cc25f0f4ac75 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:23.679763 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-30d4c3ed-699f-449b-b7ee-cc25f0f4ac75 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.523607 Jul 23 21:25:23.680927 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1423/2808] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:25:23 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:25:23.853658 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-8db542b9-f9c8-48ae-9fb7-f701cfeef9bb tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:23.854674 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-8db542b9-f9c8-48ae-9fb7-f701cfeef9bb tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] [instance: c9e47e97-31f2-41d6-a49b-66efaa974c65] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:23.862414 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8db542b9-f9c8-48ae-9fb7-f701cfeef9bb tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:23.863164 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8db542b9-f9c8-48ae-9fb7-f701cfeef9bb tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:23.864274 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8db542b9-f9c8-48ae-9fb7-f701cfeef9bb tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:23.864964 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8db542b9-f9c8-48ae-9fb7-f701cfeef9bb tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:23.908906 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-8db542b9-f9c8-48ae-9fb7-f701cfeef9bb tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] [instance: c9e47e97-31f2-41d6-a49b-66efaa974c65] Going to try to terminate instance {{(pid=131321) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:25:23.944396 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=6 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:25:24.103833 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-8db542b9-f9c8-48ae-9fb7-f701cfeef9bb tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] 10.222.0.17 "DELETE /compute/v2.1/servers/c9e47e97-31f2-41d6-a49b-66efaa974c65" status: 204 len: 0 microversion: 2.1 time: 0.254629 Jul 23 21:25:24.104449 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1424/2809] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:25:23 2022] DELETE /compute/v2.1/servers/c9e47e97-31f2-41d6-a49b-66efaa974c65 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 23 21:25:24.111452 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-f36353bf-2e87-4ce6-9758-8fb3fc07dc5b req-ef6ad426-cbcf-47f9-9ea1-66c6434ad770 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acfc85ad-35a7-4cfd-935d-89707e3bc08c", "tag": "ec455c66-6e36-401f-999f-8bf7a293217a"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:25:24.123230 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-f36353bf-2e87-4ce6-9758-8fb3fc07dc5b req-ef6ad426-cbcf-47f9-9ea1-66c6434ad770 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:24.123972 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-f36353bf-2e87-4ce6-9758-8fb3fc07dc5b req-ef6ad426-cbcf-47f9-9ea1-66c6434ad770 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:24.139421 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-f36353bf-2e87-4ce6-9758-8fb3fc07dc5b req-ef6ad426-cbcf-47f9-9ea1-66c6434ad770 service nova] Creating event network-changed:ec455c66-6e36-401f-999f-8bf7a293217a for instance acfc85ad-35a7-4cfd-935d-89707e3bc08c on nch2-master-1 Jul 23 21:25:24.146936 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-f36353bf-2e87-4ce6-9758-8fb3fc07dc5b req-ef6ad426-cbcf-47f9-9ea1-66c6434ad770 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039763 Jul 23 21:25:24.148105 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1425/2810] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:25:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:25:24.153994 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-6c9cc70a-4325-48fa-9ccc-7557bc7334e8 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:24.155647 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-6c9cc70a-4325-48fa-9ccc-7557bc7334e8 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] [instance: 73362a63-78d8-4890-8588-d112fb85c2bf] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:24.164546 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6c9cc70a-4325-48fa-9ccc-7557bc7334e8 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:24.165021 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6c9cc70a-4325-48fa-9ccc-7557bc7334e8 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:24.165876 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6c9cc70a-4325-48fa-9ccc-7557bc7334e8 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:24.166618 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6c9cc70a-4325-48fa-9ccc-7557bc7334e8 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:24.270348 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-69d90245-d525-4a42-b76b-622860c5a6b7 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7b95c6fb6743cf9f1942a6328a1ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f8e8d61274d54bd996140a9ab38f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:24.278246 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-69d90245-d525-4a42-b76b-622860c5a6b7 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] 10.222.0.17 "GET /compute/v2.1/servers/7da7a2f3-d7d5-4413-9967-4be43db261fa" status: 200 len: 1322 microversion: 2.1 time: 0.743046 Jul 23 21:25:24.278861 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1386/2811] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:23 2022] GET /compute/v2.1/servers/7da7a2f3-d7d5-4413-9967-4be43db261fa => generated 1322 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:24.283465 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-035520a1-3deb-46a7-8f5d-cd3ba4c2ddd6 req-4eea3d18-6cc9-43ab-955d-f989c5f07114 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7da7a2f3-d7d5-4413-9967-4be43db261fa", "tag": "ee408eac-db3f-4902-ae57-cfe1b8d701d2"}, {"name": "network-changed", "server_uuid": "d9c0391f-e638-415e-b079-ab7b429492c3", "tag": "df30b70a-0a8a-4c92-85ee-b5adf5aee6f3"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:25:24.293725 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-035520a1-3deb-46a7-8f5d-cd3ba4c2ddd6 req-4eea3d18-6cc9-43ab-955d-f989c5f07114 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:24.294485 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-035520a1-3deb-46a7-8f5d-cd3ba4c2ddd6 req-4eea3d18-6cc9-43ab-955d-f989c5f07114 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:24.307777 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-035520a1-3deb-46a7-8f5d-cd3ba4c2ddd6 req-4eea3d18-6cc9-43ab-955d-f989c5f07114 service nova] Creating event network-changed:ee408eac-db3f-4902-ae57-cfe1b8d701d2 for instance 7da7a2f3-d7d5-4413-9967-4be43db261fa on nch2-master-1 Jul 23 21:25:24.308991 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-035520a1-3deb-46a7-8f5d-cd3ba4c2ddd6 req-4eea3d18-6cc9-43ab-955d-f989c5f07114 service nova] Creating event network-changed:df30b70a-0a8a-4c92-85ee-b5adf5aee6f3 for instance d9c0391f-e638-415e-b079-ab7b429492c3 on nch1-master-1 Jul 23 21:25:24.318317 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-035520a1-3deb-46a7-8f5d-cd3ba4c2ddd6 req-4eea3d18-6cc9-43ab-955d-f989c5f07114 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.037984 Jul 23 21:25:24.319536 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1387/2812] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:25:24 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:25:24.325811 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0c2fbb16-6962-417b-a947-0ac148142b98 tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:24.327796 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-0c2fbb16-6962-417b-a947-0ac148142b98 tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] [instance: c9e47e97-31f2-41d6-a49b-66efaa974c65] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:24.334268 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0c2fbb16-6962-417b-a947-0ac148142b98 tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:24.334826 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0c2fbb16-6962-417b-a947-0ac148142b98 tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:24.336209 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0c2fbb16-6962-417b-a947-0ac148142b98 tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:24.336848 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0c2fbb16-6962-417b-a947-0ac148142b98 tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:24.527054 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-0c2fbb16-6962-417b-a947-0ac148142b98 tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cd8823a2d134f4ea1e31f92e65df040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a136ff692aeb4fdeae12dcacd09b3d6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:24.540558 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-0c2fbb16-6962-417b-a947-0ac148142b98 tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] 10.222.0.17 "GET /compute/v2.1/servers/c9e47e97-31f2-41d6-a49b-66efaa974c65" status: 200 len: 1699 microversion: 2.1 time: 0.219354 Jul 23 21:25:24.541910 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1388/2813] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:24 2022] GET /compute/v2.1/servers/c9e47e97-31f2-41d6-a49b-66efaa974c65 => generated 1699 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:24.546797 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-be214935-0ae5-4716-8734-22e9d3affd6d tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:24.548242 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-be214935-0ae5-4716-8734-22e9d3affd6d tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] [instance: d9c0391f-e638-415e-b079-ab7b429492c3] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:24.567335 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-be214935-0ae5-4716-8734-22e9d3affd6d tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:24.568799 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-be214935-0ae5-4716-8734-22e9d3affd6d tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:24.569836 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-be214935-0ae5-4716-8734-22e9d3affd6d tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:24.570574 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-be214935-0ae5-4716-8734-22e9d3affd6d tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:24.677541 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-6c9cc70a-4325-48fa-9ccc-7557bc7334e8 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a609c39c14343e1bc1edd4b3cd56dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116def61aba4631be91f67df63ebab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:24.694349 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-6c9cc70a-4325-48fa-9ccc-7557bc7334e8 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] 10.222.0.17 "GET /compute/v2.1/servers/73362a63-78d8-4890-8588-d112fb85c2bf" status: 200 len: 1505 microversion: 2.1 time: 0.544486 Jul 23 21:25:24.696311 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1426/2814] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:24 2022] GET /compute/v2.1/servers/73362a63-78d8-4890-8588-d112fb85c2bf => generated 1505 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:24.703166 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-49f8a635-fff8-4506-8715-f0538c8541d4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:24.703913 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-49f8a635-fff8-4506-8715-f0538c8541d4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:24.711930 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-49f8a635-fff8-4506-8715-f0538c8541d4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:24.712967 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-49f8a635-fff8-4506-8715-f0538c8541d4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:24.713843 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-49f8a635-fff8-4506-8715-f0538c8541d4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:24.714381 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-49f8a635-fff8-4506-8715-f0538c8541d4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:24.827743 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-be214935-0ae5-4716-8734-22e9d3affd6d tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859c1493a30d4386b74377ab2b9bc81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3efb8824be84323b6ec04b604775bd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:24.838022 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-be214935-0ae5-4716-8734-22e9d3affd6d tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] 10.222.0.17 "GET /compute/v2.1/servers/d9c0391f-e638-415e-b079-ab7b429492c3" status: 200 len: 1320 microversion: 2.1 time: 0.294789 Jul 23 21:25:24.839199 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1389/2815] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:24 2022] GET /compute/v2.1/servers/d9c0391f-e638-415e-b079-ab7b429492c3 => generated 1320 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:24.888947 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-49f8a635-fff8-4506-8715-f0538c8541d4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:24.919719 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-49f8a635-fff8-4506-8715-f0538c8541d4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:24.922194 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-49f8a635-fff8-4506-8715-f0538c8541d4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:24.923743 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-49f8a635-fff8-4506-8715-f0538c8541d4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.226255 Jul 23 21:25:24.934004 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1427/2816] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:25:24 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:25:25.297039 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c4c02e5b-fa2d-451f-8907-b7017cd02072 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:25.297575 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c4c02e5b-fa2d-451f-8907-b7017cd02072 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] [instance: 7da7a2f3-d7d5-4413-9967-4be43db261fa] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:25.311521 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c4c02e5b-fa2d-451f-8907-b7017cd02072 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:25.312190 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c4c02e5b-fa2d-451f-8907-b7017cd02072 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:25.312980 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c4c02e5b-fa2d-451f-8907-b7017cd02072 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:25.313412 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c4c02e5b-fa2d-451f-8907-b7017cd02072 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:25.560005 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-785bdbfb-0a0d-472a-ba5d-6a6ba2d93683 tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:25.560577 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-785bdbfb-0a0d-472a-ba5d-6a6ba2d93683 tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] [instance: c9e47e97-31f2-41d6-a49b-66efaa974c65] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:25.572376 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-785bdbfb-0a0d-472a-ba5d-6a6ba2d93683 tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:25.572841 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-785bdbfb-0a0d-472a-ba5d-6a6ba2d93683 tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:25.574207 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-785bdbfb-0a0d-472a-ba5d-6a6ba2d93683 tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:25.574655 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-785bdbfb-0a0d-472a-ba5d-6a6ba2d93683 tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:25.847587 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c4c02e5b-fa2d-451f-8907-b7017cd02072 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7b95c6fb6743cf9f1942a6328a1ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f8e8d61274d54bd996140a9ab38f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:25.858437 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c4c02e5b-fa2d-451f-8907-b7017cd02072 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] 10.222.0.17 "GET /compute/v2.1/servers/7da7a2f3-d7d5-4413-9967-4be43db261fa" status: 200 len: 1322 microversion: 2.1 time: 0.566746 Jul 23 21:25:25.859658 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1390/2817] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:25 2022] GET /compute/v2.1/servers/7da7a2f3-d7d5-4413-9967-4be43db261fa => generated 1322 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:25.865287 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2d123001-4dab-40ab-8566-cfb4056071f2 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:25.866161 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-2d123001-4dab-40ab-8566-cfb4056071f2 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] [instance: 73362a63-78d8-4890-8588-d112fb85c2bf] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:25.895441 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2d123001-4dab-40ab-8566-cfb4056071f2 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:25.896790 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2d123001-4dab-40ab-8566-cfb4056071f2 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:25.898902 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2d123001-4dab-40ab-8566-cfb4056071f2 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:25.901360 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2d123001-4dab-40ab-8566-cfb4056071f2 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:26.604400 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-785bdbfb-0a0d-472a-ba5d-6a6ba2d93683 tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cd8823a2d134f4ea1e31f92e65df040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a136ff692aeb4fdeae12dcacd09b3d6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:26.612798 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-785bdbfb-0a0d-472a-ba5d-6a6ba2d93683 tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] 10.222.0.17 "GET /compute/v2.1/servers/c9e47e97-31f2-41d6-a49b-66efaa974c65" status: 200 len: 1699 microversion: 2.1 time: 1.057607 Jul 23 21:25:26.613974 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1428/2818] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:25 2022] GET /compute/v2.1/servers/c9e47e97-31f2-41d6-a49b-66efaa974c65 => generated 1699 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:25:26.628489 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e52137cb-17e4-4c45-ad6d-282c4f4ea356 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:26.629403 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-e52137cb-17e4-4c45-ad6d-282c4f4ea356 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] [instance: d9c0391f-e638-415e-b079-ab7b429492c3] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:26.637454 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e52137cb-17e4-4c45-ad6d-282c4f4ea356 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:26.641653 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e52137cb-17e4-4c45-ad6d-282c4f4ea356 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:26.642779 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e52137cb-17e4-4c45-ad6d-282c4f4ea356 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:26.647115 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e52137cb-17e4-4c45-ad6d-282c4f4ea356 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:27.089014 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-2d123001-4dab-40ab-8566-cfb4056071f2 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a609c39c14343e1bc1edd4b3cd56dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116def61aba4631be91f67df63ebab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:27.094569 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-e52137cb-17e4-4c45-ad6d-282c4f4ea356 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859c1493a30d4386b74377ab2b9bc81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3efb8824be84323b6ec04b604775bd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:27.102482 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-e52137cb-17e4-4c45-ad6d-282c4f4ea356 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] 10.222.0.17 "GET /compute/v2.1/servers/d9c0391f-e638-415e-b079-ab7b429492c3" status: 200 len: 1320 microversion: 2.1 time: 0.487314 Jul 23 21:25:27.110359 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2d123001-4dab-40ab-8566-cfb4056071f2 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] 10.222.0.17 "GET /compute/v2.1/servers/73362a63-78d8-4890-8588-d112fb85c2bf" status: 200 len: 1505 microversion: 2.1 time: 1.249003 Jul 23 21:25:27.113281 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1391/2820] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:25 2022] GET /compute/v2.1/servers/73362a63-78d8-4890-8588-d112fb85c2bf => generated 1505 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:27.113807 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1429/2820] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:26 2022] GET /compute/v2.1/servers/d9c0391f-e638-415e-b079-ab7b429492c3 => generated 1320 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:27.123962 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ef68616b-31f0-4186-a5b5-287842d4248f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:27.125639 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-6763d431-46af-4e3e-9bb3-ff4e3c986c3b req-444553c9-aa33-4748-b2e2-4f4778c4a1f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34973378-2075-4fc5-88c2-ab65d5d9fcb8", "tag": "d20effd9-4c4d-4691-971c-97493a61fcf9"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:25:27.127729 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ef68616b-31f0-4186-a5b5-287842d4248f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:27.142655 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ef68616b-31f0-4186-a5b5-287842d4248f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:27.143644 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ef68616b-31f0-4186-a5b5-287842d4248f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:27.145792 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ef68616b-31f0-4186-a5b5-287842d4248f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:27.149036 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ef68616b-31f0-4186-a5b5-287842d4248f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:27.152093 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-6763d431-46af-4e3e-9bb3-ff4e3c986c3b req-444553c9-aa33-4748-b2e2-4f4778c4a1f4 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:27.153820 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-6763d431-46af-4e3e-9bb3-ff4e3c986c3b req-444553c9-aa33-4748-b2e2-4f4778c4a1f4 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:27.172612 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-6763d431-46af-4e3e-9bb3-ff4e3c986c3b req-444553c9-aa33-4748-b2e2-4f4778c4a1f4 service nova] Creating event network-changed:d20effd9-4c4d-4691-971c-97493a61fcf9 for instance 34973378-2075-4fc5-88c2-ab65d5d9fcb8 on nch1-master-1 Jul 23 21:25:27.185074 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-6763d431-46af-4e3e-9bb3-ff4e3c986c3b req-444553c9-aa33-4748-b2e2-4f4778c4a1f4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069077 Jul 23 21:25:27.186546 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1430/2821] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:25:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:25:27.198269 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-1ebeec2c-4444-4672-9d41-0eb495e6b44e req-c4b2ea9b-2042-42e9-9cfd-4211331c2828 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcb1aa47-1abb-4c2f-9686-7268d2b86967", "name": "network-vif-plugged", "status": "completed", "tag": "fd27373f-0bdd-45aa-abd0-2caec10e18cf"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:25:27.216065 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-1ebeec2c-4444-4672-9d41-0eb495e6b44e req-c4b2ea9b-2042-42e9-9cfd-4211331c2828 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:27.216567 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-1ebeec2c-4444-4672-9d41-0eb495e6b44e req-c4b2ea9b-2042-42e9-9cfd-4211331c2828 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:27.239423 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-1ebeec2c-4444-4672-9d41-0eb495e6b44e req-c4b2ea9b-2042-42e9-9cfd-4211331c2828 service nova] Creating event network-vif-plugged:fd27373f-0bdd-45aa-abd0-2caec10e18cf for instance dcb1aa47-1abb-4c2f-9686-7268d2b86967 on nch2-master-1 Jul 23 21:25:27.248840 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-1ebeec2c-4444-4672-9d41-0eb495e6b44e req-c4b2ea9b-2042-42e9-9cfd-4211331c2828 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058376 Jul 23 21:25:27.252798 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1431/2822] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:25:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:25:27.263974 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a3c73724-0772-43e5-84ab-ff1da12b8eb3 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:27.264708 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-a3c73724-0772-43e5-84ab-ff1da12b8eb3 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] [instance: 7da7a2f3-d7d5-4413-9967-4be43db261fa] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:27.274658 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a3c73724-0772-43e5-84ab-ff1da12b8eb3 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:27.275115 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a3c73724-0772-43e5-84ab-ff1da12b8eb3 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:27.279284 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ef68616b-31f0-4186-a5b5-287842d4248f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:27.283403 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a3c73724-0772-43e5-84ab-ff1da12b8eb3 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:27.283966 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a3c73724-0772-43e5-84ab-ff1da12b8eb3 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:27.294905 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ef68616b-31f0-4186-a5b5-287842d4248f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:27.296562 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ef68616b-31f0-4186-a5b5-287842d4248f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:27.297765 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ef68616b-31f0-4186-a5b5-287842d4248f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.182004 Jul 23 21:25:27.298410 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1392/2823] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:25:27 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:25:27.634548 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c5cf3b20-b8b8-4a27-bcaa-b923409d054a tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:27.635488 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c5cf3b20-b8b8-4a27-bcaa-b923409d054a tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] [instance: c9e47e97-31f2-41d6-a49b-66efaa974c65] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:27.644588 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c5cf3b20-b8b8-4a27-bcaa-b923409d054a tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:27.645358 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c5cf3b20-b8b8-4a27-bcaa-b923409d054a tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:27.647229 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c5cf3b20-b8b8-4a27-bcaa-b923409d054a tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:27.647676 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c5cf3b20-b8b8-4a27-bcaa-b923409d054a tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:27.665593 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-a3c73724-0772-43e5-84ab-ff1da12b8eb3 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7b95c6fb6743cf9f1942a6328a1ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f8e8d61274d54bd996140a9ab38f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:27.673412 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-a3c73724-0772-43e5-84ab-ff1da12b8eb3 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] 10.222.0.17 "GET /compute/v2.1/servers/7da7a2f3-d7d5-4413-9967-4be43db261fa" status: 200 len: 1322 microversion: 2.1 time: 0.419121 Jul 23 21:25:27.683805 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1432/2824] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:27 2022] GET /compute/v2.1/servers/7da7a2f3-d7d5-4413-9967-4be43db261fa => generated 1322 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:27.793607 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c5cf3b20-b8b8-4a27-bcaa-b923409d054a tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cd8823a2d134f4ea1e31f92e65df040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a136ff692aeb4fdeae12dcacd09b3d6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:27.805189 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c5cf3b20-b8b8-4a27-bcaa-b923409d054a tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] 10.222.0.17 "GET /compute/v2.1/servers/c9e47e97-31f2-41d6-a49b-66efaa974c65" status: 200 len: 1632 microversion: 2.1 time: 0.177526 Jul 23 21:25:27.806144 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1393/2825] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:27 2022] GET /compute/v2.1/servers/c9e47e97-31f2-41d6-a49b-66efaa974c65 => generated 1632 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:25:27.860206 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-9c524ae9-8d2b-49e0-a520-322864447df1 req-10e085e8-7118-494a-af10-b3141ecc7ffc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9e47e97-31f2-41d6-a49b-66efaa974c65", "name": "network-vif-deleted", "tag": "d3a997e1-ef36-49cc-923f-fa9696e77441"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:25:27.878700 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-9c524ae9-8d2b-49e0-a520-322864447df1 req-10e085e8-7118-494a-af10-b3141ecc7ffc service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:27.879070 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-9c524ae9-8d2b-49e0-a520-322864447df1 req-10e085e8-7118-494a-af10-b3141ecc7ffc service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:27.903001 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-9c524ae9-8d2b-49e0-a520-322864447df1 req-10e085e8-7118-494a-af10-b3141ecc7ffc service nova] Creating event network-vif-deleted:d3a997e1-ef36-49cc-923f-fa9696e77441 for instance c9e47e97-31f2-41d6-a49b-66efaa974c65 on nch2-master-1 Jul 23 21:25:27.911845 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-9c524ae9-8d2b-49e0-a520-322864447df1 req-10e085e8-7118-494a-af10-b3141ecc7ffc service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055758 Jul 23 21:25:27.919815 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1433/2826] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:25:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:25:28.119573 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5b8967b5-ea0f-4be2-b668-fabe2a4c1e61 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:28.120831 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5b8967b5-ea0f-4be2-b668-fabe2a4c1e61 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] [instance: d9c0391f-e638-415e-b079-ab7b429492c3] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:28.131810 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-97206831-9ac4-4e8c-9058-ea5ef5df5b08 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:28.132262 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-97206831-9ac4-4e8c-9058-ea5ef5df5b08 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] [instance: 73362a63-78d8-4890-8588-d112fb85c2bf] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:28.136584 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5b8967b5-ea0f-4be2-b668-fabe2a4c1e61 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:28.137241 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5b8967b5-ea0f-4be2-b668-fabe2a4c1e61 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:28.138242 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5b8967b5-ea0f-4be2-b668-fabe2a4c1e61 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:28.139186 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5b8967b5-ea0f-4be2-b668-fabe2a4c1e61 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:28.149415 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-97206831-9ac4-4e8c-9058-ea5ef5df5b08 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:28.150192 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-97206831-9ac4-4e8c-9058-ea5ef5df5b08 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:28.151195 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-97206831-9ac4-4e8c-9058-ea5ef5df5b08 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:28.151793 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-97206831-9ac4-4e8c-9058-ea5ef5df5b08 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:28.191062 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:25:28.302970 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5b8967b5-ea0f-4be2-b668-fabe2a4c1e61 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859c1493a30d4386b74377ab2b9bc81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3efb8824be84323b6ec04b604775bd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:28.312036 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5b8967b5-ea0f-4be2-b668-fabe2a4c1e61 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] 10.222.0.17 "GET /compute/v2.1/servers/d9c0391f-e638-415e-b079-ab7b429492c3" status: 200 len: 1320 microversion: 2.1 time: 0.196687 Jul 23 21:25:28.313009 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1394/2827] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:28 2022] GET /compute/v2.1/servers/d9c0391f-e638-415e-b079-ab7b429492c3 => generated 1320 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:28.318521 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b298cef3-d7f7-4e2b-b16e-1abd3a9fea26 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:28.319352 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b298cef3-d7f7-4e2b-b16e-1abd3a9fea26 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:28.328306 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b298cef3-d7f7-4e2b-b16e-1abd3a9fea26 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:28.328840 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b298cef3-d7f7-4e2b-b16e-1abd3a9fea26 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:28.329748 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b298cef3-d7f7-4e2b-b16e-1abd3a9fea26 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:28.330289 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b298cef3-d7f7-4e2b-b16e-1abd3a9fea26 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:28.483077 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-97206831-9ac4-4e8c-9058-ea5ef5df5b08 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a609c39c14343e1bc1edd4b3cd56dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116def61aba4631be91f67df63ebab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:28.491841 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-97206831-9ac4-4e8c-9058-ea5ef5df5b08 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] 10.222.0.17 "GET /compute/v2.1/servers/73362a63-78d8-4890-8588-d112fb85c2bf" status: 200 len: 1485 microversion: 2.1 time: 0.365858 Jul 23 21:25:28.495721 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1434/2828] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:28 2022] GET /compute/v2.1/servers/73362a63-78d8-4890-8588-d112fb85c2bf => generated 1485 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:28.517167 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-b720f3af-4408-4742-850b-2228bd34d7a0 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-435563323", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:25:28.541804 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:25:28.621928 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.network.neutron [None req-b720f3af-4408-4742-850b-2228bd34d7a0 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] validate_networks() for [('b32dd772-4f2a-4847-b3c5-349ce055ea43', None, None, None, None, None)] {{(pid=131321) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:25:28.760449 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b298cef3-d7f7-4e2b-b16e-1abd3a9fea26 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:28.783636 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b298cef3-d7f7-4e2b-b16e-1abd3a9fea26 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:28.786834 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b298cef3-d7f7-4e2b-b16e-1abd3a9fea26 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:28.788404 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b298cef3-d7f7-4e2b-b16e-1abd3a9fea26 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.473636 Jul 23 21:25:28.790592 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1395/2829] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:25:28 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:25:28.829890 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b6500ed8-5162-4c01-9794-85bf81fb4848 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-743827896", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:25:28.913694 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-b6500ed8-5162-4c01-9794-85bf81fb4848 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] validate_networks() for [('92d8b6c8-55fb-4a21-a58b-da2fc6e4b22b', None, None, None, None, None)] {{(pid=131320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:25:29.792783 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-b720f3af-4408-4742-850b-2228bd34d7a0 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Flavor limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:25:29.793282 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-b720f3af-4408-4742-850b-2228bd34d7a0 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Image limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:25:29.793683 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-b720f3af-4408-4742-850b-2228bd34d7a0 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Flavor pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:25:29.794207 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-b720f3af-4408-4742-850b-2228bd34d7a0 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Image pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:25:29.795002 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-b720f3af-4408-4742-850b-2228bd34d7a0 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:25:29.826788 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b720f3af-4408-4742-850b-2228bd34d7a0 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:29.827474 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b720f3af-4408-4742-850b-2228bd34d7a0 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:29.828456 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b720f3af-4408-4742-850b-2228bd34d7a0 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:29.829164 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b720f3af-4408-4742-850b-2228bd34d7a0 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:29.858733 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-b720f3af-4408-4742-850b-2228bd34d7a0 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Getting quotas for project 8305585b60d54beeb2b087a37260a89a. Resources: {'ram', 'instances', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:25:29.864735 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-b720f3af-4408-4742-850b-2228bd34d7a0 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Getting quotas for user e961e46ab94f4fffbc606485935ce64d and project 8305585b60d54beeb2b087a37260a89a. Resources: {'ram', 'instances', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:25:29.878685 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-b720f3af-4408-4742-850b-2228bd34d7a0 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Going to run 1 instances... {{(pid=131321) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:25:29.881020 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-b720f3af-4408-4742-850b-2228bd34d7a0 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] [instance: 4085bec2-40ec-4324-b718-2c7ec388a22e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131321) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:25:29.932776 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-b720f3af-4408-4742-850b-2228bd34d7a0 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.422218 Jul 23 21:25:29.934155 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1435/2830] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:25:28 2022] POST /compute/v2.1/servers => generated 383 bytes in 1424 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 23 21:25:29.940224 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ca281443-f834-402d-8415-36781d07e5bb tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:29.941059 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-ca281443-f834-402d-8415-36781d07e5bb tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] [instance: 7da7a2f3-d7d5-4413-9967-4be43db261fa] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:29.948878 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ca281443-f834-402d-8415-36781d07e5bb tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:29.949551 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ca281443-f834-402d-8415-36781d07e5bb tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:29.950557 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ca281443-f834-402d-8415-36781d07e5bb tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:29.951158 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ca281443-f834-402d-8415-36781d07e5bb tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:30.139490 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ca281443-f834-402d-8415-36781d07e5bb tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7b95c6fb6743cf9f1942a6328a1ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f8e8d61274d54bd996140a9ab38f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:30.149651 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-ca281443-f834-402d-8415-36781d07e5bb tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] 10.222.0.17 "GET /compute/v2.1/servers/7da7a2f3-d7d5-4413-9967-4be43db261fa" status: 200 len: 1322 microversion: 2.1 time: 0.214224 Jul 23 21:25:30.150457 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1436/2831] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:29 2022] GET /compute/v2.1/servers/7da7a2f3-d7d5-4413-9967-4be43db261fa => generated 1322 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:30.155934 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-13eaff63-abaa-436e-b41a-4b83d23938dc tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:30.156702 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-13eaff63-abaa-436e-b41a-4b83d23938dc tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] [instance: c9e47e97-31f2-41d6-a49b-66efaa974c65] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:30.165206 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-13eaff63-abaa-436e-b41a-4b83d23938dc tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:30.165663 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-13eaff63-abaa-436e-b41a-4b83d23938dc tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:30.166465 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-13eaff63-abaa-436e-b41a-4b83d23938dc tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:30.166896 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-13eaff63-abaa-436e-b41a-4b83d23938dc tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:30.184907 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-13eaff63-abaa-436e-b41a-4b83d23938dc tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] HTTP exception thrown: Instance c9e47e97-31f2-41d6-a49b-66efaa974c65 could not be found. Jul 23 21:25:30.186980 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-13eaff63-abaa-436e-b41a-4b83d23938dc tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Request method failure captured: Jul 23 21:25:30.186980 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/servers/c9e47e97-31f2-41d6-a49b-66efaa974c65 HTTP/1.1 Jul 23 21:25:30.186980 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:25:30.186980 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:25:30.186980 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:25:30.186980 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:25:30.186980 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:25:30.186980 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:25:30.186980 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:25:30.186980 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:25:30.186980 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GcD4nAjJLbkNoZ5_PDcCl-6-vZpcuGbhp-k3eqG747M4UR-kYjqfqyXV-IWCDVGkpgON9ik1sH-c729y4tlSaFgRdnbclo_uPDzvnsDn6AL6CrN6EjOo4OPSJKg9r8fXtfr8XPFU0XoefNC1oyzezVWBdUmsweAmA8sM044PmZY390 Jul 23 21:25:30.186980 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:25:30.186980 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:25:30.186980 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:25:30.186980 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:25:30.186980 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:25:30.186980 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:25:30.186980 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: a136ff692aeb4fdeae12dcacd09b3d6f Jul 23 21:25:30.186980 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ServersTestJSON-76171430 Jul 23 21:25:30.186980 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:25:30.186980 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:25:30.186980 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a136ff692aeb4fdeae12dcacd09b3d6f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a136ff692aeb4fdeae12dcacd09b3d6f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a136ff692aeb4fdeae12dcacd09b3d6f", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a136ff692aeb4fdeae12dcacd09b3d6f"}]}] Jul 23 21:25:30.186980 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ServersTestJSON-76171430 Jul 23 21:25:30.186980 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: a136ff692aeb4fdeae12dcacd09b3d6f Jul 23 21:25:30.186980 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ServersTestJSON-76171430 Jul 23 21:25:30.186980 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ServersTestJSON-76171430-project Jul 23 21:25:30.186980 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:25:30.186980 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:25:30.186980 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 7cd8823a2d134f4ea1e31f92e65df040 Jul 23 21:25:30.186980 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ServersTestJSON-76171430-project Jul 23 21:25:30.186980 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:25:30.186980 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance c9e47e97-31f2-41d6-a49b-66efaa974c65 could not be found. Jul 23 21:25:30.186980 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': 'c9e47e97-31f2-41d6-a49b-66efaa974c65'} Jul 23 21:25:30.186980 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:25:30.186980 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:25:30.186980 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:25:30.186980 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:25:30.186980 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:25:30.186980 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:25:30.186980 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:25:30.186980 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:25:30.186980 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:25:30.186980 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:25:30.186980 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9e47e97-31f2-41d6-a49b-66efaa974c65 could not be found. Jul 23 21:25:30.186980 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:25:30.186980 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:25:30.186980 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:25:30.186980 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:25:30.186980 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:25:30.186980 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:25:30.186980 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:25:30.186980 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:25:30.186980 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:25:30.186980 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:25:30.186980 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:25:30.186980 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:25:30.186980 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:25:30.186980 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:25:30.186980 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:25:30.186980 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:25:30.186980 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9e47e97-31f2-41d6-a49b-66efaa974c65 could not be found. Jul 23 21:25:30.186980 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:25:30.186980 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:25:30.186980 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:25:30.186980 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:25:30.191160 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:25:30.191160 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:25:30.191160 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:25:30.191160 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:25:30.191160 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9e47e97-31f2-41d6-a49b-66efaa974c65 could not be found. Jul 23 21:25:30.191160 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:25:30.193004 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-13eaff63-abaa-436e-b41a-4b83d23938dc tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Returning 404 to user: Instance c9e47e97-31f2-41d6-a49b-66efaa974c65 could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:25:30.194731 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-13eaff63-abaa-436e-b41a-4b83d23938dc tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] 10.222.0.17 "GET /compute/v2.1/servers/c9e47e97-31f2-41d6-a49b-66efaa974c65" status: 404 len: 111 microversion: 2.1 time: 0.042955 Jul 23 21:25:30.195978 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1437/2832] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:30 2022] GET /compute/v2.1/servers/c9e47e97-31f2-41d6-a49b-66efaa974c65 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:25:30.202067 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-d3b8a87e-c12f-47c4-bf23-f590d50607b8 req-8f157538-a420-4a8a-94ea-987feb3b37d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35d0d067-4f24-45a4-b03c-32346b764d3c", "name": "network-vif-plugged", "status": "completed", "tag": "9a5bd934-baf8-40bb-b356-bd97f6909cf5"}, {"server_uuid": "d9c0391f-e638-415e-b079-ab7b429492c3", "name": "network-vif-plugged", "status": "completed", "tag": "df30b70a-0a8a-4c92-85ee-b5adf5aee6f3"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:25:30.214988 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-d3b8a87e-c12f-47c4-bf23-f590d50607b8 req-8f157538-a420-4a8a-94ea-987feb3b37d1 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:30.215763 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-d3b8a87e-c12f-47c4-bf23-f590d50607b8 req-8f157538-a420-4a8a-94ea-987feb3b37d1 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:30.233945 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-d3b8a87e-c12f-47c4-bf23-f590d50607b8 req-8f157538-a420-4a8a-94ea-987feb3b37d1 service nova] Creating event network-vif-plugged:9a5bd934-baf8-40bb-b356-bd97f6909cf5 for instance 35d0d067-4f24-45a4-b03c-32346b764d3c on nch2-master-1 Jul 23 21:25:30.235890 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-d3b8a87e-c12f-47c4-bf23-f590d50607b8 req-8f157538-a420-4a8a-94ea-987feb3b37d1 service nova] Creating event network-vif-plugged:df30b70a-0a8a-4c92-85ee-b5adf5aee6f3 for instance d9c0391f-e638-415e-b079-ab7b429492c3 on nch1-master-1 Jul 23 21:25:30.248652 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-d3b8a87e-c12f-47c4-bf23-f590d50607b8 req-8f157538-a420-4a8a-94ea-987feb3b37d1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.051033 Jul 23 21:25:30.249747 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1438/2833] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:25:30 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:25:30.257502 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-faa37f9b-f4ac-4a44-8346-a59952df9751 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:30.259195 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-faa37f9b-f4ac-4a44-8346-a59952df9751 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] [instance: d9c0391f-e638-415e-b079-ab7b429492c3] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:30.266991 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-faa37f9b-f4ac-4a44-8346-a59952df9751 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:30.267719 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-faa37f9b-f4ac-4a44-8346-a59952df9751 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:30.269318 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-faa37f9b-f4ac-4a44-8346-a59952df9751 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:30.270132 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-faa37f9b-f4ac-4a44-8346-a59952df9751 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:30.510583 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-faa37f9b-f4ac-4a44-8346-a59952df9751 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859c1493a30d4386b74377ab2b9bc81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3efb8824be84323b6ec04b604775bd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:30.519356 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-faa37f9b-f4ac-4a44-8346-a59952df9751 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] 10.222.0.17 "GET /compute/v2.1/servers/d9c0391f-e638-415e-b079-ab7b429492c3" status: 200 len: 1320 microversion: 2.1 time: 0.267421 Jul 23 21:25:30.520282 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1439/2834] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:30 2022] GET /compute/v2.1/servers/d9c0391f-e638-415e-b079-ab7b429492c3 => generated 1320 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:30.698339 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-38f5e6f7-9746-416e-bb15-07d5617fcb09 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-411487110", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "networks": [{"uuid": "1dbf2bb4-d60f-4a54-bdcd-eb9fe22ca395"}]}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:25:30.733563 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=16 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:25:30.765073 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-b6500ed8-5162-4c01-9794-85bf81fb4848 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:25:30.765513 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-b6500ed8-5162-4c01-9794-85bf81fb4848 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:25:30.766214 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.network.neutron [None req-38f5e6f7-9746-416e-bb15-07d5617fcb09 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] validate_networks() for [('1dbf2bb4-d60f-4a54-bdcd-eb9fe22ca395', None, None, None, None, None)] {{(pid=131321) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:25:30.766711 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-b6500ed8-5162-4c01-9794-85bf81fb4848 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:25:30.767136 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-b6500ed8-5162-4c01-9794-85bf81fb4848 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:25:30.768051 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-b6500ed8-5162-4c01-9794-85bf81fb4848 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:25:30.781789 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b6500ed8-5162-4c01-9794-85bf81fb4848 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:30.782674 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b6500ed8-5162-4c01-9794-85bf81fb4848 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:30.783930 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b6500ed8-5162-4c01-9794-85bf81fb4848 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:30.784687 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b6500ed8-5162-4c01-9794-85bf81fb4848 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:30.832648 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-b6500ed8-5162-4c01-9794-85bf81fb4848 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Getting quotas for project 9116def61aba4631be91f67df63ebab0. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:25:30.839321 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-b6500ed8-5162-4c01-9794-85bf81fb4848 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Getting quotas for user 2a609c39c14343e1bc1edd4b3cd56dd4 and project 9116def61aba4631be91f67df63ebab0. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:25:30.855371 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b6500ed8-5162-4c01-9794-85bf81fb4848 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Going to run 1 instances... {{(pid=131320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:25:30.858567 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b6500ed8-5162-4c01-9794-85bf81fb4848 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] [instance: cb3a66a8-4c84-4bb1-8b3f-0c48acec1215] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:25:30.888376 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=93,nova_api:UPDATE=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:25:30.929063 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b6500ed8-5162-4c01-9794-85bf81fb4848 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.129159 Jul 23 21:25:30.937011 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1396/2835] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:25:28 2022] POST /compute/v2.1/servers => generated 383 bytes in 2137 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 23 21:25:30.943929 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e2e95695-b642-40c7-977a-f6d20130264b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:30.944947 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e2e95695-b642-40c7-977a-f6d20130264b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:30.990395 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e2e95695-b642-40c7-977a-f6d20130264b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:30.994752 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e2e95695-b642-40c7-977a-f6d20130264b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:31.001048 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e2e95695-b642-40c7-977a-f6d20130264b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:31.001628 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e2e95695-b642-40c7-977a-f6d20130264b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:31.026516 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=100 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:25:31.170330 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e2e95695-b642-40c7-977a-f6d20130264b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:31.183818 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e2e95695-b642-40c7-977a-f6d20130264b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:31.186919 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e2e95695-b642-40c7-977a-f6d20130264b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:31.190743 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e2e95695-b642-40c7-977a-f6d20130264b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.249104 Jul 23 21:25:31.192936 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1397/2836] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:25:30 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:25:31.200799 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ff2ce501-4f5b-4874-b32a-737dd9210717 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:31.201418 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ff2ce501-4f5b-4874-b32a-737dd9210717 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] [instance: 4085bec2-40ec-4324-b718-2c7ec388a22e] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:31.216729 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ff2ce501-4f5b-4874-b32a-737dd9210717 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:31.217170 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ff2ce501-4f5b-4874-b32a-737dd9210717 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:31.218005 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ff2ce501-4f5b-4874-b32a-737dd9210717 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:31.218452 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ff2ce501-4f5b-4874-b32a-737dd9210717 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:31.304051 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ff2ce501-4f5b-4874-b32a-737dd9210717 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961e46ab94f4fffbc606485935ce64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8305585b60d54beeb2b087a37260a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:31.312560 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ff2ce501-4f5b-4874-b32a-737dd9210717 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] 10.222.0.17 "GET /compute/v2.1/servers/4085bec2-40ec-4324-b718-2c7ec388a22e" status: 200 len: 1276 microversion: 2.1 time: 0.118340 Jul 23 21:25:31.313550 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1398/2837] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:31 2022] GET /compute/v2.1/servers/4085bec2-40ec-4324-b718-2c7ec388a22e => generated 1276 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:31.318716 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4c72b7ed-efea-46aa-9411-e1c0ad7cdf17 tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] Calling method '.version_select at 0x7f0b4762adc0>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:31.345798 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4c72b7ed-efea-46aa-9411-e1c0ad7cdf17 tempest-ServersTestJSON-76171430 tempest-ServersTestJSON-76171430-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-276346102" status: 202 len: 0 microversion: 2.1 time: 0.030894 Jul 23 21:25:31.346822 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1399/2838] 10.222.0.17 () {58 vars in 1217 bytes} [Sat Jul 23 21:25:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-276346102 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:25:31.359581 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ba973f2d-abe9-441a-ac74-1f476bbdd7fc tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:31.361571 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ba973f2d-abe9-441a-ac74-1f476bbdd7fc tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] [instance: cb3a66a8-4c84-4bb1-8b3f-0c48acec1215] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:31.428066 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-38f5e6f7-9746-416e-bb15-07d5617fcb09 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Flavor limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:25:31.429330 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-38f5e6f7-9746-416e-bb15-07d5617fcb09 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Image limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:25:31.430304 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-38f5e6f7-9746-416e-bb15-07d5617fcb09 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Flavor pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:25:31.431138 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-38f5e6f7-9746-416e-bb15-07d5617fcb09 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Image pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:25:31.431806 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-38f5e6f7-9746-416e-bb15-07d5617fcb09 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:25:31.444472 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-38f5e6f7-9746-416e-bb15-07d5617fcb09 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:31.445510 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-38f5e6f7-9746-416e-bb15-07d5617fcb09 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:31.446660 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-38f5e6f7-9746-416e-bb15-07d5617fcb09 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:31.447493 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-38f5e6f7-9746-416e-bb15-07d5617fcb09 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:31.471148 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-38f5e6f7-9746-416e-bb15-07d5617fcb09 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Getting quotas for project 5afdbc378ad64fc58903ea2518717005. Resources: {'ram', 'instances', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:25:31.477293 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-38f5e6f7-9746-416e-bb15-07d5617fcb09 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Getting quotas for user c8c3d58265714ebba65b1510bd768e19 and project 5afdbc378ad64fc58903ea2518717005. Resources: {'ram', 'instances', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:25:31.494862 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ba973f2d-abe9-441a-ac74-1f476bbdd7fc tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a609c39c14343e1bc1edd4b3cd56dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116def61aba4631be91f67df63ebab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:31.503378 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-38f5e6f7-9746-416e-bb15-07d5617fcb09 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Going to run 1 instances... {{(pid=131321) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:25:31.505563 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ba973f2d-abe9-441a-ac74-1f476bbdd7fc tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] 10.222.0.17 "GET /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215" status: 200 len: 1213 microversion: 2.1 time: 0.157614 Jul 23 21:25:31.508825 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1400/2839] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:31 2022] GET /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215 => generated 1213 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:31.511590 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-38f5e6f7-9746-416e-bb15-07d5617fcb09 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: d303403b-5d14-443b-a6fe-f8b579d24cda] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131321) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:25:31.520788 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6115dd93-f034-48b6-b553-d163f0c3694c tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:31.521777 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6115dd93-f034-48b6-b553-d163f0c3694c tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] [instance: 7da7a2f3-d7d5-4413-9967-4be43db261fa] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:31.529099 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6115dd93-f034-48b6-b553-d163f0c3694c tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:31.530316 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6115dd93-f034-48b6-b553-d163f0c3694c tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:31.532472 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6115dd93-f034-48b6-b553-d163f0c3694c tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:31.533128 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6115dd93-f034-48b6-b553-d163f0c3694c tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:31.585073 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-38f5e6f7-9746-416e-bb15-07d5617fcb09 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.063407 Jul 23 21:25:31.585780 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1440/2840] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:25:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1065 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 23 21:25:31.595345 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ae2d1a8c-bc80-4fad-834b-f255838d650d tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:31.596162 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-ae2d1a8c-bc80-4fad-834b-f255838d650d tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] [instance: d9c0391f-e638-415e-b079-ab7b429492c3] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:31.603714 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ae2d1a8c-bc80-4fad-834b-f255838d650d tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:31.604571 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ae2d1a8c-bc80-4fad-834b-f255838d650d tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:31.605504 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ae2d1a8c-bc80-4fad-834b-f255838d650d tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:31.606565 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ae2d1a8c-bc80-4fad-834b-f255838d650d tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:31.796476 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ae2d1a8c-bc80-4fad-834b-f255838d650d tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859c1493a30d4386b74377ab2b9bc81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3efb8824be84323b6ec04b604775bd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:31.800237 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6115dd93-f034-48b6-b553-d163f0c3694c tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7b95c6fb6743cf9f1942a6328a1ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f8e8d61274d54bd996140a9ab38f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:31.824188 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-ae2d1a8c-bc80-4fad-834b-f255838d650d tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] 10.222.0.17 "GET /compute/v2.1/servers/d9c0391f-e638-415e-b079-ab7b429492c3" status: 200 len: 1320 microversion: 2.1 time: 0.237105 Jul 23 21:25:31.824792 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1441/2841] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:31 2022] GET /compute/v2.1/servers/d9c0391f-e638-415e-b079-ab7b429492c3 => generated 1320 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:31.833005 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6115dd93-f034-48b6-b553-d163f0c3694c tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] 10.222.0.17 "GET /compute/v2.1/servers/7da7a2f3-d7d5-4413-9967-4be43db261fa" status: 200 len: 1322 microversion: 2.1 time: 0.322180 Jul 23 21:25:31.834322 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1401/2842] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:31 2022] GET /compute/v2.1/servers/7da7a2f3-d7d5-4413-9967-4be43db261fa => generated 1322 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:31.841346 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-56c7768f-139d-4d10-877e-26fcf9439f6f tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:31.845243 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-56c7768f-139d-4d10-877e-26fcf9439f6f tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: d303403b-5d14-443b-a6fe-f8b579d24cda] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:32.032125 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-56c7768f-139d-4d10-877e-26fcf9439f6f tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:32.040175 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-56c7768f-139d-4d10-877e-26fcf9439f6f tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda" status: 200 len: 1217 microversion: 2.1 time: 0.210571 Jul 23 21:25:32.042507 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1442/2843] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:31 2022] GET /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda => generated 1217 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:32.209822 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1224f47b-8e52-4975-84b0-461c547ba72e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:32.210858 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1224f47b-8e52-4975-84b0-461c547ba72e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:32.223798 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1224f47b-8e52-4975-84b0-461c547ba72e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:32.228568 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1224f47b-8e52-4975-84b0-461c547ba72e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:32.229837 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1224f47b-8e52-4975-84b0-461c547ba72e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:32.230327 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1224f47b-8e52-4975-84b0-461c547ba72e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:32.266807 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-d80efe5c-8982-4e79-b28f-e57a04537266 req-d30ace08-5edb-4dc6-a179-06881e2b13ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7da7a2f3-d7d5-4413-9967-4be43db261fa", "name": "network-vif-plugged", "status": "completed", "tag": "ee408eac-db3f-4902-ae57-cfe1b8d701d2"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:25:32.286680 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-d80efe5c-8982-4e79-b28f-e57a04537266 req-d30ace08-5edb-4dc6-a179-06881e2b13ea service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:32.287565 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-d80efe5c-8982-4e79-b28f-e57a04537266 req-d30ace08-5edb-4dc6-a179-06881e2b13ea service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:32.319274 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-d80efe5c-8982-4e79-b28f-e57a04537266 req-d30ace08-5edb-4dc6-a179-06881e2b13ea service nova] Creating event network-vif-plugged:ee408eac-db3f-4902-ae57-cfe1b8d701d2 for instance 7da7a2f3-d7d5-4413-9967-4be43db261fa on nch2-master-1 Jul 23 21:25:32.332830 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-d80efe5c-8982-4e79-b28f-e57a04537266 req-d30ace08-5edb-4dc6-a179-06881e2b13ea service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070544 Jul 23 21:25:32.336521 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1443/2844] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:25:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:25:32.351584 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-3b455d19-5f2a-4c9f-8275-6f7285df54a2 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:32.353168 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-3b455d19-5f2a-4c9f-8275-6f7285df54a2 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] [instance: 4085bec2-40ec-4324-b718-2c7ec388a22e] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:32.370259 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3b455d19-5f2a-4c9f-8275-6f7285df54a2 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:32.371957 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3b455d19-5f2a-4c9f-8275-6f7285df54a2 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:32.372957 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3b455d19-5f2a-4c9f-8275-6f7285df54a2 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:32.376200 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3b455d19-5f2a-4c9f-8275-6f7285df54a2 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:32.476630 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-1224f47b-8e52-4975-84b0-461c547ba72e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:32.489098 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-1224f47b-8e52-4975-84b0-461c547ba72e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:32.497459 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-1224f47b-8e52-4975-84b0-461c547ba72e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:32.498903 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1224f47b-8e52-4975-84b0-461c547ba72e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.293126 Jul 23 21:25:32.499658 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1402/2845] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:25:32 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:25:32.526401 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1ebddbb5-124d-49bd-a9a2-291b47aa3840 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:32.527363 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1ebddbb5-124d-49bd-a9a2-291b47aa3840 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] [instance: cb3a66a8-4c84-4bb1-8b3f-0c48acec1215] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:32.538870 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1ebddbb5-124d-49bd-a9a2-291b47aa3840 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:32.541010 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1ebddbb5-124d-49bd-a9a2-291b47aa3840 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:32.543459 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1ebddbb5-124d-49bd-a9a2-291b47aa3840 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:32.545364 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1ebddbb5-124d-49bd-a9a2-291b47aa3840 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:32.616035 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-3b455d19-5f2a-4c9f-8275-6f7285df54a2 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961e46ab94f4fffbc606485935ce64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8305585b60d54beeb2b087a37260a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:32.625120 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-3b455d19-5f2a-4c9f-8275-6f7285df54a2 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] 10.222.0.17 "GET /compute/v2.1/servers/4085bec2-40ec-4324-b718-2c7ec388a22e" status: 200 len: 1294 microversion: 2.1 time: 0.287017 Jul 23 21:25:32.635632 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1444/2846] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:32 2022] GET /compute/v2.1/servers/4085bec2-40ec-4324-b718-2c7ec388a22e => generated 1294 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:32.675921 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-1ebddbb5-124d-49bd-a9a2-291b47aa3840 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a609c39c14343e1bc1edd4b3cd56dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116def61aba4631be91f67df63ebab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:32.686517 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1ebddbb5-124d-49bd-a9a2-291b47aa3840 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] 10.222.0.17 "GET /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215" status: 200 len: 1265 microversion: 2.1 time: 0.165524 Jul 23 21:25:32.687142 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1403/2847] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:32 2022] GET /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:25:32.841382 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-820d78da-f1f2-44b3-aae4-04afa0352cfd tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:32.842321 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-820d78da-f1f2-44b3-aae4-04afa0352cfd tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] [instance: d9c0391f-e638-415e-b079-ab7b429492c3] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:32.858005 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-29d5b692-680b-4962-a810-5dd6b4c3ab68 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:32.858621 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-29d5b692-680b-4962-a810-5dd6b4c3ab68 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] [instance: 7da7a2f3-d7d5-4413-9967-4be43db261fa] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:32.860800 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-820d78da-f1f2-44b3-aae4-04afa0352cfd tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:32.861594 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-820d78da-f1f2-44b3-aae4-04afa0352cfd tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:32.864296 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-820d78da-f1f2-44b3-aae4-04afa0352cfd tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:32.864990 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-820d78da-f1f2-44b3-aae4-04afa0352cfd tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:32.889442 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-29d5b692-680b-4962-a810-5dd6b4c3ab68 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:32.891462 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-29d5b692-680b-4962-a810-5dd6b4c3ab68 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:32.896309 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-29d5b692-680b-4962-a810-5dd6b4c3ab68 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:32.897327 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-29d5b692-680b-4962-a810-5dd6b4c3ab68 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:33.218390 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-29d5b692-680b-4962-a810-5dd6b4c3ab68 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7b95c6fb6743cf9f1942a6328a1ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f8e8d61274d54bd996140a9ab38f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:33.230239 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-29d5b692-680b-4962-a810-5dd6b4c3ab68 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] 10.222.0.17 "GET /compute/v2.1/servers/7da7a2f3-d7d5-4413-9967-4be43db261fa" status: 200 len: 1322 microversion: 2.1 time: 0.380275 Jul 23 21:25:33.243752 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1404/2848] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:32 2022] GET /compute/v2.1/servers/7da7a2f3-d7d5-4413-9967-4be43db261fa => generated 1322 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:33.259073 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-36b39cc4-b5b8-4b21-adb2-e0a0f06721f7 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:33.260171 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-36b39cc4-b5b8-4b21-adb2-e0a0f06721f7 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: d303403b-5d14-443b-a6fe-f8b579d24cda] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:33.277148 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-36b39cc4-b5b8-4b21-adb2-e0a0f06721f7 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:33.278064 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-36b39cc4-b5b8-4b21-adb2-e0a0f06721f7 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:33.282342 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-36b39cc4-b5b8-4b21-adb2-e0a0f06721f7 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:33.283330 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-36b39cc4-b5b8-4b21-adb2-e0a0f06721f7 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:33.440064 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-36b39cc4-b5b8-4b21-adb2-e0a0f06721f7 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:33.456007 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-820d78da-f1f2-44b3-aae4-04afa0352cfd tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859c1493a30d4386b74377ab2b9bc81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3efb8824be84323b6ec04b604775bd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:33.457621 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-36b39cc4-b5b8-4b21-adb2-e0a0f06721f7 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda" status: 200 len: 1269 microversion: 2.1 time: 0.210382 Jul 23 21:25:33.458783 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1405/2849] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:33 2022] GET /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda => generated 1269 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:33.468867 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-820d78da-f1f2-44b3-aae4-04afa0352cfd tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] 10.222.0.17 "GET /compute/v2.1/servers/d9c0391f-e638-415e-b079-ab7b429492c3" status: 200 len: 1510 microversion: 2.1 time: 0.631726 Jul 23 21:25:33.469463 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1445/2850] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:32 2022] GET /compute/v2.1/servers/d9c0391f-e638-415e-b079-ab7b429492c3 => generated 1510 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:33.485501 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-021663a0-8e23-4b4d-af93-f92e9bbf3324 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:33.489374 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-021663a0-8e23-4b4d-af93-f92e9bbf3324 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] [instance: 35d0d067-4f24-45a4-b03c-32346b764d3c] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:33.500094 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-021663a0-8e23-4b4d-af93-f92e9bbf3324 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:33.500837 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-021663a0-8e23-4b4d-af93-f92e9bbf3324 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:33.503417 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-021663a0-8e23-4b4d-af93-f92e9bbf3324 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:33.504065 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-021663a0-8e23-4b4d-af93-f92e9bbf3324 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:33.517372 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c87a397b-4984-4b94-96b2-aa478e06995f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:33.518273 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-c87a397b-4984-4b94-96b2-aa478e06995f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:33.524691 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c87a397b-4984-4b94-96b2-aa478e06995f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:33.525379 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c87a397b-4984-4b94-96b2-aa478e06995f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:33.526193 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c87a397b-4984-4b94-96b2-aa478e06995f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:33.526781 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c87a397b-4984-4b94-96b2-aa478e06995f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:33.627402 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c87a397b-4984-4b94-96b2-aa478e06995f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:33.671569 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c87a397b-4984-4b94-96b2-aa478e06995f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:33.698915 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c87a397b-4984-4b94-96b2-aa478e06995f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:33.704580 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-c87a397b-4984-4b94-96b2-aa478e06995f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.190889 Jul 23 21:25:33.709753 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1446/2851] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:25:33 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:25:33.730627 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-4483bff4-1e58-40c5-b9a7-d8e5a6f8ebec tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:33.737481 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-4483bff4-1e58-40c5-b9a7-d8e5a6f8ebec tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] [instance: 4085bec2-40ec-4324-b718-2c7ec388a22e] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:33.758234 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4483bff4-1e58-40c5-b9a7-d8e5a6f8ebec tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:33.758688 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4483bff4-1e58-40c5-b9a7-d8e5a6f8ebec tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:33.762025 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4483bff4-1e58-40c5-b9a7-d8e5a6f8ebec tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:33.765129 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4483bff4-1e58-40c5-b9a7-d8e5a6f8ebec tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:33.941261 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-021663a0-8e23-4b4d-af93-f92e9bbf3324 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859c1493a30d4386b74377ab2b9bc81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3efb8824be84323b6ec04b604775bd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:33.965101 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-021663a0-8e23-4b4d-af93-f92e9bbf3324 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] 10.222.0.17 "GET /compute/v2.1/servers/35d0d067-4f24-45a4-b03c-32346b764d3c" status: 200 len: 1509 microversion: 2.1 time: 0.483680 Jul 23 21:25:33.980163 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1406/2852] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:33 2022] GET /compute/v2.1/servers/35d0d067-4f24-45a4-b03c-32346b764d3c => generated 1509 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:33.996797 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-fe5d2b13-839c-478d-8e2c-7a53aa828a4e tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:33.997416 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-fe5d2b13-839c-478d-8e2c-7a53aa828a4e tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] [instance: cb3a66a8-4c84-4bb1-8b3f-0c48acec1215] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:34.020211 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fe5d2b13-839c-478d-8e2c-7a53aa828a4e tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:34.020988 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fe5d2b13-839c-478d-8e2c-7a53aa828a4e tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:34.025291 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fe5d2b13-839c-478d-8e2c-7a53aa828a4e tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:34.039034 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fe5d2b13-839c-478d-8e2c-7a53aa828a4e tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:34.207941 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-fe5d2b13-839c-478d-8e2c-7a53aa828a4e tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a609c39c14343e1bc1edd4b3cd56dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116def61aba4631be91f67df63ebab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:34.228516 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-fe5d2b13-839c-478d-8e2c-7a53aa828a4e tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] 10.222.0.17 "GET /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215" status: 200 len: 1271 microversion: 2.1 time: 0.246838 Jul 23 21:25:34.242051 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1407/2853] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:33 2022] GET /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215 => generated 1271 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:34.262595 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-cb10be74-aac3-4b01-9fde-c36f779d1ea7 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:34.263620 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-cb10be74-aac3-4b01-9fde-c36f779d1ea7 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] [instance: dcb1aa47-1abb-4c2f-9686-7268d2b86967] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:34.275965 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cb10be74-aac3-4b01-9fde-c36f779d1ea7 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:34.276778 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cb10be74-aac3-4b01-9fde-c36f779d1ea7 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:34.279602 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cb10be74-aac3-4b01-9fde-c36f779d1ea7 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:34.280210 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cb10be74-aac3-4b01-9fde-c36f779d1ea7 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:34.509762 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-4483bff4-1e58-40c5-b9a7-d8e5a6f8ebec tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961e46ab94f4fffbc606485935ce64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8305585b60d54beeb2b087a37260a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:34.522922 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-4483bff4-1e58-40c5-b9a7-d8e5a6f8ebec tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] 10.222.0.17 "GET /compute/v2.1/servers/4085bec2-40ec-4324-b718-2c7ec388a22e" status: 200 len: 1324 microversion: 2.1 time: 0.810740 Jul 23 21:25:34.523787 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1447/2854] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:33 2022] GET /compute/v2.1/servers/4085bec2-40ec-4324-b718-2c7ec388a22e => generated 1324 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:34.532543 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a0e0a9cf-e177-49a9-b546-b50504d793ed tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:34.533281 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-a0e0a9cf-e177-49a9-b546-b50504d793ed tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] [instance: 7da7a2f3-d7d5-4413-9967-4be43db261fa] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:34.541921 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a0e0a9cf-e177-49a9-b546-b50504d793ed tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:34.542497 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a0e0a9cf-e177-49a9-b546-b50504d793ed tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:34.543385 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a0e0a9cf-e177-49a9-b546-b50504d793ed tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:34.543989 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a0e0a9cf-e177-49a9-b546-b50504d793ed tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:34.597231 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-cb10be74-aac3-4b01-9fde-c36f779d1ea7 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859c1493a30d4386b74377ab2b9bc81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3efb8824be84323b6ec04b604775bd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:34.608148 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-cb10be74-aac3-4b01-9fde-c36f779d1ea7 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] 10.222.0.17 "GET /compute/v2.1/servers/dcb1aa47-1abb-4c2f-9686-7268d2b86967" status: 200 len: 1510 microversion: 2.1 time: 0.362283 Jul 23 21:25:34.609354 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1408/2855] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:34 2022] GET /compute/v2.1/servers/dcb1aa47-1abb-4c2f-9686-7268d2b86967 => generated 1510 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:34.629597 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-817814ed-2981-4cf2-8fba-cc7b29b2d1a8 req-ec63a9c3-661e-4084-a250-137c4c859592 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34973378-2075-4fc5-88c2-ab65d5d9fcb8", "name": "network-vif-plugged", "status": "completed", "tag": "d20effd9-4c4d-4691-971c-97493a61fcf9"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:25:34.667745 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-817814ed-2981-4cf2-8fba-cc7b29b2d1a8 req-ec63a9c3-661e-4084-a250-137c4c859592 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:34.668186 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-817814ed-2981-4cf2-8fba-cc7b29b2d1a8 req-ec63a9c3-661e-4084-a250-137c4c859592 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:34.694061 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-817814ed-2981-4cf2-8fba-cc7b29b2d1a8 req-ec63a9c3-661e-4084-a250-137c4c859592 service nova] Creating event network-vif-plugged:d20effd9-4c4d-4691-971c-97493a61fcf9 for instance 34973378-2075-4fc5-88c2-ab65d5d9fcb8 on nch1-master-1 Jul 23 21:25:34.707038 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-817814ed-2981-4cf2-8fba-cc7b29b2d1a8 req-ec63a9c3-661e-4084-a250-137c4c859592 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095954 Jul 23 21:25:34.711721 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1409/2856] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:25:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:25:34.728702 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-09e32bb0-3b1f-47e1-92d0-547f28982b4f tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:34.729626 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-09e32bb0-3b1f-47e1-92d0-547f28982b4f tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: d303403b-5d14-443b-a6fe-f8b579d24cda] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:34.740626 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-09e32bb0-3b1f-47e1-92d0-547f28982b4f tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:34.741420 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-09e32bb0-3b1f-47e1-92d0-547f28982b4f tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:34.745682 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-09e32bb0-3b1f-47e1-92d0-547f28982b4f tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:34.746334 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-09e32bb0-3b1f-47e1-92d0-547f28982b4f tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:34.898621 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-a0e0a9cf-e177-49a9-b546-b50504d793ed tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7b95c6fb6743cf9f1942a6328a1ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f8e8d61274d54bd996140a9ab38f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:34.910449 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-a0e0a9cf-e177-49a9-b546-b50504d793ed tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] 10.222.0.17 "GET /compute/v2.1/servers/7da7a2f3-d7d5-4413-9967-4be43db261fa" status: 200 len: 1514 microversion: 2.1 time: 0.385350 Jul 23 21:25:34.911639 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1448/2857] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:34 2022] GET /compute/v2.1/servers/7da7a2f3-d7d5-4413-9967-4be43db261fa => generated 1514 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:34.916426 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c5fd9a86-ae2b-4853-a9a4-814de98568c8 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:34.920779 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c5fd9a86-ae2b-4853-a9a4-814de98568c8 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '859c1493a30d4386b74377ab2b9bc81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3efb8824be84323b6ec04b604775bd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:34.921818 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-c5fd9a86-ae2b-4853-a9a4-814de98568c8 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'b3efb8824be84323b6ec04b604775bd0'} {{(pid=131321) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 23 21:25:34.951704 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c5fd9a86-ae2b-4853-a9a4-814de98568c8 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:34.952398 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c5fd9a86-ae2b-4853-a9a4-814de98568c8 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:34.953352 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c5fd9a86-ae2b-4853-a9a4-814de98568c8 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:34.954008 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c5fd9a86-ae2b-4853-a9a4-814de98568c8 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:35.053140 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-09e32bb0-3b1f-47e1-92d0-547f28982b4f tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:35.061935 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-09e32bb0-3b1f-47e1-92d0-547f28982b4f tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda" status: 200 len: 1275 microversion: 2.1 time: 0.347353 Jul 23 21:25:35.073580 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1410/2858] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:34 2022] GET /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda => generated 1275 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:35.079044 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8690881d-44b1-4153-9f55-cc8c53fa0339 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:35.080019 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8690881d-44b1-4153-9f55-cc8c53fa0339 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:35.095112 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8690881d-44b1-4153-9f55-cc8c53fa0339 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:35.095955 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8690881d-44b1-4153-9f55-cc8c53fa0339 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:35.096960 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8690881d-44b1-4153-9f55-cc8c53fa0339 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:35.097651 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8690881d-44b1-4153-9f55-cc8c53fa0339 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:35.187437 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.multi_cell_list [None req-c5fd9a86-ae2b-4853-a9a4-814de98568c8 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131321) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 23 21:25:35.213696 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8690881d-44b1-4153-9f55-cc8c53fa0339 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:35.240957 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8690881d-44b1-4153-9f55-cc8c53fa0339 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:35.248782 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8690881d-44b1-4153-9f55-cc8c53fa0339 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:35.251995 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8690881d-44b1-4153-9f55-cc8c53fa0339 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.177013 Jul 23 21:25:35.257909 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1411/2859] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:25:35 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:25:35.286944 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-262ed4df-24bd-4852-b285-fd55067f055d tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:35.290062 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-262ed4df-24bd-4852-b285-fd55067f055d tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] [instance: 34973378-2075-4fc5-88c2-ab65d5d9fcb8] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:35.293650 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c5fd9a86-ae2b-4853-a9a4-814de98568c8 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859c1493a30d4386b74377ab2b9bc81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3efb8824be84323b6ec04b604775bd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:35.301649 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-262ed4df-24bd-4852-b285-fd55067f055d tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:35.305112 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c5fd9a86-ae2b-4853-a9a4-814de98568c8 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:35.305563 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c5fd9a86-ae2b-4853-a9a4-814de98568c8 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:35.306507 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-262ed4df-24bd-4852-b285-fd55067f055d tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:35.309450 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-262ed4df-24bd-4852-b285-fd55067f055d tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:35.311414 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-262ed4df-24bd-4852-b285-fd55067f055d tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:35.746002 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-262ed4df-24bd-4852-b285-fd55067f055d tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7b95c6fb6743cf9f1942a6328a1ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f8e8d61274d54bd996140a9ab38f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:35.762167 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-262ed4df-24bd-4852-b285-fd55067f055d tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] 10.222.0.17 "GET /compute/v2.1/servers/34973378-2075-4fc5-88c2-ab65d5d9fcb8" status: 200 len: 1322 microversion: 2.1 time: 0.502784 Jul 23 21:25:35.767556 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1412/2860] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:35 2022] GET /compute/v2.1/servers/34973378-2075-4fc5-88c2-ab65d5d9fcb8 => generated 1322 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:35.773596 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-32599c33-3125-41b9-b3f1-33a14f57b214 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:35.774419 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-32599c33-3125-41b9-b3f1-33a14f57b214 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] [instance: cb3a66a8-4c84-4bb1-8b3f-0c48acec1215] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:35.781558 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-32599c33-3125-41b9-b3f1-33a14f57b214 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:35.783358 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-32599c33-3125-41b9-b3f1-33a14f57b214 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:35.784346 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-32599c33-3125-41b9-b3f1-33a14f57b214 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:35.784943 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-32599c33-3125-41b9-b3f1-33a14f57b214 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:36.032172 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-c5fd9a86-ae2b-4853-a9a4-814de98568c8 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] 10.222.0.17 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1513 microversion: 2.1 time: 1.119168 Jul 23 21:25:36.032930 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1449/2861] 10.222.0.17 () {58 vars in 1166 bytes} [Sat Jul 23 21:25:34 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1513 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:36.038248 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-23ed9658-b89d-4fb4-a019-d653ffa9b59a tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:36.039203 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-23ed9658-b89d-4fb4-a019-d653ffa9b59a tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] [instance: 4085bec2-40ec-4324-b718-2c7ec388a22e] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:36.046179 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-23ed9658-b89d-4fb4-a019-d653ffa9b59a tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:36.046987 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-23ed9658-b89d-4fb4-a019-d653ffa9b59a tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:36.048173 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-23ed9658-b89d-4fb4-a019-d653ffa9b59a tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:36.048842 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-23ed9658-b89d-4fb4-a019-d653ffa9b59a tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:36.349237 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-23ed9658-b89d-4fb4-a019-d653ffa9b59a tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961e46ab94f4fffbc606485935ce64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8305585b60d54beeb2b087a37260a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:36.361529 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-23ed9658-b89d-4fb4-a019-d653ffa9b59a tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] 10.222.0.17 "GET /compute/v2.1/servers/4085bec2-40ec-4324-b718-2c7ec388a22e" status: 200 len: 1324 microversion: 2.1 time: 0.326829 Jul 23 21:25:36.363554 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1450/2862] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:36 2022] GET /compute/v2.1/servers/4085bec2-40ec-4324-b718-2c7ec388a22e => generated 1324 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:36.373032 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ff9b0ff6-7a94-4f2f-a475-737b350500f0 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:36.383089 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ff9b0ff6-7a94-4f2f-a475-737b350500f0 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '859c1493a30d4386b74377ab2b9bc81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3efb8824be84323b6ec04b604775bd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:36.385088 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-ff9b0ff6-7a94-4f2f-a475-737b350500f0 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-649361757', 'deleted': False, 'project_id': 'b3efb8824be84323b6ec04b604775bd0'} {{(pid=131321) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 23 21:25:36.395875 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ff9b0ff6-7a94-4f2f-a475-737b350500f0 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:36.396650 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ff9b0ff6-7a94-4f2f-a475-737b350500f0 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:36.398792 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ff9b0ff6-7a94-4f2f-a475-737b350500f0 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:36.399567 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ff9b0ff6-7a94-4f2f-a475-737b350500f0 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:36.407536 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-32599c33-3125-41b9-b3f1-33a14f57b214 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a609c39c14343e1bc1edd4b3cd56dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116def61aba4631be91f67df63ebab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:36.425585 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-32599c33-3125-41b9-b3f1-33a14f57b214 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] 10.222.0.17 "GET /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215" status: 200 len: 1313 microversion: 2.1 time: 0.656538 Jul 23 21:25:36.426237 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1413/2863] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:35 2022] GET /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215 => generated 1313 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:36.440595 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-cbcb8d2a-101f-496c-9884-4f8883c1291f tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:36.441274 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-cbcb8d2a-101f-496c-9884-4f8883c1291f tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: d303403b-5d14-443b-a6fe-f8b579d24cda] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:36.474355 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cbcb8d2a-101f-496c-9884-4f8883c1291f tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:36.474817 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cbcb8d2a-101f-496c-9884-4f8883c1291f tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:36.475611 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cbcb8d2a-101f-496c-9884-4f8883c1291f tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:36.476059 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cbcb8d2a-101f-496c-9884-4f8883c1291f tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:36.584725 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.multi_cell_list [None req-ff9b0ff6-7a94-4f2f-a475-737b350500f0 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131321) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 23 21:25:36.687793 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ff9b0ff6-7a94-4f2f-a475-737b350500f0 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859c1493a30d4386b74377ab2b9bc81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3efb8824be84323b6ec04b604775bd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:36.701103 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ff9b0ff6-7a94-4f2f-a475-737b350500f0 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:36.701699 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ff9b0ff6-7a94-4f2f-a475-737b350500f0 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:36.974399 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-cbcb8d2a-101f-496c-9884-4f8883c1291f tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:36.983857 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-cbcb8d2a-101f-496c-9884-4f8883c1291f tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda" status: 200 len: 1317 microversion: 2.1 time: 0.547275 Jul 23 21:25:36.984482 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1414/2864] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:36 2022] GET /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda => generated 1317 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:36.999302 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-06f9a3f5-ba2c-4589-bfca-387150f9521a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:37.000154 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-06f9a3f5-ba2c-4589-bfca-387150f9521a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:37.019468 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-06f9a3f5-ba2c-4589-bfca-387150f9521a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:37.019912 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-06f9a3f5-ba2c-4589-bfca-387150f9521a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:37.020891 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-06f9a3f5-ba2c-4589-bfca-387150f9521a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:37.021482 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-06f9a3f5-ba2c-4589-bfca-387150f9521a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:37.068826 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-ff9b0ff6-7a94-4f2f-a475-737b350500f0 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] 10.222.0.17 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-649361757" status: 200 len: 1512 microversion: 2.1 time: 0.703632 Jul 23 21:25:37.069812 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1451/2865] 10.222.0.17 () {58 vars in 1260 bytes} [Sat Jul 23 21:25:36 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-649361757 => generated 1512 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:37.074351 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-6d1d80ec-df1c-4045-99c8-42f1e52e120e req-19a10f06-64da-48d1-a4a0-3278b16ec5be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acfc85ad-35a7-4cfd-935d-89707e3bc08c", "name": "network-vif-plugged", "status": "completed", "tag": "ec455c66-6e36-401f-999f-8bf7a293217a"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:25:37.088493 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-6d1d80ec-df1c-4045-99c8-42f1e52e120e req-19a10f06-64da-48d1-a4a0-3278b16ec5be service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:37.088493 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-6d1d80ec-df1c-4045-99c8-42f1e52e120e req-19a10f06-64da-48d1-a4a0-3278b16ec5be service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:37.113533 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-6d1d80ec-df1c-4045-99c8-42f1e52e120e req-19a10f06-64da-48d1-a4a0-3278b16ec5be service nova] Creating event network-vif-plugged:ec455c66-6e36-401f-999f-8bf7a293217a for instance acfc85ad-35a7-4cfd-935d-89707e3bc08c on nch2-master-1 Jul 23 21:25:37.129190 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-6d1d80ec-df1c-4045-99c8-42f1e52e120e req-19a10f06-64da-48d1-a4a0-3278b16ec5be service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058071 Jul 23 21:25:37.130164 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1452/2866] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:25:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:25:37.139367 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-13f29482-a818-4a49-b3ff-f94c5910287a tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:37.140131 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-13f29482-a818-4a49-b3ff-f94c5910287a tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] [instance: 34973378-2075-4fc5-88c2-ab65d5d9fcb8] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:37.157785 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-13f29482-a818-4a49-b3ff-f94c5910287a tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:37.158281 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-13f29482-a818-4a49-b3ff-f94c5910287a tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:37.159083 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-13f29482-a818-4a49-b3ff-f94c5910287a tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:37.159534 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-13f29482-a818-4a49-b3ff-f94c5910287a tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:37.226328 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-06f9a3f5-ba2c-4589-bfca-387150f9521a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:37.244405 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-06f9a3f5-ba2c-4589-bfca-387150f9521a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:37.246208 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-06f9a3f5-ba2c-4589-bfca-387150f9521a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:37.247823 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-06f9a3f5-ba2c-4589-bfca-387150f9521a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.262480 Jul 23 21:25:37.248622 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1415/2867] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:25:36 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:25:37.254336 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-6a67e314-178c-4001-ac5c-7a06d001bc83 req-94e183ed-4010-4fe5-8e0a-c843e133691b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4085bec2-40ec-4324-b718-2c7ec388a22e", "tag": "39fbda00-62e3-43a1-8cd6-e48af6277d20"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:25:37.263240 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-6a67e314-178c-4001-ac5c-7a06d001bc83 req-94e183ed-4010-4fe5-8e0a-c843e133691b service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:37.264018 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-6a67e314-178c-4001-ac5c-7a06d001bc83 req-94e183ed-4010-4fe5-8e0a-c843e133691b service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:37.277655 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-6a67e314-178c-4001-ac5c-7a06d001bc83 req-94e183ed-4010-4fe5-8e0a-c843e133691b service nova] Creating event network-changed:39fbda00-62e3-43a1-8cd6-e48af6277d20 for instance 4085bec2-40ec-4324-b718-2c7ec388a22e on nch1-master-1 Jul 23 21:25:37.285168 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-6a67e314-178c-4001-ac5c-7a06d001bc83 req-94e183ed-4010-4fe5-8e0a-c843e133691b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034586 Jul 23 21:25:37.287441 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1416/2868] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:25:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:25:37.294472 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ac3b21b1-52bb-4766-9be4-1fb9385debf4 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:37.298649 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ac3b21b1-52bb-4766-9be4-1fb9385debf4 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '859c1493a30d4386b74377ab2b9bc81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3efb8824be84323b6ec04b604775bd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:37.299811 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ac3b21b1-52bb-4766-9be4-1fb9385debf4 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'b3efb8824be84323b6ec04b604775bd0'} {{(pid=131320) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 23 21:25:37.306834 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ac3b21b1-52bb-4766-9be4-1fb9385debf4 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:37.307549 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ac3b21b1-52bb-4766-9be4-1fb9385debf4 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:37.308735 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ac3b21b1-52bb-4766-9be4-1fb9385debf4 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:37.309379 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ac3b21b1-52bb-4766-9be4-1fb9385debf4 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:37.446088 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=100 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:25:37.459379 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.multi_cell_list [None req-ac3b21b1-52bb-4766-9be4-1fb9385debf4 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=131320) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 23 21:25:37.529116 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-13f29482-a818-4a49-b3ff-f94c5910287a tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7b95c6fb6743cf9f1942a6328a1ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f8e8d61274d54bd996140a9ab38f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:37.542962 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-13f29482-a818-4a49-b3ff-f94c5910287a tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] 10.222.0.17 "GET /compute/v2.1/servers/34973378-2075-4fc5-88c2-ab65d5d9fcb8" status: 200 len: 1515 microversion: 2.1 time: 0.411350 Jul 23 21:25:37.544389 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1453/2869] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:37 2022] GET /compute/v2.1/servers/34973378-2075-4fc5-88c2-ab65d5d9fcb8 => generated 1515 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:37.551315 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-57bdcd13-4fb1-4015-b12a-a3e7a0bd09ed tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:37.555352 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-57bdcd13-4fb1-4015-b12a-a3e7a0bd09ed tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] [instance: 4085bec2-40ec-4324-b718-2c7ec388a22e] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:37.562013 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ac3b21b1-52bb-4766-9be4-1fb9385debf4 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859c1493a30d4386b74377ab2b9bc81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3efb8824be84323b6ec04b604775bd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:37.567724 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-57bdcd13-4fb1-4015-b12a-a3e7a0bd09ed tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:37.568174 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-57bdcd13-4fb1-4015-b12a-a3e7a0bd09ed tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:37.568962 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-57bdcd13-4fb1-4015-b12a-a3e7a0bd09ed tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:37.569397 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-57bdcd13-4fb1-4015-b12a-a3e7a0bd09ed tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:37.571094 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ac3b21b1-52bb-4766-9be4-1fb9385debf4 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:37.571799 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ac3b21b1-52bb-4766-9be4-1fb9385debf4 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:37.598122 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=100 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:25:37.838720 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-57bdcd13-4fb1-4015-b12a-a3e7a0bd09ed tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961e46ab94f4fffbc606485935ce64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8305585b60d54beeb2b087a37260a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:37.854770 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-57bdcd13-4fb1-4015-b12a-a3e7a0bd09ed tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] 10.222.0.17 "GET /compute/v2.1/servers/4085bec2-40ec-4324-b718-2c7ec388a22e" status: 200 len: 1324 microversion: 2.1 time: 0.309102 Jul 23 21:25:37.855370 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1454/2870] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:37 2022] GET /compute/v2.1/servers/4085bec2-40ec-4324-b718-2c7ec388a22e => generated 1324 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:37.859915 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-026a367f-32f1-4811-98e8-efbbfa2ee622 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:37.860705 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-026a367f-32f1-4811-98e8-efbbfa2ee622 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] [instance: cb3a66a8-4c84-4bb1-8b3f-0c48acec1215] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:37.879921 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-026a367f-32f1-4811-98e8-efbbfa2ee622 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:37.880579 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-026a367f-32f1-4811-98e8-efbbfa2ee622 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:37.883042 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-026a367f-32f1-4811-98e8-efbbfa2ee622 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:37.887108 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-026a367f-32f1-4811-98e8-efbbfa2ee622 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:38.095564 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ac3b21b1-52bb-4766-9be4-1fb9385debf4 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] 10.222.0.17 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4512 microversion: 2.1 time: 0.806250 Jul 23 21:25:38.107362 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1417/2871] 10.222.0.17 () {58 vars in 1172 bytes} [Sat Jul 23 21:25:37 2022] GET /compute/v2.1/servers/detail?status=active => generated 4512 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:38.118652 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-361ec843-0044-48ac-9934-63dbeccd2b51 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:38.120437 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-361ec843-0044-48ac-9934-63dbeccd2b51 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] [instance: acfc85ad-35a7-4cfd-935d-89707e3bc08c] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:38.129956 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-361ec843-0044-48ac-9934-63dbeccd2b51 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:38.130415 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-361ec843-0044-48ac-9934-63dbeccd2b51 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:38.131207 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-361ec843-0044-48ac-9934-63dbeccd2b51 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:38.131650 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-361ec843-0044-48ac-9934-63dbeccd2b51 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:38.135026 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-026a367f-32f1-4811-98e8-efbbfa2ee622 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a609c39c14343e1bc1edd4b3cd56dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116def61aba4631be91f67df63ebab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:38.147473 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-026a367f-32f1-4811-98e8-efbbfa2ee622 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] 10.222.0.17 "GET /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215" status: 200 len: 1313 microversion: 2.1 time: 0.290493 Jul 23 21:25:38.161963 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1455/2872] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:37 2022] GET /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215 => generated 1313 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:38.167100 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-8255a47f-4cb8-4bc3-ac68-dcfed775bf9c req-a5c21193-032a-4069-ad17-0d4c2fec02d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb3a66a8-4c84-4bb1-8b3f-0c48acec1215", "tag": "e77bdbdb-6452-4acc-8d23-03a2d5eb3311"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:25:38.176084 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-8255a47f-4cb8-4bc3-ac68-dcfed775bf9c req-a5c21193-032a-4069-ad17-0d4c2fec02d9 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:38.176803 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-8255a47f-4cb8-4bc3-ac68-dcfed775bf9c req-a5c21193-032a-4069-ad17-0d4c2fec02d9 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:38.188044 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-8255a47f-4cb8-4bc3-ac68-dcfed775bf9c req-a5c21193-032a-4069-ad17-0d4c2fec02d9 service nova] Creating event network-changed:e77bdbdb-6452-4acc-8d23-03a2d5eb3311 for instance cb3a66a8-4c84-4bb1-8b3f-0c48acec1215 on nch1-master-1 Jul 23 21:25:38.193218 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-8255a47f-4cb8-4bc3-ac68-dcfed775bf9c req-a5c21193-032a-4069-ad17-0d4c2fec02d9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029661 Jul 23 21:25:38.193938 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1456/2873] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:25:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:25:38.199428 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-09b76c5a-e300-4842-a88c-be54e80171dc tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:38.200432 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-09b76c5a-e300-4842-a88c-be54e80171dc tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: d303403b-5d14-443b-a6fe-f8b579d24cda] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:38.207052 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-09b76c5a-e300-4842-a88c-be54e80171dc tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:38.207595 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-09b76c5a-e300-4842-a88c-be54e80171dc tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:38.208445 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-09b76c5a-e300-4842-a88c-be54e80171dc tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:38.208952 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-09b76c5a-e300-4842-a88c-be54e80171dc tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:38.403231 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-09b76c5a-e300-4842-a88c-be54e80171dc tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:38.419543 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-09b76c5a-e300-4842-a88c-be54e80171dc tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda" status: 200 len: 1317 microversion: 2.1 time: 0.224132 Jul 23 21:25:38.420347 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1457/2874] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:38 2022] GET /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda => generated 1317 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:38.425072 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-22bdcbaf-0071-40ef-b623-78e80e61dc19 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:38.428931 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-22bdcbaf-0071-40ef-b623-78e80e61dc19 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '859c1493a30d4386b74377ab2b9bc81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3efb8824be84323b6ec04b604775bd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:38.429478 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.compute.servers [None req-22bdcbaf-0071-40ef-b623-78e80e61dc19 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Removing options 'limit' from query {{(pid=131321) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 23 21:25:38.430382 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-22bdcbaf-0071-40ef-b623-78e80e61dc19 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Searching by: {'deleted': False, 'project_id': 'b3efb8824be84323b6ec04b604775bd0'} {{(pid=131321) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 23 21:25:38.435916 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-22bdcbaf-0071-40ef-b623-78e80e61dc19 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:38.436372 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-22bdcbaf-0071-40ef-b623-78e80e61dc19 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:38.437226 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-22bdcbaf-0071-40ef-b623-78e80e61dc19 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:38.437667 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-22bdcbaf-0071-40ef-b623-78e80e61dc19 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:38.471938 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-22bdcbaf-0071-40ef-b623-78e80e61dc19 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859c1493a30d4386b74377ab2b9bc81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3efb8824be84323b6ec04b604775bd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:38.478612 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-22bdcbaf-0071-40ef-b623-78e80e61dc19 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:38.479064 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-22bdcbaf-0071-40ef-b623-78e80e61dc19 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:38.568682 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-361ec843-0044-48ac-9934-63dbeccd2b51 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7b95c6fb6743cf9f1942a6328a1ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f8e8d61274d54bd996140a9ab38f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:38.582689 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-361ec843-0044-48ac-9934-63dbeccd2b51 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] 10.222.0.17 "GET /compute/v2.1/servers/acfc85ad-35a7-4cfd-935d-89707e3bc08c" status: 200 len: 1322 microversion: 2.1 time: 0.472353 Jul 23 21:25:38.584081 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1418/2875] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:38 2022] GET /compute/v2.1/servers/acfc85ad-35a7-4cfd-935d-89707e3bc08c => generated 1322 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:38.602189 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-fc287253-de1e-40b4-9d68-5080a64b7635 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:38.603213 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-fc287253-de1e-40b4-9d68-5080a64b7635 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:38.627884 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-22bdcbaf-0071-40ef-b623-78e80e61dc19 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] 10.222.0.17 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1659 microversion: 2.1 time: 0.206352 Jul 23 21:25:38.629792 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fc287253-de1e-40b4-9d68-5080a64b7635 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:38.630705 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fc287253-de1e-40b4-9d68-5080a64b7635 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:38.631660 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fc287253-de1e-40b4-9d68-5080a64b7635 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:38.633835 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fc287253-de1e-40b4-9d68-5080a64b7635 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:38.636455 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1458/2876] 10.222.0.17 () {58 vars in 1160 bytes} [Sat Jul 23 21:25:38 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1659 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:38.659748 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-acac8ee9-e371-4ba3-b5d8-6f4886931b26 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:38.663348 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-acac8ee9-e371-4ba3-b5d8-6f4886931b26 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '859c1493a30d4386b74377ab2b9bc81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3efb8824be84323b6ec04b604775bd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:38.664122 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-acac8ee9-e371-4ba3-b5d8-6f4886931b26 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'b3efb8824be84323b6ec04b604775bd0'} {{(pid=131321) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 23 21:25:38.669797 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-acac8ee9-e371-4ba3-b5d8-6f4886931b26 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:38.670280 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-acac8ee9-e371-4ba3-b5d8-6f4886931b26 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:38.671306 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-acac8ee9-e371-4ba3-b5d8-6f4886931b26 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:38.671738 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-acac8ee9-e371-4ba3-b5d8-6f4886931b26 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:38.705212 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.multi_cell_list [None req-acac8ee9-e371-4ba3-b5d8-6f4886931b26 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=131321) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 23 21:25:38.740471 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-acac8ee9-e371-4ba3-b5d8-6f4886931b26 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] 10.222.0.17 "GET /compute/v2.1/servers?status=active" status: 200 len: 1009 microversion: 2.1 time: 0.088939 Jul 23 21:25:38.741256 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1459/2877] 10.222.0.17 () {58 vars in 1151 bytes} [Sat Jul 23 21:25:38 2022] GET /compute/v2.1/servers?status=active => generated 1009 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:38.754428 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-698a7ae5-ecc8-42ba-96cd-8f64ddf744df tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:38.757897 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-698a7ae5-ecc8-42ba-96cd-8f64ddf744df tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '859c1493a30d4386b74377ab2b9bc81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3efb8824be84323b6ec04b604775bd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:38.758369 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.compute.servers [None req-698a7ae5-ecc8-42ba-96cd-8f64ddf744df tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Removing options 'limit' from query {{(pid=131321) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 23 21:25:38.759022 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-698a7ae5-ecc8-42ba-96cd-8f64ddf744df tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Searching by: {'deleted': False, 'project_id': 'b3efb8824be84323b6ec04b604775bd0'} {{(pid=131321) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 23 21:25:38.764493 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-fc287253-de1e-40b4-9d68-5080a64b7635 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:38.769944 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-698a7ae5-ecc8-42ba-96cd-8f64ddf744df tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:38.770614 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-698a7ae5-ecc8-42ba-96cd-8f64ddf744df tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:38.771530 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-698a7ae5-ecc8-42ba-96cd-8f64ddf744df tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:38.772182 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-698a7ae5-ecc8-42ba-96cd-8f64ddf744df tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:38.774693 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-fc287253-de1e-40b4-9d68-5080a64b7635 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:38.779000 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-fc287253-de1e-40b4-9d68-5080a64b7635 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:38.780559 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-fc287253-de1e-40b4-9d68-5080a64b7635 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.194393 Jul 23 21:25:38.781663 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1419/2878] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:25:38 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:25:38.806834 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.multi_cell_list [None req-698a7ae5-ecc8-42ba-96cd-8f64ddf744df tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=131321) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 23 21:25:38.844120 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-698a7ae5-ecc8-42ba-96cd-8f64ddf744df tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] 10.222.0.17 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1009 microversion: 2.1 time: 0.093486 Jul 23 21:25:38.844721 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1460/2879] 10.222.0.17 () {58 vars in 1149 bytes} [Sat Jul 23 21:25:38 2022] GET /compute/v2.1/servers?limit=100000 => generated 1009 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:38.858230 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a9a15bc1-f961-4b5a-b0e4-1cee7c2b21f4 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:38.862541 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a9a15bc1-f961-4b5a-b0e4-1cee7c2b21f4 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '859c1493a30d4386b74377ab2b9bc81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3efb8824be84323b6ec04b604775bd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:38.863344 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a9a15bc1-f961-4b5a-b0e4-1cee7c2b21f4 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Searching by: {'deleted': False, 'project_id': 'b3efb8824be84323b6ec04b604775bd0'} {{(pid=131320) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 23 21:25:38.873786 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-3988a210-b2a5-4c72-a7db-ca90692fcb70 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:38.874592 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-3988a210-b2a5-4c72-a7db-ca90692fcb70 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] [instance: 4085bec2-40ec-4324-b718-2c7ec388a22e] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:38.884119 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a9a15bc1-f961-4b5a-b0e4-1cee7c2b21f4 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:38.885517 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a9a15bc1-f961-4b5a-b0e4-1cee7c2b21f4 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:38.888221 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a9a15bc1-f961-4b5a-b0e4-1cee7c2b21f4 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:38.890727 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a9a15bc1-f961-4b5a-b0e4-1cee7c2b21f4 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:38.896413 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3988a210-b2a5-4c72-a7db-ca90692fcb70 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:38.896840 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3988a210-b2a5-4c72-a7db-ca90692fcb70 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:38.897781 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3988a210-b2a5-4c72-a7db-ca90692fcb70 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:38.898862 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3988a210-b2a5-4c72-a7db-ca90692fcb70 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:38.933917 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.multi_cell_list [None req-a9a15bc1-f961-4b5a-b0e4-1cee7c2b21f4 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=131320) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 23 21:25:38.969471 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a9a15bc1-f961-4b5a-b0e4-1cee7c2b21f4 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] 10.222.0.17 "GET /compute/v2.1/servers" status: 200 len: 1009 microversion: 2.1 time: 0.117468 Jul 23 21:25:38.970115 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1420/2880] 10.222.0.17 () {58 vars in 1124 bytes} [Sat Jul 23 21:25:38 2022] GET /compute/v2.1/servers => generated 1009 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:38.981538 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c96efa74-4de8-4533-ac7a-0df2ff5e65ee tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:38.985231 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c96efa74-4de8-4533-ac7a-0df2ff5e65ee tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '859c1493a30d4386b74377ab2b9bc81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3efb8824be84323b6ec04b604775bd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:38.985925 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c96efa74-4de8-4533-ac7a-0df2ff5e65ee tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'b3efb8824be84323b6ec04b604775bd0'} {{(pid=131320) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 23 21:25:38.999021 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c96efa74-4de8-4533-ac7a-0df2ff5e65ee tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:38.999866 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c96efa74-4de8-4533-ac7a-0df2ff5e65ee tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:39.000970 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c96efa74-4de8-4533-ac7a-0df2ff5e65ee tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:39.001596 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c96efa74-4de8-4533-ac7a-0df2ff5e65ee tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:39.069549 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-3988a210-b2a5-4c72-a7db-ca90692fcb70 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961e46ab94f4fffbc606485935ce64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8305585b60d54beeb2b087a37260a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:39.079737 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-3988a210-b2a5-4c72-a7db-ca90692fcb70 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] 10.222.0.17 "GET /compute/v2.1/servers/4085bec2-40ec-4324-b718-2c7ec388a22e" status: 200 len: 1324 microversion: 2.1 time: 0.211391 Jul 23 21:25:39.080885 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1461/2881] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:38 2022] GET /compute/v2.1/servers/4085bec2-40ec-4324-b718-2c7ec388a22e => generated 1324 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:25:39.095946 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.multi_cell_list [None req-c96efa74-4de8-4533-ac7a-0df2ff5e65ee tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131320) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 23 21:25:39.158348 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c96efa74-4de8-4533-ac7a-0df2ff5e65ee tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] 10.222.0.17 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 345 microversion: 2.1 time: 0.180283 Jul 23 21:25:39.159500 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1421/2882] 10.222.0.17 () {58 vars in 1145 bytes} [Sat Jul 23 21:25:38 2022] GET /compute/v2.1/servers?flavor=451 => generated 345 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:25:39.165927 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-25015935-ca71-442e-9001-cabe6769fa83 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:39.167211 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-25015935-ca71-442e-9001-cabe6769fa83 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] [instance: cb3a66a8-4c84-4bb1-8b3f-0c48acec1215] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:39.173757 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-adbc618b-b426-42ed-a478-0155f41bc767 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:39.174959 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-25015935-ca71-442e-9001-cabe6769fa83 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:39.174959 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-25015935-ca71-442e-9001-cabe6769fa83 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:39.175639 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-25015935-ca71-442e-9001-cabe6769fa83 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:39.176221 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-25015935-ca71-442e-9001-cabe6769fa83 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:39.177270 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-adbc618b-b426-42ed-a478-0155f41bc767 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '859c1493a30d4386b74377ab2b9bc81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3efb8824be84323b6ec04b604775bd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:39.177788 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.compute.servers [None req-adbc618b-b426-42ed-a478-0155f41bc767 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Removing options 'limit' from query {{(pid=131320) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 23 21:25:39.178667 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-adbc618b-b426-42ed-a478-0155f41bc767 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Searching by: {'deleted': False, 'project_id': 'b3efb8824be84323b6ec04b604775bd0'} {{(pid=131320) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 23 21:25:39.184153 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-adbc618b-b426-42ed-a478-0155f41bc767 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:39.184618 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-adbc618b-b426-42ed-a478-0155f41bc767 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:39.185890 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-adbc618b-b426-42ed-a478-0155f41bc767 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:39.185890 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-adbc618b-b426-42ed-a478-0155f41bc767 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:39.215132 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-adbc618b-b426-42ed-a478-0155f41bc767 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] 10.222.0.17 "GET /compute/v2.1/servers?limit=1" status: 200 len: 484 microversion: 2.1 time: 0.045209 Jul 23 21:25:39.222068 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1422/2883] 10.222.0.17 () {58 vars in 1139 bytes} [Sat Jul 23 21:25:39 2022] GET /compute/v2.1/servers?limit=1 => generated 484 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:25:39.227586 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-161c4b64-6856-47cf-bb61-069bd37c8caa tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:39.231604 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-161c4b64-6856-47cf-bb61-069bd37c8caa tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '859c1493a30d4386b74377ab2b9bc81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3efb8824be84323b6ec04b604775bd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:39.232267 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-161c4b64-6856-47cf-bb61-069bd37c8caa tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-649361757', 'deleted': False, 'project_id': 'b3efb8824be84323b6ec04b604775bd0'} {{(pid=131320) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 23 21:25:39.247481 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-161c4b64-6856-47cf-bb61-069bd37c8caa tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:39.248232 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-161c4b64-6856-47cf-bb61-069bd37c8caa tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:39.249659 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-161c4b64-6856-47cf-bb61-069bd37c8caa tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:39.250452 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-161c4b64-6856-47cf-bb61-069bd37c8caa tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:39.337943 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-25015935-ca71-442e-9001-cabe6769fa83 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a609c39c14343e1bc1edd4b3cd56dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116def61aba4631be91f67df63ebab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:39.348637 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-25015935-ca71-442e-9001-cabe6769fa83 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] 10.222.0.17 "GET /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215" status: 200 len: 1313 microversion: 2.1 time: 0.187141 Jul 23 21:25:39.350087 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1462/2884] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:39 2022] GET /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215 => generated 1313 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:39.411290 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-9994b55d-6bde-4bce-bff3-ae2cf5dbb7a0 req-980bafb5-b3c7-4e62-bc17-2ea8e5ea7f77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d303403b-5d14-443b-a6fe-f8b579d24cda", "tag": "01c1a8f9-053f-41ab-abe7-cf16d3d4127c"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:25:39.414392 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.multi_cell_list [None req-161c4b64-6856-47cf-bb61-069bd37c8caa tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131320) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 23 21:25:39.423610 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-9994b55d-6bde-4bce-bff3-ae2cf5dbb7a0 req-980bafb5-b3c7-4e62-bc17-2ea8e5ea7f77 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:39.424419 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-9994b55d-6bde-4bce-bff3-ae2cf5dbb7a0 req-980bafb5-b3c7-4e62-bc17-2ea8e5ea7f77 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:39.454526 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-9994b55d-6bde-4bce-bff3-ae2cf5dbb7a0 req-980bafb5-b3c7-4e62-bc17-2ea8e5ea7f77 service nova] Creating event network-changed:01c1a8f9-053f-41ab-abe7-cf16d3d4127c for instance d303403b-5d14-443b-a6fe-f8b579d24cda on nch1-master-1 Jul 23 21:25:39.466410 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-9994b55d-6bde-4bce-bff3-ae2cf5dbb7a0 req-980bafb5-b3c7-4e62-bc17-2ea8e5ea7f77 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055377 Jul 23 21:25:39.467680 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1463/2885] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:25:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:25:39.477343 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ec323c8d-bb35-49c7-bc65-1c2740022631 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:39.478660 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-ec323c8d-bb35-49c7-bc65-1c2740022631 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: d303403b-5d14-443b-a6fe-f8b579d24cda] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:39.505660 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-161c4b64-6856-47cf-bb61-069bd37c8caa tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] 10.222.0.17 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-649361757" status: 200 len: 345 microversion: 2.1 time: 0.281756 Jul 23 21:25:39.506337 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1423/2886] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Jul 23 21:25:39 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-649361757 => generated 345 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:25:39.517928 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ec323c8d-bb35-49c7-bc65-1c2740022631 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:39.518691 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ec323c8d-bb35-49c7-bc65-1c2740022631 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:39.520023 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ec323c8d-bb35-49c7-bc65-1c2740022631 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:39.520764 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ec323c8d-bb35-49c7-bc65-1c2740022631 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:39.529727 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3f86e20b-5bc2-4e3d-b8a4-f2bee05da275 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:25:39.548515 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3f86e20b-5bc2-4e3d-b8a4-f2bee05da275 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:39.548973 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3f86e20b-5bc2-4e3d-b8a4-f2bee05da275 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:39.575499 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-3f86e20b-5bc2-4e3d-b8a4-f2bee05da275 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] [instance: 35d0d067-4f24-45a4-b03c-32346b764d3c] Going to try to stop instance {{(pid=131320) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 23 21:25:39.668536 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-3f86e20b-5bc2-4e3d-b8a4-f2bee05da275 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] 10.222.0.17 "POST /compute/v2.1/servers/35d0d067-4f24-45a4-b03c-32346b764d3c/action" status: 202 len: 0 microversion: 2.1 time: 0.142864 Jul 23 21:25:39.676062 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1424/2887] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:25:39 2022] POST /compute/v2.1/servers/35d0d067-4f24-45a4-b03c-32346b764d3c/action => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:25:39.686648 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-79c8331a-176c-4202-9d44-4cebf6aaf32c tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:39.687702 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-79c8331a-176c-4202-9d44-4cebf6aaf32c tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] [instance: acfc85ad-35a7-4cfd-935d-89707e3bc08c] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:39.699701 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-79c8331a-176c-4202-9d44-4cebf6aaf32c tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:39.699897 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-79c8331a-176c-4202-9d44-4cebf6aaf32c tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:39.700917 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-79c8331a-176c-4202-9d44-4cebf6aaf32c tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:39.701550 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-79c8331a-176c-4202-9d44-4cebf6aaf32c tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:39.752450 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ec323c8d-bb35-49c7-bc65-1c2740022631 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:39.763473 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-ec323c8d-bb35-49c7-bc65-1c2740022631 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda" status: 200 len: 1317 microversion: 2.1 time: 0.294244 Jul 23 21:25:39.766173 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1464/2888] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:39 2022] GET /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda => generated 1317 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:39.771287 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-90c5241f-d1ec-4d85-969f-15b71192e7bf tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:39.773212 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-90c5241f-d1ec-4d85-969f-15b71192e7bf tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] [instance: 35d0d067-4f24-45a4-b03c-32346b764d3c] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:39.780028 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-90c5241f-d1ec-4d85-969f-15b71192e7bf tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:39.780750 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-90c5241f-d1ec-4d85-969f-15b71192e7bf tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:39.782639 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-90c5241f-d1ec-4d85-969f-15b71192e7bf tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:39.783445 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-90c5241f-d1ec-4d85-969f-15b71192e7bf tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:39.987785 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-90c5241f-d1ec-4d85-969f-15b71192e7bf tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859c1493a30d4386b74377ab2b9bc81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3efb8824be84323b6ec04b604775bd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:40.005406 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-90c5241f-d1ec-4d85-969f-15b71192e7bf tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] 10.222.0.17 "GET /compute/v2.1/servers/35d0d067-4f24-45a4-b03c-32346b764d3c" status: 200 len: 1519 microversion: 2.1 time: 0.237811 Jul 23 21:25:40.006114 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1465/2889] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:39 2022] GET /compute/v2.1/servers/35d0d067-4f24-45a4-b03c-32346b764d3c => generated 1519 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:40.011318 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-b3bb4bca-4524-40f7-a31b-9d9126a2e556 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:40.012177 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-b3bb4bca-4524-40f7-a31b-9d9126a2e556 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:40.014245 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:25:40.020343 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b3bb4bca-4524-40f7-a31b-9d9126a2e556 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:40.020854 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b3bb4bca-4524-40f7-a31b-9d9126a2e556 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:40.021723 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b3bb4bca-4524-40f7-a31b-9d9126a2e556 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:40.022247 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b3bb4bca-4524-40f7-a31b-9d9126a2e556 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:40.025943 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-79c8331a-176c-4202-9d44-4cebf6aaf32c tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7b95c6fb6743cf9f1942a6328a1ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f8e8d61274d54bd996140a9ab38f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:40.034526 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-79c8331a-176c-4202-9d44-4cebf6aaf32c tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] 10.222.0.17 "GET /compute/v2.1/servers/acfc85ad-35a7-4cfd-935d-89707e3bc08c" status: 200 len: 1515 microversion: 2.1 time: 0.354923 Jul 23 21:25:40.035334 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1425/2890] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:39 2022] GET /compute/v2.1/servers/acfc85ad-35a7-4cfd-935d-89707e3bc08c => generated 1515 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:40.050835 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c27c9739-ef61-45f0-bd2d-c899668f5d01 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:40.051331 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c27c9739-ef61-45f0-bd2d-c899668f5d01 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] [instance: acfc85ad-35a7-4cfd-935d-89707e3bc08c] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:40.058559 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c27c9739-ef61-45f0-bd2d-c899668f5d01 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:40.064208 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c27c9739-ef61-45f0-bd2d-c899668f5d01 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:40.065035 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c27c9739-ef61-45f0-bd2d-c899668f5d01 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:40.065481 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c27c9739-ef61-45f0-bd2d-c899668f5d01 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:40.093115 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-b3bb4bca-4524-40f7-a31b-9d9126a2e556 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:40.093903 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c27c9739-ef61-45f0-bd2d-c899668f5d01 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] [instance: acfc85ad-35a7-4cfd-935d-89707e3bc08c] Going to try to terminate instance {{(pid=131320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:25:40.103257 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-b3bb4bca-4524-40f7-a31b-9d9126a2e556 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:40.104751 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-b3bb4bca-4524-40f7-a31b-9d9126a2e556 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:40.106073 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-b3bb4bca-4524-40f7-a31b-9d9126a2e556 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.098702 Jul 23 21:25:40.106834 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1466/2891] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:25:40 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:25:40.111511 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-1e54b43c-2202-485f-9e25-bb2d67653dac tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:40.112111 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-1e54b43c-2202-485f-9e25-bb2d67653dac tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] [instance: 4085bec2-40ec-4324-b718-2c7ec388a22e] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:40.118911 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1e54b43c-2202-485f-9e25-bb2d67653dac tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:40.119359 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1e54b43c-2202-485f-9e25-bb2d67653dac tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:40.120262 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1e54b43c-2202-485f-9e25-bb2d67653dac tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:40.120702 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1e54b43c-2202-485f-9e25-bb2d67653dac tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:40.193156 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c27c9739-ef61-45f0-bd2d-c899668f5d01 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] 10.222.0.17 "DELETE /compute/v2.1/servers/acfc85ad-35a7-4cfd-935d-89707e3bc08c" status: 204 len: 0 microversion: 2.1 time: 0.145573 Jul 23 21:25:40.196970 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1426/2892] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:25:40 2022] DELETE /compute/v2.1/servers/acfc85ad-35a7-4cfd-935d-89707e3bc08c => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 23 21:25:40.213030 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9e654896-beb0-4854-8366-d243d3353474 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:40.213749 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-9e654896-beb0-4854-8366-d243d3353474 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] [instance: acfc85ad-35a7-4cfd-935d-89707e3bc08c] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:40.222197 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9e654896-beb0-4854-8366-d243d3353474 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:40.222650 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9e654896-beb0-4854-8366-d243d3353474 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:40.223442 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9e654896-beb0-4854-8366-d243d3353474 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:40.223863 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9e654896-beb0-4854-8366-d243d3353474 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:40.268079 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-1e54b43c-2202-485f-9e25-bb2d67653dac tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961e46ab94f4fffbc606485935ce64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8305585b60d54beeb2b087a37260a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:40.277246 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-1e54b43c-2202-485f-9e25-bb2d67653dac tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] 10.222.0.17 "GET /compute/v2.1/servers/4085bec2-40ec-4324-b718-2c7ec388a22e" status: 200 len: 1324 microversion: 2.1 time: 0.169466 Jul 23 21:25:40.278067 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1467/2893] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:40 2022] GET /compute/v2.1/servers/4085bec2-40ec-4324-b718-2c7ec388a22e => generated 1324 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:40.379585 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a6490df2-11bb-49e2-b14e-a115927ae191 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:40.380754 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-a6490df2-11bb-49e2-b14e-a115927ae191 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] [instance: cb3a66a8-4c84-4bb1-8b3f-0c48acec1215] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:40.386936 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a6490df2-11bb-49e2-b14e-a115927ae191 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:40.387824 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a6490df2-11bb-49e2-b14e-a115927ae191 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:40.388617 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a6490df2-11bb-49e2-b14e-a115927ae191 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:40.389054 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a6490df2-11bb-49e2-b14e-a115927ae191 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:40.432541 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-9e654896-beb0-4854-8366-d243d3353474 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7b95c6fb6743cf9f1942a6328a1ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f8e8d61274d54bd996140a9ab38f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:40.444734 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9e654896-beb0-4854-8366-d243d3353474 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] 10.222.0.17 "GET /compute/v2.1/servers/acfc85ad-35a7-4cfd-935d-89707e3bc08c" status: 200 len: 1521 microversion: 2.1 time: 0.245551 Jul 23 21:25:40.445613 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1427/2894] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:40 2022] GET /compute/v2.1/servers/acfc85ad-35a7-4cfd-935d-89707e3bc08c => generated 1521 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:25:40.553059 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-a6490df2-11bb-49e2-b14e-a115927ae191 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a609c39c14343e1bc1edd4b3cd56dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116def61aba4631be91f67df63ebab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:40.569153 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-a6490df2-11bb-49e2-b14e-a115927ae191 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] 10.222.0.17 "GET /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215" status: 200 len: 1313 microversion: 2.1 time: 0.206142 Jul 23 21:25:40.582452 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1468/2895] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:40 2022] GET /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215 => generated 1313 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:40.805250 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ff5619f7-db77-4249-901a-4481f0d8b3bb tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:40.808569 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ff5619f7-db77-4249-901a-4481f0d8b3bb tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: d303403b-5d14-443b-a6fe-f8b579d24cda] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:40.845815 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ff5619f7-db77-4249-901a-4481f0d8b3bb tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:40.848235 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ff5619f7-db77-4249-901a-4481f0d8b3bb tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:40.862571 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ff5619f7-db77-4249-901a-4481f0d8b3bb tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:40.862571 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ff5619f7-db77-4249-901a-4481f0d8b3bb tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:41.028388 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-0d469219-5caa-4b43-9810-9d11fa85d227 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:41.029760 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-0d469219-5caa-4b43-9810-9d11fa85d227 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] [instance: 35d0d067-4f24-45a4-b03c-32346b764d3c] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:41.041344 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0d469219-5caa-4b43-9810-9d11fa85d227 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:41.042145 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0d469219-5caa-4b43-9810-9d11fa85d227 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:41.043988 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0d469219-5caa-4b43-9810-9d11fa85d227 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:41.044683 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0d469219-5caa-4b43-9810-9d11fa85d227 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:41.254316 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-0d469219-5caa-4b43-9810-9d11fa85d227 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859c1493a30d4386b74377ab2b9bc81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3efb8824be84323b6ec04b604775bd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:41.263608 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-0d469219-5caa-4b43-9810-9d11fa85d227 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] 10.222.0.17 "GET /compute/v2.1/servers/35d0d067-4f24-45a4-b03c-32346b764d3c" status: 200 len: 1519 microversion: 2.1 time: 0.244081 Jul 23 21:25:41.264789 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1469/2896] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:41 2022] GET /compute/v2.1/servers/35d0d067-4f24-45a4-b03c-32346b764d3c => generated 1519 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:41.270979 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-768a9492-2d94-4b64-b63b-75440dcd36ef tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:41.272452 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-768a9492-2d94-4b64-b63b-75440dcd36ef tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:41.279617 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-768a9492-2d94-4b64-b63b-75440dcd36ef tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:41.280079 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-768a9492-2d94-4b64-b63b-75440dcd36ef tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:41.281016 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-768a9492-2d94-4b64-b63b-75440dcd36ef tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:41.281462 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-768a9492-2d94-4b64-b63b-75440dcd36ef tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:41.344858 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-768a9492-2d94-4b64-b63b-75440dcd36ef tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:41.353253 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ff5619f7-db77-4249-901a-4481f0d8b3bb tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:41.354398 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-768a9492-2d94-4b64-b63b-75440dcd36ef tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:41.355912 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-768a9492-2d94-4b64-b63b-75440dcd36ef tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:41.357066 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-768a9492-2d94-4b64-b63b-75440dcd36ef tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.090942 Jul 23 21:25:41.357905 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1470/2897] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:25:41 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:25:41.365154 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-b31f6d9e-d1c8-42e9-b155-85c3650609c6 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:41.365585 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ff5619f7-db77-4249-901a-4481f0d8b3bb tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda" status: 200 len: 1317 microversion: 2.1 time: 0.588515 Jul 23 21:25:41.365751 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-b31f6d9e-d1c8-42e9-b155-85c3650609c6 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] [instance: 4085bec2-40ec-4324-b718-2c7ec388a22e] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:41.369195 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1428/2898] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:40 2022] GET /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda => generated 1317 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:41.372571 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b31f6d9e-d1c8-42e9-b155-85c3650609c6 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:41.373013 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b31f6d9e-d1c8-42e9-b155-85c3650609c6 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:41.373781 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b31f6d9e-d1c8-42e9-b155-85c3650609c6 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:41.374263 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b31f6d9e-d1c8-42e9-b155-85c3650609c6 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:41.461967 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-827f787b-1166-4bfb-984b-5436850a3a28 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:41.464220 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-827f787b-1166-4bfb-984b-5436850a3a28 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] [instance: acfc85ad-35a7-4cfd-935d-89707e3bc08c] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:41.472857 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-827f787b-1166-4bfb-984b-5436850a3a28 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:41.473324 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-827f787b-1166-4bfb-984b-5436850a3a28 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:41.474453 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-827f787b-1166-4bfb-984b-5436850a3a28 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:41.475098 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-827f787b-1166-4bfb-984b-5436850a3a28 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:41.540769 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-b31f6d9e-d1c8-42e9-b155-85c3650609c6 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961e46ab94f4fffbc606485935ce64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8305585b60d54beeb2b087a37260a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:41.550331 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-b31f6d9e-d1c8-42e9-b155-85c3650609c6 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] 10.222.0.17 "GET /compute/v2.1/servers/4085bec2-40ec-4324-b718-2c7ec388a22e" status: 200 len: 1324 microversion: 2.1 time: 0.191431 Jul 23 21:25:41.552530 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1471/2899] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:41 2022] GET /compute/v2.1/servers/4085bec2-40ec-4324-b718-2c7ec388a22e => generated 1324 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:41.586581 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-97f63dcd-89dc-427f-baea-2be7c7702bb6 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:41.587985 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-97f63dcd-89dc-427f-baea-2be7c7702bb6 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] [instance: cb3a66a8-4c84-4bb1-8b3f-0c48acec1215] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:41.594906 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-97f63dcd-89dc-427f-baea-2be7c7702bb6 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:41.595477 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-97f63dcd-89dc-427f-baea-2be7c7702bb6 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:41.596338 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-97f63dcd-89dc-427f-baea-2be7c7702bb6 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:41.596966 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-97f63dcd-89dc-427f-baea-2be7c7702bb6 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:41.601564 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=100 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:25:41.792597 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-97f63dcd-89dc-427f-baea-2be7c7702bb6 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a609c39c14343e1bc1edd4b3cd56dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116def61aba4631be91f67df63ebab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:41.801847 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-97f63dcd-89dc-427f-baea-2be7c7702bb6 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] 10.222.0.17 "GET /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215" status: 200 len: 1313 microversion: 2.1 time: 0.219537 Jul 23 21:25:41.802772 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1472/2900] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:41 2022] GET /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215 => generated 1313 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:25:41.845662 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-827f787b-1166-4bfb-984b-5436850a3a28 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7b95c6fb6743cf9f1942a6328a1ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f8e8d61274d54bd996140a9ab38f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:41.857566 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-827f787b-1166-4bfb-984b-5436850a3a28 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] 10.222.0.17 "GET /compute/v2.1/servers/acfc85ad-35a7-4cfd-935d-89707e3bc08c" status: 200 len: 1521 microversion: 2.1 time: 0.399615 Jul 23 21:25:41.858164 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1429/2901] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:41 2022] GET /compute/v2.1/servers/acfc85ad-35a7-4cfd-935d-89707e3bc08c => generated 1521 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:25:42.282020 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-2a0d2520-9b82-4ac2-bb70-0039954093b4 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:42.282636 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-2a0d2520-9b82-4ac2-bb70-0039954093b4 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] [instance: 35d0d067-4f24-45a4-b03c-32346b764d3c] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:42.293122 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2a0d2520-9b82-4ac2-bb70-0039954093b4 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:42.294241 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2a0d2520-9b82-4ac2-bb70-0039954093b4 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:42.295819 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2a0d2520-9b82-4ac2-bb70-0039954093b4 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:42.296510 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2a0d2520-9b82-4ac2-bb70-0039954093b4 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:42.378817 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-91cb3af8-8f6c-4cfb-8493-e76f79a5bdd0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:42.380041 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-91cb3af8-8f6c-4cfb-8493-e76f79a5bdd0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:42.392601 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-91cb3af8-8f6c-4cfb-8493-e76f79a5bdd0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:42.395625 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-91cb3af8-8f6c-4cfb-8493-e76f79a5bdd0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:42.398158 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-91cb3af8-8f6c-4cfb-8493-e76f79a5bdd0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:42.398797 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-91cb3af8-8f6c-4cfb-8493-e76f79a5bdd0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:42.407000 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:25:42.471409 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-2a0d2520-9b82-4ac2-bb70-0039954093b4 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859c1493a30d4386b74377ab2b9bc81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3efb8824be84323b6ec04b604775bd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:42.481454 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-2a0d2520-9b82-4ac2-bb70-0039954093b4 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] 10.222.0.17 "GET /compute/v2.1/servers/35d0d067-4f24-45a4-b03c-32346b764d3c" status: 200 len: 1519 microversion: 2.1 time: 0.204723 Jul 23 21:25:42.482910 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1473/2902] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:42 2022] GET /compute/v2.1/servers/35d0d067-4f24-45a4-b03c-32346b764d3c => generated 1519 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:42.488822 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-10f3ba27-139e-49c9-9218-489da4ba2608 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:42.489429 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-10f3ba27-139e-49c9-9218-489da4ba2608 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: d303403b-5d14-443b-a6fe-f8b579d24cda] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:42.499618 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-10f3ba27-139e-49c9-9218-489da4ba2608 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:42.500386 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-10f3ba27-139e-49c9-9218-489da4ba2608 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:42.501332 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-10f3ba27-139e-49c9-9218-489da4ba2608 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:42.501778 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-10f3ba27-139e-49c9-9218-489da4ba2608 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:42.563161 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-91cb3af8-8f6c-4cfb-8493-e76f79a5bdd0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:42.581391 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-91cb3af8-8f6c-4cfb-8493-e76f79a5bdd0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:42.584182 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-91cb3af8-8f6c-4cfb-8493-e76f79a5bdd0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:42.590009 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-91cb3af8-8f6c-4cfb-8493-e76f79a5bdd0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.216689 Jul 23 21:25:42.590839 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1430/2903] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:25:42 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:25:42.604423 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-307e440d-e262-4353-aef2-86f8a5e8cd77 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:42.606754 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-307e440d-e262-4353-aef2-86f8a5e8cd77 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] [instance: 4085bec2-40ec-4324-b718-2c7ec388a22e] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:42.624418 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-307e440d-e262-4353-aef2-86f8a5e8cd77 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:42.624898 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-307e440d-e262-4353-aef2-86f8a5e8cd77 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:42.628193 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-307e440d-e262-4353-aef2-86f8a5e8cd77 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:42.628710 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-307e440d-e262-4353-aef2-86f8a5e8cd77 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:42.968213 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-307e440d-e262-4353-aef2-86f8a5e8cd77 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961e46ab94f4fffbc606485935ce64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8305585b60d54beeb2b087a37260a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:42.980252 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-307e440d-e262-4353-aef2-86f8a5e8cd77 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] 10.222.0.17 "GET /compute/v2.1/servers/4085bec2-40ec-4324-b718-2c7ec388a22e" status: 200 len: 1324 microversion: 2.1 time: 0.387358 Jul 23 21:25:42.980777 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1431/2904] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:42 2022] GET /compute/v2.1/servers/4085bec2-40ec-4324-b718-2c7ec388a22e => generated 1324 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:42.985787 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-05719317-4bfa-4fe8-b8c4-349026ecf4ff req-7dc6e8fd-6cad-4b4d-922b-311dcdb4a16b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb3a66a8-4c84-4bb1-8b3f-0c48acec1215", "name": "network-vif-plugged", "status": "completed", "tag": "e77bdbdb-6452-4acc-8d23-03a2d5eb3311"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:25:43.005992 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-05719317-4bfa-4fe8-b8c4-349026ecf4ff req-7dc6e8fd-6cad-4b4d-922b-311dcdb4a16b service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:43.006534 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-05719317-4bfa-4fe8-b8c4-349026ecf4ff req-7dc6e8fd-6cad-4b4d-922b-311dcdb4a16b service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:43.018756 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-05719317-4bfa-4fe8-b8c4-349026ecf4ff req-7dc6e8fd-6cad-4b4d-922b-311dcdb4a16b service nova] Creating event network-vif-plugged:e77bdbdb-6452-4acc-8d23-03a2d5eb3311 for instance cb3a66a8-4c84-4bb1-8b3f-0c48acec1215 on nch1-master-1 Jul 23 21:25:43.023935 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-05719317-4bfa-4fe8-b8c4-349026ecf4ff req-7dc6e8fd-6cad-4b4d-922b-311dcdb4a16b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041788 Jul 23 21:25:43.025136 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1432/2905] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:25:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:25:43.033482 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2c707beb-95a4-4e1d-9d35-05943aed43d5 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:43.034516 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-2c707beb-95a4-4e1d-9d35-05943aed43d5 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] [instance: cb3a66a8-4c84-4bb1-8b3f-0c48acec1215] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:43.043549 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2c707beb-95a4-4e1d-9d35-05943aed43d5 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:43.044984 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2c707beb-95a4-4e1d-9d35-05943aed43d5 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:43.046066 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2c707beb-95a4-4e1d-9d35-05943aed43d5 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:43.046723 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2c707beb-95a4-4e1d-9d35-05943aed43d5 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:43.195700 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-10f3ba27-139e-49c9-9218-489da4ba2608 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:43.206732 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-10f3ba27-139e-49c9-9218-489da4ba2608 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda" status: 200 len: 1317 microversion: 2.1 time: 0.720395 Jul 23 21:25:43.208033 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1474/2906] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:42 2022] GET /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda => generated 1317 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:43.216947 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-9d75d8c8-78cf-4a82-b46d-c4855a80f016 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:43.217891 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-9d75d8c8-78cf-4a82-b46d-c4855a80f016 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] [instance: acfc85ad-35a7-4cfd-935d-89707e3bc08c] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:43.231898 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9d75d8c8-78cf-4a82-b46d-c4855a80f016 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:43.232205 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9d75d8c8-78cf-4a82-b46d-c4855a80f016 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:43.233072 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9d75d8c8-78cf-4a82-b46d-c4855a80f016 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:43.233660 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9d75d8c8-78cf-4a82-b46d-c4855a80f016 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:43.297992 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-2c707beb-95a4-4e1d-9d35-05943aed43d5 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a609c39c14343e1bc1edd4b3cd56dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116def61aba4631be91f67df63ebab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:43.312000 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2c707beb-95a4-4e1d-9d35-05943aed43d5 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] 10.222.0.17 "GET /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215" status: 200 len: 1313 microversion: 2.1 time: 0.285051 Jul 23 21:25:43.322124 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1433/2907] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:43 2022] GET /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215 => generated 1313 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:43.327060 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-cb2c3e8a-4a04-40ac-b0bc-4f2dd67ddd8e req-a35640ca-596d-4cee-afa8-e42625a5960c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acfc85ad-35a7-4cfd-935d-89707e3bc08c", "name": "network-vif-deleted", "tag": "ec455c66-6e36-401f-999f-8bf7a293217a"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:25:43.353899 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-cb2c3e8a-4a04-40ac-b0bc-4f2dd67ddd8e req-a35640ca-596d-4cee-afa8-e42625a5960c service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:43.354366 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-cb2c3e8a-4a04-40ac-b0bc-4f2dd67ddd8e req-a35640ca-596d-4cee-afa8-e42625a5960c service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:43.365417 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-9d75d8c8-78cf-4a82-b46d-c4855a80f016 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7b95c6fb6743cf9f1942a6328a1ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f8e8d61274d54bd996140a9ab38f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:43.374905 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-cb2c3e8a-4a04-40ac-b0bc-4f2dd67ddd8e req-a35640ca-596d-4cee-afa8-e42625a5960c service nova] Creating event network-vif-deleted:ec455c66-6e36-401f-999f-8bf7a293217a for instance acfc85ad-35a7-4cfd-935d-89707e3bc08c on nch2-master-1 Jul 23 21:25:43.377531 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-9d75d8c8-78cf-4a82-b46d-c4855a80f016 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] 10.222.0.17 "GET /compute/v2.1/servers/acfc85ad-35a7-4cfd-935d-89707e3bc08c" status: 200 len: 1479 microversion: 2.1 time: 0.167516 Jul 23 21:25:43.378163 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1475/2908] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:43 2022] GET /compute/v2.1/servers/acfc85ad-35a7-4cfd-935d-89707e3bc08c => generated 1479 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:43.394532 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-cb2c3e8a-4a04-40ac-b0bc-4f2dd67ddd8e req-a35640ca-596d-4cee-afa8-e42625a5960c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071078 Jul 23 21:25:43.395245 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1434/2909] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:25:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:25:43.500309 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-25a8e091-dae1-47fa-9140-be48f186b7ce tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:43.501807 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-25a8e091-dae1-47fa-9140-be48f186b7ce tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] [instance: 35d0d067-4f24-45a4-b03c-32346b764d3c] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:43.510450 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-25a8e091-dae1-47fa-9140-be48f186b7ce tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:43.511577 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-25a8e091-dae1-47fa-9140-be48f186b7ce tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:43.512593 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-25a8e091-dae1-47fa-9140-be48f186b7ce tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:43.513256 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-25a8e091-dae1-47fa-9140-be48f186b7ce tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:43.610222 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c2c3b319-3b46-4095-b629-dca4fa4943fb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:43.610921 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c2c3b319-3b46-4095-b629-dca4fa4943fb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:43.618587 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c2c3b319-3b46-4095-b629-dca4fa4943fb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:43.619011 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c2c3b319-3b46-4095-b629-dca4fa4943fb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:43.619882 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c2c3b319-3b46-4095-b629-dca4fa4943fb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:43.620316 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c2c3b319-3b46-4095-b629-dca4fa4943fb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:43.702021 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c2c3b319-3b46-4095-b629-dca4fa4943fb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:43.723714 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c2c3b319-3b46-4095-b629-dca4fa4943fb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:43.726290 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c2c3b319-3b46-4095-b629-dca4fa4943fb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:43.727987 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c2c3b319-3b46-4095-b629-dca4fa4943fb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.122998 Jul 23 21:25:43.729198 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1435/2910] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:25:43 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:25:43.735004 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-25a8e091-dae1-47fa-9140-be48f186b7ce tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859c1493a30d4386b74377ab2b9bc81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3efb8824be84323b6ec04b604775bd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:43.744677 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-25a8e091-dae1-47fa-9140-be48f186b7ce tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] 10.222.0.17 "GET /compute/v2.1/servers/35d0d067-4f24-45a4-b03c-32346b764d3c" status: 200 len: 1519 microversion: 2.1 time: 0.249699 Jul 23 21:25:43.746742 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1476/2911] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:43 2022] GET /compute/v2.1/servers/35d0d067-4f24-45a4-b03c-32346b764d3c => generated 1519 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:43.997672 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-fb01c467-8e37-45a9-86c4-69abc6863b34 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:43.998330 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-fb01c467-8e37-45a9-86c4-69abc6863b34 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] [instance: 4085bec2-40ec-4324-b718-2c7ec388a22e] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:44.008610 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fb01c467-8e37-45a9-86c4-69abc6863b34 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:44.009189 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fb01c467-8e37-45a9-86c4-69abc6863b34 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:44.011447 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fb01c467-8e37-45a9-86c4-69abc6863b34 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:44.012688 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fb01c467-8e37-45a9-86c4-69abc6863b34 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:44.224775 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d334872d-52c3-4bc9-b470-1a1bc01528f4 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:44.225484 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-d334872d-52c3-4bc9-b470-1a1bc01528f4 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: d303403b-5d14-443b-a6fe-f8b579d24cda] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:44.232101 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d334872d-52c3-4bc9-b470-1a1bc01528f4 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:44.232612 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d334872d-52c3-4bc9-b470-1a1bc01528f4 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:44.233427 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d334872d-52c3-4bc9-b470-1a1bc01528f4 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:44.233900 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d334872d-52c3-4bc9-b470-1a1bc01528f4 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:44.315035 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-fb01c467-8e37-45a9-86c4-69abc6863b34 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961e46ab94f4fffbc606485935ce64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8305585b60d54beeb2b087a37260a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:44.325040 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-fb01c467-8e37-45a9-86c4-69abc6863b34 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] 10.222.0.17 "GET /compute/v2.1/servers/4085bec2-40ec-4324-b718-2c7ec388a22e" status: 200 len: 1324 microversion: 2.1 time: 0.331364 Jul 23 21:25:44.335360 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1436/2912] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:43 2022] GET /compute/v2.1/servers/4085bec2-40ec-4324-b718-2c7ec388a22e => generated 1324 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:44.340614 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-205507f3-ec25-4edf-bff1-6bf0ddcd9161 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:44.341518 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-205507f3-ec25-4edf-bff1-6bf0ddcd9161 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] [instance: cb3a66a8-4c84-4bb1-8b3f-0c48acec1215] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:44.347861 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-205507f3-ec25-4edf-bff1-6bf0ddcd9161 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:44.348609 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-205507f3-ec25-4edf-bff1-6bf0ddcd9161 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:44.349635 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-205507f3-ec25-4edf-bff1-6bf0ddcd9161 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:44.350307 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-205507f3-ec25-4edf-bff1-6bf0ddcd9161 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:44.404273 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-d334872d-52c3-4bc9-b470-1a1bc01528f4 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:44.412256 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-d334872d-52c3-4bc9-b470-1a1bc01528f4 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda" status: 200 len: 1317 microversion: 2.1 time: 0.191413 Jul 23 21:25:44.412840 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1477/2913] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:44 2022] GET /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda => generated 1317 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:44.419296 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-deef9b81-7ea5-48f7-b410-551d9d890305 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:44.420789 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-deef9b81-7ea5-48f7-b410-551d9d890305 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] [instance: acfc85ad-35a7-4cfd-935d-89707e3bc08c] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:44.427250 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-deef9b81-7ea5-48f7-b410-551d9d890305 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:44.427802 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-deef9b81-7ea5-48f7-b410-551d9d890305 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:44.428712 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-deef9b81-7ea5-48f7-b410-551d9d890305 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:44.429272 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-deef9b81-7ea5-48f7-b410-551d9d890305 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:44.444289 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-deef9b81-7ea5-48f7-b410-551d9d890305 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] HTTP exception thrown: Instance acfc85ad-35a7-4cfd-935d-89707e3bc08c could not be found. Jul 23 21:25:44.446494 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-deef9b81-7ea5-48f7-b410-551d9d890305 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Request method failure captured: Jul 23 21:25:44.446494 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/servers/acfc85ad-35a7-4cfd-935d-89707e3bc08c HTTP/1.1 Jul 23 21:25:44.446494 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:25:44.446494 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:25:44.446494 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:25:44.446494 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:25:44.446494 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:25:44.446494 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:25:44.446494 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:25:44.446494 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:25:44.446494 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3Gc1L1PADC1CM70W3hT0FVjoa4HtwwH3JOQkmjqciZITuhOEr0t_UZ35l8A4x914Pv0RWdOTKosFZHAL_zCSDMHc2rV1eM8cfyYDuR_tfl2tndicDedGBRHNkTAkJcQzYaxqlYrCR7nDja51eRALEogCD7UYUmxPfBufihds_7Z_B54 Jul 23 21:25:44.446494 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:25:44.446494 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:25:44.446494 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:25:44.446494 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:25:44.446494 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:25:44.446494 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:25:44.446494 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 892f8e8d61274d54bd996140a9ab38f9 Jul 23 21:25:44.446494 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ListServersNegativeTestJSON-574240373 Jul 23 21:25:44.446494 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:25:44.446494 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:25:44.446494 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/892f8e8d61274d54bd996140a9ab38f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/892f8e8d61274d54bd996140a9ab38f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_892f8e8d61274d54bd996140a9ab38f9", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/892f8e8d61274d54bd996140a9ab38f9"}]}] Jul 23 21:25:44.446494 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ListServersNegativeTestJSON-574240373 Jul 23 21:25:44.446494 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 892f8e8d61274d54bd996140a9ab38f9 Jul 23 21:25:44.446494 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-574240373 Jul 23 21:25:44.446494 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ListServersNegativeTestJSON-574240373-project Jul 23 21:25:44.446494 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:25:44.446494 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:25:44.446494 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 8a7b95c6fb6743cf9f1942a6328a1ba7 Jul 23 21:25:44.446494 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ListServersNegativeTestJSON-574240373-project Jul 23 21:25:44.446494 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:25:44.446494 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance acfc85ad-35a7-4cfd-935d-89707e3bc08c could not be found. Jul 23 21:25:44.446494 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': 'acfc85ad-35a7-4cfd-935d-89707e3bc08c'} Jul 23 21:25:44.446494 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:25:44.446494 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:25:44.446494 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:25:44.446494 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:25:44.446494 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:25:44.446494 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:25:44.446494 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:25:44.446494 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:25:44.446494 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:25:44.446494 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:25:44.446494 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acfc85ad-35a7-4cfd-935d-89707e3bc08c could not be found. Jul 23 21:25:44.446494 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:25:44.446494 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:25:44.446494 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:25:44.446494 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:25:44.446494 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:25:44.446494 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:25:44.446494 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:25:44.446494 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:25:44.446494 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:25:44.446494 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:25:44.446494 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:25:44.446494 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:25:44.446494 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:25:44.446494 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:25:44.446494 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:25:44.446494 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:25:44.446494 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acfc85ad-35a7-4cfd-935d-89707e3bc08c could not be found. Jul 23 21:25:44.446494 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:25:44.446494 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:25:44.446494 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:25:44.451161 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:25:44.451161 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:25:44.451161 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:25:44.451161 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:25:44.451161 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:25:44.451161 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acfc85ad-35a7-4cfd-935d-89707e3bc08c could not be found. Jul 23 21:25:44.451161 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:25:44.451161 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-deef9b81-7ea5-48f7-b410-551d9d890305 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Returning 404 to user: Instance acfc85ad-35a7-4cfd-935d-89707e3bc08c could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:25:44.452371 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-deef9b81-7ea5-48f7-b410-551d9d890305 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] 10.222.0.17 "GET /compute/v2.1/servers/acfc85ad-35a7-4cfd-935d-89707e3bc08c" status: 404 len: 111 microversion: 2.1 time: 0.037839 Jul 23 21:25:44.452919 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1478/2914] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:44 2022] GET /compute/v2.1/servers/acfc85ad-35a7-4cfd-935d-89707e3bc08c => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:25:44.461568 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-347af2bc-fe75-4ecb-8826-18bfcfe5b4cc tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:44.466170 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-347af2bc-fe75-4ecb-8826-18bfcfe5b4cc tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8a7b95c6fb6743cf9f1942a6328a1ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f8e8d61274d54bd996140a9ab38f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:44.467462 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-347af2bc-fe75-4ecb-8826-18bfcfe5b4cc tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '892f8e8d61274d54bd996140a9ab38f9'} {{(pid=131321) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 23 21:25:44.473771 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-347af2bc-fe75-4ecb-8826-18bfcfe5b4cc tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:44.474600 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-347af2bc-fe75-4ecb-8826-18bfcfe5b4cc tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:44.475800 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-347af2bc-fe75-4ecb-8826-18bfcfe5b4cc tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:44.476340 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-347af2bc-fe75-4ecb-8826-18bfcfe5b4cc tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:44.570390 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-347af2bc-fe75-4ecb-8826-18bfcfe5b4cc tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] 10.222.0.17 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.112593 Jul 23 21:25:44.571107 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1479/2915] 10.222.0.17 () {58 vars in 1229 bytes} [Sat Jul 23 21:25:44 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 23 21:25:44.580639 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-205507f3-ec25-4edf-bff1-6bf0ddcd9161 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a609c39c14343e1bc1edd4b3cd56dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116def61aba4631be91f67df63ebab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:44.583638 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-de903281-a032-4730-95e7-f1ae61c75847 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:44.587100 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-de903281-a032-4730-95e7-f1ae61c75847 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Request method failure captured: Jul 23 21:25:44.587100 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Jul 23 21:25:44.587100 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:25:44.587100 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:25:44.587100 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:25:44.587100 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:25:44.587100 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:25:44.587100 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:25:44.587100 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:25:44.587100 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:25:44.587100 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3Gc1L1PADC1CM70W3hT0FVjoa4HtwwH3JOQkmjqciZITuhOEr0t_UZ35l8A4x914Pv0RWdOTKosFZHAL_zCSDMHc2rV1eM8cfyYDuR_tfl2tndicDedGBRHNkTAkJcQzYaxqlYrCR7nDja51eRALEogCD7UYUmxPfBufihds_7Z_B54 Jul 23 21:25:44.587100 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:25:44.587100 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:25:44.587100 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:25:44.587100 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:25:44.587100 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:25:44.587100 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:25:44.587100 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 892f8e8d61274d54bd996140a9ab38f9 Jul 23 21:25:44.587100 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ListServersNegativeTestJSON-574240373 Jul 23 21:25:44.587100 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:25:44.587100 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:25:44.587100 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/892f8e8d61274d54bd996140a9ab38f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/892f8e8d61274d54bd996140a9ab38f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_892f8e8d61274d54bd996140a9ab38f9", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/892f8e8d61274d54bd996140a9ab38f9"}]}] Jul 23 21:25:44.587100 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ListServersNegativeTestJSON-574240373 Jul 23 21:25:44.587100 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 892f8e8d61274d54bd996140a9ab38f9 Jul 23 21:25:44.587100 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-574240373 Jul 23 21:25:44.587100 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ListServersNegativeTestJSON-574240373-project Jul 23 21:25:44.587100 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:25:44.587100 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:25:44.587100 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 8a7b95c6fb6743cf9f1942a6328a1ba7 Jul 23 21:25:44.587100 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ListServersNegativeTestJSON-574240373-project Jul 23 21:25:44.587100 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:25:44.587100 ncdv-master-1 devstack@n-api.service[131321]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jul 23 21:25:44.587100 ncdv-master-1 devstack@n-api.service[131321]: action_args: {} Jul 23 21:25:44.587100 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:25:44.587100 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:25:44.587100 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 23 21:25:44.587100 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 23 21:25:44.587100 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 23 21:25:44.587100 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise error Jul 23 21:25:44.587100 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Jul 23 21:25:44.587100 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:25:44.587100 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Jul 23 21:25:44.587100 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Jul 23 21:25:44.587100 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:25:44.587100 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi On instance[0]: Jul 23 21:25:44.587100 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi '2011/01/01' Jul 23 21:25:44.587100 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:25:44.587100 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:25:44.587100 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:25:44.587100 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:25:44.587100 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:25:44.587100 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:25:44.587100 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:25:44.587100 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:25:44.587100 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:25:44.587100 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:25:44.587100 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 23 21:25:44.587100 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:25:44.587100 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 23 21:25:44.587100 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:25:44.587100 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 23 21:25:44.587100 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:25:44.587100 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 23 21:25:44.587100 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jul 23 21:25:44.587100 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jul 23 21:25:44.587100 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 23 21:25:44.591973 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 23 21:25:44.591973 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 23 21:25:44.591973 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 23 21:25:44.591973 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jul 23 21:25:44.591973 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:25:44.591973 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:25:44.591973 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:25:44.591973 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:25:44.591973 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:25:44.591973 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:25:44.591973 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 23 21:25:44.591973 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 23 21:25:44.591973 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jul 23 21:25:44.591973 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:25:44.593115 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-205507f3-ec25-4edf-bff1-6bf0ddcd9161 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] 10.222.0.17 "GET /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215" status: 200 len: 1313 microversion: 2.1 time: 0.251800 Jul 23 21:25:44.594404 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-de903281-a032-4730-95e7-f1ae61c75847 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:25:44.595466 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-de903281-a032-4730-95e7-f1ae61c75847 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] 10.222.0.17 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.016183 Jul 23 21:25:44.600898 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1437/2916] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:44 2022] GET /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215 => generated 1313 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:44.601495 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1480/2917] 10.222.0.17 () {58 vars in 1181 bytes} [Sat Jul 23 21:25:44 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 23 21:25:44.607252 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-64138a1e-c896-4fa5-9ccf-71b1f1c6b8b5 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:44.610793 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-64138a1e-c896-4fa5-9ccf-71b1f1c6b8b5 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8a7b95c6fb6743cf9f1942a6328a1ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f8e8d61274d54bd996140a9ab38f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:44.611657 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-64138a1e-c896-4fa5-9ccf-71b1f1c6b8b5 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Searching by: {'deleted': False, 'project_id': '892f8e8d61274d54bd996140a9ab38f9'} {{(pid=131320) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 23 21:25:44.617694 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-64138a1e-c896-4fa5-9ccf-71b1f1c6b8b5 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:44.618247 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-64138a1e-c896-4fa5-9ccf-71b1f1c6b8b5 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:44.619236 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-64138a1e-c896-4fa5-9ccf-71b1f1c6b8b5 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:44.619743 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-64138a1e-c896-4fa5-9ccf-71b1f1c6b8b5 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:44.646024 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.multi_cell_list [None req-64138a1e-c896-4fa5-9ccf-71b1f1c6b8b5 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=131320) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 23 21:25:44.676367 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-64138a1e-c896-4fa5-9ccf-71b1f1c6b8b5 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] 10.222.0.17 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.073402 Jul 23 21:25:44.677130 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1438/2918] 10.222.0.17 () {58 vars in 1124 bytes} [Sat Jul 23 21:25:44 2022] GET /compute/v2.1/servers => generated 681 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:25:44.688726 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a8b7de83-3114-483f-86ad-26c5af0bbdb9 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:44.692890 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-a8b7de83-3114-483f-86ad-26c5af0bbdb9 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8a7b95c6fb6743cf9f1942a6328a1ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f8e8d61274d54bd996140a9ab38f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:44.693554 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.compute.servers [None req-a8b7de83-3114-483f-86ad-26c5af0bbdb9 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Removing options 'limit' from query {{(pid=131321) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 23 21:25:44.694234 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-a8b7de83-3114-483f-86ad-26c5af0bbdb9 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Searching by: {'deleted': False, 'project_id': '892f8e8d61274d54bd996140a9ab38f9'} {{(pid=131321) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 23 21:25:44.700854 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a8b7de83-3114-483f-86ad-26c5af0bbdb9 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:44.701487 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a8b7de83-3114-483f-86ad-26c5af0bbdb9 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:44.702934 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a8b7de83-3114-483f-86ad-26c5af0bbdb9 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:44.703551 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a8b7de83-3114-483f-86ad-26c5af0bbdb9 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:44.735351 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.multi_cell_list [None req-a8b7de83-3114-483f-86ad-26c5af0bbdb9 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=131321) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 23 21:25:44.750215 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-19cf3352-e182-4826-ac86-fa1f751019de tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:44.751457 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-19cf3352-e182-4826-ac86-fa1f751019de tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:44.758472 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:25:44.761391 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-19cf3352-e182-4826-ac86-fa1f751019de tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:44.762158 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-19cf3352-e182-4826-ac86-fa1f751019de tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:44.764065 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-19cf3352-e182-4826-ac86-fa1f751019de tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:44.764065 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-19cf3352-e182-4826-ac86-fa1f751019de tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:44.776863 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-a8b7de83-3114-483f-86ad-26c5af0bbdb9 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] 10.222.0.17 "GET /compute/v2.1/servers?limit=102" status: 200 len: 681 microversion: 2.1 time: 0.092319 Jul 23 21:25:44.778007 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1481/2919] 10.222.0.17 () {58 vars in 1143 bytes} [Sat Jul 23 21:25:44 2022] GET /compute/v2.1/servers?limit=102 => generated 681 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:25:44.796724 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-2cc3f3e9-1b9c-4d43-b49b-e68e190fafd8 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:44.797586 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-2cc3f3e9-1b9c-4d43-b49b-e68e190fafd8 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] [instance: 35d0d067-4f24-45a4-b03c-32346b764d3c] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:44.809908 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2cc3f3e9-1b9c-4d43-b49b-e68e190fafd8 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:44.811126 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2cc3f3e9-1b9c-4d43-b49b-e68e190fafd8 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:44.812131 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2cc3f3e9-1b9c-4d43-b49b-e68e190fafd8 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:44.812761 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2cc3f3e9-1b9c-4d43-b49b-e68e190fafd8 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:44.870268 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-19cf3352-e182-4826-ac86-fa1f751019de tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:44.886760 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-19cf3352-e182-4826-ac86-fa1f751019de tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:44.888556 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-19cf3352-e182-4826-ac86-fa1f751019de tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:44.893397 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-19cf3352-e182-4826-ac86-fa1f751019de tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.148026 Jul 23 21:25:44.894254 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1439/2920] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:25:44 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:25:44.905962 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2994f417-30e0-488e-91c6-b1ba313b3705 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:44.912448 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2994f417-30e0-488e-91c6-b1ba313b3705 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Request method failure captured: Jul 23 21:25:44.912448 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Jul 23 21:25:44.912448 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:25:44.912448 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:25:44.912448 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:25:44.912448 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:25:44.912448 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:25:44.912448 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:25:44.912448 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:25:44.912448 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:25:44.912448 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3Gc1L1PADC1CM70W3hT0FVjoa4HtwwH3JOQkmjqciZITuhOEr0t_UZ35l8A4x914Pv0RWdOTKosFZHAL_zCSDMHc2rV1eM8cfyYDuR_tfl2tndicDedGBRHNkTAkJcQzYaxqlYrCR7nDja51eRALEogCD7UYUmxPfBufihds_7Z_B54 Jul 23 21:25:44.912448 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:25:44.912448 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:25:44.912448 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:25:44.912448 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:25:44.912448 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:25:44.912448 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:25:44.912448 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 892f8e8d61274d54bd996140a9ab38f9 Jul 23 21:25:44.912448 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ListServersNegativeTestJSON-574240373 Jul 23 21:25:44.912448 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:25:44.912448 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:25:44.912448 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/892f8e8d61274d54bd996140a9ab38f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/892f8e8d61274d54bd996140a9ab38f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_892f8e8d61274d54bd996140a9ab38f9", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/892f8e8d61274d54bd996140a9ab38f9"}]}] Jul 23 21:25:44.912448 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ListServersNegativeTestJSON-574240373 Jul 23 21:25:44.912448 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 892f8e8d61274d54bd996140a9ab38f9 Jul 23 21:25:44.912448 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-574240373 Jul 23 21:25:44.912448 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ListServersNegativeTestJSON-574240373-project Jul 23 21:25:44.912448 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:25:44.912448 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:25:44.912448 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 8a7b95c6fb6743cf9f1942a6328a1ba7 Jul 23 21:25:44.912448 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ListServersNegativeTestJSON-574240373-project Jul 23 21:25:44.912448 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:25:44.912448 ncdv-master-1 devstack@n-api.service[131320]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jul 23 21:25:44.912448 ncdv-master-1 devstack@n-api.service[131320]: action_args: {} Jul 23 21:25:44.912448 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:25:44.912448 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:25:44.912448 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 23 21:25:44.912448 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 23 21:25:44.912448 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 23 21:25:44.912448 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise error Jul 23 21:25:44.912448 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Jul 23 21:25:44.912448 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:25:44.912448 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Jul 23 21:25:44.912448 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 23 21:25:44.912448 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi 'minimum': 0, Jul 23 21:25:44.912448 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 23 21:25:44.912448 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 23 21:25:44.912448 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:25:44.912448 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi On instance[0]: Jul 23 21:25:44.912448 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi '-1' Jul 23 21:25:44.912448 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:25:44.912448 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:25:44.912448 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:25:44.912448 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:25:44.912448 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:25:44.912448 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:25:44.912448 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:25:44.912448 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:25:44.912448 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:25:44.912448 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:25:44.912448 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 23 21:25:44.912448 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:25:44.912448 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 23 21:25:44.912448 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:25:44.912448 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 23 21:25:44.912448 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:25:44.912448 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 23 21:25:44.912448 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jul 23 21:25:44.912448 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jul 23 21:25:44.916908 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 23 21:25:44.916908 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 23 21:25:44.916908 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 23 21:25:44.916908 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 23 21:25:44.916908 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jul 23 21:25:44.916908 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:25:44.916908 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:25:44.916908 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:25:44.916908 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:25:44.916908 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:25:44.916908 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:25:44.916908 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 23 21:25:44.916908 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 23 21:25:44.916908 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jul 23 21:25:44.916908 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:25:44.922774 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2994f417-30e0-488e-91c6-b1ba313b3705 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:25:44.925298 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2994f417-30e0-488e-91c6-b1ba313b3705 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] 10.222.0.17 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.027416 Jul 23 21:25:44.930672 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1440/2921] 10.222.0.17 () {58 vars in 1141 bytes} [Sat Jul 23 21:25:44 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 23 21:25:44.942605 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1425b8e1-11c3-413d-8061-f253f52900c5 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:44.946835 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1425b8e1-11c3-413d-8061-f253f52900c5 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Request method failure captured: Jul 23 21:25:44.946835 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Jul 23 21:25:44.946835 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:25:44.946835 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:25:44.946835 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:25:44.946835 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:25:44.946835 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:25:44.946835 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:25:44.946835 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:25:44.946835 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:25:44.946835 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3Gc1L1PADC1CM70W3hT0FVjoa4HtwwH3JOQkmjqciZITuhOEr0t_UZ35l8A4x914Pv0RWdOTKosFZHAL_zCSDMHc2rV1eM8cfyYDuR_tfl2tndicDedGBRHNkTAkJcQzYaxqlYrCR7nDja51eRALEogCD7UYUmxPfBufihds_7Z_B54 Jul 23 21:25:44.946835 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:25:44.946835 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:25:44.946835 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:25:44.946835 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:25:44.946835 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:25:44.946835 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:25:44.946835 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 892f8e8d61274d54bd996140a9ab38f9 Jul 23 21:25:44.946835 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ListServersNegativeTestJSON-574240373 Jul 23 21:25:44.946835 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:25:44.946835 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:25:44.946835 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/892f8e8d61274d54bd996140a9ab38f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/892f8e8d61274d54bd996140a9ab38f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_892f8e8d61274d54bd996140a9ab38f9", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/892f8e8d61274d54bd996140a9ab38f9"}]}] Jul 23 21:25:44.946835 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ListServersNegativeTestJSON-574240373 Jul 23 21:25:44.946835 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 892f8e8d61274d54bd996140a9ab38f9 Jul 23 21:25:44.946835 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-574240373 Jul 23 21:25:44.946835 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ListServersNegativeTestJSON-574240373-project Jul 23 21:25:44.946835 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:25:44.946835 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:25:44.946835 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 8a7b95c6fb6743cf9f1942a6328a1ba7 Jul 23 21:25:44.946835 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ListServersNegativeTestJSON-574240373-project Jul 23 21:25:44.946835 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:25:44.946835 ncdv-master-1 devstack@n-api.service[131320]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jul 23 21:25:44.946835 ncdv-master-1 devstack@n-api.service[131320]: action_args: {} Jul 23 21:25:44.946835 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:25:44.946835 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:25:44.946835 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 23 21:25:44.946835 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 23 21:25:44.946835 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 23 21:25:44.946835 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise error Jul 23 21:25:44.946835 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Jul 23 21:25:44.946835 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:25:44.946835 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Jul 23 21:25:44.946835 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 23 21:25:44.946835 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi 'minimum': 0, Jul 23 21:25:44.946835 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 23 21:25:44.946835 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 23 21:25:44.946835 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:25:44.946835 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi On instance[0]: Jul 23 21:25:44.946835 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi 'testing' Jul 23 21:25:44.946835 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:25:44.946835 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:25:44.946835 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:25:44.946835 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:25:44.946835 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:25:44.946835 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:25:44.946835 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:25:44.946835 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:25:44.946835 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:25:44.946835 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:25:44.946835 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 23 21:25:44.946835 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:25:44.946835 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 23 21:25:44.946835 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:25:44.946835 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 23 21:25:44.946835 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:25:44.946835 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 23 21:25:44.946835 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jul 23 21:25:44.946835 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jul 23 21:25:44.951947 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 23 21:25:44.951947 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 23 21:25:44.951947 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 23 21:25:44.951947 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 23 21:25:44.951947 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jul 23 21:25:44.951947 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:25:44.951947 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:25:44.951947 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:25:44.951947 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:25:44.951947 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:25:44.951947 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:25:44.951947 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 23 21:25:44.951947 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 23 21:25:44.951947 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jul 23 21:25:44.951947 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:25:44.955404 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1425b8e1-11c3-413d-8061-f253f52900c5 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:25:44.956452 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1425b8e1-11c3-413d-8061-f253f52900c5 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] 10.222.0.17 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.021538 Jul 23 21:25:44.957513 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1441/2922] 10.222.0.17 () {58 vars in 1151 bytes} [Sat Jul 23 21:25:44 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 23 21:25:44.972116 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-af76faff-7de7-4d45-adef-04fca90569fa tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:44.977314 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-af76faff-7de7-4d45-adef-04fca90569fa tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8a7b95c6fb6743cf9f1942a6328a1ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f8e8d61274d54bd996140a9ab38f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:44.978416 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-af76faff-7de7-4d45-adef-04fca90569fa tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '892f8e8d61274d54bd996140a9ab38f9'} {{(pid=131320) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 23 21:25:44.990019 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.compute.servers [None req-af76faff-7de7-4d45-adef-04fca90569fa tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Flavor 'non_existing_flavor' could not be found {{(pid=131320) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Jul 23 21:25:44.992464 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-af76faff-7de7-4d45-adef-04fca90569fa tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] 10.222.0.17 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.027251 Jul 23 21:25:44.993774 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1442/2923] 10.222.0.17 () {58 vars in 1177 bytes} [Sat Jul 23 21:25:44 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 23 21:25:45.007465 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6fe59d55-61f2-4bb8-9bba-85a5fb7d4d1d tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:45.013254 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6fe59d55-61f2-4bb8-9bba-85a5fb7d4d1d tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8a7b95c6fb6743cf9f1942a6328a1ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f8e8d61274d54bd996140a9ab38f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:45.014101 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6fe59d55-61f2-4bb8-9bba-85a5fb7d4d1d tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '892f8e8d61274d54bd996140a9ab38f9'} {{(pid=131320) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 23 21:25:45.020759 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6fe59d55-61f2-4bb8-9bba-85a5fb7d4d1d tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:45.021340 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6fe59d55-61f2-4bb8-9bba-85a5fb7d4d1d tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:45.023650 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6fe59d55-61f2-4bb8-9bba-85a5fb7d4d1d tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:45.024317 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6fe59d55-61f2-4bb8-9bba-85a5fb7d4d1d tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:45.057615 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-2cc3f3e9-1b9c-4d43-b49b-e68e190fafd8 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859c1493a30d4386b74377ab2b9bc81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3efb8824be84323b6ec04b604775bd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:45.071065 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-2cc3f3e9-1b9c-4d43-b49b-e68e190fafd8 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] 10.222.0.17 "GET /compute/v2.1/servers/35d0d067-4f24-45a4-b03c-32346b764d3c" status: 200 len: 1519 microversion: 2.1 time: 0.291586 Jul 23 21:25:45.073307 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1482/2924] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:44 2022] GET /compute/v2.1/servers/35d0d067-4f24-45a4-b03c-32346b764d3c => generated 1519 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:45.126077 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-d38776a0-898b-4218-8611-fba73ca41610 req-c5f22202-0cb6-47c6-8693-5d0592f2f94f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4085bec2-40ec-4324-b718-2c7ec388a22e", "name": "network-vif-plugged", "status": "completed", "tag": "39fbda00-62e3-43a1-8cd6-e48af6277d20"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:25:45.132497 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6fe59d55-61f2-4bb8-9bba-85a5fb7d4d1d tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] 10.222.0.17 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.129510 Jul 23 21:25:45.139165 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1443/2925] 10.222.0.17 () {58 vars in 1173 bytes} [Sat Jul 23 21:25:45 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 23 21:25:45.139807 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-d38776a0-898b-4218-8611-fba73ca41610 req-c5f22202-0cb6-47c6-8693-5d0592f2f94f service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:45.141143 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-d38776a0-898b-4218-8611-fba73ca41610 req-c5f22202-0cb6-47c6-8693-5d0592f2f94f service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:45.144642 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c1d4b139-2f12-4a88-bbea-b06d55e515db tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:45.149287 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c1d4b139-2f12-4a88-bbea-b06d55e515db tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8a7b95c6fb6743cf9f1942a6328a1ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f8e8d61274d54bd996140a9ab38f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:45.150139 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c1d4b139-2f12-4a88-bbea-b06d55e515db tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '892f8e8d61274d54bd996140a9ab38f9'} {{(pid=131320) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 23 21:25:45.155898 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c1d4b139-2f12-4a88-bbea-b06d55e515db tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:45.156353 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c1d4b139-2f12-4a88-bbea-b06d55e515db tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:45.157940 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c1d4b139-2f12-4a88-bbea-b06d55e515db tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:45.158402 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c1d4b139-2f12-4a88-bbea-b06d55e515db tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:45.167575 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-d38776a0-898b-4218-8611-fba73ca41610 req-c5f22202-0cb6-47c6-8693-5d0592f2f94f service nova] Creating event network-vif-plugged:39fbda00-62e3-43a1-8cd6-e48af6277d20 for instance 4085bec2-40ec-4324-b718-2c7ec388a22e on nch1-master-1 Jul 23 21:25:45.178873 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-d38776a0-898b-4218-8611-fba73ca41610 req-c5f22202-0cb6-47c6-8693-5d0592f2f94f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056824 Jul 23 21:25:45.183578 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1483/2926] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:25:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:25:45.343624 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-85f63118-df30-479a-82f1-453571756456 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:45.344344 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-85f63118-df30-479a-82f1-453571756456 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] [instance: 4085bec2-40ec-4324-b718-2c7ec388a22e] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:45.364729 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-85f63118-df30-479a-82f1-453571756456 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:45.365386 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-85f63118-df30-479a-82f1-453571756456 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:45.367835 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-85f63118-df30-479a-82f1-453571756456 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:45.368557 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-85f63118-df30-479a-82f1-453571756456 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:45.553556 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c1d4b139-2f12-4a88-bbea-b06d55e515db tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] 10.222.0.17 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.413096 Jul 23 21:25:45.556734 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-85f63118-df30-479a-82f1-453571756456 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961e46ab94f4fffbc606485935ce64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8305585b60d54beeb2b087a37260a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:45.560093 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1444/2927] 10.222.0.17 () {58 vars in 1183 bytes} [Sat Jul 23 21:25:45 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 23 21:25:45.567704 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b7170678-fd32-490b-ac42-53a8bfc5398d tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:45.568434 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b7170678-fd32-490b-ac42-53a8bfc5398d tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: d303403b-5d14-443b-a6fe-f8b579d24cda] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:45.573179 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-85f63118-df30-479a-82f1-453571756456 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] 10.222.0.17 "GET /compute/v2.1/servers/4085bec2-40ec-4324-b718-2c7ec388a22e" status: 200 len: 1324 microversion: 2.1 time: 0.233635 Jul 23 21:25:45.574728 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1484/2928] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:45 2022] GET /compute/v2.1/servers/4085bec2-40ec-4324-b718-2c7ec388a22e => generated 1324 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:25:45.582232 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b7170678-fd32-490b-ac42-53a8bfc5398d tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:45.582767 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b7170678-fd32-490b-ac42-53a8bfc5398d tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:45.583221 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-494467ca-f6c9-4019-b2cc-e9c7baae5e6e tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:45.583709 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b7170678-fd32-490b-ac42-53a8bfc5398d tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:45.584268 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b7170678-fd32-490b-ac42-53a8bfc5398d tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:45.588007 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-494467ca-f6c9-4019-b2cc-e9c7baae5e6e tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8a7b95c6fb6743cf9f1942a6328a1ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f8e8d61274d54bd996140a9ab38f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:45.589090 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-494467ca-f6c9-4019-b2cc-e9c7baae5e6e tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Searching by: {'deleted': False, 'project_id': '892f8e8d61274d54bd996140a9ab38f9'} {{(pid=131321) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 23 21:25:45.595835 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-494467ca-f6c9-4019-b2cc-e9c7baae5e6e tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:45.596241 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-494467ca-f6c9-4019-b2cc-e9c7baae5e6e tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:45.597031 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-494467ca-f6c9-4019-b2cc-e9c7baae5e6e tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:45.597462 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-494467ca-f6c9-4019-b2cc-e9c7baae5e6e tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:45.633755 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.multi_cell_list [None req-494467ca-f6c9-4019-b2cc-e9c7baae5e6e tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=131321) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 23 21:25:45.676561 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell0:SELECT=39 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:25:45.679868 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-494467ca-f6c9-4019-b2cc-e9c7baae5e6e tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7b95c6fb6743cf9f1942a6328a1ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f8e8d61274d54bd996140a9ab38f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:45.691589 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-494467ca-f6c9-4019-b2cc-e9c7baae5e6e tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:45.692068 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-494467ca-f6c9-4019-b2cc-e9c7baae5e6e tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:45.845703 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-494467ca-f6c9-4019-b2cc-e9c7baae5e6e tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] 10.222.0.17 "GET /compute/v2.1/servers/detail" status: 200 len: 3022 microversion: 2.1 time: 0.269730 Jul 23 21:25:45.846460 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1485/2929] 10.222.0.17 () {58 vars in 1145 bytes} [Sat Jul 23 21:25:45 2022] GET /compute/v2.1/servers/detail => generated 3022 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:45.851492 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-4d6f26df-ac3e-45f0-8380-0edd104ec3c0 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:45.852415 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-4d6f26df-ac3e-45f0-8380-0edd104ec3c0 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] [instance: cb3a66a8-4c84-4bb1-8b3f-0c48acec1215] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:45.859800 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4d6f26df-ac3e-45f0-8380-0edd104ec3c0 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:45.860756 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4d6f26df-ac3e-45f0-8380-0edd104ec3c0 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:45.861744 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4d6f26df-ac3e-45f0-8380-0edd104ec3c0 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:45.863335 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4d6f26df-ac3e-45f0-8380-0edd104ec3c0 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:45.865227 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b7170678-fd32-490b-ac42-53a8bfc5398d tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:45.875824 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b7170678-fd32-490b-ac42-53a8bfc5398d tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda" status: 200 len: 1317 microversion: 2.1 time: 0.315291 Jul 23 21:25:45.876668 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1445/2930] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:45 2022] GET /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda => generated 1317 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:45.890559 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-77fd8cfa-be96-4392-b198-a591b3f04720 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:45.894440 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-77fd8cfa-be96-4392-b198-a591b3f04720 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8a7b95c6fb6743cf9f1942a6328a1ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f8e8d61274d54bd996140a9ab38f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:45.895718 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-77fd8cfa-be96-4392-b198-a591b3f04720 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] 10.222.0.17 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.008971 Jul 23 21:25:45.902450 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1446/2931] 10.222.0.17 () {58 vars in 1177 bytes} [Sat Jul 23 21:25:45 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 23 21:25:45.909157 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e09e8587-6dfc-4988-a634-a71fc5a8621b tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:45.912780 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e09e8587-6dfc-4988-a634-a71fc5a8621b tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8a7b95c6fb6743cf9f1942a6328a1ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f8e8d61274d54bd996140a9ab38f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:45.913790 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e09e8587-6dfc-4988-a634-a71fc5a8621b tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Searching by: {'deleted': False, 'project_id': '892f8e8d61274d54bd996140a9ab38f9'} {{(pid=131320) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 23 21:25:45.919530 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e09e8587-6dfc-4988-a634-a71fc5a8621b tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:45.919990 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e09e8587-6dfc-4988-a634-a71fc5a8621b tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:45.920810 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e09e8587-6dfc-4988-a634-a71fc5a8621b tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:45.921250 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e09e8587-6dfc-4988-a634-a71fc5a8621b tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:45.948816 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.multi_cell_list [None req-e09e8587-6dfc-4988-a634-a71fc5a8621b tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=131320) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 23 21:25:45.992657 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e09e8587-6dfc-4988-a634-a71fc5a8621b tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] 10.222.0.17 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.087861 Jul 23 21:25:45.999027 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1447/2932] 10.222.0.17 () {58 vars in 1124 bytes} [Sat Jul 23 21:25:45 2022] GET /compute/v2.1/servers => generated 681 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:25:45.999027 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5625d209-a8d6-4f4a-a786-fb8a4822b18e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:45.999304 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5625d209-a8d6-4f4a-a786-fb8a4822b18e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:46.011010 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5625d209-a8d6-4f4a-a786-fb8a4822b18e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:46.011643 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5625d209-a8d6-4f4a-a786-fb8a4822b18e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:46.012249 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5625d209-a8d6-4f4a-a786-fb8a4822b18e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:46.012696 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5625d209-a8d6-4f4a-a786-fb8a4822b18e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:46.037235 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-4d6f26df-ac3e-45f0-8380-0edd104ec3c0 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a609c39c14343e1bc1edd4b3cd56dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116def61aba4631be91f67df63ebab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:46.047358 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-4d6f26df-ac3e-45f0-8380-0edd104ec3c0 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] 10.222.0.17 "GET /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215" status: 200 len: 1499 microversion: 2.1 time: 0.199887 Jul 23 21:25:46.048508 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1486/2933] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:45 2022] GET /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215 => generated 1499 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:46.054488 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c747fc3f-7095-4879-bfd2-c30c8785aa04 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:46.056806 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-c747fc3f-7095-4879-bfd2-c30c8785aa04 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] [instance: acfc85ad-35a7-4cfd-935d-89707e3bc08c] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:46.063747 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c747fc3f-7095-4879-bfd2-c30c8785aa04 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:46.064468 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c747fc3f-7095-4879-bfd2-c30c8785aa04 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:46.065244 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c747fc3f-7095-4879-bfd2-c30c8785aa04 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:46.065674 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c747fc3f-7095-4879-bfd2-c30c8785aa04 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:46.080547 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-c747fc3f-7095-4879-bfd2-c30c8785aa04 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] HTTP exception thrown: Instance acfc85ad-35a7-4cfd-935d-89707e3bc08c could not be found. Jul 23 21:25:46.082273 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c747fc3f-7095-4879-bfd2-c30c8785aa04 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Request method failure captured: Jul 23 21:25:46.082273 ncdv-master-1 devstack@n-api.service[131321]: request: DELETE /compute/v2.1/servers/acfc85ad-35a7-4cfd-935d-89707e3bc08c HTTP/1.1 Jul 23 21:25:46.082273 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:25:46.082273 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:25:46.082273 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:25:46.082273 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:25:46.082273 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:25:46.082273 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:25:46.082273 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:25:46.082273 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:25:46.082273 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3Gc1L1PADC1CM70W3hT0FVjoa4HtwwH3JOQkmjqciZITuhOEr0t_UZ35l8A4x914Pv0RWdOTKosFZHAL_zCSDMHc2rV1eM8cfyYDuR_tfl2tndicDedGBRHNkTAkJcQzYaxqlYrCR7nDja51eRALEogCD7UYUmxPfBufihds_7Z_B54 Jul 23 21:25:46.082273 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:25:46.082273 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:25:46.082273 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:25:46.082273 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:25:46.082273 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:25:46.082273 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:25:46.082273 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 892f8e8d61274d54bd996140a9ab38f9 Jul 23 21:25:46.082273 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ListServersNegativeTestJSON-574240373 Jul 23 21:25:46.082273 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:25:46.082273 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:25:46.082273 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/892f8e8d61274d54bd996140a9ab38f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/892f8e8d61274d54bd996140a9ab38f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_892f8e8d61274d54bd996140a9ab38f9", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/892f8e8d61274d54bd996140a9ab38f9"}]}] Jul 23 21:25:46.082273 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ListServersNegativeTestJSON-574240373 Jul 23 21:25:46.082273 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 892f8e8d61274d54bd996140a9ab38f9 Jul 23 21:25:46.082273 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-574240373 Jul 23 21:25:46.082273 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ListServersNegativeTestJSON-574240373-project Jul 23 21:25:46.082273 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:25:46.082273 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:25:46.082273 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 8a7b95c6fb6743cf9f1942a6328a1ba7 Jul 23 21:25:46.082273 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ListServersNegativeTestJSON-574240373-project Jul 23 21:25:46.082273 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:25:46.082273 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance acfc85ad-35a7-4cfd-935d-89707e3bc08c could not be found. Jul 23 21:25:46.082273 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': 'acfc85ad-35a7-4cfd-935d-89707e3bc08c'} Jul 23 21:25:46.082273 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:25:46.082273 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:25:46.082273 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:25:46.082273 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:25:46.082273 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:25:46.082273 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:25:46.082273 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:25:46.082273 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:25:46.082273 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:25:46.082273 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:25:46.082273 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acfc85ad-35a7-4cfd-935d-89707e3bc08c could not be found. Jul 23 21:25:46.082273 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:25:46.082273 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:25:46.082273 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:25:46.082273 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:25:46.082273 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:25:46.082273 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:25:46.082273 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:25:46.082273 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:25:46.082273 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:25:46.082273 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:25:46.082273 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 23 21:25:46.082273 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 23 21:25:46.082273 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 23 21:25:46.082273 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 23 21:25:46.082273 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:25:46.082273 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:25:46.082273 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:25:46.082273 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:25:46.086888 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acfc85ad-35a7-4cfd-935d-89707e3bc08c could not be found. Jul 23 21:25:46.086888 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:25:46.086888 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:25:46.086888 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:25:46.086888 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:25:46.086888 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:25:46.086888 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:25:46.086888 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:25:46.086888 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:25:46.086888 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acfc85ad-35a7-4cfd-935d-89707e3bc08c could not be found. Jul 23 21:25:46.086888 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:25:46.088452 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c747fc3f-7095-4879-bfd2-c30c8785aa04 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Returning 404 to user: Instance acfc85ad-35a7-4cfd-935d-89707e3bc08c could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:25:46.089714 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-c747fc3f-7095-4879-bfd2-c30c8785aa04 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] 10.222.0.17 "DELETE /compute/v2.1/servers/acfc85ad-35a7-4cfd-935d-89707e3bc08c" status: 404 len: 111 microversion: 2.1 time: 0.039515 Jul 23 21:25:46.090325 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1487/2934] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:25:46 2022] DELETE /compute/v2.1/servers/acfc85ad-35a7-4cfd-935d-89707e3bc08c => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:25:46.095813 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-2ca45203-4a2e-4353-8c8b-70024ab8ef40 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:25:46.096939 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-2ca45203-4a2e-4353-8c8b-70024ab8ef40 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] [instance: cb3a66a8-4c84-4bb1-8b3f-0c48acec1215] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:46.103929 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2ca45203-4a2e-4353-8c8b-70024ab8ef40 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:46.107102 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2ca45203-4a2e-4353-8c8b-70024ab8ef40 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:46.108223 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2ca45203-4a2e-4353-8c8b-70024ab8ef40 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:46.108831 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2ca45203-4a2e-4353-8c8b-70024ab8ef40 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:46.133384 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.objects.instance [None req-2ca45203-4a2e-4353-8c8b-70024ab8ef40 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lazy-loading 'flavor' on Instance uuid cb3a66a8-4c84-4bb1-8b3f-0c48acec1215 {{(pid=131321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:25:46.134961 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5625d209-a8d6-4f4a-a786-fb8a4822b18e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:46.146603 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5625d209-a8d6-4f4a-a786-fb8a4822b18e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:46.148236 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5625d209-a8d6-4f4a-a786-fb8a4822b18e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:46.149427 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5625d209-a8d6-4f4a-a786-fb8a4822b18e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.154636 Jul 23 21:25:46.153815 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1448/2935] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:25:45 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:25:46.154552 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c7a3dc95-71c0-432a-8bcb-2dfe53599838 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:46.155166 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c7a3dc95-71c0-432a-8bcb-2dfe53599838 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] [instance: 35d0d067-4f24-45a4-b03c-32346b764d3c] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:46.166341 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c7a3dc95-71c0-432a-8bcb-2dfe53599838 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:46.166792 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c7a3dc95-71c0-432a-8bcb-2dfe53599838 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:46.167577 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c7a3dc95-71c0-432a-8bcb-2dfe53599838 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:46.168012 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c7a3dc95-71c0-432a-8bcb-2dfe53599838 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:46.224816 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-2ca45203-4a2e-4353-8c8b-70024ab8ef40 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] 10.222.0.17 "POST /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215/action" status: 200 len: 32 microversion: 2.1 time: 0.133056 Jul 23 21:25:46.229805 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1488/2936] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:25:46 2022] POST /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215/action => generated 32 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 23 21:25:46.232078 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d6cad847-f686-488e-a672-7de9beb47410 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:46.232673 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-d6cad847-f686-488e-a672-7de9beb47410 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] [instance: 34973378-2075-4fc5-88c2-ab65d5d9fcb8] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:46.239847 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d6cad847-f686-488e-a672-7de9beb47410 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:46.240274 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d6cad847-f686-488e-a672-7de9beb47410 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:46.241122 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d6cad847-f686-488e-a672-7de9beb47410 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:46.241713 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d6cad847-f686-488e-a672-7de9beb47410 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:46.260001 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:25:46.275322 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-d6cad847-f686-488e-a672-7de9beb47410 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] [instance: 34973378-2075-4fc5-88c2-ab65d5d9fcb8] Going to try to terminate instance {{(pid=131321) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:25:46.365007 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c7a3dc95-71c0-432a-8bcb-2dfe53599838 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859c1493a30d4386b74377ab2b9bc81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3efb8824be84323b6ec04b604775bd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:46.371635 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-d6cad847-f686-488e-a672-7de9beb47410 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] 10.222.0.17 "DELETE /compute/v2.1/servers/34973378-2075-4fc5-88c2-ab65d5d9fcb8" status: 204 len: 0 microversion: 2.1 time: 0.142692 Jul 23 21:25:46.372771 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1489/2937] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:25:46 2022] DELETE /compute/v2.1/servers/34973378-2075-4fc5-88c2-ab65d5d9fcb8 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:25:46.374001 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c7a3dc95-71c0-432a-8bcb-2dfe53599838 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] 10.222.0.17 "GET /compute/v2.1/servers/35d0d067-4f24-45a4-b03c-32346b764d3c" status: 200 len: 1519 microversion: 2.1 time: 0.222685 Jul 23 21:25:46.374823 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1449/2938] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:46 2022] GET /compute/v2.1/servers/35d0d067-4f24-45a4-b03c-32346b764d3c => generated 1519 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:46.384051 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b67d67d5-d9f3-4618-8817-2458b7309f5b tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:46.384558 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b67d67d5-d9f3-4618-8817-2458b7309f5b tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] [instance: 7da7a2f3-d7d5-4413-9967-4be43db261fa] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:46.391287 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b67d67d5-d9f3-4618-8817-2458b7309f5b tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:46.391287 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b67d67d5-d9f3-4618-8817-2458b7309f5b tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:46.392010 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b67d67d5-d9f3-4618-8817-2458b7309f5b tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:46.392562 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b67d67d5-d9f3-4618-8817-2458b7309f5b tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:46.398480 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-2f884204-9156-48a6-8c5d-3d34a5e6a9a3 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:46.399584 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-2f884204-9156-48a6-8c5d-3d34a5e6a9a3 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] [instance: cb3a66a8-4c84-4bb1-8b3f-0c48acec1215] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:46.410082 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2f884204-9156-48a6-8c5d-3d34a5e6a9a3 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:46.410605 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2f884204-9156-48a6-8c5d-3d34a5e6a9a3 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:46.411387 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2f884204-9156-48a6-8c5d-3d34a5e6a9a3 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:46.411960 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2f884204-9156-48a6-8c5d-3d34a5e6a9a3 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:46.449319 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b67d67d5-d9f3-4618-8817-2458b7309f5b tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] [instance: 7da7a2f3-d7d5-4413-9967-4be43db261fa] Going to try to terminate instance {{(pid=131320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:25:46.592673 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b67d67d5-d9f3-4618-8817-2458b7309f5b tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] 10.222.0.17 "DELETE /compute/v2.1/servers/7da7a2f3-d7d5-4413-9967-4be43db261fa" status: 204 len: 0 microversion: 2.1 time: 0.215070 Jul 23 21:25:46.594880 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1450/2939] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:25:46 2022] DELETE /compute/v2.1/servers/7da7a2f3-d7d5-4413-9967-4be43db261fa => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:25:46.613596 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-60d89f46-37a4-4b5a-be3f-904825ff5a2d tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:46.614309 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-60d89f46-37a4-4b5a-be3f-904825ff5a2d tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] [instance: 4085bec2-40ec-4324-b718-2c7ec388a22e] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:46.633739 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-60d89f46-37a4-4b5a-be3f-904825ff5a2d tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:46.634231 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-60d89f46-37a4-4b5a-be3f-904825ff5a2d tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:46.635025 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-60d89f46-37a4-4b5a-be3f-904825ff5a2d tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:46.635471 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-60d89f46-37a4-4b5a-be3f-904825ff5a2d tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:46.639953 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:25:46.727431 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-2f884204-9156-48a6-8c5d-3d34a5e6a9a3 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a609c39c14343e1bc1edd4b3cd56dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116def61aba4631be91f67df63ebab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:46.750709 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-2f884204-9156-48a6-8c5d-3d34a5e6a9a3 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] 10.222.0.17 "GET /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215" status: 200 len: 1505 microversion: 2.1 time: 0.375687 Jul 23 21:25:46.751647 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1490/2940] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:46 2022] GET /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215 => generated 1505 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:46.756257 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-290db1dc-bac5-47ce-905c-c4ca791436d4 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:46.756870 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-290db1dc-bac5-47ce-905c-c4ca791436d4 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] [instance: acfc85ad-35a7-4cfd-935d-89707e3bc08c] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:46.765831 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-290db1dc-bac5-47ce-905c-c4ca791436d4 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:46.770889 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-290db1dc-bac5-47ce-905c-c4ca791436d4 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:46.773022 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-290db1dc-bac5-47ce-905c-c4ca791436d4 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:46.773684 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-290db1dc-bac5-47ce-905c-c4ca791436d4 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:46.832651 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-290db1dc-bac5-47ce-905c-c4ca791436d4 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] HTTP exception thrown: Instance acfc85ad-35a7-4cfd-935d-89707e3bc08c could not be found. Jul 23 21:25:46.841122 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-290db1dc-bac5-47ce-905c-c4ca791436d4 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Request method failure captured: Jul 23 21:25:46.841122 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/servers/acfc85ad-35a7-4cfd-935d-89707e3bc08c HTTP/1.1 Jul 23 21:25:46.841122 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:25:46.841122 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:25:46.841122 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:25:46.841122 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:25:46.841122 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:25:46.841122 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:25:46.841122 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:25:46.841122 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:25:46.841122 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3Gc1L1PADC1CM70W3hT0FVjoa4HtwwH3JOQkmjqciZITuhOEr0t_UZ35l8A4x914Pv0RWdOTKosFZHAL_zCSDMHc2rV1eM8cfyYDuR_tfl2tndicDedGBRHNkTAkJcQzYaxqlYrCR7nDja51eRALEogCD7UYUmxPfBufihds_7Z_B54 Jul 23 21:25:46.841122 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:25:46.841122 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:25:46.841122 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:25:46.841122 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:25:46.841122 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:25:46.841122 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:25:46.841122 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 892f8e8d61274d54bd996140a9ab38f9 Jul 23 21:25:46.841122 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ListServersNegativeTestJSON-574240373 Jul 23 21:25:46.841122 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:25:46.841122 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:25:46.841122 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/892f8e8d61274d54bd996140a9ab38f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/892f8e8d61274d54bd996140a9ab38f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_892f8e8d61274d54bd996140a9ab38f9", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/892f8e8d61274d54bd996140a9ab38f9"}]}] Jul 23 21:25:46.841122 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ListServersNegativeTestJSON-574240373 Jul 23 21:25:46.841122 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 892f8e8d61274d54bd996140a9ab38f9 Jul 23 21:25:46.841122 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-574240373 Jul 23 21:25:46.841122 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ListServersNegativeTestJSON-574240373-project Jul 23 21:25:46.841122 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:25:46.841122 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:25:46.841122 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 8a7b95c6fb6743cf9f1942a6328a1ba7 Jul 23 21:25:46.841122 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ListServersNegativeTestJSON-574240373-project Jul 23 21:25:46.841122 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:25:46.841122 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance acfc85ad-35a7-4cfd-935d-89707e3bc08c could not be found. Jul 23 21:25:46.841122 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': 'acfc85ad-35a7-4cfd-935d-89707e3bc08c'} Jul 23 21:25:46.841122 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:25:46.841122 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:25:46.841122 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:25:46.841122 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:25:46.841122 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:25:46.841122 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:25:46.841122 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:25:46.841122 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:25:46.841122 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:25:46.841122 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:25:46.841122 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acfc85ad-35a7-4cfd-935d-89707e3bc08c could not be found. Jul 23 21:25:46.841122 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:25:46.841122 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:25:46.841122 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:25:46.841122 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:25:46.841122 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:25:46.841122 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:25:46.841122 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:25:46.841122 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:25:46.841122 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:25:46.841122 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:25:46.841122 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:25:46.841122 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:25:46.841122 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:25:46.841122 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:25:46.841122 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:25:46.841122 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:25:46.841122 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acfc85ad-35a7-4cfd-935d-89707e3bc08c could not be found. Jul 23 21:25:46.841122 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:25:46.841122 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:25:46.841122 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:25:46.846132 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:25:46.846132 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:25:46.846132 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:25:46.846132 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:25:46.846132 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:25:46.846132 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acfc85ad-35a7-4cfd-935d-89707e3bc08c could not be found. Jul 23 21:25:46.846132 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:25:46.859448 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-290db1dc-bac5-47ce-905c-c4ca791436d4 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Returning 404 to user: Instance acfc85ad-35a7-4cfd-935d-89707e3bc08c could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:25:46.864374 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-290db1dc-bac5-47ce-905c-c4ca791436d4 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] 10.222.0.17 "GET /compute/v2.1/servers/acfc85ad-35a7-4cfd-935d-89707e3bc08c" status: 404 len: 111 microversion: 2.1 time: 0.111628 Jul 23 21:25:46.874313 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1491/2941] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:46 2022] GET /compute/v2.1/servers/acfc85ad-35a7-4cfd-935d-89707e3bc08c => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:25:46.885230 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-1d2feab5-1616-4413-aa60-2b002b841515 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:46.886124 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-1d2feab5-1616-4413-aa60-2b002b841515 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] [instance: 34973378-2075-4fc5-88c2-ab65d5d9fcb8] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:46.902650 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1d2feab5-1616-4413-aa60-2b002b841515 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:46.905371 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1d2feab5-1616-4413-aa60-2b002b841515 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:46.906418 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1d2feab5-1616-4413-aa60-2b002b841515 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:46.908405 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1d2feab5-1616-4413-aa60-2b002b841515 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:46.920389 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-60d89f46-37a4-4b5a-be3f-904825ff5a2d tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961e46ab94f4fffbc606485935ce64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8305585b60d54beeb2b087a37260a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:46.935361 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-60d89f46-37a4-4b5a-be3f-904825ff5a2d tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] 10.222.0.17 "GET /compute/v2.1/servers/4085bec2-40ec-4324-b718-2c7ec388a22e" status: 200 len: 1324 microversion: 2.1 time: 0.336535 Jul 23 21:25:46.939524 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1451/2942] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:46 2022] GET /compute/v2.1/servers/4085bec2-40ec-4324-b718-2c7ec388a22e => generated 1324 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:46.954866 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6b79eb15-e3e5-41fe-a76b-d4523c664d52 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:46.958276 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6b79eb15-e3e5-41fe-a76b-d4523c664d52 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: d303403b-5d14-443b-a6fe-f8b579d24cda] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:46.977394 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6b79eb15-e3e5-41fe-a76b-d4523c664d52 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:46.978038 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6b79eb15-e3e5-41fe-a76b-d4523c664d52 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:46.978932 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6b79eb15-e3e5-41fe-a76b-d4523c664d52 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:46.979469 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6b79eb15-e3e5-41fe-a76b-d4523c664d52 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:47.196293 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6b79eb15-e3e5-41fe-a76b-d4523c664d52 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:47.212733 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6b79eb15-e3e5-41fe-a76b-d4523c664d52 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda" status: 200 len: 1317 microversion: 2.1 time: 0.269325 Jul 23 21:25:47.213352 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1452/2943] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:46 2022] GET /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda => generated 1317 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:47.229214 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-da5e5696-7a7e-4da9-8626-03944f3323de tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:47.229948 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-da5e5696-7a7e-4da9-8626-03944f3323de tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:47.241060 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-da5e5696-7a7e-4da9-8626-03944f3323de tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:47.242250 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-da5e5696-7a7e-4da9-8626-03944f3323de tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:47.244078 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-da5e5696-7a7e-4da9-8626-03944f3323de tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:47.244704 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-da5e5696-7a7e-4da9-8626-03944f3323de tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:47.327957 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-da5e5696-7a7e-4da9-8626-03944f3323de tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:47.340018 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-da5e5696-7a7e-4da9-8626-03944f3323de tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:47.341495 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-da5e5696-7a7e-4da9-8626-03944f3323de tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:47.342998 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-da5e5696-7a7e-4da9-8626-03944f3323de tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.118435 Jul 23 21:25:47.355238 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1453/2944] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:25:47 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:25:47.355238 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-5b2e8ee5-5ecd-4acb-9439-909c1aba4185 req-d7b24d27-7bd8-453c-85c4-717a15850f67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d303403b-5d14-443b-a6fe-f8b579d24cda", "name": "network-vif-plugged", "status": "completed", "tag": "01c1a8f9-053f-41ab-abe7-cf16d3d4127c"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:25:47.361454 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-5b2e8ee5-5ecd-4acb-9439-909c1aba4185 req-d7b24d27-7bd8-453c-85c4-717a15850f67 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:47.362465 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-5b2e8ee5-5ecd-4acb-9439-909c1aba4185 req-d7b24d27-7bd8-453c-85c4-717a15850f67 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:47.375995 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-5b2e8ee5-5ecd-4acb-9439-909c1aba4185 req-d7b24d27-7bd8-453c-85c4-717a15850f67 service nova] Creating event network-vif-plugged:01c1a8f9-053f-41ab-abe7-cf16d3d4127c for instance d303403b-5d14-443b-a6fe-f8b579d24cda on nch1-master-1 Jul 23 21:25:47.382302 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-5b2e8ee5-5ecd-4acb-9439-909c1aba4185 req-d7b24d27-7bd8-453c-85c4-717a15850f67 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036741 Jul 23 21:25:47.383431 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1454/2945] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:25:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:25:47.395471 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d9dd325b-127a-4233-9805-749f697c7c85 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:47.396302 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d9dd325b-127a-4233-9805-749f697c7c85 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] [instance: 35d0d067-4f24-45a4-b03c-32346b764d3c] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:47.404264 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d9dd325b-127a-4233-9805-749f697c7c85 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:47.404816 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d9dd325b-127a-4233-9805-749f697c7c85 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:47.405706 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d9dd325b-127a-4233-9805-749f697c7c85 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:47.406323 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d9dd325b-127a-4233-9805-749f697c7c85 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:47.559772 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d9dd325b-127a-4233-9805-749f697c7c85 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859c1493a30d4386b74377ab2b9bc81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3efb8824be84323b6ec04b604775bd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:47.560310 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-1d2feab5-1616-4413-aa60-2b002b841515 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7b95c6fb6743cf9f1942a6328a1ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f8e8d61274d54bd996140a9ab38f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:47.562153 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=10 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:25:47.569195 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d9dd325b-127a-4233-9805-749f697c7c85 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] 10.222.0.17 "GET /compute/v2.1/servers/35d0d067-4f24-45a4-b03c-32346b764d3c" status: 200 len: 1519 microversion: 2.1 time: 0.180577 Jul 23 21:25:47.575066 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-1d2feab5-1616-4413-aa60-2b002b841515 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] 10.222.0.17 "GET /compute/v2.1/servers/34973378-2075-4fc5-88c2-ab65d5d9fcb8" status: 200 len: 1521 microversion: 2.1 time: 0.698351 Jul 23 21:25:47.583870 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1455/2946] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:47 2022] GET /compute/v2.1/servers/35d0d067-4f24-45a4-b03c-32346b764d3c => generated 1519 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:47.584048 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1492/2947] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:46 2022] GET /compute/v2.1/servers/34973378-2075-4fc5-88c2-ab65d5d9fcb8 => generated 1521 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:47.769013 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3d1ce938-85c0-488d-baf8-84a650b3d5b9 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:47.769613 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-3d1ce938-85c0-488d-baf8-84a650b3d5b9 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] [instance: cb3a66a8-4c84-4bb1-8b3f-0c48acec1215] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:47.776634 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3d1ce938-85c0-488d-baf8-84a650b3d5b9 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:47.777081 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3d1ce938-85c0-488d-baf8-84a650b3d5b9 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:47.777901 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3d1ce938-85c0-488d-baf8-84a650b3d5b9 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:47.778669 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3d1ce938-85c0-488d-baf8-84a650b3d5b9 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:47.930488 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-3d1ce938-85c0-488d-baf8-84a650b3d5b9 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a609c39c14343e1bc1edd4b3cd56dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116def61aba4631be91f67df63ebab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:47.939384 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-3d1ce938-85c0-488d-baf8-84a650b3d5b9 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] 10.222.0.17 "GET /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215" status: 200 len: 1505 microversion: 2.1 time: 0.175232 Jul 23 21:25:47.939975 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1456/2948] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:47 2022] GET /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215 => generated 1505 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:47.955044 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-21360d46-3021-47ff-a035-d23b3a93a897 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:47.955656 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-21360d46-3021-47ff-a035-d23b3a93a897 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] [instance: 4085bec2-40ec-4324-b718-2c7ec388a22e] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:47.962030 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-21360d46-3021-47ff-a035-d23b3a93a897 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:47.962739 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-21360d46-3021-47ff-a035-d23b3a93a897 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:47.963522 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-21360d46-3021-47ff-a035-d23b3a93a897 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:47.964223 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-21360d46-3021-47ff-a035-d23b3a93a897 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:48.197383 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-21360d46-3021-47ff-a035-d23b3a93a897 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961e46ab94f4fffbc606485935ce64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8305585b60d54beeb2b087a37260a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:48.206582 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-21360d46-3021-47ff-a035-d23b3a93a897 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] 10.222.0.17 "GET /compute/v2.1/servers/4085bec2-40ec-4324-b718-2c7ec388a22e" status: 200 len: 1324 microversion: 2.1 time: 0.255442 Jul 23 21:25:48.207430 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1493/2949] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:47 2022] GET /compute/v2.1/servers/4085bec2-40ec-4324-b718-2c7ec388a22e => generated 1324 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:48.230035 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-42c124d2-7fcf-4d3c-a043-97111041dfeb tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:48.230702 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-42c124d2-7fcf-4d3c-a043-97111041dfeb tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: d303403b-5d14-443b-a6fe-f8b579d24cda] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:48.238481 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-42c124d2-7fcf-4d3c-a043-97111041dfeb tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:48.238947 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-42c124d2-7fcf-4d3c-a043-97111041dfeb tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:48.239756 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-42c124d2-7fcf-4d3c-a043-97111041dfeb tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:48.240201 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-42c124d2-7fcf-4d3c-a043-97111041dfeb tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:48.363133 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c72081e1-d363-4e0e-b093-6b49ca2522ef tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:48.363354 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-c72081e1-d363-4e0e-b093-6b49ca2522ef tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:48.372363 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c72081e1-d363-4e0e-b093-6b49ca2522ef tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:48.372824 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c72081e1-d363-4e0e-b093-6b49ca2522ef tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:48.373632 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c72081e1-d363-4e0e-b093-6b49ca2522ef tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:48.374097 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c72081e1-d363-4e0e-b093-6b49ca2522ef tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:48.476061 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c72081e1-d363-4e0e-b093-6b49ca2522ef tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:48.490811 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c72081e1-d363-4e0e-b093-6b49ca2522ef tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:48.493248 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c72081e1-d363-4e0e-b093-6b49ca2522ef tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:48.494804 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-c72081e1-d363-4e0e-b093-6b49ca2522ef tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.136204 Jul 23 21:25:48.506358 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1494/2950] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:25:48 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:25:48.589640 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-5c7465e7-6b7e-4a86-aa16-d12f8e558396 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:48.590692 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-5c7465e7-6b7e-4a86-aa16-d12f8e558396 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] [instance: 35d0d067-4f24-45a4-b03c-32346b764d3c] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:48.599795 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5c7465e7-6b7e-4a86-aa16-d12f8e558396 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:48.604549 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5c7465e7-6b7e-4a86-aa16-d12f8e558396 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:48.605685 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5c7465e7-6b7e-4a86-aa16-d12f8e558396 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:48.608663 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5c7465e7-6b7e-4a86-aa16-d12f8e558396 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:48.617388 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-42c124d2-7fcf-4d3c-a043-97111041dfeb tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:48.632415 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-42c124d2-7fcf-4d3c-a043-97111041dfeb tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda" status: 200 len: 1317 microversion: 2.1 time: 0.406589 Jul 23 21:25:48.634104 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1457/2951] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:48 2022] GET /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda => generated 1317 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:48.641363 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5e087d89-b6d1-4ac1-b8c8-78dd21016079 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:48.642396 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5e087d89-b6d1-4ac1-b8c8-78dd21016079 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] [instance: 34973378-2075-4fc5-88c2-ab65d5d9fcb8] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:48.651812 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5e087d89-b6d1-4ac1-b8c8-78dd21016079 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:48.653254 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5e087d89-b6d1-4ac1-b8c8-78dd21016079 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:48.654451 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5e087d89-b6d1-4ac1-b8c8-78dd21016079 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:48.655878 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5e087d89-b6d1-4ac1-b8c8-78dd21016079 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:49.033587 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-5c7465e7-6b7e-4a86-aa16-d12f8e558396 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859c1493a30d4386b74377ab2b9bc81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3efb8824be84323b6ec04b604775bd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:49.045294 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-5c7465e7-6b7e-4a86-aa16-d12f8e558396 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] 10.222.0.17 "GET /compute/v2.1/servers/35d0d067-4f24-45a4-b03c-32346b764d3c" status: 200 len: 1519 microversion: 2.1 time: 0.463263 Jul 23 21:25:49.046481 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1495/2952] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:48 2022] GET /compute/v2.1/servers/35d0d067-4f24-45a4-b03c-32346b764d3c => generated 1519 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:25:49.052715 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-5c0fb0ed-e26f-498e-987e-bfddd58cb11b tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:49.053643 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-5c0fb0ed-e26f-498e-987e-bfddd58cb11b tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] [instance: cb3a66a8-4c84-4bb1-8b3f-0c48acec1215] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:49.070921 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5c0fb0ed-e26f-498e-987e-bfddd58cb11b tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:49.071599 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5c0fb0ed-e26f-498e-987e-bfddd58cb11b tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:49.072563 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5c0fb0ed-e26f-498e-987e-bfddd58cb11b tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:49.073254 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5c0fb0ed-e26f-498e-987e-bfddd58cb11b tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:49.309061 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-5c0fb0ed-e26f-498e-987e-bfddd58cb11b tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a609c39c14343e1bc1edd4b3cd56dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116def61aba4631be91f67df63ebab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:49.324302 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-5c0fb0ed-e26f-498e-987e-bfddd58cb11b tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] 10.222.0.17 "GET /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215" status: 200 len: 1505 microversion: 2.1 time: 0.276449 Jul 23 21:25:49.330555 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1496/2953] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:49 2022] GET /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215 => generated 1505 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:49.347175 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-3618fbd2-92ee-4131-8ab3-9a2f7aa0523d tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:49.347811 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-3618fbd2-92ee-4131-8ab3-9a2f7aa0523d tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] [instance: 4085bec2-40ec-4324-b718-2c7ec388a22e] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:49.354431 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3618fbd2-92ee-4131-8ab3-9a2f7aa0523d tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:49.354939 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3618fbd2-92ee-4131-8ab3-9a2f7aa0523d tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:49.355686 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3618fbd2-92ee-4131-8ab3-9a2f7aa0523d tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:49.356133 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3618fbd2-92ee-4131-8ab3-9a2f7aa0523d tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:49.587578 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5e087d89-b6d1-4ac1-b8c8-78dd21016079 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7b95c6fb6743cf9f1942a6328a1ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f8e8d61274d54bd996140a9ab38f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:49.606149 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5e087d89-b6d1-4ac1-b8c8-78dd21016079 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] 10.222.0.17 "GET /compute/v2.1/servers/34973378-2075-4fc5-88c2-ab65d5d9fcb8" status: 200 len: 1521 microversion: 2.1 time: 0.970154 Jul 23 21:25:49.612477 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1458/2954] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:48 2022] GET /compute/v2.1/servers/34973378-2075-4fc5-88c2-ab65d5d9fcb8 => generated 1521 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:49.630431 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-662c90e0-29f7-427a-a929-c7df5d6cf1d4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:49.631060 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-662c90e0-29f7-427a-a929-c7df5d6cf1d4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:49.655521 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-662c90e0-29f7-427a-a929-c7df5d6cf1d4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:49.657330 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-3618fbd2-92ee-4131-8ab3-9a2f7aa0523d tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961e46ab94f4fffbc606485935ce64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8305585b60d54beeb2b087a37260a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:49.659894 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-662c90e0-29f7-427a-a929-c7df5d6cf1d4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:49.660679 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-662c90e0-29f7-427a-a929-c7df5d6cf1d4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:49.662343 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-662c90e0-29f7-427a-a929-c7df5d6cf1d4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:49.673931 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-3618fbd2-92ee-4131-8ab3-9a2f7aa0523d tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] 10.222.0.17 "GET /compute/v2.1/servers/4085bec2-40ec-4324-b718-2c7ec388a22e" status: 200 len: 1521 microversion: 2.1 time: 0.337973 Jul 23 21:25:49.693302 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1497/2955] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:49 2022] GET /compute/v2.1/servers/4085bec2-40ec-4324-b718-2c7ec388a22e => generated 1521 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:49.711750 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-b8390d19-056b-4e12-bb51-289b71493417 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:49.718432 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-b8390d19-056b-4e12-bb51-289b71493417 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: d303403b-5d14-443b-a6fe-f8b579d24cda] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:49.732458 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b8390d19-056b-4e12-bb51-289b71493417 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:49.732914 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b8390d19-056b-4e12-bb51-289b71493417 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:49.746314 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b8390d19-056b-4e12-bb51-289b71493417 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:49.746900 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b8390d19-056b-4e12-bb51-289b71493417 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:49.940533 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-662c90e0-29f7-427a-a929-c7df5d6cf1d4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:49.950174 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-662c90e0-29f7-427a-a929-c7df5d6cf1d4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:49.951670 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-662c90e0-29f7-427a-a929-c7df5d6cf1d4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:49.952860 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-662c90e0-29f7-427a-a929-c7df5d6cf1d4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.337348 Jul 23 21:25:49.964508 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1459/2956] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:25:49 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:25:49.969853 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2dd97ade-c7be-493c-b67b-874d66fa23bb tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:49.970681 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-2dd97ade-c7be-493c-b67b-874d66fa23bb tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] [instance: 4085bec2-40ec-4324-b718-2c7ec388a22e] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:49.975668 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-b8390d19-056b-4e12-bb51-289b71493417 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:49.977506 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2dd97ade-c7be-493c-b67b-874d66fa23bb tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:49.978148 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2dd97ade-c7be-493c-b67b-874d66fa23bb tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:49.979157 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2dd97ade-c7be-493c-b67b-874d66fa23bb tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:49.979752 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2dd97ade-c7be-493c-b67b-874d66fa23bb tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:49.986938 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-b8390d19-056b-4e12-bb51-289b71493417 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda" status: 200 len: 1317 microversion: 2.1 time: 0.294518 Jul 23 21:25:49.989321 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1498/2957] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:49 2022] GET /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda => generated 1317 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:50.153893 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-2cabfc34-d0c8-4f1c-aabb-b91415ab86a5 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1338415740", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "networks": [{"uuid": "c89c9ae3-a9c7-4e98-860d-e9f8ea64bbcb"}]}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:25:50.223194 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.network.neutron [None req-2cabfc34-d0c8-4f1c-aabb-b91415ab86a5 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] validate_networks() for [('c89c9ae3-a9c7-4e98-860d-e9f8ea64bbcb', None, None, None, None, None)] {{(pid=131321) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:25:50.359619 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-2dd97ade-c7be-493c-b67b-874d66fa23bb tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961e46ab94f4fffbc606485935ce64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8305585b60d54beeb2b087a37260a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:50.371244 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2dd97ade-c7be-493c-b67b-874d66fa23bb tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] 10.222.0.17 "GET /compute/v2.1/servers/4085bec2-40ec-4324-b718-2c7ec388a22e" status: 200 len: 1521 microversion: 2.1 time: 0.405214 Jul 23 21:25:50.377041 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1460/2958] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:49 2022] GET /compute/v2.1/servers/4085bec2-40ec-4324-b718-2c7ec388a22e => generated 1521 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:50.386836 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-8bd33f7b-0eb6-4dde-bfb9-58cc357739b5 req-7ecc6d92-9179-42ff-a2c5-c25958c256fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7da7a2f3-d7d5-4413-9967-4be43db261fa", "name": "network-vif-deleted", "tag": "ee408eac-db3f-4902-ae57-cfe1b8d701d2"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:25:50.397487 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-8bd33f7b-0eb6-4dde-bfb9-58cc357739b5 req-7ecc6d92-9179-42ff-a2c5-c25958c256fe service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:50.398436 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-8bd33f7b-0eb6-4dde-bfb9-58cc357739b5 req-7ecc6d92-9179-42ff-a2c5-c25958c256fe service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:50.410633 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-8bd33f7b-0eb6-4dde-bfb9-58cc357739b5 req-7ecc6d92-9179-42ff-a2c5-c25958c256fe service nova] Creating event network-vif-deleted:ee408eac-db3f-4902-ae57-cfe1b8d701d2 for instance 7da7a2f3-d7d5-4413-9967-4be43db261fa on nch2-master-1 Jul 23 21:25:50.416041 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-8bd33f7b-0eb6-4dde-bfb9-58cc357739b5 req-7ecc6d92-9179-42ff-a2c5-c25958c256fe service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036769 Jul 23 21:25:50.416895 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1461/2959] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:25:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:25:50.422495 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-10e94c95-0548-4662-8b5f-a7d53b34b054 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:50.423275 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-10e94c95-0548-4662-8b5f-a7d53b34b054 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] [instance: 35d0d067-4f24-45a4-b03c-32346b764d3c] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:50.430099 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-10e94c95-0548-4662-8b5f-a7d53b34b054 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:50.430864 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-10e94c95-0548-4662-8b5f-a7d53b34b054 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:50.431619 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-10e94c95-0548-4662-8b5f-a7d53b34b054 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:50.432213 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-10e94c95-0548-4662-8b5f-a7d53b34b054 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:50.757443 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-2cabfc34-d0c8-4f1c-aabb-b91415ab86a5 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Flavor limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:25:50.758045 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-2cabfc34-d0c8-4f1c-aabb-b91415ab86a5 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Image limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:25:50.758829 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-2cabfc34-d0c8-4f1c-aabb-b91415ab86a5 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Flavor pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:25:50.759433 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-2cabfc34-d0c8-4f1c-aabb-b91415ab86a5 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Image pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:25:50.760132 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-2cabfc34-d0c8-4f1c-aabb-b91415ab86a5 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:25:50.778278 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2cabfc34-d0c8-4f1c-aabb-b91415ab86a5 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:50.779972 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2cabfc34-d0c8-4f1c-aabb-b91415ab86a5 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:50.782604 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2cabfc34-d0c8-4f1c-aabb-b91415ab86a5 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:50.784337 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2cabfc34-d0c8-4f1c-aabb-b91415ab86a5 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:50.841227 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-10e94c95-0548-4662-8b5f-a7d53b34b054 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859c1493a30d4386b74377ab2b9bc81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3efb8824be84323b6ec04b604775bd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:50.844768 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-2cabfc34-d0c8-4f1c-aabb-b91415ab86a5 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Getting quotas for project a892bfe56afd4ee5bb6c47e926af7349. Resources: {'ram', 'instances', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:25:50.853708 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-2cabfc34-d0c8-4f1c-aabb-b91415ab86a5 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Getting quotas for user affc3572ef7d45249f50b5061a681d18 and project a892bfe56afd4ee5bb6c47e926af7349. Resources: {'ram', 'instances', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:25:50.854517 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-10e94c95-0548-4662-8b5f-a7d53b34b054 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] 10.222.0.17 "GET /compute/v2.1/servers/35d0d067-4f24-45a4-b03c-32346b764d3c" status: 200 len: 1519 microversion: 2.1 time: 0.435923 Jul 23 21:25:50.862611 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1462/2960] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:50 2022] GET /compute/v2.1/servers/35d0d067-4f24-45a4-b03c-32346b764d3c => generated 1519 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:50.862611 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0520f9fb-021c-4fa1-be77-8a24f617b27e tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:50.865806 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-0520f9fb-021c-4fa1-be77-8a24f617b27e tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] [instance: cb3a66a8-4c84-4bb1-8b3f-0c48acec1215] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:50.876775 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0520f9fb-021c-4fa1-be77-8a24f617b27e tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:50.877425 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0520f9fb-021c-4fa1-be77-8a24f617b27e tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:50.878474 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0520f9fb-021c-4fa1-be77-8a24f617b27e tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:50.879098 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0520f9fb-021c-4fa1-be77-8a24f617b27e tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:50.884058 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-2cabfc34-d0c8-4f1c-aabb-b91415ab86a5 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Going to run 1 instances... {{(pid=131321) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:25:50.886510 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-2cabfc34-d0c8-4f1c-aabb-b91415ab86a5 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: e893255e-87db-418f-8374-dc2d800f4ff5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131321) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:25:50.958979 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-2cabfc34-d0c8-4f1c-aabb-b91415ab86a5 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.966439 Jul 23 21:25:50.960987 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1499/2961] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:25:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 971 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 23 21:25:50.968037 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d19c6fb9-304b-42f1-9ad7-04bb49215476 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1489721779"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:25:50.971739 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-d19c6fb9-304b-42f1-9ad7-04bb49215476 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] [instance: 4085bec2-40ec-4324-b718-2c7ec388a22e] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:50.980989 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d19c6fb9-304b-42f1-9ad7-04bb49215476 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:50.981959 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d19c6fb9-304b-42f1-9ad7-04bb49215476 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:50.983015 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d19c6fb9-304b-42f1-9ad7-04bb49215476 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:50.983547 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d19c6fb9-304b-42f1-9ad7-04bb49215476 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:51.126721 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-0520f9fb-021c-4fa1-be77-8a24f617b27e tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a609c39c14343e1bc1edd4b3cd56dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116def61aba4631be91f67df63ebab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:51.135755 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-0520f9fb-021c-4fa1-be77-8a24f617b27e tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] 10.222.0.17 "GET /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215" status: 200 len: 1505 microversion: 2.1 time: 0.278303 Jul 23 21:25:51.136762 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1463/2962] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:50 2022] GET /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215 => generated 1505 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:51.143125 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-dd9ed135-4607-414e-aaf9-c7b92df9cd47 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:51.144206 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-dd9ed135-4607-414e-aaf9-c7b92df9cd47 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] [instance: 34973378-2075-4fc5-88c2-ab65d5d9fcb8] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:51.152362 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dd9ed135-4607-414e-aaf9-c7b92df9cd47 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:51.153128 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dd9ed135-4607-414e-aaf9-c7b92df9cd47 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:51.154245 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dd9ed135-4607-414e-aaf9-c7b92df9cd47 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:51.155144 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dd9ed135-4607-414e-aaf9-c7b92df9cd47 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:51.192944 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dd9ed135-4607-414e-aaf9-c7b92df9cd47 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:51.193757 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dd9ed135-4607-414e-aaf9-c7b92df9cd47 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:51.194935 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.objects.instance [None req-dd9ed135-4607-414e-aaf9-c7b92df9cd47 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lazy-loading 'fault' on Instance uuid 34973378-2075-4fc5-88c2-ab65d5d9fcb8 {{(pid=131320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:25:51.247691 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-dd9ed135-4607-414e-aaf9-c7b92df9cd47 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a7b95c6fb6743cf9f1942a6328a1ba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '892f8e8d61274d54bd996140a9ab38f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:51.256402 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-dd9ed135-4607-414e-aaf9-c7b92df9cd47 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] 10.222.0.17 "GET /compute/v2.1/servers/34973378-2075-4fc5-88c2-ab65d5d9fcb8" status: 200 len: 1312 microversion: 2.1 time: 0.118255 Jul 23 21:25:51.257615 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1464/2963] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:51 2022] GET /compute/v2.1/servers/34973378-2075-4fc5-88c2-ab65d5d9fcb8 => generated 1312 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:51.262439 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5345441a-9de2-4d6c-81f3-e0104d1f5b48 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:51.263254 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5345441a-9de2-4d6c-81f3-e0104d1f5b48 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: e893255e-87db-418f-8374-dc2d800f4ff5] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:51.343288 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5345441a-9de2-4d6c-81f3-e0104d1f5b48 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:51.352676 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5345441a-9de2-4d6c-81f3-e0104d1f5b48 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/e893255e-87db-418f-8374-dc2d800f4ff5" status: 200 len: 1215 microversion: 2.1 time: 0.093727 Jul 23 21:25:51.353271 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1465/2964] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:51 2022] GET /compute/v2.1/servers/e893255e-87db-418f-8374-dc2d800f4ff5 => generated 1215 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:51.357150 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-d19c6fb9-304b-42f1-9ad7-04bb49215476 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] 10.222.0.17 "POST /compute/v2.1/servers/4085bec2-40ec-4324-b718-2c7ec388a22e/action" status: 202 len: 0 microversion: 2.1 time: 0.392619 Jul 23 21:25:51.357835 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1500/2965] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:25:50 2022] POST /compute/v2.1/servers/4085bec2-40ec-4324-b718-2c7ec388a22e/action => generated 0 bytes in 396 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 23 21:25:51.360165 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3383c6fb-97ed-49a9-ac43-5099a3e8851f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:51.361131 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-3383c6fb-97ed-49a9-ac43-5099a3e8851f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:51.367830 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-255c03de-7133-4200-b375-0d14a25ac8cb tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:51.368711 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-255c03de-7133-4200-b375-0d14a25ac8cb tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: d303403b-5d14-443b-a6fe-f8b579d24cda] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:51.378525 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-255c03de-7133-4200-b375-0d14a25ac8cb tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:51.379099 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-255c03de-7133-4200-b375-0d14a25ac8cb tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:51.380226 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-255c03de-7133-4200-b375-0d14a25ac8cb tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:51.381359 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-255c03de-7133-4200-b375-0d14a25ac8cb tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:51.399536 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3383c6fb-97ed-49a9-ac43-5099a3e8851f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:51.399536 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3383c6fb-97ed-49a9-ac43-5099a3e8851f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:51.399536 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3383c6fb-97ed-49a9-ac43-5099a3e8851f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:51.399536 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3383c6fb-97ed-49a9-ac43-5099a3e8851f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:51.499840 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-3383c6fb-97ed-49a9-ac43-5099a3e8851f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:51.510168 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-3383c6fb-97ed-49a9-ac43-5099a3e8851f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:51.511689 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-3383c6fb-97ed-49a9-ac43-5099a3e8851f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:51.512955 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-3383c6fb-97ed-49a9-ac43-5099a3e8851f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.158297 Jul 23 21:25:51.513712 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1466/2966] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:25:51 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:25:51.518563 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d47f329e-e775-48bf-8321-cb3da7e4f65d tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Calling method '.version_select at 0x7f0b46b47700>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:51.661330 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-255c03de-7133-4200-b375-0d14a25ac8cb tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:51.674379 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-255c03de-7133-4200-b375-0d14a25ac8cb tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda" status: 200 len: 1507 microversion: 2.1 time: 0.314284 Jul 23 21:25:51.676368 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1501/2967] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:51 2022] GET /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda => generated 1507 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:51.692054 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-50b57df0-1cb2-4736-b1ac-bb53247a13a9 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:51.692680 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-50b57df0-1cb2-4736-b1ac-bb53247a13a9 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: d303403b-5d14-443b-a6fe-f8b579d24cda] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:51.699348 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-50b57df0-1cb2-4736-b1ac-bb53247a13a9 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:51.699810 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-50b57df0-1cb2-4736-b1ac-bb53247a13a9 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:51.699957 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d47f329e-e775-48bf-8321-cb3da7e4f65d tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] 10.222.0.17 "DELETE /compute/v2.1/images/615de04a-cf34-4112-a033-e855280ef35c" status: 204 len: 0 microversion: 2.1 time: 0.184592 Jul 23 21:25:51.700600 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-50b57df0-1cb2-4736-b1ac-bb53247a13a9 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:51.700935 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1467/2968] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:51 2022] DELETE /compute/v2.1/images/615de04a-cf34-4112-a033-e855280ef35c => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:25:51.701085 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-50b57df0-1cb2-4736-b1ac-bb53247a13a9 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:51.709589 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f0f6fa51-5e63-414d-b4d9-f71cb3e8cdf5 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Calling method '.version_select at 0x7f0b46b47ee0>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:51.746468 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-f0f6fa51-5e63-414d-b4d9-f71cb3e8cdf5 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] HTTP exception thrown: Image not found. Jul 23 21:25:51.749393 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f0f6fa51-5e63-414d-b4d9-f71cb3e8cdf5 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Request method failure captured: Jul 23 21:25:51.749393 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/images/615de04a-cf34-4112-a033-e855280ef35c HTTP/1.1 Jul 23 21:25:51.749393 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:25:51.749393 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:25:51.749393 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:25:51.749393 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:25:51.749393 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:25:51.749393 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:25:51.749393 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:25:51.749393 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:25:51.749393 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GcdFkVYIK2DtJm403sM7IG79jHXbShtkQheCHNeqOWOy-LrSxvgAeYLVbMoRM5VFKN6qfODnVk_B5qM-rDymLVGR4aR0RY1RwNvXXeBnLkJldpttrzdMpyZMOqZL8mI9RN_pqnVy4UDfpP9Qj4sUGOBflgakohNp1Y8WLMI7QhzBds Jul 23 21:25:51.749393 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:25:51.749393 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:25:51.749393 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:25:51.749393 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:25:51.749393 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:25:51.749393 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:25:51.749393 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 8305585b60d54beeb2b087a37260a89a Jul 23 21:25:51.749393 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1030577641 Jul 23 21:25:51.749393 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:25:51.749393 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:25:51.749393 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8305585b60d54beeb2b087a37260a89a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8305585b60d54beeb2b087a37260a89a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8305585b60d54beeb2b087a37260a89a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8305585b60d54beeb2b087a37260a89a"}]}] Jul 23 21:25:51.749393 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1030577641 Jul 23 21:25:51.749393 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 8305585b60d54beeb2b087a37260a89a Jul 23 21:25:51.749393 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1030577641 Jul 23 21:25:51.749393 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ImagesOneServerNegativeTestJSON-1030577641-project Jul 23 21:25:51.749393 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:25:51.749393 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:25:51.749393 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: e961e46ab94f4fffbc606485935ce64d Jul 23 21:25:51.749393 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1030577641-project Jul 23 21:25:51.749393 ncdv-master-1 devstack@n-api.service[131320]: method: Jul 23 21:25:51.749393 ncdv-master-1 devstack@n-api.service[131320]: exception: Image not found. Jul 23 21:25:51.749393 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '615de04a-cf34-4112-a033-e855280ef35c'} Jul 23 21:25:51.749393 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:25:51.749393 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:25:51.749393 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 23 21:25:51.749393 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 23 21:25:51.749393 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 23 21:25:51.749393 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 23 21:25:51.749393 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 23 21:25:51.749393 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 23 21:25:51.749393 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 23 21:25:51.749393 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 23 21:25:51.749393 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 23 21:25:51.749393 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 23 21:25:51.749393 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 23 21:25:51.749393 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 23 21:25:51.749393 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 23 21:25:51.749393 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 23 21:25:51.749393 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 23 21:25:51.749393 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 23 21:25:51.749393 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 615de04a-cf34-4112-a033-e855280ef35c Jul 23 21:25:51.749393 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:25:51.749393 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:25:51.749393 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:25:51.749393 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:25:51.749393 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 23 21:25:51.749393 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 23 21:25:51.749393 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 23 21:25:51.749393 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 23 21:25:51.749393 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 23 21:25:51.749393 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 23 21:25:51.749393 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 23 21:25:51.754013 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 23 21:25:51.754013 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 23 21:25:51.754013 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 23 21:25:51.754013 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 23 21:25:51.754013 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 23 21:25:51.754013 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 23 21:25:51.754013 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 23 21:25:51.754013 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 23 21:25:51.754013 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 23 21:25:51.754013 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 23 21:25:51.754013 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 23 21:25:51.754013 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 23 21:25:51.754013 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 23 21:25:51.754013 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 23 21:25:51.754013 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 23 21:25:51.754013 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 23 21:25:51.754013 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 23 21:25:51.754013 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 615de04a-cf34-4112-a033-e855280ef35c could not be found. Jul 23 21:25:51.754013 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:25:51.754013 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:25:51.754013 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:25:51.754013 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:25:51.754013 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:25:51.754013 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:25:51.754013 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:25:51.754013 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:25:51.754013 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:25:51.754013 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:25:51.754013 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:25:51.754013 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:25:51.754013 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 23 21:25:51.754013 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 23 21:25:51.754013 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 23 21:25:51.754013 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:25:51.754013 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:25:51.754013 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:25:51.754013 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:25:51.754013 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:25:51.754013 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:25:51.754013 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:25:51.754013 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:25:51.754013 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 23 21:25:51.754013 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:25:51.758860 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f0f6fa51-5e63-414d-b4d9-f71cb3e8cdf5 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Returning 404 to user: Image not found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:25:51.758860 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f0f6fa51-5e63-414d-b4d9-f71cb3e8cdf5 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] 10.222.0.17 "GET /compute/v2.1/images/615de04a-cf34-4112-a033-e855280ef35c" status: 404 len: 62 microversion: 2.1 time: 0.050640 Jul 23 21:25:51.762250 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1468/2969] 10.222.0.17 () {58 vars in 1232 bytes} [Sat Jul 23 21:25:51 2022] GET /compute/v2.1/images/615de04a-cf34-4112-a033-e855280ef35c => generated 62 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 23 21:25:51.768562 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-814f502a-06fc-4785-9932-e2c0e5b80702 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:51.769333 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-814f502a-06fc-4785-9932-e2c0e5b80702 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] [instance: 4085bec2-40ec-4324-b718-2c7ec388a22e] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:51.785237 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-814f502a-06fc-4785-9932-e2c0e5b80702 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:51.785825 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-814f502a-06fc-4785-9932-e2c0e5b80702 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:51.786719 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-814f502a-06fc-4785-9932-e2c0e5b80702 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:51.787229 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-814f502a-06fc-4785-9932-e2c0e5b80702 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:51.965206 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-814f502a-06fc-4785-9932-e2c0e5b80702 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961e46ab94f4fffbc606485935ce64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8305585b60d54beeb2b087a37260a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:51.969529 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-50b57df0-1cb2-4736-b1ac-bb53247a13a9 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:51.977243 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-814f502a-06fc-4785-9932-e2c0e5b80702 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] 10.222.0.17 "GET /compute/v2.1/servers/4085bec2-40ec-4324-b718-2c7ec388a22e" status: 200 len: 1533 microversion: 2.1 time: 0.213744 Jul 23 21:25:51.980212 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-50b57df0-1cb2-4736-b1ac-bb53247a13a9 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda" status: 200 len: 1507 microversion: 2.1 time: 0.291187 Jul 23 21:25:51.981000 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1502/2970] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:51 2022] GET /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda => generated 1507 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:51.988970 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ee38d1b3-4d4f-41bf-a076-1c77d15e6274 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:51.990454 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-ee38d1b3-4d4f-41bf-a076-1c77d15e6274 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] [instance: 35d0d067-4f24-45a4-b03c-32346b764d3c] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:51.998316 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ee38d1b3-4d4f-41bf-a076-1c77d15e6274 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:51.999072 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ee38d1b3-4d4f-41bf-a076-1c77d15e6274 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:52.000216 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ee38d1b3-4d4f-41bf-a076-1c77d15e6274 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:52.000983 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ee38d1b3-4d4f-41bf-a076-1c77d15e6274 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:52.006084 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1469/2971] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:51 2022] GET /compute/v2.1/servers/4085bec2-40ec-4324-b718-2c7ec388a22e => generated 1533 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:52.011587 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-fdd5ee8d-a0ba-45fb-b228-1eac81a092d6 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "OS-DCF:diskConfig": "AUTO"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:25:52.013428 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-fdd5ee8d-a0ba-45fb-b228-1eac81a092d6 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: d303403b-5d14-443b-a6fe-f8b579d24cda] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:52.021970 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fdd5ee8d-a0ba-45fb-b228-1eac81a092d6 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:52.022436 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fdd5ee8d-a0ba-45fb-b228-1eac81a092d6 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:52.023514 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fdd5ee8d-a0ba-45fb-b228-1eac81a092d6 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:52.024944 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fdd5ee8d-a0ba-45fb-b228-1eac81a092d6 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:52.153546 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-fdd5ee8d-a0ba-45fb-b228-1eac81a092d6 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:25:52.154339 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-fdd5ee8d-a0ba-45fb-b228-1eac81a092d6 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:25:52.154991 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-fdd5ee8d-a0ba-45fb-b228-1eac81a092d6 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:25:52.155482 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-fdd5ee8d-a0ba-45fb-b228-1eac81a092d6 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:25:52.156080 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-fdd5ee8d-a0ba-45fb-b228-1eac81a092d6 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:25:52.168705 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ee38d1b3-4d4f-41bf-a076-1c77d15e6274 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859c1493a30d4386b74377ab2b9bc81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3efb8824be84323b6ec04b604775bd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:52.178816 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-ee38d1b3-4d4f-41bf-a076-1c77d15e6274 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] 10.222.0.17 "GET /compute/v2.1/servers/35d0d067-4f24-45a4-b03c-32346b764d3c" status: 200 len: 1519 microversion: 2.1 time: 0.196139 Jul 23 21:25:52.188794 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1503/2972] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:51 2022] GET /compute/v2.1/servers/35d0d067-4f24-45a4-b03c-32346b764d3c => generated 1519 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:52.194593 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:25:52.199638 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a80ce745-4d8a-4edd-9557-f52c8c752057 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:52.200382 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-a80ce745-4d8a-4edd-9557-f52c8c752057 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] [instance: cb3a66a8-4c84-4bb1-8b3f-0c48acec1215] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:52.209226 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a80ce745-4d8a-4edd-9557-f52c8c752057 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:52.209678 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a80ce745-4d8a-4edd-9557-f52c8c752057 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:52.210633 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a80ce745-4d8a-4edd-9557-f52c8c752057 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:52.211061 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a80ce745-4d8a-4edd-9557-f52c8c752057 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:52.231543 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:25:52.254186 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-fdd5ee8d-a0ba-45fb-b228-1eac81a092d6 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: d303403b-5d14-443b-a6fe-f8b579d24cda] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:52.267942 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fdd5ee8d-a0ba-45fb-b228-1eac81a092d6 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:52.268830 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fdd5ee8d-a0ba-45fb-b228-1eac81a092d6 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:52.270171 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fdd5ee8d-a0ba-45fb-b228-1eac81a092d6 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:52.270921 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fdd5ee8d-a0ba-45fb-b228-1eac81a092d6 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:52.330247 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-fdd5ee8d-a0ba-45fb-b228-1eac81a092d6 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "POST /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda/action" status: 202 len: 1109 microversion: 2.1 time: 0.322587 Jul 23 21:25:52.331602 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1470/2973] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:25:52 2022] POST /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda/action => generated 1109 bytes in 325 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 23 21:25:52.336693 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-63e50892-f523-47ba-8713-b29385c0c41b tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:52.337632 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-63e50892-f523-47ba-8713-b29385c0c41b tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] [instance: 34973378-2075-4fc5-88c2-ab65d5d9fcb8] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:52.360196 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-63e50892-f523-47ba-8713-b29385c0c41b tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:52.360972 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-63e50892-f523-47ba-8713-b29385c0c41b tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:52.363553 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-63e50892-f523-47ba-8713-b29385c0c41b tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:52.364291 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-63e50892-f523-47ba-8713-b29385c0c41b tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:52.390101 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-63e50892-f523-47ba-8713-b29385c0c41b tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] HTTP exception thrown: Instance 34973378-2075-4fc5-88c2-ab65d5d9fcb8 could not be found. Jul 23 21:25:52.392929 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-63e50892-f523-47ba-8713-b29385c0c41b tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Request method failure captured: Jul 23 21:25:52.392929 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/34973378-2075-4fc5-88c2-ab65d5d9fcb8 HTTP/1.1 Jul 23 21:25:52.392929 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:25:52.392929 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:25:52.392929 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:25:52.392929 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:25:52.392929 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:25:52.392929 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:25:52.392929 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:25:52.392929 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:25:52.392929 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3Gc1L1PADC1CM70W3hT0FVjoa4HtwwH3JOQkmjqciZITuhOEr0t_UZ35l8A4x914Pv0RWdOTKosFZHAL_zCSDMHc2rV1eM8cfyYDuR_tfl2tndicDedGBRHNkTAkJcQzYaxqlYrCR7nDja51eRALEogCD7UYUmxPfBufihds_7Z_B54 Jul 23 21:25:52.392929 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:25:52.392929 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:25:52.392929 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:25:52.392929 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:25:52.392929 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:25:52.392929 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:25:52.392929 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 892f8e8d61274d54bd996140a9ab38f9 Jul 23 21:25:52.392929 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ListServersNegativeTestJSON-574240373 Jul 23 21:25:52.392929 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:25:52.392929 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:25:52.392929 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/892f8e8d61274d54bd996140a9ab38f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/892f8e8d61274d54bd996140a9ab38f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_892f8e8d61274d54bd996140a9ab38f9", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/892f8e8d61274d54bd996140a9ab38f9"}]}] Jul 23 21:25:52.392929 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ListServersNegativeTestJSON-574240373 Jul 23 21:25:52.392929 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 892f8e8d61274d54bd996140a9ab38f9 Jul 23 21:25:52.392929 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-574240373 Jul 23 21:25:52.392929 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ListServersNegativeTestJSON-574240373-project Jul 23 21:25:52.392929 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:25:52.392929 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:25:52.392929 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 8a7b95c6fb6743cf9f1942a6328a1ba7 Jul 23 21:25:52.392929 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ListServersNegativeTestJSON-574240373-project Jul 23 21:25:52.392929 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:25:52.392929 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance 34973378-2075-4fc5-88c2-ab65d5d9fcb8 could not be found. Jul 23 21:25:52.392929 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '34973378-2075-4fc5-88c2-ab65d5d9fcb8'} Jul 23 21:25:52.392929 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:25:52.392929 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:25:52.392929 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:25:52.392929 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:25:52.392929 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:25:52.392929 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:25:52.392929 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:25:52.392929 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:25:52.392929 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:25:52.392929 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:25:52.392929 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34973378-2075-4fc5-88c2-ab65d5d9fcb8 could not be found. Jul 23 21:25:52.392929 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:25:52.392929 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:25:52.392929 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:25:52.392929 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:25:52.392929 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:25:52.392929 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:25:52.392929 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:25:52.392929 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:25:52.392929 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:25:52.392929 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:25:52.392929 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:25:52.392929 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:25:52.392929 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:25:52.392929 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:25:52.392929 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:25:52.392929 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:25:52.392929 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34973378-2075-4fc5-88c2-ab65d5d9fcb8 could not be found. Jul 23 21:25:52.392929 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:25:52.392929 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:25:52.392929 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:25:52.398472 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:25:52.398472 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:25:52.398472 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:25:52.398472 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:25:52.398472 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:25:52.398472 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34973378-2075-4fc5-88c2-ab65d5d9fcb8 could not be found. Jul 23 21:25:52.398472 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:25:52.404489 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-63e50892-f523-47ba-8713-b29385c0c41b tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Returning 404 to user: Instance 34973378-2075-4fc5-88c2-ab65d5d9fcb8 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:25:52.405846 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-63e50892-f523-47ba-8713-b29385c0c41b tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] 10.222.0.17 "GET /compute/v2.1/servers/34973378-2075-4fc5-88c2-ab65d5d9fcb8" status: 404 len: 111 microversion: 2.1 time: 0.073032 Jul 23 21:25:52.407153 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1471/2974] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:52 2022] GET /compute/v2.1/servers/34973378-2075-4fc5-88c2-ab65d5d9fcb8 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:25:52.415508 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f9d5fc41-1670-4bb9-99e7-0c15d4c38c0b tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:52.416415 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f9d5fc41-1670-4bb9-99e7-0c15d4c38c0b tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: d303403b-5d14-443b-a6fe-f8b579d24cda] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:52.426351 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f9d5fc41-1670-4bb9-99e7-0c15d4c38c0b tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:52.427043 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f9d5fc41-1670-4bb9-99e7-0c15d4c38c0b tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:52.428000 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f9d5fc41-1670-4bb9-99e7-0c15d4c38c0b tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:52.428608 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f9d5fc41-1670-4bb9-99e7-0c15d4c38c0b tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:52.484112 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-a80ce745-4d8a-4edd-9557-f52c8c752057 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a609c39c14343e1bc1edd4b3cd56dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116def61aba4631be91f67df63ebab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:52.497048 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-a80ce745-4d8a-4edd-9557-f52c8c752057 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] 10.222.0.17 "GET /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215" status: 200 len: 1505 microversion: 2.1 time: 0.315637 Jul 23 21:25:52.497656 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1504/2975] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:52 2022] GET /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215 => generated 1505 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:52.513428 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-6c4a4998-3fae-423a-921b-fe52cec00e31 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:52.515005 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-6c4a4998-3fae-423a-921b-fe52cec00e31 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: e893255e-87db-418f-8374-dc2d800f4ff5] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:52.522435 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6c4a4998-3fae-423a-921b-fe52cec00e31 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:52.523205 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6c4a4998-3fae-423a-921b-fe52cec00e31 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:52.524946 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6c4a4998-3fae-423a-921b-fe52cec00e31 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:52.525586 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6c4a4998-3fae-423a-921b-fe52cec00e31 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:52.604411 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-6c4a4998-3fae-423a-921b-fe52cec00e31 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:52.613706 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-6c4a4998-3fae-423a-921b-fe52cec00e31 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/e893255e-87db-418f-8374-dc2d800f4ff5" status: 200 len: 1285 microversion: 2.1 time: 0.114435 Jul 23 21:25:52.623787 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1505/2976] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:52 2022] GET /compute/v2.1/servers/e893255e-87db-418f-8374-dc2d800f4ff5 => generated 1285 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:52.629341 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-9646b2b5-b9a0-4582-b923-4d635d3d91b4 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:52.629997 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-9646b2b5-b9a0-4582-b923-4d635d3d91b4 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] [instance: 7da7a2f3-d7d5-4413-9967-4be43db261fa] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:52.631967 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:25:52.637762 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9646b2b5-b9a0-4582-b923-4d635d3d91b4 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:52.638433 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9646b2b5-b9a0-4582-b923-4d635d3d91b4 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:52.639400 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9646b2b5-b9a0-4582-b923-4d635d3d91b4 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:52.640005 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9646b2b5-b9a0-4582-b923-4d635d3d91b4 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:52.657535 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-9646b2b5-b9a0-4582-b923-4d635d3d91b4 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] HTTP exception thrown: Instance 7da7a2f3-d7d5-4413-9967-4be43db261fa could not be found. Jul 23 21:25:52.659715 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-9646b2b5-b9a0-4582-b923-4d635d3d91b4 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Request method failure captured: Jul 23 21:25:52.659715 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/servers/7da7a2f3-d7d5-4413-9967-4be43db261fa HTTP/1.1 Jul 23 21:25:52.659715 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:25:52.659715 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:25:52.659715 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:25:52.659715 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:25:52.659715 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:25:52.659715 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:25:52.659715 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:25:52.659715 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:25:52.659715 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3Gc1L1PADC1CM70W3hT0FVjoa4HtwwH3JOQkmjqciZITuhOEr0t_UZ35l8A4x914Pv0RWdOTKosFZHAL_zCSDMHc2rV1eM8cfyYDuR_tfl2tndicDedGBRHNkTAkJcQzYaxqlYrCR7nDja51eRALEogCD7UYUmxPfBufihds_7Z_B54 Jul 23 21:25:52.659715 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:25:52.659715 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:25:52.659715 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:25:52.659715 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:25:52.659715 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:25:52.659715 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:25:52.659715 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 892f8e8d61274d54bd996140a9ab38f9 Jul 23 21:25:52.659715 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ListServersNegativeTestJSON-574240373 Jul 23 21:25:52.659715 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:25:52.659715 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:25:52.659715 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/892f8e8d61274d54bd996140a9ab38f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/892f8e8d61274d54bd996140a9ab38f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_892f8e8d61274d54bd996140a9ab38f9", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/892f8e8d61274d54bd996140a9ab38f9"}]}] Jul 23 21:25:52.659715 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ListServersNegativeTestJSON-574240373 Jul 23 21:25:52.659715 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 892f8e8d61274d54bd996140a9ab38f9 Jul 23 21:25:52.659715 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-574240373 Jul 23 21:25:52.659715 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ListServersNegativeTestJSON-574240373-project Jul 23 21:25:52.659715 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:25:52.659715 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:25:52.659715 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 8a7b95c6fb6743cf9f1942a6328a1ba7 Jul 23 21:25:52.659715 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ListServersNegativeTestJSON-574240373-project Jul 23 21:25:52.659715 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:25:52.659715 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance 7da7a2f3-d7d5-4413-9967-4be43db261fa could not be found. Jul 23 21:25:52.659715 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': '7da7a2f3-d7d5-4413-9967-4be43db261fa'} Jul 23 21:25:52.659715 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:25:52.659715 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:25:52.659715 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:25:52.659715 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:25:52.659715 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:25:52.659715 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:25:52.659715 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:25:52.659715 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:25:52.659715 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:25:52.659715 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:25:52.659715 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7da7a2f3-d7d5-4413-9967-4be43db261fa could not be found. Jul 23 21:25:52.659715 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:25:52.659715 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:25:52.659715 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:25:52.659715 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:25:52.659715 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:25:52.659715 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:25:52.659715 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:25:52.659715 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:25:52.659715 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:25:52.659715 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:25:52.659715 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:25:52.659715 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:25:52.659715 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:25:52.659715 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:25:52.659715 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:25:52.659715 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:25:52.659715 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7da7a2f3-d7d5-4413-9967-4be43db261fa could not be found. Jul 23 21:25:52.659715 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:25:52.659715 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:25:52.659715 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:25:52.664719 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:25:52.664719 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:25:52.664719 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:25:52.664719 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:25:52.664719 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:25:52.664719 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7da7a2f3-d7d5-4413-9967-4be43db261fa could not be found. Jul 23 21:25:52.664719 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:25:52.666071 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-9646b2b5-b9a0-4582-b923-4d635d3d91b4 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] Returning 404 to user: Instance 7da7a2f3-d7d5-4413-9967-4be43db261fa could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:25:52.667258 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-9646b2b5-b9a0-4582-b923-4d635d3d91b4 tempest-ListServersNegativeTestJSON-574240373 tempest-ListServersNegativeTestJSON-574240373-project] 10.222.0.17 "GET /compute/v2.1/servers/7da7a2f3-d7d5-4413-9967-4be43db261fa" status: 404 len: 111 microversion: 2.1 time: 0.041972 Jul 23 21:25:52.668006 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1506/2977] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:52 2022] GET /compute/v2.1/servers/7da7a2f3-d7d5-4413-9967-4be43db261fa => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:25:52.682808 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-3f59cf3f-712c-435a-aa36-70c36651c64f req-3c0839a1-624c-4fd1-8531-7e940cda1380 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34973378-2075-4fc5-88c2-ab65d5d9fcb8", "name": "network-vif-deleted", "tag": "d20effd9-4c4d-4691-971c-97493a61fcf9"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:25:52.711859 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-3f59cf3f-712c-435a-aa36-70c36651c64f req-3c0839a1-624c-4fd1-8531-7e940cda1380 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:52.712312 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-3f59cf3f-712c-435a-aa36-70c36651c64f req-3c0839a1-624c-4fd1-8531-7e940cda1380 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:52.731936 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f9d5fc41-1670-4bb9-99e7-0c15d4c38c0b tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:52.739870 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-3f59cf3f-712c-435a-aa36-70c36651c64f req-3c0839a1-624c-4fd1-8531-7e940cda1380 service nova] Creating event network-vif-deleted:d20effd9-4c4d-4691-971c-97493a61fcf9 for instance 34973378-2075-4fc5-88c2-ab65d5d9fcb8 on nch1-master-1 Jul 23 21:25:52.740335 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f9d5fc41-1670-4bb9-99e7-0c15d4c38c0b tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda" status: 200 len: 1514 microversion: 2.1 time: 0.331818 Jul 23 21:25:52.743364 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1472/2978] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:52 2022] GET /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda => generated 1514 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:52.753421 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1a8fd542-ac2e-4be2-8b07-856c07ee290c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:52.754136 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1a8fd542-ac2e-4be2-8b07-856c07ee290c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:52.763589 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-3f59cf3f-712c-435a-aa36-70c36651c64f req-3c0839a1-624c-4fd1-8531-7e940cda1380 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091306 Jul 23 21:25:52.765896 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1507/2979] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:25:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:25:52.767004 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1a8fd542-ac2e-4be2-8b07-856c07ee290c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:52.767472 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1a8fd542-ac2e-4be2-8b07-856c07ee290c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:52.768282 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1a8fd542-ac2e-4be2-8b07-856c07ee290c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:52.768729 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1a8fd542-ac2e-4be2-8b07-856c07ee290c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:52.928570 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-1a8fd542-ac2e-4be2-8b07-856c07ee290c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:52.947344 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-1a8fd542-ac2e-4be2-8b07-856c07ee290c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:52.949760 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-1a8fd542-ac2e-4be2-8b07-856c07ee290c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:52.952247 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1a8fd542-ac2e-4be2-8b07-856c07ee290c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.205301 Jul 23 21:25:52.953517 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1473/2980] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:25:52 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:25:53.004050 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e74f3d8f-128f-4221-a79c-c2645229382f tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:53.005228 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-e74f3d8f-128f-4221-a79c-c2645229382f tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] [instance: 4085bec2-40ec-4324-b718-2c7ec388a22e] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:53.012923 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e74f3d8f-128f-4221-a79c-c2645229382f tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:53.013749 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e74f3d8f-128f-4221-a79c-c2645229382f tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:53.014811 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e74f3d8f-128f-4221-a79c-c2645229382f tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:53.015476 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e74f3d8f-128f-4221-a79c-c2645229382f tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:53.196130 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-db5dc217-495f-4452-abe5-8aea7ee8adfc tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:53.197289 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-db5dc217-495f-4452-abe5-8aea7ee8adfc tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] [instance: 35d0d067-4f24-45a4-b03c-32346b764d3c] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:53.207988 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-db5dc217-495f-4452-abe5-8aea7ee8adfc tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:53.208481 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-db5dc217-495f-4452-abe5-8aea7ee8adfc tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:53.209948 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-db5dc217-495f-4452-abe5-8aea7ee8adfc tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:53.214435 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-db5dc217-495f-4452-abe5-8aea7ee8adfc tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:53.461421 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-e74f3d8f-128f-4221-a79c-c2645229382f tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961e46ab94f4fffbc606485935ce64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8305585b60d54beeb2b087a37260a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:53.476663 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-e74f3d8f-128f-4221-a79c-c2645229382f tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] 10.222.0.17 "GET /compute/v2.1/servers/4085bec2-40ec-4324-b718-2c7ec388a22e" status: 200 len: 1539 microversion: 2.1 time: 0.476848 Jul 23 21:25:53.487685 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1508/2981] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:52 2022] GET /compute/v2.1/servers/4085bec2-40ec-4324-b718-2c7ec388a22e => generated 1539 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:53.515157 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-b573b566-7060-4d55-aa62-05d0ddd90b5a tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:53.515730 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-b573b566-7060-4d55-aa62-05d0ddd90b5a tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] [instance: cb3a66a8-4c84-4bb1-8b3f-0c48acec1215] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:53.523066 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-db5dc217-495f-4452-abe5-8aea7ee8adfc tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859c1493a30d4386b74377ab2b9bc81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3efb8824be84323b6ec04b604775bd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:53.531348 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-db5dc217-495f-4452-abe5-8aea7ee8adfc tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] 10.222.0.17 "GET /compute/v2.1/servers/35d0d067-4f24-45a4-b03c-32346b764d3c" status: 200 len: 1519 microversion: 2.1 time: 0.339055 Jul 23 21:25:53.535617 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b573b566-7060-4d55-aa62-05d0ddd90b5a tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:53.536075 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1474/2982] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:53 2022] GET /compute/v2.1/servers/35d0d067-4f24-45a4-b03c-32346b764d3c => generated 1519 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:25:53.536722 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b573b566-7060-4d55-aa62-05d0ddd90b5a tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:53.537663 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b573b566-7060-4d55-aa62-05d0ddd90b5a tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:53.538520 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b573b566-7060-4d55-aa62-05d0ddd90b5a tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:53.631726 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5a563be3-6121-4ec5-a234-a98b746c2b3e tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:53.632745 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5a563be3-6121-4ec5-a234-a98b746c2b3e tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: e893255e-87db-418f-8374-dc2d800f4ff5] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:53.640059 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5a563be3-6121-4ec5-a234-a98b746c2b3e tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:53.652248 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5a563be3-6121-4ec5-a234-a98b746c2b3e tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:53.653474 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5a563be3-6121-4ec5-a234-a98b746c2b3e tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:53.654284 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5a563be3-6121-4ec5-a234-a98b746c2b3e tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:53.823119 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-b573b566-7060-4d55-aa62-05d0ddd90b5a tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a609c39c14343e1bc1edd4b3cd56dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116def61aba4631be91f67df63ebab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:53.834552 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-b573b566-7060-4d55-aa62-05d0ddd90b5a tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] 10.222.0.17 "GET /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215" status: 200 len: 1505 microversion: 2.1 time: 0.323841 Jul 23 21:25:53.835394 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1509/2983] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:53 2022] GET /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215 => generated 1505 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:25:53.853165 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-36dbc244-5286-4b47-ab56-2380bdb63f84 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:53.853822 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-36dbc244-5286-4b47-ab56-2380bdb63f84 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: d303403b-5d14-443b-a6fe-f8b579d24cda] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:53.873276 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-36dbc244-5286-4b47-ab56-2380bdb63f84 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:53.873728 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-36dbc244-5286-4b47-ab56-2380bdb63f84 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:53.874562 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-36dbc244-5286-4b47-ab56-2380bdb63f84 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:53.875000 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-36dbc244-5286-4b47-ab56-2380bdb63f84 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:53.909324 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5a563be3-6121-4ec5-a234-a98b746c2b3e tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:53.921174 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5a563be3-6121-4ec5-a234-a98b746c2b3e tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/e893255e-87db-418f-8374-dc2d800f4ff5" status: 200 len: 1315 microversion: 2.1 time: 0.292496 Jul 23 21:25:53.925914 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1475/2984] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:53 2022] GET /compute/v2.1/servers/e893255e-87db-418f-8374-dc2d800f4ff5 => generated 1315 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:53.972139 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-502e6d73-4586-436b-a785-436cd3ca2505 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:53.973941 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-502e6d73-4586-436b-a785-436cd3ca2505 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:53.984414 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-502e6d73-4586-436b-a785-436cd3ca2505 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:53.985213 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-502e6d73-4586-436b-a785-436cd3ca2505 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:53.986067 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-502e6d73-4586-436b-a785-436cd3ca2505 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:53.986515 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-502e6d73-4586-436b-a785-436cd3ca2505 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:54.123300 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-502e6d73-4586-436b-a785-436cd3ca2505 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:54.133494 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-502e6d73-4586-436b-a785-436cd3ca2505 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:54.135274 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-502e6d73-4586-436b-a785-436cd3ca2505 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:54.136864 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-502e6d73-4586-436b-a785-436cd3ca2505 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.168686 Jul 23 21:25:54.149122 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1476/2985] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:25:53 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:25:54.199448 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-36dbc244-5286-4b47-ab56-2380bdb63f84 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:54.216275 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-36dbc244-5286-4b47-ab56-2380bdb63f84 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda" status: 200 len: 1514 microversion: 2.1 time: 0.379761 Jul 23 21:25:54.219520 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1510/2986] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:53 2022] GET /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda => generated 1514 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:54.501815 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b53567b8-4c15-40a0-9280-4806def54bb8 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:54.504792 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b53567b8-4c15-40a0-9280-4806def54bb8 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] [instance: 4085bec2-40ec-4324-b718-2c7ec388a22e] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:54.534920 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b53567b8-4c15-40a0-9280-4806def54bb8 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:54.537138 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b53567b8-4c15-40a0-9280-4806def54bb8 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:54.539190 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b53567b8-4c15-40a0-9280-4806def54bb8 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:54.540072 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b53567b8-4c15-40a0-9280-4806def54bb8 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:54.551083 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-b932977b-87d4-4609-9bdf-545efa6a99a4 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:54.551795 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-b932977b-87d4-4609-9bdf-545efa6a99a4 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] [instance: 35d0d067-4f24-45a4-b03c-32346b764d3c] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:54.560155 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b932977b-87d4-4609-9bdf-545efa6a99a4 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:54.567015 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b932977b-87d4-4609-9bdf-545efa6a99a4 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:54.569833 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b932977b-87d4-4609-9bdf-545efa6a99a4 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:54.572705 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b932977b-87d4-4609-9bdf-545efa6a99a4 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:54.946472 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b53567b8-4c15-40a0-9280-4806def54bb8 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961e46ab94f4fffbc606485935ce64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8305585b60d54beeb2b087a37260a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:54.956472 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b53567b8-4c15-40a0-9280-4806def54bb8 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] 10.222.0.17 "GET /compute/v2.1/servers/4085bec2-40ec-4324-b718-2c7ec388a22e" status: 200 len: 1539 microversion: 2.1 time: 0.465257 Jul 23 21:25:54.972506 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1477/2987] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:54 2022] GET /compute/v2.1/servers/4085bec2-40ec-4324-b718-2c7ec388a22e => generated 1539 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:54.980580 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-3dfaafed-d3e1-4b22-853a-31dd874e8b6c req-408b2926-677e-4fdb-9029-944e451f9b05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e893255e-87db-418f-8374-dc2d800f4ff5", "tag": "a2966984-a247-41b3-8d85-9e618375ba42"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:25:54.993229 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-3dfaafed-d3e1-4b22-853a-31dd874e8b6c req-408b2926-677e-4fdb-9029-944e451f9b05 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:54.994019 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-3dfaafed-d3e1-4b22-853a-31dd874e8b6c req-408b2926-677e-4fdb-9029-944e451f9b05 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:55.022021 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-3dfaafed-d3e1-4b22-853a-31dd874e8b6c req-408b2926-677e-4fdb-9029-944e451f9b05 service nova] Creating event network-changed:a2966984-a247-41b3-8d85-9e618375ba42 for instance e893255e-87db-418f-8374-dc2d800f4ff5 on nch2-master-1 Jul 23 21:25:55.032822 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-3dfaafed-d3e1-4b22-853a-31dd874e8b6c req-408b2926-677e-4fdb-9029-944e451f9b05 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058656 Jul 23 21:25:55.036775 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1478/2988] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:25:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:25:55.053408 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f91f9c6d-08b6-4246-ae39-526772f2bf81 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:55.054692 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f91f9c6d-08b6-4246-ae39-526772f2bf81 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] [instance: cb3a66a8-4c84-4bb1-8b3f-0c48acec1215] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:55.068877 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f91f9c6d-08b6-4246-ae39-526772f2bf81 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:55.069807 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f91f9c6d-08b6-4246-ae39-526772f2bf81 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:55.071145 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f91f9c6d-08b6-4246-ae39-526772f2bf81 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:55.072320 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f91f9c6d-08b6-4246-ae39-526772f2bf81 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:55.349498 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-b932977b-87d4-4609-9bdf-545efa6a99a4 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859c1493a30d4386b74377ab2b9bc81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3efb8824be84323b6ec04b604775bd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:55.357280 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-b932977b-87d4-4609-9bdf-545efa6a99a4 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] 10.222.0.17 "GET /compute/v2.1/servers/35d0d067-4f24-45a4-b03c-32346b764d3c" status: 200 len: 1519 microversion: 2.1 time: 0.812368 Jul 23 21:25:55.358417 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1511/2989] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:54 2022] GET /compute/v2.1/servers/35d0d067-4f24-45a4-b03c-32346b764d3c => generated 1519 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:25:55.363141 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-78e7d837-a86c-44f2-bbaa-fa70d10c5abd tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:55.363986 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-78e7d837-a86c-44f2-bbaa-fa70d10c5abd tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: e893255e-87db-418f-8374-dc2d800f4ff5] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:55.372264 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-78e7d837-a86c-44f2-bbaa-fa70d10c5abd tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:55.372747 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f91f9c6d-08b6-4246-ae39-526772f2bf81 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a609c39c14343e1bc1edd4b3cd56dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116def61aba4631be91f67df63ebab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:55.373240 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-78e7d837-a86c-44f2-bbaa-fa70d10c5abd tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:55.374295 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-78e7d837-a86c-44f2-bbaa-fa70d10c5abd tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:55.375152 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-78e7d837-a86c-44f2-bbaa-fa70d10c5abd tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:55.383810 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f91f9c6d-08b6-4246-ae39-526772f2bf81 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] 10.222.0.17 "GET /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215" status: 200 len: 1505 microversion: 2.1 time: 0.344903 Jul 23 21:25:55.384409 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1479/2990] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:55 2022] GET /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215 => generated 1505 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:55.407101 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8180beb4-092b-4a6e-a907-495301f3d141 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:55.407717 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8180beb4-092b-4a6e-a907-495301f3d141 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:55.416871 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8180beb4-092b-4a6e-a907-495301f3d141 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:55.417951 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8180beb4-092b-4a6e-a907-495301f3d141 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:55.418750 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8180beb4-092b-4a6e-a907-495301f3d141 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:55.419195 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8180beb4-092b-4a6e-a907-495301f3d141 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:55.508796 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8180beb4-092b-4a6e-a907-495301f3d141 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:55.518199 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8180beb4-092b-4a6e-a907-495301f3d141 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:55.519705 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8180beb4-092b-4a6e-a907-495301f3d141 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:55.520899 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8180beb4-092b-4a6e-a907-495301f3d141 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.124079 Jul 23 21:25:55.521541 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1480/2991] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:25:55 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:25:55.526602 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-62c52303-d5d4-49d1-aaf5-f2fdfb9c71bf tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:55.527216 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-62c52303-d5d4-49d1-aaf5-f2fdfb9c71bf tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: d303403b-5d14-443b-a6fe-f8b579d24cda] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:55.533807 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-62c52303-d5d4-49d1-aaf5-f2fdfb9c71bf tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:55.534296 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-62c52303-d5d4-49d1-aaf5-f2fdfb9c71bf tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:55.535083 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-62c52303-d5d4-49d1-aaf5-f2fdfb9c71bf tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:55.535519 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-62c52303-d5d4-49d1-aaf5-f2fdfb9c71bf tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:55.611953 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-78e7d837-a86c-44f2-bbaa-fa70d10c5abd tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:55.620430 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-78e7d837-a86c-44f2-bbaa-fa70d10c5abd tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/e893255e-87db-418f-8374-dc2d800f4ff5" status: 200 len: 1315 microversion: 2.1 time: 0.260808 Jul 23 21:25:55.621409 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1512/2992] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:55 2022] GET /compute/v2.1/servers/e893255e-87db-418f-8374-dc2d800f4ff5 => generated 1315 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:55.668024 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-62c52303-d5d4-49d1-aaf5-f2fdfb9c71bf tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:55.675918 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-62c52303-d5d4-49d1-aaf5-f2fdfb9c71bf tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda" status: 200 len: 1514 microversion: 2.1 time: 0.153163 Jul 23 21:25:55.676917 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1481/2993] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:55 2022] GET /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:55.974089 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-dd5a5a8b-ab96-4637-834e-8e1b4ea43311 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:55.974718 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-dd5a5a8b-ab96-4637-834e-8e1b4ea43311 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] [instance: 4085bec2-40ec-4324-b718-2c7ec388a22e] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:55.981179 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-dd5a5a8b-ab96-4637-834e-8e1b4ea43311 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:55.981677 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-dd5a5a8b-ab96-4637-834e-8e1b4ea43311 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:55.982492 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-dd5a5a8b-ab96-4637-834e-8e1b4ea43311 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:55.982928 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-dd5a5a8b-ab96-4637-834e-8e1b4ea43311 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:56.192390 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-dd5a5a8b-ab96-4637-834e-8e1b4ea43311 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961e46ab94f4fffbc606485935ce64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8305585b60d54beeb2b087a37260a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:56.204058 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-dd5a5a8b-ab96-4637-834e-8e1b4ea43311 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] 10.222.0.17 "GET /compute/v2.1/servers/4085bec2-40ec-4324-b718-2c7ec388a22e" status: 200 len: 1539 microversion: 2.1 time: 0.234059 Jul 23 21:25:56.214410 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1513/2994] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:55 2022] GET /compute/v2.1/servers/4085bec2-40ec-4324-b718-2c7ec388a22e => generated 1539 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:56.375571 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8603dec3-4480-47e3-b771-694f10a9dae1 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:56.376906 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8603dec3-4480-47e3-b771-694f10a9dae1 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] [instance: 35d0d067-4f24-45a4-b03c-32346b764d3c] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:56.379326 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=20 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:25:56.386624 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8603dec3-4480-47e3-b771-694f10a9dae1 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:56.387354 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8603dec3-4480-47e3-b771-694f10a9dae1 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:56.388363 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8603dec3-4480-47e3-b771-694f10a9dae1 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:56.388802 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8603dec3-4480-47e3-b771-694f10a9dae1 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:56.405588 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-630fa33a-6248-4fc5-ae30-8a8f2f7d6b5a tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:56.406456 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-630fa33a-6248-4fc5-ae30-8a8f2f7d6b5a tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] [instance: cb3a66a8-4c84-4bb1-8b3f-0c48acec1215] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:56.417694 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-630fa33a-6248-4fc5-ae30-8a8f2f7d6b5a tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:56.418313 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-630fa33a-6248-4fc5-ae30-8a8f2f7d6b5a tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:56.419471 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-630fa33a-6248-4fc5-ae30-8a8f2f7d6b5a tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:56.420015 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-630fa33a-6248-4fc5-ae30-8a8f2f7d6b5a tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:56.613906 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8603dec3-4480-47e3-b771-694f10a9dae1 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859c1493a30d4386b74377ab2b9bc81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3efb8824be84323b6ec04b604775bd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:56.627031 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8603dec3-4480-47e3-b771-694f10a9dae1 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] 10.222.0.17 "GET /compute/v2.1/servers/35d0d067-4f24-45a4-b03c-32346b764d3c" status: 200 len: 1496 microversion: 2.1 time: 0.255172 Jul 23 21:25:56.639669 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1482/2995] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:56 2022] GET /compute/v2.1/servers/35d0d067-4f24-45a4-b03c-32346b764d3c => generated 1496 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:56.646112 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-192272c4-ce67-476b-b42e-3cc29206981d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:56.646858 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-192272c4-ce67-476b-b42e-3cc29206981d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:56.653421 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-192272c4-ce67-476b-b42e-3cc29206981d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:56.653989 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-192272c4-ce67-476b-b42e-3cc29206981d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:56.655254 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-192272c4-ce67-476b-b42e-3cc29206981d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:56.655827 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-192272c4-ce67-476b-b42e-3cc29206981d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:56.723808 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-630fa33a-6248-4fc5-ae30-8a8f2f7d6b5a tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a609c39c14343e1bc1edd4b3cd56dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116def61aba4631be91f67df63ebab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:56.731595 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-630fa33a-6248-4fc5-ae30-8a8f2f7d6b5a tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] 10.222.0.17 "GET /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215" status: 200 len: 1505 microversion: 2.1 time: 0.333746 Jul 23 21:25:56.732871 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1514/2996] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:56 2022] GET /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215 => generated 1505 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:56.743094 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-0a4f54b3-d4f5-410c-896d-47e61050dbd8 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:56.744005 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-0a4f54b3-d4f5-410c-896d-47e61050dbd8 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: e893255e-87db-418f-8374-dc2d800f4ff5] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:56.751603 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-192272c4-ce67-476b-b42e-3cc29206981d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:56.753520 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0a4f54b3-d4f5-410c-896d-47e61050dbd8 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:56.755929 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0a4f54b3-d4f5-410c-896d-47e61050dbd8 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:56.764309 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0a4f54b3-d4f5-410c-896d-47e61050dbd8 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:56.765026 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0a4f54b3-d4f5-410c-896d-47e61050dbd8 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:56.766801 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-192272c4-ce67-476b-b42e-3cc29206981d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:56.770937 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-192272c4-ce67-476b-b42e-3cc29206981d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:56.776095 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-192272c4-ce67-476b-b42e-3cc29206981d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.132791 Jul 23 21:25:56.777846 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1483/2997] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:25:56 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:25:56.783116 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6b919c78-5687-46fb-9489-e2f60cc6d222 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:56.787075 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6b919c78-5687-46fb-9489-e2f60cc6d222 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '859c1493a30d4386b74377ab2b9bc81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3efb8824be84323b6ec04b604775bd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:56.788202 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6b919c78-5687-46fb-9489-e2f60cc6d222 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': 'b3efb8824be84323b6ec04b604775bd0'} {{(pid=131320) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 23 21:25:56.820650 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6b919c78-5687-46fb-9489-e2f60cc6d222 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:56.824822 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6b919c78-5687-46fb-9489-e2f60cc6d222 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:56.826302 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6b919c78-5687-46fb-9489-e2f60cc6d222 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:56.826633 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6b919c78-5687-46fb-9489-e2f60cc6d222 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:56.952488 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.multi_cell_list [None req-6b919c78-5687-46fb-9489-e2f60cc6d222 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131320) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 23 21:25:57.023028 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6b919c78-5687-46fb-9489-e2f60cc6d222 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] 10.222.0.17 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 345 microversion: 2.1 time: 0.243792 Jul 23 21:25:57.023834 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1484/2998] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 23 21:25:56 2022] GET /compute/v2.1/servers?status=shutoff => generated 345 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:25:57.033648 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a9fed1de-530a-49d5-b4af-02f0d2185dd6 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:57.034329 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a9fed1de-530a-49d5-b4af-02f0d2185dd6 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: d303403b-5d14-443b-a6fe-f8b579d24cda] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:57.040937 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a9fed1de-530a-49d5-b4af-02f0d2185dd6 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:57.041380 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a9fed1de-530a-49d5-b4af-02f0d2185dd6 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:57.042195 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a9fed1de-530a-49d5-b4af-02f0d2185dd6 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:57.042824 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a9fed1de-530a-49d5-b4af-02f0d2185dd6 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:57.057568 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-0a4f54b3-d4f5-410c-896d-47e61050dbd8 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:57.070728 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-0a4f54b3-d4f5-410c-896d-47e61050dbd8 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/e893255e-87db-418f-8374-dc2d800f4ff5" status: 200 len: 1315 microversion: 2.1 time: 0.336568 Jul 23 21:25:57.071607 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1515/2999] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:56 2022] GET /compute/v2.1/servers/e893255e-87db-418f-8374-dc2d800f4ff5 => generated 1315 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:57.076802 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-7af1f35a-4875-4c0c-8bde-a29c5d99cbc0 req-cdda7d35-f2d1-4c9a-af39-f5b5d1f21e9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4085bec2-40ec-4324-b718-2c7ec388a22e", "name": "network-vif-plugged", "status": "completed", "tag": "39fbda00-62e3-43a1-8cd6-e48af6277d20"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:25:57.085978 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-7af1f35a-4875-4c0c-8bde-a29c5d99cbc0 req-cdda7d35-f2d1-4c9a-af39-f5b5d1f21e9b service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:57.086429 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-7af1f35a-4875-4c0c-8bde-a29c5d99cbc0 req-cdda7d35-f2d1-4c9a-af39-f5b5d1f21e9b service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:57.098835 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-7af1f35a-4875-4c0c-8bde-a29c5d99cbc0 req-cdda7d35-f2d1-4c9a-af39-f5b5d1f21e9b service nova] Creating event network-vif-plugged:39fbda00-62e3-43a1-8cd6-e48af6277d20 for instance 4085bec2-40ec-4324-b718-2c7ec388a22e on nch1-master-1 Jul 23 21:25:57.110221 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-7af1f35a-4875-4c0c-8bde-a29c5d99cbc0 req-cdda7d35-f2d1-4c9a-af39-f5b5d1f21e9b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036680 Jul 23 21:25:57.111525 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1516/3000] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:25:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:25:57.118009 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-354e7bfa-45d9-4d49-aca1-61b57115082a tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:25:57.126484 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-354e7bfa-45d9-4d49-aca1-61b57115082a tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:57.127716 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-354e7bfa-45d9-4d49-aca1-61b57115082a tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:57.255282 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-354e7bfa-45d9-4d49-aca1-61b57115082a tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] [instance: 35d0d067-4f24-45a4-b03c-32346b764d3c] Going to try to start instance {{(pid=131321) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 23 21:25:57.325432 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-354e7bfa-45d9-4d49-aca1-61b57115082a tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] 10.222.0.17 "POST /compute/v2.1/servers/35d0d067-4f24-45a4-b03c-32346b764d3c/action" status: 202 len: 0 microversion: 2.1 time: 0.212179 Jul 23 21:25:57.329609 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1517/3001] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:25:57 2022] POST /compute/v2.1/servers/35d0d067-4f24-45a4-b03c-32346b764d3c/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:25:57.360964 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-59e9d09f-2050-4cac-9bf1-106c0ca11c69 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:57.362685 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-59e9d09f-2050-4cac-9bf1-106c0ca11c69 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] [instance: 4085bec2-40ec-4324-b718-2c7ec388a22e] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:57.396211 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-59e9d09f-2050-4cac-9bf1-106c0ca11c69 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:57.397738 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-59e9d09f-2050-4cac-9bf1-106c0ca11c69 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:57.398656 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-59e9d09f-2050-4cac-9bf1-106c0ca11c69 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:57.399114 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-59e9d09f-2050-4cac-9bf1-106c0ca11c69 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:57.582365 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a9fed1de-530a-49d5-b4af-02f0d2185dd6 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:57.604699 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a9fed1de-530a-49d5-b4af-02f0d2185dd6 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda" status: 200 len: 1514 microversion: 2.1 time: 0.574135 Jul 23 21:25:57.606022 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1485/3002] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:57 2022] GET /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda => generated 1514 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:57.611229 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-cae55a53-475c-465b-b4c2-f65c73005147 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:57.612079 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-cae55a53-475c-465b-b4c2-f65c73005147 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] [instance: 35d0d067-4f24-45a4-b03c-32346b764d3c] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:57.620060 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cae55a53-475c-465b-b4c2-f65c73005147 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:57.621270 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cae55a53-475c-465b-b4c2-f65c73005147 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:57.622288 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cae55a53-475c-465b-b4c2-f65c73005147 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:57.622921 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cae55a53-475c-465b-b4c2-f65c73005147 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:57.735373 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-59e9d09f-2050-4cac-9bf1-106c0ca11c69 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961e46ab94f4fffbc606485935ce64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8305585b60d54beeb2b087a37260a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:57.744331 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-59e9d09f-2050-4cac-9bf1-106c0ca11c69 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] 10.222.0.17 "GET /compute/v2.1/servers/4085bec2-40ec-4324-b718-2c7ec388a22e" status: 200 len: 1521 microversion: 2.1 time: 0.413334 Jul 23 21:25:57.753130 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1518/3003] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:57 2022] GET /compute/v2.1/servers/4085bec2-40ec-4324-b718-2c7ec388a22e => generated 1521 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:57.753130 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e3e010ba-1efd-4106-a801-9ce26df0f906 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:57.753130 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-e3e010ba-1efd-4106-a801-9ce26df0f906 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] [instance: cb3a66a8-4c84-4bb1-8b3f-0c48acec1215] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:57.758055 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e3e010ba-1efd-4106-a801-9ce26df0f906 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:57.758506 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e3e010ba-1efd-4106-a801-9ce26df0f906 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:57.759281 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e3e010ba-1efd-4106-a801-9ce26df0f906 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:57.759719 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e3e010ba-1efd-4106-a801-9ce26df0f906 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:57.832430 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-cae55a53-475c-465b-b4c2-f65c73005147 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859c1493a30d4386b74377ab2b9bc81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3efb8824be84323b6ec04b604775bd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:57.841695 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-cae55a53-475c-465b-b4c2-f65c73005147 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] 10.222.0.17 "GET /compute/v2.1/servers/35d0d067-4f24-45a4-b03c-32346b764d3c" status: 200 len: 1505 microversion: 2.1 time: 0.234415 Jul 23 21:25:57.842643 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1486/3004] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:57 2022] GET /compute/v2.1/servers/35d0d067-4f24-45a4-b03c-32346b764d3c => generated 1505 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:57.857251 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1f62f783-8497-4e69-bb04-0589ce468f10 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:57.858043 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1f62f783-8497-4e69-bb04-0589ce468f10 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] [instance: 4085bec2-40ec-4324-b718-2c7ec388a22e] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:57.861197 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:25:57.865208 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1f62f783-8497-4e69-bb04-0589ce468f10 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:57.865847 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1f62f783-8497-4e69-bb04-0589ce468f10 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:57.867403 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1f62f783-8497-4e69-bb04-0589ce468f10 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:57.868011 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1f62f783-8497-4e69-bb04-0589ce468f10 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:57.898004 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:25:57.902669 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1f62f783-8497-4e69-bb04-0589ce468f10 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] [instance: 4085bec2-40ec-4324-b718-2c7ec388a22e] Going to try to terminate instance {{(pid=131320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:25:57.991022 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1f62f783-8497-4e69-bb04-0589ce468f10 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] 10.222.0.17 "DELETE /compute/v2.1/servers/4085bec2-40ec-4324-b718-2c7ec388a22e" status: 204 len: 0 microversion: 2.1 time: 0.137278 Jul 23 21:25:57.992444 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1487/3005] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:25:57 2022] DELETE /compute/v2.1/servers/4085bec2-40ec-4324-b718-2c7ec388a22e => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:25:58.000641 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ade78fa1-3574-4064-9afa-01d85e7b5252 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:58.001762 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ade78fa1-3574-4064-9afa-01d85e7b5252 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:58.010098 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ade78fa1-3574-4064-9afa-01d85e7b5252 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:58.014935 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ade78fa1-3574-4064-9afa-01d85e7b5252 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:58.016403 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ade78fa1-3574-4064-9afa-01d85e7b5252 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:58.017699 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-e3e010ba-1efd-4106-a801-9ce26df0f906 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a609c39c14343e1bc1edd4b3cd56dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116def61aba4631be91f67df63ebab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:58.017920 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ade78fa1-3574-4064-9afa-01d85e7b5252 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:58.025936 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-e3e010ba-1efd-4106-a801-9ce26df0f906 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] 10.222.0.17 "GET /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215" status: 200 len: 1505 microversion: 2.1 time: 0.279567 Jul 23 21:25:58.026480 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1519/3006] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:57 2022] GET /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215 => generated 1505 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:58.037816 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-0b70712d-ca7e-465a-bbf3-d348634eedb2 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:58.040730 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-0b70712d-ca7e-465a-bbf3-d348634eedb2 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] [instance: 4085bec2-40ec-4324-b718-2c7ec388a22e] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:58.055716 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0b70712d-ca7e-465a-bbf3-d348634eedb2 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:58.056351 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0b70712d-ca7e-465a-bbf3-d348634eedb2 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:58.057298 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0b70712d-ca7e-465a-bbf3-d348634eedb2 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:58.058560 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0b70712d-ca7e-465a-bbf3-d348634eedb2 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:58.113769 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ade78fa1-3574-4064-9afa-01d85e7b5252 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:58.123231 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ade78fa1-3574-4064-9afa-01d85e7b5252 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:58.124722 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ade78fa1-3574-4064-9afa-01d85e7b5252 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:58.125927 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ade78fa1-3574-4064-9afa-01d85e7b5252 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.131951 Jul 23 21:25:58.126499 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1488/3007] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:25:57 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:25:58.131036 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8a38d530-4354-41f6-91cf-7624ee321b79 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:58.131868 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8a38d530-4354-41f6-91cf-7624ee321b79 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: e893255e-87db-418f-8374-dc2d800f4ff5] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:58.138833 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8a38d530-4354-41f6-91cf-7624ee321b79 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:58.139678 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8a38d530-4354-41f6-91cf-7624ee321b79 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:58.140461 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8a38d530-4354-41f6-91cf-7624ee321b79 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:58.140899 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8a38d530-4354-41f6-91cf-7624ee321b79 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:58.297490 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-0b70712d-ca7e-465a-bbf3-d348634eedb2 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961e46ab94f4fffbc606485935ce64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8305585b60d54beeb2b087a37260a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:58.306200 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-0b70712d-ca7e-465a-bbf3-d348634eedb2 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] 10.222.0.17 "GET /compute/v2.1/servers/4085bec2-40ec-4324-b718-2c7ec388a22e" status: 200 len: 1527 microversion: 2.1 time: 0.275172 Jul 23 21:25:58.307091 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1520/3008] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:58 2022] GET /compute/v2.1/servers/4085bec2-40ec-4324-b718-2c7ec388a22e => generated 1527 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:58.348162 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8a38d530-4354-41f6-91cf-7624ee321b79 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:58.359373 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8a38d530-4354-41f6-91cf-7624ee321b79 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/e893255e-87db-418f-8374-dc2d800f4ff5" status: 200 len: 1315 microversion: 2.1 time: 0.231048 Jul 23 21:25:58.360187 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1489/3009] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:58 2022] GET /compute/v2.1/servers/e893255e-87db-418f-8374-dc2d800f4ff5 => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:58.622908 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e927fbfb-eb70-4a83-beae-e6aceb8de430 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:58.623920 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-e927fbfb-eb70-4a83-beae-e6aceb8de430 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: d303403b-5d14-443b-a6fe-f8b579d24cda] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:58.634399 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e927fbfb-eb70-4a83-beae-e6aceb8de430 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:58.635287 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e927fbfb-eb70-4a83-beae-e6aceb8de430 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:58.636578 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e927fbfb-eb70-4a83-beae-e6aceb8de430 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:58.637929 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e927fbfb-eb70-4a83-beae-e6aceb8de430 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:58.804533 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-e927fbfb-eb70-4a83-beae-e6aceb8de430 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:58.819412 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-e927fbfb-eb70-4a83-beae-e6aceb8de430 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda" status: 200 len: 1514 microversion: 2.1 time: 0.200496 Jul 23 21:25:58.820145 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1521/3010] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:58 2022] GET /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda => generated 1514 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:58.869823 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-47e4ab3a-3867-408d-b246-e60854dd58a9 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:58.871248 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-47e4ab3a-3867-408d-b246-e60854dd58a9 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] [instance: 35d0d067-4f24-45a4-b03c-32346b764d3c] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:58.878115 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-47e4ab3a-3867-408d-b246-e60854dd58a9 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:58.878603 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-47e4ab3a-3867-408d-b246-e60854dd58a9 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:58.879384 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-47e4ab3a-3867-408d-b246-e60854dd58a9 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:58.879825 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-47e4ab3a-3867-408d-b246-e60854dd58a9 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:59.031996 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-47e4ab3a-3867-408d-b246-e60854dd58a9 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859c1493a30d4386b74377ab2b9bc81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3efb8824be84323b6ec04b604775bd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:59.041191 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-47e4ab3a-3867-408d-b246-e60854dd58a9 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] 10.222.0.17 "GET /compute/v2.1/servers/35d0d067-4f24-45a4-b03c-32346b764d3c" status: 200 len: 1509 microversion: 2.1 time: 0.183312 Jul 23 21:25:59.042371 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1490/3011] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:58 2022] GET /compute/v2.1/servers/35d0d067-4f24-45a4-b03c-32346b764d3c => generated 1509 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:59.052185 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-7b4a8f9a-c4f7-4cbf-988f-2ef00787c05e tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:59.052968 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-7b4a8f9a-c4f7-4cbf-988f-2ef00787c05e tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] [instance: cb3a66a8-4c84-4bb1-8b3f-0c48acec1215] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:59.059696 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-50281027-ab2d-49ed-9915-c568d3b8247e tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:59.062606 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7b4a8f9a-c4f7-4cbf-988f-2ef00787c05e tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:59.063075 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7b4a8f9a-c4f7-4cbf-988f-2ef00787c05e tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:59.063836 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-50281027-ab2d-49ed-9915-c568d3b8247e tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '859c1493a30d4386b74377ab2b9bc81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3efb8824be84323b6ec04b604775bd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:59.064471 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.compute.servers [None req-50281027-ab2d-49ed-9915-c568d3b8247e tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Removing options 'limit' from query {{(pid=131320) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jul 23 21:25:59.064609 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7b4a8f9a-c4f7-4cbf-988f-2ef00787c05e tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:59.065812 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7b4a8f9a-c4f7-4cbf-988f-2ef00787c05e tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:59.065973 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-50281027-ab2d-49ed-9915-c568d3b8247e tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Searching by: {'deleted': False, 'project_id': 'b3efb8824be84323b6ec04b604775bd0'} {{(pid=131320) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 23 21:25:59.067391 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-50281027-ab2d-49ed-9915-c568d3b8247e tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:59.067996 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-50281027-ab2d-49ed-9915-c568d3b8247e tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:59.071891 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:25:59.072236 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-50281027-ab2d-49ed-9915-c568d3b8247e tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:59.073021 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-50281027-ab2d-49ed-9915-c568d3b8247e tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:59.074506 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-50281027-ab2d-49ed-9915-c568d3b8247e tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] 10.222.0.17 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.018650 Jul 23 21:25:59.075663 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1491/3012] 10.222.0.17 () {58 vars in 1139 bytes} [Sat Jul 23 21:25:59 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 23 21:25:59.089036 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2a3b2b22-7bc4-4f96-bd66-a2a98b38462b tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:59.090181 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-2a3b2b22-7bc4-4f96-bd66-a2a98b38462b tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] [instance: 35d0d067-4f24-45a4-b03c-32346b764d3c] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:59.098681 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2a3b2b22-7bc4-4f96-bd66-a2a98b38462b tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:59.099535 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2a3b2b22-7bc4-4f96-bd66-a2a98b38462b tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:59.101061 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2a3b2b22-7bc4-4f96-bd66-a2a98b38462b tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:59.101751 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2a3b2b22-7bc4-4f96-bd66-a2a98b38462b tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:59.235063 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-7b4a8f9a-c4f7-4cbf-988f-2ef00787c05e tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a609c39c14343e1bc1edd4b3cd56dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116def61aba4631be91f67df63ebab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:59.243413 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-7b4a8f9a-c4f7-4cbf-988f-2ef00787c05e tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] 10.222.0.17 "GET /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215" status: 200 len: 1505 microversion: 2.1 time: 0.204252 Jul 23 21:25:59.244217 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1522/3013] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:59 2022] GET /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215 => generated 1505 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:25:59.249881 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-5b616c87-0943-4aaa-87f8-5b6fd20fff03 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:59.250698 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-5b616c87-0943-4aaa-87f8-5b6fd20fff03 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:59.257078 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-2a3b2b22-7bc4-4f96-bd66-a2a98b38462b tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859c1493a30d4386b74377ab2b9bc81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3efb8824be84323b6ec04b604775bd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:59.257235 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5b616c87-0943-4aaa-87f8-5b6fd20fff03 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:59.257652 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5b616c87-0943-4aaa-87f8-5b6fd20fff03 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:59.258485 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5b616c87-0943-4aaa-87f8-5b6fd20fff03 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:59.258927 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5b616c87-0943-4aaa-87f8-5b6fd20fff03 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:59.270530 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2a3b2b22-7bc4-4f96-bd66-a2a98b38462b tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] 10.222.0.17 "GET /compute/v2.1/servers/35d0d067-4f24-45a4-b03c-32346b764d3c" status: 200 len: 1509 microversion: 2.1 time: 0.183543 Jul 23 21:25:59.270530 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1492/3014] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:59 2022] GET /compute/v2.1/servers/35d0d067-4f24-45a4-b03c-32346b764d3c => generated 1509 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:25:59.282852 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b27f53ae-03cd-4394-8e6b-e217ea568244 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:59.283480 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b27f53ae-03cd-4394-8e6b-e217ea568244 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] [instance: dcb1aa47-1abb-4c2f-9686-7268d2b86967] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:59.289772 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b27f53ae-03cd-4394-8e6b-e217ea568244 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:59.290260 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b27f53ae-03cd-4394-8e6b-e217ea568244 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:59.291050 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b27f53ae-03cd-4394-8e6b-e217ea568244 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:59.291497 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b27f53ae-03cd-4394-8e6b-e217ea568244 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:59.335609 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-5b616c87-0943-4aaa-87f8-5b6fd20fff03 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:59.345664 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-5b616c87-0943-4aaa-87f8-5b6fd20fff03 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:59.347202 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-5b616c87-0943-4aaa-87f8-5b6fd20fff03 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:59.348473 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-5b616c87-0943-4aaa-87f8-5b6fd20fff03 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.103081 Jul 23 21:25:59.349517 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1523/3015] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:25:59 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:25:59.363669 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a314d693-9ac8-42e3-8dd9-771d1735cea5 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:59.364231 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-a314d693-9ac8-42e3-8dd9-771d1735cea5 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] [instance: 4085bec2-40ec-4324-b718-2c7ec388a22e] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:59.371723 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a314d693-9ac8-42e3-8dd9-771d1735cea5 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:59.372485 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a314d693-9ac8-42e3-8dd9-771d1735cea5 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:59.373307 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a314d693-9ac8-42e3-8dd9-771d1735cea5 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:59.373754 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a314d693-9ac8-42e3-8dd9-771d1735cea5 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:59.459941 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b27f53ae-03cd-4394-8e6b-e217ea568244 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859c1493a30d4386b74377ab2b9bc81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3efb8824be84323b6ec04b604775bd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:59.467309 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b27f53ae-03cd-4394-8e6b-e217ea568244 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] 10.222.0.17 "GET /compute/v2.1/servers/dcb1aa47-1abb-4c2f-9686-7268d2b86967" status: 200 len: 1510 microversion: 2.1 time: 0.188352 Jul 23 21:25:59.468122 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1493/3016] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:59 2022] GET /compute/v2.1/servers/dcb1aa47-1abb-4c2f-9686-7268d2b86967 => generated 1510 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:59.482968 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e9c569f6-41da-4802-8baa-ecd60b7c4a37 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:59.483470 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e9c569f6-41da-4802-8baa-ecd60b7c4a37 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: e893255e-87db-418f-8374-dc2d800f4ff5] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:59.489742 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e9c569f6-41da-4802-8baa-ecd60b7c4a37 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:59.490906 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e9c569f6-41da-4802-8baa-ecd60b7c4a37 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:59.492112 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e9c569f6-41da-4802-8baa-ecd60b7c4a37 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:59.492533 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e9c569f6-41da-4802-8baa-ecd60b7c4a37 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:59.532368 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-a314d693-9ac8-42e3-8dd9-771d1735cea5 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961e46ab94f4fffbc606485935ce64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8305585b60d54beeb2b087a37260a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:59.542988 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-a314d693-9ac8-42e3-8dd9-771d1735cea5 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] 10.222.0.17 "GET /compute/v2.1/servers/4085bec2-40ec-4324-b718-2c7ec388a22e" status: 200 len: 1527 microversion: 2.1 time: 0.183170 Jul 23 21:25:59.544291 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1524/3017] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:59 2022] GET /compute/v2.1/servers/4085bec2-40ec-4324-b718-2c7ec388a22e => generated 1527 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:59.548969 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-53d1d84f-0411-4c24-847e-dae3fffb871a tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:59.550298 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-53d1d84f-0411-4c24-847e-dae3fffb871a tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] [instance: d9c0391f-e638-415e-b079-ab7b429492c3] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:59.556586 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-53d1d84f-0411-4c24-847e-dae3fffb871a tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:59.557045 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-53d1d84f-0411-4c24-847e-dae3fffb871a tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:59.558033 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-53d1d84f-0411-4c24-847e-dae3fffb871a tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:59.558483 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-53d1d84f-0411-4c24-847e-dae3fffb871a tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:59.646539 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e9c569f6-41da-4802-8baa-ecd60b7c4a37 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:59.658969 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e9c569f6-41da-4802-8baa-ecd60b7c4a37 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/e893255e-87db-418f-8374-dc2d800f4ff5" status: 200 len: 1315 microversion: 2.1 time: 0.179831 Jul 23 21:25:59.667635 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1494/3018] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:59 2022] GET /compute/v2.1/servers/e893255e-87db-418f-8374-dc2d800f4ff5 => generated 1315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:59.736792 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-53d1d84f-0411-4c24-847e-dae3fffb871a tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859c1493a30d4386b74377ab2b9bc81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3efb8824be84323b6ec04b604775bd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:59.746600 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-53d1d84f-0411-4c24-847e-dae3fffb871a tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] 10.222.0.17 "GET /compute/v2.1/servers/d9c0391f-e638-415e-b079-ab7b429492c3" status: 200 len: 1510 microversion: 2.1 time: 0.201220 Jul 23 21:25:59.747198 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1525/3019] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:59 2022] GET /compute/v2.1/servers/d9c0391f-e638-415e-b079-ab7b429492c3 => generated 1510 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:25:59.764117 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8df7dc0a-b91f-487a-812e-e5c2eb7fef50 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:59.768381 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8df7dc0a-b91f-487a-812e-e5c2eb7fef50 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '859c1493a30d4386b74377ab2b9bc81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3efb8824be84323b6ec04b604775bd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:25:59.769115 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8df7dc0a-b91f-487a-812e-e5c2eb7fef50 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Searching by: {'ip': '172.20.0.13', 'deleted': False, 'project_id': 'b3efb8824be84323b6ec04b604775bd0'} {{(pid=131320) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 23 21:25:59.836918 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-8d884860-c2ca-4582-93d2-4e21a73484cd tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:25:59.837427 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-8d884860-c2ca-4582-93d2-4e21a73484cd tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: d303403b-5d14-443b-a6fe-f8b579d24cda] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:25:59.843992 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8d884860-c2ca-4582-93d2-4e21a73484cd tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:59.844445 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8d884860-c2ca-4582-93d2-4e21a73484cd tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:59.845226 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8d884860-c2ca-4582-93d2-4e21a73484cd tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:59.845658 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8d884860-c2ca-4582-93d2-4e21a73484cd tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:59.906751 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8df7dc0a-b91f-487a-812e-e5c2eb7fef50 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:59.907315 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8df7dc0a-b91f-487a-812e-e5c2eb7fef50 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:25:59.908116 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8df7dc0a-b91f-487a-812e-e5c2eb7fef50 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:25:59.908615 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8df7dc0a-b91f-487a-812e-e5c2eb7fef50 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:00.004550 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.multi_cell_list [None req-8df7dc0a-b91f-487a-812e-e5c2eb7fef50 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131320) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 23 21:26:00.063670 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-8d884860-c2ca-4582-93d2-4e21a73484cd tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:00.071823 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-8d884860-c2ca-4582-93d2-4e21a73484cd tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda" status: 200 len: 1514 microversion: 2.1 time: 0.238937 Jul 23 21:26:00.082014 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1526/3020] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:25:59 2022] GET /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda => generated 1514 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:00.093804 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8df7dc0a-b91f-487a-812e-e5c2eb7fef50 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] 10.222.0.17 "GET /compute/v2.1/servers?ip=172.20.0.13" status: 200 len: 345 microversion: 2.1 time: 0.333883 Jul 23 21:26:00.094836 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1495/3021] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 23 21:25:59 2022] GET /compute/v2.1/servers?ip=172.20.0.13 => generated 345 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:26:00.107512 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-7a7bc565-532b-4d90-bda2-d325eac1f677 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:00.108125 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-7a7bc565-532b-4d90-bda2-d325eac1f677 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] [instance: 35d0d067-4f24-45a4-b03c-32346b764d3c] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:00.114713 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7a7bc565-532b-4d90-bda2-d325eac1f677 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:00.115164 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7a7bc565-532b-4d90-bda2-d325eac1f677 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:00.115943 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7a7bc565-532b-4d90-bda2-d325eac1f677 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:00.116405 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7a7bc565-532b-4d90-bda2-d325eac1f677 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:00.254959 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-7a7bc565-532b-4d90-bda2-d325eac1f677 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859c1493a30d4386b74377ab2b9bc81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3efb8824be84323b6ec04b604775bd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:00.261105 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a2f5aae9-aa8a-44fa-a532-b84e30d5ce60 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:00.261805 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a2f5aae9-aa8a-44fa-a532-b84e30d5ce60 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] [instance: cb3a66a8-4c84-4bb1-8b3f-0c48acec1215] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:00.263113 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-7a7bc565-532b-4d90-bda2-d325eac1f677 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] 10.222.0.17 "GET /compute/v2.1/servers/35d0d067-4f24-45a4-b03c-32346b764d3c" status: 200 len: 1509 microversion: 2.1 time: 0.159520 Jul 23 21:26:00.268396 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a2f5aae9-aa8a-44fa-a532-b84e30d5ce60 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:00.268931 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a2f5aae9-aa8a-44fa-a532-b84e30d5ce60 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:00.269820 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a2f5aae9-aa8a-44fa-a532-b84e30d5ce60 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:00.270362 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a2f5aae9-aa8a-44fa-a532-b84e30d5ce60 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:00.275864 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1527/3022] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:00 2022] GET /compute/v2.1/servers/35d0d067-4f24-45a4-b03c-32346b764d3c => generated 1509 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:00.280062 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-44e00555-e821-4213-bc9a-ef80519ab7dd tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:00.280673 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-44e00555-e821-4213-bc9a-ef80519ab7dd tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] [instance: dcb1aa47-1abb-4c2f-9686-7268d2b86967] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:00.286862 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-44e00555-e821-4213-bc9a-ef80519ab7dd tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:00.287313 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-44e00555-e821-4213-bc9a-ef80519ab7dd tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:00.288221 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-44e00555-e821-4213-bc9a-ef80519ab7dd tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:00.288662 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-44e00555-e821-4213-bc9a-ef80519ab7dd tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:00.419951 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-44e00555-e821-4213-bc9a-ef80519ab7dd tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859c1493a30d4386b74377ab2b9bc81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3efb8824be84323b6ec04b604775bd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:00.428125 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-44e00555-e821-4213-bc9a-ef80519ab7dd tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] 10.222.0.17 "GET /compute/v2.1/servers/dcb1aa47-1abb-4c2f-9686-7268d2b86967" status: 200 len: 1510 microversion: 2.1 time: 0.152187 Jul 23 21:26:00.428793 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1528/3023] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:00 2022] GET /compute/v2.1/servers/dcb1aa47-1abb-4c2f-9686-7268d2b86967 => generated 1510 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:00.443850 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-0a226a31-c045-4c6f-9b26-5380bc35321d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:00.444368 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-0a226a31-c045-4c6f-9b26-5380bc35321d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:00.450629 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0a226a31-c045-4c6f-9b26-5380bc35321d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:00.451018 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0a226a31-c045-4c6f-9b26-5380bc35321d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:00.451788 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0a226a31-c045-4c6f-9b26-5380bc35321d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:00.452226 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0a226a31-c045-4c6f-9b26-5380bc35321d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:00.535842 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-0a226a31-c045-4c6f-9b26-5380bc35321d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:00.547566 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-0a226a31-c045-4c6f-9b26-5380bc35321d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:00.549289 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-0a226a31-c045-4c6f-9b26-5380bc35321d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:00.552596 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-0a226a31-c045-4c6f-9b26-5380bc35321d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.112739 Jul 23 21:26:00.557523 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1529/3024] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:26:00 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:26:00.570161 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-7183d726-4e22-490e-aa71-80687279b7a0 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:00.571146 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-7183d726-4e22-490e-aa71-80687279b7a0 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] [instance: d9c0391f-e638-415e-b079-ab7b429492c3] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:00.579976 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7183d726-4e22-490e-aa71-80687279b7a0 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:00.579976 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7183d726-4e22-490e-aa71-80687279b7a0 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:00.580577 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7183d726-4e22-490e-aa71-80687279b7a0 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:00.581426 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7183d726-4e22-490e-aa71-80687279b7a0 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:00.592540 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a2f5aae9-aa8a-44fa-a532-b84e30d5ce60 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a609c39c14343e1bc1edd4b3cd56dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116def61aba4631be91f67df63ebab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:00.601620 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a2f5aae9-aa8a-44fa-a532-b84e30d5ce60 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] 10.222.0.17 "GET /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215" status: 200 len: 1505 microversion: 2.1 time: 0.344895 Jul 23 21:26:00.602569 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1496/3025] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:00 2022] GET /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215 => generated 1505 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:26:00.608039 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6a79ac9c-7ba1-462e-a279-7106c2d9c2af tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:00.608817 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6a79ac9c-7ba1-462e-a279-7106c2d9c2af tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] [instance: 4085bec2-40ec-4324-b718-2c7ec388a22e] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:00.617633 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6a79ac9c-7ba1-462e-a279-7106c2d9c2af tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:00.618100 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6a79ac9c-7ba1-462e-a279-7106c2d9c2af tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:00.619413 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6a79ac9c-7ba1-462e-a279-7106c2d9c2af tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:00.620855 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6a79ac9c-7ba1-462e-a279-7106c2d9c2af tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:00.749351 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-7183d726-4e22-490e-aa71-80687279b7a0 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859c1493a30d4386b74377ab2b9bc81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3efb8824be84323b6ec04b604775bd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:00.758778 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-7183d726-4e22-490e-aa71-80687279b7a0 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] 10.222.0.17 "GET /compute/v2.1/servers/d9c0391f-e638-415e-b079-ab7b429492c3" status: 200 len: 1510 microversion: 2.1 time: 0.201669 Jul 23 21:26:00.759685 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1530/3026] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:00 2022] GET /compute/v2.1/servers/d9c0391f-e638-415e-b079-ab7b429492c3 => generated 1510 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:00.768828 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-1d27ebca-c3f7-4682-9173-988442dfd755 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:00.770169 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-1d27ebca-c3f7-4682-9173-988442dfd755 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: e893255e-87db-418f-8374-dc2d800f4ff5] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:00.777475 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1d27ebca-c3f7-4682-9173-988442dfd755 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:00.778239 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1d27ebca-c3f7-4682-9173-988442dfd755 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:00.779444 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1d27ebca-c3f7-4682-9173-988442dfd755 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:00.780083 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1d27ebca-c3f7-4682-9173-988442dfd755 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:00.810929 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell0:SELECT=26 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:26:00.879564 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell0:SELECT=7 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:26:00.903829 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6a79ac9c-7ba1-462e-a279-7106c2d9c2af tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961e46ab94f4fffbc606485935ce64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8305585b60d54beeb2b087a37260a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:00.915052 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6a79ac9c-7ba1-462e-a279-7106c2d9c2af tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] 10.222.0.17 "GET /compute/v2.1/servers/4085bec2-40ec-4324-b718-2c7ec388a22e" status: 200 len: 1527 microversion: 2.1 time: 0.311304 Jul 23 21:26:00.925600 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1497/3027] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:00 2022] GET /compute/v2.1/servers/4085bec2-40ec-4324-b718-2c7ec388a22e => generated 1527 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:00.932737 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8040be56-7282-48d6-b36d-1896d05c23e2 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:00.939540 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8040be56-7282-48d6-b36d-1896d05c23e2 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '859c1493a30d4386b74377ab2b9bc81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3efb8824be84323b6ec04b604775bd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:00.941153 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8040be56-7282-48d6-b36d-1896d05c23e2 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Searching by: {'deleted': False, 'project_id': 'b3efb8824be84323b6ec04b604775bd0'} {{(pid=131320) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 23 21:26:00.948429 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8040be56-7282-48d6-b36d-1896d05c23e2 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:00.949135 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8040be56-7282-48d6-b36d-1896d05c23e2 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:00.950198 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8040be56-7282-48d6-b36d-1896d05c23e2 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:00.950794 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8040be56-7282-48d6-b36d-1896d05c23e2 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:00.975372 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-1d27ebca-c3f7-4682-9173-988442dfd755 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:00.984776 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-1d27ebca-c3f7-4682-9173-988442dfd755 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/e893255e-87db-418f-8374-dc2d800f4ff5" status: 200 len: 1315 microversion: 2.1 time: 0.223256 Jul 23 21:26:00.985770 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1531/3028] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:00 2022] GET /compute/v2.1/servers/e893255e-87db-418f-8374-dc2d800f4ff5 => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:00.990626 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.multi_cell_list [None req-8040be56-7282-48d6-b36d-1896d05c23e2 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=131320) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 23 21:26:01.044042 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-24ff67a7-5685-400b-9577-a3553a40acd7 req-ae4d0d3b-1f8f-4189-b166-af63b7004d06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e893255e-87db-418f-8374-dc2d800f4ff5", "name": "network-vif-plugged", "status": "completed", "tag": "a2966984-a247-41b3-8d85-9e618375ba42"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:26:01.063114 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-24ff67a7-5685-400b-9577-a3553a40acd7 req-ae4d0d3b-1f8f-4189-b166-af63b7004d06 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:01.063409 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8040be56-7282-48d6-b36d-1896d05c23e2 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859c1493a30d4386b74377ab2b9bc81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3efb8824be84323b6ec04b604775bd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:01.064348 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-24ff67a7-5685-400b-9577-a3553a40acd7 req-ae4d0d3b-1f8f-4189-b166-af63b7004d06 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:01.078433 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8040be56-7282-48d6-b36d-1896d05c23e2 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:01.078940 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8040be56-7282-48d6-b36d-1896d05c23e2 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:01.080369 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-24ff67a7-5685-400b-9577-a3553a40acd7 req-ae4d0d3b-1f8f-4189-b166-af63b7004d06 service nova] Creating event network-vif-plugged:a2966984-a247-41b3-8d85-9e618375ba42 for instance e893255e-87db-418f-8374-dc2d800f4ff5 on nch2-master-1 Jul 23 21:26:01.088163 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-24ff67a7-5685-400b-9577-a3553a40acd7 req-ae4d0d3b-1f8f-4189-b166-af63b7004d06 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052279 Jul 23 21:26:01.089486 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1532/3029] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:26:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:26:01.096581 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-4b5ad3c0-7bc6-47f2-b0fd-e2de49c7f167 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:01.097552 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-4b5ad3c0-7bc6-47f2-b0fd-e2de49c7f167 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: d303403b-5d14-443b-a6fe-f8b579d24cda] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:01.105854 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4b5ad3c0-7bc6-47f2-b0fd-e2de49c7f167 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:01.106822 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4b5ad3c0-7bc6-47f2-b0fd-e2de49c7f167 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:01.107686 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4b5ad3c0-7bc6-47f2-b0fd-e2de49c7f167 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:01.109066 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4b5ad3c0-7bc6-47f2-b0fd-e2de49c7f167 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:01.308134 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-4b5ad3c0-7bc6-47f2-b0fd-e2de49c7f167 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:01.324120 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-4b5ad3c0-7bc6-47f2-b0fd-e2de49c7f167 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda" status: 200 len: 1514 microversion: 2.1 time: 0.232662 Jul 23 21:26:01.333989 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1533/3030] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:01 2022] GET /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda => generated 1514 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:01.487261 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-230e1975-4b51-4a00-84a5-dc133b0860b5 req-bed06954-9c79-454d-9794-e4107d5e4334 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4085bec2-40ec-4324-b718-2c7ec388a22e", "name": "network-vif-deleted", "tag": "39fbda00-62e3-43a1-8cd6-e48af6277d20"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:26:01.487557 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8040be56-7282-48d6-b36d-1896d05c23e2 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] 10.222.0.17 "GET /compute/v2.1/servers/detail" status: 200 len: 4512 microversion: 2.1 time: 0.560384 Jul 23 21:26:01.489006 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1498/3031] 10.222.0.17 () {58 vars in 1145 bytes} [Sat Jul 23 21:26:00 2022] GET /compute/v2.1/servers/detail => generated 4512 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:01.504141 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-230e1975-4b51-4a00-84a5-dc133b0860b5 req-bed06954-9c79-454d-9794-e4107d5e4334 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:01.504696 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-230e1975-4b51-4a00-84a5-dc133b0860b5 req-bed06954-9c79-454d-9794-e4107d5e4334 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:01.511229 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-cfa195b6-1574-4dc1-9566-153f6c217e47 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:01.515127 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-cfa195b6-1574-4dc1-9566-153f6c217e47 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '859c1493a30d4386b74377ab2b9bc81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3efb8824be84323b6ec04b604775bd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:01.515834 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-cfa195b6-1574-4dc1-9566-153f6c217e47 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': 'b3efb8824be84323b6ec04b604775bd0'} {{(pid=131320) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 23 21:26:01.533483 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-230e1975-4b51-4a00-84a5-dc133b0860b5 req-bed06954-9c79-454d-9794-e4107d5e4334 service nova] Creating event network-vif-deleted:39fbda00-62e3-43a1-8cd6-e48af6277d20 for instance 4085bec2-40ec-4324-b718-2c7ec388a22e on nch1-master-1 Jul 23 21:26:01.540068 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-230e1975-4b51-4a00-84a5-dc133b0860b5 req-bed06954-9c79-454d-9794-e4107d5e4334 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056944 Jul 23 21:26:01.541263 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1534/3032] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:26:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:26:01.588956 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-5d5a00ee-cb6d-4b64-b90c-4518d4b9c106 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:01.596645 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-5d5a00ee-cb6d-4b64-b90c-4518d4b9c106 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:01.614124 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5d5a00ee-cb6d-4b64-b90c-4518d4b9c106 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:01.614931 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5d5a00ee-cb6d-4b64-b90c-4518d4b9c106 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:01.619180 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5d5a00ee-cb6d-4b64-b90c-4518d4b9c106 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:01.620487 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5d5a00ee-cb6d-4b64-b90c-4518d4b9c106 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:01.701231 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cfa195b6-1574-4dc1-9566-153f6c217e47 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:01.701687 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cfa195b6-1574-4dc1-9566-153f6c217e47 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:01.702522 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cfa195b6-1574-4dc1-9566-153f6c217e47 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:01.702963 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cfa195b6-1574-4dc1-9566-153f6c217e47 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:01.710469 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-5d5a00ee-cb6d-4b64-b90c-4518d4b9c106 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:01.720792 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-5d5a00ee-cb6d-4b64-b90c-4518d4b9c106 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:01.722790 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-5d5a00ee-cb6d-4b64-b90c-4518d4b9c106 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:01.724190 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-5d5a00ee-cb6d-4b64-b90c-4518d4b9c106 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.151422 Jul 23 21:26:01.724933 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1535/3033] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:26:01 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:26:01.730628 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-355f8336-7582-41db-8ed3-c75a859f8f85 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:01.731407 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-355f8336-7582-41db-8ed3-c75a859f8f85 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] [instance: cb3a66a8-4c84-4bb1-8b3f-0c48acec1215] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:01.742793 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-355f8336-7582-41db-8ed3-c75a859f8f85 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:01.743464 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-355f8336-7582-41db-8ed3-c75a859f8f85 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:01.744441 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-355f8336-7582-41db-8ed3-c75a859f8f85 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:01.744884 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-355f8336-7582-41db-8ed3-c75a859f8f85 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:01.765971 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.multi_cell_list [None req-cfa195b6-1574-4dc1-9566-153f6c217e47 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=131320) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 23 21:26:01.803912 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-cfa195b6-1574-4dc1-9566-153f6c217e47 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] 10.222.0.17 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1009 microversion: 2.1 time: 0.296453 Jul 23 21:26:01.805022 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1499/3034] 10.222.0.17 () {58 vars in 1149 bytes} [Sat Jul 23 21:26:01 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1009 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:26:01.824741 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c6ad4a2f-78c1-4fda-8270-25c280acc387 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:01.829455 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c6ad4a2f-78c1-4fda-8270-25c280acc387 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '859c1493a30d4386b74377ab2b9bc81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3efb8824be84323b6ec04b604775bd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:01.830669 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c6ad4a2f-78c1-4fda-8270-25c280acc387 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': 'b3efb8824be84323b6ec04b604775bd0'} {{(pid=131320) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 23 21:26:01.837232 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c6ad4a2f-78c1-4fda-8270-25c280acc387 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:01.838355 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c6ad4a2f-78c1-4fda-8270-25c280acc387 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:01.839377 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c6ad4a2f-78c1-4fda-8270-25c280acc387 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:01.840004 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c6ad4a2f-78c1-4fda-8270-25c280acc387 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:01.935920 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-355f8336-7582-41db-8ed3-c75a859f8f85 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a609c39c14343e1bc1edd4b3cd56dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116def61aba4631be91f67df63ebab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:01.944560 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.multi_cell_list [None req-c6ad4a2f-78c1-4fda-8270-25c280acc387 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=131320) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 23 21:26:01.946129 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-355f8336-7582-41db-8ed3-c75a859f8f85 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] 10.222.0.17 "GET /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215" status: 200 len: 1505 microversion: 2.1 time: 0.219823 Jul 23 21:26:01.959432 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1536/3035] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:01 2022] GET /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215 => generated 1505 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:01.964690 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-60140d8c-6efd-4b32-aeea-3faf1e1ae9c2 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:01.970745 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-60140d8c-6efd-4b32-aeea-3faf1e1ae9c2 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] [instance: 4085bec2-40ec-4324-b718-2c7ec388a22e] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:01.977522 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-60140d8c-6efd-4b32-aeea-3faf1e1ae9c2 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:01.978242 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-60140d8c-6efd-4b32-aeea-3faf1e1ae9c2 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:01.979287 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-60140d8c-6efd-4b32-aeea-3faf1e1ae9c2 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:01.979888 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-60140d8c-6efd-4b32-aeea-3faf1e1ae9c2 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:02.023381 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-60140d8c-6efd-4b32-aeea-3faf1e1ae9c2 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:02.024002 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-60140d8c-6efd-4b32-aeea-3faf1e1ae9c2 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:02.024555 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.objects.instance [None req-60140d8c-6efd-4b32-aeea-3faf1e1ae9c2 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lazy-loading 'fault' on Instance uuid 4085bec2-40ec-4324-b718-2c7ec388a22e {{(pid=131321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:26:02.029081 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c6ad4a2f-78c1-4fda-8270-25c280acc387 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] 10.222.0.17 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1009 microversion: 2.1 time: 0.210306 Jul 23 21:26:02.035071 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1500/3036] 10.222.0.17 () {58 vars in 1211 bytes} [Sat Jul 23 21:26:01 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1009 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:26:02.046852 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-503ce85d-3622-4bb1-8ce2-f9c8e0a74977 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:02.048038 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-503ce85d-3622-4bb1-8ce2-f9c8e0a74977 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: e893255e-87db-418f-8374-dc2d800f4ff5] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:02.055440 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-503ce85d-3622-4bb1-8ce2-f9c8e0a74977 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:02.055847 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-503ce85d-3622-4bb1-8ce2-f9c8e0a74977 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:02.056676 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-503ce85d-3622-4bb1-8ce2-f9c8e0a74977 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:02.057194 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-503ce85d-3622-4bb1-8ce2-f9c8e0a74977 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:02.079623 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-60140d8c-6efd-4b32-aeea-3faf1e1ae9c2 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961e46ab94f4fffbc606485935ce64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8305585b60d54beeb2b087a37260a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:02.089133 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-60140d8c-6efd-4b32-aeea-3faf1e1ae9c2 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] 10.222.0.17 "GET /compute/v2.1/servers/4085bec2-40ec-4324-b718-2c7ec388a22e" status: 200 len: 1314 microversion: 2.1 time: 0.128223 Jul 23 21:26:02.090303 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1537/3037] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:01 2022] GET /compute/v2.1/servers/4085bec2-40ec-4324-b718-2c7ec388a22e => generated 1314 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:02.094846 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-951d7ff4-974d-42b7-8cd0-4edccd6e2c4a tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:02.098967 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-951d7ff4-974d-42b7-8cd0-4edccd6e2c4a tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '859c1493a30d4386b74377ab2b9bc81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3efb8824be84323b6ec04b604775bd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:02.099751 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-951d7ff4-974d-42b7-8cd0-4edccd6e2c4a tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': 'b3efb8824be84323b6ec04b604775bd0'} {{(pid=131321) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 23 21:26:02.105675 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-951d7ff4-974d-42b7-8cd0-4edccd6e2c4a tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:02.106182 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-951d7ff4-974d-42b7-8cd0-4edccd6e2c4a tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:02.107500 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-951d7ff4-974d-42b7-8cd0-4edccd6e2c4a tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:02.108351 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-951d7ff4-974d-42b7-8cd0-4edccd6e2c4a tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:02.236021 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.multi_cell_list [None req-951d7ff4-974d-42b7-8cd0-4edccd6e2c4a tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=131321) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 23 21:26:02.317380 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-951d7ff4-974d-42b7-8cd0-4edccd6e2c4a tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] 10.222.0.17 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1009 microversion: 2.1 time: 0.226076 Jul 23 21:26:02.323664 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1538/3038] 10.222.0.17 () {58 vars in 1195 bytes} [Sat Jul 23 21:26:02 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1009 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:02.330682 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-cf94a08a-045d-4bdd-a2dc-d6f403b5da8a tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:02.335454 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-cf94a08a-045d-4bdd-a2dc-d6f403b5da8a tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '859c1493a30d4386b74377ab2b9bc81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3efb8824be84323b6ec04b604775bd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:02.335454 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-cf94a08a-045d-4bdd-a2dc-d6f403b5da8a tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Searching by: {'name': '-649361757', 'deleted': False, 'project_id': 'b3efb8824be84323b6ec04b604775bd0'} {{(pid=131321) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 23 21:26:02.342815 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cf94a08a-045d-4bdd-a2dc-d6f403b5da8a tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:02.343268 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cf94a08a-045d-4bdd-a2dc-d6f403b5da8a tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:02.344070 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cf94a08a-045d-4bdd-a2dc-d6f403b5da8a tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:02.344507 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cf94a08a-045d-4bdd-a2dc-d6f403b5da8a tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:02.357239 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-503ce85d-3622-4bb1-8ce2-f9c8e0a74977 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:02.366207 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:26:02.375680 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-503ce85d-3622-4bb1-8ce2-f9c8e0a74977 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/e893255e-87db-418f-8374-dc2d800f4ff5" status: 200 len: 1315 microversion: 2.1 time: 0.342279 Jul 23 21:26:02.376323 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1501/3039] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:02 2022] GET /compute/v2.1/servers/e893255e-87db-418f-8374-dc2d800f4ff5 => generated 1315 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:02.381113 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-78980f84-04f9-4864-b39b-a2fb3492626b tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:02.381856 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-78980f84-04f9-4864-b39b-a2fb3492626b tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: d303403b-5d14-443b-a6fe-f8b579d24cda] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:02.389353 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-78980f84-04f9-4864-b39b-a2fb3492626b tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:02.390741 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-78980f84-04f9-4864-b39b-a2fb3492626b tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:02.391560 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-78980f84-04f9-4864-b39b-a2fb3492626b tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:02.392003 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-78980f84-04f9-4864-b39b-a2fb3492626b tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:02.432726 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=100 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:26:02.436711 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.multi_cell_list [None req-cf94a08a-045d-4bdd-a2dc-d6f403b5da8a tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131321) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 23 21:26:02.496660 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-cf94a08a-045d-4bdd-a2dc-d6f403b5da8a tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] 10.222.0.17 "GET /compute/v2.1/servers?name=-649361757" status: 200 len: 345 microversion: 2.1 time: 0.170743 Jul 23 21:26:02.497262 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1539/3040] 10.222.0.17 () {58 vars in 1155 bytes} [Sat Jul 23 21:26:02 2022] GET /compute/v2.1/servers?name=-649361757 => generated 345 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:26:02.510840 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-0321a793-9440-46b7-8548-4c9344edbb12 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:02.514564 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-0321a793-9440-46b7-8548-4c9344edbb12 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '859c1493a30d4386b74377ab2b9bc81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3efb8824be84323b6ec04b604775bd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:02.515059 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-0321a793-9440-46b7-8548-4c9344edbb12 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': 'b3efb8824be84323b6ec04b604775bd0'} {{(pid=131321) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 23 21:26:02.520580 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0321a793-9440-46b7-8548-4c9344edbb12 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:02.521033 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0321a793-9440-46b7-8548-4c9344edbb12 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:02.521887 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0321a793-9440-46b7-8548-4c9344edbb12 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:02.522374 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0321a793-9440-46b7-8548-4c9344edbb12 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:02.621533 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.multi_cell_list [None req-0321a793-9440-46b7-8548-4c9344edbb12 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=131321) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 23 21:26:02.697401 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-0321a793-9440-46b7-8548-4c9344edbb12 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] 10.222.0.17 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1009 microversion: 2.1 time: 0.190486 Jul 23 21:26:02.698055 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1540/3041] 10.222.0.17 () {58 vars in 1153 bytes} [Sat Jul 23 21:26:02 2022] GET /compute/v2.1/servers?name=-instance => generated 1009 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:26:02.709424 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-97ee86d8-92f3-4167-b8b8-f2944b43d067 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:02.715041 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-97ee86d8-92f3-4167-b8b8-f2944b43d067 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '859c1493a30d4386b74377ab2b9bc81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3efb8824be84323b6ec04b604775bd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:02.715718 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-97ee86d8-92f3-4167-b8b8-f2944b43d067 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-64936175', 'deleted': False, 'project_id': 'b3efb8824be84323b6ec04b604775bd0'} {{(pid=131321) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 23 21:26:02.721474 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-97ee86d8-92f3-4167-b8b8-f2944b43d067 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:02.722136 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-97ee86d8-92f3-4167-b8b8-f2944b43d067 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:02.722985 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-97ee86d8-92f3-4167-b8b8-f2944b43d067 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:02.723594 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-97ee86d8-92f3-4167-b8b8-f2944b43d067 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:02.810379 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.multi_cell_list [None req-97ee86d8-92f3-4167-b8b8-f2944b43d067 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131321) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 23 21:26:02.876890 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-97ee86d8-92f3-4167-b8b8-f2944b43d067 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] 10.222.0.17 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-64936175" status: 200 len: 345 microversion: 2.1 time: 0.171539 Jul 23 21:26:02.877847 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1541/3042] 10.222.0.17 () {58 vars in 1225 bytes} [Sat Jul 23 21:26:02 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-64936175 => generated 345 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:26:02.891367 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ec2121de-8691-4a42-a766-31d645d09ee2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:02.892257 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-ec2121de-8691-4a42-a766-31d645d09ee2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:02.901515 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ec2121de-8691-4a42-a766-31d645d09ee2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:02.902295 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ec2121de-8691-4a42-a766-31d645d09ee2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:02.903253 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ec2121de-8691-4a42-a766-31d645d09ee2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:02.903855 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ec2121de-8691-4a42-a766-31d645d09ee2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:02.992858 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ec2121de-8691-4a42-a766-31d645d09ee2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:03.007161 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-78980f84-04f9-4864-b39b-a2fb3492626b tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:03.007795 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ec2121de-8691-4a42-a766-31d645d09ee2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:03.009302 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ec2121de-8691-4a42-a766-31d645d09ee2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:03.010594 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-ec2121de-8691-4a42-a766-31d645d09ee2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.131696 Jul 23 21:26:03.011066 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1542/3043] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:26:02 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:26:03.016094 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ad7ffea5-b9d8-4a9b-8aa4-49d28b25dcc7 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:03.016955 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-ad7ffea5-b9d8-4a9b-8aa4-49d28b25dcc7 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] [instance: d9c0391f-e638-415e-b079-ab7b429492c3] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:03.028826 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ad7ffea5-b9d8-4a9b-8aa4-49d28b25dcc7 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:03.029265 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ad7ffea5-b9d8-4a9b-8aa4-49d28b25dcc7 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:03.030155 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-78980f84-04f9-4864-b39b-a2fb3492626b tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda" status: 200 len: 1514 microversion: 2.1 time: 0.652727 Jul 23 21:26:03.030293 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ad7ffea5-b9d8-4a9b-8aa4-49d28b25dcc7 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:03.030716 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ad7ffea5-b9d8-4a9b-8aa4-49d28b25dcc7 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:03.045213 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1502/3044] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:02 2022] GET /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda => generated 1514 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:03.051924 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-bbf4423f-0ddb-4add-9860-6ca412271497 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:03.058870 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-bbf4423f-0ddb-4add-9860-6ca412271497 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] [instance: cb3a66a8-4c84-4bb1-8b3f-0c48acec1215] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:03.060375 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-ad7ffea5-b9d8-4a9b-8aa4-49d28b25dcc7 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] [instance: d9c0391f-e638-415e-b079-ab7b429492c3] Going to try to terminate instance {{(pid=131321) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:26:03.066715 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bbf4423f-0ddb-4add-9860-6ca412271497 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:03.067377 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bbf4423f-0ddb-4add-9860-6ca412271497 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:03.068340 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bbf4423f-0ddb-4add-9860-6ca412271497 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:03.068936 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bbf4423f-0ddb-4add-9860-6ca412271497 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:03.165486 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-ad7ffea5-b9d8-4a9b-8aa4-49d28b25dcc7 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d9c0391f-e638-415e-b079-ab7b429492c3" status: 204 len: 0 microversion: 2.1 time: 0.147365 Jul 23 21:26:03.169279 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1543/3045] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:26:03 2022] DELETE /compute/v2.1/servers/d9c0391f-e638-415e-b079-ab7b429492c3 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:26:03.172989 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-63c5ba01-6ac1-4598-b777-b9008c5dfb70 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:03.173803 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-63c5ba01-6ac1-4598-b777-b9008c5dfb70 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] [instance: 4085bec2-40ec-4324-b718-2c7ec388a22e] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:03.180724 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-63c5ba01-6ac1-4598-b777-b9008c5dfb70 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:03.181173 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-63c5ba01-6ac1-4598-b777-b9008c5dfb70 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:03.181985 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-63c5ba01-6ac1-4598-b777-b9008c5dfb70 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:03.182579 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-63c5ba01-6ac1-4598-b777-b9008c5dfb70 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:03.198273 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-63c5ba01-6ac1-4598-b777-b9008c5dfb70 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] HTTP exception thrown: Instance 4085bec2-40ec-4324-b718-2c7ec388a22e could not be found. Jul 23 21:26:03.199937 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-63c5ba01-6ac1-4598-b777-b9008c5dfb70 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Request method failure captured: Jul 23 21:26:03.199937 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/servers/4085bec2-40ec-4324-b718-2c7ec388a22e HTTP/1.1 Jul 23 21:26:03.199937 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:26:03.199937 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:26:03.199937 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:26:03.199937 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:26:03.199937 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:26:03.199937 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:26:03.199937 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:26:03.199937 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:26:03.199937 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GcdFkVYIK2DtJm403sM7IG79jHXbShtkQheCHNeqOWOy-LrSxvgAeYLVbMoRM5VFKN6qfODnVk_B5qM-rDymLVGR4aR0RY1RwNvXXeBnLkJldpttrzdMpyZMOqZL8mI9RN_pqnVy4UDfpP9Qj4sUGOBflgakohNp1Y8WLMI7QhzBds Jul 23 21:26:03.199937 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:26:03.199937 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:26:03.199937 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:26:03.199937 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:26:03.199937 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:26:03.199937 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:26:03.199937 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 8305585b60d54beeb2b087a37260a89a Jul 23 21:26:03.199937 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1030577641 Jul 23 21:26:03.199937 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:26:03.199937 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:26:03.199937 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8305585b60d54beeb2b087a37260a89a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8305585b60d54beeb2b087a37260a89a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8305585b60d54beeb2b087a37260a89a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8305585b60d54beeb2b087a37260a89a"}]}] Jul 23 21:26:03.199937 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1030577641 Jul 23 21:26:03.199937 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 8305585b60d54beeb2b087a37260a89a Jul 23 21:26:03.199937 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1030577641 Jul 23 21:26:03.199937 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ImagesOneServerNegativeTestJSON-1030577641-project Jul 23 21:26:03.199937 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:26:03.199937 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:26:03.199937 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: e961e46ab94f4fffbc606485935ce64d Jul 23 21:26:03.199937 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1030577641-project Jul 23 21:26:03.199937 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:26:03.199937 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance 4085bec2-40ec-4324-b718-2c7ec388a22e could not be found. Jul 23 21:26:03.199937 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': '4085bec2-40ec-4324-b718-2c7ec388a22e'} Jul 23 21:26:03.199937 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:26:03.199937 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:26:03.199937 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:26:03.199937 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:26:03.199937 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:26:03.199937 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:26:03.199937 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:26:03.199937 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:26:03.199937 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:26:03.199937 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:26:03.199937 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4085bec2-40ec-4324-b718-2c7ec388a22e could not be found. Jul 23 21:26:03.199937 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:03.199937 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:26:03.199937 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:03.199937 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:26:03.199937 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:26:03.199937 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:26:03.199937 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:26:03.199937 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:26:03.199937 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:26:03.199937 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:26:03.199937 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:26:03.199937 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:26:03.199937 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:26:03.199937 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:26:03.199937 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:26:03.199937 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:26:03.199937 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4085bec2-40ec-4324-b718-2c7ec388a22e could not be found. Jul 23 21:26:03.199937 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:03.199937 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:26:03.204614 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:03.204614 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:26:03.204614 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:26:03.204614 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:26:03.204614 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:26:03.204614 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:26:03.204614 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4085bec2-40ec-4324-b718-2c7ec388a22e could not be found. Jul 23 21:26:03.204614 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:03.204614 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-63c5ba01-6ac1-4598-b777-b9008c5dfb70 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Returning 404 to user: Instance 4085bec2-40ec-4324-b718-2c7ec388a22e could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:26:03.204614 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-63c5ba01-6ac1-4598-b777-b9008c5dfb70 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] 10.222.0.17 "GET /compute/v2.1/servers/4085bec2-40ec-4324-b718-2c7ec388a22e" status: 404 len: 111 microversion: 2.1 time: 0.033079 Jul 23 21:26:03.204614 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1544/3046] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:03 2022] GET /compute/v2.1/servers/4085bec2-40ec-4324-b718-2c7ec388a22e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:26:03.211895 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-9fc5e59f-3ca9-4895-bb71-9c00e2c44a28 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:03.212766 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-9fc5e59f-3ca9-4895-bb71-9c00e2c44a28 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] [instance: d9c0391f-e638-415e-b079-ab7b429492c3] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:03.219951 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9fc5e59f-3ca9-4895-bb71-9c00e2c44a28 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:03.220422 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9fc5e59f-3ca9-4895-bb71-9c00e2c44a28 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:03.221203 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9fc5e59f-3ca9-4895-bb71-9c00e2c44a28 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:03.221924 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9fc5e59f-3ca9-4895-bb71-9c00e2c44a28 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:03.339649 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-bbf4423f-0ddb-4add-9860-6ca412271497 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a609c39c14343e1bc1edd4b3cd56dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116def61aba4631be91f67df63ebab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:03.351627 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-bbf4423f-0ddb-4add-9860-6ca412271497 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] 10.222.0.17 "GET /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215" status: 200 len: 1505 microversion: 2.1 time: 0.304991 Jul 23 21:26:03.360884 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1503/3047] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:03 2022] GET /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215 => generated 1505 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:03.360884 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-7823e9ba-09df-48cd-a4eb-06c2f082244a tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1260632000", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:26:03.369254 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-9fc5e59f-3ca9-4895-bb71-9c00e2c44a28 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859c1493a30d4386b74377ab2b9bc81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3efb8824be84323b6ec04b604775bd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:03.377924 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-9fc5e59f-3ca9-4895-bb71-9c00e2c44a28 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] 10.222.0.17 "GET /compute/v2.1/servers/d9c0391f-e638-415e-b079-ab7b429492c3" status: 200 len: 1516 microversion: 2.1 time: 0.171001 Jul 23 21:26:03.378664 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1545/3048] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:03 2022] GET /compute/v2.1/servers/d9c0391f-e638-415e-b079-ab7b429492c3 => generated 1516 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:03.393019 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-cdad0451-6403-41ce-a03d-b9807114021a tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:03.393646 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-cdad0451-6403-41ce-a03d-b9807114021a tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: e893255e-87db-418f-8374-dc2d800f4ff5] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:03.408159 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cdad0451-6403-41ce-a03d-b9807114021a tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:03.408635 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cdad0451-6403-41ce-a03d-b9807114021a tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:03.409430 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cdad0451-6403-41ce-a03d-b9807114021a tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:03.409898 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cdad0451-6403-41ce-a03d-b9807114021a tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:03.440073 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-7823e9ba-09df-48cd-a4eb-06c2f082244a tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] validate_networks() for [('b32dd772-4f2a-4847-b3c5-349ce055ea43', None, None, None, None, None)] {{(pid=131320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:26:03.612399 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-cdad0451-6403-41ce-a03d-b9807114021a tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:03.621310 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-cdad0451-6403-41ce-a03d-b9807114021a tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/e893255e-87db-418f-8374-dc2d800f4ff5" status: 200 len: 1502 microversion: 2.1 time: 0.232213 Jul 23 21:26:03.622194 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1546/3049] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:03 2022] GET /compute/v2.1/servers/e893255e-87db-418f-8374-dc2d800f4ff5 => generated 1502 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:26:03.639135 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-0ffb83d2-c859-404f-aedb-52136c5d39f7 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:03.639744 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-0ffb83d2-c859-404f-aedb-52136c5d39f7 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: e893255e-87db-418f-8374-dc2d800f4ff5] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:03.646969 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0ffb83d2-c859-404f-aedb-52136c5d39f7 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:03.647511 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0ffb83d2-c859-404f-aedb-52136c5d39f7 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:03.648295 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0ffb83d2-c859-404f-aedb-52136c5d39f7 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:03.648734 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0ffb83d2-c859-404f-aedb-52136c5d39f7 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:03.674559 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-0ffb83d2-c859-404f-aedb-52136c5d39f7 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: e893255e-87db-418f-8374-dc2d800f4ff5] Going to try to terminate instance {{(pid=131321) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:26:03.765314 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-0ffb83d2-c859-404f-aedb-52136c5d39f7 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "DELETE /compute/v2.1/servers/e893255e-87db-418f-8374-dc2d800f4ff5" status: 204 len: 0 microversion: 2.1 time: 0.131055 Jul 23 21:26:03.766149 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1547/3050] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:26:03 2022] DELETE /compute/v2.1/servers/e893255e-87db-418f-8374-dc2d800f4ff5 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 23 21:26:03.774640 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-2df651b5-2b42-43fb-a56a-54066cdc6e7e tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:03.775490 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-2df651b5-2b42-43fb-a56a-54066cdc6e7e tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: e893255e-87db-418f-8374-dc2d800f4ff5] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:03.781642 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2df651b5-2b42-43fb-a56a-54066cdc6e7e tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:03.782195 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2df651b5-2b42-43fb-a56a-54066cdc6e7e tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:03.782962 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2df651b5-2b42-43fb-a56a-54066cdc6e7e tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:03.783394 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2df651b5-2b42-43fb-a56a-54066cdc6e7e tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:03.938588 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-2df651b5-2b42-43fb-a56a-54066cdc6e7e tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:03.948511 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-2df651b5-2b42-43fb-a56a-54066cdc6e7e tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/e893255e-87db-418f-8374-dc2d800f4ff5" status: 200 len: 1508 microversion: 2.1 time: 0.177976 Jul 23 21:26:03.949454 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1548/3051] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:03 2022] GET /compute/v2.1/servers/e893255e-87db-418f-8374-dc2d800f4ff5 => generated 1508 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:26:04.028891 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e0c3a718-0c10-4d9b-828c-4ba35b0b4826 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:04.029555 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-e0c3a718-0c10-4d9b-828c-4ba35b0b4826 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:04.031698 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:26:04.037566 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e0c3a718-0c10-4d9b-828c-4ba35b0b4826 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:04.038087 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e0c3a718-0c10-4d9b-828c-4ba35b0b4826 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:04.038868 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e0c3a718-0c10-4d9b-828c-4ba35b0b4826 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:04.039308 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e0c3a718-0c10-4d9b-828c-4ba35b0b4826 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:04.100639 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-7823e9ba-09df-48cd-a4eb-06c2f082244a tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:26:04.101968 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-7823e9ba-09df-48cd-a4eb-06c2f082244a tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:26:04.102665 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-7823e9ba-09df-48cd-a4eb-06c2f082244a tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:26:04.103299 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-7823e9ba-09df-48cd-a4eb-06c2f082244a tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:26:04.103787 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-7823e9ba-09df-48cd-a4eb-06c2f082244a tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:26:04.104205 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-e0c3a718-0c10-4d9b-828c-4ba35b0b4826 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:04.114371 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-e0c3a718-0c10-4d9b-828c-4ba35b0b4826 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:04.115891 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-e0c3a718-0c10-4d9b-828c-4ba35b0b4826 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:04.117583 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-e0c3a718-0c10-4d9b-828c-4ba35b0b4826 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.092683 Jul 23 21:26:04.117712 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7823e9ba-09df-48cd-a4eb-06c2f082244a tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:04.118215 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7823e9ba-09df-48cd-a4eb-06c2f082244a tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:04.119306 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7823e9ba-09df-48cd-a4eb-06c2f082244a tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:04.119970 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7823e9ba-09df-48cd-a4eb-06c2f082244a tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:04.129161 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1549/3052] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:26:04 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:26:04.134164 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-fa683e14-c037-4a43-ab21-b7f090909b54 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:04.134910 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-fa683e14-c037-4a43-ab21-b7f090909b54 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: d303403b-5d14-443b-a6fe-f8b579d24cda] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:04.140808 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fa683e14-c037-4a43-ab21-b7f090909b54 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:04.141402 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fa683e14-c037-4a43-ab21-b7f090909b54 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:04.142438 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fa683e14-c037-4a43-ab21-b7f090909b54 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:04.142862 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fa683e14-c037-4a43-ab21-b7f090909b54 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:04.149388 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-7823e9ba-09df-48cd-a4eb-06c2f082244a tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Getting quotas for project 8305585b60d54beeb2b087a37260a89a. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:26:04.156972 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-7823e9ba-09df-48cd-a4eb-06c2f082244a tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Getting quotas for user e961e46ab94f4fffbc606485935ce64d and project 8305585b60d54beeb2b087a37260a89a. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:26:04.174417 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-7823e9ba-09df-48cd-a4eb-06c2f082244a tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Going to run 1 instances... {{(pid=131320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:26:04.177259 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-7823e9ba-09df-48cd-a4eb-06c2f082244a tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] [instance: 5429c0b0-c38d-424d-90ef-4a54df8e4cba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:26:04.233634 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-7823e9ba-09df-48cd-a4eb-06c2f082244a tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.879723 Jul 23 21:26:04.242092 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1504/3053] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:26:03 2022] POST /compute/v2.1/servers => generated 383 bytes in 884 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 23 21:26:04.250475 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9905a979-66d4-468f-9322-0baa9a9a40a0 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:04.251113 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-9905a979-66d4-468f-9322-0baa9a9a40a0 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] [instance: 5429c0b0-c38d-424d-90ef-4a54df8e4cba] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:04.319779 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-fa683e14-c037-4a43-ab21-b7f090909b54 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:04.328398 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-fa683e14-c037-4a43-ab21-b7f090909b54 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda" status: 200 len: 1514 microversion: 2.1 time: 0.198119 Jul 23 21:26:04.329320 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1550/3054] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:04 2022] GET /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda => generated 1514 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:04.349663 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-9905a979-66d4-468f-9322-0baa9a9a40a0 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961e46ab94f4fffbc606485935ce64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8305585b60d54beeb2b087a37260a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:04.359822 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9905a979-66d4-468f-9322-0baa9a9a40a0 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] 10.222.0.17 "GET /compute/v2.1/servers/5429c0b0-c38d-424d-90ef-4a54df8e4cba" status: 200 len: 1225 microversion: 2.1 time: 0.115803 Jul 23 21:26:04.360957 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1505/3055] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:04 2022] GET /compute/v2.1/servers/5429c0b0-c38d-424d-90ef-4a54df8e4cba => generated 1225 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:26:04.375240 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-537c3927-8b8e-4b1b-b6b5-cf7f4f2f8bc1 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:04.375653 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-537c3927-8b8e-4b1b-b6b5-cf7f4f2f8bc1 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] [instance: cb3a66a8-4c84-4bb1-8b3f-0c48acec1215] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:04.382035 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-537c3927-8b8e-4b1b-b6b5-cf7f4f2f8bc1 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:04.382486 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-537c3927-8b8e-4b1b-b6b5-cf7f4f2f8bc1 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:04.383259 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-537c3927-8b8e-4b1b-b6b5-cf7f4f2f8bc1 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:04.383694 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-537c3927-8b8e-4b1b-b6b5-cf7f4f2f8bc1 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:04.397542 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-acf9013c-2d3d-43cb-8115-8181baa59d07 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:04.398413 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-acf9013c-2d3d-43cb-8115-8181baa59d07 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] [instance: d9c0391f-e638-415e-b079-ab7b429492c3] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:04.416448 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-acf9013c-2d3d-43cb-8115-8181baa59d07 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:04.416906 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-acf9013c-2d3d-43cb-8115-8181baa59d07 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:04.417933 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-acf9013c-2d3d-43cb-8115-8181baa59d07 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:04.418386 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-acf9013c-2d3d-43cb-8115-8181baa59d07 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:04.560502 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-537c3927-8b8e-4b1b-b6b5-cf7f4f2f8bc1 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a609c39c14343e1bc1edd4b3cd56dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116def61aba4631be91f67df63ebab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:04.570978 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-537c3927-8b8e-4b1b-b6b5-cf7f4f2f8bc1 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] 10.222.0.17 "GET /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215" status: 200 len: 1505 microversion: 2.1 time: 0.199621 Jul 23 21:26:04.593424 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1551/3056] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:04 2022] GET /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215 => generated 1505 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:04.631956 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-acf9013c-2d3d-43cb-8115-8181baa59d07 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859c1493a30d4386b74377ab2b9bc81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3efb8824be84323b6ec04b604775bd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:04.639699 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-acf9013c-2d3d-43cb-8115-8181baa59d07 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] 10.222.0.17 "GET /compute/v2.1/servers/d9c0391f-e638-415e-b079-ab7b429492c3" status: 200 len: 1516 microversion: 2.1 time: 0.247643 Jul 23 21:26:04.648912 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1506/3057] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:04 2022] GET /compute/v2.1/servers/d9c0391f-e638-415e-b079-ab7b429492c3 => generated 1516 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:26:04.965836 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a54c0da5-ad76-4917-8e6a-22061f41eb07 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:04.966731 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-a54c0da5-ad76-4917-8e6a-22061f41eb07 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: e893255e-87db-418f-8374-dc2d800f4ff5] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:04.975129 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a54c0da5-ad76-4917-8e6a-22061f41eb07 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:04.978005 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a54c0da5-ad76-4917-8e6a-22061f41eb07 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:04.978816 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a54c0da5-ad76-4917-8e6a-22061f41eb07 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:04.979367 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a54c0da5-ad76-4917-8e6a-22061f41eb07 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:05.015012 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:26:05.137236 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-931090f5-b8e0-4b22-b283-1fe05e3ca63b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:05.138083 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-931090f5-b8e0-4b22-b283-1fe05e3ca63b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:05.151799 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-931090f5-b8e0-4b22-b283-1fe05e3ca63b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:05.154513 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-931090f5-b8e0-4b22-b283-1fe05e3ca63b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:05.158419 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-931090f5-b8e0-4b22-b283-1fe05e3ca63b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:05.160710 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-931090f5-b8e0-4b22-b283-1fe05e3ca63b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:05.192738 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-a54c0da5-ad76-4917-8e6a-22061f41eb07 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:05.205973 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-a54c0da5-ad76-4917-8e6a-22061f41eb07 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/e893255e-87db-418f-8374-dc2d800f4ff5" status: 200 len: 1508 microversion: 2.1 time: 0.241590 Jul 23 21:26:05.207391 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1552/3058] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:04 2022] GET /compute/v2.1/servers/e893255e-87db-418f-8374-dc2d800f4ff5 => generated 1508 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:05.332135 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-931090f5-b8e0-4b22-b283-1fe05e3ca63b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:05.341842 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-931090f5-b8e0-4b22-b283-1fe05e3ca63b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:05.343415 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-931090f5-b8e0-4b22-b283-1fe05e3ca63b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:05.344602 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-931090f5-b8e0-4b22-b283-1fe05e3ca63b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.212321 Jul 23 21:26:05.344843 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-3126b9fd-ac1f-43da-97bd-f2da26060512 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:05.357896 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1507/3059] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:26:05 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:26:05.358115 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-3126b9fd-ac1f-43da-97bd-f2da26060512 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: d303403b-5d14-443b-a6fe-f8b579d24cda] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:05.358115 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3126b9fd-ac1f-43da-97bd-f2da26060512 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:05.358115 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3126b9fd-ac1f-43da-97bd-f2da26060512 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:05.358115 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3126b9fd-ac1f-43da-97bd-f2da26060512 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:05.358115 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3126b9fd-ac1f-43da-97bd-f2da26060512 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:05.376953 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a79d6496-692c-4376-9cd7-57115a535c93 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:05.377574 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a79d6496-692c-4376-9cd7-57115a535c93 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] [instance: 5429c0b0-c38d-424d-90ef-4a54df8e4cba] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:05.384524 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a79d6496-692c-4376-9cd7-57115a535c93 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:05.384827 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a79d6496-692c-4376-9cd7-57115a535c93 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:05.385611 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a79d6496-692c-4376-9cd7-57115a535c93 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:05.391305 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a79d6496-692c-4376-9cd7-57115a535c93 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:05.495945 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-3126b9fd-ac1f-43da-97bd-f2da26060512 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:05.504717 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-3126b9fd-ac1f-43da-97bd-f2da26060512 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda" status: 200 len: 1514 microversion: 2.1 time: 0.163556 Jul 23 21:26:05.515517 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1553/3060] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:05 2022] GET /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda => generated 1514 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:26:05.567110 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a79d6496-692c-4376-9cd7-57115a535c93 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961e46ab94f4fffbc606485935ce64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8305585b60d54beeb2b087a37260a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:05.576926 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a79d6496-692c-4376-9cd7-57115a535c93 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] 10.222.0.17 "GET /compute/v2.1/servers/5429c0b0-c38d-424d-90ef-4a54df8e4cba" status: 200 len: 1277 microversion: 2.1 time: 0.203722 Jul 23 21:26:05.582477 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1508/3061] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:05 2022] GET /compute/v2.1/servers/5429c0b0-c38d-424d-90ef-4a54df8e4cba => generated 1277 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:26:05.590445 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c8762139-a8df-43c8-b934-c7c1ae2eca2a tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:05.591103 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-c8762139-a8df-43c8-b934-c7c1ae2eca2a tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] [instance: cb3a66a8-4c84-4bb1-8b3f-0c48acec1215] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:05.606943 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c8762139-a8df-43c8-b934-c7c1ae2eca2a tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:05.607453 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c8762139-a8df-43c8-b934-c7c1ae2eca2a tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:05.608344 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c8762139-a8df-43c8-b934-c7c1ae2eca2a tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:05.608820 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c8762139-a8df-43c8-b934-c7c1ae2eca2a tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:05.658111 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c312e08d-ffd0-4553-8c6f-fb0c0c5d5cab tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:05.658933 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c312e08d-ffd0-4553-8c6f-fb0c0c5d5cab tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] [instance: d9c0391f-e638-415e-b079-ab7b429492c3] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:05.671990 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c312e08d-ffd0-4553-8c6f-fb0c0c5d5cab tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:05.672442 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c312e08d-ffd0-4553-8c6f-fb0c0c5d5cab tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:05.673219 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c312e08d-ffd0-4553-8c6f-fb0c0c5d5cab tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:05.678262 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c312e08d-ffd0-4553-8c6f-fb0c0c5d5cab tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:05.852321 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c8762139-a8df-43c8-b934-c7c1ae2eca2a tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a609c39c14343e1bc1edd4b3cd56dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116def61aba4631be91f67df63ebab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:05.869002 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-c8762139-a8df-43c8-b934-c7c1ae2eca2a tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] 10.222.0.17 "GET /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215" status: 200 len: 1505 microversion: 2.1 time: 0.284648 Jul 23 21:26:05.870920 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1554/3062] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:05 2022] GET /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215 => generated 1505 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:06.225675 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-3d6974bc-1741-4b5c-aeba-3dea5ce6c1d7 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:06.226880 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-3d6974bc-1741-4b5c-aeba-3dea5ce6c1d7 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: e893255e-87db-418f-8374-dc2d800f4ff5] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:06.234577 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3d6974bc-1741-4b5c-aeba-3dea5ce6c1d7 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:06.235040 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3d6974bc-1741-4b5c-aeba-3dea5ce6c1d7 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:06.235827 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3d6974bc-1741-4b5c-aeba-3dea5ce6c1d7 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:06.236342 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3d6974bc-1741-4b5c-aeba-3dea5ce6c1d7 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:06.417116 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-3d6974bc-1741-4b5c-aeba-3dea5ce6c1d7 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:06.426231 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-3d6974bc-1741-4b5c-aeba-3dea5ce6c1d7 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/e893255e-87db-418f-8374-dc2d800f4ff5" status: 200 len: 1508 microversion: 2.1 time: 0.206354 Jul 23 21:26:06.436495 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1555/3063] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:06 2022] GET /compute/v2.1/servers/e893255e-87db-418f-8374-dc2d800f4ff5 => generated 1508 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:06.436495 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-cc79d735-0581-49f6-bbaf-5207202d6c77 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:06.436495 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-cc79d735-0581-49f6-bbaf-5207202d6c77 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:06.444553 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cc79d735-0581-49f6-bbaf-5207202d6c77 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:06.445061 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cc79d735-0581-49f6-bbaf-5207202d6c77 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:06.445882 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cc79d735-0581-49f6-bbaf-5207202d6c77 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:06.447357 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cc79d735-0581-49f6-bbaf-5207202d6c77 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:06.538870 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-cc79d735-0581-49f6-bbaf-5207202d6c77 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:06.549421 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-cc79d735-0581-49f6-bbaf-5207202d6c77 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:06.550965 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-cc79d735-0581-49f6-bbaf-5207202d6c77 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:06.552401 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-cc79d735-0581-49f6-bbaf-5207202d6c77 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.124249 Jul 23 21:26:06.553505 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1556/3064] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:26:06 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:26:06.558145 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-fe2e21dd-b8f8-47a5-8af1-7f57ba64bc60 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:06.558749 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-fe2e21dd-b8f8-47a5-8af1-7f57ba64bc60 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: d303403b-5d14-443b-a6fe-f8b579d24cda] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:06.569782 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fe2e21dd-b8f8-47a5-8af1-7f57ba64bc60 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:06.570414 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fe2e21dd-b8f8-47a5-8af1-7f57ba64bc60 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:06.571203 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fe2e21dd-b8f8-47a5-8af1-7f57ba64bc60 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:06.571908 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fe2e21dd-b8f8-47a5-8af1-7f57ba64bc60 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:06.684521 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c312e08d-ffd0-4553-8c6f-fb0c0c5d5cab tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859c1493a30d4386b74377ab2b9bc81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3efb8824be84323b6ec04b604775bd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:06.695440 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c312e08d-ffd0-4553-8c6f-fb0c0c5d5cab tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] 10.222.0.17 "GET /compute/v2.1/servers/d9c0391f-e638-415e-b079-ab7b429492c3" status: 200 len: 1516 microversion: 2.1 time: 1.042390 Jul 23 21:26:06.708647 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1509/3065] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:05 2022] GET /compute/v2.1/servers/d9c0391f-e638-415e-b079-ab7b429492c3 => generated 1516 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:26:06.714198 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-459ecbc9-6da7-469e-b456-1ead99b957f6 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:06.715093 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-459ecbc9-6da7-469e-b456-1ead99b957f6 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] [instance: 5429c0b0-c38d-424d-90ef-4a54df8e4cba] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:06.722914 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-459ecbc9-6da7-469e-b456-1ead99b957f6 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:06.723606 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-459ecbc9-6da7-469e-b456-1ead99b957f6 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:06.724565 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-459ecbc9-6da7-469e-b456-1ead99b957f6 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:06.725195 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-459ecbc9-6da7-469e-b456-1ead99b957f6 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:06.835010 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-fe2e21dd-b8f8-47a5-8af1-7f57ba64bc60 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:06.844374 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-fe2e21dd-b8f8-47a5-8af1-7f57ba64bc60 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda" status: 200 len: 1514 microversion: 2.1 time: 0.289639 Jul 23 21:26:06.845217 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1557/3066] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:06 2022] GET /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda => generated 1514 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:06.850183 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-e7f08382-8031-424c-9777-572ddbf9266c req-8d5e103e-c2a3-4cae-a59e-616bcf920f41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9c0391f-e638-415e-b079-ab7b429492c3", "name": "network-vif-deleted", "tag": "df30b70a-0a8a-4c92-85ee-b5adf5aee6f3"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:26:06.864993 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-e7f08382-8031-424c-9777-572ddbf9266c req-8d5e103e-c2a3-4cae-a59e-616bcf920f41 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:06.865437 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-e7f08382-8031-424c-9777-572ddbf9266c req-8d5e103e-c2a3-4cae-a59e-616bcf920f41 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:06.884272 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-459ecbc9-6da7-469e-b456-1ead99b957f6 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961e46ab94f4fffbc606485935ce64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8305585b60d54beeb2b087a37260a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:06.885192 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-e7f08382-8031-424c-9777-572ddbf9266c req-8d5e103e-c2a3-4cae-a59e-616bcf920f41 service nova] Creating event network-vif-deleted:df30b70a-0a8a-4c92-85ee-b5adf5aee6f3 for instance d9c0391f-e638-415e-b079-ab7b429492c3 on nch1-master-1 Jul 23 21:26:06.892188 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-e7f08382-8031-424c-9777-572ddbf9266c req-8d5e103e-c2a3-4cae-a59e-616bcf920f41 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045104 Jul 23 21:26:06.895799 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1558/3067] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:26:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:26:06.895973 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-459ecbc9-6da7-469e-b456-1ead99b957f6 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] 10.222.0.17 "GET /compute/v2.1/servers/5429c0b0-c38d-424d-90ef-4a54df8e4cba" status: 200 len: 1283 microversion: 2.1 time: 0.185684 Jul 23 21:26:06.898340 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1510/3068] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:06 2022] GET /compute/v2.1/servers/5429c0b0-c38d-424d-90ef-4a54df8e4cba => generated 1283 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:06.905161 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3d948f2e-a031-4007-8fe5-8b5364c7e76e tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:06.908170 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-3d948f2e-a031-4007-8fe5-8b5364c7e76e tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] [instance: cb3a66a8-4c84-4bb1-8b3f-0c48acec1215] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:06.919324 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3d948f2e-a031-4007-8fe5-8b5364c7e76e tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:06.919853 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3d948f2e-a031-4007-8fe5-8b5364c7e76e tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:06.926501 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3d948f2e-a031-4007-8fe5-8b5364c7e76e tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:06.926501 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3d948f2e-a031-4007-8fe5-8b5364c7e76e tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:07.377397 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-3d948f2e-a031-4007-8fe5-8b5364c7e76e tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a609c39c14343e1bc1edd4b3cd56dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116def61aba4631be91f67df63ebab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:07.402248 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-3d948f2e-a031-4007-8fe5-8b5364c7e76e tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] 10.222.0.17 "GET /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215" status: 200 len: 1505 microversion: 2.1 time: 0.502198 Jul 23 21:26:07.403300 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1511/3069] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:06 2022] GET /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215 => generated 1505 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:07.445032 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a972fc04-f63e-4b41-b9d7-aae3d672e7be tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:07.445743 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-a972fc04-f63e-4b41-b9d7-aae3d672e7be tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: e893255e-87db-418f-8374-dc2d800f4ff5] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:07.452318 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a972fc04-f63e-4b41-b9d7-aae3d672e7be tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:07.452769 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a972fc04-f63e-4b41-b9d7-aae3d672e7be tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:07.453550 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a972fc04-f63e-4b41-b9d7-aae3d672e7be tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:07.454072 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a972fc04-f63e-4b41-b9d7-aae3d672e7be tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:07.558961 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-a972fc04-f63e-4b41-b9d7-aae3d672e7be tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:07.574129 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9d46223f-397f-47d4-bd5d-d31bae5cbe34 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:07.575207 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-9d46223f-397f-47d4-bd5d-d31bae5cbe34 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:07.582709 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9d46223f-397f-47d4-bd5d-d31bae5cbe34 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:07.583432 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9d46223f-397f-47d4-bd5d-d31bae5cbe34 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:07.584381 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9d46223f-397f-47d4-bd5d-d31bae5cbe34 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:07.588784 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9d46223f-397f-47d4-bd5d-d31bae5cbe34 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:07.592695 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-a972fc04-f63e-4b41-b9d7-aae3d672e7be tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/e893255e-87db-418f-8374-dc2d800f4ff5" status: 200 len: 1466 microversion: 2.1 time: 0.150317 Jul 23 21:26:07.595044 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1559/3070] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:07 2022] GET /compute/v2.1/servers/e893255e-87db-418f-8374-dc2d800f4ff5 => generated 1466 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:07.697568 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-9d46223f-397f-47d4-bd5d-d31bae5cbe34 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:07.708330 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-9d46223f-397f-47d4-bd5d-d31bae5cbe34 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:07.710308 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-9d46223f-397f-47d4-bd5d-d31bae5cbe34 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:07.711702 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9d46223f-397f-47d4-bd5d-d31bae5cbe34 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.142052 Jul 23 21:26:07.712462 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1512/3071] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:26:07 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:26:07.714316 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f238e083-cd7c-4803-a05d-ec7c6a606c72 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:07.714316 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-f238e083-cd7c-4803-a05d-ec7c6a606c72 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] [instance: d9c0391f-e638-415e-b079-ab7b429492c3] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:07.723684 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f238e083-cd7c-4803-a05d-ec7c6a606c72 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:07.723684 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f238e083-cd7c-4803-a05d-ec7c6a606c72 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:07.723924 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f238e083-cd7c-4803-a05d-ec7c6a606c72 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:07.724226 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f238e083-cd7c-4803-a05d-ec7c6a606c72 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:07.738622 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-f238e083-cd7c-4803-a05d-ec7c6a606c72 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] HTTP exception thrown: Instance d9c0391f-e638-415e-b079-ab7b429492c3 could not be found. Jul 23 21:26:07.740303 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f238e083-cd7c-4803-a05d-ec7c6a606c72 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Request method failure captured: Jul 23 21:26:07.740303 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/servers/d9c0391f-e638-415e-b079-ab7b429492c3 HTTP/1.1 Jul 23 21:26:07.740303 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:26:07.740303 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:26:07.740303 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:26:07.740303 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:26:07.740303 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:26:07.740303 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:26:07.740303 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:26:07.740303 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:26:07.740303 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GczsXgROL6bUMBFH-tkSofnZik0J5bxiOrKq6uW_u-Y5j3nI1UHBrHt6mX_xdACJg3OufH2YSPiqvjoO-4SZQnjCf0A0tvDUXE-OgdqnzicdxU5b3IhTQ-cl1wWVW0NuOQMQdoxm5v7bK-KeazIaRcOgIfiClXkZsnN-a7OvGhj0zs Jul 23 21:26:07.740303 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:26:07.740303 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:26:07.740303 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:26:07.740303 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:26:07.740303 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:26:07.740303 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:26:07.740303 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: b3efb8824be84323b6ec04b604775bd0 Jul 23 21:26:07.740303 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ListServerFiltersTestJSON-528658115 Jul 23 21:26:07.740303 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:26:07.740303 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:26:07.740303 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b3efb8824be84323b6ec04b604775bd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b3efb8824be84323b6ec04b604775bd0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b3efb8824be84323b6ec04b604775bd0", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b3efb8824be84323b6ec04b604775bd0"}]}] Jul 23 21:26:07.740303 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ListServerFiltersTestJSON-528658115 Jul 23 21:26:07.740303 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: b3efb8824be84323b6ec04b604775bd0 Jul 23 21:26:07.740303 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-528658115 Jul 23 21:26:07.740303 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ListServerFiltersTestJSON-528658115-project Jul 23 21:26:07.740303 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:26:07.740303 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:26:07.740303 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 859c1493a30d4386b74377ab2b9bc81d Jul 23 21:26:07.740303 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ListServerFiltersTestJSON-528658115-project Jul 23 21:26:07.740303 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:26:07.740303 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance d9c0391f-e638-415e-b079-ab7b429492c3 could not be found. Jul 23 21:26:07.740303 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': 'd9c0391f-e638-415e-b079-ab7b429492c3'} Jul 23 21:26:07.740303 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:26:07.740303 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:26:07.740303 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:26:07.740303 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:26:07.740303 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:26:07.740303 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:26:07.740303 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:26:07.740303 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:26:07.740303 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:26:07.740303 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:26:07.740303 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9c0391f-e638-415e-b079-ab7b429492c3 could not be found. Jul 23 21:26:07.740303 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:07.740303 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:26:07.740303 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:07.740303 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:26:07.740303 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:26:07.740303 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:26:07.740303 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:26:07.740303 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:26:07.740303 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:26:07.740303 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:26:07.740303 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:26:07.740303 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:26:07.740303 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:26:07.740303 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:26:07.740303 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:26:07.740303 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:26:07.740303 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9c0391f-e638-415e-b079-ab7b429492c3 could not be found. Jul 23 21:26:07.740303 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:07.740303 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:26:07.740303 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:07.744711 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:26:07.744711 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:26:07.744711 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:26:07.744711 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:26:07.744711 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:26:07.744711 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9c0391f-e638-415e-b079-ab7b429492c3 could not be found. Jul 23 21:26:07.744711 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:07.744711 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f238e083-cd7c-4803-a05d-ec7c6a606c72 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Returning 404 to user: Instance d9c0391f-e638-415e-b079-ab7b429492c3 could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:26:07.744711 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-f238e083-cd7c-4803-a05d-ec7c6a606c72 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] 10.222.0.17 "GET /compute/v2.1/servers/d9c0391f-e638-415e-b079-ab7b429492c3" status: 404 len: 111 microversion: 2.1 time: 0.033473 Jul 23 21:26:07.744711 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1560/3072] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:07 2022] GET /compute/v2.1/servers/d9c0391f-e638-415e-b079-ab7b429492c3 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 23 21:26:07.751536 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-fcfa9302-610f-4ee0-9ebf-f3d4c39e48ae tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:07.752181 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-fcfa9302-610f-4ee0-9ebf-f3d4c39e48ae tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] [instance: dcb1aa47-1abb-4c2f-9686-7268d2b86967] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:07.758734 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fcfa9302-610f-4ee0-9ebf-f3d4c39e48ae tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:07.759898 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fcfa9302-610f-4ee0-9ebf-f3d4c39e48ae tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:07.761004 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fcfa9302-610f-4ee0-9ebf-f3d4c39e48ae tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:07.761518 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fcfa9302-610f-4ee0-9ebf-f3d4c39e48ae tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:07.790942 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-fcfa9302-610f-4ee0-9ebf-f3d4c39e48ae tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] [instance: dcb1aa47-1abb-4c2f-9686-7268d2b86967] Going to try to terminate instance {{(pid=131320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:26:07.865336 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-6e01313b-1d4d-41b3-8f62-7eb0ce6b040e tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:07.866634 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-6e01313b-1d4d-41b3-8f62-7eb0ce6b040e tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: d303403b-5d14-443b-a6fe-f8b579d24cda] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:07.876018 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6e01313b-1d4d-41b3-8f62-7eb0ce6b040e tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:07.876491 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6e01313b-1d4d-41b3-8f62-7eb0ce6b040e tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:07.877292 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6e01313b-1d4d-41b3-8f62-7eb0ce6b040e tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:07.879195 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6e01313b-1d4d-41b3-8f62-7eb0ce6b040e tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:07.881006 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-fcfa9302-610f-4ee0-9ebf-f3d4c39e48ae tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] 10.222.0.17 "DELETE /compute/v2.1/servers/dcb1aa47-1abb-4c2f-9686-7268d2b86967" status: 204 len: 0 microversion: 2.1 time: 0.132369 Jul 23 21:26:07.882424 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1513/3073] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:26:07 2022] DELETE /compute/v2.1/servers/dcb1aa47-1abb-4c2f-9686-7268d2b86967 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:26:07.892364 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9e0be98e-27d4-428d-9899-2b8a2bb56644 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:07.893734 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-9e0be98e-27d4-428d-9899-2b8a2bb56644 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] [instance: dcb1aa47-1abb-4c2f-9686-7268d2b86967] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:07.902335 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9e0be98e-27d4-428d-9899-2b8a2bb56644 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:07.903218 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9e0be98e-27d4-428d-9899-2b8a2bb56644 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:07.904627 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9e0be98e-27d4-428d-9899-2b8a2bb56644 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:07.905464 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9e0be98e-27d4-428d-9899-2b8a2bb56644 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:08.076614 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-6e01313b-1d4d-41b3-8f62-7eb0ce6b040e tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:08.084889 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-6e01313b-1d4d-41b3-8f62-7eb0ce6b040e tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda" status: 200 len: 1514 microversion: 2.1 time: 0.227798 Jul 23 21:26:08.094194 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1561/3074] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:07 2022] GET /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda => generated 1514 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:08.094194 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d4914697-ea0b-4215-857a-227cc89231df tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:08.094194 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-d4914697-ea0b-4215-857a-227cc89231df tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] [instance: 5429c0b0-c38d-424d-90ef-4a54df8e4cba] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:08.100090 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d4914697-ea0b-4215-857a-227cc89231df tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:08.100587 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d4914697-ea0b-4215-857a-227cc89231df tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:08.101367 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d4914697-ea0b-4215-857a-227cc89231df tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:08.102666 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d4914697-ea0b-4215-857a-227cc89231df tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:08.167294 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-d4914697-ea0b-4215-857a-227cc89231df tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961e46ab94f4fffbc606485935ce64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8305585b60d54beeb2b087a37260a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:08.175143 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-d4914697-ea0b-4215-857a-227cc89231df tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] 10.222.0.17 "GET /compute/v2.1/servers/5429c0b0-c38d-424d-90ef-4a54df8e4cba" status: 200 len: 1283 microversion: 2.1 time: 0.088244 Jul 23 21:26:08.175723 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1562/3075] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:08 2022] GET /compute/v2.1/servers/5429c0b0-c38d-424d-90ef-4a54df8e4cba => generated 1283 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:08.234847 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-9e0be98e-27d4-428d-9899-2b8a2bb56644 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859c1493a30d4386b74377ab2b9bc81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3efb8824be84323b6ec04b604775bd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:08.243069 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9e0be98e-27d4-428d-9899-2b8a2bb56644 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] 10.222.0.17 "GET /compute/v2.1/servers/dcb1aa47-1abb-4c2f-9686-7268d2b86967" status: 200 len: 1516 microversion: 2.1 time: 0.356392 Jul 23 21:26:08.243716 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1514/3076] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:07 2022] GET /compute/v2.1/servers/dcb1aa47-1abb-4c2f-9686-7268d2b86967 => generated 1516 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:08.421071 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-fae30e1a-6a47-4145-bc8e-6acd46002a14 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:08.421380 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-fae30e1a-6a47-4145-bc8e-6acd46002a14 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] [instance: cb3a66a8-4c84-4bb1-8b3f-0c48acec1215] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:08.429353 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fae30e1a-6a47-4145-bc8e-6acd46002a14 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:08.429802 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fae30e1a-6a47-4145-bc8e-6acd46002a14 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:08.430925 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fae30e1a-6a47-4145-bc8e-6acd46002a14 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:08.431137 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fae30e1a-6a47-4145-bc8e-6acd46002a14 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:08.633840 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-fae30e1a-6a47-4145-bc8e-6acd46002a14 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a609c39c14343e1bc1edd4b3cd56dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116def61aba4631be91f67df63ebab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:08.643000 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-fae30e1a-6a47-4145-bc8e-6acd46002a14 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] 10.222.0.17 "GET /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215" status: 200 len: 1505 microversion: 2.1 time: 0.226848 Jul 23 21:26:08.645848 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1563/3077] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:08 2022] GET /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215 => generated 1505 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:08.651001 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-fd3389fa-0598-4ac9-bb82-8871192007b4 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:08.651627 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-fd3389fa-0598-4ac9-bb82-8871192007b4 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: e893255e-87db-418f-8374-dc2d800f4ff5] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:08.658097 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fd3389fa-0598-4ac9-bb82-8871192007b4 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:08.658782 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fd3389fa-0598-4ac9-bb82-8871192007b4 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:08.659748 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fd3389fa-0598-4ac9-bb82-8871192007b4 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:08.660355 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fd3389fa-0598-4ac9-bb82-8871192007b4 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:08.697772 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fd3389fa-0598-4ac9-bb82-8871192007b4 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:08.698671 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fd3389fa-0598-4ac9-bb82-8871192007b4 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:08.699329 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.objects.instance [None req-fd3389fa-0598-4ac9-bb82-8871192007b4 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lazy-loading 'fault' on Instance uuid e893255e-87db-418f-8374-dc2d800f4ff5 {{(pid=131321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:26:08.753791 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-fd3389fa-0598-4ac9-bb82-8871192007b4 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:08.769688 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-fd3389fa-0598-4ac9-bb82-8871192007b4 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/e893255e-87db-418f-8374-dc2d800f4ff5" status: 200 len: 1305 microversion: 2.1 time: 0.122420 Jul 23 21:26:08.771858 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1564/3078] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:08 2022] GET /compute/v2.1/servers/e893255e-87db-418f-8374-dc2d800f4ff5 => generated 1305 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:08.777222 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c685ce8c-efbe-4a97-a9d6-f5cb128b891d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:08.777832 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-c685ce8c-efbe-4a97-a9d6-f5cb128b891d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:08.784426 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c685ce8c-efbe-4a97-a9d6-f5cb128b891d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:08.785399 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c685ce8c-efbe-4a97-a9d6-f5cb128b891d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:08.786406 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c685ce8c-efbe-4a97-a9d6-f5cb128b891d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:08.787192 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c685ce8c-efbe-4a97-a9d6-f5cb128b891d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:08.804765 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3e0a5839-0b3d-4c25-9b06-51cad90df3c3 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-51650994", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "8997f53e-bd9a-440c-bfc5-766dd9f7d191"}]}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:26:08.860551 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c685ce8c-efbe-4a97-a9d6-f5cb128b891d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:08.874508 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c685ce8c-efbe-4a97-a9d6-f5cb128b891d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:08.876351 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c685ce8c-efbe-4a97-a9d6-f5cb128b891d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:08.878210 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-c685ce8c-efbe-4a97-a9d6-f5cb128b891d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.104928 Jul 23 21:26:08.880059 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1565/3079] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:26:08 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:26:08.889989 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-3e0a5839-0b3d-4c25-9b06-51cad90df3c3 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] validate_networks() for [('8997f53e-bd9a-440c-bfc5-766dd9f7d191', None, None, None, None, None)] {{(pid=131320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:26:08.961127 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-b42ff4b3-6c85-49d9-bf55-e63eb3f7c505 req-08823074-dd93-4f67-abb8-567bfda13bdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e893255e-87db-418f-8374-dc2d800f4ff5", "name": "network-vif-deleted", "tag": "a2966984-a247-41b3-8d85-9e618375ba42"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:26:08.970215 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-b42ff4b3-6c85-49d9-bf55-e63eb3f7c505 req-08823074-dd93-4f67-abb8-567bfda13bdc service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:08.970875 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-b42ff4b3-6c85-49d9-bf55-e63eb3f7c505 req-08823074-dd93-4f67-abb8-567bfda13bdc service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:08.983783 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-b42ff4b3-6c85-49d9-bf55-e63eb3f7c505 req-08823074-dd93-4f67-abb8-567bfda13bdc service nova] Creating event network-vif-deleted:a2966984-a247-41b3-8d85-9e618375ba42 for instance e893255e-87db-418f-8374-dc2d800f4ff5 on nch2-master-1 Jul 23 21:26:08.990879 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-b42ff4b3-6c85-49d9-bf55-e63eb3f7c505 req-08823074-dd93-4f67-abb8-567bfda13bdc service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033287 Jul 23 21:26:08.992789 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1566/3080] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:26:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:26:09.112384 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-2c5d97b6-cfdc-4acc-888b-1a4aa862488b tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:09.113098 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-2c5d97b6-cfdc-4acc-888b-1a4aa862488b tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: d303403b-5d14-443b-a6fe-f8b579d24cda] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:09.142458 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2c5d97b6-cfdc-4acc-888b-1a4aa862488b tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:09.145176 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2c5d97b6-cfdc-4acc-888b-1a4aa862488b tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:09.148088 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2c5d97b6-cfdc-4acc-888b-1a4aa862488b tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:09.149727 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2c5d97b6-cfdc-4acc-888b-1a4aa862488b tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:09.372810 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-2c5d97b6-cfdc-4acc-888b-1a4aa862488b tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:09.382328 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-2c5d97b6-cfdc-4acc-888b-1a4aa862488b tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda" status: 200 len: 1514 microversion: 2.1 time: 0.283237 Jul 23 21:26:09.383279 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1567/3081] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:09 2022] GET /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda => generated 1514 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:09.388023 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-4bf51157-a42c-4bb2-975a-ee21bca9846b tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:09.388628 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-4bf51157-a42c-4bb2-975a-ee21bca9846b tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] [instance: 5429c0b0-c38d-424d-90ef-4a54df8e4cba] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:09.394941 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4bf51157-a42c-4bb2-975a-ee21bca9846b tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:09.395398 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4bf51157-a42c-4bb2-975a-ee21bca9846b tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:09.396182 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4bf51157-a42c-4bb2-975a-ee21bca9846b tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:09.396621 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4bf51157-a42c-4bb2-975a-ee21bca9846b tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:09.571222 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-4bf51157-a42c-4bb2-975a-ee21bca9846b tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961e46ab94f4fffbc606485935ce64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8305585b60d54beeb2b087a37260a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:09.580709 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-4bf51157-a42c-4bb2-975a-ee21bca9846b tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] 10.222.0.17 "GET /compute/v2.1/servers/5429c0b0-c38d-424d-90ef-4a54df8e4cba" status: 200 len: 1325 microversion: 2.1 time: 0.196274 Jul 23 21:26:09.582083 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1568/3082] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:09 2022] GET /compute/v2.1/servers/5429c0b0-c38d-424d-90ef-4a54df8e4cba => generated 1325 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:09.586992 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-0335f4b9-9374-4753-8eeb-0e0d7108f28a tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:09.587605 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-0335f4b9-9374-4753-8eeb-0e0d7108f28a tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] [instance: dcb1aa47-1abb-4c2f-9686-7268d2b86967] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:09.594870 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0335f4b9-9374-4753-8eeb-0e0d7108f28a tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:09.595377 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0335f4b9-9374-4753-8eeb-0e0d7108f28a tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:09.596332 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0335f4b9-9374-4753-8eeb-0e0d7108f28a tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:09.596928 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0335f4b9-9374-4753-8eeb-0e0d7108f28a tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:09.763942 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-0335f4b9-9374-4753-8eeb-0e0d7108f28a tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859c1493a30d4386b74377ab2b9bc81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3efb8824be84323b6ec04b604775bd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:09.772741 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-0335f4b9-9374-4753-8eeb-0e0d7108f28a tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] 10.222.0.17 "GET /compute/v2.1/servers/dcb1aa47-1abb-4c2f-9686-7268d2b86967" status: 200 len: 1516 microversion: 2.1 time: 0.189471 Jul 23 21:26:09.782221 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1569/3083] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:09 2022] GET /compute/v2.1/servers/dcb1aa47-1abb-4c2f-9686-7268d2b86967 => generated 1516 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:09.782221 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-1d647b09-70a1-4320-bdc3-c86a8f2a6dc1 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:09.782221 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-1d647b09-70a1-4320-bdc3-c86a8f2a6dc1 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] [instance: cb3a66a8-4c84-4bb1-8b3f-0c48acec1215] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:09.788396 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1d647b09-70a1-4320-bdc3-c86a8f2a6dc1 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:09.788865 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1d647b09-70a1-4320-bdc3-c86a8f2a6dc1 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:09.789658 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1d647b09-70a1-4320-bdc3-c86a8f2a6dc1 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:09.790134 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1d647b09-70a1-4320-bdc3-c86a8f2a6dc1 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:09.997064 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-1d647b09-70a1-4320-bdc3-c86a8f2a6dc1 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a609c39c14343e1bc1edd4b3cd56dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116def61aba4631be91f67df63ebab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:10.000241 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=100 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:26:10.011717 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-1d647b09-70a1-4320-bdc3-c86a8f2a6dc1 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] 10.222.0.17 "GET /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215" status: 200 len: 1505 microversion: 2.1 time: 0.236750 Jul 23 21:26:10.012604 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1570/3084] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:09 2022] GET /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215 => generated 1505 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:10.035050 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f7f3543a-dfc4-4a85-bd52-245d07780baa tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:10.036140 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-f7f3543a-dfc4-4a85-bd52-245d07780baa tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: e893255e-87db-418f-8374-dc2d800f4ff5] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:10.052985 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f7f3543a-dfc4-4a85-bd52-245d07780baa tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:10.053778 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f7f3543a-dfc4-4a85-bd52-245d07780baa tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:10.054753 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f7f3543a-dfc4-4a85-bd52-245d07780baa tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:10.055350 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f7f3543a-dfc4-4a85-bd52-245d07780baa tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:10.093975 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-f7f3543a-dfc4-4a85-bd52-245d07780baa tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] HTTP exception thrown: Instance e893255e-87db-418f-8374-dc2d800f4ff5 could not be found. Jul 23 21:26:10.100750 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f7f3543a-dfc4-4a85-bd52-245d07780baa tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Request method failure captured: Jul 23 21:26:10.100750 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/servers/e893255e-87db-418f-8374-dc2d800f4ff5 HTTP/1.1 Jul 23 21:26:10.100750 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:26:10.100750 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:26:10.100750 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:26:10.100750 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:26:10.100750 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:26:10.100750 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:26:10.100750 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:26:10.100750 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:26:10.100750 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GddaYqyOuWcIIbeHmsk3fPEmdWyfGLbr9Nsz9MmxXVcs_PKtvbIqY2C8j4fzxFCSVf8V3fYFIZhvaOHyCuudCVcoCOVgWdy__DYWHqWW4I8VD_yG4rJj0HZodonpxNaGqSkGiL8DXUXMaZTTZO1BvjnTGQlN8CnshrUQQ72pGMeb2k Jul 23 21:26:10.100750 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:26:10.100750 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:26:10.100750 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:26:10.100750 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:26:10.100750 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:26:10.100750 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:26:10.100750 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: a892bfe56afd4ee5bb6c47e926af7349 Jul 23 21:26:10.100750 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-DeleteServersTestJSON-745069838 Jul 23 21:26:10.100750 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:26:10.100750 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:26:10.100750 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a892bfe56afd4ee5bb6c47e926af7349"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a892bfe56afd4ee5bb6c47e926af7349"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a892bfe56afd4ee5bb6c47e926af7349", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a892bfe56afd4ee5bb6c47e926af7349"}]}] Jul 23 21:26:10.100750 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-DeleteServersTestJSON-745069838 Jul 23 21:26:10.100750 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: a892bfe56afd4ee5bb6c47e926af7349 Jul 23 21:26:10.100750 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-DeleteServersTestJSON-745069838 Jul 23 21:26:10.100750 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-DeleteServersTestJSON-745069838-project Jul 23 21:26:10.100750 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:26:10.100750 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:26:10.100750 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: affc3572ef7d45249f50b5061a681d18 Jul 23 21:26:10.100750 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-DeleteServersTestJSON-745069838-project Jul 23 21:26:10.100750 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:26:10.100750 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance e893255e-87db-418f-8374-dc2d800f4ff5 could not be found. Jul 23 21:26:10.100750 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': 'e893255e-87db-418f-8374-dc2d800f4ff5'} Jul 23 21:26:10.100750 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:26:10.100750 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:26:10.100750 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:26:10.100750 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:26:10.100750 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:26:10.100750 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:26:10.100750 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:26:10.100750 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:26:10.100750 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:26:10.100750 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:26:10.100750 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e893255e-87db-418f-8374-dc2d800f4ff5 could not be found. Jul 23 21:26:10.100750 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:10.100750 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:26:10.100750 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:10.100750 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:26:10.100750 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:26:10.100750 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:26:10.100750 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:26:10.100750 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:26:10.100750 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:26:10.100750 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:26:10.100750 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:26:10.100750 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:26:10.100750 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:26:10.100750 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:26:10.100750 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:26:10.100750 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:26:10.100750 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e893255e-87db-418f-8374-dc2d800f4ff5 could not be found. Jul 23 21:26:10.100750 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:10.100750 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:26:10.100750 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:10.105662 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:26:10.105662 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:26:10.105662 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:26:10.105662 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:26:10.105662 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:26:10.105662 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e893255e-87db-418f-8374-dc2d800f4ff5 could not be found. Jul 23 21:26:10.105662 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:10.105662 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f7f3543a-dfc4-4a85-bd52-245d07780baa tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Returning 404 to user: Instance e893255e-87db-418f-8374-dc2d800f4ff5 could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:26:10.105662 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-f7f3543a-dfc4-4a85-bd52-245d07780baa tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/e893255e-87db-418f-8374-dc2d800f4ff5" status: 404 len: 111 microversion: 2.1 time: 0.082922 Jul 23 21:26:10.110512 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1571/3085] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:10 2022] GET /compute/v2.1/servers/e893255e-87db-418f-8374-dc2d800f4ff5 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:26:10.116969 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f65fe7c9-2d12-4522-b68c-fb97a0438dc1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:10.117729 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-f65fe7c9-2d12-4522-b68c-fb97a0438dc1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:10.128934 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f65fe7c9-2d12-4522-b68c-fb97a0438dc1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:10.129506 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f65fe7c9-2d12-4522-b68c-fb97a0438dc1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:10.131431 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f65fe7c9-2d12-4522-b68c-fb97a0438dc1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:10.132170 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f65fe7c9-2d12-4522-b68c-fb97a0438dc1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:10.259529 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-f65fe7c9-2d12-4522-b68c-fb97a0438dc1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:10.269781 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-f65fe7c9-2d12-4522-b68c-fb97a0438dc1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:10.281103 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-f65fe7c9-2d12-4522-b68c-fb97a0438dc1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:10.289234 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-f65fe7c9-2d12-4522-b68c-fb97a0438dc1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.177014 Jul 23 21:26:10.289934 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1572/3086] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:26:10 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:26:10.300497 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-4a961a94-4659-4019-9e3f-7e148c781a93 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1008255626", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "networks": [{"uuid": "c89c9ae3-a9c7-4e98-860d-e9f8ea64bbcb"}]}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:26:10.375311 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-3e0a5839-0b3d-4c25-9b06-51cad90df3c3 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:26:10.375816 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-3e0a5839-0b3d-4c25-9b06-51cad90df3c3 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:26:10.376196 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-3e0a5839-0b3d-4c25-9b06-51cad90df3c3 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:26:10.376607 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-3e0a5839-0b3d-4c25-9b06-51cad90df3c3 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:26:10.377020 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-3e0a5839-0b3d-4c25-9b06-51cad90df3c3 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:26:10.384086 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.network.neutron [None req-4a961a94-4659-4019-9e3f-7e148c781a93 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] validate_networks() for [('c89c9ae3-a9c7-4e98-860d-e9f8ea64bbcb', None, None, None, None, None)] {{(pid=131321) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:26:10.392303 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3e0a5839-0b3d-4c25-9b06-51cad90df3c3 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:10.392763 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3e0a5839-0b3d-4c25-9b06-51cad90df3c3 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:10.394838 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3e0a5839-0b3d-4c25-9b06-51cad90df3c3 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:10.394838 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3e0a5839-0b3d-4c25-9b06-51cad90df3c3 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:10.456077 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-3e0a5839-0b3d-4c25-9b06-51cad90df3c3 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Getting quotas for project 4d8d306759c447edb6d013cf14ac53f9. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:26:10.468207 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-3e0a5839-0b3d-4c25-9b06-51cad90df3c3 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Getting quotas for user 0543f1a561a9442cbc9463ab752bd2aa and project 4d8d306759c447edb6d013cf14ac53f9. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:26:10.487638 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-3e0a5839-0b3d-4c25-9b06-51cad90df3c3 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Going to run 2 instances... {{(pid=131320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:26:10.490769 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-3e0a5839-0b3d-4c25-9b06-51cad90df3c3 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] [instance: 61015c0f-77ab-4ba1-8d68-4979a9888f77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:26:10.540173 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-3e0a5839-0b3d-4c25-9b06-51cad90df3c3 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] [instance: 3de52df5-917b-4cdd-b2fa-a13453f03559] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=61015c0f-77ab-4ba1-8d68-4979a9888f77,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:26:10.665490 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-3e0a5839-0b3d-4c25-9b06-51cad90df3c3 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.087561 Jul 23 21:26:10.674096 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1515/3087] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:26:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 2096 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 23 21:26:10.686463 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-7dad21cc-c00d-4652-a258-e405af940170 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:10.688315 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-7dad21cc-c00d-4652-a258-e405af940170 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: d303403b-5d14-443b-a6fe-f8b579d24cda] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:10.690745 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=2,nova_api:INSERT=9 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:26:10.705091 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7dad21cc-c00d-4652-a258-e405af940170 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:10.705548 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7dad21cc-c00d-4652-a258-e405af940170 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:10.706531 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7dad21cc-c00d-4652-a258-e405af940170 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:10.706973 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7dad21cc-c00d-4652-a258-e405af940170 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:11.048126 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-7dad21cc-c00d-4652-a258-e405af940170 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:11.062569 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-7dad21cc-c00d-4652-a258-e405af940170 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda" status: 200 len: 1514 microversion: 2.1 time: 0.385455 Jul 23 21:26:11.063168 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1516/3088] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:10 2022] GET /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda => generated 1514 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:11.067730 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b5ac3550-ec42-428d-864a-fa1d4373424e tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:11.068323 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b5ac3550-ec42-428d-864a-fa1d4373424e tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] [instance: 5429c0b0-c38d-424d-90ef-4a54df8e4cba] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:11.087618 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b5ac3550-ec42-428d-864a-fa1d4373424e tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:11.088086 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b5ac3550-ec42-428d-864a-fa1d4373424e tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:11.089195 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b5ac3550-ec42-428d-864a-fa1d4373424e tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:11.089635 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b5ac3550-ec42-428d-864a-fa1d4373424e tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:11.386966 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-4a961a94-4659-4019-9e3f-7e148c781a93 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Flavor limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:26:11.387951 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-4a961a94-4659-4019-9e3f-7e148c781a93 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Image limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:26:11.388645 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-4a961a94-4659-4019-9e3f-7e148c781a93 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Flavor pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:26:11.389245 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-4a961a94-4659-4019-9e3f-7e148c781a93 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Image pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:26:11.389845 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-4a961a94-4659-4019-9e3f-7e148c781a93 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:26:11.411212 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4a961a94-4659-4019-9e3f-7e148c781a93 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:11.411965 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4a961a94-4659-4019-9e3f-7e148c781a93 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:11.413973 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4a961a94-4659-4019-9e3f-7e148c781a93 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:11.414639 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4a961a94-4659-4019-9e3f-7e148c781a93 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:11.437443 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-4a961a94-4659-4019-9e3f-7e148c781a93 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Getting quotas for project a892bfe56afd4ee5bb6c47e926af7349. Resources: {'ram', 'instances', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:26:11.444800 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-4a961a94-4659-4019-9e3f-7e148c781a93 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Getting quotas for user affc3572ef7d45249f50b5061a681d18 and project a892bfe56afd4ee5bb6c47e926af7349. Resources: {'ram', 'instances', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:26:11.461283 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-4a961a94-4659-4019-9e3f-7e148c781a93 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Going to run 1 instances... {{(pid=131321) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:26:11.464635 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-4a961a94-4659-4019-9e3f-7e148c781a93 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: 9a9ac364-9d41-4402-9312-9e363b68792d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131321) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:26:11.560317 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-4a961a94-4659-4019-9e3f-7e148c781a93 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.263664 Jul 23 21:26:11.561918 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1573/3089] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:26:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1266 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 23 21:26:11.567066 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-bfe26885-0dd6-434f-ac3e-1a96b30e7b19 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:11.570943 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-bfe26885-0dd6-434f-ac3e-1a96b30e7b19 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0543f1a561a9442cbc9463ab752bd2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d306759c447edb6d013cf14ac53f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:11.571833 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-bfe26885-0dd6-434f-ac3e-1a96b30e7b19 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Searching by: {'deleted': False, 'project_id': '4d8d306759c447edb6d013cf14ac53f9'} {{(pid=131321) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 23 21:26:11.594545 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b5ac3550-ec42-428d-864a-fa1d4373424e tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961e46ab94f4fffbc606485935ce64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8305585b60d54beeb2b087a37260a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:11.604082 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bfe26885-0dd6-434f-ac3e-1a96b30e7b19 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:11.604614 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bfe26885-0dd6-434f-ac3e-1a96b30e7b19 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:11.605801 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bfe26885-0dd6-434f-ac3e-1a96b30e7b19 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:11.607084 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bfe26885-0dd6-434f-ac3e-1a96b30e7b19 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:11.631053 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b5ac3550-ec42-428d-864a-fa1d4373424e tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] 10.222.0.17 "GET /compute/v2.1/servers/5429c0b0-c38d-424d-90ef-4a54df8e4cba" status: 200 len: 1325 microversion: 2.1 time: 0.566805 Jul 23 21:26:11.646465 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1517/3090] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:11 2022] GET /compute/v2.1/servers/5429c0b0-c38d-424d-90ef-4a54df8e4cba => generated 1325 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:11.657849 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-873bc4d8-fc36-44d7-8f0e-390f820584b3 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:11.658743 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-873bc4d8-fc36-44d7-8f0e-390f820584b3 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] [instance: dcb1aa47-1abb-4c2f-9686-7268d2b86967] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:11.670208 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-873bc4d8-fc36-44d7-8f0e-390f820584b3 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:11.674108 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-873bc4d8-fc36-44d7-8f0e-390f820584b3 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:11.676270 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.multi_cell_list [None req-bfe26885-0dd6-434f-ac3e-1a96b30e7b19 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=131321) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 23 21:26:11.677713 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-873bc4d8-fc36-44d7-8f0e-390f820584b3 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:11.680655 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-873bc4d8-fc36-44d7-8f0e-390f820584b3 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:11.735747 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-bfe26885-0dd6-434f-ac3e-1a96b30e7b19 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] 10.222.0.17 "GET /compute/v2.1/servers" status: 200 len: 673 microversion: 2.1 time: 0.172777 Jul 23 21:26:11.747327 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1574/3091] 10.222.0.17 () {58 vars in 1124 bytes} [Sat Jul 23 21:26:11 2022] GET /compute/v2.1/servers => generated 673 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:26:11.757779 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-873bc4d8-fc36-44d7-8f0e-390f820584b3 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:11.758242 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-873bc4d8-fc36-44d7-8f0e-390f820584b3 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:11.758715 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.objects.instance [None req-873bc4d8-fc36-44d7-8f0e-390f820584b3 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lazy-loading 'fault' on Instance uuid dcb1aa47-1abb-4c2f-9686-7268d2b86967 {{(pid=131320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:26:11.761900 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-281fb9c8-4969-4c23-86c0-9c1d57f3695a req-42e6ed14-d53b-4b80-bfaa-dfd2cd272273 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5429c0b0-c38d-424d-90ef-4a54df8e4cba", "tag": "cea64a01-c4e4-4bfc-a9ce-f9da3f33722b"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:26:11.771636 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-281fb9c8-4969-4c23-86c0-9c1d57f3695a req-42e6ed14-d53b-4b80-bfaa-dfd2cd272273 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:11.772186 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-281fb9c8-4969-4c23-86c0-9c1d57f3695a req-42e6ed14-d53b-4b80-bfaa-dfd2cd272273 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:11.800752 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-281fb9c8-4969-4c23-86c0-9c1d57f3695a req-42e6ed14-d53b-4b80-bfaa-dfd2cd272273 service nova] Creating event network-changed:cea64a01-c4e4-4bfc-a9ce-f9da3f33722b for instance 5429c0b0-c38d-424d-90ef-4a54df8e4cba on nch1-master-1 Jul 23 21:26:11.822414 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-873bc4d8-fc36-44d7-8f0e-390f820584b3 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859c1493a30d4386b74377ab2b9bc81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3efb8824be84323b6ec04b604775bd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:11.829778 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:26:11.830845 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-281fb9c8-4969-4c23-86c0-9c1d57f3695a req-42e6ed14-d53b-4b80-bfaa-dfd2cd272273 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081103 Jul 23 21:26:11.831506 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1575/3092] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:26:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:26:11.833553 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-873bc4d8-fc36-44d7-8f0e-390f820584b3 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] 10.222.0.17 "GET /compute/v2.1/servers/dcb1aa47-1abb-4c2f-9686-7268d2b86967" status: 200 len: 1310 microversion: 2.1 time: 0.185765 Jul 23 21:26:11.846680 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1518/3093] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:11 2022] GET /compute/v2.1/servers/dcb1aa47-1abb-4c2f-9686-7268d2b86967 => generated 1310 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:11.846680 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8494369f-1e21-439d-a76e-cb90bb84e431 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:11.847156 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-78d3c967-ca46-4d95-bf59-91a347d15dac tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:11.847248 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8494369f-1e21-439d-a76e-cb90bb84e431 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:11.847327 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-78d3c967-ca46-4d95-bf59-91a347d15dac tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] [instance: cb3a66a8-4c84-4bb1-8b3f-0c48acec1215] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:11.852239 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8494369f-1e21-439d-a76e-cb90bb84e431 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:11.852703 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8494369f-1e21-439d-a76e-cb90bb84e431 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:11.853496 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8494369f-1e21-439d-a76e-cb90bb84e431 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:11.853980 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8494369f-1e21-439d-a76e-cb90bb84e431 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:11.857815 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-78d3c967-ca46-4d95-bf59-91a347d15dac tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:11.858301 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-78d3c967-ca46-4d95-bf59-91a347d15dac tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:11.859080 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-78d3c967-ca46-4d95-bf59-91a347d15dac tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:11.859515 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-78d3c967-ca46-4d95-bf59-91a347d15dac tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:11.935928 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8494369f-1e21-439d-a76e-cb90bb84e431 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:11.948494 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8494369f-1e21-439d-a76e-cb90bb84e431 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:11.954177 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8494369f-1e21-439d-a76e-cb90bb84e431 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:11.955736 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8494369f-1e21-439d-a76e-cb90bb84e431 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.116184 Jul 23 21:26:11.967620 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1519/3094] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:26:11 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:26:11.974177 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-fc46c12d-ed89-489c-9f49-9ffd3bc75756 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:11.975029 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-fc46c12d-ed89-489c-9f49-9ffd3bc75756 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: 9a9ac364-9d41-4402-9312-9e363b68792d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:12.060485 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-fc46c12d-ed89-489c-9f49-9ffd3bc75756 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:12.068667 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-fc46c12d-ed89-489c-9f49-9ffd3bc75756 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/9a9ac364-9d41-4402-9312-9e363b68792d" status: 200 len: 1215 microversion: 2.1 time: 0.099526 Jul 23 21:26:12.069383 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1520/3095] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:11 2022] GET /compute/v2.1/servers/9a9ac364-9d41-4402-9312-9e363b68792d => generated 1215 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:12.082338 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-48099bcf-185d-46f3-80e6-66c38131184d tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:12.083240 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-48099bcf-185d-46f3-80e6-66c38131184d tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] [instance: 3de52df5-917b-4cdd-b2fa-a13453f03559] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:12.092312 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-48099bcf-185d-46f3-80e6-66c38131184d tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:12.093298 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-48099bcf-185d-46f3-80e6-66c38131184d tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:12.094289 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-48099bcf-185d-46f3-80e6-66c38131184d tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:12.094894 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-48099bcf-185d-46f3-80e6-66c38131184d tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:12.114026 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-78d3c967-ca46-4d95-bf59-91a347d15dac tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a609c39c14343e1bc1edd4b3cd56dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116def61aba4631be91f67df63ebab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:12.123872 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-78d3c967-ca46-4d95-bf59-91a347d15dac tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] 10.222.0.17 "GET /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215" status: 200 len: 1505 microversion: 2.1 time: 0.291144 Jul 23 21:26:12.130469 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1576/3096] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:11 2022] GET /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215 => generated 1505 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:12.139492 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-4a21c7bd-6678-4b7f-b8d0-5c8acd845c70 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:12.140194 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-4a21c7bd-6678-4b7f-b8d0-5c8acd845c70 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: d303403b-5d14-443b-a6fe-f8b579d24cda] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:12.151560 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4a21c7bd-6678-4b7f-b8d0-5c8acd845c70 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:12.152010 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4a21c7bd-6678-4b7f-b8d0-5c8acd845c70 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:12.152817 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4a21c7bd-6678-4b7f-b8d0-5c8acd845c70 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:12.153238 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4a21c7bd-6678-4b7f-b8d0-5c8acd845c70 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:12.182702 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-48099bcf-185d-46f3-80e6-66c38131184d tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0543f1a561a9442cbc9463ab752bd2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d306759c447edb6d013cf14ac53f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:12.191030 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-48099bcf-185d-46f3-80e6-66c38131184d tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] 10.222.0.17 "GET /compute/v2.1/servers/3de52df5-917b-4cdd-b2fa-a13453f03559" status: 200 len: 1222 microversion: 2.1 time: 0.118713 Jul 23 21:26:12.192392 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1521/3097] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:12 2022] GET /compute/v2.1/servers/3de52df5-917b-4cdd-b2fa-a13453f03559 => generated 1222 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:12.301927 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-4a21c7bd-6678-4b7f-b8d0-5c8acd845c70 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:12.312189 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-4a21c7bd-6678-4b7f-b8d0-5c8acd845c70 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda" status: 200 len: 1514 microversion: 2.1 time: 0.177999 Jul 23 21:26:12.317145 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1577/3098] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:12 2022] GET /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda => generated 1514 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:12.668089 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-cc64741e-8700-4a38-a210-198431948382 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:12.669042 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-cc64741e-8700-4a38-a210-198431948382 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] [instance: 5429c0b0-c38d-424d-90ef-4a54df8e4cba] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:12.679575 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cc64741e-8700-4a38-a210-198431948382 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:12.680078 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cc64741e-8700-4a38-a210-198431948382 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:12.680835 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cc64741e-8700-4a38-a210-198431948382 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:12.681271 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cc64741e-8700-4a38-a210-198431948382 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:12.859977 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-09b0a4ea-c0dd-413d-88d5-86834b62cbbd tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:12.860595 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-09b0a4ea-c0dd-413d-88d5-86834b62cbbd tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] [instance: dcb1aa47-1abb-4c2f-9686-7268d2b86967] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:12.871236 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-cc64741e-8700-4a38-a210-198431948382 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961e46ab94f4fffbc606485935ce64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8305585b60d54beeb2b087a37260a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:12.874849 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-09b0a4ea-c0dd-413d-88d5-86834b62cbbd tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:12.875388 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-09b0a4ea-c0dd-413d-88d5-86834b62cbbd tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:12.877278 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-09b0a4ea-c0dd-413d-88d5-86834b62cbbd tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:12.878316 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-09b0a4ea-c0dd-413d-88d5-86834b62cbbd tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:12.894302 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-cc64741e-8700-4a38-a210-198431948382 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] 10.222.0.17 "GET /compute/v2.1/servers/5429c0b0-c38d-424d-90ef-4a54df8e4cba" status: 200 len: 1325 microversion: 2.1 time: 0.233742 Jul 23 21:26:12.895274 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1522/3099] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:12 2022] GET /compute/v2.1/servers/5429c0b0-c38d-424d-90ef-4a54df8e4cba => generated 1325 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:12.907152 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-09b0a4ea-c0dd-413d-88d5-86834b62cbbd tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] HTTP exception thrown: Instance dcb1aa47-1abb-4c2f-9686-7268d2b86967 could not be found. Jul 23 21:26:12.909204 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-09b0a4ea-c0dd-413d-88d5-86834b62cbbd tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Request method failure captured: Jul 23 21:26:12.909204 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/servers/dcb1aa47-1abb-4c2f-9686-7268d2b86967 HTTP/1.1 Jul 23 21:26:12.909204 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:26:12.909204 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:26:12.909204 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:26:12.909204 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:26:12.909204 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:26:12.909204 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:26:12.909204 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:26:12.909204 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:26:12.909204 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GczsXgROL6bUMBFH-tkSofnZik0J5bxiOrKq6uW_u-Y5j3nI1UHBrHt6mX_xdACJg3OufH2YSPiqvjoO-4SZQnjCf0A0tvDUXE-OgdqnzicdxU5b3IhTQ-cl1wWVW0NuOQMQdoxm5v7bK-KeazIaRcOgIfiClXkZsnN-a7OvGhj0zs Jul 23 21:26:12.909204 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:26:12.909204 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:26:12.909204 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:26:12.909204 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:26:12.909204 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:26:12.909204 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:26:12.909204 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: b3efb8824be84323b6ec04b604775bd0 Jul 23 21:26:12.909204 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ListServerFiltersTestJSON-528658115 Jul 23 21:26:12.909204 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:26:12.909204 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:26:12.909204 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b3efb8824be84323b6ec04b604775bd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b3efb8824be84323b6ec04b604775bd0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b3efb8824be84323b6ec04b604775bd0", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b3efb8824be84323b6ec04b604775bd0"}]}] Jul 23 21:26:12.909204 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ListServerFiltersTestJSON-528658115 Jul 23 21:26:12.909204 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: b3efb8824be84323b6ec04b604775bd0 Jul 23 21:26:12.909204 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-528658115 Jul 23 21:26:12.909204 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ListServerFiltersTestJSON-528658115-project Jul 23 21:26:12.909204 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:26:12.909204 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:26:12.909204 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 859c1493a30d4386b74377ab2b9bc81d Jul 23 21:26:12.909204 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ListServerFiltersTestJSON-528658115-project Jul 23 21:26:12.909204 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:26:12.909204 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance dcb1aa47-1abb-4c2f-9686-7268d2b86967 could not be found. Jul 23 21:26:12.909204 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': 'dcb1aa47-1abb-4c2f-9686-7268d2b86967'} Jul 23 21:26:12.909204 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:26:12.909204 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:26:12.909204 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:26:12.909204 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:26:12.909204 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:26:12.909204 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:26:12.909204 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:26:12.909204 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:26:12.909204 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:26:12.909204 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:26:12.909204 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcb1aa47-1abb-4c2f-9686-7268d2b86967 could not be found. Jul 23 21:26:12.909204 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:12.909204 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:26:12.909204 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:12.909204 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:26:12.909204 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:26:12.909204 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:26:12.909204 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:26:12.909204 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:26:12.909204 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:26:12.909204 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:26:12.909204 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:26:12.909204 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:26:12.909204 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:26:12.909204 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:26:12.909204 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:26:12.909204 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:26:12.909204 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcb1aa47-1abb-4c2f-9686-7268d2b86967 could not be found. Jul 23 21:26:12.909204 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:12.909204 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:26:12.909204 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:12.914633 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:26:12.914633 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:26:12.914633 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:26:12.914633 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:26:12.914633 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:26:12.914633 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcb1aa47-1abb-4c2f-9686-7268d2b86967 could not be found. Jul 23 21:26:12.914633 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:12.914633 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-09b0a4ea-c0dd-413d-88d5-86834b62cbbd tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Returning 404 to user: Instance dcb1aa47-1abb-4c2f-9686-7268d2b86967 could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:26:12.914633 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-09b0a4ea-c0dd-413d-88d5-86834b62cbbd tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] 10.222.0.17 "GET /compute/v2.1/servers/dcb1aa47-1abb-4c2f-9686-7268d2b86967" status: 404 len: 111 microversion: 2.1 time: 0.055526 Jul 23 21:26:12.914633 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1578/3100] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:12 2022] GET /compute/v2.1/servers/dcb1aa47-1abb-4c2f-9686-7268d2b86967 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:26:12.920471 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-829fa1a5-8e30-4785-8f81-f3f42dbde5f0 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:12.920916 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-829fa1a5-8e30-4785-8f81-f3f42dbde5f0 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] [instance: 35d0d067-4f24-45a4-b03c-32346b764d3c] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:12.929065 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-829fa1a5-8e30-4785-8f81-f3f42dbde5f0 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:12.929534 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-829fa1a5-8e30-4785-8f81-f3f42dbde5f0 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:12.930508 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-829fa1a5-8e30-4785-8f81-f3f42dbde5f0 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:12.931232 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-829fa1a5-8e30-4785-8f81-f3f42dbde5f0 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:12.959052 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-829fa1a5-8e30-4785-8f81-f3f42dbde5f0 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] [instance: 35d0d067-4f24-45a4-b03c-32346b764d3c] Going to try to terminate instance {{(pid=131320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:26:12.977336 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-71586c78-aa99-4029-b707-20401c05349b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:12.978255 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-71586c78-aa99-4029-b707-20401c05349b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:12.992743 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-71586c78-aa99-4029-b707-20401c05349b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:12.993343 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-71586c78-aa99-4029-b707-20401c05349b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:12.995598 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-71586c78-aa99-4029-b707-20401c05349b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:12.996964 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-71586c78-aa99-4029-b707-20401c05349b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:13.058089 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-829fa1a5-8e30-4785-8f81-f3f42dbde5f0 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] 10.222.0.17 "DELETE /compute/v2.1/servers/35d0d067-4f24-45a4-b03c-32346b764d3c" status: 204 len: 0 microversion: 2.1 time: 0.141251 Jul 23 21:26:13.059671 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1523/3101] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:26:12 2022] DELETE /compute/v2.1/servers/35d0d067-4f24-45a4-b03c-32346b764d3c => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:26:13.069697 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-616c2134-4b9d-4053-962c-82469c972e11 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:13.070895 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-616c2134-4b9d-4053-962c-82469c972e11 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] [instance: 35d0d067-4f24-45a4-b03c-32346b764d3c] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:13.079504 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-616c2134-4b9d-4053-962c-82469c972e11 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:13.080052 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-616c2134-4b9d-4053-962c-82469c972e11 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:13.081050 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-616c2134-4b9d-4053-962c-82469c972e11 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:13.081489 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-616c2134-4b9d-4053-962c-82469c972e11 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:13.089990 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-71586c78-aa99-4029-b707-20401c05349b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:13.100830 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-71586c78-aa99-4029-b707-20401c05349b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:13.102843 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-71586c78-aa99-4029-b707-20401c05349b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:13.104185 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-71586c78-aa99-4029-b707-20401c05349b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.131100 Jul 23 21:26:13.105155 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1579/3102] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:26:12 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:26:13.109904 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-43b82f52-cea4-4c27-8266-4b7aca688657 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:13.110748 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-43b82f52-cea4-4c27-8266-4b7aca688657 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: 9a9ac364-9d41-4402-9312-9e363b68792d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:13.117733 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-43b82f52-cea4-4c27-8266-4b7aca688657 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:13.118239 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-43b82f52-cea4-4c27-8266-4b7aca688657 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:13.119014 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-43b82f52-cea4-4c27-8266-4b7aca688657 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:13.119459 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-43b82f52-cea4-4c27-8266-4b7aca688657 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:13.195777 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-43b82f52-cea4-4c27-8266-4b7aca688657 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:13.206241 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-43b82f52-cea4-4c27-8266-4b7aca688657 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/9a9ac364-9d41-4402-9312-9e363b68792d" status: 200 len: 1211 microversion: 2.1 time: 0.099590 Jul 23 21:26:13.216289 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1580/3103] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:13 2022] GET /compute/v2.1/servers/9a9ac364-9d41-4402-9312-9e363b68792d => generated 1211 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:13.216289 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-6d2c893c-4037-489f-a1b8-526ca5b00f9c tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:13.216289 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-6d2c893c-4037-489f-a1b8-526ca5b00f9c tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] [instance: cb3a66a8-4c84-4bb1-8b3f-0c48acec1215] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:13.222163 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6d2c893c-4037-489f-a1b8-526ca5b00f9c tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:13.222594 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6d2c893c-4037-489f-a1b8-526ca5b00f9c tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:13.223621 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6d2c893c-4037-489f-a1b8-526ca5b00f9c tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:13.224111 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6d2c893c-4037-489f-a1b8-526ca5b00f9c tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:13.271521 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-616c2134-4b9d-4053-962c-82469c972e11 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859c1493a30d4386b74377ab2b9bc81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3efb8824be84323b6ec04b604775bd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:13.285493 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-616c2134-4b9d-4053-962c-82469c972e11 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] 10.222.0.17 "GET /compute/v2.1/servers/35d0d067-4f24-45a4-b03c-32346b764d3c" status: 200 len: 1515 microversion: 2.1 time: 0.221462 Jul 23 21:26:13.286974 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1524/3104] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:13 2022] GET /compute/v2.1/servers/35d0d067-4f24-45a4-b03c-32346b764d3c => generated 1515 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:13.293342 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a359505a-11aa-4254-b0ef-99af7bff0eb6 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:13.294301 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a359505a-11aa-4254-b0ef-99af7bff0eb6 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] [instance: 3de52df5-917b-4cdd-b2fa-a13453f03559] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:13.302559 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a359505a-11aa-4254-b0ef-99af7bff0eb6 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:13.303268 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a359505a-11aa-4254-b0ef-99af7bff0eb6 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:13.304978 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a359505a-11aa-4254-b0ef-99af7bff0eb6 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:13.305615 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a359505a-11aa-4254-b0ef-99af7bff0eb6 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:13.376302 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a359505a-11aa-4254-b0ef-99af7bff0eb6 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0543f1a561a9442cbc9463ab752bd2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d306759c447edb6d013cf14ac53f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:13.384159 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a359505a-11aa-4254-b0ef-99af7bff0eb6 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] 10.222.0.17 "GET /compute/v2.1/servers/3de52df5-917b-4cdd-b2fa-a13453f03559" status: 200 len: 1270 microversion: 2.1 time: 0.095820 Jul 23 21:26:13.385087 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1525/3105] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:13 2022] GET /compute/v2.1/servers/3de52df5-917b-4cdd-b2fa-a13453f03559 => generated 1270 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:13.387530 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-6d2c893c-4037-489f-a1b8-526ca5b00f9c tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a609c39c14343e1bc1edd4b3cd56dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116def61aba4631be91f67df63ebab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:13.389512 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-569e470d-d42f-45a5-828d-945ac84cc217 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:13.389988 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-569e470d-d42f-45a5-828d-945ac84cc217 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: d303403b-5d14-443b-a6fe-f8b579d24cda] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:13.395204 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-6d2c893c-4037-489f-a1b8-526ca5b00f9c tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] 10.222.0.17 "GET /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215" status: 200 len: 1505 microversion: 2.1 time: 0.187021 Jul 23 21:26:13.395783 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1581/3106] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:13 2022] GET /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215 => generated 1505 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:13.395915 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-569e470d-d42f-45a5-828d-945ac84cc217 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:13.396306 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-569e470d-d42f-45a5-828d-945ac84cc217 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:13.397134 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-569e470d-d42f-45a5-828d-945ac84cc217 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:13.397624 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-569e470d-d42f-45a5-828d-945ac84cc217 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:13.695438 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-569e470d-d42f-45a5-828d-945ac84cc217 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:13.703382 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-569e470d-d42f-45a5-828d-945ac84cc217 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda" status: 200 len: 1514 microversion: 2.1 time: 0.317577 Jul 23 21:26:13.703973 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1526/3107] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:13 2022] GET /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda => generated 1514 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:13.882240 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-7f219f89-8555-4c32-82f9-124314f7f4b9 req-2e283066-81fa-4961-9517-3501ac475617 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcb1aa47-1abb-4c2f-9686-7268d2b86967", "name": "network-vif-deleted", "tag": "fd27373f-0bdd-45aa-abd0-2caec10e18cf"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:26:13.892386 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-7f219f89-8555-4c32-82f9-124314f7f4b9 req-2e283066-81fa-4961-9517-3501ac475617 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:13.892869 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-7f219f89-8555-4c32-82f9-124314f7f4b9 req-2e283066-81fa-4961-9517-3501ac475617 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:13.905223 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-7f219f89-8555-4c32-82f9-124314f7f4b9 req-2e283066-81fa-4961-9517-3501ac475617 service nova] Creating event network-vif-deleted:fd27373f-0bdd-45aa-abd0-2caec10e18cf for instance dcb1aa47-1abb-4c2f-9686-7268d2b86967 on nch2-master-1 Jul 23 21:26:13.912143 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2d3cd3a4-c377-4571-8e36-1b1ce314af34 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:13.912774 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-2d3cd3a4-c377-4571-8e36-1b1ce314af34 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] [instance: 5429c0b0-c38d-424d-90ef-4a54df8e4cba] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:13.919891 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-7f219f89-8555-4c32-82f9-124314f7f4b9 req-2e283066-81fa-4961-9517-3501ac475617 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042934 Jul 23 21:26:13.920566 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1582/3108] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:26:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:26:13.920784 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2d3cd3a4-c377-4571-8e36-1b1ce314af34 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:13.921419 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2d3cd3a4-c377-4571-8e36-1b1ce314af34 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:13.922254 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2d3cd3a4-c377-4571-8e36-1b1ce314af34 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:13.922700 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2d3cd3a4-c377-4571-8e36-1b1ce314af34 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:14.118681 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-2d3cd3a4-c377-4571-8e36-1b1ce314af34 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961e46ab94f4fffbc606485935ce64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8305585b60d54beeb2b087a37260a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:14.124995 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-3826dc2b-f2da-426a-b578-5414d0fd86bb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:14.125701 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-3826dc2b-f2da-426a-b578-5414d0fd86bb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:14.127450 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2d3cd3a4-c377-4571-8e36-1b1ce314af34 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] 10.222.0.17 "GET /compute/v2.1/servers/5429c0b0-c38d-424d-90ef-4a54df8e4cba" status: 200 len: 1325 microversion: 2.1 time: 0.219487 Jul 23 21:26:14.136803 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1527/3109] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:13 2022] GET /compute/v2.1/servers/5429c0b0-c38d-424d-90ef-4a54df8e4cba => generated 1325 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:26:14.137010 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3826dc2b-f2da-426a-b578-5414d0fd86bb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:14.137010 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3826dc2b-f2da-426a-b578-5414d0fd86bb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:14.137010 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3826dc2b-f2da-426a-b578-5414d0fd86bb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:14.137010 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3826dc2b-f2da-426a-b578-5414d0fd86bb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:14.198234 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-3826dc2b-f2da-426a-b578-5414d0fd86bb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:14.208435 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-3826dc2b-f2da-426a-b578-5414d0fd86bb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:14.210084 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-3826dc2b-f2da-426a-b578-5414d0fd86bb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:14.211354 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-3826dc2b-f2da-426a-b578-5414d0fd86bb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.090971 Jul 23 21:26:14.212011 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1583/3110] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:26:14 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:26:14.224045 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e86df635-b0b4-4489-95d0-56b53d54ecdd tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:14.224691 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e86df635-b0b4-4489-95d0-56b53d54ecdd tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: 9a9ac364-9d41-4402-9312-9e363b68792d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:14.231738 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e86df635-b0b4-4489-95d0-56b53d54ecdd tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:14.232195 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e86df635-b0b4-4489-95d0-56b53d54ecdd tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:14.232974 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e86df635-b0b4-4489-95d0-56b53d54ecdd tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:14.233412 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e86df635-b0b4-4489-95d0-56b53d54ecdd tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:14.303406 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ada08ee2-ff22-4f0c-bc0f-1064b2bdbf7b tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:14.304141 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-ada08ee2-ff22-4f0c-bc0f-1064b2bdbf7b tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] [instance: 35d0d067-4f24-45a4-b03c-32346b764d3c] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:14.310834 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ada08ee2-ff22-4f0c-bc0f-1064b2bdbf7b tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:14.311266 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ada08ee2-ff22-4f0c-bc0f-1064b2bdbf7b tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:14.312080 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ada08ee2-ff22-4f0c-bc0f-1064b2bdbf7b tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:14.312527 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ada08ee2-ff22-4f0c-bc0f-1064b2bdbf7b tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:14.318268 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e86df635-b0b4-4489-95d0-56b53d54ecdd tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:14.326529 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e86df635-b0b4-4489-95d0-56b53d54ecdd tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/9a9ac364-9d41-4402-9312-9e363b68792d" status: 200 len: 1267 microversion: 2.1 time: 0.106656 Jul 23 21:26:14.327384 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1528/3111] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:14 2022] GET /compute/v2.1/servers/9a9ac364-9d41-4402-9312-9e363b68792d => generated 1267 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:14.401277 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-65600d53-f313-4871-9aa4-2987853d9680 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:14.401734 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-65600d53-f313-4871-9aa4-2987853d9680 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] [instance: 3de52df5-917b-4cdd-b2fa-a13453f03559] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:14.409037 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-65600d53-f313-4871-9aa4-2987853d9680 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:14.409499 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-65600d53-f313-4871-9aa4-2987853d9680 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:14.410329 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-65600d53-f313-4871-9aa4-2987853d9680 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:14.410860 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-65600d53-f313-4871-9aa4-2987853d9680 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:14.463652 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ada08ee2-ff22-4f0c-bc0f-1064b2bdbf7b tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859c1493a30d4386b74377ab2b9bc81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3efb8824be84323b6ec04b604775bd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:14.471350 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-ada08ee2-ff22-4f0c-bc0f-1064b2bdbf7b tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] 10.222.0.17 "GET /compute/v2.1/servers/35d0d067-4f24-45a4-b03c-32346b764d3c" status: 200 len: 1515 microversion: 2.1 time: 0.171902 Jul 23 21:26:14.471934 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1584/3112] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:14 2022] GET /compute/v2.1/servers/35d0d067-4f24-45a4-b03c-32346b764d3c => generated 1515 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:14.477331 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-849a0f00-a2bc-4409-9192-4a9c3fd629e0 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:14.477331 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-849a0f00-a2bc-4409-9192-4a9c3fd629e0 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] [instance: cb3a66a8-4c84-4bb1-8b3f-0c48acec1215] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:14.485627 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-849a0f00-a2bc-4409-9192-4a9c3fd629e0 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:14.486138 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-849a0f00-a2bc-4409-9192-4a9c3fd629e0 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:14.486874 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-849a0f00-a2bc-4409-9192-4a9c3fd629e0 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:14.487574 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-849a0f00-a2bc-4409-9192-4a9c3fd629e0 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:14.688479 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-849a0f00-a2bc-4409-9192-4a9c3fd629e0 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a609c39c14343e1bc1edd4b3cd56dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116def61aba4631be91f67df63ebab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:14.699449 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-849a0f00-a2bc-4409-9192-4a9c3fd629e0 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] 10.222.0.17 "GET /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215" status: 200 len: 1505 microversion: 2.1 time: 0.226455 Jul 23 21:26:14.700736 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1585/3113] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:14 2022] GET /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215 => generated 1505 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:14.723271 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-9a68865d-d11c-4fc0-b9e3-5559ccefe795 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:14.724320 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-9a68865d-d11c-4fc0-b9e3-5559ccefe795 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: d303403b-5d14-443b-a6fe-f8b579d24cda] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:14.730357 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-65600d53-f313-4871-9aa4-2987853d9680 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0543f1a561a9442cbc9463ab752bd2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d306759c447edb6d013cf14ac53f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:14.740797 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-65600d53-f313-4871-9aa4-2987853d9680 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] 10.222.0.17 "GET /compute/v2.1/servers/3de52df5-917b-4cdd-b2fa-a13453f03559" status: 200 len: 1318 microversion: 2.1 time: 0.343932 Jul 23 21:26:14.745459 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1529/3114] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:14 2022] GET /compute/v2.1/servers/3de52df5-917b-4cdd-b2fa-a13453f03559 => generated 1318 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:14.748961 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9a68865d-d11c-4fc0-b9e3-5559ccefe795 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:14.749718 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9a68865d-d11c-4fc0-b9e3-5559ccefe795 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:14.751169 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9a68865d-d11c-4fc0-b9e3-5559ccefe795 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:14.751988 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9a68865d-d11c-4fc0-b9e3-5559ccefe795 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:14.926471 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-9a68865d-d11c-4fc0-b9e3-5559ccefe795 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:14.935730 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-9a68865d-d11c-4fc0-b9e3-5559ccefe795 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda" status: 200 len: 1514 microversion: 2.1 time: 0.218654 Jul 23 21:26:14.947865 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1586/3115] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:14 2022] GET /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda => generated 1514 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:15.144881 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6e621fcc-8470-4c21-91ea-7f3d018f1a82 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:15.145749 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6e621fcc-8470-4c21-91ea-7f3d018f1a82 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] [instance: 5429c0b0-c38d-424d-90ef-4a54df8e4cba] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:15.153677 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6e621fcc-8470-4c21-91ea-7f3d018f1a82 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:15.154298 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6e621fcc-8470-4c21-91ea-7f3d018f1a82 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:15.155362 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6e621fcc-8470-4c21-91ea-7f3d018f1a82 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:15.156002 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6e621fcc-8470-4c21-91ea-7f3d018f1a82 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:15.232582 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-bc813dc4-edf1-4a11-a2a3-ef4296903228 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:15.233794 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-bc813dc4-edf1-4a11-a2a3-ef4296903228 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:15.240798 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bc813dc4-edf1-4a11-a2a3-ef4296903228 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:15.242098 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bc813dc4-edf1-4a11-a2a3-ef4296903228 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:15.242994 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bc813dc4-edf1-4a11-a2a3-ef4296903228 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:15.243628 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bc813dc4-edf1-4a11-a2a3-ef4296903228 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:15.315072 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-bc813dc4-edf1-4a11-a2a3-ef4296903228 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:15.325169 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-bc813dc4-edf1-4a11-a2a3-ef4296903228 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:15.327073 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-bc813dc4-edf1-4a11-a2a3-ef4296903228 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:15.328304 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-bc813dc4-edf1-4a11-a2a3-ef4296903228 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.101622 Jul 23 21:26:15.328893 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1587/3116] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:26:15 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:26:15.343460 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f53954df-466c-46ac-a4d7-9f2e30b0c1c4 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:15.344085 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-f53954df-466c-46ac-a4d7-9f2e30b0c1c4 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: 9a9ac364-9d41-4402-9312-9e363b68792d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:15.352526 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f53954df-466c-46ac-a4d7-9f2e30b0c1c4 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:15.353081 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f53954df-466c-46ac-a4d7-9f2e30b0c1c4 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:15.354047 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f53954df-466c-46ac-a4d7-9f2e30b0c1c4 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:15.354616 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f53954df-466c-46ac-a4d7-9f2e30b0c1c4 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:15.427608 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-f53954df-466c-46ac-a4d7-9f2e30b0c1c4 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:15.436362 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-f53954df-466c-46ac-a4d7-9f2e30b0c1c4 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/9a9ac364-9d41-4402-9312-9e363b68792d" status: 200 len: 1273 microversion: 2.1 time: 0.097131 Jul 23 21:26:15.437098 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1588/3117] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:15 2022] GET /compute/v2.1/servers/9a9ac364-9d41-4402-9312-9e363b68792d => generated 1273 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:15.488987 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-2af689df-168f-4493-a62b-2985bfcba462 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:15.489611 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-2af689df-168f-4493-a62b-2985bfcba462 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] [instance: 35d0d067-4f24-45a4-b03c-32346b764d3c] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:15.496491 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2af689df-168f-4493-a62b-2985bfcba462 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:15.496991 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2af689df-168f-4493-a62b-2985bfcba462 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:15.497767 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2af689df-168f-4493-a62b-2985bfcba462 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:15.498260 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2af689df-168f-4493-a62b-2985bfcba462 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:15.635087 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-2af689df-168f-4493-a62b-2985bfcba462 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859c1493a30d4386b74377ab2b9bc81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3efb8824be84323b6ec04b604775bd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:15.644751 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-2af689df-168f-4493-a62b-2985bfcba462 tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] 10.222.0.17 "GET /compute/v2.1/servers/35d0d067-4f24-45a4-b03c-32346b764d3c" status: 200 len: 1515 microversion: 2.1 time: 0.160414 Jul 23 21:26:15.658703 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1589/3118] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:15 2022] GET /compute/v2.1/servers/35d0d067-4f24-45a4-b03c-32346b764d3c => generated 1515 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:15.716914 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d688cf83-a093-45f5-be00-31e9db20c717 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:15.717591 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-d688cf83-a093-45f5-be00-31e9db20c717 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] [instance: cb3a66a8-4c84-4bb1-8b3f-0c48acec1215] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:15.724384 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d688cf83-a093-45f5-be00-31e9db20c717 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:15.724964 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d688cf83-a093-45f5-be00-31e9db20c717 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:15.725847 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d688cf83-a093-45f5-be00-31e9db20c717 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:15.726356 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d688cf83-a093-45f5-be00-31e9db20c717 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:15.743261 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=100 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:26:15.875238 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-d688cf83-a093-45f5-be00-31e9db20c717 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a609c39c14343e1bc1edd4b3cd56dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116def61aba4631be91f67df63ebab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:15.883632 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-d688cf83-a093-45f5-be00-31e9db20c717 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] 10.222.0.17 "GET /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215" status: 200 len: 1505 microversion: 2.1 time: 0.170756 Jul 23 21:26:15.884550 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1590/3119] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:15 2022] GET /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215 => generated 1505 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:15.889266 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-b835ecf5-5a92-469c-8633-dfce9d0c23f7 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:15.889989 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-b835ecf5-5a92-469c-8633-dfce9d0c23f7 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] [instance: 3de52df5-917b-4cdd-b2fa-a13453f03559] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:15.894399 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:26:15.898522 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b835ecf5-5a92-469c-8633-dfce9d0c23f7 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:15.899213 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b835ecf5-5a92-469c-8633-dfce9d0c23f7 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:15.900085 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b835ecf5-5a92-469c-8633-dfce9d0c23f7 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:15.900596 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b835ecf5-5a92-469c-8633-dfce9d0c23f7 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:15.951445 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6e621fcc-8470-4c21-91ea-7f3d018f1a82 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961e46ab94f4fffbc606485935ce64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8305585b60d54beeb2b087a37260a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:15.963576 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6e621fcc-8470-4c21-91ea-7f3d018f1a82 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] 10.222.0.17 "GET /compute/v2.1/servers/5429c0b0-c38d-424d-90ef-4a54df8e4cba" status: 200 len: 1325 microversion: 2.1 time: 0.822196 Jul 23 21:26:15.965528 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1530/3120] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:15 2022] GET /compute/v2.1/servers/5429c0b0-c38d-424d-90ef-4a54df8e4cba => generated 1325 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:15.971688 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-fc375189-28ba-43ac-843f-af68e7c7047d tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:15.972654 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-fc375189-28ba-43ac-843f-af68e7c7047d tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: d303403b-5d14-443b-a6fe-f8b579d24cda] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:15.980850 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fc375189-28ba-43ac-843f-af68e7c7047d tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:15.981313 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fc375189-28ba-43ac-843f-af68e7c7047d tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:15.982359 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fc375189-28ba-43ac-843f-af68e7c7047d tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:15.983181 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fc375189-28ba-43ac-843f-af68e7c7047d tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:16.055274 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-b835ecf5-5a92-469c-8633-dfce9d0c23f7 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0543f1a561a9442cbc9463ab752bd2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d306759c447edb6d013cf14ac53f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:16.064898 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-b835ecf5-5a92-469c-8633-dfce9d0c23f7 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] 10.222.0.17 "GET /compute/v2.1/servers/3de52df5-917b-4cdd-b2fa-a13453f03559" status: 200 len: 1318 microversion: 2.1 time: 0.179436 Jul 23 21:26:16.065739 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1591/3121] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:15 2022] GET /compute/v2.1/servers/3de52df5-917b-4cdd-b2fa-a13453f03559 => generated 1318 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:16.347044 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e036030b-6ff0-48e8-bbaa-eb9a8c1c476c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:16.347660 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-e036030b-6ff0-48e8-bbaa-eb9a8c1c476c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:16.354857 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e036030b-6ff0-48e8-bbaa-eb9a8c1c476c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:16.355557 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e036030b-6ff0-48e8-bbaa-eb9a8c1c476c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:16.356496 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e036030b-6ff0-48e8-bbaa-eb9a8c1c476c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:16.357205 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e036030b-6ff0-48e8-bbaa-eb9a8c1c476c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:16.423849 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-e036030b-6ff0-48e8-bbaa-eb9a8c1c476c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:16.434267 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-e036030b-6ff0-48e8-bbaa-eb9a8c1c476c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:16.436207 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-e036030b-6ff0-48e8-bbaa-eb9a8c1c476c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:16.437706 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-e036030b-6ff0-48e8-bbaa-eb9a8c1c476c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.094776 Jul 23 21:26:16.450904 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1592/3122] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:26:16 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:26:16.457495 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e927aaf3-fbd4-4564-a523-32043bbe3be6 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:16.458606 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-e927aaf3-fbd4-4564-a523-32043bbe3be6 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: 9a9ac364-9d41-4402-9312-9e363b68792d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:16.465734 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e927aaf3-fbd4-4564-a523-32043bbe3be6 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:16.466486 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e927aaf3-fbd4-4564-a523-32043bbe3be6 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:16.467982 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e927aaf3-fbd4-4564-a523-32043bbe3be6 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:16.468668 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e927aaf3-fbd4-4564-a523-32043bbe3be6 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:16.538425 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-e927aaf3-fbd4-4564-a523-32043bbe3be6 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:16.546646 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-e927aaf3-fbd4-4564-a523-32043bbe3be6 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/9a9ac364-9d41-4402-9312-9e363b68792d" status: 200 len: 1273 microversion: 2.1 time: 0.094163 Jul 23 21:26:16.547253 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1593/3123] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:16 2022] GET /compute/v2.1/servers/9a9ac364-9d41-4402-9312-9e363b68792d => generated 1273 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:16.551510 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-fc375189-28ba-43ac-843f-af68e7c7047d tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:16.560256 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-fc375189-28ba-43ac-843f-af68e7c7047d tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda" status: 200 len: 1514 microversion: 2.1 time: 0.592774 Jul 23 21:26:16.560854 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1531/3124] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:15 2022] GET /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda => generated 1514 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:16.663709 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f335c23f-4907-44b2-98f1-01b69f0a17df tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:16.664475 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-f335c23f-4907-44b2-98f1-01b69f0a17df tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] [instance: 35d0d067-4f24-45a4-b03c-32346b764d3c] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:16.672595 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f335c23f-4907-44b2-98f1-01b69f0a17df tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:16.673622 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f335c23f-4907-44b2-98f1-01b69f0a17df tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:16.674037 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f335c23f-4907-44b2-98f1-01b69f0a17df tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:16.674708 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f335c23f-4907-44b2-98f1-01b69f0a17df tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:16.862556 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-f335c23f-4907-44b2-98f1-01b69f0a17df tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '859c1493a30d4386b74377ab2b9bc81d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3efb8824be84323b6ec04b604775bd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:16.872382 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-f335c23f-4907-44b2-98f1-01b69f0a17df tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] 10.222.0.17 "GET /compute/v2.1/servers/35d0d067-4f24-45a4-b03c-32346b764d3c" status: 200 len: 1515 microversion: 2.1 time: 0.214016 Jul 23 21:26:16.873365 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1594/3125] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:16 2022] GET /compute/v2.1/servers/35d0d067-4f24-45a4-b03c-32346b764d3c => generated 1515 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:16.902194 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d02cb410-8b89-4c6a-8a96-becb0d021a0d tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:16.904477 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d02cb410-8b89-4c6a-8a96-becb0d021a0d tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] [instance: cb3a66a8-4c84-4bb1-8b3f-0c48acec1215] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:16.914497 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d02cb410-8b89-4c6a-8a96-becb0d021a0d tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:16.915241 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d02cb410-8b89-4c6a-8a96-becb0d021a0d tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:16.922054 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-b8be09e9-d53e-4ad9-84f8-329bd7f01a55 req-62ebbb96-bac6-482a-95b8-88866d65afdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5429c0b0-c38d-424d-90ef-4a54df8e4cba", "name": "network-vif-plugged", "status": "completed", "tag": "cea64a01-c4e4-4bfc-a9ce-f9da3f33722b"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:26:16.928534 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d02cb410-8b89-4c6a-8a96-becb0d021a0d tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:16.929547 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d02cb410-8b89-4c6a-8a96-becb0d021a0d tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:16.942413 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-b8be09e9-d53e-4ad9-84f8-329bd7f01a55 req-62ebbb96-bac6-482a-95b8-88866d65afdc service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:16.946246 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-b8be09e9-d53e-4ad9-84f8-329bd7f01a55 req-62ebbb96-bac6-482a-95b8-88866d65afdc service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:16.959991 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-b8be09e9-d53e-4ad9-84f8-329bd7f01a55 req-62ebbb96-bac6-482a-95b8-88866d65afdc service nova] Creating event network-vif-plugged:cea64a01-c4e4-4bfc-a9ce-f9da3f33722b for instance 5429c0b0-c38d-424d-90ef-4a54df8e4cba on nch1-master-1 Jul 23 21:26:16.966246 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-b8be09e9-d53e-4ad9-84f8-329bd7f01a55 req-62ebbb96-bac6-482a-95b8-88866d65afdc service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048348 Jul 23 21:26:16.967659 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1595/3126] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:26:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:26:16.987997 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-bf3bdb7f-6776-492f-ae3f-2fa8c5c833e9 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:16.989156 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-bf3bdb7f-6776-492f-ae3f-2fa8c5c833e9 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] [instance: 5429c0b0-c38d-424d-90ef-4a54df8e4cba] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:16.997544 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bf3bdb7f-6776-492f-ae3f-2fa8c5c833e9 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:16.998339 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bf3bdb7f-6776-492f-ae3f-2fa8c5c833e9 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:16.999348 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bf3bdb7f-6776-492f-ae3f-2fa8c5c833e9 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:16.999951 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bf3bdb7f-6776-492f-ae3f-2fa8c5c833e9 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:17.204982 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-bf3bdb7f-6776-492f-ae3f-2fa8c5c833e9 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961e46ab94f4fffbc606485935ce64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8305585b60d54beeb2b087a37260a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:17.216871 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-bf3bdb7f-6776-492f-ae3f-2fa8c5c833e9 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] 10.222.0.17 "GET /compute/v2.1/servers/5429c0b0-c38d-424d-90ef-4a54df8e4cba" status: 200 len: 1325 microversion: 2.1 time: 0.233719 Jul 23 21:26:17.218760 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1596/3127] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:16 2022] GET /compute/v2.1/servers/5429c0b0-c38d-424d-90ef-4a54df8e4cba => generated 1325 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:17.223966 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-3b666d5a-bce5-449b-8ff5-11b93b5eca31 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:17.224575 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-3b666d5a-bce5-449b-8ff5-11b93b5eca31 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] [instance: 3de52df5-917b-4cdd-b2fa-a13453f03559] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:17.233002 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3b666d5a-bce5-449b-8ff5-11b93b5eca31 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:17.233451 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3b666d5a-bce5-449b-8ff5-11b93b5eca31 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:17.234274 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3b666d5a-bce5-449b-8ff5-11b93b5eca31 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:17.234704 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3b666d5a-bce5-449b-8ff5-11b93b5eca31 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:17.425701 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-3b666d5a-bce5-449b-8ff5-11b93b5eca31 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0543f1a561a9442cbc9463ab752bd2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d306759c447edb6d013cf14ac53f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:17.434420 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-3b666d5a-bce5-449b-8ff5-11b93b5eca31 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] 10.222.0.17 "GET /compute/v2.1/servers/3de52df5-917b-4cdd-b2fa-a13453f03559" status: 200 len: 1318 microversion: 2.1 time: 0.214518 Jul 23 21:26:17.435561 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1597/3128] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:17 2022] GET /compute/v2.1/servers/3de52df5-917b-4cdd-b2fa-a13453f03559 => generated 1318 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:17.440281 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-d9c10638-020e-4e13-8e96-7c9f648f1d2a req-da3ebb55-c3df-47e7-80b8-13a5bc49d707 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3de52df5-917b-4cdd-b2fa-a13453f03559", "tag": "216fbe1b-f994-4e02-a3c9-7f9a1ad5a3f1"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:26:17.448578 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-d9c10638-020e-4e13-8e96-7c9f648f1d2a req-da3ebb55-c3df-47e7-80b8-13a5bc49d707 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:17.449016 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-d9c10638-020e-4e13-8e96-7c9f648f1d2a req-da3ebb55-c3df-47e7-80b8-13a5bc49d707 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:17.461024 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-d9c10638-020e-4e13-8e96-7c9f648f1d2a req-da3ebb55-c3df-47e7-80b8-13a5bc49d707 service nova] Creating event network-changed:216fbe1b-f994-4e02-a3c9-7f9a1ad5a3f1 for instance 3de52df5-917b-4cdd-b2fa-a13453f03559 on nch1-master-1 Jul 23 21:26:17.466056 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-d9c10638-020e-4e13-8e96-7c9f648f1d2a req-da3ebb55-c3df-47e7-80b8-13a5bc49d707 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029052 Jul 23 21:26:17.466673 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1598/3129] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:26:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:26:17.472898 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-dbb39133-ad0f-4bef-80cc-058421982350 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:17.473613 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-dbb39133-ad0f-4bef-80cc-058421982350 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:17.481117 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-dbb39133-ad0f-4bef-80cc-058421982350 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:17.481659 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-dbb39133-ad0f-4bef-80cc-058421982350 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:17.482381 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-dbb39133-ad0f-4bef-80cc-058421982350 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:17.482855 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-dbb39133-ad0f-4bef-80cc-058421982350 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:17.550794 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-dbb39133-ad0f-4bef-80cc-058421982350 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:17.562945 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-dbb39133-ad0f-4bef-80cc-058421982350 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:17.564564 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-dbb39133-ad0f-4bef-80cc-058421982350 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:17.565807 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-dbb39133-ad0f-4bef-80cc-058421982350 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.097696 Jul 23 21:26:17.566408 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1599/3130] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:26:17 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:26:17.578867 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f6c16145-04fd-4817-b261-70253b006be8 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:17.578867 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-f6c16145-04fd-4817-b261-70253b006be8 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: 9a9ac364-9d41-4402-9312-9e363b68792d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:17.579482 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f6c16145-04fd-4817-b261-70253b006be8 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:17.579943 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f6c16145-04fd-4817-b261-70253b006be8 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:17.580756 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f6c16145-04fd-4817-b261-70253b006be8 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:17.581168 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f6c16145-04fd-4817-b261-70253b006be8 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:17.661626 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-f6c16145-04fd-4817-b261-70253b006be8 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:17.666259 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d02cb410-8b89-4c6a-8a96-becb0d021a0d tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a609c39c14343e1bc1edd4b3cd56dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116def61aba4631be91f67df63ebab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:17.683824 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d02cb410-8b89-4c6a-8a96-becb0d021a0d tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] 10.222.0.17 "GET /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215" status: 200 len: 1505 microversion: 2.1 time: 0.786197 Jul 23 21:26:17.685219 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1532/3131] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:16 2022] GET /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215 => generated 1505 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:17.692732 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-753218ce-ce44-4bab-85f4-3634865df223 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:17.693853 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-753218ce-ce44-4bab-85f4-3634865df223 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: d303403b-5d14-443b-a6fe-f8b579d24cda] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:17.695237 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-f6c16145-04fd-4817-b261-70253b006be8 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/9a9ac364-9d41-4402-9312-9e363b68792d" status: 200 len: 1273 microversion: 2.1 time: 0.127669 Jul 23 21:26:17.704226 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-753218ce-ce44-4bab-85f4-3634865df223 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:17.704538 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1600/3132] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:17 2022] GET /compute/v2.1/servers/9a9ac364-9d41-4402-9312-9e363b68792d => generated 1273 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:17.706271 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-753218ce-ce44-4bab-85f4-3634865df223 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:17.707677 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-753218ce-ce44-4bab-85f4-3634865df223 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:17.708451 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-753218ce-ce44-4bab-85f4-3634865df223 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:17.891700 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-1a986355-b2f9-4d8c-9885-3b8a4add806e tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:17.892409 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-1a986355-b2f9-4d8c-9885-3b8a4add806e tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] [instance: 35d0d067-4f24-45a4-b03c-32346b764d3c] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:17.898920 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1a986355-b2f9-4d8c-9885-3b8a4add806e tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:17.899447 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1a986355-b2f9-4d8c-9885-3b8a4add806e tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:17.900792 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1a986355-b2f9-4d8c-9885-3b8a4add806e tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:17.900792 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1a986355-b2f9-4d8c-9885-3b8a4add806e tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:17.916980 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-1a986355-b2f9-4d8c-9885-3b8a4add806e tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] HTTP exception thrown: Instance 35d0d067-4f24-45a4-b03c-32346b764d3c could not be found. Jul 23 21:26:17.918665 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-1a986355-b2f9-4d8c-9885-3b8a4add806e tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Request method failure captured: Jul 23 21:26:17.918665 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/servers/35d0d067-4f24-45a4-b03c-32346b764d3c HTTP/1.1 Jul 23 21:26:17.918665 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:26:17.918665 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:26:17.918665 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:26:17.918665 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:26:17.918665 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:26:17.918665 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:26:17.918665 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:26:17.918665 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:26:17.918665 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GczsXgROL6bUMBFH-tkSofnZik0J5bxiOrKq6uW_u-Y5j3nI1UHBrHt6mX_xdACJg3OufH2YSPiqvjoO-4SZQnjCf0A0tvDUXE-OgdqnzicdxU5b3IhTQ-cl1wWVW0NuOQMQdoxm5v7bK-KeazIaRcOgIfiClXkZsnN-a7OvGhj0zs Jul 23 21:26:17.918665 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:26:17.918665 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:26:17.918665 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:26:17.918665 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:26:17.918665 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:26:17.918665 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:26:17.918665 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: b3efb8824be84323b6ec04b604775bd0 Jul 23 21:26:17.918665 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ListServerFiltersTestJSON-528658115 Jul 23 21:26:17.918665 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:26:17.918665 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:26:17.918665 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b3efb8824be84323b6ec04b604775bd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b3efb8824be84323b6ec04b604775bd0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b3efb8824be84323b6ec04b604775bd0", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b3efb8824be84323b6ec04b604775bd0"}]}] Jul 23 21:26:17.918665 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ListServerFiltersTestJSON-528658115 Jul 23 21:26:17.918665 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: b3efb8824be84323b6ec04b604775bd0 Jul 23 21:26:17.918665 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-528658115 Jul 23 21:26:17.918665 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ListServerFiltersTestJSON-528658115-project Jul 23 21:26:17.918665 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:26:17.918665 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:26:17.918665 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 859c1493a30d4386b74377ab2b9bc81d Jul 23 21:26:17.918665 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ListServerFiltersTestJSON-528658115-project Jul 23 21:26:17.918665 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:26:17.918665 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance 35d0d067-4f24-45a4-b03c-32346b764d3c could not be found. Jul 23 21:26:17.918665 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': '35d0d067-4f24-45a4-b03c-32346b764d3c'} Jul 23 21:26:17.918665 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:26:17.918665 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:26:17.918665 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:26:17.918665 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:26:17.918665 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:26:17.918665 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:26:17.918665 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:26:17.918665 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:26:17.918665 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:26:17.918665 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:26:17.918665 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35d0d067-4f24-45a4-b03c-32346b764d3c could not be found. Jul 23 21:26:17.918665 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:17.918665 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:26:17.918665 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:17.918665 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:26:17.918665 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:26:17.918665 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:26:17.918665 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:26:17.918665 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:26:17.918665 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:26:17.918665 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:26:17.918665 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:26:17.918665 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:26:17.918665 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:26:17.918665 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:26:17.918665 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:26:17.918665 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:26:17.918665 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35d0d067-4f24-45a4-b03c-32346b764d3c could not be found. Jul 23 21:26:17.918665 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:17.918665 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:26:17.918665 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:17.923722 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:26:17.923722 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:26:17.923722 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:26:17.923722 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:26:17.923722 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:26:17.923722 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35d0d067-4f24-45a4-b03c-32346b764d3c could not be found. Jul 23 21:26:17.923722 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:17.923722 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-1a986355-b2f9-4d8c-9885-3b8a4add806e tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] Returning 404 to user: Instance 35d0d067-4f24-45a4-b03c-32346b764d3c could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:26:17.923722 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-1a986355-b2f9-4d8c-9885-3b8a4add806e tempest-ListServerFiltersTestJSON-528658115 tempest-ListServerFiltersTestJSON-528658115-project] 10.222.0.17 "GET /compute/v2.1/servers/35d0d067-4f24-45a4-b03c-32346b764d3c" status: 404 len: 111 microversion: 2.1 time: 0.033869 Jul 23 21:26:17.923722 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1601/3133] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:17 2022] GET /compute/v2.1/servers/35d0d067-4f24-45a4-b03c-32346b764d3c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:26:18.077820 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-753218ce-ce44-4bab-85f4-3634865df223 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:18.091454 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-753218ce-ce44-4bab-85f4-3634865df223 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda" status: 200 len: 1514 microversion: 2.1 time: 0.402414 Jul 23 21:26:18.092824 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1533/3134] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:17 2022] GET /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda => generated 1514 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:18.234202 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-8ab8497a-53bb-41c0-8104-1930c8f71734 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:18.235366 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-8ab8497a-53bb-41c0-8104-1930c8f71734 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] [instance: 5429c0b0-c38d-424d-90ef-4a54df8e4cba] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:18.243036 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8ab8497a-53bb-41c0-8104-1930c8f71734 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:18.243720 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8ab8497a-53bb-41c0-8104-1930c8f71734 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:18.244735 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8ab8497a-53bb-41c0-8104-1930c8f71734 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:18.245320 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8ab8497a-53bb-41c0-8104-1930c8f71734 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:18.451437 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6cbc23ed-29b2-4407-bb27-c1852d604088 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:18.452057 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6cbc23ed-29b2-4407-bb27-c1852d604088 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] [instance: 3de52df5-917b-4cdd-b2fa-a13453f03559] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:18.461614 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6cbc23ed-29b2-4407-bb27-c1852d604088 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:18.462103 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6cbc23ed-29b2-4407-bb27-c1852d604088 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:18.462929 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6cbc23ed-29b2-4407-bb27-c1852d604088 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:18.463357 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6cbc23ed-29b2-4407-bb27-c1852d604088 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:18.466775 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-8ab8497a-53bb-41c0-8104-1930c8f71734 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961e46ab94f4fffbc606485935ce64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8305585b60d54beeb2b087a37260a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:18.482505 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-8ab8497a-53bb-41c0-8104-1930c8f71734 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] 10.222.0.17 "GET /compute/v2.1/servers/5429c0b0-c38d-424d-90ef-4a54df8e4cba" status: 200 len: 1325 microversion: 2.1 time: 0.251979 Jul 23 21:26:18.494417 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1602/3135] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:18 2022] GET /compute/v2.1/servers/5429c0b0-c38d-424d-90ef-4a54df8e4cba => generated 1325 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:18.588642 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-fd91773f-df56-4f44-acd2-fd75dcfcc3e2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:18.589901 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-fd91773f-df56-4f44-acd2-fd75dcfcc3e2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:18.598246 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fd91773f-df56-4f44-acd2-fd75dcfcc3e2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:18.598998 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fd91773f-df56-4f44-acd2-fd75dcfcc3e2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:18.600025 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fd91773f-df56-4f44-acd2-fd75dcfcc3e2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:18.600534 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fd91773f-df56-4f44-acd2-fd75dcfcc3e2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:18.678137 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-fd91773f-df56-4f44-acd2-fd75dcfcc3e2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:18.691692 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-fd91773f-df56-4f44-acd2-fd75dcfcc3e2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:18.696433 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-fd91773f-df56-4f44-acd2-fd75dcfcc3e2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:18.698535 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-fd91773f-df56-4f44-acd2-fd75dcfcc3e2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.115577 Jul 23 21:26:18.700556 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1603/3136] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:26:18 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:26:18.707218 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-75fb0516-961a-4660-a4e5-663898f024de tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:18.708337 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-75fb0516-961a-4660-a4e5-663898f024de tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] [instance: cb3a66a8-4c84-4bb1-8b3f-0c48acec1215] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:18.721927 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-75fb0516-961a-4660-a4e5-663898f024de tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:18.723128 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-75fb0516-961a-4660-a4e5-663898f024de tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:18.724716 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-75fb0516-961a-4660-a4e5-663898f024de tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:18.725903 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-75fb0516-961a-4660-a4e5-663898f024de tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:19.000275 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-75fb0516-961a-4660-a4e5-663898f024de tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a609c39c14343e1bc1edd4b3cd56dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116def61aba4631be91f67df63ebab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:19.012038 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-75fb0516-961a-4660-a4e5-663898f024de tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] 10.222.0.17 "GET /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215" status: 200 len: 1505 microversion: 2.1 time: 0.309771 Jul 23 21:26:19.022172 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1604/3137] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:18 2022] GET /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215 => generated 1505 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:19.022172 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-7bbe5551-273a-4764-8643-24cc4e1e68b1 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:19.022172 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-7bbe5551-273a-4764-8643-24cc4e1e68b1 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: 9a9ac364-9d41-4402-9312-9e363b68792d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:19.030330 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7bbe5551-273a-4764-8643-24cc4e1e68b1 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:19.030786 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7bbe5551-273a-4764-8643-24cc4e1e68b1 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:19.031821 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7bbe5551-273a-4764-8643-24cc4e1e68b1 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:19.032084 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7bbe5551-273a-4764-8643-24cc4e1e68b1 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:19.256576 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6cbc23ed-29b2-4407-bb27-c1852d604088 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0543f1a561a9442cbc9463ab752bd2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d306759c447edb6d013cf14ac53f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:19.260338 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:26:19.265038 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6cbc23ed-29b2-4407-bb27-c1852d604088 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] 10.222.0.17 "GET /compute/v2.1/servers/3de52df5-917b-4cdd-b2fa-a13453f03559" status: 200 len: 1318 microversion: 2.1 time: 0.817501 Jul 23 21:26:19.265854 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1534/3138] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:18 2022] GET /compute/v2.1/servers/3de52df5-917b-4cdd-b2fa-a13453f03559 => generated 1318 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:26:19.265997 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-7bbe5551-273a-4764-8643-24cc4e1e68b1 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:19.270891 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d32f0609-244c-4a96-a9ad-9cfb143d480c tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:19.271680 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d32f0609-244c-4a96-a9ad-9cfb143d480c tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: d303403b-5d14-443b-a6fe-f8b579d24cda] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:19.278626 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d32f0609-244c-4a96-a9ad-9cfb143d480c tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:19.279258 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d32f0609-244c-4a96-a9ad-9cfb143d480c tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:19.280187 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d32f0609-244c-4a96-a9ad-9cfb143d480c tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:19.280620 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-7bbe5551-273a-4764-8643-24cc4e1e68b1 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/9a9ac364-9d41-4402-9312-9e363b68792d" status: 200 len: 1315 microversion: 2.1 time: 0.265487 Jul 23 21:26:19.281024 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d32f0609-244c-4a96-a9ad-9cfb143d480c tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:19.294244 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1605/3139] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:19 2022] GET /compute/v2.1/servers/9a9ac364-9d41-4402-9312-9e363b68792d => generated 1315 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:19.502135 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a51fe091-1c82-4e6c-a8b6-570648696bba tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:19.503083 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-a51fe091-1c82-4e6c-a8b6-570648696bba tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] [instance: 5429c0b0-c38d-424d-90ef-4a54df8e4cba] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:19.511992 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a51fe091-1c82-4e6c-a8b6-570648696bba tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:19.512562 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a51fe091-1c82-4e6c-a8b6-570648696bba tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:19.513549 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a51fe091-1c82-4e6c-a8b6-570648696bba tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:19.515585 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a51fe091-1c82-4e6c-a8b6-570648696bba tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:19.634417 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d32f0609-244c-4a96-a9ad-9cfb143d480c tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:19.644517 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d32f0609-244c-4a96-a9ad-9cfb143d480c tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda" status: 200 len: 1514 microversion: 2.1 time: 0.376951 Jul 23 21:26:19.645121 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1535/3140] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:19 2022] GET /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda => generated 1514 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:19.654557 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-ba25ca0f-a324-4078-90d9-3bf01f7294e1 req-06f5f63e-508f-4a2c-9067-085ee5750afa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35d0d067-4f24-45a4-b03c-32346b764d3c", "name": "network-vif-deleted", "tag": "9a5bd934-baf8-40bb-b356-bd97f6909cf5"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:26:19.678833 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-ba25ca0f-a324-4078-90d9-3bf01f7294e1 req-06f5f63e-508f-4a2c-9067-085ee5750afa service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:19.683640 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-ba25ca0f-a324-4078-90d9-3bf01f7294e1 req-06f5f63e-508f-4a2c-9067-085ee5750afa service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:19.709004 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-ba25ca0f-a324-4078-90d9-3bf01f7294e1 req-06f5f63e-508f-4a2c-9067-085ee5750afa service nova] Creating event network-vif-deleted:9a5bd934-baf8-40bb-b356-bd97f6909cf5 for instance 35d0d067-4f24-45a4-b03c-32346b764d3c on nch2-master-1 Jul 23 21:26:19.717488 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-ba25ca0f-a324-4078-90d9-3bf01f7294e1 req-06f5f63e-508f-4a2c-9067-085ee5750afa service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065896 Jul 23 21:26:19.718658 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1536/3141] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:26:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:26:19.727054 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ba83f590-2f56-4ad1-b5d8-e33d378cb30a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:19.727954 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ba83f590-2f56-4ad1-b5d8-e33d378cb30a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:19.735114 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ba83f590-2f56-4ad1-b5d8-e33d378cb30a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:19.735762 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ba83f590-2f56-4ad1-b5d8-e33d378cb30a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:19.737365 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ba83f590-2f56-4ad1-b5d8-e33d378cb30a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:19.738023 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ba83f590-2f56-4ad1-b5d8-e33d378cb30a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:19.773888 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-a51fe091-1c82-4e6c-a8b6-570648696bba tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961e46ab94f4fffbc606485935ce64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8305585b60d54beeb2b087a37260a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:19.782987 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-a51fe091-1c82-4e6c-a8b6-570648696bba tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] 10.222.0.17 "GET /compute/v2.1/servers/5429c0b0-c38d-424d-90ef-4a54df8e4cba" status: 200 len: 1521 microversion: 2.1 time: 0.285501 Jul 23 21:26:19.794495 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1606/3142] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:19 2022] GET /compute/v2.1/servers/5429c0b0-c38d-424d-90ef-4a54df8e4cba => generated 1521 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:19.802483 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ef1152a4-3dd0-4731-857d-31aa9009da8d tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:19.802979 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-ef1152a4-3dd0-4731-857d-31aa9009da8d tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] [instance: 5429c0b0-c38d-424d-90ef-4a54df8e4cba] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:19.809752 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ef1152a4-3dd0-4731-857d-31aa9009da8d tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:19.810236 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ef1152a4-3dd0-4731-857d-31aa9009da8d tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:19.811023 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ef1152a4-3dd0-4731-857d-31aa9009da8d tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:19.811460 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ef1152a4-3dd0-4731-857d-31aa9009da8d tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:19.851345 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-ef1152a4-3dd0-4731-857d-31aa9009da8d tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] [instance: 5429c0b0-c38d-424d-90ef-4a54df8e4cba] Going to try to terminate instance {{(pid=131321) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:26:19.883124 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ba83f590-2f56-4ad1-b5d8-e33d378cb30a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:19.895829 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ba83f590-2f56-4ad1-b5d8-e33d378cb30a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:19.898671 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ba83f590-2f56-4ad1-b5d8-e33d378cb30a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:19.909368 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:26:19.909841 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ba83f590-2f56-4ad1-b5d8-e33d378cb30a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.189359 Jul 23 21:26:19.910889 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1537/3143] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:26:19 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:26:19.961461 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-ef1152a4-3dd0-4731-857d-31aa9009da8d tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] 10.222.0.17 "DELETE /compute/v2.1/servers/5429c0b0-c38d-424d-90ef-4a54df8e4cba" status: 204 len: 0 microversion: 2.1 time: 0.162416 Jul 23 21:26:19.965263 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1607/3144] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:26:19 2022] DELETE /compute/v2.1/servers/5429c0b0-c38d-424d-90ef-4a54df8e4cba => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 23 21:26:19.972075 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-fdbe8c90-ee7f-413f-85ee-0c40ba61df64 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:19.972697 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-fdbe8c90-ee7f-413f-85ee-0c40ba61df64 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] [instance: 5429c0b0-c38d-424d-90ef-4a54df8e4cba] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:19.980954 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fdbe8c90-ee7f-413f-85ee-0c40ba61df64 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:19.981616 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fdbe8c90-ee7f-413f-85ee-0c40ba61df64 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:19.982620 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fdbe8c90-ee7f-413f-85ee-0c40ba61df64 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:19.984225 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fdbe8c90-ee7f-413f-85ee-0c40ba61df64 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:20.029420 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-b681997e-a7d2-4ceb-9b21-4ef792593ce4 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:20.030155 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-b681997e-a7d2-4ceb-9b21-4ef792593ce4 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] [instance: cb3a66a8-4c84-4bb1-8b3f-0c48acec1215] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:20.036811 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b681997e-a7d2-4ceb-9b21-4ef792593ce4 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:20.037573 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b681997e-a7d2-4ceb-9b21-4ef792593ce4 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:20.038454 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b681997e-a7d2-4ceb-9b21-4ef792593ce4 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:20.038894 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b681997e-a7d2-4ceb-9b21-4ef792593ce4 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:20.216044 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-b681997e-a7d2-4ceb-9b21-4ef792593ce4 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a609c39c14343e1bc1edd4b3cd56dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116def61aba4631be91f67df63ebab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:20.242930 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-b681997e-a7d2-4ceb-9b21-4ef792593ce4 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] 10.222.0.17 "GET /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215" status: 200 len: 1505 microversion: 2.1 time: 0.217674 Jul 23 21:26:20.249651 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1608/3145] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:20 2022] GET /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215 => generated 1505 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:26:20.283211 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-932cc677-6f14-4c36-af1d-66e6c638f446 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:20.283967 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-932cc677-6f14-4c36-af1d-66e6c638f446 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] [instance: 3de52df5-917b-4cdd-b2fa-a13453f03559] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:20.294642 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-932cc677-6f14-4c36-af1d-66e6c638f446 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:20.295370 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-932cc677-6f14-4c36-af1d-66e6c638f446 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:20.314474 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-932cc677-6f14-4c36-af1d-66e6c638f446 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:20.315670 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-932cc677-6f14-4c36-af1d-66e6c638f446 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:20.363820 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-fdbe8c90-ee7f-413f-85ee-0c40ba61df64 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961e46ab94f4fffbc606485935ce64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8305585b60d54beeb2b087a37260a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:20.377657 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-fdbe8c90-ee7f-413f-85ee-0c40ba61df64 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] 10.222.0.17 "GET /compute/v2.1/servers/5429c0b0-c38d-424d-90ef-4a54df8e4cba" status: 200 len: 1527 microversion: 2.1 time: 0.409571 Jul 23 21:26:20.378874 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1538/3146] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:19 2022] GET /compute/v2.1/servers/5429c0b0-c38d-424d-90ef-4a54df8e4cba => generated 1527 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:20.385319 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4e396d06-5200-42ee-81ff-4e56a45894c0 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:20.386353 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-4e396d06-5200-42ee-81ff-4e56a45894c0 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: 9a9ac364-9d41-4402-9312-9e363b68792d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:20.394176 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4e396d06-5200-42ee-81ff-4e56a45894c0 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:20.394878 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4e396d06-5200-42ee-81ff-4e56a45894c0 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:20.395888 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4e396d06-5200-42ee-81ff-4e56a45894c0 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:20.396537 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4e396d06-5200-42ee-81ff-4e56a45894c0 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:20.430644 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=14 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:26:20.561228 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-932cc677-6f14-4c36-af1d-66e6c638f446 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0543f1a561a9442cbc9463ab752bd2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d306759c447edb6d013cf14ac53f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:20.568900 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-932cc677-6f14-4c36-af1d-66e6c638f446 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] 10.222.0.17 "GET /compute/v2.1/servers/3de52df5-917b-4cdd-b2fa-a13453f03559" status: 200 len: 1318 microversion: 2.1 time: 0.290447 Jul 23 21:26:20.569627 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1609/3147] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:20 2022] GET /compute/v2.1/servers/3de52df5-917b-4cdd-b2fa-a13453f03559 => generated 1318 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:26:20.668386 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a094db64-ed1f-46ac-afdc-2752e6629074 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:20.668874 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-a094db64-ed1f-46ac-afdc-2752e6629074 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: d303403b-5d14-443b-a6fe-f8b579d24cda] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:20.677360 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a094db64-ed1f-46ac-afdc-2752e6629074 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:20.677835 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a094db64-ed1f-46ac-afdc-2752e6629074 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:20.678808 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a094db64-ed1f-46ac-afdc-2752e6629074 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:20.679530 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a094db64-ed1f-46ac-afdc-2752e6629074 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:20.839170 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-a094db64-ed1f-46ac-afdc-2752e6629074 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:20.849010 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-a094db64-ed1f-46ac-afdc-2752e6629074 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda" status: 200 len: 1514 microversion: 2.1 time: 0.187723 Jul 23 21:26:20.859741 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1610/3148] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:20 2022] GET /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda => generated 1514 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:20.875951 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-4e396d06-5200-42ee-81ff-4e56a45894c0 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:20.887524 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4e396d06-5200-42ee-81ff-4e56a45894c0 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/9a9ac364-9d41-4402-9312-9e363b68792d" status: 200 len: 1315 microversion: 2.1 time: 0.507096 Jul 23 21:26:20.889144 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1539/3149] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:20 2022] GET /compute/v2.1/servers/9a9ac364-9d41-4402-9312-9e363b68792d => generated 1315 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:20.928914 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-6c46c40b-c6fb-4469-bef1-5c1e04ea5ed3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:20.929943 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-6c46c40b-c6fb-4469-bef1-5c1e04ea5ed3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:20.937147 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6c46c40b-c6fb-4469-bef1-5c1e04ea5ed3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:20.938251 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6c46c40b-c6fb-4469-bef1-5c1e04ea5ed3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:20.940495 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6c46c40b-c6fb-4469-bef1-5c1e04ea5ed3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:20.941113 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6c46c40b-c6fb-4469-bef1-5c1e04ea5ed3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:21.021847 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-6c46c40b-c6fb-4469-bef1-5c1e04ea5ed3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:21.036054 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-6c46c40b-c6fb-4469-bef1-5c1e04ea5ed3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:21.041050 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-6c46c40b-c6fb-4469-bef1-5c1e04ea5ed3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:21.043590 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-6c46c40b-c6fb-4469-bef1-5c1e04ea5ed3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.118707 Jul 23 21:26:21.046343 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1611/3150] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:26:20 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:26:21.260079 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5ec80fda-50f2-4dde-af3e-51708b42b1f9 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:21.260824 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5ec80fda-50f2-4dde-af3e-51708b42b1f9 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] [instance: cb3a66a8-4c84-4bb1-8b3f-0c48acec1215] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:21.267564 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5ec80fda-50f2-4dde-af3e-51708b42b1f9 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:21.268026 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5ec80fda-50f2-4dde-af3e-51708b42b1f9 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:21.268825 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5ec80fda-50f2-4dde-af3e-51708b42b1f9 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:21.269227 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5ec80fda-50f2-4dde-af3e-51708b42b1f9 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:21.397330 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-8715ddf5-b526-4e60-8b51-4a484ec8c3e6 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:21.398020 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-8715ddf5-b526-4e60-8b51-4a484ec8c3e6 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] [instance: 5429c0b0-c38d-424d-90ef-4a54df8e4cba] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:21.405108 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8715ddf5-b526-4e60-8b51-4a484ec8c3e6 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:21.406144 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8715ddf5-b526-4e60-8b51-4a484ec8c3e6 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:21.408110 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8715ddf5-b526-4e60-8b51-4a484ec8c3e6 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:21.408864 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8715ddf5-b526-4e60-8b51-4a484ec8c3e6 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:21.437420 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5ec80fda-50f2-4dde-af3e-51708b42b1f9 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a609c39c14343e1bc1edd4b3cd56dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116def61aba4631be91f67df63ebab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:21.451242 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5ec80fda-50f2-4dde-af3e-51708b42b1f9 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] 10.222.0.17 "GET /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215" status: 200 len: 1505 microversion: 2.1 time: 0.195165 Jul 23 21:26:21.451881 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1540/3151] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:21 2022] GET /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215 => generated 1505 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:21.455999 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell0:SELECT=6 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:26:21.590730 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-7c517c4c-27fd-45ac-ad6e-25c2dcfef6c3 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:21.591782 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-7c517c4c-27fd-45ac-ad6e-25c2dcfef6c3 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] [instance: 3de52df5-917b-4cdd-b2fa-a13453f03559] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:21.603263 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7c517c4c-27fd-45ac-ad6e-25c2dcfef6c3 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:21.604052 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7c517c4c-27fd-45ac-ad6e-25c2dcfef6c3 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:21.605310 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7c517c4c-27fd-45ac-ad6e-25c2dcfef6c3 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:21.606040 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7c517c4c-27fd-45ac-ad6e-25c2dcfef6c3 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:21.622777 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell0:SELECT=12 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:26:21.680621 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-8715ddf5-b526-4e60-8b51-4a484ec8c3e6 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961e46ab94f4fffbc606485935ce64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8305585b60d54beeb2b087a37260a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:21.701560 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-8715ddf5-b526-4e60-8b51-4a484ec8c3e6 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] 10.222.0.17 "GET /compute/v2.1/servers/5429c0b0-c38d-424d-90ef-4a54df8e4cba" status: 200 len: 1527 microversion: 2.1 time: 0.309447 Jul 23 21:26:21.702426 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1612/3152] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:21 2022] GET /compute/v2.1/servers/5429c0b0-c38d-424d-90ef-4a54df8e4cba => generated 1527 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:21.756149 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-25ba38a0-dbb4-429e-b2e0-2dba3312d2bb req-e31c950e-71c0-4458-890e-6846026359e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61015c0f-77ab-4ba1-8d68-4979a9888f77", "tag": "7abdd709-2641-49e2-98a0-d1314fd12958"}, {"name": "network-changed", "server_uuid": "9a9ac364-9d41-4402-9312-9e363b68792d", "tag": "e651ec2b-2723-4c75-9de2-9bc8e0fbef28"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:26:21.774275 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-25ba38a0-dbb4-429e-b2e0-2dba3312d2bb req-e31c950e-71c0-4458-890e-6846026359e8 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:21.775451 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-25ba38a0-dbb4-429e-b2e0-2dba3312d2bb req-e31c950e-71c0-4458-890e-6846026359e8 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:21.792113 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-7c517c4c-27fd-45ac-ad6e-25c2dcfef6c3 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0543f1a561a9442cbc9463ab752bd2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d306759c447edb6d013cf14ac53f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:21.795702 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-25ba38a0-dbb4-429e-b2e0-2dba3312d2bb req-e31c950e-71c0-4458-890e-6846026359e8 service nova] Creating event network-changed:7abdd709-2641-49e2-98a0-d1314fd12958 for instance 61015c0f-77ab-4ba1-8d68-4979a9888f77 on nch2-master-1 Jul 23 21:26:21.796389 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-25ba38a0-dbb4-429e-b2e0-2dba3312d2bb req-e31c950e-71c0-4458-890e-6846026359e8 service nova] Creating event network-changed:e651ec2b-2723-4c75-9de2-9bc8e0fbef28 for instance 9a9ac364-9d41-4402-9312-9e363b68792d on nch2-master-1 Jul 23 21:26:21.801176 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-7c517c4c-27fd-45ac-ad6e-25c2dcfef6c3 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] 10.222.0.17 "GET /compute/v2.1/servers/3de52df5-917b-4cdd-b2fa-a13453f03559" status: 200 len: 1318 microversion: 2.1 time: 0.218361 Jul 23 21:26:21.801776 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1541/3153] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:21 2022] GET /compute/v2.1/servers/3de52df5-917b-4cdd-b2fa-a13453f03559 => generated 1318 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:21.805144 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-25ba38a0-dbb4-429e-b2e0-2dba3312d2bb req-e31c950e-71c0-4458-890e-6846026359e8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.052728 Jul 23 21:26:21.805811 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1613/3154] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:26:21 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:26:21.867145 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f74d04d6-67ad-458e-8fd5-f3602907b520 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:21.868127 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f74d04d6-67ad-458e-8fd5-f3602907b520 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: d303403b-5d14-443b-a6fe-f8b579d24cda] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:21.874805 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f74d04d6-67ad-458e-8fd5-f3602907b520 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:21.875270 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f74d04d6-67ad-458e-8fd5-f3602907b520 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:21.876060 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f74d04d6-67ad-458e-8fd5-f3602907b520 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:21.876535 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f74d04d6-67ad-458e-8fd5-f3602907b520 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:21.909247 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-5b3f6216-68a0-4d9c-b822-30fc041ed0cb tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:21.910509 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-5b3f6216-68a0-4d9c-b822-30fc041ed0cb tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: 9a9ac364-9d41-4402-9312-9e363b68792d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:21.917659 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5b3f6216-68a0-4d9c-b822-30fc041ed0cb tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:21.918304 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5b3f6216-68a0-4d9c-b822-30fc041ed0cb tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:21.919416 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5b3f6216-68a0-4d9c-b822-30fc041ed0cb tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:21.920015 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5b3f6216-68a0-4d9c-b822-30fc041ed0cb tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:22.045494 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f74d04d6-67ad-458e-8fd5-f3602907b520 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:22.053891 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f74d04d6-67ad-458e-8fd5-f3602907b520 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda" status: 200 len: 1514 microversion: 2.1 time: 0.191173 Jul 23 21:26:22.054452 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1542/3155] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:21 2022] GET /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda => generated 1514 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:22.070075 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2caf505b-3551-4f84-983c-9ce084e69088 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:22.070961 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-2caf505b-3551-4f84-983c-9ce084e69088 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:22.077336 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=20 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:26:22.080223 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2caf505b-3551-4f84-983c-9ce084e69088 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:22.081147 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2caf505b-3551-4f84-983c-9ce084e69088 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:22.082511 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2caf505b-3551-4f84-983c-9ce084e69088 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:22.083136 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2caf505b-3551-4f84-983c-9ce084e69088 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:22.155764 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-2caf505b-3551-4f84-983c-9ce084e69088 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:22.166895 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-2caf505b-3551-4f84-983c-9ce084e69088 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:22.168836 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-2caf505b-3551-4f84-983c-9ce084e69088 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:22.170268 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2caf505b-3551-4f84-983c-9ce084e69088 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.105211 Jul 23 21:26:22.171398 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1543/3156] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:26:22 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:26:22.227947 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-5b3f6216-68a0-4d9c-b822-30fc041ed0cb tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:22.236982 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-5b3f6216-68a0-4d9c-b822-30fc041ed0cb tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/9a9ac364-9d41-4402-9312-9e363b68792d" status: 200 len: 1315 microversion: 2.1 time: 0.334149 Jul 23 21:26:22.237655 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1614/3157] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:21 2022] GET /compute/v2.1/servers/9a9ac364-9d41-4402-9312-9e363b68792d => generated 1315 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:26:22.468752 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-76b833ec-a8e9-4284-8fda-913bc4a13af0 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:22.470452 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-76b833ec-a8e9-4284-8fda-913bc4a13af0 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] [instance: cb3a66a8-4c84-4bb1-8b3f-0c48acec1215] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:22.481290 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-76b833ec-a8e9-4284-8fda-913bc4a13af0 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:22.482048 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-76b833ec-a8e9-4284-8fda-913bc4a13af0 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:22.482851 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-76b833ec-a8e9-4284-8fda-913bc4a13af0 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:22.483443 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-76b833ec-a8e9-4284-8fda-913bc4a13af0 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:22.719453 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-83f3f351-8b50-455f-b6b4-f127f310a81a tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:22.720229 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-83f3f351-8b50-455f-b6b4-f127f310a81a tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] [instance: 5429c0b0-c38d-424d-90ef-4a54df8e4cba] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:22.727692 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-83f3f351-8b50-455f-b6b4-f127f310a81a tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:22.729164 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-83f3f351-8b50-455f-b6b4-f127f310a81a tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:22.731069 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-83f3f351-8b50-455f-b6b4-f127f310a81a tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:22.731601 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-83f3f351-8b50-455f-b6b4-f127f310a81a tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:23.017531 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-76b833ec-a8e9-4284-8fda-913bc4a13af0 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a609c39c14343e1bc1edd4b3cd56dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116def61aba4631be91f67df63ebab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:23.043750 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-76b833ec-a8e9-4284-8fda-913bc4a13af0 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] 10.222.0.17 "GET /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215" status: 200 len: 1505 microversion: 2.1 time: 0.576209 Jul 23 21:26:23.045765 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1544/3158] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:22 2022] GET /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215 => generated 1505 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:23.070870 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1cf9db23-c9ec-4f90-b2ff-0db785fa17d2 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:23.076647 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1cf9db23-c9ec-4f90-b2ff-0db785fa17d2 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] [instance: 3de52df5-917b-4cdd-b2fa-a13453f03559] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:23.101189 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1cf9db23-c9ec-4f90-b2ff-0db785fa17d2 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:23.101764 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1cf9db23-c9ec-4f90-b2ff-0db785fa17d2 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:23.105928 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1cf9db23-c9ec-4f90-b2ff-0db785fa17d2 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:23.106763 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1cf9db23-c9ec-4f90-b2ff-0db785fa17d2 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:23.163121 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-83f3f351-8b50-455f-b6b4-f127f310a81a tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961e46ab94f4fffbc606485935ce64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8305585b60d54beeb2b087a37260a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:23.174923 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-83f3f351-8b50-455f-b6b4-f127f310a81a tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] 10.222.0.17 "GET /compute/v2.1/servers/5429c0b0-c38d-424d-90ef-4a54df8e4cba" status: 200 len: 1527 microversion: 2.1 time: 0.459955 Jul 23 21:26:23.175527 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1615/3159] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:22 2022] GET /compute/v2.1/servers/5429c0b0-c38d-424d-90ef-4a54df8e4cba => generated 1527 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:23.190484 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-45d832db-bf4f-48bd-a76c-a4a519a8eac3 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:23.191115 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-45d832db-bf4f-48bd-a76c-a4a519a8eac3 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: d303403b-5d14-443b-a6fe-f8b579d24cda] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:23.207319 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-45d832db-bf4f-48bd-a76c-a4a519a8eac3 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:23.208080 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-45d832db-bf4f-48bd-a76c-a4a519a8eac3 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:23.209194 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-45d832db-bf4f-48bd-a76c-a4a519a8eac3 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:23.209842 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-45d832db-bf4f-48bd-a76c-a4a519a8eac3 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:23.520591 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-1cf9db23-c9ec-4f90-b2ff-0db785fa17d2 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0543f1a561a9442cbc9463ab752bd2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d306759c447edb6d013cf14ac53f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:23.529286 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1cf9db23-c9ec-4f90-b2ff-0db785fa17d2 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] 10.222.0.17 "GET /compute/v2.1/servers/3de52df5-917b-4cdd-b2fa-a13453f03559" status: 200 len: 1318 microversion: 2.1 time: 0.469440 Jul 23 21:26:23.538129 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1545/3160] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:23 2022] GET /compute/v2.1/servers/3de52df5-917b-4cdd-b2fa-a13453f03559 => generated 1318 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:23.543293 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f2cb003c-afce-4e9b-897c-490ec4f4e5a8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:23.543902 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f2cb003c-afce-4e9b-897c-490ec4f4e5a8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:23.563980 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f2cb003c-afce-4e9b-897c-490ec4f4e5a8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:23.564712 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f2cb003c-afce-4e9b-897c-490ec4f4e5a8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:23.565693 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f2cb003c-afce-4e9b-897c-490ec4f4e5a8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:23.566314 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f2cb003c-afce-4e9b-897c-490ec4f4e5a8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:23.710884 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f2cb003c-afce-4e9b-897c-490ec4f4e5a8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:23.724737 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f2cb003c-afce-4e9b-897c-490ec4f4e5a8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:23.726788 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f2cb003c-afce-4e9b-897c-490ec4f4e5a8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:23.730200 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f2cb003c-afce-4e9b-897c-490ec4f4e5a8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.190134 Jul 23 21:26:23.730988 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1546/3161] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:26:23 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:26:23.743281 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-da358ed0-e5bf-4071-9856-db3b31df8aca tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:23.744246 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-da358ed0-e5bf-4071-9856-db3b31df8aca tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: 9a9ac364-9d41-4402-9312-9e363b68792d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:23.757738 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-da358ed0-e5bf-4071-9856-db3b31df8aca tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:23.761046 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-da358ed0-e5bf-4071-9856-db3b31df8aca tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:23.762097 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-da358ed0-e5bf-4071-9856-db3b31df8aca tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:23.762647 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-da358ed0-e5bf-4071-9856-db3b31df8aca tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:23.791143 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-45d832db-bf4f-48bd-a76c-a4a519a8eac3 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:23.801045 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-45d832db-bf4f-48bd-a76c-a4a519a8eac3 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda" status: 200 len: 1514 microversion: 2.1 time: 0.624454 Jul 23 21:26:23.814737 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1616/3162] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:23 2022] GET /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda => generated 1514 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:23.820378 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-eeeab37e-46e3-45f6-85bc-02f2da676fc2 req-6eeb8cd8-92a9-4dae-902f-26a355b89508 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3de52df5-917b-4cdd-b2fa-a13453f03559", "name": "network-vif-plugged", "status": "completed", "tag": "216fbe1b-f994-4e02-a3c9-7f9a1ad5a3f1"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:26:23.838418 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-eeeab37e-46e3-45f6-85bc-02f2da676fc2 req-6eeb8cd8-92a9-4dae-902f-26a355b89508 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:23.839849 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-eeeab37e-46e3-45f6-85bc-02f2da676fc2 req-6eeb8cd8-92a9-4dae-902f-26a355b89508 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:23.858587 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-eeeab37e-46e3-45f6-85bc-02f2da676fc2 req-6eeb8cd8-92a9-4dae-902f-26a355b89508 service nova] Creating event network-vif-plugged:216fbe1b-f994-4e02-a3c9-7f9a1ad5a3f1 for instance 3de52df5-917b-4cdd-b2fa-a13453f03559 on nch1-master-1 Jul 23 21:26:23.864229 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-eeeab37e-46e3-45f6-85bc-02f2da676fc2 req-6eeb8cd8-92a9-4dae-902f-26a355b89508 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047734 Jul 23 21:26:23.866587 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1617/3163] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:26:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:26:24.066319 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-893e5660-0fe5-43fa-92c0-0c103df97e00 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:24.067689 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-893e5660-0fe5-43fa-92c0-0c103df97e00 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] [instance: cb3a66a8-4c84-4bb1-8b3f-0c48acec1215] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:24.076856 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-893e5660-0fe5-43fa-92c0-0c103df97e00 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:24.077698 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-893e5660-0fe5-43fa-92c0-0c103df97e00 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:24.078889 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-893e5660-0fe5-43fa-92c0-0c103df97e00 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:24.079558 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-893e5660-0fe5-43fa-92c0-0c103df97e00 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:24.403603 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-893e5660-0fe5-43fa-92c0-0c103df97e00 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a609c39c14343e1bc1edd4b3cd56dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116def61aba4631be91f67df63ebab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:24.410876 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-da358ed0-e5bf-4071-9856-db3b31df8aca tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:24.412431 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-893e5660-0fe5-43fa-92c0-0c103df97e00 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] 10.222.0.17 "GET /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215" status: 200 len: 1505 microversion: 2.1 time: 0.352900 Jul 23 21:26:24.413105 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1618/3164] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:24 2022] GET /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215 => generated 1505 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:26:24.421588 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-9d00eb45-545a-4969-b9e4-4ef6b68138aa tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:24.422446 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-9d00eb45-545a-4969-b9e4-4ef6b68138aa tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] [instance: 5429c0b0-c38d-424d-90ef-4a54df8e4cba] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:24.428265 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-da358ed0-e5bf-4071-9856-db3b31df8aca tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/9a9ac364-9d41-4402-9312-9e363b68792d" status: 200 len: 1315 microversion: 2.1 time: 0.692815 Jul 23 21:26:24.430162 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9d00eb45-545a-4969-b9e4-4ef6b68138aa tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:24.430341 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1547/3165] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:23 2022] GET /compute/v2.1/servers/9a9ac364-9d41-4402-9312-9e363b68792d => generated 1315 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:24.431015 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9d00eb45-545a-4969-b9e4-4ef6b68138aa tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:24.432044 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9d00eb45-545a-4969-b9e4-4ef6b68138aa tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:24.432648 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9d00eb45-545a-4969-b9e4-4ef6b68138aa tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:24.438957 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-12f7001a-2dad-4a61-becf-00f9396967e5 req-4797bb65-aa19-44ec-b349-f2859ca93996 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5429c0b0-c38d-424d-90ef-4a54df8e4cba", "name": "network-vif-deleted", "tag": "cea64a01-c4e4-4bfc-a9ce-f9da3f33722b"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:26:24.450852 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-12f7001a-2dad-4a61-becf-00f9396967e5 req-4797bb65-aa19-44ec-b349-f2859ca93996 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:24.453771 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-12f7001a-2dad-4a61-becf-00f9396967e5 req-4797bb65-aa19-44ec-b349-f2859ca93996 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:24.492004 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-12f7001a-2dad-4a61-becf-00f9396967e5 req-4797bb65-aa19-44ec-b349-f2859ca93996 service nova] Creating event network-vif-deleted:cea64a01-c4e4-4bfc-a9ce-f9da3f33722b for instance 5429c0b0-c38d-424d-90ef-4a54df8e4cba on nch1-master-1 Jul 23 21:26:24.499941 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-12f7001a-2dad-4a61-becf-00f9396967e5 req-4797bb65-aa19-44ec-b349-f2859ca93996 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067686 Jul 23 21:26:24.511177 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1548/3166] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:26:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:26:24.559943 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c8868d9b-cc89-44dd-a354-38fc870f0807 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:24.560850 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c8868d9b-cc89-44dd-a354-38fc870f0807 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] [instance: 3de52df5-917b-4cdd-b2fa-a13453f03559] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:24.572296 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-9d00eb45-545a-4969-b9e4-4ef6b68138aa tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961e46ab94f4fffbc606485935ce64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8305585b60d54beeb2b087a37260a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:24.587403 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-9d00eb45-545a-4969-b9e4-4ef6b68138aa tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] 10.222.0.17 "GET /compute/v2.1/servers/5429c0b0-c38d-424d-90ef-4a54df8e4cba" status: 200 len: 1485 microversion: 2.1 time: 0.171068 Jul 23 21:26:24.588097 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1619/3167] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:24 2022] GET /compute/v2.1/servers/5429c0b0-c38d-424d-90ef-4a54df8e4cba => generated 1485 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:24.592072 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c8868d9b-cc89-44dd-a354-38fc870f0807 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:24.592533 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c8868d9b-cc89-44dd-a354-38fc870f0807 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:24.593331 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c8868d9b-cc89-44dd-a354-38fc870f0807 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:24.593777 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c8868d9b-cc89-44dd-a354-38fc870f0807 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:24.750383 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-89f1be73-7592-496c-97dc-28f04551c608 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:24.751408 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-89f1be73-7592-496c-97dc-28f04551c608 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:24.759980 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-89f1be73-7592-496c-97dc-28f04551c608 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:24.760527 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-89f1be73-7592-496c-97dc-28f04551c608 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:24.761543 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-89f1be73-7592-496c-97dc-28f04551c608 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:24.762209 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-89f1be73-7592-496c-97dc-28f04551c608 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:24.843297 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-89f1be73-7592-496c-97dc-28f04551c608 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:24.853776 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-89f1be73-7592-496c-97dc-28f04551c608 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:24.858109 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c8868d9b-cc89-44dd-a354-38fc870f0807 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0543f1a561a9442cbc9463ab752bd2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d306759c447edb6d013cf14ac53f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:24.866659 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-89f1be73-7592-496c-97dc-28f04551c608 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:24.868227 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-89f1be73-7592-496c-97dc-28f04551c608 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.121810 Jul 23 21:26:24.869176 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1620/3168] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:26:24 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:26:24.874181 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-cc17c754-6c51-4f7f-9f86-654b865d2d6e tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:24.875046 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-cc17c754-6c51-4f7f-9f86-654b865d2d6e tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: d303403b-5d14-443b-a6fe-f8b579d24cda] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:24.883739 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c8868d9b-cc89-44dd-a354-38fc870f0807 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] 10.222.0.17 "GET /compute/v2.1/servers/3de52df5-917b-4cdd-b2fa-a13453f03559" status: 200 len: 1318 microversion: 2.1 time: 0.332245 Jul 23 21:26:24.904209 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1549/3169] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:24 2022] GET /compute/v2.1/servers/3de52df5-917b-4cdd-b2fa-a13453f03559 => generated 1318 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:24.906458 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cc17c754-6c51-4f7f-9f86-654b865d2d6e tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:24.907164 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cc17c754-6c51-4f7f-9f86-654b865d2d6e tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:24.908314 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cc17c754-6c51-4f7f-9f86-654b865d2d6e tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:24.908915 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cc17c754-6c51-4f7f-9f86-654b865d2d6e tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:25.239626 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-cc17c754-6c51-4f7f-9f86-654b865d2d6e tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:25.256906 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-cc17c754-6c51-4f7f-9f86-654b865d2d6e tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda" status: 200 len: 1514 microversion: 2.1 time: 0.386200 Jul 23 21:26:25.258477 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1621/3170] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:24 2022] GET /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda => generated 1514 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:25.431849 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e32cd083-e2ac-45da-b286-1f8ce4570087 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:25.432894 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e32cd083-e2ac-45da-b286-1f8ce4570087 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] [instance: cb3a66a8-4c84-4bb1-8b3f-0c48acec1215] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:25.448336 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-2ace9b96-75aa-4ffb-b5ee-2f791797c55c tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:25.449375 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-2ace9b96-75aa-4ffb-b5ee-2f791797c55c tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: 9a9ac364-9d41-4402-9312-9e363b68792d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:25.461623 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e32cd083-e2ac-45da-b286-1f8ce4570087 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:25.463063 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2ace9b96-75aa-4ffb-b5ee-2f791797c55c tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:25.464618 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e32cd083-e2ac-45da-b286-1f8ce4570087 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:25.468659 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2ace9b96-75aa-4ffb-b5ee-2f791797c55c tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:25.469278 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e32cd083-e2ac-45da-b286-1f8ce4570087 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:25.469954 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e32cd083-e2ac-45da-b286-1f8ce4570087 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:25.470991 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2ace9b96-75aa-4ffb-b5ee-2f791797c55c tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:25.471396 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2ace9b96-75aa-4ffb-b5ee-2f791797c55c tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:25.773205 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e32cd083-e2ac-45da-b286-1f8ce4570087 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a609c39c14343e1bc1edd4b3cd56dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116def61aba4631be91f67df63ebab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:25.782973 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e32cd083-e2ac-45da-b286-1f8ce4570087 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] 10.222.0.17 "GET /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215" status: 200 len: 1485 microversion: 2.1 time: 0.356472 Jul 23 21:26:25.784445 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1550/3171] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:25 2022] GET /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215 => generated 1485 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:25.789923 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-fdf37e49-7419-4866-9580-36ea795aec7b tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:25.790775 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-fdf37e49-7419-4866-9580-36ea795aec7b tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] [instance: 5429c0b0-c38d-424d-90ef-4a54df8e4cba] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:25.798564 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fdf37e49-7419-4866-9580-36ea795aec7b tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:25.799562 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fdf37e49-7419-4866-9580-36ea795aec7b tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:25.800371 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fdf37e49-7419-4866-9580-36ea795aec7b tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:25.801847 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fdf37e49-7419-4866-9580-36ea795aec7b tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:25.840650 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fdf37e49-7419-4866-9580-36ea795aec7b tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:25.841564 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fdf37e49-7419-4866-9580-36ea795aec7b tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:25.842045 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.objects.instance [None req-fdf37e49-7419-4866-9580-36ea795aec7b tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lazy-loading 'fault' on Instance uuid 5429c0b0-c38d-424d-90ef-4a54df8e4cba {{(pid=131320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:26:25.872674 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-2ace9b96-75aa-4ffb-b5ee-2f791797c55c tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:25.882651 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-2ace9b96-75aa-4ffb-b5ee-2f791797c55c tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/9a9ac364-9d41-4402-9312-9e363b68792d" status: 200 len: 1315 microversion: 2.1 time: 0.439707 Jul 23 21:26:25.894020 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1622/3172] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:25 2022] GET /compute/v2.1/servers/9a9ac364-9d41-4402-9312-9e363b68792d => generated 1315 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:26:25.900079 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a55707ef-10b4-40af-a266-979d00a1d918 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:26:25.900925 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-fdf37e49-7419-4866-9580-36ea795aec7b tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961e46ab94f4fffbc606485935ce64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8305585b60d54beeb2b087a37260a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:25.901079 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-a55707ef-10b4-40af-a266-979d00a1d918 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] [instance: cb3a66a8-4c84-4bb1-8b3f-0c48acec1215] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:25.911364 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-fdf37e49-7419-4866-9580-36ea795aec7b tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] 10.222.0.17 "GET /compute/v2.1/servers/5429c0b0-c38d-424d-90ef-4a54df8e4cba" status: 200 len: 1315 microversion: 2.1 time: 0.125175 Jul 23 21:26:25.912007 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a55707ef-10b4-40af-a266-979d00a1d918 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:25.912850 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a55707ef-10b4-40af-a266-979d00a1d918 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:25.914714 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a55707ef-10b4-40af-a266-979d00a1d918 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:25.915367 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a55707ef-10b4-40af-a266-979d00a1d918 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:25.922288 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1551/3173] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:25 2022] GET /compute/v2.1/servers/5429c0b0-c38d-424d-90ef-4a54df8e4cba => generated 1315 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:25.928014 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-13db1a38-3724-4492-be73-0cfb03dbbb8f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:25.928947 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-13db1a38-3724-4492-be73-0cfb03dbbb8f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:25.936015 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-13db1a38-3724-4492-be73-0cfb03dbbb8f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:25.936675 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-13db1a38-3724-4492-be73-0cfb03dbbb8f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:25.937620 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-13db1a38-3724-4492-be73-0cfb03dbbb8f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:25.938260 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-13db1a38-3724-4492-be73-0cfb03dbbb8f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:25.966194 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=100 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:26:26.009838 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-a55707ef-10b4-40af-a266-979d00a1d918 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] 10.222.0.17 "POST /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215/action" status: 202 len: 0 microversion: 2.1 time: 0.113651 Jul 23 21:26:26.015150 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1623/3174] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:26:25 2022] POST /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:26:26.022617 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-13db1a38-3724-4492-be73-0cfb03dbbb8f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:26.025325 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-6bdc8093-87d4-4982-99a5-23a6084a33b1 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:26.026122 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-6bdc8093-87d4-4982-99a5-23a6084a33b1 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] [instance: 3de52df5-917b-4cdd-b2fa-a13453f03559] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:26.033488 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-13db1a38-3724-4492-be73-0cfb03dbbb8f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:26.035541 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6bdc8093-87d4-4982-99a5-23a6084a33b1 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:26.036073 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6bdc8093-87d4-4982-99a5-23a6084a33b1 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:26.036542 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-13db1a38-3724-4492-be73-0cfb03dbbb8f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:26.037385 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6bdc8093-87d4-4982-99a5-23a6084a33b1 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:26.038209 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6bdc8093-87d4-4982-99a5-23a6084a33b1 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:26.038589 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-13db1a38-3724-4492-be73-0cfb03dbbb8f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.114682 Jul 23 21:26:26.050322 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1552/3175] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:26:25 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:26:26.056954 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-7a6e605f-696a-4585-940d-7be8fd8d8e67 req-9895e924-94b8-4f42-b251-11921b4c19cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61015c0f-77ab-4ba1-8d68-4979a9888f77", "name": "network-vif-plugged", "status": "completed", "tag": "7abdd709-2641-49e2-98a0-d1314fd12958"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:26:26.066135 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-7a6e605f-696a-4585-940d-7be8fd8d8e67 req-9895e924-94b8-4f42-b251-11921b4c19cf service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:26.066892 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-7a6e605f-696a-4585-940d-7be8fd8d8e67 req-9895e924-94b8-4f42-b251-11921b4c19cf service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:26.072000 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:26:26.080646 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-7a6e605f-696a-4585-940d-7be8fd8d8e67 req-9895e924-94b8-4f42-b251-11921b4c19cf service nova] Creating event network-vif-plugged:7abdd709-2641-49e2-98a0-d1314fd12958 for instance 61015c0f-77ab-4ba1-8d68-4979a9888f77 on nch2-master-1 Jul 23 21:26:26.086174 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-7a6e605f-696a-4585-940d-7be8fd8d8e67 req-9895e924-94b8-4f42-b251-11921b4c19cf service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034160 Jul 23 21:26:26.087430 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1553/3176] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:26:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:26:26.095165 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b1991937-27a4-40df-9ed7-dc2b90af0354 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:26.096231 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b1991937-27a4-40df-9ed7-dc2b90af0354 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] [instance: cb3a66a8-4c84-4bb1-8b3f-0c48acec1215] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:26.103529 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b1991937-27a4-40df-9ed7-dc2b90af0354 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:26.104307 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b1991937-27a4-40df-9ed7-dc2b90af0354 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:26.105396 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b1991937-27a4-40df-9ed7-dc2b90af0354 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:26.106098 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b1991937-27a4-40df-9ed7-dc2b90af0354 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:26.293716 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b1991937-27a4-40df-9ed7-dc2b90af0354 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a609c39c14343e1bc1edd4b3cd56dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116def61aba4631be91f67df63ebab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:26.310426 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b1991937-27a4-40df-9ed7-dc2b90af0354 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] 10.222.0.17 "GET /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215" status: 200 len: 1493 microversion: 2.1 time: 0.220620 Jul 23 21:26:26.311184 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1554/3177] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:26 2022] GET /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215 => generated 1493 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:26.315805 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6461087e-f482-416c-8a80-ea758c4f53f0 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:26.316423 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6461087e-f482-416c-8a80-ea758c4f53f0 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: d303403b-5d14-443b-a6fe-f8b579d24cda] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:26.338280 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6461087e-f482-416c-8a80-ea758c4f53f0 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:26.338649 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6461087e-f482-416c-8a80-ea758c4f53f0 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:26.339445 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6461087e-f482-416c-8a80-ea758c4f53f0 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:26.339884 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6461087e-f482-416c-8a80-ea758c4f53f0 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:26.391131 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-6bdc8093-87d4-4982-99a5-23a6084a33b1 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0543f1a561a9442cbc9463ab752bd2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d306759c447edb6d013cf14ac53f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:26.411895 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-6bdc8093-87d4-4982-99a5-23a6084a33b1 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] 10.222.0.17 "GET /compute/v2.1/servers/3de52df5-917b-4cdd-b2fa-a13453f03559" status: 200 len: 1318 microversion: 2.1 time: 0.394834 Jul 23 21:26:26.416799 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1624/3178] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:26 2022] GET /compute/v2.1/servers/3de52df5-917b-4cdd-b2fa-a13453f03559 => generated 1318 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:26.697788 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6461087e-f482-416c-8a80-ea758c4f53f0 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:26.706402 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6461087e-f482-416c-8a80-ea758c4f53f0 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda" status: 200 len: 1520 microversion: 2.1 time: 0.394065 Jul 23 21:26:26.707783 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1555/3179] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:26 2022] GET /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda => generated 1520 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:26.902770 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-1ee5c971-95e7-4685-a04a-616ec1125aaa tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:26.903653 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-1ee5c971-95e7-4685-a04a-616ec1125aaa tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: 9a9ac364-9d41-4402-9312-9e363b68792d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:26.914565 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1ee5c971-95e7-4685-a04a-616ec1125aaa tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:26.915289 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1ee5c971-95e7-4685-a04a-616ec1125aaa tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:26.916087 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1ee5c971-95e7-4685-a04a-616ec1125aaa tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:26.916726 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1ee5c971-95e7-4685-a04a-616ec1125aaa tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:26.927725 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f3f45bdd-1039-4085-9fff-4d59105e7818 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:26.928395 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f3f45bdd-1039-4085-9fff-4d59105e7818 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] [instance: 5429c0b0-c38d-424d-90ef-4a54df8e4cba] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:26.940560 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f3f45bdd-1039-4085-9fff-4d59105e7818 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:26.941019 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f3f45bdd-1039-4085-9fff-4d59105e7818 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:26.941821 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f3f45bdd-1039-4085-9fff-4d59105e7818 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:26.942317 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f3f45bdd-1039-4085-9fff-4d59105e7818 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:26.997790 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f3f45bdd-1039-4085-9fff-4d59105e7818 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:26.998321 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f3f45bdd-1039-4085-9fff-4d59105e7818 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:26.998839 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.objects.instance [None req-f3f45bdd-1039-4085-9fff-4d59105e7818 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lazy-loading 'fault' on Instance uuid 5429c0b0-c38d-424d-90ef-4a54df8e4cba {{(pid=131320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:26:27.050828 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f3f45bdd-1039-4085-9fff-4d59105e7818 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961e46ab94f4fffbc606485935ce64d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8305585b60d54beeb2b087a37260a89a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:27.063241 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f3f45bdd-1039-4085-9fff-4d59105e7818 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] 10.222.0.17 "GET /compute/v2.1/servers/5429c0b0-c38d-424d-90ef-4a54df8e4cba" status: 200 len: 1315 microversion: 2.1 time: 0.138544 Jul 23 21:26:27.064469 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1556/3180] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:26 2022] GET /compute/v2.1/servers/5429c0b0-c38d-424d-90ef-4a54df8e4cba => generated 1315 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:27.069797 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8b669b24-d567-4e15-a918-d1870eef3b8f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:27.070685 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8b669b24-d567-4e15-a918-d1870eef3b8f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:27.090688 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8b669b24-d567-4e15-a918-d1870eef3b8f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:27.091565 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8b669b24-d567-4e15-a918-d1870eef3b8f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:27.092722 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8b669b24-d567-4e15-a918-d1870eef3b8f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:27.094453 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8b669b24-d567-4e15-a918-d1870eef3b8f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:27.202424 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8b669b24-d567-4e15-a918-d1870eef3b8f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:27.217614 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8b669b24-d567-4e15-a918-d1870eef3b8f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:27.219587 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8b669b24-d567-4e15-a918-d1870eef3b8f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:27.221797 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8b669b24-d567-4e15-a918-d1870eef3b8f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.156003 Jul 23 21:26:27.233446 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1557/3181] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:26:27 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:26:27.328399 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f9b32ddb-2707-4890-8aaa-d15572cd76c1 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:27.329328 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f9b32ddb-2707-4890-8aaa-d15572cd76c1 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] [instance: cb3a66a8-4c84-4bb1-8b3f-0c48acec1215] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:27.336019 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f9b32ddb-2707-4890-8aaa-d15572cd76c1 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:27.336724 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f9b32ddb-2707-4890-8aaa-d15572cd76c1 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:27.338449 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f9b32ddb-2707-4890-8aaa-d15572cd76c1 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:27.339095 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f9b32ddb-2707-4890-8aaa-d15572cd76c1 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:27.381509 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-1ee5c971-95e7-4685-a04a-616ec1125aaa tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:27.398555 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-1ee5c971-95e7-4685-a04a-616ec1125aaa tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/9a9ac364-9d41-4402-9312-9e363b68792d" status: 200 len: 1315 microversion: 2.1 time: 0.501168 Jul 23 21:26:27.399631 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1625/3182] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:26 2022] GET /compute/v2.1/servers/9a9ac364-9d41-4402-9312-9e363b68792d => generated 1315 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:27.433034 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ba92841e-02c1-4f43-a53e-a63342e2f56e tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:27.434240 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-ba92841e-02c1-4f43-a53e-a63342e2f56e tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] [instance: 3de52df5-917b-4cdd-b2fa-a13453f03559] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:27.451116 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ba92841e-02c1-4f43-a53e-a63342e2f56e tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:27.451791 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ba92841e-02c1-4f43-a53e-a63342e2f56e tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:27.452800 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ba92841e-02c1-4f43-a53e-a63342e2f56e tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:27.453425 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ba92841e-02c1-4f43-a53e-a63342e2f56e tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:27.571945 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f9b32ddb-2707-4890-8aaa-d15572cd76c1 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a609c39c14343e1bc1edd4b3cd56dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116def61aba4631be91f67df63ebab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:27.588601 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f9b32ddb-2707-4890-8aaa-d15572cd76c1 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] 10.222.0.17 "GET /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215" status: 200 len: 1493 microversion: 2.1 time: 0.264489 Jul 23 21:26:27.598940 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1558/3183] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:27 2022] GET /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215 => generated 1493 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:26:27.769790 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ba92841e-02c1-4f43-a53e-a63342e2f56e tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0543f1a561a9442cbc9463ab752bd2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d306759c447edb6d013cf14ac53f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:27.782064 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-ba92841e-02c1-4f43-a53e-a63342e2f56e tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] 10.222.0.17 "GET /compute/v2.1/servers/3de52df5-917b-4cdd-b2fa-a13453f03559" status: 200 len: 1318 microversion: 2.1 time: 0.351193 Jul 23 21:26:27.791193 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1626/3184] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:27 2022] GET /compute/v2.1/servers/3de52df5-917b-4cdd-b2fa-a13453f03559 => generated 1318 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:27.798897 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-9c5834d4-5918-4a28-8135-e33a4a5bbf73 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:27.799527 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-9c5834d4-5918-4a28-8135-e33a4a5bbf73 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: d303403b-5d14-443b-a6fe-f8b579d24cda] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:27.808244 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9c5834d4-5918-4a28-8135-e33a4a5bbf73 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:27.808843 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9c5834d4-5918-4a28-8135-e33a4a5bbf73 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:27.809639 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9c5834d4-5918-4a28-8135-e33a4a5bbf73 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:27.810311 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9c5834d4-5918-4a28-8135-e33a4a5bbf73 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:27.847689 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-83b7b6ca-436e-43c7-89e8-4dcdc69f5b50 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1875177163", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "cb6686b4-1765-4f99-9801-c6a5d6418a10"}]}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:26:27.859255 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:26:27.948238 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-83b7b6ca-436e-43c7-89e8-4dcdc69f5b50 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] validate_networks() for [('cb6686b4-1765-4f99-9801-c6a5d6418a10', None, None, None, None, None)] {{(pid=131320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:26:28.088253 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-9c5834d4-5918-4a28-8135-e33a4a5bbf73 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:28.097655 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-9c5834d4-5918-4a28-8135-e33a4a5bbf73 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda" status: 200 len: 1520 microversion: 2.1 time: 0.304868 Jul 23 21:26:28.098684 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1627/3185] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:27 2022] GET /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda => generated 1520 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:28.123036 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-131fba92-1284-482d-91e5-af2c4d897ca3 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:28.123873 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-131fba92-1284-482d-91e5-af2c4d897ca3 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] [instance: 5429c0b0-c38d-424d-90ef-4a54df8e4cba] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:28.130866 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-131fba92-1284-482d-91e5-af2c4d897ca3 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:28.131971 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-131fba92-1284-482d-91e5-af2c4d897ca3 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:28.132937 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-131fba92-1284-482d-91e5-af2c4d897ca3 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:28.133574 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-131fba92-1284-482d-91e5-af2c4d897ca3 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:28.151713 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-131fba92-1284-482d-91e5-af2c4d897ca3 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] HTTP exception thrown: Instance 5429c0b0-c38d-424d-90ef-4a54df8e4cba could not be found. Jul 23 21:26:28.153855 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-131fba92-1284-482d-91e5-af2c4d897ca3 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Request method failure captured: Jul 23 21:26:28.153855 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/servers/5429c0b0-c38d-424d-90ef-4a54df8e4cba HTTP/1.1 Jul 23 21:26:28.153855 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:26:28.153855 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:26:28.153855 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:26:28.153855 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:26:28.153855 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:26:28.153855 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:26:28.153855 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:26:28.153855 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:26:28.153855 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GcdFkVYIK2DtJm403sM7IG79jHXbShtkQheCHNeqOWOy-LrSxvgAeYLVbMoRM5VFKN6qfODnVk_B5qM-rDymLVGR4aR0RY1RwNvXXeBnLkJldpttrzdMpyZMOqZL8mI9RN_pqnVy4UDfpP9Qj4sUGOBflgakohNp1Y8WLMI7QhzBds Jul 23 21:26:28.153855 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:26:28.153855 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:26:28.153855 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:26:28.153855 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:26:28.153855 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:26:28.153855 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:26:28.153855 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 8305585b60d54beeb2b087a37260a89a Jul 23 21:26:28.153855 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1030577641 Jul 23 21:26:28.153855 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:26:28.153855 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:26:28.153855 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8305585b60d54beeb2b087a37260a89a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8305585b60d54beeb2b087a37260a89a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8305585b60d54beeb2b087a37260a89a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8305585b60d54beeb2b087a37260a89a"}]}] Jul 23 21:26:28.153855 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1030577641 Jul 23 21:26:28.153855 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 8305585b60d54beeb2b087a37260a89a Jul 23 21:26:28.153855 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1030577641 Jul 23 21:26:28.153855 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ImagesOneServerNegativeTestJSON-1030577641-project Jul 23 21:26:28.153855 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:26:28.153855 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:26:28.153855 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: e961e46ab94f4fffbc606485935ce64d Jul 23 21:26:28.153855 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1030577641-project Jul 23 21:26:28.153855 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:26:28.153855 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance 5429c0b0-c38d-424d-90ef-4a54df8e4cba could not be found. Jul 23 21:26:28.153855 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': '5429c0b0-c38d-424d-90ef-4a54df8e4cba'} Jul 23 21:26:28.153855 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:26:28.153855 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:26:28.153855 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:26:28.153855 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:26:28.153855 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:26:28.153855 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:26:28.153855 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:26:28.153855 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:26:28.153855 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:26:28.153855 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:26:28.153855 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5429c0b0-c38d-424d-90ef-4a54df8e4cba could not be found. Jul 23 21:26:28.153855 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:28.153855 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:26:28.153855 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:28.153855 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:26:28.153855 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:26:28.153855 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:26:28.153855 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:26:28.153855 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:26:28.153855 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:26:28.153855 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:26:28.153855 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:26:28.153855 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:26:28.153855 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:26:28.153855 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:26:28.153855 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:26:28.153855 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:26:28.153855 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5429c0b0-c38d-424d-90ef-4a54df8e4cba could not be found. Jul 23 21:26:28.153855 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:28.153855 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:26:28.158758 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:28.158758 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:26:28.158758 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:26:28.158758 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:26:28.158758 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:26:28.158758 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:26:28.158758 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5429c0b0-c38d-424d-90ef-4a54df8e4cba could not be found. Jul 23 21:26:28.158758 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:28.160723 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-131fba92-1284-482d-91e5-af2c4d897ca3 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Returning 404 to user: Instance 5429c0b0-c38d-424d-90ef-4a54df8e4cba could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:26:28.161942 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-131fba92-1284-482d-91e5-af2c4d897ca3 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] 10.222.0.17 "GET /compute/v2.1/servers/5429c0b0-c38d-424d-90ef-4a54df8e4cba" status: 404 len: 111 microversion: 2.1 time: 0.062092 Jul 23 21:26:28.162996 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1628/3186] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:28 2022] GET /compute/v2.1/servers/5429c0b0-c38d-424d-90ef-4a54df8e4cba => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:26:28.168045 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-aaf67ea6-ff60-400f-a76f-f1c06fe3b425 req-4f6fb13c-cc31-4f58-8088-8ec02b8f2b0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d303403b-5d14-443b-a6fe-f8b579d24cda", "name": "network-vif-unplugged", "status": "completed", "tag": "01c1a8f9-053f-41ab-abe7-cf16d3d4127c"}, {"server_uuid": "9a9ac364-9d41-4402-9312-9e363b68792d", "name": "network-vif-plugged", "status": "completed", "tag": "e651ec2b-2723-4c75-9de2-9bc8e0fbef28"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:26:28.179355 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-aaf67ea6-ff60-400f-a76f-f1c06fe3b425 req-4f6fb13c-cc31-4f58-8088-8ec02b8f2b0e service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:28.179833 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-aaf67ea6-ff60-400f-a76f-f1c06fe3b425 req-4f6fb13c-cc31-4f58-8088-8ec02b8f2b0e service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:28.197002 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-aaf67ea6-ff60-400f-a76f-f1c06fe3b425 req-4f6fb13c-cc31-4f58-8088-8ec02b8f2b0e service nova] Creating event network-vif-unplugged:01c1a8f9-053f-41ab-abe7-cf16d3d4127c for instance d303403b-5d14-443b-a6fe-f8b579d24cda on nch1-master-1 Jul 23 21:26:28.197526 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-aaf67ea6-ff60-400f-a76f-f1c06fe3b425 req-4f6fb13c-cc31-4f58-8088-8ec02b8f2b0e service nova] Creating event network-vif-plugged:e651ec2b-2723-4c75-9de2-9bc8e0fbef28 for instance 9a9ac364-9d41-4402-9312-9e363b68792d on nch2-master-1 Jul 23 21:26:28.209132 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-aaf67ea6-ff60-400f-a76f-f1c06fe3b425 req-4f6fb13c-cc31-4f58-8088-8ec02b8f2b0e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.044705 Jul 23 21:26:28.210030 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1629/3187] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:26:28 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:26:28.217459 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-97e12f51-80e3-4ce6-bd75-6ddaf949beb2 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Calling method '.version_select at 0x7f0b47dd8e50>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:28.249623 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-97e12f51-80e3-4ce6-bd75-6ddaf949beb2 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] HTTP exception thrown: Image not found. Jul 23 21:26:28.252097 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-97e12f51-80e3-4ce6-bd75-6ddaf949beb2 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Request method failure captured: Jul 23 21:26:28.252097 ncdv-master-1 devstack@n-api.service[131321]: request: DELETE /compute/v2.1/images/615de04a-cf34-4112-a033-e855280ef35c HTTP/1.1 Jul 23 21:26:28.252097 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:26:28.252097 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:26:28.252097 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:26:28.252097 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:26:28.252097 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:26:28.252097 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:26:28.252097 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:26:28.252097 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:26:28.252097 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GcdFkVYIK2DtJm403sM7IG79jHXbShtkQheCHNeqOWOy-LrSxvgAeYLVbMoRM5VFKN6qfODnVk_B5qM-rDymLVGR4aR0RY1RwNvXXeBnLkJldpttrzdMpyZMOqZL8mI9RN_pqnVy4UDfpP9Qj4sUGOBflgakohNp1Y8WLMI7QhzBds Jul 23 21:26:28.252097 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:26:28.252097 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:26:28.252097 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:26:28.252097 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:26:28.252097 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:26:28.252097 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:26:28.252097 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 8305585b60d54beeb2b087a37260a89a Jul 23 21:26:28.252097 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1030577641 Jul 23 21:26:28.252097 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:26:28.252097 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:26:28.252097 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8305585b60d54beeb2b087a37260a89a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8305585b60d54beeb2b087a37260a89a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8305585b60d54beeb2b087a37260a89a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8305585b60d54beeb2b087a37260a89a"}]}] Jul 23 21:26:28.252097 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1030577641 Jul 23 21:26:28.252097 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 8305585b60d54beeb2b087a37260a89a Jul 23 21:26:28.252097 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1030577641 Jul 23 21:26:28.252097 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ImagesOneServerNegativeTestJSON-1030577641-project Jul 23 21:26:28.252097 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:26:28.252097 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:26:28.252097 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: e961e46ab94f4fffbc606485935ce64d Jul 23 21:26:28.252097 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1030577641-project Jul 23 21:26:28.252097 ncdv-master-1 devstack@n-api.service[131321]: method: Jul 23 21:26:28.252097 ncdv-master-1 devstack@n-api.service[131321]: exception: Image not found. Jul 23 21:26:28.252097 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': '615de04a-cf34-4112-a033-e855280ef35c'} Jul 23 21:26:28.252097 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:26:28.252097 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:26:28.252097 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 23 21:26:28.252097 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 23 21:26:28.252097 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 23 21:26:28.252097 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 23 21:26:28.252097 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 23 21:26:28.252097 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 23 21:26:28.252097 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 23 21:26:28.252097 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 23 21:26:28.252097 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 23 21:26:28.252097 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 23 21:26:28.252097 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 23 21:26:28.252097 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 23 21:26:28.252097 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 23 21:26:28.252097 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 23 21:26:28.252097 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 615de04a-cf34-4112-a033-e855280ef35c to delete Jul 23 21:26:28.252097 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:28.252097 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:26:28.252097 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:28.252097 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:26:28.252097 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 23 21:26:28.252097 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 23 21:26:28.252097 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 23 21:26:28.252097 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 23 21:26:28.252097 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 23 21:26:28.252097 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 23 21:26:28.252097 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 615de04a-cf34-4112-a033-e855280ef35c could not be found. Jul 23 21:26:28.252097 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:28.252097 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:26:28.252097 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:28.256610 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:26:28.256610 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:26:28.256610 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:26:28.256610 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:26:28.256610 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:26:28.256610 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:26:28.256610 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:26:28.256610 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:26:28.256610 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:26:28.256610 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 23 21:26:28.256610 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 23 21:26:28.256610 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 23 21:26:28.256610 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:28.256610 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:26:28.256610 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:28.256610 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:26:28.256610 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:26:28.256610 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:26:28.256610 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:26:28.256610 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:26:28.256610 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 23 21:26:28.256610 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:28.259518 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-97e12f51-80e3-4ce6-bd75-6ddaf949beb2 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Returning 404 to user: Image not found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:26:28.260555 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-97e12f51-80e3-4ce6-bd75-6ddaf949beb2 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] 10.222.0.17 "DELETE /compute/v2.1/images/615de04a-cf34-4112-a033-e855280ef35c" status: 404 len: 62 microversion: 2.1 time: 0.048862 Jul 23 21:26:28.261307 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1630/3188] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:28 2022] DELETE /compute/v2.1/images/615de04a-cf34-4112-a033-e855280ef35c => generated 62 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 23 21:26:28.266457 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-376509c4-dd8b-427b-b85c-fa5db0935aef tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:28.267379 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-376509c4-dd8b-427b-b85c-fa5db0935aef tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:28.275825 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-376509c4-dd8b-427b-b85c-fa5db0935aef tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:28.276568 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-376509c4-dd8b-427b-b85c-fa5db0935aef tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:28.277626 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-376509c4-dd8b-427b-b85c-fa5db0935aef tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:28.278255 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-376509c4-dd8b-427b-b85c-fa5db0935aef tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:28.354617 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-376509c4-dd8b-427b-b85c-fa5db0935aef tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:28.366967 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-376509c4-dd8b-427b-b85c-fa5db0935aef tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:28.368676 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-376509c4-dd8b-427b-b85c-fa5db0935aef tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:28.370214 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-376509c4-dd8b-427b-b85c-fa5db0935aef tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.107594 Jul 23 21:26:28.371373 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1631/3189] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:26:28 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:26:28.376150 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-cc398104-a37b-40a7-9e3d-7bb213cdd4ec tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:28.377047 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-cc398104-a37b-40a7-9e3d-7bb213cdd4ec tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] [instance: 4085bec2-40ec-4324-b718-2c7ec388a22e] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:28.383877 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cc398104-a37b-40a7-9e3d-7bb213cdd4ec tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:28.384586 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cc398104-a37b-40a7-9e3d-7bb213cdd4ec tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:28.385379 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cc398104-a37b-40a7-9e3d-7bb213cdd4ec tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:28.386015 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cc398104-a37b-40a7-9e3d-7bb213cdd4ec tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:28.401398 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-cc398104-a37b-40a7-9e3d-7bb213cdd4ec tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] HTTP exception thrown: Instance 4085bec2-40ec-4324-b718-2c7ec388a22e could not be found. Jul 23 21:26:28.403027 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-cc398104-a37b-40a7-9e3d-7bb213cdd4ec tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Request method failure captured: Jul 23 21:26:28.403027 ncdv-master-1 devstack@n-api.service[131321]: request: DELETE /compute/v2.1/servers/4085bec2-40ec-4324-b718-2c7ec388a22e HTTP/1.1 Jul 23 21:26:28.403027 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:26:28.403027 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:26:28.403027 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:26:28.403027 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:26:28.403027 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:26:28.403027 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:26:28.403027 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:26:28.403027 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:26:28.403027 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GcdFkVYIK2DtJm403sM7IG79jHXbShtkQheCHNeqOWOy-LrSxvgAeYLVbMoRM5VFKN6qfODnVk_B5qM-rDymLVGR4aR0RY1RwNvXXeBnLkJldpttrzdMpyZMOqZL8mI9RN_pqnVy4UDfpP9Qj4sUGOBflgakohNp1Y8WLMI7QhzBds Jul 23 21:26:28.403027 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:26:28.403027 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:26:28.403027 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:26:28.403027 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:26:28.403027 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:26:28.403027 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:26:28.403027 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 8305585b60d54beeb2b087a37260a89a Jul 23 21:26:28.403027 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1030577641 Jul 23 21:26:28.403027 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:26:28.403027 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:26:28.403027 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8305585b60d54beeb2b087a37260a89a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8305585b60d54beeb2b087a37260a89a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8305585b60d54beeb2b087a37260a89a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8305585b60d54beeb2b087a37260a89a"}]}] Jul 23 21:26:28.403027 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1030577641 Jul 23 21:26:28.403027 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 8305585b60d54beeb2b087a37260a89a Jul 23 21:26:28.403027 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1030577641 Jul 23 21:26:28.403027 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ImagesOneServerNegativeTestJSON-1030577641-project Jul 23 21:26:28.403027 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:26:28.403027 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:26:28.403027 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: e961e46ab94f4fffbc606485935ce64d Jul 23 21:26:28.403027 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1030577641-project Jul 23 21:26:28.403027 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:26:28.403027 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance 4085bec2-40ec-4324-b718-2c7ec388a22e could not be found. Jul 23 21:26:28.403027 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': '4085bec2-40ec-4324-b718-2c7ec388a22e'} Jul 23 21:26:28.403027 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:26:28.403027 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:26:28.403027 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:26:28.403027 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:26:28.403027 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:26:28.403027 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:26:28.403027 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:26:28.403027 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:26:28.403027 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:26:28.403027 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:26:28.403027 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4085bec2-40ec-4324-b718-2c7ec388a22e could not be found. Jul 23 21:26:28.403027 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:28.403027 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:26:28.403027 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:28.403027 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:26:28.403027 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:26:28.403027 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:26:28.403027 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:26:28.403027 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:26:28.403027 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:26:28.403027 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:26:28.403027 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 23 21:26:28.403027 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 23 21:26:28.403027 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 23 21:26:28.403027 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 23 21:26:28.403027 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:26:28.403027 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:26:28.403027 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:26:28.403027 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:26:28.407175 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4085bec2-40ec-4324-b718-2c7ec388a22e could not be found. Jul 23 21:26:28.407175 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:28.407175 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:26:28.407175 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:28.407175 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:26:28.407175 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:26:28.407175 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:26:28.407175 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:26:28.407175 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:26:28.407175 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4085bec2-40ec-4324-b718-2c7ec388a22e could not be found. Jul 23 21:26:28.407175 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:28.407175 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-cc398104-a37b-40a7-9e3d-7bb213cdd4ec tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Returning 404 to user: Instance 4085bec2-40ec-4324-b718-2c7ec388a22e could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:26:28.407175 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-cc398104-a37b-40a7-9e3d-7bb213cdd4ec tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] 10.222.0.17 "DELETE /compute/v2.1/servers/4085bec2-40ec-4324-b718-2c7ec388a22e" status: 404 len: 111 microversion: 2.1 time: 0.032178 Jul 23 21:26:28.408504 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1632/3190] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:26:28 2022] DELETE /compute/v2.1/servers/4085bec2-40ec-4324-b718-2c7ec388a22e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:26:28.413855 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-0985981a-5b90-4ec6-8ec8-7f0b935dd5d4 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:28.414520 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-0985981a-5b90-4ec6-8ec8-7f0b935dd5d4 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] [instance: 4085bec2-40ec-4324-b718-2c7ec388a22e] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:28.421275 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0985981a-5b90-4ec6-8ec8-7f0b935dd5d4 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:28.421737 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0985981a-5b90-4ec6-8ec8-7f0b935dd5d4 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:28.422614 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0985981a-5b90-4ec6-8ec8-7f0b935dd5d4 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:28.423126 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0985981a-5b90-4ec6-8ec8-7f0b935dd5d4 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:28.438168 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-0985981a-5b90-4ec6-8ec8-7f0b935dd5d4 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] HTTP exception thrown: Instance 4085bec2-40ec-4324-b718-2c7ec388a22e could not be found. Jul 23 21:26:28.448181 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-0985981a-5b90-4ec6-8ec8-7f0b935dd5d4 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Request method failure captured: Jul 23 21:26:28.448181 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/servers/4085bec2-40ec-4324-b718-2c7ec388a22e HTTP/1.1 Jul 23 21:26:28.448181 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:26:28.448181 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:26:28.448181 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:26:28.448181 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:26:28.448181 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:26:28.448181 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:26:28.448181 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:26:28.448181 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:26:28.448181 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GcdFkVYIK2DtJm403sM7IG79jHXbShtkQheCHNeqOWOy-LrSxvgAeYLVbMoRM5VFKN6qfODnVk_B5qM-rDymLVGR4aR0RY1RwNvXXeBnLkJldpttrzdMpyZMOqZL8mI9RN_pqnVy4UDfpP9Qj4sUGOBflgakohNp1Y8WLMI7QhzBds Jul 23 21:26:28.448181 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:26:28.448181 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:26:28.448181 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:26:28.448181 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:26:28.448181 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:26:28.448181 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:26:28.448181 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 8305585b60d54beeb2b087a37260a89a Jul 23 21:26:28.448181 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1030577641 Jul 23 21:26:28.448181 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:26:28.448181 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:26:28.448181 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8305585b60d54beeb2b087a37260a89a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8305585b60d54beeb2b087a37260a89a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8305585b60d54beeb2b087a37260a89a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8305585b60d54beeb2b087a37260a89a"}]}] Jul 23 21:26:28.448181 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1030577641 Jul 23 21:26:28.448181 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 8305585b60d54beeb2b087a37260a89a Jul 23 21:26:28.448181 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1030577641 Jul 23 21:26:28.448181 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ImagesOneServerNegativeTestJSON-1030577641-project Jul 23 21:26:28.448181 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:26:28.448181 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:26:28.448181 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: e961e46ab94f4fffbc606485935ce64d Jul 23 21:26:28.448181 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1030577641-project Jul 23 21:26:28.448181 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:26:28.448181 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance 4085bec2-40ec-4324-b718-2c7ec388a22e could not be found. Jul 23 21:26:28.448181 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': '4085bec2-40ec-4324-b718-2c7ec388a22e'} Jul 23 21:26:28.448181 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:26:28.448181 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:26:28.448181 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:26:28.448181 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:26:28.448181 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:26:28.448181 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:26:28.448181 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:26:28.448181 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:26:28.448181 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:26:28.448181 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:26:28.448181 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4085bec2-40ec-4324-b718-2c7ec388a22e could not be found. Jul 23 21:26:28.448181 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:28.448181 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:26:28.448181 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:28.448181 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:26:28.448181 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:26:28.448181 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:26:28.448181 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:26:28.448181 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:26:28.448181 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:26:28.448181 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:26:28.448181 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:26:28.448181 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:26:28.448181 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:26:28.448181 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:26:28.448181 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:26:28.448181 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:26:28.448181 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4085bec2-40ec-4324-b718-2c7ec388a22e could not be found. Jul 23 21:26:28.448181 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:28.448181 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:26:28.452804 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:28.452804 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:26:28.452804 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:26:28.452804 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:26:28.452804 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:26:28.452804 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:26:28.452804 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4085bec2-40ec-4324-b718-2c7ec388a22e could not be found. Jul 23 21:26:28.452804 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:28.453387 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-0985981a-5b90-4ec6-8ec8-7f0b935dd5d4 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Returning 404 to user: Instance 4085bec2-40ec-4324-b718-2c7ec388a22e could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:26:28.454210 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-0985981a-5b90-4ec6-8ec8-7f0b935dd5d4 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] 10.222.0.17 "GET /compute/v2.1/servers/4085bec2-40ec-4324-b718-2c7ec388a22e" status: 404 len: 111 microversion: 2.1 time: 0.044382 Jul 23 21:26:28.458280 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1633/3191] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:28 2022] GET /compute/v2.1/servers/4085bec2-40ec-4324-b718-2c7ec388a22e => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:26:28.463433 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-839a8a7b-3aca-4850-9932-1abcd1ce5ccc tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:28.464143 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-839a8a7b-3aca-4850-9932-1abcd1ce5ccc tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: 9a9ac364-9d41-4402-9312-9e363b68792d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:28.471341 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-839a8a7b-3aca-4850-9932-1abcd1ce5ccc tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:28.471901 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-839a8a7b-3aca-4850-9932-1abcd1ce5ccc tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:28.472797 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-839a8a7b-3aca-4850-9932-1abcd1ce5ccc tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:28.473233 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-839a8a7b-3aca-4850-9932-1abcd1ce5ccc tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:28.632042 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-83b7b6ca-436e-43c7-89e8-4dcdc69f5b50 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:26:28.632560 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-83b7b6ca-436e-43c7-89e8-4dcdc69f5b50 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:26:28.633100 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-83b7b6ca-436e-43c7-89e8-4dcdc69f5b50 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:26:28.633569 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-83b7b6ca-436e-43c7-89e8-4dcdc69f5b50 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:26:28.634070 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-83b7b6ca-436e-43c7-89e8-4dcdc69f5b50 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:26:28.643954 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-83b7b6ca-436e-43c7-89e8-4dcdc69f5b50 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:28.644373 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-83b7b6ca-436e-43c7-89e8-4dcdc69f5b50 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:28.645237 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-83b7b6ca-436e-43c7-89e8-4dcdc69f5b50 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:28.645756 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-83b7b6ca-436e-43c7-89e8-4dcdc69f5b50 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:28.646933 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-839a8a7b-3aca-4850-9932-1abcd1ce5ccc tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:28.655079 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-839a8a7b-3aca-4850-9932-1abcd1ce5ccc tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/9a9ac364-9d41-4402-9312-9e363b68792d" status: 200 len: 1315 microversion: 2.1 time: 0.195660 Jul 23 21:26:28.655676 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1634/3192] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:28 2022] GET /compute/v2.1/servers/9a9ac364-9d41-4402-9312-9e363b68792d => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:28.660528 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d1bb1d48-710f-4b24-994d-6dfaa234ec14 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Calling method '.version_select at 0x7f0b47dd4670>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:28.667883 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-83b7b6ca-436e-43c7-89e8-4dcdc69f5b50 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Getting quotas for project 766b3be6b5fb4734bd9aeccbd35e3824. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:26:28.673741 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-83b7b6ca-436e-43c7-89e8-4dcdc69f5b50 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Getting quotas for user 38c74aa110064b4f85fef220e2d47b4f and project 766b3be6b5fb4734bd9aeccbd35e3824. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:26:28.681174 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-d1bb1d48-710f-4b24-994d-6dfaa234ec14 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-949857379" status: 202 len: 0 microversion: 2.1 time: 0.024221 Jul 23 21:26:28.684952 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1635/3193] 10.222.0.17 () {58 vars in 1217 bytes} [Sat Jul 23 21:26:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-949857379 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:26:28.688032 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-bb463dce-83f4-4c52-bf8f-32fdd4999020 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:28.689202 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-bb463dce-83f4-4c52-bf8f-32fdd4999020 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] [instance: cb3a66a8-4c84-4bb1-8b3f-0c48acec1215] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:28.691999 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-83b7b6ca-436e-43c7-89e8-4dcdc69f5b50 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Going to run 1 instances... {{(pid=131320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:26:28.694715 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-83b7b6ca-436e-43c7-89e8-4dcdc69f5b50 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] [instance: 7b41cb07-71ed-4403-8d4c-65be6a3c2f4b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:26:28.696974 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bb463dce-83f4-4c52-bf8f-32fdd4999020 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:28.698095 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bb463dce-83f4-4c52-bf8f-32fdd4999020 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:28.698550 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bb463dce-83f4-4c52-bf8f-32fdd4999020 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:28.699397 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bb463dce-83f4-4c52-bf8f-32fdd4999020 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:28.751169 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-83b7b6ca-436e-43c7-89e8-4dcdc69f5b50 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.074286 Jul 23 21:26:28.759708 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1559/3194] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:26:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1083 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 23 21:26:28.769251 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-af4dcee8-d6e6-45f6-b52c-5cd9944eb1b9 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:28.773481 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-af4dcee8-d6e6-45f6-b52c-5cd9944eb1b9 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] [instance: 7b41cb07-71ed-4403-8d4c-65be6a3c2f4b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:28.905256 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-af4dcee8-d6e6-45f6-b52c-5cd9944eb1b9 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c74aa110064b4f85fef220e2d47b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b3be6b5fb4734bd9aeccbd35e3824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:28.915414 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-af4dcee8-d6e6-45f6-b52c-5cd9944eb1b9 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] 10.222.0.17 "GET /compute/v2.1/servers/7b41cb07-71ed-4403-8d4c-65be6a3c2f4b" status: 200 len: 1224 microversion: 2.1 time: 0.149940 Jul 23 21:26:28.916339 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1560/3195] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:28 2022] GET /compute/v2.1/servers/7b41cb07-71ed-4403-8d4c-65be6a3c2f4b => generated 1224 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:26:28.922230 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ef0a0445-3b37-4477-af38-ae590e1eca9d tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:28.922847 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ef0a0445-3b37-4477-af38-ae590e1eca9d tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] [instance: 3de52df5-917b-4cdd-b2fa-a13453f03559] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:28.947414 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ef0a0445-3b37-4477-af38-ae590e1eca9d tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:28.947775 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ef0a0445-3b37-4477-af38-ae590e1eca9d tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:28.958854 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-bb463dce-83f4-4c52-bf8f-32fdd4999020 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a609c39c14343e1bc1edd4b3cd56dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116def61aba4631be91f67df63ebab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:28.964986 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ef0a0445-3b37-4477-af38-ae590e1eca9d tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:28.966746 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ef0a0445-3b37-4477-af38-ae590e1eca9d tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:28.968630 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-bb463dce-83f4-4c52-bf8f-32fdd4999020 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] 10.222.0.17 "GET /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215" status: 200 len: 1493 microversion: 2.1 time: 0.285247 Jul 23 21:26:28.978336 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1636/3196] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:28 2022] GET /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215 => generated 1493 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:29.115217 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-52a85844-4d73-4876-abf8-e9aaea9a63ea tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:29.116661 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-52a85844-4d73-4876-abf8-e9aaea9a63ea tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: d303403b-5d14-443b-a6fe-f8b579d24cda] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:29.130084 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-52a85844-4d73-4876-abf8-e9aaea9a63ea tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:29.139363 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-52a85844-4d73-4876-abf8-e9aaea9a63ea tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:29.140638 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-52a85844-4d73-4876-abf8-e9aaea9a63ea tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:29.141339 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-52a85844-4d73-4876-abf8-e9aaea9a63ea tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:29.237480 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ef0a0445-3b37-4477-af38-ae590e1eca9d tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0543f1a561a9442cbc9463ab752bd2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d306759c447edb6d013cf14ac53f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:29.247396 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ef0a0445-3b37-4477-af38-ae590e1eca9d tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] 10.222.0.17 "GET /compute/v2.1/servers/3de52df5-917b-4cdd-b2fa-a13453f03559" status: 200 len: 1506 microversion: 2.1 time: 0.329525 Jul 23 21:26:29.248004 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1561/3197] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:28 2022] GET /compute/v2.1/servers/3de52df5-917b-4cdd-b2fa-a13453f03559 => generated 1506 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:29.264351 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-efe3e9bf-d0a7-4a76-bc16-de1326e52fbe tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:29.265488 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-efe3e9bf-d0a7-4a76-bc16-de1326e52fbe tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] [instance: 61015c0f-77ab-4ba1-8d68-4979a9888f77] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:29.275702 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-efe3e9bf-d0a7-4a76-bc16-de1326e52fbe tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:29.276777 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-efe3e9bf-d0a7-4a76-bc16-de1326e52fbe tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:29.278827 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-efe3e9bf-d0a7-4a76-bc16-de1326e52fbe tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:29.279504 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-efe3e9bf-d0a7-4a76-bc16-de1326e52fbe tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:29.517235 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-efe3e9bf-d0a7-4a76-bc16-de1326e52fbe tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0543f1a561a9442cbc9463ab752bd2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d306759c447edb6d013cf14ac53f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:29.529714 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-efe3e9bf-d0a7-4a76-bc16-de1326e52fbe tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] 10.222.0.17 "GET /compute/v2.1/servers/61015c0f-77ab-4ba1-8d68-4979a9888f77" status: 200 len: 1506 microversion: 2.1 time: 0.269363 Jul 23 21:26:29.530947 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1562/3198] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:29 2022] GET /compute/v2.1/servers/61015c0f-77ab-4ba1-8d68-4979a9888f77 => generated 1506 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:26:29.558517 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6ae06734-1001-4382-b702-ad202d5554f5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:29.563258 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6ae06734-1001-4382-b702-ad202d5554f5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:29.587858 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6ae06734-1001-4382-b702-ad202d5554f5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:29.588712 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6ae06734-1001-4382-b702-ad202d5554f5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:29.590547 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6ae06734-1001-4382-b702-ad202d5554f5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:29.594165 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6ae06734-1001-4382-b702-ad202d5554f5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:29.749634 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6ae06734-1001-4382-b702-ad202d5554f5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:29.766261 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6ae06734-1001-4382-b702-ad202d5554f5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:29.768801 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6ae06734-1001-4382-b702-ad202d5554f5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:29.770289 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6ae06734-1001-4382-b702-ad202d5554f5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.237910 Jul 23 21:26:29.771106 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1563/3199] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:26:29 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:26:29.793806 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-90803f9a-4033-456e-a2a1-ac631869b02d tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:29.794730 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-90803f9a-4033-456e-a2a1-ac631869b02d tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] [instance: 61015c0f-77ab-4ba1-8d68-4979a9888f77] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:29.808680 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-90803f9a-4033-456e-a2a1-ac631869b02d tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:29.812471 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-90803f9a-4033-456e-a2a1-ac631869b02d tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:29.813892 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-90803f9a-4033-456e-a2a1-ac631869b02d tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:29.814393 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-90803f9a-4033-456e-a2a1-ac631869b02d tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:29.871387 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-90803f9a-4033-456e-a2a1-ac631869b02d tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] [instance: 61015c0f-77ab-4ba1-8d68-4979a9888f77] Going to try to terminate instance {{(pid=131320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:26:29.880495 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-52a85844-4d73-4876-abf8-e9aaea9a63ea tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:29.888627 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-52a85844-4d73-4876-abf8-e9aaea9a63ea tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda" status: 200 len: 1520 microversion: 2.1 time: 0.777333 Jul 23 21:26:29.909199 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1637/3200] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:29 2022] GET /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda => generated 1520 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:29.914880 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-7648d76d-a241-4f11-ab9e-26c0cb0293eb tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:29.915783 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-7648d76d-a241-4f11-ab9e-26c0cb0293eb tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: 9a9ac364-9d41-4402-9312-9e363b68792d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:29.920211 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:26:29.924734 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7648d76d-a241-4f11-ab9e-26c0cb0293eb tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:29.925560 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7648d76d-a241-4f11-ab9e-26c0cb0293eb tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:29.926325 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7648d76d-a241-4f11-ab9e-26c0cb0293eb tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:29.926830 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7648d76d-a241-4f11-ab9e-26c0cb0293eb tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:30.006232 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-90803f9a-4033-456e-a2a1-ac631869b02d tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] 10.222.0.17 "DELETE /compute/v2.1/servers/61015c0f-77ab-4ba1-8d68-4979a9888f77" status: 204 len: 0 microversion: 2.1 time: 0.224238 Jul 23 21:26:30.007508 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1564/3201] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:26:29 2022] DELETE /compute/v2.1/servers/61015c0f-77ab-4ba1-8d68-4979a9888f77 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:26:30.016091 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-20c603e7-cab9-4f65-bf19-335d0dbb56b9 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:30.016804 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-20c603e7-cab9-4f65-bf19-335d0dbb56b9 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] [instance: 7b41cb07-71ed-4403-8d4c-65be6a3c2f4b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:30.023178 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-20c603e7-cab9-4f65-bf19-335d0dbb56b9 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:30.023986 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-20c603e7-cab9-4f65-bf19-335d0dbb56b9 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:30.024840 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-20c603e7-cab9-4f65-bf19-335d0dbb56b9 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:30.025288 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-20c603e7-cab9-4f65-bf19-335d0dbb56b9 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:30.092016 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-20c603e7-cab9-4f65-bf19-335d0dbb56b9 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c74aa110064b4f85fef220e2d47b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b3be6b5fb4734bd9aeccbd35e3824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:30.104696 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-20c603e7-cab9-4f65-bf19-335d0dbb56b9 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] 10.222.0.17 "GET /compute/v2.1/servers/7b41cb07-71ed-4403-8d4c-65be6a3c2f4b" status: 200 len: 1276 microversion: 2.1 time: 0.092632 Jul 23 21:26:30.105320 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1565/3202] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:30 2022] GET /compute/v2.1/servers/7b41cb07-71ed-4403-8d4c-65be6a3c2f4b => generated 1276 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:30.109992 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-bb88f26e-1c64-4460-b8d1-42abd698a3af tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:30.114723 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-bb88f26e-1c64-4460-b8d1-42abd698a3af tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] [instance: cb3a66a8-4c84-4bb1-8b3f-0c48acec1215] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:30.121365 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bb88f26e-1c64-4460-b8d1-42abd698a3af tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:30.121822 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bb88f26e-1c64-4460-b8d1-42abd698a3af tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:30.122761 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bb88f26e-1c64-4460-b8d1-42abd698a3af tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:30.123137 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bb88f26e-1c64-4460-b8d1-42abd698a3af tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:30.165397 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-7648d76d-a241-4f11-ab9e-26c0cb0293eb tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:30.173585 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-7648d76d-a241-4f11-ab9e-26c0cb0293eb tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/9a9ac364-9d41-4402-9312-9e363b68792d" status: 200 len: 1503 microversion: 2.1 time: 0.262866 Jul 23 21:26:30.174365 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1638/3203] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:29 2022] GET /compute/v2.1/servers/9a9ac364-9d41-4402-9312-9e363b68792d => generated 1503 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:30.197855 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a844bc5c-56ab-423e-b583-f0bd590ae45d tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:30.198393 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-a844bc5c-56ab-423e-b583-f0bd590ae45d tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] [instance: 3de52df5-917b-4cdd-b2fa-a13453f03559] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:30.207239 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a844bc5c-56ab-423e-b583-f0bd590ae45d tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:30.207772 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a844bc5c-56ab-423e-b583-f0bd590ae45d tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:30.208806 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a844bc5c-56ab-423e-b583-f0bd590ae45d tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:30.210190 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a844bc5c-56ab-423e-b583-f0bd590ae45d tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:30.247765 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-a844bc5c-56ab-423e-b583-f0bd590ae45d tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] [instance: 3de52df5-917b-4cdd-b2fa-a13453f03559] Going to try to terminate instance {{(pid=131321) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:26:30.354787 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-bb88f26e-1c64-4460-b8d1-42abd698a3af tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a609c39c14343e1bc1edd4b3cd56dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116def61aba4631be91f67df63ebab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:30.360487 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-a844bc5c-56ab-423e-b583-f0bd590ae45d tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] 10.222.0.17 "DELETE /compute/v2.1/servers/3de52df5-917b-4cdd-b2fa-a13453f03559" status: 204 len: 0 microversion: 2.1 time: 0.184021 Jul 23 21:26:30.372235 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1639/3204] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:26:30 2022] DELETE /compute/v2.1/servers/3de52df5-917b-4cdd-b2fa-a13453f03559 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:26:30.372235 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-76344e73-1918-437a-82c8-dedc124ab2d3 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Calling method '.version_select at 0x7f0b5410d5e0>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:30.380316 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-bb88f26e-1c64-4460-b8d1-42abd698a3af tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] 10.222.0.17 "GET /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215" status: 200 len: 1499 microversion: 2.1 time: 0.273122 Jul 23 21:26:30.399073 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-76344e73-1918-437a-82c8-dedc124ab2d3 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] HTTP exception thrown: Image not found. Jul 23 21:26:30.399489 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1566/3205] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:30 2022] GET /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215 => generated 1499 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:30.399618 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-76344e73-1918-437a-82c8-dedc124ab2d3 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Request method failure captured: Jul 23 21:26:30.399618 ncdv-master-1 devstack@n-api.service[131321]: request: DELETE /compute/v2.1/images/d942e3c3-be75-4451-abba-ba6f877edc00 HTTP/1.1 Jul 23 21:26:30.399618 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:26:30.399618 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:26:30.399618 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:26:30.399618 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:26:30.399618 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:26:30.399618 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:26:30.399618 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:26:30.399618 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:26:30.399618 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GcdFkVYIK2DtJm403sM7IG79jHXbShtkQheCHNeqOWOy-LrSxvgAeYLVbMoRM5VFKN6qfODnVk_B5qM-rDymLVGR4aR0RY1RwNvXXeBnLkJldpttrzdMpyZMOqZL8mI9RN_pqnVy4UDfpP9Qj4sUGOBflgakohNp1Y8WLMI7QhzBds Jul 23 21:26:30.399618 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:26:30.399618 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:26:30.399618 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:26:30.399618 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:26:30.399618 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:26:30.399618 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:26:30.399618 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 8305585b60d54beeb2b087a37260a89a Jul 23 21:26:30.399618 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1030577641 Jul 23 21:26:30.399618 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:26:30.399618 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:26:30.399618 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8305585b60d54beeb2b087a37260a89a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8305585b60d54beeb2b087a37260a89a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8305585b60d54beeb2b087a37260a89a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8305585b60d54beeb2b087a37260a89a"}]}] Jul 23 21:26:30.399618 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1030577641 Jul 23 21:26:30.399618 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 8305585b60d54beeb2b087a37260a89a Jul 23 21:26:30.399618 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1030577641 Jul 23 21:26:30.399618 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ImagesOneServerNegativeTestJSON-1030577641-project Jul 23 21:26:30.399618 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:26:30.399618 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:26:30.399618 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: e961e46ab94f4fffbc606485935ce64d Jul 23 21:26:30.399618 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1030577641-project Jul 23 21:26:30.399618 ncdv-master-1 devstack@n-api.service[131321]: method: Jul 23 21:26:30.399618 ncdv-master-1 devstack@n-api.service[131321]: exception: Image not found. Jul 23 21:26:30.399618 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': 'd942e3c3-be75-4451-abba-ba6f877edc00'} Jul 23 21:26:30.399618 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:26:30.399618 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:26:30.399618 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 23 21:26:30.399618 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 23 21:26:30.399618 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 23 21:26:30.399618 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 23 21:26:30.399618 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 23 21:26:30.399618 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 23 21:26:30.399618 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 23 21:26:30.399618 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 23 21:26:30.399618 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 23 21:26:30.399618 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 23 21:26:30.399618 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 23 21:26:30.399618 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 23 21:26:30.399618 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 23 21:26:30.399618 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 23 21:26:30.399618 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image d942e3c3-be75-4451-abba-ba6f877edc00 to delete Jul 23 21:26:30.399618 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:30.399618 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:26:30.399618 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:30.399618 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:26:30.399618 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 23 21:26:30.399618 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 23 21:26:30.399618 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 23 21:26:30.399618 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 23 21:26:30.399618 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 23 21:26:30.399618 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 23 21:26:30.399618 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d942e3c3-be75-4451-abba-ba6f877edc00 could not be found. Jul 23 21:26:30.399618 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:30.399618 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:26:30.399618 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:30.407009 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:26:30.407009 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:26:30.407009 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:26:30.407009 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:26:30.407009 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:26:30.407009 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:26:30.407009 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:26:30.407009 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:26:30.407009 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:26:30.407009 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 23 21:26:30.407009 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 23 21:26:30.407009 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 23 21:26:30.407009 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:30.407009 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:26:30.407009 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:30.407009 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:26:30.407009 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:26:30.407009 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:26:30.407009 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:26:30.407009 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:26:30.407009 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 23 21:26:30.407009 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:30.407009 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-76344e73-1918-437a-82c8-dedc124ab2d3 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Returning 404 to user: Image not found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:26:30.407009 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-76344e73-1918-437a-82c8-dedc124ab2d3 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] 10.222.0.17 "DELETE /compute/v2.1/images/d942e3c3-be75-4451-abba-ba6f877edc00" status: 404 len: 62 microversion: 2.1 time: 0.033713 Jul 23 21:26:30.407009 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1640/3206] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:30 2022] DELETE /compute/v2.1/images/d942e3c3-be75-4451-abba-ba6f877edc00 => generated 62 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 23 21:26:30.409079 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6b513c76-bfa4-43b7-92d7-e67205801d10 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:30.409079 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6b513c76-bfa4-43b7-92d7-e67205801d10 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] [instance: cb3a66a8-4c84-4bb1-8b3f-0c48acec1215] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:30.411622 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a43a5342-4266-42a5-b611-ff3e5a54f1d1 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:30.411882 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6b513c76-bfa4-43b7-92d7-e67205801d10 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:30.412375 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6b513c76-bfa4-43b7-92d7-e67205801d10 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:30.412507 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-a43a5342-4266-42a5-b611-ff3e5a54f1d1 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] [instance: d73bae1c-be56-4a5e-8e8d-56683aae946a] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:30.413547 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6b513c76-bfa4-43b7-92d7-e67205801d10 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:30.413931 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6b513c76-bfa4-43b7-92d7-e67205801d10 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:30.421166 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a43a5342-4266-42a5-b611-ff3e5a54f1d1 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:30.422152 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a43a5342-4266-42a5-b611-ff3e5a54f1d1 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:30.423037 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a43a5342-4266-42a5-b611-ff3e5a54f1d1 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:30.423574 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a43a5342-4266-42a5-b611-ff3e5a54f1d1 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:30.440741 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-a43a5342-4266-42a5-b611-ff3e5a54f1d1 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] HTTP exception thrown: Instance d73bae1c-be56-4a5e-8e8d-56683aae946a could not be found. Jul 23 21:26:30.442046 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a43a5342-4266-42a5-b611-ff3e5a54f1d1 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Request method failure captured: Jul 23 21:26:30.442046 ncdv-master-1 devstack@n-api.service[131321]: request: DELETE /compute/v2.1/servers/d73bae1c-be56-4a5e-8e8d-56683aae946a HTTP/1.1 Jul 23 21:26:30.442046 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:26:30.442046 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:26:30.442046 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:26:30.442046 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:26:30.442046 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:26:30.442046 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:26:30.442046 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:26:30.442046 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:26:30.442046 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GcdFkVYIK2DtJm403sM7IG79jHXbShtkQheCHNeqOWOy-LrSxvgAeYLVbMoRM5VFKN6qfODnVk_B5qM-rDymLVGR4aR0RY1RwNvXXeBnLkJldpttrzdMpyZMOqZL8mI9RN_pqnVy4UDfpP9Qj4sUGOBflgakohNp1Y8WLMI7QhzBds Jul 23 21:26:30.442046 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:26:30.442046 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:26:30.442046 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:26:30.442046 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:26:30.442046 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:26:30.442046 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:26:30.442046 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 8305585b60d54beeb2b087a37260a89a Jul 23 21:26:30.442046 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1030577641 Jul 23 21:26:30.442046 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:26:30.442046 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:26:30.442046 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8305585b60d54beeb2b087a37260a89a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8305585b60d54beeb2b087a37260a89a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8305585b60d54beeb2b087a37260a89a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8305585b60d54beeb2b087a37260a89a"}]}] Jul 23 21:26:30.442046 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1030577641 Jul 23 21:26:30.442046 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 8305585b60d54beeb2b087a37260a89a Jul 23 21:26:30.442046 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1030577641 Jul 23 21:26:30.442046 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ImagesOneServerNegativeTestJSON-1030577641-project Jul 23 21:26:30.442046 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:26:30.442046 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:26:30.442046 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: e961e46ab94f4fffbc606485935ce64d Jul 23 21:26:30.442046 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1030577641-project Jul 23 21:26:30.442046 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:26:30.442046 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance d73bae1c-be56-4a5e-8e8d-56683aae946a could not be found. Jul 23 21:26:30.442046 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': 'd73bae1c-be56-4a5e-8e8d-56683aae946a'} Jul 23 21:26:30.442046 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:26:30.442046 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:26:30.442046 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:26:30.442046 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:26:30.442046 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:26:30.442046 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:26:30.442046 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:26:30.442046 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:26:30.442046 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:26:30.442046 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:26:30.442046 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d73bae1c-be56-4a5e-8e8d-56683aae946a could not be found. Jul 23 21:26:30.442046 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:30.442046 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:26:30.442046 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:30.442046 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:26:30.442046 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:26:30.442046 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:26:30.442046 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:26:30.442046 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:26:30.442046 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:26:30.442046 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:26:30.442046 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 23 21:26:30.442046 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 23 21:26:30.442046 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 23 21:26:30.442046 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 23 21:26:30.442046 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:26:30.442046 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:26:30.442046 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:26:30.442046 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:26:30.446913 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d73bae1c-be56-4a5e-8e8d-56683aae946a could not be found. Jul 23 21:26:30.446913 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:30.446913 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:26:30.446913 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:30.446913 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:26:30.446913 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:26:30.446913 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:26:30.446913 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:26:30.446913 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:26:30.446913 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d73bae1c-be56-4a5e-8e8d-56683aae946a could not be found. Jul 23 21:26:30.446913 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:30.446913 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a43a5342-4266-42a5-b611-ff3e5a54f1d1 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Returning 404 to user: Instance d73bae1c-be56-4a5e-8e8d-56683aae946a could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:26:30.446913 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-a43a5342-4266-42a5-b611-ff3e5a54f1d1 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d73bae1c-be56-4a5e-8e8d-56683aae946a" status: 404 len: 111 microversion: 2.1 time: 0.042889 Jul 23 21:26:30.448920 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1641/3207] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:26:30 2022] DELETE /compute/v2.1/servers/d73bae1c-be56-4a5e-8e8d-56683aae946a => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:26:30.457120 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-7c45c5ab-2020-490f-85d7-612863767c26 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:30.458015 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-7c45c5ab-2020-490f-85d7-612863767c26 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] [instance: d73bae1c-be56-4a5e-8e8d-56683aae946a] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:30.464280 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6b513c76-bfa4-43b7-92d7-e67205801d10 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] [instance: cb3a66a8-4c84-4bb1-8b3f-0c48acec1215] Going to try to terminate instance {{(pid=131320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:26:30.470202 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7c45c5ab-2020-490f-85d7-612863767c26 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:30.471990 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7c45c5ab-2020-490f-85d7-612863767c26 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:30.473368 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7c45c5ab-2020-490f-85d7-612863767c26 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:30.474085 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7c45c5ab-2020-490f-85d7-612863767c26 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:30.499617 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-7c45c5ab-2020-490f-85d7-612863767c26 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] HTTP exception thrown: Instance d73bae1c-be56-4a5e-8e8d-56683aae946a could not be found. Jul 23 21:26:30.501855 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-7c45c5ab-2020-490f-85d7-612863767c26 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Request method failure captured: Jul 23 21:26:30.501855 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/servers/d73bae1c-be56-4a5e-8e8d-56683aae946a HTTP/1.1 Jul 23 21:26:30.501855 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:26:30.501855 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:26:30.501855 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:26:30.501855 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:26:30.501855 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:26:30.501855 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:26:30.501855 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:26:30.501855 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:26:30.501855 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GcdFkVYIK2DtJm403sM7IG79jHXbShtkQheCHNeqOWOy-LrSxvgAeYLVbMoRM5VFKN6qfODnVk_B5qM-rDymLVGR4aR0RY1RwNvXXeBnLkJldpttrzdMpyZMOqZL8mI9RN_pqnVy4UDfpP9Qj4sUGOBflgakohNp1Y8WLMI7QhzBds Jul 23 21:26:30.501855 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:26:30.501855 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:26:30.501855 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:26:30.501855 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:26:30.501855 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:26:30.501855 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:26:30.501855 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 8305585b60d54beeb2b087a37260a89a Jul 23 21:26:30.501855 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1030577641 Jul 23 21:26:30.501855 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:26:30.501855 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:26:30.501855 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8305585b60d54beeb2b087a37260a89a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/8305585b60d54beeb2b087a37260a89a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_8305585b60d54beeb2b087a37260a89a", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/8305585b60d54beeb2b087a37260a89a"}]}] Jul 23 21:26:30.501855 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1030577641 Jul 23 21:26:30.501855 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 8305585b60d54beeb2b087a37260a89a Jul 23 21:26:30.501855 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1030577641 Jul 23 21:26:30.501855 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ImagesOneServerNegativeTestJSON-1030577641-project Jul 23 21:26:30.501855 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:26:30.501855 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:26:30.501855 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: e961e46ab94f4fffbc606485935ce64d Jul 23 21:26:30.501855 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1030577641-project Jul 23 21:26:30.501855 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:26:30.501855 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance d73bae1c-be56-4a5e-8e8d-56683aae946a could not be found. Jul 23 21:26:30.501855 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': 'd73bae1c-be56-4a5e-8e8d-56683aae946a'} Jul 23 21:26:30.501855 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:26:30.501855 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:26:30.501855 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:26:30.501855 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:26:30.501855 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:26:30.501855 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:26:30.501855 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:26:30.501855 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:26:30.501855 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:26:30.501855 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:26:30.501855 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d73bae1c-be56-4a5e-8e8d-56683aae946a could not be found. Jul 23 21:26:30.501855 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:30.501855 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:26:30.501855 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:30.501855 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:26:30.501855 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:26:30.501855 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:26:30.501855 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:26:30.501855 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:26:30.501855 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:26:30.501855 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:26:30.501855 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:26:30.501855 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:26:30.501855 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:26:30.501855 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:26:30.501855 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:26:30.501855 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:26:30.501855 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d73bae1c-be56-4a5e-8e8d-56683aae946a could not be found. Jul 23 21:26:30.501855 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:30.501855 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:26:30.505843 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:30.505843 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:26:30.505843 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:26:30.505843 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:26:30.505843 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:26:30.505843 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:26:30.505843 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d73bae1c-be56-4a5e-8e8d-56683aae946a could not be found. Jul 23 21:26:30.505843 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:30.505843 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-7c45c5ab-2020-490f-85d7-612863767c26 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] Returning 404 to user: Instance d73bae1c-be56-4a5e-8e8d-56683aae946a could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:26:30.505843 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-7c45c5ab-2020-490f-85d7-612863767c26 tempest-ImagesOneServerNegativeTestJSON-1030577641 tempest-ImagesOneServerNegativeTestJSON-1030577641-project] 10.222.0.17 "GET /compute/v2.1/servers/d73bae1c-be56-4a5e-8e8d-56683aae946a" status: 404 len: 111 microversion: 2.1 time: 0.051423 Jul 23 21:26:30.505843 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1642/3208] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:30 2022] GET /compute/v2.1/servers/d73bae1c-be56-4a5e-8e8d-56683aae946a => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 23 21:26:30.560947 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e0960b4e-4ae6-4b14-b5af-9887090a4e15 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-754167084", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "8997f53e-bd9a-440c-bfc5-766dd9f7d191"}]}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:26:30.561618 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:26:30.633014 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.network.neutron [None req-e0960b4e-4ae6-4b14-b5af-9887090a4e15 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] validate_networks() for [('8997f53e-bd9a-440c-bfc5-766dd9f7d191', None, None, None, None, None)] {{(pid=131321) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:26:30.647553 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6b513c76-bfa4-43b7-92d7-e67205801d10 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] 10.222.0.17 "DELETE /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215" status: 204 len: 0 microversion: 2.1 time: 0.249007 Jul 23 21:26:30.648176 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1567/3209] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:26:30 2022] DELETE /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 23 21:26:30.657256 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-14454d25-0e0e-4610-91cb-557089ff6a42 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:30.658071 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-14454d25-0e0e-4610-91cb-557089ff6a42 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] [instance: cb3a66a8-4c84-4bb1-8b3f-0c48acec1215] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:30.672442 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-14454d25-0e0e-4610-91cb-557089ff6a42 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:30.673023 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-14454d25-0e0e-4610-91cb-557089ff6a42 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:30.680935 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-14454d25-0e0e-4610-91cb-557089ff6a42 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:30.681470 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-14454d25-0e0e-4610-91cb-557089ff6a42 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:30.987018 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-14454d25-0e0e-4610-91cb-557089ff6a42 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a609c39c14343e1bc1edd4b3cd56dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116def61aba4631be91f67df63ebab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:30.995433 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-14454d25-0e0e-4610-91cb-557089ff6a42 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] 10.222.0.17 "GET /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215" status: 200 len: 1505 microversion: 2.1 time: 0.342871 Jul 23 21:26:31.001014 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1568/3210] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:30 2022] GET /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215 => generated 1505 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:31.011702 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e0091e39-e962-4d06-adbc-90745e929d77 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:31.013282 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e0091e39-e962-4d06-adbc-90745e929d77 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:31.025463 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e0091e39-e962-4d06-adbc-90745e929d77 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:31.026176 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e0091e39-e962-4d06-adbc-90745e929d77 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:31.027297 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e0091e39-e962-4d06-adbc-90745e929d77 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:31.027885 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e0091e39-e962-4d06-adbc-90745e929d77 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:31.133660 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e0091e39-e962-4d06-adbc-90745e929d77 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:31.147791 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e0091e39-e962-4d06-adbc-90745e929d77 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:31.155987 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e0091e39-e962-4d06-adbc-90745e929d77 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:31.157238 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e0091e39-e962-4d06-adbc-90745e929d77 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.155175 Jul 23 21:26:31.158212 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1569/3211] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:26:31 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:26:31.165623 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-caf52d23-75df-452a-a323-c6998b839f47 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:31.166275 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-caf52d23-75df-452a-a323-c6998b839f47 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: d303403b-5d14-443b-a6fe-f8b579d24cda] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:31.179133 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-caf52d23-75df-452a-a323-c6998b839f47 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:31.179896 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-caf52d23-75df-452a-a323-c6998b839f47 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:31.180833 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-caf52d23-75df-452a-a323-c6998b839f47 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:31.181426 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-caf52d23-75df-452a-a323-c6998b839f47 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:31.184434 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-e0960b4e-4ae6-4b14-b5af-9887090a4e15 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Flavor limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:26:31.184943 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-e0960b4e-4ae6-4b14-b5af-9887090a4e15 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Image limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:26:31.185599 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-e0960b4e-4ae6-4b14-b5af-9887090a4e15 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Flavor pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:26:31.186170 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-e0960b4e-4ae6-4b14-b5af-9887090a4e15 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Image pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:26:31.186803 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-e0960b4e-4ae6-4b14-b5af-9887090a4e15 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:26:31.223195 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e0960b4e-4ae6-4b14-b5af-9887090a4e15 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:31.223894 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e0960b4e-4ae6-4b14-b5af-9887090a4e15 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:31.224842 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e0960b4e-4ae6-4b14-b5af-9887090a4e15 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:31.227761 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e0960b4e-4ae6-4b14-b5af-9887090a4e15 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:31.272796 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-e0960b4e-4ae6-4b14-b5af-9887090a4e15 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Getting quotas for project 4d8d306759c447edb6d013cf14ac53f9. Resources: {'ram', 'instances', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:26:31.286483 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-e0960b4e-4ae6-4b14-b5af-9887090a4e15 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Getting quotas for user 0543f1a561a9442cbc9463ab752bd2aa and project 4d8d306759c447edb6d013cf14ac53f9. Resources: {'ram', 'instances', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:26:31.318593 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-e0960b4e-4ae6-4b14-b5af-9887090a4e15 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Going to run 2 instances... {{(pid=131321) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:26:31.322197 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-e0960b4e-4ae6-4b14-b5af-9887090a4e15 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] [instance: 14bdd0f5-f5bf-44bb-876f-2d257eae5fb0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131321) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:26:31.375052 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-e0960b4e-4ae6-4b14-b5af-9887090a4e15 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] [instance: 163182e4-bfa7-4da7-9267-9cbb8a911183] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=14bdd0f5-f5bf-44bb-876f-2d257eae5fb0,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131321) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:26:31.452640 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-caf52d23-75df-452a-a323-c6998b839f47 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:31.461537 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-caf52d23-75df-452a-a323-c6998b839f47 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda" status: 200 len: 1520 microversion: 2.1 time: 0.302018 Jul 23 21:26:31.463209 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-e0960b4e-4ae6-4b14-b5af-9887090a4e15 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 0.908443 Jul 23 21:26:31.466884 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1570/3212] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:31 2022] GET /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda => generated 1520 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:31.467433 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1643/3213] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:26:30 2022] POST /compute/v2.1/servers => generated 32 bytes in 914 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jul 23 21:26:31.481789 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-dc82cca1-492f-42cf-b0ad-574fdcc50948 req-c4a6291e-18b0-42a7-9fe8-d9b17c20503d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d303403b-5d14-443b-a6fe-f8b579d24cda", "name": "network-vif-plugged", "status": "completed", "tag": "01c1a8f9-053f-41ab-abe7-cf16d3d4127c"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:26:31.486824 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-876dc14f-f4ef-4ed2-8b5a-a5c10366f0ee tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:31.487443 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-876dc14f-f4ef-4ed2-8b5a-a5c10366f0ee tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] [instance: 7b41cb07-71ed-4403-8d4c-65be6a3c2f4b] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:31.493803 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-dc82cca1-492f-42cf-b0ad-574fdcc50948 req-c4a6291e-18b0-42a7-9fe8-d9b17c20503d service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:31.494619 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-dc82cca1-492f-42cf-b0ad-574fdcc50948 req-c4a6291e-18b0-42a7-9fe8-d9b17c20503d service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:31.528177 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-dc82cca1-492f-42cf-b0ad-574fdcc50948 req-c4a6291e-18b0-42a7-9fe8-d9b17c20503d service nova] Creating event network-vif-plugged:01c1a8f9-053f-41ab-abe7-cf16d3d4127c for instance d303403b-5d14-443b-a6fe-f8b579d24cda on nch1-master-1 Jul 23 21:26:31.539271 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-dc82cca1-492f-42cf-b0ad-574fdcc50948 req-c4a6291e-18b0-42a7-9fe8-d9b17c20503d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070881 Jul 23 21:26:31.539870 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-876dc14f-f4ef-4ed2-8b5a-a5c10366f0ee tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:31.544570 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1571/3214] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:26:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:26:31.545330 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-876dc14f-f4ef-4ed2-8b5a-a5c10366f0ee tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:31.548367 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-876dc14f-f4ef-4ed2-8b5a-a5c10366f0ee tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:31.548881 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-876dc14f-f4ef-4ed2-8b5a-a5c10366f0ee tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:31.550884 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ffb9e21b-189e-425f-974f-bba2d0fb6b08 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:31.557395 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ffb9e21b-189e-425f-974f-bba2d0fb6b08 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0543f1a561a9442cbc9463ab752bd2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d306759c447edb6d013cf14ac53f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:31.558416 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ffb9e21b-189e-425f-974f-bba2d0fb6b08 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Searching by: {'deleted': False, 'project_id': '4d8d306759c447edb6d013cf14ac53f9'} {{(pid=131320) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 23 21:26:31.579194 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ffb9e21b-189e-425f-974f-bba2d0fb6b08 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:31.580649 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ffb9e21b-189e-425f-974f-bba2d0fb6b08 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:31.581762 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ffb9e21b-189e-425f-974f-bba2d0fb6b08 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:31.582327 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ffb9e21b-189e-425f-974f-bba2d0fb6b08 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:31.634749 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.multi_cell_list [None req-ffb9e21b-189e-425f-974f-bba2d0fb6b08 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=131320) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 23 21:26:31.669207 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ffb9e21b-189e-425f-974f-bba2d0fb6b08 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] 10.222.0.17 "GET /compute/v2.1/servers" status: 200 len: 1331 microversion: 2.1 time: 0.122729 Jul 23 21:26:31.679783 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1572/3215] 10.222.0.17 () {58 vars in 1124 bytes} [Sat Jul 23 21:26:31 2022] GET /compute/v2.1/servers => generated 1331 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:31.690967 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e85139ec-89c2-4ee7-aa75-0a39581132ad tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:31.693869 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e85139ec-89c2-4ee7-aa75-0a39581132ad tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] [instance: 163182e4-bfa7-4da7-9267-9cbb8a911183] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:31.751850 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-876dc14f-f4ef-4ed2-8b5a-a5c10366f0ee tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c74aa110064b4f85fef220e2d47b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b3be6b5fb4734bd9aeccbd35e3824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:31.762596 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-876dc14f-f4ef-4ed2-8b5a-a5c10366f0ee tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] 10.222.0.17 "GET /compute/v2.1/servers/7b41cb07-71ed-4403-8d4c-65be6a3c2f4b" status: 200 len: 1294 microversion: 2.1 time: 0.279050 Jul 23 21:26:31.763749 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1644/3216] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:31 2022] GET /compute/v2.1/servers/7b41cb07-71ed-4403-8d4c-65be6a3c2f4b => generated 1294 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:31.951851 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-55f57a54-8b1b-445d-b9c4-b26dd4f8166b tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1377104708", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "networks": [{"uuid": "c89c9ae3-a9c7-4e98-860d-e9f8ea64bbcb"}]}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:26:32.043539 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.network.neutron [None req-55f57a54-8b1b-445d-b9c4-b26dd4f8166b tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] validate_networks() for [('c89c9ae3-a9c7-4e98-860d-e9f8ea64bbcb', None, None, None, None, None)] {{(pid=131321) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:26:32.161399 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e85139ec-89c2-4ee7-aa75-0a39581132ad tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0543f1a561a9442cbc9463ab752bd2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d306759c447edb6d013cf14ac53f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:32.171153 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e85139ec-89c2-4ee7-aa75-0a39581132ad tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] 10.222.0.17 "GET /compute/v2.1/servers/163182e4-bfa7-4da7-9267-9cbb8a911183" status: 200 len: 1217 microversion: 2.1 time: 0.489618 Jul 23 21:26:32.171849 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1573/3217] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:31 2022] GET /compute/v2.1/servers/163182e4-bfa7-4da7-9267-9cbb8a911183 => generated 1217 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:32.184539 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-174cb10b-abc6-414a-b846-12a75ba9410f tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:32.185315 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-174cb10b-abc6-414a-b846-12a75ba9410f tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] [instance: cb3a66a8-4c84-4bb1-8b3f-0c48acec1215] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:32.193912 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-174cb10b-abc6-414a-b846-12a75ba9410f tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:32.200508 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-174cb10b-abc6-414a-b846-12a75ba9410f tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:32.201358 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-174cb10b-abc6-414a-b846-12a75ba9410f tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:32.201802 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-174cb10b-abc6-414a-b846-12a75ba9410f tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:32.686610 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-55f57a54-8b1b-445d-b9c4-b26dd4f8166b tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Flavor limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:26:32.687580 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-55f57a54-8b1b-445d-b9c4-b26dd4f8166b tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Image limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:26:32.688395 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-55f57a54-8b1b-445d-b9c4-b26dd4f8166b tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Flavor pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:26:32.689316 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-55f57a54-8b1b-445d-b9c4-b26dd4f8166b tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Image pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:26:32.690293 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-55f57a54-8b1b-445d-b9c4-b26dd4f8166b tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:26:32.701827 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-55f57a54-8b1b-445d-b9c4-b26dd4f8166b tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:32.702462 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-55f57a54-8b1b-445d-b9c4-b26dd4f8166b tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:32.703276 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-55f57a54-8b1b-445d-b9c4-b26dd4f8166b tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:32.703729 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-55f57a54-8b1b-445d-b9c4-b26dd4f8166b tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:32.722405 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-55f57a54-8b1b-445d-b9c4-b26dd4f8166b tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Getting quotas for project a892bfe56afd4ee5bb6c47e926af7349. Resources: {'ram', 'instances', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:26:32.728454 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-55f57a54-8b1b-445d-b9c4-b26dd4f8166b tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Getting quotas for user affc3572ef7d45249f50b5061a681d18 and project a892bfe56afd4ee5bb6c47e926af7349. Resources: {'ram', 'instances', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:26:32.743710 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-55f57a54-8b1b-445d-b9c4-b26dd4f8166b tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Going to run 1 instances... {{(pid=131321) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:26:32.746840 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-55f57a54-8b1b-445d-b9c4-b26dd4f8166b tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: 97d0845c-e69a-4dac-a900-ebbc2d1ed81c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131321) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:26:32.828430 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-55f57a54-8b1b-445d-b9c4-b26dd4f8166b tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.880351 Jul 23 21:26:32.830970 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1645/3218] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:26:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 884 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 23 21:26:32.881296 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-dcc56d1a-3e60-4021-8a27-9063e73e0b64 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:32.882645 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-dcc56d1a-3e60-4021-8a27-9063e73e0b64 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:32.924688 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-dcc56d1a-3e60-4021-8a27-9063e73e0b64 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:32.925408 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-dcc56d1a-3e60-4021-8a27-9063e73e0b64 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:32.927056 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-dcc56d1a-3e60-4021-8a27-9063e73e0b64 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:32.928757 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-dcc56d1a-3e60-4021-8a27-9063e73e0b64 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:33.063255 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-174cb10b-abc6-414a-b846-12a75ba9410f tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a609c39c14343e1bc1edd4b3cd56dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116def61aba4631be91f67df63ebab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:33.071617 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-174cb10b-abc6-414a-b846-12a75ba9410f tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] 10.222.0.17 "GET /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215" status: 200 len: 1505 microversion: 2.1 time: 0.898587 Jul 23 21:26:33.072505 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-dcc56d1a-3e60-4021-8a27-9063e73e0b64 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:33.085205 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-dcc56d1a-3e60-4021-8a27-9063e73e0b64 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:33.088421 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-dcc56d1a-3e60-4021-8a27-9063e73e0b64 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:33.088927 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1574/3219] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:32 2022] GET /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215 => generated 1505 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:33.091142 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-dcc56d1a-3e60-4021-8a27-9063e73e0b64 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.258897 Jul 23 21:26:33.094731 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1646/3220] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:26:32 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:26:33.094955 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-83416bd1-04e0-4f56-b509-c6e5cbd4587f tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:33.095644 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-83416bd1-04e0-4f56-b509-c6e5cbd4587f tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: d303403b-5d14-443b-a6fe-f8b579d24cda] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:33.102191 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-bf2373c2-e46e-4d4a-a4c7-a72d4745800e tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:33.102840 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-bf2373c2-e46e-4d4a-a4c7-a72d4745800e tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] [instance: 7b41cb07-71ed-4403-8d4c-65be6a3c2f4b] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:33.115050 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-83416bd1-04e0-4f56-b509-c6e5cbd4587f tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:33.116042 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bf2373c2-e46e-4d4a-a4c7-a72d4745800e tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:33.116245 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-83416bd1-04e0-4f56-b509-c6e5cbd4587f tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:33.116959 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bf2373c2-e46e-4d4a-a4c7-a72d4745800e tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:33.117089 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-83416bd1-04e0-4f56-b509-c6e5cbd4587f tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:33.117658 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-83416bd1-04e0-4f56-b509-c6e5cbd4587f tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:33.118616 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bf2373c2-e46e-4d4a-a4c7-a72d4745800e tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:33.119254 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bf2373c2-e46e-4d4a-a4c7-a72d4745800e tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:33.213702 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-bf2373c2-e46e-4d4a-a4c7-a72d4745800e tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c74aa110064b4f85fef220e2d47b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b3be6b5fb4734bd9aeccbd35e3824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:33.216287 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:26:33.232646 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-bf2373c2-e46e-4d4a-a4c7-a72d4745800e tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] 10.222.0.17 "GET /compute/v2.1/servers/7b41cb07-71ed-4403-8d4c-65be6a3c2f4b" status: 200 len: 1282 microversion: 2.1 time: 0.136493 Jul 23 21:26:33.233773 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1647/3221] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:33 2022] GET /compute/v2.1/servers/7b41cb07-71ed-4403-8d4c-65be6a3c2f4b => generated 1282 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:33.258139 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-1081f1bc-b05a-484b-9bfd-e04efc43ffde tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:33.259016 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-1081f1bc-b05a-484b-9bfd-e04efc43ffde tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: 97d0845c-e69a-4dac-a900-ebbc2d1ed81c] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:33.328429 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-1081f1bc-b05a-484b-9bfd-e04efc43ffde tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:33.339646 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-1081f1bc-b05a-484b-9bfd-e04efc43ffde tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/97d0845c-e69a-4dac-a900-ebbc2d1ed81c" status: 200 len: 1215 microversion: 2.1 time: 0.097474 Jul 23 21:26:33.341696 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1648/3222] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:33 2022] GET /compute/v2.1/servers/97d0845c-e69a-4dac-a900-ebbc2d1ed81c => generated 1215 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:33.348028 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a75e5bb8-04f9-4175-85e9-a0b0f4c7dcea tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:33.348911 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-a75e5bb8-04f9-4175-85e9-a0b0f4c7dcea tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] [instance: 163182e4-bfa7-4da7-9267-9cbb8a911183] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:33.362123 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a75e5bb8-04f9-4175-85e9-a0b0f4c7dcea tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:33.362937 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a75e5bb8-04f9-4175-85e9-a0b0f4c7dcea tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:33.364252 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a75e5bb8-04f9-4175-85e9-a0b0f4c7dcea tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:33.364956 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a75e5bb8-04f9-4175-85e9-a0b0f4c7dcea tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:33.451415 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-a75e5bb8-04f9-4175-85e9-a0b0f4c7dcea tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0543f1a561a9442cbc9463ab752bd2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d306759c447edb6d013cf14ac53f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:33.459688 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-a75e5bb8-04f9-4175-85e9-a0b0f4c7dcea tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] 10.222.0.17 "GET /compute/v2.1/servers/163182e4-bfa7-4da7-9267-9cbb8a911183" status: 200 len: 1221 microversion: 2.1 time: 0.116333 Jul 23 21:26:33.470408 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1649/3223] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:33 2022] GET /compute/v2.1/servers/163182e4-bfa7-4da7-9267-9cbb8a911183 => generated 1221 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:33.477396 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-5724ffe2-2c18-4f49-8994-7b1569fa96ca tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:33.478328 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-5724ffe2-2c18-4f49-8994-7b1569fa96ca tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: 97d0845c-e69a-4dac-a900-ebbc2d1ed81c] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:33.497746 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-5724ffe2-2c18-4f49-8994-7b1569fa96ca tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: 97d0845c-e69a-4dac-a900-ebbc2d1ed81c] Going to try to terminate instance {{(pid=131321) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:26:33.531806 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5724ffe2-2c18-4f49-8994-7b1569fa96ca tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:33.532264 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5724ffe2-2c18-4f49-8994-7b1569fa96ca tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:33.549695 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.objects.instance [None req-5724ffe2-2c18-4f49-8994-7b1569fa96ca tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lazy-loading 'flavor' on Instance uuid 97d0845c-e69a-4dac-a900-ebbc2d1ed81c {{(pid=131321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:26:33.563908 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.objects.instance [None req-5724ffe2-2c18-4f49-8994-7b1569fa96ca tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lazy-loading 'system_metadata' on Instance uuid 97d0845c-e69a-4dac-a900-ebbc2d1ed81c {{(pid=131321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:26:33.627236 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.objects.instance [None req-5724ffe2-2c18-4f49-8994-7b1569fa96ca tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lazy-loading 'metadata' on Instance uuid 97d0845c-e69a-4dac-a900-ebbc2d1ed81c {{(pid=131321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:26:33.695352 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-83416bd1-04e0-4f56-b509-c6e5cbd4587f tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:33.711782 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-83416bd1-04e0-4f56-b509-c6e5cbd4587f tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda" status: 200 len: 1520 microversion: 2.1 time: 0.621533 Jul 23 21:26:33.712390 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1575/3224] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:33 2022] GET /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda => generated 1520 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:33.716997 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-348afab8-f3a1-4a1a-9e33-c77f8fe7c96a req-d97af25f-5770-4bf7-a896-caefe163a428 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61015c0f-77ab-4ba1-8d68-4979a9888f77", "name": "network-vif-deleted", "tag": "7abdd709-2641-49e2-98a0-d1314fd12958"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:26:33.743528 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-348afab8-f3a1-4a1a-9e33-c77f8fe7c96a req-d97af25f-5770-4bf7-a896-caefe163a428 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:33.744324 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-348afab8-f3a1-4a1a-9e33-c77f8fe7c96a req-d97af25f-5770-4bf7-a896-caefe163a428 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:33.766989 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-348afab8-f3a1-4a1a-9e33-c77f8fe7c96a req-d97af25f-5770-4bf7-a896-caefe163a428 service nova] Creating event network-vif-deleted:7abdd709-2641-49e2-98a0-d1314fd12958 for instance 61015c0f-77ab-4ba1-8d68-4979a9888f77 on nch2-master-1 Jul 23 21:26:33.774229 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-348afab8-f3a1-4a1a-9e33-c77f8fe7c96a req-d97af25f-5770-4bf7-a896-caefe163a428 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060439 Jul 23 21:26:33.774858 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1576/3225] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:26:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:26:34.090279 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.scheduler.client.report [None req-5724ffe2-2c18-4f49-8994-7b1569fa96ca tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Deleted allocations for instance 97d0845c-e69a-4dac-a900-ebbc2d1ed81c Jul 23 21:26:34.096993 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e21474a2-b729-4297-ad63-c32677cdcd72 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:34.097521 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e21474a2-b729-4297-ad63-c32677cdcd72 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] [instance: cb3a66a8-4c84-4bb1-8b3f-0c48acec1215] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:34.107914 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e21474a2-b729-4297-ad63-c32677cdcd72 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:34.108799 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e21474a2-b729-4297-ad63-c32677cdcd72 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:34.111987 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e21474a2-b729-4297-ad63-c32677cdcd72 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:34.112448 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e21474a2-b729-4297-ad63-c32677cdcd72 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:34.131632 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-5724ffe2-2c18-4f49-8994-7b1569fa96ca tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "DELETE /compute/v2.1/servers/97d0845c-e69a-4dac-a900-ebbc2d1ed81c" status: 204 len: 0 microversion: 2.1 time: 0.659210 Jul 23 21:26:34.132884 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1650/3226] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:26:33 2022] DELETE /compute/v2.1/servers/97d0845c-e69a-4dac-a900-ebbc2d1ed81c => generated 0 bytes in 661 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:26:34.139631 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-6a0fc74b-8cbe-4b8d-8797-6cfed16cfbda tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:34.140399 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-6a0fc74b-8cbe-4b8d-8797-6cfed16cfbda tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:34.153260 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6a0fc74b-8cbe-4b8d-8797-6cfed16cfbda tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:34.153783 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6a0fc74b-8cbe-4b8d-8797-6cfed16cfbda tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:34.154837 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6a0fc74b-8cbe-4b8d-8797-6cfed16cfbda tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:34.155396 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6a0fc74b-8cbe-4b8d-8797-6cfed16cfbda tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:34.237112 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-6a0fc74b-8cbe-4b8d-8797-6cfed16cfbda tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:34.252240 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-6a0fc74b-8cbe-4b8d-8797-6cfed16cfbda tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:34.254207 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-6a0fc74b-8cbe-4b8d-8797-6cfed16cfbda tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:34.255575 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-6a0fc74b-8cbe-4b8d-8797-6cfed16cfbda tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.121382 Jul 23 21:26:34.257178 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1651/3227] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:26:34 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:26:34.263822 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-7eb7f251-4798-4054-aade-2fff0711bc93 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:34.264460 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-7eb7f251-4798-4054-aade-2fff0711bc93 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: 97d0845c-e69a-4dac-a900-ebbc2d1ed81c] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:34.279484 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7eb7f251-4798-4054-aade-2fff0711bc93 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:34.279967 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7eb7f251-4798-4054-aade-2fff0711bc93 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:34.280845 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7eb7f251-4798-4054-aade-2fff0711bc93 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:34.281512 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7eb7f251-4798-4054-aade-2fff0711bc93 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:34.300319 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-7eb7f251-4798-4054-aade-2fff0711bc93 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] HTTP exception thrown: Instance 97d0845c-e69a-4dac-a900-ebbc2d1ed81c could not be found. Jul 23 21:26:34.302079 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-7eb7f251-4798-4054-aade-2fff0711bc93 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Request method failure captured: Jul 23 21:26:34.302079 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/servers/97d0845c-e69a-4dac-a900-ebbc2d1ed81c HTTP/1.1 Jul 23 21:26:34.302079 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:26:34.302079 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:26:34.302079 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:26:34.302079 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:26:34.302079 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:26:34.302079 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:26:34.302079 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:26:34.302079 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:26:34.302079 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GddaYqyOuWcIIbeHmsk3fPEmdWyfGLbr9Nsz9MmxXVcs_PKtvbIqY2C8j4fzxFCSVf8V3fYFIZhvaOHyCuudCVcoCOVgWdy__DYWHqWW4I8VD_yG4rJj0HZodonpxNaGqSkGiL8DXUXMaZTTZO1BvjnTGQlN8CnshrUQQ72pGMeb2k Jul 23 21:26:34.302079 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:26:34.302079 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:26:34.302079 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:26:34.302079 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:26:34.302079 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:26:34.302079 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:26:34.302079 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: a892bfe56afd4ee5bb6c47e926af7349 Jul 23 21:26:34.302079 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-DeleteServersTestJSON-745069838 Jul 23 21:26:34.302079 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:26:34.302079 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:26:34.302079 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a892bfe56afd4ee5bb6c47e926af7349"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a892bfe56afd4ee5bb6c47e926af7349"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a892bfe56afd4ee5bb6c47e926af7349", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a892bfe56afd4ee5bb6c47e926af7349"}]}] Jul 23 21:26:34.302079 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-DeleteServersTestJSON-745069838 Jul 23 21:26:34.302079 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: a892bfe56afd4ee5bb6c47e926af7349 Jul 23 21:26:34.302079 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-DeleteServersTestJSON-745069838 Jul 23 21:26:34.302079 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-DeleteServersTestJSON-745069838-project Jul 23 21:26:34.302079 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:26:34.302079 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:26:34.302079 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: affc3572ef7d45249f50b5061a681d18 Jul 23 21:26:34.302079 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-DeleteServersTestJSON-745069838-project Jul 23 21:26:34.302079 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:26:34.302079 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance 97d0845c-e69a-4dac-a900-ebbc2d1ed81c could not be found. Jul 23 21:26:34.302079 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': '97d0845c-e69a-4dac-a900-ebbc2d1ed81c'} Jul 23 21:26:34.302079 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:26:34.302079 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:26:34.302079 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:26:34.302079 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:26:34.302079 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:26:34.302079 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:26:34.302079 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:26:34.302079 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:26:34.302079 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:26:34.302079 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:26:34.302079 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97d0845c-e69a-4dac-a900-ebbc2d1ed81c could not be found. Jul 23 21:26:34.302079 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:34.302079 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:26:34.302079 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:34.302079 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:26:34.302079 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:26:34.302079 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:26:34.302079 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:26:34.302079 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:26:34.302079 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:26:34.302079 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:26:34.302079 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:26:34.302079 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:26:34.302079 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:26:34.302079 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:26:34.302079 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:26:34.302079 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:26:34.302079 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97d0845c-e69a-4dac-a900-ebbc2d1ed81c could not be found. Jul 23 21:26:34.302079 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:34.302079 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:26:34.302079 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:34.307190 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:26:34.307190 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:26:34.307190 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:26:34.307190 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:26:34.307190 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:26:34.307190 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97d0845c-e69a-4dac-a900-ebbc2d1ed81c could not be found. Jul 23 21:26:34.307190 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:34.307190 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-7eb7f251-4798-4054-aade-2fff0711bc93 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Returning 404 to user: Instance 97d0845c-e69a-4dac-a900-ebbc2d1ed81c could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:26:34.307190 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-7eb7f251-4798-4054-aade-2fff0711bc93 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/97d0845c-e69a-4dac-a900-ebbc2d1ed81c" status: 404 len: 111 microversion: 2.1 time: 0.044747 Jul 23 21:26:34.307190 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1652/3228] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:34 2022] GET /compute/v2.1/servers/97d0845c-e69a-4dac-a900-ebbc2d1ed81c => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:26:34.310324 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-88fc9546-09b3-4bbd-be70-ea43b77b7716 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:34.311521 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-88fc9546-09b3-4bbd-be70-ea43b77b7716 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] [instance: 7b41cb07-71ed-4403-8d4c-65be6a3c2f4b] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:34.318947 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-88fc9546-09b3-4bbd-be70-ea43b77b7716 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:34.319399 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-88fc9546-09b3-4bbd-be70-ea43b77b7716 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:34.320197 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-88fc9546-09b3-4bbd-be70-ea43b77b7716 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:34.320627 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-88fc9546-09b3-4bbd-be70-ea43b77b7716 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:34.412439 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e21474a2-b729-4297-ad63-c32677cdcd72 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a609c39c14343e1bc1edd4b3cd56dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116def61aba4631be91f67df63ebab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:34.421157 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e21474a2-b729-4297-ad63-c32677cdcd72 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] 10.222.0.17 "GET /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215" status: 200 len: 1505 microversion: 2.1 time: 0.329118 Jul 23 21:26:34.421844 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1577/3229] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:34 2022] GET /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215 => generated 1505 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:34.444031 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2fb339c0-6020-4895-9018-8b47170eff07 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1390597048", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "networks": [{"uuid": "c89c9ae3-a9c7-4e98-860d-e9f8ea64bbcb"}]}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:26:34.487197 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-88fc9546-09b3-4bbd-be70-ea43b77b7716 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c74aa110064b4f85fef220e2d47b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b3be6b5fb4734bd9aeccbd35e3824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:34.507878 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-88fc9546-09b3-4bbd-be70-ea43b77b7716 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] 10.222.0.17 "GET /compute/v2.1/servers/7b41cb07-71ed-4403-8d4c-65be6a3c2f4b" status: 200 len: 1324 microversion: 2.1 time: 0.202160 Jul 23 21:26:34.508740 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1653/3230] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:34 2022] GET /compute/v2.1/servers/7b41cb07-71ed-4403-8d4c-65be6a3c2f4b => generated 1324 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:34.526140 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-9d421737-bb0f-4ea2-8db1-59a3b1909408 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:34.527104 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-9d421737-bb0f-4ea2-8db1-59a3b1909408 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] [instance: 163182e4-bfa7-4da7-9267-9cbb8a911183] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:34.537626 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9d421737-bb0f-4ea2-8db1-59a3b1909408 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:34.538363 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9d421737-bb0f-4ea2-8db1-59a3b1909408 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:34.539361 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9d421737-bb0f-4ea2-8db1-59a3b1909408 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:34.540079 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9d421737-bb0f-4ea2-8db1-59a3b1909408 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:34.550105 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-2fb339c0-6020-4895-9018-8b47170eff07 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] validate_networks() for [('c89c9ae3-a9c7-4e98-860d-e9f8ea64bbcb', None, None, None, None, None)] {{(pid=131320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:26:34.622564 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-9d421737-bb0f-4ea2-8db1-59a3b1909408 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0543f1a561a9442cbc9463ab752bd2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d306759c447edb6d013cf14ac53f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:34.632619 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-9d421737-bb0f-4ea2-8db1-59a3b1909408 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] 10.222.0.17 "GET /compute/v2.1/servers/163182e4-bfa7-4da7-9267-9cbb8a911183" status: 200 len: 1221 microversion: 2.1 time: 0.112253 Jul 23 21:26:34.633587 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1654/3231] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:34 2022] GET /compute/v2.1/servers/163182e4-bfa7-4da7-9267-9cbb8a911183 => generated 1221 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:34.732692 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-9ccc1efe-229c-4e0b-bcac-3be5e4df9ae6 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:34.733831 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-9ccc1efe-229c-4e0b-bcac-3be5e4df9ae6 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: d303403b-5d14-443b-a6fe-f8b579d24cda] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:34.756094 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9ccc1efe-229c-4e0b-bcac-3be5e4df9ae6 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:34.765268 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9ccc1efe-229c-4e0b-bcac-3be5e4df9ae6 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:34.767174 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9ccc1efe-229c-4e0b-bcac-3be5e4df9ae6 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:34.767618 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9ccc1efe-229c-4e0b-bcac-3be5e4df9ae6 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:35.122734 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-9ccc1efe-229c-4e0b-bcac-3be5e4df9ae6 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:35.133485 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-9ccc1efe-229c-4e0b-bcac-3be5e4df9ae6 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda" status: 200 len: 1520 microversion: 2.1 time: 0.406397 Jul 23 21:26:35.134500 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1655/3232] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:34 2022] GET /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda => generated 1520 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:35.148103 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-d4457ef2-4fcf-42da-bb95-a20daf4b47b5 req-250cd6bd-f640-4ff2-a75a-8cb39b77caeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3de52df5-917b-4cdd-b2fa-a13453f03559", "name": "network-vif-unplugged", "status": "completed", "tag": "216fbe1b-f994-4e02-a3c9-7f9a1ad5a3f1"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:26:35.156679 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-d4457ef2-4fcf-42da-bb95-a20daf4b47b5 req-250cd6bd-f640-4ff2-a75a-8cb39b77caeb service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:35.157255 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-d4457ef2-4fcf-42da-bb95-a20daf4b47b5 req-250cd6bd-f640-4ff2-a75a-8cb39b77caeb service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:35.171613 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-d4457ef2-4fcf-42da-bb95-a20daf4b47b5 req-250cd6bd-f640-4ff2-a75a-8cb39b77caeb service nova] Creating event network-vif-unplugged:216fbe1b-f994-4e02-a3c9-7f9a1ad5a3f1 for instance 3de52df5-917b-4cdd-b2fa-a13453f03559 on nch1-master-1 Jul 23 21:26:35.176738 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-d4457ef2-4fcf-42da-bb95-a20daf4b47b5 req-250cd6bd-f640-4ff2-a75a-8cb39b77caeb service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040900 Jul 23 21:26:35.177423 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1656/3233] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:26:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:26:35.276642 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-8d0e98ee-500a-4c44-a201-6aa906882bc3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:35.277439 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-8d0e98ee-500a-4c44-a201-6aa906882bc3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:35.284512 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8d0e98ee-500a-4c44-a201-6aa906882bc3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:35.285202 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8d0e98ee-500a-4c44-a201-6aa906882bc3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:35.286185 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8d0e98ee-500a-4c44-a201-6aa906882bc3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:35.286800 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8d0e98ee-500a-4c44-a201-6aa906882bc3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:35.380625 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-8d0e98ee-500a-4c44-a201-6aa906882bc3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:35.391411 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-8d0e98ee-500a-4c44-a201-6aa906882bc3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:35.393092 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-8d0e98ee-500a-4c44-a201-6aa906882bc3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:35.394434 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-8d0e98ee-500a-4c44-a201-6aa906882bc3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.122084 Jul 23 21:26:35.395013 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1657/3234] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:26:35 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:26:35.438297 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a5b8481b-86b3-4145-bac5-a4d7f6445a21 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:35.439168 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-a5b8481b-86b3-4145-bac5-a4d7f6445a21 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] [instance: cb3a66a8-4c84-4bb1-8b3f-0c48acec1215] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:35.445641 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a5b8481b-86b3-4145-bac5-a4d7f6445a21 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:35.446371 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a5b8481b-86b3-4145-bac5-a4d7f6445a21 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:35.447322 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a5b8481b-86b3-4145-bac5-a4d7f6445a21 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:35.447761 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a5b8481b-86b3-4145-bac5-a4d7f6445a21 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:35.586280 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-a5b8481b-86b3-4145-bac5-a4d7f6445a21 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a609c39c14343e1bc1edd4b3cd56dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116def61aba4631be91f67df63ebab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:35.594682 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-a5b8481b-86b3-4145-bac5-a4d7f6445a21 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] 10.222.0.17 "GET /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215" status: 200 len: 1505 microversion: 2.1 time: 0.160515 Jul 23 21:26:35.595296 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1658/3235] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:35 2022] GET /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215 => generated 1505 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:26:35.600077 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-06093186-9fd7-4358-acd9-d78b09587d1f tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:35.600785 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-06093186-9fd7-4358-acd9-d78b09587d1f tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] [instance: 7b41cb07-71ed-4403-8d4c-65be6a3c2f4b] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:35.607120 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-06093186-9fd7-4358-acd9-d78b09587d1f tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:35.607573 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-06093186-9fd7-4358-acd9-d78b09587d1f tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:35.609168 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-06093186-9fd7-4358-acd9-d78b09587d1f tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:35.609810 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-06093186-9fd7-4358-acd9-d78b09587d1f tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:35.756799 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-06093186-9fd7-4358-acd9-d78b09587d1f tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c74aa110064b4f85fef220e2d47b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b3be6b5fb4734bd9aeccbd35e3824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:35.765291 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-06093186-9fd7-4358-acd9-d78b09587d1f tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] 10.222.0.17 "GET /compute/v2.1/servers/7b41cb07-71ed-4403-8d4c-65be6a3c2f4b" status: 200 len: 1324 microversion: 2.1 time: 0.168890 Jul 23 21:26:35.765902 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1659/3236] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:35 2022] GET /compute/v2.1/servers/7b41cb07-71ed-4403-8d4c-65be6a3c2f4b => generated 1324 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:35.770509 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-5eeb2c69-ecf2-4b21-b96e-8f1d58a35e6b tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:35.771110 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-5eeb2c69-ecf2-4b21-b96e-8f1d58a35e6b tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] [instance: 163182e4-bfa7-4da7-9267-9cbb8a911183] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:35.778196 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5eeb2c69-ecf2-4b21-b96e-8f1d58a35e6b tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:35.778640 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5eeb2c69-ecf2-4b21-b96e-8f1d58a35e6b tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:35.779404 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5eeb2c69-ecf2-4b21-b96e-8f1d58a35e6b tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:35.779839 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5eeb2c69-ecf2-4b21-b96e-8f1d58a35e6b tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:35.845293 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-5eeb2c69-ecf2-4b21-b96e-8f1d58a35e6b tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0543f1a561a9442cbc9463ab752bd2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d306759c447edb6d013cf14ac53f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:35.853099 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-5eeb2c69-ecf2-4b21-b96e-8f1d58a35e6b tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] 10.222.0.17 "GET /compute/v2.1/servers/163182e4-bfa7-4da7-9267-9cbb8a911183" status: 200 len: 1269 microversion: 2.1 time: 0.086190 Jul 23 21:26:35.853661 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1660/3237] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:35 2022] GET /compute/v2.1/servers/163182e4-bfa7-4da7-9267-9cbb8a911183 => generated 1269 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:36.151100 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-af8efc52-9221-4ad3-8b73-ad86b30f5f63 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:36.151728 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-af8efc52-9221-4ad3-8b73-ad86b30f5f63 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: d303403b-5d14-443b-a6fe-f8b579d24cda] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:36.166226 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-af8efc52-9221-4ad3-8b73-ad86b30f5f63 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:36.166687 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-af8efc52-9221-4ad3-8b73-ad86b30f5f63 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:36.167548 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-af8efc52-9221-4ad3-8b73-ad86b30f5f63 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:36.168011 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-af8efc52-9221-4ad3-8b73-ad86b30f5f63 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:36.445632 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-af8efc52-9221-4ad3-8b73-ad86b30f5f63 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:36.453928 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-af8efc52-9221-4ad3-8b73-ad86b30f5f63 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda" status: 200 len: 1520 microversion: 2.1 time: 0.307065 Jul 23 21:26:36.458433 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1661/3238] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:36 2022] GET /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda => generated 1520 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:26:36.467396 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-cdce4caf-6e17-4b82-b123-e2c4d1cfac61 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:36.478886 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-cdce4caf-6e17-4b82-b123-e2c4d1cfac61 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:36.486002 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=2,nova_api:INSERT=9,nova_api:DELETE=1 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:26:36.487968 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cdce4caf-6e17-4b82-b123-e2c4d1cfac61 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:36.488743 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cdce4caf-6e17-4b82-b123-e2c4d1cfac61 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:36.489829 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cdce4caf-6e17-4b82-b123-e2c4d1cfac61 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:36.490874 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cdce4caf-6e17-4b82-b123-e2c4d1cfac61 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:36.521143 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-2fb339c0-6020-4895-9018-8b47170eff07 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:26:36.522385 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-2fb339c0-6020-4895-9018-8b47170eff07 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:26:36.524279 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-2fb339c0-6020-4895-9018-8b47170eff07 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:26:36.525139 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-2fb339c0-6020-4895-9018-8b47170eff07 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:26:36.525780 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-2fb339c0-6020-4895-9018-8b47170eff07 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:26:36.547889 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2fb339c0-6020-4895-9018-8b47170eff07 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:36.548913 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2fb339c0-6020-4895-9018-8b47170eff07 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:36.552372 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2fb339c0-6020-4895-9018-8b47170eff07 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:36.556012 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2fb339c0-6020-4895-9018-8b47170eff07 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:36.635593 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-2fb339c0-6020-4895-9018-8b47170eff07 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Getting quotas for project a892bfe56afd4ee5bb6c47e926af7349. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:26:36.650855 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-cdce4caf-6e17-4b82-b123-e2c4d1cfac61 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:36.651382 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-2fb339c0-6020-4895-9018-8b47170eff07 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Getting quotas for user affc3572ef7d45249f50b5061a681d18 and project a892bfe56afd4ee5bb6c47e926af7349. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:26:36.664723 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-cdce4caf-6e17-4b82-b123-e2c4d1cfac61 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:36.670630 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-cdce4caf-6e17-4b82-b123-e2c4d1cfac61 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:36.676449 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-cdce4caf-6e17-4b82-b123-e2c4d1cfac61 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.214794 Jul 23 21:26:36.677989 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1662/3239] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:26:36 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:26:36.694315 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d380f3d7-5d81-460f-8e53-32de7c4ca7e6 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:36.695016 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-d380f3d7-5d81-460f-8e53-32de7c4ca7e6 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] [instance: cb3a66a8-4c84-4bb1-8b3f-0c48acec1215] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:36.699834 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-2fb339c0-6020-4895-9018-8b47170eff07 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Going to run 1 instances... {{(pid=131320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:26:36.705123 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-2fb339c0-6020-4895-9018-8b47170eff07 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: 178abb32-365f-4ccd-828b-e69f6fe45370] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:26:36.713668 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d380f3d7-5d81-460f-8e53-32de7c4ca7e6 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:36.726954 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d380f3d7-5d81-460f-8e53-32de7c4ca7e6 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:36.728071 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d380f3d7-5d81-460f-8e53-32de7c4ca7e6 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:36.728673 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d380f3d7-5d81-460f-8e53-32de7c4ca7e6 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:36.788134 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=11,nova_cell1:DELETE=2 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:26:36.893329 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2fb339c0-6020-4895-9018-8b47170eff07 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.454675 Jul 23 21:26:36.902766 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1578/3240] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:26:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 2460 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 23 21:26:36.908731 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-40056eca-b09f-41a1-9db5-4dc63e10ba32 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:36.909729 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-40056eca-b09f-41a1-9db5-4dc63e10ba32 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] [instance: 7b41cb07-71ed-4403-8d4c-65be6a3c2f4b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:36.931291 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-40056eca-b09f-41a1-9db5-4dc63e10ba32 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:36.933431 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-40056eca-b09f-41a1-9db5-4dc63e10ba32 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:36.934584 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-40056eca-b09f-41a1-9db5-4dc63e10ba32 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:36.935814 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-40056eca-b09f-41a1-9db5-4dc63e10ba32 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:37.592692 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-40056eca-b09f-41a1-9db5-4dc63e10ba32 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c74aa110064b4f85fef220e2d47b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b3be6b5fb4734bd9aeccbd35e3824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:37.607487 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-40056eca-b09f-41a1-9db5-4dc63e10ba32 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] 10.222.0.17 "GET /compute/v2.1/servers/7b41cb07-71ed-4403-8d4c-65be6a3c2f4b" status: 200 len: 1324 microversion: 2.1 time: 0.699684 Jul 23 21:26:37.608568 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1579/3241] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:36 2022] GET /compute/v2.1/servers/7b41cb07-71ed-4403-8d4c-65be6a3c2f4b => generated 1324 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:37.625527 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0ed55bd8-812d-4469-8601-e37761a0e9e4 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:37.627186 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-0ed55bd8-812d-4469-8601-e37761a0e9e4 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] [instance: 163182e4-bfa7-4da7-9267-9cbb8a911183] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:37.642676 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0ed55bd8-812d-4469-8601-e37761a0e9e4 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:37.646487 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0ed55bd8-812d-4469-8601-e37761a0e9e4 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:37.647735 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0ed55bd8-812d-4469-8601-e37761a0e9e4 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:37.648335 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0ed55bd8-812d-4469-8601-e37761a0e9e4 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:37.669697 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-d380f3d7-5d81-460f-8e53-32de7c4ca7e6 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a609c39c14343e1bc1edd4b3cd56dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116def61aba4631be91f67df63ebab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:37.684248 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-d380f3d7-5d81-460f-8e53-32de7c4ca7e6 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] 10.222.0.17 "GET /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215" status: 200 len: 1505 microversion: 2.1 time: 1.004920 Jul 23 21:26:37.687484 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1663/3242] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:36 2022] GET /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215 => generated 1505 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:37.699786 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-fd963a5f-9ca5-4a0d-8e18-f85f142f4d59 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:37.703194 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-fd963a5f-9ca5-4a0d-8e18-f85f142f4d59 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: 178abb32-365f-4ccd-828b-e69f6fe45370] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:37.756567 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-0ed55bd8-812d-4469-8601-e37761a0e9e4 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0543f1a561a9442cbc9463ab752bd2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d306759c447edb6d013cf14ac53f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:37.765001 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-0ed55bd8-812d-4469-8601-e37761a0e9e4 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] 10.222.0.17 "GET /compute/v2.1/servers/163182e4-bfa7-4da7-9267-9cbb8a911183" status: 200 len: 1275 microversion: 2.1 time: 0.154731 Jul 23 21:26:37.778070 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1580/3243] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:37 2022] GET /compute/v2.1/servers/163182e4-bfa7-4da7-9267-9cbb8a911183 => generated 1275 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:37.795236 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-1fd70b31-4093-48fe-ac89-5278852f68ae req-cd34d814-9df9-4e38-accc-5ed3285c0d5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3de52df5-917b-4cdd-b2fa-a13453f03559", "name": "network-vif-deleted", "tag": "216fbe1b-f994-4e02-a3c9-7f9a1ad5a3f1"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:26:37.822280 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-fd963a5f-9ca5-4a0d-8e18-f85f142f4d59 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:37.827857 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-1fd70b31-4093-48fe-ac89-5278852f68ae req-cd34d814-9df9-4e38-accc-5ed3285c0d5a service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:37.829770 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-1fd70b31-4093-48fe-ac89-5278852f68ae req-cd34d814-9df9-4e38-accc-5ed3285c0d5a service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:37.839734 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-fd963a5f-9ca5-4a0d-8e18-f85f142f4d59 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/178abb32-365f-4ccd-828b-e69f6fe45370" status: 200 len: 1215 microversion: 2.1 time: 0.150796 Jul 23 21:26:37.840383 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1664/3244] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:37 2022] GET /compute/v2.1/servers/178abb32-365f-4ccd-828b-e69f6fe45370 => generated 1215 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:37.853670 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-1fd70b31-4093-48fe-ac89-5278852f68ae req-cd34d814-9df9-4e38-accc-5ed3285c0d5a service nova] Creating event network-vif-deleted:216fbe1b-f994-4e02-a3c9-7f9a1ad5a3f1 for instance 3de52df5-917b-4cdd-b2fa-a13453f03559 on nch1-master-1 Jul 23 21:26:37.854109 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-1c1e9c8d-f49c-49fb-84fc-41992d62526f tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:37.858472 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-1c1e9c8d-f49c-49fb-84fc-41992d62526f tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: d303403b-5d14-443b-a6fe-f8b579d24cda] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:37.859610 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-1fd70b31-4093-48fe-ac89-5278852f68ae req-cd34d814-9df9-4e38-accc-5ed3285c0d5a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078151 Jul 23 21:26:37.860720 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1581/3245] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:26:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:26:37.866449 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6e051865-db16-4264-8278-83d29255dabd tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:37.867151 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6e051865-db16-4264-8278-83d29255dabd tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:37.875473 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6e051865-db16-4264-8278-83d29255dabd tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:37.875845 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6e051865-db16-4264-8278-83d29255dabd tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:37.877596 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6e051865-db16-4264-8278-83d29255dabd tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:37.878238 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6e051865-db16-4264-8278-83d29255dabd tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:37.882477 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1c1e9c8d-f49c-49fb-84fc-41992d62526f tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:37.882937 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1c1e9c8d-f49c-49fb-84fc-41992d62526f tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:37.883739 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1c1e9c8d-f49c-49fb-84fc-41992d62526f tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:37.884183 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1c1e9c8d-f49c-49fb-84fc-41992d62526f tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:38.007435 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6e051865-db16-4264-8278-83d29255dabd tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:38.039349 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6e051865-db16-4264-8278-83d29255dabd tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:38.043412 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6e051865-db16-4264-8278-83d29255dabd tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:38.044675 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6e051865-db16-4264-8278-83d29255dabd tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.183169 Jul 23 21:26:38.052165 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1582/3246] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:26:37 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:26:38.561488 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-1c1e9c8d-f49c-49fb-84fc-41992d62526f tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:38.575146 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-1c1e9c8d-f49c-49fb-84fc-41992d62526f tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda" status: 200 len: 1505 microversion: 2.1 time: 0.733644 Jul 23 21:26:38.576959 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1665/3247] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:37 2022] GET /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda => generated 1505 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:38.593915 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e6b55693-3524-4e66-a10f-b24d7513cd1f tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:38.595232 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e6b55693-3524-4e66-a10f-b24d7513cd1f tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: d303403b-5d14-443b-a6fe-f8b579d24cda] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:38.618589 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e6b55693-3524-4e66-a10f-b24d7513cd1f tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:38.621657 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e6b55693-3524-4e66-a10f-b24d7513cd1f tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:38.624972 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e6b55693-3524-4e66-a10f-b24d7513cd1f tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:38.625836 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-abbaf772-e689-476f-b4d2-d0a2766116e4 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:38.626780 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-abbaf772-e689-476f-b4d2-d0a2766116e4 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] [instance: 7b41cb07-71ed-4403-8d4c-65be6a3c2f4b] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:38.626938 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e6b55693-3524-4e66-a10f-b24d7513cd1f tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:38.638722 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-abbaf772-e689-476f-b4d2-d0a2766116e4 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:38.639611 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-abbaf772-e689-476f-b4d2-d0a2766116e4 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:38.640955 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-abbaf772-e689-476f-b4d2-d0a2766116e4 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:38.641634 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-abbaf772-e689-476f-b4d2-d0a2766116e4 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:39.015446 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e6b55693-3524-4e66-a10f-b24d7513cd1f tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:39.028299 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e6b55693-3524-4e66-a10f-b24d7513cd1f tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda" status: 200 len: 1505 microversion: 2.1 time: 0.438215 Jul 23 21:26:39.029639 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1583/3248] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:38 2022] GET /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda => generated 1505 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:39.034791 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-44942c14-e8e1-4c4a-b925-77354af759c4 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:39.035846 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-44942c14-e8e1-4c4a-b925-77354af759c4 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] [instance: cb3a66a8-4c84-4bb1-8b3f-0c48acec1215] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:39.062534 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-44942c14-e8e1-4c4a-b925-77354af759c4 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:39.063008 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-44942c14-e8e1-4c4a-b925-77354af759c4 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:39.067879 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-44942c14-e8e1-4c4a-b925-77354af759c4 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:39.068344 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-44942c14-e8e1-4c4a-b925-77354af759c4 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:39.100098 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-44942c14-e8e1-4c4a-b925-77354af759c4 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] HTTP exception thrown: Instance cb3a66a8-4c84-4bb1-8b3f-0c48acec1215 could not be found. Jul 23 21:26:39.101804 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-44942c14-e8e1-4c4a-b925-77354af759c4 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Request method failure captured: Jul 23 21:26:39.101804 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215 HTTP/1.1 Jul 23 21:26:39.101804 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:26:39.101804 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:26:39.101804 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:26:39.101804 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:26:39.101804 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:26:39.101804 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:26:39.101804 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:26:39.101804 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:26:39.101804 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GcVwaMD4-f4w7Azh6TxZ5WCaWQhA0PzMDqGyfuQesfeY0pzfwz3k1188-P0XhiQYDjG8e11wncD47Ht9HAD_DqEwZanHRWTP27X-YGC8aqwBFvomTfrR-z7k3hN4std3vKaGEbptoS6jNuqHtG9OR9_7RF1XQBJ2nzvh6JKQcsK7jc Jul 23 21:26:39.101804 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:26:39.101804 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:26:39.101804 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:26:39.101804 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:26:39.101804 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:26:39.101804 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:26:39.101804 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 9116def61aba4631be91f67df63ebab0 Jul 23 21:26:39.101804 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServerRescueTestJSON-1343751565 Jul 23 21:26:39.101804 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:26:39.101804 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:26:39.101804 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9116def61aba4631be91f67df63ebab0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9116def61aba4631be91f67df63ebab0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9116def61aba4631be91f67df63ebab0", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9116def61aba4631be91f67df63ebab0"}]}] Jul 23 21:26:39.101804 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServerRescueTestJSON-1343751565 Jul 23 21:26:39.101804 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 9116def61aba4631be91f67df63ebab0 Jul 23 21:26:39.101804 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServerRescueTestJSON-1343751565 Jul 23 21:26:39.101804 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServerRescueTestJSON-1343751565-project Jul 23 21:26:39.101804 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:26:39.101804 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:26:39.101804 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 2a609c39c14343e1bc1edd4b3cd56dd4 Jul 23 21:26:39.101804 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServerRescueTestJSON-1343751565-project Jul 23 21:26:39.101804 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:26:39.101804 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance cb3a66a8-4c84-4bb1-8b3f-0c48acec1215 could not be found. Jul 23 21:26:39.101804 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': 'cb3a66a8-4c84-4bb1-8b3f-0c48acec1215'} Jul 23 21:26:39.101804 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:26:39.101804 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:26:39.101804 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:26:39.101804 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:26:39.101804 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:26:39.101804 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:26:39.101804 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:26:39.101804 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:26:39.101804 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:26:39.101804 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:26:39.101804 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb3a66a8-4c84-4bb1-8b3f-0c48acec1215 could not be found. Jul 23 21:26:39.101804 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:26:39.101804 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:26:39.101804 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:26:39.101804 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:26:39.101804 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:26:39.101804 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:26:39.101804 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:26:39.101804 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:26:39.101804 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:26:39.101804 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:26:39.101804 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:26:39.101804 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:26:39.101804 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:26:39.101804 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:26:39.101804 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:26:39.101804 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:26:39.101804 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb3a66a8-4c84-4bb1-8b3f-0c48acec1215 could not be found. Jul 23 21:26:39.101804 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:26:39.101804 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:26:39.101804 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:26:39.105811 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:26:39.105811 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:26:39.105811 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:26:39.105811 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:26:39.105811 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:26:39.105811 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb3a66a8-4c84-4bb1-8b3f-0c48acec1215 could not be found. Jul 23 21:26:39.105811 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:26:39.105811 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-44942c14-e8e1-4c4a-b925-77354af759c4 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Returning 404 to user: Instance cb3a66a8-4c84-4bb1-8b3f-0c48acec1215 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:26:39.105811 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-44942c14-e8e1-4c4a-b925-77354af759c4 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] 10.222.0.17 "GET /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215" status: 404 len: 111 microversion: 2.1 time: 0.072323 Jul 23 21:26:39.105811 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1584/3249] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:39 2022] GET /compute/v2.1/servers/cb3a66a8-4c84-4bb1-8b3f-0c48acec1215 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:26:39.136943 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-7f58edd4-c7c2-4ec4-98f0-ef8ece6bf86a tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:39.137488 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-7f58edd4-c7c2-4ec4-98f0-ef8ece6bf86a tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] [instance: 163182e4-bfa7-4da7-9267-9cbb8a911183] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:39.153487 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7f58edd4-c7c2-4ec4-98f0-ef8ece6bf86a tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:39.154821 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7f58edd4-c7c2-4ec4-98f0-ef8ece6bf86a tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:39.155789 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7f58edd4-c7c2-4ec4-98f0-ef8ece6bf86a tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:39.156383 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7f58edd4-c7c2-4ec4-98f0-ef8ece6bf86a tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:39.241093 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-7f58edd4-c7c2-4ec4-98f0-ef8ece6bf86a tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0543f1a561a9442cbc9463ab752bd2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d306759c447edb6d013cf14ac53f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:39.255759 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-7f58edd4-c7c2-4ec4-98f0-ef8ece6bf86a tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] 10.222.0.17 "GET /compute/v2.1/servers/163182e4-bfa7-4da7-9267-9cbb8a911183" status: 200 len: 1275 microversion: 2.1 time: 0.145855 Jul 23 21:26:39.257438 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1585/3250] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:39 2022] GET /compute/v2.1/servers/163182e4-bfa7-4da7-9267-9cbb8a911183 => generated 1275 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:39.267318 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6b8f2fba-c731-43c9-81c2-5766dbc28d57 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:39.268200 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6b8f2fba-c731-43c9-81c2-5766dbc28d57 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: 178abb32-365f-4ccd-828b-e69f6fe45370] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:39.274415 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6b8f2fba-c731-43c9-81c2-5766dbc28d57 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:39.275328 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6b8f2fba-c731-43c9-81c2-5766dbc28d57 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:39.276110 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6b8f2fba-c731-43c9-81c2-5766dbc28d57 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:39.276680 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6b8f2fba-c731-43c9-81c2-5766dbc28d57 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:39.288437 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-abbaf772-e689-476f-b4d2-d0a2766116e4 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c74aa110064b4f85fef220e2d47b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b3be6b5fb4734bd9aeccbd35e3824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:39.296364 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-abbaf772-e689-476f-b4d2-d0a2766116e4 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] 10.222.0.17 "GET /compute/v2.1/servers/7b41cb07-71ed-4403-8d4c-65be6a3c2f4b" status: 200 len: 1324 microversion: 2.1 time: 0.674889 Jul 23 21:26:39.306200 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1666/3251] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:38 2022] GET /compute/v2.1/servers/7b41cb07-71ed-4403-8d4c-65be6a3c2f4b => generated 1324 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:39.312262 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-00261c2c-703f-4907-a6bf-ffc602a9301a tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:39.312812 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-00261c2c-703f-4907-a6bf-ffc602a9301a tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: d303403b-5d14-443b-a6fe-f8b579d24cda] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:39.319433 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-00261c2c-703f-4907-a6bf-ffc602a9301a tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:39.320318 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-00261c2c-703f-4907-a6bf-ffc602a9301a tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:39.321382 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-00261c2c-703f-4907-a6bf-ffc602a9301a tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:39.322087 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-00261c2c-703f-4907-a6bf-ffc602a9301a tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:39.355331 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-00261c2c-703f-4907-a6bf-ffc602a9301a tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: d303403b-5d14-443b-a6fe-f8b579d24cda] Going to try to terminate instance {{(pid=131321) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:26:39.401662 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6b8f2fba-c731-43c9-81c2-5766dbc28d57 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:39.415199 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6b8f2fba-c731-43c9-81c2-5766dbc28d57 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/178abb32-365f-4ccd-828b-e69f6fe45370" status: 200 len: 1273 microversion: 2.1 time: 0.156450 Jul 23 21:26:39.416061 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1586/3252] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:39 2022] GET /compute/v2.1/servers/178abb32-365f-4ccd-828b-e69f6fe45370 => generated 1273 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:39.423033 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a8e39685-ebd5-4fe4-9db9-581c1f7f9129 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:39.423935 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a8e39685-ebd5-4fe4-9db9-581c1f7f9129 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:39.427379 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:26:39.443019 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a8e39685-ebd5-4fe4-9db9-581c1f7f9129 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:39.444685 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a8e39685-ebd5-4fe4-9db9-581c1f7f9129 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:39.446434 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a8e39685-ebd5-4fe4-9db9-581c1f7f9129 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:39.447413 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a8e39685-ebd5-4fe4-9db9-581c1f7f9129 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:39.465783 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-00261c2c-703f-4907-a6bf-ffc602a9301a tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda" status: 204 len: 0 microversion: 2.1 time: 0.157743 Jul 23 21:26:39.466836 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1667/3253] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:26:39 2022] DELETE /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:26:39.475951 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-2406dcf2-be0b-4e93-a20a-3b1fa7496e63 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:39.476782 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-2406dcf2-be0b-4e93-a20a-3b1fa7496e63 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] [instance: 73362a63-78d8-4890-8588-d112fb85c2bf] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:39.483952 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2406dcf2-be0b-4e93-a20a-3b1fa7496e63 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:39.484667 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2406dcf2-be0b-4e93-a20a-3b1fa7496e63 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:39.485990 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2406dcf2-be0b-4e93-a20a-3b1fa7496e63 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:39.486583 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2406dcf2-be0b-4e93-a20a-3b1fa7496e63 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:39.523132 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-2406dcf2-be0b-4e93-a20a-3b1fa7496e63 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] [instance: 73362a63-78d8-4890-8588-d112fb85c2bf] Going to try to terminate instance {{(pid=131321) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:26:39.544977 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a8e39685-ebd5-4fe4-9db9-581c1f7f9129 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:39.560108 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a8e39685-ebd5-4fe4-9db9-581c1f7f9129 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:39.561783 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a8e39685-ebd5-4fe4-9db9-581c1f7f9129 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:39.563167 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a8e39685-ebd5-4fe4-9db9-581c1f7f9129 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.145295 Jul 23 21:26:39.565852 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1587/3254] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:26:39 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:26:39.610920 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b2600744-9d2b-4d61-9b6e-6ab0b4aa13f6 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1387382969", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "networks": [{"uuid": "1dbf2bb4-d60f-4a54-bdcd-eb9fe22ca395"}]}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:26:39.631177 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-2406dcf2-be0b-4e93-a20a-3b1fa7496e63 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] 10.222.0.17 "DELETE /compute/v2.1/servers/73362a63-78d8-4890-8588-d112fb85c2bf" status: 204 len: 0 microversion: 2.1 time: 0.162068 Jul 23 21:26:39.633952 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1668/3255] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:26:39 2022] DELETE /compute/v2.1/servers/73362a63-78d8-4890-8588-d112fb85c2bf => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:26:39.647143 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-8565c78a-c59e-4e9f-9c5a-7b8d952f446d tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:39.650576 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-8565c78a-c59e-4e9f-9c5a-7b8d952f446d tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] [instance: 73362a63-78d8-4890-8588-d112fb85c2bf] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:39.659408 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8565c78a-c59e-4e9f-9c5a-7b8d952f446d tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:39.660015 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8565c78a-c59e-4e9f-9c5a-7b8d952f446d tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:39.660887 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8565c78a-c59e-4e9f-9c5a-7b8d952f446d tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:39.661426 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8565c78a-c59e-4e9f-9c5a-7b8d952f446d tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:39.726241 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-b2600744-9d2b-4d61-9b6e-6ab0b4aa13f6 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] validate_networks() for [('1dbf2bb4-d60f-4a54-bdcd-eb9fe22ca395', None, None, None, None, None)] {{(pid=131320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:26:39.979465 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-8565c78a-c59e-4e9f-9c5a-7b8d952f446d tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a609c39c14343e1bc1edd4b3cd56dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116def61aba4631be91f67df63ebab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:39.987580 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-8565c78a-c59e-4e9f-9c5a-7b8d952f446d tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] 10.222.0.17 "GET /compute/v2.1/servers/73362a63-78d8-4890-8588-d112fb85c2bf" status: 200 len: 1491 microversion: 2.1 time: 0.350113 Jul 23 21:26:39.999397 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1669/3256] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:39 2022] GET /compute/v2.1/servers/73362a63-78d8-4890-8588-d112fb85c2bf => generated 1491 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:26:40.239829 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-630e124a-cb56-4274-ac26-2afe3722c46d req-98f8c10e-c8f1-4860-ab30-e1763f5217d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb3a66a8-4c84-4bb1-8b3f-0c48acec1215", "name": "network-vif-deleted", "tag": "e77bdbdb-6452-4acc-8d23-03a2d5eb3311"}, {"name": "network-changed", "server_uuid": "7b41cb07-71ed-4403-8d4c-65be6a3c2f4b", "tag": "5f41cae0-7b96-4511-98b1-f7306dc68f94"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:26:40.250816 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-630e124a-cb56-4274-ac26-2afe3722c46d req-98f8c10e-c8f1-4860-ab30-e1763f5217d4 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:40.251317 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-630e124a-cb56-4274-ac26-2afe3722c46d req-98f8c10e-c8f1-4860-ab30-e1763f5217d4 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:40.265770 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-630e124a-cb56-4274-ac26-2afe3722c46d req-98f8c10e-c8f1-4860-ab30-e1763f5217d4 service nova] Creating event network-vif-deleted:e77bdbdb-6452-4acc-8d23-03a2d5eb3311 for instance cb3a66a8-4c84-4bb1-8b3f-0c48acec1215 on nch1-master-1 Jul 23 21:26:40.266599 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-630e124a-cb56-4274-ac26-2afe3722c46d req-98f8c10e-c8f1-4860-ab30-e1763f5217d4 service nova] Creating event network-changed:5f41cae0-7b96-4511-98b1-f7306dc68f94 for instance 7b41cb07-71ed-4403-8d4c-65be6a3c2f4b on nch2-master-1 Jul 23 21:26:40.276885 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-630e124a-cb56-4274-ac26-2afe3722c46d req-98f8c10e-c8f1-4860-ab30-e1763f5217d4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.040823 Jul 23 21:26:40.277969 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1670/3257] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:26:40 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:26:40.283460 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-add1cb4a-f005-42e9-9085-9063f1cdb439 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:40.294409 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-add1cb4a-f005-42e9-9085-9063f1cdb439 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] [instance: 163182e4-bfa7-4da7-9267-9cbb8a911183] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:40.312914 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-add1cb4a-f005-42e9-9085-9063f1cdb439 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:40.313658 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-add1cb4a-f005-42e9-9085-9063f1cdb439 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:40.314619 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-add1cb4a-f005-42e9-9085-9063f1cdb439 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:40.315165 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-add1cb4a-f005-42e9-9085-9063f1cdb439 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:40.652352 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-add1cb4a-f005-42e9-9085-9063f1cdb439 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0543f1a561a9442cbc9463ab752bd2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d306759c447edb6d013cf14ac53f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:40.661174 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-add1cb4a-f005-42e9-9085-9063f1cdb439 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] 10.222.0.17 "GET /compute/v2.1/servers/163182e4-bfa7-4da7-9267-9cbb8a911183" status: 200 len: 1317 microversion: 2.1 time: 0.381675 Jul 23 21:26:40.670736 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1671/3258] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:40 2022] GET /compute/v2.1/servers/163182e4-bfa7-4da7-9267-9cbb8a911183 => generated 1317 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:40.675951 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d611ac1e-22e8-4f9d-8601-70c0a193f87a tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:40.676789 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-d611ac1e-22e8-4f9d-8601-70c0a193f87a tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] [instance: 7b41cb07-71ed-4403-8d4c-65be6a3c2f4b] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:40.683890 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d611ac1e-22e8-4f9d-8601-70c0a193f87a tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:40.684749 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d611ac1e-22e8-4f9d-8601-70c0a193f87a tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:40.685756 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d611ac1e-22e8-4f9d-8601-70c0a193f87a tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:40.686381 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d611ac1e-22e8-4f9d-8601-70c0a193f87a tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:41.009640 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-d611ac1e-22e8-4f9d-8601-70c0a193f87a tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c74aa110064b4f85fef220e2d47b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b3be6b5fb4734bd9aeccbd35e3824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:41.017717 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-d611ac1e-22e8-4f9d-8601-70c0a193f87a tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] 10.222.0.17 "GET /compute/v2.1/servers/7b41cb07-71ed-4403-8d4c-65be6a3c2f4b" status: 200 len: 1324 microversion: 2.1 time: 0.345521 Jul 23 21:26:41.030266 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1672/3259] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:40 2022] GET /compute/v2.1/servers/7b41cb07-71ed-4403-8d4c-65be6a3c2f4b => generated 1324 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:41.035648 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-229ea6bf-12c3-4ff1-95c4-9e678b930b35 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:41.036689 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-229ea6bf-12c3-4ff1-95c4-9e678b930b35 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: 178abb32-365f-4ccd-828b-e69f6fe45370] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:41.045002 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-229ea6bf-12c3-4ff1-95c4-9e678b930b35 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:41.046078 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-229ea6bf-12c3-4ff1-95c4-9e678b930b35 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:41.047059 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-229ea6bf-12c3-4ff1-95c4-9e678b930b35 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:41.047832 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-229ea6bf-12c3-4ff1-95c4-9e678b930b35 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:41.386570 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-229ea6bf-12c3-4ff1-95c4-9e678b930b35 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:41.401371 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-229ea6bf-12c3-4ff1-95c4-9e678b930b35 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/178abb32-365f-4ccd-828b-e69f6fe45370" status: 200 len: 1315 microversion: 2.1 time: 0.369516 Jul 23 21:26:41.402547 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1673/3260] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:41 2022] GET /compute/v2.1/servers/178abb32-365f-4ccd-828b-e69f6fe45370 => generated 1315 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:41.423463 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-49bf8648-29de-437f-9bfb-de3d1005949b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:41.424081 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-49bf8648-29de-437f-9bfb-de3d1005949b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:41.433503 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-49bf8648-29de-437f-9bfb-de3d1005949b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:41.433898 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-49bf8648-29de-437f-9bfb-de3d1005949b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:41.434675 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-49bf8648-29de-437f-9bfb-de3d1005949b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:41.435111 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-49bf8648-29de-437f-9bfb-de3d1005949b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:41.510185 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-b2600744-9d2b-4d61-9b6e-6ab0b4aa13f6 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:26:41.510751 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-b2600744-9d2b-4d61-9b6e-6ab0b4aa13f6 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:26:41.511425 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-b2600744-9d2b-4d61-9b6e-6ab0b4aa13f6 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:26:41.512073 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-b2600744-9d2b-4d61-9b6e-6ab0b4aa13f6 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:26:41.512622 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-b2600744-9d2b-4d61-9b6e-6ab0b4aa13f6 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:26:41.540525 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b2600744-9d2b-4d61-9b6e-6ab0b4aa13f6 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:41.542518 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b2600744-9d2b-4d61-9b6e-6ab0b4aa13f6 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:41.543507 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b2600744-9d2b-4d61-9b6e-6ab0b4aa13f6 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:41.545485 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b2600744-9d2b-4d61-9b6e-6ab0b4aa13f6 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:41.579270 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-49bf8648-29de-437f-9bfb-de3d1005949b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:41.587225 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-b2600744-9d2b-4d61-9b6e-6ab0b4aa13f6 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Getting quotas for project 5afdbc378ad64fc58903ea2518717005. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:26:41.589598 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-49bf8648-29de-437f-9bfb-de3d1005949b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:41.591311 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-49bf8648-29de-437f-9bfb-de3d1005949b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:41.595683 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-b2600744-9d2b-4d61-9b6e-6ab0b4aa13f6 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Getting quotas for user c8c3d58265714ebba65b1510bd768e19 and project 5afdbc378ad64fc58903ea2518717005. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:26:41.599980 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-49bf8648-29de-437f-9bfb-de3d1005949b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.196024 Jul 23 21:26:41.601473 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1674/3261] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:26:41 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:26:41.606191 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-df613371-6165-4a26-a01a-ba0504b39faa tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:41.618741 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-df613371-6165-4a26-a01a-ba0504b39faa tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] [instance: 73362a63-78d8-4890-8588-d112fb85c2bf] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:41.627514 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-df613371-6165-4a26-a01a-ba0504b39faa tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:41.628242 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-df613371-6165-4a26-a01a-ba0504b39faa tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:41.628932 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b2600744-9d2b-4d61-9b6e-6ab0b4aa13f6 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Going to run 1 instances... {{(pid=131320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:26:41.629228 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-df613371-6165-4a26-a01a-ba0504b39faa tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:41.629668 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-df613371-6165-4a26-a01a-ba0504b39faa tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:41.634955 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b2600744-9d2b-4d61-9b6e-6ab0b4aa13f6 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: 06a478c3-f038-4813-a456-daf3a58b5749] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:26:41.714257 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b2600744-9d2b-4d61-9b6e-6ab0b4aa13f6 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.109433 Jul 23 21:26:41.720394 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1588/3262] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:26:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 2116 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 23 21:26:41.725714 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d0da5544-200d-40bf-8d5c-315c1c8c4cff tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:41.726573 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d0da5544-200d-40bf-8d5c-315c1c8c4cff tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] [instance: 163182e4-bfa7-4da7-9267-9cbb8a911183] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:41.733438 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d0da5544-200d-40bf-8d5c-315c1c8c4cff tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:41.734170 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d0da5544-200d-40bf-8d5c-315c1c8c4cff tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:41.735113 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d0da5544-200d-40bf-8d5c-315c1c8c4cff tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:41.735742 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d0da5544-200d-40bf-8d5c-315c1c8c4cff tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:41.740999 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=100 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:26:41.850399 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-df613371-6165-4a26-a01a-ba0504b39faa tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a609c39c14343e1bc1edd4b3cd56dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116def61aba4631be91f67df63ebab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:41.861853 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-df613371-6165-4a26-a01a-ba0504b39faa tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] 10.222.0.17 "GET /compute/v2.1/servers/73362a63-78d8-4890-8588-d112fb85c2bf" status: 200 len: 1491 microversion: 2.1 time: 0.259085 Jul 23 21:26:41.864194 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1675/3263] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:41 2022] GET /compute/v2.1/servers/73362a63-78d8-4890-8588-d112fb85c2bf => generated 1491 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:41.872254 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-36c1333d-14c9-47ff-92ff-98738a7cd76f tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:41.872922 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-36c1333d-14c9-47ff-92ff-98738a7cd76f tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: 06a478c3-f038-4813-a456-daf3a58b5749] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:42.034163 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-36c1333d-14c9-47ff-92ff-98738a7cd76f tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:42.042073 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-36c1333d-14c9-47ff-92ff-98738a7cd76f tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/06a478c3-f038-4813-a456-daf3a58b5749" status: 200 len: 1218 microversion: 2.1 time: 0.176695 Jul 23 21:26:42.042680 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1676/3264] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:41 2022] GET /compute/v2.1/servers/06a478c3-f038-4813-a456-daf3a58b5749 => generated 1218 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:42.070612 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-89738109-19f6-4f5e-842e-bf134718507f tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:42.072870 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-89738109-19f6-4f5e-842e-bf134718507f tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] [instance: 7b41cb07-71ed-4403-8d4c-65be6a3c2f4b] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:42.082670 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-89738109-19f6-4f5e-842e-bf134718507f tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:42.083451 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-89738109-19f6-4f5e-842e-bf134718507f tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:42.084613 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-89738109-19f6-4f5e-842e-bf134718507f tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:42.085659 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-89738109-19f6-4f5e-842e-bf134718507f tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:42.176996 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d0da5544-200d-40bf-8d5c-315c1c8c4cff tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0543f1a561a9442cbc9463ab752bd2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d306759c447edb6d013cf14ac53f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:42.188547 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d0da5544-200d-40bf-8d5c-315c1c8c4cff tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] 10.222.0.17 "GET /compute/v2.1/servers/163182e4-bfa7-4da7-9267-9cbb8a911183" status: 200 len: 1317 microversion: 2.1 time: 0.466641 Jul 23 21:26:42.189173 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1589/3265] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:41 2022] GET /compute/v2.1/servers/163182e4-bfa7-4da7-9267-9cbb8a911183 => generated 1317 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:42.423043 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5e2bd7b2-09bb-4409-8236-701223151ba0 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:42.424871 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5e2bd7b2-09bb-4409-8236-701223151ba0 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: 178abb32-365f-4ccd-828b-e69f6fe45370] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:42.443184 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5e2bd7b2-09bb-4409-8236-701223151ba0 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:42.444544 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5e2bd7b2-09bb-4409-8236-701223151ba0 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:42.447433 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5e2bd7b2-09bb-4409-8236-701223151ba0 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:42.449716 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5e2bd7b2-09bb-4409-8236-701223151ba0 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:42.574490 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-89738109-19f6-4f5e-842e-bf134718507f tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c74aa110064b4f85fef220e2d47b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b3be6b5fb4734bd9aeccbd35e3824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:42.595561 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-89738109-19f6-4f5e-842e-bf134718507f tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] 10.222.0.17 "GET /compute/v2.1/servers/7b41cb07-71ed-4403-8d4c-65be6a3c2f4b" status: 200 len: 1324 microversion: 2.1 time: 0.548823 Jul 23 21:26:42.596999 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1677/3266] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:42 2022] GET /compute/v2.1/servers/7b41cb07-71ed-4403-8d4c-65be6a3c2f4b => generated 1324 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:42.612765 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-4fdb242e-72ae-457f-b134-76bd99c12c48 req-f9438f72-c797-4f9b-b923-33ea9dd4914c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "178abb32-365f-4ccd-828b-e69f6fe45370", "tag": "54f48db7-b019-4df9-8c26-192df4b720c4"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:26:42.642657 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-4fdb242e-72ae-457f-b134-76bd99c12c48 req-f9438f72-c797-4f9b-b923-33ea9dd4914c service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:42.643095 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-4fdb242e-72ae-457f-b134-76bd99c12c48 req-f9438f72-c797-4f9b-b923-33ea9dd4914c service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:42.710906 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-4fdb242e-72ae-457f-b134-76bd99c12c48 req-f9438f72-c797-4f9b-b923-33ea9dd4914c service nova] Creating event network-changed:54f48db7-b019-4df9-8c26-192df4b720c4 for instance 178abb32-365f-4ccd-828b-e69f6fe45370 on nch2-master-1 Jul 23 21:26:42.752712 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell0:SELECT=4 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:26:42.755149 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-4fdb242e-72ae-457f-b134-76bd99c12c48 req-f9438f72-c797-4f9b-b923-33ea9dd4914c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.156589 Jul 23 21:26:42.760501 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1678/3267] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:26:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:26:42.783725 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-60887934-c5ca-48b2-9de3-ad775d9e2b6f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:42.796509 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-60887934-c5ca-48b2-9de3-ad775d9e2b6f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:42.827828 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-60887934-c5ca-48b2-9de3-ad775d9e2b6f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:42.828290 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-60887934-c5ca-48b2-9de3-ad775d9e2b6f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:42.829100 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-60887934-c5ca-48b2-9de3-ad775d9e2b6f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:42.829548 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-60887934-c5ca-48b2-9de3-ad775d9e2b6f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:43.156225 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-60887934-c5ca-48b2-9de3-ad775d9e2b6f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:43.159739 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:26:43.179515 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-60887934-c5ca-48b2-9de3-ad775d9e2b6f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:43.182983 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-60887934-c5ca-48b2-9de3-ad775d9e2b6f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:43.189434 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-60887934-c5ca-48b2-9de3-ad775d9e2b6f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.418779 Jul 23 21:26:43.190689 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1679/3268] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:26:42 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:26:43.208499 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-1ebf71f3-eda1-44bc-bddd-6335fb9530d7 req-ad6a9d59-00bc-431f-a114-77e1cbee7432 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "163182e4-bfa7-4da7-9267-9cbb8a911183", "tag": "311f22f9-8e33-46f2-9fc9-62d52b59f0d8"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:26:43.234493 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-1ebf71f3-eda1-44bc-bddd-6335fb9530d7 req-ad6a9d59-00bc-431f-a114-77e1cbee7432 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:43.238335 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-1ebf71f3-eda1-44bc-bddd-6335fb9530d7 req-ad6a9d59-00bc-431f-a114-77e1cbee7432 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:43.276697 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-1ebf71f3-eda1-44bc-bddd-6335fb9530d7 req-ad6a9d59-00bc-431f-a114-77e1cbee7432 service nova] Creating event network-changed:311f22f9-8e33-46f2-9fc9-62d52b59f0d8 for instance 163182e4-bfa7-4da7-9267-9cbb8a911183 on nch1-master-1 Jul 23 21:26:43.283444 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-1ebf71f3-eda1-44bc-bddd-6335fb9530d7 req-ad6a9d59-00bc-431f-a114-77e1cbee7432 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091149 Jul 23 21:26:43.286847 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1680/3269] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:26:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:26:43.293526 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d0b55aa4-ecd8-4653-9e32-ccd2fdc2611c tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:43.294875 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-d0b55aa4-ecd8-4653-9e32-ccd2fdc2611c tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] [instance: 73362a63-78d8-4890-8588-d112fb85c2bf] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:43.311066 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d0b55aa4-ecd8-4653-9e32-ccd2fdc2611c tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:43.312469 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d0b55aa4-ecd8-4653-9e32-ccd2fdc2611c tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:43.314116 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d0b55aa4-ecd8-4653-9e32-ccd2fdc2611c tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:43.314765 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d0b55aa4-ecd8-4653-9e32-ccd2fdc2611c tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:43.458843 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5e2bd7b2-09bb-4409-8236-701223151ba0 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:43.469351 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5e2bd7b2-09bb-4409-8236-701223151ba0 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/178abb32-365f-4ccd-828b-e69f6fe45370" status: 200 len: 1315 microversion: 2.1 time: 1.054616 Jul 23 21:26:43.469966 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1590/3270] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:42 2022] GET /compute/v2.1/servers/178abb32-365f-4ccd-828b-e69f6fe45370 => generated 1315 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:26:43.482676 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-649ab555-de7a-4ef6-9c66-ff0658d2408c tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:43.487670 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-649ab555-de7a-4ef6-9c66-ff0658d2408c tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: 06a478c3-f038-4813-a456-daf3a58b5749] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:43.499167 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-649ab555-de7a-4ef6-9c66-ff0658d2408c tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:43.501083 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-649ab555-de7a-4ef6-9c66-ff0658d2408c tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:43.503798 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-649ab555-de7a-4ef6-9c66-ff0658d2408c tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:43.504586 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-649ab555-de7a-4ef6-9c66-ff0658d2408c tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:43.676958 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-d0b55aa4-ecd8-4653-9e32-ccd2fdc2611c tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a609c39c14343e1bc1edd4b3cd56dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116def61aba4631be91f67df63ebab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:43.693219 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-d0b55aa4-ecd8-4653-9e32-ccd2fdc2611c tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] 10.222.0.17 "GET /compute/v2.1/servers/73362a63-78d8-4890-8588-d112fb85c2bf" status: 200 len: 1491 microversion: 2.1 time: 0.403946 Jul 23 21:26:43.704970 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1681/3271] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:43 2022] GET /compute/v2.1/servers/73362a63-78d8-4890-8588-d112fb85c2bf => generated 1491 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:43.710462 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-c34354e1-f712-4ad4-a216-41856d00c420 req-aa0e876d-c964-4dcb-b04b-c91be8a9a114 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b41cb07-71ed-4403-8d4c-65be6a3c2f4b", "name": "network-vif-plugged", "status": "completed", "tag": "5f41cae0-7b96-4511-98b1-f7306dc68f94"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:26:43.721659 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-c34354e1-f712-4ad4-a216-41856d00c420 req-aa0e876d-c964-4dcb-b04b-c91be8a9a114 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:43.722834 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-c34354e1-f712-4ad4-a216-41856d00c420 req-aa0e876d-c964-4dcb-b04b-c91be8a9a114 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:43.739344 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-c34354e1-f712-4ad4-a216-41856d00c420 req-aa0e876d-c964-4dcb-b04b-c91be8a9a114 service nova] Creating event network-vif-plugged:5f41cae0-7b96-4511-98b1-f7306dc68f94 for instance 7b41cb07-71ed-4403-8d4c-65be6a3c2f4b on nch2-master-1 Jul 23 21:26:43.746777 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-c34354e1-f712-4ad4-a216-41856d00c420 req-aa0e876d-c964-4dcb-b04b-c91be8a9a114 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039892 Jul 23 21:26:43.753976 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1682/3272] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:26:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:26:43.761245 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-6352b499-b87b-482d-9220-0db085c9f22b tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:43.762297 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-6352b499-b87b-482d-9220-0db085c9f22b tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] [instance: 163182e4-bfa7-4da7-9267-9cbb8a911183] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:43.771729 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6352b499-b87b-482d-9220-0db085c9f22b tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:43.772636 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6352b499-b87b-482d-9220-0db085c9f22b tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:43.773812 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6352b499-b87b-482d-9220-0db085c9f22b tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:43.774489 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6352b499-b87b-482d-9220-0db085c9f22b tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:44.063643 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-649ab555-de7a-4ef6-9c66-ff0658d2408c tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:44.072464 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-649ab555-de7a-4ef6-9c66-ff0658d2408c tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/06a478c3-f038-4813-a456-daf3a58b5749" status: 200 len: 1288 microversion: 2.1 time: 0.596301 Jul 23 21:26:44.077925 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1591/3273] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:43 2022] GET /compute/v2.1/servers/06a478c3-f038-4813-a456-daf3a58b5749 => generated 1288 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:44.079423 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-503f0252-c685-4ebd-9187-11a14783b2a8 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:44.080050 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-503f0252-c685-4ebd-9187-11a14783b2a8 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] [instance: 7b41cb07-71ed-4403-8d4c-65be6a3c2f4b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:44.087484 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-503f0252-c685-4ebd-9187-11a14783b2a8 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:44.088023 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-503f0252-c685-4ebd-9187-11a14783b2a8 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:44.088898 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-503f0252-c685-4ebd-9187-11a14783b2a8 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:44.089411 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-503f0252-c685-4ebd-9187-11a14783b2a8 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:44.476234 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-6352b499-b87b-482d-9220-0db085c9f22b tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0543f1a561a9442cbc9463ab752bd2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d306759c447edb6d013cf14ac53f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:44.484964 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-6352b499-b87b-482d-9220-0db085c9f22b tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] 10.222.0.17 "GET /compute/v2.1/servers/163182e4-bfa7-4da7-9267-9cbb8a911183" status: 200 len: 1317 microversion: 2.1 time: 0.728975 Jul 23 21:26:44.485931 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1683/3274] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:43 2022] GET /compute/v2.1/servers/163182e4-bfa7-4da7-9267-9cbb8a911183 => generated 1317 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:44.501449 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-efbc9480-0184-4e09-ba09-03af7b467009 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:44.502116 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-efbc9480-0184-4e09-ba09-03af7b467009 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:44.509067 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-efbc9480-0184-4e09-ba09-03af7b467009 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:44.509537 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-efbc9480-0184-4e09-ba09-03af7b467009 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:44.510360 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-efbc9480-0184-4e09-ba09-03af7b467009 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:44.510803 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-efbc9480-0184-4e09-ba09-03af7b467009 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:44.612107 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-efbc9480-0184-4e09-ba09-03af7b467009 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:44.623867 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-efbc9480-0184-4e09-ba09-03af7b467009 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:44.625422 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-efbc9480-0184-4e09-ba09-03af7b467009 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:44.626908 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-efbc9480-0184-4e09-ba09-03af7b467009 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.129728 Jul 23 21:26:44.627666 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1684/3275] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:26:44 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:26:44.632582 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-b0f0f227-0054-442d-8b55-a90cf9c39c91 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:44.633594 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-b0f0f227-0054-442d-8b55-a90cf9c39c91 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: 178abb32-365f-4ccd-828b-e69f6fe45370] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:44.646022 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b0f0f227-0054-442d-8b55-a90cf9c39c91 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:44.646530 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b0f0f227-0054-442d-8b55-a90cf9c39c91 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:44.647489 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b0f0f227-0054-442d-8b55-a90cf9c39c91 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:44.647918 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b0f0f227-0054-442d-8b55-a90cf9c39c91 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:44.694169 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-503f0252-c685-4ebd-9187-11a14783b2a8 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c74aa110064b4f85fef220e2d47b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b3be6b5fb4734bd9aeccbd35e3824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:44.702495 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-503f0252-c685-4ebd-9187-11a14783b2a8 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] 10.222.0.17 "GET /compute/v2.1/servers/7b41cb07-71ed-4403-8d4c-65be6a3c2f4b" status: 200 len: 1324 microversion: 2.1 time: 0.627253 Jul 23 21:26:44.703225 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1592/3276] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:44 2022] GET /compute/v2.1/servers/7b41cb07-71ed-4403-8d4c-65be6a3c2f4b => generated 1324 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:44.710712 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f63f9ab6-37e0-4a52-8323-bbda9fa8fc8b tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:44.711398 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f63f9ab6-37e0-4a52-8323-bbda9fa8fc8b tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] [instance: 73362a63-78d8-4890-8588-d112fb85c2bf] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:44.733089 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f63f9ab6-37e0-4a52-8323-bbda9fa8fc8b tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:44.733591 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f63f9ab6-37e0-4a52-8323-bbda9fa8fc8b tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:44.734463 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f63f9ab6-37e0-4a52-8323-bbda9fa8fc8b tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:44.734868 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f63f9ab6-37e0-4a52-8323-bbda9fa8fc8b tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:45.027279 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-b0f0f227-0054-442d-8b55-a90cf9c39c91 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:45.048891 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-b0f0f227-0054-442d-8b55-a90cf9c39c91 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/178abb32-365f-4ccd-828b-e69f6fe45370" status: 200 len: 1315 microversion: 2.1 time: 0.419775 Jul 23 21:26:45.049740 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1685/3277] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:44 2022] GET /compute/v2.1/servers/178abb32-365f-4ccd-828b-e69f6fe45370 => generated 1315 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:45.093766 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-1a10eedf-d7b4-420e-8453-ef4ec372605e tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:45.096673 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-1a10eedf-d7b4-420e-8453-ef4ec372605e tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: 06a478c3-f038-4813-a456-daf3a58b5749] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:45.109497 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1a10eedf-d7b4-420e-8453-ef4ec372605e tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:45.109993 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1a10eedf-d7b4-420e-8453-ef4ec372605e tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:45.110801 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1a10eedf-d7b4-420e-8453-ef4ec372605e tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:45.111254 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1a10eedf-d7b4-420e-8453-ef4ec372605e tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:45.245480 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-1a10eedf-d7b4-420e-8453-ef4ec372605e tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:45.254580 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f63f9ab6-37e0-4a52-8323-bbda9fa8fc8b tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a609c39c14343e1bc1edd4b3cd56dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116def61aba4631be91f67df63ebab0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:45.260985 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-1a10eedf-d7b4-420e-8453-ef4ec372605e tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/06a478c3-f038-4813-a456-daf3a58b5749" status: 200 len: 1276 microversion: 2.1 time: 0.174437 Jul 23 21:26:45.266211 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1686/3278] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:45 2022] GET /compute/v2.1/servers/06a478c3-f038-4813-a456-daf3a58b5749 => generated 1276 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:26:45.273028 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f63f9ab6-37e0-4a52-8323-bbda9fa8fc8b tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] 10.222.0.17 "GET /compute/v2.1/servers/73362a63-78d8-4890-8588-d112fb85c2bf" status: 200 len: 1491 microversion: 2.1 time: 0.566317 Jul 23 21:26:45.273875 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1593/3279] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:44 2022] GET /compute/v2.1/servers/73362a63-78d8-4890-8588-d112fb85c2bf => generated 1491 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:26:45.318592 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-d816e0c9-83be-434d-9f0f-190405c2f718 req-93496d84-cfda-4abf-b636-11644c5703ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14bdd0f5-f5bf-44bb-876f-2d257eae5fb0", "tag": "638f9b69-f16f-4d87-ad86-1c12e3530bb8"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:26:45.328202 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-d816e0c9-83be-434d-9f0f-190405c2f718 req-93496d84-cfda-4abf-b636-11644c5703ac service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:45.328894 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-d816e0c9-83be-434d-9f0f-190405c2f718 req-93496d84-cfda-4abf-b636-11644c5703ac service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:45.341084 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-d816e0c9-83be-434d-9f0f-190405c2f718 req-93496d84-cfda-4abf-b636-11644c5703ac service nova] Creating event network-changed:638f9b69-f16f-4d87-ad86-1c12e3530bb8 for instance 14bdd0f5-f5bf-44bb-876f-2d257eae5fb0 on nch1-master-1 Jul 23 21:26:45.347052 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-d816e0c9-83be-434d-9f0f-190405c2f718 req-93496d84-cfda-4abf-b636-11644c5703ac service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032119 Jul 23 21:26:45.348325 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1687/3280] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:26:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:26:45.360547 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-3fb246b8-bf46-4d0f-847a-4904ff7cc2b0 req-63070aff-76ba-4a89-a839-07d988381715 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d303403b-5d14-443b-a6fe-f8b579d24cda", "name": "network-vif-deleted", "tag": "01c1a8f9-053f-41ab-abe7-cf16d3d4127c"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:26:45.374832 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-3fb246b8-bf46-4d0f-847a-4904ff7cc2b0 req-63070aff-76ba-4a89-a839-07d988381715 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:45.375755 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-3fb246b8-bf46-4d0f-847a-4904ff7cc2b0 req-63070aff-76ba-4a89-a839-07d988381715 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:45.389225 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-3fb246b8-bf46-4d0f-847a-4904ff7cc2b0 req-63070aff-76ba-4a89-a839-07d988381715 service nova] Creating event network-vif-deleted:01c1a8f9-053f-41ab-abe7-cf16d3d4127c for instance d303403b-5d14-443b-a6fe-f8b579d24cda on nch1-master-1 Jul 23 21:26:45.396966 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-3fb246b8-bf46-4d0f-847a-4904ff7cc2b0 req-63070aff-76ba-4a89-a839-07d988381715 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039899 Jul 23 21:26:45.398363 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1594/3281] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:26:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:26:45.503946 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e420e999-9c42-4dba-b476-a7f3fff71561 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:45.504656 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-e420e999-9c42-4dba-b476-a7f3fff71561 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] [instance: 163182e4-bfa7-4da7-9267-9cbb8a911183] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:45.511198 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e420e999-9c42-4dba-b476-a7f3fff71561 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:45.512017 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e420e999-9c42-4dba-b476-a7f3fff71561 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:45.512970 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e420e999-9c42-4dba-b476-a7f3fff71561 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:45.513415 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e420e999-9c42-4dba-b476-a7f3fff71561 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:45.648489 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f4a53a0f-5a71-4e15-81a5-f6ad373e0136 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:45.649518 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f4a53a0f-5a71-4e15-81a5-f6ad373e0136 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:45.658643 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f4a53a0f-5a71-4e15-81a5-f6ad373e0136 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:45.659724 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f4a53a0f-5a71-4e15-81a5-f6ad373e0136 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:45.661243 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f4a53a0f-5a71-4e15-81a5-f6ad373e0136 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:45.661986 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f4a53a0f-5a71-4e15-81a5-f6ad373e0136 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:45.760712 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f4a53a0f-5a71-4e15-81a5-f6ad373e0136 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:45.772055 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f4a53a0f-5a71-4e15-81a5-f6ad373e0136 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:45.774077 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f4a53a0f-5a71-4e15-81a5-f6ad373e0136 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:45.775373 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f4a53a0f-5a71-4e15-81a5-f6ad373e0136 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.132941 Jul 23 21:26:45.782511 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1595/3282] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:26:45 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:26:45.789479 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f3ec931c-2a8b-41cc-8e21-ae4a32d6992b tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:45.790379 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f3ec931c-2a8b-41cc-8e21-ae4a32d6992b tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] [instance: 7b41cb07-71ed-4403-8d4c-65be6a3c2f4b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:45.798396 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f3ec931c-2a8b-41cc-8e21-ae4a32d6992b tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:45.799123 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f3ec931c-2a8b-41cc-8e21-ae4a32d6992b tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:45.801187 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f3ec931c-2a8b-41cc-8e21-ae4a32d6992b tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:45.801807 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f3ec931c-2a8b-41cc-8e21-ae4a32d6992b tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:45.839487 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-e420e999-9c42-4dba-b476-a7f3fff71561 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0543f1a561a9442cbc9463ab752bd2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d306759c447edb6d013cf14ac53f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:45.851528 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-e420e999-9c42-4dba-b476-a7f3fff71561 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] 10.222.0.17 "GET /compute/v2.1/servers/163182e4-bfa7-4da7-9267-9cbb8a911183" status: 200 len: 1317 microversion: 2.1 time: 0.351750 Jul 23 21:26:45.856257 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1688/3283] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:45 2022] GET /compute/v2.1/servers/163182e4-bfa7-4da7-9267-9cbb8a911183 => generated 1317 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:46.073808 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-7d9f21cd-3b8f-4eff-894e-442083242c27 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:46.084856 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-7d9f21cd-3b8f-4eff-894e-442083242c27 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: 178abb32-365f-4ccd-828b-e69f6fe45370] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:46.114402 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7d9f21cd-3b8f-4eff-894e-442083242c27 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:46.115854 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7d9f21cd-3b8f-4eff-894e-442083242c27 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:46.117444 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7d9f21cd-3b8f-4eff-894e-442083242c27 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:46.118284 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7d9f21cd-3b8f-4eff-894e-442083242c27 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:46.337743 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f3ec931c-2a8b-41cc-8e21-ae4a32d6992b tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c74aa110064b4f85fef220e2d47b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b3be6b5fb4734bd9aeccbd35e3824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:46.352132 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f3ec931c-2a8b-41cc-8e21-ae4a32d6992b tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] 10.222.0.17 "GET /compute/v2.1/servers/7b41cb07-71ed-4403-8d4c-65be6a3c2f4b" status: 200 len: 1324 microversion: 2.1 time: 0.566714 Jul 23 21:26:46.354658 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1596/3284] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:45 2022] GET /compute/v2.1/servers/7b41cb07-71ed-4403-8d4c-65be6a3c2f4b => generated 1324 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:46.369172 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8a1396d6-d2eb-453e-a960-a50fab9fef1d tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:46.370645 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8a1396d6-d2eb-453e-a960-a50fab9fef1d tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: 06a478c3-f038-4813-a456-daf3a58b5749] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:46.389771 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8a1396d6-d2eb-453e-a960-a50fab9fef1d tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:46.392118 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8a1396d6-d2eb-453e-a960-a50fab9fef1d tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:46.393406 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8a1396d6-d2eb-453e-a960-a50fab9fef1d tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:46.396271 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8a1396d6-d2eb-453e-a960-a50fab9fef1d tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:46.504230 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-7d9f21cd-3b8f-4eff-894e-442083242c27 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:46.512152 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-7d9f21cd-3b8f-4eff-894e-442083242c27 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/178abb32-365f-4ccd-828b-e69f6fe45370" status: 200 len: 1315 microversion: 2.1 time: 0.446963 Jul 23 21:26:46.513331 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1689/3285] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:46 2022] GET /compute/v2.1/servers/178abb32-365f-4ccd-828b-e69f6fe45370 => generated 1315 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:46.528166 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-17f9a780-d668-4464-82d9-f9e9c4b0aef5 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:46.529375 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-17f9a780-d668-4464-82d9-f9e9c4b0aef5 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] [instance: 73362a63-78d8-4890-8588-d112fb85c2bf] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:46.538066 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-17f9a780-d668-4464-82d9-f9e9c4b0aef5 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:46.538966 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-17f9a780-d668-4464-82d9-f9e9c4b0aef5 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:46.540232 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-17f9a780-d668-4464-82d9-f9e9c4b0aef5 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:46.540963 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-17f9a780-d668-4464-82d9-f9e9c4b0aef5 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:46.559965 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-17f9a780-d668-4464-82d9-f9e9c4b0aef5 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] HTTP exception thrown: Instance 73362a63-78d8-4890-8588-d112fb85c2bf could not be found. Jul 23 21:26:46.562138 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-17f9a780-d668-4464-82d9-f9e9c4b0aef5 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Request method failure captured: Jul 23 21:26:46.562138 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/servers/73362a63-78d8-4890-8588-d112fb85c2bf HTTP/1.1 Jul 23 21:26:46.562138 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:26:46.562138 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:26:46.562138 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:26:46.562138 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:26:46.562138 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:26:46.562138 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:26:46.562138 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:26:46.562138 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:26:46.562138 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GcVwaMD4-f4w7Azh6TxZ5WCaWQhA0PzMDqGyfuQesfeY0pzfwz3k1188-P0XhiQYDjG8e11wncD47Ht9HAD_DqEwZanHRWTP27X-YGC8aqwBFvomTfrR-z7k3hN4std3vKaGEbptoS6jNuqHtG9OR9_7RF1XQBJ2nzvh6JKQcsK7jc Jul 23 21:26:46.562138 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:26:46.562138 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:26:46.562138 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:26:46.562138 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:26:46.562138 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:26:46.562138 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:26:46.562138 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 9116def61aba4631be91f67df63ebab0 Jul 23 21:26:46.562138 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ServerRescueTestJSON-1343751565 Jul 23 21:26:46.562138 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:26:46.562138 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:26:46.562138 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9116def61aba4631be91f67df63ebab0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/9116def61aba4631be91f67df63ebab0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_9116def61aba4631be91f67df63ebab0", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/9116def61aba4631be91f67df63ebab0"}]}] Jul 23 21:26:46.562138 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ServerRescueTestJSON-1343751565 Jul 23 21:26:46.562138 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 9116def61aba4631be91f67df63ebab0 Jul 23 21:26:46.562138 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ServerRescueTestJSON-1343751565 Jul 23 21:26:46.562138 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ServerRescueTestJSON-1343751565-project Jul 23 21:26:46.562138 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:26:46.562138 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:26:46.562138 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 2a609c39c14343e1bc1edd4b3cd56dd4 Jul 23 21:26:46.562138 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ServerRescueTestJSON-1343751565-project Jul 23 21:26:46.562138 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:26:46.562138 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance 73362a63-78d8-4890-8588-d112fb85c2bf could not be found. Jul 23 21:26:46.562138 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': '73362a63-78d8-4890-8588-d112fb85c2bf'} Jul 23 21:26:46.562138 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:26:46.562138 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:26:46.562138 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:26:46.562138 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:26:46.562138 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:26:46.562138 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:26:46.562138 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:26:46.562138 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:26:46.562138 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:26:46.562138 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:26:46.562138 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73362a63-78d8-4890-8588-d112fb85c2bf could not be found. Jul 23 21:26:46.562138 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:46.562138 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:26:46.562138 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:46.562138 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:26:46.562138 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:26:46.562138 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:26:46.562138 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:26:46.562138 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:26:46.562138 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:26:46.562138 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:26:46.562138 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:26:46.562138 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:26:46.562138 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:26:46.562138 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:26:46.562138 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:26:46.562138 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:26:46.562138 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73362a63-78d8-4890-8588-d112fb85c2bf could not be found. Jul 23 21:26:46.562138 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:46.562138 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:26:46.562138 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:46.570061 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:26:46.570061 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:26:46.570061 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:26:46.570061 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:26:46.570061 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:26:46.570061 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73362a63-78d8-4890-8588-d112fb85c2bf could not be found. Jul 23 21:26:46.570061 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:46.571728 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-17f9a780-d668-4464-82d9-f9e9c4b0aef5 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] Returning 404 to user: Instance 73362a63-78d8-4890-8588-d112fb85c2bf could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:26:46.572826 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-17f9a780-d668-4464-82d9-f9e9c4b0aef5 tempest-ServerRescueTestJSON-1343751565 tempest-ServerRescueTestJSON-1343751565-project] 10.222.0.17 "GET /compute/v2.1/servers/73362a63-78d8-4890-8588-d112fb85c2bf" status: 404 len: 111 microversion: 2.1 time: 0.058233 Jul 23 21:26:46.573725 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1690/3286] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:46 2022] GET /compute/v2.1/servers/73362a63-78d8-4890-8588-d112fb85c2bf => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:26:46.801808 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-bf494f94-617d-4418-a30a-bfb72ad5a752 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:46.803014 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-bf494f94-617d-4418-a30a-bfb72ad5a752 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:46.855415 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bf494f94-617d-4418-a30a-bfb72ad5a752 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:46.855910 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bf494f94-617d-4418-a30a-bfb72ad5a752 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:46.856923 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bf494f94-617d-4418-a30a-bfb72ad5a752 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:46.859867 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bf494f94-617d-4418-a30a-bfb72ad5a752 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:47.026851 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-bf494f94-617d-4418-a30a-bfb72ad5a752 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:47.039217 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-bf494f94-617d-4418-a30a-bfb72ad5a752 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:47.041292 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-bf494f94-617d-4418-a30a-bfb72ad5a752 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:47.043362 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-bf494f94-617d-4418-a30a-bfb72ad5a752 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.252005 Jul 23 21:26:47.056488 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1691/3287] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:26:46 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:26:47.063008 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-db33a414-8309-417e-82ea-0fbff45ff374 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:47.063899 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-db33a414-8309-417e-82ea-0fbff45ff374 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] [instance: 163182e4-bfa7-4da7-9267-9cbb8a911183] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:47.071111 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-db33a414-8309-417e-82ea-0fbff45ff374 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:47.071966 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-db33a414-8309-417e-82ea-0fbff45ff374 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:47.073007 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-db33a414-8309-417e-82ea-0fbff45ff374 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:47.073670 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-db33a414-8309-417e-82ea-0fbff45ff374 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:47.218860 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8a1396d6-d2eb-453e-a960-a50fab9fef1d tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:47.230492 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8a1396d6-d2eb-453e-a960-a50fab9fef1d tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/06a478c3-f038-4813-a456-daf3a58b5749" status: 200 len: 1318 microversion: 2.1 time: 0.874007 Jul 23 21:26:47.242648 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1597/3288] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:46 2022] GET /compute/v2.1/servers/06a478c3-f038-4813-a456-daf3a58b5749 => generated 1318 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:47.321052 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-db33a414-8309-417e-82ea-0fbff45ff374 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0543f1a561a9442cbc9463ab752bd2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d306759c447edb6d013cf14ac53f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:47.341272 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-db33a414-8309-417e-82ea-0fbff45ff374 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] 10.222.0.17 "GET /compute/v2.1/servers/163182e4-bfa7-4da7-9267-9cbb8a911183" status: 200 len: 1317 microversion: 2.1 time: 0.283093 Jul 23 21:26:47.343016 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1692/3289] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:47 2022] GET /compute/v2.1/servers/163182e4-bfa7-4da7-9267-9cbb8a911183 => generated 1317 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:47.371683 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ebe48fed-4675-47a8-9004-50cec61e3b85 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:47.372302 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ebe48fed-4675-47a8-9004-50cec61e3b85 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] [instance: 7b41cb07-71ed-4403-8d4c-65be6a3c2f4b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:47.379285 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ebe48fed-4675-47a8-9004-50cec61e3b85 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:47.380936 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ebe48fed-4675-47a8-9004-50cec61e3b85 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:47.382042 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ebe48fed-4675-47a8-9004-50cec61e3b85 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:47.382688 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ebe48fed-4675-47a8-9004-50cec61e3b85 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:47.425367 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-b6fd7a2e-bac5-4fd2-97cc-ee4a3f6c3c9c req-91c7a38f-c830-48c5-a47b-e6ed707297a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73362a63-78d8-4890-8588-d112fb85c2bf", "name": "network-vif-deleted", "tag": "53cbd32e-7839-4bd5-bd13-f1cc7de68a33"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:26:47.442533 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-b6fd7a2e-bac5-4fd2-97cc-ee4a3f6c3c9c req-91c7a38f-c830-48c5-a47b-e6ed707297a8 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:47.444124 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-b6fd7a2e-bac5-4fd2-97cc-ee4a3f6c3c9c req-91c7a38f-c830-48c5-a47b-e6ed707297a8 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:47.471791 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-b6fd7a2e-bac5-4fd2-97cc-ee4a3f6c3c9c req-91c7a38f-c830-48c5-a47b-e6ed707297a8 service nova] Creating event network-vif-deleted:53cbd32e-7839-4bd5-bd13-f1cc7de68a33 for instance 73362a63-78d8-4890-8588-d112fb85c2bf on nch1-master-1 Jul 23 21:26:47.484143 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-b6fd7a2e-bac5-4fd2-97cc-ee4a3f6c3c9c req-91c7a38f-c830-48c5-a47b-e6ed707297a8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062509 Jul 23 21:26:47.486965 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1693/3290] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:26:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:26:47.533177 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-abd9ee3d-f9ad-42d7-b232-5b70f3581471 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:47.534128 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-abd9ee3d-f9ad-42d7-b232-5b70f3581471 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: 178abb32-365f-4ccd-828b-e69f6fe45370] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:47.542460 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-abd9ee3d-f9ad-42d7-b232-5b70f3581471 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:47.543246 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-abd9ee3d-f9ad-42d7-b232-5b70f3581471 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:47.544234 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-abd9ee3d-f9ad-42d7-b232-5b70f3581471 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:47.544907 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-abd9ee3d-f9ad-42d7-b232-5b70f3581471 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:48.081198 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-abd9ee3d-f9ad-42d7-b232-5b70f3581471 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:48.094539 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-abd9ee3d-f9ad-42d7-b232-5b70f3581471 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/178abb32-365f-4ccd-828b-e69f6fe45370" status: 200 len: 1315 microversion: 2.1 time: 0.566807 Jul 23 21:26:48.095513 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1694/3291] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:47 2022] GET /compute/v2.1/servers/178abb32-365f-4ccd-828b-e69f6fe45370 => generated 1315 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:48.102970 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ff556f3d-b62e-4217-addd-f3dff3c69e2e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:48.108911 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-ff556f3d-b62e-4217-addd-f3dff3c69e2e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:48.121695 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ff556f3d-b62e-4217-addd-f3dff3c69e2e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:48.126749 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ff556f3d-b62e-4217-addd-f3dff3c69e2e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:48.131601 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ff556f3d-b62e-4217-addd-f3dff3c69e2e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:48.132301 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ff556f3d-b62e-4217-addd-f3dff3c69e2e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:48.344674 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ebe48fed-4675-47a8-9004-50cec61e3b85 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c74aa110064b4f85fef220e2d47b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b3be6b5fb4734bd9aeccbd35e3824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:48.354660 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ebe48fed-4675-47a8-9004-50cec61e3b85 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] 10.222.0.17 "GET /compute/v2.1/servers/7b41cb07-71ed-4403-8d4c-65be6a3c2f4b" status: 200 len: 1519 microversion: 2.1 time: 0.986930 Jul 23 21:26:48.356274 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1598/3292] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:47 2022] GET /compute/v2.1/servers/7b41cb07-71ed-4403-8d4c-65be6a3c2f4b => generated 1519 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:48.412325 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-266656e7-1e65-4969-af92-763607a3ffc0 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:48.416565 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-266656e7-1e65-4969-af92-763607a3ffc0 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: 06a478c3-f038-4813-a456-daf3a58b5749] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:48.431424 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-266656e7-1e65-4969-af92-763607a3ffc0 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:48.433983 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-266656e7-1e65-4969-af92-763607a3ffc0 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:48.435062 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-266656e7-1e65-4969-af92-763607a3ffc0 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:48.438617 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-266656e7-1e65-4969-af92-763607a3ffc0 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:48.579568 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ff556f3d-b62e-4217-addd-f3dff3c69e2e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:48.598514 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ff556f3d-b62e-4217-addd-f3dff3c69e2e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:48.601018 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ff556f3d-b62e-4217-addd-f3dff3c69e2e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:48.602652 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-ff556f3d-b62e-4217-addd-f3dff3c69e2e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.504814 Jul 23 21:26:48.604075 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1695/3293] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:26:48 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:26:48.625835 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-28822bcd-177c-456c-b4bb-238e3bd580c8 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:48.626730 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-28822bcd-177c-456c-b4bb-238e3bd580c8 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] [instance: 163182e4-bfa7-4da7-9267-9cbb8a911183] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:48.636327 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-28822bcd-177c-456c-b4bb-238e3bd580c8 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:48.637588 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-28822bcd-177c-456c-b4bb-238e3bd580c8 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:48.639218 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-28822bcd-177c-456c-b4bb-238e3bd580c8 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:48.641295 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-28822bcd-177c-456c-b4bb-238e3bd580c8 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:48.885953 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-266656e7-1e65-4969-af92-763607a3ffc0 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:48.896353 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-266656e7-1e65-4969-af92-763607a3ffc0 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/06a478c3-f038-4813-a456-daf3a58b5749" status: 200 len: 1318 microversion: 2.1 time: 0.528288 Jul 23 21:26:48.897874 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1599/3294] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:48 2022] GET /compute/v2.1/servers/06a478c3-f038-4813-a456-daf3a58b5749 => generated 1318 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:48.906436 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-7a20277b-c924-4a1c-90ae-42418ea0ba05 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1132841240", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "cb6686b4-1765-4f99-9801-c6a5d6418a10"}]}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:26:48.910513 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-7a20277b-c924-4a1c-90ae-42418ea0ba05 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Request method failure captured: Jul 23 21:26:48.910513 ncdv-master-1 devstack@n-api.service[131320]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 23 21:26:48.910513 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:26:48.910513 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:26:48.910513 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:26:48.910513 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 243 Jul 23 21:26:48.910513 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:26:48.910513 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:26:48.910513 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:26:48.910513 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:26:48.910513 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GeD-C0KhfDo5QfL61Slq0RBwJfZgT6PQOxG6Oa0UyFRLrDHFzYSiGKQ9TZXLf6riilc4WNfhLK9J23crHfUGS-aIlJoCmR0nM8_4pntU4gvxJOssT3gVahHjJQA9KwW8xPbL8KohWeOpvX-s1ceABvzQw_j7k-pzebMDWT6F9NUszg Jul 23 21:26:48.910513 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:26:48.910513 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:26:48.910513 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:26:48.910513 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:26:48.910513 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:26:48.910513 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:26:48.910513 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 766b3be6b5fb4734bd9aeccbd35e3824 Jul 23 21:26:48.910513 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-231957292 Jul 23 21:26:48.910513 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:26:48.910513 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:26:48.910513 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/766b3be6b5fb4734bd9aeccbd35e3824"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/766b3be6b5fb4734bd9aeccbd35e3824"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_766b3be6b5fb4734bd9aeccbd35e3824", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/766b3be6b5fb4734bd9aeccbd35e3824"}]}] Jul 23 21:26:48.910513 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-231957292 Jul 23 21:26:48.910513 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 766b3be6b5fb4734bd9aeccbd35e3824 Jul 23 21:26:48.910513 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-231957292 Jul 23 21:26:48.910513 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServerMetadataNegativeTestJSON-231957292-project Jul 23 21:26:48.910513 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:26:48.910513 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:26:48.910513 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 38c74aa110064b4f85fef220e2d47b4f Jul 23 21:26:48.910513 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-231957292-project Jul 23 21:26:48.910513 ncdv-master-1 devstack@n-api.service[131320]: Jul 23 21:26:48.910513 ncdv-master-1 devstack@n-api.service[131320]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1132841240", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "cb6686b4-1765-4f99-9801-c6a5d6418a10"}]}} Jul 23 21:26:48.910513 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:26:48.910513 ncdv-master-1 devstack@n-api.service[131320]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 23 21:26:48.910513 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1132841240', 'imageRef': 'b27b20aa-ef1b-4dd1-989e-321af6343d6a', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': 'cb6686b4-1765-4f99-9801-c6a5d6418a10'}]}}} Jul 23 21:26:48.910513 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:26:48.910513 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:26:48.910513 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 23 21:26:48.910513 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 23 21:26:48.910513 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 23 21:26:48.910513 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise error Jul 23 21:26:48.910513 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 23 21:26:48.910513 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:26:48.910513 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 23 21:26:48.910513 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 23 21:26:48.910513 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 23 21:26:48.910513 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 23 21:26:48.910513 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 23 21:26:48.910513 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:26:48.910513 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 23 21:26:48.910513 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi {'': 'data1'} Jul 23 21:26:48.910513 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:26:48.910513 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:26:48.910513 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:26:48.910513 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:26:48.910513 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:26:48.910513 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:26:48.910513 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:26:48.910513 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:26:48.910513 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:26:48.910513 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:26:48.910513 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:26:48.910513 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:26:48.914796 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 23 21:26:48.914796 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 23 21:26:48.914796 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 23 21:26:48.914796 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 23 21:26:48.914796 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 23 21:26:48.914796 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 23 21:26:48.914796 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 23 21:26:48.914796 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:26:48.914796 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:26:48.914796 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:26:48.914796 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:26:48.914796 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:26:48.914796 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:26:48.914796 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 23 21:26:48.914796 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 23 21:26:48.914796 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 23 21:26:48.914796 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:26:48.917797 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-7a20277b-c924-4a1c-90ae-42418ea0ba05 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:26:48.920239 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-7a20277b-c924-4a1c-90ae-42418ea0ba05 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.021209 Jul 23 21:26:48.927937 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1600/3295] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:26:48 2022] POST /compute/v2.1/servers => generated 175 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 23 21:26:48.935378 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-daf8eca8-3b64-4184-ab15-c94bcac61f9d tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:48.936054 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-daf8eca8-3b64-4184-ab15-c94bcac61f9d tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] [instance: 56996a04-7fbb-44be-840f-667d921b5840] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:48.946653 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-daf8eca8-3b64-4184-ab15-c94bcac61f9d tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] HTTP exception thrown: Instance 56996a04-7fbb-44be-840f-667d921b5840 could not be found. Jul 23 21:26:48.955551 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-daf8eca8-3b64-4184-ab15-c94bcac61f9d tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Request method failure captured: Jul 23 21:26:48.955551 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/56996a04-7fbb-44be-840f-667d921b5840/metadata HTTP/1.1 Jul 23 21:26:48.955551 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:26:48.955551 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:26:48.955551 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:26:48.955551 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:26:48.955551 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:26:48.955551 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:26:48.955551 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:26:48.955551 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:26:48.955551 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GeD-C0KhfDo5QfL61Slq0RBwJfZgT6PQOxG6Oa0UyFRLrDHFzYSiGKQ9TZXLf6riilc4WNfhLK9J23crHfUGS-aIlJoCmR0nM8_4pntU4gvxJOssT3gVahHjJQA9KwW8xPbL8KohWeOpvX-s1ceABvzQw_j7k-pzebMDWT6F9NUszg Jul 23 21:26:48.955551 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:26:48.955551 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:26:48.955551 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:26:48.955551 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:26:48.955551 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:26:48.955551 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:26:48.955551 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 766b3be6b5fb4734bd9aeccbd35e3824 Jul 23 21:26:48.955551 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-231957292 Jul 23 21:26:48.955551 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:26:48.955551 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:26:48.955551 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/766b3be6b5fb4734bd9aeccbd35e3824"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/766b3be6b5fb4734bd9aeccbd35e3824"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_766b3be6b5fb4734bd9aeccbd35e3824", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/766b3be6b5fb4734bd9aeccbd35e3824"}]}] Jul 23 21:26:48.955551 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-231957292 Jul 23 21:26:48.955551 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 766b3be6b5fb4734bd9aeccbd35e3824 Jul 23 21:26:48.955551 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-231957292 Jul 23 21:26:48.955551 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServerMetadataNegativeTestJSON-231957292-project Jul 23 21:26:48.955551 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:26:48.955551 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:26:48.955551 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 38c74aa110064b4f85fef220e2d47b4f Jul 23 21:26:48.955551 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-231957292-project Jul 23 21:26:48.955551 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:26:48.955551 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance 56996a04-7fbb-44be-840f-667d921b5840 could not be found. Jul 23 21:26:48.955551 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'server_id': '56996a04-7fbb-44be-840f-667d921b5840'} Jul 23 21:26:48.955551 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:26:48.955551 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:26:48.955551 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:26:48.955551 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:26:48.955551 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:26:48.955551 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:26:48.955551 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 23 21:26:48.955551 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 23 21:26:48.955551 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56996a04-7fbb-44be-840f-667d921b5840 could not be found. Jul 23 21:26:48.955551 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:26:48.955551 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:26:48.955551 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:26:48.955551 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:26:48.955551 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:26:48.955551 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:26:48.955551 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:26:48.955551 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:26:48.955551 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:26:48.955551 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:26:48.955551 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Jul 23 21:26:48.955551 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Jul 23 21:26:48.955551 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:26:48.955551 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:26:48.955551 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56996a04-7fbb-44be-840f-667d921b5840 could not be found. Jul 23 21:26:48.955551 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:26:48.955551 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:26:48.955551 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:26:48.955551 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:26:48.955551 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:26:48.955551 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:26:48.960405 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:26:48.960405 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:26:48.960405 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56996a04-7fbb-44be-840f-667d921b5840 could not be found. Jul 23 21:26:48.960405 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:26:48.960405 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-daf8eca8-3b64-4184-ab15-c94bcac61f9d tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Returning 404 to user: Instance 56996a04-7fbb-44be-840f-667d921b5840 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:26:48.960405 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-daf8eca8-3b64-4184-ab15-c94bcac61f9d tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] 10.222.0.17 "GET /compute/v2.1/servers/56996a04-7fbb-44be-840f-667d921b5840/metadata" status: 404 len: 111 microversion: 2.1 time: 0.027282 Jul 23 21:26:48.963712 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1601/3296] 10.222.0.17 () {58 vars in 1262 bytes} [Sat Jul 23 21:26:48 2022] GET /compute/v2.1/servers/56996a04-7fbb-44be-840f-667d921b5840/metadata => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:26:49.041721 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-24e457a6-1218-4aa1-abc9-08712c9b8da9 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1729979639", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "cb6686b4-1765-4f99-9801-c6a5d6418a10"}]}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:26:49.045251 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-24e457a6-1218-4aa1-abc9-08712c9b8da9 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Request method failure captured: Jul 23 21:26:49.045251 ncdv-master-1 devstack@n-api.service[131320]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 23 21:26:49.045251 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:26:49.045251 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:26:49.045251 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:26:49.045251 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 499 Jul 23 21:26:49.045251 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:26:49.045251 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:26:49.045251 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:26:49.045251 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:26:49.045251 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GeD-C0KhfDo5QfL61Slq0RBwJfZgT6PQOxG6Oa0UyFRLrDHFzYSiGKQ9TZXLf6riilc4WNfhLK9J23crHfUGS-aIlJoCmR0nM8_4pntU4gvxJOssT3gVahHjJQA9KwW8xPbL8KohWeOpvX-s1ceABvzQw_j7k-pzebMDWT6F9NUszg Jul 23 21:26:49.045251 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:26:49.045251 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:26:49.045251 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:26:49.045251 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:26:49.045251 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:26:49.045251 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:26:49.045251 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 766b3be6b5fb4734bd9aeccbd35e3824 Jul 23 21:26:49.045251 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-231957292 Jul 23 21:26:49.045251 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:26:49.045251 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:26:49.045251 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/766b3be6b5fb4734bd9aeccbd35e3824"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/766b3be6b5fb4734bd9aeccbd35e3824"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_766b3be6b5fb4734bd9aeccbd35e3824", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/766b3be6b5fb4734bd9aeccbd35e3824"}]}] Jul 23 21:26:49.045251 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-231957292 Jul 23 21:26:49.045251 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 766b3be6b5fb4734bd9aeccbd35e3824 Jul 23 21:26:49.045251 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-231957292 Jul 23 21:26:49.045251 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServerMetadataNegativeTestJSON-231957292-project Jul 23 21:26:49.045251 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:26:49.045251 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:26:49.045251 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 38c74aa110064b4f85fef220e2d47b4f Jul 23 21:26:49.045251 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-231957292-project Jul 23 21:26:49.045251 ncdv-master-1 devstack@n-api.service[131320]: Jul 23 21:26:49.045251 ncdv-master-1 devstack@n-api.service[131320]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1729979639", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "cb6686b4-1765-4f99-9801-c6a5d6418a10"}]}} Jul 23 21:26:49.045251 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:26:49.045251 ncdv-master-1 devstack@n-api.service[131320]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 23 21:26:49.045251 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1729979639', 'imageRef': 'b27b20aa-ef1b-4dd1-989e-321af6343d6a', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'cb6686b4-1765-4f99-9801-c6a5d6418a10'}]}}} Jul 23 21:26:49.045251 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:26:49.045251 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:26:49.045251 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 23 21:26:49.045251 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 23 21:26:49.045251 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 23 21:26:49.045251 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise error Jul 23 21:26:49.045251 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 23 21:26:49.045251 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:26:49.045251 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 23 21:26:49.045251 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 23 21:26:49.045251 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 23 21:26:49.045251 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 23 21:26:49.045251 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 23 21:26:49.048351 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:26:49.048351 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 23 21:26:49.048351 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 23 21:26:49.048351 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:26:49.048351 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:26:49.048351 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:26:49.048351 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:26:49.048351 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:26:49.048351 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:26:49.048351 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:26:49.048351 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:26:49.048351 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:26:49.048351 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:26:49.048351 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:26:49.048351 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:26:49.048351 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 23 21:26:49.048351 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 23 21:26:49.048351 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 23 21:26:49.048351 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 23 21:26:49.048351 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 23 21:26:49.048351 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 23 21:26:49.048351 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 23 21:26:49.048351 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:26:49.048351 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:26:49.048351 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:26:49.048351 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:26:49.048351 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:26:49.048351 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:26:49.048351 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 23 21:26:49.048351 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 23 21:26:49.048351 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 23 21:26:49.048351 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:26:49.052933 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-24e457a6-1218-4aa1-abc9-08712c9b8da9 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:26:49.054062 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-24e457a6-1218-4aa1-abc9-08712c9b8da9 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.016340 Jul 23 21:26:49.059642 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1602/3297] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:26:49 2022] POST /compute/v2.1/servers => generated 687 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 23 21:26:49.111615 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2b251e72-8fc6-461c-aeaf-f931698ec05d tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:49.112947 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-2b251e72-8fc6-461c-aeaf-f931698ec05d tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: 178abb32-365f-4ccd-828b-e69f6fe45370] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:49.126328 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2b251e72-8fc6-461c-aeaf-f931698ec05d tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:49.127505 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2b251e72-8fc6-461c-aeaf-f931698ec05d tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:49.129948 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2b251e72-8fc6-461c-aeaf-f931698ec05d tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:49.131646 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2b251e72-8fc6-461c-aeaf-f931698ec05d tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:49.160549 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-28822bcd-177c-456c-b4bb-238e3bd580c8 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0543f1a561a9442cbc9463ab752bd2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d306759c447edb6d013cf14ac53f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:49.173223 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-28822bcd-177c-456c-b4bb-238e3bd580c8 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] 10.222.0.17 "GET /compute/v2.1/servers/163182e4-bfa7-4da7-9267-9cbb8a911183" status: 200 len: 1317 microversion: 2.1 time: 0.552065 Jul 23 21:26:49.185272 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1696/3298] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:48 2022] GET /compute/v2.1/servers/163182e4-bfa7-4da7-9267-9cbb8a911183 => generated 1317 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:49.197905 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e712fd2b-c37b-4353-b97b-9a7d9671467f tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-749091353", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "cb6686b4-1765-4f99-9801-c6a5d6418a10"}]}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:26:49.204515 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e712fd2b-c37b-4353-b97b-9a7d9671467f tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Request method failure captured: Jul 23 21:26:49.204515 ncdv-master-1 devstack@n-api.service[131321]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 23 21:26:49.204515 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:26:49.204515 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:26:49.204515 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:26:49.204515 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 499 Jul 23 21:26:49.204515 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:26:49.204515 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:26:49.204515 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:26:49.204515 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:26:49.204515 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GeD-C0KhfDo5QfL61Slq0RBwJfZgT6PQOxG6Oa0UyFRLrDHFzYSiGKQ9TZXLf6riilc4WNfhLK9J23crHfUGS-aIlJoCmR0nM8_4pntU4gvxJOssT3gVahHjJQA9KwW8xPbL8KohWeOpvX-s1ceABvzQw_j7k-pzebMDWT6F9NUszg Jul 23 21:26:49.204515 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:26:49.204515 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:26:49.204515 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:26:49.204515 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:26:49.204515 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:26:49.204515 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:26:49.204515 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 766b3be6b5fb4734bd9aeccbd35e3824 Jul 23 21:26:49.204515 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-231957292 Jul 23 21:26:49.204515 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:26:49.204515 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:26:49.204515 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/766b3be6b5fb4734bd9aeccbd35e3824"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/766b3be6b5fb4734bd9aeccbd35e3824"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_766b3be6b5fb4734bd9aeccbd35e3824", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/766b3be6b5fb4734bd9aeccbd35e3824"}]}] Jul 23 21:26:49.204515 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-231957292 Jul 23 21:26:49.204515 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 766b3be6b5fb4734bd9aeccbd35e3824 Jul 23 21:26:49.204515 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-231957292 Jul 23 21:26:49.204515 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ServerMetadataNegativeTestJSON-231957292-project Jul 23 21:26:49.204515 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:26:49.204515 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:26:49.204515 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 38c74aa110064b4f85fef220e2d47b4f Jul 23 21:26:49.204515 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-231957292-project Jul 23 21:26:49.204515 ncdv-master-1 devstack@n-api.service[131321]: Jul 23 21:26:49.204515 ncdv-master-1 devstack@n-api.service[131321]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-749091353", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "cb6686b4-1765-4f99-9801-c6a5d6418a10"}]}} Jul 23 21:26:49.204515 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:26:49.204515 ncdv-master-1 devstack@n-api.service[131321]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 23 21:26:49.204515 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-749091353', 'imageRef': 'b27b20aa-ef1b-4dd1-989e-321af6343d6a', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'cb6686b4-1765-4f99-9801-c6a5d6418a10'}]}}} Jul 23 21:26:49.204515 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:26:49.204515 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:26:49.204515 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 23 21:26:49.204515 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 23 21:26:49.204515 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 23 21:26:49.204515 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise error Jul 23 21:26:49.204515 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 23 21:26:49.204515 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:49.204515 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 23 21:26:49.204515 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 23 21:26:49.204515 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 23 21:26:49.204515 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 23 21:26:49.204515 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 23 21:26:49.207799 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:49.207799 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 23 21:26:49.207799 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 23 21:26:49.207799 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:49.207799 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:26:49.207799 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:49.207799 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:26:49.207799 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:26:49.207799 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:26:49.207799 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:26:49.207799 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:26:49.207799 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:26:49.207799 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:26:49.207799 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:26:49.207799 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:26:49.207799 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 23 21:26:49.207799 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 23 21:26:49.207799 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 23 21:26:49.207799 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 23 21:26:49.207799 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 23 21:26:49.207799 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 23 21:26:49.207799 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 23 21:26:49.207799 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:49.207799 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:26:49.207799 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:49.207799 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:26:49.207799 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:26:49.207799 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:26:49.207799 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 23 21:26:49.207799 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 23 21:26:49.207799 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 23 21:26:49.207799 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:49.207799 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e712fd2b-c37b-4353-b97b-9a7d9671467f tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:26:49.209945 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-e712fd2b-c37b-4353-b97b-9a7d9671467f tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.021512 Jul 23 21:26:49.211839 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1697/3299] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:26:49 2022] POST /compute/v2.1/servers => generated 689 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 23 21:26:49.268651 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-32cd69c2-a34b-4756-909f-b9cb061a6aba tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-484068190", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "cb6686b4-1765-4f99-9801-c6a5d6418a10"}]}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:26:49.271845 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-32cd69c2-a34b-4756-909f-b9cb061a6aba tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Request method failure captured: Jul 23 21:26:49.271845 ncdv-master-1 devstack@n-api.service[131321]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 23 21:26:49.271845 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:26:49.271845 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:26:49.271845 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:26:49.271845 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 753 Jul 23 21:26:49.271845 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:26:49.271845 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:26:49.271845 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:26:49.271845 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:26:49.271845 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GeD-C0KhfDo5QfL61Slq0RBwJfZgT6PQOxG6Oa0UyFRLrDHFzYSiGKQ9TZXLf6riilc4WNfhLK9J23crHfUGS-aIlJoCmR0nM8_4pntU4gvxJOssT3gVahHjJQA9KwW8xPbL8KohWeOpvX-s1ceABvzQw_j7k-pzebMDWT6F9NUszg Jul 23 21:26:49.271845 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:26:49.271845 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:26:49.271845 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:26:49.271845 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:26:49.271845 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:26:49.271845 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:26:49.271845 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 766b3be6b5fb4734bd9aeccbd35e3824 Jul 23 21:26:49.271845 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-231957292 Jul 23 21:26:49.271845 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:26:49.271845 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:26:49.271845 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/766b3be6b5fb4734bd9aeccbd35e3824"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/766b3be6b5fb4734bd9aeccbd35e3824"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_766b3be6b5fb4734bd9aeccbd35e3824", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/766b3be6b5fb4734bd9aeccbd35e3824"}]}] Jul 23 21:26:49.271845 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-231957292 Jul 23 21:26:49.271845 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 766b3be6b5fb4734bd9aeccbd35e3824 Jul 23 21:26:49.271845 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-231957292 Jul 23 21:26:49.271845 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ServerMetadataNegativeTestJSON-231957292-project Jul 23 21:26:49.271845 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:26:49.271845 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:26:49.271845 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 38c74aa110064b4f85fef220e2d47b4f Jul 23 21:26:49.271845 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-231957292-project Jul 23 21:26:49.271845 ncdv-master-1 devstack@n-api.service[131321]: Jul 23 21:26:49.271845 ncdv-master-1 devstack@n-api.service[131321]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-484068190", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "cb6686b4-1765-4f99-9801-c6a5d6418a10"}]}} Jul 23 21:26:49.271845 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:26:49.271845 ncdv-master-1 devstack@n-api.service[131321]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 23 21:26:49.271845 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-484068190', 'imageRef': 'b27b20aa-ef1b-4dd1-989e-321af6343d6a', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'cb6686b4-1765-4f99-9801-c6a5d6418a10'}]}}} Jul 23 21:26:49.271845 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:26:49.271845 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:26:49.271845 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 23 21:26:49.271845 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 23 21:26:49.271845 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 23 21:26:49.274886 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise error Jul 23 21:26:49.274886 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 23 21:26:49.274886 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:49.274886 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 23 21:26:49.274886 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 23 21:26:49.274886 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 23 21:26:49.274886 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 23 21:26:49.274886 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 23 21:26:49.274886 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:49.274886 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 23 21:26:49.274886 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 23 21:26:49.274886 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:49.274886 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:26:49.274886 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:49.274886 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:26:49.274886 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:26:49.274886 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:26:49.274886 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:26:49.274886 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:26:49.274886 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:26:49.274886 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:26:49.274886 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:26:49.274886 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:26:49.274886 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 23 21:26:49.274886 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 23 21:26:49.274886 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 23 21:26:49.274886 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 23 21:26:49.274886 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 23 21:26:49.274886 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 23 21:26:49.274886 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 23 21:26:49.274886 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:49.274886 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:26:49.274886 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:49.274886 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:26:49.274886 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:26:49.274886 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:26:49.274886 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 23 21:26:49.274886 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 23 21:26:49.277955 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 23 21:26:49.277955 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:49.279154 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-32cd69c2-a34b-4756-909f-b9cb061a6aba tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:26:49.281248 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-32cd69c2-a34b-4756-909f-b9cb061a6aba tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.016865 Jul 23 21:26:49.283000 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1698/3300] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:26:49 2022] POST /compute/v2.1/servers => generated 1197 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 382 bytes (2 switches on core 0) Jul 23 21:26:49.347167 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-23bf90cf-cd9a-4b3d-b359-62a8ecef6d0f req-e6d35cb6-9021-4e78-877c-1da773b895e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "178abb32-365f-4ccd-828b-e69f6fe45370", "name": "network-vif-plugged", "status": "completed", "tag": "54f48db7-b019-4df9-8c26-192df4b720c4"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:26:49.366004 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-23bf90cf-cd9a-4b3d-b359-62a8ecef6d0f req-e6d35cb6-9021-4e78-877c-1da773b895e9 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:49.366620 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-23bf90cf-cd9a-4b3d-b359-62a8ecef6d0f req-e6d35cb6-9021-4e78-877c-1da773b895e9 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:49.382629 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-23bf90cf-cd9a-4b3d-b359-62a8ecef6d0f req-e6d35cb6-9021-4e78-877c-1da773b895e9 service nova] Creating event network-vif-plugged:54f48db7-b019-4df9-8c26-192df4b720c4 for instance 178abb32-365f-4ccd-828b-e69f6fe45370 on nch2-master-1 Jul 23 21:26:49.394905 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-23bf90cf-cd9a-4b3d-b359-62a8ecef6d0f req-e6d35cb6-9021-4e78-877c-1da773b895e9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052708 Jul 23 21:26:49.397061 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1699/3301] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:26:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:26:49.424980 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-35d91e62-bdff-4b01-83fe-04b4c26c6327 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-929443263", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "cb6686b4-1765-4f99-9801-c6a5d6418a10"}]}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:26:49.429048 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-35d91e62-bdff-4b01-83fe-04b4c26c6327 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Request method failure captured: Jul 23 21:26:49.429048 ncdv-master-1 devstack@n-api.service[131321]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 23 21:26:49.429048 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:26:49.429048 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:26:49.429048 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:26:49.429048 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 1265 Jul 23 21:26:49.429048 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:26:49.429048 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:26:49.429048 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:26:49.429048 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:26:49.429048 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GeD-C0KhfDo5QfL61Slq0RBwJfZgT6PQOxG6Oa0UyFRLrDHFzYSiGKQ9TZXLf6riilc4WNfhLK9J23crHfUGS-aIlJoCmR0nM8_4pntU4gvxJOssT3gVahHjJQA9KwW8xPbL8KohWeOpvX-s1ceABvzQw_j7k-pzebMDWT6F9NUszg Jul 23 21:26:49.429048 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:26:49.429048 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:26:49.429048 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:26:49.429048 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:26:49.429048 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:26:49.429048 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:26:49.429048 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 766b3be6b5fb4734bd9aeccbd35e3824 Jul 23 21:26:49.429048 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-231957292 Jul 23 21:26:49.429048 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:26:49.429048 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:26:49.429048 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/766b3be6b5fb4734bd9aeccbd35e3824"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/766b3be6b5fb4734bd9aeccbd35e3824"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_766b3be6b5fb4734bd9aeccbd35e3824", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/766b3be6b5fb4734bd9aeccbd35e3824"}]}] Jul 23 21:26:49.429048 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-231957292 Jul 23 21:26:49.429048 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 766b3be6b5fb4734bd9aeccbd35e3824 Jul 23 21:26:49.429048 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-231957292 Jul 23 21:26:49.429048 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ServerMetadataNegativeTestJSON-231957292-project Jul 23 21:26:49.429048 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:26:49.429048 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:26:49.429048 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 38c74aa110064b4f85fef220e2d47b4f Jul 23 21:26:49.429048 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-231957292-project Jul 23 21:26:49.429048 ncdv-master-1 devstack@n-api.service[131321]: Jul 23 21:26:49.429048 ncdv-master-1 devstack@n-api.service[131321]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-929443263", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "cb6686b4-1765-4f99-9801-c6a5d6418a10"}]}} Jul 23 21:26:49.429048 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:26:49.431390 ncdv-master-1 devstack@n-api.service[131321]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 23 21:26:49.431390 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-929443263', 'imageRef': 'b27b20aa-ef1b-4dd1-989e-321af6343d6a', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'cb6686b4-1765-4f99-9801-c6a5d6418a10'}]}}} Jul 23 21:26:49.431390 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:26:49.431390 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:26:49.431390 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 23 21:26:49.431390 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 23 21:26:49.431390 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 23 21:26:49.431390 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise error Jul 23 21:26:49.431390 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 23 21:26:49.431390 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:49.431390 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 23 21:26:49.431390 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 23 21:26:49.431390 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 23 21:26:49.431390 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 23 21:26:49.431390 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 23 21:26:49.431390 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:49.431390 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 23 21:26:49.432626 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 23 21:26:49.432626 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:49.432626 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:26:49.432626 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:49.432626 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:26:49.432626 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:26:49.432626 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:26:49.432626 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:26:49.432626 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:26:49.432626 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:26:49.432626 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:26:49.432626 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:26:49.432626 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:26:49.432626 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 23 21:26:49.432626 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 23 21:26:49.432626 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 23 21:26:49.432626 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 23 21:26:49.432626 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 23 21:26:49.432626 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 23 21:26:49.432626 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 23 21:26:49.432626 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:49.432626 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:26:49.432626 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:49.432626 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:26:49.432626 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:26:49.432626 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:26:49.432626 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 23 21:26:49.432626 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 23 21:26:49.435463 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 23 21:26:49.435463 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:49.435463 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-35d91e62-bdff-4b01-83fe-04b4c26c6327 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:26:49.446058 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-35d91e62-bdff-4b01-83fe-04b4c26c6327 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.042249 Jul 23 21:26:49.448516 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1700/3302] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Jul 23 21:26:49 2022] POST /compute/v2.1/servers => generated 2221 bytes in 50 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Jul 23 21:26:49.459847 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e51dc176-38b0-40fd-9339-70e630ed70b2 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:49.460670 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-e51dc176-38b0-40fd-9339-70e630ed70b2 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] [instance: def596b4-5e62-4d0a-94ad-97f44806f63b] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:49.470284 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-e51dc176-38b0-40fd-9339-70e630ed70b2 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] HTTP exception thrown: Instance def596b4-5e62-4d0a-94ad-97f44806f63b could not be found. Jul 23 21:26:49.472610 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e51dc176-38b0-40fd-9339-70e630ed70b2 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Request method failure captured: Jul 23 21:26:49.472610 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/servers/def596b4-5e62-4d0a-94ad-97f44806f63b/metadata/test2 HTTP/1.1 Jul 23 21:26:49.472610 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:26:49.472610 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:26:49.472610 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:26:49.472610 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:26:49.472610 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:26:49.472610 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:26:49.472610 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:26:49.472610 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:26:49.472610 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GeD-C0KhfDo5QfL61Slq0RBwJfZgT6PQOxG6Oa0UyFRLrDHFzYSiGKQ9TZXLf6riilc4WNfhLK9J23crHfUGS-aIlJoCmR0nM8_4pntU4gvxJOssT3gVahHjJQA9KwW8xPbL8KohWeOpvX-s1ceABvzQw_j7k-pzebMDWT6F9NUszg Jul 23 21:26:49.472610 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:26:49.472610 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:26:49.472610 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:26:49.472610 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:26:49.472610 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:26:49.472610 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:26:49.472610 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 766b3be6b5fb4734bd9aeccbd35e3824 Jul 23 21:26:49.472610 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-231957292 Jul 23 21:26:49.472610 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:26:49.472610 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:26:49.472610 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/766b3be6b5fb4734bd9aeccbd35e3824"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/766b3be6b5fb4734bd9aeccbd35e3824"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_766b3be6b5fb4734bd9aeccbd35e3824", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/766b3be6b5fb4734bd9aeccbd35e3824"}]}] Jul 23 21:26:49.472610 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-231957292 Jul 23 21:26:49.472610 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 766b3be6b5fb4734bd9aeccbd35e3824 Jul 23 21:26:49.472610 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-231957292 Jul 23 21:26:49.472610 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ServerMetadataNegativeTestJSON-231957292-project Jul 23 21:26:49.472610 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:26:49.472610 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:26:49.472610 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 38c74aa110064b4f85fef220e2d47b4f Jul 23 21:26:49.472610 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-231957292-project Jul 23 21:26:49.472610 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:26:49.472610 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance def596b4-5e62-4d0a-94ad-97f44806f63b could not be found. Jul 23 21:26:49.472610 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'server_id': 'def596b4-5e62-4d0a-94ad-97f44806f63b', 'id': 'test2'} Jul 23 21:26:49.472610 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:26:49.472610 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:26:49.472610 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:26:49.472610 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:26:49.472610 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:26:49.472610 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:26:49.472610 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 23 21:26:49.472610 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 23 21:26:49.472610 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance def596b4-5e62-4d0a-94ad-97f44806f63b could not be found. Jul 23 21:26:49.472610 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:49.472610 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:26:49.472610 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:49.472610 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:26:49.472610 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:26:49.472610 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:26:49.472610 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:26:49.472610 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:26:49.472610 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:26:49.472610 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:26:49.472610 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Jul 23 21:26:49.472610 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Jul 23 21:26:49.472610 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:26:49.472610 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:26:49.472610 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance def596b4-5e62-4d0a-94ad-97f44806f63b could not be found. Jul 23 21:26:49.472610 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:49.472610 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:26:49.472610 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:49.472610 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:26:49.472610 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:26:49.472610 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:26:49.477475 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:26:49.477475 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:26:49.477475 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance def596b4-5e62-4d0a-94ad-97f44806f63b could not be found. Jul 23 21:26:49.477475 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:49.478025 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e51dc176-38b0-40fd-9339-70e630ed70b2 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Returning 404 to user: Instance def596b4-5e62-4d0a-94ad-97f44806f63b could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:26:49.478993 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-e51dc176-38b0-40fd-9339-70e630ed70b2 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] 10.222.0.17 "GET /compute/v2.1/servers/def596b4-5e62-4d0a-94ad-97f44806f63b/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.024157 Jul 23 21:26:49.480157 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1701/3303] 10.222.0.17 () {58 vars in 1280 bytes} [Sat Jul 23 21:26:49 2022] GET /compute/v2.1/servers/def596b4-5e62-4d0a-94ad-97f44806f63b/metadata/test2 => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:26:49.496919 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-705e3584-7308-4bfa-b69d-0f326b7744b3 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:49.497629 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-705e3584-7308-4bfa-b69d-0f326b7744b3 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] [instance: 7b41cb07-71ed-4403-8d4c-65be6a3c2f4b] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:49.504396 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-705e3584-7308-4bfa-b69d-0f326b7744b3 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:49.504993 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-705e3584-7308-4bfa-b69d-0f326b7744b3 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:49.505965 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-705e3584-7308-4bfa-b69d-0f326b7744b3 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:49.506505 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-705e3584-7308-4bfa-b69d-0f326b7744b3 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:49.537994 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-705e3584-7308-4bfa-b69d-0f326b7744b3 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] [instance: 7b41cb07-71ed-4403-8d4c-65be6a3c2f4b] Going to try to terminate instance {{(pid=131321) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:26:49.606797 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:26:49.714772 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-705e3584-7308-4bfa-b69d-0f326b7744b3 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] 10.222.0.17 "DELETE /compute/v2.1/servers/7b41cb07-71ed-4403-8d4c-65be6a3c2f4b" status: 204 len: 0 microversion: 2.1 time: 0.221583 Jul 23 21:26:49.718368 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1702/3304] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:26:49 2022] DELETE /compute/v2.1/servers/7b41cb07-71ed-4403-8d4c-65be6a3c2f4b => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:26:49.727420 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-215895aa-9c33-4c3e-87a8-d0940479b3b5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:49.728563 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-215895aa-9c33-4c3e-87a8-d0940479b3b5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:49.742208 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-215895aa-9c33-4c3e-87a8-d0940479b3b5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:49.743267 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-215895aa-9c33-4c3e-87a8-d0940479b3b5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:49.744387 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-215895aa-9c33-4c3e-87a8-d0940479b3b5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:49.746031 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-215895aa-9c33-4c3e-87a8-d0940479b3b5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:49.863504 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-2b251e72-8fc6-461c-aeaf-f931698ec05d tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:49.869140 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-215895aa-9c33-4c3e-87a8-d0940479b3b5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:49.873801 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2b251e72-8fc6-461c-aeaf-f931698ec05d tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/178abb32-365f-4ccd-828b-e69f6fe45370" status: 200 len: 1315 microversion: 2.1 time: 0.766164 Jul 23 21:26:49.874431 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1603/3305] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:49 2022] GET /compute/v2.1/servers/178abb32-365f-4ccd-828b-e69f6fe45370 => generated 1315 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:49.885550 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-ee403fb1-55a9-4bca-9728-2868617243d0 req-31cbef82-2e86-47c3-8a39-025224bb55ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06a478c3-f038-4813-a456-daf3a58b5749", "tag": "661b9337-be92-4f83-a6f7-6a98a2b053db"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:26:49.897428 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-215895aa-9c33-4c3e-87a8-d0940479b3b5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:49.899038 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-215895aa-9c33-4c3e-87a8-d0940479b3b5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:49.900404 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-215895aa-9c33-4c3e-87a8-d0940479b3b5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.180102 Jul 23 21:26:49.901073 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1703/3306] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:26:49 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:26:49.915786 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-818e95f1-1844-4c14-b808-86d11089ac5b tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:49.929352 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-818e95f1-1844-4c14-b808-86d11089ac5b tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] [instance: 7b41cb07-71ed-4403-8d4c-65be6a3c2f4b] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:49.932495 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-ee403fb1-55a9-4bca-9728-2868617243d0 req-31cbef82-2e86-47c3-8a39-025224bb55ae service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:49.933003 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-ee403fb1-55a9-4bca-9728-2868617243d0 req-31cbef82-2e86-47c3-8a39-025224bb55ae service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:49.942681 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:26:49.946766 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-818e95f1-1844-4c14-b808-86d11089ac5b tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:49.947213 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-818e95f1-1844-4c14-b808-86d11089ac5b tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:49.948130 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-818e95f1-1844-4c14-b808-86d11089ac5b tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:49.948990 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-818e95f1-1844-4c14-b808-86d11089ac5b tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:49.975105 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-ee403fb1-55a9-4bca-9728-2868617243d0 req-31cbef82-2e86-47c3-8a39-025224bb55ae service nova] Creating event network-changed:661b9337-be92-4f83-a6f7-6a98a2b053db for instance 06a478c3-f038-4813-a456-daf3a58b5749 on nch2-master-1 Jul 23 21:26:49.992146 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-ee403fb1-55a9-4bca-9728-2868617243d0 req-31cbef82-2e86-47c3-8a39-025224bb55ae service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113824 Jul 23 21:26:49.993565 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1604/3307] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:26:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:26:49.999048 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-60e52802-32aa-49aa-a2ae-4de857b4a048 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:50.000095 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-60e52802-32aa-49aa-a2ae-4de857b4a048 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: 06a478c3-f038-4813-a456-daf3a58b5749] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:50.019863 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-60e52802-32aa-49aa-a2ae-4de857b4a048 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:50.020612 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-60e52802-32aa-49aa-a2ae-4de857b4a048 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:50.021734 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-60e52802-32aa-49aa-a2ae-4de857b4a048 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:50.023328 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-60e52802-32aa-49aa-a2ae-4de857b4a048 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:50.268504 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-818e95f1-1844-4c14-b808-86d11089ac5b tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c74aa110064b4f85fef220e2d47b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b3be6b5fb4734bd9aeccbd35e3824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:50.279283 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-818e95f1-1844-4c14-b808-86d11089ac5b tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] 10.222.0.17 "GET /compute/v2.1/servers/7b41cb07-71ed-4403-8d4c-65be6a3c2f4b" status: 200 len: 1525 microversion: 2.1 time: 0.377172 Jul 23 21:26:50.279894 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1704/3308] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:49 2022] GET /compute/v2.1/servers/7b41cb07-71ed-4403-8d4c-65be6a3c2f4b => generated 1525 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:50.288912 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-60e52802-32aa-49aa-a2ae-4de857b4a048 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:50.289828 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-60e52802-32aa-49aa-a2ae-4de857b4a048 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/06a478c3-f038-4813-a456-daf3a58b5749" status: 200 len: 1318 microversion: 2.1 time: 0.294852 Jul 23 21:26:50.290442 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1605/3309] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:49 2022] GET /compute/v2.1/servers/06a478c3-f038-4813-a456-daf3a58b5749 => generated 1318 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:50.303492 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5f7885a0-0309-498b-a3cc-2b0ae5807bbe tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:50.304120 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5f7885a0-0309-498b-a3cc-2b0ae5807bbe tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] [instance: 163182e4-bfa7-4da7-9267-9cbb8a911183] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:50.319085 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5f7885a0-0309-498b-a3cc-2b0ae5807bbe tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:50.319904 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5f7885a0-0309-498b-a3cc-2b0ae5807bbe tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:50.320936 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5f7885a0-0309-498b-a3cc-2b0ae5807bbe tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:50.321654 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5f7885a0-0309-498b-a3cc-2b0ae5807bbe tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:50.600210 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5f7885a0-0309-498b-a3cc-2b0ae5807bbe tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0543f1a561a9442cbc9463ab752bd2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d306759c447edb6d013cf14ac53f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:50.614425 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5f7885a0-0309-498b-a3cc-2b0ae5807bbe tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] 10.222.0.17 "GET /compute/v2.1/servers/163182e4-bfa7-4da7-9267-9cbb8a911183" status: 200 len: 1317 microversion: 2.1 time: 0.321213 Jul 23 21:26:50.616271 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1606/3310] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:50 2022] GET /compute/v2.1/servers/163182e4-bfa7-4da7-9267-9cbb8a911183 => generated 1317 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:50.891837 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-5055aff2-bbd0-4f6a-af55-818d5a48d549 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:50.892716 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-5055aff2-bbd0-4f6a-af55-818d5a48d549 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: 178abb32-365f-4ccd-828b-e69f6fe45370] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:50.904295 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5055aff2-bbd0-4f6a-af55-818d5a48d549 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:50.904756 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5055aff2-bbd0-4f6a-af55-818d5a48d549 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:50.905557 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5055aff2-bbd0-4f6a-af55-818d5a48d549 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:50.906067 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5055aff2-bbd0-4f6a-af55-818d5a48d549 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:50.920611 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-93843523-207a-4d29-a167-a8f20366240c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:50.923040 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-93843523-207a-4d29-a167-a8f20366240c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:50.956708 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-93843523-207a-4d29-a167-a8f20366240c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:50.959812 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-93843523-207a-4d29-a167-a8f20366240c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:50.967818 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-93843523-207a-4d29-a167-a8f20366240c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:50.972462 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-93843523-207a-4d29-a167-a8f20366240c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:51.150962 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-93843523-207a-4d29-a167-a8f20366240c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:51.164967 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-93843523-207a-4d29-a167-a8f20366240c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:51.175898 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-93843523-207a-4d29-a167-a8f20366240c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:51.181985 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-93843523-207a-4d29-a167-a8f20366240c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.266538 Jul 23 21:26:51.200684 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1607/3311] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:26:50 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:26:51.250359 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-5055aff2-bbd0-4f6a-af55-818d5a48d549 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:51.262370 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-5055aff2-bbd0-4f6a-af55-818d5a48d549 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/178abb32-365f-4ccd-828b-e69f6fe45370" status: 200 len: 1315 microversion: 2.1 time: 0.372001 Jul 23 21:26:51.263012 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1705/3312] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:50 2022] GET /compute/v2.1/servers/178abb32-365f-4ccd-828b-e69f6fe45370 => generated 1315 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:51.297053 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e419fd5e-dcf3-4bcd-90ff-442cec3beb91 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:51.297676 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e419fd5e-dcf3-4bcd-90ff-442cec3beb91 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] [instance: 7b41cb07-71ed-4403-8d4c-65be6a3c2f4b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:51.306704 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-8e0577d2-0455-44a4-972f-f523161f978b tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:51.307325 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-8e0577d2-0455-44a4-972f-f523161f978b tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: 06a478c3-f038-4813-a456-daf3a58b5749] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:51.314542 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e419fd5e-dcf3-4bcd-90ff-442cec3beb91 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:51.315000 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e419fd5e-dcf3-4bcd-90ff-442cec3beb91 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:51.315797 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e419fd5e-dcf3-4bcd-90ff-442cec3beb91 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:51.316334 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e419fd5e-dcf3-4bcd-90ff-442cec3beb91 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:51.322865 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8e0577d2-0455-44a4-972f-f523161f978b tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:51.323328 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8e0577d2-0455-44a4-972f-f523161f978b tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:51.324131 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8e0577d2-0455-44a4-972f-f523161f978b tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:51.324572 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8e0577d2-0455-44a4-972f-f523161f978b tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:51.566990 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=8 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:26:51.618578 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=22 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:26:51.666574 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e419fd5e-dcf3-4bcd-90ff-442cec3beb91 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c74aa110064b4f85fef220e2d47b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b3be6b5fb4734bd9aeccbd35e3824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:51.678210 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e419fd5e-dcf3-4bcd-90ff-442cec3beb91 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] 10.222.0.17 "GET /compute/v2.1/servers/7b41cb07-71ed-4403-8d4c-65be6a3c2f4b" status: 200 len: 1525 microversion: 2.1 time: 0.385421 Jul 23 21:26:51.682172 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1608/3313] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:51 2022] GET /compute/v2.1/servers/7b41cb07-71ed-4403-8d4c-65be6a3c2f4b => generated 1525 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:51.698406 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-e494d859-3e78-4813-9e75-5b47c78851b8 req-b3380a4c-48eb-49ee-8d26-e500beb8d13d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "163182e4-bfa7-4da7-9267-9cbb8a911183", "name": "network-vif-plugged", "status": "completed", "tag": "311f22f9-8e33-46f2-9fc9-62d52b59f0d8"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:26:51.720234 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-8e0577d2-0455-44a4-972f-f523161f978b tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:51.723998 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-e494d859-3e78-4813-9e75-5b47c78851b8 req-b3380a4c-48eb-49ee-8d26-e500beb8d13d service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:51.724720 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-e494d859-3e78-4813-9e75-5b47c78851b8 req-b3380a4c-48eb-49ee-8d26-e500beb8d13d service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:51.730414 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-8e0577d2-0455-44a4-972f-f523161f978b tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/06a478c3-f038-4813-a456-daf3a58b5749" status: 200 len: 1318 microversion: 2.1 time: 0.427692 Jul 23 21:26:51.741675 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1706/3314] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:51 2022] GET /compute/v2.1/servers/06a478c3-f038-4813-a456-daf3a58b5749 => generated 1318 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:51.741675 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-06c445db-dc4f-4391-9e34-052f09f73059 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:51.745015 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-06c445db-dc4f-4391-9e34-052f09f73059 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] [instance: 163182e4-bfa7-4da7-9267-9cbb8a911183] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:51.760458 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-06c445db-dc4f-4391-9e34-052f09f73059 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:51.760917 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-06c445db-dc4f-4391-9e34-052f09f73059 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:51.763991 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-e494d859-3e78-4813-9e75-5b47c78851b8 req-b3380a4c-48eb-49ee-8d26-e500beb8d13d service nova] Creating event network-vif-plugged:311f22f9-8e33-46f2-9fc9-62d52b59f0d8 for instance 163182e4-bfa7-4da7-9267-9cbb8a911183 on nch1-master-1 Jul 23 21:26:51.764842 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-06c445db-dc4f-4391-9e34-052f09f73059 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:51.765598 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-06c445db-dc4f-4391-9e34-052f09f73059 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:51.786368 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-e494d859-3e78-4813-9e75-5b47c78851b8 req-b3380a4c-48eb-49ee-8d26-e500beb8d13d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102612 Jul 23 21:26:51.787049 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1609/3315] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:26:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:26:52.042212 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell0:SELECT=18 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:26:52.057725 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-06c445db-dc4f-4391-9e34-052f09f73059 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0543f1a561a9442cbc9463ab752bd2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d306759c447edb6d013cf14ac53f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:52.070990 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-06c445db-dc4f-4391-9e34-052f09f73059 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] 10.222.0.17 "GET /compute/v2.1/servers/163182e4-bfa7-4da7-9267-9cbb8a911183" status: 200 len: 1317 microversion: 2.1 time: 0.335645 Jul 23 21:26:52.082196 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1707/3316] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:51 2022] GET /compute/v2.1/servers/163182e4-bfa7-4da7-9267-9cbb8a911183 => generated 1317 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:52.207565 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-39f56deb-0f60-44f0-bfdb-8fc3705da245 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:52.208714 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-39f56deb-0f60-44f0-bfdb-8fc3705da245 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:52.216675 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-39f56deb-0f60-44f0-bfdb-8fc3705da245 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:52.217140 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-39f56deb-0f60-44f0-bfdb-8fc3705da245 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:52.218308 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-39f56deb-0f60-44f0-bfdb-8fc3705da245 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:52.218881 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-39f56deb-0f60-44f0-bfdb-8fc3705da245 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:52.279125 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-524bf054-7d44-4455-99e5-3c353319b8c1 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:52.280206 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-524bf054-7d44-4455-99e5-3c353319b8c1 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: 178abb32-365f-4ccd-828b-e69f6fe45370] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:52.287426 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-524bf054-7d44-4455-99e5-3c353319b8c1 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:52.288183 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-524bf054-7d44-4455-99e5-3c353319b8c1 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:52.288973 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-524bf054-7d44-4455-99e5-3c353319b8c1 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:52.289419 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-524bf054-7d44-4455-99e5-3c353319b8c1 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:52.339420 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-39f56deb-0f60-44f0-bfdb-8fc3705da245 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:52.343342 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=100 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:26:52.350677 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-39f56deb-0f60-44f0-bfdb-8fc3705da245 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:52.352187 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-39f56deb-0f60-44f0-bfdb-8fc3705da245 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:52.353573 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-39f56deb-0f60-44f0-bfdb-8fc3705da245 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.151295 Jul 23 21:26:52.354171 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1610/3317] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:26:52 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:26:52.473145 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-524bf054-7d44-4455-99e5-3c353319b8c1 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:52.482820 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-524bf054-7d44-4455-99e5-3c353319b8c1 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/178abb32-365f-4ccd-828b-e69f6fe45370" status: 200 len: 1315 microversion: 2.1 time: 0.207327 Jul 23 21:26:52.484658 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1708/3318] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:52 2022] GET /compute/v2.1/servers/178abb32-365f-4ccd-828b-e69f6fe45370 => generated 1315 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:52.697010 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-13eeff14-6e8d-44d0-8fff-aaab53962f10 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:52.697982 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-13eeff14-6e8d-44d0-8fff-aaab53962f10 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] [instance: 7b41cb07-71ed-4403-8d4c-65be6a3c2f4b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:52.714644 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-13eeff14-6e8d-44d0-8fff-aaab53962f10 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:52.715253 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-13eeff14-6e8d-44d0-8fff-aaab53962f10 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:52.716509 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-13eeff14-6e8d-44d0-8fff-aaab53962f10 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:52.717051 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-13eeff14-6e8d-44d0-8fff-aaab53962f10 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:52.749106 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ab299698-5825-4d06-9855-b03e4a3049f3 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:52.750166 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-ab299698-5825-4d06-9855-b03e4a3049f3 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: 06a478c3-f038-4813-a456-daf3a58b5749] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:52.761819 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ab299698-5825-4d06-9855-b03e4a3049f3 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:52.763142 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ab299698-5825-4d06-9855-b03e4a3049f3 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:52.764201 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ab299698-5825-4d06-9855-b03e4a3049f3 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:52.764843 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ab299698-5825-4d06-9855-b03e4a3049f3 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:53.599966 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-13eeff14-6e8d-44d0-8fff-aaab53962f10 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c74aa110064b4f85fef220e2d47b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b3be6b5fb4734bd9aeccbd35e3824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:53.623488 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-13eeff14-6e8d-44d0-8fff-aaab53962f10 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] 10.222.0.17 "GET /compute/v2.1/servers/7b41cb07-71ed-4403-8d4c-65be6a3c2f4b" status: 200 len: 1525 microversion: 2.1 time: 0.923062 Jul 23 21:26:53.625278 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1611/3319] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:52 2022] GET /compute/v2.1/servers/7b41cb07-71ed-4403-8d4c-65be6a3c2f4b => generated 1525 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:53.656311 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-932205d9-9152-4f40-9853-0616ebc31838 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:53.658258 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-932205d9-9152-4f40-9853-0616ebc31838 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] [instance: 163182e4-bfa7-4da7-9267-9cbb8a911183] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:53.677340 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-932205d9-9152-4f40-9853-0616ebc31838 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:53.677839 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-932205d9-9152-4f40-9853-0616ebc31838 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:53.684565 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-932205d9-9152-4f40-9853-0616ebc31838 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:53.685026 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-932205d9-9152-4f40-9853-0616ebc31838 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:53.685192 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ab299698-5825-4d06-9855-b03e4a3049f3 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:53.698178 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-ab299698-5825-4d06-9855-b03e4a3049f3 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/06a478c3-f038-4813-a456-daf3a58b5749" status: 200 len: 1318 microversion: 2.1 time: 0.952999 Jul 23 21:26:53.710790 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1709/3320] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:52 2022] GET /compute/v2.1/servers/06a478c3-f038-4813-a456-daf3a58b5749 => generated 1318 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:26:53.734297 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f0cdcb0b-7382-4a68-a916-7df2535bbaf1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:53.735440 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-f0cdcb0b-7382-4a68-a916-7df2535bbaf1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:53.748956 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f0cdcb0b-7382-4a68-a916-7df2535bbaf1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:53.751366 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f0cdcb0b-7382-4a68-a916-7df2535bbaf1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:53.755301 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f0cdcb0b-7382-4a68-a916-7df2535bbaf1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:53.756035 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f0cdcb0b-7382-4a68-a916-7df2535bbaf1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:53.882981 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-f0cdcb0b-7382-4a68-a916-7df2535bbaf1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:53.897233 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-f0cdcb0b-7382-4a68-a916-7df2535bbaf1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:53.900890 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-f0cdcb0b-7382-4a68-a916-7df2535bbaf1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:53.903773 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-f0cdcb0b-7382-4a68-a916-7df2535bbaf1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.191343 Jul 23 21:26:53.905320 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1710/3321] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:26:53 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:26:53.913052 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-dbc5b8f7-0d1a-4c1e-ae21-17920e0cee56 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:53.914045 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-dbc5b8f7-0d1a-4c1e-ae21-17920e0cee56 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: 178abb32-365f-4ccd-828b-e69f6fe45370] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:53.923918 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-dbc5b8f7-0d1a-4c1e-ae21-17920e0cee56 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:53.925082 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-dbc5b8f7-0d1a-4c1e-ae21-17920e0cee56 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:53.926304 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-dbc5b8f7-0d1a-4c1e-ae21-17920e0cee56 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:53.927264 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-dbc5b8f7-0d1a-4c1e-ae21-17920e0cee56 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:54.136560 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-932205d9-9152-4f40-9853-0616ebc31838 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0543f1a561a9442cbc9463ab752bd2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d306759c447edb6d013cf14ac53f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:54.145183 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-932205d9-9152-4f40-9853-0616ebc31838 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] 10.222.0.17 "GET /compute/v2.1/servers/163182e4-bfa7-4da7-9267-9cbb8a911183" status: 200 len: 1505 microversion: 2.1 time: 0.517983 Jul 23 21:26:54.145948 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1612/3322] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:53 2022] GET /compute/v2.1/servers/163182e4-bfa7-4da7-9267-9cbb8a911183 => generated 1505 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:54.151268 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-ca4547fa-6875-4d5a-972a-b25c0461c49f req-318179b1-bd35-40f3-8759-4b23da2517c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14bdd0f5-f5bf-44bb-876f-2d257eae5fb0", "name": "network-vif-plugged", "status": "completed", "tag": "638f9b69-f16f-4d87-ad86-1c12e3530bb8"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:26:54.161085 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-ca4547fa-6875-4d5a-972a-b25c0461c49f req-318179b1-bd35-40f3-8759-4b23da2517c0 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:54.161085 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-ca4547fa-6875-4d5a-972a-b25c0461c49f req-318179b1-bd35-40f3-8759-4b23da2517c0 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:54.167860 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-dbc5b8f7-0d1a-4c1e-ae21-17920e0cee56 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:54.173599 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-ca4547fa-6875-4d5a-972a-b25c0461c49f req-318179b1-bd35-40f3-8759-4b23da2517c0 service nova] Creating event network-vif-plugged:638f9b69-f16f-4d87-ad86-1c12e3530bb8 for instance 14bdd0f5-f5bf-44bb-876f-2d257eae5fb0 on nch1-master-1 Jul 23 21:26:54.179123 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-dbc5b8f7-0d1a-4c1e-ae21-17920e0cee56 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/178abb32-365f-4ccd-828b-e69f6fe45370" status: 200 len: 1502 microversion: 2.1 time: 0.271474 Jul 23 21:26:54.180312 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1711/3323] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:53 2022] GET /compute/v2.1/servers/178abb32-365f-4ccd-828b-e69f6fe45370 => generated 1502 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:54.192672 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-ca4547fa-6875-4d5a-972a-b25c0461c49f req-318179b1-bd35-40f3-8759-4b23da2517c0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045132 Jul 23 21:26:54.196278 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1613/3324] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:26:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:26:54.204530 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a4ee9b29-0655-48bd-a4ff-f0572ebe3dbd tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:54.206897 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a4ee9b29-0655-48bd-a4ff-f0572ebe3dbd tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] [instance: 14bdd0f5-f5bf-44bb-876f-2d257eae5fb0] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:54.216842 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a4ee9b29-0655-48bd-a4ff-f0572ebe3dbd tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:54.217294 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a4ee9b29-0655-48bd-a4ff-f0572ebe3dbd tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:54.218124 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a4ee9b29-0655-48bd-a4ff-f0572ebe3dbd tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:54.218567 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a4ee9b29-0655-48bd-a4ff-f0572ebe3dbd tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:54.429856 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-6fafd3b1-1dcb-4a06-9e00-5796c354a584 tempest-SecurityGroupsNegativeTestJSON-172220035 tempest-SecurityGroupsNegativeTestJSON-172220035-project] Calling method '.version_select at 0x7f0b59979700>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:54.509677 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a4ee9b29-0655-48bd-a4ff-f0572ebe3dbd tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0543f1a561a9442cbc9463ab752bd2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d306759c447edb6d013cf14ac53f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:54.525217 ncdv-master-1 devstack@n-api.service[131321]: DEBUG neutronclient.v2_0.client [None req-6fafd3b1-1dcb-4a06-9e00-5796c354a584 tempest-SecurityGroupsNegativeTestJSON-172220035 tempest-SecurityGroupsNegativeTestJSON-172220035-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5442acee-a9b8-40fc-96c6-d4e791756873 does not exist", "detail": ""}} {{(pid=131321) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 23 21:26:54.525825 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.network.security_group_api [None req-6fafd3b1-1dcb-4a06-9e00-5796c354a584 tempest-SecurityGroupsNegativeTestJSON-172220035 tempest-SecurityGroupsNegativeTestJSON-172220035-project] Neutron security group 5442acee-a9b8-40fc-96c6-d4e791756873 not found {{(pid=131321) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 23 21:26:54.526696 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-6fafd3b1-1dcb-4a06-9e00-5796c354a584 tempest-SecurityGroupsNegativeTestJSON-172220035 tempest-SecurityGroupsNegativeTestJSON-172220035-project] HTTP exception thrown: Security group 5442acee-a9b8-40fc-96c6-d4e791756873 does not exist Jul 23 21:26:54.526696 ncdv-master-1 devstack@n-api.service[131321]: Neutron server returns request_ids: ['req-2e69ce1b-a9b5-4567-b471-32d71b2a4a99'] Jul 23 21:26:54.529216 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-6fafd3b1-1dcb-4a06-9e00-5796c354a584 tempest-SecurityGroupsNegativeTestJSON-172220035 tempest-SecurityGroupsNegativeTestJSON-172220035-project] Request method failure captured: Jul 23 21:26:54.529216 ncdv-master-1 devstack@n-api.service[131321]: request: DELETE /compute/v2.1/os-security-groups/5442acee-a9b8-40fc-96c6-d4e791756873 HTTP/1.1 Jul 23 21:26:54.529216 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:26:54.529216 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:26:54.529216 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:26:54.529216 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:26:54.529216 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:26:54.529216 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:26:54.529216 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:26:54.529216 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:26:54.529216 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GeelzZgG07l6_um_x6x8a9k2Yk2nxrQ5bBR9z7Hq2JfMIRtUP7Uh0aFNNYObXguLuwZNwpa4wi1NkC8AOB3AP6A6YkS-YZoGez7NwWb54yFEf_56fLhdCW1m5yAnBnBLsq4714sOU1j5QVPkbaUQuc9Si-hw7f31bb0QB8taIMFxhc Jul 23 21:26:54.529216 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:26:54.529216 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:26:54.529216 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:26:54.529216 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:26:54.529216 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:26:54.529216 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:26:54.529216 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 81c256a3f4f34db1b8eb590bb6d4baa7 Jul 23 21:26:54.529216 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-172220035 Jul 23 21:26:54.529216 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:26:54.529216 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:26:54.529216 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/81c256a3f4f34db1b8eb590bb6d4baa7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/81c256a3f4f34db1b8eb590bb6d4baa7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_81c256a3f4f34db1b8eb590bb6d4baa7", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/81c256a3f4f34db1b8eb590bb6d4baa7"}]}] Jul 23 21:26:54.529216 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-172220035 Jul 23 21:26:54.529216 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 81c256a3f4f34db1b8eb590bb6d4baa7 Jul 23 21:26:54.529216 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-172220035 Jul 23 21:26:54.529216 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-SecurityGroupsNegativeTestJSON-172220035-project Jul 23 21:26:54.529216 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:26:54.529216 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:26:54.529216 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: ce9622bd31514e87a45d4cf05a248a00 Jul 23 21:26:54.529216 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-172220035-project Jul 23 21:26:54.529216 ncdv-master-1 devstack@n-api.service[131321]: method: Jul 23 21:26:54.529216 ncdv-master-1 devstack@n-api.service[131321]: exception: Security group 5442acee-a9b8-40fc-96c6-d4e791756873 does not exist Jul 23 21:26:54.529216 ncdv-master-1 devstack@n-api.service[131321]: Neutron server returns request_ids: ['req-2e69ce1b-a9b5-4567-b471-32d71b2a4a99'] Jul 23 21:26:54.529216 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': '5442acee-a9b8-40fc-96c6-d4e791756873'} Jul 23 21:26:54.529216 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:26:54.529216 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:26:54.529216 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 23 21:26:54.529216 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 23 21:26:54.529216 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:26:54.529216 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:26:54.529216 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 23 21:26:54.529216 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 23 21:26:54.529216 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:26:54.529216 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:26:54.529216 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 23 21:26:54.529216 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 23 21:26:54.529216 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:26:54.529216 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:26:54.529216 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 23 21:26:54.529216 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 23 21:26:54.529216 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:26:54.529216 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:26:54.529216 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 23 21:26:54.529216 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 23 21:26:54.529216 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:26:54.529216 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:26:54.529216 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 23 21:26:54.529216 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 23 21:26:54.529216 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 23 21:26:54.529216 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 23 21:26:54.529216 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 5442acee-a9b8-40fc-96c6-d4e791756873 does not exist Jul 23 21:26:54.534336 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2e69ce1b-a9b5-4567-b471-32d71b2a4a99'] Jul 23 21:26:54.534336 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:54.534336 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:26:54.534336 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:54.534336 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:26:54.534336 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 23 21:26:54.534336 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 23 21:26:54.534336 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 23 21:26:54.534336 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 23 21:26:54.534336 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 5442acee-a9b8-40fc-96c6-d4e791756873 does not exist Jul 23 21:26:54.534336 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2e69ce1b-a9b5-4567-b471-32d71b2a4a99'] Jul 23 21:26:54.534336 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:54.534336 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:26:54.534336 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:54.534336 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:26:54.534336 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:26:54.534336 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:26:54.534336 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:26:54.534336 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:26:54.534336 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:26:54.534336 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:26:54.534336 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:26:54.534336 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:26:54.534336 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 23 21:26:54.534336 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 23 21:26:54.534336 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 5442acee-a9b8-40fc-96c6-d4e791756873 does not exist Jul 23 21:26:54.534336 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2e69ce1b-a9b5-4567-b471-32d71b2a4a99'] Jul 23 21:26:54.534336 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:54.534336 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:26:54.534336 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:54.534336 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:26:54.534336 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:26:54.534336 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:26:54.534336 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:26:54.534336 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:26:54.534336 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 5442acee-a9b8-40fc-96c6-d4e791756873 does not exist Jul 23 21:26:54.534336 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2e69ce1b-a9b5-4567-b471-32d71b2a4a99'] Jul 23 21:26:54.534336 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:54.539358 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-6fafd3b1-1dcb-4a06-9e00-5796c354a584 tempest-SecurityGroupsNegativeTestJSON-172220035 tempest-SecurityGroupsNegativeTestJSON-172220035-project] Returning 404 to user: Security group 5442acee-a9b8-40fc-96c6-d4e791756873 does not exist Jul 23 21:26:54.539358 ncdv-master-1 devstack@n-api.service[131321]: Neutron server returns request_ids: ['req-2e69ce1b-a9b5-4567-b471-32d71b2a4a99'] {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:26:54.540321 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-6fafd3b1-1dcb-4a06-9e00-5796c354a584 tempest-SecurityGroupsNegativeTestJSON-172220035 tempest-SecurityGroupsNegativeTestJSON-172220035-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/5442acee-a9b8-40fc-96c6-d4e791756873" status: 404 len: 194 microversion: 2.1 time: 0.358855 Jul 23 21:26:54.540656 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a4ee9b29-0655-48bd-a4ff-f0572ebe3dbd tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] 10.222.0.17 "GET /compute/v2.1/servers/14bdd0f5-f5bf-44bb-876f-2d257eae5fb0" status: 200 len: 1317 microversion: 2.1 time: 0.343191 Jul 23 21:26:54.541248 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1712/3325] 10.222.0.17 () {58 vars in 1271 bytes} [Sat Jul 23 21:26:54 2022] DELETE /compute/v2.1/os-security-groups/5442acee-a9b8-40fc-96c6-d4e791756873 => generated 194 bytes in 360 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:26:54.542781 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1614/3326] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:54 2022] GET /compute/v2.1/servers/14bdd0f5-f5bf-44bb-876f-2d257eae5fb0 => generated 1317 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:54.554856 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5527a5a2-fe02-4919-a8f9-af9e734c3dd4 tempest-SecurityGroupsNegativeTestJSON-172220035 tempest-SecurityGroupsNegativeTestJSON-172220035-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.007380 Jul 23 21:26:54.555846 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1615/3327] 10.222.0.17 () {58 vars in 1163 bytes} [Sat Jul 23 21:26:54 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 23 21:26:54.557574 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c50667a8-6a21-4ea9-a329-50d089e8fa2e tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:26:54.558173 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-c50667a8-6a21-4ea9-a329-50d089e8fa2e tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: 178abb32-365f-4ccd-828b-e69f6fe45370] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:54.577393 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-69415f23-abbf-4100-97e4-f8db2d0d0a23 tempest-SecurityGroupsNegativeTestJSON-172220035 tempest-SecurityGroupsNegativeTestJSON-172220035-project] Calling method '.version_select at 0x7f0b599d83a0>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:54.606998 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c50667a8-6a21-4ea9-a329-50d089e8fa2e tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:54.607531 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c50667a8-6a21-4ea9-a329-50d089e8fa2e tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:54.611265 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c50667a8-6a21-4ea9-a329-50d089e8fa2e tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:54.611784 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c50667a8-6a21-4ea9-a329-50d089e8fa2e tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:54.706501 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-c50667a8-6a21-4ea9-a329-50d089e8fa2e tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "POST /compute/v2.1/servers/178abb32-365f-4ccd-828b-e69f6fe45370/action" status: 202 len: 0 microversion: 2.1 time: 0.163313 Jul 23 21:26:54.711717 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1713/3328] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:26:54 2022] POST /compute/v2.1/servers/178abb32-365f-4ccd-828b-e69f6fe45370/action => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:26:54.727196 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-07e3466d-4f9e-4062-b02c-9ab32b0879b2 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:54.730805 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-07e3466d-4f9e-4062-b02c-9ab32b0879b2 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] [instance: 7b41cb07-71ed-4403-8d4c-65be6a3c2f4b] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:54.764674 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-07e3466d-4f9e-4062-b02c-9ab32b0879b2 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:54.768962 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-07e3466d-4f9e-4062-b02c-9ab32b0879b2 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:54.769851 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-07e3466d-4f9e-4062-b02c-9ab32b0879b2 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:54.780957 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-07e3466d-4f9e-4062-b02c-9ab32b0879b2 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:54.980496 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-69415f23-abbf-4100-97e4-f8db2d0d0a23 tempest-SecurityGroupsNegativeTestJSON-172220035 tempest-SecurityGroupsNegativeTestJSON-172220035-project] 10.222.0.17 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.409480 Jul 23 21:26:54.989728 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1616/3329] 10.222.0.17 () {58 vars in 1157 bytes} [Sat Jul 23 21:26:54 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:26:54.995385 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-bc8a8823-e35c-4925-bcd5-39a2465d7f7c req-570ab107-178c-4026-bede-609d25d2499d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b41cb07-71ed-4403-8d4c-65be6a3c2f4b", "name": "network-vif-deleted", "tag": "5f41cae0-7b96-4511-98b1-f7306dc68f94"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:26:55.024733 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-bc8a8823-e35c-4925-bcd5-39a2465d7f7c req-570ab107-178c-4026-bede-609d25d2499d service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:55.025569 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-bc8a8823-e35c-4925-bcd5-39a2465d7f7c req-570ab107-178c-4026-bede-609d25d2499d service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:55.040496 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-bc8a8823-e35c-4925-bcd5-39a2465d7f7c req-570ab107-178c-4026-bede-609d25d2499d service nova] Creating event network-vif-deleted:5f41cae0-7b96-4511-98b1-f7306dc68f94 for instance 7b41cb07-71ed-4403-8d4c-65be6a3c2f4b on nch2-master-1 Jul 23 21:26:55.046612 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-bc8a8823-e35c-4925-bcd5-39a2465d7f7c req-570ab107-178c-4026-bede-609d25d2499d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061812 Jul 23 21:26:55.052009 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1617/3330] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:26:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:26:55.060888 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1c9fb5d3-0c5d-4c1b-8005-1e79b054a7f2 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:55.061523 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1c9fb5d3-0c5d-4c1b-8005-1e79b054a7f2 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: 06a478c3-f038-4813-a456-daf3a58b5749] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:55.070107 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1c9fb5d3-0c5d-4c1b-8005-1e79b054a7f2 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:55.070864 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1c9fb5d3-0c5d-4c1b-8005-1e79b054a7f2 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:55.071880 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1c9fb5d3-0c5d-4c1b-8005-1e79b054a7f2 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:55.072477 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1c9fb5d3-0c5d-4c1b-8005-1e79b054a7f2 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:55.077540 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-07e3466d-4f9e-4062-b02c-9ab32b0879b2 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c74aa110064b4f85fef220e2d47b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766b3be6b5fb4734bd9aeccbd35e3824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:55.090724 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-07e3466d-4f9e-4062-b02c-9ab32b0879b2 tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] 10.222.0.17 "GET /compute/v2.1/servers/7b41cb07-71ed-4403-8d4c-65be6a3c2f4b" status: 200 len: 1309 microversion: 2.1 time: 0.372642 Jul 23 21:26:55.092084 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1714/3331] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:54 2022] GET /compute/v2.1/servers/7b41cb07-71ed-4403-8d4c-65be6a3c2f4b => generated 1309 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:55.100581 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-cdb1262a-a812-4319-b9e7-7971391025b6 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:55.107352 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-cdb1262a-a812-4319-b9e7-7971391025b6 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: 178abb32-365f-4ccd-828b-e69f6fe45370] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:55.114196 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cdb1262a-a812-4319-b9e7-7971391025b6 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:55.114452 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cdb1262a-a812-4319-b9e7-7971391025b6 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:55.116208 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cdb1262a-a812-4319-b9e7-7971391025b6 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:55.116918 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cdb1262a-a812-4319-b9e7-7971391025b6 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:55.331056 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-1c9fb5d3-0c5d-4c1b-8005-1e79b054a7f2 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:55.342078 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1c9fb5d3-0c5d-4c1b-8005-1e79b054a7f2 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/06a478c3-f038-4813-a456-daf3a58b5749" status: 200 len: 1318 microversion: 2.1 time: 0.288084 Jul 23 21:26:55.345052 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1618/3332] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:55 2022] GET /compute/v2.1/servers/06a478c3-f038-4813-a456-daf3a58b5749 => generated 1318 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:55.360251 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d4273b85-277b-477f-9d04-4136f2cf09af tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:55.360820 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d4273b85-277b-477f-9d04-4136f2cf09af tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:55.381481 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d4273b85-277b-477f-9d04-4136f2cf09af tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:55.382351 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d4273b85-277b-477f-9d04-4136f2cf09af tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:55.388919 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d4273b85-277b-477f-9d04-4136f2cf09af tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:55.389768 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d4273b85-277b-477f-9d04-4136f2cf09af tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:55.446683 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-cdb1262a-a812-4319-b9e7-7971391025b6 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:55.460600 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-cdb1262a-a812-4319-b9e7-7971391025b6 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/178abb32-365f-4ccd-828b-e69f6fe45370" status: 200 len: 1487 microversion: 2.1 time: 0.367313 Jul 23 21:26:55.476802 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1715/3333] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:55 2022] GET /compute/v2.1/servers/178abb32-365f-4ccd-828b-e69f6fe45370 => generated 1487 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:55.478198 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d4273b85-277b-477f-9d04-4136f2cf09af tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:55.486423 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-12e9aad2-6e40-4053-8f63-45135ae7ac8c tempest-SecurityGroupsNegativeTestJSON-172220035 tempest-SecurityGroupsNegativeTestJSON-172220035-project] Calling method '.version_select at 0x7f0b59b281f0>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:55.489545 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d4273b85-277b-477f-9d04-4136f2cf09af tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:55.498373 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d4273b85-277b-477f-9d04-4136f2cf09af tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:55.499897 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d4273b85-277b-477f-9d04-4136f2cf09af tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.150523 Jul 23 21:26:55.500776 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1619/3334] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:26:55 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:26:55.510995 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1d7fb8c9-c30a-4b05-ae8a-a602fa66132c tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:55.511493 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1d7fb8c9-c30a-4b05-ae8a-a602fa66132c tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: 178abb32-365f-4ccd-828b-e69f6fe45370] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:55.519353 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1d7fb8c9-c30a-4b05-ae8a-a602fa66132c tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:55.520071 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1d7fb8c9-c30a-4b05-ae8a-a602fa66132c tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:55.521016 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1d7fb8c9-c30a-4b05-ae8a-a602fa66132c tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:55.521673 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1d7fb8c9-c30a-4b05-ae8a-a602fa66132c tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:55.566819 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1d7fb8c9-c30a-4b05-ae8a-a602fa66132c tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: 178abb32-365f-4ccd-828b-e69f6fe45370] Going to try to terminate instance {{(pid=131320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:26:55.656715 ncdv-master-1 devstack@n-api.service[131321]: DEBUG neutronclient.v2_0.client [None req-12e9aad2-6e40-4053-8f63-45135ae7ac8c tempest-SecurityGroupsNegativeTestJSON-172220035 tempest-SecurityGroupsNegativeTestJSON-172220035-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=131321) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 23 21:26:55.657784 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-12e9aad2-6e40-4053-8f63-45135ae7ac8c tempest-SecurityGroupsNegativeTestJSON-172220035 tempest-SecurityGroupsNegativeTestJSON-172220035-project] HTTP exception thrown: Insufficient rights for removing default security group. Jul 23 21:26:55.657784 ncdv-master-1 devstack@n-api.service[131321]: Neutron server returns request_ids: ['req-9c9ac710-d09d-428b-a1c1-7c07a5774082'] Jul 23 21:26:55.660507 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-12e9aad2-6e40-4053-8f63-45135ae7ac8c tempest-SecurityGroupsNegativeTestJSON-172220035 tempest-SecurityGroupsNegativeTestJSON-172220035-project] Request method failure captured: Jul 23 21:26:55.660507 ncdv-master-1 devstack@n-api.service[131321]: request: DELETE /compute/v2.1/os-security-groups/db42759e-e3d3-4edd-a759-a7814a82208b HTTP/1.1 Jul 23 21:26:55.660507 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:26:55.660507 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:26:55.660507 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:26:55.660507 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:26:55.660507 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:26:55.660507 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:26:55.660507 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:26:55.660507 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:26:55.660507 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GeelzZgG07l6_um_x6x8a9k2Yk2nxrQ5bBR9z7Hq2JfMIRtUP7Uh0aFNNYObXguLuwZNwpa4wi1NkC8AOB3AP6A6YkS-YZoGez7NwWb54yFEf_56fLhdCW1m5yAnBnBLsq4714sOU1j5QVPkbaUQuc9Si-hw7f31bb0QB8taIMFxhc Jul 23 21:26:55.660507 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:26:55.660507 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:26:55.660507 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:26:55.660507 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:26:55.660507 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:26:55.660507 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:26:55.660507 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 81c256a3f4f34db1b8eb590bb6d4baa7 Jul 23 21:26:55.660507 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-172220035 Jul 23 21:26:55.660507 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:26:55.660507 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:26:55.660507 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/81c256a3f4f34db1b8eb590bb6d4baa7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/81c256a3f4f34db1b8eb590bb6d4baa7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_81c256a3f4f34db1b8eb590bb6d4baa7", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/81c256a3f4f34db1b8eb590bb6d4baa7"}]}] Jul 23 21:26:55.660507 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-172220035 Jul 23 21:26:55.660507 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 81c256a3f4f34db1b8eb590bb6d4baa7 Jul 23 21:26:55.660507 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-172220035 Jul 23 21:26:55.660507 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-SecurityGroupsNegativeTestJSON-172220035-project Jul 23 21:26:55.660507 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:26:55.660507 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:26:55.660507 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: ce9622bd31514e87a45d4cf05a248a00 Jul 23 21:26:55.660507 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-172220035-project Jul 23 21:26:55.660507 ncdv-master-1 devstack@n-api.service[131321]: method: Jul 23 21:26:55.660507 ncdv-master-1 devstack@n-api.service[131321]: exception: Insufficient rights for removing default security group. Jul 23 21:26:55.660507 ncdv-master-1 devstack@n-api.service[131321]: Neutron server returns request_ids: ['req-9c9ac710-d09d-428b-a1c1-7c07a5774082'] Jul 23 21:26:55.660507 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': 'db42759e-e3d3-4edd-a759-a7814a82208b'} Jul 23 21:26:55.660507 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:26:55.660507 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:26:55.660507 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jul 23 21:26:55.660507 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jul 23 21:26:55.660507 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:26:55.660507 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:26:55.660507 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jul 23 21:26:55.660507 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jul 23 21:26:55.660507 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:26:55.660507 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:26:55.660507 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jul 23 21:26:55.660507 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jul 23 21:26:55.660507 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:26:55.660507 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:26:55.660507 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 23 21:26:55.660507 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 23 21:26:55.660507 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:26:55.660507 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:26:55.660507 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 23 21:26:55.660507 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 23 21:26:55.660507 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:26:55.660507 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:26:55.660507 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 23 21:26:55.660507 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 23 21:26:55.660507 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 23 21:26:55.660507 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 23 21:26:55.660507 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Jul 23 21:26:55.665652 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9c9ac710-d09d-428b-a1c1-7c07a5774082'] Jul 23 21:26:55.665652 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:55.665652 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:26:55.665652 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:55.665652 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:26:55.665652 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jul 23 21:26:55.665652 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jul 23 21:26:55.665652 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jul 23 21:26:55.665652 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jul 23 21:26:55.665652 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Jul 23 21:26:55.665652 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9c9ac710-d09d-428b-a1c1-7c07a5774082'] Jul 23 21:26:55.665652 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:55.665652 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:26:55.665652 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:55.665652 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:26:55.665652 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:26:55.665652 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:26:55.665652 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:26:55.665652 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:26:55.665652 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:26:55.665652 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:26:55.665652 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:26:55.665652 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:26:55.665652 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jul 23 21:26:55.665652 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 23 21:26:55.665652 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Jul 23 21:26:55.665652 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9c9ac710-d09d-428b-a1c1-7c07a5774082'] Jul 23 21:26:55.665652 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:55.665652 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:26:55.665652 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:55.665652 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:26:55.665652 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:26:55.665652 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:26:55.665652 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:26:55.665652 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:26:55.665652 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Jul 23 21:26:55.665652 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9c9ac710-d09d-428b-a1c1-7c07a5774082'] Jul 23 21:26:55.665652 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:55.677000 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-12e9aad2-6e40-4053-8f63-45135ae7ac8c tempest-SecurityGroupsNegativeTestJSON-172220035 tempest-SecurityGroupsNegativeTestJSON-172220035-project] Returning 400 to user: Insufficient rights for removing default security group. Jul 23 21:26:55.677000 ncdv-master-1 devstack@n-api.service[131321]: Neutron server returns request_ids: ['req-9c9ac710-d09d-428b-a1c1-7c07a5774082'] {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:26:55.679958 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-12e9aad2-6e40-4053-8f63-45135ae7ac8c tempest-SecurityGroupsNegativeTestJSON-172220035 tempest-SecurityGroupsNegativeTestJSON-172220035-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/db42759e-e3d3-4edd-a759-a7814a82208b" status: 400 len: 182 microversion: 2.1 time: 0.201345 Jul 23 21:26:55.681487 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1716/3335] 10.222.0.17 () {58 vars in 1271 bytes} [Sat Jul 23 21:26:55 2022] DELETE /compute/v2.1/os-security-groups/db42759e-e3d3-4edd-a759-a7814a82208b => generated 182 bytes in 204 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 23 21:26:55.700316 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-5157c20a-7a4f-446b-bfae-81b8f8267dbc tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:55.702688 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-5157c20a-7a4f-446b-bfae-81b8f8267dbc tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] [instance: 14bdd0f5-f5bf-44bb-876f-2d257eae5fb0] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:55.707037 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1d7fb8c9-c30a-4b05-ae8a-a602fa66132c tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "DELETE /compute/v2.1/servers/178abb32-365f-4ccd-828b-e69f6fe45370" status: 204 len: 0 microversion: 2.1 time: 0.204982 Jul 23 21:26:55.709029 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1620/3336] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:26:55 2022] DELETE /compute/v2.1/servers/178abb32-365f-4ccd-828b-e69f6fe45370 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:26:55.716432 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b8cf595a-f952-4407-89cd-418587a7e941 tempest-SecurityGroupsNegativeTestJSON-172220035 tempest-SecurityGroupsNegativeTestJSON-172220035-project] Calling method '.version_select at 0x7f0b599bbaf0>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:55.717564 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5157c20a-7a4f-446b-bfae-81b8f8267dbc tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:55.718145 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5157c20a-7a4f-446b-bfae-81b8f8267dbc tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:55.718825 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5157c20a-7a4f-446b-bfae-81b8f8267dbc tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:55.719263 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5157c20a-7a4f-446b-bfae-81b8f8267dbc tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:55.751770 ncdv-master-1 devstack@n-api.service[131320]: DEBUG neutronclient.v2_0.client [None req-b8cf595a-f952-4407-89cd-418587a7e941 tempest-SecurityGroupsNegativeTestJSON-172220035 tempest-SecurityGroupsNegativeTestJSON-172220035-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7cb55e4b-c802-4959-992e-6b6cd51bdbad does not exist", "detail": ""}} {{(pid=131320) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 23 21:26:55.752384 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.security_group_api [None req-b8cf595a-f952-4407-89cd-418587a7e941 tempest-SecurityGroupsNegativeTestJSON-172220035 tempest-SecurityGroupsNegativeTestJSON-172220035-project] Neutron security group 7cb55e4b-c802-4959-992e-6b6cd51bdbad not found {{(pid=131320) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 23 21:26:55.752947 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-b8cf595a-f952-4407-89cd-418587a7e941 tempest-SecurityGroupsNegativeTestJSON-172220035 tempest-SecurityGroupsNegativeTestJSON-172220035-project] HTTP exception thrown: Security group 7cb55e4b-c802-4959-992e-6b6cd51bdbad does not exist Jul 23 21:26:55.752947 ncdv-master-1 devstack@n-api.service[131320]: Neutron server returns request_ids: ['req-e59578b6-2434-49a1-89db-a892ebaf6efb'] Jul 23 21:26:55.755213 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b8cf595a-f952-4407-89cd-418587a7e941 tempest-SecurityGroupsNegativeTestJSON-172220035 tempest-SecurityGroupsNegativeTestJSON-172220035-project] Request method failure captured: Jul 23 21:26:55.755213 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/os-security-groups/7cb55e4b-c802-4959-992e-6b6cd51bdbad HTTP/1.1 Jul 23 21:26:55.755213 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:26:55.755213 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:26:55.755213 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:26:55.755213 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:26:55.755213 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:26:55.755213 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:26:55.755213 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:26:55.755213 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:26:55.755213 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GeelzZgG07l6_um_x6x8a9k2Yk2nxrQ5bBR9z7Hq2JfMIRtUP7Uh0aFNNYObXguLuwZNwpa4wi1NkC8AOB3AP6A6YkS-YZoGez7NwWb54yFEf_56fLhdCW1m5yAnBnBLsq4714sOU1j5QVPkbaUQuc9Si-hw7f31bb0QB8taIMFxhc Jul 23 21:26:55.755213 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:26:55.755213 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:26:55.755213 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:26:55.755213 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:26:55.755213 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:26:55.755213 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:26:55.755213 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 81c256a3f4f34db1b8eb590bb6d4baa7 Jul 23 21:26:55.755213 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-172220035 Jul 23 21:26:55.755213 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:26:55.755213 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:26:55.755213 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/81c256a3f4f34db1b8eb590bb6d4baa7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/81c256a3f4f34db1b8eb590bb6d4baa7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_81c256a3f4f34db1b8eb590bb6d4baa7", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/81c256a3f4f34db1b8eb590bb6d4baa7"}]}] Jul 23 21:26:55.755213 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-172220035 Jul 23 21:26:55.755213 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 81c256a3f4f34db1b8eb590bb6d4baa7 Jul 23 21:26:55.755213 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-172220035 Jul 23 21:26:55.755213 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-SecurityGroupsNegativeTestJSON-172220035-project Jul 23 21:26:55.755213 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:26:55.755213 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:26:55.755213 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: ce9622bd31514e87a45d4cf05a248a00 Jul 23 21:26:55.755213 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-172220035-project Jul 23 21:26:55.755213 ncdv-master-1 devstack@n-api.service[131320]: method: Jul 23 21:26:55.755213 ncdv-master-1 devstack@n-api.service[131320]: exception: Security group 7cb55e4b-c802-4959-992e-6b6cd51bdbad does not exist Jul 23 21:26:55.755213 ncdv-master-1 devstack@n-api.service[131320]: Neutron server returns request_ids: ['req-e59578b6-2434-49a1-89db-a892ebaf6efb'] Jul 23 21:26:55.755213 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '7cb55e4b-c802-4959-992e-6b6cd51bdbad'} Jul 23 21:26:55.755213 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:26:55.755213 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:26:55.755213 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 23 21:26:55.755213 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 23 21:26:55.755213 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:26:55.755213 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:26:55.755213 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 23 21:26:55.755213 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 23 21:26:55.755213 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:26:55.755213 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:26:55.755213 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 23 21:26:55.755213 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 23 21:26:55.755213 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:26:55.755213 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:26:55.755213 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 23 21:26:55.755213 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 23 21:26:55.755213 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:26:55.755213 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:26:55.755213 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 23 21:26:55.755213 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 23 21:26:55.755213 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:26:55.755213 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:26:55.755213 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 23 21:26:55.755213 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 23 21:26:55.755213 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 23 21:26:55.755213 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 23 21:26:55.755213 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 7cb55e4b-c802-4959-992e-6b6cd51bdbad does not exist Jul 23 21:26:55.759371 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e59578b6-2434-49a1-89db-a892ebaf6efb'] Jul 23 21:26:55.759371 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:26:55.759371 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:26:55.759371 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:26:55.759371 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:26:55.759371 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 23 21:26:55.759371 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 23 21:26:55.759371 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 23 21:26:55.759371 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 23 21:26:55.759371 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 7cb55e4b-c802-4959-992e-6b6cd51bdbad does not exist Jul 23 21:26:55.759371 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e59578b6-2434-49a1-89db-a892ebaf6efb'] Jul 23 21:26:55.759371 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:26:55.759371 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:26:55.759371 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:26:55.759371 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:26:55.759371 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:26:55.759371 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:26:55.759371 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:26:55.759371 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:26:55.759371 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:26:55.759371 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:26:55.759371 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:26:55.759371 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:26:55.759371 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 23 21:26:55.759371 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 23 21:26:55.759371 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 7cb55e4b-c802-4959-992e-6b6cd51bdbad does not exist Jul 23 21:26:55.759371 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e59578b6-2434-49a1-89db-a892ebaf6efb'] Jul 23 21:26:55.759371 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:26:55.759371 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:26:55.759371 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:26:55.759371 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:26:55.759371 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:26:55.759371 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:26:55.759371 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:26:55.759371 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:26:55.759371 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 7cb55e4b-c802-4959-992e-6b6cd51bdbad does not exist Jul 23 21:26:55.759371 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e59578b6-2434-49a1-89db-a892ebaf6efb'] Jul 23 21:26:55.759371 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:26:55.759371 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b8cf595a-f952-4407-89cd-418587a7e941 tempest-SecurityGroupsNegativeTestJSON-172220035 tempest-SecurityGroupsNegativeTestJSON-172220035-project] Returning 404 to user: Security group 7cb55e4b-c802-4959-992e-6b6cd51bdbad does not exist Jul 23 21:26:55.759371 ncdv-master-1 devstack@n-api.service[131320]: Neutron server returns request_ids: ['req-e59578b6-2434-49a1-89db-a892ebaf6efb'] {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:26:55.759371 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b8cf595a-f952-4407-89cd-418587a7e941 tempest-SecurityGroupsNegativeTestJSON-172220035 tempest-SecurityGroupsNegativeTestJSON-172220035-project] 10.222.0.17 "GET /compute/v2.1/os-security-groups/7cb55e4b-c802-4959-992e-6b6cd51bdbad" status: 404 len: 194 microversion: 2.1 time: 0.046149 Jul 23 21:26:55.759371 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1621/3337] 10.222.0.17 () {58 vars in 1268 bytes} [Sat Jul 23 21:26:55 2022] GET /compute/v2.1/os-security-groups/7cb55e4b-c802-4959-992e-6b6cd51bdbad => generated 194 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:26:55.767028 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f3f21ceb-b87e-47bb-ba4c-e46eec42ed2b tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:55.767779 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f3f21ceb-b87e-47bb-ba4c-e46eec42ed2b tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: 178abb32-365f-4ccd-828b-e69f6fe45370] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:55.777148 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f3f21ceb-b87e-47bb-ba4c-e46eec42ed2b tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:55.777611 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f3f21ceb-b87e-47bb-ba4c-e46eec42ed2b tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:55.778794 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f3f21ceb-b87e-47bb-ba4c-e46eec42ed2b tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:55.779256 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f3f21ceb-b87e-47bb-ba4c-e46eec42ed2b tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:55.900841 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-5157c20a-7a4f-446b-bfae-81b8f8267dbc tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0543f1a561a9442cbc9463ab752bd2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d306759c447edb6d013cf14ac53f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:55.911917 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-5157c20a-7a4f-446b-bfae-81b8f8267dbc tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] 10.222.0.17 "GET /compute/v2.1/servers/14bdd0f5-f5bf-44bb-876f-2d257eae5fb0" status: 200 len: 1505 microversion: 2.1 time: 0.227921 Jul 23 21:26:55.925524 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1717/3338] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:55 2022] GET /compute/v2.1/servers/14bdd0f5-f5bf-44bb-876f-2d257eae5fb0 => generated 1505 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:55.931376 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-7ccb846f-e62d-447e-8a77-18ad9df8d52f tempest-SecurityGroupsNegativeTestJSON-172220035 tempest-SecurityGroupsNegativeTestJSON-172220035-project] Action: 'update', calling method: .version_select at 0x7f0b47601670>, body: {"security_group": {"name": "tempest-sg-1140419129", "description": "tempest-description-36547426"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:26:55.955122 ncdv-master-1 devstack@n-api.service[131321]: DEBUG neutronclient.v2_0.client [None req-7ccb846f-e62d-447e-8a77-18ad9df8d52f tempest-SecurityGroupsNegativeTestJSON-172220035 tempest-SecurityGroupsNegativeTestJSON-172220035-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 6c41e87d-109b-4702-8dbb-1f20eaa7c1ab does not exist", "detail": ""}} {{(pid=131321) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 23 21:26:55.955732 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.network.security_group_api [None req-7ccb846f-e62d-447e-8a77-18ad9df8d52f tempest-SecurityGroupsNegativeTestJSON-172220035 tempest-SecurityGroupsNegativeTestJSON-172220035-project] Neutron security group 6c41e87d-109b-4702-8dbb-1f20eaa7c1ab not found {{(pid=131321) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 23 21:26:55.956269 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-7ccb846f-e62d-447e-8a77-18ad9df8d52f tempest-SecurityGroupsNegativeTestJSON-172220035 tempest-SecurityGroupsNegativeTestJSON-172220035-project] HTTP exception thrown: Security group 6c41e87d-109b-4702-8dbb-1f20eaa7c1ab does not exist Jul 23 21:26:55.956269 ncdv-master-1 devstack@n-api.service[131321]: Neutron server returns request_ids: ['req-275c8b1d-205f-408b-8905-a1df7b8e8c51'] Jul 23 21:26:55.958880 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-7ccb846f-e62d-447e-8a77-18ad9df8d52f tempest-SecurityGroupsNegativeTestJSON-172220035 tempest-SecurityGroupsNegativeTestJSON-172220035-project] Request method failure captured: Jul 23 21:26:55.958880 ncdv-master-1 devstack@n-api.service[131321]: request: PUT /compute/v2.1/os-security-groups/6c41e87d-109b-4702-8dbb-1f20eaa7c1ab HTTP/1.1 Jul 23 21:26:55.958880 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:26:55.958880 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:26:55.958880 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:26:55.958880 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 100 Jul 23 21:26:55.958880 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:26:55.958880 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:26:55.958880 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:26:55.958880 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:26:55.958880 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GeelzZgG07l6_um_x6x8a9k2Yk2nxrQ5bBR9z7Hq2JfMIRtUP7Uh0aFNNYObXguLuwZNwpa4wi1NkC8AOB3AP6A6YkS-YZoGez7NwWb54yFEf_56fLhdCW1m5yAnBnBLsq4714sOU1j5QVPkbaUQuc9Si-hw7f31bb0QB8taIMFxhc Jul 23 21:26:55.958880 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:26:55.958880 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:26:55.958880 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:26:55.958880 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:26:55.958880 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:26:55.958880 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:26:55.958880 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 81c256a3f4f34db1b8eb590bb6d4baa7 Jul 23 21:26:55.958880 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-172220035 Jul 23 21:26:55.958880 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:26:55.958880 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:26:55.958880 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/81c256a3f4f34db1b8eb590bb6d4baa7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/81c256a3f4f34db1b8eb590bb6d4baa7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_81c256a3f4f34db1b8eb590bb6d4baa7", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/81c256a3f4f34db1b8eb590bb6d4baa7"}]}] Jul 23 21:26:55.958880 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-172220035 Jul 23 21:26:55.958880 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 81c256a3f4f34db1b8eb590bb6d4baa7 Jul 23 21:26:55.958880 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-172220035 Jul 23 21:26:55.958880 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-SecurityGroupsNegativeTestJSON-172220035-project Jul 23 21:26:55.958880 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:26:55.958880 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:26:55.958880 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: ce9622bd31514e87a45d4cf05a248a00 Jul 23 21:26:55.958880 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-172220035-project Jul 23 21:26:55.958880 ncdv-master-1 devstack@n-api.service[131321]: Jul 23 21:26:55.958880 ncdv-master-1 devstack@n-api.service[131321]: {"security_group": {"name": "tempest-sg-1140419129", "description": "tempest-description-36547426"}} Jul 23 21:26:55.958880 ncdv-master-1 devstack@n-api.service[131321]: method: Jul 23 21:26:55.958880 ncdv-master-1 devstack@n-api.service[131321]: exception: Security group 6c41e87d-109b-4702-8dbb-1f20eaa7c1ab does not exist Jul 23 21:26:55.958880 ncdv-master-1 devstack@n-api.service[131321]: Neutron server returns request_ids: ['req-275c8b1d-205f-408b-8905-a1df7b8e8c51'] Jul 23 21:26:55.958880 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': '6c41e87d-109b-4702-8dbb-1f20eaa7c1ab', 'body': {'security_group': {'name': 'tempest-sg-1140419129', 'description': 'tempest-description-36547426'}}} Jul 23 21:26:55.958880 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:26:55.958880 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:26:55.958880 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 23 21:26:55.958880 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 23 21:26:55.958880 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:26:55.958880 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:26:55.958880 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 23 21:26:55.958880 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 23 21:26:55.958880 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:26:55.958880 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:26:55.958880 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 23 21:26:55.958880 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 23 21:26:55.958880 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:26:55.958880 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:26:55.958880 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 23 21:26:55.958880 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 23 21:26:55.958880 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:26:55.958880 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:26:55.958880 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 23 21:26:55.958880 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 23 21:26:55.958880 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:26:55.958880 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:26:55.958880 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 23 21:26:55.958880 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 23 21:26:55.958880 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 23 21:26:55.962810 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 23 21:26:55.962810 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 6c41e87d-109b-4702-8dbb-1f20eaa7c1ab does not exist Jul 23 21:26:55.962810 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-275c8b1d-205f-408b-8905-a1df7b8e8c51'] Jul 23 21:26:55.962810 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:55.962810 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:26:55.962810 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:55.962810 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:26:55.962810 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Jul 23 21:26:55.962810 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 23 21:26:55.962810 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 23 21:26:55.962810 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 23 21:26:55.962810 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 6c41e87d-109b-4702-8dbb-1f20eaa7c1ab does not exist Jul 23 21:26:55.962810 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-275c8b1d-205f-408b-8905-a1df7b8e8c51'] Jul 23 21:26:55.962810 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:55.962810 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:26:55.962810 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:55.962810 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:26:55.962810 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:26:55.962810 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:26:55.962810 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:26:55.962810 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:26:55.962810 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:26:55.962810 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:26:55.962810 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:26:55.962810 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:26:55.962810 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Jul 23 21:26:55.962810 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 23 21:26:55.962810 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 6c41e87d-109b-4702-8dbb-1f20eaa7c1ab does not exist Jul 23 21:26:55.962810 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-275c8b1d-205f-408b-8905-a1df7b8e8c51'] Jul 23 21:26:55.962810 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:55.962810 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:26:55.962810 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:55.962810 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:26:55.962810 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:26:55.962810 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:26:55.962810 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:26:55.962810 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:26:55.962810 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 6c41e87d-109b-4702-8dbb-1f20eaa7c1ab does not exist Jul 23 21:26:55.962810 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-275c8b1d-205f-408b-8905-a1df7b8e8c51'] Jul 23 21:26:55.962810 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:26:55.962810 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-7ccb846f-e62d-447e-8a77-18ad9df8d52f tempest-SecurityGroupsNegativeTestJSON-172220035 tempest-SecurityGroupsNegativeTestJSON-172220035-project] Returning 404 to user: Security group 6c41e87d-109b-4702-8dbb-1f20eaa7c1ab does not exist Jul 23 21:26:55.962810 ncdv-master-1 devstack@n-api.service[131321]: Neutron server returns request_ids: ['req-275c8b1d-205f-408b-8905-a1df7b8e8c51'] {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:26:55.962810 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-7ccb846f-e62d-447e-8a77-18ad9df8d52f tempest-SecurityGroupsNegativeTestJSON-172220035 tempest-SecurityGroupsNegativeTestJSON-172220035-project] 10.222.0.17 "PUT /compute/v2.1/os-security-groups/6c41e87d-109b-4702-8dbb-1f20eaa7c1ab" status: 404 len: 194 microversion: 2.1 time: 0.033107 Jul 23 21:26:55.966877 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1718/3339] 10.222.0.17 () {60 vars in 1289 bytes} [Sat Jul 23 21:26:55 2022] PUT /compute/v2.1/os-security-groups/6c41e87d-109b-4702-8dbb-1f20eaa7c1ab => generated 194 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:26:55.972361 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-833eb5b1-286e-45bc-8f95-19e74f3ecbd2 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:55.972883 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-833eb5b1-286e-45bc-8f95-19e74f3ecbd2 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] [instance: 14bdd0f5-f5bf-44bb-876f-2d257eae5fb0] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:55.983651 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-833eb5b1-286e-45bc-8f95-19e74f3ecbd2 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:55.984277 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-833eb5b1-286e-45bc-8f95-19e74f3ecbd2 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:55.985681 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-833eb5b1-286e-45bc-8f95-19e74f3ecbd2 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:55.986382 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-833eb5b1-286e-45bc-8f95-19e74f3ecbd2 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:55.992350 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f3f21ceb-b87e-47bb-ba4c-e46eec42ed2b tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:56.004636 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f3f21ceb-b87e-47bb-ba4c-e46eec42ed2b tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/178abb32-365f-4ccd-828b-e69f6fe45370" status: 200 len: 1493 microversion: 2.1 time: 0.240941 Jul 23 21:26:56.014670 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1622/3340] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:55 2022] GET /compute/v2.1/servers/178abb32-365f-4ccd-828b-e69f6fe45370 => generated 1493 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:56.029594 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-833eb5b1-286e-45bc-8f95-19e74f3ecbd2 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] [instance: 14bdd0f5-f5bf-44bb-876f-2d257eae5fb0] Going to try to terminate instance {{(pid=131321) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:26:56.094546 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:26:56.109508 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-77a71ab1-8b98-40a5-8620-a516550ba6fb tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:56.110777 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-77a71ab1-8b98-40a5-8620-a516550ba6fb tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] [instance: 7b41cb07-71ed-4403-8d4c-65be6a3c2f4b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:56.119108 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-77a71ab1-8b98-40a5-8620-a516550ba6fb tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:56.120161 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-77a71ab1-8b98-40a5-8620-a516550ba6fb tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:56.121576 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-77a71ab1-8b98-40a5-8620-a516550ba6fb tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:56.122295 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-77a71ab1-8b98-40a5-8620-a516550ba6fb tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:56.143229 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-77a71ab1-8b98-40a5-8620-a516550ba6fb tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] HTTP exception thrown: Instance 7b41cb07-71ed-4403-8d4c-65be6a3c2f4b could not be found. Jul 23 21:26:56.145302 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-77a71ab1-8b98-40a5-8620-a516550ba6fb tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Request method failure captured: Jul 23 21:26:56.145302 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/7b41cb07-71ed-4403-8d4c-65be6a3c2f4b HTTP/1.1 Jul 23 21:26:56.145302 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:26:56.145302 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:26:56.145302 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:26:56.145302 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:26:56.145302 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:26:56.145302 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:26:56.145302 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:26:56.145302 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:26:56.145302 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GeD-C0KhfDo5QfL61Slq0RBwJfZgT6PQOxG6Oa0UyFRLrDHFzYSiGKQ9TZXLf6riilc4WNfhLK9J23crHfUGS-aIlJoCmR0nM8_4pntU4gvxJOssT3gVahHjJQA9KwW8xPbL8KohWeOpvX-s1ceABvzQw_j7k-pzebMDWT6F9NUszg Jul 23 21:26:56.145302 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:26:56.145302 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:26:56.145302 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:26:56.145302 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:26:56.145302 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:26:56.145302 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:26:56.145302 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 766b3be6b5fb4734bd9aeccbd35e3824 Jul 23 21:26:56.145302 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-231957292 Jul 23 21:26:56.145302 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:26:56.145302 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:26:56.145302 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/766b3be6b5fb4734bd9aeccbd35e3824"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/766b3be6b5fb4734bd9aeccbd35e3824"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_766b3be6b5fb4734bd9aeccbd35e3824", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/766b3be6b5fb4734bd9aeccbd35e3824"}]}] Jul 23 21:26:56.145302 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-231957292 Jul 23 21:26:56.145302 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 766b3be6b5fb4734bd9aeccbd35e3824 Jul 23 21:26:56.145302 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-231957292 Jul 23 21:26:56.145302 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServerMetadataNegativeTestJSON-231957292-project Jul 23 21:26:56.145302 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:26:56.145302 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:26:56.145302 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 38c74aa110064b4f85fef220e2d47b4f Jul 23 21:26:56.145302 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-231957292-project Jul 23 21:26:56.145302 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:26:56.145302 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance 7b41cb07-71ed-4403-8d4c-65be6a3c2f4b could not be found. Jul 23 21:26:56.145302 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '7b41cb07-71ed-4403-8d4c-65be6a3c2f4b'} Jul 23 21:26:56.145302 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:26:56.145302 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:26:56.145302 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:26:56.145302 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:26:56.145302 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:26:56.145302 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:26:56.145302 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:26:56.145302 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:26:56.145302 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:26:56.145302 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:26:56.145302 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b41cb07-71ed-4403-8d4c-65be6a3c2f4b could not be found. Jul 23 21:26:56.145302 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:26:56.145302 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:26:56.145302 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:26:56.145302 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:26:56.145302 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:26:56.145302 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:26:56.145302 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:26:56.145302 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:26:56.145302 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:26:56.145302 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:26:56.145302 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:26:56.145302 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:26:56.145302 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:26:56.145302 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:26:56.145302 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:26:56.145302 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:26:56.145302 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b41cb07-71ed-4403-8d4c-65be6a3c2f4b could not be found. Jul 23 21:26:56.145302 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:26:56.145302 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:26:56.150646 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:26:56.150646 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:26:56.150646 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:26:56.150646 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:26:56.150646 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:26:56.150646 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:26:56.150646 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b41cb07-71ed-4403-8d4c-65be6a3c2f4b could not be found. Jul 23 21:26:56.150646 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:26:56.155766 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-77a71ab1-8b98-40a5-8620-a516550ba6fb tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] Returning 404 to user: Instance 7b41cb07-71ed-4403-8d4c-65be6a3c2f4b could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:26:56.157004 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-77a71ab1-8b98-40a5-8620-a516550ba6fb tempest-ServerMetadataNegativeTestJSON-231957292 tempest-ServerMetadataNegativeTestJSON-231957292-project] 10.222.0.17 "GET /compute/v2.1/servers/7b41cb07-71ed-4403-8d4c-65be6a3c2f4b" status: 404 len: 111 microversion: 2.1 time: 0.053111 Jul 23 21:26:56.158146 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1623/3341] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:56 2022] GET /compute/v2.1/servers/7b41cb07-71ed-4403-8d4c-65be6a3c2f4b => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:26:56.168987 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-833eb5b1-286e-45bc-8f95-19e74f3ecbd2 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] 10.222.0.17 "DELETE /compute/v2.1/servers/14bdd0f5-f5bf-44bb-876f-2d257eae5fb0" status: 204 len: 0 microversion: 2.1 time: 0.200903 Jul 23 21:26:56.169587 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1719/3342] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:26:55 2022] DELETE /compute/v2.1/servers/14bdd0f5-f5bf-44bb-876f-2d257eae5fb0 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:26:56.188501 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3d1b572b-ba43-40de-80b3-c9796445bef0 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:56.189518 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-3d1b572b-ba43-40de-80b3-c9796445bef0 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] [instance: 163182e4-bfa7-4da7-9267-9cbb8a911183] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:56.214218 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-4d163bef-9406-4d68-9bf0-2c555c42da46 req-1178cf96-cbe6-4ba9-b75b-4f24e9619d7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06a478c3-f038-4813-a456-daf3a58b5749", "name": "network-vif-plugged", "status": "completed", "tag": "661b9337-be92-4f83-a6f7-6a98a2b053db"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:26:56.214386 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3d1b572b-ba43-40de-80b3-c9796445bef0 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:56.216428 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3d1b572b-ba43-40de-80b3-c9796445bef0 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:56.217321 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3d1b572b-ba43-40de-80b3-c9796445bef0 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:56.220358 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3d1b572b-ba43-40de-80b3-c9796445bef0 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:56.225940 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-4d163bef-9406-4d68-9bf0-2c555c42da46 req-1178cf96-cbe6-4ba9-b75b-4f24e9619d7c service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:56.226396 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-4d163bef-9406-4d68-9bf0-2c555c42da46 req-1178cf96-cbe6-4ba9-b75b-4f24e9619d7c service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:56.252714 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-4d163bef-9406-4d68-9bf0-2c555c42da46 req-1178cf96-cbe6-4ba9-b75b-4f24e9619d7c service nova] Creating event network-vif-plugged:661b9337-be92-4f83-a6f7-6a98a2b053db for instance 06a478c3-f038-4813-a456-daf3a58b5749 on nch2-master-1 Jul 23 21:26:56.267700 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-4d163bef-9406-4d68-9bf0-2c555c42da46 req-1178cf96-cbe6-4ba9-b75b-4f24e9619d7c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057737 Jul 23 21:26:56.268462 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1720/3343] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:26:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:26:56.291297 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-3d1b572b-ba43-40de-80b3-c9796445bef0 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] [instance: 163182e4-bfa7-4da7-9267-9cbb8a911183] Going to try to terminate instance {{(pid=131320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:26:56.362658 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d32c6927-c4c8-4e3a-8f85-48168970154b tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:56.363303 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-d32c6927-c4c8-4e3a-8f85-48168970154b tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: 06a478c3-f038-4813-a456-daf3a58b5749] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:56.374150 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d32c6927-c4c8-4e3a-8f85-48168970154b tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:56.374610 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d32c6927-c4c8-4e3a-8f85-48168970154b tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:56.375412 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d32c6927-c4c8-4e3a-8f85-48168970154b tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:56.375963 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d32c6927-c4c8-4e3a-8f85-48168970154b tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:56.417256 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-3d1b572b-ba43-40de-80b3-c9796445bef0 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] 10.222.0.17 "DELETE /compute/v2.1/servers/163182e4-bfa7-4da7-9267-9cbb8a911183" status: 204 len: 0 microversion: 2.1 time: 0.241631 Jul 23 21:26:56.418678 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1624/3344] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:26:56 2022] DELETE /compute/v2.1/servers/163182e4-bfa7-4da7-9267-9cbb8a911183 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:26:56.430480 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6d5ab83c-c91b-4eef-b826-c48792821815 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:56.431880 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6d5ab83c-c91b-4eef-b826-c48792821815 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] [instance: 14bdd0f5-f5bf-44bb-876f-2d257eae5fb0] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:56.445272 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6d5ab83c-c91b-4eef-b826-c48792821815 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:56.447196 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6d5ab83c-c91b-4eef-b826-c48792821815 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:56.448201 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6d5ab83c-c91b-4eef-b826-c48792821815 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:56.450487 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6d5ab83c-c91b-4eef-b826-c48792821815 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:56.712596 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-d32c6927-c4c8-4e3a-8f85-48168970154b tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:56.723611 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-d32c6927-c4c8-4e3a-8f85-48168970154b tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/06a478c3-f038-4813-a456-daf3a58b5749" status: 200 len: 1318 microversion: 2.1 time: 0.366194 Jul 23 21:26:56.728651 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1721/3345] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:56 2022] GET /compute/v2.1/servers/06a478c3-f038-4813-a456-daf3a58b5749 => generated 1318 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:56.735626 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-06784f62-5787-43dd-8feb-c9e67e9f97f5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:56.743116 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-06784f62-5787-43dd-8feb-c9e67e9f97f5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:56.763600 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-06784f62-5787-43dd-8feb-c9e67e9f97f5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:56.765255 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-06784f62-5787-43dd-8feb-c9e67e9f97f5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:56.770041 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-06784f62-5787-43dd-8feb-c9e67e9f97f5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:56.770874 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-06784f62-5787-43dd-8feb-c9e67e9f97f5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:56.783240 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6d5ab83c-c91b-4eef-b826-c48792821815 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0543f1a561a9442cbc9463ab752bd2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d306759c447edb6d013cf14ac53f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:56.799386 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6d5ab83c-c91b-4eef-b826-c48792821815 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] 10.222.0.17 "GET /compute/v2.1/servers/14bdd0f5-f5bf-44bb-876f-2d257eae5fb0" status: 200 len: 1511 microversion: 2.1 time: 0.376221 Jul 23 21:26:56.807291 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1625/3346] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:56 2022] GET /compute/v2.1/servers/14bdd0f5-f5bf-44bb-876f-2d257eae5fb0 => generated 1511 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:56.933047 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-06784f62-5787-43dd-8feb-c9e67e9f97f5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:56.956190 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-06784f62-5787-43dd-8feb-c9e67e9f97f5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:56.959360 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-06784f62-5787-43dd-8feb-c9e67e9f97f5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:56.963933 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-06784f62-5787-43dd-8feb-c9e67e9f97f5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.233880 Jul 23 21:26:56.966067 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1722/3347] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:26:56 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:26:57.023041 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8164b168-4efa-476f-8da9-1c64a8d1405d tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:57.024306 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8164b168-4efa-476f-8da9-1c64a8d1405d tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: 178abb32-365f-4ccd-828b-e69f6fe45370] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:57.032853 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8164b168-4efa-476f-8da9-1c64a8d1405d tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:57.035633 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8164b168-4efa-476f-8da9-1c64a8d1405d tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:57.039539 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8164b168-4efa-476f-8da9-1c64a8d1405d tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:57.039539 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8164b168-4efa-476f-8da9-1c64a8d1405d tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:57.498342 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8164b168-4efa-476f-8da9-1c64a8d1405d tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:57.507661 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8164b168-4efa-476f-8da9-1c64a8d1405d tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/178abb32-365f-4ccd-828b-e69f6fe45370" status: 200 len: 1493 microversion: 2.1 time: 0.488987 Jul 23 21:26:57.508629 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1626/3348] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:57 2022] GET /compute/v2.1/servers/178abb32-365f-4ccd-828b-e69f6fe45370 => generated 1493 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:57.743585 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c6860cfc-86f0-4b5d-89df-7644d7665231 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:57.744989 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-c6860cfc-86f0-4b5d-89df-7644d7665231 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: 06a478c3-f038-4813-a456-daf3a58b5749] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:57.760898 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c6860cfc-86f0-4b5d-89df-7644d7665231 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:57.761681 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c6860cfc-86f0-4b5d-89df-7644d7665231 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:57.767184 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c6860cfc-86f0-4b5d-89df-7644d7665231 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:57.767926 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c6860cfc-86f0-4b5d-89df-7644d7665231 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:57.818758 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-bcfd4db8-7937-481e-94c0-95e0a52dc4e0 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:57.819388 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-bcfd4db8-7937-481e-94c0-95e0a52dc4e0 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] [instance: 14bdd0f5-f5bf-44bb-876f-2d257eae5fb0] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:57.834717 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bcfd4db8-7937-481e-94c0-95e0a52dc4e0 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:57.837692 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bcfd4db8-7937-481e-94c0-95e0a52dc4e0 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:57.838572 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bcfd4db8-7937-481e-94c0-95e0a52dc4e0 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:57.841814 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bcfd4db8-7937-481e-94c0-95e0a52dc4e0 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:58.026971 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c6860cfc-86f0-4b5d-89df-7644d7665231 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:58.035560 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-c6860cfc-86f0-4b5d-89df-7644d7665231 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/06a478c3-f038-4813-a456-daf3a58b5749" status: 200 len: 1318 microversion: 2.1 time: 0.296615 Jul 23 21:26:58.036904 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1723/3349] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:57 2022] GET /compute/v2.1/servers/06a478c3-f038-4813-a456-daf3a58b5749 => generated 1318 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:58.042039 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-01324268-33e5-4ffe-859f-f4dffeca6d89 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:58.043067 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-01324268-33e5-4ffe-859f-f4dffeca6d89 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:58.051656 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-01324268-33e5-4ffe-859f-f4dffeca6d89 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:58.052494 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-01324268-33e5-4ffe-859f-f4dffeca6d89 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:58.054850 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-01324268-33e5-4ffe-859f-f4dffeca6d89 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:58.055457 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-01324268-33e5-4ffe-859f-f4dffeca6d89 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:58.168565 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-01324268-33e5-4ffe-859f-f4dffeca6d89 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:58.179304 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-01324268-33e5-4ffe-859f-f4dffeca6d89 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:58.181263 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-01324268-33e5-4ffe-859f-f4dffeca6d89 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:58.182814 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-01324268-33e5-4ffe-859f-f4dffeca6d89 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.144683 Jul 23 21:26:58.183636 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1724/3350] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:26:58 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:26:58.525275 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-0c3558d6-222c-4582-819b-12fbbd9a9959 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:58.525987 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-0c3558d6-222c-4582-819b-12fbbd9a9959 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: 178abb32-365f-4ccd-828b-e69f6fe45370] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:58.532832 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0c3558d6-222c-4582-819b-12fbbd9a9959 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:58.534176 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0c3558d6-222c-4582-819b-12fbbd9a9959 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:58.535265 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0c3558d6-222c-4582-819b-12fbbd9a9959 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:58.536001 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0c3558d6-222c-4582-819b-12fbbd9a9959 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:58.749186 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-bcfd4db8-7937-481e-94c0-95e0a52dc4e0 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0543f1a561a9442cbc9463ab752bd2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d306759c447edb6d013cf14ac53f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:58.761208 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-bcfd4db8-7937-481e-94c0-95e0a52dc4e0 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] 10.222.0.17 "GET /compute/v2.1/servers/14bdd0f5-f5bf-44bb-876f-2d257eae5fb0" status: 200 len: 1511 microversion: 2.1 time: 0.947803 Jul 23 21:26:58.762187 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1627/3351] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:57 2022] GET /compute/v2.1/servers/14bdd0f5-f5bf-44bb-876f-2d257eae5fb0 => generated 1511 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:58.999918 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-0c3558d6-222c-4582-819b-12fbbd9a9959 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:59.011976 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-0c3558d6-222c-4582-819b-12fbbd9a9959 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/178abb32-365f-4ccd-828b-e69f6fe45370" status: 200 len: 1451 microversion: 2.1 time: 0.490696 Jul 23 21:26:59.012638 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1725/3352] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:58 2022] GET /compute/v2.1/servers/178abb32-365f-4ccd-828b-e69f6fe45370 => generated 1451 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:59.054866 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-714130e7-6f83-4525-8c84-e10c39c8ccd5 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:59.058773 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-714130e7-6f83-4525-8c84-e10c39c8ccd5 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: 06a478c3-f038-4813-a456-daf3a58b5749] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:59.081074 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-714130e7-6f83-4525-8c84-e10c39c8ccd5 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:59.081528 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-714130e7-6f83-4525-8c84-e10c39c8ccd5 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:59.082401 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-714130e7-6f83-4525-8c84-e10c39c8ccd5 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:59.082851 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-714130e7-6f83-4525-8c84-e10c39c8ccd5 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:59.136752 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-20f503a2-f005-4e66-b289-8693bda7ff27 req-bcb5eeb5-b5fd-457f-893d-f6c27de20170 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "178abb32-365f-4ccd-828b-e69f6fe45370", "name": "network-vif-deleted", "tag": "54f48db7-b019-4df9-8c26-192df4b720c4"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:26:59.158400 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-20f503a2-f005-4e66-b289-8693bda7ff27 req-bcb5eeb5-b5fd-457f-893d-f6c27de20170 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:59.165903 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-20f503a2-f005-4e66-b289-8693bda7ff27 req-bcb5eeb5-b5fd-457f-893d-f6c27de20170 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:59.202163 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-20f503a2-f005-4e66-b289-8693bda7ff27 req-bcb5eeb5-b5fd-457f-893d-f6c27de20170 service nova] Creating event network-vif-deleted:54f48db7-b019-4df9-8c26-192df4b720c4 for instance 178abb32-365f-4ccd-828b-e69f6fe45370 on nch2-master-1 Jul 23 21:26:59.216274 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-20f503a2-f005-4e66-b289-8693bda7ff27 req-bcb5eeb5-b5fd-457f-893d-f6c27de20170 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093582 Jul 23 21:26:59.221474 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1726/3353] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:26:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:26:59.242214 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-19e62623-dad6-47b8-a587-8374fd794963 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:59.243296 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-19e62623-dad6-47b8-a587-8374fd794963 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:59.269469 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-19e62623-dad6-47b8-a587-8374fd794963 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:59.271309 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-19e62623-dad6-47b8-a587-8374fd794963 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:59.277958 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-19e62623-dad6-47b8-a587-8374fd794963 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:59.278737 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-19e62623-dad6-47b8-a587-8374fd794963 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:59.443624 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-19e62623-dad6-47b8-a587-8374fd794963 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:59.473297 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-19e62623-dad6-47b8-a587-8374fd794963 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:59.475713 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-19e62623-dad6-47b8-a587-8374fd794963 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:59.477473 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-19e62623-dad6-47b8-a587-8374fd794963 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.252270 Jul 23 21:26:59.492558 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1727/3354] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:26:59 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:26:59.588355 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-714130e7-6f83-4525-8c84-e10c39c8ccd5 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:26:59.603931 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-714130e7-6f83-4525-8c84-e10c39c8ccd5 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/06a478c3-f038-4813-a456-daf3a58b5749" status: 200 len: 1508 microversion: 2.1 time: 0.554988 Jul 23 21:26:59.606333 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1628/3355] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:59 2022] GET /compute/v2.1/servers/06a478c3-f038-4813-a456-daf3a58b5749 => generated 1508 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:26:59.623479 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-3ffccb7d-d16b-446e-8c56-e8d9e3efe9ed tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:59.624367 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-3ffccb7d-d16b-446e-8c56-e8d9e3efe9ed tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: 06a478c3-f038-4813-a456-daf3a58b5749] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:59.636837 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3ffccb7d-d16b-446e-8c56-e8d9e3efe9ed tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:59.637356 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3ffccb7d-d16b-446e-8c56-e8d9e3efe9ed tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:59.638725 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3ffccb7d-d16b-446e-8c56-e8d9e3efe9ed tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:59.639518 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3ffccb7d-d16b-446e-8c56-e8d9e3efe9ed tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:59.779111 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0e57f1c8-ad28-4abe-9435-9a902512589a tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:26:59.779885 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-0e57f1c8-ad28-4abe-9435-9a902512589a tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] [instance: 14bdd0f5-f5bf-44bb-876f-2d257eae5fb0] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:26:59.783222 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:26:59.799684 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0e57f1c8-ad28-4abe-9435-9a902512589a tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:59.800549 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0e57f1c8-ad28-4abe-9435-9a902512589a tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:59.801564 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0e57f1c8-ad28-4abe-9435-9a902512589a tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:26:59.802248 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0e57f1c8-ad28-4abe-9435-9a902512589a tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:26:59.807948 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:00.034537 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-3ffccb7d-d16b-446e-8c56-e8d9e3efe9ed tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:00.051349 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-3ffccb7d-d16b-446e-8c56-e8d9e3efe9ed tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/06a478c3-f038-4813-a456-daf3a58b5749" status: 200 len: 1508 microversion: 2.1 time: 0.431958 Jul 23 21:27:00.053267 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1728/3356] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:59 2022] GET /compute/v2.1/servers/06a478c3-f038-4813-a456-daf3a58b5749 => generated 1508 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:00.058961 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-2b1ce919-0727-46eb-997b-97c7880a7f9d tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:00.060506 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-2b1ce919-0727-46eb-997b-97c7880a7f9d tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: 178abb32-365f-4ccd-828b-e69f6fe45370] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:00.073513 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2b1ce919-0727-46eb-997b-97c7880a7f9d tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:00.074505 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2b1ce919-0727-46eb-997b-97c7880a7f9d tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:00.077696 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2b1ce919-0727-46eb-997b-97c7880a7f9d tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:00.078430 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2b1ce919-0727-46eb-997b-97c7880a7f9d tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:00.100393 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-2b1ce919-0727-46eb-997b-97c7880a7f9d tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] HTTP exception thrown: Instance 178abb32-365f-4ccd-828b-e69f6fe45370 could not be found. Jul 23 21:27:00.104678 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-2b1ce919-0727-46eb-997b-97c7880a7f9d tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Request method failure captured: Jul 23 21:27:00.104678 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/servers/178abb32-365f-4ccd-828b-e69f6fe45370 HTTP/1.1 Jul 23 21:27:00.104678 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:27:00.104678 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:27:00.104678 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:27:00.104678 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:27:00.104678 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:27:00.104678 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:27:00.104678 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:27:00.104678 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:27:00.104678 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GddaYqyOuWcIIbeHmsk3fPEmdWyfGLbr9Nsz9MmxXVcs_PKtvbIqY2C8j4fzxFCSVf8V3fYFIZhvaOHyCuudCVcoCOVgWdy__DYWHqWW4I8VD_yG4rJj0HZodonpxNaGqSkGiL8DXUXMaZTTZO1BvjnTGQlN8CnshrUQQ72pGMeb2k Jul 23 21:27:00.104678 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:27:00.104678 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:27:00.104678 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:27:00.104678 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:27:00.104678 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:27:00.104678 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:27:00.104678 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: a892bfe56afd4ee5bb6c47e926af7349 Jul 23 21:27:00.104678 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-DeleteServersTestJSON-745069838 Jul 23 21:27:00.104678 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:27:00.104678 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:27:00.104678 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a892bfe56afd4ee5bb6c47e926af7349"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a892bfe56afd4ee5bb6c47e926af7349"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a892bfe56afd4ee5bb6c47e926af7349", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a892bfe56afd4ee5bb6c47e926af7349"}]}] Jul 23 21:27:00.104678 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-DeleteServersTestJSON-745069838 Jul 23 21:27:00.104678 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: a892bfe56afd4ee5bb6c47e926af7349 Jul 23 21:27:00.104678 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-DeleteServersTestJSON-745069838 Jul 23 21:27:00.104678 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-DeleteServersTestJSON-745069838-project Jul 23 21:27:00.104678 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:27:00.104678 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:27:00.104678 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: affc3572ef7d45249f50b5061a681d18 Jul 23 21:27:00.104678 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-DeleteServersTestJSON-745069838-project Jul 23 21:27:00.104678 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:27:00.104678 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance 178abb32-365f-4ccd-828b-e69f6fe45370 could not be found. Jul 23 21:27:00.104678 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': '178abb32-365f-4ccd-828b-e69f6fe45370'} Jul 23 21:27:00.104678 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:27:00.104678 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:27:00.104678 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:27:00.104678 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:27:00.104678 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:27:00.104678 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:27:00.104678 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:27:00.104678 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:27:00.104678 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:27:00.104678 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:27:00.104678 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 178abb32-365f-4ccd-828b-e69f6fe45370 could not be found. Jul 23 21:27:00.104678 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:27:00.104678 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:27:00.104678 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:27:00.104678 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:27:00.104678 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:27:00.104678 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:27:00.104678 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:27:00.104678 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:27:00.104678 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:27:00.104678 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:27:00.104678 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:27:00.104678 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:27:00.104678 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:27:00.104678 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:27:00.104678 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:27:00.104678 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:27:00.104678 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 178abb32-365f-4ccd-828b-e69f6fe45370 could not be found. Jul 23 21:27:00.104678 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:27:00.104678 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:27:00.104678 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:27:00.108936 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:27:00.108936 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:27:00.108936 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:27:00.108936 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:27:00.108936 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:27:00.108936 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 178abb32-365f-4ccd-828b-e69f6fe45370 could not be found. Jul 23 21:27:00.108936 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:27:00.116181 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-2b1ce919-0727-46eb-997b-97c7880a7f9d tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Returning 404 to user: Instance 178abb32-365f-4ccd-828b-e69f6fe45370 could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:27:00.117480 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-2b1ce919-0727-46eb-997b-97c7880a7f9d tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/178abb32-365f-4ccd-828b-e69f6fe45370" status: 404 len: 111 microversion: 2.1 time: 0.063037 Jul 23 21:27:00.118533 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1729/3357] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:00 2022] GET /compute/v2.1/servers/178abb32-365f-4ccd-828b-e69f6fe45370 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:27:00.124580 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e795fd70-10de-4549-9138-f054419d0192 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:27:00.126361 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-e795fd70-10de-4549-9138-f054419d0192 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: 06a478c3-f038-4813-a456-daf3a58b5749] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:00.159234 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e795fd70-10de-4549-9138-f054419d0192 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:00.162097 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e795fd70-10de-4549-9138-f054419d0192 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:00.163175 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e795fd70-10de-4549-9138-f054419d0192 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:00.164580 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e795fd70-10de-4549-9138-f054419d0192 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:00.291437 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-e795fd70-10de-4549-9138-f054419d0192 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "PUT /compute/v2.1/servers/06a478c3-f038-4813-a456-daf3a58b5749" status: 200 len: 1080 microversion: 2.1 time: 0.171440 Jul 23 21:27:00.292655 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1730/3358] 10.222.0.17 () {60 vars in 1255 bytes} [Sat Jul 23 21:27:00 2022] PUT /compute/v2.1/servers/06a478c3-f038-4813-a456-daf3a58b5749 => generated 1080 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:00.307242 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-96cb32b8-465e-4c2d-a4a8-ae1fbf754b6b tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:00.308452 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-96cb32b8-465e-4c2d-a4a8-ae1fbf754b6b tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: 06a478c3-f038-4813-a456-daf3a58b5749] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:00.316994 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-96cb32b8-465e-4c2d-a4a8-ae1fbf754b6b tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:00.317596 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-96cb32b8-465e-4c2d-a4a8-ae1fbf754b6b tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:00.318955 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-96cb32b8-465e-4c2d-a4a8-ae1fbf754b6b tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:00.319568 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-96cb32b8-465e-4c2d-a4a8-ae1fbf754b6b tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:00.347551 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-0e57f1c8-ad28-4abe-9435-9a902512589a tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0543f1a561a9442cbc9463ab752bd2aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8d306759c447edb6d013cf14ac53f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:00.358578 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-0e57f1c8-ad28-4abe-9435-9a902512589a tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] 10.222.0.17 "GET /compute/v2.1/servers/14bdd0f5-f5bf-44bb-876f-2d257eae5fb0" status: 200 len: 1511 microversion: 2.1 time: 0.583201 Jul 23 21:27:00.359198 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1629/3359] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:26:59 2022] GET /compute/v2.1/servers/14bdd0f5-f5bf-44bb-876f-2d257eae5fb0 => generated 1511 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:00.369926 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8df0ada3-a317-498b-ba38-10299d94af50 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-415488415", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "networks": [{"uuid": "c89c9ae3-a9c7-4e98-860d-e9f8ea64bbcb"}]}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:27:00.427467 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-8df0ada3-a317-498b-ba38-10299d94af50 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] validate_networks() for [('c89c9ae3-a9c7-4e98-860d-e9f8ea64bbcb', None, None, None, None, None)] {{(pid=131320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:27:00.839712 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-96cb32b8-465e-4c2d-a4a8-ae1fbf754b6b tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:00.854569 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-96cb32b8-465e-4c2d-a4a8-ae1fbf754b6b tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/06a478c3-f038-4813-a456-daf3a58b5749" status: 200 len: 1506 microversion: 2.1 time: 0.552410 Jul 23 21:27:00.856832 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1731/3360] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:00 2022] GET /compute/v2.1/servers/06a478c3-f038-4813-a456-daf3a58b5749 => generated 1506 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:27:00.861627 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-9ad5e999-e99d-45ae-9ea1-2d8450ab2673 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:00.862272 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-9ad5e999-e99d-45ae-9ea1-2d8450ab2673 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:00.897834 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9ad5e999-e99d-45ae-9ea1-2d8450ab2673 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:00.898337 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9ad5e999-e99d-45ae-9ea1-2d8450ab2673 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:00.899129 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9ad5e999-e99d-45ae-9ea1-2d8450ab2673 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:00.899576 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9ad5e999-e99d-45ae-9ea1-2d8450ab2673 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:01.316982 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-9ad5e999-e99d-45ae-9ea1-2d8450ab2673 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:01.339285 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-9ad5e999-e99d-45ae-9ea1-2d8450ab2673 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:01.346467 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-9ad5e999-e99d-45ae-9ea1-2d8450ab2673 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:01.350618 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-9ad5e999-e99d-45ae-9ea1-2d8450ab2673 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.492701 Jul 23 21:27:01.397652 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1732/3361] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:27:00 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:27:01.406815 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-fe8a0601-e215-4139-ac16-bdf1fbbe9bd1 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:01.411487 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-fe8a0601-e215-4139-ac16-bdf1fbbe9bd1 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: 06a478c3-f038-4813-a456-daf3a58b5749] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:01.424931 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fe8a0601-e215-4139-ac16-bdf1fbbe9bd1 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:01.425754 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fe8a0601-e215-4139-ac16-bdf1fbbe9bd1 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:01.426761 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fe8a0601-e215-4139-ac16-bdf1fbbe9bd1 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:01.427836 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fe8a0601-e215-4139-ac16-bdf1fbbe9bd1 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:01.902151 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-8df0ada3-a317-498b-ba38-10299d94af50 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:27:01.902880 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-8df0ada3-a317-498b-ba38-10299d94af50 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:27:01.903541 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-8df0ada3-a317-498b-ba38-10299d94af50 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:27:01.904051 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-8df0ada3-a317-498b-ba38-10299d94af50 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:27:01.904510 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-8df0ada3-a317-498b-ba38-10299d94af50 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:27:01.921600 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8df0ada3-a317-498b-ba38-10299d94af50 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:01.922343 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8df0ada3-a317-498b-ba38-10299d94af50 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:01.935100 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8df0ada3-a317-498b-ba38-10299d94af50 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:01.935914 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8df0ada3-a317-498b-ba38-10299d94af50 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:01.983626 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-8df0ada3-a317-498b-ba38-10299d94af50 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Getting quotas for project a892bfe56afd4ee5bb6c47e926af7349. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:27:01.995620 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-8df0ada3-a317-498b-ba38-10299d94af50 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Getting quotas for user affc3572ef7d45249f50b5061a681d18 and project a892bfe56afd4ee5bb6c47e926af7349. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:27:02.092394 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8df0ada3-a317-498b-ba38-10299d94af50 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Going to run 1 instances... {{(pid=131320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:27:02.100142 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8df0ada3-a317-498b-ba38-10299d94af50 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: c4da9681-4d81-4ffb-8d7e-453436e71331] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:27:02.233395 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-fe8a0601-e215-4139-ac16-bdf1fbbe9bd1 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:02.255144 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8df0ada3-a317-498b-ba38-10299d94af50 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.886754 Jul 23 21:27:02.258767 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-fe8a0601-e215-4139-ac16-bdf1fbbe9bd1 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/06a478c3-f038-4813-a456-daf3a58b5749" status: 200 len: 1506 microversion: 2.1 time: 0.846841 Jul 23 21:27:02.261319 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1630/3362] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:27:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1901 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 23 21:27:02.276684 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-88ca2dfd-9cf4-43ba-a899-c306a1d0f09e req-91865807-ac67-44db-bd5a-10852ada4aff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "163182e4-bfa7-4da7-9267-9cbb8a911183", "name": "network-vif-deleted", "tag": "311f22f9-8e33-46f2-9fc9-62d52b59f0d8"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:27:02.277700 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1733/3363] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:01 2022] GET /compute/v2.1/servers/06a478c3-f038-4813-a456-daf3a58b5749 => generated 1506 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:02.288630 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-eb5fb841-1670-4512-8065-f9932206b367 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:02.289251 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-eb5fb841-1670-4512-8065-f9932206b367 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] [instance: 14bdd0f5-f5bf-44bb-876f-2d257eae5fb0] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:02.290494 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-88ca2dfd-9cf4-43ba-a899-c306a1d0f09e req-91865807-ac67-44db-bd5a-10852ada4aff service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:02.291277 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-88ca2dfd-9cf4-43ba-a899-c306a1d0f09e req-91865807-ac67-44db-bd5a-10852ada4aff service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:02.295681 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-eb5fb841-1670-4512-8065-f9932206b367 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:02.296415 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-eb5fb841-1670-4512-8065-f9932206b367 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:02.297315 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-eb5fb841-1670-4512-8065-f9932206b367 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:02.305633 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-88ca2dfd-9cf4-43ba-a899-c306a1d0f09e req-91865807-ac67-44db-bd5a-10852ada4aff service nova] Creating event network-vif-deleted:311f22f9-8e33-46f2-9fc9-62d52b59f0d8 for instance 163182e4-bfa7-4da7-9267-9cbb8a911183 on nch1-master-1 Jul 23 21:27:02.309488 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-eb5fb841-1670-4512-8065-f9932206b367 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:02.311374 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-88ca2dfd-9cf4-43ba-a899-c306a1d0f09e req-91865807-ac67-44db-bd5a-10852ada4aff service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048751 Jul 23 21:27:02.312351 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1631/3364] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:27:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:27:02.319482 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e04725cc-1172-4ae8-8847-e4838630480d tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:02.320586 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e04725cc-1172-4ae8-8847-e4838630480d tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: c4da9681-4d81-4ffb-8d7e-453436e71331] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:02.334134 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-eb5fb841-1670-4512-8065-f9932206b367 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] HTTP exception thrown: Instance 14bdd0f5-f5bf-44bb-876f-2d257eae5fb0 could not be found. Jul 23 21:27:02.338724 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-eb5fb841-1670-4512-8065-f9932206b367 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Request method failure captured: Jul 23 21:27:02.338724 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/servers/14bdd0f5-f5bf-44bb-876f-2d257eae5fb0 HTTP/1.1 Jul 23 21:27:02.338724 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:27:02.338724 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:27:02.338724 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:27:02.338724 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:27:02.338724 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:27:02.338724 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:27:02.338724 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:27:02.338724 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:27:02.338724 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GdwanSLUxvvVO__jP63nlQk5y7_LiiZCvRyvrvMUaohoAlPUWML06JRKUEJmNFjEnIE8j9pcI2q_cyM8U9M8cXDYAU8PYBX1LYnfrigW-3LuDhQ-X5UsY5zifSEfX0ysYs4XvoTtaMyeM854C_ZdbFCEWv6iDw-yK-8PN1LRoYKjdg Jul 23 21:27:02.338724 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:27:02.338724 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:27:02.338724 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:27:02.338724 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:27:02.338724 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:27:02.338724 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:27:02.338724 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 4d8d306759c447edb6d013cf14ac53f9 Jul 23 21:27:02.338724 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-MultipleCreateTestJSON-576006092 Jul 23 21:27:02.338724 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:27:02.338724 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:27:02.338724 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4d8d306759c447edb6d013cf14ac53f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4d8d306759c447edb6d013cf14ac53f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4d8d306759c447edb6d013cf14ac53f9", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4d8d306759c447edb6d013cf14ac53f9"}]}] Jul 23 21:27:02.338724 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-MultipleCreateTestJSON-576006092 Jul 23 21:27:02.338724 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 4d8d306759c447edb6d013cf14ac53f9 Jul 23 21:27:02.338724 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-MultipleCreateTestJSON-576006092 Jul 23 21:27:02.338724 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-MultipleCreateTestJSON-576006092-project Jul 23 21:27:02.338724 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:27:02.338724 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:27:02.338724 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 0543f1a561a9442cbc9463ab752bd2aa Jul 23 21:27:02.338724 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-MultipleCreateTestJSON-576006092-project Jul 23 21:27:02.338724 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:27:02.338724 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance 14bdd0f5-f5bf-44bb-876f-2d257eae5fb0 could not be found. Jul 23 21:27:02.338724 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': '14bdd0f5-f5bf-44bb-876f-2d257eae5fb0'} Jul 23 21:27:02.338724 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:27:02.338724 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:27:02.338724 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:27:02.338724 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:27:02.338724 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:27:02.338724 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:27:02.338724 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:27:02.338724 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:27:02.338724 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:27:02.338724 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:27:02.338724 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14bdd0f5-f5bf-44bb-876f-2d257eae5fb0 could not be found. Jul 23 21:27:02.338724 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:27:02.338724 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:27:02.338724 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:27:02.338724 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:27:02.338724 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:27:02.338724 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:27:02.338724 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:27:02.338724 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:27:02.338724 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:27:02.338724 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:27:02.338724 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:27:02.338724 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:27:02.338724 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:27:02.338724 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:27:02.338724 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:27:02.338724 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:27:02.338724 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14bdd0f5-f5bf-44bb-876f-2d257eae5fb0 could not be found. Jul 23 21:27:02.338724 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:27:02.338724 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:27:02.338724 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:27:02.344330 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:27:02.344330 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:27:02.344330 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:27:02.344330 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:27:02.344330 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:27:02.344330 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14bdd0f5-f5bf-44bb-876f-2d257eae5fb0 could not be found. Jul 23 21:27:02.344330 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:27:02.344330 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-eb5fb841-1670-4512-8065-f9932206b367 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Returning 404 to user: Instance 14bdd0f5-f5bf-44bb-876f-2d257eae5fb0 could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:27:02.344330 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-eb5fb841-1670-4512-8065-f9932206b367 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] 10.222.0.17 "GET /compute/v2.1/servers/14bdd0f5-f5bf-44bb-876f-2d257eae5fb0" status: 404 len: 111 microversion: 2.1 time: 0.061472 Jul 23 21:27:02.345377 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1734/3365] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:02 2022] GET /compute/v2.1/servers/14bdd0f5-f5bf-44bb-876f-2d257eae5fb0 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:27:02.350392 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-0f7b351d-d9a6-465a-adf0-f3c83f664f98 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:27:02.351931 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-0f7b351d-d9a6-465a-adf0-f3c83f664f98 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: 06a478c3-f038-4813-a456-daf3a58b5749] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:02.360267 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0f7b351d-d9a6-465a-adf0-f3c83f664f98 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:02.361075 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0f7b351d-d9a6-465a-adf0-f3c83f664f98 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:02.362086 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0f7b351d-d9a6-465a-adf0-f3c83f664f98 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:02.362686 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0f7b351d-d9a6-465a-adf0-f3c83f664f98 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:02.515855 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-0f7b351d-d9a6-465a-adf0-f3c83f664f98 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Flavor limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:27:02.516581 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-0f7b351d-d9a6-465a-adf0-f3c83f664f98 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Image limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:27:02.517219 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-0f7b351d-d9a6-465a-adf0-f3c83f664f98 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Flavor pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:27:02.517788 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-0f7b351d-d9a6-465a-adf0-f3c83f664f98 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Image pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:27:02.518936 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-0f7b351d-d9a6-465a-adf0-f3c83f664f98 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:27:02.581911 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e04725cc-1172-4ae8-8847-e4838630480d tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:02.598310 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e04725cc-1172-4ae8-8847-e4838630480d tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331" status: 200 len: 1214 microversion: 2.1 time: 0.284527 Jul 23 21:27:02.604448 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1632/3366] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:02 2022] GET /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331 => generated 1214 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:02.614513 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a487aeef-3216-42b1-89d3-f4982d8b6fb1 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:02.621592 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-0f7b351d-d9a6-465a-adf0-f3c83f664f98 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: 06a478c3-f038-4813-a456-daf3a58b5749] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:02.635294 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a487aeef-3216-42b1-89d3-f4982d8b6fb1 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] [instance: 163182e4-bfa7-4da7-9267-9cbb8a911183] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:02.638807 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0f7b351d-d9a6-465a-adf0-f3c83f664f98 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:02.639264 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0f7b351d-d9a6-465a-adf0-f3c83f664f98 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:02.640740 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0f7b351d-d9a6-465a-adf0-f3c83f664f98 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:02.641322 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0f7b351d-d9a6-465a-adf0-f3c83f664f98 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:02.688567 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a487aeef-3216-42b1-89d3-f4982d8b6fb1 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:02.697982 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a487aeef-3216-42b1-89d3-f4982d8b6fb1 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:02.708758 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a487aeef-3216-42b1-89d3-f4982d8b6fb1 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:02.712872 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a487aeef-3216-42b1-89d3-f4982d8b6fb1 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:02.720789 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-0f7b351d-d9a6-465a-adf0-f3c83f664f98 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "POST /compute/v2.1/servers/06a478c3-f038-4813-a456-daf3a58b5749/action" status: 202 len: 1112 microversion: 2.1 time: 0.374494 Jul 23 21:27:02.721902 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1735/3367] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:27:02 2022] POST /compute/v2.1/servers/06a478c3-f038-4813-a456-daf3a58b5749/action => generated 1112 bytes in 376 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 23 21:27:02.727292 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-1eb42d40-10fd-44e6-957e-e5409ca09fb3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:02.728223 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-1eb42d40-10fd-44e6-957e-e5409ca09fb3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:02.736263 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1eb42d40-10fd-44e6-957e-e5409ca09fb3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:02.736713 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1eb42d40-10fd-44e6-957e-e5409ca09fb3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:02.737722 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1eb42d40-10fd-44e6-957e-e5409ca09fb3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:02.738194 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1eb42d40-10fd-44e6-957e-e5409ca09fb3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:02.765012 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-a487aeef-3216-42b1-89d3-f4982d8b6fb1 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] HTTP exception thrown: Instance 163182e4-bfa7-4da7-9267-9cbb8a911183 could not be found. Jul 23 21:27:02.767339 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a487aeef-3216-42b1-89d3-f4982d8b6fb1 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Request method failure captured: Jul 23 21:27:02.767339 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/163182e4-bfa7-4da7-9267-9cbb8a911183 HTTP/1.1 Jul 23 21:27:02.767339 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:27:02.767339 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:27:02.767339 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:27:02.767339 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:27:02.767339 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:27:02.767339 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:27:02.767339 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:27:02.767339 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:27:02.767339 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GdwanSLUxvvVO__jP63nlQk5y7_LiiZCvRyvrvMUaohoAlPUWML06JRKUEJmNFjEnIE8j9pcI2q_cyM8U9M8cXDYAU8PYBX1LYnfrigW-3LuDhQ-X5UsY5zifSEfX0ysYs4XvoTtaMyeM854C_ZdbFCEWv6iDw-yK-8PN1LRoYKjdg Jul 23 21:27:02.767339 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:27:02.767339 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:27:02.767339 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:27:02.767339 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:27:02.767339 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:27:02.767339 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:27:02.767339 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 4d8d306759c447edb6d013cf14ac53f9 Jul 23 21:27:02.767339 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-MultipleCreateTestJSON-576006092 Jul 23 21:27:02.767339 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:27:02.767339 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:27:02.767339 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4d8d306759c447edb6d013cf14ac53f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4d8d306759c447edb6d013cf14ac53f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4d8d306759c447edb6d013cf14ac53f9", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4d8d306759c447edb6d013cf14ac53f9"}]}] Jul 23 21:27:02.767339 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-MultipleCreateTestJSON-576006092 Jul 23 21:27:02.767339 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 4d8d306759c447edb6d013cf14ac53f9 Jul 23 21:27:02.767339 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-MultipleCreateTestJSON-576006092 Jul 23 21:27:02.767339 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-MultipleCreateTestJSON-576006092-project Jul 23 21:27:02.767339 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:27:02.767339 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:27:02.767339 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 0543f1a561a9442cbc9463ab752bd2aa Jul 23 21:27:02.767339 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-MultipleCreateTestJSON-576006092-project Jul 23 21:27:02.767339 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:27:02.767339 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance 163182e4-bfa7-4da7-9267-9cbb8a911183 could not be found. Jul 23 21:27:02.767339 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '163182e4-bfa7-4da7-9267-9cbb8a911183'} Jul 23 21:27:02.767339 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:27:02.767339 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:27:02.767339 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:27:02.767339 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:27:02.767339 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:27:02.767339 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:27:02.767339 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:27:02.767339 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:27:02.767339 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:27:02.767339 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:27:02.767339 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 163182e4-bfa7-4da7-9267-9cbb8a911183 could not be found. Jul 23 21:27:02.767339 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:27:02.767339 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:27:02.767339 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:27:02.767339 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:27:02.767339 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:27:02.767339 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:27:02.767339 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:27:02.767339 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:27:02.767339 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:27:02.767339 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:27:02.767339 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:27:02.767339 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:27:02.767339 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:27:02.767339 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:27:02.767339 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:27:02.767339 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:27:02.767339 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 163182e4-bfa7-4da7-9267-9cbb8a911183 could not be found. Jul 23 21:27:02.767339 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:27:02.767339 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:27:02.767339 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:27:02.772662 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:27:02.772662 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:27:02.772662 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:27:02.772662 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:27:02.772662 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:27:02.772662 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 163182e4-bfa7-4da7-9267-9cbb8a911183 could not be found. Jul 23 21:27:02.772662 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:27:02.773262 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:02.774447 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a487aeef-3216-42b1-89d3-f4982d8b6fb1 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] Returning 404 to user: Instance 163182e4-bfa7-4da7-9267-9cbb8a911183 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:27:02.783655 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a487aeef-3216-42b1-89d3-f4982d8b6fb1 tempest-MultipleCreateTestJSON-576006092 tempest-MultipleCreateTestJSON-576006092-project] 10.222.0.17 "GET /compute/v2.1/servers/163182e4-bfa7-4da7-9267-9cbb8a911183" status: 404 len: 111 microversion: 2.1 time: 0.170153 Jul 23 21:27:02.784748 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1633/3368] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:02 2022] GET /compute/v2.1/servers/163182e4-bfa7-4da7-9267-9cbb8a911183 => generated 111 bytes in 180 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:27:02.805305 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2e5ddc9d-331b-4080-893e-843a845f0a68 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:02.806322 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-2e5ddc9d-331b-4080-893e-843a845f0a68 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: 06a478c3-f038-4813-a456-daf3a58b5749] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:02.866656 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2e5ddc9d-331b-4080-893e-843a845f0a68 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:02.867522 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2e5ddc9d-331b-4080-893e-843a845f0a68 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:02.876073 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2e5ddc9d-331b-4080-893e-843a845f0a68 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:02.878605 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2e5ddc9d-331b-4080-893e-843a845f0a68 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:03.209445 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-1eb42d40-10fd-44e6-957e-e5409ca09fb3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:03.219552 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-1eb42d40-10fd-44e6-957e-e5409ca09fb3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:03.227135 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-1eb42d40-10fd-44e6-957e-e5409ca09fb3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:03.232666 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-1eb42d40-10fd-44e6-957e-e5409ca09fb3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.506204 Jul 23 21:27:03.233945 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1736/3369] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:27:02 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:27:03.621071 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-fe181bfc-61b5-47c3-b3e8-a2b940d1f25a tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:03.622391 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-fe181bfc-61b5-47c3-b3e8-a2b940d1f25a tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: c4da9681-4d81-4ffb-8d7e-453436e71331] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:03.628880 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fe181bfc-61b5-47c3-b3e8-a2b940d1f25a tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:03.629639 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fe181bfc-61b5-47c3-b3e8-a2b940d1f25a tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:03.630715 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fe181bfc-61b5-47c3-b3e8-a2b940d1f25a tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:03.631326 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fe181bfc-61b5-47c3-b3e8-a2b940d1f25a tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:03.661128 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-2e5ddc9d-331b-4080-893e-843a845f0a68 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:03.671055 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2e5ddc9d-331b-4080-893e-843a845f0a68 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/06a478c3-f038-4813-a456-daf3a58b5749" status: 200 len: 1517 microversion: 2.1 time: 0.877772 Jul 23 21:27:03.671844 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1634/3370] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:02 2022] GET /compute/v2.1/servers/06a478c3-f038-4813-a456-daf3a58b5749 => generated 1517 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:03.741942 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-fe181bfc-61b5-47c3-b3e8-a2b940d1f25a tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:03.754284 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-fe181bfc-61b5-47c3-b3e8-a2b940d1f25a tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331" status: 200 len: 1266 microversion: 2.1 time: 0.134894 Jul 23 21:27:03.754911 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1737/3371] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:03 2022] GET /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331 => generated 1266 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:27:04.252744 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d2e4288e-3f9f-4be7-8504-337ce1a0b6fe tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:04.253368 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d2e4288e-3f9f-4be7-8504-337ce1a0b6fe tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:04.262958 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d2e4288e-3f9f-4be7-8504-337ce1a0b6fe tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:04.263420 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d2e4288e-3f9f-4be7-8504-337ce1a0b6fe tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:04.268594 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d2e4288e-3f9f-4be7-8504-337ce1a0b6fe tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:04.270014 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d2e4288e-3f9f-4be7-8504-337ce1a0b6fe tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:04.358597 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-0f390c68-0e32-4194-9b27-9c54ce4bbc97 req-fe218a50-7eb9-4aa3-bdca-1e92a5dc87cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14bdd0f5-f5bf-44bb-876f-2d257eae5fb0", "name": "network-vif-deleted", "tag": "638f9b69-f16f-4d87-ad86-1c12e3530bb8"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:27:04.371589 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-0f390c68-0e32-4194-9b27-9c54ce4bbc97 req-fe218a50-7eb9-4aa3-bdca-1e92a5dc87cc service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:04.378087 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-0f390c68-0e32-4194-9b27-9c54ce4bbc97 req-fe218a50-7eb9-4aa3-bdca-1e92a5dc87cc service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:04.398855 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-0f390c68-0e32-4194-9b27-9c54ce4bbc97 req-fe218a50-7eb9-4aa3-bdca-1e92a5dc87cc service nova] Creating event network-vif-deleted:638f9b69-f16f-4d87-ad86-1c12e3530bb8 for instance 14bdd0f5-f5bf-44bb-876f-2d257eae5fb0 on nch1-master-1 Jul 23 21:27:04.412523 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-0f390c68-0e32-4194-9b27-9c54ce4bbc97 req-fe218a50-7eb9-4aa3-bdca-1e92a5dc87cc service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051656 Jul 23 21:27:04.413668 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1738/3372] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:27:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:27:04.425360 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d2e4288e-3f9f-4be7-8504-337ce1a0b6fe tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:04.439509 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d2e4288e-3f9f-4be7-8504-337ce1a0b6fe tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:04.446427 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d2e4288e-3f9f-4be7-8504-337ce1a0b6fe tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:04.447691 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d2e4288e-3f9f-4be7-8504-337ce1a0b6fe tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.198993 Jul 23 21:27:04.450921 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1635/3373] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:27:04 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:27:04.692474 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-62b9ed86-e6f9-473d-bf64-3ab0b4cc599d tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:04.694234 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-62b9ed86-e6f9-473d-bf64-3ab0b4cc599d tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: 06a478c3-f038-4813-a456-daf3a58b5749] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:04.707248 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-62b9ed86-e6f9-473d-bf64-3ab0b4cc599d tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:04.707980 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-62b9ed86-e6f9-473d-bf64-3ab0b4cc599d tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:04.709612 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-62b9ed86-e6f9-473d-bf64-3ab0b4cc599d tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:04.710288 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-62b9ed86-e6f9-473d-bf64-3ab0b4cc599d tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:04.771299 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-04968eb0-3644-4a54-9a4d-afe478c9fe1e tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:04.772782 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-04968eb0-3644-4a54-9a4d-afe478c9fe1e tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: c4da9681-4d81-4ffb-8d7e-453436e71331] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:04.779296 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-04968eb0-3644-4a54-9a4d-afe478c9fe1e tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:04.780139 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-04968eb0-3644-4a54-9a4d-afe478c9fe1e tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:04.781636 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-04968eb0-3644-4a54-9a4d-afe478c9fe1e tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:04.790517 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-04968eb0-3644-4a54-9a4d-afe478c9fe1e tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:04.908728 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-62b9ed86-e6f9-473d-bf64-3ab0b4cc599d tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:04.924851 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-62b9ed86-e6f9-473d-bf64-3ab0b4cc599d tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/06a478c3-f038-4813-a456-daf3a58b5749" status: 200 len: 1517 microversion: 2.1 time: 0.239272 Jul 23 21:27:04.925971 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1739/3374] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:04 2022] GET /compute/v2.1/servers/06a478c3-f038-4813-a456-daf3a58b5749 => generated 1517 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:05.469018 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-349a4754-d2fb-4cb4-9f1a-c20695054e65 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:05.469666 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-349a4754-d2fb-4cb4-9f1a-c20695054e65 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:05.481359 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-349a4754-d2fb-4cb4-9f1a-c20695054e65 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:05.482270 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-349a4754-d2fb-4cb4-9f1a-c20695054e65 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:05.483484 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-349a4754-d2fb-4cb4-9f1a-c20695054e65 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:05.484125 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-349a4754-d2fb-4cb4-9f1a-c20695054e65 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:05.598187 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-349a4754-d2fb-4cb4-9f1a-c20695054e65 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:05.625384 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-349a4754-d2fb-4cb4-9f1a-c20695054e65 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:05.627108 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-349a4754-d2fb-4cb4-9f1a-c20695054e65 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:05.628340 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-349a4754-d2fb-4cb4-9f1a-c20695054e65 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.163374 Jul 23 21:27:05.631724 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1740/3375] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:27:05 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:27:05.742478 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-04968eb0-3644-4a54-9a4d-afe478c9fe1e tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:05.765168 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-04968eb0-3644-4a54-9a4d-afe478c9fe1e tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331" status: 200 len: 1314 microversion: 2.1 time: 0.989707 Jul 23 21:27:05.767185 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1636/3376] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:04 2022] GET /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331 => generated 1314 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:05.949036 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-0987cd66-1a64-4119-ad5a-7283038e6f07 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:05.951833 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-0987cd66-1a64-4119-ad5a-7283038e6f07 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: 06a478c3-f038-4813-a456-daf3a58b5749] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:05.972725 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0987cd66-1a64-4119-ad5a-7283038e6f07 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:05.974562 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0987cd66-1a64-4119-ad5a-7283038e6f07 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:05.976114 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0987cd66-1a64-4119-ad5a-7283038e6f07 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:05.978287 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0987cd66-1a64-4119-ad5a-7283038e6f07 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:06.521446 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-1fd6b247-df33-4524-a760-30edd58de2b4 req-958f13c7-abfa-41bf-a202-a94f63fdef29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4da9681-4d81-4ffb-8d7e-453436e71331", "tag": "f60d970a-170d-47a9-b1da-1f92400f8025"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:27:06.541267 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-1fd6b247-df33-4524-a760-30edd58de2b4 req-958f13c7-abfa-41bf-a202-a94f63fdef29 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:06.542232 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-1fd6b247-df33-4524-a760-30edd58de2b4 req-958f13c7-abfa-41bf-a202-a94f63fdef29 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:06.556427 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-1fd6b247-df33-4524-a760-30edd58de2b4 req-958f13c7-abfa-41bf-a202-a94f63fdef29 service nova] Creating event network-changed:f60d970a-170d-47a9-b1da-1f92400f8025 for instance c4da9681-4d81-4ffb-8d7e-453436e71331 on nch1-master-1 Jul 23 21:27:06.569765 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-1fd6b247-df33-4524-a760-30edd58de2b4 req-958f13c7-abfa-41bf-a202-a94f63fdef29 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051885 Jul 23 21:27:06.576616 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1637/3377] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:27:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:27:06.651432 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-813c59ca-9257-48ab-a8ad-3f9dfc48ad41 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:06.652446 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-813c59ca-9257-48ab-a8ad-3f9dfc48ad41 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:06.661661 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-813c59ca-9257-48ab-a8ad-3f9dfc48ad41 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:06.665108 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-813c59ca-9257-48ab-a8ad-3f9dfc48ad41 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:06.667837 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-813c59ca-9257-48ab-a8ad-3f9dfc48ad41 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:06.668510 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-813c59ca-9257-48ab-a8ad-3f9dfc48ad41 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:06.669512 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-0987cd66-1a64-4119-ad5a-7283038e6f07 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:06.687985 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-0987cd66-1a64-4119-ad5a-7283038e6f07 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/06a478c3-f038-4813-a456-daf3a58b5749" status: 200 len: 1517 microversion: 2.1 time: 0.748881 Jul 23 21:27:06.689299 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1741/3378] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:05 2022] GET /compute/v2.1/servers/06a478c3-f038-4813-a456-daf3a58b5749 => generated 1517 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:06.788551 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f9ede1b3-4ce7-4f32-8a45-f60cfe052b95 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:06.789234 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-f9ede1b3-4ce7-4f32-8a45-f60cfe052b95 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: c4da9681-4d81-4ffb-8d7e-453436e71331] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:06.797133 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-813c59ca-9257-48ab-a8ad-3f9dfc48ad41 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:06.813214 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-813c59ca-9257-48ab-a8ad-3f9dfc48ad41 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:06.819949 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-813c59ca-9257-48ab-a8ad-3f9dfc48ad41 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:06.823108 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-813c59ca-9257-48ab-a8ad-3f9dfc48ad41 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.176198 Jul 23 21:27:06.824827 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f9ede1b3-4ce7-4f32-8a45-f60cfe052b95 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:06.827399 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1638/3379] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:27:06 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:27:06.828305 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f9ede1b3-4ce7-4f32-8a45-f60cfe052b95 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:06.832001 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f9ede1b3-4ce7-4f32-8a45-f60cfe052b95 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:06.837762 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f9ede1b3-4ce7-4f32-8a45-f60cfe052b95 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:07.670217 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-f9ede1b3-4ce7-4f32-8a45-f60cfe052b95 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:07.679843 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-f9ede1b3-4ce7-4f32-8a45-f60cfe052b95 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331" status: 200 len: 1314 microversion: 2.1 time: 0.899769 Jul 23 21:27:07.687677 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1742/3380] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:06 2022] GET /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331 => generated 1314 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:27:07.707673 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-676e1949-b843-4f75-9ccf-d30714a665df tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:07.708958 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-676e1949-b843-4f75-9ccf-d30714a665df tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: 06a478c3-f038-4813-a456-daf3a58b5749] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:07.720311 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-676e1949-b843-4f75-9ccf-d30714a665df tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:07.721153 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-676e1949-b843-4f75-9ccf-d30714a665df tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:07.722237 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-676e1949-b843-4f75-9ccf-d30714a665df tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:07.722946 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-676e1949-b843-4f75-9ccf-d30714a665df tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:07.847269 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-52d57d57-0c58-48db-9de8-e320854fc89d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:07.848585 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-52d57d57-0c58-48db-9de8-e320854fc89d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:07.862656 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-52d57d57-0c58-48db-9de8-e320854fc89d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:07.863470 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-52d57d57-0c58-48db-9de8-e320854fc89d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:07.868168 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-52d57d57-0c58-48db-9de8-e320854fc89d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:07.869693 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-52d57d57-0c58-48db-9de8-e320854fc89d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:08.052866 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-676e1949-b843-4f75-9ccf-d30714a665df tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:08.061378 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-676e1949-b843-4f75-9ccf-d30714a665df tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/06a478c3-f038-4813-a456-daf3a58b5749" status: 200 len: 1517 microversion: 2.1 time: 0.358782 Jul 23 21:27:08.064332 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1639/3381] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:07 2022] GET /compute/v2.1/servers/06a478c3-f038-4813-a456-daf3a58b5749 => generated 1517 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:08.136729 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-52d57d57-0c58-48db-9de8-e320854fc89d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:08.161172 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-52d57d57-0c58-48db-9de8-e320854fc89d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:08.163830 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-52d57d57-0c58-48db-9de8-e320854fc89d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:08.175346 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-52d57d57-0c58-48db-9de8-e320854fc89d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.333071 Jul 23 21:27:08.178090 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1743/3382] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:27:07 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:27:08.705180 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ac3ca21c-b4e7-462b-b552-de03b267f51d tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:08.706441 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ac3ca21c-b4e7-462b-b552-de03b267f51d tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: c4da9681-4d81-4ffb-8d7e-453436e71331] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:08.726712 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ac3ca21c-b4e7-462b-b552-de03b267f51d tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:08.727497 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ac3ca21c-b4e7-462b-b552-de03b267f51d tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:08.728083 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ac3ca21c-b4e7-462b-b552-de03b267f51d tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:08.728603 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ac3ca21c-b4e7-462b-b552-de03b267f51d tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:09.393049 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ac3ca21c-b4e7-462b-b552-de03b267f51d tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:09.408174 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ac3ca21c-b4e7-462b-b552-de03b267f51d tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331" status: 200 len: 1314 microversion: 2.1 time: 0.708033 Jul 23 21:27:09.421582 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1640/3383] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:08 2022] GET /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331 => generated 1314 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:09.429180 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a9cefc38-43bc-4b79-900e-aa1d58b5b047 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:09.439110 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a9cefc38-43bc-4b79-900e-aa1d58b5b047 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: 06a478c3-f038-4813-a456-daf3a58b5749] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:09.447322 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-8a60f929-347b-4ca2-8a10-431710b23ad1 tempest-AZV2TestJSON-1335903244 tempest-AZV2TestJSON-1335903244-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:09.449322 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a9cefc38-43bc-4b79-900e-aa1d58b5b047 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:09.450408 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8a60f929-347b-4ca2-8a10-431710b23ad1 tempest-AZV2TestJSON-1335903244 tempest-AZV2TestJSON-1335903244-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:09.451611 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8a60f929-347b-4ca2-8a10-431710b23ad1 tempest-AZV2TestJSON-1335903244 tempest-AZV2TestJSON-1335903244-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:09.452661 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8a60f929-347b-4ca2-8a10-431710b23ad1 tempest-AZV2TestJSON-1335903244 tempest-AZV2TestJSON-1335903244-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:09.453351 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8a60f929-347b-4ca2-8a10-431710b23ad1 tempest-AZV2TestJSON-1335903244 tempest-AZV2TestJSON-1335903244-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:09.458101 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a9cefc38-43bc-4b79-900e-aa1d58b5b047 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:09.459022 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a9cefc38-43bc-4b79-900e-aa1d58b5b047 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:09.459480 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a9cefc38-43bc-4b79-900e-aa1d58b5b047 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:09.524682 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-8a60f929-347b-4ca2-8a10-431710b23ad1 tempest-AZV2TestJSON-1335903244 tempest-AZV2TestJSON-1335903244-project] 10.222.0.17 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.636612 Jul 23 21:27:09.525631 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1744/3384] 10.222.0.17 () {58 vars in 1163 bytes} [Sat Jul 23 21:27:08 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 23 21:27:09.530371 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-90bc9194-c833-4fab-a0ae-d5e8882ec7a1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:09.530992 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-90bc9194-c833-4fab-a0ae-d5e8882ec7a1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:09.542490 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-90bc9194-c833-4fab-a0ae-d5e8882ec7a1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:09.543218 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-90bc9194-c833-4fab-a0ae-d5e8882ec7a1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:09.544211 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-90bc9194-c833-4fab-a0ae-d5e8882ec7a1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:09.544818 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-90bc9194-c833-4fab-a0ae-d5e8882ec7a1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:09.747109 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-90bc9194-c833-4fab-a0ae-d5e8882ec7a1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:09.763111 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-90bc9194-c833-4fab-a0ae-d5e8882ec7a1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:09.773185 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-90bc9194-c833-4fab-a0ae-d5e8882ec7a1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:09.777102 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-90bc9194-c833-4fab-a0ae-d5e8882ec7a1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.250385 Jul 23 21:27:09.780215 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1745/3385] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:27:09 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:27:10.446569 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a9cefc38-43bc-4b79-900e-aa1d58b5b047 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:10.452817 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-df31d875-82d6-4493-a58d-1b950a3220ad tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:10.454090 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-df31d875-82d6-4493-a58d-1b950a3220ad tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: c4da9681-4d81-4ffb-8d7e-453436e71331] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:10.455368 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a9cefc38-43bc-4b79-900e-aa1d58b5b047 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/06a478c3-f038-4813-a456-daf3a58b5749" status: 200 len: 1517 microversion: 2.1 time: 1.032304 Jul 23 21:27:10.456736 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1641/3386] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:09 2022] GET /compute/v2.1/servers/06a478c3-f038-4813-a456-daf3a58b5749 => generated 1517 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:10.477804 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-df31d875-82d6-4493-a58d-1b950a3220ad tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:10.478282 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-df31d875-82d6-4493-a58d-1b950a3220ad tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:10.481461 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-df31d875-82d6-4493-a58d-1b950a3220ad tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:10.483429 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-df31d875-82d6-4493-a58d-1b950a3220ad tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:10.624876 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a9cefc38-43bc-4b79-900e-aa1d58b5b047 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:10.625856 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a9cefc38-43bc-4b79-900e-aa1d58b5b047 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001369 Jul 23 21:27:10.626234 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1642/3387] 10.222.0.17 () {56 vars in 885 bytes} [Sat Jul 23 21:27:10 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 23 21:27:10.803306 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-29d7c65b-878a-41c0-97c4-e8596bbd8f62 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:10.804797 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-29d7c65b-878a-41c0-97c4-e8596bbd8f62 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:10.839996 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-29d7c65b-878a-41c0-97c4-e8596bbd8f62 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:10.840448 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-29d7c65b-878a-41c0-97c4-e8596bbd8f62 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:10.844525 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-29d7c65b-878a-41c0-97c4-e8596bbd8f62 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:10.845172 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-29d7c65b-878a-41c0-97c4-e8596bbd8f62 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:10.958634 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-df31d875-82d6-4493-a58d-1b950a3220ad tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:10.965113 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-df31d875-82d6-4493-a58d-1b950a3220ad tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331" status: 200 len: 1314 microversion: 2.1 time: 0.528155 Jul 23 21:27:10.965950 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1746/3388] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:10 2022] GET /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331 => generated 1314 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:10.986945 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-29d7c65b-878a-41c0-97c4-e8596bbd8f62 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:11.012037 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-29d7c65b-878a-41c0-97c4-e8596bbd8f62 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:11.014039 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-29d7c65b-878a-41c0-97c4-e8596bbd8f62 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:11.016505 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-29d7c65b-878a-41c0-97c4-e8596bbd8f62 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.221191 Jul 23 21:27:11.027918 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1643/3389] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:27:10 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:27:11.475073 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-39e93910-40f5-4dd6-8bdb-649dcff825b4 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:11.476413 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-39e93910-40f5-4dd6-8bdb-649dcff825b4 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: 06a478c3-f038-4813-a456-daf3a58b5749] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:11.484563 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-39e93910-40f5-4dd6-8bdb-649dcff825b4 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:11.485389 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-39e93910-40f5-4dd6-8bdb-649dcff825b4 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:11.486560 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-39e93910-40f5-4dd6-8bdb-649dcff825b4 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:11.487366 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-39e93910-40f5-4dd6-8bdb-649dcff825b4 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:11.782034 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-39e93910-40f5-4dd6-8bdb-649dcff825b4 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:11.794970 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-39e93910-40f5-4dd6-8bdb-649dcff825b4 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/06a478c3-f038-4813-a456-daf3a58b5749" status: 200 len: 1517 microversion: 2.1 time: 0.323493 Jul 23 21:27:11.797413 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1747/3390] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:11 2022] GET /compute/v2.1/servers/06a478c3-f038-4813-a456-daf3a58b5749 => generated 1517 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:11.990640 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-baf7cda0-f9b5-4875-9876-0100af71da5f tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:11.993376 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-baf7cda0-f9b5-4875-9876-0100af71da5f tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: c4da9681-4d81-4ffb-8d7e-453436e71331] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:12.001391 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:12.015889 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-baf7cda0-f9b5-4875-9876-0100af71da5f tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:12.016346 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-baf7cda0-f9b5-4875-9876-0100af71da5f tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:12.017132 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-baf7cda0-f9b5-4875-9876-0100af71da5f tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:12.017573 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-baf7cda0-f9b5-4875-9876-0100af71da5f tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:12.036139 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-2a445d2c-131c-4cdd-ace9-8a1b9d6caf6e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:12.037037 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-2a445d2c-131c-4cdd-ace9-8a1b9d6caf6e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:12.047187 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2a445d2c-131c-4cdd-ace9-8a1b9d6caf6e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:12.047901 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2a445d2c-131c-4cdd-ace9-8a1b9d6caf6e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:12.048834 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2a445d2c-131c-4cdd-ace9-8a1b9d6caf6e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:12.055041 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2a445d2c-131c-4cdd-ace9-8a1b9d6caf6e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:12.319752 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-baf7cda0-f9b5-4875-9876-0100af71da5f tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:12.334623 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-baf7cda0-f9b5-4875-9876-0100af71da5f tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331" status: 200 len: 1314 microversion: 2.1 time: 0.350015 Jul 23 21:27:12.336192 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1644/3391] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:11 2022] GET /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331 => generated 1314 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:12.342661 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-9fc516ca-3d15-48da-a70f-d7b0f81cf80a req-ea4a0cb7-77a6-4bd3-a411-6f699893db18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4da9681-4d81-4ffb-8d7e-453436e71331", "name": "network-vif-plugged", "status": "completed", "tag": "f60d970a-170d-47a9-b1da-1f92400f8025"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:27:12.368751 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-9fc516ca-3d15-48da-a70f-d7b0f81cf80a req-ea4a0cb7-77a6-4bd3-a411-6f699893db18 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:12.369272 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-9fc516ca-3d15-48da-a70f-d7b0f81cf80a req-ea4a0cb7-77a6-4bd3-a411-6f699893db18 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:12.393518 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-9fc516ca-3d15-48da-a70f-d7b0f81cf80a req-ea4a0cb7-77a6-4bd3-a411-6f699893db18 service nova] Creating event network-vif-plugged:f60d970a-170d-47a9-b1da-1f92400f8025 for instance c4da9681-4d81-4ffb-8d7e-453436e71331 on nch1-master-1 Jul 23 21:27:12.408393 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-9fc516ca-3d15-48da-a70f-d7b0f81cf80a req-ea4a0cb7-77a6-4bd3-a411-6f699893db18 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070480 Jul 23 21:27:12.409240 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1645/3392] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:27:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:27:12.546056 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-2a445d2c-131c-4cdd-ace9-8a1b9d6caf6e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:12.565466 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-2a445d2c-131c-4cdd-ace9-8a1b9d6caf6e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:12.571653 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-2a445d2c-131c-4cdd-ace9-8a1b9d6caf6e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:12.578125 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-2a445d2c-131c-4cdd-ace9-8a1b9d6caf6e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.544304 Jul 23 21:27:12.592837 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1748/3393] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:27:12 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:27:12.814659 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=8 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:12.821661 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-70cd8f41-37c4-4a5b-a7d5-cb9016713357 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:12.822482 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-70cd8f41-37c4-4a5b-a7d5-cb9016713357 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: 06a478c3-f038-4813-a456-daf3a58b5749] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:12.837423 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-70cd8f41-37c4-4a5b-a7d5-cb9016713357 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:12.838398 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-70cd8f41-37c4-4a5b-a7d5-cb9016713357 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:12.839946 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-70cd8f41-37c4-4a5b-a7d5-cb9016713357 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:12.840648 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-70cd8f41-37c4-4a5b-a7d5-cb9016713357 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:13.058633 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-70cd8f41-37c4-4a5b-a7d5-cb9016713357 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:13.068038 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-70cd8f41-37c4-4a5b-a7d5-cb9016713357 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/06a478c3-f038-4813-a456-daf3a58b5749" status: 200 len: 1517 microversion: 2.1 time: 0.254387 Jul 23 21:27:13.069663 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1646/3394] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:12 2022] GET /compute/v2.1/servers/06a478c3-f038-4813-a456-daf3a58b5749 => generated 1517 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:13.360725 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-58e6e1d3-2ced-455a-bfee-e8f97b1e6fa3 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:13.361453 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-58e6e1d3-2ced-455a-bfee-e8f97b1e6fa3 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: c4da9681-4d81-4ffb-8d7e-453436e71331] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:13.371534 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-58e6e1d3-2ced-455a-bfee-e8f97b1e6fa3 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:13.372062 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-58e6e1d3-2ced-455a-bfee-e8f97b1e6fa3 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:13.372917 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-58e6e1d3-2ced-455a-bfee-e8f97b1e6fa3 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:13.373462 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-58e6e1d3-2ced-455a-bfee-e8f97b1e6fa3 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:13.601041 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c775cb1e-586f-4ca9-a0c6-b5ca40c99d76 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:13.602063 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c775cb1e-586f-4ca9-a0c6-b5ca40c99d76 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:13.609423 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c775cb1e-586f-4ca9-a0c6-b5ca40c99d76 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:13.610251 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c775cb1e-586f-4ca9-a0c6-b5ca40c99d76 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:13.611276 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c775cb1e-586f-4ca9-a0c6-b5ca40c99d76 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:13.612000 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c775cb1e-586f-4ca9-a0c6-b5ca40c99d76 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:13.639094 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-58e6e1d3-2ced-455a-bfee-e8f97b1e6fa3 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:13.650380 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-58e6e1d3-2ced-455a-bfee-e8f97b1e6fa3 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331" status: 200 len: 1314 microversion: 2.1 time: 0.294055 Jul 23 21:27:13.655410 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1749/3395] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:13 2022] GET /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331 => generated 1314 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:13.725273 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c775cb1e-586f-4ca9-a0c6-b5ca40c99d76 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:13.737665 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c775cb1e-586f-4ca9-a0c6-b5ca40c99d76 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:13.742763 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c775cb1e-586f-4ca9-a0c6-b5ca40c99d76 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:13.745239 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c775cb1e-586f-4ca9-a0c6-b5ca40c99d76 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.149105 Jul 23 21:27:13.748976 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1647/3396] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:27:13 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:27:14.088479 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-8098c9c7-d655-4408-bec9-38b528259738 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:14.089908 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-8098c9c7-d655-4408-bec9-38b528259738 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: 06a478c3-f038-4813-a456-daf3a58b5749] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:14.100320 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8098c9c7-d655-4408-bec9-38b528259738 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:14.101337 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8098c9c7-d655-4408-bec9-38b528259738 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:14.102606 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8098c9c7-d655-4408-bec9-38b528259738 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:14.104093 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8098c9c7-d655-4408-bec9-38b528259738 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:14.384139 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-8098c9c7-d655-4408-bec9-38b528259738 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:14.395833 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-8098c9c7-d655-4408-bec9-38b528259738 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/06a478c3-f038-4813-a456-daf3a58b5749" status: 200 len: 1517 microversion: 2.1 time: 0.314038 Jul 23 21:27:14.396446 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1750/3397] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:14 2022] GET /compute/v2.1/servers/06a478c3-f038-4813-a456-daf3a58b5749 => generated 1517 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:14.670895 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-aa5898fc-57c1-464c-9078-f6e2b29f00c9 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:14.671529 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-aa5898fc-57c1-464c-9078-f6e2b29f00c9 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: c4da9681-4d81-4ffb-8d7e-453436e71331] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:14.684889 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-aa5898fc-57c1-464c-9078-f6e2b29f00c9 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:14.685278 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-aa5898fc-57c1-464c-9078-f6e2b29f00c9 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:14.698011 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-aa5898fc-57c1-464c-9078-f6e2b29f00c9 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:14.701504 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-aa5898fc-57c1-464c-9078-f6e2b29f00c9 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:14.772553 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-df3e415a-68b1-4d39-8e9b-67396114eeda tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:14.772994 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-df3e415a-68b1-4d39-8e9b-67396114eeda tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:14.779952 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:14.790337 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-df3e415a-68b1-4d39-8e9b-67396114eeda tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:14.791095 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-df3e415a-68b1-4d39-8e9b-67396114eeda tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:14.792053 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-df3e415a-68b1-4d39-8e9b-67396114eeda tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:14.795638 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-df3e415a-68b1-4d39-8e9b-67396114eeda tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:14.945043 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-df3e415a-68b1-4d39-8e9b-67396114eeda tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:14.971317 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-df3e415a-68b1-4d39-8e9b-67396114eeda tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:14.982890 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-df3e415a-68b1-4d39-8e9b-67396114eeda tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:14.986181 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-df3e415a-68b1-4d39-8e9b-67396114eeda tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.217779 Jul 23 21:27:14.986928 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1751/3398] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:27:14 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:27:15.163244 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-aa5898fc-57c1-464c-9078-f6e2b29f00c9 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:15.180768 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-aa5898fc-57c1-464c-9078-f6e2b29f00c9 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331" status: 200 len: 1502 microversion: 2.1 time: 0.514264 Jul 23 21:27:15.196996 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1648/3399] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:14 2022] GET /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331 => generated 1502 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:27:15.204866 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8b948a6d-c388-4778-8d9f-8d6c4097bcb0 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:27:15.206464 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8b948a6d-c388-4778-8d9f-8d6c4097bcb0 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: c4da9681-4d81-4ffb-8d7e-453436e71331] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:15.223519 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8b948a6d-c388-4778-8d9f-8d6c4097bcb0 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:15.226638 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8b948a6d-c388-4778-8d9f-8d6c4097bcb0 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:15.227704 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8b948a6d-c388-4778-8d9f-8d6c4097bcb0 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:15.228357 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8b948a6d-c388-4778-8d9f-8d6c4097bcb0 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:15.290847 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.objects.instance [None req-8b948a6d-c388-4778-8d9f-8d6c4097bcb0 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lazy-loading 'flavor' on Instance uuid c4da9681-4d81-4ffb-8d7e-453436e71331 {{(pid=131320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:27:15.396804 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:15.590016 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-2ed4eaa0-f4d7-484d-9d4e-74422c7dbc1f tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-2067001738", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "networks": "none"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:27:15.685597 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-2ed4eaa0-f4d7-484d-9d4e-74422c7dbc1f tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] Flavor limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:27:15.686572 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-2ed4eaa0-f4d7-484d-9d4e-74422c7dbc1f tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] Image limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:27:15.687228 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-2ed4eaa0-f4d7-484d-9d4e-74422c7dbc1f tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] Flavor pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:27:15.687827 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-2ed4eaa0-f4d7-484d-9d4e-74422c7dbc1f tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] Image pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:27:15.688466 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-2ed4eaa0-f4d7-484d-9d4e-74422c7dbc1f tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:27:15.710476 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2ed4eaa0-f4d7-484d-9d4e-74422c7dbc1f tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:15.711885 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2ed4eaa0-f4d7-484d-9d4e-74422c7dbc1f tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:15.712942 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2ed4eaa0-f4d7-484d-9d4e-74422c7dbc1f tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:15.715245 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2ed4eaa0-f4d7-484d-9d4e-74422c7dbc1f tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:15.762941 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-2ed4eaa0-f4d7-484d-9d4e-74422c7dbc1f tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] Getting quotas for project 7a91417f3a6b47c7b1acc77c350a6aa2. Resources: {'ram', 'instances', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:27:15.769809 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-2ed4eaa0-f4d7-484d-9d4e-74422c7dbc1f tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] Getting quotas for user dffbe88f71ae4f2180f89d18f234a016 and project 7a91417f3a6b47c7b1acc77c350a6aa2. Resources: {'ram', 'instances', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:27:15.786558 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-2ed4eaa0-f4d7-484d-9d4e-74422c7dbc1f tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] Going to run 1 instances... {{(pid=131321) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:27:15.790296 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-2ed4eaa0-f4d7-484d-9d4e-74422c7dbc1f tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] [instance: 297ef61b-a662-4d05-9fa6-55159b8b2dc7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131321) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:27:15.902390 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8b948a6d-c388-4778-8d9f-8d6c4097bcb0 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "POST /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331/action" status: 202 len: 0 microversion: 2.1 time: 0.700979 Jul 23 21:27:15.905236 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1649/3400] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:27:15 2022] POST /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331/action => generated 0 bytes in 707 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:27:15.910573 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-2ed4eaa0-f4d7-484d-9d4e-74422c7dbc1f tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.917923 Jul 23 21:27:15.919126 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1752/3401] 10.222.0.17 () {62 vars in 1187 bytes} [Sat Jul 23 21:27:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 930 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 23 21:27:15.930001 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-41c9cf0a-18fe-49ca-bc36-02857f9f27dd tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:15.934039 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-41c9cf0a-18fe-49ca-bc36-02857f9f27dd tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: 06a478c3-f038-4813-a456-daf3a58b5749] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:15.940607 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ae318edb-c05a-4292-bd27-8a4c59e31320 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:15.941551 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-ae318edb-c05a-4292-bd27-8a4c59e31320 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: c4da9681-4d81-4ffb-8d7e-453436e71331] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:15.975147 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-41c9cf0a-18fe-49ca-bc36-02857f9f27dd tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:15.976869 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-41c9cf0a-18fe-49ca-bc36-02857f9f27dd tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:15.979918 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-41c9cf0a-18fe-49ca-bc36-02857f9f27dd tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:15.980464 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-41c9cf0a-18fe-49ca-bc36-02857f9f27dd tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:15.988628 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ae318edb-c05a-4292-bd27-8a4c59e31320 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:15.991895 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ae318edb-c05a-4292-bd27-8a4c59e31320 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:15.992810 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ae318edb-c05a-4292-bd27-8a4c59e31320 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:15.993354 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ae318edb-c05a-4292-bd27-8a4c59e31320 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:16.304178 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ae318edb-c05a-4292-bd27-8a4c59e31320 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:16.313139 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-ae318edb-c05a-4292-bd27-8a4c59e31320 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331" status: 200 len: 1508 microversion: 2.1 time: 0.390977 Jul 23 21:27:16.317234 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1753/3402] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:15 2022] GET /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331 => generated 1508 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:16.330766 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-79dc308e-8fb3-4d59-8aa5-e96c14f62471 tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:16.331396 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-79dc308e-8fb3-4d59-8aa5-e96c14f62471 tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] [instance: 297ef61b-a662-4d05-9fa6-55159b8b2dc7] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:16.591090 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-79dc308e-8fb3-4d59-8aa5-e96c14f62471 tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffbe88f71ae4f2180f89d18f234a016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a91417f3a6b47c7b1acc77c350a6aa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:16.604809 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-79dc308e-8fb3-4d59-8aa5-e96c14f62471 tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dffbe88f71ae4f2180f89d18f234a016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a91417f3a6b47c7b1acc77c350a6aa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:16.607731 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-79dc308e-8fb3-4d59-8aa5-e96c14f62471 tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dffbe88f71ae4f2180f89d18f234a016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a91417f3a6b47c7b1acc77c350a6aa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:16.612762 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-79dc308e-8fb3-4d59-8aa5-e96c14f62471 tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] 10.222.0.17 "GET /compute/v2.1/servers/297ef61b-a662-4d05-9fa6-55159b8b2dc7" status: 200 len: 1281 microversion: 2.47 time: 0.293155 Jul 23 21:27:16.615724 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1754/3403] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:27:16 2022] GET /compute/v2.1/servers/297ef61b-a662-4d05-9fa6-55159b8b2dc7 => generated 1281 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:27:16.628615 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-90c6cc06-5933-47e7-a3b5-fb7672bb2872 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:16.629496 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-90c6cc06-5933-47e7-a3b5-fb7672bb2872 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:16.646734 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-90c6cc06-5933-47e7-a3b5-fb7672bb2872 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:16.647754 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-90c6cc06-5933-47e7-a3b5-fb7672bb2872 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:16.648629 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-90c6cc06-5933-47e7-a3b5-fb7672bb2872 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:16.649195 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-90c6cc06-5933-47e7-a3b5-fb7672bb2872 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:16.744176 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-90c6cc06-5933-47e7-a3b5-fb7672bb2872 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:16.759705 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-90c6cc06-5933-47e7-a3b5-fb7672bb2872 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:16.764403 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-90c6cc06-5933-47e7-a3b5-fb7672bb2872 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:16.768400 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-90c6cc06-5933-47e7-a3b5-fb7672bb2872 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.150251 Jul 23 21:27:16.769082 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1755/3404] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:27:16 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:27:16.809686 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-41c9cf0a-18fe-49ca-bc36-02857f9f27dd tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:16.821143 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-41c9cf0a-18fe-49ca-bc36-02857f9f27dd tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/06a478c3-f038-4813-a456-daf3a58b5749" status: 200 len: 1517 microversion: 2.1 time: 0.912949 Jul 23 21:27:16.823818 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1650/3405] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:15 2022] GET /compute/v2.1/servers/06a478c3-f038-4813-a456-daf3a58b5749 => generated 1517 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:17.334158 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-9610cf5c-2df8-42b2-9d78-6bb77185590f tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:17.335430 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-9610cf5c-2df8-42b2-9d78-6bb77185590f tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: c4da9681-4d81-4ffb-8d7e-453436e71331] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:17.347717 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9610cf5c-2df8-42b2-9d78-6bb77185590f tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:17.348392 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9610cf5c-2df8-42b2-9d78-6bb77185590f tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:17.349405 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9610cf5c-2df8-42b2-9d78-6bb77185590f tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:17.350063 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9610cf5c-2df8-42b2-9d78-6bb77185590f tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:17.383848 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=100 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:17.633316 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c41f846c-eb14-412e-b059-c4078ad0f3dd tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:17.633975 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c41f846c-eb14-412e-b059-c4078ad0f3dd tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] [instance: 297ef61b-a662-4d05-9fa6-55159b8b2dc7] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:17.650903 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c41f846c-eb14-412e-b059-c4078ad0f3dd tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:17.651365 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c41f846c-eb14-412e-b059-c4078ad0f3dd tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:17.652170 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c41f846c-eb14-412e-b059-c4078ad0f3dd tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:17.652610 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c41f846c-eb14-412e-b059-c4078ad0f3dd tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:17.742298 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-9610cf5c-2df8-42b2-9d78-6bb77185590f tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:17.750829 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-9610cf5c-2df8-42b2-9d78-6bb77185590f tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331" status: 200 len: 1508 microversion: 2.1 time: 0.420633 Jul 23 21:27:17.751409 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1756/3406] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:17 2022] GET /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331 => generated 1508 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:17.791449 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-6e3a6aca-0afb-4f2e-a8ee-deb75669900b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:17.793039 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-6e3a6aca-0afb-4f2e-a8ee-deb75669900b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:17.816227 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6e3a6aca-0afb-4f2e-a8ee-deb75669900b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:17.817058 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6e3a6aca-0afb-4f2e-a8ee-deb75669900b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:17.820106 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6e3a6aca-0afb-4f2e-a8ee-deb75669900b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:17.837655 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6e3a6aca-0afb-4f2e-a8ee-deb75669900b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:17.854146 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c41f846c-eb14-412e-b059-c4078ad0f3dd tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffbe88f71ae4f2180f89d18f234a016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a91417f3a6b47c7b1acc77c350a6aa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:17.894107 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c41f846c-eb14-412e-b059-c4078ad0f3dd tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dffbe88f71ae4f2180f89d18f234a016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a91417f3a6b47c7b1acc77c350a6aa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:17.905563 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c41f846c-eb14-412e-b059-c4078ad0f3dd tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dffbe88f71ae4f2180f89d18f234a016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a91417f3a6b47c7b1acc77c350a6aa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:17.910943 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c41f846c-eb14-412e-b059-c4078ad0f3dd tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] 10.222.0.17 "GET /compute/v2.1/servers/297ef61b-a662-4d05-9fa6-55159b8b2dc7" status: 200 len: 1333 microversion: 2.47 time: 0.278193 Jul 23 21:27:17.913444 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1651/3407] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:27:17 2022] GET /compute/v2.1/servers/297ef61b-a662-4d05-9fa6-55159b8b2dc7 => generated 1333 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:27:17.930149 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d134b429-2362-4069-96fd-d8ea5db659b0 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:17.934177 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d134b429-2362-4069-96fd-d8ea5db659b0 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: 06a478c3-f038-4813-a456-daf3a58b5749] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:17.962931 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d134b429-2362-4069-96fd-d8ea5db659b0 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:17.966664 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d134b429-2362-4069-96fd-d8ea5db659b0 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:17.982386 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d134b429-2362-4069-96fd-d8ea5db659b0 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:17.985831 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d134b429-2362-4069-96fd-d8ea5db659b0 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:18.048717 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-6e3a6aca-0afb-4f2e-a8ee-deb75669900b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:18.064389 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-6e3a6aca-0afb-4f2e-a8ee-deb75669900b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:18.066930 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-6e3a6aca-0afb-4f2e-a8ee-deb75669900b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:18.068867 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-6e3a6aca-0afb-4f2e-a8ee-deb75669900b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.283444 Jul 23 21:27:18.069991 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1757/3408] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:27:17 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:27:18.705050 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d134b429-2362-4069-96fd-d8ea5db659b0 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:18.717205 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d134b429-2362-4069-96fd-d8ea5db659b0 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/06a478c3-f038-4813-a456-daf3a58b5749" status: 200 len: 1517 microversion: 2.1 time: 0.798479 Jul 23 21:27:18.722349 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1652/3409] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:17 2022] GET /compute/v2.1/servers/06a478c3-f038-4813-a456-daf3a58b5749 => generated 1517 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:18.769744 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-0de9c045-fa6e-4ad9-aff1-f7e73a22b921 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:18.771348 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-0de9c045-fa6e-4ad9-aff1-f7e73a22b921 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: c4da9681-4d81-4ffb-8d7e-453436e71331] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:18.779640 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0de9c045-fa6e-4ad9-aff1-f7e73a22b921 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:18.780496 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0de9c045-fa6e-4ad9-aff1-f7e73a22b921 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:18.781661 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0de9c045-fa6e-4ad9-aff1-f7e73a22b921 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:18.782364 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0de9c045-fa6e-4ad9-aff1-f7e73a22b921 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:18.933317 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ac35ebba-547b-47e5-83ef-2242126af126 tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:18.934719 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ac35ebba-547b-47e5-83ef-2242126af126 tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] [instance: 297ef61b-a662-4d05-9fa6-55159b8b2dc7] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:18.950881 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ac35ebba-547b-47e5-83ef-2242126af126 tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:18.951731 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ac35ebba-547b-47e5-83ef-2242126af126 tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:18.952803 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ac35ebba-547b-47e5-83ef-2242126af126 tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:18.970495 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ac35ebba-547b-47e5-83ef-2242126af126 tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:19.201300 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ac35ebba-547b-47e5-83ef-2242126af126 tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffbe88f71ae4f2180f89d18f234a016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a91417f3a6b47c7b1acc77c350a6aa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:19.218530 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ac35ebba-547b-47e5-83ef-2242126af126 tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dffbe88f71ae4f2180f89d18f234a016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a91417f3a6b47c7b1acc77c350a6aa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:19.228175 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ac35ebba-547b-47e5-83ef-2242126af126 tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dffbe88f71ae4f2180f89d18f234a016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a91417f3a6b47c7b1acc77c350a6aa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:19.229910 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ac35ebba-547b-47e5-83ef-2242126af126 tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] 10.222.0.17 "GET /compute/v2.1/servers/297ef61b-a662-4d05-9fa6-55159b8b2dc7" status: 200 len: 1339 microversion: 2.47 time: 0.300757 Jul 23 21:27:19.231176 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1653/3410] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:27:18 2022] GET /compute/v2.1/servers/297ef61b-a662-4d05-9fa6-55159b8b2dc7 => generated 1339 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:27:19.249669 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-cd52733e-ccb5-4781-9d57-53d0c6a2b58b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:19.250758 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-cd52733e-ccb5-4781-9d57-53d0c6a2b58b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:19.258593 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cd52733e-ccb5-4781-9d57-53d0c6a2b58b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:19.260056 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cd52733e-ccb5-4781-9d57-53d0c6a2b58b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:19.261359 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cd52733e-ccb5-4781-9d57-53d0c6a2b58b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:19.262182 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cd52733e-ccb5-4781-9d57-53d0c6a2b58b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:19.363496 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-cd52733e-ccb5-4781-9d57-53d0c6a2b58b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:19.375618 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-cd52733e-ccb5-4781-9d57-53d0c6a2b58b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:19.377478 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-cd52733e-ccb5-4781-9d57-53d0c6a2b58b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:19.378958 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-cd52733e-ccb5-4781-9d57-53d0c6a2b58b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.134635 Jul 23 21:27:19.380299 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1654/3411] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:27:19 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:27:19.475086 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-0de9c045-fa6e-4ad9-aff1-f7e73a22b921 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:19.488645 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-0de9c045-fa6e-4ad9-aff1-f7e73a22b921 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331" status: 200 len: 1508 microversion: 2.1 time: 0.723510 Jul 23 21:27:19.491184 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1758/3412] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:18 2022] GET /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331 => generated 1508 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:19.743929 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8b127407-162d-45da-bf2c-80a58b12b7a4 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:19.744878 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8b127407-162d-45da-bf2c-80a58b12b7a4 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: 06a478c3-f038-4813-a456-daf3a58b5749] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:19.759429 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8b127407-162d-45da-bf2c-80a58b12b7a4 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:19.760541 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8b127407-162d-45da-bf2c-80a58b12b7a4 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:19.761912 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8b127407-162d-45da-bf2c-80a58b12b7a4 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:19.762711 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8b127407-162d-45da-bf2c-80a58b12b7a4 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:20.046242 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8b127407-162d-45da-bf2c-80a58b12b7a4 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:20.061532 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8b127407-162d-45da-bf2c-80a58b12b7a4 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/06a478c3-f038-4813-a456-daf3a58b5749" status: 200 len: 1517 microversion: 2.1 time: 0.326427 Jul 23 21:27:20.063285 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1655/3413] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:19 2022] GET /compute/v2.1/servers/06a478c3-f038-4813-a456-daf3a58b5749 => generated 1517 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:20.255591 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-dc4421a5-eac5-4e11-8a53-2e07ae03f86e tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:20.256193 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-dc4421a5-eac5-4e11-8a53-2e07ae03f86e tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] [instance: 297ef61b-a662-4d05-9fa6-55159b8b2dc7] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:20.279749 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-dc4421a5-eac5-4e11-8a53-2e07ae03f86e tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:20.285035 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-dc4421a5-eac5-4e11-8a53-2e07ae03f86e tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:20.290498 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-dc4421a5-eac5-4e11-8a53-2e07ae03f86e tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:20.291361 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-dc4421a5-eac5-4e11-8a53-2e07ae03f86e tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:20.398384 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-46bef783-3de6-4ad9-9ddf-30b6ba025ec4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:20.399306 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-46bef783-3de6-4ad9-9ddf-30b6ba025ec4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:20.414096 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-46bef783-3de6-4ad9-9ddf-30b6ba025ec4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:20.415320 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-46bef783-3de6-4ad9-9ddf-30b6ba025ec4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:20.416813 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-46bef783-3de6-4ad9-9ddf-30b6ba025ec4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:20.417521 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-46bef783-3de6-4ad9-9ddf-30b6ba025ec4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:20.494144 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-dc4421a5-eac5-4e11-8a53-2e07ae03f86e tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffbe88f71ae4f2180f89d18f234a016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a91417f3a6b47c7b1acc77c350a6aa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:20.510082 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-dc4421a5-eac5-4e11-8a53-2e07ae03f86e tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dffbe88f71ae4f2180f89d18f234a016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a91417f3a6b47c7b1acc77c350a6aa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:20.528544 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-dc4421a5-eac5-4e11-8a53-2e07ae03f86e tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dffbe88f71ae4f2180f89d18f234a016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a91417f3a6b47c7b1acc77c350a6aa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:20.531095 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-dc4421a5-eac5-4e11-8a53-2e07ae03f86e tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] 10.222.0.17 "GET /compute/v2.1/servers/297ef61b-a662-4d05-9fa6-55159b8b2dc7" status: 200 len: 1339 microversion: 2.47 time: 0.279771 Jul 23 21:27:20.550486 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1759/3414] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:27:20 2022] GET /compute/v2.1/servers/297ef61b-a662-4d05-9fa6-55159b8b2dc7 => generated 1339 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:27:20.557277 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-fac0b1f5-8e0c-4d55-bc4d-449dd0a4d037 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:20.560873 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-fac0b1f5-8e0c-4d55-bc4d-449dd0a4d037 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: c4da9681-4d81-4ffb-8d7e-453436e71331] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:20.580132 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fac0b1f5-8e0c-4d55-bc4d-449dd0a4d037 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:20.580596 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fac0b1f5-8e0c-4d55-bc4d-449dd0a4d037 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:20.582584 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fac0b1f5-8e0c-4d55-bc4d-449dd0a4d037 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:20.584247 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fac0b1f5-8e0c-4d55-bc4d-449dd0a4d037 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:20.590096 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-46bef783-3de6-4ad9-9ddf-30b6ba025ec4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:20.603260 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-46bef783-3de6-4ad9-9ddf-30b6ba025ec4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:20.605184 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-46bef783-3de6-4ad9-9ddf-30b6ba025ec4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:20.616791 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-46bef783-3de6-4ad9-9ddf-30b6ba025ec4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.211723 Jul 23 21:27:20.617478 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1656/3415] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:27:20 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:27:20.897433 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-fac0b1f5-8e0c-4d55-bc4d-449dd0a4d037 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:20.910143 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-fac0b1f5-8e0c-4d55-bc4d-449dd0a4d037 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331" status: 200 len: 1508 microversion: 2.1 time: 0.357381 Jul 23 21:27:20.911249 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1760/3416] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:20 2022] GET /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331 => generated 1508 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:21.080851 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-41e02272-6802-4671-914a-06546446512f tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:21.082124 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-41e02272-6802-4671-914a-06546446512f tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: 06a478c3-f038-4813-a456-daf3a58b5749] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:21.099044 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-41e02272-6802-4671-914a-06546446512f tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:21.102810 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-41e02272-6802-4671-914a-06546446512f tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:21.103745 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-41e02272-6802-4671-914a-06546446512f tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:21.106116 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-41e02272-6802-4671-914a-06546446512f tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:21.381514 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-41e02272-6802-4671-914a-06546446512f tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:21.390528 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-41e02272-6802-4671-914a-06546446512f tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/06a478c3-f038-4813-a456-daf3a58b5749" status: 200 len: 1517 microversion: 2.1 time: 0.315030 Jul 23 21:27:21.391123 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1657/3417] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:21 2022] GET /compute/v2.1/servers/06a478c3-f038-4813-a456-daf3a58b5749 => generated 1517 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:21.443799 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-fac0b1f5-8e0c-4d55-bc4d-449dd0a4d037 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:21.444798 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-fac0b1f5-8e0c-4d55-bc4d-449dd0a4d037 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001386 Jul 23 21:27:21.445146 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1761/3418] 10.222.0.17 () {56 vars in 885 bytes} [Sat Jul 23 21:27:21 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 23 21:27:21.557055 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f0601a48-e390-4c3e-b94f-14a7177664b7 tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:21.558073 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f0601a48-e390-4c3e-b94f-14a7177664b7 tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] [instance: 297ef61b-a662-4d05-9fa6-55159b8b2dc7] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:21.565377 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f0601a48-e390-4c3e-b94f-14a7177664b7 tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:21.566243 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f0601a48-e390-4c3e-b94f-14a7177664b7 tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:21.567739 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f0601a48-e390-4c3e-b94f-14a7177664b7 tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:21.568371 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f0601a48-e390-4c3e-b94f-14a7177664b7 tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:21.646037 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-4d985095-5136-4cd9-a2f8-3e3d88a5bd1d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:21.649035 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-4d985095-5136-4cd9-a2f8-3e3d88a5bd1d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:21.670803 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4d985095-5136-4cd9-a2f8-3e3d88a5bd1d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:21.674042 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4d985095-5136-4cd9-a2f8-3e3d88a5bd1d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:21.674892 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4d985095-5136-4cd9-a2f8-3e3d88a5bd1d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:21.675341 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4d985095-5136-4cd9-a2f8-3e3d88a5bd1d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:21.686293 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f0601a48-e390-4c3e-b94f-14a7177664b7 tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffbe88f71ae4f2180f89d18f234a016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a91417f3a6b47c7b1acc77c350a6aa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:21.695007 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f0601a48-e390-4c3e-b94f-14a7177664b7 tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dffbe88f71ae4f2180f89d18f234a016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a91417f3a6b47c7b1acc77c350a6aa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:21.696519 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f0601a48-e390-4c3e-b94f-14a7177664b7 tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dffbe88f71ae4f2180f89d18f234a016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a91417f3a6b47c7b1acc77c350a6aa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:21.697713 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f0601a48-e390-4c3e-b94f-14a7177664b7 tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] 10.222.0.17 "GET /compute/v2.1/servers/297ef61b-a662-4d05-9fa6-55159b8b2dc7" status: 200 len: 1360 microversion: 2.47 time: 0.145557 Jul 23 21:27:21.714753 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1658/3419] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:27:21 2022] GET /compute/v2.1/servers/297ef61b-a662-4d05-9fa6-55159b8b2dc7 => generated 1360 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:27:21.739521 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5d39a396-0266-43e6-a749-2405979a4666 tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-527824971"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:27:21.741102 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5d39a396-0266-43e6-a749-2405979a4666 tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] [instance: 297ef61b-a662-4d05-9fa6-55159b8b2dc7] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:21.748752 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5d39a396-0266-43e6-a749-2405979a4666 tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:21.749497 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5d39a396-0266-43e6-a749-2405979a4666 tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:21.750536 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5d39a396-0266-43e6-a749-2405979a4666 tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:21.751236 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5d39a396-0266-43e6-a749-2405979a4666 tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:21.840640 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-4d985095-5136-4cd9-a2f8-3e3d88a5bd1d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:21.854362 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-4d985095-5136-4cd9-a2f8-3e3d88a5bd1d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:21.857775 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-4d985095-5136-4cd9-a2f8-3e3d88a5bd1d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:21.859116 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-4d985095-5136-4cd9-a2f8-3e3d88a5bd1d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.222782 Jul 23 21:27:21.870459 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1762/3420] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:27:21 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:27:22.095707 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-b35698b3-d410-4022-9356-eef6563b6053 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1639924084", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:27:22.149067 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5d39a396-0266-43e6-a749-2405979a4666 tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] 10.222.0.17 "POST /compute/v2.1/servers/297ef61b-a662-4d05-9fa6-55159b8b2dc7/action" status: 202 len: 52 microversion: 2.47 time: 0.414603 Jul 23 21:27:22.149905 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1659/3421] 10.222.0.17 () {62 vars in 1318 bytes} [Sat Jul 23 21:27:21 2022] POST /compute/v2.1/servers/297ef61b-a662-4d05-9fa6-55159b8b2dc7/action => generated 52 bytes in 416 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Jul 23 21:27:22.155304 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2bb9e246-4c2e-4abc-95de-1435db31d0f0 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:22.156254 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-2bb9e246-4c2e-4abc-95de-1435db31d0f0 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: c4da9681-4d81-4ffb-8d7e-453436e71331] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:22.162963 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.network.neutron [None req-b35698b3-d410-4022-9356-eef6563b6053 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] validate_networks() for [('2f6a581c-5aeb-4c8e-996b-61f280fbe3c2', None, None, None, None, None)] {{(pid=131321) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:27:22.163525 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2bb9e246-4c2e-4abc-95de-1435db31d0f0 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:22.164154 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2bb9e246-4c2e-4abc-95de-1435db31d0f0 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:22.165114 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2bb9e246-4c2e-4abc-95de-1435db31d0f0 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:22.165611 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2bb9e246-4c2e-4abc-95de-1435db31d0f0 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:22.414302 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-2bb9e246-4c2e-4abc-95de-1435db31d0f0 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:22.425306 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2bb9e246-4c2e-4abc-95de-1435db31d0f0 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331" status: 200 len: 1508 microversion: 2.1 time: 0.273836 Jul 23 21:27:22.426302 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1660/3422] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:22 2022] GET /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331 => generated 1508 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:22.443603 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f459f10b-a32b-42aa-ba45-27fa1c527096 tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:22.444398 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f459f10b-a32b-42aa-ba45-27fa1c527096 tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] [instance: 297ef61b-a662-4d05-9fa6-55159b8b2dc7] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:22.451467 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f459f10b-a32b-42aa-ba45-27fa1c527096 tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:22.452283 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f459f10b-a32b-42aa-ba45-27fa1c527096 tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:22.453304 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f459f10b-a32b-42aa-ba45-27fa1c527096 tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:22.453984 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f459f10b-a32b-42aa-ba45-27fa1c527096 tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:22.482312 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f459f10b-a32b-42aa-ba45-27fa1c527096 tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] [instance: 297ef61b-a662-4d05-9fa6-55159b8b2dc7] Going to try to terminate instance {{(pid=131320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:27:22.577154 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f459f10b-a32b-42aa-ba45-27fa1c527096 tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] 10.222.0.17 "DELETE /compute/v2.1/servers/297ef61b-a662-4d05-9fa6-55159b8b2dc7" status: 204 len: 0 microversion: 2.47 time: 0.139695 Jul 23 21:27:22.578080 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1661/3423] 10.222.0.17 () {60 vars in 1279 bytes} [Sat Jul 23 21:27:22 2022] DELETE /compute/v2.1/servers/297ef61b-a662-4d05-9fa6-55159b8b2dc7 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 23 21:27:22.589377 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c66f52f6-e0b1-4401-a578-5624e2141859 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:22.590116 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c66f52f6-e0b1-4401-a578-5624e2141859 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: 06a478c3-f038-4813-a456-daf3a58b5749] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:22.601519 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c66f52f6-e0b1-4401-a578-5624e2141859 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:22.602205 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c66f52f6-e0b1-4401-a578-5624e2141859 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:22.603363 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c66f52f6-e0b1-4401-a578-5624e2141859 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:22.603946 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c66f52f6-e0b1-4401-a578-5624e2141859 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:22.789489 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c66f52f6-e0b1-4401-a578-5624e2141859 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:22.790355 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-b35698b3-d410-4022-9356-eef6563b6053 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Flavor limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:27:22.790355 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-b35698b3-d410-4022-9356-eef6563b6053 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Image limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:27:22.790821 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-b35698b3-d410-4022-9356-eef6563b6053 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Flavor pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:27:22.791241 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-b35698b3-d410-4022-9356-eef6563b6053 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Image pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:27:22.791814 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-b35698b3-d410-4022-9356-eef6563b6053 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:27:22.793279 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:22.802871 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c66f52f6-e0b1-4401-a578-5624e2141859 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/06a478c3-f038-4813-a456-daf3a58b5749" status: 200 len: 1517 microversion: 2.1 time: 0.218074 Jul 23 21:27:22.803742 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1662/3424] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:22 2022] GET /compute/v2.1/servers/06a478c3-f038-4813-a456-daf3a58b5749 => generated 1517 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:22.809285 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b35698b3-d410-4022-9356-eef6563b6053 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:22.810072 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b35698b3-d410-4022-9356-eef6563b6053 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:22.811063 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b35698b3-d410-4022-9356-eef6563b6053 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:22.811671 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b35698b3-d410-4022-9356-eef6563b6053 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:22.832176 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-db63bf97-9a40-4334-bcfe-856e9c349a5e tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:22.832846 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-db63bf97-9a40-4334-bcfe-856e9c349a5e tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] [instance: 297ef61b-a662-4d05-9fa6-55159b8b2dc7] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:22.833229 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-b35698b3-d410-4022-9356-eef6563b6053 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Getting quotas for project 2b46cc4b1ef64d168bf4184339de54d2. Resources: {'ram', 'instances', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:27:22.842799 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-b35698b3-d410-4022-9356-eef6563b6053 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Getting quotas for user e11fb79c253c4a0f955d710ff4626f6d and project 2b46cc4b1ef64d168bf4184339de54d2. Resources: {'ram', 'instances', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:27:22.861981 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-db63bf97-9a40-4334-bcfe-856e9c349a5e tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:22.862798 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-db63bf97-9a40-4334-bcfe-856e9c349a5e tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:22.868103 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-db63bf97-9a40-4334-bcfe-856e9c349a5e tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:22.869256 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-db63bf97-9a40-4334-bcfe-856e9c349a5e tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:22.883166 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-b35698b3-d410-4022-9356-eef6563b6053 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Going to run 1 instances... {{(pid=131321) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:27:22.885729 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-b35698b3-d410-4022-9356-eef6563b6053 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] [instance: 63c3348d-dcf9-4e87-acfe-c7ab88796150] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131321) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:27:22.976805 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-b35698b3-d410-4022-9356-eef6563b6053 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.060540 Jul 23 21:27:22.983410 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1763/3425] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:27:21 2022] POST /compute/v2.1/servers => generated 383 bytes in 1067 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 23 21:27:22.999755 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-1d09a618-d61e-42bb-84af-f726c399172f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:23.005429 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-1d09a618-d61e-42bb-84af-f726c399172f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:23.023041 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1d09a618-d61e-42bb-84af-f726c399172f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:23.026576 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1d09a618-d61e-42bb-84af-f726c399172f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:23.027454 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1d09a618-d61e-42bb-84af-f726c399172f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:23.027908 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1d09a618-d61e-42bb-84af-f726c399172f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:23.036155 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-db63bf97-9a40-4334-bcfe-856e9c349a5e tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffbe88f71ae4f2180f89d18f234a016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a91417f3a6b47c7b1acc77c350a6aa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:23.049732 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-db63bf97-9a40-4334-bcfe-856e9c349a5e tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dffbe88f71ae4f2180f89d18f234a016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a91417f3a6b47c7b1acc77c350a6aa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:23.052821 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-db63bf97-9a40-4334-bcfe-856e9c349a5e tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dffbe88f71ae4f2180f89d18f234a016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a91417f3a6b47c7b1acc77c350a6aa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:23.058740 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-db63bf97-9a40-4334-bcfe-856e9c349a5e tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] 10.222.0.17 "GET /compute/v2.1/servers/297ef61b-a662-4d05-9fa6-55159b8b2dc7" status: 200 len: 1366 microversion: 2.47 time: 0.253737 Jul 23 21:27:23.066043 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1663/3426] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:27:22 2022] GET /compute/v2.1/servers/297ef61b-a662-4d05-9fa6-55159b8b2dc7 => generated 1366 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:27:23.067375 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-fe62d5fe-a72d-4e41-b59a-6ea62cfb4e75 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:23.068226 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-fe62d5fe-a72d-4e41-b59a-6ea62cfb4e75 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] [instance: 63c3348d-dcf9-4e87-acfe-c7ab88796150] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:23.138899 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-fe62d5fe-a72d-4e41-b59a-6ea62cfb4e75 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e11fb79c253c4a0f955d710ff4626f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b46cc4b1ef64d168bf4184339de54d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:23.147513 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-fe62d5fe-a72d-4e41-b59a-6ea62cfb4e75 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] 10.222.0.17 "GET /compute/v2.1/servers/63c3348d-dcf9-4e87-acfe-c7ab88796150" status: 200 len: 1222 microversion: 2.1 time: 0.085702 Jul 23 21:27:23.150775 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1664/3427] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:23 2022] GET /compute/v2.1/servers/63c3348d-dcf9-4e87-acfe-c7ab88796150 => generated 1222 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:23.260966 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-1d09a618-d61e-42bb-84af-f726c399172f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:23.287489 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-1d09a618-d61e-42bb-84af-f726c399172f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:23.307867 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-1d09a618-d61e-42bb-84af-f726c399172f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:23.307867 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-1d09a618-d61e-42bb-84af-f726c399172f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.309880 Jul 23 21:27:23.307867 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1764/3428] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:27:22 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:27:23.324904 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a67dfe3a-6890-41e1-9b6a-df27cd571fab tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1812290411", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:27:23.404933 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-a67dfe3a-6890-41e1-9b6a-df27cd571fab tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] validate_networks() for [('2f6a581c-5aeb-4c8e-996b-61f280fbe3c2', None, None, None, None, None)] {{(pid=131320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:27:23.444254 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-156414de-a63c-43d3-bf95-5fec295f8cf9 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:23.445265 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-156414de-a63c-43d3-bf95-5fec295f8cf9 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: c4da9681-4d81-4ffb-8d7e-453436e71331] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:23.459299 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-156414de-a63c-43d3-bf95-5fec295f8cf9 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:23.461212 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-156414de-a63c-43d3-bf95-5fec295f8cf9 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:23.464664 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-156414de-a63c-43d3-bf95-5fec295f8cf9 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:23.466813 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-156414de-a63c-43d3-bf95-5fec295f8cf9 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:23.723035 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-156414de-a63c-43d3-bf95-5fec295f8cf9 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:23.735636 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-156414de-a63c-43d3-bf95-5fec295f8cf9 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331" status: 200 len: 1508 microversion: 2.1 time: 0.295983 Jul 23 21:27:23.737302 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1765/3429] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:23 2022] GET /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331 => generated 1508 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:23.822758 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-4f6f2d51-76a7-47eb-93dc-b82d8b2840a2 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:23.824215 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-4f6f2d51-76a7-47eb-93dc-b82d8b2840a2 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: 06a478c3-f038-4813-a456-daf3a58b5749] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:23.840327 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4f6f2d51-76a7-47eb-93dc-b82d8b2840a2 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:23.841219 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4f6f2d51-76a7-47eb-93dc-b82d8b2840a2 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:23.847099 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4f6f2d51-76a7-47eb-93dc-b82d8b2840a2 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:23.848800 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4f6f2d51-76a7-47eb-93dc-b82d8b2840a2 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:24.105885 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-4f6f2d51-76a7-47eb-93dc-b82d8b2840a2 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:24.115773 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-4f6f2d51-76a7-47eb-93dc-b82d8b2840a2 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/06a478c3-f038-4813-a456-daf3a58b5749" status: 200 len: 1517 microversion: 2.1 time: 0.298619 Jul 23 21:27:24.127528 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1766/3430] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:23 2022] GET /compute/v2.1/servers/06a478c3-f038-4813-a456-daf3a58b5749 => generated 1517 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:24.135825 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-bf81d987-49aa-4a37-8b83-15f375e55614 tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:24.136719 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-bf81d987-49aa-4a37-8b83-15f375e55614 tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] [instance: 297ef61b-a662-4d05-9fa6-55159b8b2dc7] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:24.162580 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bf81d987-49aa-4a37-8b83-15f375e55614 tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:24.163033 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bf81d987-49aa-4a37-8b83-15f375e55614 tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:24.170578 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bf81d987-49aa-4a37-8b83-15f375e55614 tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:24.173895 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bf81d987-49aa-4a37-8b83-15f375e55614 tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:24.248939 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-a67dfe3a-6890-41e1-9b6a-df27cd571fab tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:27:24.249989 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-a67dfe3a-6890-41e1-9b6a-df27cd571fab tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:27:24.250652 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-a67dfe3a-6890-41e1-9b6a-df27cd571fab tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:27:24.251242 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-a67dfe3a-6890-41e1-9b6a-df27cd571fab tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:27:24.251838 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-a67dfe3a-6890-41e1-9b6a-df27cd571fab tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:27:24.262483 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-bf81d987-49aa-4a37-8b83-15f375e55614 tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffbe88f71ae4f2180f89d18f234a016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a91417f3a6b47c7b1acc77c350a6aa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:24.265268 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a67dfe3a-6890-41e1-9b6a-df27cd571fab tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:24.266114 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a67dfe3a-6890-41e1-9b6a-df27cd571fab tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:24.268070 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a67dfe3a-6890-41e1-9b6a-df27cd571fab tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:24.268687 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a67dfe3a-6890-41e1-9b6a-df27cd571fab tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:24.272937 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-bf81d987-49aa-4a37-8b83-15f375e55614 tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dffbe88f71ae4f2180f89d18f234a016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a91417f3a6b47c7b1acc77c350a6aa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:24.275493 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-bf81d987-49aa-4a37-8b83-15f375e55614 tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dffbe88f71ae4f2180f89d18f234a016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a91417f3a6b47c7b1acc77c350a6aa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:24.277470 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-bf81d987-49aa-4a37-8b83-15f375e55614 tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] 10.222.0.17 "GET /compute/v2.1/servers/297ef61b-a662-4d05-9fa6-55159b8b2dc7" status: 200 len: 1366 microversion: 2.47 time: 0.147852 Jul 23 21:27:24.278065 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1767/3431] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:27:24 2022] GET /compute/v2.1/servers/297ef61b-a662-4d05-9fa6-55159b8b2dc7 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:27:24.301893 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-a67dfe3a-6890-41e1-9b6a-df27cd571fab tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Getting quotas for project 2b46cc4b1ef64d168bf4184339de54d2. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:27:24.313206 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:24.314439 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-32736144-0207-4214-9fb2-626726777995 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:24.315075 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-32736144-0207-4214-9fb2-626726777995 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:24.317622 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-a67dfe3a-6890-41e1-9b6a-df27cd571fab tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Getting quotas for user e11fb79c253c4a0f955d710ff4626f6d and project 2b46cc4b1ef64d168bf4184339de54d2. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:27:24.326611 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-32736144-0207-4214-9fb2-626726777995 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:24.327072 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-32736144-0207-4214-9fb2-626726777995 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:24.329541 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-32736144-0207-4214-9fb2-626726777995 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:24.330023 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-32736144-0207-4214-9fb2-626726777995 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:24.342060 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a67dfe3a-6890-41e1-9b6a-df27cd571fab tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Going to run 1 instances... {{(pid=131320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:27:24.345574 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a67dfe3a-6890-41e1-9b6a-df27cd571fab tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] [instance: d3d6b0e1-57fa-4247-bf6d-18c97aa22750] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:27:24.419938 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a67dfe3a-6890-41e1-9b6a-df27cd571fab tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.099581 Jul 23 21:27:24.423202 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-32736144-0207-4214-9fb2-626726777995 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:24.425529 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1665/3432] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:27:23 2022] POST /compute/v2.1/servers => generated 383 bytes in 1106 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 23 21:27:24.435724 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-32736144-0207-4214-9fb2-626726777995 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:24.437630 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5512cade-d6dd-4f46-bda5-c8eb8421bf45 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:24.438147 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-32736144-0207-4214-9fb2-626726777995 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:24.438617 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5512cade-d6dd-4f46-bda5-c8eb8421bf45 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] [instance: d3d6b0e1-57fa-4247-bf6d-18c97aa22750] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:24.439849 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-32736144-0207-4214-9fb2-626726777995 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.131078 Jul 23 21:27:24.442074 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1768/3433] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:27:24 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:27:24.531405 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5512cade-d6dd-4f46-bda5-c8eb8421bf45 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e11fb79c253c4a0f955d710ff4626f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b46cc4b1ef64d168bf4184339de54d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:24.552712 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5512cade-d6dd-4f46-bda5-c8eb8421bf45 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] 10.222.0.17 "GET /compute/v2.1/servers/d3d6b0e1-57fa-4247-bf6d-18c97aa22750" status: 200 len: 1222 microversion: 2.1 time: 0.119317 Jul 23 21:27:24.559326 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1666/3434] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:24 2022] GET /compute/v2.1/servers/d3d6b0e1-57fa-4247-bf6d-18c97aa22750 => generated 1222 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:24.755368 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-054bff8f-aa9f-41ed-8887-f259a87b9faa tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:24.756417 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-054bff8f-aa9f-41ed-8887-f259a87b9faa tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: c4da9681-4d81-4ffb-8d7e-453436e71331] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:24.769357 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-054bff8f-aa9f-41ed-8887-f259a87b9faa tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:24.775446 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-054bff8f-aa9f-41ed-8887-f259a87b9faa tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:24.788485 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-054bff8f-aa9f-41ed-8887-f259a87b9faa tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:24.790563 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-054bff8f-aa9f-41ed-8887-f259a87b9faa tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:25.137933 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-423d8509-41ea-43bc-89fc-dadcf6507680 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:25.139150 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-423d8509-41ea-43bc-89fc-dadcf6507680 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: 06a478c3-f038-4813-a456-daf3a58b5749] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:25.155876 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-423d8509-41ea-43bc-89fc-dadcf6507680 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:25.158695 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-423d8509-41ea-43bc-89fc-dadcf6507680 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:25.159890 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-423d8509-41ea-43bc-89fc-dadcf6507680 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:25.160374 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-423d8509-41ea-43bc-89fc-dadcf6507680 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:25.172678 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-054bff8f-aa9f-41ed-8887-f259a87b9faa tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:25.183291 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-054bff8f-aa9f-41ed-8887-f259a87b9faa tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331" status: 200 len: 1508 microversion: 2.1 time: 0.431295 Jul 23 21:27:25.184642 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1769/3435] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:24 2022] GET /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331 => generated 1508 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:25.301357 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-cdee4089-6ef5-4003-b20e-01019645912b tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:25.302158 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-cdee4089-6ef5-4003-b20e-01019645912b tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] [instance: 297ef61b-a662-4d05-9fa6-55159b8b2dc7] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:25.317585 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cdee4089-6ef5-4003-b20e-01019645912b tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:25.319624 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cdee4089-6ef5-4003-b20e-01019645912b tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:25.321048 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cdee4089-6ef5-4003-b20e-01019645912b tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:25.325291 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cdee4089-6ef5-4003-b20e-01019645912b tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:25.519538 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-cdee4089-6ef5-4003-b20e-01019645912b tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dffbe88f71ae4f2180f89d18f234a016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a91417f3a6b47c7b1acc77c350a6aa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:25.542167 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-cdee4089-6ef5-4003-b20e-01019645912b tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dffbe88f71ae4f2180f89d18f234a016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a91417f3a6b47c7b1acc77c350a6aa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:25.552767 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-cdee4089-6ef5-4003-b20e-01019645912b tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dffbe88f71ae4f2180f89d18f234a016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a91417f3a6b47c7b1acc77c350a6aa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:25.555682 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-cdee4089-6ef5-4003-b20e-01019645912b tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] 10.222.0.17 "GET /compute/v2.1/servers/297ef61b-a662-4d05-9fa6-55159b8b2dc7" status: 200 len: 1366 microversion: 2.47 time: 0.261050 Jul 23 21:27:25.571104 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1770/3436] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:27:25 2022] GET /compute/v2.1/servers/297ef61b-a662-4d05-9fa6-55159b8b2dc7 => generated 1366 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:27:25.584439 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e93f887e-60b9-41c5-bff2-d67d8b019ea1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:25.585967 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-e93f887e-60b9-41c5-bff2-d67d8b019ea1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:25.595973 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-423d8509-41ea-43bc-89fc-dadcf6507680 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:25.603173 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e93f887e-60b9-41c5-bff2-d67d8b019ea1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:25.603829 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-423d8509-41ea-43bc-89fc-dadcf6507680 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/06a478c3-f038-4813-a456-daf3a58b5749" status: 200 len: 1517 microversion: 2.1 time: 0.471458 Jul 23 21:27:25.604724 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e93f887e-60b9-41c5-bff2-d67d8b019ea1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:25.606221 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e93f887e-60b9-41c5-bff2-d67d8b019ea1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:25.606811 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e93f887e-60b9-41c5-bff2-d67d8b019ea1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:25.609645 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1667/3437] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:25 2022] GET /compute/v2.1/servers/06a478c3-f038-4813-a456-daf3a58b5749 => generated 1517 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:25.615000 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c95ed4be-9aac-45aa-91e0-d16d101edda6 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:25.615626 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c95ed4be-9aac-45aa-91e0-d16d101edda6 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] [instance: d3d6b0e1-57fa-4247-bf6d-18c97aa22750] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:25.641976 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c95ed4be-9aac-45aa-91e0-d16d101edda6 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:25.642447 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c95ed4be-9aac-45aa-91e0-d16d101edda6 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:25.643258 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c95ed4be-9aac-45aa-91e0-d16d101edda6 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:25.643715 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c95ed4be-9aac-45aa-91e0-d16d101edda6 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:25.787639 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c95ed4be-9aac-45aa-91e0-d16d101edda6 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e11fb79c253c4a0f955d710ff4626f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b46cc4b1ef64d168bf4184339de54d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:25.807145 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c95ed4be-9aac-45aa-91e0-d16d101edda6 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] 10.222.0.17 "GET /compute/v2.1/servers/d3d6b0e1-57fa-4247-bf6d-18c97aa22750" status: 200 len: 1226 microversion: 2.1 time: 0.194720 Jul 23 21:27:25.809045 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1668/3438] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:25 2022] GET /compute/v2.1/servers/d3d6b0e1-57fa-4247-bf6d-18c97aa22750 => generated 1226 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:25.833071 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-e93f887e-60b9-41c5-bff2-d67d8b019ea1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:25.863052 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-e93f887e-60b9-41c5-bff2-d67d8b019ea1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:25.867704 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-e93f887e-60b9-41c5-bff2-d67d8b019ea1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:25.872982 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-e93f887e-60b9-41c5-bff2-d67d8b019ea1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.298058 Jul 23 21:27:25.873834 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1771/3439] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:27:25 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:27:26.211312 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-dcf0f1d8-d0d1-428c-8f44-185cda7ae9c2 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:26.213246 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-dcf0f1d8-d0d1-428c-8f44-185cda7ae9c2 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: c4da9681-4d81-4ffb-8d7e-453436e71331] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:26.221379 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dcf0f1d8-d0d1-428c-8f44-185cda7ae9c2 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:26.240812 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dcf0f1d8-d0d1-428c-8f44-185cda7ae9c2 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:26.241807 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dcf0f1d8-d0d1-428c-8f44-185cda7ae9c2 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:26.242572 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dcf0f1d8-d0d1-428c-8f44-185cda7ae9c2 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:26.556337 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-dcf0f1d8-d0d1-428c-8f44-185cda7ae9c2 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:26.564974 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-dcf0f1d8-d0d1-428c-8f44-185cda7ae9c2 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331" status: 200 len: 1508 microversion: 2.1 time: 0.357616 Jul 23 21:27:26.576440 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1669/3440] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:26 2022] GET /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331 => generated 1508 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:26.588411 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-1fc4a331-322b-46b1-a4b4-f99ac5041adc tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:26.590929 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-1fc4a331-322b-46b1-a4b4-f99ac5041adc tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] [instance: 297ef61b-a662-4d05-9fa6-55159b8b2dc7] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:26.602079 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1fc4a331-322b-46b1-a4b4-f99ac5041adc tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:26.603500 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1fc4a331-322b-46b1-a4b4-f99ac5041adc tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:26.604937 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1fc4a331-322b-46b1-a4b4-f99ac5041adc tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:26.610132 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1fc4a331-322b-46b1-a4b4-f99ac5041adc tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:26.623138 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f1a371cd-c50f-4f12-823e-f58062b124e2 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:26.623674 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f1a371cd-c50f-4f12-823e-f58062b124e2 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: 06a478c3-f038-4813-a456-daf3a58b5749] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:26.633697 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f1a371cd-c50f-4f12-823e-f58062b124e2 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:26.634322 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f1a371cd-c50f-4f12-823e-f58062b124e2 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:26.634955 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f1a371cd-c50f-4f12-823e-f58062b124e2 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:26.635391 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f1a371cd-c50f-4f12-823e-f58062b124e2 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:26.704715 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-1fc4a331-322b-46b1-a4b4-f99ac5041adc tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] HTTP exception thrown: Instance 297ef61b-a662-4d05-9fa6-55159b8b2dc7 could not be found. Jul 23 21:27:26.711926 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-1fc4a331-322b-46b1-a4b4-f99ac5041adc tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] Request method failure captured: Jul 23 21:27:26.711926 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/servers/297ef61b-a662-4d05-9fa6-55159b8b2dc7 HTTP/1.1 Jul 23 21:27:26.711926 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:27:26.711926 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:27:26.711926 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:27:26.711926 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:27:26.711926 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:27:26.711926 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:27:26.711926 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:27:26.711926 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:27:26.711926 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3Gey8bXXUiRi_nPGbNmkfJolMrvHNE3sBN47aDPOPbVuxWp1-1G6Y6epdzuBE4MYxLDwMjU09p21WynIhHxk30iV_7HAQ46aZ18w4foS1Wz3_XwEM5z23Q-kgtv4V4wby08Uqw1NcGHGD6h6rdfgLwVhpOHliryTBTfFvdCbCwIYJ64 Jul 23 21:27:26.711926 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:27:26.711926 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:27:26.711926 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:27:26.711926 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:27:26.711926 ncdv-master-1 devstack@n-api.service[131321]: X-Openstack-Nova-Api-Version: 2.47 Jul 23 21:27:26.711926 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:27:26.711926 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:27:26.711926 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 7a91417f3a6b47c7b1acc77c350a6aa2 Jul 23 21:27:26.711926 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ServersAaction247Test-938590045 Jul 23 21:27:26.711926 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:27:26.711926 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:27:26.711926 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7a91417f3a6b47c7b1acc77c350a6aa2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7a91417f3a6b47c7b1acc77c350a6aa2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_7a91417f3a6b47c7b1acc77c350a6aa2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/7a91417f3a6b47c7b1acc77c350a6aa2"}]}] Jul 23 21:27:26.711926 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ServersAaction247Test-938590045 Jul 23 21:27:26.711926 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 7a91417f3a6b47c7b1acc77c350a6aa2 Jul 23 21:27:26.711926 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ServersAaction247Test-938590045 Jul 23 21:27:26.711926 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ServersAaction247Test-938590045-project Jul 23 21:27:26.711926 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:27:26.711926 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:27:26.711926 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: dffbe88f71ae4f2180f89d18f234a016 Jul 23 21:27:26.711926 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ServersAaction247Test-938590045-project Jul 23 21:27:26.711926 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:27:26.711926 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance 297ef61b-a662-4d05-9fa6-55159b8b2dc7 could not be found. Jul 23 21:27:26.711926 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': '297ef61b-a662-4d05-9fa6-55159b8b2dc7'} Jul 23 21:27:26.711926 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:27:26.711926 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:27:26.711926 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:27:26.711926 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:27:26.711926 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:27:26.711926 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:27:26.711926 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:27:26.711926 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:27:26.711926 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:27:26.711926 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:27:26.711926 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 297ef61b-a662-4d05-9fa6-55159b8b2dc7 could not be found. Jul 23 21:27:26.711926 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:27:26.711926 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:27:26.711926 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:27:26.711926 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:27:26.711926 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:27:26.711926 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:27:26.711926 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:27:26.711926 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:27:26.711926 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:27:26.711926 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:27:26.711926 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:27:26.711926 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:27:26.711926 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:27:26.711926 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:27:26.711926 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:27:26.711926 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:27:26.711926 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 297ef61b-a662-4d05-9fa6-55159b8b2dc7 could not be found. Jul 23 21:27:26.711926 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:27:26.711926 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:27:26.711926 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:27:26.723639 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:27:26.723639 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:27:26.723639 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:27:26.723639 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:27:26.723639 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:27:26.723639 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 297ef61b-a662-4d05-9fa6-55159b8b2dc7 could not be found. Jul 23 21:27:26.723639 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:27:26.759881 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-1fc4a331-322b-46b1-a4b4-f99ac5041adc tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] Returning 404 to user: Instance 297ef61b-a662-4d05-9fa6-55159b8b2dc7 could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:27:26.761130 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-1fc4a331-322b-46b1-a4b4-f99ac5041adc tempest-ServersAaction247Test-938590045 tempest-ServersAaction247Test-938590045-project] 10.222.0.17 "GET /compute/v2.1/servers/297ef61b-a662-4d05-9fa6-55159b8b2dc7" status: 404 len: 111 microversion: 2.47 time: 0.187515 Jul 23 21:27:26.762422 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1772/3441] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:27:26 2022] GET /compute/v2.1/servers/297ef61b-a662-4d05-9fa6-55159b8b2dc7 => generated 111 bytes in 190 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 23 21:27:26.825549 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-98478853-211b-43ea-b8fa-5256c588b7bf tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:26.827636 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-98478853-211b-43ea-b8fa-5256c588b7bf tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] [instance: d3d6b0e1-57fa-4247-bf6d-18c97aa22750] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:26.853209 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-98478853-211b-43ea-b8fa-5256c588b7bf tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:26.853774 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-98478853-211b-43ea-b8fa-5256c588b7bf tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:26.860294 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-98478853-211b-43ea-b8fa-5256c588b7bf tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:26.863265 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-98478853-211b-43ea-b8fa-5256c588b7bf tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:27.003083 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f1a371cd-c50f-4f12-823e-f58062b124e2 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:27.014107 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f1a371cd-c50f-4f12-823e-f58062b124e2 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/06a478c3-f038-4813-a456-daf3a58b5749" status: 200 len: 1517 microversion: 2.1 time: 0.396417 Jul 23 21:27:27.015229 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1670/3442] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:26 2022] GET /compute/v2.1/servers/06a478c3-f038-4813-a456-daf3a58b5749 => generated 1517 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:27.023429 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-09a89c2b-9ec5-4ec0-a0ef-b07821d06635 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:27.024049 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-09a89c2b-9ec5-4ec0-a0ef-b07821d06635 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:27.067480 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-09a89c2b-9ec5-4ec0-a0ef-b07821d06635 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:27.067930 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-09a89c2b-9ec5-4ec0-a0ef-b07821d06635 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:27.074110 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-09a89c2b-9ec5-4ec0-a0ef-b07821d06635 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:27.074817 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-09a89c2b-9ec5-4ec0-a0ef-b07821d06635 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:27.255863 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-98478853-211b-43ea-b8fa-5256c588b7bf tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e11fb79c253c4a0f955d710ff4626f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b46cc4b1ef64d168bf4184339de54d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:27.267661 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-98478853-211b-43ea-b8fa-5256c588b7bf tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] 10.222.0.17 "GET /compute/v2.1/servers/d3d6b0e1-57fa-4247-bf6d-18c97aa22750" status: 200 len: 1292 microversion: 2.1 time: 0.446821 Jul 23 21:27:27.277674 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1773/3443] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:26 2022] GET /compute/v2.1/servers/d3d6b0e1-57fa-4247-bf6d-18c97aa22750 => generated 1292 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:27:27.365361 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-09a89c2b-9ec5-4ec0-a0ef-b07821d06635 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:27.391259 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-09a89c2b-9ec5-4ec0-a0ef-b07821d06635 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:27.396932 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-09a89c2b-9ec5-4ec0-a0ef-b07821d06635 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:27.401192 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-09a89c2b-9ec5-4ec0-a0ef-b07821d06635 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.384712 Jul 23 21:27:27.404100 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1671/3444] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:27:27 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:27:27.583817 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-9c9f2096-07ed-425c-9868-1fa892508567 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:27.584533 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-9c9f2096-07ed-425c-9868-1fa892508567 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: c4da9681-4d81-4ffb-8d7e-453436e71331] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:27.592885 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9c9f2096-07ed-425c-9868-1fa892508567 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:27.593532 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9c9f2096-07ed-425c-9868-1fa892508567 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:27.594149 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9c9f2096-07ed-425c-9868-1fa892508567 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:27.594594 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9c9f2096-07ed-425c-9868-1fa892508567 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:28.032659 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ad96d053-f9ac-4649-abc5-b22136989772 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:28.033495 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ad96d053-f9ac-4649-abc5-b22136989772 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: 06a478c3-f038-4813-a456-daf3a58b5749] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:28.044060 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ad96d053-f9ac-4649-abc5-b22136989772 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:28.044520 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ad96d053-f9ac-4649-abc5-b22136989772 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:28.052716 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ad96d053-f9ac-4649-abc5-b22136989772 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:28.053443 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ad96d053-f9ac-4649-abc5-b22136989772 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:28.113451 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-9c9f2096-07ed-425c-9868-1fa892508567 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:28.130482 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-9c9f2096-07ed-425c-9868-1fa892508567 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331" status: 200 len: 1508 microversion: 2.1 time: 0.550546 Jul 23 21:27:28.131091 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1774/3445] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:27 2022] GET /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331 => generated 1508 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:28.163223 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-589033e8-57d1-4fb5-94cb-96de4c345469 req-84eb8d5b-8a04-41da-906a-6aeb63358e42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63c3348d-dcf9-4e87-acfe-c7ab88796150", "tag": "0b5927e4-f75a-467a-a587-7ca2264cf2a2"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:27:28.190082 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-589033e8-57d1-4fb5-94cb-96de4c345469 req-84eb8d5b-8a04-41da-906a-6aeb63358e42 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:28.190603 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-589033e8-57d1-4fb5-94cb-96de4c345469 req-84eb8d5b-8a04-41da-906a-6aeb63358e42 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:28.195013 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=100 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:28.242033 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-589033e8-57d1-4fb5-94cb-96de4c345469 req-84eb8d5b-8a04-41da-906a-6aeb63358e42 service nova] Creating event network-changed:0b5927e4-f75a-467a-a587-7ca2264cf2a2 for instance 63c3348d-dcf9-4e87-acfe-c7ab88796150 on nch2-master-1 Jul 23 21:27:28.254151 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-589033e8-57d1-4fb5-94cb-96de4c345469 req-84eb8d5b-8a04-41da-906a-6aeb63358e42 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121771 Jul 23 21:27:28.269084 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1775/3446] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:27:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:27:28.285557 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a8c41d17-7847-4da4-90d3-0d476565211b tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:28.301928 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-a8c41d17-7847-4da4-90d3-0d476565211b tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] [instance: d3d6b0e1-57fa-4247-bf6d-18c97aa22750] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:28.322821 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a8c41d17-7847-4da4-90d3-0d476565211b tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:28.323401 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a8c41d17-7847-4da4-90d3-0d476565211b tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:28.325377 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a8c41d17-7847-4da4-90d3-0d476565211b tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:28.326812 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a8c41d17-7847-4da4-90d3-0d476565211b tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:28.602681 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-a8c41d17-7847-4da4-90d3-0d476565211b tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e11fb79c253c4a0f955d710ff4626f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b46cc4b1ef64d168bf4184339de54d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:28.611303 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-a8c41d17-7847-4da4-90d3-0d476565211b tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] 10.222.0.17 "GET /compute/v2.1/servers/d3d6b0e1-57fa-4247-bf6d-18c97aa22750" status: 200 len: 1322 microversion: 2.1 time: 0.330117 Jul 23 21:27:28.612684 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1776/3447] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:28 2022] GET /compute/v2.1/servers/d3d6b0e1-57fa-4247-bf6d-18c97aa22750 => generated 1322 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:28.628704 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-539ed7a3-ddc4-410b-8f38-f237ade15eb8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:28.629323 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-539ed7a3-ddc4-410b-8f38-f237ade15eb8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:28.635783 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-539ed7a3-ddc4-410b-8f38-f237ade15eb8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:28.636272 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-539ed7a3-ddc4-410b-8f38-f237ade15eb8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:28.637017 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-539ed7a3-ddc4-410b-8f38-f237ade15eb8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:28.637471 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-539ed7a3-ddc4-410b-8f38-f237ade15eb8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:28.661642 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ad96d053-f9ac-4649-abc5-b22136989772 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:28.677196 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ad96d053-f9ac-4649-abc5-b22136989772 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/06a478c3-f038-4813-a456-daf3a58b5749" status: 200 len: 1517 microversion: 2.1 time: 0.649534 Jul 23 21:27:28.680633 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1672/3448] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:28 2022] GET /compute/v2.1/servers/06a478c3-f038-4813-a456-daf3a58b5749 => generated 1517 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:28.761402 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-539ed7a3-ddc4-410b-8f38-f237ade15eb8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:28.779321 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-539ed7a3-ddc4-410b-8f38-f237ade15eb8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:28.782184 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-539ed7a3-ddc4-410b-8f38-f237ade15eb8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:28.784246 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-539ed7a3-ddc4-410b-8f38-f237ade15eb8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.170357 Jul 23 21:27:28.785378 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1777/3449] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:27:28 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:27:29.147992 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4a32a2b8-1b1c-4b1e-91f9-9f40dbd382e3 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:29.148572 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-4a32a2b8-1b1c-4b1e-91f9-9f40dbd382e3 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: c4da9681-4d81-4ffb-8d7e-453436e71331] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:29.160565 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4a32a2b8-1b1c-4b1e-91f9-9f40dbd382e3 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:29.161269 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4a32a2b8-1b1c-4b1e-91f9-9f40dbd382e3 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:29.162203 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4a32a2b8-1b1c-4b1e-91f9-9f40dbd382e3 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:29.163326 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4a32a2b8-1b1c-4b1e-91f9-9f40dbd382e3 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:29.350923 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-4a32a2b8-1b1c-4b1e-91f9-9f40dbd382e3 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:29.362507 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4a32a2b8-1b1c-4b1e-91f9-9f40dbd382e3 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331" status: 200 len: 1508 microversion: 2.1 time: 0.218540 Jul 23 21:27:29.364969 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1673/3450] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:29 2022] GET /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331 => generated 1508 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:27:29.555397 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-1d384607-d9a2-4d5a-bc67-7c913fb918dc req-9da857ae-1676-44b8-927c-466920af66c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3d6b0e1-57fa-4247-bf6d-18c97aa22750", "tag": "7cf9c3f5-8099-4bad-9bc9-d6b598d427b9"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:27:29.568745 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-1d384607-d9a2-4d5a-bc67-7c913fb918dc req-9da857ae-1676-44b8-927c-466920af66c2 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:29.569380 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-1d384607-d9a2-4d5a-bc67-7c913fb918dc req-9da857ae-1676-44b8-927c-466920af66c2 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:29.590995 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-1d384607-d9a2-4d5a-bc67-7c913fb918dc req-9da857ae-1676-44b8-927c-466920af66c2 service nova] Creating event network-changed:7cf9c3f5-8099-4bad-9bc9-d6b598d427b9 for instance d3d6b0e1-57fa-4247-bf6d-18c97aa22750 on nch1-master-1 Jul 23 21:27:29.602631 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-1d384607-d9a2-4d5a-bc67-7c913fb918dc req-9da857ae-1676-44b8-927c-466920af66c2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050429 Jul 23 21:27:29.608795 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1778/3451] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:27:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:27:29.628525 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2a1f5413-9b8e-413a-8cb1-ea5d18575d60 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:29.629176 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-2a1f5413-9b8e-413a-8cb1-ea5d18575d60 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] [instance: d3d6b0e1-57fa-4247-bf6d-18c97aa22750] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:29.636763 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2a1f5413-9b8e-413a-8cb1-ea5d18575d60 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:29.637941 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2a1f5413-9b8e-413a-8cb1-ea5d18575d60 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:29.638960 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2a1f5413-9b8e-413a-8cb1-ea5d18575d60 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:29.639619 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2a1f5413-9b8e-413a-8cb1-ea5d18575d60 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:29.698890 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f77034f1-71e1-4975-be6e-a480ac2c1286 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:29.700412 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-f77034f1-71e1-4975-be6e-a480ac2c1286 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: 06a478c3-f038-4813-a456-daf3a58b5749] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:29.711151 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f77034f1-71e1-4975-be6e-a480ac2c1286 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:29.712039 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f77034f1-71e1-4975-be6e-a480ac2c1286 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:29.713755 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f77034f1-71e1-4975-be6e-a480ac2c1286 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:29.715076 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f77034f1-71e1-4975-be6e-a480ac2c1286 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:29.883106 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-2a1f5413-9b8e-413a-8cb1-ea5d18575d60 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e11fb79c253c4a0f955d710ff4626f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b46cc4b1ef64d168bf4184339de54d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:29.890761 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2a1f5413-9b8e-413a-8cb1-ea5d18575d60 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] 10.222.0.17 "GET /compute/v2.1/servers/d3d6b0e1-57fa-4247-bf6d-18c97aa22750" status: 200 len: 1322 microversion: 2.1 time: 0.266100 Jul 23 21:27:29.894236 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1674/3452] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:29 2022] GET /compute/v2.1/servers/d3d6b0e1-57fa-4247-bf6d-18c97aa22750 => generated 1322 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:29.906312 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5de27c41-5cb7-4520-8135-d2eaa30dbd02 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:29.912986 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5de27c41-5cb7-4520-8135-d2eaa30dbd02 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:29.923340 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5de27c41-5cb7-4520-8135-d2eaa30dbd02 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:29.924079 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5de27c41-5cb7-4520-8135-d2eaa30dbd02 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:29.925499 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5de27c41-5cb7-4520-8135-d2eaa30dbd02 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:29.926873 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5de27c41-5cb7-4520-8135-d2eaa30dbd02 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:30.026248 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5de27c41-5cb7-4520-8135-d2eaa30dbd02 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:30.055492 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5de27c41-5cb7-4520-8135-d2eaa30dbd02 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:30.058435 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5de27c41-5cb7-4520-8135-d2eaa30dbd02 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:30.060305 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5de27c41-5cb7-4520-8135-d2eaa30dbd02 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.164109 Jul 23 21:27:30.060879 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1675/3453] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:27:29 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:27:30.135539 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-f77034f1-71e1-4975-be6e-a480ac2c1286 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:30.144762 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-f77034f1-71e1-4975-be6e-a480ac2c1286 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/06a478c3-f038-4813-a456-daf3a58b5749" status: 200 len: 1517 microversion: 2.1 time: 0.451746 Jul 23 21:27:30.155398 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1779/3454] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:29 2022] GET /compute/v2.1/servers/06a478c3-f038-4813-a456-daf3a58b5749 => generated 1517 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:30.386481 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6572c5c4-bf29-4610-bc57-986d1cc7ef60 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:30.387138 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6572c5c4-bf29-4610-bc57-986d1cc7ef60 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: c4da9681-4d81-4ffb-8d7e-453436e71331] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:30.399250 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6572c5c4-bf29-4610-bc57-986d1cc7ef60 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:30.399796 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6572c5c4-bf29-4610-bc57-986d1cc7ef60 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:30.400663 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6572c5c4-bf29-4610-bc57-986d1cc7ef60 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:30.401200 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6572c5c4-bf29-4610-bc57-986d1cc7ef60 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:30.915439 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-1ab008e3-41ef-4028-825c-a440e30406a8 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:30.916701 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-1ab008e3-41ef-4028-825c-a440e30406a8 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] [instance: d3d6b0e1-57fa-4247-bf6d-18c97aa22750] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:30.932162 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1ab008e3-41ef-4028-825c-a440e30406a8 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:30.933094 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1ab008e3-41ef-4028-825c-a440e30406a8 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:30.935503 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1ab008e3-41ef-4028-825c-a440e30406a8 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:30.936198 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1ab008e3-41ef-4028-825c-a440e30406a8 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:31.027559 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6572c5c4-bf29-4610-bc57-986d1cc7ef60 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:31.041226 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6572c5c4-bf29-4610-bc57-986d1cc7ef60 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331" status: 200 len: 1508 microversion: 2.1 time: 0.661427 Jul 23 21:27:31.042636 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1676/3455] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:30 2022] GET /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331 => generated 1508 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:31.081554 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a869cf53-adcf-4044-9ffc-9875c6b60ebe tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:31.082271 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a869cf53-adcf-4044-9ffc-9875c6b60ebe tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:31.095283 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a869cf53-adcf-4044-9ffc-9875c6b60ebe tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:31.095743 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a869cf53-adcf-4044-9ffc-9875c6b60ebe tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:31.103304 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a869cf53-adcf-4044-9ffc-9875c6b60ebe tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:31.103855 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a869cf53-adcf-4044-9ffc-9875c6b60ebe tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:31.274959 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a869cf53-adcf-4044-9ffc-9875c6b60ebe tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:31.288900 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a869cf53-adcf-4044-9ffc-9875c6b60ebe tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:31.290944 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a869cf53-adcf-4044-9ffc-9875c6b60ebe tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:31.292462 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a869cf53-adcf-4044-9ffc-9875c6b60ebe tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.215533 Jul 23 21:27:31.305097 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1677/3456] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:27:31 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:27:31.312473 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-eed439ae-dcb4-43cd-8136-f49211d6d3ab tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:31.313343 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-eed439ae-dcb4-43cd-8136-f49211d6d3ab tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: 06a478c3-f038-4813-a456-daf3a58b5749] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:31.323235 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-eed439ae-dcb4-43cd-8136-f49211d6d3ab tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:31.324013 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-eed439ae-dcb4-43cd-8136-f49211d6d3ab tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:31.324997 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-eed439ae-dcb4-43cd-8136-f49211d6d3ab tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:31.325628 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-eed439ae-dcb4-43cd-8136-f49211d6d3ab tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:31.436381 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-1ab008e3-41ef-4028-825c-a440e30406a8 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e11fb79c253c4a0f955d710ff4626f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b46cc4b1ef64d168bf4184339de54d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:31.445703 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-1ab008e3-41ef-4028-825c-a440e30406a8 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] 10.222.0.17 "GET /compute/v2.1/servers/d3d6b0e1-57fa-4247-bf6d-18c97aa22750" status: 200 len: 1322 microversion: 2.1 time: 0.540663 Jul 23 21:27:31.448228 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1780/3457] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:30 2022] GET /compute/v2.1/servers/d3d6b0e1-57fa-4247-bf6d-18c97aa22750 => generated 1322 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:31.617635 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-eed439ae-dcb4-43cd-8136-f49211d6d3ab tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:31.641904 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-eed439ae-dcb4-43cd-8136-f49211d6d3ab tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/06a478c3-f038-4813-a456-daf3a58b5749" status: 200 len: 1517 microversion: 2.1 time: 0.334777 Jul 23 21:27:31.642492 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1678/3458] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:31 2022] GET /compute/v2.1/servers/06a478c3-f038-4813-a456-daf3a58b5749 => generated 1517 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:32.060633 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-82acd8f1-dda1-47e6-8c94-6423de43f9d2 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:32.061153 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-82acd8f1-dda1-47e6-8c94-6423de43f9d2 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: c4da9681-4d81-4ffb-8d7e-453436e71331] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:32.068402 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-82acd8f1-dda1-47e6-8c94-6423de43f9d2 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:32.068927 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-82acd8f1-dda1-47e6-8c94-6423de43f9d2 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:32.069721 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-82acd8f1-dda1-47e6-8c94-6423de43f9d2 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:32.070361 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-82acd8f1-dda1-47e6-8c94-6423de43f9d2 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:32.312891 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e65ec5cc-d779-4089-94ab-2a96a0a3af32 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:32.313710 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e65ec5cc-d779-4089-94ab-2a96a0a3af32 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:32.320835 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e65ec5cc-d779-4089-94ab-2a96a0a3af32 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:32.321802 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e65ec5cc-d779-4089-94ab-2a96a0a3af32 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:32.322959 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e65ec5cc-d779-4089-94ab-2a96a0a3af32 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:32.323583 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e65ec5cc-d779-4089-94ab-2a96a0a3af32 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:32.383511 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-82acd8f1-dda1-47e6-8c94-6423de43f9d2 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:32.395691 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-82acd8f1-dda1-47e6-8c94-6423de43f9d2 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331" status: 200 len: 1508 microversion: 2.1 time: 0.340876 Jul 23 21:27:32.396298 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1781/3459] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:32 2022] GET /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331 => generated 1508 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:32.415240 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e65ec5cc-d779-4089-94ab-2a96a0a3af32 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:32.426887 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e65ec5cc-d779-4089-94ab-2a96a0a3af32 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:32.428440 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e65ec5cc-d779-4089-94ab-2a96a0a3af32 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:32.429640 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e65ec5cc-d779-4089-94ab-2a96a0a3af32 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.121766 Jul 23 21:27:32.430503 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1679/3460] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:27:32 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:27:32.467338 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-120e8ca6-f315-4c80-8be2-9c0a9f02d0df tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:32.469113 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-120e8ca6-f315-4c80-8be2-9c0a9f02d0df tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] [instance: d3d6b0e1-57fa-4247-bf6d-18c97aa22750] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:32.475467 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-120e8ca6-f315-4c80-8be2-9c0a9f02d0df tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:32.476222 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-120e8ca6-f315-4c80-8be2-9c0a9f02d0df tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:32.477228 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-120e8ca6-f315-4c80-8be2-9c0a9f02d0df tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:32.477906 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-120e8ca6-f315-4c80-8be2-9c0a9f02d0df tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:32.660048 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-020f0bcb-df66-4bd6-a83e-710a8d3eaf76 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:32.660695 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-020f0bcb-df66-4bd6-a83e-710a8d3eaf76 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: 06a478c3-f038-4813-a456-daf3a58b5749] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:32.672708 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-020f0bcb-df66-4bd6-a83e-710a8d3eaf76 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:32.683750 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-020f0bcb-df66-4bd6-a83e-710a8d3eaf76 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:32.685173 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-020f0bcb-df66-4bd6-a83e-710a8d3eaf76 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:32.686414 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-020f0bcb-df66-4bd6-a83e-710a8d3eaf76 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:32.753796 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-120e8ca6-f315-4c80-8be2-9c0a9f02d0df tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e11fb79c253c4a0f955d710ff4626f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b46cc4b1ef64d168bf4184339de54d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:32.771252 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-120e8ca6-f315-4c80-8be2-9c0a9f02d0df tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] 10.222.0.17 "GET /compute/v2.1/servers/d3d6b0e1-57fa-4247-bf6d-18c97aa22750" status: 200 len: 1322 microversion: 2.1 time: 0.307394 Jul 23 21:27:32.790396 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1782/3461] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:32 2022] GET /compute/v2.1/servers/d3d6b0e1-57fa-4247-bf6d-18c97aa22750 => generated 1322 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:32.881638 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-020f0bcb-df66-4bd6-a83e-710a8d3eaf76 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:32.891829 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-020f0bcb-df66-4bd6-a83e-710a8d3eaf76 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/06a478c3-f038-4813-a456-daf3a58b5749" status: 200 len: 1517 microversion: 2.1 time: 0.235860 Jul 23 21:27:32.893357 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1680/3462] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:32 2022] GET /compute/v2.1/servers/06a478c3-f038-4813-a456-daf3a58b5749 => generated 1517 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:33.149204 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-e24a8228-ac27-4361-b192-a0bb5ea1121f req-ef3ed5fc-0469-455d-a824-4d3a7ec18197 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63c3348d-dcf9-4e87-acfe-c7ab88796150", "name": "network-vif-plugged", "status": "completed", "tag": "0b5927e4-f75a-467a-a587-7ca2264cf2a2"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:27:33.157712 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell0:SELECT=6 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:33.160108 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell0:SELECT=14 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:33.169610 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-e24a8228-ac27-4361-b192-a0bb5ea1121f req-ef3ed5fc-0469-455d-a824-4d3a7ec18197 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:33.170990 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-e24a8228-ac27-4361-b192-a0bb5ea1121f req-ef3ed5fc-0469-455d-a824-4d3a7ec18197 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:33.187528 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-e24a8228-ac27-4361-b192-a0bb5ea1121f req-ef3ed5fc-0469-455d-a824-4d3a7ec18197 service nova] Creating event network-vif-plugged:0b5927e4-f75a-467a-a587-7ca2264cf2a2 for instance 63c3348d-dcf9-4e87-acfe-c7ab88796150 on nch2-master-1 Jul 23 21:27:33.195729 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-e24a8228-ac27-4361-b192-a0bb5ea1121f req-ef3ed5fc-0469-455d-a824-4d3a7ec18197 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050661 Jul 23 21:27:33.196679 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1783/3463] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:27:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:27:33.416735 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b5bcd360-7db3-4486-81bb-dc0e1d6d0d67 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:33.417710 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b5bcd360-7db3-4486-81bb-dc0e1d6d0d67 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: c4da9681-4d81-4ffb-8d7e-453436e71331] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:33.437076 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b5bcd360-7db3-4486-81bb-dc0e1d6d0d67 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:33.438356 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b5bcd360-7db3-4486-81bb-dc0e1d6d0d67 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:33.441677 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b5bcd360-7db3-4486-81bb-dc0e1d6d0d67 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:33.442903 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b5bcd360-7db3-4486-81bb-dc0e1d6d0d67 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:33.450055 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-27a4d978-f218-4088-8ef2-2007c198096e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:33.451055 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-27a4d978-f218-4088-8ef2-2007c198096e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:33.466893 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-27a4d978-f218-4088-8ef2-2007c198096e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:33.467730 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-27a4d978-f218-4088-8ef2-2007c198096e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:33.468923 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-27a4d978-f218-4088-8ef2-2007c198096e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:33.470043 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-27a4d978-f218-4088-8ef2-2007c198096e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:33.599629 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-27a4d978-f218-4088-8ef2-2007c198096e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:33.623234 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-27a4d978-f218-4088-8ef2-2007c198096e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:33.625330 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-27a4d978-f218-4088-8ef2-2007c198096e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:33.627122 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-27a4d978-f218-4088-8ef2-2007c198096e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.181910 Jul 23 21:27:33.628054 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1784/3464] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:27:33 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:27:33.709094 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b5bcd360-7db3-4486-81bb-dc0e1d6d0d67 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:33.719976 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b5bcd360-7db3-4486-81bb-dc0e1d6d0d67 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331" status: 200 len: 1508 microversion: 2.1 time: 0.311233 Jul 23 21:27:33.724207 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1681/3465] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:33 2022] GET /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331 => generated 1508 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:33.789627 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-aa2d3854-dd9b-4f1e-aab2-fc8c10d5bb06 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:33.790892 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-aa2d3854-dd9b-4f1e-aab2-fc8c10d5bb06 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] [instance: d3d6b0e1-57fa-4247-bf6d-18c97aa22750] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:33.798436 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-aa2d3854-dd9b-4f1e-aab2-fc8c10d5bb06 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:33.799315 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-aa2d3854-dd9b-4f1e-aab2-fc8c10d5bb06 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:33.800633 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-aa2d3854-dd9b-4f1e-aab2-fc8c10d5bb06 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:33.802674 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-aa2d3854-dd9b-4f1e-aab2-fc8c10d5bb06 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:33.912745 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-863a958a-fcfc-45ff-aa1f-17b798ee92d6 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:33.913438 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-863a958a-fcfc-45ff-aa1f-17b798ee92d6 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: 06a478c3-f038-4813-a456-daf3a58b5749] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:33.923995 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-863a958a-fcfc-45ff-aa1f-17b798ee92d6 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:33.924789 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-863a958a-fcfc-45ff-aa1f-17b798ee92d6 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:33.929801 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-863a958a-fcfc-45ff-aa1f-17b798ee92d6 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:33.930519 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-863a958a-fcfc-45ff-aa1f-17b798ee92d6 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:33.940575 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=100 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:34.072495 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-aa2d3854-dd9b-4f1e-aab2-fc8c10d5bb06 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e11fb79c253c4a0f955d710ff4626f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b46cc4b1ef64d168bf4184339de54d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:34.080333 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-aa2d3854-dd9b-4f1e-aab2-fc8c10d5bb06 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] 10.222.0.17 "GET /compute/v2.1/servers/d3d6b0e1-57fa-4247-bf6d-18c97aa22750" status: 200 len: 1322 microversion: 2.1 time: 0.295414 Jul 23 21:27:34.090057 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1785/3466] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:33 2022] GET /compute/v2.1/servers/d3d6b0e1-57fa-4247-bf6d-18c97aa22750 => generated 1322 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:34.150387 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-863a958a-fcfc-45ff-aa1f-17b798ee92d6 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:34.162847 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-863a958a-fcfc-45ff-aa1f-17b798ee92d6 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/06a478c3-f038-4813-a456-daf3a58b5749" status: 200 len: 1517 microversion: 2.1 time: 0.255007 Jul 23 21:27:34.163769 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1682/3467] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:33 2022] GET /compute/v2.1/servers/06a478c3-f038-4813-a456-daf3a58b5749 => generated 1517 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:34.648977 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-b6435d5d-3cb9-4a70-9dad-2b2c3c10e81a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:34.650243 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-b6435d5d-3cb9-4a70-9dad-2b2c3c10e81a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:34.658155 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b6435d5d-3cb9-4a70-9dad-2b2c3c10e81a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:34.658905 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b6435d5d-3cb9-4a70-9dad-2b2c3c10e81a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:34.659872 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b6435d5d-3cb9-4a70-9dad-2b2c3c10e81a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:34.660503 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b6435d5d-3cb9-4a70-9dad-2b2c3c10e81a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:34.741797 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-35e7e786-b293-48c7-8915-25958e3c9ea3 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:34.742395 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-35e7e786-b293-48c7-8915-25958e3c9ea3 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: c4da9681-4d81-4ffb-8d7e-453436e71331] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:34.753337 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:34.758253 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=10 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:34.763369 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-35e7e786-b293-48c7-8915-25958e3c9ea3 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:34.763898 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-35e7e786-b293-48c7-8915-25958e3c9ea3 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:34.766789 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-35e7e786-b293-48c7-8915-25958e3c9ea3 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:34.767259 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-35e7e786-b293-48c7-8915-25958e3c9ea3 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:34.849644 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-b6435d5d-3cb9-4a70-9dad-2b2c3c10e81a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:34.864737 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-b6435d5d-3cb9-4a70-9dad-2b2c3c10e81a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:34.866452 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-b6435d5d-3cb9-4a70-9dad-2b2c3c10e81a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:34.868222 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-b6435d5d-3cb9-4a70-9dad-2b2c3c10e81a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.223609 Jul 23 21:27:34.872358 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1786/3468] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:27:34 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:27:34.992275 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-35e7e786-b293-48c7-8915-25958e3c9ea3 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:35.003627 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-35e7e786-b293-48c7-8915-25958e3c9ea3 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331" status: 200 len: 1508 microversion: 2.1 time: 0.266371 Jul 23 21:27:35.004791 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1683/3469] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:34 2022] GET /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331 => generated 1508 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:35.102785 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-5e534234-9a00-4139-b515-01d7a869e03a tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:35.103416 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-5e534234-9a00-4139-b515-01d7a869e03a tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] [instance: d3d6b0e1-57fa-4247-bf6d-18c97aa22750] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:35.105439 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:35.116656 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5e534234-9a00-4139-b515-01d7a869e03a tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:35.120663 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5e534234-9a00-4139-b515-01d7a869e03a tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:35.121841 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5e534234-9a00-4139-b515-01d7a869e03a tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:35.124425 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5e534234-9a00-4139-b515-01d7a869e03a tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:35.180285 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-554d0943-c468-4303-8609-661e226c4341 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:35.181312 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-554d0943-c468-4303-8609-661e226c4341 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: 06a478c3-f038-4813-a456-daf3a58b5749] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:35.188204 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-554d0943-c468-4303-8609-661e226c4341 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:35.188927 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-554d0943-c468-4303-8609-661e226c4341 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:35.189996 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-554d0943-c468-4303-8609-661e226c4341 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:35.190614 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-554d0943-c468-4303-8609-661e226c4341 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:35.354976 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-554d0943-c468-4303-8609-661e226c4341 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:35.365813 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-554d0943-c468-4303-8609-661e226c4341 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/06a478c3-f038-4813-a456-daf3a58b5749" status: 200 len: 1523 microversion: 2.1 time: 0.189480 Jul 23 21:27:35.366740 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1684/3470] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:35 2022] GET /compute/v2.1/servers/06a478c3-f038-4813-a456-daf3a58b5749 => generated 1523 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:27:35.486458 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-5e534234-9a00-4139-b515-01d7a869e03a tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e11fb79c253c4a0f955d710ff4626f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b46cc4b1ef64d168bf4184339de54d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:35.497387 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-5e534234-9a00-4139-b515-01d7a869e03a tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] 10.222.0.17 "GET /compute/v2.1/servers/d3d6b0e1-57fa-4247-bf6d-18c97aa22750" status: 200 len: 1322 microversion: 2.1 time: 0.398572 Jul 23 21:27:35.498664 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1787/3471] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:35 2022] GET /compute/v2.1/servers/d3d6b0e1-57fa-4247-bf6d-18c97aa22750 => generated 1322 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:35.841242 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-d3e16975-4157-4407-9d80-72b96f20c14e req-a69d280b-7117-4ee7-a5f6-ea42dee1e01b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3d6b0e1-57fa-4247-bf6d-18c97aa22750", "name": "network-vif-plugged", "status": "completed", "tag": "7cf9c3f5-8099-4bad-9bc9-d6b598d427b9"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:27:35.859240 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-d3e16975-4157-4407-9d80-72b96f20c14e req-a69d280b-7117-4ee7-a5f6-ea42dee1e01b service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:35.860874 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-d3e16975-4157-4407-9d80-72b96f20c14e req-a69d280b-7117-4ee7-a5f6-ea42dee1e01b service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:35.890694 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-d3e16975-4157-4407-9d80-72b96f20c14e req-a69d280b-7117-4ee7-a5f6-ea42dee1e01b service nova] Creating event network-vif-plugged:7cf9c3f5-8099-4bad-9bc9-d6b598d427b9 for instance d3d6b0e1-57fa-4247-bf6d-18c97aa22750 on nch1-master-1 Jul 23 21:27:35.893557 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d1c0b904-0e3f-4838-9651-b6b22058296d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:35.895345 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-d1c0b904-0e3f-4838-9651-b6b22058296d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:35.908813 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-d3e16975-4157-4407-9d80-72b96f20c14e req-a69d280b-7117-4ee7-a5f6-ea42dee1e01b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072172 Jul 23 21:27:35.910242 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1685/3472] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:27:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:27:35.911595 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d1c0b904-0e3f-4838-9651-b6b22058296d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:35.912767 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d1c0b904-0e3f-4838-9651-b6b22058296d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:35.920212 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d1c0b904-0e3f-4838-9651-b6b22058296d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:35.920435 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d1c0b904-0e3f-4838-9651-b6b22058296d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:36.021261 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-bf49f12b-1fc5-40fc-88a3-c09bd2e280b5 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:36.022182 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-bf49f12b-1fc5-40fc-88a3-c09bd2e280b5 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: c4da9681-4d81-4ffb-8d7e-453436e71331] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:36.044224 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bf49f12b-1fc5-40fc-88a3-c09bd2e280b5 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:36.044701 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bf49f12b-1fc5-40fc-88a3-c09bd2e280b5 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:36.045540 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bf49f12b-1fc5-40fc-88a3-c09bd2e280b5 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:36.046020 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bf49f12b-1fc5-40fc-88a3-c09bd2e280b5 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:36.198348 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-d1c0b904-0e3f-4838-9651-b6b22058296d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:36.223365 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-d1c0b904-0e3f-4838-9651-b6b22058296d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:36.230283 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-d1c0b904-0e3f-4838-9651-b6b22058296d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:36.235332 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-d1c0b904-0e3f-4838-9651-b6b22058296d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.346768 Jul 23 21:27:36.239192 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1788/3473] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:27:35 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:27:36.339693 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-bf49f12b-1fc5-40fc-88a3-c09bd2e280b5 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:36.351186 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-bf49f12b-1fc5-40fc-88a3-c09bd2e280b5 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331" status: 200 len: 1508 microversion: 2.1 time: 0.330961 Jul 23 21:27:36.351999 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1686/3474] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:36 2022] GET /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331 => generated 1508 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:27:36.384726 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-1164186a-88e9-4802-9cf3-38bd48107a2c tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:36.385687 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-1164186a-88e9-4802-9cf3-38bd48107a2c tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: 06a478c3-f038-4813-a456-daf3a58b5749] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:36.392996 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1164186a-88e9-4802-9cf3-38bd48107a2c tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:36.393705 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1164186a-88e9-4802-9cf3-38bd48107a2c tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:36.394671 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1164186a-88e9-4802-9cf3-38bd48107a2c tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:36.395588 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1164186a-88e9-4802-9cf3-38bd48107a2c tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:36.514496 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1754a659-e964-43a9-86b0-04b73c39e6c3 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:36.518436 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1754a659-e964-43a9-86b0-04b73c39e6c3 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] [instance: d3d6b0e1-57fa-4247-bf6d-18c97aa22750] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:36.526050 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1754a659-e964-43a9-86b0-04b73c39e6c3 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:36.531263 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1754a659-e964-43a9-86b0-04b73c39e6c3 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:36.532668 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1754a659-e964-43a9-86b0-04b73c39e6c3 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:36.533551 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1754a659-e964-43a9-86b0-04b73c39e6c3 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:36.640280 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-1164186a-88e9-4802-9cf3-38bd48107a2c tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:36.651396 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-1164186a-88e9-4802-9cf3-38bd48107a2c tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/06a478c3-f038-4813-a456-daf3a58b5749" status: 200 len: 1523 microversion: 2.1 time: 0.268110 Jul 23 21:27:36.651957 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1789/3475] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:36 2022] GET /compute/v2.1/servers/06a478c3-f038-4813-a456-daf3a58b5749 => generated 1523 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:36.704133 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-1754a659-e964-43a9-86b0-04b73c39e6c3 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e11fb79c253c4a0f955d710ff4626f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b46cc4b1ef64d168bf4184339de54d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:36.714047 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1754a659-e964-43a9-86b0-04b73c39e6c3 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] 10.222.0.17 "GET /compute/v2.1/servers/d3d6b0e1-57fa-4247-bf6d-18c97aa22750" status: 200 len: 1322 microversion: 2.1 time: 0.203303 Jul 23 21:27:36.715640 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1687/3476] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:36 2022] GET /compute/v2.1/servers/d3d6b0e1-57fa-4247-bf6d-18c97aa22750 => generated 1322 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:27:37.257072 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-bc0bd345-055c-4124-8659-f119d21582ed tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:37.258565 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-bc0bd345-055c-4124-8659-f119d21582ed tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:37.268968 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bc0bd345-055c-4124-8659-f119d21582ed tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:37.270284 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bc0bd345-055c-4124-8659-f119d21582ed tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:37.271404 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bc0bd345-055c-4124-8659-f119d21582ed tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:37.271852 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bc0bd345-055c-4124-8659-f119d21582ed tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:37.356962 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-bc0bd345-055c-4124-8659-f119d21582ed tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:37.368925 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d60f3af7-b597-46e9-84d6-b15482a6f0da tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:37.369573 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d60f3af7-b597-46e9-84d6-b15482a6f0da tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: c4da9681-4d81-4ffb-8d7e-453436e71331] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:37.376737 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-bc0bd345-055c-4124-8659-f119d21582ed tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:37.378822 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-bc0bd345-055c-4124-8659-f119d21582ed tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:37.387377 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d60f3af7-b597-46e9-84d6-b15482a6f0da tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:37.387856 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-bc0bd345-055c-4124-8659-f119d21582ed tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.134203 Jul 23 21:27:37.387999 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d60f3af7-b597-46e9-84d6-b15482a6f0da tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:37.389043 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d60f3af7-b597-46e9-84d6-b15482a6f0da tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:37.389492 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d60f3af7-b597-46e9-84d6-b15482a6f0da tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:37.390592 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1790/3477] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:27:37 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:27:37.624240 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d60f3af7-b597-46e9-84d6-b15482a6f0da tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:37.638224 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d60f3af7-b597-46e9-84d6-b15482a6f0da tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331" status: 200 len: 1508 microversion: 2.1 time: 0.272888 Jul 23 21:27:37.651094 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1688/3478] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:37 2022] GET /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331 => generated 1508 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:27:37.669944 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1360246d-49bf-4bfa-bc14-d4f16acf482b tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:37.670897 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1360246d-49bf-4bfa-bc14-d4f16acf482b tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: 06a478c3-f038-4813-a456-daf3a58b5749] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:37.690301 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1360246d-49bf-4bfa-bc14-d4f16acf482b tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:37.691270 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1360246d-49bf-4bfa-bc14-d4f16acf482b tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:37.692265 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1360246d-49bf-4bfa-bc14-d4f16acf482b tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:37.693053 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1360246d-49bf-4bfa-bc14-d4f16acf482b tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:37.779950 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c899e0b6-a2fb-451a-9305-f9c1e3aa35b4 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-1842993474", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "networks": [{"uuid": "ae3c96b5-c6c0-4656-88a1-aa751efece6d"}]}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:27:37.922411 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.network.neutron [None req-c899e0b6-a2fb-451a-9305-f9c1e3aa35b4 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] validate_networks() for [('ae3c96b5-c6c0-4656-88a1-aa751efece6d', None, None, None, None, None)] {{(pid=131321) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:27:37.934922 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-1360246d-49bf-4bfa-bc14-d4f16acf482b tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:37.944329 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1360246d-49bf-4bfa-bc14-d4f16acf482b tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/06a478c3-f038-4813-a456-daf3a58b5749" status: 200 len: 1523 microversion: 2.1 time: 0.279233 Jul 23 21:27:37.946716 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1689/3479] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:37 2022] GET /compute/v2.1/servers/06a478c3-f038-4813-a456-daf3a58b5749 => generated 1523 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:27:37.965920 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f71daea1-04ce-4d08-8968-681db5f3c376 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:37.966944 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f71daea1-04ce-4d08-8968-681db5f3c376 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] [instance: d3d6b0e1-57fa-4247-bf6d-18c97aa22750] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:37.975394 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f71daea1-04ce-4d08-8968-681db5f3c376 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:37.976081 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f71daea1-04ce-4d08-8968-681db5f3c376 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:37.977120 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f71daea1-04ce-4d08-8968-681db5f3c376 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:37.977952 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f71daea1-04ce-4d08-8968-681db5f3c376 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:38.184660 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f71daea1-04ce-4d08-8968-681db5f3c376 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e11fb79c253c4a0f955d710ff4626f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b46cc4b1ef64d168bf4184339de54d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:38.193252 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f71daea1-04ce-4d08-8968-681db5f3c376 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] 10.222.0.17 "GET /compute/v2.1/servers/d3d6b0e1-57fa-4247-bf6d-18c97aa22750" status: 200 len: 1516 microversion: 2.1 time: 0.244072 Jul 23 21:27:38.194165 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1690/3480] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:37 2022] GET /compute/v2.1/servers/d3d6b0e1-57fa-4247-bf6d-18c97aa22750 => generated 1516 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:38.211149 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2ad2a9be-6441-4c23-ab8b-731e514b078a tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:27:38.212653 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-2ad2a9be-6441-4c23-ab8b-731e514b078a tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] [instance: d3d6b0e1-57fa-4247-bf6d-18c97aa22750] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:38.220439 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2ad2a9be-6441-4c23-ab8b-731e514b078a tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:38.221233 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2ad2a9be-6441-4c23-ab8b-731e514b078a tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:38.222417 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2ad2a9be-6441-4c23-ab8b-731e514b078a tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:38.223074 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2ad2a9be-6441-4c23-ab8b-731e514b078a tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:38.249208 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.objects.instance [None req-2ad2a9be-6441-4c23-ab8b-731e514b078a tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lazy-loading 'flavor' on Instance uuid d3d6b0e1-57fa-4247-bf6d-18c97aa22750 {{(pid=131320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:27:38.342750 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2ad2a9be-6441-4c23-ab8b-731e514b078a tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] 10.222.0.17 "POST /compute/v2.1/servers/d3d6b0e1-57fa-4247-bf6d-18c97aa22750/action" status: 200 len: 32 microversion: 2.1 time: 0.136783 Jul 23 21:27:38.348019 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1691/3481] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:27:38 2022] POST /compute/v2.1/servers/d3d6b0e1-57fa-4247-bf6d-18c97aa22750/action => generated 32 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 23 21:27:38.364975 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d74c9d9c-23bb-4efa-901e-d46d9aae1be9 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:38.367198 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d74c9d9c-23bb-4efa-901e-d46d9aae1be9 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] [instance: d3d6b0e1-57fa-4247-bf6d-18c97aa22750] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:38.377684 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d74c9d9c-23bb-4efa-901e-d46d9aae1be9 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:38.378634 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d74c9d9c-23bb-4efa-901e-d46d9aae1be9 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:38.379612 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d74c9d9c-23bb-4efa-901e-d46d9aae1be9 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:38.380855 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d74c9d9c-23bb-4efa-901e-d46d9aae1be9 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:38.425202 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-c899e0b6-a2fb-451a-9305-f9c1e3aa35b4 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Flavor limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:27:38.425680 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-c899e0b6-a2fb-451a-9305-f9c1e3aa35b4 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Image limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:27:38.426487 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-c899e0b6-a2fb-451a-9305-f9c1e3aa35b4 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Flavor pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:27:38.427903 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-c899e0b6-a2fb-451a-9305-f9c1e3aa35b4 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Image pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:27:38.428454 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-c899e0b6-a2fb-451a-9305-f9c1e3aa35b4 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:27:38.441306 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c899e0b6-a2fb-451a-9305-f9c1e3aa35b4 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:38.441889 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c899e0b6-a2fb-451a-9305-f9c1e3aa35b4 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:38.442736 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c899e0b6-a2fb-451a-9305-f9c1e3aa35b4 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:38.443180 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c899e0b6-a2fb-451a-9305-f9c1e3aa35b4 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:38.462431 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-c899e0b6-a2fb-451a-9305-f9c1e3aa35b4 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Getting quotas for project 0c005e3bc67b4501949fb72140726a11. Resources: {'ram', 'instances', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:27:38.468620 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-c899e0b6-a2fb-451a-9305-f9c1e3aa35b4 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Getting quotas for user 6411b0f635714320a4f40e9bc5e260e5 and project 0c005e3bc67b4501949fb72140726a11. Resources: {'ram', 'instances', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:27:38.500333 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-c899e0b6-a2fb-451a-9305-f9c1e3aa35b4 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Going to run 1 instances... {{(pid=131321) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:27:38.502962 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-c899e0b6-a2fb-451a-9305-f9c1e3aa35b4 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] [instance: 1516f44b-afba-4f88-ab56-c1f2fb68c74e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131321) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:27:38.574515 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-c899e0b6-a2fb-451a-9305-f9c1e3aa35b4 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.001251 Jul 23 21:27:38.580542 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1791/3482] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:27:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1008 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 23 21:27:38.586595 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c2e231dd-d84d-42c1-a66f-0b79d8b14204 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:38.588111 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-c2e231dd-d84d-42c1-a66f-0b79d8b14204 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:38.610730 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c2e231dd-d84d-42c1-a66f-0b79d8b14204 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:38.614851 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c2e231dd-d84d-42c1-a66f-0b79d8b14204 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:38.616329 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c2e231dd-d84d-42c1-a66f-0b79d8b14204 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:38.617172 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c2e231dd-d84d-42c1-a66f-0b79d8b14204 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:38.626228 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d74c9d9c-23bb-4efa-901e-d46d9aae1be9 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e11fb79c253c4a0f955d710ff4626f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b46cc4b1ef64d168bf4184339de54d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:38.638272 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d74c9d9c-23bb-4efa-901e-d46d9aae1be9 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] 10.222.0.17 "GET /compute/v2.1/servers/d3d6b0e1-57fa-4247-bf6d-18c97aa22750" status: 200 len: 1522 microversion: 2.1 time: 0.288119 Jul 23 21:27:38.639845 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1692/3483] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:38 2022] GET /compute/v2.1/servers/d3d6b0e1-57fa-4247-bf6d-18c97aa22750 => generated 1522 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:38.654585 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c5573522-9865-4456-9178-515af5fee8f0 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:38.656992 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c5573522-9865-4456-9178-515af5fee8f0 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] [instance: 1516f44b-afba-4f88-ab56-c1f2fb68c74e] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:38.746886 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c5573522-9865-4456-9178-515af5fee8f0 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6411b0f635714320a4f40e9bc5e260e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c005e3bc67b4501949fb72140726a11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:38.756730 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c5573522-9865-4456-9178-515af5fee8f0 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] 10.222.0.17 "GET /compute/v2.1/servers/1516f44b-afba-4f88-ab56-c1f2fb68c74e" status: 200 len: 1217 microversion: 2.1 time: 0.111358 Jul 23 21:27:38.757797 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1693/3484] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:38 2022] GET /compute/v2.1/servers/1516f44b-afba-4f88-ab56-c1f2fb68c74e => generated 1217 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:38.769546 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-34e842d0-02c9-4cdf-ab1e-3cab76f3c6dc tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:38.770562 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-34e842d0-02c9-4cdf-ab1e-3cab76f3c6dc tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: c4da9681-4d81-4ffb-8d7e-453436e71331] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:38.780973 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c2e231dd-d84d-42c1-a66f-0b79d8b14204 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:38.792514 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c2e231dd-d84d-42c1-a66f-0b79d8b14204 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:38.794044 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c2e231dd-d84d-42c1-a66f-0b79d8b14204 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:38.795279 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-c2e231dd-d84d-42c1-a66f-0b79d8b14204 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.213383 Jul 23 21:27:38.797344 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-34e842d0-02c9-4cdf-ab1e-3cab76f3c6dc tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:38.798081 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-34e842d0-02c9-4cdf-ab1e-3cab76f3c6dc tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:38.799038 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-34e842d0-02c9-4cdf-ab1e-3cab76f3c6dc tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:38.799635 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-34e842d0-02c9-4cdf-ab1e-3cab76f3c6dc tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:38.804314 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1792/3485] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:27:38 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:27:38.962726 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-7b2c3256-f71b-4906-ab1a-2795021c3d50 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:38.963694 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-7b2c3256-f71b-4906-ab1a-2795021c3d50 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: 06a478c3-f038-4813-a456-daf3a58b5749] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:38.977091 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-34e842d0-02c9-4cdf-ab1e-3cab76f3c6dc tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:38.979129 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7b2c3256-f71b-4906-ab1a-2795021c3d50 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:38.980585 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7b2c3256-f71b-4906-ab1a-2795021c3d50 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:38.986748 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7b2c3256-f71b-4906-ab1a-2795021c3d50 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:38.987202 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7b2c3256-f71b-4906-ab1a-2795021c3d50 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:38.987817 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-34e842d0-02c9-4cdf-ab1e-3cab76f3c6dc tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331" status: 200 len: 1508 microversion: 2.1 time: 0.228126 Jul 23 21:27:38.989269 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1694/3486] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:38 2022] GET /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331 => generated 1508 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:39.209525 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-0af17477-ffaa-48e6-a19e-e3cea8d9eecb req-b25abe2a-564b-419a-a78c-0456272edec6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06a478c3-f038-4813-a456-daf3a58b5749", "name": "network-vif-plugged", "status": "completed", "tag": "661b9337-be92-4f83-a6f7-6a98a2b053db"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:27:39.228639 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-0af17477-ffaa-48e6-a19e-e3cea8d9eecb req-b25abe2a-564b-419a-a78c-0456272edec6 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:39.229498 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-0af17477-ffaa-48e6-a19e-e3cea8d9eecb req-b25abe2a-564b-419a-a78c-0456272edec6 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:39.262123 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-0af17477-ffaa-48e6-a19e-e3cea8d9eecb req-b25abe2a-564b-419a-a78c-0456272edec6 service nova] Creating event network-vif-plugged:661b9337-be92-4f83-a6f7-6a98a2b053db for instance 06a478c3-f038-4813-a456-daf3a58b5749 on nch2-master-1 Jul 23 21:27:39.274068 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-0af17477-ffaa-48e6-a19e-e3cea8d9eecb req-b25abe2a-564b-419a-a78c-0456272edec6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068429 Jul 23 21:27:39.275860 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1695/3487] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:27:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:27:39.387552 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-7b2c3256-f71b-4906-ab1a-2795021c3d50 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:39.399528 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-7b2c3256-f71b-4906-ab1a-2795021c3d50 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/06a478c3-f038-4813-a456-daf3a58b5749" status: 200 len: 1523 microversion: 2.1 time: 0.442214 Jul 23 21:27:39.410766 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1793/3488] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:38 2022] GET /compute/v2.1/servers/06a478c3-f038-4813-a456-daf3a58b5749 => generated 1523 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:27:39.667001 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-668b8b4d-bca4-4577-9030-6855693e1411 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:39.667750 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-668b8b4d-bca4-4577-9030-6855693e1411 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] [instance: d3d6b0e1-57fa-4247-bf6d-18c97aa22750] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:39.674984 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-668b8b4d-bca4-4577-9030-6855693e1411 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:39.675450 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-668b8b4d-bca4-4577-9030-6855693e1411 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:39.676320 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-668b8b4d-bca4-4577-9030-6855693e1411 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:39.676765 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-668b8b4d-bca4-4577-9030-6855693e1411 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:39.777930 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c325ee0f-cb3a-4c7e-b9ed-92e809163e50 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:39.779283 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-c325ee0f-cb3a-4c7e-b9ed-92e809163e50 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] [instance: 1516f44b-afba-4f88-ab56-c1f2fb68c74e] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:39.787453 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c325ee0f-cb3a-4c7e-b9ed-92e809163e50 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:39.787978 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c325ee0f-cb3a-4c7e-b9ed-92e809163e50 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:39.788971 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c325ee0f-cb3a-4c7e-b9ed-92e809163e50 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:39.789414 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c325ee0f-cb3a-4c7e-b9ed-92e809163e50 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:39.810409 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=100 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:39.866256 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-668b8b4d-bca4-4577-9030-6855693e1411 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e11fb79c253c4a0f955d710ff4626f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b46cc4b1ef64d168bf4184339de54d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:39.877779 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-668b8b4d-bca4-4577-9030-6855693e1411 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] 10.222.0.17 "GET /compute/v2.1/servers/d3d6b0e1-57fa-4247-bf6d-18c97aa22750" status: 200 len: 1522 microversion: 2.1 time: 0.216153 Jul 23 21:27:39.878529 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1696/3489] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:39 2022] GET /compute/v2.1/servers/d3d6b0e1-57fa-4247-bf6d-18c97aa22750 => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:27:39.883281 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3ddf5962-e09e-4ee4-aa1b-f201442d52ca tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:39.891326 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-3ddf5962-e09e-4ee4-aa1b-f201442d52ca tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:39.900129 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3ddf5962-e09e-4ee4-aa1b-f201442d52ca tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:39.900851 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3ddf5962-e09e-4ee4-aa1b-f201442d52ca tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:39.901912 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3ddf5962-e09e-4ee4-aa1b-f201442d52ca tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:39.902519 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3ddf5962-e09e-4ee4-aa1b-f201442d52ca tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:39.902916 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c325ee0f-cb3a-4c7e-b9ed-92e809163e50 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6411b0f635714320a4f40e9bc5e260e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c005e3bc67b4501949fb72140726a11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:39.912756 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-c325ee0f-cb3a-4c7e-b9ed-92e809163e50 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] 10.222.0.17 "GET /compute/v2.1/servers/1516f44b-afba-4f88-ab56-c1f2fb68c74e" status: 200 len: 1269 microversion: 2.1 time: 0.141748 Jul 23 21:27:39.913537 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1794/3490] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:39 2022] GET /compute/v2.1/servers/1516f44b-afba-4f88-ab56-c1f2fb68c74e => generated 1269 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:27:39.990090 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-3ddf5962-e09e-4ee4-aa1b-f201442d52ca tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:40.001578 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-3ddf5962-e09e-4ee4-aa1b-f201442d52ca tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:40.001578 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-3ddf5962-e09e-4ee4-aa1b-f201442d52ca tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:40.007236 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-14ace268-776b-4add-b892-44a096408f56 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:40.007833 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-14ace268-776b-4add-b892-44a096408f56 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: c4da9681-4d81-4ffb-8d7e-453436e71331] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:40.012748 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-3ddf5962-e09e-4ee4-aa1b-f201442d52ca tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.132933 Jul 23 21:27:40.014378 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1697/3491] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:27:39 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:27:40.026792 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-14ace268-776b-4add-b892-44a096408f56 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:40.027250 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-14ace268-776b-4add-b892-44a096408f56 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:40.028052 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-14ace268-776b-4add-b892-44a096408f56 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:40.029194 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-14ace268-776b-4add-b892-44a096408f56 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:40.280878 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-14ace268-776b-4add-b892-44a096408f56 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:40.296183 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-14ace268-776b-4add-b892-44a096408f56 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331" status: 200 len: 1508 microversion: 2.1 time: 0.292752 Jul 23 21:27:40.297146 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1795/3492] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:40 2022] GET /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331 => generated 1508 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:27:40.417631 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b645e0d2-06e2-4d81-b078-411ab2d97ee8 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:40.418899 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b645e0d2-06e2-4d81-b078-411ab2d97ee8 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: 06a478c3-f038-4813-a456-daf3a58b5749] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:40.428071 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b645e0d2-06e2-4d81-b078-411ab2d97ee8 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:40.428597 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b645e0d2-06e2-4d81-b078-411ab2d97ee8 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:40.429629 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b645e0d2-06e2-4d81-b078-411ab2d97ee8 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:40.430389 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b645e0d2-06e2-4d81-b078-411ab2d97ee8 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:40.589222 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b645e0d2-06e2-4d81-b078-411ab2d97ee8 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:40.599784 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b645e0d2-06e2-4d81-b078-411ab2d97ee8 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/06a478c3-f038-4813-a456-daf3a58b5749" status: 200 len: 1523 microversion: 2.1 time: 0.186517 Jul 23 21:27:40.600846 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1698/3493] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:40 2022] GET /compute/v2.1/servers/06a478c3-f038-4813-a456-daf3a58b5749 => generated 1523 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:40.896807 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-5a30b53a-0993-4108-acde-143f357aa20b tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:40.897180 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-5a30b53a-0993-4108-acde-143f357aa20b tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] [instance: d3d6b0e1-57fa-4247-bf6d-18c97aa22750] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:40.911448 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5a30b53a-0993-4108-acde-143f357aa20b tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:40.912386 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5a30b53a-0993-4108-acde-143f357aa20b tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:40.919596 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5a30b53a-0993-4108-acde-143f357aa20b tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:40.920523 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5a30b53a-0993-4108-acde-143f357aa20b tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:40.930003 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-04cafb11-9190-4272-a609-5a000d9588cb tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:40.931611 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-04cafb11-9190-4272-a609-5a000d9588cb tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] [instance: 1516f44b-afba-4f88-ab56-c1f2fb68c74e] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:40.940586 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-04cafb11-9190-4272-a609-5a000d9588cb tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:40.945029 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-04cafb11-9190-4272-a609-5a000d9588cb tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:40.946797 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-04cafb11-9190-4272-a609-5a000d9588cb tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:40.952027 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-04cafb11-9190-4272-a609-5a000d9588cb tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:40.980210 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:41.079112 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-04cafb11-9190-4272-a609-5a000d9588cb tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6411b0f635714320a4f40e9bc5e260e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c005e3bc67b4501949fb72140726a11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:41.088585 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-04cafb11-9190-4272-a609-5a000d9588cb tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] 10.222.0.17 "GET /compute/v2.1/servers/1516f44b-afba-4f88-ab56-c1f2fb68c74e" status: 200 len: 1275 microversion: 2.1 time: 0.162316 Jul 23 21:27:41.099934 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1699/3494] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:40 2022] GET /compute/v2.1/servers/1516f44b-afba-4f88-ab56-c1f2fb68c74e => generated 1275 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:41.105168 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b399ef2e-d49b-45a3-b777-ab700456801c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:41.106288 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b399ef2e-d49b-45a3-b777-ab700456801c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:41.121819 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b399ef2e-d49b-45a3-b777-ab700456801c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:41.122690 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b399ef2e-d49b-45a3-b777-ab700456801c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:41.124125 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b399ef2e-d49b-45a3-b777-ab700456801c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:41.124933 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b399ef2e-d49b-45a3-b777-ab700456801c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:41.230678 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b399ef2e-d49b-45a3-b777-ab700456801c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:41.246460 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b399ef2e-d49b-45a3-b777-ab700456801c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:41.248608 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b399ef2e-d49b-45a3-b777-ab700456801c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:41.250578 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b399ef2e-d49b-45a3-b777-ab700456801c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.149330 Jul 23 21:27:41.251786 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1700/3495] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:27:41 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:27:41.314239 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f9cd4832-d434-4f3f-8a79-6ae553d417d1 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:41.315703 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f9cd4832-d434-4f3f-8a79-6ae553d417d1 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: c4da9681-4d81-4ffb-8d7e-453436e71331] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:41.332523 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f9cd4832-d434-4f3f-8a79-6ae553d417d1 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:41.333744 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f9cd4832-d434-4f3f-8a79-6ae553d417d1 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:41.334797 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f9cd4832-d434-4f3f-8a79-6ae553d417d1 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:41.335425 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f9cd4832-d434-4f3f-8a79-6ae553d417d1 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:41.599348 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-5a30b53a-0993-4108-acde-143f357aa20b tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e11fb79c253c4a0f955d710ff4626f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b46cc4b1ef64d168bf4184339de54d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:41.619956 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-5a30b53a-0993-4108-acde-143f357aa20b tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] 10.222.0.17 "GET /compute/v2.1/servers/d3d6b0e1-57fa-4247-bf6d-18c97aa22750" status: 200 len: 1522 microversion: 2.1 time: 0.728232 Jul 23 21:27:41.629093 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1796/3496] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:40 2022] GET /compute/v2.1/servers/d3d6b0e1-57fa-4247-bf6d-18c97aa22750 => generated 1522 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:41.653922 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f151399d-d0b9-4bfb-b6e2-7d796db9a147 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:41.656822 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-f151399d-d0b9-4bfb-b6e2-7d796db9a147 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: 06a478c3-f038-4813-a456-daf3a58b5749] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:41.666994 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f9cd4832-d434-4f3f-8a79-6ae553d417d1 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:41.678242 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f9cd4832-d434-4f3f-8a79-6ae553d417d1 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331" status: 200 len: 1508 microversion: 2.1 time: 0.368860 Jul 23 21:27:41.679515 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1701/3497] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:41 2022] GET /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331 => generated 1508 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:41.690075 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f151399d-d0b9-4bfb-b6e2-7d796db9a147 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:41.690542 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f151399d-d0b9-4bfb-b6e2-7d796db9a147 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:41.691343 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f151399d-d0b9-4bfb-b6e2-7d796db9a147 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:41.691868 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f151399d-d0b9-4bfb-b6e2-7d796db9a147 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:42.041937 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-f151399d-d0b9-4bfb-b6e2-7d796db9a147 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:42.055373 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-f151399d-d0b9-4bfb-b6e2-7d796db9a147 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/06a478c3-f038-4813-a456-daf3a58b5749" status: 200 len: 1508 microversion: 2.1 time: 0.423090 Jul 23 21:27:42.056279 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1797/3498] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:41 2022] GET /compute/v2.1/servers/06a478c3-f038-4813-a456-daf3a58b5749 => generated 1508 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:42.073479 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9927e8bb-9cdc-49ea-81d2-ac5de6970f1a tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:42.075113 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-9927e8bb-9cdc-49ea-81d2-ac5de6970f1a tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: 06a478c3-f038-4813-a456-daf3a58b5749] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:42.084299 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9927e8bb-9cdc-49ea-81d2-ac5de6970f1a tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:42.084862 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9927e8bb-9cdc-49ea-81d2-ac5de6970f1a tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:42.085651 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9927e8bb-9cdc-49ea-81d2-ac5de6970f1a tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:42.086057 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9927e8bb-9cdc-49ea-81d2-ac5de6970f1a tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:42.105974 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c1093deb-2b28-48b4-ba07-98f8f1d8bff4 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:42.106591 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-c1093deb-2b28-48b4-ba07-98f8f1d8bff4 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] [instance: 1516f44b-afba-4f88-ab56-c1f2fb68c74e] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:42.118757 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c1093deb-2b28-48b4-ba07-98f8f1d8bff4 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:42.119206 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c1093deb-2b28-48b4-ba07-98f8f1d8bff4 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:42.119996 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c1093deb-2b28-48b4-ba07-98f8f1d8bff4 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:42.120432 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c1093deb-2b28-48b4-ba07-98f8f1d8bff4 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:42.288286 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-9927e8bb-9cdc-49ea-81d2-ac5de6970f1a tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:42.298967 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9927e8bb-9cdc-49ea-81d2-ac5de6970f1a tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/06a478c3-f038-4813-a456-daf3a58b5749" status: 200 len: 1508 microversion: 2.1 time: 0.228626 Jul 23 21:27:42.300058 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1702/3499] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:42 2022] GET /compute/v2.1/servers/06a478c3-f038-4813-a456-daf3a58b5749 => generated 1508 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:42.308411 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-74eb4261-0f16-4dff-b4a0-6075de507b03 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:42.318093 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-74eb4261-0f16-4dff-b4a0-6075de507b03 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:42.326726 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-74eb4261-0f16-4dff-b4a0-6075de507b03 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:42.327509 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-74eb4261-0f16-4dff-b4a0-6075de507b03 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:42.328463 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-74eb4261-0f16-4dff-b4a0-6075de507b03 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:42.328909 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-74eb4261-0f16-4dff-b4a0-6075de507b03 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:42.402875 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-74eb4261-0f16-4dff-b4a0-6075de507b03 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:42.412200 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-74eb4261-0f16-4dff-b4a0-6075de507b03 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:42.413701 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-74eb4261-0f16-4dff-b4a0-6075de507b03 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:42.414932 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-74eb4261-0f16-4dff-b4a0-6075de507b03 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.114085 Jul 23 21:27:42.416953 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1703/3500] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:27:42 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:27:42.421706 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-cdb57288-bfb4-4253-98e4-4c2be9052e8e tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:42.422238 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-cdb57288-bfb4-4253-98e4-4c2be9052e8e tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: 06a478c3-f038-4813-a456-daf3a58b5749] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:42.428882 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cdb57288-bfb4-4253-98e4-4c2be9052e8e tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:42.429492 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cdb57288-bfb4-4253-98e4-4c2be9052e8e tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:42.430636 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cdb57288-bfb4-4253-98e4-4c2be9052e8e tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:42.431003 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cdb57288-bfb4-4253-98e4-4c2be9052e8e tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:42.437466 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c1093deb-2b28-48b4-ba07-98f8f1d8bff4 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6411b0f635714320a4f40e9bc5e260e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c005e3bc67b4501949fb72140726a11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:42.451578 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-c1093deb-2b28-48b4-ba07-98f8f1d8bff4 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] 10.222.0.17 "GET /compute/v2.1/servers/1516f44b-afba-4f88-ab56-c1f2fb68c74e" status: 200 len: 1317 microversion: 2.1 time: 0.349265 Jul 23 21:27:42.456082 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1798/3501] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:42 2022] GET /compute/v2.1/servers/1516f44b-afba-4f88-ab56-c1f2fb68c74e => generated 1317 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:27:42.471383 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-cdb57288-bfb4-4253-98e4-4c2be9052e8e tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: 06a478c3-f038-4813-a456-daf3a58b5749] Going to try to terminate instance {{(pid=131320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:27:42.641392 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-cdb57288-bfb4-4253-98e4-4c2be9052e8e tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "DELETE /compute/v2.1/servers/06a478c3-f038-4813-a456-daf3a58b5749" status: 204 len: 0 microversion: 2.1 time: 0.222915 Jul 23 21:27:42.646952 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-fd2784a4-7238-4910-9096-47d778fdf48e tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:42.647913 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-fd2784a4-7238-4910-9096-47d778fdf48e tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] [instance: d3d6b0e1-57fa-4247-bf6d-18c97aa22750] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:42.656804 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1704/3502] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:27:42 2022] DELETE /compute/v2.1/servers/06a478c3-f038-4813-a456-daf3a58b5749 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:27:42.677411 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fd2784a4-7238-4910-9096-47d778fdf48e tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:42.679781 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fd2784a4-7238-4910-9096-47d778fdf48e tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:42.681204 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fd2784a4-7238-4910-9096-47d778fdf48e tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:42.682711 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fd2784a4-7238-4910-9096-47d778fdf48e tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:42.704404 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-60643ff6-4061-4672-a812-ce74f277a6f1 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:42.705696 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-60643ff6-4061-4672-a812-ce74f277a6f1 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: c4da9681-4d81-4ffb-8d7e-453436e71331] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:42.725658 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-60643ff6-4061-4672-a812-ce74f277a6f1 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:42.727040 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-60643ff6-4061-4672-a812-ce74f277a6f1 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:42.729709 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-60643ff6-4061-4672-a812-ce74f277a6f1 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:42.731918 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-60643ff6-4061-4672-a812-ce74f277a6f1 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:42.950308 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-60643ff6-4061-4672-a812-ce74f277a6f1 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:42.959985 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-60643ff6-4061-4672-a812-ce74f277a6f1 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331" status: 200 len: 1529 microversion: 2.1 time: 0.267305 Jul 23 21:27:42.960796 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1705/3503] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:42 2022] GET /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331 => generated 1529 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:27:42.976751 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-94ec1eb4-805e-4c06-a0e6-5fe3fe47656f tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-2127139804", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "networks": [{"uuid": "1dbf2bb4-d60f-4a54-bdcd-eb9fe22ca395"}]}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:27:42.987653 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:43.044847 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-94ec1eb4-805e-4c06-a0e6-5fe3fe47656f tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] validate_networks() for [('1dbf2bb4-d60f-4a54-bdcd-eb9fe22ca395', None, None, None, None, None)] {{(pid=131320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:27:43.492333 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-fd2784a4-7238-4910-9096-47d778fdf48e tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e11fb79c253c4a0f955d710ff4626f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b46cc4b1ef64d168bf4184339de54d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:43.500792 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-fd2784a4-7238-4910-9096-47d778fdf48e tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] 10.222.0.17 "GET /compute/v2.1/servers/d3d6b0e1-57fa-4247-bf6d-18c97aa22750" status: 200 len: 1522 microversion: 2.1 time: 0.859245 Jul 23 21:27:43.511306 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1799/3504] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:42 2022] GET /compute/v2.1/servers/d3d6b0e1-57fa-4247-bf6d-18c97aa22750 => generated 1522 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:27:43.516471 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-00f644c9-b315-40c2-8b04-bfa37a3aecdf req-5009f9d3-cb58-4ade-b778-86094aa1c745 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1516f44b-afba-4f88-ab56-c1f2fb68c74e", "tag": "3dea3342-e8ae-4cc4-b025-3cb0df4712cc"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:27:43.544665 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-00f644c9-b315-40c2-8b04-bfa37a3aecdf req-5009f9d3-cb58-4ade-b778-86094aa1c745 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:43.545483 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-00f644c9-b315-40c2-8b04-bfa37a3aecdf req-5009f9d3-cb58-4ade-b778-86094aa1c745 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:43.576682 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-00f644c9-b315-40c2-8b04-bfa37a3aecdf req-5009f9d3-cb58-4ade-b778-86094aa1c745 service nova] Creating event network-changed:3dea3342-e8ae-4cc4-b025-3cb0df4712cc for instance 1516f44b-afba-4f88-ab56-c1f2fb68c74e on nch1-master-1 Jul 23 21:27:43.585818 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-00f644c9-b315-40c2-8b04-bfa37a3aecdf req-5009f9d3-cb58-4ade-b778-86094aa1c745 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072928 Jul 23 21:27:43.590973 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1800/3505] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:27:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:27:43.602527 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-2cead283-d57b-4c11-a97c-2cc36ff53f76 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:43.604034 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-2cead283-d57b-4c11-a97c-2cc36ff53f76 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:43.615247 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-94ec1eb4-805e-4c06-a0e6-5fe3fe47656f tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:27:43.615728 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-94ec1eb4-805e-4c06-a0e6-5fe3fe47656f tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:27:43.616128 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-94ec1eb4-805e-4c06-a0e6-5fe3fe47656f tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:27:43.617202 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-94ec1eb4-805e-4c06-a0e6-5fe3fe47656f tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:27:43.617775 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-94ec1eb4-805e-4c06-a0e6-5fe3fe47656f tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:27:43.619836 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2cead283-d57b-4c11-a97c-2cc36ff53f76 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:43.621574 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2cead283-d57b-4c11-a97c-2cc36ff53f76 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:43.626292 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2cead283-d57b-4c11-a97c-2cc36ff53f76 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:43.627178 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2cead283-d57b-4c11-a97c-2cc36ff53f76 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:43.641681 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-94ec1eb4-805e-4c06-a0e6-5fe3fe47656f tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:43.646138 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-94ec1eb4-805e-4c06-a0e6-5fe3fe47656f tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:43.652507 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-94ec1eb4-805e-4c06-a0e6-5fe3fe47656f tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:43.653182 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-94ec1eb4-805e-4c06-a0e6-5fe3fe47656f tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:43.693305 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-94ec1eb4-805e-4c06-a0e6-5fe3fe47656f tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Getting quotas for project 5afdbc378ad64fc58903ea2518717005. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:27:43.704892 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-94ec1eb4-805e-4c06-a0e6-5fe3fe47656f tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Getting quotas for user c8c3d58265714ebba65b1510bd768e19 and project 5afdbc378ad64fc58903ea2518717005. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:27:43.719242 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-94ec1eb4-805e-4c06-a0e6-5fe3fe47656f tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Going to run 1 instances... {{(pid=131320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:27:43.721569 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-94ec1eb4-805e-4c06-a0e6-5fe3fe47656f tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: e55e0951-8a56-497b-8bdf-15dd6cc250fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:27:43.760579 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-2cead283-d57b-4c11-a97c-2cc36ff53f76 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:43.784872 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-94ec1eb4-805e-4c06-a0e6-5fe3fe47656f tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.812772 Jul 23 21:27:43.786264 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1706/3506] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:27:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 825 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 23 21:27:43.791255 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5c22fcbb-0d98-4057-86a6-0cd4e95c4738 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:43.791812 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-2cead283-d57b-4c11-a97c-2cc36ff53f76 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:43.792034 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5c22fcbb-0d98-4057-86a6-0cd4e95c4738 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] [instance: 1516f44b-afba-4f88-ab56-c1f2fb68c74e] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:43.793509 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-2cead283-d57b-4c11-a97c-2cc36ff53f76 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:43.795442 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-2cead283-d57b-4c11-a97c-2cc36ff53f76 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.203125 Jul 23 21:27:43.796012 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1801/3507] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:27:43 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:27:43.801501 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-2e792d38-20e5-4cd0-bbaa-56cd413e2b4f tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:43.808376 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-2e792d38-20e5-4cd0-bbaa-56cd413e2b4f tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: e55e0951-8a56-497b-8bdf-15dd6cc250fd] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:43.827312 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5c22fcbb-0d98-4057-86a6-0cd4e95c4738 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:43.827795 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5c22fcbb-0d98-4057-86a6-0cd4e95c4738 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:43.832396 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5c22fcbb-0d98-4057-86a6-0cd4e95c4738 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:43.832852 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5c22fcbb-0d98-4057-86a6-0cd4e95c4738 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:43.979438 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-2e792d38-20e5-4cd0-bbaa-56cd413e2b4f tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:43.995608 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-2e792d38-20e5-4cd0-bbaa-56cd413e2b4f tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/e55e0951-8a56-497b-8bdf-15dd6cc250fd" status: 200 len: 1218 microversion: 2.1 time: 0.190938 Jul 23 21:27:43.997988 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1802/3508] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:43 2022] GET /compute/v2.1/servers/e55e0951-8a56-497b-8bdf-15dd6cc250fd => generated 1218 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:44.013933 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-969d2d9d-0e4a-443d-b273-7d2b9476f22a tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:44.015262 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-969d2d9d-0e4a-443d-b273-7d2b9476f22a tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: c4da9681-4d81-4ffb-8d7e-453436e71331] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:44.031041 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-969d2d9d-0e4a-443d-b273-7d2b9476f22a tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:44.031781 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-969d2d9d-0e4a-443d-b273-7d2b9476f22a tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:44.033000 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-969d2d9d-0e4a-443d-b273-7d2b9476f22a tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:44.033626 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-969d2d9d-0e4a-443d-b273-7d2b9476f22a tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:44.256163 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5c22fcbb-0d98-4057-86a6-0cd4e95c4738 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6411b0f635714320a4f40e9bc5e260e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c005e3bc67b4501949fb72140726a11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:44.268140 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-969d2d9d-0e4a-443d-b273-7d2b9476f22a tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:44.272519 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5c22fcbb-0d98-4057-86a6-0cd4e95c4738 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] 10.222.0.17 "GET /compute/v2.1/servers/1516f44b-afba-4f88-ab56-c1f2fb68c74e" status: 200 len: 1317 microversion: 2.1 time: 0.485002 Jul 23 21:27:44.273164 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1707/3509] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:43 2022] GET /compute/v2.1/servers/1516f44b-afba-4f88-ab56-c1f2fb68c74e => generated 1317 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:44.278907 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-969d2d9d-0e4a-443d-b273-7d2b9476f22a tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331" status: 200 len: 1524 microversion: 2.1 time: 0.279589 Jul 23 21:27:44.279529 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1803/3510] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:43 2022] GET /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331 => generated 1524 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:44.517540 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-14af4751-878e-409d-94e6-8d67d6d398a3 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:44.518403 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-14af4751-878e-409d-94e6-8d67d6d398a3 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] [instance: d3d6b0e1-57fa-4247-bf6d-18c97aa22750] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:44.525077 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-14af4751-878e-409d-94e6-8d67d6d398a3 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:44.525523 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-14af4751-878e-409d-94e6-8d67d6d398a3 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:44.526554 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-14af4751-878e-409d-94e6-8d67d6d398a3 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:44.527192 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-14af4751-878e-409d-94e6-8d67d6d398a3 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:44.721098 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-3f54f84e-2ef4-45e2-818e-ed5a4fb61096 req-0562c2c7-eca7-4974-8740-c6ba09c48557 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06a478c3-f038-4813-a456-daf3a58b5749", "name": "network-vif-deleted", "tag": "661b9337-be92-4f83-a6f7-6a98a2b053db"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:27:44.748147 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-3f54f84e-2ef4-45e2-818e-ed5a4fb61096 req-0562c2c7-eca7-4974-8740-c6ba09c48557 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:44.748598 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-3f54f84e-2ef4-45e2-818e-ed5a4fb61096 req-0562c2c7-eca7-4974-8740-c6ba09c48557 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:44.773788 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-3f54f84e-2ef4-45e2-818e-ed5a4fb61096 req-0562c2c7-eca7-4974-8740-c6ba09c48557 service nova] Creating event network-vif-deleted:661b9337-be92-4f83-a6f7-6a98a2b053db for instance 06a478c3-f038-4813-a456-daf3a58b5749 on nch2-master-1 Jul 23 21:27:44.779951 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-3f54f84e-2ef4-45e2-818e-ed5a4fb61096 req-0562c2c7-eca7-4974-8740-c6ba09c48557 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075748 Jul 23 21:27:44.781132 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1804/3511] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:27:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:27:44.791894 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-14af4751-878e-409d-94e6-8d67d6d398a3 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e11fb79c253c4a0f955d710ff4626f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b46cc4b1ef64d168bf4184339de54d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:44.802315 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-14af4751-878e-409d-94e6-8d67d6d398a3 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] 10.222.0.17 "GET /compute/v2.1/servers/d3d6b0e1-57fa-4247-bf6d-18c97aa22750" status: 200 len: 1522 microversion: 2.1 time: 0.286852 Jul 23 21:27:44.802315 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1708/3512] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:44 2022] GET /compute/v2.1/servers/d3d6b0e1-57fa-4247-bf6d-18c97aa22750 => generated 1522 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:44.815178 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c30aec2d-0cf9-4d0c-abc6-0259244fdb62 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:44.815907 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-c30aec2d-0cf9-4d0c-abc6-0259244fdb62 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:44.827933 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c30aec2d-0cf9-4d0c-abc6-0259244fdb62 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:44.828661 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c30aec2d-0cf9-4d0c-abc6-0259244fdb62 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:44.829692 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c30aec2d-0cf9-4d0c-abc6-0259244fdb62 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:44.830199 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c30aec2d-0cf9-4d0c-abc6-0259244fdb62 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:44.907913 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c30aec2d-0cf9-4d0c-abc6-0259244fdb62 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:44.918252 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c30aec2d-0cf9-4d0c-abc6-0259244fdb62 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:44.919751 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c30aec2d-0cf9-4d0c-abc6-0259244fdb62 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:44.920967 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-c30aec2d-0cf9-4d0c-abc6-0259244fdb62 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.110281 Jul 23 21:27:44.921534 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1805/3513] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:27:44 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:27:45.014678 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-89a4d5d9-c86e-4e64-a888-4b6df3d908e6 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:45.015623 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-89a4d5d9-c86e-4e64-a888-4b6df3d908e6 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: e55e0951-8a56-497b-8bdf-15dd6cc250fd] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:45.025887 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-89a4d5d9-c86e-4e64-a888-4b6df3d908e6 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:45.025887 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-89a4d5d9-c86e-4e64-a888-4b6df3d908e6 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:45.025887 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-89a4d5d9-c86e-4e64-a888-4b6df3d908e6 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:45.025887 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-89a4d5d9-c86e-4e64-a888-4b6df3d908e6 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:45.110534 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-89a4d5d9-c86e-4e64-a888-4b6df3d908e6 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:45.126365 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-89a4d5d9-c86e-4e64-a888-4b6df3d908e6 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/e55e0951-8a56-497b-8bdf-15dd6cc250fd" status: 200 len: 1222 microversion: 2.1 time: 0.116914 Jul 23 21:27:45.127558 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1709/3514] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:45 2022] GET /compute/v2.1/servers/e55e0951-8a56-497b-8bdf-15dd6cc250fd => generated 1222 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:45.301892 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-debe0882-dda3-461a-91bd-3e375004c3d3 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:45.306351 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6335288b-f926-4cad-9670-6bbefadd885c tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:45.306590 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-debe0882-dda3-461a-91bd-3e375004c3d3 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] [instance: 1516f44b-afba-4f88-ab56-c1f2fb68c74e] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:45.307355 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6335288b-f926-4cad-9670-6bbefadd885c tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: c4da9681-4d81-4ffb-8d7e-453436e71331] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:45.314086 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6335288b-f926-4cad-9670-6bbefadd885c tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:45.315068 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6335288b-f926-4cad-9670-6bbefadd885c tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:45.316372 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6335288b-f926-4cad-9670-6bbefadd885c tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:45.317156 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6335288b-f926-4cad-9670-6bbefadd885c tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:45.323278 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-debe0882-dda3-461a-91bd-3e375004c3d3 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:45.323741 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-debe0882-dda3-461a-91bd-3e375004c3d3 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:45.330223 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-debe0882-dda3-461a-91bd-3e375004c3d3 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:45.330734 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-debe0882-dda3-461a-91bd-3e375004c3d3 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:45.530821 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6335288b-f926-4cad-9670-6bbefadd885c tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:45.544560 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6335288b-f926-4cad-9670-6bbefadd885c tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331" status: 200 len: 1524 microversion: 2.1 time: 0.248416 Jul 23 21:27:45.545571 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1710/3515] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:45 2022] GET /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331 => generated 1524 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:45.672843 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-616ed13b-98f5-4822-8edf-842e06dc2ed4 req-023173b1-1f51-4e44-a57d-0cd1a87fc2a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4da9681-4d81-4ffb-8d7e-453436e71331", "name": "network-vif-plugged", "status": "completed", "tag": "f60d970a-170d-47a9-b1da-1f92400f8025"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:27:45.686765 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-616ed13b-98f5-4822-8edf-842e06dc2ed4 req-023173b1-1f51-4e44-a57d-0cd1a87fc2a0 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:45.687220 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-616ed13b-98f5-4822-8edf-842e06dc2ed4 req-023173b1-1f51-4e44-a57d-0cd1a87fc2a0 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:45.703441 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-616ed13b-98f5-4822-8edf-842e06dc2ed4 req-023173b1-1f51-4e44-a57d-0cd1a87fc2a0 service nova] Creating event network-vif-plugged:f60d970a-170d-47a9-b1da-1f92400f8025 for instance c4da9681-4d81-4ffb-8d7e-453436e71331 on nch1-master-1 Jul 23 21:27:45.709144 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-616ed13b-98f5-4822-8edf-842e06dc2ed4 req-023173b1-1f51-4e44-a57d-0cd1a87fc2a0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041212 Jul 23 21:27:45.710345 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1711/3516] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:27:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:27:45.745058 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-debe0882-dda3-461a-91bd-3e375004c3d3 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6411b0f635714320a4f40e9bc5e260e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c005e3bc67b4501949fb72140726a11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:45.754525 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-debe0882-dda3-461a-91bd-3e375004c3d3 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] 10.222.0.17 "GET /compute/v2.1/servers/1516f44b-afba-4f88-ab56-c1f2fb68c74e" status: 200 len: 1317 microversion: 2.1 time: 0.468075 Jul 23 21:27:45.759051 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1806/3517] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:45 2022] GET /compute/v2.1/servers/1516f44b-afba-4f88-ab56-c1f2fb68c74e => generated 1317 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:45.823135 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d6e11836-26a7-4efd-84bd-acf7443d8c95 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:45.823683 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d6e11836-26a7-4efd-84bd-acf7443d8c95 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] [instance: d3d6b0e1-57fa-4247-bf6d-18c97aa22750] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:45.830905 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d6e11836-26a7-4efd-84bd-acf7443d8c95 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:45.831320 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d6e11836-26a7-4efd-84bd-acf7443d8c95 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:45.832375 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d6e11836-26a7-4efd-84bd-acf7443d8c95 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:45.833142 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d6e11836-26a7-4efd-84bd-acf7443d8c95 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:45.942190 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ae973308-3254-432e-af9d-2af4057878c9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:45.943535 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-ae973308-3254-432e-af9d-2af4057878c9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:45.954818 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ae973308-3254-432e-af9d-2af4057878c9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:45.955778 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ae973308-3254-432e-af9d-2af4057878c9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:45.958249 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ae973308-3254-432e-af9d-2af4057878c9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:45.958943 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ae973308-3254-432e-af9d-2af4057878c9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:46.063927 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d6e11836-26a7-4efd-84bd-acf7443d8c95 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e11fb79c253c4a0f955d710ff4626f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b46cc4b1ef64d168bf4184339de54d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:46.077111 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d6e11836-26a7-4efd-84bd-acf7443d8c95 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] 10.222.0.17 "GET /compute/v2.1/servers/d3d6b0e1-57fa-4247-bf6d-18c97aa22750" status: 200 len: 1522 microversion: 2.1 time: 0.259867 Jul 23 21:27:46.078466 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1712/3518] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:45 2022] GET /compute/v2.1/servers/d3d6b0e1-57fa-4247-bf6d-18c97aa22750 => generated 1522 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:46.149980 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0318d0a8-79f2-415f-a1d9-a016aa94799d tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:46.150649 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-0318d0a8-79f2-415f-a1d9-a016aa94799d tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: e55e0951-8a56-497b-8bdf-15dd6cc250fd] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:46.164587 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ae973308-3254-432e-af9d-2af4057878c9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:46.199371 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0318d0a8-79f2-415f-a1d9-a016aa94799d tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:46.199875 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0318d0a8-79f2-415f-a1d9-a016aa94799d tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:46.200718 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0318d0a8-79f2-415f-a1d9-a016aa94799d tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:46.203024 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ae973308-3254-432e-af9d-2af4057878c9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:46.204542 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ae973308-3254-432e-af9d-2af4057878c9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:46.206756 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0318d0a8-79f2-415f-a1d9-a016aa94799d tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:46.218725 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-ae973308-3254-432e-af9d-2af4057878c9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.280892 Jul 23 21:27:46.218725 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1807/3519] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:27:45 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:27:46.345711 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-0318d0a8-79f2-415f-a1d9-a016aa94799d tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:46.357232 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-0318d0a8-79f2-415f-a1d9-a016aa94799d tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/e55e0951-8a56-497b-8bdf-15dd6cc250fd" status: 200 len: 1288 microversion: 2.1 time: 0.216288 Jul 23 21:27:46.362097 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1713/3520] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:46 2022] GET /compute/v2.1/servers/e55e0951-8a56-497b-8bdf-15dd6cc250fd => generated 1288 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:27:46.566070 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-6258fafc-05d6-49d2-be56-165e8cfd343c tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:46.569357 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-6258fafc-05d6-49d2-be56-165e8cfd343c tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: c4da9681-4d81-4ffb-8d7e-453436e71331] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:46.597998 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6258fafc-05d6-49d2-be56-165e8cfd343c tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:46.600877 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6258fafc-05d6-49d2-be56-165e8cfd343c tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:46.603222 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6258fafc-05d6-49d2-be56-165e8cfd343c tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:46.603945 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6258fafc-05d6-49d2-be56-165e8cfd343c tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:46.773067 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-73013ab4-c735-4c4d-aba5-b4083a5ecac8 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:46.774307 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-73013ab4-c735-4c4d-aba5-b4083a5ecac8 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] [instance: 1516f44b-afba-4f88-ab56-c1f2fb68c74e] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:46.788947 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-73013ab4-c735-4c4d-aba5-b4083a5ecac8 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:46.789502 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-73013ab4-c735-4c4d-aba5-b4083a5ecac8 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:46.791613 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-73013ab4-c735-4c4d-aba5-b4083a5ecac8 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:46.794571 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-73013ab4-c735-4c4d-aba5-b4083a5ecac8 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:47.155185 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-73013ab4-c735-4c4d-aba5-b4083a5ecac8 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6411b0f635714320a4f40e9bc5e260e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c005e3bc67b4501949fb72140726a11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:47.160962 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-6258fafc-05d6-49d2-be56-165e8cfd343c tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:47.177196 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-73013ab4-c735-4c4d-aba5-b4083a5ecac8 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] 10.222.0.17 "GET /compute/v2.1/servers/1516f44b-afba-4f88-ab56-c1f2fb68c74e" status: 200 len: 1317 microversion: 2.1 time: 0.409084 Jul 23 21:27:47.177828 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1714/3521] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:46 2022] GET /compute/v2.1/servers/1516f44b-afba-4f88-ab56-c1f2fb68c74e => generated 1317 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:47.194921 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3aa610ab-c12c-412b-be04-d3af240eabf2 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:47.196193 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-3aa610ab-c12c-412b-be04-d3af240eabf2 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] [instance: d3d6b0e1-57fa-4247-bf6d-18c97aa22750] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:47.196682 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-6258fafc-05d6-49d2-be56-165e8cfd343c tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331" status: 200 len: 1524 microversion: 2.1 time: 0.637228 Jul 23 21:27:47.197775 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1808/3522] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:46 2022] GET /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331 => generated 1524 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:47.234288 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3aa610ab-c12c-412b-be04-d3af240eabf2 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:47.234742 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3aa610ab-c12c-412b-be04-d3af240eabf2 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:47.235526 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3aa610ab-c12c-412b-be04-d3af240eabf2 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:47.236044 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3aa610ab-c12c-412b-be04-d3af240eabf2 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:47.239863 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-1e74d91d-5e86-4bd1-91ad-8a9bf128d5f3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:47.242958 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-1e74d91d-5e86-4bd1-91ad-8a9bf128d5f3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:47.252006 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1e74d91d-5e86-4bd1-91ad-8a9bf128d5f3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:47.253046 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1e74d91d-5e86-4bd1-91ad-8a9bf128d5f3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:47.254145 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1e74d91d-5e86-4bd1-91ad-8a9bf128d5f3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:47.255213 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1e74d91d-5e86-4bd1-91ad-8a9bf128d5f3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:47.279010 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:47.402831 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-1e74d91d-5e86-4bd1-91ad-8a9bf128d5f3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:47.416126 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-1e74d91d-5e86-4bd1-91ad-8a9bf128d5f3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:47.423344 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-1e74d91d-5e86-4bd1-91ad-8a9bf128d5f3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:47.426183 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-1e74d91d-5e86-4bd1-91ad-8a9bf128d5f3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.192962 Jul 23 21:27:47.428416 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1809/3523] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:27:47 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:27:47.435987 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-4880bf64-1161-45a7-84c8-8ac8ed9653fd tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:47.439864 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-4880bf64-1161-45a7-84c8-8ac8ed9653fd tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: e55e0951-8a56-497b-8bdf-15dd6cc250fd] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:47.460117 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4880bf64-1161-45a7-84c8-8ac8ed9653fd tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:47.461420 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4880bf64-1161-45a7-84c8-8ac8ed9653fd tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:47.462678 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4880bf64-1161-45a7-84c8-8ac8ed9653fd tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:47.465411 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4880bf64-1161-45a7-84c8-8ac8ed9653fd tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:47.570204 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-3aa610ab-c12c-412b-be04-d3af240eabf2 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e11fb79c253c4a0f955d710ff4626f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b46cc4b1ef64d168bf4184339de54d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:47.588465 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-3aa610ab-c12c-412b-be04-d3af240eabf2 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] 10.222.0.17 "GET /compute/v2.1/servers/d3d6b0e1-57fa-4247-bf6d-18c97aa22750" status: 200 len: 1522 microversion: 2.1 time: 0.407952 Jul 23 21:27:47.591657 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1715/3524] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:47 2022] GET /compute/v2.1/servers/d3d6b0e1-57fa-4247-bf6d-18c97aa22750 => generated 1522 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:47.843907 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-4880bf64-1161-45a7-84c8-8ac8ed9653fd tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:47.853845 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-4880bf64-1161-45a7-84c8-8ac8ed9653fd tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/e55e0951-8a56-497b-8bdf-15dd6cc250fd" status: 200 len: 1318 microversion: 2.1 time: 0.424098 Jul 23 21:27:47.855347 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1810/3525] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:47 2022] GET /compute/v2.1/servers/e55e0951-8a56-497b-8bdf-15dd6cc250fd => generated 1318 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:48.203050 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4b4e2a20-c84f-413c-a5ac-ee9b0168cb64 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:48.203745 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-4b4e2a20-c84f-413c-a5ac-ee9b0168cb64 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] [instance: 1516f44b-afba-4f88-ab56-c1f2fb68c74e] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:48.226367 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f92dc1c1-f2dd-4cc4-adde-45977cb178ce tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:48.227775 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-f92dc1c1-f2dd-4cc4-adde-45977cb178ce tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: c4da9681-4d81-4ffb-8d7e-453436e71331] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:48.241986 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4b4e2a20-c84f-413c-a5ac-ee9b0168cb64 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:48.242448 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4b4e2a20-c84f-413c-a5ac-ee9b0168cb64 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:48.244750 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4b4e2a20-c84f-413c-a5ac-ee9b0168cb64 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:48.245501 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f92dc1c1-f2dd-4cc4-adde-45977cb178ce tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:48.246542 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4b4e2a20-c84f-413c-a5ac-ee9b0168cb64 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:48.247755 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f92dc1c1-f2dd-4cc4-adde-45977cb178ce tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:48.248770 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f92dc1c1-f2dd-4cc4-adde-45977cb178ce tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:48.254542 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f92dc1c1-f2dd-4cc4-adde-45977cb178ce tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:48.454416 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell0:SELECT=2 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:48.539385 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-4b4e2a20-c84f-413c-a5ac-ee9b0168cb64 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6411b0f635714320a4f40e9bc5e260e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c005e3bc67b4501949fb72140726a11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:48.555535 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4b4e2a20-c84f-413c-a5ac-ee9b0168cb64 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] 10.222.0.17 "GET /compute/v2.1/servers/1516f44b-afba-4f88-ab56-c1f2fb68c74e" status: 200 len: 1317 microversion: 2.1 time: 0.353703 Jul 23 21:27:48.556378 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1716/3526] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:48 2022] GET /compute/v2.1/servers/1516f44b-afba-4f88-ab56-c1f2fb68c74e => generated 1317 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:27:48.570253 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c675c2e5-6f88-4c45-b9ef-d73f7ec34b99 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:48.571986 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c675c2e5-6f88-4c45-b9ef-d73f7ec34b99 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:48.588070 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c675c2e5-6f88-4c45-b9ef-d73f7ec34b99 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:48.590208 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c675c2e5-6f88-4c45-b9ef-d73f7ec34b99 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:48.593261 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c675c2e5-6f88-4c45-b9ef-d73f7ec34b99 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:48.606846 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c675c2e5-6f88-4c45-b9ef-d73f7ec34b99 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:48.742624 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-f92dc1c1-f2dd-4cc4-adde-45977cb178ce tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:48.754806 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-f92dc1c1-f2dd-4cc4-adde-45977cb178ce tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331" status: 200 len: 1524 microversion: 2.1 time: 0.533504 Jul 23 21:27:48.758643 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1811/3527] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:48 2022] GET /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331 => generated 1524 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:48.760786 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c675c2e5-6f88-4c45-b9ef-d73f7ec34b99 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:48.773337 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f37cd9e9-651a-489e-8ea9-7adad9b6dcfe tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:48.777609 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-f37cd9e9-651a-489e-8ea9-7adad9b6dcfe tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] [instance: d3d6b0e1-57fa-4247-bf6d-18c97aa22750] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:48.785705 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c675c2e5-6f88-4c45-b9ef-d73f7ec34b99 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:48.788122 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f37cd9e9-651a-489e-8ea9-7adad9b6dcfe tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:48.789243 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f37cd9e9-651a-489e-8ea9-7adad9b6dcfe tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:48.790320 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f37cd9e9-651a-489e-8ea9-7adad9b6dcfe tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:48.790979 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f37cd9e9-651a-489e-8ea9-7adad9b6dcfe tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:48.791492 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c675c2e5-6f88-4c45-b9ef-d73f7ec34b99 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:48.793626 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c675c2e5-6f88-4c45-b9ef-d73f7ec34b99 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.235051 Jul 23 21:27:48.794698 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1717/3528] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:27:48 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:27:48.872425 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b4a8db48-0101-4285-9961-ebb88ddeecd9 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:48.873316 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b4a8db48-0101-4285-9961-ebb88ddeecd9 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: e55e0951-8a56-497b-8bdf-15dd6cc250fd] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:48.889314 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b4a8db48-0101-4285-9961-ebb88ddeecd9 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:48.889768 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b4a8db48-0101-4285-9961-ebb88ddeecd9 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:48.890624 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b4a8db48-0101-4285-9961-ebb88ddeecd9 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:48.891063 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b4a8db48-0101-4285-9961-ebb88ddeecd9 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:49.197466 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-f37cd9e9-651a-489e-8ea9-7adad9b6dcfe tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e11fb79c253c4a0f955d710ff4626f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b46cc4b1ef64d168bf4184339de54d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:49.209531 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b4a8db48-0101-4285-9961-ebb88ddeecd9 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:49.213199 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-f37cd9e9-651a-489e-8ea9-7adad9b6dcfe tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] 10.222.0.17 "GET /compute/v2.1/servers/d3d6b0e1-57fa-4247-bf6d-18c97aa22750" status: 200 len: 1522 microversion: 2.1 time: 0.449266 Jul 23 21:27:49.224338 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b4a8db48-0101-4285-9961-ebb88ddeecd9 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/e55e0951-8a56-497b-8bdf-15dd6cc250fd" status: 200 len: 1318 microversion: 2.1 time: 0.349789 Jul 23 21:27:49.224463 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1812/3529] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:48 2022] GET /compute/v2.1/servers/d3d6b0e1-57fa-4247-bf6d-18c97aa22750 => generated 1522 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:49.229233 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1718/3530] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:48 2022] GET /compute/v2.1/servers/e55e0951-8a56-497b-8bdf-15dd6cc250fd => generated 1318 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:27:49.241591 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-f7bcf7e3-ef8a-46a8-8e85-fd0d1d5f2968 req-9ec32baa-4889-4b8c-b982-645c50ec8db8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e55e0951-8a56-497b-8bdf-15dd6cc250fd", "tag": "36c01a6d-b578-4e94-8b0a-f12d45fa0bd7"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:27:49.265433 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-f7bcf7e3-ef8a-46a8-8e85-fd0d1d5f2968 req-9ec32baa-4889-4b8c-b982-645c50ec8db8 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:49.265893 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-f7bcf7e3-ef8a-46a8-8e85-fd0d1d5f2968 req-9ec32baa-4889-4b8c-b982-645c50ec8db8 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:49.279620 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-f7bcf7e3-ef8a-46a8-8e85-fd0d1d5f2968 req-9ec32baa-4889-4b8c-b982-645c50ec8db8 service nova] Creating event network-changed:36c01a6d-b578-4e94-8b0a-f12d45fa0bd7 for instance e55e0951-8a56-497b-8bdf-15dd6cc250fd on nch1-master-1 Jul 23 21:27:49.285545 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-f7bcf7e3-ef8a-46a8-8e85-fd0d1d5f2968 req-9ec32baa-4889-4b8c-b982-645c50ec8db8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064348 Jul 23 21:27:49.287301 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1813/3531] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:27:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:27:49.532693 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-b11973a3-f487-40c9-a55b-1a74c167755a req-ceefbdbf-6a02-466f-b2cd-607e279253ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1516f44b-afba-4f88-ab56-c1f2fb68c74e", "name": "network-vif-plugged", "status": "completed", "tag": "3dea3342-e8ae-4cc4-b025-3cb0df4712cc"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:27:49.547762 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-b11973a3-f487-40c9-a55b-1a74c167755a req-ceefbdbf-6a02-466f-b2cd-607e279253ae service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:49.548220 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-b11973a3-f487-40c9-a55b-1a74c167755a req-ceefbdbf-6a02-466f-b2cd-607e279253ae service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:49.577114 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-b11973a3-f487-40c9-a55b-1a74c167755a req-ceefbdbf-6a02-466f-b2cd-607e279253ae service nova] Creating event network-vif-plugged:3dea3342-e8ae-4cc4-b025-3cb0df4712cc for instance 1516f44b-afba-4f88-ab56-c1f2fb68c74e on nch1-master-1 Jul 23 21:27:49.577373 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-41c550d2-7e23-44d4-8e28-bb7ee95a0ff6 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:49.585394 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-b11973a3-f487-40c9-a55b-1a74c167755a req-ceefbdbf-6a02-466f-b2cd-607e279253ae service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058296 Jul 23 21:27:49.586544 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1719/3532] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:27:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:27:49.597976 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-41c550d2-7e23-44d4-8e28-bb7ee95a0ff6 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] [instance: 1516f44b-afba-4f88-ab56-c1f2fb68c74e] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:49.597976 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-41c550d2-7e23-44d4-8e28-bb7ee95a0ff6 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:49.597976 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-41c550d2-7e23-44d4-8e28-bb7ee95a0ff6 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:49.598289 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-41c550d2-7e23-44d4-8e28-bb7ee95a0ff6 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:49.598661 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-41c550d2-7e23-44d4-8e28-bb7ee95a0ff6 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:49.608783 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=100 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:49.777818 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c8858305-6b8d-4816-a9f2-a60bdbae8cf8 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:49.778549 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c8858305-6b8d-4816-a9f2-a60bdbae8cf8 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: c4da9681-4d81-4ffb-8d7e-453436e71331] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:49.787740 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c8858305-6b8d-4816-a9f2-a60bdbae8cf8 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:49.791067 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c8858305-6b8d-4816-a9f2-a60bdbae8cf8 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:49.792160 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c8858305-6b8d-4816-a9f2-a60bdbae8cf8 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:49.794981 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c8858305-6b8d-4816-a9f2-a60bdbae8cf8 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:49.969019 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-41c550d2-7e23-44d4-8e28-bb7ee95a0ff6 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6411b0f635714320a4f40e9bc5e260e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c005e3bc67b4501949fb72140726a11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:49.978186 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-41c550d2-7e23-44d4-8e28-bb7ee95a0ff6 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] 10.222.0.17 "GET /compute/v2.1/servers/1516f44b-afba-4f88-ab56-c1f2fb68c74e" status: 200 len: 1317 microversion: 2.1 time: 0.407053 Jul 23 21:27:49.982385 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1814/3533] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:49 2022] GET /compute/v2.1/servers/1516f44b-afba-4f88-ab56-c1f2fb68c74e => generated 1317 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:27:50.000553 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-fd9f266c-01e4-4ffa-83e1-d3db76022198 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:50.001616 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-fd9f266c-01e4-4ffa-83e1-d3db76022198 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:50.013456 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fd9f266c-01e4-4ffa-83e1-d3db76022198 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:50.014245 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fd9f266c-01e4-4ffa-83e1-d3db76022198 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:50.020507 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fd9f266c-01e4-4ffa-83e1-d3db76022198 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:50.021436 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fd9f266c-01e4-4ffa-83e1-d3db76022198 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:50.090545 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c8858305-6b8d-4816-a9f2-a60bdbae8cf8 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:50.102209 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c8858305-6b8d-4816-a9f2-a60bdbae8cf8 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331" status: 200 len: 1524 microversion: 2.1 time: 0.329102 Jul 23 21:27:50.103152 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1720/3534] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:49 2022] GET /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331 => generated 1524 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:27:50.152273 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-fd9f266c-01e4-4ffa-83e1-d3db76022198 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:50.161840 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-fd9f266c-01e4-4ffa-83e1-d3db76022198 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:50.163611 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-fd9f266c-01e4-4ffa-83e1-d3db76022198 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:50.165080 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-fd9f266c-01e4-4ffa-83e1-d3db76022198 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.181384 Jul 23 21:27:50.165535 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1815/3535] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:27:49 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:27:50.234993 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-176ebc4c-7715-4436-91b5-9bb9f1ab6b35 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:50.239980 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-79903383-7ed5-4ffd-8c82-a2a7434953ca tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:50.241152 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-176ebc4c-7715-4436-91b5-9bb9f1ab6b35 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: e55e0951-8a56-497b-8bdf-15dd6cc250fd] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:50.243369 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-79903383-7ed5-4ffd-8c82-a2a7434953ca tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] [instance: d3d6b0e1-57fa-4247-bf6d-18c97aa22750] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:50.253370 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-176ebc4c-7715-4436-91b5-9bb9f1ab6b35 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:50.254080 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-176ebc4c-7715-4436-91b5-9bb9f1ab6b35 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:50.256166 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-79903383-7ed5-4ffd-8c82-a2a7434953ca tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:50.256615 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-79903383-7ed5-4ffd-8c82-a2a7434953ca tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:50.257410 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-79903383-7ed5-4ffd-8c82-a2a7434953ca tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:50.257846 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-79903383-7ed5-4ffd-8c82-a2a7434953ca tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:50.264346 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-176ebc4c-7715-4436-91b5-9bb9f1ab6b35 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:50.264800 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-176ebc4c-7715-4436-91b5-9bb9f1ab6b35 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:50.490707 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-79903383-7ed5-4ffd-8c82-a2a7434953ca tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e11fb79c253c4a0f955d710ff4626f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b46cc4b1ef64d168bf4184339de54d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:50.504795 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-79903383-7ed5-4ffd-8c82-a2a7434953ca tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] 10.222.0.17 "GET /compute/v2.1/servers/d3d6b0e1-57fa-4247-bf6d-18c97aa22750" status: 200 len: 1522 microversion: 2.1 time: 0.276430 Jul 23 21:27:50.505605 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1721/3536] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:50 2022] GET /compute/v2.1/servers/d3d6b0e1-57fa-4247-bf6d-18c97aa22750 => generated 1522 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:50.519159 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-176ebc4c-7715-4436-91b5-9bb9f1ab6b35 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:50.532958 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-176ebc4c-7715-4436-91b5-9bb9f1ab6b35 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/e55e0951-8a56-497b-8bdf-15dd6cc250fd" status: 200 len: 1318 microversion: 2.1 time: 0.301842 Jul 23 21:27:50.534161 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1816/3537] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:50 2022] GET /compute/v2.1/servers/e55e0951-8a56-497b-8bdf-15dd6cc250fd => generated 1318 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:51.003331 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d827b2ad-757c-4d9e-9b57-1af8de8d22c9 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:51.004250 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d827b2ad-757c-4d9e-9b57-1af8de8d22c9 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] [instance: 1516f44b-afba-4f88-ab56-c1f2fb68c74e] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:51.011292 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d827b2ad-757c-4d9e-9b57-1af8de8d22c9 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:51.011822 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d827b2ad-757c-4d9e-9b57-1af8de8d22c9 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:51.012727 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d827b2ad-757c-4d9e-9b57-1af8de8d22c9 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:51.013215 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d827b2ad-757c-4d9e-9b57-1af8de8d22c9 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:51.126449 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-040c7615-b4aa-4e7a-965c-d31625b5f9ec tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:51.127215 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-040c7615-b4aa-4e7a-965c-d31625b5f9ec tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: c4da9681-4d81-4ffb-8d7e-453436e71331] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:51.134775 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-040c7615-b4aa-4e7a-965c-d31625b5f9ec tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:51.135385 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-040c7615-b4aa-4e7a-965c-d31625b5f9ec tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:51.136406 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-040c7615-b4aa-4e7a-965c-d31625b5f9ec tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:51.137044 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-040c7615-b4aa-4e7a-965c-d31625b5f9ec tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:51.267656 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d827b2ad-757c-4d9e-9b57-1af8de8d22c9 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6411b0f635714320a4f40e9bc5e260e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c005e3bc67b4501949fb72140726a11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:51.278801 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d827b2ad-757c-4d9e-9b57-1af8de8d22c9 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] 10.222.0.17 "GET /compute/v2.1/servers/1516f44b-afba-4f88-ab56-c1f2fb68c74e" status: 200 len: 1317 microversion: 2.1 time: 0.279534 Jul 23 21:27:51.280926 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1722/3538] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:50 2022] GET /compute/v2.1/servers/1516f44b-afba-4f88-ab56-c1f2fb68c74e => generated 1317 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:51.286627 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2b8eb6d6-0d9b-48dd-adfd-eb7002706dd1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:51.288204 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-2b8eb6d6-0d9b-48dd-adfd-eb7002706dd1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:51.298409 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2b8eb6d6-0d9b-48dd-adfd-eb7002706dd1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:51.299117 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2b8eb6d6-0d9b-48dd-adfd-eb7002706dd1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:51.299985 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2b8eb6d6-0d9b-48dd-adfd-eb7002706dd1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:51.302302 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2b8eb6d6-0d9b-48dd-adfd-eb7002706dd1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:51.346536 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-040c7615-b4aa-4e7a-965c-d31625b5f9ec tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:51.371402 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-040c7615-b4aa-4e7a-965c-d31625b5f9ec tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331" status: 200 len: 1524 microversion: 2.1 time: 0.254248 Jul 23 21:27:51.371402 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1817/3539] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:51 2022] GET /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331 => generated 1524 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:27:51.416884 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-2b8eb6d6-0d9b-48dd-adfd-eb7002706dd1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:51.427480 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-2b8eb6d6-0d9b-48dd-adfd-eb7002706dd1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:51.429040 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-2b8eb6d6-0d9b-48dd-adfd-eb7002706dd1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:51.430288 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2b8eb6d6-0d9b-48dd-adfd-eb7002706dd1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.148106 Jul 23 21:27:51.431033 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1723/3540] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:27:51 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:27:51.522256 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-42abc2a8-f460-474a-ad7b-70e3740f8da8 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:51.522873 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-42abc2a8-f460-474a-ad7b-70e3740f8da8 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] [instance: d3d6b0e1-57fa-4247-bf6d-18c97aa22750] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:51.529038 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-42abc2a8-f460-474a-ad7b-70e3740f8da8 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:51.529496 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-42abc2a8-f460-474a-ad7b-70e3740f8da8 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:51.530310 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-42abc2a8-f460-474a-ad7b-70e3740f8da8 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:51.530752 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-42abc2a8-f460-474a-ad7b-70e3740f8da8 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:51.557234 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-49b57223-7f59-48ec-b138-23472d41abbf tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:51.559052 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-49b57223-7f59-48ec-b138-23472d41abbf tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: e55e0951-8a56-497b-8bdf-15dd6cc250fd] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:51.578716 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-49b57223-7f59-48ec-b138-23472d41abbf tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:51.579868 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-49b57223-7f59-48ec-b138-23472d41abbf tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:51.582539 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-49b57223-7f59-48ec-b138-23472d41abbf tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:51.583906 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-49b57223-7f59-48ec-b138-23472d41abbf tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:51.727865 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-42abc2a8-f460-474a-ad7b-70e3740f8da8 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e11fb79c253c4a0f955d710ff4626f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b46cc4b1ef64d168bf4184339de54d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:51.737271 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-42abc2a8-f460-474a-ad7b-70e3740f8da8 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] 10.222.0.17 "GET /compute/v2.1/servers/d3d6b0e1-57fa-4247-bf6d-18c97aa22750" status: 200 len: 1522 microversion: 2.1 time: 0.218724 Jul 23 21:27:51.739152 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1818/3541] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:51 2022] GET /compute/v2.1/servers/d3d6b0e1-57fa-4247-bf6d-18c97aa22750 => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:51.850194 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-49b57223-7f59-48ec-b138-23472d41abbf tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:51.859764 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-49b57223-7f59-48ec-b138-23472d41abbf tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/e55e0951-8a56-497b-8bdf-15dd6cc250fd" status: 200 len: 1318 microversion: 2.1 time: 0.311860 Jul 23 21:27:51.869778 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1724/3542] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:51 2022] GET /compute/v2.1/servers/e55e0951-8a56-497b-8bdf-15dd6cc250fd => generated 1318 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:52.302635 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-85407c28-2ab5-4183-bbcb-d7cd24c28e92 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:52.302635 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-85407c28-2ab5-4183-bbcb-d7cd24c28e92 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] [instance: 1516f44b-afba-4f88-ab56-c1f2fb68c74e] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:52.316322 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-85407c28-2ab5-4183-bbcb-d7cd24c28e92 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:52.316322 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-85407c28-2ab5-4183-bbcb-d7cd24c28e92 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:52.317606 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-85407c28-2ab5-4183-bbcb-d7cd24c28e92 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:52.318185 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-85407c28-2ab5-4183-bbcb-d7cd24c28e92 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:52.395046 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-188aa163-a79d-4e76-bd00-fec21211e610 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:52.396569 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-188aa163-a79d-4e76-bd00-fec21211e610 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: c4da9681-4d81-4ffb-8d7e-453436e71331] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:52.418183 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-188aa163-a79d-4e76-bd00-fec21211e610 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:52.422452 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-188aa163-a79d-4e76-bd00-fec21211e610 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:52.425079 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-188aa163-a79d-4e76-bd00-fec21211e610 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:52.426737 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-188aa163-a79d-4e76-bd00-fec21211e610 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:52.678061 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-188aa163-a79d-4e76-bd00-fec21211e610 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:52.690423 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-188aa163-a79d-4e76-bd00-fec21211e610 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331" status: 200 len: 1524 microversion: 2.1 time: 0.305273 Jul 23 21:27:52.691241 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1725/3543] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:52 2022] GET /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331 => generated 1524 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:27:52.701114 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1289b1f4-a494-44df-8236-b32426bbca42 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:52.701114 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1289b1f4-a494-44df-8236-b32426bbca42 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:52.706298 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1289b1f4-a494-44df-8236-b32426bbca42 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:52.706790 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1289b1f4-a494-44df-8236-b32426bbca42 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:52.707944 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1289b1f4-a494-44df-8236-b32426bbca42 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:52.708616 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1289b1f4-a494-44df-8236-b32426bbca42 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:52.768520 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-85407c28-2ab5-4183-bbcb-d7cd24c28e92 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6411b0f635714320a4f40e9bc5e260e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c005e3bc67b4501949fb72140726a11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:52.778637 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-85407c28-2ab5-4183-bbcb-d7cd24c28e92 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] 10.222.0.17 "GET /compute/v2.1/servers/1516f44b-afba-4f88-ab56-c1f2fb68c74e" status: 200 len: 1317 microversion: 2.1 time: 0.485594 Jul 23 21:27:52.792179 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1819/3544] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:52 2022] GET /compute/v2.1/servers/1516f44b-afba-4f88-ab56-c1f2fb68c74e => generated 1317 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:52.797152 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-bfd21942-339f-45bf-be1d-abbd0010a233 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:52.797770 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-bfd21942-339f-45bf-be1d-abbd0010a233 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] [instance: d3d6b0e1-57fa-4247-bf6d-18c97aa22750] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:52.820285 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-1289b1f4-a494-44df-8236-b32426bbca42 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:52.825905 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bfd21942-339f-45bf-be1d-abbd0010a233 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:52.835549 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-1289b1f4-a494-44df-8236-b32426bbca42 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:52.837040 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-1289b1f4-a494-44df-8236-b32426bbca42 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:52.839086 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bfd21942-339f-45bf-be1d-abbd0010a233 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:52.840012 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bfd21942-339f-45bf-be1d-abbd0010a233 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:52.840459 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bfd21942-339f-45bf-be1d-abbd0010a233 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:52.847087 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1289b1f4-a494-44df-8236-b32426bbca42 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.146118 Jul 23 21:27:52.848496 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1726/3545] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:27:52 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:27:52.876667 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c653ef47-a86a-40ee-b553-6036cad2b570 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:52.877281 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c653ef47-a86a-40ee-b553-6036cad2b570 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: e55e0951-8a56-497b-8bdf-15dd6cc250fd] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:52.888241 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c653ef47-a86a-40ee-b553-6036cad2b570 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:52.888698 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c653ef47-a86a-40ee-b553-6036cad2b570 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:52.892172 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c653ef47-a86a-40ee-b553-6036cad2b570 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:52.892655 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c653ef47-a86a-40ee-b553-6036cad2b570 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:53.109100 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c653ef47-a86a-40ee-b553-6036cad2b570 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:53.118943 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c653ef47-a86a-40ee-b553-6036cad2b570 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/e55e0951-8a56-497b-8bdf-15dd6cc250fd" status: 200 len: 1318 microversion: 2.1 time: 0.246147 Jul 23 21:27:53.119916 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1727/3546] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:52 2022] GET /compute/v2.1/servers/e55e0951-8a56-497b-8bdf-15dd6cc250fd => generated 1318 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:53.228353 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-bfd21942-339f-45bf-be1d-abbd0010a233 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e11fb79c253c4a0f955d710ff4626f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b46cc4b1ef64d168bf4184339de54d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:53.242932 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-bfd21942-339f-45bf-be1d-abbd0010a233 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] 10.222.0.17 "GET /compute/v2.1/servers/d3d6b0e1-57fa-4247-bf6d-18c97aa22750" status: 200 len: 1522 microversion: 2.1 time: 0.449569 Jul 23 21:27:53.259934 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1820/3547] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:52 2022] GET /compute/v2.1/servers/d3d6b0e1-57fa-4247-bf6d-18c97aa22750 => generated 1522 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:53.708845 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b7d47161-2035-4fa4-b9d6-c9ccbc6376fc tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:53.709587 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b7d47161-2035-4fa4-b9d6-c9ccbc6376fc tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: c4da9681-4d81-4ffb-8d7e-453436e71331] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:53.722767 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:53.723591 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=8 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:53.725404 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b7d47161-2035-4fa4-b9d6-c9ccbc6376fc tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:53.726040 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b7d47161-2035-4fa4-b9d6-c9ccbc6376fc tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:53.727467 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b7d47161-2035-4fa4-b9d6-c9ccbc6376fc tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:53.728083 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b7d47161-2035-4fa4-b9d6-c9ccbc6376fc tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:53.795949 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d8dbf882-36e3-4c08-92d2-cd0594a808f3 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:53.796772 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-d8dbf882-36e3-4c08-92d2-cd0594a808f3 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] [instance: 1516f44b-afba-4f88-ab56-c1f2fb68c74e] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:53.805534 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d8dbf882-36e3-4c08-92d2-cd0594a808f3 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:53.806035 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d8dbf882-36e3-4c08-92d2-cd0594a808f3 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:53.806814 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d8dbf882-36e3-4c08-92d2-cd0594a808f3 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:53.807253 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d8dbf882-36e3-4c08-92d2-cd0594a808f3 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:53.986029 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell0:SELECT=8 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:53.996658 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b7d47161-2035-4fa4-b9d6-c9ccbc6376fc tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:54.017391 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b7d47161-2035-4fa4-b9d6-c9ccbc6376fc tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331" status: 200 len: 1524 microversion: 2.1 time: 0.313160 Jul 23 21:27:54.021579 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1728/3548] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:53 2022] GET /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331 => generated 1524 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:54.044110 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-35eb97b0-1bcf-488f-901b-26a95a7584c8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:54.045520 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-35eb97b0-1bcf-488f-901b-26a95a7584c8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:54.071409 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-35eb97b0-1bcf-488f-901b-26a95a7584c8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:54.073201 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-35eb97b0-1bcf-488f-901b-26a95a7584c8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:54.074225 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-35eb97b0-1bcf-488f-901b-26a95a7584c8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:54.076770 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-35eb97b0-1bcf-488f-901b-26a95a7584c8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:54.081249 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-d8dbf882-36e3-4c08-92d2-cd0594a808f3 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6411b0f635714320a4f40e9bc5e260e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c005e3bc67b4501949fb72140726a11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:54.097909 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-d8dbf882-36e3-4c08-92d2-cd0594a808f3 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] 10.222.0.17 "GET /compute/v2.1/servers/1516f44b-afba-4f88-ab56-c1f2fb68c74e" status: 200 len: 1506 microversion: 2.1 time: 0.306204 Jul 23 21:27:54.111272 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1821/3549] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:53 2022] GET /compute/v2.1/servers/1516f44b-afba-4f88-ab56-c1f2fb68c74e => generated 1506 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:27:54.123158 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-64e92769-eee5-4ff0-9174-769f8bdc0481 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:54.125144 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-64e92769-eee5-4ff0-9174-769f8bdc0481 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] [instance: 1516f44b-afba-4f88-ab56-c1f2fb68c74e] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:54.138680 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-64e92769-eee5-4ff0-9174-769f8bdc0481 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:54.139337 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-64e92769-eee5-4ff0-9174-769f8bdc0481 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:54.140302 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-64e92769-eee5-4ff0-9174-769f8bdc0481 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:54.140934 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-64e92769-eee5-4ff0-9174-769f8bdc0481 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:54.195292 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-64e92769-eee5-4ff0-9174-769f8bdc0481 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] 10.222.0.17 "GET /compute/v2.1/servers/1516f44b-afba-4f88-ab56-c1f2fb68c74e/ips" status: 200 len: 109 microversion: 2.1 time: 0.078538 Jul 23 21:27:54.202664 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1822/3550] 10.222.0.17 () {58 vars in 1247 bytes} [Sat Jul 23 21:27:54 2022] GET /compute/v2.1/servers/1516f44b-afba-4f88-ab56-c1f2fb68c74e/ips => generated 109 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:27:54.212364 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-583fc3c4-d3da-4f4c-83bf-144fd2cb1f72 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:54.215318 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-583fc3c4-d3da-4f4c-83bf-144fd2cb1f72 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: e55e0951-8a56-497b-8bdf-15dd6cc250fd] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:54.220120 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-35eb97b0-1bcf-488f-901b-26a95a7584c8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:54.231864 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-583fc3c4-d3da-4f4c-83bf-144fd2cb1f72 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:54.232693 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-35eb97b0-1bcf-488f-901b-26a95a7584c8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:54.233345 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-583fc3c4-d3da-4f4c-83bf-144fd2cb1f72 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:54.234956 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-583fc3c4-d3da-4f4c-83bf-144fd2cb1f72 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:54.236478 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-35eb97b0-1bcf-488f-901b-26a95a7584c8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:54.238599 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-35eb97b0-1bcf-488f-901b-26a95a7584c8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.203635 Jul 23 21:27:54.239610 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1729/3551] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:27:54 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:27:54.241113 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-583fc3c4-d3da-4f4c-83bf-144fd2cb1f72 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:54.244862 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-92681730-5fd7-41e0-8382-41f873101935 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:54.245437 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-92681730-5fd7-41e0-8382-41f873101935 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] [instance: 1516f44b-afba-4f88-ab56-c1f2fb68c74e] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:54.254962 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-92681730-5fd7-41e0-8382-41f873101935 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:54.255702 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-92681730-5fd7-41e0-8382-41f873101935 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:54.256756 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-92681730-5fd7-41e0-8382-41f873101935 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:54.257552 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-92681730-5fd7-41e0-8382-41f873101935 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:54.290813 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-92681730-5fd7-41e0-8382-41f873101935 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] 10.222.0.17 "GET /compute/v2.1/servers/1516f44b-afba-4f88-ab56-c1f2fb68c74e/ips" status: 200 len: 109 microversion: 2.1 time: 0.049765 Jul 23 21:27:54.292163 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1730/3552] 10.222.0.17 () {58 vars in 1247 bytes} [Sat Jul 23 21:27:54 2022] GET /compute/v2.1/servers/1516f44b-afba-4f88-ab56-c1f2fb68c74e/ips => generated 109 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:27:54.297456 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6385d406-ede7-4be5-ac46-e82ec2bacaaa tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:54.298395 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6385d406-ede7-4be5-ac46-e82ec2bacaaa tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] [instance: d3d6b0e1-57fa-4247-bf6d-18c97aa22750] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:54.305657 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6385d406-ede7-4be5-ac46-e82ec2bacaaa tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:54.307138 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6385d406-ede7-4be5-ac46-e82ec2bacaaa tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:54.308091 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6385d406-ede7-4be5-ac46-e82ec2bacaaa tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:54.308699 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6385d406-ede7-4be5-ac46-e82ec2bacaaa tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:54.505270 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-583fc3c4-d3da-4f4c-83bf-144fd2cb1f72 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:54.518026 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-583fc3c4-d3da-4f4c-83bf-144fd2cb1f72 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/e55e0951-8a56-497b-8bdf-15dd6cc250fd" status: 200 len: 1318 microversion: 2.1 time: 0.312475 Jul 23 21:27:54.519060 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1823/3553] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:54 2022] GET /compute/v2.1/servers/e55e0951-8a56-497b-8bdf-15dd6cc250fd => generated 1318 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:54.520116 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6385d406-ede7-4be5-ac46-e82ec2bacaaa tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e11fb79c253c4a0f955d710ff4626f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b46cc4b1ef64d168bf4184339de54d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:54.526014 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-2c08b964-6358-47ea-a812-2af23f5eb541 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:54.530079 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-2c08b964-6358-47ea-a812-2af23f5eb541 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] [instance: 1516f44b-afba-4f88-ab56-c1f2fb68c74e] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:54.530413 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6385d406-ede7-4be5-ac46-e82ec2bacaaa tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] 10.222.0.17 "GET /compute/v2.1/servers/d3d6b0e1-57fa-4247-bf6d-18c97aa22750" status: 200 len: 1522 microversion: 2.1 time: 0.236396 Jul 23 21:27:54.540179 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1731/3554] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:54 2022] GET /compute/v2.1/servers/d3d6b0e1-57fa-4247-bf6d-18c97aa22750 => generated 1522 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:54.540400 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2c08b964-6358-47ea-a812-2af23f5eb541 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:54.543401 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2c08b964-6358-47ea-a812-2af23f5eb541 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:54.544366 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2c08b964-6358-47ea-a812-2af23f5eb541 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:54.544659 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2c08b964-6358-47ea-a812-2af23f5eb541 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:54.594227 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-2c08b964-6358-47ea-a812-2af23f5eb541 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] 10.222.0.17 "GET /compute/v2.1/servers/1516f44b-afba-4f88-ab56-c1f2fb68c74e/ips/tempest-ServerAddressesTestJSON-1694645359-network" status: 200 len: 94 microversion: 2.1 time: 0.073803 Jul 23 21:27:54.594834 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1824/3555] 10.222.0.17 () {58 vars in 1400 bytes} [Sat Jul 23 21:27:54 2022] GET /compute/v2.1/servers/1516f44b-afba-4f88-ab56-c1f2fb68c74e/ips/tempest-ServerAddressesTestJSON-1694645359-network => generated 94 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 23 21:27:54.609577 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9a63a227-1ac1-44db-8fc8-2fcbc67ac638 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:54.610207 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-9a63a227-1ac1-44db-8fc8-2fcbc67ac638 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] [instance: 1516f44b-afba-4f88-ab56-c1f2fb68c74e] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:54.621379 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9a63a227-1ac1-44db-8fc8-2fcbc67ac638 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:54.621832 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9a63a227-1ac1-44db-8fc8-2fcbc67ac638 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:54.622646 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9a63a227-1ac1-44db-8fc8-2fcbc67ac638 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:54.623082 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9a63a227-1ac1-44db-8fc8-2fcbc67ac638 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:54.663066 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-9a63a227-1ac1-44db-8fc8-2fcbc67ac638 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] [instance: 1516f44b-afba-4f88-ab56-c1f2fb68c74e] Going to try to terminate instance {{(pid=131320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:27:54.691175 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=100 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:54.786321 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9a63a227-1ac1-44db-8fc8-2fcbc67ac638 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] 10.222.0.17 "DELETE /compute/v2.1/servers/1516f44b-afba-4f88-ab56-c1f2fb68c74e" status: 204 len: 0 microversion: 2.1 time: 0.182145 Jul 23 21:27:54.790124 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1732/3556] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:27:54 2022] DELETE /compute/v2.1/servers/1516f44b-afba-4f88-ab56-c1f2fb68c74e => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:27:54.795437 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-1e41dc78-4e26-4af1-b60d-afe5c9817a9e tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:54.796384 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-1e41dc78-4e26-4af1-b60d-afe5c9817a9e tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] [instance: 1516f44b-afba-4f88-ab56-c1f2fb68c74e] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:54.803548 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1e41dc78-4e26-4af1-b60d-afe5c9817a9e tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:54.804009 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1e41dc78-4e26-4af1-b60d-afe5c9817a9e tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:54.806358 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1e41dc78-4e26-4af1-b60d-afe5c9817a9e tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:54.806801 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1e41dc78-4e26-4af1-b60d-afe5c9817a9e tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:54.999414 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-1e41dc78-4e26-4af1-b60d-afe5c9817a9e tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6411b0f635714320a4f40e9bc5e260e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c005e3bc67b4501949fb72140726a11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:55.013067 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-1e41dc78-4e26-4af1-b60d-afe5c9817a9e tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] 10.222.0.17 "GET /compute/v2.1/servers/1516f44b-afba-4f88-ab56-c1f2fb68c74e" status: 200 len: 1512 microversion: 2.1 time: 0.221280 Jul 23 21:27:55.013879 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1825/3557] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:54 2022] GET /compute/v2.1/servers/1516f44b-afba-4f88-ab56-c1f2fb68c74e => generated 1512 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:55.039529 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-41a1b742-1306-434b-900e-299805a9132e tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:55.040756 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-41a1b742-1306-434b-900e-299805a9132e tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: c4da9681-4d81-4ffb-8d7e-453436e71331] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:55.057235 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-41a1b742-1306-434b-900e-299805a9132e tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:55.058485 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-41a1b742-1306-434b-900e-299805a9132e tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:55.060611 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-41a1b742-1306-434b-900e-299805a9132e tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:55.062506 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-41a1b742-1306-434b-900e-299805a9132e tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:55.259272 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-34710918-2536-4d74-9185-905ea1d84e59 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:55.259884 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-34710918-2536-4d74-9185-905ea1d84e59 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:55.268580 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-34710918-2536-4d74-9185-905ea1d84e59 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:55.270104 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-34710918-2536-4d74-9185-905ea1d84e59 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:55.272628 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-34710918-2536-4d74-9185-905ea1d84e59 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:55.277254 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-41a1b742-1306-434b-900e-299805a9132e tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:55.282294 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-34710918-2536-4d74-9185-905ea1d84e59 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:55.288754 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-41a1b742-1306-434b-900e-299805a9132e tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331" status: 200 len: 1524 microversion: 2.1 time: 0.253770 Jul 23 21:27:55.294060 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1733/3558] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:55 2022] GET /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331 => generated 1524 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:55.414770 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-34710918-2536-4d74-9185-905ea1d84e59 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:55.428499 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-34710918-2536-4d74-9185-905ea1d84e59 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:55.430516 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-34710918-2536-4d74-9185-905ea1d84e59 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:55.432805 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-34710918-2536-4d74-9185-905ea1d84e59 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.177477 Jul 23 21:27:55.446540 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1826/3559] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:27:55 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:27:55.537211 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-bbfe3e0b-c148-4414-aca2-7251e0d256b5 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:55.538530 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-bbfe3e0b-c148-4414-aca2-7251e0d256b5 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: e55e0951-8a56-497b-8bdf-15dd6cc250fd] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:55.548187 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-19991024-a777-484b-be63-7af89cd7a61c tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:55.549204 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-19991024-a777-484b-be63-7af89cd7a61c tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] [instance: d3d6b0e1-57fa-4247-bf6d-18c97aa22750] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:55.559325 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-19991024-a777-484b-be63-7af89cd7a61c tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:55.560586 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bbfe3e0b-c148-4414-aca2-7251e0d256b5 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:55.563657 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-19991024-a777-484b-be63-7af89cd7a61c tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:55.564446 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bbfe3e0b-c148-4414-aca2-7251e0d256b5 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:55.564572 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-19991024-a777-484b-be63-7af89cd7a61c tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:55.564949 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-19991024-a777-484b-be63-7af89cd7a61c tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:55.565839 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bbfe3e0b-c148-4414-aca2-7251e0d256b5 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:55.566769 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bbfe3e0b-c148-4414-aca2-7251e0d256b5 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:55.850739 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-bbfe3e0b-c148-4414-aca2-7251e0d256b5 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:55.864202 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-bbfe3e0b-c148-4414-aca2-7251e0d256b5 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/e55e0951-8a56-497b-8bdf-15dd6cc250fd" status: 200 len: 1318 microversion: 2.1 time: 0.329758 Jul 23 21:27:55.865595 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1734/3560] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:55 2022] GET /compute/v2.1/servers/e55e0951-8a56-497b-8bdf-15dd6cc250fd => generated 1318 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:55.874935 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-5fcaf484-2239-44a2-a30e-88b34b45a3aa req-b39583a1-3533-4538-968a-fa20e0ae6c7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e55e0951-8a56-497b-8bdf-15dd6cc250fd", "name": "network-vif-plugged", "status": "completed", "tag": "36c01a6d-b578-4e94-8b0a-f12d45fa0bd7"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:27:55.885313 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-5fcaf484-2239-44a2-a30e-88b34b45a3aa req-b39583a1-3533-4538-968a-fa20e0ae6c7e service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:55.886382 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-5fcaf484-2239-44a2-a30e-88b34b45a3aa req-b39583a1-3533-4538-968a-fa20e0ae6c7e service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:55.911413 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-5fcaf484-2239-44a2-a30e-88b34b45a3aa req-b39583a1-3533-4538-968a-fa20e0ae6c7e service nova] Creating event network-vif-plugged:36c01a6d-b578-4e94-8b0a-f12d45fa0bd7 for instance e55e0951-8a56-497b-8bdf-15dd6cc250fd on nch1-master-1 Jul 23 21:27:55.918849 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-5fcaf484-2239-44a2-a30e-88b34b45a3aa req-b39583a1-3533-4538-968a-fa20e0ae6c7e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051043 Jul 23 21:27:55.919706 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1735/3561] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:27:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:27:56.031711 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9672fe8f-dc89-4b00-9dfc-1b9670e15cf6 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:56.032421 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-9672fe8f-dc89-4b00-9dfc-1b9670e15cf6 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] [instance: 1516f44b-afba-4f88-ab56-c1f2fb68c74e] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:56.046720 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9672fe8f-dc89-4b00-9dfc-1b9670e15cf6 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:56.047242 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9672fe8f-dc89-4b00-9dfc-1b9670e15cf6 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:56.048223 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9672fe8f-dc89-4b00-9dfc-1b9670e15cf6 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:56.048652 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9672fe8f-dc89-4b00-9dfc-1b9670e15cf6 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:56.315897 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-9672fe8f-dc89-4b00-9dfc-1b9670e15cf6 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6411b0f635714320a4f40e9bc5e260e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c005e3bc67b4501949fb72140726a11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:56.330184 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9672fe8f-dc89-4b00-9dfc-1b9670e15cf6 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] 10.222.0.17 "GET /compute/v2.1/servers/1516f44b-afba-4f88-ab56-c1f2fb68c74e" status: 200 len: 1512 microversion: 2.1 time: 0.302785 Jul 23 21:27:56.331676 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1736/3562] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:56 2022] GET /compute/v2.1/servers/1516f44b-afba-4f88-ab56-c1f2fb68c74e => generated 1512 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:56.336649 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2315c40c-0921-40ff-aca3-ca52562997f7 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:56.337448 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-2315c40c-0921-40ff-aca3-ca52562997f7 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: c4da9681-4d81-4ffb-8d7e-453436e71331] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:56.347566 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2315c40c-0921-40ff-aca3-ca52562997f7 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:56.348331 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2315c40c-0921-40ff-aca3-ca52562997f7 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:56.349326 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2315c40c-0921-40ff-aca3-ca52562997f7 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:56.349989 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2315c40c-0921-40ff-aca3-ca52562997f7 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:56.524714 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-2315c40c-0921-40ff-aca3-ca52562997f7 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:56.533285 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2315c40c-0921-40ff-aca3-ca52562997f7 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331" status: 200 len: 1524 microversion: 2.1 time: 0.200194 Jul 23 21:27:56.533901 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1737/3563] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:56 2022] GET /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331 => generated 1524 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:56.546817 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e72d1eeb-6ca9-46db-8aea-c132fbd1dd70 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:56.547736 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e72d1eeb-6ca9-46db-8aea-c132fbd1dd70 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:56.556946 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e72d1eeb-6ca9-46db-8aea-c132fbd1dd70 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:56.557700 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e72d1eeb-6ca9-46db-8aea-c132fbd1dd70 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:56.559073 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e72d1eeb-6ca9-46db-8aea-c132fbd1dd70 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:56.559674 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e72d1eeb-6ca9-46db-8aea-c132fbd1dd70 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:56.561572 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-19991024-a777-484b-be63-7af89cd7a61c tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e11fb79c253c4a0f955d710ff4626f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b46cc4b1ef64d168bf4184339de54d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:56.576960 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-19991024-a777-484b-be63-7af89cd7a61c tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] 10.222.0.17 "GET /compute/v2.1/servers/d3d6b0e1-57fa-4247-bf6d-18c97aa22750" status: 200 len: 1522 microversion: 2.1 time: 1.032809 Jul 23 21:27:56.577552 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1827/3564] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:55 2022] GET /compute/v2.1/servers/d3d6b0e1-57fa-4247-bf6d-18c97aa22750 => generated 1522 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:56.645408 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e72d1eeb-6ca9-46db-8aea-c132fbd1dd70 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:56.656002 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e72d1eeb-6ca9-46db-8aea-c132fbd1dd70 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:56.657701 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e72d1eeb-6ca9-46db-8aea-c132fbd1dd70 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:56.659022 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e72d1eeb-6ca9-46db-8aea-c132fbd1dd70 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.124134 Jul 23 21:27:56.659618 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1738/3565] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:27:56 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:27:56.882153 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f83845f4-df68-43f6-859b-af1306c59f16 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:56.882623 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-f83845f4-df68-43f6-859b-af1306c59f16 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: e55e0951-8a56-497b-8bdf-15dd6cc250fd] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:56.895832 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f83845f4-df68-43f6-859b-af1306c59f16 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:56.896292 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f83845f4-df68-43f6-859b-af1306c59f16 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:56.897103 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f83845f4-df68-43f6-859b-af1306c59f16 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:56.897753 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f83845f4-df68-43f6-859b-af1306c59f16 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:57.313662 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-f83845f4-df68-43f6-859b-af1306c59f16 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:57.329455 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-f83845f4-df68-43f6-859b-af1306c59f16 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/e55e0951-8a56-497b-8bdf-15dd6cc250fd" status: 200 len: 1318 microversion: 2.1 time: 0.450181 Jul 23 21:27:57.332135 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1828/3566] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:56 2022] GET /compute/v2.1/servers/e55e0951-8a56-497b-8bdf-15dd6cc250fd => generated 1318 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:57.349298 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-01259f25-53c9-4c70-a00d-794d9261bed6 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:57.351052 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-01259f25-53c9-4c70-a00d-794d9261bed6 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] [instance: 1516f44b-afba-4f88-ab56-c1f2fb68c74e] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:57.366037 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-01259f25-53c9-4c70-a00d-794d9261bed6 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:57.369944 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-01259f25-53c9-4c70-a00d-794d9261bed6 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:57.371117 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-01259f25-53c9-4c70-a00d-794d9261bed6 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:57.373008 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-01259f25-53c9-4c70-a00d-794d9261bed6 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:57.551507 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-94edaba1-11ad-44be-ad19-381f5c68f870 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:57.552130 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-94edaba1-11ad-44be-ad19-381f5c68f870 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: c4da9681-4d81-4ffb-8d7e-453436e71331] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:57.555500 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:57.564708 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-94edaba1-11ad-44be-ad19-381f5c68f870 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:57.565363 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-94edaba1-11ad-44be-ad19-381f5c68f870 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:57.565979 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-94edaba1-11ad-44be-ad19-381f5c68f870 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:57.566495 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-94edaba1-11ad-44be-ad19-381f5c68f870 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:57.664473 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-01259f25-53c9-4c70-a00d-794d9261bed6 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6411b0f635714320a4f40e9bc5e260e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c005e3bc67b4501949fb72140726a11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:57.677379 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-01259f25-53c9-4c70-a00d-794d9261bed6 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] 10.222.0.17 "GET /compute/v2.1/servers/1516f44b-afba-4f88-ab56-c1f2fb68c74e" status: 200 len: 1512 microversion: 2.1 time: 0.333322 Jul 23 21:27:57.679593 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1739/3567] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:57 2022] GET /compute/v2.1/servers/1516f44b-afba-4f88-ab56-c1f2fb68c74e => generated 1512 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:57.714098 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-93e2f9f9-9b02-4316-b1f1-6c68b6f3f2a7 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:57.717194 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-93e2f9f9-9b02-4316-b1f1-6c68b6f3f2a7 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] [instance: d3d6b0e1-57fa-4247-bf6d-18c97aa22750] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:57.750426 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-93e2f9f9-9b02-4316-b1f1-6c68b6f3f2a7 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:57.751222 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-93e2f9f9-9b02-4316-b1f1-6c68b6f3f2a7 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:57.755859 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-93e2f9f9-9b02-4316-b1f1-6c68b6f3f2a7 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:57.758082 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-93e2f9f9-9b02-4316-b1f1-6c68b6f3f2a7 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:57.974253 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-94edaba1-11ad-44be-ad19-381f5c68f870 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:57.996047 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-94edaba1-11ad-44be-ad19-381f5c68f870 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331" status: 200 len: 1524 microversion: 2.1 time: 0.448394 Jul 23 21:27:58.006543 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1829/3568] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:57 2022] GET /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331 => generated 1524 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:27:58.016616 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ee4a2f83-0a0d-4981-b254-7f44b78e293c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:58.017590 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-ee4a2f83-0a0d-4981-b254-7f44b78e293c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:58.025009 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ee4a2f83-0a0d-4981-b254-7f44b78e293c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:58.026469 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ee4a2f83-0a0d-4981-b254-7f44b78e293c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:58.027508 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ee4a2f83-0a0d-4981-b254-7f44b78e293c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:58.028175 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ee4a2f83-0a0d-4981-b254-7f44b78e293c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:58.110710 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-93e2f9f9-9b02-4316-b1f1-6c68b6f3f2a7 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e11fb79c253c4a0f955d710ff4626f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b46cc4b1ef64d168bf4184339de54d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:58.126917 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-93e2f9f9-9b02-4316-b1f1-6c68b6f3f2a7 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] 10.222.0.17 "GET /compute/v2.1/servers/d3d6b0e1-57fa-4247-bf6d-18c97aa22750" status: 200 len: 1522 microversion: 2.1 time: 0.445095 Jul 23 21:27:58.128123 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1740/3569] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:57 2022] GET /compute/v2.1/servers/d3d6b0e1-57fa-4247-bf6d-18c97aa22750 => generated 1522 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:58.141919 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-90675bc2-8d3f-41f9-a2c3-23e46cc3ae93 req-88e094a5-928e-49a8-8adf-045b138de53f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1516f44b-afba-4f88-ab56-c1f2fb68c74e", "name": "network-vif-deleted", "tag": "3dea3342-e8ae-4cc4-b025-3cb0df4712cc"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:27:58.160883 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-90675bc2-8d3f-41f9-a2c3-23e46cc3ae93 req-88e094a5-928e-49a8-8adf-045b138de53f service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:58.162075 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-90675bc2-8d3f-41f9-a2c3-23e46cc3ae93 req-88e094a5-928e-49a8-8adf-045b138de53f service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:58.173032 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ee4a2f83-0a0d-4981-b254-7f44b78e293c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:58.192657 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ee4a2f83-0a0d-4981-b254-7f44b78e293c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:58.208104 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-90675bc2-8d3f-41f9-a2c3-23e46cc3ae93 req-88e094a5-928e-49a8-8adf-045b138de53f service nova] Creating event network-vif-deleted:3dea3342-e8ae-4cc4-b025-3cb0df4712cc for instance 1516f44b-afba-4f88-ab56-c1f2fb68c74e on nch1-master-1 Jul 23 21:27:58.213989 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ee4a2f83-0a0d-4981-b254-7f44b78e293c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:58.214738 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-90675bc2-8d3f-41f9-a2c3-23e46cc3ae93 req-88e094a5-928e-49a8-8adf-045b138de53f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084558 Jul 23 21:27:58.216081 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1741/3570] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:27:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:27:58.217771 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-ee4a2f83-0a0d-4981-b254-7f44b78e293c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.205979 Jul 23 21:27:58.218324 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1830/3571] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:27:58 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:27:58.349972 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b97bf9cf-d773-49c4-b87d-8e13e9175528 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:58.351595 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b97bf9cf-d773-49c4-b87d-8e13e9175528 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: e55e0951-8a56-497b-8bdf-15dd6cc250fd] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:58.368267 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b97bf9cf-d773-49c4-b87d-8e13e9175528 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:58.372938 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b97bf9cf-d773-49c4-b87d-8e13e9175528 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:58.373788 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b97bf9cf-d773-49c4-b87d-8e13e9175528 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:58.376645 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b97bf9cf-d773-49c4-b87d-8e13e9175528 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:58.612793 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b97bf9cf-d773-49c4-b87d-8e13e9175528 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:58.627790 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b97bf9cf-d773-49c4-b87d-8e13e9175528 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/e55e0951-8a56-497b-8bdf-15dd6cc250fd" status: 200 len: 1509 microversion: 2.1 time: 0.282683 Jul 23 21:27:58.631003 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1742/3572] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:58 2022] GET /compute/v2.1/servers/e55e0951-8a56-497b-8bdf-15dd6cc250fd => generated 1509 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:58.653182 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f1c8af9e-9f97-41a8-8a1e-c2227c054159 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:58.654775 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-f1c8af9e-9f97-41a8-8a1e-c2227c054159 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: e55e0951-8a56-497b-8bdf-15dd6cc250fd] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:58.664252 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f1c8af9e-9f97-41a8-8a1e-c2227c054159 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:58.665279 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f1c8af9e-9f97-41a8-8a1e-c2227c054159 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:58.666551 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f1c8af9e-9f97-41a8-8a1e-c2227c054159 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:58.668271 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f1c8af9e-9f97-41a8-8a1e-c2227c054159 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:58.696664 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d1045b06-9f6a-47cf-9a7a-597df291baf9 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:58.697595 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d1045b06-9f6a-47cf-9a7a-597df291baf9 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] [instance: 1516f44b-afba-4f88-ab56-c1f2fb68c74e] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:58.713503 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d1045b06-9f6a-47cf-9a7a-597df291baf9 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:58.715297 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d1045b06-9f6a-47cf-9a7a-597df291baf9 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:58.717153 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d1045b06-9f6a-47cf-9a7a-597df291baf9 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:58.723456 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d1045b06-9f6a-47cf-9a7a-597df291baf9 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:58.729802 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=100 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:58.834339 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d1045b06-9f6a-47cf-9a7a-597df291baf9 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:58.837696 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d1045b06-9f6a-47cf-9a7a-597df291baf9 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:58.838575 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.objects.instance [None req-d1045b06-9f6a-47cf-9a7a-597df291baf9 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Lazy-loading 'fault' on Instance uuid 1516f44b-afba-4f88-ab56-c1f2fb68c74e {{(pid=131320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:27:58.935989 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d1045b06-9f6a-47cf-9a7a-597df291baf9 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6411b0f635714320a4f40e9bc5e260e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c005e3bc67b4501949fb72140726a11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:58.948019 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d1045b06-9f6a-47cf-9a7a-597df291baf9 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] 10.222.0.17 "GET /compute/v2.1/servers/1516f44b-afba-4f88-ab56-c1f2fb68c74e" status: 200 len: 1307 microversion: 2.1 time: 0.255611 Jul 23 21:27:58.948613 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1743/3573] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:58 2022] GET /compute/v2.1/servers/1516f44b-afba-4f88-ab56-c1f2fb68c74e => generated 1307 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:27:59.023293 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-f1c8af9e-9f97-41a8-8a1e-c2227c054159 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:59.023501 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-172d7e8a-d89b-412a-bb55-f362ece1e689 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:59.024111 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-172d7e8a-d89b-412a-bb55-f362ece1e689 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: c4da9681-4d81-4ffb-8d7e-453436e71331] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:59.033810 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-172d7e8a-d89b-412a-bb55-f362ece1e689 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:59.034208 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-172d7e8a-d89b-412a-bb55-f362ece1e689 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:59.035078 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-172d7e8a-d89b-412a-bb55-f362ece1e689 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:59.035515 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-172d7e8a-d89b-412a-bb55-f362ece1e689 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:59.037628 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-f1c8af9e-9f97-41a8-8a1e-c2227c054159 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/e55e0951-8a56-497b-8bdf-15dd6cc250fd" status: 200 len: 1509 microversion: 2.1 time: 0.391198 Jul 23 21:27:59.038380 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1831/3574] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:58 2022] GET /compute/v2.1/servers/e55e0951-8a56-497b-8bdf-15dd6cc250fd => generated 1509 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:59.054424 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-81814b5f-2e5c-4bcc-a27d-660d01e803a7 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:27:59.056027 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-81814b5f-2e5c-4bcc-a27d-660d01e803a7 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: e55e0951-8a56-497b-8bdf-15dd6cc250fd] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:59.064642 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-81814b5f-2e5c-4bcc-a27d-660d01e803a7 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:59.067200 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-81814b5f-2e5c-4bcc-a27d-660d01e803a7 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:59.073339 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-81814b5f-2e5c-4bcc-a27d-660d01e803a7 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:59.074210 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-81814b5f-2e5c-4bcc-a27d-660d01e803a7 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:59.177437 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-81814b5f-2e5c-4bcc-a27d-660d01e803a7 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "PUT /compute/v2.1/servers/e55e0951-8a56-497b-8bdf-15dd6cc250fd" status: 200 len: 1081 microversion: 2.1 time: 0.126932 Jul 23 21:27:59.178241 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1832/3575] 10.222.0.17 () {60 vars in 1255 bytes} [Sat Jul 23 21:27:59 2022] PUT /compute/v2.1/servers/e55e0951-8a56-497b-8bdf-15dd6cc250fd => generated 1081 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:27:59.184060 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-b715e8b5-a8c5-4e0f-98f6-00e3e2c4d469 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:59.184663 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-b715e8b5-a8c5-4e0f-98f6-00e3e2c4d469 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] [instance: d3d6b0e1-57fa-4247-bf6d-18c97aa22750] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:59.194908 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b715e8b5-a8c5-4e0f-98f6-00e3e2c4d469 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:59.195359 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b715e8b5-a8c5-4e0f-98f6-00e3e2c4d469 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:59.196141 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b715e8b5-a8c5-4e0f-98f6-00e3e2c4d469 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:59.196579 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b715e8b5-a8c5-4e0f-98f6-00e3e2c4d469 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:59.240618 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-172d7e8a-d89b-412a-bb55-f362ece1e689 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:59.251301 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-172d7e8a-d89b-412a-bb55-f362ece1e689 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331" status: 200 len: 1524 microversion: 2.1 time: 0.231821 Jul 23 21:27:59.252180 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1744/3576] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:59 2022] GET /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331 => generated 1524 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:59.257175 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-7266b0d5-9fec-4b65-839d-51ddc41d5f87 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:59.258075 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-7266b0d5-9fec-4b65-839d-51ddc41d5f87 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: e55e0951-8a56-497b-8bdf-15dd6cc250fd] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:59.262197 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:27:59.266216 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7266b0d5-9fec-4b65-839d-51ddc41d5f87 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:59.267374 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7266b0d5-9fec-4b65-839d-51ddc41d5f87 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:59.268483 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7266b0d5-9fec-4b65-839d-51ddc41d5f87 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:59.269536 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7266b0d5-9fec-4b65-839d-51ddc41d5f87 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:59.390914 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-b715e8b5-a8c5-4e0f-98f6-00e3e2c4d469 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e11fb79c253c4a0f955d710ff4626f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b46cc4b1ef64d168bf4184339de54d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:59.401408 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-b715e8b5-a8c5-4e0f-98f6-00e3e2c4d469 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] 10.222.0.17 "GET /compute/v2.1/servers/d3d6b0e1-57fa-4247-bf6d-18c97aa22750" status: 200 len: 1522 microversion: 2.1 time: 0.222094 Jul 23 21:27:59.411639 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1833/3577] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:59 2022] GET /compute/v2.1/servers/d3d6b0e1-57fa-4247-bf6d-18c97aa22750 => generated 1522 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:59.422403 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-00630b41-7c4c-48a8-a9f3-81f8aea3a4a8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:59.423301 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-00630b41-7c4c-48a8-a9f3-81f8aea3a4a8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:59.432571 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-00630b41-7c4c-48a8-a9f3-81f8aea3a4a8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:59.433315 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-00630b41-7c4c-48a8-a9f3-81f8aea3a4a8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:59.434304 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-00630b41-7c4c-48a8-a9f3-81f8aea3a4a8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:59.435012 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-00630b41-7c4c-48a8-a9f3-81f8aea3a4a8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:59.531782 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-00630b41-7c4c-48a8-a9f3-81f8aea3a4a8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:59.542321 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-7266b0d5-9fec-4b65-839d-51ddc41d5f87 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:59.546458 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-00630b41-7c4c-48a8-a9f3-81f8aea3a4a8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:59.548280 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-00630b41-7c4c-48a8-a9f3-81f8aea3a4a8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:59.549670 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-00630b41-7c4c-48a8-a9f3-81f8aea3a4a8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.136781 Jul 23 21:27:59.556495 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-7266b0d5-9fec-4b65-839d-51ddc41d5f87 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/e55e0951-8a56-497b-8bdf-15dd6cc250fd" status: 200 len: 1507 microversion: 2.1 time: 0.301309 Jul 23 21:27:59.567753 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1834/3578] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:27:59 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:27:59.570353 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1745/3579] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:59 2022] GET /compute/v2.1/servers/e55e0951-8a56-497b-8bdf-15dd6cc250fd => generated 1507 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:27:59.574964 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-635c3d87-f89b-432a-8c0b-0e1c1b72d457 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:59.575835 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-635c3d87-f89b-432a-8c0b-0e1c1b72d457 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: e55e0951-8a56-497b-8bdf-15dd6cc250fd] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:59.585475 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-635c3d87-f89b-432a-8c0b-0e1c1b72d457 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:59.585956 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-635c3d87-f89b-432a-8c0b-0e1c1b72d457 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:59.587410 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-635c3d87-f89b-432a-8c0b-0e1c1b72d457 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:59.587881 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-635c3d87-f89b-432a-8c0b-0e1c1b72d457 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:59.812953 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-635c3d87-f89b-432a-8c0b-0e1c1b72d457 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:27:59.823984 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-635c3d87-f89b-432a-8c0b-0e1c1b72d457 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/e55e0951-8a56-497b-8bdf-15dd6cc250fd" status: 200 len: 1507 microversion: 2.1 time: 0.254553 Jul 23 21:27:59.839764 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a99ec74f-1a83-4ba4-904b-afde0b181f30 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:27:59.840949 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a99ec74f-1a83-4ba4-904b-afde0b181f30 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: e55e0951-8a56-497b-8bdf-15dd6cc250fd] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:59.849908 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1835/3580] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:59 2022] GET /compute/v2.1/servers/e55e0951-8a56-497b-8bdf-15dd6cc250fd => generated 1507 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:27:59.852053 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a99ec74f-1a83-4ba4-904b-afde0b181f30 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:59.852505 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a99ec74f-1a83-4ba4-904b-afde0b181f30 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:59.853298 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a99ec74f-1a83-4ba4-904b-afde0b181f30 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:59.853735 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a99ec74f-1a83-4ba4-904b-afde0b181f30 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:59.942767 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a99ec74f-1a83-4ba4-904b-afde0b181f30 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "PUT /compute/v2.1/servers/e55e0951-8a56-497b-8bdf-15dd6cc250fd" status: 200 len: 1083 microversion: 2.1 time: 0.106573 Jul 23 21:27:59.944740 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1746/3581] 10.222.0.17 () {60 vars in 1255 bytes} [Sat Jul 23 21:27:59 2022] PUT /compute/v2.1/servers/e55e0951-8a56-497b-8bdf-15dd6cc250fd => generated 1083 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:27:59.958609 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-03f7f505-cfd7-4198-8b53-369fe6d9c941 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:59.959356 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-03f7f505-cfd7-4198-8b53-369fe6d9c941 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: e55e0951-8a56-497b-8bdf-15dd6cc250fd] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:59.967792 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-03f7f505-cfd7-4198-8b53-369fe6d9c941 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:59.972095 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-03f7f505-cfd7-4198-8b53-369fe6d9c941 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:59.973847 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-03f7f505-cfd7-4198-8b53-369fe6d9c941 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:59.974478 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-03f7f505-cfd7-4198-8b53-369fe6d9c941 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:59.974923 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-69bc64ac-fab4-4001-b337-4ad7b48d88d4 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:27:59.978868 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-69bc64ac-fab4-4001-b337-4ad7b48d88d4 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] [instance: 1516f44b-afba-4f88-ab56-c1f2fb68c74e] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:27:59.988354 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-69bc64ac-fab4-4001-b337-4ad7b48d88d4 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:59.988865 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-69bc64ac-fab4-4001-b337-4ad7b48d88d4 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:27:59.989717 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-69bc64ac-fab4-4001-b337-4ad7b48d88d4 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:27:59.990134 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-69bc64ac-fab4-4001-b337-4ad7b48d88d4 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:00.028567 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-69bc64ac-fab4-4001-b337-4ad7b48d88d4 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] HTTP exception thrown: Instance 1516f44b-afba-4f88-ab56-c1f2fb68c74e could not be found. Jul 23 21:28:00.030282 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-69bc64ac-fab4-4001-b337-4ad7b48d88d4 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Request method failure captured: Jul 23 21:28:00.030282 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/1516f44b-afba-4f88-ab56-c1f2fb68c74e HTTP/1.1 Jul 23 21:28:00.030282 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:28:00.030282 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:28:00.030282 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:28:00.030282 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:28:00.030282 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:28:00.030282 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:28:00.030282 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:28:00.030282 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:28:00.030282 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GfJo4rnTjURTvconyFWVhsmsKQYaypEAzMoIcx8P0z9NQHF4csc3pU5xxtVYws1gFNRt5yN9sli5UAA_ROlX2fEd2h7k-5aAzwhGbWfXKQdUvMka8n7msPtPbRszprLOOL1yoCp4kCPzS0FAFy_LtLd-YxGX0iSF9DS_w3hWCrsYXU Jul 23 21:28:00.030282 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:28:00.030282 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:28:00.030282 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:28:00.030282 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:28:00.030282 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:28:00.030282 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:28:00.030282 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 0c005e3bc67b4501949fb72140726a11 Jul 23 21:28:00.030282 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServerAddressesTestJSON-1542621956 Jul 23 21:28:00.030282 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:28:00.030282 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:28:00.030282 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0c005e3bc67b4501949fb72140726a11"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0c005e3bc67b4501949fb72140726a11"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0c005e3bc67b4501949fb72140726a11", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0c005e3bc67b4501949fb72140726a11"}]}] Jul 23 21:28:00.030282 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServerAddressesTestJSON-1542621956 Jul 23 21:28:00.030282 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 0c005e3bc67b4501949fb72140726a11 Jul 23 21:28:00.030282 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServerAddressesTestJSON-1542621956 Jul 23 21:28:00.030282 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServerAddressesTestJSON-1542621956-project Jul 23 21:28:00.030282 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:28:00.030282 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:28:00.030282 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 6411b0f635714320a4f40e9bc5e260e5 Jul 23 21:28:00.030282 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServerAddressesTestJSON-1542621956-project Jul 23 21:28:00.030282 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:28:00.030282 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance 1516f44b-afba-4f88-ab56-c1f2fb68c74e could not be found. Jul 23 21:28:00.030282 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '1516f44b-afba-4f88-ab56-c1f2fb68c74e'} Jul 23 21:28:00.030282 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:28:00.030282 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:28:00.030282 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:28:00.030282 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:28:00.030282 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:28:00.030282 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:28:00.030282 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:28:00.030282 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:28:00.030282 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:28:00.030282 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:28:00.030282 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1516f44b-afba-4f88-ab56-c1f2fb68c74e could not be found. Jul 23 21:28:00.030282 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:28:00.030282 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:28:00.030282 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:28:00.030282 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:28:00.030282 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:28:00.030282 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:28:00.030282 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:28:00.030282 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:28:00.030282 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:28:00.030282 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:28:00.030282 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:28:00.030282 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:28:00.030282 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:28:00.030282 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:28:00.030282 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:28:00.030282 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:28:00.030282 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1516f44b-afba-4f88-ab56-c1f2fb68c74e could not be found. Jul 23 21:28:00.030282 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:28:00.030282 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:28:00.030282 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:28:00.041017 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:28:00.041017 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:28:00.041017 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:28:00.041017 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:28:00.041017 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:28:00.041017 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1516f44b-afba-4f88-ab56-c1f2fb68c74e could not be found. Jul 23 21:28:00.041017 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:28:00.041017 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-69bc64ac-fab4-4001-b337-4ad7b48d88d4 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] Returning 404 to user: Instance 1516f44b-afba-4f88-ab56-c1f2fb68c74e could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:28:00.041017 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-69bc64ac-fab4-4001-b337-4ad7b48d88d4 tempest-ServerAddressesTestJSON-1542621956 tempest-ServerAddressesTestJSON-1542621956-project] 10.222.0.17 "GET /compute/v2.1/servers/1516f44b-afba-4f88-ab56-c1f2fb68c74e" status: 404 len: 111 microversion: 2.1 time: 0.065142 Jul 23 21:28:00.041017 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1747/3582] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:59 2022] GET /compute/v2.1/servers/1516f44b-afba-4f88-ab56-c1f2fb68c74e => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:28:00.182695 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-03f7f505-cfd7-4198-8b53-369fe6d9c941 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:00.192903 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-03f7f505-cfd7-4198-8b53-369fe6d9c941 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/e55e0951-8a56-497b-8bdf-15dd6cc250fd" status: 200 len: 1509 microversion: 2.1 time: 0.238626 Jul 23 21:28:00.209547 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0e930846-1f1a-4d6c-b037-e2859c59fdd3 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:00.210330 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-0e930846-1f1a-4d6c-b037-e2859c59fdd3 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: e55e0951-8a56-497b-8bdf-15dd6cc250fd] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:00.214792 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1836/3583] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:27:59 2022] GET /compute/v2.1/servers/e55e0951-8a56-497b-8bdf-15dd6cc250fd => generated 1509 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:28:00.218567 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0e930846-1f1a-4d6c-b037-e2859c59fdd3 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:00.219400 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0e930846-1f1a-4d6c-b037-e2859c59fdd3 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:00.220345 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0e930846-1f1a-4d6c-b037-e2859c59fdd3 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:00.220982 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0e930846-1f1a-4d6c-b037-e2859c59fdd3 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:00.268879 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-9a92d5d1-5ad9-43d7-b3d4-f21c28c98e05 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:00.271679 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-9a92d5d1-5ad9-43d7-b3d4-f21c28c98e05 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: c4da9681-4d81-4ffb-8d7e-453436e71331] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:00.281934 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9a92d5d1-5ad9-43d7-b3d4-f21c28c98e05 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:00.282791 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9a92d5d1-5ad9-43d7-b3d4-f21c28c98e05 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:00.283901 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9a92d5d1-5ad9-43d7-b3d4-f21c28c98e05 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:00.285127 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9a92d5d1-5ad9-43d7-b3d4-f21c28c98e05 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:00.511984 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-9a92d5d1-5ad9-43d7-b3d4-f21c28c98e05 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:00.522928 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-9a92d5d1-5ad9-43d7-b3d4-f21c28c98e05 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331" status: 200 len: 1524 microversion: 2.1 time: 0.257955 Jul 23 21:28:00.524202 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1837/3584] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:28:00 2022] GET /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331 => generated 1524 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:28:00.525672 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-0e930846-1f1a-4d6c-b037-e2859c59fdd3 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:00.534735 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-0e930846-1f1a-4d6c-b037-e2859c59fdd3 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/e55e0951-8a56-497b-8bdf-15dd6cc250fd" status: 200 len: 1509 microversion: 2.1 time: 0.329830 Jul 23 21:28:00.536377 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1748/3585] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:28:00 2022] GET /compute/v2.1/servers/e55e0951-8a56-497b-8bdf-15dd6cc250fd => generated 1509 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:28:00.539772 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-5b694ffb-0b1c-4420-b003-6520bbc8a6c2 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:00.541520 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-5b694ffb-0b1c-4420-b003-6520bbc8a6c2 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] [instance: d3d6b0e1-57fa-4247-bf6d-18c97aa22750] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:00.554754 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a0201929-58e9-4a1d-8ddd-11c6f7f94143 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:00.556010 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a0201929-58e9-4a1d-8ddd-11c6f7f94143 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: e55e0951-8a56-497b-8bdf-15dd6cc250fd] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:00.558533 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5b694ffb-0b1c-4420-b003-6520bbc8a6c2 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:00.559773 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5b694ffb-0b1c-4420-b003-6520bbc8a6c2 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:00.561265 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5b694ffb-0b1c-4420-b003-6520bbc8a6c2 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:00.561909 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5b694ffb-0b1c-4420-b003-6520bbc8a6c2 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:00.568984 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a0201929-58e9-4a1d-8ddd-11c6f7f94143 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:00.569451 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a0201929-58e9-4a1d-8ddd-11c6f7f94143 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:00.570278 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a0201929-58e9-4a1d-8ddd-11c6f7f94143 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:00.570722 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a0201929-58e9-4a1d-8ddd-11c6f7f94143 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:00.588900 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:00.654905 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a0201929-58e9-4a1d-8ddd-11c6f7f94143 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: e55e0951-8a56-497b-8bdf-15dd6cc250fd] Going to try to terminate instance {{(pid=131320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:28:00.860644 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a0201929-58e9-4a1d-8ddd-11c6f7f94143 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "DELETE /compute/v2.1/servers/e55e0951-8a56-497b-8bdf-15dd6cc250fd" status: 204 len: 0 microversion: 2.1 time: 0.308613 Jul 23 21:28:00.861428 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1749/3586] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:28:00 2022] DELETE /compute/v2.1/servers/e55e0951-8a56-497b-8bdf-15dd6cc250fd => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 23 21:28:00.870591 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-5b694ffb-0b1c-4420-b003-6520bbc8a6c2 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e11fb79c253c4a0f955d710ff4626f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b46cc4b1ef64d168bf4184339de54d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:00.878591 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-52d1f865-7e52-4bf3-bb9f-7b91cf65b875 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:00.879363 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-52d1f865-7e52-4bf3-bb9f-7b91cf65b875 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:00.885263 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-5b694ffb-0b1c-4420-b003-6520bbc8a6c2 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] 10.222.0.17 "GET /compute/v2.1/servers/d3d6b0e1-57fa-4247-bf6d-18c97aa22750" status: 200 len: 1522 microversion: 2.1 time: 0.359659 Jul 23 21:28:00.887323 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1838/3587] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:28:00 2022] GET /compute/v2.1/servers/d3d6b0e1-57fa-4247-bf6d-18c97aa22750 => generated 1522 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:28:00.899584 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-52d1f865-7e52-4bf3-bb9f-7b91cf65b875 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:00.900046 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-52d1f865-7e52-4bf3-bb9f-7b91cf65b875 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:00.900850 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-52d1f865-7e52-4bf3-bb9f-7b91cf65b875 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:00.901458 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-52d1f865-7e52-4bf3-bb9f-7b91cf65b875 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:00.909074 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-3b4e55ef-0bc7-4744-8d34-b387ef58c691 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:00.910046 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-3b4e55ef-0bc7-4744-8d34-b387ef58c691 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: e55e0951-8a56-497b-8bdf-15dd6cc250fd] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:00.925653 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3b4e55ef-0bc7-4744-8d34-b387ef58c691 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:00.926455 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3b4e55ef-0bc7-4744-8d34-b387ef58c691 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:00.927447 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3b4e55ef-0bc7-4744-8d34-b387ef58c691 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:00.928076 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3b4e55ef-0bc7-4744-8d34-b387ef58c691 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:00.989450 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-3b4e55ef-0bc7-4744-8d34-b387ef58c691 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: e55e0951-8a56-497b-8bdf-15dd6cc250fd] Going to try to terminate instance {{(pid=131321) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:28:01.056974 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.compute.api [None req-3b4e55ef-0bc7-4744-8d34-b387ef58c691 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: e55e0951-8a56-497b-8bdf-15dd6cc250fd] Instance is already in deleting state, ignoring this request Jul 23 21:28:01.059210 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-3b4e55ef-0bc7-4744-8d34-b387ef58c691 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "DELETE /compute/v2.1/servers/e55e0951-8a56-497b-8bdf-15dd6cc250fd" status: 204 len: 0 microversion: 2.1 time: 0.170606 Jul 23 21:28:01.060037 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1839/3588] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:28:00 2022] DELETE /compute/v2.1/servers/e55e0951-8a56-497b-8bdf-15dd6cc250fd => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:28:01.070087 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-9763bc7d-10cb-43cf-a072-49979111c931 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:01.070804 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-9763bc7d-10cb-43cf-a072-49979111c931 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: e55e0951-8a56-497b-8bdf-15dd6cc250fd] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:01.078202 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9763bc7d-10cb-43cf-a072-49979111c931 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:01.078779 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9763bc7d-10cb-43cf-a072-49979111c931 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:01.079585 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9763bc7d-10cb-43cf-a072-49979111c931 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:01.080093 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9763bc7d-10cb-43cf-a072-49979111c931 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:01.179147 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-52d1f865-7e52-4bf3-bb9f-7b91cf65b875 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:01.200018 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-52d1f865-7e52-4bf3-bb9f-7b91cf65b875 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:01.202210 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-52d1f865-7e52-4bf3-bb9f-7b91cf65b875 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:01.205385 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-52d1f865-7e52-4bf3-bb9f-7b91cf65b875 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.341393 Jul 23 21:28:01.218009 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1750/3589] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:28:00 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:28:01.313118 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-9763bc7d-10cb-43cf-a072-49979111c931 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:01.325774 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-9763bc7d-10cb-43cf-a072-49979111c931 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/e55e0951-8a56-497b-8bdf-15dd6cc250fd" status: 200 len: 1515 microversion: 2.1 time: 0.261332 Jul 23 21:28:01.335555 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1840/3590] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:28:01 2022] GET /compute/v2.1/servers/e55e0951-8a56-497b-8bdf-15dd6cc250fd => generated 1515 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:28:01.541088 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a1300d0c-4a42-4519-864e-cf48ad76fce8 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:01.541622 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a1300d0c-4a42-4519-864e-cf48ad76fce8 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: c4da9681-4d81-4ffb-8d7e-453436e71331] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:01.560879 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a1300d0c-4a42-4519-864e-cf48ad76fce8 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:01.561398 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a1300d0c-4a42-4519-864e-cf48ad76fce8 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:01.561995 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a1300d0c-4a42-4519-864e-cf48ad76fce8 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:01.562433 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a1300d0c-4a42-4519-864e-cf48ad76fce8 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:01.907089 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-7a7f4705-cd30-4744-96fa-0d99ac9dcd8f tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:01.908504 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-7a7f4705-cd30-4744-96fa-0d99ac9dcd8f tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] [instance: d3d6b0e1-57fa-4247-bf6d-18c97aa22750] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:01.922799 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7a7f4705-cd30-4744-96fa-0d99ac9dcd8f tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:01.925594 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7a7f4705-cd30-4744-96fa-0d99ac9dcd8f tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:01.927630 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7a7f4705-cd30-4744-96fa-0d99ac9dcd8f tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:01.929742 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7a7f4705-cd30-4744-96fa-0d99ac9dcd8f tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:02.182526 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a1300d0c-4a42-4519-864e-cf48ad76fce8 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:02.190045 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a1300d0c-4a42-4519-864e-cf48ad76fce8 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331" status: 200 len: 1524 microversion: 2.1 time: 0.652970 Jul 23 21:28:02.192667 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1751/3591] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:28:01 2022] GET /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331 => generated 1524 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:28:02.203350 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-7a7f4705-cd30-4744-96fa-0d99ac9dcd8f tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e11fb79c253c4a0f955d710ff4626f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b46cc4b1ef64d168bf4184339de54d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:02.228792 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ab92c17f-daf9-47b9-aea7-19ee524724de tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:02.229402 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ab92c17f-daf9-47b9-aea7-19ee524724de tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:02.232274 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-7a7f4705-cd30-4744-96fa-0d99ac9dcd8f tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] 10.222.0.17 "GET /compute/v2.1/servers/d3d6b0e1-57fa-4247-bf6d-18c97aa22750" status: 200 len: 1522 microversion: 2.1 time: 0.331501 Jul 23 21:28:02.234906 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1841/3592] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:28:01 2022] GET /compute/v2.1/servers/d3d6b0e1-57fa-4247-bf6d-18c97aa22750 => generated 1522 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:28:02.260465 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ab92c17f-daf9-47b9-aea7-19ee524724de tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:02.260918 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ab92c17f-daf9-47b9-aea7-19ee524724de tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:02.263676 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ab92c17f-daf9-47b9-aea7-19ee524724de tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:02.264132 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ab92c17f-daf9-47b9-aea7-19ee524724de tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:02.345959 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-68ebcc49-b746-4fdb-9fbc-167b359677c4 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:02.346541 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-68ebcc49-b746-4fdb-9fbc-167b359677c4 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: e55e0951-8a56-497b-8bdf-15dd6cc250fd] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:02.363671 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-68ebcc49-b746-4fdb-9fbc-167b359677c4 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:02.364758 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-68ebcc49-b746-4fdb-9fbc-167b359677c4 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:02.366196 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-68ebcc49-b746-4fdb-9fbc-167b359677c4 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:02.367004 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-68ebcc49-b746-4fdb-9fbc-167b359677c4 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:02.426623 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ab92c17f-daf9-47b9-aea7-19ee524724de tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:02.442687 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ab92c17f-daf9-47b9-aea7-19ee524724de tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:02.465935 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ab92c17f-daf9-47b9-aea7-19ee524724de tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:02.470124 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ab92c17f-daf9-47b9-aea7-19ee524724de tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.245252 Jul 23 21:28:02.484456 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1752/3593] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:28:02 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:28:02.803338 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-68ebcc49-b746-4fdb-9fbc-167b359677c4 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:02.831053 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-68ebcc49-b746-4fdb-9fbc-167b359677c4 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/e55e0951-8a56-497b-8bdf-15dd6cc250fd" status: 200 len: 1515 microversion: 2.1 time: 0.488672 Jul 23 21:28:02.835835 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1842/3594] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:28:02 2022] GET /compute/v2.1/servers/e55e0951-8a56-497b-8bdf-15dd6cc250fd => generated 1515 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:28:03.211935 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-60a42034-7559-4015-a3ff-7ab9657379f6 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:03.213014 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-60a42034-7559-4015-a3ff-7ab9657379f6 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: c4da9681-4d81-4ffb-8d7e-453436e71331] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:03.224275 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-60a42034-7559-4015-a3ff-7ab9657379f6 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:03.225006 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-60a42034-7559-4015-a3ff-7ab9657379f6 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:03.225804 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-60a42034-7559-4015-a3ff-7ab9657379f6 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:03.226862 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-60a42034-7559-4015-a3ff-7ab9657379f6 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:03.250982 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-9350f066-969a-4ea5-9e66-ca3acd05b619 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:03.252422 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-9350f066-969a-4ea5-9e66-ca3acd05b619 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] [instance: d3d6b0e1-57fa-4247-bf6d-18c97aa22750] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:03.266637 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9350f066-969a-4ea5-9e66-ca3acd05b619 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:03.267453 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9350f066-969a-4ea5-9e66-ca3acd05b619 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:03.268669 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9350f066-969a-4ea5-9e66-ca3acd05b619 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:03.270485 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9350f066-969a-4ea5-9e66-ca3acd05b619 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:03.594407 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-60a42034-7559-4015-a3ff-7ab9657379f6 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:03.604447 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-60a42034-7559-4015-a3ff-7ab9657379f6 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331" status: 200 len: 1506 microversion: 2.1 time: 0.399218 Jul 23 21:28:03.617602 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1753/3595] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:28:03 2022] GET /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331 => generated 1506 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:28:03.628550 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f6a1a46c-cf0c-41d0-ae62-065f61238150 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:03.630404 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f6a1a46c-cf0c-41d0-ae62-065f61238150 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:03.644265 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f6a1a46c-cf0c-41d0-ae62-065f61238150 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:03.644730 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f6a1a46c-cf0c-41d0-ae62-065f61238150 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:03.647422 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f6a1a46c-cf0c-41d0-ae62-065f61238150 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:03.647743 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f6a1a46c-cf0c-41d0-ae62-065f61238150 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:03.763363 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f6a1a46c-cf0c-41d0-ae62-065f61238150 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:03.779349 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f6a1a46c-cf0c-41d0-ae62-065f61238150 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:03.780803 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f6a1a46c-cf0c-41d0-ae62-065f61238150 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:03.784356 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f6a1a46c-cf0c-41d0-ae62-065f61238150 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.163339 Jul 23 21:28:03.785943 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1754/3596] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:28:03 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:28:03.848246 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-ab065e16-42ee-4528-8507-a6340d115d32 req-e6c16872-fbc7-45cf-9b21-ae7f7dbcd703 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e55e0951-8a56-497b-8bdf-15dd6cc250fd", "name": "network-vif-deleted", "tag": "36c01a6d-b578-4e94-8b0a-f12d45fa0bd7"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:28:03.879753 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-ab065e16-42ee-4528-8507-a6340d115d32 req-e6c16872-fbc7-45cf-9b21-ae7f7dbcd703 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:03.880207 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-ab065e16-42ee-4528-8507-a6340d115d32 req-e6c16872-fbc7-45cf-9b21-ae7f7dbcd703 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:03.919457 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-ab065e16-42ee-4528-8507-a6340d115d32 req-e6c16872-fbc7-45cf-9b21-ae7f7dbcd703 service nova] Creating event network-vif-deleted:36c01a6d-b578-4e94-8b0a-f12d45fa0bd7 for instance e55e0951-8a56-497b-8bdf-15dd6cc250fd on nch1-master-1 Jul 23 21:28:03.934171 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-ab065e16-42ee-4528-8507-a6340d115d32 req-e6c16872-fbc7-45cf-9b21-ae7f7dbcd703 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085654 Jul 23 21:28:03.935257 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1755/3597] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:28:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:28:03.943831 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-903962cd-155f-47b0-8642-71483a0525f6 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:03.944534 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-903962cd-155f-47b0-8642-71483a0525f6 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: e55e0951-8a56-497b-8bdf-15dd6cc250fd] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:03.951168 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-903962cd-155f-47b0-8642-71483a0525f6 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:03.951614 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-903962cd-155f-47b0-8642-71483a0525f6 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:03.952390 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-903962cd-155f-47b0-8642-71483a0525f6 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:03.952824 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-903962cd-155f-47b0-8642-71483a0525f6 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:04.024526 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-903962cd-155f-47b0-8642-71483a0525f6 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:04.029460 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-903962cd-155f-47b0-8642-71483a0525f6 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:04.029929 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.objects.instance [None req-903962cd-155f-47b0-8642-71483a0525f6 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lazy-loading 'fault' on Instance uuid e55e0951-8a56-497b-8bdf-15dd6cc250fd {{(pid=131320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:28:04.101602 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-903962cd-155f-47b0-8642-71483a0525f6 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8c3d58265714ebba65b1510bd768e19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5afdbc378ad64fc58903ea2518717005', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:04.111175 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-903962cd-155f-47b0-8642-71483a0525f6 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/e55e0951-8a56-497b-8bdf-15dd6cc250fd" status: 200 len: 1308 microversion: 2.1 time: 0.174654 Jul 23 21:28:04.111764 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1756/3598] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:28:03 2022] GET /compute/v2.1/servers/e55e0951-8a56-497b-8bdf-15dd6cc250fd => generated 1308 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:28:04.112327 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-9350f066-969a-4ea5-9e66-ca3acd05b619 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e11fb79c253c4a0f955d710ff4626f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b46cc4b1ef64d168bf4184339de54d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:04.127106 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-9350f066-969a-4ea5-9e66-ca3acd05b619 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] 10.222.0.17 "GET /compute/v2.1/servers/d3d6b0e1-57fa-4247-bf6d-18c97aa22750" status: 200 len: 1522 microversion: 2.1 time: 0.880054 Jul 23 21:28:04.132957 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1843/3599] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:28:03 2022] GET /compute/v2.1/servers/d3d6b0e1-57fa-4247-bf6d-18c97aa22750 => generated 1522 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:28:04.628344 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8ae18d21-e9e8-44bc-a73d-c97d63f5b859 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:04.629243 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8ae18d21-e9e8-44bc-a73d-c97d63f5b859 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: c4da9681-4d81-4ffb-8d7e-453436e71331] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:04.638707 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8ae18d21-e9e8-44bc-a73d-c97d63f5b859 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:04.639394 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8ae18d21-e9e8-44bc-a73d-c97d63f5b859 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:04.640324 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8ae18d21-e9e8-44bc-a73d-c97d63f5b859 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:04.640809 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8ae18d21-e9e8-44bc-a73d-c97d63f5b859 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:04.804846 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a19b260d-d6c2-4aef-96bd-213ba50c2681 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:04.806671 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-a19b260d-d6c2-4aef-96bd-213ba50c2681 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:04.822094 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a19b260d-d6c2-4aef-96bd-213ba50c2681 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:04.822094 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a19b260d-d6c2-4aef-96bd-213ba50c2681 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:04.822094 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a19b260d-d6c2-4aef-96bd-213ba50c2681 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:04.822094 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a19b260d-d6c2-4aef-96bd-213ba50c2681 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:04.856332 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8ae18d21-e9e8-44bc-a73d-c97d63f5b859 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:04.868035 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8ae18d21-e9e8-44bc-a73d-c97d63f5b859 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331" status: 200 len: 1506 microversion: 2.1 time: 0.247490 Jul 23 21:28:04.868635 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1757/3600] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:28:04 2022] GET /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331 => generated 1506 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:28:04.936061 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-a19b260d-d6c2-4aef-96bd-213ba50c2681 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:04.947741 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-a19b260d-d6c2-4aef-96bd-213ba50c2681 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:04.949428 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-a19b260d-d6c2-4aef-96bd-213ba50c2681 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:04.950930 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-a19b260d-d6c2-4aef-96bd-213ba50c2681 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.151058 Jul 23 21:28:04.962637 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1844/3601] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:28:04 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:28:05.130164 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6016af17-0c7a-4eda-9477-260b413d766d tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:05.131040 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6016af17-0c7a-4eda-9477-260b413d766d tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: e55e0951-8a56-497b-8bdf-15dd6cc250fd] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:05.145367 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-3d31d16a-d544-4fe0-9f76-9ce346304fec tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:05.146286 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-3d31d16a-d544-4fe0-9f76-9ce346304fec tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] [instance: d3d6b0e1-57fa-4247-bf6d-18c97aa22750] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:05.154122 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6016af17-0c7a-4eda-9477-260b413d766d tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:05.156476 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3d31d16a-d544-4fe0-9f76-9ce346304fec tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:05.157114 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6016af17-0c7a-4eda-9477-260b413d766d tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:05.158148 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6016af17-0c7a-4eda-9477-260b413d766d tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:05.158752 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6016af17-0c7a-4eda-9477-260b413d766d tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:05.159395 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3d31d16a-d544-4fe0-9f76-9ce346304fec tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:05.165746 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3d31d16a-d544-4fe0-9f76-9ce346304fec tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:05.169520 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3d31d16a-d544-4fe0-9f76-9ce346304fec tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:05.210758 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-6016af17-0c7a-4eda-9477-260b413d766d tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] HTTP exception thrown: Instance e55e0951-8a56-497b-8bdf-15dd6cc250fd could not be found. Jul 23 21:28:05.213752 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6016af17-0c7a-4eda-9477-260b413d766d tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Request method failure captured: Jul 23 21:28:05.213752 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/e55e0951-8a56-497b-8bdf-15dd6cc250fd HTTP/1.1 Jul 23 21:28:05.213752 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:28:05.213752 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:28:05.213752 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:28:05.213752 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:28:05.213752 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:28:05.213752 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:28:05.213752 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:28:05.213752 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:28:05.213752 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GdJQkLBDDDbNa0KBYcfIkcRkETE7VXm35Pt1gsK085zroM5w5uK5G1HQ5xiZRanRIGQ8wfjeq7HRQC9e4YXisyfvJr6S667bnROAdwj-sUZBHgRYU_tm6A9URpjjWmVstXjFhy7kbS0JbV9gNmCMZnbXLIWFSwezqM7_QHQqkhsSs0 Jul 23 21:28:05.213752 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:28:05.213752 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:28:05.213752 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:28:05.213752 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:28:05.213752 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:28:05.213752 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:28:05.213752 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 5afdbc378ad64fc58903ea2518717005 Jul 23 21:28:05.213752 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1665317441 Jul 23 21:28:05.213752 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:28:05.213752 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:28:05.213752 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5afdbc378ad64fc58903ea2518717005"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5afdbc378ad64fc58903ea2518717005"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_5afdbc378ad64fc58903ea2518717005", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/5afdbc378ad64fc58903ea2518717005"}]}] Jul 23 21:28:05.213752 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServerDiskConfigTestJSON-1665317441 Jul 23 21:28:05.213752 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 5afdbc378ad64fc58903ea2518717005 Jul 23 21:28:05.213752 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1665317441 Jul 23 21:28:05.213752 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServerDiskConfigTestJSON-1665317441-project Jul 23 21:28:05.213752 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:28:05.213752 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:28:05.213752 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: c8c3d58265714ebba65b1510bd768e19 Jul 23 21:28:05.213752 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServerDiskConfigTestJSON-1665317441-project Jul 23 21:28:05.213752 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:28:05.213752 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance e55e0951-8a56-497b-8bdf-15dd6cc250fd could not be found. Jul 23 21:28:05.213752 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': 'e55e0951-8a56-497b-8bdf-15dd6cc250fd'} Jul 23 21:28:05.213752 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:28:05.213752 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:28:05.213752 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:28:05.213752 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:28:05.213752 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:28:05.213752 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:28:05.213752 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:28:05.213752 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:28:05.213752 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:28:05.213752 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:28:05.213752 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e55e0951-8a56-497b-8bdf-15dd6cc250fd could not be found. Jul 23 21:28:05.213752 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:28:05.213752 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:28:05.213752 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:28:05.213752 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:28:05.213752 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:28:05.213752 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:28:05.213752 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:28:05.213752 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:28:05.213752 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:28:05.213752 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:28:05.213752 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:28:05.213752 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:28:05.213752 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:28:05.213752 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:28:05.213752 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:28:05.213752 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:28:05.213752 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e55e0951-8a56-497b-8bdf-15dd6cc250fd could not be found. Jul 23 21:28:05.213752 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:28:05.213752 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:28:05.213752 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:28:05.219243 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:28:05.219243 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:28:05.219243 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:28:05.219243 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:28:05.219243 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:28:05.219243 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e55e0951-8a56-497b-8bdf-15dd6cc250fd could not be found. Jul 23 21:28:05.219243 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:28:05.221142 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6016af17-0c7a-4eda-9477-260b413d766d tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Returning 404 to user: Instance e55e0951-8a56-497b-8bdf-15dd6cc250fd could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:28:05.221657 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6016af17-0c7a-4eda-9477-260b413d766d tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/e55e0951-8a56-497b-8bdf-15dd6cc250fd" status: 404 len: 111 microversion: 2.1 time: 0.096083 Jul 23 21:28:05.225449 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1758/3602] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:28:05 2022] GET /compute/v2.1/servers/e55e0951-8a56-497b-8bdf-15dd6cc250fd => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:28:05.235444 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-be6f2f53-ab00-4fe5-9cb6-d6b6d7f64394 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:05.236438 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-be6f2f53-ab00-4fe5-9cb6-d6b6d7f64394 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: 06a478c3-f038-4813-a456-daf3a58b5749] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:05.245321 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-be6f2f53-ab00-4fe5-9cb6-d6b6d7f64394 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:05.248126 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-be6f2f53-ab00-4fe5-9cb6-d6b6d7f64394 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:05.251356 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-be6f2f53-ab00-4fe5-9cb6-d6b6d7f64394 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:05.251976 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-be6f2f53-ab00-4fe5-9cb6-d6b6d7f64394 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:05.313327 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-be6f2f53-ab00-4fe5-9cb6-d6b6d7f64394 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] HTTP exception thrown: Instance 06a478c3-f038-4813-a456-daf3a58b5749 could not be found. Jul 23 21:28:05.318941 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-be6f2f53-ab00-4fe5-9cb6-d6b6d7f64394 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Request method failure captured: Jul 23 21:28:05.318941 ncdv-master-1 devstack@n-api.service[131320]: request: DELETE /compute/v2.1/servers/06a478c3-f038-4813-a456-daf3a58b5749 HTTP/1.1 Jul 23 21:28:05.318941 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:28:05.318941 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:28:05.318941 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:28:05.318941 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:28:05.318941 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:28:05.318941 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:28:05.318941 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:28:05.318941 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:28:05.318941 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GdJQkLBDDDbNa0KBYcfIkcRkETE7VXm35Pt1gsK085zroM5w5uK5G1HQ5xiZRanRIGQ8wfjeq7HRQC9e4YXisyfvJr6S667bnROAdwj-sUZBHgRYU_tm6A9URpjjWmVstXjFhy7kbS0JbV9gNmCMZnbXLIWFSwezqM7_QHQqkhsSs0 Jul 23 21:28:05.318941 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:28:05.318941 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:28:05.318941 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:28:05.318941 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:28:05.318941 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:28:05.318941 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:28:05.318941 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 5afdbc378ad64fc58903ea2518717005 Jul 23 21:28:05.318941 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1665317441 Jul 23 21:28:05.318941 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:28:05.318941 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:28:05.318941 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5afdbc378ad64fc58903ea2518717005"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5afdbc378ad64fc58903ea2518717005"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_5afdbc378ad64fc58903ea2518717005", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/5afdbc378ad64fc58903ea2518717005"}]}] Jul 23 21:28:05.318941 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServerDiskConfigTestJSON-1665317441 Jul 23 21:28:05.318941 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 5afdbc378ad64fc58903ea2518717005 Jul 23 21:28:05.318941 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1665317441 Jul 23 21:28:05.318941 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServerDiskConfigTestJSON-1665317441-project Jul 23 21:28:05.318941 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:28:05.318941 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:28:05.318941 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: c8c3d58265714ebba65b1510bd768e19 Jul 23 21:28:05.318941 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServerDiskConfigTestJSON-1665317441-project Jul 23 21:28:05.318941 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:28:05.318941 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance 06a478c3-f038-4813-a456-daf3a58b5749 could not be found. Jul 23 21:28:05.318941 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '06a478c3-f038-4813-a456-daf3a58b5749'} Jul 23 21:28:05.318941 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:28:05.318941 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:28:05.318941 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:28:05.318941 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:28:05.318941 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:28:05.318941 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:28:05.318941 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:28:05.318941 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:28:05.318941 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:28:05.318941 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:28:05.318941 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06a478c3-f038-4813-a456-daf3a58b5749 could not be found. Jul 23 21:28:05.318941 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:28:05.318941 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:28:05.318941 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:28:05.318941 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:28:05.318941 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:28:05.318941 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:28:05.318941 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:28:05.318941 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:28:05.318941 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:28:05.318941 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:28:05.318941 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 23 21:28:05.318941 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 23 21:28:05.318941 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 23 21:28:05.318941 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 23 21:28:05.318941 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:28:05.318941 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:28:05.318941 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:28:05.318941 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:28:05.325155 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06a478c3-f038-4813-a456-daf3a58b5749 could not be found. Jul 23 21:28:05.325155 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:28:05.325155 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:28:05.325155 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:28:05.325155 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:28:05.325155 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:28:05.325155 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:28:05.325155 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:28:05.325155 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:28:05.325155 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06a478c3-f038-4813-a456-daf3a58b5749 could not be found. Jul 23 21:28:05.325155 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:28:05.325155 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-be6f2f53-ab00-4fe5-9cb6-d6b6d7f64394 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Returning 404 to user: Instance 06a478c3-f038-4813-a456-daf3a58b5749 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:28:05.327323 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-be6f2f53-ab00-4fe5-9cb6-d6b6d7f64394 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "DELETE /compute/v2.1/servers/06a478c3-f038-4813-a456-daf3a58b5749" status: 404 len: 111 microversion: 2.1 time: 0.097655 Jul 23 21:28:05.329649 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1759/3603] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:28:05 2022] DELETE /compute/v2.1/servers/06a478c3-f038-4813-a456-daf3a58b5749 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:28:05.343618 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5bae3785-1f56-42bf-aed0-2e69f057b04c tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:05.346277 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5bae3785-1f56-42bf-aed0-2e69f057b04c tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: 06a478c3-f038-4813-a456-daf3a58b5749] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:05.361180 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5bae3785-1f56-42bf-aed0-2e69f057b04c tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:05.366571 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5bae3785-1f56-42bf-aed0-2e69f057b04c tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:05.366571 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5bae3785-1f56-42bf-aed0-2e69f057b04c tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:05.366571 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5bae3785-1f56-42bf-aed0-2e69f057b04c tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:05.397627 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-5bae3785-1f56-42bf-aed0-2e69f057b04c tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] HTTP exception thrown: Instance 06a478c3-f038-4813-a456-daf3a58b5749 could not be found. Jul 23 21:28:05.407391 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5bae3785-1f56-42bf-aed0-2e69f057b04c tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Request method failure captured: Jul 23 21:28:05.407391 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/06a478c3-f038-4813-a456-daf3a58b5749 HTTP/1.1 Jul 23 21:28:05.407391 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:28:05.407391 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:28:05.407391 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:28:05.407391 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:28:05.407391 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:28:05.407391 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:28:05.407391 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:28:05.407391 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:28:05.407391 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GdJQkLBDDDbNa0KBYcfIkcRkETE7VXm35Pt1gsK085zroM5w5uK5G1HQ5xiZRanRIGQ8wfjeq7HRQC9e4YXisyfvJr6S667bnROAdwj-sUZBHgRYU_tm6A9URpjjWmVstXjFhy7kbS0JbV9gNmCMZnbXLIWFSwezqM7_QHQqkhsSs0 Jul 23 21:28:05.407391 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:28:05.407391 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:28:05.407391 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:28:05.407391 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:28:05.407391 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:28:05.407391 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:28:05.407391 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 5afdbc378ad64fc58903ea2518717005 Jul 23 21:28:05.407391 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1665317441 Jul 23 21:28:05.407391 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:28:05.407391 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:28:05.407391 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5afdbc378ad64fc58903ea2518717005"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5afdbc378ad64fc58903ea2518717005"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_5afdbc378ad64fc58903ea2518717005", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/5afdbc378ad64fc58903ea2518717005"}]}] Jul 23 21:28:05.407391 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServerDiskConfigTestJSON-1665317441 Jul 23 21:28:05.407391 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 5afdbc378ad64fc58903ea2518717005 Jul 23 21:28:05.407391 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1665317441 Jul 23 21:28:05.407391 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServerDiskConfigTestJSON-1665317441-project Jul 23 21:28:05.407391 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:28:05.407391 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:28:05.407391 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: c8c3d58265714ebba65b1510bd768e19 Jul 23 21:28:05.407391 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServerDiskConfigTestJSON-1665317441-project Jul 23 21:28:05.407391 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:28:05.407391 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance 06a478c3-f038-4813-a456-daf3a58b5749 could not be found. Jul 23 21:28:05.407391 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '06a478c3-f038-4813-a456-daf3a58b5749'} Jul 23 21:28:05.407391 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:28:05.407391 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:28:05.407391 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:28:05.407391 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:28:05.407391 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:28:05.407391 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:28:05.407391 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:28:05.407391 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:28:05.407391 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:28:05.407391 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:28:05.407391 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06a478c3-f038-4813-a456-daf3a58b5749 could not be found. Jul 23 21:28:05.407391 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:28:05.407391 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:28:05.407391 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:28:05.407391 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:28:05.407391 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:28:05.407391 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:28:05.407391 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:28:05.407391 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:28:05.407391 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:28:05.407391 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:28:05.407391 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:28:05.407391 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:28:05.407391 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:28:05.407391 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:28:05.407391 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:28:05.407391 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:28:05.407391 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06a478c3-f038-4813-a456-daf3a58b5749 could not be found. Jul 23 21:28:05.407391 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:28:05.407391 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:28:05.407391 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:28:05.412756 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:28:05.412756 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:28:05.412756 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:28:05.412756 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:28:05.412756 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:28:05.412756 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06a478c3-f038-4813-a456-daf3a58b5749 could not be found. Jul 23 21:28:05.412756 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:28:05.412756 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5bae3785-1f56-42bf-aed0-2e69f057b04c tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Returning 404 to user: Instance 06a478c3-f038-4813-a456-daf3a58b5749 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:28:05.412756 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5bae3785-1f56-42bf-aed0-2e69f057b04c tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/06a478c3-f038-4813-a456-daf3a58b5749" status: 404 len: 111 microversion: 2.1 time: 0.073098 Jul 23 21:28:05.418114 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1760/3604] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:28:05 2022] GET /compute/v2.1/servers/06a478c3-f038-4813-a456-daf3a58b5749 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:28:05.426529 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0d644cf1-b7e8-4685-a38c-0e8a91cabbbc tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:05.434028 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-0d644cf1-b7e8-4685-a38c-0e8a91cabbbc tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: d303403b-5d14-443b-a6fe-f8b579d24cda] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:05.447511 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0d644cf1-b7e8-4685-a38c-0e8a91cabbbc tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:05.448197 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0d644cf1-b7e8-4685-a38c-0e8a91cabbbc tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:05.448918 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0d644cf1-b7e8-4685-a38c-0e8a91cabbbc tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:05.451423 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0d644cf1-b7e8-4685-a38c-0e8a91cabbbc tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:05.484224 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-0d644cf1-b7e8-4685-a38c-0e8a91cabbbc tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] HTTP exception thrown: Instance d303403b-5d14-443b-a6fe-f8b579d24cda could not be found. Jul 23 21:28:05.485842 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0d644cf1-b7e8-4685-a38c-0e8a91cabbbc tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Request method failure captured: Jul 23 21:28:05.485842 ncdv-master-1 devstack@n-api.service[131320]: request: DELETE /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda HTTP/1.1 Jul 23 21:28:05.485842 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:28:05.485842 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:28:05.485842 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:28:05.485842 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:28:05.485842 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:28:05.485842 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:28:05.485842 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:28:05.485842 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:28:05.485842 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GdJQkLBDDDbNa0KBYcfIkcRkETE7VXm35Pt1gsK085zroM5w5uK5G1HQ5xiZRanRIGQ8wfjeq7HRQC9e4YXisyfvJr6S667bnROAdwj-sUZBHgRYU_tm6A9URpjjWmVstXjFhy7kbS0JbV9gNmCMZnbXLIWFSwezqM7_QHQqkhsSs0 Jul 23 21:28:05.485842 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:28:05.485842 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:28:05.485842 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:28:05.485842 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:28:05.485842 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:28:05.485842 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:28:05.485842 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 5afdbc378ad64fc58903ea2518717005 Jul 23 21:28:05.485842 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1665317441 Jul 23 21:28:05.485842 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:28:05.485842 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:28:05.485842 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5afdbc378ad64fc58903ea2518717005"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5afdbc378ad64fc58903ea2518717005"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_5afdbc378ad64fc58903ea2518717005", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/5afdbc378ad64fc58903ea2518717005"}]}] Jul 23 21:28:05.485842 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServerDiskConfigTestJSON-1665317441 Jul 23 21:28:05.485842 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 5afdbc378ad64fc58903ea2518717005 Jul 23 21:28:05.485842 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1665317441 Jul 23 21:28:05.485842 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServerDiskConfigTestJSON-1665317441-project Jul 23 21:28:05.485842 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:28:05.485842 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:28:05.485842 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: c8c3d58265714ebba65b1510bd768e19 Jul 23 21:28:05.485842 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServerDiskConfigTestJSON-1665317441-project Jul 23 21:28:05.485842 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:28:05.485842 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance d303403b-5d14-443b-a6fe-f8b579d24cda could not be found. Jul 23 21:28:05.485842 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': 'd303403b-5d14-443b-a6fe-f8b579d24cda'} Jul 23 21:28:05.485842 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:28:05.485842 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:28:05.485842 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:28:05.485842 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:28:05.485842 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:28:05.485842 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:28:05.485842 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:28:05.485842 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:28:05.485842 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:28:05.485842 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:28:05.485842 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d303403b-5d14-443b-a6fe-f8b579d24cda could not be found. Jul 23 21:28:05.485842 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:28:05.485842 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:28:05.485842 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:28:05.485842 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:28:05.485842 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:28:05.485842 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:28:05.485842 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:28:05.485842 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:28:05.485842 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:28:05.485842 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:28:05.485842 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 23 21:28:05.485842 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 23 21:28:05.485842 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 23 21:28:05.485842 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 23 21:28:05.485842 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:28:05.485842 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:28:05.485842 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:28:05.485842 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:28:05.491758 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d303403b-5d14-443b-a6fe-f8b579d24cda could not be found. Jul 23 21:28:05.491758 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:28:05.491758 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:28:05.491758 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:28:05.491758 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:28:05.491758 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:28:05.491758 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:28:05.491758 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:28:05.491758 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:28:05.491758 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d303403b-5d14-443b-a6fe-f8b579d24cda could not be found. Jul 23 21:28:05.491758 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:28:05.491758 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0d644cf1-b7e8-4685-a38c-0e8a91cabbbc tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Returning 404 to user: Instance d303403b-5d14-443b-a6fe-f8b579d24cda could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:28:05.491758 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-0d644cf1-b7e8-4685-a38c-0e8a91cabbbc tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda" status: 404 len: 111 microversion: 2.1 time: 0.071693 Jul 23 21:28:05.496718 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1761/3605] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:28:05 2022] DELETE /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:28:05.503693 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-3d31d16a-d544-4fe0-9f76-9ce346304fec tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e11fb79c253c4a0f955d710ff4626f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b46cc4b1ef64d168bf4184339de54d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:05.504493 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-bfffdfec-77f1-4904-bf58-5ef92d963887 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:05.505114 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-bfffdfec-77f1-4904-bf58-5ef92d963887 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] [instance: d303403b-5d14-443b-a6fe-f8b579d24cda] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:05.511672 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bfffdfec-77f1-4904-bf58-5ef92d963887 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:05.512123 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bfffdfec-77f1-4904-bf58-5ef92d963887 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:05.512903 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bfffdfec-77f1-4904-bf58-5ef92d963887 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:05.513339 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bfffdfec-77f1-4904-bf58-5ef92d963887 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:05.524848 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-3d31d16a-d544-4fe0-9f76-9ce346304fec tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] 10.222.0.17 "GET /compute/v2.1/servers/d3d6b0e1-57fa-4247-bf6d-18c97aa22750" status: 200 len: 1522 microversion: 2.1 time: 0.383315 Jul 23 21:28:05.538105 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-bfffdfec-77f1-4904-bf58-5ef92d963887 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] HTTP exception thrown: Instance d303403b-5d14-443b-a6fe-f8b579d24cda could not be found. Jul 23 21:28:05.539411 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1845/3606] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:28:05 2022] GET /compute/v2.1/servers/d3d6b0e1-57fa-4247-bf6d-18c97aa22750 => generated 1522 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:28:05.543659 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-bfffdfec-77f1-4904-bf58-5ef92d963887 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Request method failure captured: Jul 23 21:28:05.543659 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda HTTP/1.1 Jul 23 21:28:05.543659 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:28:05.543659 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:28:05.543659 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:28:05.543659 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:28:05.543659 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:28:05.543659 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:28:05.543659 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:28:05.543659 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:28:05.543659 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GdJQkLBDDDbNa0KBYcfIkcRkETE7VXm35Pt1gsK085zroM5w5uK5G1HQ5xiZRanRIGQ8wfjeq7HRQC9e4YXisyfvJr6S667bnROAdwj-sUZBHgRYU_tm6A9URpjjWmVstXjFhy7kbS0JbV9gNmCMZnbXLIWFSwezqM7_QHQqkhsSs0 Jul 23 21:28:05.543659 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:28:05.543659 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:28:05.543659 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:28:05.543659 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:28:05.543659 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:28:05.543659 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:28:05.543659 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 5afdbc378ad64fc58903ea2518717005 Jul 23 21:28:05.543659 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1665317441 Jul 23 21:28:05.543659 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:28:05.543659 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:28:05.543659 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5afdbc378ad64fc58903ea2518717005"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5afdbc378ad64fc58903ea2518717005"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_5afdbc378ad64fc58903ea2518717005", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/5afdbc378ad64fc58903ea2518717005"}]}] Jul 23 21:28:05.543659 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServerDiskConfigTestJSON-1665317441 Jul 23 21:28:05.543659 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 5afdbc378ad64fc58903ea2518717005 Jul 23 21:28:05.543659 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1665317441 Jul 23 21:28:05.543659 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServerDiskConfigTestJSON-1665317441-project Jul 23 21:28:05.543659 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:28:05.543659 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:28:05.543659 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: c8c3d58265714ebba65b1510bd768e19 Jul 23 21:28:05.543659 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServerDiskConfigTestJSON-1665317441-project Jul 23 21:28:05.543659 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:28:05.543659 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance d303403b-5d14-443b-a6fe-f8b579d24cda could not be found. Jul 23 21:28:05.543659 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': 'd303403b-5d14-443b-a6fe-f8b579d24cda'} Jul 23 21:28:05.543659 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:28:05.543659 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:28:05.543659 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:28:05.543659 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:28:05.543659 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:28:05.543659 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:28:05.543659 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:28:05.543659 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:28:05.543659 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:28:05.543659 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:28:05.543659 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d303403b-5d14-443b-a6fe-f8b579d24cda could not be found. Jul 23 21:28:05.543659 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:28:05.543659 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:28:05.543659 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:28:05.543659 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:28:05.543659 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:28:05.543659 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:28:05.543659 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:28:05.543659 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:28:05.543659 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:28:05.543659 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:28:05.543659 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:28:05.543659 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:28:05.543659 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:28:05.543659 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:28:05.543659 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:28:05.543659 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:28:05.543659 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d303403b-5d14-443b-a6fe-f8b579d24cda could not be found. Jul 23 21:28:05.543659 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:28:05.543659 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:28:05.543659 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:28:05.549405 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:28:05.549405 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:28:05.549405 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:28:05.549405 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:28:05.549405 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:28:05.549405 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d303403b-5d14-443b-a6fe-f8b579d24cda could not be found. Jul 23 21:28:05.549405 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:28:05.549405 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-bfffdfec-77f1-4904-bf58-5ef92d963887 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] Returning 404 to user: Instance d303403b-5d14-443b-a6fe-f8b579d24cda could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:28:05.549405 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-bfffdfec-77f1-4904-bf58-5ef92d963887 tempest-ServerDiskConfigTestJSON-1665317441 tempest-ServerDiskConfigTestJSON-1665317441-project] 10.222.0.17 "GET /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda" status: 404 len: 111 microversion: 2.1 time: 0.048555 Jul 23 21:28:05.549405 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1762/3607] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:28:05 2022] GET /compute/v2.1/servers/d303403b-5d14-443b-a6fe-f8b579d24cda => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:28:05.683884 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-9430cd77-ef73-4b25-8fdf-f52be3e7ae55 req-dc9638af-5027-43d7-9b09-ca1458c917f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4da9681-4d81-4ffb-8d7e-453436e71331", "name": "network-vif-unplugged", "status": "completed", "tag": "f60d970a-170d-47a9-b1da-1f92400f8025"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:28:05.699386 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-9430cd77-ef73-4b25-8fdf-f52be3e7ae55 req-dc9638af-5027-43d7-9b09-ca1458c917f7 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:05.699992 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-9430cd77-ef73-4b25-8fdf-f52be3e7ae55 req-dc9638af-5027-43d7-9b09-ca1458c917f7 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:05.706686 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:05.720070 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-9430cd77-ef73-4b25-8fdf-f52be3e7ae55 req-dc9638af-5027-43d7-9b09-ca1458c917f7 service nova] Creating event network-vif-unplugged:f60d970a-170d-47a9-b1da-1f92400f8025 for instance c4da9681-4d81-4ffb-8d7e-453436e71331 on nch1-master-1 Jul 23 21:28:05.731571 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-9430cd77-ef73-4b25-8fdf-f52be3e7ae55 req-dc9638af-5027-43d7-9b09-ca1458c917f7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061528 Jul 23 21:28:05.732841 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1846/3608] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:28:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:28:05.885366 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5a1dd628-c195-4ee6-9429-caf54bc94e90 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:05.886719 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5a1dd628-c195-4ee6-9429-caf54bc94e90 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: c4da9681-4d81-4ffb-8d7e-453436e71331] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:05.894619 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5a1dd628-c195-4ee6-9429-caf54bc94e90 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:05.895160 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5a1dd628-c195-4ee6-9429-caf54bc94e90 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:05.895995 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5a1dd628-c195-4ee6-9429-caf54bc94e90 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:05.896956 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5a1dd628-c195-4ee6-9429-caf54bc94e90 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:05.973456 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-b9fdd9c8-c247-424b-907f-cafeae3d5ffe tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:05.974193 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-b9fdd9c8-c247-424b-907f-cafeae3d5ffe tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:05.980921 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b9fdd9c8-c247-424b-907f-cafeae3d5ffe tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:05.981456 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b9fdd9c8-c247-424b-907f-cafeae3d5ffe tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:05.982397 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b9fdd9c8-c247-424b-907f-cafeae3d5ffe tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:05.982929 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b9fdd9c8-c247-424b-907f-cafeae3d5ffe tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:06.103889 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5a1dd628-c195-4ee6-9429-caf54bc94e90 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:06.121754 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-b9fdd9c8-c247-424b-907f-cafeae3d5ffe tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:06.124119 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5a1dd628-c195-4ee6-9429-caf54bc94e90 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331" status: 200 len: 1506 microversion: 2.1 time: 0.242631 Jul 23 21:28:06.128651 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1763/3609] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:28:05 2022] GET /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331 => generated 1506 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:28:06.134746 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-b9fdd9c8-c247-424b-907f-cafeae3d5ffe tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:06.136741 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-b9fdd9c8-c247-424b-907f-cafeae3d5ffe tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:06.138234 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-b9fdd9c8-c247-424b-907f-cafeae3d5ffe tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.170329 Jul 23 21:28:06.139699 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1847/3610] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:28:05 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:28:06.543956 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ba1a7a45-6979-4154-bb3a-f079dff4ac96 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:06.545373 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ba1a7a45-6979-4154-bb3a-f079dff4ac96 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] [instance: d3d6b0e1-57fa-4247-bf6d-18c97aa22750] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:06.557659 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ba1a7a45-6979-4154-bb3a-f079dff4ac96 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:06.561281 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ba1a7a45-6979-4154-bb3a-f079dff4ac96 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:06.563490 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ba1a7a45-6979-4154-bb3a-f079dff4ac96 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:06.564878 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ba1a7a45-6979-4154-bb3a-f079dff4ac96 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:06.784181 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ba1a7a45-6979-4154-bb3a-f079dff4ac96 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e11fb79c253c4a0f955d710ff4626f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b46cc4b1ef64d168bf4184339de54d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:06.792310 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ba1a7a45-6979-4154-bb3a-f079dff4ac96 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] 10.222.0.17 "GET /compute/v2.1/servers/d3d6b0e1-57fa-4247-bf6d-18c97aa22750" status: 200 len: 1522 microversion: 2.1 time: 0.253665 Jul 23 21:28:06.801684 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1764/3611] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:28:06 2022] GET /compute/v2.1/servers/d3d6b0e1-57fa-4247-bf6d-18c97aa22750 => generated 1522 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:28:07.143716 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-38e22955-d20e-440e-b713-d4ad08ca27ed tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:07.145557 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-38e22955-d20e-440e-b713-d4ad08ca27ed tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: c4da9681-4d81-4ffb-8d7e-453436e71331] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:07.160701 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-38e22955-d20e-440e-b713-d4ad08ca27ed tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:07.161051 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-00ea9515-cfa9-4e7d-9373-8db0261f8e97 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:07.161674 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-00ea9515-cfa9-4e7d-9373-8db0261f8e97 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:07.162349 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-38e22955-d20e-440e-b713-d4ad08ca27ed tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:07.165258 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-38e22955-d20e-440e-b713-d4ad08ca27ed tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:07.166159 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-38e22955-d20e-440e-b713-d4ad08ca27ed tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:07.176705 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-00ea9515-cfa9-4e7d-9373-8db0261f8e97 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:07.177640 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-00ea9515-cfa9-4e7d-9373-8db0261f8e97 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:07.179489 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-00ea9515-cfa9-4e7d-9373-8db0261f8e97 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:07.180617 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-00ea9515-cfa9-4e7d-9373-8db0261f8e97 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:07.362429 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-00ea9515-cfa9-4e7d-9373-8db0261f8e97 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:07.379778 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-00ea9515-cfa9-4e7d-9373-8db0261f8e97 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:07.391016 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-00ea9515-cfa9-4e7d-9373-8db0261f8e97 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:07.399777 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-00ea9515-cfa9-4e7d-9373-8db0261f8e97 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.236405 Jul 23 21:28:07.400778 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1765/3612] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:28:07 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:28:07.698562 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-38e22955-d20e-440e-b713-d4ad08ca27ed tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:07.720090 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-38e22955-d20e-440e-b713-d4ad08ca27ed tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331" status: 200 len: 1509 microversion: 2.1 time: 0.580398 Jul 23 21:28:07.722789 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1848/3613] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:28:07 2022] GET /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331 => generated 1509 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:28:07.740566 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e87cb0f0-e5cf-4cb8-8d55-238699b11195 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:07.744721 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e87cb0f0-e5cf-4cb8-8d55-238699b11195 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: c4da9681-4d81-4ffb-8d7e-453436e71331] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:07.748498 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e87cb0f0-e5cf-4cb8-8d55-238699b11195 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:07.749083 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e87cb0f0-e5cf-4cb8-8d55-238699b11195 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:07.750038 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e87cb0f0-e5cf-4cb8-8d55-238699b11195 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:07.750564 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e87cb0f0-e5cf-4cb8-8d55-238699b11195 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:07.781316 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e87cb0f0-e5cf-4cb8-8d55-238699b11195 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: c4da9681-4d81-4ffb-8d7e-453436e71331] Going to try to terminate instance {{(pid=131320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:28:07.788730 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.compute.api [None req-e87cb0f0-e5cf-4cb8-8d55-238699b11195 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: c4da9681-4d81-4ffb-8d7e-453436e71331] Working on deleting snapshot ee4e3a51-9753-4162-a843-3bdf74ae034e from shelved instance... Jul 23 21:28:07.812136 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-6c24dd8d-3467-4487-ba8f-4ab27e548549 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:07.813248 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-6c24dd8d-3467-4487-ba8f-4ab27e548549 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] [instance: d3d6b0e1-57fa-4247-bf6d-18c97aa22750] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:07.829596 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6c24dd8d-3467-4487-ba8f-4ab27e548549 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:07.831685 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6c24dd8d-3467-4487-ba8f-4ab27e548549 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:07.835450 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6c24dd8d-3467-4487-ba8f-4ab27e548549 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:07.838502 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6c24dd8d-3467-4487-ba8f-4ab27e548549 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:08.312800 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-6c24dd8d-3467-4487-ba8f-4ab27e548549 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e11fb79c253c4a0f955d710ff4626f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b46cc4b1ef64d168bf4184339de54d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:08.323859 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-6c24dd8d-3467-4487-ba8f-4ab27e548549 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] 10.222.0.17 "GET /compute/v2.1/servers/d3d6b0e1-57fa-4247-bf6d-18c97aa22750" status: 200 len: 1522 microversion: 2.1 time: 0.518555 Jul 23 21:28:08.324486 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1849/3614] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:28:07 2022] GET /compute/v2.1/servers/d3d6b0e1-57fa-4247-bf6d-18c97aa22750 => generated 1522 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:28:08.419620 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-195c412d-88c7-4312-8d70-7831405d23a3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:08.420385 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-195c412d-88c7-4312-8d70-7831405d23a3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:08.430418 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-195c412d-88c7-4312-8d70-7831405d23a3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:08.431884 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-195c412d-88c7-4312-8d70-7831405d23a3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:08.434133 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-195c412d-88c7-4312-8d70-7831405d23a3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:08.434851 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-195c412d-88c7-4312-8d70-7831405d23a3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:08.566584 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-195c412d-88c7-4312-8d70-7831405d23a3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:08.583813 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-195c412d-88c7-4312-8d70-7831405d23a3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:08.587324 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-195c412d-88c7-4312-8d70-7831405d23a3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:08.589184 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-195c412d-88c7-4312-8d70-7831405d23a3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.173836 Jul 23 21:28:08.603394 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1850/3615] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:28:08 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:28:08.707168 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:08.788938 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e87cb0f0-e5cf-4cb8-8d55-238699b11195 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: c4da9681-4d81-4ffb-8d7e-453436e71331] Doing local delete in cell 4e90cb14-d4b2-4158-b8cf-a592a1314a7b(cell1) {{(pid=131320) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jul 23 21:28:08.795828 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e87cb0f0-e5cf-4cb8-8d55-238699b11195 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:08.796520 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e87cb0f0-e5cf-4cb8-8d55-238699b11195 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:08.796981 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.compute.api [None req-e87cb0f0-e5cf-4cb8-8d55-238699b11195 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: c4da9681-4d81-4ffb-8d7e-453436e71331] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Jul 23 21:28:08.813757 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-e87cb0f0-e5cf-4cb8-8d55-238699b11195 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: c4da9681-4d81-4ffb-8d7e-453436e71331] deallocate_for_instance() {{(pid=131320) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 23 21:28:09.341617 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-bb316fc8-46ae-4cff-8b8b-c43a21fdafb5 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:09.342861 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-bb316fc8-46ae-4cff-8b8b-c43a21fdafb5 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] [instance: d3d6b0e1-57fa-4247-bf6d-18c97aa22750] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:09.352079 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bb316fc8-46ae-4cff-8b8b-c43a21fdafb5 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:09.355928 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bb316fc8-46ae-4cff-8b8b-c43a21fdafb5 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:09.361211 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bb316fc8-46ae-4cff-8b8b-c43a21fdafb5 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:09.361849 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bb316fc8-46ae-4cff-8b8b-c43a21fdafb5 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:09.885334 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-bb316fc8-46ae-4cff-8b8b-c43a21fdafb5 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e11fb79c253c4a0f955d710ff4626f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b46cc4b1ef64d168bf4184339de54d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:09.909214 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-bb316fc8-46ae-4cff-8b8b-c43a21fdafb5 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] 10.222.0.17 "GET /compute/v2.1/servers/d3d6b0e1-57fa-4247-bf6d-18c97aa22750" status: 200 len: 1502 microversion: 2.1 time: 0.571310 Jul 23 21:28:09.913730 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1851/3616] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:28:09 2022] GET /compute/v2.1/servers/d3d6b0e1-57fa-4247-bf6d-18c97aa22750 => generated 1502 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:28:09.920089 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-acbabbd6-a087-46e8-9c90-862a62af017e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:09.934765 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-acbabbd6-a087-46e8-9c90-862a62af017e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:09.955963 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-acbabbd6-a087-46e8-9c90-862a62af017e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:09.957597 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-acbabbd6-a087-46e8-9c90-862a62af017e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:09.959581 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-acbabbd6-a087-46e8-9c90-862a62af017e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:09.960046 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-acbabbd6-a087-46e8-9c90-862a62af017e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:10.023488 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-e87cb0f0-e5cf-4cb8-8d55-238699b11195 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: c4da9681-4d81-4ffb-8d7e-453436e71331] Updating instance_info_cache with network_info: [] {{(pid=131320) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 23 21:28:10.250274 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-acbabbd6-a087-46e8-9c90-862a62af017e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:10.260930 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-acbabbd6-a087-46e8-9c90-862a62af017e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:10.270674 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-acbabbd6-a087-46e8-9c90-862a62af017e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:10.272426 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-acbabbd6-a087-46e8-9c90-862a62af017e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.357245 Jul 23 21:28:10.284213 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1852/3617] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:28:09 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:28:10.312804 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e7a04941-e9b1-4b2a-87fe-89deef391199 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:10.314900 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-e7a04941-e9b1-4b2a-87fe-89deef391199 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] [instance: 63c3348d-dcf9-4e87-acfe-c7ab88796150] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:10.327391 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e7a04941-e9b1-4b2a-87fe-89deef391199 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:10.328348 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e7a04941-e9b1-4b2a-87fe-89deef391199 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:10.329401 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e7a04941-e9b1-4b2a-87fe-89deef391199 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:10.330318 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e7a04941-e9b1-4b2a-87fe-89deef391199 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:10.702706 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e87cb0f0-e5cf-4cb8-8d55-238699b11195 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "DELETE /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331" status: 204 len: 0 microversion: 2.1 time: 2.966631 Jul 23 21:28:10.704099 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1766/3618] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:28:07 2022] DELETE /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331 => generated 0 bytes in 2969 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:28:10.711730 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-bf83d8d9-5bd9-442a-93fa-3bee0983f890 req-8db6c5a7-3be6-4e27-84fa-72a3c2186fd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4da9681-4d81-4ffb-8d7e-453436e71331", "name": "network-vif-deleted", "tag": "f60d970a-170d-47a9-b1da-1f92400f8025"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:28:10.729241 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-bf83d8d9-5bd9-442a-93fa-3bee0983f890 req-8db6c5a7-3be6-4e27-84fa-72a3c2186fd8 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:10.729930 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-bf83d8d9-5bd9-442a-93fa-3bee0983f890 req-8db6c5a7-3be6-4e27-84fa-72a3c2186fd8 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:10.751935 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.compute.server_external_events [req-bf83d8d9-5bd9-442a-93fa-3bee0983f890 req-8db6c5a7-3be6-4e27-84fa-72a3c2186fd8 service nova] Unable to find a host for instance c4da9681-4d81-4ffb-8d7e-453436e71331. Dropping event network-vif-deleted {{(pid=131320) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 23 21:28:10.756190 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-bf83d8d9-5bd9-442a-93fa-3bee0983f890 req-8db6c5a7-3be6-4e27-84fa-72a3c2186fd8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.049740 Jul 23 21:28:10.758407 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1767/3619] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:28:10 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 53 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 23 21:28:10.769566 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-024d7f5f-c9d4-4517-8395-229a6803daee tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:10.773146 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-024d7f5f-c9d4-4517-8395-229a6803daee tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: c4da9681-4d81-4ffb-8d7e-453436e71331] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:10.785154 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-e7a04941-e9b1-4b2a-87fe-89deef391199 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e11fb79c253c4a0f955d710ff4626f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b46cc4b1ef64d168bf4184339de54d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:10.788788 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-024d7f5f-c9d4-4517-8395-229a6803daee tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:10.790837 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-024d7f5f-c9d4-4517-8395-229a6803daee tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:10.791570 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-024d7f5f-c9d4-4517-8395-229a6803daee tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:10.794541 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-024d7f5f-c9d4-4517-8395-229a6803daee tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:10.796036 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-e7a04941-e9b1-4b2a-87fe-89deef391199 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] 10.222.0.17 "GET /compute/v2.1/servers/63c3348d-dcf9-4e87-acfe-c7ab88796150" status: 200 len: 1517 microversion: 2.1 time: 0.509054 Jul 23 21:28:10.801634 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1853/3620] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:28:10 2022] GET /compute/v2.1/servers/63c3348d-dcf9-4e87-acfe-c7ab88796150 => generated 1517 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:28:10.821465 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-3f1f9ff4-e987-4d7b-b1b9-c95976cf2a7e tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:28:10.823510 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-3f1f9ff4-e987-4d7b-b1b9-c95976cf2a7e tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] [instance: c6514f7c-bc98-41f0-b66d-c0ac05a9811c] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:10.837236 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-3f1f9ff4-e987-4d7b-b1b9-c95976cf2a7e tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] HTTP exception thrown: Instance c6514f7c-bc98-41f0-b66d-c0ac05a9811c could not be found. Jul 23 21:28:10.839922 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-024d7f5f-c9d4-4517-8395-229a6803daee tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] HTTP exception thrown: Instance c4da9681-4d81-4ffb-8d7e-453436e71331 could not be found. Jul 23 21:28:10.842758 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-024d7f5f-c9d4-4517-8395-229a6803daee tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Request method failure captured: Jul 23 21:28:10.842758 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331 HTTP/1.1 Jul 23 21:28:10.842758 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:28:10.842758 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:28:10.842758 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:28:10.842758 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:28:10.842758 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:28:10.842758 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:28:10.842758 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:28:10.842758 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:28:10.842758 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GddaYqyOuWcIIbeHmsk3fPEmdWyfGLbr9Nsz9MmxXVcs_PKtvbIqY2C8j4fzxFCSVf8V3fYFIZhvaOHyCuudCVcoCOVgWdy__DYWHqWW4I8VD_yG4rJj0HZodonpxNaGqSkGiL8DXUXMaZTTZO1BvjnTGQlN8CnshrUQQ72pGMeb2k Jul 23 21:28:10.842758 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:28:10.842758 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:28:10.842758 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:28:10.842758 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:28:10.842758 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:28:10.842758 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:28:10.842758 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: a892bfe56afd4ee5bb6c47e926af7349 Jul 23 21:28:10.842758 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-DeleteServersTestJSON-745069838 Jul 23 21:28:10.842758 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:28:10.842758 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:28:10.842758 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a892bfe56afd4ee5bb6c47e926af7349"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a892bfe56afd4ee5bb6c47e926af7349"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a892bfe56afd4ee5bb6c47e926af7349", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a892bfe56afd4ee5bb6c47e926af7349"}]}] Jul 23 21:28:10.842758 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-DeleteServersTestJSON-745069838 Jul 23 21:28:10.842758 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: a892bfe56afd4ee5bb6c47e926af7349 Jul 23 21:28:10.842758 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-DeleteServersTestJSON-745069838 Jul 23 21:28:10.842758 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-DeleteServersTestJSON-745069838-project Jul 23 21:28:10.842758 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:28:10.842758 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:28:10.842758 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: affc3572ef7d45249f50b5061a681d18 Jul 23 21:28:10.842758 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-DeleteServersTestJSON-745069838-project Jul 23 21:28:10.842758 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:28:10.842758 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance c4da9681-4d81-4ffb-8d7e-453436e71331 could not be found. Jul 23 21:28:10.842758 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': 'c4da9681-4d81-4ffb-8d7e-453436e71331'} Jul 23 21:28:10.842758 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:28:10.842758 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:28:10.842758 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:28:10.842758 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:28:10.842758 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:28:10.842758 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:28:10.842758 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:28:10.842758 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:28:10.842758 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:28:10.842758 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:28:10.842758 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4da9681-4d81-4ffb-8d7e-453436e71331 could not be found. Jul 23 21:28:10.842758 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:28:10.842758 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:28:10.842758 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:28:10.842758 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:28:10.842758 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:28:10.842758 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:28:10.842758 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:28:10.842758 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:28:10.842758 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:28:10.842758 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:28:10.842758 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:28:10.842758 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:28:10.842758 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:28:10.842758 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:28:10.842758 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:28:10.842758 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:28:10.842758 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4da9681-4d81-4ffb-8d7e-453436e71331 could not be found. Jul 23 21:28:10.842758 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:28:10.842758 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:28:10.842758 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:28:10.848343 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:28:10.848343 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:28:10.848343 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:28:10.848343 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:28:10.848343 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:28:10.848343 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4da9681-4d81-4ffb-8d7e-453436e71331 could not be found. Jul 23 21:28:10.848343 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:28:10.848343 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-024d7f5f-c9d4-4517-8395-229a6803daee tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Returning 404 to user: Instance c4da9681-4d81-4ffb-8d7e-453436e71331 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:28:10.848343 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-024d7f5f-c9d4-4517-8395-229a6803daee tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331" status: 404 len: 111 microversion: 2.1 time: 0.083429 Jul 23 21:28:10.848343 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1768/3621] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:28:10 2022] GET /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:28:10.863836 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-3f1f9ff4-e987-4d7b-b1b9-c95976cf2a7e tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Request method failure captured: Jul 23 21:28:10.863836 ncdv-master-1 devstack@n-api.service[131321]: request: POST /compute/v2.1/servers/c6514f7c-bc98-41f0-b66d-c0ac05a9811c/action HTTP/1.1 Jul 23 21:28:10.863836 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:28:10.863836 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:28:10.863836 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:28:10.863836 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 14 Jul 23 21:28:10.863836 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:28:10.863836 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:28:10.863836 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:28:10.863836 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:28:10.863836 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3Ge5sfpyINomWvIAkXUfkN_GsmOi84xmn7Oehj4M1cohCMbN-apBPVBoMCXYqkSv7XAKTOGp925-GSTDUknXTPPAruca7_C6-qgMCTteE4yRK2cEHLY1toUemDjpxKzwap62q93oix_a2YsNO6xWlBMkvJ3y_64k-QWLQoGbOloMYPg Jul 23 21:28:10.863836 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:28:10.863836 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:28:10.863836 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:28:10.863836 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:28:10.863836 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:28:10.863836 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:28:10.863836 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 2b46cc4b1ef64d168bf4184339de54d2 Jul 23 21:28:10.863836 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2128176625 Jul 23 21:28:10.863836 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:28:10.863836 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:28:10.863836 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2b46cc4b1ef64d168bf4184339de54d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2b46cc4b1ef64d168bf4184339de54d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2b46cc4b1ef64d168bf4184339de54d2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2b46cc4b1ef64d168bf4184339de54d2"}]}] Jul 23 21:28:10.863836 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2128176625 Jul 23 21:28:10.863836 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 2b46cc4b1ef64d168bf4184339de54d2 Jul 23 21:28:10.863836 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2128176625 Jul 23 21:28:10.863836 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ServerRescueNegativeTestJSON-2128176625-project Jul 23 21:28:10.863836 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:28:10.863836 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:28:10.863836 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: e11fb79c253c4a0f955d710ff4626f6d Jul 23 21:28:10.863836 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2128176625-project Jul 23 21:28:10.863836 ncdv-master-1 devstack@n-api.service[131321]: Jul 23 21:28:10.863836 ncdv-master-1 devstack@n-api.service[131321]: {"rescue": {}} Jul 23 21:28:10.863836 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:28:10.863836 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance c6514f7c-bc98-41f0-b66d-c0ac05a9811c could not be found. Jul 23 21:28:10.863836 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': 'c6514f7c-bc98-41f0-b66d-c0ac05a9811c', 'body': {'rescue': {}}} Jul 23 21:28:10.863836 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:28:10.863836 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:28:10.863836 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:28:10.863836 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:28:10.863836 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:28:10.863836 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:28:10.863836 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 23 21:28:10.863836 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 23 21:28:10.863836 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6514f7c-bc98-41f0-b66d-c0ac05a9811c could not be found. Jul 23 21:28:10.863836 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:28:10.863836 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:28:10.863836 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:28:10.863836 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:28:10.863836 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:28:10.863836 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:28:10.863836 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:28:10.863836 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:28:10.863836 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:28:10.863836 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:28:10.863836 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:28:10.863836 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:28:10.863836 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Jul 23 21:28:10.863836 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 23 21:28:10.863836 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:28:10.863836 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:28:10.863836 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6514f7c-bc98-41f0-b66d-c0ac05a9811c could not be found. Jul 23 21:28:10.863836 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:28:10.863836 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:28:10.863836 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:28:10.863836 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:28:10.868493 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:28:10.868493 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:28:10.868493 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:28:10.868493 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:28:10.868493 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6514f7c-bc98-41f0-b66d-c0ac05a9811c could not be found. Jul 23 21:28:10.868493 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:28:10.868493 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-3f1f9ff4-e987-4d7b-b1b9-c95976cf2a7e tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Returning 404 to user: Instance c6514f7c-bc98-41f0-b66d-c0ac05a9811c could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:28:10.868493 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-3f1f9ff4-e987-4d7b-b1b9-c95976cf2a7e tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] 10.222.0.17 "POST /compute/v2.1/servers/c6514f7c-bc98-41f0-b66d-c0ac05a9811c/action" status: 404 len: 111 microversion: 2.1 time: 0.050707 Jul 23 21:28:10.868493 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1854/3622] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:28:10 2022] POST /compute/v2.1/servers/c6514f7c-bc98-41f0-b66d-c0ac05a9811c/action => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 23 21:28:10.883317 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ab9f6789-5db4-408b-abb6-3a48490c0423 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:28:10.884920 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ab9f6789-5db4-408b-abb6-3a48490c0423 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] [instance: 63c3348d-dcf9-4e87-acfe-c7ab88796150] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:10.911556 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ab9f6789-5db4-408b-abb6-3a48490c0423 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:10.911556 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ab9f6789-5db4-408b-abb6-3a48490c0423 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:10.911556 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ab9f6789-5db4-408b-abb6-3a48490c0423 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:10.911556 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ab9f6789-5db4-408b-abb6-3a48490c0423 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:11.094731 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d2679c61-b188-458a-baab-2e7289cb0499 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-499235936", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "networks": [{"uuid": "c89c9ae3-a9c7-4e98-860d-e9f8ea64bbcb"}]}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:28:11.148836 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ab9f6789-5db4-408b-abb6-3a48490c0423 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] 10.222.0.17 "POST /compute/v2.1/servers/63c3348d-dcf9-4e87-acfe-c7ab88796150/action" status: 202 len: 0 microversion: 2.1 time: 0.276040 Jul 23 21:28:11.154637 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1769/3623] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:28:10 2022] POST /compute/v2.1/servers/63c3348d-dcf9-4e87-acfe-c7ab88796150/action => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 23 21:28:11.169261 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-341a92d7-65a3-4357-bb52-5264c1fe3170 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:11.171562 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-341a92d7-65a3-4357-bb52-5264c1fe3170 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] [instance: 63c3348d-dcf9-4e87-acfe-c7ab88796150] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:11.195365 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-341a92d7-65a3-4357-bb52-5264c1fe3170 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:11.196080 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-341a92d7-65a3-4357-bb52-5264c1fe3170 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:11.198903 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-341a92d7-65a3-4357-bb52-5264c1fe3170 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:11.199587 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-341a92d7-65a3-4357-bb52-5264c1fe3170 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:11.221645 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.network.neutron [None req-d2679c61-b188-458a-baab-2e7289cb0499 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] validate_networks() for [('c89c9ae3-a9c7-4e98-860d-e9f8ea64bbcb', None, None, None, None, None)] {{(pid=131321) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:28:11.755481 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-341a92d7-65a3-4357-bb52-5264c1fe3170 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e11fb79c253c4a0f955d710ff4626f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b46cc4b1ef64d168bf4184339de54d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:11.766959 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-341a92d7-65a3-4357-bb52-5264c1fe3170 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] 10.222.0.17 "GET /compute/v2.1/servers/63c3348d-dcf9-4e87-acfe-c7ab88796150" status: 200 len: 1522 microversion: 2.1 time: 0.609115 Jul 23 21:28:11.768742 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1770/3624] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:28:11 2022] GET /compute/v2.1/servers/63c3348d-dcf9-4e87-acfe-c7ab88796150 => generated 1522 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:28:11.774292 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-119d2cfc-41ca-434a-91fc-21877aaa0334 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:11.775690 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-119d2cfc-41ca-434a-91fc-21877aaa0334 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:11.790529 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-119d2cfc-41ca-434a-91fc-21877aaa0334 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:11.792075 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-119d2cfc-41ca-434a-91fc-21877aaa0334 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:11.793183 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-119d2cfc-41ca-434a-91fc-21877aaa0334 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:11.794239 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-119d2cfc-41ca-434a-91fc-21877aaa0334 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:11.936903 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-119d2cfc-41ca-434a-91fc-21877aaa0334 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:11.957249 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-119d2cfc-41ca-434a-91fc-21877aaa0334 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:11.965699 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-119d2cfc-41ca-434a-91fc-21877aaa0334 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:11.968702 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-119d2cfc-41ca-434a-91fc-21877aaa0334 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.198784 Jul 23 21:28:11.970007 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1771/3625] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:28:11 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:28:12.687066 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-d2679c61-b188-458a-baab-2e7289cb0499 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Flavor limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:28:12.688297 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-d2679c61-b188-458a-baab-2e7289cb0499 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Image limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:28:12.688806 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-d2679c61-b188-458a-baab-2e7289cb0499 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Flavor pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:28:12.689368 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-d2679c61-b188-458a-baab-2e7289cb0499 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Image pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:28:12.689959 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-d2679c61-b188-458a-baab-2e7289cb0499 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:28:12.701177 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d2679c61-b188-458a-baab-2e7289cb0499 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:12.702034 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d2679c61-b188-458a-baab-2e7289cb0499 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:12.703049 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d2679c61-b188-458a-baab-2e7289cb0499 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:12.703496 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d2679c61-b188-458a-baab-2e7289cb0499 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:12.729960 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-d2679c61-b188-458a-baab-2e7289cb0499 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Getting quotas for project a892bfe56afd4ee5bb6c47e926af7349. Resources: {'ram', 'instances', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:28:12.737938 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-d2679c61-b188-458a-baab-2e7289cb0499 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Getting quotas for user affc3572ef7d45249f50b5061a681d18 and project a892bfe56afd4ee5bb6c47e926af7349. Resources: {'ram', 'instances', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:28:12.754448 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-d2679c61-b188-458a-baab-2e7289cb0499 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Going to run 1 instances... {{(pid=131321) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:28:12.757823 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-d2679c61-b188-458a-baab-2e7289cb0499 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: 694b9d2e-5137-4c2a-a656-2607e1ea912a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131321) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:28:12.785054 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-87c6a0cd-bb06-495c-8081-414f5b9cecfa tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:12.785774 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-87c6a0cd-bb06-495c-8081-414f5b9cecfa tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] [instance: 63c3348d-dcf9-4e87-acfe-c7ab88796150] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:12.796841 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-87c6a0cd-bb06-495c-8081-414f5b9cecfa tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:12.797646 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-87c6a0cd-bb06-495c-8081-414f5b9cecfa tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:12.798980 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-87c6a0cd-bb06-495c-8081-414f5b9cecfa tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:12.800054 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-87c6a0cd-bb06-495c-8081-414f5b9cecfa tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:12.846617 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-d2679c61-b188-458a-baab-2e7289cb0499 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.756336 Jul 23 21:28:12.853147 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1855/3626] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:28:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1763 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 23 21:28:12.864807 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a3afa6b8-8459-45f1-84b5-bd629ad52d7d tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:12.865747 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-a3afa6b8-8459-45f1-84b5-bd629ad52d7d tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: 694b9d2e-5137-4c2a-a656-2607e1ea912a] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:12.969757 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-a3afa6b8-8459-45f1-84b5-bd629ad52d7d tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:12.978984 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-a3afa6b8-8459-45f1-84b5-bd629ad52d7d tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/694b9d2e-5137-4c2a-a656-2607e1ea912a" status: 200 len: 1214 microversion: 2.1 time: 0.124666 Jul 23 21:28:12.979574 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1856/3627] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:28:12 2022] GET /compute/v2.1/servers/694b9d2e-5137-4c2a-a656-2607e1ea912a => generated 1214 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:28:13.000275 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-1279d430-512b-4959-b3c1-17467ed079b9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:13.000899 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-1279d430-512b-4959-b3c1-17467ed079b9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:13.010884 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1279d430-512b-4959-b3c1-17467ed079b9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:13.011339 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1279d430-512b-4959-b3c1-17467ed079b9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:13.012126 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1279d430-512b-4959-b3c1-17467ed079b9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:13.012556 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1279d430-512b-4959-b3c1-17467ed079b9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:13.172503 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-87c6a0cd-bb06-495c-8081-414f5b9cecfa tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e11fb79c253c4a0f955d710ff4626f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b46cc4b1ef64d168bf4184339de54d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:13.193610 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-87c6a0cd-bb06-495c-8081-414f5b9cecfa tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] 10.222.0.17 "GET /compute/v2.1/servers/63c3348d-dcf9-4e87-acfe-c7ab88796150" status: 200 len: 1502 microversion: 2.1 time: 0.412788 Jul 23 21:28:13.203593 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1772/3628] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:28:12 2022] GET /compute/v2.1/servers/63c3348d-dcf9-4e87-acfe-c7ab88796150 => generated 1502 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:28:13.224424 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3211a148-a51f-41cf-a894-15cdd9195991 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:28:13.229729 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-3211a148-a51f-41cf-a894-15cdd9195991 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] [instance: 63c3348d-dcf9-4e87-acfe-c7ab88796150] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:13.230196 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-1279d430-512b-4959-b3c1-17467ed079b9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:13.251676 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-1279d430-512b-4959-b3c1-17467ed079b9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:13.255808 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3211a148-a51f-41cf-a894-15cdd9195991 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:13.256661 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3211a148-a51f-41cf-a894-15cdd9195991 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:13.257707 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-1279d430-512b-4959-b3c1-17467ed079b9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:13.257998 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3211a148-a51f-41cf-a894-15cdd9195991 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:13.258329 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3211a148-a51f-41cf-a894-15cdd9195991 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:13.261127 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-1279d430-512b-4959-b3c1-17467ed079b9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.274267 Jul 23 21:28:13.274739 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1857/3629] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:28:12 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:28:13.295802 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.objects.instance [None req-3211a148-a51f-41cf-a894-15cdd9195991 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lazy-loading 'flavor' on Instance uuid 63c3348d-dcf9-4e87-acfe-c7ab88796150 {{(pid=131320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:28:13.313607 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-3211a148-a51f-41cf-a894-15cdd9195991 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] HTTP exception thrown: Cannot 'rescue' instance 63c3348d-dcf9-4e87-acfe-c7ab88796150 while it is in vm_state paused Jul 23 21:28:13.316173 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3211a148-a51f-41cf-a894-15cdd9195991 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Request method failure captured: Jul 23 21:28:13.316173 ncdv-master-1 devstack@n-api.service[131320]: request: POST /compute/v2.1/servers/63c3348d-dcf9-4e87-acfe-c7ab88796150/action HTTP/1.1 Jul 23 21:28:13.316173 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:28:13.316173 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:28:13.316173 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:28:13.316173 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 14 Jul 23 21:28:13.316173 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:28:13.316173 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:28:13.316173 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:28:13.316173 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:28:13.316173 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3Ge5sfpyINomWvIAkXUfkN_GsmOi84xmn7Oehj4M1cohCMbN-apBPVBoMCXYqkSv7XAKTOGp925-GSTDUknXTPPAruca7_C6-qgMCTteE4yRK2cEHLY1toUemDjpxKzwap62q93oix_a2YsNO6xWlBMkvJ3y_64k-QWLQoGbOloMYPg Jul 23 21:28:13.316173 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:28:13.316173 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:28:13.316173 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:28:13.316173 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:28:13.316173 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:28:13.316173 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:28:13.316173 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 2b46cc4b1ef64d168bf4184339de54d2 Jul 23 21:28:13.316173 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2128176625 Jul 23 21:28:13.316173 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:28:13.316173 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:28:13.316173 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2b46cc4b1ef64d168bf4184339de54d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2b46cc4b1ef64d168bf4184339de54d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2b46cc4b1ef64d168bf4184339de54d2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2b46cc4b1ef64d168bf4184339de54d2"}]}] Jul 23 21:28:13.316173 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2128176625 Jul 23 21:28:13.316173 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 2b46cc4b1ef64d168bf4184339de54d2 Jul 23 21:28:13.316173 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2128176625 Jul 23 21:28:13.316173 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServerRescueNegativeTestJSON-2128176625-project Jul 23 21:28:13.316173 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:28:13.316173 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:28:13.316173 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: e11fb79c253c4a0f955d710ff4626f6d Jul 23 21:28:13.316173 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2128176625-project Jul 23 21:28:13.316173 ncdv-master-1 devstack@n-api.service[131320]: Jul 23 21:28:13.316173 ncdv-master-1 devstack@n-api.service[131320]: {"rescue": {}} Jul 23 21:28:13.316173 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:28:13.316173 ncdv-master-1 devstack@n-api.service[131320]: exception: Cannot 'rescue' instance 63c3348d-dcf9-4e87-acfe-c7ab88796150 while it is in vm_state paused Jul 23 21:28:13.316173 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '63c3348d-dcf9-4e87-acfe-c7ab88796150', 'body': {'rescue': {}}} Jul 23 21:28:13.316173 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:28:13.316173 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:28:13.316173 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Jul 23 21:28:13.316173 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Jul 23 21:28:13.316173 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 23 21:28:13.316173 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 23 21:28:13.316173 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 23 21:28:13.316173 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 23 21:28:13.316173 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 23 21:28:13.316173 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 23 21:28:13.316173 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 63c3348d-dcf9-4e87-acfe-c7ab88796150 in vm_state paused. Cannot rescue while the instance is in this state. Jul 23 21:28:13.316173 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:28:13.316173 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:28:13.316173 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:28:13.316173 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:28:13.316173 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:28:13.316173 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:28:13.316173 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:28:13.316173 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:28:13.316173 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:28:13.316173 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:28:13.316173 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:28:13.316173 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:28:13.316173 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Jul 23 21:28:13.316173 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Jul 23 21:28:13.316173 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 23 21:28:13.316173 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 23 21:28:13.316173 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 63c3348d-dcf9-4e87-acfe-c7ab88796150 while it is in vm_state paused Jul 23 21:28:13.316173 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:28:13.322088 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:28:13.322088 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:28:13.322088 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:28:13.322088 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:28:13.322088 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:28:13.322088 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:28:13.322088 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:28:13.322088 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 63c3348d-dcf9-4e87-acfe-c7ab88796150 while it is in vm_state paused Jul 23 21:28:13.322088 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:28:13.322088 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3211a148-a51f-41cf-a894-15cdd9195991 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Returning 409 to user: Cannot 'rescue' instance 63c3348d-dcf9-4e87-acfe-c7ab88796150 while it is in vm_state paused {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:28:13.322088 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-3211a148-a51f-41cf-a894-15cdd9195991 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] 10.222.0.17 "POST /compute/v2.1/servers/63c3348d-dcf9-4e87-acfe-c7ab88796150/action" status: 409 len: 144 microversion: 2.1 time: 0.099405 Jul 23 21:28:13.328626 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-688f6047-c0e0-4f2d-b801-50d007b5b83c tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:28:13.329360 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-688f6047-c0e0-4f2d-b801-50d007b5b83c tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] [instance: 63c3348d-dcf9-4e87-acfe-c7ab88796150] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:13.333944 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1773/3630] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:28:13 2022] POST /compute/v2.1/servers/63c3348d-dcf9-4e87-acfe-c7ab88796150/action => generated 144 bytes in 115 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 23 21:28:13.338069 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-688f6047-c0e0-4f2d-b801-50d007b5b83c tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:13.338896 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-688f6047-c0e0-4f2d-b801-50d007b5b83c tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:13.340176 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-688f6047-c0e0-4f2d-b801-50d007b5b83c tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:13.340730 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-688f6047-c0e0-4f2d-b801-50d007b5b83c tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:13.449041 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-688f6047-c0e0-4f2d-b801-50d007b5b83c tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] 10.222.0.17 "POST /compute/v2.1/servers/63c3348d-dcf9-4e87-acfe-c7ab88796150/action" status: 202 len: 0 microversion: 2.1 time: 0.125544 Jul 23 21:28:13.450312 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1858/3631] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:28:13 2022] POST /compute/v2.1/servers/63c3348d-dcf9-4e87-acfe-c7ab88796150/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:28:13.460130 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d50af2ac-740d-4105-bd20-e947f3b4324f tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:13.461169 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d50af2ac-740d-4105-bd20-e947f3b4324f tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] [instance: 63c3348d-dcf9-4e87-acfe-c7ab88796150] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:13.471099 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d50af2ac-740d-4105-bd20-e947f3b4324f tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:13.472157 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d50af2ac-740d-4105-bd20-e947f3b4324f tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:13.474610 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d50af2ac-740d-4105-bd20-e947f3b4324f tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:13.475487 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d50af2ac-740d-4105-bd20-e947f3b4324f tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:13.903448 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d50af2ac-740d-4105-bd20-e947f3b4324f tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e11fb79c253c4a0f955d710ff4626f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b46cc4b1ef64d168bf4184339de54d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:13.912001 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d50af2ac-740d-4105-bd20-e947f3b4324f tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] 10.222.0.17 "GET /compute/v2.1/servers/63c3348d-dcf9-4e87-acfe-c7ab88796150" status: 200 len: 1509 microversion: 2.1 time: 0.457067 Jul 23 21:28:13.922732 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1774/3632] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:28:13 2022] GET /compute/v2.1/servers/63c3348d-dcf9-4e87-acfe-c7ab88796150 => generated 1509 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:28:13.996694 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f66b91fa-825c-47d9-9b97-039e80064519 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:13.997400 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-f66b91fa-825c-47d9-9b97-039e80064519 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: 694b9d2e-5137-4c2a-a656-2607e1ea912a] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:14.004238 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f66b91fa-825c-47d9-9b97-039e80064519 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:14.004996 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f66b91fa-825c-47d9-9b97-039e80064519 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:14.006293 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f66b91fa-825c-47d9-9b97-039e80064519 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:14.006922 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f66b91fa-825c-47d9-9b97-039e80064519 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:14.120398 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-f66b91fa-825c-47d9-9b97-039e80064519 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:14.128840 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-f66b91fa-825c-47d9-9b97-039e80064519 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/694b9d2e-5137-4c2a-a656-2607e1ea912a" status: 200 len: 1266 microversion: 2.1 time: 0.136338 Jul 23 21:28:14.129772 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1859/3633] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:28:13 2022] GET /compute/v2.1/servers/694b9d2e-5137-4c2a-a656-2607e1ea912a => generated 1266 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:28:14.285364 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8cd96f2e-cd35-4a0b-a287-bf77303cdd1d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:14.286021 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8cd96f2e-cd35-4a0b-a287-bf77303cdd1d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:14.297817 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8cd96f2e-cd35-4a0b-a287-bf77303cdd1d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:14.299478 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8cd96f2e-cd35-4a0b-a287-bf77303cdd1d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:14.300893 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8cd96f2e-cd35-4a0b-a287-bf77303cdd1d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:14.301415 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8cd96f2e-cd35-4a0b-a287-bf77303cdd1d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:14.462055 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8cd96f2e-cd35-4a0b-a287-bf77303cdd1d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:14.475611 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8cd96f2e-cd35-4a0b-a287-bf77303cdd1d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:14.483273 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8cd96f2e-cd35-4a0b-a287-bf77303cdd1d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:14.484843 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8cd96f2e-cd35-4a0b-a287-bf77303cdd1d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.204097 Jul 23 21:28:14.496511 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1775/3634] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:28:14 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:28:14.929648 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-4b4cf2ab-5b79-40f5-99dd-c6a3f1bcc84d tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:14.930289 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-4b4cf2ab-5b79-40f5-99dd-c6a3f1bcc84d tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] [instance: 63c3348d-dcf9-4e87-acfe-c7ab88796150] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:14.944390 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4b4cf2ab-5b79-40f5-99dd-c6a3f1bcc84d tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:14.944870 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4b4cf2ab-5b79-40f5-99dd-c6a3f1bcc84d tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:14.945712 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4b4cf2ab-5b79-40f5-99dd-c6a3f1bcc84d tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:14.950301 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4b4cf2ab-5b79-40f5-99dd-c6a3f1bcc84d tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:15.147280 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-cadd2e50-6200-431b-8a00-a75ab446cdf9 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:15.147929 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-cadd2e50-6200-431b-8a00-a75ab446cdf9 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: 694b9d2e-5137-4c2a-a656-2607e1ea912a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:15.160466 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cadd2e50-6200-431b-8a00-a75ab446cdf9 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:15.160932 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cadd2e50-6200-431b-8a00-a75ab446cdf9 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:15.166252 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cadd2e50-6200-431b-8a00-a75ab446cdf9 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:15.166714 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cadd2e50-6200-431b-8a00-a75ab446cdf9 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:15.383850 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-cadd2e50-6200-431b-8a00-a75ab446cdf9 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:15.395484 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-cadd2e50-6200-431b-8a00-a75ab446cdf9 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/694b9d2e-5137-4c2a-a656-2607e1ea912a" status: 200 len: 1272 microversion: 2.1 time: 0.252276 Jul 23 21:28:15.396371 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1776/3635] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:28:15 2022] GET /compute/v2.1/servers/694b9d2e-5137-4c2a-a656-2607e1ea912a => generated 1272 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:28:15.506134 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ed8eaa85-9c88-4fcc-ae21-f8f0871361e9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:15.507188 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ed8eaa85-9c88-4fcc-ae21-f8f0871361e9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:15.518350 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ed8eaa85-9c88-4fcc-ae21-f8f0871361e9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:15.521748 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ed8eaa85-9c88-4fcc-ae21-f8f0871361e9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:15.522930 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ed8eaa85-9c88-4fcc-ae21-f8f0871361e9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:15.523713 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ed8eaa85-9c88-4fcc-ae21-f8f0871361e9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:15.535240 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-4b4cf2ab-5b79-40f5-99dd-c6a3f1bcc84d tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e11fb79c253c4a0f955d710ff4626f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b46cc4b1ef64d168bf4184339de54d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:15.552240 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-4b4cf2ab-5b79-40f5-99dd-c6a3f1bcc84d tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] 10.222.0.17 "GET /compute/v2.1/servers/63c3348d-dcf9-4e87-acfe-c7ab88796150" status: 200 len: 1517 microversion: 2.1 time: 0.626597 Jul 23 21:28:15.557271 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1860/3636] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:28:14 2022] GET /compute/v2.1/servers/63c3348d-dcf9-4e87-acfe-c7ab88796150 => generated 1517 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:28:15.711049 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ed8eaa85-9c88-4fcc-ae21-f8f0871361e9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:15.726858 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ed8eaa85-9c88-4fcc-ae21-f8f0871361e9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:15.728857 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ed8eaa85-9c88-4fcc-ae21-f8f0871361e9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:15.730204 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ed8eaa85-9c88-4fcc-ae21-f8f0871361e9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.229723 Jul 23 21:28:15.734920 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1777/3637] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:28:15 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:28:16.416594 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f5607b00-3e05-478b-872a-8b9f745149d5 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:16.417286 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-f5607b00-3e05-478b-872a-8b9f745149d5 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: 694b9d2e-5137-4c2a-a656-2607e1ea912a] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:16.433192 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f5607b00-3e05-478b-872a-8b9f745149d5 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:16.433648 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f5607b00-3e05-478b-872a-8b9f745149d5 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:16.434727 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f5607b00-3e05-478b-872a-8b9f745149d5 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:16.435352 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f5607b00-3e05-478b-872a-8b9f745149d5 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:16.759492 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5f7f8a38-9aef-401b-8098-458e751f4687 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:16.760867 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5f7f8a38-9aef-401b-8098-458e751f4687 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:16.785685 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5f7f8a38-9aef-401b-8098-458e751f4687 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:16.786986 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5f7f8a38-9aef-401b-8098-458e751f4687 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:16.789013 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5f7f8a38-9aef-401b-8098-458e751f4687 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:16.790186 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5f7f8a38-9aef-401b-8098-458e751f4687 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:16.884341 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:16.960789 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5f7f8a38-9aef-401b-8098-458e751f4687 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:16.979182 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5f7f8a38-9aef-401b-8098-458e751f4687 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:16.984133 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5f7f8a38-9aef-401b-8098-458e751f4687 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:16.990848 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5f7f8a38-9aef-401b-8098-458e751f4687 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.237834 Jul 23 21:28:17.001565 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1778/3638] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:28:16 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:28:17.416455 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-f5607b00-3e05-478b-872a-8b9f745149d5 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:17.432741 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-f5607b00-3e05-478b-872a-8b9f745149d5 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/694b9d2e-5137-4c2a-a656-2607e1ea912a" status: 200 len: 1314 microversion: 2.1 time: 1.020605 Jul 23 21:28:17.433786 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1861/3639] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:28:16 2022] GET /compute/v2.1/servers/694b9d2e-5137-4c2a-a656-2607e1ea912a => generated 1314 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:28:18.012966 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9e451b25-7362-4705-a9e5-65a4dbaad5c1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:18.013945 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-9e451b25-7362-4705-a9e5-65a4dbaad5c1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:18.032434 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9e451b25-7362-4705-a9e5-65a4dbaad5c1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:18.032902 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9e451b25-7362-4705-a9e5-65a4dbaad5c1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:18.033811 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9e451b25-7362-4705-a9e5-65a4dbaad5c1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:18.034569 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9e451b25-7362-4705-a9e5-65a4dbaad5c1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:18.214064 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-9e451b25-7362-4705-a9e5-65a4dbaad5c1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:18.239706 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-9e451b25-7362-4705-a9e5-65a4dbaad5c1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:18.241553 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-9e451b25-7362-4705-a9e5-65a4dbaad5c1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:18.242809 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9e451b25-7362-4705-a9e5-65a4dbaad5c1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.234034 Jul 23 21:28:18.249360 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1779/3640] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:28:18 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:28:18.451554 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-4da5eebf-fcab-47b3-86ec-eb7929492aeb tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:18.451962 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-4da5eebf-fcab-47b3-86ec-eb7929492aeb tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: 694b9d2e-5137-4c2a-a656-2607e1ea912a] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:18.472969 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4da5eebf-fcab-47b3-86ec-eb7929492aeb tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:18.473421 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4da5eebf-fcab-47b3-86ec-eb7929492aeb tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:18.474275 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4da5eebf-fcab-47b3-86ec-eb7929492aeb tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:18.474714 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4da5eebf-fcab-47b3-86ec-eb7929492aeb tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:18.992774 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d5f8dfe7-d83b-4c7d-8e46-315270d24e5b tempest-ServersTestBootFromVolume-253143402 tempest-ServersTestBootFromVolume-253143402-project] Calling method '.version_select at 0x7f0b467074c0>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:19.036224 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d5f8dfe7-d83b-4c7d-8e46-315270d24e5b tempest-ServersTestBootFromVolume-253143402 tempest-ServersTestBootFromVolume-253143402-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-896843045" status: 202 len: 0 microversion: 2.1 time: 0.047439 Jul 23 21:28:19.037279 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1780/3641] 10.222.0.17 () {58 vars in 1217 bytes} [Sat Jul 23 21:28:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-896843045 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:28:19.089171 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-4da5eebf-fcab-47b3-86ec-eb7929492aeb tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:19.096918 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6ec7da0d-31e5-4daa-8e9c-bcfded463ad2 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:28:19.100154 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6ec7da0d-31e5-4daa-8e9c-bcfded463ad2 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] [instance: d3d6b0e1-57fa-4247-bf6d-18c97aa22750] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:19.106305 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-4da5eebf-fcab-47b3-86ec-eb7929492aeb tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/694b9d2e-5137-4c2a-a656-2607e1ea912a" status: 200 len: 1314 microversion: 2.1 time: 0.659889 Jul 23 21:28:19.113957 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6ec7da0d-31e5-4daa-8e9c-bcfded463ad2 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:19.114403 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1862/3642] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:28:18 2022] GET /compute/v2.1/servers/694b9d2e-5137-4c2a-a656-2607e1ea912a => generated 1314 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:28:19.119931 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6ec7da0d-31e5-4daa-8e9c-bcfded463ad2 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:19.120960 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6ec7da0d-31e5-4daa-8e9c-bcfded463ad2 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:19.121548 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6ec7da0d-31e5-4daa-8e9c-bcfded463ad2 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:19.168767 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-6ec7da0d-31e5-4daa-8e9c-bcfded463ad2 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] HTTP exception thrown: Cannot 'reboot' instance d3d6b0e1-57fa-4247-bf6d-18c97aa22750 while it is in vm_state rescued Jul 23 21:28:19.184137 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6ec7da0d-31e5-4daa-8e9c-bcfded463ad2 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Request method failure captured: Jul 23 21:28:19.184137 ncdv-master-1 devstack@n-api.service[131320]: request: POST /compute/v2.1/servers/d3d6b0e1-57fa-4247-bf6d-18c97aa22750/action HTTP/1.1 Jul 23 21:28:19.184137 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:28:19.184137 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:28:19.184137 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:28:19.184137 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 28 Jul 23 21:28:19.184137 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:28:19.184137 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:28:19.184137 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:28:19.184137 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:28:19.184137 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3Ge5sfpyINomWvIAkXUfkN_GsmOi84xmn7Oehj4M1cohCMbN-apBPVBoMCXYqkSv7XAKTOGp925-GSTDUknXTPPAruca7_C6-qgMCTteE4yRK2cEHLY1toUemDjpxKzwap62q93oix_a2YsNO6xWlBMkvJ3y_64k-QWLQoGbOloMYPg Jul 23 21:28:19.184137 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:28:19.184137 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:28:19.184137 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:28:19.184137 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:28:19.184137 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:28:19.184137 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:28:19.184137 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 2b46cc4b1ef64d168bf4184339de54d2 Jul 23 21:28:19.184137 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2128176625 Jul 23 21:28:19.184137 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:28:19.184137 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:28:19.184137 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2b46cc4b1ef64d168bf4184339de54d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2b46cc4b1ef64d168bf4184339de54d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2b46cc4b1ef64d168bf4184339de54d2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2b46cc4b1ef64d168bf4184339de54d2"}]}] Jul 23 21:28:19.184137 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2128176625 Jul 23 21:28:19.184137 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 2b46cc4b1ef64d168bf4184339de54d2 Jul 23 21:28:19.184137 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2128176625 Jul 23 21:28:19.184137 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServerRescueNegativeTestJSON-2128176625-project Jul 23 21:28:19.184137 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:28:19.184137 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:28:19.184137 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: e11fb79c253c4a0f955d710ff4626f6d Jul 23 21:28:19.184137 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2128176625-project Jul 23 21:28:19.184137 ncdv-master-1 devstack@n-api.service[131320]: Jul 23 21:28:19.184137 ncdv-master-1 devstack@n-api.service[131320]: {"reboot": {"type": "HARD"}} Jul 23 21:28:19.184137 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:28:19.184137 ncdv-master-1 devstack@n-api.service[131320]: exception: Cannot 'reboot' instance d3d6b0e1-57fa-4247-bf6d-18c97aa22750 while it is in vm_state rescued Jul 23 21:28:19.184137 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': 'd3d6b0e1-57fa-4247-bf6d-18c97aa22750', 'body': {'reboot': {'type': 'HARD'}}} Jul 23 21:28:19.184137 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:28:19.184137 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:28:19.184137 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Jul 23 21:28:19.184137 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Jul 23 21:28:19.184137 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 23 21:28:19.184137 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 23 21:28:19.184137 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3497, in reboot Jul 23 21:28:19.184137 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Jul 23 21:28:19.184137 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 23 21:28:19.184137 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 23 21:28:19.184137 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d3d6b0e1-57fa-4247-bf6d-18c97aa22750 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Jul 23 21:28:19.184137 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:28:19.184137 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:28:19.184137 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:28:19.184137 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:28:19.184137 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:28:19.184137 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:28:19.184137 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:28:19.184137 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:28:19.184137 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:28:19.184137 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:28:19.184137 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:28:19.184137 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:28:19.184137 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Jul 23 21:28:19.184137 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 23 21:28:19.184137 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 23 21:28:19.184137 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 23 21:28:19.196377 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance d3d6b0e1-57fa-4247-bf6d-18c97aa22750 while it is in vm_state rescued Jul 23 21:28:19.196377 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:28:19.196377 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:28:19.196377 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:28:19.196377 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:28:19.196377 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:28:19.196377 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:28:19.196377 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:28:19.196377 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:28:19.196377 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance d3d6b0e1-57fa-4247-bf6d-18c97aa22750 while it is in vm_state rescued Jul 23 21:28:19.196377 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:28:19.196377 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6ec7da0d-31e5-4daa-8e9c-bcfded463ad2 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Returning 409 to user: Cannot 'reboot' instance d3d6b0e1-57fa-4247-bf6d-18c97aa22750 while it is in vm_state rescued {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:28:19.196377 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6ec7da0d-31e5-4daa-8e9c-bcfded463ad2 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] 10.222.0.17 "POST /compute/v2.1/servers/d3d6b0e1-57fa-4247-bf6d-18c97aa22750/action" status: 409 len: 145 microversion: 2.1 time: 0.102307 Jul 23 21:28:19.196377 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1781/3643] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:28:19 2022] POST /compute/v2.1/servers/d3d6b0e1-57fa-4247-bf6d-18c97aa22750/action => generated 145 bytes in 104 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 23 21:28:19.198242 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ce8a6d6a-d005-4fe3-a176-10ead0212788 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:28:19.199947 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-ce8a6d6a-d005-4fe3-a176-10ead0212788 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] [instance: d3d6b0e1-57fa-4247-bf6d-18c97aa22750] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:19.208405 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-4d7c146b-3dc8-436a-973b-5dc31c532b0a req-5e975e9d-3443-429f-a14e-4b048f603964 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "694b9d2e-5137-4c2a-a656-2607e1ea912a", "tag": "15c6d187-24f9-41fc-a731-bb0fbef03740"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:28:19.229219 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ce8a6d6a-d005-4fe3-a176-10ead0212788 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:19.229669 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ce8a6d6a-d005-4fe3-a176-10ead0212788 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:19.230489 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ce8a6d6a-d005-4fe3-a176-10ead0212788 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:19.230928 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ce8a6d6a-d005-4fe3-a176-10ead0212788 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:19.251152 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-4d7c146b-3dc8-436a-973b-5dc31c532b0a req-5e975e9d-3443-429f-a14e-4b048f603964 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:19.251603 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-4d7c146b-3dc8-436a-973b-5dc31c532b0a req-5e975e9d-3443-429f-a14e-4b048f603964 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:19.295978 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-4d7c146b-3dc8-436a-973b-5dc31c532b0a req-5e975e9d-3443-429f-a14e-4b048f603964 service nova] Creating event network-changed:15c6d187-24f9-41fc-a731-bb0fbef03740 for instance 694b9d2e-5137-4c2a-a656-2607e1ea912a on nch1-master-1 Jul 23 21:28:19.305110 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-4d7c146b-3dc8-436a-973b-5dc31c532b0a req-5e975e9d-3443-429f-a14e-4b048f603964 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102546 Jul 23 21:28:19.310486 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1782/3644] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:28:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:28:19.316509 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-84b68d74-11cc-4135-85c8-c2415c6a8377 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:19.316762 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-84b68d74-11cc-4135-85c8-c2415c6a8377 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:19.319011 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-ce8a6d6a-d005-4fe3-a176-10ead0212788 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] HTTP exception thrown: Cannot 'rebuild' instance d3d6b0e1-57fa-4247-bf6d-18c97aa22750 while it is in vm_state rescued Jul 23 21:28:19.320891 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ce8a6d6a-d005-4fe3-a176-10ead0212788 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Request method failure captured: Jul 23 21:28:19.320891 ncdv-master-1 devstack@n-api.service[131321]: request: POST /compute/v2.1/servers/d3d6b0e1-57fa-4247-bf6d-18c97aa22750/action HTTP/1.1 Jul 23 21:28:19.320891 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:28:19.320891 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:28:19.320891 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:28:19.320891 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 65 Jul 23 21:28:19.320891 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:28:19.320891 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:28:19.320891 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:28:19.320891 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:28:19.320891 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3Ge5sfpyINomWvIAkXUfkN_GsmOi84xmn7Oehj4M1cohCMbN-apBPVBoMCXYqkSv7XAKTOGp925-GSTDUknXTPPAruca7_C6-qgMCTteE4yRK2cEHLY1toUemDjpxKzwap62q93oix_a2YsNO6xWlBMkvJ3y_64k-QWLQoGbOloMYPg Jul 23 21:28:19.320891 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:28:19.320891 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:28:19.320891 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:28:19.320891 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:28:19.320891 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:28:19.320891 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:28:19.320891 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 2b46cc4b1ef64d168bf4184339de54d2 Jul 23 21:28:19.320891 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2128176625 Jul 23 21:28:19.320891 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:28:19.320891 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:28:19.320891 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2b46cc4b1ef64d168bf4184339de54d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2b46cc4b1ef64d168bf4184339de54d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2b46cc4b1ef64d168bf4184339de54d2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2b46cc4b1ef64d168bf4184339de54d2"}]}] Jul 23 21:28:19.320891 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2128176625 Jul 23 21:28:19.320891 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 2b46cc4b1ef64d168bf4184339de54d2 Jul 23 21:28:19.320891 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2128176625 Jul 23 21:28:19.320891 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ServerRescueNegativeTestJSON-2128176625-project Jul 23 21:28:19.320891 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:28:19.320891 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:28:19.320891 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: e11fb79c253c4a0f955d710ff4626f6d Jul 23 21:28:19.320891 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2128176625-project Jul 23 21:28:19.320891 ncdv-master-1 devstack@n-api.service[131321]: Jul 23 21:28:19.320891 ncdv-master-1 devstack@n-api.service[131321]: {"rebuild": {"imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a"}} Jul 23 21:28:19.320891 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:28:19.320891 ncdv-master-1 devstack@n-api.service[131321]: exception: Cannot 'rebuild' instance d3d6b0e1-57fa-4247-bf6d-18c97aa22750 while it is in vm_state rescued Jul 23 21:28:19.320891 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': 'd3d6b0e1-57fa-4247-bf6d-18c97aa22750', 'body': {'rebuild': {'imageRef': 'b27b20aa-ef1b-4dd1-989e-321af6343d6a'}}} Jul 23 21:28:19.320891 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:28:19.320891 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:28:19.320891 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1220, in _action_rebuild Jul 23 21:28:19.320891 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Jul 23 21:28:19.320891 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 23 21:28:19.320891 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 23 21:28:19.320891 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 23 21:28:19.320891 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 23 21:28:19.320891 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 23 21:28:19.320891 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 23 21:28:19.320891 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 23 21:28:19.320891 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 23 21:28:19.320891 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d3d6b0e1-57fa-4247-bf6d-18c97aa22750 in vm_state rescued. Cannot rebuild while the instance is in this state. Jul 23 21:28:19.320891 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:28:19.320891 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:28:19.320891 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:28:19.320891 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:28:19.320891 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:28:19.320891 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:28:19.320891 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:28:19.320891 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:28:19.320891 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:28:19.320891 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:28:19.320891 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:28:19.320891 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:28:19.320891 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:28:19.320891 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:28:19.320891 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:28:19.333134 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:28:19.333134 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Jul 23 21:28:19.333134 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1228, in _action_rebuild Jul 23 21:28:19.333134 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 23 21:28:19.333134 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 23 21:28:19.333134 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 23 21:28:19.333134 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance d3d6b0e1-57fa-4247-bf6d-18c97aa22750 while it is in vm_state rescued Jul 23 21:28:19.333134 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:28:19.333134 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:28:19.333134 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:28:19.333134 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:28:19.333134 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:28:19.333134 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:28:19.333134 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:28:19.333134 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:28:19.333134 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance d3d6b0e1-57fa-4247-bf6d-18c97aa22750 while it is in vm_state rescued Jul 23 21:28:19.333134 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:28:19.333134 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ce8a6d6a-d005-4fe3-a176-10ead0212788 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Returning 409 to user: Cannot 'rebuild' instance d3d6b0e1-57fa-4247-bf6d-18c97aa22750 while it is in vm_state rescued {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:28:19.333134 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-ce8a6d6a-d005-4fe3-a176-10ead0212788 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] 10.222.0.17 "POST /compute/v2.1/servers/d3d6b0e1-57fa-4247-bf6d-18c97aa22750/action" status: 409 len: 146 microversion: 2.1 time: 0.132019 Jul 23 21:28:19.333134 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1863/3645] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:28:19 2022] POST /compute/v2.1/servers/d3d6b0e1-57fa-4247-bf6d-18c97aa22750/action => generated 146 bytes in 133 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 23 21:28:19.358586 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-84b68d74-11cc-4135-85c8-c2415c6a8377 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:19.363688 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-84b68d74-11cc-4135-85c8-c2415c6a8377 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:19.364869 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-84b68d74-11cc-4135-85c8-c2415c6a8377 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:19.369930 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-84b68d74-11cc-4135-85c8-c2415c6a8377 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:19.603834 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-84b68d74-11cc-4135-85c8-c2415c6a8377 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:19.618866 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-84b68d74-11cc-4135-85c8-c2415c6a8377 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:19.621687 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-84b68d74-11cc-4135-85c8-c2415c6a8377 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:19.624522 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-84b68d74-11cc-4135-85c8-c2415c6a8377 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.312836 Jul 23 21:28:19.625098 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1783/3646] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:28:19 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:28:20.129525 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-6fb8e783-f591-4ceb-b2a1-c135342ef190 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:20.130635 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-6fb8e783-f591-4ceb-b2a1-c135342ef190 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: 694b9d2e-5137-4c2a-a656-2607e1ea912a] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:20.146914 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d107e0ea-cd18-4be3-aec5-d147837389f8 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:20.149309 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d107e0ea-cd18-4be3-aec5-d147837389f8 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] [instance: d3d6b0e1-57fa-4247-bf6d-18c97aa22750] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:20.150803 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6fb8e783-f591-4ceb-b2a1-c135342ef190 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:20.151278 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6fb8e783-f591-4ceb-b2a1-c135342ef190 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:20.154424 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6fb8e783-f591-4ceb-b2a1-c135342ef190 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:20.155170 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6fb8e783-f591-4ceb-b2a1-c135342ef190 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:20.163850 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d107e0ea-cd18-4be3-aec5-d147837389f8 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:20.165126 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d107e0ea-cd18-4be3-aec5-d147837389f8 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:20.166659 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d107e0ea-cd18-4be3-aec5-d147837389f8 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:20.167927 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d107e0ea-cd18-4be3-aec5-d147837389f8 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:20.220787 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d107e0ea-cd18-4be3-aec5-d147837389f8 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] [instance: d3d6b0e1-57fa-4247-bf6d-18c97aa22750] Going to try to terminate instance {{(pid=131320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:28:20.373730 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:20.383691 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d107e0ea-cd18-4be3-aec5-d147837389f8 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d3d6b0e1-57fa-4247-bf6d-18c97aa22750" status: 204 len: 0 microversion: 2.1 time: 0.241916 Jul 23 21:28:20.391428 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1784/3647] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:28:20 2022] DELETE /compute/v2.1/servers/d3d6b0e1-57fa-4247-bf6d-18c97aa22750 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:28:20.406568 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-fc3d54c8-51d6-4996-8733-154622e81d69 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:20.407797 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-fc3d54c8-51d6-4996-8733-154622e81d69 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] [instance: d3d6b0e1-57fa-4247-bf6d-18c97aa22750] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:20.426348 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fc3d54c8-51d6-4996-8733-154622e81d69 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:20.427417 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fc3d54c8-51d6-4996-8733-154622e81d69 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:20.429476 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fc3d54c8-51d6-4996-8733-154622e81d69 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:20.430815 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fc3d54c8-51d6-4996-8733-154622e81d69 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:20.653608 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-6fb8e783-f591-4ceb-b2a1-c135342ef190 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:20.676903 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-6fb8e783-f591-4ceb-b2a1-c135342ef190 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/694b9d2e-5137-4c2a-a656-2607e1ea912a" status: 200 len: 1314 microversion: 2.1 time: 0.552070 Jul 23 21:28:20.678272 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1864/3648] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:28:20 2022] GET /compute/v2.1/servers/694b9d2e-5137-4c2a-a656-2607e1ea912a => generated 1314 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:28:20.694384 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-5ab65498-f68a-4c4f-a1b1-af51574e3937 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:20.695576 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-5ab65498-f68a-4c4f-a1b1-af51574e3937 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:20.709473 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5ab65498-f68a-4c4f-a1b1-af51574e3937 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:20.710255 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5ab65498-f68a-4c4f-a1b1-af51574e3937 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:20.711242 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5ab65498-f68a-4c4f-a1b1-af51574e3937 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:20.712399 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5ab65498-f68a-4c4f-a1b1-af51574e3937 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:20.742545 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:20.829464 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-5ab65498-f68a-4c4f-a1b1-af51574e3937 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:20.840875 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-5ab65498-f68a-4c4f-a1b1-af51574e3937 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:20.850042 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-5ab65498-f68a-4c4f-a1b1-af51574e3937 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:20.863579 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-5ab65498-f68a-4c4f-a1b1-af51574e3937 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.175134 Jul 23 21:28:20.864617 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1865/3649] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:28:20 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:28:21.395430 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-fc3d54c8-51d6-4996-8733-154622e81d69 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e11fb79c253c4a0f955d710ff4626f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b46cc4b1ef64d168bf4184339de54d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:21.407676 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-fc3d54c8-51d6-4996-8733-154622e81d69 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] 10.222.0.17 "GET /compute/v2.1/servers/d3d6b0e1-57fa-4247-bf6d-18c97aa22750" status: 200 len: 1508 microversion: 2.1 time: 1.010206 Jul 23 21:28:21.408510 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1785/3650] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:28:20 2022] GET /compute/v2.1/servers/d3d6b0e1-57fa-4247-bf6d-18c97aa22750 => generated 1508 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:28:21.672952 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-42db8a27-9398-48d6-97fd-cb83c70bb323 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1253046925", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:28:21.694633 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0d5d7918-91eb-4a28-8471-a30e852472f7 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:21.695263 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-0d5d7918-91eb-4a28-8471-a30e852472f7 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: 694b9d2e-5137-4c2a-a656-2607e1ea912a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:21.705204 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0d5d7918-91eb-4a28-8471-a30e852472f7 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:21.705664 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0d5d7918-91eb-4a28-8471-a30e852472f7 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:21.706531 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0d5d7918-91eb-4a28-8471-a30e852472f7 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:21.706977 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0d5d7918-91eb-4a28-8471-a30e852472f7 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:21.768694 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.network.neutron [None req-42db8a27-9398-48d6-97fd-cb83c70bb323 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] validate_networks() for [('2ef4984d-4688-41b1-9cf1-8bd2229153ac', None, None, None, None, None)] {{(pid=131321) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:28:22.483069 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-0d5d7918-91eb-4a28-8471-a30e852472f7 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:22.498734 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-0d5d7918-91eb-4a28-8471-a30e852472f7 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/694b9d2e-5137-4c2a-a656-2607e1ea912a" status: 200 len: 1314 microversion: 2.1 time: 0.808378 Jul 23 21:28:22.499332 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1786/3651] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:28:21 2022] GET /compute/v2.1/servers/694b9d2e-5137-4c2a-a656-2607e1ea912a => generated 1314 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:28:22.504735 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-cc2f7a7c-7808-4f2e-961c-244fe07479c8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:22.509807 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-cc2f7a7c-7808-4f2e-961c-244fe07479c8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:22.519838 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cc2f7a7c-7808-4f2e-961c-244fe07479c8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:22.522077 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cc2f7a7c-7808-4f2e-961c-244fe07479c8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:22.526798 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cc2f7a7c-7808-4f2e-961c-244fe07479c8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:22.527881 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cc2f7a7c-7808-4f2e-961c-244fe07479c8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:22.716437 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell0:SELECT=2 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:22.826337 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-cc2f7a7c-7808-4f2e-961c-244fe07479c8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:22.843227 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-cc2f7a7c-7808-4f2e-961c-244fe07479c8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:22.846231 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-cc2f7a7c-7808-4f2e-961c-244fe07479c8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:22.848575 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-cc2f7a7c-7808-4f2e-961c-244fe07479c8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.348114 Jul 23 21:28:22.852229 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1787/3652] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:28:22 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:28:22.860172 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-64cac800-5d28-4ef4-9172-d2c6c0702bf3 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:22.863890 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-64cac800-5d28-4ef4-9172-d2c6c0702bf3 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] [instance: d3d6b0e1-57fa-4247-bf6d-18c97aa22750] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:22.878885 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-64cac800-5d28-4ef4-9172-d2c6c0702bf3 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:22.879621 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-64cac800-5d28-4ef4-9172-d2c6c0702bf3 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:22.883273 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-64cac800-5d28-4ef4-9172-d2c6c0702bf3 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:22.884881 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-64cac800-5d28-4ef4-9172-d2c6c0702bf3 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:22.967042 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-42db8a27-9398-48d6-97fd-cb83c70bb323 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Flavor limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:28:22.967483 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-42db8a27-9398-48d6-97fd-cb83c70bb323 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Image limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:28:22.968225 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-42db8a27-9398-48d6-97fd-cb83c70bb323 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Flavor pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:28:22.968720 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-42db8a27-9398-48d6-97fd-cb83c70bb323 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Image pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:28:22.969370 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-42db8a27-9398-48d6-97fd-cb83c70bb323 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:28:22.978020 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell0:SELECT=8 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:23.002237 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-42db8a27-9398-48d6-97fd-cb83c70bb323 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:23.002913 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-42db8a27-9398-48d6-97fd-cb83c70bb323 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:23.008438 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-42db8a27-9398-48d6-97fd-cb83c70bb323 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:23.011784 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-42db8a27-9398-48d6-97fd-cb83c70bb323 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:23.065703 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-42db8a27-9398-48d6-97fd-cb83c70bb323 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Getting quotas for project f3eef3db6d5f46c9882fbe98cb732263. Resources: {'ram', 'instances', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:28:23.097080 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-42db8a27-9398-48d6-97fd-cb83c70bb323 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Getting quotas for user 3b566640463e43aa85ec96a1aa76d3f8 and project f3eef3db6d5f46c9882fbe98cb732263. Resources: {'ram', 'instances', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:28:23.129653 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:23.134500 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-42db8a27-9398-48d6-97fd-cb83c70bb323 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Going to run 1 instances... {{(pid=131321) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:28:23.140678 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-42db8a27-9398-48d6-97fd-cb83c70bb323 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] [instance: f24f6136-4a47-44f1-9e79-fea1b1cbf057] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131321) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:28:23.273149 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-42db8a27-9398-48d6-97fd-cb83c70bb323 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.061112 Jul 23 21:28:23.274916 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1866/3653] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:28:21 2022] POST /compute/v2.1/servers => generated 383 bytes in 2063 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 23 21:28:23.301209 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e979e7b5-d13c-4fb6-befc-c658ed73e3f5 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:23.302348 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-e979e7b5-d13c-4fb6-befc-c658ed73e3f5 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] [instance: f24f6136-4a47-44f1-9e79-fea1b1cbf057] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:23.529252 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-64cac800-5d28-4ef4-9172-d2c6c0702bf3 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e11fb79c253c4a0f955d710ff4626f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b46cc4b1ef64d168bf4184339de54d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:23.538760 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-64cac800-5d28-4ef4-9172-d2c6c0702bf3 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] 10.222.0.17 "GET /compute/v2.1/servers/d3d6b0e1-57fa-4247-bf6d-18c97aa22750" status: 200 len: 1508 microversion: 2.1 time: 0.684876 Jul 23 21:28:23.554001 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1788/3654] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:28:22 2022] GET /compute/v2.1/servers/d3d6b0e1-57fa-4247-bf6d-18c97aa22750 => generated 1508 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:28:23.561240 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9902195f-255f-4f68-ab9b-f06f8cb81e26 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:23.566343 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-9902195f-255f-4f68-ab9b-f06f8cb81e26 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: 694b9d2e-5137-4c2a-a656-2607e1ea912a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:23.583639 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9902195f-255f-4f68-ab9b-f06f8cb81e26 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:23.584593 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9902195f-255f-4f68-ab9b-f06f8cb81e26 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:23.586774 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9902195f-255f-4f68-ab9b-f06f8cb81e26 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:23.587400 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9902195f-255f-4f68-ab9b-f06f8cb81e26 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:23.785317 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-e979e7b5-d13c-4fb6-befc-c658ed73e3f5 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b566640463e43aa85ec96a1aa76d3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eef3db6d5f46c9882fbe98cb732263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:23.807094 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-e979e7b5-d13c-4fb6-befc-c658ed73e3f5 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] 10.222.0.17 "GET /compute/v2.1/servers/f24f6136-4a47-44f1-9e79-fea1b1cbf057" status: 200 len: 1223 microversion: 2.1 time: 0.520409 Jul 23 21:28:23.808067 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1867/3655] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:28:23 2022] GET /compute/v2.1/servers/f24f6136-4a47-44f1-9e79-fea1b1cbf057 => generated 1223 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:28:23.869445 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-34cc5f58-f457-41f5-8402-6c714c84712d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:23.872389 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-34cc5f58-f457-41f5-8402-6c714c84712d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:23.889310 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-34cc5f58-f457-41f5-8402-6c714c84712d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:23.890393 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-34cc5f58-f457-41f5-8402-6c714c84712d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:23.891264 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-34cc5f58-f457-41f5-8402-6c714c84712d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:23.891914 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-34cc5f58-f457-41f5-8402-6c714c84712d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:24.119524 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-34cc5f58-f457-41f5-8402-6c714c84712d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:24.141146 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-34cc5f58-f457-41f5-8402-6c714c84712d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:24.146945 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-34cc5f58-f457-41f5-8402-6c714c84712d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:24.150037 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-34cc5f58-f457-41f5-8402-6c714c84712d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.284741 Jul 23 21:28:24.163933 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1868/3656] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:28:23 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:28:24.428999 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-9902195f-255f-4f68-ab9b-f06f8cb81e26 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:24.448711 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9902195f-255f-4f68-ab9b-f06f8cb81e26 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/694b9d2e-5137-4c2a-a656-2607e1ea912a" status: 200 len: 1314 microversion: 2.1 time: 0.891849 Jul 23 21:28:24.450613 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1789/3657] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:28:23 2022] GET /compute/v2.1/servers/694b9d2e-5137-4c2a-a656-2607e1ea912a => generated 1314 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:28:24.561325 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d1b95828-e73d-4280-8b02-161df12c0293 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:24.562055 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-d1b95828-e73d-4280-8b02-161df12c0293 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] [instance: d3d6b0e1-57fa-4247-bf6d-18c97aa22750] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:24.571608 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d1b95828-e73d-4280-8b02-161df12c0293 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:24.572522 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d1b95828-e73d-4280-8b02-161df12c0293 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:24.573758 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d1b95828-e73d-4280-8b02-161df12c0293 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:24.574247 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d1b95828-e73d-4280-8b02-161df12c0293 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:24.825109 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a5bdb58b-e7fe-45c6-9bf1-d317cd072b90 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:24.825739 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a5bdb58b-e7fe-45c6-9bf1-d317cd072b90 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] [instance: f24f6136-4a47-44f1-9e79-fea1b1cbf057] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:24.832272 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a5bdb58b-e7fe-45c6-9bf1-d317cd072b90 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:24.832740 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a5bdb58b-e7fe-45c6-9bf1-d317cd072b90 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:24.833532 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a5bdb58b-e7fe-45c6-9bf1-d317cd072b90 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:24.852784 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a5bdb58b-e7fe-45c6-9bf1-d317cd072b90 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:25.076975 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-d1b95828-e73d-4280-8b02-161df12c0293 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e11fb79c253c4a0f955d710ff4626f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b46cc4b1ef64d168bf4184339de54d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:25.117823 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-d1b95828-e73d-4280-8b02-161df12c0293 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] 10.222.0.17 "GET /compute/v2.1/servers/d3d6b0e1-57fa-4247-bf6d-18c97aa22750" status: 200 len: 1508 microversion: 2.1 time: 0.551904 Jul 23 21:28:25.125955 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1869/3658] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:28:24 2022] GET /compute/v2.1/servers/d3d6b0e1-57fa-4247-bf6d-18c97aa22750 => generated 1508 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:28:25.172543 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-becaecb2-d139-4746-94cf-12bc34ff9da3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:25.173386 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-becaecb2-d139-4746-94cf-12bc34ff9da3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:25.203626 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-becaecb2-d139-4746-94cf-12bc34ff9da3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:25.205711 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-becaecb2-d139-4746-94cf-12bc34ff9da3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:25.208284 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-becaecb2-d139-4746-94cf-12bc34ff9da3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:25.211479 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-becaecb2-d139-4746-94cf-12bc34ff9da3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:25.348708 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a5bdb58b-e7fe-45c6-9bf1-d317cd072b90 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b566640463e43aa85ec96a1aa76d3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eef3db6d5f46c9882fbe98cb732263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:25.377232 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a5bdb58b-e7fe-45c6-9bf1-d317cd072b90 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] 10.222.0.17 "GET /compute/v2.1/servers/f24f6136-4a47-44f1-9e79-fea1b1cbf057" status: 200 len: 1275 microversion: 2.1 time: 0.556195 Jul 23 21:28:25.379574 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1790/3659] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:28:24 2022] GET /compute/v2.1/servers/f24f6136-4a47-44f1-9e79-fea1b1cbf057 => generated 1275 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:28:25.474969 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1ad87983-2585-4e15-b065-57d5b469388a tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:25.476718 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1ad87983-2585-4e15-b065-57d5b469388a tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: 694b9d2e-5137-4c2a-a656-2607e1ea912a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:25.495783 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-becaecb2-d139-4746-94cf-12bc34ff9da3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:25.496496 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1ad87983-2585-4e15-b065-57d5b469388a tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:25.501368 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1ad87983-2585-4e15-b065-57d5b469388a tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:25.503433 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1ad87983-2585-4e15-b065-57d5b469388a tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:25.504093 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1ad87983-2585-4e15-b065-57d5b469388a tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:25.523540 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-becaecb2-d139-4746-94cf-12bc34ff9da3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:25.532002 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-becaecb2-d139-4746-94cf-12bc34ff9da3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:25.534433 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-becaecb2-d139-4746-94cf-12bc34ff9da3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.366035 Jul 23 21:28:25.537981 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1870/3660] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:28:25 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:28:25.727513 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-32f0403f-d503-4da6-b87c-bfafb9d3b71d req-5fe455a7-2301-4689-bc10-b1bcb36333e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3d6b0e1-57fa-4247-bf6d-18c97aa22750", "name": "network-vif-deleted", "tag": "7cf9c3f5-8099-4bad-9bc9-d6b598d427b9"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:28:25.751310 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-32f0403f-d503-4da6-b87c-bfafb9d3b71d req-5fe455a7-2301-4689-bc10-b1bcb36333e9 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:25.752557 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-32f0403f-d503-4da6-b87c-bfafb9d3b71d req-5fe455a7-2301-4689-bc10-b1bcb36333e9 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:25.779891 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-32f0403f-d503-4da6-b87c-bfafb9d3b71d req-5fe455a7-2301-4689-bc10-b1bcb36333e9 service nova] Creating event network-vif-deleted:7cf9c3f5-8099-4bad-9bc9-d6b598d427b9 for instance d3d6b0e1-57fa-4247-bf6d-18c97aa22750 on nch1-master-1 Jul 23 21:28:25.790443 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-32f0403f-d503-4da6-b87c-bfafb9d3b71d req-5fe455a7-2301-4689-bc10-b1bcb36333e9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073785 Jul 23 21:28:25.791986 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1871/3661] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:28:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:28:26.110317 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-1ad87983-2585-4e15-b065-57d5b469388a tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:26.119723 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1ad87983-2585-4e15-b065-57d5b469388a tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/694b9d2e-5137-4c2a-a656-2607e1ea912a" status: 200 len: 1314 microversion: 2.1 time: 0.653160 Jul 23 21:28:26.120439 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1791/3662] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:28:25 2022] GET /compute/v2.1/servers/694b9d2e-5137-4c2a-a656-2607e1ea912a => generated 1314 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:28:26.147540 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e2af2346-1b1b-4f1f-a55b-f40ddb45d969 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:26.148671 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-e2af2346-1b1b-4f1f-a55b-f40ddb45d969 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] [instance: d3d6b0e1-57fa-4247-bf6d-18c97aa22750] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:26.166543 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e2af2346-1b1b-4f1f-a55b-f40ddb45d969 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:26.168390 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e2af2346-1b1b-4f1f-a55b-f40ddb45d969 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:26.170320 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e2af2346-1b1b-4f1f-a55b-f40ddb45d969 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:26.171055 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e2af2346-1b1b-4f1f-a55b-f40ddb45d969 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:26.256503 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e2af2346-1b1b-4f1f-a55b-f40ddb45d969 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:26.257286 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e2af2346-1b1b-4f1f-a55b-f40ddb45d969 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:26.258077 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.objects.instance [None req-e2af2346-1b1b-4f1f-a55b-f40ddb45d969 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lazy-loading 'fault' on Instance uuid d3d6b0e1-57fa-4247-bf6d-18c97aa22750 {{(pid=131321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:28:26.395557 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8cf69941-c19f-4f9e-ab11-86ad3e17d37e tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:26.396550 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8cf69941-c19f-4f9e-ab11-86ad3e17d37e tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] [instance: f24f6136-4a47-44f1-9e79-fea1b1cbf057] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:26.410847 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8cf69941-c19f-4f9e-ab11-86ad3e17d37e tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:26.411608 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8cf69941-c19f-4f9e-ab11-86ad3e17d37e tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:26.414147 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8cf69941-c19f-4f9e-ab11-86ad3e17d37e tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:26.415877 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8cf69941-c19f-4f9e-ab11-86ad3e17d37e tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:26.446784 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-e2af2346-1b1b-4f1f-a55b-f40ddb45d969 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e11fb79c253c4a0f955d710ff4626f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b46cc4b1ef64d168bf4184339de54d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:26.454236 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-e2af2346-1b1b-4f1f-a55b-f40ddb45d969 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] 10.222.0.17 "GET /compute/v2.1/servers/d3d6b0e1-57fa-4247-bf6d-18c97aa22750" status: 200 len: 1312 microversion: 2.1 time: 0.314463 Jul 23 21:28:26.455409 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1872/3663] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:28:26 2022] GET /compute/v2.1/servers/d3d6b0e1-57fa-4247-bf6d-18c97aa22750 => generated 1312 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:28:26.556760 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-82f55139-f90c-4db2-aae5-e9ccdfb83514 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:26.557502 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-82f55139-f90c-4db2-aae5-e9ccdfb83514 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:26.564812 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-82f55139-f90c-4db2-aae5-e9ccdfb83514 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:26.566688 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-82f55139-f90c-4db2-aae5-e9ccdfb83514 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:26.568040 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-82f55139-f90c-4db2-aae5-e9ccdfb83514 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:26.569562 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-82f55139-f90c-4db2-aae5-e9ccdfb83514 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:26.594985 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8cf69941-c19f-4f9e-ab11-86ad3e17d37e tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b566640463e43aa85ec96a1aa76d3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eef3db6d5f46c9882fbe98cb732263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:26.608305 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8cf69941-c19f-4f9e-ab11-86ad3e17d37e tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] 10.222.0.17 "GET /compute/v2.1/servers/f24f6136-4a47-44f1-9e79-fea1b1cbf057" status: 200 len: 1281 microversion: 2.1 time: 0.215488 Jul 23 21:28:26.618194 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1792/3664] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:28:26 2022] GET /compute/v2.1/servers/f24f6136-4a47-44f1-9e79-fea1b1cbf057 => generated 1281 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:28:26.699486 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-82f55139-f90c-4db2-aae5-e9ccdfb83514 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:26.710683 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-82f55139-f90c-4db2-aae5-e9ccdfb83514 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:26.712738 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-82f55139-f90c-4db2-aae5-e9ccdfb83514 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:26.714128 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-82f55139-f90c-4db2-aae5-e9ccdfb83514 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.162361 Jul 23 21:28:26.715281 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1873/3665] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:28:26 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:28:27.141376 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4d6bcad9-ce4d-4e53-9b32-4ae5d7996d45 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:27.141376 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-4d6bcad9-ce4d-4e53-9b32-4ae5d7996d45 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: 694b9d2e-5137-4c2a-a656-2607e1ea912a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:27.156224 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4d6bcad9-ce4d-4e53-9b32-4ae5d7996d45 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:27.174020 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4d6bcad9-ce4d-4e53-9b32-4ae5d7996d45 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:27.180133 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4d6bcad9-ce4d-4e53-9b32-4ae5d7996d45 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:27.180689 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4d6bcad9-ce4d-4e53-9b32-4ae5d7996d45 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:27.474609 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d031043d-473a-43f2-ac5f-107d48b5cf73 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:27.476932 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-d031043d-473a-43f2-ac5f-107d48b5cf73 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] [instance: d3d6b0e1-57fa-4247-bf6d-18c97aa22750] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:27.487413 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d031043d-473a-43f2-ac5f-107d48b5cf73 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:27.488267 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d031043d-473a-43f2-ac5f-107d48b5cf73 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:27.489330 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d031043d-473a-43f2-ac5f-107d48b5cf73 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:27.490027 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d031043d-473a-43f2-ac5f-107d48b5cf73 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:27.510828 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-d031043d-473a-43f2-ac5f-107d48b5cf73 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] HTTP exception thrown: Instance d3d6b0e1-57fa-4247-bf6d-18c97aa22750 could not be found. Jul 23 21:28:27.512771 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d031043d-473a-43f2-ac5f-107d48b5cf73 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Request method failure captured: Jul 23 21:28:27.512771 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/servers/d3d6b0e1-57fa-4247-bf6d-18c97aa22750 HTTP/1.1 Jul 23 21:28:27.512771 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:28:27.512771 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:28:27.512771 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:28:27.512771 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:28:27.512771 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:28:27.512771 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:28:27.512771 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:28:27.512771 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:28:27.512771 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3Ge5sfpyINomWvIAkXUfkN_GsmOi84xmn7Oehj4M1cohCMbN-apBPVBoMCXYqkSv7XAKTOGp925-GSTDUknXTPPAruca7_C6-qgMCTteE4yRK2cEHLY1toUemDjpxKzwap62q93oix_a2YsNO6xWlBMkvJ3y_64k-QWLQoGbOloMYPg Jul 23 21:28:27.512771 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:28:27.512771 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:28:27.512771 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:28:27.512771 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:28:27.512771 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:28:27.512771 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:28:27.512771 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 2b46cc4b1ef64d168bf4184339de54d2 Jul 23 21:28:27.512771 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2128176625 Jul 23 21:28:27.512771 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:28:27.512771 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:28:27.512771 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2b46cc4b1ef64d168bf4184339de54d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2b46cc4b1ef64d168bf4184339de54d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2b46cc4b1ef64d168bf4184339de54d2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2b46cc4b1ef64d168bf4184339de54d2"}]}] Jul 23 21:28:27.512771 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2128176625 Jul 23 21:28:27.512771 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 2b46cc4b1ef64d168bf4184339de54d2 Jul 23 21:28:27.512771 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2128176625 Jul 23 21:28:27.512771 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ServerRescueNegativeTestJSON-2128176625-project Jul 23 21:28:27.512771 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:28:27.512771 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:28:27.512771 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: e11fb79c253c4a0f955d710ff4626f6d Jul 23 21:28:27.512771 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2128176625-project Jul 23 21:28:27.512771 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:28:27.512771 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance d3d6b0e1-57fa-4247-bf6d-18c97aa22750 could not be found. Jul 23 21:28:27.512771 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': 'd3d6b0e1-57fa-4247-bf6d-18c97aa22750'} Jul 23 21:28:27.512771 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:28:27.512771 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:28:27.512771 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:28:27.512771 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:28:27.512771 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:28:27.512771 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:28:27.512771 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:28:27.512771 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:28:27.512771 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:28:27.512771 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:28:27.512771 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3d6b0e1-57fa-4247-bf6d-18c97aa22750 could not be found. Jul 23 21:28:27.512771 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:28:27.512771 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:28:27.512771 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:28:27.512771 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:28:27.512771 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:28:27.512771 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:28:27.512771 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:28:27.512771 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:28:27.512771 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:28:27.512771 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:28:27.512771 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:28:27.512771 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:28:27.512771 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:28:27.512771 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:28:27.512771 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:28:27.512771 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:28:27.512771 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3d6b0e1-57fa-4247-bf6d-18c97aa22750 could not be found. Jul 23 21:28:27.512771 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:28:27.512771 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:28:27.517499 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:28:27.517499 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:28:27.517499 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:28:27.517499 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:28:27.517499 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:28:27.517499 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:28:27.517499 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3d6b0e1-57fa-4247-bf6d-18c97aa22750 could not be found. Jul 23 21:28:27.517499 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:28:27.520426 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d031043d-473a-43f2-ac5f-107d48b5cf73 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Returning 404 to user: Instance d3d6b0e1-57fa-4247-bf6d-18c97aa22750 could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:28:27.521543 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-d031043d-473a-43f2-ac5f-107d48b5cf73 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] 10.222.0.17 "GET /compute/v2.1/servers/d3d6b0e1-57fa-4247-bf6d-18c97aa22750" status: 404 len: 111 microversion: 2.1 time: 0.053101 Jul 23 21:28:27.522710 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1874/3666] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:28:27 2022] GET /compute/v2.1/servers/d3d6b0e1-57fa-4247-bf6d-18c97aa22750 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:28:27.536043 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-de580292-c89f-4421-961f-7c7175af4efa tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:27.536951 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-de580292-c89f-4421-961f-7c7175af4efa tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] [instance: 63c3348d-dcf9-4e87-acfe-c7ab88796150] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:27.548394 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-de580292-c89f-4421-961f-7c7175af4efa tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:27.549260 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-de580292-c89f-4421-961f-7c7175af4efa tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:27.550429 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-de580292-c89f-4421-961f-7c7175af4efa tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:27.551121 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-de580292-c89f-4421-961f-7c7175af4efa tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:27.583745 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-de580292-c89f-4421-961f-7c7175af4efa tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] [instance: 63c3348d-dcf9-4e87-acfe-c7ab88796150] Going to try to terminate instance {{(pid=131321) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:28:27.706870 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-de580292-c89f-4421-961f-7c7175af4efa tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] 10.222.0.17 "DELETE /compute/v2.1/servers/63c3348d-dcf9-4e87-acfe-c7ab88796150" status: 204 len: 0 microversion: 2.1 time: 0.176353 Jul 23 21:28:27.707460 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1875/3667] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:28:27 2022] DELETE /compute/v2.1/servers/63c3348d-dcf9-4e87-acfe-c7ab88796150 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:28:27.717561 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-84647933-62ea-42fe-9ac8-c3a74504c947 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:27.719055 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-84647933-62ea-42fe-9ac8-c3a74504c947 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] [instance: f24f6136-4a47-44f1-9e79-fea1b1cbf057] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:27.727279 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-84647933-62ea-42fe-9ac8-c3a74504c947 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:27.728291 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-84647933-62ea-42fe-9ac8-c3a74504c947 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:27.729413 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-84647933-62ea-42fe-9ac8-c3a74504c947 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:27.730117 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-84647933-62ea-42fe-9ac8-c3a74504c947 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:27.835009 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-84647933-62ea-42fe-9ac8-c3a74504c947 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b566640463e43aa85ec96a1aa76d3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eef3db6d5f46c9882fbe98cb732263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:27.857128 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-84647933-62ea-42fe-9ac8-c3a74504c947 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] 10.222.0.17 "GET /compute/v2.1/servers/f24f6136-4a47-44f1-9e79-fea1b1cbf057" status: 200 len: 1281 microversion: 2.1 time: 0.146638 Jul 23 21:28:27.859220 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1876/3668] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:28:27 2022] GET /compute/v2.1/servers/f24f6136-4a47-44f1-9e79-fea1b1cbf057 => generated 1281 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:28:27.872296 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-201e0c6f-dbb3-4552-a98d-f5b3eb29e423 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:27.873190 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-4d6bcad9-ce4d-4e53-9b32-4ae5d7996d45 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:27.874095 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-201e0c6f-dbb3-4552-a98d-f5b3eb29e423 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] [instance: 63c3348d-dcf9-4e87-acfe-c7ab88796150] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:27.885153 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4d6bcad9-ce4d-4e53-9b32-4ae5d7996d45 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/694b9d2e-5137-4c2a-a656-2607e1ea912a" status: 200 len: 1314 microversion: 2.1 time: 0.747390 Jul 23 21:28:27.885791 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1793/3669] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:28:27 2022] GET /compute/v2.1/servers/694b9d2e-5137-4c2a-a656-2607e1ea912a => generated 1314 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:28:27.895016 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-201e0c6f-dbb3-4552-a98d-f5b3eb29e423 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:27.895016 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-201e0c6f-dbb3-4552-a98d-f5b3eb29e423 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:27.895016 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-201e0c6f-dbb3-4552-a98d-f5b3eb29e423 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:27.895016 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-201e0c6f-dbb3-4552-a98d-f5b3eb29e423 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:27.907271 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f16b80ff-9cb2-4fdd-a66b-54241a64a770 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:27.917120 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f16b80ff-9cb2-4fdd-a66b-54241a64a770 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:27.923659 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f16b80ff-9cb2-4fdd-a66b-54241a64a770 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:27.924539 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f16b80ff-9cb2-4fdd-a66b-54241a64a770 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:27.925493 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f16b80ff-9cb2-4fdd-a66b-54241a64a770 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:27.926390 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f16b80ff-9cb2-4fdd-a66b-54241a64a770 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:28.117617 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f16b80ff-9cb2-4fdd-a66b-54241a64a770 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:28.127475 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f16b80ff-9cb2-4fdd-a66b-54241a64a770 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:28.129069 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f16b80ff-9cb2-4fdd-a66b-54241a64a770 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:28.138548 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f16b80ff-9cb2-4fdd-a66b-54241a64a770 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.233282 Jul 23 21:28:28.149884 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1794/3670] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:28:27 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:28:28.516848 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-201e0c6f-dbb3-4552-a98d-f5b3eb29e423 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e11fb79c253c4a0f955d710ff4626f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b46cc4b1ef64d168bf4184339de54d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:28.528703 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-201e0c6f-dbb3-4552-a98d-f5b3eb29e423 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] 10.222.0.17 "GET /compute/v2.1/servers/63c3348d-dcf9-4e87-acfe-c7ab88796150" status: 200 len: 1523 microversion: 2.1 time: 0.667458 Jul 23 21:28:28.534384 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1877/3671] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:28:27 2022] GET /compute/v2.1/servers/63c3348d-dcf9-4e87-acfe-c7ab88796150 => generated 1523 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:28:28.875511 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-01fd96fc-0414-454d-a6a9-608f1133b225 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:28.876342 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-01fd96fc-0414-454d-a6a9-608f1133b225 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] [instance: f24f6136-4a47-44f1-9e79-fea1b1cbf057] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:28.890031 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-01fd96fc-0414-454d-a6a9-608f1133b225 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:28.890815 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-01fd96fc-0414-454d-a6a9-608f1133b225 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:28.891811 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-01fd96fc-0414-454d-a6a9-608f1133b225 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:28.894524 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-01fd96fc-0414-454d-a6a9-608f1133b225 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:28.901803 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-8469f9f8-e239-42b3-a71b-d681008d5542 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:28.902762 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-8469f9f8-e239-42b3-a71b-d681008d5542 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: 694b9d2e-5137-4c2a-a656-2607e1ea912a] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:28.916687 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8469f9f8-e239-42b3-a71b-d681008d5542 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:28.926671 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8469f9f8-e239-42b3-a71b-d681008d5542 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:28.929990 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8469f9f8-e239-42b3-a71b-d681008d5542 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:28.930635 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8469f9f8-e239-42b3-a71b-d681008d5542 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:28.953904 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:29.564235 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-8469f9f8-e239-42b3-a71b-d681008d5542 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:29.581737 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-8469f9f8-e239-42b3-a71b-d681008d5542 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/694b9d2e-5137-4c2a-a656-2607e1ea912a" status: 200 len: 1314 microversion: 2.1 time: 0.683856 Jul 23 21:28:29.586808 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1878/3672] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:28:28 2022] GET /compute/v2.1/servers/694b9d2e-5137-4c2a-a656-2607e1ea912a => generated 1314 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:28:29.605736 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-c557b147-9ea8-4473-8816-6cdf4b24bd1d req-d7ddbb1d-fce3-4670-ab95-62aef29fb317 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "694b9d2e-5137-4c2a-a656-2607e1ea912a", "name": "network-vif-plugged", "status": "completed", "tag": "15c6d187-24f9-41fc-a731-bb0fbef03740"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:28:29.626802 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-c557b147-9ea8-4473-8816-6cdf4b24bd1d req-d7ddbb1d-fce3-4670-ab95-62aef29fb317 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:29.627572 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-c557b147-9ea8-4473-8816-6cdf4b24bd1d req-d7ddbb1d-fce3-4670-ab95-62aef29fb317 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:29.660779 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-c557b147-9ea8-4473-8816-6cdf4b24bd1d req-d7ddbb1d-fce3-4670-ab95-62aef29fb317 service nova] Creating event network-vif-plugged:15c6d187-24f9-41fc-a731-bb0fbef03740 for instance 694b9d2e-5137-4c2a-a656-2607e1ea912a on nch1-master-1 Jul 23 21:28:29.668215 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-c557b147-9ea8-4473-8816-6cdf4b24bd1d req-d7ddbb1d-fce3-4670-ab95-62aef29fb317 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079750 Jul 23 21:28:29.669562 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1879/3673] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:28:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:28:29.681607 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-09f8e422-3246-4692-9948-c0726a74296a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:29.682674 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-09f8e422-3246-4692-9948-c0726a74296a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:29.698942 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-09f8e422-3246-4692-9948-c0726a74296a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:29.699639 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-09f8e422-3246-4692-9948-c0726a74296a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:29.700821 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-09f8e422-3246-4692-9948-c0726a74296a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:29.701428 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-09f8e422-3246-4692-9948-c0726a74296a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:29.945684 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-09f8e422-3246-4692-9948-c0726a74296a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:29.955634 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-09f8e422-3246-4692-9948-c0726a74296a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:29.971806 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-09f8e422-3246-4692-9948-c0726a74296a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:29.976653 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-09f8e422-3246-4692-9948-c0726a74296a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.305682 Jul 23 21:28:29.980142 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1880/3674] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:28:29 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:28:29.989296 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-bda445cd-13a6-4da3-86d4-8bdcbbe615a8 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:29.994608 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-bda445cd-13a6-4da3-86d4-8bdcbbe615a8 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] [instance: 63c3348d-dcf9-4e87-acfe-c7ab88796150] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:30.019620 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bda445cd-13a6-4da3-86d4-8bdcbbe615a8 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:30.023625 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bda445cd-13a6-4da3-86d4-8bdcbbe615a8 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:30.024832 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bda445cd-13a6-4da3-86d4-8bdcbbe615a8 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:30.027909 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bda445cd-13a6-4da3-86d4-8bdcbbe615a8 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:30.381413 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-01fd96fc-0414-454d-a6a9-608f1133b225 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b566640463e43aa85ec96a1aa76d3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eef3db6d5f46c9882fbe98cb732263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:30.413321 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-01fd96fc-0414-454d-a6a9-608f1133b225 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] 10.222.0.17 "GET /compute/v2.1/servers/f24f6136-4a47-44f1-9e79-fea1b1cbf057" status: 200 len: 1323 microversion: 2.1 time: 1.541945 Jul 23 21:28:30.413954 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1795/3675] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:28:28 2022] GET /compute/v2.1/servers/f24f6136-4a47-44f1-9e79-fea1b1cbf057 => generated 1323 bytes in 1544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:28:30.600455 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-bda445cd-13a6-4da3-86d4-8bdcbbe615a8 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e11fb79c253c4a0f955d710ff4626f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b46cc4b1ef64d168bf4184339de54d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:30.619455 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d53d0c30-75da-4f76-8a66-d094c337bddc tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:30.619455 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d53d0c30-75da-4f76-8a66-d094c337bddc tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: 694b9d2e-5137-4c2a-a656-2607e1ea912a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:30.636173 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d53d0c30-75da-4f76-8a66-d094c337bddc tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:30.636751 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d53d0c30-75da-4f76-8a66-d094c337bddc tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:30.638768 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d53d0c30-75da-4f76-8a66-d094c337bddc tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:30.641237 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d53d0c30-75da-4f76-8a66-d094c337bddc tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:30.642026 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-bda445cd-13a6-4da3-86d4-8bdcbbe615a8 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] 10.222.0.17 "GET /compute/v2.1/servers/63c3348d-dcf9-4e87-acfe-c7ab88796150" status: 200 len: 1523 microversion: 2.1 time: 0.654904 Jul 23 21:28:30.642802 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1881/3676] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:28:29 2022] GET /compute/v2.1/servers/63c3348d-dcf9-4e87-acfe-c7ab88796150 => generated 1523 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:28:30.995975 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c5da9f10-911f-4f9c-806a-474e646a0a30 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:30.996918 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-c5da9f10-911f-4f9c-806a-474e646a0a30 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:31.008921 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c5da9f10-911f-4f9c-806a-474e646a0a30 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:31.010928 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c5da9f10-911f-4f9c-806a-474e646a0a30 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:31.012905 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c5da9f10-911f-4f9c-806a-474e646a0a30 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:31.013632 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c5da9f10-911f-4f9c-806a-474e646a0a30 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:31.260964 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c5da9f10-911f-4f9c-806a-474e646a0a30 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:31.275471 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c5da9f10-911f-4f9c-806a-474e646a0a30 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:31.277323 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c5da9f10-911f-4f9c-806a-474e646a0a30 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:31.278841 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-c5da9f10-911f-4f9c-806a-474e646a0a30 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.286856 Jul 23 21:28:31.280075 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1882/3677] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:28:30 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:28:31.432936 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c1548c48-4599-4d35-ae83-2f7a64f4e417 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:31.434140 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-c1548c48-4599-4d35-ae83-2f7a64f4e417 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] [instance: f24f6136-4a47-44f1-9e79-fea1b1cbf057] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:31.442108 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c1548c48-4599-4d35-ae83-2f7a64f4e417 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:31.443172 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c1548c48-4599-4d35-ae83-2f7a64f4e417 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:31.444515 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c1548c48-4599-4d35-ae83-2f7a64f4e417 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:31.445224 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c1548c48-4599-4d35-ae83-2f7a64f4e417 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:31.868890 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c1548c48-4599-4d35-ae83-2f7a64f4e417 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b566640463e43aa85ec96a1aa76d3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eef3db6d5f46c9882fbe98cb732263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:31.875485 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:31.877962 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-c1548c48-4599-4d35-ae83-2f7a64f4e417 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] 10.222.0.17 "GET /compute/v2.1/servers/f24f6136-4a47-44f1-9e79-fea1b1cbf057" status: 200 len: 1323 microversion: 2.1 time: 0.451197 Jul 23 21:28:31.878510 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1883/3678] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:28:31 2022] GET /compute/v2.1/servers/f24f6136-4a47-44f1-9e79-fea1b1cbf057 => generated 1323 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:28:31.895015 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e2d9a660-98c5-4719-9987-7743cbfe4bda tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:31.896943 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-e2d9a660-98c5-4719-9987-7743cbfe4bda tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] [instance: 63c3348d-dcf9-4e87-acfe-c7ab88796150] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:31.904756 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e2d9a660-98c5-4719-9987-7743cbfe4bda tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:31.905460 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e2d9a660-98c5-4719-9987-7743cbfe4bda tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:31.907019 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e2d9a660-98c5-4719-9987-7743cbfe4bda tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:31.907920 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e2d9a660-98c5-4719-9987-7743cbfe4bda tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:32.073622 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d53d0c30-75da-4f76-8a66-d094c337bddc tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:32.089788 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d53d0c30-75da-4f76-8a66-d094c337bddc tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/694b9d2e-5137-4c2a-a656-2607e1ea912a" status: 200 len: 1314 microversion: 2.1 time: 1.491399 Jul 23 21:28:32.106412 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1796/3679] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:28:30 2022] GET /compute/v2.1/servers/694b9d2e-5137-4c2a-a656-2607e1ea912a => generated 1314 bytes in 1509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:28:32.112240 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-0d319065-199e-4b43-ae04-e554eb30af79 req-aa9142d4-483d-479d-8bb5-ba4c200d47e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63c3348d-dcf9-4e87-acfe-c7ab88796150", "name": "network-vif-deleted", "tag": "0b5927e4-f75a-467a-a587-7ca2264cf2a2"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:28:32.156437 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-0d319065-199e-4b43-ae04-e554eb30af79 req-aa9142d4-483d-479d-8bb5-ba4c200d47e9 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:32.157282 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-0d319065-199e-4b43-ae04-e554eb30af79 req-aa9142d4-483d-479d-8bb5-ba4c200d47e9 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:32.184000 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-0d319065-199e-4b43-ae04-e554eb30af79 req-aa9142d4-483d-479d-8bb5-ba4c200d47e9 service nova] Creating event network-vif-deleted:0b5927e4-f75a-467a-a587-7ca2264cf2a2 for instance 63c3348d-dcf9-4e87-acfe-c7ab88796150 on nch2-master-1 Jul 23 21:28:32.199505 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-0d319065-199e-4b43-ae04-e554eb30af79 req-aa9142d4-483d-479d-8bb5-ba4c200d47e9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091492 Jul 23 21:28:32.200811 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1797/3680] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:28:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:28:32.226752 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-e2d9a660-98c5-4719-9987-7743cbfe4bda tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e11fb79c253c4a0f955d710ff4626f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b46cc4b1ef64d168bf4184339de54d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:32.243923 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-e2d9a660-98c5-4719-9987-7743cbfe4bda tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] 10.222.0.17 "GET /compute/v2.1/servers/63c3348d-dcf9-4e87-acfe-c7ab88796150" status: 200 len: 1307 microversion: 2.1 time: 0.357678 Jul 23 21:28:32.244902 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1884/3681] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:28:31 2022] GET /compute/v2.1/servers/63c3348d-dcf9-4e87-acfe-c7ab88796150 => generated 1307 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:28:32.298427 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-72818dd2-4b43-4ba2-a2ed-d094675b5e9a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:32.300224 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-72818dd2-4b43-4ba2-a2ed-d094675b5e9a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:32.371454 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-72818dd2-4b43-4ba2-a2ed-d094675b5e9a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:32.372172 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-72818dd2-4b43-4ba2-a2ed-d094675b5e9a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:32.373229 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-72818dd2-4b43-4ba2-a2ed-d094675b5e9a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:32.374075 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-72818dd2-4b43-4ba2-a2ed-d094675b5e9a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:32.388280 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ed920e8f-c121-4fa4-a4f4-ccfe222fe8de tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-479070470", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "networks": [{"uuid": "bd9d798b-247f-49b4-b3d6-6be29b6fa2bc"}]}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:28:32.519009 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-ed920e8f-c121-4fa4-a4f4-ccfe222fe8de tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] validate_networks() for [('bd9d798b-247f-49b4-b3d6-6be29b6fa2bc', None, None, None, None, None)] {{(pid=131320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:28:32.793268 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-72818dd2-4b43-4ba2-a2ed-d094675b5e9a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:32.818899 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-72818dd2-4b43-4ba2-a2ed-d094675b5e9a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:32.844850 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-72818dd2-4b43-4ba2-a2ed-d094675b5e9a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:32.848358 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-72818dd2-4b43-4ba2-a2ed-d094675b5e9a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.553278 Jul 23 21:28:32.858996 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1885/3682] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:28:32 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:28:32.898889 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-053abc61-b39e-4fa3-85f6-0361f0439f9d tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:32.900269 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-053abc61-b39e-4fa3-85f6-0361f0439f9d tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] [instance: f24f6136-4a47-44f1-9e79-fea1b1cbf057] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:32.910393 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-053abc61-b39e-4fa3-85f6-0361f0439f9d tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:32.911540 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-053abc61-b39e-4fa3-85f6-0361f0439f9d tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:32.914560 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-053abc61-b39e-4fa3-85f6-0361f0439f9d tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:32.917813 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-053abc61-b39e-4fa3-85f6-0361f0439f9d tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:33.048839 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell0:SELECT=2 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:33.468268 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-053abc61-b39e-4fa3-85f6-0361f0439f9d tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b566640463e43aa85ec96a1aa76d3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eef3db6d5f46c9882fbe98cb732263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:33.486665 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-053abc61-b39e-4fa3-85f6-0361f0439f9d tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] 10.222.0.17 "GET /compute/v2.1/servers/f24f6136-4a47-44f1-9e79-fea1b1cbf057" status: 200 len: 1323 microversion: 2.1 time: 0.593511 Jul 23 21:28:33.496291 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1886/3683] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:28:32 2022] GET /compute/v2.1/servers/f24f6136-4a47-44f1-9e79-fea1b1cbf057 => generated 1323 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:28:33.496291 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-beaae024-7a90-4d24-9519-dc74c2c49b0c tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:33.496291 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-beaae024-7a90-4d24-9519-dc74c2c49b0c tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: 694b9d2e-5137-4c2a-a656-2607e1ea912a] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:33.513536 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-beaae024-7a90-4d24-9519-dc74c2c49b0c tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:33.514038 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-beaae024-7a90-4d24-9519-dc74c2c49b0c tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:33.514851 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-beaae024-7a90-4d24-9519-dc74c2c49b0c tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:33.515300 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-beaae024-7a90-4d24-9519-dc74c2c49b0c tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:33.802108 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-ed920e8f-c121-4fa4-a4f4-ccfe222fe8de tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:28:33.802633 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-ed920e8f-c121-4fa4-a4f4-ccfe222fe8de tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:28:33.803005 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-ed920e8f-c121-4fa4-a4f4-ccfe222fe8de tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:28:33.803431 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-ed920e8f-c121-4fa4-a4f4-ccfe222fe8de tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:28:33.803845 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-ed920e8f-c121-4fa4-a4f4-ccfe222fe8de tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:28:33.804226 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell0:SELECT=8 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:33.836298 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ed920e8f-c121-4fa4-a4f4-ccfe222fe8de tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:33.836948 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ed920e8f-c121-4fa4-a4f4-ccfe222fe8de tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:33.837788 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ed920e8f-c121-4fa4-a4f4-ccfe222fe8de tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:33.838233 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ed920e8f-c121-4fa4-a4f4-ccfe222fe8de tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:33.859916 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-ed920e8f-c121-4fa4-a4f4-ccfe222fe8de tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Getting quotas for project 15e47587982546ff87e06be741d68b96. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:28:33.867122 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-ed920e8f-c121-4fa4-a4f4-ccfe222fe8de tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Getting quotas for user a7a723a102d34fbfa2662b07f9b10fc8 and project 15e47587982546ff87e06be741d68b96. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:28:33.883714 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ed920e8f-c121-4fa4-a4f4-ccfe222fe8de tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Going to run 1 instances... {{(pid=131320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:28:33.886773 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ed920e8f-c121-4fa4-a4f4-ccfe222fe8de tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] [instance: 5f175c94-dac6-4a61-a83b-1ebe44902d7c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:28:33.943385 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ed920e8f-c121-4fa4-a4f4-ccfe222fe8de tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 1.687831 Jul 23 21:28:33.945514 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1798/3684] 10.222.0.17 () {62 vars in 1187 bytes} [Sat Jul 23 21:28:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1691 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 23 21:28:33.951682 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3425472f-94df-4921-85f8-a48508d956b3 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:33.952573 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-3425472f-94df-4921-85f8-a48508d956b3 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] [instance: 63c3348d-dcf9-4e87-acfe-c7ab88796150] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:33.961618 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3425472f-94df-4921-85f8-a48508d956b3 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:33.962389 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3425472f-94df-4921-85f8-a48508d956b3 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:33.975119 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3425472f-94df-4921-85f8-a48508d956b3 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:33.984354 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3425472f-94df-4921-85f8-a48508d956b3 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:34.006437 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-3425472f-94df-4921-85f8-a48508d956b3 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] HTTP exception thrown: Instance 63c3348d-dcf9-4e87-acfe-c7ab88796150 could not be found. Jul 23 21:28:34.008444 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3425472f-94df-4921-85f8-a48508d956b3 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Request method failure captured: Jul 23 21:28:34.008444 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/63c3348d-dcf9-4e87-acfe-c7ab88796150 HTTP/1.1 Jul 23 21:28:34.008444 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:28:34.008444 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:28:34.008444 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:28:34.008444 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:28:34.008444 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:28:34.008444 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:28:34.008444 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:28:34.008444 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:28:34.008444 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3Ge5sfpyINomWvIAkXUfkN_GsmOi84xmn7Oehj4M1cohCMbN-apBPVBoMCXYqkSv7XAKTOGp925-GSTDUknXTPPAruca7_C6-qgMCTteE4yRK2cEHLY1toUemDjpxKzwap62q93oix_a2YsNO6xWlBMkvJ3y_64k-QWLQoGbOloMYPg Jul 23 21:28:34.008444 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:28:34.008444 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:28:34.008444 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:28:34.008444 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:28:34.008444 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:28:34.008444 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:28:34.008444 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 2b46cc4b1ef64d168bf4184339de54d2 Jul 23 21:28:34.008444 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2128176625 Jul 23 21:28:34.008444 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:28:34.008444 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:28:34.008444 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2b46cc4b1ef64d168bf4184339de54d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2b46cc4b1ef64d168bf4184339de54d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2b46cc4b1ef64d168bf4184339de54d2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2b46cc4b1ef64d168bf4184339de54d2"}]}] Jul 23 21:28:34.008444 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2128176625 Jul 23 21:28:34.008444 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 2b46cc4b1ef64d168bf4184339de54d2 Jul 23 21:28:34.008444 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2128176625 Jul 23 21:28:34.008444 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServerRescueNegativeTestJSON-2128176625-project Jul 23 21:28:34.008444 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:28:34.008444 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:28:34.008444 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: e11fb79c253c4a0f955d710ff4626f6d Jul 23 21:28:34.008444 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2128176625-project Jul 23 21:28:34.008444 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:28:34.008444 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance 63c3348d-dcf9-4e87-acfe-c7ab88796150 could not be found. Jul 23 21:28:34.008444 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '63c3348d-dcf9-4e87-acfe-c7ab88796150'} Jul 23 21:28:34.008444 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:28:34.008444 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:28:34.008444 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:28:34.008444 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:28:34.008444 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:28:34.008444 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:28:34.008444 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:28:34.008444 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:28:34.008444 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:28:34.008444 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:28:34.008444 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63c3348d-dcf9-4e87-acfe-c7ab88796150 could not be found. Jul 23 21:28:34.008444 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:28:34.008444 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:28:34.008444 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:28:34.008444 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:28:34.008444 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:28:34.008444 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:28:34.008444 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:28:34.008444 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:28:34.008444 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:28:34.008444 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:28:34.008444 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:28:34.008444 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:28:34.008444 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:28:34.008444 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:28:34.008444 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:28:34.008444 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:28:34.008444 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63c3348d-dcf9-4e87-acfe-c7ab88796150 could not be found. Jul 23 21:28:34.008444 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:28:34.008444 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:28:34.013678 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:28:34.013678 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:28:34.013678 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:28:34.013678 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:28:34.013678 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:28:34.013678 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:28:34.013678 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63c3348d-dcf9-4e87-acfe-c7ab88796150 could not be found. Jul 23 21:28:34.013678 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:28:34.015649 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3425472f-94df-4921-85f8-a48508d956b3 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] Returning 404 to user: Instance 63c3348d-dcf9-4e87-acfe-c7ab88796150 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:28:34.021984 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-3425472f-94df-4921-85f8-a48508d956b3 tempest-ServerRescueNegativeTestJSON-2128176625 tempest-ServerRescueNegativeTestJSON-2128176625-project] 10.222.0.17 "GET /compute/v2.1/servers/63c3348d-dcf9-4e87-acfe-c7ab88796150" status: 404 len: 111 microversion: 2.1 time: 0.075025 Jul 23 21:28:34.026805 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1799/3685] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:28:33 2022] GET /compute/v2.1/servers/63c3348d-dcf9-4e87-acfe-c7ab88796150 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:28:34.032472 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-bc178e91-05f3-4b8a-9404-318781818451 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:34.033382 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-bc178e91-05f3-4b8a-9404-318781818451 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:34.043888 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bc178e91-05f3-4b8a-9404-318781818451 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:34.044651 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bc178e91-05f3-4b8a-9404-318781818451 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:34.045706 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bc178e91-05f3-4b8a-9404-318781818451 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:34.046428 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bc178e91-05f3-4b8a-9404-318781818451 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:34.189427 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-beaae024-7a90-4d24-9519-dc74c2c49b0c tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:34.202498 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-beaae024-7a90-4d24-9519-dc74c2c49b0c tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/694b9d2e-5137-4c2a-a656-2607e1ea912a" status: 200 len: 1501 microversion: 2.1 time: 0.712852 Jul 23 21:28:34.205332 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1887/3686] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:28:33 2022] GET /compute/v2.1/servers/694b9d2e-5137-4c2a-a656-2607e1ea912a => generated 1501 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:28:34.212693 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-2f11a816-176a-45e2-adf6-402729acc87a tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:34.215066 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-2f11a816-176a-45e2-adf6-402729acc87a tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] [instance: 5f175c94-dac6-4a61-a83b-1ebe44902d7c] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:34.221412 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-bc178e91-05f3-4b8a-9404-318781818451 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:34.246901 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-bc178e91-05f3-4b8a-9404-318781818451 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:34.250150 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-bc178e91-05f3-4b8a-9404-318781818451 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:34.257195 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-bc178e91-05f3-4b8a-9404-318781818451 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.226544 Jul 23 21:28:34.261192 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1800/3687] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:28:34 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:28:34.277881 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-7ba64206-879a-49ca-a7ad-b0eb8201e7f6 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:28:34.318199 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7ba64206-879a-49ca-a7ad-b0eb8201e7f6 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:34.325386 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7ba64206-879a-49ca-a7ad-b0eb8201e7f6 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:34.375025 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-7ba64206-879a-49ca-a7ad-b0eb8201e7f6 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: 694b9d2e-5137-4c2a-a656-2607e1ea912a] Going to try to stop instance {{(pid=131320) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 23 21:28:34.476482 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-7ba64206-879a-49ca-a7ad-b0eb8201e7f6 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "POST /compute/v2.1/servers/694b9d2e-5137-4c2a-a656-2607e1ea912a/action" status: 202 len: 0 microversion: 2.1 time: 0.210963 Jul 23 21:28:34.477343 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1801/3688] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:28:34 2022] POST /compute/v2.1/servers/694b9d2e-5137-4c2a-a656-2607e1ea912a/action => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:28:34.490586 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-d8603f0a-b105-41e5-9455-c4976070b8a5 req-b9c1a63a-777a-4dd8-bd5e-86e5bbaa19a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f24f6136-4a47-44f1-9e79-fea1b1cbf057", "tag": "fb17bdf4-0872-4074-8623-374df990053a"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:28:34.536473 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-d8603f0a-b105-41e5-9455-c4976070b8a5 req-b9c1a63a-777a-4dd8-bd5e-86e5bbaa19a2 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:34.537766 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-d8603f0a-b105-41e5-9455-c4976070b8a5 req-b9c1a63a-777a-4dd8-bd5e-86e5bbaa19a2 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:34.565176 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-d8603f0a-b105-41e5-9455-c4976070b8a5 req-b9c1a63a-777a-4dd8-bd5e-86e5bbaa19a2 service nova] Creating event network-changed:fb17bdf4-0872-4074-8623-374df990053a for instance f24f6136-4a47-44f1-9e79-fea1b1cbf057 on nch2-master-1 Jul 23 21:28:34.572269 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-2f11a816-176a-45e2-adf6-402729acc87a tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a723a102d34fbfa2662b07f9b10fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e47587982546ff87e06be741d68b96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:34.582047 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-d8603f0a-b105-41e5-9455-c4976070b8a5 req-b9c1a63a-777a-4dd8-bd5e-86e5bbaa19a2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103499 Jul 23 21:28:34.582667 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1802/3689] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:28:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:28:34.588582 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-dd49c632-90b9-42c4-ae39-929c109cd7cd tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:34.588886 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-2f11a816-176a-45e2-adf6-402729acc87a tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a723a102d34fbfa2662b07f9b10fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e47587982546ff87e06be741d68b96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:34.589813 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-dd49c632-90b9-42c4-ae39-929c109cd7cd tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: 694b9d2e-5137-4c2a-a656-2607e1ea912a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:34.594793 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-2f11a816-176a-45e2-adf6-402729acc87a tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a723a102d34fbfa2662b07f9b10fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e47587982546ff87e06be741d68b96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:34.596012 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-2f11a816-176a-45e2-adf6-402729acc87a tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] 10.222.0.17 "GET /compute/v2.1/servers/5f175c94-dac6-4a61-a83b-1ebe44902d7c" status: 200 len: 1258 microversion: 2.21 time: 0.389166 Jul 23 21:28:34.596664 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1888/3690] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:28:34 2022] GET /compute/v2.1/servers/5f175c94-dac6-4a61-a83b-1ebe44902d7c => generated 1258 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:28:34.612449 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-b9a3cdab-54e6-496e-924d-508b124976ae tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:34.613170 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-b9a3cdab-54e6-496e-924d-508b124976ae tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] [instance: f24f6136-4a47-44f1-9e79-fea1b1cbf057] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:34.633498 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b9a3cdab-54e6-496e-924d-508b124976ae tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:34.633995 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b9a3cdab-54e6-496e-924d-508b124976ae tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:34.634801 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b9a3cdab-54e6-496e-924d-508b124976ae tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:34.635251 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b9a3cdab-54e6-496e-924d-508b124976ae tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:34.657379 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dd49c632-90b9-42c4-ae39-929c109cd7cd tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:34.665570 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dd49c632-90b9-42c4-ae39-929c109cd7cd tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:34.667348 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dd49c632-90b9-42c4-ae39-929c109cd7cd tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:34.668398 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dd49c632-90b9-42c4-ae39-929c109cd7cd tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:35.086485 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-b9a3cdab-54e6-496e-924d-508b124976ae tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b566640463e43aa85ec96a1aa76d3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eef3db6d5f46c9882fbe98cb732263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:35.125062 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-b9a3cdab-54e6-496e-924d-508b124976ae tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] 10.222.0.17 "GET /compute/v2.1/servers/f24f6136-4a47-44f1-9e79-fea1b1cbf057" status: 200 len: 1323 microversion: 2.1 time: 0.521315 Jul 23 21:28:35.138020 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1889/3691] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:28:34 2022] GET /compute/v2.1/servers/f24f6136-4a47-44f1-9e79-fea1b1cbf057 => generated 1323 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:28:35.286687 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-6264524b-6cff-46ab-974f-03cd61c735fa tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:35.297144 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-6264524b-6cff-46ab-974f-03cd61c735fa tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:35.317127 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6264524b-6cff-46ab-974f-03cd61c735fa tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:35.317637 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6264524b-6cff-46ab-974f-03cd61c735fa tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:35.326332 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6264524b-6cff-46ab-974f-03cd61c735fa tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:35.326805 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6264524b-6cff-46ab-974f-03cd61c735fa tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:35.477333 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-dd49c632-90b9-42c4-ae39-929c109cd7cd tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:35.492985 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-dd49c632-90b9-42c4-ae39-929c109cd7cd tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/694b9d2e-5137-4c2a-a656-2607e1ea912a" status: 200 len: 1511 microversion: 2.1 time: 0.908484 Jul 23 21:28:35.496739 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1803/3692] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:28:34 2022] GET /compute/v2.1/servers/694b9d2e-5137-4c2a-a656-2607e1ea912a => generated 1511 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:28:35.514408 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-6264524b-6cff-46ab-974f-03cd61c735fa tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:35.529491 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-6264524b-6cff-46ab-974f-03cd61c735fa tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:35.531482 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-6264524b-6cff-46ab-974f-03cd61c735fa tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:35.533752 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-6264524b-6cff-46ab-974f-03cd61c735fa tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.252889 Jul 23 21:28:35.535475 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1890/3693] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:28:35 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:28:35.623595 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ae35beda-a546-4326-9103-849a700e7b80 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:35.624278 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ae35beda-a546-4326-9103-849a700e7b80 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] [instance: 5f175c94-dac6-4a61-a83b-1ebe44902d7c] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:35.646366 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ae35beda-a546-4326-9103-849a700e7b80 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:35.650448 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ae35beda-a546-4326-9103-849a700e7b80 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:35.651408 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ae35beda-a546-4326-9103-849a700e7b80 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:35.651865 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ae35beda-a546-4326-9103-849a700e7b80 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:35.809769 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ae35beda-a546-4326-9103-849a700e7b80 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a723a102d34fbfa2662b07f9b10fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e47587982546ff87e06be741d68b96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:35.826583 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ae35beda-a546-4326-9103-849a700e7b80 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a723a102d34fbfa2662b07f9b10fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e47587982546ff87e06be741d68b96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:35.828660 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ae35beda-a546-4326-9103-849a700e7b80 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a723a102d34fbfa2662b07f9b10fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e47587982546ff87e06be741d68b96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:35.830116 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ae35beda-a546-4326-9103-849a700e7b80 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] 10.222.0.17 "GET /compute/v2.1/servers/5f175c94-dac6-4a61-a83b-1ebe44902d7c" status: 200 len: 1310 microversion: 2.21 time: 0.220083 Jul 23 21:28:35.838670 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1804/3694] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:28:35 2022] GET /compute/v2.1/servers/5f175c94-dac6-4a61-a83b-1ebe44902d7c => generated 1310 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:28:36.148921 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f9811db2-e3d0-4288-8ab0-17bf94968e31 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:36.149736 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-f9811db2-e3d0-4288-8ab0-17bf94968e31 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] [instance: f24f6136-4a47-44f1-9e79-fea1b1cbf057] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:36.163238 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f9811db2-e3d0-4288-8ab0-17bf94968e31 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:36.163955 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f9811db2-e3d0-4288-8ab0-17bf94968e31 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:36.170021 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f9811db2-e3d0-4288-8ab0-17bf94968e31 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:36.171868 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f9811db2-e3d0-4288-8ab0-17bf94968e31 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:36.524109 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c777fb03-0d92-478b-b0a9-c126639bc550 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:36.528929 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c777fb03-0d92-478b-b0a9-c126639bc550 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: 694b9d2e-5137-4c2a-a656-2607e1ea912a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:36.565516 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c777fb03-0d92-478b-b0a9-c126639bc550 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:36.574600 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c777fb03-0d92-478b-b0a9-c126639bc550 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:36.575576 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c777fb03-0d92-478b-b0a9-c126639bc550 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:36.576037 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c777fb03-0d92-478b-b0a9-c126639bc550 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:36.995737 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-f9811db2-e3d0-4288-8ab0-17bf94968e31 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b566640463e43aa85ec96a1aa76d3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eef3db6d5f46c9882fbe98cb732263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:37.005916 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-f9811db2-e3d0-4288-8ab0-17bf94968e31 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] 10.222.0.17 "GET /compute/v2.1/servers/f24f6136-4a47-44f1-9e79-fea1b1cbf057" status: 200 len: 1323 microversion: 2.1 time: 0.860825 Jul 23 21:28:37.007373 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1891/3695] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:28:36 2022] GET /compute/v2.1/servers/f24f6136-4a47-44f1-9e79-fea1b1cbf057 => generated 1323 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:28:37.015635 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a47c2705-36f1-465e-810c-a347bed9b97b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:37.016889 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-a47c2705-36f1-465e-810c-a347bed9b97b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:37.032376 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a47c2705-36f1-465e-810c-a347bed9b97b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:37.033360 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a47c2705-36f1-465e-810c-a347bed9b97b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:37.035541 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a47c2705-36f1-465e-810c-a347bed9b97b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:37.037701 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a47c2705-36f1-465e-810c-a347bed9b97b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:37.188965 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-a47c2705-36f1-465e-810c-a347bed9b97b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:37.206401 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-a47c2705-36f1-465e-810c-a347bed9b97b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:37.210343 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-a47c2705-36f1-465e-810c-a347bed9b97b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:37.211550 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-a47c2705-36f1-465e-810c-a347bed9b97b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.201892 Jul 23 21:28:37.213751 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c777fb03-0d92-478b-b0a9-c126639bc550 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:37.214751 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1892/3696] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:28:37 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:28:37.224273 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-3f4f7d5d-869f-4193-b20d-8ebc26c7d7f8 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:37.224899 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-3f4f7d5d-869f-4193-b20d-8ebc26c7d7f8 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] [instance: 5f175c94-dac6-4a61-a83b-1ebe44902d7c] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:37.238998 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3f4f7d5d-869f-4193-b20d-8ebc26c7d7f8 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:37.239462 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3f4f7d5d-869f-4193-b20d-8ebc26c7d7f8 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:37.240261 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3f4f7d5d-869f-4193-b20d-8ebc26c7d7f8 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:37.240921 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3f4f7d5d-869f-4193-b20d-8ebc26c7d7f8 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:37.243085 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c777fb03-0d92-478b-b0a9-c126639bc550 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/694b9d2e-5137-4c2a-a656-2607e1ea912a" status: 200 len: 1511 microversion: 2.1 time: 0.731366 Jul 23 21:28:37.254065 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1805/3697] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:28:36 2022] GET /compute/v2.1/servers/694b9d2e-5137-4c2a-a656-2607e1ea912a => generated 1511 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:28:37.382965 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-3f4f7d5d-869f-4193-b20d-8ebc26c7d7f8 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a723a102d34fbfa2662b07f9b10fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e47587982546ff87e06be741d68b96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:37.397036 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-3f4f7d5d-869f-4193-b20d-8ebc26c7d7f8 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a723a102d34fbfa2662b07f9b10fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e47587982546ff87e06be741d68b96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:37.403344 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-3f4f7d5d-869f-4193-b20d-8ebc26c7d7f8 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a723a102d34fbfa2662b07f9b10fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e47587982546ff87e06be741d68b96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:37.407899 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-3f4f7d5d-869f-4193-b20d-8ebc26c7d7f8 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] 10.222.0.17 "GET /compute/v2.1/servers/5f175c94-dac6-4a61-a83b-1ebe44902d7c" status: 200 len: 1316 microversion: 2.21 time: 0.190476 Jul 23 21:28:37.410973 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1893/3698] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:28:37 2022] GET /compute/v2.1/servers/5f175c94-dac6-4a61-a83b-1ebe44902d7c => generated 1316 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:28:38.023790 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f2b2b607-94e8-455d-8e7d-afd521b9e6c8 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:38.024449 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f2b2b607-94e8-455d-8e7d-afd521b9e6c8 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] [instance: f24f6136-4a47-44f1-9e79-fea1b1cbf057] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:38.036882 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f2b2b607-94e8-455d-8e7d-afd521b9e6c8 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:38.037955 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f2b2b607-94e8-455d-8e7d-afd521b9e6c8 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:38.039033 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f2b2b607-94e8-455d-8e7d-afd521b9e6c8 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:38.043321 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f2b2b607-94e8-455d-8e7d-afd521b9e6c8 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:38.232995 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-81afbab4-2c23-40b6-be2e-9d9bd86909a9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:38.233604 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-81afbab4-2c23-40b6-be2e-9d9bd86909a9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:38.264200 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-81afbab4-2c23-40b6-be2e-9d9bd86909a9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:38.266442 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-81afbab4-2c23-40b6-be2e-9d9bd86909a9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:38.269014 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-81afbab4-2c23-40b6-be2e-9d9bd86909a9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:38.269824 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-81afbab4-2c23-40b6-be2e-9d9bd86909a9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:38.478986 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f2b2b607-94e8-455d-8e7d-afd521b9e6c8 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b566640463e43aa85ec96a1aa76d3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eef3db6d5f46c9882fbe98cb732263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:38.493288 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f2b2b607-94e8-455d-8e7d-afd521b9e6c8 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] 10.222.0.17 "GET /compute/v2.1/servers/f24f6136-4a47-44f1-9e79-fea1b1cbf057" status: 200 len: 1323 microversion: 2.1 time: 0.473832 Jul 23 21:28:38.495246 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1806/3699] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:28:38 2022] GET /compute/v2.1/servers/f24f6136-4a47-44f1-9e79-fea1b1cbf057 => generated 1323 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:28:38.508873 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-00e27faf-809b-46cc-afef-45cc0d8d43ee tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:38.510348 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-00e27faf-809b-46cc-afef-45cc0d8d43ee tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: 694b9d2e-5137-4c2a-a656-2607e1ea912a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:38.533103 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-81afbab4-2c23-40b6-be2e-9d9bd86909a9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:38.534095 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-00e27faf-809b-46cc-afef-45cc0d8d43ee tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:38.534654 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-00e27faf-809b-46cc-afef-45cc0d8d43ee tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:38.535554 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-00e27faf-809b-46cc-afef-45cc0d8d43ee tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:38.536088 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-00e27faf-809b-46cc-afef-45cc0d8d43ee tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:38.554535 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-81afbab4-2c23-40b6-be2e-9d9bd86909a9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:38.556249 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-81afbab4-2c23-40b6-be2e-9d9bd86909a9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:38.557507 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-81afbab4-2c23-40b6-be2e-9d9bd86909a9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.328670 Jul 23 21:28:38.562744 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1894/3700] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:28:38 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:28:38.572681 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ced5e790-eec4-4891-8232-32c7e2ca9425 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:38.574320 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-ced5e790-eec4-4891-8232-32c7e2ca9425 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] [instance: 5f175c94-dac6-4a61-a83b-1ebe44902d7c] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:38.594703 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ced5e790-eec4-4891-8232-32c7e2ca9425 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:38.596448 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ced5e790-eec4-4891-8232-32c7e2ca9425 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:38.603074 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ced5e790-eec4-4891-8232-32c7e2ca9425 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:38.603549 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ced5e790-eec4-4891-8232-32c7e2ca9425 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:38.891300 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-00e27faf-809b-46cc-afef-45cc0d8d43ee tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:38.900717 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-00e27faf-809b-46cc-afef-45cc0d8d43ee tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/694b9d2e-5137-4c2a-a656-2607e1ea912a" status: 200 len: 1511 microversion: 2.1 time: 0.402192 Jul 23 21:28:38.904908 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1807/3701] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:28:38 2022] GET /compute/v2.1/servers/694b9d2e-5137-4c2a-a656-2607e1ea912a => generated 1511 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:28:39.368679 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ced5e790-eec4-4891-8232-32c7e2ca9425 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a723a102d34fbfa2662b07f9b10fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e47587982546ff87e06be741d68b96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:39.390911 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ced5e790-eec4-4891-8232-32c7e2ca9425 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a723a102d34fbfa2662b07f9b10fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e47587982546ff87e06be741d68b96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:39.399764 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ced5e790-eec4-4891-8232-32c7e2ca9425 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a723a102d34fbfa2662b07f9b10fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e47587982546ff87e06be741d68b96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:39.403742 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-ced5e790-eec4-4891-8232-32c7e2ca9425 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] 10.222.0.17 "GET /compute/v2.1/servers/5f175c94-dac6-4a61-a83b-1ebe44902d7c" status: 200 len: 1358 microversion: 2.21 time: 0.839908 Jul 23 21:28:39.408556 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1895/3702] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:28:38 2022] GET /compute/v2.1/servers/5f175c94-dac6-4a61-a83b-1ebe44902d7c => generated 1358 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:28:39.516242 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d2f5ba87-485a-4be7-b0de-55e7be627f8b tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:39.518949 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d2f5ba87-485a-4be7-b0de-55e7be627f8b tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] [instance: f24f6136-4a47-44f1-9e79-fea1b1cbf057] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:39.544697 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d2f5ba87-485a-4be7-b0de-55e7be627f8b tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:39.546607 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d2f5ba87-485a-4be7-b0de-55e7be627f8b tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:39.551016 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d2f5ba87-485a-4be7-b0de-55e7be627f8b tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:39.552914 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d2f5ba87-485a-4be7-b0de-55e7be627f8b tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:39.577080 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ae74fc21-884c-40ce-a064-b6621fa61a21 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:39.577729 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-ae74fc21-884c-40ce-a064-b6621fa61a21 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:39.593995 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ae74fc21-884c-40ce-a064-b6621fa61a21 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:39.594601 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ae74fc21-884c-40ce-a064-b6621fa61a21 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:39.597805 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ae74fc21-884c-40ce-a064-b6621fa61a21 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:39.600487 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ae74fc21-884c-40ce-a064-b6621fa61a21 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:39.994726 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d2f5ba87-485a-4be7-b0de-55e7be627f8b tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b566640463e43aa85ec96a1aa76d3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eef3db6d5f46c9882fbe98cb732263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:40.005006 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d2f5ba87-485a-4be7-b0de-55e7be627f8b tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] 10.222.0.17 "GET /compute/v2.1/servers/f24f6136-4a47-44f1-9e79-fea1b1cbf057" status: 200 len: 1323 microversion: 2.1 time: 0.496204 Jul 23 21:28:40.007763 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1808/3703] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:28:39 2022] GET /compute/v2.1/servers/f24f6136-4a47-44f1-9e79-fea1b1cbf057 => generated 1323 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:28:40.018723 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-bfbdd96f-26d4-4e01-bf60-66630126cd18 req-863a8d2d-828d-45e3-b889-890cbc8905ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f24f6136-4a47-44f1-9e79-fea1b1cbf057", "name": "network-vif-plugged", "status": "completed", "tag": "fb17bdf4-0872-4074-8623-374df990053a"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:28:40.038915 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-bfbdd96f-26d4-4e01-bf60-66630126cd18 req-863a8d2d-828d-45e3-b889-890cbc8905ad service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:40.040370 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-bfbdd96f-26d4-4e01-bf60-66630126cd18 req-863a8d2d-828d-45e3-b889-890cbc8905ad service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:40.069099 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-bfbdd96f-26d4-4e01-bf60-66630126cd18 req-863a8d2d-828d-45e3-b889-890cbc8905ad service nova] Creating event network-vif-plugged:fb17bdf4-0872-4074-8623-374df990053a for instance f24f6136-4a47-44f1-9e79-fea1b1cbf057 on nch2-master-1 Jul 23 21:28:40.083211 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-bfbdd96f-26d4-4e01-bf60-66630126cd18 req-863a8d2d-828d-45e3-b889-890cbc8905ad service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072266 Jul 23 21:28:40.083860 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1809/3704] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:28:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:28:40.095907 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ae74fc21-884c-40ce-a064-b6621fa61a21 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:40.123074 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-775117b9-0e76-479f-b8b1-028ae629815f tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:40.124071 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-775117b9-0e76-479f-b8b1-028ae629815f tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: 694b9d2e-5137-4c2a-a656-2607e1ea912a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:40.147784 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ae74fc21-884c-40ce-a064-b6621fa61a21 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:40.147904 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-775117b9-0e76-479f-b8b1-028ae629815f tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:40.147904 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-775117b9-0e76-479f-b8b1-028ae629815f tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:40.147904 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-775117b9-0e76-479f-b8b1-028ae629815f tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:40.147904 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-775117b9-0e76-479f-b8b1-028ae629815f tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:40.148251 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ae74fc21-884c-40ce-a064-b6621fa61a21 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:40.150782 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-ae74fc21-884c-40ce-a064-b6621fa61a21 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.578289 Jul 23 21:28:40.165429 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1896/3705] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:28:39 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:28:40.433613 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-6f68f329-acdf-4b04-9e9e-9ac28d11257a tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:40.434358 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-6f68f329-acdf-4b04-9e9e-9ac28d11257a tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] [instance: 5f175c94-dac6-4a61-a83b-1ebe44902d7c] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:40.443373 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6f68f329-acdf-4b04-9e9e-9ac28d11257a tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:40.444067 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6f68f329-acdf-4b04-9e9e-9ac28d11257a tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:40.445166 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6f68f329-acdf-4b04-9e9e-9ac28d11257a tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:40.445839 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6f68f329-acdf-4b04-9e9e-9ac28d11257a tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:40.536285 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-775117b9-0e76-479f-b8b1-028ae629815f tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:40.549254 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-775117b9-0e76-479f-b8b1-028ae629815f tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/694b9d2e-5137-4c2a-a656-2607e1ea912a" status: 200 len: 1511 microversion: 2.1 time: 0.459532 Jul 23 21:28:40.551516 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1810/3706] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:28:40 2022] GET /compute/v2.1/servers/694b9d2e-5137-4c2a-a656-2607e1ea912a => generated 1511 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:28:40.758854 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-6f68f329-acdf-4b04-9e9e-9ac28d11257a tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a723a102d34fbfa2662b07f9b10fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e47587982546ff87e06be741d68b96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:40.775411 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-6f68f329-acdf-4b04-9e9e-9ac28d11257a tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a723a102d34fbfa2662b07f9b10fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e47587982546ff87e06be741d68b96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:40.781149 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-6f68f329-acdf-4b04-9e9e-9ac28d11257a tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a723a102d34fbfa2662b07f9b10fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e47587982546ff87e06be741d68b96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:40.783709 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-6f68f329-acdf-4b04-9e9e-9ac28d11257a tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] 10.222.0.17 "GET /compute/v2.1/servers/5f175c94-dac6-4a61-a83b-1ebe44902d7c" status: 200 len: 1358 microversion: 2.21 time: 0.356043 Jul 23 21:28:40.787397 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1897/3707] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:28:40 2022] GET /compute/v2.1/servers/5f175c94-dac6-4a61-a83b-1ebe44902d7c => generated 1358 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:28:41.004990 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-554a85d2-5136-431d-b326-a3988b911a94 req-432aa5f1-dae3-44b7-a327-a28ea8fe8bfc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f175c94-dac6-4a61-a83b-1ebe44902d7c", "tag": "7ce9ca5a-5d97-4722-9294-105fb3d417e1"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:28:41.020395 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-554a85d2-5136-431d-b326-a3988b911a94 req-432aa5f1-dae3-44b7-a327-a28ea8fe8bfc service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:41.020850 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-554a85d2-5136-431d-b326-a3988b911a94 req-432aa5f1-dae3-44b7-a327-a28ea8fe8bfc service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:41.023872 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-835b4664-f121-47a3-bad7-76046978b3d4 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:41.024569 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-835b4664-f121-47a3-bad7-76046978b3d4 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] [instance: f24f6136-4a47-44f1-9e79-fea1b1cbf057] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:41.032860 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-835b4664-f121-47a3-bad7-76046978b3d4 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:41.035472 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-835b4664-f121-47a3-bad7-76046978b3d4 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:41.038061 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-835b4664-f121-47a3-bad7-76046978b3d4 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:41.039605 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-835b4664-f121-47a3-bad7-76046978b3d4 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:41.048478 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-554a85d2-5136-431d-b326-a3988b911a94 req-432aa5f1-dae3-44b7-a327-a28ea8fe8bfc service nova] Creating event network-changed:7ce9ca5a-5d97-4722-9294-105fb3d417e1 for instance 5f175c94-dac6-4a61-a83b-1ebe44902d7c on nch1-master-1 Jul 23 21:28:41.056885 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-554a85d2-5136-431d-b326-a3988b911a94 req-432aa5f1-dae3-44b7-a327-a28ea8fe8bfc service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055298 Jul 23 21:28:41.060054 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1811/3708] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:28:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:28:41.173497 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3a0191d3-3e2a-4445-bb72-419be48b4544 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:41.174539 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-3a0191d3-3e2a-4445-bb72-419be48b4544 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:41.189996 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3a0191d3-3e2a-4445-bb72-419be48b4544 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:41.190800 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3a0191d3-3e2a-4445-bb72-419be48b4544 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:41.191779 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3a0191d3-3e2a-4445-bb72-419be48b4544 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:41.192239 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3a0191d3-3e2a-4445-bb72-419be48b4544 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:41.641621 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-3a0191d3-3e2a-4445-bb72-419be48b4544 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:41.662069 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-3a0191d3-3e2a-4445-bb72-419be48b4544 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:41.662069 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-3a0191d3-3e2a-4445-bb72-419be48b4544 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:41.662596 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-3a0191d3-3e2a-4445-bb72-419be48b4544 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.493720 Jul 23 21:28:41.664021 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1812/3709] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:28:41 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:28:41.669340 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-bbf9b84f-4f43-4ded-a258-2bc15b06220b tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:41.670478 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-bbf9b84f-4f43-4ded-a258-2bc15b06220b tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: 694b9d2e-5137-4c2a-a656-2607e1ea912a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:41.679117 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bbf9b84f-4f43-4ded-a258-2bc15b06220b tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:41.679802 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bbf9b84f-4f43-4ded-a258-2bc15b06220b tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:41.680691 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bbf9b84f-4f43-4ded-a258-2bc15b06220b tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:41.681766 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bbf9b84f-4f43-4ded-a258-2bc15b06220b tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:41.828558 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-835b4664-f121-47a3-bad7-76046978b3d4 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b566640463e43aa85ec96a1aa76d3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eef3db6d5f46c9882fbe98cb732263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:41.848728 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-835b4664-f121-47a3-bad7-76046978b3d4 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] 10.222.0.17 "GET /compute/v2.1/servers/f24f6136-4a47-44f1-9e79-fea1b1cbf057" status: 200 len: 1323 microversion: 2.1 time: 0.829514 Jul 23 21:28:41.849720 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1898/3710] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:28:41 2022] GET /compute/v2.1/servers/f24f6136-4a47-44f1-9e79-fea1b1cbf057 => generated 1323 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:28:41.855288 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-529d94bf-b84c-4981-89f0-fba032cf337e tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:41.856181 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-529d94bf-b84c-4981-89f0-fba032cf337e tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] [instance: 5f175c94-dac6-4a61-a83b-1ebe44902d7c] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:41.863782 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-529d94bf-b84c-4981-89f0-fba032cf337e tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:41.864636 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-529d94bf-b84c-4981-89f0-fba032cf337e tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:41.865646 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-529d94bf-b84c-4981-89f0-fba032cf337e tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:41.866357 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-529d94bf-b84c-4981-89f0-fba032cf337e tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:41.894743 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-bbf9b84f-4f43-4ded-a258-2bc15b06220b tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:41.905590 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-bbf9b84f-4f43-4ded-a258-2bc15b06220b tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/694b9d2e-5137-4c2a-a656-2607e1ea912a" status: 200 len: 1511 microversion: 2.1 time: 0.240336 Jul 23 21:28:41.906871 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1813/3711] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:28:41 2022] GET /compute/v2.1/servers/694b9d2e-5137-4c2a-a656-2607e1ea912a => generated 1511 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:28:42.397231 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-529d94bf-b84c-4981-89f0-fba032cf337e tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a723a102d34fbfa2662b07f9b10fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e47587982546ff87e06be741d68b96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:42.414176 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-529d94bf-b84c-4981-89f0-fba032cf337e tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a723a102d34fbfa2662b07f9b10fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e47587982546ff87e06be741d68b96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:42.416713 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-529d94bf-b84c-4981-89f0-fba032cf337e tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a723a102d34fbfa2662b07f9b10fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e47587982546ff87e06be741d68b96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:42.418324 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-529d94bf-b84c-4981-89f0-fba032cf337e tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] 10.222.0.17 "GET /compute/v2.1/servers/5f175c94-dac6-4a61-a83b-1ebe44902d7c" status: 200 len: 1358 microversion: 2.21 time: 0.567099 Jul 23 21:28:42.420358 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1899/3712] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:28:41 2022] GET /compute/v2.1/servers/5f175c94-dac6-4a61-a83b-1ebe44902d7c => generated 1358 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:28:42.684764 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-439c9830-fa39-4d77-8206-9322a2930a62 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:42.685363 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-439c9830-fa39-4d77-8206-9322a2930a62 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:42.699515 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-439c9830-fa39-4d77-8206-9322a2930a62 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:42.699981 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-439c9830-fa39-4d77-8206-9322a2930a62 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:42.700764 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-439c9830-fa39-4d77-8206-9322a2930a62 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:42.701207 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-439c9830-fa39-4d77-8206-9322a2930a62 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:42.861530 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-439c9830-fa39-4d77-8206-9322a2930a62 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:42.867543 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-5844263a-9ec6-473a-a8ab-2f7bc3acb08c tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:42.871204 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-5844263a-9ec6-473a-a8ab-2f7bc3acb08c tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] [instance: f24f6136-4a47-44f1-9e79-fea1b1cbf057] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:42.887166 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5844263a-9ec6-473a-a8ab-2f7bc3acb08c tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:42.887765 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-439c9830-fa39-4d77-8206-9322a2930a62 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:42.888428 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5844263a-9ec6-473a-a8ab-2f7bc3acb08c tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:42.890383 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-439c9830-fa39-4d77-8206-9322a2930a62 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:42.891536 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5844263a-9ec6-473a-a8ab-2f7bc3acb08c tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:42.892161 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5844263a-9ec6-473a-a8ab-2f7bc3acb08c tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:42.893897 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-439c9830-fa39-4d77-8206-9322a2930a62 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.213773 Jul 23 21:28:42.898217 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1814/3713] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:28:42 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:28:42.923214 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b4aad769-ceb5-4d90-b283-21ad8f984f96 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:42.923845 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b4aad769-ceb5-4d90-b283-21ad8f984f96 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: 694b9d2e-5137-4c2a-a656-2607e1ea912a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:42.933950 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b4aad769-ceb5-4d90-b283-21ad8f984f96 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:42.934410 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b4aad769-ceb5-4d90-b283-21ad8f984f96 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:42.935674 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b4aad769-ceb5-4d90-b283-21ad8f984f96 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:42.936123 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b4aad769-ceb5-4d90-b283-21ad8f984f96 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:42.999167 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:43.405311 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-5844263a-9ec6-473a-a8ab-2f7bc3acb08c tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b566640463e43aa85ec96a1aa76d3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eef3db6d5f46c9882fbe98cb732263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:43.414822 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b4aad769-ceb5-4d90-b283-21ad8f984f96 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:43.420188 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-5844263a-9ec6-473a-a8ab-2f7bc3acb08c tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] 10.222.0.17 "GET /compute/v2.1/servers/f24f6136-4a47-44f1-9e79-fea1b1cbf057" status: 200 len: 1518 microversion: 2.1 time: 0.553056 Jul 23 21:28:43.437091 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1900/3714] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:28:42 2022] GET /compute/v2.1/servers/f24f6136-4a47-44f1-9e79-fea1b1cbf057 => generated 1518 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:28:43.439231 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b4aad769-ceb5-4d90-b283-21ad8f984f96 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/694b9d2e-5137-4c2a-a656-2607e1ea912a" status: 200 len: 1511 microversion: 2.1 time: 0.519967 Jul 23 21:28:43.447737 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1815/3715] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:28:42 2022] GET /compute/v2.1/servers/694b9d2e-5137-4c2a-a656-2607e1ea912a => generated 1511 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:28:43.450818 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-92fdf169-9559-47dc-91f2-d09ec3038b90 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:43.451847 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-92fdf169-9559-47dc-91f2-d09ec3038b90 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] [instance: 5f175c94-dac6-4a61-a83b-1ebe44902d7c] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:43.462809 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-92fdf169-9559-47dc-91f2-d09ec3038b90 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:43.463617 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-92fdf169-9559-47dc-91f2-d09ec3038b90 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:43.464887 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-00c86c52-724d-49f6-8989-d46cbed29e3e tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:28:43.468070 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-00c86c52-724d-49f6-8989-d46cbed29e3e tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] [instance: f24f6136-4a47-44f1-9e79-fea1b1cbf057] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:43.473107 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-92fdf169-9559-47dc-91f2-d09ec3038b90 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:43.475119 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-92fdf169-9559-47dc-91f2-d09ec3038b90 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:43.488916 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-00c86c52-724d-49f6-8989-d46cbed29e3e tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:43.489714 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-00c86c52-724d-49f6-8989-d46cbed29e3e tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:43.492234 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-00c86c52-724d-49f6-8989-d46cbed29e3e tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:43.492886 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-00c86c52-724d-49f6-8989-d46cbed29e3e tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:43.552630 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.objects.instance [None req-00c86c52-724d-49f6-8989-d46cbed29e3e tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lazy-loading 'flavor' on Instance uuid f24f6136-4a47-44f1-9e79-fea1b1cbf057 {{(pid=131320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:28:43.553384 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=100 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:43.732077 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-00c86c52-724d-49f6-8989-d46cbed29e3e tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] 10.222.0.17 "POST /compute/v2.1/servers/f24f6136-4a47-44f1-9e79-fea1b1cbf057/action" status: 200 len: 32 microversion: 2.1 time: 0.280009 Jul 23 21:28:43.737655 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1816/3716] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:28:43 2022] POST /compute/v2.1/servers/f24f6136-4a47-44f1-9e79-fea1b1cbf057/action => generated 32 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 23 21:28:43.745193 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0680ed26-0882-46d1-b068-c11d36e5d36d tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:43.756639 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-0680ed26-0882-46d1-b068-c11d36e5d36d tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] [instance: f24f6136-4a47-44f1-9e79-fea1b1cbf057] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:43.759557 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-92fdf169-9559-47dc-91f2-d09ec3038b90 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a723a102d34fbfa2662b07f9b10fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e47587982546ff87e06be741d68b96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:43.765341 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0680ed26-0882-46d1-b068-c11d36e5d36d tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:43.766105 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0680ed26-0882-46d1-b068-c11d36e5d36d tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:43.767091 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0680ed26-0882-46d1-b068-c11d36e5d36d tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:43.767755 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0680ed26-0882-46d1-b068-c11d36e5d36d tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:43.778582 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-92fdf169-9559-47dc-91f2-d09ec3038b90 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a723a102d34fbfa2662b07f9b10fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e47587982546ff87e06be741d68b96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:43.788786 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-92fdf169-9559-47dc-91f2-d09ec3038b90 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a723a102d34fbfa2662b07f9b10fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e47587982546ff87e06be741d68b96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:43.790536 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-92fdf169-9559-47dc-91f2-d09ec3038b90 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] 10.222.0.17 "GET /compute/v2.1/servers/5f175c94-dac6-4a61-a83b-1ebe44902d7c" status: 200 len: 1358 microversion: 2.21 time: 0.351796 Jul 23 21:28:43.791429 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1901/3717] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:28:43 2022] GET /compute/v2.1/servers/5f175c94-dac6-4a61-a83b-1ebe44902d7c => generated 1358 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:28:43.846728 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:43.877506 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=6 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:43.916532 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d573661c-6fe7-4432-8ad0-0805382b336d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:43.917758 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-d573661c-6fe7-4432-8ad0-0805382b336d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:43.928753 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d573661c-6fe7-4432-8ad0-0805382b336d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:43.930417 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d573661c-6fe7-4432-8ad0-0805382b336d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:43.934304 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d573661c-6fe7-4432-8ad0-0805382b336d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:43.934942 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d573661c-6fe7-4432-8ad0-0805382b336d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:44.169361 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-d573661c-6fe7-4432-8ad0-0805382b336d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:44.188775 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-d573661c-6fe7-4432-8ad0-0805382b336d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:44.191509 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-d573661c-6fe7-4432-8ad0-0805382b336d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:44.196550 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-d573661c-6fe7-4432-8ad0-0805382b336d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.283367 Jul 23 21:28:44.199748 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1902/3718] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:28:43 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:28:44.241177 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-0680ed26-0882-46d1-b068-c11d36e5d36d tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b566640463e43aa85ec96a1aa76d3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eef3db6d5f46c9882fbe98cb732263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:44.257638 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-0680ed26-0882-46d1-b068-c11d36e5d36d tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] 10.222.0.17 "GET /compute/v2.1/servers/f24f6136-4a47-44f1-9e79-fea1b1cbf057" status: 200 len: 1524 microversion: 2.1 time: 0.518116 Jul 23 21:28:44.259158 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1817/3719] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:28:43 2022] GET /compute/v2.1/servers/f24f6136-4a47-44f1-9e79-fea1b1cbf057 => generated 1524 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:28:44.458392 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-2beec902-d750-46a5-9fae-fcaeba978f7c tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:44.459781 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-2beec902-d750-46a5-9fae-fcaeba978f7c tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: 694b9d2e-5137-4c2a-a656-2607e1ea912a] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:44.474270 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2beec902-d750-46a5-9fae-fcaeba978f7c tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:44.476408 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2beec902-d750-46a5-9fae-fcaeba978f7c tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:44.478419 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2beec902-d750-46a5-9fae-fcaeba978f7c tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:44.480599 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2beec902-d750-46a5-9fae-fcaeba978f7c tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:44.587029 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell0:SELECT=2 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:44.810995 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-452ab56c-8949-4ef7-8c80-016fc501b1d0 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:44.811730 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-452ab56c-8949-4ef7-8c80-016fc501b1d0 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] [instance: 5f175c94-dac6-4a61-a83b-1ebe44902d7c] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:44.827518 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-452ab56c-8949-4ef7-8c80-016fc501b1d0 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:44.828227 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-452ab56c-8949-4ef7-8c80-016fc501b1d0 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:44.831568 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-452ab56c-8949-4ef7-8c80-016fc501b1d0 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:44.832413 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-452ab56c-8949-4ef7-8c80-016fc501b1d0 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:44.991243 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-2beec902-d750-46a5-9fae-fcaeba978f7c tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:45.003748 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-2beec902-d750-46a5-9fae-fcaeba978f7c tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/694b9d2e-5137-4c2a-a656-2607e1ea912a" status: 200 len: 1511 microversion: 2.1 time: 0.549416 Jul 23 21:28:45.007020 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1903/3720] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:28:44 2022] GET /compute/v2.1/servers/694b9d2e-5137-4c2a-a656-2607e1ea912a => generated 1511 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:28:45.218622 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-93f3c2db-d9df-41f9-8dd0-e74c89ef8890 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:45.219270 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-93f3c2db-d9df-41f9-8dd0-e74c89ef8890 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:45.229719 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-93f3c2db-d9df-41f9-8dd0-e74c89ef8890 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:45.231770 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-93f3c2db-d9df-41f9-8dd0-e74c89ef8890 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:45.232851 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-93f3c2db-d9df-41f9-8dd0-e74c89ef8890 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:45.236109 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-93f3c2db-d9df-41f9-8dd0-e74c89ef8890 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:45.350766 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-452ab56c-8949-4ef7-8c80-016fc501b1d0 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a723a102d34fbfa2662b07f9b10fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e47587982546ff87e06be741d68b96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:45.368783 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-452ab56c-8949-4ef7-8c80-016fc501b1d0 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a723a102d34fbfa2662b07f9b10fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e47587982546ff87e06be741d68b96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:45.373884 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-452ab56c-8949-4ef7-8c80-016fc501b1d0 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a723a102d34fbfa2662b07f9b10fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e47587982546ff87e06be741d68b96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:45.375340 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-452ab56c-8949-4ef7-8c80-016fc501b1d0 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] 10.222.0.17 "GET /compute/v2.1/servers/5f175c94-dac6-4a61-a83b-1ebe44902d7c" status: 200 len: 1358 microversion: 2.21 time: 0.569944 Jul 23 21:28:45.391476 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1818/3721] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:28:44 2022] GET /compute/v2.1/servers/5f175c94-dac6-4a61-a83b-1ebe44902d7c => generated 1358 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:28:45.399684 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8990cc40-770e-4b3d-a42d-3d89fdbe519d tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:45.400900 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8990cc40-770e-4b3d-a42d-3d89fdbe519d tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] [instance: f24f6136-4a47-44f1-9e79-fea1b1cbf057] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:45.408122 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8990cc40-770e-4b3d-a42d-3d89fdbe519d tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:45.408900 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8990cc40-770e-4b3d-a42d-3d89fdbe519d tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:45.409822 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8990cc40-770e-4b3d-a42d-3d89fdbe519d tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:45.411444 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8990cc40-770e-4b3d-a42d-3d89fdbe519d tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:45.623848 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-93f3c2db-d9df-41f9-8dd0-e74c89ef8890 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:45.641484 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-93f3c2db-d9df-41f9-8dd0-e74c89ef8890 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:45.649279 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-93f3c2db-d9df-41f9-8dd0-e74c89ef8890 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:45.650921 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-93f3c2db-d9df-41f9-8dd0-e74c89ef8890 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.436892 Jul 23 21:28:45.653825 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1904/3722] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:28:45 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:28:45.737776 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8990cc40-770e-4b3d-a42d-3d89fdbe519d tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b566640463e43aa85ec96a1aa76d3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eef3db6d5f46c9882fbe98cb732263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:45.751319 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8990cc40-770e-4b3d-a42d-3d89fdbe519d tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] 10.222.0.17 "GET /compute/v2.1/servers/f24f6136-4a47-44f1-9e79-fea1b1cbf057" status: 200 len: 1524 microversion: 2.1 time: 0.358372 Jul 23 21:28:45.752227 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1819/3723] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:28:45 2022] GET /compute/v2.1/servers/f24f6136-4a47-44f1-9e79-fea1b1cbf057 => generated 1524 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:28:46.028437 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-5a7b8bea-13cd-444d-be53-0732edca2b46 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:46.029848 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-5a7b8bea-13cd-444d-be53-0732edca2b46 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: 694b9d2e-5137-4c2a-a656-2607e1ea912a] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:46.039557 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5a7b8bea-13cd-444d-be53-0732edca2b46 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:46.040407 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5a7b8bea-13cd-444d-be53-0732edca2b46 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:46.041613 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5a7b8bea-13cd-444d-be53-0732edca2b46 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:46.042340 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5a7b8bea-13cd-444d-be53-0732edca2b46 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:46.395489 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-26dffcb9-41d2-423f-987b-16f48984d69a tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:46.396332 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-26dffcb9-41d2-423f-987b-16f48984d69a tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] [instance: 5f175c94-dac6-4a61-a83b-1ebe44902d7c] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:46.409626 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-26dffcb9-41d2-423f-987b-16f48984d69a tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:46.410745 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-26dffcb9-41d2-423f-987b-16f48984d69a tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:46.412392 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-26dffcb9-41d2-423f-987b-16f48984d69a tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:46.415157 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-26dffcb9-41d2-423f-987b-16f48984d69a tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:46.647084 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-5a7b8bea-13cd-444d-be53-0732edca2b46 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:46.658300 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-5a7b8bea-13cd-444d-be53-0732edca2b46 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/694b9d2e-5137-4c2a-a656-2607e1ea912a" status: 200 len: 1511 microversion: 2.1 time: 0.638561 Jul 23 21:28:46.658895 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1905/3724] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:28:46 2022] GET /compute/v2.1/servers/694b9d2e-5137-4c2a-a656-2607e1ea912a => generated 1511 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:28:46.674779 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-efa9a6a6-cb62-4ec7-88e5-ec17d392b930 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:46.675405 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-efa9a6a6-cb62-4ec7-88e5-ec17d392b930 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:46.690353 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-efa9a6a6-cb62-4ec7-88e5-ec17d392b930 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:46.690917 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-efa9a6a6-cb62-4ec7-88e5-ec17d392b930 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:46.691764 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-efa9a6a6-cb62-4ec7-88e5-ec17d392b930 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:46.692212 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-efa9a6a6-cb62-4ec7-88e5-ec17d392b930 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:46.817116 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-26dffcb9-41d2-423f-987b-16f48984d69a tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a723a102d34fbfa2662b07f9b10fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e47587982546ff87e06be741d68b96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:46.832833 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-26dffcb9-41d2-423f-987b-16f48984d69a tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a723a102d34fbfa2662b07f9b10fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e47587982546ff87e06be741d68b96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:46.834667 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-26dffcb9-41d2-423f-987b-16f48984d69a tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a723a102d34fbfa2662b07f9b10fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e47587982546ff87e06be741d68b96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:46.835998 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-26dffcb9-41d2-423f-987b-16f48984d69a tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] 10.222.0.17 "GET /compute/v2.1/servers/5f175c94-dac6-4a61-a83b-1ebe44902d7c" status: 200 len: 1358 microversion: 2.21 time: 0.445246 Jul 23 21:28:46.836726 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1820/3725] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:28:46 2022] GET /compute/v2.1/servers/5f175c94-dac6-4a61-a83b-1ebe44902d7c => generated 1358 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:28:46.850301 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8e51f119-7565-429c-9844-de80a6dd4385 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:46.851169 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8e51f119-7565-429c-9844-de80a6dd4385 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] [instance: f24f6136-4a47-44f1-9e79-fea1b1cbf057] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:46.861767 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8e51f119-7565-429c-9844-de80a6dd4385 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:46.865101 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8e51f119-7565-429c-9844-de80a6dd4385 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:46.866021 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8e51f119-7565-429c-9844-de80a6dd4385 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:46.866427 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8e51f119-7565-429c-9844-de80a6dd4385 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:47.118423 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8e51f119-7565-429c-9844-de80a6dd4385 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b566640463e43aa85ec96a1aa76d3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eef3db6d5f46c9882fbe98cb732263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:47.134113 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8e51f119-7565-429c-9844-de80a6dd4385 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] 10.222.0.17 "GET /compute/v2.1/servers/f24f6136-4a47-44f1-9e79-fea1b1cbf057" status: 200 len: 1524 microversion: 2.1 time: 0.290375 Jul 23 21:28:47.135005 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1821/3726] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:28:46 2022] GET /compute/v2.1/servers/f24f6136-4a47-44f1-9e79-fea1b1cbf057 => generated 1524 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:28:47.368858 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-efa9a6a6-cb62-4ec7-88e5-ec17d392b930 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:47.384405 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-efa9a6a6-cb62-4ec7-88e5-ec17d392b930 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:47.387210 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-efa9a6a6-cb62-4ec7-88e5-ec17d392b930 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:47.389710 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-efa9a6a6-cb62-4ec7-88e5-ec17d392b930 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.718949 Jul 23 21:28:47.391869 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1906/3727] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:28:46 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:28:47.679235 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-074b7be6-f2ea-44c7-b79a-d73a5fac324a tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:47.680857 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-074b7be6-f2ea-44c7-b79a-d73a5fac324a tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: 694b9d2e-5137-4c2a-a656-2607e1ea912a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:47.689950 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-074b7be6-f2ea-44c7-b79a-d73a5fac324a tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:47.691410 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-074b7be6-f2ea-44c7-b79a-d73a5fac324a tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:47.693033 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-074b7be6-f2ea-44c7-b79a-d73a5fac324a tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:47.693764 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-074b7be6-f2ea-44c7-b79a-d73a5fac324a tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:47.856063 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a1edba4f-643b-4806-9339-bdd473d23815 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:47.856706 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-a1edba4f-643b-4806-9339-bdd473d23815 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] [instance: 5f175c94-dac6-4a61-a83b-1ebe44902d7c] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:47.886558 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a1edba4f-643b-4806-9339-bdd473d23815 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:47.887024 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a1edba4f-643b-4806-9339-bdd473d23815 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:47.887845 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a1edba4f-643b-4806-9339-bdd473d23815 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:47.888287 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a1edba4f-643b-4806-9339-bdd473d23815 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:47.980025 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-074b7be6-f2ea-44c7-b79a-d73a5fac324a tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:47.989805 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-074b7be6-f2ea-44c7-b79a-d73a5fac324a tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/694b9d2e-5137-4c2a-a656-2607e1ea912a" status: 200 len: 1511 microversion: 2.1 time: 0.317156 Jul 23 21:28:47.994282 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1822/3728] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:28:47 2022] GET /compute/v2.1/servers/694b9d2e-5137-4c2a-a656-2607e1ea912a => generated 1511 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:28:48.152350 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-10ba889d-7cb1-4663-a682-9bff73d8a032 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:48.152973 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-10ba889d-7cb1-4663-a682-9bff73d8a032 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] [instance: f24f6136-4a47-44f1-9e79-fea1b1cbf057] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:48.164373 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-10ba889d-7cb1-4663-a682-9bff73d8a032 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:48.165079 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-10ba889d-7cb1-4663-a682-9bff73d8a032 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:48.166278 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-10ba889d-7cb1-4663-a682-9bff73d8a032 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:48.166974 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-10ba889d-7cb1-4663-a682-9bff73d8a032 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:48.326884 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-a1edba4f-643b-4806-9339-bdd473d23815 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a723a102d34fbfa2662b07f9b10fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e47587982546ff87e06be741d68b96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:48.345191 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-a1edba4f-643b-4806-9339-bdd473d23815 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a723a102d34fbfa2662b07f9b10fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e47587982546ff87e06be741d68b96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:48.347279 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-a1edba4f-643b-4806-9339-bdd473d23815 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a723a102d34fbfa2662b07f9b10fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e47587982546ff87e06be741d68b96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:48.350318 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-a1edba4f-643b-4806-9339-bdd473d23815 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] 10.222.0.17 "GET /compute/v2.1/servers/5f175c94-dac6-4a61-a83b-1ebe44902d7c" status: 200 len: 1358 microversion: 2.21 time: 0.499714 Jul 23 21:28:48.362825 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1907/3729] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:28:47 2022] GET /compute/v2.1/servers/5f175c94-dac6-4a61-a83b-1ebe44902d7c => generated 1358 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:28:48.370971 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-50cba57b-dcb0-46f9-97a2-7c04357b4100 req-ed2546c5-2455-4450-bfeb-48f439cc2c6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f175c94-dac6-4a61-a83b-1ebe44902d7c", "name": "network-vif-plugged", "status": "completed", "tag": "7ce9ca5a-5d97-4722-9294-105fb3d417e1"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:28:48.395579 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:48.398101 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-50cba57b-dcb0-46f9-97a2-7c04357b4100 req-ed2546c5-2455-4450-bfeb-48f439cc2c6a service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:48.399159 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-50cba57b-dcb0-46f9-97a2-7c04357b4100 req-ed2546c5-2455-4450-bfeb-48f439cc2c6a service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:48.425419 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-50cba57b-dcb0-46f9-97a2-7c04357b4100 req-ed2546c5-2455-4450-bfeb-48f439cc2c6a service nova] Creating event network-vif-plugged:7ce9ca5a-5d97-4722-9294-105fb3d417e1 for instance 5f175c94-dac6-4a61-a83b-1ebe44902d7c on nch1-master-1 Jul 23 21:28:48.432967 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-50cba57b-dcb0-46f9-97a2-7c04357b4100 req-ed2546c5-2455-4450-bfeb-48f439cc2c6a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067496 Jul 23 21:28:48.434287 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1908/3730] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:28:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:28:48.442405 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-87f9bee5-5615-4bb9-b717-a8d668ac2e2c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:48.443627 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-87f9bee5-5615-4bb9-b717-a8d668ac2e2c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:48.446672 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-10ba889d-7cb1-4663-a682-9bff73d8a032 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b566640463e43aa85ec96a1aa76d3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eef3db6d5f46c9882fbe98cb732263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:48.451737 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-87f9bee5-5615-4bb9-b717-a8d668ac2e2c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:48.452558 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-87f9bee5-5615-4bb9-b717-a8d668ac2e2c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:48.453655 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-87f9bee5-5615-4bb9-b717-a8d668ac2e2c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:48.454543 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-87f9bee5-5615-4bb9-b717-a8d668ac2e2c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:48.461245 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-10ba889d-7cb1-4663-a682-9bff73d8a032 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] 10.222.0.17 "GET /compute/v2.1/servers/f24f6136-4a47-44f1-9e79-fea1b1cbf057" status: 200 len: 1524 microversion: 2.1 time: 0.313083 Jul 23 21:28:48.483494 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1823/3731] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:28:48 2022] GET /compute/v2.1/servers/f24f6136-4a47-44f1-9e79-fea1b1cbf057 => generated 1524 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:28:48.587462 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-87f9bee5-5615-4bb9-b717-a8d668ac2e2c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:48.600910 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-87f9bee5-5615-4bb9-b717-a8d668ac2e2c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:48.603599 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-87f9bee5-5615-4bb9-b717-a8d668ac2e2c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:48.605087 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-87f9bee5-5615-4bb9-b717-a8d668ac2e2c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.168704 Jul 23 21:28:48.606266 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1909/3732] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:28:48 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:28:49.010807 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ea84d5df-3ce7-4839-9447-4770c86de769 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:49.012533 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ea84d5df-3ce7-4839-9447-4770c86de769 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: 694b9d2e-5137-4c2a-a656-2607e1ea912a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:49.030774 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ea84d5df-3ce7-4839-9447-4770c86de769 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:49.034966 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ea84d5df-3ce7-4839-9447-4770c86de769 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:49.038718 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ea84d5df-3ce7-4839-9447-4770c86de769 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:49.039422 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ea84d5df-3ce7-4839-9447-4770c86de769 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:49.374094 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-7503d9ae-09e7-496f-abaa-0f0d3440f653 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:49.375540 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-7503d9ae-09e7-496f-abaa-0f0d3440f653 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] [instance: 5f175c94-dac6-4a61-a83b-1ebe44902d7c] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:49.393256 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7503d9ae-09e7-496f-abaa-0f0d3440f653 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:49.397351 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7503d9ae-09e7-496f-abaa-0f0d3440f653 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:49.403473 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7503d9ae-09e7-496f-abaa-0f0d3440f653 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:49.404209 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7503d9ae-09e7-496f-abaa-0f0d3440f653 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:49.817138 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-7503d9ae-09e7-496f-abaa-0f0d3440f653 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a723a102d34fbfa2662b07f9b10fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e47587982546ff87e06be741d68b96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:49.831947 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-7503d9ae-09e7-496f-abaa-0f0d3440f653 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a723a102d34fbfa2662b07f9b10fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e47587982546ff87e06be741d68b96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:49.838907 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-7503d9ae-09e7-496f-abaa-0f0d3440f653 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a723a102d34fbfa2662b07f9b10fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e47587982546ff87e06be741d68b96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:49.840577 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-7503d9ae-09e7-496f-abaa-0f0d3440f653 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] 10.222.0.17 "GET /compute/v2.1/servers/5f175c94-dac6-4a61-a83b-1ebe44902d7c" status: 200 len: 1358 microversion: 2.21 time: 0.474326 Jul 23 21:28:49.841283 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1910/3733] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:28:49 2022] GET /compute/v2.1/servers/5f175c94-dac6-4a61-a83b-1ebe44902d7c => generated 1358 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:28:49.856978 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c7798f4c-b4a6-468f-a065-585fd201f2f7 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:49.857699 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-c7798f4c-b4a6-468f-a065-585fd201f2f7 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] [instance: f24f6136-4a47-44f1-9e79-fea1b1cbf057] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:49.874784 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c7798f4c-b4a6-468f-a065-585fd201f2f7 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:49.875336 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c7798f4c-b4a6-468f-a065-585fd201f2f7 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:49.876235 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c7798f4c-b4a6-468f-a065-585fd201f2f7 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:49.876742 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c7798f4c-b4a6-468f-a065-585fd201f2f7 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:49.908845 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ea84d5df-3ce7-4839-9447-4770c86de769 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:49.924105 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ea84d5df-3ce7-4839-9447-4770c86de769 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/694b9d2e-5137-4c2a-a656-2607e1ea912a" status: 200 len: 1511 microversion: 2.1 time: 0.920460 Jul 23 21:28:49.925436 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1824/3734] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:28:49 2022] GET /compute/v2.1/servers/694b9d2e-5137-4c2a-a656-2607e1ea912a => generated 1511 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:28:49.930532 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a0f2d09b-b419-4f04-8899-92820783e39c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:49.942710 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a0f2d09b-b419-4f04-8899-92820783e39c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:49.949454 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a0f2d09b-b419-4f04-8899-92820783e39c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:49.950304 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a0f2d09b-b419-4f04-8899-92820783e39c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:49.951321 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a0f2d09b-b419-4f04-8899-92820783e39c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:49.951983 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a0f2d09b-b419-4f04-8899-92820783e39c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:50.125089 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c7798f4c-b4a6-468f-a065-585fd201f2f7 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b566640463e43aa85ec96a1aa76d3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eef3db6d5f46c9882fbe98cb732263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:50.138400 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a0f2d09b-b419-4f04-8899-92820783e39c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:50.148014 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-c7798f4c-b4a6-468f-a065-585fd201f2f7 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] 10.222.0.17 "GET /compute/v2.1/servers/f24f6136-4a47-44f1-9e79-fea1b1cbf057" status: 200 len: 1524 microversion: 2.1 time: 0.305509 Jul 23 21:28:50.154849 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1911/3735] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:28:49 2022] GET /compute/v2.1/servers/f24f6136-4a47-44f1-9e79-fea1b1cbf057 => generated 1524 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:28:50.156684 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a0f2d09b-b419-4f04-8899-92820783e39c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:50.162456 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a0f2d09b-b419-4f04-8899-92820783e39c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:50.163736 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a0f2d09b-b419-4f04-8899-92820783e39c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.236905 Jul 23 21:28:50.172824 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1825/3736] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:28:49 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:28:50.863862 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-cd9af793-f02c-475f-ba16-da236d0b12c2 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:50.864479 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-cd9af793-f02c-475f-ba16-da236d0b12c2 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] [instance: 5f175c94-dac6-4a61-a83b-1ebe44902d7c] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:50.900642 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cd9af793-f02c-475f-ba16-da236d0b12c2 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:50.902852 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cd9af793-f02c-475f-ba16-da236d0b12c2 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:50.903893 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cd9af793-f02c-475f-ba16-da236d0b12c2 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:50.905146 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cd9af793-f02c-475f-ba16-da236d0b12c2 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:50.942379 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-fe683660-3ef1-416e-b0a3-93f6c93dad9f tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:50.943004 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-fe683660-3ef1-416e-b0a3-93f6c93dad9f tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: 694b9d2e-5137-4c2a-a656-2607e1ea912a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:50.946396 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:50.957359 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fe683660-3ef1-416e-b0a3-93f6c93dad9f tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:50.961772 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fe683660-3ef1-416e-b0a3-93f6c93dad9f tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:50.962973 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fe683660-3ef1-416e-b0a3-93f6c93dad9f tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:50.963857 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fe683660-3ef1-416e-b0a3-93f6c93dad9f tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:51.285671 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-cd9af793-f02c-475f-ba16-da236d0b12c2 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a723a102d34fbfa2662b07f9b10fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e47587982546ff87e06be741d68b96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:51.306375 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-cd9af793-f02c-475f-ba16-da236d0b12c2 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a723a102d34fbfa2662b07f9b10fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e47587982546ff87e06be741d68b96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:51.310077 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-cd9af793-f02c-475f-ba16-da236d0b12c2 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a723a102d34fbfa2662b07f9b10fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e47587982546ff87e06be741d68b96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:51.311989 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-cd9af793-f02c-475f-ba16-da236d0b12c2 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] 10.222.0.17 "GET /compute/v2.1/servers/5f175c94-dac6-4a61-a83b-1ebe44902d7c" status: 200 len: 1550 microversion: 2.21 time: 0.457422 Jul 23 21:28:51.318903 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1912/3737] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:28:50 2022] GET /compute/v2.1/servers/5f175c94-dac6-4a61-a83b-1ebe44902d7c => generated 1550 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:28:51.328474 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-58eb22da-ee6a-428d-afb8-8c955338ccdb tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:51.330801 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-58eb22da-ee6a-428d-afb8-8c955338ccdb tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] [instance: f24f6136-4a47-44f1-9e79-fea1b1cbf057] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:51.354568 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-58eb22da-ee6a-428d-afb8-8c955338ccdb tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:51.355177 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-58eb22da-ee6a-428d-afb8-8c955338ccdb tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:51.356073 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-58eb22da-ee6a-428d-afb8-8c955338ccdb tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:51.356614 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-58eb22da-ee6a-428d-afb8-8c955338ccdb tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:51.581050 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-58eb22da-ee6a-428d-afb8-8c955338ccdb tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b566640463e43aa85ec96a1aa76d3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eef3db6d5f46c9882fbe98cb732263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:51.595181 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-58eb22da-ee6a-428d-afb8-8c955338ccdb tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] 10.222.0.17 "GET /compute/v2.1/servers/f24f6136-4a47-44f1-9e79-fea1b1cbf057" status: 200 len: 1524 microversion: 2.1 time: 0.274324 Jul 23 21:28:51.602903 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1913/3738] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:28:51 2022] GET /compute/v2.1/servers/f24f6136-4a47-44f1-9e79-fea1b1cbf057 => generated 1524 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:28:51.608502 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f25e1cd5-995b-4caa-953a-96ba96e11dd9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:51.609183 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-f25e1cd5-995b-4caa-953a-96ba96e11dd9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:51.622022 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f25e1cd5-995b-4caa-953a-96ba96e11dd9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:51.622738 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f25e1cd5-995b-4caa-953a-96ba96e11dd9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:51.623890 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f25e1cd5-995b-4caa-953a-96ba96e11dd9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:51.624505 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f25e1cd5-995b-4caa-953a-96ba96e11dd9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:51.664678 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-fe683660-3ef1-416e-b0a3-93f6c93dad9f tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:51.681261 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-fe683660-3ef1-416e-b0a3-93f6c93dad9f tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/694b9d2e-5137-4c2a-a656-2607e1ea912a" status: 200 len: 1511 microversion: 2.1 time: 0.743389 Jul 23 21:28:51.681959 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1826/3739] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:28:50 2022] GET /compute/v2.1/servers/694b9d2e-5137-4c2a-a656-2607e1ea912a => generated 1511 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:28:51.727078 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-f25e1cd5-995b-4caa-953a-96ba96e11dd9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:51.743122 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-f25e1cd5-995b-4caa-953a-96ba96e11dd9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:51.748296 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-f25e1cd5-995b-4caa-953a-96ba96e11dd9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:51.751243 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-f25e1cd5-995b-4caa-953a-96ba96e11dd9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.145593 Jul 23 21:28:51.752757 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1914/3740] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:28:51 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:28:51.767256 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-bf2499ec-19fb-448c-abc5-d0c46d536776 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:51.768383 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-bf2499ec-19fb-448c-abc5-d0c46d536776 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] [instance: 5f175c94-dac6-4a61-a83b-1ebe44902d7c] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:51.785367 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bf2499ec-19fb-448c-abc5-d0c46d536776 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:51.789672 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bf2499ec-19fb-448c-abc5-d0c46d536776 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:51.790909 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bf2499ec-19fb-448c-abc5-d0c46d536776 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:51.792465 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bf2499ec-19fb-448c-abc5-d0c46d536776 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:51.864301 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-bf2499ec-19fb-448c-abc5-d0c46d536776 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] [instance: 5f175c94-dac6-4a61-a83b-1ebe44902d7c] Going to try to terminate instance {{(pid=131321) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:28:52.051063 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-bf2499ec-19fb-448c-abc5-d0c46d536776 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] 10.222.0.17 "DELETE /compute/v2.1/servers/5f175c94-dac6-4a61-a83b-1ebe44902d7c" status: 204 len: 0 microversion: 2.21 time: 0.297019 Jul 23 21:28:52.052203 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1915/3741] 10.222.0.17 () {60 vars in 1279 bytes} [Sat Jul 23 21:28:51 2022] DELETE /compute/v2.1/servers/5f175c94-dac6-4a61-a83b-1ebe44902d7c => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 23 21:28:52.064633 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-587a3c9a-4463-46af-bc6d-0f6a1ab11613 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:52.065581 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-587a3c9a-4463-46af-bc6d-0f6a1ab11613 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] [instance: 5f175c94-dac6-4a61-a83b-1ebe44902d7c] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:52.074036 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-587a3c9a-4463-46af-bc6d-0f6a1ab11613 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:52.074718 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-587a3c9a-4463-46af-bc6d-0f6a1ab11613 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:52.076020 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-587a3c9a-4463-46af-bc6d-0f6a1ab11613 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:52.076634 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-587a3c9a-4463-46af-bc6d-0f6a1ab11613 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:52.094634 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d83ff9bb-9605-4d84-8721-1d615ce543af tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-67056066", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "networks": [{"uuid": "c9810fe3-dd25-4298-92d6-a9c75ba28a24"}]}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:28:52.174447 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-d83ff9bb-9605-4d84-8721-1d615ce543af tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] validate_networks() for [('c9810fe3-dd25-4298-92d6-a9c75ba28a24', None, None, None, None, None)] {{(pid=131320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:28:52.367845 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-587a3c9a-4463-46af-bc6d-0f6a1ab11613 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a723a102d34fbfa2662b07f9b10fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e47587982546ff87e06be741d68b96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:52.376908 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-587a3c9a-4463-46af-bc6d-0f6a1ab11613 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a723a102d34fbfa2662b07f9b10fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e47587982546ff87e06be741d68b96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:52.378739 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-587a3c9a-4463-46af-bc6d-0f6a1ab11613 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a723a102d34fbfa2662b07f9b10fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e47587982546ff87e06be741d68b96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:52.390076 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-587a3c9a-4463-46af-bc6d-0f6a1ab11613 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] 10.222.0.17 "GET /compute/v2.1/servers/5f175c94-dac6-4a61-a83b-1ebe44902d7c" status: 200 len: 1556 microversion: 2.21 time: 0.330556 Jul 23 21:28:52.401549 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1916/3742] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:28:52 2022] GET /compute/v2.1/servers/5f175c94-dac6-4a61-a83b-1ebe44902d7c => generated 1556 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:28:52.614274 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-80d3d3a1-33ac-4bf9-ba07-4cce041f1d0e tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:52.615701 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-80d3d3a1-33ac-4bf9-ba07-4cce041f1d0e tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] [instance: f24f6136-4a47-44f1-9e79-fea1b1cbf057] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:52.624601 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-80d3d3a1-33ac-4bf9-ba07-4cce041f1d0e tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:52.625275 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-80d3d3a1-33ac-4bf9-ba07-4cce041f1d0e tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:52.626354 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-80d3d3a1-33ac-4bf9-ba07-4cce041f1d0e tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:52.627030 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-80d3d3a1-33ac-4bf9-ba07-4cce041f1d0e tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:52.632683 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:52.914236 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-80d3d3a1-33ac-4bf9-ba07-4cce041f1d0e tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b566640463e43aa85ec96a1aa76d3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eef3db6d5f46c9882fbe98cb732263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:52.929251 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-80d3d3a1-33ac-4bf9-ba07-4cce041f1d0e tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] 10.222.0.17 "GET /compute/v2.1/servers/f24f6136-4a47-44f1-9e79-fea1b1cbf057" status: 200 len: 1524 microversion: 2.1 time: 0.320454 Jul 23 21:28:52.930491 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1917/3743] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:28:52 2022] GET /compute/v2.1/servers/f24f6136-4a47-44f1-9e79-fea1b1cbf057 => generated 1524 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:28:52.940584 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-7fae11db-3183-46e3-becf-7bd5224c7863 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:52.941338 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-7fae11db-3183-46e3-becf-7bd5224c7863 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: 694b9d2e-5137-4c2a-a656-2607e1ea912a] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:52.950271 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7fae11db-3183-46e3-becf-7bd5224c7863 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:52.951003 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7fae11db-3183-46e3-becf-7bd5224c7863 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:52.951943 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7fae11db-3183-46e3-becf-7bd5224c7863 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:52.952548 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7fae11db-3183-46e3-becf-7bd5224c7863 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:53.094534 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-d83ff9bb-9605-4d84-8721-1d615ce543af tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:28:53.096105 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-d83ff9bb-9605-4d84-8721-1d615ce543af tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:28:53.096805 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-d83ff9bb-9605-4d84-8721-1d615ce543af tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:28:53.097788 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-d83ff9bb-9605-4d84-8721-1d615ce543af tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:28:53.098457 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-d83ff9bb-9605-4d84-8721-1d615ce543af tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:28:53.112563 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d83ff9bb-9605-4d84-8721-1d615ce543af tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:53.114021 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d83ff9bb-9605-4d84-8721-1d615ce543af tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:53.115643 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d83ff9bb-9605-4d84-8721-1d615ce543af tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:53.116321 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d83ff9bb-9605-4d84-8721-1d615ce543af tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:53.132171 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-7fae11db-3183-46e3-becf-7bd5224c7863 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:53.140790 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-7fae11db-3183-46e3-becf-7bd5224c7863 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/694b9d2e-5137-4c2a-a656-2607e1ea912a" status: 200 len: 1511 microversion: 2.1 time: 0.209021 Jul 23 21:28:53.143097 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1918/3744] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:28:52 2022] GET /compute/v2.1/servers/694b9d2e-5137-4c2a-a656-2607e1ea912a => generated 1511 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:28:53.152589 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-aba2c76f-afb4-4228-970c-a8b06f0c6aa9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:53.157452 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-aba2c76f-afb4-4228-970c-a8b06f0c6aa9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:53.160590 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-d83ff9bb-9605-4d84-8721-1d615ce543af tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Getting quotas for project 21695c8a68454c07bd8c466671076897. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:28:53.172695 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-aba2c76f-afb4-4228-970c-a8b06f0c6aa9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:53.173160 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-aba2c76f-afb4-4228-970c-a8b06f0c6aa9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:53.175718 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-d83ff9bb-9605-4d84-8721-1d615ce543af tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Getting quotas for user 896f9085718446cd90ce445c09be4741 and project 21695c8a68454c07bd8c466671076897. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:28:53.177578 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-aba2c76f-afb4-4228-970c-a8b06f0c6aa9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:53.178151 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-aba2c76f-afb4-4228-970c-a8b06f0c6aa9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:53.213121 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d83ff9bb-9605-4d84-8721-1d615ce543af tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Going to run 1 instances... {{(pid=131320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:28:53.215582 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d83ff9bb-9605-4d84-8721-1d615ce543af tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] [instance: ee790a59-a432-4563-a3f9-ab25bb7876b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:28:53.294747 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d83ff9bb-9605-4d84-8721-1d615ce543af tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.610791 Jul 23 21:28:53.295745 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1827/3745] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:28:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1613 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 23 21:28:53.307225 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1cbcf6b1-4d7c-488e-958c-baccea7df14e tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:53.307976 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1cbcf6b1-4d7c-488e-958c-baccea7df14e tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] [instance: ee790a59-a432-4563-a3f9-ab25bb7876b9] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:53.320067 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-aba2c76f-afb4-4228-970c-a8b06f0c6aa9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:53.333661 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-aba2c76f-afb4-4228-970c-a8b06f0c6aa9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:53.335264 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-aba2c76f-afb4-4228-970c-a8b06f0c6aa9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:53.337142 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-aba2c76f-afb4-4228-970c-a8b06f0c6aa9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.191390 Jul 23 21:28:53.337778 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1919/3746] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:28:53 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:28:53.412175 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-1b562adb-28e1-4827-a6bc-2c6e6d0a786e tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:53.413402 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-1b562adb-28e1-4827-a6bc-2c6e6d0a786e tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] [instance: 5f175c94-dac6-4a61-a83b-1ebe44902d7c] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:53.455442 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1b562adb-28e1-4827-a6bc-2c6e6d0a786e tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:53.456042 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1b562adb-28e1-4827-a6bc-2c6e6d0a786e tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:53.456927 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1b562adb-28e1-4827-a6bc-2c6e6d0a786e tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:53.457370 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1b562adb-28e1-4827-a6bc-2c6e6d0a786e tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:53.719172 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-1cbcf6b1-4d7c-488e-958c-baccea7df14e tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '896f9085718446cd90ce445c09be4741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21695c8a68454c07bd8c466671076897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:53.729826 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1cbcf6b1-4d7c-488e-958c-baccea7df14e tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] 10.222.0.17 "GET /compute/v2.1/servers/ee790a59-a432-4563-a3f9-ab25bb7876b9" status: 200 len: 1223 microversion: 2.1 time: 0.425210 Jul 23 21:28:53.742068 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1828/3747] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:28:53 2022] GET /compute/v2.1/servers/ee790a59-a432-4563-a3f9-ab25bb7876b9 => generated 1223 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:28:53.948037 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-735fa068-34af-42d6-8074-a2390813d841 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:53.949567 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-735fa068-34af-42d6-8074-a2390813d841 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] [instance: f24f6136-4a47-44f1-9e79-fea1b1cbf057] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:53.960490 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-735fa068-34af-42d6-8074-a2390813d841 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:53.962983 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-735fa068-34af-42d6-8074-a2390813d841 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:53.965445 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-735fa068-34af-42d6-8074-a2390813d841 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:53.966649 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-735fa068-34af-42d6-8074-a2390813d841 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:54.074493 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-1b562adb-28e1-4827-a6bc-2c6e6d0a786e tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a723a102d34fbfa2662b07f9b10fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e47587982546ff87e06be741d68b96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:54.094716 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-1b562adb-28e1-4827-a6bc-2c6e6d0a786e tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a723a102d34fbfa2662b07f9b10fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e47587982546ff87e06be741d68b96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:54.099369 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-1b562adb-28e1-4827-a6bc-2c6e6d0a786e tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a723a102d34fbfa2662b07f9b10fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e47587982546ff87e06be741d68b96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:54.103267 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-1b562adb-28e1-4827-a6bc-2c6e6d0a786e tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] 10.222.0.17 "GET /compute/v2.1/servers/5f175c94-dac6-4a61-a83b-1ebe44902d7c" status: 200 len: 1556 microversion: 2.21 time: 0.698600 Jul 23 21:28:54.105132 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1920/3748] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:28:53 2022] GET /compute/v2.1/servers/5f175c94-dac6-4a61-a83b-1ebe44902d7c => generated 1556 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:28:54.160092 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-392adb1b-0353-4af3-bb80-5629cd1c5408 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:54.161286 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-392adb1b-0353-4af3-bb80-5629cd1c5408 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: 694b9d2e-5137-4c2a-a656-2607e1ea912a] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:54.173731 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-392adb1b-0353-4af3-bb80-5629cd1c5408 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:54.176006 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-392adb1b-0353-4af3-bb80-5629cd1c5408 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:54.177031 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-392adb1b-0353-4af3-bb80-5629cd1c5408 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:54.179375 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-392adb1b-0353-4af3-bb80-5629cd1c5408 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:54.384837 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-735fa068-34af-42d6-8074-a2390813d841 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b566640463e43aa85ec96a1aa76d3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eef3db6d5f46c9882fbe98cb732263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:54.393461 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-735fa068-34af-42d6-8074-a2390813d841 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] 10.222.0.17 "GET /compute/v2.1/servers/f24f6136-4a47-44f1-9e79-fea1b1cbf057" status: 200 len: 1524 microversion: 2.1 time: 0.450206 Jul 23 21:28:54.394614 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1829/3749] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:28:53 2022] GET /compute/v2.1/servers/f24f6136-4a47-44f1-9e79-fea1b1cbf057 => generated 1524 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:28:54.399993 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d89556ea-7c0e-4612-b98c-884d7d9282d1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:54.400779 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d89556ea-7c0e-4612-b98c-884d7d9282d1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:54.407994 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d89556ea-7c0e-4612-b98c-884d7d9282d1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:54.408668 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d89556ea-7c0e-4612-b98c-884d7d9282d1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:54.410195 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d89556ea-7c0e-4612-b98c-884d7d9282d1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:54.410865 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d89556ea-7c0e-4612-b98c-884d7d9282d1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:54.567271 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d89556ea-7c0e-4612-b98c-884d7d9282d1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:54.598038 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d89556ea-7c0e-4612-b98c-884d7d9282d1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:54.603874 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d89556ea-7c0e-4612-b98c-884d7d9282d1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:54.605311 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d89556ea-7c0e-4612-b98c-884d7d9282d1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.209577 Jul 23 21:28:54.605920 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1830/3750] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:28:54 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:28:54.751108 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-faf3f2d8-127d-4611-8cda-13e4cf5173be tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:54.752377 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-faf3f2d8-127d-4611-8cda-13e4cf5173be tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] [instance: ee790a59-a432-4563-a3f9-ab25bb7876b9] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:54.768723 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-faf3f2d8-127d-4611-8cda-13e4cf5173be tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:54.769595 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-faf3f2d8-127d-4611-8cda-13e4cf5173be tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:54.770669 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-faf3f2d8-127d-4611-8cda-13e4cf5173be tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:54.772712 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-faf3f2d8-127d-4611-8cda-13e4cf5173be tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:54.902842 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-392adb1b-0353-4af3-bb80-5629cd1c5408 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:54.918053 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:28:54.928909 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-392adb1b-0353-4af3-bb80-5629cd1c5408 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/694b9d2e-5137-4c2a-a656-2607e1ea912a" status: 200 len: 1511 microversion: 2.1 time: 0.772139 Jul 23 21:28:54.932035 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1921/3751] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:28:54 2022] GET /compute/v2.1/servers/694b9d2e-5137-4c2a-a656-2607e1ea912a => generated 1511 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:28:55.066692 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-97b3a108-e5f6-4312-b66e-5d39c616363d req-324bf616-e40a-4497-96df-39792ee4bcfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f175c94-dac6-4a61-a83b-1ebe44902d7c", "name": "network-vif-deleted", "tag": "7ce9ca5a-5d97-4722-9294-105fb3d417e1"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:28:55.081707 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-97b3a108-e5f6-4312-b66e-5d39c616363d req-324bf616-e40a-4497-96df-39792ee4bcfd service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:55.084011 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-97b3a108-e5f6-4312-b66e-5d39c616363d req-324bf616-e40a-4497-96df-39792ee4bcfd service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:55.088678 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-faf3f2d8-127d-4611-8cda-13e4cf5173be tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '896f9085718446cd90ce445c09be4741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21695c8a68454c07bd8c466671076897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:55.106852 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-faf3f2d8-127d-4611-8cda-13e4cf5173be tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] 10.222.0.17 "GET /compute/v2.1/servers/ee790a59-a432-4563-a3f9-ab25bb7876b9" status: 200 len: 1219 microversion: 2.1 time: 0.361160 Jul 23 21:28:55.120140 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1831/3752] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:28:54 2022] GET /compute/v2.1/servers/ee790a59-a432-4563-a3f9-ab25bb7876b9 => generated 1219 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:28:55.130316 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8fd2196b-9047-47db-ae93-9d540501d6b2 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:55.131136 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8fd2196b-9047-47db-ae93-9d540501d6b2 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] [instance: 5f175c94-dac6-4a61-a83b-1ebe44902d7c] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:55.143721 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-97b3a108-e5f6-4312-b66e-5d39c616363d req-324bf616-e40a-4497-96df-39792ee4bcfd service nova] Creating event network-vif-deleted:7ce9ca5a-5d97-4722-9294-105fb3d417e1 for instance 5f175c94-dac6-4a61-a83b-1ebe44902d7c on nch1-master-1 Jul 23 21:28:55.155356 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8fd2196b-9047-47db-ae93-9d540501d6b2 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:55.156290 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8fd2196b-9047-47db-ae93-9d540501d6b2 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:55.159795 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8fd2196b-9047-47db-ae93-9d540501d6b2 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:55.160057 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-97b3a108-e5f6-4312-b66e-5d39c616363d req-324bf616-e40a-4497-96df-39792ee4bcfd service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101041 Jul 23 21:28:55.160640 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8fd2196b-9047-47db-ae93-9d540501d6b2 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:55.163289 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1922/3753] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:28:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:28:55.413904 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-fc5a3879-0993-49cd-a8a6-19ab8a8a278d tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:55.414625 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-fc5a3879-0993-49cd-a8a6-19ab8a8a278d tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] [instance: f24f6136-4a47-44f1-9e79-fea1b1cbf057] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:55.424148 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fc5a3879-0993-49cd-a8a6-19ab8a8a278d tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:55.424622 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fc5a3879-0993-49cd-a8a6-19ab8a8a278d tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:55.425403 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fc5a3879-0993-49cd-a8a6-19ab8a8a278d tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:55.425852 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fc5a3879-0993-49cd-a8a6-19ab8a8a278d tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:56.017608 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-fc5a3879-0993-49cd-a8a6-19ab8a8a278d tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b566640463e43aa85ec96a1aa76d3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eef3db6d5f46c9882fbe98cb732263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:56.035346 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-fc5a3879-0993-49cd-a8a6-19ab8a8a278d tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] 10.222.0.17 "GET /compute/v2.1/servers/f24f6136-4a47-44f1-9e79-fea1b1cbf057" status: 200 len: 1524 microversion: 2.1 time: 0.625363 Jul 23 21:28:56.038893 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1923/3754] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:28:55 2022] GET /compute/v2.1/servers/f24f6136-4a47-44f1-9e79-fea1b1cbf057 => generated 1524 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:28:56.050385 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-2597c2e1-f96d-4a85-815d-5ae20e9a82ad tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:56.070776 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-2597c2e1-f96d-4a85-815d-5ae20e9a82ad tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:56.092316 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2597c2e1-f96d-4a85-815d-5ae20e9a82ad tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:56.092944 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2597c2e1-f96d-4a85-815d-5ae20e9a82ad tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:56.093575 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2597c2e1-f96d-4a85-815d-5ae20e9a82ad tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:56.094055 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2597c2e1-f96d-4a85-815d-5ae20e9a82ad tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:56.250170 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8fd2196b-9047-47db-ae93-9d540501d6b2 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7a723a102d34fbfa2662b07f9b10fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e47587982546ff87e06be741d68b96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:56.267349 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8fd2196b-9047-47db-ae93-9d540501d6b2 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a7a723a102d34fbfa2662b07f9b10fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e47587982546ff87e06be741d68b96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:56.273103 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8fd2196b-9047-47db-ae93-9d540501d6b2 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a7a723a102d34fbfa2662b07f9b10fc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15e47587982546ff87e06be741d68b96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:56.279044 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8fd2196b-9047-47db-ae93-9d540501d6b2 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] 10.222.0.17 "GET /compute/v2.1/servers/5f175c94-dac6-4a61-a83b-1ebe44902d7c" status: 200 len: 1343 microversion: 2.21 time: 1.159462 Jul 23 21:28:56.281196 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1832/3755] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:28:55 2022] GET /compute/v2.1/servers/5f175c94-dac6-4a61-a83b-1ebe44902d7c => generated 1343 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:28:56.297057 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ccd38ef7-98e0-4e17-bc86-74ede5bd29bb tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:56.298517 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ccd38ef7-98e0-4e17-bc86-74ede5bd29bb tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: 694b9d2e-5137-4c2a-a656-2607e1ea912a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:56.317699 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ccd38ef7-98e0-4e17-bc86-74ede5bd29bb tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:56.319058 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ccd38ef7-98e0-4e17-bc86-74ede5bd29bb tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:56.319925 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ccd38ef7-98e0-4e17-bc86-74ede5bd29bb tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:56.323045 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ccd38ef7-98e0-4e17-bc86-74ede5bd29bb tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:56.342938 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-2597c2e1-f96d-4a85-815d-5ae20e9a82ad tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:56.362707 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-2597c2e1-f96d-4a85-815d-5ae20e9a82ad tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:56.364348 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-2597c2e1-f96d-4a85-815d-5ae20e9a82ad tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:56.373190 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-2597c2e1-f96d-4a85-815d-5ae20e9a82ad tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.332724 Jul 23 21:28:56.373711 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1924/3756] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:28:56 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:28:56.387737 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-dbd483fb-61ee-45f4-9770-ab2cf8fd7010 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:56.388359 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-dbd483fb-61ee-45f4-9770-ab2cf8fd7010 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] [instance: ee790a59-a432-4563-a3f9-ab25bb7876b9] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:56.404427 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-dbd483fb-61ee-45f4-9770-ab2cf8fd7010 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:56.404882 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-dbd483fb-61ee-45f4-9770-ab2cf8fd7010 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:56.410423 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-dbd483fb-61ee-45f4-9770-ab2cf8fd7010 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:56.411122 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-dbd483fb-61ee-45f4-9770-ab2cf8fd7010 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:56.610598 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-dbd483fb-61ee-45f4-9770-ab2cf8fd7010 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '896f9085718446cd90ce445c09be4741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21695c8a68454c07bd8c466671076897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:56.652014 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-dbd483fb-61ee-45f4-9770-ab2cf8fd7010 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] 10.222.0.17 "GET /compute/v2.1/servers/ee790a59-a432-4563-a3f9-ab25bb7876b9" status: 200 len: 1281 microversion: 2.1 time: 0.271794 Jul 23 21:28:56.663879 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1925/3757] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:28:56 2022] GET /compute/v2.1/servers/ee790a59-a432-4563-a3f9-ab25bb7876b9 => generated 1281 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:28:56.863467 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ccd38ef7-98e0-4e17-bc86-74ede5bd29bb tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:56.878649 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ccd38ef7-98e0-4e17-bc86-74ede5bd29bb tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/694b9d2e-5137-4c2a-a656-2607e1ea912a" status: 200 len: 1511 microversion: 2.1 time: 0.593308 Jul 23 21:28:56.879732 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1833/3758] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:28:56 2022] GET /compute/v2.1/servers/694b9d2e-5137-4c2a-a656-2607e1ea912a => generated 1511 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:28:57.057345 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-0fcad3c4-8b33-4d32-ab1c-8665882a2f53 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:57.058065 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-0fcad3c4-8b33-4d32-ab1c-8665882a2f53 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] [instance: f24f6136-4a47-44f1-9e79-fea1b1cbf057] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:57.070235 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0fcad3c4-8b33-4d32-ab1c-8665882a2f53 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:57.072878 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0fcad3c4-8b33-4d32-ab1c-8665882a2f53 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:57.073724 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0fcad3c4-8b33-4d32-ab1c-8665882a2f53 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:57.074216 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0fcad3c4-8b33-4d32-ab1c-8665882a2f53 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:57.300325 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9f6dd198-3453-43e0-a1e4-315d56820d35 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:57.300999 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-9f6dd198-3453-43e0-a1e4-315d56820d35 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] [instance: 5f175c94-dac6-4a61-a83b-1ebe44902d7c] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:57.320004 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9f6dd198-3453-43e0-a1e4-315d56820d35 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:57.320481 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9f6dd198-3453-43e0-a1e4-315d56820d35 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:57.326168 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9f6dd198-3453-43e0-a1e4-315d56820d35 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:57.327454 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9f6dd198-3453-43e0-a1e4-315d56820d35 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:57.365013 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-9f6dd198-3453-43e0-a1e4-315d56820d35 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] HTTP exception thrown: Instance 5f175c94-dac6-4a61-a83b-1ebe44902d7c could not be found. Jul 23 21:28:57.372343 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9f6dd198-3453-43e0-a1e4-315d56820d35 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Request method failure captured: Jul 23 21:28:57.372343 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/5f175c94-dac6-4a61-a83b-1ebe44902d7c HTTP/1.1 Jul 23 21:28:57.372343 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:28:57.372343 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:28:57.372343 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:28:57.372343 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:28:57.372343 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:28:57.372343 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:28:57.372343 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:28:57.372343 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:28:57.372343 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3Gf_gIN9lFSrVhzwJ3u3vdgZNJ1a685vmSHI00RXlSlQNo9HdiKRK8Trtmid6ed0tHsARyqkxY2BRTaCuSI6x_H22j1jeq2eitIyD1_x-_5G4oSz_iWEijDtxNW8M3D9Tq4m6RGV6CfvKHzd-jwbvGAEFyXOjXdMdT7Avwkuf5HCkqE Jul 23 21:28:57.372343 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:28:57.372343 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:28:57.372343 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:28:57.372343 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:28:57.372343 ncdv-master-1 devstack@n-api.service[131320]: X-Openstack-Nova-Api-Version: 2.21 Jul 23 21:28:57.372343 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:28:57.372343 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:28:57.372343 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 15e47587982546ff87e06be741d68b96 Jul 23 21:28:57.372343 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-InstanceActionsV221TestJSON-720664181 Jul 23 21:28:57.372343 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:28:57.372343 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:28:57.372343 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/15e47587982546ff87e06be741d68b96"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/15e47587982546ff87e06be741d68b96"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_15e47587982546ff87e06be741d68b96", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/15e47587982546ff87e06be741d68b96"}]}] Jul 23 21:28:57.372343 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-InstanceActionsV221TestJSON-720664181 Jul 23 21:28:57.372343 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 15e47587982546ff87e06be741d68b96 Jul 23 21:28:57.372343 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-720664181 Jul 23 21:28:57.372343 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-InstanceActionsV221TestJSON-720664181-project Jul 23 21:28:57.372343 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:28:57.372343 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:28:57.372343 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: a7a723a102d34fbfa2662b07f9b10fc8 Jul 23 21:28:57.372343 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-InstanceActionsV221TestJSON-720664181-project Jul 23 21:28:57.372343 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:28:57.372343 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance 5f175c94-dac6-4a61-a83b-1ebe44902d7c could not be found. Jul 23 21:28:57.372343 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '5f175c94-dac6-4a61-a83b-1ebe44902d7c'} Jul 23 21:28:57.372343 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:28:57.372343 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:28:57.372343 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:28:57.372343 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:28:57.372343 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:28:57.372343 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:28:57.372343 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:28:57.372343 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:28:57.372343 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:28:57.372343 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:28:57.372343 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f175c94-dac6-4a61-a83b-1ebe44902d7c could not be found. Jul 23 21:28:57.372343 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:28:57.372343 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:28:57.372343 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:28:57.372343 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:28:57.372343 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:28:57.372343 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:28:57.372343 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:28:57.372343 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:28:57.372343 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:28:57.372343 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:28:57.372343 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:28:57.372343 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:28:57.372343 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:28:57.372343 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:28:57.372343 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:28:57.372343 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:28:57.372343 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f175c94-dac6-4a61-a83b-1ebe44902d7c could not be found. Jul 23 21:28:57.372343 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:28:57.372343 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:28:57.379943 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:28:57.379943 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:28:57.379943 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:28:57.379943 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:28:57.379943 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:28:57.379943 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:28:57.379943 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f175c94-dac6-4a61-a83b-1ebe44902d7c could not be found. Jul 23 21:28:57.379943 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:28:57.386785 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9f6dd198-3453-43e0-a1e4-315d56820d35 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Returning 404 to user: Instance 5f175c94-dac6-4a61-a83b-1ebe44902d7c could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:28:57.388377 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9f6dd198-3453-43e0-a1e4-315d56820d35 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] 10.222.0.17 "GET /compute/v2.1/servers/5f175c94-dac6-4a61-a83b-1ebe44902d7c" status: 404 len: 111 microversion: 2.21 time: 0.093816 Jul 23 21:28:57.394413 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1834/3759] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:28:57 2022] GET /compute/v2.1/servers/5f175c94-dac6-4a61-a83b-1ebe44902d7c => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 23 21:28:57.408611 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5a6f414f-330f-4373-b904-6f746a2c9f5c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:57.412271 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5a6f414f-330f-4373-b904-6f746a2c9f5c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:57.422252 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-0fcad3c4-8b33-4d32-ab1c-8665882a2f53 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b566640463e43aa85ec96a1aa76d3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eef3db6d5f46c9882fbe98cb732263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:57.434257 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5a6f414f-330f-4373-b904-6f746a2c9f5c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:57.436760 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5a6f414f-330f-4373-b904-6f746a2c9f5c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:57.438945 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5a6f414f-330f-4373-b904-6f746a2c9f5c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:57.441854 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-0fcad3c4-8b33-4d32-ab1c-8665882a2f53 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] 10.222.0.17 "GET /compute/v2.1/servers/f24f6136-4a47-44f1-9e79-fea1b1cbf057" status: 200 len: 1524 microversion: 2.1 time: 0.389444 Jul 23 21:28:57.442457 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5a6f414f-330f-4373-b904-6f746a2c9f5c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:57.442681 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1926/3760] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:28:57 2022] GET /compute/v2.1/servers/f24f6136-4a47-44f1-9e79-fea1b1cbf057 => generated 1524 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:28:57.460329 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-215b5eb3-a06c-48e7-b534-6c533dffa4c3 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Calling method '.version_select at 0x7f0b47f1d3a0>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:57.463040 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-215b5eb3-a06c-48e7-b534-6c533dffa4c3 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] [instance: 5f175c94-dac6-4a61-a83b-1ebe44902d7c] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:57.482620 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-215b5eb3-a06c-48e7-b534-6c533dffa4c3 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:57.485842 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-215b5eb3-a06c-48e7-b534-6c533dffa4c3 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:57.493337 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-215b5eb3-a06c-48e7-b534-6c533dffa4c3 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:57.495174 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-215b5eb3-a06c-48e7-b534-6c533dffa4c3 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:57.635517 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-215b5eb3-a06c-48e7-b534-6c533dffa4c3 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] 10.222.0.17 "GET /compute/v2.1/servers/5f175c94-dac6-4a61-a83b-1ebe44902d7c/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.191547 Jul 23 21:28:57.646862 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1927/3761] 10.222.0.17 () {60 vars in 1336 bytes} [Sat Jul 23 21:28:57 2022] GET /compute/v2.1/servers/5f175c94-dac6-4a61-a83b-1ebe44902d7c/os-instance-actions => generated 611 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 23 21:28:57.669173 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-00e3da57-8020-4051-b07c-0f1abc538593 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:57.669687 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-00e3da57-8020-4051-b07c-0f1abc538593 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] [instance: 5f175c94-dac6-4a61-a83b-1ebe44902d7c] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:57.679718 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-00e3da57-8020-4051-b07c-0f1abc538593 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:57.680176 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-00e3da57-8020-4051-b07c-0f1abc538593 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:57.680980 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-00e3da57-8020-4051-b07c-0f1abc538593 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:57.685410 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-00e3da57-8020-4051-b07c-0f1abc538593 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:57.714704 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-00e3da57-8020-4051-b07c-0f1abc538593 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] HTTP exception thrown: Instance 5f175c94-dac6-4a61-a83b-1ebe44902d7c could not be found. Jul 23 21:28:57.720582 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-00e3da57-8020-4051-b07c-0f1abc538593 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Request method failure captured: Jul 23 21:28:57.720582 ncdv-master-1 devstack@n-api.service[131321]: request: DELETE /compute/v2.1/servers/5f175c94-dac6-4a61-a83b-1ebe44902d7c HTTP/1.1 Jul 23 21:28:57.720582 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:28:57.720582 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:28:57.720582 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:28:57.720582 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:28:57.720582 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:28:57.720582 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:28:57.720582 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:28:57.720582 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:28:57.720582 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3Gf_gIN9lFSrVhzwJ3u3vdgZNJ1a685vmSHI00RXlSlQNo9HdiKRK8Trtmid6ed0tHsARyqkxY2BRTaCuSI6x_H22j1jeq2eitIyD1_x-_5G4oSz_iWEijDtxNW8M3D9Tq4m6RGV6CfvKHzd-jwbvGAEFyXOjXdMdT7Avwkuf5HCkqE Jul 23 21:28:57.720582 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:28:57.720582 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:28:57.720582 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:28:57.720582 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:28:57.720582 ncdv-master-1 devstack@n-api.service[131321]: X-Openstack-Nova-Api-Version: 2.21 Jul 23 21:28:57.720582 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:28:57.720582 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:28:57.720582 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 15e47587982546ff87e06be741d68b96 Jul 23 21:28:57.720582 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-InstanceActionsV221TestJSON-720664181 Jul 23 21:28:57.720582 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:28:57.720582 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:28:57.720582 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/15e47587982546ff87e06be741d68b96"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/15e47587982546ff87e06be741d68b96"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_15e47587982546ff87e06be741d68b96", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/15e47587982546ff87e06be741d68b96"}]}] Jul 23 21:28:57.720582 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-InstanceActionsV221TestJSON-720664181 Jul 23 21:28:57.720582 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 15e47587982546ff87e06be741d68b96 Jul 23 21:28:57.720582 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-720664181 Jul 23 21:28:57.720582 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-InstanceActionsV221TestJSON-720664181-project Jul 23 21:28:57.720582 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:28:57.720582 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:28:57.720582 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: a7a723a102d34fbfa2662b07f9b10fc8 Jul 23 21:28:57.720582 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-InstanceActionsV221TestJSON-720664181-project Jul 23 21:28:57.720582 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:28:57.720582 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance 5f175c94-dac6-4a61-a83b-1ebe44902d7c could not be found. Jul 23 21:28:57.720582 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': '5f175c94-dac6-4a61-a83b-1ebe44902d7c'} Jul 23 21:28:57.720582 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:28:57.720582 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:28:57.720582 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:28:57.720582 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:28:57.720582 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:28:57.720582 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:28:57.720582 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:28:57.720582 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:28:57.720582 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:28:57.720582 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:28:57.720582 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f175c94-dac6-4a61-a83b-1ebe44902d7c could not be found. Jul 23 21:28:57.720582 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:28:57.720582 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:28:57.720582 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:28:57.720582 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:28:57.720582 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:28:57.720582 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:28:57.720582 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:28:57.720582 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:28:57.720582 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:28:57.720582 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:28:57.720582 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 23 21:28:57.720582 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 23 21:28:57.720582 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 23 21:28:57.720582 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 23 21:28:57.720582 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:28:57.720582 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:28:57.720582 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:28:57.720582 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:28:57.725714 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f175c94-dac6-4a61-a83b-1ebe44902d7c could not be found. Jul 23 21:28:57.725714 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:28:57.725714 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:28:57.725714 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:28:57.725714 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:28:57.725714 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:28:57.725714 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:28:57.725714 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:28:57.725714 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:28:57.725714 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f175c94-dac6-4a61-a83b-1ebe44902d7c could not be found. Jul 23 21:28:57.725714 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:28:57.731027 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-00e3da57-8020-4051-b07c-0f1abc538593 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Returning 404 to user: Instance 5f175c94-dac6-4a61-a83b-1ebe44902d7c could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:28:57.733615 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-00e3da57-8020-4051-b07c-0f1abc538593 tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] 10.222.0.17 "DELETE /compute/v2.1/servers/5f175c94-dac6-4a61-a83b-1ebe44902d7c" status: 404 len: 111 microversion: 2.21 time: 0.085486 Jul 23 21:28:57.737641 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1928/3762] 10.222.0.17 () {60 vars in 1279 bytes} [Sat Jul 23 21:28:57 2022] DELETE /compute/v2.1/servers/5f175c94-dac6-4a61-a83b-1ebe44902d7c => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 23 21:28:57.745422 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-5f6fe0e7-b9cd-4081-9e96-cccd0e9ba242 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:57.754844 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-5f6fe0e7-b9cd-4081-9e96-cccd0e9ba242 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] [instance: ee790a59-a432-4563-a3f9-ab25bb7876b9] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:57.771591 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5f6fe0e7-b9cd-4081-9e96-cccd0e9ba242 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:57.772335 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5f6fe0e7-b9cd-4081-9e96-cccd0e9ba242 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:57.774758 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5f6fe0e7-b9cd-4081-9e96-cccd0e9ba242 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:57.777963 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5f6fe0e7-b9cd-4081-9e96-cccd0e9ba242 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:57.887983 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5a6f414f-330f-4373-b904-6f746a2c9f5c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:57.903161 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5a6f414f-330f-4373-b904-6f746a2c9f5c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:57.904659 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5a6f414f-330f-4373-b904-6f746a2c9f5c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:57.905895 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5a6f414f-330f-4373-b904-6f746a2c9f5c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.508612 Jul 23 21:28:57.910962 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-5f6fe0e7-b9cd-4081-9e96-cccd0e9ba242 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '896f9085718446cd90ce445c09be4741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21695c8a68454c07bd8c466671076897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:57.919331 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-5f6fe0e7-b9cd-4081-9e96-cccd0e9ba242 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] 10.222.0.17 "GET /compute/v2.1/servers/ee790a59-a432-4563-a3f9-ab25bb7876b9" status: 200 len: 1281 microversion: 2.1 time: 0.180075 Jul 23 21:28:57.920391 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1929/3763] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:28:57 2022] GET /compute/v2.1/servers/ee790a59-a432-4563-a3f9-ab25bb7876b9 => generated 1281 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:28:57.935028 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1835/3764] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:28:57 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:28:57.939736 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-8c774924-e8e8-4fc6-b600-9f6bd8ee7bec tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:57.945185 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-8c774924-e8e8-4fc6-b600-9f6bd8ee7bec tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] [instance: 5f175c94-dac6-4a61-a83b-1ebe44902d7c] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:57.945568 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5774613a-df0f-477e-98b6-6b5d218135af tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:57.946426 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5774613a-df0f-477e-98b6-6b5d218135af tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: 694b9d2e-5137-4c2a-a656-2607e1ea912a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:57.958722 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8c774924-e8e8-4fc6-b600-9f6bd8ee7bec tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:57.960738 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5774613a-df0f-477e-98b6-6b5d218135af tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:57.961580 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8c774924-e8e8-4fc6-b600-9f6bd8ee7bec tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:57.962233 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5774613a-df0f-477e-98b6-6b5d218135af tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:57.963226 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8c774924-e8e8-4fc6-b600-9f6bd8ee7bec tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:57.966199 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5774613a-df0f-477e-98b6-6b5d218135af tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:57.966925 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8c774924-e8e8-4fc6-b600-9f6bd8ee7bec tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:57.968494 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5774613a-df0f-477e-98b6-6b5d218135af tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:58.020548 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-8c774924-e8e8-4fc6-b600-9f6bd8ee7bec tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] HTTP exception thrown: Instance 5f175c94-dac6-4a61-a83b-1ebe44902d7c could not be found. Jul 23 21:28:58.022180 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-8c774924-e8e8-4fc6-b600-9f6bd8ee7bec tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Request method failure captured: Jul 23 21:28:58.022180 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/servers/5f175c94-dac6-4a61-a83b-1ebe44902d7c HTTP/1.1 Jul 23 21:28:58.022180 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:28:58.022180 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:28:58.022180 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:28:58.022180 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:28:58.022180 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:28:58.022180 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:28:58.022180 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:28:58.022180 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:28:58.022180 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3Gf_gIN9lFSrVhzwJ3u3vdgZNJ1a685vmSHI00RXlSlQNo9HdiKRK8Trtmid6ed0tHsARyqkxY2BRTaCuSI6x_H22j1jeq2eitIyD1_x-_5G4oSz_iWEijDtxNW8M3D9Tq4m6RGV6CfvKHzd-jwbvGAEFyXOjXdMdT7Avwkuf5HCkqE Jul 23 21:28:58.022180 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:28:58.022180 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:28:58.022180 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:28:58.022180 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:28:58.022180 ncdv-master-1 devstack@n-api.service[131321]: X-Openstack-Nova-Api-Version: 2.21 Jul 23 21:28:58.022180 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:28:58.022180 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:28:58.022180 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 15e47587982546ff87e06be741d68b96 Jul 23 21:28:58.022180 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-InstanceActionsV221TestJSON-720664181 Jul 23 21:28:58.022180 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:28:58.022180 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:28:58.022180 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/15e47587982546ff87e06be741d68b96"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/15e47587982546ff87e06be741d68b96"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_15e47587982546ff87e06be741d68b96", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/15e47587982546ff87e06be741d68b96"}]}] Jul 23 21:28:58.022180 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-InstanceActionsV221TestJSON-720664181 Jul 23 21:28:58.022180 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 15e47587982546ff87e06be741d68b96 Jul 23 21:28:58.022180 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-720664181 Jul 23 21:28:58.022180 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-InstanceActionsV221TestJSON-720664181-project Jul 23 21:28:58.022180 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:28:58.022180 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:28:58.022180 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: a7a723a102d34fbfa2662b07f9b10fc8 Jul 23 21:28:58.022180 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-InstanceActionsV221TestJSON-720664181-project Jul 23 21:28:58.022180 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:28:58.022180 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance 5f175c94-dac6-4a61-a83b-1ebe44902d7c could not be found. Jul 23 21:28:58.022180 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': '5f175c94-dac6-4a61-a83b-1ebe44902d7c'} Jul 23 21:28:58.022180 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:28:58.022180 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:28:58.022180 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:28:58.022180 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:28:58.022180 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:28:58.022180 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:28:58.022180 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:28:58.022180 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:28:58.022180 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:28:58.022180 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:28:58.022180 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f175c94-dac6-4a61-a83b-1ebe44902d7c could not be found. Jul 23 21:28:58.022180 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:28:58.022180 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:28:58.022180 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:28:58.022180 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:28:58.022180 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:28:58.022180 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:28:58.022180 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:28:58.022180 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:28:58.022180 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:28:58.022180 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:28:58.022180 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:28:58.022180 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:28:58.022180 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:28:58.022180 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:28:58.022180 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:28:58.022180 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:28:58.022180 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f175c94-dac6-4a61-a83b-1ebe44902d7c could not be found. Jul 23 21:28:58.022180 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:28:58.022180 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:28:58.027530 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:28:58.027530 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:28:58.027530 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:28:58.027530 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:28:58.027530 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:28:58.027530 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:28:58.027530 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f175c94-dac6-4a61-a83b-1ebe44902d7c could not be found. Jul 23 21:28:58.027530 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:28:58.027530 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-8c774924-e8e8-4fc6-b600-9f6bd8ee7bec tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] Returning 404 to user: Instance 5f175c94-dac6-4a61-a83b-1ebe44902d7c could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:28:58.027530 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-8c774924-e8e8-4fc6-b600-9f6bd8ee7bec tempest-InstanceActionsV221TestJSON-720664181 tempest-InstanceActionsV221TestJSON-720664181-project] 10.222.0.17 "GET /compute/v2.1/servers/5f175c94-dac6-4a61-a83b-1ebe44902d7c" status: 404 len: 111 microversion: 2.21 time: 0.090007 Jul 23 21:28:58.032597 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1930/3765] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:28:57 2022] GET /compute/v2.1/servers/5f175c94-dac6-4a61-a83b-1ebe44902d7c => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 23 21:28:58.466333 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-798ff30d-16ea-42a8-8bcf-2f5dc0fa8ab6 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:58.467742 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-798ff30d-16ea-42a8-8bcf-2f5dc0fa8ab6 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] [instance: f24f6136-4a47-44f1-9e79-fea1b1cbf057] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:58.480147 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-798ff30d-16ea-42a8-8bcf-2f5dc0fa8ab6 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:58.485980 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-798ff30d-16ea-42a8-8bcf-2f5dc0fa8ab6 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:58.487956 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-798ff30d-16ea-42a8-8bcf-2f5dc0fa8ab6 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:58.491001 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-798ff30d-16ea-42a8-8bcf-2f5dc0fa8ab6 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:58.707492 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5774613a-df0f-477e-98b6-6b5d218135af tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:58.731843 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5774613a-df0f-477e-98b6-6b5d218135af tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/694b9d2e-5137-4c2a-a656-2607e1ea912a" status: 200 len: 1511 microversion: 2.1 time: 0.795170 Jul 23 21:28:58.732465 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1836/3766] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:28:57 2022] GET /compute/v2.1/servers/694b9d2e-5137-4c2a-a656-2607e1ea912a => generated 1511 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:28:58.940757 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-331da07f-41ea-4366-9dc9-a6cb0a683b4e tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:58.941380 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-331da07f-41ea-4366-9dc9-a6cb0a683b4e tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] [instance: ee790a59-a432-4563-a3f9-ab25bb7876b9] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:58.954719 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-331da07f-41ea-4366-9dc9-a6cb0a683b4e tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:58.955179 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-331da07f-41ea-4366-9dc9-a6cb0a683b4e tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:58.965494 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-331da07f-41ea-4366-9dc9-a6cb0a683b4e tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:58.966137 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-331da07f-41ea-4366-9dc9-a6cb0a683b4e tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:59.151632 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-798ff30d-16ea-42a8-8bcf-2f5dc0fa8ab6 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b566640463e43aa85ec96a1aa76d3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eef3db6d5f46c9882fbe98cb732263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:59.166170 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-798ff30d-16ea-42a8-8bcf-2f5dc0fa8ab6 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] 10.222.0.17 "GET /compute/v2.1/servers/f24f6136-4a47-44f1-9e79-fea1b1cbf057" status: 200 len: 1524 microversion: 2.1 time: 0.710334 Jul 23 21:28:59.169439 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1931/3767] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:28:58 2022] GET /compute/v2.1/servers/f24f6136-4a47-44f1-9e79-fea1b1cbf057 => generated 1524 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:28:59.183515 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-26092af8-a0d0-45a1-b48e-66265aaa0db9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:59.185251 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-26092af8-a0d0-45a1-b48e-66265aaa0db9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:59.200244 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-26092af8-a0d0-45a1-b48e-66265aaa0db9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:59.202511 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-26092af8-a0d0-45a1-b48e-66265aaa0db9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:59.205503 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-26092af8-a0d0-45a1-b48e-66265aaa0db9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:59.205986 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-26092af8-a0d0-45a1-b48e-66265aaa0db9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:59.487863 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-26092af8-a0d0-45a1-b48e-66265aaa0db9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:59.501354 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-26092af8-a0d0-45a1-b48e-66265aaa0db9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:59.508553 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-26092af8-a0d0-45a1-b48e-66265aaa0db9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:59.511849 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-26092af8-a0d0-45a1-b48e-66265aaa0db9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.340146 Jul 23 21:28:59.518370 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1932/3768] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:28:59 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:28:59.597972 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-331da07f-41ea-4366-9dc9-a6cb0a683b4e tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '896f9085718446cd90ce445c09be4741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21695c8a68454c07bd8c466671076897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:28:59.610540 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-331da07f-41ea-4366-9dc9-a6cb0a683b4e tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] 10.222.0.17 "GET /compute/v2.1/servers/ee790a59-a432-4563-a3f9-ab25bb7876b9" status: 200 len: 1323 microversion: 2.1 time: 0.677049 Jul 23 21:28:59.613318 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1837/3769] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:28:58 2022] GET /compute/v2.1/servers/ee790a59-a432-4563-a3f9-ab25bb7876b9 => generated 1323 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:28:59.749337 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ba926f6b-7d12-4d11-8a24-38e3192633a0 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:28:59.750570 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-ba926f6b-7d12-4d11-8a24-38e3192633a0 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: 694b9d2e-5137-4c2a-a656-2607e1ea912a] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:28:59.769286 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ba926f6b-7d12-4d11-8a24-38e3192633a0 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:59.770207 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ba926f6b-7d12-4d11-8a24-38e3192633a0 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:28:59.775158 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ba926f6b-7d12-4d11-8a24-38e3192633a0 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:28:59.775859 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ba926f6b-7d12-4d11-8a24-38e3192633a0 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:00.156978 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ba926f6b-7d12-4d11-8a24-38e3192633a0 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:00.167838 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-ba926f6b-7d12-4d11-8a24-38e3192633a0 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/694b9d2e-5137-4c2a-a656-2607e1ea912a" status: 200 len: 1511 microversion: 2.1 time: 0.422857 Jul 23 21:29:00.177993 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1933/3770] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:28:59 2022] GET /compute/v2.1/servers/694b9d2e-5137-4c2a-a656-2607e1ea912a => generated 1511 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:29:00.188140 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-57155fd3-bb61-4b76-9f59-9a96520e4664 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:00.189421 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-57155fd3-bb61-4b76-9f59-9a96520e4664 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] [instance: f24f6136-4a47-44f1-9e79-fea1b1cbf057] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:00.199456 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-57155fd3-bb61-4b76-9f59-9a96520e4664 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:00.200226 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-57155fd3-bb61-4b76-9f59-9a96520e4664 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:00.201177 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-57155fd3-bb61-4b76-9f59-9a96520e4664 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:00.201874 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-57155fd3-bb61-4b76-9f59-9a96520e4664 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:00.537174 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ddde5416-a499-412d-8d71-c3f1dd77dbf0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:00.537970 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-ddde5416-a499-412d-8d71-c3f1dd77dbf0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:00.551661 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ddde5416-a499-412d-8d71-c3f1dd77dbf0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:00.553290 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ddde5416-a499-412d-8d71-c3f1dd77dbf0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:00.554258 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ddde5416-a499-412d-8d71-c3f1dd77dbf0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:00.556268 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ddde5416-a499-412d-8d71-c3f1dd77dbf0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:00.588461 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-57155fd3-bb61-4b76-9f59-9a96520e4664 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b566640463e43aa85ec96a1aa76d3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eef3db6d5f46c9882fbe98cb732263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:00.605447 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-57155fd3-bb61-4b76-9f59-9a96520e4664 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] 10.222.0.17 "GET /compute/v2.1/servers/f24f6136-4a47-44f1-9e79-fea1b1cbf057" status: 200 len: 1524 microversion: 2.1 time: 0.423147 Jul 23 21:29:00.610510 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1838/3771] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:29:00 2022] GET /compute/v2.1/servers/f24f6136-4a47-44f1-9e79-fea1b1cbf057 => generated 1524 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:29:00.650912 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2afc3501-49d5-401c-9a15-d97bc419b621 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:00.652242 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-2afc3501-49d5-401c-9a15-d97bc419b621 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] [instance: ee790a59-a432-4563-a3f9-ab25bb7876b9] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:00.676833 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2afc3501-49d5-401c-9a15-d97bc419b621 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:00.678708 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2afc3501-49d5-401c-9a15-d97bc419b621 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:00.682429 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2afc3501-49d5-401c-9a15-d97bc419b621 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:00.683986 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2afc3501-49d5-401c-9a15-d97bc419b621 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:00.889040 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ddde5416-a499-412d-8d71-c3f1dd77dbf0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:00.899126 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ddde5416-a499-412d-8d71-c3f1dd77dbf0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:00.901009 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ddde5416-a499-412d-8d71-c3f1dd77dbf0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:00.902271 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-ddde5416-a499-412d-8d71-c3f1dd77dbf0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.369917 Jul 23 21:29:00.902833 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1934/3772] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:29:00 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:29:01.167942 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-2afc3501-49d5-401c-9a15-d97bc419b621 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '896f9085718446cd90ce445c09be4741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21695c8a68454c07bd8c466671076897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:01.184684 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c81cd4ab-e9cb-4211-9bee-25e3d31893a7 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:01.185572 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-c81cd4ab-e9cb-4211-9bee-25e3d31893a7 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: 694b9d2e-5137-4c2a-a656-2607e1ea912a] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:01.188464 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2afc3501-49d5-401c-9a15-d97bc419b621 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] 10.222.0.17 "GET /compute/v2.1/servers/ee790a59-a432-4563-a3f9-ab25bb7876b9" status: 200 len: 1323 microversion: 2.1 time: 0.559596 Jul 23 21:29:01.190807 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1839/3773] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:29:00 2022] GET /compute/v2.1/servers/ee790a59-a432-4563-a3f9-ab25bb7876b9 => generated 1323 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:29:01.203829 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c81cd4ab-e9cb-4211-9bee-25e3d31893a7 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:01.204787 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c81cd4ab-e9cb-4211-9bee-25e3d31893a7 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:01.209986 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c81cd4ab-e9cb-4211-9bee-25e3d31893a7 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:01.209986 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c81cd4ab-e9cb-4211-9bee-25e3d31893a7 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:01.530873 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c81cd4ab-e9cb-4211-9bee-25e3d31893a7 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:01.537003 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=100 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:01.543999 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-c81cd4ab-e9cb-4211-9bee-25e3d31893a7 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/694b9d2e-5137-4c2a-a656-2607e1ea912a" status: 200 len: 1488 microversion: 2.1 time: 0.363131 Jul 23 21:29:01.558223 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1935/3774] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:29:01 2022] GET /compute/v2.1/servers/694b9d2e-5137-4c2a-a656-2607e1ea912a => generated 1488 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:29:01.570191 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-fc50ca40-41e2-42d1-9c52-c499a1ec9f48 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:01.570902 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-fc50ca40-41e2-42d1-9c52-c499a1ec9f48 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: 694b9d2e-5137-4c2a-a656-2607e1ea912a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:01.583376 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fc50ca40-41e2-42d1-9c52-c499a1ec9f48 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:01.584087 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fc50ca40-41e2-42d1-9c52-c499a1ec9f48 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:01.586006 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fc50ca40-41e2-42d1-9c52-c499a1ec9f48 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:01.586673 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fc50ca40-41e2-42d1-9c52-c499a1ec9f48 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:01.620153 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-fc50ca40-41e2-42d1-9c52-c499a1ec9f48 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: 694b9d2e-5137-4c2a-a656-2607e1ea912a] Going to try to terminate instance {{(pid=131320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:29:01.630209 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-7cf4be9f-63dc-4acb-9d74-5599b8ffbd17 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:01.631374 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-7cf4be9f-63dc-4acb-9d74-5599b8ffbd17 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] [instance: f24f6136-4a47-44f1-9e79-fea1b1cbf057] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:01.648366 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7cf4be9f-63dc-4acb-9d74-5599b8ffbd17 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:01.648828 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7cf4be9f-63dc-4acb-9d74-5599b8ffbd17 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:01.649631 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7cf4be9f-63dc-4acb-9d74-5599b8ffbd17 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:01.650560 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7cf4be9f-63dc-4acb-9d74-5599b8ffbd17 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:01.730226 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-fc50ca40-41e2-42d1-9c52-c499a1ec9f48 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "DELETE /compute/v2.1/servers/694b9d2e-5137-4c2a-a656-2607e1ea912a" status: 204 len: 0 microversion: 2.1 time: 0.168290 Jul 23 21:29:01.731155 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1840/3775] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:29:01 2022] DELETE /compute/v2.1/servers/694b9d2e-5137-4c2a-a656-2607e1ea912a => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:29:01.745697 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-aa9c19f9-5bd9-4fd2-9770-a0b44674ee8f tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:01.747719 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-aa9c19f9-5bd9-4fd2-9770-a0b44674ee8f tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: 694b9d2e-5137-4c2a-a656-2607e1ea912a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:01.756595 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-aa9c19f9-5bd9-4fd2-9770-a0b44674ee8f tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:01.757445 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-aa9c19f9-5bd9-4fd2-9770-a0b44674ee8f tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:01.758674 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-aa9c19f9-5bd9-4fd2-9770-a0b44674ee8f tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:01.760532 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-aa9c19f9-5bd9-4fd2-9770-a0b44674ee8f tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:02.049072 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-7cf4be9f-63dc-4acb-9d74-5599b8ffbd17 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b566640463e43aa85ec96a1aa76d3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eef3db6d5f46c9882fbe98cb732263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:02.069530 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-7cf4be9f-63dc-4acb-9d74-5599b8ffbd17 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] 10.222.0.17 "GET /compute/v2.1/servers/f24f6136-4a47-44f1-9e79-fea1b1cbf057" status: 200 len: 1524 microversion: 2.1 time: 0.443198 Jul 23 21:29:02.071134 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1936/3776] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:29:01 2022] GET /compute/v2.1/servers/f24f6136-4a47-44f1-9e79-fea1b1cbf057 => generated 1524 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:29:02.092572 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d8dd14ec-3b55-4831-bcb0-5dbb974338cf tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:02.096346 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-d8dd14ec-3b55-4831-bcb0-5dbb974338cf tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:02.110804 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d8dd14ec-3b55-4831-bcb0-5dbb974338cf tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:02.114452 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d8dd14ec-3b55-4831-bcb0-5dbb974338cf tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:02.122857 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d8dd14ec-3b55-4831-bcb0-5dbb974338cf tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:02.122857 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d8dd14ec-3b55-4831-bcb0-5dbb974338cf tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:02.231214 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-aa9c19f9-5bd9-4fd2-9770-a0b44674ee8f tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:02.243514 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-aa9c19f9-5bd9-4fd2-9770-a0b44674ee8f tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/694b9d2e-5137-4c2a-a656-2607e1ea912a" status: 200 len: 1494 microversion: 2.1 time: 0.502858 Jul 23 21:29:02.245391 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1841/3777] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:29:01 2022] GET /compute/v2.1/servers/694b9d2e-5137-4c2a-a656-2607e1ea912a => generated 1494 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:29:02.257144 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-25641821-24be-44b9-8296-399d876fb282 req-3387f034-bcee-4eed-b2dd-8596528959ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee790a59-a432-4563-a3f9-ab25bb7876b9", "tag": "f61f4673-2052-484f-bcf5-fa6c5e329c06"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:29:02.289637 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-25641821-24be-44b9-8296-399d876fb282 req-3387f034-bcee-4eed-b2dd-8596528959ca service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:02.293094 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-25641821-24be-44b9-8296-399d876fb282 req-3387f034-bcee-4eed-b2dd-8596528959ca service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:02.293814 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-d8dd14ec-3b55-4831-bcb0-5dbb974338cf tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:02.308210 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-d8dd14ec-3b55-4831-bcb0-5dbb974338cf tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:02.327652 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-d8dd14ec-3b55-4831-bcb0-5dbb974338cf tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:02.327652 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-d8dd14ec-3b55-4831-bcb0-5dbb974338cf tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.251867 Jul 23 21:29:02.327652 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1937/3778] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:29:02 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:29:02.332169 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-25641821-24be-44b9-8296-399d876fb282 req-3387f034-bcee-4eed-b2dd-8596528959ca service nova] Creating event network-changed:f61f4673-2052-484f-bcf5-fa6c5e329c06 for instance ee790a59-a432-4563-a3f9-ab25bb7876b9 on nch2-master-1 Jul 23 21:29:02.337267 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-3e1f71bf-e45a-4641-9d8f-bb3ab823bf20 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:02.340321 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-25641821-24be-44b9-8296-399d876fb282 req-3387f034-bcee-4eed-b2dd-8596528959ca service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093203 Jul 23 21:29:02.341076 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1842/3779] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:29:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:29:02.344945 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-3e1f71bf-e45a-4641-9d8f-bb3ab823bf20 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] [instance: ee790a59-a432-4563-a3f9-ab25bb7876b9] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:02.359955 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3e1f71bf-e45a-4641-9d8f-bb3ab823bf20 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:02.360410 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3e1f71bf-e45a-4641-9d8f-bb3ab823bf20 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:02.363423 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3e1f71bf-e45a-4641-9d8f-bb3ab823bf20 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:02.363880 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3e1f71bf-e45a-4641-9d8f-bb3ab823bf20 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:02.708070 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-3e1f71bf-e45a-4641-9d8f-bb3ab823bf20 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '896f9085718446cd90ce445c09be4741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21695c8a68454c07bd8c466671076897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:02.729833 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-3e1f71bf-e45a-4641-9d8f-bb3ab823bf20 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] 10.222.0.17 "GET /compute/v2.1/servers/ee790a59-a432-4563-a3f9-ab25bb7876b9" status: 200 len: 1323 microversion: 2.1 time: 0.401796 Jul 23 21:29:02.742245 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1938/3780] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:29:02 2022] GET /compute/v2.1/servers/ee790a59-a432-4563-a3f9-ab25bb7876b9 => generated 1323 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:29:03.048168 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3daedd9f-2591-4265-a4c4-d7b397cc4ab3 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-803541082", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "networks": [{"uuid": "63d253f9-5d83-4f00-8bc3-28f418cf7611"}]}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:29:03.087410 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-60343dbc-956b-4dbf-8d3a-47a2b85432cb tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:03.088042 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-60343dbc-956b-4dbf-8d3a-47a2b85432cb tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] [instance: f24f6136-4a47-44f1-9e79-fea1b1cbf057] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:03.098035 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-60343dbc-956b-4dbf-8d3a-47a2b85432cb tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:03.098499 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-60343dbc-956b-4dbf-8d3a-47a2b85432cb tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:03.113579 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-60343dbc-956b-4dbf-8d3a-47a2b85432cb tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:03.114747 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-60343dbc-956b-4dbf-8d3a-47a2b85432cb tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:03.131283 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:03.178861 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-3daedd9f-2591-4265-a4c4-d7b397cc4ab3 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] validate_networks() for [('63d253f9-5d83-4f00-8bc3-28f418cf7611', None, None, None, None, None)] {{(pid=131320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:29:03.726760 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=8 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:03.767055 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-60343dbc-956b-4dbf-8d3a-47a2b85432cb tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b566640463e43aa85ec96a1aa76d3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eef3db6d5f46c9882fbe98cb732263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:03.795922 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-60343dbc-956b-4dbf-8d3a-47a2b85432cb tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] 10.222.0.17 "GET /compute/v2.1/servers/f24f6136-4a47-44f1-9e79-fea1b1cbf057" status: 200 len: 1524 microversion: 2.1 time: 0.712979 Jul 23 21:29:03.807416 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1939/3781] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:29:03 2022] GET /compute/v2.1/servers/f24f6136-4a47-44f1-9e79-fea1b1cbf057 => generated 1524 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:29:03.851627 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-bf0b7148-801a-4af1-86cb-f9013617230a tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:03.853780 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-bf0b7148-801a-4af1-86cb-f9013617230a tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: 694b9d2e-5137-4c2a-a656-2607e1ea912a] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:03.872216 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bf0b7148-801a-4af1-86cb-f9013617230a tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:03.872783 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bf0b7148-801a-4af1-86cb-f9013617230a tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:03.874718 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bf0b7148-801a-4af1-86cb-f9013617230a tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:03.875456 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bf0b7148-801a-4af1-86cb-f9013617230a tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:04.295314 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-bf0b7148-801a-4af1-86cb-f9013617230a tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:04.308146 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-bf0b7148-801a-4af1-86cb-f9013617230a tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/694b9d2e-5137-4c2a-a656-2607e1ea912a" status: 200 len: 1494 microversion: 2.1 time: 0.505644 Jul 23 21:29:04.308875 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1940/3782] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:29:03 2022] GET /compute/v2.1/servers/694b9d2e-5137-4c2a-a656-2607e1ea912a => generated 1494 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:29:04.327918 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-963a5091-e80c-45e1-b70f-2bad7f155bdd tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:04.328944 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-963a5091-e80c-45e1-b70f-2bad7f155bdd tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:04.351757 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-963a5091-e80c-45e1-b70f-2bad7f155bdd tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:04.354268 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-963a5091-e80c-45e1-b70f-2bad7f155bdd tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:04.356356 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-963a5091-e80c-45e1-b70f-2bad7f155bdd tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:04.357113 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-963a5091-e80c-45e1-b70f-2bad7f155bdd tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:04.536586 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-963a5091-e80c-45e1-b70f-2bad7f155bdd tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:04.552618 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-963a5091-e80c-45e1-b70f-2bad7f155bdd tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:04.558602 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-963a5091-e80c-45e1-b70f-2bad7f155bdd tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:04.560797 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-963a5091-e80c-45e1-b70f-2bad7f155bdd tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.247190 Jul 23 21:29:04.561825 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1941/3783] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:29:04 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:29:04.568092 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-8355a2dd-3314-4e0c-b498-2e4e5e356278 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:04.569087 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-8355a2dd-3314-4e0c-b498-2e4e5e356278 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] [instance: ee790a59-a432-4563-a3f9-ab25bb7876b9] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:04.584948 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8355a2dd-3314-4e0c-b498-2e4e5e356278 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:04.586701 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8355a2dd-3314-4e0c-b498-2e4e5e356278 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:04.587744 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8355a2dd-3314-4e0c-b498-2e4e5e356278 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:04.588429 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8355a2dd-3314-4e0c-b498-2e4e5e356278 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:04.664919 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-3daedd9f-2591-4265-a4c4-d7b397cc4ab3 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:29:04.665570 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-3daedd9f-2591-4265-a4c4-d7b397cc4ab3 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:29:04.666198 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-3daedd9f-2591-4265-a4c4-d7b397cc4ab3 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:29:04.666678 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-3daedd9f-2591-4265-a4c4-d7b397cc4ab3 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:29:04.667160 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-3daedd9f-2591-4265-a4c4-d7b397cc4ab3 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:29:04.698520 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3daedd9f-2591-4265-a4c4-d7b397cc4ab3 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:04.702734 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3daedd9f-2591-4265-a4c4-d7b397cc4ab3 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:04.706601 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3daedd9f-2591-4265-a4c4-d7b397cc4ab3 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:04.709275 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3daedd9f-2591-4265-a4c4-d7b397cc4ab3 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:04.784482 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-3daedd9f-2591-4265-a4c4-d7b397cc4ab3 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Getting quotas for project 1890022bd460485dae0ea94b152a6746. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:29:04.812855 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-3daedd9f-2591-4265-a4c4-d7b397cc4ab3 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Getting quotas for user 5efda1c40f494592bf1e6af1add120f3 and project 1890022bd460485dae0ea94b152a6746. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:29:04.829357 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-3daedd9f-2591-4265-a4c4-d7b397cc4ab3 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Going to run 1 instances... {{(pid=131320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:29:04.832550 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-3daedd9f-2591-4265-a4c4-d7b397cc4ab3 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: 274ce0ec-f78b-41cd-8538-2708c52c1c55] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:29:04.976153 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-3daedd9f-2591-4265-a4c4-d7b397cc4ab3 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.357080 Jul 23 21:29:04.976822 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1843/3784] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:29:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 2359 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 23 21:29:05.019302 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-20bc2707-d9a3-4195-a688-e9027a6744aa req-6b209e80-6dae-497b-b2f8-87d8d8ffcd61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "694b9d2e-5137-4c2a-a656-2607e1ea912a", "name": "network-vif-deleted", "tag": "15c6d187-24f9-41fc-a731-bb0fbef03740"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:29:05.040008 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-20bc2707-d9a3-4195-a688-e9027a6744aa req-6b209e80-6dae-497b-b2f8-87d8d8ffcd61 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:05.040583 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-20bc2707-d9a3-4195-a688-e9027a6744aa req-6b209e80-6dae-497b-b2f8-87d8d8ffcd61 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:05.065703 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-20bc2707-d9a3-4195-a688-e9027a6744aa req-6b209e80-6dae-497b-b2f8-87d8d8ffcd61 service nova] Creating event network-vif-deleted:15c6d187-24f9-41fc-a731-bb0fbef03740 for instance 694b9d2e-5137-4c2a-a656-2607e1ea912a on nch1-master-1 Jul 23 21:29:05.078236 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-20bc2707-d9a3-4195-a688-e9027a6744aa req-6b209e80-6dae-497b-b2f8-87d8d8ffcd61 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079195 Jul 23 21:29:05.079637 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1844/3785] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:29:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:29:05.089805 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-338224ab-ed98-4dbe-887a-bdbe3ad8aaf2 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:05.096220 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-338224ab-ed98-4dbe-887a-bdbe3ad8aaf2 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] [instance: f24f6136-4a47-44f1-9e79-fea1b1cbf057] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:05.110475 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-338224ab-ed98-4dbe-887a-bdbe3ad8aaf2 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:05.114185 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-338224ab-ed98-4dbe-887a-bdbe3ad8aaf2 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:05.123049 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-338224ab-ed98-4dbe-887a-bdbe3ad8aaf2 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:05.127244 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-338224ab-ed98-4dbe-887a-bdbe3ad8aaf2 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:05.139965 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-8355a2dd-3314-4e0c-b498-2e4e5e356278 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '896f9085718446cd90ce445c09be4741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21695c8a68454c07bd8c466671076897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:05.151907 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-8355a2dd-3314-4e0c-b498-2e4e5e356278 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] 10.222.0.17 "GET /compute/v2.1/servers/ee790a59-a432-4563-a3f9-ab25bb7876b9" status: 200 len: 1323 microversion: 2.1 time: 0.588355 Jul 23 21:29:05.159885 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1942/3786] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:29:04 2022] GET /compute/v2.1/servers/ee790a59-a432-4563-a3f9-ab25bb7876b9 => generated 1323 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:29:05.171994 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-b0b0853c-05ea-46df-8eea-724d9cf16a6c tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:05.178819 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-b0b0853c-05ea-46df-8eea-724d9cf16a6c tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: 274ce0ec-f78b-41cd-8538-2708c52c1c55] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:05.325840 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-b0b0853c-05ea-46df-8eea-724d9cf16a6c tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:05.337059 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-b0b0853c-05ea-46df-8eea-724d9cf16a6c tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/274ce0ec-f78b-41cd-8538-2708c52c1c55" status: 200 len: 1192 microversion: 2.1 time: 0.175883 Jul 23 21:29:05.358786 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1943/3787] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:29:05 2022] GET /compute/v2.1/servers/274ce0ec-f78b-41cd-8538-2708c52c1c55 => generated 1192 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:29:05.363083 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-5d0a931c-62c1-4887-afc8-ab1f50eead93 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:05.363659 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-5d0a931c-62c1-4887-afc8-ab1f50eead93 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: 694b9d2e-5137-4c2a-a656-2607e1ea912a] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:05.396180 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5d0a931c-62c1-4887-afc8-ab1f50eead93 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:05.396657 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5d0a931c-62c1-4887-afc8-ab1f50eead93 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:05.397667 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5d0a931c-62c1-4887-afc8-ab1f50eead93 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:05.398352 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5d0a931c-62c1-4887-afc8-ab1f50eead93 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:05.515745 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5d0a931c-62c1-4887-afc8-ab1f50eead93 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:05.519244 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5d0a931c-62c1-4887-afc8-ab1f50eead93 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:05.520050 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.objects.instance [None req-5d0a931c-62c1-4887-afc8-ab1f50eead93 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lazy-loading 'fault' on Instance uuid 694b9d2e-5137-4c2a-a656-2607e1ea912a {{(pid=131321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:29:05.632217 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-5d0a931c-62c1-4887-afc8-ab1f50eead93 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:05.642185 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-5d0a931c-62c1-4887-afc8-ab1f50eead93 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/694b9d2e-5137-4c2a-a656-2607e1ea912a" status: 200 len: 1304 microversion: 2.1 time: 0.290539 Jul 23 21:29:05.655502 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1944/3788] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:29:05 2022] GET /compute/v2.1/servers/694b9d2e-5137-4c2a-a656-2607e1ea912a => generated 1304 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:29:05.664584 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-2e0b14ed-6230-4e15-9aab-1781a90d283a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:05.669005 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-2e0b14ed-6230-4e15-9aab-1781a90d283a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:05.691570 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2e0b14ed-6230-4e15-9aab-1781a90d283a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:05.693957 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2e0b14ed-6230-4e15-9aab-1781a90d283a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:05.697564 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2e0b14ed-6230-4e15-9aab-1781a90d283a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:05.698431 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2e0b14ed-6230-4e15-9aab-1781a90d283a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:05.790943 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-2e0b14ed-6230-4e15-9aab-1781a90d283a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:05.806883 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-2e0b14ed-6230-4e15-9aab-1781a90d283a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:05.828428 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-2e0b14ed-6230-4e15-9aab-1781a90d283a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:05.831274 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-2e0b14ed-6230-4e15-9aab-1781a90d283a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.173918 Jul 23 21:29:05.835397 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1945/3789] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:29:05 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:29:06.177177 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-743cddf7-f83b-4115-a87f-f2ad0d6f4e62 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:06.178690 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-743cddf7-f83b-4115-a87f-f2ad0d6f4e62 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] [instance: ee790a59-a432-4563-a3f9-ab25bb7876b9] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:06.187760 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-743cddf7-f83b-4115-a87f-f2ad0d6f4e62 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:06.188659 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-743cddf7-f83b-4115-a87f-f2ad0d6f4e62 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:06.190380 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-743cddf7-f83b-4115-a87f-f2ad0d6f4e62 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:06.191203 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-743cddf7-f83b-4115-a87f-f2ad0d6f4e62 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:06.335735 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-338224ab-ed98-4dbe-887a-bdbe3ad8aaf2 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b566640463e43aa85ec96a1aa76d3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eef3db6d5f46c9882fbe98cb732263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:06.354403 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-338224ab-ed98-4dbe-887a-bdbe3ad8aaf2 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] 10.222.0.17 "GET /compute/v2.1/servers/f24f6136-4a47-44f1-9e79-fea1b1cbf057" status: 200 len: 1524 microversion: 2.1 time: 1.273221 Jul 23 21:29:06.365319 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1845/3790] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:29:05 2022] GET /compute/v2.1/servers/f24f6136-4a47-44f1-9e79-fea1b1cbf057 => generated 1524 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:29:06.371898 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e4911690-2448-4c7d-9e31-f398cd31de63 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:06.388203 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e4911690-2448-4c7d-9e31-f398cd31de63 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: 274ce0ec-f78b-41cd-8538-2708c52c1c55] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:06.406126 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e4911690-2448-4c7d-9e31-f398cd31de63 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:06.406726 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e4911690-2448-4c7d-9e31-f398cd31de63 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:06.408951 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e4911690-2448-4c7d-9e31-f398cd31de63 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:06.409764 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e4911690-2448-4c7d-9e31-f398cd31de63 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:06.487248 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-743cddf7-f83b-4115-a87f-f2ad0d6f4e62 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '896f9085718446cd90ce445c09be4741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21695c8a68454c07bd8c466671076897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:06.507417 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-743cddf7-f83b-4115-a87f-f2ad0d6f4e62 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] 10.222.0.17 "GET /compute/v2.1/servers/ee790a59-a432-4563-a3f9-ab25bb7876b9" status: 200 len: 1323 microversion: 2.1 time: 0.335225 Jul 23 21:29:06.509116 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1946/3791] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:29:06 2022] GET /compute/v2.1/servers/ee790a59-a432-4563-a3f9-ab25bb7876b9 => generated 1323 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:29:06.619684 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e4911690-2448-4c7d-9e31-f398cd31de63 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:06.630156 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e4911690-2448-4c7d-9e31-f398cd31de63 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/274ce0ec-f78b-41cd-8538-2708c52c1c55" status: 200 len: 1188 microversion: 2.1 time: 0.263034 Jul 23 21:29:06.634113 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1846/3792] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:29:06 2022] GET /compute/v2.1/servers/274ce0ec-f78b-41cd-8538-2708c52c1c55 => generated 1188 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:29:06.665220 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-01be9865-18af-47d3-b688-f6004ad5fa95 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:06.666058 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-01be9865-18af-47d3-b688-f6004ad5fa95 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: 694b9d2e-5137-4c2a-a656-2607e1ea912a] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:06.680904 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-01be9865-18af-47d3-b688-f6004ad5fa95 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:06.681649 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-01be9865-18af-47d3-b688-f6004ad5fa95 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:06.682523 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-01be9865-18af-47d3-b688-f6004ad5fa95 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:06.685267 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-01be9865-18af-47d3-b688-f6004ad5fa95 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:06.718607 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-01be9865-18af-47d3-b688-f6004ad5fa95 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] HTTP exception thrown: Instance 694b9d2e-5137-4c2a-a656-2607e1ea912a could not be found. Jul 23 21:29:06.725596 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-01be9865-18af-47d3-b688-f6004ad5fa95 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Request method failure captured: Jul 23 21:29:06.725596 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/servers/694b9d2e-5137-4c2a-a656-2607e1ea912a HTTP/1.1 Jul 23 21:29:06.725596 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:29:06.725596 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:29:06.725596 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:29:06.725596 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:29:06.725596 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:29:06.725596 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:29:06.725596 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:29:06.725596 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:29:06.725596 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GddaYqyOuWcIIbeHmsk3fPEmdWyfGLbr9Nsz9MmxXVcs_PKtvbIqY2C8j4fzxFCSVf8V3fYFIZhvaOHyCuudCVcoCOVgWdy__DYWHqWW4I8VD_yG4rJj0HZodonpxNaGqSkGiL8DXUXMaZTTZO1BvjnTGQlN8CnshrUQQ72pGMeb2k Jul 23 21:29:06.725596 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:29:06.725596 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:29:06.725596 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:29:06.725596 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:29:06.725596 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:29:06.725596 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:29:06.725596 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: a892bfe56afd4ee5bb6c47e926af7349 Jul 23 21:29:06.725596 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-DeleteServersTestJSON-745069838 Jul 23 21:29:06.725596 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:29:06.725596 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:29:06.725596 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a892bfe56afd4ee5bb6c47e926af7349"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a892bfe56afd4ee5bb6c47e926af7349"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a892bfe56afd4ee5bb6c47e926af7349", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a892bfe56afd4ee5bb6c47e926af7349"}]}] Jul 23 21:29:06.725596 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-DeleteServersTestJSON-745069838 Jul 23 21:29:06.725596 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: a892bfe56afd4ee5bb6c47e926af7349 Jul 23 21:29:06.725596 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-DeleteServersTestJSON-745069838 Jul 23 21:29:06.725596 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-DeleteServersTestJSON-745069838-project Jul 23 21:29:06.725596 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:29:06.725596 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:29:06.725596 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: affc3572ef7d45249f50b5061a681d18 Jul 23 21:29:06.725596 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-DeleteServersTestJSON-745069838-project Jul 23 21:29:06.725596 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:29:06.725596 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance 694b9d2e-5137-4c2a-a656-2607e1ea912a could not be found. Jul 23 21:29:06.725596 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': '694b9d2e-5137-4c2a-a656-2607e1ea912a'} Jul 23 21:29:06.725596 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:29:06.725596 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:29:06.725596 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:29:06.725596 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:29:06.725596 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:29:06.725596 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:29:06.725596 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:29:06.725596 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:29:06.725596 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:29:06.725596 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:29:06.725596 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 694b9d2e-5137-4c2a-a656-2607e1ea912a could not be found. Jul 23 21:29:06.725596 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:29:06.725596 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:29:06.725596 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:29:06.725596 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:29:06.725596 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:29:06.725596 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:29:06.725596 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:29:06.725596 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:29:06.725596 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:29:06.725596 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:29:06.725596 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:29:06.725596 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:29:06.725596 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:29:06.725596 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:29:06.725596 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:29:06.725596 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:29:06.725596 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 694b9d2e-5137-4c2a-a656-2607e1ea912a could not be found. Jul 23 21:29:06.725596 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:29:06.725596 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:29:06.725596 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:29:06.730358 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:29:06.730358 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:29:06.730358 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:29:06.730358 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:29:06.730358 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:29:06.730358 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 694b9d2e-5137-4c2a-a656-2607e1ea912a could not be found. Jul 23 21:29:06.730358 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:29:06.730358 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-01be9865-18af-47d3-b688-f6004ad5fa95 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Returning 404 to user: Instance 694b9d2e-5137-4c2a-a656-2607e1ea912a could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:29:06.731425 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-01be9865-18af-47d3-b688-f6004ad5fa95 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/694b9d2e-5137-4c2a-a656-2607e1ea912a" status: 404 len: 111 microversion: 2.1 time: 0.071281 Jul 23 21:29:06.734965 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1947/3793] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:29:06 2022] GET /compute/v2.1/servers/694b9d2e-5137-4c2a-a656-2607e1ea912a => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:29:06.869989 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e498d25d-0a4a-433b-997d-d1c849874fc7 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:06.872131 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e498d25d-0a4a-433b-997d-d1c849874fc7 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:06.890164 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e498d25d-0a4a-433b-997d-d1c849874fc7 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:06.891576 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e498d25d-0a4a-433b-997d-d1c849874fc7 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:06.894019 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e498d25d-0a4a-433b-997d-d1c849874fc7 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:06.895734 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e498d25d-0a4a-433b-997d-d1c849874fc7 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:07.029637 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-6db2f635-ab1d-496a-9f2a-c11b6f3b6fdb tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2044906399", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "networks": [{"uuid": "c89c9ae3-a9c7-4e98-860d-e9f8ea64bbcb"}]}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:29:07.093038 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e498d25d-0a4a-433b-997d-d1c849874fc7 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:07.118306 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e498d25d-0a4a-433b-997d-d1c849874fc7 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:07.124091 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e498d25d-0a4a-433b-997d-d1c849874fc7 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:07.125598 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e498d25d-0a4a-433b-997d-d1c849874fc7 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.274168 Jul 23 21:29:07.127302 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1847/3794] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:29:06 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:29:07.163369 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.network.neutron [None req-6db2f635-ab1d-496a-9f2a-c11b6f3b6fdb tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] validate_networks() for [('c89c9ae3-a9c7-4e98-860d-e9f8ea64bbcb', None, None, None, None, None)] {{(pid=131321) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:29:07.389346 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9e6e6b9f-70b4-43df-81ca-3601ed8d6e56 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:07.389999 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-9e6e6b9f-70b4-43df-81ca-3601ed8d6e56 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] [instance: f24f6136-4a47-44f1-9e79-fea1b1cbf057] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:07.407237 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9e6e6b9f-70b4-43df-81ca-3601ed8d6e56 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:07.409882 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9e6e6b9f-70b4-43df-81ca-3601ed8d6e56 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:07.410911 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9e6e6b9f-70b4-43df-81ca-3601ed8d6e56 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:07.413225 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9e6e6b9f-70b4-43df-81ca-3601ed8d6e56 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:07.721623 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-9e6e6b9f-70b4-43df-81ca-3601ed8d6e56 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b566640463e43aa85ec96a1aa76d3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eef3db6d5f46c9882fbe98cb732263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:07.730075 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9e6e6b9f-70b4-43df-81ca-3601ed8d6e56 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] 10.222.0.17 "GET /compute/v2.1/servers/f24f6136-4a47-44f1-9e79-fea1b1cbf057" status: 200 len: 1524 microversion: 2.1 time: 0.348364 Jul 23 21:29:07.737158 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1848/3795] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:29:07 2022] GET /compute/v2.1/servers/f24f6136-4a47-44f1-9e79-fea1b1cbf057 => generated 1524 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:29:07.742136 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-867a1071-44f9-4784-b900-d5cae6bd117b tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:07.747213 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-867a1071-44f9-4784-b900-d5cae6bd117b tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] [instance: ee790a59-a432-4563-a3f9-ab25bb7876b9] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:07.763927 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-867a1071-44f9-4784-b900-d5cae6bd117b tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:07.764380 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-867a1071-44f9-4784-b900-d5cae6bd117b tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:07.765182 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-867a1071-44f9-4784-b900-d5cae6bd117b tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:07.765619 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-867a1071-44f9-4784-b900-d5cae6bd117b tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:07.778098 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:08.429959 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-867a1071-44f9-4784-b900-d5cae6bd117b tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '896f9085718446cd90ce445c09be4741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21695c8a68454c07bd8c466671076897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:08.440872 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-867a1071-44f9-4784-b900-d5cae6bd117b tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] 10.222.0.17 "GET /compute/v2.1/servers/ee790a59-a432-4563-a3f9-ab25bb7876b9" status: 200 len: 1323 microversion: 2.1 time: 0.702534 Jul 23 21:29:08.443156 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1849/3796] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:29:07 2022] GET /compute/v2.1/servers/ee790a59-a432-4563-a3f9-ab25bb7876b9 => generated 1323 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:29:08.451696 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-622ebd34-826b-4c35-a6eb-a940f608865b tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:08.454253 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-622ebd34-826b-4c35-a6eb-a940f608865b tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: 274ce0ec-f78b-41cd-8538-2708c52c1c55] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:08.465964 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-622ebd34-826b-4c35-a6eb-a940f608865b tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:08.467964 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-622ebd34-826b-4c35-a6eb-a940f608865b tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:08.470161 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-622ebd34-826b-4c35-a6eb-a940f608865b tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:08.472068 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-622ebd34-826b-4c35-a6eb-a940f608865b tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:08.621712 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-622ebd34-826b-4c35-a6eb-a940f608865b tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:08.635040 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-622ebd34-826b-4c35-a6eb-a940f608865b tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/274ce0ec-f78b-41cd-8538-2708c52c1c55" status: 200 len: 1250 microversion: 2.1 time: 0.187051 Jul 23 21:29:08.638963 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1850/3797] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:29:08 2022] GET /compute/v2.1/servers/274ce0ec-f78b-41cd-8538-2708c52c1c55 => generated 1250 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:29:08.651818 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ea18bd38-f3a3-42a4-a86b-d934975b5348 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:08.655806 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ea18bd38-f3a3-42a4-a86b-d934975b5348 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:08.674737 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-6db2f635-ab1d-496a-9f2a-c11b6f3b6fdb tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Flavor limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:29:08.675197 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-6db2f635-ab1d-496a-9f2a-c11b6f3b6fdb tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Image limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:29:08.675632 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-6db2f635-ab1d-496a-9f2a-c11b6f3b6fdb tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Flavor pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:29:08.676054 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-6db2f635-ab1d-496a-9f2a-c11b6f3b6fdb tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Image pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:29:08.676467 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-6db2f635-ab1d-496a-9f2a-c11b6f3b6fdb tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:29:08.682415 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ea18bd38-f3a3-42a4-a86b-d934975b5348 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:08.683887 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ea18bd38-f3a3-42a4-a86b-d934975b5348 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:08.688476 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ea18bd38-f3a3-42a4-a86b-d934975b5348 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:08.689287 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ea18bd38-f3a3-42a4-a86b-d934975b5348 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:08.701650 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6db2f635-ab1d-496a-9f2a-c11b6f3b6fdb tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:08.702995 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6db2f635-ab1d-496a-9f2a-c11b6f3b6fdb tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:08.708036 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6db2f635-ab1d-496a-9f2a-c11b6f3b6fdb tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:08.708817 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6db2f635-ab1d-496a-9f2a-c11b6f3b6fdb tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:08.745099 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-6db2f635-ab1d-496a-9f2a-c11b6f3b6fdb tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Getting quotas for project a892bfe56afd4ee5bb6c47e926af7349. Resources: {'ram', 'instances', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:29:08.759675 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-6db2f635-ab1d-496a-9f2a-c11b6f3b6fdb tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Getting quotas for user affc3572ef7d45249f50b5061a681d18 and project a892bfe56afd4ee5bb6c47e926af7349. Resources: {'ram', 'instances', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:29:08.786267 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:08.787891 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-6db2f635-ab1d-496a-9f2a-c11b6f3b6fdb tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Going to run 1 instances... {{(pid=131321) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:29:08.790531 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-6db2f635-ab1d-496a-9f2a-c11b6f3b6fdb tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: a0a4b52f-fa76-473e-ae4b-48f1bdf7c875] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131321) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:29:08.861446 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ea18bd38-f3a3-42a4-a86b-d934975b5348 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:08.886585 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ea18bd38-f3a3-42a4-a86b-d934975b5348 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:08.888625 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ea18bd38-f3a3-42a4-a86b-d934975b5348 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:08.890350 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ea18bd38-f3a3-42a4-a86b-d934975b5348 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.249839 Jul 23 21:29:08.891615 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1851/3798] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:29:08 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:29:08.898875 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-6db2f635-ab1d-496a-9f2a-c11b6f3b6fdb tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.875212 Jul 23 21:29:08.900376 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1948/3799] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:29:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1878 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 23 21:29:08.901209 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3c07a3ba-3ab9-478b-909e-c3777cfb9427 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:08.902055 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-3c07a3ba-3ab9-478b-909e-c3777cfb9427 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] [instance: f24f6136-4a47-44f1-9e79-fea1b1cbf057] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:08.911716 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-12a30d53-9a89-4653-a23b-cd5df49247ab tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:08.912451 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-12a30d53-9a89-4653-a23b-cd5df49247ab tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: a0a4b52f-fa76-473e-ae4b-48f1bdf7c875] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:08.923891 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3c07a3ba-3ab9-478b-909e-c3777cfb9427 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:08.924357 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3c07a3ba-3ab9-478b-909e-c3777cfb9427 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:08.925173 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3c07a3ba-3ab9-478b-909e-c3777cfb9427 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:08.925614 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3c07a3ba-3ab9-478b-909e-c3777cfb9427 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:09.013010 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-12a30d53-9a89-4653-a23b-cd5df49247ab tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:09.023287 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-12a30d53-9a89-4653-a23b-cd5df49247ab tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/a0a4b52f-fa76-473e-ae4b-48f1bdf7c875" status: 200 len: 1215 microversion: 2.1 time: 0.115698 Jul 23 21:29:09.032489 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1949/3800] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:29:08 2022] GET /compute/v2.1/servers/a0a4b52f-fa76-473e-ae4b-48f1bdf7c875 => generated 1215 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:29:09.352939 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-3c07a3ba-3ab9-478b-909e-c3777cfb9427 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b566640463e43aa85ec96a1aa76d3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eef3db6d5f46c9882fbe98cb732263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:09.363132 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-3c07a3ba-3ab9-478b-909e-c3777cfb9427 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] 10.222.0.17 "GET /compute/v2.1/servers/f24f6136-4a47-44f1-9e79-fea1b1cbf057" status: 200 len: 1524 microversion: 2.1 time: 0.470186 Jul 23 21:29:09.376832 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1852/3801] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:29:08 2022] GET /compute/v2.1/servers/f24f6136-4a47-44f1-9e79-fea1b1cbf057 => generated 1524 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:29:09.460931 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-6d2a94ee-cc44-443a-a073-94c2ed146612 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:09.461716 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-6d2a94ee-cc44-443a-a073-94c2ed146612 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] [instance: ee790a59-a432-4563-a3f9-ab25bb7876b9] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:09.473824 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6d2a94ee-cc44-443a-a073-94c2ed146612 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:09.474320 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6d2a94ee-cc44-443a-a073-94c2ed146612 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:09.485446 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6d2a94ee-cc44-443a-a073-94c2ed146612 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:09.486991 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6d2a94ee-cc44-443a-a073-94c2ed146612 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:09.655197 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b80ce401-7fbc-4c8c-8f30-a2858d9b3218 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:09.656453 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b80ce401-7fbc-4c8c-8f30-a2858d9b3218 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: 274ce0ec-f78b-41cd-8538-2708c52c1c55] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:09.674127 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b80ce401-7fbc-4c8c-8f30-a2858d9b3218 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:09.684921 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b80ce401-7fbc-4c8c-8f30-a2858d9b3218 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:09.685957 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b80ce401-7fbc-4c8c-8f30-a2858d9b3218 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:09.686538 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b80ce401-7fbc-4c8c-8f30-a2858d9b3218 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:09.949511 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b80ce401-7fbc-4c8c-8f30-a2858d9b3218 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:09.959615 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b80ce401-7fbc-4c8c-8f30-a2858d9b3218 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/274ce0ec-f78b-41cd-8538-2708c52c1c55" status: 200 len: 1292 microversion: 2.1 time: 0.308247 Jul 23 21:29:09.960389 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1853/3802] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:29:09 2022] GET /compute/v2.1/servers/274ce0ec-f78b-41cd-8538-2708c52c1c55 => generated 1292 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:29:09.968849 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-eda25529-eb03-457b-932c-96106a5a0a62 req-b6d3dd1b-ede7-48c0-8302-307a0d2f2efb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee790a59-a432-4563-a3f9-ab25bb7876b9", "name": "network-vif-plugged", "status": "completed", "tag": "f61f4673-2052-484f-bcf5-fa6c5e329c06"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:29:09.978064 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-eda25529-eb03-457b-932c-96106a5a0a62 req-b6d3dd1b-ede7-48c0-8302-307a0d2f2efb service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:09.978988 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-eda25529-eb03-457b-932c-96106a5a0a62 req-b6d3dd1b-ede7-48c0-8302-307a0d2f2efb service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:09.993302 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-eda25529-eb03-457b-932c-96106a5a0a62 req-b6d3dd1b-ede7-48c0-8302-307a0d2f2efb service nova] Creating event network-vif-plugged:f61f4673-2052-484f-bcf5-fa6c5e329c06 for instance ee790a59-a432-4563-a3f9-ab25bb7876b9 on nch2-master-1 Jul 23 21:29:09.999231 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-eda25529-eb03-457b-932c-96106a5a0a62 req-b6d3dd1b-ede7-48c0-8302-307a0d2f2efb service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035680 Jul 23 21:29:10.000084 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1854/3803] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:29:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:29:10.007144 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-74466a92-c11b-419c-90c4-fbd5eae277e3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:10.019019 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-74466a92-c11b-419c-90c4-fbd5eae277e3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:10.027708 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-74466a92-c11b-419c-90c4-fbd5eae277e3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:10.028590 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-74466a92-c11b-419c-90c4-fbd5eae277e3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:10.029797 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-74466a92-c11b-419c-90c4-fbd5eae277e3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:10.030461 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-74466a92-c11b-419c-90c4-fbd5eae277e3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:10.045971 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-6d2a94ee-cc44-443a-a073-94c2ed146612 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '896f9085718446cd90ce445c09be4741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21695c8a68454c07bd8c466671076897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:10.060336 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-6d2a94ee-cc44-443a-a073-94c2ed146612 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] 10.222.0.17 "GET /compute/v2.1/servers/ee790a59-a432-4563-a3f9-ab25bb7876b9" status: 200 len: 1323 microversion: 2.1 time: 0.602209 Jul 23 21:29:10.073429 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1950/3804] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:29:09 2022] GET /compute/v2.1/servers/ee790a59-a432-4563-a3f9-ab25bb7876b9 => generated 1323 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:29:10.085023 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-37de441a-58fa-40f6-997a-2ffdfe1da48d tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:10.087032 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-37de441a-58fa-40f6-997a-2ffdfe1da48d tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: a0a4b52f-fa76-473e-ae4b-48f1bdf7c875] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:10.128085 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-37de441a-58fa-40f6-997a-2ffdfe1da48d tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:10.128874 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-37de441a-58fa-40f6-997a-2ffdfe1da48d tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:10.129843 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-37de441a-58fa-40f6-997a-2ffdfe1da48d tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:10.130499 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-37de441a-58fa-40f6-997a-2ffdfe1da48d tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:10.175711 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-74466a92-c11b-419c-90c4-fbd5eae277e3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:10.192139 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-74466a92-c11b-419c-90c4-fbd5eae277e3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:10.193648 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-74466a92-c11b-419c-90c4-fbd5eae277e3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:10.194937 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-74466a92-c11b-419c-90c4-fbd5eae277e3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.193527 Jul 23 21:29:10.195710 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1855/3805] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:29:10 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:29:10.243100 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-37de441a-58fa-40f6-997a-2ffdfe1da48d tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:10.254597 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-37de441a-58fa-40f6-997a-2ffdfe1da48d tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/a0a4b52f-fa76-473e-ae4b-48f1bdf7c875" status: 200 len: 1267 microversion: 2.1 time: 0.179914 Jul 23 21:29:10.257253 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1951/3806] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:29:10 2022] GET /compute/v2.1/servers/a0a4b52f-fa76-473e-ae4b-48f1bdf7c875 => generated 1267 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:29:10.386693 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-66e1b2cc-c1d8-4a51-b939-0be74dfc09b7 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:10.386931 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-66e1b2cc-c1d8-4a51-b939-0be74dfc09b7 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] [instance: f24f6136-4a47-44f1-9e79-fea1b1cbf057] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:10.405583 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-66e1b2cc-c1d8-4a51-b939-0be74dfc09b7 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:10.406531 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-66e1b2cc-c1d8-4a51-b939-0be74dfc09b7 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:10.407376 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-66e1b2cc-c1d8-4a51-b939-0be74dfc09b7 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:10.407882 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-66e1b2cc-c1d8-4a51-b939-0be74dfc09b7 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:10.662915 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-66e1b2cc-c1d8-4a51-b939-0be74dfc09b7 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b566640463e43aa85ec96a1aa76d3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eef3db6d5f46c9882fbe98cb732263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:10.686402 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-66e1b2cc-c1d8-4a51-b939-0be74dfc09b7 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] 10.222.0.17 "GET /compute/v2.1/servers/f24f6136-4a47-44f1-9e79-fea1b1cbf057" status: 200 len: 1524 microversion: 2.1 time: 0.306074 Jul 23 21:29:10.690950 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1856/3807] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:29:10 2022] GET /compute/v2.1/servers/f24f6136-4a47-44f1-9e79-fea1b1cbf057 => generated 1524 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:29:10.976603 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-45781c95-374e-4b2e-8a7e-976cd3c459a2 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:10.977228 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-45781c95-374e-4b2e-8a7e-976cd3c459a2 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: 274ce0ec-f78b-41cd-8538-2708c52c1c55] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:10.987745 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-45781c95-374e-4b2e-8a7e-976cd3c459a2 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:10.988212 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-45781c95-374e-4b2e-8a7e-976cd3c459a2 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:10.989004 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-45781c95-374e-4b2e-8a7e-976cd3c459a2 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:10.989442 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-45781c95-374e-4b2e-8a7e-976cd3c459a2 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:11.080836 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-acf34145-5c9a-498e-bfef-9bc303f1acfd tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:11.081749 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-acf34145-5c9a-498e-bfef-9bc303f1acfd tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] [instance: ee790a59-a432-4563-a3f9-ab25bb7876b9] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:11.090341 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-acf34145-5c9a-498e-bfef-9bc303f1acfd tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:11.090955 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-acf34145-5c9a-498e-bfef-9bc303f1acfd tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:11.091742 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-acf34145-5c9a-498e-bfef-9bc303f1acfd tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:11.092183 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-acf34145-5c9a-498e-bfef-9bc303f1acfd tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:11.363585 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-45781c95-374e-4b2e-8a7e-976cd3c459a2 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:11.373679 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-45781c95-374e-4b2e-8a7e-976cd3c459a2 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/274ce0ec-f78b-41cd-8538-2708c52c1c55" status: 200 len: 1292 microversion: 2.1 time: 0.400809 Jul 23 21:29:11.374311 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1952/3808] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:29:10 2022] GET /compute/v2.1/servers/274ce0ec-f78b-41cd-8538-2708c52c1c55 => generated 1292 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:29:11.377523 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-acf34145-5c9a-498e-bfef-9bc303f1acfd tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '896f9085718446cd90ce445c09be4741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21695c8a68454c07bd8c466671076897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:11.382646 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d38ad052-d36e-4d23-a731-41d6f8db8b07 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:11.383265 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-d38ad052-d36e-4d23-a731-41d6f8db8b07 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:11.394118 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-acf34145-5c9a-498e-bfef-9bc303f1acfd tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] 10.222.0.17 "GET /compute/v2.1/servers/ee790a59-a432-4563-a3f9-ab25bb7876b9" status: 200 len: 1323 microversion: 2.1 time: 0.318340 Jul 23 21:29:11.407797 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1857/3809] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:29:11 2022] GET /compute/v2.1/servers/ee790a59-a432-4563-a3f9-ab25bb7876b9 => generated 1323 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:29:11.415824 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d38ad052-d36e-4d23-a731-41d6f8db8b07 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:11.416287 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d38ad052-d36e-4d23-a731-41d6f8db8b07 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:11.417088 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d38ad052-d36e-4d23-a731-41d6f8db8b07 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:11.417530 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d38ad052-d36e-4d23-a731-41d6f8db8b07 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:11.426479 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c89eabb4-8018-4cfb-95c7-942501ee5b27 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:11.428845 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c89eabb4-8018-4cfb-95c7-942501ee5b27 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: a0a4b52f-fa76-473e-ae4b-48f1bdf7c875] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:11.442614 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:11.446450 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c89eabb4-8018-4cfb-95c7-942501ee5b27 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:11.450474 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c89eabb4-8018-4cfb-95c7-942501ee5b27 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:11.451709 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c89eabb4-8018-4cfb-95c7-942501ee5b27 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:11.453707 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c89eabb4-8018-4cfb-95c7-942501ee5b27 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:11.601224 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c89eabb4-8018-4cfb-95c7-942501ee5b27 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:11.612191 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c89eabb4-8018-4cfb-95c7-942501ee5b27 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/a0a4b52f-fa76-473e-ae4b-48f1bdf7c875" status: 200 len: 1273 microversion: 2.1 time: 0.202296 Jul 23 21:29:11.612791 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1858/3810] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:29:11 2022] GET /compute/v2.1/servers/a0a4b52f-fa76-473e-ae4b-48f1bdf7c875 => generated 1273 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:29:11.619283 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-682eafcd-3672-416a-90e6-cead477e3ee3 req-b4c2b9b1-89b5-48f9-83ff-757767a65894 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "274ce0ec-f78b-41cd-8538-2708c52c1c55", "tag": "dcaef018-3af8-4f24-90ac-5c35c064677a"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:29:11.642073 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-682eafcd-3672-416a-90e6-cead477e3ee3 req-b4c2b9b1-89b5-48f9-83ff-757767a65894 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:11.642529 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-682eafcd-3672-416a-90e6-cead477e3ee3 req-b4c2b9b1-89b5-48f9-83ff-757767a65894 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:11.656757 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-682eafcd-3672-416a-90e6-cead477e3ee3 req-b4c2b9b1-89b5-48f9-83ff-757767a65894 service nova] Creating event network-changed:dcaef018-3af8-4f24-90ac-5c35c064677a for instance 274ce0ec-f78b-41cd-8538-2708c52c1c55 on nch1-master-1 Jul 23 21:29:11.659978 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-682eafcd-3672-416a-90e6-cead477e3ee3 req-b4c2b9b1-89b5-48f9-83ff-757767a65894 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044178 Jul 23 21:29:11.660648 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1859/3811] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:29:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:29:11.696397 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-d38ad052-d36e-4d23-a731-41d6f8db8b07 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:11.709559 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e8821d5e-d0d8-43fd-838c-cc5f675726c3 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:11.710713 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e8821d5e-d0d8-43fd-838c-cc5f675726c3 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] [instance: f24f6136-4a47-44f1-9e79-fea1b1cbf057] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:11.722568 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e8821d5e-d0d8-43fd-838c-cc5f675726c3 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:11.723027 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e8821d5e-d0d8-43fd-838c-cc5f675726c3 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:11.724262 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-d38ad052-d36e-4d23-a731-41d6f8db8b07 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:11.725633 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e8821d5e-d0d8-43fd-838c-cc5f675726c3 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:11.726129 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e8821d5e-d0d8-43fd-838c-cc5f675726c3 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:11.727540 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-d38ad052-d36e-4d23-a731-41d6f8db8b07 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:11.730161 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-d38ad052-d36e-4d23-a731-41d6f8db8b07 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.354856 Jul 23 21:29:11.742047 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1953/3812] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:29:11 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:29:12.058725 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e8821d5e-d0d8-43fd-838c-cc5f675726c3 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b566640463e43aa85ec96a1aa76d3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eef3db6d5f46c9882fbe98cb732263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:12.070500 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e8821d5e-d0d8-43fd-838c-cc5f675726c3 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] 10.222.0.17 "GET /compute/v2.1/servers/f24f6136-4a47-44f1-9e79-fea1b1cbf057" status: 200 len: 1524 microversion: 2.1 time: 0.366070 Jul 23 21:29:12.071676 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1860/3813] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:29:11 2022] GET /compute/v2.1/servers/f24f6136-4a47-44f1-9e79-fea1b1cbf057 => generated 1524 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:29:12.392722 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-9ade7bf8-5881-47f5-8b38-dedf46c6a9fb tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:12.393355 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-9ade7bf8-5881-47f5-8b38-dedf46c6a9fb tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: 274ce0ec-f78b-41cd-8538-2708c52c1c55] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:12.413051 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-bceeead7-3d5a-4cf0-8774-e26db2a5d451 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:12.414012 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-bceeead7-3d5a-4cf0-8774-e26db2a5d451 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] [instance: ee790a59-a432-4563-a3f9-ab25bb7876b9] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:12.416632 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9ade7bf8-5881-47f5-8b38-dedf46c6a9fb tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:12.418239 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9ade7bf8-5881-47f5-8b38-dedf46c6a9fb tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:12.421272 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9ade7bf8-5881-47f5-8b38-dedf46c6a9fb tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:12.423893 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9ade7bf8-5881-47f5-8b38-dedf46c6a9fb tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:12.430017 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bceeead7-3d5a-4cf0-8774-e26db2a5d451 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:12.432788 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bceeead7-3d5a-4cf0-8774-e26db2a5d451 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:12.435845 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bceeead7-3d5a-4cf0-8774-e26db2a5d451 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:12.436513 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bceeead7-3d5a-4cf0-8774-e26db2a5d451 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:12.763876 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-9ade7bf8-5881-47f5-8b38-dedf46c6a9fb tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:12.778856 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-9ade7bf8-5881-47f5-8b38-dedf46c6a9fb tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/274ce0ec-f78b-41cd-8538-2708c52c1c55" status: 200 len: 1292 microversion: 2.1 time: 0.390564 Jul 23 21:29:12.779611 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1954/3814] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:29:12 2022] GET /compute/v2.1/servers/274ce0ec-f78b-41cd-8538-2708c52c1c55 => generated 1292 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:29:12.797546 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-74dc4a62-b5b3-4db6-b34e-bf38734c0e46 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:12.798729 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-74dc4a62-b5b3-4db6-b34e-bf38734c0e46 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: a0a4b52f-fa76-473e-ae4b-48f1bdf7c875] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:12.809032 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-74dc4a62-b5b3-4db6-b34e-bf38734c0e46 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:12.812647 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-74dc4a62-b5b3-4db6-b34e-bf38734c0e46 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:12.814412 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-74dc4a62-b5b3-4db6-b34e-bf38734c0e46 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:12.815172 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-74dc4a62-b5b3-4db6-b34e-bf38734c0e46 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:12.885903 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=100 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:12.902607 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-bceeead7-3d5a-4cf0-8774-e26db2a5d451 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '896f9085718446cd90ce445c09be4741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21695c8a68454c07bd8c466671076897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:12.911459 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-bceeead7-3d5a-4cf0-8774-e26db2a5d451 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] 10.222.0.17 "GET /compute/v2.1/servers/ee790a59-a432-4563-a3f9-ab25bb7876b9" status: 200 len: 1520 microversion: 2.1 time: 0.502980 Jul 23 21:29:12.922652 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1861/3815] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:29:12 2022] GET /compute/v2.1/servers/ee790a59-a432-4563-a3f9-ab25bb7876b9 => generated 1520 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:29:12.928041 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0bb4a5de-f17d-4bea-b29d-c97f609755d8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:12.928876 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-0bb4a5de-f17d-4bea-b29d-c97f609755d8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:12.940559 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0bb4a5de-f17d-4bea-b29d-c97f609755d8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:12.941276 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0bb4a5de-f17d-4bea-b29d-c97f609755d8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:12.947672 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0bb4a5de-f17d-4bea-b29d-c97f609755d8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:12.948490 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0bb4a5de-f17d-4bea-b29d-c97f609755d8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:13.059800 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-0bb4a5de-f17d-4bea-b29d-c97f609755d8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:13.075775 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-0bb4a5de-f17d-4bea-b29d-c97f609755d8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:13.079421 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-0bb4a5de-f17d-4bea-b29d-c97f609755d8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:13.081483 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-0bb4a5de-f17d-4bea-b29d-c97f609755d8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.157451 Jul 23 21:29:13.082988 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1862/3816] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:29:12 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:29:13.089251 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-41164ff9-c2e8-4a65-aee5-d08375b50269 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:13.090895 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-41164ff9-c2e8-4a65-aee5-d08375b50269 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] [instance: ee790a59-a432-4563-a3f9-ab25bb7876b9] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:13.099410 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-41164ff9-c2e8-4a65-aee5-d08375b50269 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:13.101739 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-41164ff9-c2e8-4a65-aee5-d08375b50269 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:13.102837 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-41164ff9-c2e8-4a65-aee5-d08375b50269 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:13.104298 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-41164ff9-c2e8-4a65-aee5-d08375b50269 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:13.165022 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-41164ff9-c2e8-4a65-aee5-d08375b50269 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] HTTP exception thrown: Action 999 not found Jul 23 21:29:13.174209 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-41164ff9-c2e8-4a65-aee5-d08375b50269 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Request method failure captured: Jul 23 21:29:13.174209 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/ee790a59-a432-4563-a3f9-ab25bb7876b9/os-instance-actions/999 HTTP/1.1 Jul 23 21:29:13.174209 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:29:13.174209 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:29:13.174209 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:29:13.174209 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:29:13.174209 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:29:13.174209 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:29:13.174209 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:29:13.174209 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:29:13.174209 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GgSS9T1_704KiFFTD4viB5qsKA9veci1lemME3yJoYkOzDIG8_qt-pXPsS5CTIEqCLMF03XQneenVBzTPeHqzwO2GQz71W524BdLf7fd9643cmSH09DLz93jaWVXy8SonmHsdRoszyUmyBRWUyAzeN1UvNAx6yUwGreYJLsM9fvv1g Jul 23 21:29:13.174209 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:29:13.174209 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:29:13.174209 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:29:13.174209 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:29:13.174209 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:29:13.174209 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:29:13.174209 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 21695c8a68454c07bd8c466671076897 Jul 23 21:29:13.174209 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-805858935 Jul 23 21:29:13.174209 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:29:13.174209 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:29:13.174209 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/21695c8a68454c07bd8c466671076897"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/21695c8a68454c07bd8c466671076897"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_21695c8a68454c07bd8c466671076897", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/21695c8a68454c07bd8c466671076897"}]}] Jul 23 21:29:13.174209 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-805858935 Jul 23 21:29:13.174209 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 21695c8a68454c07bd8c466671076897 Jul 23 21:29:13.174209 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-805858935 Jul 23 21:29:13.174209 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-InstanceActionsNegativeTestJSON-805858935-project Jul 23 21:29:13.174209 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:29:13.174209 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:29:13.174209 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 896f9085718446cd90ce445c09be4741 Jul 23 21:29:13.174209 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-805858935-project Jul 23 21:29:13.174209 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:29:13.174209 ncdv-master-1 devstack@n-api.service[131320]: exception: Action 999 not found Jul 23 21:29:13.174209 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'server_id': 'ee790a59-a432-4563-a3f9-ab25bb7876b9', 'id': '999'} Jul 23 21:29:13.174209 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:29:13.174209 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:29:13.174209 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:29:13.174209 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:29:13.174209 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:29:13.174209 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:29:13.174209 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:29:13.174209 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:29:13.174209 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Jul 23 21:29:13.174209 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 23 21:29:13.174209 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Jul 23 21:29:13.174209 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:29:13.174209 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:29:13.174209 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:29:13.174209 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:29:13.174209 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:29:13.174209 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:29:13.174209 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:29:13.174209 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:29:13.174209 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Jul 23 21:29:13.174209 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:29:13.179983 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-41164ff9-c2e8-4a65-aee5-d08375b50269 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Returning 404 to user: Action 999 not found {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:29:13.181123 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-41164ff9-c2e8-4a65-aee5-d08375b50269 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] 10.222.0.17 "GET /compute/v2.1/servers/ee790a59-a432-4563-a3f9-ab25bb7876b9/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.096477 Jul 23 21:29:13.185921 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1863/3817] 10.222.0.17 () {58 vars in 1307 bytes} [Sat Jul 23 21:29:13 2022] GET /compute/v2.1/servers/ee790a59-a432-4563-a3f9-ab25bb7876b9/os-instance-actions/999 => generated 66 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 23 21:29:13.189613 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8747c11b-d3fe-471a-ae42-dd1c85ca9168 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:13.190280 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8747c11b-d3fe-471a-ae42-dd1c85ca9168 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] [instance: f24f6136-4a47-44f1-9e79-fea1b1cbf057] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:13.198046 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8747c11b-d3fe-471a-ae42-dd1c85ca9168 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:13.198732 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8747c11b-d3fe-471a-ae42-dd1c85ca9168 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:13.199986 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8747c11b-d3fe-471a-ae42-dd1c85ca9168 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:13.201106 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8747c11b-d3fe-471a-ae42-dd1c85ca9168 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:13.385616 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8747c11b-d3fe-471a-ae42-dd1c85ca9168 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b566640463e43aa85ec96a1aa76d3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eef3db6d5f46c9882fbe98cb732263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:13.394205 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-74dc4a62-b5b3-4db6-b34e-bf38734c0e46 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:13.395990 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8747c11b-d3fe-471a-ae42-dd1c85ca9168 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] 10.222.0.17 "GET /compute/v2.1/servers/f24f6136-4a47-44f1-9e79-fea1b1cbf057" status: 200 len: 1524 microversion: 2.1 time: 0.211897 Jul 23 21:29:13.396996 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1864/3818] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:29:13 2022] GET /compute/v2.1/servers/f24f6136-4a47-44f1-9e79-fea1b1cbf057 => generated 1524 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:29:13.412958 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-159ca827-4c52-4282-b19b-45247a6838ac tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Calling method '.version_select at 0x7f0b598d39d0>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:13.414116 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-159ca827-4c52-4282-b19b-45247a6838ac tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] [instance: 3da0cf0f-5658-4994-ba79-be4556e81e2a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:13.415574 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-74dc4a62-b5b3-4db6-b34e-bf38734c0e46 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/a0a4b52f-fa76-473e-ae4b-48f1bdf7c875" status: 200 len: 1315 microversion: 2.1 time: 0.621639 Jul 23 21:29:13.417625 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1955/3819] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:29:12 2022] GET /compute/v2.1/servers/a0a4b52f-fa76-473e-ae4b-48f1bdf7c875 => generated 1315 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:29:13.423828 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-159ca827-4c52-4282-b19b-45247a6838ac tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] HTTP exception thrown: Instance 3da0cf0f-5658-4994-ba79-be4556e81e2a could not be found. Jul 23 21:29:13.425777 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-159ca827-4c52-4282-b19b-45247a6838ac tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Request method failure captured: Jul 23 21:29:13.425777 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/3da0cf0f-5658-4994-ba79-be4556e81e2a/os-instance-actions HTTP/1.1 Jul 23 21:29:13.425777 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:29:13.425777 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:29:13.425777 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:29:13.425777 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:29:13.425777 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:29:13.425777 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:29:13.425777 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:29:13.425777 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:29:13.425777 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GgSS9T1_704KiFFTD4viB5qsKA9veci1lemME3yJoYkOzDIG8_qt-pXPsS5CTIEqCLMF03XQneenVBzTPeHqzwO2GQz71W524BdLf7fd9643cmSH09DLz93jaWVXy8SonmHsdRoszyUmyBRWUyAzeN1UvNAx6yUwGreYJLsM9fvv1g Jul 23 21:29:13.425777 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:29:13.425777 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:29:13.425777 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:29:13.425777 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:29:13.425777 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:29:13.425777 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:29:13.425777 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 21695c8a68454c07bd8c466671076897 Jul 23 21:29:13.425777 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-805858935 Jul 23 21:29:13.425777 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:29:13.425777 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:29:13.425777 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/21695c8a68454c07bd8c466671076897"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/21695c8a68454c07bd8c466671076897"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_21695c8a68454c07bd8c466671076897", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/21695c8a68454c07bd8c466671076897"}]}] Jul 23 21:29:13.425777 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-805858935 Jul 23 21:29:13.425777 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 21695c8a68454c07bd8c466671076897 Jul 23 21:29:13.425777 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-805858935 Jul 23 21:29:13.425777 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-InstanceActionsNegativeTestJSON-805858935-project Jul 23 21:29:13.425777 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:29:13.425777 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:29:13.425777 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 896f9085718446cd90ce445c09be4741 Jul 23 21:29:13.425777 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-805858935-project Jul 23 21:29:13.425777 ncdv-master-1 devstack@n-api.service[131320]: method: Jul 23 21:29:13.425777 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance 3da0cf0f-5658-4994-ba79-be4556e81e2a could not be found. Jul 23 21:29:13.425777 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'server_id': '3da0cf0f-5658-4994-ba79-be4556e81e2a'} Jul 23 21:29:13.425777 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:29:13.425777 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:29:13.425777 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:29:13.425777 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:29:13.425777 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:29:13.425777 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:29:13.425777 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 23 21:29:13.425777 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 23 21:29:13.425777 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3da0cf0f-5658-4994-ba79-be4556e81e2a could not be found. Jul 23 21:29:13.425777 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:29:13.425777 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:29:13.425777 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:29:13.425777 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:29:13.425777 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:29:13.425777 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:29:13.425777 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:29:13.425777 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:29:13.425777 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:29:13.425777 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:29:13.425777 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:29:13.425777 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:29:13.425777 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Jul 23 21:29:13.425777 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Jul 23 21:29:13.425777 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:29:13.425777 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:29:13.425777 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Jul 23 21:29:13.425777 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Jul 23 21:29:13.425777 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:29:13.425777 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:29:13.432119 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3da0cf0f-5658-4994-ba79-be4556e81e2a could not be found. Jul 23 21:29:13.432119 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:29:13.432119 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:29:13.432119 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:29:13.432119 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:29:13.432119 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:29:13.432119 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:29:13.432119 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:29:13.432119 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:29:13.432119 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3da0cf0f-5658-4994-ba79-be4556e81e2a could not be found. Jul 23 21:29:13.432119 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:29:13.434404 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-159ca827-4c52-4282-b19b-45247a6838ac tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Returning 404 to user: Instance 3da0cf0f-5658-4994-ba79-be4556e81e2a could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:29:13.435457 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-159ca827-4c52-4282-b19b-45247a6838ac tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] 10.222.0.17 "GET /compute/v2.1/servers/3da0cf0f-5658-4994-ba79-be4556e81e2a/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.030555 Jul 23 21:29:13.436568 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1865/3820] 10.222.0.17 () {58 vars in 1295 bytes} [Sat Jul 23 21:29:13 2022] GET /compute/v2.1/servers/3da0cf0f-5658-4994-ba79-be4556e81e2a/os-instance-actions => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:29:13.449679 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e958b24e-e038-486f-bb69-7278d8aa0635 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:13.450509 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-e958b24e-e038-486f-bb69-7278d8aa0635 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] [instance: ee790a59-a432-4563-a3f9-ab25bb7876b9] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:13.469730 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e958b24e-e038-486f-bb69-7278d8aa0635 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:13.470661 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e958b24e-e038-486f-bb69-7278d8aa0635 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:13.471687 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e958b24e-e038-486f-bb69-7278d8aa0635 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:13.472139 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e958b24e-e038-486f-bb69-7278d8aa0635 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:13.499790 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-e958b24e-e038-486f-bb69-7278d8aa0635 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] [instance: ee790a59-a432-4563-a3f9-ab25bb7876b9] Going to try to terminate instance {{(pid=131321) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:29:13.617088 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-e958b24e-e038-486f-bb69-7278d8aa0635 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] 10.222.0.17 "DELETE /compute/v2.1/servers/ee790a59-a432-4563-a3f9-ab25bb7876b9" status: 204 len: 0 microversion: 2.1 time: 0.175081 Jul 23 21:29:13.618523 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1956/3821] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:29:13 2022] DELETE /compute/v2.1/servers/ee790a59-a432-4563-a3f9-ab25bb7876b9 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:29:13.627393 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9a7e58a0-963b-4b56-b484-c1b6cf4208f9 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:13.628395 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-9a7e58a0-963b-4b56-b484-c1b6cf4208f9 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] [instance: ee790a59-a432-4563-a3f9-ab25bb7876b9] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:13.640491 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9a7e58a0-963b-4b56-b484-c1b6cf4208f9 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:13.641245 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9a7e58a0-963b-4b56-b484-c1b6cf4208f9 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:13.642891 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9a7e58a0-963b-4b56-b484-c1b6cf4208f9 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:13.643526 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9a7e58a0-963b-4b56-b484-c1b6cf4208f9 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:13.797348 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-3b6dadc9-e92d-414b-b82a-5d18b6000d8f tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:13.798663 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-3b6dadc9-e92d-414b-b82a-5d18b6000d8f tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: 274ce0ec-f78b-41cd-8538-2708c52c1c55] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:13.808341 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3b6dadc9-e92d-414b-b82a-5d18b6000d8f tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:13.810984 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3b6dadc9-e92d-414b-b82a-5d18b6000d8f tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:13.812004 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3b6dadc9-e92d-414b-b82a-5d18b6000d8f tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:13.812617 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3b6dadc9-e92d-414b-b82a-5d18b6000d8f tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:13.838351 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-9a7e58a0-963b-4b56-b484-c1b6cf4208f9 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '896f9085718446cd90ce445c09be4741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21695c8a68454c07bd8c466671076897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:13.848830 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9a7e58a0-963b-4b56-b484-c1b6cf4208f9 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] 10.222.0.17 "GET /compute/v2.1/servers/ee790a59-a432-4563-a3f9-ab25bb7876b9" status: 200 len: 1526 microversion: 2.1 time: 0.226354 Jul 23 21:29:13.852380 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1866/3822] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:29:13 2022] GET /compute/v2.1/servers/ee790a59-a432-4563-a3f9-ab25bb7876b9 => generated 1526 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:29:14.106586 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-23a88dde-e4f4-4a86-b7ad-777689c850ea tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:14.107975 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-23a88dde-e4f4-4a86-b7ad-777689c850ea tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:14.122243 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-23a88dde-e4f4-4a86-b7ad-777689c850ea tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:14.123431 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-23a88dde-e4f4-4a86-b7ad-777689c850ea tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:14.127037 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-23a88dde-e4f4-4a86-b7ad-777689c850ea tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:14.128932 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-23a88dde-e4f4-4a86-b7ad-777689c850ea tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:14.269326 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-23a88dde-e4f4-4a86-b7ad-777689c850ea tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:14.289914 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-23a88dde-e4f4-4a86-b7ad-777689c850ea tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:14.291741 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-23a88dde-e4f4-4a86-b7ad-777689c850ea tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:14.293079 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-23a88dde-e4f4-4a86-b7ad-777689c850ea tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.194672 Jul 23 21:29:14.293905 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1867/3823] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:29:14 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:29:14.414327 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-409b851d-9f7b-4451-a79a-2d2a40ce2358 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:14.415010 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-409b851d-9f7b-4451-a79a-2d2a40ce2358 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] [instance: f24f6136-4a47-44f1-9e79-fea1b1cbf057] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:14.427306 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-409b851d-9f7b-4451-a79a-2d2a40ce2358 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:14.429990 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-409b851d-9f7b-4451-a79a-2d2a40ce2358 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:14.431087 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-409b851d-9f7b-4451-a79a-2d2a40ce2358 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:14.431847 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-409b851d-9f7b-4451-a79a-2d2a40ce2358 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:14.437068 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=100 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:14.671302 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-409b851d-9f7b-4451-a79a-2d2a40ce2358 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b566640463e43aa85ec96a1aa76d3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eef3db6d5f46c9882fbe98cb732263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:14.680005 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-409b851d-9f7b-4451-a79a-2d2a40ce2358 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] 10.222.0.17 "GET /compute/v2.1/servers/f24f6136-4a47-44f1-9e79-fea1b1cbf057" status: 200 len: 1504 microversion: 2.1 time: 0.269644 Jul 23 21:29:14.681424 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1868/3824] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:29:14 2022] GET /compute/v2.1/servers/f24f6136-4a47-44f1-9e79-fea1b1cbf057 => generated 1504 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:29:14.687552 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-83ab0d1e-5acf-4d5b-9cf6-e063fc02052d tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:14.689019 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-83ab0d1e-5acf-4d5b-9cf6-e063fc02052d tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: a0a4b52f-fa76-473e-ae4b-48f1bdf7c875] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:14.700326 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-83ab0d1e-5acf-4d5b-9cf6-e063fc02052d tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:14.701128 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-83ab0d1e-5acf-4d5b-9cf6-e063fc02052d tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:14.702681 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-83ab0d1e-5acf-4d5b-9cf6-e063fc02052d tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:14.703382 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-83ab0d1e-5acf-4d5b-9cf6-e063fc02052d tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:14.752050 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:14.823832 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=6 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:14.876438 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-3b6dadc9-e92d-414b-b82a-5d18b6000d8f tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:14.893790 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-3b6dadc9-e92d-414b-b82a-5d18b6000d8f tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/274ce0ec-f78b-41cd-8538-2708c52c1c55" status: 200 len: 1292 microversion: 2.1 time: 1.101222 Jul 23 21:29:14.911567 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1957/3825] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:29:13 2022] GET /compute/v2.1/servers/274ce0ec-f78b-41cd-8538-2708c52c1c55 => generated 1292 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:29:14.922511 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-40ec4515-43a3-4842-8682-7bbcc458a281 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Action: 'create', calling method: .version_select at 0x7f0b47dd8af0>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1540634379", "description": "tempest-description-1148092928"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:29:15.000409 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-83ab0d1e-5acf-4d5b-9cf6-e063fc02052d tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:15.018376 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-83ab0d1e-5acf-4d5b-9cf6-e063fc02052d tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/a0a4b52f-fa76-473e-ae4b-48f1bdf7c875" status: 200 len: 1315 microversion: 2.1 time: 0.332266 Jul 23 21:29:15.034183 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1869/3826] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:29:14 2022] GET /compute/v2.1/servers/a0a4b52f-fa76-473e-ae4b-48f1bdf7c875 => generated 1315 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:29:15.043277 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1e925179-8ce7-4ee3-811f-e44f7fa11684 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:15.044321 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1e925179-8ce7-4ee3-811f-e44f7fa11684 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] [instance: ee790a59-a432-4563-a3f9-ab25bb7876b9] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:15.052215 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1e925179-8ce7-4ee3-811f-e44f7fa11684 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:15.052857 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1e925179-8ce7-4ee3-811f-e44f7fa11684 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:15.054869 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1e925179-8ce7-4ee3-811f-e44f7fa11684 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:15.055541 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1e925179-8ce7-4ee3-811f-e44f7fa11684 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:15.341564 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-1e925179-8ce7-4ee3-811f-e44f7fa11684 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '896f9085718446cd90ce445c09be4741', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21695c8a68454c07bd8c466671076897', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:15.351552 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1e925179-8ce7-4ee3-811f-e44f7fa11684 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] 10.222.0.17 "GET /compute/v2.1/servers/ee790a59-a432-4563-a3f9-ab25bb7876b9" status: 200 len: 1526 microversion: 2.1 time: 0.314671 Jul 23 21:29:15.352161 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1870/3827] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:29:15 2022] GET /compute/v2.1/servers/ee790a59-a432-4563-a3f9-ab25bb7876b9 => generated 1526 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:29:15.361520 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f601e2ca-cb2a-4c1c-aa52-8a4847a73e2b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:15.362210 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f601e2ca-cb2a-4c1c-aa52-8a4847a73e2b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:15.383642 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f601e2ca-cb2a-4c1c-aa52-8a4847a73e2b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:15.384382 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f601e2ca-cb2a-4c1c-aa52-8a4847a73e2b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:15.385341 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f601e2ca-cb2a-4c1c-aa52-8a4847a73e2b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:15.388019 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f601e2ca-cb2a-4c1c-aa52-8a4847a73e2b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:15.452826 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-40ec4515-43a3-4842-8682-7bbcc458a281 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] 10.222.0.17 "POST /compute/v2.1/os-security-groups" status: 200 len: 251 microversion: 2.1 time: 0.539516 Jul 23 21:29:15.453438 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1958/3828] 10.222.0.17 () {60 vars in 1179 bytes} [Sat Jul 23 21:29:14 2022] POST /compute/v2.1/os-security-groups => generated 251 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:29:15.464861 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-409a914a-ccc9-4d02-b0a4-3c669a9a4c25 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1540634379"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:29:15.465545 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-409a914a-ccc9-4d02-b0a4-3c669a9a4c25 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] [instance: f24f6136-4a47-44f1-9e79-fea1b1cbf057] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:15.477609 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-409a914a-ccc9-4d02-b0a4-3c669a9a4c25 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:15.478094 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-409a914a-ccc9-4d02-b0a4-3c669a9a4c25 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:15.487433 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-409a914a-ccc9-4d02-b0a4-3c669a9a4c25 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:15.487917 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-409a914a-ccc9-4d02-b0a4-3c669a9a4c25 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:15.523799 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f601e2ca-cb2a-4c1c-aa52-8a4847a73e2b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:15.540992 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f601e2ca-cb2a-4c1c-aa52-8a4847a73e2b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:15.545159 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f601e2ca-cb2a-4c1c-aa52-8a4847a73e2b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:15.549282 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f601e2ca-cb2a-4c1c-aa52-8a4847a73e2b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.196143 Jul 23 21:29:15.562100 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1871/3829] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:29:15 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:29:15.780500 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-055d1666-c174-4f37-b1e2-d6ea5399037a req-7c84dc90-283d-4485-88ee-1934ba73cc1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0a4b52f-fa76-473e-ae4b-48f1bdf7c875", "tag": "791af44f-6229-414d-8cbb-6c62b7fc606b"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:29:15.830721 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-055d1666-c174-4f37-b1e2-d6ea5399037a req-7c84dc90-283d-4485-88ee-1934ba73cc1f service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:15.832347 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-055d1666-c174-4f37-b1e2-d6ea5399037a req-7c84dc90-283d-4485-88ee-1934ba73cc1f service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:15.896267 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-055d1666-c174-4f37-b1e2-d6ea5399037a req-7c84dc90-283d-4485-88ee-1934ba73cc1f service nova] Creating event network-changed:791af44f-6229-414d-8cbb-6c62b7fc606b for instance a0a4b52f-fa76-473e-ae4b-48f1bdf7c875 on nch1-master-1 Jul 23 21:29:15.919037 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-055d1666-c174-4f37-b1e2-d6ea5399037a req-7c84dc90-283d-4485-88ee-1934ba73cc1f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142036 Jul 23 21:29:15.920209 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1872/3830] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:29:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:29:15.949624 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6e773d4c-8102-46c6-aa55-1437abfb97f8 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:15.967866 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6e773d4c-8102-46c6-aa55-1437abfb97f8 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: 274ce0ec-f78b-41cd-8538-2708c52c1c55] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:16.010293 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6e773d4c-8102-46c6-aa55-1437abfb97f8 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:16.011176 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6e773d4c-8102-46c6-aa55-1437abfb97f8 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:16.014148 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6e773d4c-8102-46c6-aa55-1437abfb97f8 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:16.014942 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.network.security_group_api [None req-409a914a-ccc9-4d02-b0a4-3c669a9a4c25 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Adding security group 3ce77ef1-7896-489e-8e58-5a86c4d3da37 to port fb17bdf4-0872-4074-8623-374df990053a Jul 23 21:29:16.020202 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6e773d4c-8102-46c6-aa55-1437abfb97f8 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:16.595254 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6e773d4c-8102-46c6-aa55-1437abfb97f8 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:16.608670 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6e773d4c-8102-46c6-aa55-1437abfb97f8 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/274ce0ec-f78b-41cd-8538-2708c52c1c55" status: 200 len: 1292 microversion: 2.1 time: 0.681886 Jul 23 21:29:16.611331 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1873/3831] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:29:15 2022] GET /compute/v2.1/servers/274ce0ec-f78b-41cd-8538-2708c52c1c55 => generated 1292 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:29:16.618844 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f4057c0e-e568-4936-b8bc-0809a79a863d tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:16.619770 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f4057c0e-e568-4936-b8bc-0809a79a863d tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: a0a4b52f-fa76-473e-ae4b-48f1bdf7c875] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:16.629959 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f4057c0e-e568-4936-b8bc-0809a79a863d tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:16.630606 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f4057c0e-e568-4936-b8bc-0809a79a863d tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:16.632115 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f4057c0e-e568-4936-b8bc-0809a79a863d tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:16.632859 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f4057c0e-e568-4936-b8bc-0809a79a863d tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:16.888755 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f4057c0e-e568-4936-b8bc-0809a79a863d tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:16.900191 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f4057c0e-e568-4936-b8bc-0809a79a863d tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/a0a4b52f-fa76-473e-ae4b-48f1bdf7c875" status: 200 len: 1315 microversion: 2.1 time: 0.287357 Jul 23 21:29:16.910184 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1874/3832] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:29:16 2022] GET /compute/v2.1/servers/a0a4b52f-fa76-473e-ae4b-48f1bdf7c875 => generated 1315 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:29:17.388761 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-8a6ba2ef-c3fa-4270-8ee1-86caf5499cee req-e307cee6-f07a-4fb6-8993-ca08bb1b6cec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee790a59-a432-4563-a3f9-ab25bb7876b9", "name": "network-vif-deleted", "tag": "f61f4673-2052-484f-bcf5-fa6c5e329c06"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:29:17.408116 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-8a6ba2ef-c3fa-4270-8ee1-86caf5499cee req-e307cee6-f07a-4fb6-8993-ca08bb1b6cec service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:17.408568 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-8a6ba2ef-c3fa-4270-8ee1-86caf5499cee req-e307cee6-f07a-4fb6-8993-ca08bb1b6cec service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:17.428950 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-8a6ba2ef-c3fa-4270-8ee1-86caf5499cee req-e307cee6-f07a-4fb6-8993-ca08bb1b6cec service nova] Creating event network-vif-deleted:f61f4673-2052-484f-bcf5-fa6c5e329c06 for instance ee790a59-a432-4563-a3f9-ab25bb7876b9 on nch2-master-1 Jul 23 21:29:17.443816 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-8a6ba2ef-c3fa-4270-8ee1-86caf5499cee req-e307cee6-f07a-4fb6-8993-ca08bb1b6cec service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.531690 Jul 23 21:29:17.444357 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1875/3833] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:29:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:29:17.458932 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f89da149-d20d-4209-8a52-7b1f9b8ee184 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:17.459704 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f89da149-d20d-4209-8a52-7b1f9b8ee184 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] [instance: ee790a59-a432-4563-a3f9-ab25bb7876b9] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:17.474737 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f89da149-d20d-4209-8a52-7b1f9b8ee184 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:17.475831 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f89da149-d20d-4209-8a52-7b1f9b8ee184 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:17.476652 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f89da149-d20d-4209-8a52-7b1f9b8ee184 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:17.477258 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f89da149-d20d-4209-8a52-7b1f9b8ee184 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:17.511159 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-f89da149-d20d-4209-8a52-7b1f9b8ee184 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] HTTP exception thrown: Instance ee790a59-a432-4563-a3f9-ab25bb7876b9 could not be found. Jul 23 21:29:17.513635 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f89da149-d20d-4209-8a52-7b1f9b8ee184 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Request method failure captured: Jul 23 21:29:17.513635 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/ee790a59-a432-4563-a3f9-ab25bb7876b9 HTTP/1.1 Jul 23 21:29:17.513635 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:29:17.513635 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:29:17.513635 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:29:17.513635 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:29:17.513635 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:29:17.513635 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:29:17.513635 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:29:17.513635 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:29:17.513635 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GgSS9T1_704KiFFTD4viB5qsKA9veci1lemME3yJoYkOzDIG8_qt-pXPsS5CTIEqCLMF03XQneenVBzTPeHqzwO2GQz71W524BdLf7fd9643cmSH09DLz93jaWVXy8SonmHsdRoszyUmyBRWUyAzeN1UvNAx6yUwGreYJLsM9fvv1g Jul 23 21:29:17.513635 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:29:17.513635 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:29:17.513635 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:29:17.513635 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:29:17.513635 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:29:17.513635 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:29:17.513635 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 21695c8a68454c07bd8c466671076897 Jul 23 21:29:17.513635 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-805858935 Jul 23 21:29:17.513635 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:29:17.513635 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:29:17.513635 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/21695c8a68454c07bd8c466671076897"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/21695c8a68454c07bd8c466671076897"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_21695c8a68454c07bd8c466671076897", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/21695c8a68454c07bd8c466671076897"}]}] Jul 23 21:29:17.513635 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-805858935 Jul 23 21:29:17.513635 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 21695c8a68454c07bd8c466671076897 Jul 23 21:29:17.513635 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-805858935 Jul 23 21:29:17.513635 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-InstanceActionsNegativeTestJSON-805858935-project Jul 23 21:29:17.513635 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:29:17.513635 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:29:17.513635 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 896f9085718446cd90ce445c09be4741 Jul 23 21:29:17.513635 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-805858935-project Jul 23 21:29:17.513635 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:29:17.513635 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance ee790a59-a432-4563-a3f9-ab25bb7876b9 could not be found. Jul 23 21:29:17.513635 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': 'ee790a59-a432-4563-a3f9-ab25bb7876b9'} Jul 23 21:29:17.513635 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:29:17.513635 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:29:17.513635 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:29:17.513635 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:29:17.513635 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:29:17.513635 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:29:17.513635 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:29:17.513635 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:29:17.513635 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:29:17.513635 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:29:17.513635 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee790a59-a432-4563-a3f9-ab25bb7876b9 could not be found. Jul 23 21:29:17.513635 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:29:17.513635 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:29:17.513635 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:29:17.513635 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:29:17.513635 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:29:17.513635 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:29:17.513635 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:29:17.513635 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:29:17.513635 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:29:17.513635 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:29:17.513635 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:29:17.513635 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:29:17.513635 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:29:17.513635 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:29:17.513635 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:29:17.513635 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:29:17.513635 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee790a59-a432-4563-a3f9-ab25bb7876b9 could not be found. Jul 23 21:29:17.513635 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:29:17.513635 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:29:17.518581 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:29:17.518581 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:29:17.518581 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:29:17.518581 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:29:17.518581 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:29:17.518581 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:29:17.518581 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee790a59-a432-4563-a3f9-ab25bb7876b9 could not be found. Jul 23 21:29:17.518581 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:29:17.520823 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f89da149-d20d-4209-8a52-7b1f9b8ee184 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] Returning 404 to user: Instance ee790a59-a432-4563-a3f9-ab25bb7876b9 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:29:17.521977 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f89da149-d20d-4209-8a52-7b1f9b8ee184 tempest-InstanceActionsNegativeTestJSON-805858935 tempest-InstanceActionsNegativeTestJSON-805858935-project] 10.222.0.17 "GET /compute/v2.1/servers/ee790a59-a432-4563-a3f9-ab25bb7876b9" status: 404 len: 111 microversion: 2.1 time: 0.067816 Jul 23 21:29:17.524207 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1876/3834] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:29:17 2022] GET /compute/v2.1/servers/ee790a59-a432-4563-a3f9-ab25bb7876b9 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:29:17.537378 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d9f00854-69cc-4376-aa3e-d38d0d107cb1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:17.538762 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d9f00854-69cc-4376-aa3e-d38d0d107cb1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:17.550880 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d9f00854-69cc-4376-aa3e-d38d0d107cb1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:17.551626 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d9f00854-69cc-4376-aa3e-d38d0d107cb1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:17.552823 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d9f00854-69cc-4376-aa3e-d38d0d107cb1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:17.553671 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d9f00854-69cc-4376-aa3e-d38d0d107cb1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:17.775355 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-409a914a-ccc9-4d02-b0a4-3c669a9a4c25 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] 10.222.0.17 "POST /compute/v2.1/servers/f24f6136-4a47-44f1-9e79-fea1b1cbf057/action" status: 202 len: 0 microversion: 2.1 time: 2.314255 Jul 23 21:29:17.779214 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1959/3835] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:29:15 2022] POST /compute/v2.1/servers/f24f6136-4a47-44f1-9e79-fea1b1cbf057/action => generated 0 bytes in 2316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:29:17.781553 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-8326b1d1-0702-4780-8fa7-06e4ddd5b8b0 req-00e3cab5-e274-4344-84cc-a18773b63aa0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "274ce0ec-f78b-41cd-8538-2708c52c1c55", "name": "network-vif-plugged", "status": "completed", "tag": "dcaef018-3af8-4f24-90ac-5c35c064677a"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:29:17.803100 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-8326b1d1-0702-4780-8fa7-06e4ddd5b8b0 req-00e3cab5-e274-4344-84cc-a18773b63aa0 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:17.803549 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-8326b1d1-0702-4780-8fa7-06e4ddd5b8b0 req-00e3cab5-e274-4344-84cc-a18773b63aa0 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:17.803739 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d9f00854-69cc-4376-aa3e-d38d0d107cb1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:17.819741 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d9f00854-69cc-4376-aa3e-d38d0d107cb1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:17.824189 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d9f00854-69cc-4376-aa3e-d38d0d107cb1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:17.834088 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d9f00854-69cc-4376-aa3e-d38d0d107cb1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.306258 Jul 23 21:29:17.835215 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1877/3836] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:29:17 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:29:17.842139 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3889d71f-f3df-4ea3-b217-f9fd752c01fa tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:17.843117 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-3889d71f-f3df-4ea3-b217-f9fd752c01fa tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: 274ce0ec-f78b-41cd-8538-2708c52c1c55] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:17.853459 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-8326b1d1-0702-4780-8fa7-06e4ddd5b8b0 req-00e3cab5-e274-4344-84cc-a18773b63aa0 service nova] Creating event network-vif-plugged:dcaef018-3af8-4f24-90ac-5c35c064677a for instance 274ce0ec-f78b-41cd-8538-2708c52c1c55 on nch1-master-1 Jul 23 21:29:17.868399 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-8326b1d1-0702-4780-8fa7-06e4ddd5b8b0 req-00e3cab5-e274-4344-84cc-a18773b63aa0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090588 Jul 23 21:29:17.868655 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3889d71f-f3df-4ea3-b217-f9fd752c01fa tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:17.868848 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3889d71f-f3df-4ea3-b217-f9fd752c01fa tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:17.869617 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1960/3837] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:29:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:29:17.873301 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3889d71f-f3df-4ea3-b217-f9fd752c01fa tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:17.874986 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3889d71f-f3df-4ea3-b217-f9fd752c01fa tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:17.881915 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-88e68004-5bfa-44c5-aec6-1bace141f5f7 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1540634379"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:29:17.887400 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-88e68004-5bfa-44c5-aec6-1bace141f5f7 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] [instance: f24f6136-4a47-44f1-9e79-fea1b1cbf057] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:17.902959 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-88e68004-5bfa-44c5-aec6-1bace141f5f7 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:17.903528 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-88e68004-5bfa-44c5-aec6-1bace141f5f7 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:17.904428 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-88e68004-5bfa-44c5-aec6-1bace141f5f7 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:17.904975 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-88e68004-5bfa-44c5-aec6-1bace141f5f7 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:18.332014 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-3889d71f-f3df-4ea3-b217-f9fd752c01fa tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:18.348479 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-3889d71f-f3df-4ea3-b217-f9fd752c01fa tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/274ce0ec-f78b-41cd-8538-2708c52c1c55" status: 200 len: 1292 microversion: 2.1 time: 0.504371 Jul 23 21:29:18.358368 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1878/3838] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:29:17 2022] GET /compute/v2.1/servers/274ce0ec-f78b-41cd-8538-2708c52c1c55 => generated 1292 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:29:18.361592 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-dbb3929d-8f3e-4c4a-a8db-3982b3d65d64 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:18.362253 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-dbb3929d-8f3e-4c4a-a8db-3982b3d65d64 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: a0a4b52f-fa76-473e-ae4b-48f1bdf7c875] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:18.373635 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dbb3929d-8f3e-4c4a-a8db-3982b3d65d64 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:18.381112 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dbb3929d-8f3e-4c4a-a8db-3982b3d65d64 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:18.382280 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dbb3929d-8f3e-4c4a-a8db-3982b3d65d64 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:18.384675 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dbb3929d-8f3e-4c4a-a8db-3982b3d65d64 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:18.720990 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell0:SELECT=2 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:18.723890 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-dbb3929d-8f3e-4c4a-a8db-3982b3d65d64 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:18.734920 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-dbb3929d-8f3e-4c4a-a8db-3982b3d65d64 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/a0a4b52f-fa76-473e-ae4b-48f1bdf7c875" status: 200 len: 1315 microversion: 2.1 time: 0.380512 Jul 23 21:29:18.744969 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1879/3839] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:29:18 2022] GET /compute/v2.1/servers/a0a4b52f-fa76-473e-ae4b-48f1bdf7c875 => generated 1315 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:29:18.748406 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-67141247-a5c5-477f-b583-6842e81c8865 req-16488b5f-cd08-4cb3-b9ab-38bf7ccd30a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f24f6136-4a47-44f1-9e79-fea1b1cbf057", "tag": "fb17bdf4-0872-4074-8623-374df990053a"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:29:18.764776 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-67141247-a5c5-477f-b583-6842e81c8865 req-16488b5f-cd08-4cb3-b9ab-38bf7ccd30a7 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:18.770585 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-67141247-a5c5-477f-b583-6842e81c8865 req-16488b5f-cd08-4cb3-b9ab-38bf7ccd30a7 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:18.797662 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-67141247-a5c5-477f-b583-6842e81c8865 req-16488b5f-cd08-4cb3-b9ab-38bf7ccd30a7 service nova] Creating event network-changed:fb17bdf4-0872-4074-8623-374df990053a for instance f24f6136-4a47-44f1-9e79-fea1b1cbf057 on nch2-master-1 Jul 23 21:29:18.804424 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-67141247-a5c5-477f-b583-6842e81c8865 req-16488b5f-cd08-4cb3-b9ab-38bf7ccd30a7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065625 Jul 23 21:29:18.806663 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1880/3840] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:29:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:29:18.854891 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c6f51e6c-eb0b-429d-bf88-191a3c05fc62 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:18.856161 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c6f51e6c-eb0b-429d-bf88-191a3c05fc62 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:18.874277 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c6f51e6c-eb0b-429d-bf88-191a3c05fc62 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:18.875241 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c6f51e6c-eb0b-429d-bf88-191a3c05fc62 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:18.876546 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c6f51e6c-eb0b-429d-bf88-191a3c05fc62 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:18.877374 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c6f51e6c-eb0b-429d-bf88-191a3c05fc62 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:19.017392 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell0:SELECT=10 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:19.052255 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.network.security_group_api [None req-88e68004-5bfa-44c5-aec6-1bace141f5f7 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Removing security group 3ce77ef1-7896-489e-8e58-5a86c4d3da37 from port fb17bdf4-0872-4074-8623-374df990053a Jul 23 21:29:19.077771 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c6f51e6c-eb0b-429d-bf88-191a3c05fc62 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:19.090205 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c6f51e6c-eb0b-429d-bf88-191a3c05fc62 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:19.091713 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c6f51e6c-eb0b-429d-bf88-191a3c05fc62 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:19.092928 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c6f51e6c-eb0b-429d-bf88-191a3c05fc62 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.243623 Jul 23 21:29:19.103894 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1881/3841] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:29:18 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:29:19.369117 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-00e19a6e-da30-4b15-8b81-83a6c9a1a6f4 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:19.369845 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-00e19a6e-da30-4b15-8b81-83a6c9a1a6f4 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: 274ce0ec-f78b-41cd-8538-2708c52c1c55] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:19.381232 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-00e19a6e-da30-4b15-8b81-83a6c9a1a6f4 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:19.381703 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-00e19a6e-da30-4b15-8b81-83a6c9a1a6f4 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:19.382774 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-00e19a6e-da30-4b15-8b81-83a6c9a1a6f4 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:19.386341 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-00e19a6e-da30-4b15-8b81-83a6c9a1a6f4 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:19.892941 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-00e19a6e-da30-4b15-8b81-83a6c9a1a6f4 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:19.912703 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-00e19a6e-da30-4b15-8b81-83a6c9a1a6f4 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/274ce0ec-f78b-41cd-8538-2708c52c1c55" status: 200 len: 1292 microversion: 2.1 time: 0.547770 Jul 23 21:29:19.914483 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1882/3842] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:29:19 2022] GET /compute/v2.1/servers/274ce0ec-f78b-41cd-8538-2708c52c1c55 => generated 1292 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:29:19.926865 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-7ab6b18d-e22d-42c5-b0a6-bd3dbf426edd tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:19.928535 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-7ab6b18d-e22d-42c5-b0a6-bd3dbf426edd tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: a0a4b52f-fa76-473e-ae4b-48f1bdf7c875] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:19.942727 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7ab6b18d-e22d-42c5-b0a6-bd3dbf426edd tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:19.943875 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7ab6b18d-e22d-42c5-b0a6-bd3dbf426edd tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:19.945726 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7ab6b18d-e22d-42c5-b0a6-bd3dbf426edd tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:19.946762 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7ab6b18d-e22d-42c5-b0a6-bd3dbf426edd tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:20.267629 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-88e68004-5bfa-44c5-aec6-1bace141f5f7 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] 10.222.0.17 "POST /compute/v2.1/servers/f24f6136-4a47-44f1-9e79-fea1b1cbf057/action" status: 202 len: 0 microversion: 2.1 time: 2.392757 Jul 23 21:29:20.268834 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1961/3843] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:29:17 2022] POST /compute/v2.1/servers/f24f6136-4a47-44f1-9e79-fea1b1cbf057/action => generated 0 bytes in 2395 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:29:20.275347 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-5e1d26fa-ca6e-4228-afa7-9f8c3abeb0c1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:20.276225 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-5e1d26fa-ca6e-4228-afa7-9f8c3abeb0c1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:20.290991 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5e1d26fa-ca6e-4228-afa7-9f8c3abeb0c1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:20.294594 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5e1d26fa-ca6e-4228-afa7-9f8c3abeb0c1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:20.295760 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5e1d26fa-ca6e-4228-afa7-9f8c3abeb0c1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:20.302614 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5e1d26fa-ca6e-4228-afa7-9f8c3abeb0c1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:20.448107 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-5e1d26fa-ca6e-4228-afa7-9f8c3abeb0c1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:20.460580 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-5e1d26fa-ca6e-4228-afa7-9f8c3abeb0c1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:20.462137 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-5e1d26fa-ca6e-4228-afa7-9f8c3abeb0c1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:20.463361 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-5e1d26fa-ca6e-4228-afa7-9f8c3abeb0c1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.193419 Jul 23 21:29:20.463949 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1962/3844] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:29:20 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:29:20.488573 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-87e55d1d-88f7-492c-81d6-dd176389c39f tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Action: 'create', calling method: .version_select at 0x7f0b47cc4ee0>, body: {"pool": null} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:29:21.118179 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-7ab6b18d-e22d-42c5-b0a6-bd3dbf426edd tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:21.127973 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-7ab6b18d-e22d-42c5-b0a6-bd3dbf426edd tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/a0a4b52f-fa76-473e-ae4b-48f1bdf7c875" status: 200 len: 1315 microversion: 2.1 time: 1.211081 Jul 23 21:29:21.133059 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1883/3845] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:29:19 2022] GET /compute/v2.1/servers/a0a4b52f-fa76-473e-ae4b-48f1bdf7c875 => generated 1315 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:29:21.143625 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4059b859-9093-4036-8db8-41c3eaf701a6 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:21.144252 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-4059b859-9093-4036-8db8-41c3eaf701a6 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: 274ce0ec-f78b-41cd-8538-2708c52c1c55] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:21.159420 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4059b859-9093-4036-8db8-41c3eaf701a6 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:21.159973 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4059b859-9093-4036-8db8-41c3eaf701a6 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:21.163219 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4059b859-9093-4036-8db8-41c3eaf701a6 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:21.164417 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4059b859-9093-4036-8db8-41c3eaf701a6 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:21.819926 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-4059b859-9093-4036-8db8-41c3eaf701a6 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:21.835096 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4059b859-9093-4036-8db8-41c3eaf701a6 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/274ce0ec-f78b-41cd-8538-2708c52c1c55" status: 200 len: 1474 microversion: 2.1 time: 0.700260 Jul 23 21:29:21.835618 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1884/3846] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:29:21 2022] GET /compute/v2.1/servers/274ce0ec-f78b-41cd-8538-2708c52c1c55 => generated 1474 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:29:21.844734 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-705aba34-586d-4972-8d5c-2dac0c7e7666 req-a3ff98cc-a689-4be1-ba81-b07ea6ce2573 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f24f6136-4a47-44f1-9e79-fea1b1cbf057", "tag": "fb17bdf4-0872-4074-8623-374df990053a"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:29:21.865804 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-705aba34-586d-4972-8d5c-2dac0c7e7666 req-a3ff98cc-a689-4be1-ba81-b07ea6ce2573 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:21.866639 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-705aba34-586d-4972-8d5c-2dac0c7e7666 req-a3ff98cc-a689-4be1-ba81-b07ea6ce2573 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:21.897680 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-705aba34-586d-4972-8d5c-2dac0c7e7666 req-a3ff98cc-a689-4be1-ba81-b07ea6ce2573 service nova] Creating event network-changed:fb17bdf4-0872-4074-8623-374df990053a for instance f24f6136-4a47-44f1-9e79-fea1b1cbf057 on nch2-master-1 Jul 23 21:29:21.910693 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-705aba34-586d-4972-8d5c-2dac0c7e7666 req-a3ff98cc-a689-4be1-ba81-b07ea6ce2573 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070891 Jul 23 21:29:21.914410 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1885/3847] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:29:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:29:21.937911 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-17d2434a-d40e-4580-b985-c8fd3e939834 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:21.939791 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-17d2434a-d40e-4580-b985-c8fd3e939834 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:21.949316 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-17d2434a-d40e-4580-b985-c8fd3e939834 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:21.955442 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-17d2434a-d40e-4580-b985-c8fd3e939834 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:21.958984 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-17d2434a-d40e-4580-b985-c8fd3e939834 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:21.961936 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-17d2434a-d40e-4580-b985-c8fd3e939834 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:22.236967 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-17d2434a-d40e-4580-b985-c8fd3e939834 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:22.267512 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-17d2434a-d40e-4580-b985-c8fd3e939834 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:22.270036 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-17d2434a-d40e-4580-b985-c8fd3e939834 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:22.271642 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-17d2434a-d40e-4580-b985-c8fd3e939834 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.355820 Jul 23 21:29:22.272436 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1886/3848] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:29:21 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:29:22.289855 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-4ac91365-2d62-49ae-88fa-527b778928df req-8e4543b7-2e5d-4b62-949c-ca3a6688afc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0a4b52f-fa76-473e-ae4b-48f1bdf7c875", "name": "network-vif-plugged", "status": "completed", "tag": "791af44f-6229-414d-8cbb-6c62b7fc606b"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:29:22.309687 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-4ac91365-2d62-49ae-88fa-527b778928df req-8e4543b7-2e5d-4b62-949c-ca3a6688afc8 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:22.310507 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-4ac91365-2d62-49ae-88fa-527b778928df req-8e4543b7-2e5d-4b62-949c-ca3a6688afc8 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:22.336929 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-4ac91365-2d62-49ae-88fa-527b778928df req-8e4543b7-2e5d-4b62-949c-ca3a6688afc8 service nova] Creating event network-vif-plugged:791af44f-6229-414d-8cbb-6c62b7fc606b for instance a0a4b52f-fa76-473e-ae4b-48f1bdf7c875 on nch1-master-1 Jul 23 21:29:22.352765 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-4ac91365-2d62-49ae-88fa-527b778928df req-8e4543b7-2e5d-4b62-949c-ca3a6688afc8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075074 Jul 23 21:29:22.359230 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1887/3849] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:29:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:29:22.380917 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-350c3bae-4712-43d1-aefe-afcf1a34be33 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1063319072", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:29:22.493986 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-350c3bae-4712-43d1-aefe-afcf1a34be33 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] validate_networks() for [('63d253f9-5d83-4f00-8bc3-28f418cf7611', None, None, None, None, None)] {{(pid=131320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:29:23.472316 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-87e55d1d-88f7-492c-81d6-dd176389c39f tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] 10.222.0.17 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.007273 Jul 23 21:29:23.473959 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1963/3850] 10.222.0.17 () {60 vars in 1169 bytes} [Sat Jul 23 21:29:20 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3009 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:29:23.480165 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ea884d5b-fa0a-417d-9e8e-a30fc5938fda tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:23.481069 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-ea884d5b-fa0a-417d-9e8e-a30fc5938fda tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: a0a4b52f-fa76-473e-ae4b-48f1bdf7c875] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:23.503794 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ea884d5b-fa0a-417d-9e8e-a30fc5938fda tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:23.507798 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ea884d5b-fa0a-417d-9e8e-a30fc5938fda tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:23.509418 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ea884d5b-fa0a-417d-9e8e-a30fc5938fda tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:23.510127 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ea884d5b-fa0a-417d-9e8e-a30fc5938fda tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:23.776696 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ea884d5b-fa0a-417d-9e8e-a30fc5938fda tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:23.786685 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-ea884d5b-fa0a-417d-9e8e-a30fc5938fda tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/a0a4b52f-fa76-473e-ae4b-48f1bdf7c875" status: 200 len: 1315 microversion: 2.1 time: 0.311449 Jul 23 21:29:23.790647 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1964/3851] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:29:23 2022] GET /compute/v2.1/servers/a0a4b52f-fa76-473e-ae4b-48f1bdf7c875 => generated 1315 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:29:23.805904 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-5b6885a1-f74a-4341-9c35-d104cb0e56a7 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:23.806863 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-5b6885a1-f74a-4341-9c35-d104cb0e56a7 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:23.814484 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5b6885a1-f74a-4341-9c35-d104cb0e56a7 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:23.815227 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5b6885a1-f74a-4341-9c35-d104cb0e56a7 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:23.816226 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5b6885a1-f74a-4341-9c35-d104cb0e56a7 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:23.816892 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5b6885a1-f74a-4341-9c35-d104cb0e56a7 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:23.934623 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-5b6885a1-f74a-4341-9c35-d104cb0e56a7 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:23.950049 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-5b6885a1-f74a-4341-9c35-d104cb0e56a7 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:23.950049 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-5b6885a1-f74a-4341-9c35-d104cb0e56a7 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:23.965701 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-5b6885a1-f74a-4341-9c35-d104cb0e56a7 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.163943 Jul 23 21:29:23.966400 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1965/3852] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:29:23 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:29:23.972758 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-fed4bbcc-c721-408b-9bb7-fc0cd7f9db09 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.4.216"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:29:23.976072 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-fed4bbcc-c721-408b-9bb7-fc0cd7f9db09 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] [instance: f24f6136-4a47-44f1-9e79-fea1b1cbf057] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:23.991434 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fed4bbcc-c721-408b-9bb7-fc0cd7f9db09 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:23.993198 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fed4bbcc-c721-408b-9bb7-fc0cd7f9db09 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:23.995078 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fed4bbcc-c721-408b-9bb7-fc0cd7f9db09 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:23.996152 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fed4bbcc-c721-408b-9bb7-fc0cd7f9db09 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:24.051502 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fed4bbcc-c721-408b-9bb7-fc0cd7f9db09 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Acquired lock "refresh_cache-f24f6136-4a47-44f1-9e79-fea1b1cbf057" {{(pid=131321) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 23 21:29:24.332759 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-350c3bae-4712-43d1-aefe-afcf1a34be33 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:29:24.333725 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-350c3bae-4712-43d1-aefe-afcf1a34be33 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:29:24.334650 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-350c3bae-4712-43d1-aefe-afcf1a34be33 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:29:24.335230 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-350c3bae-4712-43d1-aefe-afcf1a34be33 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:29:24.336165 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-350c3bae-4712-43d1-aefe-afcf1a34be33 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:29:24.356690 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-350c3bae-4712-43d1-aefe-afcf1a34be33 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:24.359786 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-350c3bae-4712-43d1-aefe-afcf1a34be33 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:24.363239 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-350c3bae-4712-43d1-aefe-afcf1a34be33 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:24.363937 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-350c3bae-4712-43d1-aefe-afcf1a34be33 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:24.416459 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-350c3bae-4712-43d1-aefe-afcf1a34be33 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Getting quotas for project 1890022bd460485dae0ea94b152a6746. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:29:24.431399 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-350c3bae-4712-43d1-aefe-afcf1a34be33 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Getting quotas for user 5efda1c40f494592bf1e6af1add120f3 and project 1890022bd460485dae0ea94b152a6746. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:29:24.471292 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-350c3bae-4712-43d1-aefe-afcf1a34be33 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Going to run 1 instances... {{(pid=131320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:29:24.478389 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-350c3bae-4712-43d1-aefe-afcf1a34be33 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: e7c04296-7707-4783-81e2-3cad733754c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:29:24.577055 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-350c3bae-4712-43d1-aefe-afcf1a34be33 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.214476 Jul 23 21:29:24.584055 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1888/3853] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:29:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 2218 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 23 21:29:24.589051 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3315ce68-a1ee-47bc-98c0-449ccc384e59 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:24.590802 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-3315ce68-a1ee-47bc-98c0-449ccc384e59 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: e7c04296-7707-4783-81e2-3cad733754c5] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:24.630049 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-3315ce68-a1ee-47bc-98c0-449ccc384e59 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: e7c04296-7707-4783-81e2-3cad733754c5] Going to try to terminate instance {{(pid=131320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:29:24.857057 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-3315ce68-a1ee-47bc-98c0-449ccc384e59 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "DELETE /compute/v2.1/servers/e7c04296-7707-4783-81e2-3cad733754c5" status: 204 len: 0 microversion: 2.1 time: 0.272385 Jul 23 21:29:24.863946 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1889/3854] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:29:24 2022] DELETE /compute/v2.1/servers/e7c04296-7707-4783-81e2-3cad733754c5 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:29:24.869727 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-7b18dc65-8396-4846-b8a4-3a0ec5890999 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:24.870970 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-7b18dc65-8396-4846-b8a4-3a0ec5890999 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: a0a4b52f-fa76-473e-ae4b-48f1bdf7c875] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:24.882325 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7b18dc65-8396-4846-b8a4-3a0ec5890999 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:24.883184 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7b18dc65-8396-4846-b8a4-3a0ec5890999 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:24.886494 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7b18dc65-8396-4846-b8a4-3a0ec5890999 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:24.887065 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7b18dc65-8396-4846-b8a4-3a0ec5890999 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:24.934552 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=100 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:25.902070 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-7b18dc65-8396-4846-b8a4-3a0ec5890999 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:25.914463 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-7b18dc65-8396-4846-b8a4-3a0ec5890999 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/a0a4b52f-fa76-473e-ae4b-48f1bdf7c875" status: 200 len: 1502 microversion: 2.1 time: 1.049024 Jul 23 21:29:25.917761 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1890/3855] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:29:24 2022] GET /compute/v2.1/servers/a0a4b52f-fa76-473e-ae4b-48f1bdf7c875 => generated 1502 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:29:25.930204 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e8ec206c-89b1-4b72-8879-8cc51391ff49 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:25.931145 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e8ec206c-89b1-4b72-8879-8cc51391ff49 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: e7c04296-7707-4783-81e2-3cad733754c5] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:25.958737 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-e8ec206c-89b1-4b72-8879-8cc51391ff49 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] HTTP exception thrown: Instance e7c04296-7707-4783-81e2-3cad733754c5 could not be found. Jul 23 21:29:25.963918 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e8ec206c-89b1-4b72-8879-8cc51391ff49 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Request method failure captured: Jul 23 21:29:25.963918 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/e7c04296-7707-4783-81e2-3cad733754c5 HTTP/1.1 Jul 23 21:29:25.963918 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:29:25.963918 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:29:25.963918 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:29:25.963918 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:29:25.963918 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:29:25.963918 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:29:25.963918 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:29:25.963918 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:29:25.963918 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GgexSaJTA-FXaV5LcqTAteOVESwOg7zac7nwUa59CGOHDwwWd7w7HKC8R65F9X48OwLZ_a8UsJYui6X5BG5uL_WJC-ysEg9nxrojp43TnKgPHTkujcdOw9VWLxqM9CE8dPwhawUMo8jE8x_rLu-o0j9Xf_QveShH-OlX4BIDLcYoyo Jul 23 21:29:25.963918 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:29:25.963918 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:29:25.963918 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:29:25.963918 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:29:25.963918 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:29:25.963918 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:29:25.963918 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 1890022bd460485dae0ea94b152a6746 Jul 23 21:29:25.963918 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServersTestJSON-1141465764 Jul 23 21:29:25.963918 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:29:25.963918 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:29:25.963918 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1890022bd460485dae0ea94b152a6746"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1890022bd460485dae0ea94b152a6746"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1890022bd460485dae0ea94b152a6746", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1890022bd460485dae0ea94b152a6746"}]}] Jul 23 21:29:25.963918 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServersTestJSON-1141465764 Jul 23 21:29:25.963918 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 1890022bd460485dae0ea94b152a6746 Jul 23 21:29:25.963918 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServersTestJSON-1141465764 Jul 23 21:29:25.963918 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServersTestJSON-1141465764-project Jul 23 21:29:25.963918 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:29:25.963918 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:29:25.963918 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 5efda1c40f494592bf1e6af1add120f3 Jul 23 21:29:25.963918 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServersTestJSON-1141465764-project Jul 23 21:29:25.963918 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:29:25.963918 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance e7c04296-7707-4783-81e2-3cad733754c5 could not be found. Jul 23 21:29:25.963918 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': 'e7c04296-7707-4783-81e2-3cad733754c5'} Jul 23 21:29:25.963918 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:29:25.963918 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:29:25.963918 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:29:25.963918 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:29:25.963918 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:29:25.963918 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:29:25.963918 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 23 21:29:25.963918 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 23 21:29:25.963918 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7c04296-7707-4783-81e2-3cad733754c5 could not be found. Jul 23 21:29:25.963918 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:29:25.963918 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:29:25.963918 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:29:25.963918 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:29:25.963918 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:29:25.963918 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:29:25.963918 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:29:25.963918 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:29:25.963918 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:29:25.963918 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:29:25.963918 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:29:25.963918 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:29:25.963918 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:29:25.963918 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:29:25.963918 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:29:25.963918 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:29:25.963918 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7c04296-7707-4783-81e2-3cad733754c5 could not be found. Jul 23 21:29:25.963918 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:29:25.963918 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:29:25.963918 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:29:25.963918 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:29:25.963918 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:29:25.963918 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:29:25.968779 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:29:25.968779 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:29:25.968779 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7c04296-7707-4783-81e2-3cad733754c5 could not be found. Jul 23 21:29:25.968779 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:29:25.973007 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e8ec206c-89b1-4b72-8879-8cc51391ff49 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Returning 404 to user: Instance e7c04296-7707-4783-81e2-3cad733754c5 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:29:25.976001 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e8ec206c-89b1-4b72-8879-8cc51391ff49 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/e7c04296-7707-4783-81e2-3cad733754c5" status: 404 len: 111 microversion: 2.1 time: 0.054596 Jul 23 21:29:25.980876 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1891/3856] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:29:25 2022] GET /compute/v2.1/servers/e7c04296-7707-4783-81e2-3cad733754c5 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:29:25.989006 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-52ba52be-1c66-40bc-8824-dcba8d0dc7ec tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:25.995011 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-52ba52be-1c66-40bc-8824-dcba8d0dc7ec tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:26.014933 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-52ba52be-1c66-40bc-8824-dcba8d0dc7ec tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:26.020403 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-52ba52be-1c66-40bc-8824-dcba8d0dc7ec tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:26.024880 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-52ba52be-1c66-40bc-8824-dcba8d0dc7ec tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:26.025627 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-52ba52be-1c66-40bc-8824-dcba8d0dc7ec tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:26.215992 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-52ba52be-1c66-40bc-8824-dcba8d0dc7ec tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:26.236307 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-52ba52be-1c66-40bc-8824-dcba8d0dc7ec tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:26.239017 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-52ba52be-1c66-40bc-8824-dcba8d0dc7ec tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:26.240581 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-52ba52be-1c66-40bc-8824-dcba8d0dc7ec tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.258410 Jul 23 21:29:26.242349 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1892/3857] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:29:25 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:29:26.249459 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5d1f65f8-86fb-47f8-ae98-affcbe9544d0 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:29:26.250292 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5d1f65f8-86fb-47f8-ae98-affcbe9544d0 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: a0a4b52f-fa76-473e-ae4b-48f1bdf7c875] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:26.258690 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5d1f65f8-86fb-47f8-ae98-affcbe9544d0 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:26.259432 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5d1f65f8-86fb-47f8-ae98-affcbe9544d0 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:26.260229 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5d1f65f8-86fb-47f8-ae98-affcbe9544d0 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:26.260653 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5d1f65f8-86fb-47f8-ae98-affcbe9544d0 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:26.290997 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.objects.instance [None req-5d1f65f8-86fb-47f8-ae98-affcbe9544d0 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lazy-loading 'flavor' on Instance uuid a0a4b52f-fa76-473e-ae4b-48f1bdf7c875 {{(pid=131320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:29:26.406633 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5d1f65f8-86fb-47f8-ae98-affcbe9544d0 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "POST /compute/v2.1/servers/a0a4b52f-fa76-473e-ae4b-48f1bdf7c875/action" status: 202 len: 0 microversion: 2.1 time: 0.162277 Jul 23 21:29:26.425166 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1893/3858] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:29:26 2022] POST /compute/v2.1/servers/a0a4b52f-fa76-473e-ae4b-48f1bdf7c875/action => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:29:26.435997 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-94fc5e14-b8a9-4ca9-b9a2-c9a4daffd347 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1184984485", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "63d253f9-5d83-4f00-8bc3-28f418cf7611"}]}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:29:26.463568 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:26.548834 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-94fc5e14-b8a9-4ca9-b9a2-c9a4daffd347 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] validate_networks() for [('63d253f9-5d83-4f00-8bc3-28f418cf7611', None, None, None, None, None)] {{(pid=131320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:29:26.965218 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.network.neutron [None req-fed4bbcc-c721-408b-9bb7-fc0cd7f9db09 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] [instance: f24f6136-4a47-44f1-9e79-fea1b1cbf057] Building network info cache for instance {{(pid=131321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 23 21:29:27.783652 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-94fc5e14-b8a9-4ca9-b9a2-c9a4daffd347 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:29:27.784854 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-94fc5e14-b8a9-4ca9-b9a2-c9a4daffd347 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:29:27.785572 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-94fc5e14-b8a9-4ca9-b9a2-c9a4daffd347 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:29:27.786259 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-94fc5e14-b8a9-4ca9-b9a2-c9a4daffd347 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:29:27.787856 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-94fc5e14-b8a9-4ca9-b9a2-c9a4daffd347 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:29:27.803278 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-94fc5e14-b8a9-4ca9-b9a2-c9a4daffd347 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:27.804051 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-94fc5e14-b8a9-4ca9-b9a2-c9a4daffd347 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:27.805160 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-94fc5e14-b8a9-4ca9-b9a2-c9a4daffd347 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:27.805851 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-94fc5e14-b8a9-4ca9-b9a2-c9a4daffd347 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:27.847295 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-94fc5e14-b8a9-4ca9-b9a2-c9a4daffd347 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Getting quotas for project 1890022bd460485dae0ea94b152a6746. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:29:27.853302 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-94fc5e14-b8a9-4ca9-b9a2-c9a4daffd347 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Getting quotas for user 5efda1c40f494592bf1e6af1add120f3 and project 1890022bd460485dae0ea94b152a6746. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:29:27.879604 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-94fc5e14-b8a9-4ca9-b9a2-c9a4daffd347 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Going to run 1 instances... {{(pid=131320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:29:27.882450 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-94fc5e14-b8a9-4ca9-b9a2-c9a4daffd347 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: e9a7d9eb-cfeb-4392-9b44-3dc592d9ebd8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:29:28.016369 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-94fc5e14-b8a9-4ca9-b9a2-c9a4daffd347 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.589544 Jul 23 21:29:28.017834 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1894/3859] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:29:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1592 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 23 21:29:28.031456 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-73eccb46-9819-4f89-9adc-e5e80bb8d95b tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:28.032843 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-73eccb46-9819-4f89-9adc-e5e80bb8d95b tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: a0a4b52f-fa76-473e-ae4b-48f1bdf7c875] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:28.043313 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-73eccb46-9819-4f89-9adc-e5e80bb8d95b tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:28.043862 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-73eccb46-9819-4f89-9adc-e5e80bb8d95b tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:28.045673 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-73eccb46-9819-4f89-9adc-e5e80bb8d95b tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:28.046285 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-73eccb46-9819-4f89-9adc-e5e80bb8d95b tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:28.349852 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-73eccb46-9819-4f89-9adc-e5e80bb8d95b tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:28.362511 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-73eccb46-9819-4f89-9adc-e5e80bb8d95b tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/a0a4b52f-fa76-473e-ae4b-48f1bdf7c875" status: 200 len: 1493 microversion: 2.1 time: 0.343300 Jul 23 21:29:28.363441 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1895/3860] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:29:28 2022] GET /compute/v2.1/servers/a0a4b52f-fa76-473e-ae4b-48f1bdf7c875 => generated 1493 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:29:29.005305 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-daaba6e3-8900-4fbf-a2b1-6444b0d4660b req-2d3abbae-8a97-4420-853b-6513941f901d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f24f6136-4a47-44f1-9e79-fea1b1cbf057", "tag": "fb17bdf4-0872-4074-8623-374df990053a"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:29:29.022617 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-daaba6e3-8900-4fbf-a2b1-6444b0d4660b req-2d3abbae-8a97-4420-853b-6513941f901d service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:29.023097 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-daaba6e3-8900-4fbf-a2b1-6444b0d4660b req-2d3abbae-8a97-4420-853b-6513941f901d service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:29.065019 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-daaba6e3-8900-4fbf-a2b1-6444b0d4660b req-2d3abbae-8a97-4420-853b-6513941f901d service nova] Creating event network-changed:fb17bdf4-0872-4074-8623-374df990053a for instance f24f6136-4a47-44f1-9e79-fea1b1cbf057 on nch2-master-1 Jul 23 21:29:29.076811 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-daaba6e3-8900-4fbf-a2b1-6444b0d4660b req-2d3abbae-8a97-4420-853b-6513941f901d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.710990 Jul 23 21:29:29.078764 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1896/3861] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:29:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:29:29.087981 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-83625d94-8ff8-4685-ba47-41b9559e6713 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:29.093490 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-83625d94-8ff8-4685-ba47-41b9559e6713 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:29.124426 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-83625d94-8ff8-4685-ba47-41b9559e6713 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:29.124905 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-83625d94-8ff8-4685-ba47-41b9559e6713 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:29.131179 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-83625d94-8ff8-4685-ba47-41b9559e6713 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:29.131740 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-83625d94-8ff8-4685-ba47-41b9559e6713 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:29.397459 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-83625d94-8ff8-4685-ba47-41b9559e6713 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:29.413845 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-83625d94-8ff8-4685-ba47-41b9559e6713 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:29.419807 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-83625d94-8ff8-4685-ba47-41b9559e6713 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:29.423921 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-83625d94-8ff8-4685-ba47-41b9559e6713 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.342426 Jul 23 21:29:29.441662 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1897/3862] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:29:29 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:29:29.793789 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-27f5dc3e-220d-4a4f-8722-25b2fd40b504 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-1306122039", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "networks": [{"uuid": "7fd37abf-615f-476f-afe8-326b4527ec60"}]}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:29:29.903768 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-27f5dc3e-220d-4a4f-8722-25b2fd40b504 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] validate_networks() for [('7fd37abf-615f-476f-afe8-326b4527ec60', None, None, None, None, None)] {{(pid=131320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:29:29.937171 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.network.neutron [None req-fed4bbcc-c721-408b-9bb7-fc0cd7f9db09 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] [instance: f24f6136-4a47-44f1-9e79-fea1b1cbf057] Updating instance_info_cache with network_info: [{"id": "fb17bdf4-0872-4074-8623-374df990053a", "address": "fa:16:3e:a6:2c:7d", "network": {"id": "2ef4984d-4688-41b1-9cf1-8bd2229153ac", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1014491558-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "f3eef3db6d5f46c9882fbe98cb732263", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapfb17bdf4-08", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=131321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 23 21:29:29.957578 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fed4bbcc-c721-408b-9bb7-fc0cd7f9db09 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Releasing lock "refresh_cache-f24f6136-4a47-44f1-9e79-fea1b1cbf057" {{(pid=131321) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 23 21:29:29.959073 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-fed4bbcc-c721-408b-9bb7-fc0cd7f9db09 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] 10.222.0.17 "POST /compute/v2.1/servers/f24f6136-4a47-44f1-9e79-fea1b1cbf057/action" status: 202 len: 0 microversion: 2.1 time: 5.991357 Jul 23 21:29:29.960330 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1966/3863] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:29:23 2022] POST /compute/v2.1/servers/f24f6136-4a47-44f1-9e79-fea1b1cbf057/action => generated 0 bytes in 5993 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 23 21:29:29.977320 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c15fbfab-853a-498b-9115-6dc7f2e0127e tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:29.978149 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-c15fbfab-853a-498b-9115-6dc7f2e0127e tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: e9a7d9eb-cfeb-4392-9b44-3dc592d9ebd8] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:29.994900 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c15fbfab-853a-498b-9115-6dc7f2e0127e tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:30.008245 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c15fbfab-853a-498b-9115-6dc7f2e0127e tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:30.009178 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c15fbfab-853a-498b-9115-6dc7f2e0127e tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:30.009653 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c15fbfab-853a-498b-9115-6dc7f2e0127e tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:30.132206 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c15fbfab-853a-498b-9115-6dc7f2e0127e tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:30.155150 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-c15fbfab-853a-498b-9115-6dc7f2e0127e tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/e9a7d9eb-cfeb-4392-9b44-3dc592d9ebd8" status: 200 len: 1291 microversion: 2.1 time: 0.193145 Jul 23 21:29:30.159153 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1967/3864] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:29:29 2022] GET /compute/v2.1/servers/e9a7d9eb-cfeb-4392-9b44-3dc592d9ebd8 => generated 1291 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:29:30.172690 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-7c3f6bcd-37b0-4176-946c-a1ab92530178 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:30.174635 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-7c3f6bcd-37b0-4176-946c-a1ab92530178 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: a0a4b52f-fa76-473e-ae4b-48f1bdf7c875] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:30.191289 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7c3f6bcd-37b0-4176-946c-a1ab92530178 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:30.192841 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7c3f6bcd-37b0-4176-946c-a1ab92530178 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:30.195646 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7c3f6bcd-37b0-4176-946c-a1ab92530178 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:30.196325 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7c3f6bcd-37b0-4176-946c-a1ab92530178 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:30.260557 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-7c3f6bcd-37b0-4176-946c-a1ab92530178 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: a0a4b52f-fa76-473e-ae4b-48f1bdf7c875] Going to try to terminate instance {{(pid=131321) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:29:30.454100 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-7c3f6bcd-37b0-4176-946c-a1ab92530178 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "DELETE /compute/v2.1/servers/a0a4b52f-fa76-473e-ae4b-48f1bdf7c875" status: 204 len: 0 microversion: 2.1 time: 0.292553 Jul 23 21:29:30.455210 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1968/3865] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:29:30 2022] DELETE /compute/v2.1/servers/a0a4b52f-fa76-473e-ae4b-48f1bdf7c875 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:29:30.467034 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-dbc68ceb-ce17-4c27-a65f-f94687da8661 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.4.216"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:29:30.944900 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-dbc68ceb-ce17-4c27-a65f-f94687da8661 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] [instance: f24f6136-4a47-44f1-9e79-fea1b1cbf057] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:30.953935 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-dbc68ceb-ce17-4c27-a65f-f94687da8661 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:30.955470 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-dbc68ceb-ce17-4c27-a65f-f94687da8661 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:30.969312 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-dbc68ceb-ce17-4c27-a65f-f94687da8661 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:30.970249 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-dbc68ceb-ce17-4c27-a65f-f94687da8661 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:31.418663 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-dbc68ceb-ce17-4c27-a65f-f94687da8661 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Acquired lock "refresh_cache-f24f6136-4a47-44f1-9e79-fea1b1cbf057" {{(pid=131321) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 23 21:29:32.055413 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-27f5dc3e-220d-4a4f-8722-25b2fd40b504 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:29:32.055413 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-27f5dc3e-220d-4a4f-8722-25b2fd40b504 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:29:32.055413 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-27f5dc3e-220d-4a4f-8722-25b2fd40b504 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:29:32.055413 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-27f5dc3e-220d-4a4f-8722-25b2fd40b504 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:29:32.055413 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-27f5dc3e-220d-4a4f-8722-25b2fd40b504 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:29:32.076767 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-27f5dc3e-220d-4a4f-8722-25b2fd40b504 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:32.078285 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-27f5dc3e-220d-4a4f-8722-25b2fd40b504 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:32.079338 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-27f5dc3e-220d-4a4f-8722-25b2fd40b504 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:32.079954 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-27f5dc3e-220d-4a4f-8722-25b2fd40b504 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:32.108178 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-27f5dc3e-220d-4a4f-8722-25b2fd40b504 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Getting quotas for project aa1e19260e3448e08f349cbd4c4a3f70. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:29:32.118079 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-27f5dc3e-220d-4a4f-8722-25b2fd40b504 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Getting quotas for user ca13fa56f9a342b69f198080ef10acaa and project aa1e19260e3448e08f349cbd4c4a3f70. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:29:32.135640 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-27f5dc3e-220d-4a4f-8722-25b2fd40b504 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Going to run 1 instances... {{(pid=131320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:29:32.138600 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-27f5dc3e-220d-4a4f-8722-25b2fd40b504 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] [instance: 063b75fd-42ba-4fb6-bcd0-06b9622e32b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:29:32.237951 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-27f5dc3e-220d-4a4f-8722-25b2fd40b504 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 2.794960 Jul 23 21:29:32.245133 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1898/3866] 10.222.0.17 () {62 vars in 1187 bytes} [Sat Jul 23 21:29:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 2802 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 23 21:29:32.255393 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-eb89d9b4-c54d-4609-91d2-951a6d4608ed tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:32.256592 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-eb89d9b4-c54d-4609-91d2-951a6d4608ed tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:32.273732 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-eb89d9b4-c54d-4609-91d2-951a6d4608ed tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:32.275687 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-eb89d9b4-c54d-4609-91d2-951a6d4608ed tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:32.276869 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-eb89d9b4-c54d-4609-91d2-951a6d4608ed tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:32.281398 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-eb89d9b4-c54d-4609-91d2-951a6d4608ed tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:32.428070 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-eb89d9b4-c54d-4609-91d2-951a6d4608ed tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:32.449530 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-eb89d9b4-c54d-4609-91d2-951a6d4608ed tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:32.451674 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-eb89d9b4-c54d-4609-91d2-951a6d4608ed tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:32.454960 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-eb89d9b4-c54d-4609-91d2-951a6d4608ed tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.207432 Jul 23 21:29:32.459234 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1899/3867] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:29:32 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:29:32.467544 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1869a4d6-d200-4659-ac4b-f3f2328b14a6 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:32.471560 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1869a4d6-d200-4659-ac4b-f3f2328b14a6 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: a0a4b52f-fa76-473e-ae4b-48f1bdf7c875] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:32.482427 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1869a4d6-d200-4659-ac4b-f3f2328b14a6 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:32.484037 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1869a4d6-d200-4659-ac4b-f3f2328b14a6 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:32.492541 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1869a4d6-d200-4659-ac4b-f3f2328b14a6 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:32.493213 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1869a4d6-d200-4659-ac4b-f3f2328b14a6 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:32.916334 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-1869a4d6-d200-4659-ac4b-f3f2328b14a6 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:32.949524 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1869a4d6-d200-4659-ac4b-f3f2328b14a6 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/a0a4b52f-fa76-473e-ae4b-48f1bdf7c875" status: 200 len: 1499 microversion: 2.1 time: 0.480399 Jul 23 21:29:32.955064 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1900/3868] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:29:32 2022] GET /compute/v2.1/servers/a0a4b52f-fa76-473e-ae4b-48f1bdf7c875 => generated 1499 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:29:32.975630 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1e6a3ec9-9d8f-4369-b2f5-fe6fb58d2c55 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:32.978676 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1e6a3ec9-9d8f-4369-b2f5-fe6fb58d2c55 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: e9a7d9eb-cfeb-4392-9b44-3dc592d9ebd8] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:32.997779 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1e6a3ec9-9d8f-4369-b2f5-fe6fb58d2c55 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:32.998268 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1e6a3ec9-9d8f-4369-b2f5-fe6fb58d2c55 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:32.999048 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1e6a3ec9-9d8f-4369-b2f5-fe6fb58d2c55 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:32.999493 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1e6a3ec9-9d8f-4369-b2f5-fe6fb58d2c55 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:33.350449 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-1e6a3ec9-9d8f-4369-b2f5-fe6fb58d2c55 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:33.368873 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1e6a3ec9-9d8f-4369-b2f5-fe6fb58d2c55 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/e9a7d9eb-cfeb-4392-9b44-3dc592d9ebd8" status: 200 len: 1321 microversion: 2.1 time: 0.410987 Jul 23 21:29:33.375474 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1901/3869] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:29:32 2022] GET /compute/v2.1/servers/e9a7d9eb-cfeb-4392-9b44-3dc592d9ebd8 => generated 1321 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:29:33.392157 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a9f6da49-7e35-4cd0-be05-7ba2d9687683 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:33.397964 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a9f6da49-7e35-4cd0-be05-7ba2d9687683 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] [instance: 063b75fd-42ba-4fb6-bcd0-06b9622e32b1] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:33.419579 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a9f6da49-7e35-4cd0-be05-7ba2d9687683 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:33.420452 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a9f6da49-7e35-4cd0-be05-7ba2d9687683 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:33.421512 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a9f6da49-7e35-4cd0-be05-7ba2d9687683 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:33.424888 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a9f6da49-7e35-4cd0-be05-7ba2d9687683 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:33.557465 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.network.neutron [None req-dbc68ceb-ce17-4c27-a65f-f94687da8661 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] [instance: f24f6136-4a47-44f1-9e79-fea1b1cbf057] Building network info cache for instance {{(pid=131321) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 23 21:29:33.634930 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a9f6da49-7e35-4cd0-be05-7ba2d9687683 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca13fa56f9a342b69f198080ef10acaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1e19260e3448e08f349cbd4c4a3f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:33.644801 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a9f6da49-7e35-4cd0-be05-7ba2d9687683 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca13fa56f9a342b69f198080ef10acaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1e19260e3448e08f349cbd4c4a3f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:33.659032 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a9f6da49-7e35-4cd0-be05-7ba2d9687683 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca13fa56f9a342b69f198080ef10acaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1e19260e3448e08f349cbd4c4a3f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:33.660499 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a9f6da49-7e35-4cd0-be05-7ba2d9687683 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] 10.222.0.17 "GET /compute/v2.1/servers/063b75fd-42ba-4fb6-bcd0-06b9622e32b1" status: 200 len: 1266 microversion: 2.26 time: 0.283735 Jul 23 21:29:33.661379 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1902/3870] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:29:33 2022] GET /compute/v2.1/servers/063b75fd-42ba-4fb6-bcd0-06b9622e32b1 => generated 1266 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:29:34.047761 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a36ae05d-30eb-4db0-9997-0417c5ab1c86 tempest-MultipleCreateNegativeTestJSON-31114420 tempest-MultipleCreateNegativeTestJSON-31114420-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2041313016", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:29:34.050170 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-a36ae05d-30eb-4db0-9997-0417c5ab1c86 tempest-MultipleCreateNegativeTestJSON-31114420 tempest-MultipleCreateNegativeTestJSON-31114420-project] HTTP exception thrown: min_count must be <= max_count Jul 23 21:29:34.051909 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a36ae05d-30eb-4db0-9997-0417c5ab1c86 tempest-MultipleCreateNegativeTestJSON-31114420 tempest-MultipleCreateNegativeTestJSON-31114420-project] Request method failure captured: Jul 23 21:29:34.051909 ncdv-master-1 devstack@n-api.service[131320]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 23 21:29:34.051909 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:29:34.051909 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:29:34.051909 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:29:34.051909 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 184 Jul 23 21:29:34.051909 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:29:34.051909 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:29:34.051909 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:29:34.051909 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:29:34.051909 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3Gg8XK3S3Eh7dB6oSvIKm5YhXhQBmYteEUVqghi9Z0ykuTITcuQ51TsqvaqzM3q9VY0S5NAzL74AXRwuDT9hoT0w34Aa9ziWJe0ArJxA59GpD7ucz2iJDp74OXqW6zxB_QQ4-Ehz1EiNsxD8B9ZQ0W15DUq-WoGnJEt2wnELfovaLt0 Jul 23 21:29:34.051909 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:29:34.051909 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:29:34.051909 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:29:34.051909 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:29:34.051909 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:29:34.051909 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:29:34.051909 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 367436136ccc4e6ca0860bc24de14d61 Jul 23 21:29:34.051909 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-31114420 Jul 23 21:29:34.051909 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:29:34.051909 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:29:34.051909 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/367436136ccc4e6ca0860bc24de14d61"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/367436136ccc4e6ca0860bc24de14d61"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_367436136ccc4e6ca0860bc24de14d61", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/367436136ccc4e6ca0860bc24de14d61"}]}] Jul 23 21:29:34.051909 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-31114420 Jul 23 21:29:34.051909 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 367436136ccc4e6ca0860bc24de14d61 Jul 23 21:29:34.051909 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-31114420 Jul 23 21:29:34.051909 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-MultipleCreateNegativeTestJSON-31114420-project Jul 23 21:29:34.051909 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:29:34.051909 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:29:34.051909 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 8221fb61600c4282a0590117563082cd Jul 23 21:29:34.051909 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-31114420-project Jul 23 21:29:34.051909 ncdv-master-1 devstack@n-api.service[131320]: Jul 23 21:29:34.051909 ncdv-master-1 devstack@n-api.service[131320]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2041313016", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "min_count": 3, "max_count": 2}} Jul 23 21:29:34.051909 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:29:34.051909 ncdv-master-1 devstack@n-api.service[131320]: exception: min_count must be <= max_count Jul 23 21:29:34.051909 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-2041313016', 'imageRef': 'b27b20aa-ef1b-4dd1-989e-321af6343d6a', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Jul 23 21:29:34.051909 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:29:34.051909 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:29:34.051909 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:29:34.051909 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:29:34.051909 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:29:34.051909 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:29:34.051909 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:29:34.051909 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:29:34.051909 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:29:34.051909 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:29:34.051909 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:29:34.051909 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:29:34.051909 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:29:34.051909 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:29:34.051909 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 23 21:29:34.051909 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Jul 23 21:29:34.051909 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 23 21:29:34.051909 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Jul 23 21:29:34.051909 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:29:34.051909 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:29:34.051909 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:29:34.051909 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:29:34.051909 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:29:34.051909 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:29:34.051909 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:29:34.051909 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:29:34.051909 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Jul 23 21:29:34.051909 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:29:34.058387 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a36ae05d-30eb-4db0-9997-0417c5ab1c86 tempest-MultipleCreateNegativeTestJSON-31114420 tempest-MultipleCreateNegativeTestJSON-31114420-project] Returning 400 to user: min_count must be <= max_count {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:29:34.061832 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a36ae05d-30eb-4db0-9997-0417c5ab1c86 tempest-MultipleCreateNegativeTestJSON-31114420 tempest-MultipleCreateNegativeTestJSON-31114420-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.399160 Jul 23 21:29:34.062590 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1903/3871] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:29:33 2022] POST /compute/v2.1/servers => generated 74 bytes in 400 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 23 21:29:34.079409 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-980b7761-48b9-4109-8419-51a75392d864 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:34.087903 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-980b7761-48b9-4109-8419-51a75392d864 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:34.105912 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-980b7761-48b9-4109-8419-51a75392d864 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:34.106524 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-980b7761-48b9-4109-8419-51a75392d864 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:34.108789 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-980b7761-48b9-4109-8419-51a75392d864 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:34.109635 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-980b7761-48b9-4109-8419-51a75392d864 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:34.276697 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-980b7761-48b9-4109-8419-51a75392d864 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:34.296217 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-980b7761-48b9-4109-8419-51a75392d864 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:34.304590 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-980b7761-48b9-4109-8419-51a75392d864 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:34.304590 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-980b7761-48b9-4109-8419-51a75392d864 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.230549 Jul 23 21:29:34.319615 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1904/3872] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:29:34 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:29:34.332625 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-7e13b958-3a08-4168-9f45-71265c4b95fd req-99e85c43-40b3-436d-92f0-f8217f75ae31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f24f6136-4a47-44f1-9e79-fea1b1cbf057", "tag": "fb17bdf4-0872-4074-8623-374df990053a"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:29:34.351512 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-7e13b958-3a08-4168-9f45-71265c4b95fd req-99e85c43-40b3-436d-92f0-f8217f75ae31 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:34.352190 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-7e13b958-3a08-4168-9f45-71265c4b95fd req-99e85c43-40b3-436d-92f0-f8217f75ae31 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:34.382113 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-7e13b958-3a08-4168-9f45-71265c4b95fd req-99e85c43-40b3-436d-92f0-f8217f75ae31 service nova] Creating event network-changed:fb17bdf4-0872-4074-8623-374df990053a for instance f24f6136-4a47-44f1-9e79-fea1b1cbf057 on nch2-master-1 Jul 23 21:29:34.395265 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-7e13b958-3a08-4168-9f45-71265c4b95fd req-99e85c43-40b3-436d-92f0-f8217f75ae31 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071658 Jul 23 21:29:34.396560 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1905/3873] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:29:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:29:34.402031 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5f8d8b00-1b0b-47e8-9ae4-b5fc79695929 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:34.402748 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5f8d8b00-1b0b-47e8-9ae4-b5fc79695929 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: a0a4b52f-fa76-473e-ae4b-48f1bdf7c875] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:34.449751 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5f8d8b00-1b0b-47e8-9ae4-b5fc79695929 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:34.461732 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5f8d8b00-1b0b-47e8-9ae4-b5fc79695929 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:34.463673 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5f8d8b00-1b0b-47e8-9ae4-b5fc79695929 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:34.464286 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5f8d8b00-1b0b-47e8-9ae4-b5fc79695929 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:34.958281 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5f8d8b00-1b0b-47e8-9ae4-b5fc79695929 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:34.970886 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5f8d8b00-1b0b-47e8-9ae4-b5fc79695929 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/a0a4b52f-fa76-473e-ae4b-48f1bdf7c875" status: 200 len: 1499 microversion: 2.1 time: 0.571129 Jul 23 21:29:34.971532 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1906/3874] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:29:34 2022] GET /compute/v2.1/servers/a0a4b52f-fa76-473e-ae4b-48f1bdf7c875 => generated 1499 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:29:35.001383 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-b968e824-002d-484d-8230-47d4951c7e42 req-7db8dd61-9968-490d-a4a4-21d227ced6aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9a7d9eb-cfeb-4392-9b44-3dc592d9ebd8", "tag": "9df3f98c-2899-484e-873c-811935e4c5e1"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:29:35.041384 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-b968e824-002d-484d-8230-47d4951c7e42 req-7db8dd61-9968-490d-a4a4-21d227ced6aa service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:35.041844 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-b968e824-002d-484d-8230-47d4951c7e42 req-7db8dd61-9968-490d-a4a4-21d227ced6aa service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:35.089255 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-b968e824-002d-484d-8230-47d4951c7e42 req-7db8dd61-9968-490d-a4a4-21d227ced6aa service nova] Creating event network-changed:9df3f98c-2899-484e-873c-811935e4c5e1 for instance e9a7d9eb-cfeb-4392-9b44-3dc592d9ebd8 on nch2-master-1 Jul 23 21:29:35.115660 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-b968e824-002d-484d-8230-47d4951c7e42 req-7db8dd61-9968-490d-a4a4-21d227ced6aa service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119514 Jul 23 21:29:35.118729 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1907/3875] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:29:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:29:35.141150 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c45b52a1-44e8-4147-9205-337095252fa2 tempest-MultipleCreateNegativeTestJSON-31114420 tempest-MultipleCreateNegativeTestJSON-31114420-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-599705730", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "max_count": 0}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:29:35.152404 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c45b52a1-44e8-4147-9205-337095252fa2 tempest-MultipleCreateNegativeTestJSON-31114420 tempest-MultipleCreateNegativeTestJSON-31114420-project] Request method failure captured: Jul 23 21:29:35.152404 ncdv-master-1 devstack@n-api.service[131320]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 23 21:29:35.152404 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:29:35.152404 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:29:35.152404 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:29:35.152404 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 167 Jul 23 21:29:35.152404 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:29:35.152404 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:29:35.152404 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:29:35.152404 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:29:35.152404 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3Gg8XK3S3Eh7dB6oSvIKm5YhXhQBmYteEUVqghi9Z0ykuTITcuQ51TsqvaqzM3q9VY0S5NAzL74AXRwuDT9hoT0w34Aa9ziWJe0ArJxA59GpD7ucz2iJDp74OXqW6zxB_QQ4-Ehz1EiNsxD8B9ZQ0W15DUq-WoGnJEt2wnELfovaLt0 Jul 23 21:29:35.152404 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:29:35.152404 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:29:35.152404 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:29:35.152404 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:29:35.152404 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:29:35.152404 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:29:35.152404 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 367436136ccc4e6ca0860bc24de14d61 Jul 23 21:29:35.152404 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-31114420 Jul 23 21:29:35.152404 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:29:35.152404 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:29:35.152404 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/367436136ccc4e6ca0860bc24de14d61"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/367436136ccc4e6ca0860bc24de14d61"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_367436136ccc4e6ca0860bc24de14d61", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/367436136ccc4e6ca0860bc24de14d61"}]}] Jul 23 21:29:35.152404 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-31114420 Jul 23 21:29:35.152404 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 367436136ccc4e6ca0860bc24de14d61 Jul 23 21:29:35.152404 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-31114420 Jul 23 21:29:35.152404 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-MultipleCreateNegativeTestJSON-31114420-project Jul 23 21:29:35.152404 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:29:35.152404 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:29:35.152404 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 8221fb61600c4282a0590117563082cd Jul 23 21:29:35.152404 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-31114420-project Jul 23 21:29:35.152404 ncdv-master-1 devstack@n-api.service[131320]: Jul 23 21:29:35.152404 ncdv-master-1 devstack@n-api.service[131320]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-599705730", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "max_count": 0}} Jul 23 21:29:35.152404 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:29:35.152404 ncdv-master-1 devstack@n-api.service[131320]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jul 23 21:29:35.152404 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-599705730', 'imageRef': 'b27b20aa-ef1b-4dd1-989e-321af6343d6a', 'flavorRef': '452', 'max_count': 0}}} Jul 23 21:29:35.152404 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:29:35.152404 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:29:35.152404 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 23 21:29:35.152404 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 23 21:29:35.152404 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 23 21:29:35.152404 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise error Jul 23 21:29:35.152404 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 23 21:29:35.152404 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:29:35.152404 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Jul 23 21:29:35.152404 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 23 21:29:35.152404 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 23 21:29:35.152404 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 23 21:29:35.152404 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 23 21:29:35.152404 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:29:35.152404 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 23 21:29:35.152404 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi 0 Jul 23 21:29:35.152404 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:29:35.152404 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:29:35.152404 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:29:35.152404 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:29:35.152404 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:29:35.152404 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:29:35.152404 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:29:35.152404 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:29:35.152404 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:29:35.152404 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:29:35.152404 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:29:35.152404 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:29:35.152404 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 23 21:29:35.152404 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 23 21:29:35.152404 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 23 21:29:35.157839 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 23 21:29:35.157839 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 23 21:29:35.157839 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 23 21:29:35.157839 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jul 23 21:29:35.157839 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:29:35.157839 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:29:35.157839 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:29:35.157839 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:29:35.157839 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:29:35.157839 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:29:35.157839 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 23 21:29:35.157839 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 23 21:29:35.157839 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jul 23 21:29:35.157839 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:29:35.157839 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c45b52a1-44e8-4147-9205-337095252fa2 tempest-MultipleCreateNegativeTestJSON-31114420 tempest-MultipleCreateNegativeTestJSON-31114420-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:29:35.157839 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c45b52a1-44e8-4147-9205-337095252fa2 tempest-MultipleCreateNegativeTestJSON-31114420 tempest-MultipleCreateNegativeTestJSON-31114420-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.034081 Jul 23 21:29:35.162740 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1908/3876] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:29:35 2022] POST /compute/v2.1/servers => generated 130 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 23 21:29:35.179794 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-683b974a-edf2-4f01-ae5f-505d32279e0e tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:35.183791 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-683b974a-edf2-4f01-ae5f-505d32279e0e tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: e9a7d9eb-cfeb-4392-9b44-3dc592d9ebd8] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:35.212234 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-683b974a-edf2-4f01-ae5f-505d32279e0e tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:35.214275 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-683b974a-edf2-4f01-ae5f-505d32279e0e tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:35.218802 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-683b974a-edf2-4f01-ae5f-505d32279e0e tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:35.221466 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-683b974a-edf2-4f01-ae5f-505d32279e0e tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:35.701145 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-683b974a-edf2-4f01-ae5f-505d32279e0e tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:35.715081 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-683b974a-edf2-4f01-ae5f-505d32279e0e tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/e9a7d9eb-cfeb-4392-9b44-3dc592d9ebd8" status: 200 len: 1321 microversion: 2.1 time: 0.549996 Jul 23 21:29:35.728573 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1909/3877] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:29:35 2022] GET /compute/v2.1/servers/e9a7d9eb-cfeb-4392-9b44-3dc592d9ebd8 => generated 1321 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:29:35.742410 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9e5c02d1-058b-4db2-8556-1705ef3be1f1 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:35.745516 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-9e5c02d1-058b-4db2-8556-1705ef3be1f1 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] [instance: 063b75fd-42ba-4fb6-bcd0-06b9622e32b1] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:35.747878 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.network.neutron [None req-dbc68ceb-ce17-4c27-a65f-f94687da8661 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] [instance: f24f6136-4a47-44f1-9e79-fea1b1cbf057] Updating instance_info_cache with network_info: [{"id": "fb17bdf4-0872-4074-8623-374df990053a", "address": "fa:16:3e:a6:2c:7d", "network": {"id": "2ef4984d-4688-41b1-9cf1-8bd2229153ac", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1014491558-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "f3eef3db6d5f46c9882fbe98cb732263", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapfb17bdf4-08", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=131321) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 23 21:29:35.768129 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9e5c02d1-058b-4db2-8556-1705ef3be1f1 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:35.770338 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9e5c02d1-058b-4db2-8556-1705ef3be1f1 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:35.772338 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9e5c02d1-058b-4db2-8556-1705ef3be1f1 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:35.773702 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9e5c02d1-058b-4db2-8556-1705ef3be1f1 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:35.779688 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-dbc68ceb-ce17-4c27-a65f-f94687da8661 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Releasing lock "refresh_cache-f24f6136-4a47-44f1-9e79-fea1b1cbf057" {{(pid=131321) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 23 21:29:35.782186 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-dbc68ceb-ce17-4c27-a65f-f94687da8661 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] 10.222.0.17 "POST /compute/v2.1/servers/f24f6136-4a47-44f1-9e79-fea1b1cbf057/action" status: 202 len: 0 microversion: 2.1 time: 5.325081 Jul 23 21:29:35.783084 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1969/3878] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:29:30 2022] POST /compute/v2.1/servers/f24f6136-4a47-44f1-9e79-fea1b1cbf057/action => generated 0 bytes in 5327 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 23 21:29:35.800126 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-4fab1c30-6d30-44ee-a572-c2dc2936d31c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:35.817713 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-4fab1c30-6d30-44ee-a572-c2dc2936d31c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:35.850334 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4fab1c30-6d30-44ee-a572-c2dc2936d31c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:35.853146 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4fab1c30-6d30-44ee-a572-c2dc2936d31c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:35.858475 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4fab1c30-6d30-44ee-a572-c2dc2936d31c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:35.863053 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4fab1c30-6d30-44ee-a572-c2dc2936d31c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:35.937328 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=4,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:36.036968 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-9e5c02d1-058b-4db2-8556-1705ef3be1f1 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca13fa56f9a342b69f198080ef10acaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1e19260e3448e08f349cbd4c4a3f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:36.056705 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-9e5c02d1-058b-4db2-8556-1705ef3be1f1 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca13fa56f9a342b69f198080ef10acaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1e19260e3448e08f349cbd4c4a3f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:36.061966 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-9e5c02d1-058b-4db2-8556-1705ef3be1f1 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca13fa56f9a342b69f198080ef10acaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1e19260e3448e08f349cbd4c4a3f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:36.063540 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9e5c02d1-058b-4db2-8556-1705ef3be1f1 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] 10.222.0.17 "GET /compute/v2.1/servers/063b75fd-42ba-4fb6-bcd0-06b9622e32b1" status: 200 len: 1320 microversion: 2.26 time: 0.333560 Jul 23 21:29:36.065021 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1910/3879] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:29:35 2022] GET /compute/v2.1/servers/063b75fd-42ba-4fb6-bcd0-06b9622e32b1 => generated 1320 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:29:36.072333 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6861ff96-98c0-40db-a94a-63b91c9f3936 tempest-MultipleCreateNegativeTestJSON-31114420 tempest-MultipleCreateNegativeTestJSON-31114420-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-33590436", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "max_count": 2.5}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:29:36.077025 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6861ff96-98c0-40db-a94a-63b91c9f3936 tempest-MultipleCreateNegativeTestJSON-31114420 tempest-MultipleCreateNegativeTestJSON-31114420-project] Request method failure captured: Jul 23 21:29:36.077025 ncdv-master-1 devstack@n-api.service[131320]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 23 21:29:36.077025 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:29:36.077025 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:29:36.077025 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:29:36.077025 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 168 Jul 23 21:29:36.077025 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:29:36.077025 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:29:36.077025 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:29:36.077025 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:29:36.077025 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3Gg8XK3S3Eh7dB6oSvIKm5YhXhQBmYteEUVqghi9Z0ykuTITcuQ51TsqvaqzM3q9VY0S5NAzL74AXRwuDT9hoT0w34Aa9ziWJe0ArJxA59GpD7ucz2iJDp74OXqW6zxB_QQ4-Ehz1EiNsxD8B9ZQ0W15DUq-WoGnJEt2wnELfovaLt0 Jul 23 21:29:36.077025 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:29:36.077025 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:29:36.077025 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:29:36.077025 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:29:36.077025 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:29:36.077025 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:29:36.077025 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 367436136ccc4e6ca0860bc24de14d61 Jul 23 21:29:36.077025 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-31114420 Jul 23 21:29:36.077025 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:29:36.077025 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:29:36.077025 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/367436136ccc4e6ca0860bc24de14d61"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/367436136ccc4e6ca0860bc24de14d61"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_367436136ccc4e6ca0860bc24de14d61", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/367436136ccc4e6ca0860bc24de14d61"}]}] Jul 23 21:29:36.077025 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-31114420 Jul 23 21:29:36.077025 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 367436136ccc4e6ca0860bc24de14d61 Jul 23 21:29:36.077025 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-31114420 Jul 23 21:29:36.077025 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-MultipleCreateNegativeTestJSON-31114420-project Jul 23 21:29:36.077025 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:29:36.077025 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:29:36.077025 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 8221fb61600c4282a0590117563082cd Jul 23 21:29:36.077025 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-31114420-project Jul 23 21:29:36.077025 ncdv-master-1 devstack@n-api.service[131320]: Jul 23 21:29:36.077025 ncdv-master-1 devstack@n-api.service[131320]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-33590436", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "max_count": 2.5}} Jul 23 21:29:36.077025 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:29:36.077025 ncdv-master-1 devstack@n-api.service[131320]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 23 21:29:36.077025 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-33590436', 'imageRef': 'b27b20aa-ef1b-4dd1-989e-321af6343d6a', 'flavorRef': '452', 'max_count': 2.5}}} Jul 23 21:29:36.077025 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:29:36.077025 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:29:36.077025 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 23 21:29:36.077025 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 23 21:29:36.077025 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 23 21:29:36.077025 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise error Jul 23 21:29:36.077025 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Jul 23 21:29:36.077025 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:29:36.077025 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Jul 23 21:29:36.077025 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 23 21:29:36.077025 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 23 21:29:36.077025 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 23 21:29:36.077025 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 23 21:29:36.077025 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:29:36.077025 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 23 21:29:36.077025 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi 2.5 Jul 23 21:29:36.077025 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:29:36.077025 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:29:36.077025 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:29:36.077025 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:29:36.077025 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:29:36.077025 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:29:36.077025 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:29:36.077025 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:29:36.077025 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:29:36.077025 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:29:36.077025 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:29:36.077025 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:29:36.077025 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 23 21:29:36.077025 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 23 21:29:36.083346 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 23 21:29:36.083346 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 23 21:29:36.083346 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 23 21:29:36.083346 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 23 21:29:36.083346 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 23 21:29:36.083346 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:29:36.083346 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:29:36.083346 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:29:36.083346 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:29:36.083346 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:29:36.083346 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:29:36.083346 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 23 21:29:36.083346 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 23 21:29:36.083346 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 23 21:29:36.083346 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:29:36.087882 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6861ff96-98c0-40db-a94a-63b91c9f3936 tempest-MultipleCreateNegativeTestJSON-31114420 tempest-MultipleCreateNegativeTestJSON-31114420-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:29:36.088939 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6861ff96-98c0-40db-a94a-63b91c9f3936 tempest-MultipleCreateNegativeTestJSON-31114420 tempest-MultipleCreateNegativeTestJSON-31114420-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.022794 Jul 23 21:29:36.103587 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-4fab1c30-6d30-44ee-a572-c2dc2936d31c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:36.105331 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1911/3880] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:29:36 2022] POST /compute/v2.1/servers => generated 139 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 23 21:29:36.116618 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-33e94cf0-1ced-4bd2-819e-b784c9776a93 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Calling method '.version_select at 0x7f0b598ef940>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:36.120579 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-4fab1c30-6d30-44ee-a572-c2dc2936d31c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:36.123954 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-4fab1c30-6d30-44ee-a572-c2dc2936d31c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:36.128596 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-4fab1c30-6d30-44ee-a572-c2dc2936d31c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.343267 Jul 23 21:29:36.130026 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1970/3881] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:29:35 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:29:36.146782 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-985c5767-7dfb-4a9e-abad-04c76a9e69bd tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:36.147565 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-985c5767-7dfb-4a9e-abad-04c76a9e69bd tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: a0a4b52f-fa76-473e-ae4b-48f1bdf7c875] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:36.156162 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-985c5767-7dfb-4a9e-abad-04c76a9e69bd tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:36.156913 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-985c5767-7dfb-4a9e-abad-04c76a9e69bd tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:36.158299 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-985c5767-7dfb-4a9e-abad-04c76a9e69bd tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:36.158916 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-985c5767-7dfb-4a9e-abad-04c76a9e69bd tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:36.182161 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-985c5767-7dfb-4a9e-abad-04c76a9e69bd tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] HTTP exception thrown: Instance a0a4b52f-fa76-473e-ae4b-48f1bdf7c875 could not be found. Jul 23 21:29:36.183876 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-985c5767-7dfb-4a9e-abad-04c76a9e69bd tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Request method failure captured: Jul 23 21:29:36.183876 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/servers/a0a4b52f-fa76-473e-ae4b-48f1bdf7c875 HTTP/1.1 Jul 23 21:29:36.183876 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:29:36.183876 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:29:36.183876 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:29:36.183876 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:29:36.183876 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:29:36.183876 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:29:36.183876 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:29:36.183876 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:29:36.183876 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GddaYqyOuWcIIbeHmsk3fPEmdWyfGLbr9Nsz9MmxXVcs_PKtvbIqY2C8j4fzxFCSVf8V3fYFIZhvaOHyCuudCVcoCOVgWdy__DYWHqWW4I8VD_yG4rJj0HZodonpxNaGqSkGiL8DXUXMaZTTZO1BvjnTGQlN8CnshrUQQ72pGMeb2k Jul 23 21:29:36.183876 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:29:36.183876 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:29:36.183876 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:29:36.183876 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:29:36.183876 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:29:36.183876 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:29:36.183876 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: a892bfe56afd4ee5bb6c47e926af7349 Jul 23 21:29:36.183876 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-DeleteServersTestJSON-745069838 Jul 23 21:29:36.183876 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:29:36.183876 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:29:36.183876 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a892bfe56afd4ee5bb6c47e926af7349"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a892bfe56afd4ee5bb6c47e926af7349"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a892bfe56afd4ee5bb6c47e926af7349", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a892bfe56afd4ee5bb6c47e926af7349"}]}] Jul 23 21:29:36.183876 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-DeleteServersTestJSON-745069838 Jul 23 21:29:36.183876 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: a892bfe56afd4ee5bb6c47e926af7349 Jul 23 21:29:36.183876 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-DeleteServersTestJSON-745069838 Jul 23 21:29:36.183876 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-DeleteServersTestJSON-745069838-project Jul 23 21:29:36.183876 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:29:36.183876 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:29:36.183876 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: affc3572ef7d45249f50b5061a681d18 Jul 23 21:29:36.183876 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-DeleteServersTestJSON-745069838-project Jul 23 21:29:36.183876 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:29:36.183876 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance a0a4b52f-fa76-473e-ae4b-48f1bdf7c875 could not be found. Jul 23 21:29:36.183876 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': 'a0a4b52f-fa76-473e-ae4b-48f1bdf7c875'} Jul 23 21:29:36.183876 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:29:36.183876 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:29:36.183876 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:29:36.183876 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:29:36.183876 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:29:36.183876 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:29:36.183876 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:29:36.183876 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:29:36.183876 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:29:36.183876 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:29:36.183876 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0a4b52f-fa76-473e-ae4b-48f1bdf7c875 could not be found. Jul 23 21:29:36.183876 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:29:36.183876 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:29:36.183876 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:29:36.183876 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:29:36.183876 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:29:36.183876 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:29:36.183876 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:29:36.183876 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:29:36.183876 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:29:36.183876 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:29:36.183876 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:29:36.183876 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:29:36.183876 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:29:36.183876 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:29:36.183876 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:29:36.183876 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:29:36.183876 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0a4b52f-fa76-473e-ae4b-48f1bdf7c875 could not be found. Jul 23 21:29:36.183876 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:29:36.183876 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:29:36.183876 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:29:36.190671 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:29:36.190671 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:29:36.190671 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:29:36.190671 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:29:36.190671 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:29:36.190671 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0a4b52f-fa76-473e-ae4b-48f1bdf7c875 could not be found. Jul 23 21:29:36.190671 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:29:36.190671 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-985c5767-7dfb-4a9e-abad-04c76a9e69bd tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Returning 404 to user: Instance a0a4b52f-fa76-473e-ae4b-48f1bdf7c875 could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:29:36.190671 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-985c5767-7dfb-4a9e-abad-04c76a9e69bd tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/a0a4b52f-fa76-473e-ae4b-48f1bdf7c875" status: 404 len: 111 microversion: 2.1 time: 0.054369 Jul 23 21:29:36.190671 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1971/3882] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:29:36 2022] GET /compute/v2.1/servers/a0a4b52f-fa76-473e-ae4b-48f1bdf7c875 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:29:36.202179 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-3b90d170-39ed-4781-b05e-d72fb8d4558c tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:36.202856 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-3b90d170-39ed-4781-b05e-d72fb8d4558c tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: a0a4b52f-fa76-473e-ae4b-48f1bdf7c875] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:36.220102 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3b90d170-39ed-4781-b05e-d72fb8d4558c tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:36.220892 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3b90d170-39ed-4781-b05e-d72fb8d4558c tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:36.222680 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3b90d170-39ed-4781-b05e-d72fb8d4558c tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:36.224371 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3b90d170-39ed-4781-b05e-d72fb8d4558c tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:36.244833 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-3b90d170-39ed-4781-b05e-d72fb8d4558c tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] HTTP exception thrown: Instance a0a4b52f-fa76-473e-ae4b-48f1bdf7c875 could not be found. Jul 23 21:29:36.246964 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-3b90d170-39ed-4781-b05e-d72fb8d4558c tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Request method failure captured: Jul 23 21:29:36.246964 ncdv-master-1 devstack@n-api.service[131321]: request: DELETE /compute/v2.1/servers/a0a4b52f-fa76-473e-ae4b-48f1bdf7c875 HTTP/1.1 Jul 23 21:29:36.246964 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:29:36.246964 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:29:36.246964 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:29:36.246964 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:29:36.246964 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:29:36.246964 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:29:36.246964 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:29:36.246964 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:29:36.246964 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GddaYqyOuWcIIbeHmsk3fPEmdWyfGLbr9Nsz9MmxXVcs_PKtvbIqY2C8j4fzxFCSVf8V3fYFIZhvaOHyCuudCVcoCOVgWdy__DYWHqWW4I8VD_yG4rJj0HZodonpxNaGqSkGiL8DXUXMaZTTZO1BvjnTGQlN8CnshrUQQ72pGMeb2k Jul 23 21:29:36.246964 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:29:36.246964 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:29:36.246964 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:29:36.246964 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:29:36.246964 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:29:36.246964 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:29:36.246964 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: a892bfe56afd4ee5bb6c47e926af7349 Jul 23 21:29:36.246964 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-DeleteServersTestJSON-745069838 Jul 23 21:29:36.246964 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:29:36.246964 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:29:36.246964 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a892bfe56afd4ee5bb6c47e926af7349"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a892bfe56afd4ee5bb6c47e926af7349"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a892bfe56afd4ee5bb6c47e926af7349", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a892bfe56afd4ee5bb6c47e926af7349"}]}] Jul 23 21:29:36.246964 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-DeleteServersTestJSON-745069838 Jul 23 21:29:36.246964 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: a892bfe56afd4ee5bb6c47e926af7349 Jul 23 21:29:36.246964 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-DeleteServersTestJSON-745069838 Jul 23 21:29:36.246964 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-DeleteServersTestJSON-745069838-project Jul 23 21:29:36.246964 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:29:36.246964 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:29:36.246964 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: affc3572ef7d45249f50b5061a681d18 Jul 23 21:29:36.246964 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-DeleteServersTestJSON-745069838-project Jul 23 21:29:36.246964 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:29:36.246964 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance a0a4b52f-fa76-473e-ae4b-48f1bdf7c875 could not be found. Jul 23 21:29:36.246964 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': 'a0a4b52f-fa76-473e-ae4b-48f1bdf7c875'} Jul 23 21:29:36.246964 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:29:36.246964 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:29:36.246964 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:29:36.246964 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:29:36.246964 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:29:36.246964 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:29:36.246964 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:29:36.246964 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:29:36.246964 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:29:36.246964 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:29:36.246964 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0a4b52f-fa76-473e-ae4b-48f1bdf7c875 could not be found. Jul 23 21:29:36.246964 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:29:36.246964 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:29:36.246964 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:29:36.246964 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:29:36.246964 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:29:36.246964 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:29:36.246964 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:29:36.246964 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:29:36.246964 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:29:36.246964 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:29:36.246964 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 23 21:29:36.246964 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 23 21:29:36.246964 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 23 21:29:36.246964 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 23 21:29:36.246964 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:29:36.246964 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:29:36.246964 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:29:36.246964 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:29:36.252382 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0a4b52f-fa76-473e-ae4b-48f1bdf7c875 could not be found. Jul 23 21:29:36.252382 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:29:36.252382 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:29:36.252382 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:29:36.252382 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:29:36.252382 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:29:36.252382 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:29:36.252382 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:29:36.252382 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:29:36.252382 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0a4b52f-fa76-473e-ae4b-48f1bdf7c875 could not be found. Jul 23 21:29:36.252382 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:29:36.254205 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-3b90d170-39ed-4781-b05e-d72fb8d4558c tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Returning 404 to user: Instance a0a4b52f-fa76-473e-ae4b-48f1bdf7c875 could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:29:36.255319 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-3b90d170-39ed-4781-b05e-d72fb8d4558c tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "DELETE /compute/v2.1/servers/a0a4b52f-fa76-473e-ae4b-48f1bdf7c875" status: 404 len: 111 microversion: 2.1 time: 0.061240 Jul 23 21:29:36.256206 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1972/3883] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:29:36 2022] DELETE /compute/v2.1/servers/a0a4b52f-fa76-473e-ae4b-48f1bdf7c875 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:29:36.265582 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f0b743e7-3ed5-4077-aece-729b7ed76cd2 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:36.269197 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-f0b743e7-3ed5-4077-aece-729b7ed76cd2 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: a0a4b52f-fa76-473e-ae4b-48f1bdf7c875] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:36.292904 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f0b743e7-3ed5-4077-aece-729b7ed76cd2 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:36.293277 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f0b743e7-3ed5-4077-aece-729b7ed76cd2 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:36.294530 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f0b743e7-3ed5-4077-aece-729b7ed76cd2 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:36.294973 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f0b743e7-3ed5-4077-aece-729b7ed76cd2 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:36.331324 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-f0b743e7-3ed5-4077-aece-729b7ed76cd2 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] HTTP exception thrown: Instance a0a4b52f-fa76-473e-ae4b-48f1bdf7c875 could not be found. Jul 23 21:29:36.335672 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f0b743e7-3ed5-4077-aece-729b7ed76cd2 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Request method failure captured: Jul 23 21:29:36.335672 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/servers/a0a4b52f-fa76-473e-ae4b-48f1bdf7c875 HTTP/1.1 Jul 23 21:29:36.335672 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:29:36.335672 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:29:36.335672 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:29:36.335672 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:29:36.335672 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:29:36.335672 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:29:36.335672 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:29:36.335672 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:29:36.335672 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GddaYqyOuWcIIbeHmsk3fPEmdWyfGLbr9Nsz9MmxXVcs_PKtvbIqY2C8j4fzxFCSVf8V3fYFIZhvaOHyCuudCVcoCOVgWdy__DYWHqWW4I8VD_yG4rJj0HZodonpxNaGqSkGiL8DXUXMaZTTZO1BvjnTGQlN8CnshrUQQ72pGMeb2k Jul 23 21:29:36.335672 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:29:36.335672 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:29:36.335672 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:29:36.335672 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:29:36.335672 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:29:36.335672 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:29:36.335672 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: a892bfe56afd4ee5bb6c47e926af7349 Jul 23 21:29:36.335672 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-DeleteServersTestJSON-745069838 Jul 23 21:29:36.335672 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:29:36.335672 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:29:36.335672 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a892bfe56afd4ee5bb6c47e926af7349"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a892bfe56afd4ee5bb6c47e926af7349"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a892bfe56afd4ee5bb6c47e926af7349", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a892bfe56afd4ee5bb6c47e926af7349"}]}] Jul 23 21:29:36.335672 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-DeleteServersTestJSON-745069838 Jul 23 21:29:36.335672 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: a892bfe56afd4ee5bb6c47e926af7349 Jul 23 21:29:36.335672 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-DeleteServersTestJSON-745069838 Jul 23 21:29:36.335672 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-DeleteServersTestJSON-745069838-project Jul 23 21:29:36.335672 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:29:36.335672 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:29:36.335672 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: affc3572ef7d45249f50b5061a681d18 Jul 23 21:29:36.335672 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-DeleteServersTestJSON-745069838-project Jul 23 21:29:36.335672 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:29:36.335672 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance a0a4b52f-fa76-473e-ae4b-48f1bdf7c875 could not be found. Jul 23 21:29:36.335672 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': 'a0a4b52f-fa76-473e-ae4b-48f1bdf7c875'} Jul 23 21:29:36.335672 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:29:36.335672 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:29:36.335672 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:29:36.335672 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:29:36.335672 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:29:36.335672 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:29:36.335672 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:29:36.335672 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:29:36.335672 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:29:36.335672 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:29:36.335672 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0a4b52f-fa76-473e-ae4b-48f1bdf7c875 could not be found. Jul 23 21:29:36.335672 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:29:36.335672 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:29:36.335672 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:29:36.335672 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:29:36.335672 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:29:36.335672 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:29:36.335672 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:29:36.335672 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:29:36.335672 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:29:36.335672 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:29:36.335672 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:29:36.335672 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:29:36.335672 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:29:36.335672 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:29:36.335672 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:29:36.335672 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:29:36.335672 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0a4b52f-fa76-473e-ae4b-48f1bdf7c875 could not be found. Jul 23 21:29:36.335672 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:29:36.335672 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:29:36.335672 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:29:36.341234 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:29:36.341234 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:29:36.341234 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:29:36.341234 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:29:36.341234 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:29:36.341234 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0a4b52f-fa76-473e-ae4b-48f1bdf7c875 could not be found. Jul 23 21:29:36.341234 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:29:36.341234 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f0b743e7-3ed5-4077-aece-729b7ed76cd2 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Returning 404 to user: Instance a0a4b52f-fa76-473e-ae4b-48f1bdf7c875 could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:29:36.341234 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-f0b743e7-3ed5-4077-aece-729b7ed76cd2 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/a0a4b52f-fa76-473e-ae4b-48f1bdf7c875" status: 404 len: 111 microversion: 2.1 time: 0.080236 Jul 23 21:29:36.343755 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1973/3884] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:29:36 2022] GET /compute/v2.1/servers/a0a4b52f-fa76-473e-ae4b-48f1bdf7c875 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:29:36.349501 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-86caa856-b523-4858-ae8b-0d82ed34fc97 tempest-MultipleCreateNegativeTestJSON-31114420 tempest-MultipleCreateNegativeTestJSON-31114420-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1208660044", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "min_count": 0}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:29:36.353045 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-86caa856-b523-4858-ae8b-0d82ed34fc97 tempest-MultipleCreateNegativeTestJSON-31114420 tempest-MultipleCreateNegativeTestJSON-31114420-project] Request method failure captured: Jul 23 21:29:36.353045 ncdv-master-1 devstack@n-api.service[131321]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 23 21:29:36.353045 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:29:36.353045 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:29:36.353045 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:29:36.353045 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 168 Jul 23 21:29:36.353045 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:29:36.353045 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:29:36.353045 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:29:36.353045 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:29:36.353045 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3Gg8XK3S3Eh7dB6oSvIKm5YhXhQBmYteEUVqghi9Z0ykuTITcuQ51TsqvaqzM3q9VY0S5NAzL74AXRwuDT9hoT0w34Aa9ziWJe0ArJxA59GpD7ucz2iJDp74OXqW6zxB_QQ4-Ehz1EiNsxD8B9ZQ0W15DUq-WoGnJEt2wnELfovaLt0 Jul 23 21:29:36.353045 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:29:36.353045 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:29:36.353045 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:29:36.353045 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:29:36.353045 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:29:36.353045 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:29:36.353045 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 367436136ccc4e6ca0860bc24de14d61 Jul 23 21:29:36.353045 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-31114420 Jul 23 21:29:36.353045 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:29:36.353045 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:29:36.353045 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/367436136ccc4e6ca0860bc24de14d61"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/367436136ccc4e6ca0860bc24de14d61"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_367436136ccc4e6ca0860bc24de14d61", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/367436136ccc4e6ca0860bc24de14d61"}]}] Jul 23 21:29:36.353045 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-31114420 Jul 23 21:29:36.353045 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 367436136ccc4e6ca0860bc24de14d61 Jul 23 21:29:36.353045 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-31114420 Jul 23 21:29:36.353045 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-MultipleCreateNegativeTestJSON-31114420-project Jul 23 21:29:36.353045 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:29:36.353045 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:29:36.353045 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 8221fb61600c4282a0590117563082cd Jul 23 21:29:36.353045 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-31114420-project Jul 23 21:29:36.353045 ncdv-master-1 devstack@n-api.service[131321]: Jul 23 21:29:36.353045 ncdv-master-1 devstack@n-api.service[131321]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1208660044", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "min_count": 0}} Jul 23 21:29:36.353045 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:29:36.353045 ncdv-master-1 devstack@n-api.service[131321]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jul 23 21:29:36.353045 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1208660044', 'imageRef': 'b27b20aa-ef1b-4dd1-989e-321af6343d6a', 'flavorRef': '452', 'min_count': 0}}} Jul 23 21:29:36.353045 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:29:36.353045 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:29:36.353045 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 23 21:29:36.353045 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 23 21:29:36.353045 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 23 21:29:36.353045 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise error Jul 23 21:29:36.353045 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 23 21:29:36.353045 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:29:36.353045 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Jul 23 21:29:36.353045 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 23 21:29:36.353045 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 23 21:29:36.353045 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 23 21:29:36.353045 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 23 21:29:36.353045 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:29:36.353045 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 23 21:29:36.353045 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi 0 Jul 23 21:29:36.353045 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:29:36.353045 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:29:36.353045 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:29:36.353045 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:29:36.353045 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:29:36.353045 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:29:36.353045 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:29:36.353045 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:29:36.353045 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:29:36.353045 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:29:36.353045 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:29:36.353045 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:29:36.353045 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 23 21:29:36.353045 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 23 21:29:36.353045 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 23 21:29:36.358048 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 23 21:29:36.358048 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 23 21:29:36.358048 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 23 21:29:36.358048 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jul 23 21:29:36.358048 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:29:36.358048 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:29:36.358048 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:29:36.358048 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:29:36.358048 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:29:36.358048 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:29:36.358048 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 23 21:29:36.358048 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 23 21:29:36.358048 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jul 23 21:29:36.358048 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:29:36.361269 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-86caa856-b523-4858-ae8b-0d82ed34fc97 tempest-MultipleCreateNegativeTestJSON-31114420 tempest-MultipleCreateNegativeTestJSON-31114420-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:29:36.362416 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-86caa856-b523-4858-ae8b-0d82ed34fc97 tempest-MultipleCreateNegativeTestJSON-31114420 tempest-MultipleCreateNegativeTestJSON-31114420-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.017462 Jul 23 21:29:36.363544 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1974/3885] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:29:36 2022] POST /compute/v2.1/servers => generated 130 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 23 21:29:36.368521 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-304fda12-425e-4811-a342-672dff58cf5b tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:36.369481 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-304fda12-425e-4811-a342-672dff58cf5b tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: 694b9d2e-5137-4c2a-a656-2607e1ea912a] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:36.378823 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-304fda12-425e-4811-a342-672dff58cf5b tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:36.379576 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-304fda12-425e-4811-a342-672dff58cf5b tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:36.381004 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-304fda12-425e-4811-a342-672dff58cf5b tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:36.381951 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-304fda12-425e-4811-a342-672dff58cf5b tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:36.397411 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-304fda12-425e-4811-a342-672dff58cf5b tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] HTTP exception thrown: Instance 694b9d2e-5137-4c2a-a656-2607e1ea912a could not be found. Jul 23 21:29:36.399394 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-304fda12-425e-4811-a342-672dff58cf5b tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Request method failure captured: Jul 23 21:29:36.399394 ncdv-master-1 devstack@n-api.service[131321]: request: DELETE /compute/v2.1/servers/694b9d2e-5137-4c2a-a656-2607e1ea912a HTTP/1.1 Jul 23 21:29:36.399394 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:29:36.399394 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:29:36.399394 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:29:36.399394 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:29:36.399394 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:29:36.399394 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:29:36.399394 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:29:36.399394 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:29:36.399394 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GddaYqyOuWcIIbeHmsk3fPEmdWyfGLbr9Nsz9MmxXVcs_PKtvbIqY2C8j4fzxFCSVf8V3fYFIZhvaOHyCuudCVcoCOVgWdy__DYWHqWW4I8VD_yG4rJj0HZodonpxNaGqSkGiL8DXUXMaZTTZO1BvjnTGQlN8CnshrUQQ72pGMeb2k Jul 23 21:29:36.399394 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:29:36.399394 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:29:36.399394 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:29:36.399394 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:29:36.399394 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:29:36.399394 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:29:36.399394 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: a892bfe56afd4ee5bb6c47e926af7349 Jul 23 21:29:36.399394 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-DeleteServersTestJSON-745069838 Jul 23 21:29:36.399394 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:29:36.399394 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:29:36.399394 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a892bfe56afd4ee5bb6c47e926af7349"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a892bfe56afd4ee5bb6c47e926af7349"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a892bfe56afd4ee5bb6c47e926af7349", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a892bfe56afd4ee5bb6c47e926af7349"}]}] Jul 23 21:29:36.399394 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-DeleteServersTestJSON-745069838 Jul 23 21:29:36.399394 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: a892bfe56afd4ee5bb6c47e926af7349 Jul 23 21:29:36.399394 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-DeleteServersTestJSON-745069838 Jul 23 21:29:36.399394 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-DeleteServersTestJSON-745069838-project Jul 23 21:29:36.399394 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:29:36.399394 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:29:36.399394 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: affc3572ef7d45249f50b5061a681d18 Jul 23 21:29:36.399394 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-DeleteServersTestJSON-745069838-project Jul 23 21:29:36.399394 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:29:36.399394 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance 694b9d2e-5137-4c2a-a656-2607e1ea912a could not be found. Jul 23 21:29:36.399394 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': '694b9d2e-5137-4c2a-a656-2607e1ea912a'} Jul 23 21:29:36.399394 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:29:36.399394 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:29:36.399394 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:29:36.399394 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:29:36.399394 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:29:36.399394 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:29:36.399394 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:29:36.399394 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:29:36.399394 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:29:36.399394 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:29:36.399394 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 694b9d2e-5137-4c2a-a656-2607e1ea912a could not be found. Jul 23 21:29:36.399394 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:29:36.399394 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:29:36.399394 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:29:36.399394 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:29:36.399394 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:29:36.399394 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:29:36.399394 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:29:36.399394 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:29:36.399394 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:29:36.399394 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:29:36.399394 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 23 21:29:36.399394 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 23 21:29:36.399394 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 23 21:29:36.399394 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 23 21:29:36.399394 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:29:36.399394 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:29:36.399394 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:29:36.399394 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:29:36.404873 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 694b9d2e-5137-4c2a-a656-2607e1ea912a could not be found. Jul 23 21:29:36.404873 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:29:36.404873 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:29:36.404873 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:29:36.404873 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:29:36.404873 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:29:36.404873 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:29:36.404873 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:29:36.404873 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:29:36.404873 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 694b9d2e-5137-4c2a-a656-2607e1ea912a could not be found. Jul 23 21:29:36.404873 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:29:36.407220 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-304fda12-425e-4811-a342-672dff58cf5b tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Returning 404 to user: Instance 694b9d2e-5137-4c2a-a656-2607e1ea912a could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:29:36.408407 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-304fda12-425e-4811-a342-672dff58cf5b tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "DELETE /compute/v2.1/servers/694b9d2e-5137-4c2a-a656-2607e1ea912a" status: 404 len: 111 microversion: 2.1 time: 0.043646 Jul 23 21:29:36.409433 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1975/3886] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:29:36 2022] DELETE /compute/v2.1/servers/694b9d2e-5137-4c2a-a656-2607e1ea912a => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:29:36.418710 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d3177515-64f5-4921-9d52-bc40e59351be tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:36.419700 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-d3177515-64f5-4921-9d52-bc40e59351be tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: 694b9d2e-5137-4c2a-a656-2607e1ea912a] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:36.429032 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d3177515-64f5-4921-9d52-bc40e59351be tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:36.429828 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d3177515-64f5-4921-9d52-bc40e59351be tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:36.431343 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d3177515-64f5-4921-9d52-bc40e59351be tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:36.432045 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d3177515-64f5-4921-9d52-bc40e59351be tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:36.464508 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-d3177515-64f5-4921-9d52-bc40e59351be tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] HTTP exception thrown: Instance 694b9d2e-5137-4c2a-a656-2607e1ea912a could not be found. Jul 23 21:29:36.466121 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d3177515-64f5-4921-9d52-bc40e59351be tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Request method failure captured: Jul 23 21:29:36.466121 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/servers/694b9d2e-5137-4c2a-a656-2607e1ea912a HTTP/1.1 Jul 23 21:29:36.466121 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:29:36.466121 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:29:36.466121 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:29:36.466121 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:29:36.466121 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:29:36.466121 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:29:36.466121 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:29:36.466121 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:29:36.466121 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GddaYqyOuWcIIbeHmsk3fPEmdWyfGLbr9Nsz9MmxXVcs_PKtvbIqY2C8j4fzxFCSVf8V3fYFIZhvaOHyCuudCVcoCOVgWdy__DYWHqWW4I8VD_yG4rJj0HZodonpxNaGqSkGiL8DXUXMaZTTZO1BvjnTGQlN8CnshrUQQ72pGMeb2k Jul 23 21:29:36.466121 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:29:36.466121 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:29:36.466121 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:29:36.466121 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:29:36.466121 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:29:36.466121 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:29:36.466121 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: a892bfe56afd4ee5bb6c47e926af7349 Jul 23 21:29:36.466121 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-DeleteServersTestJSON-745069838 Jul 23 21:29:36.466121 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:29:36.466121 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:29:36.466121 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a892bfe56afd4ee5bb6c47e926af7349"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a892bfe56afd4ee5bb6c47e926af7349"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a892bfe56afd4ee5bb6c47e926af7349", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a892bfe56afd4ee5bb6c47e926af7349"}]}] Jul 23 21:29:36.466121 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-DeleteServersTestJSON-745069838 Jul 23 21:29:36.466121 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: a892bfe56afd4ee5bb6c47e926af7349 Jul 23 21:29:36.466121 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-DeleteServersTestJSON-745069838 Jul 23 21:29:36.466121 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-DeleteServersTestJSON-745069838-project Jul 23 21:29:36.466121 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:29:36.466121 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:29:36.466121 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: affc3572ef7d45249f50b5061a681d18 Jul 23 21:29:36.466121 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-DeleteServersTestJSON-745069838-project Jul 23 21:29:36.466121 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:29:36.466121 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance 694b9d2e-5137-4c2a-a656-2607e1ea912a could not be found. Jul 23 21:29:36.466121 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': '694b9d2e-5137-4c2a-a656-2607e1ea912a'} Jul 23 21:29:36.466121 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:29:36.466121 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:29:36.466121 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:29:36.466121 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:29:36.466121 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:29:36.466121 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:29:36.466121 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:29:36.466121 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:29:36.466121 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:29:36.466121 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:29:36.466121 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 694b9d2e-5137-4c2a-a656-2607e1ea912a could not be found. Jul 23 21:29:36.466121 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:29:36.466121 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:29:36.466121 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:29:36.466121 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:29:36.466121 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:29:36.466121 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:29:36.466121 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:29:36.466121 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:29:36.466121 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:29:36.466121 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:29:36.466121 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:29:36.466121 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:29:36.466121 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:29:36.466121 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:29:36.466121 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:29:36.466121 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:29:36.466121 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 694b9d2e-5137-4c2a-a656-2607e1ea912a could not be found. Jul 23 21:29:36.466121 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:29:36.466121 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:29:36.466121 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:29:36.473260 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:29:36.473260 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:29:36.473260 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:29:36.473260 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:29:36.473260 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:29:36.473260 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 694b9d2e-5137-4c2a-a656-2607e1ea912a could not be found. Jul 23 21:29:36.473260 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:29:36.473260 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d3177515-64f5-4921-9d52-bc40e59351be tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Returning 404 to user: Instance 694b9d2e-5137-4c2a-a656-2607e1ea912a could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:29:36.475718 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-d3177515-64f5-4921-9d52-bc40e59351be tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/694b9d2e-5137-4c2a-a656-2607e1ea912a" status: 404 len: 111 microversion: 2.1 time: 0.060985 Jul 23 21:29:36.475718 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1976/3887] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:29:36 2022] GET /compute/v2.1/servers/694b9d2e-5137-4c2a-a656-2607e1ea912a => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 23 21:29:36.487891 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-2a259e10-7b3b-40ce-83a6-0d6645def63a tempest-MultipleCreateNegativeTestJSON-31114420 tempest-MultipleCreateNegativeTestJSON-31114420-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1710708268", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "min_count": 2.5}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:29:36.500307 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-2a259e10-7b3b-40ce-83a6-0d6645def63a tempest-MultipleCreateNegativeTestJSON-31114420 tempest-MultipleCreateNegativeTestJSON-31114420-project] Request method failure captured: Jul 23 21:29:36.500307 ncdv-master-1 devstack@n-api.service[131321]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 23 21:29:36.500307 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:29:36.500307 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:29:36.500307 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:29:36.500307 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 170 Jul 23 21:29:36.500307 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:29:36.500307 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:29:36.500307 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:29:36.500307 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:29:36.500307 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3Gg8XK3S3Eh7dB6oSvIKm5YhXhQBmYteEUVqghi9Z0ykuTITcuQ51TsqvaqzM3q9VY0S5NAzL74AXRwuDT9hoT0w34Aa9ziWJe0ArJxA59GpD7ucz2iJDp74OXqW6zxB_QQ4-Ehz1EiNsxD8B9ZQ0W15DUq-WoGnJEt2wnELfovaLt0 Jul 23 21:29:36.500307 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:29:36.500307 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:29:36.500307 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:29:36.500307 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:29:36.500307 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:29:36.500307 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:29:36.500307 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 367436136ccc4e6ca0860bc24de14d61 Jul 23 21:29:36.500307 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-31114420 Jul 23 21:29:36.500307 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:29:36.500307 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:29:36.500307 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/367436136ccc4e6ca0860bc24de14d61"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/367436136ccc4e6ca0860bc24de14d61"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_367436136ccc4e6ca0860bc24de14d61", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/367436136ccc4e6ca0860bc24de14d61"}]}] Jul 23 21:29:36.500307 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-31114420 Jul 23 21:29:36.500307 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 367436136ccc4e6ca0860bc24de14d61 Jul 23 21:29:36.500307 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-31114420 Jul 23 21:29:36.500307 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-MultipleCreateNegativeTestJSON-31114420-project Jul 23 21:29:36.500307 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:29:36.500307 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:29:36.500307 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 8221fb61600c4282a0590117563082cd Jul 23 21:29:36.500307 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-31114420-project Jul 23 21:29:36.500307 ncdv-master-1 devstack@n-api.service[131321]: Jul 23 21:29:36.500307 ncdv-master-1 devstack@n-api.service[131321]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1710708268", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "min_count": 2.5}} Jul 23 21:29:36.500307 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:29:36.500307 ncdv-master-1 devstack@n-api.service[131321]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 23 21:29:36.500307 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1710708268', 'imageRef': 'b27b20aa-ef1b-4dd1-989e-321af6343d6a', 'flavorRef': '452', 'min_count': 2.5}}} Jul 23 21:29:36.500307 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:29:36.500307 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:29:36.500307 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 23 21:29:36.500307 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 23 21:29:36.500307 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 23 21:29:36.500307 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise error Jul 23 21:29:36.500307 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Jul 23 21:29:36.500307 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:29:36.500307 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Jul 23 21:29:36.500307 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 23 21:29:36.500307 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 23 21:29:36.500307 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 23 21:29:36.500307 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 23 21:29:36.500307 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:29:36.500307 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 23 21:29:36.500307 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi 2.5 Jul 23 21:29:36.500307 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:29:36.500307 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:29:36.500307 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:29:36.500307 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:29:36.500307 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:29:36.500307 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:29:36.500307 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:29:36.500307 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:29:36.500307 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:29:36.500307 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:29:36.500307 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:29:36.500307 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:29:36.500307 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 23 21:29:36.500307 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 23 21:29:36.511272 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 23 21:29:36.511272 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 23 21:29:36.511272 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 23 21:29:36.511272 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 23 21:29:36.511272 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 23 21:29:36.511272 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:29:36.511272 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:29:36.511272 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:29:36.511272 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:29:36.511272 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:29:36.511272 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:29:36.511272 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 23 21:29:36.511272 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 23 21:29:36.511272 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 23 21:29:36.511272 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:29:36.511272 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-2a259e10-7b3b-40ce-83a6-0d6645def63a tempest-MultipleCreateNegativeTestJSON-31114420 tempest-MultipleCreateNegativeTestJSON-31114420-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:29:36.511272 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-2a259e10-7b3b-40ce-83a6-0d6645def63a tempest-MultipleCreateNegativeTestJSON-31114420 tempest-MultipleCreateNegativeTestJSON-31114420-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.025436 Jul 23 21:29:36.511272 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1977/3888] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:29:36 2022] POST /compute/v2.1/servers => generated 139 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 23 21:29:36.511272 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-264f2e3d-7aa8-442f-8bea-7a1eba6f4f21 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:36.511272 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-264f2e3d-7aa8-442f-8bea-7a1eba6f4f21 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: c4da9681-4d81-4ffb-8d7e-453436e71331] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:36.524971 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-264f2e3d-7aa8-442f-8bea-7a1eba6f4f21 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:36.525449 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-264f2e3d-7aa8-442f-8bea-7a1eba6f4f21 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:36.526282 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-264f2e3d-7aa8-442f-8bea-7a1eba6f4f21 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:36.526733 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-264f2e3d-7aa8-442f-8bea-7a1eba6f4f21 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:36.564106 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-264f2e3d-7aa8-442f-8bea-7a1eba6f4f21 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] HTTP exception thrown: Instance c4da9681-4d81-4ffb-8d7e-453436e71331 could not be found. Jul 23 21:29:36.565973 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-264f2e3d-7aa8-442f-8bea-7a1eba6f4f21 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Request method failure captured: Jul 23 21:29:36.565973 ncdv-master-1 devstack@n-api.service[131321]: request: DELETE /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331 HTTP/1.1 Jul 23 21:29:36.565973 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:29:36.565973 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:29:36.565973 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:29:36.565973 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:29:36.565973 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:29:36.565973 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:29:36.565973 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:29:36.565973 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:29:36.565973 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GddaYqyOuWcIIbeHmsk3fPEmdWyfGLbr9Nsz9MmxXVcs_PKtvbIqY2C8j4fzxFCSVf8V3fYFIZhvaOHyCuudCVcoCOVgWdy__DYWHqWW4I8VD_yG4rJj0HZodonpxNaGqSkGiL8DXUXMaZTTZO1BvjnTGQlN8CnshrUQQ72pGMeb2k Jul 23 21:29:36.565973 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:29:36.565973 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:29:36.565973 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:29:36.565973 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:29:36.565973 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:29:36.565973 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:29:36.565973 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: a892bfe56afd4ee5bb6c47e926af7349 Jul 23 21:29:36.565973 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-DeleteServersTestJSON-745069838 Jul 23 21:29:36.565973 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:29:36.565973 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:29:36.565973 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a892bfe56afd4ee5bb6c47e926af7349"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a892bfe56afd4ee5bb6c47e926af7349"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a892bfe56afd4ee5bb6c47e926af7349", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a892bfe56afd4ee5bb6c47e926af7349"}]}] Jul 23 21:29:36.565973 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-DeleteServersTestJSON-745069838 Jul 23 21:29:36.565973 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: a892bfe56afd4ee5bb6c47e926af7349 Jul 23 21:29:36.565973 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-DeleteServersTestJSON-745069838 Jul 23 21:29:36.565973 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-DeleteServersTestJSON-745069838-project Jul 23 21:29:36.565973 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:29:36.565973 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:29:36.565973 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: affc3572ef7d45249f50b5061a681d18 Jul 23 21:29:36.565973 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-DeleteServersTestJSON-745069838-project Jul 23 21:29:36.565973 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:29:36.565973 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance c4da9681-4d81-4ffb-8d7e-453436e71331 could not be found. Jul 23 21:29:36.565973 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': 'c4da9681-4d81-4ffb-8d7e-453436e71331'} Jul 23 21:29:36.565973 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:29:36.565973 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:29:36.565973 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:29:36.565973 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:29:36.565973 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:29:36.565973 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:29:36.565973 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:29:36.565973 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:29:36.565973 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:29:36.565973 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:29:36.565973 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4da9681-4d81-4ffb-8d7e-453436e71331 could not be found. Jul 23 21:29:36.565973 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:29:36.565973 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:29:36.565973 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:29:36.565973 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:29:36.565973 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:29:36.565973 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:29:36.565973 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:29:36.565973 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:29:36.565973 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:29:36.565973 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:29:36.565973 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 23 21:29:36.565973 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 23 21:29:36.565973 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 23 21:29:36.565973 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 23 21:29:36.565973 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:29:36.565973 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:29:36.565973 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:29:36.565973 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:29:36.573095 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4da9681-4d81-4ffb-8d7e-453436e71331 could not be found. Jul 23 21:29:36.573095 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:29:36.573095 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:29:36.573095 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:29:36.573095 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:29:36.573095 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:29:36.573095 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:29:36.573095 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:29:36.573095 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:29:36.573095 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4da9681-4d81-4ffb-8d7e-453436e71331 could not be found. Jul 23 21:29:36.573095 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:29:36.573095 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-264f2e3d-7aa8-442f-8bea-7a1eba6f4f21 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Returning 404 to user: Instance c4da9681-4d81-4ffb-8d7e-453436e71331 could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:29:36.573095 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-264f2e3d-7aa8-442f-8bea-7a1eba6f4f21 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "DELETE /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331" status: 404 len: 111 microversion: 2.1 time: 0.064012 Jul 23 21:29:36.574160 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1978/3889] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:29:36 2022] DELETE /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:29:36.578185 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-6df85e62-7782-432f-9f60-85e98db27412 req-9feba368-c23d-4f5d-b2fd-472d81c62427 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0a4b52f-fa76-473e-ae4b-48f1bdf7c875", "name": "network-vif-deleted", "tag": "791af44f-6229-414d-8cbb-6c62b7fc606b"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:29:36.618947 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-6df85e62-7782-432f-9f60-85e98db27412 req-9feba368-c23d-4f5d-b2fd-472d81c62427 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:36.621928 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-6df85e62-7782-432f-9f60-85e98db27412 req-9feba368-c23d-4f5d-b2fd-472d81c62427 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:36.692863 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-6df85e62-7782-432f-9f60-85e98db27412 req-9feba368-c23d-4f5d-b2fd-472d81c62427 service nova] Creating event network-vif-deleted:791af44f-6229-414d-8cbb-6c62b7fc606b for instance a0a4b52f-fa76-473e-ae4b-48f1bdf7c875 on nch1-master-1 Jul 23 21:29:36.700657 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-6df85e62-7782-432f-9f60-85e98db27412 req-9feba368-c23d-4f5d-b2fd-472d81c62427 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125435 Jul 23 21:29:36.701902 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1979/3890] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:29:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:29:36.710437 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-15fe745c-f900-4f73-b105-ef4468ad3820 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:36.712007 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-15fe745c-f900-4f73-b105-ef4468ad3820 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: c4da9681-4d81-4ffb-8d7e-453436e71331] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:36.721027 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-15fe745c-f900-4f73-b105-ef4468ad3820 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:36.721837 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-15fe745c-f900-4f73-b105-ef4468ad3820 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:36.723260 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-15fe745c-f900-4f73-b105-ef4468ad3820 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:36.723776 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-15fe745c-f900-4f73-b105-ef4468ad3820 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:36.809214 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-15fe745c-f900-4f73-b105-ef4468ad3820 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] HTTP exception thrown: Instance c4da9681-4d81-4ffb-8d7e-453436e71331 could not be found. Jul 23 21:29:36.823908 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-15fe745c-f900-4f73-b105-ef4468ad3820 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Request method failure captured: Jul 23 21:29:36.823908 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331 HTTP/1.1 Jul 23 21:29:36.823908 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:29:36.823908 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:29:36.823908 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:29:36.823908 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:29:36.823908 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:29:36.823908 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:29:36.823908 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:29:36.823908 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:29:36.823908 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GddaYqyOuWcIIbeHmsk3fPEmdWyfGLbr9Nsz9MmxXVcs_PKtvbIqY2C8j4fzxFCSVf8V3fYFIZhvaOHyCuudCVcoCOVgWdy__DYWHqWW4I8VD_yG4rJj0HZodonpxNaGqSkGiL8DXUXMaZTTZO1BvjnTGQlN8CnshrUQQ72pGMeb2k Jul 23 21:29:36.823908 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:29:36.823908 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:29:36.823908 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:29:36.823908 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:29:36.823908 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:29:36.823908 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:29:36.823908 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: a892bfe56afd4ee5bb6c47e926af7349 Jul 23 21:29:36.823908 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-DeleteServersTestJSON-745069838 Jul 23 21:29:36.823908 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:29:36.823908 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:29:36.823908 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a892bfe56afd4ee5bb6c47e926af7349"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a892bfe56afd4ee5bb6c47e926af7349"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a892bfe56afd4ee5bb6c47e926af7349", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a892bfe56afd4ee5bb6c47e926af7349"}]}] Jul 23 21:29:36.823908 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-DeleteServersTestJSON-745069838 Jul 23 21:29:36.823908 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: a892bfe56afd4ee5bb6c47e926af7349 Jul 23 21:29:36.823908 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-DeleteServersTestJSON-745069838 Jul 23 21:29:36.823908 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-DeleteServersTestJSON-745069838-project Jul 23 21:29:36.823908 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:29:36.823908 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:29:36.823908 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: affc3572ef7d45249f50b5061a681d18 Jul 23 21:29:36.823908 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-DeleteServersTestJSON-745069838-project Jul 23 21:29:36.823908 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:29:36.823908 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance c4da9681-4d81-4ffb-8d7e-453436e71331 could not be found. Jul 23 21:29:36.823908 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': 'c4da9681-4d81-4ffb-8d7e-453436e71331'} Jul 23 21:29:36.823908 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:29:36.823908 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:29:36.823908 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:29:36.823908 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:29:36.823908 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:29:36.823908 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:29:36.823908 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:29:36.823908 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:29:36.823908 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:29:36.823908 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:29:36.823908 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4da9681-4d81-4ffb-8d7e-453436e71331 could not be found. Jul 23 21:29:36.823908 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:29:36.823908 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:29:36.823908 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:29:36.823908 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:29:36.823908 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:29:36.823908 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:29:36.823908 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:29:36.823908 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:29:36.823908 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:29:36.823908 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:29:36.823908 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:29:36.823908 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:29:36.823908 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:29:36.823908 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:29:36.823908 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:29:36.823908 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:29:36.823908 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4da9681-4d81-4ffb-8d7e-453436e71331 could not be found. Jul 23 21:29:36.823908 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:29:36.823908 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:29:36.823908 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:29:36.829851 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:29:36.829851 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:29:36.829851 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:29:36.829851 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:29:36.829851 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:29:36.829851 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4da9681-4d81-4ffb-8d7e-453436e71331 could not be found. Jul 23 21:29:36.829851 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:29:36.832755 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-15fe745c-f900-4f73-b105-ef4468ad3820 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Returning 404 to user: Instance c4da9681-4d81-4ffb-8d7e-453436e71331 could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:29:36.835276 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-15fe745c-f900-4f73-b105-ef4468ad3820 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331" status: 404 len: 111 microversion: 2.1 time: 0.129997 Jul 23 21:29:36.858729 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1980/3891] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:29:36 2022] GET /compute/v2.1/servers/c4da9681-4d81-4ffb-8d7e-453436e71331 => generated 111 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:29:36.883639 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-b340d5d0-644a-47b4-8669-319dcc85f193 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:36.889816 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-b340d5d0-644a-47b4-8669-319dcc85f193 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: e9a7d9eb-cfeb-4392-9b44-3dc592d9ebd8] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:36.921536 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b340d5d0-644a-47b4-8669-319dcc85f193 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:36.923813 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b340d5d0-644a-47b4-8669-319dcc85f193 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:36.929660 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b340d5d0-644a-47b4-8669-319dcc85f193 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:36.930416 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b340d5d0-644a-47b4-8669-319dcc85f193 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:37.592440 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-b340d5d0-644a-47b4-8669-319dcc85f193 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:37.602970 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-b340d5d0-644a-47b4-8669-319dcc85f193 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/e9a7d9eb-cfeb-4392-9b44-3dc592d9ebd8" status: 200 len: 1321 microversion: 2.1 time: 0.742151 Jul 23 21:29:37.606390 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1981/3892] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:29:36 2022] GET /compute/v2.1/servers/e9a7d9eb-cfeb-4392-9b44-3dc592d9ebd8 => generated 1321 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:29:37.615108 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-60cdea87-3963-43f6-a7c5-b1ed71749ebc tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:37.615626 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-60cdea87-3963-43f6-a7c5-b1ed71749ebc tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: 178abb32-365f-4ccd-828b-e69f6fe45370] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:37.625203 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-60cdea87-3963-43f6-a7c5-b1ed71749ebc tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:37.625674 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-60cdea87-3963-43f6-a7c5-b1ed71749ebc tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:37.626586 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-60cdea87-3963-43f6-a7c5-b1ed71749ebc tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:37.627557 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-60cdea87-3963-43f6-a7c5-b1ed71749ebc tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:37.644311 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-60cdea87-3963-43f6-a7c5-b1ed71749ebc tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] HTTP exception thrown: Instance 178abb32-365f-4ccd-828b-e69f6fe45370 could not be found. Jul 23 21:29:37.646250 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-60cdea87-3963-43f6-a7c5-b1ed71749ebc tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Request method failure captured: Jul 23 21:29:37.646250 ncdv-master-1 devstack@n-api.service[131321]: request: DELETE /compute/v2.1/servers/178abb32-365f-4ccd-828b-e69f6fe45370 HTTP/1.1 Jul 23 21:29:37.646250 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:29:37.646250 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:29:37.646250 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:29:37.646250 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:29:37.646250 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:29:37.646250 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:29:37.646250 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:29:37.646250 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:29:37.646250 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GddaYqyOuWcIIbeHmsk3fPEmdWyfGLbr9Nsz9MmxXVcs_PKtvbIqY2C8j4fzxFCSVf8V3fYFIZhvaOHyCuudCVcoCOVgWdy__DYWHqWW4I8VD_yG4rJj0HZodonpxNaGqSkGiL8DXUXMaZTTZO1BvjnTGQlN8CnshrUQQ72pGMeb2k Jul 23 21:29:37.646250 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:29:37.646250 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:29:37.646250 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:29:37.646250 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:29:37.646250 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:29:37.646250 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:29:37.646250 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: a892bfe56afd4ee5bb6c47e926af7349 Jul 23 21:29:37.646250 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-DeleteServersTestJSON-745069838 Jul 23 21:29:37.646250 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:29:37.646250 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:29:37.646250 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a892bfe56afd4ee5bb6c47e926af7349"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a892bfe56afd4ee5bb6c47e926af7349"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a892bfe56afd4ee5bb6c47e926af7349", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a892bfe56afd4ee5bb6c47e926af7349"}]}] Jul 23 21:29:37.646250 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-DeleteServersTestJSON-745069838 Jul 23 21:29:37.646250 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: a892bfe56afd4ee5bb6c47e926af7349 Jul 23 21:29:37.646250 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-DeleteServersTestJSON-745069838 Jul 23 21:29:37.646250 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-DeleteServersTestJSON-745069838-project Jul 23 21:29:37.646250 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:29:37.646250 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:29:37.646250 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: affc3572ef7d45249f50b5061a681d18 Jul 23 21:29:37.646250 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-DeleteServersTestJSON-745069838-project Jul 23 21:29:37.646250 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:29:37.646250 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance 178abb32-365f-4ccd-828b-e69f6fe45370 could not be found. Jul 23 21:29:37.646250 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': '178abb32-365f-4ccd-828b-e69f6fe45370'} Jul 23 21:29:37.646250 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:29:37.646250 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:29:37.646250 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:29:37.646250 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:29:37.646250 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:29:37.646250 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:29:37.646250 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:29:37.646250 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:29:37.646250 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:29:37.646250 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:29:37.646250 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 178abb32-365f-4ccd-828b-e69f6fe45370 could not be found. Jul 23 21:29:37.646250 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:29:37.646250 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:29:37.646250 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:29:37.646250 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:29:37.646250 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:29:37.646250 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:29:37.646250 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:29:37.646250 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:29:37.646250 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:29:37.646250 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:29:37.646250 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 23 21:29:37.646250 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 23 21:29:37.646250 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 23 21:29:37.646250 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 23 21:29:37.646250 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:29:37.646250 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:29:37.646250 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:29:37.646250 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:29:37.653440 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 178abb32-365f-4ccd-828b-e69f6fe45370 could not be found. Jul 23 21:29:37.653440 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:29:37.653440 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:29:37.653440 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:29:37.653440 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:29:37.653440 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:29:37.653440 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:29:37.653440 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:29:37.653440 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:29:37.653440 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 178abb32-365f-4ccd-828b-e69f6fe45370 could not be found. Jul 23 21:29:37.653440 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:29:37.653440 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-60cdea87-3963-43f6-a7c5-b1ed71749ebc tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Returning 404 to user: Instance 178abb32-365f-4ccd-828b-e69f6fe45370 could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:29:37.653440 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-60cdea87-3963-43f6-a7c5-b1ed71749ebc tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "DELETE /compute/v2.1/servers/178abb32-365f-4ccd-828b-e69f6fe45370" status: 404 len: 111 microversion: 2.1 time: 0.037605 Jul 23 21:29:37.653440 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1982/3893] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:29:37 2022] DELETE /compute/v2.1/servers/178abb32-365f-4ccd-828b-e69f6fe45370 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:29:37.655925 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-507c9e1b-ed47-4492-aeeb-3c1756dd8393 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:37.656165 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-507c9e1b-ed47-4492-aeeb-3c1756dd8393 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] [instance: 063b75fd-42ba-4fb6-bcd0-06b9622e32b1] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:37.663986 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-507c9e1b-ed47-4492-aeeb-3c1756dd8393 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:37.664513 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-507c9e1b-ed47-4492-aeeb-3c1756dd8393 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:37.665614 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-507c9e1b-ed47-4492-aeeb-3c1756dd8393 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:37.666134 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-507c9e1b-ed47-4492-aeeb-3c1756dd8393 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:38.087520 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-507c9e1b-ed47-4492-aeeb-3c1756dd8393 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca13fa56f9a342b69f198080ef10acaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1e19260e3448e08f349cbd4c4a3f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:38.107106 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-507c9e1b-ed47-4492-aeeb-3c1756dd8393 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca13fa56f9a342b69f198080ef10acaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1e19260e3448e08f349cbd4c4a3f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:38.107286 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-33e94cf0-1ced-4bd2-819e-b784c9776a93 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] 10.222.0.17 "DELETE /compute/v2.1/os-floating-ips/a7684026-0a88-4c50-9686-82badf9dd6dd" status: 202 len: 0 microversion: 2.1 time: 1.998861 Jul 23 21:29:38.112984 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-507c9e1b-ed47-4492-aeeb-3c1756dd8393 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca13fa56f9a342b69f198080ef10acaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1e19260e3448e08f349cbd4c4a3f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:38.112984 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-507c9e1b-ed47-4492-aeeb-3c1756dd8393 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] 10.222.0.17 "GET /compute/v2.1/servers/063b75fd-42ba-4fb6-bcd0-06b9622e32b1" status: 200 len: 1362 microversion: 2.26 time: 0.459703 Jul 23 21:29:38.112984 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1983/3894] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:29:37 2022] GET /compute/v2.1/servers/063b75fd-42ba-4fb6-bcd0-06b9622e32b1 => generated 1362 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:29:38.115062 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1912/3895] 10.222.0.17 () {58 vars in 1262 bytes} [Sat Jul 23 21:29:36 2022] DELETE /compute/v2.1/os-floating-ips/a7684026-0a88-4c50-9686-82badf9dd6dd => generated 0 bytes in 2007 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:29:38.118541 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-92cd08a8-9e09-4491-bdd7-7911f1216ffb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:38.119953 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8a6cb0df-66b4-496a-8f06-97d2a141f2a7 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:38.121459 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8a6cb0df-66b4-496a-8f06-97d2a141f2a7 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: 178abb32-365f-4ccd-828b-e69f6fe45370] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:38.121670 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-92cd08a8-9e09-4491-bdd7-7911f1216ffb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:38.129510 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8a6cb0df-66b4-496a-8f06-97d2a141f2a7 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:38.129853 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8a6cb0df-66b4-496a-8f06-97d2a141f2a7 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:38.130884 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8a6cb0df-66b4-496a-8f06-97d2a141f2a7 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:38.131498 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8a6cb0df-66b4-496a-8f06-97d2a141f2a7 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:38.135688 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-92cd08a8-9e09-4491-bdd7-7911f1216ffb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:38.136383 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-92cd08a8-9e09-4491-bdd7-7911f1216ffb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:38.137196 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-92cd08a8-9e09-4491-bdd7-7911f1216ffb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:38.137653 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-92cd08a8-9e09-4491-bdd7-7911f1216ffb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:38.160616 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-8a6cb0df-66b4-496a-8f06-97d2a141f2a7 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] HTTP exception thrown: Instance 178abb32-365f-4ccd-828b-e69f6fe45370 could not be found. Jul 23 21:29:38.162305 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8a6cb0df-66b4-496a-8f06-97d2a141f2a7 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Request method failure captured: Jul 23 21:29:38.162305 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/178abb32-365f-4ccd-828b-e69f6fe45370 HTTP/1.1 Jul 23 21:29:38.162305 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:29:38.162305 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:29:38.162305 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:29:38.162305 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:29:38.162305 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:29:38.162305 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:29:38.162305 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:29:38.162305 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:29:38.162305 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GddaYqyOuWcIIbeHmsk3fPEmdWyfGLbr9Nsz9MmxXVcs_PKtvbIqY2C8j4fzxFCSVf8V3fYFIZhvaOHyCuudCVcoCOVgWdy__DYWHqWW4I8VD_yG4rJj0HZodonpxNaGqSkGiL8DXUXMaZTTZO1BvjnTGQlN8CnshrUQQ72pGMeb2k Jul 23 21:29:38.162305 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:29:38.162305 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:29:38.162305 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:29:38.162305 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:29:38.162305 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:29:38.162305 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:29:38.162305 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: a892bfe56afd4ee5bb6c47e926af7349 Jul 23 21:29:38.162305 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-DeleteServersTestJSON-745069838 Jul 23 21:29:38.162305 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:29:38.162305 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:29:38.162305 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a892bfe56afd4ee5bb6c47e926af7349"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a892bfe56afd4ee5bb6c47e926af7349"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a892bfe56afd4ee5bb6c47e926af7349", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a892bfe56afd4ee5bb6c47e926af7349"}]}] Jul 23 21:29:38.162305 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-DeleteServersTestJSON-745069838 Jul 23 21:29:38.162305 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: a892bfe56afd4ee5bb6c47e926af7349 Jul 23 21:29:38.162305 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-DeleteServersTestJSON-745069838 Jul 23 21:29:38.162305 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-DeleteServersTestJSON-745069838-project Jul 23 21:29:38.162305 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:29:38.162305 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:29:38.162305 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: affc3572ef7d45249f50b5061a681d18 Jul 23 21:29:38.162305 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-DeleteServersTestJSON-745069838-project Jul 23 21:29:38.162305 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:29:38.162305 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance 178abb32-365f-4ccd-828b-e69f6fe45370 could not be found. Jul 23 21:29:38.162305 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '178abb32-365f-4ccd-828b-e69f6fe45370'} Jul 23 21:29:38.162305 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:29:38.162305 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:29:38.162305 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:29:38.162305 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:29:38.162305 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:29:38.162305 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:29:38.162305 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:29:38.162305 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:29:38.162305 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:29:38.162305 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:29:38.162305 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 178abb32-365f-4ccd-828b-e69f6fe45370 could not be found. Jul 23 21:29:38.162305 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:29:38.162305 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:29:38.162305 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:29:38.162305 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:29:38.162305 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:29:38.162305 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:29:38.162305 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:29:38.162305 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:29:38.162305 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:29:38.162305 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:29:38.162305 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:29:38.162305 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:29:38.162305 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:29:38.162305 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:29:38.162305 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:29:38.162305 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:29:38.162305 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 178abb32-365f-4ccd-828b-e69f6fe45370 could not be found. Jul 23 21:29:38.162305 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:29:38.162305 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:29:38.162305 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:29:38.167934 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:29:38.167934 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:29:38.167934 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:29:38.167934 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:29:38.167934 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:29:38.167934 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 178abb32-365f-4ccd-828b-e69f6fe45370 could not be found. Jul 23 21:29:38.167934 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:29:38.171308 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8a6cb0df-66b4-496a-8f06-97d2a141f2a7 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Returning 404 to user: Instance 178abb32-365f-4ccd-828b-e69f6fe45370 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:29:38.172334 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8a6cb0df-66b4-496a-8f06-97d2a141f2a7 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/178abb32-365f-4ccd-828b-e69f6fe45370" status: 404 len: 111 microversion: 2.1 time: 0.056180 Jul 23 21:29:38.176748 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1913/3896] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:29:38 2022] GET /compute/v2.1/servers/178abb32-365f-4ccd-828b-e69f6fe45370 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:29:38.183516 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-72b926cc-c2e3-4e31-af7b-e6bbafdda932 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Calling method '.version_select at 0x7f0b5991aca0>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:38.293490 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-92cd08a8-9e09-4491-bdd7-7911f1216ffb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:38.315532 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-92cd08a8-9e09-4491-bdd7-7911f1216ffb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:38.318744 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-92cd08a8-9e09-4491-bdd7-7911f1216ffb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:38.321005 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-92cd08a8-9e09-4491-bdd7-7911f1216ffb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.209272 Jul 23 21:29:38.322634 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1984/3897] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:29:38 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:29:38.344428 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-2a6670ad-3d8c-4e54-a658-dd2fdcf5073e tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:38.346672 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-2a6670ad-3d8c-4e54-a658-dd2fdcf5073e tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: 97d0845c-e69a-4dac-a900-ebbc2d1ed81c] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:38.368023 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2a6670ad-3d8c-4e54-a658-dd2fdcf5073e tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:38.368756 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2a6670ad-3d8c-4e54-a658-dd2fdcf5073e tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:38.369792 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2a6670ad-3d8c-4e54-a658-dd2fdcf5073e tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:38.370494 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2a6670ad-3d8c-4e54-a658-dd2fdcf5073e tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:38.388612 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-2a6670ad-3d8c-4e54-a658-dd2fdcf5073e tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] HTTP exception thrown: Instance 97d0845c-e69a-4dac-a900-ebbc2d1ed81c could not be found. Jul 23 21:29:38.390490 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-2a6670ad-3d8c-4e54-a658-dd2fdcf5073e tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Request method failure captured: Jul 23 21:29:38.390490 ncdv-master-1 devstack@n-api.service[131321]: request: DELETE /compute/v2.1/servers/97d0845c-e69a-4dac-a900-ebbc2d1ed81c HTTP/1.1 Jul 23 21:29:38.390490 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:29:38.390490 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:29:38.390490 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:29:38.390490 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:29:38.390490 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:29:38.390490 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:29:38.390490 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:29:38.390490 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:29:38.390490 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GddaYqyOuWcIIbeHmsk3fPEmdWyfGLbr9Nsz9MmxXVcs_PKtvbIqY2C8j4fzxFCSVf8V3fYFIZhvaOHyCuudCVcoCOVgWdy__DYWHqWW4I8VD_yG4rJj0HZodonpxNaGqSkGiL8DXUXMaZTTZO1BvjnTGQlN8CnshrUQQ72pGMeb2k Jul 23 21:29:38.390490 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:29:38.390490 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:29:38.390490 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:29:38.390490 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:29:38.390490 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:29:38.390490 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:29:38.390490 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: a892bfe56afd4ee5bb6c47e926af7349 Jul 23 21:29:38.390490 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-DeleteServersTestJSON-745069838 Jul 23 21:29:38.390490 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:29:38.390490 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:29:38.390490 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a892bfe56afd4ee5bb6c47e926af7349"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a892bfe56afd4ee5bb6c47e926af7349"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a892bfe56afd4ee5bb6c47e926af7349", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a892bfe56afd4ee5bb6c47e926af7349"}]}] Jul 23 21:29:38.390490 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-DeleteServersTestJSON-745069838 Jul 23 21:29:38.390490 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: a892bfe56afd4ee5bb6c47e926af7349 Jul 23 21:29:38.390490 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-DeleteServersTestJSON-745069838 Jul 23 21:29:38.390490 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-DeleteServersTestJSON-745069838-project Jul 23 21:29:38.390490 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:29:38.390490 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:29:38.390490 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: affc3572ef7d45249f50b5061a681d18 Jul 23 21:29:38.390490 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-DeleteServersTestJSON-745069838-project Jul 23 21:29:38.390490 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:29:38.390490 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance 97d0845c-e69a-4dac-a900-ebbc2d1ed81c could not be found. Jul 23 21:29:38.390490 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': '97d0845c-e69a-4dac-a900-ebbc2d1ed81c'} Jul 23 21:29:38.390490 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:29:38.390490 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:29:38.390490 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:29:38.390490 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:29:38.390490 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:29:38.390490 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:29:38.390490 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:29:38.390490 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:29:38.390490 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:29:38.390490 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:29:38.390490 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97d0845c-e69a-4dac-a900-ebbc2d1ed81c could not be found. Jul 23 21:29:38.390490 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:29:38.390490 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:29:38.390490 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:29:38.390490 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:29:38.390490 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:29:38.390490 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:29:38.390490 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:29:38.390490 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:29:38.390490 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:29:38.390490 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:29:38.390490 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 23 21:29:38.390490 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 23 21:29:38.390490 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 23 21:29:38.390490 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 23 21:29:38.390490 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:29:38.390490 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:29:38.390490 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:29:38.390490 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:29:38.395149 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97d0845c-e69a-4dac-a900-ebbc2d1ed81c could not be found. Jul 23 21:29:38.395149 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:29:38.395149 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:29:38.395149 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:29:38.395149 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:29:38.395149 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:29:38.395149 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:29:38.395149 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:29:38.395149 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:29:38.395149 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97d0845c-e69a-4dac-a900-ebbc2d1ed81c could not be found. Jul 23 21:29:38.395149 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:29:38.395149 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-2a6670ad-3d8c-4e54-a658-dd2fdcf5073e tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Returning 404 to user: Instance 97d0845c-e69a-4dac-a900-ebbc2d1ed81c could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:29:38.395149 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-2a6670ad-3d8c-4e54-a658-dd2fdcf5073e tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "DELETE /compute/v2.1/servers/97d0845c-e69a-4dac-a900-ebbc2d1ed81c" status: 404 len: 111 microversion: 2.1 time: 0.068058 Jul 23 21:29:38.395149 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1985/3898] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:29:38 2022] DELETE /compute/v2.1/servers/97d0845c-e69a-4dac-a900-ebbc2d1ed81c => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:29:38.401817 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-bb38b135-764c-43b3-8c74-7c9134fcb740 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:38.403017 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-bb38b135-764c-43b3-8c74-7c9134fcb740 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: 97d0845c-e69a-4dac-a900-ebbc2d1ed81c] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:38.410766 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bb38b135-764c-43b3-8c74-7c9134fcb740 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:38.411608 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bb38b135-764c-43b3-8c74-7c9134fcb740 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:38.412618 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bb38b135-764c-43b3-8c74-7c9134fcb740 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:38.413275 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bb38b135-764c-43b3-8c74-7c9134fcb740 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:38.434717 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-bb38b135-764c-43b3-8c74-7c9134fcb740 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] HTTP exception thrown: Instance 97d0845c-e69a-4dac-a900-ebbc2d1ed81c could not be found. Jul 23 21:29:38.438210 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-bb38b135-764c-43b3-8c74-7c9134fcb740 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Request method failure captured: Jul 23 21:29:38.438210 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/servers/97d0845c-e69a-4dac-a900-ebbc2d1ed81c HTTP/1.1 Jul 23 21:29:38.438210 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:29:38.438210 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:29:38.438210 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:29:38.438210 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:29:38.438210 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:29:38.438210 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:29:38.438210 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:29:38.438210 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:29:38.438210 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GddaYqyOuWcIIbeHmsk3fPEmdWyfGLbr9Nsz9MmxXVcs_PKtvbIqY2C8j4fzxFCSVf8V3fYFIZhvaOHyCuudCVcoCOVgWdy__DYWHqWW4I8VD_yG4rJj0HZodonpxNaGqSkGiL8DXUXMaZTTZO1BvjnTGQlN8CnshrUQQ72pGMeb2k Jul 23 21:29:38.438210 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:29:38.438210 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:29:38.438210 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:29:38.438210 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:29:38.438210 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:29:38.438210 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:29:38.438210 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: a892bfe56afd4ee5bb6c47e926af7349 Jul 23 21:29:38.438210 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-DeleteServersTestJSON-745069838 Jul 23 21:29:38.438210 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:29:38.438210 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:29:38.438210 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a892bfe56afd4ee5bb6c47e926af7349"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a892bfe56afd4ee5bb6c47e926af7349"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a892bfe56afd4ee5bb6c47e926af7349", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a892bfe56afd4ee5bb6c47e926af7349"}]}] Jul 23 21:29:38.438210 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-DeleteServersTestJSON-745069838 Jul 23 21:29:38.438210 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: a892bfe56afd4ee5bb6c47e926af7349 Jul 23 21:29:38.438210 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-DeleteServersTestJSON-745069838 Jul 23 21:29:38.438210 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-DeleteServersTestJSON-745069838-project Jul 23 21:29:38.438210 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:29:38.438210 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:29:38.438210 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: affc3572ef7d45249f50b5061a681d18 Jul 23 21:29:38.438210 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-DeleteServersTestJSON-745069838-project Jul 23 21:29:38.438210 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:29:38.438210 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance 97d0845c-e69a-4dac-a900-ebbc2d1ed81c could not be found. Jul 23 21:29:38.438210 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': '97d0845c-e69a-4dac-a900-ebbc2d1ed81c'} Jul 23 21:29:38.438210 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:29:38.438210 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:29:38.438210 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:29:38.438210 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:29:38.438210 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:29:38.438210 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:29:38.438210 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:29:38.438210 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:29:38.438210 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:29:38.438210 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:29:38.438210 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97d0845c-e69a-4dac-a900-ebbc2d1ed81c could not be found. Jul 23 21:29:38.438210 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:29:38.438210 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:29:38.438210 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:29:38.438210 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:29:38.438210 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:29:38.438210 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:29:38.438210 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:29:38.438210 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:29:38.438210 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:29:38.438210 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:29:38.438210 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:29:38.438210 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:29:38.438210 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:29:38.438210 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:29:38.438210 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:29:38.438210 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:29:38.438210 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97d0845c-e69a-4dac-a900-ebbc2d1ed81c could not be found. Jul 23 21:29:38.438210 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:29:38.438210 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:29:38.438210 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:29:38.445105 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:29:38.445105 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:29:38.445105 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:29:38.445105 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:29:38.445105 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:29:38.445105 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97d0845c-e69a-4dac-a900-ebbc2d1ed81c could not be found. Jul 23 21:29:38.445105 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:29:38.445105 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-bb38b135-764c-43b3-8c74-7c9134fcb740 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Returning 404 to user: Instance 97d0845c-e69a-4dac-a900-ebbc2d1ed81c could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:29:38.445105 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-bb38b135-764c-43b3-8c74-7c9134fcb740 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/97d0845c-e69a-4dac-a900-ebbc2d1ed81c" status: 404 len: 111 microversion: 2.1 time: 0.046957 Jul 23 21:29:38.445105 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1986/3899] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:29:38 2022] GET /compute/v2.1/servers/97d0845c-e69a-4dac-a900-ebbc2d1ed81c => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 23 21:29:38.622779 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-9091214e-196a-4265-95d7-81d30eac0b06 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:38.627359 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-9091214e-196a-4265-95d7-81d30eac0b06 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: e9a7d9eb-cfeb-4392-9b44-3dc592d9ebd8] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:38.654644 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9091214e-196a-4265-95d7-81d30eac0b06 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:38.656860 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9091214e-196a-4265-95d7-81d30eac0b06 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:38.659100 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9091214e-196a-4265-95d7-81d30eac0b06 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:38.659790 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9091214e-196a-4265-95d7-81d30eac0b06 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:38.766853 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-72b926cc-c2e3-4e31-af7b-e6bbafdda932 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] 10.222.0.17 "DELETE /compute/v2.1/os-security-groups/3ce77ef1-7896-489e-8e58-5a86c4d3da37" status: 202 len: 0 microversion: 2.1 time: 0.587985 Jul 23 21:29:38.768232 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1914/3900] 10.222.0.17 () {58 vars in 1271 bytes} [Sat Jul 23 21:29:38 2022] DELETE /compute/v2.1/os-security-groups/3ce77ef1-7896-489e-8e58-5a86c4d3da37 => generated 0 bytes in 591 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:29:38.778652 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-459f5625-56fe-4b48-8dd0-52f263792dd1 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:38.779170 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-459f5625-56fe-4b48-8dd0-52f263792dd1 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: 9a9ac364-9d41-4402-9312-9e363b68792d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:38.791204 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-459f5625-56fe-4b48-8dd0-52f263792dd1 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:38.792311 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-459f5625-56fe-4b48-8dd0-52f263792dd1 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:38.795007 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-459f5625-56fe-4b48-8dd0-52f263792dd1 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:38.796877 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-459f5625-56fe-4b48-8dd0-52f263792dd1 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:38.827761 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:38.834159 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-459f5625-56fe-4b48-8dd0-52f263792dd1 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: 9a9ac364-9d41-4402-9312-9e363b68792d] Going to try to terminate instance {{(pid=131320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:29:38.974433 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-459f5625-56fe-4b48-8dd0-52f263792dd1 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "DELETE /compute/v2.1/servers/9a9ac364-9d41-4402-9312-9e363b68792d" status: 204 len: 0 microversion: 2.1 time: 0.203830 Jul 23 21:29:38.975089 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1915/3901] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:29:38 2022] DELETE /compute/v2.1/servers/9a9ac364-9d41-4402-9312-9e363b68792d => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:29:39.002754 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-9091214e-196a-4265-95d7-81d30eac0b06 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:39.003800 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ccbb1c89-d8a0-464d-9aaa-58e8cbd74b2f tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:39.004977 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ccbb1c89-d8a0-464d-9aaa-58e8cbd74b2f tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] [instance: f24f6136-4a47-44f1-9e79-fea1b1cbf057] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:39.014480 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-9091214e-196a-4265-95d7-81d30eac0b06 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/e9a7d9eb-cfeb-4392-9b44-3dc592d9ebd8" status: 200 len: 1321 microversion: 2.1 time: 0.396427 Jul 23 21:29:39.021178 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1987/3902] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:29:38 2022] GET /compute/v2.1/servers/e9a7d9eb-cfeb-4392-9b44-3dc592d9ebd8 => generated 1321 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:29:39.024996 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ccbb1c89-d8a0-464d-9aaa-58e8cbd74b2f tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:39.025582 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ccbb1c89-d8a0-464d-9aaa-58e8cbd74b2f tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:39.026093 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-014d9cbb-aa7d-42a9-b9b8-35e3a9ee0769 req-e962b7ac-1611-454d-8ad8-818becaf0bb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "063b75fd-42ba-4fb6-bcd0-06b9622e32b1", "tag": "55ad3ac1-2c82-4462-8c36-48b51682f148"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:29:39.026450 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ccbb1c89-d8a0-464d-9aaa-58e8cbd74b2f tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:39.027092 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ccbb1c89-d8a0-464d-9aaa-58e8cbd74b2f tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:39.029804 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:39.049363 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-014d9cbb-aa7d-42a9-b9b8-35e3a9ee0769 req-e962b7ac-1611-454d-8ad8-818becaf0bb6 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:39.049844 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-014d9cbb-aa7d-42a9-b9b8-35e3a9ee0769 req-e962b7ac-1611-454d-8ad8-818becaf0bb6 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:39.060933 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ccbb1c89-d8a0-464d-9aaa-58e8cbd74b2f tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] [instance: f24f6136-4a47-44f1-9e79-fea1b1cbf057] Going to try to terminate instance {{(pid=131320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:29:39.081988 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-014d9cbb-aa7d-42a9-b9b8-35e3a9ee0769 req-e962b7ac-1611-454d-8ad8-818becaf0bb6 service nova] Creating event network-changed:55ad3ac1-2c82-4462-8c36-48b51682f148 for instance 063b75fd-42ba-4fb6-bcd0-06b9622e32b1 on nch1-master-1 Jul 23 21:29:39.102609 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-014d9cbb-aa7d-42a9-b9b8-35e3a9ee0769 req-e962b7ac-1611-454d-8ad8-818becaf0bb6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079531 Jul 23 21:29:39.106307 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1988/3903] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:29:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:29:39.115305 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-1dc6e7f6-629c-4781-849b-395287c019c8 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:39.116472 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-1dc6e7f6-629c-4781-849b-395287c019c8 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: 9a9ac364-9d41-4402-9312-9e363b68792d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:39.132586 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1dc6e7f6-629c-4781-849b-395287c019c8 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:39.133370 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1dc6e7f6-629c-4781-849b-395287c019c8 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:39.135259 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1dc6e7f6-629c-4781-849b-395287c019c8 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:39.136241 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1dc6e7f6-629c-4781-849b-395287c019c8 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:39.222516 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ccbb1c89-d8a0-464d-9aaa-58e8cbd74b2f tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] 10.222.0.17 "DELETE /compute/v2.1/servers/f24f6136-4a47-44f1-9e79-fea1b1cbf057" status: 204 len: 0 microversion: 2.1 time: 0.240772 Jul 23 21:29:39.223992 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1916/3904] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:29:38 2022] DELETE /compute/v2.1/servers/f24f6136-4a47-44f1-9e79-fea1b1cbf057 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:29:39.233668 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2b518fdb-8ab3-4cd6-ad6a-22b97a647ffd tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:39.235066 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-2b518fdb-8ab3-4cd6-ad6a-22b97a647ffd tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] [instance: 063b75fd-42ba-4fb6-bcd0-06b9622e32b1] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:39.242386 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2b518fdb-8ab3-4cd6-ad6a-22b97a647ffd tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:39.243300 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2b518fdb-8ab3-4cd6-ad6a-22b97a647ffd tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:39.245050 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2b518fdb-8ab3-4cd6-ad6a-22b97a647ffd tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:39.245740 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2b518fdb-8ab3-4cd6-ad6a-22b97a647ffd tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:39.434175 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-2b518fdb-8ab3-4cd6-ad6a-22b97a647ffd tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca13fa56f9a342b69f198080ef10acaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1e19260e3448e08f349cbd4c4a3f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:39.448979 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-2b518fdb-8ab3-4cd6-ad6a-22b97a647ffd tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca13fa56f9a342b69f198080ef10acaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1e19260e3448e08f349cbd4c4a3f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:39.450889 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-2b518fdb-8ab3-4cd6-ad6a-22b97a647ffd tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca13fa56f9a342b69f198080ef10acaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1e19260e3448e08f349cbd4c4a3f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:39.452379 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2b518fdb-8ab3-4cd6-ad6a-22b97a647ffd tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] 10.222.0.17 "GET /compute/v2.1/servers/063b75fd-42ba-4fb6-bcd0-06b9622e32b1" status: 200 len: 1362 microversion: 2.26 time: 0.223812 Jul 23 21:29:39.463373 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1917/3905] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:29:39 2022] GET /compute/v2.1/servers/063b75fd-42ba-4fb6-bcd0-06b9622e32b1 => generated 1362 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:29:39.476244 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4c2d7095-71a4-4697-b26f-7990ec7d4515 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:39.478348 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-4c2d7095-71a4-4697-b26f-7990ec7d4515 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] [instance: f24f6136-4a47-44f1-9e79-fea1b1cbf057] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:39.490990 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4c2d7095-71a4-4697-b26f-7990ec7d4515 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:39.491465 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-1dc6e7f6-629c-4781-849b-395287c019c8 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:39.492064 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4c2d7095-71a4-4697-b26f-7990ec7d4515 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:39.493311 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4c2d7095-71a4-4697-b26f-7990ec7d4515 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:39.494052 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4c2d7095-71a4-4697-b26f-7990ec7d4515 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:39.505933 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-1dc6e7f6-629c-4781-849b-395287c019c8 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/9a9ac364-9d41-4402-9312-9e363b68792d" status: 200 len: 1509 microversion: 2.1 time: 0.397174 Jul 23 21:29:39.506815 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1989/3906] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:29:39 2022] GET /compute/v2.1/servers/9a9ac364-9d41-4402-9312-9e363b68792d => generated 1509 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:29:39.523015 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ed369056-3601-4ce9-ab30-1b6c33a4f141 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:39.526838 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-ed369056-3601-4ce9-ab30-1b6c33a4f141 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:39.544693 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ed369056-3601-4ce9-ab30-1b6c33a4f141 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:39.546621 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ed369056-3601-4ce9-ab30-1b6c33a4f141 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:39.549035 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ed369056-3601-4ce9-ab30-1b6c33a4f141 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:39.557926 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ed369056-3601-4ce9-ab30-1b6c33a4f141 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:39.738508 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ed369056-3601-4ce9-ab30-1b6c33a4f141 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:39.760698 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ed369056-3601-4ce9-ab30-1b6c33a4f141 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:39.762468 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ed369056-3601-4ce9-ab30-1b6c33a4f141 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:39.765187 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-ed369056-3601-4ce9-ab30-1b6c33a4f141 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.244899 Jul 23 21:29:39.766137 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1990/3907] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:29:39 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:29:39.783737 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-4c2d7095-71a4-4697-b26f-7990ec7d4515 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b566640463e43aa85ec96a1aa76d3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eef3db6d5f46c9882fbe98cb732263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:39.792427 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4c2d7095-71a4-4697-b26f-7990ec7d4515 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] 10.222.0.17 "GET /compute/v2.1/servers/f24f6136-4a47-44f1-9e79-fea1b1cbf057" status: 200 len: 1510 microversion: 2.1 time: 0.328104 Jul 23 21:29:39.806442 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1918/3908] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:29:39 2022] GET /compute/v2.1/servers/f24f6136-4a47-44f1-9e79-fea1b1cbf057 => generated 1510 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:29:39.982218 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-5942a28e-a74a-4b4a-8d8e-5cdde4a1115a req-900eab61-0d2f-41f1-a17a-fe54eb9c79ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9a7d9eb-cfeb-4392-9b44-3dc592d9ebd8", "name": "network-vif-plugged", "status": "completed", "tag": "9df3f98c-2899-484e-873c-811935e4c5e1"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:29:39.992155 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-5942a28e-a74a-4b4a-8d8e-5cdde4a1115a req-900eab61-0d2f-41f1-a17a-fe54eb9c79ad service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:39.992660 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-5942a28e-a74a-4b4a-8d8e-5cdde4a1115a req-900eab61-0d2f-41f1-a17a-fe54eb9c79ad service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:40.005789 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-5942a28e-a74a-4b4a-8d8e-5cdde4a1115a req-900eab61-0d2f-41f1-a17a-fe54eb9c79ad service nova] Creating event network-vif-plugged:9df3f98c-2899-484e-873c-811935e4c5e1 for instance e9a7d9eb-cfeb-4392-9b44-3dc592d9ebd8 on nch2-master-1 Jul 23 21:29:40.012934 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-5942a28e-a74a-4b4a-8d8e-5cdde4a1115a req-900eab61-0d2f-41f1-a17a-fe54eb9c79ad service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.241697 Jul 23 21:29:40.014037 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1991/3909] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:29:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:29:40.034626 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1b85464b-b819-40be-883e-ebbee1bf9ebc tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:40.035263 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1b85464b-b819-40be-883e-ebbee1bf9ebc tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: e9a7d9eb-cfeb-4392-9b44-3dc592d9ebd8] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:40.044207 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1b85464b-b819-40be-883e-ebbee1bf9ebc tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:40.045012 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1b85464b-b819-40be-883e-ebbee1bf9ebc tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:40.046138 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1b85464b-b819-40be-883e-ebbee1bf9ebc tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:40.046812 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1b85464b-b819-40be-883e-ebbee1bf9ebc tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:40.258099 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-1b85464b-b819-40be-883e-ebbee1bf9ebc tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:40.267250 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1b85464b-b819-40be-883e-ebbee1bf9ebc tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/e9a7d9eb-cfeb-4392-9b44-3dc592d9ebd8" status: 200 len: 1321 microversion: 2.1 time: 0.239986 Jul 23 21:29:40.279070 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1919/3910] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:29:40 2022] GET /compute/v2.1/servers/e9a7d9eb-cfeb-4392-9b44-3dc592d9ebd8 => generated 1321 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:29:40.472396 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-761cb885-dca3-4455-bb0a-1d53f4e0dfc4 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:40.473133 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-761cb885-dca3-4455-bb0a-1d53f4e0dfc4 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] [instance: 063b75fd-42ba-4fb6-bcd0-06b9622e32b1] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:40.480786 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-761cb885-dca3-4455-bb0a-1d53f4e0dfc4 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:40.481262 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-761cb885-dca3-4455-bb0a-1d53f4e0dfc4 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:40.482292 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-761cb885-dca3-4455-bb0a-1d53f4e0dfc4 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:40.482958 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-761cb885-dca3-4455-bb0a-1d53f4e0dfc4 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:40.624886 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-761cb885-dca3-4455-bb0a-1d53f4e0dfc4 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca13fa56f9a342b69f198080ef10acaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1e19260e3448e08f349cbd4c4a3f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:40.634419 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-761cb885-dca3-4455-bb0a-1d53f4e0dfc4 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca13fa56f9a342b69f198080ef10acaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1e19260e3448e08f349cbd4c4a3f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:40.636154 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-761cb885-dca3-4455-bb0a-1d53f4e0dfc4 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca13fa56f9a342b69f198080ef10acaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1e19260e3448e08f349cbd4c4a3f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:40.637660 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-761cb885-dca3-4455-bb0a-1d53f4e0dfc4 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] 10.222.0.17 "GET /compute/v2.1/servers/063b75fd-42ba-4fb6-bcd0-06b9622e32b1" status: 200 len: 1362 microversion: 2.26 time: 0.170100 Jul 23 21:29:40.638305 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1992/3911] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:29:40 2022] GET /compute/v2.1/servers/063b75fd-42ba-4fb6-bcd0-06b9622e32b1 => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:29:40.643571 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-fd9d0495-579f-4140-8e1a-06b8c9f67f0f tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:40.644289 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-fd9d0495-579f-4140-8e1a-06b8c9f67f0f tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: 9a9ac364-9d41-4402-9312-9e363b68792d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:40.652094 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fd9d0495-579f-4140-8e1a-06b8c9f67f0f tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:40.652557 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fd9d0495-579f-4140-8e1a-06b8c9f67f0f tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:40.653354 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fd9d0495-579f-4140-8e1a-06b8c9f67f0f tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:40.653354 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fd9d0495-579f-4140-8e1a-06b8c9f67f0f tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:40.713249 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1475b174-a6fc-434c-8819-079d73a3702d tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-1901559437", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "networks": "none"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:29:40.794486 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-1475b174-a6fc-434c-8819-079d73a3702d tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:29:40.795269 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-1475b174-a6fc-434c-8819-079d73a3702d tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:29:40.795964 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-1475b174-a6fc-434c-8819-079d73a3702d tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:29:40.796618 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-1475b174-a6fc-434c-8819-079d73a3702d tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:29:40.797445 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-1475b174-a6fc-434c-8819-079d73a3702d tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:29:40.824984 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1475b174-a6fc-434c-8819-079d73a3702d tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:40.825850 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1475b174-a6fc-434c-8819-079d73a3702d tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:40.827234 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1475b174-a6fc-434c-8819-079d73a3702d tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:40.827677 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1475b174-a6fc-434c-8819-079d73a3702d tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:40.838132 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-fd9d0495-579f-4140-8e1a-06b8c9f67f0f tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:40.849023 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-fd9d0495-579f-4140-8e1a-06b8c9f67f0f tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/9a9ac364-9d41-4402-9312-9e363b68792d" status: 200 len: 1509 microversion: 2.1 time: 0.209234 Jul 23 21:29:40.855616 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-1475b174-a6fc-434c-8819-079d73a3702d tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Getting quotas for project e751dfada40945a69472003d08f1bb0b. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:29:40.860448 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1993/3912] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:29:40 2022] GET /compute/v2.1/servers/9a9ac364-9d41-4402-9312-9e363b68792d => generated 1509 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:29:40.863337 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-1475b174-a6fc-434c-8819-079d73a3702d tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Getting quotas for user cadc4fac778e4eaf905a3fbc26fbb090 and project e751dfada40945a69472003d08f1bb0b. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:29:40.879802 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-3507f313-5e56-4846-a9ec-457a19ce55e6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:40.880046 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1475b174-a6fc-434c-8819-079d73a3702d tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Going to run 1 instances... {{(pid=131320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:29:40.881692 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-3507f313-5e56-4846-a9ec-457a19ce55e6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:40.883324 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1475b174-a6fc-434c-8819-079d73a3702d tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] [instance: b3576570-0c74-42f9-ae44-ac9f049e980d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:29:40.888868 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3507f313-5e56-4846-a9ec-457a19ce55e6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:40.889561 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3507f313-5e56-4846-a9ec-457a19ce55e6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:40.890628 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3507f313-5e56-4846-a9ec-457a19ce55e6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:40.891354 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3507f313-5e56-4846-a9ec-457a19ce55e6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:40.956919 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1475b174-a6fc-434c-8819-079d73a3702d tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.457101 Jul 23 21:29:40.957961 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1920/3913] 10.222.0.17 () {62 vars in 1187 bytes} [Sat Jul 23 21:29:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 459 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 23 21:29:40.972180 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b6cec536-e981-4149-98f4-79e7c6b6d240 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:40.972828 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b6cec536-e981-4149-98f4-79e7c6b6d240 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] [instance: f24f6136-4a47-44f1-9e79-fea1b1cbf057] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:40.994742 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b6cec536-e981-4149-98f4-79e7c6b6d240 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:40.996603 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b6cec536-e981-4149-98f4-79e7c6b6d240 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:40.998744 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b6cec536-e981-4149-98f4-79e7c6b6d240 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:41.000078 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b6cec536-e981-4149-98f4-79e7c6b6d240 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:41.004996 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-3507f313-5e56-4846-a9ec-457a19ce55e6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:41.023725 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-3507f313-5e56-4846-a9ec-457a19ce55e6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:41.028713 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-3507f313-5e56-4846-a9ec-457a19ce55e6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:41.030565 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-3507f313-5e56-4846-a9ec-457a19ce55e6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.168277 Jul 23 21:29:41.032156 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1994/3914] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:29:40 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:29:41.047829 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c4f77d56-9128-40cd-832a-558d667d0c7d tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:41.049945 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-c4f77d56-9128-40cd-832a-558d667d0c7d tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] [instance: b3576570-0c74-42f9-ae44-ac9f049e980d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:41.128979 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c4f77d56-9128-40cd-832a-558d667d0c7d tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadc4fac778e4eaf905a3fbc26fbb090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e751dfada40945a69472003d08f1bb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:41.141395 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c4f77d56-9128-40cd-832a-558d667d0c7d tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cadc4fac778e4eaf905a3fbc26fbb090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e751dfada40945a69472003d08f1bb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:41.144641 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c4f77d56-9128-40cd-832a-558d667d0c7d tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cadc4fac778e4eaf905a3fbc26fbb090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e751dfada40945a69472003d08f1bb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:41.149896 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-c4f77d56-9128-40cd-832a-558d667d0c7d tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] 10.222.0.17 "GET /compute/v2.1/servers/b3576570-0c74-42f9-ae44-ac9f049e980d" status: 200 len: 1278 microversion: 2.54 time: 0.111857 Jul 23 21:29:41.153698 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1995/3915] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:29:41 2022] GET /compute/v2.1/servers/b3576570-0c74-42f9-ae44-ac9f049e980d => generated 1278 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:29:41.286619 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e0fdbe63-ceb9-4952-bf24-9cf5fedacae1 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:41.287488 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-e0fdbe63-ceb9-4952-bf24-9cf5fedacae1 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: e9a7d9eb-cfeb-4392-9b44-3dc592d9ebd8] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:41.297324 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e0fdbe63-ceb9-4952-bf24-9cf5fedacae1 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:41.299106 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e0fdbe63-ceb9-4952-bf24-9cf5fedacae1 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:41.301195 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e0fdbe63-ceb9-4952-bf24-9cf5fedacae1 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:41.302113 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e0fdbe63-ceb9-4952-bf24-9cf5fedacae1 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:41.552541 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b6cec536-e981-4149-98f4-79e7c6b6d240 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b566640463e43aa85ec96a1aa76d3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eef3db6d5f46c9882fbe98cb732263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:41.565434 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-e0fdbe63-ceb9-4952-bf24-9cf5fedacae1 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:41.571297 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b6cec536-e981-4149-98f4-79e7c6b6d240 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] 10.222.0.17 "GET /compute/v2.1/servers/f24f6136-4a47-44f1-9e79-fea1b1cbf057" status: 200 len: 1510 microversion: 2.1 time: 0.612147 Jul 23 21:29:41.572239 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1921/3916] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:29:40 2022] GET /compute/v2.1/servers/f24f6136-4a47-44f1-9e79-fea1b1cbf057 => generated 1510 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:29:41.590788 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-e0fdbe63-ceb9-4952-bf24-9cf5fedacae1 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/e9a7d9eb-cfeb-4392-9b44-3dc592d9ebd8" status: 200 len: 1321 microversion: 2.1 time: 0.309560 Jul 23 21:29:41.614648 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1996/3917] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:29:41 2022] GET /compute/v2.1/servers/e9a7d9eb-cfeb-4392-9b44-3dc592d9ebd8 => generated 1321 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:29:41.659890 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b2d626ae-6c83-43dd-95a3-6f5281e3dbfe tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:41.660869 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b2d626ae-6c83-43dd-95a3-6f5281e3dbfe tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] [instance: 063b75fd-42ba-4fb6-bcd0-06b9622e32b1] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:41.673519 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=9,nova_api:UPDATE=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:41.677803 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b2d626ae-6c83-43dd-95a3-6f5281e3dbfe tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:41.680862 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b2d626ae-6c83-43dd-95a3-6f5281e3dbfe tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:41.681983 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b2d626ae-6c83-43dd-95a3-6f5281e3dbfe tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:41.683194 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b2d626ae-6c83-43dd-95a3-6f5281e3dbfe tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:41.867604 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c0b71454-4bc0-402b-875a-d972185758f8 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:41.868277 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-c0b71454-4bc0-402b-875a-d972185758f8 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: 9a9ac364-9d41-4402-9312-9e363b68792d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:41.907003 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b2d626ae-6c83-43dd-95a3-6f5281e3dbfe tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca13fa56f9a342b69f198080ef10acaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1e19260e3448e08f349cbd4c4a3f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:41.908833 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c0b71454-4bc0-402b-875a-d972185758f8 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:41.911536 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c0b71454-4bc0-402b-875a-d972185758f8 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:41.912572 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c0b71454-4bc0-402b-875a-d972185758f8 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:41.918425 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c0b71454-4bc0-402b-875a-d972185758f8 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:41.919044 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b2d626ae-6c83-43dd-95a3-6f5281e3dbfe tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca13fa56f9a342b69f198080ef10acaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1e19260e3448e08f349cbd4c4a3f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:41.921538 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b2d626ae-6c83-43dd-95a3-6f5281e3dbfe tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca13fa56f9a342b69f198080ef10acaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1e19260e3448e08f349cbd4c4a3f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:41.923772 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b2d626ae-6c83-43dd-95a3-6f5281e3dbfe tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] 10.222.0.17 "GET /compute/v2.1/servers/063b75fd-42ba-4fb6-bcd0-06b9622e32b1" status: 200 len: 1362 microversion: 2.26 time: 0.270346 Jul 23 21:29:41.934922 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1922/3918] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:29:41 2022] GET /compute/v2.1/servers/063b75fd-42ba-4fb6-bcd0-06b9622e32b1 => generated 1362 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:29:42.053709 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2579c1a1-5d5a-4737-8c0a-58ad4a68d59b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:42.054899 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-2579c1a1-5d5a-4737-8c0a-58ad4a68d59b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:42.067226 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2579c1a1-5d5a-4737-8c0a-58ad4a68d59b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:42.068001 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2579c1a1-5d5a-4737-8c0a-58ad4a68d59b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:42.068839 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2579c1a1-5d5a-4737-8c0a-58ad4a68d59b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:42.069283 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2579c1a1-5d5a-4737-8c0a-58ad4a68d59b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:42.182907 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-2579c1a1-5d5a-4737-8c0a-58ad4a68d59b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:42.197478 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-2579c1a1-5d5a-4737-8c0a-58ad4a68d59b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:42.203210 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-2579c1a1-5d5a-4737-8c0a-58ad4a68d59b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:42.205701 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2579c1a1-5d5a-4737-8c0a-58ad4a68d59b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.157695 Jul 23 21:29:42.211285 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c0b71454-4bc0-402b-875a-d972185758f8 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:42.219179 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1923/3919] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:29:42 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:29:42.221070 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-c0b71454-4bc0-402b-875a-d972185758f8 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/9a9ac364-9d41-4402-9312-9e363b68792d" status: 200 len: 1509 microversion: 2.1 time: 0.358011 Jul 23 21:29:42.226342 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a288cfbf-23e0-43bc-9a02-33e39062ae28 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:42.231456 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1997/3920] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:29:41 2022] GET /compute/v2.1/servers/9a9ac364-9d41-4402-9312-9e363b68792d => generated 1509 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:29:42.233762 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a288cfbf-23e0-43bc-9a02-33e39062ae28 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] [instance: b3576570-0c74-42f9-ae44-ac9f049e980d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:42.248132 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a288cfbf-23e0-43bc-9a02-33e39062ae28 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:42.249458 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a288cfbf-23e0-43bc-9a02-33e39062ae28 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:42.251797 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a288cfbf-23e0-43bc-9a02-33e39062ae28 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:42.252880 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a288cfbf-23e0-43bc-9a02-33e39062ae28 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:42.432157 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a288cfbf-23e0-43bc-9a02-33e39062ae28 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadc4fac778e4eaf905a3fbc26fbb090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e751dfada40945a69472003d08f1bb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:42.443521 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a288cfbf-23e0-43bc-9a02-33e39062ae28 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cadc4fac778e4eaf905a3fbc26fbb090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e751dfada40945a69472003d08f1bb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:42.446110 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a288cfbf-23e0-43bc-9a02-33e39062ae28 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cadc4fac778e4eaf905a3fbc26fbb090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e751dfada40945a69472003d08f1bb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:42.447660 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a288cfbf-23e0-43bc-9a02-33e39062ae28 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] 10.222.0.17 "GET /compute/v2.1/servers/b3576570-0c74-42f9-ae44-ac9f049e980d" status: 200 len: 1330 microversion: 2.54 time: 0.225386 Jul 23 21:29:42.448898 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1924/3921] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:29:42 2022] GET /compute/v2.1/servers/b3576570-0c74-42f9-ae44-ac9f049e980d => generated 1330 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:29:42.592225 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-cf2b2d96-5bdf-4c3d-9587-77f8c486465f tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:42.592939 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-cf2b2d96-5bdf-4c3d-9587-77f8c486465f tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] [instance: f24f6136-4a47-44f1-9e79-fea1b1cbf057] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:42.611633 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2a7133c0-bed8-4591-be2c-8df9559ebfa6 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:42.613076 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-2a7133c0-bed8-4591-be2c-8df9559ebfa6 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: e9a7d9eb-cfeb-4392-9b44-3dc592d9ebd8] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:42.622961 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2a7133c0-bed8-4591-be2c-8df9559ebfa6 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:42.623610 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2a7133c0-bed8-4591-be2c-8df9559ebfa6 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:42.623895 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cf2b2d96-5bdf-4c3d-9587-77f8c486465f tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:42.624637 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cf2b2d96-5bdf-4c3d-9587-77f8c486465f tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:42.625081 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2a7133c0-bed8-4591-be2c-8df9559ebfa6 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:42.625868 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cf2b2d96-5bdf-4c3d-9587-77f8c486465f tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:42.626305 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2a7133c0-bed8-4591-be2c-8df9559ebfa6 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:42.626946 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cf2b2d96-5bdf-4c3d-9587-77f8c486465f tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:42.906431 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-cf2b2d96-5bdf-4c3d-9587-77f8c486465f tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b566640463e43aa85ec96a1aa76d3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eef3db6d5f46c9882fbe98cb732263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:42.911114 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=100 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:42.916253 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-cf2b2d96-5bdf-4c3d-9587-77f8c486465f tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] 10.222.0.17 "GET /compute/v2.1/servers/f24f6136-4a47-44f1-9e79-fea1b1cbf057" status: 200 len: 1510 microversion: 2.1 time: 0.331285 Jul 23 21:29:42.926360 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1998/3922] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:29:42 2022] GET /compute/v2.1/servers/f24f6136-4a47-44f1-9e79-fea1b1cbf057 => generated 1510 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:29:42.942719 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-96762493-cb54-4d52-907c-c81dcdf56cf1 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:42.947945 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-96762493-cb54-4d52-907c-c81dcdf56cf1 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] [instance: 063b75fd-42ba-4fb6-bcd0-06b9622e32b1] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:42.954685 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-96762493-cb54-4d52-907c-c81dcdf56cf1 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:42.955364 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-96762493-cb54-4d52-907c-c81dcdf56cf1 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:42.956139 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-96762493-cb54-4d52-907c-c81dcdf56cf1 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:42.956742 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-96762493-cb54-4d52-907c-c81dcdf56cf1 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:43.099481 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-2a7133c0-bed8-4591-be2c-8df9559ebfa6 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:43.114385 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2a7133c0-bed8-4591-be2c-8df9559ebfa6 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/e9a7d9eb-cfeb-4392-9b44-3dc592d9ebd8" status: 200 len: 1321 microversion: 2.1 time: 0.508950 Jul 23 21:29:43.115316 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1925/3923] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:29:42 2022] GET /compute/v2.1/servers/e9a7d9eb-cfeb-4392-9b44-3dc592d9ebd8 => generated 1321 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:29:43.142479 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-96762493-cb54-4d52-907c-c81dcdf56cf1 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca13fa56f9a342b69f198080ef10acaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1e19260e3448e08f349cbd4c4a3f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:43.166505 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-96762493-cb54-4d52-907c-c81dcdf56cf1 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca13fa56f9a342b69f198080ef10acaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1e19260e3448e08f349cbd4c4a3f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:43.169781 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-96762493-cb54-4d52-907c-c81dcdf56cf1 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca13fa56f9a342b69f198080ef10acaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1e19260e3448e08f349cbd4c4a3f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:43.171893 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-96762493-cb54-4d52-907c-c81dcdf56cf1 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] 10.222.0.17 "GET /compute/v2.1/servers/063b75fd-42ba-4fb6-bcd0-06b9622e32b1" status: 200 len: 1362 microversion: 2.26 time: 0.232953 Jul 23 21:29:43.173268 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 1999/3924] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:29:42 2022] GET /compute/v2.1/servers/063b75fd-42ba-4fb6-bcd0-06b9622e32b1 => generated 1362 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:29:43.225771 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-7e2fec2b-fbbb-48cd-80d8-4bc7c5238cf0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:43.226423 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-7e2fec2b-fbbb-48cd-80d8-4bc7c5238cf0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:43.237168 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7e2fec2b-fbbb-48cd-80d8-4bc7c5238cf0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:43.237638 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7e2fec2b-fbbb-48cd-80d8-4bc7c5238cf0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:43.238665 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7e2fec2b-fbbb-48cd-80d8-4bc7c5238cf0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:43.238921 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-88cee2f9-e16d-4d77-b2ed-fc6ed21e38cd tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:43.239110 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7e2fec2b-fbbb-48cd-80d8-4bc7c5238cf0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:43.239550 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-88cee2f9-e16d-4d77-b2ed-fc6ed21e38cd tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: 9a9ac364-9d41-4402-9312-9e363b68792d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:43.245583 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-88cee2f9-e16d-4d77-b2ed-fc6ed21e38cd tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:43.246306 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-88cee2f9-e16d-4d77-b2ed-fc6ed21e38cd tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:43.301242 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-88cee2f9-e16d-4d77-b2ed-fc6ed21e38cd tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:43.301242 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-88cee2f9-e16d-4d77-b2ed-fc6ed21e38cd tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:43.439309 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-7e2fec2b-fbbb-48cd-80d8-4bc7c5238cf0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:43.452411 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-7e2fec2b-fbbb-48cd-80d8-4bc7c5238cf0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:43.457707 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-7e2fec2b-fbbb-48cd-80d8-4bc7c5238cf0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:43.460472 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-7e2fec2b-fbbb-48cd-80d8-4bc7c5238cf0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.238980 Jul 23 21:29:43.464006 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1926/3925] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:29:43 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:29:43.475619 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-266fc024-a2ba-4da6-828c-560d528dee7f tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:43.476353 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-266fc024-a2ba-4da6-828c-560d528dee7f tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] [instance: b3576570-0c74-42f9-ae44-ac9f049e980d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:43.491097 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-266fc024-a2ba-4da6-828c-560d528dee7f tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:43.492130 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-266fc024-a2ba-4da6-828c-560d528dee7f tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:43.500257 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-266fc024-a2ba-4da6-828c-560d528dee7f tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:43.501954 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-266fc024-a2ba-4da6-828c-560d528dee7f tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:43.545446 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-88cee2f9-e16d-4d77-b2ed-fc6ed21e38cd tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'affc3572ef7d45249f50b5061a681d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a892bfe56afd4ee5bb6c47e926af7349', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:43.566786 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-88cee2f9-e16d-4d77-b2ed-fc6ed21e38cd tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/9a9ac364-9d41-4402-9312-9e363b68792d" status: 200 len: 1509 microversion: 2.1 time: 0.332450 Jul 23 21:29:43.567385 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2000/3926] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:29:43 2022] GET /compute/v2.1/servers/9a9ac364-9d41-4402-9312-9e363b68792d => generated 1509 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:29:43.714541 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-266fc024-a2ba-4da6-828c-560d528dee7f tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadc4fac778e4eaf905a3fbc26fbb090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e751dfada40945a69472003d08f1bb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:43.725127 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-36ea47b0-1ea3-45ff-9bd8-deeb9d7eb45a req-3e66d639-b0c5-4eeb-adf2-0223b3d67b8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f24f6136-4a47-44f1-9e79-fea1b1cbf057", "name": "network-vif-deleted", "tag": "fb17bdf4-0872-4074-8623-374df990053a"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:29:43.730051 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-266fc024-a2ba-4da6-828c-560d528dee7f tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cadc4fac778e4eaf905a3fbc26fbb090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e751dfada40945a69472003d08f1bb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:43.736733 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-266fc024-a2ba-4da6-828c-560d528dee7f tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cadc4fac778e4eaf905a3fbc26fbb090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e751dfada40945a69472003d08f1bb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:43.738297 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-266fc024-a2ba-4da6-828c-560d528dee7f tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] 10.222.0.17 "GET /compute/v2.1/servers/b3576570-0c74-42f9-ae44-ac9f049e980d" status: 200 len: 1336 microversion: 2.54 time: 0.272966 Jul 23 21:29:43.738835 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-36ea47b0-1ea3-45ff-9bd8-deeb9d7eb45a req-3e66d639-b0c5-4eeb-adf2-0223b3d67b8a service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:43.739304 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-36ea47b0-1ea3-45ff-9bd8-deeb9d7eb45a req-3e66d639-b0c5-4eeb-adf2-0223b3d67b8a service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:43.739883 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1927/3927] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:29:43 2022] GET /compute/v2.1/servers/b3576570-0c74-42f9-ae44-ac9f049e980d => generated 1336 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:29:43.765075 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-36ea47b0-1ea3-45ff-9bd8-deeb9d7eb45a req-3e66d639-b0c5-4eeb-adf2-0223b3d67b8a service nova] Creating event network-vif-deleted:fb17bdf4-0872-4074-8623-374df990053a for instance f24f6136-4a47-44f1-9e79-fea1b1cbf057 on nch2-master-1 Jul 23 21:29:43.770760 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-36ea47b0-1ea3-45ff-9bd8-deeb9d7eb45a req-3e66d639-b0c5-4eeb-adf2-0223b3d67b8a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049946 Jul 23 21:29:43.772192 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2001/3928] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:29:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:29:43.936836 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c4dd77d6-1776-4c51-bcac-b03542d6f914 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:43.937732 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c4dd77d6-1776-4c51-bcac-b03542d6f914 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] [instance: f24f6136-4a47-44f1-9e79-fea1b1cbf057] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:43.953505 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c4dd77d6-1776-4c51-bcac-b03542d6f914 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:43.959657 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c4dd77d6-1776-4c51-bcac-b03542d6f914 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:43.960707 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c4dd77d6-1776-4c51-bcac-b03542d6f914 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:43.961168 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c4dd77d6-1776-4c51-bcac-b03542d6f914 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:44.014077 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c4dd77d6-1776-4c51-bcac-b03542d6f914 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:44.014537 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c4dd77d6-1776-4c51-bcac-b03542d6f914 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:44.014999 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.objects.instance [None req-c4dd77d6-1776-4c51-bcac-b03542d6f914 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lazy-loading 'fault' on Instance uuid f24f6136-4a47-44f1-9e79-fea1b1cbf057 {{(pid=131320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:29:44.067761 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c4dd77d6-1776-4c51-bcac-b03542d6f914 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b566640463e43aa85ec96a1aa76d3f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eef3db6d5f46c9882fbe98cb732263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:44.077937 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c4dd77d6-1776-4c51-bcac-b03542d6f914 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] 10.222.0.17 "GET /compute/v2.1/servers/f24f6136-4a47-44f1-9e79-fea1b1cbf057" status: 200 len: 1313 microversion: 2.1 time: 0.147802 Jul 23 21:29:44.079191 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1928/3929] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:29:43 2022] GET /compute/v2.1/servers/f24f6136-4a47-44f1-9e79-fea1b1cbf057 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:29:44.132538 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-374a33a7-009e-4c84-90ce-9d2cd7bd03c3 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:44.133353 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-374a33a7-009e-4c84-90ce-9d2cd7bd03c3 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: e9a7d9eb-cfeb-4392-9b44-3dc592d9ebd8] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:44.151671 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-374a33a7-009e-4c84-90ce-9d2cd7bd03c3 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:44.152132 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-374a33a7-009e-4c84-90ce-9d2cd7bd03c3 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:44.163440 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-374a33a7-009e-4c84-90ce-9d2cd7bd03c3 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:44.164008 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-374a33a7-009e-4c84-90ce-9d2cd7bd03c3 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:44.194468 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2405316d-5d6a-4853-8313-0e6ce5441b5c tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:44.195709 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-2405316d-5d6a-4853-8313-0e6ce5441b5c tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] [instance: 063b75fd-42ba-4fb6-bcd0-06b9622e32b1] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:44.205424 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2405316d-5d6a-4853-8313-0e6ce5441b5c tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:44.206094 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2405316d-5d6a-4853-8313-0e6ce5441b5c tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:44.207122 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2405316d-5d6a-4853-8313-0e6ce5441b5c tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:44.207713 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2405316d-5d6a-4853-8313-0e6ce5441b5c tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:44.214403 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:44.426679 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-2405316d-5d6a-4853-8313-0e6ce5441b5c tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca13fa56f9a342b69f198080ef10acaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1e19260e3448e08f349cbd4c4a3f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:44.428285 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-374a33a7-009e-4c84-90ce-9d2cd7bd03c3 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:44.436118 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-2405316d-5d6a-4853-8313-0e6ce5441b5c tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca13fa56f9a342b69f198080ef10acaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1e19260e3448e08f349cbd4c4a3f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:44.439093 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-374a33a7-009e-4c84-90ce-9d2cd7bd03c3 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/e9a7d9eb-cfeb-4392-9b44-3dc592d9ebd8" status: 200 len: 1502 microversion: 2.1 time: 0.311517 Jul 23 21:29:44.440126 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2002/3930] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:29:44 2022] GET /compute/v2.1/servers/e9a7d9eb-cfeb-4392-9b44-3dc592d9ebd8 => generated 1502 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:29:44.446165 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-2405316d-5d6a-4853-8313-0e6ce5441b5c tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca13fa56f9a342b69f198080ef10acaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1e19260e3448e08f349cbd4c4a3f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:44.446500 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-7c679e23-82cf-47b3-810a-eb7bec64f454 req-38fc28ae-655f-45a4-aec1-44c083aebd94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "063b75fd-42ba-4fb6-bcd0-06b9622e32b1", "name": "network-vif-plugged", "status": "completed", "tag": "55ad3ac1-2c82-4462-8c36-48b51682f148"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:29:44.447403 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2405316d-5d6a-4853-8313-0e6ce5441b5c tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] 10.222.0.17 "GET /compute/v2.1/servers/063b75fd-42ba-4fb6-bcd0-06b9622e32b1" status: 200 len: 1362 microversion: 2.26 time: 0.258323 Jul 23 21:29:44.458650 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1929/3931] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:29:44 2022] GET /compute/v2.1/servers/063b75fd-42ba-4fb6-bcd0-06b9622e32b1 => generated 1362 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:29:44.471397 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-7c679e23-82cf-47b3-810a-eb7bec64f454 req-38fc28ae-655f-45a4-aec1-44c083aebd94 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:44.471605 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f9b49c17-1124-45e9-b4be-8ae7f94eec0f tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:44.472179 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f9b49c17-1124-45e9-b4be-8ae7f94eec0f tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: e9a7d9eb-cfeb-4392-9b44-3dc592d9ebd8] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:44.472589 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-7c679e23-82cf-47b3-810a-eb7bec64f454 req-38fc28ae-655f-45a4-aec1-44c083aebd94 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:44.487018 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f9b49c17-1124-45e9-b4be-8ae7f94eec0f tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:44.487476 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f9b49c17-1124-45e9-b4be-8ae7f94eec0f tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:44.488421 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f9b49c17-1124-45e9-b4be-8ae7f94eec0f tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:44.488805 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f9b49c17-1124-45e9-b4be-8ae7f94eec0f tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:44.502652 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-7c679e23-82cf-47b3-810a-eb7bec64f454 req-38fc28ae-655f-45a4-aec1-44c083aebd94 service nova] Creating event network-vif-plugged:55ad3ac1-2c82-4462-8c36-48b51682f148 for instance 063b75fd-42ba-4fb6-bcd0-06b9622e32b1 on nch1-master-1 Jul 23 21:29:44.519226 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-7c679e23-82cf-47b3-810a-eb7bec64f454 req-38fc28ae-655f-45a4-aec1-44c083aebd94 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077116 Jul 23 21:29:44.519846 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2003/3932] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:29:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:29:44.542678 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-44614816-94be-494d-8e93-fcaf6169a9ce tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:44.548106 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-44614816-94be-494d-8e93-fcaf6169a9ce tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:44.561944 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-44614816-94be-494d-8e93-fcaf6169a9ce tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:44.562904 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-44614816-94be-494d-8e93-fcaf6169a9ce tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:44.564882 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-44614816-94be-494d-8e93-fcaf6169a9ce tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:44.568047 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-44614816-94be-494d-8e93-fcaf6169a9ce tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:44.655962 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-44614816-94be-494d-8e93-fcaf6169a9ce tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:44.670962 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-44614816-94be-494d-8e93-fcaf6169a9ce tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:44.672572 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-44614816-94be-494d-8e93-fcaf6169a9ce tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:44.679458 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-44614816-94be-494d-8e93-fcaf6169a9ce tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.142861 Jul 23 21:29:44.681153 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2004/3933] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:29:44 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:29:44.701927 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f9b49c17-1124-45e9-b4be-8ae7f94eec0f tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:44.703133 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d488555d-5a6b-437e-97c0-518c986fe4dc tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:44.704358 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-d488555d-5a6b-437e-97c0-518c986fe4dc tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: 9a9ac364-9d41-4402-9312-9e363b68792d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:44.711324 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f9b49c17-1124-45e9-b4be-8ae7f94eec0f tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/e9a7d9eb-cfeb-4392-9b44-3dc592d9ebd8" status: 200 len: 1502 microversion: 2.1 time: 0.254338 Jul 23 21:29:44.711952 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1930/3934] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:29:44 2022] GET /compute/v2.1/servers/e9a7d9eb-cfeb-4392-9b44-3dc592d9ebd8 => generated 1502 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:29:44.714102 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d488555d-5a6b-437e-97c0-518c986fe4dc tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:44.714516 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d488555d-5a6b-437e-97c0-518c986fe4dc tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:44.715300 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d488555d-5a6b-437e-97c0-518c986fe4dc tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:44.716227 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d488555d-5a6b-437e-97c0-518c986fe4dc tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:44.731188 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-33be4de8-dbdf-4dfb-98e1-0898299a7f5e tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:44.731696 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-33be4de8-dbdf-4dfb-98e1-0898299a7f5e tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: e9a7d9eb-cfeb-4392-9b44-3dc592d9ebd8] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:44.735362 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-d488555d-5a6b-437e-97c0-518c986fe4dc tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] HTTP exception thrown: Instance 9a9ac364-9d41-4402-9312-9e363b68792d could not be found. Jul 23 21:29:44.737600 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d488555d-5a6b-437e-97c0-518c986fe4dc tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Request method failure captured: Jul 23 21:29:44.737600 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/servers/9a9ac364-9d41-4402-9312-9e363b68792d HTTP/1.1 Jul 23 21:29:44.737600 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:29:44.737600 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:29:44.737600 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:29:44.737600 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:29:44.737600 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:29:44.737600 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:29:44.737600 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:29:44.737600 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:29:44.737600 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GddaYqyOuWcIIbeHmsk3fPEmdWyfGLbr9Nsz9MmxXVcs_PKtvbIqY2C8j4fzxFCSVf8V3fYFIZhvaOHyCuudCVcoCOVgWdy__DYWHqWW4I8VD_yG4rJj0HZodonpxNaGqSkGiL8DXUXMaZTTZO1BvjnTGQlN8CnshrUQQ72pGMeb2k Jul 23 21:29:44.737600 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:29:44.737600 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:29:44.737600 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:29:44.737600 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:29:44.737600 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:29:44.737600 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:29:44.737600 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: a892bfe56afd4ee5bb6c47e926af7349 Jul 23 21:29:44.737600 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-DeleteServersTestJSON-745069838 Jul 23 21:29:44.737600 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:29:44.737600 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:29:44.737600 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a892bfe56afd4ee5bb6c47e926af7349"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a892bfe56afd4ee5bb6c47e926af7349"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a892bfe56afd4ee5bb6c47e926af7349", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a892bfe56afd4ee5bb6c47e926af7349"}]}] Jul 23 21:29:44.737600 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-DeleteServersTestJSON-745069838 Jul 23 21:29:44.737600 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: a892bfe56afd4ee5bb6c47e926af7349 Jul 23 21:29:44.737600 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-DeleteServersTestJSON-745069838 Jul 23 21:29:44.737600 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-DeleteServersTestJSON-745069838-project Jul 23 21:29:44.737600 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:29:44.737600 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:29:44.737600 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: affc3572ef7d45249f50b5061a681d18 Jul 23 21:29:44.737600 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-DeleteServersTestJSON-745069838-project Jul 23 21:29:44.737600 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:29:44.737600 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance 9a9ac364-9d41-4402-9312-9e363b68792d could not be found. Jul 23 21:29:44.737600 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': '9a9ac364-9d41-4402-9312-9e363b68792d'} Jul 23 21:29:44.737600 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:29:44.737600 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:29:44.737600 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:29:44.737600 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:29:44.737600 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:29:44.737600 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:29:44.737600 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:29:44.737600 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:29:44.737600 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:29:44.737600 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:29:44.737600 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a9ac364-9d41-4402-9312-9e363b68792d could not be found. Jul 23 21:29:44.737600 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:29:44.737600 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:29:44.737600 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:29:44.737600 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:29:44.737600 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:29:44.737600 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:29:44.737600 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:29:44.737600 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:29:44.737600 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:29:44.737600 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:29:44.737600 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:29:44.737600 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:29:44.737600 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:29:44.737600 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:29:44.737600 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:29:44.737600 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:29:44.737600 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a9ac364-9d41-4402-9312-9e363b68792d could not be found. Jul 23 21:29:44.737600 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:29:44.737600 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:29:44.737600 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:29:44.740549 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:29:44.740549 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:29:44.740549 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:29:44.740549 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:29:44.740549 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:29:44.740549 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a9ac364-9d41-4402-9312-9e363b68792d could not be found. Jul 23 21:29:44.740549 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:29:44.740870 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-33be4de8-dbdf-4dfb-98e1-0898299a7f5e tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:44.740870 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-33be4de8-dbdf-4dfb-98e1-0898299a7f5e tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:44.740870 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-33be4de8-dbdf-4dfb-98e1-0898299a7f5e tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:44.741235 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-33be4de8-dbdf-4dfb-98e1-0898299a7f5e tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:44.742178 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d488555d-5a6b-437e-97c0-518c986fe4dc tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Returning 404 to user: Instance 9a9ac364-9d41-4402-9312-9e363b68792d could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:29:44.744131 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-d488555d-5a6b-437e-97c0-518c986fe4dc tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/9a9ac364-9d41-4402-9312-9e363b68792d" status: 404 len: 111 microversion: 2.1 time: 0.050220 Jul 23 21:29:44.749947 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2005/3935] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:29:44 2022] GET /compute/v2.1/servers/9a9ac364-9d41-4402-9312-9e363b68792d => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:29:44.755921 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-7ad202b7-99e1-4f4d-b634-f59c929198bd tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:44.756435 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-7ad202b7-99e1-4f4d-b634-f59c929198bd tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: e893255e-87db-418f-8374-dc2d800f4ff5] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:44.764212 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7ad202b7-99e1-4f4d-b634-f59c929198bd tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:44.765021 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7ad202b7-99e1-4f4d-b634-f59c929198bd tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:44.765885 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7ad202b7-99e1-4f4d-b634-f59c929198bd tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:44.766506 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7ad202b7-99e1-4f4d-b634-f59c929198bd tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:44.778829 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-33be4de8-dbdf-4dfb-98e1-0898299a7f5e tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: e9a7d9eb-cfeb-4392-9b44-3dc592d9ebd8] Going to try to terminate instance {{(pid=131320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:29:44.783584 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-7ad202b7-99e1-4f4d-b634-f59c929198bd tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] HTTP exception thrown: Instance e893255e-87db-418f-8374-dc2d800f4ff5 could not be found. Jul 23 21:29:44.785941 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-7ad202b7-99e1-4f4d-b634-f59c929198bd tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Request method failure captured: Jul 23 21:29:44.785941 ncdv-master-1 devstack@n-api.service[131321]: request: DELETE /compute/v2.1/servers/e893255e-87db-418f-8374-dc2d800f4ff5 HTTP/1.1 Jul 23 21:29:44.785941 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:29:44.785941 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:29:44.785941 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:29:44.785941 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:29:44.785941 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:29:44.785941 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:29:44.785941 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:29:44.785941 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:29:44.785941 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GddaYqyOuWcIIbeHmsk3fPEmdWyfGLbr9Nsz9MmxXVcs_PKtvbIqY2C8j4fzxFCSVf8V3fYFIZhvaOHyCuudCVcoCOVgWdy__DYWHqWW4I8VD_yG4rJj0HZodonpxNaGqSkGiL8DXUXMaZTTZO1BvjnTGQlN8CnshrUQQ72pGMeb2k Jul 23 21:29:44.785941 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:29:44.785941 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:29:44.785941 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:29:44.785941 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:29:44.785941 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:29:44.785941 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:29:44.785941 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: a892bfe56afd4ee5bb6c47e926af7349 Jul 23 21:29:44.785941 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-DeleteServersTestJSON-745069838 Jul 23 21:29:44.785941 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:29:44.785941 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:29:44.785941 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a892bfe56afd4ee5bb6c47e926af7349"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a892bfe56afd4ee5bb6c47e926af7349"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a892bfe56afd4ee5bb6c47e926af7349", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a892bfe56afd4ee5bb6c47e926af7349"}]}] Jul 23 21:29:44.785941 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-DeleteServersTestJSON-745069838 Jul 23 21:29:44.785941 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: a892bfe56afd4ee5bb6c47e926af7349 Jul 23 21:29:44.785941 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-DeleteServersTestJSON-745069838 Jul 23 21:29:44.785941 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-DeleteServersTestJSON-745069838-project Jul 23 21:29:44.785941 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:29:44.785941 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:29:44.785941 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: affc3572ef7d45249f50b5061a681d18 Jul 23 21:29:44.785941 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-DeleteServersTestJSON-745069838-project Jul 23 21:29:44.785941 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:29:44.785941 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance e893255e-87db-418f-8374-dc2d800f4ff5 could not be found. Jul 23 21:29:44.785941 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': 'e893255e-87db-418f-8374-dc2d800f4ff5'} Jul 23 21:29:44.785941 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:29:44.785941 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:29:44.785941 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:29:44.785941 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:29:44.785941 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:29:44.785941 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:29:44.785941 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:29:44.785941 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:29:44.785941 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:29:44.785941 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:29:44.785941 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e893255e-87db-418f-8374-dc2d800f4ff5 could not be found. Jul 23 21:29:44.785941 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:29:44.785941 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:29:44.785941 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:29:44.785941 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:29:44.785941 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:29:44.785941 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:29:44.785941 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:29:44.785941 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:29:44.785941 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:29:44.785941 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:29:44.785941 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 23 21:29:44.785941 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 23 21:29:44.785941 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 23 21:29:44.785941 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 23 21:29:44.785941 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:29:44.785941 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:29:44.785941 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:29:44.785941 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:29:44.788870 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e893255e-87db-418f-8374-dc2d800f4ff5 could not be found. Jul 23 21:29:44.788870 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:29:44.788870 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:29:44.788870 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:29:44.788870 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:29:44.788870 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:29:44.788870 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:29:44.788870 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:29:44.788870 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:29:44.788870 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e893255e-87db-418f-8374-dc2d800f4ff5 could not be found. Jul 23 21:29:44.788870 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:29:44.788870 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-7ad202b7-99e1-4f4d-b634-f59c929198bd tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Returning 404 to user: Instance e893255e-87db-418f-8374-dc2d800f4ff5 could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:29:44.788870 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-7ad202b7-99e1-4f4d-b634-f59c929198bd tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "DELETE /compute/v2.1/servers/e893255e-87db-418f-8374-dc2d800f4ff5" status: 404 len: 111 microversion: 2.1 time: 0.036528 Jul 23 21:29:44.791630 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2006/3936] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:29:44 2022] DELETE /compute/v2.1/servers/e893255e-87db-418f-8374-dc2d800f4ff5 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:29:44.799024 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a4872d7e-d3bc-4a2c-8cb4-752b32894c5c tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:44.799648 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-a4872d7e-d3bc-4a2c-8cb4-752b32894c5c tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] [instance: b3576570-0c74-42f9-ae44-ac9f049e980d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:44.806556 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a4872d7e-d3bc-4a2c-8cb4-752b32894c5c tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:44.807058 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a4872d7e-d3bc-4a2c-8cb4-752b32894c5c tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:44.807975 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a4872d7e-d3bc-4a2c-8cb4-752b32894c5c tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:44.808565 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a4872d7e-d3bc-4a2c-8cb4-752b32894c5c tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:44.897596 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-33be4de8-dbdf-4dfb-98e1-0898299a7f5e tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "DELETE /compute/v2.1/servers/e9a7d9eb-cfeb-4392-9b44-3dc592d9ebd8" status: 204 len: 0 microversion: 2.1 time: 0.169776 Jul 23 21:29:44.902554 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1931/3937] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:29:44 2022] DELETE /compute/v2.1/servers/e9a7d9eb-cfeb-4392-9b44-3dc592d9ebd8 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 23 21:29:44.906383 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-a4872d7e-d3bc-4a2c-8cb4-752b32894c5c tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadc4fac778e4eaf905a3fbc26fbb090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e751dfada40945a69472003d08f1bb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:44.909565 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-37d8e810-277d-4496-8566-448e885eb0a4 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:44.910942 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-37d8e810-277d-4496-8566-448e885eb0a4 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] [instance: e893255e-87db-418f-8374-dc2d800f4ff5] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:44.918902 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-37d8e810-277d-4496-8566-448e885eb0a4 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:44.919403 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-37d8e810-277d-4496-8566-448e885eb0a4 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:44.920676 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-37d8e810-277d-4496-8566-448e885eb0a4 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:44.920780 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-a4872d7e-d3bc-4a2c-8cb4-752b32894c5c tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cadc4fac778e4eaf905a3fbc26fbb090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e751dfada40945a69472003d08f1bb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:44.921177 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-37d8e810-277d-4496-8566-448e885eb0a4 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:44.922394 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-a4872d7e-d3bc-4a2c-8cb4-752b32894c5c tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cadc4fac778e4eaf905a3fbc26fbb090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e751dfada40945a69472003d08f1bb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:44.923627 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-a4872d7e-d3bc-4a2c-8cb4-752b32894c5c tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] 10.222.0.17 "GET /compute/v2.1/servers/b3576570-0c74-42f9-ae44-ac9f049e980d" status: 200 len: 1336 microversion: 2.54 time: 0.130904 Jul 23 21:29:44.926570 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2007/3938] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:29:44 2022] GET /compute/v2.1/servers/b3576570-0c74-42f9-ae44-ac9f049e980d => generated 1336 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:29:44.934278 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-029ff6ef-207b-4cbc-b2f4-7417762bbd3a tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:44.935065 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-029ff6ef-207b-4cbc-b2f4-7417762bbd3a tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: e9a7d9eb-cfeb-4392-9b44-3dc592d9ebd8] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:44.945439 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-029ff6ef-207b-4cbc-b2f4-7417762bbd3a tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:44.945921 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-029ff6ef-207b-4cbc-b2f4-7417762bbd3a tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:44.946707 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-029ff6ef-207b-4cbc-b2f4-7417762bbd3a tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:44.947146 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-029ff6ef-207b-4cbc-b2f4-7417762bbd3a tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:44.956077 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-37d8e810-277d-4496-8566-448e885eb0a4 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] HTTP exception thrown: Instance e893255e-87db-418f-8374-dc2d800f4ff5 could not be found. Jul 23 21:29:44.959701 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-37d8e810-277d-4496-8566-448e885eb0a4 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Request method failure captured: Jul 23 21:29:44.959701 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/e893255e-87db-418f-8374-dc2d800f4ff5 HTTP/1.1 Jul 23 21:29:44.959701 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:29:44.959701 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:29:44.959701 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:29:44.959701 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:29:44.959701 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:29:44.959701 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:29:44.959701 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:29:44.959701 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:29:44.959701 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GddaYqyOuWcIIbeHmsk3fPEmdWyfGLbr9Nsz9MmxXVcs_PKtvbIqY2C8j4fzxFCSVf8V3fYFIZhvaOHyCuudCVcoCOVgWdy__DYWHqWW4I8VD_yG4rJj0HZodonpxNaGqSkGiL8DXUXMaZTTZO1BvjnTGQlN8CnshrUQQ72pGMeb2k Jul 23 21:29:44.959701 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:29:44.959701 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:29:44.959701 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:29:44.959701 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:29:44.959701 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:29:44.959701 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:29:44.959701 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: a892bfe56afd4ee5bb6c47e926af7349 Jul 23 21:29:44.959701 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-DeleteServersTestJSON-745069838 Jul 23 21:29:44.959701 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:29:44.959701 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:29:44.959701 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a892bfe56afd4ee5bb6c47e926af7349"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a892bfe56afd4ee5bb6c47e926af7349"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a892bfe56afd4ee5bb6c47e926af7349", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a892bfe56afd4ee5bb6c47e926af7349"}]}] Jul 23 21:29:44.959701 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-DeleteServersTestJSON-745069838 Jul 23 21:29:44.959701 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: a892bfe56afd4ee5bb6c47e926af7349 Jul 23 21:29:44.959701 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-DeleteServersTestJSON-745069838 Jul 23 21:29:44.959701 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-DeleteServersTestJSON-745069838-project Jul 23 21:29:44.959701 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:29:44.959701 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:29:44.959701 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: affc3572ef7d45249f50b5061a681d18 Jul 23 21:29:44.959701 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-DeleteServersTestJSON-745069838-project Jul 23 21:29:44.959701 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:29:44.959701 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance e893255e-87db-418f-8374-dc2d800f4ff5 could not be found. Jul 23 21:29:44.959701 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': 'e893255e-87db-418f-8374-dc2d800f4ff5'} Jul 23 21:29:44.959701 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:29:44.959701 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:29:44.959701 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:29:44.959701 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:29:44.959701 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:29:44.959701 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:29:44.959701 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:29:44.959701 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:29:44.959701 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:29:44.959701 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:29:44.959701 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e893255e-87db-418f-8374-dc2d800f4ff5 could not be found. Jul 23 21:29:44.959701 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:29:44.959701 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:29:44.959701 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:29:44.959701 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:29:44.959701 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:29:44.959701 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:29:44.959701 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:29:44.959701 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:29:44.959701 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:29:44.959701 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:29:44.959701 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:29:44.959701 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:29:44.959701 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:29:44.959701 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:29:44.959701 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:29:44.959701 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:29:44.959701 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e893255e-87db-418f-8374-dc2d800f4ff5 could not be found. Jul 23 21:29:44.959701 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:29:44.959701 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:29:44.959701 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:29:44.962560 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:29:44.962560 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:29:44.962560 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:29:44.962560 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:29:44.962560 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:29:44.962560 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e893255e-87db-418f-8374-dc2d800f4ff5 could not be found. Jul 23 21:29:44.962560 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:29:44.962560 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-37d8e810-277d-4496-8566-448e885eb0a4 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] Returning 404 to user: Instance e893255e-87db-418f-8374-dc2d800f4ff5 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:29:44.962560 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-37d8e810-277d-4496-8566-448e885eb0a4 tempest-DeleteServersTestJSON-745069838 tempest-DeleteServersTestJSON-745069838-project] 10.222.0.17 "GET /compute/v2.1/servers/e893255e-87db-418f-8374-dc2d800f4ff5" status: 404 len: 111 microversion: 2.1 time: 0.057192 Jul 23 21:29:44.963150 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1932/3939] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:29:44 2022] GET /compute/v2.1/servers/e893255e-87db-418f-8374-dc2d800f4ff5 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:29:45.097602 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-eada11ac-5f1e-4fd4-8c0c-a7aabc5bf868 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:45.098974 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-eada11ac-5f1e-4fd4-8c0c-a7aabc5bf868 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] [instance: f24f6136-4a47-44f1-9e79-fea1b1cbf057] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:45.107523 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-eada11ac-5f1e-4fd4-8c0c-a7aabc5bf868 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:45.108274 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-eada11ac-5f1e-4fd4-8c0c-a7aabc5bf868 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:45.109952 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-eada11ac-5f1e-4fd4-8c0c-a7aabc5bf868 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:45.110676 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-eada11ac-5f1e-4fd4-8c0c-a7aabc5bf868 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:45.140962 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-eada11ac-5f1e-4fd4-8c0c-a7aabc5bf868 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] HTTP exception thrown: Instance f24f6136-4a47-44f1-9e79-fea1b1cbf057 could not be found. Jul 23 21:29:45.145242 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-eada11ac-5f1e-4fd4-8c0c-a7aabc5bf868 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Request method failure captured: Jul 23 21:29:45.145242 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/f24f6136-4a47-44f1-9e79-fea1b1cbf057 HTTP/1.1 Jul 23 21:29:45.145242 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:29:45.145242 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:29:45.145242 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:29:45.145242 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:29:45.145242 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:29:45.145242 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:29:45.145242 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:29:45.145242 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:29:45.145242 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3Gf1nSLtCL6r8HwKl9QPHFFqcoGL6yQnA0rOmdby9QZ5h_iNyzCPPpJw1ZYa7PBA16I_6yuzUmyd4LRjLThOO7vjntboip8FLbJfNbfKnHQt2WxhkOYpNi2le8neZqohrmIg0EARIjWmcoTgrVPkHCZWYiphLP_CBb4jS-7mekT0mis Jul 23 21:29:45.145242 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:29:45.145242 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:29:45.145242 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:29:45.145242 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:29:45.145242 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:29:45.145242 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:29:45.145242 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: f3eef3db6d5f46c9882fbe98cb732263 Jul 23 21:29:45.145242 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-371159432 Jul 23 21:29:45.145242 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:29:45.145242 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:29:45.145242 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f3eef3db6d5f46c9882fbe98cb732263"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f3eef3db6d5f46c9882fbe98cb732263"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f3eef3db6d5f46c9882fbe98cb732263", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f3eef3db6d5f46c9882fbe98cb732263"}]}] Jul 23 21:29:45.145242 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-371159432 Jul 23 21:29:45.145242 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: f3eef3db6d5f46c9882fbe98cb732263 Jul 23 21:29:45.145242 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-371159432 Jul 23 21:29:45.145242 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServerRescueTestJSONUnderV235-371159432-project Jul 23 21:29:45.145242 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:29:45.145242 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:29:45.145242 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 3b566640463e43aa85ec96a1aa76d3f8 Jul 23 21:29:45.145242 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-371159432-project Jul 23 21:29:45.145242 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:29:45.145242 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance f24f6136-4a47-44f1-9e79-fea1b1cbf057 could not be found. Jul 23 21:29:45.145242 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': 'f24f6136-4a47-44f1-9e79-fea1b1cbf057'} Jul 23 21:29:45.145242 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:29:45.145242 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:29:45.145242 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:29:45.145242 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:29:45.145242 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:29:45.145242 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:29:45.145242 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:29:45.145242 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:29:45.145242 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:29:45.145242 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:29:45.145242 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f24f6136-4a47-44f1-9e79-fea1b1cbf057 could not be found. Jul 23 21:29:45.145242 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:29:45.145242 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:29:45.145242 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:29:45.145242 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:29:45.145242 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:29:45.145242 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:29:45.145242 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:29:45.145242 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:29:45.145242 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:29:45.145242 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:29:45.145242 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:29:45.145242 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:29:45.145242 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:29:45.145242 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:29:45.145242 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:29:45.145242 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:29:45.145242 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f24f6136-4a47-44f1-9e79-fea1b1cbf057 could not be found. Jul 23 21:29:45.145242 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:29:45.145242 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:29:45.148909 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:29:45.148909 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:29:45.148909 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:29:45.148909 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:29:45.148909 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:29:45.148909 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:29:45.148909 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f24f6136-4a47-44f1-9e79-fea1b1cbf057 could not be found. Jul 23 21:29:45.148909 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:29:45.151596 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-029ff6ef-207b-4cbc-b2f4-7417762bbd3a tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:45.160697 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-eada11ac-5f1e-4fd4-8c0c-a7aabc5bf868 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] Returning 404 to user: Instance f24f6136-4a47-44f1-9e79-fea1b1cbf057 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:29:45.162230 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-eada11ac-5f1e-4fd4-8c0c-a7aabc5bf868 tempest-ServerRescueTestJSONUnderV235-371159432 tempest-ServerRescueTestJSONUnderV235-371159432-project] 10.222.0.17 "GET /compute/v2.1/servers/f24f6136-4a47-44f1-9e79-fea1b1cbf057" status: 404 len: 111 microversion: 2.1 time: 0.070160 Jul 23 21:29:45.162978 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1933/3940] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:29:45 2022] GET /compute/v2.1/servers/f24f6136-4a47-44f1-9e79-fea1b1cbf057 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:29:45.170214 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-029ff6ef-207b-4cbc-b2f4-7417762bbd3a tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/e9a7d9eb-cfeb-4392-9b44-3dc592d9ebd8" status: 200 len: 1508 microversion: 2.1 time: 0.234938 Jul 23 21:29:45.171232 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2008/3941] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:29:44 2022] GET /compute/v2.1/servers/e9a7d9eb-cfeb-4392-9b44-3dc592d9ebd8 => generated 1508 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:29:45.471058 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4b2f74ae-007e-4f11-8b17-bc25198941ab tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:45.471718 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-4b2f74ae-007e-4f11-8b17-bc25198941ab tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] [instance: 063b75fd-42ba-4fb6-bcd0-06b9622e32b1] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:45.484969 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4b2f74ae-007e-4f11-8b17-bc25198941ab tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:45.485593 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4b2f74ae-007e-4f11-8b17-bc25198941ab tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:45.486440 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4b2f74ae-007e-4f11-8b17-bc25198941ab tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:45.486889 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4b2f74ae-007e-4f11-8b17-bc25198941ab tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:45.699539 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e292716a-ef0b-45ff-8c7f-50e4af5e92d2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:45.700160 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-e292716a-ef0b-45ff-8c7f-50e4af5e92d2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:45.706547 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e292716a-ef0b-45ff-8c7f-50e4af5e92d2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:45.707270 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e292716a-ef0b-45ff-8c7f-50e4af5e92d2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:45.708247 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e292716a-ef0b-45ff-8c7f-50e4af5e92d2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:45.708890 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e292716a-ef0b-45ff-8c7f-50e4af5e92d2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:45.804903 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-e292716a-ef0b-45ff-8c7f-50e4af5e92d2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:45.844761 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-4b2f74ae-007e-4f11-8b17-bc25198941ab tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca13fa56f9a342b69f198080ef10acaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1e19260e3448e08f349cbd4c4a3f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:45.850940 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-e292716a-ef0b-45ff-8c7f-50e4af5e92d2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:45.853320 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-e292716a-ef0b-45ff-8c7f-50e4af5e92d2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:45.855372 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-e292716a-ef0b-45ff-8c7f-50e4af5e92d2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.159741 Jul 23 21:29:45.855973 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-4b2f74ae-007e-4f11-8b17-bc25198941ab tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca13fa56f9a342b69f198080ef10acaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1e19260e3448e08f349cbd4c4a3f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:45.856938 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2009/3942] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:29:45 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:29:45.857716 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-4b2f74ae-007e-4f11-8b17-bc25198941ab tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca13fa56f9a342b69f198080ef10acaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1e19260e3448e08f349cbd4c4a3f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:45.860096 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4b2f74ae-007e-4f11-8b17-bc25198941ab tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] 10.222.0.17 "GET /compute/v2.1/servers/063b75fd-42ba-4fb6-bcd0-06b9622e32b1" status: 200 len: 1362 microversion: 2.26 time: 0.393195 Jul 23 21:29:45.861091 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1934/3943] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:29:45 2022] GET /compute/v2.1/servers/063b75fd-42ba-4fb6-bcd0-06b9622e32b1 => generated 1362 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:29:45.868983 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-28ddad9f-4a23-4998-919c-2d6d22eb575d req-e276bb7f-b599-411b-95b4-4e54800560a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a9ac364-9d41-4402-9312-9e363b68792d", "name": "network-vif-deleted", "tag": "e651ec2b-2723-4c75-9de2-9bc8e0fbef28"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:29:45.881043 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-28ddad9f-4a23-4998-919c-2d6d22eb575d req-e276bb7f-b599-411b-95b4-4e54800560a4 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:45.881573 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-28ddad9f-4a23-4998-919c-2d6d22eb575d req-e276bb7f-b599-411b-95b4-4e54800560a4 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:45.900270 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-28ddad9f-4a23-4998-919c-2d6d22eb575d req-e276bb7f-b599-411b-95b4-4e54800560a4 service nova] Creating event network-vif-deleted:e651ec2b-2723-4c75-9de2-9bc8e0fbef28 for instance 9a9ac364-9d41-4402-9312-9e363b68792d on nch2-master-1 Jul 23 21:29:45.908578 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-28ddad9f-4a23-4998-919c-2d6d22eb575d req-e276bb7f-b599-411b-95b4-4e54800560a4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050220 Jul 23 21:29:45.909256 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2010/3944] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:29:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:29:45.944128 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-35ad4b09-9433-47f1-9205-771032410264 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:45.945535 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-35ad4b09-9433-47f1-9205-771032410264 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] [instance: b3576570-0c74-42f9-ae44-ac9f049e980d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:45.955749 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-35ad4b09-9433-47f1-9205-771032410264 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:45.956793 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-35ad4b09-9433-47f1-9205-771032410264 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:45.958022 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-35ad4b09-9433-47f1-9205-771032410264 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:45.958669 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-35ad4b09-9433-47f1-9205-771032410264 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:46.111838 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-35ad4b09-9433-47f1-9205-771032410264 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadc4fac778e4eaf905a3fbc26fbb090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e751dfada40945a69472003d08f1bb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:46.127874 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-35ad4b09-9433-47f1-9205-771032410264 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cadc4fac778e4eaf905a3fbc26fbb090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e751dfada40945a69472003d08f1bb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:46.131131 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-35ad4b09-9433-47f1-9205-771032410264 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cadc4fac778e4eaf905a3fbc26fbb090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e751dfada40945a69472003d08f1bb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:46.134834 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-35ad4b09-9433-47f1-9205-771032410264 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] 10.222.0.17 "GET /compute/v2.1/servers/b3576570-0c74-42f9-ae44-ac9f049e980d" status: 200 len: 1357 microversion: 2.54 time: 0.195131 Jul 23 21:29:46.140140 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1935/3945] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:29:45 2022] GET /compute/v2.1/servers/b3576570-0c74-42f9-ae44-ac9f049e980d => generated 1357 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:29:46.160137 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-b9aa5110-56d4-4249-a1b2-100ab2736e8c tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Action: 'create', calling method: .version_select at 0x7f0b47cc4820>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-480804347", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWfprSSwqKoK8kgFgFNRosYaxK8/a+JG9Zd0S7/46OY1MdWi2Y77dBfokdF2dGVftrrjAiuMSXpBv46sJeuXdPenxuQSC4EJZalkrmcIBY+5aXYGLoMob26sbuaIQxyqw=="}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:29:46.176090 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-b9aa5110-56d4-4249-a1b2-100ab2736e8c tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Getting quotas for project e751dfada40945a69472003d08f1bb0b. Resources: {'key_pairs'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:29:46.190261 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6d87f385-1813-4265-83c3-e62009ba950d tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:46.190909 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6d87f385-1813-4265-83c3-e62009ba950d tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: e9a7d9eb-cfeb-4392-9b44-3dc592d9ebd8] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:46.198077 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6d87f385-1813-4265-83c3-e62009ba950d tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:46.199248 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6d87f385-1813-4265-83c3-e62009ba950d tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:46.199696 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-b9aa5110-56d4-4249-a1b2-100ab2736e8c tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Getting quotas for user cadc4fac778e4eaf905a3fbc26fbb090 and project e751dfada40945a69472003d08f1bb0b. Resources: {'key_pairs'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:29:46.200520 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6d87f385-1813-4265-83c3-e62009ba950d tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:46.201093 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6d87f385-1813-4265-83c3-e62009ba950d tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:46.254960 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-b9aa5110-56d4-4249-a1b2-100ab2736e8c tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 419 microversion: 2.54 time: 0.100502 Jul 23 21:29:46.255610 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2011/3946] 10.222.0.17 () {62 vars in 1199 bytes} [Sat Jul 23 21:29:46 2022] POST /compute/v2.1/os-keypairs => generated 419 bytes in 102 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 23 21:29:46.268751 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-2617770a-ef53-45e8-8844-9930c06e63e4 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-480804347", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:29:46.270696 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-2617770a-ef53-45e8-8844-9930c06e63e4 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] [instance: b3576570-0c74-42f9-ae44-ac9f049e980d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:46.277488 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2617770a-ef53-45e8-8844-9930c06e63e4 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:46.278202 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2617770a-ef53-45e8-8844-9930c06e63e4 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:46.279387 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2617770a-ef53-45e8-8844-9930c06e63e4 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:46.279978 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2617770a-ef53-45e8-8844-9930c06e63e4 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:46.454194 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-2617770a-ef53-45e8-8844-9930c06e63e4 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Flavor limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:29:46.454655 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-2617770a-ef53-45e8-8844-9930c06e63e4 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Image limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:29:46.455139 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-2617770a-ef53-45e8-8844-9930c06e63e4 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Flavor pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:29:46.455546 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-2617770a-ef53-45e8-8844-9930c06e63e4 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Image pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:29:46.458691 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-2617770a-ef53-45e8-8844-9930c06e63e4 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:29:46.592839 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6d87f385-1813-4265-83c3-e62009ba950d tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:46.605530 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6d87f385-1813-4265-83c3-e62009ba950d tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/e9a7d9eb-cfeb-4392-9b44-3dc592d9ebd8" status: 200 len: 1508 microversion: 2.1 time: 0.420944 Jul 23 21:29:46.606154 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1936/3947] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:29:46 2022] GET /compute/v2.1/servers/e9a7d9eb-cfeb-4392-9b44-3dc592d9ebd8 => generated 1508 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:29:46.661480 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-2617770a-ef53-45e8-8844-9930c06e63e4 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] [instance: b3576570-0c74-42f9-ae44-ac9f049e980d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:46.676464 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2617770a-ef53-45e8-8844-9930c06e63e4 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:46.677042 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2617770a-ef53-45e8-8844-9930c06e63e4 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:46.678694 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2617770a-ef53-45e8-8844-9930c06e63e4 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:46.680708 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2617770a-ef53-45e8-8844-9930c06e63e4 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:46.729465 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-2617770a-ef53-45e8-8844-9930c06e63e4 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] 10.222.0.17 "POST /compute/v2.1/servers/b3576570-0c74-42f9-ae44-ac9f049e980d/action" status: 202 len: 1139 microversion: 2.54 time: 0.464514 Jul 23 21:29:46.732348 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2012/3948] 10.222.0.17 () {62 vars in 1319 bytes} [Sat Jul 23 21:29:46 2022] POST /compute/v2.1/servers/b3576570-0c74-42f9-ae44-ac9f049e980d/action => generated 1139 bytes in 468 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 23 21:29:46.749545 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ba74f71c-22f6-49e2-af15-b132357ce95e tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:46.750493 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ba74f71c-22f6-49e2-af15-b132357ce95e tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] [instance: b3576570-0c74-42f9-ae44-ac9f049e980d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:46.768050 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ba74f71c-22f6-49e2-af15-b132357ce95e tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:46.768501 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ba74f71c-22f6-49e2-af15-b132357ce95e tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:46.769296 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ba74f71c-22f6-49e2-af15-b132357ce95e tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:46.769728 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ba74f71c-22f6-49e2-af15-b132357ce95e tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:46.879469 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-3b0e3728-ac27-4d28-bf92-51f1d1e9affe tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:46.880163 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-3b0e3728-ac27-4d28-bf92-51f1d1e9affe tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:46.901979 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3b0e3728-ac27-4d28-bf92-51f1d1e9affe tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:46.902439 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3b0e3728-ac27-4d28-bf92-51f1d1e9affe tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:46.905125 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3b0e3728-ac27-4d28-bf92-51f1d1e9affe tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:46.906348 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3b0e3728-ac27-4d28-bf92-51f1d1e9affe tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:47.032926 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ba74f71c-22f6-49e2-af15-b132357ce95e tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadc4fac778e4eaf905a3fbc26fbb090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e751dfada40945a69472003d08f1bb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:47.042270 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ba74f71c-22f6-49e2-af15-b132357ce95e tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cadc4fac778e4eaf905a3fbc26fbb090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e751dfada40945a69472003d08f1bb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:47.044734 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ba74f71c-22f6-49e2-af15-b132357ce95e tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cadc4fac778e4eaf905a3fbc26fbb090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e751dfada40945a69472003d08f1bb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:47.046253 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ba74f71c-22f6-49e2-af15-b132357ce95e tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] 10.222.0.17 "GET /compute/v2.1/servers/b3576570-0c74-42f9-ae44-ac9f049e980d" status: 200 len: 1408 microversion: 2.54 time: 0.300682 Jul 23 21:29:47.047444 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1937/3949] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:29:46 2022] GET /compute/v2.1/servers/b3576570-0c74-42f9-ae44-ac9f049e980d => generated 1408 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:29:47.057229 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-3b0e3728-ac27-4d28-bf92-51f1d1e9affe tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:47.071365 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-3b0e3728-ac27-4d28-bf92-51f1d1e9affe tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:47.073179 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-90b088bc-baf5-43aa-8c3f-1d10bb368e9b tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:47.074761 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-90b088bc-baf5-43aa-8c3f-1d10bb368e9b tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] [instance: 063b75fd-42ba-4fb6-bcd0-06b9622e32b1] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:47.075208 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-3b0e3728-ac27-4d28-bf92-51f1d1e9affe tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:47.076479 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-3b0e3728-ac27-4d28-bf92-51f1d1e9affe tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.204209 Jul 23 21:29:47.087723 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2013/3950] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:29:46 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:29:47.098762 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-90b088bc-baf5-43aa-8c3f-1d10bb368e9b tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:47.099759 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-90b088bc-baf5-43aa-8c3f-1d10bb368e9b tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:47.101724 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-90b088bc-baf5-43aa-8c3f-1d10bb368e9b tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:47.102549 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-90b088bc-baf5-43aa-8c3f-1d10bb368e9b tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:47.457847 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-90b088bc-baf5-43aa-8c3f-1d10bb368e9b tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca13fa56f9a342b69f198080ef10acaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1e19260e3448e08f349cbd4c4a3f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:47.470410 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-90b088bc-baf5-43aa-8c3f-1d10bb368e9b tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca13fa56f9a342b69f198080ef10acaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1e19260e3448e08f349cbd4c4a3f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:47.472070 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-90b088bc-baf5-43aa-8c3f-1d10bb368e9b tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca13fa56f9a342b69f198080ef10acaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1e19260e3448e08f349cbd4c4a3f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:47.480169 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-90b088bc-baf5-43aa-8c3f-1d10bb368e9b tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] 10.222.0.17 "GET /compute/v2.1/servers/063b75fd-42ba-4fb6-bcd0-06b9622e32b1" status: 200 len: 1545 microversion: 2.26 time: 0.429617 Jul 23 21:29:47.493887 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1938/3951] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:29:47 2022] GET /compute/v2.1/servers/063b75fd-42ba-4fb6-bcd0-06b9622e32b1 => generated 1545 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:29:47.502756 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-8118e30d-8760-4ba7-9058-69ef7e883a49 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Calling method '.version_select at 0x7f0b473193a0>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:47.565542 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8118e30d-8760-4ba7-9058-69ef7e883a49 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:47.566110 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8118e30d-8760-4ba7-9058-69ef7e883a49 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:47.566628 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-8118e30d-8760-4ba7-9058-69ef7e883a49 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] [instance: 063b75fd-42ba-4fb6-bcd0-06b9622e32b1] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:47.589074 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8118e30d-8760-4ba7-9058-69ef7e883a49 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:47.590501 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8118e30d-8760-4ba7-9058-69ef7e883a49 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:47.591342 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8118e30d-8760-4ba7-9058-69ef7e883a49 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:47.591951 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8118e30d-8760-4ba7-9058-69ef7e883a49 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:47.627052 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-65982a11-c318-4686-ae84-72ab99fd434c tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:47.627671 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-65982a11-c318-4686-ae84-72ab99fd434c tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: e9a7d9eb-cfeb-4392-9b44-3dc592d9ebd8] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:47.647281 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-65982a11-c318-4686-ae84-72ab99fd434c tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:47.648109 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-65982a11-c318-4686-ae84-72ab99fd434c tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:47.656032 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-65982a11-c318-4686-ae84-72ab99fd434c tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:47.656779 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-65982a11-c318-4686-ae84-72ab99fd434c tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:47.707906 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8118e30d-8760-4ba7-9058-69ef7e883a49 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:47.708386 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8118e30d-8760-4ba7-9058-69ef7e883a49 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:47.746684 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8118e30d-8760-4ba7-9058-69ef7e883a49 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:47.747236 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8118e30d-8760-4ba7-9058-69ef7e883a49 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:47.786697 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.objects.instance [None req-8118e30d-8760-4ba7-9058-69ef7e883a49 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lazy-loading 'flavor' on Instance uuid 063b75fd-42ba-4fb6-bcd0-06b9622e32b1 {{(pid=131321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:29:47.809904 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-8118e30d-8760-4ba7-9058-69ef7e883a49 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] 10.222.0.17 "PUT /compute/v2.1/servers/063b75fd-42ba-4fb6-bcd0-06b9622e32b1/tags/tempest-tag-485938540" status: 201 len: 0 microversion: 2.26 time: 0.313460 Jul 23 21:29:47.811433 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2014/3952] 10.222.0.17 () {62 vars in 1376 bytes} [Sat Jul 23 21:29:47 2022] PUT /compute/v2.1/servers/063b75fd-42ba-4fb6-bcd0-06b9622e32b1/tags/tempest-tag-485938540 => generated 0 bytes in 316 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Jul 23 21:29:47.830666 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c68aef91-86e2-487f-a1c0-a1199af768f0 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Calling method '.version_select at 0x7f0b47e7ed30>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:47.844709 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c68aef91-86e2-487f-a1c0-a1199af768f0 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:47.845260 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c68aef91-86e2-487f-a1c0-a1199af768f0 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:47.859038 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-c68aef91-86e2-487f-a1c0-a1199af768f0 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] 10.222.0.17 "GET /compute/v2.1/servers/063b75fd-42ba-4fb6-bcd0-06b9622e32b1/tags/tempest-tag-485938540" status: 204 len: 0 microversion: 2.26 time: 0.038285 Jul 23 21:29:47.863794 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2015/3953] 10.222.0.17 () {60 vars in 1357 bytes} [Sat Jul 23 21:29:47 2022] GET /compute/v2.1/servers/063b75fd-42ba-4fb6-bcd0-06b9622e32b1/tags/tempest-tag-485938540 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 23 21:29:47.869351 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-5bdfe0a2-446a-47ba-9e03-e878a163d443 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Calling method '.version_select at 0x7f0b47319ee0>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:47.877915 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5bdfe0a2-446a-47ba-9e03-e878a163d443 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:47.878449 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5bdfe0a2-446a-47ba-9e03-e878a163d443 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:47.879002 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-5bdfe0a2-446a-47ba-9e03-e878a163d443 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] [instance: 063b75fd-42ba-4fb6-bcd0-06b9622e32b1] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:47.888461 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5bdfe0a2-446a-47ba-9e03-e878a163d443 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:47.888461 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5bdfe0a2-446a-47ba-9e03-e878a163d443 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:47.888461 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5bdfe0a2-446a-47ba-9e03-e878a163d443 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:47.888461 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5bdfe0a2-446a-47ba-9e03-e878a163d443 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:47.892710 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:47.917985 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5bdfe0a2-446a-47ba-9e03-e878a163d443 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:47.918546 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5bdfe0a2-446a-47ba-9e03-e878a163d443 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:47.952326 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.objects.instance [None req-5bdfe0a2-446a-47ba-9e03-e878a163d443 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lazy-loading 'flavor' on Instance uuid 063b75fd-42ba-4fb6-bcd0-06b9622e32b1 {{(pid=131321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:29:47.986717 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-5bdfe0a2-446a-47ba-9e03-e878a163d443 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] 10.222.0.17 "DELETE /compute/v2.1/servers/063b75fd-42ba-4fb6-bcd0-06b9622e32b1/tags" status: 204 len: 0 microversion: 2.26 time: 0.121492 Jul 23 21:29:47.992942 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2016/3954] 10.222.0.17 () {60 vars in 1294 bytes} [Sat Jul 23 21:29:47 2022] DELETE /compute/v2.1/servers/063b75fd-42ba-4fb6-bcd0-06b9622e32b1/tags => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 23 21:29:48.001137 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-84c4922c-dde5-4bb6-87d2-4315b9849249 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Calling method '.version_select at 0x7f0b47e7e790>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:48.011781 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-84c4922c-dde5-4bb6-87d2-4315b9849249 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:48.012219 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-84c4922c-dde5-4bb6-87d2-4315b9849249 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:48.025461 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-84c4922c-dde5-4bb6-87d2-4315b9849249 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] 10.222.0.17 "GET /compute/v2.1/servers/063b75fd-42ba-4fb6-bcd0-06b9622e32b1/tags" status: 200 len: 12 microversion: 2.26 time: 0.030323 Jul 23 21:29:48.030786 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2017/3955] 10.222.0.17 () {60 vars in 1291 bytes} [Sat Jul 23 21:29:47 2022] GET /compute/v2.1/servers/063b75fd-42ba-4fb6-bcd0-06b9622e32b1/tags => generated 12 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:29:48.036524 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-2bb778c5-0c52-4d77-8b04-280361fdb1ba req-29c15d8b-5543-4a12-8468-d9b9f77e5df5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9a7d9eb-cfeb-4392-9b44-3dc592d9ebd8", "name": "network-vif-deleted", "tag": "9df3f98c-2899-484e-873c-811935e4c5e1"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:29:48.052750 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-2bb778c5-0c52-4d77-8b04-280361fdb1ba req-29c15d8b-5543-4a12-8468-d9b9f77e5df5 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:48.053259 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-2bb778c5-0c52-4d77-8b04-280361fdb1ba req-29c15d8b-5543-4a12-8468-d9b9f77e5df5 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:48.069732 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-2bb778c5-0c52-4d77-8b04-280361fdb1ba req-29c15d8b-5543-4a12-8468-d9b9f77e5df5 service nova] Creating event network-vif-deleted:9df3f98c-2899-484e-873c-811935e4c5e1 for instance e9a7d9eb-cfeb-4392-9b44-3dc592d9ebd8 on nch2-master-1 Jul 23 21:29:48.077797 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-2bb778c5-0c52-4d77-8b04-280361fdb1ba req-29c15d8b-5543-4a12-8468-d9b9f77e5df5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045331 Jul 23 21:29:48.078947 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2018/3956] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:29:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:29:48.086353 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-144b2b28-2900-467d-a8a9-72c3f18aa597 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Calling method '.version_select at 0x7f0b473ad430>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:48.098057 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-144b2b28-2900-467d-a8a9-72c3f18aa597 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:48.098782 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-144b2b28-2900-467d-a8a9-72c3f18aa597 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:48.100749 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-144b2b28-2900-467d-a8a9-72c3f18aa597 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] [instance: 063b75fd-42ba-4fb6-bcd0-06b9622e32b1] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:48.105517 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-65982a11-c318-4686-ae84-72ab99fd434c tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:48.108960 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-144b2b28-2900-467d-a8a9-72c3f18aa597 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:48.109995 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-144b2b28-2900-467d-a8a9-72c3f18aa597 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:48.110930 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-144b2b28-2900-467d-a8a9-72c3f18aa597 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:48.111349 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-144b2b28-2900-467d-a8a9-72c3f18aa597 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:48.122441 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-65982a11-c318-4686-ae84-72ab99fd434c tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/e9a7d9eb-cfeb-4392-9b44-3dc592d9ebd8" status: 200 len: 1306 microversion: 2.1 time: 0.500329 Jul 23 21:29:48.125545 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1939/3957] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:29:47 2022] GET /compute/v2.1/servers/e9a7d9eb-cfeb-4392-9b44-3dc592d9ebd8 => generated 1306 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:29:48.137437 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-37005572-198d-42b5-a6b1-3bdccdc5d8a6 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:48.138140 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-37005572-198d-42b5-a6b1-3bdccdc5d8a6 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] [instance: b3576570-0c74-42f9-ae44-ac9f049e980d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:48.139566 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-144b2b28-2900-467d-a8a9-72c3f18aa597 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:48.140200 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-144b2b28-2900-467d-a8a9-72c3f18aa597 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:48.153300 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-144b2b28-2900-467d-a8a9-72c3f18aa597 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:48.153502 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-37005572-198d-42b5-a6b1-3bdccdc5d8a6 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:48.154048 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-144b2b28-2900-467d-a8a9-72c3f18aa597 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:48.157351 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-37005572-198d-42b5-a6b1-3bdccdc5d8a6 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:48.158247 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-37005572-198d-42b5-a6b1-3bdccdc5d8a6 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:48.158699 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-37005572-198d-42b5-a6b1-3bdccdc5d8a6 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:48.197228 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.objects.instance [None req-144b2b28-2900-467d-a8a9-72c3f18aa597 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lazy-loading 'flavor' on Instance uuid 063b75fd-42ba-4fb6-bcd0-06b9622e32b1 {{(pid=131321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:29:48.222391 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-144b2b28-2900-467d-a8a9-72c3f18aa597 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] 10.222.0.17 "PUT /compute/v2.1/servers/063b75fd-42ba-4fb6-bcd0-06b9622e32b1/tags/tempest-tag-1938235174" status: 201 len: 0 microversion: 2.26 time: 0.140591 Jul 23 21:29:48.230019 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2019/3958] 10.222.0.17 () {62 vars in 1379 bytes} [Sat Jul 23 21:29:48 2022] PUT /compute/v2.1/servers/063b75fd-42ba-4fb6-bcd0-06b9622e32b1/tags/tempest-tag-1938235174 => generated 0 bytes in 150 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Jul 23 21:29:48.236373 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ac9f04cc-0131-4a9c-aaa0-1ff6c10036d9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:48.237304 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-ac9f04cc-0131-4a9c-aaa0-1ff6c10036d9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:48.244866 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ac9f04cc-0131-4a9c-aaa0-1ff6c10036d9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:48.245489 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ac9f04cc-0131-4a9c-aaa0-1ff6c10036d9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:48.249328 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ac9f04cc-0131-4a9c-aaa0-1ff6c10036d9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:48.249328 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ac9f04cc-0131-4a9c-aaa0-1ff6c10036d9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:48.308500 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-37005572-198d-42b5-a6b1-3bdccdc5d8a6 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadc4fac778e4eaf905a3fbc26fbb090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e751dfada40945a69472003d08f1bb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:48.318079 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-37005572-198d-42b5-a6b1-3bdccdc5d8a6 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cadc4fac778e4eaf905a3fbc26fbb090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e751dfada40945a69472003d08f1bb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:48.319479 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-37005572-198d-42b5-a6b1-3bdccdc5d8a6 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cadc4fac778e4eaf905a3fbc26fbb090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e751dfada40945a69472003d08f1bb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:48.320672 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-37005572-198d-42b5-a6b1-3bdccdc5d8a6 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] 10.222.0.17 "GET /compute/v2.1/servers/b3576570-0c74-42f9-ae44-ac9f049e980d" status: 200 len: 1408 microversion: 2.54 time: 0.194097 Jul 23 21:29:48.332373 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1940/3959] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:29:48 2022] GET /compute/v2.1/servers/b3576570-0c74-42f9-ae44-ac9f049e980d => generated 1408 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:29:48.337973 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f78e027a-5a84-4b63-8556-4804eccbce54 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Calling method '.version_select at 0x7f0b540a8040>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:48.346078 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f78e027a-5a84-4b63-8556-4804eccbce54 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:48.346419 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f78e027a-5a84-4b63-8556-4804eccbce54 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:48.363440 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f78e027a-5a84-4b63-8556-4804eccbce54 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] 10.222.0.17 "GET /compute/v2.1/servers/063b75fd-42ba-4fb6-bcd0-06b9622e32b1/tags" status: 200 len: 36 microversion: 2.26 time: 0.029524 Jul 23 21:29:48.364294 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1941/3960] 10.222.0.17 () {60 vars in 1291 bytes} [Sat Jul 23 21:29:48 2022] GET /compute/v2.1/servers/063b75fd-42ba-4fb6-bcd0-06b9622e32b1/tags => generated 36 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:29:48.374557 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-7a9fb0c1-9693-4f75-bc7e-4d508db3cf68 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Calling method '.version_select at 0x7f0b59a95820>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:48.382683 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7a9fb0c1-9693-4f75-bc7e-4d508db3cf68 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:48.383479 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7a9fb0c1-9693-4f75-bc7e-4d508db3cf68 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:48.384188 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-7a9fb0c1-9693-4f75-bc7e-4d508db3cf68 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] [instance: 063b75fd-42ba-4fb6-bcd0-06b9622e32b1] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:48.391732 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7a9fb0c1-9693-4f75-bc7e-4d508db3cf68 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:48.392515 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7a9fb0c1-9693-4f75-bc7e-4d508db3cf68 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:48.393517 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7a9fb0c1-9693-4f75-bc7e-4d508db3cf68 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:48.394192 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7a9fb0c1-9693-4f75-bc7e-4d508db3cf68 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:48.411775 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ac9f04cc-0131-4a9c-aaa0-1ff6c10036d9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:48.421529 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7a9fb0c1-9693-4f75-bc7e-4d508db3cf68 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:48.422392 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7a9fb0c1-9693-4f75-bc7e-4d508db3cf68 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:48.425732 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ac9f04cc-0131-4a9c-aaa0-1ff6c10036d9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:48.428534 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ac9f04cc-0131-4a9c-aaa0-1ff6c10036d9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:48.433334 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-ac9f04cc-0131-4a9c-aaa0-1ff6c10036d9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.198511 Jul 23 21:29:48.433966 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2020/3961] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:29:48 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:29:48.471563 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.objects.instance [None req-7a9fb0c1-9693-4f75-bc7e-4d508db3cf68 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lazy-loading 'flavor' on Instance uuid 063b75fd-42ba-4fb6-bcd0-06b9622e32b1 {{(pid=131320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:29:48.501236 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-7a9fb0c1-9693-4f75-bc7e-4d508db3cf68 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] 10.222.0.17 "DELETE /compute/v2.1/servers/063b75fd-42ba-4fb6-bcd0-06b9622e32b1/tags/tempest-tag-1938235174" status: 204 len: 0 microversion: 2.26 time: 0.130943 Jul 23 21:29:48.502561 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1942/3962] 10.222.0.17 () {60 vars in 1363 bytes} [Sat Jul 23 21:29:48 2022] DELETE /compute/v2.1/servers/063b75fd-42ba-4fb6-bcd0-06b9622e32b1/tags/tempest-tag-1938235174 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 23 21:29:48.510922 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-09803a5f-fd90-4840-b9b4-c73f4704ac33 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Calling method '.version_select at 0x7f0b4739f790>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:48.526629 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-09803a5f-fd90-4840-b9b4-c73f4704ac33 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:48.527256 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-09803a5f-fd90-4840-b9b4-c73f4704ac33 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:48.560063 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-09803a5f-fd90-4840-b9b4-c73f4704ac33 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] 10.222.0.17 "GET /compute/v2.1/servers/063b75fd-42ba-4fb6-bcd0-06b9622e32b1/tags" status: 200 len: 12 microversion: 2.26 time: 0.039146 Jul 23 21:29:48.566354 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2021/3963] 10.222.0.17 () {60 vars in 1291 bytes} [Sat Jul 23 21:29:48 2022] GET /compute/v2.1/servers/063b75fd-42ba-4fb6-bcd0-06b9622e32b1/tags => generated 12 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:29:48.573423 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0fd32c1e-c416-40b7-a8c3-9a9eaac9517e tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Calling method '.version_select at 0x7f0b560a1550>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:48.589830 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0fd32c1e-c416-40b7-a8c3-9a9eaac9517e tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:48.592429 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0fd32c1e-c416-40b7-a8c3-9a9eaac9517e tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:48.593120 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-0fd32c1e-c416-40b7-a8c3-9a9eaac9517e tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] [instance: 063b75fd-42ba-4fb6-bcd0-06b9622e32b1] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:48.610023 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0fd32c1e-c416-40b7-a8c3-9a9eaac9517e tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:48.610485 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0fd32c1e-c416-40b7-a8c3-9a9eaac9517e tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:48.616655 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0fd32c1e-c416-40b7-a8c3-9a9eaac9517e tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:48.618414 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0fd32c1e-c416-40b7-a8c3-9a9eaac9517e tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:48.668734 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0fd32c1e-c416-40b7-a8c3-9a9eaac9517e tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:48.676300 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0fd32c1e-c416-40b7-a8c3-9a9eaac9517e tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:48.703403 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.objects.instance [None req-0fd32c1e-c416-40b7-a8c3-9a9eaac9517e tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lazy-loading 'flavor' on Instance uuid 063b75fd-42ba-4fb6-bcd0-06b9622e32b1 {{(pid=131320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:29:48.739122 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-0fd32c1e-c416-40b7-a8c3-9a9eaac9517e tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] 10.222.0.17 "DELETE /compute/v2.1/servers/063b75fd-42ba-4fb6-bcd0-06b9622e32b1/tags" status: 204 len: 0 microversion: 2.26 time: 0.171131 Jul 23 21:29:48.742148 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1943/3964] 10.222.0.17 () {60 vars in 1294 bytes} [Sat Jul 23 21:29:48 2022] DELETE /compute/v2.1/servers/063b75fd-42ba-4fb6-bcd0-06b9622e32b1/tags => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 23 21:29:48.752403 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-5b557f62-7497-4721-8fa3-4d8133892b0a tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Calling method '.version_select at 0x7f0b47341040>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:48.776243 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5b557f62-7497-4721-8fa3-4d8133892b0a tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:48.776713 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5b557f62-7497-4721-8fa3-4d8133892b0a tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:48.780810 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-5b557f62-7497-4721-8fa3-4d8133892b0a tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] [instance: 063b75fd-42ba-4fb6-bcd0-06b9622e32b1] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:48.806483 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5b557f62-7497-4721-8fa3-4d8133892b0a tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:48.806954 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5b557f62-7497-4721-8fa3-4d8133892b0a tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:48.813930 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5b557f62-7497-4721-8fa3-4d8133892b0a tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:48.813930 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5b557f62-7497-4721-8fa3-4d8133892b0a tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:48.881886 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5b557f62-7497-4721-8fa3-4d8133892b0a tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:48.882340 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5b557f62-7497-4721-8fa3-4d8133892b0a tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:48.908114 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5b557f62-7497-4721-8fa3-4d8133892b0a tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:48.908802 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5b557f62-7497-4721-8fa3-4d8133892b0a tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:48.964123 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.objects.instance [None req-5b557f62-7497-4721-8fa3-4d8133892b0a tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lazy-loading 'flavor' on Instance uuid 063b75fd-42ba-4fb6-bcd0-06b9622e32b1 {{(pid=131321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:29:48.997168 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-5b557f62-7497-4721-8fa3-4d8133892b0a tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] 10.222.0.17 "PUT /compute/v2.1/servers/063b75fd-42ba-4fb6-bcd0-06b9622e32b1/tags/tempest-tag-1228851105" status: 201 len: 0 microversion: 2.26 time: 0.247742 Jul 23 21:29:48.998335 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2022/3965] 10.222.0.17 () {62 vars in 1379 bytes} [Sat Jul 23 21:29:48 2022] PUT /compute/v2.1/servers/063b75fd-42ba-4fb6-bcd0-06b9622e32b1/tags/tempest-tag-1228851105 => generated 0 bytes in 251 msecs (HTTP/1.1 201) 10 headers in 486 bytes (2 switches on core 0) Jul 23 21:29:49.008403 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4500cf14-e11f-4c89-aa4c-19fa2d7fadc3 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Calling method '.version_select at 0x7f0b47bace50>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:49.018194 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4500cf14-e11f-4c89-aa4c-19fa2d7fadc3 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:49.018880 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4500cf14-e11f-4c89-aa4c-19fa2d7fadc3 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:49.019568 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-4500cf14-e11f-4c89-aa4c-19fa2d7fadc3 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] [instance: 063b75fd-42ba-4fb6-bcd0-06b9622e32b1] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:49.029970 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4500cf14-e11f-4c89-aa4c-19fa2d7fadc3 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:49.030770 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4500cf14-e11f-4c89-aa4c-19fa2d7fadc3 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:49.031953 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4500cf14-e11f-4c89-aa4c-19fa2d7fadc3 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:49.032865 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4500cf14-e11f-4c89-aa4c-19fa2d7fadc3 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:49.079077 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1,nova_cell1:DELETE=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:49.086892 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4500cf14-e11f-4c89-aa4c-19fa2d7fadc3 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:49.087720 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4500cf14-e11f-4c89-aa4c-19fa2d7fadc3 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:49.107830 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4500cf14-e11f-4c89-aa4c-19fa2d7fadc3 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:49.108405 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4500cf14-e11f-4c89-aa4c-19fa2d7fadc3 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:49.139677 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-8ea81070-24b7-4891-be38-03201c843fc5 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:49.140297 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-8ea81070-24b7-4891-be38-03201c843fc5 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: e9a7d9eb-cfeb-4392-9b44-3dc592d9ebd8] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:49.164074 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8ea81070-24b7-4891-be38-03201c843fc5 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:49.164553 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8ea81070-24b7-4891-be38-03201c843fc5 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:49.165365 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8ea81070-24b7-4891-be38-03201c843fc5 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:49.173751 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8ea81070-24b7-4891-be38-03201c843fc5 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:49.215299 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-8ea81070-24b7-4891-be38-03201c843fc5 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] HTTP exception thrown: Instance e9a7d9eb-cfeb-4392-9b44-3dc592d9ebd8 could not be found. Jul 23 21:29:49.215493 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.objects.instance [None req-4500cf14-e11f-4c89-aa4c-19fa2d7fadc3 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lazy-loading 'flavor' on Instance uuid 063b75fd-42ba-4fb6-bcd0-06b9622e32b1 {{(pid=131320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:29:49.217037 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-8ea81070-24b7-4891-be38-03201c843fc5 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Request method failure captured: Jul 23 21:29:49.217037 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/servers/e9a7d9eb-cfeb-4392-9b44-3dc592d9ebd8 HTTP/1.1 Jul 23 21:29:49.217037 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:29:49.217037 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:29:49.217037 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:29:49.217037 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:29:49.217037 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:29:49.217037 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:29:49.217037 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:29:49.217037 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:29:49.217037 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GgexSaJTA-FXaV5LcqTAteOVESwOg7zac7nwUa59CGOHDwwWd7w7HKC8R65F9X48OwLZ_a8UsJYui6X5BG5uL_WJC-ysEg9nxrojp43TnKgPHTkujcdOw9VWLxqM9CE8dPwhawUMo8jE8x_rLu-o0j9Xf_QveShH-OlX4BIDLcYoyo Jul 23 21:29:49.217037 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:29:49.217037 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:29:49.217037 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:29:49.217037 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:29:49.217037 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:29:49.217037 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:29:49.217037 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 1890022bd460485dae0ea94b152a6746 Jul 23 21:29:49.217037 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ServersTestJSON-1141465764 Jul 23 21:29:49.217037 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:29:49.217037 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:29:49.217037 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1890022bd460485dae0ea94b152a6746"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1890022bd460485dae0ea94b152a6746"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1890022bd460485dae0ea94b152a6746", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1890022bd460485dae0ea94b152a6746"}]}] Jul 23 21:29:49.217037 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ServersTestJSON-1141465764 Jul 23 21:29:49.217037 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 1890022bd460485dae0ea94b152a6746 Jul 23 21:29:49.217037 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ServersTestJSON-1141465764 Jul 23 21:29:49.217037 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ServersTestJSON-1141465764-project Jul 23 21:29:49.217037 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:29:49.217037 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:29:49.217037 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 5efda1c40f494592bf1e6af1add120f3 Jul 23 21:29:49.217037 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ServersTestJSON-1141465764-project Jul 23 21:29:49.217037 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:29:49.217037 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance e9a7d9eb-cfeb-4392-9b44-3dc592d9ebd8 could not be found. Jul 23 21:29:49.217037 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': 'e9a7d9eb-cfeb-4392-9b44-3dc592d9ebd8'} Jul 23 21:29:49.217037 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:29:49.217037 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:29:49.217037 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:29:49.217037 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:29:49.217037 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:29:49.217037 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:29:49.217037 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:29:49.217037 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:29:49.217037 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:29:49.217037 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:29:49.217037 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9a7d9eb-cfeb-4392-9b44-3dc592d9ebd8 could not be found. Jul 23 21:29:49.217037 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:29:49.217037 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:29:49.217037 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:29:49.217037 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:29:49.217037 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:29:49.217037 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:29:49.217037 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:29:49.217037 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:29:49.217037 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:29:49.217037 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:29:49.217037 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:29:49.217037 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:29:49.217037 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:29:49.217037 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:29:49.217037 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:29:49.217037 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:29:49.217037 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9a7d9eb-cfeb-4392-9b44-3dc592d9ebd8 could not be found. Jul 23 21:29:49.217037 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:29:49.217037 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:29:49.217037 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:29:49.217037 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:29:49.221284 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:29:49.221284 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:29:49.221284 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:29:49.221284 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:29:49.221284 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9a7d9eb-cfeb-4392-9b44-3dc592d9ebd8 could not be found. Jul 23 21:29:49.221284 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:29:49.221284 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-8ea81070-24b7-4891-be38-03201c843fc5 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Returning 404 to user: Instance e9a7d9eb-cfeb-4392-9b44-3dc592d9ebd8 could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:29:49.221284 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-8ea81070-24b7-4891-be38-03201c843fc5 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/e9a7d9eb-cfeb-4392-9b44-3dc592d9ebd8" status: 404 len: 111 microversion: 2.1 time: 0.083273 Jul 23 21:29:49.237127 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2023/3966] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:29:49 2022] GET /compute/v2.1/servers/e9a7d9eb-cfeb-4392-9b44-3dc592d9ebd8 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 23 21:29:49.242138 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-1c66afe9-c9dd-4429-943a-1303212467da tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Action: 'create', calling method: .version_select at 0x7f0b4739fee0>, body: {"keypair": {"name": "tempest-key-581193143", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIAuSfxlNi/oWbJ4GC9CDEbdy/MzSPSXA09OxqDZjgaEuQjRxPe2FzdcUHsdFd3VWhnJ49kP7ZpLlBxYKPyG0ah1CH3qV7lP8YsPWBTctmCD0lNyH7YQ4e8S+EmkRSvMUg=="}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:29:49.247000 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4500cf14-e11f-4c89-aa4c-19fa2d7fadc3 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] 10.222.0.17 "PUT /compute/v2.1/servers/063b75fd-42ba-4fb6-bcd0-06b9622e32b1/tags/tempest-tag-1229763602" status: 201 len: 0 microversion: 2.26 time: 0.242759 Jul 23 21:29:49.249091 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1944/3967] 10.222.0.17 () {62 vars in 1379 bytes} [Sat Jul 23 21:29:49 2022] PUT /compute/v2.1/servers/063b75fd-42ba-4fb6-bcd0-06b9622e32b1/tags/tempest-tag-1229763602 => generated 0 bytes in 246 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Jul 23 21:29:49.260066 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0c194227-dc82-459d-bf08-54a2271814ee tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Calling method '.version_select at 0x7f0b598ad160>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:49.268198 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:49.281215 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0c194227-dc82-459d-bf08-54a2271814ee tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:49.281689 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0c194227-dc82-459d-bf08-54a2271814ee tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:49.282642 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-0c194227-dc82-459d-bf08-54a2271814ee tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] [instance: 063b75fd-42ba-4fb6-bcd0-06b9622e32b1] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:49.287894 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-1c66afe9-c9dd-4429-943a-1303212467da tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Getting quotas for project 1890022bd460485dae0ea94b152a6746. Resources: {'key_pairs'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:29:49.297369 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-1c66afe9-c9dd-4429-943a-1303212467da tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Getting quotas for user 5efda1c40f494592bf1e6af1add120f3 and project 1890022bd460485dae0ea94b152a6746. Resources: {'key_pairs'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:29:49.299210 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0c194227-dc82-459d-bf08-54a2271814ee tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:49.300958 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0c194227-dc82-459d-bf08-54a2271814ee tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:49.303116 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0c194227-dc82-459d-bf08-54a2271814ee tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:49.305534 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0c194227-dc82-459d-bf08-54a2271814ee tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:49.341951 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-1c66afe9-c9dd-4429-943a-1303212467da tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 381 microversion: 2.1 time: 0.101463 Jul 23 21:29:49.345942 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2024/3968] 10.222.0.17 () {60 vars in 1158 bytes} [Sat Jul 23 21:29:49 2022] POST /compute/v2.1/os-keypairs => generated 381 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:29:49.358814 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-322eb306-9da3-4a57-ae14-119a579aa39e tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:49.361429 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0c194227-dc82-459d-bf08-54a2271814ee tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:49.366773 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-322eb306-9da3-4a57-ae14-119a579aa39e tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] [instance: b3576570-0c74-42f9-ae44-ac9f049e980d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:49.370533 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0c194227-dc82-459d-bf08-54a2271814ee tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:49.388197 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-322eb306-9da3-4a57-ae14-119a579aa39e tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:49.388650 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-322eb306-9da3-4a57-ae14-119a579aa39e tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:49.389427 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-322eb306-9da3-4a57-ae14-119a579aa39e tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:49.389892 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-322eb306-9da3-4a57-ae14-119a579aa39e tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:49.411003 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.objects.instance [None req-0c194227-dc82-459d-bf08-54a2271814ee tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lazy-loading 'flavor' on Instance uuid 063b75fd-42ba-4fb6-bcd0-06b9622e32b1 {{(pid=131320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:29:49.440005 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-0c194227-dc82-459d-bf08-54a2271814ee tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] 10.222.0.17 "DELETE /compute/v2.1/servers/063b75fd-42ba-4fb6-bcd0-06b9622e32b1/tags" status: 204 len: 0 microversion: 2.26 time: 0.183688 Jul 23 21:29:49.440961 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1945/3969] 10.222.0.17 () {60 vars in 1294 bytes} [Sat Jul 23 21:29:49 2022] DELETE /compute/v2.1/servers/063b75fd-42ba-4fb6-bcd0-06b9622e32b1/tags => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 23 21:29:49.459343 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3de07d70-190d-4957-9dc6-abfdf841e8c1 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '.version_select at 0x7f0b5998d310>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:49.462453 ncdv-master-1 devstack@n-api.service[131320]: WARNING oslo_db.sqlalchemy.utils [None req-3de07d70-190d-4957-9dc6-abfdf841e8c1 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 23 21:29:49.479831 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-3de07d70-190d-4957-9dc6-abfdf841e8c1 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/os-keypairs" status: 200 len: 350 microversion: 2.1 time: 0.033640 Jul 23 21:29:49.480414 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1946/3970] 10.222.0.17 () {58 vars in 1136 bytes} [Sat Jul 23 21:29:49 2022] GET /compute/v2.1/os-keypairs => generated 350 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:29:49.508169 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e7c55633-5fc5-4188-bfc2-a893f0f7890c tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Calling method '.version_select at 0x7f0b540e0820>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:49.533154 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e7c55633-5fc5-4188-bfc2-a893f0f7890c tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:49.533934 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e7c55633-5fc5-4188-bfc2-a893f0f7890c tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:49.555772 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e7c55633-5fc5-4188-bfc2-a893f0f7890c tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] 10.222.0.17 "GET /compute/v2.1/servers/063b75fd-42ba-4fb6-bcd0-06b9622e32b1/tags" status: 200 len: 12 microversion: 2.26 time: 0.066338 Jul 23 21:29:49.573163 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1947/3971] 10.222.0.17 () {60 vars in 1291 bytes} [Sat Jul 23 21:29:49 2022] GET /compute/v2.1/servers/063b75fd-42ba-4fb6-bcd0-06b9622e32b1/tags => generated 12 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:29:49.580854 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2e7ad745-e4dc-417b-a378-46f801de96ff tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:49.584189 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-2e7ad745-e4dc-417b-a378-46f801de96ff tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:49.599545 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2e7ad745-e4dc-417b-a378-46f801de96ff tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:49.602247 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2e7ad745-e4dc-417b-a378-46f801de96ff tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:49.603225 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2e7ad745-e4dc-417b-a378-46f801de96ff tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:49.605255 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2e7ad745-e4dc-417b-a378-46f801de96ff tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:49.665209 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-322eb306-9da3-4a57-ae14-119a579aa39e tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadc4fac778e4eaf905a3fbc26fbb090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e751dfada40945a69472003d08f1bb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:49.693558 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-322eb306-9da3-4a57-ae14-119a579aa39e tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cadc4fac778e4eaf905a3fbc26fbb090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e751dfada40945a69472003d08f1bb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:49.695501 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-322eb306-9da3-4a57-ae14-119a579aa39e tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cadc4fac778e4eaf905a3fbc26fbb090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e751dfada40945a69472003d08f1bb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:49.700724 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-322eb306-9da3-4a57-ae14-119a579aa39e tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] 10.222.0.17 "GET /compute/v2.1/servers/b3576570-0c74-42f9-ae44-ac9f049e980d" status: 200 len: 1408 microversion: 2.54 time: 0.355356 Jul 23 21:29:49.701321 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2025/3972] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:29:49 2022] GET /compute/v2.1/servers/b3576570-0c74-42f9-ae44-ac9f049e980d => generated 1408 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:29:49.731654 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-6834677f-b813-477f-83af-5fc5d42fa07e tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Calling method '.version_select at 0x7f0b599b51f0>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:49.767451 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6834677f-b813-477f-83af-5fc5d42fa07e tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:49.767661 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6834677f-b813-477f-83af-5fc5d42fa07e tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:49.772504 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-6834677f-b813-477f-83af-5fc5d42fa07e tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] [instance: 063b75fd-42ba-4fb6-bcd0-06b9622e32b1] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:49.785615 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6834677f-b813-477f-83af-5fc5d42fa07e tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:49.785983 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6834677f-b813-477f-83af-5fc5d42fa07e tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:49.786867 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6834677f-b813-477f-83af-5fc5d42fa07e tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:49.787393 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6834677f-b813-477f-83af-5fc5d42fa07e tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:49.808632 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-2e7ad745-e4dc-417b-a378-46f801de96ff tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:49.835776 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-2e7ad745-e4dc-417b-a378-46f801de96ff tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:49.837388 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-2e7ad745-e4dc-417b-a378-46f801de96ff tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:49.844834 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2e7ad745-e4dc-417b-a378-46f801de96ff tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.270262 Jul 23 21:29:49.845445 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1948/3973] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:29:49 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:29:49.860918 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-fc406ea1-c9d4-4c38-831f-2d531b9b5434 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1591604975", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "key_name": "tempest-key-581193143", "networks": [{"uuid": "63d253f9-5d83-4f00-8bc3-28f418cf7611"}]}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:29:49.875577 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6834677f-b813-477f-83af-5fc5d42fa07e tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:49.876071 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6834677f-b813-477f-83af-5fc5d42fa07e tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:49.891232 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.objects.instance [None req-6834677f-b813-477f-83af-5fc5d42fa07e tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lazy-loading 'flavor' on Instance uuid 063b75fd-42ba-4fb6-bcd0-06b9622e32b1 {{(pid=131321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:29:49.935709 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-6834677f-b813-477f-83af-5fc5d42fa07e tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] 10.222.0.17 "DELETE /compute/v2.1/servers/063b75fd-42ba-4fb6-bcd0-06b9622e32b1/tags" status: 204 len: 0 microversion: 2.26 time: 0.216761 Jul 23 21:29:49.937148 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2026/3974] 10.222.0.17 () {60 vars in 1294 bytes} [Sat Jul 23 21:29:49 2022] DELETE /compute/v2.1/servers/063b75fd-42ba-4fb6-bcd0-06b9622e32b1/tags => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 23 21:29:49.960905 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-fc406ea1-c9d4-4c38-831f-2d531b9b5434 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] validate_networks() for [('63d253f9-5d83-4f00-8bc3-28f418cf7611', None, None, None, None, None)] {{(pid=131320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:29:49.962455 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e4ed241d-8e34-4213-b7af-7d430e6687eb tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Calling method '.version_select at 0x7f0b59aa9820>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:49.983065 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e4ed241d-8e34-4213-b7af-7d430e6687eb tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:49.983426 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e4ed241d-8e34-4213-b7af-7d430e6687eb tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:49.983921 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-e4ed241d-8e34-4213-b7af-7d430e6687eb tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] [instance: 063b75fd-42ba-4fb6-bcd0-06b9622e32b1] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:49.995673 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e4ed241d-8e34-4213-b7af-7d430e6687eb tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:49.996132 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e4ed241d-8e34-4213-b7af-7d430e6687eb tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:49.996915 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e4ed241d-8e34-4213-b7af-7d430e6687eb tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:49.999570 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e4ed241d-8e34-4213-b7af-7d430e6687eb tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:50.054925 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e4ed241d-8e34-4213-b7af-7d430e6687eb tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:50.060183 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e4ed241d-8e34-4213-b7af-7d430e6687eb tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:50.085975 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e4ed241d-8e34-4213-b7af-7d430e6687eb tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:50.086812 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e4ed241d-8e34-4213-b7af-7d430e6687eb tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:50.148905 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.objects.instance [None req-e4ed241d-8e34-4213-b7af-7d430e6687eb tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lazy-loading 'flavor' on Instance uuid 063b75fd-42ba-4fb6-bcd0-06b9622e32b1 {{(pid=131321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:29:50.182298 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-e4ed241d-8e34-4213-b7af-7d430e6687eb tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] 10.222.0.17 "PUT /compute/v2.1/servers/063b75fd-42ba-4fb6-bcd0-06b9622e32b1/tags/tempest-tag-464714799" status: 201 len: 0 microversion: 2.26 time: 0.238566 Jul 23 21:29:50.185424 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2027/3975] 10.222.0.17 () {62 vars in 1376 bytes} [Sat Jul 23 21:29:49 2022] PUT /compute/v2.1/servers/063b75fd-42ba-4fb6-bcd0-06b9622e32b1/tags/tempest-tag-464714799 => generated 0 bytes in 242 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Jul 23 21:29:50.192387 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-7755c0d5-ebe3-48d9-8bc0-02f6277d2907 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Calling method '.version_select at 0x7f0b47cc44c0>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:50.210331 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7755c0d5-ebe3-48d9-8bc0-02f6277d2907 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:50.212003 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7755c0d5-ebe3-48d9-8bc0-02f6277d2907 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:50.213455 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-7755c0d5-ebe3-48d9-8bc0-02f6277d2907 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] [instance: 063b75fd-42ba-4fb6-bcd0-06b9622e32b1] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:50.227497 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7755c0d5-ebe3-48d9-8bc0-02f6277d2907 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:50.227958 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7755c0d5-ebe3-48d9-8bc0-02f6277d2907 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:50.233370 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7755c0d5-ebe3-48d9-8bc0-02f6277d2907 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:50.233845 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7755c0d5-ebe3-48d9-8bc0-02f6277d2907 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:50.287158 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7755c0d5-ebe3-48d9-8bc0-02f6277d2907 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:50.287694 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7755c0d5-ebe3-48d9-8bc0-02f6277d2907 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:50.313239 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7755c0d5-ebe3-48d9-8bc0-02f6277d2907 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:50.313703 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7755c0d5-ebe3-48d9-8bc0-02f6277d2907 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:50.345457 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=87,nova_cell1:DELETE=2,nova_cell1:SAVEPOINT=4,nova_cell1:INSERT=4,nova_cell1:RELEASE=3 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:50.388196 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.objects.instance [None req-7755c0d5-ebe3-48d9-8bc0-02f6277d2907 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lazy-loading 'flavor' on Instance uuid 063b75fd-42ba-4fb6-bcd0-06b9622e32b1 {{(pid=131321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:29:50.435107 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-7755c0d5-ebe3-48d9-8bc0-02f6277d2907 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] 10.222.0.17 "PUT /compute/v2.1/servers/063b75fd-42ba-4fb6-bcd0-06b9622e32b1/tags/tempest-tag-994403446" status: 201 len: 0 microversion: 2.26 time: 0.246154 Jul 23 21:29:50.436013 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2028/3976] 10.222.0.17 () {62 vars in 1376 bytes} [Sat Jul 23 21:29:50 2022] PUT /compute/v2.1/servers/063b75fd-42ba-4fb6-bcd0-06b9622e32b1/tags/tempest-tag-994403446 => generated 0 bytes in 248 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Jul 23 21:29:50.454576 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-119d64e9-f465-4f49-a48d-a86ca11b1a75 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Action: 'update_all', calling method: .version_select at 0x7f0b47cc4940>, body: {"tags": ["tempest-tag-1081770569", "tempest-tag-911202668"]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:29:50.474170 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-119d64e9-f465-4f49-a48d-a86ca11b1a75 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:50.476523 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-119d64e9-f465-4f49-a48d-a86ca11b1a75 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:50.477058 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-119d64e9-f465-4f49-a48d-a86ca11b1a75 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] [instance: 063b75fd-42ba-4fb6-bcd0-06b9622e32b1] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:50.496219 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-119d64e9-f465-4f49-a48d-a86ca11b1a75 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:50.496649 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-119d64e9-f465-4f49-a48d-a86ca11b1a75 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:50.501325 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-119d64e9-f465-4f49-a48d-a86ca11b1a75 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:50.501649 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-119d64e9-f465-4f49-a48d-a86ca11b1a75 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:50.570112 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-119d64e9-f465-4f49-a48d-a86ca11b1a75 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:50.570735 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-119d64e9-f465-4f49-a48d-a86ca11b1a75 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:50.612762 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.objects.instance [None req-119d64e9-f465-4f49-a48d-a86ca11b1a75 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lazy-loading 'flavor' on Instance uuid 063b75fd-42ba-4fb6-bcd0-06b9622e32b1 {{(pid=131321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:29:50.641707 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-119d64e9-f465-4f49-a48d-a86ca11b1a75 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] 10.222.0.17 "PUT /compute/v2.1/servers/063b75fd-42ba-4fb6-bcd0-06b9622e32b1/tags" status: 200 len: 61 microversion: 2.26 time: 0.200330 Jul 23 21:29:50.644367 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2029/3977] 10.222.0.17 () {62 vars in 1311 bytes} [Sat Jul 23 21:29:50 2022] PUT /compute/v2.1/servers/063b75fd-42ba-4fb6-bcd0-06b9622e32b1/tags => generated 61 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:29:50.665562 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-cff4bb3a-763c-4b1e-9c21-2361eae1d7d9 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Calling method '.version_select at 0x7f0b59ac2940>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:50.684433 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cff4bb3a-763c-4b1e-9c21-2361eae1d7d9 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:50.687904 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cff4bb3a-763c-4b1e-9c21-2361eae1d7d9 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:50.716370 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-cff4bb3a-763c-4b1e-9c21-2361eae1d7d9 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] 10.222.0.17 "GET /compute/v2.1/servers/063b75fd-42ba-4fb6-bcd0-06b9622e32b1/tags" status: 200 len: 61 microversion: 2.26 time: 0.065872 Jul 23 21:29:50.718617 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2030/3978] 10.222.0.17 () {60 vars in 1291 bytes} [Sat Jul 23 21:29:50 2022] GET /compute/v2.1/servers/063b75fd-42ba-4fb6-bcd0-06b9622e32b1/tags => generated 61 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:29:50.730971 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-5020a562-30e3-4c87-9cd8-a2f3b46e425a tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:50.733115 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-5020a562-30e3-4c87-9cd8-a2f3b46e425a tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] [instance: b3576570-0c74-42f9-ae44-ac9f049e980d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:50.752699 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5020a562-30e3-4c87-9cd8-a2f3b46e425a tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:50.753516 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5020a562-30e3-4c87-9cd8-a2f3b46e425a tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:50.754904 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5020a562-30e3-4c87-9cd8-a2f3b46e425a tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:50.755533 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5020a562-30e3-4c87-9cd8-a2f3b46e425a tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:50.844162 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=8 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:50.857299 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-5020a562-30e3-4c87-9cd8-a2f3b46e425a tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadc4fac778e4eaf905a3fbc26fbb090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e751dfada40945a69472003d08f1bb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:50.871428 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-5020a562-30e3-4c87-9cd8-a2f3b46e425a tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cadc4fac778e4eaf905a3fbc26fbb090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e751dfada40945a69472003d08f1bb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:50.872955 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-5020a562-30e3-4c87-9cd8-a2f3b46e425a tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cadc4fac778e4eaf905a3fbc26fbb090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e751dfada40945a69472003d08f1bb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:50.873759 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=26 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:50.878632 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-5020a562-30e3-4c87-9cd8-a2f3b46e425a tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] 10.222.0.17 "GET /compute/v2.1/servers/b3576570-0c74-42f9-ae44-ac9f049e980d" status: 200 len: 1408 microversion: 2.54 time: 0.158385 Jul 23 21:29:50.882121 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2031/3979] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:29:50 2022] GET /compute/v2.1/servers/b3576570-0c74-42f9-ae44-ac9f049e980d => generated 1408 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:29:50.893678 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-5e7c8e6d-2642-4ecc-a55b-f3107bfcc378 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Calling method '.version_select at 0x7f0b472b41f0>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:50.905818 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5e7c8e6d-2642-4ecc-a55b-f3107bfcc378 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:50.906375 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5e7c8e6d-2642-4ecc-a55b-f3107bfcc378 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:50.906859 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-5e7c8e6d-2642-4ecc-a55b-f3107bfcc378 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] [instance: 063b75fd-42ba-4fb6-bcd0-06b9622e32b1] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:50.924290 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5e7c8e6d-2642-4ecc-a55b-f3107bfcc378 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:50.924744 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5e7c8e6d-2642-4ecc-a55b-f3107bfcc378 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:50.925528 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5e7c8e6d-2642-4ecc-a55b-f3107bfcc378 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:50.925992 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5e7c8e6d-2642-4ecc-a55b-f3107bfcc378 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:50.966103 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5e7c8e6d-2642-4ecc-a55b-f3107bfcc378 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:50.966674 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5e7c8e6d-2642-4ecc-a55b-f3107bfcc378 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:51.005323 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.objects.instance [None req-5e7c8e6d-2642-4ecc-a55b-f3107bfcc378 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lazy-loading 'flavor' on Instance uuid 063b75fd-42ba-4fb6-bcd0-06b9622e32b1 {{(pid=131321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:29:51.057278 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-5e7c8e6d-2642-4ecc-a55b-f3107bfcc378 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] 10.222.0.17 "DELETE /compute/v2.1/servers/063b75fd-42ba-4fb6-bcd0-06b9622e32b1/tags" status: 204 len: 0 microversion: 2.26 time: 0.171702 Jul 23 21:29:51.059218 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2032/3980] 10.222.0.17 () {60 vars in 1294 bytes} [Sat Jul 23 21:29:50 2022] DELETE /compute/v2.1/servers/063b75fd-42ba-4fb6-bcd0-06b9622e32b1/tags => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 23 21:29:51.076465 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-60a2d869-bece-49b6-ad62-d312676de1a5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:51.079705 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-60a2d869-bece-49b6-ad62-d312676de1a5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:51.097703 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-60a2d869-bece-49b6-ad62-d312676de1a5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:51.098411 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-60a2d869-bece-49b6-ad62-d312676de1a5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:51.099487 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-60a2d869-bece-49b6-ad62-d312676de1a5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:51.100114 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-60a2d869-bece-49b6-ad62-d312676de1a5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:51.237339 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-fc406ea1-c9d4-4c38-831f-2d531b9b5434 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:29:51.238311 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-fc406ea1-c9d4-4c38-831f-2d531b9b5434 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:29:51.242382 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-fc406ea1-c9d4-4c38-831f-2d531b9b5434 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:29:51.243526 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-fc406ea1-c9d4-4c38-831f-2d531b9b5434 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:29:51.247294 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-fc406ea1-c9d4-4c38-831f-2d531b9b5434 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:29:51.280365 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fc406ea1-c9d4-4c38-831f-2d531b9b5434 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:51.280843 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fc406ea1-c9d4-4c38-831f-2d531b9b5434 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:51.281906 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fc406ea1-c9d4-4c38-831f-2d531b9b5434 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:51.282791 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fc406ea1-c9d4-4c38-831f-2d531b9b5434 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:51.287124 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-60a2d869-bece-49b6-ad62-d312676de1a5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:51.306959 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-60a2d869-bece-49b6-ad62-d312676de1a5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:51.311792 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-60a2d869-bece-49b6-ad62-d312676de1a5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:51.323198 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-60a2d869-bece-49b6-ad62-d312676de1a5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.256322 Jul 23 21:29:51.351353 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2033/3981] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:29:51 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:29:51.375306 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-968e0d62-d342-4dc4-a057-76e40c4b0c68 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:51.377741 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-968e0d62-d342-4dc4-a057-76e40c4b0c68 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] [instance: 063b75fd-42ba-4fb6-bcd0-06b9622e32b1] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:51.395495 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-fc406ea1-c9d4-4c38-831f-2d531b9b5434 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Getting quotas for project 1890022bd460485dae0ea94b152a6746. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:29:51.408547 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-968e0d62-d342-4dc4-a057-76e40c4b0c68 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:51.409357 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-968e0d62-d342-4dc4-a057-76e40c4b0c68 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:51.413806 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-968e0d62-d342-4dc4-a057-76e40c4b0c68 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:51.414741 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-968e0d62-d342-4dc4-a057-76e40c4b0c68 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:51.427707 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-fc406ea1-c9d4-4c38-831f-2d531b9b5434 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Getting quotas for user 5efda1c40f494592bf1e6af1add120f3 and project 1890022bd460485dae0ea94b152a6746. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:29:51.457844 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-fc406ea1-c9d4-4c38-831f-2d531b9b5434 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Going to run 1 instances... {{(pid=131320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:29:51.461101 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-fc406ea1-c9d4-4c38-831f-2d531b9b5434 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: d6770104-2850-4914-b129-c3dd3544bfb6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:29:51.508342 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-968e0d62-d342-4dc4-a057-76e40c4b0c68 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] [instance: 063b75fd-42ba-4fb6-bcd0-06b9622e32b1] Going to try to terminate instance {{(pid=131321) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:29:51.623965 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-fc406ea1-c9d4-4c38-831f-2d531b9b5434 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.774262 Jul 23 21:29:51.628940 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1949/3982] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:29:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1783 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 23 21:29:51.651207 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a2241232-3176-489a-8868-1347ff895944 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:51.652108 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a2241232-3176-489a-8868-1347ff895944 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: d6770104-2850-4914-b129-c3dd3544bfb6] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:51.746460 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a2241232-3176-489a-8868-1347ff895944 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:51.757064 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a2241232-3176-489a-8868-1347ff895944 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/d6770104-2850-4914-b129-c3dd3544bfb6" status: 200 len: 1228 microversion: 2.1 time: 0.125404 Jul 23 21:29:51.768162 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1950/3983] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:29:51 2022] GET /compute/v2.1/servers/d6770104-2850-4914-b129-c3dd3544bfb6 => generated 1228 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:29:51.800285 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-968e0d62-d342-4dc4-a057-76e40c4b0c68 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] 10.222.0.17 "DELETE /compute/v2.1/servers/063b75fd-42ba-4fb6-bcd0-06b9622e32b1" status: 204 len: 0 microversion: 2.26 time: 0.449419 Jul 23 21:29:51.801217 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2034/3984] 10.222.0.17 () {60 vars in 1279 bytes} [Sat Jul 23 21:29:51 2022] DELETE /compute/v2.1/servers/063b75fd-42ba-4fb6-bcd0-06b9622e32b1 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 23 21:29:51.815170 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-fd98b1af-cbc5-4aee-94c3-bbab3a9653b3 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:51.816722 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-fd98b1af-cbc5-4aee-94c3-bbab3a9653b3 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] [instance: 063b75fd-42ba-4fb6-bcd0-06b9622e32b1] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:51.840999 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fd98b1af-cbc5-4aee-94c3-bbab3a9653b3 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:51.849435 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fd98b1af-cbc5-4aee-94c3-bbab3a9653b3 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:51.851018 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fd98b1af-cbc5-4aee-94c3-bbab3a9653b3 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:51.851638 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fd98b1af-cbc5-4aee-94c3-bbab3a9653b3 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:51.901488 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d2729116-fe77-4aaa-b25c-d21ff7fca44e tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:51.902355 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-d2729116-fe77-4aaa-b25c-d21ff7fca44e tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] [instance: b3576570-0c74-42f9-ae44-ac9f049e980d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:51.916210 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d2729116-fe77-4aaa-b25c-d21ff7fca44e tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:51.917054 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d2729116-fe77-4aaa-b25c-d21ff7fca44e tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:51.918866 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d2729116-fe77-4aaa-b25c-d21ff7fca44e tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:51.919729 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d2729116-fe77-4aaa-b25c-d21ff7fca44e tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:52.205839 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-d2729116-fe77-4aaa-b25c-d21ff7fca44e tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadc4fac778e4eaf905a3fbc26fbb090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e751dfada40945a69472003d08f1bb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:52.218062 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-d2729116-fe77-4aaa-b25c-d21ff7fca44e tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cadc4fac778e4eaf905a3fbc26fbb090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e751dfada40945a69472003d08f1bb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:52.220788 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-d2729116-fe77-4aaa-b25c-d21ff7fca44e tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cadc4fac778e4eaf905a3fbc26fbb090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e751dfada40945a69472003d08f1bb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:52.222382 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-d2729116-fe77-4aaa-b25c-d21ff7fca44e tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] 10.222.0.17 "GET /compute/v2.1/servers/b3576570-0c74-42f9-ae44-ac9f049e980d" status: 200 len: 1408 microversion: 2.54 time: 0.325175 Jul 23 21:29:52.234165 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2035/3985] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:29:51 2022] GET /compute/v2.1/servers/b3576570-0c74-42f9-ae44-ac9f049e980d => generated 1408 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:29:52.237041 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-fd98b1af-cbc5-4aee-94c3-bbab3a9653b3 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca13fa56f9a342b69f198080ef10acaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1e19260e3448e08f349cbd4c4a3f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:52.260834 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-fd98b1af-cbc5-4aee-94c3-bbab3a9653b3 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca13fa56f9a342b69f198080ef10acaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1e19260e3448e08f349cbd4c4a3f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:52.263556 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-fd98b1af-cbc5-4aee-94c3-bbab3a9653b3 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca13fa56f9a342b69f198080ef10acaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1e19260e3448e08f349cbd4c4a3f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:52.268305 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-fd98b1af-cbc5-4aee-94c3-bbab3a9653b3 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] 10.222.0.17 "GET /compute/v2.1/servers/063b75fd-42ba-4fb6-bcd0-06b9622e32b1" status: 200 len: 1551 microversion: 2.26 time: 0.457845 Jul 23 21:29:52.270338 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1951/3986] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:29:51 2022] GET /compute/v2.1/servers/063b75fd-42ba-4fb6-bcd0-06b9622e32b1 => generated 1551 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:29:52.347766 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d045aaf7-27ed-4892-acba-78cb2c9789ed tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:52.348673 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-d045aaf7-27ed-4892-acba-78cb2c9789ed tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:52.357755 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d045aaf7-27ed-4892-acba-78cb2c9789ed tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:52.358664 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d045aaf7-27ed-4892-acba-78cb2c9789ed tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:52.360381 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d045aaf7-27ed-4892-acba-78cb2c9789ed tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:52.361065 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d045aaf7-27ed-4892-acba-78cb2c9789ed tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:52.503487 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-d045aaf7-27ed-4892-acba-78cb2c9789ed tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:52.514159 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-d045aaf7-27ed-4892-acba-78cb2c9789ed tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:52.516012 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-d045aaf7-27ed-4892-acba-78cb2c9789ed tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:52.517570 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-d045aaf7-27ed-4892-acba-78cb2c9789ed tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.176480 Jul 23 21:29:52.529277 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2036/3987] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:29:52 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:29:52.776709 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4795caf4-e5b5-4af2-a37d-c3e171d96994 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:52.777941 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-4795caf4-e5b5-4af2-a37d-c3e171d96994 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: d6770104-2850-4914-b129-c3dd3544bfb6] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:52.787208 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4795caf4-e5b5-4af2-a37d-c3e171d96994 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:52.788546 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4795caf4-e5b5-4af2-a37d-c3e171d96994 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:52.790139 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4795caf4-e5b5-4af2-a37d-c3e171d96994 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:52.790719 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4795caf4-e5b5-4af2-a37d-c3e171d96994 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:52.899587 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-4795caf4-e5b5-4af2-a37d-c3e171d96994 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:52.910899 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4795caf4-e5b5-4af2-a37d-c3e171d96994 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/d6770104-2850-4914-b129-c3dd3544bfb6" status: 200 len: 1224 microversion: 2.1 time: 0.140504 Jul 23 21:29:52.916992 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1952/3988] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:29:52 2022] GET /compute/v2.1/servers/d6770104-2850-4914-b129-c3dd3544bfb6 => generated 1224 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:29:53.242627 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-185e1896-7ea5-4229-9cb4-0d81bb4b2efe tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:53.243264 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-185e1896-7ea5-4229-9cb4-0d81bb4b2efe tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] [instance: b3576570-0c74-42f9-ae44-ac9f049e980d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:53.255885 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-185e1896-7ea5-4229-9cb4-0d81bb4b2efe tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:53.257267 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-185e1896-7ea5-4229-9cb4-0d81bb4b2efe tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:53.258650 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-185e1896-7ea5-4229-9cb4-0d81bb4b2efe tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:53.260849 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-185e1896-7ea5-4229-9cb4-0d81bb4b2efe tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:53.292738 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-31498f77-65cf-4f3a-990c-e28bf98a32cf tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:53.293351 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-31498f77-65cf-4f3a-990c-e28bf98a32cf tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] [instance: 063b75fd-42ba-4fb6-bcd0-06b9622e32b1] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:53.333854 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-31498f77-65cf-4f3a-990c-e28bf98a32cf tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:53.336441 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-31498f77-65cf-4f3a-990c-e28bf98a32cf tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:53.341581 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-31498f77-65cf-4f3a-990c-e28bf98a32cf tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:53.353291 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-31498f77-65cf-4f3a-990c-e28bf98a32cf tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:53.441972 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-185e1896-7ea5-4229-9cb4-0d81bb4b2efe tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadc4fac778e4eaf905a3fbc26fbb090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e751dfada40945a69472003d08f1bb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:53.454422 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-185e1896-7ea5-4229-9cb4-0d81bb4b2efe tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cadc4fac778e4eaf905a3fbc26fbb090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e751dfada40945a69472003d08f1bb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:53.456820 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-185e1896-7ea5-4229-9cb4-0d81bb4b2efe tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cadc4fac778e4eaf905a3fbc26fbb090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e751dfada40945a69472003d08f1bb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:53.461946 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-185e1896-7ea5-4229-9cb4-0d81bb4b2efe tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] 10.222.0.17 "GET /compute/v2.1/servers/b3576570-0c74-42f9-ae44-ac9f049e980d" status: 200 len: 1408 microversion: 2.54 time: 0.223736 Jul 23 21:29:53.465960 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2037/3989] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:29:53 2022] GET /compute/v2.1/servers/b3576570-0c74-42f9-ae44-ac9f049e980d => generated 1408 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:29:53.535654 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-1b5143cb-2dac-4976-88ba-35bbaabf6568 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:53.536531 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-1b5143cb-2dac-4976-88ba-35bbaabf6568 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:53.547771 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1b5143cb-2dac-4976-88ba-35bbaabf6568 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:53.551015 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1b5143cb-2dac-4976-88ba-35bbaabf6568 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:53.552160 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1b5143cb-2dac-4976-88ba-35bbaabf6568 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:53.554752 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1b5143cb-2dac-4976-88ba-35bbaabf6568 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:53.668903 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-1b5143cb-2dac-4976-88ba-35bbaabf6568 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:53.686131 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-1b5143cb-2dac-4976-88ba-35bbaabf6568 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:53.691843 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-1b5143cb-2dac-4976-88ba-35bbaabf6568 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:53.697067 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-1b5143cb-2dac-4976-88ba-35bbaabf6568 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.161383 Jul 23 21:29:53.698147 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2038/3990] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:29:53 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:29:53.779996 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-31498f77-65cf-4f3a-990c-e28bf98a32cf tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca13fa56f9a342b69f198080ef10acaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1e19260e3448e08f349cbd4c4a3f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:53.792824 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-31498f77-65cf-4f3a-990c-e28bf98a32cf tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca13fa56f9a342b69f198080ef10acaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1e19260e3448e08f349cbd4c4a3f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:53.794281 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-31498f77-65cf-4f3a-990c-e28bf98a32cf tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca13fa56f9a342b69f198080ef10acaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1e19260e3448e08f349cbd4c4a3f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:53.800023 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-31498f77-65cf-4f3a-990c-e28bf98a32cf tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] 10.222.0.17 "GET /compute/v2.1/servers/063b75fd-42ba-4fb6-bcd0-06b9622e32b1" status: 200 len: 1551 microversion: 2.26 time: 0.508999 Jul 23 21:29:53.803854 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1953/3991] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:29:53 2022] GET /compute/v2.1/servers/063b75fd-42ba-4fb6-bcd0-06b9622e32b1 => generated 1551 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:29:53.935908 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f21f7ea4-a273-436d-a8e4-0c2703bc4aeb tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:53.936660 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-f21f7ea4-a273-436d-a8e4-0c2703bc4aeb tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: d6770104-2850-4914-b129-c3dd3544bfb6] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:53.947306 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f21f7ea4-a273-436d-a8e4-0c2703bc4aeb tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:53.948707 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f21f7ea4-a273-436d-a8e4-0c2703bc4aeb tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:53.950579 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f21f7ea4-a273-436d-a8e4-0c2703bc4aeb tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:53.951314 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f21f7ea4-a273-436d-a8e4-0c2703bc4aeb tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:54.081428 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-f21f7ea4-a273-436d-a8e4-0c2703bc4aeb tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:54.095183 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-f21f7ea4-a273-436d-a8e4-0c2703bc4aeb tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/d6770104-2850-4914-b129-c3dd3544bfb6" status: 200 len: 1286 microversion: 2.1 time: 0.165148 Jul 23 21:29:54.106823 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2039/3992] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:29:53 2022] GET /compute/v2.1/servers/d6770104-2850-4914-b129-c3dd3544bfb6 => generated 1286 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:29:54.481051 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-51538730-f2bd-43e1-b703-404d0eeacea8 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:54.482252 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-51538730-f2bd-43e1-b703-404d0eeacea8 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] [instance: b3576570-0c74-42f9-ae44-ac9f049e980d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:54.490917 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-51538730-f2bd-43e1-b703-404d0eeacea8 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:54.491651 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-51538730-f2bd-43e1-b703-404d0eeacea8 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:54.493304 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-51538730-f2bd-43e1-b703-404d0eeacea8 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:54.494250 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-51538730-f2bd-43e1-b703-404d0eeacea8 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:54.588771 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-51538730-f2bd-43e1-b703-404d0eeacea8 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadc4fac778e4eaf905a3fbc26fbb090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e751dfada40945a69472003d08f1bb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:54.603371 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-51538730-f2bd-43e1-b703-404d0eeacea8 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cadc4fac778e4eaf905a3fbc26fbb090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e751dfada40945a69472003d08f1bb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:54.606938 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-51538730-f2bd-43e1-b703-404d0eeacea8 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cadc4fac778e4eaf905a3fbc26fbb090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e751dfada40945a69472003d08f1bb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:54.608586 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-51538730-f2bd-43e1-b703-404d0eeacea8 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] 10.222.0.17 "GET /compute/v2.1/servers/b3576570-0c74-42f9-ae44-ac9f049e980d" status: 200 len: 1408 microversion: 2.54 time: 0.131675 Jul 23 21:29:54.609817 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1954/3993] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:29:54 2022] GET /compute/v2.1/servers/b3576570-0c74-42f9-ae44-ac9f049e980d => generated 1408 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:29:54.721562 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a174d93b-8750-4033-824e-61e397200493 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:54.722491 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-a174d93b-8750-4033-824e-61e397200493 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:54.740826 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-b2a61b63-322b-4811-ba17-09217e963b64 req-7f8121b3-f9dd-4c9e-97c6-ea445a810ece service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "063b75fd-42ba-4fb6-bcd0-06b9622e32b1", "name": "network-vif-deleted", "tag": "55ad3ac1-2c82-4462-8c36-48b51682f148"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:29:54.746039 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a174d93b-8750-4033-824e-61e397200493 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:54.746846 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a174d93b-8750-4033-824e-61e397200493 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:54.748359 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a174d93b-8750-4033-824e-61e397200493 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:54.749208 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a174d93b-8750-4033-824e-61e397200493 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:54.761085 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:54.768827 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-b2a61b63-322b-4811-ba17-09217e963b64 req-7f8121b3-f9dd-4c9e-97c6-ea445a810ece service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:54.769303 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-b2a61b63-322b-4811-ba17-09217e963b64 req-7f8121b3-f9dd-4c9e-97c6-ea445a810ece service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:54.825732 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-b2a61b63-322b-4811-ba17-09217e963b64 req-7f8121b3-f9dd-4c9e-97c6-ea445a810ece service nova] Creating event network-vif-deleted:55ad3ac1-2c82-4462-8c36-48b51682f148 for instance 063b75fd-42ba-4fb6-bcd0-06b9622e32b1 on nch1-master-1 Jul 23 21:29:54.846056 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-b2a61b63-322b-4811-ba17-09217e963b64 req-7f8121b3-f9dd-4c9e-97c6-ea445a810ece service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109666 Jul 23 21:29:54.847329 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1955/3994] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:29:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:29:54.853451 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ab18d358-782e-417c-92a7-215a0f9336de tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:54.861823 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ab18d358-782e-417c-92a7-215a0f9336de tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] [instance: 063b75fd-42ba-4fb6-bcd0-06b9622e32b1] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:54.868627 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ab18d358-782e-417c-92a7-215a0f9336de tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:54.869266 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ab18d358-782e-417c-92a7-215a0f9336de tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:54.874951 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ab18d358-782e-417c-92a7-215a0f9336de tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:54.876896 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ab18d358-782e-417c-92a7-215a0f9336de tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:54.881326 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-a174d93b-8750-4033-824e-61e397200493 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:54.891699 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-a174d93b-8750-4033-824e-61e397200493 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:54.897096 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-a174d93b-8750-4033-824e-61e397200493 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:54.903640 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-a174d93b-8750-4033-824e-61e397200493 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.191039 Jul 23 21:29:54.904477 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2040/3995] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:29:54 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:29:54.936543 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ab18d358-782e-417c-92a7-215a0f9336de tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:54.937521 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ab18d358-782e-417c-92a7-215a0f9336de tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:54.937718 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.objects.instance [None req-ab18d358-782e-417c-92a7-215a0f9336de tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lazy-loading 'fault' on Instance uuid 063b75fd-42ba-4fb6-bcd0-06b9622e32b1 {{(pid=131320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:29:55.017526 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ab18d358-782e-417c-92a7-215a0f9336de tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca13fa56f9a342b69f198080ef10acaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1e19260e3448e08f349cbd4c4a3f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:55.027446 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ab18d358-782e-417c-92a7-215a0f9336de tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ca13fa56f9a342b69f198080ef10acaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1e19260e3448e08f349cbd4c4a3f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:55.029418 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ab18d358-782e-417c-92a7-215a0f9336de tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ca13fa56f9a342b69f198080ef10acaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa1e19260e3448e08f349cbd4c4a3f70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:55.030727 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ab18d358-782e-417c-92a7-215a0f9336de tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] 10.222.0.17 "GET /compute/v2.1/servers/063b75fd-42ba-4fb6-bcd0-06b9622e32b1" status: 200 len: 1352 microversion: 2.26 time: 0.181885 Jul 23 21:29:55.032116 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1956/3996] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:29:54 2022] GET /compute/v2.1/servers/063b75fd-42ba-4fb6-bcd0-06b9622e32b1 => generated 1352 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:29:55.113478 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e06f02e1-c807-4598-a8da-f8a279e84139 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:55.114562 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-e06f02e1-c807-4598-a8da-f8a279e84139 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: d6770104-2850-4914-b129-c3dd3544bfb6] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:55.120985 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e06f02e1-c807-4598-a8da-f8a279e84139 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:55.121448 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e06f02e1-c807-4598-a8da-f8a279e84139 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:55.122263 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e06f02e1-c807-4598-a8da-f8a279e84139 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:55.122738 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e06f02e1-c807-4598-a8da-f8a279e84139 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:55.231328 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-e06f02e1-c807-4598-a8da-f8a279e84139 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:55.236553 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:RELEASE=1,nova_cell1:SELECT=94,nova_cell1:DELETE=2,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:55.248471 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-e06f02e1-c807-4598-a8da-f8a279e84139 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/d6770104-2850-4914-b129-c3dd3544bfb6" status: 200 len: 1286 microversion: 2.1 time: 0.137408 Jul 23 21:29:55.250716 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2041/3997] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:29:55 2022] GET /compute/v2.1/servers/d6770104-2850-4914-b129-c3dd3544bfb6 => generated 1286 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:29:55.630892 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b3e18178-503a-4c18-b482-19272b1ca2b7 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:55.632295 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b3e18178-503a-4c18-b482-19272b1ca2b7 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] [instance: b3576570-0c74-42f9-ae44-ac9f049e980d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:55.644654 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b3e18178-503a-4c18-b482-19272b1ca2b7 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:55.649257 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b3e18178-503a-4c18-b482-19272b1ca2b7 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:55.650238 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b3e18178-503a-4c18-b482-19272b1ca2b7 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:55.652112 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b3e18178-503a-4c18-b482-19272b1ca2b7 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:55.789434 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b3e18178-503a-4c18-b482-19272b1ca2b7 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadc4fac778e4eaf905a3fbc26fbb090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e751dfada40945a69472003d08f1bb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:55.818541 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b3e18178-503a-4c18-b482-19272b1ca2b7 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cadc4fac778e4eaf905a3fbc26fbb090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e751dfada40945a69472003d08f1bb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:55.822593 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b3e18178-503a-4c18-b482-19272b1ca2b7 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cadc4fac778e4eaf905a3fbc26fbb090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e751dfada40945a69472003d08f1bb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:55.831624 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b3e18178-503a-4c18-b482-19272b1ca2b7 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] 10.222.0.17 "GET /compute/v2.1/servers/b3576570-0c74-42f9-ae44-ac9f049e980d" status: 200 len: 1408 microversion: 2.54 time: 0.204395 Jul 23 21:29:55.833715 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1957/3998] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:29:55 2022] GET /compute/v2.1/servers/b3576570-0c74-42f9-ae44-ac9f049e980d => generated 1408 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:29:56.052702 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d797c1a5-65b8-400b-a2f6-70fcbe8496c7 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:56.053967 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d797c1a5-65b8-400b-a2f6-70fcbe8496c7 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] [instance: 063b75fd-42ba-4fb6-bcd0-06b9622e32b1] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:56.071677 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d797c1a5-65b8-400b-a2f6-70fcbe8496c7 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:56.073378 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d797c1a5-65b8-400b-a2f6-70fcbe8496c7 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:56.074727 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d797c1a5-65b8-400b-a2f6-70fcbe8496c7 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:56.075563 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d797c1a5-65b8-400b-a2f6-70fcbe8496c7 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:56.124461 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-d797c1a5-65b8-400b-a2f6-70fcbe8496c7 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] HTTP exception thrown: Instance 063b75fd-42ba-4fb6-bcd0-06b9622e32b1 could not be found. Jul 23 21:29:56.129604 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d797c1a5-65b8-400b-a2f6-70fcbe8496c7 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Request method failure captured: Jul 23 21:29:56.129604 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/063b75fd-42ba-4fb6-bcd0-06b9622e32b1 HTTP/1.1 Jul 23 21:29:56.129604 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:29:56.129604 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:29:56.129604 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:29:56.129604 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:29:56.129604 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:29:56.129604 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:29:56.129604 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:29:56.129604 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:29:56.129604 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3Gg3Y4H-4P3O09PQICgIO5SmfIXsxAwvWv4IG-2tmbbzW6eNvLudPosA4SD5yhL-lCsnVfn8HAVC2ejr5hEfhwBLaoKJBdSKvmD4m46j1YtN2bVFYwcH8gcIM6O59bEvLjKzkPWZMxF3SxZsxRYcFYyo4k0rWwQUIJXH0Pp8m_FDp3I Jul 23 21:29:56.129604 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:29:56.129604 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:29:56.129604 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:29:56.129604 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:29:56.129604 ncdv-master-1 devstack@n-api.service[131320]: X-Openstack-Nova-Api-Version: 2.26 Jul 23 21:29:56.129604 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:29:56.129604 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:29:56.129604 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: aa1e19260e3448e08f349cbd4c4a3f70 Jul 23 21:29:56.129604 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServerTagsTestJSON-933224599 Jul 23 21:29:56.129604 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:29:56.129604 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:29:56.129604 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/aa1e19260e3448e08f349cbd4c4a3f70"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/aa1e19260e3448e08f349cbd4c4a3f70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_aa1e19260e3448e08f349cbd4c4a3f70", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/aa1e19260e3448e08f349cbd4c4a3f70"}]}] Jul 23 21:29:56.129604 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServerTagsTestJSON-933224599 Jul 23 21:29:56.129604 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: aa1e19260e3448e08f349cbd4c4a3f70 Jul 23 21:29:56.129604 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServerTagsTestJSON-933224599 Jul 23 21:29:56.129604 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServerTagsTestJSON-933224599-project Jul 23 21:29:56.129604 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:29:56.129604 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:29:56.129604 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: ca13fa56f9a342b69f198080ef10acaa Jul 23 21:29:56.129604 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServerTagsTestJSON-933224599-project Jul 23 21:29:56.129604 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:29:56.129604 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance 063b75fd-42ba-4fb6-bcd0-06b9622e32b1 could not be found. Jul 23 21:29:56.129604 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '063b75fd-42ba-4fb6-bcd0-06b9622e32b1'} Jul 23 21:29:56.129604 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:29:56.129604 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:29:56.129604 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:29:56.129604 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:29:56.129604 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:29:56.129604 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:29:56.129604 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:29:56.129604 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:29:56.129604 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:29:56.129604 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:29:56.129604 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 063b75fd-42ba-4fb6-bcd0-06b9622e32b1 could not be found. Jul 23 21:29:56.129604 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:29:56.129604 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:29:56.129604 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:29:56.129604 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:29:56.129604 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:29:56.129604 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:29:56.129604 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:29:56.129604 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:29:56.129604 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:29:56.129604 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:29:56.129604 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:29:56.129604 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:29:56.129604 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:29:56.129604 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:29:56.129604 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:29:56.129604 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:29:56.129604 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 063b75fd-42ba-4fb6-bcd0-06b9622e32b1 could not be found. Jul 23 21:29:56.129604 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:29:56.129604 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:29:56.129604 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:29:56.132997 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:29:56.132997 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:29:56.132997 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:29:56.132997 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:29:56.132997 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:29:56.132997 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 063b75fd-42ba-4fb6-bcd0-06b9622e32b1 could not be found. Jul 23 21:29:56.132997 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:29:56.137139 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d797c1a5-65b8-400b-a2f6-70fcbe8496c7 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] Returning 404 to user: Instance 063b75fd-42ba-4fb6-bcd0-06b9622e32b1 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:29:56.140519 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d797c1a5-65b8-400b-a2f6-70fcbe8496c7 tempest-ServerTagsTestJSON-933224599 tempest-ServerTagsTestJSON-933224599-project] 10.222.0.17 "GET /compute/v2.1/servers/063b75fd-42ba-4fb6-bcd0-06b9622e32b1" status: 404 len: 111 microversion: 2.26 time: 0.092687 Jul 23 21:29:56.142879 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1958/3999] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:29:56 2022] GET /compute/v2.1/servers/063b75fd-42ba-4fb6-bcd0-06b9622e32b1 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 23 21:29:56.268245 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-44ab2f62-0c16-4715-88ee-c49137f5fac3 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:56.268872 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-44ab2f62-0c16-4715-88ee-c49137f5fac3 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: d6770104-2850-4914-b129-c3dd3544bfb6] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:56.277319 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-44ab2f62-0c16-4715-88ee-c49137f5fac3 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:56.277982 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-44ab2f62-0c16-4715-88ee-c49137f5fac3 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:56.279864 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-44ab2f62-0c16-4715-88ee-c49137f5fac3 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:56.280605 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-44ab2f62-0c16-4715-88ee-c49137f5fac3 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:56.468763 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-6c05b99d-02ef-44e7-a51b-39d7b00283a7 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:56.469588 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-6c05b99d-02ef-44e7-a51b-39d7b00283a7 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:56.478749 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6c05b99d-02ef-44e7-a51b-39d7b00283a7 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:56.479475 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6c05b99d-02ef-44e7-a51b-39d7b00283a7 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:56.480765 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6c05b99d-02ef-44e7-a51b-39d7b00283a7 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:56.481367 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6c05b99d-02ef-44e7-a51b-39d7b00283a7 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:56.732321 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-6c05b99d-02ef-44e7-a51b-39d7b00283a7 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:56.762800 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-6c05b99d-02ef-44e7-a51b-39d7b00283a7 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:56.768862 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-6c05b99d-02ef-44e7-a51b-39d7b00283a7 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:56.770865 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-6c05b99d-02ef-44e7-a51b-39d7b00283a7 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.851576 Jul 23 21:29:56.771795 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2042/4000] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:29:55 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:29:56.853584 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-9a6acd57-5f79-4de6-b890-5efcf65cf74c tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:56.854625 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-9a6acd57-5f79-4de6-b890-5efcf65cf74c tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] [instance: b3576570-0c74-42f9-ae44-ac9f049e980d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:56.866261 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9a6acd57-5f79-4de6-b890-5efcf65cf74c tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:56.867655 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9a6acd57-5f79-4de6-b890-5efcf65cf74c tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:56.871887 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9a6acd57-5f79-4de6-b890-5efcf65cf74c tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:56.872501 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9a6acd57-5f79-4de6-b890-5efcf65cf74c tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:56.927134 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-44ab2f62-0c16-4715-88ee-c49137f5fac3 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:56.938660 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-44ab2f62-0c16-4715-88ee-c49137f5fac3 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/d6770104-2850-4914-b129-c3dd3544bfb6" status: 200 len: 1328 microversion: 2.1 time: 0.675125 Jul 23 21:29:56.939265 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1959/4001] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:29:56 2022] GET /compute/v2.1/servers/d6770104-2850-4914-b129-c3dd3544bfb6 => generated 1328 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:29:57.070708 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-9a6acd57-5f79-4de6-b890-5efcf65cf74c tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadc4fac778e4eaf905a3fbc26fbb090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e751dfada40945a69472003d08f1bb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:57.085107 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-9a6acd57-5f79-4de6-b890-5efcf65cf74c tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cadc4fac778e4eaf905a3fbc26fbb090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e751dfada40945a69472003d08f1bb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:57.087944 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-9a6acd57-5f79-4de6-b890-5efcf65cf74c tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cadc4fac778e4eaf905a3fbc26fbb090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e751dfada40945a69472003d08f1bb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:57.089802 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-9a6acd57-5f79-4de6-b890-5efcf65cf74c tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] 10.222.0.17 "GET /compute/v2.1/servers/b3576570-0c74-42f9-ae44-ac9f049e980d" status: 200 len: 1408 microversion: 2.54 time: 0.241800 Jul 23 21:29:57.090826 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2043/4002] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:29:56 2022] GET /compute/v2.1/servers/b3576570-0c74-42f9-ae44-ac9f049e980d => generated 1408 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:29:57.789497 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-bb8bdeb5-b908-441b-93c2-5275914b2979 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:57.790136 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-bb8bdeb5-b908-441b-93c2-5275914b2979 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:57.802736 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bb8bdeb5-b908-441b-93c2-5275914b2979 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:57.803211 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bb8bdeb5-b908-441b-93c2-5275914b2979 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:57.803995 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bb8bdeb5-b908-441b-93c2-5275914b2979 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:57.804450 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bb8bdeb5-b908-441b-93c2-5275914b2979 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:57.955715 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-89123f3f-c073-4b8b-9bb6-2fade9f1ae5f tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:57.956357 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-89123f3f-c073-4b8b-9bb6-2fade9f1ae5f tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: d6770104-2850-4914-b129-c3dd3544bfb6] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:57.970078 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-89123f3f-c073-4b8b-9bb6-2fade9f1ae5f tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:57.970547 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-89123f3f-c073-4b8b-9bb6-2fade9f1ae5f tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:57.971353 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-89123f3f-c073-4b8b-9bb6-2fade9f1ae5f tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:57.971805 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-89123f3f-c073-4b8b-9bb6-2fade9f1ae5f tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:58.000865 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-bb8bdeb5-b908-441b-93c2-5275914b2979 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:58.022573 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-bb8bdeb5-b908-441b-93c2-5275914b2979 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:58.024835 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-bb8bdeb5-b908-441b-93c2-5275914b2979 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:58.028288 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-bb8bdeb5-b908-441b-93c2-5275914b2979 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.242445 Jul 23 21:29:58.029060 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1960/4003] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:29:57 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:29:58.040684 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-96adf53a-1bde-4039-98b5-5e25e5402c63 req-c8b771f4-8e6b-4fa8-8b26-c74ede35aaf8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6770104-2850-4914-b129-c3dd3544bfb6", "tag": "1cb4fef7-7cfe-4941-ae7f-b8aebe6f05b4"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:29:58.068334 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-96adf53a-1bde-4039-98b5-5e25e5402c63 req-c8b771f4-8e6b-4fa8-8b26-c74ede35aaf8 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:58.069130 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-96adf53a-1bde-4039-98b5-5e25e5402c63 req-c8b771f4-8e6b-4fa8-8b26-c74ede35aaf8 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:58.082579 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-96adf53a-1bde-4039-98b5-5e25e5402c63 req-c8b771f4-8e6b-4fa8-8b26-c74ede35aaf8 service nova] Creating event network-changed:1cb4fef7-7cfe-4941-ae7f-b8aebe6f05b4 for instance d6770104-2850-4914-b129-c3dd3544bfb6 on nch2-master-1 Jul 23 21:29:58.090047 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-96adf53a-1bde-4039-98b5-5e25e5402c63 req-c8b771f4-8e6b-4fa8-8b26-c74ede35aaf8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052934 Jul 23 21:29:58.091423 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1961/4004] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:29:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:29:58.124242 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-222609d5-aeb6-4cd6-8583-5f8056969e65 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:58.124242 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-222609d5-aeb6-4cd6-8583-5f8056969e65 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] [instance: b3576570-0c74-42f9-ae44-ac9f049e980d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:58.131195 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-222609d5-aeb6-4cd6-8583-5f8056969e65 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:58.131652 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-222609d5-aeb6-4cd6-8583-5f8056969e65 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:58.132625 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-222609d5-aeb6-4cd6-8583-5f8056969e65 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:58.133221 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-222609d5-aeb6-4cd6-8583-5f8056969e65 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:58.261422 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-222609d5-aeb6-4cd6-8583-5f8056969e65 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadc4fac778e4eaf905a3fbc26fbb090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e751dfada40945a69472003d08f1bb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:58.282245 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-222609d5-aeb6-4cd6-8583-5f8056969e65 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cadc4fac778e4eaf905a3fbc26fbb090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e751dfada40945a69472003d08f1bb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:58.284338 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-222609d5-aeb6-4cd6-8583-5f8056969e65 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cadc4fac778e4eaf905a3fbc26fbb090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e751dfada40945a69472003d08f1bb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:58.286235 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-222609d5-aeb6-4cd6-8583-5f8056969e65 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] 10.222.0.17 "GET /compute/v2.1/servers/b3576570-0c74-42f9-ae44-ac9f049e980d" status: 200 len: 1408 microversion: 2.54 time: 0.175481 Jul 23 21:29:58.287376 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1962/4005] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:29:58 2022] GET /compute/v2.1/servers/b3576570-0c74-42f9-ae44-ac9f049e980d => generated 1408 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:29:58.448011 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-89123f3f-c073-4b8b-9bb6-2fade9f1ae5f tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:58.458148 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-89123f3f-c073-4b8b-9bb6-2fade9f1ae5f tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/d6770104-2850-4914-b129-c3dd3544bfb6" status: 200 len: 1328 microversion: 2.1 time: 0.506460 Jul 23 21:29:58.460739 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2044/4006] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:29:57 2022] GET /compute/v2.1/servers/d6770104-2850-4914-b129-c3dd3544bfb6 => generated 1328 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:29:59.054133 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2b62c48b-91ef-4fc6-8914-bfd60bf650d7 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:59.055574 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-2b62c48b-91ef-4fc6-8914-bfd60bf650d7 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:59.068960 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2b62c48b-91ef-4fc6-8914-bfd60bf650d7 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:59.069927 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2b62c48b-91ef-4fc6-8914-bfd60bf650d7 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:59.071237 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2b62c48b-91ef-4fc6-8914-bfd60bf650d7 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:59.071915 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2b62c48b-91ef-4fc6-8914-bfd60bf650d7 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:59.245589 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-2b62c48b-91ef-4fc6-8914-bfd60bf650d7 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:59.265398 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=96,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:59.269773 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-2b62c48b-91ef-4fc6-8914-bfd60bf650d7 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:59.275425 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-2b62c48b-91ef-4fc6-8914-bfd60bf650d7 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:59.276924 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2b62c48b-91ef-4fc6-8914-bfd60bf650d7 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.227876 Jul 23 21:29:59.277829 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1963/4007] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:29:59 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:29:59.306772 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-0a3cd54c-6062-423b-b61f-243532245995 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:59.308192 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-0a3cd54c-6062-423b-b61f-243532245995 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] [instance: b3576570-0c74-42f9-ae44-ac9f049e980d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:59.315568 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell0:SELECT=10 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:29:59.335710 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0a3cd54c-6062-423b-b61f-243532245995 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:59.341740 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0a3cd54c-6062-423b-b61f-243532245995 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:59.343283 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0a3cd54c-6062-423b-b61f-243532245995 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:59.344570 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0a3cd54c-6062-423b-b61f-243532245995 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:59.475892 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-accc98e1-941b-4bb3-99d6-6e2ed15c78c2 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:29:59.477285 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-accc98e1-941b-4bb3-99d6-6e2ed15c78c2 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: d6770104-2850-4914-b129-c3dd3544bfb6] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:29:59.487516 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-accc98e1-941b-4bb3-99d6-6e2ed15c78c2 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:59.488384 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-accc98e1-941b-4bb3-99d6-6e2ed15c78c2 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:59.489485 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-accc98e1-941b-4bb3-99d6-6e2ed15c78c2 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:29:59.490169 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-accc98e1-941b-4bb3-99d6-6e2ed15c78c2 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:29:59.895769 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-accc98e1-941b-4bb3-99d6-6e2ed15c78c2 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:29:59.906952 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-accc98e1-941b-4bb3-99d6-6e2ed15c78c2 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/d6770104-2850-4914-b129-c3dd3544bfb6" status: 200 len: 1328 microversion: 2.1 time: 0.435436 Jul 23 21:29:59.907621 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1964/4008] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:29:59 2022] GET /compute/v2.1/servers/d6770104-2850-4914-b129-c3dd3544bfb6 => generated 1328 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:30:00.040993 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-0a3cd54c-6062-423b-b61f-243532245995 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadc4fac778e4eaf905a3fbc26fbb090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e751dfada40945a69472003d08f1bb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:00.055555 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-0a3cd54c-6062-423b-b61f-243532245995 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cadc4fac778e4eaf905a3fbc26fbb090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e751dfada40945a69472003d08f1bb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:00.071758 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-0a3cd54c-6062-423b-b61f-243532245995 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cadc4fac778e4eaf905a3fbc26fbb090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e751dfada40945a69472003d08f1bb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:00.075892 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-0a3cd54c-6062-423b-b61f-243532245995 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] 10.222.0.17 "GET /compute/v2.1/servers/b3576570-0c74-42f9-ae44-ac9f049e980d" status: 200 len: 1408 microversion: 2.54 time: 0.774033 Jul 23 21:30:00.077729 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2045/4009] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:29:59 2022] GET /compute/v2.1/servers/b3576570-0c74-42f9-ae44-ac9f049e980d => generated 1408 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:30:00.301022 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a3ef100e-567a-487c-8f8d-c45e794704f2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:00.303145 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a3ef100e-567a-487c-8f8d-c45e794704f2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:00.322219 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a3ef100e-567a-487c-8f8d-c45e794704f2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:00.325230 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a3ef100e-567a-487c-8f8d-c45e794704f2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:00.327454 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a3ef100e-567a-487c-8f8d-c45e794704f2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:00.328486 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a3ef100e-567a-487c-8f8d-c45e794704f2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:00.434481 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a3ef100e-567a-487c-8f8d-c45e794704f2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:00.470456 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a3ef100e-567a-487c-8f8d-c45e794704f2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:00.472538 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a3ef100e-567a-487c-8f8d-c45e794704f2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:00.474059 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a3ef100e-567a-487c-8f8d-c45e794704f2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.180445 Jul 23 21:30:00.485601 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1965/4010] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:30:00 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:30:00.923928 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-55ece8a1-a440-42fe-9363-642ce33cd75c tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:00.925282 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-55ece8a1-a440-42fe-9363-642ce33cd75c tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: d6770104-2850-4914-b129-c3dd3544bfb6] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:00.933470 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-55ece8a1-a440-42fe-9363-642ce33cd75c tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:00.934315 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-55ece8a1-a440-42fe-9363-642ce33cd75c tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:00.935309 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-55ece8a1-a440-42fe-9363-642ce33cd75c tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:00.935939 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-55ece8a1-a440-42fe-9363-642ce33cd75c tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:01.099893 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8b317ea8-e6f5-464d-bb1d-995026afd007 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:01.100950 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8b317ea8-e6f5-464d-bb1d-995026afd007 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] [instance: b3576570-0c74-42f9-ae44-ac9f049e980d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:01.110753 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8b317ea8-e6f5-464d-bb1d-995026afd007 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:01.111534 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8b317ea8-e6f5-464d-bb1d-995026afd007 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:01.112725 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8b317ea8-e6f5-464d-bb1d-995026afd007 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:01.113388 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8b317ea8-e6f5-464d-bb1d-995026afd007 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:01.346719 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:30:01.372845 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-55ece8a1-a440-42fe-9363-642ce33cd75c tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:01.388103 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-55ece8a1-a440-42fe-9363-642ce33cd75c tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/d6770104-2850-4914-b129-c3dd3544bfb6" status: 200 len: 1328 microversion: 2.1 time: 0.464936 Jul 23 21:30:01.389093 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2046/4011] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:30:00 2022] GET /compute/v2.1/servers/d6770104-2850-4914-b129-c3dd3544bfb6 => generated 1328 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:30:01.407507 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8b317ea8-e6f5-464d-bb1d-995026afd007 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadc4fac778e4eaf905a3fbc26fbb090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e751dfada40945a69472003d08f1bb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:01.419491 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8b317ea8-e6f5-464d-bb1d-995026afd007 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cadc4fac778e4eaf905a3fbc26fbb090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e751dfada40945a69472003d08f1bb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:01.431818 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8b317ea8-e6f5-464d-bb1d-995026afd007 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cadc4fac778e4eaf905a3fbc26fbb090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e751dfada40945a69472003d08f1bb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:01.433110 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8b317ea8-e6f5-464d-bb1d-995026afd007 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] 10.222.0.17 "GET /compute/v2.1/servers/b3576570-0c74-42f9-ae44-ac9f049e980d" status: 200 len: 1408 microversion: 2.54 time: 0.340955 Jul 23 21:30:01.433689 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1966/4012] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:30:01 2022] GET /compute/v2.1/servers/b3576570-0c74-42f9-ae44-ac9f049e980d => generated 1408 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:30:01.493750 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a2063507-dc86-4d8f-b062-8bc417416c02 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:01.494537 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-a2063507-dc86-4d8f-b062-8bc417416c02 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:01.511993 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a2063507-dc86-4d8f-b062-8bc417416c02 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:01.512456 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a2063507-dc86-4d8f-b062-8bc417416c02 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:01.517968 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a2063507-dc86-4d8f-b062-8bc417416c02 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:01.520999 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a2063507-dc86-4d8f-b062-8bc417416c02 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:01.691204 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-a2063507-dc86-4d8f-b062-8bc417416c02 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:01.701424 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-a2063507-dc86-4d8f-b062-8bc417416c02 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:01.703617 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-a2063507-dc86-4d8f-b062-8bc417416c02 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:01.705222 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-a2063507-dc86-4d8f-b062-8bc417416c02 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.215899 Jul 23 21:30:01.706946 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2047/4013] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:30:01 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:30:02.405609 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-7eb58290-277b-4be1-846d-869e24c70c1a tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:02.406291 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-7eb58290-277b-4be1-846d-869e24c70c1a tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: d6770104-2850-4914-b129-c3dd3544bfb6] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:02.421680 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=8 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:30:02.427782 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7eb58290-277b-4be1-846d-869e24c70c1a tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:02.428244 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7eb58290-277b-4be1-846d-869e24c70c1a tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:02.451933 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-89703115-61cc-43d5-b151-f80b9c9cab31 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:02.452629 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-89703115-61cc-43d5-b151-f80b9c9cab31 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] [instance: b3576570-0c74-42f9-ae44-ac9f049e980d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:02.457267 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7eb58290-277b-4be1-846d-869e24c70c1a tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:02.457752 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7eb58290-277b-4be1-846d-869e24c70c1a tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:02.476799 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-89703115-61cc-43d5-b151-f80b9c9cab31 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:02.477257 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-89703115-61cc-43d5-b151-f80b9c9cab31 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:02.478090 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-89703115-61cc-43d5-b151-f80b9c9cab31 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:02.483017 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-89703115-61cc-43d5-b151-f80b9c9cab31 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:02.892556 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-89703115-61cc-43d5-b151-f80b9c9cab31 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadc4fac778e4eaf905a3fbc26fbb090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e751dfada40945a69472003d08f1bb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:02.907378 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-89703115-61cc-43d5-b151-f80b9c9cab31 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cadc4fac778e4eaf905a3fbc26fbb090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e751dfada40945a69472003d08f1bb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:02.908917 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-89703115-61cc-43d5-b151-f80b9c9cab31 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cadc4fac778e4eaf905a3fbc26fbb090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e751dfada40945a69472003d08f1bb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:02.913489 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-89703115-61cc-43d5-b151-f80b9c9cab31 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] 10.222.0.17 "GET /compute/v2.1/servers/b3576570-0c74-42f9-ae44-ac9f049e980d" status: 200 len: 1408 microversion: 2.54 time: 0.465523 Jul 23 21:30:02.914124 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2048/4014] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:30:02 2022] GET /compute/v2.1/servers/b3576570-0c74-42f9-ae44-ac9f049e980d => generated 1408 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:30:02.927201 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-7eb58290-277b-4be1-846d-869e24c70c1a tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:02.931266 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-adc1edc4-76e3-4ffb-873f-cb8abb5d9e1e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:02.938376 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-adc1edc4-76e3-4ffb-873f-cb8abb5d9e1e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:02.949587 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-adc1edc4-76e3-4ffb-873f-cb8abb5d9e1e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:02.950447 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-7eb58290-277b-4be1-846d-869e24c70c1a tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/d6770104-2850-4914-b129-c3dd3544bfb6" status: 200 len: 1328 microversion: 2.1 time: 0.542533 Jul 23 21:30:02.951663 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1967/4015] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:30:02 2022] GET /compute/v2.1/servers/d6770104-2850-4914-b129-c3dd3544bfb6 => generated 1328 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:30:02.961625 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-adc1edc4-76e3-4ffb-873f-cb8abb5d9e1e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:02.962887 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-adc1edc4-76e3-4ffb-873f-cb8abb5d9e1e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:02.963537 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-adc1edc4-76e3-4ffb-873f-cb8abb5d9e1e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:03.148196 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-adc1edc4-76e3-4ffb-873f-cb8abb5d9e1e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:03.164624 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-adc1edc4-76e3-4ffb-873f-cb8abb5d9e1e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:03.166749 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-adc1edc4-76e3-4ffb-873f-cb8abb5d9e1e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:03.170160 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-adc1edc4-76e3-4ffb-873f-cb8abb5d9e1e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.254743 Jul 23 21:30:03.172702 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2049/4016] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:30:02 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:30:03.932553 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d0347cba-f364-467c-abee-befa8bb1331f tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:03.933186 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d0347cba-f364-467c-abee-befa8bb1331f tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] [instance: b3576570-0c74-42f9-ae44-ac9f049e980d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:03.949017 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d0347cba-f364-467c-abee-befa8bb1331f tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:03.949834 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d0347cba-f364-467c-abee-befa8bb1331f tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:03.951591 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d0347cba-f364-467c-abee-befa8bb1331f tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:03.954778 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d0347cba-f364-467c-abee-befa8bb1331f tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:03.968906 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f3afffa7-fd1d-4f21-a761-a00ff794c3ca tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:03.970134 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-f3afffa7-fd1d-4f21-a761-a00ff794c3ca tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: d6770104-2850-4914-b129-c3dd3544bfb6] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:03.987991 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f3afffa7-fd1d-4f21-a761-a00ff794c3ca tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:03.988803 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f3afffa7-fd1d-4f21-a761-a00ff794c3ca tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:03.989843 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f3afffa7-fd1d-4f21-a761-a00ff794c3ca tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:03.990537 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f3afffa7-fd1d-4f21-a761-a00ff794c3ca tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:04.181179 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d0347cba-f364-467c-abee-befa8bb1331f tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadc4fac778e4eaf905a3fbc26fbb090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e751dfada40945a69472003d08f1bb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:04.194701 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d0347cba-f364-467c-abee-befa8bb1331f tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cadc4fac778e4eaf905a3fbc26fbb090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e751dfada40945a69472003d08f1bb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:04.208928 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d0347cba-f364-467c-abee-befa8bb1331f tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cadc4fac778e4eaf905a3fbc26fbb090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e751dfada40945a69472003d08f1bb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:04.211151 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d0347cba-f364-467c-abee-befa8bb1331f tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] 10.222.0.17 "GET /compute/v2.1/servers/b3576570-0c74-42f9-ae44-ac9f049e980d" status: 200 len: 1408 microversion: 2.54 time: 0.283310 Jul 23 21:30:04.224862 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1968/4017] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:30:03 2022] GET /compute/v2.1/servers/b3576570-0c74-42f9-ae44-ac9f049e980d => generated 1408 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:30:04.231135 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-deef9d33-fb27-4a39-96bc-378b1228e3ba tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:04.232119 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-deef9d33-fb27-4a39-96bc-378b1228e3ba tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:04.249456 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-deef9d33-fb27-4a39-96bc-378b1228e3ba tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:04.250224 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-deef9d33-fb27-4a39-96bc-378b1228e3ba tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:04.251985 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-deef9d33-fb27-4a39-96bc-378b1228e3ba tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:04.252586 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-deef9d33-fb27-4a39-96bc-378b1228e3ba tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:04.417380 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-deef9d33-fb27-4a39-96bc-378b1228e3ba tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:04.436114 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-deef9d33-fb27-4a39-96bc-378b1228e3ba tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:04.440908 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-deef9d33-fb27-4a39-96bc-378b1228e3ba tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:04.442504 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-deef9d33-fb27-4a39-96bc-378b1228e3ba tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.216475 Jul 23 21:30:04.443914 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1969/4018] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:30:04 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:30:04.491401 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-f3afffa7-fd1d-4f21-a761-a00ff794c3ca tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:04.499998 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-f3afffa7-fd1d-4f21-a761-a00ff794c3ca tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/d6770104-2850-4914-b129-c3dd3544bfb6" status: 200 len: 1328 microversion: 2.1 time: 0.535954 Jul 23 21:30:04.511497 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2050/4019] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:30:03 2022] GET /compute/v2.1/servers/d6770104-2850-4914-b129-c3dd3544bfb6 => generated 1328 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:30:05.242526 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-774d1017-1062-48fb-919f-df0fc1ba754d tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:05.243752 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-774d1017-1062-48fb-919f-df0fc1ba754d tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] [instance: b3576570-0c74-42f9-ae44-ac9f049e980d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:05.257815 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-774d1017-1062-48fb-919f-df0fc1ba754d tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:05.258602 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-774d1017-1062-48fb-919f-df0fc1ba754d tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:05.260937 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-774d1017-1062-48fb-919f-df0fc1ba754d tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:05.261594 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-774d1017-1062-48fb-919f-df0fc1ba754d tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:05.428778 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-774d1017-1062-48fb-919f-df0fc1ba754d tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadc4fac778e4eaf905a3fbc26fbb090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e751dfada40945a69472003d08f1bb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:05.463487 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-774d1017-1062-48fb-919f-df0fc1ba754d tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cadc4fac778e4eaf905a3fbc26fbb090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e751dfada40945a69472003d08f1bb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:05.468627 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-9d8aba2e-5c0f-4eba-94f7-932081ecdd3b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:05.469831 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-774d1017-1062-48fb-919f-df0fc1ba754d tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cadc4fac778e4eaf905a3fbc26fbb090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e751dfada40945a69472003d08f1bb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:05.470696 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-9d8aba2e-5c0f-4eba-94f7-932081ecdd3b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:05.474497 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-774d1017-1062-48fb-919f-df0fc1ba754d tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] 10.222.0.17 "GET /compute/v2.1/servers/b3576570-0c74-42f9-ae44-ac9f049e980d" status: 200 len: 1408 microversion: 2.54 time: 0.243258 Jul 23 21:30:05.489644 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1970/4020] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:30:05 2022] GET /compute/v2.1/servers/b3576570-0c74-42f9-ae44-ac9f049e980d => generated 1408 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:30:05.497366 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9d8aba2e-5c0f-4eba-94f7-932081ecdd3b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:05.497847 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9d8aba2e-5c0f-4eba-94f7-932081ecdd3b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:05.500773 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9d8aba2e-5c0f-4eba-94f7-932081ecdd3b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:05.501385 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9d8aba2e-5c0f-4eba-94f7-932081ecdd3b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:05.520691 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f88bae44-f8a1-4dde-911e-4b9a3f305ad3 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:05.521636 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f88bae44-f8a1-4dde-911e-4b9a3f305ad3 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: d6770104-2850-4914-b129-c3dd3544bfb6] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:05.536131 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f88bae44-f8a1-4dde-911e-4b9a3f305ad3 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:05.540671 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f88bae44-f8a1-4dde-911e-4b9a3f305ad3 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:05.546284 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f88bae44-f8a1-4dde-911e-4b9a3f305ad3 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:05.547061 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f88bae44-f8a1-4dde-911e-4b9a3f305ad3 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:05.978169 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-9d8aba2e-5c0f-4eba-94f7-932081ecdd3b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:06.000560 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-9d8aba2e-5c0f-4eba-94f7-932081ecdd3b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:06.002644 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-9d8aba2e-5c0f-4eba-94f7-932081ecdd3b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:06.009057 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-9d8aba2e-5c0f-4eba-94f7-932081ecdd3b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.545882 Jul 23 21:30:06.011276 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2051/4021] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:30:05 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:30:06.463775 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f88bae44-f8a1-4dde-911e-4b9a3f305ad3 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:06.477529 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f88bae44-f8a1-4dde-911e-4b9a3f305ad3 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/d6770104-2850-4914-b129-c3dd3544bfb6" status: 200 len: 1328 microversion: 2.1 time: 0.961392 Jul 23 21:30:06.480079 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1971/4022] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:30:05 2022] GET /compute/v2.1/servers/d6770104-2850-4914-b129-c3dd3544bfb6 => generated 1328 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:30:06.494961 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d06218f3-fcf0-4d00-b3dd-9c112b6b71a9 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:06.495589 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-d06218f3-fcf0-4d00-b3dd-9c112b6b71a9 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] [instance: b3576570-0c74-42f9-ae44-ac9f049e980d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:06.512996 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d06218f3-fcf0-4d00-b3dd-9c112b6b71a9 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:06.513426 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d06218f3-fcf0-4d00-b3dd-9c112b6b71a9 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:06.514355 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d06218f3-fcf0-4d00-b3dd-9c112b6b71a9 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:06.514837 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d06218f3-fcf0-4d00-b3dd-9c112b6b71a9 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:06.976755 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-d06218f3-fcf0-4d00-b3dd-9c112b6b71a9 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadc4fac778e4eaf905a3fbc26fbb090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e751dfada40945a69472003d08f1bb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:06.986841 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-bfe904d7-3cdc-4a77-a077-2e3ba814b7cc req-949b71f1-fdcb-4f29-bdc3-398761fa3636 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6770104-2850-4914-b129-c3dd3544bfb6", "name": "network-vif-plugged", "status": "completed", "tag": "1cb4fef7-7cfe-4941-ae7f-b8aebe6f05b4"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:30:06.994117 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-d06218f3-fcf0-4d00-b3dd-9c112b6b71a9 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cadc4fac778e4eaf905a3fbc26fbb090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e751dfada40945a69472003d08f1bb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:06.995701 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-d06218f3-fcf0-4d00-b3dd-9c112b6b71a9 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cadc4fac778e4eaf905a3fbc26fbb090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e751dfada40945a69472003d08f1bb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:06.996972 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-d06218f3-fcf0-4d00-b3dd-9c112b6b71a9 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] 10.222.0.17 "GET /compute/v2.1/servers/b3576570-0c74-42f9-ae44-ac9f049e980d" status: 200 len: 1408 microversion: 2.54 time: 0.506255 Jul 23 21:30:06.998384 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2052/4023] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:30:06 2022] GET /compute/v2.1/servers/b3576570-0c74-42f9-ae44-ac9f049e980d => generated 1408 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:30:07.011033 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-bfe904d7-3cdc-4a77-a077-2e3ba814b7cc req-949b71f1-fdcb-4f29-bdc3-398761fa3636 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:07.011489 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-bfe904d7-3cdc-4a77-a077-2e3ba814b7cc req-949b71f1-fdcb-4f29-bdc3-398761fa3636 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:07.029627 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-28afcfdd-0b21-482a-8d27-2705ca5624fc tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:07.030585 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-28afcfdd-0b21-482a-8d27-2705ca5624fc tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:07.041016 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-28afcfdd-0b21-482a-8d27-2705ca5624fc tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:07.043250 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-28afcfdd-0b21-482a-8d27-2705ca5624fc tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:07.043752 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-bfe904d7-3cdc-4a77-a077-2e3ba814b7cc req-949b71f1-fdcb-4f29-bdc3-398761fa3636 service nova] Creating event network-vif-plugged:1cb4fef7-7cfe-4941-ae7f-b8aebe6f05b4 for instance d6770104-2850-4914-b129-c3dd3544bfb6 on nch2-master-1 Jul 23 21:30:07.048184 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-28afcfdd-0b21-482a-8d27-2705ca5624fc tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:07.049058 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-28afcfdd-0b21-482a-8d27-2705ca5624fc tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:07.053709 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-bfe904d7-3cdc-4a77-a077-2e3ba814b7cc req-949b71f1-fdcb-4f29-bdc3-398761fa3636 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075584 Jul 23 21:30:07.057567 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1972/4024] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:30:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Jul 23 21:30:07.348498 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-28afcfdd-0b21-482a-8d27-2705ca5624fc tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:07.364629 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-28afcfdd-0b21-482a-8d27-2705ca5624fc tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:07.368610 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-28afcfdd-0b21-482a-8d27-2705ca5624fc tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:07.377229 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-28afcfdd-0b21-482a-8d27-2705ca5624fc tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.352052 Jul 23 21:30:07.377848 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2053/4025] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:30:07 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:30:07.500033 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-22c98089-e307-43e5-8bb1-a139cc17f03f tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:07.500914 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-22c98089-e307-43e5-8bb1-a139cc17f03f tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: d6770104-2850-4914-b129-c3dd3544bfb6] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:07.552643 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-22c98089-e307-43e5-8bb1-a139cc17f03f tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:07.553227 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-22c98089-e307-43e5-8bb1-a139cc17f03f tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:07.554152 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-22c98089-e307-43e5-8bb1-a139cc17f03f tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:07.554821 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-22c98089-e307-43e5-8bb1-a139cc17f03f tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:08.015519 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a4a6c0d0-0457-4eae-aa55-667becbf963d tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:08.016816 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-a4a6c0d0-0457-4eae-aa55-667becbf963d tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] [instance: b3576570-0c74-42f9-ae44-ac9f049e980d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:08.033123 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-22c98089-e307-43e5-8bb1-a139cc17f03f tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:08.033398 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a4a6c0d0-0457-4eae-aa55-667becbf963d tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:08.033932 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a4a6c0d0-0457-4eae-aa55-667becbf963d tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:08.043745 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a4a6c0d0-0457-4eae-aa55-667becbf963d tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:08.045221 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a4a6c0d0-0457-4eae-aa55-667becbf963d tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:08.057210 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-22c98089-e307-43e5-8bb1-a139cc17f03f tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/d6770104-2850-4914-b129-c3dd3544bfb6" status: 200 len: 1328 microversion: 2.1 time: 0.565094 Jul 23 21:30:08.058083 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1973/4026] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:30:07 2022] GET /compute/v2.1/servers/d6770104-2850-4914-b129-c3dd3544bfb6 => generated 1328 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:30:08.250516 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-a4a6c0d0-0457-4eae-aa55-667becbf963d tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadc4fac778e4eaf905a3fbc26fbb090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e751dfada40945a69472003d08f1bb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:08.260835 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-a4a6c0d0-0457-4eae-aa55-667becbf963d tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cadc4fac778e4eaf905a3fbc26fbb090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e751dfada40945a69472003d08f1bb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:08.263001 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-a4a6c0d0-0457-4eae-aa55-667becbf963d tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cadc4fac778e4eaf905a3fbc26fbb090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e751dfada40945a69472003d08f1bb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:08.265411 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-a4a6c0d0-0457-4eae-aa55-667becbf963d tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] 10.222.0.17 "GET /compute/v2.1/servers/b3576570-0c74-42f9-ae44-ac9f049e980d" status: 200 len: 1408 microversion: 2.54 time: 0.253365 Jul 23 21:30:08.266803 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2054/4027] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:30:08 2022] GET /compute/v2.1/servers/b3576570-0c74-42f9-ae44-ac9f049e980d => generated 1408 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:30:08.397347 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c4c7ccf9-5e69-4f85-a723-4aa4c0f28f93 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:08.398445 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-c4c7ccf9-5e69-4f85-a723-4aa4c0f28f93 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:08.399353 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8a66d9d4-ebd7-4eef-95f7-8f0919ec6313 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-100839358", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "networks": [{"uuid": "654a77ca-1e84-434d-8536-1fc3adb327d0"}]}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:30:08.420662 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c4c7ccf9-5e69-4f85-a723-4aa4c0f28f93 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:08.430951 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c4c7ccf9-5e69-4f85-a723-4aa4c0f28f93 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:08.433527 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c4c7ccf9-5e69-4f85-a723-4aa4c0f28f93 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:08.434422 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c4c7ccf9-5e69-4f85-a723-4aa4c0f28f93 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:08.499901 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-8a66d9d4-ebd7-4eef-95f7-8f0919ec6313 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] validate_networks() for [('654a77ca-1e84-434d-8536-1fc3adb327d0', None, None, None, None, None)] {{(pid=131320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:30:08.529020 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c4c7ccf9-5e69-4f85-a723-4aa4c0f28f93 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:08.539413 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c4c7ccf9-5e69-4f85-a723-4aa4c0f28f93 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:08.541145 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c4c7ccf9-5e69-4f85-a723-4aa4c0f28f93 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:08.542364 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-c4c7ccf9-5e69-4f85-a723-4aa4c0f28f93 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.149765 Jul 23 21:30:08.542926 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2055/4028] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:30:08 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:30:09.075078 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a879fa11-dacf-4163-bc82-5f4a9f96f7de tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:09.076596 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-a879fa11-dacf-4163-bc82-5f4a9f96f7de tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: d6770104-2850-4914-b129-c3dd3544bfb6] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:09.088216 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a879fa11-dacf-4163-bc82-5f4a9f96f7de tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:09.089636 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a879fa11-dacf-4163-bc82-5f4a9f96f7de tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:09.091883 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a879fa11-dacf-4163-bc82-5f4a9f96f7de tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:09.093967 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a879fa11-dacf-4163-bc82-5f4a9f96f7de tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:09.538901 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-8a66d9d4-ebd7-4eef-95f7-8f0919ec6313 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:30:09.545644 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-8a66d9d4-ebd7-4eef-95f7-8f0919ec6313 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:30:09.546501 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-8a66d9d4-ebd7-4eef-95f7-8f0919ec6313 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:30:09.547173 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-8a66d9d4-ebd7-4eef-95f7-8f0919ec6313 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:30:09.547980 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-8a66d9d4-ebd7-4eef-95f7-8f0919ec6313 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:30:09.562898 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8a66d9d4-ebd7-4eef-95f7-8f0919ec6313 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:09.563879 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8a66d9d4-ebd7-4eef-95f7-8f0919ec6313 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:09.565360 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8a66d9d4-ebd7-4eef-95f7-8f0919ec6313 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:09.568287 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8a66d9d4-ebd7-4eef-95f7-8f0919ec6313 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:09.619563 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-8a66d9d4-ebd7-4eef-95f7-8f0919ec6313 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Getting quotas for project d70f6c96e1ad484aa3207fc01a12d519. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:30:09.634144 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-8a66d9d4-ebd7-4eef-95f7-8f0919ec6313 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Getting quotas for user 6ca9644a73d9468aa39b21548a72bded and project d70f6c96e1ad484aa3207fc01a12d519. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:30:09.669358 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8a66d9d4-ebd7-4eef-95f7-8f0919ec6313 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Going to run 1 instances... {{(pid=131320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:30:09.673179 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8a66d9d4-ebd7-4eef-95f7-8f0919ec6313 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:30:09.779528 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8a66d9d4-ebd7-4eef-95f7-8f0919ec6313 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.577469 Jul 23 21:30:09.782654 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1974/4029] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:30:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1581 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 23 21:30:09.795656 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e2fd6249-18f0-48ba-8290-fff31bb8dc40 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:09.797444 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e2fd6249-18f0-48ba-8290-fff31bb8dc40 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] [instance: b3576570-0c74-42f9-ae44-ac9f049e980d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:09.817149 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e2fd6249-18f0-48ba-8290-fff31bb8dc40 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:09.817929 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e2fd6249-18f0-48ba-8290-fff31bb8dc40 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:09.819358 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e2fd6249-18f0-48ba-8290-fff31bb8dc40 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:09.822629 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e2fd6249-18f0-48ba-8290-fff31bb8dc40 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:09.932296 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-a879fa11-dacf-4163-bc82-5f4a9f96f7de tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:09.954725 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-a879fa11-dacf-4163-bc82-5f4a9f96f7de tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/d6770104-2850-4914-b129-c3dd3544bfb6" status: 200 len: 1510 microversion: 2.1 time: 0.882403 Jul 23 21:30:09.961217 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2056/4030] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:30:09 2022] GET /compute/v2.1/servers/d6770104-2850-4914-b129-c3dd3544bfb6 => generated 1510 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:30:09.994775 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-1b8aa964-4d53-4dc1-abca-92f4f1d30c87 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:09.999656 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-1b8aa964-4d53-4dc1-abca-92f4f1d30c87 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:10.051055 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1b8aa964-4d53-4dc1-abca-92f4f1d30c87 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:10.062135 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1b8aa964-4d53-4dc1-abca-92f4f1d30c87 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:10.064575 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1b8aa964-4d53-4dc1-abca-92f4f1d30c87 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:10.076064 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1b8aa964-4d53-4dc1-abca-92f4f1d30c87 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:10.084523 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e2fd6249-18f0-48ba-8290-fff31bb8dc40 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadc4fac778e4eaf905a3fbc26fbb090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e751dfada40945a69472003d08f1bb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:10.095690 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e2fd6249-18f0-48ba-8290-fff31bb8dc40 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cadc4fac778e4eaf905a3fbc26fbb090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e751dfada40945a69472003d08f1bb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:10.105926 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e2fd6249-18f0-48ba-8290-fff31bb8dc40 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cadc4fac778e4eaf905a3fbc26fbb090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e751dfada40945a69472003d08f1bb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:10.107209 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e2fd6249-18f0-48ba-8290-fff31bb8dc40 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] 10.222.0.17 "GET /compute/v2.1/servers/b3576570-0c74-42f9-ae44-ac9f049e980d" status: 200 len: 1408 microversion: 2.54 time: 0.323366 Jul 23 21:30:10.107787 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1975/4031] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:30:09 2022] GET /compute/v2.1/servers/b3576570-0c74-42f9-ae44-ac9f049e980d => generated 1408 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:30:10.124501 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9b27bbde-507f-46a0-afab-74f9cbba3df2 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:10.125297 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-9b27bbde-507f-46a0-afab-74f9cbba3df2 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:10.279873 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-1b8aa964-4d53-4dc1-abca-92f4f1d30c87 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:10.295452 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-1b8aa964-4d53-4dc1-abca-92f4f1d30c87 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:10.302119 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-1b8aa964-4d53-4dc1-abca-92f4f1d30c87 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:10.304203 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-1b8aa964-4d53-4dc1-abca-92f4f1d30c87 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.340635 Jul 23 21:30:10.306513 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2057/4032] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:30:09 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:30:10.317072 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-7553c35c-0a27-4bd0-b7fe-d3bdb5507ce0 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:10.320535 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-7553c35c-0a27-4bd0-b7fe-d3bdb5507ce0 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: d6770104-2850-4914-b129-c3dd3544bfb6] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:10.336980 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7553c35c-0a27-4bd0-b7fe-d3bdb5507ce0 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:10.337724 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7553c35c-0a27-4bd0-b7fe-d3bdb5507ce0 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:10.339884 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7553c35c-0a27-4bd0-b7fe-d3bdb5507ce0 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:10.343583 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7553c35c-0a27-4bd0-b7fe-d3bdb5507ce0 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:10.395923 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=100 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:30:10.434363 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-9b27bbde-507f-46a0-afab-74f9cbba3df2 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:10.445124 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9b27bbde-507f-46a0-afab-74f9cbba3df2 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1216 microversion: 2.1 time: 0.333838 Jul 23 21:30:10.446417 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1976/4033] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:30:10 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1216 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:30:11.005233 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-7553c35c-0a27-4bd0-b7fe-d3bdb5507ce0 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:11.015668 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-7553c35c-0a27-4bd0-b7fe-d3bdb5507ce0 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/d6770104-2850-4914-b129-c3dd3544bfb6" status: 200 len: 1510 microversion: 2.1 time: 0.706554 Jul 23 21:30:11.017072 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2058/4034] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:30:10 2022] GET /compute/v2.1/servers/d6770104-2850-4914-b129-c3dd3544bfb6 => generated 1510 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:30:11.037140 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ce2bfe20-88c7-475d-b965-d255eaf34f15 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:11.037694 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ce2bfe20-88c7-475d-b965-d255eaf34f15 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: d6770104-2850-4914-b129-c3dd3544bfb6] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:11.082148 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ce2bfe20-88c7-475d-b965-d255eaf34f15 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:11.084065 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ce2bfe20-88c7-475d-b965-d255eaf34f15 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:11.088074 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ce2bfe20-88c7-475d-b965-d255eaf34f15 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:11.089817 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ce2bfe20-88c7-475d-b965-d255eaf34f15 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:11.130627 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-abdd1b71-a0b6-4a2a-b153-c4c1c42ee687 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:11.131266 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-abdd1b71-a0b6-4a2a-b153-c4c1c42ee687 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] [instance: b3576570-0c74-42f9-ae44-ac9f049e980d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:11.142716 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-abdd1b71-a0b6-4a2a-b153-c4c1c42ee687 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:11.143187 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-abdd1b71-a0b6-4a2a-b153-c4c1c42ee687 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:11.143995 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-abdd1b71-a0b6-4a2a-b153-c4c1c42ee687 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:11.154966 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-abdd1b71-a0b6-4a2a-b153-c4c1c42ee687 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:11.207990 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ce2bfe20-88c7-475d-b965-d255eaf34f15 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: d6770104-2850-4914-b129-c3dd3544bfb6] Going to try to terminate instance {{(pid=131320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:30:11.356567 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-abdd1b71-a0b6-4a2a-b153-c4c1c42ee687 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadc4fac778e4eaf905a3fbc26fbb090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e751dfada40945a69472003d08f1bb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:11.376876 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-abdd1b71-a0b6-4a2a-b153-c4c1c42ee687 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cadc4fac778e4eaf905a3fbc26fbb090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e751dfada40945a69472003d08f1bb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:11.378478 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-abdd1b71-a0b6-4a2a-b153-c4c1c42ee687 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cadc4fac778e4eaf905a3fbc26fbb090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e751dfada40945a69472003d08f1bb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:11.400091 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-abdd1b71-a0b6-4a2a-b153-c4c1c42ee687 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] 10.222.0.17 "GET /compute/v2.1/servers/b3576570-0c74-42f9-ae44-ac9f049e980d" status: 200 len: 1408 microversion: 2.54 time: 0.253834 Jul 23 21:30:11.402819 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2059/4035] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:30:11 2022] GET /compute/v2.1/servers/b3576570-0c74-42f9-ae44-ac9f049e980d => generated 1408 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:30:11.423486 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-3225a393-b6a1-4f47-b7e5-905c18dd1064 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:11.424152 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-3225a393-b6a1-4f47-b7e5-905c18dd1064 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:11.459962 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3225a393-b6a1-4f47-b7e5-905c18dd1064 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:11.462326 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3225a393-b6a1-4f47-b7e5-905c18dd1064 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:11.463437 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3225a393-b6a1-4f47-b7e5-905c18dd1064 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:11.465506 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3225a393-b6a1-4f47-b7e5-905c18dd1064 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:11.654892 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ce2bfe20-88c7-475d-b965-d255eaf34f15 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d6770104-2850-4914-b129-c3dd3544bfb6" status: 204 len: 0 microversion: 2.1 time: 0.621172 Jul 23 21:30:11.662131 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1977/4036] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:30:11 2022] DELETE /compute/v2.1/servers/d6770104-2850-4914-b129-c3dd3544bfb6 => generated 0 bytes in 626 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:30:11.678175 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-31bda602-5c92-4d56-8dcc-33c70cbacaab tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:11.683444 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-3225a393-b6a1-4f47-b7e5-905c18dd1064 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:11.684770 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-31bda602-5c92-4d56-8dcc-33c70cbacaab tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:11.701294 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-3225a393-b6a1-4f47-b7e5-905c18dd1064 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:11.703768 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-3225a393-b6a1-4f47-b7e5-905c18dd1064 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:11.705018 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-3225a393-b6a1-4f47-b7e5-905c18dd1064 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.299995 Jul 23 21:30:11.705613 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2060/4037] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:30:11 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:30:11.710876 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ea714652-dedd-40b0-a0a9-6a584dfa8b7d tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:11.711490 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-ea714652-dedd-40b0-a0a9-6a584dfa8b7d tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: d6770104-2850-4914-b129-c3dd3544bfb6] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:11.716405 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-31bda602-5c92-4d56-8dcc-33c70cbacaab tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:11.717673 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-31bda602-5c92-4d56-8dcc-33c70cbacaab tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:11.720370 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ea714652-dedd-40b0-a0a9-6a584dfa8b7d tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:11.720837 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ea714652-dedd-40b0-a0a9-6a584dfa8b7d tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:11.721633 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ea714652-dedd-40b0-a0a9-6a584dfa8b7d tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:11.722520 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-31bda602-5c92-4d56-8dcc-33c70cbacaab tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:11.722661 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ea714652-dedd-40b0-a0a9-6a584dfa8b7d tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:11.726760 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-31bda602-5c92-4d56-8dcc-33c70cbacaab tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:11.943859 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-31bda602-5c92-4d56-8dcc-33c70cbacaab tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:11.963797 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-31bda602-5c92-4d56-8dcc-33c70cbacaab tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1268 microversion: 2.1 time: 0.297300 Jul 23 21:30:11.975588 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1978/4038] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:30:11 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1268 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:30:12.050895 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ea714652-dedd-40b0-a0a9-6a584dfa8b7d tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:12.075103 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-ea714652-dedd-40b0-a0a9-6a584dfa8b7d tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/d6770104-2850-4914-b129-c3dd3544bfb6" status: 200 len: 1516 microversion: 2.1 time: 0.368131 Jul 23 21:30:12.078957 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2061/4039] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:30:11 2022] GET /compute/v2.1/servers/d6770104-2850-4914-b129-c3dd3544bfb6 => generated 1516 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:30:12.422873 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6f18849e-5919-4d8f-93ed-3176bbb9e9fd tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:12.425470 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6f18849e-5919-4d8f-93ed-3176bbb9e9fd tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] [instance: b3576570-0c74-42f9-ae44-ac9f049e980d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:12.448664 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6f18849e-5919-4d8f-93ed-3176bbb9e9fd tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:12.449128 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6f18849e-5919-4d8f-93ed-3176bbb9e9fd tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:12.449967 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6f18849e-5919-4d8f-93ed-3176bbb9e9fd tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:12.450407 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6f18849e-5919-4d8f-93ed-3176bbb9e9fd tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:12.694633 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6f18849e-5919-4d8f-93ed-3176bbb9e9fd tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadc4fac778e4eaf905a3fbc26fbb090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e751dfada40945a69472003d08f1bb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:12.708663 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6f18849e-5919-4d8f-93ed-3176bbb9e9fd tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cadc4fac778e4eaf905a3fbc26fbb090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e751dfada40945a69472003d08f1bb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:12.712597 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6f18849e-5919-4d8f-93ed-3176bbb9e9fd tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cadc4fac778e4eaf905a3fbc26fbb090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e751dfada40945a69472003d08f1bb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:12.718028 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6f18849e-5919-4d8f-93ed-3176bbb9e9fd tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] 10.222.0.17 "GET /compute/v2.1/servers/b3576570-0c74-42f9-ae44-ac9f049e980d" status: 200 len: 1408 microversion: 2.54 time: 0.300674 Jul 23 21:30:12.719078 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1979/4040] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:30:12 2022] GET /compute/v2.1/servers/b3576570-0c74-42f9-ae44-ac9f049e980d => generated 1408 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:30:12.724585 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ab92927f-ca70-4c89-a963-7f9286a31042 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:12.725845 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-ab92927f-ca70-4c89-a963-7f9286a31042 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:12.736773 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:30:12.741093 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ab92927f-ca70-4c89-a963-7f9286a31042 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:12.743304 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ab92927f-ca70-4c89-a963-7f9286a31042 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:12.746603 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ab92927f-ca70-4c89-a963-7f9286a31042 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:12.747279 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ab92927f-ca70-4c89-a963-7f9286a31042 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:12.981195 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f8338419-62e6-4d7b-8dd9-05343b3473e3 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:12.981833 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f8338419-62e6-4d7b-8dd9-05343b3473e3 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:12.999292 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f8338419-62e6-4d7b-8dd9-05343b3473e3 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:13.001971 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f8338419-62e6-4d7b-8dd9-05343b3473e3 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:13.002833 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f8338419-62e6-4d7b-8dd9-05343b3473e3 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:13.003290 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f8338419-62e6-4d7b-8dd9-05343b3473e3 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:13.036900 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ab92927f-ca70-4c89-a963-7f9286a31042 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:13.058225 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ab92927f-ca70-4c89-a963-7f9286a31042 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:13.061926 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ab92927f-ca70-4c89-a963-7f9286a31042 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:13.064258 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-ab92927f-ca70-4c89-a963-7f9286a31042 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.343839 Jul 23 21:30:13.068749 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2062/4041] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:30:12 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:30:13.143338 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-73642de5-f3dd-47e9-a8bd-255ec24f999f tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:13.146937 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-73642de5-f3dd-47e9-a8bd-255ec24f999f tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: d6770104-2850-4914-b129-c3dd3544bfb6] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:13.181748 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-73642de5-f3dd-47e9-a8bd-255ec24f999f tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:13.191621 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-73642de5-f3dd-47e9-a8bd-255ec24f999f tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:13.214074 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-73642de5-f3dd-47e9-a8bd-255ec24f999f tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:13.217950 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-73642de5-f3dd-47e9-a8bd-255ec24f999f tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:13.356517 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f8338419-62e6-4d7b-8dd9-05343b3473e3 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:13.369702 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f8338419-62e6-4d7b-8dd9-05343b3473e3 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1274 microversion: 2.1 time: 0.392782 Jul 23 21:30:13.382642 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1980/4042] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:30:12 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1274 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:30:13.738840 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-49c4ed27-1f81-4207-a5c6-8cf9c8e36535 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:13.740180 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-49c4ed27-1f81-4207-a5c6-8cf9c8e36535 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] [instance: b3576570-0c74-42f9-ae44-ac9f049e980d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:13.758160 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-49c4ed27-1f81-4207-a5c6-8cf9c8e36535 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:13.762629 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-49c4ed27-1f81-4207-a5c6-8cf9c8e36535 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:13.763728 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-49c4ed27-1f81-4207-a5c6-8cf9c8e36535 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:13.765167 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-49c4ed27-1f81-4207-a5c6-8cf9c8e36535 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:13.776383 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:30:13.878990 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-73642de5-f3dd-47e9-a8bd-255ec24f999f tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:13.895188 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-73642de5-f3dd-47e9-a8bd-255ec24f999f tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/d6770104-2850-4914-b129-c3dd3544bfb6" status: 200 len: 1516 microversion: 2.1 time: 0.784795 Jul 23 21:30:13.899095 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2063/4043] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:30:13 2022] GET /compute/v2.1/servers/d6770104-2850-4914-b129-c3dd3544bfb6 => generated 1516 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:30:14.087085 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-1a33cddf-fda5-484b-8b6d-36ff4adadda7 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:14.088178 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-1a33cddf-fda5-484b-8b6d-36ff4adadda7 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:14.099291 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1a33cddf-fda5-484b-8b6d-36ff4adadda7 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:14.101290 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1a33cddf-fda5-484b-8b6d-36ff4adadda7 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:14.105634 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1a33cddf-fda5-484b-8b6d-36ff4adadda7 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:14.106489 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1a33cddf-fda5-484b-8b6d-36ff4adadda7 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:14.268521 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-1a33cddf-fda5-484b-8b6d-36ff4adadda7 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:14.284793 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-1a33cddf-fda5-484b-8b6d-36ff4adadda7 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:14.286326 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-1a33cddf-fda5-484b-8b6d-36ff4adadda7 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:14.287569 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-1a33cddf-fda5-484b-8b6d-36ff4adadda7 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.205113 Jul 23 21:30:14.296767 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2064/4044] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:30:14 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:30:14.393589 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-9a8131cb-5d7e-41dc-8788-2369ae61ea75 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:14.394520 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-9a8131cb-5d7e-41dc-8788-2369ae61ea75 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:14.402694 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9a8131cb-5d7e-41dc-8788-2369ae61ea75 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:14.404093 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9a8131cb-5d7e-41dc-8788-2369ae61ea75 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:14.406710 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9a8131cb-5d7e-41dc-8788-2369ae61ea75 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:14.409002 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9a8131cb-5d7e-41dc-8788-2369ae61ea75 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:14.625815 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-49c4ed27-1f81-4207-a5c6-8cf9c8e36535 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadc4fac778e4eaf905a3fbc26fbb090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e751dfada40945a69472003d08f1bb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:14.635550 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-49c4ed27-1f81-4207-a5c6-8cf9c8e36535 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cadc4fac778e4eaf905a3fbc26fbb090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e751dfada40945a69472003d08f1bb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:14.643634 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-49c4ed27-1f81-4207-a5c6-8cf9c8e36535 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cadc4fac778e4eaf905a3fbc26fbb090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e751dfada40945a69472003d08f1bb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:14.645157 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-49c4ed27-1f81-4207-a5c6-8cf9c8e36535 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] 10.222.0.17 "GET /compute/v2.1/servers/b3576570-0c74-42f9-ae44-ac9f049e980d" status: 200 len: 1426 microversion: 2.54 time: 0.911710 Jul 23 21:30:14.648230 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1981/4045] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:30:13 2022] GET /compute/v2.1/servers/b3576570-0c74-42f9-ae44-ac9f049e980d => generated 1426 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:30:14.913177 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-fe7498eb-f490-4149-a616-1efa243f89bd tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:14.913819 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-fe7498eb-f490-4149-a616-1efa243f89bd tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: d6770104-2850-4914-b129-c3dd3544bfb6] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:14.922565 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fe7498eb-f490-4149-a616-1efa243f89bd tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:14.923139 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fe7498eb-f490-4149-a616-1efa243f89bd tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:14.923810 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fe7498eb-f490-4149-a616-1efa243f89bd tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:14.924250 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fe7498eb-f490-4149-a616-1efa243f89bd tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:15.139072 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-9a8131cb-5d7e-41dc-8788-2369ae61ea75 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:15.147933 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-9a8131cb-5d7e-41dc-8788-2369ae61ea75 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1274 microversion: 2.1 time: 0.759775 Jul 23 21:30:15.168701 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2065/4046] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:30:14 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1274 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:30:15.310991 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-9469d607-1d54-4927-ae2c-16dad9299699 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:15.312076 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-9469d607-1d54-4927-ae2c-16dad9299699 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:15.345137 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9469d607-1d54-4927-ae2c-16dad9299699 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:15.347629 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9469d607-1d54-4927-ae2c-16dad9299699 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:15.349664 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9469d607-1d54-4927-ae2c-16dad9299699 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:15.351270 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9469d607-1d54-4927-ae2c-16dad9299699 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:15.527278 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-fe7498eb-f490-4149-a616-1efa243f89bd tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:15.544087 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-fe7498eb-f490-4149-a616-1efa243f89bd tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/d6770104-2850-4914-b129-c3dd3544bfb6" status: 200 len: 1516 microversion: 2.1 time: 0.634182 Jul 23 21:30:15.545906 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1982/4047] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:30:14 2022] GET /compute/v2.1/servers/d6770104-2850-4914-b129-c3dd3544bfb6 => generated 1516 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:30:15.664826 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-abdbd915-5000-406f-9671-07ee38a09636 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:15.665721 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-abdbd915-5000-406f-9671-07ee38a09636 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] [instance: b3576570-0c74-42f9-ae44-ac9f049e980d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:15.675999 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-abdbd915-5000-406f-9671-07ee38a09636 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:15.680055 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-abdbd915-5000-406f-9671-07ee38a09636 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:15.681542 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-abdbd915-5000-406f-9671-07ee38a09636 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:15.682173 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-abdbd915-5000-406f-9671-07ee38a09636 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:16.056533 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-abdbd915-5000-406f-9671-07ee38a09636 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadc4fac778e4eaf905a3fbc26fbb090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e751dfada40945a69472003d08f1bb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:16.081903 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-abdbd915-5000-406f-9671-07ee38a09636 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cadc4fac778e4eaf905a3fbc26fbb090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e751dfada40945a69472003d08f1bb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:16.103696 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-abdbd915-5000-406f-9671-07ee38a09636 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cadc4fac778e4eaf905a3fbc26fbb090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e751dfada40945a69472003d08f1bb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:16.104956 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-abdbd915-5000-406f-9671-07ee38a09636 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] 10.222.0.17 "GET /compute/v2.1/servers/b3576570-0c74-42f9-ae44-ac9f049e980d" status: 200 len: 1414 microversion: 2.54 time: 0.444240 Jul 23 21:30:16.105536 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1983/4048] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:30:15 2022] GET /compute/v2.1/servers/b3576570-0c74-42f9-ae44-ac9f049e980d => generated 1414 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:30:16.137084 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-9469d607-1d54-4927-ae2c-16dad9299699 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:16.155814 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-9469d607-1d54-4927-ae2c-16dad9299699 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:16.161457 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-9469d607-1d54-4927-ae2c-16dad9299699 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:16.168707 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-9469d607-1d54-4927-ae2c-16dad9299699 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.862404 Jul 23 21:30:16.186765 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2066/4049] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:30:15 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:30:16.194923 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-8ada380f-62c0-4f8f-92fe-254fb116c59e req-1d839788-7ab7-40a2-b72a-85813087bde8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6770104-2850-4914-b129-c3dd3544bfb6", "name": "network-vif-deleted", "tag": "1cb4fef7-7cfe-4941-ae7f-b8aebe6f05b4"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:30:16.199746 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-cb148fea-d732-4255-919b-7ead226156f7 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:16.205043 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-cb148fea-d732-4255-919b-7ead226156f7 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:16.219992 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cb148fea-d732-4255-919b-7ead226156f7 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:16.222475 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cb148fea-d732-4255-919b-7ead226156f7 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:16.224618 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cb148fea-d732-4255-919b-7ead226156f7 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:16.227491 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cb148fea-d732-4255-919b-7ead226156f7 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:16.246260 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-8ada380f-62c0-4f8f-92fe-254fb116c59e req-1d839788-7ab7-40a2-b72a-85813087bde8 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:16.251614 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-8ada380f-62c0-4f8f-92fe-254fb116c59e req-1d839788-7ab7-40a2-b72a-85813087bde8 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:16.300889 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-8ada380f-62c0-4f8f-92fe-254fb116c59e req-1d839788-7ab7-40a2-b72a-85813087bde8 service nova] Creating event network-vif-deleted:1cb4fef7-7cfe-4941-ae7f-b8aebe6f05b4 for instance d6770104-2850-4914-b129-c3dd3544bfb6 on nch2-master-1 Jul 23 21:30:16.329416 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-8ada380f-62c0-4f8f-92fe-254fb116c59e req-1d839788-7ab7-40a2-b72a-85813087bde8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.184958 Jul 23 21:30:16.333244 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1984/4050] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:30:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:30:16.561457 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f4eaaf20-31d9-4b02-8d2f-aa81fea8a763 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:16.563934 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f4eaaf20-31d9-4b02-8d2f-aa81fea8a763 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: d6770104-2850-4914-b129-c3dd3544bfb6] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:16.579674 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f4eaaf20-31d9-4b02-8d2f-aa81fea8a763 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:16.585123 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f4eaaf20-31d9-4b02-8d2f-aa81fea8a763 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:16.587905 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f4eaaf20-31d9-4b02-8d2f-aa81fea8a763 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:16.588591 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f4eaaf20-31d9-4b02-8d2f-aa81fea8a763 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:16.729550 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f4eaaf20-31d9-4b02-8d2f-aa81fea8a763 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:16.730031 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f4eaaf20-31d9-4b02-8d2f-aa81fea8a763 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:16.730498 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.objects.instance [None req-f4eaaf20-31d9-4b02-8d2f-aa81fea8a763 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lazy-loading 'fault' on Instance uuid d6770104-2850-4914-b129-c3dd3544bfb6 {{(pid=131320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:30:17.070586 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f4eaaf20-31d9-4b02-8d2f-aa81fea8a763 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:17.080178 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f4eaaf20-31d9-4b02-8d2f-aa81fea8a763 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/d6770104-2850-4914-b129-c3dd3544bfb6" status: 200 len: 1318 microversion: 2.1 time: 0.523122 Jul 23 21:30:17.082652 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1985/4051] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:30:16 2022] GET /compute/v2.1/servers/d6770104-2850-4914-b129-c3dd3544bfb6 => generated 1318 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:30:17.125045 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b1f18498-6976-4d70-8a01-f058c3cdef1a tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:17.126291 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b1f18498-6976-4d70-8a01-f058c3cdef1a tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] [instance: b3576570-0c74-42f9-ae44-ac9f049e980d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:17.135399 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b1f18498-6976-4d70-8a01-f058c3cdef1a tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:17.139028 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b1f18498-6976-4d70-8a01-f058c3cdef1a tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:17.140289 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b1f18498-6976-4d70-8a01-f058c3cdef1a tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:17.141541 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b1f18498-6976-4d70-8a01-f058c3cdef1a tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:17.212535 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-cb148fea-d732-4255-919b-7ead226156f7 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:17.222660 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-cb148fea-d732-4255-919b-7ead226156f7 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1316 microversion: 2.1 time: 1.034325 Jul 23 21:30:17.236090 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2067/4052] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:30:16 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1316 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:30:17.251306 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-4b09e0ff-43d2-40f8-bf31-0fae01b81d78 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:17.262940 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-4b09e0ff-43d2-40f8-bf31-0fae01b81d78 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:17.283455 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4b09e0ff-43d2-40f8-bf31-0fae01b81d78 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:17.285600 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4b09e0ff-43d2-40f8-bf31-0fae01b81d78 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:17.287394 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4b09e0ff-43d2-40f8-bf31-0fae01b81d78 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:17.289543 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4b09e0ff-43d2-40f8-bf31-0fae01b81d78 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:17.527084 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-4b09e0ff-43d2-40f8-bf31-0fae01b81d78 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:17.552543 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-4b09e0ff-43d2-40f8-bf31-0fae01b81d78 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:17.557308 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-4b09e0ff-43d2-40f8-bf31-0fae01b81d78 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:17.571465 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-4b09e0ff-43d2-40f8-bf31-0fae01b81d78 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.333964 Jul 23 21:30:17.572333 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2068/4053] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:30:17 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:30:17.939010 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b1f18498-6976-4d70-8a01-f058c3cdef1a tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadc4fac778e4eaf905a3fbc26fbb090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e751dfada40945a69472003d08f1bb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:17.952814 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b1f18498-6976-4d70-8a01-f058c3cdef1a tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cadc4fac778e4eaf905a3fbc26fbb090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e751dfada40945a69472003d08f1bb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:17.960408 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b1f18498-6976-4d70-8a01-f058c3cdef1a tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cadc4fac778e4eaf905a3fbc26fbb090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e751dfada40945a69472003d08f1bb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:17.961930 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b1f18498-6976-4d70-8a01-f058c3cdef1a tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] 10.222.0.17 "GET /compute/v2.1/servers/b3576570-0c74-42f9-ae44-ac9f049e980d" status: 200 len: 1399 microversion: 2.54 time: 0.840991 Jul 23 21:30:17.969819 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1986/4054] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:30:17 2022] GET /compute/v2.1/servers/b3576570-0c74-42f9-ae44-ac9f049e980d => generated 1399 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:30:17.991139 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-1ee15a07-2d71-4255-bbbe-832e1c9711d9 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Calling method '.version_select at 0x7f0b470d3310>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:18.054420 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-1ee15a07-2d71-4255-bbbe-832e1c9711d9 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-480804347" status: 204 len: 0 microversion: 2.54 time: 0.071017 Jul 23 21:30:18.057907 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2069/4055] 10.222.0.17 () {60 vars in 1315 bytes} [Sat Jul 23 21:30:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-480804347 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 23 21:30:18.072322 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-fb276834-7905-40be-8813-1bca549eb519 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:18.072878 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-fb276834-7905-40be-8813-1bca549eb519 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] [instance: b3576570-0c74-42f9-ae44-ac9f049e980d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:18.081632 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fb276834-7905-40be-8813-1bca549eb519 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:18.084544 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fb276834-7905-40be-8813-1bca549eb519 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:18.086089 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fb276834-7905-40be-8813-1bca549eb519 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:18.089409 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fb276834-7905-40be-8813-1bca549eb519 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:18.097675 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e04eade9-0e11-4672-a1f9-aad744e1fe0f tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:18.098487 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-e04eade9-0e11-4672-a1f9-aad744e1fe0f tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: d6770104-2850-4914-b129-c3dd3544bfb6] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:18.116872 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e04eade9-0e11-4672-a1f9-aad744e1fe0f tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:18.117364 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e04eade9-0e11-4672-a1f9-aad744e1fe0f tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:18.118241 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e04eade9-0e11-4672-a1f9-aad744e1fe0f tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:18.118689 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e04eade9-0e11-4672-a1f9-aad744e1fe0f tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:18.175205 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-e04eade9-0e11-4672-a1f9-aad744e1fe0f tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] HTTP exception thrown: Instance d6770104-2850-4914-b129-c3dd3544bfb6 could not be found. Jul 23 21:30:18.184795 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e04eade9-0e11-4672-a1f9-aad744e1fe0f tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Request method failure captured: Jul 23 21:30:18.184795 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/servers/d6770104-2850-4914-b129-c3dd3544bfb6 HTTP/1.1 Jul 23 21:30:18.184795 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:30:18.184795 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:30:18.184795 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:30:18.184795 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:30:18.184795 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:30:18.184795 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:30:18.184795 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:30:18.184795 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:30:18.184795 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GgexSaJTA-FXaV5LcqTAteOVESwOg7zac7nwUa59CGOHDwwWd7w7HKC8R65F9X48OwLZ_a8UsJYui6X5BG5uL_WJC-ysEg9nxrojp43TnKgPHTkujcdOw9VWLxqM9CE8dPwhawUMo8jE8x_rLu-o0j9Xf_QveShH-OlX4BIDLcYoyo Jul 23 21:30:18.184795 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:30:18.184795 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:30:18.184795 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:30:18.184795 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:30:18.184795 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:30:18.184795 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:30:18.184795 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 1890022bd460485dae0ea94b152a6746 Jul 23 21:30:18.184795 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ServersTestJSON-1141465764 Jul 23 21:30:18.184795 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:30:18.184795 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:30:18.184795 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1890022bd460485dae0ea94b152a6746"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1890022bd460485dae0ea94b152a6746"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1890022bd460485dae0ea94b152a6746", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1890022bd460485dae0ea94b152a6746"}]}] Jul 23 21:30:18.184795 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ServersTestJSON-1141465764 Jul 23 21:30:18.184795 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 1890022bd460485dae0ea94b152a6746 Jul 23 21:30:18.184795 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ServersTestJSON-1141465764 Jul 23 21:30:18.184795 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ServersTestJSON-1141465764-project Jul 23 21:30:18.184795 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:30:18.184795 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:30:18.184795 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 5efda1c40f494592bf1e6af1add120f3 Jul 23 21:30:18.184795 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ServersTestJSON-1141465764-project Jul 23 21:30:18.184795 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:30:18.184795 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance d6770104-2850-4914-b129-c3dd3544bfb6 could not be found. Jul 23 21:30:18.184795 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': 'd6770104-2850-4914-b129-c3dd3544bfb6'} Jul 23 21:30:18.184795 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:30:18.184795 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:30:18.184795 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:30:18.184795 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:30:18.184795 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:30:18.184795 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:30:18.184795 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:30:18.184795 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:30:18.184795 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:30:18.184795 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:30:18.184795 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6770104-2850-4914-b129-c3dd3544bfb6 could not be found. Jul 23 21:30:18.184795 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:30:18.184795 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:30:18.184795 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:30:18.184795 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:30:18.184795 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:30:18.184795 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:30:18.184795 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:30:18.184795 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:30:18.184795 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:30:18.184795 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:30:18.184795 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:30:18.184795 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:30:18.184795 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:30:18.184795 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:30:18.184795 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:30:18.184795 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:30:18.184795 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6770104-2850-4914-b129-c3dd3544bfb6 could not be found. Jul 23 21:30:18.184795 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:30:18.184795 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:30:18.184795 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:30:18.184795 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:30:18.188289 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:30:18.188289 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:30:18.188289 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:30:18.188289 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:30:18.188289 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6770104-2850-4914-b129-c3dd3544bfb6 could not be found. Jul 23 21:30:18.188289 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:30:18.188289 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e04eade9-0e11-4672-a1f9-aad744e1fe0f tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Returning 404 to user: Instance d6770104-2850-4914-b129-c3dd3544bfb6 could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:30:18.190021 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-e04eade9-0e11-4672-a1f9-aad744e1fe0f tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/d6770104-2850-4914-b129-c3dd3544bfb6" status: 404 len: 111 microversion: 2.1 time: 0.095407 Jul 23 21:30:18.190631 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2070/4056] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:30:18 2022] GET /compute/v2.1/servers/d6770104-2850-4914-b129-c3dd3544bfb6 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 23 21:30:18.210053 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-fb276834-7905-40be-8813-1bca549eb519 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] [instance: b3576570-0c74-42f9-ae44-ac9f049e980d] Going to try to terminate instance {{(pid=131320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:30:18.211617 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-104a2b23-3dd1-4a9b-b1bf-0362b7f93026 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '.version_select at 0x7f0b59b28a60>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:18.252245 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-104a2b23-3dd1-4a9b-b1bf-0362b7f93026 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-key-581193143" status: 202 len: 0 microversion: 2.1 time: 0.056540 Jul 23 21:30:18.255766 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2071/4057] 10.222.0.17 () {58 vars in 1205 bytes} [Sat Jul 23 21:30:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-581193143 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:30:18.271167 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-63ea6e03-6085-4cce-abee-bd3a954ac37c tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:18.272050 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-63ea6e03-6085-4cce-abee-bd3a954ac37c tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:18.301257 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-63ea6e03-6085-4cce-abee-bd3a954ac37c tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:18.304176 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-63ea6e03-6085-4cce-abee-bd3a954ac37c tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:18.307624 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-63ea6e03-6085-4cce-abee-bd3a954ac37c tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:18.308284 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-63ea6e03-6085-4cce-abee-bd3a954ac37c tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:18.466916 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-fb276834-7905-40be-8813-1bca549eb519 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] 10.222.0.17 "DELETE /compute/v2.1/servers/b3576570-0c74-42f9-ae44-ac9f049e980d" status: 204 len: 0 microversion: 2.54 time: 0.398181 Jul 23 21:30:18.467704 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1987/4058] 10.222.0.17 () {60 vars in 1279 bytes} [Sat Jul 23 21:30:18 2022] DELETE /compute/v2.1/servers/b3576570-0c74-42f9-ae44-ac9f049e980d => generated 0 bytes in 400 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 23 21:30:18.478736 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d51eb723-dabc-4a20-b940-7f5de055e581 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:18.479669 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d51eb723-dabc-4a20-b940-7f5de055e581 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] [instance: b3576570-0c74-42f9-ae44-ac9f049e980d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:18.494617 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d51eb723-dabc-4a20-b940-7f5de055e581 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:18.506427 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d51eb723-dabc-4a20-b940-7f5de055e581 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:18.507519 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d51eb723-dabc-4a20-b940-7f5de055e581 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:18.507984 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d51eb723-dabc-4a20-b940-7f5de055e581 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:18.723005 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d51eb723-dabc-4a20-b940-7f5de055e581 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadc4fac778e4eaf905a3fbc26fbb090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e751dfada40945a69472003d08f1bb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:18.740089 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d51eb723-dabc-4a20-b940-7f5de055e581 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cadc4fac778e4eaf905a3fbc26fbb090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e751dfada40945a69472003d08f1bb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:18.748487 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d51eb723-dabc-4a20-b940-7f5de055e581 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cadc4fac778e4eaf905a3fbc26fbb090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e751dfada40945a69472003d08f1bb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:18.750354 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d51eb723-dabc-4a20-b940-7f5de055e581 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] 10.222.0.17 "GET /compute/v2.1/servers/b3576570-0c74-42f9-ae44-ac9f049e980d" status: 200 len: 1405 microversion: 2.54 time: 0.277987 Jul 23 21:30:18.750972 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1988/4059] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:30:18 2022] GET /compute/v2.1/servers/b3576570-0c74-42f9-ae44-ac9f049e980d => generated 1405 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:30:18.786749 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0821319c-5fcb-44db-b4ad-b43256a81567 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1936166309", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "networks": [{"uuid": "63d253f9-5d83-4f00-8bc3-28f418cf7611"}]}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:30:18.823744 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:30:18.938114 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-0821319c-5fcb-44db-b4ad-b43256a81567 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] validate_networks() for [('63d253f9-5d83-4f00-8bc3-28f418cf7611', None, None, None, None, None)] {{(pid=131320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:30:19.575954 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-63ea6e03-6085-4cce-abee-bd3a954ac37c tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:19.596128 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-63ea6e03-6085-4cce-abee-bd3a954ac37c tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1316 microversion: 2.1 time: 1.336815 Jul 23 21:30:19.611970 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:30:19.616672 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2072/4060] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:30:18 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1316 bytes in 1360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:30:19.630683 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-2731558a-6f15-47ad-aeaf-71053d91fce2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:19.631500 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-2731558a-6f15-47ad-aeaf-71053d91fce2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:19.661233 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2731558a-6f15-47ad-aeaf-71053d91fce2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:19.662614 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2731558a-6f15-47ad-aeaf-71053d91fce2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:19.665072 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2731558a-6f15-47ad-aeaf-71053d91fce2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:19.667602 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2731558a-6f15-47ad-aeaf-71053d91fce2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:19.843748 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-2731558a-6f15-47ad-aeaf-71053d91fce2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:19.875042 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-2731558a-6f15-47ad-aeaf-71053d91fce2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:19.881675 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-2731558a-6f15-47ad-aeaf-71053d91fce2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:19.884074 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-2731558a-6f15-47ad-aeaf-71053d91fce2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.265913 Jul 23 21:30:19.892119 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2073/4061] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:30:19 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:30:19.900877 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-77d597b3-892b-4a7a-abf0-0c97796b4620 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:19.902083 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-77d597b3-892b-4a7a-abf0-0c97796b4620 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] [instance: b3576570-0c74-42f9-ae44-ac9f049e980d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:19.925333 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-77d597b3-892b-4a7a-abf0-0c97796b4620 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:19.926191 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-77d597b3-892b-4a7a-abf0-0c97796b4620 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:19.928352 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-77d597b3-892b-4a7a-abf0-0c97796b4620 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:19.932119 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-77d597b3-892b-4a7a-abf0-0c97796b4620 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:20.134693 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-77d597b3-892b-4a7a-abf0-0c97796b4620 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cadc4fac778e4eaf905a3fbc26fbb090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e751dfada40945a69472003d08f1bb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:20.150410 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-77d597b3-892b-4a7a-abf0-0c97796b4620 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cadc4fac778e4eaf905a3fbc26fbb090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e751dfada40945a69472003d08f1bb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:20.153527 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-77d597b3-892b-4a7a-abf0-0c97796b4620 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cadc4fac778e4eaf905a3fbc26fbb090', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e751dfada40945a69472003d08f1bb0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:20.156748 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-77d597b3-892b-4a7a-abf0-0c97796b4620 tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] 10.222.0.17 "GET /compute/v2.1/servers/b3576570-0c74-42f9-ae44-ac9f049e980d" status: 200 len: 1405 microversion: 2.54 time: 0.263284 Jul 23 21:30:20.167298 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2074/4062] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:30:19 2022] GET /compute/v2.1/servers/b3576570-0c74-42f9-ae44-ac9f049e980d => generated 1405 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:30:20.193842 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-238a7119-ecb4-447d-b247-0f801878fc1a req-cdebfb50-1c14-4308-abf2-615a62a29674 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2ad2cfd-7479-48d0-b802-cdd5d5093305", "tag": "cbde15d1-b6fd-48d4-98a3-b0a0c831fec2"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:30:20.211643 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-238a7119-ecb4-447d-b247-0f801878fc1a req-cdebfb50-1c14-4308-abf2-615a62a29674 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:20.213636 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-238a7119-ecb4-447d-b247-0f801878fc1a req-cdebfb50-1c14-4308-abf2-615a62a29674 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:20.249239 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-238a7119-ecb4-447d-b247-0f801878fc1a req-cdebfb50-1c14-4308-abf2-615a62a29674 service nova] Creating event network-changed:cbde15d1-b6fd-48d4-98a3-b0a0c831fec2 for instance f2ad2cfd-7479-48d0-b802-cdd5d5093305 on nch1-master-1 Jul 23 21:30:20.270424 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-238a7119-ecb4-447d-b247-0f801878fc1a req-cdebfb50-1c14-4308-abf2-615a62a29674 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082349 Jul 23 21:30:20.273579 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2075/4063] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:30:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:30:20.443349 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=8 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:30:20.629147 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a231fab2-1c02-473f-af75-e8dd2b01a355 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:20.629970 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-a231fab2-1c02-473f-af75-e8dd2b01a355 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:20.646746 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a231fab2-1c02-473f-af75-e8dd2b01a355 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:20.647421 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a231fab2-1c02-473f-af75-e8dd2b01a355 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:20.654850 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a231fab2-1c02-473f-af75-e8dd2b01a355 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:20.656503 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a231fab2-1c02-473f-af75-e8dd2b01a355 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:21.542047 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-a231fab2-1c02-473f-af75-e8dd2b01a355 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:21.556732 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-a231fab2-1c02-473f-af75-e8dd2b01a355 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1316 microversion: 2.1 time: 0.934084 Jul 23 21:30:21.559219 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2076/4064] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:30:20 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1316 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:30:21.578764 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-61e35fd2-fc1e-4522-b60f-f5e206f7e9f7 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:21.581593 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-61e35fd2-fc1e-4522-b60f-f5e206f7e9f7 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:21.598465 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-61e35fd2-fc1e-4522-b60f-f5e206f7e9f7 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:21.602633 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-61e35fd2-fc1e-4522-b60f-f5e206f7e9f7 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:21.603856 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-61e35fd2-fc1e-4522-b60f-f5e206f7e9f7 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:21.609299 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-61e35fd2-fc1e-4522-b60f-f5e206f7e9f7 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:21.703343 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-0821319c-5fcb-44db-b4ad-b43256a81567 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:30:21.704379 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-0821319c-5fcb-44db-b4ad-b43256a81567 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:30:21.705089 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-0821319c-5fcb-44db-b4ad-b43256a81567 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:30:21.705856 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-0821319c-5fcb-44db-b4ad-b43256a81567 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:30:21.711173 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-0821319c-5fcb-44db-b4ad-b43256a81567 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:30:21.736767 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0821319c-5fcb-44db-b4ad-b43256a81567 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:21.737782 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0821319c-5fcb-44db-b4ad-b43256a81567 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:21.740930 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0821319c-5fcb-44db-b4ad-b43256a81567 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:21.743045 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0821319c-5fcb-44db-b4ad-b43256a81567 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:21.780829 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-0821319c-5fcb-44db-b4ad-b43256a81567 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Getting quotas for project 1890022bd460485dae0ea94b152a6746. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:30:21.799430 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-0821319c-5fcb-44db-b4ad-b43256a81567 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Getting quotas for user 5efda1c40f494592bf1e6af1add120f3 and project 1890022bd460485dae0ea94b152a6746. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:30:21.834689 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-0821319c-5fcb-44db-b4ad-b43256a81567 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Going to run 1 instances... {{(pid=131320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:30:21.837080 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-0821319c-5fcb-44db-b4ad-b43256a81567 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: f685637e-a804-4266-81a2-67d2e11a60b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:30:21.917700 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-0821319c-5fcb-44db-b4ad-b43256a81567 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.146015 Jul 23 21:30:21.919907 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1989/4065] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:30:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 3168 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 23 21:30:21.928038 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-832711e0-cdf4-4a9b-88c6-ae0c871a832a tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:21.929013 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-832711e0-cdf4-4a9b-88c6-ae0c871a832a tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] [instance: b3576570-0c74-42f9-ae44-ac9f049e980d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:21.937089 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-61e35fd2-fc1e-4522-b60f-f5e206f7e9f7 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:21.964330 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-61e35fd2-fc1e-4522-b60f-f5e206f7e9f7 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:21.967258 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-832711e0-cdf4-4a9b-88c6-ae0c871a832a tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:21.969187 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-61e35fd2-fc1e-4522-b60f-f5e206f7e9f7 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:21.973062 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-61e35fd2-fc1e-4522-b60f-f5e206f7e9f7 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.412537 Jul 23 21:30:21.973354 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-832711e0-cdf4-4a9b-88c6-ae0c871a832a tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:21.974678 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-832711e0-cdf4-4a9b-88c6-ae0c871a832a tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:21.975586 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2077/4066] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:30:21 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:30:21.977404 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-832711e0-cdf4-4a9b-88c6-ae0c871a832a tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:21.993140 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-70a642a7-4bfe-40e5-be08-57bbfd767a4d tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:21.994777 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-70a642a7-4bfe-40e5-be08-57bbfd767a4d tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: f685637e-a804-4266-81a2-67d2e11a60b0] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:22.077327 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-832711e0-cdf4-4a9b-88c6-ae0c871a832a tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] HTTP exception thrown: Instance b3576570-0c74-42f9-ae44-ac9f049e980d could not be found. Jul 23 21:30:22.096296 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-832711e0-cdf4-4a9b-88c6-ae0c871a832a tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Request method failure captured: Jul 23 21:30:22.096296 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/b3576570-0c74-42f9-ae44-ac9f049e980d HTTP/1.1 Jul 23 21:30:22.096296 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:30:22.096296 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:30:22.096296 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:30:22.096296 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:30:22.096296 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:30:22.096296 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:30:22.096296 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:30:22.096296 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:30:22.096296 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GhEYUgNsqFokyLb63-mMT_2yLpE4Q91_3Dqv2E-tT6YO1t0MDqnBUMiDbgjLKjO7PsJV-Ru6fMLq08U5OUE1PQo3xHXODuB2fvM1FMsJTP6ztnSCDw_FG5NMwDS68q7W04kr3ro62FJ0H1rjcDUXsofVP6mPRlCidmLLAsLGRCAA8w Jul 23 21:30:22.096296 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:30:22.096296 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:30:22.096296 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:30:22.096296 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:30:22.096296 ncdv-master-1 devstack@n-api.service[131320]: X-Openstack-Nova-Api-Version: 2.54 Jul 23 21:30:22.096296 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:30:22.096296 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:30:22.096296 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: e751dfada40945a69472003d08f1bb0b Jul 23 21:30:22.096296 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServerShowV254Test-564346227 Jul 23 21:30:22.096296 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:30:22.096296 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:30:22.096296 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e751dfada40945a69472003d08f1bb0b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e751dfada40945a69472003d08f1bb0b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e751dfada40945a69472003d08f1bb0b", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e751dfada40945a69472003d08f1bb0b"}]}] Jul 23 21:30:22.096296 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServerShowV254Test-564346227 Jul 23 21:30:22.096296 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: e751dfada40945a69472003d08f1bb0b Jul 23 21:30:22.096296 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServerShowV254Test-564346227 Jul 23 21:30:22.096296 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServerShowV254Test-564346227-project Jul 23 21:30:22.096296 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:30:22.096296 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:30:22.096296 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: cadc4fac778e4eaf905a3fbc26fbb090 Jul 23 21:30:22.096296 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServerShowV254Test-564346227-project Jul 23 21:30:22.096296 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:30:22.096296 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance b3576570-0c74-42f9-ae44-ac9f049e980d could not be found. Jul 23 21:30:22.096296 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': 'b3576570-0c74-42f9-ae44-ac9f049e980d'} Jul 23 21:30:22.096296 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:30:22.096296 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:30:22.096296 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:30:22.096296 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:30:22.096296 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:30:22.096296 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:30:22.096296 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:30:22.096296 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:30:22.096296 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:30:22.096296 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:30:22.096296 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3576570-0c74-42f9-ae44-ac9f049e980d could not be found. Jul 23 21:30:22.096296 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:30:22.096296 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:30:22.096296 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:30:22.096296 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:30:22.096296 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:30:22.096296 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:30:22.096296 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:30:22.096296 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:30:22.096296 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:30:22.096296 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:30:22.096296 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:30:22.096296 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:30:22.096296 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:30:22.096296 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:30:22.096296 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:30:22.096296 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:30:22.096296 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3576570-0c74-42f9-ae44-ac9f049e980d could not be found. Jul 23 21:30:22.096296 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:30:22.096296 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:30:22.096296 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:30:22.099869 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:30:22.099869 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:30:22.099869 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:30:22.099869 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:30:22.099869 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:30:22.099869 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3576570-0c74-42f9-ae44-ac9f049e980d could not be found. Jul 23 21:30:22.099869 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:30:22.099869 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-832711e0-cdf4-4a9b-88c6-ae0c871a832a tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] Returning 404 to user: Instance b3576570-0c74-42f9-ae44-ac9f049e980d could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:30:22.099869 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-832711e0-cdf4-4a9b-88c6-ae0c871a832a tempest-ServerShowV254Test-564346227 tempest-ServerShowV254Test-564346227-project] 10.222.0.17 "GET /compute/v2.1/servers/b3576570-0c74-42f9-ae44-ac9f049e980d" status: 404 len: 111 microversion: 2.54 time: 0.176216 Jul 23 21:30:22.110975 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1990/4067] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:30:21 2022] GET /compute/v2.1/servers/b3576570-0c74-42f9-ae44-ac9f049e980d => generated 111 bytes in 190 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 23 21:30:22.415785 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-70a642a7-4bfe-40e5-be08-57bbfd767a4d tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:22.429588 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-70a642a7-4bfe-40e5-be08-57bbfd767a4d tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/f685637e-a804-4266-81a2-67d2e11a60b0" status: 200 len: 1209 microversion: 2.1 time: 0.447151 Jul 23 21:30:22.430419 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2078/4068] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:30:21 2022] GET /compute/v2.1/servers/f685637e-a804-4266-81a2-67d2e11a60b0 => generated 1209 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:30:22.589619 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f6e64732-30d9-47a0-9f00-ce7d8e5ff145 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:22.590795 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f6e64732-30d9-47a0-9f00-ce7d8e5ff145 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:22.604797 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f6e64732-30d9-47a0-9f00-ce7d8e5ff145 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:22.605545 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f6e64732-30d9-47a0-9f00-ce7d8e5ff145 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:22.606546 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f6e64732-30d9-47a0-9f00-ce7d8e5ff145 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:22.607194 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f6e64732-30d9-47a0-9f00-ce7d8e5ff145 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:22.994900 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-caa29d76-ce57-4ef8-bac6-487635a1c713 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:22.996227 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-caa29d76-ce57-4ef8-bac6-487635a1c713 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:23.015847 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-caa29d76-ce57-4ef8-bac6-487635a1c713 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:23.016302 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-caa29d76-ce57-4ef8-bac6-487635a1c713 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:23.017327 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-caa29d76-ce57-4ef8-bac6-487635a1c713 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:23.018215 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-caa29d76-ce57-4ef8-bac6-487635a1c713 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:23.064902 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=100 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:30:23.240502 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-caa29d76-ce57-4ef8-bac6-487635a1c713 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:23.254846 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-caa29d76-ce57-4ef8-bac6-487635a1c713 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:23.257137 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-caa29d76-ce57-4ef8-bac6-487635a1c713 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:23.258836 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-caa29d76-ce57-4ef8-bac6-487635a1c713 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.267951 Jul 23 21:30:23.259976 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2079/4069] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:30:22 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:30:23.376262 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f6e64732-30d9-47a0-9f00-ce7d8e5ff145 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:23.397051 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f6e64732-30d9-47a0-9f00-ce7d8e5ff145 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1316 microversion: 2.1 time: 0.815992 Jul 23 21:30:23.402203 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1991/4070] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:30:22 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1316 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:30:23.453914 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-38a1d0c1-98d9-4db6-8774-5df9b1426e75 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:23.455923 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-38a1d0c1-98d9-4db6-8774-5df9b1426e75 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: f685637e-a804-4266-81a2-67d2e11a60b0] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:23.483983 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-38a1d0c1-98d9-4db6-8774-5df9b1426e75 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:23.484929 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-38a1d0c1-98d9-4db6-8774-5df9b1426e75 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:23.489144 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-38a1d0c1-98d9-4db6-8774-5df9b1426e75 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:23.491616 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-38a1d0c1-98d9-4db6-8774-5df9b1426e75 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:23.708178 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-38a1d0c1-98d9-4db6-8774-5df9b1426e75 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:23.737684 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-38a1d0c1-98d9-4db6-8774-5df9b1426e75 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/f685637e-a804-4266-81a2-67d2e11a60b0" status: 200 len: 1269 microversion: 2.1 time: 0.288497 Jul 23 21:30:23.754892 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2080/4071] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:30:23 2022] GET /compute/v2.1/servers/f685637e-a804-4266-81a2-67d2e11a60b0 => generated 1269 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:30:24.278450 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-190dfcf4-6100-4c6c-8bbc-2b9f6c402b95 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:24.279346 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-190dfcf4-6100-4c6c-8bbc-2b9f6c402b95 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:24.295767 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-190dfcf4-6100-4c6c-8bbc-2b9f6c402b95 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:24.296237 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-190dfcf4-6100-4c6c-8bbc-2b9f6c402b95 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:24.299440 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-190dfcf4-6100-4c6c-8bbc-2b9f6c402b95 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:24.300098 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-190dfcf4-6100-4c6c-8bbc-2b9f6c402b95 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:24.412901 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-190dfcf4-6100-4c6c-8bbc-2b9f6c402b95 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:24.420418 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c22f1d08-2258-42c6-887a-4edf77466066 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:24.421306 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-c22f1d08-2258-42c6-887a-4edf77466066 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:24.434631 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-190dfcf4-6100-4c6c-8bbc-2b9f6c402b95 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:24.436589 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-190dfcf4-6100-4c6c-8bbc-2b9f6c402b95 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:24.439271 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c22f1d08-2258-42c6-887a-4edf77466066 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:24.439910 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c22f1d08-2258-42c6-887a-4edf77466066 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:24.442049 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c22f1d08-2258-42c6-887a-4edf77466066 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:24.443651 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c22f1d08-2258-42c6-887a-4edf77466066 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:24.443911 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-190dfcf4-6100-4c6c-8bbc-2b9f6c402b95 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.167198 Jul 23 21:30:24.444932 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1992/4072] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:30:24 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:30:24.773070 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8dcd8198-8973-4f67-b90e-1a65f1e81007 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:24.774088 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8dcd8198-8973-4f67-b90e-1a65f1e81007 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: f685637e-a804-4266-81a2-67d2e11a60b0] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:24.785811 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8dcd8198-8973-4f67-b90e-1a65f1e81007 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:24.787686 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8dcd8198-8973-4f67-b90e-1a65f1e81007 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:24.789228 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8dcd8198-8973-4f67-b90e-1a65f1e81007 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:24.790756 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8dcd8198-8973-4f67-b90e-1a65f1e81007 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:24.917670 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c22f1d08-2258-42c6-887a-4edf77466066 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:24.929050 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-c22f1d08-2258-42c6-887a-4edf77466066 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1316 microversion: 2.1 time: 0.514202 Jul 23 21:30:24.932193 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2081/4073] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:30:24 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1316 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:30:25.464539 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-011529e7-d673-4785-8cf1-de85a77d64de tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:25.466106 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-011529e7-d673-4785-8cf1-de85a77d64de tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:25.479438 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-011529e7-d673-4785-8cf1-de85a77d64de tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:25.481338 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-011529e7-d673-4785-8cf1-de85a77d64de tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:25.485099 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-011529e7-d673-4785-8cf1-de85a77d64de tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:25.488779 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-011529e7-d673-4785-8cf1-de85a77d64de tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:25.634367 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-011529e7-d673-4785-8cf1-de85a77d64de tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:25.650054 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-011529e7-d673-4785-8cf1-de85a77d64de tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:25.651739 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-011529e7-d673-4785-8cf1-de85a77d64de tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:25.652983 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-011529e7-d673-4785-8cf1-de85a77d64de tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.193125 Jul 23 21:30:25.654140 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2082/4074] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:30:25 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:30:25.953274 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c360fb85-85da-46fa-9bdf-702d90bc7b91 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:25.954058 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-c360fb85-85da-46fa-9bdf-702d90bc7b91 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:25.971335 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c360fb85-85da-46fa-9bdf-702d90bc7b91 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:25.974036 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c360fb85-85da-46fa-9bdf-702d90bc7b91 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:25.978369 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c360fb85-85da-46fa-9bdf-702d90bc7b91 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:25.980835 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c360fb85-85da-46fa-9bdf-702d90bc7b91 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:26.211957 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8dcd8198-8973-4f67-b90e-1a65f1e81007 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:26.239448 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8dcd8198-8973-4f67-b90e-1a65f1e81007 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/f685637e-a804-4266-81a2-67d2e11a60b0" status: 200 len: 1267 microversion: 2.1 time: 1.471767 Jul 23 21:30:26.248596 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1993/4075] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:30:24 2022] GET /compute/v2.1/servers/f685637e-a804-4266-81a2-67d2e11a60b0 => generated 1267 bytes in 1480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:30:26.554758 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c360fb85-85da-46fa-9bdf-702d90bc7b91 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:26.574145 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-c360fb85-85da-46fa-9bdf-702d90bc7b91 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1316 microversion: 2.1 time: 0.629504 Jul 23 21:30:26.575413 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2083/4076] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:30:25 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1316 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:30:26.672170 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6599c223-2201-4734-a4a2-72946d5c22a1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:26.673873 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6599c223-2201-4734-a4a2-72946d5c22a1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:26.688742 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6599c223-2201-4734-a4a2-72946d5c22a1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:26.690758 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6599c223-2201-4734-a4a2-72946d5c22a1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:26.692373 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6599c223-2201-4734-a4a2-72946d5c22a1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:26.692826 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6599c223-2201-4734-a4a2-72946d5c22a1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:26.989389 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6599c223-2201-4734-a4a2-72946d5c22a1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:27.008136 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6599c223-2201-4734-a4a2-72946d5c22a1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:27.010552 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6599c223-2201-4734-a4a2-72946d5c22a1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:27.013785 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6599c223-2201-4734-a4a2-72946d5c22a1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.344206 Jul 23 21:30:27.015167 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1994/4077] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:30:26 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:30:27.265931 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-8e07298f-ea3e-4c5a-a843-8f4cb6fad461 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:27.266905 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-8e07298f-ea3e-4c5a-a843-8f4cb6fad461 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: f685637e-a804-4266-81a2-67d2e11a60b0] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:27.281341 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8e07298f-ea3e-4c5a-a843-8f4cb6fad461 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:27.282623 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8e07298f-ea3e-4c5a-a843-8f4cb6fad461 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:27.284881 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8e07298f-ea3e-4c5a-a843-8f4cb6fad461 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:27.287092 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8e07298f-ea3e-4c5a-a843-8f4cb6fad461 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:27.592885 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-732e39c1-1c75-4697-8ed0-32d14858444e tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:27.593592 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-732e39c1-1c75-4697-8ed0-32d14858444e tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:27.621064 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-732e39c1-1c75-4697-8ed0-32d14858444e tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:27.622381 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-732e39c1-1c75-4697-8ed0-32d14858444e tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:27.628890 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-732e39c1-1c75-4697-8ed0-32d14858444e tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:27.629689 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-732e39c1-1c75-4697-8ed0-32d14858444e tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:27.653843 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-8e07298f-ea3e-4c5a-a843-8f4cb6fad461 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:27.667339 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-8e07298f-ea3e-4c5a-a843-8f4cb6fad461 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/f685637e-a804-4266-81a2-67d2e11a60b0" status: 200 len: 1309 microversion: 2.1 time: 0.406874 Jul 23 21:30:27.675165 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2084/4078] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:30:27 2022] GET /compute/v2.1/servers/f685637e-a804-4266-81a2-67d2e11a60b0 => generated 1309 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:30:28.034882 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-3ff4d1e9-6222-4343-9a20-ee0d295eba7c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:28.035928 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-3ff4d1e9-6222-4343-9a20-ee0d295eba7c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:28.046844 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3ff4d1e9-6222-4343-9a20-ee0d295eba7c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:28.047309 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3ff4d1e9-6222-4343-9a20-ee0d295eba7c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:28.048114 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3ff4d1e9-6222-4343-9a20-ee0d295eba7c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:28.048567 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3ff4d1e9-6222-4343-9a20-ee0d295eba7c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:28.262090 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-3ff4d1e9-6222-4343-9a20-ee0d295eba7c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:28.272078 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-3ff4d1e9-6222-4343-9a20-ee0d295eba7c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:28.273606 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-3ff4d1e9-6222-4343-9a20-ee0d295eba7c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:28.274871 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-3ff4d1e9-6222-4343-9a20-ee0d295eba7c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.244679 Jul 23 21:30:28.275463 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2085/4079] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:30:28 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:30:28.495582 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-732e39c1-1c75-4697-8ed0-32d14858444e tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:28.506273 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-732e39c1-1c75-4697-8ed0-32d14858444e tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1316 microversion: 2.1 time: 0.916451 Jul 23 21:30:28.509187 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1995/4080] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:30:27 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1316 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:30:28.685137 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-8a25d88c-a507-4599-8baf-acebd736df93 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:28.685766 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-8a25d88c-a507-4599-8baf-acebd736df93 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: f685637e-a804-4266-81a2-67d2e11a60b0] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:28.700658 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8a25d88c-a507-4599-8baf-acebd736df93 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:28.703958 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8a25d88c-a507-4599-8baf-acebd736df93 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:28.705050 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8a25d88c-a507-4599-8baf-acebd736df93 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:28.705507 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8a25d88c-a507-4599-8baf-acebd736df93 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:29.038327 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-8a25d88c-a507-4599-8baf-acebd736df93 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:29.051823 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-8a25d88c-a507-4599-8baf-acebd736df93 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/f685637e-a804-4266-81a2-67d2e11a60b0" status: 200 len: 1309 microversion: 2.1 time: 0.370882 Jul 23 21:30:29.054230 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2086/4081] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:30:28 2022] GET /compute/v2.1/servers/f685637e-a804-4266-81a2-67d2e11a60b0 => generated 1309 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:30:29.296947 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-40069ace-d8c9-4715-bac6-4dfa191f2cf6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:29.297572 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-40069ace-d8c9-4715-bac6-4dfa191f2cf6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:29.310438 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-40069ace-d8c9-4715-bac6-4dfa191f2cf6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:29.318174 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-40069ace-d8c9-4715-bac6-4dfa191f2cf6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:29.319491 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-40069ace-d8c9-4715-bac6-4dfa191f2cf6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:29.320074 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-40069ace-d8c9-4715-bac6-4dfa191f2cf6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:29.524709 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d954d8b2-bbb0-445d-9e7c-3475143c1b07 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:29.525330 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-d954d8b2-bbb0-445d-9e7c-3475143c1b07 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:29.536710 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d954d8b2-bbb0-445d-9e7c-3475143c1b07 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:29.537639 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d954d8b2-bbb0-445d-9e7c-3475143c1b07 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:29.539087 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d954d8b2-bbb0-445d-9e7c-3475143c1b07 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:29.541940 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d954d8b2-bbb0-445d-9e7c-3475143c1b07 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:29.618238 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-40069ace-d8c9-4715-bac6-4dfa191f2cf6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:29.649931 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-40069ace-d8c9-4715-bac6-4dfa191f2cf6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:29.651439 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-40069ace-d8c9-4715-bac6-4dfa191f2cf6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:29.652646 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-40069ace-d8c9-4715-bac6-4dfa191f2cf6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.359827 Jul 23 21:30:29.658499 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1996/4082] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:30:29 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:30:30.072135 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-beb6dee5-0608-46f4-9657-54fd6b93608c tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:30.073008 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-beb6dee5-0608-46f4-9657-54fd6b93608c tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: f685637e-a804-4266-81a2-67d2e11a60b0] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:30.105053 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-beb6dee5-0608-46f4-9657-54fd6b93608c tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:30.111038 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-beb6dee5-0608-46f4-9657-54fd6b93608c tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:30.117676 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-beb6dee5-0608-46f4-9657-54fd6b93608c tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:30.118505 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-beb6dee5-0608-46f4-9657-54fd6b93608c tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:31.036426 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-beb6dee5-0608-46f4-9657-54fd6b93608c tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:31.040534 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:30:31.050772 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-beb6dee5-0608-46f4-9657-54fd6b93608c tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/f685637e-a804-4266-81a2-67d2e11a60b0" status: 200 len: 1309 microversion: 2.1 time: 0.983454 Jul 23 21:30:31.058323 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-d954d8b2-bbb0-445d-9e7c-3475143c1b07 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:31.060405 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1997/4083] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:30:30 2022] GET /compute/v2.1/servers/f685637e-a804-4266-81a2-67d2e11a60b0 => generated 1309 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:30:31.065547 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-6862f381-645a-4077-bf52-967cefc4e961 req-fd818445-15b1-4aef-999d-d2606d15d38c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f685637e-a804-4266-81a2-67d2e11a60b0", "tag": "bcbda1a6-1f30-4122-9a97-0aac7286f268"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:30:31.071192 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-d954d8b2-bbb0-445d-9e7c-3475143c1b07 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1316 microversion: 2.1 time: 1.550288 Jul 23 21:30:31.071788 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2087/4084] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:30:29 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1316 bytes in 1552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:30:31.077372 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-af81878f-21a8-4fcb-8733-30c647f489a3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:31.078275 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-af81878f-21a8-4fcb-8733-30c647f489a3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:31.084902 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-af81878f-21a8-4fcb-8733-30c647f489a3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:31.085851 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-af81878f-21a8-4fcb-8733-30c647f489a3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:31.086873 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-af81878f-21a8-4fcb-8733-30c647f489a3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:31.087701 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-af81878f-21a8-4fcb-8733-30c647f489a3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:31.092688 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-6862f381-645a-4077-bf52-967cefc4e961 req-fd818445-15b1-4aef-999d-d2606d15d38c service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:31.093142 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-6862f381-645a-4077-bf52-967cefc4e961 req-fd818445-15b1-4aef-999d-d2606d15d38c service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:31.129581 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-6862f381-645a-4077-bf52-967cefc4e961 req-fd818445-15b1-4aef-999d-d2606d15d38c service nova] Creating event network-changed:bcbda1a6-1f30-4122-9a97-0aac7286f268 for instance f685637e-a804-4266-81a2-67d2e11a60b0 on nch2-master-1 Jul 23 21:30:31.143616 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-6862f381-645a-4077-bf52-967cefc4e961 req-fd818445-15b1-4aef-999d-d2606d15d38c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079670 Jul 23 21:30:31.145407 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1998/4085] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:30:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:30:31.160956 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-cac5c44e-571d-48c5-a5b1-73ff9bda34ef req-3a0c03b0-46fd-4ec7-8be4-759fd265e4f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2ad2cfd-7479-48d0-b802-cdd5d5093305", "name": "network-vif-plugged", "status": "completed", "tag": "cbde15d1-b6fd-48d4-98a3-b0a0c831fec2"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:30:31.171865 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-cac5c44e-571d-48c5-a5b1-73ff9bda34ef req-3a0c03b0-46fd-4ec7-8be4-759fd265e4f3 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:31.172347 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-cac5c44e-571d-48c5-a5b1-73ff9bda34ef req-3a0c03b0-46fd-4ec7-8be4-759fd265e4f3 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:31.188031 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-cac5c44e-571d-48c5-a5b1-73ff9bda34ef req-3a0c03b0-46fd-4ec7-8be4-759fd265e4f3 service nova] Creating event network-vif-plugged:cbde15d1-b6fd-48d4-98a3-b0a0c831fec2 for instance f2ad2cfd-7479-48d0-b802-cdd5d5093305 on nch1-master-1 Jul 23 21:30:31.195081 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-cac5c44e-571d-48c5-a5b1-73ff9bda34ef req-3a0c03b0-46fd-4ec7-8be4-759fd265e4f3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047069 Jul 23 21:30:31.198536 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 1999/4086] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:30:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:30:31.285168 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-af81878f-21a8-4fcb-8733-30c647f489a3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:31.296375 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-af81878f-21a8-4fcb-8733-30c647f489a3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:31.307565 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-af81878f-21a8-4fcb-8733-30c647f489a3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:31.308960 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-af81878f-21a8-4fcb-8733-30c647f489a3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.235895 Jul 23 21:30:31.320655 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2088/4087] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:30:31 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:30:32.065732 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:30:32.068289 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=6 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:30:32.074426 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e3037c05-d9c2-4eaf-af21-53060812a9ab tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:32.075484 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e3037c05-d9c2-4eaf-af21-53060812a9ab tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: f685637e-a804-4266-81a2-67d2e11a60b0] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:32.090073 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e74b12d6-d22e-44c2-80d4-3c076e4d233f tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:32.091959 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-e74b12d6-d22e-44c2-80d4-3c076e4d233f tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:32.109038 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e74b12d6-d22e-44c2-80d4-3c076e4d233f tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:32.109547 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e74b12d6-d22e-44c2-80d4-3c076e4d233f tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:32.117680 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e74b12d6-d22e-44c2-80d4-3c076e4d233f tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:32.120973 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e3037c05-d9c2-4eaf-af21-53060812a9ab tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:32.121744 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e74b12d6-d22e-44c2-80d4-3c076e4d233f tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:32.128172 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e3037c05-d9c2-4eaf-af21-53060812a9ab tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:32.129288 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e3037c05-d9c2-4eaf-af21-53060812a9ab tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:32.133981 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e3037c05-d9c2-4eaf-af21-53060812a9ab tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:32.424145 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell0:SELECT=2 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:30:32.953082 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-e74b12d6-d22e-44c2-80d4-3c076e4d233f tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:32.963662 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-e74b12d6-d22e-44c2-80d4-3c076e4d233f tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1316 microversion: 2.1 time: 0.878179 Jul 23 21:30:32.967929 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2089/4088] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:30:32 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1316 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:30:32.978995 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c8510bf5-4618-4c4d-b5b4-f3a76e06eefa tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:32.986585 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-c8510bf5-4618-4c4d-b5b4-f3a76e06eefa tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:33.006572 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c8510bf5-4618-4c4d-b5b4-f3a76e06eefa tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:33.009592 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c8510bf5-4618-4c4d-b5b4-f3a76e06eefa tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:33.011461 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c8510bf5-4618-4c4d-b5b4-f3a76e06eefa tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:33.012100 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c8510bf5-4618-4c4d-b5b4-f3a76e06eefa tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:33.133526 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e3037c05-d9c2-4eaf-af21-53060812a9ab tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:33.148286 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e3037c05-d9c2-4eaf-af21-53060812a9ab tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/f685637e-a804-4266-81a2-67d2e11a60b0" status: 200 len: 1309 microversion: 2.1 time: 1.082945 Jul 23 21:30:33.159398 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2000/4089] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:30:32 2022] GET /compute/v2.1/servers/f685637e-a804-4266-81a2-67d2e11a60b0 => generated 1309 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:30:33.232092 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c8510bf5-4618-4c4d-b5b4-f3a76e06eefa tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:33.249032 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c8510bf5-4618-4c4d-b5b4-f3a76e06eefa tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:33.255856 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c8510bf5-4618-4c4d-b5b4-f3a76e06eefa tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:33.257426 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-c8510bf5-4618-4c4d-b5b4-f3a76e06eefa tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.288204 Jul 23 21:30:33.258277 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2090/4090] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:30:32 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:30:33.984886 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b7f0c1a1-a346-41a9-ab38-dbaf1edf664d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:33.985513 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b7f0c1a1-a346-41a9-ab38-dbaf1edf664d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:34.001638 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b7f0c1a1-a346-41a9-ab38-dbaf1edf664d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:34.002190 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b7f0c1a1-a346-41a9-ab38-dbaf1edf664d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:34.003022 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b7f0c1a1-a346-41a9-ab38-dbaf1edf664d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:34.003471 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b7f0c1a1-a346-41a9-ab38-dbaf1edf664d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:34.169043 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-9ea6cf0d-dc73-4bd5-ae62-4be89145367f tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:34.169664 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-9ea6cf0d-dc73-4bd5-ae62-4be89145367f tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: f685637e-a804-4266-81a2-67d2e11a60b0] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:34.196048 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9ea6cf0d-dc73-4bd5-ae62-4be89145367f tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:34.196507 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9ea6cf0d-dc73-4bd5-ae62-4be89145367f tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:34.197310 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9ea6cf0d-dc73-4bd5-ae62-4be89145367f tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:34.197753 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9ea6cf0d-dc73-4bd5-ae62-4be89145367f tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:34.923676 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b7f0c1a1-a346-41a9-ab38-dbaf1edf664d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:34.943632 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b7f0c1a1-a346-41a9-ab38-dbaf1edf664d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1505 microversion: 2.1 time: 0.963735 Jul 23 21:30:34.951876 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2001/4091] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:30:33 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1505 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:30:34.962402 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-33abd333-93cf-404a-a059-84004d0e0bbc tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:34.965445 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-33abd333-93cf-404a-a059-84004d0e0bbc tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:34.984846 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-33abd333-93cf-404a-a059-84004d0e0bbc tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:34.985567 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-33abd333-93cf-404a-a059-84004d0e0bbc tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:34.988588 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-33abd333-93cf-404a-a059-84004d0e0bbc tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:34.989228 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-33abd333-93cf-404a-a059-84004d0e0bbc tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:35.242180 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-9ea6cf0d-dc73-4bd5-ae62-4be89145367f tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:35.261186 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-9ea6cf0d-dc73-4bd5-ae62-4be89145367f tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/f685637e-a804-4266-81a2-67d2e11a60b0" status: 200 len: 1309 microversion: 2.1 time: 1.097963 Jul 23 21:30:35.264354 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2091/4092] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:30:34 2022] GET /compute/v2.1/servers/f685637e-a804-4266-81a2-67d2e11a60b0 => generated 1309 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:30:35.306638 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-33abd333-93cf-404a-a059-84004d0e0bbc tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:35.324288 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-33abd333-93cf-404a-a059-84004d0e0bbc tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:35.326434 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-33abd333-93cf-404a-a059-84004d0e0bbc tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:35.327965 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-33abd333-93cf-404a-a059-84004d0e0bbc tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.373422 Jul 23 21:30:35.331333 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2002/4093] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:30:34 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:30:35.351862 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1df889f6-3159-43ef-961d-021d2d1ba0bc tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1584738636", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "networks": [{"uuid": "654a77ca-1e84-434d-8536-1fc3adb327d0"}]}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:30:35.424490 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-1df889f6-3159-43ef-961d-021d2d1ba0bc tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] validate_networks() for [('654a77ca-1e84-434d-8536-1fc3adb327d0', None, None, None, None, None)] {{(pid=131320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:30:35.625980 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-84d670ca-3058-43c6-b6e3-e26ded09312e tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Action: 'create', calling method: .version_select at 0x7f0b472f9310>, body: {"keypair": {"name": "tempest-keypair-439558644", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCoP7Y9C97lTXe1zBB9R7vFIpPWEaBNcosuDvKXf2Yl619P6h3PczKj3BC54g17wJlgGhX4axPcgGxRqMygkpYeu8TuA0ftaMtLWd6yiEJBEjGUzdtGs+ShQScG3HqUOvA=="}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:30:35.669054 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-84d670ca-3058-43c6-b6e3-e26ded09312e tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Getting quotas for project ebcf55bcaba04bf8ae8a9b2ac09e8d98. Resources: {'key_pairs'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:30:35.685520 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-84d670ca-3058-43c6-b6e3-e26ded09312e tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Getting quotas for user 37b1e260651b4dffa7c1efe8e9d0f144 and project ebcf55bcaba04bf8ae8a9b2ac09e8d98. Resources: {'key_pairs'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:30:35.732777 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-84d670ca-3058-43c6-b6e3-e26ded09312e tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.466592 Jul 23 21:30:35.737025 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2092/4094] 10.222.0.17 () {60 vars in 1158 bytes} [Sat Jul 23 21:30:35 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:30:36.284686 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a35a8fc0-11ce-439a-a2e6-7f4a73ed6b06 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:36.286100 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-a35a8fc0-11ce-439a-a2e6-7f4a73ed6b06 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: f685637e-a804-4266-81a2-67d2e11a60b0] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:36.310095 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a35a8fc0-11ce-439a-a2e6-7f4a73ed6b06 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:36.314521 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a35a8fc0-11ce-439a-a2e6-7f4a73ed6b06 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:36.315826 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a35a8fc0-11ce-439a-a2e6-7f4a73ed6b06 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:36.316292 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a35a8fc0-11ce-439a-a2e6-7f4a73ed6b06 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:36.874613 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-1df889f6-3159-43ef-961d-021d2d1ba0bc tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:30:36.875048 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-1df889f6-3159-43ef-961d-021d2d1ba0bc tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:30:36.875566 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-1df889f6-3159-43ef-961d-021d2d1ba0bc tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:30:36.875979 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-1df889f6-3159-43ef-961d-021d2d1ba0bc tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:30:36.876457 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-1df889f6-3159-43ef-961d-021d2d1ba0bc tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:30:36.913658 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1df889f6-3159-43ef-961d-021d2d1ba0bc tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:36.914587 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1df889f6-3159-43ef-961d-021d2d1ba0bc tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:36.915942 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1df889f6-3159-43ef-961d-021d2d1ba0bc tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:36.918087 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1df889f6-3159-43ef-961d-021d2d1ba0bc tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:36.969716 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-1df889f6-3159-43ef-961d-021d2d1ba0bc tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Getting quotas for project d70f6c96e1ad484aa3207fc01a12d519. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:30:36.989111 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-1df889f6-3159-43ef-961d-021d2d1ba0bc tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Getting quotas for user 6ca9644a73d9468aa39b21548a72bded and project d70f6c96e1ad484aa3207fc01a12d519. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:30:37.019816 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1df889f6-3159-43ef-961d-021d2d1ba0bc tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Going to run 1 instances... {{(pid=131320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:30:37.039688 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1df889f6-3159-43ef-961d-021d2d1ba0bc tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: e74832ce-b06a-4786-b3f3-372e508a4795] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:30:37.164949 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1df889f6-3159-43ef-961d-021d2d1ba0bc tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.830192 Jul 23 21:30:37.168013 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2003/4095] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:30:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1836 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 23 21:30:37.184019 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0accc520-5c0a-4aa0-b1a5-2da6f45d3da4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:37.189116 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-0accc520-5c0a-4aa0-b1a5-2da6f45d3da4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:37.240621 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0accc520-5c0a-4aa0-b1a5-2da6f45d3da4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:37.248998 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0accc520-5c0a-4aa0-b1a5-2da6f45d3da4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:37.252718 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0accc520-5c0a-4aa0-b1a5-2da6f45d3da4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:37.262379 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0accc520-5c0a-4aa0-b1a5-2da6f45d3da4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:37.646591 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-a35a8fc0-11ce-439a-a2e6-7f4a73ed6b06 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:37.671461 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-a35a8fc0-11ce-439a-a2e6-7f4a73ed6b06 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/f685637e-a804-4266-81a2-67d2e11a60b0" status: 200 len: 1309 microversion: 2.1 time: 1.394171 Jul 23 21:30:37.675856 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2093/4096] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:30:36 2022] GET /compute/v2.1/servers/f685637e-a804-4266-81a2-67d2e11a60b0 => generated 1309 bytes in 1402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:30:37.694759 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-9848c798-589f-46ed-bbe9-177b6eca2cec tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:37.713098 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-9848c798-589f-46ed-bbe9-177b6eca2cec tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: e74832ce-b06a-4786-b3f3-372e508a4795] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:37.738258 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-0accc520-5c0a-4aa0-b1a5-2da6f45d3da4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:37.828164 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-0accc520-5c0a-4aa0-b1a5-2da6f45d3da4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:37.833352 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-0accc520-5c0a-4aa0-b1a5-2da6f45d3da4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:37.839506 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-0accc520-5c0a-4aa0-b1a5-2da6f45d3da4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.668997 Jul 23 21:30:37.855039 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2004/4097] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:30:37 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:30:37.867941 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-a3614032-147d-4ed0-a560-260da4ce4caf req-17a4f012-00f8-43cf-85fd-ce7cb293436d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f685637e-a804-4266-81a2-67d2e11a60b0", "name": "network-vif-plugged", "status": "completed", "tag": "bcbda1a6-1f30-4122-9a97-0aac7286f268"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:30:37.896421 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-a3614032-147d-4ed0-a560-260da4ce4caf req-17a4f012-00f8-43cf-85fd-ce7cb293436d service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:37.897396 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-a3614032-147d-4ed0-a560-260da4ce4caf req-17a4f012-00f8-43cf-85fd-ce7cb293436d service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:37.939804 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-a3614032-147d-4ed0-a560-260da4ce4caf req-17a4f012-00f8-43cf-85fd-ce7cb293436d service nova] Creating event network-vif-plugged:bcbda1a6-1f30-4122-9a97-0aac7286f268 for instance f685637e-a804-4266-81a2-67d2e11a60b0 on nch2-master-1 Jul 23 21:30:37.965228 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-a3614032-147d-4ed0-a560-260da4ce4caf req-17a4f012-00f8-43cf-85fd-ce7cb293436d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107363 Jul 23 21:30:37.967587 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2005/4098] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:30:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:30:38.523754 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-9848c798-589f-46ed-bbe9-177b6eca2cec tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:38.559026 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-9848c798-589f-46ed-bbe9-177b6eca2cec tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/e74832ce-b06a-4786-b3f3-372e508a4795" status: 200 len: 1217 microversion: 2.1 time: 0.877333 Jul 23 21:30:38.570044 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2094/4099] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:30:37 2022] GET /compute/v2.1/servers/e74832ce-b06a-4786-b3f3-372e508a4795 => generated 1217 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:30:38.691408 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d3c7f136-e4c9-4ebc-8341-e968984493c2 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:38.692296 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d3c7f136-e4c9-4ebc-8341-e968984493c2 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: f685637e-a804-4266-81a2-67d2e11a60b0] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:38.718337 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d3c7f136-e4c9-4ebc-8341-e968984493c2 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:38.718966 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d3c7f136-e4c9-4ebc-8341-e968984493c2 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:38.720015 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d3c7f136-e4c9-4ebc-8341-e968984493c2 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:38.720603 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d3c7f136-e4c9-4ebc-8341-e968984493c2 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:38.861698 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-53284178-9944-4415-97bf-b19c082c9e72 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:38.864547 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-53284178-9944-4415-97bf-b19c082c9e72 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:38.879223 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-53284178-9944-4415-97bf-b19c082c9e72 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:38.882647 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-53284178-9944-4415-97bf-b19c082c9e72 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:38.883731 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-53284178-9944-4415-97bf-b19c082c9e72 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:38.886730 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-53284178-9944-4415-97bf-b19c082c9e72 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:39.236029 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-53284178-9944-4415-97bf-b19c082c9e72 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:39.245902 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-53284178-9944-4415-97bf-b19c082c9e72 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:39.250276 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-53284178-9944-4415-97bf-b19c082c9e72 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:39.252134 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-53284178-9944-4415-97bf-b19c082c9e72 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.395832 Jul 23 21:30:39.253486 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2095/4100] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:30:38 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:30:39.588493 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-91aa07ee-43b3-4942-83d9-9d3b5a1bd374 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:39.589398 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-91aa07ee-43b3-4942-83d9-9d3b5a1bd374 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: e74832ce-b06a-4786-b3f3-372e508a4795] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:39.608911 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-91aa07ee-43b3-4942-83d9-9d3b5a1bd374 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:39.609475 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-91aa07ee-43b3-4942-83d9-9d3b5a1bd374 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:39.610369 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-91aa07ee-43b3-4942-83d9-9d3b5a1bd374 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:39.610870 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-91aa07ee-43b3-4942-83d9-9d3b5a1bd374 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:39.923910 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-91aa07ee-43b3-4942-83d9-9d3b5a1bd374 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:39.943077 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-91aa07ee-43b3-4942-83d9-9d3b5a1bd374 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/e74832ce-b06a-4786-b3f3-372e508a4795" status: 200 len: 1277 microversion: 2.1 time: 0.358189 Jul 23 21:30:39.943734 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2096/4101] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:30:39 2022] GET /compute/v2.1/servers/e74832ce-b06a-4786-b3f3-372e508a4795 => generated 1277 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:30:40.271409 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-4dee7e6a-c227-4733-a5fa-e949c17a4d3f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:40.273290 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-4dee7e6a-c227-4733-a5fa-e949c17a4d3f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:40.288212 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4dee7e6a-c227-4733-a5fa-e949c17a4d3f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:40.292284 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4dee7e6a-c227-4733-a5fa-e949c17a4d3f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:40.295213 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4dee7e6a-c227-4733-a5fa-e949c17a4d3f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:40.295855 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4dee7e6a-c227-4733-a5fa-e949c17a4d3f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:40.403990 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d3c7f136-e4c9-4ebc-8341-e968984493c2 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:40.417818 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d3c7f136-e4c9-4ebc-8341-e968984493c2 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/f685637e-a804-4266-81a2-67d2e11a60b0" status: 200 len: 1309 microversion: 2.1 time: 1.730516 Jul 23 21:30:40.419106 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2006/4102] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:30:38 2022] GET /compute/v2.1/servers/f685637e-a804-4266-81a2-67d2e11a60b0 => generated 1309 bytes in 1733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:30:40.426701 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-4dee7e6a-c227-4733-a5fa-e949c17a4d3f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:40.450451 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-4dee7e6a-c227-4733-a5fa-e949c17a4d3f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:40.456024 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-4dee7e6a-c227-4733-a5fa-e949c17a4d3f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:40.457388 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-4dee7e6a-c227-4733-a5fa-e949c17a4d3f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.189454 Jul 23 21:30:40.459080 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2097/4103] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:30:40 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:30:40.965787 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-78064abe-2700-4b72-b654-68baf7c87876 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:40.966539 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-78064abe-2700-4b72-b654-68baf7c87876 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: e74832ce-b06a-4786-b3f3-372e508a4795] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:40.989027 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-78064abe-2700-4b72-b654-68baf7c87876 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:40.989495 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-78064abe-2700-4b72-b654-68baf7c87876 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:40.990380 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-78064abe-2700-4b72-b654-68baf7c87876 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:40.994164 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-78064abe-2700-4b72-b654-68baf7c87876 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:41.255604 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-78064abe-2700-4b72-b654-68baf7c87876 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:41.266931 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-78064abe-2700-4b72-b654-68baf7c87876 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/e74832ce-b06a-4786-b3f3-372e508a4795" status: 200 len: 1275 microversion: 2.1 time: 0.309106 Jul 23 21:30:41.283399 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2007/4104] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:30:40 2022] GET /compute/v2.1/servers/e74832ce-b06a-4786-b3f3-372e508a4795 => generated 1275 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:30:41.439672 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-be327962-bf0e-4b62-92f0-9a8c7994f82c tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:41.440465 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-be327962-bf0e-4b62-92f0-9a8c7994f82c tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: f685637e-a804-4266-81a2-67d2e11a60b0] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:41.462786 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-be327962-bf0e-4b62-92f0-9a8c7994f82c tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:41.464099 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-be327962-bf0e-4b62-92f0-9a8c7994f82c tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:41.467351 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-be327962-bf0e-4b62-92f0-9a8c7994f82c tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:41.472297 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-be327962-bf0e-4b62-92f0-9a8c7994f82c tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:41.477138 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-325fd726-9a6f-445d-ba41-73033c2bbf21 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:41.479053 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-325fd726-9a6f-445d-ba41-73033c2bbf21 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:41.496471 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-325fd726-9a6f-445d-ba41-73033c2bbf21 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:41.496860 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-325fd726-9a6f-445d-ba41-73033c2bbf21 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:41.497670 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-325fd726-9a6f-445d-ba41-73033c2bbf21 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:41.503887 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-325fd726-9a6f-445d-ba41-73033c2bbf21 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:41.570033 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=100 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:30:41.849957 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-325fd726-9a6f-445d-ba41-73033c2bbf21 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:41.858993 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-be327962-bf0e-4b62-92f0-9a8c7994f82c tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:41.866045 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-325fd726-9a6f-445d-ba41-73033c2bbf21 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:41.871586 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-325fd726-9a6f-445d-ba41-73033c2bbf21 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:41.873065 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-be327962-bf0e-4b62-92f0-9a8c7994f82c tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/f685637e-a804-4266-81a2-67d2e11a60b0" status: 200 len: 1491 microversion: 2.1 time: 0.441983 Jul 23 21:30:41.873190 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-325fd726-9a6f-445d-ba41-73033c2bbf21 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.399837 Jul 23 21:30:41.873698 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2098/4105] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:30:41 2022] GET /compute/v2.1/servers/f685637e-a804-4266-81a2-67d2e11a60b0 => generated 1491 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:30:41.875658 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2008/4106] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:30:41 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:30:42.136080 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-9318b7f4-5677-43cf-a23b-9491f49468a5 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1936166309", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "networks": [{"uuid": "63d253f9-5d83-4f00-8bc3-28f418cf7611"}]}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:30:42.261656 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.network.neutron [None req-9318b7f4-5677-43cf-a23b-9491f49468a5 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] validate_networks() for [('63d253f9-5d83-4f00-8bc3-28f418cf7611', None, None, None, None, None)] {{(pid=131321) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:30:42.300657 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a17c020e-557b-45aa-83b1-df0739f4a3a6 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:42.301363 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a17c020e-557b-45aa-83b1-df0739f4a3a6 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: e74832ce-b06a-4786-b3f3-372e508a4795] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:42.324704 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a17c020e-557b-45aa-83b1-df0739f4a3a6 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:42.325211 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a17c020e-557b-45aa-83b1-df0739f4a3a6 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:42.328896 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a17c020e-557b-45aa-83b1-df0739f4a3a6 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:42.330841 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a17c020e-557b-45aa-83b1-df0739f4a3a6 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:42.736819 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a17c020e-557b-45aa-83b1-df0739f4a3a6 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:42.786519 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a17c020e-557b-45aa-83b1-df0739f4a3a6 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/e74832ce-b06a-4786-b3f3-372e508a4795" status: 200 len: 1275 microversion: 2.1 time: 0.489926 Jul 23 21:30:42.792802 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2009/4107] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:30:42 2022] GET /compute/v2.1/servers/e74832ce-b06a-4786-b3f3-372e508a4795 => generated 1275 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:30:42.897170 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-7dcb03b8-4811-4c97-9c0e-09447fe78f07 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:42.898899 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-7dcb03b8-4811-4c97-9c0e-09447fe78f07 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:42.918263 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7dcb03b8-4811-4c97-9c0e-09447fe78f07 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:42.918726 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7dcb03b8-4811-4c97-9c0e-09447fe78f07 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:42.919528 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7dcb03b8-4811-4c97-9c0e-09447fe78f07 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:42.920111 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7dcb03b8-4811-4c97-9c0e-09447fe78f07 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:43.291581 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-7dcb03b8-4811-4c97-9c0e-09447fe78f07 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:43.319703 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-7dcb03b8-4811-4c97-9c0e-09447fe78f07 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:43.326336 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-7dcb03b8-4811-4c97-9c0e-09447fe78f07 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:43.326709 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-7dcb03b8-4811-4c97-9c0e-09447fe78f07 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.437896 Jul 23 21:30:43.327856 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2010/4108] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:30:42 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:30:43.812380 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-042cd344-6637-4070-a17c-613611760bf5 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:43.813204 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-042cd344-6637-4070-a17c-613611760bf5 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: e74832ce-b06a-4786-b3f3-372e508a4795] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:43.822743 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-042cd344-6637-4070-a17c-613611760bf5 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:43.824137 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-042cd344-6637-4070-a17c-613611760bf5 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:43.824960 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-042cd344-6637-4070-a17c-613611760bf5 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:43.832807 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-042cd344-6637-4070-a17c-613611760bf5 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:44.227257 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-042cd344-6637-4070-a17c-613611760bf5 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:44.236354 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-042cd344-6637-4070-a17c-613611760bf5 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/e74832ce-b06a-4786-b3f3-372e508a4795" status: 200 len: 1275 microversion: 2.1 time: 0.429101 Jul 23 21:30:44.251509 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2011/4109] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:30:43 2022] GET /compute/v2.1/servers/e74832ce-b06a-4786-b3f3-372e508a4795 => generated 1275 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:30:44.347778 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f01a2137-cf92-4f01-95f3-685bafd33af7 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:44.349679 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f01a2137-cf92-4f01-95f3-685bafd33af7 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:44.379693 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f01a2137-cf92-4f01-95f3-685bafd33af7 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:44.380531 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f01a2137-cf92-4f01-95f3-685bafd33af7 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:44.387936 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f01a2137-cf92-4f01-95f3-685bafd33af7 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:44.394930 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f01a2137-cf92-4f01-95f3-685bafd33af7 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:44.546331 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-9318b7f4-5677-43cf-a23b-9491f49468a5 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Flavor limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:30:44.546962 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-9318b7f4-5677-43cf-a23b-9491f49468a5 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Image limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:30:44.547195 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-9318b7f4-5677-43cf-a23b-9491f49468a5 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Flavor pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:30:44.548020 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-9318b7f4-5677-43cf-a23b-9491f49468a5 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Image pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:30:44.548590 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-9318b7f4-5677-43cf-a23b-9491f49468a5 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:30:44.553420 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:30:44.572402 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9318b7f4-5677-43cf-a23b-9491f49468a5 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:44.573003 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9318b7f4-5677-43cf-a23b-9491f49468a5 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:44.580568 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9318b7f4-5677-43cf-a23b-9491f49468a5 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:44.581266 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9318b7f4-5677-43cf-a23b-9491f49468a5 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:44.638128 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-9318b7f4-5677-43cf-a23b-9491f49468a5 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Getting quotas for project 1890022bd460485dae0ea94b152a6746. Resources: {'ram', 'instances', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:30:44.653643 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-9318b7f4-5677-43cf-a23b-9491f49468a5 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Getting quotas for user 5efda1c40f494592bf1e6af1add120f3 and project 1890022bd460485dae0ea94b152a6746. Resources: {'ram', 'instances', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:30:44.694741 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-9318b7f4-5677-43cf-a23b-9491f49468a5 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Going to run 1 instances... {{(pid=131321) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:30:44.698433 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-9318b7f4-5677-43cf-a23b-9491f49468a5 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: fc75dd20-e6e4-4484-b715-2251c593c9e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131321) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:30:44.860614 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-9318b7f4-5677-43cf-a23b-9491f49468a5 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.730316 Jul 23 21:30:44.866050 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2099/4110] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:30:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 2737 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 23 21:30:44.879484 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c35c6f01-6ff9-4600-b8c4-a1d61aa24060 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:44.887448 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-c35c6f01-6ff9-4600-b8c4-a1d61aa24060 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: fc75dd20-e6e4-4484-b715-2251c593c9e5] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:45.041200 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c35c6f01-6ff9-4600-b8c4-a1d61aa24060 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:45.076743 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-c35c6f01-6ff9-4600-b8c4-a1d61aa24060 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75dd20-e6e4-4484-b715-2251c593c9e5" status: 200 len: 1209 microversion: 2.1 time: 0.200258 Jul 23 21:30:45.079465 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2100/4111] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:30:44 2022] GET /compute/v2.1/servers/fc75dd20-e6e4-4484-b715-2251c593c9e5 => generated 1209 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:30:45.260728 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-7ff91195-8c78-436c-a468-5044b5c71b77 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:45.261607 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-7ff91195-8c78-436c-a468-5044b5c71b77 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: e74832ce-b06a-4786-b3f3-372e508a4795] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:45.274599 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7ff91195-8c78-436c-a468-5044b5c71b77 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:45.277470 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7ff91195-8c78-436c-a468-5044b5c71b77 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:45.278802 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7ff91195-8c78-436c-a468-5044b5c71b77 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:45.282678 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7ff91195-8c78-436c-a468-5044b5c71b77 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:45.432852 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f01a2137-cf92-4f01-95f3-685bafd33af7 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:45.470091 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f01a2137-cf92-4f01-95f3-685bafd33af7 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:45.470623 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f01a2137-cf92-4f01-95f3-685bafd33af7 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:45.471848 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f01a2137-cf92-4f01-95f3-685bafd33af7 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 1.129208 Jul 23 21:30:45.507116 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2012/4112] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:30:44 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:30:45.837022 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-76e50673-8ee9-486a-8171-f575ad5a1007 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-432891436", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e6510bf5-c62e-46e0-81de-3e26ff603612"}], "security_groups": [{"name": "tempest-securitygroup--333826858"}], "key_name": "tempest-keypair-439558644", "user_data": "}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:30:46.052508 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-76e50673-8ee9-486a-8171-f575ad5a1007 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] validate_networks() for [('e6510bf5-c62e-46e0-81de-3e26ff603612', None, None, None, None, None)] {{(pid=131320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:30:46.181163 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-7ff91195-8c78-436c-a468-5044b5c71b77 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:46.212676 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-7ff91195-8c78-436c-a468-5044b5c71b77 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/e74832ce-b06a-4786-b3f3-372e508a4795" status: 200 len: 1317 microversion: 2.1 time: 0.956119 Jul 23 21:30:46.219287 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2101/4113] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:30:45 2022] GET /compute/v2.1/servers/e74832ce-b06a-4786-b3f3-372e508a4795 => generated 1317 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:30:46.234245 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-576725ec-5e01-443c-9dbc-17b63afaabb3 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:46.237244 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-576725ec-5e01-443c-9dbc-17b63afaabb3 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: fc75dd20-e6e4-4484-b715-2251c593c9e5] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:46.260630 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-576725ec-5e01-443c-9dbc-17b63afaabb3 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:46.262158 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-576725ec-5e01-443c-9dbc-17b63afaabb3 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:46.263134 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-576725ec-5e01-443c-9dbc-17b63afaabb3 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:46.264401 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-576725ec-5e01-443c-9dbc-17b63afaabb3 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:46.515321 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-576725ec-5e01-443c-9dbc-17b63afaabb3 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:46.530758 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-576725ec-5e01-443c-9dbc-17b63afaabb3 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75dd20-e6e4-4484-b715-2251c593c9e5" status: 200 len: 1205 microversion: 2.1 time: 0.305470 Jul 23 21:30:46.531653 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2102/4114] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:30:46 2022] GET /compute/v2.1/servers/fc75dd20-e6e4-4484-b715-2251c593c9e5 => generated 1205 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:30:46.538410 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-9915ede7-8987-4b2e-9d34-1483c0b2c8e5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:46.539430 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-9915ede7-8987-4b2e-9d34-1483c0b2c8e5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:46.552857 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9915ede7-8987-4b2e-9d34-1483c0b2c8e5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:46.553640 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9915ede7-8987-4b2e-9d34-1483c0b2c8e5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:46.555630 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9915ede7-8987-4b2e-9d34-1483c0b2c8e5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:46.556145 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9915ede7-8987-4b2e-9d34-1483c0b2c8e5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:46.946520 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:30:46.996302 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=6 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:30:47.106839 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-9915ede7-8987-4b2e-9d34-1483c0b2c8e5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:47.126558 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-9915ede7-8987-4b2e-9d34-1483c0b2c8e5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:47.128461 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-9915ede7-8987-4b2e-9d34-1483c0b2c8e5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:47.131297 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-9915ede7-8987-4b2e-9d34-1483c0b2c8e5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.598488 Jul 23 21:30:47.132109 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2103/4115] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:30:46 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:30:47.234483 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-092b3e72-0f25-4440-83e0-9206e6ea56c0 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:47.235370 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-092b3e72-0f25-4440-83e0-9206e6ea56c0 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: e74832ce-b06a-4786-b3f3-372e508a4795] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:47.250581 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-092b3e72-0f25-4440-83e0-9206e6ea56c0 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:47.251284 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-092b3e72-0f25-4440-83e0-9206e6ea56c0 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:47.252220 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-092b3e72-0f25-4440-83e0-9206e6ea56c0 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:47.253012 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-092b3e72-0f25-4440-83e0-9206e6ea56c0 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:47.693088 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-76e50673-8ee9-486a-8171-f575ad5a1007 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:30:47.693900 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-76e50673-8ee9-486a-8171-f575ad5a1007 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:30:47.699536 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-76e50673-8ee9-486a-8171-f575ad5a1007 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:30:47.700720 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-76e50673-8ee9-486a-8171-f575ad5a1007 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:30:47.701735 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-76e50673-8ee9-486a-8171-f575ad5a1007 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:30:47.721238 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-76e50673-8ee9-486a-8171-f575ad5a1007 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:47.721700 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-76e50673-8ee9-486a-8171-f575ad5a1007 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:47.745106 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-76e50673-8ee9-486a-8171-f575ad5a1007 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:47.745573 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-76e50673-8ee9-486a-8171-f575ad5a1007 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:47.784298 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-76e50673-8ee9-486a-8171-f575ad5a1007 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Getting quotas for project ebcf55bcaba04bf8ae8a9b2ac09e8d98. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:30:47.798030 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-76e50673-8ee9-486a-8171-f575ad5a1007 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Getting quotas for user 37b1e260651b4dffa7c1efe8e9d0f144 and project ebcf55bcaba04bf8ae8a9b2ac09e8d98. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:30:47.837478 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-76e50673-8ee9-486a-8171-f575ad5a1007 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Going to run 1 instances... {{(pid=131320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:30:47.844657 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-76e50673-8ee9-486a-8171-f575ad5a1007 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] [instance: b90d9c54-1b5f-40db-acc6-67aaf46def15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:30:47.928094 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-76e50673-8ee9-486a-8171-f575ad5a1007 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.096012 Jul 23 21:30:47.929074 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2013/4116] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:30:45 2022] POST /compute/v2.1/servers => generated 401 bytes in 2100 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 23 21:30:47.940270 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-036f802e-e775-4ce5-8c0e-22a030b9c015 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:47.940757 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-036f802e-e775-4ce5-8c0e-22a030b9c015 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: fc75dd20-e6e4-4484-b715-2251c593c9e5] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:47.959148 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-036f802e-e775-4ce5-8c0e-22a030b9c015 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:47.962382 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-036f802e-e775-4ce5-8c0e-22a030b9c015 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:47.980545 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-036f802e-e775-4ce5-8c0e-22a030b9c015 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:47.982996 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-036f802e-e775-4ce5-8c0e-22a030b9c015 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:48.234820 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-036f802e-e775-4ce5-8c0e-22a030b9c015 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:48.251134 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-036f802e-e775-4ce5-8c0e-22a030b9c015 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75dd20-e6e4-4484-b715-2251c593c9e5" status: 200 len: 1267 microversion: 2.1 time: 0.320297 Jul 23 21:30:48.252445 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2014/4117] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:30:47 2022] GET /compute/v2.1/servers/fc75dd20-e6e4-4484-b715-2251c593c9e5 => generated 1267 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:30:48.256959 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-7589474d-f475-4e62-881b-22dcc363371d tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:48.257549 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-7589474d-f475-4e62-881b-22dcc363371d tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] [instance: b90d9c54-1b5f-40db-acc6-67aaf46def15] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:48.348236 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-092b3e72-0f25-4440-83e0-9206e6ea56c0 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:48.361004 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-092b3e72-0f25-4440-83e0-9206e6ea56c0 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/e74832ce-b06a-4786-b3f3-372e508a4795" status: 200 len: 1317 microversion: 2.1 time: 1.131531 Jul 23 21:30:48.361606 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2104/4118] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:30:47 2022] GET /compute/v2.1/servers/e74832ce-b06a-4786-b3f3-372e508a4795 => generated 1317 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:30:48.375129 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c8bf1e12-c49a-4fb9-8496-9759454e1d7c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:48.376042 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-c8bf1e12-c49a-4fb9-8496-9759454e1d7c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:48.386300 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-7589474d-f475-4e62-881b-22dcc363371d tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b1e260651b4dffa7c1efe8e9d0f144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcf55bcaba04bf8ae8a9b2ac09e8d98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:48.394256 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-7589474d-f475-4e62-881b-22dcc363371d tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] 10.222.0.17 "GET /compute/v2.1/servers/b90d9c54-1b5f-40db-acc6-67aaf46def15" status: 200 len: 1240 microversion: 2.1 time: 0.140916 Jul 23 21:30:48.394852 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2015/4119] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:30:48 2022] GET /compute/v2.1/servers/b90d9c54-1b5f-40db-acc6-67aaf46def15 => generated 1240 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:30:48.398142 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c8bf1e12-c49a-4fb9-8496-9759454e1d7c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:48.398606 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c8bf1e12-c49a-4fb9-8496-9759454e1d7c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:48.399411 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c8bf1e12-c49a-4fb9-8496-9759454e1d7c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:48.399856 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c8bf1e12-c49a-4fb9-8496-9759454e1d7c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:48.521676 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-f9384da2-4f5d-46e2-915c-7a0d6bee3cfb req-fe258385-0125-4708-b3b2-a2d6a6018566 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e74832ce-b06a-4786-b3f3-372e508a4795", "tag": "2aad6658-7072-4fc3-afd1-3d912d7e1da3"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:30:48.528252 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:30:48.534068 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-f9384da2-4f5d-46e2-915c-7a0d6bee3cfb req-fe258385-0125-4708-b3b2-a2d6a6018566 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:48.534800 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-f9384da2-4f5d-46e2-915c-7a0d6bee3cfb req-fe258385-0125-4708-b3b2-a2d6a6018566 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:48.551318 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-f9384da2-4f5d-46e2-915c-7a0d6bee3cfb req-fe258385-0125-4708-b3b2-a2d6a6018566 service nova] Creating event network-changed:2aad6658-7072-4fc3-afd1-3d912d7e1da3 for instance e74832ce-b06a-4786-b3f3-372e508a4795 on nch2-master-1 Jul 23 21:30:48.558929 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-f9384da2-4f5d-46e2-915c-7a0d6bee3cfb req-fe258385-0125-4708-b3b2-a2d6a6018566 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041740 Jul 23 21:30:48.564142 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2016/4120] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:30:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:30:48.752821 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c8bf1e12-c49a-4fb9-8496-9759454e1d7c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:48.768438 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c8bf1e12-c49a-4fb9-8496-9759454e1d7c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:48.778399 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c8bf1e12-c49a-4fb9-8496-9759454e1d7c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:48.780070 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-c8bf1e12-c49a-4fb9-8496-9759454e1d7c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.417088 Jul 23 21:30:48.785612 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2105/4121] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:30:48 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:30:49.271472 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-06d7a609-a2ff-41fd-b5b7-a628b2fb9a24 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:49.272199 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-06d7a609-a2ff-41fd-b5b7-a628b2fb9a24 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: fc75dd20-e6e4-4484-b715-2251c593c9e5] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:49.283966 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-06d7a609-a2ff-41fd-b5b7-a628b2fb9a24 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:49.284430 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-06d7a609-a2ff-41fd-b5b7-a628b2fb9a24 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:49.285232 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-06d7a609-a2ff-41fd-b5b7-a628b2fb9a24 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:49.285678 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-06d7a609-a2ff-41fd-b5b7-a628b2fb9a24 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:49.382345 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-1888acb2-9104-4f7a-96b6-6c5172c4b956 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:49.383002 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-1888acb2-9104-4f7a-96b6-6c5172c4b956 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: e74832ce-b06a-4786-b3f3-372e508a4795] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:49.397612 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1888acb2-9104-4f7a-96b6-6c5172c4b956 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:49.398406 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1888acb2-9104-4f7a-96b6-6c5172c4b956 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:49.399410 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1888acb2-9104-4f7a-96b6-6c5172c4b956 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:49.406936 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1888acb2-9104-4f7a-96b6-6c5172c4b956 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:49.480899 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-06d7a609-a2ff-41fd-b5b7-a628b2fb9a24 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:49.500853 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-06d7a609-a2ff-41fd-b5b7-a628b2fb9a24 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75dd20-e6e4-4484-b715-2251c593c9e5" status: 200 len: 1267 microversion: 2.1 time: 0.235454 Jul 23 21:30:49.502353 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2017/4122] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:30:49 2022] GET /compute/v2.1/servers/fc75dd20-e6e4-4484-b715-2251c593c9e5 => generated 1267 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:30:49.507777 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-94f23241-3c42-43f5-9caa-44e24ac77435 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:49.508925 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-94f23241-3c42-43f5-9caa-44e24ac77435 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] [instance: b90d9c54-1b5f-40db-acc6-67aaf46def15] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:49.516197 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-94f23241-3c42-43f5-9caa-44e24ac77435 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:49.516656 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-94f23241-3c42-43f5-9caa-44e24ac77435 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:49.517414 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-94f23241-3c42-43f5-9caa-44e24ac77435 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:49.518084 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-94f23241-3c42-43f5-9caa-44e24ac77435 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:49.618774 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-94f23241-3c42-43f5-9caa-44e24ac77435 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b1e260651b4dffa7c1efe8e9d0f144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcf55bcaba04bf8ae8a9b2ac09e8d98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:49.630631 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-94f23241-3c42-43f5-9caa-44e24ac77435 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] 10.222.0.17 "GET /compute/v2.1/servers/b90d9c54-1b5f-40db-acc6-67aaf46def15" status: 200 len: 1292 microversion: 2.1 time: 0.126592 Jul 23 21:30:49.647986 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2018/4123] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:30:49 2022] GET /compute/v2.1/servers/b90d9c54-1b5f-40db-acc6-67aaf46def15 => generated 1292 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:30:49.807309 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-40215934-35e6-4ded-8eb8-70366110ab85 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:49.808929 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-40215934-35e6-4ded-8eb8-70366110ab85 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:49.828345 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-40215934-35e6-4ded-8eb8-70366110ab85 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:49.829052 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-40215934-35e6-4ded-8eb8-70366110ab85 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:49.830092 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-40215934-35e6-4ded-8eb8-70366110ab85 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:49.832312 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-40215934-35e6-4ded-8eb8-70366110ab85 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:49.850198 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=100 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:30:49.930550 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-40215934-35e6-4ded-8eb8-70366110ab85 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:49.945431 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-40215934-35e6-4ded-8eb8-70366110ab85 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:49.949356 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-40215934-35e6-4ded-8eb8-70366110ab85 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:49.950782 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-40215934-35e6-4ded-8eb8-70366110ab85 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.150987 Jul 23 21:30:49.952440 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2019/4124] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:30:49 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:30:50.518884 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f8694d4e-ac74-4221-a178-9e78a4a73c69 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:50.520189 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f8694d4e-ac74-4221-a178-9e78a4a73c69 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: fc75dd20-e6e4-4484-b715-2251c593c9e5] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:50.531301 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f8694d4e-ac74-4221-a178-9e78a4a73c69 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:50.531788 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f8694d4e-ac74-4221-a178-9e78a4a73c69 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:50.532419 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f8694d4e-ac74-4221-a178-9e78a4a73c69 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:50.532883 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f8694d4e-ac74-4221-a178-9e78a4a73c69 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:50.699036 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-1888acb2-9104-4f7a-96b6-6c5172c4b956 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:50.724913 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-1888acb2-9104-4f7a-96b6-6c5172c4b956 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/e74832ce-b06a-4786-b3f3-372e508a4795" status: 200 len: 1317 microversion: 2.1 time: 1.347435 Jul 23 21:30:50.730648 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2106/4125] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:30:49 2022] GET /compute/v2.1/servers/e74832ce-b06a-4786-b3f3-372e508a4795 => generated 1317 bytes in 1356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:30:50.762983 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f24a2501-e96f-4663-ad18-d9eb246fe1ef tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:50.770598 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-f24a2501-e96f-4663-ad18-d9eb246fe1ef tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] [instance: b90d9c54-1b5f-40db-acc6-67aaf46def15] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:50.797791 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f24a2501-e96f-4663-ad18-d9eb246fe1ef tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:50.801745 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f24a2501-e96f-4663-ad18-d9eb246fe1ef tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:50.808123 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f24a2501-e96f-4663-ad18-d9eb246fe1ef tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:50.810307 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f24a2501-e96f-4663-ad18-d9eb246fe1ef tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:51.105712 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-f24a2501-e96f-4663-ad18-d9eb246fe1ef tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b1e260651b4dffa7c1efe8e9d0f144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcf55bcaba04bf8ae8a9b2ac09e8d98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:51.121187 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-f24a2501-e96f-4663-ad18-d9eb246fe1ef tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] 10.222.0.17 "GET /compute/v2.1/servers/b90d9c54-1b5f-40db-acc6-67aaf46def15" status: 200 len: 1298 microversion: 2.1 time: 0.382255 Jul 23 21:30:51.122645 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2107/4126] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:30:50 2022] GET /compute/v2.1/servers/b90d9c54-1b5f-40db-acc6-67aaf46def15 => generated 1298 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:30:51.127733 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-aa370c74-4cc8-46e2-a040-2628591cc723 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:51.135870 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-aa370c74-4cc8-46e2-a040-2628591cc723 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:51.150917 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-aa370c74-4cc8-46e2-a040-2628591cc723 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:51.153612 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-aa370c74-4cc8-46e2-a040-2628591cc723 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:51.154833 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-aa370c74-4cc8-46e2-a040-2628591cc723 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:51.158198 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-aa370c74-4cc8-46e2-a040-2628591cc723 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:51.424468 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-aa370c74-4cc8-46e2-a040-2628591cc723 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:51.450569 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-aa370c74-4cc8-46e2-a040-2628591cc723 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:51.452125 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-aa370c74-4cc8-46e2-a040-2628591cc723 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:51.459389 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-aa370c74-4cc8-46e2-a040-2628591cc723 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.334348 Jul 23 21:30:51.462227 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2108/4127] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:30:51 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:30:51.534070 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f8694d4e-ac74-4221-a178-9e78a4a73c69 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:51.547967 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f8694d4e-ac74-4221-a178-9e78a4a73c69 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75dd20-e6e4-4484-b715-2251c593c9e5" status: 200 len: 1309 microversion: 2.1 time: 1.032554 Jul 23 21:30:51.548632 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2020/4128] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:30:50 2022] GET /compute/v2.1/servers/fc75dd20-e6e4-4484-b715-2251c593c9e5 => generated 1309 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:30:51.744582 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-46c2e6d2-75f0-4867-b3f1-3dbffa8d5b56 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:51.745202 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-46c2e6d2-75f0-4867-b3f1-3dbffa8d5b56 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: e74832ce-b06a-4786-b3f3-372e508a4795] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:51.767602 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-46c2e6d2-75f0-4867-b3f1-3dbffa8d5b56 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:51.768063 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-46c2e6d2-75f0-4867-b3f1-3dbffa8d5b56 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:51.768870 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-46c2e6d2-75f0-4867-b3f1-3dbffa8d5b56 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:51.769315 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-46c2e6d2-75f0-4867-b3f1-3dbffa8d5b56 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:52.139209 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-49164388-b474-4354-b306-dcd7efc9da00 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:52.140317 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-49164388-b474-4354-b306-dcd7efc9da00 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] [instance: b90d9c54-1b5f-40db-acc6-67aaf46def15] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:52.160163 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-49164388-b474-4354-b306-dcd7efc9da00 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:52.160909 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-49164388-b474-4354-b306-dcd7efc9da00 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:52.161854 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-49164388-b474-4354-b306-dcd7efc9da00 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:52.162465 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-49164388-b474-4354-b306-dcd7efc9da00 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:52.947305 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-46c2e6d2-75f0-4867-b3f1-3dbffa8d5b56 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:52.955834 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-46c2e6d2-75f0-4867-b3f1-3dbffa8d5b56 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/e74832ce-b06a-4786-b3f3-372e508a4795" status: 200 len: 1317 microversion: 2.1 time: 1.215116 Jul 23 21:30:52.958964 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2109/4129] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:30:51 2022] GET /compute/v2.1/servers/e74832ce-b06a-4786-b3f3-372e508a4795 => generated 1317 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:30:52.963713 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-49164388-b474-4354-b306-dcd7efc9da00 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b1e260651b4dffa7c1efe8e9d0f144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcf55bcaba04bf8ae8a9b2ac09e8d98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:52.982959 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-49164388-b474-4354-b306-dcd7efc9da00 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] 10.222.0.17 "GET /compute/v2.1/servers/b90d9c54-1b5f-40db-acc6-67aaf46def15" status: 200 len: 1298 microversion: 2.1 time: 0.845037 Jul 23 21:30:52.989930 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2021/4130] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:30:52 2022] GET /compute/v2.1/servers/b90d9c54-1b5f-40db-acc6-67aaf46def15 => generated 1298 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:30:52.994481 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-59040b61-713c-45bd-9e2b-efec1cb795bf tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:53.001165 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-59040b61-713c-45bd-9e2b-efec1cb795bf tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:53.028001 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-dce09d63-2621-4eff-8c08-0f2d2c3cd7b8 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:53.030344 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-dce09d63-2621-4eff-8c08-0f2d2c3cd7b8 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: fc75dd20-e6e4-4484-b715-2251c593c9e5] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:53.037118 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-59040b61-713c-45bd-9e2b-efec1cb795bf tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:53.039823 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-59040b61-713c-45bd-9e2b-efec1cb795bf tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:53.040894 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-59040b61-713c-45bd-9e2b-efec1cb795bf tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:53.041831 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-59040b61-713c-45bd-9e2b-efec1cb795bf tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:53.045323 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dce09d63-2621-4eff-8c08-0f2d2c3cd7b8 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:53.050880 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dce09d63-2621-4eff-8c08-0f2d2c3cd7b8 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:53.053273 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dce09d63-2621-4eff-8c08-0f2d2c3cd7b8 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:53.059328 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dce09d63-2621-4eff-8c08-0f2d2c3cd7b8 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:53.278644 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-59040b61-713c-45bd-9e2b-efec1cb795bf tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:53.300777 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-59040b61-713c-45bd-9e2b-efec1cb795bf tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:53.307998 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-59040b61-713c-45bd-9e2b-efec1cb795bf tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:53.311143 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-59040b61-713c-45bd-9e2b-efec1cb795bf tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.335614 Jul 23 21:30:53.315743 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2110/4131] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:30:52 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:30:53.627204 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-dce09d63-2621-4eff-8c08-0f2d2c3cd7b8 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:53.639499 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-dce09d63-2621-4eff-8c08-0f2d2c3cd7b8 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75dd20-e6e4-4484-b715-2251c593c9e5" status: 200 len: 1309 microversion: 2.1 time: 0.647852 Jul 23 21:30:53.640108 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2022/4132] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:30:52 2022] GET /compute/v2.1/servers/fc75dd20-e6e4-4484-b715-2251c593c9e5 => generated 1309 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:30:53.975496 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-2289a34d-0ed4-4a78-bae8-d9c23e88f97a tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:53.976716 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-2289a34d-0ed4-4a78-bae8-d9c23e88f97a tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: e74832ce-b06a-4786-b3f3-372e508a4795] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:53.989455 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2289a34d-0ed4-4a78-bae8-d9c23e88f97a tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:53.990290 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2289a34d-0ed4-4a78-bae8-d9c23e88f97a tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:54.002593 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-96570216-2167-4dda-bc85-8752b5c86a8d tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:54.003807 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-96570216-2167-4dda-bc85-8752b5c86a8d tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] [instance: b90d9c54-1b5f-40db-acc6-67aaf46def15] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:54.007605 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2289a34d-0ed4-4a78-bae8-d9c23e88f97a tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:54.010270 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2289a34d-0ed4-4a78-bae8-d9c23e88f97a tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:54.012655 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-96570216-2167-4dda-bc85-8752b5c86a8d tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:54.017448 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-96570216-2167-4dda-bc85-8752b5c86a8d tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:54.018540 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-96570216-2167-4dda-bc85-8752b5c86a8d tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:54.026640 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-96570216-2167-4dda-bc85-8752b5c86a8d tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:54.416215 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-96570216-2167-4dda-bc85-8752b5c86a8d tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b1e260651b4dffa7c1efe8e9d0f144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcf55bcaba04bf8ae8a9b2ac09e8d98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:54.431674 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-96570216-2167-4dda-bc85-8752b5c86a8d tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] 10.222.0.17 "GET /compute/v2.1/servers/b90d9c54-1b5f-40db-acc6-67aaf46def15" status: 200 len: 1365 microversion: 2.1 time: 0.433003 Jul 23 21:30:54.432867 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2023/4133] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:30:53 2022] GET /compute/v2.1/servers/b90d9c54-1b5f-40db-acc6-67aaf46def15 => generated 1365 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:30:54.438662 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-74a0cbf5-2189-4a63-85e3-61d0c0ffb6db tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:54.442386 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-74a0cbf5-2189-4a63-85e3-61d0c0ffb6db tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:54.458417 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-74a0cbf5-2189-4a63-85e3-61d0c0ffb6db tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:54.462121 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-74a0cbf5-2189-4a63-85e3-61d0c0ffb6db tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:54.463238 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-74a0cbf5-2189-4a63-85e3-61d0c0ffb6db tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:54.463879 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-74a0cbf5-2189-4a63-85e3-61d0c0ffb6db tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:54.614096 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell0:SELECT=2 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:30:54.644134 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-74a0cbf5-2189-4a63-85e3-61d0c0ffb6db tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:54.656980 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-74a0cbf5-2189-4a63-85e3-61d0c0ffb6db tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:54.658726 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-74a0cbf5-2189-4a63-85e3-61d0c0ffb6db tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:54.659980 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-74a0cbf5-2189-4a63-85e3-61d0c0ffb6db tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.225870 Jul 23 21:30:54.660567 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2024/4134] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:30:54 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:30:54.676033 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2c990676-e1cb-41c4-8f1a-2b13169a698b tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:54.676872 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-2c990676-e1cb-41c4-8f1a-2b13169a698b tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: fc75dd20-e6e4-4484-b715-2251c593c9e5] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:54.690009 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2c990676-e1cb-41c4-8f1a-2b13169a698b tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:54.690466 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2c990676-e1cb-41c4-8f1a-2b13169a698b tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:54.694790 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2c990676-e1cb-41c4-8f1a-2b13169a698b tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:54.695248 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2c990676-e1cb-41c4-8f1a-2b13169a698b tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:54.954022 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-2289a34d-0ed4-4a78-bae8-d9c23e88f97a tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:54.972068 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-2289a34d-0ed4-4a78-bae8-d9c23e88f97a tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/e74832ce-b06a-4786-b3f3-372e508a4795" status: 200 len: 1317 microversion: 2.1 time: 1.000253 Jul 23 21:30:54.994359 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2111/4135] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:30:53 2022] GET /compute/v2.1/servers/e74832ce-b06a-4786-b3f3-372e508a4795 => generated 1317 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:30:55.057855 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-2c990676-e1cb-41c4-8f1a-2b13169a698b tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:55.072111 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2c990676-e1cb-41c4-8f1a-2b13169a698b tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75dd20-e6e4-4484-b715-2251c593c9e5" status: 200 len: 1309 microversion: 2.1 time: 0.409736 Jul 23 21:30:55.085937 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2025/4136] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:30:54 2022] GET /compute/v2.1/servers/fc75dd20-e6e4-4484-b715-2251c593c9e5 => generated 1309 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:30:55.452463 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d02bfcd6-13ff-44e1-bb43-08b01df7597f tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:55.454007 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-d02bfcd6-13ff-44e1-bb43-08b01df7597f tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] [instance: b90d9c54-1b5f-40db-acc6-67aaf46def15] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:55.466165 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell0:SELECT=14 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:30:55.469623 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d02bfcd6-13ff-44e1-bb43-08b01df7597f tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:55.470337 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d02bfcd6-13ff-44e1-bb43-08b01df7597f tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:55.474594 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d02bfcd6-13ff-44e1-bb43-08b01df7597f tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:55.475575 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d02bfcd6-13ff-44e1-bb43-08b01df7597f tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:55.653459 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-f1ed2fac-6907-47f3-8e70-3ad539fcb329 req-9ed5ce60-58d1-4dc7-b7dc-e5e45a033592 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc75dd20-e6e4-4484-b715-2251c593c9e5", "tag": "737200ba-4d1d-40c0-aaa2-a478e7e3d2f6"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:30:55.665640 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-f1ed2fac-6907-47f3-8e70-3ad539fcb329 req-9ed5ce60-58d1-4dc7-b7dc-e5e45a033592 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:55.666376 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-f1ed2fac-6907-47f3-8e70-3ad539fcb329 req-9ed5ce60-58d1-4dc7-b7dc-e5e45a033592 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:55.692676 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-f1ed2fac-6907-47f3-8e70-3ad539fcb329 req-9ed5ce60-58d1-4dc7-b7dc-e5e45a033592 service nova] Creating event network-changed:737200ba-4d1d-40c0-aaa2-a478e7e3d2f6 for instance fc75dd20-e6e4-4484-b715-2251c593c9e5 on nch1-master-1 Jul 23 21:30:55.701545 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-f1ed2fac-6907-47f3-8e70-3ad539fcb329 req-9ed5ce60-58d1-4dc7-b7dc-e5e45a033592 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051811 Jul 23 21:30:55.705267 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2026/4137] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:30:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:30:55.715051 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-603df101-414e-4343-9d47-f6a015e53097 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:55.717248 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-603df101-414e-4343-9d47-f6a015e53097 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:55.726190 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-603df101-414e-4343-9d47-f6a015e53097 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:55.727014 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-603df101-414e-4343-9d47-f6a015e53097 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:55.728209 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-603df101-414e-4343-9d47-f6a015e53097 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:55.728800 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-603df101-414e-4343-9d47-f6a015e53097 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:55.915012 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-603df101-414e-4343-9d47-f6a015e53097 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:55.930860 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-603df101-414e-4343-9d47-f6a015e53097 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:55.932390 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-603df101-414e-4343-9d47-f6a015e53097 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:55.933771 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-603df101-414e-4343-9d47-f6a015e53097 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.226801 Jul 23 21:30:55.950093 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2027/4138] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:30:55 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:30:55.992017 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-37e16537-c0c9-4bfc-90d8-b28c3bbbf2f3 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:55.993742 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-37e16537-c0c9-4bfc-90d8-b28c3bbbf2f3 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: e74832ce-b06a-4786-b3f3-372e508a4795] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:56.018596 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-37e16537-c0c9-4bfc-90d8-b28c3bbbf2f3 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:56.019118 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-37e16537-c0c9-4bfc-90d8-b28c3bbbf2f3 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:56.019937 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-37e16537-c0c9-4bfc-90d8-b28c3bbbf2f3 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:56.020414 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-37e16537-c0c9-4bfc-90d8-b28c3bbbf2f3 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:56.237760 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-d02bfcd6-13ff-44e1-bb43-08b01df7597f tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b1e260651b4dffa7c1efe8e9d0f144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcf55bcaba04bf8ae8a9b2ac09e8d98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:56.247685 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-d02bfcd6-13ff-44e1-bb43-08b01df7597f tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] 10.222.0.17 "GET /compute/v2.1/servers/b90d9c54-1b5f-40db-acc6-67aaf46def15" status: 200 len: 1365 microversion: 2.1 time: 0.801751 Jul 23 21:30:56.252121 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2112/4139] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:30:55 2022] GET /compute/v2.1/servers/b90d9c54-1b5f-40db-acc6-67aaf46def15 => generated 1365 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:30:56.257032 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-6ed91437-ba63-403f-b9a5-3b38a9eaf91d tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:56.266791 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-6ed91437-ba63-403f-b9a5-3b38a9eaf91d tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: fc75dd20-e6e4-4484-b715-2251c593c9e5] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:56.281839 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6ed91437-ba63-403f-b9a5-3b38a9eaf91d tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:56.282617 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6ed91437-ba63-403f-b9a5-3b38a9eaf91d tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:56.283698 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6ed91437-ba63-403f-b9a5-3b38a9eaf91d tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:56.284352 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6ed91437-ba63-403f-b9a5-3b38a9eaf91d tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:56.713435 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-37e16537-c0c9-4bfc-90d8-b28c3bbbf2f3 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:56.736070 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-37e16537-c0c9-4bfc-90d8-b28c3bbbf2f3 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/e74832ce-b06a-4786-b3f3-372e508a4795" status: 200 len: 1317 microversion: 2.1 time: 0.745929 Jul 23 21:30:56.739685 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2028/4140] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:30:55 2022] GET /compute/v2.1/servers/e74832ce-b06a-4786-b3f3-372e508a4795 => generated 1317 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:30:56.775611 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-f1bf866b-b9c3-4e4c-a3a5-a89bf77d667b req-0ab2b48f-aa7c-4bd9-9849-c435d86bf35b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e74832ce-b06a-4786-b3f3-372e508a4795", "name": "network-vif-plugged", "status": "completed", "tag": "2aad6658-7072-4fc3-afd1-3d912d7e1da3"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:30:56.805986 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-f1bf866b-b9c3-4e4c-a3a5-a89bf77d667b req-0ab2b48f-aa7c-4bd9-9849-c435d86bf35b service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:56.812115 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-f1bf866b-b9c3-4e4c-a3a5-a89bf77d667b req-0ab2b48f-aa7c-4bd9-9849-c435d86bf35b service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:56.844721 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-f1bf866b-b9c3-4e4c-a3a5-a89bf77d667b req-0ab2b48f-aa7c-4bd9-9849-c435d86bf35b service nova] Creating event network-vif-plugged:2aad6658-7072-4fc3-afd1-3d912d7e1da3 for instance e74832ce-b06a-4786-b3f3-372e508a4795 on nch2-master-1 Jul 23 21:30:56.870442 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-f1bf866b-b9c3-4e4c-a3a5-a89bf77d667b req-0ab2b48f-aa7c-4bd9-9849-c435d86bf35b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116684 Jul 23 21:30:56.870981 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2029/4141] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:30:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:30:56.898266 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-d69e8959-4794-4ece-b072-e33744fd17f3 req-f43e99be-1f8b-401c-a9d4-e095c49a3fe3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b90d9c54-1b5f-40db-acc6-67aaf46def15", "tag": "11b31040-c051-49e9-abc5-174c912590d7"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:30:56.933259 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-d69e8959-4794-4ece-b072-e33744fd17f3 req-f43e99be-1f8b-401c-a9d4-e095c49a3fe3 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:56.933714 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-d69e8959-4794-4ece-b072-e33744fd17f3 req-f43e99be-1f8b-401c-a9d4-e095c49a3fe3 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:56.964317 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-d69e8959-4794-4ece-b072-e33744fd17f3 req-f43e99be-1f8b-401c-a9d4-e095c49a3fe3 service nova] Creating event network-changed:11b31040-c051-49e9-abc5-174c912590d7 for instance b90d9c54-1b5f-40db-acc6-67aaf46def15 on nch2-master-1 Jul 23 21:30:56.980539 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-d69e8959-4794-4ece-b072-e33744fd17f3 req-f43e99be-1f8b-401c-a9d4-e095c49a3fe3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105341 Jul 23 21:30:56.984686 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2030/4142] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:30:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:30:56.999084 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-84a35436-9a45-4711-a558-2cc649b06048 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:57.000072 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-84a35436-9a45-4711-a558-2cc649b06048 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:57.009733 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-84a35436-9a45-4711-a558-2cc649b06048 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:57.014807 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-84a35436-9a45-4711-a558-2cc649b06048 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:57.016006 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-84a35436-9a45-4711-a558-2cc649b06048 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:57.016603 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-84a35436-9a45-4711-a558-2cc649b06048 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:57.207538 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-84a35436-9a45-4711-a558-2cc649b06048 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:57.220227 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-84a35436-9a45-4711-a558-2cc649b06048 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:57.221742 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-84a35436-9a45-4711-a558-2cc649b06048 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:57.236864 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-84a35436-9a45-4711-a558-2cc649b06048 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.245819 Jul 23 21:30:57.237534 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2031/4143] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:30:56 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:30:57.258278 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9fa03425-ebef-4943-b513-83f7f2ddb884 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '.version_select at 0x7f0b47bdfaf0>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:57.283863 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-6ed91437-ba63-403f-b9a5-3b38a9eaf91d tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:57.287373 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9fa03425-ebef-4943-b513-83f7f2ddb884 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-712817914" status: 204 len: 0 microversion: 2.42 time: 0.032248 Jul 23 21:30:57.293024 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2032/4144] 10.222.0.17 () {60 vars in 1258 bytes} [Sat Jul 23 21:30:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-712817914 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 23 21:30:57.295705 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-6ed91437-ba63-403f-b9a5-3b38a9eaf91d tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75dd20-e6e4-4484-b715-2251c593c9e5" status: 200 len: 1309 microversion: 2.1 time: 1.040209 Jul 23 21:30:57.296445 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2113/4145] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:30:56 2022] GET /compute/v2.1/servers/fc75dd20-e6e4-4484-b715-2251c593c9e5 => generated 1309 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:30:57.299776 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c84eb6ca-1860-4a4e-ac82-c8730db838f5 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:57.300564 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c84eb6ca-1860-4a4e-ac82-c8730db838f5 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] [instance: b90d9c54-1b5f-40db-acc6-67aaf46def15] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:57.310420 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c84eb6ca-1860-4a4e-ac82-c8730db838f5 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:57.311128 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c84eb6ca-1860-4a4e-ac82-c8730db838f5 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:57.312105 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c84eb6ca-1860-4a4e-ac82-c8730db838f5 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:57.312697 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c84eb6ca-1860-4a4e-ac82-c8730db838f5 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:57.757136 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f292b60c-dced-4af6-afc3-1b8b7319c96d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:57.758111 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-f292b60c-dced-4af6-afc3-1b8b7319c96d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: e74832ce-b06a-4786-b3f3-372e508a4795] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:57.773623 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f292b60c-dced-4af6-afc3-1b8b7319c96d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:57.774304 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:30:57.775430 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f292b60c-dced-4af6-afc3-1b8b7319c96d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:57.779032 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f292b60c-dced-4af6-afc3-1b8b7319c96d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:57.779693 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f292b60c-dced-4af6-afc3-1b8b7319c96d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:57.951249 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c84eb6ca-1860-4a4e-ac82-c8730db838f5 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b1e260651b4dffa7c1efe8e9d0f144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcf55bcaba04bf8ae8a9b2ac09e8d98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:57.964148 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c84eb6ca-1860-4a4e-ac82-c8730db838f5 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] 10.222.0.17 "GET /compute/v2.1/servers/b90d9c54-1b5f-40db-acc6-67aaf46def15" status: 200 len: 1365 microversion: 2.1 time: 0.669525 Jul 23 21:30:57.968626 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2033/4146] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:30:57 2022] GET /compute/v2.1/servers/b90d9c54-1b5f-40db-acc6-67aaf46def15 => generated 1365 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:30:58.187719 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-f292b60c-dced-4af6-afc3-1b8b7319c96d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:58.198247 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-f292b60c-dced-4af6-afc3-1b8b7319c96d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/e74832ce-b06a-4786-b3f3-372e508a4795" status: 200 len: 1317 microversion: 2.1 time: 0.445393 Jul 23 21:30:58.198846 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2114/4147] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:30:57 2022] GET /compute/v2.1/servers/e74832ce-b06a-4786-b3f3-372e508a4795 => generated 1317 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:30:58.314281 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-36d581f8-1d33-4c0a-ad42-95f156921527 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:58.315048 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-36d581f8-1d33-4c0a-ad42-95f156921527 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: fc75dd20-e6e4-4484-b715-2251c593c9e5] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:58.323214 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-36d581f8-1d33-4c0a-ad42-95f156921527 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:58.323818 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-36d581f8-1d33-4c0a-ad42-95f156921527 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:58.324821 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-36d581f8-1d33-4c0a-ad42-95f156921527 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:58.325368 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-36d581f8-1d33-4c0a-ad42-95f156921527 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:58.391051 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=8 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:30:58.852588 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-36d581f8-1d33-4c0a-ad42-95f156921527 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:58.896597 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-36d581f8-1d33-4c0a-ad42-95f156921527 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75dd20-e6e4-4484-b715-2251c593c9e5" status: 200 len: 1309 microversion: 2.1 time: 0.587092 Jul 23 21:30:58.897749 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2034/4148] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:30:58 2022] GET /compute/v2.1/servers/fc75dd20-e6e4-4484-b715-2251c593c9e5 => generated 1309 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:30:58.984999 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ed9ed63e-5427-45a6-b174-b05435db3213 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:58.985645 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-ed9ed63e-5427-45a6-b174-b05435db3213 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] [instance: b90d9c54-1b5f-40db-acc6-67aaf46def15] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:59.002578 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ed9ed63e-5427-45a6-b174-b05435db3213 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:59.002985 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ed9ed63e-5427-45a6-b174-b05435db3213 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:59.004105 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ed9ed63e-5427-45a6-b174-b05435db3213 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:59.004707 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ed9ed63e-5427-45a6-b174-b05435db3213 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:59.215819 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-42ed035b-550d-4845-b1a1-491dc12bc8eb tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:59.216713 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-42ed035b-550d-4845-b1a1-491dc12bc8eb tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: e74832ce-b06a-4786-b3f3-372e508a4795] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:59.233155 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-42ed035b-550d-4845-b1a1-491dc12bc8eb tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:59.238540 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-42ed035b-550d-4845-b1a1-491dc12bc8eb tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:59.239795 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-42ed035b-550d-4845-b1a1-491dc12bc8eb tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:59.240500 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-42ed035b-550d-4845-b1a1-491dc12bc8eb tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:59.565412 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ed9ed63e-5427-45a6-b174-b05435db3213 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b1e260651b4dffa7c1efe8e9d0f144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcf55bcaba04bf8ae8a9b2ac09e8d98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:30:59.577155 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-ed9ed63e-5427-45a6-b174-b05435db3213 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] 10.222.0.17 "GET /compute/v2.1/servers/b90d9c54-1b5f-40db-acc6-67aaf46def15" status: 200 len: 1365 microversion: 2.1 time: 0.598178 Jul 23 21:30:59.579862 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2115/4149] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:30:58 2022] GET /compute/v2.1/servers/b90d9c54-1b5f-40db-acc6-67aaf46def15 => generated 1365 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:30:59.924848 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e1669e82-be8b-4215-ac38-066fb06dc9e4 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:30:59.926078 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-e1669e82-be8b-4215-ac38-066fb06dc9e4 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: fc75dd20-e6e4-4484-b715-2251c593c9e5] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:30:59.938632 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e1669e82-be8b-4215-ac38-066fb06dc9e4 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:59.941458 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e1669e82-be8b-4215-ac38-066fb06dc9e4 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:30:59.943710 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e1669e82-be8b-4215-ac38-066fb06dc9e4 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:30:59.945310 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e1669e82-be8b-4215-ac38-066fb06dc9e4 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:00.015465 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=100 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:31:00.274311 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-e1669e82-be8b-4215-ac38-066fb06dc9e4 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:00.290470 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-e1669e82-be8b-4215-ac38-066fb06dc9e4 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75dd20-e6e4-4484-b715-2251c593c9e5" status: 200 len: 1309 microversion: 2.1 time: 0.379258 Jul 23 21:31:00.291079 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2116/4150] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:30:59 2022] GET /compute/v2.1/servers/fc75dd20-e6e4-4484-b715-2251c593c9e5 => generated 1309 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:31:00.371830 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-42ed035b-550d-4845-b1a1-491dc12bc8eb tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:00.381890 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-42ed035b-550d-4845-b1a1-491dc12bc8eb tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/e74832ce-b06a-4786-b3f3-372e508a4795" status: 200 len: 1507 microversion: 2.1 time: 1.170455 Jul 23 21:31:00.383087 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2035/4151] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:30:59 2022] GET /compute/v2.1/servers/e74832ce-b06a-4786-b3f3-372e508a4795 => generated 1507 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:31:00.399265 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-2530deef-5d5f-4200-912f-247f27a18705 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:00.399774 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-2530deef-5d5f-4200-912f-247f27a18705 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: e74832ce-b06a-4786-b3f3-372e508a4795] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:00.407337 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2530deef-5d5f-4200-912f-247f27a18705 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:00.407795 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2530deef-5d5f-4200-912f-247f27a18705 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:00.408584 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2530deef-5d5f-4200-912f-247f27a18705 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:00.409023 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2530deef-5d5f-4200-912f-247f27a18705 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:00.487599 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-2530deef-5d5f-4200-912f-247f27a18705 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: e74832ce-b06a-4786-b3f3-372e508a4795] Going to try to terminate instance {{(pid=131321) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:31:00.678390 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-2530deef-5d5f-4200-912f-247f27a18705 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "DELETE /compute/v2.1/servers/e74832ce-b06a-4786-b3f3-372e508a4795" status: 204 len: 0 microversion: 2.1 time: 0.282186 Jul 23 21:31:00.679506 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2117/4152] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:31:00 2022] DELETE /compute/v2.1/servers/e74832ce-b06a-4786-b3f3-372e508a4795 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:31:00.694858 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e051c2df-1df1-4e73-af1c-107f7e0dca1b tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:00.695592 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-e051c2df-1df1-4e73-af1c-107f7e0dca1b tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] [instance: b90d9c54-1b5f-40db-acc6-67aaf46def15] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:00.732554 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e051c2df-1df1-4e73-af1c-107f7e0dca1b tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:00.733057 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e051c2df-1df1-4e73-af1c-107f7e0dca1b tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:00.733988 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e051c2df-1df1-4e73-af1c-107f7e0dca1b tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:00.734433 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e051c2df-1df1-4e73-af1c-107f7e0dca1b tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:00.829096 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c592fa04-4590-444d-b0d3-3bdcc1c5fe99 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Action: 'create', calling method: .version_select at 0x7f0b477ded30>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-1067306574", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKuBS2FFPnRO1bF/LRjpq+GlkONkVENuaTTCcd5OTuf+ygbU/6nW67nO1JHxNnOvmaUJE1CO8Ff9eb2KKjP2hS9M7nGdHDSYerIJHNxwB3smbIz2FWxITL90pBJdhOTsEg=="}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:31:00.886057 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-c592fa04-4590-444d-b0d3-3bdcc1c5fe99 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Getting quotas for project 842a1aca542f416eab5d43b881325917. Resources: {'key_pairs'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:31:00.895722 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-c592fa04-4590-444d-b0d3-3bdcc1c5fe99 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Getting quotas for user 0bd49331138a4dbc912bc7bf6f6b0215 and project 842a1aca542f416eab5d43b881325917. Resources: {'key_pairs'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:31:00.948005 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c592fa04-4590-444d-b0d3-3bdcc1c5fe99 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.518568 Jul 23 21:31:00.949187 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2036/4153] 10.222.0.17 () {60 vars in 1158 bytes} [Sat Jul 23 21:31:00 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:31:00.955135 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b4fb2b0e-298e-4cab-ab1f-5dc6ef908ff8 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:00.955947 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b4fb2b0e-298e-4cab-ab1f-5dc6ef908ff8 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: e74832ce-b06a-4786-b3f3-372e508a4795] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:00.965034 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b4fb2b0e-298e-4cab-ab1f-5dc6ef908ff8 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:00.968570 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b4fb2b0e-298e-4cab-ab1f-5dc6ef908ff8 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:00.969701 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b4fb2b0e-298e-4cab-ab1f-5dc6ef908ff8 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:00.971682 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b4fb2b0e-298e-4cab-ab1f-5dc6ef908ff8 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:01.214446 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-e051c2df-1df1-4e73-af1c-107f7e0dca1b tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b1e260651b4dffa7c1efe8e9d0f144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcf55bcaba04bf8ae8a9b2ac09e8d98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:01.228834 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-e051c2df-1df1-4e73-af1c-107f7e0dca1b tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] 10.222.0.17 "GET /compute/v2.1/servers/b90d9c54-1b5f-40db-acc6-67aaf46def15" status: 200 len: 1365 microversion: 2.1 time: 0.543972 Jul 23 21:31:01.229704 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2118/4154] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:00 2022] GET /compute/v2.1/servers/b90d9c54-1b5f-40db-acc6-67aaf46def15 => generated 1365 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:01.308924 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-7c87f307-7e62-4224-bca2-ed0ead3f10ad tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:01.310003 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-7c87f307-7e62-4224-bca2-ed0ead3f10ad tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: fc75dd20-e6e4-4484-b715-2251c593c9e5] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:01.318426 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7c87f307-7e62-4224-bca2-ed0ead3f10ad tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:01.318926 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7c87f307-7e62-4224-bca2-ed0ead3f10ad tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:01.320127 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7c87f307-7e62-4224-bca2-ed0ead3f10ad tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:01.322525 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7c87f307-7e62-4224-bca2-ed0ead3f10ad tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:01.512391 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b4fb2b0e-298e-4cab-ab1f-5dc6ef908ff8 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:01.527335 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b4fb2b0e-298e-4cab-ab1f-5dc6ef908ff8 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/e74832ce-b06a-4786-b3f3-372e508a4795" status: 200 len: 1513 microversion: 2.1 time: 0.573677 Jul 23 21:31:01.528193 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2037/4155] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:00 2022] GET /compute/v2.1/servers/e74832ce-b06a-4786-b3f3-372e508a4795 => generated 1513 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:01.663610 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-7c87f307-7e62-4224-bca2-ed0ead3f10ad tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:01.672824 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-7c87f307-7e62-4224-bca2-ed0ead3f10ad tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75dd20-e6e4-4484-b715-2251c593c9e5" status: 200 len: 1309 microversion: 2.1 time: 0.368938 Jul 23 21:31:01.674305 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2119/4156] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:01 2022] GET /compute/v2.1/servers/fc75dd20-e6e4-4484-b715-2251c593c9e5 => generated 1309 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:31:02.246964 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c80a4047-b3df-4496-9664-0792023ff2c1 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:02.247464 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c80a4047-b3df-4496-9664-0792023ff2c1 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] [instance: b90d9c54-1b5f-40db-acc6-67aaf46def15] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:02.258944 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c80a4047-b3df-4496-9664-0792023ff2c1 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:02.259715 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c80a4047-b3df-4496-9664-0792023ff2c1 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:02.263515 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c80a4047-b3df-4496-9664-0792023ff2c1 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:02.264405 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c80a4047-b3df-4496-9664-0792023ff2c1 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:02.278897 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-93b70788-b785-48fe-b642-988fc9f41890 req-313e2a71-8c52-4f47-a8e8-069874d48ee4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b90d9c54-1b5f-40db-acc6-67aaf46def15", "name": "network-vif-plugged", "status": "completed", "tag": "11b31040-c051-49e9-abc5-174c912590d7"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:31:02.294636 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-93b70788-b785-48fe-b642-988fc9f41890 req-313e2a71-8c52-4f47-a8e8-069874d48ee4 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:02.295089 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-93b70788-b785-48fe-b642-988fc9f41890 req-313e2a71-8c52-4f47-a8e8-069874d48ee4 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:02.324837 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-93b70788-b785-48fe-b642-988fc9f41890 req-313e2a71-8c52-4f47-a8e8-069874d48ee4 service nova] Creating event network-vif-plugged:11b31040-c051-49e9-abc5-174c912590d7 for instance b90d9c54-1b5f-40db-acc6-67aaf46def15 on nch2-master-1 Jul 23 21:31:02.331129 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-93b70788-b785-48fe-b642-988fc9f41890 req-313e2a71-8c52-4f47-a8e8-069874d48ee4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055875 Jul 23 21:31:02.357485 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2120/4157] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:31:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:31:02.546782 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c8fe5d2b-bfd7-465d-9cee-47f1d24b3836 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:02.548151 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-c8fe5d2b-bfd7-465d-9cee-47f1d24b3836 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: e74832ce-b06a-4786-b3f3-372e508a4795] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:02.563948 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c8fe5d2b-bfd7-465d-9cee-47f1d24b3836 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:02.565277 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c8fe5d2b-bfd7-465d-9cee-47f1d24b3836 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:02.566221 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c8fe5d2b-bfd7-465d-9cee-47f1d24b3836 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:02.566948 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c8fe5d2b-bfd7-465d-9cee-47f1d24b3836 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:03.018659 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c80a4047-b3df-4496-9664-0792023ff2c1 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b1e260651b4dffa7c1efe8e9d0f144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcf55bcaba04bf8ae8a9b2ac09e8d98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:03.031334 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c80a4047-b3df-4496-9664-0792023ff2c1 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] 10.222.0.17 "GET /compute/v2.1/servers/b90d9c54-1b5f-40db-acc6-67aaf46def15" status: 200 len: 1365 microversion: 2.1 time: 0.788340 Jul 23 21:31:03.032287 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2038/4158] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:02 2022] GET /compute/v2.1/servers/b90d9c54-1b5f-40db-acc6-67aaf46def15 => generated 1365 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:03.038121 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c0ab6159-a4e6-4667-98f5-dfa81e413e57 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:03.038974 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c0ab6159-a4e6-4667-98f5-dfa81e413e57 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: fc75dd20-e6e4-4484-b715-2251c593c9e5] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:03.047568 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c0ab6159-a4e6-4667-98f5-dfa81e413e57 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:03.048356 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c0ab6159-a4e6-4667-98f5-dfa81e413e57 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:03.049337 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c0ab6159-a4e6-4667-98f5-dfa81e413e57 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:03.050309 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c0ab6159-a4e6-4667-98f5-dfa81e413e57 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:03.375252 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c0ab6159-a4e6-4667-98f5-dfa81e413e57 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:03.393829 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c0ab6159-a4e6-4667-98f5-dfa81e413e57 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75dd20-e6e4-4484-b715-2251c593c9e5" status: 200 len: 1309 microversion: 2.1 time: 0.358664 Jul 23 21:31:03.394877 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2039/4159] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:03 2022] GET /compute/v2.1/servers/fc75dd20-e6e4-4484-b715-2251c593c9e5 => generated 1309 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:03.497490 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c8fe5d2b-bfd7-465d-9cee-47f1d24b3836 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:03.509471 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-c8fe5d2b-bfd7-465d-9cee-47f1d24b3836 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/e74832ce-b06a-4786-b3f3-372e508a4795" status: 200 len: 1513 microversion: 2.1 time: 0.965898 Jul 23 21:31:03.510997 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2121/4160] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:02 2022] GET /compute/v2.1/servers/e74832ce-b06a-4786-b3f3-372e508a4795 => generated 1513 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:03.877064 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-79b70e6b-a31a-48a9-be5d-6e8d407aa733 req-ca865898-221e-4000-8826-121042c26add service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e74832ce-b06a-4786-b3f3-372e508a4795", "name": "network-vif-deleted", "tag": "2aad6658-7072-4fc3-afd1-3d912d7e1da3"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:31:03.906224 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-79b70e6b-a31a-48a9-be5d-6e8d407aa733 req-ca865898-221e-4000-8826-121042c26add service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:03.907072 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-79b70e6b-a31a-48a9-be5d-6e8d407aa733 req-ca865898-221e-4000-8826-121042c26add service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:03.912107 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=100 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:31:03.953428 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-79b70e6b-a31a-48a9-be5d-6e8d407aa733 req-ca865898-221e-4000-8826-121042c26add service nova] Creating event network-vif-deleted:2aad6658-7072-4fc3-afd1-3d912d7e1da3 for instance e74832ce-b06a-4786-b3f3-372e508a4795 on nch2-master-1 Jul 23 21:31:03.971721 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-79b70e6b-a31a-48a9-be5d-6e8d407aa733 req-ca865898-221e-4000-8826-121042c26add service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098894 Jul 23 21:31:03.974997 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2040/4161] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:31:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:31:04.052316 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f01f8e22-fb7a-4f13-b8e0-da31519fadd9 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:04.053189 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-f01f8e22-fb7a-4f13-b8e0-da31519fadd9 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] [instance: b90d9c54-1b5f-40db-acc6-67aaf46def15] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:04.066402 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f01f8e22-fb7a-4f13-b8e0-da31519fadd9 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:04.068349 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f01f8e22-fb7a-4f13-b8e0-da31519fadd9 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:04.079619 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f01f8e22-fb7a-4f13-b8e0-da31519fadd9 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:04.082488 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f01f8e22-fb7a-4f13-b8e0-da31519fadd9 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:04.653951 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-f01f8e22-fb7a-4f13-b8e0-da31519fadd9 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b1e260651b4dffa7c1efe8e9d0f144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcf55bcaba04bf8ae8a9b2ac09e8d98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:04.664784 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-f01f8e22-fb7a-4f13-b8e0-da31519fadd9 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] 10.222.0.17 "GET /compute/v2.1/servers/b90d9c54-1b5f-40db-acc6-67aaf46def15" status: 200 len: 1365 microversion: 2.1 time: 0.619372 Jul 23 21:31:04.668452 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2122/4162] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:04 2022] GET /compute/v2.1/servers/b90d9c54-1b5f-40db-acc6-67aaf46def15 => generated 1365 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:31:04.684972 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-edac3186-1dd5-4b1c-adc7-7d99b3443090 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:04.687923 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6d88566b-8391-4f91-86ef-325c7be048db tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-1059605452", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "networks": [{"uuid": "f81be2dc-52d3-4ced-b0c1-473f6f463f73"}]}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:31:04.695629 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-edac3186-1dd5-4b1c-adc7-7d99b3443090 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: fc75dd20-e6e4-4484-b715-2251c593c9e5] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:04.720437 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-edac3186-1dd5-4b1c-adc7-7d99b3443090 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:04.722777 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-edac3186-1dd5-4b1c-adc7-7d99b3443090 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:04.727725 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-edac3186-1dd5-4b1c-adc7-7d99b3443090 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:04.729295 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-edac3186-1dd5-4b1c-adc7-7d99b3443090 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:04.805113 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-6d88566b-8391-4f91-86ef-325c7be048db tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] validate_networks() for [('f81be2dc-52d3-4ced-b0c1-473f6f463f73', None, None, None, None, None)] {{(pid=131320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:31:05.172268 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-edac3186-1dd5-4b1c-adc7-7d99b3443090 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:05.182068 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-edac3186-1dd5-4b1c-adc7-7d99b3443090 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75dd20-e6e4-4484-b715-2251c593c9e5" status: 200 len: 1309 microversion: 2.1 time: 0.500945 Jul 23 21:31:05.182671 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2123/4163] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:04 2022] GET /compute/v2.1/servers/fc75dd20-e6e4-4484-b715-2251c593c9e5 => generated 1309 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:05.198473 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-cbaf24a2-5479-4214-9806-95ee5176dbfd req-7887641c-7e39-43b5-8bed-6e66c2f58dc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc75dd20-e6e4-4484-b715-2251c593c9e5", "name": "network-vif-plugged", "status": "completed", "tag": "737200ba-4d1d-40c0-aaa2-a478e7e3d2f6"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:31:05.208347 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-cbaf24a2-5479-4214-9806-95ee5176dbfd req-7887641c-7e39-43b5-8bed-6e66c2f58dc9 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:05.209199 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-cbaf24a2-5479-4214-9806-95ee5176dbfd req-7887641c-7e39-43b5-8bed-6e66c2f58dc9 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:05.223394 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-cbaf24a2-5479-4214-9806-95ee5176dbfd req-7887641c-7e39-43b5-8bed-6e66c2f58dc9 service nova] Creating event network-vif-plugged:737200ba-4d1d-40c0-aaa2-a478e7e3d2f6 for instance fc75dd20-e6e4-4484-b715-2251c593c9e5 on nch1-master-1 Jul 23 21:31:05.230240 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-cbaf24a2-5479-4214-9806-95ee5176dbfd req-7887641c-7e39-43b5-8bed-6e66c2f58dc9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043192 Jul 23 21:31:05.231606 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2124/4164] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:31:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:31:05.239531 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e5c07c75-8a75-4895-8065-b95e4ef78958 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:05.240490 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-e5c07c75-8a75-4895-8065-b95e4ef78958 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: e74832ce-b06a-4786-b3f3-372e508a4795] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:05.248436 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e5c07c75-8a75-4895-8065-b95e4ef78958 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:05.249240 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e5c07c75-8a75-4895-8065-b95e4ef78958 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:05.250555 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e5c07c75-8a75-4895-8065-b95e4ef78958 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:05.251252 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e5c07c75-8a75-4895-8065-b95e4ef78958 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:05.268346 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-e5c07c75-8a75-4895-8065-b95e4ef78958 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] HTTP exception thrown: Instance e74832ce-b06a-4786-b3f3-372e508a4795 could not be found. Jul 23 21:31:05.270644 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e5c07c75-8a75-4895-8065-b95e4ef78958 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Request method failure captured: Jul 23 21:31:05.270644 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/servers/e74832ce-b06a-4786-b3f3-372e508a4795 HTTP/1.1 Jul 23 21:31:05.270644 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:31:05.270644 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:31:05.270644 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:31:05.270644 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:31:05.270644 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:31:05.270644 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:31:05.270644 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:31:05.270644 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:31:05.270644 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3Ghf1JjZ4k8tVzERRK8IkLpluLUwa9k5Rz-X0dEr2p4_7xl_eBekUiNk1RZEGsFdGEiApbLOfcuSifirvwiKV1QOTaKdXKwfMnwZgdfagxJjoe3dPYUa3b-d3rVTYewIN_YoX2mMGGBMWRa3po8WOCVIc6hXJLExzq_ndbcO7U8NQBI Jul 23 21:31:05.270644 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:31:05.270644 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:31:05.270644 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:31:05.270644 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:31:05.270644 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:31:05.270644 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:31:05.270644 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: d70f6c96e1ad484aa3207fc01a12d519 Jul 23 21:31:05.270644 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:31:05.270644 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:31:05.270644 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:31:05.270644 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d70f6c96e1ad484aa3207fc01a12d519"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d70f6c96e1ad484aa3207fc01a12d519"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d70f6c96e1ad484aa3207fc01a12d519", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d70f6c96e1ad484aa3207fc01a12d519"}]}] Jul 23 21:31:05.270644 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:31:05.270644 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: d70f6c96e1ad484aa3207fc01a12d519 Jul 23 21:31:05.270644 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:31:05.270644 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ServersNegativeTestJSON-1106538570-project Jul 23 21:31:05.270644 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:31:05.270644 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:31:05.270644 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 6ca9644a73d9468aa39b21548a72bded Jul 23 21:31:05.270644 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ServersNegativeTestJSON-1106538570-project Jul 23 21:31:05.270644 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:31:05.270644 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance e74832ce-b06a-4786-b3f3-372e508a4795 could not be found. Jul 23 21:31:05.270644 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': 'e74832ce-b06a-4786-b3f3-372e508a4795'} Jul 23 21:31:05.270644 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:31:05.270644 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:05.270644 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:31:05.270644 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:31:05.270644 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:31:05.270644 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:31:05.270644 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:31:05.270644 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:31:05.270644 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:31:05.270644 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:31:05.270644 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e74832ce-b06a-4786-b3f3-372e508a4795 could not be found. Jul 23 21:31:05.270644 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:05.270644 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:31:05.270644 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:05.270644 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:05.270644 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:31:05.270644 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:31:05.270644 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:31:05.270644 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:31:05.270644 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:31:05.270644 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:31:05.270644 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:31:05.270644 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:31:05.270644 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:31:05.270644 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:31:05.270644 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:31:05.270644 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:31:05.270644 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e74832ce-b06a-4786-b3f3-372e508a4795 could not be found. Jul 23 21:31:05.270644 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:05.270644 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:31:05.270644 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:05.274991 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:05.274991 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:31:05.274991 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:31:05.274991 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:31:05.274991 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:31:05.274991 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e74832ce-b06a-4786-b3f3-372e508a4795 could not be found. Jul 23 21:31:05.274991 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:05.276828 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e5c07c75-8a75-4895-8065-b95e4ef78958 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Returning 404 to user: Instance e74832ce-b06a-4786-b3f3-372e508a4795 could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:31:05.279866 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-e5c07c75-8a75-4895-8065-b95e4ef78958 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/e74832ce-b06a-4786-b3f3-372e508a4795" status: 404 len: 111 microversion: 2.1 time: 0.046281 Jul 23 21:31:05.280740 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2125/4165] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:05 2022] GET /compute/v2.1/servers/e74832ce-b06a-4786-b3f3-372e508a4795 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:31:05.293461 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f15fa872-54c9-43ef-b1dd-2ce8f62a52fc tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:05.295043 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-f15fa872-54c9-43ef-b1dd-2ce8f62a52fc tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:05.312452 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f15fa872-54c9-43ef-b1dd-2ce8f62a52fc tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:05.313396 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f15fa872-54c9-43ef-b1dd-2ce8f62a52fc tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:05.314749 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f15fa872-54c9-43ef-b1dd-2ce8f62a52fc tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:05.315337 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f15fa872-54c9-43ef-b1dd-2ce8f62a52fc tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:05.785340 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-6d88566b-8391-4f91-86ef-325c7be048db tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:31:05.786406 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-6d88566b-8391-4f91-86ef-325c7be048db tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:31:05.787435 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-6d88566b-8391-4f91-86ef-325c7be048db tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:31:05.788386 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-6d88566b-8391-4f91-86ef-325c7be048db tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:31:05.789421 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-6d88566b-8391-4f91-86ef-325c7be048db tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:31:05.820404 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6d88566b-8391-4f91-86ef-325c7be048db tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:05.821210 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6d88566b-8391-4f91-86ef-325c7be048db tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:05.822990 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6d88566b-8391-4f91-86ef-325c7be048db tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:05.823780 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6d88566b-8391-4f91-86ef-325c7be048db tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:05.862710 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-6d88566b-8391-4f91-86ef-325c7be048db tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Getting quotas for project 3d547fc8e53d43888e35c3e8ef5caada. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:31:05.869441 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-6d88566b-8391-4f91-86ef-325c7be048db tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Getting quotas for user fc0782a98aca44f18bf86a9f6ad5eb60 and project 3d547fc8e53d43888e35c3e8ef5caada. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:31:05.906093 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6d88566b-8391-4f91-86ef-325c7be048db tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Going to run 1 instances... {{(pid=131320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:31:05.916303 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6d88566b-8391-4f91-86ef-325c7be048db tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] [instance: a053bb4d-aaa2-4f14-bb62-5623ef5448aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:31:06.001369 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6d88566b-8391-4f91-86ef-325c7be048db tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.723725 Jul 23 21:31:06.002717 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2041/4166] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:31:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1726 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 23 21:31:06.015102 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-616076c5-e601-4f85-b974-495434af2deb tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:06.016062 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-616076c5-e601-4f85-b974-495434af2deb tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] [instance: b90d9c54-1b5f-40db-acc6-67aaf46def15] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:06.023942 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-616076c5-e601-4f85-b974-495434af2deb tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:06.024743 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-616076c5-e601-4f85-b974-495434af2deb tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:06.025746 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-616076c5-e601-4f85-b974-495434af2deb tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:06.026486 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-616076c5-e601-4f85-b974-495434af2deb tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:06.295567 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-616076c5-e601-4f85-b974-495434af2deb tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b1e260651b4dffa7c1efe8e9d0f144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcf55bcaba04bf8ae8a9b2ac09e8d98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:06.311901 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-616076c5-e601-4f85-b974-495434af2deb tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] 10.222.0.17 "GET /compute/v2.1/servers/b90d9c54-1b5f-40db-acc6-67aaf46def15" status: 200 len: 1555 microversion: 2.1 time: 0.300665 Jul 23 21:31:06.336920 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2042/4167] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:06 2022] GET /compute/v2.1/servers/b90d9c54-1b5f-40db-acc6-67aaf46def15 => generated 1555 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:06.343288 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e6c0a565-a88e-4eb2-96fc-4d79ede3beef tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:06.352191 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e6c0a565-a88e-4eb2-96fc-4d79ede3beef tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] [instance: a053bb4d-aaa2-4f14-bb62-5623ef5448aa] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:06.456906 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e6c0a565-a88e-4eb2-96fc-4d79ede3beef tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc0782a98aca44f18bf86a9f6ad5eb60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d547fc8e53d43888e35c3e8ef5caada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:06.496731 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e6c0a565-a88e-4eb2-96fc-4d79ede3beef tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] 10.222.0.17 "GET /compute/v2.1/servers/a053bb4d-aaa2-4f14-bb62-5623ef5448aa" status: 200 len: 1228 microversion: 2.1 time: 0.157306 Jul 23 21:31:06.499620 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2043/4168] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:06 2022] GET /compute/v2.1/servers/a053bb4d-aaa2-4f14-bb62-5623ef5448aa => generated 1228 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:06.517756 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3563a5a2-234a-415f-bd54-c47b435181df tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:06.518936 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-3563a5a2-234a-415f-bd54-c47b435181df tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: fc75dd20-e6e4-4484-b715-2251c593c9e5] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:06.535143 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3563a5a2-234a-415f-bd54-c47b435181df tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:06.537290 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3563a5a2-234a-415f-bd54-c47b435181df tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:06.541618 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3563a5a2-234a-415f-bd54-c47b435181df tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:06.542501 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3563a5a2-234a-415f-bd54-c47b435181df tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:06.790528 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-3563a5a2-234a-415f-bd54-c47b435181df tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:06.800424 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-3563a5a2-234a-415f-bd54-c47b435181df tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75dd20-e6e4-4484-b715-2251c593c9e5" status: 200 len: 1309 microversion: 2.1 time: 0.299470 Jul 23 21:31:06.801207 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2044/4169] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:06 2022] GET /compute/v2.1/servers/fc75dd20-e6e4-4484-b715-2251c593c9e5 => generated 1309 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:06.807400 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-bfe87b2e-4a65-47bd-9034-91c9393cd435 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:06.808397 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-bfe87b2e-4a65-47bd-9034-91c9393cd435 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] [instance: b90d9c54-1b5f-40db-acc6-67aaf46def15] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:06.815485 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bfe87b2e-4a65-47bd-9034-91c9393cd435 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:06.816033 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bfe87b2e-4a65-47bd-9034-91c9393cd435 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:06.816908 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bfe87b2e-4a65-47bd-9034-91c9393cd435 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:06.817436 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bfe87b2e-4a65-47bd-9034-91c9393cd435 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:06.945204 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-bfe87b2e-4a65-47bd-9034-91c9393cd435 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] 10.222.0.17 "GET /compute/v2.1/servers/b90d9c54-1b5f-40db-acc6-67aaf46def15/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.142215 Jul 23 21:31:06.946512 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2045/4170] 10.222.0.17 () {58 vars in 1274 bytes} [Sat Jul 23 21:31:06 2022] GET /compute/v2.1/servers/b90d9c54-1b5f-40db-acc6-67aaf46def15/os-interface => generated 285 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:31:06.972292 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-f15fa872-54c9-43ef-b1dd-2ce8f62a52fc tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:06.986100 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-f15fa872-54c9-43ef-b1dd-2ce8f62a52fc tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1505 microversion: 2.1 time: 1.698367 Jul 23 21:31:06.989624 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2126/4171] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:05 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1505 bytes in 1704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:07.181170 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-122d3883-eed2-4b92-8f1c-dee5bb25470c tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "networks": [{"uuid": "654a77ca-1e84-434d-8536-1fc3adb327d0"}]}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:31:07.183812 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-122d3883-eed2-4b92-8f1c-dee5bb25470c tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Request method failure captured: Jul 23 21:31:07.183812 ncdv-master-1 devstack@n-api.service[131321]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 23 21:31:07.183812 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:31:07.183812 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:31:07.183812 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:31:07.183812 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 163 Jul 23 21:31:07.183812 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:31:07.183812 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:31:07.183812 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:31:07.183812 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:31:07.183812 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3Ghf1JjZ4k8tVzERRK8IkLpluLUwa9k5Rz-X0dEr2p4_7xl_eBekUiNk1RZEGsFdGEiApbLOfcuSifirvwiKV1QOTaKdXKwfMnwZgdfagxJjoe3dPYUa3b-d3rVTYewIN_YoX2mMGGBMWRa3po8WOCVIc6hXJLExzq_ndbcO7U8NQBI Jul 23 21:31:07.183812 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:31:07.183812 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:31:07.183812 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:31:07.183812 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:31:07.183812 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:31:07.183812 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:31:07.183812 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: d70f6c96e1ad484aa3207fc01a12d519 Jul 23 21:31:07.183812 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:31:07.183812 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:31:07.183812 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:31:07.183812 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d70f6c96e1ad484aa3207fc01a12d519"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d70f6c96e1ad484aa3207fc01a12d519"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d70f6c96e1ad484aa3207fc01a12d519", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d70f6c96e1ad484aa3207fc01a12d519"}]}] Jul 23 21:31:07.183812 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:31:07.183812 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: d70f6c96e1ad484aa3207fc01a12d519 Jul 23 21:31:07.183812 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:31:07.183812 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ServersNegativeTestJSON-1106538570-project Jul 23 21:31:07.183812 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:31:07.183812 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:31:07.183812 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 6ca9644a73d9468aa39b21548a72bded Jul 23 21:31:07.183812 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ServersNegativeTestJSON-1106538570-project Jul 23 21:31:07.183812 ncdv-master-1 devstack@n-api.service[131321]: Jul 23 21:31:07.183812 ncdv-master-1 devstack@n-api.service[131321]: {"server": {"name": 12345, "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "networks": [{"uuid": "654a77ca-1e84-434d-8536-1fc3adb327d0"}]}} Jul 23 21:31:07.183812 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:31:07.183812 ncdv-master-1 devstack@n-api.service[131321]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Jul 23 21:31:07.183812 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'body': {'server': {'name': 12345, 'imageRef': 'b27b20aa-ef1b-4dd1-989e-321af6343d6a', 'flavorRef': '452', 'networks': [{'uuid': '654a77ca-1e84-434d-8536-1fc3adb327d0'}]}}} Jul 23 21:31:07.183812 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:31:07.183812 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:07.183812 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 23 21:31:07.183812 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 23 21:31:07.183812 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 23 21:31:07.183812 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise error Jul 23 21:31:07.183812 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Jul 23 21:31:07.183812 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:07.183812 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Jul 23 21:31:07.183812 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 23 21:31:07.183812 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:07.183812 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 23 21:31:07.183812 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi 12345 Jul 23 21:31:07.183812 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:07.183812 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:31:07.183812 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:07.183812 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:07.183812 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:31:07.183812 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:31:07.183812 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:31:07.183812 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:31:07.183812 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:31:07.183812 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:31:07.183812 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:31:07.183812 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:31:07.183812 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 23 21:31:07.183812 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 23 21:31:07.183812 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 23 21:31:07.183812 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 23 21:31:07.183812 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 23 21:31:07.188204 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 23 21:31:07.188204 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Jul 23 21:31:07.188204 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:07.188204 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:31:07.188204 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:07.188204 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:07.188204 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:31:07.188204 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:31:07.188204 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 23 21:31:07.188204 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 23 21:31:07.188204 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Jul 23 21:31:07.188204 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:07.190929 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-122d3883-eed2-4b92-8f1c-dee5bb25470c tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:31:07.191782 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-122d3883-eed2-4b92-8f1c-dee5bb25470c tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.014614 Jul 23 21:31:07.192366 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2127/4172] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:31:07 2022] POST /compute/v2.1/servers => generated 127 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 23 21:31:07.202107 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-44e377a4-404d-4bf9-962a-e98b3077f5b6 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:07.207833 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-44e377a4-404d-4bf9-962a-e98b3077f5b6 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:07.232251 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-44e377a4-404d-4bf9-962a-e98b3077f5b6 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:07.232954 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-44e377a4-404d-4bf9-962a-e98b3077f5b6 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:07.234717 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-44e377a4-404d-4bf9-962a-e98b3077f5b6 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:07.237174 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-44e377a4-404d-4bf9-962a-e98b3077f5b6 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:07.287840 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-745d7b45-40d2-4390-b7fe-1c1d9c7ac963 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1435198613", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "networks": "none"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:31:07.352585 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-745d7b45-40d2-4390-b7fe-1c1d9c7ac963 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:31:07.353223 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-745d7b45-40d2-4390-b7fe-1c1d9c7ac963 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:31:07.354086 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-745d7b45-40d2-4390-b7fe-1c1d9c7ac963 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:31:07.354734 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-745d7b45-40d2-4390-b7fe-1c1d9c7ac963 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:31:07.355345 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-745d7b45-40d2-4390-b7fe-1c1d9c7ac963 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:31:07.366918 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-745d7b45-40d2-4390-b7fe-1c1d9c7ac963 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:07.367707 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-745d7b45-40d2-4390-b7fe-1c1d9c7ac963 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:07.368702 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-745d7b45-40d2-4390-b7fe-1c1d9c7ac963 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:07.369442 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-745d7b45-40d2-4390-b7fe-1c1d9c7ac963 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:07.398047 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-745d7b45-40d2-4390-b7fe-1c1d9c7ac963 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Getting quotas for project 0ffb5a534beb4a4eab7e16c936a22362. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:31:07.406816 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-745d7b45-40d2-4390-b7fe-1c1d9c7ac963 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Getting quotas for user d3d6440acdb14f7a8e24fb642f65a919 and project 0ffb5a534beb4a4eab7e16c936a22362. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:31:07.422564 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-745d7b45-40d2-4390-b7fe-1c1d9c7ac963 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Going to run 1 instances... {{(pid=131320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:31:07.426494 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-745d7b45-40d2-4390-b7fe-1c1d9c7ac963 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] [instance: dea61dbd-f797-488b-891f-70b761712a1a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:31:07.444084 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:INSERT=5 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:31:07.485342 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-44e377a4-404d-4bf9-962a-e98b3077f5b6 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:07.495901 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-44e377a4-404d-4bf9-962a-e98b3077f5b6 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1505 microversion: 2.1 time: 0.298933 Jul 23 21:31:07.508943 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2128/4173] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:07 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1505 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:07.516044 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-745d7b45-40d2-4390-b7fe-1c1d9c7ac963 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.560080 Jul 23 21:31:07.516044 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2046/4174] 10.222.0.17 () {62 vars in 1187 bytes} [Sat Jul 23 21:31:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 565 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 23 21:31:07.520244 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ac2be284-7151-47d3-a79a-f8a69c33024b tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:07.520872 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-ac2be284-7151-47d3-a79a-f8a69c33024b tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] [instance: a053bb4d-aaa2-4f14-bb62-5623ef5448aa] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:07.528363 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ac2be284-7151-47d3-a79a-f8a69c33024b tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:07.528810 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ac2be284-7151-47d3-a79a-f8a69c33024b tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:07.535178 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-23cba991-369b-4cc2-9835-55e0922a25e8 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:07.535494 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-23cba991-369b-4cc2-9835-55e0922a25e8 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] [instance: dea61dbd-f797-488b-891f-70b761712a1a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:07.536568 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ac2be284-7151-47d3-a79a-f8a69c33024b tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:07.537240 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ac2be284-7151-47d3-a79a-f8a69c33024b tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:07.782785 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ac2be284-7151-47d3-a79a-f8a69c33024b tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc0782a98aca44f18bf86a9f6ad5eb60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d547fc8e53d43888e35c3e8ef5caada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:07.801708 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-ac2be284-7151-47d3-a79a-f8a69c33024b tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] 10.222.0.17 "GET /compute/v2.1/servers/a053bb4d-aaa2-4f14-bb62-5623ef5448aa" status: 200 len: 1280 microversion: 2.1 time: 0.287383 Jul 23 21:31:07.802704 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2129/4175] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:07 2022] GET /compute/v2.1/servers/a053bb4d-aaa2-4f14-bb62-5623ef5448aa => generated 1280 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:07.807452 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-30c662c7-e6af-45e2-957e-7fdcadfa3727 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:07.807999 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-30c662c7-e6af-45e2-957e-7fdcadfa3727 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:07.829944 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-23cba991-369b-4cc2-9835-55e0922a25e8 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:07.836882 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-30c662c7-e6af-45e2-957e-7fdcadfa3727 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:07.839810 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-30c662c7-e6af-45e2-957e-7fdcadfa3727 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:07.840625 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-30c662c7-e6af-45e2-957e-7fdcadfa3727 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:07.841103 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-30c662c7-e6af-45e2-957e-7fdcadfa3727 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:07.891418 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-23cba991-369b-4cc2-9835-55e0922a25e8 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:07.908332 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-23cba991-369b-4cc2-9835-55e0922a25e8 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:07.923865 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-23cba991-369b-4cc2-9835-55e0922a25e8 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] 10.222.0.17 "GET /compute/v2.1/servers/dea61dbd-f797-488b-891f-70b761712a1a" status: 200 len: 1278 microversion: 2.47 time: 0.408602 Jul 23 21:31:07.934318 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2047/4176] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:31:07 2022] GET /compute/v2.1/servers/dea61dbd-f797-488b-891f-70b761712a1a => generated 1278 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:31:07.934318 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0377181d-d6d3-486a-ab8f-b4244b030fdd tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:07.934318 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-0377181d-d6d3-486a-ab8f-b4244b030fdd tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: fc75dd20-e6e4-4484-b715-2251c593c9e5] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:07.951738 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0377181d-d6d3-486a-ab8f-b4244b030fdd tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:07.953122 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0377181d-d6d3-486a-ab8f-b4244b030fdd tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:07.954277 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0377181d-d6d3-486a-ab8f-b4244b030fdd tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:07.954808 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0377181d-d6d3-486a-ab8f-b4244b030fdd tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:08.592362 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-0377181d-d6d3-486a-ab8f-b4244b030fdd tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:08.601148 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-0377181d-d6d3-486a-ab8f-b4244b030fdd tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75dd20-e6e4-4484-b715-2251c593c9e5" status: 200 len: 1309 microversion: 2.1 time: 0.672789 Jul 23 21:31:08.611833 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2048/4177] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:07 2022] GET /compute/v2.1/servers/fc75dd20-e6e4-4484-b715-2251c593c9e5 => generated 1309 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:08.625382 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-10ebe387-635b-42c4-90f9-bc6b6f5fcb40 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-66004834", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "networks": "none"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:31:08.724886 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-10ebe387-635b-42c4-90f9-bc6b6f5fcb40 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:31:08.725562 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-10ebe387-635b-42c4-90f9-bc6b6f5fcb40 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:31:08.726315 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-10ebe387-635b-42c4-90f9-bc6b6f5fcb40 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:31:08.726837 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-10ebe387-635b-42c4-90f9-bc6b6f5fcb40 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:31:08.727438 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-10ebe387-635b-42c4-90f9-bc6b6f5fcb40 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:31:08.761435 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-10ebe387-635b-42c4-90f9-bc6b6f5fcb40 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:08.762099 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-10ebe387-635b-42c4-90f9-bc6b6f5fcb40 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:08.763224 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-10ebe387-635b-42c4-90f9-bc6b6f5fcb40 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:08.764025 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-10ebe387-635b-42c4-90f9-bc6b6f5fcb40 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:08.831654 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-30c662c7-e6af-45e2-957e-7fdcadfa3727 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:08.838917 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-10ebe387-635b-42c4-90f9-bc6b6f5fcb40 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Getting quotas for project 0ffb5a534beb4a4eab7e16c936a22362. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:31:08.839630 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-30c662c7-e6af-45e2-957e-7fdcadfa3727 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1505 microversion: 2.1 time: 1.035762 Jul 23 21:31:08.844244 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2130/4178] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:07 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1505 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:08.856327 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-dfa10964-8efd-4e8d-9ac1-76ed630792d0 tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:08.857297 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-dfa10964-8efd-4e8d-9ac1-76ed630792d0 tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] [instance: a053bb4d-aaa2-4f14-bb62-5623ef5448aa] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:08.861443 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-10ebe387-635b-42c4-90f9-bc6b6f5fcb40 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Getting quotas for user d3d6440acdb14f7a8e24fb642f65a919 and project 0ffb5a534beb4a4eab7e16c936a22362. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:31:08.881273 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-dfa10964-8efd-4e8d-9ac1-76ed630792d0 tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:08.881853 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-dfa10964-8efd-4e8d-9ac1-76ed630792d0 tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:08.882543 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-dfa10964-8efd-4e8d-9ac1-76ed630792d0 tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:08.883293 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-dfa10964-8efd-4e8d-9ac1-76ed630792d0 tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:08.904729 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-10ebe387-635b-42c4-90f9-bc6b6f5fcb40 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Going to run 1 instances... {{(pid=131320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:31:08.907474 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-10ebe387-635b-42c4-90f9-bc6b6f5fcb40 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] [instance: 5cb6a473-80fe-4569-bd9a-52511d3b81aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:31:09.043521 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-dfa10964-8efd-4e8d-9ac1-76ed630792d0 tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc0782a98aca44f18bf86a9f6ad5eb60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d547fc8e53d43888e35c3e8ef5caada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:09.049095 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-10ebe387-635b-42c4-90f9-bc6b6f5fcb40 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.434312 Jul 23 21:31:09.054066 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2049/4179] 10.222.0.17 () {62 vars in 1187 bytes} [Sat Jul 23 21:31:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 442 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 23 21:31:09.062173 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-dfa10964-8efd-4e8d-9ac1-76ed630792d0 tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] 10.222.0.17 "GET /compute/v2.1/servers/a053bb4d-aaa2-4f14-bb62-5623ef5448aa" status: 200 len: 1286 microversion: 2.1 time: 0.216603 Jul 23 21:31:09.062670 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2131/4180] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:08 2022] GET /compute/v2.1/servers/a053bb4d-aaa2-4f14-bb62-5623ef5448aa => generated 1286 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:09.065053 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-52067939-03eb-45dd-a60a-41aad0bae8ea tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:31:09.066516 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-52067939-03eb-45dd-a60a-41aad0bae8ea tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] [instance: 5cb6a473-80fe-4569-bd9a-52511d3b81aa] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:09.169565 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-52067939-03eb-45dd-a60a-41aad0bae8ea tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] 10.222.0.17 "PUT /compute/v2.1/servers/5cb6a473-80fe-4569-bd9a-52511d3b81aa" status: 200 len: 990 microversion: 2.47 time: 0.108974 Jul 23 21:31:09.186024 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2050/4181] 10.222.0.17 () {62 vars in 1296 bytes} [Sat Jul 23 21:31:09 2022] PUT /compute/v2.1/servers/5cb6a473-80fe-4569-bd9a-52511d3b81aa => generated 990 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 23 21:31:09.199519 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-7f3afa96-810d-4a95-af08-0e328e811daf tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:09.200457 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-7f3afa96-810d-4a95-af08-0e328e811daf tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] [instance: 5cb6a473-80fe-4569-bd9a-52511d3b81aa] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:09.581030 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-7f3afa96-810d-4a95-af08-0e328e811daf tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:09.602737 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-7f3afa96-810d-4a95-af08-0e328e811daf tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:09.604326 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-7f3afa96-810d-4a95-af08-0e328e811daf tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:09.605526 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-7f3afa96-810d-4a95-af08-0e328e811daf tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] 10.222.0.17 "GET /compute/v2.1/servers/5cb6a473-80fe-4569-bd9a-52511d3b81aa" status: 200 len: 1276 microversion: 2.47 time: 0.414323 Jul 23 21:31:09.626573 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2132/4182] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:31:09 2022] GET /compute/v2.1/servers/5cb6a473-80fe-4569-bd9a-52511d3b81aa => generated 1276 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:31:09.632500 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5e40c1fe-68cb-49b8-b867-1e2fddb94ad2 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:09.633523 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5e40c1fe-68cb-49b8-b867-1e2fddb94ad2 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: fc75dd20-e6e4-4484-b715-2251c593c9e5] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:09.652551 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5e40c1fe-68cb-49b8-b867-1e2fddb94ad2 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:09.653021 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5e40c1fe-68cb-49b8-b867-1e2fddb94ad2 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:09.653930 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5e40c1fe-68cb-49b8-b867-1e2fddb94ad2 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:09.654390 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5e40c1fe-68cb-49b8-b867-1e2fddb94ad2 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:10.108552 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d0e03003-ae1a-4759-b2ce-32b6458b533d tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:10.109160 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-d0e03003-ae1a-4759-b2ce-32b6458b533d tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] [instance: a053bb4d-aaa2-4f14-bb62-5623ef5448aa] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:10.147247 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d0e03003-ae1a-4759-b2ce-32b6458b533d tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:10.152126 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d0e03003-ae1a-4759-b2ce-32b6458b533d tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:10.153446 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d0e03003-ae1a-4759-b2ce-32b6458b533d tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:10.154715 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d0e03003-ae1a-4759-b2ce-32b6458b533d tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:10.317596 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-d0e03003-ae1a-4759-b2ce-32b6458b533d tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc0782a98aca44f18bf86a9f6ad5eb60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d547fc8e53d43888e35c3e8ef5caada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:10.330110 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-d0e03003-ae1a-4759-b2ce-32b6458b533d tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] 10.222.0.17 "GET /compute/v2.1/servers/a053bb4d-aaa2-4f14-bb62-5623ef5448aa" status: 200 len: 1286 microversion: 2.1 time: 0.255199 Jul 23 21:31:10.338772 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2133/4183] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:10 2022] GET /compute/v2.1/servers/a053bb4d-aaa2-4f14-bb62-5623ef5448aa => generated 1286 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:10.346040 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c6193bfd-c76f-4c68-8447-f3be530992da tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:10.346554 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-c6193bfd-c76f-4c68-8447-f3be530992da tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:10.370778 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c6193bfd-c76f-4c68-8447-f3be530992da tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:10.371260 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c6193bfd-c76f-4c68-8447-f3be530992da tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:10.372207 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c6193bfd-c76f-4c68-8447-f3be530992da tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:10.374431 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c6193bfd-c76f-4c68-8447-f3be530992da tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:10.444447 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-c6193bfd-c76f-4c68-8447-f3be530992da tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Going to try to terminate instance {{(pid=131321) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:31:10.497159 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:31:10.533242 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.compute.api [None req-c6193bfd-c76f-4c68-8447-f3be530992da tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Instance is already in deleting state, ignoring this request Jul 23 21:31:10.534323 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-c6193bfd-c76f-4c68-8447-f3be530992da tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "DELETE /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 204 len: 0 microversion: 2.42 time: 0.194222 Jul 23 21:31:10.535101 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2134/4184] 10.222.0.17 () {60 vars in 1279 bytes} [Sat Jul 23 21:31:10 2022] DELETE /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 23 21:31:10.544477 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-177e04f7-ef90-49b2-aa87-a6d060041e57 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:10.545451 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-177e04f7-ef90-49b2-aa87-a6d060041e57 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:10.553918 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-177e04f7-ef90-49b2-aa87-a6d060041e57 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:10.554383 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-177e04f7-ef90-49b2-aa87-a6d060041e57 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:10.556208 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-177e04f7-ef90-49b2-aa87-a6d060041e57 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:10.556656 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-177e04f7-ef90-49b2-aa87-a6d060041e57 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:10.690721 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5e40c1fe-68cb-49b8-b867-1e2fddb94ad2 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:10.702824 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5e40c1fe-68cb-49b8-b867-1e2fddb94ad2 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75dd20-e6e4-4484-b715-2251c593c9e5" status: 200 len: 1490 microversion: 2.1 time: 1.075293 Jul 23 21:31:10.703605 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2051/4185] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:09 2022] GET /compute/v2.1/servers/fc75dd20-e6e4-4484-b715-2251c593c9e5 => generated 1490 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:31:10.717178 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f3b8a959-cb94-452d-9aad-688ea46fbd4b tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:10.718209 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f3b8a959-cb94-452d-9aad-688ea46fbd4b tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] [instance: 5cb6a473-80fe-4569-bd9a-52511d3b81aa] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:10.729668 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f3b8a959-cb94-452d-9aad-688ea46fbd4b tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:10.730517 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f3b8a959-cb94-452d-9aad-688ea46fbd4b tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:10.742274 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f3b8a959-cb94-452d-9aad-688ea46fbd4b tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:10.743250 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f3b8a959-cb94-452d-9aad-688ea46fbd4b tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:10.756929 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-177e04f7-ef90-49b2-aa87-a6d060041e57 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:10.772555 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-177e04f7-ef90-49b2-aa87-a6d060041e57 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:10.776081 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-177e04f7-ef90-49b2-aa87-a6d060041e57 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:10.777330 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-177e04f7-ef90-49b2-aa87-a6d060041e57 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.237659 Jul 23 21:31:10.796958 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2135/4186] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:31:10 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:31:10.802666 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-0a70ec3e-873e-4ed0-a78f-16be629a3069 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:10.803285 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-0a70ec3e-873e-4ed0-a78f-16be629a3069 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:10.830543 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0a70ec3e-873e-4ed0-a78f-16be629a3069 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:10.831232 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0a70ec3e-873e-4ed0-a78f-16be629a3069 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:10.832185 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0a70ec3e-873e-4ed0-a78f-16be629a3069 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:10.832777 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0a70ec3e-873e-4ed0-a78f-16be629a3069 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:10.964004 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f3b8a959-cb94-452d-9aad-688ea46fbd4b tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:10.989673 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f3b8a959-cb94-452d-9aad-688ea46fbd4b tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:10.992010 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f3b8a959-cb94-452d-9aad-688ea46fbd4b tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:10.995139 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f3b8a959-cb94-452d-9aad-688ea46fbd4b tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] 10.222.0.17 "GET /compute/v2.1/servers/5cb6a473-80fe-4569-bd9a-52511d3b81aa" status: 200 len: 1328 microversion: 2.47 time: 0.289900 Jul 23 21:31:10.995945 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2052/4187] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:31:10 2022] GET /compute/v2.1/servers/5cb6a473-80fe-4569-bd9a-52511d3b81aa => generated 1328 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:31:11.004906 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e90e865e-3337-4fb9-a230-d89a88dac8d0 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:11.005713 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e90e865e-3337-4fb9-a230-d89a88dac8d0 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: f685637e-a804-4266-81a2-67d2e11a60b0] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:11.013715 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e90e865e-3337-4fb9-a230-d89a88dac8d0 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:11.014692 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e90e865e-3337-4fb9-a230-d89a88dac8d0 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:11.015781 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e90e865e-3337-4fb9-a230-d89a88dac8d0 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:11.016692 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e90e865e-3337-4fb9-a230-d89a88dac8d0 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:11.236438 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-0a70ec3e-873e-4ed0-a78f-16be629a3069 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:11.245335 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-0a70ec3e-873e-4ed0-a78f-16be629a3069 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1505 microversion: 2.1 time: 0.447201 Jul 23 21:31:11.261326 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2136/4188] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:10 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1505 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:11.273627 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-daea6866-37e0-4103-bba8-5ba0ba6be30f tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:11.275393 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-daea6866-37e0-4103-bba8-5ba0ba6be30f tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:11.284627 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-daea6866-37e0-4103-bba8-5ba0ba6be30f tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:11.285375 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-daea6866-37e0-4103-bba8-5ba0ba6be30f tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:11.286192 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-daea6866-37e0-4103-bba8-5ba0ba6be30f tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:11.286780 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-daea6866-37e0-4103-bba8-5ba0ba6be30f tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:11.611396 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-daea6866-37e0-4103-bba8-5ba0ba6be30f tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:11.628253 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-daea6866-37e0-4103-bba8-5ba0ba6be30f tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1505 microversion: 2.1 time: 0.362298 Jul 23 21:31:11.629820 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2137/4189] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:11 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1505 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:11.648511 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-10ee0eac-43b1-474f-92fa-47228b77250f tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:11.655725 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-10ee0eac-43b1-474f-92fa-47228b77250f tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] [instance: a053bb4d-aaa2-4f14-bb62-5623ef5448aa] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:11.671114 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-10ee0eac-43b1-474f-92fa-47228b77250f tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:11.671614 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-10ee0eac-43b1-474f-92fa-47228b77250f tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:11.672472 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-10ee0eac-43b1-474f-92fa-47228b77250f tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:11.672973 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-10ee0eac-43b1-474f-92fa-47228b77250f tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:11.763150 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e90e865e-3337-4fb9-a230-d89a88dac8d0 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:11.773595 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e90e865e-3337-4fb9-a230-d89a88dac8d0 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/f685637e-a804-4266-81a2-67d2e11a60b0" status: 200 len: 1491 microversion: 2.1 time: 0.775959 Jul 23 21:31:11.787769 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2053/4190] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:10 2022] GET /compute/v2.1/servers/f685637e-a804-4266-81a2-67d2e11a60b0 => generated 1491 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:11.803616 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-b9d70412-c8b3-42ba-8d7a-04dcc1ed238f req-4f8f3511-bb19-4e27-8b18-6190675623c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b90d9c54-1b5f-40db-acc6-67aaf46def15", "tag": "11b31040-c051-49e9-abc5-174c912590d7"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:31:11.839233 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-b9d70412-c8b3-42ba-8d7a-04dcc1ed238f req-4f8f3511-bb19-4e27-8b18-6190675623c0 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:11.839939 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-b9d70412-c8b3-42ba-8d7a-04dcc1ed238f req-4f8f3511-bb19-4e27-8b18-6190675623c0 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:11.867679 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-b9d70412-c8b3-42ba-8d7a-04dcc1ed238f req-4f8f3511-bb19-4e27-8b18-6190675623c0 service nova] Creating event network-changed:11b31040-c051-49e9-abc5-174c912590d7 for instance b90d9c54-1b5f-40db-acc6-67aaf46def15 on nch2-master-1 Jul 23 21:31:11.877918 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-b9d70412-c8b3-42ba-8d7a-04dcc1ed238f req-4f8f3511-bb19-4e27-8b18-6190675623c0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083407 Jul 23 21:31:11.878993 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2054/4191] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:31:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:31:11.884399 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3e9eff8f-e056-4ab7-986b-f376a5ae3d99 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:11.887931 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-3e9eff8f-e056-4ab7-986b-f376a5ae3d99 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:11.909077 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3e9eff8f-e056-4ab7-986b-f376a5ae3d99 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:11.909725 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3e9eff8f-e056-4ab7-986b-f376a5ae3d99 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:11.910560 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3e9eff8f-e056-4ab7-986b-f376a5ae3d99 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:11.911150 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3e9eff8f-e056-4ab7-986b-f376a5ae3d99 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:12.114771 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-3e9eff8f-e056-4ab7-986b-f376a5ae3d99 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:12.147297 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-3e9eff8f-e056-4ab7-986b-f376a5ae3d99 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:12.155834 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-3e9eff8f-e056-4ab7-986b-f376a5ae3d99 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:12.157317 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-3e9eff8f-e056-4ab7-986b-f376a5ae3d99 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.277055 Jul 23 21:31:12.158082 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2055/4192] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:31:11 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:31:12.174166 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-098066af-c65c-44e2-8145-116f6c9fb252 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:12.175023 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-098066af-c65c-44e2-8145-116f6c9fb252 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: fc75dd20-e6e4-4484-b715-2251c593c9e5] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:12.206155 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-098066af-c65c-44e2-8145-116f6c9fb252 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:12.206155 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-098066af-c65c-44e2-8145-116f6c9fb252 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:12.207065 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-098066af-c65c-44e2-8145-116f6c9fb252 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:12.210106 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-098066af-c65c-44e2-8145-116f6c9fb252 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:12.400205 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-10ee0eac-43b1-474f-92fa-47228b77250f tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc0782a98aca44f18bf86a9f6ad5eb60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d547fc8e53d43888e35c3e8ef5caada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:12.413134 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-10ee0eac-43b1-474f-92fa-47228b77250f tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] 10.222.0.17 "GET /compute/v2.1/servers/a053bb4d-aaa2-4f14-bb62-5623ef5448aa" status: 200 len: 1328 microversion: 2.1 time: 0.780929 Jul 23 21:31:12.413231 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2138/4193] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:11 2022] GET /compute/v2.1/servers/a053bb4d-aaa2-4f14-bb62-5623ef5448aa => generated 1328 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:12.430771 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-12a51d43-16f9-462e-95c7-4c6b7d34da9d tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:12.431546 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-12a51d43-16f9-462e-95c7-4c6b7d34da9d tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] [instance: 5cb6a473-80fe-4569-bd9a-52511d3b81aa] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:12.443307 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:31:12.470266 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-12a51d43-16f9-462e-95c7-4c6b7d34da9d tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:12.470885 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-12a51d43-16f9-462e-95c7-4c6b7d34da9d tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:12.471741 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-12a51d43-16f9-462e-95c7-4c6b7d34da9d tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:12.472179 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-12a51d43-16f9-462e-95c7-4c6b7d34da9d tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:13.086213 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-12a51d43-16f9-462e-95c7-4c6b7d34da9d tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:13.099208 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-12a51d43-16f9-462e-95c7-4c6b7d34da9d tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:13.104182 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-12a51d43-16f9-462e-95c7-4c6b7d34da9d tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:13.109749 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-12a51d43-16f9-462e-95c7-4c6b7d34da9d tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] 10.222.0.17 "GET /compute/v2.1/servers/5cb6a473-80fe-4569-bd9a-52511d3b81aa" status: 200 len: 1334 microversion: 2.47 time: 0.692806 Jul 23 21:31:13.111085 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2139/4194] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:31:12 2022] GET /compute/v2.1/servers/5cb6a473-80fe-4569-bd9a-52511d3b81aa => generated 1334 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:31:13.176878 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-b20df6f9-38db-4d6c-996d-a6fdb9ec938f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:13.177513 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-b20df6f9-38db-4d6c-996d-a6fdb9ec938f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:13.186721 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b20df6f9-38db-4d6c-996d-a6fdb9ec938f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:13.187456 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b20df6f9-38db-4d6c-996d-a6fdb9ec938f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:13.188450 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b20df6f9-38db-4d6c-996d-a6fdb9ec938f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:13.189038 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b20df6f9-38db-4d6c-996d-a6fdb9ec938f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:13.261550 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-098066af-c65c-44e2-8145-116f6c9fb252 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:13.277538 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-098066af-c65c-44e2-8145-116f6c9fb252 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75dd20-e6e4-4484-b715-2251c593c9e5" status: 200 len: 1490 microversion: 2.1 time: 1.107737 Jul 23 21:31:13.278614 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2056/4195] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:12 2022] GET /compute/v2.1/servers/fc75dd20-e6e4-4484-b715-2251c593c9e5 => generated 1490 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:13.295680 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-486a5c12-bca0-46a9-871f-3483a4b9e68b tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:13.296518 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-486a5c12-bca0-46a9-871f-3483a4b9e68b tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: fc75dd20-e6e4-4484-b715-2251c593c9e5] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:13.306727 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-486a5c12-bca0-46a9-871f-3483a4b9e68b tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:13.307589 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-486a5c12-bca0-46a9-871f-3483a4b9e68b tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:13.309393 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-486a5c12-bca0-46a9-871f-3483a4b9e68b tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:13.310101 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-486a5c12-bca0-46a9-871f-3483a4b9e68b tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:13.337410 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-b20df6f9-38db-4d6c-996d-a6fdb9ec938f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:13.366545 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-486a5c12-bca0-46a9-871f-3483a4b9e68b tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: fc75dd20-e6e4-4484-b715-2251c593c9e5] Going to try to terminate instance {{(pid=131320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:31:13.367876 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-b20df6f9-38db-4d6c-996d-a6fdb9ec938f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:13.371148 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-b20df6f9-38db-4d6c-996d-a6fdb9ec938f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:13.372805 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-b20df6f9-38db-4d6c-996d-a6fdb9ec938f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.200462 Jul 23 21:31:13.373607 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2140/4196] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:31:13 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:31:13.415875 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-4250bedd-629b-4cea-abea-3edd9adb5af5 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:13.417239 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-4250bedd-629b-4cea-abea-3edd9adb5af5 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:13.439051 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4250bedd-629b-4cea-abea-3edd9adb5af5 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:13.442399 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4250bedd-629b-4cea-abea-3edd9adb5af5 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:13.443539 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4250bedd-629b-4cea-abea-3edd9adb5af5 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:13.445614 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4250bedd-629b-4cea-abea-3edd9adb5af5 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:13.549567 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-486a5c12-bca0-46a9-871f-3483a4b9e68b tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "DELETE /compute/v2.1/servers/fc75dd20-e6e4-4484-b715-2251c593c9e5" status: 204 len: 0 microversion: 2.1 time: 0.257366 Jul 23 21:31:13.551287 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2057/4197] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:31:13 2022] DELETE /compute/v2.1/servers/fc75dd20-e6e4-4484-b715-2251c593c9e5 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 23 21:31:13.563710 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-40f67091-d7cb-41eb-9166-16f33e9ced6c tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:13.564818 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-40f67091-d7cb-41eb-9166-16f33e9ced6c tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] [instance: a053bb4d-aaa2-4f14-bb62-5623ef5448aa] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:13.573507 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-40f67091-d7cb-41eb-9166-16f33e9ced6c tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:13.574475 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-40f67091-d7cb-41eb-9166-16f33e9ced6c tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:13.575625 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-40f67091-d7cb-41eb-9166-16f33e9ced6c tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:13.576410 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-40f67091-d7cb-41eb-9166-16f33e9ced6c tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:13.845641 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-4250bedd-629b-4cea-abea-3edd9adb5af5 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:13.879271 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-4250bedd-629b-4cea-abea-3edd9adb5af5 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1505 microversion: 2.1 time: 0.455011 Jul 23 21:31:13.882144 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2141/4198] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:13 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1505 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:31:13.900435 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-b78dbd9c-cde3-4f02-9532-14eb6b253aea tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:13.903356 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-b78dbd9c-cde3-4f02-9532-14eb6b253aea tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: fc75dd20-e6e4-4484-b715-2251c593c9e5] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:13.934640 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b78dbd9c-cde3-4f02-9532-14eb6b253aea tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:13.936081 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b78dbd9c-cde3-4f02-9532-14eb6b253aea tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:13.941986 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b78dbd9c-cde3-4f02-9532-14eb6b253aea tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:13.950204 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b78dbd9c-cde3-4f02-9532-14eb6b253aea tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:14.193452 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-40f67091-d7cb-41eb-9166-16f33e9ced6c tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc0782a98aca44f18bf86a9f6ad5eb60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d547fc8e53d43888e35c3e8ef5caada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:14.205005 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-40f67091-d7cb-41eb-9166-16f33e9ced6c tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] 10.222.0.17 "GET /compute/v2.1/servers/a053bb4d-aaa2-4f14-bb62-5623ef5448aa" status: 200 len: 1328 microversion: 2.1 time: 0.650272 Jul 23 21:31:14.206370 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2058/4199] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:13 2022] GET /compute/v2.1/servers/a053bb4d-aaa2-4f14-bb62-5623ef5448aa => generated 1328 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:14.213760 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-b78dbd9c-cde3-4f02-9532-14eb6b253aea tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:14.225886 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-b78dbd9c-cde3-4f02-9532-14eb6b253aea tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75dd20-e6e4-4484-b715-2251c593c9e5" status: 200 len: 1496 microversion: 2.1 time: 0.340903 Jul 23 21:31:14.226337 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-de65a2c0-5ce5-4744-b395-1022e1bf098e tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:14.228908 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-de65a2c0-5ce5-4744-b395-1022e1bf098e tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:14.229631 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2142/4200] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:13 2022] GET /compute/v2.1/servers/fc75dd20-e6e4-4484-b715-2251c593c9e5 => generated 1496 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:14.243585 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ca0aa89f-e8ba-4fe4-a286-12d323a2fddd tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:14.244591 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-ca0aa89f-e8ba-4fe4-a286-12d323a2fddd tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] [instance: 5cb6a473-80fe-4569-bd9a-52511d3b81aa] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:14.250984 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-de65a2c0-5ce5-4744-b395-1022e1bf098e tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:14.259545 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-de65a2c0-5ce5-4744-b395-1022e1bf098e tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:14.260801 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-de65a2c0-5ce5-4744-b395-1022e1bf098e tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:14.261397 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-de65a2c0-5ce5-4744-b395-1022e1bf098e tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:14.261716 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ca0aa89f-e8ba-4fe4-a286-12d323a2fddd tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:14.262922 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ca0aa89f-e8ba-4fe4-a286-12d323a2fddd tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:14.265480 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ca0aa89f-e8ba-4fe4-a286-12d323a2fddd tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:14.266907 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ca0aa89f-e8ba-4fe4-a286-12d323a2fddd tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:14.436862 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ca0aa89f-e8ba-4fe4-a286-12d323a2fddd tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:14.456154 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ca0aa89f-e8ba-4fe4-a286-12d323a2fddd tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:14.459544 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ca0aa89f-e8ba-4fe4-a286-12d323a2fddd tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:14.462191 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-ca0aa89f-e8ba-4fe4-a286-12d323a2fddd tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] 10.222.0.17 "GET /compute/v2.1/servers/5cb6a473-80fe-4569-bd9a-52511d3b81aa" status: 200 len: 1355 microversion: 2.47 time: 0.229929 Jul 23 21:31:14.490017 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2143/4201] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:31:14 2022] GET /compute/v2.1/servers/5cb6a473-80fe-4569-bd9a-52511d3b81aa => generated 1355 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:31:14.511636 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-8a3c7538-5a2c-4a1f-8045-c13f915d5faa tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:14.512272 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-8a3c7538-5a2c-4a1f-8045-c13f915d5faa tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:14.519494 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8a3c7538-5a2c-4a1f-8045-c13f915d5faa tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:14.519943 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8a3c7538-5a2c-4a1f-8045-c13f915d5faa tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:14.520726 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8a3c7538-5a2c-4a1f-8045-c13f915d5faa tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:14.521160 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8a3c7538-5a2c-4a1f-8045-c13f915d5faa tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:14.641331 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-8a3c7538-5a2c-4a1f-8045-c13f915d5faa tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:14.685556 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-8a3c7538-5a2c-4a1f-8045-c13f915d5faa tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:14.691403 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-8a3c7538-5a2c-4a1f-8045-c13f915d5faa tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:14.694303 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-8a3c7538-5a2c-4a1f-8045-c13f915d5faa tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.203072 Jul 23 21:31:14.710643 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2144/4202] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:31:14 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:31:14.732343 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-b90836cf-e7dc-49cf-9da2-bb39d3e6fce0 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:31:14.736115 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-b90836cf-e7dc-49cf-9da2-bb39d3e6fce0 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] [instance: 5cb6a473-80fe-4569-bd9a-52511d3b81aa] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:14.761005 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b90836cf-e7dc-49cf-9da2-bb39d3e6fce0 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:14.762092 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b90836cf-e7dc-49cf-9da2-bb39d3e6fce0 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:14.763148 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b90836cf-e7dc-49cf-9da2-bb39d3e6fce0 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:14.763787 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b90836cf-e7dc-49cf-9da2-bb39d3e6fce0 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:14.951311 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-b90836cf-e7dc-49cf-9da2-bb39d3e6fce0 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Flavor limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:31:14.952034 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-b90836cf-e7dc-49cf-9da2-bb39d3e6fce0 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Image limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:31:14.952825 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-b90836cf-e7dc-49cf-9da2-bb39d3e6fce0 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Flavor pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:31:14.953487 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-b90836cf-e7dc-49cf-9da2-bb39d3e6fce0 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Image pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:31:14.954453 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-b90836cf-e7dc-49cf-9da2-bb39d3e6fce0 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:31:15.076783 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-de65a2c0-5ce5-4744-b395-1022e1bf098e tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:15.095063 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-de65a2c0-5ce5-4744-b395-1022e1bf098e tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1505 microversion: 2.1 time: 0.885157 Jul 23 21:31:15.095923 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2059/4203] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:14 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1505 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:15.140757 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-b90836cf-e7dc-49cf-9da2-bb39d3e6fce0 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] [instance: 5cb6a473-80fe-4569-bd9a-52511d3b81aa] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:15.152787 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b90836cf-e7dc-49cf-9da2-bb39d3e6fce0 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:15.153287 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b90836cf-e7dc-49cf-9da2-bb39d3e6fce0 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:15.158322 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b90836cf-e7dc-49cf-9da2-bb39d3e6fce0 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:15.158559 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b90836cf-e7dc-49cf-9da2-bb39d3e6fce0 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:15.223345 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-96af496e-a24f-4698-8c40-e6a3f11508ee tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:15.225653 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-96af496e-a24f-4698-8c40-e6a3f11508ee tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] [instance: a053bb4d-aaa2-4f14-bb62-5623ef5448aa] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:15.243061 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-96af496e-a24f-4698-8c40-e6a3f11508ee tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:15.246537 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-96af496e-a24f-4698-8c40-e6a3f11508ee tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:15.251023 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-96af496e-a24f-4698-8c40-e6a3f11508ee tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:15.253160 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-96af496e-a24f-4698-8c40-e6a3f11508ee tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:15.282840 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-b90836cf-e7dc-49cf-9da2-bb39d3e6fce0 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] 10.222.0.17 "POST /compute/v2.1/servers/5cb6a473-80fe-4569-bd9a-52511d3b81aa/action" status: 202 len: 1077 microversion: 2.47 time: 0.568405 Jul 23 21:31:15.286314 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2145/4204] 10.222.0.17 () {62 vars in 1318 bytes} [Sat Jul 23 21:31:14 2022] POST /compute/v2.1/servers/5cb6a473-80fe-4569-bd9a-52511d3b81aa/action => generated 1077 bytes in 575 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 23 21:31:15.300686 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-4c59904b-be75-4ed1-9c1c-9296b7ec1a67 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1372473637", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "654a77ca-1e84-434d-8536-1fc3adb327d0"}]}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:31:15.307409 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-4c59904b-be75-4ed1-9c1c-9296b7ec1a67 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Request method failure captured: Jul 23 21:31:15.307409 ncdv-master-1 devstack@n-api.service[131321]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 23 21:31:15.307409 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:31:15.307409 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:31:15.307409 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:31:15.307409 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 492 Jul 23 21:31:15.307409 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:31:15.307409 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:31:15.307409 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:31:15.307409 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:31:15.307409 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3Ghf1JjZ4k8tVzERRK8IkLpluLUwa9k5Rz-X0dEr2p4_7xl_eBekUiNk1RZEGsFdGEiApbLOfcuSifirvwiKV1QOTaKdXKwfMnwZgdfagxJjoe3dPYUa3b-d3rVTYewIN_YoX2mMGGBMWRa3po8WOCVIc6hXJLExzq_ndbcO7U8NQBI Jul 23 21:31:15.307409 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:31:15.307409 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:31:15.307409 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:31:15.307409 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:31:15.307409 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:31:15.307409 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:31:15.307409 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: d70f6c96e1ad484aa3207fc01a12d519 Jul 23 21:31:15.307409 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:31:15.307409 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:31:15.307409 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:31:15.307409 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d70f6c96e1ad484aa3207fc01a12d519"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d70f6c96e1ad484aa3207fc01a12d519"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d70f6c96e1ad484aa3207fc01a12d519", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d70f6c96e1ad484aa3207fc01a12d519"}]}] Jul 23 21:31:15.307409 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:31:15.307409 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: d70f6c96e1ad484aa3207fc01a12d519 Jul 23 21:31:15.307409 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:31:15.307409 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ServersNegativeTestJSON-1106538570-project Jul 23 21:31:15.307409 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:31:15.307409 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:31:15.307409 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 6ca9644a73d9468aa39b21548a72bded Jul 23 21:31:15.307409 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ServersNegativeTestJSON-1106538570-project Jul 23 21:31:15.307409 ncdv-master-1 devstack@n-api.service[131321]: Jul 23 21:31:15.307409 ncdv-master-1 devstack@n-api.service[131321]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1372473637", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "654a77ca-1e84-434d-8536-1fc3adb327d0"}]}} Jul 23 21:31:15.307409 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:31:15.307409 ncdv-master-1 devstack@n-api.service[131321]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 23 21:31:15.307409 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1372473637', 'imageRef': 'b27b20aa-ef1b-4dd1-989e-321af6343d6a', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '654a77ca-1e84-434d-8536-1fc3adb327d0'}]}}} Jul 23 21:31:15.307409 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:31:15.307409 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:15.307409 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 23 21:31:15.307409 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 23 21:31:15.307409 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 23 21:31:15.307409 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise error Jul 23 21:31:15.307409 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 23 21:31:15.307409 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:15.307409 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Jul 23 21:31:15.307409 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Jul 23 21:31:15.307409 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:15.307409 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Jul 23 21:31:15.307409 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Jul 23 21:31:15.311934 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:15.311934 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:31:15.311934 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:15.311934 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:15.311934 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:31:15.311934 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:31:15.311934 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:31:15.311934 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:31:15.311934 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:31:15.311934 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:31:15.311934 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:31:15.311934 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:31:15.311934 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 23 21:31:15.311934 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 23 21:31:15.311934 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 23 21:31:15.311934 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 23 21:31:15.311934 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 23 21:31:15.311934 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 23 21:31:15.311934 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 23 21:31:15.311934 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:15.311934 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:31:15.311934 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:15.311934 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:15.311934 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:31:15.311934 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:31:15.311934 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 23 21:31:15.311934 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 23 21:31:15.311934 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 23 21:31:15.311934 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:15.316628 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-4c59904b-be75-4ed1-9c1c-9296b7ec1a67 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:31:15.318725 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-4c59904b-be75-4ed1-9c1c-9296b7ec1a67 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.030149 Jul 23 21:31:15.328079 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2146/4205] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:31:15 2022] POST /compute/v2.1/servers => generated 624 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 23 21:31:15.342039 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-cb392585-84ca-44e6-a206-4c1d7c3a8da8 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:15.344736 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-cb392585-84ca-44e6-a206-4c1d7c3a8da8 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: fc75dd20-e6e4-4484-b715-2251c593c9e5] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:15.379001 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cb392585-84ca-44e6-a206-4c1d7c3a8da8 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:15.379512 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cb392585-84ca-44e6-a206-4c1d7c3a8da8 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:15.380324 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cb392585-84ca-44e6-a206-4c1d7c3a8da8 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:15.385543 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cb392585-84ca-44e6-a206-4c1d7c3a8da8 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:15.997401 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-96af496e-a24f-4698-8c40-e6a3f11508ee tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc0782a98aca44f18bf86a9f6ad5eb60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d547fc8e53d43888e35c3e8ef5caada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:16.006570 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-96af496e-a24f-4698-8c40-e6a3f11508ee tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] 10.222.0.17 "GET /compute/v2.1/servers/a053bb4d-aaa2-4f14-bb62-5623ef5448aa" status: 200 len: 1328 microversion: 2.1 time: 0.787290 Jul 23 21:31:16.007172 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2060/4206] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:15 2022] GET /compute/v2.1/servers/a053bb4d-aaa2-4f14-bb62-5623ef5448aa => generated 1328 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:16.012785 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-04dd6ffc-1880-49a5-83a8-be361d9c5680 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:16.013720 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-04dd6ffc-1880-49a5-83a8-be361d9c5680 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] [instance: 5cb6a473-80fe-4569-bd9a-52511d3b81aa] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:16.020609 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-04dd6ffc-1880-49a5-83a8-be361d9c5680 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:16.021437 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-04dd6ffc-1880-49a5-83a8-be361d9c5680 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:16.022392 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-04dd6ffc-1880-49a5-83a8-be361d9c5680 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:16.023078 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-04dd6ffc-1880-49a5-83a8-be361d9c5680 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:16.133424 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-04dd6ffc-1880-49a5-83a8-be361d9c5680 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:16.137751 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:31:16.168813 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-04dd6ffc-1880-49a5-83a8-be361d9c5680 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:16.171198 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-04dd6ffc-1880-49a5-83a8-be361d9c5680 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:16.172608 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-04dd6ffc-1880-49a5-83a8-be361d9c5680 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] 10.222.0.17 "GET /compute/v2.1/servers/5cb6a473-80fe-4569-bd9a-52511d3b81aa" status: 200 len: 1364 microversion: 2.47 time: 0.164295 Jul 23 21:31:16.185271 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2061/4207] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:31:16 2022] GET /compute/v2.1/servers/5cb6a473-80fe-4569-bd9a-52511d3b81aa => generated 1364 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:31:16.192463 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-16a14cf9-35cf-4ad1-b120-835354177dd6 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:16.193487 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-16a14cf9-35cf-4ad1-b120-835354177dd6 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:16.203147 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-16a14cf9-35cf-4ad1-b120-835354177dd6 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:16.203895 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-16a14cf9-35cf-4ad1-b120-835354177dd6 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:16.204859 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-16a14cf9-35cf-4ad1-b120-835354177dd6 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:16.205468 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-16a14cf9-35cf-4ad1-b120-835354177dd6 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:16.375570 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-cb392585-84ca-44e6-a206-4c1d7c3a8da8 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:16.383841 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-cb392585-84ca-44e6-a206-4c1d7c3a8da8 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75dd20-e6e4-4484-b715-2251c593c9e5" status: 200 len: 1496 microversion: 2.1 time: 1.055234 Jul 23 21:31:16.384973 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2147/4208] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:15 2022] GET /compute/v2.1/servers/fc75dd20-e6e4-4484-b715-2251c593c9e5 => generated 1496 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:16.390159 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-938c523d-4dbf-4d3c-a0a6-88bfb757ee62 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:16.391170 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-938c523d-4dbf-4d3c-a0a6-88bfb757ee62 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:16.397809 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-938c523d-4dbf-4d3c-a0a6-88bfb757ee62 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:16.398531 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-938c523d-4dbf-4d3c-a0a6-88bfb757ee62 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:16.399483 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-938c523d-4dbf-4d3c-a0a6-88bfb757ee62 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:16.400067 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-938c523d-4dbf-4d3c-a0a6-88bfb757ee62 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:16.427906 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-16a14cf9-35cf-4ad1-b120-835354177dd6 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:16.436903 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-16a14cf9-35cf-4ad1-b120-835354177dd6 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1505 microversion: 2.1 time: 0.249902 Jul 23 21:31:16.443062 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2062/4209] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:16 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1505 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:16.448755 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-dc5b01e3-95fe-4d62-97e9-1b72be08d6a4 req-13b2df12-7336-4aac-b39b-e591e8817aba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a053bb4d-aaa2-4f14-bb62-5623ef5448aa", "tag": "dc3c2b67-c0b1-4e25-8f1d-3348a9b8ff05"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:31:16.462894 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-dc5b01e3-95fe-4d62-97e9-1b72be08d6a4 req-13b2df12-7336-4aac-b39b-e591e8817aba service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:16.463695 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-dc5b01e3-95fe-4d62-97e9-1b72be08d6a4 req-13b2df12-7336-4aac-b39b-e591e8817aba service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:16.486039 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-dc5b01e3-95fe-4d62-97e9-1b72be08d6a4 req-13b2df12-7336-4aac-b39b-e591e8817aba service nova] Creating event network-changed:dc3c2b67-c0b1-4e25-8f1d-3348a9b8ff05 for instance a053bb4d-aaa2-4f14-bb62-5623ef5448aa on nch2-master-1 Jul 23 21:31:16.493293 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-dc5b01e3-95fe-4d62-97e9-1b72be08d6a4 req-13b2df12-7336-4aac-b39b-e591e8817aba service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048312 Jul 23 21:31:16.495197 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2063/4210] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:31:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:31:16.503025 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-034a1bbb-087e-474a-b020-d2318945966a tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:16.503988 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-034a1bbb-087e-474a-b020-d2318945966a tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:16.511640 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-938c523d-4dbf-4d3c-a0a6-88bfb757ee62 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:16.514178 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-034a1bbb-087e-474a-b020-d2318945966a tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:16.514865 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-034a1bbb-087e-474a-b020-d2318945966a tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:16.515842 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-034a1bbb-087e-474a-b020-d2318945966a tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:16.516615 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-034a1bbb-087e-474a-b020-d2318945966a tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:16.522041 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-938c523d-4dbf-4d3c-a0a6-88bfb757ee62 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:16.535274 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-938c523d-4dbf-4d3c-a0a6-88bfb757ee62 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:16.536610 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-938c523d-4dbf-4d3c-a0a6-88bfb757ee62 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.150531 Jul 23 21:31:16.537267 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2148/4211] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:31:16 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:31:16.723458 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-034a1bbb-087e-474a-b020-d2318945966a tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:16.732322 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-034a1bbb-087e-474a-b020-d2318945966a tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1505 microversion: 2.1 time: 0.235244 Jul 23 21:31:16.732919 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2064/4212] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:16 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1505 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:16.890831 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-8330c606-bfbc-47c1-9c69-4ae3f828628d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "networks": [{"uuid": "654a77ca-1e84-434d-8536-1fc3adb327d0"}]}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:31:16.893815 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-8330c606-bfbc-47c1-9c69-4ae3f828628d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Request method failure captured: Jul 23 21:31:16.893815 ncdv-master-1 devstack@n-api.service[131321]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 23 21:31:16.893815 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:31:16.893815 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:31:16.893815 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:31:16.893815 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 416 Jul 23 21:31:16.893815 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:31:16.893815 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:31:16.893815 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:31:16.893815 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:31:16.893815 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3Ghf1JjZ4k8tVzERRK8IkLpluLUwa9k5Rz-X0dEr2p4_7xl_eBekUiNk1RZEGsFdGEiApbLOfcuSifirvwiKV1QOTaKdXKwfMnwZgdfagxJjoe3dPYUa3b-d3rVTYewIN_YoX2mMGGBMWRa3po8WOCVIc6hXJLExzq_ndbcO7U8NQBI Jul 23 21:31:16.893815 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:31:16.893815 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:31:16.893815 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:31:16.893815 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:31:16.893815 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:31:16.893815 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:31:16.893815 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: d70f6c96e1ad484aa3207fc01a12d519 Jul 23 21:31:16.893815 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:31:16.893815 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:31:16.893815 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:31:16.893815 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d70f6c96e1ad484aa3207fc01a12d519"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d70f6c96e1ad484aa3207fc01a12d519"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d70f6c96e1ad484aa3207fc01a12d519", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d70f6c96e1ad484aa3207fc01a12d519"}]}] Jul 23 21:31:16.893815 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:31:16.893815 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: d70f6c96e1ad484aa3207fc01a12d519 Jul 23 21:31:16.893815 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:31:16.893815 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ServersNegativeTestJSON-1106538570-project Jul 23 21:31:16.893815 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:31:16.893815 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:31:16.893815 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 6ca9644a73d9468aa39b21548a72bded Jul 23 21:31:16.893815 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ServersNegativeTestJSON-1106538570-project Jul 23 21:31:16.893815 ncdv-master-1 devstack@n-api.service[131321]: Jul 23 21:31:16.893815 ncdv-master-1 devstack@n-api.service[131321]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "networks": [{"uuid": "654a77ca-1e84-434d-8536-1fc3adb327d0"}]}} Jul 23 21:31:16.893815 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:31:16.893815 ncdv-master-1 devstack@n-api.service[131321]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 23 21:31:16.893815 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': 'b27b20aa-ef1b-4dd1-989e-321af6343d6a', 'flavorRef': '452', 'networks': [{'uuid': '654a77ca-1e84-434d-8536-1fc3adb327d0'}]}}} Jul 23 21:31:16.893815 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:31:16.893815 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:16.893815 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 23 21:31:16.893815 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 23 21:31:16.893815 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 23 21:31:16.893815 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise error Jul 23 21:31:16.893815 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 23 21:31:16.893815 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:16.893815 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Jul 23 21:31:16.893815 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 23 21:31:16.893815 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:16.893815 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 23 21:31:16.893815 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 23 21:31:16.893815 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:16.893815 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:31:16.893815 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:16.898482 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:16.898482 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:31:16.898482 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:31:16.898482 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:31:16.898482 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:31:16.898482 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:31:16.898482 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:31:16.898482 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:31:16.898482 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:31:16.898482 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 23 21:31:16.898482 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 23 21:31:16.898482 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 23 21:31:16.898482 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 23 21:31:16.898482 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 23 21:31:16.898482 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 23 21:31:16.898482 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 23 21:31:16.898482 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:16.898482 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:31:16.898482 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:16.898482 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:16.898482 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:31:16.898482 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:31:16.898482 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 23 21:31:16.898482 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 23 21:31:16.898482 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 23 21:31:16.898482 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:16.902555 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-8330c606-bfbc-47c1-9c69-4ae3f828628d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:31:16.903492 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-8330c606-bfbc-47c1-9c69-4ae3f828628d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.018545 Jul 23 21:31:16.904640 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2149/4213] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:31:16 2022] POST /compute/v2.1/servers => generated 619 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 23 21:31:16.914541 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-66bd6635-ffe1-4f06-8635-2456da04876c tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:16.915512 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-66bd6635-ffe1-4f06-8635-2456da04876c tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:16.925890 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-66bd6635-ffe1-4f06-8635-2456da04876c tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:16.926676 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-66bd6635-ffe1-4f06-8635-2456da04876c tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:16.928458 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-66bd6635-ffe1-4f06-8635-2456da04876c tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:16.929168 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-66bd6635-ffe1-4f06-8635-2456da04876c tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:17.023820 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-89fd08ee-cc6e-4d59-aee9-70f5b057081e tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:17.024444 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-89fd08ee-cc6e-4d59-aee9-70f5b057081e tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] [instance: a053bb4d-aaa2-4f14-bb62-5623ef5448aa] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:17.035384 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-89fd08ee-cc6e-4d59-aee9-70f5b057081e tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:17.037503 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-89fd08ee-cc6e-4d59-aee9-70f5b057081e tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:17.039781 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-89fd08ee-cc6e-4d59-aee9-70f5b057081e tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:17.040397 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-89fd08ee-cc6e-4d59-aee9-70f5b057081e tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:17.147588 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-66bd6635-ffe1-4f06-8635-2456da04876c tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:17.158021 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-66bd6635-ffe1-4f06-8635-2456da04876c tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1505 microversion: 2.1 time: 0.248984 Jul 23 21:31:17.158982 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2065/4214] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:16 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1505 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:17.175550 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2db707b0-ec8b-45f4-bc87-33758bf36377 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:17.176509 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-2db707b0-ec8b-45f4-bc87-33758bf36377 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:17.185317 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2db707b0-ec8b-45f4-bc87-33758bf36377 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:17.186546 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2db707b0-ec8b-45f4-bc87-33758bf36377 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:17.187513 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2db707b0-ec8b-45f4-bc87-33758bf36377 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:17.188221 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2db707b0-ec8b-45f4-bc87-33758bf36377 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:17.425690 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-89fd08ee-cc6e-4d59-aee9-70f5b057081e tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc0782a98aca44f18bf86a9f6ad5eb60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d547fc8e53d43888e35c3e8ef5caada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:17.429269 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:31:17.437776 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-89fd08ee-cc6e-4d59-aee9-70f5b057081e tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] 10.222.0.17 "GET /compute/v2.1/servers/a053bb4d-aaa2-4f14-bb62-5623ef5448aa" status: 200 len: 1328 microversion: 2.1 time: 0.416224 Jul 23 21:31:17.439001 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2150/4215] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:17 2022] GET /compute/v2.1/servers/a053bb4d-aaa2-4f14-bb62-5623ef5448aa => generated 1328 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:31:17.444263 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-23ff0bfe-0d72-44f8-8cbe-765c1c8abe07 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:17.445110 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-23ff0bfe-0d72-44f8-8cbe-765c1c8abe07 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] [instance: 5cb6a473-80fe-4569-bd9a-52511d3b81aa] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:17.453351 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-23ff0bfe-0d72-44f8-8cbe-765c1c8abe07 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:17.454100 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-23ff0bfe-0d72-44f8-8cbe-765c1c8abe07 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:17.455178 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-23ff0bfe-0d72-44f8-8cbe-765c1c8abe07 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:17.455780 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-23ff0bfe-0d72-44f8-8cbe-765c1c8abe07 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:17.532275 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-2db707b0-ec8b-45f4-bc87-33758bf36377 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:17.544458 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2db707b0-ec8b-45f4-bc87-33758bf36377 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1505 microversion: 2.1 time: 0.370471 Jul 23 21:31:17.549423 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2066/4216] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:17 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1505 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:17.562209 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-7dbe6e5c-db61-44fb-bd24-1dd60146b9e9 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:17.562980 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-7dbe6e5c-db61-44fb-bd24-1dd60146b9e9 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: fc75dd20-e6e4-4484-b715-2251c593c9e5] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:17.586052 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7dbe6e5c-db61-44fb-bd24-1dd60146b9e9 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:17.586833 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7dbe6e5c-db61-44fb-bd24-1dd60146b9e9 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:17.589261 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7dbe6e5c-db61-44fb-bd24-1dd60146b9e9 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:17.589945 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7dbe6e5c-db61-44fb-bd24-1dd60146b9e9 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:17.617365 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-23ff0bfe-0d72-44f8-8cbe-765c1c8abe07 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:17.630243 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-23ff0bfe-0d72-44f8-8cbe-765c1c8abe07 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:17.634563 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-23ff0bfe-0d72-44f8-8cbe-765c1c8abe07 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:17.638471 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-23ff0bfe-0d72-44f8-8cbe-765c1c8abe07 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] 10.222.0.17 "GET /compute/v2.1/servers/5cb6a473-80fe-4569-bd9a-52511d3b81aa" status: 200 len: 1364 microversion: 2.47 time: 0.197666 Jul 23 21:31:17.652053 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2151/4217] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:31:17 2022] GET /compute/v2.1/servers/5cb6a473-80fe-4569-bd9a-52511d3b81aa => generated 1364 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:31:17.657327 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-ff53f4d6-9b40-4354-a122-3073002d5733 req-ff303c7a-3c4e-46b3-bf1e-5e9df7bd6f74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc75dd20-e6e4-4484-b715-2251c593c9e5", "name": "network-vif-deleted", "tag": "737200ba-4d1d-40c0-aaa2-a478e7e3d2f6"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:31:17.666065 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-ff53f4d6-9b40-4354-a122-3073002d5733 req-ff303c7a-3c4e-46b3-bf1e-5e9df7bd6f74 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:17.666769 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-ff53f4d6-9b40-4354-a122-3073002d5733 req-ff303c7a-3c4e-46b3-bf1e-5e9df7bd6f74 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:17.679650 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-ff53f4d6-9b40-4354-a122-3073002d5733 req-ff303c7a-3c4e-46b3-bf1e-5e9df7bd6f74 service nova] Creating event network-vif-deleted:737200ba-4d1d-40c0-aaa2-a478e7e3d2f6 for instance fc75dd20-e6e4-4484-b715-2251c593c9e5 on nch1-master-1 Jul 23 21:31:17.681052 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7dbe6e5c-db61-44fb-bd24-1dd60146b9e9 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:17.681516 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7dbe6e5c-db61-44fb-bd24-1dd60146b9e9 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:17.682015 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.objects.instance [None req-7dbe6e5c-db61-44fb-bd24-1dd60146b9e9 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lazy-loading 'fault' on Instance uuid fc75dd20-e6e4-4484-b715-2251c593c9e5 {{(pid=131320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:31:17.686045 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-ff53f4d6-9b40-4354-a122-3073002d5733 req-ff303c7a-3c4e-46b3-bf1e-5e9df7bd6f74 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032167 Jul 23 21:31:17.687248 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2152/4218] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:31:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:31:17.692739 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c60fb1b8-32a0-45b8-beb0-f2f87be84cf6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:17.693670 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-c60fb1b8-32a0-45b8-beb0-f2f87be84cf6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:17.700592 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c60fb1b8-32a0-45b8-beb0-f2f87be84cf6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:17.701275 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c60fb1b8-32a0-45b8-beb0-f2f87be84cf6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:17.702269 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c60fb1b8-32a0-45b8-beb0-f2f87be84cf6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:17.702908 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c60fb1b8-32a0-45b8-beb0-f2f87be84cf6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:17.763857 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-7dbe6e5c-db61-44fb-bd24-1dd60146b9e9 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:17.775821 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-7dbe6e5c-db61-44fb-bd24-1dd60146b9e9 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75dd20-e6e4-4484-b715-2251c593c9e5" status: 200 len: 1299 microversion: 2.1 time: 0.224869 Jul 23 21:31:17.776996 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2067/4219] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:17 2022] GET /compute/v2.1/servers/fc75dd20-e6e4-4484-b715-2251c593c9e5 => generated 1299 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:17.789074 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c60fb1b8-32a0-45b8-beb0-f2f87be84cf6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:17.796068 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-199b2e8c-ad0c-42c3-ae43-2e822fb0945d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-194565371", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": -1, "networks": [{"uuid": "654a77ca-1e84-434d-8536-1fc3adb327d0"}]}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:31:17.806532 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c60fb1b8-32a0-45b8-beb0-f2f87be84cf6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:17.817940 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-199b2e8c-ad0c-42c3-ae43-2e822fb0945d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] HTTP exception thrown: Flavor -1 could not be found. Jul 23 21:31:17.821851 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-199b2e8c-ad0c-42c3-ae43-2e822fb0945d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Request method failure captured: Jul 23 21:31:17.821851 ncdv-master-1 devstack@n-api.service[131320]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 23 21:31:17.821851 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:31:17.821851 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:31:17.821851 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:31:17.821851 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 205 Jul 23 21:31:17.821851 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:31:17.821851 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:31:17.821851 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:31:17.821851 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:31:17.821851 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3Ghf1JjZ4k8tVzERRK8IkLpluLUwa9k5Rz-X0dEr2p4_7xl_eBekUiNk1RZEGsFdGEiApbLOfcuSifirvwiKV1QOTaKdXKwfMnwZgdfagxJjoe3dPYUa3b-d3rVTYewIN_YoX2mMGGBMWRa3po8WOCVIc6hXJLExzq_ndbcO7U8NQBI Jul 23 21:31:17.821851 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:31:17.821851 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:31:17.821851 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:31:17.821851 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:31:17.821851 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:31:17.821851 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:31:17.821851 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: d70f6c96e1ad484aa3207fc01a12d519 Jul 23 21:31:17.821851 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:31:17.821851 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:31:17.821851 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:31:17.821851 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d70f6c96e1ad484aa3207fc01a12d519"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d70f6c96e1ad484aa3207fc01a12d519"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d70f6c96e1ad484aa3207fc01a12d519", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d70f6c96e1ad484aa3207fc01a12d519"}]}] Jul 23 21:31:17.821851 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:31:17.821851 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: d70f6c96e1ad484aa3207fc01a12d519 Jul 23 21:31:17.821851 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:31:17.821851 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServersNegativeTestJSON-1106538570-project Jul 23 21:31:17.821851 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:31:17.821851 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:31:17.821851 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 6ca9644a73d9468aa39b21548a72bded Jul 23 21:31:17.821851 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServersNegativeTestJSON-1106538570-project Jul 23 21:31:17.821851 ncdv-master-1 devstack@n-api.service[131320]: Jul 23 21:31:17.821851 ncdv-master-1 devstack@n-api.service[131320]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-194565371", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": -1, "networks": [{"uuid": "654a77ca-1e84-434d-8536-1fc3adb327d0"}]}} Jul 23 21:31:17.821851 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:31:17.821851 ncdv-master-1 devstack@n-api.service[131320]: exception: Flavor -1 could not be found. Jul 23 21:31:17.821851 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-194565371', 'imageRef': 'b27b20aa-ef1b-4dd1-989e-321af6343d6a', 'flavorRef': -1, 'networks': [{'uuid': '654a77ca-1e84-434d-8536-1fc3adb327d0'}]}}} Jul 23 21:31:17.821851 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:31:17.821851 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:17.821851 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Jul 23 21:31:17.821851 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Jul 23 21:31:17.821851 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 23 21:31:17.821851 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 23 21:31:17.821851 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 23 21:31:17.821851 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 23 21:31:17.821851 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 23 21:31:17.821851 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 23 21:31:17.821851 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 23 21:31:17.821851 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:31:17.821851 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 23 21:31:17.821851 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 23 21:31:17.821851 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Jul 23 21:31:17.821851 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:31:17.821851 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:31:17.821851 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:31:17.821851 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:17.821851 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:31:17.821851 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:31:17.821851 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:31:17.821851 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:31:17.821851 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:31:17.821851 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:31:17.821851 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:31:17.821851 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:31:17.825613 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:31:17.825613 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:31:17.825613 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:31:17.825613 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:31:17.825613 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 23 21:31:17.825613 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 23 21:31:17.825613 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 23 21:31:17.825613 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Jul 23 21:31:17.825613 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:31:17.825613 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:31:17.825613 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:31:17.825613 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:17.825613 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:31:17.825613 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:31:17.825613 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:31:17.825613 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:31:17.825613 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Jul 23 21:31:17.825613 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:31:17.829970 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-199b2e8c-ad0c-42c3-ae43-2e822fb0945d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:31:17.831084 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c60fb1b8-32a0-45b8-beb0-f2f87be84cf6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:17.831946 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-199b2e8c-ad0c-42c3-ae43-2e822fb0945d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.053794 Jul 23 21:31:17.832626 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-c60fb1b8-32a0-45b8-beb0-f2f87be84cf6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.143964 Jul 23 21:31:17.833278 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2153/4220] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:31:17 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:31:17.833635 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2068/4221] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:31:17 2022] POST /compute/v2.1/servers => generated 73 bytes in 56 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 23 21:31:17.859450 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-1b816b76-8c47-4396-8d65-38e71e1b9f0a tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:17.869791 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-1b816b76-8c47-4396-8d65-38e71e1b9f0a tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:17.895772 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1b816b76-8c47-4396-8d65-38e71e1b9f0a tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:17.896565 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1b816b76-8c47-4396-8d65-38e71e1b9f0a tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:17.897774 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1b816b76-8c47-4396-8d65-38e71e1b9f0a tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:17.898644 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1b816b76-8c47-4396-8d65-38e71e1b9f0a tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:18.454925 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-32ec56c4-5091-4d4b-bc8e-0b0454a891bb tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:18.456349 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-32ec56c4-5091-4d4b-bc8e-0b0454a891bb tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] [instance: a053bb4d-aaa2-4f14-bb62-5623ef5448aa] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:18.471816 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-32ec56c4-5091-4d4b-bc8e-0b0454a891bb tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:18.472309 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-32ec56c4-5091-4d4b-bc8e-0b0454a891bb tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:18.473116 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-32ec56c4-5091-4d4b-bc8e-0b0454a891bb tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:18.473651 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-32ec56c4-5091-4d4b-bc8e-0b0454a891bb tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:18.679504 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-1b816b76-8c47-4396-8d65-38e71e1b9f0a tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:18.693519 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-1b816b76-8c47-4396-8d65-38e71e1b9f0a tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1505 microversion: 2.1 time: 0.855480 Jul 23 21:31:18.708285 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2154/4222] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:17 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1505 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:18.725903 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-180947b0-3758-480d-8484-0fe0e649bd5a tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:18.728113 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-180947b0-3758-480d-8484-0fe0e649bd5a tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] [instance: 5cb6a473-80fe-4569-bd9a-52511d3b81aa] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:18.740636 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-180947b0-3758-480d-8484-0fe0e649bd5a tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:18.741473 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-180947b0-3758-480d-8484-0fe0e649bd5a tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:18.742576 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-180947b0-3758-480d-8484-0fe0e649bd5a tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:18.743160 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-180947b0-3758-480d-8484-0fe0e649bd5a tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:18.780828 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=6 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:31:18.805781 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-32ec56c4-5091-4d4b-bc8e-0b0454a891bb tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc0782a98aca44f18bf86a9f6ad5eb60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d547fc8e53d43888e35c3e8ef5caada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:18.814151 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-32ec56c4-5091-4d4b-bc8e-0b0454a891bb tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] 10.222.0.17 "GET /compute/v2.1/servers/a053bb4d-aaa2-4f14-bb62-5623ef5448aa" status: 200 len: 1328 microversion: 2.1 time: 0.363294 Jul 23 21:31:18.818189 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2069/4223] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:18 2022] GET /compute/v2.1/servers/a053bb4d-aaa2-4f14-bb62-5623ef5448aa => generated 1328 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:31:18.827373 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-12f19cbd-c8cc-48be-971f-9dd271942077 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:18.827991 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-12f19cbd-c8cc-48be-971f-9dd271942077 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:18.834545 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-12f19cbd-c8cc-48be-971f-9dd271942077 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:18.835248 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-12f19cbd-c8cc-48be-971f-9dd271942077 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:18.836186 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-12f19cbd-c8cc-48be-971f-9dd271942077 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:18.836794 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-12f19cbd-c8cc-48be-971f-9dd271942077 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:18.885521 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=26 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:31:18.996943 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-180947b0-3758-480d-8484-0fe0e649bd5a tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:19.006247 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-180947b0-3758-480d-8484-0fe0e649bd5a tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:19.008147 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-180947b0-3758-480d-8484-0fe0e649bd5a tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:19.009736 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-180947b0-3758-480d-8484-0fe0e649bd5a tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] 10.222.0.17 "GET /compute/v2.1/servers/5cb6a473-80fe-4569-bd9a-52511d3b81aa" status: 200 len: 1364 microversion: 2.47 time: 0.300212 Jul 23 21:31:19.010602 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2155/4224] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:31:18 2022] GET /compute/v2.1/servers/5cb6a473-80fe-4569-bd9a-52511d3b81aa => generated 1364 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:31:19.025496 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-6e9b0090-50ab-4175-a8e2-d3f1bb81d561 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:19.026352 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-6e9b0090-50ab-4175-a8e2-d3f1bb81d561 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: fc75dd20-e6e4-4484-b715-2251c593c9e5] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:19.033938 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6e9b0090-50ab-4175-a8e2-d3f1bb81d561 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:19.035156 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6e9b0090-50ab-4175-a8e2-d3f1bb81d561 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:19.036138 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6e9b0090-50ab-4175-a8e2-d3f1bb81d561 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:19.036895 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6e9b0090-50ab-4175-a8e2-d3f1bb81d561 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:19.054689 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-6e9b0090-50ab-4175-a8e2-d3f1bb81d561 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] HTTP exception thrown: Instance fc75dd20-e6e4-4484-b715-2251c593c9e5 could not be found. Jul 23 21:31:19.056712 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-6e9b0090-50ab-4175-a8e2-d3f1bb81d561 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Request method failure captured: Jul 23 21:31:19.056712 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/servers/fc75dd20-e6e4-4484-b715-2251c593c9e5 HTTP/1.1 Jul 23 21:31:19.056712 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:31:19.056712 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:31:19.056712 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:31:19.056712 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:31:19.056712 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:31:19.056712 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:31:19.056712 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:31:19.056712 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:31:19.056712 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GgexSaJTA-FXaV5LcqTAteOVESwOg7zac7nwUa59CGOHDwwWd7w7HKC8R65F9X48OwLZ_a8UsJYui6X5BG5uL_WJC-ysEg9nxrojp43TnKgPHTkujcdOw9VWLxqM9CE8dPwhawUMo8jE8x_rLu-o0j9Xf_QveShH-OlX4BIDLcYoyo Jul 23 21:31:19.056712 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:31:19.056712 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:31:19.056712 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:31:19.056712 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:31:19.056712 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:31:19.056712 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:31:19.056712 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 1890022bd460485dae0ea94b152a6746 Jul 23 21:31:19.056712 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ServersTestJSON-1141465764 Jul 23 21:31:19.056712 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:31:19.056712 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:31:19.056712 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1890022bd460485dae0ea94b152a6746"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1890022bd460485dae0ea94b152a6746"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1890022bd460485dae0ea94b152a6746", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1890022bd460485dae0ea94b152a6746"}]}] Jul 23 21:31:19.056712 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ServersTestJSON-1141465764 Jul 23 21:31:19.056712 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 1890022bd460485dae0ea94b152a6746 Jul 23 21:31:19.056712 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ServersTestJSON-1141465764 Jul 23 21:31:19.056712 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ServersTestJSON-1141465764-project Jul 23 21:31:19.056712 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:31:19.056712 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:31:19.056712 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 5efda1c40f494592bf1e6af1add120f3 Jul 23 21:31:19.056712 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ServersTestJSON-1141465764-project Jul 23 21:31:19.056712 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:31:19.056712 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance fc75dd20-e6e4-4484-b715-2251c593c9e5 could not be found. Jul 23 21:31:19.056712 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': 'fc75dd20-e6e4-4484-b715-2251c593c9e5'} Jul 23 21:31:19.056712 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:31:19.056712 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:19.056712 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:31:19.056712 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:31:19.056712 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:31:19.056712 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:31:19.056712 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:31:19.056712 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:31:19.056712 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:31:19.056712 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:31:19.056712 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc75dd20-e6e4-4484-b715-2251c593c9e5 could not be found. Jul 23 21:31:19.056712 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:19.056712 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:31:19.056712 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:19.056712 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:19.056712 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:31:19.056712 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:31:19.056712 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:31:19.056712 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:31:19.056712 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:31:19.056712 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:31:19.056712 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:31:19.056712 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:31:19.056712 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:31:19.056712 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:31:19.056712 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:31:19.056712 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:31:19.056712 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc75dd20-e6e4-4484-b715-2251c593c9e5 could not be found. Jul 23 21:31:19.056712 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:19.056712 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:31:19.056712 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:19.056712 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:19.062425 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:31:19.062425 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:31:19.062425 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:31:19.062425 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:31:19.062425 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc75dd20-e6e4-4484-b715-2251c593c9e5 could not be found. Jul 23 21:31:19.062425 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:19.064273 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-6e9b0090-50ab-4175-a8e2-d3f1bb81d561 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Returning 404 to user: Instance fc75dd20-e6e4-4484-b715-2251c593c9e5 could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:31:19.065494 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-6e9b0090-50ab-4175-a8e2-d3f1bb81d561 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75dd20-e6e4-4484-b715-2251c593c9e5" status: 404 len: 111 microversion: 2.1 time: 0.053657 Jul 23 21:31:19.066989 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2156/4225] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:19 2022] GET /compute/v2.1/servers/fc75dd20-e6e4-4484-b715-2251c593c9e5 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:31:19.072420 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-367e8b7d-126c-4768-ad67-cdce41857c4d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:19.073297 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-367e8b7d-126c-4768-ad67-cdce41857c4d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:19.081219 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-367e8b7d-126c-4768-ad67-cdce41857c4d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:19.082135 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-367e8b7d-126c-4768-ad67-cdce41857c4d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:19.083276 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-367e8b7d-126c-4768-ad67-cdce41857c4d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:19.085218 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-367e8b7d-126c-4768-ad67-cdce41857c4d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:19.217573 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-367e8b7d-126c-4768-ad67-cdce41857c4d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:19.240742 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-367e8b7d-126c-4768-ad67-cdce41857c4d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:19.247256 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-367e8b7d-126c-4768-ad67-cdce41857c4d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:19.251669 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-367e8b7d-126c-4768-ad67-cdce41857c4d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.182942 Jul 23 21:31:19.252466 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2157/4226] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:31:19 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:31:19.257610 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-549ffb07-e2db-46a6-9dd5-2608be6b2909 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:19.258107 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-549ffb07-e2db-46a6-9dd5-2608be6b2909 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: f685637e-a804-4266-81a2-67d2e11a60b0] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:19.265449 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-549ffb07-e2db-46a6-9dd5-2608be6b2909 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:19.266116 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-549ffb07-e2db-46a6-9dd5-2608be6b2909 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:19.267230 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-549ffb07-e2db-46a6-9dd5-2608be6b2909 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:19.267809 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-549ffb07-e2db-46a6-9dd5-2608be6b2909 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:19.295686 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-549ffb07-e2db-46a6-9dd5-2608be6b2909 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: f685637e-a804-4266-81a2-67d2e11a60b0] Going to try to terminate instance {{(pid=131321) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:31:19.299724 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-12f19cbd-c8cc-48be-971f-9dd271942077 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:19.320140 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-12f19cbd-c8cc-48be-971f-9dd271942077 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1505 microversion: 2.1 time: 0.500705 Jul 23 21:31:19.324428 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2070/4227] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:18 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1505 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:19.416829 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0d5ffa7a-e210-45b3-ab81-d0b14ec731eb tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-332869456", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "654a77ca-1e84-434d-8536-1fc3adb327d0"}]}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:31:19.419853 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0d5ffa7a-e210-45b3-ab81-d0b14ec731eb tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Request method failure captured: Jul 23 21:31:19.419853 ncdv-master-1 devstack@n-api.service[131320]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 23 21:31:19.419853 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:31:19.419853 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:31:19.419853 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:31:19.419853 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 172 Jul 23 21:31:19.419853 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:31:19.419853 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:31:19.419853 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:31:19.419853 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:31:19.419853 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3Ghf1JjZ4k8tVzERRK8IkLpluLUwa9k5Rz-X0dEr2p4_7xl_eBekUiNk1RZEGsFdGEiApbLOfcuSifirvwiKV1QOTaKdXKwfMnwZgdfagxJjoe3dPYUa3b-d3rVTYewIN_YoX2mMGGBMWRa3po8WOCVIc6hXJLExzq_ndbcO7U8NQBI Jul 23 21:31:19.419853 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:31:19.419853 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:31:19.419853 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:31:19.419853 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:31:19.419853 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:31:19.419853 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:31:19.419853 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: d70f6c96e1ad484aa3207fc01a12d519 Jul 23 21:31:19.419853 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:31:19.419853 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:31:19.419853 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:31:19.419853 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d70f6c96e1ad484aa3207fc01a12d519"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d70f6c96e1ad484aa3207fc01a12d519"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d70f6c96e1ad484aa3207fc01a12d519", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d70f6c96e1ad484aa3207fc01a12d519"}]}] Jul 23 21:31:19.419853 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:31:19.419853 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: d70f6c96e1ad484aa3207fc01a12d519 Jul 23 21:31:19.419853 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:31:19.419853 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServersNegativeTestJSON-1106538570-project Jul 23 21:31:19.419853 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:31:19.419853 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:31:19.419853 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 6ca9644a73d9468aa39b21548a72bded Jul 23 21:31:19.419853 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServersNegativeTestJSON-1106538570-project Jul 23 21:31:19.419853 ncdv-master-1 devstack@n-api.service[131320]: Jul 23 21:31:19.419853 ncdv-master-1 devstack@n-api.service[131320]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-332869456", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "654a77ca-1e84-434d-8536-1fc3adb327d0"}]}} Jul 23 21:31:19.419853 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:31:19.419853 ncdv-master-1 devstack@n-api.service[131320]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Jul 23 21:31:19.419853 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-332869456', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '654a77ca-1e84-434d-8536-1fc3adb327d0'}]}}} Jul 23 21:31:19.419853 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:31:19.419853 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:19.419853 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 23 21:31:19.419853 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 23 21:31:19.419853 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 23 21:31:19.419853 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise error Jul 23 21:31:19.419853 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Jul 23 21:31:19.419853 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:31:19.419853 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Jul 23 21:31:19.419853 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Jul 23 21:31:19.419853 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Jul 23 21:31:19.419853 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:31:19.419853 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 23 21:31:19.419853 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi -1 Jul 23 21:31:19.419853 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:31:19.419853 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:31:19.419853 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:31:19.419853 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:19.419853 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:31:19.419853 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:31:19.419853 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:31:19.419853 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:31:19.419853 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:31:19.419853 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:31:19.419853 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:31:19.419853 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:31:19.419853 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 23 21:31:19.419853 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 23 21:31:19.419853 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 23 21:31:19.419853 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 23 21:31:19.425137 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 23 21:31:19.425137 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 23 21:31:19.425137 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Jul 23 21:31:19.425137 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:31:19.425137 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:31:19.425137 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:31:19.425137 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:19.425137 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:31:19.425137 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:31:19.425137 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 23 21:31:19.425137 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 23 21:31:19.425137 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Jul 23 21:31:19.425137 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:31:19.425137 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0d5ffa7a-e210-45b3-ab81-d0b14ec731eb tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:31:19.425137 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-0d5ffa7a-e210-45b3-ab81-d0b14ec731eb tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.010352 Jul 23 21:31:19.431671 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2071/4228] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:31:19 2022] POST /compute/v2.1/servers => generated 145 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 23 21:31:19.442702 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-28e7f4c7-98b5-4437-82db-e4a5b300b14c tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:19.445431 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-28e7f4c7-98b5-4437-82db-e4a5b300b14c tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:19.462834 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-28e7f4c7-98b5-4437-82db-e4a5b300b14c tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:19.464574 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-549ffb07-e2db-46a6-9dd5-2608be6b2909 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "DELETE /compute/v2.1/servers/f685637e-a804-4266-81a2-67d2e11a60b0" status: 204 len: 0 microversion: 2.1 time: 0.208732 Jul 23 21:31:19.465295 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-28e7f4c7-98b5-4437-82db-e4a5b300b14c tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:19.466559 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2158/4229] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:31:19 2022] DELETE /compute/v2.1/servers/f685637e-a804-4266-81a2-67d2e11a60b0 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:31:19.468206 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-28e7f4c7-98b5-4437-82db-e4a5b300b14c tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:19.468641 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-28e7f4c7-98b5-4437-82db-e4a5b300b14c tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:19.489427 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-501dc3f3-5f21-4ecc-94b3-236d1bb960a0 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:19.490601 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-501dc3f3-5f21-4ecc-94b3-236d1bb960a0 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: f685637e-a804-4266-81a2-67d2e11a60b0] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:19.503229 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-501dc3f3-5f21-4ecc-94b3-236d1bb960a0 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:19.504162 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-501dc3f3-5f21-4ecc-94b3-236d1bb960a0 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:19.505660 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-501dc3f3-5f21-4ecc-94b3-236d1bb960a0 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:19.507056 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-501dc3f3-5f21-4ecc-94b3-236d1bb960a0 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:19.595301 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell0:SELECT=2 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:31:19.748692 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-28e7f4c7-98b5-4437-82db-e4a5b300b14c tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:19.760584 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-28e7f4c7-98b5-4437-82db-e4a5b300b14c tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1505 microversion: 2.1 time: 0.327798 Jul 23 21:31:19.762103 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2072/4230] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:19 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1505 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:19.777516 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-501dc3f3-5f21-4ecc-94b3-236d1bb960a0 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:19.780098 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-17467030-137d-40bc-9a70-a2e27e0bfd52 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:19.781681 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-17467030-137d-40bc-9a70-a2e27e0bfd52 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:19.789407 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-17467030-137d-40bc-9a70-a2e27e0bfd52 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:19.790613 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-17467030-137d-40bc-9a70-a2e27e0bfd52 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:19.791410 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-17467030-137d-40bc-9a70-a2e27e0bfd52 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:19.792074 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-17467030-137d-40bc-9a70-a2e27e0bfd52 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:19.804265 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-501dc3f3-5f21-4ecc-94b3-236d1bb960a0 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/f685637e-a804-4266-81a2-67d2e11a60b0" status: 200 len: 1497 microversion: 2.1 time: 0.330966 Jul 23 21:31:19.806896 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2159/4231] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:19 2022] GET /compute/v2.1/servers/f685637e-a804-4266-81a2-67d2e11a60b0 => generated 1497 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:19.835837 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-bf7d86bf-9925-4de1-8aa1-3cb50c46febe tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:19.837981 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-bf7d86bf-9925-4de1-8aa1-3cb50c46febe tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] [instance: a053bb4d-aaa2-4f14-bb62-5623ef5448aa] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:19.845410 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bf7d86bf-9925-4de1-8aa1-3cb50c46febe tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:19.846109 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bf7d86bf-9925-4de1-8aa1-3cb50c46febe tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:19.847359 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bf7d86bf-9925-4de1-8aa1-3cb50c46febe tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:19.847938 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bf7d86bf-9925-4de1-8aa1-3cb50c46febe tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:20.006453 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-17467030-137d-40bc-9a70-a2e27e0bfd52 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:20.015606 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-17467030-137d-40bc-9a70-a2e27e0bfd52 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1505 microversion: 2.1 time: 0.239592 Jul 23 21:31:20.017919 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2073/4232] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:19 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1505 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:20.031313 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-95a19646-4f2c-4c3d-af67-3322b99a78f3 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:20.033424 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-95a19646-4f2c-4c3d-af67-3322b99a78f3 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] [instance: 5cb6a473-80fe-4569-bd9a-52511d3b81aa] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:20.045226 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-95a19646-4f2c-4c3d-af67-3322b99a78f3 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:20.046624 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-95a19646-4f2c-4c3d-af67-3322b99a78f3 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:20.047439 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-95a19646-4f2c-4c3d-af67-3322b99a78f3 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:20.047888 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-95a19646-4f2c-4c3d-af67-3322b99a78f3 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:20.080711 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-bf7d86bf-9925-4de1-8aa1-3cb50c46febe tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc0782a98aca44f18bf86a9f6ad5eb60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d547fc8e53d43888e35c3e8ef5caada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:20.090273 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-bf7d86bf-9925-4de1-8aa1-3cb50c46febe tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] 10.222.0.17 "GET /compute/v2.1/servers/a053bb4d-aaa2-4f14-bb62-5623ef5448aa" status: 200 len: 1328 microversion: 2.1 time: 0.260694 Jul 23 21:31:20.093937 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2160/4233] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:19 2022] GET /compute/v2.1/servers/a053bb4d-aaa2-4f14-bb62-5623ef5448aa => generated 1328 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:20.100514 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-9de249d6-0862-4824-9ce2-7aaa958584bf tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1835145465", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:31:20.107533 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-9de249d6-0862-4824-9ce2-7aaa958584bf tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 23 21:31:20.109494 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-9de249d6-0862-4824-9ce2-7aaa958584bf tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Request method failure captured: Jul 23 21:31:20.109494 ncdv-master-1 devstack@n-api.service[131321]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 23 21:31:20.109494 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:31:20.109494 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:31:20.109494 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:31:20.109494 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 216 Jul 23 21:31:20.109494 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:31:20.109494 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:31:20.109494 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:31:20.109494 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:31:20.109494 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3Ghf1JjZ4k8tVzERRK8IkLpluLUwa9k5Rz-X0dEr2p4_7xl_eBekUiNk1RZEGsFdGEiApbLOfcuSifirvwiKV1QOTaKdXKwfMnwZgdfagxJjoe3dPYUa3b-d3rVTYewIN_YoX2mMGGBMWRa3po8WOCVIc6hXJLExzq_ndbcO7U8NQBI Jul 23 21:31:20.109494 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:31:20.109494 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:31:20.109494 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:31:20.109494 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:31:20.109494 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:31:20.109494 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:31:20.109494 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: d70f6c96e1ad484aa3207fc01a12d519 Jul 23 21:31:20.109494 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:31:20.109494 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:31:20.109494 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:31:20.109494 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d70f6c96e1ad484aa3207fc01a12d519"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d70f6c96e1ad484aa3207fc01a12d519"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d70f6c96e1ad484aa3207fc01a12d519", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d70f6c96e1ad484aa3207fc01a12d519"}]}] Jul 23 21:31:20.109494 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:31:20.109494 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: d70f6c96e1ad484aa3207fc01a12d519 Jul 23 21:31:20.109494 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:31:20.109494 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ServersNegativeTestJSON-1106538570-project Jul 23 21:31:20.109494 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:31:20.109494 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:31:20.109494 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 6ca9644a73d9468aa39b21548a72bded Jul 23 21:31:20.109494 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ServersNegativeTestJSON-1106538570-project Jul 23 21:31:20.109494 ncdv-master-1 devstack@n-api.service[131321]: Jul 23 21:31:20.109494 ncdv-master-1 devstack@n-api.service[131321]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1835145465", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Jul 23 21:31:20.109494 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:31:20.109494 ncdv-master-1 devstack@n-api.service[131321]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 23 21:31:20.109494 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1835145465', 'imageRef': 'b27b20aa-ef1b-4dd1-989e-321af6343d6a', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Jul 23 21:31:20.109494 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:31:20.109494 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:20.109494 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:31:20.109494 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:31:20.109494 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:31:20.109494 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:31:20.109494 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:31:20.109494 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:31:20.109494 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:31:20.109494 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:31:20.109494 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:31:20.109494 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:31:20.109494 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:31:20.109494 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:31:20.109494 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 23 21:31:20.109494 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Jul 23 21:31:20.109494 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Jul 23 21:31:20.109494 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Jul 23 21:31:20.109494 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Jul 23 21:31:20.109494 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Jul 23 21:31:20.109494 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self._validate_network_id( Jul 23 21:31:20.109494 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Jul 23 21:31:20.109494 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 23 21:31:20.109494 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 23 21:31:20.109494 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:20.109494 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:31:20.109494 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:20.113418 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:20.113418 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:31:20.113418 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:31:20.113418 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:31:20.113418 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:31:20.113418 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 23 21:31:20.113418 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:20.114576 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-9de249d6-0862-4824-9ce2-7aaa958584bf tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:31:20.115777 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-9de249d6-0862-4824-9ce2-7aaa958584bf tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.020483 Jul 23 21:31:20.116866 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2161/4234] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:31:20 2022] POST /compute/v2.1/servers => generated 123 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 23 21:31:20.127174 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f56b9b9e-bf28-4817-b27e-d08f1561e37d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:20.127978 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-f56b9b9e-bf28-4817-b27e-d08f1561e37d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:20.138653 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f56b9b9e-bf28-4817-b27e-d08f1561e37d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:20.139553 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f56b9b9e-bf28-4817-b27e-d08f1561e37d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:20.140515 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f56b9b9e-bf28-4817-b27e-d08f1561e37d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:20.141189 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f56b9b9e-bf28-4817-b27e-d08f1561e37d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:20.180395 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-95a19646-4f2c-4c3d-af67-3322b99a78f3 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:20.193942 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-95a19646-4f2c-4c3d-af67-3322b99a78f3 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:20.196064 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-95a19646-4f2c-4c3d-af67-3322b99a78f3 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:20.197468 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-95a19646-4f2c-4c3d-af67-3322b99a78f3 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] 10.222.0.17 "GET /compute/v2.1/servers/5cb6a473-80fe-4569-bd9a-52511d3b81aa" status: 200 len: 1364 microversion: 2.47 time: 0.172959 Jul 23 21:31:20.198618 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2074/4235] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:31:20 2022] GET /compute/v2.1/servers/5cb6a473-80fe-4569-bd9a-52511d3b81aa => generated 1364 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:31:20.204929 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e9723133-8f2f-4b79-bd51-10351f920f13 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-820000053-access_point-453397090", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "networks": [{"uuid": "c6540b20-5658-416d-989b-bbbd93e1c7a9"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1067306574", "security_groups": [{"name": "tempest-secgroup_access--1860078197"}, {"name": "tempest-secgroup_general--53132833"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:31:20.395664 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-e9723133-8f2f-4b79-bd51-10351f920f13 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] validate_networks() for [('c6540b20-5658-416d-989b-bbbd93e1c7a9', None, None, None, None, None)] {{(pid=131320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:31:20.473041 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-f56b9b9e-bf28-4817-b27e-d08f1561e37d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:20.481219 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-f56b9b9e-bf28-4817-b27e-d08f1561e37d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1505 microversion: 2.1 time: 0.359582 Jul 23 21:31:20.486071 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2162/4236] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:20 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1505 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:20.494921 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-717744f6-3025-4374-9f84-74a70d4f9bfd tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:20.497717 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-717744f6-3025-4374-9f84-74a70d4f9bfd tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:20.510479 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-717744f6-3025-4374-9f84-74a70d4f9bfd tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:20.512409 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-717744f6-3025-4374-9f84-74a70d4f9bfd tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:20.513417 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-717744f6-3025-4374-9f84-74a70d4f9bfd tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:20.514813 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-717744f6-3025-4374-9f84-74a70d4f9bfd tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:20.625102 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-717744f6-3025-4374-9f84-74a70d4f9bfd tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:20.647533 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-717744f6-3025-4374-9f84-74a70d4f9bfd tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:20.650933 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-717744f6-3025-4374-9f84-74a70d4f9bfd tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:20.653979 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-717744f6-3025-4374-9f84-74a70d4f9bfd tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.168057 Jul 23 21:31:20.654606 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2163/4237] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:31:20 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:31:20.665738 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-cc5573dd-079b-40b8-b597-056d73314995 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:20.667537 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-cc5573dd-079b-40b8-b597-056d73314995 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:20.681117 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cc5573dd-079b-40b8-b597-056d73314995 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:20.692773 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cc5573dd-079b-40b8-b597-056d73314995 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:20.693647 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cc5573dd-079b-40b8-b597-056d73314995 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:20.694180 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cc5573dd-079b-40b8-b597-056d73314995 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:20.944281 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-cc5573dd-079b-40b8-b597-056d73314995 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:20.957739 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-cc5573dd-079b-40b8-b597-056d73314995 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1505 microversion: 2.1 time: 0.300138 Jul 23 21:31:20.959059 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2164/4238] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:20 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1505 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:20.964781 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e867ddb0-6ca4-459b-9200-1634b581f768 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:20.965731 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-e867ddb0-6ca4-459b-9200-1634b581f768 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: f685637e-a804-4266-81a2-67d2e11a60b0] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:20.973760 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e867ddb0-6ca4-459b-9200-1634b581f768 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:20.975127 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e867ddb0-6ca4-459b-9200-1634b581f768 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:20.977264 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e867ddb0-6ca4-459b-9200-1634b581f768 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:20.978840 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e867ddb0-6ca4-459b-9200-1634b581f768 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:21.033364 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-e9723133-8f2f-4b79-bd51-10351f920f13 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:31:21.034485 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-e9723133-8f2f-4b79-bd51-10351f920f13 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:31:21.035318 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-e9723133-8f2f-4b79-bd51-10351f920f13 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:31:21.036168 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-e9723133-8f2f-4b79-bd51-10351f920f13 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:31:21.036899 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-e9723133-8f2f-4b79-bd51-10351f920f13 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:31:21.065224 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e9723133-8f2f-4b79-bd51-10351f920f13 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:21.066681 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e9723133-8f2f-4b79-bd51-10351f920f13 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:21.067829 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e9723133-8f2f-4b79-bd51-10351f920f13 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:21.068467 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e9723133-8f2f-4b79-bd51-10351f920f13 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:21.095868 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-e9723133-8f2f-4b79-bd51-10351f920f13 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Getting quotas for project 842a1aca542f416eab5d43b881325917. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:31:21.103219 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-e9723133-8f2f-4b79-bd51-10351f920f13 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Getting quotas for user 0bd49331138a4dbc912bc7bf6f6b0215 and project 842a1aca542f416eab5d43b881325917. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:31:21.115493 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=94,nova_api:UPDATE=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:31:21.119968 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e9723133-8f2f-4b79-bd51-10351f920f13 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Going to run 1 instances... {{(pid=131320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:31:21.122931 ncdv-master-1 devstack@n-api.service[131320]: WARNING nova.utils [None req-e9723133-8f2f-4b79-bd51-10351f920f13 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-820000053-access_point-453397090 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-820000053-acc Jul 23 21:31:21.124160 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e9723133-8f2f-4b79-bd51-10351f920f13 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] [instance: 1f5b9a5a-109e-48b5-adc1-113384944dce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:31:21.223924 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e9723133-8f2f-4b79-bd51-10351f920f13 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 456 microversion: 2.1 time: 1.021240 Jul 23 21:31:21.226675 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2075/4239] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:31:20 2022] POST /compute/v2.1/servers => generated 456 bytes in 1027 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 23 21:31:21.241083 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f90fd757-8e96-4c60-854e-b14a5ec3bda6 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-537646222", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "key_name": "tempest-key-1994117002", "networks": [{"uuid": "654a77ca-1e84-434d-8536-1fc3adb327d0"}]}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:31:21.283049 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-e867ddb0-6ca4-459b-9200-1634b581f768 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:21.294095 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-e867ddb0-6ca4-459b-9200-1634b581f768 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/f685637e-a804-4266-81a2-67d2e11a60b0" status: 200 len: 1497 microversion: 2.1 time: 0.333712 Jul 23 21:31:21.304803 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2165/4240] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:20 2022] GET /compute/v2.1/servers/f685637e-a804-4266-81a2-67d2e11a60b0 => generated 1497 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:21.310914 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-7ebf5d4b-4963-418a-a65e-daa8c55c8d4f req-0e99c009-6978-43bf-ade3-23d68880f8fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a053bb4d-aaa2-4f14-bb62-5623ef5448aa", "name": "network-vif-plugged", "status": "completed", "tag": "dc3c2b67-c0b1-4e25-8f1d-3348a9b8ff05"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:31:21.328600 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-f90fd757-8e96-4c60-854e-b14a5ec3bda6 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] validate_networks() for [('654a77ca-1e84-434d-8536-1fc3adb327d0', None, None, None, None, None)] {{(pid=131320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:31:21.339982 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-7ebf5d4b-4963-418a-a65e-daa8c55c8d4f req-0e99c009-6978-43bf-ade3-23d68880f8fc service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:21.340480 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-7ebf5d4b-4963-418a-a65e-daa8c55c8d4f req-0e99c009-6978-43bf-ade3-23d68880f8fc service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:21.354409 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-7ebf5d4b-4963-418a-a65e-daa8c55c8d4f req-0e99c009-6978-43bf-ade3-23d68880f8fc service nova] Creating event network-vif-plugged:dc3c2b67-c0b1-4e25-8f1d-3348a9b8ff05 for instance a053bb4d-aaa2-4f14-bb62-5623ef5448aa on nch2-master-1 Jul 23 21:31:21.361308 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-7ebf5d4b-4963-418a-a65e-daa8c55c8d4f req-0e99c009-6978-43bf-ade3-23d68880f8fc service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054304 Jul 23 21:31:21.362986 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2166/4241] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:31:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:31:21.374329 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-991ec00d-e02e-40a9-afea-7bb5725e7516 tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:21.375287 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-991ec00d-e02e-40a9-afea-7bb5725e7516 tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] [instance: a053bb4d-aaa2-4f14-bb62-5623ef5448aa] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:21.385629 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-991ec00d-e02e-40a9-afea-7bb5725e7516 tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:21.386460 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-991ec00d-e02e-40a9-afea-7bb5725e7516 tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:21.387835 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-991ec00d-e02e-40a9-afea-7bb5725e7516 tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:21.388426 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-991ec00d-e02e-40a9-afea-7bb5725e7516 tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:21.748217 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-991ec00d-e02e-40a9-afea-7bb5725e7516 tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc0782a98aca44f18bf86a9f6ad5eb60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d547fc8e53d43888e35c3e8ef5caada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:21.761022 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-991ec00d-e02e-40a9-afea-7bb5725e7516 tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] 10.222.0.17 "GET /compute/v2.1/servers/a053bb4d-aaa2-4f14-bb62-5623ef5448aa" status: 200 len: 1328 microversion: 2.1 time: 0.395461 Jul 23 21:31:21.764269 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2167/4242] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:21 2022] GET /compute/v2.1/servers/a053bb4d-aaa2-4f14-bb62-5623ef5448aa => generated 1328 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:21.775183 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-18795306-2d44-4dbe-a3eb-4d3cfbfacc7d tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:21.779958 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-18795306-2d44-4dbe-a3eb-4d3cfbfacc7d tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] [instance: 5cb6a473-80fe-4569-bd9a-52511d3b81aa] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:21.794589 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-18795306-2d44-4dbe-a3eb-4d3cfbfacc7d tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:21.794972 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-18795306-2d44-4dbe-a3eb-4d3cfbfacc7d tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:21.795892 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-18795306-2d44-4dbe-a3eb-4d3cfbfacc7d tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:21.796605 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-18795306-2d44-4dbe-a3eb-4d3cfbfacc7d tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:22.050714 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-18795306-2d44-4dbe-a3eb-4d3cfbfacc7d tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:22.062147 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:31:22.073307 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-18795306-2d44-4dbe-a3eb-4d3cfbfacc7d tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:22.080969 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-18795306-2d44-4dbe-a3eb-4d3cfbfacc7d tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:22.082989 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-18795306-2d44-4dbe-a3eb-4d3cfbfacc7d tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] 10.222.0.17 "GET /compute/v2.1/servers/5cb6a473-80fe-4569-bd9a-52511d3b81aa" status: 200 len: 1364 microversion: 2.47 time: 0.317698 Jul 23 21:31:22.087175 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2168/4243] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:31:21 2022] GET /compute/v2.1/servers/5cb6a473-80fe-4569-bd9a-52511d3b81aa => generated 1364 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:31:22.097504 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-4e74d1d5-11cf-4f71-bcaf-9f631a5ef07d tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:22.098581 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-4e74d1d5-11cf-4f71-bcaf-9f631a5ef07d tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] [instance: 1f5b9a5a-109e-48b5-adc1-113384944dce] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:22.289348 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-f90fd757-8e96-4c60-854e-b14a5ec3bda6 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] HTTP exception thrown: Invalid key_name provided. Jul 23 21:31:22.291320 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f90fd757-8e96-4c60-854e-b14a5ec3bda6 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Request method failure captured: Jul 23 21:31:22.291320 ncdv-master-1 devstack@n-api.service[131320]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 23 21:31:22.291320 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:31:22.291320 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:31:22.291320 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:31:22.291320 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 246 Jul 23 21:31:22.291320 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:31:22.291320 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:31:22.291320 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:31:22.291320 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:31:22.291320 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3Ghf1JjZ4k8tVzERRK8IkLpluLUwa9k5Rz-X0dEr2p4_7xl_eBekUiNk1RZEGsFdGEiApbLOfcuSifirvwiKV1QOTaKdXKwfMnwZgdfagxJjoe3dPYUa3b-d3rVTYewIN_YoX2mMGGBMWRa3po8WOCVIc6hXJLExzq_ndbcO7U8NQBI Jul 23 21:31:22.291320 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:31:22.291320 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:31:22.291320 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:31:22.291320 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:31:22.291320 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:31:22.291320 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:31:22.291320 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: d70f6c96e1ad484aa3207fc01a12d519 Jul 23 21:31:22.291320 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:31:22.291320 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:31:22.291320 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:31:22.291320 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d70f6c96e1ad484aa3207fc01a12d519"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d70f6c96e1ad484aa3207fc01a12d519"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d70f6c96e1ad484aa3207fc01a12d519", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d70f6c96e1ad484aa3207fc01a12d519"}]}] Jul 23 21:31:22.291320 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:31:22.291320 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: d70f6c96e1ad484aa3207fc01a12d519 Jul 23 21:31:22.291320 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:31:22.291320 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServersNegativeTestJSON-1106538570-project Jul 23 21:31:22.291320 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:31:22.291320 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:31:22.291320 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 6ca9644a73d9468aa39b21548a72bded Jul 23 21:31:22.291320 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServersNegativeTestJSON-1106538570-project Jul 23 21:31:22.291320 ncdv-master-1 devstack@n-api.service[131320]: Jul 23 21:31:22.291320 ncdv-master-1 devstack@n-api.service[131320]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-537646222", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "key_name": "tempest-key-1994117002", "networks": [{"uuid": "654a77ca-1e84-434d-8536-1fc3adb327d0"}]}} Jul 23 21:31:22.291320 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:31:22.291320 ncdv-master-1 devstack@n-api.service[131320]: exception: Invalid key_name provided. Jul 23 21:31:22.291320 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-537646222', 'imageRef': 'b27b20aa-ef1b-4dd1-989e-321af6343d6a', 'flavorRef': '452', 'key_name': 'tempest-key-1994117002', 'networks': [{'uuid': '654a77ca-1e84-434d-8536-1fc3adb327d0'}]}}} Jul 23 21:31:22.291320 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:31:22.291320 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:22.291320 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 23 21:31:22.291320 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 23 21:31:22.291320 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 23 21:31:22.291320 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 23 21:31:22.291320 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1632, in _create_instance Jul 23 21:31:22.291320 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Jul 23 21:31:22.291320 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1075, in _validate_and_build_base_options Jul 23 21:31:22.291320 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Jul 23 21:31:22.291320 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 23 21:31:22.291320 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 23 21:31:22.291320 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Jul 23 21:31:22.291320 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Jul 23 21:31:22.291320 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Jul 23 21:31:22.291320 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Jul 23 21:31:22.291320 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 23 21:31:22.291320 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 23 21:31:22.291320 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Jul 23 21:31:22.291320 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Jul 23 21:31:22.291320 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-1994117002 not found for user 6ca9644a73d9468aa39b21548a72bded Jul 23 21:31:22.291320 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:31:22.291320 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:31:22.291320 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:31:22.291320 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:22.291320 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:31:22.294788 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:31:22.294788 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:31:22.294788 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:31:22.294788 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:31:22.294788 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:31:22.294788 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:31:22.294788 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:31:22.294788 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:31:22.294788 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:31:22.294788 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:31:22.294788 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:31:22.294788 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 23 21:31:22.294788 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Jul 23 21:31:22.294788 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 23 21:31:22.294788 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Jul 23 21:31:22.294788 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:31:22.294788 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:31:22.294788 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:31:22.294788 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:22.294788 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:31:22.294788 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:31:22.294788 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:31:22.294788 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:31:22.294788 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Jul 23 21:31:22.294788 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:31:22.294788 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f90fd757-8e96-4c60-854e-b14a5ec3bda6 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Returning 400 to user: Invalid key_name provided. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:31:22.294788 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f90fd757-8e96-4c60-854e-b14a5ec3bda6 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 1.064947 Jul 23 21:31:22.298874 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2076/4244] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:31:21 2022] POST /compute/v2.1/servers => generated 70 bytes in 1071 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 23 21:31:22.304223 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3e250b22-3ac7-417a-92a7-858c2a0801a6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:22.304846 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-3e250b22-3ac7-417a-92a7-858c2a0801a6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:22.313247 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3e250b22-3ac7-417a-92a7-858c2a0801a6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:22.314011 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3e250b22-3ac7-417a-92a7-858c2a0801a6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:22.314955 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3e250b22-3ac7-417a-92a7-858c2a0801a6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:22.315559 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3e250b22-3ac7-417a-92a7-858c2a0801a6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:22.334042 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-4e74d1d5-11cf-4f71-bcaf-9f631a5ef07d tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd49331138a4dbc912bc7bf6f6b0215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842a1aca542f416eab5d43b881325917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:22.345563 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-4e74d1d5-11cf-4f71-bcaf-9f631a5ef07d tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] 10.222.0.17 "GET /compute/v2.1/servers/1f5b9a5a-109e-48b5-adc1-113384944dce" status: 200 len: 1293 microversion: 2.1 time: 0.256966 Jul 23 21:31:22.347052 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2169/4245] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:22 2022] GET /compute/v2.1/servers/1f5b9a5a-109e-48b5-adc1-113384944dce => generated 1293 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:22.355544 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-d7984dd3-44c3-454b-8aff-2c59fb639627 req-50dc01f5-a7a9-4119-8c1f-e4e77d489d36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f685637e-a804-4266-81a2-67d2e11a60b0", "name": "network-vif-deleted", "tag": "bcbda1a6-1f30-4122-9a97-0aac7286f268"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:31:22.366285 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-d7984dd3-44c3-454b-8aff-2c59fb639627 req-50dc01f5-a7a9-4119-8c1f-e4e77d489d36 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:22.367093 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-d7984dd3-44c3-454b-8aff-2c59fb639627 req-50dc01f5-a7a9-4119-8c1f-e4e77d489d36 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:22.380731 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-d7984dd3-44c3-454b-8aff-2c59fb639627 req-50dc01f5-a7a9-4119-8c1f-e4e77d489d36 service nova] Creating event network-vif-deleted:bcbda1a6-1f30-4122-9a97-0aac7286f268 for instance f685637e-a804-4266-81a2-67d2e11a60b0 on nch2-master-1 Jul 23 21:31:22.392025 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-d7984dd3-44c3-454b-8aff-2c59fb639627 req-50dc01f5-a7a9-4119-8c1f-e4e77d489d36 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041008 Jul 23 21:31:22.392025 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2170/4246] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:31:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:31:22.399880 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-3e250b22-3ac7-417a-92a7-858c2a0801a6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:22.400073 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-2f926782-e4d5-4f48-a3d4-47db16be69fa tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:22.400971 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-2f926782-e4d5-4f48-a3d4-47db16be69fa tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:22.409721 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2f926782-e4d5-4f48-a3d4-47db16be69fa tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:22.410514 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2f926782-e4d5-4f48-a3d4-47db16be69fa tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:22.411375 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2f926782-e4d5-4f48-a3d4-47db16be69fa tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:22.411891 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2f926782-e4d5-4f48-a3d4-47db16be69fa tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:22.415543 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-3e250b22-3ac7-417a-92a7-858c2a0801a6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:22.417408 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-3e250b22-3ac7-417a-92a7-858c2a0801a6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:22.419607 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-3e250b22-3ac7-417a-92a7-858c2a0801a6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.119031 Jul 23 21:31:22.420349 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2077/4247] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:31:22 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:31:22.424985 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-45f39d37-e549-4cda-b8c0-aaa0cfc5719b tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:22.425766 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-45f39d37-e549-4cda-b8c0-aaa0cfc5719b tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: f685637e-a804-4266-81a2-67d2e11a60b0] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:22.437233 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-45f39d37-e549-4cda-b8c0-aaa0cfc5719b tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:22.438707 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-45f39d37-e549-4cda-b8c0-aaa0cfc5719b tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:22.439540 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-45f39d37-e549-4cda-b8c0-aaa0cfc5719b tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:22.439983 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-45f39d37-e549-4cda-b8c0-aaa0cfc5719b tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:22.552687 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-45f39d37-e549-4cda-b8c0-aaa0cfc5719b tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:22.584312 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-45f39d37-e549-4cda-b8c0-aaa0cfc5719b tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/f685637e-a804-4266-81a2-67d2e11a60b0" status: 200 len: 1455 microversion: 2.1 time: 0.162604 Jul 23 21:31:22.585134 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2078/4248] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:22 2022] GET /compute/v2.1/servers/f685637e-a804-4266-81a2-67d2e11a60b0 => generated 1455 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:22.706291 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-2f926782-e4d5-4f48-a3d4-47db16be69fa tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:22.716993 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-2f926782-e4d5-4f48-a3d4-47db16be69fa tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1505 microversion: 2.1 time: 0.322712 Jul 23 21:31:22.718011 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2171/4249] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:22 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1505 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:22.738888 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-878a1572-f102-496e-a29c-bd801d51ca6c tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:22.739495 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-878a1572-f102-496e-a29c-bd801d51ca6c tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:22.749647 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-878a1572-f102-496e-a29c-bd801d51ca6c tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:22.750173 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-878a1572-f102-496e-a29c-bd801d51ca6c tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:22.751387 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-878a1572-f102-496e-a29c-bd801d51ca6c tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:22.751976 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-878a1572-f102-496e-a29c-bd801d51ca6c tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:22.796281 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-df087b35-1bf7-4465-a5cf-4c19a2ca326a tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:22.796916 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-df087b35-1bf7-4465-a5cf-4c19a2ca326a tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] [instance: a053bb4d-aaa2-4f14-bb62-5623ef5448aa] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:22.826815 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-df087b35-1bf7-4465-a5cf-4c19a2ca326a tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:22.830435 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-df087b35-1bf7-4465-a5cf-4c19a2ca326a tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:22.831500 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-df087b35-1bf7-4465-a5cf-4c19a2ca326a tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:22.832132 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-df087b35-1bf7-4465-a5cf-4c19a2ca326a tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:23.105356 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-878a1572-f102-496e-a29c-bd801d51ca6c tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:23.118477 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-878a1572-f102-496e-a29c-bd801d51ca6c tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1505 microversion: 2.1 time: 0.385111 Jul 23 21:31:23.119526 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2079/4250] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:22 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1505 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:23.131661 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e5e5e859-538b-4569-a570-caac6b544a5d tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:23.133494 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e5e5e859-538b-4569-a570-caac6b544a5d tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] [instance: 5cb6a473-80fe-4569-bd9a-52511d3b81aa] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:23.166535 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e5e5e859-538b-4569-a570-caac6b544a5d tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:23.167017 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e5e5e859-538b-4569-a570-caac6b544a5d tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:23.168000 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e5e5e859-538b-4569-a570-caac6b544a5d tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:23.168508 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e5e5e859-538b-4569-a570-caac6b544a5d tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:23.221722 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-df087b35-1bf7-4465-a5cf-4c19a2ca326a tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc0782a98aca44f18bf86a9f6ad5eb60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d547fc8e53d43888e35c3e8ef5caada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:23.240735 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-df087b35-1bf7-4465-a5cf-4c19a2ca326a tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] 10.222.0.17 "GET /compute/v2.1/servers/a053bb4d-aaa2-4f14-bb62-5623ef5448aa" status: 200 len: 1328 microversion: 2.1 time: 0.453480 Jul 23 21:31:23.241347 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2172/4251] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:22 2022] GET /compute/v2.1/servers/a053bb4d-aaa2-4f14-bb62-5623ef5448aa => generated 1328 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:31:23.263559 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a86704b5-3c43-48f3-a7f5-5980d5dd2bff tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1106667840", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "654a77ca-1e84-434d-8536-1fc3adb327d0"}]}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:31:23.281325 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e5e5e859-538b-4569-a570-caac6b544a5d tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:23.291078 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e5e5e859-538b-4569-a570-caac6b544a5d tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:23.293351 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e5e5e859-538b-4569-a570-caac6b544a5d tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:23.294946 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e5e5e859-538b-4569-a570-caac6b544a5d tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] 10.222.0.17 "GET /compute/v2.1/servers/5cb6a473-80fe-4569-bd9a-52511d3b81aa" status: 200 len: 1364 microversion: 2.47 time: 0.174235 Jul 23 21:31:23.309520 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2080/4252] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:31:23 2022] GET /compute/v2.1/servers/5cb6a473-80fe-4569-bd9a-52511d3b81aa => generated 1364 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:31:23.364668 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-21db1fc0-fe7c-4115-8f25-b2f62ce1808b tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:23.365403 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-21db1fc0-fe7c-4115-8f25-b2f62ce1808b tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] [instance: 1f5b9a5a-109e-48b5-adc1-113384944dce] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:23.373654 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-21db1fc0-fe7c-4115-8f25-b2f62ce1808b tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:23.374103 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-21db1fc0-fe7c-4115-8f25-b2f62ce1808b tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:23.375050 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-21db1fc0-fe7c-4115-8f25-b2f62ce1808b tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:23.375887 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-21db1fc0-fe7c-4115-8f25-b2f62ce1808b tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:23.411574 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.network.security_group_api [None req-a86704b5-3c43-48f3-a7f5-5980d5dd2bff tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Neutron security group does_not_exist not found {{(pid=131321) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Jul 23 21:31:23.412371 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-a86704b5-3c43-48f3-a7f5-5980d5dd2bff tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Jul 23 21:31:23.435696 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a86704b5-3c43-48f3-a7f5-5980d5dd2bff tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Request method failure captured: Jul 23 21:31:23.435696 ncdv-master-1 devstack@n-api.service[131321]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 23 21:31:23.435696 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:31:23.435696 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:31:23.435696 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:31:23.435696 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 258 Jul 23 21:31:23.435696 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:31:23.435696 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:31:23.435696 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:31:23.435696 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:31:23.435696 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3Ghf1JjZ4k8tVzERRK8IkLpluLUwa9k5Rz-X0dEr2p4_7xl_eBekUiNk1RZEGsFdGEiApbLOfcuSifirvwiKV1QOTaKdXKwfMnwZgdfagxJjoe3dPYUa3b-d3rVTYewIN_YoX2mMGGBMWRa3po8WOCVIc6hXJLExzq_ndbcO7U8NQBI Jul 23 21:31:23.435696 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:31:23.435696 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:31:23.435696 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:31:23.435696 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:31:23.435696 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:31:23.435696 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:31:23.435696 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: d70f6c96e1ad484aa3207fc01a12d519 Jul 23 21:31:23.435696 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:31:23.435696 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:31:23.435696 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:31:23.435696 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d70f6c96e1ad484aa3207fc01a12d519"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d70f6c96e1ad484aa3207fc01a12d519"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d70f6c96e1ad484aa3207fc01a12d519", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d70f6c96e1ad484aa3207fc01a12d519"}]}] Jul 23 21:31:23.435696 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:31:23.435696 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: d70f6c96e1ad484aa3207fc01a12d519 Jul 23 21:31:23.435696 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:31:23.435696 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ServersNegativeTestJSON-1106538570-project Jul 23 21:31:23.435696 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:31:23.435696 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:31:23.435696 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 6ca9644a73d9468aa39b21548a72bded Jul 23 21:31:23.435696 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ServersNegativeTestJSON-1106538570-project Jul 23 21:31:23.435696 ncdv-master-1 devstack@n-api.service[131321]: Jul 23 21:31:23.435696 ncdv-master-1 devstack@n-api.service[131321]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1106667840", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "654a77ca-1e84-434d-8536-1fc3adb327d0"}]}} Jul 23 21:31:23.435696 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:31:23.435696 ncdv-master-1 devstack@n-api.service[131321]: exception: Unable to find security_group with name or id 'does_not_exist' Jul 23 21:31:23.435696 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1106667840', 'imageRef': 'b27b20aa-ef1b-4dd1-989e-321af6343d6a', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '654a77ca-1e84-434d-8536-1fc3adb327d0'}]}}} Jul 23 21:31:23.435696 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:31:23.435696 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:23.435696 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Jul 23 21:31:23.435696 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Jul 23 21:31:23.435696 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:31:23.435696 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:31:23.435696 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Jul 23 21:31:23.435696 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Jul 23 21:31:23.435696 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Jul 23 21:31:23.435696 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:23.435696 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:31:23.435696 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:23.435696 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:23.435696 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Jul 23 21:31:23.435696 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Jul 23 21:31:23.435696 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:31:23.435696 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:31:23.435696 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Jul 23 21:31:23.435696 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Jul 23 21:31:23.435696 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Jul 23 21:31:23.435696 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:23.435696 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:31:23.435696 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:23.435696 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:23.435696 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Jul 23 21:31:23.435696 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Jul 23 21:31:23.439480 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Jul 23 21:31:23.439480 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Jul 23 21:31:23.439480 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Jul 23 21:31:23.439480 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Jul 23 21:31:23.439480 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 23 21:31:23.439480 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 23 21:31:23.439480 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Jul 23 21:31:23.439480 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Jul 23 21:31:23.439480 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Jul 23 21:31:23.439480 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:23.439480 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:31:23.439480 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:23.439480 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:23.439480 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jul 23 21:31:23.439480 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 23 21:31:23.439480 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 23 21:31:23.439480 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 23 21:31:23.439480 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1632, in _create_instance Jul 23 21:31:23.439480 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Jul 23 21:31:23.439480 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1060, in _validate_and_build_base_options Jul 23 21:31:23.439480 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Jul 23 21:31:23.439480 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 507, in _check_requested_secgroups Jul 23 21:31:23.439480 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Jul 23 21:31:23.439480 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Jul 23 21:31:23.439480 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 23 21:31:23.439480 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Jul 23 21:31:23.439480 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:23.439480 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:31:23.439480 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:23.439480 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:23.439480 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:31:23.439480 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:31:23.439480 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:31:23.439480 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:31:23.439480 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:31:23.439480 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:31:23.439480 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:31:23.439480 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:31:23.439480 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:31:23.439480 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:31:23.439480 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:31:23.439480 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:31:23.439480 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 23 21:31:23.439480 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jul 23 21:31:23.439480 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 23 21:31:23.439480 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Jul 23 21:31:23.439480 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:23.439480 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:31:23.439480 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:23.439480 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:23.439480 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:31:23.439480 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:31:23.439480 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:31:23.439480 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:31:23.439480 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Jul 23 21:31:23.439480 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:23.439480 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a86704b5-3c43-48f3-a7f5-5980d5dd2bff tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:31:23.442922 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-a86704b5-3c43-48f3-a7f5-5980d5dd2bff tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.189015 Jul 23 21:31:23.442922 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2173/4253] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:31:23 2022] POST /compute/v2.1/servers => generated 106 bytes in 191 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 23 21:31:23.445570 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a2cee4bb-a321-4c72-b625-1938cb6d418e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:23.463470 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-a2cee4bb-a321-4c72-b625-1938cb6d418e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:23.474087 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a2cee4bb-a321-4c72-b625-1938cb6d418e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:23.475215 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a2cee4bb-a321-4c72-b625-1938cb6d418e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:23.475600 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a2cee4bb-a321-4c72-b625-1938cb6d418e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:23.476035 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a2cee4bb-a321-4c72-b625-1938cb6d418e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:23.534566 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-21db1fc0-fe7c-4115-8f25-b2f62ce1808b tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd49331138a4dbc912bc7bf6f6b0215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842a1aca542f416eab5d43b881325917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:23.566180 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-21db1fc0-fe7c-4115-8f25-b2f62ce1808b tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] 10.222.0.17 "GET /compute/v2.1/servers/1f5b9a5a-109e-48b5-adc1-113384944dce" status: 200 len: 1345 microversion: 2.1 time: 0.206148 Jul 23 21:31:23.582086 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-a2cee4bb-a321-4c72-b625-1938cb6d418e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:23.586141 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2081/4254] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:23 2022] GET /compute/v2.1/servers/1f5b9a5a-109e-48b5-adc1-113384944dce => generated 1345 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:31:23.591024 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-a2cee4bb-a321-4c72-b625-1938cb6d418e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:23.592536 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-a2cee4bb-a321-4c72-b625-1938cb6d418e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:23.593749 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-a2cee4bb-a321-4c72-b625-1938cb6d418e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.153492 Jul 23 21:31:23.614565 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2851d359-db54-4793-b735-d35471bd5ce8 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:23.614565 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-2851d359-db54-4793-b735-d35471bd5ce8 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:23.615743 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2174/4255] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:31:23 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:31:23.620711 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2851d359-db54-4793-b735-d35471bd5ce8 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:23.621189 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2851d359-db54-4793-b735-d35471bd5ce8 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:23.623764 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-6bd4e4a5-6a60-4b28-978a-8dd8e4b25347 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:23.624561 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-6bd4e4a5-6a60-4b28-978a-8dd8e4b25347 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: f685637e-a804-4266-81a2-67d2e11a60b0] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:23.629108 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2851d359-db54-4793-b735-d35471bd5ce8 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:23.630719 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2851d359-db54-4793-b735-d35471bd5ce8 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:23.634498 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6bd4e4a5-6a60-4b28-978a-8dd8e4b25347 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:23.635207 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6bd4e4a5-6a60-4b28-978a-8dd8e4b25347 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:23.636749 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6bd4e4a5-6a60-4b28-978a-8dd8e4b25347 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:23.637698 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6bd4e4a5-6a60-4b28-978a-8dd8e4b25347 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:23.676133 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=100 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:31:23.716595 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6bd4e4a5-6a60-4b28-978a-8dd8e4b25347 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:23.718366 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6bd4e4a5-6a60-4b28-978a-8dd8e4b25347 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:23.719031 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.objects.instance [None req-6bd4e4a5-6a60-4b28-978a-8dd8e4b25347 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lazy-loading 'fault' on Instance uuid f685637e-a804-4266-81a2-67d2e11a60b0 {{(pid=131321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:31:23.800133 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-6bd4e4a5-6a60-4b28-978a-8dd8e4b25347 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:23.809177 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-6bd4e4a5-6a60-4b28-978a-8dd8e4b25347 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/f685637e-a804-4266-81a2-67d2e11a60b0" status: 200 len: 1299 microversion: 2.1 time: 0.191806 Jul 23 21:31:23.822112 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2175/4256] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:23 2022] GET /compute/v2.1/servers/f685637e-a804-4266-81a2-67d2e11a60b0 => generated 1299 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:24.279334 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f51ad661-f6ff-4773-bcf8-a68597f68a49 tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:24.280271 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-f51ad661-f6ff-4773-bcf8-a68597f68a49 tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] [instance: a053bb4d-aaa2-4f14-bb62-5623ef5448aa] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:24.287369 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f51ad661-f6ff-4773-bcf8-a68597f68a49 tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:24.287829 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f51ad661-f6ff-4773-bcf8-a68597f68a49 tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:24.288623 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f51ad661-f6ff-4773-bcf8-a68597f68a49 tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:24.289069 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f51ad661-f6ff-4773-bcf8-a68597f68a49 tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:24.469901 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-f51ad661-f6ff-4773-bcf8-a68597f68a49 tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc0782a98aca44f18bf86a9f6ad5eb60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d547fc8e53d43888e35c3e8ef5caada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:24.489593 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-f51ad661-f6ff-4773-bcf8-a68597f68a49 tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] 10.222.0.17 "GET /compute/v2.1/servers/a053bb4d-aaa2-4f14-bb62-5623ef5448aa" status: 200 len: 1528 microversion: 2.1 time: 0.235597 Jul 23 21:31:24.495069 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2176/4257] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:24 2022] GET /compute/v2.1/servers/a053bb4d-aaa2-4f14-bb62-5623ef5448aa => generated 1528 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:24.508649 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-2851d359-db54-4793-b735-d35471bd5ce8 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:24.509219 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-1cc7f1c1-1093-423c-a397-73849a55c047 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:24.510276 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-1cc7f1c1-1093-423c-a397-73849a55c047 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] [instance: 5cb6a473-80fe-4569-bd9a-52511d3b81aa] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:24.521915 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1cc7f1c1-1093-423c-a397-73849a55c047 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:24.524991 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1cc7f1c1-1093-423c-a397-73849a55c047 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:24.527954 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2851d359-db54-4793-b735-d35471bd5ce8 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1505 microversion: 2.1 time: 0.940107 Jul 23 21:31:24.529601 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2082/4258] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:23 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1505 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:24.531029 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1cc7f1c1-1093-423c-a397-73849a55c047 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:24.531595 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1cc7f1c1-1093-423c-a397-73849a55c047 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:24.537665 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2d951052-e18c-4d6f-af17-b289bc2b83ce tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:24.538576 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-2d951052-e18c-4d6f-af17-b289bc2b83ce tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] [instance: a053bb4d-aaa2-4f14-bb62-5623ef5448aa] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:24.549368 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2d951052-e18c-4d6f-af17-b289bc2b83ce tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:24.550136 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2d951052-e18c-4d6f-af17-b289bc2b83ce tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:24.551510 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2d951052-e18c-4d6f-af17-b289bc2b83ce tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:24.552120 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2d951052-e18c-4d6f-af17-b289bc2b83ce tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:24.607874 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-1cc7f1c1-1093-423c-a397-73849a55c047 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:24.617516 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-1cc7f1c1-1093-423c-a397-73849a55c047 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:24.619451 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-1cc7f1c1-1093-423c-a397-73849a55c047 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:24.621443 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-1cc7f1c1-1093-423c-a397-73849a55c047 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] 10.222.0.17 "GET /compute/v2.1/servers/5cb6a473-80fe-4569-bd9a-52511d3b81aa" status: 200 len: 1364 microversion: 2.47 time: 0.123317 Jul 23 21:31:24.622992 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2177/4259] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:31:24 2022] GET /compute/v2.1/servers/5cb6a473-80fe-4569-bd9a-52511d3b81aa => generated 1364 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:31:24.627982 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-36ab9848-2993-4543-8753-b702be4a9d86 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:24.628592 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-36ab9848-2993-4543-8753-b702be4a9d86 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:24.636268 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-36ab9848-2993-4543-8753-b702be4a9d86 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:24.636528 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-36ab9848-2993-4543-8753-b702be4a9d86 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:24.637623 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-36ab9848-2993-4543-8753-b702be4a9d86 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:24.638182 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-36ab9848-2993-4543-8753-b702be4a9d86 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:24.839524 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-36ab9848-2993-4543-8753-b702be4a9d86 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:24.847269 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-36ab9848-2993-4543-8753-b702be4a9d86 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1505 microversion: 2.1 time: 0.223171 Jul 23 21:31:24.847862 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2178/4260] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:24 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1505 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:24.865569 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-5a069792-58d2-4bbc-a3c6-b3cec55966af tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:24.866306 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-5a069792-58d2-4bbc-a3c6-b3cec55966af tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] [instance: 1f5b9a5a-109e-48b5-adc1-113384944dce] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:24.873176 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5a069792-58d2-4bbc-a3c6-b3cec55966af tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:24.873581 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5a069792-58d2-4bbc-a3c6-b3cec55966af tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:24.874384 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5a069792-58d2-4bbc-a3c6-b3cec55966af tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:24.874826 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5a069792-58d2-4bbc-a3c6-b3cec55966af tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:24.948032 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-5a069792-58d2-4bbc-a3c6-b3cec55966af tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd49331138a4dbc912bc7bf6f6b0215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842a1aca542f416eab5d43b881325917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:24.956987 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-5a069792-58d2-4bbc-a3c6-b3cec55966af tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] 10.222.0.17 "GET /compute/v2.1/servers/1f5b9a5a-109e-48b5-adc1-113384944dce" status: 200 len: 1351 microversion: 2.1 time: 0.095633 Jul 23 21:31:24.962471 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2179/4261] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:24 2022] GET /compute/v2.1/servers/1f5b9a5a-109e-48b5-adc1-113384944dce => generated 1351 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:24.966587 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-4e18e1ac-9660-40ac-85f9-5f74f2ee5be3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:24.967130 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-4e18e1ac-9660-40ac-85f9-5f74f2ee5be3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:24.973475 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4e18e1ac-9660-40ac-85f9-5f74f2ee5be3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:24.973947 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4e18e1ac-9660-40ac-85f9-5f74f2ee5be3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:24.974873 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4e18e1ac-9660-40ac-85f9-5f74f2ee5be3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:24.975314 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4e18e1ac-9660-40ac-85f9-5f74f2ee5be3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:25.047890 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-2d951052-e18c-4d6f-af17-b289bc2b83ce tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc0782a98aca44f18bf86a9f6ad5eb60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d547fc8e53d43888e35c3e8ef5caada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:25.048444 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-4e18e1ac-9660-40ac-85f9-5f74f2ee5be3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:25.058776 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2d951052-e18c-4d6f-af17-b289bc2b83ce tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] 10.222.0.17 "GET /compute/v2.1/servers/a053bb4d-aaa2-4f14-bb62-5623ef5448aa" status: 200 len: 1528 microversion: 2.1 time: 0.527568 Jul 23 21:31:25.059948 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2083/4262] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:24 2022] GET /compute/v2.1/servers/a053bb4d-aaa2-4f14-bb62-5623ef5448aa => generated 1528 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:25.069119 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5067f7e7-3958-44dc-ab9a-a969a5e16157 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:25.072611 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-4e18e1ac-9660-40ac-85f9-5f74f2ee5be3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:25.073607 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5067f7e7-3958-44dc-ab9a-a969a5e16157 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: f685637e-a804-4266-81a2-67d2e11a60b0] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:25.074699 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-4e18e1ac-9660-40ac-85f9-5f74f2ee5be3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:25.076034 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-4e18e1ac-9660-40ac-85f9-5f74f2ee5be3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.117470 Jul 23 21:31:25.086251 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5067f7e7-3958-44dc-ab9a-a969a5e16157 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:25.088198 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2180/4263] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:31:24 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:31:25.089068 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5067f7e7-3958-44dc-ab9a-a969a5e16157 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:25.090058 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5067f7e7-3958-44dc-ab9a-a969a5e16157 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:25.094551 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-34a4145c-bd1a-401a-a45b-260264fd1bca tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:25.095061 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-34a4145c-bd1a-401a-a45b-260264fd1bca tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: b69d3185-f8e2-413a-9ffe-b35a036461b2] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:25.095383 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5067f7e7-3958-44dc-ab9a-a969a5e16157 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:25.102041 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-34a4145c-bd1a-401a-a45b-260264fd1bca tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] HTTP exception thrown: Instance b69d3185-f8e2-413a-9ffe-b35a036461b2 could not be found. Jul 23 21:31:25.103475 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-34a4145c-bd1a-401a-a45b-260264fd1bca tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Request method failure captured: Jul 23 21:31:25.103475 ncdv-master-1 devstack@n-api.service[131321]: request: DELETE /compute/v2.1/servers/b69d3185-f8e2-413a-9ffe-b35a036461b2 HTTP/1.1 Jul 23 21:31:25.103475 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:31:25.103475 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:31:25.103475 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:31:25.103475 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:31:25.103475 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:31:25.103475 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:31:25.103475 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:31:25.103475 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:31:25.103475 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3Ghf1JjZ4k8tVzERRK8IkLpluLUwa9k5Rz-X0dEr2p4_7xl_eBekUiNk1RZEGsFdGEiApbLOfcuSifirvwiKV1QOTaKdXKwfMnwZgdfagxJjoe3dPYUa3b-d3rVTYewIN_YoX2mMGGBMWRa3po8WOCVIc6hXJLExzq_ndbcO7U8NQBI Jul 23 21:31:25.103475 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:31:25.103475 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:31:25.103475 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:31:25.103475 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:31:25.103475 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:31:25.103475 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:31:25.103475 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: d70f6c96e1ad484aa3207fc01a12d519 Jul 23 21:31:25.103475 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:31:25.103475 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:31:25.103475 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:31:25.103475 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d70f6c96e1ad484aa3207fc01a12d519"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d70f6c96e1ad484aa3207fc01a12d519"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d70f6c96e1ad484aa3207fc01a12d519", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d70f6c96e1ad484aa3207fc01a12d519"}]}] Jul 23 21:31:25.103475 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:31:25.103475 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: d70f6c96e1ad484aa3207fc01a12d519 Jul 23 21:31:25.103475 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:31:25.103475 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ServersNegativeTestJSON-1106538570-project Jul 23 21:31:25.103475 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:31:25.103475 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:31:25.103475 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 6ca9644a73d9468aa39b21548a72bded Jul 23 21:31:25.103475 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ServersNegativeTestJSON-1106538570-project Jul 23 21:31:25.103475 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:31:25.103475 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance b69d3185-f8e2-413a-9ffe-b35a036461b2 could not be found. Jul 23 21:31:25.103475 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': 'b69d3185-f8e2-413a-9ffe-b35a036461b2'} Jul 23 21:31:25.103475 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:31:25.103475 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:25.103475 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:31:25.103475 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:31:25.103475 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:31:25.103475 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:31:25.103475 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 23 21:31:25.103475 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 23 21:31:25.103475 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b69d3185-f8e2-413a-9ffe-b35a036461b2 could not be found. Jul 23 21:31:25.103475 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:25.103475 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:31:25.103475 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:25.103475 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:25.103475 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:31:25.103475 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:31:25.103475 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:31:25.103475 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:31:25.103475 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:31:25.103475 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:31:25.103475 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 23 21:31:25.103475 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 23 21:31:25.103475 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 23 21:31:25.103475 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 23 21:31:25.103475 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:31:25.103475 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:31:25.103475 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:31:25.103475 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:31:25.103475 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b69d3185-f8e2-413a-9ffe-b35a036461b2 could not be found. Jul 23 21:31:25.103475 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:25.103475 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:31:25.111166 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:25.111166 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:25.111166 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:31:25.111166 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:31:25.111166 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:31:25.111166 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:31:25.111166 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b69d3185-f8e2-413a-9ffe-b35a036461b2 could not be found. Jul 23 21:31:25.111166 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:25.111166 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-34a4145c-bd1a-401a-a45b-260264fd1bca tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Returning 404 to user: Instance b69d3185-f8e2-413a-9ffe-b35a036461b2 could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:31:25.111166 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-34a4145c-bd1a-401a-a45b-260264fd1bca tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "DELETE /compute/v2.1/servers/b69d3185-f8e2-413a-9ffe-b35a036461b2" status: 404 len: 111 microversion: 2.1 time: 0.015376 Jul 23 21:31:25.111166 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2181/4264] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:31:25 2022] DELETE /compute/v2.1/servers/b69d3185-f8e2-413a-9ffe-b35a036461b2 => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:31:25.122408 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-5067f7e7-3958-44dc-ab9a-a969a5e16157 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] HTTP exception thrown: Instance f685637e-a804-4266-81a2-67d2e11a60b0 could not be found. Jul 23 21:31:25.127215 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5067f7e7-3958-44dc-ab9a-a969a5e16157 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Request method failure captured: Jul 23 21:31:25.127215 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/f685637e-a804-4266-81a2-67d2e11a60b0 HTTP/1.1 Jul 23 21:31:25.127215 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:31:25.127215 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:31:25.127215 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:31:25.127215 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:31:25.127215 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:31:25.127215 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:31:25.127215 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:31:25.127215 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:31:25.127215 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GgexSaJTA-FXaV5LcqTAteOVESwOg7zac7nwUa59CGOHDwwWd7w7HKC8R65F9X48OwLZ_a8UsJYui6X5BG5uL_WJC-ysEg9nxrojp43TnKgPHTkujcdOw9VWLxqM9CE8dPwhawUMo8jE8x_rLu-o0j9Xf_QveShH-OlX4BIDLcYoyo Jul 23 21:31:25.127215 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:31:25.127215 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:31:25.127215 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:31:25.127215 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:31:25.127215 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:31:25.127215 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:31:25.127215 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 1890022bd460485dae0ea94b152a6746 Jul 23 21:31:25.127215 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServersTestJSON-1141465764 Jul 23 21:31:25.127215 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:31:25.127215 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:31:25.127215 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1890022bd460485dae0ea94b152a6746"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1890022bd460485dae0ea94b152a6746"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1890022bd460485dae0ea94b152a6746", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1890022bd460485dae0ea94b152a6746"}]}] Jul 23 21:31:25.127215 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServersTestJSON-1141465764 Jul 23 21:31:25.127215 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 1890022bd460485dae0ea94b152a6746 Jul 23 21:31:25.127215 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServersTestJSON-1141465764 Jul 23 21:31:25.127215 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServersTestJSON-1141465764-project Jul 23 21:31:25.127215 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:31:25.127215 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:31:25.127215 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 5efda1c40f494592bf1e6af1add120f3 Jul 23 21:31:25.127215 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServersTestJSON-1141465764-project Jul 23 21:31:25.127215 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:31:25.127215 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance f685637e-a804-4266-81a2-67d2e11a60b0 could not be found. Jul 23 21:31:25.127215 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': 'f685637e-a804-4266-81a2-67d2e11a60b0'} Jul 23 21:31:25.127215 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:31:25.127215 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:25.127215 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:31:25.127215 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:31:25.127215 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:31:25.127215 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:31:25.127215 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:31:25.127215 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:31:25.127215 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:31:25.127215 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:31:25.127215 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f685637e-a804-4266-81a2-67d2e11a60b0 could not be found. Jul 23 21:31:25.127215 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:31:25.127215 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:31:25.127215 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:31:25.127215 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:25.127215 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:31:25.127215 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:31:25.127215 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:31:25.127215 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:31:25.127215 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:31:25.127215 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:31:25.127215 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:31:25.127215 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:31:25.127215 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:31:25.127215 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:31:25.127215 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:31:25.127215 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:31:25.127215 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f685637e-a804-4266-81a2-67d2e11a60b0 could not be found. Jul 23 21:31:25.127215 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:31:25.127215 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:31:25.127215 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:31:25.127215 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:25.131416 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:31:25.131416 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:31:25.131416 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:31:25.131416 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:31:25.131416 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f685637e-a804-4266-81a2-67d2e11a60b0 could not be found. Jul 23 21:31:25.131416 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:31:25.131416 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5067f7e7-3958-44dc-ab9a-a969a5e16157 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Returning 404 to user: Instance f685637e-a804-4266-81a2-67d2e11a60b0 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:31:25.139499 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5067f7e7-3958-44dc-ab9a-a969a5e16157 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/f685637e-a804-4266-81a2-67d2e11a60b0" status: 404 len: 111 microversion: 2.1 time: 0.070601 Jul 23 21:31:25.140771 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2084/4265] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:25 2022] GET /compute/v2.1/servers/f685637e-a804-4266-81a2-67d2e11a60b0 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:31:25.153540 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5d00e79e-b618-4b92-9da3-d72a827bbe47 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:25.154206 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5d00e79e-b618-4b92-9da3-d72a827bbe47 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:25.165591 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5d00e79e-b618-4b92-9da3-d72a827bbe47 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:25.166086 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5d00e79e-b618-4b92-9da3-d72a827bbe47 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:25.166876 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5d00e79e-b618-4b92-9da3-d72a827bbe47 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:25.167315 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5d00e79e-b618-4b92-9da3-d72a827bbe47 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:25.315117 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-4ff3adaf-fbdd-4f92-af58-9e541d5dddfe tempest-ServersNegativeTestMultiTenantJSON-2037041285 tempest-ServersNegativeTestMultiTenantJSON-2037041285-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:25.315755 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-4ff3adaf-fbdd-4f92-af58-9e541d5dddfe tempest-ServersNegativeTestMultiTenantJSON-2037041285 tempest-ServersNegativeTestMultiTenantJSON-2037041285-project] [instance: a053bb4d-aaa2-4f14-bb62-5623ef5448aa] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:25.326483 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4ff3adaf-fbdd-4f92-af58-9e541d5dddfe tempest-ServersNegativeTestMultiTenantJSON-2037041285 tempest-ServersNegativeTestMultiTenantJSON-2037041285-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:25.327157 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4ff3adaf-fbdd-4f92-af58-9e541d5dddfe tempest-ServersNegativeTestMultiTenantJSON-2037041285 tempest-ServersNegativeTestMultiTenantJSON-2037041285-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:25.332116 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4ff3adaf-fbdd-4f92-af58-9e541d5dddfe tempest-ServersNegativeTestMultiTenantJSON-2037041285 tempest-ServersNegativeTestMultiTenantJSON-2037041285-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:25.332992 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4ff3adaf-fbdd-4f92-af58-9e541d5dddfe tempest-ServersNegativeTestMultiTenantJSON-2037041285 tempest-ServersNegativeTestMultiTenantJSON-2037041285-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:25.348891 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-4ff3adaf-fbdd-4f92-af58-9e541d5dddfe tempest-ServersNegativeTestMultiTenantJSON-2037041285 tempest-ServersNegativeTestMultiTenantJSON-2037041285-project] HTTP exception thrown: Instance a053bb4d-aaa2-4f14-bb62-5623ef5448aa could not be found. Jul 23 21:31:25.352059 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-4ff3adaf-fbdd-4f92-af58-9e541d5dddfe tempest-ServersNegativeTestMultiTenantJSON-2037041285 tempest-ServersNegativeTestMultiTenantJSON-2037041285-project] Request method failure captured: Jul 23 21:31:25.352059 ncdv-master-1 devstack@n-api.service[131321]: request: DELETE /compute/v2.1/servers/a053bb4d-aaa2-4f14-bb62-5623ef5448aa HTTP/1.1 Jul 23 21:31:25.352059 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:31:25.352059 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:31:25.352059 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:31:25.352059 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:31:25.352059 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:31:25.352059 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:31:25.352059 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:31:25.352059 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:31:25.352059 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GiXbzv2UR7I4C3XvAzdSQ7os-ioYF8NPh-drHY0VR7iVc_reausbd_KlGjrUCEnYmDtw_bg-owLAxK8qLWD3YNIeN8KDCA_fnGZSZ3A03Iw5o-oTBZDScUI7jv15nidzhNCpoa4eCwY9oo-2I2Jk6rUYqiRN6LaB1gruu-b8av8Hk4 Jul 23 21:31:25.352059 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:31:25.352059 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:31:25.352059 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:31:25.352059 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:31:25.352059 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:31:25.352059 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:31:25.352059 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 866e33e7818341c2b4105db2241ef067 Jul 23 21:31:25.352059 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-2037041285 Jul 23 21:31:25.352059 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:31:25.352059 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:31:25.352059 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/866e33e7818341c2b4105db2241ef067"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/866e33e7818341c2b4105db2241ef067"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_866e33e7818341c2b4105db2241ef067", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/866e33e7818341c2b4105db2241ef067"}]}] Jul 23 21:31:25.352059 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-2037041285 Jul 23 21:31:25.352059 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 866e33e7818341c2b4105db2241ef067 Jul 23 21:31:25.352059 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-2037041285 Jul 23 21:31:25.352059 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ServersNegativeTestMultiTenantJSON-2037041285-project Jul 23 21:31:25.352059 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:31:25.352059 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:31:25.352059 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 8e191bb795f848bf939124faae84add1 Jul 23 21:31:25.352059 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-2037041285-project Jul 23 21:31:25.352059 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:31:25.352059 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance a053bb4d-aaa2-4f14-bb62-5623ef5448aa could not be found. Jul 23 21:31:25.352059 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': 'a053bb4d-aaa2-4f14-bb62-5623ef5448aa'} Jul 23 21:31:25.352059 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:31:25.352059 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:25.352059 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:31:25.352059 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:31:25.352059 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:31:25.352059 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:31:25.352059 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:31:25.352059 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:31:25.352059 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:31:25.352059 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:31:25.352059 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a053bb4d-aaa2-4f14-bb62-5623ef5448aa could not be found. Jul 23 21:31:25.352059 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:25.352059 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:31:25.352059 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:25.352059 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:25.352059 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:31:25.352059 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:31:25.352059 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:31:25.352059 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:31:25.352059 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:31:25.352059 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:31:25.352059 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 23 21:31:25.352059 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 23 21:31:25.352059 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 23 21:31:25.352059 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 23 21:31:25.352059 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:31:25.352059 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:31:25.352059 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:31:25.352059 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:31:25.356863 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a053bb4d-aaa2-4f14-bb62-5623ef5448aa could not be found. Jul 23 21:31:25.356863 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:25.356863 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:31:25.356863 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:25.356863 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:25.356863 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:31:25.356863 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:31:25.356863 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:31:25.356863 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:31:25.356863 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a053bb4d-aaa2-4f14-bb62-5623ef5448aa could not be found. Jul 23 21:31:25.356863 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:25.358563 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-4ff3adaf-fbdd-4f92-af58-9e541d5dddfe tempest-ServersNegativeTestMultiTenantJSON-2037041285 tempest-ServersNegativeTestMultiTenantJSON-2037041285-project] Returning 404 to user: Instance a053bb4d-aaa2-4f14-bb62-5623ef5448aa could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:31:25.359607 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-4ff3adaf-fbdd-4f92-af58-9e541d5dddfe tempest-ServersNegativeTestMultiTenantJSON-2037041285 tempest-ServersNegativeTestMultiTenantJSON-2037041285-project] 10.222.0.17 "DELETE /compute/v2.1/servers/a053bb4d-aaa2-4f14-bb62-5623ef5448aa" status: 404 len: 111 microversion: 2.1 time: 0.252392 Jul 23 21:31:25.360479 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2182/4266] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:31:25 2022] DELETE /compute/v2.1/servers/a053bb4d-aaa2-4f14-bb62-5623ef5448aa => generated 111 bytes in 254 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:31:25.377373 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-4f2c9a4e-5f34-4385-ba10-19c3f1f85dbd tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1115596099", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "networks": [{"uuid": "63d253f9-5d83-4f00-8bc3-28f418cf7611"}]}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:31:25.434495 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.network.neutron [None req-4f2c9a4e-5f34-4385-ba10-19c3f1f85dbd tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] validate_networks() for [('63d253f9-5d83-4f00-8bc3-28f418cf7611', None, None, None, None, None)] {{(pid=131321) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:31:25.522869 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5d00e79e-b618-4b92-9da3-d72a827bbe47 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:25.535302 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5d00e79e-b618-4b92-9da3-d72a827bbe47 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1505 microversion: 2.1 time: 0.393137 Jul 23 21:31:25.549459 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2085/4267] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:25 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1505 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:25.557329 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-436b31b5-ac67-4852-9194-c3cd9d56efbd tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:25.559277 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-436b31b5-ac67-4852-9194-c3cd9d56efbd tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] [instance: a053bb4d-aaa2-4f14-bb62-5623ef5448aa] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:25.573327 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-436b31b5-ac67-4852-9194-c3cd9d56efbd tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:25.574614 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-436b31b5-ac67-4852-9194-c3cd9d56efbd tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:25.575641 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-436b31b5-ac67-4852-9194-c3cd9d56efbd tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:25.576306 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-436b31b5-ac67-4852-9194-c3cd9d56efbd tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:25.897184 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-4f2c9a4e-5f34-4385-ba10-19c3f1f85dbd tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Flavor limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:31:25.897613 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-4f2c9a4e-5f34-4385-ba10-19c3f1f85dbd tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Image limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:31:25.898138 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-4f2c9a4e-5f34-4385-ba10-19c3f1f85dbd tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Flavor pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:31:25.898554 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-4f2c9a4e-5f34-4385-ba10-19c3f1f85dbd tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Image pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:31:25.899496 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-4f2c9a4e-5f34-4385-ba10-19c3f1f85dbd tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:31:25.910695 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4f2c9a4e-5f34-4385-ba10-19c3f1f85dbd tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:25.911497 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4f2c9a4e-5f34-4385-ba10-19c3f1f85dbd tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:25.912388 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4f2c9a4e-5f34-4385-ba10-19c3f1f85dbd tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:25.913016 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4f2c9a4e-5f34-4385-ba10-19c3f1f85dbd tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:25.929339 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:31:25.935460 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-4f2c9a4e-5f34-4385-ba10-19c3f1f85dbd tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Getting quotas for project 1890022bd460485dae0ea94b152a6746. Resources: {'ram', 'instances', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:31:25.940516 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-436b31b5-ac67-4852-9194-c3cd9d56efbd tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc0782a98aca44f18bf86a9f6ad5eb60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d547fc8e53d43888e35c3e8ef5caada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:25.943349 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-4f2c9a4e-5f34-4385-ba10-19c3f1f85dbd tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Getting quotas for user 5efda1c40f494592bf1e6af1add120f3 and project 1890022bd460485dae0ea94b152a6746. Resources: {'ram', 'instances', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:31:25.950390 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-436b31b5-ac67-4852-9194-c3cd9d56efbd tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] 10.222.0.17 "GET /compute/v2.1/servers/a053bb4d-aaa2-4f14-bb62-5623ef5448aa" status: 200 len: 1528 microversion: 2.1 time: 0.397657 Jul 23 21:31:25.959676 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-4f2c9a4e-5f34-4385-ba10-19c3f1f85dbd tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Going to run 1 instances... {{(pid=131321) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:31:25.964019 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-4f2c9a4e-5f34-4385-ba10-19c3f1f85dbd tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: b83d31c6-561b-47f9-a17b-377c54728c08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131321) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:31:25.966123 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2086/4268] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:25 2022] GET /compute/v2.1/servers/a053bb4d-aaa2-4f14-bb62-5623ef5448aa => generated 1528 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:25.974884 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e1fe08f0-7d00-47f0-bcef-38974167da65 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:25.975987 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e1fe08f0-7d00-47f0-bcef-38974167da65 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:25.983230 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e1fe08f0-7d00-47f0-bcef-38974167da65 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:25.983698 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e1fe08f0-7d00-47f0-bcef-38974167da65 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:25.984568 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e1fe08f0-7d00-47f0-bcef-38974167da65 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:25.985018 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e1fe08f0-7d00-47f0-bcef-38974167da65 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:26.028820 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-4f2c9a4e-5f34-4385-ba10-19c3f1f85dbd tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.655684 Jul 23 21:31:26.029904 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2183/4269] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:31:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 657 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 23 21:31:26.039262 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-0981c9c3-1d8b-40ed-8b8a-0b818f27628a tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:26.040163 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-0981c9c3-1d8b-40ed-8b8a-0b818f27628a tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] [instance: 5cb6a473-80fe-4569-bd9a-52511d3b81aa] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:26.047147 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0981c9c3-1d8b-40ed-8b8a-0b818f27628a tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:26.047605 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0981c9c3-1d8b-40ed-8b8a-0b818f27628a tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:26.048399 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0981c9c3-1d8b-40ed-8b8a-0b818f27628a tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:26.048975 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0981c9c3-1d8b-40ed-8b8a-0b818f27628a tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:26.116368 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-0981c9c3-1d8b-40ed-8b8a-0b818f27628a tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:26.125633 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-0981c9c3-1d8b-40ed-8b8a-0b818f27628a tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:26.129223 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-0981c9c3-1d8b-40ed-8b8a-0b818f27628a tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:26.130488 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-0981c9c3-1d8b-40ed-8b8a-0b818f27628a tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] 10.222.0.17 "GET /compute/v2.1/servers/5cb6a473-80fe-4569-bd9a-52511d3b81aa" status: 200 len: 1364 microversion: 2.47 time: 0.095398 Jul 23 21:31:26.131067 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2184/4270] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:31:26 2022] GET /compute/v2.1/servers/5cb6a473-80fe-4569-bd9a-52511d3b81aa => generated 1364 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:31:26.135846 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-40656d28-5347-4452-94a1-9b5726216080 tempest-ServersNegativeTestMultiTenantJSON-2037041285 tempest-ServersNegativeTestMultiTenantJSON-2037041285-project] Action: 'update', calling method: >, body: {"server": {"name": "a053bb4d-aaa2-4f14-bb62-5623ef5448aa_new"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:31:26.137149 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-40656d28-5347-4452-94a1-9b5726216080 tempest-ServersNegativeTestMultiTenantJSON-2037041285 tempest-ServersNegativeTestMultiTenantJSON-2037041285-project] [instance: a053bb4d-aaa2-4f14-bb62-5623ef5448aa] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:26.144386 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-40656d28-5347-4452-94a1-9b5726216080 tempest-ServersNegativeTestMultiTenantJSON-2037041285 tempest-ServersNegativeTestMultiTenantJSON-2037041285-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:26.144850 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-40656d28-5347-4452-94a1-9b5726216080 tempest-ServersNegativeTestMultiTenantJSON-2037041285 tempest-ServersNegativeTestMultiTenantJSON-2037041285-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:26.145637 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-40656d28-5347-4452-94a1-9b5726216080 tempest-ServersNegativeTestMultiTenantJSON-2037041285 tempest-ServersNegativeTestMultiTenantJSON-2037041285-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:26.146120 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-40656d28-5347-4452-94a1-9b5726216080 tempest-ServersNegativeTestMultiTenantJSON-2037041285 tempest-ServersNegativeTestMultiTenantJSON-2037041285-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:26.163083 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-40656d28-5347-4452-94a1-9b5726216080 tempest-ServersNegativeTestMultiTenantJSON-2037041285 tempest-ServersNegativeTestMultiTenantJSON-2037041285-project] HTTP exception thrown: Instance a053bb4d-aaa2-4f14-bb62-5623ef5448aa could not be found. Jul 23 21:31:26.164774 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-40656d28-5347-4452-94a1-9b5726216080 tempest-ServersNegativeTestMultiTenantJSON-2037041285 tempest-ServersNegativeTestMultiTenantJSON-2037041285-project] Request method failure captured: Jul 23 21:31:26.164774 ncdv-master-1 devstack@n-api.service[131321]: request: PUT /compute/v2.1/servers/a053bb4d-aaa2-4f14-bb62-5623ef5448aa HTTP/1.1 Jul 23 21:31:26.164774 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:31:26.164774 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:31:26.164774 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:31:26.164774 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 64 Jul 23 21:31:26.164774 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:31:26.164774 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:31:26.164774 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:31:26.164774 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:31:26.164774 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GiXbzv2UR7I4C3XvAzdSQ7os-ioYF8NPh-drHY0VR7iVc_reausbd_KlGjrUCEnYmDtw_bg-owLAxK8qLWD3YNIeN8KDCA_fnGZSZ3A03Iw5o-oTBZDScUI7jv15nidzhNCpoa4eCwY9oo-2I2Jk6rUYqiRN6LaB1gruu-b8av8Hk4 Jul 23 21:31:26.164774 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:31:26.164774 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:31:26.164774 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:31:26.164774 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:31:26.164774 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:31:26.164774 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:31:26.164774 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 866e33e7818341c2b4105db2241ef067 Jul 23 21:31:26.164774 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-2037041285 Jul 23 21:31:26.164774 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:31:26.164774 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:31:26.164774 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/866e33e7818341c2b4105db2241ef067"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/866e33e7818341c2b4105db2241ef067"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_866e33e7818341c2b4105db2241ef067", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/866e33e7818341c2b4105db2241ef067"}]}] Jul 23 21:31:26.164774 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-2037041285 Jul 23 21:31:26.164774 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 866e33e7818341c2b4105db2241ef067 Jul 23 21:31:26.164774 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-2037041285 Jul 23 21:31:26.164774 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ServersNegativeTestMultiTenantJSON-2037041285-project Jul 23 21:31:26.164774 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:31:26.164774 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:31:26.164774 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 8e191bb795f848bf939124faae84add1 Jul 23 21:31:26.164774 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-2037041285-project Jul 23 21:31:26.164774 ncdv-master-1 devstack@n-api.service[131321]: Jul 23 21:31:26.164774 ncdv-master-1 devstack@n-api.service[131321]: {"server": {"name": "a053bb4d-aaa2-4f14-bb62-5623ef5448aa_new"}} Jul 23 21:31:26.164774 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:31:26.164774 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance a053bb4d-aaa2-4f14-bb62-5623ef5448aa could not be found. Jul 23 21:31:26.164774 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': 'a053bb4d-aaa2-4f14-bb62-5623ef5448aa', 'body': {'server': {'name': 'a053bb4d-aaa2-4f14-bb62-5623ef5448aa_new'}}} Jul 23 21:31:26.164774 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:31:26.164774 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:26.164774 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:31:26.164774 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:31:26.164774 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:31:26.164774 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:31:26.164774 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:31:26.164774 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:31:26.164774 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:31:26.164774 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:31:26.164774 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a053bb4d-aaa2-4f14-bb62-5623ef5448aa could not be found. Jul 23 21:31:26.164774 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:26.164774 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:31:26.164774 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:26.164774 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:26.164774 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:31:26.164774 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:31:26.164774 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:31:26.164774 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:31:26.164774 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:31:26.164774 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:31:26.164774 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:31:26.164774 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:31:26.164774 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:31:26.164774 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:31:26.164774 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:31:26.164774 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:31:26.164774 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 23 21:31:26.164774 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Jul 23 21:31:26.169001 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Jul 23 21:31:26.169001 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:31:26.169001 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:31:26.169001 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:31:26.169001 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:31:26.169001 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a053bb4d-aaa2-4f14-bb62-5623ef5448aa could not be found. Jul 23 21:31:26.169001 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:26.169001 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:31:26.169001 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:26.169001 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:26.169001 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:31:26.169001 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:31:26.169001 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:31:26.169001 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:31:26.169001 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a053bb4d-aaa2-4f14-bb62-5623ef5448aa could not be found. Jul 23 21:31:26.169001 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:26.172172 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-40656d28-5347-4452-94a1-9b5726216080 tempest-ServersNegativeTestMultiTenantJSON-2037041285 tempest-ServersNegativeTestMultiTenantJSON-2037041285-project] Returning 404 to user: Instance a053bb4d-aaa2-4f14-bb62-5623ef5448aa could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:31:26.173287 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-40656d28-5347-4452-94a1-9b5726216080 tempest-ServersNegativeTestMultiTenantJSON-2037041285 tempest-ServersNegativeTestMultiTenantJSON-2037041285-project] 10.222.0.17 "PUT /compute/v2.1/servers/a053bb4d-aaa2-4f14-bb62-5623ef5448aa" status: 404 len: 111 microversion: 2.1 time: 0.041269 Jul 23 21:31:26.174342 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2185/4271] 10.222.0.17 () {60 vars in 1255 bytes} [Sat Jul 23 21:31:26 2022] PUT /compute/v2.1/servers/a053bb4d-aaa2-4f14-bb62-5623ef5448aa => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:31:26.179838 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-9d5601e7-cb58-4593-8fef-1342f12bf7f4 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:26.180612 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-9d5601e7-cb58-4593-8fef-1342f12bf7f4 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] [instance: 1f5b9a5a-109e-48b5-adc1-113384944dce] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:26.187629 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9d5601e7-cb58-4593-8fef-1342f12bf7f4 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:26.188239 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9d5601e7-cb58-4593-8fef-1342f12bf7f4 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:26.189347 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9d5601e7-cb58-4593-8fef-1342f12bf7f4 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:26.190061 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9d5601e7-cb58-4593-8fef-1342f12bf7f4 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:26.378738 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-9d5601e7-cb58-4593-8fef-1342f12bf7f4 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd49331138a4dbc912bc7bf6f6b0215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842a1aca542f416eab5d43b881325917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:26.395669 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-9d5601e7-cb58-4593-8fef-1342f12bf7f4 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] 10.222.0.17 "GET /compute/v2.1/servers/1f5b9a5a-109e-48b5-adc1-113384944dce" status: 200 len: 1469 microversion: 2.1 time: 0.219958 Jul 23 21:31:26.396456 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2186/4272] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:26 2022] GET /compute/v2.1/servers/1f5b9a5a-109e-48b5-adc1-113384944dce => generated 1469 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:26.409712 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-6694317c-8538-46b3-8553-9a787a47159a tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:26.411606 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-6694317c-8538-46b3-8553-9a787a47159a tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: b83d31c6-561b-47f9-a17b-377c54728c08] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:26.419026 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e1fe08f0-7d00-47f0-bcef-38974167da65 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:26.439054 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e1fe08f0-7d00-47f0-bcef-38974167da65 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1505 microversion: 2.1 time: 0.467191 Jul 23 21:31:26.454528 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2087/4273] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:25 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1505 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:26.473884 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a6ac31cb-1254-4124-92b2-f751ebf0ca3f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:26.477101 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a6ac31cb-1254-4124-92b2-f751ebf0ca3f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:26.485967 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a6ac31cb-1254-4124-92b2-f751ebf0ca3f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:26.487791 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a6ac31cb-1254-4124-92b2-f751ebf0ca3f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:26.489148 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a6ac31cb-1254-4124-92b2-f751ebf0ca3f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:26.489922 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a6ac31cb-1254-4124-92b2-f751ebf0ca3f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:26.508834 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-6694317c-8538-46b3-8553-9a787a47159a tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:26.520419 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-6694317c-8538-46b3-8553-9a787a47159a tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/b83d31c6-561b-47f9-a17b-377c54728c08" status: 200 len: 1209 microversion: 2.1 time: 0.122945 Jul 23 21:31:26.522171 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2187/4274] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:26 2022] GET /compute/v2.1/servers/b83d31c6-561b-47f9-a17b-377c54728c08 => generated 1209 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:26.550281 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-edb1e2de-a6e1-496e-bf38-92b969db7bae tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:26.550896 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-edb1e2de-a6e1-496e-bf38-92b969db7bae tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] [instance: a053bb4d-aaa2-4f14-bb62-5623ef5448aa] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:26.576822 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-edb1e2de-a6e1-496e-bf38-92b969db7bae tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:26.578263 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-edb1e2de-a6e1-496e-bf38-92b969db7bae tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:26.579546 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-edb1e2de-a6e1-496e-bf38-92b969db7bae tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:26.582108 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-edb1e2de-a6e1-496e-bf38-92b969db7bae tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:26.652033 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-edb1e2de-a6e1-496e-bf38-92b969db7bae tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] [instance: a053bb4d-aaa2-4f14-bb62-5623ef5448aa] Going to try to terminate instance {{(pid=131321) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:31:26.695675 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a6ac31cb-1254-4124-92b2-f751ebf0ca3f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:26.715400 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a6ac31cb-1254-4124-92b2-f751ebf0ca3f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:26.717883 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a6ac31cb-1254-4124-92b2-f751ebf0ca3f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:26.721471 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a6ac31cb-1254-4124-92b2-f751ebf0ca3f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.265599 Jul 23 21:31:26.722087 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2088/4275] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:31:26 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:31:26.730734 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-cf399121-077d-488b-9f60-50230c95400f tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:26.734449 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-cf399121-077d-488b-9f60-50230c95400f tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Failed to fetch instance by id 9223372036854775808 {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 23 21:31:26.735989 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-cf399121-077d-488b-9f60-50230c95400f tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Jul 23 21:31:26.737622 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-cf399121-077d-488b-9f60-50230c95400f tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Request method failure captured: Jul 23 21:31:26.737622 ncdv-master-1 devstack@n-api.service[131320]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Jul 23 21:31:26.737622 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:31:26.737622 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:31:26.737622 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:31:26.737622 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:31:26.737622 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:31:26.737622 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:31:26.737622 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:31:26.737622 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:31:26.737622 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3Ghf1JjZ4k8tVzERRK8IkLpluLUwa9k5Rz-X0dEr2p4_7xl_eBekUiNk1RZEGsFdGEiApbLOfcuSifirvwiKV1QOTaKdXKwfMnwZgdfagxJjoe3dPYUa3b-d3rVTYewIN_YoX2mMGGBMWRa3po8WOCVIc6hXJLExzq_ndbcO7U8NQBI Jul 23 21:31:26.737622 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:31:26.737622 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:31:26.737622 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:31:26.737622 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:31:26.737622 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:31:26.737622 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:31:26.737622 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: d70f6c96e1ad484aa3207fc01a12d519 Jul 23 21:31:26.737622 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:31:26.737622 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:31:26.737622 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:31:26.737622 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d70f6c96e1ad484aa3207fc01a12d519"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d70f6c96e1ad484aa3207fc01a12d519"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d70f6c96e1ad484aa3207fc01a12d519", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d70f6c96e1ad484aa3207fc01a12d519"}]}] Jul 23 21:31:26.737622 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:31:26.737622 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: d70f6c96e1ad484aa3207fc01a12d519 Jul 23 21:31:26.737622 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:31:26.737622 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServersNegativeTestJSON-1106538570-project Jul 23 21:31:26.737622 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:31:26.737622 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:31:26.737622 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 6ca9644a73d9468aa39b21548a72bded Jul 23 21:31:26.737622 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServersNegativeTestJSON-1106538570-project Jul 23 21:31:26.737622 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:31:26.737622 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance 9223372036854775808 could not be found. Jul 23 21:31:26.737622 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '9223372036854775808'} Jul 23 21:31:26.737622 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:31:26.737622 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:26.737622 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:31:26.737622 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:31:26.737622 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 23 21:31:26.737622 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 23 21:31:26.737622 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Jul 23 21:31:26.737622 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:31:26.737622 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:31:26.737622 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:31:26.737622 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:26.737622 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:31:26.737622 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:31:26.737622 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:31:26.737622 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:31:26.737622 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:31:26.737622 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:31:26.737622 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 23 21:31:26.737622 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 23 21:31:26.737622 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 23 21:31:26.737622 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 23 21:31:26.737622 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:31:26.737622 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:31:26.737622 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:31:26.737622 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:31:26.737622 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Jul 23 21:31:26.737622 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:31:26.737622 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:31:26.737622 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:31:26.737622 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:26.737622 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:31:26.744790 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:31:26.744790 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:31:26.744790 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:31:26.744790 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Jul 23 21:31:26.744790 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:31:26.744790 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-cf399121-077d-488b-9f60-50230c95400f tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:31:26.744790 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-cf399121-077d-488b-9f60-50230c95400f tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.017421 Jul 23 21:31:26.746113 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2089/4276] 10.222.0.17 () {58 vars in 1187 bytes} [Sat Jul 23 21:31:26 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 23 21:31:26.755555 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1fe71c27-00e2-481e-a086-8116835e9423 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:26.756660 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1fe71c27-00e2-481e-a086-8116835e9423 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:26.766750 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1fe71c27-00e2-481e-a086-8116835e9423 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:26.767240 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1fe71c27-00e2-481e-a086-8116835e9423 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:26.768103 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1fe71c27-00e2-481e-a086-8116835e9423 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:26.769081 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1fe71c27-00e2-481e-a086-8116835e9423 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:26.836924 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-edb1e2de-a6e1-496e-bf38-92b969db7bae tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] 10.222.0.17 "DELETE /compute/v2.1/servers/a053bb4d-aaa2-4f14-bb62-5623ef5448aa" status: 204 len: 0 microversion: 2.1 time: 0.312925 Jul 23 21:31:26.839638 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2188/4277] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:31:26 2022] DELETE /compute/v2.1/servers/a053bb4d-aaa2-4f14-bb62-5623ef5448aa => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:31:26.848657 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-3738f5db-8e03-4b25-a10e-260873785d1a tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:26.850131 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-3738f5db-8e03-4b25-a10e-260873785d1a tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] [instance: a053bb4d-aaa2-4f14-bb62-5623ef5448aa] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:26.867145 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3738f5db-8e03-4b25-a10e-260873785d1a tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:26.867763 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3738f5db-8e03-4b25-a10e-260873785d1a tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:26.868561 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3738f5db-8e03-4b25-a10e-260873785d1a tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:26.869031 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3738f5db-8e03-4b25-a10e-260873785d1a tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:27.151611 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-1fe71c27-00e2-481e-a086-8116835e9423 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:27.156035 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-3738f5db-8e03-4b25-a10e-260873785d1a tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc0782a98aca44f18bf86a9f6ad5eb60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d547fc8e53d43888e35c3e8ef5caada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:27.164107 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1fe71c27-00e2-481e-a086-8116835e9423 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1505 microversion: 2.1 time: 0.413415 Jul 23 21:31:27.166504 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2090/4278] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:26 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1505 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:31:27.171014 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-3738f5db-8e03-4b25-a10e-260873785d1a tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] 10.222.0.17 "GET /compute/v2.1/servers/a053bb4d-aaa2-4f14-bb62-5623ef5448aa" status: 200 len: 1534 microversion: 2.1 time: 0.326679 Jul 23 21:31:27.171797 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-37e66a79-1b8c-42de-bac2-2fb8eb21a563 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:27.172595 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-37e66a79-1b8c-42de-bac2-2fb8eb21a563 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] [instance: 5cb6a473-80fe-4569-bd9a-52511d3b81aa] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:27.173821 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2189/4279] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:26 2022] GET /compute/v2.1/servers/a053bb4d-aaa2-4f14-bb62-5623ef5448aa => generated 1534 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:27.180945 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-37e66a79-1b8c-42de-bac2-2fb8eb21a563 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:27.181635 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-37e66a79-1b8c-42de-bac2-2fb8eb21a563 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:27.184739 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-37e66a79-1b8c-42de-bac2-2fb8eb21a563 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:27.185362 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-37e66a79-1b8c-42de-bac2-2fb8eb21a563 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:27.188779 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-90e94d0e-90da-4914-a106-8a92456eb2d1 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:27.189678 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-90e94d0e-90da-4914-a106-8a92456eb2d1 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:27.208417 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-90e94d0e-90da-4914-a106-8a92456eb2d1 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:27.210107 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-90e94d0e-90da-4914-a106-8a92456eb2d1 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:27.211356 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-90e94d0e-90da-4914-a106-8a92456eb2d1 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:27.212618 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-90e94d0e-90da-4914-a106-8a92456eb2d1 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:27.243092 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:31:27.302014 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-37e66a79-1b8c-42de-bac2-2fb8eb21a563 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:27.313644 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-37e66a79-1b8c-42de-bac2-2fb8eb21a563 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:27.315394 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-37e66a79-1b8c-42de-bac2-2fb8eb21a563 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:27.316740 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-37e66a79-1b8c-42de-bac2-2fb8eb21a563 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] 10.222.0.17 "GET /compute/v2.1/servers/5cb6a473-80fe-4569-bd9a-52511d3b81aa" status: 200 len: 1364 microversion: 2.47 time: 0.149213 Jul 23 21:31:27.317443 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2091/4280] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:31:27 2022] GET /compute/v2.1/servers/5cb6a473-80fe-4569-bd9a-52511d3b81aa => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:31:27.414877 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-68c7768e-def0-493e-8586-34ad520a660c tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:27.415965 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-68c7768e-def0-493e-8586-34ad520a660c tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] [instance: 1f5b9a5a-109e-48b5-adc1-113384944dce] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:27.426399 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-68c7768e-def0-493e-8586-34ad520a660c tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:27.427792 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-68c7768e-def0-493e-8586-34ad520a660c tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:27.428754 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-68c7768e-def0-493e-8586-34ad520a660c tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:27.430087 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-68c7768e-def0-493e-8586-34ad520a660c tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:27.510209 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-90e94d0e-90da-4914-a106-8a92456eb2d1 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:27.521398 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-90e94d0e-90da-4914-a106-8a92456eb2d1 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1505 microversion: 2.1 time: 0.342342 Jul 23 21:31:27.522705 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2190/4281] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:27 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1505 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:27.538938 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-452490f2-e6f8-4fce-bb2f-239362fda0ef tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:27.539769 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-452490f2-e6f8-4fce-bb2f-239362fda0ef tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Failed to fetch instance by id -1 {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 23 21:31:27.540524 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-452490f2-e6f8-4fce-bb2f-239362fda0ef tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] HTTP exception thrown: Instance -1 could not be found. Jul 23 21:31:27.542623 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-452490f2-e6f8-4fce-bb2f-239362fda0ef tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Request method failure captured: Jul 23 21:31:27.542623 ncdv-master-1 devstack@n-api.service[131321]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Jul 23 21:31:27.542623 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:31:27.542623 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:31:27.542623 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:31:27.542623 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:31:27.542623 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:31:27.542623 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:31:27.542623 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:31:27.542623 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:31:27.542623 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3Ghf1JjZ4k8tVzERRK8IkLpluLUwa9k5Rz-X0dEr2p4_7xl_eBekUiNk1RZEGsFdGEiApbLOfcuSifirvwiKV1QOTaKdXKwfMnwZgdfagxJjoe3dPYUa3b-d3rVTYewIN_YoX2mMGGBMWRa3po8WOCVIc6hXJLExzq_ndbcO7U8NQBI Jul 23 21:31:27.542623 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:31:27.542623 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:31:27.542623 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:31:27.542623 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:31:27.542623 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:31:27.542623 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:31:27.542623 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: d70f6c96e1ad484aa3207fc01a12d519 Jul 23 21:31:27.542623 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:31:27.542623 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:31:27.542623 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:31:27.542623 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d70f6c96e1ad484aa3207fc01a12d519"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d70f6c96e1ad484aa3207fc01a12d519"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d70f6c96e1ad484aa3207fc01a12d519", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d70f6c96e1ad484aa3207fc01a12d519"}]}] Jul 23 21:31:27.542623 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:31:27.542623 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: d70f6c96e1ad484aa3207fc01a12d519 Jul 23 21:31:27.542623 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:31:27.542623 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ServersNegativeTestJSON-1106538570-project Jul 23 21:31:27.542623 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:31:27.542623 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:31:27.542623 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 6ca9644a73d9468aa39b21548a72bded Jul 23 21:31:27.542623 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ServersNegativeTestJSON-1106538570-project Jul 23 21:31:27.542623 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:31:27.542623 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance -1 could not be found. Jul 23 21:31:27.542623 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': '-1'} Jul 23 21:31:27.542623 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:31:27.542623 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:27.542623 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:31:27.542623 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:31:27.542623 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 23 21:31:27.542623 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 23 21:31:27.542623 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Jul 23 21:31:27.542623 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:27.542623 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:31:27.542623 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:27.542623 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:27.542623 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:31:27.542623 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:31:27.542623 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:31:27.542623 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:31:27.542623 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:31:27.542623 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:31:27.542623 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 23 21:31:27.542623 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 23 21:31:27.542623 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 23 21:31:27.542623 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 23 21:31:27.542623 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:31:27.542623 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:31:27.542623 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:31:27.542623 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:31:27.542623 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Jul 23 21:31:27.542623 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:27.542623 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:31:27.542623 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:27.542623 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:27.542623 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:31:27.542623 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:31:27.546214 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:31:27.546214 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:31:27.546214 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Jul 23 21:31:27.546214 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:27.547900 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-452490f2-e6f8-4fce-bb2f-239362fda0ef tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Returning 404 to user: Instance -1 could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:31:27.549461 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-452490f2-e6f8-4fce-bb2f-239362fda0ef tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.014144 Jul 23 21:31:27.550638 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2191/4282] 10.222.0.17 () {58 vars in 1136 bytes} [Sat Jul 23 21:31:27 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 23 21:31:27.556255 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-2cff556f-35f0-4ffd-91ee-91db0479aaaf tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:27.556872 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-2cff556f-35f0-4ffd-91ee-91db0479aaaf tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: b83d31c6-561b-47f9-a17b-377c54728c08] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:27.564472 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2cff556f-35f0-4ffd-91ee-91db0479aaaf tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:27.565212 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2cff556f-35f0-4ffd-91ee-91db0479aaaf tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:27.566241 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2cff556f-35f0-4ffd-91ee-91db0479aaaf tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:27.566947 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2cff556f-35f0-4ffd-91ee-91db0479aaaf tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:27.655826 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-2cff556f-35f0-4ffd-91ee-91db0479aaaf tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:27.670638 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-2cff556f-35f0-4ffd-91ee-91db0479aaaf tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/b83d31c6-561b-47f9-a17b-377c54728c08" status: 200 len: 1261 microversion: 2.1 time: 0.118353 Jul 23 21:31:27.671534 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2192/4283] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:27 2022] GET /compute/v2.1/servers/b83d31c6-561b-47f9-a17b-377c54728c08 => generated 1261 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:27.685852 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-b5b7dabf-82a4-4932-8d59-c879d82e6441 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:27.686850 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-b5b7dabf-82a4-4932-8d59-c879d82e6441 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:27.695915 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b5b7dabf-82a4-4932-8d59-c879d82e6441 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:27.696936 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b5b7dabf-82a4-4932-8d59-c879d82e6441 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:27.698505 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b5b7dabf-82a4-4932-8d59-c879d82e6441 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:27.699563 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b5b7dabf-82a4-4932-8d59-c879d82e6441 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:27.823234 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-68c7768e-def0-493e-8586-34ad520a660c tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd49331138a4dbc912bc7bf6f6b0215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842a1aca542f416eab5d43b881325917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:27.834316 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-68c7768e-def0-493e-8586-34ad520a660c tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] 10.222.0.17 "GET /compute/v2.1/servers/1f5b9a5a-109e-48b5-adc1-113384944dce" status: 200 len: 1469 microversion: 2.1 time: 0.425220 Jul 23 21:31:27.835217 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2092/4284] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:27 2022] GET /compute/v2.1/servers/1f5b9a5a-109e-48b5-adc1-113384944dce => generated 1469 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:31:27.844512 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-bc213ea3-3899-45e3-a1d6-f635bbe1bfd8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:27.845873 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-bc213ea3-3899-45e3-a1d6-f635bbe1bfd8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:27.853077 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bc213ea3-3899-45e3-a1d6-f635bbe1bfd8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:27.853985 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bc213ea3-3899-45e3-a1d6-f635bbe1bfd8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:27.854760 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bc213ea3-3899-45e3-a1d6-f635bbe1bfd8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:27.858391 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bc213ea3-3899-45e3-a1d6-f635bbe1bfd8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:27.970167 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-bc213ea3-3899-45e3-a1d6-f635bbe1bfd8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:27.980867 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-bc213ea3-3899-45e3-a1d6-f635bbe1bfd8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:27.983065 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-bc213ea3-3899-45e3-a1d6-f635bbe1bfd8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:27.984443 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-bc213ea3-3899-45e3-a1d6-f635bbe1bfd8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.147913 Jul 23 21:31:27.985337 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2093/4285] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:31:27 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:31:27.990149 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-b7e5a86c-53c0-4e50-a2d8-4edcbad1a23d req-df4dd827-2650-48b1-8d9e-6c952a48403a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f5b9a5a-109e-48b5-adc1-113384944dce", "tag": "b947908f-6578-44ec-898d-fff1852fea99"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:31:27.999688 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-b7e5a86c-53c0-4e50-a2d8-4edcbad1a23d req-df4dd827-2650-48b1-8d9e-6c952a48403a service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:28.000378 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-b7e5a86c-53c0-4e50-a2d8-4edcbad1a23d req-df4dd827-2650-48b1-8d9e-6c952a48403a service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:28.012843 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-b7e5a86c-53c0-4e50-a2d8-4edcbad1a23d req-df4dd827-2650-48b1-8d9e-6c952a48403a service nova] Creating event network-changed:b947908f-6578-44ec-898d-fff1852fea99 for instance 1f5b9a5a-109e-48b5-adc1-113384944dce on nch2-master-1 Jul 23 21:31:28.019527 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-b7e5a86c-53c0-4e50-a2d8-4edcbad1a23d req-df4dd827-2650-48b1-8d9e-6c952a48403a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032650 Jul 23 21:31:28.034415 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2094/4286] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:31:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:31:28.126707 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-b5b7dabf-82a4-4932-8d59-c879d82e6441 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:28.139084 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-b5b7dabf-82a4-4932-8d59-c879d82e6441 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1505 microversion: 2.1 time: 0.466202 Jul 23 21:31:28.139691 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2193/4287] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:27 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1505 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:28.160894 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-268ea244-12a7-471e-b364-029fa1584992 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:28.162248 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-268ea244-12a7-471e-b364-029fa1584992 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:28.171465 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-268ea244-12a7-471e-b364-029fa1584992 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:28.174256 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-268ea244-12a7-471e-b364-029fa1584992 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:28.176105 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-268ea244-12a7-471e-b364-029fa1584992 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:28.178003 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-268ea244-12a7-471e-b364-029fa1584992 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:28.195053 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a4a722ee-54ab-41bd-807a-6d20c834cd55 tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:28.196208 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-a4a722ee-54ab-41bd-807a-6d20c834cd55 tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] [instance: a053bb4d-aaa2-4f14-bb62-5623ef5448aa] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:28.208923 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a4a722ee-54ab-41bd-807a-6d20c834cd55 tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:28.214323 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a4a722ee-54ab-41bd-807a-6d20c834cd55 tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:28.215465 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a4a722ee-54ab-41bd-807a-6d20c834cd55 tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:28.216548 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a4a722ee-54ab-41bd-807a-6d20c834cd55 tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:28.526920 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-a4a722ee-54ab-41bd-807a-6d20c834cd55 tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc0782a98aca44f18bf86a9f6ad5eb60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d547fc8e53d43888e35c3e8ef5caada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:28.536471 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-a4a722ee-54ab-41bd-807a-6d20c834cd55 tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] 10.222.0.17 "GET /compute/v2.1/servers/a053bb4d-aaa2-4f14-bb62-5623ef5448aa" status: 200 len: 1534 microversion: 2.1 time: 0.348428 Jul 23 21:31:28.547449 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2194/4288] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:28 2022] GET /compute/v2.1/servers/a053bb4d-aaa2-4f14-bb62-5623ef5448aa => generated 1534 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:31:28.552781 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c3b104e2-a3cc-48da-9727-166e3a312e82 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:28.553912 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-c3b104e2-a3cc-48da-9727-166e3a312e82 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] [instance: 5cb6a473-80fe-4569-bd9a-52511d3b81aa] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:28.562197 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c3b104e2-a3cc-48da-9727-166e3a312e82 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:28.562659 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c3b104e2-a3cc-48da-9727-166e3a312e82 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:28.563441 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c3b104e2-a3cc-48da-9727-166e3a312e82 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:28.563870 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c3b104e2-a3cc-48da-9727-166e3a312e82 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:28.684266 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c3b104e2-a3cc-48da-9727-166e3a312e82 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:28.696249 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c3b104e2-a3cc-48da-9727-166e3a312e82 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:28.697885 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c3b104e2-a3cc-48da-9727-166e3a312e82 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:28.699375 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-c3b104e2-a3cc-48da-9727-166e3a312e82 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] 10.222.0.17 "GET /compute/v2.1/servers/5cb6a473-80fe-4569-bd9a-52511d3b81aa" status: 200 len: 1364 microversion: 2.47 time: 0.150568 Jul 23 21:31:28.701805 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2195/4289] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:31:28 2022] GET /compute/v2.1/servers/5cb6a473-80fe-4569-bd9a-52511d3b81aa => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:31:28.706634 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-07dd8e3b-3e40-46bb-bf88-0a7fe500d85f tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:28.707451 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-07dd8e3b-3e40-46bb-bf88-0a7fe500d85f tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: b83d31c6-561b-47f9-a17b-377c54728c08] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:28.716058 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-07dd8e3b-3e40-46bb-bf88-0a7fe500d85f tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:28.716976 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-07dd8e3b-3e40-46bb-bf88-0a7fe500d85f tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:28.718191 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-07dd8e3b-3e40-46bb-bf88-0a7fe500d85f tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:28.718662 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-07dd8e3b-3e40-46bb-bf88-0a7fe500d85f tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:28.848633 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-268ea244-12a7-471e-b364-029fa1584992 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:28.860766 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-268ea244-12a7-471e-b364-029fa1584992 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1505 microversion: 2.1 time: 0.704709 Jul 23 21:31:28.861597 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2095/4290] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:28 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1505 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:31:28.868333 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ac157696-6c09-46ca-9c71-acae6cc990af tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:28.870109 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ac157696-6c09-46ca-9c71-acae6cc990af tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] [instance: 1f5b9a5a-109e-48b5-adc1-113384944dce] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:28.878600 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ac157696-6c09-46ca-9c71-acae6cc990af tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:28.879062 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ac157696-6c09-46ca-9c71-acae6cc990af tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:28.879854 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ac157696-6c09-46ca-9c71-acae6cc990af tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:28.880299 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ac157696-6c09-46ca-9c71-acae6cc990af tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:29.108961 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-07dd8e3b-3e40-46bb-bf88-0a7fe500d85f tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:29.117831 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-07dd8e3b-3e40-46bb-bf88-0a7fe500d85f tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/b83d31c6-561b-47f9-a17b-377c54728c08" status: 200 len: 1267 microversion: 2.1 time: 0.416108 Jul 23 21:31:29.118343 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2196/4291] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:28 2022] GET /compute/v2.1/servers/b83d31c6-561b-47f9-a17b-377c54728c08 => generated 1267 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:29.134257 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-5a8f36ac-b0fb-4e40-8afa-d12473f891aa tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:31:29.134806 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-5a8f36ac-b0fb-4e40-8afa-d12473f891aa tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: 5d569f9c-2f3b-4396-aff9-fa140d04cf18] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:29.141979 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-5a8f36ac-b0fb-4e40-8afa-d12473f891aa tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] HTTP exception thrown: Instance 5d569f9c-2f3b-4396-aff9-fa140d04cf18 could not be found. Jul 23 21:31:29.149890 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-5a8f36ac-b0fb-4e40-8afa-d12473f891aa tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Request method failure captured: Jul 23 21:31:29.149890 ncdv-master-1 devstack@n-api.service[131321]: request: POST /compute/v2.1/servers/5d569f9c-2f3b-4396-aff9-fa140d04cf18/action HTTP/1.1 Jul 23 21:31:29.149890 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:31:29.149890 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:31:29.149890 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:31:29.149890 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 19 Jul 23 21:31:29.149890 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:31:29.149890 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:31:29.149890 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:31:29.149890 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:31:29.149890 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3Ghf1JjZ4k8tVzERRK8IkLpluLUwa9k5Rz-X0dEr2p4_7xl_eBekUiNk1RZEGsFdGEiApbLOfcuSifirvwiKV1QOTaKdXKwfMnwZgdfagxJjoe3dPYUa3b-d3rVTYewIN_YoX2mMGGBMWRa3po8WOCVIc6hXJLExzq_ndbcO7U8NQBI Jul 23 21:31:29.149890 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:31:29.149890 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:31:29.149890 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:31:29.149890 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:31:29.149890 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:31:29.149890 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:31:29.149890 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: d70f6c96e1ad484aa3207fc01a12d519 Jul 23 21:31:29.149890 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:31:29.149890 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:31:29.149890 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:31:29.149890 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d70f6c96e1ad484aa3207fc01a12d519"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d70f6c96e1ad484aa3207fc01a12d519"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d70f6c96e1ad484aa3207fc01a12d519", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d70f6c96e1ad484aa3207fc01a12d519"}]}] Jul 23 21:31:29.149890 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:31:29.149890 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: d70f6c96e1ad484aa3207fc01a12d519 Jul 23 21:31:29.149890 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:31:29.149890 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ServersNegativeTestJSON-1106538570-project Jul 23 21:31:29.149890 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:31:29.149890 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:31:29.149890 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 6ca9644a73d9468aa39b21548a72bded Jul 23 21:31:29.149890 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ServersNegativeTestJSON-1106538570-project Jul 23 21:31:29.149890 ncdv-master-1 devstack@n-api.service[131321]: Jul 23 21:31:29.149890 ncdv-master-1 devstack@n-api.service[131321]: {"forceDelete": {}} Jul 23 21:31:29.149890 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:31:29.149890 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance 5d569f9c-2f3b-4396-aff9-fa140d04cf18 could not be found. Jul 23 21:31:29.149890 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': '5d569f9c-2f3b-4396-aff9-fa140d04cf18', 'body': {'forceDelete': {}}} Jul 23 21:31:29.149890 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:31:29.149890 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:29.149890 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:31:29.149890 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:31:29.149890 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:31:29.149890 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:31:29.149890 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 23 21:31:29.149890 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 23 21:31:29.149890 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d569f9c-2f3b-4396-aff9-fa140d04cf18 could not be found. Jul 23 21:31:29.149890 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:29.149890 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:31:29.149890 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:29.149890 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:29.149890 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:31:29.149890 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:31:29.149890 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:31:29.149890 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:31:29.149890 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:31:29.149890 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:31:29.149890 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Jul 23 21:31:29.149890 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 23 21:31:29.149890 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:31:29.149890 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:31:29.149890 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d569f9c-2f3b-4396-aff9-fa140d04cf18 could not be found. Jul 23 21:31:29.149890 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:29.149890 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:31:29.149890 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:29.149890 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:29.149890 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:31:29.149890 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:31:29.153548 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:31:29.153548 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:31:29.153548 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d569f9c-2f3b-4396-aff9-fa140d04cf18 could not be found. Jul 23 21:31:29.153548 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:29.155683 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-5a8f36ac-b0fb-4e40-8afa-d12473f891aa tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Returning 404 to user: Instance 5d569f9c-2f3b-4396-aff9-fa140d04cf18 could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:31:29.156559 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-5a8f36ac-b0fb-4e40-8afa-d12473f891aa tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "POST /compute/v2.1/servers/5d569f9c-2f3b-4396-aff9-fa140d04cf18/action" status: 404 len: 111 microversion: 2.1 time: 0.028047 Jul 23 21:31:29.157161 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2197/4292] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:31:29 2022] POST /compute/v2.1/servers/5d569f9c-2f3b-4396-aff9-fa140d04cf18/action => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:31:29.161747 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-40ba364d-40b6-4e1f-b056-a519563bee09 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:29.162383 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-40ba364d-40b6-4e1f-b056-a519563bee09 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:29.169854 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-40ba364d-40b6-4e1f-b056-a519563bee09 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:29.170466 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-40ba364d-40b6-4e1f-b056-a519563bee09 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:29.171709 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-40ba364d-40b6-4e1f-b056-a519563bee09 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:29.172383 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-40ba364d-40b6-4e1f-b056-a519563bee09 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:29.277997 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-40ba364d-40b6-4e1f-b056-a519563bee09 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:29.289717 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-40ba364d-40b6-4e1f-b056-a519563bee09 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:29.291311 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-40ba364d-40b6-4e1f-b056-a519563bee09 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:29.292748 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-40ba364d-40b6-4e1f-b056-a519563bee09 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.134645 Jul 23 21:31:29.304190 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2198/4293] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:31:29 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:31:29.304190 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-b9288834-372a-4ef7-90d2-3ca37b61a65b tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:29.304190 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-b9288834-372a-4ef7-90d2-3ca37b61a65b tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:29.308521 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b9288834-372a-4ef7-90d2-3ca37b61a65b tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:29.309116 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b9288834-372a-4ef7-90d2-3ca37b61a65b tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:29.310002 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b9288834-372a-4ef7-90d2-3ca37b61a65b tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:29.310534 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b9288834-372a-4ef7-90d2-3ca37b61a65b tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:29.374934 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ac157696-6c09-46ca-9c71-acae6cc990af tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd49331138a4dbc912bc7bf6f6b0215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842a1aca542f416eab5d43b881325917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:29.385300 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ac157696-6c09-46ca-9c71-acae6cc990af tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] 10.222.0.17 "GET /compute/v2.1/servers/1f5b9a5a-109e-48b5-adc1-113384944dce" status: 200 len: 1469 microversion: 2.1 time: 0.521234 Jul 23 21:31:29.396437 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2096/4294] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:28 2022] GET /compute/v2.1/servers/1f5b9a5a-109e-48b5-adc1-113384944dce => generated 1469 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:29.555581 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ff72ce62-72ff-4906-8a6f-923502b98944 tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:29.556331 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ff72ce62-72ff-4906-8a6f-923502b98944 tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] [instance: a053bb4d-aaa2-4f14-bb62-5623ef5448aa] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:29.562747 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ff72ce62-72ff-4906-8a6f-923502b98944 tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:29.563281 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ff72ce62-72ff-4906-8a6f-923502b98944 tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:29.564126 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ff72ce62-72ff-4906-8a6f-923502b98944 tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:29.564630 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ff72ce62-72ff-4906-8a6f-923502b98944 tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:29.607104 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-b9288834-372a-4ef7-90d2-3ca37b61a65b tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:29.621216 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-b9288834-372a-4ef7-90d2-3ca37b61a65b tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1505 microversion: 2.1 time: 0.325077 Jul 23 21:31:29.625015 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2199/4295] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:29 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1505 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:29.645312 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-274c90e3-2334-41a1-af32-3ebc596333ac tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:29.668405 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-274c90e3-2334-41a1-af32-3ebc596333ac tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:29.675536 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-274c90e3-2334-41a1-af32-3ebc596333ac tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:29.678213 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-274c90e3-2334-41a1-af32-3ebc596333ac tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:29.683746 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-274c90e3-2334-41a1-af32-3ebc596333ac tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:29.684713 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-274c90e3-2334-41a1-af32-3ebc596333ac tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:29.701604 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ff72ce62-72ff-4906-8a6f-923502b98944 tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc0782a98aca44f18bf86a9f6ad5eb60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d547fc8e53d43888e35c3e8ef5caada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:29.727372 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ff72ce62-72ff-4906-8a6f-923502b98944 tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] 10.222.0.17 "GET /compute/v2.1/servers/a053bb4d-aaa2-4f14-bb62-5623ef5448aa" status: 200 len: 1492 microversion: 2.1 time: 0.177052 Jul 23 21:31:29.729290 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2097/4296] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:29 2022] GET /compute/v2.1/servers/a053bb4d-aaa2-4f14-bb62-5623ef5448aa => generated 1492 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:31:29.736500 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f3ee5fa0-79c5-49c1-b58b-4b060e0cc625 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:29.737636 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f3ee5fa0-79c5-49c1-b58b-4b060e0cc625 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] [instance: 5cb6a473-80fe-4569-bd9a-52511d3b81aa] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:29.768029 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f3ee5fa0-79c5-49c1-b58b-4b060e0cc625 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:29.771587 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f3ee5fa0-79c5-49c1-b58b-4b060e0cc625 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:29.776759 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f3ee5fa0-79c5-49c1-b58b-4b060e0cc625 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:29.777696 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f3ee5fa0-79c5-49c1-b58b-4b060e0cc625 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:29.869646 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f3ee5fa0-79c5-49c1-b58b-4b060e0cc625 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:29.886905 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f3ee5fa0-79c5-49c1-b58b-4b060e0cc625 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:29.891070 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f3ee5fa0-79c5-49c1-b58b-4b060e0cc625 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:29.892725 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f3ee5fa0-79c5-49c1-b58b-4b060e0cc625 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] 10.222.0.17 "GET /compute/v2.1/servers/5cb6a473-80fe-4569-bd9a-52511d3b81aa" status: 200 len: 1364 microversion: 2.47 time: 0.161545 Jul 23 21:31:29.894017 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2098/4297] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:31:29 2022] GET /compute/v2.1/servers/5cb6a473-80fe-4569-bd9a-52511d3b81aa => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:31:30.041923 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-56e4bf01-dfd3-4ced-b2c0-9cc2579f9c02 req-8cf8fc87-3405-4759-b050-adf19ae9e413 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a053bb4d-aaa2-4f14-bb62-5623ef5448aa", "name": "network-vif-deleted", "tag": "dc3c2b67-c0b1-4e25-8f1d-3348a9b8ff05"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:31:30.058225 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-56e4bf01-dfd3-4ced-b2c0-9cc2579f9c02 req-8cf8fc87-3405-4759-b050-adf19ae9e413 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:30.058978 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-56e4bf01-dfd3-4ced-b2c0-9cc2579f9c02 req-8cf8fc87-3405-4759-b050-adf19ae9e413 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:30.078079 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-56e4bf01-dfd3-4ced-b2c0-9cc2579f9c02 req-8cf8fc87-3405-4759-b050-adf19ae9e413 service nova] Creating event network-vif-deleted:dc3c2b67-c0b1-4e25-8f1d-3348a9b8ff05 for instance a053bb4d-aaa2-4f14-bb62-5623ef5448aa on nch2-master-1 Jul 23 21:31:30.087885 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-56e4bf01-dfd3-4ced-b2c0-9cc2579f9c02 req-8cf8fc87-3405-4759-b050-adf19ae9e413 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055305 Jul 23 21:31:30.088515 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2099/4298] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:31:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:31:30.135786 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-bed99f89-83d5-4dc7-9016-b22cbb3d1fe2 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:30.136499 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-bed99f89-83d5-4dc7-9016-b22cbb3d1fe2 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: b83d31c6-561b-47f9-a17b-377c54728c08] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:30.144668 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bed99f89-83d5-4dc7-9016-b22cbb3d1fe2 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:30.145908 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bed99f89-83d5-4dc7-9016-b22cbb3d1fe2 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:30.146740 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bed99f89-83d5-4dc7-9016-b22cbb3d1fe2 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:30.147528 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bed99f89-83d5-4dc7-9016-b22cbb3d1fe2 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:30.185665 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-274c90e3-2334-41a1-af32-3ebc596333ac tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:30.198751 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-274c90e3-2334-41a1-af32-3ebc596333ac tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1505 microversion: 2.1 time: 0.559288 Jul 23 21:31:30.201093 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2200/4299] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:29 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1505 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:30.220542 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-b8e43cf4-6061-4efe-a1c8-2c5b1ad3c6bb tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:31:30.221635 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-b8e43cf4-6061-4efe-a1c8-2c5b1ad3c6bb tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: e1026e09-52e8-44d8-8826-517853ce61be] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:30.233250 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-b8e43cf4-6061-4efe-a1c8-2c5b1ad3c6bb tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] HTTP exception thrown: Instance e1026e09-52e8-44d8-8826-517853ce61be could not be found. Jul 23 21:31:30.247129 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-b8e43cf4-6061-4efe-a1c8-2c5b1ad3c6bb tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Request method failure captured: Jul 23 21:31:30.247129 ncdv-master-1 devstack@n-api.service[131321]: request: POST /compute/v2.1/servers/e1026e09-52e8-44d8-8826-517853ce61be/action HTTP/1.1 Jul 23 21:31:30.247129 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:31:30.247129 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:31:30.247129 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:31:30.247129 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 39 Jul 23 21:31:30.247129 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:31:30.247129 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:31:30.247129 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:31:30.247129 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:31:30.247129 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3Ghf1JjZ4k8tVzERRK8IkLpluLUwa9k5Rz-X0dEr2p4_7xl_eBekUiNk1RZEGsFdGEiApbLOfcuSifirvwiKV1QOTaKdXKwfMnwZgdfagxJjoe3dPYUa3b-d3rVTYewIN_YoX2mMGGBMWRa3po8WOCVIc6hXJLExzq_ndbcO7U8NQBI Jul 23 21:31:30.247129 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:31:30.247129 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:31:30.247129 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:31:30.247129 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:31:30.247129 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:31:30.247129 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:31:30.247129 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: d70f6c96e1ad484aa3207fc01a12d519 Jul 23 21:31:30.247129 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:31:30.247129 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:31:30.247129 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:31:30.247129 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d70f6c96e1ad484aa3207fc01a12d519"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d70f6c96e1ad484aa3207fc01a12d519"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d70f6c96e1ad484aa3207fc01a12d519", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d70f6c96e1ad484aa3207fc01a12d519"}]}] Jul 23 21:31:30.247129 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:31:30.247129 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: d70f6c96e1ad484aa3207fc01a12d519 Jul 23 21:31:30.247129 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:31:30.247129 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ServersNegativeTestJSON-1106538570-project Jul 23 21:31:30.247129 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:31:30.247129 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:31:30.247129 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 6ca9644a73d9468aa39b21548a72bded Jul 23 21:31:30.247129 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ServersNegativeTestJSON-1106538570-project Jul 23 21:31:30.247129 ncdv-master-1 devstack@n-api.service[131321]: Jul 23 21:31:30.247129 ncdv-master-1 devstack@n-api.service[131321]: {"os-getConsoleOutput": {"length": 10}} Jul 23 21:31:30.247129 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:31:30.247129 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance e1026e09-52e8-44d8-8826-517853ce61be could not be found. Jul 23 21:31:30.247129 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': 'e1026e09-52e8-44d8-8826-517853ce61be', 'body': {'os-getConsoleOutput': {'length': 10}}} Jul 23 21:31:30.247129 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:31:30.247129 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:30.247129 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:31:30.247129 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:31:30.247129 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:31:30.247129 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:31:30.247129 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 23 21:31:30.247129 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 23 21:31:30.247129 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1026e09-52e8-44d8-8826-517853ce61be could not be found. Jul 23 21:31:30.247129 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:30.247129 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:31:30.247129 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:30.247129 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:30.247129 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:31:30.247129 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:31:30.247129 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:31:30.247129 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:31:30.247129 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:31:30.247129 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:31:30.247129 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:31:30.247129 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:31:30.247129 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Jul 23 21:31:30.247129 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 23 21:31:30.247129 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:31:30.247129 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:31:30.247129 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1026e09-52e8-44d8-8826-517853ce61be could not be found. Jul 23 21:31:30.247129 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:30.247129 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:31:30.247129 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:30.247129 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:30.251341 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:31:30.251341 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:31:30.251341 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:31:30.251341 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:31:30.251341 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1026e09-52e8-44d8-8826-517853ce61be could not be found. Jul 23 21:31:30.251341 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:30.256695 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-b8e43cf4-6061-4efe-a1c8-2c5b1ad3c6bb tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Returning 404 to user: Instance e1026e09-52e8-44d8-8826-517853ce61be could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:31:30.257766 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-b8e43cf4-6061-4efe-a1c8-2c5b1ad3c6bb tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "POST /compute/v2.1/servers/e1026e09-52e8-44d8-8826-517853ce61be/action" status: 404 len: 111 microversion: 2.1 time: 0.041222 Jul 23 21:31:30.258500 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2201/4300] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:31:30 2022] POST /compute/v2.1/servers/e1026e09-52e8-44d8-8826-517853ce61be/action => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:31:30.268383 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-85e20d86-6e79-4a5c-879d-ead563323678 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:30.269176 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-85e20d86-6e79-4a5c-879d-ead563323678 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:30.277104 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-85e20d86-6e79-4a5c-879d-ead563323678 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:30.277606 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-85e20d86-6e79-4a5c-879d-ead563323678 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:30.278423 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-85e20d86-6e79-4a5c-879d-ead563323678 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:30.279018 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-85e20d86-6e79-4a5c-879d-ead563323678 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:30.322228 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-bed99f89-83d5-4dc7-9016-b22cbb3d1fe2 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:30.330240 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-bed99f89-83d5-4dc7-9016-b22cbb3d1fe2 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/b83d31c6-561b-47f9-a17b-377c54728c08" status: 200 len: 1309 microversion: 2.1 time: 0.198766 Jul 23 21:31:30.330963 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2100/4301] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:30 2022] GET /compute/v2.1/servers/b83d31c6-561b-47f9-a17b-377c54728c08 => generated 1309 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:31:30.335593 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e7a4581f-1756-4725-a959-83d375948bf7 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:30.336442 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e7a4581f-1756-4725-a959-83d375948bf7 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:30.344404 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e7a4581f-1756-4725-a959-83d375948bf7 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:30.344857 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e7a4581f-1756-4725-a959-83d375948bf7 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:30.345675 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e7a4581f-1756-4725-a959-83d375948bf7 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:30.346149 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e7a4581f-1756-4725-a959-83d375948bf7 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:30.432787 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e7a4581f-1756-4725-a959-83d375948bf7 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:30.445371 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e7a4581f-1756-4725-a959-83d375948bf7 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:30.446987 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e7a4581f-1756-4725-a959-83d375948bf7 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:30.448403 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e7a4581f-1756-4725-a959-83d375948bf7 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.116309 Jul 23 21:31:30.449077 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2101/4302] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:31:30 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:31:30.453799 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-977d0518-7fd0-4aab-a482-ced46db314b0 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:30.454777 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-977d0518-7fd0-4aab-a482-ced46db314b0 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] [instance: 1f5b9a5a-109e-48b5-adc1-113384944dce] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:30.461251 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-977d0518-7fd0-4aab-a482-ced46db314b0 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:30.461935 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-977d0518-7fd0-4aab-a482-ced46db314b0 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:30.462716 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-977d0518-7fd0-4aab-a482-ced46db314b0 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:30.463153 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-977d0518-7fd0-4aab-a482-ced46db314b0 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:30.468473 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=100 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:31:30.509236 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-85e20d86-6e79-4a5c-879d-ead563323678 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:30.527844 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-85e20d86-6e79-4a5c-879d-ead563323678 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1505 microversion: 2.1 time: 0.264233 Jul 23 21:31:30.530741 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2202/4303] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:30 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1505 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:30.550707 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-6c7bf7b4-ee3a-4a46-8f9c-0095c8786691 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:30.551516 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-6c7bf7b4-ee3a-4a46-8f9c-0095c8786691 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:30.562660 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6c7bf7b4-ee3a-4a46-8f9c-0095c8786691 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:30.563059 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6c7bf7b4-ee3a-4a46-8f9c-0095c8786691 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:30.563856 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6c7bf7b4-ee3a-4a46-8f9c-0095c8786691 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:30.564297 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6c7bf7b4-ee3a-4a46-8f9c-0095c8786691 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:30.772966 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-977d0518-7fd0-4aab-a482-ced46db314b0 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd49331138a4dbc912bc7bf6f6b0215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842a1aca542f416eab5d43b881325917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:30.782999 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-977d0518-7fd0-4aab-a482-ced46db314b0 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] 10.222.0.17 "GET /compute/v2.1/servers/1f5b9a5a-109e-48b5-adc1-113384944dce" status: 200 len: 1469 microversion: 2.1 time: 0.332211 Jul 23 21:31:30.783932 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2102/4304] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:30 2022] GET /compute/v2.1/servers/1f5b9a5a-109e-48b5-adc1-113384944dce => generated 1469 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:30.789788 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e079980b-cc7e-45cd-9fa0-df752fb987f4 tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:30.790435 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e079980b-cc7e-45cd-9fa0-df752fb987f4 tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] [instance: a053bb4d-aaa2-4f14-bb62-5623ef5448aa] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:30.797913 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e079980b-cc7e-45cd-9fa0-df752fb987f4 tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:30.798652 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e079980b-cc7e-45cd-9fa0-df752fb987f4 tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:30.799621 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e079980b-cc7e-45cd-9fa0-df752fb987f4 tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:30.800249 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e079980b-cc7e-45cd-9fa0-df752fb987f4 tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:30.868182 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e079980b-cc7e-45cd-9fa0-df752fb987f4 tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:30.868852 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e079980b-cc7e-45cd-9fa0-df752fb987f4 tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:30.870125 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.objects.instance [None req-e079980b-cc7e-45cd-9fa0-df752fb987f4 tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Lazy-loading 'fault' on Instance uuid a053bb4d-aaa2-4f14-bb62-5623ef5448aa {{(pid=131320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:31:30.940192 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e079980b-cc7e-45cd-9fa0-df752fb987f4 tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc0782a98aca44f18bf86a9f6ad5eb60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d547fc8e53d43888e35c3e8ef5caada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:30.955374 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e079980b-cc7e-45cd-9fa0-df752fb987f4 tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] 10.222.0.17 "GET /compute/v2.1/servers/a053bb4d-aaa2-4f14-bb62-5623ef5448aa" status: 200 len: 1318 microversion: 2.1 time: 0.169826 Jul 23 21:31:30.956297 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2103/4305] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:30 2022] GET /compute/v2.1/servers/a053bb4d-aaa2-4f14-bb62-5623ef5448aa => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:30.962918 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c85fe79d-e25d-47db-a112-f587db85f797 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:30.964695 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c85fe79d-e25d-47db-a112-f587db85f797 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] [instance: 5cb6a473-80fe-4569-bd9a-52511d3b81aa] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:30.974924 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c85fe79d-e25d-47db-a112-f587db85f797 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:30.975630 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c85fe79d-e25d-47db-a112-f587db85f797 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:30.976450 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c85fe79d-e25d-47db-a112-f587db85f797 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:30.977076 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c85fe79d-e25d-47db-a112-f587db85f797 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:31.020711 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-6c7bf7b4-ee3a-4a46-8f9c-0095c8786691 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:31.037357 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-6c7bf7b4-ee3a-4a46-8f9c-0095c8786691 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1505 microversion: 2.1 time: 0.491328 Jul 23 21:31:31.049507 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2203/4306] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:30 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1505 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:31:31.056758 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-fe859b16-6c7d-4494-850c-eafae27dcd94 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:31.057478 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-fe859b16-6c7d-4494-850c-eafae27dcd94 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: 307538e9-7579-41c9-84d8-27ddc6af904d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:31.062175 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c85fe79d-e25d-47db-a112-f587db85f797 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:31.076273 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-fe859b16-6c7d-4494-850c-eafae27dcd94 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] HTTP exception thrown: Instance 307538e9-7579-41c9-84d8-27ddc6af904d could not be found. Jul 23 21:31:31.078068 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-fe859b16-6c7d-4494-850c-eafae27dcd94 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Request method failure captured: Jul 23 21:31:31.078068 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/servers/307538e9-7579-41c9-84d8-27ddc6af904d HTTP/1.1 Jul 23 21:31:31.078068 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:31:31.078068 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:31:31.078068 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:31:31.078068 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:31:31.078068 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:31:31.078068 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:31:31.078068 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:31:31.078068 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:31:31.078068 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3Ghf1JjZ4k8tVzERRK8IkLpluLUwa9k5Rz-X0dEr2p4_7xl_eBekUiNk1RZEGsFdGEiApbLOfcuSifirvwiKV1QOTaKdXKwfMnwZgdfagxJjoe3dPYUa3b-d3rVTYewIN_YoX2mMGGBMWRa3po8WOCVIc6hXJLExzq_ndbcO7U8NQBI Jul 23 21:31:31.078068 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:31:31.078068 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:31:31.078068 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:31:31.078068 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:31:31.078068 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:31:31.078068 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:31:31.078068 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: d70f6c96e1ad484aa3207fc01a12d519 Jul 23 21:31:31.078068 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:31:31.078068 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:31:31.078068 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:31:31.078068 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d70f6c96e1ad484aa3207fc01a12d519"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d70f6c96e1ad484aa3207fc01a12d519"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d70f6c96e1ad484aa3207fc01a12d519", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d70f6c96e1ad484aa3207fc01a12d519"}]}] Jul 23 21:31:31.078068 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:31:31.078068 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: d70f6c96e1ad484aa3207fc01a12d519 Jul 23 21:31:31.078068 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:31:31.078068 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ServersNegativeTestJSON-1106538570-project Jul 23 21:31:31.078068 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:31:31.078068 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:31:31.078068 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 6ca9644a73d9468aa39b21548a72bded Jul 23 21:31:31.078068 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ServersNegativeTestJSON-1106538570-project Jul 23 21:31:31.078068 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:31:31.078068 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance 307538e9-7579-41c9-84d8-27ddc6af904d could not be found. Jul 23 21:31:31.078068 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': '307538e9-7579-41c9-84d8-27ddc6af904d'} Jul 23 21:31:31.078068 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:31:31.078068 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:31.078068 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:31:31.078068 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:31:31.078068 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:31:31.078068 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:31:31.078068 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 23 21:31:31.078068 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 23 21:31:31.078068 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 307538e9-7579-41c9-84d8-27ddc6af904d could not be found. Jul 23 21:31:31.078068 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:31.078068 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:31:31.078068 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:31.078068 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:31.078068 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:31:31.078068 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:31:31.078068 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:31:31.078068 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:31:31.078068 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:31:31.078068 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:31:31.078068 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:31:31.078068 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:31:31.078068 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:31:31.078068 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:31:31.078068 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:31:31.078068 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:31:31.078068 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 307538e9-7579-41c9-84d8-27ddc6af904d could not be found. Jul 23 21:31:31.078068 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:31.078068 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:31:31.078068 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:31.078068 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:31.078068 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:31:31.082119 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:31:31.082119 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:31:31.082119 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:31:31.082119 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 307538e9-7579-41c9-84d8-27ddc6af904d could not be found. Jul 23 21:31:31.082119 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:31.084231 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-fe859b16-6c7d-4494-850c-eafae27dcd94 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Returning 404 to user: Instance 307538e9-7579-41c9-84d8-27ddc6af904d could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:31:31.085442 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-fe859b16-6c7d-4494-850c-eafae27dcd94 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/307538e9-7579-41c9-84d8-27ddc6af904d" status: 404 len: 111 microversion: 2.1 time: 0.034118 Jul 23 21:31:31.089724 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2204/4307] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:31 2022] GET /compute/v2.1/servers/307538e9-7579-41c9-84d8-27ddc6af904d => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 23 21:31:31.096175 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ce6ca6f4-7350-46fd-8147-0f909420a1f0 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:31.097528 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-ce6ca6f4-7350-46fd-8147-0f909420a1f0 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:31.099453 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c85fe79d-e25d-47db-a112-f587db85f797 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:31.107412 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ce6ca6f4-7350-46fd-8147-0f909420a1f0 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:31.108343 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ce6ca6f4-7350-46fd-8147-0f909420a1f0 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:31.109746 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ce6ca6f4-7350-46fd-8147-0f909420a1f0 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:31.110562 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ce6ca6f4-7350-46fd-8147-0f909420a1f0 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:31.110672 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c85fe79d-e25d-47db-a112-f587db85f797 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:31.114809 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c85fe79d-e25d-47db-a112-f587db85f797 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] 10.222.0.17 "GET /compute/v2.1/servers/5cb6a473-80fe-4569-bd9a-52511d3b81aa" status: 200 len: 1364 microversion: 2.47 time: 0.156281 Jul 23 21:31:31.122458 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2104/4308] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:31:30 2022] GET /compute/v2.1/servers/5cb6a473-80fe-4569-bd9a-52511d3b81aa => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:31:31.347640 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d5910224-8f77-453a-8dca-cadcae2e7e5e tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:31.348268 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d5910224-8f77-453a-8dca-cadcae2e7e5e tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: b83d31c6-561b-47f9-a17b-377c54728c08] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:31.351462 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:31:31.352147 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=6 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:31:31.369775 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d5910224-8f77-453a-8dca-cadcae2e7e5e tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:31.369775 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d5910224-8f77-453a-8dca-cadcae2e7e5e tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:31.369775 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d5910224-8f77-453a-8dca-cadcae2e7e5e tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:31.370559 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d5910224-8f77-453a-8dca-cadcae2e7e5e tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:31.425202 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ce6ca6f4-7350-46fd-8147-0f909420a1f0 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:31.432967 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-ce6ca6f4-7350-46fd-8147-0f909420a1f0 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1505 microversion: 2.1 time: 0.341628 Jul 23 21:31:31.446524 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2205/4309] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:31 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1505 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:31.453027 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-df012247-8e60-443e-a31d-fabad56db190 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:31.453853 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-df012247-8e60-443e-a31d-fabad56db190 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:31.461195 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-df012247-8e60-443e-a31d-fabad56db190 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:31.461962 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-df012247-8e60-443e-a31d-fabad56db190 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:31.463204 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-df012247-8e60-443e-a31d-fabad56db190 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:31.463813 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-df012247-8e60-443e-a31d-fabad56db190 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:31.630318 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d5910224-8f77-453a-8dca-cadcae2e7e5e tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:31.643265 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d5910224-8f77-453a-8dca-cadcae2e7e5e tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/b83d31c6-561b-47f9-a17b-377c54728c08" status: 200 len: 1309 microversion: 2.1 time: 0.299534 Jul 23 21:31:31.643887 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2105/4310] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:31 2022] GET /compute/v2.1/servers/b83d31c6-561b-47f9-a17b-377c54728c08 => generated 1309 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:31:31.659208 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f14d6b87-9ce9-435a-b723-0d5f489e077c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:31.660370 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f14d6b87-9ce9-435a-b723-0d5f489e077c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:31.670840 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f14d6b87-9ce9-435a-b723-0d5f489e077c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:31.671656 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f14d6b87-9ce9-435a-b723-0d5f489e077c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:31.672676 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f14d6b87-9ce9-435a-b723-0d5f489e077c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:31.673336 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f14d6b87-9ce9-435a-b723-0d5f489e077c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:31.760057 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f14d6b87-9ce9-435a-b723-0d5f489e077c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:31.771503 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f14d6b87-9ce9-435a-b723-0d5f489e077c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:31.773818 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f14d6b87-9ce9-435a-b723-0d5f489e077c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:31.775387 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f14d6b87-9ce9-435a-b723-0d5f489e077c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.130137 Jul 23 21:31:31.776733 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2106/4311] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:31:31 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:31:31.804033 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-59c74dca-0444-4538-ac9c-21542f93c075 req-c882668a-168e-42d9-8e49-6239922eff9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b83d31c6-561b-47f9-a17b-377c54728c08", "tag": "a266c338-dcaf-437b-942e-26c032063e60"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:31:31.819304 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-df012247-8e60-443e-a31d-fabad56db190 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:31.829187 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-59c74dca-0444-4538-ac9c-21542f93c075 req-c882668a-168e-42d9-8e49-6239922eff9d service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:31.829187 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-59c74dca-0444-4538-ac9c-21542f93c075 req-c882668a-168e-42d9-8e49-6239922eff9d service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:31.840961 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-df012247-8e60-443e-a31d-fabad56db190 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1505 microversion: 2.1 time: 0.383002 Jul 23 21:31:31.843206 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-59c74dca-0444-4538-ac9c-21542f93c075 req-c882668a-168e-42d9-8e49-6239922eff9d service nova] Creating event network-changed:a266c338-dcaf-437b-942e-26c032063e60 for instance b83d31c6-561b-47f9-a17b-377c54728c08 on nch1-master-1 Jul 23 21:31:31.848863 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-59c74dca-0444-4538-ac9c-21542f93c075 req-c882668a-168e-42d9-8e49-6239922eff9d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052943 Jul 23 21:31:31.850074 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2107/4312] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:31:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:31:31.856360 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1ee875e2-ee2f-4339-9064-ed7ce590a41c tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:31.856718 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2206/4313] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:31 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1505 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:31:31.857076 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1ee875e2-ee2f-4339-9064-ed7ce590a41c tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] [instance: 1f5b9a5a-109e-48b5-adc1-113384944dce] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:31.864874 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1ee875e2-ee2f-4339-9064-ed7ce590a41c tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:31.865484 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1ee875e2-ee2f-4339-9064-ed7ce590a41c tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:31.866586 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1ee875e2-ee2f-4339-9064-ed7ce590a41c tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:31.867179 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1ee875e2-ee2f-4339-9064-ed7ce590a41c tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:31.910843 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-03ca5f5f-762d-4664-a108-7665eeea353f tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-814724189", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "654a77ca-1e84-434d-8536-1fc3adb327d0"}]}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:31:31.913952 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-03ca5f5f-762d-4664-a108-7665eeea353f tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Request method failure captured: Jul 23 21:31:31.913952 ncdv-master-1 devstack@n-api.service[131321]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 23 21:31:31.913952 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:31:31.913952 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:31:31.913952 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:31:31.913952 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 237 Jul 23 21:31:31.913952 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:31:31.913952 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:31:31.913952 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:31:31.913952 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:31:31.913952 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3Ghf1JjZ4k8tVzERRK8IkLpluLUwa9k5Rz-X0dEr2p4_7xl_eBekUiNk1RZEGsFdGEiApbLOfcuSifirvwiKV1QOTaKdXKwfMnwZgdfagxJjoe3dPYUa3b-d3rVTYewIN_YoX2mMGGBMWRa3po8WOCVIc6hXJLExzq_ndbcO7U8NQBI Jul 23 21:31:31.913952 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:31:31.913952 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:31:31.913952 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:31:31.913952 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:31:31.913952 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:31:31.913952 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:31:31.913952 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: d70f6c96e1ad484aa3207fc01a12d519 Jul 23 21:31:31.913952 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:31:31.913952 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:31:31.913952 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:31:31.913952 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d70f6c96e1ad484aa3207fc01a12d519"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d70f6c96e1ad484aa3207fc01a12d519"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d70f6c96e1ad484aa3207fc01a12d519", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d70f6c96e1ad484aa3207fc01a12d519"}]}] Jul 23 21:31:31.913952 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:31:31.913952 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: d70f6c96e1ad484aa3207fc01a12d519 Jul 23 21:31:31.913952 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:31:31.913952 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ServersNegativeTestJSON-1106538570-project Jul 23 21:31:31.913952 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:31:31.913952 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:31:31.913952 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 6ca9644a73d9468aa39b21548a72bded Jul 23 21:31:31.913952 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ServersNegativeTestJSON-1106538570-project Jul 23 21:31:31.913952 ncdv-master-1 devstack@n-api.service[131321]: Jul 23 21:31:31.913952 ncdv-master-1 devstack@n-api.service[131321]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-814724189", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "654a77ca-1e84-434d-8536-1fc3adb327d0"}]}} Jul 23 21:31:31.913952 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:31:31.913952 ncdv-master-1 devstack@n-api.service[131321]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Jul 23 21:31:31.913952 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-814724189', 'imageRef': 'b27b20aa-ef1b-4dd1-989e-321af6343d6a', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '654a77ca-1e84-434d-8536-1fc3adb327d0'}]}}} Jul 23 21:31:31.913952 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:31:31.913952 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:31.913952 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 23 21:31:31.913952 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 23 21:31:31.913952 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 23 21:31:31.913952 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise error Jul 23 21:31:31.913952 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Jul 23 21:31:31.913952 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:31.913952 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Jul 23 21:31:31.913952 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Jul 23 21:31:31.913952 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:31.913952 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 23 21:31:31.913952 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Jul 23 21:31:31.913952 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:31.913952 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:31:31.913952 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:31.913952 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:31.913952 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:31:31.913952 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:31:31.913952 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:31:31.913952 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:31:31.913952 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:31:31.913952 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:31:31.913952 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:31:31.913952 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:31:31.913952 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 23 21:31:31.913952 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 23 21:31:31.913952 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 23 21:31:31.913952 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 23 21:31:31.917532 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 23 21:31:31.917532 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 23 21:31:31.917532 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Jul 23 21:31:31.917532 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:31.917532 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:31:31.917532 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:31.917532 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:31.917532 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:31:31.917532 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:31:31.917532 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 23 21:31:31.917532 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 23 21:31:31.917532 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Jul 23 21:31:31.917532 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:31.921255 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-03ca5f5f-762d-4664-a108-7665eeea353f tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:31:31.922396 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-03ca5f5f-762d-4664-a108-7665eeea353f tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.015649 Jul 23 21:31:31.926856 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2207/4314] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:31:31 2022] POST /compute/v2.1/servers => generated 139 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 23 21:31:31.933324 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-510789f1-8b29-406c-a6eb-d483a6034415 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:31.934388 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-510789f1-8b29-406c-a6eb-d483a6034415 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:31.944560 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-510789f1-8b29-406c-a6eb-d483a6034415 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:31.945353 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-510789f1-8b29-406c-a6eb-d483a6034415 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:31.946367 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-510789f1-8b29-406c-a6eb-d483a6034415 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:31.946814 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-510789f1-8b29-406c-a6eb-d483a6034415 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:32.052803 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-1ee875e2-ee2f-4339-9064-ed7ce590a41c tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd49331138a4dbc912bc7bf6f6b0215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842a1aca542f416eab5d43b881325917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:32.065072 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1ee875e2-ee2f-4339-9064-ed7ce590a41c tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] 10.222.0.17 "GET /compute/v2.1/servers/1f5b9a5a-109e-48b5-adc1-113384944dce" status: 200 len: 1469 microversion: 2.1 time: 0.213495 Jul 23 21:31:32.075550 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2108/4315] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:31 2022] GET /compute/v2.1/servers/1f5b9a5a-109e-48b5-adc1-113384944dce => generated 1469 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:32.082613 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f879fc8b-d27d-4557-8932-986aa8940b18 tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:32.083319 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f879fc8b-d27d-4557-8932-986aa8940b18 tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] [instance: a053bb4d-aaa2-4f14-bb62-5623ef5448aa] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:32.091040 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f879fc8b-d27d-4557-8932-986aa8940b18 tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:32.091672 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f879fc8b-d27d-4557-8932-986aa8940b18 tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:32.092482 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f879fc8b-d27d-4557-8932-986aa8940b18 tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:32.093113 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f879fc8b-d27d-4557-8932-986aa8940b18 tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:32.110938 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-f879fc8b-d27d-4557-8932-986aa8940b18 tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] HTTP exception thrown: Instance a053bb4d-aaa2-4f14-bb62-5623ef5448aa could not be found. Jul 23 21:31:32.112671 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f879fc8b-d27d-4557-8932-986aa8940b18 tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Request method failure captured: Jul 23 21:31:32.112671 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/a053bb4d-aaa2-4f14-bb62-5623ef5448aa HTTP/1.1 Jul 23 21:31:32.112671 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:31:32.112671 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:31:32.112671 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:31:32.112671 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:31:32.112671 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:31:32.112671 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:31:32.112671 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:31:32.112671 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:31:32.112671 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GiDzLdftJ39qIa9R_rRCaoAJzbq79xQ-deA9gQCELruDpoZCN-v1qjpCyNE00aZDs5vVo31SP1AJEzfdLKdsemqR5MbnjdqJByIBOZHFSQiBCbllF1y-Mh034EGC1o_xg5Jhs1s5x6D-Aosi34cuQ6m7FRDAOIc2ag_KjF5bXWlIv8 Jul 23 21:31:32.112671 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:31:32.112671 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:31:32.112671 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:31:32.112671 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:31:32.112671 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:31:32.112671 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:31:32.112671 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 3d547fc8e53d43888e35c3e8ef5caada Jul 23 21:31:32.112671 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1725354656 Jul 23 21:31:32.112671 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:31:32.112671 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:31:32.112671 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3d547fc8e53d43888e35c3e8ef5caada"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3d547fc8e53d43888e35c3e8ef5caada"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3d547fc8e53d43888e35c3e8ef5caada", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3d547fc8e53d43888e35c3e8ef5caada"}]}] Jul 23 21:31:32.112671 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1725354656 Jul 23 21:31:32.112671 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 3d547fc8e53d43888e35c3e8ef5caada Jul 23 21:31:32.112671 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1725354656 Jul 23 21:31:32.112671 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1725354656-project Jul 23 21:31:32.112671 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:31:32.112671 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:31:32.112671 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: fc0782a98aca44f18bf86a9f6ad5eb60 Jul 23 21:31:32.112671 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1725354656-project Jul 23 21:31:32.112671 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:31:32.112671 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance a053bb4d-aaa2-4f14-bb62-5623ef5448aa could not be found. Jul 23 21:31:32.112671 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': 'a053bb4d-aaa2-4f14-bb62-5623ef5448aa'} Jul 23 21:31:32.112671 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:31:32.112671 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:32.112671 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:31:32.112671 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:31:32.112671 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:31:32.112671 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:31:32.112671 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:31:32.112671 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:31:32.112671 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:31:32.112671 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:31:32.112671 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a053bb4d-aaa2-4f14-bb62-5623ef5448aa could not be found. Jul 23 21:31:32.112671 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:31:32.112671 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:31:32.112671 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:31:32.112671 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:32.112671 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:31:32.112671 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:31:32.112671 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:31:32.112671 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:31:32.112671 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:31:32.112671 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:31:32.112671 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:31:32.112671 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:31:32.112671 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:31:32.112671 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:31:32.112671 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:31:32.112671 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:31:32.112671 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a053bb4d-aaa2-4f14-bb62-5623ef5448aa could not be found. Jul 23 21:31:32.112671 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:31:32.119226 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:31:32.119226 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:31:32.119226 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:32.119226 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:31:32.119226 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:31:32.119226 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:31:32.119226 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:31:32.119226 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a053bb4d-aaa2-4f14-bb62-5623ef5448aa could not be found. Jul 23 21:31:32.119226 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:31:32.121335 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f879fc8b-d27d-4557-8932-986aa8940b18 tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] Returning 404 to user: Instance a053bb4d-aaa2-4f14-bb62-5623ef5448aa could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:31:32.122479 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f879fc8b-d27d-4557-8932-986aa8940b18 tempest-ServersNegativeTestMultiTenantJSON-1725354656 tempest-ServersNegativeTestMultiTenantJSON-1725354656-project] 10.222.0.17 "GET /compute/v2.1/servers/a053bb4d-aaa2-4f14-bb62-5623ef5448aa" status: 404 len: 111 microversion: 2.1 time: 0.045780 Jul 23 21:31:32.123270 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2109/4316] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:32 2022] GET /compute/v2.1/servers/a053bb4d-aaa2-4f14-bb62-5623ef5448aa => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:31:32.140418 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-fe059a81-afcb-4f4b-bbd5-e00c8586bad7 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:32.141044 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-fe059a81-afcb-4f4b-bbd5-e00c8586bad7 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] [instance: 5cb6a473-80fe-4569-bd9a-52511d3b81aa] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:32.155844 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fe059a81-afcb-4f4b-bbd5-e00c8586bad7 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:32.156303 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fe059a81-afcb-4f4b-bbd5-e00c8586bad7 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:32.157278 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fe059a81-afcb-4f4b-bbd5-e00c8586bad7 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:32.157724 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fe059a81-afcb-4f4b-bbd5-e00c8586bad7 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:32.274213 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-fe059a81-afcb-4f4b-bbd5-e00c8586bad7 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:32.283850 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-fe059a81-afcb-4f4b-bbd5-e00c8586bad7 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:32.285618 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-fe059a81-afcb-4f4b-bbd5-e00c8586bad7 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:32.287317 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-fe059a81-afcb-4f4b-bbd5-e00c8586bad7 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] 10.222.0.17 "GET /compute/v2.1/servers/5cb6a473-80fe-4569-bd9a-52511d3b81aa" status: 200 len: 1364 microversion: 2.47 time: 0.151145 Jul 23 21:31:32.298969 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2110/4317] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:31:32 2022] GET /compute/v2.1/servers/5cb6a473-80fe-4569-bd9a-52511d3b81aa => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:31:32.343715 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-510789f1-8b29-406c-a6eb-d483a6034415 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:32.359763 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-510789f1-8b29-406c-a6eb-d483a6034415 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1505 microversion: 2.1 time: 0.431002 Jul 23 21:31:32.360360 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2208/4318] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:31 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1505 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:31:32.377704 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e04e32aa-c129-4c2d-ab05-4624e691c1be tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:32.378370 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e04e32aa-c129-4c2d-ab05-4624e691c1be tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:32.385400 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e04e32aa-c129-4c2d-ab05-4624e691c1be tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:32.385890 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e04e32aa-c129-4c2d-ab05-4624e691c1be tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:32.386767 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e04e32aa-c129-4c2d-ab05-4624e691c1be tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:32.387377 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e04e32aa-c129-4c2d-ab05-4624e691c1be tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:32.593710 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e04e32aa-c129-4c2d-ab05-4624e691c1be tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:32.623238 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e04e32aa-c129-4c2d-ab05-4624e691c1be tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1505 microversion: 2.1 time: 0.249580 Jul 23 21:31:32.627106 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2111/4319] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:32 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1505 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:32.663401 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-5269a926-d09f-408b-96df-f0a389e35e0d tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:32.664550 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-5269a926-d09f-408b-96df-f0a389e35e0d tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: b83d31c6-561b-47f9-a17b-377c54728c08] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:32.673049 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5269a926-d09f-408b-96df-f0a389e35e0d tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:32.673753 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5269a926-d09f-408b-96df-f0a389e35e0d tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:32.684326 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6682c049-8d2e-417d-a295-d11f503e7dff tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-203793388", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "654a77ca-1e84-434d-8536-1fc3adb327d0"}]}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:31:32.688099 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5269a926-d09f-408b-96df-f0a389e35e0d tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:32.689833 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5269a926-d09f-408b-96df-f0a389e35e0d tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:32.702522 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6682c049-8d2e-417d-a295-d11f503e7dff tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Request method failure captured: Jul 23 21:31:32.702522 ncdv-master-1 devstack@n-api.service[131320]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 23 21:31:32.702522 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:31:32.702522 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:31:32.702522 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:31:32.702522 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 234 Jul 23 21:31:32.702522 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:31:32.702522 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:31:32.702522 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:31:32.702522 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:31:32.702522 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3Ghf1JjZ4k8tVzERRK8IkLpluLUwa9k5Rz-X0dEr2p4_7xl_eBekUiNk1RZEGsFdGEiApbLOfcuSifirvwiKV1QOTaKdXKwfMnwZgdfagxJjoe3dPYUa3b-d3rVTYewIN_YoX2mMGGBMWRa3po8WOCVIc6hXJLExzq_ndbcO7U8NQBI Jul 23 21:31:32.702522 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:31:32.702522 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:31:32.702522 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:31:32.702522 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:31:32.702522 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:31:32.702522 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:31:32.702522 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: d70f6c96e1ad484aa3207fc01a12d519 Jul 23 21:31:32.702522 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:31:32.702522 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:31:32.702522 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:31:32.702522 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d70f6c96e1ad484aa3207fc01a12d519"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d70f6c96e1ad484aa3207fc01a12d519"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d70f6c96e1ad484aa3207fc01a12d519", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d70f6c96e1ad484aa3207fc01a12d519"}]}] Jul 23 21:31:32.702522 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:31:32.702522 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: d70f6c96e1ad484aa3207fc01a12d519 Jul 23 21:31:32.702522 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:31:32.702522 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServersNegativeTestJSON-1106538570-project Jul 23 21:31:32.702522 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:31:32.702522 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:31:32.702522 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 6ca9644a73d9468aa39b21548a72bded Jul 23 21:31:32.702522 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServersNegativeTestJSON-1106538570-project Jul 23 21:31:32.702522 ncdv-master-1 devstack@n-api.service[131320]: Jul 23 21:31:32.702522 ncdv-master-1 devstack@n-api.service[131320]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-203793388", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "654a77ca-1e84-434d-8536-1fc3adb327d0"}]}} Jul 23 21:31:32.702522 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:31:32.702522 ncdv-master-1 devstack@n-api.service[131320]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Jul 23 21:31:32.702522 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-203793388', 'imageRef': 'b27b20aa-ef1b-4dd1-989e-321af6343d6a', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '654a77ca-1e84-434d-8536-1fc3adb327d0'}]}}} Jul 23 21:31:32.702522 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:31:32.702522 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:32.702522 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 240, in check Jul 23 21:31:32.702522 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi result = func(instance) Jul 23 21:31:32.702522 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/_format.py", line 210, in is_ipv6 Jul 23 21:31:32.702522 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return socket.inet_pton(socket.AF_INET6, instance) Jul 23 21:31:32.702522 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi OSError: illegal IP address string passed to inet_pton Jul 23 21:31:32.702522 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:31:32.702522 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 23 21:31:32.702522 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:31:32.702522 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:32.702522 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 23 21:31:32.702522 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 23 21:31:32.702522 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 23 21:31:32.702522 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise error Jul 23 21:31:32.702522 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Jul 23 21:31:32.702522 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:31:32.702522 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Jul 23 21:31:32.702522 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Jul 23 21:31:32.702522 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:31:32.702522 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 23 21:31:32.702522 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi 'notvalid' Jul 23 21:31:32.702522 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:31:32.702522 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:31:32.702522 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:31:32.702522 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:32.702522 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:31:32.702522 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:31:32.702522 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:31:32.702522 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:31:32.706616 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:31:32.706616 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:31:32.706616 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:31:32.706616 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:31:32.706616 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 23 21:31:32.706616 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 23 21:31:32.706616 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 23 21:31:32.706616 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 23 21:31:32.706616 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 23 21:31:32.706616 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 23 21:31:32.706616 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Jul 23 21:31:32.706616 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:31:32.706616 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:31:32.706616 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:31:32.706616 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:32.706616 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:31:32.706616 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:31:32.706616 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 23 21:31:32.706616 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 23 21:31:32.706616 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Jul 23 21:31:32.706616 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:31:32.709413 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6682c049-8d2e-417d-a295-d11f503e7dff tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:31:32.710565 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6682c049-8d2e-417d-a295-d11f503e7dff tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.031236 Jul 23 21:31:32.711376 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2112/4320] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:31:32 2022] POST /compute/v2.1/servers => generated 133 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 23 21:31:32.727361 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5d452371-7fe2-447d-9c48-099e6087b58f tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:32.731398 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5d452371-7fe2-447d-9c48-099e6087b58f tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:32.747733 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5d452371-7fe2-447d-9c48-099e6087b58f tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:32.751550 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5d452371-7fe2-447d-9c48-099e6087b58f tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:32.768180 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5d452371-7fe2-447d-9c48-099e6087b58f tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:32.768974 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5d452371-7fe2-447d-9c48-099e6087b58f tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:32.950868 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-5269a926-d09f-408b-96df-f0a389e35e0d tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:32.958979 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-5269a926-d09f-408b-96df-f0a389e35e0d tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/b83d31c6-561b-47f9-a17b-377c54728c08" status: 200 len: 1309 microversion: 2.1 time: 0.300003 Jul 23 21:31:32.959678 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2209/4321] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:32 2022] GET /compute/v2.1/servers/b83d31c6-561b-47f9-a17b-377c54728c08 => generated 1309 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:32.964368 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-27254512-b5a0-4da6-8587-3afdd4cf969c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:32.965164 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-27254512-b5a0-4da6-8587-3afdd4cf969c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:32.971531 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-27254512-b5a0-4da6-8587-3afdd4cf969c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:32.971981 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-27254512-b5a0-4da6-8587-3afdd4cf969c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:32.972786 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-27254512-b5a0-4da6-8587-3afdd4cf969c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:32.973216 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-27254512-b5a0-4da6-8587-3afdd4cf969c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:33.037459 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-27254512-b5a0-4da6-8587-3afdd4cf969c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:33.047129 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-27254512-b5a0-4da6-8587-3afdd4cf969c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:33.048629 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-27254512-b5a0-4da6-8587-3afdd4cf969c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:33.050081 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-27254512-b5a0-4da6-8587-3afdd4cf969c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.089254 Jul 23 21:31:33.050648 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2210/4322] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:31:32 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:31:33.083392 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-bfba9a15-d807-4e18-97d5-b654eb63ec88 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:33.084374 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-bfba9a15-d807-4e18-97d5-b654eb63ec88 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] [instance: 1f5b9a5a-109e-48b5-adc1-113384944dce] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:33.091025 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bfba9a15-d807-4e18-97d5-b654eb63ec88 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:33.091819 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bfba9a15-d807-4e18-97d5-b654eb63ec88 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:33.092845 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bfba9a15-d807-4e18-97d5-b654eb63ec88 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:33.093507 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bfba9a15-d807-4e18-97d5-b654eb63ec88 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:33.262395 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-bfba9a15-d807-4e18-97d5-b654eb63ec88 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd49331138a4dbc912bc7bf6f6b0215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842a1aca542f416eab5d43b881325917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:33.266884 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=100 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:31:33.272072 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-bfba9a15-d807-4e18-97d5-b654eb63ec88 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] 10.222.0.17 "GET /compute/v2.1/servers/1f5b9a5a-109e-48b5-adc1-113384944dce" status: 200 len: 1469 microversion: 2.1 time: 0.192571 Jul 23 21:31:33.272746 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2211/4323] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:33 2022] GET /compute/v2.1/servers/1f5b9a5a-109e-48b5-adc1-113384944dce => generated 1469 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:31:33.306446 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e0f6d541-23cc-4a45-abe8-a83aa151f61c tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:33.307202 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-e0f6d541-23cc-4a45-abe8-a83aa151f61c tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] [instance: 5cb6a473-80fe-4569-bd9a-52511d3b81aa] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:33.314831 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e0f6d541-23cc-4a45-abe8-a83aa151f61c tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:33.315296 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e0f6d541-23cc-4a45-abe8-a83aa151f61c tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:33.316093 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e0f6d541-23cc-4a45-abe8-a83aa151f61c tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:33.316533 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e0f6d541-23cc-4a45-abe8-a83aa151f61c tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:33.383771 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-e0f6d541-23cc-4a45-abe8-a83aa151f61c tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:33.392625 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-e0f6d541-23cc-4a45-abe8-a83aa151f61c tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:33.394176 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-e0f6d541-23cc-4a45-abe8-a83aa151f61c tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:33.395405 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-e0f6d541-23cc-4a45-abe8-a83aa151f61c tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] 10.222.0.17 "GET /compute/v2.1/servers/5cb6a473-80fe-4569-bd9a-52511d3b81aa" status: 200 len: 1364 microversion: 2.47 time: 0.093649 Jul 23 21:31:33.396233 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2212/4324] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:31:33 2022] GET /compute/v2.1/servers/5cb6a473-80fe-4569-bd9a-52511d3b81aa => generated 1364 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:31:33.578454 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5d452371-7fe2-447d-9c48-099e6087b58f tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:33.589380 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5d452371-7fe2-447d-9c48-099e6087b58f tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1505 microversion: 2.1 time: 0.872657 Jul 23 21:31:33.602148 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2113/4325] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:32 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1505 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:33.608635 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-fa2c9932-9b33-4e4c-aa4b-be589f9cad9c tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:33.609474 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-fa2c9932-9b33-4e4c-aa4b-be589f9cad9c tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:33.616067 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fa2c9932-9b33-4e4c-aa4b-be589f9cad9c tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:33.616937 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fa2c9932-9b33-4e4c-aa4b-be589f9cad9c tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:33.617802 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fa2c9932-9b33-4e4c-aa4b-be589f9cad9c tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:33.618339 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fa2c9932-9b33-4e4c-aa4b-be589f9cad9c tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:33.755476 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-fa2c9932-9b33-4e4c-aa4b-be589f9cad9c tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:33.770046 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-fa2c9932-9b33-4e4c-aa4b-be589f9cad9c tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1505 microversion: 2.1 time: 0.166136 Jul 23 21:31:33.771596 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2213/4326] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:33 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1505 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:33.787216 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-cbda97a4-8e36-42f1-858e-7b167a083100 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:31:33.787979 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-cbda97a4-8e36-42f1-858e-7b167a083100 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: 1f4d3b86-205e-412d-a699-ed811093bc92] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:33.793704 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-cbda97a4-8e36-42f1-858e-7b167a083100 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] HTTP exception thrown: Instance 1f4d3b86-205e-412d-a699-ed811093bc92 could not be found. Jul 23 21:31:33.801066 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-cbda97a4-8e36-42f1-858e-7b167a083100 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Request method failure captured: Jul 23 21:31:33.801066 ncdv-master-1 devstack@n-api.service[131320]: request: POST /compute/v2.1/servers/1f4d3b86-205e-412d-a699-ed811093bc92/action HTTP/1.1 Jul 23 21:31:33.801066 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:31:33.801066 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:31:33.801066 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:31:33.801066 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 13 Jul 23 21:31:33.801066 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:31:33.801066 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:31:33.801066 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:31:33.801066 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:31:33.801066 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3Ghf1JjZ4k8tVzERRK8IkLpluLUwa9k5Rz-X0dEr2p4_7xl_eBekUiNk1RZEGsFdGEiApbLOfcuSifirvwiKV1QOTaKdXKwfMnwZgdfagxJjoe3dPYUa3b-d3rVTYewIN_YoX2mMGGBMWRa3po8WOCVIc6hXJLExzq_ndbcO7U8NQBI Jul 23 21:31:33.801066 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:31:33.801066 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:31:33.801066 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:31:33.801066 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:31:33.801066 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:31:33.801066 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:31:33.801066 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: d70f6c96e1ad484aa3207fc01a12d519 Jul 23 21:31:33.801066 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:31:33.801066 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:31:33.801066 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:31:33.801066 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d70f6c96e1ad484aa3207fc01a12d519"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d70f6c96e1ad484aa3207fc01a12d519"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d70f6c96e1ad484aa3207fc01a12d519", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d70f6c96e1ad484aa3207fc01a12d519"}]}] Jul 23 21:31:33.801066 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:31:33.801066 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: d70f6c96e1ad484aa3207fc01a12d519 Jul 23 21:31:33.801066 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:31:33.801066 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServersNegativeTestJSON-1106538570-project Jul 23 21:31:33.801066 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:31:33.801066 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:31:33.801066 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 6ca9644a73d9468aa39b21548a72bded Jul 23 21:31:33.801066 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServersNegativeTestJSON-1106538570-project Jul 23 21:31:33.801066 ncdv-master-1 devstack@n-api.service[131320]: Jul 23 21:31:33.801066 ncdv-master-1 devstack@n-api.service[131320]: {"pause": {}} Jul 23 21:31:33.801066 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:31:33.801066 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance 1f4d3b86-205e-412d-a699-ed811093bc92 could not be found. Jul 23 21:31:33.801066 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '1f4d3b86-205e-412d-a699-ed811093bc92', 'body': {'pause': {}}} Jul 23 21:31:33.801066 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:31:33.801066 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:33.801066 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:31:33.801066 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:31:33.801066 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:31:33.801066 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:31:33.801066 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 23 21:31:33.801066 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 23 21:31:33.801066 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f4d3b86-205e-412d-a699-ed811093bc92 could not be found. Jul 23 21:31:33.801066 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:31:33.801066 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:31:33.801066 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:31:33.801066 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:33.801066 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:31:33.801066 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:31:33.801066 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:31:33.801066 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:31:33.801066 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:31:33.801066 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:31:33.801066 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Jul 23 21:31:33.801066 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Jul 23 21:31:33.801066 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:31:33.801066 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:31:33.801066 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f4d3b86-205e-412d-a699-ed811093bc92 could not be found. Jul 23 21:31:33.801066 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:31:33.801066 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:31:33.801066 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:31:33.801066 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:33.801066 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:31:33.801066 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:31:33.805751 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:31:33.805751 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:31:33.805751 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f4d3b86-205e-412d-a699-ed811093bc92 could not be found. Jul 23 21:31:33.805751 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:31:33.805751 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-cbda97a4-8e36-42f1-858e-7b167a083100 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Returning 404 to user: Instance 1f4d3b86-205e-412d-a699-ed811093bc92 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:31:33.805751 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-cbda97a4-8e36-42f1-858e-7b167a083100 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "POST /compute/v2.1/servers/1f4d3b86-205e-412d-a699-ed811093bc92/action" status: 404 len: 111 microversion: 2.1 time: 0.019545 Jul 23 21:31:33.812205 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-088b47f2-88c4-47ad-a41d-4ff61aee373b tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:33.812814 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-088b47f2-88c4-47ad-a41d-4ff61aee373b tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:33.814969 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2114/4327] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:31:33 2022] POST /compute/v2.1/servers/1f4d3b86-205e-412d-a699-ed811093bc92/action => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 23 21:31:33.823457 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-088b47f2-88c4-47ad-a41d-4ff61aee373b tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:33.826638 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-088b47f2-88c4-47ad-a41d-4ff61aee373b tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:33.827719 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-088b47f2-88c4-47ad-a41d-4ff61aee373b tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:33.828692 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-088b47f2-88c4-47ad-a41d-4ff61aee373b tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:33.978030 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3f4773cb-ad5e-4626-974e-b29215eddee9 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:33.978811 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-3f4773cb-ad5e-4626-974e-b29215eddee9 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: b83d31c6-561b-47f9-a17b-377c54728c08] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:33.987961 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3f4773cb-ad5e-4626-974e-b29215eddee9 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:33.988411 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3f4773cb-ad5e-4626-974e-b29215eddee9 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:33.997221 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3f4773cb-ad5e-4626-974e-b29215eddee9 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:33.998132 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3f4773cb-ad5e-4626-974e-b29215eddee9 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:34.082384 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-088b47f2-88c4-47ad-a41d-4ff61aee373b tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:34.096514 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-088b47f2-88c4-47ad-a41d-4ff61aee373b tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1505 microversion: 2.1 time: 0.288376 Jul 23 21:31:34.107384 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2214/4328] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:33 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1505 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:34.115149 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-6a22c30f-2c5b-4a42-9fc4-7f37590bf8bc tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:34.115811 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-6a22c30f-2c5b-4a42-9fc4-7f37590bf8bc tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:34.138618 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6a22c30f-2c5b-4a42-9fc4-7f37590bf8bc tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:34.139076 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6a22c30f-2c5b-4a42-9fc4-7f37590bf8bc tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:34.139867 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6a22c30f-2c5b-4a42-9fc4-7f37590bf8bc tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:34.140477 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6a22c30f-2c5b-4a42-9fc4-7f37590bf8bc tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:34.257955 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-6a22c30f-2c5b-4a42-9fc4-7f37590bf8bc tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:34.274768 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-6a22c30f-2c5b-4a42-9fc4-7f37590bf8bc tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:34.275781 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-3f4773cb-ad5e-4626-974e-b29215eddee9 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:34.276120 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-6a22c30f-2c5b-4a42-9fc4-7f37590bf8bc tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:34.277905 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-6a22c30f-2c5b-4a42-9fc4-7f37590bf8bc tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.167114 Jul 23 21:31:34.279136 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2215/4329] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:31:34 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:31:34.287253 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-bb2afda5-d202-487a-92f2-4bd87d78bc7a tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:34.288100 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-bb2afda5-d202-487a-92f2-4bd87d78bc7a tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:34.295897 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bb2afda5-d202-487a-92f2-4bd87d78bc7a tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:34.296381 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-3f4773cb-ad5e-4626-974e-b29215eddee9 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/b83d31c6-561b-47f9-a17b-377c54728c08" status: 200 len: 1309 microversion: 2.1 time: 0.324026 Jul 23 21:31:34.296750 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bb2afda5-d202-487a-92f2-4bd87d78bc7a tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:34.298095 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bb2afda5-d202-487a-92f2-4bd87d78bc7a tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:34.299140 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bb2afda5-d202-487a-92f2-4bd87d78bc7a tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:34.305973 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2115/4330] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:33 2022] GET /compute/v2.1/servers/b83d31c6-561b-47f9-a17b-377c54728c08 => generated 1309 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:34.312049 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-09308a89-45a6-4cdd-8e11-10b7befe85ae tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:34.312782 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-09308a89-45a6-4cdd-8e11-10b7befe85ae tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] [instance: 1f5b9a5a-109e-48b5-adc1-113384944dce] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:34.320294 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-09308a89-45a6-4cdd-8e11-10b7befe85ae tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:34.321090 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-09308a89-45a6-4cdd-8e11-10b7befe85ae tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:34.322177 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-09308a89-45a6-4cdd-8e11-10b7befe85ae tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:34.323126 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-09308a89-45a6-4cdd-8e11-10b7befe85ae tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:34.609585 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-09308a89-45a6-4cdd-8e11-10b7befe85ae tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd49331138a4dbc912bc7bf6f6b0215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842a1aca542f416eab5d43b881325917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:34.654400 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-09308a89-45a6-4cdd-8e11-10b7befe85ae tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] 10.222.0.17 "GET /compute/v2.1/servers/1f5b9a5a-109e-48b5-adc1-113384944dce" status: 200 len: 1469 microversion: 2.1 time: 0.346870 Jul 23 21:31:34.679571 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2116/4331] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:34 2022] GET /compute/v2.1/servers/1f5b9a5a-109e-48b5-adc1-113384944dce => generated 1469 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:34.706942 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-06a5ad0a-a1a9-457e-9901-53ba552af4b5 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:34.714922 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-06a5ad0a-a1a9-457e-9901-53ba552af4b5 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] [instance: 5cb6a473-80fe-4569-bd9a-52511d3b81aa] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:34.734186 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-06a5ad0a-a1a9-457e-9901-53ba552af4b5 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:34.734667 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-06a5ad0a-a1a9-457e-9901-53ba552af4b5 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:34.735419 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-06a5ad0a-a1a9-457e-9901-53ba552af4b5 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:34.735860 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-06a5ad0a-a1a9-457e-9901-53ba552af4b5 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:34.876928 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-06a5ad0a-a1a9-457e-9901-53ba552af4b5 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:34.909121 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-06a5ad0a-a1a9-457e-9901-53ba552af4b5 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:34.918796 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-06a5ad0a-a1a9-457e-9901-53ba552af4b5 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:34.922461 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-06a5ad0a-a1a9-457e-9901-53ba552af4b5 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] 10.222.0.17 "GET /compute/v2.1/servers/5cb6a473-80fe-4569-bd9a-52511d3b81aa" status: 200 len: 1364 microversion: 2.47 time: 0.241438 Jul 23 21:31:34.923079 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2117/4332] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:31:34 2022] GET /compute/v2.1/servers/5cb6a473-80fe-4569-bd9a-52511d3b81aa => generated 1364 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:31:35.005844 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-bb2afda5-d202-487a-92f2-4bd87d78bc7a tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:35.017136 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-bb2afda5-d202-487a-92f2-4bd87d78bc7a tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1505 microversion: 2.1 time: 0.736849 Jul 23 21:31:35.017729 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2216/4333] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:34 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1505 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:35.018295 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-4cf78f4a-672a-406f-a006-c30d7987625d req-d94255f6-6d43-4ae2-90ac-d1da1fdd6671 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f5b9a5a-109e-48b5-adc1-113384944dce", "name": "network-vif-plugged", "status": "completed", "tag": "b947908f-6578-44ec-898d-fff1852fea99"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:31:35.029753 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-4cf78f4a-672a-406f-a006-c30d7987625d req-d94255f6-6d43-4ae2-90ac-d1da1fdd6671 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:35.030634 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-4cf78f4a-672a-406f-a006-c30d7987625d req-d94255f6-6d43-4ae2-90ac-d1da1fdd6671 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:35.034918 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a9f96e71-fc3f-4a2e-bff1-41d43bda75b4 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:31:35.035486 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-a9f96e71-fc3f-4a2e-bff1-41d43bda75b4 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:35.046191 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a9f96e71-fc3f-4a2e-bff1-41d43bda75b4 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:35.047196 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-4cf78f4a-672a-406f-a006-c30d7987625d req-d94255f6-6d43-4ae2-90ac-d1da1fdd6671 service nova] Creating event network-vif-plugged:b947908f-6578-44ec-898d-fff1852fea99 for instance 1f5b9a5a-109e-48b5-adc1-113384944dce on nch2-master-1 Jul 23 21:31:35.049273 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a9f96e71-fc3f-4a2e-bff1-41d43bda75b4 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:35.050196 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a9f96e71-fc3f-4a2e-bff1-41d43bda75b4 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:35.050656 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a9f96e71-fc3f-4a2e-bff1-41d43bda75b4 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:35.070377 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-4cf78f4a-672a-406f-a006-c30d7987625d req-d94255f6-6d43-4ae2-90ac-d1da1fdd6671 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053257 Jul 23 21:31:35.073000 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2118/4334] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:31:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:31:35.175207 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-a9f96e71-fc3f-4a2e-bff1-41d43bda75b4 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "POST /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305/action" status: 202 len: 0 microversion: 2.1 time: 0.144640 Jul 23 21:31:35.175969 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2217/4335] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:31:35 2022] POST /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305/action => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 23 21:31:35.186627 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ad72a789-d230-4f24-a489-d1177a31b646 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:35.187416 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ad72a789-d230-4f24-a489-d1177a31b646 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:35.198059 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ad72a789-d230-4f24-a489-d1177a31b646 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:35.198674 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ad72a789-d230-4f24-a489-d1177a31b646 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:35.199710 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ad72a789-d230-4f24-a489-d1177a31b646 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:35.200295 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ad72a789-d230-4f24-a489-d1177a31b646 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:35.297738 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d9fba3bc-315e-4abf-812b-76e6d5f46826 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:35.298714 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-d9fba3bc-315e-4abf-812b-76e6d5f46826 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:35.305062 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d9fba3bc-315e-4abf-812b-76e6d5f46826 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:35.305512 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d9fba3bc-315e-4abf-812b-76e6d5f46826 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:35.306339 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d9fba3bc-315e-4abf-812b-76e6d5f46826 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:35.306817 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d9fba3bc-315e-4abf-812b-76e6d5f46826 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:35.374351 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-d9fba3bc-315e-4abf-812b-76e6d5f46826 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:35.384061 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-d9fba3bc-315e-4abf-812b-76e6d5f46826 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:35.385734 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-d9fba3bc-315e-4abf-812b-76e6d5f46826 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:35.387109 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-d9fba3bc-315e-4abf-812b-76e6d5f46826 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.094094 Jul 23 21:31:35.388133 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2218/4336] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:31:35 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:31:35.393075 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d33b2c42-d99d-414d-a7b9-805e9023f318 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:35.393895 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-d33b2c42-d99d-414d-a7b9-805e9023f318 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: b83d31c6-561b-47f9-a17b-377c54728c08] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:35.400238 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d33b2c42-d99d-414d-a7b9-805e9023f318 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:35.400623 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d33b2c42-d99d-414d-a7b9-805e9023f318 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:35.401394 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d33b2c42-d99d-414d-a7b9-805e9023f318 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:35.401841 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d33b2c42-d99d-414d-a7b9-805e9023f318 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:35.507921 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ad72a789-d230-4f24-a489-d1177a31b646 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:35.520426 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ad72a789-d230-4f24-a489-d1177a31b646 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1510 microversion: 2.1 time: 0.339873 Jul 23 21:31:35.522874 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2119/4337] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:35 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1510 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:35.594011 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-d33b2c42-d99d-414d-a7b9-805e9023f318 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:35.607028 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-d33b2c42-d99d-414d-a7b9-805e9023f318 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/b83d31c6-561b-47f9-a17b-377c54728c08" status: 200 len: 1309 microversion: 2.1 time: 0.217477 Jul 23 21:31:35.616513 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2219/4338] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:35 2022] GET /compute/v2.1/servers/b83d31c6-561b-47f9-a17b-377c54728c08 => generated 1309 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:35.680874 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-adcbe347-5478-4177-9cd8-0241bc19050e tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:35.681653 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-adcbe347-5478-4177-9cd8-0241bc19050e tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] [instance: 1f5b9a5a-109e-48b5-adc1-113384944dce] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:35.690803 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-adcbe347-5478-4177-9cd8-0241bc19050e tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:35.691240 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-adcbe347-5478-4177-9cd8-0241bc19050e tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:35.694805 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-adcbe347-5478-4177-9cd8-0241bc19050e tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:35.697282 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-adcbe347-5478-4177-9cd8-0241bc19050e tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:35.941150 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e8e9601b-a1ff-4d00-951c-d29a9ee8dd09 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:35.942646 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-e8e9601b-a1ff-4d00-951c-d29a9ee8dd09 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] [instance: 5cb6a473-80fe-4569-bd9a-52511d3b81aa] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:35.949469 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell0:SELECT=2 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:31:35.951980 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e8e9601b-a1ff-4d00-951c-d29a9ee8dd09 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:35.952402 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e8e9601b-a1ff-4d00-951c-d29a9ee8dd09 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:35.954486 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e8e9601b-a1ff-4d00-951c-d29a9ee8dd09 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:35.955112 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e8e9601b-a1ff-4d00-951c-d29a9ee8dd09 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:35.991899 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-adcbe347-5478-4177-9cd8-0241bc19050e tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd49331138a4dbc912bc7bf6f6b0215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842a1aca542f416eab5d43b881325917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:36.008820 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-adcbe347-5478-4177-9cd8-0241bc19050e tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] 10.222.0.17 "GET /compute/v2.1/servers/1f5b9a5a-109e-48b5-adc1-113384944dce" status: 200 len: 1469 microversion: 2.1 time: 0.332263 Jul 23 21:31:36.009796 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2120/4339] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:35 2022] GET /compute/v2.1/servers/1f5b9a5a-109e-48b5-adc1-113384944dce => generated 1469 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:36.035789 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-e8e9601b-a1ff-4d00-951c-d29a9ee8dd09 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:36.046313 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-e8e9601b-a1ff-4d00-951c-d29a9ee8dd09 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:36.048104 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-e8e9601b-a1ff-4d00-951c-d29a9ee8dd09 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:36.049478 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-e8e9601b-a1ff-4d00-951c-d29a9ee8dd09 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] 10.222.0.17 "GET /compute/v2.1/servers/5cb6a473-80fe-4569-bd9a-52511d3b81aa" status: 200 len: 1364 microversion: 2.47 time: 0.112502 Jul 23 21:31:36.050271 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2220/4340] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:31:35 2022] GET /compute/v2.1/servers/5cb6a473-80fe-4569-bd9a-52511d3b81aa => generated 1364 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:31:36.408399 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b68ff218-e05a-4077-89e0-0586237c8457 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:36.409051 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b68ff218-e05a-4077-89e0-0586237c8457 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:36.416008 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b68ff218-e05a-4077-89e0-0586237c8457 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:36.416553 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b68ff218-e05a-4077-89e0-0586237c8457 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:36.417387 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b68ff218-e05a-4077-89e0-0586237c8457 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:36.417836 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b68ff218-e05a-4077-89e0-0586237c8457 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:36.521005 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b68ff218-e05a-4077-89e0-0586237c8457 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:36.538772 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-5a318d70-2302-495b-9644-d3b42e302102 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:36.539139 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-5a318d70-2302-495b-9644-d3b42e302102 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:36.554738 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell0:SELECT=10 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:31:36.556359 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b68ff218-e05a-4077-89e0-0586237c8457 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:36.561921 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b68ff218-e05a-4077-89e0-0586237c8457 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:36.563389 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b68ff218-e05a-4077-89e0-0586237c8457 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.159186 Jul 23 21:31:36.564305 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2121/4341] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:31:36 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:31:36.568911 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5a318d70-2302-495b-9644-d3b42e302102 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:36.569591 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5a318d70-2302-495b-9644-d3b42e302102 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:36.571170 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5a318d70-2302-495b-9644-d3b42e302102 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:36.575203 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5a318d70-2302-495b-9644-d3b42e302102 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:36.628027 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2880850b-fd77-4582-a89e-85fd4c70dea8 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:36.643065 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-2880850b-fd77-4582-a89e-85fd4c70dea8 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: b83d31c6-561b-47f9-a17b-377c54728c08] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:36.657153 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2880850b-fd77-4582-a89e-85fd4c70dea8 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:36.659849 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2880850b-fd77-4582-a89e-85fd4c70dea8 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:36.664752 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2880850b-fd77-4582-a89e-85fd4c70dea8 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:36.665388 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2880850b-fd77-4582-a89e-85fd4c70dea8 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:36.700190 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=100 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:31:36.779104 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-5a318d70-2302-495b-9644-d3b42e302102 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:36.796235 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-5a318d70-2302-495b-9644-d3b42e302102 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1490 microversion: 2.1 time: 0.259655 Jul 23 21:31:36.798078 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2221/4342] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:36 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1490 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:36.815677 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-962b5dd3-634c-4331-a68f-941a07ba05b0 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:31:36.816601 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-962b5dd3-634c-4331-a68f-941a07ba05b0 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:36.823786 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-962b5dd3-634c-4331-a68f-941a07ba05b0 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:36.824360 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-962b5dd3-634c-4331-a68f-941a07ba05b0 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:36.825138 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-962b5dd3-634c-4331-a68f-941a07ba05b0 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:36.825746 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-962b5dd3-634c-4331-a68f-941a07ba05b0 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:36.851868 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-962b5dd3-634c-4331-a68f-941a07ba05b0 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] HTTP exception thrown: Cannot 'pause' instance f2ad2cfd-7479-48d0-b802-cdd5d5093305 while it is in vm_state paused Jul 23 21:31:36.854004 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-962b5dd3-634c-4331-a68f-941a07ba05b0 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Request method failure captured: Jul 23 21:31:36.854004 ncdv-master-1 devstack@n-api.service[131321]: request: POST /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305/action HTTP/1.1 Jul 23 21:31:36.854004 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:31:36.854004 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:31:36.854004 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:31:36.854004 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 13 Jul 23 21:31:36.854004 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:31:36.854004 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:31:36.854004 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:31:36.854004 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:31:36.854004 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3Ghf1JjZ4k8tVzERRK8IkLpluLUwa9k5Rz-X0dEr2p4_7xl_eBekUiNk1RZEGsFdGEiApbLOfcuSifirvwiKV1QOTaKdXKwfMnwZgdfagxJjoe3dPYUa3b-d3rVTYewIN_YoX2mMGGBMWRa3po8WOCVIc6hXJLExzq_ndbcO7U8NQBI Jul 23 21:31:36.854004 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:31:36.854004 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:31:36.854004 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:31:36.854004 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:31:36.854004 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:31:36.854004 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:31:36.854004 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: d70f6c96e1ad484aa3207fc01a12d519 Jul 23 21:31:36.854004 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:31:36.854004 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:31:36.854004 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:31:36.854004 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d70f6c96e1ad484aa3207fc01a12d519"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d70f6c96e1ad484aa3207fc01a12d519"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d70f6c96e1ad484aa3207fc01a12d519", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d70f6c96e1ad484aa3207fc01a12d519"}]}] Jul 23 21:31:36.854004 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:31:36.854004 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: d70f6c96e1ad484aa3207fc01a12d519 Jul 23 21:31:36.854004 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:31:36.854004 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ServersNegativeTestJSON-1106538570-project Jul 23 21:31:36.854004 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:31:36.854004 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:31:36.854004 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 6ca9644a73d9468aa39b21548a72bded Jul 23 21:31:36.854004 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ServersNegativeTestJSON-1106538570-project Jul 23 21:31:36.854004 ncdv-master-1 devstack@n-api.service[131321]: Jul 23 21:31:36.854004 ncdv-master-1 devstack@n-api.service[131321]: {"pause": {}} Jul 23 21:31:36.854004 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:31:36.854004 ncdv-master-1 devstack@n-api.service[131321]: exception: Cannot 'pause' instance f2ad2cfd-7479-48d0-b802-cdd5d5093305 while it is in vm_state paused Jul 23 21:31:36.854004 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': 'f2ad2cfd-7479-48d0-b802-cdd5d5093305', 'body': {'pause': {}}} Jul 23 21:31:36.854004 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:31:36.854004 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:36.854004 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Jul 23 21:31:36.854004 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Jul 23 21:31:36.854004 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 23 21:31:36.854004 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 23 21:31:36.854004 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 23 21:31:36.854004 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 23 21:31:36.854004 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f2ad2cfd-7479-48d0-b802-cdd5d5093305 in vm_state paused. Cannot pause while the instance is in this state. Jul 23 21:31:36.854004 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:36.854004 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:31:36.854004 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:36.854004 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:36.854004 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:31:36.854004 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:31:36.854004 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:31:36.854004 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:31:36.854004 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:31:36.854004 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:31:36.854004 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Jul 23 21:31:36.854004 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 23 21:31:36.854004 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 23 21:31:36.854004 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 23 21:31:36.854004 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance f2ad2cfd-7479-48d0-b802-cdd5d5093305 while it is in vm_state paused Jul 23 21:31:36.854004 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:36.854004 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:31:36.854004 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:36.854004 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:36.854004 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:31:36.858807 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:31:36.858807 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:31:36.858807 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:31:36.858807 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance f2ad2cfd-7479-48d0-b802-cdd5d5093305 while it is in vm_state paused Jul 23 21:31:36.858807 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:36.859960 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-962b5dd3-634c-4331-a68f-941a07ba05b0 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Returning 409 to user: Cannot 'pause' instance f2ad2cfd-7479-48d0-b802-cdd5d5093305 while it is in vm_state paused {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:31:36.860958 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-962b5dd3-634c-4331-a68f-941a07ba05b0 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "POST /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305/action" status: 409 len: 143 microversion: 2.1 time: 0.050242 Jul 23 21:31:36.862122 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2222/4343] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:31:36 2022] POST /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305/action => generated 143 bytes in 52 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 23 21:31:36.872344 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-b222848e-e994-4a20-bf2e-493e05265a40 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:31:36.873186 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-b222848e-e994-4a20-bf2e-493e05265a40 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:36.881116 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b222848e-e994-4a20-bf2e-493e05265a40 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:36.881957 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b222848e-e994-4a20-bf2e-493e05265a40 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:36.882915 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b222848e-e994-4a20-bf2e-493e05265a40 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:36.883602 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b222848e-e994-4a20-bf2e-493e05265a40 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:36.967468 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-b222848e-e994-4a20-bf2e-493e05265a40 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "POST /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305/action" status: 202 len: 0 microversion: 2.1 time: 0.101017 Jul 23 21:31:36.971163 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2223/4344] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:31:36 2022] POST /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:31:36.976794 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-274753a7-1f78-4927-a5a4-9c34b039c164 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:36.978013 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-274753a7-1f78-4927-a5a4-9c34b039c164 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:36.985883 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-274753a7-1f78-4927-a5a4-9c34b039c164 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:36.985883 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-274753a7-1f78-4927-a5a4-9c34b039c164 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:36.986489 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-274753a7-1f78-4927-a5a4-9c34b039c164 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:36.986927 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-274753a7-1f78-4927-a5a4-9c34b039c164 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:37.041837 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-2880850b-fd77-4582-a89e-85fd4c70dea8 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:37.056540 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2880850b-fd77-4582-a89e-85fd4c70dea8 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/b83d31c6-561b-47f9-a17b-377c54728c08" status: 200 len: 1309 microversion: 2.1 time: 0.436181 Jul 23 21:31:37.071959 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2122/4345] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:36 2022] GET /compute/v2.1/servers/b83d31c6-561b-47f9-a17b-377c54728c08 => generated 1309 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:31:37.077672 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a95b6760-421d-4a04-93c3-f1d9e43c423f tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:37.078334 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a95b6760-421d-4a04-93c3-f1d9e43c423f tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] [instance: 1f5b9a5a-109e-48b5-adc1-113384944dce] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:37.083053 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:31:37.088212 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a95b6760-421d-4a04-93c3-f1d9e43c423f tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:37.089028 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a95b6760-421d-4a04-93c3-f1d9e43c423f tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:37.091472 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a95b6760-421d-4a04-93c3-f1d9e43c423f tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:37.092115 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a95b6760-421d-4a04-93c3-f1d9e43c423f tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:37.180285 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-274753a7-1f78-4927-a5a4-9c34b039c164 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:37.190306 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-274753a7-1f78-4927-a5a4-9c34b039c164 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1497 microversion: 2.1 time: 0.217622 Jul 23 21:31:37.191587 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2224/4346] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:36 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1497 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:31:37.199390 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-2a2b2ca2-1dd6-4ff5-a56b-ef5bf89d9b53 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:37.200230 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-2a2b2ca2-1dd6-4ff5-a56b-ef5bf89d9b53 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] [instance: 5cb6a473-80fe-4569-bd9a-52511d3b81aa] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:37.214203 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2a2b2ca2-1dd6-4ff5-a56b-ef5bf89d9b53 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:37.215046 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2a2b2ca2-1dd6-4ff5-a56b-ef5bf89d9b53 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:37.216065 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2a2b2ca2-1dd6-4ff5-a56b-ef5bf89d9b53 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:37.216657 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2a2b2ca2-1dd6-4ff5-a56b-ef5bf89d9b53 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:37.292112 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-2a2b2ca2-1dd6-4ff5-a56b-ef5bf89d9b53 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:37.300734 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-2a2b2ca2-1dd6-4ff5-a56b-ef5bf89d9b53 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:37.302256 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-2a2b2ca2-1dd6-4ff5-a56b-ef5bf89d9b53 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:37.303424 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-2a2b2ca2-1dd6-4ff5-a56b-ef5bf89d9b53 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] 10.222.0.17 "GET /compute/v2.1/servers/5cb6a473-80fe-4569-bd9a-52511d3b81aa" status: 200 len: 1364 microversion: 2.47 time: 0.110667 Jul 23 21:31:37.304000 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2225/4347] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:31:37 2022] GET /compute/v2.1/servers/5cb6a473-80fe-4569-bd9a-52511d3b81aa => generated 1364 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:31:37.308686 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-bec34e7e-7ffc-4d22-a83c-44a3c0992e3c req-f1db99d4-81af-46cb-ab82-eac676b0f2f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b83d31c6-561b-47f9-a17b-377c54728c08", "name": "network-vif-plugged", "status": "completed", "tag": "a266c338-dcaf-437b-942e-26c032063e60"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:31:37.312317 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:31:37.318433 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-bec34e7e-7ffc-4d22-a83c-44a3c0992e3c req-f1db99d4-81af-46cb-ab82-eac676b0f2f6 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:37.318963 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-bec34e7e-7ffc-4d22-a83c-44a3c0992e3c req-f1db99d4-81af-46cb-ab82-eac676b0f2f6 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:37.332427 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-bec34e7e-7ffc-4d22-a83c-44a3c0992e3c req-f1db99d4-81af-46cb-ab82-eac676b0f2f6 service nova] Creating event network-vif-plugged:a266c338-dcaf-437b-942e-26c032063e60 for instance b83d31c6-561b-47f9-a17b-377c54728c08 on nch1-master-1 Jul 23 21:31:37.337847 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-bec34e7e-7ffc-4d22-a83c-44a3c0992e3c req-f1db99d4-81af-46cb-ab82-eac676b0f2f6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032693 Jul 23 21:31:37.340004 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2226/4348] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:31:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:31:37.465675 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a95b6760-421d-4a04-93c3-f1d9e43c423f tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd49331138a4dbc912bc7bf6f6b0215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842a1aca542f416eab5d43b881325917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:37.476635 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a95b6760-421d-4a04-93c3-f1d9e43c423f tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] 10.222.0.17 "GET /compute/v2.1/servers/1f5b9a5a-109e-48b5-adc1-113384944dce" status: 200 len: 1642 microversion: 2.1 time: 0.403230 Jul 23 21:31:37.477245 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2123/4349] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:37 2022] GET /compute/v2.1/servers/1f5b9a5a-109e-48b5-adc1-113384944dce => generated 1642 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:37.495272 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a3628441-6334-4937-aae4-19af9c7aa258 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:37.496109 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-a3628441-6334-4937-aae4-19af9c7aa258 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] [instance: 1f5b9a5a-109e-48b5-adc1-113384944dce] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:37.510563 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a3628441-6334-4937-aae4-19af9c7aa258 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:37.511592 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a3628441-6334-4937-aae4-19af9c7aa258 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:37.512844 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a3628441-6334-4937-aae4-19af9c7aa258 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:37.513671 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a3628441-6334-4937-aae4-19af9c7aa258 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:37.541539 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:31:37.583507 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8af3ef07-ab8b-4b86-92a7-debeafc5d7eb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:37.584127 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8af3ef07-ab8b-4b86-92a7-debeafc5d7eb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:37.599481 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8af3ef07-ab8b-4b86-92a7-debeafc5d7eb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:37.600053 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8af3ef07-ab8b-4b86-92a7-debeafc5d7eb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:37.600873 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8af3ef07-ab8b-4b86-92a7-debeafc5d7eb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:37.601311 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8af3ef07-ab8b-4b86-92a7-debeafc5d7eb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:37.720778 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8af3ef07-ab8b-4b86-92a7-debeafc5d7eb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:37.732971 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8af3ef07-ab8b-4b86-92a7-debeafc5d7eb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:37.734520 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8af3ef07-ab8b-4b86-92a7-debeafc5d7eb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:37.735751 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8af3ef07-ab8b-4b86-92a7-debeafc5d7eb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.156952 Jul 23 21:31:37.736414 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2124/4350] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:31:37 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:31:37.791315 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-a3628441-6334-4937-aae4-19af9c7aa258 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd49331138a4dbc912bc7bf6f6b0215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842a1aca542f416eab5d43b881325917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:37.803298 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-a3628441-6334-4937-aae4-19af9c7aa258 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] 10.222.0.17 "GET /compute/v2.1/servers/1f5b9a5a-109e-48b5-adc1-113384944dce" status: 200 len: 1642 microversion: 2.1 time: 0.313515 Jul 23 21:31:37.805759 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2227/4351] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:37 2022] GET /compute/v2.1/servers/1f5b9a5a-109e-48b5-adc1-113384944dce => generated 1642 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:37.825697 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5e8993d7-4f73-472b-a6f4-af197c179506 tempest-TestSecurityGroupsBasicOps-1374320103 tempest-TestSecurityGroupsBasicOps-1374320103-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:37.826577 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5e8993d7-4f73-472b-a6f4-af197c179506 tempest-TestSecurityGroupsBasicOps-1374320103 tempest-TestSecurityGroupsBasicOps-1374320103-project-admin] [instance: 1f5b9a5a-109e-48b5-adc1-113384944dce] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:37.853495 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5e8993d7-4f73-472b-a6f4-af197c179506 tempest-TestSecurityGroupsBasicOps-1374320103 tempest-TestSecurityGroupsBasicOps-1374320103-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:37.853495 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5e8993d7-4f73-472b-a6f4-af197c179506 tempest-TestSecurityGroupsBasicOps-1374320103 tempest-TestSecurityGroupsBasicOps-1374320103-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:37.857081 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5e8993d7-4f73-472b-a6f4-af197c179506 tempest-TestSecurityGroupsBasicOps-1374320103 tempest-TestSecurityGroupsBasicOps-1374320103-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:37.857579 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5e8993d7-4f73-472b-a6f4-af197c179506 tempest-TestSecurityGroupsBasicOps-1374320103 tempest-TestSecurityGroupsBasicOps-1374320103-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:38.075492 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-fff07a0c-8609-4258-827a-e8a46b8cd1f4 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:38.076274 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-fff07a0c-8609-4258-827a-e8a46b8cd1f4 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: b83d31c6-561b-47f9-a17b-377c54728c08] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:38.106967 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fff07a0c-8609-4258-827a-e8a46b8cd1f4 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:38.110844 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fff07a0c-8609-4258-827a-e8a46b8cd1f4 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:38.112235 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fff07a0c-8609-4258-827a-e8a46b8cd1f4 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:38.116881 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fff07a0c-8609-4258-827a-e8a46b8cd1f4 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:38.243800 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5e8993d7-4f73-472b-a6f4-af197c179506 tempest-TestSecurityGroupsBasicOps-1374320103 tempest-TestSecurityGroupsBasicOps-1374320103-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/1f5b9a5a-109e-48b5-adc1-113384944dce" status: 200 len: 1793 microversion: 2.1 time: 0.428322 Jul 23 21:31:38.248099 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2125/4352] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:37 2022] GET /compute/v2.1/servers/1f5b9a5a-109e-48b5-adc1-113384944dce => generated 1793 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:38.257338 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-08abf3fa-4028-4c54-86bf-b87c2101f074 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:38.266407 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-08abf3fa-4028-4c54-86bf-b87c2101f074 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:38.278983 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-08abf3fa-4028-4c54-86bf-b87c2101f074 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:38.279603 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-08abf3fa-4028-4c54-86bf-b87c2101f074 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:38.280503 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-08abf3fa-4028-4c54-86bf-b87c2101f074 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:38.281050 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-08abf3fa-4028-4c54-86bf-b87c2101f074 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:38.511697 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-fff07a0c-8609-4258-827a-e8a46b8cd1f4 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:38.530458 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-fff07a0c-8609-4258-827a-e8a46b8cd1f4 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/b83d31c6-561b-47f9-a17b-377c54728c08" status: 200 len: 1309 microversion: 2.1 time: 0.459505 Jul 23 21:31:38.531425 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2228/4353] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:38 2022] GET /compute/v2.1/servers/b83d31c6-561b-47f9-a17b-377c54728c08 => generated 1309 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:38.533767 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-08abf3fa-4028-4c54-86bf-b87c2101f074 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:38.536036 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-dda085b4-2215-48e9-8ed2-dfbaaa2d4647 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:38.536634 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-dda085b4-2215-48e9-8ed2-dfbaaa2d4647 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] [instance: 5cb6a473-80fe-4569-bd9a-52511d3b81aa] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:38.545416 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-08abf3fa-4028-4c54-86bf-b87c2101f074 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1505 microversion: 2.1 time: 0.291970 Jul 23 21:31:38.546531 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2126/4354] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:38 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1505 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:38.548592 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-dda085b4-2215-48e9-8ed2-dfbaaa2d4647 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:38.549239 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-dda085b4-2215-48e9-8ed2-dfbaaa2d4647 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:38.550474 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-dda085b4-2215-48e9-8ed2-dfbaaa2d4647 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:38.551797 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-dda085b4-2215-48e9-8ed2-dfbaaa2d4647 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:38.566213 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-08e18458-1667-428d-8a8b-d49494718531 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:38.566994 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-08e18458-1667-428d-8a8b-d49494718531 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:38.577488 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-08e18458-1667-428d-8a8b-d49494718531 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:38.578908 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-08e18458-1667-428d-8a8b-d49494718531 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:38.584041 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-08e18458-1667-428d-8a8b-d49494718531 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:38.584810 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-08e18458-1667-428d-8a8b-d49494718531 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:38.667851 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-dda085b4-2215-48e9-8ed2-dfbaaa2d4647 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:38.688455 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-dda085b4-2215-48e9-8ed2-dfbaaa2d4647 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:38.698675 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-dda085b4-2215-48e9-8ed2-dfbaaa2d4647 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:38.702632 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-dda085b4-2215-48e9-8ed2-dfbaaa2d4647 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] 10.222.0.17 "GET /compute/v2.1/servers/5cb6a473-80fe-4569-bd9a-52511d3b81aa" status: 200 len: 1364 microversion: 2.47 time: 0.169979 Jul 23 21:31:38.708725 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2229/4355] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:31:38 2022] GET /compute/v2.1/servers/5cb6a473-80fe-4569-bd9a-52511d3b81aa => generated 1364 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:31:38.756430 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-2ec233f1-c179-415c-853e-f2a1e71ba7e6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:38.758697 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-2ec233f1-c179-415c-853e-f2a1e71ba7e6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:38.770094 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2ec233f1-c179-415c-853e-f2a1e71ba7e6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:38.771057 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2ec233f1-c179-415c-853e-f2a1e71ba7e6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:38.772401 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2ec233f1-c179-415c-853e-f2a1e71ba7e6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:38.772864 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2ec233f1-c179-415c-853e-f2a1e71ba7e6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:38.943807 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-08e18458-1667-428d-8a8b-d49494718531 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:38.955573 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-08e18458-1667-428d-8a8b-d49494718531 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1505 microversion: 2.1 time: 0.393264 Jul 23 21:31:38.956687 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2127/4356] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:38 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1505 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:31:38.974002 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-19564fb8-89c7-4137-9263-9698eaf46d34 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:31:38.975311 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-19564fb8-89c7-4137-9263-9698eaf46d34 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: e74832ce-b06a-4786-b3f3-372e508a4795] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:38.998308 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-19564fb8-89c7-4137-9263-9698eaf46d34 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:38.999171 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-19564fb8-89c7-4137-9263-9698eaf46d34 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:39.000125 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-19564fb8-89c7-4137-9263-9698eaf46d34 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:39.000715 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-19564fb8-89c7-4137-9263-9698eaf46d34 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:39.022233 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-2ec233f1-c179-415c-853e-f2a1e71ba7e6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:39.037693 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-19564fb8-89c7-4137-9263-9698eaf46d34 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] HTTP exception thrown: Instance e74832ce-b06a-4786-b3f3-372e508a4795 could not be found. Jul 23 21:31:39.039499 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-19564fb8-89c7-4137-9263-9698eaf46d34 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Request method failure captured: Jul 23 21:31:39.039499 ncdv-master-1 devstack@n-api.service[131320]: request: POST /compute/v2.1/servers/e74832ce-b06a-4786-b3f3-372e508a4795/action HTTP/1.1 Jul 23 21:31:39.039499 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:31:39.039499 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:31:39.039499 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:31:39.039499 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 28 Jul 23 21:31:39.039499 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:31:39.039499 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:31:39.039499 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:31:39.039499 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:31:39.039499 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3Ghf1JjZ4k8tVzERRK8IkLpluLUwa9k5Rz-X0dEr2p4_7xl_eBekUiNk1RZEGsFdGEiApbLOfcuSifirvwiKV1QOTaKdXKwfMnwZgdfagxJjoe3dPYUa3b-d3rVTYewIN_YoX2mMGGBMWRa3po8WOCVIc6hXJLExzq_ndbcO7U8NQBI Jul 23 21:31:39.039499 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:31:39.039499 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:31:39.039499 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:31:39.039499 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:31:39.039499 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:31:39.039499 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:31:39.039499 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: d70f6c96e1ad484aa3207fc01a12d519 Jul 23 21:31:39.039499 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:31:39.039499 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:31:39.039499 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:31:39.039499 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d70f6c96e1ad484aa3207fc01a12d519"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d70f6c96e1ad484aa3207fc01a12d519"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d70f6c96e1ad484aa3207fc01a12d519", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d70f6c96e1ad484aa3207fc01a12d519"}]}] Jul 23 21:31:39.039499 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:31:39.039499 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: d70f6c96e1ad484aa3207fc01a12d519 Jul 23 21:31:39.039499 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:31:39.039499 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServersNegativeTestJSON-1106538570-project Jul 23 21:31:39.039499 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:31:39.039499 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:31:39.039499 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 6ca9644a73d9468aa39b21548a72bded Jul 23 21:31:39.039499 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServersNegativeTestJSON-1106538570-project Jul 23 21:31:39.039499 ncdv-master-1 devstack@n-api.service[131320]: Jul 23 21:31:39.039499 ncdv-master-1 devstack@n-api.service[131320]: {"reboot": {"type": "SOFT"}} Jul 23 21:31:39.039499 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:31:39.039499 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance e74832ce-b06a-4786-b3f3-372e508a4795 could not be found. Jul 23 21:31:39.039499 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': 'e74832ce-b06a-4786-b3f3-372e508a4795', 'body': {'reboot': {'type': 'SOFT'}}} Jul 23 21:31:39.039499 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:31:39.039499 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:39.039499 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:31:39.039499 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:31:39.039499 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:31:39.039499 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:31:39.039499 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:31:39.039499 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:31:39.039499 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:31:39.039499 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:31:39.039499 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e74832ce-b06a-4786-b3f3-372e508a4795 could not be found. Jul 23 21:31:39.039499 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:31:39.039499 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:31:39.039499 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:31:39.039499 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:39.039499 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:31:39.039499 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:31:39.039499 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:31:39.039499 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:31:39.039499 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:31:39.039499 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:31:39.039499 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:31:39.039499 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:31:39.039499 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Jul 23 21:31:39.039499 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 23 21:31:39.039499 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:31:39.039499 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:31:39.039499 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:31:39.039499 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:31:39.043358 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e74832ce-b06a-4786-b3f3-372e508a4795 could not be found. Jul 23 21:31:39.043358 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:31:39.043358 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:31:39.043358 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:31:39.043358 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:39.043358 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:31:39.043358 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:31:39.043358 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:31:39.043358 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:31:39.043358 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e74832ce-b06a-4786-b3f3-372e508a4795 could not be found. Jul 23 21:31:39.043358 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:31:39.044431 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-19564fb8-89c7-4137-9263-9698eaf46d34 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Returning 404 to user: Instance e74832ce-b06a-4786-b3f3-372e508a4795 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:31:39.045014 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-2ec233f1-c179-415c-853e-f2a1e71ba7e6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:39.046062 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-19564fb8-89c7-4137-9263-9698eaf46d34 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "POST /compute/v2.1/servers/e74832ce-b06a-4786-b3f3-372e508a4795/action" status: 404 len: 111 microversion: 2.1 time: 0.077828 Jul 23 21:31:39.047163 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2128/4357] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:31:38 2022] POST /compute/v2.1/servers/e74832ce-b06a-4786-b3f3-372e508a4795/action => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:31:39.048201 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-2ec233f1-c179-415c-853e-f2a1e71ba7e6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:39.049675 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-2ec233f1-c179-415c-853e-f2a1e71ba7e6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.298163 Jul 23 21:31:39.050722 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2230/4358] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:31:38 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:31:39.066610 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c9ce73fa-476e-476b-9b07-90ce613447fd tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:39.067224 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c9ce73fa-476e-476b-9b07-90ce613447fd tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:39.075021 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c9ce73fa-476e-476b-9b07-90ce613447fd tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:39.075494 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c9ce73fa-476e-476b-9b07-90ce613447fd tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:39.076278 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c9ce73fa-476e-476b-9b07-90ce613447fd tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:39.076966 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c9ce73fa-476e-476b-9b07-90ce613447fd tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:39.351549 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c9ce73fa-476e-476b-9b07-90ce613447fd tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:39.367988 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c9ce73fa-476e-476b-9b07-90ce613447fd tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1505 microversion: 2.1 time: 0.305304 Jul 23 21:31:39.369824 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2129/4359] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:39 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1505 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:39.386561 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ab693610-b15a-4b6f-9ee3-5a16c6f72cc2 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:39.387391 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-ab693610-b15a-4b6f-9ee3-5a16c6f72cc2 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:39.394076 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ab693610-b15a-4b6f-9ee3-5a16c6f72cc2 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:39.394534 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ab693610-b15a-4b6f-9ee3-5a16c6f72cc2 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:39.395306 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ab693610-b15a-4b6f-9ee3-5a16c6f72cc2 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:39.395981 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ab693610-b15a-4b6f-9ee3-5a16c6f72cc2 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:39.547455 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6c4b76cd-196d-4834-aad0-d471fdba2213 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:39.547979 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6c4b76cd-196d-4834-aad0-d471fdba2213 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: b83d31c6-561b-47f9-a17b-377c54728c08] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:39.555313 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6c4b76cd-196d-4834-aad0-d471fdba2213 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:39.555807 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6c4b76cd-196d-4834-aad0-d471fdba2213 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:39.556600 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6c4b76cd-196d-4834-aad0-d471fdba2213 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:39.557040 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6c4b76cd-196d-4834-aad0-d471fdba2213 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:39.771399 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ab693610-b15a-4b6f-9ee3-5a16c6f72cc2 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:39.781570 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-ab693610-b15a-4b6f-9ee3-5a16c6f72cc2 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1505 microversion: 2.1 time: 0.398806 Jul 23 21:31:39.783918 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2231/4360] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:39 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1505 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:39.789137 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-28a4684f-dbe2-4143-9e19-673632e7aa3d tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:39.791846 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-28a4684f-dbe2-4143-9e19-673632e7aa3d tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] [instance: 5cb6a473-80fe-4569-bd9a-52511d3b81aa] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:39.803404 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6c4b76cd-196d-4834-aad0-d471fdba2213 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:39.813978 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-28a4684f-dbe2-4143-9e19-673632e7aa3d tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:39.814636 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-28a4684f-dbe2-4143-9e19-673632e7aa3d tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:39.815643 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-28a4684f-dbe2-4143-9e19-673632e7aa3d tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:39.816311 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-28a4684f-dbe2-4143-9e19-673632e7aa3d tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:39.823707 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6c4b76cd-196d-4834-aad0-d471fdba2213 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/b83d31c6-561b-47f9-a17b-377c54728c08" status: 200 len: 1491 microversion: 2.1 time: 0.279647 Jul 23 21:31:39.828685 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2130/4361] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:39 2022] GET /compute/v2.1/servers/b83d31c6-561b-47f9-a17b-377c54728c08 => generated 1491 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:31:39.833695 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-99ff34c8-e6a5-4763-8ef0-ec253737b7b7 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:31:39.834734 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-99ff34c8-e6a5-4763-8ef0-ec253737b7b7 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: 4e077d53-3b0e-4e3f-a997-5be879485b5e] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:39.853724 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-99ff34c8-e6a5-4763-8ef0-ec253737b7b7 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] HTTP exception thrown: Instance 4e077d53-3b0e-4e3f-a997-5be879485b5e could not be found. Jul 23 21:31:39.856034 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-99ff34c8-e6a5-4763-8ef0-ec253737b7b7 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Request method failure captured: Jul 23 21:31:39.856034 ncdv-master-1 devstack@n-api.service[131320]: request: POST /compute/v2.1/servers/4e077d53-3b0e-4e3f-a997-5be879485b5e/action HTTP/1.1 Jul 23 21:31:39.856034 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:31:39.856034 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:31:39.856034 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:31:39.856034 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 28 Jul 23 21:31:39.856034 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:31:39.856034 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:31:39.856034 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:31:39.856034 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:31:39.856034 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3Ghf1JjZ4k8tVzERRK8IkLpluLUwa9k5Rz-X0dEr2p4_7xl_eBekUiNk1RZEGsFdGEiApbLOfcuSifirvwiKV1QOTaKdXKwfMnwZgdfagxJjoe3dPYUa3b-d3rVTYewIN_YoX2mMGGBMWRa3po8WOCVIc6hXJLExzq_ndbcO7U8NQBI Jul 23 21:31:39.856034 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:31:39.856034 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:31:39.856034 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:31:39.856034 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:31:39.856034 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:31:39.856034 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:31:39.856034 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: d70f6c96e1ad484aa3207fc01a12d519 Jul 23 21:31:39.856034 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:31:39.856034 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:31:39.856034 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:31:39.856034 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d70f6c96e1ad484aa3207fc01a12d519"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d70f6c96e1ad484aa3207fc01a12d519"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d70f6c96e1ad484aa3207fc01a12d519", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d70f6c96e1ad484aa3207fc01a12d519"}]}] Jul 23 21:31:39.856034 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:31:39.856034 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: d70f6c96e1ad484aa3207fc01a12d519 Jul 23 21:31:39.856034 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:31:39.856034 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServersNegativeTestJSON-1106538570-project Jul 23 21:31:39.856034 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:31:39.856034 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:31:39.856034 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 6ca9644a73d9468aa39b21548a72bded Jul 23 21:31:39.856034 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServersNegativeTestJSON-1106538570-project Jul 23 21:31:39.856034 ncdv-master-1 devstack@n-api.service[131320]: Jul 23 21:31:39.856034 ncdv-master-1 devstack@n-api.service[131320]: {"reboot": {"type": "SOFT"}} Jul 23 21:31:39.856034 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:31:39.856034 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance 4e077d53-3b0e-4e3f-a997-5be879485b5e could not be found. Jul 23 21:31:39.856034 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '4e077d53-3b0e-4e3f-a997-5be879485b5e', 'body': {'reboot': {'type': 'SOFT'}}} Jul 23 21:31:39.856034 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:31:39.856034 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:39.856034 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:31:39.856034 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:31:39.856034 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:31:39.856034 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:31:39.856034 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 23 21:31:39.856034 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 23 21:31:39.856034 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e077d53-3b0e-4e3f-a997-5be879485b5e could not be found. Jul 23 21:31:39.856034 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:31:39.856034 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:31:39.856034 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:31:39.856034 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:39.856034 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:31:39.856034 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:31:39.856034 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:31:39.856034 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:31:39.856034 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:31:39.856034 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:31:39.856034 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:31:39.856034 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:31:39.856034 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Jul 23 21:31:39.856034 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 23 21:31:39.856034 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:31:39.856034 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:31:39.856034 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:31:39.856034 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:31:39.856034 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e077d53-3b0e-4e3f-a997-5be879485b5e could not be found. Jul 23 21:31:39.856034 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:31:39.859539 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:31:39.859539 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:31:39.859539 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:39.859539 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:31:39.859539 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:31:39.859539 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:31:39.859539 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:31:39.859539 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e077d53-3b0e-4e3f-a997-5be879485b5e could not be found. Jul 23 21:31:39.859539 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:31:39.867375 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-99ff34c8-e6a5-4763-8ef0-ec253737b7b7 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Returning 404 to user: Instance 4e077d53-3b0e-4e3f-a997-5be879485b5e could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:31:39.868272 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-99ff34c8-e6a5-4763-8ef0-ec253737b7b7 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "POST /compute/v2.1/servers/4e077d53-3b0e-4e3f-a997-5be879485b5e/action" status: 404 len: 111 microversion: 2.1 time: 0.038560 Jul 23 21:31:39.868878 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2131/4362] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:31:39 2022] POST /compute/v2.1/servers/4e077d53-3b0e-4e3f-a997-5be879485b5e/action => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:31:39.875883 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e2f89171-d07b-47b2-bbea-1ec9e8f5e174 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:31:39.883340 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e2f89171-d07b-47b2-bbea-1ec9e8f5e174 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: b83d31c6-561b-47f9-a17b-377c54728c08] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:39.891051 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e2f89171-d07b-47b2-bbea-1ec9e8f5e174 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:39.891831 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e2f89171-d07b-47b2-bbea-1ec9e8f5e174 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:39.892800 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e2f89171-d07b-47b2-bbea-1ec9e8f5e174 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:39.893421 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e2f89171-d07b-47b2-bbea-1ec9e8f5e174 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:39.953951 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-28a4684f-dbe2-4143-9e19-673632e7aa3d tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:39.968122 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-28a4684f-dbe2-4143-9e19-673632e7aa3d tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:39.970134 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-28a4684f-dbe2-4143-9e19-673632e7aa3d tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:39.971583 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-28a4684f-dbe2-4143-9e19-673632e7aa3d tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] 10.222.0.17 "GET /compute/v2.1/servers/5cb6a473-80fe-4569-bd9a-52511d3b81aa" status: 200 len: 1364 microversion: 2.47 time: 0.186469 Jul 23 21:31:39.973110 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2232/4363] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:31:39 2022] GET /compute/v2.1/servers/5cb6a473-80fe-4569-bd9a-52511d3b81aa => generated 1364 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:31:39.982460 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-1d52f35a-2699-4d10-aaf8-0581b48d9bc2 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:39.986387 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-1d52f35a-2699-4d10-aaf8-0581b48d9bc2 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:39.994866 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1d52f35a-2699-4d10-aaf8-0581b48d9bc2 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:39.995619 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1d52f35a-2699-4d10-aaf8-0581b48d9bc2 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:39.996181 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e2f89171-d07b-47b2-bbea-1ec9e8f5e174 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "PUT /compute/v2.1/servers/b83d31c6-561b-47f9-a17b-377c54728c08" status: 200 len: 1086 microversion: 2.1 time: 0.125693 Jul 23 21:31:39.997292 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2132/4364] 10.222.0.17 () {60 vars in 1255 bytes} [Sat Jul 23 21:31:39 2022] PUT /compute/v2.1/servers/b83d31c6-561b-47f9-a17b-377c54728c08 => generated 1086 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:39.997919 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1d52f35a-2699-4d10-aaf8-0581b48d9bc2 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:39.998680 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1d52f35a-2699-4d10-aaf8-0581b48d9bc2 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:40.012279 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-7833b3df-33ee-4d32-9ec1-1b81101d9b6c tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:40.013557 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-7833b3df-33ee-4d32-9ec1-1b81101d9b6c tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: b83d31c6-561b-47f9-a17b-377c54728c08] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:40.024274 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7833b3df-33ee-4d32-9ec1-1b81101d9b6c tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:40.025113 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7833b3df-33ee-4d32-9ec1-1b81101d9b6c tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:40.028017 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7833b3df-33ee-4d32-9ec1-1b81101d9b6c tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:40.028666 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7833b3df-33ee-4d32-9ec1-1b81101d9b6c tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:40.259304 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-7833b3df-33ee-4d32-9ec1-1b81101d9b6c tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:40.271405 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-7833b3df-33ee-4d32-9ec1-1b81101d9b6c tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/b83d31c6-561b-47f9-a17b-377c54728c08" status: 200 len: 1512 microversion: 2.1 time: 0.263924 Jul 23 21:31:40.273145 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2133/4365] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:40 2022] GET /compute/v2.1/servers/b83d31c6-561b-47f9-a17b-377c54728c08 => generated 1512 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:40.281511 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1998c9d2-6d90-4ba8-a601-143dae2fdf06 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:40.282385 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1998c9d2-6d90-4ba8-a601-143dae2fdf06 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:40.290788 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1998c9d2-6d90-4ba8-a601-143dae2fdf06 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:40.291467 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1998c9d2-6d90-4ba8-a601-143dae2fdf06 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:40.292412 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1998c9d2-6d90-4ba8-a601-143dae2fdf06 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:40.293073 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1998c9d2-6d90-4ba8-a601-143dae2fdf06 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:40.386643 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-1998c9d2-6d90-4ba8-a601-143dae2fdf06 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:40.412210 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-1998c9d2-6d90-4ba8-a601-143dae2fdf06 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:40.415201 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-1998c9d2-6d90-4ba8-a601-143dae2fdf06 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:40.418869 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1998c9d2-6d90-4ba8-a601-143dae2fdf06 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.144473 Jul 23 21:31:40.419681 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2134/4366] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:31:40 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:31:40.425017 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-be7a42fc-ee41-4343-9a35-ad53aa6c164c tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:40.425737 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-be7a42fc-ee41-4343-9a35-ad53aa6c164c tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: b83d31c6-561b-47f9-a17b-377c54728c08] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:40.432308 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-be7a42fc-ee41-4343-9a35-ad53aa6c164c tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:40.432873 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-be7a42fc-ee41-4343-9a35-ad53aa6c164c tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:40.433825 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-be7a42fc-ee41-4343-9a35-ad53aa6c164c tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:40.434527 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-be7a42fc-ee41-4343-9a35-ad53aa6c164c tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:40.481337 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-1d52f35a-2699-4d10-aaf8-0581b48d9bc2 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:40.496058 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-1d52f35a-2699-4d10-aaf8-0581b48d9bc2 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1505 microversion: 2.1 time: 0.517725 Jul 23 21:31:40.510205 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2233/4367] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:39 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1505 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:40.515767 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-8a78df74-5852-4ef0-8af0-6d15b80fff76 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:40.516633 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-8a78df74-5852-4ef0-8af0-6d15b80fff76 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:40.523065 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8a78df74-5852-4ef0-8af0-6d15b80fff76 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:40.523726 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8a78df74-5852-4ef0-8af0-6d15b80fff76 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:40.524662 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8a78df74-5852-4ef0-8af0-6d15b80fff76 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:40.525260 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8a78df74-5852-4ef0-8af0-6d15b80fff76 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:40.687640 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-be7a42fc-ee41-4343-9a35-ad53aa6c164c tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:40.695680 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-be7a42fc-ee41-4343-9a35-ad53aa6c164c tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/b83d31c6-561b-47f9-a17b-377c54728c08" status: 200 len: 1512 microversion: 2.1 time: 0.274751 Jul 23 21:31:40.696649 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2135/4368] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:40 2022] GET /compute/v2.1/servers/b83d31c6-561b-47f9-a17b-377c54728c08 => generated 1512 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:40.730466 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8e42e9d8-90b9-4c7f-9834-638bea6c7503 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:40.731448 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8e42e9d8-90b9-4c7f-9834-638bea6c7503 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: b83d31c6-561b-47f9-a17b-377c54728c08] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:40.739248 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8e42e9d8-90b9-4c7f-9834-638bea6c7503 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:40.739678 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8e42e9d8-90b9-4c7f-9834-638bea6c7503 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:40.740520 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8e42e9d8-90b9-4c7f-9834-638bea6c7503 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:40.741161 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8e42e9d8-90b9-4c7f-9834-638bea6c7503 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:40.777659 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8e42e9d8-90b9-4c7f-9834-638bea6c7503 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: b83d31c6-561b-47f9-a17b-377c54728c08] Going to try to terminate instance {{(pid=131320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:31:40.893316 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-8a78df74-5852-4ef0-8af0-6d15b80fff76 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:40.908304 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8e42e9d8-90b9-4c7f-9834-638bea6c7503 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "DELETE /compute/v2.1/servers/b83d31c6-561b-47f9-a17b-377c54728c08" status: 204 len: 0 microversion: 2.1 time: 0.195975 Jul 23 21:31:40.909840 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-8a78df74-5852-4ef0-8af0-6d15b80fff76 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1505 microversion: 2.1 time: 0.398006 Jul 23 21:31:40.910286 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2136/4369] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:31:40 2022] DELETE /compute/v2.1/servers/b83d31c6-561b-47f9-a17b-377c54728c08 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:31:40.923116 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2234/4370] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:40 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1505 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:40.928408 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ee8d0ef3-657e-40c9-9b51-7d549d87fa33 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:40.929029 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-ee8d0ef3-657e-40c9-9b51-7d549d87fa33 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: b83d31c6-561b-47f9-a17b-377c54728c08] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:40.930789 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c703fe6e-b219-4a16-9d00-d3ee9946d5f6 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:31:40.938288 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ee8d0ef3-657e-40c9-9b51-7d549d87fa33 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:40.939375 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ee8d0ef3-657e-40c9-9b51-7d549d87fa33 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:40.940489 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ee8d0ef3-657e-40c9-9b51-7d549d87fa33 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:40.941264 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ee8d0ef3-657e-40c9-9b51-7d549d87fa33 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:40.942207 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c703fe6e-b219-4a16-9d00-d3ee9946d5f6 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: e74832ce-b06a-4786-b3f3-372e508a4795] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:40.955748 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c703fe6e-b219-4a16-9d00-d3ee9946d5f6 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:40.956390 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c703fe6e-b219-4a16-9d00-d3ee9946d5f6 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:40.957281 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c703fe6e-b219-4a16-9d00-d3ee9946d5f6 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:40.958283 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c703fe6e-b219-4a16-9d00-d3ee9946d5f6 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:40.976053 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-c703fe6e-b219-4a16-9d00-d3ee9946d5f6 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] HTTP exception thrown: Instance e74832ce-b06a-4786-b3f3-372e508a4795 could not be found. Jul 23 21:31:40.978963 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c703fe6e-b219-4a16-9d00-d3ee9946d5f6 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Request method failure captured: Jul 23 21:31:40.978963 ncdv-master-1 devstack@n-api.service[131320]: request: POST /compute/v2.1/servers/e74832ce-b06a-4786-b3f3-372e508a4795/action HTTP/1.1 Jul 23 21:31:40.978963 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:31:40.978963 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:31:40.978963 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:31:40.978963 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 65 Jul 23 21:31:40.978963 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:31:40.978963 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:31:40.978963 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:31:40.978963 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:31:40.978963 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3Ghf1JjZ4k8tVzERRK8IkLpluLUwa9k5Rz-X0dEr2p4_7xl_eBekUiNk1RZEGsFdGEiApbLOfcuSifirvwiKV1QOTaKdXKwfMnwZgdfagxJjoe3dPYUa3b-d3rVTYewIN_YoX2mMGGBMWRa3po8WOCVIc6hXJLExzq_ndbcO7U8NQBI Jul 23 21:31:40.978963 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:31:40.978963 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:31:40.978963 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:31:40.978963 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:31:40.978963 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:31:40.978963 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:31:40.978963 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: d70f6c96e1ad484aa3207fc01a12d519 Jul 23 21:31:40.978963 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:31:40.978963 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:31:40.978963 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:31:40.978963 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d70f6c96e1ad484aa3207fc01a12d519"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d70f6c96e1ad484aa3207fc01a12d519"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d70f6c96e1ad484aa3207fc01a12d519", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d70f6c96e1ad484aa3207fc01a12d519"}]}] Jul 23 21:31:40.978963 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:31:40.978963 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: d70f6c96e1ad484aa3207fc01a12d519 Jul 23 21:31:40.978963 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:31:40.978963 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServersNegativeTestJSON-1106538570-project Jul 23 21:31:40.978963 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:31:40.978963 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:31:40.978963 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 6ca9644a73d9468aa39b21548a72bded Jul 23 21:31:40.978963 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServersNegativeTestJSON-1106538570-project Jul 23 21:31:40.978963 ncdv-master-1 devstack@n-api.service[131320]: Jul 23 21:31:40.978963 ncdv-master-1 devstack@n-api.service[131320]: {"rebuild": {"imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a"}} Jul 23 21:31:40.978963 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:31:40.978963 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance e74832ce-b06a-4786-b3f3-372e508a4795 could not be found. Jul 23 21:31:40.978963 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': 'e74832ce-b06a-4786-b3f3-372e508a4795', 'body': {'rebuild': {'imageRef': 'b27b20aa-ef1b-4dd1-989e-321af6343d6a'}}} Jul 23 21:31:40.978963 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:31:40.978963 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:40.978963 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:31:40.978963 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:31:40.978963 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:31:40.978963 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:31:40.978963 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:31:40.978963 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:31:40.978963 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:31:40.978963 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:31:40.978963 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e74832ce-b06a-4786-b3f3-372e508a4795 could not be found. Jul 23 21:31:40.978963 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:31:40.978963 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:31:40.978963 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:31:40.978963 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:40.978963 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:31:40.978963 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:31:40.978963 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:31:40.978963 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:31:40.978963 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:31:40.978963 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:31:40.978963 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:31:40.978963 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:31:40.978963 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:31:40.978963 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:31:40.978963 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:31:40.978963 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:31:40.978963 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Jul 23 21:31:40.978963 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Jul 23 21:31:40.984477 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 23 21:31:40.984477 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:31:40.984477 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:31:40.984477 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:31:40.984477 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:31:40.984477 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e74832ce-b06a-4786-b3f3-372e508a4795 could not be found. Jul 23 21:31:40.984477 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:31:40.984477 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:31:40.984477 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:31:40.984477 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:40.984477 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:31:40.984477 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:31:40.984477 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:31:40.984477 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:31:40.984477 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e74832ce-b06a-4786-b3f3-372e508a4795 could not be found. Jul 23 21:31:40.984477 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:31:40.984477 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c703fe6e-b219-4a16-9d00-d3ee9946d5f6 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Returning 404 to user: Instance e74832ce-b06a-4786-b3f3-372e508a4795 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:31:40.984477 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c703fe6e-b219-4a16-9d00-d3ee9946d5f6 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "POST /compute/v2.1/servers/e74832ce-b06a-4786-b3f3-372e508a4795/action" status: 404 len: 111 microversion: 2.1 time: 0.059818 Jul 23 21:31:40.989770 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2137/4371] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:31:40 2022] POST /compute/v2.1/servers/e74832ce-b06a-4786-b3f3-372e508a4795/action => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 23 21:31:40.992792 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-67a89252-b1a9-4da8-9848-7542d659beec tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:40.993498 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-67a89252-b1a9-4da8-9848-7542d659beec tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] [instance: 5cb6a473-80fe-4569-bd9a-52511d3b81aa] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:41.010214 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-67a89252-b1a9-4da8-9848-7542d659beec tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:41.010861 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-67a89252-b1a9-4da8-9848-7542d659beec tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:41.012914 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-67a89252-b1a9-4da8-9848-7542d659beec tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:41.013371 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-67a89252-b1a9-4da8-9848-7542d659beec tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:41.090538 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-67a89252-b1a9-4da8-9848-7542d659beec tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:41.099168 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-67a89252-b1a9-4da8-9848-7542d659beec tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:41.101896 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-67a89252-b1a9-4da8-9848-7542d659beec tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:41.102934 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-67a89252-b1a9-4da8-9848-7542d659beec tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] 10.222.0.17 "GET /compute/v2.1/servers/5cb6a473-80fe-4569-bd9a-52511d3b81aa" status: 200 len: 1364 microversion: 2.47 time: 0.114921 Jul 23 21:31:41.103841 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2138/4372] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:31:40 2022] GET /compute/v2.1/servers/5cb6a473-80fe-4569-bd9a-52511d3b81aa => generated 1364 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:31:41.119260 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6cd125a4-f008-4004-aae2-0073c37cc68e tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:41.119888 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6cd125a4-f008-4004-aae2-0073c37cc68e tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:41.126433 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6cd125a4-f008-4004-aae2-0073c37cc68e tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:41.126892 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6cd125a4-f008-4004-aae2-0073c37cc68e tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:41.127682 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6cd125a4-f008-4004-aae2-0073c37cc68e tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:41.128129 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6cd125a4-f008-4004-aae2-0073c37cc68e tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:41.133322 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:31:41.336300 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6cd125a4-f008-4004-aae2-0073c37cc68e tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:41.347636 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6cd125a4-f008-4004-aae2-0073c37cc68e tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1505 microversion: 2.1 time: 0.232635 Jul 23 21:31:41.356457 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2139/4373] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:41 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1505 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:41.366576 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9ffeb317-c09d-4067-b617-97c64c9d8a88 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:41.366789 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-9ffeb317-c09d-4067-b617-97c64c9d8a88 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:41.374256 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9ffeb317-c09d-4067-b617-97c64c9d8a88 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:41.374691 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9ffeb317-c09d-4067-b617-97c64c9d8a88 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:41.375488 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9ffeb317-c09d-4067-b617-97c64c9d8a88 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:41.375922 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9ffeb317-c09d-4067-b617-97c64c9d8a88 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:41.728671 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ee8d0ef3-657e-40c9-9b51-7d549d87fa33 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:41.738978 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-ee8d0ef3-657e-40c9-9b51-7d549d87fa33 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/b83d31c6-561b-47f9-a17b-377c54728c08" status: 200 len: 1518 microversion: 2.1 time: 0.814439 Jul 23 21:31:41.750291 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2235/4374] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:40 2022] GET /compute/v2.1/servers/b83d31c6-561b-47f9-a17b-377c54728c08 => generated 1518 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:41.766417 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-065677cb-824a-47ee-9fdf-b4f3a5bc8131 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:41.767868 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-065677cb-824a-47ee-9fdf-b4f3a5bc8131 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:41.775732 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-065677cb-824a-47ee-9fdf-b4f3a5bc8131 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:41.776466 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-065677cb-824a-47ee-9fdf-b4f3a5bc8131 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:41.777642 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-065677cb-824a-47ee-9fdf-b4f3a5bc8131 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:41.779392 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-065677cb-824a-47ee-9fdf-b4f3a5bc8131 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:41.918336 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-9ffeb317-c09d-4067-b617-97c64c9d8a88 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:41.928679 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9ffeb317-c09d-4067-b617-97c64c9d8a88 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1505 microversion: 2.1 time: 0.565575 Jul 23 21:31:41.929512 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2140/4375] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:41 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1505 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:41.946094 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-489fee71-3db0-4dc9-9264-f88ce9d50db2 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:31:41.947933 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-489fee71-3db0-4dc9-9264-f88ce9d50db2 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: e689ab97-0aeb-4229-a51e-7fc562981a27] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:41.954262 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-489fee71-3db0-4dc9-9264-f88ce9d50db2 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] HTTP exception thrown: Instance e689ab97-0aeb-4229-a51e-7fc562981a27 could not be found. Jul 23 21:31:41.956953 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-489fee71-3db0-4dc9-9264-f88ce9d50db2 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Request method failure captured: Jul 23 21:31:41.956953 ncdv-master-1 devstack@n-api.service[131320]: request: POST /compute/v2.1/servers/e689ab97-0aeb-4229-a51e-7fc562981a27/action HTTP/1.1 Jul 23 21:31:41.956953 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:31:41.956953 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:31:41.956953 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:31:41.956953 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 65 Jul 23 21:31:41.956953 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:31:41.956953 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:31:41.956953 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:31:41.956953 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:31:41.956953 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3Ghf1JjZ4k8tVzERRK8IkLpluLUwa9k5Rz-X0dEr2p4_7xl_eBekUiNk1RZEGsFdGEiApbLOfcuSifirvwiKV1QOTaKdXKwfMnwZgdfagxJjoe3dPYUa3b-d3rVTYewIN_YoX2mMGGBMWRa3po8WOCVIc6hXJLExzq_ndbcO7U8NQBI Jul 23 21:31:41.956953 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:31:41.956953 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:31:41.956953 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:31:41.956953 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:31:41.956953 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:31:41.956953 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:31:41.956953 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: d70f6c96e1ad484aa3207fc01a12d519 Jul 23 21:31:41.956953 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:31:41.956953 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:31:41.956953 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:31:41.956953 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d70f6c96e1ad484aa3207fc01a12d519"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d70f6c96e1ad484aa3207fc01a12d519"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d70f6c96e1ad484aa3207fc01a12d519", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d70f6c96e1ad484aa3207fc01a12d519"}]}] Jul 23 21:31:41.956953 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:31:41.956953 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: d70f6c96e1ad484aa3207fc01a12d519 Jul 23 21:31:41.956953 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:31:41.956953 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServersNegativeTestJSON-1106538570-project Jul 23 21:31:41.956953 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:31:41.956953 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:31:41.956953 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 6ca9644a73d9468aa39b21548a72bded Jul 23 21:31:41.956953 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServersNegativeTestJSON-1106538570-project Jul 23 21:31:41.956953 ncdv-master-1 devstack@n-api.service[131320]: Jul 23 21:31:41.956953 ncdv-master-1 devstack@n-api.service[131320]: {"rebuild": {"imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a"}} Jul 23 21:31:41.956953 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:31:41.956953 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance e689ab97-0aeb-4229-a51e-7fc562981a27 could not be found. Jul 23 21:31:41.956953 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': 'e689ab97-0aeb-4229-a51e-7fc562981a27', 'body': {'rebuild': {'imageRef': 'b27b20aa-ef1b-4dd1-989e-321af6343d6a'}}} Jul 23 21:31:41.956953 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:31:41.956953 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:41.956953 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:31:41.956953 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:31:41.956953 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:31:41.956953 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:31:41.956953 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 23 21:31:41.956953 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 23 21:31:41.956953 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e689ab97-0aeb-4229-a51e-7fc562981a27 could not be found. Jul 23 21:31:41.956953 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:31:41.956953 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:31:41.956953 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:31:41.956953 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:41.956953 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:31:41.956953 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:31:41.956953 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:31:41.956953 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:31:41.956953 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:31:41.956953 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:31:41.956953 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:31:41.956953 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:31:41.956953 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:31:41.956953 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:31:41.956953 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:31:41.956953 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:31:41.956953 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Jul 23 21:31:41.956953 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Jul 23 21:31:41.956953 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 23 21:31:41.956953 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:31:41.960779 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:31:41.960779 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:31:41.960779 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:31:41.960779 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e689ab97-0aeb-4229-a51e-7fc562981a27 could not be found. Jul 23 21:31:41.960779 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:31:41.960779 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:31:41.960779 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:31:41.960779 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:41.960779 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:31:41.960779 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:31:41.960779 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:31:41.960779 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:31:41.960779 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e689ab97-0aeb-4229-a51e-7fc562981a27 could not be found. Jul 23 21:31:41.960779 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:31:41.963172 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-489fee71-3db0-4dc9-9264-f88ce9d50db2 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Returning 404 to user: Instance e689ab97-0aeb-4229-a51e-7fc562981a27 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:31:41.963315 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-065677cb-824a-47ee-9fdf-b4f3a5bc8131 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:41.964857 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-489fee71-3db0-4dc9-9264-f88ce9d50db2 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "POST /compute/v2.1/servers/e689ab97-0aeb-4229-a51e-7fc562981a27/action" status: 404 len: 111 microversion: 2.1 time: 0.022831 Jul 23 21:31:41.966011 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2141/4376] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:31:41 2022] POST /compute/v2.1/servers/e689ab97-0aeb-4229-a51e-7fc562981a27/action => generated 111 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 23 21:31:41.974317 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9afa2eb9-ca7b-4af5-80cf-e3be1f096109 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:41.975607 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-9afa2eb9-ca7b-4af5-80cf-e3be1f096109 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:41.983943 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9afa2eb9-ca7b-4af5-80cf-e3be1f096109 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:41.984681 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9afa2eb9-ca7b-4af5-80cf-e3be1f096109 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:41.985566 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-065677cb-824a-47ee-9fdf-b4f3a5bc8131 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:41.985949 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9afa2eb9-ca7b-4af5-80cf-e3be1f096109 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:41.986594 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9afa2eb9-ca7b-4af5-80cf-e3be1f096109 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:41.987125 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-065677cb-824a-47ee-9fdf-b4f3a5bc8131 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:41.988312 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-065677cb-824a-47ee-9fdf-b4f3a5bc8131 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.236865 Jul 23 21:31:42.002934 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2236/4377] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:31:41 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:31:42.126452 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-32ece85e-5732-4b16-b889-45a471e0b6b9 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:42.127085 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-32ece85e-5732-4b16-b889-45a471e0b6b9 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] [instance: 5cb6a473-80fe-4569-bd9a-52511d3b81aa] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:42.133434 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-32ece85e-5732-4b16-b889-45a471e0b6b9 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:42.133907 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-32ece85e-5732-4b16-b889-45a471e0b6b9 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:42.134968 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-32ece85e-5732-4b16-b889-45a471e0b6b9 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:42.135765 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-32ece85e-5732-4b16-b889-45a471e0b6b9 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:42.241067 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-32ece85e-5732-4b16-b889-45a471e0b6b9 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:42.258463 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-32ece85e-5732-4b16-b889-45a471e0b6b9 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:42.260246 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-32ece85e-5732-4b16-b889-45a471e0b6b9 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:42.262492 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-32ece85e-5732-4b16-b889-45a471e0b6b9 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] 10.222.0.17 "GET /compute/v2.1/servers/5cb6a473-80fe-4569-bd9a-52511d3b81aa" status: 200 len: 1364 microversion: 2.47 time: 0.141869 Jul 23 21:31:42.274524 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2237/4378] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:31:42 2022] GET /compute/v2.1/servers/5cb6a473-80fe-4569-bd9a-52511d3b81aa => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:31:42.318781 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-9afa2eb9-ca7b-4af5-80cf-e3be1f096109 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:42.327948 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9afa2eb9-ca7b-4af5-80cf-e3be1f096109 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1505 microversion: 2.1 time: 0.357665 Jul 23 21:31:42.328931 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2142/4379] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:41 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1505 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:31:42.350124 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-9867e281-996c-44a5-994b-ce3f825cb31a tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:42.350963 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-9867e281-996c-44a5-994b-ce3f825cb31a tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:42.359020 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9867e281-996c-44a5-994b-ce3f825cb31a tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:42.359882 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9867e281-996c-44a5-994b-ce3f825cb31a tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:42.361086 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9867e281-996c-44a5-994b-ce3f825cb31a tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:42.361690 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9867e281-996c-44a5-994b-ce3f825cb31a tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:42.715992 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-9867e281-996c-44a5-994b-ce3f825cb31a tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:42.731403 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-9867e281-996c-44a5-994b-ce3f825cb31a tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1505 microversion: 2.1 time: 0.388093 Jul 23 21:31:42.749798 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b2bb5528-f412-4bc2-b778-f66a405393d7 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:31:42.750378 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b2bb5528-f412-4bc2-b778-f66a405393d7 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: 8890d80f-58ba-494d-85aa-e2418d76bca1] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:42.755034 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2238/4380] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:42 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1505 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:42.765655 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-b2bb5528-f412-4bc2-b778-f66a405393d7 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] HTTP exception thrown: Instance 8890d80f-58ba-494d-85aa-e2418d76bca1 could not be found. Jul 23 21:31:42.766848 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-719c42ae-6073-45c5-8afb-6708012034f0 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:42.769115 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-719c42ae-6073-45c5-8afb-6708012034f0 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: b83d31c6-561b-47f9-a17b-377c54728c08] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:42.769847 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b2bb5528-f412-4bc2-b778-f66a405393d7 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Request method failure captured: Jul 23 21:31:42.769847 ncdv-master-1 devstack@n-api.service[131320]: request: POST /compute/v2.1/servers/8890d80f-58ba-494d-85aa-e2418d76bca1/action HTTP/1.1 Jul 23 21:31:42.769847 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:31:42.769847 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:31:42.769847 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:31:42.769847 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 15 Jul 23 21:31:42.769847 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:31:42.769847 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:31:42.769847 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:31:42.769847 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:31:42.769847 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3Ghf1JjZ4k8tVzERRK8IkLpluLUwa9k5Rz-X0dEr2p4_7xl_eBekUiNk1RZEGsFdGEiApbLOfcuSifirvwiKV1QOTaKdXKwfMnwZgdfagxJjoe3dPYUa3b-d3rVTYewIN_YoX2mMGGBMWRa3po8WOCVIc6hXJLExzq_ndbcO7U8NQBI Jul 23 21:31:42.769847 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:31:42.769847 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:31:42.769847 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:31:42.769847 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:31:42.769847 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:31:42.769847 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:31:42.769847 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: d70f6c96e1ad484aa3207fc01a12d519 Jul 23 21:31:42.769847 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:31:42.769847 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:31:42.769847 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:31:42.769847 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d70f6c96e1ad484aa3207fc01a12d519"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d70f6c96e1ad484aa3207fc01a12d519"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d70f6c96e1ad484aa3207fc01a12d519", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d70f6c96e1ad484aa3207fc01a12d519"}]}] Jul 23 21:31:42.769847 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:31:42.769847 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: d70f6c96e1ad484aa3207fc01a12d519 Jul 23 21:31:42.769847 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:31:42.769847 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServersNegativeTestJSON-1106538570-project Jul 23 21:31:42.769847 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:31:42.769847 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:31:42.769847 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 6ca9644a73d9468aa39b21548a72bded Jul 23 21:31:42.769847 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServersNegativeTestJSON-1106538570-project Jul 23 21:31:42.769847 ncdv-master-1 devstack@n-api.service[131320]: Jul 23 21:31:42.769847 ncdv-master-1 devstack@n-api.service[131320]: {"restore": {}} Jul 23 21:31:42.769847 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:31:42.769847 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance 8890d80f-58ba-494d-85aa-e2418d76bca1 could not be found. Jul 23 21:31:42.769847 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '8890d80f-58ba-494d-85aa-e2418d76bca1', 'body': {'restore': {}}} Jul 23 21:31:42.769847 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:31:42.769847 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:42.769847 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:31:42.769847 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:31:42.769847 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:31:42.769847 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:31:42.769847 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 23 21:31:42.769847 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 23 21:31:42.769847 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8890d80f-58ba-494d-85aa-e2418d76bca1 could not be found. Jul 23 21:31:42.769847 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:31:42.769847 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:31:42.769847 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:31:42.769847 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:42.769847 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:31:42.769847 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:31:42.769847 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:31:42.769847 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:31:42.769847 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:31:42.769847 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:31:42.769847 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Jul 23 21:31:42.769847 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 23 21:31:42.769847 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:31:42.769847 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:31:42.769847 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8890d80f-58ba-494d-85aa-e2418d76bca1 could not be found. Jul 23 21:31:42.769847 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:31:42.769847 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:31:42.769847 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:31:42.769847 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:42.769847 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:31:42.769847 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:31:42.774745 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:31:42.774745 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:31:42.774745 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8890d80f-58ba-494d-85aa-e2418d76bca1 could not be found. Jul 23 21:31:42.774745 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:31:42.776240 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b2bb5528-f412-4bc2-b778-f66a405393d7 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Returning 404 to user: Instance 8890d80f-58ba-494d-85aa-e2418d76bca1 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:31:42.778838 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b2bb5528-f412-4bc2-b778-f66a405393d7 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "POST /compute/v2.1/servers/8890d80f-58ba-494d-85aa-e2418d76bca1/action" status: 404 len: 111 microversion: 2.1 time: 0.034198 Jul 23 21:31:42.785176 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2143/4381] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:31:42 2022] POST /compute/v2.1/servers/8890d80f-58ba-494d-85aa-e2418d76bca1/action => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:31:42.790703 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-719c42ae-6073-45c5-8afb-6708012034f0 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:42.794500 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-719c42ae-6073-45c5-8afb-6708012034f0 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:42.795635 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-719c42ae-6073-45c5-8afb-6708012034f0 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:42.796241 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-719c42ae-6073-45c5-8afb-6708012034f0 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:42.796746 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a05080d3-8407-4eb8-a6e2-5b1d5c286ded tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:42.799961 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a05080d3-8407-4eb8-a6e2-5b1d5c286ded tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:42.849398 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a05080d3-8407-4eb8-a6e2-5b1d5c286ded tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:42.852986 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a05080d3-8407-4eb8-a6e2-5b1d5c286ded tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:42.860585 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a05080d3-8407-4eb8-a6e2-5b1d5c286ded tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:42.861358 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a05080d3-8407-4eb8-a6e2-5b1d5c286ded tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:43.195184 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a05080d3-8407-4eb8-a6e2-5b1d5c286ded tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:43.219385 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a05080d3-8407-4eb8-a6e2-5b1d5c286ded tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1505 microversion: 2.1 time: 0.431107 Jul 23 21:31:43.220028 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2144/4382] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:42 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1505 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:43.225496 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ade48277-5910-4e25-8850-24d14abaedb8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:43.226140 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ade48277-5910-4e25-8850-24d14abaedb8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:43.247351 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ade48277-5910-4e25-8850-24d14abaedb8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:43.247351 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ade48277-5910-4e25-8850-24d14abaedb8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:43.247577 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ade48277-5910-4e25-8850-24d14abaedb8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:43.247962 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ade48277-5910-4e25-8850-24d14abaedb8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:43.447592 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ade48277-5910-4e25-8850-24d14abaedb8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:43.468242 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ade48277-5910-4e25-8850-24d14abaedb8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:43.469770 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ade48277-5910-4e25-8850-24d14abaedb8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:43.474543 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ade48277-5910-4e25-8850-24d14abaedb8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.253324 Jul 23 21:31:43.475154 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2145/4383] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:31:43 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:31:43.501649 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5dd7bcbe-d9c7-42fe-bab4-c5ce05bd803d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:43.512618 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-719c42ae-6073-45c5-8afb-6708012034f0 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:43.519104 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5dd7bcbe-d9c7-42fe-bab4-c5ce05bd803d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:43.526199 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-719c42ae-6073-45c5-8afb-6708012034f0 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/b83d31c6-561b-47f9-a17b-377c54728c08" status: 200 len: 1518 microversion: 2.1 time: 0.764993 Jul 23 21:31:43.529194 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5dd7bcbe-d9c7-42fe-bab4-c5ce05bd803d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:43.530117 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5dd7bcbe-d9c7-42fe-bab4-c5ce05bd803d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:43.531210 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5dd7bcbe-d9c7-42fe-bab4-c5ce05bd803d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:43.531795 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5dd7bcbe-d9c7-42fe-bab4-c5ce05bd803d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:43.535981 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2239/4384] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:42 2022] GET /compute/v2.1/servers/b83d31c6-561b-47f9-a17b-377c54728c08 => generated 1518 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:43.543399 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-21908dc8-8764-42d2-88f4-b4c8cc230c30 req-5451d00c-55ea-4985-ad26-18027dc575af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f5b9a5a-109e-48b5-adc1-113384944dce", "tag": "b947908f-6578-44ec-898d-fff1852fea99"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:31:43.560958 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-21908dc8-8764-42d2-88f4-b4c8cc230c30 req-5451d00c-55ea-4985-ad26-18027dc575af service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:43.564631 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-21908dc8-8764-42d2-88f4-b4c8cc230c30 req-5451d00c-55ea-4985-ad26-18027dc575af service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:43.582570 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-21908dc8-8764-42d2-88f4-b4c8cc230c30 req-5451d00c-55ea-4985-ad26-18027dc575af service nova] Creating event network-changed:b947908f-6578-44ec-898d-fff1852fea99 for instance 1f5b9a5a-109e-48b5-adc1-113384944dce on nch2-master-1 Jul 23 21:31:43.592771 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-21908dc8-8764-42d2-88f4-b4c8cc230c30 req-5451d00c-55ea-4985-ad26-18027dc575af service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055156 Jul 23 21:31:43.593429 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2240/4385] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:31:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:31:43.604289 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a7f77111-7b28-4f2b-8212-b12ec72b88b3 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:43.605801 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-a7f77111-7b28-4f2b-8212-b12ec72b88b3 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] [instance: 5cb6a473-80fe-4569-bd9a-52511d3b81aa] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:43.624573 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a7f77111-7b28-4f2b-8212-b12ec72b88b3 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:43.625264 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a7f77111-7b28-4f2b-8212-b12ec72b88b3 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:43.626259 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a7f77111-7b28-4f2b-8212-b12ec72b88b3 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:43.626848 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a7f77111-7b28-4f2b-8212-b12ec72b88b3 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:43.775625 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-a7f77111-7b28-4f2b-8212-b12ec72b88b3 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:43.794176 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-a7f77111-7b28-4f2b-8212-b12ec72b88b3 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:43.799227 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-a7f77111-7b28-4f2b-8212-b12ec72b88b3 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:43.801340 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-a7f77111-7b28-4f2b-8212-b12ec72b88b3 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] 10.222.0.17 "GET /compute/v2.1/servers/5cb6a473-80fe-4569-bd9a-52511d3b81aa" status: 200 len: 1364 microversion: 2.47 time: 0.206575 Jul 23 21:31:43.802213 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2241/4386] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:31:43 2022] GET /compute/v2.1/servers/5cb6a473-80fe-4569-bd9a-52511d3b81aa => generated 1364 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:31:44.000907 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5dd7bcbe-d9c7-42fe-bab4-c5ce05bd803d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:44.011654 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5dd7bcbe-d9c7-42fe-bab4-c5ce05bd803d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1505 microversion: 2.1 time: 0.514676 Jul 23 21:31:44.012820 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2146/4387] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:43 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1505 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:44.032765 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-4c029ce5-5bef-440a-85a7-4480c6feb0e3 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:31:44.032765 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-4c029ce5-5bef-440a-85a7-4480c6feb0e3 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:44.038850 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4c029ce5-5bef-440a-85a7-4480c6feb0e3 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:44.039541 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4c029ce5-5bef-440a-85a7-4480c6feb0e3 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:44.040540 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4c029ce5-5bef-440a-85a7-4480c6feb0e3 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:44.041247 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4c029ce5-5bef-440a-85a7-4480c6feb0e3 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:44.115756 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-4c029ce5-5bef-440a-85a7-4480c6feb0e3 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] HTTP exception thrown: Cannot 'restore' instance f2ad2cfd-7479-48d0-b802-cdd5d5093305 while it is in vm_state active Jul 23 21:31:44.119880 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-4c029ce5-5bef-440a-85a7-4480c6feb0e3 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Request method failure captured: Jul 23 21:31:44.119880 ncdv-master-1 devstack@n-api.service[131321]: request: POST /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305/action HTTP/1.1 Jul 23 21:31:44.119880 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:31:44.119880 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:31:44.119880 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:31:44.119880 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 15 Jul 23 21:31:44.119880 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:31:44.119880 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:31:44.119880 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:31:44.119880 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:31:44.119880 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3Ghf1JjZ4k8tVzERRK8IkLpluLUwa9k5Rz-X0dEr2p4_7xl_eBekUiNk1RZEGsFdGEiApbLOfcuSifirvwiKV1QOTaKdXKwfMnwZgdfagxJjoe3dPYUa3b-d3rVTYewIN_YoX2mMGGBMWRa3po8WOCVIc6hXJLExzq_ndbcO7U8NQBI Jul 23 21:31:44.119880 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:31:44.119880 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:31:44.119880 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:31:44.119880 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:31:44.119880 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:31:44.119880 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:31:44.119880 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: d70f6c96e1ad484aa3207fc01a12d519 Jul 23 21:31:44.119880 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:31:44.119880 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:31:44.119880 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:31:44.119880 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d70f6c96e1ad484aa3207fc01a12d519"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d70f6c96e1ad484aa3207fc01a12d519"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d70f6c96e1ad484aa3207fc01a12d519", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d70f6c96e1ad484aa3207fc01a12d519"}]}] Jul 23 21:31:44.119880 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:31:44.119880 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: d70f6c96e1ad484aa3207fc01a12d519 Jul 23 21:31:44.119880 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:31:44.119880 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ServersNegativeTestJSON-1106538570-project Jul 23 21:31:44.119880 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:31:44.119880 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:31:44.119880 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 6ca9644a73d9468aa39b21548a72bded Jul 23 21:31:44.119880 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ServersNegativeTestJSON-1106538570-project Jul 23 21:31:44.119880 ncdv-master-1 devstack@n-api.service[131321]: Jul 23 21:31:44.119880 ncdv-master-1 devstack@n-api.service[131321]: {"restore": {}} Jul 23 21:31:44.119880 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:31:44.119880 ncdv-master-1 devstack@n-api.service[131321]: exception: Cannot 'restore' instance f2ad2cfd-7479-48d0-b802-cdd5d5093305 while it is in vm_state active Jul 23 21:31:44.119880 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': 'f2ad2cfd-7479-48d0-b802-cdd5d5093305', 'body': {'restore': {}}} Jul 23 21:31:44.119880 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:31:44.119880 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:44.119880 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Jul 23 21:31:44.119880 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Jul 23 21:31:44.119880 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 23 21:31:44.119880 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 23 21:31:44.119880 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 23 21:31:44.119880 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 23 21:31:44.119880 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f2ad2cfd-7479-48d0-b802-cdd5d5093305 in vm_state active. Cannot restore while the instance is in this state. Jul 23 21:31:44.119880 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:44.119880 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:31:44.119880 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:44.119880 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:44.119880 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:31:44.119880 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:31:44.119880 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:31:44.119880 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:31:44.119880 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:31:44.119880 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:31:44.119880 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Jul 23 21:31:44.119880 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 23 21:31:44.119880 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 23 21:31:44.119880 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 23 21:31:44.119880 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance f2ad2cfd-7479-48d0-b802-cdd5d5093305 while it is in vm_state active Jul 23 21:31:44.119880 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:44.119880 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:31:44.119880 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:44.119880 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:44.119880 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:31:44.124207 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:31:44.124207 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:31:44.124207 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:31:44.124207 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance f2ad2cfd-7479-48d0-b802-cdd5d5093305 while it is in vm_state active Jul 23 21:31:44.124207 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:44.126770 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-4c029ce5-5bef-440a-85a7-4480c6feb0e3 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Returning 409 to user: Cannot 'restore' instance f2ad2cfd-7479-48d0-b802-cdd5d5093305 while it is in vm_state active {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:31:44.128227 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-4c029ce5-5bef-440a-85a7-4480c6feb0e3 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "POST /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305/action" status: 409 len: 145 microversion: 2.1 time: 0.102695 Jul 23 21:31:44.132372 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2242/4388] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:31:44 2022] POST /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305/action => generated 145 bytes in 105 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 23 21:31:44.139498 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ea2b5946-2822-437d-9f34-2d0448df2fc4 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:44.140491 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ea2b5946-2822-437d-9f34-2d0448df2fc4 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:44.152050 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ea2b5946-2822-437d-9f34-2d0448df2fc4 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:44.153832 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ea2b5946-2822-437d-9f34-2d0448df2fc4 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:44.155303 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ea2b5946-2822-437d-9f34-2d0448df2fc4 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:44.156533 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ea2b5946-2822-437d-9f34-2d0448df2fc4 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:44.435986 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ccf3538d-7f72-4a48-98e7-99bc864a7496 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:44.436482 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-ccf3538d-7f72-4a48-98e7-99bc864a7496 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] [instance: b90d9c54-1b5f-40db-acc6-67aaf46def15] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:44.443178 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ccf3538d-7f72-4a48-98e7-99bc864a7496 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:44.443634 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ccf3538d-7f72-4a48-98e7-99bc864a7496 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:44.444401 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ccf3538d-7f72-4a48-98e7-99bc864a7496 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:44.444841 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ccf3538d-7f72-4a48-98e7-99bc864a7496 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:44.474756 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-ccf3538d-7f72-4a48-98e7-99bc864a7496 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] 10.222.0.17 "GET /compute/v2.1/servers/b90d9c54-1b5f-40db-acc6-67aaf46def15/ips" status: 200 len: 150 microversion: 2.1 time: 0.042540 Jul 23 21:31:44.475793 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2243/4389] 10.222.0.17 () {58 vars in 1247 bytes} [Sat Jul 23 21:31:44 2022] GET /compute/v2.1/servers/b90d9c54-1b5f-40db-acc6-67aaf46def15/ips => generated 150 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:31:44.504626 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e2ec3a2f-6bbb-4344-a534-44826cfa89b2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:44.505407 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-e2ec3a2f-6bbb-4344-a534-44826cfa89b2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:44.515972 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e2ec3a2f-6bbb-4344-a534-44826cfa89b2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:44.516928 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e2ec3a2f-6bbb-4344-a534-44826cfa89b2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:44.517829 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e2ec3a2f-6bbb-4344-a534-44826cfa89b2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:44.518704 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e2ec3a2f-6bbb-4344-a534-44826cfa89b2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:44.612762 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-e2ec3a2f-6bbb-4344-a534-44826cfa89b2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:44.640460 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-e2ec3a2f-6bbb-4344-a534-44826cfa89b2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:44.648132 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-e2ec3a2f-6bbb-4344-a534-44826cfa89b2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:44.649774 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-e2ec3a2f-6bbb-4344-a534-44826cfa89b2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.151364 Jul 23 21:31:44.650475 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2244/4390] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:31:44 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:31:44.676783 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-483532fe-49df-4a57-8edb-f94c08cf0258 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:44.681226 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ea2b5946-2822-437d-9f34-2d0448df2fc4 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:44.681743 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-483532fe-49df-4a57-8edb-f94c08cf0258 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: b83d31c6-561b-47f9-a17b-377c54728c08] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:44.689845 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ea2b5946-2822-437d-9f34-2d0448df2fc4 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1505 microversion: 2.1 time: 0.555640 Jul 23 21:31:44.702377 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-483532fe-49df-4a57-8edb-f94c08cf0258 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:44.702487 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2147/4391] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:44 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1505 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:44.702589 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-483532fe-49df-4a57-8edb-f94c08cf0258 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:44.702589 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-483532fe-49df-4a57-8edb-f94c08cf0258 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:44.702589 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-483532fe-49df-4a57-8edb-f94c08cf0258 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:44.711050 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b5b3e9c0-fab9-404d-b820-de051b02fb81 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:44.711868 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b5b3e9c0-fab9-404d-b820-de051b02fb81 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:44.723180 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b5b3e9c0-fab9-404d-b820-de051b02fb81 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:44.723822 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b5b3e9c0-fab9-404d-b820-de051b02fb81 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:44.726065 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b5b3e9c0-fab9-404d-b820-de051b02fb81 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:44.728463 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b5b3e9c0-fab9-404d-b820-de051b02fb81 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:44.747985 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-483532fe-49df-4a57-8edb-f94c08cf0258 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] HTTP exception thrown: Instance b83d31c6-561b-47f9-a17b-377c54728c08 could not be found. Jul 23 21:31:44.751544 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-483532fe-49df-4a57-8edb-f94c08cf0258 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Request method failure captured: Jul 23 21:31:44.751544 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/servers/b83d31c6-561b-47f9-a17b-377c54728c08 HTTP/1.1 Jul 23 21:31:44.751544 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:31:44.751544 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:31:44.751544 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:31:44.751544 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:31:44.751544 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:31:44.751544 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:31:44.751544 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:31:44.751544 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:31:44.751544 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GgexSaJTA-FXaV5LcqTAteOVESwOg7zac7nwUa59CGOHDwwWd7w7HKC8R65F9X48OwLZ_a8UsJYui6X5BG5uL_WJC-ysEg9nxrojp43TnKgPHTkujcdOw9VWLxqM9CE8dPwhawUMo8jE8x_rLu-o0j9Xf_QveShH-OlX4BIDLcYoyo Jul 23 21:31:44.751544 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:31:44.751544 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:31:44.751544 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:31:44.751544 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:31:44.751544 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:31:44.751544 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:31:44.751544 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 1890022bd460485dae0ea94b152a6746 Jul 23 21:31:44.751544 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ServersTestJSON-1141465764 Jul 23 21:31:44.751544 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:31:44.751544 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:31:44.751544 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1890022bd460485dae0ea94b152a6746"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1890022bd460485dae0ea94b152a6746"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1890022bd460485dae0ea94b152a6746", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1890022bd460485dae0ea94b152a6746"}]}] Jul 23 21:31:44.751544 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ServersTestJSON-1141465764 Jul 23 21:31:44.751544 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 1890022bd460485dae0ea94b152a6746 Jul 23 21:31:44.751544 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ServersTestJSON-1141465764 Jul 23 21:31:44.751544 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ServersTestJSON-1141465764-project Jul 23 21:31:44.751544 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:31:44.751544 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:31:44.751544 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 5efda1c40f494592bf1e6af1add120f3 Jul 23 21:31:44.751544 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ServersTestJSON-1141465764-project Jul 23 21:31:44.751544 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:31:44.751544 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance b83d31c6-561b-47f9-a17b-377c54728c08 could not be found. Jul 23 21:31:44.751544 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': 'b83d31c6-561b-47f9-a17b-377c54728c08'} Jul 23 21:31:44.751544 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:31:44.751544 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:44.751544 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:31:44.751544 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:31:44.751544 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:31:44.751544 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:31:44.751544 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:31:44.751544 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:31:44.751544 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:31:44.751544 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:31:44.751544 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b83d31c6-561b-47f9-a17b-377c54728c08 could not be found. Jul 23 21:31:44.751544 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:44.751544 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:31:44.751544 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:44.751544 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:44.751544 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:31:44.751544 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:31:44.751544 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:31:44.751544 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:31:44.751544 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:31:44.751544 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:31:44.751544 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:31:44.751544 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:31:44.751544 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:31:44.751544 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:31:44.751544 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:31:44.751544 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:31:44.751544 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b83d31c6-561b-47f9-a17b-377c54728c08 could not be found. Jul 23 21:31:44.751544 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:44.751544 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:31:44.751544 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:44.751544 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:44.756471 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:31:44.756471 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:31:44.756471 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:31:44.756471 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:31:44.756471 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b83d31c6-561b-47f9-a17b-377c54728c08 could not be found. Jul 23 21:31:44.756471 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:44.757925 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-483532fe-49df-4a57-8edb-f94c08cf0258 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Returning 404 to user: Instance b83d31c6-561b-47f9-a17b-377c54728c08 could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:31:44.766265 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-483532fe-49df-4a57-8edb-f94c08cf0258 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/b83d31c6-561b-47f9-a17b-377c54728c08" status: 404 len: 111 microversion: 2.1 time: 0.114653 Jul 23 21:31:44.768056 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2245/4392] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:44 2022] GET /compute/v2.1/servers/b83d31c6-561b-47f9-a17b-377c54728c08 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:31:44.821219 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-bb13fd27-1977-4e7c-878f-b582aa9a51f5 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:44.821855 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-bb13fd27-1977-4e7c-878f-b582aa9a51f5 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] [instance: 5cb6a473-80fe-4569-bd9a-52511d3b81aa] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:44.831051 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bb13fd27-1977-4e7c-878f-b582aa9a51f5 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:44.834497 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bb13fd27-1977-4e7c-878f-b582aa9a51f5 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:44.835600 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bb13fd27-1977-4e7c-878f-b582aa9a51f5 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:44.836088 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bb13fd27-1977-4e7c-878f-b582aa9a51f5 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:44.847078 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=100 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:31:44.932275 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-bb13fd27-1977-4e7c-878f-b582aa9a51f5 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:44.943045 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-bb13fd27-1977-4e7c-878f-b582aa9a51f5 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:44.944830 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-bb13fd27-1977-4e7c-878f-b582aa9a51f5 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:44.946441 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-bb13fd27-1977-4e7c-878f-b582aa9a51f5 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] 10.222.0.17 "GET /compute/v2.1/servers/5cb6a473-80fe-4569-bd9a-52511d3b81aa" status: 200 len: 1364 microversion: 2.47 time: 0.129655 Jul 23 21:31:44.948096 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2246/4393] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:31:44 2022] GET /compute/v2.1/servers/5cb6a473-80fe-4569-bd9a-52511d3b81aa => generated 1364 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:31:44.953416 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-7d38d7c3-3659-491f-adbd-7d7c88ecffda tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-463130371", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "networks": [{"uuid": "63d253f9-5d83-4f00-8bc3-28f418cf7611"}]}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:31:45.013541 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.network.neutron [None req-7d38d7c3-3659-491f-adbd-7d7c88ecffda tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] validate_networks() for [('63d253f9-5d83-4f00-8bc3-28f418cf7611', None, None, None, None, None)] {{(pid=131321) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:31:45.143509 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b5b3e9c0-fab9-404d-b820-de051b02fb81 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:45.155000 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b5b3e9c0-fab9-404d-b820-de051b02fb81 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1505 microversion: 2.1 time: 0.447978 Jul 23 21:31:45.159806 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2148/4394] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:44 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1505 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:45.175879 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-92b91a5b-df9c-4c7e-989a-8bc9fd70c710 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:31:45.176422 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-92b91a5b-df9c-4c7e-989a-8bc9fd70c710 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: 03916973-2072-46d5-ba08-23e8d848e094] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:45.182334 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-92b91a5b-df9c-4c7e-989a-8bc9fd70c710 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] HTTP exception thrown: Instance 03916973-2072-46d5-ba08-23e8d848e094 could not be found. Jul 23 21:31:45.189740 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-92b91a5b-df9c-4c7e-989a-8bc9fd70c710 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Request method failure captured: Jul 23 21:31:45.189740 ncdv-master-1 devstack@n-api.service[131320]: request: POST /compute/v2.1/servers/03916973-2072-46d5-ba08-23e8d848e094/action HTTP/1.1 Jul 23 21:31:45.189740 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:31:45.189740 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:31:45.189740 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:31:45.189740 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 14 Jul 23 21:31:45.189740 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:31:45.189740 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:31:45.189740 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:31:45.189740 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:31:45.189740 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3Ghf1JjZ4k8tVzERRK8IkLpluLUwa9k5Rz-X0dEr2p4_7xl_eBekUiNk1RZEGsFdGEiApbLOfcuSifirvwiKV1QOTaKdXKwfMnwZgdfagxJjoe3dPYUa3b-d3rVTYewIN_YoX2mMGGBMWRa3po8WOCVIc6hXJLExzq_ndbcO7U8NQBI Jul 23 21:31:45.189740 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:31:45.189740 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:31:45.189740 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:31:45.189740 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:31:45.189740 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:31:45.189740 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:31:45.189740 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: d70f6c96e1ad484aa3207fc01a12d519 Jul 23 21:31:45.189740 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:31:45.189740 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:31:45.189740 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:31:45.189740 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d70f6c96e1ad484aa3207fc01a12d519"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d70f6c96e1ad484aa3207fc01a12d519"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d70f6c96e1ad484aa3207fc01a12d519", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d70f6c96e1ad484aa3207fc01a12d519"}]}] Jul 23 21:31:45.189740 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:31:45.189740 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: d70f6c96e1ad484aa3207fc01a12d519 Jul 23 21:31:45.189740 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:31:45.189740 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServersNegativeTestJSON-1106538570-project Jul 23 21:31:45.189740 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:31:45.189740 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:31:45.189740 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 6ca9644a73d9468aa39b21548a72bded Jul 23 21:31:45.189740 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServersNegativeTestJSON-1106538570-project Jul 23 21:31:45.189740 ncdv-master-1 devstack@n-api.service[131320]: Jul 23 21:31:45.189740 ncdv-master-1 devstack@n-api.service[131320]: {"resume": {}} Jul 23 21:31:45.189740 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:31:45.189740 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance 03916973-2072-46d5-ba08-23e8d848e094 could not be found. Jul 23 21:31:45.189740 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '03916973-2072-46d5-ba08-23e8d848e094', 'body': {'resume': {}}} Jul 23 21:31:45.189740 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:31:45.189740 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:45.189740 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:31:45.189740 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:31:45.189740 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:31:45.189740 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:31:45.189740 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 23 21:31:45.189740 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 23 21:31:45.189740 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03916973-2072-46d5-ba08-23e8d848e094 could not be found. Jul 23 21:31:45.189740 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:31:45.189740 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:31:45.189740 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:31:45.189740 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:45.189740 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:31:45.189740 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:31:45.189740 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:31:45.189740 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:31:45.189740 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:31:45.189740 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:31:45.189740 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Jul 23 21:31:45.189740 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Jul 23 21:31:45.189740 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:31:45.189740 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:31:45.189740 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03916973-2072-46d5-ba08-23e8d848e094 could not be found. Jul 23 21:31:45.189740 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:31:45.189740 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:31:45.189740 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:31:45.189740 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:45.189740 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:31:45.189740 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:31:45.193724 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:31:45.193724 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:31:45.193724 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03916973-2072-46d5-ba08-23e8d848e094 could not be found. Jul 23 21:31:45.193724 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:31:45.196241 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-92b91a5b-df9c-4c7e-989a-8bc9fd70c710 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Returning 404 to user: Instance 03916973-2072-46d5-ba08-23e8d848e094 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:31:45.197262 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-92b91a5b-df9c-4c7e-989a-8bc9fd70c710 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "POST /compute/v2.1/servers/03916973-2072-46d5-ba08-23e8d848e094/action" status: 404 len: 111 microversion: 2.1 time: 0.025711 Jul 23 21:31:45.203538 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2149/4395] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:31:45 2022] POST /compute/v2.1/servers/03916973-2072-46d5-ba08-23e8d848e094/action => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:31:45.211534 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-fa46b6dc-e9f4-4d91-8226-ea18ee8222a9 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:45.212341 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-fa46b6dc-e9f4-4d91-8226-ea18ee8222a9 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:45.222452 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fa46b6dc-e9f4-4d91-8226-ea18ee8222a9 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:45.223175 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fa46b6dc-e9f4-4d91-8226-ea18ee8222a9 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:45.224139 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fa46b6dc-e9f4-4d91-8226-ea18ee8222a9 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:45.224785 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fa46b6dc-e9f4-4d91-8226-ea18ee8222a9 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:45.523665 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-fa46b6dc-e9f4-4d91-8226-ea18ee8222a9 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:45.533532 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-fa46b6dc-e9f4-4d91-8226-ea18ee8222a9 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1505 microversion: 2.1 time: 0.326291 Jul 23 21:31:45.534743 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2150/4396] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:45 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1505 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:31:45.554707 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-7fe708e3-b033-4ccc-8d3e-fc69e3790802 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:45.556120 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-7fe708e3-b033-4ccc-8d3e-fc69e3790802 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:45.564447 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7fe708e3-b033-4ccc-8d3e-fc69e3790802 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:45.565103 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7fe708e3-b033-4ccc-8d3e-fc69e3790802 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:45.566710 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7fe708e3-b033-4ccc-8d3e-fc69e3790802 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:45.567311 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7fe708e3-b033-4ccc-8d3e-fc69e3790802 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:45.766612 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-7fe708e3-b033-4ccc-8d3e-fc69e3790802 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:45.777426 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-7fe708e3-b033-4ccc-8d3e-fc69e3790802 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1505 microversion: 2.1 time: 0.227895 Jul 23 21:31:45.778361 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2151/4397] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:45 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1505 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:45.783585 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-1fe72c99-f519-4c89-87d0-08fea56ca165 req-26210a81-d72a-4a02-8556-eef7f3254a5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b83d31c6-561b-47f9-a17b-377c54728c08", "name": "network-vif-deleted", "tag": "a266c338-dcaf-437b-942e-26c032063e60"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:31:45.792373 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-1fe72c99-f519-4c89-87d0-08fea56ca165 req-26210a81-d72a-4a02-8556-eef7f3254a5c service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:45.793151 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-1fe72c99-f519-4c89-87d0-08fea56ca165 req-26210a81-d72a-4a02-8556-eef7f3254a5c service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:45.801296 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-7d38d7c3-3659-491f-adbd-7d7c88ecffda tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Flavor limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:31:45.801842 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-7d38d7c3-3659-491f-adbd-7d7c88ecffda tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Image limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:31:45.802204 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-7d38d7c3-3659-491f-adbd-7d7c88ecffda tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Flavor pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:31:45.802611 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-7d38d7c3-3659-491f-adbd-7d7c88ecffda tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Image pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:31:45.803023 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-7d38d7c3-3659-491f-adbd-7d7c88ecffda tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:31:45.808296 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-1fe72c99-f519-4c89-87d0-08fea56ca165 req-26210a81-d72a-4a02-8556-eef7f3254a5c service nova] Creating event network-vif-deleted:a266c338-dcaf-437b-942e-26c032063e60 for instance b83d31c6-561b-47f9-a17b-377c54728c08 on nch1-master-1 Jul 23 21:31:45.815270 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-1fe72c99-f519-4c89-87d0-08fea56ca165 req-26210a81-d72a-4a02-8556-eef7f3254a5c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034522 Jul 23 21:31:45.816375 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2152/4398] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:31:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:31:45.824975 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7d38d7c3-3659-491f-adbd-7d7c88ecffda tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:45.825428 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7d38d7c3-3659-491f-adbd-7d7c88ecffda tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:45.828714 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-cea188dc-b73d-4625-b613-4e68bed86e9a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:45.829527 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-cea188dc-b73d-4625-b613-4e68bed86e9a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:45.830373 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7d38d7c3-3659-491f-adbd-7d7c88ecffda tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:45.831093 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7d38d7c3-3659-491f-adbd-7d7c88ecffda tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:45.836123 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cea188dc-b73d-4625-b613-4e68bed86e9a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:45.836440 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cea188dc-b73d-4625-b613-4e68bed86e9a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:45.837355 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cea188dc-b73d-4625-b613-4e68bed86e9a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:45.838147 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cea188dc-b73d-4625-b613-4e68bed86e9a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:45.852952 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-7d38d7c3-3659-491f-adbd-7d7c88ecffda tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Getting quotas for project 1890022bd460485dae0ea94b152a6746. Resources: {'ram', 'instances', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:31:45.859405 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-7d38d7c3-3659-491f-adbd-7d7c88ecffda tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Getting quotas for user 5efda1c40f494592bf1e6af1add120f3 and project 1890022bd460485dae0ea94b152a6746. Resources: {'ram', 'instances', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:31:45.873808 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-7d38d7c3-3659-491f-adbd-7d7c88ecffda tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Going to run 1 instances... {{(pid=131321) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:31:45.876707 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-7d38d7c3-3659-491f-adbd-7d7c88ecffda tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: dcc206d0-3170-459e-b48a-8cf9709e1ffb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131321) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:31:45.917617 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-cea188dc-b73d-4625-b613-4e68bed86e9a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:45.936339 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-7d38d7c3-3659-491f-adbd-7d7c88ecffda tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.986850 Jul 23 21:31:45.936859 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-cea188dc-b73d-4625-b613-4e68bed86e9a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:45.937700 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2247/4399] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:31:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 989 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 23 21:31:45.938417 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-cea188dc-b73d-4625-b613-4e68bed86e9a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:45.939608 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-cea188dc-b73d-4625-b613-4e68bed86e9a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.121513 Jul 23 21:31:45.940446 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2153/4400] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:31:45 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:31:45.944157 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-388ad3e3-d16f-4710-9533-6546db8ee950 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:31:45.944694 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-388ad3e3-d16f-4710-9533-6546db8ee950 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:45.951171 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-388ad3e3-d16f-4710-9533-6546db8ee950 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:45.951776 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-388ad3e3-d16f-4710-9533-6546db8ee950 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:45.952748 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-388ad3e3-d16f-4710-9533-6546db8ee950 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:45.953183 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-388ad3e3-d16f-4710-9533-6546db8ee950 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:45.973391 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d3d12180-de8e-42f3-bb0f-156ebcf0aa8a tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:45.974070 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d3d12180-de8e-42f3-bb0f-156ebcf0aa8a tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: dcc206d0-3170-459e-b48a-8cf9709e1ffb] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:45.986932 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-388ad3e3-d16f-4710-9533-6546db8ee950 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] HTTP exception thrown: Cannot 'resume' instance f2ad2cfd-7479-48d0-b802-cdd5d5093305 while it is in vm_state active Jul 23 21:31:45.989989 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-388ad3e3-d16f-4710-9533-6546db8ee950 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Request method failure captured: Jul 23 21:31:45.989989 ncdv-master-1 devstack@n-api.service[131321]: request: POST /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305/action HTTP/1.1 Jul 23 21:31:45.989989 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:31:45.989989 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:31:45.989989 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:31:45.989989 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 14 Jul 23 21:31:45.989989 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:31:45.989989 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:31:45.989989 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:31:45.989989 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:31:45.989989 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3Ghf1JjZ4k8tVzERRK8IkLpluLUwa9k5Rz-X0dEr2p4_7xl_eBekUiNk1RZEGsFdGEiApbLOfcuSifirvwiKV1QOTaKdXKwfMnwZgdfagxJjoe3dPYUa3b-d3rVTYewIN_YoX2mMGGBMWRa3po8WOCVIc6hXJLExzq_ndbcO7U8NQBI Jul 23 21:31:45.989989 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:31:45.989989 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:31:45.989989 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:31:45.989989 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:31:45.989989 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:31:45.989989 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:31:45.989989 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: d70f6c96e1ad484aa3207fc01a12d519 Jul 23 21:31:45.989989 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:31:45.989989 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:31:45.989989 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:31:45.989989 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d70f6c96e1ad484aa3207fc01a12d519"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d70f6c96e1ad484aa3207fc01a12d519"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d70f6c96e1ad484aa3207fc01a12d519", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d70f6c96e1ad484aa3207fc01a12d519"}]}] Jul 23 21:31:45.989989 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:31:45.989989 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: d70f6c96e1ad484aa3207fc01a12d519 Jul 23 21:31:45.989989 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:31:45.989989 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ServersNegativeTestJSON-1106538570-project Jul 23 21:31:45.989989 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:31:45.989989 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:31:45.989989 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 6ca9644a73d9468aa39b21548a72bded Jul 23 21:31:45.989989 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ServersNegativeTestJSON-1106538570-project Jul 23 21:31:45.989989 ncdv-master-1 devstack@n-api.service[131321]: Jul 23 21:31:45.989989 ncdv-master-1 devstack@n-api.service[131321]: {"resume": {}} Jul 23 21:31:45.989989 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:31:45.989989 ncdv-master-1 devstack@n-api.service[131321]: exception: Cannot 'resume' instance f2ad2cfd-7479-48d0-b802-cdd5d5093305 while it is in vm_state active Jul 23 21:31:45.989989 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': 'f2ad2cfd-7479-48d0-b802-cdd5d5093305', 'body': {'resume': {}}} Jul 23 21:31:45.989989 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:31:45.989989 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:45.989989 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Jul 23 21:31:45.989989 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Jul 23 21:31:45.989989 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 23 21:31:45.989989 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 23 21:31:45.989989 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 23 21:31:45.989989 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 23 21:31:45.989989 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f2ad2cfd-7479-48d0-b802-cdd5d5093305 in vm_state active. Cannot resume while the instance is in this state. Jul 23 21:31:45.989989 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:45.989989 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:31:45.989989 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:45.989989 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:45.989989 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:31:45.989989 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:31:45.989989 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:31:45.989989 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:31:45.989989 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:31:45.989989 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:31:45.989989 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Jul 23 21:31:45.989989 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 23 21:31:45.989989 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 23 21:31:45.989989 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 23 21:31:45.989989 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance f2ad2cfd-7479-48d0-b802-cdd5d5093305 while it is in vm_state active Jul 23 21:31:45.989989 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:45.989989 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:31:45.989989 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:45.989989 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:45.989989 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:31:45.995403 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:31:45.995403 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:31:45.995403 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:31:45.995403 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance f2ad2cfd-7479-48d0-b802-cdd5d5093305 while it is in vm_state active Jul 23 21:31:45.995403 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:45.995403 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-388ad3e3-d16f-4710-9533-6546db8ee950 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Returning 409 to user: Cannot 'resume' instance f2ad2cfd-7479-48d0-b802-cdd5d5093305 while it is in vm_state active {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:31:45.995403 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-388ad3e3-d16f-4710-9533-6546db8ee950 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "POST /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305/action" status: 409 len: 144 microversion: 2.1 time: 0.052229 Jul 23 21:31:45.995403 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2248/4401] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:31:45 2022] POST /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305/action => generated 144 bytes in 54 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 23 21:31:45.997072 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-25b8bef3-7325-4efa-a53e-04218210081b tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:45.997676 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-25b8bef3-7325-4efa-a53e-04218210081b tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] [instance: 5cb6a473-80fe-4569-bd9a-52511d3b81aa] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:46.006479 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-25b8bef3-7325-4efa-a53e-04218210081b tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:46.006972 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-25b8bef3-7325-4efa-a53e-04218210081b tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:46.021248 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-25b8bef3-7325-4efa-a53e-04218210081b tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:46.021711 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-25b8bef3-7325-4efa-a53e-04218210081b tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:46.052070 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d3d12180-de8e-42f3-bb0f-156ebcf0aa8a tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:46.068810 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d3d12180-de8e-42f3-bb0f-156ebcf0aa8a tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/dcc206d0-3170-459e-b48a-8cf9709e1ffb" status: 200 len: 1208 microversion: 2.1 time: 0.111641 Jul 23 21:31:46.069395 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2154/4402] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:45 2022] GET /compute/v2.1/servers/dcc206d0-3170-459e-b48a-8cf9709e1ffb => generated 1208 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:46.078744 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3d1baa10-c177-430b-a810-234697ae93d1 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:46.079708 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-3d1baa10-c177-430b-a810-234697ae93d1 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:46.086829 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3d1baa10-c177-430b-a810-234697ae93d1 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:46.087276 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3d1baa10-c177-430b-a810-234697ae93d1 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:46.088299 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3d1baa10-c177-430b-a810-234697ae93d1 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:46.088941 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3d1baa10-c177-430b-a810-234697ae93d1 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:46.176757 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-25b8bef3-7325-4efa-a53e-04218210081b tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:46.185564 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-25b8bef3-7325-4efa-a53e-04218210081b tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:46.187298 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-25b8bef3-7325-4efa-a53e-04218210081b tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:46.189365 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-25b8bef3-7325-4efa-a53e-04218210081b tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] 10.222.0.17 "GET /compute/v2.1/servers/5cb6a473-80fe-4569-bd9a-52511d3b81aa" status: 200 len: 1364 microversion: 2.47 time: 0.195836 Jul 23 21:31:46.201445 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2249/4403] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:31:45 2022] GET /compute/v2.1/servers/5cb6a473-80fe-4569-bd9a-52511d3b81aa => generated 1364 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:31:46.201445 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-44a15b05-9958-4ae4-9813-4ee49a204d80 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:46.201445 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-44a15b05-9958-4ae4-9813-4ee49a204d80 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] [instance: b90d9c54-1b5f-40db-acc6-67aaf46def15] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:46.202813 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-44a15b05-9958-4ae4-9813-4ee49a204d80 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:46.202813 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-44a15b05-9958-4ae4-9813-4ee49a204d80 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:46.202813 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-44a15b05-9958-4ae4-9813-4ee49a204d80 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:46.204264 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-44a15b05-9958-4ae4-9813-4ee49a204d80 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:46.241941 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-44a15b05-9958-4ae4-9813-4ee49a204d80 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] [instance: b90d9c54-1b5f-40db-acc6-67aaf46def15] Going to try to terminate instance {{(pid=131321) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:31:46.351662 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-3d1baa10-c177-430b-a810-234697ae93d1 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:46.360362 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-3d1baa10-c177-430b-a810-234697ae93d1 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1505 microversion: 2.1 time: 0.287830 Jul 23 21:31:46.377389 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-44a15b05-9958-4ae4-9813-4ee49a204d80 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] 10.222.0.17 "DELETE /compute/v2.1/servers/b90d9c54-1b5f-40db-acc6-67aaf46def15" status: 204 len: 0 microversion: 2.1 time: 0.185707 Jul 23 21:31:46.378375 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2155/4405] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:46 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1505 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:46.379673 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2250/4405] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:31:46 2022] DELETE /compute/v2.1/servers/b90d9c54-1b5f-40db-acc6-67aaf46def15 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:31:46.390927 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d58c4e0f-e7ca-4138-a1de-aeaa0d1c16a2 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:46.392092 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-d58c4e0f-e7ca-4138-a1de-aeaa0d1c16a2 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] [instance: b90d9c54-1b5f-40db-acc6-67aaf46def15] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:46.397564 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-20767d1e-b243-4266-9473-1a2467356e3a tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:46.398361 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-20767d1e-b243-4266-9473-1a2467356e3a tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:46.400844 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d58c4e0f-e7ca-4138-a1de-aeaa0d1c16a2 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:46.402039 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d58c4e0f-e7ca-4138-a1de-aeaa0d1c16a2 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:46.403164 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d58c4e0f-e7ca-4138-a1de-aeaa0d1c16a2 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:46.404170 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d58c4e0f-e7ca-4138-a1de-aeaa0d1c16a2 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:46.412941 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-20767d1e-b243-4266-9473-1a2467356e3a tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:46.413393 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-20767d1e-b243-4266-9473-1a2467356e3a tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:46.414221 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-20767d1e-b243-4266-9473-1a2467356e3a tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:46.414668 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-20767d1e-b243-4266-9473-1a2467356e3a tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:46.637277 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-20767d1e-b243-4266-9473-1a2467356e3a tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:46.647280 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-20767d1e-b243-4266-9473-1a2467356e3a tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1505 microversion: 2.1 time: 0.267731 Jul 23 21:31:46.648816 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2156/4406] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:46 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1505 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:46.651823 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-d58c4e0f-e7ca-4138-a1de-aeaa0d1c16a2 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b1e260651b4dffa7c1efe8e9d0f144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcf55bcaba04bf8ae8a9b2ac09e8d98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:46.675835 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-d58c4e0f-e7ca-4138-a1de-aeaa0d1c16a2 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] 10.222.0.17 "GET /compute/v2.1/servers/b90d9c54-1b5f-40db-acc6-67aaf46def15" status: 200 len: 1680 microversion: 2.1 time: 0.292626 Jul 23 21:31:46.679634 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2251/4407] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:46 2022] GET /compute/v2.1/servers/b90d9c54-1b5f-40db-acc6-67aaf46def15 => generated 1680 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:46.816098 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e7c5ff24-149a-4d25-a550-feb8fb752166 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "networks": [{"uuid": "654a77ca-1e84-434d-8536-1fc3adb327d0"}]}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:31:46.820085 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e7c5ff24-149a-4d25-a550-feb8fb752166 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Request method failure captured: Jul 23 21:31:46.820085 ncdv-master-1 devstack@n-api.service[131320]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 23 21:31:46.820085 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:31:46.820085 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:31:46.820085 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:31:46.820085 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 160 Jul 23 21:31:46.820085 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:31:46.820085 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:31:46.820085 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:31:46.820085 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:31:46.820085 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3Ghf1JjZ4k8tVzERRK8IkLpluLUwa9k5Rz-X0dEr2p4_7xl_eBekUiNk1RZEGsFdGEiApbLOfcuSifirvwiKV1QOTaKdXKwfMnwZgdfagxJjoe3dPYUa3b-d3rVTYewIN_YoX2mMGGBMWRa3po8WOCVIc6hXJLExzq_ndbcO7U8NQBI Jul 23 21:31:46.820085 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:31:46.820085 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:31:46.820085 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:31:46.820085 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:31:46.820085 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:31:46.820085 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:31:46.820085 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: d70f6c96e1ad484aa3207fc01a12d519 Jul 23 21:31:46.820085 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:31:46.820085 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:31:46.820085 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:31:46.820085 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d70f6c96e1ad484aa3207fc01a12d519"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d70f6c96e1ad484aa3207fc01a12d519"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d70f6c96e1ad484aa3207fc01a12d519", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d70f6c96e1ad484aa3207fc01a12d519"}]}] Jul 23 21:31:46.820085 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:31:46.820085 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: d70f6c96e1ad484aa3207fc01a12d519 Jul 23 21:31:46.820085 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:31:46.820085 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServersNegativeTestJSON-1106538570-project Jul 23 21:31:46.820085 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:31:46.820085 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:31:46.820085 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 6ca9644a73d9468aa39b21548a72bded Jul 23 21:31:46.820085 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServersNegativeTestJSON-1106538570-project Jul 23 21:31:46.820085 ncdv-master-1 devstack@n-api.service[131320]: Jul 23 21:31:46.820085 ncdv-master-1 devstack@n-api.service[131320]: {"server": {"name": "", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "networks": [{"uuid": "654a77ca-1e84-434d-8536-1fc3adb327d0"}]}} Jul 23 21:31:46.820085 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:31:46.820085 ncdv-master-1 devstack@n-api.service[131320]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 23 21:31:46.820085 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'body': {'server': {'name': '', 'imageRef': 'b27b20aa-ef1b-4dd1-989e-321af6343d6a', 'flavorRef': '452', 'networks': [{'uuid': '654a77ca-1e84-434d-8536-1fc3adb327d0'}]}}} Jul 23 21:31:46.820085 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:31:46.820085 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:46.820085 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 23 21:31:46.820085 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 23 21:31:46.820085 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 23 21:31:46.820085 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise error Jul 23 21:31:46.820085 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 23 21:31:46.820085 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:31:46.820085 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Jul 23 21:31:46.820085 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 23 21:31:46.820085 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:31:46.820085 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 23 21:31:46.820085 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi '' Jul 23 21:31:46.820085 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:31:46.820085 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:31:46.820085 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:31:46.820085 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:46.820085 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:31:46.820085 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:31:46.820085 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:31:46.820085 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:31:46.820085 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:31:46.820085 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:31:46.820085 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:31:46.820085 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:31:46.820085 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 23 21:31:46.820085 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 23 21:31:46.820085 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 23 21:31:46.820085 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 23 21:31:46.820085 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 23 21:31:46.825887 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 23 21:31:46.825887 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 23 21:31:46.825887 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:31:46.825887 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:31:46.825887 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:31:46.825887 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:46.825887 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:31:46.825887 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:31:46.825887 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 23 21:31:46.825887 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 23 21:31:46.825887 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 23 21:31:46.825887 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:31:46.825887 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e7c5ff24-149a-4d25-a550-feb8fb752166 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:31:46.825887 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e7c5ff24-149a-4d25-a550-feb8fb752166 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.010845 Jul 23 21:31:46.825887 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2157/4408] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:31:46 2022] POST /compute/v2.1/servers => generated 108 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 23 21:31:46.832839 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-65652fa9-0e9e-4cf4-ae62-7c6d47c21ddc tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:46.838211 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-65652fa9-0e9e-4cf4-ae62-7c6d47c21ddc tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:46.846729 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-65652fa9-0e9e-4cf4-ae62-7c6d47c21ddc tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:46.847223 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-65652fa9-0e9e-4cf4-ae62-7c6d47c21ddc tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:46.848296 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-65652fa9-0e9e-4cf4-ae62-7c6d47c21ddc tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:46.849235 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-65652fa9-0e9e-4cf4-ae62-7c6d47c21ddc tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:46.964219 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5ea71722-7b6e-46ee-8d1e-a3aecedc61a5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:46.964918 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5ea71722-7b6e-46ee-8d1e-a3aecedc61a5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:46.973830 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5ea71722-7b6e-46ee-8d1e-a3aecedc61a5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:46.974309 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5ea71722-7b6e-46ee-8d1e-a3aecedc61a5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:46.978914 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5ea71722-7b6e-46ee-8d1e-a3aecedc61a5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:46.979764 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5ea71722-7b6e-46ee-8d1e-a3aecedc61a5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:47.026652 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-65652fa9-0e9e-4cf4-ae62-7c6d47c21ddc tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:47.036422 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-65652fa9-0e9e-4cf4-ae62-7c6d47c21ddc tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1505 microversion: 2.1 time: 0.207545 Jul 23 21:31:47.038602 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2252/4409] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:46 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1505 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:47.056435 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-42176176-487f-46b1-ba2f-3c625e4b3e73 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:47.057272 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-42176176-487f-46b1-ba2f-3c625e4b3e73 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:47.064135 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-42176176-487f-46b1-ba2f-3c625e4b3e73 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:47.064898 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-42176176-487f-46b1-ba2f-3c625e4b3e73 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:47.065926 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-42176176-487f-46b1-ba2f-3c625e4b3e73 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:47.066604 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-42176176-487f-46b1-ba2f-3c625e4b3e73 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:47.071793 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5ea71722-7b6e-46ee-8d1e-a3aecedc61a5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:47.083134 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5ea71722-7b6e-46ee-8d1e-a3aecedc61a5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:47.084885 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5ea71722-7b6e-46ee-8d1e-a3aecedc61a5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:47.086409 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5ea71722-7b6e-46ee-8d1e-a3aecedc61a5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.127888 Jul 23 21:31:47.087335 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2158/4410] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:31:46 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:31:47.093336 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1c4d2b45-6801-44b1-94ea-bf6bd1eec45e tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:47.094610 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1c4d2b45-6801-44b1-94ea-bf6bd1eec45e tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: dcc206d0-3170-459e-b48a-8cf9709e1ffb] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:47.100748 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1c4d2b45-6801-44b1-94ea-bf6bd1eec45e tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:47.101445 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1c4d2b45-6801-44b1-94ea-bf6bd1eec45e tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:47.102256 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1c4d2b45-6801-44b1-94ea-bf6bd1eec45e tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:47.102854 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1c4d2b45-6801-44b1-94ea-bf6bd1eec45e tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:47.249524 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-42176176-487f-46b1-ba2f-3c625e4b3e73 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:47.260460 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-42176176-487f-46b1-ba2f-3c625e4b3e73 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1505 microversion: 2.1 time: 0.207769 Jul 23 21:31:47.274274 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2253/4411] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:47 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1505 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:31:47.280609 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-5215b261-4481-4651-92a9-f0b4437e57be tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:47.281556 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-5215b261-4481-4651-92a9-f0b4437e57be tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] [instance: 5cb6a473-80fe-4569-bd9a-52511d3b81aa] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:47.289047 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5215b261-4481-4651-92a9-f0b4437e57be tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:47.289926 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5215b261-4481-4651-92a9-f0b4437e57be tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:47.290947 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5215b261-4481-4651-92a9-f0b4437e57be tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:47.291596 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5215b261-4481-4651-92a9-f0b4437e57be tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:47.374695 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-5215b261-4481-4651-92a9-f0b4437e57be tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:47.385290 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-5215b261-4481-4651-92a9-f0b4437e57be tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:47.388512 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-5215b261-4481-4651-92a9-f0b4437e57be tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:47.395310 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-5215b261-4481-4651-92a9-f0b4437e57be tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] 10.222.0.17 "GET /compute/v2.1/servers/5cb6a473-80fe-4569-bd9a-52511d3b81aa" status: 200 len: 1364 microversion: 2.47 time: 0.119324 Jul 23 21:31:47.396437 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2254/4412] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:31:47 2022] GET /compute/v2.1/servers/5cb6a473-80fe-4569-bd9a-52511d3b81aa => generated 1364 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:31:47.403248 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-2e9ccea6-de3a-4af7-990d-c7fb8d6b5694 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:31:47.404410 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-2e9ccea6-de3a-4af7-990d-c7fb8d6b5694 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: d779d3b0-5af0-4657-8463-777690832ad8] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:47.413442 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-2e9ccea6-de3a-4af7-990d-c7fb8d6b5694 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] HTTP exception thrown: Instance d779d3b0-5af0-4657-8463-777690832ad8 could not be found. Jul 23 21:31:47.419083 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-2e9ccea6-de3a-4af7-990d-c7fb8d6b5694 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Request method failure captured: Jul 23 21:31:47.419083 ncdv-master-1 devstack@n-api.service[131321]: request: POST /compute/v2.1/servers/d779d3b0-5af0-4657-8463-777690832ad8/action HTTP/1.1 Jul 23 21:31:47.419083 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:31:47.419083 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:31:47.419083 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:31:47.419083 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 14 Jul 23 21:31:47.419083 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:31:47.419083 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:31:47.419083 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:31:47.419083 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:31:47.419083 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3Ghf1JjZ4k8tVzERRK8IkLpluLUwa9k5Rz-X0dEr2p4_7xl_eBekUiNk1RZEGsFdGEiApbLOfcuSifirvwiKV1QOTaKdXKwfMnwZgdfagxJjoe3dPYUa3b-d3rVTYewIN_YoX2mMGGBMWRa3po8WOCVIc6hXJLExzq_ndbcO7U8NQBI Jul 23 21:31:47.419083 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:31:47.419083 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:31:47.419083 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:31:47.419083 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:31:47.419083 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:31:47.419083 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:31:47.419083 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: d70f6c96e1ad484aa3207fc01a12d519 Jul 23 21:31:47.419083 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:31:47.419083 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:31:47.419083 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:31:47.419083 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d70f6c96e1ad484aa3207fc01a12d519"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d70f6c96e1ad484aa3207fc01a12d519"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d70f6c96e1ad484aa3207fc01a12d519", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d70f6c96e1ad484aa3207fc01a12d519"}]}] Jul 23 21:31:47.419083 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:31:47.419083 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: d70f6c96e1ad484aa3207fc01a12d519 Jul 23 21:31:47.419083 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:31:47.419083 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ServersNegativeTestJSON-1106538570-project Jul 23 21:31:47.419083 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:31:47.419083 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:31:47.419083 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 6ca9644a73d9468aa39b21548a72bded Jul 23 21:31:47.419083 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ServersNegativeTestJSON-1106538570-project Jul 23 21:31:47.419083 ncdv-master-1 devstack@n-api.service[131321]: Jul 23 21:31:47.419083 ncdv-master-1 devstack@n-api.service[131321]: {"shelve": {}} Jul 23 21:31:47.419083 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:31:47.419083 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance d779d3b0-5af0-4657-8463-777690832ad8 could not be found. Jul 23 21:31:47.419083 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': 'd779d3b0-5af0-4657-8463-777690832ad8', 'body': {'shelve': {}}} Jul 23 21:31:47.419083 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:31:47.419083 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:47.419083 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:31:47.419083 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:31:47.419083 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:31:47.419083 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:31:47.419083 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 23 21:31:47.419083 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 23 21:31:47.419083 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d779d3b0-5af0-4657-8463-777690832ad8 could not be found. Jul 23 21:31:47.419083 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:47.419083 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:31:47.419083 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:47.419083 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:47.419083 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:31:47.419083 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:31:47.419083 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:31:47.419083 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:31:47.419083 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:31:47.419083 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:31:47.419083 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Jul 23 21:31:47.419083 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 23 21:31:47.419083 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:31:47.419083 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:31:47.419083 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d779d3b0-5af0-4657-8463-777690832ad8 could not be found. Jul 23 21:31:47.419083 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:47.419083 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:31:47.419083 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:47.419083 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:47.419083 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:31:47.419083 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:31:47.423832 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:31:47.423832 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:31:47.423832 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d779d3b0-5af0-4657-8463-777690832ad8 could not be found. Jul 23 21:31:47.423832 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:47.425750 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-2e9ccea6-de3a-4af7-990d-c7fb8d6b5694 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Returning 404 to user: Instance d779d3b0-5af0-4657-8463-777690832ad8 could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:31:47.428579 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-2e9ccea6-de3a-4af7-990d-c7fb8d6b5694 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "POST /compute/v2.1/servers/d779d3b0-5af0-4657-8463-777690832ad8/action" status: 404 len: 111 microversion: 2.1 time: 0.029802 Jul 23 21:31:47.429413 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2255/4413] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:31:47 2022] POST /compute/v2.1/servers/d779d3b0-5af0-4657-8463-777690832ad8/action => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:31:47.439273 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-80ed3163-f58b-45e9-a3dd-789ef4c8f04a tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:47.440035 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-80ed3163-f58b-45e9-a3dd-789ef4c8f04a tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:47.450800 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-80ed3163-f58b-45e9-a3dd-789ef4c8f04a tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:47.451451 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-80ed3163-f58b-45e9-a3dd-789ef4c8f04a tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:47.452317 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-80ed3163-f58b-45e9-a3dd-789ef4c8f04a tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:47.453055 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-80ed3163-f58b-45e9-a3dd-789ef4c8f04a tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:47.538233 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-1c4d2b45-6801-44b1-94ea-bf6bd1eec45e tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:47.547951 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1c4d2b45-6801-44b1-94ea-bf6bd1eec45e tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/dcc206d0-3170-459e-b48a-8cf9709e1ffb" status: 200 len: 1260 microversion: 2.1 time: 0.458708 Jul 23 21:31:47.548541 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2159/4414] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:47 2022] GET /compute/v2.1/servers/dcc206d0-3170-459e-b48a-8cf9709e1ffb => generated 1260 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:47.694742 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-394a0daf-cf87-4e17-bac5-2c5b1074c61d tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:47.695430 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-394a0daf-cf87-4e17-bac5-2c5b1074c61d tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] [instance: b90d9c54-1b5f-40db-acc6-67aaf46def15] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:47.703121 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-394a0daf-cf87-4e17-bac5-2c5b1074c61d tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:47.703748 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-394a0daf-cf87-4e17-bac5-2c5b1074c61d tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:47.704913 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-394a0daf-cf87-4e17-bac5-2c5b1074c61d tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:47.705362 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-394a0daf-cf87-4e17-bac5-2c5b1074c61d tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:47.768658 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-80ed3163-f58b-45e9-a3dd-789ef4c8f04a tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:47.776288 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-80ed3163-f58b-45e9-a3dd-789ef4c8f04a tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1505 microversion: 2.1 time: 0.341203 Jul 23 21:31:47.777204 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2256/4415] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:47 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1505 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:47.797396 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-017027d8-6477-4bce-8e7e-8082b028f2aa tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:47.799572 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-017027d8-6477-4bce-8e7e-8082b028f2aa tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:47.806856 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-017027d8-6477-4bce-8e7e-8082b028f2aa tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:47.807322 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-017027d8-6477-4bce-8e7e-8082b028f2aa tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:47.808914 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-017027d8-6477-4bce-8e7e-8082b028f2aa tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:47.809922 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-017027d8-6477-4bce-8e7e-8082b028f2aa tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:47.895000 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-394a0daf-cf87-4e17-bac5-2c5b1074c61d tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b1e260651b4dffa7c1efe8e9d0f144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcf55bcaba04bf8ae8a9b2ac09e8d98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:47.908152 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-394a0daf-cf87-4e17-bac5-2c5b1074c61d tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] 10.222.0.17 "GET /compute/v2.1/servers/b90d9c54-1b5f-40db-acc6-67aaf46def15" status: 200 len: 1680 microversion: 2.1 time: 0.218799 Jul 23 21:31:47.909488 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2160/4416] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:47 2022] GET /compute/v2.1/servers/b90d9c54-1b5f-40db-acc6-67aaf46def15 => generated 1680 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:31:48.110419 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-38c53965-4bd9-481e-ab2c-56be2b5133e4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:48.111743 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-38c53965-4bd9-481e-ab2c-56be2b5133e4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:48.126268 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-38c53965-4bd9-481e-ab2c-56be2b5133e4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:48.127231 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-38c53965-4bd9-481e-ab2c-56be2b5133e4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:48.128676 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-38c53965-4bd9-481e-ab2c-56be2b5133e4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:48.130276 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-38c53965-4bd9-481e-ab2c-56be2b5133e4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:48.157601 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=100 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:31:48.256763 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-38c53965-4bd9-481e-ab2c-56be2b5133e4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:48.277735 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-38c53965-4bd9-481e-ab2c-56be2b5133e4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:48.281532 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-38c53965-4bd9-481e-ab2c-56be2b5133e4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:48.283523 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-38c53965-4bd9-481e-ab2c-56be2b5133e4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.181795 Jul 23 21:31:48.284929 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2161/4417] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:31:48 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:31:48.416495 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ba46f83d-3327-4150-8cbf-36ec87143006 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:48.417483 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ba46f83d-3327-4150-8cbf-36ec87143006 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] [instance: 5cb6a473-80fe-4569-bd9a-52511d3b81aa] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:48.427384 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ba46f83d-3327-4150-8cbf-36ec87143006 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:48.428073 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ba46f83d-3327-4150-8cbf-36ec87143006 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:48.429093 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ba46f83d-3327-4150-8cbf-36ec87143006 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:48.429883 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ba46f83d-3327-4150-8cbf-36ec87143006 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:48.469759 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-017027d8-6477-4bce-8e7e-8082b028f2aa tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:48.484237 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-017027d8-6477-4bce-8e7e-8082b028f2aa tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1505 microversion: 2.1 time: 0.692121 Jul 23 21:31:48.484919 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2257/4418] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:47 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1505 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:48.501351 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ef60e725-f3f1-407f-bca5-c38e4416987f tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:31:48.502477 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-ef60e725-f3f1-407f-bca5-c38e4416987f tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:48.508773 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ef60e725-f3f1-407f-bca5-c38e4416987f tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:48.509220 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ef60e725-f3f1-407f-bca5-c38e4416987f tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:48.510348 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ef60e725-f3f1-407f-bca5-c38e4416987f tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:48.510948 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ef60e725-f3f1-407f-bca5-c38e4416987f tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:48.550299 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ba46f83d-3327-4150-8cbf-36ec87143006 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:48.550716 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.objects.instance [None req-ef60e725-f3f1-407f-bca5-c38e4416987f tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lazy-loading 'flavor' on Instance uuid f2ad2cfd-7479-48d0-b802-cdd5d5093305 {{(pid=131321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:31:48.561601 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ba46f83d-3327-4150-8cbf-36ec87143006 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:48.563116 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ba46f83d-3327-4150-8cbf-36ec87143006 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:48.565425 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ba46f83d-3327-4150-8cbf-36ec87143006 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] 10.222.0.17 "GET /compute/v2.1/servers/5cb6a473-80fe-4569-bd9a-52511d3b81aa" status: 200 len: 1370 microversion: 2.47 time: 0.154286 Jul 23 21:31:48.566032 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2162/4419] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:31:48 2022] GET /compute/v2.1/servers/5cb6a473-80fe-4569-bd9a-52511d3b81aa => generated 1370 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:31:48.585773 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ad1dc68c-0765-4e9c-9d42-ba1a88c808ab tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:48.586416 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ad1dc68c-0765-4e9c-9d42-ba1a88c808ab tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: dcc206d0-3170-459e-b48a-8cf9709e1ffb] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:48.595178 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ad1dc68c-0765-4e9c-9d42-ba1a88c808ab tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:48.595625 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ad1dc68c-0765-4e9c-9d42-ba1a88c808ab tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:48.596679 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ad1dc68c-0765-4e9c-9d42-ba1a88c808ab tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:48.597436 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ad1dc68c-0765-4e9c-9d42-ba1a88c808ab tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:48.760136 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ad1dc68c-0765-4e9c-9d42-ba1a88c808ab tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:48.773725 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ad1dc68c-0765-4e9c-9d42-ba1a88c808ab tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/dcc206d0-3170-459e-b48a-8cf9709e1ffb" status: 200 len: 1266 microversion: 2.1 time: 0.189987 Jul 23 21:31:48.774749 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2163/4420] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:48 2022] GET /compute/v2.1/servers/dcc206d0-3170-459e-b48a-8cf9709e1ffb => generated 1266 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:48.910658 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ad1dc68c-0765-4e9c-9d42-ba1a88c808ab tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:48.911693 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ad1dc68c-0765-4e9c-9d42-ba1a88c808ab tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001492 Jul 23 21:31:48.912030 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2164/4421] 10.222.0.17 () {56 vars in 885 bytes} [Sat Jul 23 21:31:48 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Jul 23 21:31:48.914299 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-ef60e725-f3f1-407f-bca5-c38e4416987f tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "POST /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305/action" status: 202 len: 0 microversion: 2.1 time: 0.416978 Jul 23 21:31:48.919171 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ad1dc68c-0765-4e9c-9d42-ba1a88c808ab tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:48.919724 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2258/4422] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:31:48 2022] POST /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305/action => generated 0 bytes in 423 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:31:48.920582 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ad1dc68c-0765-4e9c-9d42-ba1a88c808ab tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.002189 Jul 23 21:31:48.926464 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2165/4423] 10.222.0.17 () {54 vars in 1034 bytes} [Sat Jul 23 21:31:48 2022] GET /compute/v2/ => generated 379 bytes in 9 msecs (HTTP/1.1 200) 5 headers in 221 bytes (2 switches on core 0) Jul 23 21:31:48.930721 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-b9dbee26-72a8-4dfb-a568-db4f7ec25d9c tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:48.931668 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-b9dbee26-72a8-4dfb-a568-db4f7ec25d9c tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:48.933610 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-fbc28ee4-fb1c-4f0a-945a-6ef0cfae7570 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:48.934297 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-fbc28ee4-fb1c-4f0a-945a-6ef0cfae7570 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] [instance: b90d9c54-1b5f-40db-acc6-67aaf46def15] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:48.940875 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b9dbee26-72a8-4dfb-a568-db4f7ec25d9c tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:48.941584 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fbc28ee4-fb1c-4f0a-945a-6ef0cfae7570 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:48.941781 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b9dbee26-72a8-4dfb-a568-db4f7ec25d9c tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:48.942376 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fbc28ee4-fb1c-4f0a-945a-6ef0cfae7570 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:48.942872 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b9dbee26-72a8-4dfb-a568-db4f7ec25d9c tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:48.943315 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b9dbee26-72a8-4dfb-a568-db4f7ec25d9c tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:48.943686 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fbc28ee4-fb1c-4f0a-945a-6ef0cfae7570 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:48.944281 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fbc28ee4-fb1c-4f0a-945a-6ef0cfae7570 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:49.154479 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-fbc28ee4-fb1c-4f0a-945a-6ef0cfae7570 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b1e260651b4dffa7c1efe8e9d0f144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcf55bcaba04bf8ae8a9b2ac09e8d98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:49.163566 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-fbc28ee4-fb1c-4f0a-945a-6ef0cfae7570 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] 10.222.0.17 "GET /compute/v2.1/servers/b90d9c54-1b5f-40db-acc6-67aaf46def15" status: 200 len: 1680 microversion: 2.1 time: 0.235952 Jul 23 21:31:49.170276 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2166/4424] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:48 2022] GET /compute/v2.1/servers/b90d9c54-1b5f-40db-acc6-67aaf46def15 => generated 1680 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:49.173192 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-fbc28ee4-fb1c-4f0a-945a-6ef0cfae7570 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:49.174627 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-fbc28ee4-fb1c-4f0a-945a-6ef0cfae7570 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] 10.222.0.17 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001705 Jul 23 21:31:49.175678 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2167/4425] 10.222.0.17 () {54 vars in 1040 bytes} [Sat Jul 23 21:31:49 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:31:49.183728 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-fbc28ee4-fb1c-4f0a-945a-6ef0cfae7570 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:49.186214 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-fbc28ee4-fb1c-4f0a-945a-6ef0cfae7570 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] 10.222.0.17 "GET /compute//" status: 200 len: 377 microversion: - time: 0.003252 Jul 23 21:31:49.187125 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2168/4426] 10.222.0.17 () {56 vars in 885 bytes} [Sat Jul 23 21:31:49 2022] GET /compute/ => generated 377 bytes in 5 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 23 21:31:49.302833 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-47391fec-69ad-4395-86b9-15425c46e4a1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:49.303681 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-47391fec-69ad-4395-86b9-15425c46e4a1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:49.312291 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-47391fec-69ad-4395-86b9-15425c46e4a1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:49.314870 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-47391fec-69ad-4395-86b9-15425c46e4a1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:49.319023 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-47391fec-69ad-4395-86b9-15425c46e4a1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:49.320625 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-47391fec-69ad-4395-86b9-15425c46e4a1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:49.324233 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-b9dbee26-72a8-4dfb-a568-db4f7ec25d9c tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:49.337268 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-b9dbee26-72a8-4dfb-a568-db4f7ec25d9c tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1511 microversion: 2.1 time: 0.415140 Jul 23 21:31:49.337894 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2259/4427] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:48 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1511 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:49.459140 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-47391fec-69ad-4395-86b9-15425c46e4a1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:49.472028 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-47391fec-69ad-4395-86b9-15425c46e4a1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:49.474095 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-47391fec-69ad-4395-86b9-15425c46e4a1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:49.475544 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-47391fec-69ad-4395-86b9-15425c46e4a1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.176706 Jul 23 21:31:49.476633 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2169/4428] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:31:49 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:31:49.586478 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-4417da4c-54f4-47bd-b218-4499c9319ba3 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:49.588394 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-4417da4c-54f4-47bd-b218-4499c9319ba3 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] [instance: 5cb6a473-80fe-4569-bd9a-52511d3b81aa] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:49.602270 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4417da4c-54f4-47bd-b218-4499c9319ba3 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:49.602720 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4417da4c-54f4-47bd-b218-4499c9319ba3 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:49.604277 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4417da4c-54f4-47bd-b218-4499c9319ba3 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:49.604923 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4417da4c-54f4-47bd-b218-4499c9319ba3 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:49.708506 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-4417da4c-54f4-47bd-b218-4499c9319ba3 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:49.719667 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-4417da4c-54f4-47bd-b218-4499c9319ba3 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:49.721458 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-4417da4c-54f4-47bd-b218-4499c9319ba3 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:49.722881 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-4417da4c-54f4-47bd-b218-4499c9319ba3 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] 10.222.0.17 "GET /compute/v2.1/servers/5cb6a473-80fe-4569-bd9a-52511d3b81aa" status: 200 len: 1370 microversion: 2.47 time: 0.141656 Jul 23 21:31:49.723965 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2260/4429] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:31:49 2022] GET /compute/v2.1/servers/5cb6a473-80fe-4569-bd9a-52511d3b81aa => generated 1370 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:31:49.794958 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-253ee6c0-1913-40ce-9a50-bbb3ae606214 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:49.795621 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-253ee6c0-1913-40ce-9a50-bbb3ae606214 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: dcc206d0-3170-459e-b48a-8cf9709e1ffb] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:49.804006 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-253ee6c0-1913-40ce-9a50-bbb3ae606214 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:49.804929 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-253ee6c0-1913-40ce-9a50-bbb3ae606214 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:49.806223 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-253ee6c0-1913-40ce-9a50-bbb3ae606214 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:49.807045 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-253ee6c0-1913-40ce-9a50-bbb3ae606214 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:50.133776 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-253ee6c0-1913-40ce-9a50-bbb3ae606214 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:50.159147 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-253ee6c0-1913-40ce-9a50-bbb3ae606214 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/dcc206d0-3170-459e-b48a-8cf9709e1ffb" status: 200 len: 1308 microversion: 2.1 time: 0.371250 Jul 23 21:31:50.160826 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2170/4430] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:49 2022] GET /compute/v2.1/servers/dcc206d0-3170-459e-b48a-8cf9709e1ffb => generated 1308 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:50.181336 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-2b825d33-eedd-4018-bf1c-a7acf04c011c tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:50.181979 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-2b825d33-eedd-4018-bf1c-a7acf04c011c tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] [instance: b90d9c54-1b5f-40db-acc6-67aaf46def15] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:50.193144 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2b825d33-eedd-4018-bf1c-a7acf04c011c tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:50.195640 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2b825d33-eedd-4018-bf1c-a7acf04c011c tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:50.196632 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2b825d33-eedd-4018-bf1c-a7acf04c011c tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:50.197384 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2b825d33-eedd-4018-bf1c-a7acf04c011c tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:50.256479 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:31:50.355121 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-2b825d33-eedd-4018-bf1c-a7acf04c011c tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b1e260651b4dffa7c1efe8e9d0f144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcf55bcaba04bf8ae8a9b2ac09e8d98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:50.356255 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2305ae73-d419-4d0c-8e73-6c52b268fbb5 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:50.357918 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-2305ae73-d419-4d0c-8e73-6c52b268fbb5 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:50.375082 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-2b825d33-eedd-4018-bf1c-a7acf04c011c tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] 10.222.0.17 "GET /compute/v2.1/servers/b90d9c54-1b5f-40db-acc6-67aaf46def15" status: 200 len: 1613 microversion: 2.1 time: 0.197293 Jul 23 21:31:50.376494 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2261/4431] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:50 2022] GET /compute/v2.1/servers/b90d9c54-1b5f-40db-acc6-67aaf46def15 => generated 1613 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:50.387336 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2305ae73-d419-4d0c-8e73-6c52b268fbb5 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:50.394507 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2305ae73-d419-4d0c-8e73-6c52b268fbb5 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:50.395563 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2305ae73-d419-4d0c-8e73-6c52b268fbb5 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:50.396388 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-e980f9f3-7feb-4bf3-b8d6-44f3c6b0f805 req-2519995e-34b2-447a-9f80-05ad4ba3a578 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcc206d0-3170-459e-b48a-8cf9709e1ffb", "tag": "42f2d7dd-7907-4a82-b260-d0d132ebcb5f"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:31:50.401411 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2305ae73-d419-4d0c-8e73-6c52b268fbb5 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:50.443475 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-e980f9f3-7feb-4bf3-b8d6-44f3c6b0f805 req-2519995e-34b2-447a-9f80-05ad4ba3a578 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:50.445649 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-e980f9f3-7feb-4bf3-b8d6-44f3c6b0f805 req-2519995e-34b2-447a-9f80-05ad4ba3a578 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:50.465357 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-e980f9f3-7feb-4bf3-b8d6-44f3c6b0f805 req-2519995e-34b2-447a-9f80-05ad4ba3a578 service nova] Creating event network-changed:42f2d7dd-7907-4a82-b260-d0d132ebcb5f for instance dcc206d0-3170-459e-b48a-8cf9709e1ffb on nch1-master-1 Jul 23 21:31:50.477425 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-e980f9f3-7feb-4bf3-b8d6-44f3c6b0f805 req-2519995e-34b2-447a-9f80-05ad4ba3a578 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095142 Jul 23 21:31:50.478406 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2262/4432] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:31:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:31:50.551231 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-12f08173-0086-45d2-8351-48bee7ef39f8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:50.551738 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-12f08173-0086-45d2-8351-48bee7ef39f8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:50.571978 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-12f08173-0086-45d2-8351-48bee7ef39f8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:50.573304 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-12f08173-0086-45d2-8351-48bee7ef39f8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:50.574282 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-12f08173-0086-45d2-8351-48bee7ef39f8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:50.574727 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-12f08173-0086-45d2-8351-48bee7ef39f8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:50.841709 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-2305ae73-d419-4d0c-8e73-6c52b268fbb5 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:50.861099 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2305ae73-d419-4d0c-8e73-6c52b268fbb5 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1511 microversion: 2.1 time: 0.508436 Jul 23 21:31:50.864971 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2171/4433] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:50 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1511 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:31:50.871977 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-2f9911d0-640b-41f2-b2fa-9228adcbb937 req-8d57230b-2d5f-4548-bf6d-0fba65127d31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b90d9c54-1b5f-40db-acc6-67aaf46def15", "name": "network-vif-deleted", "tag": "11b31040-c051-49e9-abc5-174c912590d7"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:31:50.901262 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-2f9911d0-640b-41f2-b2fa-9228adcbb937 req-8d57230b-2d5f-4548-bf6d-0fba65127d31 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:50.902599 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-2f9911d0-640b-41f2-b2fa-9228adcbb937 req-8d57230b-2d5f-4548-bf6d-0fba65127d31 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:50.909062 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-12f08173-0086-45d2-8351-48bee7ef39f8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:50.917477 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-2f9911d0-640b-41f2-b2fa-9228adcbb937 req-8d57230b-2d5f-4548-bf6d-0fba65127d31 service nova] Creating event network-vif-deleted:11b31040-c051-49e9-abc5-174c912590d7 for instance b90d9c54-1b5f-40db-acc6-67aaf46def15 on nch2-master-1 Jul 23 21:31:50.921639 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-12f08173-0086-45d2-8351-48bee7ef39f8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:50.923758 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-2f9911d0-640b-41f2-b2fa-9228adcbb937 req-8d57230b-2d5f-4548-bf6d-0fba65127d31 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057318 Jul 23 21:31:50.924868 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2172/4434] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:31:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:31:50.927511 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-12f08173-0086-45d2-8351-48bee7ef39f8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:50.932082 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-12f08173-0086-45d2-8351-48bee7ef39f8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.419529 Jul 23 21:31:50.932787 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2263/4435] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:31:50 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:31:50.934746 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b563a5e8-5693-470e-bc9f-ece00522e258 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:50.935479 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b563a5e8-5693-470e-bc9f-ece00522e258 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] [instance: 5cb6a473-80fe-4569-bd9a-52511d3b81aa] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:50.943118 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b563a5e8-5693-470e-bc9f-ece00522e258 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:50.944149 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b563a5e8-5693-470e-bc9f-ece00522e258 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:50.944986 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b563a5e8-5693-470e-bc9f-ece00522e258 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:50.945433 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b563a5e8-5693-470e-bc9f-ece00522e258 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:51.043231 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b563a5e8-5693-470e-bc9f-ece00522e258 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:51.049846 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b563a5e8-5693-470e-bc9f-ece00522e258 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:51.051371 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b563a5e8-5693-470e-bc9f-ece00522e258 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:51.052810 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b563a5e8-5693-470e-bc9f-ece00522e258 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] 10.222.0.17 "GET /compute/v2.1/servers/5cb6a473-80fe-4569-bd9a-52511d3b81aa" status: 200 len: 1355 microversion: 2.47 time: 0.126597 Jul 23 21:31:51.053380 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2173/4436] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:31:50 2022] GET /compute/v2.1/servers/5cb6a473-80fe-4569-bd9a-52511d3b81aa => generated 1355 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:31:51.070644 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-cea85bed-5404-44f1-b018-03c7aa09d71a tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:51.074115 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-cea85bed-5404-44f1-b018-03c7aa09d71a tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:51.074988 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-cea85bed-5404-44f1-b018-03c7aa09d71a tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Searching by: {'deleted': False, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362'} {{(pid=131321) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 23 21:31:51.083596 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cea85bed-5404-44f1-b018-03c7aa09d71a tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:51.084050 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cea85bed-5404-44f1-b018-03c7aa09d71a tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:51.084848 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cea85bed-5404-44f1-b018-03c7aa09d71a tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:51.085287 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cea85bed-5404-44f1-b018-03c7aa09d71a tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:51.179966 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b09b3160-4ece-478c-9b1f-5049c49599f0 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:51.188479 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b09b3160-4ece-478c-9b1f-5049c49599f0 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: dcc206d0-3170-459e-b48a-8cf9709e1ffb] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:51.201342 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:31:51.204828 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b09b3160-4ece-478c-9b1f-5049c49599f0 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:51.205292 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b09b3160-4ece-478c-9b1f-5049c49599f0 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:51.206141 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b09b3160-4ece-478c-9b1f-5049c49599f0 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:51.206611 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b09b3160-4ece-478c-9b1f-5049c49599f0 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:51.300669 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.multi_cell_list [None req-cea85bed-5404-44f1-b018-03c7aa09d71a tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=131321) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 23 21:31:51.410072 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-cea85bed-5404-44f1-b018-03c7aa09d71a tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:51.418523 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cea85bed-5404-44f1-b018-03c7aa09d71a tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:51.419216 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cea85bed-5404-44f1-b018-03c7aa09d71a tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:51.432196 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-cea85bed-5404-44f1-b018-03c7aa09d71a tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:51.434687 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-cea85bed-5404-44f1-b018-03c7aa09d71a tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:51.546950 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b09b3160-4ece-478c-9b1f-5049c49599f0 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:51.555395 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b09b3160-4ece-478c-9b1f-5049c49599f0 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/dcc206d0-3170-459e-b48a-8cf9709e1ffb" status: 200 len: 1308 microversion: 2.1 time: 0.379210 Jul 23 21:31:51.556076 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2174/4437] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:51 2022] GET /compute/v2.1/servers/dcc206d0-3170-459e-b48a-8cf9709e1ffb => generated 1308 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:31:51.560748 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-7d716085-e999-4e7f-9009-00d72e6db9f2 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:51.561352 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-7d716085-e999-4e7f-9009-00d72e6db9f2 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] [instance: b90d9c54-1b5f-40db-acc6-67aaf46def15] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:51.572709 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-cea85bed-5404-44f1-b018-03c7aa09d71a tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] 10.222.0.17 "GET /compute/v2.1/servers/detail" status: 200 len: 2705 microversion: 2.47 time: 0.505867 Jul 23 21:31:51.581897 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2264/4438] 10.222.0.17 () {60 vars in 1186 bytes} [Sat Jul 23 21:31:51 2022] GET /compute/v2.1/servers/detail => generated 2705 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:31:51.589615 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7d716085-e999-4e7f-9009-00d72e6db9f2 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:51.590562 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7d716085-e999-4e7f-9009-00d72e6db9f2 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:51.591595 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7d716085-e999-4e7f-9009-00d72e6db9f2 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:51.593219 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7d716085-e999-4e7f-9009-00d72e6db9f2 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:51.611633 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-8d4cb898-d737-445c-b2a7-b2d5bbbd4e50 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:51.612796 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-8d4cb898-d737-445c-b2a7-b2d5bbbd4e50 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] [instance: 5cb6a473-80fe-4569-bd9a-52511d3b81aa] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:51.627275 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:31:51.632165 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8d4cb898-d737-445c-b2a7-b2d5bbbd4e50 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:51.634764 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8d4cb898-d737-445c-b2a7-b2d5bbbd4e50 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:51.635801 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8d4cb898-d737-445c-b2a7-b2d5bbbd4e50 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:51.637117 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8d4cb898-d737-445c-b2a7-b2d5bbbd4e50 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:51.641752 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-7d716085-e999-4e7f-9009-00d72e6db9f2 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] HTTP exception thrown: Instance b90d9c54-1b5f-40db-acc6-67aaf46def15 could not be found. Jul 23 21:31:51.644173 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-7d716085-e999-4e7f-9009-00d72e6db9f2 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Request method failure captured: Jul 23 21:31:51.644173 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/b90d9c54-1b5f-40db-acc6-67aaf46def15 HTTP/1.1 Jul 23 21:31:51.644173 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:31:51.644173 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:31:51.644173 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:31:51.644173 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:31:51.644173 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:31:51.644173 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:31:51.644173 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:31:51.644173 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:31:51.644173 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3Gh6HV9tIHJcoN46Wjr6EBasJhEuZbFRe23VWqvOs5i0B_4KLAGeVvnmZ6iexSHuUfOXTk6UOU6O-9Emh9fXdmyDDqxExiJefgV0tjF1ehtFmzTkKcDham_s0PhpTyidjx3XByPfr1uqB9BNvtB5vj0aHZ_s7b1yGmPK6uTOhFc95ZY Jul 23 21:31:51.644173 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:31:51.644173 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:31:51.644173 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:31:51.644173 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:31:51.644173 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:31:51.644173 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:31:51.644173 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: ebcf55bcaba04bf8ae8a9b2ac09e8d98 Jul 23 21:31:51.644173 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-AttachVolumeNegativeTest-319311902 Jul 23 21:31:51.644173 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:31:51.644173 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:31:51.644173 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ebcf55bcaba04bf8ae8a9b2ac09e8d98"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ebcf55bcaba04bf8ae8a9b2ac09e8d98"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ebcf55bcaba04bf8ae8a9b2ac09e8d98", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ebcf55bcaba04bf8ae8a9b2ac09e8d98"}]}] Jul 23 21:31:51.644173 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-AttachVolumeNegativeTest-319311902 Jul 23 21:31:51.644173 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: ebcf55bcaba04bf8ae8a9b2ac09e8d98 Jul 23 21:31:51.644173 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-319311902 Jul 23 21:31:51.644173 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-AttachVolumeNegativeTest-319311902-project Jul 23 21:31:51.644173 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:31:51.644173 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:31:51.644173 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 37b1e260651b4dffa7c1efe8e9d0f144 Jul 23 21:31:51.644173 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-AttachVolumeNegativeTest-319311902-project Jul 23 21:31:51.644173 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:31:51.644173 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance b90d9c54-1b5f-40db-acc6-67aaf46def15 could not be found. Jul 23 21:31:51.644173 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': 'b90d9c54-1b5f-40db-acc6-67aaf46def15'} Jul 23 21:31:51.644173 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:31:51.644173 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:51.644173 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:31:51.644173 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:31:51.644173 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:31:51.644173 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:31:51.644173 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:31:51.644173 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:31:51.644173 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:31:51.644173 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:31:51.644173 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b90d9c54-1b5f-40db-acc6-67aaf46def15 could not be found. Jul 23 21:31:51.644173 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:31:51.644173 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:31:51.644173 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:31:51.644173 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:51.644173 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:31:51.644173 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:31:51.644173 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:31:51.644173 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:31:51.644173 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:31:51.644173 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:31:51.644173 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:31:51.644173 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:31:51.644173 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:31:51.644173 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:31:51.644173 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:31:51.644173 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:31:51.644173 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b90d9c54-1b5f-40db-acc6-67aaf46def15 could not be found. Jul 23 21:31:51.644173 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:31:51.644173 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:31:51.644173 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:31:51.648381 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:51.648381 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:31:51.648381 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:31:51.648381 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:31:51.648381 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:31:51.648381 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b90d9c54-1b5f-40db-acc6-67aaf46def15 could not be found. Jul 23 21:31:51.648381 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:31:51.648381 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-7d716085-e999-4e7f-9009-00d72e6db9f2 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Returning 404 to user: Instance b90d9c54-1b5f-40db-acc6-67aaf46def15 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:31:51.651091 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-7d716085-e999-4e7f-9009-00d72e6db9f2 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] 10.222.0.17 "GET /compute/v2.1/servers/b90d9c54-1b5f-40db-acc6-67aaf46def15" status: 404 len: 111 microversion: 2.1 time: 0.092579 Jul 23 21:31:51.652786 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2175/4439] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:51 2022] GET /compute/v2.1/servers/b90d9c54-1b5f-40db-acc6-67aaf46def15 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:31:51.663697 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0e40c0c2-427e-42d5-9ba1-0608f0a5c5fd tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Calling method '.version_select at 0x7f0b4673d040>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:51.691891 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-0e40c0c2-427e-42d5-9ba1-0608f0a5c5fd tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-439558644" status: 202 len: 0 microversion: 2.1 time: 0.032578 Jul 23 21:31:51.694246 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2176/4440] 10.222.0.17 () {58 vars in 1217 bytes} [Sat Jul 23 21:31:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-439558644 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:31:51.700041 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-8d4cb898-d737-445c-b2a7-b2d5bbbd4e50 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] [instance: 5cb6a473-80fe-4569-bd9a-52511d3b81aa] Going to try to terminate instance {{(pid=131321) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:31:51.862577 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-8d4cb898-d737-445c-b2a7-b2d5bbbd4e50 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] 10.222.0.17 "DELETE /compute/v2.1/servers/5cb6a473-80fe-4569-bd9a-52511d3b81aa" status: 204 len: 0 microversion: 2.47 time: 0.246799 Jul 23 21:31:51.866354 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2265/4441] 10.222.0.17 () {60 vars in 1279 bytes} [Sat Jul 23 21:31:51 2022] DELETE /compute/v2.1/servers/5cb6a473-80fe-4569-bd9a-52511d3b81aa => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 23 21:31:51.875083 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a5d6e773-51ed-4a98-aacb-78ff14ca1f53 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:51.875701 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a5d6e773-51ed-4a98-aacb-78ff14ca1f53 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] [instance: 5cb6a473-80fe-4569-bd9a-52511d3b81aa] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:51.882886 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-579d3e71-1da8-44a8-90b4-aa2fb3ae7823 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:51.883800 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-579d3e71-1da8-44a8-90b4-aa2fb3ae7823 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:51.887093 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a5d6e773-51ed-4a98-aacb-78ff14ca1f53 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:51.888971 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a5d6e773-51ed-4a98-aacb-78ff14ca1f53 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:51.890375 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-579d3e71-1da8-44a8-90b4-aa2fb3ae7823 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:51.890835 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-579d3e71-1da8-44a8-90b4-aa2fb3ae7823 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:51.891715 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-579d3e71-1da8-44a8-90b4-aa2fb3ae7823 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:51.892086 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a5d6e773-51ed-4a98-aacb-78ff14ca1f53 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:51.892199 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-579d3e71-1da8-44a8-90b4-aa2fb3ae7823 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:51.893092 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a5d6e773-51ed-4a98-aacb-78ff14ca1f53 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:52.034584 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a5d6e773-51ed-4a98-aacb-78ff14ca1f53 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:52.045215 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a5d6e773-51ed-4a98-aacb-78ff14ca1f53 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:52.047937 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a5d6e773-51ed-4a98-aacb-78ff14ca1f53 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:52.052292 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a5d6e773-51ed-4a98-aacb-78ff14ca1f53 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] 10.222.0.17 "GET /compute/v2.1/servers/5cb6a473-80fe-4569-bd9a-52511d3b81aa" status: 200 len: 1361 microversion: 2.47 time: 0.181585 Jul 23 21:31:52.053478 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2177/4442] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:31:51 2022] GET /compute/v2.1/servers/5cb6a473-80fe-4569-bd9a-52511d3b81aa => generated 1361 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:31:52.066213 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0292e14a-4afb-4665-aeea-6f5fdb23800e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:52.067187 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-0292e14a-4afb-4665-aeea-6f5fdb23800e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:52.074603 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0292e14a-4afb-4665-aeea-6f5fdb23800e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:52.075238 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0292e14a-4afb-4665-aeea-6f5fdb23800e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:52.075596 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-579d3e71-1da8-44a8-90b4-aa2fb3ae7823 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:52.076837 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0292e14a-4afb-4665-aeea-6f5fdb23800e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:52.077440 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0292e14a-4afb-4665-aeea-6f5fdb23800e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:52.086613 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-579d3e71-1da8-44a8-90b4-aa2fb3ae7823 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1511 microversion: 2.1 time: 0.208004 Jul 23 21:31:52.096994 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2266/4443] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:51 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1511 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:52.206571 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-0292e14a-4afb-4665-aeea-6f5fdb23800e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:52.221886 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-0292e14a-4afb-4665-aeea-6f5fdb23800e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:52.225368 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-0292e14a-4afb-4665-aeea-6f5fdb23800e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:52.227330 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-0292e14a-4afb-4665-aeea-6f5fdb23800e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.172429 Jul 23 21:31:52.240769 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2178/4444] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:31:52 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:31:52.573917 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-1dcf2211-25d1-48eb-a217-482acfbdf80a tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:52.575046 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-1dcf2211-25d1-48eb-a217-482acfbdf80a tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: dcc206d0-3170-459e-b48a-8cf9709e1ffb] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:52.581715 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1dcf2211-25d1-48eb-a217-482acfbdf80a tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:52.582546 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1dcf2211-25d1-48eb-a217-482acfbdf80a tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:52.583536 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1dcf2211-25d1-48eb-a217-482acfbdf80a tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:52.584195 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1dcf2211-25d1-48eb-a217-482acfbdf80a tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:53.032219 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-1dcf2211-25d1-48eb-a217-482acfbdf80a tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:53.043258 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-1dcf2211-25d1-48eb-a217-482acfbdf80a tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/dcc206d0-3170-459e-b48a-8cf9709e1ffb" status: 200 len: 1308 microversion: 2.1 time: 0.474113 Jul 23 21:31:53.044861 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2267/4445] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:52 2022] GET /compute/v2.1/servers/dcc206d0-3170-459e-b48a-8cf9709e1ffb => generated 1308 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:53.071162 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b432e9d7-4422-4864-9b64-a54d1a2d9a5a tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:53.071783 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b432e9d7-4422-4864-9b64-a54d1a2d9a5a tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] [instance: 5cb6a473-80fe-4569-bd9a-52511d3b81aa] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:53.078516 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b432e9d7-4422-4864-9b64-a54d1a2d9a5a tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:53.079219 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b432e9d7-4422-4864-9b64-a54d1a2d9a5a tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:53.080181 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b432e9d7-4422-4864-9b64-a54d1a2d9a5a tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:53.080874 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b432e9d7-4422-4864-9b64-a54d1a2d9a5a tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:53.104936 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-9e01b7b0-032b-43da-8954-5db353e162f4 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:53.106010 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-9e01b7b0-032b-43da-8954-5db353e162f4 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:53.115091 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9e01b7b0-032b-43da-8954-5db353e162f4 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:53.116569 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9e01b7b0-032b-43da-8954-5db353e162f4 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:53.117504 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9e01b7b0-032b-43da-8954-5db353e162f4 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:53.118142 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9e01b7b0-032b-43da-8954-5db353e162f4 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:53.160201 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b432e9d7-4422-4864-9b64-a54d1a2d9a5a tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:53.172422 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b432e9d7-4422-4864-9b64-a54d1a2d9a5a tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:53.184471 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b432e9d7-4422-4864-9b64-a54d1a2d9a5a tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:53.184471 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b432e9d7-4422-4864-9b64-a54d1a2d9a5a tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] 10.222.0.17 "GET /compute/v2.1/servers/5cb6a473-80fe-4569-bd9a-52511d3b81aa" status: 200 len: 1361 microversion: 2.47 time: 0.116936 Jul 23 21:31:53.185345 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2179/4446] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:31:53 2022] GET /compute/v2.1/servers/5cb6a473-80fe-4569-bd9a-52511d3b81aa => generated 1361 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:31:53.198279 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-962c1124-3d60-44c4-892c-8e870f5c57c2 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Action: 'create', calling method: .version_select at 0x7f0b477ad3a0>, body: {"keypair": {"name": "tempest-keypair-755336650", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFcf5zu9jBjf27GRVC3RnpzcubpEWjN/oT3IouT8vd8GnvGaY3TJ7xbglvhFrKW6yYbQtRIRR8np2g8BVbbTStbo7GGsB5LPW+7Bx4Gor0HfYNEwAWy8anHPw6+abrG2Q=="}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:31:53.215718 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-962c1124-3d60-44c4-892c-8e870f5c57c2 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Getting quotas for project ebcf55bcaba04bf8ae8a9b2ac09e8d98. Resources: {'key_pairs'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:31:53.224119 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-962c1124-3d60-44c4-892c-8e870f5c57c2 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Getting quotas for user 37b1e260651b4dffa7c1efe8e9d0f144 and project ebcf55bcaba04bf8ae8a9b2ac09e8d98. Resources: {'key_pairs'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:31:53.261480 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-962c1124-3d60-44c4-892c-8e870f5c57c2 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.074686 Jul 23 21:31:53.262410 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2180/4447] 10.222.0.17 () {60 vars in 1158 bytes} [Sat Jul 23 21:31:53 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:31:53.267930 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0eb4f13f-4334-446d-9520-f089dd52bed6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:53.269061 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-0eb4f13f-4334-446d-9520-f089dd52bed6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:53.276238 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0eb4f13f-4334-446d-9520-f089dd52bed6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:53.276758 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0eb4f13f-4334-446d-9520-f089dd52bed6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:53.277547 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0eb4f13f-4334-446d-9520-f089dd52bed6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:53.278017 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0eb4f13f-4334-446d-9520-f089dd52bed6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:53.389504 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-0eb4f13f-4334-446d-9520-f089dd52bed6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:53.408066 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-0eb4f13f-4334-446d-9520-f089dd52bed6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:53.410482 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-0eb4f13f-4334-446d-9520-f089dd52bed6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:53.413080 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-0eb4f13f-4334-446d-9520-f089dd52bed6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.148708 Jul 23 21:31:53.414033 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2181/4448] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:31:53 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:31:53.480521 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-9e01b7b0-032b-43da-8954-5db353e162f4 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:53.509442 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-9e01b7b0-032b-43da-8954-5db353e162f4 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1511 microversion: 2.1 time: 0.400603 Jul 23 21:31:53.510814 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2268/4449] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:53 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1511 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:54.064085 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5d0c29f0-5ca8-4631-aa93-2aa0d0fe04b8 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:54.073770 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5d0c29f0-5ca8-4631-aa93-2aa0d0fe04b8 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: dcc206d0-3170-459e-b48a-8cf9709e1ffb] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:54.097657 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5d0c29f0-5ca8-4631-aa93-2aa0d0fe04b8 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:54.098757 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5d0c29f0-5ca8-4631-aa93-2aa0d0fe04b8 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:54.099877 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5d0c29f0-5ca8-4631-aa93-2aa0d0fe04b8 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:54.100536 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5d0c29f0-5ca8-4631-aa93-2aa0d0fe04b8 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:54.208720 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d9c8df1d-4bab-4f4e-a1d4-5929317e9cb4 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:54.210247 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-d9c8df1d-4bab-4f4e-a1d4-5929317e9cb4 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] [instance: 5cb6a473-80fe-4569-bd9a-52511d3b81aa] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:54.218204 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d9c8df1d-4bab-4f4e-a1d4-5929317e9cb4 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:54.219093 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d9c8df1d-4bab-4f4e-a1d4-5929317e9cb4 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:54.220936 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d9c8df1d-4bab-4f4e-a1d4-5929317e9cb4 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:54.221614 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d9c8df1d-4bab-4f4e-a1d4-5929317e9cb4 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:54.254862 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-d9c8df1d-4bab-4f4e-a1d4-5929317e9cb4 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] HTTP exception thrown: Instance 5cb6a473-80fe-4569-bd9a-52511d3b81aa could not be found. Jul 23 21:31:54.257053 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d9c8df1d-4bab-4f4e-a1d4-5929317e9cb4 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Request method failure captured: Jul 23 21:31:54.257053 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/servers/5cb6a473-80fe-4569-bd9a-52511d3b81aa HTTP/1.1 Jul 23 21:31:54.257053 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:31:54.257053 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:31:54.257053 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:31:54.257053 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:31:54.257053 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:31:54.257053 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:31:54.257053 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:31:54.257053 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:31:54.257053 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GiaeDrqTWal6mx4Oh6cc6s-nIOpbkWxFl3QkE0tE7K7-jwc9_m20QVzZhFw6Z34M7tVWfTHzZzScjT11dHbq_yBUHf2o8juHPKsCccxaKdSJZRRHYxMqg5xJbyxR9wMVB-0jvhPZfIZMRwVGTs8XNf_enEdv5TlDCKxOTE_vuX2lio Jul 23 21:31:54.257053 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:31:54.257053 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:31:54.257053 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:31:54.257053 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:31:54.257053 ncdv-master-1 devstack@n-api.service[131321]: X-Openstack-Nova-Api-Version: 2.47 Jul 23 21:31:54.257053 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:31:54.257053 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:31:54.257053 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 0ffb5a534beb4a4eab7e16c936a22362 Jul 23 21:31:54.257053 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ServerShowV247Test-787001518 Jul 23 21:31:54.257053 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:31:54.257053 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:31:54.257053 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0ffb5a534beb4a4eab7e16c936a22362"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0ffb5a534beb4a4eab7e16c936a22362"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0ffb5a534beb4a4eab7e16c936a22362", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0ffb5a534beb4a4eab7e16c936a22362"}]}] Jul 23 21:31:54.257053 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ServerShowV247Test-787001518 Jul 23 21:31:54.257053 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 0ffb5a534beb4a4eab7e16c936a22362 Jul 23 21:31:54.257053 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ServerShowV247Test-787001518 Jul 23 21:31:54.257053 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ServerShowV247Test-787001518-project Jul 23 21:31:54.257053 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:31:54.257053 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:31:54.257053 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: d3d6440acdb14f7a8e24fb642f65a919 Jul 23 21:31:54.257053 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ServerShowV247Test-787001518-project Jul 23 21:31:54.257053 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:31:54.257053 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance 5cb6a473-80fe-4569-bd9a-52511d3b81aa could not be found. Jul 23 21:31:54.257053 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': '5cb6a473-80fe-4569-bd9a-52511d3b81aa'} Jul 23 21:31:54.257053 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:31:54.257053 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:54.257053 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:31:54.257053 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:31:54.257053 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:31:54.257053 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:31:54.257053 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:31:54.257053 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:31:54.257053 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:31:54.257053 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:31:54.257053 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5cb6a473-80fe-4569-bd9a-52511d3b81aa could not be found. Jul 23 21:31:54.257053 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:54.257053 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:31:54.257053 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:54.257053 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:54.257053 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:31:54.257053 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:31:54.257053 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:31:54.257053 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:31:54.257053 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:31:54.257053 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:31:54.257053 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:31:54.257053 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:31:54.257053 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:31:54.257053 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:31:54.257053 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:31:54.257053 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:31:54.257053 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5cb6a473-80fe-4569-bd9a-52511d3b81aa could not be found. Jul 23 21:31:54.257053 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:54.257053 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:31:54.257053 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:54.261055 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:54.261055 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:31:54.261055 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:31:54.261055 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:31:54.261055 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:31:54.261055 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5cb6a473-80fe-4569-bd9a-52511d3b81aa could not be found. Jul 23 21:31:54.261055 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:31:54.265232 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d9c8df1d-4bab-4f4e-a1d4-5929317e9cb4 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Returning 404 to user: Instance 5cb6a473-80fe-4569-bd9a-52511d3b81aa could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:31:54.266453 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-d9c8df1d-4bab-4f4e-a1d4-5929317e9cb4 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] 10.222.0.17 "GET /compute/v2.1/servers/5cb6a473-80fe-4569-bd9a-52511d3b81aa" status: 404 len: 111 microversion: 2.47 time: 0.061888 Jul 23 21:31:54.271088 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2269/4450] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:31:54 2022] GET /compute/v2.1/servers/5cb6a473-80fe-4569-bd9a-52511d3b81aa => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 23 21:31:54.276976 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c2ea116d-c141-4f69-b19b-4f773cb2c523 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:54.277800 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-c2ea116d-c141-4f69-b19b-4f773cb2c523 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] [instance: dea61dbd-f797-488b-891f-70b761712a1a] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:54.284674 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c2ea116d-c141-4f69-b19b-4f773cb2c523 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:54.285413 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c2ea116d-c141-4f69-b19b-4f773cb2c523 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:54.286444 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c2ea116d-c141-4f69-b19b-4f773cb2c523 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:54.287077 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c2ea116d-c141-4f69-b19b-4f773cb2c523 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:54.323647 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-c2ea116d-c141-4f69-b19b-4f773cb2c523 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] [instance: dea61dbd-f797-488b-891f-70b761712a1a] Going to try to terminate instance {{(pid=131321) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:31:54.397629 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5d0c29f0-5ca8-4631-aa93-2aa0d0fe04b8 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:54.410977 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5d0c29f0-5ca8-4631-aa93-2aa0d0fe04b8 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/dcc206d0-3170-459e-b48a-8cf9709e1ffb" status: 200 len: 1308 microversion: 2.1 time: 0.353176 Jul 23 21:31:54.412973 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2182/4451] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:54 2022] GET /compute/v2.1/servers/dcc206d0-3170-459e-b48a-8cf9709e1ffb => generated 1308 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:54.435931 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a4cf81a9-8ff9-403e-be36-b1676e0d0de2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:54.437111 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a4cf81a9-8ff9-403e-be36-b1676e0d0de2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:54.468517 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a4cf81a9-8ff9-403e-be36-b1676e0d0de2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:54.470841 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a4cf81a9-8ff9-403e-be36-b1676e0d0de2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:54.479385 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a4cf81a9-8ff9-403e-be36-b1676e0d0de2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:54.480716 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a4cf81a9-8ff9-403e-be36-b1676e0d0de2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:54.491108 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-c2ea116d-c141-4f69-b19b-4f773cb2c523 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] 10.222.0.17 "DELETE /compute/v2.1/servers/dea61dbd-f797-488b-891f-70b761712a1a" status: 204 len: 0 microversion: 2.47 time: 0.218409 Jul 23 21:31:54.492427 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2270/4452] 10.222.0.17 () {60 vars in 1279 bytes} [Sat Jul 23 21:31:54 2022] DELETE /compute/v2.1/servers/dea61dbd-f797-488b-891f-70b761712a1a => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 23 21:31:54.501204 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-2ba9eb48-41a6-4fce-8850-4032779f129a tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:54.502238 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-2ba9eb48-41a6-4fce-8850-4032779f129a tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] [instance: dea61dbd-f797-488b-891f-70b761712a1a] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:54.513349 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2ba9eb48-41a6-4fce-8850-4032779f129a tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:54.515605 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2ba9eb48-41a6-4fce-8850-4032779f129a tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:54.522265 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2ba9eb48-41a6-4fce-8850-4032779f129a tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:54.523140 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2ba9eb48-41a6-4fce-8850-4032779f129a tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:54.645739 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a4cf81a9-8ff9-403e-be36-b1676e0d0de2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:54.657582 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a4cf81a9-8ff9-403e-be36-b1676e0d0de2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:54.659491 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a4cf81a9-8ff9-403e-be36-b1676e0d0de2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:54.661031 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a4cf81a9-8ff9-403e-be36-b1676e0d0de2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.232015 Jul 23 21:31:54.672513 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-2ba9eb48-41a6-4fce-8850-4032779f129a tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:54.683140 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-2ba9eb48-41a6-4fce-8850-4032779f129a tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:54.685223 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2183/4453] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:31:54 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:31:54.687363 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-2ba9eb48-41a6-4fce-8850-4032779f129a tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:54.690680 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-2ba9eb48-41a6-4fce-8850-4032779f129a tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] 10.222.0.17 "GET /compute/v2.1/servers/dea61dbd-f797-488b-891f-70b761712a1a" status: 200 len: 1363 microversion: 2.47 time: 0.192488 Jul 23 21:31:54.691331 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2271/4454] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:31:54 2022] GET /compute/v2.1/servers/dea61dbd-f797-488b-891f-70b761712a1a => generated 1363 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:31:54.702871 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-75d6737a-5622-451a-b512-dcfc2c87f0e0 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:54.702871 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-75d6737a-5622-451a-b512-dcfc2c87f0e0 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:54.709396 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-75d6737a-5622-451a-b512-dcfc2c87f0e0 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:54.710315 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-75d6737a-5622-451a-b512-dcfc2c87f0e0 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:54.711622 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-75d6737a-5622-451a-b512-dcfc2c87f0e0 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:54.712479 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-75d6737a-5622-451a-b512-dcfc2c87f0e0 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:55.046165 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-75d6737a-5622-451a-b512-dcfc2c87f0e0 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:55.055281 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-75d6737a-5622-451a-b512-dcfc2c87f0e0 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1511 microversion: 2.1 time: 0.367974 Jul 23 21:31:55.055484 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2184/4455] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:54 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1511 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:55.157648 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-784a7227-af8d-4c3a-af0d-61ed980ef52c req-0d662ade-6dca-42ec-b511-75b61e67ba6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcc206d0-3170-459e-b48a-8cf9709e1ffb", "name": "network-vif-plugged", "status": "completed", "tag": "42f2d7dd-7907-4a82-b260-d0d132ebcb5f"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:31:55.168150 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-784a7227-af8d-4c3a-af0d-61ed980ef52c req-0d662ade-6dca-42ec-b511-75b61e67ba6a service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:55.169085 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-784a7227-af8d-4c3a-af0d-61ed980ef52c req-0d662ade-6dca-42ec-b511-75b61e67ba6a service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:55.183826 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-784a7227-af8d-4c3a-af0d-61ed980ef52c req-0d662ade-6dca-42ec-b511-75b61e67ba6a service nova] Creating event network-vif-plugged:42f2d7dd-7907-4a82-b260-d0d132ebcb5f for instance dcc206d0-3170-459e-b48a-8cf9709e1ffb on nch1-master-1 Jul 23 21:31:55.191153 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-784a7227-af8d-4c3a-af0d-61ed980ef52c req-0d662ade-6dca-42ec-b511-75b61e67ba6a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037121 Jul 23 21:31:55.192459 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2272/4456] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:31:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:31:55.429189 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ca90cb33-4bf0-46a0-b961-76b1f3131215 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:55.430724 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ca90cb33-4bf0-46a0-b961-76b1f3131215 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: dcc206d0-3170-459e-b48a-8cf9709e1ffb] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:55.439926 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ca90cb33-4bf0-46a0-b961-76b1f3131215 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:55.440618 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ca90cb33-4bf0-46a0-b961-76b1f3131215 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:55.442083 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ca90cb33-4bf0-46a0-b961-76b1f3131215 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:55.447318 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ca90cb33-4bf0-46a0-b961-76b1f3131215 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:55.472418 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=100 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:31:55.674572 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ca90cb33-4bf0-46a0-b961-76b1f3131215 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:55.683948 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ca90cb33-4bf0-46a0-b961-76b1f3131215 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/dcc206d0-3170-459e-b48a-8cf9709e1ffb" status: 200 len: 1308 microversion: 2.1 time: 0.259038 Jul 23 21:31:55.684312 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-21a5fee3-c6a2-4cde-97df-f4249358f8e8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:55.685045 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-21a5fee3-c6a2-4cde-97df-f4249358f8e8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:55.685828 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2185/4457] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:55 2022] GET /compute/v2.1/servers/dcc206d0-3170-459e-b48a-8cf9709e1ffb => generated 1308 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:55.696733 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-21a5fee3-c6a2-4cde-97df-f4249358f8e8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:55.697190 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-21a5fee3-c6a2-4cde-97df-f4249358f8e8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:55.698040 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-21a5fee3-c6a2-4cde-97df-f4249358f8e8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:55.699223 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-21a5fee3-c6a2-4cde-97df-f4249358f8e8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:55.711014 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ea0a5af1-474b-4589-9b1d-d8f2ea08b9ca tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:55.711683 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ea0a5af1-474b-4589-9b1d-d8f2ea08b9ca tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] [instance: dea61dbd-f797-488b-891f-70b761712a1a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:55.721411 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ea0a5af1-474b-4589-9b1d-d8f2ea08b9ca tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:55.722741 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ea0a5af1-474b-4589-9b1d-d8f2ea08b9ca tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:55.723886 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ea0a5af1-474b-4589-9b1d-d8f2ea08b9ca tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:55.724529 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ea0a5af1-474b-4589-9b1d-d8f2ea08b9ca tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:55.816481 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ea0a5af1-474b-4589-9b1d-d8f2ea08b9ca tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:55.828837 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ea0a5af1-474b-4589-9b1d-d8f2ea08b9ca tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:55.830361 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ea0a5af1-474b-4589-9b1d-d8f2ea08b9ca tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:55.831545 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ea0a5af1-474b-4589-9b1d-d8f2ea08b9ca tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] 10.222.0.17 "GET /compute/v2.1/servers/dea61dbd-f797-488b-891f-70b761712a1a" status: 200 len: 1363 microversion: 2.47 time: 0.126146 Jul 23 21:31:55.832136 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2186/4458] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:31:55 2022] GET /compute/v2.1/servers/dea61dbd-f797-488b-891f-70b761712a1a => generated 1363 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:31:55.837339 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1d8b1523-0e36-4690-846a-d4889a4adeec tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1910983400", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e6510bf5-c62e-46e0-81de-3e26ff603612"}], "security_groups": [{"name": "tempest-securitygroup--1957009484"}], "key_name": "tempest-keypair-755336650", "user_data": "}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:31:55.846742 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-21a5fee3-c6a2-4cde-97df-f4249358f8e8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:55.859326 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-21a5fee3-c6a2-4cde-97df-f4249358f8e8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:55.861465 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-21a5fee3-c6a2-4cde-97df-f4249358f8e8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:55.862710 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-21a5fee3-c6a2-4cde-97df-f4249358f8e8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.186249 Jul 23 21:31:55.867741 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2273/4459] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:31:55 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:31:55.953199 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-1d8b1523-0e36-4690-846a-d4889a4adeec tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] validate_networks() for [('e6510bf5-c62e-46e0-81de-3e26ff603612', None, None, None, None, None)] {{(pid=131320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:31:56.072550 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-117e4b6d-d473-46ac-84f2-5a9f2d4f3f55 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:56.073527 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-117e4b6d-d473-46ac-84f2-5a9f2d4f3f55 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:56.084983 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-117e4b6d-d473-46ac-84f2-5a9f2d4f3f55 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:56.085481 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-117e4b6d-d473-46ac-84f2-5a9f2d4f3f55 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:56.086508 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-117e4b6d-d473-46ac-84f2-5a9f2d4f3f55 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:56.087240 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-117e4b6d-d473-46ac-84f2-5a9f2d4f3f55 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:56.395740 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-117e4b6d-d473-46ac-84f2-5a9f2d4f3f55 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:56.415697 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-117e4b6d-d473-46ac-84f2-5a9f2d4f3f55 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1511 microversion: 2.1 time: 0.345786 Jul 23 21:31:56.418329 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2274/4460] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:56 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1511 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:56.580092 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-1d8b1523-0e36-4690-846a-d4889a4adeec tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:31:56.580703 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-1d8b1523-0e36-4690-846a-d4889a4adeec tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:31:56.582009 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-1d8b1523-0e36-4690-846a-d4889a4adeec tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:31:56.582907 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-1d8b1523-0e36-4690-846a-d4889a4adeec tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:31:56.583761 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-1d8b1523-0e36-4690-846a-d4889a4adeec tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:31:56.597277 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1d8b1523-0e36-4690-846a-d4889a4adeec tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:56.598036 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1d8b1523-0e36-4690-846a-d4889a4adeec tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:56.599180 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1d8b1523-0e36-4690-846a-d4889a4adeec tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:56.600299 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1d8b1523-0e36-4690-846a-d4889a4adeec tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:56.625020 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-1d8b1523-0e36-4690-846a-d4889a4adeec tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Getting quotas for project ebcf55bcaba04bf8ae8a9b2ac09e8d98. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:31:56.634152 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-1d8b1523-0e36-4690-846a-d4889a4adeec tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Getting quotas for user 37b1e260651b4dffa7c1efe8e9d0f144 and project ebcf55bcaba04bf8ae8a9b2ac09e8d98. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:31:56.654265 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1d8b1523-0e36-4690-846a-d4889a4adeec tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Going to run 1 instances... {{(pid=131320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:31:56.659787 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1d8b1523-0e36-4690-846a-d4889a4adeec tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] [instance: f66b6134-b8aa-4df7-9905-b7488fe6bc85] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:31:56.716134 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-420ab5c9-9017-4f8e-bc65-03674b42470a tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:56.716585 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-420ab5c9-9017-4f8e-bc65-03674b42470a tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: dcc206d0-3170-459e-b48a-8cf9709e1ffb] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:56.726790 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-420ab5c9-9017-4f8e-bc65-03674b42470a tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:56.727542 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-420ab5c9-9017-4f8e-bc65-03674b42470a tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:56.728541 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-420ab5c9-9017-4f8e-bc65-03674b42470a tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:56.729462 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-420ab5c9-9017-4f8e-bc65-03674b42470a tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:56.776245 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1d8b1523-0e36-4690-846a-d4889a4adeec tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.942618 Jul 23 21:31:56.777257 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2187/4461] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:31:55 2022] POST /compute/v2.1/servers => generated 402 bytes in 944 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 23 21:31:56.787060 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2511df9e-791d-42ae-9c15-01a4a3d6ab79 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:56.787680 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-2511df9e-791d-42ae-9c15-01a4a3d6ab79 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] [instance: f66b6134-b8aa-4df7-9905-b7488fe6bc85] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:56.888944 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-2511df9e-791d-42ae-9c15-01a4a3d6ab79 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b1e260651b4dffa7c1efe8e9d0f144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcf55bcaba04bf8ae8a9b2ac09e8d98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:56.905538 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2511df9e-791d-42ae-9c15-01a4a3d6ab79 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] 10.222.0.17 "GET /compute/v2.1/servers/f66b6134-b8aa-4df7-9905-b7488fe6bc85" status: 200 len: 1241 microversion: 2.1 time: 0.122247 Jul 23 21:31:56.915209 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2188/4462] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:56 2022] GET /compute/v2.1/servers/f66b6134-b8aa-4df7-9905-b7488fe6bc85 => generated 1241 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:56.920270 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c97b116b-384e-4399-9d05-a36db7f9e99a tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:56.920883 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c97b116b-384e-4399-9d05-a36db7f9e99a tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] [instance: dea61dbd-f797-488b-891f-70b761712a1a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:56.927421 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c97b116b-384e-4399-9d05-a36db7f9e99a tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:56.927734 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c97b116b-384e-4399-9d05-a36db7f9e99a tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:56.928525 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c97b116b-384e-4399-9d05-a36db7f9e99a tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:56.928963 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c97b116b-384e-4399-9d05-a36db7f9e99a tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:57.094987 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c97b116b-384e-4399-9d05-a36db7f9e99a tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:57.113787 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c97b116b-384e-4399-9d05-a36db7f9e99a tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:57.116094 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c97b116b-384e-4399-9d05-a36db7f9e99a tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:57.118237 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c97b116b-384e-4399-9d05-a36db7f9e99a tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] 10.222.0.17 "GET /compute/v2.1/servers/dea61dbd-f797-488b-891f-70b761712a1a" status: 200 len: 1363 microversion: 2.47 time: 0.201549 Jul 23 21:31:57.129925 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2189/4463] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:31:56 2022] GET /compute/v2.1/servers/dea61dbd-f797-488b-891f-70b761712a1a => generated 1363 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:31:57.147189 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-38d76778-299e-4ca5-a3b3-3cc2461d6bf8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:57.147818 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-38d76778-299e-4ca5-a3b3-3cc2461d6bf8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:57.163396 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-38d76778-299e-4ca5-a3b3-3cc2461d6bf8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:57.164409 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-38d76778-299e-4ca5-a3b3-3cc2461d6bf8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:57.165486 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-38d76778-299e-4ca5-a3b3-3cc2461d6bf8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:57.166159 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-38d76778-299e-4ca5-a3b3-3cc2461d6bf8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:57.203475 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-420ab5c9-9017-4f8e-bc65-03674b42470a tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:57.207741 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:31:57.212123 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-420ab5c9-9017-4f8e-bc65-03674b42470a tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/dcc206d0-3170-459e-b48a-8cf9709e1ffb" status: 200 len: 1308 microversion: 2.1 time: 0.512325 Jul 23 21:31:57.212725 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2275/4464] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:56 2022] GET /compute/v2.1/servers/dcc206d0-3170-459e-b48a-8cf9709e1ffb => generated 1308 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:57.435174 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-91fdeb1f-595f-491a-9427-40d2f89b85ea tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:57.435790 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-91fdeb1f-595f-491a-9427-40d2f89b85ea tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:57.451482 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-91fdeb1f-595f-491a-9427-40d2f89b85ea tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:57.451954 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-91fdeb1f-595f-491a-9427-40d2f89b85ea tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:57.455360 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-91fdeb1f-595f-491a-9427-40d2f89b85ea tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:57.459629 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-91fdeb1f-595f-491a-9427-40d2f89b85ea tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:57.793674 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-91fdeb1f-595f-491a-9427-40d2f89b85ea tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:57.796295 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-38d76778-299e-4ca5-a3b3-3cc2461d6bf8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:57.812384 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-91fdeb1f-595f-491a-9427-40d2f89b85ea tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1511 microversion: 2.1 time: 0.379979 Jul 23 21:31:57.813757 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-38d76778-299e-4ca5-a3b3-3cc2461d6bf8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:57.815078 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2276/4465] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:57 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1511 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:31:57.824622 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-38d76778-299e-4ca5-a3b3-3cc2461d6bf8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:57.828650 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-38d76778-299e-4ca5-a3b3-3cc2461d6bf8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.702598 Jul 23 21:31:57.847173 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2190/4466] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:31:57 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:31:57.922479 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-739921fc-4721-4d06-bf2d-f29bb96b5b49 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:57.923462 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-739921fc-4721-4d06-bf2d-f29bb96b5b49 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] [instance: f66b6134-b8aa-4df7-9905-b7488fe6bc85] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:57.929977 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-739921fc-4721-4d06-bf2d-f29bb96b5b49 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:57.930680 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-739921fc-4721-4d06-bf2d-f29bb96b5b49 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:57.931844 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-739921fc-4721-4d06-bf2d-f29bb96b5b49 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:57.933023 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-739921fc-4721-4d06-bf2d-f29bb96b5b49 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:58.011717 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-739921fc-4721-4d06-bf2d-f29bb96b5b49 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b1e260651b4dffa7c1efe8e9d0f144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcf55bcaba04bf8ae8a9b2ac09e8d98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:58.019858 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-739921fc-4721-4d06-bf2d-f29bb96b5b49 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] 10.222.0.17 "GET /compute/v2.1/servers/f66b6134-b8aa-4df7-9905-b7488fe6bc85" status: 200 len: 1293 microversion: 2.1 time: 0.101185 Jul 23 21:31:58.020611 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2277/4467] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:57 2022] GET /compute/v2.1/servers/f66b6134-b8aa-4df7-9905-b7488fe6bc85 => generated 1293 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:58.143968 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a6ef2c5c-1cdd-4c4b-93f1-9d4b10aed590 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:58.145114 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a6ef2c5c-1cdd-4c4b-93f1-9d4b10aed590 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] [instance: dea61dbd-f797-488b-891f-70b761712a1a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:58.176034 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a6ef2c5c-1cdd-4c4b-93f1-9d4b10aed590 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:58.178366 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a6ef2c5c-1cdd-4c4b-93f1-9d4b10aed590 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:58.180339 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a6ef2c5c-1cdd-4c4b-93f1-9d4b10aed590 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:58.182382 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a6ef2c5c-1cdd-4c4b-93f1-9d4b10aed590 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:58.231325 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d04a6579-f5d9-4cfb-9f52-af3d5e745dfd tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:58.232724 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-d04a6579-f5d9-4cfb-9f52-af3d5e745dfd tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: dcc206d0-3170-459e-b48a-8cf9709e1ffb] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:58.246488 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d04a6579-f5d9-4cfb-9f52-af3d5e745dfd tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:58.250197 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d04a6579-f5d9-4cfb-9f52-af3d5e745dfd tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:58.251852 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d04a6579-f5d9-4cfb-9f52-af3d5e745dfd tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:58.253092 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d04a6579-f5d9-4cfb-9f52-af3d5e745dfd tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:58.294901 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a6ef2c5c-1cdd-4c4b-93f1-9d4b10aed590 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:58.297024 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a6ef2c5c-1cdd-4c4b-93f1-9d4b10aed590 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:58.300029 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.objects.instance [None req-a6ef2c5c-1cdd-4c4b-93f1-9d4b10aed590 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lazy-loading 'fault' on Instance uuid dea61dbd-f797-488b-891f-70b761712a1a {{(pid=131320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:31:58.416088 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a6ef2c5c-1cdd-4c4b-93f1-9d4b10aed590 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:58.437213 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a6ef2c5c-1cdd-4c4b-93f1-9d4b10aed590 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:58.440460 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a6ef2c5c-1cdd-4c4b-93f1-9d4b10aed590 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3d6440acdb14f7a8e24fb642f65a919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ffb5a534beb4a4eab7e16c936a22362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:58.444721 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a6ef2c5c-1cdd-4c4b-93f1-9d4b10aed590 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] 10.222.0.17 "GET /compute/v2.1/servers/dea61dbd-f797-488b-891f-70b761712a1a" status: 200 len: 1368 microversion: 2.47 time: 0.307536 Jul 23 21:31:58.446592 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2191/4468] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:31:58 2022] GET /compute/v2.1/servers/dea61dbd-f797-488b-891f-70b761712a1a => generated 1368 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:31:58.552184 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-d04a6579-f5d9-4cfb-9f52-af3d5e745dfd tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:58.560452 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-d04a6579-f5d9-4cfb-9f52-af3d5e745dfd tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/dcc206d0-3170-459e-b48a-8cf9709e1ffb" status: 200 len: 1490 microversion: 2.1 time: 0.335244 Jul 23 21:31:58.561076 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2278/4469] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:58 2022] GET /compute/v2.1/servers/dcc206d0-3170-459e-b48a-8cf9709e1ffb => generated 1490 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:58.580020 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-acffe103-4b86-46b6-8717-4a014f4b3f13 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-2116640043"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:31:58.581670 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-acffe103-4b86-46b6-8717-4a014f4b3f13 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: dcc206d0-3170-459e-b48a-8cf9709e1ffb] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:58.593451 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-acffe103-4b86-46b6-8717-4a014f4b3f13 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:58.593927 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-acffe103-4b86-46b6-8717-4a014f4b3f13 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:58.594720 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-acffe103-4b86-46b6-8717-4a014f4b3f13 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:58.595155 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-acffe103-4b86-46b6-8717-4a014f4b3f13 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:58.759281 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-acffe103-4b86-46b6-8717-4a014f4b3f13 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "PUT /compute/v2.1/servers/dcc206d0-3170-459e-b48a-8cf9709e1ffb" status: 200 len: 1076 microversion: 2.1 time: 0.183723 Jul 23 21:31:58.760452 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2192/4470] 10.222.0.17 () {60 vars in 1255 bytes} [Sat Jul 23 21:31:58 2022] PUT /compute/v2.1/servers/dcc206d0-3170-459e-b48a-8cf9709e1ffb => generated 1076 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:58.775032 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-89bc6e54-baed-4dbd-a557-88f88febecca tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:58.777105 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-89bc6e54-baed-4dbd-a557-88f88febecca tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: dcc206d0-3170-459e-b48a-8cf9709e1ffb] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:58.784721 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-89bc6e54-baed-4dbd-a557-88f88febecca tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:58.785486 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-89bc6e54-baed-4dbd-a557-88f88febecca tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:58.786637 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-89bc6e54-baed-4dbd-a557-88f88febecca tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:58.787245 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-89bc6e54-baed-4dbd-a557-88f88febecca tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:58.831970 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b870f673-579c-497f-b081-6689b22d8b60 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:58.833162 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b870f673-579c-497f-b081-6689b22d8b60 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:58.841973 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b870f673-579c-497f-b081-6689b22d8b60 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:58.845465 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b870f673-579c-497f-b081-6689b22d8b60 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:58.846536 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b870f673-579c-497f-b081-6689b22d8b60 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:58.847204 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b870f673-579c-497f-b081-6689b22d8b60 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:59.139640 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-89bc6e54-baed-4dbd-a557-88f88febecca tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:59.146686 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b870f673-579c-497f-b081-6689b22d8b60 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:59.157401 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b870f673-579c-497f-b081-6689b22d8b60 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1511 microversion: 2.1 time: 0.330107 Jul 23 21:31:59.161708 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-89bc6e54-baed-4dbd-a557-88f88febecca tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/dcc206d0-3170-459e-b48a-8cf9709e1ffb" status: 200 len: 1502 microversion: 2.1 time: 0.390475 Jul 23 21:31:59.173827 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2193/4471] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:58 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1511 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:59.175216 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2279/4472] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:58 2022] GET /compute/v2.1/servers/dcc206d0-3170-459e-b48a-8cf9709e1ffb => generated 1502 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:59.185224 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d41433be-0d30-46a2-951c-e83df4df1819 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:59.187630 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-07479883-d0a3-468b-929a-d0da07819951 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:59.188324 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-07479883-d0a3-468b-929a-d0da07819951 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] [instance: f66b6134-b8aa-4df7-9905-b7488fe6bc85] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:59.190873 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d41433be-0d30-46a2-951c-e83df4df1819 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:59.202828 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-07479883-d0a3-468b-929a-d0da07819951 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:59.203359 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-07479883-d0a3-468b-929a-d0da07819951 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:59.204316 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-07479883-d0a3-468b-929a-d0da07819951 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:59.204756 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-07479883-d0a3-468b-929a-d0da07819951 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:59.207466 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d41433be-0d30-46a2-951c-e83df4df1819 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:59.207915 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d41433be-0d30-46a2-951c-e83df4df1819 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:59.208703 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d41433be-0d30-46a2-951c-e83df4df1819 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:59.209283 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d41433be-0d30-46a2-951c-e83df4df1819 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:59.322449 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d41433be-0d30-46a2-951c-e83df4df1819 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:59.326212 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-07479883-d0a3-468b-929a-d0da07819951 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b1e260651b4dffa7c1efe8e9d0f144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcf55bcaba04bf8ae8a9b2ac09e8d98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:59.339528 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-07479883-d0a3-468b-929a-d0da07819951 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] 10.222.0.17 "GET /compute/v2.1/servers/f66b6134-b8aa-4df7-9905-b7488fe6bc85" status: 200 len: 1299 microversion: 2.1 time: 0.160259 Jul 23 21:31:59.340867 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d41433be-0d30-46a2-951c-e83df4df1819 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:59.343557 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d41433be-0d30-46a2-951c-e83df4df1819 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:59.349131 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d41433be-0d30-46a2-951c-e83df4df1819 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.173674 Jul 23 21:31:59.349928 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2280/4473] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:59 2022] GET /compute/v2.1/servers/f66b6134-b8aa-4df7-9905-b7488fe6bc85 => generated 1299 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:59.360538 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2194/4474] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:31:59 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:31:59.367243 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-2fbae775-499c-434a-9bc6-f187ff1eed44 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:59.367869 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-2fbae775-499c-434a-9bc6-f187ff1eed44 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: dcc206d0-3170-459e-b48a-8cf9709e1ffb] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:59.385913 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2fbae775-499c-434a-9bc6-f187ff1eed44 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:59.386376 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2fbae775-499c-434a-9bc6-f187ff1eed44 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:59.387174 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2fbae775-499c-434a-9bc6-f187ff1eed44 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:59.387614 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2fbae775-499c-434a-9bc6-f187ff1eed44 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:59.465285 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a1f1d859-ab85-4e5a-9ccd-dedce4413e79 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:59.465919 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a1f1d859-ab85-4e5a-9ccd-dedce4413e79 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] [instance: dea61dbd-f797-488b-891f-70b761712a1a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:59.472351 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a1f1d859-ab85-4e5a-9ccd-dedce4413e79 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:59.472803 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a1f1d859-ab85-4e5a-9ccd-dedce4413e79 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:59.473690 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a1f1d859-ab85-4e5a-9ccd-dedce4413e79 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:59.474186 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a1f1d859-ab85-4e5a-9ccd-dedce4413e79 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:59.493214 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-a1f1d859-ab85-4e5a-9ccd-dedce4413e79 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] HTTP exception thrown: Instance dea61dbd-f797-488b-891f-70b761712a1a could not be found. Jul 23 21:31:59.494809 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a1f1d859-ab85-4e5a-9ccd-dedce4413e79 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Request method failure captured: Jul 23 21:31:59.494809 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/dea61dbd-f797-488b-891f-70b761712a1a HTTP/1.1 Jul 23 21:31:59.494809 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:31:59.494809 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:31:59.494809 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:31:59.494809 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:31:59.494809 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:31:59.494809 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:31:59.494809 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:31:59.494809 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:31:59.494809 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GiaeDrqTWal6mx4Oh6cc6s-nIOpbkWxFl3QkE0tE7K7-jwc9_m20QVzZhFw6Z34M7tVWfTHzZzScjT11dHbq_yBUHf2o8juHPKsCccxaKdSJZRRHYxMqg5xJbyxR9wMVB-0jvhPZfIZMRwVGTs8XNf_enEdv5TlDCKxOTE_vuX2lio Jul 23 21:31:59.494809 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:31:59.494809 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:31:59.494809 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:31:59.494809 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:31:59.494809 ncdv-master-1 devstack@n-api.service[131320]: X-Openstack-Nova-Api-Version: 2.47 Jul 23 21:31:59.494809 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:31:59.494809 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:31:59.494809 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 0ffb5a534beb4a4eab7e16c936a22362 Jul 23 21:31:59.494809 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServerShowV247Test-787001518 Jul 23 21:31:59.494809 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:31:59.494809 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:31:59.494809 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0ffb5a534beb4a4eab7e16c936a22362"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0ffb5a534beb4a4eab7e16c936a22362"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0ffb5a534beb4a4eab7e16c936a22362", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0ffb5a534beb4a4eab7e16c936a22362"}]}] Jul 23 21:31:59.494809 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServerShowV247Test-787001518 Jul 23 21:31:59.494809 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 0ffb5a534beb4a4eab7e16c936a22362 Jul 23 21:31:59.494809 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServerShowV247Test-787001518 Jul 23 21:31:59.494809 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServerShowV247Test-787001518-project Jul 23 21:31:59.494809 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:31:59.494809 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:31:59.494809 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: d3d6440acdb14f7a8e24fb642f65a919 Jul 23 21:31:59.494809 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServerShowV247Test-787001518-project Jul 23 21:31:59.494809 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:31:59.494809 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance dea61dbd-f797-488b-891f-70b761712a1a could not be found. Jul 23 21:31:59.494809 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': 'dea61dbd-f797-488b-891f-70b761712a1a'} Jul 23 21:31:59.494809 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:31:59.494809 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:59.494809 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:31:59.494809 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:31:59.494809 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:31:59.494809 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:31:59.494809 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:31:59.494809 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:31:59.494809 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:31:59.494809 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:31:59.494809 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dea61dbd-f797-488b-891f-70b761712a1a could not be found. Jul 23 21:31:59.494809 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:31:59.494809 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:31:59.494809 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:31:59.494809 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:59.494809 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:31:59.494809 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:31:59.494809 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:31:59.494809 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:31:59.494809 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:31:59.494809 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:31:59.494809 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:31:59.494809 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:31:59.494809 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:31:59.494809 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:31:59.494809 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:31:59.494809 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:31:59.494809 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dea61dbd-f797-488b-891f-70b761712a1a could not be found. Jul 23 21:31:59.494809 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:31:59.494809 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:31:59.494809 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:31:59.502685 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:31:59.502685 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:31:59.502685 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:31:59.502685 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:31:59.502685 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:31:59.502685 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dea61dbd-f797-488b-891f-70b761712a1a could not be found. Jul 23 21:31:59.502685 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:31:59.502685 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a1f1d859-ab85-4e5a-9ccd-dedce4413e79 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] Returning 404 to user: Instance dea61dbd-f797-488b-891f-70b761712a1a could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:31:59.502685 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a1f1d859-ab85-4e5a-9ccd-dedce4413e79 tempest-ServerShowV247Test-787001518 tempest-ServerShowV247Test-787001518-project] 10.222.0.17 "GET /compute/v2.1/servers/dea61dbd-f797-488b-891f-70b761712a1a" status: 404 len: 111 microversion: 2.47 time: 0.035228 Jul 23 21:31:59.502685 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2195/4475] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:31:59 2022] GET /compute/v2.1/servers/dea61dbd-f797-488b-891f-70b761712a1a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 23 21:31:59.691688 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-2fbae775-499c-434a-9bc6-f187ff1eed44 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:31:59.713365 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-2fbae775-499c-434a-9bc6-f187ff1eed44 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/dcc206d0-3170-459e-b48a-8cf9709e1ffb" status: 200 len: 1502 microversion: 2.1 time: 0.360252 Jul 23 21:31:59.714503 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2281/4476] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:59 2022] GET /compute/v2.1/servers/dcc206d0-3170-459e-b48a-8cf9709e1ffb => generated 1502 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:31:59.732655 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0f18d881-2c56-4dd2-b4d0-14a391e5963f tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:31:59.745486 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0f18d881-2c56-4dd2-b4d0-14a391e5963f tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:59.746257 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0f18d881-2c56-4dd2-b4d0-14a391e5963f tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:59.779383 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-0f18d881-2c56-4dd2-b4d0-14a391e5963f tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: dcc206d0-3170-459e-b48a-8cf9709e1ffb] Going to try to stop instance {{(pid=131320) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 23 21:31:59.879980 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-0f18d881-2c56-4dd2-b4d0-14a391e5963f tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "POST /compute/v2.1/servers/dcc206d0-3170-459e-b48a-8cf9709e1ffb/action" status: 202 len: 0 microversion: 2.1 time: 0.152473 Jul 23 21:31:59.884538 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2196/4477] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:31:59 2022] POST /compute/v2.1/servers/dcc206d0-3170-459e-b48a-8cf9709e1ffb/action => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:31:59.889715 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-45cd902a-388f-4a4a-a878-d02036f66a93 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:31:59.890455 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-45cd902a-388f-4a4a-a878-d02036f66a93 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: dcc206d0-3170-459e-b48a-8cf9709e1ffb] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:31:59.909364 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-45cd902a-388f-4a4a-a878-d02036f66a93 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:59.910255 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-45cd902a-388f-4a4a-a878-d02036f66a93 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:31:59.911799 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-45cd902a-388f-4a4a-a878-d02036f66a93 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:31:59.914561 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-45cd902a-388f-4a4a-a878-d02036f66a93 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:00.178638 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ce3f27f0-f3c1-445d-b768-50525a89faa4 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:00.179612 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ce3f27f0-f3c1-445d-b768-50525a89faa4 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:00.187096 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ce3f27f0-f3c1-445d-b768-50525a89faa4 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:00.187802 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ce3f27f0-f3c1-445d-b768-50525a89faa4 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:00.188739 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ce3f27f0-f3c1-445d-b768-50525a89faa4 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:00.189327 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ce3f27f0-f3c1-445d-b768-50525a89faa4 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:00.416433 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-45cd902a-388f-4a4a-a878-d02036f66a93 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:00.433045 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-45cd902a-388f-4a4a-a878-d02036f66a93 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/dcc206d0-3170-459e-b48a-8cf9709e1ffb" status: 200 len: 1512 microversion: 2.1 time: 0.546011 Jul 23 21:32:00.436034 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2282/4478] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:31:59 2022] GET /compute/v2.1/servers/dcc206d0-3170-459e-b48a-8cf9709e1ffb => generated 1512 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:32:00.443044 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-6c9e752d-2852-4eb0-91b5-f309ebd2c395 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:00.443905 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-6c9e752d-2852-4eb0-91b5-f309ebd2c395 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] [instance: f66b6134-b8aa-4df7-9905-b7488fe6bc85] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:00.451652 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6c9e752d-2852-4eb0-91b5-f309ebd2c395 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:00.452457 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6c9e752d-2852-4eb0-91b5-f309ebd2c395 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:00.453483 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6c9e752d-2852-4eb0-91b5-f309ebd2c395 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:00.454227 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6c9e752d-2852-4eb0-91b5-f309ebd2c395 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:00.495511 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ce3f27f0-f3c1-445d-b768-50525a89faa4 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:00.510237 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ce3f27f0-f3c1-445d-b768-50525a89faa4 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1532 microversion: 2.1 time: 0.335344 Jul 23 21:32:00.523244 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2197/4479] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:00 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1532 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:32:00.535849 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e5803f6a-e9a8-4aa7-a01c-61c27087c346 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:00.537259 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e5803f6a-e9a8-4aa7-a01c-61c27087c346 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:00.566059 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e5803f6a-e9a8-4aa7-a01c-61c27087c346 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:00.566525 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e5803f6a-e9a8-4aa7-a01c-61c27087c346 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:00.567328 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e5803f6a-e9a8-4aa7-a01c-61c27087c346 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:00.567774 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e5803f6a-e9a8-4aa7-a01c-61c27087c346 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:00.748528 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e5803f6a-e9a8-4aa7-a01c-61c27087c346 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:00.762098 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e5803f6a-e9a8-4aa7-a01c-61c27087c346 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:00.764511 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e5803f6a-e9a8-4aa7-a01c-61c27087c346 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:00.766904 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e5803f6a-e9a8-4aa7-a01c-61c27087c346 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.242455 Jul 23 21:32:00.768040 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2198/4480] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:32:00 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:32:00.956279 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-6c9e752d-2852-4eb0-91b5-f309ebd2c395 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b1e260651b4dffa7c1efe8e9d0f144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcf55bcaba04bf8ae8a9b2ac09e8d98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:00.990305 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-6c9e752d-2852-4eb0-91b5-f309ebd2c395 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] 10.222.0.17 "GET /compute/v2.1/servers/f66b6134-b8aa-4df7-9905-b7488fe6bc85" status: 200 len: 1367 microversion: 2.1 time: 0.552788 Jul 23 21:32:01.002539 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2283/4481] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:00 2022] GET /compute/v2.1/servers/f66b6134-b8aa-4df7-9905-b7488fe6bc85 => generated 1367 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:32:01.366775 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-93eacc80-53cb-4c31-b6ce-0260c438c993 req-454080e6-5b24-4a91-8eb7-a6bda084eb8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f66b6134-b8aa-4df7-9905-b7488fe6bc85", "tag": "7ffd9730-367d-43b1-af40-908b309e515f"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:32:01.381062 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-93eacc80-53cb-4c31-b6ce-0260c438c993 req-454080e6-5b24-4a91-8eb7-a6bda084eb8e service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:01.383898 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-93eacc80-53cb-4c31-b6ce-0260c438c993 req-454080e6-5b24-4a91-8eb7-a6bda084eb8e service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:01.425048 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-93eacc80-53cb-4c31-b6ce-0260c438c993 req-454080e6-5b24-4a91-8eb7-a6bda084eb8e service nova] Creating event network-changed:7ffd9730-367d-43b1-af40-908b309e515f for instance f66b6134-b8aa-4df7-9905-b7488fe6bc85 on nch2-master-1 Jul 23 21:32:01.430172 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-93eacc80-53cb-4c31-b6ce-0260c438c993 req-454080e6-5b24-4a91-8eb7-a6bda084eb8e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069206 Jul 23 21:32:01.435900 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2199/4482] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:32:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:32:01.453810 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-8a841d69-12cd-4f05-b3cd-0dc77c7f2224 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:01.454462 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-8a841d69-12cd-4f05-b3cd-0dc77c7f2224 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: dcc206d0-3170-459e-b48a-8cf9709e1ffb] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:01.482304 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell0:SELECT=4 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:32:01.483552 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell0:SELECT=8 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:32:01.489763 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8a841d69-12cd-4f05-b3cd-0dc77c7f2224 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:01.490740 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8a841d69-12cd-4f05-b3cd-0dc77c7f2224 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:01.492164 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8a841d69-12cd-4f05-b3cd-0dc77c7f2224 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:01.492789 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8a841d69-12cd-4f05-b3cd-0dc77c7f2224 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:01.886120 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-8a841d69-12cd-4f05-b3cd-0dc77c7f2224 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:01.896098 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-8a841d69-12cd-4f05-b3cd-0dc77c7f2224 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/dcc206d0-3170-459e-b48a-8cf9709e1ffb" status: 200 len: 1512 microversion: 2.1 time: 0.446804 Jul 23 21:32:01.898464 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2284/4483] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:01 2022] GET /compute/v2.1/servers/dcc206d0-3170-459e-b48a-8cf9709e1ffb => generated 1512 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:32:01.904073 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-55a2411f-af00-4bb6-ad40-dde8330accd7 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:01.904676 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-55a2411f-af00-4bb6-ad40-dde8330accd7 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:01.935317 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-55a2411f-af00-4bb6-ad40-dde8330accd7 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:01.936105 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-55a2411f-af00-4bb6-ad40-dde8330accd7 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:01.938973 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-55a2411f-af00-4bb6-ad40-dde8330accd7 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:01.939730 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-55a2411f-af00-4bb6-ad40-dde8330accd7 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:02.142569 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ced5640b-4aad-4520-97e6-28468efbf896 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Action: 'create', calling method: .version_select at 0x7f0b47035ca0>, body: {"keypair": {"name": "tempest-keypair-1851525913", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDdsU5gs6lvioqUDZ+LlsjktyNsA23v+XHJqTZhA1Qy7nFaqTcfRRjlhaRdOi7TBVFAye1YnPHoh+uaZcp9UYjwzd2RdS6cWEbxU75Y01U6VVh3Qvt/mUsGO9kY0cAbxbA=="}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:32:02.157498 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-55a2411f-af00-4bb6-ad40-dde8330accd7 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:02.167380 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-55a2411f-af00-4bb6-ad40-dde8330accd7 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1527 microversion: 2.1 time: 0.266808 Jul 23 21:32:02.169374 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-ced5640b-4aad-4520-97e6-28468efbf896 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Getting quotas for project 49da2dec096c474199da94d7c7a83258. Resources: {'key_pairs'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:32:02.174968 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-ced5640b-4aad-4520-97e6-28468efbf896 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Getting quotas for user 048f5756139b4283b695c057647983ba and project 49da2dec096c474199da94d7c7a83258. Resources: {'key_pairs'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:32:02.176891 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2285/4484] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:01 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1527 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:32:02.190099 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d9a0bd14-97ab-40a6-96c0-a1fd3d19fec1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:02.191476 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-d9a0bd14-97ab-40a6-96c0-a1fd3d19fec1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:02.204544 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d9a0bd14-97ab-40a6-96c0-a1fd3d19fec1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:02.205113 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d9a0bd14-97ab-40a6-96c0-a1fd3d19fec1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:02.205902 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d9a0bd14-97ab-40a6-96c0-a1fd3d19fec1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:02.206343 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d9a0bd14-97ab-40a6-96c0-a1fd3d19fec1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:02.248879 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ced5640b-4aad-4520-97e6-28468efbf896 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.774916 Jul 23 21:32:02.249271 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2200/4485] 10.222.0.17 () {62 vars in 1199 bytes} [Sat Jul 23 21:32:01 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 777 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 23 21:32:02.269037 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-362cb590-bf72-4041-bf33-4ee9672396db tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:02.269793 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-362cb590-bf72-4041-bf33-4ee9672396db tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] [instance: f66b6134-b8aa-4df7-9905-b7488fe6bc85] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:02.299729 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-362cb590-bf72-4041-bf33-4ee9672396db tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:02.301540 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-362cb590-bf72-4041-bf33-4ee9672396db tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:02.302679 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-362cb590-bf72-4041-bf33-4ee9672396db tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:02.303201 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-362cb590-bf72-4041-bf33-4ee9672396db tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:02.378714 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-d9a0bd14-97ab-40a6-96c0-a1fd3d19fec1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:02.392486 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-d9a0bd14-97ab-40a6-96c0-a1fd3d19fec1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:02.394343 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-d9a0bd14-97ab-40a6-96c0-a1fd3d19fec1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:02.395801 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-d9a0bd14-97ab-40a6-96c0-a1fd3d19fec1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.217615 Jul 23 21:32:02.396556 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2286/4486] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:32:02 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:32:02.548647 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-362cb590-bf72-4041-bf33-4ee9672396db tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b1e260651b4dffa7c1efe8e9d0f144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcf55bcaba04bf8ae8a9b2ac09e8d98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:02.558646 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-362cb590-bf72-4041-bf33-4ee9672396db tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] 10.222.0.17 "GET /compute/v2.1/servers/f66b6134-b8aa-4df7-9905-b7488fe6bc85" status: 200 len: 1367 microversion: 2.1 time: 0.306201 Jul 23 21:32:02.560625 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2201/4487] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:02 2022] GET /compute/v2.1/servers/f66b6134-b8aa-4df7-9905-b7488fe6bc85 => generated 1367 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:32:02.917699 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-44c507fe-40a6-47bd-b161-cc295f14e264 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:02.919329 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-44c507fe-40a6-47bd-b161-cc295f14e264 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: dcc206d0-3170-459e-b48a-8cf9709e1ffb] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:02.934744 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-44c507fe-40a6-47bd-b161-cc295f14e264 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:02.936163 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-44c507fe-40a6-47bd-b161-cc295f14e264 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:02.937413 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-44c507fe-40a6-47bd-b161-cc295f14e264 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:02.939316 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-44c507fe-40a6-47bd-b161-cc295f14e264 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:03.169893 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-44c507fe-40a6-47bd-b161-cc295f14e264 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:03.179481 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-44c507fe-40a6-47bd-b161-cc295f14e264 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/dcc206d0-3170-459e-b48a-8cf9709e1ffb" status: 200 len: 1512 microversion: 2.1 time: 0.266618 Jul 23 21:32:03.191700 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2287/4488] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:02 2022] GET /compute/v2.1/servers/dcc206d0-3170-459e-b48a-8cf9709e1ffb => generated 1512 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:32:03.196375 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-97fa08b9-2ff2-402a-b579-267d187b3d1e tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:03.197229 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-97fa08b9-2ff2-402a-b579-267d187b3d1e tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:03.224083 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-97fa08b9-2ff2-402a-b579-267d187b3d1e tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:03.224965 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-97fa08b9-2ff2-402a-b579-267d187b3d1e tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:03.226291 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-97fa08b9-2ff2-402a-b579-267d187b3d1e tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:03.226955 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-97fa08b9-2ff2-402a-b579-267d187b3d1e tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:03.371866 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-27cc5025-fe76-4d29-bc92-b78427ade50f req-8425d42f-8e70-481b-8f1f-d11451ed1be7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2ad2cfd-7479-48d0-b802-cdd5d5093305", "name": "network-vif-plugged", "status": "completed", "tag": "cbde15d1-b6fd-48d4-98a3-b0a0c831fec2"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:32:03.386049 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-27cc5025-fe76-4d29-bc92-b78427ade50f req-8425d42f-8e70-481b-8f1f-d11451ed1be7 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:03.386494 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-27cc5025-fe76-4d29-bc92-b78427ade50f req-8425d42f-8e70-481b-8f1f-d11451ed1be7 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:03.409657 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-27cc5025-fe76-4d29-bc92-b78427ade50f req-8425d42f-8e70-481b-8f1f-d11451ed1be7 service nova] Creating event network-vif-plugged:cbde15d1-b6fd-48d4-98a3-b0a0c831fec2 for instance f2ad2cfd-7479-48d0-b802-cdd5d5093305 on nch1-master-1 Jul 23 21:32:03.428196 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-27cc5025-fe76-4d29-bc92-b78427ade50f req-8425d42f-8e70-481b-8f1f-d11451ed1be7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059549 Jul 23 21:32:03.429148 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2288/4489] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:32:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:32:03.434824 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-14dcb638-c965-440a-8eeb-a64058675f15 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:03.435526 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-14dcb638-c965-440a-8eeb-a64058675f15 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:03.455175 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-14dcb638-c965-440a-8eeb-a64058675f15 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:03.455636 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-14dcb638-c965-440a-8eeb-a64058675f15 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:03.456449 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-14dcb638-c965-440a-8eeb-a64058675f15 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:03.457833 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-14dcb638-c965-440a-8eeb-a64058675f15 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:03.682097 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-14dcb638-c965-440a-8eeb-a64058675f15 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:03.696953 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-14dcb638-c965-440a-8eeb-a64058675f15 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:03.700531 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-14dcb638-c965-440a-8eeb-a64058675f15 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:03.704624 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-14dcb638-c965-440a-8eeb-a64058675f15 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.274241 Jul 23 21:32:03.707616 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2289/4490] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:32:03 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:32:03.708469 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-97fa08b9-2ff2-402a-b579-267d187b3d1e tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:03.720435 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-6cedf40e-7031-4fe0-b6bf-468e81311f81 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:03.721383 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-6cedf40e-7031-4fe0-b6bf-468e81311f81 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] [instance: f66b6134-b8aa-4df7-9905-b7488fe6bc85] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:03.727716 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-97fa08b9-2ff2-402a-b579-267d187b3d1e tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1527 microversion: 2.1 time: 0.534594 Jul 23 21:32:03.728956 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2202/4491] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:03 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1527 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:32:03.751361 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6cedf40e-7031-4fe0-b6bf-468e81311f81 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:03.752222 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6cedf40e-7031-4fe0-b6bf-468e81311f81 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:03.753959 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6cedf40e-7031-4fe0-b6bf-468e81311f81 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:03.754605 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6cedf40e-7031-4fe0-b6bf-468e81311f81 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:04.178679 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-6cedf40e-7031-4fe0-b6bf-468e81311f81 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b1e260651b4dffa7c1efe8e9d0f144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcf55bcaba04bf8ae8a9b2ac09e8d98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:04.186699 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-6cedf40e-7031-4fe0-b6bf-468e81311f81 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] 10.222.0.17 "GET /compute/v2.1/servers/f66b6134-b8aa-4df7-9905-b7488fe6bc85" status: 200 len: 1367 microversion: 2.1 time: 0.477732 Jul 23 21:32:04.187305 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2290/4492] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:03 2022] GET /compute/v2.1/servers/f66b6134-b8aa-4df7-9905-b7488fe6bc85 => generated 1367 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:32:04.204327 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1a18d879-e276-4a4b-9ba5-4b4ac46ef0ef tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:04.205513 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1a18d879-e276-4a4b-9ba5-4b4ac46ef0ef tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: dcc206d0-3170-459e-b48a-8cf9709e1ffb] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:04.216871 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:INSERT=5 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:32:04.252406 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1a18d879-e276-4a4b-9ba5-4b4ac46ef0ef tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:04.256062 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1a18d879-e276-4a4b-9ba5-4b4ac46ef0ef tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:04.258766 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1a18d879-e276-4a4b-9ba5-4b4ac46ef0ef tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:04.259415 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1a18d879-e276-4a4b-9ba5-4b4ac46ef0ef tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:04.725152 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-afef6d8e-025f-46ed-aa8e-79d483819f7d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:04.726179 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-afef6d8e-025f-46ed-aa8e-79d483819f7d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:04.741692 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-afef6d8e-025f-46ed-aa8e-79d483819f7d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:04.742561 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-afef6d8e-025f-46ed-aa8e-79d483819f7d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:04.743565 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-afef6d8e-025f-46ed-aa8e-79d483819f7d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:04.748382 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-afef6d8e-025f-46ed-aa8e-79d483819f7d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:04.946446 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-1a18d879-e276-4a4b-9ba5-4b4ac46ef0ef tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:04.960640 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1a18d879-e276-4a4b-9ba5-4b4ac46ef0ef tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/dcc206d0-3170-459e-b48a-8cf9709e1ffb" status: 200 len: 1512 microversion: 2.1 time: 0.761792 Jul 23 21:32:04.963514 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2203/4493] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:04 2022] GET /compute/v2.1/servers/dcc206d0-3170-459e-b48a-8cf9709e1ffb => generated 1512 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:32:04.982153 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-155813bc-ce55-40a8-b879-6093af0b1c72 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:04.986645 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-155813bc-ce55-40a8-b879-6093af0b1c72 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:05.000486 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-155813bc-ce55-40a8-b879-6093af0b1c72 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:05.001215 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-155813bc-ce55-40a8-b879-6093af0b1c72 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:05.007238 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-155813bc-ce55-40a8-b879-6093af0b1c72 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:05.008371 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-155813bc-ce55-40a8-b879-6093af0b1c72 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:05.021702 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:32:05.241105 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-afef6d8e-025f-46ed-aa8e-79d483819f7d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:05.251532 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-afef6d8e-025f-46ed-aa8e-79d483819f7d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:05.261398 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-afef6d8e-025f-46ed-aa8e-79d483819f7d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:05.262995 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-afef6d8e-025f-46ed-aa8e-79d483819f7d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.542293 Jul 23 21:32:05.265643 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2291/4494] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:32:04 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:32:05.271064 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-be9cdfc4-c6ae-416b-b25b-b56ce0a87a3c tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:05.277809 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-be9cdfc4-c6ae-416b-b25b-b56ce0a87a3c tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] [instance: f66b6134-b8aa-4df7-9905-b7488fe6bc85] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:05.285199 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-be9cdfc4-c6ae-416b-b25b-b56ce0a87a3c tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:05.285913 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-be9cdfc4-c6ae-416b-b25b-b56ce0a87a3c tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:05.286951 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-be9cdfc4-c6ae-416b-b25b-b56ce0a87a3c tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:05.288228 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-be9cdfc4-c6ae-416b-b25b-b56ce0a87a3c tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:05.397563 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-155813bc-ce55-40a8-b879-6093af0b1c72 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:05.424810 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-155813bc-ce55-40a8-b879-6093af0b1c72 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1527 microversion: 2.1 time: 0.439976 Jul 23 21:32:05.438893 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2204/4495] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:04 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1527 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:32:05.502311 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-be9cdfc4-c6ae-416b-b25b-b56ce0a87a3c tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b1e260651b4dffa7c1efe8e9d0f144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcf55bcaba04bf8ae8a9b2ac09e8d98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:05.515664 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-be9cdfc4-c6ae-416b-b25b-b56ce0a87a3c tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] 10.222.0.17 "GET /compute/v2.1/servers/f66b6134-b8aa-4df7-9905-b7488fe6bc85" status: 200 len: 1367 microversion: 2.1 time: 0.248402 Jul 23 21:32:05.519579 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2292/4496] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:05 2022] GET /compute/v2.1/servers/f66b6134-b8aa-4df7-9905-b7488fe6bc85 => generated 1367 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:32:05.987608 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-fb394dc9-da79-4a26-9cf4-428feb5e7c9a tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:05.988212 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-fb394dc9-da79-4a26-9cf4-428feb5e7c9a tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: dcc206d0-3170-459e-b48a-8cf9709e1ffb] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:06.000502 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fb394dc9-da79-4a26-9cf4-428feb5e7c9a tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:06.001247 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fb394dc9-da79-4a26-9cf4-428feb5e7c9a tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:06.004827 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fb394dc9-da79-4a26-9cf4-428feb5e7c9a tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:06.005463 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fb394dc9-da79-4a26-9cf4-428feb5e7c9a tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:06.284027 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-4f8ce211-33c1-4f4c-93cf-b6e9dea189ee tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:06.285448 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-4f8ce211-33c1-4f4c-93cf-b6e9dea189ee tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:06.303785 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4f8ce211-33c1-4f4c-93cf-b6e9dea189ee tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:06.304247 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4f8ce211-33c1-4f4c-93cf-b6e9dea189ee tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:06.305385 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4f8ce211-33c1-4f4c-93cf-b6e9dea189ee tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:06.305825 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4f8ce211-33c1-4f4c-93cf-b6e9dea189ee tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:06.323863 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=100 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:32:06.462203 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-4f8ce211-33c1-4f4c-93cf-b6e9dea189ee tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:06.478877 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-4f8ce211-33c1-4f4c-93cf-b6e9dea189ee tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:06.480953 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-4f8ce211-33c1-4f4c-93cf-b6e9dea189ee tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:06.493899 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-4f8ce211-33c1-4f4c-93cf-b6e9dea189ee tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.202631 Jul 23 21:32:06.509127 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2293/4497] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:32:06 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:32:06.510257 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c5b2b9f8-88a6-4a3f-bbd1-af5431e1c5ff tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:06.510938 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-c5b2b9f8-88a6-4a3f-bbd1-af5431e1c5ff tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:06.530666 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c5b2b9f8-88a6-4a3f-bbd1-af5431e1c5ff tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:06.531111 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c5b2b9f8-88a6-4a3f-bbd1-af5431e1c5ff tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:06.531926 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c5b2b9f8-88a6-4a3f-bbd1-af5431e1c5ff tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:06.532366 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c5b2b9f8-88a6-4a3f-bbd1-af5431e1c5ff tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:06.612958 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:32:06.787410 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c5b2b9f8-88a6-4a3f-bbd1-af5431e1c5ff tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:06.796334 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-c5b2b9f8-88a6-4a3f-bbd1-af5431e1c5ff tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1527 microversion: 2.1 time: 0.300507 Jul 23 21:32:06.809308 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2294/4498] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:06 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1527 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:32:06.819580 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-abba5563-1175-4da8-8965-d7326c308bab tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:06.821322 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-abba5563-1175-4da8-8965-d7326c308bab tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] [instance: f66b6134-b8aa-4df7-9905-b7488fe6bc85] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:06.847656 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-abba5563-1175-4da8-8965-d7326c308bab tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:06.861153 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-abba5563-1175-4da8-8965-d7326c308bab tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:06.864801 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-abba5563-1175-4da8-8965-d7326c308bab tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:06.865349 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-abba5563-1175-4da8-8965-d7326c308bab tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:07.017437 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-fb394dc9-da79-4a26-9cf4-428feb5e7c9a tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:07.029073 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-fb394dc9-da79-4a26-9cf4-428feb5e7c9a tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/dcc206d0-3170-459e-b48a-8cf9709e1ffb" status: 200 len: 1512 microversion: 2.1 time: 1.051918 Jul 23 21:32:07.038998 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2205/4499] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:05 2022] GET /compute/v2.1/servers/dcc206d0-3170-459e-b48a-8cf9709e1ffb => generated 1512 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:32:07.197503 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-abba5563-1175-4da8-8965-d7326c308bab tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b1e260651b4dffa7c1efe8e9d0f144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcf55bcaba04bf8ae8a9b2ac09e8d98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:07.205216 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-abba5563-1175-4da8-8965-d7326c308bab tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] 10.222.0.17 "GET /compute/v2.1/servers/f66b6134-b8aa-4df7-9905-b7488fe6bc85" status: 200 len: 1367 microversion: 2.1 time: 0.403496 Jul 23 21:32:07.208236 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2295/4500] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:06 2022] GET /compute/v2.1/servers/f66b6134-b8aa-4df7-9905-b7488fe6bc85 => generated 1367 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:32:07.523379 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b1bc6db9-e615-4e79-ab19-cd283f495741 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:07.524369 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b1bc6db9-e615-4e79-ab19-cd283f495741 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:07.543873 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b1bc6db9-e615-4e79-ab19-cd283f495741 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:07.546713 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b1bc6db9-e615-4e79-ab19-cd283f495741 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:07.547858 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b1bc6db9-e615-4e79-ab19-cd283f495741 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:07.550669 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b1bc6db9-e615-4e79-ab19-cd283f495741 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:07.718998 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b1bc6db9-e615-4e79-ab19-cd283f495741 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:07.730317 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b1bc6db9-e615-4e79-ab19-cd283f495741 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:07.732957 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b1bc6db9-e615-4e79-ab19-cd283f495741 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:07.734510 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b1bc6db9-e615-4e79-ab19-cd283f495741 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.221360 Jul 23 21:32:07.735676 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2206/4501] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:32:07 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:32:07.819564 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-2c291ad9-833f-4fb6-9221-631b6c8b243d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:07.820118 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-2c291ad9-833f-4fb6-9221-631b6c8b243d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:07.836289 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2c291ad9-833f-4fb6-9221-631b6c8b243d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:07.836715 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2c291ad9-833f-4fb6-9221-631b6c8b243d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:07.837802 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2c291ad9-833f-4fb6-9221-631b6c8b243d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:07.838412 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2c291ad9-833f-4fb6-9221-631b6c8b243d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:08.047486 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-864ebe79-e0d2-4f6a-a5de-77810e0f576c tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:08.048761 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-864ebe79-e0d2-4f6a-a5de-77810e0f576c tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: dcc206d0-3170-459e-b48a-8cf9709e1ffb] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:08.057615 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-864ebe79-e0d2-4f6a-a5de-77810e0f576c tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:08.066332 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-864ebe79-e0d2-4f6a-a5de-77810e0f576c tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:08.067654 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-864ebe79-e0d2-4f6a-a5de-77810e0f576c tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:08.075327 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-864ebe79-e0d2-4f6a-a5de-77810e0f576c tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:08.159558 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-2c291ad9-833f-4fb6-9221-631b6c8b243d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:08.170321 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-2c291ad9-833f-4fb6-9221-631b6c8b243d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1527 microversion: 2.1 time: 0.354486 Jul 23 21:32:08.172357 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2296/4502] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:07 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1527 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:32:08.226370 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-db4bccf3-ae70-49b3-8fc9-84165e789aad tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:08.227415 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-db4bccf3-ae70-49b3-8fc9-84165e789aad tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] [instance: f66b6134-b8aa-4df7-9905-b7488fe6bc85] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:08.240104 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-db4bccf3-ae70-49b3-8fc9-84165e789aad tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:08.240774 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-db4bccf3-ae70-49b3-8fc9-84165e789aad tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:08.242392 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-db4bccf3-ae70-49b3-8fc9-84165e789aad tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:08.245611 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-db4bccf3-ae70-49b3-8fc9-84165e789aad tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:08.425821 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-db4bccf3-ae70-49b3-8fc9-84165e789aad tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b1e260651b4dffa7c1efe8e9d0f144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcf55bcaba04bf8ae8a9b2ac09e8d98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:08.436133 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-db4bccf3-ae70-49b3-8fc9-84165e789aad tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] 10.222.0.17 "GET /compute/v2.1/servers/f66b6134-b8aa-4df7-9905-b7488fe6bc85" status: 200 len: 1367 microversion: 2.1 time: 0.215129 Jul 23 21:32:08.436995 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2297/4503] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:08 2022] GET /compute/v2.1/servers/f66b6134-b8aa-4df7-9905-b7488fe6bc85 => generated 1367 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:32:08.468576 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-864ebe79-e0d2-4f6a-a5de-77810e0f576c tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:08.481337 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-864ebe79-e0d2-4f6a-a5de-77810e0f576c tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/dcc206d0-3170-459e-b48a-8cf9709e1ffb" status: 200 len: 1512 microversion: 2.1 time: 0.435975 Jul 23 21:32:08.482252 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2207/4504] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:08 2022] GET /compute/v2.1/servers/dcc206d0-3170-459e-b48a-8cf9709e1ffb => generated 1512 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:32:08.676210 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d4c4f259-5cc4-4819-aa3b-51b04a830fe6 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1793240720", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "594800b0-aba9-4cae-b3b6-645faa446b0c"}], "security_groups": [{"name": "tempest-securitygroup--1256691171"}], "key_name": "tempest-keypair-1851525913", "user_data": "}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:32:08.753017 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-faa34053-ed60-4021-aa72-9c50085460e5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:08.753934 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-faa34053-ed60-4021-aa72-9c50085460e5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:08.772753 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-faa34053-ed60-4021-aa72-9c50085460e5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:08.784285 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-faa34053-ed60-4021-aa72-9c50085460e5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:08.787448 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-faa34053-ed60-4021-aa72-9c50085460e5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:08.789769 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-faa34053-ed60-4021-aa72-9c50085460e5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:08.964510 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.network.neutron [None req-d4c4f259-5cc4-4819-aa3b-51b04a830fe6 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] validate_networks() for [('594800b0-aba9-4cae-b3b6-645faa446b0c', None, None, None, None, None)] {{(pid=131321) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:32:09.091534 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-faa34053-ed60-4021-aa72-9c50085460e5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:09.109507 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-faa34053-ed60-4021-aa72-9c50085460e5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:09.111052 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-faa34053-ed60-4021-aa72-9c50085460e5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:09.112271 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-faa34053-ed60-4021-aa72-9c50085460e5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.363145 Jul 23 21:32:09.124602 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2208/4505] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:32:08 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:32:09.147548 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-0d42ddee-ca07-4aec-8fe4-ac8cc1fd8ad3 req-8f624d23-2c9c-429b-9c1d-cc76c402a21c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f66b6134-b8aa-4df7-9905-b7488fe6bc85", "name": "network-vif-plugged", "status": "completed", "tag": "7ffd9730-367d-43b1-af40-908b309e515f"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:32:09.169076 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-0d42ddee-ca07-4aec-8fe4-ac8cc1fd8ad3 req-8f624d23-2c9c-429b-9c1d-cc76c402a21c service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:09.171311 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-0d42ddee-ca07-4aec-8fe4-ac8cc1fd8ad3 req-8f624d23-2c9c-429b-9c1d-cc76c402a21c service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:09.204800 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-0d42ddee-ca07-4aec-8fe4-ac8cc1fd8ad3 req-8f624d23-2c9c-429b-9c1d-cc76c402a21c service nova] Creating event network-vif-plugged:7ffd9730-367d-43b1-af40-908b309e515f for instance f66b6134-b8aa-4df7-9905-b7488fe6bc85 on nch2-master-1 Jul 23 21:32:09.219234 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-0d42ddee-ca07-4aec-8fe4-ac8cc1fd8ad3 req-8f624d23-2c9c-429b-9c1d-cc76c402a21c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087246 Jul 23 21:32:09.222207 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2209/4506] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:32:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:32:09.232913 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2e0653e2-13e7-410f-92d7-c8dae40acbb8 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:09.266542 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-2e0653e2-13e7-410f-92d7-c8dae40acbb8 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:09.303503 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2e0653e2-13e7-410f-92d7-c8dae40acbb8 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:09.303980 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2e0653e2-13e7-410f-92d7-c8dae40acbb8 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:09.304788 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2e0653e2-13e7-410f-92d7-c8dae40acbb8 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:09.305233 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2e0653e2-13e7-410f-92d7-c8dae40acbb8 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:09.739182 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-d4c4f259-5cc4-4819-aa3b-51b04a830fe6 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Flavor limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:32:09.739892 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-d4c4f259-5cc4-4819-aa3b-51b04a830fe6 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Image limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:32:09.740595 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-d4c4f259-5cc4-4819-aa3b-51b04a830fe6 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Flavor pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:32:09.741227 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-d4c4f259-5cc4-4819-aa3b-51b04a830fe6 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Image pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:32:09.741854 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-d4c4f259-5cc4-4819-aa3b-51b04a830fe6 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:32:09.766118 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d4c4f259-5cc4-4819-aa3b-51b04a830fe6 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:09.766929 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d4c4f259-5cc4-4819-aa3b-51b04a830fe6 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:09.767991 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d4c4f259-5cc4-4819-aa3b-51b04a830fe6 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:09.768550 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d4c4f259-5cc4-4819-aa3b-51b04a830fe6 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:09.784214 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-2e0653e2-13e7-410f-92d7-c8dae40acbb8 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:09.796320 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2e0653e2-13e7-410f-92d7-c8dae40acbb8 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1527 microversion: 2.1 time: 0.571811 Jul 23 21:32:09.798726 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2210/4507] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:09 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1527 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:32:09.807188 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8f7c9616-f79b-4c18-8211-26880e1a3a01 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:09.808118 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8f7c9616-f79b-4c18-8211-26880e1a3a01 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] [instance: f66b6134-b8aa-4df7-9905-b7488fe6bc85] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:09.816396 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8f7c9616-f79b-4c18-8211-26880e1a3a01 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:09.819407 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8f7c9616-f79b-4c18-8211-26880e1a3a01 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:09.820495 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8f7c9616-f79b-4c18-8211-26880e1a3a01 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:09.821252 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8f7c9616-f79b-4c18-8211-26880e1a3a01 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:09.824947 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-d4c4f259-5cc4-4819-aa3b-51b04a830fe6 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Getting quotas for project 49da2dec096c474199da94d7c7a83258. Resources: {'ram', 'instances', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:32:09.860656 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-d4c4f259-5cc4-4819-aa3b-51b04a830fe6 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Getting quotas for user 048f5756139b4283b695c057647983ba and project 49da2dec096c474199da94d7c7a83258. Resources: {'ram', 'instances', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:32:09.928172 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-d4c4f259-5cc4-4819-aa3b-51b04a830fe6 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Going to run 1 instances... {{(pid=131321) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:32:09.942193 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-d4c4f259-5cc4-4819-aa3b-51b04a830fe6 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] [instance: d6b9ea07-2ebd-4e1a-86f2-abb1bf581076] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131321) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:32:10.070081 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-d4c4f259-5cc4-4819-aa3b-51b04a830fe6 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.398284 Jul 23 21:32:10.078379 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2298/4508] 10.222.0.17 () {62 vars in 1187 bytes} [Sat Jul 23 21:32:08 2022] POST /compute/v2.1/servers => generated 402 bytes in 1407 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 23 21:32:10.085586 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-0bd248dc-0a2e-476f-a3d0-eabc5cfe92ac tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:10.086702 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-0bd248dc-0a2e-476f-a3d0-eabc5cfe92ac tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: dcc206d0-3170-459e-b48a-8cf9709e1ffb] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:10.098604 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0bd248dc-0a2e-476f-a3d0-eabc5cfe92ac tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:10.099289 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0bd248dc-0a2e-476f-a3d0-eabc5cfe92ac tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:10.100786 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0bd248dc-0a2e-476f-a3d0-eabc5cfe92ac tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:10.101471 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0bd248dc-0a2e-476f-a3d0-eabc5cfe92ac tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:10.207178 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8f7c9616-f79b-4c18-8211-26880e1a3a01 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b1e260651b4dffa7c1efe8e9d0f144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcf55bcaba04bf8ae8a9b2ac09e8d98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:10.217590 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8f7c9616-f79b-4c18-8211-26880e1a3a01 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] 10.222.0.17 "GET /compute/v2.1/servers/f66b6134-b8aa-4df7-9905-b7488fe6bc85" status: 200 len: 1367 microversion: 2.1 time: 0.415619 Jul 23 21:32:10.219439 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2211/4509] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:09 2022] GET /compute/v2.1/servers/f66b6134-b8aa-4df7-9905-b7488fe6bc85 => generated 1367 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:32:10.224852 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ef15a37f-a976-4d30-a778-ded6296243db tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:10.226189 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ef15a37f-a976-4d30-a778-ded6296243db tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] [instance: d6b9ea07-2ebd-4e1a-86f2-abb1bf581076] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:10.359245 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ef15a37f-a976-4d30-a778-ded6296243db tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:10.401107 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ef15a37f-a976-4d30-a778-ded6296243db tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:10.415574 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ef15a37f-a976-4d30-a778-ded6296243db tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:10.416923 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ef15a37f-a976-4d30-a778-ded6296243db tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] 10.222.0.17 "GET /compute/v2.1/servers/d6b9ea07-2ebd-4e1a-86f2-abb1bf581076" status: 200 len: 1282 microversion: 2.20 time: 0.196074 Jul 23 21:32:10.419778 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2212/4510] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:32:10 2022] GET /compute/v2.1/servers/d6b9ea07-2ebd-4e1a-86f2-abb1bf581076 => generated 1282 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:32:10.434369 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-86edbfbe-2029-478b-92c4-f43e2e902b91 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:10.435845 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-86edbfbe-2029-478b-92c4-f43e2e902b91 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:10.443560 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-0bd248dc-0a2e-476f-a3d0-eabc5cfe92ac tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:10.457049 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-0bd248dc-0a2e-476f-a3d0-eabc5cfe92ac tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/dcc206d0-3170-459e-b48a-8cf9709e1ffb" status: 200 len: 1512 microversion: 2.1 time: 0.376814 Jul 23 21:32:10.458559 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2299/4511] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:10 2022] GET /compute/v2.1/servers/dcc206d0-3170-459e-b48a-8cf9709e1ffb => generated 1512 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:32:10.468613 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-86edbfbe-2029-478b-92c4-f43e2e902b91 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:10.469343 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-86edbfbe-2029-478b-92c4-f43e2e902b91 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:10.470359 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-86edbfbe-2029-478b-92c4-f43e2e902b91 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:10.471015 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-86edbfbe-2029-478b-92c4-f43e2e902b91 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:10.582631 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-86edbfbe-2029-478b-92c4-f43e2e902b91 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:10.603907 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-86edbfbe-2029-478b-92c4-f43e2e902b91 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:10.606588 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-86edbfbe-2029-478b-92c4-f43e2e902b91 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:10.608245 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-86edbfbe-2029-478b-92c4-f43e2e902b91 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.187754 Jul 23 21:32:10.609066 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2213/4512] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:32:10 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:32:10.818389 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-38ea0874-dd1e-45f8-bde7-5f4413bb14a1 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:10.819208 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-38ea0874-dd1e-45f8-bde7-5f4413bb14a1 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:10.850905 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-38ea0874-dd1e-45f8-bde7-5f4413bb14a1 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:10.855414 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-38ea0874-dd1e-45f8-bde7-5f4413bb14a1 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:10.859518 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-38ea0874-dd1e-45f8-bde7-5f4413bb14a1 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:10.860286 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-38ea0874-dd1e-45f8-bde7-5f4413bb14a1 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:11.238769 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0b34b236-0787-4ca8-ad94-e9b0aa67b87d tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:11.239419 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-0b34b236-0787-4ca8-ad94-e9b0aa67b87d tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] [instance: f66b6134-b8aa-4df7-9905-b7488fe6bc85] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:11.262463 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0b34b236-0787-4ca8-ad94-e9b0aa67b87d tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:11.262930 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0b34b236-0787-4ca8-ad94-e9b0aa67b87d tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:11.263745 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0b34b236-0787-4ca8-ad94-e9b0aa67b87d tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:11.264189 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0b34b236-0787-4ca8-ad94-e9b0aa67b87d tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:11.309877 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-38ea0874-dd1e-45f8-bde7-5f4413bb14a1 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:11.328087 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-38ea0874-dd1e-45f8-bde7-5f4413bb14a1 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1527 microversion: 2.1 time: 0.516225 Jul 23 21:32:11.329001 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2300/4513] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:10 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1527 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:32:11.440023 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-5683aaef-8de1-4afa-ae6b-413d2d355580 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:11.440979 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-5683aaef-8de1-4afa-ae6b-413d2d355580 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] [instance: d6b9ea07-2ebd-4e1a-86f2-abb1bf581076] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:11.447252 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:32:11.449793 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5683aaef-8de1-4afa-ae6b-413d2d355580 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:11.450533 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5683aaef-8de1-4afa-ae6b-413d2d355580 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:11.452203 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5683aaef-8de1-4afa-ae6b-413d2d355580 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:11.452856 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5683aaef-8de1-4afa-ae6b-413d2d355580 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:11.663821 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-0b34b236-0787-4ca8-ad94-e9b0aa67b87d tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b1e260651b4dffa7c1efe8e9d0f144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcf55bcaba04bf8ae8a9b2ac09e8d98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:11.666319 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-5683aaef-8de1-4afa-ae6b-413d2d355580 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:11.674651 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-0b34b236-0787-4ca8-ad94-e9b0aa67b87d tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] 10.222.0.17 "GET /compute/v2.1/servers/f66b6134-b8aa-4df7-9905-b7488fe6bc85" status: 200 len: 1556 microversion: 2.1 time: 0.442081 Jul 23 21:32:11.676133 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2214/4514] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:11 2022] GET /compute/v2.1/servers/f66b6134-b8aa-4df7-9905-b7488fe6bc85 => generated 1556 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:32:11.678832 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-5683aaef-8de1-4afa-ae6b-413d2d355580 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:11.680612 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-5683aaef-8de1-4afa-ae6b-413d2d355580 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:11.682253 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-5683aaef-8de1-4afa-ae6b-413d2d355580 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] 10.222.0.17 "GET /compute/v2.1/servers/d6b9ea07-2ebd-4e1a-86f2-abb1bf581076" status: 200 len: 1278 microversion: 2.20 time: 0.246376 Jul 23 21:32:11.683343 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2301/4515] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:32:11 2022] GET /compute/v2.1/servers/d6b9ea07-2ebd-4e1a-86f2-abb1bf581076 => generated 1278 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:32:11.685805 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ca2fa7e9-2e32-46b9-a9a1-2d9ee9cb567a tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:11.689213 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ca2fa7e9-2e32-46b9-a9a1-2d9ee9cb567a tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: dcc206d0-3170-459e-b48a-8cf9709e1ffb] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:11.698663 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-df19f410-4b26-4eb7-8a28-d2caa2d3467f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:11.699545 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-df19f410-4b26-4eb7-8a28-d2caa2d3467f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:11.703381 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ca2fa7e9-2e32-46b9-a9a1-2d9ee9cb567a tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:11.703850 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ca2fa7e9-2e32-46b9-a9a1-2d9ee9cb567a tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:11.704655 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ca2fa7e9-2e32-46b9-a9a1-2d9ee9cb567a tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:11.705100 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ca2fa7e9-2e32-46b9-a9a1-2d9ee9cb567a tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:11.719723 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-df19f410-4b26-4eb7-8a28-d2caa2d3467f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:11.720473 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-df19f410-4b26-4eb7-8a28-d2caa2d3467f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:11.721415 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-df19f410-4b26-4eb7-8a28-d2caa2d3467f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:11.722034 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-df19f410-4b26-4eb7-8a28-d2caa2d3467f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:11.855405 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-df19f410-4b26-4eb7-8a28-d2caa2d3467f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:11.869575 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-df19f410-4b26-4eb7-8a28-d2caa2d3467f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:11.873559 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-df19f410-4b26-4eb7-8a28-d2caa2d3467f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:11.874778 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-df19f410-4b26-4eb7-8a28-d2caa2d3467f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.190357 Jul 23 21:32:11.878171 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2302/4516] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:32:11 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:32:11.886035 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-1b1fd4d9-eb1a-457d-a5a2-5f79f6476a46 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:11.886920 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-1b1fd4d9-eb1a-457d-a5a2-5f79f6476a46 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] [instance: f66b6134-b8aa-4df7-9905-b7488fe6bc85] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:11.893604 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1b1fd4d9-eb1a-457d-a5a2-5f79f6476a46 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:11.894495 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1b1fd4d9-eb1a-457d-a5a2-5f79f6476a46 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:11.895534 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1b1fd4d9-eb1a-457d-a5a2-5f79f6476a46 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:11.896217 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1b1fd4d9-eb1a-457d-a5a2-5f79f6476a46 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:12.239938 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-1b1fd4d9-eb1a-457d-a5a2-5f79f6476a46 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] 10.222.0.17 "GET /compute/v2.1/servers/f66b6134-b8aa-4df7-9905-b7488fe6bc85/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.358606 Jul 23 21:32:12.242330 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2303/4517] 10.222.0.17 () {58 vars in 1274 bytes} [Sat Jul 23 21:32:11 2022] GET /compute/v2.1/servers/f66b6134-b8aa-4df7-9905-b7488fe6bc85/os-interface => generated 284 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:32:12.345772 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-b0d305a6-cf33-4a80-9e08-e42a53bcf89e tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:12.347131 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-b0d305a6-cf33-4a80-9e08-e42a53bcf89e tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:12.360257 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b0d305a6-cf33-4a80-9e08-e42a53bcf89e tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:12.361717 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b0d305a6-cf33-4a80-9e08-e42a53bcf89e tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:12.368743 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b0d305a6-cf33-4a80-9e08-e42a53bcf89e tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:12.370213 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b0d305a6-cf33-4a80-9e08-e42a53bcf89e tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:12.646215 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ca2fa7e9-2e32-46b9-a9a1-2d9ee9cb567a tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:12.657224 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ca2fa7e9-2e32-46b9-a9a1-2d9ee9cb567a tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/dcc206d0-3170-459e-b48a-8cf9709e1ffb" status: 200 len: 1512 microversion: 2.1 time: 0.978726 Jul 23 21:32:12.658686 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2215/4518] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:11 2022] GET /compute/v2.1/servers/dcc206d0-3170-459e-b48a-8cf9709e1ffb => generated 1512 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:32:12.709386 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c5c0334f-720b-4d87-9f2e-2cba5464e7d9 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:12.710482 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c5c0334f-720b-4d87-9f2e-2cba5464e7d9 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] [instance: d6b9ea07-2ebd-4e1a-86f2-abb1bf581076] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:12.725513 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c5c0334f-720b-4d87-9f2e-2cba5464e7d9 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:12.727130 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c5c0334f-720b-4d87-9f2e-2cba5464e7d9 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:12.732135 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c5c0334f-720b-4d87-9f2e-2cba5464e7d9 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:12.732808 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c5c0334f-720b-4d87-9f2e-2cba5464e7d9 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:12.857802 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c5c0334f-720b-4d87-9f2e-2cba5464e7d9 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:12.866805 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c5c0334f-720b-4d87-9f2e-2cba5464e7d9 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:12.872412 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c5c0334f-720b-4d87-9f2e-2cba5464e7d9 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:12.876687 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c5c0334f-720b-4d87-9f2e-2cba5464e7d9 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] 10.222.0.17 "GET /compute/v2.1/servers/d6b9ea07-2ebd-4e1a-86f2-abb1bf581076" status: 200 len: 1340 microversion: 2.20 time: 0.177579 Jul 23 21:32:12.879152 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2216/4519] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:32:12 2022] GET /compute/v2.1/servers/d6b9ea07-2ebd-4e1a-86f2-abb1bf581076 => generated 1340 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:32:12.896913 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-301a2aad-ccd2-445d-b371-ccbd892d3dc6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:12.897788 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-301a2aad-ccd2-445d-b371-ccbd892d3dc6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:12.912778 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-301a2aad-ccd2-445d-b371-ccbd892d3dc6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:12.913486 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-301a2aad-ccd2-445d-b371-ccbd892d3dc6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:12.914535 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-301a2aad-ccd2-445d-b371-ccbd892d3dc6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:12.915140 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-301a2aad-ccd2-445d-b371-ccbd892d3dc6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:12.928748 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-b0d305a6-cf33-4a80-9e08-e42a53bcf89e tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:12.936888 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-b0d305a6-cf33-4a80-9e08-e42a53bcf89e tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1527 microversion: 2.1 time: 0.596075 Jul 23 21:32:12.950993 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2304/4520] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:12 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1527 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:32:13.102860 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-301a2aad-ccd2-445d-b371-ccbd892d3dc6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:13.127271 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-301a2aad-ccd2-445d-b371-ccbd892d3dc6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:13.132941 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-301a2aad-ccd2-445d-b371-ccbd892d3dc6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:13.134634 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-301a2aad-ccd2-445d-b371-ccbd892d3dc6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.240016 Jul 23 21:32:13.148635 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2217/4521] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:32:12 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:32:13.675480 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f717baa2-f9b8-41cc-bb68-c0e9753d4cf2 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:13.676033 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-f717baa2-f9b8-41cc-bb68-c0e9753d4cf2 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: dcc206d0-3170-459e-b48a-8cf9709e1ffb] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:13.692688 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f717baa2-f9b8-41cc-bb68-c0e9753d4cf2 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:13.693035 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f717baa2-f9b8-41cc-bb68-c0e9753d4cf2 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:13.693831 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f717baa2-f9b8-41cc-bb68-c0e9753d4cf2 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:13.694297 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f717baa2-f9b8-41cc-bb68-c0e9753d4cf2 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:13.896285 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3e317985-bb31-4045-9b9c-bf8d358bc4a0 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:13.896916 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-3e317985-bb31-4045-9b9c-bf8d358bc4a0 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] [instance: d6b9ea07-2ebd-4e1a-86f2-abb1bf581076] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:13.916294 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3e317985-bb31-4045-9b9c-bf8d358bc4a0 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:13.918167 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3e317985-bb31-4045-9b9c-bf8d358bc4a0 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:13.919678 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3e317985-bb31-4045-9b9c-bf8d358bc4a0 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:13.920909 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3e317985-bb31-4045-9b9c-bf8d358bc4a0 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:14.262596 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-3e317985-bb31-4045-9b9c-bf8d358bc4a0 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:14.280580 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-3e317985-bb31-4045-9b9c-bf8d358bc4a0 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:14.292617 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-3e317985-bb31-4045-9b9c-bf8d358bc4a0 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:14.294872 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-3e317985-bb31-4045-9b9c-bf8d358bc4a0 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] 10.222.0.17 "GET /compute/v2.1/servers/d6b9ea07-2ebd-4e1a-86f2-abb1bf581076" status: 200 len: 1340 microversion: 2.20 time: 0.402689 Jul 23 21:32:14.296892 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2218/4522] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:32:13 2022] GET /compute/v2.1/servers/d6b9ea07-2ebd-4e1a-86f2-abb1bf581076 => generated 1340 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:32:14.305130 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-495f5e4b-a317-460f-bac4-ac2e5e27b9a3 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:14.308453 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-495f5e4b-a317-460f-bac4-ac2e5e27b9a3 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:14.334299 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-495f5e4b-a317-460f-bac4-ac2e5e27b9a3 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:14.335205 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-495f5e4b-a317-460f-bac4-ac2e5e27b9a3 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:14.336289 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-495f5e4b-a317-460f-bac4-ac2e5e27b9a3 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:14.336968 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-495f5e4b-a317-460f-bac4-ac2e5e27b9a3 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:14.738107 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-495f5e4b-a317-460f-bac4-ac2e5e27b9a3 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:14.752451 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-495f5e4b-a317-460f-bac4-ac2e5e27b9a3 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1527 microversion: 2.1 time: 0.453671 Jul 23 21:32:14.753450 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2219/4523] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:14 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1527 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:32:14.776215 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d5da04ac-024a-4098-9c53-33b3665542b0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:14.787979 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d5da04ac-024a-4098-9c53-33b3665542b0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:14.823258 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d5da04ac-024a-4098-9c53-33b3665542b0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:14.831992 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d5da04ac-024a-4098-9c53-33b3665542b0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:14.833226 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d5da04ac-024a-4098-9c53-33b3665542b0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:14.833882 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d5da04ac-024a-4098-9c53-33b3665542b0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:14.904167 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-f717baa2-f9b8-41cc-bb68-c0e9753d4cf2 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:14.912812 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-f717baa2-f9b8-41cc-bb68-c0e9753d4cf2 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/dcc206d0-3170-459e-b48a-8cf9709e1ffb" status: 200 len: 1512 microversion: 2.1 time: 1.241478 Jul 23 21:32:14.922805 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2305/4524] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:13 2022] GET /compute/v2.1/servers/dcc206d0-3170-459e-b48a-8cf9709e1ffb => generated 1512 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:32:14.973128 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d5da04ac-024a-4098-9c53-33b3665542b0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:14.986474 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d5da04ac-024a-4098-9c53-33b3665542b0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:14.988002 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d5da04ac-024a-4098-9c53-33b3665542b0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:14.998733 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d5da04ac-024a-4098-9c53-33b3665542b0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.229824 Jul 23 21:32:15.000082 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2220/4525] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:32:14 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:32:15.316493 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c9c6d606-538a-4fad-9c6a-e55817f3f75e tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:15.317226 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-c9c6d606-538a-4fad-9c6a-e55817f3f75e tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] [instance: d6b9ea07-2ebd-4e1a-86f2-abb1bf581076] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:15.337188 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c9c6d606-538a-4fad-9c6a-e55817f3f75e tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:15.337805 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c9c6d606-538a-4fad-9c6a-e55817f3f75e tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:15.340506 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c9c6d606-538a-4fad-9c6a-e55817f3f75e tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:15.346540 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c9c6d606-538a-4fad-9c6a-e55817f3f75e tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:15.568379 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b87deaed-6969-42ab-88a9-c1886ff59540 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Action: 'create', calling method: .version_select at 0x7f0b466b3f70>, body: {"keypair": {"name": "tempest-keypair-1091663138", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJWKZsW4s2LdHCgWasOuaPlFItHMEdXbGPRqYyuySxp00X4x8G66o6Mu2F64+TtXaMdLnFsDojj2HUR0hAqT/zh1VIME+txZH9bQRYkS6vdcs5WHp5lrhSEeWA2YNNGbnQ=="}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:32:15.588370 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=21 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:32:15.590210 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-b87deaed-6969-42ab-88a9-c1886ff59540 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Getting quotas for project 6bc1475019924837a8be47347f6bbd75. Resources: {'key_pairs'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:32:15.600178 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-b87deaed-6969-42ab-88a9-c1886ff59540 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Getting quotas for user bc4aa131e63349b2aa8f37fdf6d2fe00 and project 6bc1475019924837a8be47347f6bbd75. Resources: {'key_pairs'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:32:15.669237 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b87deaed-6969-42ab-88a9-c1886ff59540 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.348862 Jul 23 21:32:15.677190 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2221/4526] 10.222.0.17 () {60 vars in 1158 bytes} [Sat Jul 23 21:32:15 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:32:15.774217 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4db2d763-5735-4d87-9acf-6e33089307a8 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:15.776950 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-4db2d763-5735-4d87-9acf-6e33089307a8 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:15.789472 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4db2d763-5735-4d87-9acf-6e33089307a8 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:15.790924 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4db2d763-5735-4d87-9acf-6e33089307a8 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:15.792286 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4db2d763-5735-4d87-9acf-6e33089307a8 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:15.793042 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4db2d763-5735-4d87-9acf-6e33089307a8 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:15.921378 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c9c6d606-538a-4fad-9c6a-e55817f3f75e tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:15.936185 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c9c6d606-538a-4fad-9c6a-e55817f3f75e tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:15.946270 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c9c6d606-538a-4fad-9c6a-e55817f3f75e tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:15.948861 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-c9c6d606-538a-4fad-9c6a-e55817f3f75e tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] 10.222.0.17 "GET /compute/v2.1/servers/d6b9ea07-2ebd-4e1a-86f2-abb1bf581076" status: 200 len: 1408 microversion: 2.20 time: 0.636912 Jul 23 21:32:15.950281 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2306/4527] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:32:15 2022] GET /compute/v2.1/servers/d6b9ea07-2ebd-4e1a-86f2-abb1bf581076 => generated 1408 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:32:15.957988 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e9460923-48df-4e38-b7e7-ebde36cbdce5 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:15.958850 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-e9460923-48df-4e38-b7e7-ebde36cbdce5 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: dcc206d0-3170-459e-b48a-8cf9709e1ffb] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:15.971718 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e9460923-48df-4e38-b7e7-ebde36cbdce5 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:15.973160 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e9460923-48df-4e38-b7e7-ebde36cbdce5 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:15.974271 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e9460923-48df-4e38-b7e7-ebde36cbdce5 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:15.974861 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e9460923-48df-4e38-b7e7-ebde36cbdce5 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:16.277106 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-4db2d763-5735-4d87-9acf-6e33089307a8 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:16.300704 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4db2d763-5735-4d87-9acf-6e33089307a8 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1527 microversion: 2.1 time: 0.526634 Jul 23 21:32:16.301495 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2222/4528] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:15 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1527 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:32:16.327838 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-45343aab-7d6e-44e9-b1c9-85a306b83169 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:16.331129 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-45343aab-7d6e-44e9-b1c9-85a306b83169 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:16.343590 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-45343aab-7d6e-44e9-b1c9-85a306b83169 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:16.344406 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-45343aab-7d6e-44e9-b1c9-85a306b83169 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:16.346270 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-45343aab-7d6e-44e9-b1c9-85a306b83169 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:16.347020 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-45343aab-7d6e-44e9-b1c9-85a306b83169 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:16.382250 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=100 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:32:16.488675 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-45343aab-7d6e-44e9-b1c9-85a306b83169 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:16.516779 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-45343aab-7d6e-44e9-b1c9-85a306b83169 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:16.518463 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-45343aab-7d6e-44e9-b1c9-85a306b83169 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:16.522176 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-45343aab-7d6e-44e9-b1c9-85a306b83169 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.203474 Jul 23 21:32:16.531000 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2223/4529] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:32:16 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:32:16.533084 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-5ce152cf-9b62-474b-8b0e-d7508b3bc13c req-cb3ae594-8c70-461a-9a38-7172a4d7b147 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f66b6134-b8aa-4df7-9905-b7488fe6bc85", "tag": "7ffd9730-367d-43b1-af40-908b309e515f"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:32:16.556157 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-5ce152cf-9b62-474b-8b0e-d7508b3bc13c req-cb3ae594-8c70-461a-9a38-7172a4d7b147 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:16.560027 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-5ce152cf-9b62-474b-8b0e-d7508b3bc13c req-cb3ae594-8c70-461a-9a38-7172a4d7b147 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:16.587408 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-5ce152cf-9b62-474b-8b0e-d7508b3bc13c req-cb3ae594-8c70-461a-9a38-7172a4d7b147 service nova] Creating event network-changed:7ffd9730-367d-43b1-af40-908b309e515f for instance f66b6134-b8aa-4df7-9905-b7488fe6bc85 on nch2-master-1 Jul 23 21:32:16.612507 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-5ce152cf-9b62-474b-8b0e-d7508b3bc13c req-cb3ae594-8c70-461a-9a38-7172a4d7b147 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081750 Jul 23 21:32:16.617425 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2224/4530] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:32:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:32:16.702031 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-e9460923-48df-4e38-b7e7-ebde36cbdce5 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:16.711369 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-e9460923-48df-4e38-b7e7-ebde36cbdce5 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/dcc206d0-3170-459e-b48a-8cf9709e1ffb" status: 200 len: 1512 microversion: 2.1 time: 0.759732 Jul 23 21:32:16.716464 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2307/4531] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:15 2022] GET /compute/v2.1/servers/dcc206d0-3170-459e-b48a-8cf9709e1ffb => generated 1512 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:32:16.969625 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-58d9170a-dcd5-4413-8acf-512ee2330064 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:16.970894 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-58d9170a-dcd5-4413-8acf-512ee2330064 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] [instance: d6b9ea07-2ebd-4e1a-86f2-abb1bf581076] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:16.981136 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-58d9170a-dcd5-4413-8acf-512ee2330064 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:16.981650 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-58d9170a-dcd5-4413-8acf-512ee2330064 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:16.982868 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-58d9170a-dcd5-4413-8acf-512ee2330064 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:16.983828 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-58d9170a-dcd5-4413-8acf-512ee2330064 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:17.319335 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-3b158cba-fe47-464e-a1f7-58fc451d4371 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:17.320140 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-3b158cba-fe47-464e-a1f7-58fc451d4371 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:17.331332 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3b158cba-fe47-464e-a1f7-58fc451d4371 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:17.332816 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3b158cba-fe47-464e-a1f7-58fc451d4371 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:17.336324 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3b158cba-fe47-464e-a1f7-58fc451d4371 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:17.337499 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3b158cba-fe47-464e-a1f7-58fc451d4371 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:17.743957 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-58d9170a-dcd5-4413-8acf-512ee2330064 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:17.757118 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-58d9170a-dcd5-4413-8acf-512ee2330064 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:17.761092 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-58d9170a-dcd5-4413-8acf-512ee2330064 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:17.763122 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-58d9170a-dcd5-4413-8acf-512ee2330064 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] 10.222.0.17 "GET /compute/v2.1/servers/d6b9ea07-2ebd-4e1a-86f2-abb1bf581076" status: 200 len: 1408 microversion: 2.20 time: 0.799652 Jul 23 21:32:17.766123 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2225/4532] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:32:16 2022] GET /compute/v2.1/servers/d6b9ea07-2ebd-4e1a-86f2-abb1bf581076 => generated 1408 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:32:17.778611 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-84773992-e108-4692-9cde-a07b4c65dbd4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:17.781001 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-84773992-e108-4692-9cde-a07b4c65dbd4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:17.792696 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-3b158cba-fe47-464e-a1f7-58fc451d4371 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:17.812654 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-3b158cba-fe47-464e-a1f7-58fc451d4371 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1527 microversion: 2.1 time: 0.497693 Jul 23 21:32:17.827545 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2308/4533] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:17 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1527 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:32:17.832844 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-84773992-e108-4692-9cde-a07b4c65dbd4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:17.834906 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-84773992-e108-4692-9cde-a07b4c65dbd4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:17.837418 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-84773992-e108-4692-9cde-a07b4c65dbd4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:17.841071 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-84773992-e108-4692-9cde-a07b4c65dbd4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:17.851204 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-b65c45ff-233b-489e-a0c5-2d6bc4000030 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:17.859463 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-b65c45ff-233b-489e-a0c5-2d6bc4000030 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: dcc206d0-3170-459e-b48a-8cf9709e1ffb] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:17.881229 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b65c45ff-233b-489e-a0c5-2d6bc4000030 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:17.882205 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b65c45ff-233b-489e-a0c5-2d6bc4000030 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:17.884212 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b65c45ff-233b-489e-a0c5-2d6bc4000030 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:17.886258 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b65c45ff-233b-489e-a0c5-2d6bc4000030 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:18.048287 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-84773992-e108-4692-9cde-a07b4c65dbd4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:18.068645 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-84773992-e108-4692-9cde-a07b4c65dbd4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:18.075158 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-84773992-e108-4692-9cde-a07b4c65dbd4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:18.080115 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-84773992-e108-4692-9cde-a07b4c65dbd4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.309349 Jul 23 21:32:18.081310 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2226/4534] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:32:17 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:32:18.487507 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-b65c45ff-233b-489e-a0c5-2d6bc4000030 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:18.501457 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-b65c45ff-233b-489e-a0c5-2d6bc4000030 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/dcc206d0-3170-459e-b48a-8cf9709e1ffb" status: 200 len: 1512 microversion: 2.1 time: 0.669881 Jul 23 21:32:18.502125 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2309/4535] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:17 2022] GET /compute/v2.1/servers/dcc206d0-3170-459e-b48a-8cf9709e1ffb => generated 1512 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:32:18.789382 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c2177dc9-6671-44c2-8ba9-7b7ec1601f04 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:18.790894 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c2177dc9-6671-44c2-8ba9-7b7ec1601f04 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] [instance: d6b9ea07-2ebd-4e1a-86f2-abb1bf581076] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:18.824175 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c2177dc9-6671-44c2-8ba9-7b7ec1601f04 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:18.833325 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c2177dc9-6671-44c2-8ba9-7b7ec1601f04 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:18.833984 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-74ad1c55-9087-42e0-8db2-223bd88544d2 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:18.834200 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c2177dc9-6671-44c2-8ba9-7b7ec1601f04 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:18.834651 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c2177dc9-6671-44c2-8ba9-7b7ec1601f04 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:18.835283 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-74ad1c55-9087-42e0-8db2-223bd88544d2 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:18.863835 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-74ad1c55-9087-42e0-8db2-223bd88544d2 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:18.864703 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-74ad1c55-9087-42e0-8db2-223bd88544d2 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:18.865803 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-74ad1c55-9087-42e0-8db2-223bd88544d2 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:18.870507 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-74ad1c55-9087-42e0-8db2-223bd88544d2 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:19.160083 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c2177dc9-6671-44c2-8ba9-7b7ec1601f04 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:19.168931 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c2177dc9-6671-44c2-8ba9-7b7ec1601f04 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:19.170508 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c2177dc9-6671-44c2-8ba9-7b7ec1601f04 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:19.171639 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c2177dc9-6671-44c2-8ba9-7b7ec1601f04 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] 10.222.0.17 "GET /compute/v2.1/servers/d6b9ea07-2ebd-4e1a-86f2-abb1bf581076" status: 200 len: 1408 microversion: 2.20 time: 0.391172 Jul 23 21:32:19.172224 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2227/4536] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:32:18 2022] GET /compute/v2.1/servers/d6b9ea07-2ebd-4e1a-86f2-abb1bf581076 => generated 1408 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:32:19.206971 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d8561be7-9a85-4ff0-baa9-143bf2516cab tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:19.207810 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d8561be7-9a85-4ff0-baa9-143bf2516cab tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:19.240089 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d8561be7-9a85-4ff0-baa9-143bf2516cab tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:19.240819 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d8561be7-9a85-4ff0-baa9-143bf2516cab tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:19.241785 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d8561be7-9a85-4ff0-baa9-143bf2516cab tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:19.242401 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d8561be7-9a85-4ff0-baa9-143bf2516cab tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:19.350262 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d8561be7-9a85-4ff0-baa9-143bf2516cab tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:19.363793 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d8561be7-9a85-4ff0-baa9-143bf2516cab tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:19.365332 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d8561be7-9a85-4ff0-baa9-143bf2516cab tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:19.372093 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d8561be7-9a85-4ff0-baa9-143bf2516cab tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.168929 Jul 23 21:32:19.372808 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2228/4537] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:32:19 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:32:19.382227 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-efbf3872-d7ac-4afe-8fc9-4b310bf37a81 req-255e3919-b1f7-4913-96bf-ef2010dca586 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6b9ea07-2ebd-4e1a-86f2-abb1bf581076", "tag": "d1ebc2ac-80d0-4761-8a8b-958b5aadb724"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:32:19.401111 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-efbf3872-d7ac-4afe-8fc9-4b310bf37a81 req-255e3919-b1f7-4913-96bf-ef2010dca586 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:19.401111 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-efbf3872-d7ac-4afe-8fc9-4b310bf37a81 req-255e3919-b1f7-4913-96bf-ef2010dca586 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:19.428035 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-efbf3872-d7ac-4afe-8fc9-4b310bf37a81 req-255e3919-b1f7-4913-96bf-ef2010dca586 service nova] Creating event network-changed:d1ebc2ac-80d0-4761-8a8b-958b5aadb724 for instance d6b9ea07-2ebd-4e1a-86f2-abb1bf581076 on nch1-master-1 Jul 23 21:32:19.450933 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-efbf3872-d7ac-4afe-8fc9-4b310bf37a81 req-255e3919-b1f7-4913-96bf-ef2010dca586 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076897 Jul 23 21:32:19.452483 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2229/4538] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:32:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:32:19.519213 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d254f2ec-6c4b-4757-8777-d61a2e13a514 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:19.520025 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d254f2ec-6c4b-4757-8777-d61a2e13a514 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: dcc206d0-3170-459e-b48a-8cf9709e1ffb] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:19.539962 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d254f2ec-6c4b-4757-8777-d61a2e13a514 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:19.540530 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d254f2ec-6c4b-4757-8777-d61a2e13a514 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:19.541477 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d254f2ec-6c4b-4757-8777-d61a2e13a514 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:19.542015 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d254f2ec-6c4b-4757-8777-d61a2e13a514 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:19.721976 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-74ad1c55-9087-42e0-8db2-223bd88544d2 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:19.729115 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=100 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:32:19.733926 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-74ad1c55-9087-42e0-8db2-223bd88544d2 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1527 microversion: 2.1 time: 0.905157 Jul 23 21:32:19.746996 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2310/4539] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:18 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1527 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:32:19.979628 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d254f2ec-6c4b-4757-8777-d61a2e13a514 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:19.993892 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d254f2ec-6c4b-4757-8777-d61a2e13a514 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/dcc206d0-3170-459e-b48a-8cf9709e1ffb" status: 200 len: 1512 microversion: 2.1 time: 0.478803 Jul 23 21:32:20.001401 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2230/4540] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:19 2022] GET /compute/v2.1/servers/dcc206d0-3170-459e-b48a-8cf9709e1ffb => generated 1512 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:32:20.199686 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-8ad35272-e51a-4974-b692-62355a4fa845 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:20.200401 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-8ad35272-e51a-4974-b692-62355a4fa845 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] [instance: d6b9ea07-2ebd-4e1a-86f2-abb1bf581076] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:20.202951 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell0:SELECT=2 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:32:20.204182 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell0:SELECT=6 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:32:20.221477 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8ad35272-e51a-4974-b692-62355a4fa845 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:20.224535 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8ad35272-e51a-4974-b692-62355a4fa845 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:20.228469 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8ad35272-e51a-4974-b692-62355a4fa845 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:20.234936 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8ad35272-e51a-4974-b692-62355a4fa845 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:20.390853 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3e19764e-5c96-425c-893a-82b4bd1e5ae8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:20.391711 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-3e19764e-5c96-425c-893a-82b4bd1e5ae8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:20.405726 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3e19764e-5c96-425c-893a-82b4bd1e5ae8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:20.406213 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3e19764e-5c96-425c-893a-82b4bd1e5ae8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:20.413081 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3e19764e-5c96-425c-893a-82b4bd1e5ae8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:20.414194 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3e19764e-5c96-425c-893a-82b4bd1e5ae8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:20.635030 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-3e19764e-5c96-425c-893a-82b4bd1e5ae8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:20.656499 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-3e19764e-5c96-425c-893a-82b4bd1e5ae8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:20.664267 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-3e19764e-5c96-425c-893a-82b4bd1e5ae8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:20.665749 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-3e19764e-5c96-425c-893a-82b4bd1e5ae8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.279037 Jul 23 21:32:20.666874 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2231/4541] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:32:20 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:32:20.674259 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5da3498d-e8a8-4dd5-b3ad-a6a86ab96cea tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1651390481", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a7a4d3a1-2c94-480e-8528-bb4fc0917bb3"}], "security_groups": [{"name": "tempest-securitygroup--659896481"}], "key_name": "tempest-keypair-1091663138", "user_data": "}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:32:20.893124 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-5da3498d-e8a8-4dd5-b3ad-a6a86ab96cea tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] validate_networks() for [('a7a4d3a1-2c94-480e-8528-bb4fc0917bb3', None, None, None, None, None)] {{(pid=131320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:32:20.913519 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-8ad35272-e51a-4974-b692-62355a4fa845 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:20.924399 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-8ad35272-e51a-4974-b692-62355a4fa845 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:20.925936 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-8ad35272-e51a-4974-b692-62355a4fa845 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:20.927082 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-8ad35272-e51a-4974-b692-62355a4fa845 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] 10.222.0.17 "GET /compute/v2.1/servers/d6b9ea07-2ebd-4e1a-86f2-abb1bf581076" status: 200 len: 1408 microversion: 2.20 time: 0.735953 Jul 23 21:32:20.943451 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2311/4542] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:32:20 2022] GET /compute/v2.1/servers/d6b9ea07-2ebd-4e1a-86f2-abb1bf581076 => generated 1408 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:32:20.949051 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-99e42ea0-fc50-4554-a781-f920fe3252b6 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:20.949917 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-99e42ea0-fc50-4554-a781-f920fe3252b6 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:20.956917 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-99e42ea0-fc50-4554-a781-f920fe3252b6 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:20.957587 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-99e42ea0-fc50-4554-a781-f920fe3252b6 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:20.958567 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-99e42ea0-fc50-4554-a781-f920fe3252b6 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:20.959165 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-99e42ea0-fc50-4554-a781-f920fe3252b6 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:21.474501 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-99e42ea0-fc50-4554-a781-f920fe3252b6 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:21.512643 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-99e42ea0-fc50-4554-a781-f920fe3252b6 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1527 microversion: 2.1 time: 0.556650 Jul 23 21:32:21.513893 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2312/4543] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:20 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1527 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:32:21.527906 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-584890be-7f30-4c1c-87a4-e569128eb3ba tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:21.528693 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-584890be-7f30-4c1c-87a4-e569128eb3ba tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: dcc206d0-3170-459e-b48a-8cf9709e1ffb] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:21.537058 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-5da3498d-e8a8-4dd5-b3ad-a6a86ab96cea tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:32:21.537659 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-5da3498d-e8a8-4dd5-b3ad-a6a86ab96cea tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:32:21.537973 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-5da3498d-e8a8-4dd5-b3ad-a6a86ab96cea tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:32:21.538383 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-5da3498d-e8a8-4dd5-b3ad-a6a86ab96cea tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:32:21.538802 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-5da3498d-e8a8-4dd5-b3ad-a6a86ab96cea tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:32:21.555043 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5da3498d-e8a8-4dd5-b3ad-a6a86ab96cea tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:21.555784 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5da3498d-e8a8-4dd5-b3ad-a6a86ab96cea tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:21.557277 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5da3498d-e8a8-4dd5-b3ad-a6a86ab96cea tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:21.557919 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5da3498d-e8a8-4dd5-b3ad-a6a86ab96cea tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:21.562249 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-584890be-7f30-4c1c-87a4-e569128eb3ba tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:21.562700 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-584890be-7f30-4c1c-87a4-e569128eb3ba tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:21.568842 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-584890be-7f30-4c1c-87a4-e569128eb3ba tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:21.571833 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-584890be-7f30-4c1c-87a4-e569128eb3ba tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:21.601515 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-5da3498d-e8a8-4dd5-b3ad-a6a86ab96cea tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Getting quotas for project 6bc1475019924837a8be47347f6bbd75. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:32:21.608374 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-5da3498d-e8a8-4dd5-b3ad-a6a86ab96cea tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Getting quotas for user bc4aa131e63349b2aa8f37fdf6d2fe00 and project 6bc1475019924837a8be47347f6bbd75. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:32:21.624892 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5da3498d-e8a8-4dd5-b3ad-a6a86ab96cea tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Going to run 1 instances... {{(pid=131320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:32:21.629420 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5da3498d-e8a8-4dd5-b3ad-a6a86ab96cea tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] [instance: b0bb14c2-15df-4440-9d9c-4c6598867dfe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:32:21.736236 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5da3498d-e8a8-4dd5-b3ad-a6a86ab96cea tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.068011 Jul 23 21:32:21.742854 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2232/4544] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:32:20 2022] POST /compute/v2.1/servers => generated 401 bytes in 1075 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 23 21:32:21.758244 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5ade838e-0f46-4219-9f22-9f01f419cee9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:21.759361 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5ade838e-0f46-4219-9f22-9f01f419cee9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:21.791217 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5ade838e-0f46-4219-9f22-9f01f419cee9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:21.792856 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5ade838e-0f46-4219-9f22-9f01f419cee9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:21.793828 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5ade838e-0f46-4219-9f22-9f01f419cee9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:21.805074 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5ade838e-0f46-4219-9f22-9f01f419cee9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:21.951821 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5ade838e-0f46-4219-9f22-9f01f419cee9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:22.004263 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5ade838e-0f46-4219-9f22-9f01f419cee9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:22.006451 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5ade838e-0f46-4219-9f22-9f01f419cee9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:22.035995 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5ade838e-0f46-4219-9f22-9f01f419cee9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.280229 Jul 23 21:32:22.043969 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2233/4545] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:32:21 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:32:22.053172 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6e778f97-2bc1-4160-8877-69d4cb4f2629 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:22.054020 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6e778f97-2bc1-4160-8877-69d4cb4f2629 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] [instance: b0bb14c2-15df-4440-9d9c-4c6598867dfe] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:22.136371 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6e778f97-2bc1-4160-8877-69d4cb4f2629 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc4aa131e63349b2aa8f37fdf6d2fe00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc1475019924837a8be47347f6bbd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:22.145397 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6e778f97-2bc1-4160-8877-69d4cb4f2629 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] 10.222.0.17 "GET /compute/v2.1/servers/b0bb14c2-15df-4440-9d9c-4c6598867dfe" status: 200 len: 1238 microversion: 2.1 time: 0.098262 Jul 23 21:32:22.147005 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2234/4546] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:22 2022] GET /compute/v2.1/servers/b0bb14c2-15df-4440-9d9c-4c6598867dfe => generated 1238 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:32:22.152965 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d26547a9-44fb-4d9d-af0e-3d5b4a857c20 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:22.157697 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d26547a9-44fb-4d9d-af0e-3d5b4a857c20 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] [instance: d6b9ea07-2ebd-4e1a-86f2-abb1bf581076] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:22.180794 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d26547a9-44fb-4d9d-af0e-3d5b4a857c20 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:22.181299 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d26547a9-44fb-4d9d-af0e-3d5b4a857c20 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:22.182310 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d26547a9-44fb-4d9d-af0e-3d5b4a857c20 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:22.182874 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d26547a9-44fb-4d9d-af0e-3d5b4a857c20 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:22.197111 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-584890be-7f30-4c1c-87a4-e569128eb3ba tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:22.206468 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-584890be-7f30-4c1c-87a4-e569128eb3ba tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/dcc206d0-3170-459e-b48a-8cf9709e1ffb" status: 200 len: 1512 microversion: 2.1 time: 0.691305 Jul 23 21:32:22.207963 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2313/4547] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:21 2022] GET /compute/v2.1/servers/dcc206d0-3170-459e-b48a-8cf9709e1ffb => generated 1512 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:32:22.531461 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e7b1c9b4-d9c8-46da-8ffc-b85f9b84dd71 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:22.532343 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-e7b1c9b4-d9c8-46da-8ffc-b85f9b84dd71 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:22.546825 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e7b1c9b4-d9c8-46da-8ffc-b85f9b84dd71 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:22.547577 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e7b1c9b4-d9c8-46da-8ffc-b85f9b84dd71 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:22.548629 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e7b1c9b4-d9c8-46da-8ffc-b85f9b84dd71 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:22.557123 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e7b1c9b4-d9c8-46da-8ffc-b85f9b84dd71 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:22.967659 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d26547a9-44fb-4d9d-af0e-3d5b4a857c20 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:22.979708 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d26547a9-44fb-4d9d-af0e-3d5b4a857c20 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:22.982323 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d26547a9-44fb-4d9d-af0e-3d5b4a857c20 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:22.983676 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d26547a9-44fb-4d9d-af0e-3d5b4a857c20 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] 10.222.0.17 "GET /compute/v2.1/servers/d6b9ea07-2ebd-4e1a-86f2-abb1bf581076" status: 200 len: 1408 microversion: 2.20 time: 0.835607 Jul 23 21:32:22.984423 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2235/4548] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:32:22 2022] GET /compute/v2.1/servers/d6b9ea07-2ebd-4e1a-86f2-abb1bf581076 => generated 1408 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:32:23.065169 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6c986630-2429-4bee-b4f5-832951ab2da0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:23.066249 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6c986630-2429-4bee-b4f5-832951ab2da0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:23.075865 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6c986630-2429-4bee-b4f5-832951ab2da0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:23.076559 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6c986630-2429-4bee-b4f5-832951ab2da0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:23.078153 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6c986630-2429-4bee-b4f5-832951ab2da0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:23.078755 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6c986630-2429-4bee-b4f5-832951ab2da0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:23.136922 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-e7b1c9b4-d9c8-46da-8ffc-b85f9b84dd71 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:23.147723 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-e7b1c9b4-d9c8-46da-8ffc-b85f9b84dd71 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1527 microversion: 2.1 time: 0.620139 Jul 23 21:32:23.153982 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2314/4549] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:22 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1527 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:32:23.193915 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6c986630-2429-4bee-b4f5-832951ab2da0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:23.197091 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6c986630-2429-4bee-b4f5-832951ab2da0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:23.198833 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6c986630-2429-4bee-b4f5-832951ab2da0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:23.200440 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6c986630-2429-4bee-b4f5-832951ab2da0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.141626 Jul 23 21:32:23.201163 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-7aee3bd8-c2bf-4eb8-b086-a57d673b98f5 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:23.202456 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-7aee3bd8-c2bf-4eb8-b086-a57d673b98f5 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] [instance: b0bb14c2-15df-4440-9d9c-4c6598867dfe] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:23.213638 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2236/4550] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:32:23 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:32:23.220861 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7aee3bd8-c2bf-4eb8-b086-a57d673b98f5 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:23.222064 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7aee3bd8-c2bf-4eb8-b086-a57d673b98f5 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:23.223260 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7aee3bd8-c2bf-4eb8-b086-a57d673b98f5 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:23.224012 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7aee3bd8-c2bf-4eb8-b086-a57d673b98f5 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:23.226920 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e3048e51-e456-44ff-8890-1d8d252fe8b0 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:23.227614 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e3048e51-e456-44ff-8890-1d8d252fe8b0 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: dcc206d0-3170-459e-b48a-8cf9709e1ffb] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:23.236502 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e3048e51-e456-44ff-8890-1d8d252fe8b0 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:23.237404 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e3048e51-e456-44ff-8890-1d8d252fe8b0 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:23.238415 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e3048e51-e456-44ff-8890-1d8d252fe8b0 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:23.238972 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e3048e51-e456-44ff-8890-1d8d252fe8b0 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:23.354476 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-7aee3bd8-c2bf-4eb8-b086-a57d673b98f5 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc4aa131e63349b2aa8f37fdf6d2fe00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc1475019924837a8be47347f6bbd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:23.374937 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-7aee3bd8-c2bf-4eb8-b086-a57d673b98f5 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] 10.222.0.17 "GET /compute/v2.1/servers/b0bb14c2-15df-4440-9d9c-4c6598867dfe" status: 200 len: 1290 microversion: 2.1 time: 0.215222 Jul 23 21:32:23.375541 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2315/4551] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:23 2022] GET /compute/v2.1/servers/b0bb14c2-15df-4440-9d9c-4c6598867dfe => generated 1290 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:32:23.871175 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e3048e51-e456-44ff-8890-1d8d252fe8b0 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:23.883366 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e3048e51-e456-44ff-8890-1d8d252fe8b0 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/dcc206d0-3170-459e-b48a-8cf9709e1ffb" status: 200 len: 1512 microversion: 2.1 time: 0.657339 Jul 23 21:32:23.884104 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2237/4552] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:23 2022] GET /compute/v2.1/servers/dcc206d0-3170-459e-b48a-8cf9709e1ffb => generated 1512 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:32:24.004746 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-0d7cd55b-1ee5-4e8a-b0c5-c605d81e0600 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:24.007200 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-0d7cd55b-1ee5-4e8a-b0c5-c605d81e0600 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] [instance: d6b9ea07-2ebd-4e1a-86f2-abb1bf581076] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:24.022442 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0d7cd55b-1ee5-4e8a-b0c5-c605d81e0600 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:24.024360 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0d7cd55b-1ee5-4e8a-b0c5-c605d81e0600 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:24.026832 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0d7cd55b-1ee5-4e8a-b0c5-c605d81e0600 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:24.029681 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0d7cd55b-1ee5-4e8a-b0c5-c605d81e0600 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:24.173238 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-7697e8b3-711a-4e76-9310-da2296ee3040 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:24.173956 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-7697e8b3-711a-4e76-9310-da2296ee3040 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:24.188492 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:32:24.202735 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7697e8b3-711a-4e76-9310-da2296ee3040 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:24.203649 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7697e8b3-711a-4e76-9310-da2296ee3040 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:24.204519 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7697e8b3-711a-4e76-9310-da2296ee3040 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:24.204969 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7697e8b3-711a-4e76-9310-da2296ee3040 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:24.565369 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-7697e8b3-711a-4e76-9310-da2296ee3040 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:24.568501 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-0d7cd55b-1ee5-4e8a-b0c5-c605d81e0600 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:24.581893 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-0d7cd55b-1ee5-4e8a-b0c5-c605d81e0600 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:24.583560 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-7697e8b3-711a-4e76-9310-da2296ee3040 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1527 microversion: 2.1 time: 0.414628 Jul 23 21:32:24.586053 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-0d7cd55b-1ee5-4e8a-b0c5-c605d81e0600 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:24.592339 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-0d7cd55b-1ee5-4e8a-b0c5-c605d81e0600 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] 10.222.0.17 "GET /compute/v2.1/servers/d6b9ea07-2ebd-4e1a-86f2-abb1bf581076" status: 200 len: 1408 microversion: 2.20 time: 0.590306 Jul 23 21:32:24.593136 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2316/4553] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:32:23 2022] GET /compute/v2.1/servers/d6b9ea07-2ebd-4e1a-86f2-abb1bf581076 => generated 1408 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:32:24.597635 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2238/4554] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:24 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1527 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:32:24.604706 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-88f6ac87-b1b8-4898-b1e8-1b4e75f1cd21 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:24.606920 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c569251e-ae99-4459-a9a5-3223278d5ea0 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:24.607518 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-88f6ac87-b1b8-4898-b1e8-1b4e75f1cd21 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:24.611154 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c569251e-ae99-4459-a9a5-3223278d5ea0 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] [instance: b0bb14c2-15df-4440-9d9c-4c6598867dfe] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:24.625484 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c569251e-ae99-4459-a9a5-3223278d5ea0 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:24.626547 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c569251e-ae99-4459-a9a5-3223278d5ea0 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:24.627510 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-88f6ac87-b1b8-4898-b1e8-1b4e75f1cd21 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:24.628933 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-88f6ac87-b1b8-4898-b1e8-1b4e75f1cd21 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:24.630949 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-88f6ac87-b1b8-4898-b1e8-1b4e75f1cd21 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:24.631916 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-88f6ac87-b1b8-4898-b1e8-1b4e75f1cd21 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:24.636290 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c569251e-ae99-4459-a9a5-3223278d5ea0 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:24.639881 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c569251e-ae99-4459-a9a5-3223278d5ea0 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:24.819277 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c569251e-ae99-4459-a9a5-3223278d5ea0 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc4aa131e63349b2aa8f37fdf6d2fe00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc1475019924837a8be47347f6bbd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:24.837004 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c569251e-ae99-4459-a9a5-3223278d5ea0 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] 10.222.0.17 "GET /compute/v2.1/servers/b0bb14c2-15df-4440-9d9c-4c6598867dfe" status: 200 len: 1296 microversion: 2.1 time: 0.232584 Jul 23 21:32:24.838347 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2239/4555] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:24 2022] GET /compute/v2.1/servers/b0bb14c2-15df-4440-9d9c-4c6598867dfe => generated 1296 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:32:24.879482 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-88f6ac87-b1b8-4898-b1e8-1b4e75f1cd21 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:24.898577 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-88f6ac87-b1b8-4898-b1e8-1b4e75f1cd21 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:24.902783 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-88f6ac87-b1b8-4898-b1e8-1b4e75f1cd21 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:24.904141 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-962870f9-ddc4-43c3-aa3c-82216159c869 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:24.905203 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-962870f9-ddc4-43c3-aa3c-82216159c869 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: dcc206d0-3170-459e-b48a-8cf9709e1ffb] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:24.905483 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-88f6ac87-b1b8-4898-b1e8-1b4e75f1cd21 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.308361 Jul 23 21:32:24.908104 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2317/4556] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:32:24 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:32:24.930621 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-962870f9-ddc4-43c3-aa3c-82216159c869 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:24.932869 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-962870f9-ddc4-43c3-aa3c-82216159c869 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:24.934036 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-962870f9-ddc4-43c3-aa3c-82216159c869 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:24.935797 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-962870f9-ddc4-43c3-aa3c-82216159c869 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:25.358371 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-962870f9-ddc4-43c3-aa3c-82216159c869 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:25.374510 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-962870f9-ddc4-43c3-aa3c-82216159c869 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/dcc206d0-3170-459e-b48a-8cf9709e1ffb" status: 200 len: 1512 microversion: 2.1 time: 0.474912 Jul 23 21:32:25.376275 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2240/4557] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:24 2022] GET /compute/v2.1/servers/dcc206d0-3170-459e-b48a-8cf9709e1ffb => generated 1512 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:32:25.604955 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-74c89d9a-4693-48b6-8bdb-26d1f43cf9fa tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:25.605581 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-74c89d9a-4693-48b6-8bdb-26d1f43cf9fa tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:25.619821 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-74c89d9a-4693-48b6-8bdb-26d1f43cf9fa tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:25.620033 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0bd4cf53-1bd5-485b-92e0-58cc1b989f48 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:25.620268 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-74c89d9a-4693-48b6-8bdb-26d1f43cf9fa tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:25.620576 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-0bd4cf53-1bd5-485b-92e0-58cc1b989f48 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] [instance: d6b9ea07-2ebd-4e1a-86f2-abb1bf581076] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:25.622847 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-74c89d9a-4693-48b6-8bdb-26d1f43cf9fa tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:25.623584 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-74c89d9a-4693-48b6-8bdb-26d1f43cf9fa tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:25.629310 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0bd4cf53-1bd5-485b-92e0-58cc1b989f48 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:25.637604 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0bd4cf53-1bd5-485b-92e0-58cc1b989f48 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:25.641674 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0bd4cf53-1bd5-485b-92e0-58cc1b989f48 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:25.642399 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0bd4cf53-1bd5-485b-92e0-58cc1b989f48 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:26.162661 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-0bd4cf53-1bd5-485b-92e0-58cc1b989f48 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:26.183167 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-0bd4cf53-1bd5-485b-92e0-58cc1b989f48 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:26.190176 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-0bd4cf53-1bd5-485b-92e0-58cc1b989f48 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:26.191829 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-0bd4cf53-1bd5-485b-92e0-58cc1b989f48 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] 10.222.0.17 "GET /compute/v2.1/servers/d6b9ea07-2ebd-4e1a-86f2-abb1bf581076" status: 200 len: 1408 microversion: 2.20 time: 0.581042 Jul 23 21:32:26.192959 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2241/4558] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:32:25 2022] GET /compute/v2.1/servers/d6b9ea07-2ebd-4e1a-86f2-abb1bf581076 => generated 1408 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:32:26.202881 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-7deda3b2-153a-46ec-aa25-6fa02a4c1ff4 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:26.203771 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-7deda3b2-153a-46ec-aa25-6fa02a4c1ff4 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] [instance: b0bb14c2-15df-4440-9d9c-4c6598867dfe] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:26.211380 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7deda3b2-153a-46ec-aa25-6fa02a4c1ff4 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:26.212084 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7deda3b2-153a-46ec-aa25-6fa02a4c1ff4 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:26.213102 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7deda3b2-153a-46ec-aa25-6fa02a4c1ff4 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:26.213727 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7deda3b2-153a-46ec-aa25-6fa02a4c1ff4 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:26.454188 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-74c89d9a-4693-48b6-8bdb-26d1f43cf9fa tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:26.470492 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-74c89d9a-4693-48b6-8bdb-26d1f43cf9fa tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1527 microversion: 2.1 time: 0.870648 Jul 23 21:32:26.471424 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2318/4559] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:25 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1527 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:32:26.475996 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ad2750ee-2961-4a3b-9505-112f1f57e821 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:26.476605 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-ad2750ee-2961-4a3b-9505-112f1f57e821 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:26.493755 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ad2750ee-2961-4a3b-9505-112f1f57e821 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:26.494316 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ad2750ee-2961-4a3b-9505-112f1f57e821 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:26.495109 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ad2750ee-2961-4a3b-9505-112f1f57e821 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:26.495547 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ad2750ee-2961-4a3b-9505-112f1f57e821 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:26.532011 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-7deda3b2-153a-46ec-aa25-6fa02a4c1ff4 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc4aa131e63349b2aa8f37fdf6d2fe00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc1475019924837a8be47347f6bbd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:26.548732 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-7deda3b2-153a-46ec-aa25-6fa02a4c1ff4 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] 10.222.0.17 "GET /compute/v2.1/servers/b0bb14c2-15df-4440-9d9c-4c6598867dfe" status: 200 len: 1363 microversion: 2.1 time: 0.354374 Jul 23 21:32:26.550698 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2242/4560] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:26 2022] GET /compute/v2.1/servers/b0bb14c2-15df-4440-9d9c-4c6598867dfe => generated 1363 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:32:26.555636 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-28f8647c-d788-468d-8b4d-00ec02b59ead tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:26.556743 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-28f8647c-d788-468d-8b4d-00ec02b59ead tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: dcc206d0-3170-459e-b48a-8cf9709e1ffb] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:26.573009 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-28f8647c-d788-468d-8b4d-00ec02b59ead tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:26.573753 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-28f8647c-d788-468d-8b4d-00ec02b59ead tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:26.574749 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-28f8647c-d788-468d-8b4d-00ec02b59ead tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:26.576800 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-28f8647c-d788-468d-8b4d-00ec02b59ead tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:26.593460 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=100 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:32:26.876324 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ad2750ee-2961-4a3b-9505-112f1f57e821 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:26.893374 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ad2750ee-2961-4a3b-9505-112f1f57e821 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:26.898312 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ad2750ee-2961-4a3b-9505-112f1f57e821 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:26.901970 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-ad2750ee-2961-4a3b-9505-112f1f57e821 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.427231 Jul 23 21:32:26.902563 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2319/4561] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:32:26 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:32:26.906729 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-28f8647c-d788-468d-8b4d-00ec02b59ead tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:26.920150 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-28f8647c-d788-468d-8b4d-00ec02b59ead tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/dcc206d0-3170-459e-b48a-8cf9709e1ffb" status: 200 len: 1489 microversion: 2.1 time: 0.368073 Jul 23 21:32:26.933340 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2243/4562] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:26 2022] GET /compute/v2.1/servers/dcc206d0-3170-459e-b48a-8cf9709e1ffb => generated 1489 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:32:26.938040 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-01bf5ca1-8bed-49f5-8899-7f913a37b202 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1563323555"}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:32:26.941545 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-01bf5ca1-8bed-49f5-8899-7f913a37b202 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: dcc206d0-3170-459e-b48a-8cf9709e1ffb] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:26.947959 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-01bf5ca1-8bed-49f5-8899-7f913a37b202 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:26.948383 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-01bf5ca1-8bed-49f5-8899-7f913a37b202 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:26.949708 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-01bf5ca1-8bed-49f5-8899-7f913a37b202 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:26.956063 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-01bf5ca1-8bed-49f5-8899-7f913a37b202 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:27.092530 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-01bf5ca1-8bed-49f5-8899-7f913a37b202 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "PUT /compute/v2.1/servers/dcc206d0-3170-459e-b48a-8cf9709e1ffb" status: 200 len: 1062 microversion: 2.1 time: 0.158507 Jul 23 21:32:27.093648 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2320/4563] 10.222.0.17 () {60 vars in 1255 bytes} [Sat Jul 23 21:32:26 2022] PUT /compute/v2.1/servers/dcc206d0-3170-459e-b48a-8cf9709e1ffb => generated 1062 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:32:27.109932 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-696df244-e3db-4ed5-a018-9f0318121784 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:27.110967 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-696df244-e3db-4ed5-a018-9f0318121784 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: dcc206d0-3170-459e-b48a-8cf9709e1ffb] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:27.122010 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-696df244-e3db-4ed5-a018-9f0318121784 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:27.123448 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-696df244-e3db-4ed5-a018-9f0318121784 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:27.124751 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-696df244-e3db-4ed5-a018-9f0318121784 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:27.125350 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-696df244-e3db-4ed5-a018-9f0318121784 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:27.211533 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-56515b33-df32-43ac-9a2d-0ba4388c0e28 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:27.214427 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-56515b33-df32-43ac-9a2d-0ba4388c0e28 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] [instance: d6b9ea07-2ebd-4e1a-86f2-abb1bf581076] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:27.225317 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-56515b33-df32-43ac-9a2d-0ba4388c0e28 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:27.226184 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-56515b33-df32-43ac-9a2d-0ba4388c0e28 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:27.227201 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-56515b33-df32-43ac-9a2d-0ba4388c0e28 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:27.228001 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-56515b33-df32-43ac-9a2d-0ba4388c0e28 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:27.567490 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-696df244-e3db-4ed5-a018-9f0318121784 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:27.582339 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-696df244-e3db-4ed5-a018-9f0318121784 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/dcc206d0-3170-459e-b48a-8cf9709e1ffb" status: 200 len: 1489 microversion: 2.1 time: 0.476546 Jul 23 21:32:27.606931 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2244/4564] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:27 2022] GET /compute/v2.1/servers/dcc206d0-3170-459e-b48a-8cf9709e1ffb => generated 1489 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:32:27.619613 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-60917501-5c2b-404a-9005-985e0314c7d2 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:27.623399 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-60917501-5c2b-404a-9005-985e0314c7d2 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:27.644216 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-60917501-5c2b-404a-9005-985e0314c7d2 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:27.644635 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-60917501-5c2b-404a-9005-985e0314c7d2 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:27.646694 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-60917501-5c2b-404a-9005-985e0314c7d2 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:27.648739 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-60917501-5c2b-404a-9005-985e0314c7d2 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:27.656053 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-56515b33-df32-43ac-9a2d-0ba4388c0e28 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:27.666537 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-56515b33-df32-43ac-9a2d-0ba4388c0e28 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:27.671372 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-56515b33-df32-43ac-9a2d-0ba4388c0e28 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:27.672670 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-56515b33-df32-43ac-9a2d-0ba4388c0e28 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] 10.222.0.17 "GET /compute/v2.1/servers/d6b9ea07-2ebd-4e1a-86f2-abb1bf581076" status: 200 len: 1408 microversion: 2.20 time: 0.465734 Jul 23 21:32:27.677205 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2321/4565] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:32:27 2022] GET /compute/v2.1/servers/d6b9ea07-2ebd-4e1a-86f2-abb1bf581076 => generated 1408 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:32:27.689278 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-0506e48f-1812-4e2f-a1e3-6a332cbcbe83 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:27.690427 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-0506e48f-1812-4e2f-a1e3-6a332cbcbe83 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] [instance: b0bb14c2-15df-4440-9d9c-4c6598867dfe] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:27.706394 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0506e48f-1812-4e2f-a1e3-6a332cbcbe83 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:27.718336 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0506e48f-1812-4e2f-a1e3-6a332cbcbe83 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:27.719429 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0506e48f-1812-4e2f-a1e3-6a332cbcbe83 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:27.720088 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0506e48f-1812-4e2f-a1e3-6a332cbcbe83 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:28.154174 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-60917501-5c2b-404a-9005-985e0314c7d2 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:28.165937 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-60917501-5c2b-404a-9005-985e0314c7d2 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1509 microversion: 2.1 time: 0.556622 Jul 23 21:32:28.179848 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2245/4566] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:27 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1509 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:32:28.199740 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-0506e48f-1812-4e2f-a1e3-6a332cbcbe83 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc4aa131e63349b2aa8f37fdf6d2fe00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc1475019924837a8be47347f6bbd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:28.200271 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-04483ec8-912f-4200-975f-97d398b1a9fe req-9ac875c8-8d9b-4ebf-ac04-0b04d41b8c5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0bb14c2-15df-4440-9d9c-4c6598867dfe", "tag": "da2c7126-d794-4ff2-a071-724ef04327f5"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:32:28.212428 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-0506e48f-1812-4e2f-a1e3-6a332cbcbe83 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] 10.222.0.17 "GET /compute/v2.1/servers/b0bb14c2-15df-4440-9d9c-4c6598867dfe" status: 200 len: 1363 microversion: 2.1 time: 0.531070 Jul 23 21:32:28.216633 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2322/4567] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:27 2022] GET /compute/v2.1/servers/b0bb14c2-15df-4440-9d9c-4c6598867dfe => generated 1363 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:32:28.230052 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ebb40ebb-4d32-4634-86d7-698af15ae474 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:28.231093 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-ebb40ebb-4d32-4634-86d7-698af15ae474 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: dcc206d0-3170-459e-b48a-8cf9709e1ffb] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:28.236505 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-04483ec8-912f-4200-975f-97d398b1a9fe req-9ac875c8-8d9b-4ebf-ac04-0b04d41b8c5e service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:28.237408 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-04483ec8-912f-4200-975f-97d398b1a9fe req-9ac875c8-8d9b-4ebf-ac04-0b04d41b8c5e service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:28.253176 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ebb40ebb-4d32-4634-86d7-698af15ae474 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:28.253738 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ebb40ebb-4d32-4634-86d7-698af15ae474 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:28.254677 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ebb40ebb-4d32-4634-86d7-698af15ae474 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:28.255237 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ebb40ebb-4d32-4634-86d7-698af15ae474 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:28.271091 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-04483ec8-912f-4200-975f-97d398b1a9fe req-9ac875c8-8d9b-4ebf-ac04-0b04d41b8c5e service nova] Creating event network-changed:da2c7126-d794-4ff2-a071-724ef04327f5 for instance b0bb14c2-15df-4440-9d9c-4c6598867dfe on nch2-master-1 Jul 23 21:32:28.288723 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-04483ec8-912f-4200-975f-97d398b1a9fe req-9ac875c8-8d9b-4ebf-ac04-0b04d41b8c5e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115085 Jul 23 21:32:28.296268 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2246/4568] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:32:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:32:28.301979 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-64e631ce-0673-41ea-bce5-1c74c188686c req-7d746f17-1571-4c91-b276-f42b75e08ad3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6b9ea07-2ebd-4e1a-86f2-abb1bf581076", "name": "network-vif-plugged", "status": "completed", "tag": "d1ebc2ac-80d0-4761-8a8b-958b5aadb724"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:32:28.325809 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-64e631ce-0673-41ea-bce5-1c74c188686c req-7d746f17-1571-4c91-b276-f42b75e08ad3 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:28.326203 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-64e631ce-0673-41ea-bce5-1c74c188686c req-7d746f17-1571-4c91-b276-f42b75e08ad3 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:28.344910 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-64e631ce-0673-41ea-bce5-1c74c188686c req-7d746f17-1571-4c91-b276-f42b75e08ad3 service nova] Creating event network-vif-plugged:d1ebc2ac-80d0-4761-8a8b-958b5aadb724 for instance d6b9ea07-2ebd-4e1a-86f2-abb1bf581076 on nch1-master-1 Jul 23 21:32:28.355026 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-64e631ce-0673-41ea-bce5-1c74c188686c req-7d746f17-1571-4c91-b276-f42b75e08ad3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056649 Jul 23 21:32:28.355716 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2247/4569] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:32:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:32:28.367273 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-02ba1c8e-3489-4d17-a95f-d316b7a2518f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:28.369321 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-02ba1c8e-3489-4d17-a95f-d316b7a2518f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:28.378237 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-02ba1c8e-3489-4d17-a95f-d316b7a2518f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:28.379000 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-02ba1c8e-3489-4d17-a95f-d316b7a2518f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:28.379968 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-02ba1c8e-3489-4d17-a95f-d316b7a2518f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:28.380607 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-02ba1c8e-3489-4d17-a95f-d316b7a2518f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:28.450606 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-02ba1c8e-3489-4d17-a95f-d316b7a2518f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:28.459992 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-02ba1c8e-3489-4d17-a95f-d316b7a2518f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:28.461942 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-02ba1c8e-3489-4d17-a95f-d316b7a2518f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:28.463281 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-02ba1c8e-3489-4d17-a95f-d316b7a2518f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.106180 Jul 23 21:32:28.463918 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2248/4570] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:32:28 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:32:28.589471 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ebb40ebb-4d32-4634-86d7-698af15ae474 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:28.600437 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-ebb40ebb-4d32-4634-86d7-698af15ae474 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/dcc206d0-3170-459e-b48a-8cf9709e1ffb" status: 200 len: 1489 microversion: 2.1 time: 0.382219 Jul 23 21:32:28.601258 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2323/4571] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:28 2022] GET /compute/v2.1/servers/dcc206d0-3170-459e-b48a-8cf9709e1ffb => generated 1489 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:32:28.617835 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d13f973d-3179-4109-8f7b-b67011e3611b tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:28.618453 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d13f973d-3179-4109-8f7b-b67011e3611b tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: dcc206d0-3170-459e-b48a-8cf9709e1ffb] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:28.625227 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d13f973d-3179-4109-8f7b-b67011e3611b tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:28.626244 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d13f973d-3179-4109-8f7b-b67011e3611b tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:28.627257 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d13f973d-3179-4109-8f7b-b67011e3611b tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:28.627907 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d13f973d-3179-4109-8f7b-b67011e3611b tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:28.683648 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d13f973d-3179-4109-8f7b-b67011e3611b tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: dcc206d0-3170-459e-b48a-8cf9709e1ffb] Going to try to terminate instance {{(pid=131320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:32:28.699121 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-df209171-6283-4623-a4bc-6a9f650a1788 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:28.700017 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-df209171-6283-4623-a4bc-6a9f650a1788 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] [instance: d6b9ea07-2ebd-4e1a-86f2-abb1bf581076] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:28.720313 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-df209171-6283-4623-a4bc-6a9f650a1788 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:28.721392 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-df209171-6283-4623-a4bc-6a9f650a1788 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:28.723049 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-df209171-6283-4623-a4bc-6a9f650a1788 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:28.723742 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-df209171-6283-4623-a4bc-6a9f650a1788 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:28.866352 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d13f973d-3179-4109-8f7b-b67011e3611b tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "DELETE /compute/v2.1/servers/dcc206d0-3170-459e-b48a-8cf9709e1ffb" status: 204 len: 0 microversion: 2.1 time: 0.251951 Jul 23 21:32:28.867337 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2249/4572] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:32:28 2022] DELETE /compute/v2.1/servers/dcc206d0-3170-459e-b48a-8cf9709e1ffb => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:32:28.877615 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2e2b6b36-e1be-4993-828e-f54a44b9efca tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:28.878871 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-2e2b6b36-e1be-4993-828e-f54a44b9efca tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: dcc206d0-3170-459e-b48a-8cf9709e1ffb] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:28.886950 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2e2b6b36-e1be-4993-828e-f54a44b9efca tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:28.887770 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2e2b6b36-e1be-4993-828e-f54a44b9efca tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:28.888983 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2e2b6b36-e1be-4993-828e-f54a44b9efca tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:28.889569 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2e2b6b36-e1be-4993-828e-f54a44b9efca tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:29.136278 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-df209171-6283-4623-a4bc-6a9f650a1788 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:29.151838 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-df209171-6283-4623-a4bc-6a9f650a1788 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:29.155304 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-2e2b6b36-e1be-4993-828e-f54a44b9efca tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:29.155500 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-df209171-6283-4623-a4bc-6a9f650a1788 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:29.156742 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-df209171-6283-4623-a4bc-6a9f650a1788 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] 10.222.0.17 "GET /compute/v2.1/servers/d6b9ea07-2ebd-4e1a-86f2-abb1bf581076" status: 200 len: 1408 microversion: 2.20 time: 0.465986 Jul 23 21:32:29.157323 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2324/4573] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:32:28 2022] GET /compute/v2.1/servers/d6b9ea07-2ebd-4e1a-86f2-abb1bf581076 => generated 1408 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:32:29.171403 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2e2b6b36-e1be-4993-828e-f54a44b9efca tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/dcc206d0-3170-459e-b48a-8cf9709e1ffb" status: 200 len: 1495 microversion: 2.1 time: 0.296675 Jul 23 21:32:29.173161 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2250/4574] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:28 2022] GET /compute/v2.1/servers/dcc206d0-3170-459e-b48a-8cf9709e1ffb => generated 1495 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:32:29.190843 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-954469f8-3741-4890-ac52-dbbf20b65a0d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:29.191448 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-954469f8-3741-4890-ac52-dbbf20b65a0d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:29.208575 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-954469f8-3741-4890-ac52-dbbf20b65a0d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:29.209247 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-954469f8-3741-4890-ac52-dbbf20b65a0d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:29.209812 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-954469f8-3741-4890-ac52-dbbf20b65a0d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:29.210771 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-954469f8-3741-4890-ac52-dbbf20b65a0d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:29.232886 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c5049b60-8d12-46db-9cb7-c176a6c79489 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:29.235010 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c5049b60-8d12-46db-9cb7-c176a6c79489 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] [instance: b0bb14c2-15df-4440-9d9c-4c6598867dfe] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:29.255002 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c5049b60-8d12-46db-9cb7-c176a6c79489 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:29.261048 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c5049b60-8d12-46db-9cb7-c176a6c79489 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:29.266744 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c5049b60-8d12-46db-9cb7-c176a6c79489 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:29.267568 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c5049b60-8d12-46db-9cb7-c176a6c79489 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:29.579070 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-954469f8-3741-4890-ac52-dbbf20b65a0d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:29.596557 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-954469f8-3741-4890-ac52-dbbf20b65a0d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1509 microversion: 2.1 time: 0.409027 Jul 23 21:32:29.611483 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2325/4575] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:29 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1509 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:32:29.618824 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-2ada757c-4b57-4cec-af48-114fd8794b39 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:29.620869 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-2ada757c-4b57-4cec-af48-114fd8794b39 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:29.628658 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2ada757c-4b57-4cec-af48-114fd8794b39 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:29.629243 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2ada757c-4b57-4cec-af48-114fd8794b39 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:29.631526 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2ada757c-4b57-4cec-af48-114fd8794b39 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:29.632123 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2ada757c-4b57-4cec-af48-114fd8794b39 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:29.650036 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c5049b60-8d12-46db-9cb7-c176a6c79489 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc4aa131e63349b2aa8f37fdf6d2fe00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc1475019924837a8be47347f6bbd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:29.670436 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c5049b60-8d12-46db-9cb7-c176a6c79489 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] 10.222.0.17 "GET /compute/v2.1/servers/b0bb14c2-15df-4440-9d9c-4c6598867dfe" status: 200 len: 1363 microversion: 2.1 time: 0.443390 Jul 23 21:32:29.672587 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2251/4576] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:29 2022] GET /compute/v2.1/servers/b0bb14c2-15df-4440-9d9c-4c6598867dfe => generated 1363 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:32:29.782452 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-2ada757c-4b57-4cec-af48-114fd8794b39 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:29.804836 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:32:29.821000 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-2ada757c-4b57-4cec-af48-114fd8794b39 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:29.827887 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-2ada757c-4b57-4cec-af48-114fd8794b39 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:29.830829 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-2ada757c-4b57-4cec-af48-114fd8794b39 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.217377 Jul 23 21:32:29.850784 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2326/4577] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:32:29 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:32:30.176550 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b939f8bf-13d9-4ca2-9b23-8ecd9264ce16 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:30.177189 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b939f8bf-13d9-4ca2-9b23-8ecd9264ce16 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] [instance: d6b9ea07-2ebd-4e1a-86f2-abb1bf581076] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:30.188835 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ba258d68-624c-4abc-9563-f632484c3cf5 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:30.189918 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-ba258d68-624c-4abc-9563-f632484c3cf5 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: dcc206d0-3170-459e-b48a-8cf9709e1ffb] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:30.197325 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ba258d68-624c-4abc-9563-f632484c3cf5 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:30.197905 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b939f8bf-13d9-4ca2-9b23-8ecd9264ce16 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:30.198653 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b939f8bf-13d9-4ca2-9b23-8ecd9264ce16 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:30.199872 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b939f8bf-13d9-4ca2-9b23-8ecd9264ce16 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:30.200477 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b939f8bf-13d9-4ca2-9b23-8ecd9264ce16 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:30.205616 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ba258d68-624c-4abc-9563-f632484c3cf5 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:30.207132 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ba258d68-624c-4abc-9563-f632484c3cf5 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:30.207819 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ba258d68-624c-4abc-9563-f632484c3cf5 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:30.368789 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b939f8bf-13d9-4ca2-9b23-8ecd9264ce16 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:30.377052 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b939f8bf-13d9-4ca2-9b23-8ecd9264ce16 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:30.379247 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b939f8bf-13d9-4ca2-9b23-8ecd9264ce16 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:30.380459 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b939f8bf-13d9-4ca2-9b23-8ecd9264ce16 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] 10.222.0.17 "GET /compute/v2.1/servers/d6b9ea07-2ebd-4e1a-86f2-abb1bf581076" status: 200 len: 1408 microversion: 2.20 time: 0.209445 Jul 23 21:32:30.381039 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2252/4578] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:32:30 2022] GET /compute/v2.1/servers/d6b9ea07-2ebd-4e1a-86f2-abb1bf581076 => generated 1408 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:32:30.386149 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-7a868f82-6492-4c73-af1e-0ac55388ce13 req-7fce62e2-7a66-40a9-9454-7f77e63b4d8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2ad2cfd-7479-48d0-b802-cdd5d5093305", "name": "network-vif-unplugged", "status": "completed", "tag": "cbde15d1-b6fd-48d4-98a3-b0a0c831fec2"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:32:30.394920 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-7a868f82-6492-4c73-af1e-0ac55388ce13 req-7fce62e2-7a66-40a9-9454-7f77e63b4d8d service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:30.395364 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-7a868f82-6492-4c73-af1e-0ac55388ce13 req-7fce62e2-7a66-40a9-9454-7f77e63b4d8d service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:30.407456 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-7a868f82-6492-4c73-af1e-0ac55388ce13 req-7fce62e2-7a66-40a9-9454-7f77e63b4d8d service nova] Creating event network-vif-unplugged:cbde15d1-b6fd-48d4-98a3-b0a0c831fec2 for instance f2ad2cfd-7479-48d0-b802-cdd5d5093305 on nch1-master-1 Jul 23 21:32:30.412452 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-7a868f82-6492-4c73-af1e-0ac55388ce13 req-7fce62e2-7a66-40a9-9454-7f77e63b4d8d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030089 Jul 23 21:32:30.413066 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2253/4579] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:32:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:32:30.616559 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c483efc0-9607-4a11-a774-2edca933e9eb tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:30.617530 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c483efc0-9607-4a11-a774-2edca933e9eb tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:30.618116 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ba258d68-624c-4abc-9563-f632484c3cf5 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:30.624912 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c483efc0-9607-4a11-a774-2edca933e9eb tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:30.625266 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c483efc0-9607-4a11-a774-2edca933e9eb tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:30.626352 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c483efc0-9607-4a11-a774-2edca933e9eb tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:30.627008 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c483efc0-9607-4a11-a774-2edca933e9eb tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:30.627792 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-ba258d68-624c-4abc-9563-f632484c3cf5 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/dcc206d0-3170-459e-b48a-8cf9709e1ffb" status: 200 len: 1495 microversion: 2.1 time: 0.442749 Jul 23 21:32:30.628874 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2327/4580] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:30 2022] GET /compute/v2.1/servers/dcc206d0-3170-459e-b48a-8cf9709e1ffb => generated 1495 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:32:30.687528 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-abf11efc-b4a8-4572-a754-9a9b630ab45c tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:30.688158 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-abf11efc-b4a8-4572-a754-9a9b630ab45c tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] [instance: b0bb14c2-15df-4440-9d9c-4c6598867dfe] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:30.694821 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-abf11efc-b4a8-4572-a754-9a9b630ab45c tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:30.695567 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-abf11efc-b4a8-4572-a754-9a9b630ab45c tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:30.696361 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-abf11efc-b4a8-4572-a754-9a9b630ab45c tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:30.696960 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-abf11efc-b4a8-4572-a754-9a9b630ab45c tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:30.889106 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c483efc0-9607-4a11-a774-2edca933e9eb tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:30.899677 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c483efc0-9607-4a11-a774-2edca933e9eb tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1509 microversion: 2.1 time: 0.287355 Jul 23 21:32:30.903870 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2254/4581] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:30 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1509 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:32:30.921317 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f281426c-7ccf-4e5b-bcc8-08b257559979 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:30.922302 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f281426c-7ccf-4e5b-bcc8-08b257559979 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:30.954445 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f281426c-7ccf-4e5b-bcc8-08b257559979 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:30.957268 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f281426c-7ccf-4e5b-bcc8-08b257559979 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:30.958281 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f281426c-7ccf-4e5b-bcc8-08b257559979 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:30.958827 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f281426c-7ccf-4e5b-bcc8-08b257559979 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:30.985239 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-abf11efc-b4a8-4572-a754-9a9b630ab45c tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc4aa131e63349b2aa8f37fdf6d2fe00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc1475019924837a8be47347f6bbd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:30.993112 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-abf11efc-b4a8-4572-a754-9a9b630ab45c tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] 10.222.0.17 "GET /compute/v2.1/servers/b0bb14c2-15df-4440-9d9c-4c6598867dfe" status: 200 len: 1363 microversion: 2.1 time: 0.309615 Jul 23 21:32:30.996288 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2328/4582] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:30 2022] GET /compute/v2.1/servers/b0bb14c2-15df-4440-9d9c-4c6598867dfe => generated 1363 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:32:31.062894 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f281426c-7ccf-4e5b-bcc8-08b257559979 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:31.087134 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f281426c-7ccf-4e5b-bcc8-08b257559979 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:31.091832 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f281426c-7ccf-4e5b-bcc8-08b257559979 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:31.096589 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f281426c-7ccf-4e5b-bcc8-08b257559979 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.180697 Jul 23 21:32:31.098284 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2255/4583] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:32:30 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:32:31.399241 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-843dfb53-1cf3-488d-b588-c93338764841 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:31.399933 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-843dfb53-1cf3-488d-b588-c93338764841 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] [instance: d6b9ea07-2ebd-4e1a-86f2-abb1bf581076] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:31.408266 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-843dfb53-1cf3-488d-b588-c93338764841 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:31.408729 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-843dfb53-1cf3-488d-b588-c93338764841 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:31.409553 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-843dfb53-1cf3-488d-b588-c93338764841 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:31.410848 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-843dfb53-1cf3-488d-b588-c93338764841 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:31.560393 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-7f38b931-3892-475d-9dae-9eb175ea2d62 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1855281509", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "networks": [{"uuid": "24910048-6a06-4bd9-99f1-e6cc0b3a4a13"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1067306574", "security_groups": []}, "os:scheduler_hints": {"different_host": ["1f5b9a5a-109e-48b5-adc1-113384944dce"]}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:32:31.591465 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:32:31.606868 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-843dfb53-1cf3-488d-b588-c93338764841 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:31.615450 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-843dfb53-1cf3-488d-b588-c93338764841 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:31.617375 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-843dfb53-1cf3-488d-b588-c93338764841 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:31.618745 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-843dfb53-1cf3-488d-b588-c93338764841 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] 10.222.0.17 "GET /compute/v2.1/servers/d6b9ea07-2ebd-4e1a-86f2-abb1bf581076" status: 200 len: 1408 microversion: 2.20 time: 0.223805 Jul 23 21:32:31.621675 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2329/4584] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:32:31 2022] GET /compute/v2.1/servers/d6b9ea07-2ebd-4e1a-86f2-abb1bf581076 => generated 1408 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:32:31.643689 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-7f38b931-3892-475d-9dae-9eb175ea2d62 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] validate_networks() for [('24910048-6a06-4bd9-99f1-e6cc0b3a4a13', None, None, None, None, None)] {{(pid=131320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:32:31.647556 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-06fe8b2d-c315-4fe4-baef-4a3e2d80d599 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:31.650711 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-06fe8b2d-c315-4fe4-baef-4a3e2d80d599 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: dcc206d0-3170-459e-b48a-8cf9709e1ffb] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:31.658369 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-06fe8b2d-c315-4fe4-baef-4a3e2d80d599 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:31.659074 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-06fe8b2d-c315-4fe4-baef-4a3e2d80d599 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:31.660240 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-06fe8b2d-c315-4fe4-baef-4a3e2d80d599 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:31.660732 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-06fe8b2d-c315-4fe4-baef-4a3e2d80d599 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:31.869114 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-06fe8b2d-c315-4fe4-baef-4a3e2d80d599 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:31.879600 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-06fe8b2d-c315-4fe4-baef-4a3e2d80d599 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/dcc206d0-3170-459e-b48a-8cf9709e1ffb" status: 200 len: 1495 microversion: 2.1 time: 0.235640 Jul 23 21:32:31.880957 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2330/4585] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:31 2022] GET /compute/v2.1/servers/dcc206d0-3170-459e-b48a-8cf9709e1ffb => generated 1495 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:32:31.923589 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-abf575e1-bff1-4bbb-9e00-3c665f5bd369 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:31.925138 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-abf575e1-bff1-4bbb-9e00-3c665f5bd369 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:31.933916 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-abf575e1-bff1-4bbb-9e00-3c665f5bd369 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:31.934766 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-abf575e1-bff1-4bbb-9e00-3c665f5bd369 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:31.935951 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-abf575e1-bff1-4bbb-9e00-3c665f5bd369 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:31.936762 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-abf575e1-bff1-4bbb-9e00-3c665f5bd369 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:32.141168 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=11 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:32:32.306617 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-abf575e1-bff1-4bbb-9e00-3c665f5bd369 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:32.322770 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-abf575e1-bff1-4bbb-9e00-3c665f5bd369 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1512 microversion: 2.1 time: 0.403480 Jul 23 21:32:32.324626 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2331/4586] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:31 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1512 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:32:32.333184 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-7fad2629-4495-4606-afdf-3e1333c1a91d tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:32.334882 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-7fad2629-4495-4606-afdf-3e1333c1a91d tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] [instance: b0bb14c2-15df-4440-9d9c-4c6598867dfe] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:32.345352 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7fad2629-4495-4606-afdf-3e1333c1a91d tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:32.346720 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7fad2629-4495-4606-afdf-3e1333c1a91d tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:32.347896 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7fad2629-4495-4606-afdf-3e1333c1a91d tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:32.348772 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7fad2629-4495-4606-afdf-3e1333c1a91d tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:32.441307 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-7f38b931-3892-475d-9dae-9eb175ea2d62 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:32:32.442111 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-7f38b931-3892-475d-9dae-9eb175ea2d62 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:32:32.442902 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-7f38b931-3892-475d-9dae-9eb175ea2d62 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:32:32.443367 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-7f38b931-3892-475d-9dae-9eb175ea2d62 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:32:32.443864 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-7f38b931-3892-475d-9dae-9eb175ea2d62 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:32:32.454670 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7f38b931-3892-475d-9dae-9eb175ea2d62 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:32.455313 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7f38b931-3892-475d-9dae-9eb175ea2d62 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:32.456339 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7f38b931-3892-475d-9dae-9eb175ea2d62 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:32.456950 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7f38b931-3892-475d-9dae-9eb175ea2d62 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:32.482327 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-7f38b931-3892-475d-9dae-9eb175ea2d62 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Getting quotas for project 842a1aca542f416eab5d43b881325917. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:32:32.488401 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-7f38b931-3892-475d-9dae-9eb175ea2d62 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Getting quotas for user 0bd49331138a4dbc912bc7bf6f6b0215 and project 842a1aca542f416eab5d43b881325917. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:32:32.503862 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-7f38b931-3892-475d-9dae-9eb175ea2d62 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Going to run 1 instances... {{(pid=131320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:32:32.506700 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-7f38b931-3892-475d-9dae-9eb175ea2d62 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] [instance: 2ec03ea9-c0f4-41a6-93cb-bf713381760b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:32:32.606231 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-7f38b931-3892-475d-9dae-9eb175ea2d62 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 1.049203 Jul 23 21:32:32.615444 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2256/4587] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:32:31 2022] POST /compute/v2.1/servers => generated 361 bytes in 1060 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 23 21:32:32.621917 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0e62a557-3194-40f7-8bb1-d6e10fb2b981 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:32.622947 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-0e62a557-3194-40f7-8bb1-d6e10fb2b981 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:32.638966 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0e62a557-3194-40f7-8bb1-d6e10fb2b981 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:32.657654 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0e62a557-3194-40f7-8bb1-d6e10fb2b981 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:32.678877 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0e62a557-3194-40f7-8bb1-d6e10fb2b981 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:32.680428 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0e62a557-3194-40f7-8bb1-d6e10fb2b981 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:32.838105 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-0e62a557-3194-40f7-8bb1-d6e10fb2b981 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:32.867360 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-0e62a557-3194-40f7-8bb1-d6e10fb2b981 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:32.883801 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-0e62a557-3194-40f7-8bb1-d6e10fb2b981 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:32.886304 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-0e62a557-3194-40f7-8bb1-d6e10fb2b981 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.269375 Jul 23 21:32:32.887666 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-7fad2629-4495-4606-afdf-3e1333c1a91d tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc4aa131e63349b2aa8f37fdf6d2fe00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc1475019924837a8be47347f6bbd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:32.892376 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2257/4588] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:32:32 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:32:32.898672 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-7fad2629-4495-4606-afdf-3e1333c1a91d tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] 10.222.0.17 "GET /compute/v2.1/servers/b0bb14c2-15df-4440-9d9c-4c6598867dfe" status: 200 len: 1363 microversion: 2.1 time: 0.572674 Jul 23 21:32:32.899263 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2332/4589] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:32 2022] GET /compute/v2.1/servers/b0bb14c2-15df-4440-9d9c-4c6598867dfe => generated 1363 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:32:32.901065 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-644179fc-7596-4c55-bec6-ed7873b0f6db tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:32.901920 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-644179fc-7596-4c55-bec6-ed7873b0f6db tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:32.909934 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-040d4ea3-a38c-456b-8c65-4382c01896c1 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:32.910423 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-040d4ea3-a38c-456b-8c65-4382c01896c1 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] [instance: 2ec03ea9-c0f4-41a6-93cb-bf713381760b] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:32.925081 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-644179fc-7596-4c55-bec6-ed7873b0f6db tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:32.926430 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-644179fc-7596-4c55-bec6-ed7873b0f6db tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:32.928023 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-644179fc-7596-4c55-bec6-ed7873b0f6db tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:32.930321 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-644179fc-7596-4c55-bec6-ed7873b0f6db tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:33.062665 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-040d4ea3-a38c-456b-8c65-4382c01896c1 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd49331138a4dbc912bc7bf6f6b0215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842a1aca542f416eab5d43b881325917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:33.073732 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-040d4ea3-a38c-456b-8c65-4382c01896c1 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] 10.222.0.17 "GET /compute/v2.1/servers/2ec03ea9-c0f4-41a6-93cb-bf713381760b" status: 200 len: 1242 microversion: 2.1 time: 0.171835 Jul 23 21:32:33.075970 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2333/4590] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:32 2022] GET /compute/v2.1/servers/2ec03ea9-c0f4-41a6-93cb-bf713381760b => generated 1242 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:32:33.087592 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-14efada1-248d-4255-b4d7-b1c9a0e33744 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:33.088227 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-14efada1-248d-4255-b4d7-b1c9a0e33744 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] [instance: d6b9ea07-2ebd-4e1a-86f2-abb1bf581076] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:33.108804 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-14efada1-248d-4255-b4d7-b1c9a0e33744 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:33.109517 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-14efada1-248d-4255-b4d7-b1c9a0e33744 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:33.110521 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-14efada1-248d-4255-b4d7-b1c9a0e33744 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:33.111118 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-14efada1-248d-4255-b4d7-b1c9a0e33744 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:33.144749 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-644179fc-7596-4c55-bec6-ed7873b0f6db tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:33.155735 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-644179fc-7596-4c55-bec6-ed7873b0f6db tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1452 microversion: 2.1 time: 0.260990 Jul 23 21:32:33.157013 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2258/4591] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:32 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1452 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:32:33.164256 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-59458359-cc32-4c3f-9d80-7272e255c213 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:33.181758 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-59458359-cc32-4c3f-9d80-7272e255c213 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: dcc206d0-3170-459e-b48a-8cf9709e1ffb] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:33.191877 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-59458359-cc32-4c3f-9d80-7272e255c213 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:33.192748 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-59458359-cc32-4c3f-9d80-7272e255c213 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:33.193723 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-59458359-cc32-4c3f-9d80-7272e255c213 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:33.194365 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-59458359-cc32-4c3f-9d80-7272e255c213 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:33.321453 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-59458359-cc32-4c3f-9d80-7272e255c213 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:33.335064 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-59458359-cc32-4c3f-9d80-7272e255c213 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/dcc206d0-3170-459e-b48a-8cf9709e1ffb" status: 200 len: 1453 microversion: 2.1 time: 0.176648 Jul 23 21:32:33.335905 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2259/4592] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:33 2022] GET /compute/v2.1/servers/dcc206d0-3170-459e-b48a-8cf9709e1ffb => generated 1453 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:32:33.348856 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-bb92f339-f3fe-44ca-91a7-5f25defadfb6 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:32:33.349558 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-bb92f339-f3fe-44ca-91a7-5f25defadfb6 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:33.367522 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bb92f339-f3fe-44ca-91a7-5f25defadfb6 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:33.368043 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bb92f339-f3fe-44ca-91a7-5f25defadfb6 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:33.368956 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bb92f339-f3fe-44ca-91a7-5f25defadfb6 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:33.369467 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bb92f339-f3fe-44ca-91a7-5f25defadfb6 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:33.440880 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.objects.instance [None req-bb92f339-f3fe-44ca-91a7-5f25defadfb6 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lazy-loading 'flavor' on Instance uuid f2ad2cfd-7479-48d0-b802-cdd5d5093305 {{(pid=131320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:32:33.446747 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:32:33.464919 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-bb92f339-f3fe-44ca-91a7-5f25defadfb6 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] HTTP exception thrown: Cannot 'shelve' instance f2ad2cfd-7479-48d0-b802-cdd5d5093305 while it is in vm_state shelved_offloaded Jul 23 21:32:33.468415 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-bb92f339-f3fe-44ca-91a7-5f25defadfb6 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Request method failure captured: Jul 23 21:32:33.468415 ncdv-master-1 devstack@n-api.service[131320]: request: POST /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305/action HTTP/1.1 Jul 23 21:32:33.468415 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:32:33.468415 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:32:33.468415 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:32:33.468415 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 14 Jul 23 21:32:33.468415 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:32:33.468415 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:32:33.468415 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:32:33.468415 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:32:33.468415 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3Ghf1JjZ4k8tVzERRK8IkLpluLUwa9k5Rz-X0dEr2p4_7xl_eBekUiNk1RZEGsFdGEiApbLOfcuSifirvwiKV1QOTaKdXKwfMnwZgdfagxJjoe3dPYUa3b-d3rVTYewIN_YoX2mMGGBMWRa3po8WOCVIc6hXJLExzq_ndbcO7U8NQBI Jul 23 21:32:33.468415 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:32:33.468415 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:32:33.468415 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:32:33.468415 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:32:33.468415 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:32:33.468415 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:32:33.468415 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: d70f6c96e1ad484aa3207fc01a12d519 Jul 23 21:32:33.468415 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:32:33.468415 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:32:33.468415 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:32:33.468415 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d70f6c96e1ad484aa3207fc01a12d519"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d70f6c96e1ad484aa3207fc01a12d519"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d70f6c96e1ad484aa3207fc01a12d519", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d70f6c96e1ad484aa3207fc01a12d519"}]}] Jul 23 21:32:33.468415 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:32:33.468415 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: d70f6c96e1ad484aa3207fc01a12d519 Jul 23 21:32:33.468415 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:32:33.468415 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServersNegativeTestJSON-1106538570-project Jul 23 21:32:33.468415 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:32:33.468415 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:32:33.468415 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 6ca9644a73d9468aa39b21548a72bded Jul 23 21:32:33.468415 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServersNegativeTestJSON-1106538570-project Jul 23 21:32:33.468415 ncdv-master-1 devstack@n-api.service[131320]: Jul 23 21:32:33.468415 ncdv-master-1 devstack@n-api.service[131320]: {"shelve": {}} Jul 23 21:32:33.468415 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:32:33.468415 ncdv-master-1 devstack@n-api.service[131320]: exception: Cannot 'shelve' instance f2ad2cfd-7479-48d0-b802-cdd5d5093305 while it is in vm_state shelved_offloaded Jul 23 21:32:33.468415 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': 'f2ad2cfd-7479-48d0-b802-cdd5d5093305', 'body': {'shelve': {}}} Jul 23 21:32:33.468415 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:32:33.468415 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:32:33.468415 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Jul 23 21:32:33.468415 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Jul 23 21:32:33.468415 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 23 21:32:33.468415 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 23 21:32:33.468415 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 23 21:32:33.468415 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 23 21:32:33.468415 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 23 21:32:33.468415 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 23 21:32:33.468415 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 23 21:32:33.468415 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 23 21:32:33.468415 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 23 21:32:33.468415 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 23 21:32:33.468415 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 23 21:32:33.468415 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 23 21:32:33.468415 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f2ad2cfd-7479-48d0-b802-cdd5d5093305 in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Jul 23 21:32:33.468415 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:32:33.468415 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:32:33.468415 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:32:33.468415 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:32:33.468415 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:32:33.468415 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:32:33.468415 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:32:33.468415 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:32:33.468415 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:32:33.468415 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:32:33.468415 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Jul 23 21:32:33.468415 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 23 21:32:33.472765 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 23 21:32:33.472765 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 23 21:32:33.472765 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance f2ad2cfd-7479-48d0-b802-cdd5d5093305 while it is in vm_state shelved_offloaded Jul 23 21:32:33.472765 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:32:33.472765 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:32:33.472765 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:32:33.472765 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:32:33.472765 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:32:33.472765 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:32:33.472765 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:32:33.472765 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:32:33.472765 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance f2ad2cfd-7479-48d0-b802-cdd5d5093305 while it is in vm_state shelved_offloaded Jul 23 21:32:33.472765 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:32:33.472765 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-bb92f339-f3fe-44ca-91a7-5f25defadfb6 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Returning 409 to user: Cannot 'shelve' instance f2ad2cfd-7479-48d0-b802-cdd5d5093305 while it is in vm_state shelved_offloaded {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:32:33.472765 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-bb92f339-f3fe-44ca-91a7-5f25defadfb6 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "POST /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305/action" status: 409 len: 155 microversion: 2.1 time: 0.133328 Jul 23 21:32:33.479795 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2260/4593] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:32:33 2022] POST /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305/action => generated 155 bytes in 144 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 23 21:32:33.487160 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-883de91c-50bc-4df8-93ee-0f897e9d3438 req-443852e1-7584-4013-a919-daf5ae1c18c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcc206d0-3170-459e-b48a-8cf9709e1ffb", "name": "network-vif-deleted", "tag": "42f2d7dd-7907-4a82-b260-d0d132ebcb5f"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:32:33.498830 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-883de91c-50bc-4df8-93ee-0f897e9d3438 req-443852e1-7584-4013-a919-daf5ae1c18c8 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:33.499375 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-883de91c-50bc-4df8-93ee-0f897e9d3438 req-443852e1-7584-4013-a919-daf5ae1c18c8 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:33.513947 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-883de91c-50bc-4df8-93ee-0f897e9d3438 req-443852e1-7584-4013-a919-daf5ae1c18c8 service nova] Creating event network-vif-deleted:42f2d7dd-7907-4a82-b260-d0d132ebcb5f for instance dcc206d0-3170-459e-b48a-8cf9709e1ffb on nch1-master-1 Jul 23 21:32:33.519575 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-883de91c-50bc-4df8-93ee-0f897e9d3438 req-443852e1-7584-4013-a919-daf5ae1c18c8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038114 Jul 23 21:32:33.520221 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2261/4594] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:32:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:32:33.525559 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ae64c74a-eb32-4906-b5cd-0679b2000f32 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:32:33.526516 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ae64c74a-eb32-4906-b5cd-0679b2000f32 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:33.534864 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ae64c74a-eb32-4906-b5cd-0679b2000f32 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:33.535313 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ae64c74a-eb32-4906-b5cd-0679b2000f32 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:33.536327 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ae64c74a-eb32-4906-b5cd-0679b2000f32 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:33.537487 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ae64c74a-eb32-4906-b5cd-0679b2000f32 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:33.675536 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ae64c74a-eb32-4906-b5cd-0679b2000f32 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "POST /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305/action" status: 202 len: 0 microversion: 2.1 time: 0.153992 Jul 23 21:32:33.676714 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2262/4595] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:32:33 2022] POST /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305/action => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:32:33.686274 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3e28ac38-8f0a-4a6c-ab5d-ff0e107f4447 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:33.691311 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-3e28ac38-8f0a-4a6c-ab5d-ff0e107f4447 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:33.699654 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3e28ac38-8f0a-4a6c-ab5d-ff0e107f4447 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:33.700344 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3e28ac38-8f0a-4a6c-ab5d-ff0e107f4447 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:33.701575 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3e28ac38-8f0a-4a6c-ab5d-ff0e107f4447 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:33.702404 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3e28ac38-8f0a-4a6c-ab5d-ff0e107f4447 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:33.711692 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-14efada1-248d-4255-b4d7-b1c9a0e33744 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:33.739250 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-14efada1-248d-4255-b4d7-b1c9a0e33744 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:33.744191 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-14efada1-248d-4255-b4d7-b1c9a0e33744 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:33.747328 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-14efada1-248d-4255-b4d7-b1c9a0e33744 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] 10.222.0.17 "GET /compute/v2.1/servers/d6b9ea07-2ebd-4e1a-86f2-abb1bf581076" status: 200 len: 1600 microversion: 2.20 time: 0.669121 Jul 23 21:32:33.749232 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2334/4596] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:32:33 2022] GET /compute/v2.1/servers/d6b9ea07-2ebd-4e1a-86f2-abb1bf581076 => generated 1600 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:32:33.757234 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-ca3c3fab-d0f4-4ded-9ca0-18ade5b2bccf req-4c653194-4dc2-474a-9c06-0965f3de2b13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0bb14c2-15df-4440-9d9c-4c6598867dfe", "name": "network-vif-plugged", "status": "completed", "tag": "da2c7126-d794-4ff2-a071-724ef04327f5"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:32:33.776449 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-ca3c3fab-d0f4-4ded-9ca0-18ade5b2bccf req-4c653194-4dc2-474a-9c06-0965f3de2b13 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:33.776900 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-ca3c3fab-d0f4-4ded-9ca0-18ade5b2bccf req-4c653194-4dc2-474a-9c06-0965f3de2b13 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:33.809340 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-ca3c3fab-d0f4-4ded-9ca0-18ade5b2bccf req-4c653194-4dc2-474a-9c06-0965f3de2b13 service nova] Creating event network-vif-plugged:da2c7126-d794-4ff2-a071-724ef04327f5 for instance b0bb14c2-15df-4440-9d9c-4c6598867dfe on nch2-master-1 Jul 23 21:32:33.834652 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-ca3c3fab-d0f4-4ded-9ca0-18ade5b2bccf req-4c653194-4dc2-474a-9c06-0965f3de2b13 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082666 Jul 23 21:32:33.835715 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2335/4597] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:32:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:32:33.842983 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-35f27485-3053-4cd8-b4b7-5507f1e3714b tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:33.844527 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-35f27485-3053-4cd8-b4b7-5507f1e3714b tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] [instance: d6b9ea07-2ebd-4e1a-86f2-abb1bf581076] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:33.854375 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-35f27485-3053-4cd8-b4b7-5507f1e3714b tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:33.855144 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-35f27485-3053-4cd8-b4b7-5507f1e3714b tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:33.856126 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-35f27485-3053-4cd8-b4b7-5507f1e3714b tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:33.856751 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-35f27485-3053-4cd8-b4b7-5507f1e3714b tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:34.038157 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-35f27485-3053-4cd8-b4b7-5507f1e3714b tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] 10.222.0.17 "GET /compute/v2.1/servers/d6b9ea07-2ebd-4e1a-86f2-abb1bf581076/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.200523 Jul 23 21:32:34.040089 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2336/4598] 10.222.0.17 () {60 vars in 1315 bytes} [Sat Jul 23 21:32:33 2022] GET /compute/v2.1/servers/d6b9ea07-2ebd-4e1a-86f2-abb1bf581076/os-interface => generated 284 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 23 21:32:34.047110 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-07a76104-f128-42a2-971f-d9748d7dfcb5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:34.051260 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-07a76104-f128-42a2-971f-d9748d7dfcb5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:34.069600 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-07a76104-f128-42a2-971f-d9748d7dfcb5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:34.072230 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-07a76104-f128-42a2-971f-d9748d7dfcb5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:34.075815 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-07a76104-f128-42a2-971f-d9748d7dfcb5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:34.076983 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-07a76104-f128-42a2-971f-d9748d7dfcb5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:34.121764 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-3e28ac38-8f0a-4a6c-ab5d-ff0e107f4447 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:34.137464 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-3e28ac38-8f0a-4a6c-ab5d-ff0e107f4447 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1460 microversion: 2.1 time: 0.453743 Jul 23 21:32:34.138115 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2263/4599] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:33 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1460 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:32:34.169710 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-59c84669-f9b1-4192-a962-12bfa465632c tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:34.172845 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-59c84669-f9b1-4192-a962-12bfa465632c tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] [instance: b0bb14c2-15df-4440-9d9c-4c6598867dfe] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:34.196256 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-59c84669-f9b1-4192-a962-12bfa465632c tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:34.200765 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-59c84669-f9b1-4192-a962-12bfa465632c tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:34.204515 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-59c84669-f9b1-4192-a962-12bfa465632c tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:34.204999 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-59c84669-f9b1-4192-a962-12bfa465632c tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:34.469985 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-59c84669-f9b1-4192-a962-12bfa465632c tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc4aa131e63349b2aa8f37fdf6d2fe00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc1475019924837a8be47347f6bbd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:34.481022 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-59c84669-f9b1-4192-a962-12bfa465632c tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] 10.222.0.17 "GET /compute/v2.1/servers/b0bb14c2-15df-4440-9d9c-4c6598867dfe" status: 200 len: 1363 microversion: 2.1 time: 0.336762 Jul 23 21:32:34.481834 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2264/4600] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:34 2022] GET /compute/v2.1/servers/b0bb14c2-15df-4440-9d9c-4c6598867dfe => generated 1363 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:32:34.498173 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a2d47d7a-d7c6-4c9a-bea7-31feb20a986b tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:34.498987 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a2d47d7a-d7c6-4c9a-bea7-31feb20a986b tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] [instance: 2ec03ea9-c0f4-41a6-93cb-bf713381760b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:34.523535 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a2d47d7a-d7c6-4c9a-bea7-31feb20a986b tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:34.539545 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a2d47d7a-d7c6-4c9a-bea7-31feb20a986b tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:34.540693 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a2d47d7a-d7c6-4c9a-bea7-31feb20a986b tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:34.541345 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a2d47d7a-d7c6-4c9a-bea7-31feb20a986b tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:34.627789 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a2d47d7a-d7c6-4c9a-bea7-31feb20a986b tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd49331138a4dbc912bc7bf6f6b0215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842a1aca542f416eab5d43b881325917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:34.641744 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a2d47d7a-d7c6-4c9a-bea7-31feb20a986b tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] 10.222.0.17 "GET /compute/v2.1/servers/2ec03ea9-c0f4-41a6-93cb-bf713381760b" status: 200 len: 1302 microversion: 2.1 time: 0.148492 Jul 23 21:32:34.642730 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2265/4601] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:34 2022] GET /compute/v2.1/servers/2ec03ea9-c0f4-41a6-93cb-bf713381760b => generated 1302 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:32:34.648173 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-aea98356-4ad8-429d-99b7-bb8ef67aedd3 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:34.648986 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-aea98356-4ad8-429d-99b7-bb8ef67aedd3 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: dcc206d0-3170-459e-b48a-8cf9709e1ffb] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:34.658903 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-aea98356-4ad8-429d-99b7-bb8ef67aedd3 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:34.660589 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-aea98356-4ad8-429d-99b7-bb8ef67aedd3 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:34.663109 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-aea98356-4ad8-429d-99b7-bb8ef67aedd3 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:34.663881 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-aea98356-4ad8-429d-99b7-bb8ef67aedd3 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:34.684801 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-aea98356-4ad8-429d-99b7-bb8ef67aedd3 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] HTTP exception thrown: Instance dcc206d0-3170-459e-b48a-8cf9709e1ffb could not be found. Jul 23 21:32:34.686732 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-aea98356-4ad8-429d-99b7-bb8ef67aedd3 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Request method failure captured: Jul 23 21:32:34.686732 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/dcc206d0-3170-459e-b48a-8cf9709e1ffb HTTP/1.1 Jul 23 21:32:34.686732 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:32:34.686732 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:32:34.686732 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:32:34.686732 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:32:34.686732 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:32:34.686732 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:32:34.686732 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:32:34.686732 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:32:34.686732 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GgexSaJTA-FXaV5LcqTAteOVESwOg7zac7nwUa59CGOHDwwWd7w7HKC8R65F9X48OwLZ_a8UsJYui6X5BG5uL_WJC-ysEg9nxrojp43TnKgPHTkujcdOw9VWLxqM9CE8dPwhawUMo8jE8x_rLu-o0j9Xf_QveShH-OlX4BIDLcYoyo Jul 23 21:32:34.686732 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:32:34.686732 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:32:34.686732 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:32:34.686732 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:32:34.686732 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:32:34.686732 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:32:34.686732 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 1890022bd460485dae0ea94b152a6746 Jul 23 21:32:34.686732 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServersTestJSON-1141465764 Jul 23 21:32:34.686732 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:32:34.686732 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:32:34.686732 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1890022bd460485dae0ea94b152a6746"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1890022bd460485dae0ea94b152a6746"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1890022bd460485dae0ea94b152a6746", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1890022bd460485dae0ea94b152a6746"}]}] Jul 23 21:32:34.686732 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServersTestJSON-1141465764 Jul 23 21:32:34.686732 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 1890022bd460485dae0ea94b152a6746 Jul 23 21:32:34.686732 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServersTestJSON-1141465764 Jul 23 21:32:34.686732 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServersTestJSON-1141465764-project Jul 23 21:32:34.686732 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:32:34.686732 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:32:34.686732 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 5efda1c40f494592bf1e6af1add120f3 Jul 23 21:32:34.686732 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServersTestJSON-1141465764-project Jul 23 21:32:34.686732 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:32:34.686732 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance dcc206d0-3170-459e-b48a-8cf9709e1ffb could not be found. Jul 23 21:32:34.686732 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': 'dcc206d0-3170-459e-b48a-8cf9709e1ffb'} Jul 23 21:32:34.686732 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:32:34.686732 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:32:34.686732 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:32:34.686732 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:32:34.686732 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:32:34.686732 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:32:34.686732 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:32:34.686732 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:32:34.686732 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:32:34.686732 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:32:34.686732 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcc206d0-3170-459e-b48a-8cf9709e1ffb could not be found. Jul 23 21:32:34.686732 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:32:34.686732 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:32:34.686732 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:32:34.686732 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:32:34.686732 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:32:34.686732 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:32:34.686732 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:32:34.686732 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:32:34.686732 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:32:34.686732 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:32:34.686732 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:32:34.686732 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:32:34.686732 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:32:34.686732 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:32:34.686732 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:32:34.686732 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:32:34.686732 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcc206d0-3170-459e-b48a-8cf9709e1ffb could not be found. Jul 23 21:32:34.686732 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:32:34.686732 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:32:34.686732 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:32:34.686732 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:32:34.695613 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:32:34.695613 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:32:34.695613 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:32:34.695613 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:32:34.695613 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcc206d0-3170-459e-b48a-8cf9709e1ffb could not be found. Jul 23 21:32:34.695613 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:32:34.695613 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-aea98356-4ad8-429d-99b7-bb8ef67aedd3 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Returning 404 to user: Instance dcc206d0-3170-459e-b48a-8cf9709e1ffb could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:32:34.695613 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-aea98356-4ad8-429d-99b7-bb8ef67aedd3 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/dcc206d0-3170-459e-b48a-8cf9709e1ffb" status: 404 len: 111 microversion: 2.1 time: 0.045001 Jul 23 21:32:34.695613 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2266/4602] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:34 2022] GET /compute/v2.1/servers/dcc206d0-3170-459e-b48a-8cf9709e1ffb => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:32:34.714843 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8baa97ea-e75a-4a7e-95b0-f31f09120d51 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:34.715427 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8baa97ea-e75a-4a7e-95b0-f31f09120d51 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: dcc206d0-3170-459e-b48a-8cf9709e1ffb] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:34.752982 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-07a76104-f128-42a2-971f-d9748d7dfcb5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:34.754134 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8baa97ea-e75a-4a7e-95b0-f31f09120d51 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:34.754596 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8baa97ea-e75a-4a7e-95b0-f31f09120d51 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:34.757170 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8baa97ea-e75a-4a7e-95b0-f31f09120d51 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:34.757616 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8baa97ea-e75a-4a7e-95b0-f31f09120d51 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:34.772839 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-07a76104-f128-42a2-971f-d9748d7dfcb5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:34.774627 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-07a76104-f128-42a2-971f-d9748d7dfcb5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:34.776053 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-07a76104-f128-42a2-971f-d9748d7dfcb5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.734247 Jul 23 21:32:34.791755 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2337/4603] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:32:34 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:32:34.816184 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-8baa97ea-e75a-4a7e-95b0-f31f09120d51 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] HTTP exception thrown: Instance dcc206d0-3170-459e-b48a-8cf9709e1ffb could not be found. Jul 23 21:32:34.818624 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8baa97ea-e75a-4a7e-95b0-f31f09120d51 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Request method failure captured: Jul 23 21:32:34.818624 ncdv-master-1 devstack@n-api.service[131320]: request: DELETE /compute/v2.1/servers/dcc206d0-3170-459e-b48a-8cf9709e1ffb HTTP/1.1 Jul 23 21:32:34.818624 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:32:34.818624 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:32:34.818624 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:32:34.818624 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:32:34.818624 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:32:34.818624 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:32:34.818624 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:32:34.818624 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:32:34.818624 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GgexSaJTA-FXaV5LcqTAteOVESwOg7zac7nwUa59CGOHDwwWd7w7HKC8R65F9X48OwLZ_a8UsJYui6X5BG5uL_WJC-ysEg9nxrojp43TnKgPHTkujcdOw9VWLxqM9CE8dPwhawUMo8jE8x_rLu-o0j9Xf_QveShH-OlX4BIDLcYoyo Jul 23 21:32:34.818624 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:32:34.818624 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:32:34.818624 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:32:34.818624 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:32:34.818624 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:32:34.818624 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:32:34.818624 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 1890022bd460485dae0ea94b152a6746 Jul 23 21:32:34.818624 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServersTestJSON-1141465764 Jul 23 21:32:34.818624 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:32:34.818624 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:32:34.818624 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1890022bd460485dae0ea94b152a6746"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1890022bd460485dae0ea94b152a6746"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1890022bd460485dae0ea94b152a6746", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1890022bd460485dae0ea94b152a6746"}]}] Jul 23 21:32:34.818624 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServersTestJSON-1141465764 Jul 23 21:32:34.818624 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 1890022bd460485dae0ea94b152a6746 Jul 23 21:32:34.818624 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServersTestJSON-1141465764 Jul 23 21:32:34.818624 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServersTestJSON-1141465764-project Jul 23 21:32:34.818624 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:32:34.818624 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:32:34.818624 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 5efda1c40f494592bf1e6af1add120f3 Jul 23 21:32:34.818624 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServersTestJSON-1141465764-project Jul 23 21:32:34.818624 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:32:34.818624 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance dcc206d0-3170-459e-b48a-8cf9709e1ffb could not be found. Jul 23 21:32:34.818624 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': 'dcc206d0-3170-459e-b48a-8cf9709e1ffb'} Jul 23 21:32:34.818624 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:32:34.818624 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:32:34.818624 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:32:34.818624 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:32:34.818624 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:32:34.818624 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:32:34.818624 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:32:34.818624 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:32:34.818624 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:32:34.818624 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:32:34.818624 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcc206d0-3170-459e-b48a-8cf9709e1ffb could not be found. Jul 23 21:32:34.818624 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:32:34.818624 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:32:34.818624 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:32:34.818624 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:32:34.818624 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:32:34.818624 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:32:34.818624 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:32:34.818624 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:32:34.818624 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:32:34.818624 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:32:34.818624 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 23 21:32:34.818624 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 23 21:32:34.818624 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 23 21:32:34.818624 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 23 21:32:34.818624 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:32:34.818624 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:32:34.818624 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:32:34.818624 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:32:34.818624 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcc206d0-3170-459e-b48a-8cf9709e1ffb could not be found. Jul 23 21:32:34.822760 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:32:34.822760 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:32:34.822760 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:32:34.822760 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:32:34.822760 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:32:34.822760 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:32:34.822760 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:32:34.822760 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:32:34.822760 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcc206d0-3170-459e-b48a-8cf9709e1ffb could not be found. Jul 23 21:32:34.822760 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:32:34.825981 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8baa97ea-e75a-4a7e-95b0-f31f09120d51 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Returning 404 to user: Instance dcc206d0-3170-459e-b48a-8cf9709e1ffb could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:32:34.828003 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8baa97ea-e75a-4a7e-95b0-f31f09120d51 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "DELETE /compute/v2.1/servers/dcc206d0-3170-459e-b48a-8cf9709e1ffb" status: 404 len: 111 microversion: 2.1 time: 0.123067 Jul 23 21:32:34.832493 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2267/4604] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:32:34 2022] DELETE /compute/v2.1/servers/dcc206d0-3170-459e-b48a-8cf9709e1ffb => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:32:34.837100 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-1c446670-5ebd-4ab2-8fa0-b51933541163 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:34.837966 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-1c446670-5ebd-4ab2-8fa0-b51933541163 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: dcc206d0-3170-459e-b48a-8cf9709e1ffb] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:34.851221 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1c446670-5ebd-4ab2-8fa0-b51933541163 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:34.851704 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1c446670-5ebd-4ab2-8fa0-b51933541163 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:34.852551 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1c446670-5ebd-4ab2-8fa0-b51933541163 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:34.862624 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1c446670-5ebd-4ab2-8fa0-b51933541163 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:34.877848 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-1c446670-5ebd-4ab2-8fa0-b51933541163 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] HTTP exception thrown: Instance dcc206d0-3170-459e-b48a-8cf9709e1ffb could not be found. Jul 23 21:32:34.884181 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-1c446670-5ebd-4ab2-8fa0-b51933541163 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Request method failure captured: Jul 23 21:32:34.884181 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/servers/dcc206d0-3170-459e-b48a-8cf9709e1ffb HTTP/1.1 Jul 23 21:32:34.884181 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:32:34.884181 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:32:34.884181 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:32:34.884181 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:32:34.884181 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:32:34.884181 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:32:34.884181 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:32:34.884181 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:32:34.884181 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GgexSaJTA-FXaV5LcqTAteOVESwOg7zac7nwUa59CGOHDwwWd7w7HKC8R65F9X48OwLZ_a8UsJYui6X5BG5uL_WJC-ysEg9nxrojp43TnKgPHTkujcdOw9VWLxqM9CE8dPwhawUMo8jE8x_rLu-o0j9Xf_QveShH-OlX4BIDLcYoyo Jul 23 21:32:34.884181 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:32:34.884181 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:32:34.884181 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:32:34.884181 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:32:34.884181 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:32:34.884181 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:32:34.884181 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 1890022bd460485dae0ea94b152a6746 Jul 23 21:32:34.884181 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ServersTestJSON-1141465764 Jul 23 21:32:34.884181 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:32:34.884181 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:32:34.884181 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1890022bd460485dae0ea94b152a6746"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1890022bd460485dae0ea94b152a6746"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1890022bd460485dae0ea94b152a6746", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1890022bd460485dae0ea94b152a6746"}]}] Jul 23 21:32:34.884181 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ServersTestJSON-1141465764 Jul 23 21:32:34.884181 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 1890022bd460485dae0ea94b152a6746 Jul 23 21:32:34.884181 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ServersTestJSON-1141465764 Jul 23 21:32:34.884181 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ServersTestJSON-1141465764-project Jul 23 21:32:34.884181 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:32:34.884181 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:32:34.884181 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 5efda1c40f494592bf1e6af1add120f3 Jul 23 21:32:34.884181 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ServersTestJSON-1141465764-project Jul 23 21:32:34.884181 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:32:34.884181 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance dcc206d0-3170-459e-b48a-8cf9709e1ffb could not be found. Jul 23 21:32:34.884181 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': 'dcc206d0-3170-459e-b48a-8cf9709e1ffb'} Jul 23 21:32:34.884181 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:32:34.884181 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:32:34.884181 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:32:34.884181 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:32:34.884181 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:32:34.884181 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:32:34.884181 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:32:34.884181 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:32:34.884181 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:32:34.884181 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:32:34.884181 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcc206d0-3170-459e-b48a-8cf9709e1ffb could not be found. Jul 23 21:32:34.884181 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:32:34.884181 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:32:34.884181 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:32:34.884181 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:32:34.884181 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:32:34.884181 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:32:34.884181 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:32:34.884181 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:32:34.884181 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:32:34.884181 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:32:34.884181 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:32:34.884181 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:32:34.884181 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:32:34.884181 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:32:34.884181 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:32:34.884181 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:32:34.884181 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcc206d0-3170-459e-b48a-8cf9709e1ffb could not be found. Jul 23 21:32:34.884181 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:32:34.884181 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:32:34.884181 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:32:34.884181 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:32:34.889084 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:32:34.889084 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:32:34.889084 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:32:34.889084 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:32:34.889084 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcc206d0-3170-459e-b48a-8cf9709e1ffb could not be found. Jul 23 21:32:34.889084 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:32:34.889084 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-1c446670-5ebd-4ab2-8fa0-b51933541163 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Returning 404 to user: Instance dcc206d0-3170-459e-b48a-8cf9709e1ffb could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:32:34.889084 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-1c446670-5ebd-4ab2-8fa0-b51933541163 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/dcc206d0-3170-459e-b48a-8cf9709e1ffb" status: 404 len: 111 microversion: 2.1 time: 0.053739 Jul 23 21:32:34.895931 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-21e5ec11-8503-4c23-9199-a9d5e7a1ca21 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:34.896607 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-21e5ec11-8503-4c23-9199-a9d5e7a1ca21 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: b83d31c6-561b-47f9-a17b-377c54728c08] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:34.901946 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2338/4605] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:34 2022] GET /compute/v2.1/servers/dcc206d0-3170-459e-b48a-8cf9709e1ffb => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 23 21:32:34.904605 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-21e5ec11-8503-4c23-9199-a9d5e7a1ca21 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:34.905062 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-21e5ec11-8503-4c23-9199-a9d5e7a1ca21 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:34.905853 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-21e5ec11-8503-4c23-9199-a9d5e7a1ca21 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:34.906671 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-21e5ec11-8503-4c23-9199-a9d5e7a1ca21 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:34.952933 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-21e5ec11-8503-4c23-9199-a9d5e7a1ca21 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] HTTP exception thrown: Instance b83d31c6-561b-47f9-a17b-377c54728c08 could not be found. Jul 23 21:32:34.955184 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-21e5ec11-8503-4c23-9199-a9d5e7a1ca21 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Request method failure captured: Jul 23 21:32:34.955184 ncdv-master-1 devstack@n-api.service[131320]: request: DELETE /compute/v2.1/servers/b83d31c6-561b-47f9-a17b-377c54728c08 HTTP/1.1 Jul 23 21:32:34.955184 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:32:34.955184 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:32:34.955184 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:32:34.955184 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:32:34.955184 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:32:34.955184 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:32:34.955184 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:32:34.955184 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:32:34.955184 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GgexSaJTA-FXaV5LcqTAteOVESwOg7zac7nwUa59CGOHDwwWd7w7HKC8R65F9X48OwLZ_a8UsJYui6X5BG5uL_WJC-ysEg9nxrojp43TnKgPHTkujcdOw9VWLxqM9CE8dPwhawUMo8jE8x_rLu-o0j9Xf_QveShH-OlX4BIDLcYoyo Jul 23 21:32:34.955184 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:32:34.955184 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:32:34.955184 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:32:34.955184 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:32:34.955184 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:32:34.955184 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:32:34.955184 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 1890022bd460485dae0ea94b152a6746 Jul 23 21:32:34.955184 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServersTestJSON-1141465764 Jul 23 21:32:34.955184 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:32:34.955184 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:32:34.955184 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1890022bd460485dae0ea94b152a6746"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1890022bd460485dae0ea94b152a6746"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1890022bd460485dae0ea94b152a6746", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1890022bd460485dae0ea94b152a6746"}]}] Jul 23 21:32:34.955184 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServersTestJSON-1141465764 Jul 23 21:32:34.955184 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 1890022bd460485dae0ea94b152a6746 Jul 23 21:32:34.955184 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServersTestJSON-1141465764 Jul 23 21:32:34.955184 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServersTestJSON-1141465764-project Jul 23 21:32:34.955184 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:32:34.955184 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:32:34.955184 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 5efda1c40f494592bf1e6af1add120f3 Jul 23 21:32:34.955184 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServersTestJSON-1141465764-project Jul 23 21:32:34.955184 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:32:34.955184 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance b83d31c6-561b-47f9-a17b-377c54728c08 could not be found. Jul 23 21:32:34.955184 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': 'b83d31c6-561b-47f9-a17b-377c54728c08'} Jul 23 21:32:34.955184 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:32:34.955184 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:32:34.955184 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:32:34.955184 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:32:34.955184 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:32:34.955184 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:32:34.955184 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:32:34.955184 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:32:34.955184 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:32:34.955184 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:32:34.955184 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b83d31c6-561b-47f9-a17b-377c54728c08 could not be found. Jul 23 21:32:34.955184 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:32:34.955184 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:32:34.955184 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:32:34.955184 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:32:34.955184 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:32:34.955184 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:32:34.955184 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:32:34.955184 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:32:34.955184 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:32:34.955184 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:32:34.955184 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 23 21:32:34.955184 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 23 21:32:34.955184 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 23 21:32:34.955184 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 23 21:32:34.955184 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:32:34.955184 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:32:34.955184 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:32:34.955184 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:32:34.955184 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b83d31c6-561b-47f9-a17b-377c54728c08 could not be found. Jul 23 21:32:34.961741 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:32:34.961741 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:32:34.961741 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:32:34.961741 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:32:34.961741 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:32:34.961741 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:32:34.961741 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:32:34.961741 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:32:34.961741 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b83d31c6-561b-47f9-a17b-377c54728c08 could not be found. Jul 23 21:32:34.961741 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:32:34.965404 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-21e5ec11-8503-4c23-9199-a9d5e7a1ca21 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Returning 404 to user: Instance b83d31c6-561b-47f9-a17b-377c54728c08 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:32:34.967058 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-21e5ec11-8503-4c23-9199-a9d5e7a1ca21 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "DELETE /compute/v2.1/servers/b83d31c6-561b-47f9-a17b-377c54728c08" status: 404 len: 111 microversion: 2.1 time: 0.074838 Jul 23 21:32:34.967678 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2268/4606] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:32:34 2022] DELETE /compute/v2.1/servers/b83d31c6-561b-47f9-a17b-377c54728c08 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:32:34.979625 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f04f09a5-36f8-4fea-b993-9e4754906371 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:34.980565 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-f04f09a5-36f8-4fea-b993-9e4754906371 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: b83d31c6-561b-47f9-a17b-377c54728c08] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:34.990087 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f04f09a5-36f8-4fea-b993-9e4754906371 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:34.990718 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f04f09a5-36f8-4fea-b993-9e4754906371 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:34.992358 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f04f09a5-36f8-4fea-b993-9e4754906371 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:34.992879 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f04f09a5-36f8-4fea-b993-9e4754906371 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:35.010719 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-f04f09a5-36f8-4fea-b993-9e4754906371 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] HTTP exception thrown: Instance b83d31c6-561b-47f9-a17b-377c54728c08 could not be found. Jul 23 21:32:35.012535 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f04f09a5-36f8-4fea-b993-9e4754906371 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Request method failure captured: Jul 23 21:32:35.012535 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/servers/b83d31c6-561b-47f9-a17b-377c54728c08 HTTP/1.1 Jul 23 21:32:35.012535 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:32:35.012535 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:32:35.012535 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:32:35.012535 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:32:35.012535 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:32:35.012535 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:32:35.012535 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:32:35.012535 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:32:35.012535 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GgexSaJTA-FXaV5LcqTAteOVESwOg7zac7nwUa59CGOHDwwWd7w7HKC8R65F9X48OwLZ_a8UsJYui6X5BG5uL_WJC-ysEg9nxrojp43TnKgPHTkujcdOw9VWLxqM9CE8dPwhawUMo8jE8x_rLu-o0j9Xf_QveShH-OlX4BIDLcYoyo Jul 23 21:32:35.012535 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:32:35.012535 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:32:35.012535 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:32:35.012535 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:32:35.012535 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:32:35.012535 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:32:35.012535 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 1890022bd460485dae0ea94b152a6746 Jul 23 21:32:35.012535 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ServersTestJSON-1141465764 Jul 23 21:32:35.012535 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:32:35.012535 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:32:35.012535 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1890022bd460485dae0ea94b152a6746"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1890022bd460485dae0ea94b152a6746"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1890022bd460485dae0ea94b152a6746", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1890022bd460485dae0ea94b152a6746"}]}] Jul 23 21:32:35.012535 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ServersTestJSON-1141465764 Jul 23 21:32:35.012535 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 1890022bd460485dae0ea94b152a6746 Jul 23 21:32:35.012535 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ServersTestJSON-1141465764 Jul 23 21:32:35.012535 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ServersTestJSON-1141465764-project Jul 23 21:32:35.012535 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:32:35.012535 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:32:35.012535 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 5efda1c40f494592bf1e6af1add120f3 Jul 23 21:32:35.012535 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ServersTestJSON-1141465764-project Jul 23 21:32:35.012535 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:32:35.012535 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance b83d31c6-561b-47f9-a17b-377c54728c08 could not be found. Jul 23 21:32:35.012535 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': 'b83d31c6-561b-47f9-a17b-377c54728c08'} Jul 23 21:32:35.012535 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:32:35.012535 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:32:35.012535 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:32:35.012535 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:32:35.012535 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:32:35.012535 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:32:35.012535 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:32:35.012535 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:32:35.012535 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:32:35.012535 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:32:35.012535 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b83d31c6-561b-47f9-a17b-377c54728c08 could not be found. Jul 23 21:32:35.012535 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:32:35.012535 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:32:35.012535 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:32:35.012535 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:32:35.012535 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:32:35.012535 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:32:35.012535 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:32:35.012535 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:32:35.012535 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:32:35.012535 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:32:35.012535 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:32:35.012535 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:32:35.012535 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:32:35.012535 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:32:35.012535 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:32:35.012535 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:32:35.012535 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b83d31c6-561b-47f9-a17b-377c54728c08 could not be found. Jul 23 21:32:35.012535 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:32:35.012535 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:32:35.012535 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:32:35.012535 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:32:35.018639 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:32:35.018639 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:32:35.018639 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:32:35.018639 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:32:35.018639 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b83d31c6-561b-47f9-a17b-377c54728c08 could not be found. Jul 23 21:32:35.018639 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:32:35.022380 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f04f09a5-36f8-4fea-b993-9e4754906371 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Returning 404 to user: Instance b83d31c6-561b-47f9-a17b-377c54728c08 could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:32:35.022676 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-f04f09a5-36f8-4fea-b993-9e4754906371 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/b83d31c6-561b-47f9-a17b-377c54728c08" status: 404 len: 111 microversion: 2.1 time: 0.049653 Jul 23 21:32:35.027115 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2339/4607] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:34 2022] GET /compute/v2.1/servers/b83d31c6-561b-47f9-a17b-377c54728c08 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:32:35.032768 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-de61071d-8d0c-4e30-96f0-a973ec6022a2 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:35.033191 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-de61071d-8d0c-4e30-96f0-a973ec6022a2 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: fc75dd20-e6e4-4484-b715-2251c593c9e5] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:35.053288 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-de61071d-8d0c-4e30-96f0-a973ec6022a2 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:35.053768 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-de61071d-8d0c-4e30-96f0-a973ec6022a2 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:35.058843 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-de61071d-8d0c-4e30-96f0-a973ec6022a2 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:35.059312 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-de61071d-8d0c-4e30-96f0-a973ec6022a2 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:35.086565 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-de61071d-8d0c-4e30-96f0-a973ec6022a2 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] HTTP exception thrown: Instance fc75dd20-e6e4-4484-b715-2251c593c9e5 could not be found. Jul 23 21:32:35.088542 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-de61071d-8d0c-4e30-96f0-a973ec6022a2 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Request method failure captured: Jul 23 21:32:35.088542 ncdv-master-1 devstack@n-api.service[131320]: request: DELETE /compute/v2.1/servers/fc75dd20-e6e4-4484-b715-2251c593c9e5 HTTP/1.1 Jul 23 21:32:35.088542 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:32:35.088542 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:32:35.088542 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:32:35.088542 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:32:35.088542 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:32:35.088542 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:32:35.088542 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:32:35.088542 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:32:35.088542 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GgexSaJTA-FXaV5LcqTAteOVESwOg7zac7nwUa59CGOHDwwWd7w7HKC8R65F9X48OwLZ_a8UsJYui6X5BG5uL_WJC-ysEg9nxrojp43TnKgPHTkujcdOw9VWLxqM9CE8dPwhawUMo8jE8x_rLu-o0j9Xf_QveShH-OlX4BIDLcYoyo Jul 23 21:32:35.088542 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:32:35.088542 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:32:35.088542 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:32:35.088542 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:32:35.088542 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:32:35.088542 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:32:35.088542 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 1890022bd460485dae0ea94b152a6746 Jul 23 21:32:35.088542 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServersTestJSON-1141465764 Jul 23 21:32:35.088542 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:32:35.088542 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:32:35.088542 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1890022bd460485dae0ea94b152a6746"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1890022bd460485dae0ea94b152a6746"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1890022bd460485dae0ea94b152a6746", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1890022bd460485dae0ea94b152a6746"}]}] Jul 23 21:32:35.088542 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServersTestJSON-1141465764 Jul 23 21:32:35.088542 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 1890022bd460485dae0ea94b152a6746 Jul 23 21:32:35.088542 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServersTestJSON-1141465764 Jul 23 21:32:35.088542 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServersTestJSON-1141465764-project Jul 23 21:32:35.088542 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:32:35.088542 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:32:35.088542 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 5efda1c40f494592bf1e6af1add120f3 Jul 23 21:32:35.088542 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServersTestJSON-1141465764-project Jul 23 21:32:35.088542 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:32:35.088542 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance fc75dd20-e6e4-4484-b715-2251c593c9e5 could not be found. Jul 23 21:32:35.088542 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': 'fc75dd20-e6e4-4484-b715-2251c593c9e5'} Jul 23 21:32:35.088542 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:32:35.088542 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:32:35.088542 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:32:35.088542 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:32:35.088542 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:32:35.088542 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:32:35.088542 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:32:35.088542 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:32:35.088542 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:32:35.088542 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:32:35.088542 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc75dd20-e6e4-4484-b715-2251c593c9e5 could not be found. Jul 23 21:32:35.088542 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:32:35.088542 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:32:35.088542 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:32:35.088542 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:32:35.088542 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:32:35.088542 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:32:35.088542 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:32:35.088542 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:32:35.088542 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:32:35.088542 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:32:35.088542 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 23 21:32:35.088542 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 23 21:32:35.088542 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 23 21:32:35.088542 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 23 21:32:35.088542 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:32:35.088542 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:32:35.088542 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:32:35.088542 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:32:35.088542 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc75dd20-e6e4-4484-b715-2251c593c9e5 could not be found. Jul 23 21:32:35.093903 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:32:35.093903 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:32:35.093903 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:32:35.093903 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:32:35.093903 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:32:35.093903 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:32:35.093903 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:32:35.093903 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:32:35.093903 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc75dd20-e6e4-4484-b715-2251c593c9e5 could not be found. Jul 23 21:32:35.093903 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:32:35.102932 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-de61071d-8d0c-4e30-96f0-a973ec6022a2 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Returning 404 to user: Instance fc75dd20-e6e4-4484-b715-2251c593c9e5 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:32:35.103160 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-de61071d-8d0c-4e30-96f0-a973ec6022a2 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "DELETE /compute/v2.1/servers/fc75dd20-e6e4-4484-b715-2251c593c9e5" status: 404 len: 111 microversion: 2.1 time: 0.075010 Jul 23 21:32:35.104086 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2269/4608] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:32:35 2022] DELETE /compute/v2.1/servers/fc75dd20-e6e4-4484-b715-2251c593c9e5 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 23 21:32:35.112903 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c3531117-43a4-4fb7-a1bc-9f0bf455b7e7 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:35.113532 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-c3531117-43a4-4fb7-a1bc-9f0bf455b7e7 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: fc75dd20-e6e4-4484-b715-2251c593c9e5] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:35.120143 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c3531117-43a4-4fb7-a1bc-9f0bf455b7e7 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:35.127963 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c3531117-43a4-4fb7-a1bc-9f0bf455b7e7 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:35.130265 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c3531117-43a4-4fb7-a1bc-9f0bf455b7e7 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:35.131110 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c3531117-43a4-4fb7-a1bc-9f0bf455b7e7 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:35.156693 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-c3531117-43a4-4fb7-a1bc-9f0bf455b7e7 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] HTTP exception thrown: Instance fc75dd20-e6e4-4484-b715-2251c593c9e5 could not be found. Jul 23 21:32:35.158918 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c3531117-43a4-4fb7-a1bc-9f0bf455b7e7 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Request method failure captured: Jul 23 21:32:35.158918 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/servers/fc75dd20-e6e4-4484-b715-2251c593c9e5 HTTP/1.1 Jul 23 21:32:35.158918 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:32:35.158918 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:32:35.158918 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:32:35.158918 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:32:35.158918 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:32:35.158918 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:32:35.158918 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:32:35.158918 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:32:35.158918 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GgexSaJTA-FXaV5LcqTAteOVESwOg7zac7nwUa59CGOHDwwWd7w7HKC8R65F9X48OwLZ_a8UsJYui6X5BG5uL_WJC-ysEg9nxrojp43TnKgPHTkujcdOw9VWLxqM9CE8dPwhawUMo8jE8x_rLu-o0j9Xf_QveShH-OlX4BIDLcYoyo Jul 23 21:32:35.158918 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:32:35.158918 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:32:35.158918 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:32:35.158918 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:32:35.158918 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:32:35.158918 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:32:35.158918 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 1890022bd460485dae0ea94b152a6746 Jul 23 21:32:35.158918 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ServersTestJSON-1141465764 Jul 23 21:32:35.158918 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:32:35.158918 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:32:35.158918 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1890022bd460485dae0ea94b152a6746"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1890022bd460485dae0ea94b152a6746"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1890022bd460485dae0ea94b152a6746", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1890022bd460485dae0ea94b152a6746"}]}] Jul 23 21:32:35.158918 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ServersTestJSON-1141465764 Jul 23 21:32:35.158918 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 1890022bd460485dae0ea94b152a6746 Jul 23 21:32:35.158918 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ServersTestJSON-1141465764 Jul 23 21:32:35.158918 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ServersTestJSON-1141465764-project Jul 23 21:32:35.158918 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:32:35.158918 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:32:35.158918 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 5efda1c40f494592bf1e6af1add120f3 Jul 23 21:32:35.158918 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ServersTestJSON-1141465764-project Jul 23 21:32:35.158918 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:32:35.158918 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance fc75dd20-e6e4-4484-b715-2251c593c9e5 could not be found. Jul 23 21:32:35.158918 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': 'fc75dd20-e6e4-4484-b715-2251c593c9e5'} Jul 23 21:32:35.158918 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:32:35.158918 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:32:35.158918 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:32:35.158918 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:32:35.158918 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:32:35.158918 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:32:35.158918 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:32:35.158918 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:32:35.158918 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:32:35.158918 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:32:35.158918 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc75dd20-e6e4-4484-b715-2251c593c9e5 could not be found. Jul 23 21:32:35.158918 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:32:35.158918 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:32:35.158918 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:32:35.158918 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:32:35.158918 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:32:35.158918 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:32:35.158918 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:32:35.158918 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:32:35.158918 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:32:35.158918 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:32:35.158918 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:32:35.158918 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:32:35.158918 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:32:35.158918 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:32:35.158918 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:32:35.158918 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:32:35.158918 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc75dd20-e6e4-4484-b715-2251c593c9e5 could not be found. Jul 23 21:32:35.158918 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:32:35.158918 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:32:35.158918 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:32:35.158918 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:32:35.163793 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:32:35.163793 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:32:35.163793 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:32:35.163793 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:32:35.163793 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc75dd20-e6e4-4484-b715-2251c593c9e5 could not be found. Jul 23 21:32:35.163793 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:32:35.164464 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4ec0f3c2-c868-4587-b6c8-8f61f07744b8 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:35.164464 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-4ec0f3c2-c868-4587-b6c8-8f61f07744b8 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:35.166547 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c3531117-43a4-4fb7-a1bc-9f0bf455b7e7 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Returning 404 to user: Instance fc75dd20-e6e4-4484-b715-2251c593c9e5 could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:32:35.167907 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-c3531117-43a4-4fb7-a1bc-9f0bf455b7e7 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/fc75dd20-e6e4-4484-b715-2251c593c9e5" status: 404 len: 111 microversion: 2.1 time: 0.059484 Jul 23 21:32:35.168958 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2340/4609] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:35 2022] GET /compute/v2.1/servers/fc75dd20-e6e4-4484-b715-2251c593c9e5 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:32:35.179647 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4ec0f3c2-c868-4587-b6c8-8f61f07744b8 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:35.180144 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4ec0f3c2-c868-4587-b6c8-8f61f07744b8 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:35.180889 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4ec0f3c2-c868-4587-b6c8-8f61f07744b8 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:35.181396 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4ec0f3c2-c868-4587-b6c8-8f61f07744b8 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:35.191706 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-44ebcdc2-544e-4cb7-a133-959209e61a68 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:35.192220 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-44ebcdc2-544e-4cb7-a133-959209e61a68 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: f685637e-a804-4266-81a2-67d2e11a60b0] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:35.202212 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-44ebcdc2-544e-4cb7-a133-959209e61a68 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:35.202662 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-44ebcdc2-544e-4cb7-a133-959209e61a68 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:35.203447 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-44ebcdc2-544e-4cb7-a133-959209e61a68 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:35.203882 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-44ebcdc2-544e-4cb7-a133-959209e61a68 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:35.254604 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-44ebcdc2-544e-4cb7-a133-959209e61a68 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] HTTP exception thrown: Instance f685637e-a804-4266-81a2-67d2e11a60b0 could not be found. Jul 23 21:32:35.259726 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-44ebcdc2-544e-4cb7-a133-959209e61a68 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Request method failure captured: Jul 23 21:32:35.259726 ncdv-master-1 devstack@n-api.service[131321]: request: DELETE /compute/v2.1/servers/f685637e-a804-4266-81a2-67d2e11a60b0 HTTP/1.1 Jul 23 21:32:35.259726 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:32:35.259726 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:32:35.259726 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:32:35.259726 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:32:35.259726 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:32:35.259726 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:32:35.259726 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:32:35.259726 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:32:35.259726 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GgexSaJTA-FXaV5LcqTAteOVESwOg7zac7nwUa59CGOHDwwWd7w7HKC8R65F9X48OwLZ_a8UsJYui6X5BG5uL_WJC-ysEg9nxrojp43TnKgPHTkujcdOw9VWLxqM9CE8dPwhawUMo8jE8x_rLu-o0j9Xf_QveShH-OlX4BIDLcYoyo Jul 23 21:32:35.259726 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:32:35.259726 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:32:35.259726 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:32:35.259726 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:32:35.259726 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:32:35.259726 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:32:35.259726 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 1890022bd460485dae0ea94b152a6746 Jul 23 21:32:35.259726 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ServersTestJSON-1141465764 Jul 23 21:32:35.259726 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:32:35.259726 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:32:35.259726 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1890022bd460485dae0ea94b152a6746"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1890022bd460485dae0ea94b152a6746"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1890022bd460485dae0ea94b152a6746", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1890022bd460485dae0ea94b152a6746"}]}] Jul 23 21:32:35.259726 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ServersTestJSON-1141465764 Jul 23 21:32:35.259726 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 1890022bd460485dae0ea94b152a6746 Jul 23 21:32:35.259726 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ServersTestJSON-1141465764 Jul 23 21:32:35.259726 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ServersTestJSON-1141465764-project Jul 23 21:32:35.259726 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:32:35.259726 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:32:35.259726 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 5efda1c40f494592bf1e6af1add120f3 Jul 23 21:32:35.259726 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ServersTestJSON-1141465764-project Jul 23 21:32:35.259726 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:32:35.259726 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance f685637e-a804-4266-81a2-67d2e11a60b0 could not be found. Jul 23 21:32:35.259726 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': 'f685637e-a804-4266-81a2-67d2e11a60b0'} Jul 23 21:32:35.259726 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:32:35.259726 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:32:35.259726 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:32:35.259726 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:32:35.259726 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:32:35.259726 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:32:35.259726 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:32:35.259726 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:32:35.259726 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:32:35.259726 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:32:35.259726 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f685637e-a804-4266-81a2-67d2e11a60b0 could not be found. Jul 23 21:32:35.259726 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:32:35.259726 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:32:35.259726 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:32:35.259726 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:32:35.259726 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:32:35.259726 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:32:35.259726 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:32:35.259726 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:32:35.259726 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:32:35.259726 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:32:35.259726 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 23 21:32:35.259726 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 23 21:32:35.259726 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 23 21:32:35.259726 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 23 21:32:35.259726 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:32:35.259726 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:32:35.259726 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:32:35.259726 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:32:35.259726 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f685637e-a804-4266-81a2-67d2e11a60b0 could not be found. Jul 23 21:32:35.263769 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:32:35.263769 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:32:35.263769 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:32:35.263769 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:32:35.263769 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:32:35.263769 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:32:35.263769 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:32:35.263769 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:32:35.263769 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f685637e-a804-4266-81a2-67d2e11a60b0 could not be found. Jul 23 21:32:35.263769 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:32:35.266456 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-44ebcdc2-544e-4cb7-a133-959209e61a68 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Returning 404 to user: Instance f685637e-a804-4266-81a2-67d2e11a60b0 could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:32:35.268668 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-44ebcdc2-544e-4cb7-a133-959209e61a68 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "DELETE /compute/v2.1/servers/f685637e-a804-4266-81a2-67d2e11a60b0" status: 404 len: 111 microversion: 2.1 time: 0.091048 Jul 23 21:32:35.272787 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2341/4610] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:32:35 2022] DELETE /compute/v2.1/servers/f685637e-a804-4266-81a2-67d2e11a60b0 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:32:35.280751 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-31ed5196-c116-4ec5-b119-3df3470c3d9e tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:35.281764 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-31ed5196-c116-4ec5-b119-3df3470c3d9e tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: f685637e-a804-4266-81a2-67d2e11a60b0] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:35.301372 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-31ed5196-c116-4ec5-b119-3df3470c3d9e tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:35.302189 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-31ed5196-c116-4ec5-b119-3df3470c3d9e tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:35.303194 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-31ed5196-c116-4ec5-b119-3df3470c3d9e tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:35.303811 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-31ed5196-c116-4ec5-b119-3df3470c3d9e tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:35.340671 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-31ed5196-c116-4ec5-b119-3df3470c3d9e tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] HTTP exception thrown: Instance f685637e-a804-4266-81a2-67d2e11a60b0 could not be found. Jul 23 21:32:35.342716 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-31ed5196-c116-4ec5-b119-3df3470c3d9e tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Request method failure captured: Jul 23 21:32:35.342716 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/servers/f685637e-a804-4266-81a2-67d2e11a60b0 HTTP/1.1 Jul 23 21:32:35.342716 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:32:35.342716 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:32:35.342716 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:32:35.342716 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:32:35.342716 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:32:35.342716 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:32:35.342716 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:32:35.342716 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:32:35.342716 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GgexSaJTA-FXaV5LcqTAteOVESwOg7zac7nwUa59CGOHDwwWd7w7HKC8R65F9X48OwLZ_a8UsJYui6X5BG5uL_WJC-ysEg9nxrojp43TnKgPHTkujcdOw9VWLxqM9CE8dPwhawUMo8jE8x_rLu-o0j9Xf_QveShH-OlX4BIDLcYoyo Jul 23 21:32:35.342716 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:32:35.342716 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:32:35.342716 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:32:35.342716 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:32:35.342716 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:32:35.342716 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:32:35.342716 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 1890022bd460485dae0ea94b152a6746 Jul 23 21:32:35.342716 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ServersTestJSON-1141465764 Jul 23 21:32:35.342716 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:32:35.342716 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:32:35.342716 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1890022bd460485dae0ea94b152a6746"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1890022bd460485dae0ea94b152a6746"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1890022bd460485dae0ea94b152a6746", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1890022bd460485dae0ea94b152a6746"}]}] Jul 23 21:32:35.342716 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ServersTestJSON-1141465764 Jul 23 21:32:35.342716 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 1890022bd460485dae0ea94b152a6746 Jul 23 21:32:35.342716 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ServersTestJSON-1141465764 Jul 23 21:32:35.342716 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ServersTestJSON-1141465764-project Jul 23 21:32:35.342716 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:32:35.342716 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:32:35.342716 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 5efda1c40f494592bf1e6af1add120f3 Jul 23 21:32:35.342716 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ServersTestJSON-1141465764-project Jul 23 21:32:35.342716 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:32:35.342716 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance f685637e-a804-4266-81a2-67d2e11a60b0 could not be found. Jul 23 21:32:35.342716 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': 'f685637e-a804-4266-81a2-67d2e11a60b0'} Jul 23 21:32:35.342716 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:32:35.342716 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:32:35.342716 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:32:35.342716 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:32:35.342716 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:32:35.342716 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:32:35.342716 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:32:35.342716 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:32:35.342716 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:32:35.342716 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:32:35.342716 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f685637e-a804-4266-81a2-67d2e11a60b0 could not be found. Jul 23 21:32:35.342716 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:32:35.342716 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:32:35.342716 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:32:35.342716 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:32:35.342716 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:32:35.342716 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:32:35.342716 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:32:35.342716 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:32:35.342716 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:32:35.342716 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:32:35.342716 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:32:35.342716 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:32:35.342716 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:32:35.342716 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:32:35.342716 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:32:35.342716 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:32:35.342716 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f685637e-a804-4266-81a2-67d2e11a60b0 could not be found. Jul 23 21:32:35.342716 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:32:35.342716 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:32:35.342716 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:32:35.342716 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:32:35.347789 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:32:35.347789 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:32:35.347789 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:32:35.347789 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:32:35.347789 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f685637e-a804-4266-81a2-67d2e11a60b0 could not be found. Jul 23 21:32:35.347789 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:32:35.350475 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-31ed5196-c116-4ec5-b119-3df3470c3d9e tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Returning 404 to user: Instance f685637e-a804-4266-81a2-67d2e11a60b0 could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:32:35.351618 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-31ed5196-c116-4ec5-b119-3df3470c3d9e tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/f685637e-a804-4266-81a2-67d2e11a60b0" status: 404 len: 111 microversion: 2.1 time: 0.075503 Jul 23 21:32:35.352413 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2342/4611] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:35 2022] GET /compute/v2.1/servers/f685637e-a804-4266-81a2-67d2e11a60b0 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:32:35.361461 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-dbea0b86-ac68-4852-8239-4b1e5448bc89 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:35.362379 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-dbea0b86-ac68-4852-8239-4b1e5448bc89 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: d6770104-2850-4914-b129-c3dd3544bfb6] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:35.380809 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-dbea0b86-ac68-4852-8239-4b1e5448bc89 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:35.381271 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-dbea0b86-ac68-4852-8239-4b1e5448bc89 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:35.382109 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-dbea0b86-ac68-4852-8239-4b1e5448bc89 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:35.392157 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-dbea0b86-ac68-4852-8239-4b1e5448bc89 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:35.438195 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-dbea0b86-ac68-4852-8239-4b1e5448bc89 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] HTTP exception thrown: Instance d6770104-2850-4914-b129-c3dd3544bfb6 could not be found. Jul 23 21:32:35.438738 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-4ec0f3c2-c868-4587-b6c8-8f61f07744b8 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:35.440927 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-dbea0b86-ac68-4852-8239-4b1e5448bc89 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Request method failure captured: Jul 23 21:32:35.440927 ncdv-master-1 devstack@n-api.service[131321]: request: DELETE /compute/v2.1/servers/d6770104-2850-4914-b129-c3dd3544bfb6 HTTP/1.1 Jul 23 21:32:35.440927 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:32:35.440927 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:32:35.440927 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:32:35.440927 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:32:35.440927 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:32:35.440927 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:32:35.440927 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:32:35.440927 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:32:35.440927 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GgexSaJTA-FXaV5LcqTAteOVESwOg7zac7nwUa59CGOHDwwWd7w7HKC8R65F9X48OwLZ_a8UsJYui6X5BG5uL_WJC-ysEg9nxrojp43TnKgPHTkujcdOw9VWLxqM9CE8dPwhawUMo8jE8x_rLu-o0j9Xf_QveShH-OlX4BIDLcYoyo Jul 23 21:32:35.440927 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:32:35.440927 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:32:35.440927 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:32:35.440927 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:32:35.440927 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:32:35.440927 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:32:35.440927 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 1890022bd460485dae0ea94b152a6746 Jul 23 21:32:35.440927 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ServersTestJSON-1141465764 Jul 23 21:32:35.440927 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:32:35.440927 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:32:35.440927 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1890022bd460485dae0ea94b152a6746"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1890022bd460485dae0ea94b152a6746"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1890022bd460485dae0ea94b152a6746", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1890022bd460485dae0ea94b152a6746"}]}] Jul 23 21:32:35.440927 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ServersTestJSON-1141465764 Jul 23 21:32:35.440927 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 1890022bd460485dae0ea94b152a6746 Jul 23 21:32:35.440927 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ServersTestJSON-1141465764 Jul 23 21:32:35.440927 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ServersTestJSON-1141465764-project Jul 23 21:32:35.440927 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:32:35.440927 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:32:35.440927 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 5efda1c40f494592bf1e6af1add120f3 Jul 23 21:32:35.440927 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ServersTestJSON-1141465764-project Jul 23 21:32:35.440927 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:32:35.440927 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance d6770104-2850-4914-b129-c3dd3544bfb6 could not be found. Jul 23 21:32:35.440927 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': 'd6770104-2850-4914-b129-c3dd3544bfb6'} Jul 23 21:32:35.440927 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:32:35.440927 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:32:35.440927 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:32:35.440927 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:32:35.440927 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:32:35.440927 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:32:35.440927 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:32:35.440927 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:32:35.440927 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:32:35.440927 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:32:35.440927 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6770104-2850-4914-b129-c3dd3544bfb6 could not be found. Jul 23 21:32:35.440927 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:32:35.440927 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:32:35.440927 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:32:35.440927 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:32:35.440927 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:32:35.440927 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:32:35.440927 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:32:35.440927 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:32:35.440927 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:32:35.440927 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:32:35.440927 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 23 21:32:35.440927 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 23 21:32:35.440927 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 23 21:32:35.440927 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 23 21:32:35.440927 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:32:35.440927 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:32:35.440927 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:32:35.440927 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:32:35.440927 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6770104-2850-4914-b129-c3dd3544bfb6 could not be found. Jul 23 21:32:35.444874 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:32:35.444874 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:32:35.444874 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:32:35.444874 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:32:35.444874 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:32:35.444874 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:32:35.444874 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:32:35.444874 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:32:35.444874 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6770104-2850-4914-b129-c3dd3544bfb6 could not be found. Jul 23 21:32:35.444874 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:32:35.444874 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-dbea0b86-ac68-4852-8239-4b1e5448bc89 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Returning 404 to user: Instance d6770104-2850-4914-b129-c3dd3544bfb6 could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:32:35.444874 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-dbea0b86-ac68-4852-8239-4b1e5448bc89 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d6770104-2850-4914-b129-c3dd3544bfb6" status: 404 len: 111 microversion: 2.1 time: 0.086209 Jul 23 21:32:35.449602 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2343/4612] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:32:35 2022] DELETE /compute/v2.1/servers/d6770104-2850-4914-b129-c3dd3544bfb6 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 23 21:32:35.456682 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4ec0f3c2-c868-4587-b6c8-8f61f07744b8 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1460 microversion: 2.1 time: 0.304468 Jul 23 21:32:35.465993 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2270/4613] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:35 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1460 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:32:35.466222 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-4973e025-6a18-4a17-88ce-3231b2923138 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:35.466222 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-4973e025-6a18-4a17-88ce-3231b2923138 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: d6770104-2850-4914-b129-c3dd3544bfb6] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:35.474466 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4973e025-6a18-4a17-88ce-3231b2923138 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:35.474926 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4973e025-6a18-4a17-88ce-3231b2923138 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:35.480030 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4973e025-6a18-4a17-88ce-3231b2923138 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:35.480490 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4973e025-6a18-4a17-88ce-3231b2923138 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:35.500237 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-483a6733-79ad-4136-83b2-fb02d9460d6a tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:35.500874 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-483a6733-79ad-4136-83b2-fb02d9460d6a tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] [instance: b0bb14c2-15df-4440-9d9c-4c6598867dfe] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:35.506951 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-4973e025-6a18-4a17-88ce-3231b2923138 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] HTTP exception thrown: Instance d6770104-2850-4914-b129-c3dd3544bfb6 could not be found. Jul 23 21:32:35.508535 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-4973e025-6a18-4a17-88ce-3231b2923138 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Request method failure captured: Jul 23 21:32:35.508535 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/servers/d6770104-2850-4914-b129-c3dd3544bfb6 HTTP/1.1 Jul 23 21:32:35.508535 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:32:35.508535 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:32:35.508535 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:32:35.508535 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:32:35.508535 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:32:35.508535 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:32:35.508535 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:32:35.508535 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:32:35.508535 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GgexSaJTA-FXaV5LcqTAteOVESwOg7zac7nwUa59CGOHDwwWd7w7HKC8R65F9X48OwLZ_a8UsJYui6X5BG5uL_WJC-ysEg9nxrojp43TnKgPHTkujcdOw9VWLxqM9CE8dPwhawUMo8jE8x_rLu-o0j9Xf_QveShH-OlX4BIDLcYoyo Jul 23 21:32:35.508535 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:32:35.508535 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:32:35.508535 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:32:35.508535 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:32:35.508535 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:32:35.508535 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:32:35.508535 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 1890022bd460485dae0ea94b152a6746 Jul 23 21:32:35.508535 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ServersTestJSON-1141465764 Jul 23 21:32:35.508535 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:32:35.508535 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:32:35.508535 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1890022bd460485dae0ea94b152a6746"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1890022bd460485dae0ea94b152a6746"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1890022bd460485dae0ea94b152a6746", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1890022bd460485dae0ea94b152a6746"}]}] Jul 23 21:32:35.508535 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ServersTestJSON-1141465764 Jul 23 21:32:35.508535 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 1890022bd460485dae0ea94b152a6746 Jul 23 21:32:35.508535 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ServersTestJSON-1141465764 Jul 23 21:32:35.508535 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ServersTestJSON-1141465764-project Jul 23 21:32:35.508535 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:32:35.508535 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:32:35.508535 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 5efda1c40f494592bf1e6af1add120f3 Jul 23 21:32:35.508535 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ServersTestJSON-1141465764-project Jul 23 21:32:35.508535 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:32:35.508535 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance d6770104-2850-4914-b129-c3dd3544bfb6 could not be found. Jul 23 21:32:35.508535 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': 'd6770104-2850-4914-b129-c3dd3544bfb6'} Jul 23 21:32:35.508535 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:32:35.508535 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:32:35.508535 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:32:35.508535 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:32:35.508535 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:32:35.508535 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:32:35.508535 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:32:35.508535 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:32:35.508535 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:32:35.508535 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:32:35.508535 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6770104-2850-4914-b129-c3dd3544bfb6 could not be found. Jul 23 21:32:35.508535 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:32:35.508535 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:32:35.508535 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:32:35.508535 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:32:35.508535 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:32:35.508535 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:32:35.508535 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:32:35.508535 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:32:35.508535 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:32:35.508535 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:32:35.508535 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:32:35.508535 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:32:35.508535 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:32:35.508535 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:32:35.508535 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:32:35.508535 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:32:35.508535 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6770104-2850-4914-b129-c3dd3544bfb6 could not be found. Jul 23 21:32:35.508535 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:32:35.508535 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:32:35.508535 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:32:35.508535 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:32:35.512489 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:32:35.512489 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:32:35.512489 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:32:35.512489 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:32:35.512489 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6770104-2850-4914-b129-c3dd3544bfb6 could not be found. Jul 23 21:32:35.512489 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:32:35.512489 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-4973e025-6a18-4a17-88ce-3231b2923138 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Returning 404 to user: Instance d6770104-2850-4914-b129-c3dd3544bfb6 could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:32:35.512489 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-4973e025-6a18-4a17-88ce-3231b2923138 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/d6770104-2850-4914-b129-c3dd3544bfb6" status: 404 len: 111 microversion: 2.1 time: 0.059268 Jul 23 21:32:35.512489 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2344/4614] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:35 2022] GET /compute/v2.1/servers/d6770104-2850-4914-b129-c3dd3544bfb6 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:32:35.513037 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-483a6733-79ad-4136-83b2-fb02d9460d6a tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:35.513037 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-483a6733-79ad-4136-83b2-fb02d9460d6a tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:35.516752 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-483a6733-79ad-4136-83b2-fb02d9460d6a tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:35.517850 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-483a6733-79ad-4136-83b2-fb02d9460d6a tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:35.530736 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-149a0f2b-ab86-4501-8305-b0b0f2246d9c tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:35.560207 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-149a0f2b-ab86-4501-8305-b0b0f2246d9c tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: e9a7d9eb-cfeb-4392-9b44-3dc592d9ebd8] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:35.581327 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-149a0f2b-ab86-4501-8305-b0b0f2246d9c tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:35.581829 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-149a0f2b-ab86-4501-8305-b0b0f2246d9c tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:35.582703 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-149a0f2b-ab86-4501-8305-b0b0f2246d9c tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:35.583154 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-149a0f2b-ab86-4501-8305-b0b0f2246d9c tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:35.618074 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-149a0f2b-ab86-4501-8305-b0b0f2246d9c tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] HTTP exception thrown: Instance e9a7d9eb-cfeb-4392-9b44-3dc592d9ebd8 could not be found. Jul 23 21:32:35.619955 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-149a0f2b-ab86-4501-8305-b0b0f2246d9c tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Request method failure captured: Jul 23 21:32:35.619955 ncdv-master-1 devstack@n-api.service[131321]: request: DELETE /compute/v2.1/servers/e9a7d9eb-cfeb-4392-9b44-3dc592d9ebd8 HTTP/1.1 Jul 23 21:32:35.619955 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:32:35.619955 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:32:35.619955 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:32:35.619955 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:32:35.619955 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:32:35.619955 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:32:35.619955 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:32:35.619955 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:32:35.619955 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GgexSaJTA-FXaV5LcqTAteOVESwOg7zac7nwUa59CGOHDwwWd7w7HKC8R65F9X48OwLZ_a8UsJYui6X5BG5uL_WJC-ysEg9nxrojp43TnKgPHTkujcdOw9VWLxqM9CE8dPwhawUMo8jE8x_rLu-o0j9Xf_QveShH-OlX4BIDLcYoyo Jul 23 21:32:35.619955 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:32:35.619955 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:32:35.619955 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:32:35.619955 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:32:35.619955 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:32:35.619955 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:32:35.619955 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 1890022bd460485dae0ea94b152a6746 Jul 23 21:32:35.619955 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ServersTestJSON-1141465764 Jul 23 21:32:35.619955 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:32:35.619955 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:32:35.619955 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1890022bd460485dae0ea94b152a6746"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1890022bd460485dae0ea94b152a6746"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1890022bd460485dae0ea94b152a6746", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1890022bd460485dae0ea94b152a6746"}]}] Jul 23 21:32:35.619955 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ServersTestJSON-1141465764 Jul 23 21:32:35.619955 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 1890022bd460485dae0ea94b152a6746 Jul 23 21:32:35.619955 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ServersTestJSON-1141465764 Jul 23 21:32:35.619955 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ServersTestJSON-1141465764-project Jul 23 21:32:35.619955 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:32:35.619955 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:32:35.619955 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 5efda1c40f494592bf1e6af1add120f3 Jul 23 21:32:35.619955 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ServersTestJSON-1141465764-project Jul 23 21:32:35.619955 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:32:35.619955 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance e9a7d9eb-cfeb-4392-9b44-3dc592d9ebd8 could not be found. Jul 23 21:32:35.619955 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': 'e9a7d9eb-cfeb-4392-9b44-3dc592d9ebd8'} Jul 23 21:32:35.619955 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:32:35.619955 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:32:35.619955 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:32:35.619955 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:32:35.619955 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:32:35.619955 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:32:35.619955 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:32:35.619955 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:32:35.619955 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:32:35.619955 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:32:35.619955 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9a7d9eb-cfeb-4392-9b44-3dc592d9ebd8 could not be found. Jul 23 21:32:35.619955 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:32:35.619955 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:32:35.619955 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:32:35.619955 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:32:35.619955 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:32:35.619955 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:32:35.619955 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:32:35.619955 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:32:35.619955 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:32:35.619955 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:32:35.619955 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 23 21:32:35.619955 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 23 21:32:35.619955 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 23 21:32:35.619955 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 23 21:32:35.619955 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:32:35.619955 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:32:35.619955 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:32:35.619955 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:32:35.619955 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9a7d9eb-cfeb-4392-9b44-3dc592d9ebd8 could not be found. Jul 23 21:32:35.625207 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:32:35.625207 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:32:35.625207 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:32:35.625207 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:32:35.625207 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:32:35.625207 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:32:35.625207 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:32:35.625207 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:32:35.625207 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9a7d9eb-cfeb-4392-9b44-3dc592d9ebd8 could not be found. Jul 23 21:32:35.625207 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:32:35.625207 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-149a0f2b-ab86-4501-8305-b0b0f2246d9c tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Returning 404 to user: Instance e9a7d9eb-cfeb-4392-9b44-3dc592d9ebd8 could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:32:35.625207 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-149a0f2b-ab86-4501-8305-b0b0f2246d9c tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "DELETE /compute/v2.1/servers/e9a7d9eb-cfeb-4392-9b44-3dc592d9ebd8" status: 404 len: 111 microversion: 2.1 time: 0.097509 Jul 23 21:32:35.629946 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2345/4615] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:32:35 2022] DELETE /compute/v2.1/servers/e9a7d9eb-cfeb-4392-9b44-3dc592d9ebd8 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:32:35.637355 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-374fdbfe-6081-4bd5-a565-875f24e84b63 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:35.638347 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-374fdbfe-6081-4bd5-a565-875f24e84b63 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: e9a7d9eb-cfeb-4392-9b44-3dc592d9ebd8] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:35.652008 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-374fdbfe-6081-4bd5-a565-875f24e84b63 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:35.652795 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-374fdbfe-6081-4bd5-a565-875f24e84b63 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:35.654126 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-374fdbfe-6081-4bd5-a565-875f24e84b63 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:35.654769 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-374fdbfe-6081-4bd5-a565-875f24e84b63 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:35.697968 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-374fdbfe-6081-4bd5-a565-875f24e84b63 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] HTTP exception thrown: Instance e9a7d9eb-cfeb-4392-9b44-3dc592d9ebd8 could not be found. Jul 23 21:32:35.699526 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-374fdbfe-6081-4bd5-a565-875f24e84b63 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Request method failure captured: Jul 23 21:32:35.699526 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/servers/e9a7d9eb-cfeb-4392-9b44-3dc592d9ebd8 HTTP/1.1 Jul 23 21:32:35.699526 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:32:35.699526 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:32:35.699526 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:32:35.699526 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:32:35.699526 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:32:35.699526 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:32:35.699526 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:32:35.699526 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:32:35.699526 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GgexSaJTA-FXaV5LcqTAteOVESwOg7zac7nwUa59CGOHDwwWd7w7HKC8R65F9X48OwLZ_a8UsJYui6X5BG5uL_WJC-ysEg9nxrojp43TnKgPHTkujcdOw9VWLxqM9CE8dPwhawUMo8jE8x_rLu-o0j9Xf_QveShH-OlX4BIDLcYoyo Jul 23 21:32:35.699526 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:32:35.699526 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:32:35.699526 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:32:35.699526 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:32:35.699526 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:32:35.699526 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:32:35.699526 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 1890022bd460485dae0ea94b152a6746 Jul 23 21:32:35.699526 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ServersTestJSON-1141465764 Jul 23 21:32:35.699526 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:32:35.699526 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:32:35.699526 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1890022bd460485dae0ea94b152a6746"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1890022bd460485dae0ea94b152a6746"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1890022bd460485dae0ea94b152a6746", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1890022bd460485dae0ea94b152a6746"}]}] Jul 23 21:32:35.699526 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ServersTestJSON-1141465764 Jul 23 21:32:35.699526 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 1890022bd460485dae0ea94b152a6746 Jul 23 21:32:35.699526 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ServersTestJSON-1141465764 Jul 23 21:32:35.699526 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ServersTestJSON-1141465764-project Jul 23 21:32:35.699526 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:32:35.699526 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:32:35.699526 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 5efda1c40f494592bf1e6af1add120f3 Jul 23 21:32:35.699526 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ServersTestJSON-1141465764-project Jul 23 21:32:35.699526 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:32:35.699526 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance e9a7d9eb-cfeb-4392-9b44-3dc592d9ebd8 could not be found. Jul 23 21:32:35.699526 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': 'e9a7d9eb-cfeb-4392-9b44-3dc592d9ebd8'} Jul 23 21:32:35.699526 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:32:35.699526 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:32:35.699526 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:32:35.699526 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:32:35.699526 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:32:35.699526 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:32:35.699526 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:32:35.699526 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:32:35.699526 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:32:35.699526 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:32:35.699526 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9a7d9eb-cfeb-4392-9b44-3dc592d9ebd8 could not be found. Jul 23 21:32:35.699526 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:32:35.699526 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:32:35.699526 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:32:35.699526 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:32:35.699526 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:32:35.699526 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:32:35.699526 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:32:35.699526 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:32:35.699526 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:32:35.699526 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:32:35.699526 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:32:35.699526 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:32:35.699526 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:32:35.699526 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:32:35.699526 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:32:35.699526 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:32:35.699526 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9a7d9eb-cfeb-4392-9b44-3dc592d9ebd8 could not be found. Jul 23 21:32:35.699526 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:32:35.699526 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:32:35.699526 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:32:35.699526 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:32:35.703475 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:32:35.703475 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:32:35.703475 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:32:35.703475 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:32:35.703475 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9a7d9eb-cfeb-4392-9b44-3dc592d9ebd8 could not be found. Jul 23 21:32:35.703475 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:32:35.703475 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-374fdbfe-6081-4bd5-a565-875f24e84b63 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Returning 404 to user: Instance e9a7d9eb-cfeb-4392-9b44-3dc592d9ebd8 could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:32:35.703475 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-374fdbfe-6081-4bd5-a565-875f24e84b63 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/e9a7d9eb-cfeb-4392-9b44-3dc592d9ebd8" status: 404 len: 111 microversion: 2.1 time: 0.069718 Jul 23 21:32:35.703475 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2346/4616] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:35 2022] GET /compute/v2.1/servers/e9a7d9eb-cfeb-4392-9b44-3dc592d9ebd8 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:32:35.718913 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-3c812d64-40e6-4981-afce-f063244594b0 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:35.719531 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-3c812d64-40e6-4981-afce-f063244594b0 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] [instance: 2ec03ea9-c0f4-41a6-93cb-bf713381760b] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:35.735590 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3c812d64-40e6-4981-afce-f063244594b0 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:35.736255 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3c812d64-40e6-4981-afce-f063244594b0 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:35.737607 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3c812d64-40e6-4981-afce-f063244594b0 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:35.738089 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3c812d64-40e6-4981-afce-f063244594b0 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:35.778380 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-483a6733-79ad-4136-83b2-fb02d9460d6a tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc4aa131e63349b2aa8f37fdf6d2fe00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc1475019924837a8be47347f6bbd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:35.796257 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-483a6733-79ad-4136-83b2-fb02d9460d6a tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] 10.222.0.17 "GET /compute/v2.1/servers/b0bb14c2-15df-4440-9d9c-4c6598867dfe" status: 200 len: 1549 microversion: 2.1 time: 0.300665 Jul 23 21:32:35.796847 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2271/4617] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:35 2022] GET /compute/v2.1/servers/b0bb14c2-15df-4440-9d9c-4c6598867dfe => generated 1549 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:32:35.803384 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4630863a-eafa-408d-bebd-a474a6172e58 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:35.804456 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-4630863a-eafa-408d-bebd-a474a6172e58 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: e7c04296-7707-4783-81e2-3cad733754c5] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:35.831259 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-4630863a-eafa-408d-bebd-a474a6172e58 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] HTTP exception thrown: Instance e7c04296-7707-4783-81e2-3cad733754c5 could not be found. Jul 23 21:32:35.832955 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4630863a-eafa-408d-bebd-a474a6172e58 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Request method failure captured: Jul 23 21:32:35.832955 ncdv-master-1 devstack@n-api.service[131320]: request: DELETE /compute/v2.1/servers/e7c04296-7707-4783-81e2-3cad733754c5 HTTP/1.1 Jul 23 21:32:35.832955 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:32:35.832955 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:32:35.832955 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:32:35.832955 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:32:35.832955 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:32:35.832955 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:32:35.832955 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:32:35.832955 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:32:35.832955 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GgexSaJTA-FXaV5LcqTAteOVESwOg7zac7nwUa59CGOHDwwWd7w7HKC8R65F9X48OwLZ_a8UsJYui6X5BG5uL_WJC-ysEg9nxrojp43TnKgPHTkujcdOw9VWLxqM9CE8dPwhawUMo8jE8x_rLu-o0j9Xf_QveShH-OlX4BIDLcYoyo Jul 23 21:32:35.832955 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:32:35.832955 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:32:35.832955 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:32:35.832955 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:32:35.832955 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:32:35.832955 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:32:35.832955 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 1890022bd460485dae0ea94b152a6746 Jul 23 21:32:35.832955 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServersTestJSON-1141465764 Jul 23 21:32:35.832955 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:32:35.832955 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:32:35.832955 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1890022bd460485dae0ea94b152a6746"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1890022bd460485dae0ea94b152a6746"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1890022bd460485dae0ea94b152a6746", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1890022bd460485dae0ea94b152a6746"}]}] Jul 23 21:32:35.832955 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServersTestJSON-1141465764 Jul 23 21:32:35.832955 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 1890022bd460485dae0ea94b152a6746 Jul 23 21:32:35.832955 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServersTestJSON-1141465764 Jul 23 21:32:35.832955 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServersTestJSON-1141465764-project Jul 23 21:32:35.832955 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:32:35.832955 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:32:35.832955 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 5efda1c40f494592bf1e6af1add120f3 Jul 23 21:32:35.832955 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServersTestJSON-1141465764-project Jul 23 21:32:35.832955 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:32:35.832955 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance e7c04296-7707-4783-81e2-3cad733754c5 could not be found. Jul 23 21:32:35.832955 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': 'e7c04296-7707-4783-81e2-3cad733754c5'} Jul 23 21:32:35.832955 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:32:35.832955 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:32:35.832955 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:32:35.832955 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:32:35.832955 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:32:35.832955 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:32:35.832955 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 23 21:32:35.832955 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 23 21:32:35.832955 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7c04296-7707-4783-81e2-3cad733754c5 could not be found. Jul 23 21:32:35.832955 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:32:35.832955 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:32:35.832955 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:32:35.832955 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:32:35.832955 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:32:35.832955 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:32:35.832955 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:32:35.832955 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:32:35.832955 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:32:35.832955 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:32:35.832955 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 23 21:32:35.832955 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 23 21:32:35.832955 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 23 21:32:35.832955 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 23 21:32:35.832955 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:32:35.832955 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:32:35.832955 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:32:35.832955 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:32:35.832955 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7c04296-7707-4783-81e2-3cad733754c5 could not be found. Jul 23 21:32:35.832955 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:32:35.832955 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:32:35.832955 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:32:35.837675 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:32:35.837675 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:32:35.837675 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:32:35.837675 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:32:35.837675 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:32:35.837675 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7c04296-7707-4783-81e2-3cad733754c5 could not be found. Jul 23 21:32:35.837675 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:32:35.837675 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4630863a-eafa-408d-bebd-a474a6172e58 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Returning 404 to user: Instance e7c04296-7707-4783-81e2-3cad733754c5 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:32:35.839158 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4630863a-eafa-408d-bebd-a474a6172e58 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "DELETE /compute/v2.1/servers/e7c04296-7707-4783-81e2-3cad733754c5" status: 404 len: 111 microversion: 2.1 time: 0.041027 Jul 23 21:32:35.841281 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2272/4618] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:32:35 2022] DELETE /compute/v2.1/servers/e7c04296-7707-4783-81e2-3cad733754c5 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:32:35.851034 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4a81605e-f338-4f01-acf5-242d5b1f75d0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:35.852364 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-4a81605e-f338-4f01-acf5-242d5b1f75d0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:35.860481 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-3c812d64-40e6-4981-afce-f063244594b0 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd49331138a4dbc912bc7bf6f6b0215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842a1aca542f416eab5d43b881325917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:35.861646 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4a81605e-f338-4f01-acf5-242d5b1f75d0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:35.862202 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4a81605e-f338-4f01-acf5-242d5b1f75d0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:35.863060 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4a81605e-f338-4f01-acf5-242d5b1f75d0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:35.863565 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4a81605e-f338-4f01-acf5-242d5b1f75d0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:35.868580 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-3c812d64-40e6-4981-afce-f063244594b0 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] 10.222.0.17 "GET /compute/v2.1/servers/2ec03ea9-c0f4-41a6-93cb-bf713381760b" status: 200 len: 1300 microversion: 2.1 time: 0.153533 Jul 23 21:32:35.869282 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2347/4619] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:35 2022] GET /compute/v2.1/servers/2ec03ea9-c0f4-41a6-93cb-bf713381760b => generated 1300 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:32:35.878911 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-0268b5a8-ac31-4523-816c-78079f1a2a23 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:35.879419 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-0268b5a8-ac31-4523-816c-78079f1a2a23 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] [instance: b0bb14c2-15df-4440-9d9c-4c6598867dfe] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:35.898606 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0268b5a8-ac31-4523-816c-78079f1a2a23 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:35.899072 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0268b5a8-ac31-4523-816c-78079f1a2a23 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:35.899862 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0268b5a8-ac31-4523-816c-78079f1a2a23 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:35.900820 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0268b5a8-ac31-4523-816c-78079f1a2a23 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:35.944198 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-4a81605e-f338-4f01-acf5-242d5b1f75d0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:35.956301 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-4a81605e-f338-4f01-acf5-242d5b1f75d0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:35.958043 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-4a81605e-f338-4f01-acf5-242d5b1f75d0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:35.960274 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4a81605e-f338-4f01-acf5-242d5b1f75d0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.117680 Jul 23 21:32:35.961643 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2273/4620] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:32:35 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:32:35.971973 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2f3faa5b-8233-414d-aeec-20b6ea121a63 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:35.974412 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-2f3faa5b-8233-414d-aeec-20b6ea121a63 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: e7c04296-7707-4783-81e2-3cad733754c5] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:35.981136 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-2f3faa5b-8233-414d-aeec-20b6ea121a63 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] HTTP exception thrown: Instance e7c04296-7707-4783-81e2-3cad733754c5 could not be found. Jul 23 21:32:35.984785 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2f3faa5b-8233-414d-aeec-20b6ea121a63 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Request method failure captured: Jul 23 21:32:35.984785 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/e7c04296-7707-4783-81e2-3cad733754c5 HTTP/1.1 Jul 23 21:32:35.984785 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:32:35.984785 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:32:35.984785 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:32:35.984785 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:32:35.984785 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:32:35.984785 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:32:35.984785 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:32:35.984785 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:32:35.984785 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GgexSaJTA-FXaV5LcqTAteOVESwOg7zac7nwUa59CGOHDwwWd7w7HKC8R65F9X48OwLZ_a8UsJYui6X5BG5uL_WJC-ysEg9nxrojp43TnKgPHTkujcdOw9VWLxqM9CE8dPwhawUMo8jE8x_rLu-o0j9Xf_QveShH-OlX4BIDLcYoyo Jul 23 21:32:35.984785 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:32:35.984785 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:32:35.984785 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:32:35.984785 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:32:35.984785 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:32:35.984785 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:32:35.984785 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 1890022bd460485dae0ea94b152a6746 Jul 23 21:32:35.984785 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServersTestJSON-1141465764 Jul 23 21:32:35.984785 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:32:35.984785 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:32:35.984785 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1890022bd460485dae0ea94b152a6746"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1890022bd460485dae0ea94b152a6746"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1890022bd460485dae0ea94b152a6746", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1890022bd460485dae0ea94b152a6746"}]}] Jul 23 21:32:35.984785 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServersTestJSON-1141465764 Jul 23 21:32:35.984785 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 1890022bd460485dae0ea94b152a6746 Jul 23 21:32:35.984785 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServersTestJSON-1141465764 Jul 23 21:32:35.984785 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServersTestJSON-1141465764-project Jul 23 21:32:35.984785 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:32:35.984785 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:32:35.984785 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 5efda1c40f494592bf1e6af1add120f3 Jul 23 21:32:35.984785 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServersTestJSON-1141465764-project Jul 23 21:32:35.984785 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:32:35.984785 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance e7c04296-7707-4783-81e2-3cad733754c5 could not be found. Jul 23 21:32:35.984785 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': 'e7c04296-7707-4783-81e2-3cad733754c5'} Jul 23 21:32:35.984785 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:32:35.984785 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:32:35.984785 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:32:35.984785 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:32:35.984785 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:32:35.984785 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:32:35.984785 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 23 21:32:35.984785 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 23 21:32:35.984785 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7c04296-7707-4783-81e2-3cad733754c5 could not be found. Jul 23 21:32:35.984785 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:32:35.984785 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:32:35.984785 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:32:35.984785 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:32:35.984785 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:32:35.984785 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:32:35.984785 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:32:35.984785 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:32:35.984785 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:32:35.984785 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:32:35.984785 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:32:35.984785 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:32:35.984785 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:32:35.984785 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:32:35.984785 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:32:35.984785 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:32:35.984785 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7c04296-7707-4783-81e2-3cad733754c5 could not be found. Jul 23 21:32:35.984785 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:32:35.984785 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:32:35.984785 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:32:35.984785 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:32:35.984785 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:32:35.984785 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:32:35.989564 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:32:35.989564 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:32:35.989564 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7c04296-7707-4783-81e2-3cad733754c5 could not be found. Jul 23 21:32:35.989564 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:32:35.990703 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2f3faa5b-8233-414d-aeec-20b6ea121a63 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Returning 404 to user: Instance e7c04296-7707-4783-81e2-3cad733754c5 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:32:35.991815 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2f3faa5b-8233-414d-aeec-20b6ea121a63 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/e7c04296-7707-4783-81e2-3cad733754c5" status: 404 len: 111 microversion: 2.1 time: 0.027644 Jul 23 21:32:35.993225 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2274/4621] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:35 2022] GET /compute/v2.1/servers/e7c04296-7707-4783-81e2-3cad733754c5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:32:36.006665 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-94267daa-ca08-4280-a270-b2f0c551f1fe tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:36.008086 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-94267daa-ca08-4280-a270-b2f0c551f1fe tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: 274ce0ec-f78b-41cd-8538-2708c52c1c55] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:36.016705 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-94267daa-ca08-4280-a270-b2f0c551f1fe tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:36.017404 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-94267daa-ca08-4280-a270-b2f0c551f1fe tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:36.018693 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-94267daa-ca08-4280-a270-b2f0c551f1fe tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:36.019286 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-94267daa-ca08-4280-a270-b2f0c551f1fe tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:36.080518 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-94267daa-ca08-4280-a270-b2f0c551f1fe tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: 274ce0ec-f78b-41cd-8538-2708c52c1c55] Going to try to terminate instance {{(pid=131320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:32:36.133095 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-0268b5a8-ac31-4523-816c-78079f1a2a23 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] 10.222.0.17 "GET /compute/v2.1/servers/b0bb14c2-15df-4440-9d9c-4c6598867dfe/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.257993 Jul 23 21:32:36.133971 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2348/4622] 10.222.0.17 () {58 vars in 1274 bytes} [Sat Jul 23 21:32:35 2022] GET /compute/v2.1/servers/b0bb14c2-15df-4440-9d9c-4c6598867dfe/os-interface => generated 284 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:32:36.168111 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:32:36.200403 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-94267daa-ca08-4280-a270-b2f0c551f1fe tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "DELETE /compute/v2.1/servers/274ce0ec-f78b-41cd-8538-2708c52c1c55" status: 204 len: 0 microversion: 2.1 time: 0.200443 Jul 23 21:32:36.203332 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2275/4623] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:32:35 2022] DELETE /compute/v2.1/servers/274ce0ec-f78b-41cd-8538-2708c52c1c55 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:32:36.213241 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-b29b7099-4fb5-430f-ad57-39add1405527 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:36.214297 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-b29b7099-4fb5-430f-ad57-39add1405527 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: 274ce0ec-f78b-41cd-8538-2708c52c1c55] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:36.226762 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b29b7099-4fb5-430f-ad57-39add1405527 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:36.227850 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b29b7099-4fb5-430f-ad57-39add1405527 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:36.229324 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b29b7099-4fb5-430f-ad57-39add1405527 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:36.230106 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b29b7099-4fb5-430f-ad57-39add1405527 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:36.481128 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d14d9816-4ac6-4c86-801c-15fc15f1cd39 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:36.482678 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d14d9816-4ac6-4c86-801c-15fc15f1cd39 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:36.490080 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d14d9816-4ac6-4c86-801c-15fc15f1cd39 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:36.490625 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d14d9816-4ac6-4c86-801c-15fc15f1cd39 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:36.491490 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d14d9816-4ac6-4c86-801c-15fc15f1cd39 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:36.491995 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d14d9816-4ac6-4c86-801c-15fc15f1cd39 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:36.575563 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-b29b7099-4fb5-430f-ad57-39add1405527 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:36.584078 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-b29b7099-4fb5-430f-ad57-39add1405527 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/274ce0ec-f78b-41cd-8538-2708c52c1c55" status: 200 len: 1480 microversion: 2.1 time: 0.375530 Jul 23 21:32:36.584601 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2349/4624] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:36 2022] GET /compute/v2.1/servers/274ce0ec-f78b-41cd-8538-2708c52c1c55 => generated 1480 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:32:36.764826 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d14d9816-4ac6-4c86-801c-15fc15f1cd39 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:36.780081 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d14d9816-4ac6-4c86-801c-15fc15f1cd39 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1518 microversion: 2.1 time: 0.304854 Jul 23 21:32:36.780977 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2276/4625] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:36 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1518 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:32:36.886616 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-61d84c67-6923-4281-a07f-170aac1cba5c tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:36.887527 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-61d84c67-6923-4281-a07f-170aac1cba5c tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] [instance: 2ec03ea9-c0f4-41a6-93cb-bf713381760b] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:36.891209 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_api:SELECT=100 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:32:36.896629 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-61d84c67-6923-4281-a07f-170aac1cba5c tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:36.897336 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-61d84c67-6923-4281-a07f-170aac1cba5c tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:36.898469 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-61d84c67-6923-4281-a07f-170aac1cba5c tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:36.899389 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-61d84c67-6923-4281-a07f-170aac1cba5c tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:36.988673 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c26681fe-763a-450e-92b2-2757a44c145d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:36.989299 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c26681fe-763a-450e-92b2-2757a44c145d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:36.996392 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c26681fe-763a-450e-92b2-2757a44c145d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:37.003421 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c26681fe-763a-450e-92b2-2757a44c145d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:37.004743 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c26681fe-763a-450e-92b2-2757a44c145d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:37.005345 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c26681fe-763a-450e-92b2-2757a44c145d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:37.082511 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c26681fe-763a-450e-92b2-2757a44c145d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:37.087605 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-61d84c67-6923-4281-a07f-170aac1cba5c tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd49331138a4dbc912bc7bf6f6b0215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842a1aca542f416eab5d43b881325917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:37.092998 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c26681fe-763a-450e-92b2-2757a44c145d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:37.106351 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c26681fe-763a-450e-92b2-2757a44c145d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:37.106660 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-61d84c67-6923-4281-a07f-170aac1cba5c tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] 10.222.0.17 "GET /compute/v2.1/servers/2ec03ea9-c0f4-41a6-93cb-bf713381760b" status: 200 len: 1300 microversion: 2.1 time: 0.220328 Jul 23 21:32:37.107697 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c26681fe-763a-450e-92b2-2757a44c145d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.131108 Jul 23 21:32:37.108654 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2277/4626] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:32:36 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:32:37.117985 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2350/4627] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:36 2022] GET /compute/v2.1/servers/2ec03ea9-c0f4-41a6-93cb-bf713381760b => generated 1300 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:32:37.170811 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-4fc0b969-84f1-4c3e-bde1-e995d49262d3 req-7b1c815a-c292-44d7-847b-50716ce409ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6b9ea07-2ebd-4e1a-86f2-abb1bf581076", "tag": "d1ebc2ac-80d0-4761-8a8b-958b5aadb724"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:32:37.180445 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-4fc0b969-84f1-4c3e-bde1-e995d49262d3 req-7b1c815a-c292-44d7-847b-50716ce409ae service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:37.180897 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-4fc0b969-84f1-4c3e-bde1-e995d49262d3 req-7b1c815a-c292-44d7-847b-50716ce409ae service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:37.193367 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-4fc0b969-84f1-4c3e-bde1-e995d49262d3 req-7b1c815a-c292-44d7-847b-50716ce409ae service nova] Creating event network-changed:d1ebc2ac-80d0-4761-8a8b-958b5aadb724 for instance d6b9ea07-2ebd-4e1a-86f2-abb1bf581076 on nch1-master-1 Jul 23 21:32:37.198383 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-4fc0b969-84f1-4c3e-bde1-e995d49262d3 req-7b1c815a-c292-44d7-847b-50716ce409ae service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031325 Jul 23 21:32:37.199402 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2351/4628] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:32:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:32:37.613459 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-bab62c74-3474-47b4-9c20-4882482f5d00 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:37.617080 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-bab62c74-3474-47b4-9c20-4882482f5d00 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: 274ce0ec-f78b-41cd-8538-2708c52c1c55] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:37.639718 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bab62c74-3474-47b4-9c20-4882482f5d00 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:37.647585 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bab62c74-3474-47b4-9c20-4882482f5d00 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:37.648802 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bab62c74-3474-47b4-9c20-4882482f5d00 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:37.649436 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bab62c74-3474-47b4-9c20-4882482f5d00 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:37.768613 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-d991189d-685a-4591-a6d0-a3311bc8bad2 req-e0802ed1-5847-4a06-b352-b213abb4b811 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0bb14c2-15df-4440-9d9c-4c6598867dfe", "tag": "da2c7126-d794-4ff2-a071-724ef04327f5"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:32:37.784401 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-d991189d-685a-4591-a6d0-a3311bc8bad2 req-e0802ed1-5847-4a06-b352-b213abb4b811 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:37.785429 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-d991189d-685a-4591-a6d0-a3311bc8bad2 req-e0802ed1-5847-4a06-b352-b213abb4b811 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:37.821917 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-d991189d-685a-4591-a6d0-a3311bc8bad2 req-e0802ed1-5847-4a06-b352-b213abb4b811 service nova] Creating event network-changed:da2c7126-d794-4ff2-a071-724ef04327f5 for instance b0bb14c2-15df-4440-9d9c-4c6598867dfe on nch2-master-1 Jul 23 21:32:37.834968 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-d991189d-685a-4591-a6d0-a3311bc8bad2 req-e0802ed1-5847-4a06-b352-b213abb4b811 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070713 Jul 23 21:32:37.836189 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2352/4629] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:32:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:32:37.855646 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e6a99d78-0fb2-471c-9001-3ad60d54079f tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:37.856466 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-e6a99d78-0fb2-471c-9001-3ad60d54079f tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:37.863454 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e6a99d78-0fb2-471c-9001-3ad60d54079f tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:37.863911 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e6a99d78-0fb2-471c-9001-3ad60d54079f tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:37.866729 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e6a99d78-0fb2-471c-9001-3ad60d54079f tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:37.867176 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e6a99d78-0fb2-471c-9001-3ad60d54079f tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:37.873674 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=100 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:32:38.401113 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-bab62c74-3474-47b4-9c20-4882482f5d00 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:38.413972 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-bab62c74-3474-47b4-9c20-4882482f5d00 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/274ce0ec-f78b-41cd-8538-2708c52c1c55" status: 200 len: 1480 microversion: 2.1 time: 0.815730 Jul 23 21:32:38.419153 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2278/4630] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:37 2022] GET /compute/v2.1/servers/274ce0ec-f78b-41cd-8538-2708c52c1c55 => generated 1480 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:32:38.428225 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c03e5d57-e324-4048-b70a-ba02ba9a109c tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:38.436367 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c03e5d57-e324-4048-b70a-ba02ba9a109c tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] [instance: 2ec03ea9-c0f4-41a6-93cb-bf713381760b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:38.451596 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c03e5d57-e324-4048-b70a-ba02ba9a109c tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:38.462562 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c03e5d57-e324-4048-b70a-ba02ba9a109c tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:38.464358 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c03e5d57-e324-4048-b70a-ba02ba9a109c tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:38.464833 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c03e5d57-e324-4048-b70a-ba02ba9a109c tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:38.941406 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-e6a99d78-0fb2-471c-9001-3ad60d54079f tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:38.960145 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-e6a99d78-0fb2-471c-9001-3ad60d54079f tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1518 microversion: 2.1 time: 1.122540 Jul 23 21:32:38.960822 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2353/4631] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:37 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1518 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:32:38.978997 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ec783ccd-3c9a-4ec1-a0b1-f27e099c52bd tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:38.984518 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-ec783ccd-3c9a-4ec1-a0b1-f27e099c52bd tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:39.006707 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ec783ccd-3c9a-4ec1-a0b1-f27e099c52bd tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:39.008228 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ec783ccd-3c9a-4ec1-a0b1-f27e099c52bd tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:39.009152 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ec783ccd-3c9a-4ec1-a0b1-f27e099c52bd tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:39.009764 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ec783ccd-3c9a-4ec1-a0b1-f27e099c52bd tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:39.017234 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c03e5d57-e324-4048-b70a-ba02ba9a109c tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd49331138a4dbc912bc7bf6f6b0215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842a1aca542f416eab5d43b881325917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:39.028506 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c03e5d57-e324-4048-b70a-ba02ba9a109c tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] 10.222.0.17 "GET /compute/v2.1/servers/2ec03ea9-c0f4-41a6-93cb-bf713381760b" status: 200 len: 1300 microversion: 2.1 time: 0.607961 Jul 23 21:32:39.042657 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2279/4632] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:38 2022] GET /compute/v2.1/servers/2ec03ea9-c0f4-41a6-93cb-bf713381760b => generated 1300 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:32:39.349134 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ec783ccd-3c9a-4ec1-a0b1-f27e099c52bd tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:39.370655 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ec783ccd-3c9a-4ec1-a0b1-f27e099c52bd tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:39.372211 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ec783ccd-3c9a-4ec1-a0b1-f27e099c52bd tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:39.374334 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-ec783ccd-3c9a-4ec1-a0b1-f27e099c52bd tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.403459 Jul 23 21:32:39.387173 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2354/4633] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:32:38 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:32:39.437194 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c35f0670-26ef-41a2-b21b-6126f0419d34 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:39.438033 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c35f0670-26ef-41a2-b21b-6126f0419d34 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: 274ce0ec-f78b-41cd-8538-2708c52c1c55] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:39.445960 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c35f0670-26ef-41a2-b21b-6126f0419d34 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:39.447186 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c35f0670-26ef-41a2-b21b-6126f0419d34 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:39.448086 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c35f0670-26ef-41a2-b21b-6126f0419d34 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:39.448874 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c35f0670-26ef-41a2-b21b-6126f0419d34 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:39.479384 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:32:39.651429 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c35f0670-26ef-41a2-b21b-6126f0419d34 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5efda1c40f494592bf1e6af1add120f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1890022bd460485dae0ea94b152a6746', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:39.669207 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c35f0670-26ef-41a2-b21b-6126f0419d34 tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/274ce0ec-f78b-41cd-8538-2708c52c1c55" status: 200 len: 1438 microversion: 2.1 time: 0.236955 Jul 23 21:32:39.672032 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2280/4634] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:39 2022] GET /compute/v2.1/servers/274ce0ec-f78b-41cd-8538-2708c52c1c55 => generated 1438 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:32:39.688829 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-7a5abaca-2c88-4171-b26d-cec5551d2bea req-40c3c653-2ba6-4793-887a-96929ee6a4de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ec03ea9-c0f4-41a6-93cb-bf713381760b", "tag": "fd0afce0-b59f-447f-b37d-b1fb5f51e6eb"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:32:39.712739 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-7a5abaca-2c88-4171-b26d-cec5551d2bea req-40c3c653-2ba6-4793-887a-96929ee6a4de service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:39.715384 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-7a5abaca-2c88-4171-b26d-cec5551d2bea req-40c3c653-2ba6-4793-887a-96929ee6a4de service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:39.758809 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-7a5abaca-2c88-4171-b26d-cec5551d2bea req-40c3c653-2ba6-4793-887a-96929ee6a4de service nova] Creating event network-changed:fd0afce0-b59f-447f-b37d-b1fb5f51e6eb for instance 2ec03ea9-c0f4-41a6-93cb-bf713381760b on nch1-master-1 Jul 23 21:32:39.778860 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-7a5abaca-2c88-4171-b26d-cec5551d2bea req-40c3c653-2ba6-4793-887a-96929ee6a4de service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093758 Jul 23 21:32:39.783031 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2355/4635] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:32:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:32:39.917624 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-45f72f5b-a87f-43f8-9bd8-45aafda2937e req-99189e5f-cb7a-42ae-91cc-2a2b190b9a34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "274ce0ec-f78b-41cd-8538-2708c52c1c55", "name": "network-vif-deleted", "tag": "dcaef018-3af8-4f24-90ac-5c35c064677a"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:32:39.935019 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-45f72f5b-a87f-43f8-9bd8-45aafda2937e req-99189e5f-cb7a-42ae-91cc-2a2b190b9a34 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:39.935674 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-45f72f5b-a87f-43f8-9bd8-45aafda2937e req-99189e5f-cb7a-42ae-91cc-2a2b190b9a34 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:39.951786 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-45f72f5b-a87f-43f8-9bd8-45aafda2937e req-99189e5f-cb7a-42ae-91cc-2a2b190b9a34 service nova] Creating event network-vif-deleted:dcaef018-3af8-4f24-90ac-5c35c064677a for instance 274ce0ec-f78b-41cd-8538-2708c52c1c55 on nch1-master-1 Jul 23 21:32:39.959233 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-45f72f5b-a87f-43f8-9bd8-45aafda2937e req-99189e5f-cb7a-42ae-91cc-2a2b190b9a34 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049219 Jul 23 21:32:39.960710 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2281/4636] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:32:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:32:39.977337 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c06b15ac-821b-4959-b44f-f1f514b1130d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:39.978322 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-c06b15ac-821b-4959-b44f-f1f514b1130d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:39.991785 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c06b15ac-821b-4959-b44f-f1f514b1130d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:39.992251 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c06b15ac-821b-4959-b44f-f1f514b1130d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:39.993048 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c06b15ac-821b-4959-b44f-f1f514b1130d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:39.993496 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c06b15ac-821b-4959-b44f-f1f514b1130d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:40.047549 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-de0c780a-b560-4600-a4fa-38f8c1ccad24 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:40.048256 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-de0c780a-b560-4600-a4fa-38f8c1ccad24 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] [instance: 2ec03ea9-c0f4-41a6-93cb-bf713381760b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:40.058159 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-de0c780a-b560-4600-a4fa-38f8c1ccad24 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:40.058623 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-de0c780a-b560-4600-a4fa-38f8c1ccad24 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:40.066364 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-de0c780a-b560-4600-a4fa-38f8c1ccad24 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:40.070258 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-de0c780a-b560-4600-a4fa-38f8c1ccad24 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:40.268166 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-de0c780a-b560-4600-a4fa-38f8c1ccad24 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd49331138a4dbc912bc7bf6f6b0215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842a1aca542f416eab5d43b881325917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:40.279193 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-de0c780a-b560-4600-a4fa-38f8c1ccad24 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] 10.222.0.17 "GET /compute/v2.1/servers/2ec03ea9-c0f4-41a6-93cb-bf713381760b" status: 200 len: 1300 microversion: 2.1 time: 0.235871 Jul 23 21:32:40.280472 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2282/4637] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:40 2022] GET /compute/v2.1/servers/2ec03ea9-c0f4-41a6-93cb-bf713381760b => generated 1300 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:32:40.348506 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c06b15ac-821b-4959-b44f-f1f514b1130d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:40.359417 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-c06b15ac-821b-4959-b44f-f1f514b1130d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1518 microversion: 2.1 time: 0.386309 Jul 23 21:32:40.360020 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2356/4638] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:39 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1518 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:32:40.393985 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-48f03c91-c9a4-46d1-a4b7-0dc4e8f3fe19 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:40.395723 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-48f03c91-c9a4-46d1-a4b7-0dc4e8f3fe19 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:40.406008 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-48f03c91-c9a4-46d1-a4b7-0dc4e8f3fe19 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:40.407450 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-48f03c91-c9a4-46d1-a4b7-0dc4e8f3fe19 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:40.408952 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-48f03c91-c9a4-46d1-a4b7-0dc4e8f3fe19 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:40.409756 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-48f03c91-c9a4-46d1-a4b7-0dc4e8f3fe19 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:40.476451 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-48f03c91-c9a4-46d1-a4b7-0dc4e8f3fe19 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:40.487342 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-48f03c91-c9a4-46d1-a4b7-0dc4e8f3fe19 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:40.488842 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-48f03c91-c9a4-46d1-a4b7-0dc4e8f3fe19 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:40.490279 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-48f03c91-c9a4-46d1-a4b7-0dc4e8f3fe19 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.101072 Jul 23 21:32:40.491050 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2283/4639] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:32:40 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:32:40.689011 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-907837de-c53e-4ae2-97de-cddf7a01364b tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:40.689818 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-907837de-c53e-4ae2-97de-cddf7a01364b tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] [instance: 274ce0ec-f78b-41cd-8538-2708c52c1c55] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:40.697562 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-907837de-c53e-4ae2-97de-cddf7a01364b tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:40.698359 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-907837de-c53e-4ae2-97de-cddf7a01364b tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:40.700173 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-907837de-c53e-4ae2-97de-cddf7a01364b tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:40.701302 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-907837de-c53e-4ae2-97de-cddf7a01364b tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:40.717482 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-907837de-c53e-4ae2-97de-cddf7a01364b tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] HTTP exception thrown: Instance 274ce0ec-f78b-41cd-8538-2708c52c1c55 could not be found. Jul 23 21:32:40.720613 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-907837de-c53e-4ae2-97de-cddf7a01364b tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Request method failure captured: Jul 23 21:32:40.720613 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/servers/274ce0ec-f78b-41cd-8538-2708c52c1c55 HTTP/1.1 Jul 23 21:32:40.720613 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:32:40.720613 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:32:40.720613 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:32:40.720613 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:32:40.720613 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:32:40.720613 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:32:40.720613 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:32:40.720613 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:32:40.720613 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GgexSaJTA-FXaV5LcqTAteOVESwOg7zac7nwUa59CGOHDwwWd7w7HKC8R65F9X48OwLZ_a8UsJYui6X5BG5uL_WJC-ysEg9nxrojp43TnKgPHTkujcdOw9VWLxqM9CE8dPwhawUMo8jE8x_rLu-o0j9Xf_QveShH-OlX4BIDLcYoyo Jul 23 21:32:40.720613 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:32:40.720613 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:32:40.720613 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:32:40.720613 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:32:40.720613 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:32:40.720613 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:32:40.720613 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 1890022bd460485dae0ea94b152a6746 Jul 23 21:32:40.720613 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ServersTestJSON-1141465764 Jul 23 21:32:40.720613 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:32:40.720613 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:32:40.720613 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1890022bd460485dae0ea94b152a6746"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1890022bd460485dae0ea94b152a6746"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1890022bd460485dae0ea94b152a6746", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1890022bd460485dae0ea94b152a6746"}]}] Jul 23 21:32:40.720613 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ServersTestJSON-1141465764 Jul 23 21:32:40.720613 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 1890022bd460485dae0ea94b152a6746 Jul 23 21:32:40.720613 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ServersTestJSON-1141465764 Jul 23 21:32:40.720613 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ServersTestJSON-1141465764-project Jul 23 21:32:40.720613 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:32:40.720613 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:32:40.720613 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 5efda1c40f494592bf1e6af1add120f3 Jul 23 21:32:40.720613 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ServersTestJSON-1141465764-project Jul 23 21:32:40.720613 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:32:40.720613 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance 274ce0ec-f78b-41cd-8538-2708c52c1c55 could not be found. Jul 23 21:32:40.720613 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': '274ce0ec-f78b-41cd-8538-2708c52c1c55'} Jul 23 21:32:40.720613 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:32:40.720613 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:32:40.720613 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:32:40.720613 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:32:40.720613 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:32:40.720613 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:32:40.720613 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:32:40.720613 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:32:40.720613 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:32:40.720613 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:32:40.720613 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 274ce0ec-f78b-41cd-8538-2708c52c1c55 could not be found. Jul 23 21:32:40.720613 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:32:40.720613 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:32:40.720613 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:32:40.720613 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:32:40.720613 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:32:40.720613 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:32:40.720613 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:32:40.720613 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:32:40.720613 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:32:40.720613 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:32:40.720613 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:32:40.720613 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:32:40.720613 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:32:40.720613 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:32:40.720613 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:32:40.720613 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:32:40.720613 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 274ce0ec-f78b-41cd-8538-2708c52c1c55 could not be found. Jul 23 21:32:40.720613 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:32:40.720613 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:32:40.720613 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:32:40.720613 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:32:40.726180 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:32:40.726180 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:32:40.726180 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:32:40.726180 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:32:40.726180 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 274ce0ec-f78b-41cd-8538-2708c52c1c55 could not be found. Jul 23 21:32:40.726180 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:32:40.729238 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-907837de-c53e-4ae2-97de-cddf7a01364b tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] Returning 404 to user: Instance 274ce0ec-f78b-41cd-8538-2708c52c1c55 could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:32:40.730446 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-907837de-c53e-4ae2-97de-cddf7a01364b tempest-ServersTestJSON-1141465764 tempest-ServersTestJSON-1141465764-project] 10.222.0.17 "GET /compute/v2.1/servers/274ce0ec-f78b-41cd-8538-2708c52c1c55" status: 404 len: 111 microversion: 2.1 time: 0.046602 Jul 23 21:32:40.731274 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2357/4640] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:40 2022] GET /compute/v2.1/servers/274ce0ec-f78b-41cd-8538-2708c52c1c55 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:32:41.297011 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8faff8a8-69c3-40c6-8e26-07d13c3ddf5d tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:41.297774 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8faff8a8-69c3-40c6-8e26-07d13c3ddf5d tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] [instance: 2ec03ea9-c0f4-41a6-93cb-bf713381760b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:41.305129 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8faff8a8-69c3-40c6-8e26-07d13c3ddf5d tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:41.305586 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8faff8a8-69c3-40c6-8e26-07d13c3ddf5d tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:41.306448 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8faff8a8-69c3-40c6-8e26-07d13c3ddf5d tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:41.306889 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8faff8a8-69c3-40c6-8e26-07d13c3ddf5d tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:41.379165 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-53b505d4-cd9a-46cc-a3ea-9b7e18945aa5 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:41.379924 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-53b505d4-cd9a-46cc-a3ea-9b7e18945aa5 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:41.386942 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-53b505d4-cd9a-46cc-a3ea-9b7e18945aa5 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:41.387482 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-53b505d4-cd9a-46cc-a3ea-9b7e18945aa5 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:41.388341 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-53b505d4-cd9a-46cc-a3ea-9b7e18945aa5 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:41.388790 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-53b505d4-cd9a-46cc-a3ea-9b7e18945aa5 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:41.412604 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8faff8a8-69c3-40c6-8e26-07d13c3ddf5d tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd49331138a4dbc912bc7bf6f6b0215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842a1aca542f416eab5d43b881325917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:41.422613 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8faff8a8-69c3-40c6-8e26-07d13c3ddf5d tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] 10.222.0.17 "GET /compute/v2.1/servers/2ec03ea9-c0f4-41a6-93cb-bf713381760b" status: 200 len: 1300 microversion: 2.1 time: 0.129521 Jul 23 21:32:41.423328 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2284/4641] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:41 2022] GET /compute/v2.1/servers/2ec03ea9-c0f4-41a6-93cb-bf713381760b => generated 1300 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:32:41.509436 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-733ea61f-2af2-4098-85b3-75c7bce29f59 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:41.510512 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-733ea61f-2af2-4098-85b3-75c7bce29f59 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:41.517030 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-733ea61f-2af2-4098-85b3-75c7bce29f59 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:41.517651 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-733ea61f-2af2-4098-85b3-75c7bce29f59 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:41.518739 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-733ea61f-2af2-4098-85b3-75c7bce29f59 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:41.519393 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-733ea61f-2af2-4098-85b3-75c7bce29f59 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:41.536588 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-53b505d4-cd9a-46cc-a3ea-9b7e18945aa5 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:41.545996 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-53b505d4-cd9a-46cc-a3ea-9b7e18945aa5 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1518 microversion: 2.1 time: 0.170106 Jul 23 21:32:41.555675 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2358/4642] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:41 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1518 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:32:41.599344 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-733ea61f-2af2-4098-85b3-75c7bce29f59 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:41.608979 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-733ea61f-2af2-4098-85b3-75c7bce29f59 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:41.610592 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-733ea61f-2af2-4098-85b3-75c7bce29f59 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:41.611776 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-733ea61f-2af2-4098-85b3-75c7bce29f59 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.106564 Jul 23 21:32:41.612319 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2285/4643] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:32:41 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:32:42.439239 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d8a31ad3-727c-4280-8594-debba04edcec tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:42.441214 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-d8a31ad3-727c-4280-8594-debba04edcec tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] [instance: 2ec03ea9-c0f4-41a6-93cb-bf713381760b] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:42.456614 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d8a31ad3-727c-4280-8594-debba04edcec tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:42.457115 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d8a31ad3-727c-4280-8594-debba04edcec tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:42.458165 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d8a31ad3-727c-4280-8594-debba04edcec tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:42.458817 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d8a31ad3-727c-4280-8594-debba04edcec tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:42.564314 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ae4306f5-e8a0-47b6-bf70-1621985ae764 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:42.568078 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ae4306f5-e8a0-47b6-bf70-1621985ae764 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:42.575043 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:32:42.578448 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=6 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:32:42.589037 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ae4306f5-e8a0-47b6-bf70-1621985ae764 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:42.589406 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-d8a31ad3-727c-4280-8594-debba04edcec tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd49331138a4dbc912bc7bf6f6b0215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842a1aca542f416eab5d43b881325917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:42.589956 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ae4306f5-e8a0-47b6-bf70-1621985ae764 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:42.609836 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-d8a31ad3-727c-4280-8594-debba04edcec tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] 10.222.0.17 "GET /compute/v2.1/servers/2ec03ea9-c0f4-41a6-93cb-bf713381760b" status: 200 len: 1300 microversion: 2.1 time: 0.172836 Jul 23 21:32:42.610450 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ae4306f5-e8a0-47b6-bf70-1621985ae764 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:42.610966 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ae4306f5-e8a0-47b6-bf70-1621985ae764 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:42.613403 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2359/4644] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:42 2022] GET /compute/v2.1/servers/2ec03ea9-c0f4-41a6-93cb-bf713381760b => generated 1300 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:32:42.630612 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-dc124494-f011-41ae-804d-6778af308298 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:42.649226 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-dc124494-f011-41ae-804d-6778af308298 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:42.665117 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-dc124494-f011-41ae-804d-6778af308298 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:42.665617 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-dc124494-f011-41ae-804d-6778af308298 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:42.666457 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-dc124494-f011-41ae-804d-6778af308298 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:42.669274 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-dc124494-f011-41ae-804d-6778af308298 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:42.867149 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-dc124494-f011-41ae-804d-6778af308298 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:42.881044 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-dc124494-f011-41ae-804d-6778af308298 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:42.883097 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-dc124494-f011-41ae-804d-6778af308298 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:42.884687 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-dc124494-f011-41ae-804d-6778af308298 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.258425 Jul 23 21:32:42.885703 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2360/4645] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:32:42 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:32:42.965280 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ae4306f5-e8a0-47b6-bf70-1621985ae764 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:42.985230 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ae4306f5-e8a0-47b6-bf70-1621985ae764 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1518 microversion: 2.1 time: 0.425675 Jul 23 21:32:42.986243 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2286/4646] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:42 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1518 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:32:43.636423 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-fd75de39-da64-420e-a4db-1b5346e4b36f tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:43.637772 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-fd75de39-da64-420e-a4db-1b5346e4b36f tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] [instance: 2ec03ea9-c0f4-41a6-93cb-bf713381760b] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:43.640109 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell0:SELECT=2 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:32:43.654323 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fd75de39-da64-420e-a4db-1b5346e4b36f tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:43.655096 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fd75de39-da64-420e-a4db-1b5346e4b36f tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:43.658830 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fd75de39-da64-420e-a4db-1b5346e4b36f tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:43.659510 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fd75de39-da64-420e-a4db-1b5346e4b36f tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:43.909487 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1370959f-b914-4932-9698-5b5d3aa7ceff tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:43.911458 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1370959f-b914-4932-9698-5b5d3aa7ceff tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:43.917243 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-fd75de39-da64-420e-a4db-1b5346e4b36f tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd49331138a4dbc912bc7bf6f6b0215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842a1aca542f416eab5d43b881325917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:43.928030 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1370959f-b914-4932-9698-5b5d3aa7ceff tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:43.928482 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1370959f-b914-4932-9698-5b5d3aa7ceff tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:43.929271 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1370959f-b914-4932-9698-5b5d3aa7ceff tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:43.929714 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1370959f-b914-4932-9698-5b5d3aa7ceff tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:43.944790 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-fd75de39-da64-420e-a4db-1b5346e4b36f tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] 10.222.0.17 "GET /compute/v2.1/servers/2ec03ea9-c0f4-41a6-93cb-bf713381760b" status: 200 len: 1300 microversion: 2.1 time: 0.316472 Jul 23 21:32:43.956939 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2361/4647] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:43 2022] GET /compute/v2.1/servers/2ec03ea9-c0f4-41a6-93cb-bf713381760b => generated 1300 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:32:44.002902 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a627bcf3-487a-44f3-a1d2-c53f2f605095 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:44.003960 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-a627bcf3-487a-44f3-a1d2-c53f2f605095 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:44.018367 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a627bcf3-487a-44f3-a1d2-c53f2f605095 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:44.019410 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a627bcf3-487a-44f3-a1d2-c53f2f605095 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:44.021476 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a627bcf3-487a-44f3-a1d2-c53f2f605095 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:44.022273 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a627bcf3-487a-44f3-a1d2-c53f2f605095 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:44.052745 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-1370959f-b914-4932-9698-5b5d3aa7ceff tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:44.065662 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-1370959f-b914-4932-9698-5b5d3aa7ceff tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:44.067736 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-1370959f-b914-4932-9698-5b5d3aa7ceff tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:44.069353 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1370959f-b914-4932-9698-5b5d3aa7ceff tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.166055 Jul 23 21:32:44.070781 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2287/4648] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:32:43 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:32:44.484409 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-a627bcf3-487a-44f3-a1d2-c53f2f605095 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:44.514801 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-a627bcf3-487a-44f3-a1d2-c53f2f605095 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1518 microversion: 2.1 time: 0.515221 Jul 23 21:32:44.515584 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2362/4649] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:43 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1518 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:32:44.964543 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b6877f3e-d970-4d71-bacf-3993c9da561b tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:44.965194 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b6877f3e-d970-4d71-bacf-3993c9da561b tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] [instance: 2ec03ea9-c0f4-41a6-93cb-bf713381760b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:44.981396 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b6877f3e-d970-4d71-bacf-3993c9da561b tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:44.981883 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b6877f3e-d970-4d71-bacf-3993c9da561b tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:44.982677 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b6877f3e-d970-4d71-bacf-3993c9da561b tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:44.983123 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b6877f3e-d970-4d71-bacf-3993c9da561b tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:45.090257 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-053d008a-5914-4b1d-a79f-b4d286d770f8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:45.090903 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-053d008a-5914-4b1d-a79f-b4d286d770f8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:45.102474 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-053d008a-5914-4b1d-a79f-b4d286d770f8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:45.104093 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-053d008a-5914-4b1d-a79f-b4d286d770f8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:45.104994 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-053d008a-5914-4b1d-a79f-b4d286d770f8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:45.106173 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-053d008a-5914-4b1d-a79f-b4d286d770f8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:45.349775 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-053d008a-5914-4b1d-a79f-b4d286d770f8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:45.389877 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-053d008a-5914-4b1d-a79f-b4d286d770f8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:45.391981 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-053d008a-5914-4b1d-a79f-b4d286d770f8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:45.395286 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-053d008a-5914-4b1d-a79f-b4d286d770f8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.310610 Jul 23 21:32:45.417947 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2363/4650] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:32:45 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:32:45.498511 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b6877f3e-d970-4d71-bacf-3993c9da561b tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd49331138a4dbc912bc7bf6f6b0215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842a1aca542f416eab5d43b881325917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:45.524427 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b6877f3e-d970-4d71-bacf-3993c9da561b tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] 10.222.0.17 "GET /compute/v2.1/servers/2ec03ea9-c0f4-41a6-93cb-bf713381760b" status: 200 len: 1300 microversion: 2.1 time: 0.564306 Jul 23 21:32:45.526503 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2288/4651] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:44 2022] GET /compute/v2.1/servers/2ec03ea9-c0f4-41a6-93cb-bf713381760b => generated 1300 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:32:45.532161 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-239c0973-4d3f-4f52-8534-44fceda47cda tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:45.533064 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-239c0973-4d3f-4f52-8534-44fceda47cda tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:45.544452 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-239c0973-4d3f-4f52-8534-44fceda47cda tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:45.544974 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-239c0973-4d3f-4f52-8534-44fceda47cda tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:45.545844 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-239c0973-4d3f-4f52-8534-44fceda47cda tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:45.550260 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-239c0973-4d3f-4f52-8534-44fceda47cda tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:45.552733 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-f26ad866-40db-4d35-9443-220f80772110 req-17f35a39-ad0b-4e37-8210-d24fcdd4b9b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ec03ea9-c0f4-41a6-93cb-bf713381760b", "name": "network-vif-plugged", "status": "completed", "tag": "fd0afce0-b59f-447f-b37d-b1fb5f51e6eb"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:32:45.567187 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-f26ad866-40db-4d35-9443-220f80772110 req-17f35a39-ad0b-4e37-8210-d24fcdd4b9b8 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:45.582420 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-f26ad866-40db-4d35-9443-220f80772110 req-17f35a39-ad0b-4e37-8210-d24fcdd4b9b8 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:45.608263 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-f26ad866-40db-4d35-9443-220f80772110 req-17f35a39-ad0b-4e37-8210-d24fcdd4b9b8 service nova] Creating event network-vif-plugged:fd0afce0-b59f-447f-b37d-b1fb5f51e6eb for instance 2ec03ea9-c0f4-41a6-93cb-bf713381760b on nch1-master-1 Jul 23 21:32:45.621760 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-f26ad866-40db-4d35-9443-220f80772110 req-17f35a39-ad0b-4e37-8210-d24fcdd4b9b8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073151 Jul 23 21:32:45.623269 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2289/4652] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:32:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:32:45.753087 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-239c0973-4d3f-4f52-8534-44fceda47cda tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:45.766198 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-239c0973-4d3f-4f52-8534-44fceda47cda tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1518 microversion: 2.1 time: 0.237759 Jul 23 21:32:45.776492 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2364/4653] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:45 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1518 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:32:46.422403 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8d425ca5-f040-435a-b02c-cb8dc0e657e2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:46.423205 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8d425ca5-f040-435a-b02c-cb8dc0e657e2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:46.431171 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8d425ca5-f040-435a-b02c-cb8dc0e657e2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:46.431807 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8d425ca5-f040-435a-b02c-cb8dc0e657e2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:46.433278 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8d425ca5-f040-435a-b02c-cb8dc0e657e2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:46.434409 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8d425ca5-f040-435a-b02c-cb8dc0e657e2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:46.528147 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8d425ca5-f040-435a-b02c-cb8dc0e657e2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:46.542868 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-4d39e222-6d13-4d05-a1f5-d6d2f9270c84 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:46.544143 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-4d39e222-6d13-4d05-a1f5-d6d2f9270c84 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] [instance: 2ec03ea9-c0f4-41a6-93cb-bf713381760b] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:46.550412 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8d425ca5-f040-435a-b02c-cb8dc0e657e2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:46.554826 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4d39e222-6d13-4d05-a1f5-d6d2f9270c84 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:46.558307 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4d39e222-6d13-4d05-a1f5-d6d2f9270c84 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:46.561301 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4d39e222-6d13-4d05-a1f5-d6d2f9270c84 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:46.566765 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8d425ca5-f040-435a-b02c-cb8dc0e657e2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:46.567662 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4d39e222-6d13-4d05-a1f5-d6d2f9270c84 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:46.572600 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8d425ca5-f040-435a-b02c-cb8dc0e657e2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.153167 Jul 23 21:32:46.573225 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2290/4654] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:32:46 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:32:46.747870 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-4d39e222-6d13-4d05-a1f5-d6d2f9270c84 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd49331138a4dbc912bc7bf6f6b0215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842a1aca542f416eab5d43b881325917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:46.766781 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-4d39e222-6d13-4d05-a1f5-d6d2f9270c84 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] 10.222.0.17 "GET /compute/v2.1/servers/2ec03ea9-c0f4-41a6-93cb-bf713381760b" status: 200 len: 1300 microversion: 2.1 time: 0.226791 Jul 23 21:32:46.776122 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2365/4655] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:46 2022] GET /compute/v2.1/servers/2ec03ea9-c0f4-41a6-93cb-bf713381760b => generated 1300 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:32:46.785063 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-7f9c86bb-261c-4e6e-97cf-b407fbb7668c tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:46.786116 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-7f9c86bb-261c-4e6e-97cf-b407fbb7668c tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:46.793905 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7f9c86bb-261c-4e6e-97cf-b407fbb7668c tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:46.794603 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7f9c86bb-261c-4e6e-97cf-b407fbb7668c tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:46.795568 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7f9c86bb-261c-4e6e-97cf-b407fbb7668c tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:46.796157 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7f9c86bb-261c-4e6e-97cf-b407fbb7668c tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:47.078914 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-7f9c86bb-261c-4e6e-97cf-b407fbb7668c tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:47.091631 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-7f9c86bb-261c-4e6e-97cf-b407fbb7668c tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1518 microversion: 2.1 time: 0.311462 Jul 23 21:32:47.092637 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2291/4656] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:46 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1518 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:32:47.592748 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-fb4cb371-da7b-48a2-8e36-0a5579e9ece8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:47.594017 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-fb4cb371-da7b-48a2-8e36-0a5579e9ece8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:47.607041 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fb4cb371-da7b-48a2-8e36-0a5579e9ece8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:47.607776 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fb4cb371-da7b-48a2-8e36-0a5579e9ece8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:47.613559 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fb4cb371-da7b-48a2-8e36-0a5579e9ece8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:47.614058 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fb4cb371-da7b-48a2-8e36-0a5579e9ece8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:47.761132 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-fb4cb371-da7b-48a2-8e36-0a5579e9ece8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:47.783910 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-bbddb1ff-22fa-4098-8709-c64a3c822f6c tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:47.784462 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-bbddb1ff-22fa-4098-8709-c64a3c822f6c tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] [instance: 2ec03ea9-c0f4-41a6-93cb-bf713381760b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:47.797550 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-fb4cb371-da7b-48a2-8e36-0a5579e9ece8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:47.799350 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-fb4cb371-da7b-48a2-8e36-0a5579e9ece8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:47.800939 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-fb4cb371-da7b-48a2-8e36-0a5579e9ece8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.212910 Jul 23 21:32:47.818809 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bbddb1ff-22fa-4098-8709-c64a3c822f6c tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:47.819268 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bbddb1ff-22fa-4098-8709-c64a3c822f6c tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:47.820072 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bbddb1ff-22fa-4098-8709-c64a3c822f6c tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:47.820516 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bbddb1ff-22fa-4098-8709-c64a3c822f6c tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:47.827389 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2366/4657] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:32:47 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:32:47.981480 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-bbddb1ff-22fa-4098-8709-c64a3c822f6c tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd49331138a4dbc912bc7bf6f6b0215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842a1aca542f416eab5d43b881325917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:47.992973 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-bbddb1ff-22fa-4098-8709-c64a3c822f6c tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] 10.222.0.17 "GET /compute/v2.1/servers/2ec03ea9-c0f4-41a6-93cb-bf713381760b" status: 200 len: 1300 microversion: 2.1 time: 0.213126 Jul 23 21:32:47.994039 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2292/4658] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:47 2022] GET /compute/v2.1/servers/2ec03ea9-c0f4-41a6-93cb-bf713381760b => generated 1300 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:32:48.112218 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d1b462de-41dd-4f12-82a4-76be9052d82c tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:48.113182 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-d1b462de-41dd-4f12-82a4-76be9052d82c tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:48.123261 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d1b462de-41dd-4f12-82a4-76be9052d82c tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:48.123790 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d1b462de-41dd-4f12-82a4-76be9052d82c tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:48.124866 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d1b462de-41dd-4f12-82a4-76be9052d82c tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:48.125366 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d1b462de-41dd-4f12-82a4-76be9052d82c tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:48.340290 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-d1b462de-41dd-4f12-82a4-76be9052d82c tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:48.352984 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-d1b462de-41dd-4f12-82a4-76be9052d82c tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1518 microversion: 2.1 time: 0.246216 Jul 23 21:32:48.354498 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2367/4659] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:48 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1518 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:32:48.551361 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ac674355-2d12-49ee-b8f2-7cb26651cfe6 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-1528717999", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "networks": "none"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:32:48.610260 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-ac674355-2d12-49ee-b8f2-7cb26651cfe6 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:32:48.610940 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-ac674355-2d12-49ee-b8f2-7cb26651cfe6 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:32:48.611625 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-ac674355-2d12-49ee-b8f2-7cb26651cfe6 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:32:48.612236 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-ac674355-2d12-49ee-b8f2-7cb26651cfe6 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:32:48.612849 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-ac674355-2d12-49ee-b8f2-7cb26651cfe6 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:32:48.622921 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ac674355-2d12-49ee-b8f2-7cb26651cfe6 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:48.623766 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ac674355-2d12-49ee-b8f2-7cb26651cfe6 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:48.624777 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ac674355-2d12-49ee-b8f2-7cb26651cfe6 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:48.625437 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ac674355-2d12-49ee-b8f2-7cb26651cfe6 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:48.646532 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-ac674355-2d12-49ee-b8f2-7cb26651cfe6 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Getting quotas for project 967b5ba16feb4b88bd4bacf0ec6194c2. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:32:48.652654 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-ac674355-2d12-49ee-b8f2-7cb26651cfe6 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Getting quotas for user 0400e69a5bee4dcc9b55cd38de32eb76 and project 967b5ba16feb4b88bd4bacf0ec6194c2. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:32:48.665890 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ac674355-2d12-49ee-b8f2-7cb26651cfe6 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Going to run 1 instances... {{(pid=131320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:32:48.668528 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ac674355-2d12-49ee-b8f2-7cb26651cfe6 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] [instance: 0352d36b-f7b0-4c09-8517-a5711438d586] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:32:48.721707 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ac674355-2d12-49ee-b8f2-7cb26651cfe6 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.321256 Jul 23 21:32:48.722881 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2293/4660] 10.222.0.17 () {62 vars in 1187 bytes} [Sat Jul 23 21:32:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 323 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 23 21:32:48.733226 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-06c64cec-4c59-4ef1-b771-67b2739c0eaf tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:48.733986 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-06c64cec-4c59-4ef1-b771-67b2739c0eaf tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] [instance: 0352d36b-f7b0-4c09-8517-a5711438d586] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:48.802414 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-06c64cec-4c59-4ef1-b771-67b2739c0eaf tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:48.813540 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-06c64cec-4c59-4ef1-b771-67b2739c0eaf tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:48.823614 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-17e8d36f-d568-42a1-a527-eadb923ebd7f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:48.824248 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-17e8d36f-d568-42a1-a527-eadb923ebd7f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:48.833088 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-06c64cec-4c59-4ef1-b771-67b2739c0eaf tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:48.839953 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-06c64cec-4c59-4ef1-b771-67b2739c0eaf tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] 10.222.0.17 "GET /compute/v2.1/servers/0352d36b-f7b0-4c09-8517-a5711438d586" status: 200 len: 1278 microversion: 2.57 time: 0.107855 Jul 23 21:32:48.841625 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2368/4661] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:32:48 2022] GET /compute/v2.1/servers/0352d36b-f7b0-4c09-8517-a5711438d586 => generated 1278 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:32:48.842800 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-17e8d36f-d568-42a1-a527-eadb923ebd7f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:48.843411 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-17e8d36f-d568-42a1-a527-eadb923ebd7f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:48.844213 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-17e8d36f-d568-42a1-a527-eadb923ebd7f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:48.844704 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-17e8d36f-d568-42a1-a527-eadb923ebd7f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:48.996571 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-fa988b7b-f8c3-4da4-af08-3b8be3132310 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:48.997527 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-fa988b7b-f8c3-4da4-af08-3b8be3132310 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] [instance: f66b6134-b8aa-4df7-9905-b7488fe6bc85] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:49.006646 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-17e8d36f-d568-42a1-a527-eadb923ebd7f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:49.012193 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fa988b7b-f8c3-4da4-af08-3b8be3132310 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:49.014529 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fa988b7b-f8c3-4da4-af08-3b8be3132310 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:49.015702 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fa988b7b-f8c3-4da4-af08-3b8be3132310 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:49.017425 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-17e8d36f-d568-42a1-a527-eadb923ebd7f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:49.018178 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fa988b7b-f8c3-4da4-af08-3b8be3132310 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:49.019524 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-17e8d36f-d568-42a1-a527-eadb923ebd7f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:49.021027 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-17e8d36f-d568-42a1-a527-eadb923ebd7f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.204969 Jul 23 21:32:49.022145 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2294/4662] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:32:48 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:32:49.026855 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2885cd82-9ffa-432f-a647-b5009443864f tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:49.027663 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-2885cd82-9ffa-432f-a647-b5009443864f tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] [instance: 2ec03ea9-c0f4-41a6-93cb-bf713381760b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:49.034023 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2885cd82-9ffa-432f-a647-b5009443864f tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:49.034661 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2885cd82-9ffa-432f-a647-b5009443864f tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:49.035434 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2885cd82-9ffa-432f-a647-b5009443864f tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:49.035962 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2885cd82-9ffa-432f-a647-b5009443864f tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:49.081853 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-fa988b7b-f8c3-4da4-af08-3b8be3132310 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] 10.222.0.17 "GET /compute/v2.1/servers/f66b6134-b8aa-4df7-9905-b7488fe6bc85/ips" status: 200 len: 148 microversion: 2.1 time: 0.094547 Jul 23 21:32:49.085761 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2369/4663] 10.222.0.17 () {58 vars in 1247 bytes} [Sat Jul 23 21:32:48 2022] GET /compute/v2.1/servers/f66b6134-b8aa-4df7-9905-b7488fe6bc85/ips => generated 148 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:32:49.196810 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-2885cd82-9ffa-432f-a647-b5009443864f tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd49331138a4dbc912bc7bf6f6b0215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842a1aca542f416eab5d43b881325917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:49.210096 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2885cd82-9ffa-432f-a647-b5009443864f tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] 10.222.0.17 "GET /compute/v2.1/servers/2ec03ea9-c0f4-41a6-93cb-bf713381760b" status: 200 len: 1300 microversion: 2.1 time: 0.185192 Jul 23 21:32:49.221482 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2295/4664] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:49 2022] GET /compute/v2.1/servers/2ec03ea9-c0f4-41a6-93cb-bf713381760b => generated 1300 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:32:49.375528 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-4469df8c-9fc9-4a16-9046-e5d253daac4d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:49.376167 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-4469df8c-9fc9-4a16-9046-e5d253daac4d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:49.390986 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4469df8c-9fc9-4a16-9046-e5d253daac4d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:49.391699 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4469df8c-9fc9-4a16-9046-e5d253daac4d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:49.393801 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4469df8c-9fc9-4a16-9046-e5d253daac4d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:49.394281 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4469df8c-9fc9-4a16-9046-e5d253daac4d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:49.646062 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-4469df8c-9fc9-4a16-9046-e5d253daac4d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:49.655830 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-4469df8c-9fc9-4a16-9046-e5d253daac4d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1518 microversion: 2.1 time: 0.287626 Jul 23 21:32:49.662768 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2370/4665] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:49 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1518 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:32:49.860703 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-859b6bda-92fe-44ee-8336-586cd449e77a tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:49.861553 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-859b6bda-92fe-44ee-8336-586cd449e77a tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] [instance: 0352d36b-f7b0-4c09-8517-a5711438d586] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:49.875732 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-859b6bda-92fe-44ee-8336-586cd449e77a tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:49.876190 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-859b6bda-92fe-44ee-8336-586cd449e77a tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:49.876983 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-859b6bda-92fe-44ee-8336-586cd449e77a tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:49.877428 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-859b6bda-92fe-44ee-8336-586cd449e77a tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:49.945400 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-859b6bda-92fe-44ee-8336-586cd449e77a tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:49.954352 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-859b6bda-92fe-44ee-8336-586cd449e77a tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:49.956236 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-859b6bda-92fe-44ee-8336-586cd449e77a tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:49.957014 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-859b6bda-92fe-44ee-8336-586cd449e77a tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] 10.222.0.17 "GET /compute/v2.1/servers/0352d36b-f7b0-4c09-8517-a5711438d586" status: 200 len: 1282 microversion: 2.57 time: 0.101841 Jul 23 21:32:49.957587 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2296/4666] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:32:49 2022] GET /compute/v2.1/servers/0352d36b-f7b0-4c09-8517-a5711438d586 => generated 1282 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:32:50.040930 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-14f1d922-9b16-4b34-afeb-aeba8ac51b00 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:50.040930 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-14f1d922-9b16-4b34-afeb-aeba8ac51b00 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:50.048358 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-14f1d922-9b16-4b34-afeb-aeba8ac51b00 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:50.048823 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-14f1d922-9b16-4b34-afeb-aeba8ac51b00 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:50.049618 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-14f1d922-9b16-4b34-afeb-aeba8ac51b00 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:50.050112 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-14f1d922-9b16-4b34-afeb-aeba8ac51b00 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:50.125719 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-14f1d922-9b16-4b34-afeb-aeba8ac51b00 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:50.137039 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-14f1d922-9b16-4b34-afeb-aeba8ac51b00 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:50.139018 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-14f1d922-9b16-4b34-afeb-aeba8ac51b00 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:50.140379 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-14f1d922-9b16-4b34-afeb-aeba8ac51b00 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.103981 Jul 23 21:32:50.141220 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2371/4667] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:32:50 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:32:50.230408 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e6618598-4fb6-47bd-bb5f-6cb068e335d2 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:50.231021 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e6618598-4fb6-47bd-bb5f-6cb068e335d2 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] [instance: 2ec03ea9-c0f4-41a6-93cb-bf713381760b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:50.237529 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e6618598-4fb6-47bd-bb5f-6cb068e335d2 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:50.238003 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e6618598-4fb6-47bd-bb5f-6cb068e335d2 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:50.238785 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e6618598-4fb6-47bd-bb5f-6cb068e335d2 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:50.239421 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e6618598-4fb6-47bd-bb5f-6cb068e335d2 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:50.344267 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e6618598-4fb6-47bd-bb5f-6cb068e335d2 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd49331138a4dbc912bc7bf6f6b0215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842a1aca542f416eab5d43b881325917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:50.352023 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e6618598-4fb6-47bd-bb5f-6cb068e335d2 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] 10.222.0.17 "GET /compute/v2.1/servers/2ec03ea9-c0f4-41a6-93cb-bf713381760b" status: 200 len: 1300 microversion: 2.1 time: 0.126173 Jul 23 21:32:50.352654 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2297/4668] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:50 2022] GET /compute/v2.1/servers/2ec03ea9-c0f4-41a6-93cb-bf713381760b => generated 1300 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:32:50.675859 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-156479e9-04a0-4dad-94e9-19af2d8947d1 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:50.676487 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-156479e9-04a0-4dad-94e9-19af2d8947d1 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:50.683217 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-156479e9-04a0-4dad-94e9-19af2d8947d1 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:50.683680 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-156479e9-04a0-4dad-94e9-19af2d8947d1 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:50.684476 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-156479e9-04a0-4dad-94e9-19af2d8947d1 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:50.685077 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-156479e9-04a0-4dad-94e9-19af2d8947d1 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:50.703961 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=100 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:32:50.828140 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-17f5c151-d7f7-4c77-ad2b-35d2113c6056 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:50.828755 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-17f5c151-d7f7-4c77-ad2b-35d2113c6056 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] [instance: f66b6134-b8aa-4df7-9905-b7488fe6bc85] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:50.835881 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-17f5c151-d7f7-4c77-ad2b-35d2113c6056 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:50.836620 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-17f5c151-d7f7-4c77-ad2b-35d2113c6056 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:50.837651 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-17f5c151-d7f7-4c77-ad2b-35d2113c6056 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:50.838444 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-17f5c151-d7f7-4c77-ad2b-35d2113c6056 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:50.844170 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-156479e9-04a0-4dad-94e9-19af2d8947d1 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:50.854383 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-156479e9-04a0-4dad-94e9-19af2d8947d1 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1518 microversion: 2.1 time: 0.185467 Jul 23 21:32:50.855699 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2372/4669] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:50 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1518 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:32:50.865128 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-17f5c151-d7f7-4c77-ad2b-35d2113c6056 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] [instance: f66b6134-b8aa-4df7-9905-b7488fe6bc85] Going to try to terminate instance {{(pid=131320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:32:50.868958 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=100 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:32:50.944952 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-17f5c151-d7f7-4c77-ad2b-35d2113c6056 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] 10.222.0.17 "DELETE /compute/v2.1/servers/f66b6134-b8aa-4df7-9905-b7488fe6bc85" status: 204 len: 0 microversion: 2.1 time: 0.137971 Jul 23 21:32:50.945568 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2298/4670] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:32:50 2022] DELETE /compute/v2.1/servers/f66b6134-b8aa-4df7-9905-b7488fe6bc85 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 23 21:32:50.954029 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c5c5d0cb-1827-4de0-9215-fe5c150e8a55 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:50.954914 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-c5c5d0cb-1827-4de0-9215-fe5c150e8a55 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] [instance: f66b6134-b8aa-4df7-9905-b7488fe6bc85] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:50.961319 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c5c5d0cb-1827-4de0-9215-fe5c150e8a55 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:50.961781 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c5c5d0cb-1827-4de0-9215-fe5c150e8a55 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:50.962855 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c5c5d0cb-1827-4de0-9215-fe5c150e8a55 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:50.963305 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c5c5d0cb-1827-4de0-9215-fe5c150e8a55 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:50.976067 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-24b03837-d030-4231-92bd-8e3ad60814ea tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:50.977013 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-24b03837-d030-4231-92bd-8e3ad60814ea tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] [instance: 0352d36b-f7b0-4c09-8517-a5711438d586] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:50.984104 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-24b03837-d030-4231-92bd-8e3ad60814ea tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:50.984556 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-24b03837-d030-4231-92bd-8e3ad60814ea tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:50.985336 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-24b03837-d030-4231-92bd-8e3ad60814ea tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:50.985808 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-24b03837-d030-4231-92bd-8e3ad60814ea tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:51.070056 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-24b03837-d030-4231-92bd-8e3ad60814ea tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:51.078790 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-24b03837-d030-4231-92bd-8e3ad60814ea tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:51.080286 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-24b03837-d030-4231-92bd-8e3ad60814ea tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:51.081422 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-24b03837-d030-4231-92bd-8e3ad60814ea tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] 10.222.0.17 "GET /compute/v2.1/servers/0352d36b-f7b0-4c09-8517-a5711438d586" status: 200 len: 1274 microversion: 2.57 time: 0.109834 Jul 23 21:32:51.082045 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2299/4671] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:32:50 2022] GET /compute/v2.1/servers/0352d36b-f7b0-4c09-8517-a5711438d586 => generated 1274 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:32:51.106987 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c5c5d0cb-1827-4de0-9215-fe5c150e8a55 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b1e260651b4dffa7c1efe8e9d0f144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcf55bcaba04bf8ae8a9b2ac09e8d98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:51.114679 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-c5c5d0cb-1827-4de0-9215-fe5c150e8a55 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] 10.222.0.17 "GET /compute/v2.1/servers/f66b6134-b8aa-4df7-9905-b7488fe6bc85" status: 200 len: 1680 microversion: 2.1 time: 0.164635 Jul 23 21:32:51.115257 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2373/4672] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:50 2022] GET /compute/v2.1/servers/f66b6134-b8aa-4df7-9905-b7488fe6bc85 => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:32:51.160344 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-647ba46c-9081-44df-88c9-b881331da3e0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:51.160987 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-647ba46c-9081-44df-88c9-b881331da3e0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:51.167226 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-647ba46c-9081-44df-88c9-b881331da3e0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:51.167676 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-647ba46c-9081-44df-88c9-b881331da3e0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:51.168463 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-647ba46c-9081-44df-88c9-b881331da3e0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:51.168906 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-647ba46c-9081-44df-88c9-b881331da3e0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:51.231474 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-647ba46c-9081-44df-88c9-b881331da3e0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:51.240849 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-647ba46c-9081-44df-88c9-b881331da3e0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:51.242976 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-647ba46c-9081-44df-88c9-b881331da3e0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:51.244707 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-647ba46c-9081-44df-88c9-b881331da3e0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.088023 Jul 23 21:32:51.245557 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2300/4673] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:32:51 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:32:51.368928 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-18d70bbe-d99c-438f-8a4b-da0de67af760 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:51.369560 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-18d70bbe-d99c-438f-8a4b-da0de67af760 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] [instance: 2ec03ea9-c0f4-41a6-93cb-bf713381760b] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:51.376475 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-18d70bbe-d99c-438f-8a4b-da0de67af760 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:51.376942 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-18d70bbe-d99c-438f-8a4b-da0de67af760 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:51.377773 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-18d70bbe-d99c-438f-8a4b-da0de67af760 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:51.378260 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-18d70bbe-d99c-438f-8a4b-da0de67af760 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:51.464931 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-18d70bbe-d99c-438f-8a4b-da0de67af760 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd49331138a4dbc912bc7bf6f6b0215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842a1aca542f416eab5d43b881325917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:51.472543 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-18d70bbe-d99c-438f-8a4b-da0de67af760 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] 10.222.0.17 "GET /compute/v2.1/servers/2ec03ea9-c0f4-41a6-93cb-bf713381760b" status: 200 len: 1300 microversion: 2.1 time: 0.107836 Jul 23 21:32:51.473362 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2374/4674] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:51 2022] GET /compute/v2.1/servers/2ec03ea9-c0f4-41a6-93cb-bf713381760b => generated 1300 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:32:51.872802 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-aebfe864-9dd0-40ee-ae5d-14d72fdee85d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:51.873402 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-aebfe864-9dd0-40ee-ae5d-14d72fdee85d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:51.885343 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-aebfe864-9dd0-40ee-ae5d-14d72fdee85d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:51.885774 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-aebfe864-9dd0-40ee-ae5d-14d72fdee85d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:51.886702 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-aebfe864-9dd0-40ee-ae5d-14d72fdee85d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:51.887053 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-aebfe864-9dd0-40ee-ae5d-14d72fdee85d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:52.028746 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-aebfe864-9dd0-40ee-ae5d-14d72fdee85d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:52.037659 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-aebfe864-9dd0-40ee-ae5d-14d72fdee85d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1518 microversion: 2.1 time: 0.169274 Jul 23 21:32:52.038382 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2301/4675] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:51 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1518 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:32:52.100840 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ce669511-b752-4501-89dd-24c298c33d6d tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:52.101778 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-ce669511-b752-4501-89dd-24c298c33d6d tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] [instance: 0352d36b-f7b0-4c09-8517-a5711438d586] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:52.111808 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ce669511-b752-4501-89dd-24c298c33d6d tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:52.112678 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ce669511-b752-4501-89dd-24c298c33d6d tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:52.114580 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ce669511-b752-4501-89dd-24c298c33d6d tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:52.115441 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ce669511-b752-4501-89dd-24c298c33d6d tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:52.133261 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9031956d-340e-48a8-b450-4b4dee938b19 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:52.133812 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-9031956d-340e-48a8-b450-4b4dee938b19 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] [instance: f66b6134-b8aa-4df7-9905-b7488fe6bc85] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:52.144677 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9031956d-340e-48a8-b450-4b4dee938b19 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:52.145021 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9031956d-340e-48a8-b450-4b4dee938b19 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:52.145820 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9031956d-340e-48a8-b450-4b4dee938b19 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:52.146479 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9031956d-340e-48a8-b450-4b4dee938b19 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:52.187226 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ce669511-b752-4501-89dd-24c298c33d6d tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:52.196510 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ce669511-b752-4501-89dd-24c298c33d6d tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:52.198110 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ce669511-b752-4501-89dd-24c298c33d6d tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:52.199297 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-ce669511-b752-4501-89dd-24c298c33d6d tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] 10.222.0.17 "GET /compute/v2.1/servers/0352d36b-f7b0-4c09-8517-a5711438d586" status: 200 len: 1330 microversion: 2.57 time: 0.102679 Jul 23 21:32:52.200162 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2375/4676] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:32:52 2022] GET /compute/v2.1/servers/0352d36b-f7b0-4c09-8517-a5711438d586 => generated 1330 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:32:52.265025 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-5b327e35-64c5-4810-94b7-1ae96f2e385e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:52.265694 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-5b327e35-64c5-4810-94b7-1ae96f2e385e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:52.279443 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5b327e35-64c5-4810-94b7-1ae96f2e385e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:52.279896 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5b327e35-64c5-4810-94b7-1ae96f2e385e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:52.280861 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5b327e35-64c5-4810-94b7-1ae96f2e385e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:52.281464 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5b327e35-64c5-4810-94b7-1ae96f2e385e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:52.314254 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-9031956d-340e-48a8-b450-4b4dee938b19 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b1e260651b4dffa7c1efe8e9d0f144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcf55bcaba04bf8ae8a9b2ac09e8d98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:52.327475 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9031956d-340e-48a8-b450-4b4dee938b19 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] 10.222.0.17 "GET /compute/v2.1/servers/f66b6134-b8aa-4df7-9905-b7488fe6bc85" status: 200 len: 1680 microversion: 2.1 time: 0.198529 Jul 23 21:32:52.328669 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2302/4677] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:52 2022] GET /compute/v2.1/servers/f66b6134-b8aa-4df7-9905-b7488fe6bc85 => generated 1680 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:32:52.354376 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-5b327e35-64c5-4810-94b7-1ae96f2e385e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:52.364199 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-5b327e35-64c5-4810-94b7-1ae96f2e385e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:52.365738 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-5b327e35-64c5-4810-94b7-1ae96f2e385e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:52.367095 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-5b327e35-64c5-4810-94b7-1ae96f2e385e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.107541 Jul 23 21:32:52.367833 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2376/4678] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:32:52 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:32:52.490774 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2018cc4b-2a3f-4116-a36a-a1844e92b7ba tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:52.491395 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-2018cc4b-2a3f-4116-a36a-a1844e92b7ba tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] [instance: 2ec03ea9-c0f4-41a6-93cb-bf713381760b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:52.498121 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2018cc4b-2a3f-4116-a36a-a1844e92b7ba tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:52.498556 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2018cc4b-2a3f-4116-a36a-a1844e92b7ba tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:52.499504 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2018cc4b-2a3f-4116-a36a-a1844e92b7ba tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:52.500150 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2018cc4b-2a3f-4116-a36a-a1844e92b7ba tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:52.650237 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-2018cc4b-2a3f-4116-a36a-a1844e92b7ba tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd49331138a4dbc912bc7bf6f6b0215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842a1aca542f416eab5d43b881325917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:52.658246 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2018cc4b-2a3f-4116-a36a-a1844e92b7ba tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] 10.222.0.17 "GET /compute/v2.1/servers/2ec03ea9-c0f4-41a6-93cb-bf713381760b" status: 200 len: 1300 microversion: 2.1 time: 0.171992 Jul 23 21:32:52.659333 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2303/4679] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:52 2022] GET /compute/v2.1/servers/2ec03ea9-c0f4-41a6-93cb-bf713381760b => generated 1300 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:32:53.055531 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-b50c7804-93e5-4236-b5b8-710ec8bee6bd tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:53.056914 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-b50c7804-93e5-4236-b5b8-710ec8bee6bd tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:53.071744 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b50c7804-93e5-4236-b5b8-710ec8bee6bd tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:53.072204 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b50c7804-93e5-4236-b5b8-710ec8bee6bd tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:53.073002 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b50c7804-93e5-4236-b5b8-710ec8bee6bd tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:53.073657 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b50c7804-93e5-4236-b5b8-710ec8bee6bd tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:53.218058 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-cb944fd9-a55d-409d-b941-075e09263c9f tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:53.219351 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-cb944fd9-a55d-409d-b941-075e09263c9f tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] [instance: 0352d36b-f7b0-4c09-8517-a5711438d586] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:53.226508 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cb944fd9-a55d-409d-b941-075e09263c9f tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:53.227212 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cb944fd9-a55d-409d-b941-075e09263c9f tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:53.228399 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cb944fd9-a55d-409d-b941-075e09263c9f tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:53.229098 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cb944fd9-a55d-409d-b941-075e09263c9f tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:53.260602 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-b50c7804-93e5-4236-b5b8-710ec8bee6bd tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:53.269116 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-b50c7804-93e5-4236-b5b8-710ec8bee6bd tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1518 microversion: 2.1 time: 0.217886 Jul 23 21:32:53.270214 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2377/4680] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:53 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1518 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:32:53.311133 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-cb944fd9-a55d-409d-b941-075e09263c9f tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:53.319899 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-cb944fd9-a55d-409d-b941-075e09263c9f tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:53.321639 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-cb944fd9-a55d-409d-b941-075e09263c9f tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:53.322810 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-cb944fd9-a55d-409d-b941-075e09263c9f tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] 10.222.0.17 "GET /compute/v2.1/servers/0352d36b-f7b0-4c09-8517-a5711438d586" status: 200 len: 1336 microversion: 2.57 time: 0.108709 Jul 23 21:32:53.328725 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2304/4681] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:32:53 2022] GET /compute/v2.1/servers/0352d36b-f7b0-4c09-8517-a5711438d586 => generated 1336 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:32:53.345956 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-b01aade6-5cec-4b35-bac5-1bc8ed00d5e3 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:53.346677 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-b01aade6-5cec-4b35-bac5-1bc8ed00d5e3 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] [instance: f66b6134-b8aa-4df7-9905-b7488fe6bc85] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:53.353358 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b01aade6-5cec-4b35-bac5-1bc8ed00d5e3 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:53.354071 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b01aade6-5cec-4b35-bac5-1bc8ed00d5e3 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:53.354848 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b01aade6-5cec-4b35-bac5-1bc8ed00d5e3 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:53.355462 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b01aade6-5cec-4b35-bac5-1bc8ed00d5e3 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:53.386408 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6afdb037-9c36-454f-a2d9-fdcba6107099 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:53.387053 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6afdb037-9c36-454f-a2d9-fdcba6107099 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:53.393767 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6afdb037-9c36-454f-a2d9-fdcba6107099 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:53.394592 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6afdb037-9c36-454f-a2d9-fdcba6107099 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:53.395443 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6afdb037-9c36-454f-a2d9-fdcba6107099 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:53.395871 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6afdb037-9c36-454f-a2d9-fdcba6107099 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:53.437083 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-b01aade6-5cec-4b35-bac5-1bc8ed00d5e3 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b1e260651b4dffa7c1efe8e9d0f144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcf55bcaba04bf8ae8a9b2ac09e8d98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:53.449562 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-b01aade6-5cec-4b35-bac5-1bc8ed00d5e3 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] 10.222.0.17 "GET /compute/v2.1/servers/f66b6134-b8aa-4df7-9905-b7488fe6bc85" status: 200 len: 1612 microversion: 2.1 time: 0.107638 Jul 23 21:32:53.453968 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2378/4682] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:53 2022] GET /compute/v2.1/servers/f66b6134-b8aa-4df7-9905-b7488fe6bc85 => generated 1612 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:32:53.493631 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6afdb037-9c36-454f-a2d9-fdcba6107099 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:53.512060 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6afdb037-9c36-454f-a2d9-fdcba6107099 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:53.514116 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6afdb037-9c36-454f-a2d9-fdcba6107099 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:53.515489 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6afdb037-9c36-454f-a2d9-fdcba6107099 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.133259 Jul 23 21:32:53.532807 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2305/4683] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:32:53 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:32:53.606846 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-41bf9e82-b253-4956-8b21-da06c0f42861 req-9ad101e5-1cc0-4698-8b20-5e0ef69a212e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f66b6134-b8aa-4df7-9905-b7488fe6bc85", "name": "network-vif-deleted", "tag": "7ffd9730-367d-43b1-af40-908b309e515f"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:32:53.618868 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-41bf9e82-b253-4956-8b21-da06c0f42861 req-9ad101e5-1cc0-4698-8b20-5e0ef69a212e service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:53.619411 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-41bf9e82-b253-4956-8b21-da06c0f42861 req-9ad101e5-1cc0-4698-8b20-5e0ef69a212e service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:53.636194 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-41bf9e82-b253-4956-8b21-da06c0f42861 req-9ad101e5-1cc0-4698-8b20-5e0ef69a212e service nova] Creating event network-vif-deleted:7ffd9730-367d-43b1-af40-908b309e515f for instance f66b6134-b8aa-4df7-9905-b7488fe6bc85 on nch2-master-1 Jul 23 21:32:53.642166 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-41bf9e82-b253-4956-8b21-da06c0f42861 req-9ad101e5-1cc0-4698-8b20-5e0ef69a212e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044532 Jul 23 21:32:53.642775 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2379/4684] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:32:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:32:53.675079 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-907719d3-5bca-46f4-9832-10f6d351db1b tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:53.675797 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-907719d3-5bca-46f4-9832-10f6d351db1b tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] [instance: 2ec03ea9-c0f4-41a6-93cb-bf713381760b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:53.683581 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-907719d3-5bca-46f4-9832-10f6d351db1b tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:53.684418 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-907719d3-5bca-46f4-9832-10f6d351db1b tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:53.685636 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-907719d3-5bca-46f4-9832-10f6d351db1b tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:53.686476 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-907719d3-5bca-46f4-9832-10f6d351db1b tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:53.777817 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-907719d3-5bca-46f4-9832-10f6d351db1b tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd49331138a4dbc912bc7bf6f6b0215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842a1aca542f416eab5d43b881325917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:53.786049 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-907719d3-5bca-46f4-9832-10f6d351db1b tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] 10.222.0.17 "GET /compute/v2.1/servers/2ec03ea9-c0f4-41a6-93cb-bf713381760b" status: 200 len: 1473 microversion: 2.1 time: 0.114946 Jul 23 21:32:53.787039 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2306/4685] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:53 2022] GET /compute/v2.1/servers/2ec03ea9-c0f4-41a6-93cb-bf713381760b => generated 1473 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:32:53.806962 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-0ec06d53-ebd8-49ea-8e1e-c36d178b28ca tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:53.807673 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-0ec06d53-ebd8-49ea-8e1e-c36d178b28ca tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] [instance: 2ec03ea9-c0f4-41a6-93cb-bf713381760b] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:53.815389 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0ec06d53-ebd8-49ea-8e1e-c36d178b28ca tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:53.816165 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0ec06d53-ebd8-49ea-8e1e-c36d178b28ca tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:53.817148 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0ec06d53-ebd8-49ea-8e1e-c36d178b28ca tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:53.817779 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0ec06d53-ebd8-49ea-8e1e-c36d178b28ca tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:53.914584 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-0ec06d53-ebd8-49ea-8e1e-c36d178b28ca tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd49331138a4dbc912bc7bf6f6b0215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842a1aca542f416eab5d43b881325917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:53.923678 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-0ec06d53-ebd8-49ea-8e1e-c36d178b28ca tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] 10.222.0.17 "GET /compute/v2.1/servers/2ec03ea9-c0f4-41a6-93cb-bf713381760b" status: 200 len: 1473 microversion: 2.1 time: 0.122828 Jul 23 21:32:53.924366 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2380/4686] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:53 2022] GET /compute/v2.1/servers/2ec03ea9-c0f4-41a6-93cb-bf713381760b => generated 1473 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:32:53.939632 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d1a28565-7171-4de5-ba73-368f107fd37c tempest-TestSecurityGroupsBasicOps-1374320103 tempest-TestSecurityGroupsBasicOps-1374320103-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:53.940451 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d1a28565-7171-4de5-ba73-368f107fd37c tempest-TestSecurityGroupsBasicOps-1374320103 tempest-TestSecurityGroupsBasicOps-1374320103-project-admin] [instance: 2ec03ea9-c0f4-41a6-93cb-bf713381760b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:53.947061 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d1a28565-7171-4de5-ba73-368f107fd37c tempest-TestSecurityGroupsBasicOps-1374320103 tempest-TestSecurityGroupsBasicOps-1374320103-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:53.947511 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d1a28565-7171-4de5-ba73-368f107fd37c tempest-TestSecurityGroupsBasicOps-1374320103 tempest-TestSecurityGroupsBasicOps-1374320103-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:53.948451 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d1a28565-7171-4de5-ba73-368f107fd37c tempest-TestSecurityGroupsBasicOps-1374320103 tempest-TestSecurityGroupsBasicOps-1374320103-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:53.949043 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d1a28565-7171-4de5-ba73-368f107fd37c tempest-TestSecurityGroupsBasicOps-1374320103 tempest-TestSecurityGroupsBasicOps-1374320103-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:54.063954 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d1a28565-7171-4de5-ba73-368f107fd37c tempest-TestSecurityGroupsBasicOps-1374320103 tempest-TestSecurityGroupsBasicOps-1374320103-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/2ec03ea9-c0f4-41a6-93cb-bf713381760b" status: 200 len: 1624 microversion: 2.1 time: 0.127865 Jul 23 21:32:54.065464 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2307/4687] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:53 2022] GET /compute/v2.1/servers/2ec03ea9-c0f4-41a6-93cb-bf713381760b => generated 1624 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:32:54.085220 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-73a655be-30c7-4429-bc9a-39985390e061 tempest-TestSecurityGroupsBasicOps-1374320103 tempest-TestSecurityGroupsBasicOps-1374320103-project-admin] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:54.086461 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-73a655be-30c7-4429-bc9a-39985390e061 tempest-TestSecurityGroupsBasicOps-1374320103 tempest-TestSecurityGroupsBasicOps-1374320103-project-admin] [instance: 1f5b9a5a-109e-48b5-adc1-113384944dce] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:54.095510 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-73a655be-30c7-4429-bc9a-39985390e061 tempest-TestSecurityGroupsBasicOps-1374320103 tempest-TestSecurityGroupsBasicOps-1374320103-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:54.096777 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-73a655be-30c7-4429-bc9a-39985390e061 tempest-TestSecurityGroupsBasicOps-1374320103 tempest-TestSecurityGroupsBasicOps-1374320103-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:54.098167 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-73a655be-30c7-4429-bc9a-39985390e061 tempest-TestSecurityGroupsBasicOps-1374320103 tempest-TestSecurityGroupsBasicOps-1374320103-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:54.098859 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-73a655be-30c7-4429-bc9a-39985390e061 tempest-TestSecurityGroupsBasicOps-1374320103 tempest-TestSecurityGroupsBasicOps-1374320103-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:54.286970 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-38aaf1a7-aa9d-4949-b353-c0176b4df82f tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:54.287588 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-38aaf1a7-aa9d-4949-b353-c0176b4df82f tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:54.294453 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-38aaf1a7-aa9d-4949-b353-c0176b4df82f tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:54.294919 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-38aaf1a7-aa9d-4949-b353-c0176b4df82f tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:54.295771 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-38aaf1a7-aa9d-4949-b353-c0176b4df82f tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:54.296160 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-38aaf1a7-aa9d-4949-b353-c0176b4df82f tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:54.370639 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-73a655be-30c7-4429-bc9a-39985390e061 tempest-TestSecurityGroupsBasicOps-1374320103 tempest-TestSecurityGroupsBasicOps-1374320103-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/1f5b9a5a-109e-48b5-adc1-113384944dce" status: 200 len: 1912 microversion: 2.1 time: 0.291781 Jul 23 21:32:54.372240 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2381/4688] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:54 2022] GET /compute/v2.1/servers/1f5b9a5a-109e-48b5-adc1-113384944dce => generated 1912 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:32:54.377290 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d47555c7-48ce-44a0-bdff-f2feee2741e3 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:54.378240 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-d47555c7-48ce-44a0-bdff-f2feee2741e3 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] [instance: 0352d36b-f7b0-4c09-8517-a5711438d586] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:54.385459 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d47555c7-48ce-44a0-bdff-f2feee2741e3 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:54.385971 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d47555c7-48ce-44a0-bdff-f2feee2741e3 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:54.387158 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d47555c7-48ce-44a0-bdff-f2feee2741e3 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:54.387761 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d47555c7-48ce-44a0-bdff-f2feee2741e3 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:54.468011 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-38aaf1a7-aa9d-4949-b353-c0176b4df82f tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:54.478522 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-38aaf1a7-aa9d-4949-b353-c0176b4df82f tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1518 microversion: 2.1 time: 0.193972 Jul 23 21:32:54.479462 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2308/4689] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:54 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1518 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:32:54.487681 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b60bc60e-8ad9-48e4-9c54-f5d44f7211d6 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:54.488687 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b60bc60e-8ad9-48e4-9c54-f5d44f7211d6 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] [instance: f66b6134-b8aa-4df7-9905-b7488fe6bc85] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:54.514318 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b60bc60e-8ad9-48e4-9c54-f5d44f7211d6 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:54.515034 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b60bc60e-8ad9-48e4-9c54-f5d44f7211d6 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:54.516617 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b60bc60e-8ad9-48e4-9c54-f5d44f7211d6 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:54.517267 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b60bc60e-8ad9-48e4-9c54-f5d44f7211d6 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:54.538742 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-b60bc60e-8ad9-48e4-9c54-f5d44f7211d6 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] HTTP exception thrown: Instance f66b6134-b8aa-4df7-9905-b7488fe6bc85 could not be found. Jul 23 21:32:54.541196 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b60bc60e-8ad9-48e4-9c54-f5d44f7211d6 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Request method failure captured: Jul 23 21:32:54.541196 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/f66b6134-b8aa-4df7-9905-b7488fe6bc85 HTTP/1.1 Jul 23 21:32:54.541196 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:32:54.541196 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:32:54.541196 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:32:54.541196 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:32:54.541196 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:32:54.541196 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:32:54.541196 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:32:54.541196 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:32:54.541196 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3Gh6HV9tIHJcoN46Wjr6EBasJhEuZbFRe23VWqvOs5i0B_4KLAGeVvnmZ6iexSHuUfOXTk6UOU6O-9Emh9fXdmyDDqxExiJefgV0tjF1ehtFmzTkKcDham_s0PhpTyidjx3XByPfr1uqB9BNvtB5vj0aHZ_s7b1yGmPK6uTOhFc95ZY Jul 23 21:32:54.541196 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:32:54.541196 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:32:54.541196 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:32:54.541196 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:32:54.541196 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:32:54.541196 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:32:54.541196 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: ebcf55bcaba04bf8ae8a9b2ac09e8d98 Jul 23 21:32:54.541196 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-AttachVolumeNegativeTest-319311902 Jul 23 21:32:54.541196 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:32:54.541196 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:32:54.541196 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ebcf55bcaba04bf8ae8a9b2ac09e8d98"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ebcf55bcaba04bf8ae8a9b2ac09e8d98"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ebcf55bcaba04bf8ae8a9b2ac09e8d98", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ebcf55bcaba04bf8ae8a9b2ac09e8d98"}]}] Jul 23 21:32:54.541196 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-AttachVolumeNegativeTest-319311902 Jul 23 21:32:54.541196 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: ebcf55bcaba04bf8ae8a9b2ac09e8d98 Jul 23 21:32:54.541196 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-319311902 Jul 23 21:32:54.541196 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-AttachVolumeNegativeTest-319311902-project Jul 23 21:32:54.541196 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:32:54.541196 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:32:54.541196 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 37b1e260651b4dffa7c1efe8e9d0f144 Jul 23 21:32:54.541196 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-AttachVolumeNegativeTest-319311902-project Jul 23 21:32:54.541196 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:32:54.541196 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance f66b6134-b8aa-4df7-9905-b7488fe6bc85 could not be found. Jul 23 21:32:54.541196 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': 'f66b6134-b8aa-4df7-9905-b7488fe6bc85'} Jul 23 21:32:54.541196 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:32:54.541196 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:32:54.541196 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:32:54.541196 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:32:54.541196 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:32:54.541196 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:32:54.541196 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:32:54.541196 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:32:54.541196 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:32:54.541196 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:32:54.541196 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f66b6134-b8aa-4df7-9905-b7488fe6bc85 could not be found. Jul 23 21:32:54.541196 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:32:54.541196 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:32:54.541196 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:32:54.541196 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:32:54.541196 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:32:54.541196 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:32:54.541196 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:32:54.541196 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:32:54.541196 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:32:54.541196 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:32:54.541196 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:32:54.541196 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:32:54.541196 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:32:54.541196 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:32:54.541196 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:32:54.541196 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:32:54.541196 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f66b6134-b8aa-4df7-9905-b7488fe6bc85 could not be found. Jul 23 21:32:54.541196 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:32:54.541196 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:32:54.541196 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:32:54.547019 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:32:54.547019 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:32:54.547019 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:32:54.547019 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:32:54.547019 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:32:54.547019 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f66b6134-b8aa-4df7-9905-b7488fe6bc85 could not be found. Jul 23 21:32:54.547019 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:32:54.549359 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b60bc60e-8ad9-48e4-9c54-f5d44f7211d6 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Returning 404 to user: Instance f66b6134-b8aa-4df7-9905-b7488fe6bc85 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:32:54.550486 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b60bc60e-8ad9-48e4-9c54-f5d44f7211d6 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] 10.222.0.17 "GET /compute/v2.1/servers/f66b6134-b8aa-4df7-9905-b7488fe6bc85" status: 404 len: 111 microversion: 2.1 time: 0.069342 Jul 23 21:32:54.555562 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2309/4690] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:54 2022] GET /compute/v2.1/servers/f66b6134-b8aa-4df7-9905-b7488fe6bc85 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:32:54.560283 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0d11dd89-f30e-44e9-85ad-06d59ad8b398 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:54.561317 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-0d11dd89-f30e-44e9-85ad-06d59ad8b398 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] [instance: 2ec03ea9-c0f4-41a6-93cb-bf713381760b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:54.569299 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0d11dd89-f30e-44e9-85ad-06d59ad8b398 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:54.569897 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0d11dd89-f30e-44e9-85ad-06d59ad8b398 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:54.571203 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0d11dd89-f30e-44e9-85ad-06d59ad8b398 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:54.572168 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0d11dd89-f30e-44e9-85ad-06d59ad8b398 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:54.604491 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-0d11dd89-f30e-44e9-85ad-06d59ad8b398 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] [instance: 2ec03ea9-c0f4-41a6-93cb-bf713381760b] Going to try to terminate instance {{(pid=131320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:32:54.712351 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:32:54.724266 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-0d11dd89-f30e-44e9-85ad-06d59ad8b398 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] 10.222.0.17 "DELETE /compute/v2.1/servers/2ec03ea9-c0f4-41a6-93cb-bf713381760b" status: 204 len: 0 microversion: 2.1 time: 0.167585 Jul 23 21:32:54.725529 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2310/4691] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:32:54 2022] DELETE /compute/v2.1/servers/2ec03ea9-c0f4-41a6-93cb-bf713381760b => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:32:54.733490 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-240f2db7-b7d0-431e-857b-03dc9e77c105 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:54.735443 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-240f2db7-b7d0-431e-857b-03dc9e77c105 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:54.746009 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-240f2db7-b7d0-431e-857b-03dc9e77c105 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:54.746463 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-240f2db7-b7d0-431e-857b-03dc9e77c105 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:54.747547 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-240f2db7-b7d0-431e-857b-03dc9e77c105 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:54.747784 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-240f2db7-b7d0-431e-857b-03dc9e77c105 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:54.834145 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-240f2db7-b7d0-431e-857b-03dc9e77c105 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:54.844078 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-d47555c7-48ce-44a0-bdff-f2feee2741e3 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:54.844466 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-240f2db7-b7d0-431e-857b-03dc9e77c105 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:54.846252 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-240f2db7-b7d0-431e-857b-03dc9e77c105 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:54.847514 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-240f2db7-b7d0-431e-857b-03dc9e77c105 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.120842 Jul 23 21:32:54.848080 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2311/4692] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:32:54 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:32:54.854499 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-d47555c7-48ce-44a0-bdff-f2feee2741e3 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:54.856831 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-d47555c7-48ce-44a0-bdff-f2feee2741e3 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:54.858175 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-d47555c7-48ce-44a0-bdff-f2feee2741e3 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] 10.222.0.17 "GET /compute/v2.1/servers/0352d36b-f7b0-4c09-8517-a5711438d586" status: 200 len: 1336 microversion: 2.57 time: 0.484776 Jul 23 21:32:54.858741 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2382/4693] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:32:54 2022] GET /compute/v2.1/servers/0352d36b-f7b0-4c09-8517-a5711438d586 => generated 1336 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:32:54.865933 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-730e9897-9fdf-4c2f-a68d-d6a560072fac tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Calling method '.version_select at 0x7f0b46612790>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:54.873826 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-706c7e18-9335-4506-af3c-315f502019ba tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:54.874815 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-706c7e18-9335-4506-af3c-315f502019ba tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] [instance: 2ec03ea9-c0f4-41a6-93cb-bf713381760b] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:54.883068 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-706c7e18-9335-4506-af3c-315f502019ba tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:54.883547 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-706c7e18-9335-4506-af3c-315f502019ba tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:54.884856 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-706c7e18-9335-4506-af3c-315f502019ba tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:54.885320 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-706c7e18-9335-4506-af3c-315f502019ba tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:54.890542 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-730e9897-9fdf-4c2f-a68d-d6a560072fac tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-755336650" status: 202 len: 0 microversion: 2.1 time: 0.035327 Jul 23 21:32:54.894443 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2312/4694] 10.222.0.17 () {58 vars in 1217 bytes} [Sat Jul 23 21:32:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-755336650 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:32:55.003068 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-706c7e18-9335-4506-af3c-315f502019ba tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd49331138a4dbc912bc7bf6f6b0215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842a1aca542f416eab5d43b881325917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:55.012080 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-706c7e18-9335-4506-af3c-315f502019ba tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] 10.222.0.17 "GET /compute/v2.1/servers/2ec03ea9-c0f4-41a6-93cb-bf713381760b" status: 200 len: 1479 microversion: 2.1 time: 0.144048 Jul 23 21:32:55.012986 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2383/4695] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:54 2022] GET /compute/v2.1/servers/2ec03ea9-c0f4-41a6-93cb-bf713381760b => generated 1479 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:32:55.497616 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3d557988-f373-4e0f-b570-d78120547862 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:55.498269 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-3d557988-f373-4e0f-b570-d78120547862 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:55.507204 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3d557988-f373-4e0f-b570-d78120547862 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:55.507957 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3d557988-f373-4e0f-b570-d78120547862 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:55.508801 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3d557988-f373-4e0f-b570-d78120547862 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:55.509416 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3d557988-f373-4e0f-b570-d78120547862 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:55.825770 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-3d557988-f373-4e0f-b570-d78120547862 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:55.828514 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:32:55.836359 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-3d557988-f373-4e0f-b570-d78120547862 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1518 microversion: 2.1 time: 0.343806 Jul 23 21:32:55.846283 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2313/4696] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:55 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1518 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:32:55.866821 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c09453b4-07c4-4ead-8b68-2d11e2ff7442 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:55.868276 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-c09453b4-07c4-4ead-8b68-2d11e2ff7442 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:55.879231 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c09453b4-07c4-4ead-8b68-2d11e2ff7442 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:55.880008 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c09453b4-07c4-4ead-8b68-2d11e2ff7442 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:55.881645 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c09453b4-07c4-4ead-8b68-2d11e2ff7442 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:55.884594 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-34359411-dcbb-4096-903a-aec49bbd4ba1 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:55.885357 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c09453b4-07c4-4ead-8b68-2d11e2ff7442 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:55.890884 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-34359411-dcbb-4096-903a-aec49bbd4ba1 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] [instance: 0352d36b-f7b0-4c09-8517-a5711438d586] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:55.905460 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-34359411-dcbb-4096-903a-aec49bbd4ba1 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:55.906236 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-34359411-dcbb-4096-903a-aec49bbd4ba1 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:55.907023 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-34359411-dcbb-4096-903a-aec49bbd4ba1 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:55.907463 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-34359411-dcbb-4096-903a-aec49bbd4ba1 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:55.973642 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c09453b4-07c4-4ead-8b68-2d11e2ff7442 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:55.983535 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c09453b4-07c4-4ead-8b68-2d11e2ff7442 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:55.985187 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c09453b4-07c4-4ead-8b68-2d11e2ff7442 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:55.986831 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-c09453b4-07c4-4ead-8b68-2d11e2ff7442 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.124087 Jul 23 21:32:55.987417 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2384/4697] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:32:55 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:32:56.016346 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-34359411-dcbb-4096-903a-aec49bbd4ba1 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:56.025048 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-34359411-dcbb-4096-903a-aec49bbd4ba1 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:56.026744 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-34359411-dcbb-4096-903a-aec49bbd4ba1 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:56.027894 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-34359411-dcbb-4096-903a-aec49bbd4ba1 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] 10.222.0.17 "GET /compute/v2.1/servers/0352d36b-f7b0-4c09-8517-a5711438d586" status: 200 len: 1336 microversion: 2.57 time: 0.151315 Jul 23 21:32:56.028449 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2314/4698] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:32:55 2022] GET /compute/v2.1/servers/0352d36b-f7b0-4c09-8517-a5711438d586 => generated 1336 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:32:56.031681 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-850b9a76-16ab-4c3f-a6f1-6abc0b50ead6 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:56.032305 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-850b9a76-16ab-4c3f-a6f1-6abc0b50ead6 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] [instance: 2ec03ea9-c0f4-41a6-93cb-bf713381760b] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:56.040076 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-850b9a76-16ab-4c3f-a6f1-6abc0b50ead6 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:56.040531 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-850b9a76-16ab-4c3f-a6f1-6abc0b50ead6 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:56.041314 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-850b9a76-16ab-4c3f-a6f1-6abc0b50ead6 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:56.041776 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-850b9a76-16ab-4c3f-a6f1-6abc0b50ead6 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:56.122445 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-850b9a76-16ab-4c3f-a6f1-6abc0b50ead6 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd49331138a4dbc912bc7bf6f6b0215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842a1aca542f416eab5d43b881325917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:56.132157 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-850b9a76-16ab-4c3f-a6f1-6abc0b50ead6 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] 10.222.0.17 "GET /compute/v2.1/servers/2ec03ea9-c0f4-41a6-93cb-bf713381760b" status: 200 len: 1479 microversion: 2.1 time: 0.104532 Jul 23 21:32:56.132872 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2385/4699] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:56 2022] GET /compute/v2.1/servers/2ec03ea9-c0f4-41a6-93cb-bf713381760b => generated 1479 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:32:56.340090 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e0ff4c2c-85d2-49d5-8d57-64893528334a tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Action: 'create', calling method: .version_select at 0x7f0b465ee700>, body: {"keypair": {"name": "tempest-keypair-1454771714", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3jBtJP+k4s+3BVUHo2ylz7zeQakX/HZMf54wlPJeFKuq0yQ/v7hYvjCHS9M5y/LfSLd++NHUiIkopkB+GnPsYSUPmuhl1BJaHQdnQ1br6TFngLpaiNrc8wAe/w/A5XpQ=="}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:32:56.358574 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-e0ff4c2c-85d2-49d5-8d57-64893528334a tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Getting quotas for project ebcf55bcaba04bf8ae8a9b2ac09e8d98. Resources: {'key_pairs'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:32:56.365737 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-e0ff4c2c-85d2-49d5-8d57-64893528334a tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Getting quotas for user 37b1e260651b4dffa7c1efe8e9d0f144 and project ebcf55bcaba04bf8ae8a9b2ac09e8d98. Resources: {'key_pairs'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:32:56.392080 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e0ff4c2c-85d2-49d5-8d57-64893528334a tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.056704 Jul 23 21:32:56.398560 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2315/4700] 10.222.0.17 () {60 vars in 1158 bytes} [Sat Jul 23 21:32:56 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:32:56.855220 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-08007ff2-ee99-4f17-914a-d24ca87cf848 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:56.855929 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-08007ff2-ee99-4f17-914a-d24ca87cf848 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:56.865325 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-08007ff2-ee99-4f17-914a-d24ca87cf848 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:56.866059 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-08007ff2-ee99-4f17-914a-d24ca87cf848 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:56.867000 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-08007ff2-ee99-4f17-914a-d24ca87cf848 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:56.868328 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-08007ff2-ee99-4f17-914a-d24ca87cf848 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:57.007375 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-fa32d8b0-1111-4834-80d9-abb1f026d9e4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:57.007971 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-fa32d8b0-1111-4834-80d9-abb1f026d9e4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:57.015437 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fa32d8b0-1111-4834-80d9-abb1f026d9e4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:57.016136 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fa32d8b0-1111-4834-80d9-abb1f026d9e4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:57.017105 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fa32d8b0-1111-4834-80d9-abb1f026d9e4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:57.017696 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fa32d8b0-1111-4834-80d9-abb1f026d9e4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:57.097366 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-fa32d8b0-1111-4834-80d9-abb1f026d9e4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:57.119336 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-fa32d8b0-1111-4834-80d9-abb1f026d9e4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:57.121841 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-fa32d8b0-1111-4834-80d9-abb1f026d9e4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:57.126457 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-fa32d8b0-1111-4834-80d9-abb1f026d9e4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.123775 Jul 23 21:32:57.141685 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2316/4701] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:32:57 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:32:57.151112 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1300767d-8eb5-44a4-9a8b-e611b4117438 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:57.151738 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1300767d-8eb5-44a4-9a8b-e611b4117438 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] [instance: 0352d36b-f7b0-4c09-8517-a5711438d586] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:57.158166 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1300767d-8eb5-44a4-9a8b-e611b4117438 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:57.158617 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1300767d-8eb5-44a4-9a8b-e611b4117438 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:57.160161 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1300767d-8eb5-44a4-9a8b-e611b4117438 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:57.160772 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1300767d-8eb5-44a4-9a8b-e611b4117438 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:57.238070 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-08007ff2-ee99-4f17-914a-d24ca87cf848 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:57.253598 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-08007ff2-ee99-4f17-914a-d24ca87cf848 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1518 microversion: 2.1 time: 0.402521 Jul 23 21:32:57.255907 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2386/4702] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:56 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1518 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:32:57.266450 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-1300767d-8eb5-44a4-9a8b-e611b4117438 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:57.281167 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-9c0c370c-3aa8-420b-8779-3bd28020f561 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:57.283367 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-9c0c370c-3aa8-420b-8779-3bd28020f561 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] [instance: 2ec03ea9-c0f4-41a6-93cb-bf713381760b] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:57.287325 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-1300767d-8eb5-44a4-9a8b-e611b4117438 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:57.291588 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-1300767d-8eb5-44a4-9a8b-e611b4117438 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:57.297016 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9c0c370c-3aa8-420b-8779-3bd28020f561 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:57.297971 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1300767d-8eb5-44a4-9a8b-e611b4117438 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] 10.222.0.17 "GET /compute/v2.1/servers/0352d36b-f7b0-4c09-8517-a5711438d586" status: 200 len: 1357 microversion: 2.57 time: 0.155124 Jul 23 21:32:57.298770 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2317/4703] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:32:57 2022] GET /compute/v2.1/servers/0352d36b-f7b0-4c09-8517-a5711438d586 => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:32:57.299396 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9c0c370c-3aa8-420b-8779-3bd28020f561 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:57.300337 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9c0c370c-3aa8-420b-8779-3bd28020f561 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:57.300930 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9c0c370c-3aa8-420b-8779-3bd28020f561 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:57.322849 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f890b59a-7e74-456a-ab1f-1dcea7d7909f tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:32:57.326687 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f890b59a-7e74-456a-ab1f-1dcea7d7909f tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] [instance: 0352d36b-f7b0-4c09-8517-a5711438d586] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:57.336036 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f890b59a-7e74-456a-ab1f-1dcea7d7909f tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:57.336839 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f890b59a-7e74-456a-ab1f-1dcea7d7909f tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:57.338257 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f890b59a-7e74-456a-ab1f-1dcea7d7909f tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:57.338888 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f890b59a-7e74-456a-ab1f-1dcea7d7909f tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:57.490214 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-f890b59a-7e74-456a-ab1f-1dcea7d7909f tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:32:57.490636 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-f890b59a-7e74-456a-ab1f-1dcea7d7909f tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:32:57.491455 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-f890b59a-7e74-456a-ab1f-1dcea7d7909f tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:32:57.491560 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-f890b59a-7e74-456a-ab1f-1dcea7d7909f tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:32:57.491893 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-f890b59a-7e74-456a-ab1f-1dcea7d7909f tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:32:57.496278 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-9c0c370c-3aa8-420b-8779-3bd28020f561 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd49331138a4dbc912bc7bf6f6b0215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842a1aca542f416eab5d43b881325917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:57.518055 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-9c0c370c-3aa8-420b-8779-3bd28020f561 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] 10.222.0.17 "GET /compute/v2.1/servers/2ec03ea9-c0f4-41a6-93cb-bf713381760b" status: 200 len: 1479 microversion: 2.1 time: 0.259785 Jul 23 21:32:57.518910 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2387/4704] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:57 2022] GET /compute/v2.1/servers/2ec03ea9-c0f4-41a6-93cb-bf713381760b => generated 1479 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:32:57.530719 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-258ed3df-bbac-4cc3-86d7-54d89db0869f req-cdbe2808-cd75-4271-b81f-375be1dca956 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2ad2cfd-7479-48d0-b802-cdd5d5093305", "name": "network-vif-plugged", "status": "completed", "tag": "cbde15d1-b6fd-48d4-98a3-b0a0c831fec2"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:32:57.552801 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-258ed3df-bbac-4cc3-86d7-54d89db0869f req-cdbe2808-cd75-4271-b81f-375be1dca956 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:57.557908 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-258ed3df-bbac-4cc3-86d7-54d89db0869f req-cdbe2808-cd75-4271-b81f-375be1dca956 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:57.580527 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-258ed3df-bbac-4cc3-86d7-54d89db0869f req-cdbe2808-cd75-4271-b81f-375be1dca956 service nova] Creating event network-vif-plugged:cbde15d1-b6fd-48d4-98a3-b0a0c831fec2 for instance f2ad2cfd-7479-48d0-b802-cdd5d5093305 on nch1-master-1 Jul 23 21:32:57.591109 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-258ed3df-bbac-4cc3-86d7-54d89db0869f req-cdbe2808-cd75-4271-b81f-375be1dca956 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070210 Jul 23 21:32:57.592358 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2388/4705] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:32:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:32:57.628417 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f890b59a-7e74-456a-ab1f-1dcea7d7909f tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] [instance: 0352d36b-f7b0-4c09-8517-a5711438d586] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:57.637994 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f890b59a-7e74-456a-ab1f-1dcea7d7909f tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:57.639404 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f890b59a-7e74-456a-ab1f-1dcea7d7909f tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:57.641587 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f890b59a-7e74-456a-ab1f-1dcea7d7909f tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:57.642194 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f890b59a-7e74-456a-ab1f-1dcea7d7909f tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:57.679217 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f890b59a-7e74-456a-ab1f-1dcea7d7909f tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] 10.222.0.17 "POST /compute/v2.1/servers/0352d36b-f7b0-4c09-8517-a5711438d586/action" status: 202 len: 1138 microversion: 2.57 time: 0.362348 Jul 23 21:32:57.680176 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2318/4706] 10.222.0.17 () {62 vars in 1319 bytes} [Sat Jul 23 21:32:57 2022] POST /compute/v2.1/servers/0352d36b-f7b0-4c09-8517-a5711438d586/action => generated 1138 bytes in 365 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 23 21:32:57.699704 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-80c2150d-006e-4db3-a02e-5052f9d11b2e tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:57.700918 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-80c2150d-006e-4db3-a02e-5052f9d11b2e tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] [instance: 0352d36b-f7b0-4c09-8517-a5711438d586] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:57.714516 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-80c2150d-006e-4db3-a02e-5052f9d11b2e tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:57.715368 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-80c2150d-006e-4db3-a02e-5052f9d11b2e tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:57.726059 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-80c2150d-006e-4db3-a02e-5052f9d11b2e tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:57.731595 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-80c2150d-006e-4db3-a02e-5052f9d11b2e tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:57.927814 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-80c2150d-006e-4db3-a02e-5052f9d11b2e tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:57.937521 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-80c2150d-006e-4db3-a02e-5052f9d11b2e tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:57.939808 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-80c2150d-006e-4db3-a02e-5052f9d11b2e tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:57.941218 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-80c2150d-006e-4db3-a02e-5052f9d11b2e tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] 10.222.0.17 "GET /compute/v2.1/servers/0352d36b-f7b0-4c09-8517-a5711438d586" status: 200 len: 1366 microversion: 2.57 time: 0.248574 Jul 23 21:32:57.960498 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2389/4707] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:32:57 2022] GET /compute/v2.1/servers/0352d36b-f7b0-4c09-8517-a5711438d586 => generated 1366 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:32:58.036431 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-c664df35-74a3-456c-accd-4f8967d29d8d req-67e54204-9c95-4478-85d9-10f5c2f8f5ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ec03ea9-c0f4-41a6-93cb-bf713381760b", "name": "network-vif-deleted", "tag": "fd0afce0-b59f-447f-b37d-b1fb5f51e6eb"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:32:58.058809 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-c664df35-74a3-456c-accd-4f8967d29d8d req-67e54204-9c95-4478-85d9-10f5c2f8f5ef service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:58.059262 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-c664df35-74a3-456c-accd-4f8967d29d8d req-67e54204-9c95-4478-85d9-10f5c2f8f5ef service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:58.076322 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-c664df35-74a3-456c-accd-4f8967d29d8d req-67e54204-9c95-4478-85d9-10f5c2f8f5ef service nova] Creating event network-vif-deleted:fd0afce0-b59f-447f-b37d-b1fb5f51e6eb for instance 2ec03ea9-c0f4-41a6-93cb-bf713381760b on nch1-master-1 Jul 23 21:32:58.089054 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-c664df35-74a3-456c-accd-4f8967d29d8d req-67e54204-9c95-4478-85d9-10f5c2f8f5ef service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056219 Jul 23 21:32:58.089986 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2319/4708] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:32:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:32:58.147152 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-60354551-1d3c-4272-8443-98bd9790d68b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:58.147879 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-60354551-1d3c-4272-8443-98bd9790d68b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:58.158811 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-60354551-1d3c-4272-8443-98bd9790d68b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:58.160787 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-60354551-1d3c-4272-8443-98bd9790d68b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:58.161782 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-60354551-1d3c-4272-8443-98bd9790d68b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:58.162448 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-60354551-1d3c-4272-8443-98bd9790d68b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:58.202149 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=100 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:32:58.273161 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5aacb290-5c6a-40d7-bf15-fa709afec114 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:58.273900 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5aacb290-5c6a-40d7-bf15-fa709afec114 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:58.283857 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5aacb290-5c6a-40d7-bf15-fa709afec114 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:58.284301 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5aacb290-5c6a-40d7-bf15-fa709afec114 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:58.285080 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5aacb290-5c6a-40d7-bf15-fa709afec114 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:58.285518 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5aacb290-5c6a-40d7-bf15-fa709afec114 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:58.317422 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-60354551-1d3c-4272-8443-98bd9790d68b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:58.329980 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-60354551-1d3c-4272-8443-98bd9790d68b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:58.331520 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-60354551-1d3c-4272-8443-98bd9790d68b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:58.332746 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-60354551-1d3c-4272-8443-98bd9790d68b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.190476 Jul 23 21:32:58.336706 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2390/4709] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:32:58 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:32:58.380703 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-2bc972ca-19d6-4033-b3cc-3c737de28025 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1773955393", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e6510bf5-c62e-46e0-81de-3e26ff603612"}], "security_groups": [{"name": "tempest-securitygroup--1689237686"}], "key_name": "tempest-keypair-1454771714", "user_data": "}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:32:58.463026 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5aacb290-5c6a-40d7-bf15-fa709afec114 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:58.471193 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5aacb290-5c6a-40d7-bf15-fa709afec114 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1518 microversion: 2.1 time: 0.202629 Jul 23 21:32:58.481417 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2320/4710] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:58 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1518 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:32:58.539479 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e6e92358-33d9-4533-a70c-57ed435ce332 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:58.540062 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e6e92358-33d9-4533-a70c-57ed435ce332 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] [instance: 2ec03ea9-c0f4-41a6-93cb-bf713381760b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:58.541499 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.network.neutron [None req-2bc972ca-19d6-4033-b3cc-3c737de28025 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] validate_networks() for [('e6510bf5-c62e-46e0-81de-3e26ff603612', None, None, None, None, None)] {{(pid=131321) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:32:58.547014 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e6e92358-33d9-4533-a70c-57ed435ce332 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:58.547466 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e6e92358-33d9-4533-a70c-57ed435ce332 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:58.548260 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e6e92358-33d9-4533-a70c-57ed435ce332 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:58.548701 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e6e92358-33d9-4533-a70c-57ed435ce332 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:58.584719 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e6e92358-33d9-4533-a70c-57ed435ce332 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:58.585180 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e6e92358-33d9-4533-a70c-57ed435ce332 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:58.585696 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.objects.instance [None req-e6e92358-33d9-4533-a70c-57ed435ce332 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lazy-loading 'fault' on Instance uuid 2ec03ea9-c0f4-41a6-93cb-bf713381760b {{(pid=131320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:32:58.635355 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e6e92358-33d9-4533-a70c-57ed435ce332 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd49331138a4dbc912bc7bf6f6b0215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842a1aca542f416eab5d43b881325917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:58.640442 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:32:58.648282 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e6e92358-33d9-4533-a70c-57ed435ce332 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] 10.222.0.17 "GET /compute/v2.1/servers/2ec03ea9-c0f4-41a6-93cb-bf713381760b" status: 200 len: 1332 microversion: 2.1 time: 0.115739 Jul 23 21:32:58.649287 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2321/4711] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:58 2022] GET /compute/v2.1/servers/2ec03ea9-c0f4-41a6-93cb-bf713381760b => generated 1332 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:32:58.816550 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell0:SELECT=2 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:32:58.962719 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f26789e3-5a96-4b7a-86c7-ed2cdfff7d4d tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:58.964131 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f26789e3-5a96-4b7a-86c7-ed2cdfff7d4d tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] [instance: 0352d36b-f7b0-4c09-8517-a5711438d586] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:58.970333 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f26789e3-5a96-4b7a-86c7-ed2cdfff7d4d tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:58.970779 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f26789e3-5a96-4b7a-86c7-ed2cdfff7d4d tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:58.971551 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f26789e3-5a96-4b7a-86c7-ed2cdfff7d4d tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:58.971981 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f26789e3-5a96-4b7a-86c7-ed2cdfff7d4d tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:59.046091 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f26789e3-5a96-4b7a-86c7-ed2cdfff7d4d tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:59.054712 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f26789e3-5a96-4b7a-86c7-ed2cdfff7d4d tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:59.056397 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f26789e3-5a96-4b7a-86c7-ed2cdfff7d4d tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:59.057809 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f26789e3-5a96-4b7a-86c7-ed2cdfff7d4d tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] 10.222.0.17 "GET /compute/v2.1/servers/0352d36b-f7b0-4c09-8517-a5711438d586" status: 200 len: 1366 microversion: 2.57 time: 0.100907 Jul 23 21:32:59.058581 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2322/4712] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:32:58 2022] GET /compute/v2.1/servers/0352d36b-f7b0-4c09-8517-a5711438d586 => generated 1366 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:32:59.293204 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-2bc972ca-19d6-4033-b3cc-3c737de28025 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Flavor limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:32:59.293749 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-2bc972ca-19d6-4033-b3cc-3c737de28025 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Image limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:32:59.294823 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-2bc972ca-19d6-4033-b3cc-3c737de28025 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Flavor pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:32:59.295572 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-2bc972ca-19d6-4033-b3cc-3c737de28025 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Image pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:32:59.296090 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-2bc972ca-19d6-4033-b3cc-3c737de28025 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:32:59.320806 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2bc972ca-19d6-4033-b3cc-3c737de28025 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:59.321336 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2bc972ca-19d6-4033-b3cc-3c737de28025 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:59.322283 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2bc972ca-19d6-4033-b3cc-3c737de28025 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:59.324223 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2bc972ca-19d6-4033-b3cc-3c737de28025 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:59.361163 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-bde50344-9365-439a-9b15-bb25318d3159 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:59.362121 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-bde50344-9365-439a-9b15-bb25318d3159 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:59.376389 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bde50344-9365-439a-9b15-bb25318d3159 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:59.377159 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bde50344-9365-439a-9b15-bb25318d3159 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:59.380140 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bde50344-9365-439a-9b15-bb25318d3159 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:59.381555 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bde50344-9365-439a-9b15-bb25318d3159 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:59.393624 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-2bc972ca-19d6-4033-b3cc-3c737de28025 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Getting quotas for project ebcf55bcaba04bf8ae8a9b2ac09e8d98. Resources: {'ram', 'instances', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:32:59.410998 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-2bc972ca-19d6-4033-b3cc-3c737de28025 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Getting quotas for user 37b1e260651b4dffa7c1efe8e9d0f144 and project ebcf55bcaba04bf8ae8a9b2ac09e8d98. Resources: {'ram', 'instances', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:32:59.443986 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-2bc972ca-19d6-4033-b3cc-3c737de28025 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Going to run 1 instances... {{(pid=131321) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:32:59.447817 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-2bc972ca-19d6-4033-b3cc-3c737de28025 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] [instance: bbee3556-287f-42a5-a6a8-84356c840b67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131321) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:32:59.487564 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:32:59.516545 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-bde50344-9365-439a-9b15-bb25318d3159 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:59.533855 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-bde50344-9365-439a-9b15-bb25318d3159 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:59.536315 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-bde50344-9365-439a-9b15-bb25318d3159 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:59.537542 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-2bc972ca-19d6-4033-b3cc-3c737de28025 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.162978 Jul 23 21:32:59.538822 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-bde50344-9365-439a-9b15-bb25318d3159 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.190075 Jul 23 21:32:59.539275 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2391/4713] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:32:58 2022] POST /compute/v2.1/servers => generated 402 bytes in 1165 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 23 21:32:59.540051 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2323/4714] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:32:59 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:32:59.549783 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-735af3b8-0f5e-4e1c-9146-873ba429344e tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:59.554242 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-caa9ee4d-f49e-4799-9d11-6b722cca1608 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:59.555195 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-caa9ee4d-f49e-4799-9d11-6b722cca1608 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:59.555920 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-735af3b8-0f5e-4e1c-9146-873ba429344e tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] [instance: bbee3556-287f-42a5-a6a8-84356c840b67] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:59.574362 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-caa9ee4d-f49e-4799-9d11-6b722cca1608 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:59.575356 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-caa9ee4d-f49e-4799-9d11-6b722cca1608 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:59.576320 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-caa9ee4d-f49e-4799-9d11-6b722cca1608 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:59.576926 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-caa9ee4d-f49e-4799-9d11-6b722cca1608 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:59.750224 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-735af3b8-0f5e-4e1c-9146-873ba429344e tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b1e260651b4dffa7c1efe8e9d0f144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcf55bcaba04bf8ae8a9b2ac09e8d98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:32:59.761512 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-735af3b8-0f5e-4e1c-9146-873ba429344e tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] 10.222.0.17 "GET /compute/v2.1/servers/bbee3556-287f-42a5-a6a8-84356c840b67" status: 200 len: 1242 microversion: 2.1 time: 0.216382 Jul 23 21:32:59.774669 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2324/4715] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:59 2022] GET /compute/v2.1/servers/bbee3556-287f-42a5-a6a8-84356c840b67 => generated 1242 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:32:59.780050 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-bcf8d3e4-2886-414a-a872-4d1847ee096f tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:32:59.780698 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-bcf8d3e4-2886-414a-a872-4d1847ee096f tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] [instance: 2ec03ea9-c0f4-41a6-93cb-bf713381760b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:32:59.804020 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bcf8d3e4-2886-414a-a872-4d1847ee096f tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:59.804657 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bcf8d3e4-2886-414a-a872-4d1847ee096f tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:59.805772 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bcf8d3e4-2886-414a-a872-4d1847ee096f tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:32:59.806254 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bcf8d3e4-2886-414a-a872-4d1847ee096f tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:32:59.856945 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-bcf8d3e4-2886-414a-a872-4d1847ee096f tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] HTTP exception thrown: Instance 2ec03ea9-c0f4-41a6-93cb-bf713381760b could not be found. Jul 23 21:32:59.858706 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-bcf8d3e4-2886-414a-a872-4d1847ee096f tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Request method failure captured: Jul 23 21:32:59.858706 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/2ec03ea9-c0f4-41a6-93cb-bf713381760b HTTP/1.1 Jul 23 21:32:59.858706 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:32:59.858706 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:32:59.858706 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:32:59.858706 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:32:59.858706 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:32:59.858706 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:32:59.858706 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:32:59.858706 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:32:59.858706 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GiSHGnzzTir6G2mkC4jaPgCVF1y1xLwQedmA7LvV03c02Xe23W2KsUPT37XjDPVKEMOFLkGiErD7I7IMt7YT88pM0khBDol2SMKBsKDFUTBYtfvq9zg9z5ruQEFt0Anq0ZoSTwWSOEsjPrqrFH7f_8Om8o-cmqhPrh5I_ggUZ1RWuw Jul 23 21:32:59.858706 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:32:59.858706 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:32:59.858706 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:32:59.858706 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:32:59.858706 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:32:59.858706 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:32:59.858706 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 842a1aca542f416eab5d43b881325917 Jul 23 21:32:59.858706 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-820000053 Jul 23 21:32:59.858706 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:32:59.858706 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:32:59.858706 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/842a1aca542f416eab5d43b881325917"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/842a1aca542f416eab5d43b881325917"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_842a1aca542f416eab5d43b881325917", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/842a1aca542f416eab5d43b881325917"}]}] Jul 23 21:32:59.858706 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-TestSecurityGroupsBasicOps-820000053 Jul 23 21:32:59.858706 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 842a1aca542f416eab5d43b881325917 Jul 23 21:32:59.858706 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-820000053 Jul 23 21:32:59.858706 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-TestSecurityGroupsBasicOps-820000053-project Jul 23 21:32:59.858706 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:32:59.858706 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:32:59.858706 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 0bd49331138a4dbc912bc7bf6f6b0215 Jul 23 21:32:59.858706 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-TestSecurityGroupsBasicOps-820000053-project Jul 23 21:32:59.858706 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:32:59.858706 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance 2ec03ea9-c0f4-41a6-93cb-bf713381760b could not be found. Jul 23 21:32:59.858706 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '2ec03ea9-c0f4-41a6-93cb-bf713381760b'} Jul 23 21:32:59.858706 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:32:59.858706 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:32:59.858706 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:32:59.858706 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:32:59.858706 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:32:59.858706 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:32:59.858706 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:32:59.858706 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:32:59.858706 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:32:59.858706 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:32:59.858706 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ec03ea9-c0f4-41a6-93cb-bf713381760b could not be found. Jul 23 21:32:59.858706 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:32:59.858706 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:32:59.858706 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:32:59.858706 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:32:59.858706 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:32:59.858706 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:32:59.858706 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:32:59.858706 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:32:59.858706 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:32:59.858706 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:32:59.858706 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:32:59.858706 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:32:59.858706 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:32:59.858706 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:32:59.858706 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:32:59.858706 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:32:59.858706 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ec03ea9-c0f4-41a6-93cb-bf713381760b could not be found. Jul 23 21:32:59.858706 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:32:59.858706 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:32:59.858706 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:32:59.863420 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:32:59.863420 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:32:59.863420 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:32:59.863420 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:32:59.863420 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:32:59.863420 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ec03ea9-c0f4-41a6-93cb-bf713381760b could not be found. Jul 23 21:32:59.863420 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:32:59.863420 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-bcf8d3e4-2886-414a-a872-4d1847ee096f tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Returning 404 to user: Instance 2ec03ea9-c0f4-41a6-93cb-bf713381760b could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:32:59.863420 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-bcf8d3e4-2886-414a-a872-4d1847ee096f tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] 10.222.0.17 "GET /compute/v2.1/servers/2ec03ea9-c0f4-41a6-93cb-bf713381760b" status: 404 len: 111 microversion: 2.1 time: 0.084335 Jul 23 21:32:59.878252 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2325/4716] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:59 2022] GET /compute/v2.1/servers/2ec03ea9-c0f4-41a6-93cb-bf713381760b => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:33:00.077550 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9a1ad93d-922a-4901-b231-ff73b521448b tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:00.079290 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-9a1ad93d-922a-4901-b231-ff73b521448b tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] [instance: 0352d36b-f7b0-4c09-8517-a5711438d586] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:00.087975 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9a1ad93d-922a-4901-b231-ff73b521448b tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:00.091443 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9a1ad93d-922a-4901-b231-ff73b521448b tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:00.095430 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9a1ad93d-922a-4901-b231-ff73b521448b tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:00.096049 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9a1ad93d-922a-4901-b231-ff73b521448b tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:00.106956 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-caa9ee4d-f49e-4799-9d11-6b722cca1608 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:00.115791 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-caa9ee4d-f49e-4799-9d11-6b722cca1608 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1518 microversion: 2.1 time: 0.575354 Jul 23 21:33:00.119151 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2392/4717] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:32:59 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1518 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:33:00.268202 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-9a1ad93d-922a-4901-b231-ff73b521448b tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:00.279477 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-9a1ad93d-922a-4901-b231-ff73b521448b tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:00.281490 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-9a1ad93d-922a-4901-b231-ff73b521448b tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:00.283915 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9a1ad93d-922a-4901-b231-ff73b521448b tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] 10.222.0.17 "GET /compute/v2.1/servers/0352d36b-f7b0-4c09-8517-a5711438d586" status: 200 len: 1366 microversion: 2.57 time: 0.210250 Jul 23 21:33:00.285137 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2326/4718] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:33:00 2022] GET /compute/v2.1/servers/0352d36b-f7b0-4c09-8517-a5711438d586 => generated 1366 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:33:00.575041 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-0b111c4b-e123-4990-b4e8-99bb0da0cddb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:00.577906 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-0b111c4b-e123-4990-b4e8-99bb0da0cddb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:00.591823 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0b111c4b-e123-4990-b4e8-99bb0da0cddb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:00.592577 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0b111c4b-e123-4990-b4e8-99bb0da0cddb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:00.594782 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0b111c4b-e123-4990-b4e8-99bb0da0cddb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:00.595417 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0b111c4b-e123-4990-b4e8-99bb0da0cddb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:00.695246 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-0b111c4b-e123-4990-b4e8-99bb0da0cddb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:00.712186 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-0b111c4b-e123-4990-b4e8-99bb0da0cddb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:00.714455 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-0b111c4b-e123-4990-b4e8-99bb0da0cddb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:00.715882 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-0b111c4b-e123-4990-b4e8-99bb0da0cddb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.154461 Jul 23 21:33:00.716622 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2393/4719] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:33:00 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:33:00.782478 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-90aa0513-c854-4369-8e29-390cb4903bd7 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:00.783504 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-90aa0513-c854-4369-8e29-390cb4903bd7 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] [instance: bbee3556-287f-42a5-a6a8-84356c840b67] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:00.802947 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-90aa0513-c854-4369-8e29-390cb4903bd7 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:00.805828 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-90aa0513-c854-4369-8e29-390cb4903bd7 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:00.807498 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-90aa0513-c854-4369-8e29-390cb4903bd7 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:00.808364 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-90aa0513-c854-4369-8e29-390cb4903bd7 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:00.944371 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-90aa0513-c854-4369-8e29-390cb4903bd7 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b1e260651b4dffa7c1efe8e9d0f144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcf55bcaba04bf8ae8a9b2ac09e8d98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:00.965813 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-90aa0513-c854-4369-8e29-390cb4903bd7 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] 10.222.0.17 "GET /compute/v2.1/servers/bbee3556-287f-42a5-a6a8-84356c840b67" status: 200 len: 1294 microversion: 2.1 time: 0.185325 Jul 23 21:33:00.967064 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2327/4720] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:33:00 2022] GET /compute/v2.1/servers/bbee3556-287f-42a5-a6a8-84356c840b67 => generated 1294 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:33:01.138263 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-4db53b88-fbe3-4ac6-93bc-3d151da01774 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:01.139039 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-4db53b88-fbe3-4ac6-93bc-3d151da01774 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:01.152303 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4db53b88-fbe3-4ac6-93bc-3d151da01774 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:01.154249 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4db53b88-fbe3-4ac6-93bc-3d151da01774 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:01.155343 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4db53b88-fbe3-4ac6-93bc-3d151da01774 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:01.156004 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4db53b88-fbe3-4ac6-93bc-3d151da01774 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:01.302810 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4c9eaefe-52d9-493c-9463-14289c276b60 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:01.303422 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-4c9eaefe-52d9-493c-9463-14289c276b60 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] [instance: 0352d36b-f7b0-4c09-8517-a5711438d586] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:01.305837 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-4db53b88-fbe3-4ac6-93bc-3d151da01774 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:01.310438 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4c9eaefe-52d9-493c-9463-14289c276b60 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:01.310887 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4c9eaefe-52d9-493c-9463-14289c276b60 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:01.311857 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4c9eaefe-52d9-493c-9463-14289c276b60 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:01.312290 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4c9eaefe-52d9-493c-9463-14289c276b60 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:01.318448 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-4db53b88-fbe3-4ac6-93bc-3d151da01774 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1505 microversion: 2.1 time: 0.187414 Jul 23 21:33:01.319619 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2394/4721] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:33:01 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1505 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:33:01.336319 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-8adee9bd-ab0b-488b-a8ab-bce27526ac18 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:01.337556 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-8adee9bd-ab0b-488b-a8ab-bce27526ac18 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:01.345722 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8adee9bd-ab0b-488b-a8ab-bce27526ac18 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:01.347087 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8adee9bd-ab0b-488b-a8ab-bce27526ac18 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:01.348124 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8adee9bd-ab0b-488b-a8ab-bce27526ac18 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:01.349079 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8adee9bd-ab0b-488b-a8ab-bce27526ac18 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:01.494682 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-8adee9bd-ab0b-488b-a8ab-bce27526ac18 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:01.503511 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-8adee9bd-ab0b-488b-a8ab-bce27526ac18 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1505 microversion: 2.1 time: 0.171547 Jul 23 21:33:01.504123 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2395/4722] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:33:01 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1505 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:33:01.524370 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-4c9eaefe-52d9-493c-9463-14289c276b60 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:01.529740 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-8650385b-1769-4a07-8818-f884439eaa0e tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:01.530497 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-8650385b-1769-4a07-8818-f884439eaa0e tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:01.540632 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-4c9eaefe-52d9-493c-9463-14289c276b60 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:01.542594 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8650385b-1769-4a07-8818-f884439eaa0e tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:01.544242 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-4c9eaefe-52d9-493c-9463-14289c276b60 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:01.545453 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4c9eaefe-52d9-493c-9463-14289c276b60 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] 10.222.0.17 "GET /compute/v2.1/servers/0352d36b-f7b0-4c09-8517-a5711438d586" status: 200 len: 1366 microversion: 2.57 time: 0.246966 Jul 23 21:33:01.546026 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8650385b-1769-4a07-8818-f884439eaa0e tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:01.546158 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2328/4723] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:33:01 2022] GET /compute/v2.1/servers/0352d36b-f7b0-4c09-8517-a5711438d586 => generated 1366 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:33:01.547507 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8650385b-1769-4a07-8818-f884439eaa0e tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:01.548187 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8650385b-1769-4a07-8818-f884439eaa0e tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:01.716773 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-8650385b-1769-4a07-8818-f884439eaa0e tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:01.732788 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-8650385b-1769-4a07-8818-f884439eaa0e tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1505 microversion: 2.1 time: 0.209053 Jul 23 21:33:01.733762 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2396/4724] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:33:01 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1505 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:33:01.744457 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ea5ef885-3dc9-49cb-8692-53bfc3cf8826 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:01.744457 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ea5ef885-3dc9-49cb-8692-53bfc3cf8826 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:01.744457 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ea5ef885-3dc9-49cb-8692-53bfc3cf8826 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:01.744457 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ea5ef885-3dc9-49cb-8692-53bfc3cf8826 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:01.745615 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ea5ef885-3dc9-49cb-8692-53bfc3cf8826 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:01.746089 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ea5ef885-3dc9-49cb-8692-53bfc3cf8826 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:01.753761 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-6cd69de1-e4f1-412e-973b-e292addd0d5d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:33:01.760910 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-6cd69de1-e4f1-412e-973b-e292addd0d5d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] HTTP exception thrown: Instance df21e8c9-ded0-4741-8b6f-e728cd61e8bc has no mapping to a cell. Jul 23 21:33:01.771650 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-6cd69de1-e4f1-412e-973b-e292addd0d5d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Request method failure captured: Jul 23 21:33:01.771650 ncdv-master-1 devstack@n-api.service[131321]: request: POST /compute/v2.1/servers/df21e8c9-ded0-4741-8b6f-e728cd61e8bc/action HTTP/1.1 Jul 23 21:33:01.771650 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:33:01.771650 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:33:01.771650 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:33:01.771650 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 15 Jul 23 21:33:01.771650 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:33:01.771650 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:33:01.771650 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:33:01.771650 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:33:01.771650 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3Ghf1JjZ4k8tVzERRK8IkLpluLUwa9k5Rz-X0dEr2p4_7xl_eBekUiNk1RZEGsFdGEiApbLOfcuSifirvwiKV1QOTaKdXKwfMnwZgdfagxJjoe3dPYUa3b-d3rVTYewIN_YoX2mMGGBMWRa3po8WOCVIc6hXJLExzq_ndbcO7U8NQBI Jul 23 21:33:01.771650 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:33:01.771650 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:33:01.771650 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:33:01.771650 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:33:01.771650 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:33:01.771650 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:33:01.771650 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: d70f6c96e1ad484aa3207fc01a12d519 Jul 23 21:33:01.771650 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:33:01.771650 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:33:01.771650 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:33:01.771650 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d70f6c96e1ad484aa3207fc01a12d519"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d70f6c96e1ad484aa3207fc01a12d519"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d70f6c96e1ad484aa3207fc01a12d519", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d70f6c96e1ad484aa3207fc01a12d519"}]}] Jul 23 21:33:01.771650 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:33:01.771650 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: d70f6c96e1ad484aa3207fc01a12d519 Jul 23 21:33:01.771650 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:33:01.771650 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ServersNegativeTestJSON-1106538570-project Jul 23 21:33:01.771650 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:33:01.771650 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:33:01.771650 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 6ca9644a73d9468aa39b21548a72bded Jul 23 21:33:01.771650 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ServersNegativeTestJSON-1106538570-project Jul 23 21:33:01.771650 ncdv-master-1 devstack@n-api.service[131321]: Jul 23 21:33:01.771650 ncdv-master-1 devstack@n-api.service[131321]: {"os-stop": {}} Jul 23 21:33:01.771650 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:33:01.771650 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance df21e8c9-ded0-4741-8b6f-e728cd61e8bc has no mapping to a cell. Jul 23 21:33:01.771650 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': 'df21e8c9-ded0-4741-8b6f-e728cd61e8bc', 'body': {'os-stop': {}}} Jul 23 21:33:01.771650 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:33:01.771650 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:33:01.771650 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1408, in _get_instance Jul 23 21:33:01.771650 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Jul 23 21:33:01.771650 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 23 21:33:01.771650 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 23 21:33:01.771650 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Jul 23 21:33:01.771650 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Jul 23 21:33:01.771650 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 23 21:33:01.771650 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 23 21:33:01.771650 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Jul 23 21:33:01.771650 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Jul 23 21:33:01.771650 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance df21e8c9-ded0-4741-8b6f-e728cd61e8bc has no mapping to a cell. Jul 23 21:33:01.771650 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:33:01.771650 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:33:01.771650 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:33:01.771650 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:33:01.771650 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:33:01.771650 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:33:01.771650 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:33:01.771650 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:33:01.771650 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:33:01.771650 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:33:01.771650 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1441, in _stop_server Jul 23 21:33:01.771650 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Jul 23 21:33:01.771650 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1415, in _get_instance Jul 23 21:33:01.771650 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:33:01.771650 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df21e8c9-ded0-4741-8b6f-e728cd61e8bc has no mapping to a cell. Jul 23 21:33:01.775906 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:33:01.775906 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:33:01.775906 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:33:01.775906 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:33:01.775906 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:33:01.775906 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:33:01.775906 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:33:01.775906 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:33:01.775906 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df21e8c9-ded0-4741-8b6f-e728cd61e8bc has no mapping to a cell. Jul 23 21:33:01.775906 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:33:01.783696 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-6cd69de1-e4f1-412e-973b-e292addd0d5d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Returning 404 to user: Instance df21e8c9-ded0-4741-8b6f-e728cd61e8bc has no mapping to a cell. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:33:01.784735 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-6cd69de1-e4f1-412e-973b-e292addd0d5d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "POST /compute/v2.1/servers/df21e8c9-ded0-4741-8b6f-e728cd61e8bc/action" status: 404 len: 117 microversion: 2.1 time: 0.035288 Jul 23 21:33:01.785653 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2397/4725] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:33:01 2022] POST /compute/v2.1/servers/df21e8c9-ded0-4741-8b6f-e728cd61e8bc/action => generated 117 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:33:01.794400 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e50b4eda-5b0b-4ed1-9943-63df0954ae8b tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:01.795105 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-e50b4eda-5b0b-4ed1-9943-63df0954ae8b tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:01.803117 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e50b4eda-5b0b-4ed1-9943-63df0954ae8b tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:01.803898 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e50b4eda-5b0b-4ed1-9943-63df0954ae8b tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:01.804618 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e50b4eda-5b0b-4ed1-9943-63df0954ae8b tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:01.805177 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e50b4eda-5b0b-4ed1-9943-63df0954ae8b tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:01.876488 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ea5ef885-3dc9-49cb-8692-53bfc3cf8826 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:01.888378 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ea5ef885-3dc9-49cb-8692-53bfc3cf8826 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:01.890911 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ea5ef885-3dc9-49cb-8692-53bfc3cf8826 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:01.895708 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ea5ef885-3dc9-49cb-8692-53bfc3cf8826 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.164405 Jul 23 21:33:01.897798 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2329/4726] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:33:01 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:33:01.948642 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-e50b4eda-5b0b-4ed1-9943-63df0954ae8b tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:01.958659 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-e50b4eda-5b0b-4ed1-9943-63df0954ae8b tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1505 microversion: 2.1 time: 0.167991 Jul 23 21:33:01.959990 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2398/4727] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:33:01 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1505 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:33:01.977326 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0a5918b9-6d96-47cf-afda-5c23514a7e5f tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:01.978306 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-0a5918b9-6d96-47cf-afda-5c23514a7e5f tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:01.986597 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a5bb1214-3f54-45eb-8e01-78888acb0e80 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:01.987210 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-a5bb1214-3f54-45eb-8e01-78888acb0e80 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] [instance: bbee3556-287f-42a5-a6a8-84356c840b67] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:01.991999 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0a5918b9-6d96-47cf-afda-5c23514a7e5f tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:01.992476 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0a5918b9-6d96-47cf-afda-5c23514a7e5f tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:01.993310 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0a5918b9-6d96-47cf-afda-5c23514a7e5f tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:01.993743 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0a5918b9-6d96-47cf-afda-5c23514a7e5f tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:02.004402 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a5bb1214-3f54-45eb-8e01-78888acb0e80 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:02.004856 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a5bb1214-3f54-45eb-8e01-78888acb0e80 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:02.005651 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a5bb1214-3f54-45eb-8e01-78888acb0e80 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:02.006117 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a5bb1214-3f54-45eb-8e01-78888acb0e80 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:02.092806 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-a5bb1214-3f54-45eb-8e01-78888acb0e80 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b1e260651b4dffa7c1efe8e9d0f144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcf55bcaba04bf8ae8a9b2ac09e8d98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:02.101344 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-a5bb1214-3f54-45eb-8e01-78888acb0e80 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] 10.222.0.17 "GET /compute/v2.1/servers/bbee3556-287f-42a5-a6a8-84356c840b67" status: 200 len: 1300 microversion: 2.1 time: 0.118571 Jul 23 21:33:02.102128 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2399/4728] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:33:01 2022] GET /compute/v2.1/servers/bbee3556-287f-42a5-a6a8-84356c840b67 => generated 1300 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:33:02.373833 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-0a5918b9-6d96-47cf-afda-5c23514a7e5f tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:02.383181 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-0a5918b9-6d96-47cf-afda-5c23514a7e5f tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1505 microversion: 2.1 time: 0.409878 Jul 23 21:33:02.383836 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2330/4729] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:33:01 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1505 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:33:02.400375 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-88d31c62-5345-4524-9b2e-80e17dca2ef6 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:33:02.401045 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-88d31c62-5345-4524-9b2e-80e17dca2ef6 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: ecf11896-cc5a-4765-b63e-aa638c5840d6] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:02.408375 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-88d31c62-5345-4524-9b2e-80e17dca2ef6 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] HTTP exception thrown: Instance ecf11896-cc5a-4765-b63e-aa638c5840d6 could not be found. Jul 23 21:33:02.410608 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-88d31c62-5345-4524-9b2e-80e17dca2ef6 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Request method failure captured: Jul 23 21:33:02.410608 ncdv-master-1 devstack@n-api.service[131321]: request: POST /compute/v2.1/servers/ecf11896-cc5a-4765-b63e-aa638c5840d6/action HTTP/1.1 Jul 23 21:33:02.410608 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:33:02.410608 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:33:02.410608 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:33:02.410608 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 15 Jul 23 21:33:02.410608 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:33:02.410608 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:33:02.410608 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:33:02.410608 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:33:02.410608 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3Ghf1JjZ4k8tVzERRK8IkLpluLUwa9k5Rz-X0dEr2p4_7xl_eBekUiNk1RZEGsFdGEiApbLOfcuSifirvwiKV1QOTaKdXKwfMnwZgdfagxJjoe3dPYUa3b-d3rVTYewIN_YoX2mMGGBMWRa3po8WOCVIc6hXJLExzq_ndbcO7U8NQBI Jul 23 21:33:02.410608 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:33:02.410608 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:33:02.410608 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:33:02.410608 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:33:02.410608 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:33:02.410608 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:33:02.410608 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: d70f6c96e1ad484aa3207fc01a12d519 Jul 23 21:33:02.410608 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:33:02.410608 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:33:02.410608 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:33:02.410608 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d70f6c96e1ad484aa3207fc01a12d519"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d70f6c96e1ad484aa3207fc01a12d519"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d70f6c96e1ad484aa3207fc01a12d519", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d70f6c96e1ad484aa3207fc01a12d519"}]}] Jul 23 21:33:02.410608 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:33:02.410608 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: d70f6c96e1ad484aa3207fc01a12d519 Jul 23 21:33:02.410608 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:33:02.410608 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ServersNegativeTestJSON-1106538570-project Jul 23 21:33:02.410608 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:33:02.410608 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:33:02.410608 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 6ca9644a73d9468aa39b21548a72bded Jul 23 21:33:02.410608 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ServersNegativeTestJSON-1106538570-project Jul 23 21:33:02.410608 ncdv-master-1 devstack@n-api.service[131321]: Jul 23 21:33:02.410608 ncdv-master-1 devstack@n-api.service[131321]: {"suspend": {}} Jul 23 21:33:02.410608 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:33:02.410608 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance ecf11896-cc5a-4765-b63e-aa638c5840d6 could not be found. Jul 23 21:33:02.410608 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': 'ecf11896-cc5a-4765-b63e-aa638c5840d6', 'body': {'suspend': {}}} Jul 23 21:33:02.410608 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:33:02.410608 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:33:02.410608 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:33:02.410608 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:33:02.410608 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:33:02.410608 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:33:02.410608 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 23 21:33:02.410608 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 23 21:33:02.410608 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecf11896-cc5a-4765-b63e-aa638c5840d6 could not be found. Jul 23 21:33:02.410608 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:33:02.410608 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:33:02.410608 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:33:02.410608 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:33:02.410608 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:33:02.410608 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:33:02.410608 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:33:02.410608 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:33:02.410608 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:33:02.410608 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:33:02.410608 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Jul 23 21:33:02.410608 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Jul 23 21:33:02.410608 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:33:02.410608 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:33:02.410608 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecf11896-cc5a-4765-b63e-aa638c5840d6 could not be found. Jul 23 21:33:02.410608 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:33:02.410608 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:33:02.410608 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:33:02.410608 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:33:02.410608 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:33:02.410608 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:33:02.415575 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:33:02.415575 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:33:02.415575 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecf11896-cc5a-4765-b63e-aa638c5840d6 could not be found. Jul 23 21:33:02.415575 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:33:02.415575 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-88d31c62-5345-4524-9b2e-80e17dca2ef6 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Returning 404 to user: Instance ecf11896-cc5a-4765-b63e-aa638c5840d6 could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:33:02.416709 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-88d31c62-5345-4524-9b2e-80e17dca2ef6 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "POST /compute/v2.1/servers/ecf11896-cc5a-4765-b63e-aa638c5840d6/action" status: 404 len: 111 microversion: 2.1 time: 0.020686 Jul 23 21:33:02.426426 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1f63e1ab-9f52-48b8-ab85-a33c250341d3 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:02.427173 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1f63e1ab-9f52-48b8-ab85-a33c250341d3 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:02.432506 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2400/4730] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:33:02 2022] POST /compute/v2.1/servers/ecf11896-cc5a-4765-b63e-aa638c5840d6/action => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:33:02.435600 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1f63e1ab-9f52-48b8-ab85-a33c250341d3 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:02.436397 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1f63e1ab-9f52-48b8-ab85-a33c250341d3 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:02.437720 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1f63e1ab-9f52-48b8-ab85-a33c250341d3 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:02.438344 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1f63e1ab-9f52-48b8-ab85-a33c250341d3 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:02.461188 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:02.565509 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-7b266124-739a-49cd-bd22-3bf6950ea5da tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:02.566578 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-7b266124-739a-49cd-bd22-3bf6950ea5da tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] [instance: 0352d36b-f7b0-4c09-8517-a5711438d586] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:02.574699 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7b266124-739a-49cd-bd22-3bf6950ea5da tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:02.575179 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7b266124-739a-49cd-bd22-3bf6950ea5da tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:02.577032 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7b266124-739a-49cd-bd22-3bf6950ea5da tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:02.578105 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7b266124-739a-49cd-bd22-3bf6950ea5da tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:02.647578 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-7b266124-739a-49cd-bd22-3bf6950ea5da tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:02.656840 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-7b266124-739a-49cd-bd22-3bf6950ea5da tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:02.659696 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-7b266124-739a-49cd-bd22-3bf6950ea5da tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:02.662044 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-7b266124-739a-49cd-bd22-3bf6950ea5da tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] 10.222.0.17 "GET /compute/v2.1/servers/0352d36b-f7b0-4c09-8517-a5711438d586" status: 200 len: 1366 microversion: 2.57 time: 0.100595 Jul 23 21:33:02.673646 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2401/4731] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:33:02 2022] GET /compute/v2.1/servers/0352d36b-f7b0-4c09-8517-a5711438d586 => generated 1366 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:33:02.916107 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d334a032-597d-45a4-a30b-d7a13025215f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:02.917838 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-d334a032-597d-45a4-a30b-d7a13025215f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:02.936804 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d334a032-597d-45a4-a30b-d7a13025215f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:02.937986 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d334a032-597d-45a4-a30b-d7a13025215f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:02.939612 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-1f63e1ab-9f52-48b8-ab85-a33c250341d3 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:02.940227 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d334a032-597d-45a4-a30b-d7a13025215f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:02.944673 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d334a032-597d-45a4-a30b-d7a13025215f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:02.947606 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1f63e1ab-9f52-48b8-ab85-a33c250341d3 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1505 microversion: 2.1 time: 0.525405 Jul 23 21:33:02.948202 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2331/4732] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:33:02 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1505 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:33:02.965843 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-7da1aa8b-704e-4e5b-88bd-678087da14e3 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:02.966522 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-7da1aa8b-704e-4e5b-88bd-678087da14e3 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:02.983545 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7da1aa8b-704e-4e5b-88bd-678087da14e3 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:02.984047 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7da1aa8b-704e-4e5b-88bd-678087da14e3 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:02.984865 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7da1aa8b-704e-4e5b-88bd-678087da14e3 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:02.985473 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7da1aa8b-704e-4e5b-88bd-678087da14e3 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:03.045292 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-d334a032-597d-45a4-a30b-d7a13025215f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:03.056151 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-d334a032-597d-45a4-a30b-d7a13025215f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:03.057943 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-d334a032-597d-45a4-a30b-d7a13025215f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:03.061361 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-d334a032-597d-45a4-a30b-d7a13025215f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.148293 Jul 23 21:33:03.066595 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2402/4733] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:33:02 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:33:03.119347 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ff7b2561-a681-4546-a94a-d1f021d3577d tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:03.120560 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-ff7b2561-a681-4546-a94a-d1f021d3577d tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] [instance: bbee3556-287f-42a5-a6a8-84356c840b67] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:03.130823 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ff7b2561-a681-4546-a94a-d1f021d3577d tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:03.131423 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ff7b2561-a681-4546-a94a-d1f021d3577d tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:03.132462 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ff7b2561-a681-4546-a94a-d1f021d3577d tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:03.133111 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ff7b2561-a681-4546-a94a-d1f021d3577d tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:03.200142 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ff7b2561-a681-4546-a94a-d1f021d3577d tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b1e260651b4dffa7c1efe8e9d0f144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcf55bcaba04bf8ae8a9b2ac09e8d98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:03.208115 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-ff7b2561-a681-4546-a94a-d1f021d3577d tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] 10.222.0.17 "GET /compute/v2.1/servers/bbee3556-287f-42a5-a6a8-84356c840b67" status: 200 len: 1300 microversion: 2.1 time: 0.092789 Jul 23 21:33:03.208706 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2403/4734] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:33:03 2022] GET /compute/v2.1/servers/bbee3556-287f-42a5-a6a8-84356c840b67 => generated 1300 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:33:03.400858 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-7da1aa8b-704e-4e5b-88bd-678087da14e3 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:03.409990 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-7da1aa8b-704e-4e5b-88bd-678087da14e3 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1505 microversion: 2.1 time: 0.448925 Jul 23 21:33:03.410558 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2332/4735] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:33:02 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1505 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:33:03.427868 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-bdf69d4c-c3a3-4b44-ae2a-283cdd026302 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:33:03.428593 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-bdf69d4c-c3a3-4b44-ae2a-283cdd026302 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:03.435867 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bdf69d4c-c3a3-4b44-ae2a-283cdd026302 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:03.436594 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bdf69d4c-c3a3-4b44-ae2a-283cdd026302 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:03.437483 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bdf69d4c-c3a3-4b44-ae2a-283cdd026302 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:03.437962 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bdf69d4c-c3a3-4b44-ae2a-283cdd026302 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:03.462426 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.objects.instance [None req-bdf69d4c-c3a3-4b44-ae2a-283cdd026302 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lazy-loading 'flavor' on Instance uuid f2ad2cfd-7479-48d0-b802-cdd5d5093305 {{(pid=131321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:33:03.533309 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-bdf69d4c-c3a3-4b44-ae2a-283cdd026302 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "POST /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305/action" status: 202 len: 0 microversion: 2.1 time: 0.109519 Jul 23 21:33:03.537028 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2404/4736] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:33:03 2022] POST /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:33:03.544325 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5c59bfaa-5223-470a-bf8c-0bb1ccbadadb tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:03.545364 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5c59bfaa-5223-470a-bf8c-0bb1ccbadadb tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:03.552332 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5c59bfaa-5223-470a-bf8c-0bb1ccbadadb tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:03.552778 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5c59bfaa-5223-470a-bf8c-0bb1ccbadadb tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:03.554952 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5c59bfaa-5223-470a-bf8c-0bb1ccbadadb tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:03.556038 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5c59bfaa-5223-470a-bf8c-0bb1ccbadadb tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:03.682367 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f478882e-546a-4a8f-abe9-a4d0af769d8a tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:03.682950 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-f478882e-546a-4a8f-abe9-a4d0af769d8a tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] [instance: 0352d36b-f7b0-4c09-8517-a5711438d586] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:03.689660 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f478882e-546a-4a8f-abe9-a4d0af769d8a tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:03.690148 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f478882e-546a-4a8f-abe9-a4d0af769d8a tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:03.690937 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f478882e-546a-4a8f-abe9-a4d0af769d8a tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:03.691381 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f478882e-546a-4a8f-abe9-a4d0af769d8a tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:03.763971 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-f478882e-546a-4a8f-abe9-a4d0af769d8a tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:03.773286 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-f478882e-546a-4a8f-abe9-a4d0af769d8a tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:03.775083 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-f478882e-546a-4a8f-abe9-a4d0af769d8a tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:03.776329 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-f478882e-546a-4a8f-abe9-a4d0af769d8a tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] 10.222.0.17 "GET /compute/v2.1/servers/0352d36b-f7b0-4c09-8517-a5711438d586" status: 200 len: 1366 microversion: 2.57 time: 0.098736 Jul 23 21:33:03.777108 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2405/4737] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:33:03 2022] GET /compute/v2.1/servers/0352d36b-f7b0-4c09-8517-a5711438d586 => generated 1366 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:33:03.999909 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5c59bfaa-5223-470a-bf8c-0bb1ccbadadb tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:04.008847 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5c59bfaa-5223-470a-bf8c-0bb1ccbadadb tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1513 microversion: 2.1 time: 0.470214 Jul 23 21:33:04.009917 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2333/4738] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:33:03 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1513 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:33:04.086496 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e3d334ee-24ba-4ea5-92c3-a35f0f8e70c9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:04.087865 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-e3d334ee-24ba-4ea5-92c3-a35f0f8e70c9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:04.095306 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e3d334ee-24ba-4ea5-92c3-a35f0f8e70c9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:04.096088 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e3d334ee-24ba-4ea5-92c3-a35f0f8e70c9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:04.097023 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e3d334ee-24ba-4ea5-92c3-a35f0f8e70c9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:04.097746 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e3d334ee-24ba-4ea5-92c3-a35f0f8e70c9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:04.167770 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-e3d334ee-24ba-4ea5-92c3-a35f0f8e70c9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:04.177564 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-e3d334ee-24ba-4ea5-92c3-a35f0f8e70c9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:04.179160 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-e3d334ee-24ba-4ea5-92c3-a35f0f8e70c9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:04.180502 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-e3d334ee-24ba-4ea5-92c3-a35f0f8e70c9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.099021 Jul 23 21:33:04.181065 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2406/4739] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:33:04 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:33:04.225152 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3c35d64e-8f3c-448b-9fb3-dc14ef352668 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:04.225672 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-3c35d64e-8f3c-448b-9fb3-dc14ef352668 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] [instance: bbee3556-287f-42a5-a6a8-84356c840b67] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:04.232802 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3c35d64e-8f3c-448b-9fb3-dc14ef352668 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:04.233271 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3c35d64e-8f3c-448b-9fb3-dc14ef352668 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:04.234092 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3c35d64e-8f3c-448b-9fb3-dc14ef352668 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:04.234537 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3c35d64e-8f3c-448b-9fb3-dc14ef352668 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:04.796255 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d05be74b-dfe3-416a-8167-ee5f78e05349 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:04.796905 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-d05be74b-dfe3-416a-8167-ee5f78e05349 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] [instance: 0352d36b-f7b0-4c09-8517-a5711438d586] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:04.809550 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d05be74b-dfe3-416a-8167-ee5f78e05349 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:04.810343 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d05be74b-dfe3-416a-8167-ee5f78e05349 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:04.811321 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d05be74b-dfe3-416a-8167-ee5f78e05349 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:04.816078 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d05be74b-dfe3-416a-8167-ee5f78e05349 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:04.871247 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-3c35d64e-8f3c-448b-9fb3-dc14ef352668 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b1e260651b4dffa7c1efe8e9d0f144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcf55bcaba04bf8ae8a9b2ac09e8d98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:04.878936 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-3c35d64e-8f3c-448b-9fb3-dc14ef352668 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] 10.222.0.17 "GET /compute/v2.1/servers/bbee3556-287f-42a5-a6a8-84356c840b67" status: 200 len: 1368 microversion: 2.1 time: 0.657842 Jul 23 21:33:04.879547 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2334/4740] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:33:04 2022] GET /compute/v2.1/servers/bbee3556-287f-42a5-a6a8-84356c840b67 => generated 1368 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:33:04.933585 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-d05be74b-dfe3-416a-8167-ee5f78e05349 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:04.944383 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-d05be74b-dfe3-416a-8167-ee5f78e05349 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:04.946931 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-d05be74b-dfe3-416a-8167-ee5f78e05349 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:04.948371 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-d05be74b-dfe3-416a-8167-ee5f78e05349 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] 10.222.0.17 "GET /compute/v2.1/servers/0352d36b-f7b0-4c09-8517-a5711438d586" status: 200 len: 1366 microversion: 2.57 time: 0.156223 Jul 23 21:33:04.958083 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2407/4741] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:33:04 2022] GET /compute/v2.1/servers/0352d36b-f7b0-4c09-8517-a5711438d586 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:33:05.028782 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3feaa5d1-e323-4e2c-8ca7-19083920a459 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:05.029652 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-3feaa5d1-e323-4e2c-8ca7-19083920a459 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:05.039018 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3feaa5d1-e323-4e2c-8ca7-19083920a459 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:05.040796 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3feaa5d1-e323-4e2c-8ca7-19083920a459 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:05.043095 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3feaa5d1-e323-4e2c-8ca7-19083920a459 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:05.043832 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3feaa5d1-e323-4e2c-8ca7-19083920a459 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:05.200084 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-46457ea0-2206-4631-ac1d-33aa4e176eec tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:05.201971 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-46457ea0-2206-4631-ac1d-33aa4e176eec tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:05.210710 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-46457ea0-2206-4631-ac1d-33aa4e176eec tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:05.211651 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-46457ea0-2206-4631-ac1d-33aa4e176eec tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:05.212669 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-46457ea0-2206-4631-ac1d-33aa4e176eec tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:05.213331 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-46457ea0-2206-4631-ac1d-33aa4e176eec tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:05.218178 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:05.303203 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-46457ea0-2206-4631-ac1d-33aa4e176eec tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:05.315976 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-46457ea0-2206-4631-ac1d-33aa4e176eec tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:05.318448 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-46457ea0-2206-4631-ac1d-33aa4e176eec tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:05.319934 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-46457ea0-2206-4631-ac1d-33aa4e176eec tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.124138 Jul 23 21:33:05.321096 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2408/4742] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:33:05 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:33:05.467622 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-3feaa5d1-e323-4e2c-8ca7-19083920a459 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:05.487171 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-3feaa5d1-e323-4e2c-8ca7-19083920a459 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1496 microversion: 2.1 time: 0.463921 Jul 23 21:33:05.496991 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2335/4743] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:33:05 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1496 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:33:05.504822 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-28657ef0-fd84-4b7f-a5e4-8574c95bbdba tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:33:05.505368 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-28657ef0-fd84-4b7f-a5e4-8574c95bbdba tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:05.521338 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-28657ef0-fd84-4b7f-a5e4-8574c95bbdba tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:05.521801 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-28657ef0-fd84-4b7f-a5e4-8574c95bbdba tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:05.522635 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-28657ef0-fd84-4b7f-a5e4-8574c95bbdba tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:05.523078 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-28657ef0-fd84-4b7f-a5e4-8574c95bbdba tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:05.572119 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.objects.instance [None req-28657ef0-fd84-4b7f-a5e4-8574c95bbdba tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lazy-loading 'flavor' on Instance uuid f2ad2cfd-7479-48d0-b802-cdd5d5093305 {{(pid=131321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:33:05.608485 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-28657ef0-fd84-4b7f-a5e4-8574c95bbdba tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] HTTP exception thrown: Cannot 'suspend' instance f2ad2cfd-7479-48d0-b802-cdd5d5093305 while it is in vm_state suspended Jul 23 21:33:05.618733 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-28657ef0-fd84-4b7f-a5e4-8574c95bbdba tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Request method failure captured: Jul 23 21:33:05.618733 ncdv-master-1 devstack@n-api.service[131321]: request: POST /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305/action HTTP/1.1 Jul 23 21:33:05.618733 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:33:05.618733 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:33:05.618733 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:33:05.618733 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 15 Jul 23 21:33:05.618733 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:33:05.618733 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:33:05.618733 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:33:05.618733 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:33:05.618733 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3Ghf1JjZ4k8tVzERRK8IkLpluLUwa9k5Rz-X0dEr2p4_7xl_eBekUiNk1RZEGsFdGEiApbLOfcuSifirvwiKV1QOTaKdXKwfMnwZgdfagxJjoe3dPYUa3b-d3rVTYewIN_YoX2mMGGBMWRa3po8WOCVIc6hXJLExzq_ndbcO7U8NQBI Jul 23 21:33:05.618733 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:33:05.618733 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:33:05.618733 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:33:05.618733 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:33:05.618733 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:33:05.618733 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:33:05.618733 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: d70f6c96e1ad484aa3207fc01a12d519 Jul 23 21:33:05.618733 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:33:05.618733 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:33:05.618733 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:33:05.618733 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d70f6c96e1ad484aa3207fc01a12d519"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d70f6c96e1ad484aa3207fc01a12d519"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d70f6c96e1ad484aa3207fc01a12d519", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d70f6c96e1ad484aa3207fc01a12d519"}]}] Jul 23 21:33:05.618733 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:33:05.618733 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: d70f6c96e1ad484aa3207fc01a12d519 Jul 23 21:33:05.618733 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:33:05.618733 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ServersNegativeTestJSON-1106538570-project Jul 23 21:33:05.618733 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:33:05.618733 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:33:05.618733 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 6ca9644a73d9468aa39b21548a72bded Jul 23 21:33:05.618733 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ServersNegativeTestJSON-1106538570-project Jul 23 21:33:05.618733 ncdv-master-1 devstack@n-api.service[131321]: Jul 23 21:33:05.618733 ncdv-master-1 devstack@n-api.service[131321]: {"suspend": {}} Jul 23 21:33:05.618733 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:33:05.618733 ncdv-master-1 devstack@n-api.service[131321]: exception: Cannot 'suspend' instance f2ad2cfd-7479-48d0-b802-cdd5d5093305 while it is in vm_state suspended Jul 23 21:33:05.618733 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': 'f2ad2cfd-7479-48d0-b802-cdd5d5093305', 'body': {'suspend': {}}} Jul 23 21:33:05.618733 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:33:05.618733 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:33:05.618733 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Jul 23 21:33:05.618733 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Jul 23 21:33:05.618733 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 23 21:33:05.618733 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 23 21:33:05.618733 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 23 21:33:05.618733 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 23 21:33:05.618733 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 23 21:33:05.618733 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 23 21:33:05.618733 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Jul 23 21:33:05.618733 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 23 21:33:05.618733 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 23 21:33:05.618733 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 23 21:33:05.618733 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 23 21:33:05.618733 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 23 21:33:05.618733 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f2ad2cfd-7479-48d0-b802-cdd5d5093305 in vm_state suspended. Cannot suspend while the instance is in this state. Jul 23 21:33:05.618733 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:33:05.618733 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:33:05.618733 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:33:05.618733 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:33:05.618733 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:33:05.618733 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:33:05.618733 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:33:05.618733 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:33:05.618733 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:33:05.618733 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:33:05.618733 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Jul 23 21:33:05.618733 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 23 21:33:05.622799 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 23 21:33:05.622799 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 23 21:33:05.622799 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance f2ad2cfd-7479-48d0-b802-cdd5d5093305 while it is in vm_state suspended Jul 23 21:33:05.622799 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:33:05.622799 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:33:05.622799 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:33:05.622799 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:33:05.622799 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:33:05.622799 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:33:05.622799 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:33:05.622799 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:33:05.622799 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance f2ad2cfd-7479-48d0-b802-cdd5d5093305 while it is in vm_state suspended Jul 23 21:33:05.622799 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:33:05.622799 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-28657ef0-fd84-4b7f-a5e4-8574c95bbdba tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Returning 409 to user: Cannot 'suspend' instance f2ad2cfd-7479-48d0-b802-cdd5d5093305 while it is in vm_state suspended {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:33:05.622799 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-28657ef0-fd84-4b7f-a5e4-8574c95bbdba tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "POST /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305/action" status: 409 len: 148 microversion: 2.1 time: 0.119992 Jul 23 21:33:05.622799 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2409/4744] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:33:05 2022] POST /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305/action => generated 148 bytes in 121 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 23 21:33:05.639102 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-dd5668fb-a719-4bbb-afb1-b48bec23bc45 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:33:05.639669 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-dd5668fb-a719-4bbb-afb1-b48bec23bc45 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:05.660036 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dd5668fb-a719-4bbb-afb1-b48bec23bc45 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:05.660515 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dd5668fb-a719-4bbb-afb1-b48bec23bc45 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:05.667886 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dd5668fb-a719-4bbb-afb1-b48bec23bc45 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:05.669795 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dd5668fb-a719-4bbb-afb1-b48bec23bc45 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:05.830264 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-dd5668fb-a719-4bbb-afb1-b48bec23bc45 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "POST /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305/action" status: 202 len: 0 microversion: 2.1 time: 0.203359 Jul 23 21:33:05.836559 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2336/4745] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:33:05 2022] POST /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305/action => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:33:05.843828 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-60e04f58-4e31-4e91-a29c-3a126dd4c84b tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:05.844739 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-60e04f58-4e31-4e91-a29c-3a126dd4c84b tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:05.858648 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-60e04f58-4e31-4e91-a29c-3a126dd4c84b tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:05.859340 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-60e04f58-4e31-4e91-a29c-3a126dd4c84b tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:05.860477 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-60e04f58-4e31-4e91-a29c-3a126dd4c84b tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:05.861547 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-60e04f58-4e31-4e91-a29c-3a126dd4c84b tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:05.895945 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d56a8031-b740-4430-9f92-75a7418cc794 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:05.896816 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d56a8031-b740-4430-9f92-75a7418cc794 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] [instance: bbee3556-287f-42a5-a6a8-84356c840b67] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:05.913174 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d56a8031-b740-4430-9f92-75a7418cc794 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:05.913631 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d56a8031-b740-4430-9f92-75a7418cc794 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:05.918248 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d56a8031-b740-4430-9f92-75a7418cc794 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:05.921527 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d56a8031-b740-4430-9f92-75a7418cc794 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:06.139716 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-60e04f58-4e31-4e91-a29c-3a126dd4c84b tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:06.149571 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-60e04f58-4e31-4e91-a29c-3a126dd4c84b tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1502 microversion: 2.1 time: 0.312633 Jul 23 21:33:06.161912 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2410/4746] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:33:05 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1502 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:33:06.186303 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-9f1f774f-612b-409b-b2d6-99dbfc9da50f tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:06.189233 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-9f1f774f-612b-409b-b2d6-99dbfc9da50f tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] [instance: 0352d36b-f7b0-4c09-8517-a5711438d586] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:06.204638 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9f1f774f-612b-409b-b2d6-99dbfc9da50f tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:06.206521 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9f1f774f-612b-409b-b2d6-99dbfc9da50f tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:06.208097 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9f1f774f-612b-409b-b2d6-99dbfc9da50f tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:06.208552 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9f1f774f-612b-409b-b2d6-99dbfc9da50f tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:06.295013 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-9f1f774f-612b-409b-b2d6-99dbfc9da50f tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:06.309254 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-9f1f774f-612b-409b-b2d6-99dbfc9da50f tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:06.311261 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-9f1f774f-612b-409b-b2d6-99dbfc9da50f tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:06.312818 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-9f1f774f-612b-409b-b2d6-99dbfc9da50f tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] 10.222.0.17 "GET /compute/v2.1/servers/0352d36b-f7b0-4c09-8517-a5711438d586" status: 200 len: 1366 microversion: 2.57 time: 0.148263 Jul 23 21:33:06.315071 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2411/4747] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:33:06 2022] GET /compute/v2.1/servers/0352d36b-f7b0-4c09-8517-a5711438d586 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:33:06.320933 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-c0d10548-8824-4671-b9b1-fee277c4b4da req-03b68f91-9490-4349-93ba-b18352ec6783 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbee3556-287f-42a5-a6a8-84356c840b67", "tag": "b588225a-63d8-48d9-a3c7-0823a9dd1533"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:33:06.332267 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-c0d10548-8824-4671-b9b1-fee277c4b4da req-03b68f91-9490-4349-93ba-b18352ec6783 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:06.332937 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-c0d10548-8824-4671-b9b1-fee277c4b4da req-03b68f91-9490-4349-93ba-b18352ec6783 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:06.358145 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-c0d10548-8824-4671-b9b1-fee277c4b4da req-03b68f91-9490-4349-93ba-b18352ec6783 service nova] Creating event network-changed:b588225a-63d8-48d9-a3c7-0823a9dd1533 for instance bbee3556-287f-42a5-a6a8-84356c840b67 on nch2-master-1 Jul 23 21:33:06.364895 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-c0d10548-8824-4671-b9b1-fee277c4b4da req-03b68f91-9490-4349-93ba-b18352ec6783 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048319 Jul 23 21:33:06.370909 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2412/4748] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:33:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:33:06.378734 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-3602b464-41e5-4803-805d-4bc13a9f18ee tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:06.379656 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-3602b464-41e5-4803-805d-4bc13a9f18ee tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:06.389107 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3602b464-41e5-4803-805d-4bc13a9f18ee tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:06.389945 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3602b464-41e5-4803-805d-4bc13a9f18ee tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:06.390973 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3602b464-41e5-4803-805d-4bc13a9f18ee tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:06.391766 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3602b464-41e5-4803-805d-4bc13a9f18ee tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:06.546937 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-3602b464-41e5-4803-805d-4bc13a9f18ee tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:06.566250 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-3602b464-41e5-4803-805d-4bc13a9f18ee tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:06.569037 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-3602b464-41e5-4803-805d-4bc13a9f18ee tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:06.573380 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-3602b464-41e5-4803-805d-4bc13a9f18ee tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.200319 Jul 23 21:33:06.574389 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2413/4749] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:33:06 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:33:06.702239 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d56a8031-b740-4430-9f92-75a7418cc794 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b1e260651b4dffa7c1efe8e9d0f144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcf55bcaba04bf8ae8a9b2ac09e8d98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:06.745675 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d56a8031-b740-4430-9f92-75a7418cc794 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] 10.222.0.17 "GET /compute/v2.1/servers/bbee3556-287f-42a5-a6a8-84356c840b67" status: 200 len: 1368 microversion: 2.1 time: 0.844270 Jul 23 21:33:06.747389 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2337/4750] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:33:05 2022] GET /compute/v2.1/servers/bbee3556-287f-42a5-a6a8-84356c840b67 => generated 1368 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:33:07.170477 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ed45f0d1-fc98-4f90-9521-95fb5567c6bf tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:07.170991 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-ed45f0d1-fc98-4f90-9521-95fb5567c6bf tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:07.179014 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ed45f0d1-fc98-4f90-9521-95fb5567c6bf tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:07.180299 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ed45f0d1-fc98-4f90-9521-95fb5567c6bf tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:07.185836 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ed45f0d1-fc98-4f90-9521-95fb5567c6bf tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:07.186609 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ed45f0d1-fc98-4f90-9521-95fb5567c6bf tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:07.333923 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6439995e-e96f-4e41-a99a-f38047d9edbb tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:07.334563 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6439995e-e96f-4e41-a99a-f38047d9edbb tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] [instance: 0352d36b-f7b0-4c09-8517-a5711438d586] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:07.343024 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6439995e-e96f-4e41-a99a-f38047d9edbb tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:07.343748 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6439995e-e96f-4e41-a99a-f38047d9edbb tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:07.344970 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6439995e-e96f-4e41-a99a-f38047d9edbb tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:07.345561 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6439995e-e96f-4e41-a99a-f38047d9edbb tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:07.431862 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ed45f0d1-fc98-4f90-9521-95fb5567c6bf tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:07.443023 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-ed45f0d1-fc98-4f90-9521-95fb5567c6bf tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1502 microversion: 2.1 time: 0.276753 Jul 23 21:33:07.454208 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2414/4751] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:33:07 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1502 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:33:07.533006 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6439995e-e96f-4e41-a99a-f38047d9edbb tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:07.595115 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-52143389-bde8-4b75-b1a2-2fb02bfa338e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:07.596990 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-52143389-bde8-4b75-b1a2-2fb02bfa338e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:07.633370 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6439995e-e96f-4e41-a99a-f38047d9edbb tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:07.634960 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-52143389-bde8-4b75-b1a2-2fb02bfa338e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:07.639887 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-52143389-bde8-4b75-b1a2-2fb02bfa338e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:07.642939 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-52143389-bde8-4b75-b1a2-2fb02bfa338e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:07.646347 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6439995e-e96f-4e41-a99a-f38047d9edbb tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:07.648224 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-52143389-bde8-4b75-b1a2-2fb02bfa338e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:07.655612 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6439995e-e96f-4e41-a99a-f38047d9edbb tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] 10.222.0.17 "GET /compute/v2.1/servers/0352d36b-f7b0-4c09-8517-a5711438d586" status: 200 len: 1366 microversion: 2.57 time: 0.318412 Jul 23 21:33:07.661804 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2338/4752] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:33:07 2022] GET /compute/v2.1/servers/0352d36b-f7b0-4c09-8517-a5711438d586 => generated 1366 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:33:07.787490 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1b06ee1a-bf24-4d12-a2a3-8adf336277b7 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:07.789749 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1b06ee1a-bf24-4d12-a2a3-8adf336277b7 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] [instance: bbee3556-287f-42a5-a6a8-84356c840b67] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:07.809626 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1b06ee1a-bf24-4d12-a2a3-8adf336277b7 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:07.810147 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1b06ee1a-bf24-4d12-a2a3-8adf336277b7 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:07.811689 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1b06ee1a-bf24-4d12-a2a3-8adf336277b7 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:07.812291 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1b06ee1a-bf24-4d12-a2a3-8adf336277b7 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:08.007457 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-1b06ee1a-bf24-4d12-a2a3-8adf336277b7 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b1e260651b4dffa7c1efe8e9d0f144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcf55bcaba04bf8ae8a9b2ac09e8d98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:08.016871 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1b06ee1a-bf24-4d12-a2a3-8adf336277b7 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] 10.222.0.17 "GET /compute/v2.1/servers/bbee3556-287f-42a5-a6a8-84356c840b67" status: 200 len: 1368 microversion: 2.1 time: 0.254887 Jul 23 21:33:08.027231 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2339/4753] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:33:07 2022] GET /compute/v2.1/servers/bbee3556-287f-42a5-a6a8-84356c840b67 => generated 1368 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:33:08.038701 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-52143389-bde8-4b75-b1a2-2fb02bfa338e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:08.055255 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-52143389-bde8-4b75-b1a2-2fb02bfa338e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:08.058834 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-52143389-bde8-4b75-b1a2-2fb02bfa338e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:08.063119 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-52143389-bde8-4b75-b1a2-2fb02bfa338e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.473398 Jul 23 21:33:08.077023 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2415/4754] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:33:07 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:33:08.164822 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-80a161be-c8b1-4d4a-b68d-f494a517cbb0 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:08.165645 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-80a161be-c8b1-4d4a-b68d-f494a517cbb0 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] [instance: b0bb14c2-15df-4440-9d9c-4c6598867dfe] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:08.174714 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-80a161be-c8b1-4d4a-b68d-f494a517cbb0 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:08.176323 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-80a161be-c8b1-4d4a-b68d-f494a517cbb0 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:08.177679 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-80a161be-c8b1-4d4a-b68d-f494a517cbb0 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:08.178993 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-80a161be-c8b1-4d4a-b68d-f494a517cbb0 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:08.246253 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-80a161be-c8b1-4d4a-b68d-f494a517cbb0 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] 10.222.0.17 "GET /compute/v2.1/servers/b0bb14c2-15df-4440-9d9c-4c6598867dfe/ips" status: 200 len: 145 microversion: 2.1 time: 0.091839 Jul 23 21:33:08.249278 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2340/4755] 10.222.0.17 () {58 vars in 1247 bytes} [Sat Jul 23 21:33:08 2022] GET /compute/v2.1/servers/b0bb14c2-15df-4440-9d9c-4c6598867dfe/ips => generated 145 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:33:08.470056 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f184dcb9-9839-4df2-83df-adb1bad89514 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:08.482117 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-f184dcb9-9839-4df2-83df-adb1bad89514 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:08.498648 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f184dcb9-9839-4df2-83df-adb1bad89514 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:08.499743 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f184dcb9-9839-4df2-83df-adb1bad89514 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:08.500850 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f184dcb9-9839-4df2-83df-adb1bad89514 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:08.501538 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f184dcb9-9839-4df2-83df-adb1bad89514 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:08.682971 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a5f8d8a4-2580-4a77-aa67-90f9a8452a55 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:08.684186 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a5f8d8a4-2580-4a77-aa67-90f9a8452a55 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] [instance: 0352d36b-f7b0-4c09-8517-a5711438d586] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:08.690926 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a5f8d8a4-2580-4a77-aa67-90f9a8452a55 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:08.691599 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a5f8d8a4-2580-4a77-aa67-90f9a8452a55 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:08.692512 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a5f8d8a4-2580-4a77-aa67-90f9a8452a55 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:08.693118 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a5f8d8a4-2580-4a77-aa67-90f9a8452a55 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:08.853078 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-f184dcb9-9839-4df2-83df-adb1bad89514 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:08.860957 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-f184dcb9-9839-4df2-83df-adb1bad89514 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1505 microversion: 2.1 time: 0.395312 Jul 23 21:33:08.883722 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2416/4756] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:33:08 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1505 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:33:08.899392 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c6b82fb9-802b-475f-bf0b-2bc46febc9ce tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:08.900285 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-c6b82fb9-802b-475f-bf0b-2bc46febc9ce tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:08.911365 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c6b82fb9-802b-475f-bf0b-2bc46febc9ce tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:08.912024 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c6b82fb9-802b-475f-bf0b-2bc46febc9ce tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:08.913181 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c6b82fb9-802b-475f-bf0b-2bc46febc9ce tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:08.914124 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c6b82fb9-802b-475f-bf0b-2bc46febc9ce tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:09.049716 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a5f8d8a4-2580-4a77-aa67-90f9a8452a55 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:09.065981 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a5f8d8a4-2580-4a77-aa67-90f9a8452a55 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:09.067903 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a5f8d8a4-2580-4a77-aa67-90f9a8452a55 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:09.069290 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a5f8d8a4-2580-4a77-aa67-90f9a8452a55 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] 10.222.0.17 "GET /compute/v2.1/servers/0352d36b-f7b0-4c09-8517-a5711438d586" status: 200 len: 1366 microversion: 2.57 time: 0.391189 Jul 23 21:33:09.075175 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2341/4757] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:33:08 2022] GET /compute/v2.1/servers/0352d36b-f7b0-4c09-8517-a5711438d586 => generated 1366 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:33:09.080523 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9f835ef6-c052-4d3d-8a6a-416245e34cc0 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:09.084716 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-9f835ef6-c052-4d3d-8a6a-416245e34cc0 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] [instance: bbee3556-287f-42a5-a6a8-84356c840b67] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:09.099860 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9f835ef6-c052-4d3d-8a6a-416245e34cc0 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:09.101955 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9f835ef6-c052-4d3d-8a6a-416245e34cc0 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:09.105442 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9f835ef6-c052-4d3d-8a6a-416245e34cc0 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:09.106168 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9f835ef6-c052-4d3d-8a6a-416245e34cc0 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:09.184229 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c6b82fb9-802b-475f-bf0b-2bc46febc9ce tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:09.192001 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-c6b82fb9-802b-475f-bf0b-2bc46febc9ce tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1505 microversion: 2.1 time: 0.306818 Jul 23 21:33:09.202697 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2417/4758] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:33:08 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1505 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:33:09.219188 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c4fcbd2f-9229-4149-8aa6-7520e0819d45 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:09.220025 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-c4fcbd2f-9229-4149-8aa6-7520e0819d45 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:09.227279 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c4fcbd2f-9229-4149-8aa6-7520e0819d45 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:09.228084 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c4fcbd2f-9229-4149-8aa6-7520e0819d45 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:09.228873 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c4fcbd2f-9229-4149-8aa6-7520e0819d45 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:09.229480 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c4fcbd2f-9229-4149-8aa6-7520e0819d45 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:09.339205 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c4fcbd2f-9229-4149-8aa6-7520e0819d45 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:09.349151 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c4fcbd2f-9229-4149-8aa6-7520e0819d45 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:09.362155 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c4fcbd2f-9229-4149-8aa6-7520e0819d45 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:09.363677 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-c4fcbd2f-9229-4149-8aa6-7520e0819d45 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.148749 Jul 23 21:33:09.364478 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2418/4759] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:33:09 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:33:09.369702 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-894561b5-f950-4d23-a561-fb50043043bb tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:33:09.377132 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-894561b5-f950-4d23-a561-fb50043043bb tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: 80b7d6fa-c57b-48ea-b888-b45f805134aa] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:09.382904 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell0:SELECT=2 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:09.384410 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-894561b5-f950-4d23-a561-fb50043043bb tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] HTTP exception thrown: Instance 80b7d6fa-c57b-48ea-b888-b45f805134aa could not be found. Jul 23 21:33:09.389008 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-894561b5-f950-4d23-a561-fb50043043bb tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Request method failure captured: Jul 23 21:33:09.389008 ncdv-master-1 devstack@n-api.service[131321]: request: POST /compute/v2.1/servers/80b7d6fa-c57b-48ea-b888-b45f805134aa/action HTTP/1.1 Jul 23 21:33:09.389008 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:33:09.389008 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:33:09.389008 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:33:09.389008 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 15 Jul 23 21:33:09.389008 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:33:09.389008 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:33:09.389008 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:33:09.389008 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:33:09.389008 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3Ghf1JjZ4k8tVzERRK8IkLpluLUwa9k5Rz-X0dEr2p4_7xl_eBekUiNk1RZEGsFdGEiApbLOfcuSifirvwiKV1QOTaKdXKwfMnwZgdfagxJjoe3dPYUa3b-d3rVTYewIN_YoX2mMGGBMWRa3po8WOCVIc6hXJLExzq_ndbcO7U8NQBI Jul 23 21:33:09.389008 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:33:09.389008 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:33:09.389008 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:33:09.389008 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:33:09.389008 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:33:09.389008 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:33:09.389008 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: d70f6c96e1ad484aa3207fc01a12d519 Jul 23 21:33:09.389008 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:33:09.389008 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:33:09.389008 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:33:09.389008 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d70f6c96e1ad484aa3207fc01a12d519"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d70f6c96e1ad484aa3207fc01a12d519"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d70f6c96e1ad484aa3207fc01a12d519", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d70f6c96e1ad484aa3207fc01a12d519"}]}] Jul 23 21:33:09.389008 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:33:09.389008 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: d70f6c96e1ad484aa3207fc01a12d519 Jul 23 21:33:09.389008 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:33:09.389008 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ServersNegativeTestJSON-1106538570-project Jul 23 21:33:09.389008 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:33:09.389008 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:33:09.389008 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 6ca9644a73d9468aa39b21548a72bded Jul 23 21:33:09.389008 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ServersNegativeTestJSON-1106538570-project Jul 23 21:33:09.389008 ncdv-master-1 devstack@n-api.service[131321]: Jul 23 21:33:09.389008 ncdv-master-1 devstack@n-api.service[131321]: {"unpause": {}} Jul 23 21:33:09.389008 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:33:09.389008 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance 80b7d6fa-c57b-48ea-b888-b45f805134aa could not be found. Jul 23 21:33:09.389008 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': '80b7d6fa-c57b-48ea-b888-b45f805134aa', 'body': {'unpause': {}}} Jul 23 21:33:09.389008 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:33:09.389008 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:33:09.389008 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:33:09.389008 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:33:09.389008 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:33:09.389008 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:33:09.389008 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 23 21:33:09.389008 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 23 21:33:09.389008 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80b7d6fa-c57b-48ea-b888-b45f805134aa could not be found. Jul 23 21:33:09.389008 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:33:09.389008 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:33:09.389008 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:33:09.389008 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:33:09.389008 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:33:09.389008 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:33:09.389008 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:33:09.389008 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:33:09.389008 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:33:09.389008 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:33:09.389008 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Jul 23 21:33:09.389008 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Jul 23 21:33:09.389008 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:33:09.389008 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:33:09.389008 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80b7d6fa-c57b-48ea-b888-b45f805134aa could not be found. Jul 23 21:33:09.389008 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:33:09.389008 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:33:09.389008 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:33:09.389008 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:33:09.389008 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:33:09.389008 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:33:09.393630 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:33:09.393630 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:33:09.393630 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80b7d6fa-c57b-48ea-b888-b45f805134aa could not be found. Jul 23 21:33:09.393630 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:33:09.396702 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-894561b5-f950-4d23-a561-fb50043043bb tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Returning 404 to user: Instance 80b7d6fa-c57b-48ea-b888-b45f805134aa could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:33:09.397753 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-894561b5-f950-4d23-a561-fb50043043bb tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "POST /compute/v2.1/servers/80b7d6fa-c57b-48ea-b888-b45f805134aa/action" status: 404 len: 111 microversion: 2.1 time: 0.032006 Jul 23 21:33:09.404625 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2419/4760] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:33:09 2022] POST /compute/v2.1/servers/80b7d6fa-c57b-48ea-b888-b45f805134aa/action => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:33:09.409945 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-996a5897-b5c0-48fc-87f7-4411fc9fe8ef tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:09.413179 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-996a5897-b5c0-48fc-87f7-4411fc9fe8ef tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:09.431468 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell0:SELECT=6 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:09.433549 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-996a5897-b5c0-48fc-87f7-4411fc9fe8ef tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:09.433966 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-996a5897-b5c0-48fc-87f7-4411fc9fe8ef tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:09.434777 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-996a5897-b5c0-48fc-87f7-4411fc9fe8ef tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:09.435212 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-996a5897-b5c0-48fc-87f7-4411fc9fe8ef tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:09.757806 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=12 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:09.874139 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-996a5897-b5c0-48fc-87f7-4411fc9fe8ef tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:09.892958 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-996a5897-b5c0-48fc-87f7-4411fc9fe8ef tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1505 microversion: 2.1 time: 0.479920 Jul 23 21:33:09.894632 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2420/4761] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:33:09 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1505 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:33:09.929076 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-4b5db613-1383-4af3-832b-94708f217fda tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:09.935352 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-4b5db613-1383-4af3-832b-94708f217fda tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:09.945563 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-9f835ef6-c052-4d3d-8a6a-416245e34cc0 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b1e260651b4dffa7c1efe8e9d0f144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcf55bcaba04bf8ae8a9b2ac09e8d98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:09.962084 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4b5db613-1383-4af3-832b-94708f217fda tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:09.962084 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4b5db613-1383-4af3-832b-94708f217fda tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:09.962084 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4b5db613-1383-4af3-832b-94708f217fda tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:09.962084 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4b5db613-1383-4af3-832b-94708f217fda tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:09.962561 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9f835ef6-c052-4d3d-8a6a-416245e34cc0 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] 10.222.0.17 "GET /compute/v2.1/servers/bbee3556-287f-42a5-a6a8-84356c840b67" status: 200 len: 1368 microversion: 2.1 time: 0.876857 Jul 23 21:33:09.962561 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2342/4762] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:33:09 2022] GET /compute/v2.1/servers/bbee3556-287f-42a5-a6a8-84356c840b67 => generated 1368 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:33:10.090820 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-061e6ce3-765c-45a1-baf5-da7a4ef43dbb tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:10.091792 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-061e6ce3-765c-45a1-baf5-da7a4ef43dbb tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] [instance: 0352d36b-f7b0-4c09-8517-a5711438d586] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:10.105273 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-061e6ce3-765c-45a1-baf5-da7a4ef43dbb tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:10.106091 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-061e6ce3-765c-45a1-baf5-da7a4ef43dbb tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:10.107087 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-061e6ce3-765c-45a1-baf5-da7a4ef43dbb tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:10.107710 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-061e6ce3-765c-45a1-baf5-da7a4ef43dbb tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:10.229550 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-061e6ce3-765c-45a1-baf5-da7a4ef43dbb tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:10.237953 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-061e6ce3-765c-45a1-baf5-da7a4ef43dbb tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:10.239635 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-061e6ce3-765c-45a1-baf5-da7a4ef43dbb tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:10.241264 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-061e6ce3-765c-45a1-baf5-da7a4ef43dbb tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] 10.222.0.17 "GET /compute/v2.1/servers/0352d36b-f7b0-4c09-8517-a5711438d586" status: 200 len: 1366 microversion: 2.57 time: 0.155036 Jul 23 21:33:10.253056 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2343/4763] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:33:10 2022] GET /compute/v2.1/servers/0352d36b-f7b0-4c09-8517-a5711438d586 => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:33:10.297584 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-4b5db613-1383-4af3-832b-94708f217fda tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:10.306478 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-4b5db613-1383-4af3-832b-94708f217fda tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1505 microversion: 2.1 time: 0.390018 Jul 23 21:33:10.307869 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2421/4764] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:33:09 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1505 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:33:10.324639 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-35a3846c-6f89-4697-8dfd-799dfaabdd08 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:33:10.325274 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-35a3846c-6f89-4697-8dfd-799dfaabdd08 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:10.344314 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-35a3846c-6f89-4697-8dfd-799dfaabdd08 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:10.345768 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-35a3846c-6f89-4697-8dfd-799dfaabdd08 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:10.347486 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-35a3846c-6f89-4697-8dfd-799dfaabdd08 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:10.348163 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-35a3846c-6f89-4697-8dfd-799dfaabdd08 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:10.387314 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-96bd4622-4366-4288-bce6-05106281f8bd tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:10.389429 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-96bd4622-4366-4288-bce6-05106281f8bd tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:10.391800 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-35a3846c-6f89-4697-8dfd-799dfaabdd08 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] HTTP exception thrown: Cannot 'unpause' instance f2ad2cfd-7479-48d0-b802-cdd5d5093305 while it is in vm_state active Jul 23 21:33:10.393989 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-35a3846c-6f89-4697-8dfd-799dfaabdd08 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Request method failure captured: Jul 23 21:33:10.393989 ncdv-master-1 devstack@n-api.service[131320]: request: POST /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305/action HTTP/1.1 Jul 23 21:33:10.393989 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:33:10.393989 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:33:10.393989 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:33:10.393989 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 15 Jul 23 21:33:10.393989 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:33:10.393989 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:33:10.393989 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:33:10.393989 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:33:10.393989 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3Ghf1JjZ4k8tVzERRK8IkLpluLUwa9k5Rz-X0dEr2p4_7xl_eBekUiNk1RZEGsFdGEiApbLOfcuSifirvwiKV1QOTaKdXKwfMnwZgdfagxJjoe3dPYUa3b-d3rVTYewIN_YoX2mMGGBMWRa3po8WOCVIc6hXJLExzq_ndbcO7U8NQBI Jul 23 21:33:10.393989 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:33:10.393989 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:33:10.393989 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:33:10.393989 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:33:10.393989 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:33:10.393989 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:33:10.393989 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: d70f6c96e1ad484aa3207fc01a12d519 Jul 23 21:33:10.393989 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:33:10.393989 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:33:10.393989 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:33:10.393989 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d70f6c96e1ad484aa3207fc01a12d519"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d70f6c96e1ad484aa3207fc01a12d519"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d70f6c96e1ad484aa3207fc01a12d519", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d70f6c96e1ad484aa3207fc01a12d519"}]}] Jul 23 21:33:10.393989 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:33:10.393989 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: d70f6c96e1ad484aa3207fc01a12d519 Jul 23 21:33:10.393989 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:33:10.393989 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServersNegativeTestJSON-1106538570-project Jul 23 21:33:10.393989 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:33:10.393989 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:33:10.393989 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 6ca9644a73d9468aa39b21548a72bded Jul 23 21:33:10.393989 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServersNegativeTestJSON-1106538570-project Jul 23 21:33:10.393989 ncdv-master-1 devstack@n-api.service[131320]: Jul 23 21:33:10.393989 ncdv-master-1 devstack@n-api.service[131320]: {"unpause": {}} Jul 23 21:33:10.393989 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:33:10.393989 ncdv-master-1 devstack@n-api.service[131320]: exception: Cannot 'unpause' instance f2ad2cfd-7479-48d0-b802-cdd5d5093305 while it is in vm_state active Jul 23 21:33:10.393989 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': 'f2ad2cfd-7479-48d0-b802-cdd5d5093305', 'body': {'unpause': {}}} Jul 23 21:33:10.393989 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:33:10.393989 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:33:10.393989 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Jul 23 21:33:10.393989 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Jul 23 21:33:10.393989 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 23 21:33:10.393989 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 23 21:33:10.393989 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 23 21:33:10.393989 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 23 21:33:10.393989 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f2ad2cfd-7479-48d0-b802-cdd5d5093305 in vm_state active. Cannot unpause while the instance is in this state. Jul 23 21:33:10.393989 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:10.393989 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:33:10.393989 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:10.393989 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:33:10.393989 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:33:10.393989 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:33:10.393989 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:33:10.393989 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:33:10.393989 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:33:10.393989 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:33:10.393989 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Jul 23 21:33:10.393989 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 23 21:33:10.393989 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 23 21:33:10.393989 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 23 21:33:10.393989 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance f2ad2cfd-7479-48d0-b802-cdd5d5093305 while it is in vm_state active Jul 23 21:33:10.393989 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:10.393989 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:33:10.393989 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:10.393989 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:33:10.393989 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:33:10.397826 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:33:10.397826 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:33:10.397826 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:33:10.397826 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance f2ad2cfd-7479-48d0-b802-cdd5d5093305 while it is in vm_state active Jul 23 21:33:10.397826 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:10.399488 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-35a3846c-6f89-4697-8dfd-799dfaabdd08 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Returning 409 to user: Cannot 'unpause' instance f2ad2cfd-7479-48d0-b802-cdd5d5093305 while it is in vm_state active {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:33:10.399679 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-96bd4622-4366-4288-bce6-05106281f8bd tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:10.399679 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-96bd4622-4366-4288-bce6-05106281f8bd tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:10.399999 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-35a3846c-6f89-4697-8dfd-799dfaabdd08 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "POST /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305/action" status: 409 len: 145 microversion: 2.1 time: 0.079572 Jul 23 21:33:10.400481 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-96bd4622-4366-4288-bce6-05106281f8bd tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:10.400922 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-96bd4622-4366-4288-bce6-05106281f8bd tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:10.406346 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2344/4765] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:33:10 2022] POST /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305/action => generated 145 bytes in 87 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 23 21:33:10.412940 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9fb88201-bf60-4a43-842b-c2cd51c34999 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:10.413377 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-9fb88201-bf60-4a43-842b-c2cd51c34999 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:10.432062 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9fb88201-bf60-4a43-842b-c2cd51c34999 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:10.432514 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9fb88201-bf60-4a43-842b-c2cd51c34999 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:10.433306 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9fb88201-bf60-4a43-842b-c2cd51c34999 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:10.433746 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9fb88201-bf60-4a43-842b-c2cd51c34999 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:10.683749 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-9fb88201-bf60-4a43-842b-c2cd51c34999 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:10.705393 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9fb88201-bf60-4a43-842b-c2cd51c34999 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1505 microversion: 2.1 time: 0.298084 Jul 23 21:33:10.709758 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2345/4766] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:33:10 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1505 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:33:10.729768 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-71210c58-bf52-481c-8127-b0904b9a57a3 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:10.730615 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-71210c58-bf52-481c-8127-b0904b9a57a3 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:10.748058 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-71210c58-bf52-481c-8127-b0904b9a57a3 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:10.764755 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-71210c58-bf52-481c-8127-b0904b9a57a3 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:10.765687 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-71210c58-bf52-481c-8127-b0904b9a57a3 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:10.766188 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-71210c58-bf52-481c-8127-b0904b9a57a3 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:10.908697 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-96bd4622-4366-4288-bce6-05106281f8bd tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:10.939084 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-96bd4622-4366-4288-bce6-05106281f8bd tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:10.946273 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-96bd4622-4366-4288-bce6-05106281f8bd tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:10.949744 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-96bd4622-4366-4288-bce6-05106281f8bd tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.567905 Jul 23 21:33:10.950790 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2422/4767] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:33:10 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:33:10.956252 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-1d59ccdf-99c9-45ab-a5ad-27733e2c54d0 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:10.956757 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-1d59ccdf-99c9-45ab-a5ad-27733e2c54d0 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] [instance: 1f5b9a5a-109e-48b5-adc1-113384944dce] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:10.979246 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1d59ccdf-99c9-45ab-a5ad-27733e2c54d0 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:10.984780 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1d59ccdf-99c9-45ab-a5ad-27733e2c54d0 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:10.985894 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1d59ccdf-99c9-45ab-a5ad-27733e2c54d0 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:10.986493 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1d59ccdf-99c9-45ab-a5ad-27733e2c54d0 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:11.058811 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-1d59ccdf-99c9-45ab-a5ad-27733e2c54d0 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] [instance: 1f5b9a5a-109e-48b5-adc1-113384944dce] Going to try to terminate instance {{(pid=131321) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:33:11.063917 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-71210c58-bf52-481c-8127-b0904b9a57a3 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:11.071928 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-71210c58-bf52-481c-8127-b0904b9a57a3 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1505 microversion: 2.1 time: 0.348409 Jul 23 21:33:11.090324 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2346/4768] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:33:10 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1505 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:33:11.097694 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-3167c616-52eb-41ee-80e6-e82e76a33489 req-42ecf522-b10d-4668-8ab6-2f91e6be2c7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f5b9a5a-109e-48b5-adc1-113384944dce", "tag": "b947908f-6578-44ec-898d-fff1852fea99"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:33:11.115297 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-3167c616-52eb-41ee-80e6-e82e76a33489 req-42ecf522-b10d-4668-8ab6-2f91e6be2c7d service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:11.116769 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-3167c616-52eb-41ee-80e6-e82e76a33489 req-42ecf522-b10d-4668-8ab6-2f91e6be2c7d service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:11.142127 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-3167c616-52eb-41ee-80e6-e82e76a33489 req-42ecf522-b10d-4668-8ab6-2f91e6be2c7d service nova] Creating event network-changed:b947908f-6578-44ec-898d-fff1852fea99 for instance 1f5b9a5a-109e-48b5-adc1-113384944dce on nch2-master-1 Jul 23 21:33:11.152626 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-3167c616-52eb-41ee-80e6-e82e76a33489 req-42ecf522-b10d-4668-8ab6-2f91e6be2c7d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060945 Jul 23 21:33:11.162850 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2347/4769] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:33:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:33:11.168797 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-cef84d3f-8cba-4eb9-9089-0af4e0c5fe84 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:11.169503 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-cef84d3f-8cba-4eb9-9089-0af4e0c5fe84 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] [instance: bbee3556-287f-42a5-a6a8-84356c840b67] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:11.190040 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cef84d3f-8cba-4eb9-9089-0af4e0c5fe84 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:11.190793 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cef84d3f-8cba-4eb9-9089-0af4e0c5fe84 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:11.195692 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cef84d3f-8cba-4eb9-9089-0af4e0c5fe84 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:11.196339 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cef84d3f-8cba-4eb9-9089-0af4e0c5fe84 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:11.225628 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-1d59ccdf-99c9-45ab-a5ad-27733e2c54d0 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] 10.222.0.17 "DELETE /compute/v2.1/servers/1f5b9a5a-109e-48b5-adc1-113384944dce" status: 204 len: 0 microversion: 2.1 time: 0.272748 Jul 23 21:33:11.226277 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2423/4770] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:33:10 2022] DELETE /compute/v2.1/servers/1f5b9a5a-109e-48b5-adc1-113384944dce => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:33:11.240342 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-5b930da5-4491-4e65-84bf-570c2d5a26a5 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:33:11.245497 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-5b930da5-4491-4e65-84bf-570c2d5a26a5 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: ccdeb3cc-0c7f-4659-b5a1-a3cddf44b04f] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:11.252492 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:11.267390 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-5b930da5-4491-4e65-84bf-570c2d5a26a5 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] HTTP exception thrown: Instance ccdeb3cc-0c7f-4659-b5a1-a3cddf44b04f could not be found. Jul 23 21:33:11.269213 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-5b930da5-4491-4e65-84bf-570c2d5a26a5 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Request method failure captured: Jul 23 21:33:11.269213 ncdv-master-1 devstack@n-api.service[131321]: request: POST /compute/v2.1/servers/ccdeb3cc-0c7f-4659-b5a1-a3cddf44b04f/action HTTP/1.1 Jul 23 21:33:11.269213 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:33:11.269213 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:33:11.269213 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:33:11.269213 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 18 Jul 23 21:33:11.269213 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:33:11.269213 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:33:11.269213 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:33:11.269213 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:33:11.269213 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3Ghf1JjZ4k8tVzERRK8IkLpluLUwa9k5Rz-X0dEr2p4_7xl_eBekUiNk1RZEGsFdGEiApbLOfcuSifirvwiKV1QOTaKdXKwfMnwZgdfagxJjoe3dPYUa3b-d3rVTYewIN_YoX2mMGGBMWRa3po8WOCVIc6hXJLExzq_ndbcO7U8NQBI Jul 23 21:33:11.269213 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:33:11.269213 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:33:11.269213 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:33:11.269213 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:33:11.269213 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:33:11.269213 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:33:11.269213 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: d70f6c96e1ad484aa3207fc01a12d519 Jul 23 21:33:11.269213 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:33:11.269213 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:33:11.269213 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:33:11.269213 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d70f6c96e1ad484aa3207fc01a12d519"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d70f6c96e1ad484aa3207fc01a12d519"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d70f6c96e1ad484aa3207fc01a12d519", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d70f6c96e1ad484aa3207fc01a12d519"}]}] Jul 23 21:33:11.269213 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:33:11.269213 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: d70f6c96e1ad484aa3207fc01a12d519 Jul 23 21:33:11.269213 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:33:11.269213 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ServersNegativeTestJSON-1106538570-project Jul 23 21:33:11.269213 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:33:11.269213 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:33:11.269213 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 6ca9644a73d9468aa39b21548a72bded Jul 23 21:33:11.269213 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ServersNegativeTestJSON-1106538570-project Jul 23 21:33:11.269213 ncdv-master-1 devstack@n-api.service[131321]: Jul 23 21:33:11.269213 ncdv-master-1 devstack@n-api.service[131321]: {"unshelve": null} Jul 23 21:33:11.269213 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:33:11.269213 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance ccdeb3cc-0c7f-4659-b5a1-a3cddf44b04f could not be found. Jul 23 21:33:11.269213 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': 'ccdeb3cc-0c7f-4659-b5a1-a3cddf44b04f', 'body': {'unshelve': None}} Jul 23 21:33:11.269213 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:33:11.269213 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:33:11.269213 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:33:11.269213 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:33:11.269213 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:33:11.269213 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:33:11.269213 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 23 21:33:11.269213 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 23 21:33:11.269213 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ccdeb3cc-0c7f-4659-b5a1-a3cddf44b04f could not be found. Jul 23 21:33:11.269213 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:33:11.269213 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:33:11.269213 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:33:11.269213 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:33:11.269213 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:33:11.269213 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:33:11.269213 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:33:11.269213 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:33:11.269213 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:33:11.269213 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:33:11.269213 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:33:11.269213 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:33:11.269213 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 94, in _unshelve Jul 23 21:33:11.269213 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 23 21:33:11.269213 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:33:11.269213 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:33:11.269213 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ccdeb3cc-0c7f-4659-b5a1-a3cddf44b04f could not be found. Jul 23 21:33:11.269213 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:33:11.269213 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:33:11.269213 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:33:11.269213 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:33:11.274257 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:33:11.274257 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:33:11.274257 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:33:11.274257 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:33:11.274257 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ccdeb3cc-0c7f-4659-b5a1-a3cddf44b04f could not be found. Jul 23 21:33:11.274257 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:33:11.274257 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-5b930da5-4491-4e65-84bf-570c2d5a26a5 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Returning 404 to user: Instance ccdeb3cc-0c7f-4659-b5a1-a3cddf44b04f could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:33:11.276613 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-5b930da5-4491-4e65-84bf-570c2d5a26a5 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "POST /compute/v2.1/servers/ccdeb3cc-0c7f-4659-b5a1-a3cddf44b04f/action" status: 404 len: 111 microversion: 2.1 time: 0.048289 Jul 23 21:33:11.279727 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2424/4771] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:33:11 2022] POST /compute/v2.1/servers/ccdeb3cc-0c7f-4659-b5a1-a3cddf44b04f/action => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:33:11.300713 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-8a263dc6-bd28-4313-9557-7c8f157b3f9a tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:11.303080 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-8a263dc6-bd28-4313-9557-7c8f157b3f9a tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] [instance: 1f5b9a5a-109e-48b5-adc1-113384944dce] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:11.322877 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8a263dc6-bd28-4313-9557-7c8f157b3f9a tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:11.327001 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8a263dc6-bd28-4313-9557-7c8f157b3f9a tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:11.328089 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8a263dc6-bd28-4313-9557-7c8f157b3f9a tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:11.328703 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8a263dc6-bd28-4313-9557-7c8f157b3f9a tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:11.600728 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-cef84d3f-8cba-4eb9-9089-0af4e0c5fe84 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b1e260651b4dffa7c1efe8e9d0f144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcf55bcaba04bf8ae8a9b2ac09e8d98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:11.616930 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-cef84d3f-8cba-4eb9-9089-0af4e0c5fe84 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] 10.222.0.17 "GET /compute/v2.1/servers/bbee3556-287f-42a5-a6a8-84356c840b67" status: 200 len: 1368 microversion: 2.1 time: 0.452653 Jul 23 21:33:11.618511 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2348/4772] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:33:11 2022] GET /compute/v2.1/servers/bbee3556-287f-42a5-a6a8-84356c840b67 => generated 1368 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:33:11.630292 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d8e7dead-bcb1-4488-8702-3e130e90f0e1 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:11.630921 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d8e7dead-bcb1-4488-8702-3e130e90f0e1 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] [instance: 0352d36b-f7b0-4c09-8517-a5711438d586] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:11.658549 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d8e7dead-bcb1-4488-8702-3e130e90f0e1 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:11.659010 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d8e7dead-bcb1-4488-8702-3e130e90f0e1 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:11.659821 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d8e7dead-bcb1-4488-8702-3e130e90f0e1 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:11.660272 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d8e7dead-bcb1-4488-8702-3e130e90f0e1 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:11.689593 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-8a263dc6-bd28-4313-9557-7c8f157b3f9a tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd49331138a4dbc912bc7bf6f6b0215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842a1aca542f416eab5d43b881325917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:11.695096 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:11.706576 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-8a263dc6-bd28-4313-9557-7c8f157b3f9a tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] 10.222.0.17 "GET /compute/v2.1/servers/1f5b9a5a-109e-48b5-adc1-113384944dce" status: 200 len: 1767 microversion: 2.1 time: 0.425410 Jul 23 21:33:11.716637 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2425/4773] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:33:11 2022] GET /compute/v2.1/servers/1f5b9a5a-109e-48b5-adc1-113384944dce => generated 1767 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:33:11.721719 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a934bdc7-99a5-44fe-88e6-65dbd47244fe tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:11.722375 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-a934bdc7-99a5-44fe-88e6-65dbd47244fe tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:11.755472 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a934bdc7-99a5-44fe-88e6-65dbd47244fe tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:11.759180 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a934bdc7-99a5-44fe-88e6-65dbd47244fe tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:11.760118 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a934bdc7-99a5-44fe-88e6-65dbd47244fe tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:11.760575 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a934bdc7-99a5-44fe-88e6-65dbd47244fe tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:11.852003 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d8e7dead-bcb1-4488-8702-3e130e90f0e1 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:11.871579 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d8e7dead-bcb1-4488-8702-3e130e90f0e1 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:11.873908 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d8e7dead-bcb1-4488-8702-3e130e90f0e1 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:11.874414 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d8e7dead-bcb1-4488-8702-3e130e90f0e1 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] 10.222.0.17 "GET /compute/v2.1/servers/0352d36b-f7b0-4c09-8517-a5711438d586" status: 200 len: 1366 microversion: 2.57 time: 0.253172 Jul 23 21:33:11.885377 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2349/4774] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:33:11 2022] GET /compute/v2.1/servers/0352d36b-f7b0-4c09-8517-a5711438d586 => generated 1366 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:33:11.885377 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-eac830f5-7de7-4868-8339-c77e31ab68bf req-b06b0ab7-34e1-4951-a550-a333413c3198 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbee3556-287f-42a5-a6a8-84356c840b67", "name": "network-vif-plugged", "status": "completed", "tag": "b588225a-63d8-48d9-a3c7-0823a9dd1533"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:33:11.898457 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:11.900517 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-eac830f5-7de7-4868-8339-c77e31ab68bf req-b06b0ab7-34e1-4951-a550-a333413c3198 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:11.900978 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-eac830f5-7de7-4868-8339-c77e31ab68bf req-b06b0ab7-34e1-4951-a550-a333413c3198 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:11.928808 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-eac830f5-7de7-4868-8339-c77e31ab68bf req-b06b0ab7-34e1-4951-a550-a333413c3198 service nova] Creating event network-vif-plugged:b588225a-63d8-48d9-a3c7-0823a9dd1533 for instance bbee3556-287f-42a5-a6a8-84356c840b67 on nch2-master-1 Jul 23 21:33:11.935832 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-eac830f5-7de7-4868-8339-c77e31ab68bf req-b06b0ab7-34e1-4951-a550-a333413c3198 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059215 Jul 23 21:33:11.937073 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2350/4775] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:33:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:33:11.974038 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4ecf8cca-d255-4f7b-beea-c05cc4b70a0b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:11.974945 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-4ecf8cca-d255-4f7b-beea-c05cc4b70a0b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:11.990059 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4ecf8cca-d255-4f7b-beea-c05cc4b70a0b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:11.991711 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4ecf8cca-d255-4f7b-beea-c05cc4b70a0b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:11.992924 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4ecf8cca-d255-4f7b-beea-c05cc4b70a0b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:11.994764 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4ecf8cca-d255-4f7b-beea-c05cc4b70a0b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:12.048445 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-a934bdc7-99a5-44fe-88e6-65dbd47244fe tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:12.061712 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-a934bdc7-99a5-44fe-88e6-65dbd47244fe tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1505 microversion: 2.1 time: 0.349660 Jul 23 21:33:12.063861 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2426/4776] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:33:11 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1505 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:33:12.088566 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-fae2fc54-cfe6-4e33-b90a-ff1a9899f89d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:12.089563 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-fae2fc54-cfe6-4e33-b90a-ff1a9899f89d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:12.097754 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fae2fc54-cfe6-4e33-b90a-ff1a9899f89d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:12.098410 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fae2fc54-cfe6-4e33-b90a-ff1a9899f89d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:12.099361 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fae2fc54-cfe6-4e33-b90a-ff1a9899f89d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:12.099972 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fae2fc54-cfe6-4e33-b90a-ff1a9899f89d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:12.174813 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-4ecf8cca-d255-4f7b-beea-c05cc4b70a0b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:12.198110 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-4ecf8cca-d255-4f7b-beea-c05cc4b70a0b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:12.200139 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-4ecf8cca-d255-4f7b-beea-c05cc4b70a0b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:12.202271 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4ecf8cca-d255-4f7b-beea-c05cc4b70a0b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.235888 Jul 23 21:33:12.203442 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2351/4777] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:33:11 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:33:12.264680 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-fae2fc54-cfe6-4e33-b90a-ff1a9899f89d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:12.274300 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-fae2fc54-cfe6-4e33-b90a-ff1a9899f89d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1505 microversion: 2.1 time: 0.191046 Jul 23 21:33:12.274829 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2427/4778] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:33:12 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1505 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:33:12.291168 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c86317d4-d929-45dd-9c96-26478a636c3d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:33:12.292773 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c86317d4-d929-45dd-9c96-26478a636c3d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:12.302236 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c86317d4-d929-45dd-9c96-26478a636c3d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:12.303029 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c86317d4-d929-45dd-9c96-26478a636c3d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:12.305128 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c86317d4-d929-45dd-9c96-26478a636c3d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:12.307265 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c86317d4-d929-45dd-9c96-26478a636c3d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:12.342757 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-c86317d4-d929-45dd-9c96-26478a636c3d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] HTTP exception thrown: Cannot 'unshelve' instance f2ad2cfd-7479-48d0-b802-cdd5d5093305 while it is in vm_state active Jul 23 21:33:12.345520 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c86317d4-d929-45dd-9c96-26478a636c3d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Request method failure captured: Jul 23 21:33:12.345520 ncdv-master-1 devstack@n-api.service[131320]: request: POST /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305/action HTTP/1.1 Jul 23 21:33:12.345520 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:33:12.345520 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:33:12.345520 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:33:12.345520 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 18 Jul 23 21:33:12.345520 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:33:12.345520 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:33:12.345520 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:33:12.345520 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:33:12.345520 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3Ghf1JjZ4k8tVzERRK8IkLpluLUwa9k5Rz-X0dEr2p4_7xl_eBekUiNk1RZEGsFdGEiApbLOfcuSifirvwiKV1QOTaKdXKwfMnwZgdfagxJjoe3dPYUa3b-d3rVTYewIN_YoX2mMGGBMWRa3po8WOCVIc6hXJLExzq_ndbcO7U8NQBI Jul 23 21:33:12.345520 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:33:12.345520 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:33:12.345520 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:33:12.345520 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:33:12.345520 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:33:12.345520 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:33:12.345520 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: d70f6c96e1ad484aa3207fc01a12d519 Jul 23 21:33:12.345520 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:33:12.345520 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:33:12.345520 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:33:12.345520 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d70f6c96e1ad484aa3207fc01a12d519"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d70f6c96e1ad484aa3207fc01a12d519"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d70f6c96e1ad484aa3207fc01a12d519", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d70f6c96e1ad484aa3207fc01a12d519"}]}] Jul 23 21:33:12.345520 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:33:12.345520 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: d70f6c96e1ad484aa3207fc01a12d519 Jul 23 21:33:12.345520 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:33:12.345520 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServersNegativeTestJSON-1106538570-project Jul 23 21:33:12.345520 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:33:12.345520 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:33:12.345520 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 6ca9644a73d9468aa39b21548a72bded Jul 23 21:33:12.345520 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServersNegativeTestJSON-1106538570-project Jul 23 21:33:12.345520 ncdv-master-1 devstack@n-api.service[131320]: Jul 23 21:33:12.345520 ncdv-master-1 devstack@n-api.service[131320]: {"unshelve": null} Jul 23 21:33:12.345520 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:33:12.345520 ncdv-master-1 devstack@n-api.service[131320]: exception: Cannot 'unshelve' instance f2ad2cfd-7479-48d0-b802-cdd5d5093305 while it is in vm_state active Jul 23 21:33:12.345520 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': 'f2ad2cfd-7479-48d0-b802-cdd5d5093305', 'body': {'unshelve': None}} Jul 23 21:33:12.345520 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:33:12.345520 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:33:12.345520 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 105, in _unshelve Jul 23 21:33:12.345520 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve(context, instance, new_az=new_az) Jul 23 21:33:12.345520 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 23 21:33:12.345520 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 23 21:33:12.345520 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 23 21:33:12.345520 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 23 21:33:12.345520 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 23 21:33:12.345520 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 23 21:33:12.345520 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f2ad2cfd-7479-48d0-b802-cdd5d5093305 in vm_state active. Cannot unshelve while the instance is in this state. Jul 23 21:33:12.345520 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:12.345520 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:33:12.345520 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:12.345520 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:33:12.345520 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:33:12.345520 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:33:12.345520 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:33:12.345520 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:33:12.345520 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:33:12.345520 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:33:12.345520 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:33:12.345520 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:33:12.345520 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 111, in _unshelve Jul 23 21:33:12.345520 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 23 21:33:12.345520 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 23 21:33:12.345520 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 23 21:33:12.345520 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance f2ad2cfd-7479-48d0-b802-cdd5d5093305 while it is in vm_state active Jul 23 21:33:12.349913 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:12.349913 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:33:12.349913 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:12.349913 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:33:12.349913 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:33:12.349913 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:33:12.349913 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:33:12.349913 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:33:12.349913 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance f2ad2cfd-7479-48d0-b802-cdd5d5093305 while it is in vm_state active Jul 23 21:33:12.349913 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:12.351740 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c86317d4-d929-45dd-9c96-26478a636c3d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Returning 409 to user: Cannot 'unshelve' instance f2ad2cfd-7479-48d0-b802-cdd5d5093305 while it is in vm_state active {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:33:12.353763 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c86317d4-d929-45dd-9c96-26478a636c3d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "POST /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305/action" status: 409 len: 146 microversion: 2.1 time: 0.066294 Jul 23 21:33:12.358413 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2352/4779] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:33:12 2022] POST /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305/action => generated 146 bytes in 72 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 23 21:33:12.364930 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e18bf32b-04ef-44da-8994-abfd260d84ab tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:12.365649 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-e18bf32b-04ef-44da-8994-abfd260d84ab tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:12.372584 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e18bf32b-04ef-44da-8994-abfd260d84ab tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:12.373724 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e18bf32b-04ef-44da-8994-abfd260d84ab tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:12.376394 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e18bf32b-04ef-44da-8994-abfd260d84ab tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:12.377215 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e18bf32b-04ef-44da-8994-abfd260d84ab tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:12.544394 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-e18bf32b-04ef-44da-8994-abfd260d84ab tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:12.557214 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-e18bf32b-04ef-44da-8994-abfd260d84ab tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1505 microversion: 2.1 time: 0.197306 Jul 23 21:33:12.557901 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2428/4780] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:33:12 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1505 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:33:12.578509 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f7a5a4fe-8f26-4a43-9a8f-9039280e43f3 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:12.579294 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f7a5a4fe-8f26-4a43-9a8f-9039280e43f3 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:12.588738 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f7a5a4fe-8f26-4a43-9a8f-9039280e43f3 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:12.589808 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f7a5a4fe-8f26-4a43-9a8f-9039280e43f3 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:12.590901 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f7a5a4fe-8f26-4a43-9a8f-9039280e43f3 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:12.603362 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f7a5a4fe-8f26-4a43-9a8f-9039280e43f3 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:12.637837 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-0eded2c0-b7c8-488f-8f09-bba43952eea3 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:12.638953 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-0eded2c0-b7c8-488f-8f09-bba43952eea3 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] [instance: bbee3556-287f-42a5-a6a8-84356c840b67] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:12.652080 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0eded2c0-b7c8-488f-8f09-bba43952eea3 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:12.652810 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0eded2c0-b7c8-488f-8f09-bba43952eea3 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:12.654104 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0eded2c0-b7c8-488f-8f09-bba43952eea3 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:12.654897 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0eded2c0-b7c8-488f-8f09-bba43952eea3 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:12.854666 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-0eded2c0-b7c8-488f-8f09-bba43952eea3 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b1e260651b4dffa7c1efe8e9d0f144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcf55bcaba04bf8ae8a9b2ac09e8d98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:12.868692 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-0eded2c0-b7c8-488f-8f09-bba43952eea3 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] 10.222.0.17 "GET /compute/v2.1/servers/bbee3556-287f-42a5-a6a8-84356c840b67" status: 200 len: 1368 microversion: 2.1 time: 0.237548 Jul 23 21:33:12.869456 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2429/4781] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:33:12 2022] GET /compute/v2.1/servers/bbee3556-287f-42a5-a6a8-84356c840b67 => generated 1368 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:33:12.876154 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-4c07ecb3-76f8-4691-8298-cb87c4d75fe4 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:12.876897 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-4c07ecb3-76f8-4691-8298-cb87c4d75fe4 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] [instance: b0bb14c2-15df-4440-9d9c-4c6598867dfe] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:12.884925 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4c07ecb3-76f8-4691-8298-cb87c4d75fe4 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:12.885502 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4c07ecb3-76f8-4691-8298-cb87c4d75fe4 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:12.886609 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4c07ecb3-76f8-4691-8298-cb87c4d75fe4 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:12.887819 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4c07ecb3-76f8-4691-8298-cb87c4d75fe4 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:12.915109 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-4c07ecb3-76f8-4691-8298-cb87c4d75fe4 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] [instance: b0bb14c2-15df-4440-9d9c-4c6598867dfe] Going to try to terminate instance {{(pid=131321) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:33:13.017817 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-4c07ecb3-76f8-4691-8298-cb87c4d75fe4 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] 10.222.0.17 "DELETE /compute/v2.1/servers/b0bb14c2-15df-4440-9d9c-4c6598867dfe" status: 204 len: 0 microversion: 2.1 time: 0.146671 Jul 23 21:33:13.019404 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2430/4782] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:33:12 2022] DELETE /compute/v2.1/servers/b0bb14c2-15df-4440-9d9c-4c6598867dfe => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:33:13.025313 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d096fd71-7c77-403c-85ff-1a39cc0e9c0d tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:13.027153 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-d096fd71-7c77-403c-85ff-1a39cc0e9c0d tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] [instance: 1f5b9a5a-109e-48b5-adc1-113384944dce] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:13.034502 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d096fd71-7c77-403c-85ff-1a39cc0e9c0d tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:13.035892 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d096fd71-7c77-403c-85ff-1a39cc0e9c0d tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:13.036611 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d096fd71-7c77-403c-85ff-1a39cc0e9c0d tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:13.037176 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d096fd71-7c77-403c-85ff-1a39cc0e9c0d tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:13.160448 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f7a5a4fe-8f26-4a43-9a8f-9039280e43f3 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:13.172728 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f7a5a4fe-8f26-4a43-9a8f-9039280e43f3 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1505 microversion: 2.1 time: 0.596869 Jul 23 21:33:13.174018 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2353/4783] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:33:12 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1505 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:33:13.179687 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0c3ec12e-3792-4748-813d-ed10a3618f96 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:13.180536 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-0c3ec12e-3792-4748-813d-ed10a3618f96 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] [instance: 0352d36b-f7b0-4c09-8517-a5711438d586] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:13.189156 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0c3ec12e-3792-4748-813d-ed10a3618f96 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:13.189986 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0c3ec12e-3792-4748-813d-ed10a3618f96 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:13.190821 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0c3ec12e-3792-4748-813d-ed10a3618f96 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:13.191273 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0c3ec12e-3792-4748-813d-ed10a3618f96 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:13.219501 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-d096fd71-7c77-403c-85ff-1a39cc0e9c0d tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd49331138a4dbc912bc7bf6f6b0215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842a1aca542f416eab5d43b881325917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:13.228868 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-d096fd71-7c77-403c-85ff-1a39cc0e9c0d tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] 10.222.0.17 "GET /compute/v2.1/servers/1f5b9a5a-109e-48b5-adc1-113384944dce" status: 200 len: 1767 microversion: 2.1 time: 0.208075 Jul 23 21:33:13.230561 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2431/4784] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:33:13 2022] GET /compute/v2.1/servers/1f5b9a5a-109e-48b5-adc1-113384944dce => generated 1767 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:33:13.235424 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f8609a77-ca4b-4d6c-9185-6ea163cb302d tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:13.236441 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-f8609a77-ca4b-4d6c-9185-6ea163cb302d tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] [instance: b0bb14c2-15df-4440-9d9c-4c6598867dfe] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:13.244418 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f8609a77-ca4b-4d6c-9185-6ea163cb302d tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:13.244994 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f8609a77-ca4b-4d6c-9185-6ea163cb302d tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:13.246039 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f8609a77-ca4b-4d6c-9185-6ea163cb302d tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:13.246589 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f8609a77-ca4b-4d6c-9185-6ea163cb302d tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:13.315707 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-0c3ec12e-3792-4748-813d-ed10a3618f96 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:13.331701 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-0c3ec12e-3792-4748-813d-ed10a3618f96 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:13.334038 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-0c3ec12e-3792-4748-813d-ed10a3618f96 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:13.335596 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-0c3ec12e-3792-4748-813d-ed10a3618f96 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] 10.222.0.17 "GET /compute/v2.1/servers/0352d36b-f7b0-4c09-8517-a5711438d586" status: 200 len: 1366 microversion: 2.57 time: 0.160384 Jul 23 21:33:13.336589 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2354/4785] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:33:13 2022] GET /compute/v2.1/servers/0352d36b-f7b0-4c09-8517-a5711438d586 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:33:13.341363 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8d20f8e7-77d1-43dc-a588-55009aa3f95b tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-810304292_updated"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:33:13.342986 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8d20f8e7-77d1-43dc-a588-55009aa3f95b tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: 04305c84-0e28-4a8b-97f1-432bf3206453] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:13.350008 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-8d20f8e7-77d1-43dc-a588-55009aa3f95b tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] HTTP exception thrown: Instance 04305c84-0e28-4a8b-97f1-432bf3206453 could not be found. Jul 23 21:33:13.351949 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8d20f8e7-77d1-43dc-a588-55009aa3f95b tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Request method failure captured: Jul 23 21:33:13.351949 ncdv-master-1 devstack@n-api.service[131320]: request: PUT /compute/v2.1/servers/04305c84-0e28-4a8b-97f1-432bf3206453 HTTP/1.1 Jul 23 21:33:13.351949 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:33:13.351949 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:33:13.351949 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:33:13.351949 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 80 Jul 23 21:33:13.351949 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:33:13.351949 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:33:13.351949 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:33:13.351949 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:33:13.351949 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3Ghf1JjZ4k8tVzERRK8IkLpluLUwa9k5Rz-X0dEr2p4_7xl_eBekUiNk1RZEGsFdGEiApbLOfcuSifirvwiKV1QOTaKdXKwfMnwZgdfagxJjoe3dPYUa3b-d3rVTYewIN_YoX2mMGGBMWRa3po8WOCVIc6hXJLExzq_ndbcO7U8NQBI Jul 23 21:33:13.351949 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:33:13.351949 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:33:13.351949 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:33:13.351949 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:33:13.351949 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:33:13.351949 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:33:13.351949 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: d70f6c96e1ad484aa3207fc01a12d519 Jul 23 21:33:13.351949 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:33:13.351949 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:33:13.351949 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:33:13.351949 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d70f6c96e1ad484aa3207fc01a12d519"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d70f6c96e1ad484aa3207fc01a12d519"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d70f6c96e1ad484aa3207fc01a12d519", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d70f6c96e1ad484aa3207fc01a12d519"}]}] Jul 23 21:33:13.351949 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:33:13.351949 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: d70f6c96e1ad484aa3207fc01a12d519 Jul 23 21:33:13.351949 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:33:13.351949 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServersNegativeTestJSON-1106538570-project Jul 23 21:33:13.351949 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:33:13.351949 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:33:13.351949 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 6ca9644a73d9468aa39b21548a72bded Jul 23 21:33:13.351949 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServersNegativeTestJSON-1106538570-project Jul 23 21:33:13.351949 ncdv-master-1 devstack@n-api.service[131320]: Jul 23 21:33:13.351949 ncdv-master-1 devstack@n-api.service[131320]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-810304292_updated"}} Jul 23 21:33:13.351949 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:33:13.351949 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance 04305c84-0e28-4a8b-97f1-432bf3206453 could not be found. Jul 23 21:33:13.351949 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '04305c84-0e28-4a8b-97f1-432bf3206453', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-810304292_updated'}}} Jul 23 21:33:13.351949 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:33:13.351949 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:33:13.351949 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:33:13.351949 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:33:13.351949 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:33:13.351949 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:33:13.351949 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 23 21:33:13.351949 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 23 21:33:13.351949 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04305c84-0e28-4a8b-97f1-432bf3206453 could not be found. Jul 23 21:33:13.351949 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:13.351949 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:33:13.351949 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:13.351949 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:33:13.351949 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:33:13.351949 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:33:13.351949 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:33:13.351949 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:33:13.351949 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:33:13.351949 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:33:13.351949 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:33:13.351949 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:33:13.351949 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:33:13.351949 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:33:13.351949 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:33:13.351949 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:33:13.351949 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 23 21:33:13.351949 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Jul 23 21:33:13.351949 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Jul 23 21:33:13.351949 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:33:13.357316 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:33:13.357316 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:33:13.357316 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:33:13.357316 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04305c84-0e28-4a8b-97f1-432bf3206453 could not be found. Jul 23 21:33:13.357316 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:13.357316 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:33:13.357316 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:13.357316 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:33:13.357316 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:33:13.357316 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:33:13.357316 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:33:13.357316 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:33:13.357316 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04305c84-0e28-4a8b-97f1-432bf3206453 could not be found. Jul 23 21:33:13.357316 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:13.359915 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8d20f8e7-77d1-43dc-a588-55009aa3f95b tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Returning 404 to user: Instance 04305c84-0e28-4a8b-97f1-432bf3206453 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:33:13.360791 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8d20f8e7-77d1-43dc-a588-55009aa3f95b tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "PUT /compute/v2.1/servers/04305c84-0e28-4a8b-97f1-432bf3206453" status: 404 len: 111 microversion: 2.1 time: 0.023102 Jul 23 21:33:13.361395 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2355/4786] 10.222.0.17 () {60 vars in 1255 bytes} [Sat Jul 23 21:33:13 2022] PUT /compute/v2.1/servers/04305c84-0e28-4a8b-97f1-432bf3206453 => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:33:13.366699 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3f165fd7-2ad4-4583-8241-66505b5b9633 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:13.367364 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-3f165fd7-2ad4-4583-8241-66505b5b9633 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:13.374685 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3f165fd7-2ad4-4583-8241-66505b5b9633 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:13.375138 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3f165fd7-2ad4-4583-8241-66505b5b9633 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:13.376131 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3f165fd7-2ad4-4583-8241-66505b5b9633 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:13.376647 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3f165fd7-2ad4-4583-8241-66505b5b9633 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:13.454694 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-f8609a77-ca4b-4d6c-9185-6ea163cb302d tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc4aa131e63349b2aa8f37fdf6d2fe00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc1475019924837a8be47347f6bbd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:13.464175 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-f8609a77-ca4b-4d6c-9185-6ea163cb302d tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] 10.222.0.17 "GET /compute/v2.1/servers/b0bb14c2-15df-4440-9d9c-4c6598867dfe" status: 200 len: 1673 microversion: 2.1 time: 0.232295 Jul 23 21:33:13.466493 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2432/4787] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:33:13 2022] GET /compute/v2.1/servers/b0bb14c2-15df-4440-9d9c-4c6598867dfe => generated 1673 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:33:13.471731 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-08c58cec-23fc-4539-9864-375722b3f8c3 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:13.472690 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-08c58cec-23fc-4539-9864-375722b3f8c3 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:13.480044 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-08c58cec-23fc-4539-9864-375722b3f8c3 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:13.480781 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-08c58cec-23fc-4539-9864-375722b3f8c3 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:13.481746 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-08c58cec-23fc-4539-9864-375722b3f8c3 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:13.482367 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-08c58cec-23fc-4539-9864-375722b3f8c3 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:13.571827 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-3f165fd7-2ad4-4583-8241-66505b5b9633 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:13.593638 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-3f165fd7-2ad4-4583-8241-66505b5b9633 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:13.595507 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-3f165fd7-2ad4-4583-8241-66505b5b9633 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:13.597612 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-3f165fd7-2ad4-4583-8241-66505b5b9633 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.235080 Jul 23 21:33:13.598696 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2356/4788] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:33:13 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:33:13.664653 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-08c58cec-23fc-4539-9864-375722b3f8c3 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:13.673694 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-08c58cec-23fc-4539-9864-375722b3f8c3 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1505 microversion: 2.1 time: 0.205891 Jul 23 21:33:13.674528 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2433/4789] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:33:13 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1505 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:33:13.691074 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4cfd0ce7-66c5-47b0-a1a4-aefe98d1b0bc tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:13.692146 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-4cfd0ce7-66c5-47b0-a1a4-aefe98d1b0bc tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:13.700015 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4cfd0ce7-66c5-47b0-a1a4-aefe98d1b0bc tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:13.700620 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4cfd0ce7-66c5-47b0-a1a4-aefe98d1b0bc tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:13.701548 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4cfd0ce7-66c5-47b0-a1a4-aefe98d1b0bc tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:13.702366 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4cfd0ce7-66c5-47b0-a1a4-aefe98d1b0bc tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:13.758935 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-06c0de50-79ef-4b91-8bc7-55a3446264dd tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:13.760444 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-06c0de50-79ef-4b91-8bc7-55a3446264dd tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] [instance: d6b9ea07-2ebd-4e1a-86f2-abb1bf581076] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:13.768731 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-06c0de50-79ef-4b91-8bc7-55a3446264dd tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:13.769185 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-06c0de50-79ef-4b91-8bc7-55a3446264dd tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:13.770045 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-06c0de50-79ef-4b91-8bc7-55a3446264dd tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:13.770489 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-06c0de50-79ef-4b91-8bc7-55a3446264dd tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:13.796383 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-06c0de50-79ef-4b91-8bc7-55a3446264dd tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] 10.222.0.17 "GET /compute/v2.1/servers/d6b9ea07-2ebd-4e1a-86f2-abb1bf581076/ips" status: 200 len: 151 microversion: 2.20 time: 0.041327 Jul 23 21:33:13.797533 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2434/4790] 10.222.0.17 () {60 vars in 1288 bytes} [Sat Jul 23 21:33:13 2022] GET /compute/v2.1/servers/d6b9ea07-2ebd-4e1a-86f2-abb1bf581076/ips => generated 151 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 23 21:33:13.886241 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-57c20d5c-f6c9-4943-8780-39cc375d3aae tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:13.887194 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-57c20d5c-f6c9-4943-8780-39cc375d3aae tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] [instance: bbee3556-287f-42a5-a6a8-84356c840b67] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:13.893659 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=97,nova_api:UPDATE=2 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:13.895891 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-57c20d5c-f6c9-4943-8780-39cc375d3aae tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:13.896910 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-57c20d5c-f6c9-4943-8780-39cc375d3aae tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:13.906841 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-57c20d5c-f6c9-4943-8780-39cc375d3aae tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:13.908244 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-57c20d5c-f6c9-4943-8780-39cc375d3aae tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:14.088278 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-57c20d5c-f6c9-4943-8780-39cc375d3aae tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b1e260651b4dffa7c1efe8e9d0f144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcf55bcaba04bf8ae8a9b2ac09e8d98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:14.096781 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-57c20d5c-f6c9-4943-8780-39cc375d3aae tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] 10.222.0.17 "GET /compute/v2.1/servers/bbee3556-287f-42a5-a6a8-84356c840b67" status: 200 len: 1368 microversion: 2.1 time: 0.214839 Jul 23 21:33:14.102173 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2435/4791] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:33:13 2022] GET /compute/v2.1/servers/bbee3556-287f-42a5-a6a8-84356c840b67 => generated 1368 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:33:14.263849 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-123f1d3f-5a0a-4ac5-9f9a-e1ce768e2a22 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:14.265212 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-123f1d3f-5a0a-4ac5-9f9a-e1ce768e2a22 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] [instance: 1f5b9a5a-109e-48b5-adc1-113384944dce] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:14.278616 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-123f1d3f-5a0a-4ac5-9f9a-e1ce768e2a22 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:14.279373 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-123f1d3f-5a0a-4ac5-9f9a-e1ce768e2a22 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:14.280462 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-123f1d3f-5a0a-4ac5-9f9a-e1ce768e2a22 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:14.281019 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-123f1d3f-5a0a-4ac5-9f9a-e1ce768e2a22 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:14.367070 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-123f1d3f-5a0a-4ac5-9f9a-e1ce768e2a22 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd49331138a4dbc912bc7bf6f6b0215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842a1aca542f416eab5d43b881325917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:14.375114 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-123f1d3f-5a0a-4ac5-9f9a-e1ce768e2a22 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] 10.222.0.17 "GET /compute/v2.1/servers/1f5b9a5a-109e-48b5-adc1-113384944dce" status: 200 len: 1649 microversion: 2.1 time: 0.122522 Jul 23 21:33:14.384701 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2436/4792] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:33:14 2022] GET /compute/v2.1/servers/1f5b9a5a-109e-48b5-adc1-113384944dce => generated 1649 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:33:14.384701 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-abfac239-7107-4b36-8abd-9e4618688cf7 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:14.384701 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-abfac239-7107-4b36-8abd-9e4618688cf7 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] [instance: 0352d36b-f7b0-4c09-8517-a5711438d586] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:14.389144 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-abfac239-7107-4b36-8abd-9e4618688cf7 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:14.389603 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-abfac239-7107-4b36-8abd-9e4618688cf7 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:14.390431 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-abfac239-7107-4b36-8abd-9e4618688cf7 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:14.390874 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-abfac239-7107-4b36-8abd-9e4618688cf7 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:14.409678 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-4cfd0ce7-66c5-47b0-a1a4-aefe98d1b0bc tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:14.418394 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4cfd0ce7-66c5-47b0-a1a4-aefe98d1b0bc tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1505 microversion: 2.1 time: 0.731147 Jul 23 21:33:14.429910 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2357/4793] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:33:13 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1505 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:33:14.438932 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8f7f0698-cc89-4a9b-bb5b-f774d2cbb9be tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:33:14.441960 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8f7f0698-cc89-4a9b-bb5b-f774d2cbb9be tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Request method failure captured: Jul 23 21:33:14.441960 ncdv-master-1 devstack@n-api.service[131320]: request: PUT /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 HTTP/1.1 Jul 23 21:33:14.441960 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:33:14.441960 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:33:14.441960 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:33:14.441960 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 280 Jul 23 21:33:14.441960 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:33:14.441960 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:33:14.441960 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:33:14.441960 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:33:14.441960 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3Ghf1JjZ4k8tVzERRK8IkLpluLUwa9k5Rz-X0dEr2p4_7xl_eBekUiNk1RZEGsFdGEiApbLOfcuSifirvwiKV1QOTaKdXKwfMnwZgdfagxJjoe3dPYUa3b-d3rVTYewIN_YoX2mMGGBMWRa3po8WOCVIc6hXJLExzq_ndbcO7U8NQBI Jul 23 21:33:14.441960 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:33:14.441960 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:33:14.441960 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:33:14.441960 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:33:14.441960 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:33:14.441960 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:33:14.441960 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: d70f6c96e1ad484aa3207fc01a12d519 Jul 23 21:33:14.441960 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:33:14.441960 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:33:14.441960 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:33:14.441960 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d70f6c96e1ad484aa3207fc01a12d519"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d70f6c96e1ad484aa3207fc01a12d519"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d70f6c96e1ad484aa3207fc01a12d519", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d70f6c96e1ad484aa3207fc01a12d519"}]}] Jul 23 21:33:14.441960 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:33:14.441960 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: d70f6c96e1ad484aa3207fc01a12d519 Jul 23 21:33:14.441960 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:33:14.441960 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServersNegativeTestJSON-1106538570-project Jul 23 21:33:14.441960 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:33:14.441960 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:33:14.441960 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 6ca9644a73d9468aa39b21548a72bded Jul 23 21:33:14.441960 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServersNegativeTestJSON-1106538570-project Jul 23 21:33:14.441960 ncdv-master-1 devstack@n-api.service[131320]: Jul 23 21:33:14.441960 ncdv-master-1 devstack@n-api.service[131320]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jul 23 21:33:14.441960 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:33:14.441960 ncdv-master-1 devstack@n-api.service[131320]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 23 21:33:14.441960 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': 'f2ad2cfd-7479-48d0-b802-cdd5d5093305', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jul 23 21:33:14.441960 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:33:14.441960 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:33:14.441960 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 23 21:33:14.441960 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 23 21:33:14.441960 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 23 21:33:14.441960 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise error Jul 23 21:33:14.441960 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 23 21:33:14.441960 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:14.441960 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Jul 23 21:33:14.441960 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 23 21:33:14.441960 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:14.441960 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 23 21:33:14.441960 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 23 21:33:14.441960 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:14.441960 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:33:14.441960 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:14.441960 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:33:14.447879 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:33:14.447879 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:33:14.447879 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:33:14.447879 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:33:14.447879 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:33:14.447879 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:33:14.447879 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:33:14.447879 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:33:14.447879 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 23 21:33:14.447879 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 23 21:33:14.447879 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 23 21:33:14.447879 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 23 21:33:14.447879 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 23 21:33:14.447879 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 23 21:33:14.447879 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 23 21:33:14.447879 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:14.447879 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:33:14.447879 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:14.447879 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:33:14.447879 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:33:14.447879 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:33:14.447879 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 23 21:33:14.447879 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 23 21:33:14.447879 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 23 21:33:14.447879 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:14.447879 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8f7f0698-cc89-4a9b-bb5b-f774d2cbb9be tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:33:14.447879 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8f7f0698-cc89-4a9b-bb5b-f774d2cbb9be tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "PUT /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 400 len: 619 microversion: 2.1 time: 0.008009 Jul 23 21:33:14.447879 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2358/4794] 10.222.0.17 () {60 vars in 1256 bytes} [Sat Jul 23 21:33:14 2022] PUT /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 619 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 23 21:33:14.456329 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1688bb7e-ae93-40ec-8610-a49c90f25ca7 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:14.456938 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1688bb7e-ae93-40ec-8610-a49c90f25ca7 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:14.467252 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1688bb7e-ae93-40ec-8610-a49c90f25ca7 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:14.467702 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1688bb7e-ae93-40ec-8610-a49c90f25ca7 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:14.468485 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1688bb7e-ae93-40ec-8610-a49c90f25ca7 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:14.468956 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1688bb7e-ae93-40ec-8610-a49c90f25ca7 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:14.482893 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-abfac239-7107-4b36-8abd-9e4618688cf7 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:14.492450 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-abfac239-7107-4b36-8abd-9e4618688cf7 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:14.494052 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-abfac239-7107-4b36-8abd-9e4618688cf7 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:14.495215 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-abfac239-7107-4b36-8abd-9e4618688cf7 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] 10.222.0.17 "GET /compute/v2.1/servers/0352d36b-f7b0-4c09-8517-a5711438d586" status: 200 len: 1366 microversion: 2.57 time: 0.118188 Jul 23 21:33:14.496097 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2437/4795] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:33:14 2022] GET /compute/v2.1/servers/0352d36b-f7b0-4c09-8517-a5711438d586 => generated 1366 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:33:14.507314 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-fa362bb7-a02e-44d5-83b6-2d5732c7b02f tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:14.508015 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-fa362bb7-a02e-44d5-83b6-2d5732c7b02f tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] [instance: b0bb14c2-15df-4440-9d9c-4c6598867dfe] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:14.514373 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fa362bb7-a02e-44d5-83b6-2d5732c7b02f tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:14.514810 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fa362bb7-a02e-44d5-83b6-2d5732c7b02f tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:14.515784 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fa362bb7-a02e-44d5-83b6-2d5732c7b02f tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:14.516386 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fa362bb7-a02e-44d5-83b6-2d5732c7b02f tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:14.673616 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-fa362bb7-a02e-44d5-83b6-2d5732c7b02f tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc4aa131e63349b2aa8f37fdf6d2fe00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc1475019924837a8be47347f6bbd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:14.680224 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-fa362bb7-a02e-44d5-83b6-2d5732c7b02f tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] 10.222.0.17 "GET /compute/v2.1/servers/b0bb14c2-15df-4440-9d9c-4c6598867dfe" status: 200 len: 1673 microversion: 2.1 time: 0.182498 Jul 23 21:33:14.681093 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2438/4796] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:33:14 2022] GET /compute/v2.1/servers/b0bb14c2-15df-4440-9d9c-4c6598867dfe => generated 1673 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:33:14.686381 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-f3ed8eec-af3f-41d7-b1cd-d0f0ea9d30c4 req-b1db0d53-4e76-4978-a065-86cb440a5273 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f5b9a5a-109e-48b5-adc1-113384944dce", "name": "network-vif-deleted", "tag": "b947908f-6578-44ec-898d-fff1852fea99"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:33:14.697155 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-f3ed8eec-af3f-41d7-b1cd-d0f0ea9d30c4 req-b1db0d53-4e76-4978-a065-86cb440a5273 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:14.698362 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-f3ed8eec-af3f-41d7-b1cd-d0f0ea9d30c4 req-b1db0d53-4e76-4978-a065-86cb440a5273 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:14.717468 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-f3ed8eec-af3f-41d7-b1cd-d0f0ea9d30c4 req-b1db0d53-4e76-4978-a065-86cb440a5273 service nova] Creating event network-vif-deleted:b947908f-6578-44ec-898d-fff1852fea99 for instance 1f5b9a5a-109e-48b5-adc1-113384944dce on nch2-master-1 Jul 23 21:33:14.723014 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-f3ed8eec-af3f-41d7-b1cd-d0f0ea9d30c4 req-b1db0d53-4e76-4978-a065-86cb440a5273 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039913 Jul 23 21:33:14.724131 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2439/4797] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:33:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:33:14.731216 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-92296023-c16f-4c02-98c8-97747de65744 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:14.732182 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-92296023-c16f-4c02-98c8-97747de65744 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:14.739371 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-92296023-c16f-4c02-98c8-97747de65744 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:14.739933 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-92296023-c16f-4c02-98c8-97747de65744 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:14.740797 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-92296023-c16f-4c02-98c8-97747de65744 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:14.741314 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-92296023-c16f-4c02-98c8-97747de65744 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:14.841346 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-92296023-c16f-4c02-98c8-97747de65744 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:14.853488 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-92296023-c16f-4c02-98c8-97747de65744 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:14.855409 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-92296023-c16f-4c02-98c8-97747de65744 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:14.857697 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-92296023-c16f-4c02-98c8-97747de65744 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.132229 Jul 23 21:33:14.859350 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2440/4798] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:33:14 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:33:14.955083 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-1688bb7e-ae93-40ec-8610-a49c90f25ca7 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:14.965993 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1688bb7e-ae93-40ec-8610-a49c90f25ca7 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1505 microversion: 2.1 time: 0.513391 Jul 23 21:33:14.966591 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2359/4799] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:33:14 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1505 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:33:14.986538 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-569af529-b2d6-41ed-ab5f-582c335e23c1 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:14.987463 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-569af529-b2d6-41ed-ab5f-582c335e23c1 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:14.997256 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-569af529-b2d6-41ed-ab5f-582c335e23c1 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:14.997949 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-569af529-b2d6-41ed-ab5f-582c335e23c1 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:14.998957 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-569af529-b2d6-41ed-ab5f-582c335e23c1 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:15.000026 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-569af529-b2d6-41ed-ab5f-582c335e23c1 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:15.119718 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6da63854-6c2f-4f1a-a308-a7c6226fe7b8 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:15.120249 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6da63854-6c2f-4f1a-a308-a7c6226fe7b8 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] [instance: bbee3556-287f-42a5-a6a8-84356c840b67] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:15.162965 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6da63854-6c2f-4f1a-a308-a7c6226fe7b8 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:15.163469 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6da63854-6c2f-4f1a-a308-a7c6226fe7b8 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:15.166641 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6da63854-6c2f-4f1a-a308-a7c6226fe7b8 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:15.167183 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6da63854-6c2f-4f1a-a308-a7c6226fe7b8 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:15.252251 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-569af529-b2d6-41ed-ab5f-582c335e23c1 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:15.256572 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:15.275284 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-569af529-b2d6-41ed-ab5f-582c335e23c1 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1505 microversion: 2.1 time: 0.288089 Jul 23 21:33:15.276607 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2441/4800] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:33:14 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1505 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:33:15.292933 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a55f884a-ad46-4422-b47a-04d4be767393 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:33:15.298554 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a55f884a-ad46-4422-b47a-04d4be767393 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Request method failure captured: Jul 23 21:33:15.298554 ncdv-master-1 devstack@n-api.service[131321]: request: PUT /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 HTTP/1.1 Jul 23 21:33:15.298554 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:33:15.298554 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:33:15.298554 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:33:15.298554 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 24 Jul 23 21:33:15.298554 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:33:15.298554 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:33:15.298554 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:33:15.298554 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:33:15.298554 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3Ghf1JjZ4k8tVzERRK8IkLpluLUwa9k5Rz-X0dEr2p4_7xl_eBekUiNk1RZEGsFdGEiApbLOfcuSifirvwiKV1QOTaKdXKwfMnwZgdfagxJjoe3dPYUa3b-d3rVTYewIN_YoX2mMGGBMWRa3po8WOCVIc6hXJLExzq_ndbcO7U8NQBI Jul 23 21:33:15.298554 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:33:15.298554 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:33:15.298554 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:33:15.298554 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:33:15.298554 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:33:15.298554 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:33:15.298554 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: d70f6c96e1ad484aa3207fc01a12d519 Jul 23 21:33:15.298554 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:33:15.298554 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:33:15.298554 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:33:15.298554 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d70f6c96e1ad484aa3207fc01a12d519"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d70f6c96e1ad484aa3207fc01a12d519"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d70f6c96e1ad484aa3207fc01a12d519", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d70f6c96e1ad484aa3207fc01a12d519"}]}] Jul 23 21:33:15.298554 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:33:15.298554 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: d70f6c96e1ad484aa3207fc01a12d519 Jul 23 21:33:15.298554 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:33:15.298554 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ServersNegativeTestJSON-1106538570-project Jul 23 21:33:15.298554 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:33:15.298554 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:33:15.298554 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 6ca9644a73d9468aa39b21548a72bded Jul 23 21:33:15.298554 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ServersNegativeTestJSON-1106538570-project Jul 23 21:33:15.298554 ncdv-master-1 devstack@n-api.service[131321]: Jul 23 21:33:15.298554 ncdv-master-1 devstack@n-api.service[131321]: {"server": {"name": ""}} Jul 23 21:33:15.298554 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:33:15.298554 ncdv-master-1 devstack@n-api.service[131321]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 23 21:33:15.298554 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': 'f2ad2cfd-7479-48d0-b802-cdd5d5093305', 'body': {'server': {'name': ''}}} Jul 23 21:33:15.298554 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:33:15.298554 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:33:15.298554 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 23 21:33:15.298554 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 23 21:33:15.298554 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 23 21:33:15.298554 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise error Jul 23 21:33:15.298554 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 23 21:33:15.298554 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:33:15.298554 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Jul 23 21:33:15.298554 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 23 21:33:15.298554 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:33:15.298554 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 23 21:33:15.298554 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi '' Jul 23 21:33:15.298554 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:33:15.298554 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:33:15.298554 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:33:15.298554 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:33:15.298554 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:33:15.298554 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:33:15.298554 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:33:15.298554 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:33:15.298554 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:33:15.298554 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:33:15.298554 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 21:33:15.298554 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 21:33:15.298554 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 23 21:33:15.298554 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 23 21:33:15.298554 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 23 21:33:15.298554 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 23 21:33:15.298554 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 23 21:33:15.298554 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 23 21:33:15.298554 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 23 21:33:15.302602 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:33:15.302602 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:33:15.302602 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:33:15.302602 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:33:15.302602 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:33:15.302602 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:33:15.302602 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 23 21:33:15.302602 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 23 21:33:15.302602 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 23 21:33:15.302602 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:33:15.306935 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a55f884a-ad46-4422-b47a-04d4be767393 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:33:15.310477 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-a55f884a-ad46-4422-b47a-04d4be767393 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "PUT /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 400 len: 108 microversion: 2.1 time: 0.021979 Jul 23 21:33:15.311206 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2442/4801] 10.222.0.17 () {60 vars in 1255 bytes} [Sat Jul 23 21:33:15 2022] PUT /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 108 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 23 21:33:15.327813 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-8517765e-e4c7-4e51-8121-67934c48f5c9 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:15.328926 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-8517765e-e4c7-4e51-8121-67934c48f5c9 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] [instance: d6b9ea07-2ebd-4e1a-86f2-abb1bf581076] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:15.343425 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8517765e-e4c7-4e51-8121-67934c48f5c9 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:15.343425 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8517765e-e4c7-4e51-8121-67934c48f5c9 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:15.346829 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8517765e-e4c7-4e51-8121-67934c48f5c9 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:15.347543 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8517765e-e4c7-4e51-8121-67934c48f5c9 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:15.386027 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-8517765e-e4c7-4e51-8121-67934c48f5c9 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] [instance: d6b9ea07-2ebd-4e1a-86f2-abb1bf581076] Going to try to terminate instance {{(pid=131321) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:33:15.514407 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-8517765e-e4c7-4e51-8121-67934c48f5c9 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d6b9ea07-2ebd-4e1a-86f2-abb1bf581076" status: 204 len: 0 microversion: 2.20 time: 0.201071 Jul 23 21:33:15.518160 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2443/4802] 10.222.0.17 () {60 vars in 1279 bytes} [Sat Jul 23 21:33:15 2022] DELETE /compute/v2.1/servers/d6b9ea07-2ebd-4e1a-86f2-abb1bf581076 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 23 21:33:15.524309 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-b40ac8bf-688c-43d0-a118-611f94ecbecb tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:15.525104 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-b40ac8bf-688c-43d0-a118-611f94ecbecb tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:15.532430 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b40ac8bf-688c-43d0-a118-611f94ecbecb tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:15.532980 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b40ac8bf-688c-43d0-a118-611f94ecbecb tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:15.533824 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b40ac8bf-688c-43d0-a118-611f94ecbecb tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:15.535072 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b40ac8bf-688c-43d0-a118-611f94ecbecb tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:15.587358 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6da63854-6c2f-4f1a-a308-a7c6226fe7b8 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b1e260651b4dffa7c1efe8e9d0f144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcf55bcaba04bf8ae8a9b2ac09e8d98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:15.599947 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6da63854-6c2f-4f1a-a308-a7c6226fe7b8 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] 10.222.0.17 "GET /compute/v2.1/servers/bbee3556-287f-42a5-a6a8-84356c840b67" status: 200 len: 1368 microversion: 2.1 time: 0.484558 Jul 23 21:33:15.601363 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2360/4803] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:33:15 2022] GET /compute/v2.1/servers/bbee3556-287f-42a5-a6a8-84356c840b67 => generated 1368 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:33:15.609319 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ab3d07e6-7696-4d25-9de8-231ee9386c7a tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:15.610270 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ab3d07e6-7696-4d25-9de8-231ee9386c7a tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] [instance: 1f5b9a5a-109e-48b5-adc1-113384944dce] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:15.618623 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ab3d07e6-7696-4d25-9de8-231ee9386c7a tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:15.619302 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ab3d07e6-7696-4d25-9de8-231ee9386c7a tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:15.620296 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ab3d07e6-7696-4d25-9de8-231ee9386c7a tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:15.622668 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ab3d07e6-7696-4d25-9de8-231ee9386c7a tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:15.673424 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ab3d07e6-7696-4d25-9de8-231ee9386c7a tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:15.674015 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ab3d07e6-7696-4d25-9de8-231ee9386c7a tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:15.674782 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.objects.instance [None req-ab3d07e6-7696-4d25-9de8-231ee9386c7a tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lazy-loading 'fault' on Instance uuid 1f5b9a5a-109e-48b5-adc1-113384944dce {{(pid=131320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:33:15.703926 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-b40ac8bf-688c-43d0-a118-611f94ecbecb tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:15.711863 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-b40ac8bf-688c-43d0-a118-611f94ecbecb tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1505 microversion: 2.1 time: 0.192050 Jul 23 21:33:15.718585 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2444/4804] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:33:15 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1505 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:33:15.718585 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-7cae4b01-fddd-45c5-8a8e-bd980878f3da tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:15.718585 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-7cae4b01-fddd-45c5-8a8e-bd980878f3da tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] [instance: 0352d36b-f7b0-4c09-8517-a5711438d586] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:15.741154 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7cae4b01-fddd-45c5-8a8e-bd980878f3da tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:15.741608 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7cae4b01-fddd-45c5-8a8e-bd980878f3da tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:15.742646 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7cae4b01-fddd-45c5-8a8e-bd980878f3da tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:15.743084 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7cae4b01-fddd-45c5-8a8e-bd980878f3da tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:15.762637 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ab3d07e6-7696-4d25-9de8-231ee9386c7a tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bd49331138a4dbc912bc7bf6f6b0215', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842a1aca542f416eab5d43b881325917', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:15.778125 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ab3d07e6-7696-4d25-9de8-231ee9386c7a tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] 10.222.0.17 "GET /compute/v2.1/servers/1f5b9a5a-109e-48b5-adc1-113384944dce" status: 200 len: 1535 microversion: 2.1 time: 0.170652 Jul 23 21:33:15.789002 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2361/4805] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:33:15 2022] GET /compute/v2.1/servers/1f5b9a5a-109e-48b5-adc1-113384944dce => generated 1535 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:33:15.811608 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-335560a6-6444-4cf6-9e73-8266f7df9314 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:15.815639 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-335560a6-6444-4cf6-9e73-8266f7df9314 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] [instance: d6b9ea07-2ebd-4e1a-86f2-abb1bf581076] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:15.843419 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-335560a6-6444-4cf6-9e73-8266f7df9314 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:15.844386 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-335560a6-6444-4cf6-9e73-8266f7df9314 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:15.849070 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-335560a6-6444-4cf6-9e73-8266f7df9314 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:15.849807 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-335560a6-6444-4cf6-9e73-8266f7df9314 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:15.879292 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-7cae4b01-fddd-45c5-8a8e-bd980878f3da tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:15.892113 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-7cae4b01-fddd-45c5-8a8e-bd980878f3da tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:15.896207 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-7cae4b01-fddd-45c5-8a8e-bd980878f3da tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:15.901545 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-7cae4b01-fddd-45c5-8a8e-bd980878f3da tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] 10.222.0.17 "GET /compute/v2.1/servers/0352d36b-f7b0-4c09-8517-a5711438d586" status: 200 len: 1366 microversion: 2.57 time: 0.183677 Jul 23 21:33:15.913964 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2445/4806] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:33:15 2022] GET /compute/v2.1/servers/0352d36b-f7b0-4c09-8517-a5711438d586 => generated 1366 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:33:15.919441 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-de617b08-7ca0-4afa-976e-06ee0bb18dc5 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:15.920471 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-de617b08-7ca0-4afa-976e-06ee0bb18dc5 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] [instance: b0bb14c2-15df-4440-9d9c-4c6598867dfe] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:15.929705 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-de617b08-7ca0-4afa-976e-06ee0bb18dc5 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:15.930510 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-de617b08-7ca0-4afa-976e-06ee0bb18dc5 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:15.931478 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-de617b08-7ca0-4afa-976e-06ee0bb18dc5 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:15.932218 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-de617b08-7ca0-4afa-976e-06ee0bb18dc5 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:16.166126 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-de617b08-7ca0-4afa-976e-06ee0bb18dc5 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc4aa131e63349b2aa8f37fdf6d2fe00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc1475019924837a8be47347f6bbd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:16.183964 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-335560a6-6444-4cf6-9e73-8266f7df9314 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:16.185415 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-de617b08-7ca0-4afa-976e-06ee0bb18dc5 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] 10.222.0.17 "GET /compute/v2.1/servers/b0bb14c2-15df-4440-9d9c-4c6598867dfe" status: 200 len: 1673 microversion: 2.1 time: 0.269997 Jul 23 21:33:16.186210 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2446/4807] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:33:15 2022] GET /compute/v2.1/servers/b0bb14c2-15df-4440-9d9c-4c6598867dfe => generated 1673 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:33:16.194062 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-7f5dd92a-1f71-4b96-ac3b-99507698a41b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:16.194424 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-7f5dd92a-1f71-4b96-ac3b-99507698a41b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:16.208998 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7f5dd92a-1f71-4b96-ac3b-99507698a41b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:16.209274 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-335560a6-6444-4cf6-9e73-8266f7df9314 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:16.209455 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7f5dd92a-1f71-4b96-ac3b-99507698a41b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:16.210358 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7f5dd92a-1f71-4b96-ac3b-99507698a41b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:16.210807 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7f5dd92a-1f71-4b96-ac3b-99507698a41b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:16.211299 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-335560a6-6444-4cf6-9e73-8266f7df9314 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:16.213039 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-335560a6-6444-4cf6-9e73-8266f7df9314 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] 10.222.0.17 "GET /compute/v2.1/servers/d6b9ea07-2ebd-4e1a-86f2-abb1bf581076" status: 200 len: 1724 microversion: 2.20 time: 0.422752 Jul 23 21:33:16.214054 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2362/4808] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:33:15 2022] GET /compute/v2.1/servers/d6b9ea07-2ebd-4e1a-86f2-abb1bf581076 => generated 1724 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:33:16.230570 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-cb1392d3-ab34-4692-8b5a-3ccb6794493d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:16.231214 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-cb1392d3-ab34-4692-8b5a-3ccb6794493d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: e74832ce-b06a-4786-b3f3-372e508a4795] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:16.238359 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cb1392d3-ab34-4692-8b5a-3ccb6794493d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:16.239008 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cb1392d3-ab34-4692-8b5a-3ccb6794493d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:16.239893 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cb1392d3-ab34-4692-8b5a-3ccb6794493d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:16.240432 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cb1392d3-ab34-4692-8b5a-3ccb6794493d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:16.258855 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-cb1392d3-ab34-4692-8b5a-3ccb6794493d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] HTTP exception thrown: Instance e74832ce-b06a-4786-b3f3-372e508a4795 could not be found. Jul 23 21:33:16.260825 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-cb1392d3-ab34-4692-8b5a-3ccb6794493d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Request method failure captured: Jul 23 21:33:16.260825 ncdv-master-1 devstack@n-api.service[131320]: request: DELETE /compute/v2.1/servers/e74832ce-b06a-4786-b3f3-372e508a4795 HTTP/1.1 Jul 23 21:33:16.260825 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:33:16.260825 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:33:16.260825 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:33:16.260825 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:33:16.260825 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:33:16.260825 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:33:16.260825 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:33:16.260825 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:33:16.260825 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3Ghf1JjZ4k8tVzERRK8IkLpluLUwa9k5Rz-X0dEr2p4_7xl_eBekUiNk1RZEGsFdGEiApbLOfcuSifirvwiKV1QOTaKdXKwfMnwZgdfagxJjoe3dPYUa3b-d3rVTYewIN_YoX2mMGGBMWRa3po8WOCVIc6hXJLExzq_ndbcO7U8NQBI Jul 23 21:33:16.260825 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:33:16.260825 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:33:16.260825 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:33:16.260825 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:33:16.260825 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:33:16.260825 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:33:16.260825 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: d70f6c96e1ad484aa3207fc01a12d519 Jul 23 21:33:16.260825 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:33:16.260825 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:33:16.260825 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:33:16.260825 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d70f6c96e1ad484aa3207fc01a12d519"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d70f6c96e1ad484aa3207fc01a12d519"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d70f6c96e1ad484aa3207fc01a12d519", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d70f6c96e1ad484aa3207fc01a12d519"}]}] Jul 23 21:33:16.260825 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:33:16.260825 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: d70f6c96e1ad484aa3207fc01a12d519 Jul 23 21:33:16.260825 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:33:16.260825 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServersNegativeTestJSON-1106538570-project Jul 23 21:33:16.260825 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:33:16.260825 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:33:16.260825 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 6ca9644a73d9468aa39b21548a72bded Jul 23 21:33:16.260825 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServersNegativeTestJSON-1106538570-project Jul 23 21:33:16.260825 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:33:16.260825 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance e74832ce-b06a-4786-b3f3-372e508a4795 could not be found. Jul 23 21:33:16.260825 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': 'e74832ce-b06a-4786-b3f3-372e508a4795'} Jul 23 21:33:16.260825 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:33:16.260825 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:33:16.260825 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:33:16.260825 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:33:16.260825 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:33:16.260825 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:33:16.260825 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:33:16.260825 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:33:16.260825 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:33:16.260825 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:33:16.260825 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e74832ce-b06a-4786-b3f3-372e508a4795 could not be found. Jul 23 21:33:16.260825 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:16.260825 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:33:16.260825 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:16.260825 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:33:16.260825 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:33:16.260825 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:33:16.260825 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:33:16.260825 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:33:16.260825 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:33:16.260825 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:33:16.260825 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 23 21:33:16.260825 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 23 21:33:16.260825 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 23 21:33:16.260825 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 23 21:33:16.260825 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:33:16.260825 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:33:16.260825 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:33:16.260825 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:33:16.264966 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e74832ce-b06a-4786-b3f3-372e508a4795 could not be found. Jul 23 21:33:16.264966 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:16.264966 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:33:16.264966 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:16.264966 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:33:16.264966 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:33:16.264966 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:33:16.264966 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:33:16.264966 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:33:16.264966 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e74832ce-b06a-4786-b3f3-372e508a4795 could not be found. Jul 23 21:33:16.264966 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:16.267608 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-cb1392d3-ab34-4692-8b5a-3ccb6794493d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Returning 404 to user: Instance e74832ce-b06a-4786-b3f3-372e508a4795 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:33:16.268573 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-cb1392d3-ab34-4692-8b5a-3ccb6794493d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "DELETE /compute/v2.1/servers/e74832ce-b06a-4786-b3f3-372e508a4795" status: 404 len: 111 microversion: 2.1 time: 0.043840 Jul 23 21:33:16.269211 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2363/4809] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:33:16 2022] DELETE /compute/v2.1/servers/e74832ce-b06a-4786-b3f3-372e508a4795 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:33:16.278433 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a1f12d5a-2b2c-4d28-ba79-e973937903fc tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:16.279664 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a1f12d5a-2b2c-4d28-ba79-e973937903fc tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: e74832ce-b06a-4786-b3f3-372e508a4795] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:16.287094 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a1f12d5a-2b2c-4d28-ba79-e973937903fc tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:16.288140 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a1f12d5a-2b2c-4d28-ba79-e973937903fc tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:16.289331 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a1f12d5a-2b2c-4d28-ba79-e973937903fc tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:16.290107 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a1f12d5a-2b2c-4d28-ba79-e973937903fc tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:16.307936 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-7f5dd92a-1f71-4b96-ac3b-99507698a41b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:16.314349 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-a1f12d5a-2b2c-4d28-ba79-e973937903fc tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] HTTP exception thrown: Instance e74832ce-b06a-4786-b3f3-372e508a4795 could not be found. Jul 23 21:33:16.316307 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a1f12d5a-2b2c-4d28-ba79-e973937903fc tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Request method failure captured: Jul 23 21:33:16.316307 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/e74832ce-b06a-4786-b3f3-372e508a4795 HTTP/1.1 Jul 23 21:33:16.316307 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:33:16.316307 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:33:16.316307 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:33:16.316307 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:33:16.316307 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:33:16.316307 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:33:16.316307 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:33:16.316307 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:33:16.316307 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3Ghf1JjZ4k8tVzERRK8IkLpluLUwa9k5Rz-X0dEr2p4_7xl_eBekUiNk1RZEGsFdGEiApbLOfcuSifirvwiKV1QOTaKdXKwfMnwZgdfagxJjoe3dPYUa3b-d3rVTYewIN_YoX2mMGGBMWRa3po8WOCVIc6hXJLExzq_ndbcO7U8NQBI Jul 23 21:33:16.316307 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:33:16.316307 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:33:16.316307 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:33:16.316307 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:33:16.316307 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:33:16.316307 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:33:16.316307 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: d70f6c96e1ad484aa3207fc01a12d519 Jul 23 21:33:16.316307 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:33:16.316307 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:33:16.316307 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:33:16.316307 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d70f6c96e1ad484aa3207fc01a12d519"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d70f6c96e1ad484aa3207fc01a12d519"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d70f6c96e1ad484aa3207fc01a12d519", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d70f6c96e1ad484aa3207fc01a12d519"}]}] Jul 23 21:33:16.316307 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:33:16.316307 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: d70f6c96e1ad484aa3207fc01a12d519 Jul 23 21:33:16.316307 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:33:16.316307 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServersNegativeTestJSON-1106538570-project Jul 23 21:33:16.316307 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:33:16.316307 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:33:16.316307 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 6ca9644a73d9468aa39b21548a72bded Jul 23 21:33:16.316307 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServersNegativeTestJSON-1106538570-project Jul 23 21:33:16.316307 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:33:16.316307 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance e74832ce-b06a-4786-b3f3-372e508a4795 could not be found. Jul 23 21:33:16.316307 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': 'e74832ce-b06a-4786-b3f3-372e508a4795'} Jul 23 21:33:16.316307 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:33:16.316307 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:33:16.316307 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:33:16.316307 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:33:16.316307 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:33:16.316307 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:33:16.316307 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:33:16.316307 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:33:16.316307 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:33:16.316307 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:33:16.316307 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e74832ce-b06a-4786-b3f3-372e508a4795 could not be found. Jul 23 21:33:16.316307 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:16.316307 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:33:16.316307 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:16.316307 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:33:16.316307 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:33:16.316307 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:33:16.316307 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:33:16.316307 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:33:16.316307 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:33:16.316307 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:33:16.316307 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:33:16.316307 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:33:16.316307 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:33:16.316307 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:33:16.316307 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:33:16.316307 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:33:16.316307 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e74832ce-b06a-4786-b3f3-372e508a4795 could not be found. Jul 23 21:33:16.316307 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:16.316307 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:33:16.316307 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:16.321104 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:33:16.321104 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:33:16.321104 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:33:16.321104 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:33:16.321104 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:33:16.321104 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e74832ce-b06a-4786-b3f3-372e508a4795 could not be found. Jul 23 21:33:16.321104 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:16.321104 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a1f12d5a-2b2c-4d28-ba79-e973937903fc tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Returning 404 to user: Instance e74832ce-b06a-4786-b3f3-372e508a4795 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:33:16.322361 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a1f12d5a-2b2c-4d28-ba79-e973937903fc tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/e74832ce-b06a-4786-b3f3-372e508a4795" status: 404 len: 111 microversion: 2.1 time: 0.048082 Jul 23 21:33:16.323687 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2364/4810] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:33:16 2022] GET /compute/v2.1/servers/e74832ce-b06a-4786-b3f3-372e508a4795 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 23 21:33:16.333790 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-7f5dd92a-1f71-4b96-ac3b-99507698a41b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:16.339541 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-7f5dd92a-1f71-4b96-ac3b-99507698a41b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:16.341982 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-7f5dd92a-1f71-4b96-ac3b-99507698a41b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.154732 Jul 23 21:33:16.343216 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2447/4811] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:33:16 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:33:16.350098 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-3c3424cf-8905-4ac5-b9a5-7879f8d287fd tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:16.350674 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-3c3424cf-8905-4ac5-b9a5-7879f8d287fd tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:16.358908 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3c3424cf-8905-4ac5-b9a5-7879f8d287fd tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:16.359475 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3c3424cf-8905-4ac5-b9a5-7879f8d287fd tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:16.360331 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3c3424cf-8905-4ac5-b9a5-7879f8d287fd tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:16.360840 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3c3424cf-8905-4ac5-b9a5-7879f8d287fd tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:16.392069 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-3c3424cf-8905-4ac5-b9a5-7879f8d287fd tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Going to try to terminate instance {{(pid=131321) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:33:16.480622 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-3c3424cf-8905-4ac5-b9a5-7879f8d287fd tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "DELETE /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 204 len: 0 microversion: 2.1 time: 0.134246 Jul 23 21:33:16.481636 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2448/4812] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:33:16 2022] DELETE /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:33:16.490521 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-0bdce92d-fe75-49be-8229-020929f0ab64 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:16.491211 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-0bdce92d-fe75-49be-8229-020929f0ab64 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:16.498509 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0bdce92d-fe75-49be-8229-020929f0ab64 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:16.499198 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0bdce92d-fe75-49be-8229-020929f0ab64 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:16.500150 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0bdce92d-fe75-49be-8229-020929f0ab64 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:16.500759 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0bdce92d-fe75-49be-8229-020929f0ab64 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:16.610300 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-de5e16d4-6427-4e7e-8775-baf122ffb6ea tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Action: 'create', calling method: .version_select at 0x7f0b466b3160>, body: {"keypair": {"name": "tempest-TestServerBasicOps-1799494003", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPrvZuLgrhDQHPnC5nuhkTIgx/Kx75sOVoffD7TPfhnQC82EOF4krYUYWqkn6WGE6v7rqWpaeu2vDCp5vN1ZvO/2kdCNEkda+fnS6n3TGkcGMsrc38ExIpYORmV8bQNohw=="}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:33:16.636251 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-de5e16d4-6427-4e7e-8775-baf122ffb6ea tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Getting quotas for project 6f1825873b0849ea98136c0979b251c4. Resources: {'key_pairs'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:33:16.641764 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-de5e16d4-6427-4e7e-8775-baf122ffb6ea tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Getting quotas for user 47bdbd5d201c465a82540c1d8c0fdf57 and project 6f1825873b0849ea98136c0979b251c4. Resources: {'key_pairs'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:33:16.691795 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-de5e16d4-6427-4e7e-8775-baf122ffb6ea tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.367696 Jul 23 21:33:16.711232 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-0bdce92d-fe75-49be-8229-020929f0ab64 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:16.712796 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2365/4813] 10.222.0.17 () {60 vars in 1158 bytes} [Sat Jul 23 21:33:16 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:33:16.722684 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-315bb273-d7c2-474b-988c-03809586b422 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:16.729449 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-0bdce92d-fe75-49be-8229-020929f0ab64 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1511 microversion: 2.1 time: 0.241981 Jul 23 21:33:16.730180 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-315bb273-d7c2-474b-988c-03809586b422 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] [instance: bbee3556-287f-42a5-a6a8-84356c840b67] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:16.731206 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2449/4814] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:33:16 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1511 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:33:16.753177 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-315bb273-d7c2-474b-988c-03809586b422 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:16.753177 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-315bb273-d7c2-474b-988c-03809586b422 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:16.753734 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-315bb273-d7c2-474b-988c-03809586b422 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:16.756201 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-315bb273-d7c2-474b-988c-03809586b422 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:16.800332 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-9c98626a-b68f-444e-adfc-3ccfa863b0a5 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:16.801982 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-9c98626a-b68f-444e-adfc-3ccfa863b0a5 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] [instance: 1f5b9a5a-109e-48b5-adc1-113384944dce] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:16.873852 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9c98626a-b68f-444e-adfc-3ccfa863b0a5 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:16.874905 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9c98626a-b68f-444e-adfc-3ccfa863b0a5 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:16.876588 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9c98626a-b68f-444e-adfc-3ccfa863b0a5 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:16.880843 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9c98626a-b68f-444e-adfc-3ccfa863b0a5 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:16.903176 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-9c98626a-b68f-444e-adfc-3ccfa863b0a5 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] HTTP exception thrown: Instance 1f5b9a5a-109e-48b5-adc1-113384944dce could not be found. Jul 23 21:33:16.914814 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-9c98626a-b68f-444e-adfc-3ccfa863b0a5 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Request method failure captured: Jul 23 21:33:16.914814 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/servers/1f5b9a5a-109e-48b5-adc1-113384944dce HTTP/1.1 Jul 23 21:33:16.914814 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:33:16.914814 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:33:16.914814 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:33:16.914814 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:33:16.914814 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:33:16.914814 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:33:16.914814 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:33:16.914814 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:33:16.914814 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GiSHGnzzTir6G2mkC4jaPgCVF1y1xLwQedmA7LvV03c02Xe23W2KsUPT37XjDPVKEMOFLkGiErD7I7IMt7YT88pM0khBDol2SMKBsKDFUTBYtfvq9zg9z5ruQEFt0Anq0ZoSTwWSOEsjPrqrFH7f_8Om8o-cmqhPrh5I_ggUZ1RWuw Jul 23 21:33:16.914814 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:33:16.914814 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:33:16.914814 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:33:16.914814 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:33:16.914814 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:33:16.914814 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:33:16.914814 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 842a1aca542f416eab5d43b881325917 Jul 23 21:33:16.914814 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-820000053 Jul 23 21:33:16.914814 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:33:16.914814 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:33:16.914814 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/842a1aca542f416eab5d43b881325917"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/842a1aca542f416eab5d43b881325917"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_842a1aca542f416eab5d43b881325917", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/842a1aca542f416eab5d43b881325917"}]}] Jul 23 21:33:16.914814 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-TestSecurityGroupsBasicOps-820000053 Jul 23 21:33:16.914814 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 842a1aca542f416eab5d43b881325917 Jul 23 21:33:16.914814 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-820000053 Jul 23 21:33:16.914814 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-TestSecurityGroupsBasicOps-820000053-project Jul 23 21:33:16.914814 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:33:16.914814 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:33:16.914814 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 0bd49331138a4dbc912bc7bf6f6b0215 Jul 23 21:33:16.914814 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-TestSecurityGroupsBasicOps-820000053-project Jul 23 21:33:16.914814 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:33:16.914814 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance 1f5b9a5a-109e-48b5-adc1-113384944dce could not be found. Jul 23 21:33:16.914814 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': '1f5b9a5a-109e-48b5-adc1-113384944dce'} Jul 23 21:33:16.914814 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:33:16.914814 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:33:16.914814 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:33:16.914814 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:33:16.914814 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:33:16.914814 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:33:16.914814 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:33:16.914814 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:33:16.914814 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:33:16.914814 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:33:16.914814 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f5b9a5a-109e-48b5-adc1-113384944dce could not be found. Jul 23 21:33:16.914814 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:33:16.914814 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:33:16.914814 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:33:16.914814 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:33:16.914814 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:33:16.914814 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:33:16.914814 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:33:16.914814 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:33:16.914814 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:33:16.914814 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:33:16.914814 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:33:16.914814 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:33:16.914814 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:33:16.914814 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:33:16.914814 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:33:16.914814 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:33:16.914814 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f5b9a5a-109e-48b5-adc1-113384944dce could not be found. Jul 23 21:33:16.914814 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:33:16.914814 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:33:16.914814 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:33:16.919805 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:33:16.919805 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:33:16.919805 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:33:16.919805 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:33:16.919805 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:33:16.919805 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f5b9a5a-109e-48b5-adc1-113384944dce could not be found. Jul 23 21:33:16.919805 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:33:16.927642 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-9c98626a-b68f-444e-adfc-3ccfa863b0a5 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Returning 404 to user: Instance 1f5b9a5a-109e-48b5-adc1-113384944dce could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:33:16.929263 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-9c98626a-b68f-444e-adfc-3ccfa863b0a5 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] 10.222.0.17 "GET /compute/v2.1/servers/1f5b9a5a-109e-48b5-adc1-113384944dce" status: 404 len: 111 microversion: 2.1 time: 0.135593 Jul 23 21:33:16.930487 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2450/4815] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:33:16 2022] GET /compute/v2.1/servers/1f5b9a5a-109e-48b5-adc1-113384944dce => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:33:16.937625 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e5de4e80-0efc-40d4-9f67-0483883f5d71 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:16.938532 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-e5de4e80-0efc-40d4-9f67-0483883f5d71 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] [instance: 0352d36b-f7b0-4c09-8517-a5711438d586] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:16.951047 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e5de4e80-0efc-40d4-9f67-0483883f5d71 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:16.951851 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e5de4e80-0efc-40d4-9f67-0483883f5d71 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:16.952896 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e5de4e80-0efc-40d4-9f67-0483883f5d71 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:16.954024 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e5de4e80-0efc-40d4-9f67-0483883f5d71 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:17.099896 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-e5de4e80-0efc-40d4-9f67-0483883f5d71 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:17.112483 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-315bb273-d7c2-474b-988c-03809586b422 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b1e260651b4dffa7c1efe8e9d0f144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcf55bcaba04bf8ae8a9b2ac09e8d98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:17.116639 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-e5de4e80-0efc-40d4-9f67-0483883f5d71 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:17.120964 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-315bb273-d7c2-474b-988c-03809586b422 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] 10.222.0.17 "GET /compute/v2.1/servers/bbee3556-287f-42a5-a6a8-84356c840b67" status: 200 len: 1557 microversion: 2.1 time: 0.406984 Jul 23 21:33:17.123392 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2366/4816] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:33:16 2022] GET /compute/v2.1/servers/bbee3556-287f-42a5-a6a8-84356c840b67 => generated 1557 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:33:17.128465 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-d3071111-0d6d-427c-906c-b403c70db556 req-49cf2543-c027-4d9a-9443-a9aaad37d4b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0bb14c2-15df-4440-9d9c-4c6598867dfe", "name": "network-vif-deleted", "tag": "da2c7126-d794-4ff2-a071-724ef04327f5"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:33:17.129692 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-e5de4e80-0efc-40d4-9f67-0483883f5d71 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:17.130974 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-e5de4e80-0efc-40d4-9f67-0483883f5d71 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] 10.222.0.17 "GET /compute/v2.1/servers/0352d36b-f7b0-4c09-8517-a5711438d586" status: 200 len: 1366 microversion: 2.57 time: 0.199267 Jul 23 21:33:17.139144 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-d3071111-0d6d-427c-906c-b403c70db556 req-49cf2543-c027-4d9a-9443-a9aaad37d4b0 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:17.139985 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-d3071111-0d6d-427c-906c-b403c70db556 req-49cf2543-c027-4d9a-9443-a9aaad37d4b0 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:17.142171 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2451/4817] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:33:16 2022] GET /compute/v2.1/servers/0352d36b-f7b0-4c09-8517-a5711438d586 => generated 1366 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:33:17.147373 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-268093ab-df36-4ad8-9fb4-43c797aa801f tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:17.155544 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-268093ab-df36-4ad8-9fb4-43c797aa801f tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] [instance: bbee3556-287f-42a5-a6a8-84356c840b67] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:17.168055 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-268093ab-df36-4ad8-9fb4-43c797aa801f tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:17.168807 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-268093ab-df36-4ad8-9fb4-43c797aa801f tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:17.169841 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-268093ab-df36-4ad8-9fb4-43c797aa801f tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:17.170506 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-268093ab-df36-4ad8-9fb4-43c797aa801f tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:17.171683 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-d3071111-0d6d-427c-906c-b403c70db556 req-49cf2543-c027-4d9a-9443-a9aaad37d4b0 service nova] Creating event network-vif-deleted:da2c7126-d794-4ff2-a071-724ef04327f5 for instance b0bb14c2-15df-4440-9d9c-4c6598867dfe on nch2-master-1 Jul 23 21:33:17.199684 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-d3071111-0d6d-427c-906c-b403c70db556 req-49cf2543-c027-4d9a-9443-a9aaad37d4b0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074579 Jul 23 21:33:17.202184 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2367/4818] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:33:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:33:17.218448 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4a9a5ca0-087f-4cbc-8ce7-ef9401130c11 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:17.219547 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-4a9a5ca0-087f-4cbc-8ce7-ef9401130c11 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] [instance: b0bb14c2-15df-4440-9d9c-4c6598867dfe] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:17.229542 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4a9a5ca0-087f-4cbc-8ce7-ef9401130c11 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:17.233277 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4a9a5ca0-087f-4cbc-8ce7-ef9401130c11 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:17.236262 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4a9a5ca0-087f-4cbc-8ce7-ef9401130c11 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:17.238836 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4a9a5ca0-087f-4cbc-8ce7-ef9401130c11 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:17.307466 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4a9a5ca0-087f-4cbc-8ce7-ef9401130c11 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:17.308304 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4a9a5ca0-087f-4cbc-8ce7-ef9401130c11 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:17.308965 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.objects.instance [None req-4a9a5ca0-087f-4cbc-8ce7-ef9401130c11 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lazy-loading 'fault' on Instance uuid b0bb14c2-15df-4440-9d9c-4c6598867dfe {{(pid=131320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:33:17.382842 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-268093ab-df36-4ad8-9fb4-43c797aa801f tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] 10.222.0.17 "GET /compute/v2.1/servers/bbee3556-287f-42a5-a6a8-84356c840b67/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.238321 Jul 23 21:33:17.383524 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2452/4819] 10.222.0.17 () {58 vars in 1274 bytes} [Sat Jul 23 21:33:17 2022] GET /compute/v2.1/servers/bbee3556-287f-42a5-a6a8-84356c840b67/os-interface => generated 284 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:33:17.391748 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-6a6c43c6-8cae-4b4c-9646-c1561faed90f tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:17.394718 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-6a6c43c6-8cae-4b4c-9646-c1561faed90f tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] [instance: d6b9ea07-2ebd-4e1a-86f2-abb1bf581076] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:17.414886 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6a6c43c6-8cae-4b4c-9646-c1561faed90f tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:17.415581 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6a6c43c6-8cae-4b4c-9646-c1561faed90f tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:17.416245 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-4a9a5ca0-087f-4cbc-8ce7-ef9401130c11 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc4aa131e63349b2aa8f37fdf6d2fe00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc1475019924837a8be47347f6bbd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:17.418627 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6a6c43c6-8cae-4b4c-9646-c1561faed90f tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:17.419401 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6a6c43c6-8cae-4b4c-9646-c1561faed90f tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:17.426243 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4a9a5ca0-087f-4cbc-8ce7-ef9401130c11 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] 10.222.0.17 "GET /compute/v2.1/servers/b0bb14c2-15df-4440-9d9c-4c6598867dfe" status: 200 len: 1328 microversion: 2.1 time: 0.222526 Jul 23 21:33:17.436152 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2368/4820] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:33:17 2022] GET /compute/v2.1/servers/b0bb14c2-15df-4440-9d9c-4c6598867dfe => generated 1328 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:33:17.447882 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4ebaf8c1-b941-476b-a288-c23d4ab13521 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:17.448446 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-4ebaf8c1-b941-476b-a288-c23d4ab13521 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:17.464552 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4ebaf8c1-b941-476b-a288-c23d4ab13521 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:17.465108 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4ebaf8c1-b941-476b-a288-c23d4ab13521 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:17.465994 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4ebaf8c1-b941-476b-a288-c23d4ab13521 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:17.466443 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4ebaf8c1-b941-476b-a288-c23d4ab13521 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:17.562676 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-4ebaf8c1-b941-476b-a288-c23d4ab13521 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:17.576738 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-4ebaf8c1-b941-476b-a288-c23d4ab13521 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:17.583911 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-4ebaf8c1-b941-476b-a288-c23d4ab13521 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:17.585545 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4ebaf8c1-b941-476b-a288-c23d4ab13521 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.147862 Jul 23 21:33:17.598768 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2369/4821] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:33:17 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:33:17.749044 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-76321fba-3778-4f46-ac19-82f34ab1ede2 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:17.750493 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-76321fba-3778-4f46-ac19-82f34ab1ede2 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:17.768505 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-76321fba-3778-4f46-ac19-82f34ab1ede2 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:17.770393 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-76321fba-3778-4f46-ac19-82f34ab1ede2 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:17.771674 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-76321fba-3778-4f46-ac19-82f34ab1ede2 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:17.773065 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-76321fba-3778-4f46-ac19-82f34ab1ede2 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:17.775718 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-6a6c43c6-8cae-4b4c-9646-c1561faed90f tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:17.791754 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-6a6c43c6-8cae-4b4c-9646-c1561faed90f tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:17.793531 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-6a6c43c6-8cae-4b4c-9646-c1561faed90f tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:17.794878 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-6a6c43c6-8cae-4b4c-9646-c1561faed90f tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] 10.222.0.17 "GET /compute/v2.1/servers/d6b9ea07-2ebd-4e1a-86f2-abb1bf581076" status: 200 len: 1724 microversion: 2.20 time: 0.409236 Jul 23 21:33:17.795856 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2453/4822] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:33:17 2022] GET /compute/v2.1/servers/d6b9ea07-2ebd-4e1a-86f2-abb1bf581076 => generated 1724 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:33:17.805804 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=100 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:18.026893 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-76321fba-3778-4f46-ac19-82f34ab1ede2 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:18.036069 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-76321fba-3778-4f46-ac19-82f34ab1ede2 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1511 microversion: 2.1 time: 0.291416 Jul 23 21:33:18.040068 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2370/4823] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:33:17 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1511 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:33:18.150209 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-6c5914e7-66af-45bb-9f06-a65c9cd93fa6 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:18.150841 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-6c5914e7-66af-45bb-9f06-a65c9cd93fa6 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] [instance: 0352d36b-f7b0-4c09-8517-a5711438d586] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:18.161695 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6c5914e7-66af-45bb-9f06-a65c9cd93fa6 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:18.163373 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6c5914e7-66af-45bb-9f06-a65c9cd93fa6 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:18.164306 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6c5914e7-66af-45bb-9f06-a65c9cd93fa6 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:18.164768 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6c5914e7-66af-45bb-9f06-a65c9cd93fa6 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:18.305618 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-6c5914e7-66af-45bb-9f06-a65c9cd93fa6 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:18.321737 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-6c5914e7-66af-45bb-9f06-a65c9cd93fa6 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:18.324236 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-6c5914e7-66af-45bb-9f06-a65c9cd93fa6 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:18.325567 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-6c5914e7-66af-45bb-9f06-a65c9cd93fa6 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] 10.222.0.17 "GET /compute/v2.1/servers/0352d36b-f7b0-4c09-8517-a5711438d586" status: 200 len: 1366 microversion: 2.57 time: 0.179755 Jul 23 21:33:18.339153 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2454/4824] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:33:18 2022] GET /compute/v2.1/servers/0352d36b-f7b0-4c09-8517-a5711438d586 => generated 1366 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:33:18.443486 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-976518aa-bf49-41a8-adc7-81ee3daa7e41 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:18.444100 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-976518aa-bf49-41a8-adc7-81ee3daa7e41 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] [instance: b0bb14c2-15df-4440-9d9c-4c6598867dfe] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:18.451053 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-976518aa-bf49-41a8-adc7-81ee3daa7e41 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:18.451739 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-976518aa-bf49-41a8-adc7-81ee3daa7e41 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:18.452298 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-976518aa-bf49-41a8-adc7-81ee3daa7e41 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:18.452744 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-976518aa-bf49-41a8-adc7-81ee3daa7e41 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:18.481700 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-976518aa-bf49-41a8-adc7-81ee3daa7e41 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] HTTP exception thrown: Instance b0bb14c2-15df-4440-9d9c-4c6598867dfe could not be found. Jul 23 21:33:18.483350 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-976518aa-bf49-41a8-adc7-81ee3daa7e41 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Request method failure captured: Jul 23 21:33:18.483350 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/b0bb14c2-15df-4440-9d9c-4c6598867dfe HTTP/1.1 Jul 23 21:33:18.483350 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:33:18.483350 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:33:18.483350 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:33:18.483350 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:33:18.483350 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:33:18.483350 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:33:18.483350 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:33:18.483350 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:33:18.483350 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GjfgQOGWzElTWf002Ut_f1Wcr_yBFtwnVk83bWSqCFwGZa5EAK2XMph2qhSbMaq09HkgNJ-0CvfZnlqJEUNoBL04WEXaoyTbGoQipnQ6q1x_awVwLWZvN6-awWxn5KdGXNeWQd4_HLoUm0TybLuxA8tiZTb1I153m5qSexqZjpNZtg Jul 23 21:33:18.483350 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:33:18.483350 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:33:18.483350 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:33:18.483350 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:33:18.483350 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:33:18.483350 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:33:18.483350 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 6bc1475019924837a8be47347f6bbd75 Jul 23 21:33:18.483350 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-AttachVolumeTestJSON-1227491524 Jul 23 21:33:18.483350 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:33:18.483350 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:33:18.483350 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6bc1475019924837a8be47347f6bbd75"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6bc1475019924837a8be47347f6bbd75"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6bc1475019924837a8be47347f6bbd75", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6bc1475019924837a8be47347f6bbd75"}]}] Jul 23 21:33:18.483350 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-AttachVolumeTestJSON-1227491524 Jul 23 21:33:18.483350 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 6bc1475019924837a8be47347f6bbd75 Jul 23 21:33:18.483350 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1227491524 Jul 23 21:33:18.483350 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-AttachVolumeTestJSON-1227491524-project Jul 23 21:33:18.483350 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:33:18.483350 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:33:18.483350 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: bc4aa131e63349b2aa8f37fdf6d2fe00 Jul 23 21:33:18.483350 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-AttachVolumeTestJSON-1227491524-project Jul 23 21:33:18.483350 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:33:18.483350 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance b0bb14c2-15df-4440-9d9c-4c6598867dfe could not be found. Jul 23 21:33:18.483350 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': 'b0bb14c2-15df-4440-9d9c-4c6598867dfe'} Jul 23 21:33:18.483350 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:33:18.483350 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:33:18.483350 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:33:18.483350 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:33:18.483350 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:33:18.483350 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:33:18.483350 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:33:18.483350 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:33:18.483350 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:33:18.483350 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:33:18.483350 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0bb14c2-15df-4440-9d9c-4c6598867dfe could not be found. Jul 23 21:33:18.483350 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:18.483350 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:33:18.483350 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:18.483350 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:33:18.483350 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:33:18.483350 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:33:18.483350 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:33:18.483350 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:33:18.483350 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:33:18.483350 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:33:18.483350 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:33:18.483350 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:33:18.483350 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:33:18.483350 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:33:18.483350 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:33:18.483350 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:33:18.483350 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0bb14c2-15df-4440-9d9c-4c6598867dfe could not be found. Jul 23 21:33:18.483350 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:18.483350 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:33:18.483350 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:18.490198 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:33:18.490198 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:33:18.490198 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:33:18.490198 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:33:18.490198 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:33:18.490198 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0bb14c2-15df-4440-9d9c-4c6598867dfe could not be found. Jul 23 21:33:18.490198 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:18.490198 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-976518aa-bf49-41a8-adc7-81ee3daa7e41 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Returning 404 to user: Instance b0bb14c2-15df-4440-9d9c-4c6598867dfe could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:33:18.490198 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-976518aa-bf49-41a8-adc7-81ee3daa7e41 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] 10.222.0.17 "GET /compute/v2.1/servers/b0bb14c2-15df-4440-9d9c-4c6598867dfe" status: 404 len: 111 microversion: 2.1 time: 0.045350 Jul 23 21:33:18.490198 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2371/4825] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:33:18 2022] GET /compute/v2.1/servers/b0bb14c2-15df-4440-9d9c-4c6598867dfe => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:33:18.497450 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-6150f02f-215e-4367-8736-be6944fcc58b tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Calling method '.version_select at 0x7f0b4713c3a0>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:18.549054 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-6150f02f-215e-4367-8736-be6944fcc58b tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1091663138" status: 202 len: 0 microversion: 2.1 time: 0.056972 Jul 23 21:33:18.549876 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2455/4826] 10.222.0.17 () {58 vars in 1220 bytes} [Sat Jul 23 21:33:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1091663138 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:33:18.605099 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-7caa559b-90ca-42ad-9020-ba189cb14179 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:18.606032 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-7caa559b-90ca-42ad-9020-ba189cb14179 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:18.624766 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7caa559b-90ca-42ad-9020-ba189cb14179 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:18.625504 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7caa559b-90ca-42ad-9020-ba189cb14179 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:18.626513 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7caa559b-90ca-42ad-9020-ba189cb14179 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:18.627107 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7caa559b-90ca-42ad-9020-ba189cb14179 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:18.810828 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-7caa559b-90ca-42ad-9020-ba189cb14179 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:18.818579 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-3372ea34-b8bd-4531-83e7-c8ce9cbb17e5 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:18.820052 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-3372ea34-b8bd-4531-83e7-c8ce9cbb17e5 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] [instance: d6b9ea07-2ebd-4e1a-86f2-abb1bf581076] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:18.826007 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-7caa559b-90ca-42ad-9020-ba189cb14179 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:18.827676 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-7caa559b-90ca-42ad-9020-ba189cb14179 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:18.830299 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-7caa559b-90ca-42ad-9020-ba189cb14179 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.229561 Jul 23 21:33:18.830869 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2372/4827] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:33:18 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:33:18.834822 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3372ea34-b8bd-4531-83e7-c8ce9cbb17e5 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:18.835287 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3372ea34-b8bd-4531-83e7-c8ce9cbb17e5 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:18.836304 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3372ea34-b8bd-4531-83e7-c8ce9cbb17e5 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:18.836898 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3372ea34-b8bd-4531-83e7-c8ce9cbb17e5 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:19.056829 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-96f2aab6-18d2-4810-92fe-3a97f668ce5d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:19.059636 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-96f2aab6-18d2-4810-92fe-3a97f668ce5d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:19.075123 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-96f2aab6-18d2-4810-92fe-3a97f668ce5d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:19.076332 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-96f2aab6-18d2-4810-92fe-3a97f668ce5d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:19.077492 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-96f2aab6-18d2-4810-92fe-3a97f668ce5d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:19.078368 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-96f2aab6-18d2-4810-92fe-3a97f668ce5d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:19.192523 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-3372ea34-b8bd-4531-83e7-c8ce9cbb17e5 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:19.233198 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-3372ea34-b8bd-4531-83e7-c8ce9cbb17e5 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:19.235332 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-3372ea34-b8bd-4531-83e7-c8ce9cbb17e5 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:19.237151 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-3372ea34-b8bd-4531-83e7-c8ce9cbb17e5 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] 10.222.0.17 "GET /compute/v2.1/servers/d6b9ea07-2ebd-4e1a-86f2-abb1bf581076" status: 200 len: 1724 microversion: 2.20 time: 0.427795 Jul 23 21:33:19.238054 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2456/4828] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:33:18 2022] GET /compute/v2.1/servers/d6b9ea07-2ebd-4e1a-86f2-abb1bf581076 => generated 1724 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:33:19.350172 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-39d14538-d8f1-4047-8c64-4f419c202756 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:19.351558 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-39d14538-d8f1-4047-8c64-4f419c202756 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] [instance: 0352d36b-f7b0-4c09-8517-a5711438d586] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:19.362926 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-39d14538-d8f1-4047-8c64-4f419c202756 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:19.363833 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-39d14538-d8f1-4047-8c64-4f419c202756 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:19.365255 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-39d14538-d8f1-4047-8c64-4f419c202756 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:19.366007 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-39d14538-d8f1-4047-8c64-4f419c202756 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:19.542810 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-39d14538-d8f1-4047-8c64-4f419c202756 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:19.553649 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-39d14538-d8f1-4047-8c64-4f419c202756 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:19.556401 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-39d14538-d8f1-4047-8c64-4f419c202756 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:19.559192 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-39d14538-d8f1-4047-8c64-4f419c202756 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] 10.222.0.17 "GET /compute/v2.1/servers/0352d36b-f7b0-4c09-8517-a5711438d586" status: 200 len: 1366 microversion: 2.57 time: 0.218133 Jul 23 21:33:19.573350 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2457/4829] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:33:19 2022] GET /compute/v2.1/servers/0352d36b-f7b0-4c09-8517-a5711438d586 => generated 1366 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:33:19.669728 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-e8b091d0-26bf-4040-90d2-440a53e8c527 req-cf9995ff-37b3-4c9d-baa8-08a7c5015193 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbee3556-287f-42a5-a6a8-84356c840b67", "tag": "b588225a-63d8-48d9-a3c7-0823a9dd1533"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:33:19.686795 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-e8b091d0-26bf-4040-90d2-440a53e8c527 req-cf9995ff-37b3-4c9d-baa8-08a7c5015193 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:19.687349 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-e8b091d0-26bf-4040-90d2-440a53e8c527 req-cf9995ff-37b3-4c9d-baa8-08a7c5015193 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:19.692195 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:19.718561 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-e8b091d0-26bf-4040-90d2-440a53e8c527 req-cf9995ff-37b3-4c9d-baa8-08a7c5015193 service nova] Creating event network-changed:b588225a-63d8-48d9-a3c7-0823a9dd1533 for instance bbee3556-287f-42a5-a6a8-84356c840b67 on nch2-master-1 Jul 23 21:33:19.724791 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-e8b091d0-26bf-4040-90d2-440a53e8c527 req-cf9995ff-37b3-4c9d-baa8-08a7c5015193 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058726 Jul 23 21:33:19.725732 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2458/4830] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:33:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:33:19.770463 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-96f2aab6-18d2-4810-92fe-3a97f668ce5d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca9644a73d9468aa39b21548a72bded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd70f6c96e1ad484aa3207fc01a12d519', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:19.781466 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-96f2aab6-18d2-4810-92fe-3a97f668ce5d tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 200 len: 1511 microversion: 2.1 time: 0.728539 Jul 23 21:33:19.782711 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2373/4831] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:33:19 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 1511 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:33:19.854236 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-20052700-63ea-428f-932a-52b353889247 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:19.855119 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-20052700-63ea-428f-932a-52b353889247 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:19.871391 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-20052700-63ea-428f-932a-52b353889247 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:19.873919 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-20052700-63ea-428f-932a-52b353889247 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:19.883563 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-20052700-63ea-428f-932a-52b353889247 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:19.886831 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-20052700-63ea-428f-932a-52b353889247 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:20.080407 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-20052700-63ea-428f-932a-52b353889247 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:20.104902 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-20052700-63ea-428f-932a-52b353889247 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:20.109009 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-20052700-63ea-428f-932a-52b353889247 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:20.110735 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-20052700-63ea-428f-932a-52b353889247 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.264410 Jul 23 21:33:20.124759 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2459/4832] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:33:19 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:33:20.256574 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3494e5a6-61c4-4673-84ab-0baaacb0782a tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:20.259512 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-3494e5a6-61c4-4673-84ab-0baaacb0782a tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] [instance: d6b9ea07-2ebd-4e1a-86f2-abb1bf581076] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:20.278315 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3494e5a6-61c4-4673-84ab-0baaacb0782a tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:20.279768 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3494e5a6-61c4-4673-84ab-0baaacb0782a tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:20.280880 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3494e5a6-61c4-4673-84ab-0baaacb0782a tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:20.281530 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3494e5a6-61c4-4673-84ab-0baaacb0782a tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:20.385415 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-cb98a7cd-a9ea-44d4-b10d-10ce86bf85c3 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Action: 'create', calling method: .version_select at 0x7f0b46b839d0>, body: {"keypair": {"name": "tempest-keypair-1155814123", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGvyMzSWMORvfne16whEUWL7wOR4h7V7EUP8I52p9coBCHzYwXzqCy2w0f7q/TOZ6PXOU+7wSflnFWS/5/9Pjwg0D/8OWrgihRqztv7NSoQPc521kvOWGvMTqOp8pAzYqQ=="}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:33:20.411943 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-cb98a7cd-a9ea-44d4-b10d-10ce86bf85c3 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Getting quotas for project 6bc1475019924837a8be47347f6bbd75. Resources: {'key_pairs'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:33:20.422120 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-cb98a7cd-a9ea-44d4-b10d-10ce86bf85c3 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Getting quotas for user bc4aa131e63349b2aa8f37fdf6d2fe00 and project 6bc1475019924837a8be47347f6bbd75. Resources: {'key_pairs'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:33:20.459486 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-cb98a7cd-a9ea-44d4-b10d-10ce86bf85c3 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.078113 Jul 23 21:33:20.465675 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2460/4833] 10.222.0.17 () {60 vars in 1158 bytes} [Sat Jul 23 21:33:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:33:20.585288 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-186dad42-d4bd-4cb6-bd69-302b2175723e tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:20.586998 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-186dad42-d4bd-4cb6-bd69-302b2175723e tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] [instance: 0352d36b-f7b0-4c09-8517-a5711438d586] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:20.618808 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-186dad42-d4bd-4cb6-bd69-302b2175723e tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:20.619287 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-186dad42-d4bd-4cb6-bd69-302b2175723e tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:20.620119 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-186dad42-d4bd-4cb6-bd69-302b2175723e tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:20.620574 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-186dad42-d4bd-4cb6-bd69-302b2175723e tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:20.867489 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-186dad42-d4bd-4cb6-bd69-302b2175723e tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:20.917312 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-186dad42-d4bd-4cb6-bd69-302b2175723e tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:20.926598 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-186dad42-d4bd-4cb6-bd69-302b2175723e tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:20.928698 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-186dad42-d4bd-4cb6-bd69-302b2175723e tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] 10.222.0.17 "GET /compute/v2.1/servers/0352d36b-f7b0-4c09-8517-a5711438d586" status: 200 len: 1366 microversion: 2.57 time: 0.353765 Jul 23 21:33:20.936001 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2461/4834] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:33:20 2022] GET /compute/v2.1/servers/0352d36b-f7b0-4c09-8517-a5711438d586 => generated 1366 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:33:20.942303 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-1d046d9e-3946-45f2-87d9-0721afe35227 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:20.943274 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-1d046d9e-3946-45f2-87d9-0721afe35227 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] [instance: f2ad2cfd-7479-48d0-b802-cdd5d5093305] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:20.951120 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1d046d9e-3946-45f2-87d9-0721afe35227 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:20.951821 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1d046d9e-3946-45f2-87d9-0721afe35227 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:20.952821 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1d046d9e-3946-45f2-87d9-0721afe35227 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:20.953451 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1d046d9e-3946-45f2-87d9-0721afe35227 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:20.970610 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-1d046d9e-3946-45f2-87d9-0721afe35227 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] HTTP exception thrown: Instance f2ad2cfd-7479-48d0-b802-cdd5d5093305 could not be found. Jul 23 21:33:20.972472 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-1d046d9e-3946-45f2-87d9-0721afe35227 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Request method failure captured: Jul 23 21:33:20.972472 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 HTTP/1.1 Jul 23 21:33:20.972472 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:33:20.972472 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:33:20.972472 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:33:20.972472 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:33:20.972472 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:33:20.972472 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:33:20.972472 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:33:20.972472 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:33:20.972472 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3Ghf1JjZ4k8tVzERRK8IkLpluLUwa9k5Rz-X0dEr2p4_7xl_eBekUiNk1RZEGsFdGEiApbLOfcuSifirvwiKV1QOTaKdXKwfMnwZgdfagxJjoe3dPYUa3b-d3rVTYewIN_YoX2mMGGBMWRa3po8WOCVIc6hXJLExzq_ndbcO7U8NQBI Jul 23 21:33:20.972472 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:33:20.972472 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:33:20.972472 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:33:20.972472 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:33:20.972472 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:33:20.972472 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:33:20.972472 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: d70f6c96e1ad484aa3207fc01a12d519 Jul 23 21:33:20.972472 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:33:20.972472 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:33:20.972472 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:33:20.972472 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d70f6c96e1ad484aa3207fc01a12d519"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d70f6c96e1ad484aa3207fc01a12d519"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d70f6c96e1ad484aa3207fc01a12d519", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d70f6c96e1ad484aa3207fc01a12d519"}]}] Jul 23 21:33:20.972472 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:33:20.972472 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: d70f6c96e1ad484aa3207fc01a12d519 Jul 23 21:33:20.972472 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1106538570 Jul 23 21:33:20.972472 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-ServersNegativeTestJSON-1106538570-project Jul 23 21:33:20.972472 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:33:20.972472 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:33:20.972472 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 6ca9644a73d9468aa39b21548a72bded Jul 23 21:33:20.972472 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-ServersNegativeTestJSON-1106538570-project Jul 23 21:33:20.972472 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:33:20.972472 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance f2ad2cfd-7479-48d0-b802-cdd5d5093305 could not be found. Jul 23 21:33:20.972472 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': 'f2ad2cfd-7479-48d0-b802-cdd5d5093305'} Jul 23 21:33:20.972472 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:33:20.972472 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:33:20.972472 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:33:20.972472 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:33:20.972472 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:33:20.972472 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:33:20.972472 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:33:20.972472 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:33:20.972472 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:33:20.972472 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:33:20.972472 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2ad2cfd-7479-48d0-b802-cdd5d5093305 could not be found. Jul 23 21:33:20.972472 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:33:20.972472 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:33:20.972472 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:33:20.972472 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:33:20.972472 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:33:20.972472 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:33:20.972472 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:33:20.972472 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:33:20.972472 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:33:20.972472 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:33:20.972472 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:33:20.972472 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:33:20.972472 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:33:20.972472 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:33:20.972472 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:33:20.972472 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:33:20.972472 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2ad2cfd-7479-48d0-b802-cdd5d5093305 could not be found. Jul 23 21:33:20.972472 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:33:20.972472 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:33:20.972472 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:33:20.977699 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:33:20.977699 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:33:20.977699 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:33:20.977699 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:33:20.977699 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:33:20.977699 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2ad2cfd-7479-48d0-b802-cdd5d5093305 could not be found. Jul 23 21:33:20.977699 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:33:20.977699 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-1d046d9e-3946-45f2-87d9-0721afe35227 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] Returning 404 to user: Instance f2ad2cfd-7479-48d0-b802-cdd5d5093305 could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:33:20.977699 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-1d046d9e-3946-45f2-87d9-0721afe35227 tempest-ServersNegativeTestJSON-1106538570 tempest-ServersNegativeTestJSON-1106538570-project] 10.222.0.17 "GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305" status: 404 len: 111 microversion: 2.1 time: 0.037041 Jul 23 21:33:20.980058 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2462/4835] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:33:20 2022] GET /compute/v2.1/servers/f2ad2cfd-7479-48d0-b802-cdd5d5093305 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:33:21.130448 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-1892f278-1ec7-4220-902d-6bc3c96327ca tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:21.131234 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-1892f278-1ec7-4220-902d-6bc3c96327ca tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:21.143932 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1892f278-1ec7-4220-902d-6bc3c96327ca tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:21.144394 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1892f278-1ec7-4220-902d-6bc3c96327ca tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:21.150604 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1892f278-1ec7-4220-902d-6bc3c96327ca tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:21.151285 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1892f278-1ec7-4220-902d-6bc3c96327ca tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:21.179225 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-3494e5a6-61c4-4673-84ab-0baaacb0782a tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:21.187812 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-3494e5a6-61c4-4673-84ab-0baaacb0782a tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:21.189340 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-3494e5a6-61c4-4673-84ab-0baaacb0782a tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:21.196694 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-3494e5a6-61c4-4673-84ab-0baaacb0782a tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] 10.222.0.17 "GET /compute/v2.1/servers/d6b9ea07-2ebd-4e1a-86f2-abb1bf581076" status: 200 len: 1724 microversion: 2.20 time: 0.944381 Jul 23 21:33:21.198550 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2374/4836] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:33:20 2022] GET /compute/v2.1/servers/d6b9ea07-2ebd-4e1a-86f2-abb1bf581076 => generated 1724 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:33:21.318685 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-1892f278-1ec7-4220-902d-6bc3c96327ca tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:21.334274 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-1892f278-1ec7-4220-902d-6bc3c96327ca tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:21.341653 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-1892f278-1ec7-4220-902d-6bc3c96327ca tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:21.348531 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-1892f278-1ec7-4220-902d-6bc3c96327ca tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.221164 Jul 23 21:33:21.349510 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2463/4837] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:33:21 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:33:21.433655 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-cccbe0b9-a6e6-4ffb-a106-ee8921c02da9 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-63377669", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-1799494003", "security_groups": [{"name": "tempest-secgroup-smoke-1504683840"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "844e56d0-a884-488d-9a0f-9dba36913ad9"}]}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:33:21.804416 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-cccbe0b9-a6e6-4ffb-a106-ee8921c02da9 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] validate_networks() for [('844e56d0-a884-488d-9a0f-9dba36913ad9', None, None, None, None, None)] {{(pid=131320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:33:21.836885 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-ac382331-2235-495f-8c33-ca1a79fa4e0a req-67ac6070-a798-4c5c-9042-240a7e4c1dc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2ad2cfd-7479-48d0-b802-cdd5d5093305", "name": "network-vif-deleted", "tag": "cbde15d1-b6fd-48d4-98a3-b0a0c831fec2"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:33:21.853327 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-ac382331-2235-495f-8c33-ca1a79fa4e0a req-67ac6070-a798-4c5c-9042-240a7e4c1dc0 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:21.854118 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-ac382331-2235-495f-8c33-ca1a79fa4e0a req-67ac6070-a798-4c5c-9042-240a7e4c1dc0 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:21.875379 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-ac382331-2235-495f-8c33-ca1a79fa4e0a req-67ac6070-a798-4c5c-9042-240a7e4c1dc0 service nova] Creating event network-vif-deleted:cbde15d1-b6fd-48d4-98a3-b0a0c831fec2 for instance f2ad2cfd-7479-48d0-b802-cdd5d5093305 on nch1-master-1 Jul 23 21:33:21.881197 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-ac382331-2235-495f-8c33-ca1a79fa4e0a req-67ac6070-a798-4c5c-9042-240a7e4c1dc0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050002 Jul 23 21:33:21.882482 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2464/4838] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:33:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:33:21.949196 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a9a04e3f-5904-447e-8f13-5db6f87bbc7a tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:21.950073 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-a9a04e3f-5904-447e-8f13-5db6f87bbc7a tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] [instance: 0352d36b-f7b0-4c09-8517-a5711438d586] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:21.956672 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a9a04e3f-5904-447e-8f13-5db6f87bbc7a tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:21.957213 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a9a04e3f-5904-447e-8f13-5db6f87bbc7a tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:21.958102 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a9a04e3f-5904-447e-8f13-5db6f87bbc7a tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:21.958898 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a9a04e3f-5904-447e-8f13-5db6f87bbc7a tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:22.094406 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-a9a04e3f-5904-447e-8f13-5db6f87bbc7a tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:22.105425 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-a9a04e3f-5904-447e-8f13-5db6f87bbc7a tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:22.107472 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-a9a04e3f-5904-447e-8f13-5db6f87bbc7a tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:22.109645 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-a9a04e3f-5904-447e-8f13-5db6f87bbc7a tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] 10.222.0.17 "GET /compute/v2.1/servers/0352d36b-f7b0-4c09-8517-a5711438d586" status: 200 len: 1366 microversion: 2.57 time: 0.164729 Jul 23 21:33:22.110577 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2465/4839] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:33:21 2022] GET /compute/v2.1/servers/0352d36b-f7b0-4c09-8517-a5711438d586 => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:33:22.222628 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-06c4b4d1-3bc7-4288-97a9-89058cf2dd48 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:22.224000 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-06c4b4d1-3bc7-4288-97a9-89058cf2dd48 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] [instance: d6b9ea07-2ebd-4e1a-86f2-abb1bf581076] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:22.231759 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-06c4b4d1-3bc7-4288-97a9-89058cf2dd48 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:22.232572 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-06c4b4d1-3bc7-4288-97a9-89058cf2dd48 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:22.233603 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-06c4b4d1-3bc7-4288-97a9-89058cf2dd48 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:22.234169 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-06c4b4d1-3bc7-4288-97a9-89058cf2dd48 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:22.319225 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-06c4b4d1-3bc7-4288-97a9-89058cf2dd48 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:22.328479 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-06c4b4d1-3bc7-4288-97a9-89058cf2dd48 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:22.330328 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-06c4b4d1-3bc7-4288-97a9-89058cf2dd48 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:22.331738 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-06c4b4d1-3bc7-4288-97a9-89058cf2dd48 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] 10.222.0.17 "GET /compute/v2.1/servers/d6b9ea07-2ebd-4e1a-86f2-abb1bf581076" status: 200 len: 1656 microversion: 2.20 time: 0.119731 Jul 23 21:33:22.333475 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2466/4840] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:33:22 2022] GET /compute/v2.1/servers/d6b9ea07-2ebd-4e1a-86f2-abb1bf581076 => generated 1656 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:33:22.369509 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-5f4e3693-4d87-4109-80a3-009d902228fd tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:22.370439 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-5f4e3693-4d87-4109-80a3-009d902228fd tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:22.379272 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5f4e3693-4d87-4109-80a3-009d902228fd tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:22.379979 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5f4e3693-4d87-4109-80a3-009d902228fd tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:22.381294 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5f4e3693-4d87-4109-80a3-009d902228fd tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:22.381744 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5f4e3693-4d87-4109-80a3-009d902228fd tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:22.470913 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-5f4e3693-4d87-4109-80a3-009d902228fd tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:22.485235 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-5f4e3693-4d87-4109-80a3-009d902228fd tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:22.489368 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-5f4e3693-4d87-4109-80a3-009d902228fd tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:22.490765 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-5f4e3693-4d87-4109-80a3-009d902228fd tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.126004 Jul 23 21:33:22.491585 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2467/4841] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:33:22 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:33:22.754445 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-c5077219-5c39-4b20-a1ed-e2a8fea17dc2 req-18d1b50f-934f-4640-ad21-e6d923cc2314 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6b9ea07-2ebd-4e1a-86f2-abb1bf581076", "name": "network-vif-deleted", "tag": "d1ebc2ac-80d0-4761-8a8b-958b5aadb724"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:33:22.791477 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-c5077219-5c39-4b20-a1ed-e2a8fea17dc2 req-18d1b50f-934f-4640-ad21-e6d923cc2314 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:22.791926 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-c5077219-5c39-4b20-a1ed-e2a8fea17dc2 req-18d1b50f-934f-4640-ad21-e6d923cc2314 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:22.808440 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-c5077219-5c39-4b20-a1ed-e2a8fea17dc2 req-18d1b50f-934f-4640-ad21-e6d923cc2314 service nova] Creating event network-vif-deleted:d1ebc2ac-80d0-4761-8a8b-958b5aadb724 for instance d6b9ea07-2ebd-4e1a-86f2-abb1bf581076 on nch1-master-1 Jul 23 21:33:22.817763 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-c5077219-5c39-4b20-a1ed-e2a8fea17dc2 req-18d1b50f-934f-4640-ad21-e6d923cc2314 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066946 Jul 23 21:33:22.818780 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2468/4842] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:33:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:33:23.094759 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-cccbe0b9-a6e6-4ffb-a106-ee8921c02da9 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Getting quotas for project 6f1825873b0849ea98136c0979b251c4. Resources: dict_keys(['metadata_items']) {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:33:23.104875 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-cccbe0b9-a6e6-4ffb-a106-ee8921c02da9 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Getting quotas for user 47bdbd5d201c465a82540c1d8c0fdf57 and project 6f1825873b0849ea98136c0979b251c4. Resources: dict_keys(['metadata_items']) {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:33:23.129615 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-cccbe0b9-a6e6-4ffb-a106-ee8921c02da9 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:33:23.130412 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-cccbe0b9-a6e6-4ffb-a106-ee8921c02da9 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:33:23.130545 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-0533a481-6309-41ee-aaff-6a11d0d1bbbd tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:23.131131 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-0533a481-6309-41ee-aaff-6a11d0d1bbbd tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] [instance: 0352d36b-f7b0-4c09-8517-a5711438d586] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:23.133368 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-cccbe0b9-a6e6-4ffb-a106-ee8921c02da9 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:33:23.133993 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-cccbe0b9-a6e6-4ffb-a106-ee8921c02da9 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:33:23.134608 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-cccbe0b9-a6e6-4ffb-a106-ee8921c02da9 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:33:23.144966 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cccbe0b9-a6e6-4ffb-a106-ee8921c02da9 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:23.145717 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cccbe0b9-a6e6-4ffb-a106-ee8921c02da9 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:23.146740 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cccbe0b9-a6e6-4ffb-a106-ee8921c02da9 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:23.147459 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cccbe0b9-a6e6-4ffb-a106-ee8921c02da9 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:23.151613 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0533a481-6309-41ee-aaff-6a11d0d1bbbd tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:23.152131 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0533a481-6309-41ee-aaff-6a11d0d1bbbd tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:23.152972 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0533a481-6309-41ee-aaff-6a11d0d1bbbd tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:23.153589 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0533a481-6309-41ee-aaff-6a11d0d1bbbd tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:23.170174 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-cccbe0b9-a6e6-4ffb-a106-ee8921c02da9 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Getting quotas for project 6f1825873b0849ea98136c0979b251c4. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:33:23.176281 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-cccbe0b9-a6e6-4ffb-a106-ee8921c02da9 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Getting quotas for user 47bdbd5d201c465a82540c1d8c0fdf57 and project 6f1825873b0849ea98136c0979b251c4. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:33:23.190275 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-cccbe0b9-a6e6-4ffb-a106-ee8921c02da9 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Going to run 1 instances... {{(pid=131320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:33:23.192944 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-cccbe0b9-a6e6-4ffb-a106-ee8921c02da9 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] [instance: f9976c66-cc8b-45a6-b7f1-182c2abeb0ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:33:23.306730 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-cccbe0b9-a6e6-4ffb-a106-ee8921c02da9 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.866333 Jul 23 21:33:23.308687 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2375/4843] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:33:21 2022] POST /compute/v2.1/servers => generated 406 bytes in 1880 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 23 21:33:23.316714 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-0533a481-6309-41ee-aaff-6a11d0d1bbbd tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:23.331232 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0549032f-7c28-4f5f-a9c4-03860d465659 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:23.332240 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-0533a481-6309-41ee-aaff-6a11d0d1bbbd tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:23.333246 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-0549032f-7c28-4f5f-a9c4-03860d465659 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] [instance: f9976c66-cc8b-45a6-b7f1-182c2abeb0ac] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:23.339181 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-0533a481-6309-41ee-aaff-6a11d0d1bbbd tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:23.340929 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-0533a481-6309-41ee-aaff-6a11d0d1bbbd tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] 10.222.0.17 "GET /compute/v2.1/servers/0352d36b-f7b0-4c09-8517-a5711438d586" status: 200 len: 1366 microversion: 2.57 time: 0.215805 Jul 23 21:33:23.342075 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2469/4844] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:33:23 2022] GET /compute/v2.1/servers/0352d36b-f7b0-4c09-8517-a5711438d586 => generated 1366 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:33:23.352597 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-2120fbb8-8f44-4fc4-a5de-9af3101f3e5f tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:23.353925 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-2120fbb8-8f44-4fc4-a5de-9af3101f3e5f tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] [instance: d6b9ea07-2ebd-4e1a-86f2-abb1bf581076] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:23.376544 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2120fbb8-8f44-4fc4-a5de-9af3101f3e5f tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:23.377392 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2120fbb8-8f44-4fc4-a5de-9af3101f3e5f tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:23.378470 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2120fbb8-8f44-4fc4-a5de-9af3101f3e5f tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:23.379110 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2120fbb8-8f44-4fc4-a5de-9af3101f3e5f tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:23.479244 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2120fbb8-8f44-4fc4-a5de-9af3101f3e5f tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:23.479697 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2120fbb8-8f44-4fc4-a5de-9af3101f3e5f tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:23.481578 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.objects.instance [None req-2120fbb8-8f44-4fc4-a5de-9af3101f3e5f tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lazy-loading 'fault' on Instance uuid d6b9ea07-2ebd-4e1a-86f2-abb1bf581076 {{(pid=131321) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:33:23.598873 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-2120fbb8-8f44-4fc4-a5de-9af3101f3e5f tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:23.611319 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-2120fbb8-8f44-4fc4-a5de-9af3101f3e5f tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:23.616511 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-2120fbb8-8f44-4fc4-a5de-9af3101f3e5f tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:23.618790 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-2120fbb8-8f44-4fc4-a5de-9af3101f3e5f tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] 10.222.0.17 "GET /compute/v2.1/servers/d6b9ea07-2ebd-4e1a-86f2-abb1bf581076" status: 200 len: 1372 microversion: 2.20 time: 0.271256 Jul 23 21:33:23.625420 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2470/4845] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:33:23 2022] GET /compute/v2.1/servers/d6b9ea07-2ebd-4e1a-86f2-abb1bf581076 => generated 1372 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:33:23.638520 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-60cab811-8f21-4165-9f1a-43f1cc75559c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:23.639553 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-60cab811-8f21-4165-9f1a-43f1cc75559c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:23.648757 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-60cab811-8f21-4165-9f1a-43f1cc75559c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:23.651216 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-60cab811-8f21-4165-9f1a-43f1cc75559c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:23.654675 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-60cab811-8f21-4165-9f1a-43f1cc75559c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:23.655135 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-60cab811-8f21-4165-9f1a-43f1cc75559c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:23.661034 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-0549032f-7c28-4f5f-a9c4-03860d465659 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47bdbd5d201c465a82540c1d8c0fdf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f1825873b0849ea98136c0979b251c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:23.843849 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-60cab811-8f21-4165-9f1a-43f1cc75559c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:23.865159 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-60cab811-8f21-4165-9f1a-43f1cc75559c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:23.876444 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-60cab811-8f21-4165-9f1a-43f1cc75559c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:23.881219 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-60cab811-8f21-4165-9f1a-43f1cc75559c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.254376 Jul 23 21:33:23.885390 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2471/4846] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:33:23 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:33:24.259311 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-0549032f-7c28-4f5f-a9c4-03860d465659 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] 10.222.0.17 "GET /compute/v2.1/servers/f9976c66-cc8b-45a6-b7f1-182c2abeb0ac" status: 200 len: 1301 microversion: 2.1 time: 0.942733 Jul 23 21:33:24.261164 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2376/4847] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:33:23 2022] GET /compute/v2.1/servers/f9976c66-cc8b-45a6-b7f1-182c2abeb0ac => generated 1301 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:33:24.368119 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ba7d5bfe-5153-4d60-b926-5d4d88db6dc8 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:24.368748 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-ba7d5bfe-5153-4d60-b926-5d4d88db6dc8 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] [instance: 0352d36b-f7b0-4c09-8517-a5711438d586] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:24.379473 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ba7d5bfe-5153-4d60-b926-5d4d88db6dc8 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:24.379932 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ba7d5bfe-5153-4d60-b926-5d4d88db6dc8 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:24.380728 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ba7d5bfe-5153-4d60-b926-5d4d88db6dc8 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:24.381179 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ba7d5bfe-5153-4d60-b926-5d4d88db6dc8 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:24.556841 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ba7d5bfe-5153-4d60-b926-5d4d88db6dc8 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:24.574982 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ba7d5bfe-5153-4d60-b926-5d4d88db6dc8 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:24.578908 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ba7d5bfe-5153-4d60-b926-5d4d88db6dc8 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:24.580168 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-ba7d5bfe-5153-4d60-b926-5d4d88db6dc8 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] 10.222.0.17 "GET /compute/v2.1/servers/0352d36b-f7b0-4c09-8517-a5711438d586" status: 200 len: 1366 microversion: 2.57 time: 0.218064 Jul 23 21:33:24.583036 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2472/4848] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:33:24 2022] GET /compute/v2.1/servers/0352d36b-f7b0-4c09-8517-a5711438d586 => generated 1366 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:33:24.648692 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-06b94d8a-0b75-4647-865f-92536ed98cc2 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:24.649631 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-06b94d8a-0b75-4647-865f-92536ed98cc2 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] [instance: d6b9ea07-2ebd-4e1a-86f2-abb1bf581076] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:24.671298 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-06b94d8a-0b75-4647-865f-92536ed98cc2 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:24.671679 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-06b94d8a-0b75-4647-865f-92536ed98cc2 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:24.672486 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-06b94d8a-0b75-4647-865f-92536ed98cc2 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:24.672939 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-06b94d8a-0b75-4647-865f-92536ed98cc2 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:24.699663 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-06b94d8a-0b75-4647-865f-92536ed98cc2 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] HTTP exception thrown: Instance d6b9ea07-2ebd-4e1a-86f2-abb1bf581076 could not be found. Jul 23 21:33:24.712983 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-06b94d8a-0b75-4647-865f-92536ed98cc2 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Request method failure captured: Jul 23 21:33:24.712983 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/d6b9ea07-2ebd-4e1a-86f2-abb1bf581076 HTTP/1.1 Jul 23 21:33:24.712983 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:33:24.712983 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:33:24.712983 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:33:24.712983 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:33:24.712983 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:33:24.712983 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:33:24.712983 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:33:24.712983 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:33:24.712983 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GjR_0O6GBCiuxjDMiEyfVqYI1YKbSgNPPzxoIkrVy_FrrUjrWzvyNvEkXtlLAGAMMOkrqI-Zveal9DamR6iACXxUi-dpsTsmcAkFx41oWYSzBCiL5Kch14hOD4rlvYY_pz_x10LAqvx_qIUvQaBJMJHMyRtqH48pEnd-OgJDqLi-YE Jul 23 21:33:24.712983 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:33:24.712983 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:33:24.712983 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:33:24.712983 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:33:24.712983 ncdv-master-1 devstack@n-api.service[131320]: X-Openstack-Nova-Api-Version: 2.20 Jul 23 21:33:24.712983 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:33:24.712983 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:33:24.712983 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 49da2dec096c474199da94d7c7a83258 Jul 23 21:33:24.712983 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1512806459 Jul 23 21:33:24.712983 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:33:24.712983 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:33:24.712983 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/49da2dec096c474199da94d7c7a83258"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/49da2dec096c474199da94d7c7a83258"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_49da2dec096c474199da94d7c7a83258", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/49da2dec096c474199da94d7c7a83258"}]}] Jul 23 21:33:24.712983 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1512806459 Jul 23 21:33:24.712983 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 49da2dec096c474199da94d7c7a83258 Jul 23 21:33:24.712983 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1512806459 Jul 23 21:33:24.712983 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-AttachVolumeShelveTestJSON-1512806459-project Jul 23 21:33:24.712983 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:33:24.712983 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:33:24.712983 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 048f5756139b4283b695c057647983ba Jul 23 21:33:24.712983 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1512806459-project Jul 23 21:33:24.712983 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:33:24.712983 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance d6b9ea07-2ebd-4e1a-86f2-abb1bf581076 could not be found. Jul 23 21:33:24.712983 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': 'd6b9ea07-2ebd-4e1a-86f2-abb1bf581076'} Jul 23 21:33:24.712983 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:33:24.712983 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:33:24.712983 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:33:24.712983 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:33:24.712983 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:33:24.712983 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:33:24.712983 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:33:24.712983 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:33:24.712983 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:33:24.712983 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:33:24.712983 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6b9ea07-2ebd-4e1a-86f2-abb1bf581076 could not be found. Jul 23 21:33:24.712983 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:24.712983 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:33:24.712983 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:24.712983 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:33:24.712983 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:33:24.712983 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:33:24.712983 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:33:24.712983 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:33:24.712983 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:33:24.712983 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:33:24.712983 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:33:24.712983 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:33:24.712983 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:33:24.712983 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:33:24.712983 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:33:24.712983 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:33:24.712983 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6b9ea07-2ebd-4e1a-86f2-abb1bf581076 could not be found. Jul 23 21:33:24.712983 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:24.712983 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:33:24.717664 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:24.717664 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:33:24.717664 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:33:24.717664 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:33:24.717664 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:33:24.717664 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:33:24.717664 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6b9ea07-2ebd-4e1a-86f2-abb1bf581076 could not be found. Jul 23 21:33:24.717664 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:24.718897 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-06b94d8a-0b75-4647-865f-92536ed98cc2 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Returning 404 to user: Instance d6b9ea07-2ebd-4e1a-86f2-abb1bf581076 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:33:24.719774 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-06b94d8a-0b75-4647-865f-92536ed98cc2 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] 10.222.0.17 "GET /compute/v2.1/servers/d6b9ea07-2ebd-4e1a-86f2-abb1bf581076" status: 404 len: 111 microversion: 2.20 time: 0.081111 Jul 23 21:33:24.730073 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-7742f31e-0eeb-4b42-b575-30d7d93c6bdb tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Calling method '.version_select at 0x7f0b470d3670>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:24.734300 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2377/4849] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:33:24 2022] GET /compute/v2.1/servers/d6b9ea07-2ebd-4e1a-86f2-abb1bf581076 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 23 21:33:24.739396 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:24.798602 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-7742f31e-0eeb-4b42-b575-30d7d93c6bdb tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1851525913" status: 204 len: 0 microversion: 2.20 time: 0.073464 Jul 23 21:33:24.799204 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2473/4850] 10.222.0.17 () {60 vars in 1261 bytes} [Sat Jul 23 21:33:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1851525913 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 23 21:33:24.903870 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b126f74f-9e9e-480d-9a46-157c80af60ad tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:24.904724 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b126f74f-9e9e-480d-9a46-157c80af60ad tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:24.924102 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b126f74f-9e9e-480d-9a46-157c80af60ad tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:24.924813 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b126f74f-9e9e-480d-9a46-157c80af60ad tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:24.925799 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b126f74f-9e9e-480d-9a46-157c80af60ad tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:24.926422 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b126f74f-9e9e-480d-9a46-157c80af60ad tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:25.060844 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b126f74f-9e9e-480d-9a46-157c80af60ad tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:25.072859 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b126f74f-9e9e-480d-9a46-157c80af60ad tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:25.075233 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b126f74f-9e9e-480d-9a46-157c80af60ad tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:25.077391 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b126f74f-9e9e-480d-9a46-157c80af60ad tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.177028 Jul 23 21:33:25.078492 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2378/4851] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:33:24 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:33:25.284028 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-045d8dcb-e78c-44ea-92c4-d29fdd8042b1 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:25.284977 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-045d8dcb-e78c-44ea-92c4-d29fdd8042b1 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] [instance: f9976c66-cc8b-45a6-b7f1-182c2abeb0ac] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:25.292008 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-045d8dcb-e78c-44ea-92c4-d29fdd8042b1 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:25.292473 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-045d8dcb-e78c-44ea-92c4-d29fdd8042b1 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:25.293273 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-045d8dcb-e78c-44ea-92c4-d29fdd8042b1 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:25.300754 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-045d8dcb-e78c-44ea-92c4-d29fdd8042b1 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:25.456645 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-045d8dcb-e78c-44ea-92c4-d29fdd8042b1 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47bdbd5d201c465a82540c1d8c0fdf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f1825873b0849ea98136c0979b251c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:25.465779 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-045d8dcb-e78c-44ea-92c4-d29fdd8042b1 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] 10.222.0.17 "GET /compute/v2.1/servers/f9976c66-cc8b-45a6-b7f1-182c2abeb0ac" status: 200 len: 1353 microversion: 2.1 time: 0.186076 Jul 23 21:33:25.466645 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2474/4852] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:33:25 2022] GET /compute/v2.1/servers/f9976c66-cc8b-45a6-b7f1-182c2abeb0ac => generated 1353 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:33:25.600995 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5765ab1d-8475-44d7-b45b-c9fef55084c4 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:25.603144 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5765ab1d-8475-44d7-b45b-c9fef55084c4 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] [instance: 0352d36b-f7b0-4c09-8517-a5711438d586] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:25.611905 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5765ab1d-8475-44d7-b45b-c9fef55084c4 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:25.613424 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5765ab1d-8475-44d7-b45b-c9fef55084c4 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:25.615211 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5765ab1d-8475-44d7-b45b-c9fef55084c4 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:25.615899 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5765ab1d-8475-44d7-b45b-c9fef55084c4 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:25.698432 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5765ab1d-8475-44d7-b45b-c9fef55084c4 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:25.712959 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5765ab1d-8475-44d7-b45b-c9fef55084c4 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:25.715126 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5765ab1d-8475-44d7-b45b-c9fef55084c4 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:25.716717 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5765ab1d-8475-44d7-b45b-c9fef55084c4 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] 10.222.0.17 "GET /compute/v2.1/servers/0352d36b-f7b0-4c09-8517-a5711438d586" status: 200 len: 1372 microversion: 2.57 time: 0.119772 Jul 23 21:33:25.730250 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2379/4853] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:33:25 2022] GET /compute/v2.1/servers/0352d36b-f7b0-4c09-8517-a5711438d586 => generated 1372 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:33:26.110715 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8ff38c23-e0b0-4c32-affd-18e9d0b8326c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:26.112272 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-9a0de35a-1023-4982-8435-bff2618781f6 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1653446204", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a7a4d3a1-2c94-480e-8528-bb4fc0917bb3"}], "security_groups": [{"name": "tempest-securitygroup--33482377"}], "key_name": "tempest-keypair-1155814123", "user_data": "}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:33:26.116082 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8ff38c23-e0b0-4c32-affd-18e9d0b8326c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:26.147671 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8ff38c23-e0b0-4c32-affd-18e9d0b8326c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:26.148623 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8ff38c23-e0b0-4c32-affd-18e9d0b8326c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:26.149643 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8ff38c23-e0b0-4c32-affd-18e9d0b8326c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:26.150295 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8ff38c23-e0b0-4c32-affd-18e9d0b8326c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:26.344227 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8ff38c23-e0b0-4c32-affd-18e9d0b8326c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:26.358331 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8ff38c23-e0b0-4c32-affd-18e9d0b8326c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:26.364269 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8ff38c23-e0b0-4c32-affd-18e9d0b8326c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:26.366141 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8ff38c23-e0b0-4c32-affd-18e9d0b8326c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.273308 Jul 23 21:33:26.385012 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2380/4854] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:33:26 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:33:26.484195 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-fc803b9a-ec88-457b-89a5-d09f0b8ddb40 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:26.485079 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-fc803b9a-ec88-457b-89a5-d09f0b8ddb40 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] [instance: f9976c66-cc8b-45a6-b7f1-182c2abeb0ac] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:26.488654 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:26.492609 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fc803b9a-ec88-457b-89a5-d09f0b8ddb40 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:26.493058 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fc803b9a-ec88-457b-89a5-d09f0b8ddb40 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:26.494043 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fc803b9a-ec88-457b-89a5-d09f0b8ddb40 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:26.494672 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fc803b9a-ec88-457b-89a5-d09f0b8ddb40 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:26.506968 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.network.neutron [None req-9a0de35a-1023-4982-8435-bff2618781f6 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] validate_networks() for [('a7a4d3a1-2c94-480e-8528-bb4fc0917bb3', None, None, None, None, None)] {{(pid=131321) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:33:26.584706 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-fc803b9a-ec88-457b-89a5-d09f0b8ddb40 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47bdbd5d201c465a82540c1d8c0fdf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f1825873b0849ea98136c0979b251c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:26.596006 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-fc803b9a-ec88-457b-89a5-d09f0b8ddb40 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] 10.222.0.17 "GET /compute/v2.1/servers/f9976c66-cc8b-45a6-b7f1-182c2abeb0ac" status: 200 len: 1359 microversion: 2.1 time: 0.116336 Jul 23 21:33:26.597336 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2381/4855] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:33:26 2022] GET /compute/v2.1/servers/f9976c66-cc8b-45a6-b7f1-182c2abeb0ac => generated 1359 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:33:26.737141 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5c73705b-0392-4ada-99cf-b6ab5a4ac163 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:26.737818 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5c73705b-0392-4ada-99cf-b6ab5a4ac163 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] [instance: 0352d36b-f7b0-4c09-8517-a5711438d586] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:26.747702 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5c73705b-0392-4ada-99cf-b6ab5a4ac163 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:26.747920 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5c73705b-0392-4ada-99cf-b6ab5a4ac163 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:26.748689 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5c73705b-0392-4ada-99cf-b6ab5a4ac163 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:26.749302 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5c73705b-0392-4ada-99cf-b6ab5a4ac163 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:26.912860 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5c73705b-0392-4ada-99cf-b6ab5a4ac163 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:26.923116 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5c73705b-0392-4ada-99cf-b6ab5a4ac163 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:26.925146 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5c73705b-0392-4ada-99cf-b6ab5a4ac163 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:26.926366 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5c73705b-0392-4ada-99cf-b6ab5a4ac163 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] 10.222.0.17 "GET /compute/v2.1/servers/0352d36b-f7b0-4c09-8517-a5711438d586" status: 200 len: 1372 microversion: 2.57 time: 0.193446 Jul 23 21:33:26.941810 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2382/4856] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:33:26 2022] GET /compute/v2.1/servers/0352d36b-f7b0-4c09-8517-a5711438d586 => generated 1372 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:33:27.386446 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ad2a6652-e29e-4c3d-a32e-807092f10326 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:27.387338 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ad2a6652-e29e-4c3d-a32e-807092f10326 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:27.394713 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ad2a6652-e29e-4c3d-a32e-807092f10326 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:27.395695 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ad2a6652-e29e-4c3d-a32e-807092f10326 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:27.396720 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ad2a6652-e29e-4c3d-a32e-807092f10326 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:27.397230 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ad2a6652-e29e-4c3d-a32e-807092f10326 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:27.496713 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ad2a6652-e29e-4c3d-a32e-807092f10326 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:27.528272 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ad2a6652-e29e-4c3d-a32e-807092f10326 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:27.532084 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ad2a6652-e29e-4c3d-a32e-807092f10326 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:27.536218 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ad2a6652-e29e-4c3d-a32e-807092f10326 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.154311 Jul 23 21:33:27.552011 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2383/4857] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:33:27 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:33:27.563119 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ca965623-414c-409a-9005-d3429e367287 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Action: 'create', calling method: .version_select at 0x7f0b47d08160>, body: {"keypair": {"name": "tempest-keypair-312135291", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1pA8MnHDHASqkjwvmcxWEEQB2FA17a3mJt1iBa3w6NcNndleQeEtjZZI9QR8nGI/z5cdiMTu6ry/UOVECdCkfAdsDqwvLbA3o+ELxEnLVKOAE5Upk/cG7Zv8mxWR/oCw=="}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:33:27.611770 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-9a0de35a-1023-4982-8435-bff2618781f6 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Flavor limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:33:27.612875 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-9a0de35a-1023-4982-8435-bff2618781f6 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Image limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:33:27.617010 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-9a0de35a-1023-4982-8435-bff2618781f6 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Flavor pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:33:27.620552 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-9a0de35a-1023-4982-8435-bff2618781f6 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Image pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:33:27.620965 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-9a0de35a-1023-4982-8435-bff2618781f6 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:33:27.628631 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-ca965623-414c-409a-9005-d3429e367287 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Getting quotas for project 49da2dec096c474199da94d7c7a83258. Resources: {'key_pairs'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:33:27.644931 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9a0de35a-1023-4982-8435-bff2618781f6 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:27.645386 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9a0de35a-1023-4982-8435-bff2618781f6 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:27.648281 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-ca965623-414c-409a-9005-d3429e367287 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Getting quotas for user 048f5756139b4283b695c057647983ba and project 49da2dec096c474199da94d7c7a83258. Resources: {'key_pairs'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:33:27.656302 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9a0de35a-1023-4982-8435-bff2618781f6 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:27.656758 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9a0de35a-1023-4982-8435-bff2618781f6 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:27.703221 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ca965623-414c-409a-9005-d3429e367287 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.149405 Jul 23 21:33:27.703845 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2384/4858] 10.222.0.17 () {62 vars in 1199 bytes} [Sat Jul 23 21:33:27 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 151 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 23 21:33:27.707429 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-9a0de35a-1023-4982-8435-bff2618781f6 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Getting quotas for project 6bc1475019924837a8be47347f6bbd75. Resources: {'ram', 'instances', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:33:27.714721 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1380bc14-6b45-40af-8285-0f8dce6c0b1d tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:27.714721 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1380bc14-6b45-40af-8285-0f8dce6c0b1d tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] [instance: f9976c66-cc8b-45a6-b7f1-182c2abeb0ac] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:27.723127 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1380bc14-6b45-40af-8285-0f8dce6c0b1d tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:27.723590 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1380bc14-6b45-40af-8285-0f8dce6c0b1d tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:27.724379 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1380bc14-6b45-40af-8285-0f8dce6c0b1d tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:27.724826 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1380bc14-6b45-40af-8285-0f8dce6c0b1d tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:27.743017 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-9a0de35a-1023-4982-8435-bff2618781f6 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Getting quotas for user bc4aa131e63349b2aa8f37fdf6d2fe00 and project 6bc1475019924837a8be47347f6bbd75. Resources: {'ram', 'instances', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:33:27.784800 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-9a0de35a-1023-4982-8435-bff2618781f6 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Going to run 1 instances... {{(pid=131321) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:33:27.791292 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-9a0de35a-1023-4982-8435-bff2618781f6 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] [instance: bdade0fb-93ef-41ad-8079-a26f353871f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131321) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:33:27.888042 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-9a0de35a-1023-4982-8435-bff2618781f6 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.803468 Jul 23 21:33:27.888715 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2475/4859] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:33:26 2022] POST /compute/v2.1/servers => generated 400 bytes in 1805 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 23 21:33:27.903312 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-0b16385e-bb8f-4f91-a84c-56bccc163fc9 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:27.904092 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-0b16385e-bb8f-4f91-a84c-56bccc163fc9 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] [instance: bdade0fb-93ef-41ad-8079-a26f353871f4] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:28.061892 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-0b16385e-bb8f-4f91-a84c-56bccc163fc9 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc4aa131e63349b2aa8f37fdf6d2fe00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc1475019924837a8be47347f6bbd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:28.079105 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-0b16385e-bb8f-4f91-a84c-56bccc163fc9 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] 10.222.0.17 "GET /compute/v2.1/servers/bdade0fb-93ef-41ad-8079-a26f353871f4" status: 200 len: 1238 microversion: 2.1 time: 0.184092 Jul 23 21:33:28.082518 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2476/4860] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:33:27 2022] GET /compute/v2.1/servers/bdade0fb-93ef-41ad-8079-a26f353871f4 => generated 1238 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:33:28.108760 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-6587f956-7b5f-4b05-861e-a6dae77b8899 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:28.114913 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-6587f956-7b5f-4b05-861e-a6dae77b8899 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] [instance: 0352d36b-f7b0-4c09-8517-a5711438d586] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:28.141628 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6587f956-7b5f-4b05-861e-a6dae77b8899 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:28.147677 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6587f956-7b5f-4b05-861e-a6dae77b8899 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:28.148638 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6587f956-7b5f-4b05-861e-a6dae77b8899 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:28.149092 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6587f956-7b5f-4b05-861e-a6dae77b8899 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:28.209150 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-1380bc14-6b45-40af-8285-0f8dce6c0b1d tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47bdbd5d201c465a82540c1d8c0fdf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f1825873b0849ea98136c0979b251c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:28.226601 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1380bc14-6b45-40af-8285-0f8dce6c0b1d tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] 10.222.0.17 "GET /compute/v2.1/servers/f9976c66-cc8b-45a6-b7f1-182c2abeb0ac" status: 200 len: 1427 microversion: 2.1 time: 0.513035 Jul 23 21:33:28.235899 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2385/4861] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:33:27 2022] GET /compute/v2.1/servers/f9976c66-cc8b-45a6-b7f1-182c2abeb0ac => generated 1427 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:33:28.235899 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ec2d2b40-60e7-4479-994f-a6f87adc5307 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] Calling method '.version_select at 0x7f0b46620040>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:28.270471 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ec2d2b40-60e7-4479-994f-a6f87adc5307 tempest-TestSecurityGroupsBasicOps-820000053 tempest-TestSecurityGroupsBasicOps-820000053-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1067306574" status: 202 len: 0 microversion: 2.1 time: 0.041207 Jul 23 21:33:28.274525 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2386/4862] 10.222.0.17 () {58 vars in 1277 bytes} [Sat Jul 23 21:33:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1067306574 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:33:28.377601 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-6587f956-7b5f-4b05-861e-a6dae77b8899 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:28.397600 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-6587f956-7b5f-4b05-861e-a6dae77b8899 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:28.417065 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-6587f956-7b5f-4b05-861e-a6dae77b8899 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:28.418407 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-6587f956-7b5f-4b05-861e-a6dae77b8899 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] 10.222.0.17 "GET /compute/v2.1/servers/0352d36b-f7b0-4c09-8517-a5711438d586" status: 200 len: 1357 microversion: 2.57 time: 0.332003 Jul 23 21:33:28.425772 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2477/4863] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:33:28 2022] GET /compute/v2.1/servers/0352d36b-f7b0-4c09-8517-a5711438d586 => generated 1357 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:33:28.454614 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6f6a7353-ab73-499d-b2d7-3d79b7ae6cd5 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:28.455136 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6f6a7353-ab73-499d-b2d7-3d79b7ae6cd5 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] [instance: 0352d36b-f7b0-4c09-8517-a5711438d586] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:28.471484 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6f6a7353-ab73-499d-b2d7-3d79b7ae6cd5 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:28.471958 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6f6a7353-ab73-499d-b2d7-3d79b7ae6cd5 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:28.472770 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6f6a7353-ab73-499d-b2d7-3d79b7ae6cd5 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:28.473219 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6f6a7353-ab73-499d-b2d7-3d79b7ae6cd5 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:28.510923 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6f6a7353-ab73-499d-b2d7-3d79b7ae6cd5 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] [instance: 0352d36b-f7b0-4c09-8517-a5711438d586] Going to try to terminate instance {{(pid=131320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:33:28.560198 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-25f7cb76-9673-4fce-bcdc-6afd4455f519 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:28.560872 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-25f7cb76-9673-4fce-bcdc-6afd4455f519 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:28.568793 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-25f7cb76-9673-4fce-bcdc-6afd4455f519 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:28.570471 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-25f7cb76-9673-4fce-bcdc-6afd4455f519 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:28.571667 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-25f7cb76-9673-4fce-bcdc-6afd4455f519 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:28.572826 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-25f7cb76-9673-4fce-bcdc-6afd4455f519 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:28.717496 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6f6a7353-ab73-499d-b2d7-3d79b7ae6cd5 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0352d36b-f7b0-4c09-8517-a5711438d586" status: 204 len: 0 microversion: 2.57 time: 0.266215 Jul 23 21:33:28.718769 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2387/4864] 10.222.0.17 () {60 vars in 1279 bytes} [Sat Jul 23 21:33:28 2022] DELETE /compute/v2.1/servers/0352d36b-f7b0-4c09-8517-a5711438d586 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 23 21:33:28.725647 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-25f7cb76-9673-4fce-bcdc-6afd4455f519 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:28.738289 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-25f7cb76-9673-4fce-bcdc-6afd4455f519 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:28.746623 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-25f7cb76-9673-4fce-bcdc-6afd4455f519 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:28.748033 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-25f7cb76-9673-4fce-bcdc-6afd4455f519 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.192503 Jul 23 21:33:28.748756 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3550e661-d64e-460e-9538-88eb7bb55c58 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:28.749465 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2478/4865] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:33:28 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:33:28.756006 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-3550e661-d64e-460e-9538-88eb7bb55c58 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] [instance: 0352d36b-f7b0-4c09-8517-a5711438d586] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:28.783528 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3550e661-d64e-460e-9538-88eb7bb55c58 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:28.786221 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3550e661-d64e-460e-9538-88eb7bb55c58 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:28.791080 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3550e661-d64e-460e-9538-88eb7bb55c58 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:28.791834 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3550e661-d64e-460e-9538-88eb7bb55c58 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:29.044580 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-3550e661-d64e-460e-9538-88eb7bb55c58 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:29.059101 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-3550e661-d64e-460e-9538-88eb7bb55c58 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:29.060639 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-3550e661-d64e-460e-9538-88eb7bb55c58 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:29.065402 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-3550e661-d64e-460e-9538-88eb7bb55c58 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] 10.222.0.17 "GET /compute/v2.1/servers/0352d36b-f7b0-4c09-8517-a5711438d586" status: 200 len: 1363 microversion: 2.57 time: 0.338474 Jul 23 21:33:29.067064 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2388/4866] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:33:28 2022] GET /compute/v2.1/servers/0352d36b-f7b0-4c09-8517-a5711438d586 => generated 1363 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:33:29.098657 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e7c3585d-2f05-4037-b455-cf668217c120 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:29.110482 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-e7c3585d-2f05-4037-b455-cf668217c120 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] [instance: bdade0fb-93ef-41ad-8079-a26f353871f4] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:29.127476 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e7c3585d-2f05-4037-b455-cf668217c120 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:29.127968 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e7c3585d-2f05-4037-b455-cf668217c120 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:29.128807 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e7c3585d-2f05-4037-b455-cf668217c120 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:29.129346 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e7c3585d-2f05-4037-b455-cf668217c120 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:29.229820 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-e7c3585d-2f05-4037-b455-cf668217c120 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc4aa131e63349b2aa8f37fdf6d2fe00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc1475019924837a8be47347f6bbd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:29.238039 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-e7c3585d-2f05-4037-b455-cf668217c120 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] 10.222.0.17 "GET /compute/v2.1/servers/bdade0fb-93ef-41ad-8079-a26f353871f4" status: 200 len: 1290 microversion: 2.1 time: 0.143222 Jul 23 21:33:29.243922 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-41864786-6538-4b86-ad68-5f4bf615b81e tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:29.244667 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-41864786-6538-4b86-ad68-5f4bf615b81e tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] [instance: f9976c66-cc8b-45a6-b7f1-182c2abeb0ac] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:29.251646 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-41864786-6538-4b86-ad68-5f4bf615b81e tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:29.251969 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2479/4867] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:33:29 2022] GET /compute/v2.1/servers/bdade0fb-93ef-41ad-8079-a26f353871f4 => generated 1290 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:33:29.252105 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-41864786-6538-4b86-ad68-5f4bf615b81e tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:29.252878 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-41864786-6538-4b86-ad68-5f4bf615b81e tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:29.253319 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-41864786-6538-4b86-ad68-5f4bf615b81e tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:29.585264 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-41864786-6538-4b86-ad68-5f4bf615b81e tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47bdbd5d201c465a82540c1d8c0fdf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f1825873b0849ea98136c0979b251c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:29.600545 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-41864786-6538-4b86-ad68-5f4bf615b81e tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] 10.222.0.17 "GET /compute/v2.1/servers/f9976c66-cc8b-45a6-b7f1-182c2abeb0ac" status: 200 len: 1427 microversion: 2.1 time: 0.361088 Jul 23 21:33:29.615133 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2389/4868] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:33:29 2022] GET /compute/v2.1/servers/f9976c66-cc8b-45a6-b7f1-182c2abeb0ac => generated 1427 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:33:29.772366 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e0a79403-385f-416a-977c-82ccd10abead tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:29.774845 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-e0a79403-385f-416a-977c-82ccd10abead tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:29.787803 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e0a79403-385f-416a-977c-82ccd10abead tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:29.788945 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e0a79403-385f-416a-977c-82ccd10abead tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:29.790395 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e0a79403-385f-416a-977c-82ccd10abead tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:29.791532 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e0a79403-385f-416a-977c-82ccd10abead tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:29.904416 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-e0a79403-385f-416a-977c-82ccd10abead tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:29.917187 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=100 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:29.924205 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-e0a79403-385f-416a-977c-82ccd10abead tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:29.928533 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-e0a79403-385f-416a-977c-82ccd10abead tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:29.931100 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-e0a79403-385f-416a-977c-82ccd10abead tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.165493 Jul 23 21:33:29.944170 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2480/4869] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:33:29 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:33:30.086743 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-87bb1012-f04e-4ed6-a954-cdc0a989f254 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:30.087921 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-87bb1012-f04e-4ed6-a954-cdc0a989f254 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] [instance: 0352d36b-f7b0-4c09-8517-a5711438d586] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:30.109178 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-87bb1012-f04e-4ed6-a954-cdc0a989f254 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:30.110166 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-87bb1012-f04e-4ed6-a954-cdc0a989f254 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:30.113276 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-87bb1012-f04e-4ed6-a954-cdc0a989f254 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:30.113979 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-87bb1012-f04e-4ed6-a954-cdc0a989f254 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:30.176870 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:30.248556 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-c86b9002-49e9-4b6b-848e-3c8c9227135a req-331af108-12f8-49d2-b8d2-f5cf75561e79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9976c66-cc8b-45a6-b7f1-182c2abeb0ac", "tag": "6423c43f-d175-49b4-bde9-bf2e2953e90c"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:33:30.260782 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-c86b9002-49e9-4b6b-848e-3c8c9227135a req-331af108-12f8-49d2-b8d2-f5cf75561e79 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:30.265530 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-c86b9002-49e9-4b6b-848e-3c8c9227135a req-331af108-12f8-49d2-b8d2-f5cf75561e79 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:30.285015 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-c86b9002-49e9-4b6b-848e-3c8c9227135a req-331af108-12f8-49d2-b8d2-f5cf75561e79 service nova] Creating event network-changed:6423c43f-d175-49b4-bde9-bf2e2953e90c for instance f9976c66-cc8b-45a6-b7f1-182c2abeb0ac on nch1-master-1 Jul 23 21:33:30.299288 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-c86b9002-49e9-4b6b-848e-3c8c9227135a req-331af108-12f8-49d2-b8d2-f5cf75561e79 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050001 Jul 23 21:33:30.300459 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2481/4870] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:33:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:33:30.307989 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-190d388e-92b0-4e6a-be05-a98eaa9d064b tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:30.309035 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-190d388e-92b0-4e6a-be05-a98eaa9d064b tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] [instance: bdade0fb-93ef-41ad-8079-a26f353871f4] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:30.321016 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-190d388e-92b0-4e6a-be05-a98eaa9d064b tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:30.321395 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-87bb1012-f04e-4ed6-a954-cdc0a989f254 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:30.322449 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-190d388e-92b0-4e6a-be05-a98eaa9d064b tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:30.323493 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-190d388e-92b0-4e6a-be05-a98eaa9d064b tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:30.324416 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-190d388e-92b0-4e6a-be05-a98eaa9d064b tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:30.337468 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-87bb1012-f04e-4ed6-a954-cdc0a989f254 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:30.343133 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-87bb1012-f04e-4ed6-a954-cdc0a989f254 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0400e69a5bee4dcc9b55cd38de32eb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '967b5ba16feb4b88bd4bacf0ec6194c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:30.345768 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-87bb1012-f04e-4ed6-a954-cdc0a989f254 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] 10.222.0.17 "GET /compute/v2.1/servers/0352d36b-f7b0-4c09-8517-a5711438d586" status: 200 len: 1363 microversion: 2.57 time: 0.263507 Jul 23 21:33:30.347363 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2390/4871] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:33:30 2022] GET /compute/v2.1/servers/0352d36b-f7b0-4c09-8517-a5711438d586 => generated 1363 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:33:30.561533 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-190d388e-92b0-4e6a-be05-a98eaa9d064b tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc4aa131e63349b2aa8f37fdf6d2fe00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc1475019924837a8be47347f6bbd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:30.574683 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-190d388e-92b0-4e6a-be05-a98eaa9d064b tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] 10.222.0.17 "GET /compute/v2.1/servers/bdade0fb-93ef-41ad-8079-a26f353871f4" status: 200 len: 1296 microversion: 2.1 time: 0.271889 Jul 23 21:33:30.589456 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2482/4872] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:33:30 2022] GET /compute/v2.1/servers/bdade0fb-93ef-41ad-8079-a26f353871f4 => generated 1296 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:33:30.623044 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d4817ef1-e534-4e23-bfec-e8ba9bc77c5b tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:30.623773 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d4817ef1-e534-4e23-bfec-e8ba9bc77c5b tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] [instance: f9976c66-cc8b-45a6-b7f1-182c2abeb0ac] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:30.635938 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d4817ef1-e534-4e23-bfec-e8ba9bc77c5b tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:30.636395 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d4817ef1-e534-4e23-bfec-e8ba9bc77c5b tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:30.637187 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d4817ef1-e534-4e23-bfec-e8ba9bc77c5b tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:30.640878 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d4817ef1-e534-4e23-bfec-e8ba9bc77c5b tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:30.906056 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f5f42900-519f-46ec-a1f9-97e0fb0d46c2 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1966704378", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "594800b0-aba9-4cae-b3b6-645faa446b0c"}], "security_groups": [{"name": "tempest-securitygroup--2061879292"}], "key_name": "tempest-keypair-312135291", "user_data": "}} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:33:31.064830 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d4817ef1-e534-4e23-bfec-e8ba9bc77c5b tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47bdbd5d201c465a82540c1d8c0fdf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f1825873b0849ea98136c0979b251c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:31.076544 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d4817ef1-e534-4e23-bfec-e8ba9bc77c5b tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] 10.222.0.17 "GET /compute/v2.1/servers/f9976c66-cc8b-45a6-b7f1-182c2abeb0ac" status: 200 len: 1427 microversion: 2.1 time: 0.457776 Jul 23 21:33:31.077331 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2391/4873] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:33:30 2022] GET /compute/v2.1/servers/f9976c66-cc8b-45a6-b7f1-182c2abeb0ac => generated 1427 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:33:31.084512 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d18e9c90-8682-4e35-a0a2-02d81e0a38f1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:31.085679 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d18e9c90-8682-4e35-a0a2-02d81e0a38f1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:31.095680 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d18e9c90-8682-4e35-a0a2-02d81e0a38f1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:31.096666 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d18e9c90-8682-4e35-a0a2-02d81e0a38f1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:31.097856 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d18e9c90-8682-4e35-a0a2-02d81e0a38f1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:31.098692 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d18e9c90-8682-4e35-a0a2-02d81e0a38f1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:31.133241 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.network.neutron [None req-f5f42900-519f-46ec-a1f9-97e0fb0d46c2 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] validate_networks() for [('594800b0-aba9-4cae-b3b6-645faa446b0c', None, None, None, None, None)] {{(pid=131321) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:33:31.233134 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d18e9c90-8682-4e35-a0a2-02d81e0a38f1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:31.249996 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d18e9c90-8682-4e35-a0a2-02d81e0a38f1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:31.252097 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d18e9c90-8682-4e35-a0a2-02d81e0a38f1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:31.253774 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d18e9c90-8682-4e35-a0a2-02d81e0a38f1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.175013 Jul 23 21:33:31.254831 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2392/4874] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:33:31 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:33:31.367822 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ecaad086-3444-4eda-be62-d439becd5ff4 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:31.368688 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ecaad086-3444-4eda-be62-d439becd5ff4 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] [instance: 0352d36b-f7b0-4c09-8517-a5711438d586] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:31.381845 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ecaad086-3444-4eda-be62-d439becd5ff4 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:31.385513 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ecaad086-3444-4eda-be62-d439becd5ff4 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:31.386501 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ecaad086-3444-4eda-be62-d439becd5ff4 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:31.387196 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ecaad086-3444-4eda-be62-d439becd5ff4 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:31.405992 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-ecaad086-3444-4eda-be62-d439becd5ff4 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] HTTP exception thrown: Instance 0352d36b-f7b0-4c09-8517-a5711438d586 could not be found. Jul 23 21:33:31.407950 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ecaad086-3444-4eda-be62-d439becd5ff4 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Request method failure captured: Jul 23 21:33:31.407950 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/0352d36b-f7b0-4c09-8517-a5711438d586 HTTP/1.1 Jul 23 21:33:31.407950 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:33:31.407950 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:33:31.407950 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:33:31.407950 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:33:31.407950 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:33:31.407950 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:33:31.407950 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:33:31.407950 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:33:31.407950 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GkAV6ngawGr_kPvhzqnysvJbUSi5zcitXNO8teedtHaTN4tNIk1u7PFk8aHQCL2diY9islxQ6rhYQov9noyc5aia9hx7J4bVJXU_HmV5nBfumRaNLMXfKPIv3Yugavnyk39-4sf9GzGbTKNbYvgBJZDmCrqiQX9ms4s2trlsn4yAow Jul 23 21:33:31.407950 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:33:31.407950 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:33:31.407950 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:33:31.407950 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:33:31.407950 ncdv-master-1 devstack@n-api.service[131320]: X-Openstack-Nova-Api-Version: 2.57 Jul 23 21:33:31.407950 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:33:31.407950 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:33:31.407950 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 967b5ba16feb4b88bd4bacf0ec6194c2 Jul 23 21:33:31.407950 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServerShowV257Test-2090099481 Jul 23 21:33:31.407950 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:33:31.407950 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:33:31.407950 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/967b5ba16feb4b88bd4bacf0ec6194c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/967b5ba16feb4b88bd4bacf0ec6194c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_967b5ba16feb4b88bd4bacf0ec6194c2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/967b5ba16feb4b88bd4bacf0ec6194c2"}]}] Jul 23 21:33:31.407950 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServerShowV257Test-2090099481 Jul 23 21:33:31.407950 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 967b5ba16feb4b88bd4bacf0ec6194c2 Jul 23 21:33:31.407950 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServerShowV257Test-2090099481 Jul 23 21:33:31.407950 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServerShowV257Test-2090099481-project Jul 23 21:33:31.407950 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:33:31.407950 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:33:31.407950 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 0400e69a5bee4dcc9b55cd38de32eb76 Jul 23 21:33:31.407950 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServerShowV257Test-2090099481-project Jul 23 21:33:31.407950 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:33:31.407950 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance 0352d36b-f7b0-4c09-8517-a5711438d586 could not be found. Jul 23 21:33:31.407950 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '0352d36b-f7b0-4c09-8517-a5711438d586'} Jul 23 21:33:31.407950 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:33:31.407950 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:33:31.407950 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:33:31.407950 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:33:31.407950 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:33:31.407950 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:33:31.407950 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:33:31.407950 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:33:31.407950 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:33:31.407950 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:33:31.407950 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0352d36b-f7b0-4c09-8517-a5711438d586 could not be found. Jul 23 21:33:31.407950 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:31.407950 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:33:31.407950 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:31.407950 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:33:31.407950 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:33:31.407950 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:33:31.407950 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:33:31.407950 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:33:31.407950 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:33:31.407950 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:33:31.407950 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:33:31.407950 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:33:31.407950 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:33:31.407950 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:33:31.407950 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:33:31.407950 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:33:31.407950 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0352d36b-f7b0-4c09-8517-a5711438d586 could not be found. Jul 23 21:33:31.407950 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:31.407950 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:33:31.407950 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:31.412717 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:33:31.412717 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:33:31.412717 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:33:31.412717 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:33:31.412717 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:33:31.412717 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0352d36b-f7b0-4c09-8517-a5711438d586 could not be found. Jul 23 21:33:31.412717 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:31.412717 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ecaad086-3444-4eda-be62-d439becd5ff4 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] Returning 404 to user: Instance 0352d36b-f7b0-4c09-8517-a5711438d586 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:33:31.412717 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ecaad086-3444-4eda-be62-d439becd5ff4 tempest-ServerShowV257Test-2090099481 tempest-ServerShowV257Test-2090099481-project] 10.222.0.17 "GET /compute/v2.1/servers/0352d36b-f7b0-4c09-8517-a5711438d586" status: 404 len: 111 microversion: 2.57 time: 0.047273 Jul 23 21:33:31.412717 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2393/4875] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:33:31 2022] GET /compute/v2.1/servers/0352d36b-f7b0-4c09-8517-a5711438d586 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 23 21:33:31.594023 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8a58a1de-d9d6-4839-9a2f-fc5397be3ebb tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:31.594635 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8a58a1de-d9d6-4839-9a2f-fc5397be3ebb tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] [instance: bdade0fb-93ef-41ad-8079-a26f353871f4] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:31.601189 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8a58a1de-d9d6-4839-9a2f-fc5397be3ebb tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:31.602241 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8a58a1de-d9d6-4839-9a2f-fc5397be3ebb tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:31.603175 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8a58a1de-d9d6-4839-9a2f-fc5397be3ebb tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:31.603793 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8a58a1de-d9d6-4839-9a2f-fc5397be3ebb tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:32.161415 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-f5f42900-519f-46ec-a1f9-97e0fb0d46c2 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Flavor limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:33:32.162232 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-f5f42900-519f-46ec-a1f9-97e0fb0d46c2 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Image limits 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:33:32.162981 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-f5f42900-519f-46ec-a1f9-97e0fb0d46c2 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Flavor pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:33:32.163639 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-f5f42900-519f-46ec-a1f9-97e0fb0d46c2 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Image pref 0:0:0 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:33:32.164443 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.virt.hardware [None req-f5f42900-519f-46ec-a1f9-97e0fb0d46c2 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131321) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:33:32.184771 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f5f42900-519f-46ec-a1f9-97e0fb0d46c2 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:32.185743 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f5f42900-519f-46ec-a1f9-97e0fb0d46c2 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:32.191924 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f5f42900-519f-46ec-a1f9-97e0fb0d46c2 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:32.193395 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f5f42900-519f-46ec-a1f9-97e0fb0d46c2 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:32.214289 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-f5f42900-519f-46ec-a1f9-97e0fb0d46c2 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Getting quotas for project 49da2dec096c474199da94d7c7a83258. Resources: {'ram', 'instances', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:33:32.220811 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.quota [None req-f5f42900-519f-46ec-a1f9-97e0fb0d46c2 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Getting quotas for user 048f5756139b4283b695c057647983ba and project 49da2dec096c474199da94d7c7a83258. Resources: {'ram', 'instances', 'cores'} {{(pid=131321) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:33:32.236286 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-f5f42900-519f-46ec-a1f9-97e0fb0d46c2 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Going to run 1 instances... {{(pid=131321) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:33:32.240062 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-f5f42900-519f-46ec-a1f9-97e0fb0d46c2 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] [instance: 7cf33651-7d81-4943-8ec4-182097c73de0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131321) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:33:32.313828 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-f5f42900-519f-46ec-a1f9-97e0fb0d46c2 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.415101 Jul 23 21:33:32.317329 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2483/4876] 10.222.0.17 () {62 vars in 1187 bytes} [Sat Jul 23 21:33:30 2022] POST /compute/v2.1/servers => generated 402 bytes in 1420 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 23 21:33:32.323085 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-1aa6c208-ceba-441b-a7c8-1116231bf572 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:32.324087 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-1aa6c208-ceba-441b-a7c8-1116231bf572 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] [instance: f9976c66-cc8b-45a6-b7f1-182c2abeb0ac] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:32.333269 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1aa6c208-ceba-441b-a7c8-1116231bf572 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:32.333931 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1aa6c208-ceba-441b-a7c8-1116231bf572 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:32.335161 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1aa6c208-ceba-441b-a7c8-1116231bf572 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:32.336112 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1aa6c208-ceba-441b-a7c8-1116231bf572 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:32.499024 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8a58a1de-d9d6-4839-9a2f-fc5397be3ebb tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc4aa131e63349b2aa8f37fdf6d2fe00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc1475019924837a8be47347f6bbd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:32.509359 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8a58a1de-d9d6-4839-9a2f-fc5397be3ebb tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] 10.222.0.17 "GET /compute/v2.1/servers/bdade0fb-93ef-41ad-8079-a26f353871f4" status: 200 len: 1362 microversion: 2.1 time: 0.919186 Jul 23 21:33:32.509975 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2394/4877] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:33:31 2022] GET /compute/v2.1/servers/bdade0fb-93ef-41ad-8079-a26f353871f4 => generated 1362 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:33:32.517071 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6b812fed-48cd-4e07-a3e3-5b09fd847f26 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:32.518275 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6b812fed-48cd-4e07-a3e3-5b09fd847f26 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:32.520126 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-1aa6c208-ceba-441b-a7c8-1116231bf572 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47bdbd5d201c465a82540c1d8c0fdf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f1825873b0849ea98136c0979b251c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:32.535873 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6b812fed-48cd-4e07-a3e3-5b09fd847f26 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:32.537658 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-1aa6c208-ceba-441b-a7c8-1116231bf572 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] 10.222.0.17 "GET /compute/v2.1/servers/f9976c66-cc8b-45a6-b7f1-182c2abeb0ac" status: 200 len: 1427 microversion: 2.1 time: 0.218990 Jul 23 21:33:32.539232 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6b812fed-48cd-4e07-a3e3-5b09fd847f26 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:32.541944 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2484/4878] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:33:32 2022] GET /compute/v2.1/servers/f9976c66-cc8b-45a6-b7f1-182c2abeb0ac => generated 1427 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:33:32.544813 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6b812fed-48cd-4e07-a3e3-5b09fd847f26 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:32.546019 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6b812fed-48cd-4e07-a3e3-5b09fd847f26 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:32.556017 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-b98fee75-a141-4d0e-ae37-95b5fc4402c8 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:32.557631 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-b98fee75-a141-4d0e-ae37-95b5fc4402c8 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] [instance: 7cf33651-7d81-4943-8ec4-182097c73de0] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:32.631898 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-b98fee75-a141-4d0e-ae37-95b5fc4402c8 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:32.642842 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-b98fee75-a141-4d0e-ae37-95b5fc4402c8 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:32.646666 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-b98fee75-a141-4d0e-ae37-95b5fc4402c8 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:32.649310 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-b98fee75-a141-4d0e-ae37-95b5fc4402c8 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] 10.222.0.17 "GET /compute/v2.1/servers/7cf33651-7d81-4943-8ec4-182097c73de0" status: 200 len: 1281 microversion: 2.20 time: 0.106313 Jul 23 21:33:32.661748 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2485/4879] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:33:32 2022] GET /compute/v2.1/servers/7cf33651-7d81-4943-8ec4-182097c73de0 => generated 1281 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:33:32.717772 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6b812fed-48cd-4e07-a3e3-5b09fd847f26 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:32.729374 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6b812fed-48cd-4e07-a3e3-5b09fd847f26 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:32.734170 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6b812fed-48cd-4e07-a3e3-5b09fd847f26 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:32.735572 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6b812fed-48cd-4e07-a3e3-5b09fd847f26 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.223274 Jul 23 21:33:32.736182 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2395/4880] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:33:32 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:33:33.478833 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-157ee1bc-7d53-46b1-a522-4feb032ffc02 req-6dacf002-7c9d-41dd-92eb-8fbd24483447 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdade0fb-93ef-41ad-8079-a26f353871f4", "tag": "34883282-1a78-4faa-8577-5453eeda82f5"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:33:33.521759 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-157ee1bc-7d53-46b1-a522-4feb032ffc02 req-6dacf002-7c9d-41dd-92eb-8fbd24483447 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:33.522486 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-157ee1bc-7d53-46b1-a522-4feb032ffc02 req-6dacf002-7c9d-41dd-92eb-8fbd24483447 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:33.526254 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ff25b6f7-79d7-40f8-871c-70d2e19a7e86 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:33.526852 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ff25b6f7-79d7-40f8-871c-70d2e19a7e86 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] [instance: bdade0fb-93ef-41ad-8079-a26f353871f4] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:33.530223 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:33.541157 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-157ee1bc-7d53-46b1-a522-4feb032ffc02 req-6dacf002-7c9d-41dd-92eb-8fbd24483447 service nova] Creating event network-changed:34883282-1a78-4faa-8577-5453eeda82f5 for instance bdade0fb-93ef-41ad-8079-a26f353871f4 on nch2-master-1 Jul 23 21:33:33.545824 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ff25b6f7-79d7-40f8-871c-70d2e19a7e86 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:33.546343 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ff25b6f7-79d7-40f8-871c-70d2e19a7e86 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:33.547138 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ff25b6f7-79d7-40f8-871c-70d2e19a7e86 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:33.547578 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ff25b6f7-79d7-40f8-871c-70d2e19a7e86 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:33.548953 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-157ee1bc-7d53-46b1-a522-4feb032ffc02 req-6dacf002-7c9d-41dd-92eb-8fbd24483447 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078924 Jul 23 21:33:33.549730 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2486/4881] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:33:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:33:33.572608 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-517d744c-4e12-4c3a-bd1a-da36a38b5b14 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:33.573710 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-517d744c-4e12-4c3a-bd1a-da36a38b5b14 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] [instance: f9976c66-cc8b-45a6-b7f1-182c2abeb0ac] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:33.582054 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-517d744c-4e12-4c3a-bd1a-da36a38b5b14 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:33.582752 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-517d744c-4e12-4c3a-bd1a-da36a38b5b14 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:33.583704 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-517d744c-4e12-4c3a-bd1a-da36a38b5b14 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:33.584301 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-517d744c-4e12-4c3a-bd1a-da36a38b5b14 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:33.764913 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-517d744c-4e12-4c3a-bd1a-da36a38b5b14 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47bdbd5d201c465a82540c1d8c0fdf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f1825873b0849ea98136c0979b251c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:33.773437 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-517d744c-4e12-4c3a-bd1a-da36a38b5b14 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] 10.222.0.17 "GET /compute/v2.1/servers/f9976c66-cc8b-45a6-b7f1-182c2abeb0ac" status: 200 len: 1427 microversion: 2.1 time: 0.218403 Jul 23 21:33:33.775093 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2487/4882] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:33:33 2022] GET /compute/v2.1/servers/f9976c66-cc8b-45a6-b7f1-182c2abeb0ac => generated 1427 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:33:33.780092 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-b206c432-ec52-45a9-8f95-9b30ff95b847 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:33.780707 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-b206c432-ec52-45a9-8f95-9b30ff95b847 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] [instance: 7cf33651-7d81-4943-8ec4-182097c73de0] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:33.791106 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b206c432-ec52-45a9-8f95-9b30ff95b847 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:33.791616 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b206c432-ec52-45a9-8f95-9b30ff95b847 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:33.792608 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b206c432-ec52-45a9-8f95-9b30ff95b847 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:33.793377 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b206c432-ec52-45a9-8f95-9b30ff95b847 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:33.867967 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-b206c432-ec52-45a9-8f95-9b30ff95b847 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:33.880053 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-b206c432-ec52-45a9-8f95-9b30ff95b847 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:33.881995 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-b206c432-ec52-45a9-8f95-9b30ff95b847 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:33.883702 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-b206c432-ec52-45a9-8f95-9b30ff95b847 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] 10.222.0.17 "GET /compute/v2.1/servers/7cf33651-7d81-4943-8ec4-182097c73de0" status: 200 len: 1277 microversion: 2.20 time: 0.107642 Jul 23 21:33:33.885703 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2488/4883] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:33:33 2022] GET /compute/v2.1/servers/7cf33651-7d81-4943-8ec4-182097c73de0 => generated 1277 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:33:33.892607 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-aacf2428-994e-4f5c-92f9-1bc08d4e42f4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:33.893429 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-aacf2428-994e-4f5c-92f9-1bc08d4e42f4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:33.901947 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-aacf2428-994e-4f5c-92f9-1bc08d4e42f4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:33.902900 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-aacf2428-994e-4f5c-92f9-1bc08d4e42f4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:33.904020 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-aacf2428-994e-4f5c-92f9-1bc08d4e42f4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:33.904816 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-aacf2428-994e-4f5c-92f9-1bc08d4e42f4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:34.000896 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-aacf2428-994e-4f5c-92f9-1bc08d4e42f4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:34.011613 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-aacf2428-994e-4f5c-92f9-1bc08d4e42f4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:34.013480 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-aacf2428-994e-4f5c-92f9-1bc08d4e42f4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:34.014954 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-aacf2428-994e-4f5c-92f9-1bc08d4e42f4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.127918 Jul 23 21:33:34.016057 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2489/4884] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:33:33 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:33:34.172207 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ff25b6f7-79d7-40f8-871c-70d2e19a7e86 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc4aa131e63349b2aa8f37fdf6d2fe00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc1475019924837a8be47347f6bbd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:34.184535 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ff25b6f7-79d7-40f8-871c-70d2e19a7e86 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] 10.222.0.17 "GET /compute/v2.1/servers/bdade0fb-93ef-41ad-8079-a26f353871f4" status: 200 len: 1362 microversion: 2.1 time: 0.663050 Jul 23 21:33:34.185455 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2396/4885] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:33:33 2022] GET /compute/v2.1/servers/bdade0fb-93ef-41ad-8079-a26f353871f4 => generated 1362 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:33:34.793650 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c64131e4-13ef-4390-8e48-be14b31344d4 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:34.794381 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c64131e4-13ef-4390-8e48-be14b31344d4 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] [instance: f9976c66-cc8b-45a6-b7f1-182c2abeb0ac] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:34.808009 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c64131e4-13ef-4390-8e48-be14b31344d4 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:34.808206 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c64131e4-13ef-4390-8e48-be14b31344d4 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:34.810278 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c64131e4-13ef-4390-8e48-be14b31344d4 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:34.810959 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c64131e4-13ef-4390-8e48-be14b31344d4 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:34.907673 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-aa67e537-9056-4186-b80c-0b2267d9c4ec tempest-ComputeTenantNetworksTest-1547813625 tempest-ComputeTenantNetworksTest-1547813625-project] Calling method '.version_select at 0x7f0b59aa98b0>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:34.993484 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c64131e4-13ef-4390-8e48-be14b31344d4 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47bdbd5d201c465a82540c1d8c0fdf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f1825873b0849ea98136c0979b251c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:35.001460 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c64131e4-13ef-4390-8e48-be14b31344d4 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] 10.222.0.17 "GET /compute/v2.1/servers/f9976c66-cc8b-45a6-b7f1-182c2abeb0ac" status: 200 len: 1427 microversion: 2.1 time: 0.213798 Jul 23 21:33:35.002174 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2397/4886] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:33:34 2022] GET /compute/v2.1/servers/f9976c66-cc8b-45a6-b7f1-182c2abeb0ac => generated 1427 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:33:35.007027 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9c092226-9ffd-4176-bda3-4f4b9997424a tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:35.007734 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-9c092226-9ffd-4176-bda3-4f4b9997424a tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] [instance: 7cf33651-7d81-4943-8ec4-182097c73de0] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:35.014526 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9c092226-9ffd-4176-bda3-4f4b9997424a tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:35.014998 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9c092226-9ffd-4176-bda3-4f4b9997424a tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:35.016298 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9c092226-9ffd-4176-bda3-4f4b9997424a tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:35.016720 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9c092226-9ffd-4176-bda3-4f4b9997424a tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:35.080380 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-9c092226-9ffd-4176-bda3-4f4b9997424a tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:35.089007 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-9c092226-9ffd-4176-bda3-4f4b9997424a tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:35.090542 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-9c092226-9ffd-4176-bda3-4f4b9997424a tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:35.091662 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9c092226-9ffd-4176-bda3-4f4b9997424a tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] 10.222.0.17 "GET /compute/v2.1/servers/7cf33651-7d81-4943-8ec4-182097c73de0" status: 200 len: 1339 microversion: 2.20 time: 0.088321 Jul 23 21:33:35.102677 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2398/4887] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:33:35 2022] GET /compute/v2.1/servers/7cf33651-7d81-4943-8ec4-182097c73de0 => generated 1339 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:33:35.106599 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f1adf99f-2416-44c5-9e37-29bb82106a40 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:35.107287 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f1adf99f-2416-44c5-9e37-29bb82106a40 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:35.113545 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f1adf99f-2416-44c5-9e37-29bb82106a40 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:35.114127 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f1adf99f-2416-44c5-9e37-29bb82106a40 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:35.114977 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f1adf99f-2416-44c5-9e37-29bb82106a40 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:35.115509 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f1adf99f-2416-44c5-9e37-29bb82106a40 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:35.182131 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f1adf99f-2416-44c5-9e37-29bb82106a40 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:35.191945 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f1adf99f-2416-44c5-9e37-29bb82106a40 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:35.193474 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f1adf99f-2416-44c5-9e37-29bb82106a40 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:35.194715 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f1adf99f-2416-44c5-9e37-29bb82106a40 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.101094 Jul 23 21:33:35.198177 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2399/4888] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:33:35 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:33:35.201582 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-7780ff72-6299-42f5-9855-809c2f9aeb13 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:35.202204 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-7780ff72-6299-42f5-9855-809c2f9aeb13 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] [instance: bdade0fb-93ef-41ad-8079-a26f353871f4] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:35.209131 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7780ff72-6299-42f5-9855-809c2f9aeb13 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:35.209610 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7780ff72-6299-42f5-9855-809c2f9aeb13 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:35.210539 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7780ff72-6299-42f5-9855-809c2f9aeb13 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:35.210976 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7780ff72-6299-42f5-9855-809c2f9aeb13 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:35.271989 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-aa67e537-9056-4186-b80c-0b2267d9c4ec tempest-ComputeTenantNetworksTest-1547813625 tempest-ComputeTenantNetworksTest-1547813625-project] 10.222.0.17 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 308 microversion: 2.1 time: 0.552562 Jul 23 21:33:35.272604 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2490/4889] 10.222.0.17 () {58 vars in 1157 bytes} [Sat Jul 23 21:33:34 2022] GET /compute/v2.1/os-tenant-networks => generated 308 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:33:35.282703 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-75b03ebf-3c4d-4036-876b-a39f28e7474f tempest-ComputeTenantNetworksTest-1547813625 tempest-ComputeTenantNetworksTest-1547813625-project] Calling method '.version_select at 0x7f0b599b53a0>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:35.360618 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-7780ff72-6299-42f5-9855-809c2f9aeb13 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc4aa131e63349b2aa8f37fdf6d2fe00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc1475019924837a8be47347f6bbd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:35.368903 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-7780ff72-6299-42f5-9855-809c2f9aeb13 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] 10.222.0.17 "GET /compute/v2.1/servers/bdade0fb-93ef-41ad-8079-a26f353871f4" status: 200 len: 1362 microversion: 2.1 time: 0.170667 Jul 23 21:33:35.369473 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2400/4890] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:33:35 2022] GET /compute/v2.1/servers/bdade0fb-93ef-41ad-8079-a26f353871f4 => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:33:35.424516 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-75b03ebf-3c4d-4036-876b-a39f28e7474f tempest-ComputeTenantNetworksTest-1547813625 tempest-ComputeTenantNetworksTest-1547813625-project] 10.222.0.17 "GET /compute/v2.1/os-tenant-networks/87a5ecf2-d3b6-4d9f-8339-696d6ba318a8" status: 200 len: 139 microversion: 2.1 time: 0.145803 Jul 23 21:33:35.430667 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2491/4891] 10.222.0.17 () {58 vars in 1268 bytes} [Sat Jul 23 21:33:35 2022] GET /compute/v2.1/os-tenant-networks/87a5ecf2-d3b6-4d9f-8339-696d6ba318a8 => generated 139 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:33:36.018919 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b7c2f983-e3af-4083-a5fa-48314ec480e2 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:36.020208 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b7c2f983-e3af-4083-a5fa-48314ec480e2 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] [instance: f9976c66-cc8b-45a6-b7f1-182c2abeb0ac] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:36.034296 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b7c2f983-e3af-4083-a5fa-48314ec480e2 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:36.038165 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b7c2f983-e3af-4083-a5fa-48314ec480e2 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:36.039078 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b7c2f983-e3af-4083-a5fa-48314ec480e2 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:36.041681 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b7c2f983-e3af-4083-a5fa-48314ec480e2 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:36.114185 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-7fd266c1-8845-4a54-b878-4a965d317cfe tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:36.115348 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-7fd266c1-8845-4a54-b878-4a965d317cfe tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] [instance: 7cf33651-7d81-4943-8ec4-182097c73de0] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:36.132293 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7fd266c1-8845-4a54-b878-4a965d317cfe tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:36.133039 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7fd266c1-8845-4a54-b878-4a965d317cfe tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:36.134109 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7fd266c1-8845-4a54-b878-4a965d317cfe tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:36.134879 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7fd266c1-8845-4a54-b878-4a965d317cfe tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:36.396273 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-7fd266c1-8845-4a54-b878-4a965d317cfe tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:36.415152 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-7fd266c1-8845-4a54-b878-4a965d317cfe tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:36.416054 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b7c2f983-e3af-4083-a5fa-48314ec480e2 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47bdbd5d201c465a82540c1d8c0fdf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f1825873b0849ea98136c0979b251c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:36.416789 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-7fd266c1-8845-4a54-b878-4a965d317cfe tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:36.417801 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-7fd266c1-8845-4a54-b878-4a965d317cfe tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] 10.222.0.17 "GET /compute/v2.1/servers/7cf33651-7d81-4943-8ec4-182097c73de0" status: 200 len: 1407 microversion: 2.20 time: 0.307827 Jul 23 21:33:36.418397 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2492/4892] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:33:36 2022] GET /compute/v2.1/servers/7cf33651-7d81-4943-8ec4-182097c73de0 => generated 1407 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:33:36.426285 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b7c2f983-e3af-4083-a5fa-48314ec480e2 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] 10.222.0.17 "GET /compute/v2.1/servers/f9976c66-cc8b-45a6-b7f1-182c2abeb0ac" status: 200 len: 1427 microversion: 2.1 time: 0.412068 Jul 23 21:33:36.426930 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f76da2ac-4ebe-4a07-aa0f-5ff81ac835c2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:36.427543 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-f76da2ac-4ebe-4a07-aa0f-5ff81ac835c2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:36.430299 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2401/4893] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:33:36 2022] GET /compute/v2.1/servers/f9976c66-cc8b-45a6-b7f1-182c2abeb0ac => generated 1427 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:33:36.446666 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6fa2e4f0-3f02-435c-ae07-17ec1a70efff tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:36.448713 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6fa2e4f0-3f02-435c-ae07-17ec1a70efff tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] [instance: bdade0fb-93ef-41ad-8079-a26f353871f4] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:36.448912 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f76da2ac-4ebe-4a07-aa0f-5ff81ac835c2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:36.449548 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f76da2ac-4ebe-4a07-aa0f-5ff81ac835c2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:36.450530 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f76da2ac-4ebe-4a07-aa0f-5ff81ac835c2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:36.451121 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f76da2ac-4ebe-4a07-aa0f-5ff81ac835c2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:36.468557 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6fa2e4f0-3f02-435c-ae07-17ec1a70efff tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:36.469018 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6fa2e4f0-3f02-435c-ae07-17ec1a70efff tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:36.469889 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6fa2e4f0-3f02-435c-ae07-17ec1a70efff tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:36.470381 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6fa2e4f0-3f02-435c-ae07-17ec1a70efff tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:36.577501 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-f76da2ac-4ebe-4a07-aa0f-5ff81ac835c2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:36.588912 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-f76da2ac-4ebe-4a07-aa0f-5ff81ac835c2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:36.590735 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-f76da2ac-4ebe-4a07-aa0f-5ff81ac835c2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:36.593200 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-f76da2ac-4ebe-4a07-aa0f-5ff81ac835c2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.169802 Jul 23 21:33:36.594317 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2493/4894] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:33:36 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:33:36.840747 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-8837d895-9bae-4bfd-8d69-d6b3dbdd822b req-33cb77bf-2358-4313-95f6-3e95ac7c65e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cf33651-7d81-4943-8ec4-182097c73de0", "tag": "4a6fdacd-0c83-4f6d-a2bf-31fb7f27977d"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:33:36.865198 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-8837d895-9bae-4bfd-8d69-d6b3dbdd822b req-33cb77bf-2358-4313-95f6-3e95ac7c65e6 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:36.867809 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-8837d895-9bae-4bfd-8d69-d6b3dbdd822b req-33cb77bf-2358-4313-95f6-3e95ac7c65e6 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:36.878084 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6fa2e4f0-3f02-435c-ae07-17ec1a70efff tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc4aa131e63349b2aa8f37fdf6d2fe00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc1475019924837a8be47347f6bbd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:36.889747 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6fa2e4f0-3f02-435c-ae07-17ec1a70efff tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] 10.222.0.17 "GET /compute/v2.1/servers/bdade0fb-93ef-41ad-8079-a26f353871f4" status: 200 len: 1362 microversion: 2.1 time: 0.456801 Jul 23 21:33:36.890429 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2402/4895] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:33:36 2022] GET /compute/v2.1/servers/bdade0fb-93ef-41ad-8079-a26f353871f4 => generated 1362 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:33:36.900173 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-8837d895-9bae-4bfd-8d69-d6b3dbdd822b req-33cb77bf-2358-4313-95f6-3e95ac7c65e6 service nova] Creating event network-changed:4a6fdacd-0c83-4f6d-a2bf-31fb7f27977d for instance 7cf33651-7d81-4943-8ec4-182097c73de0 on nch1-master-1 Jul 23 21:33:36.910560 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-8837d895-9bae-4bfd-8d69-d6b3dbdd822b req-33cb77bf-2358-4313-95f6-3e95ac7c65e6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073869 Jul 23 21:33:36.914551 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2494/4896] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:33:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:33:37.435657 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ea549127-3d8f-4998-ae2e-d0ed1b9b4d68 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:37.436817 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ea549127-3d8f-4998-ae2e-d0ed1b9b4d68 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] [instance: 7cf33651-7d81-4943-8ec4-182097c73de0] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:37.443941 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ea549127-3d8f-4998-ae2e-d0ed1b9b4d68 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:37.444687 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ea549127-3d8f-4998-ae2e-d0ed1b9b4d68 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:37.445714 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ea549127-3d8f-4998-ae2e-d0ed1b9b4d68 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:37.446419 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ea549127-3d8f-4998-ae2e-d0ed1b9b4d68 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:37.449436 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-fd5583b1-c782-4000-88a5-9c9a360894a6 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:37.450175 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-fd5583b1-c782-4000-88a5-9c9a360894a6 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] [instance: f9976c66-cc8b-45a6-b7f1-182c2abeb0ac] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:37.464601 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fd5583b1-c782-4000-88a5-9c9a360894a6 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:37.465065 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fd5583b1-c782-4000-88a5-9c9a360894a6 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:37.466407 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fd5583b1-c782-4000-88a5-9c9a360894a6 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:37.466864 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fd5583b1-c782-4000-88a5-9c9a360894a6 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:37.621849 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ea549127-3d8f-4998-ae2e-d0ed1b9b4d68 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:37.634254 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ea549127-3d8f-4998-ae2e-d0ed1b9b4d68 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:37.637643 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ea549127-3d8f-4998-ae2e-d0ed1b9b4d68 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:37.639715 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ea549127-3d8f-4998-ae2e-d0ed1b9b4d68 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] 10.222.0.17 "GET /compute/v2.1/servers/7cf33651-7d81-4943-8ec4-182097c73de0" status: 200 len: 1407 microversion: 2.20 time: 0.207741 Jul 23 21:33:37.641754 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2403/4897] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:33:37 2022] GET /compute/v2.1/servers/7cf33651-7d81-4943-8ec4-182097c73de0 => generated 1407 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:33:37.646653 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-b62fbc14-e400-46a4-913e-fc6762755cb0 req-6cf78ba6-432d-4a7f-b033-eba76a498fa9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9976c66-cc8b-45a6-b7f1-182c2abeb0ac", "name": "network-vif-plugged", "status": "completed", "tag": "6423c43f-d175-49b4-bde9-bf2e2953e90c"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:33:37.660111 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-b62fbc14-e400-46a4-913e-fc6762755cb0 req-6cf78ba6-432d-4a7f-b033-eba76a498fa9 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:37.668289 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-b62fbc14-e400-46a4-913e-fc6762755cb0 req-6cf78ba6-432d-4a7f-b033-eba76a498fa9 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:37.672836 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=20 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:37.681900 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-b62fbc14-e400-46a4-913e-fc6762755cb0 req-6cf78ba6-432d-4a7f-b033-eba76a498fa9 service nova] Creating event network-vif-plugged:6423c43f-d175-49b4-bde9-bf2e2953e90c for instance f9976c66-cc8b-45a6-b7f1-182c2abeb0ac on nch1-master-1 Jul 23 21:33:37.689803 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-b62fbc14-e400-46a4-913e-fc6762755cb0 req-6cf78ba6-432d-4a7f-b033-eba76a498fa9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046380 Jul 23 21:33:37.690566 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2404/4898] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:33:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:33:37.703196 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-533b64e4-d467-4b7e-80f7-1e39c3f50a1f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:37.704129 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-533b64e4-d467-4b7e-80f7-1e39c3f50a1f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:37.714410 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-533b64e4-d467-4b7e-80f7-1e39c3f50a1f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:37.716417 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-533b64e4-d467-4b7e-80f7-1e39c3f50a1f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:37.717463 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-533b64e4-d467-4b7e-80f7-1e39c3f50a1f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:37.719153 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-533b64e4-d467-4b7e-80f7-1e39c3f50a1f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:37.805380 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-fd5583b1-c782-4000-88a5-9c9a360894a6 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47bdbd5d201c465a82540c1d8c0fdf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f1825873b0849ea98136c0979b251c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:37.824620 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-fd5583b1-c782-4000-88a5-9c9a360894a6 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] 10.222.0.17 "GET /compute/v2.1/servers/f9976c66-cc8b-45a6-b7f1-182c2abeb0ac" status: 200 len: 1427 microversion: 2.1 time: 0.379609 Jul 23 21:33:37.838075 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2495/4899] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:33:37 2022] GET /compute/v2.1/servers/f9976c66-cc8b-45a6-b7f1-182c2abeb0ac => generated 1427 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:33:37.907170 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-461d3d6f-71a9-4897-b19a-a0c6207c0832 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:37.907919 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-461d3d6f-71a9-4897-b19a-a0c6207c0832 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] [instance: bdade0fb-93ef-41ad-8079-a26f353871f4] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:37.921252 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-533b64e4-d467-4b7e-80f7-1e39c3f50a1f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:37.929607 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-461d3d6f-71a9-4897-b19a-a0c6207c0832 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:37.930472 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-461d3d6f-71a9-4897-b19a-a0c6207c0832 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:37.936524 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-461d3d6f-71a9-4897-b19a-a0c6207c0832 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:37.937295 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-461d3d6f-71a9-4897-b19a-a0c6207c0832 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:37.940149 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-533b64e4-d467-4b7e-80f7-1e39c3f50a1f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:37.945559 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-533b64e4-d467-4b7e-80f7-1e39c3f50a1f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:37.950666 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-533b64e4-d467-4b7e-80f7-1e39c3f50a1f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.258687 Jul 23 21:33:37.952155 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2405/4900] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:33:37 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:33:38.095943 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-461d3d6f-71a9-4897-b19a-a0c6207c0832 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc4aa131e63349b2aa8f37fdf6d2fe00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc1475019924837a8be47347f6bbd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:38.104458 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-461d3d6f-71a9-4897-b19a-a0c6207c0832 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] 10.222.0.17 "GET /compute/v2.1/servers/bdade0fb-93ef-41ad-8079-a26f353871f4" status: 200 len: 1362 microversion: 2.1 time: 0.201666 Jul 23 21:33:38.105568 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2496/4901] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:33:37 2022] GET /compute/v2.1/servers/bdade0fb-93ef-41ad-8079-a26f353871f4 => generated 1362 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:33:38.185223 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a7fc4f52-29bf-46de-9dcc-e3ff750926ca tempest-VolumesGetTestJSON-617832461 tempest-VolumesGetTestJSON-617832461-project] Action: 'create', calling method: .version_select at 0x7f0b46578550>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-539630675", "metadata": {"Type": "work"}}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:33:38.499326 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a7fc4f52-29bf-46de-9dcc-e3ff750926ca tempest-VolumesGetTestJSON-617832461 tempest-VolumesGetTestJSON-617832461-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.440559 Jul 23 21:33:38.500388 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2406/4902] 10.222.0.17 () {60 vars in 1155 bytes} [Sat Jul 23 21:33:38 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 443 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 23 21:33:38.514074 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f5026923-7fdb-4c77-85be-9afee933df2f tempest-VolumesGetTestJSON-617832461 tempest-VolumesGetTestJSON-617832461-project] Calling method '.version_select at 0x7f0b470d39d0>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:38.588460 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-f5026923-7fdb-4c77-85be-9afee933df2f tempest-VolumesGetTestJSON-617832461 tempest-VolumesGetTestJSON-617832461-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/fc108528-d315-4d1a-a09e-998952ad9215" status: 200 len: 342 microversion: 2.1 time: 0.080281 Jul 23 21:33:38.589308 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2497/4903] 10.222.0.17 () {58 vars in 1244 bytes} [Sat Jul 23 21:33:38 2022] GET /compute/v2.1/os-volumes/fc108528-d315-4d1a-a09e-998952ad9215 => generated 342 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:33:38.659179 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-5d1ee76c-cbff-4b79-b7f2-1127ead4d03d tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:38.659802 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-5d1ee76c-cbff-4b79-b7f2-1127ead4d03d tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] [instance: 7cf33651-7d81-4943-8ec4-182097c73de0] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:38.669365 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5d1ee76c-cbff-4b79-b7f2-1127ead4d03d tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:38.669820 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5d1ee76c-cbff-4b79-b7f2-1127ead4d03d tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:38.670677 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5d1ee76c-cbff-4b79-b7f2-1127ead4d03d tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:38.671161 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5d1ee76c-cbff-4b79-b7f2-1127ead4d03d tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:38.719557 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-69692ff8-2e48-4b60-b218-a0880b882f30 tempest-VolumesNegativeTest-1145478151 tempest-VolumesNegativeTest-1145478151-project] Action: 'create', calling method: .version_select at 0x7f0b46658dc0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-459514320", "metadata": {"Type": "work"}}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:33:38.722405 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-69692ff8-2e48-4b60-b218-a0880b882f30 tempest-VolumesNegativeTest-1145478151 tempest-VolumesNegativeTest-1145478151-project] Request method failure captured: Jul 23 21:33:38.722405 ncdv-master-1 devstack@n-api.service[131320]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 23 21:33:38.722405 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:33:38.722405 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:33:38.722405 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:33:38.722405 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 121 Jul 23 21:33:38.722405 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:33:38.722405 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:33:38.722405 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:33:38.722405 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:33:38.722405 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GkyO18ftS84cYFSGtMpL4AXdSYyJrD6n9nvTmhh-2wMWssIp6-MbUfH3lVuzZLssPXgH2xsZCfD2-YwQ3bbmV0d0V9e6Ra53LOtj6cUjrvxOG06oQHBhPkl-Qq1KK9QZzqike_ahV2l1MDzUrG2zSYCJeu60WkXTkqzIhOg_LiHajE Jul 23 21:33:38.722405 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:33:38.722405 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:33:38.722405 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:33:38.722405 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:33:38.722405 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:33:38.722405 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:33:38.722405 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: e416466bf1c742f5b56e651f847ca0be Jul 23 21:33:38.722405 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-VolumesNegativeTest-1145478151 Jul 23 21:33:38.722405 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:33:38.722405 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:33:38.722405 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e416466bf1c742f5b56e651f847ca0be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e416466bf1c742f5b56e651f847ca0be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e416466bf1c742f5b56e651f847ca0be", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e416466bf1c742f5b56e651f847ca0be"}]}] Jul 23 21:33:38.722405 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-VolumesNegativeTest-1145478151 Jul 23 21:33:38.722405 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: e416466bf1c742f5b56e651f847ca0be Jul 23 21:33:38.722405 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-VolumesNegativeTest-1145478151 Jul 23 21:33:38.722405 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-VolumesNegativeTest-1145478151-project Jul 23 21:33:38.722405 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:33:38.722405 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:33:38.722405 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 62a539d943a54052b2881de540073140 Jul 23 21:33:38.722405 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-VolumesNegativeTest-1145478151-project Jul 23 21:33:38.722405 ncdv-master-1 devstack@n-api.service[131320]: Jul 23 21:33:38.722405 ncdv-master-1 devstack@n-api.service[131320]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-459514320", "metadata": {"Type": "work"}}} Jul 23 21:33:38.722405 ncdv-master-1 devstack@n-api.service[131320]: method: Jul 23 21:33:38.722405 ncdv-master-1 devstack@n-api.service[131320]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 23 21:33:38.722405 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-459514320', 'metadata': {'Type': 'work'}}}} Jul 23 21:33:38.722405 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:33:38.722405 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:33:38.722405 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 23 21:33:38.722405 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 23 21:33:38.722405 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 23 21:33:38.722405 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise error Jul 23 21:33:38.722405 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 23 21:33:38.722405 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:38.722405 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 23 21:33:38.722405 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 23 21:33:38.722405 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:38.722405 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 23 21:33:38.722405 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi '#$%' Jul 23 21:33:38.722405 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:38.722405 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:33:38.722405 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:38.722405 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:33:38.722405 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:33:38.722405 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:33:38.722405 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:33:38.722405 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:33:38.722405 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:33:38.722405 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:33:38.722405 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:33:38.722405 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:33:38.722405 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 23 21:33:38.722405 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 23 21:33:38.722405 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 23 21:33:38.722405 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 23 21:33:38.722405 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 23 21:33:38.722405 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 23 21:33:38.727654 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 23 21:33:38.727654 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:38.727654 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:33:38.727654 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:38.727654 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:33:38.727654 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:33:38.727654 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:33:38.727654 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 23 21:33:38.727654 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 23 21:33:38.727654 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 23 21:33:38.727654 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:38.727654 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-69692ff8-2e48-4b60-b218-a0880b882f30 tempest-VolumesNegativeTest-1145478151 tempest-VolumesNegativeTest-1145478151-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:33:38.727654 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-69692ff8-2e48-4b60-b218-a0880b882f30 tempest-VolumesNegativeTest-1145478151 tempest-VolumesNegativeTest-1145478151-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.121388 Jul 23 21:33:38.730568 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2407/4904] 10.222.0.17 () {60 vars in 1155 bytes} [Sat Jul 23 21:33:38 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 129 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 23 21:33:38.736654 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-389c25b1-219a-4b07-a50e-7a16465325bf tempest-VolumesNegativeTest-1145478151 tempest-VolumesNegativeTest-1145478151-project] Action: 'create', calling method: .version_select at 0x7f0b4777f280>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1733373201", "metadata": {"Type": "work"}}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:33:38.739212 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-389c25b1-219a-4b07-a50e-7a16465325bf tempest-VolumesNegativeTest-1145478151 tempest-VolumesNegativeTest-1145478151-project] Request method failure captured: Jul 23 21:33:38.739212 ncdv-master-1 devstack@n-api.service[131320]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 23 21:33:38.739212 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:33:38.739212 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:33:38.739212 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:33:38.739212 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 120 Jul 23 21:33:38.739212 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:33:38.739212 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:33:38.739212 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:33:38.739212 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:33:38.739212 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GkyO18ftS84cYFSGtMpL4AXdSYyJrD6n9nvTmhh-2wMWssIp6-MbUfH3lVuzZLssPXgH2xsZCfD2-YwQ3bbmV0d0V9e6Ra53LOtj6cUjrvxOG06oQHBhPkl-Qq1KK9QZzqike_ahV2l1MDzUrG2zSYCJeu60WkXTkqzIhOg_LiHajE Jul 23 21:33:38.739212 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:33:38.739212 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:33:38.739212 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:33:38.739212 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:33:38.739212 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:33:38.739212 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:33:38.739212 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: e416466bf1c742f5b56e651f847ca0be Jul 23 21:33:38.739212 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-VolumesNegativeTest-1145478151 Jul 23 21:33:38.739212 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:33:38.739212 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:33:38.739212 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e416466bf1c742f5b56e651f847ca0be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e416466bf1c742f5b56e651f847ca0be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e416466bf1c742f5b56e651f847ca0be", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e416466bf1c742f5b56e651f847ca0be"}]}] Jul 23 21:33:38.739212 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-VolumesNegativeTest-1145478151 Jul 23 21:33:38.739212 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: e416466bf1c742f5b56e651f847ca0be Jul 23 21:33:38.739212 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-VolumesNegativeTest-1145478151 Jul 23 21:33:38.739212 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-VolumesNegativeTest-1145478151-project Jul 23 21:33:38.739212 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:33:38.739212 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:33:38.739212 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 62a539d943a54052b2881de540073140 Jul 23 21:33:38.739212 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-VolumesNegativeTest-1145478151-project Jul 23 21:33:38.739212 ncdv-master-1 devstack@n-api.service[131320]: Jul 23 21:33:38.739212 ncdv-master-1 devstack@n-api.service[131320]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1733373201", "metadata": {"Type": "work"}}} Jul 23 21:33:38.739212 ncdv-master-1 devstack@n-api.service[131320]: method: Jul 23 21:33:38.739212 ncdv-master-1 devstack@n-api.service[131320]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 23 21:33:38.739212 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1733373201', 'metadata': {'Type': 'work'}}}} Jul 23 21:33:38.739212 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:33:38.739212 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:33:38.739212 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 23 21:33:38.739212 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 23 21:33:38.739212 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 23 21:33:38.739212 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise error Jul 23 21:33:38.739212 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 23 21:33:38.739212 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:38.739212 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 23 21:33:38.739212 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 23 21:33:38.739212 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:38.739212 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 23 21:33:38.739212 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi '0' Jul 23 21:33:38.739212 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:38.739212 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:33:38.739212 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:38.739212 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:33:38.739212 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:33:38.739212 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:33:38.739212 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:33:38.739212 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:33:38.739212 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:33:38.739212 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:33:38.739212 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:33:38.739212 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:33:38.739212 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 23 21:33:38.739212 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 23 21:33:38.739212 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 23 21:33:38.739212 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 23 21:33:38.739212 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 23 21:33:38.739212 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 23 21:33:38.745074 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 23 21:33:38.745074 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:38.745074 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:33:38.745074 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:38.745074 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:33:38.745074 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:33:38.745074 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:33:38.745074 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 23 21:33:38.745074 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 23 21:33:38.745074 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 23 21:33:38.745074 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:38.745074 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-389c25b1-219a-4b07-a50e-7a16465325bf tempest-VolumesNegativeTest-1145478151 tempest-VolumesNegativeTest-1145478151-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:33:38.745074 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-389c25b1-219a-4b07-a50e-7a16465325bf tempest-VolumesNegativeTest-1145478151 tempest-VolumesNegativeTest-1145478151-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008986 Jul 23 21:33:38.745074 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2408/4905] 10.222.0.17 () {60 vars in 1155 bytes} [Sat Jul 23 21:33:38 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 23 21:33:38.751315 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a8c2dc75-a6ba-4515-bda6-e122025cd4cb tempest-VolumesNegativeTest-1145478151 tempest-VolumesNegativeTest-1145478151-project] Action: 'create', calling method: .version_select at 0x7f0b46578550>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1010491526", "metadata": {"Type": "work"}}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:33:38.753505 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a8c2dc75-a6ba-4515-bda6-e122025cd4cb tempest-VolumesNegativeTest-1145478151 tempest-VolumesNegativeTest-1145478151-project] Request method failure captured: Jul 23 21:33:38.753505 ncdv-master-1 devstack@n-api.service[131320]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 23 21:33:38.753505 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:33:38.753505 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:33:38.753505 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:33:38.753505 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 119 Jul 23 21:33:38.753505 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:33:38.753505 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:33:38.753505 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:33:38.753505 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:33:38.753505 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GkyO18ftS84cYFSGtMpL4AXdSYyJrD6n9nvTmhh-2wMWssIp6-MbUfH3lVuzZLssPXgH2xsZCfD2-YwQ3bbmV0d0V9e6Ra53LOtj6cUjrvxOG06oQHBhPkl-Qq1KK9QZzqike_ahV2l1MDzUrG2zSYCJeu60WkXTkqzIhOg_LiHajE Jul 23 21:33:38.753505 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:33:38.753505 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:33:38.753505 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:33:38.753505 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:33:38.753505 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:33:38.753505 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:33:38.753505 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: e416466bf1c742f5b56e651f847ca0be Jul 23 21:33:38.753505 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-VolumesNegativeTest-1145478151 Jul 23 21:33:38.753505 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:33:38.753505 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:33:38.753505 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e416466bf1c742f5b56e651f847ca0be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e416466bf1c742f5b56e651f847ca0be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e416466bf1c742f5b56e651f847ca0be", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e416466bf1c742f5b56e651f847ca0be"}]}] Jul 23 21:33:38.753505 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-VolumesNegativeTest-1145478151 Jul 23 21:33:38.753505 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: e416466bf1c742f5b56e651f847ca0be Jul 23 21:33:38.753505 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-VolumesNegativeTest-1145478151 Jul 23 21:33:38.753505 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-VolumesNegativeTest-1145478151-project Jul 23 21:33:38.753505 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:33:38.753505 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:33:38.753505 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 62a539d943a54052b2881de540073140 Jul 23 21:33:38.753505 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-VolumesNegativeTest-1145478151-project Jul 23 21:33:38.753505 ncdv-master-1 devstack@n-api.service[131320]: Jul 23 21:33:38.753505 ncdv-master-1 devstack@n-api.service[131320]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1010491526", "metadata": {"Type": "work"}}} Jul 23 21:33:38.753505 ncdv-master-1 devstack@n-api.service[131320]: method: Jul 23 21:33:38.753505 ncdv-master-1 devstack@n-api.service[131320]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 23 21:33:38.753505 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1010491526', 'metadata': {'Type': 'work'}}}} Jul 23 21:33:38.753505 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:33:38.753505 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:33:38.753505 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 23 21:33:38.753505 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 23 21:33:38.753505 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 23 21:33:38.753505 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise error Jul 23 21:33:38.753505 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 23 21:33:38.753505 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:38.753505 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 23 21:33:38.753505 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 23 21:33:38.753505 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:38.753505 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 23 21:33:38.753505 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi '' Jul 23 21:33:38.753505 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:38.753505 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:33:38.753505 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:38.753505 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:33:38.753505 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:33:38.753505 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:33:38.753505 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:33:38.753505 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:33:38.753505 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:33:38.753505 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:33:38.753505 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:33:38.753505 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:33:38.753505 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 23 21:33:38.753505 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 23 21:33:38.753505 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 23 21:33:38.753505 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 23 21:33:38.753505 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 23 21:33:38.753505 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 23 21:33:38.758563 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 23 21:33:38.758563 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:38.758563 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:33:38.758563 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:38.758563 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:33:38.758563 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:33:38.758563 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:33:38.758563 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 23 21:33:38.758563 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 23 21:33:38.758563 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 23 21:33:38.758563 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:38.758563 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a8c2dc75-a6ba-4515-bda6-e122025cd4cb tempest-VolumesNegativeTest-1145478151 tempest-VolumesNegativeTest-1145478151-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:33:38.758563 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a8c2dc75-a6ba-4515-bda6-e122025cd4cb tempest-VolumesNegativeTest-1145478151 tempest-VolumesNegativeTest-1145478151-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009784 Jul 23 21:33:38.765570 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2409/4906] 10.222.0.17 () {60 vars in 1155 bytes} [Sat Jul 23 21:33:38 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 23 21:33:38.769891 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f4caa929-2c9e-49b4-b387-6e572bb30b2f tempest-VolumesNegativeTest-1145478151 tempest-VolumesNegativeTest-1145478151-project] Calling method '.version_select at 0x7f0b46553c10>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:38.811314 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-f4caa929-2c9e-49b4-b387-6e572bb30b2f tempest-VolumesNegativeTest-1145478151 tempest-VolumesNegativeTest-1145478151-project] HTTP exception thrown: Volume tempest-invalid-1702839629 could not be found. Jul 23 21:33:38.813613 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f4caa929-2c9e-49b4-b387-6e572bb30b2f tempest-VolumesNegativeTest-1145478151 tempest-VolumesNegativeTest-1145478151-project] Request method failure captured: Jul 23 21:33:38.813613 ncdv-master-1 devstack@n-api.service[131320]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1702839629 HTTP/1.1 Jul 23 21:33:38.813613 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:33:38.813613 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:33:38.813613 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:33:38.813613 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:33:38.813613 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:33:38.813613 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:33:38.813613 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:33:38.813613 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:33:38.813613 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GkyO18ftS84cYFSGtMpL4AXdSYyJrD6n9nvTmhh-2wMWssIp6-MbUfH3lVuzZLssPXgH2xsZCfD2-YwQ3bbmV0d0V9e6Ra53LOtj6cUjrvxOG06oQHBhPkl-Qq1KK9QZzqike_ahV2l1MDzUrG2zSYCJeu60WkXTkqzIhOg_LiHajE Jul 23 21:33:38.813613 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:33:38.813613 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:33:38.813613 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:33:38.813613 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:33:38.813613 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:33:38.813613 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:33:38.813613 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: e416466bf1c742f5b56e651f847ca0be Jul 23 21:33:38.813613 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-VolumesNegativeTest-1145478151 Jul 23 21:33:38.813613 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:33:38.813613 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:33:38.813613 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e416466bf1c742f5b56e651f847ca0be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e416466bf1c742f5b56e651f847ca0be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e416466bf1c742f5b56e651f847ca0be", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e416466bf1c742f5b56e651f847ca0be"}]}] Jul 23 21:33:38.813613 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-VolumesNegativeTest-1145478151 Jul 23 21:33:38.813613 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: e416466bf1c742f5b56e651f847ca0be Jul 23 21:33:38.813613 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-VolumesNegativeTest-1145478151 Jul 23 21:33:38.813613 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-VolumesNegativeTest-1145478151-project Jul 23 21:33:38.813613 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:33:38.813613 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:33:38.813613 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 62a539d943a54052b2881de540073140 Jul 23 21:33:38.813613 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-VolumesNegativeTest-1145478151-project Jul 23 21:33:38.813613 ncdv-master-1 devstack@n-api.service[131320]: method: Jul 23 21:33:38.813613 ncdv-master-1 devstack@n-api.service[131320]: exception: Volume tempest-invalid-1702839629 could not be found. Jul 23 21:33:38.813613 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': 'tempest-invalid-1702839629'} Jul 23 21:33:38.813613 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:33:38.813613 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:33:38.813613 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 23 21:33:38.813613 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 23 21:33:38.813613 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 23 21:33:38.813613 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 23 21:33:38.813613 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 23 21:33:38.813613 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 23 21:33:38.813613 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 23 21:33:38.813613 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 23 21:33:38.813613 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 23 21:33:38.813613 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 23 21:33:38.813613 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 23 21:33:38.813613 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 23 21:33:38.813613 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 23 21:33:38.813613 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 23 21:33:38.813613 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1702839629 could not be found. (HTTP 404) (Request-ID: req-19b6b8fc-c2d7-4019-b471-397fafea62fa) Jul 23 21:33:38.813613 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:38.813613 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:33:38.813613 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:38.813613 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:33:38.813613 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 23 21:33:38.813613 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 23 21:33:38.813613 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 23 21:33:38.813613 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 23 21:33:38.813613 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 23 21:33:38.813613 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 23 21:33:38.813613 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 23 21:33:38.813613 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 23 21:33:38.813613 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 23 21:33:38.813613 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 23 21:33:38.818487 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 23 21:33:38.818487 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 23 21:33:38.818487 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 23 21:33:38.818487 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 23 21:33:38.818487 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 23 21:33:38.818487 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 23 21:33:38.818487 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 23 21:33:38.818487 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 23 21:33:38.818487 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 23 21:33:38.818487 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 23 21:33:38.818487 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 23 21:33:38.818487 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 23 21:33:38.818487 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1702839629 could not be found. Jul 23 21:33:38.818487 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:38.818487 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:33:38.818487 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:38.818487 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:33:38.818487 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:33:38.818487 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:33:38.818487 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:33:38.818487 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:33:38.818487 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:33:38.818487 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:33:38.818487 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:33:38.818487 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:33:38.818487 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 23 21:33:38.818487 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:33:38.818487 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1702839629 could not be found. Jul 23 21:33:38.818487 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:38.818487 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:33:38.818487 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:38.818487 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:33:38.818487 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:33:38.818487 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:33:38.818487 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:33:38.818487 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:33:38.818487 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1702839629 could not be found. Jul 23 21:33:38.818487 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:38.818487 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f4caa929-2c9e-49b4-b387-6e572bb30b2f tempest-VolumesNegativeTest-1145478151 tempest-VolumesNegativeTest-1145478151-project] Returning 404 to user: Volume tempest-invalid-1702839629 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:33:38.818487 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f4caa929-2c9e-49b4-b387-6e572bb30b2f tempest-VolumesNegativeTest-1145478151 tempest-VolumesNegativeTest-1145478151-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1702839629" status: 404 len: 99 microversion: 2.1 time: 0.049992 Jul 23 21:33:38.818487 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2410/4907] 10.222.0.17 () {58 vars in 1217 bytes} [Sat Jul 23 21:33:38 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1702839629 => generated 99 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 23 21:33:38.826536 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8f42d727-a27d-4e7f-87c8-50e23ad086a5 tempest-VolumesNegativeTest-1145478151 tempest-VolumesNegativeTest-1145478151-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003830 Jul 23 21:33:38.827191 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2411/4908] 10.222.0.17 () {58 vars in 1139 bytes} [Sat Jul 23 21:33:38 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jul 23 21:33:38.836082 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4ed534f2-be67-4aed-9283-6c31706e7bd7 tempest-VolumesNegativeTest-1145478151 tempest-VolumesNegativeTest-1145478151-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003744 Jul 23 21:33:38.836708 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2412/4909] 10.222.0.17 () {58 vars in 1136 bytes} [Sat Jul 23 21:33:38 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jul 23 21:33:38.845553 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-877e9e19-4344-439f-9f55-52608e5fa516 tempest-VolumesNegativeTest-1145478151 tempest-VolumesNegativeTest-1145478151-project] Calling method '.version_select at 0x7f0b4674fc10>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:38.858554 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-5d1ee76c-cbff-4b79-b7f2-1127ead4d03d tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:38.867199 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-5d1ee76c-cbff-4b79-b7f2-1127ead4d03d tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:38.868790 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-5d1ee76c-cbff-4b79-b7f2-1127ead4d03d tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:38.869952 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-5d1ee76c-cbff-4b79-b7f2-1127ead4d03d tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] 10.222.0.17 "GET /compute/v2.1/servers/7cf33651-7d81-4943-8ec4-182097c73de0" status: 200 len: 1407 microversion: 2.20 time: 0.214834 Jul 23 21:33:38.870540 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2498/4910] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:33:38 2022] GET /compute/v2.1/servers/7cf33651-7d81-4943-8ec4-182097c73de0 => generated 1407 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:33:38.878763 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-498f17a1-94f5-40fe-93eb-0936c27d2e03 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:38.879278 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-877e9e19-4344-439f-9f55-52608e5fa516 tempest-VolumesNegativeTest-1145478151 tempest-VolumesNegativeTest-1145478151-project] HTTP exception thrown: Volume ad78829e-8b96-4fcf-8aed-c4227ea6ed8f could not be found. Jul 23 21:33:38.879875 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-498f17a1-94f5-40fe-93eb-0936c27d2e03 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] [instance: f9976c66-cc8b-45a6-b7f1-182c2abeb0ac] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:38.881238 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-877e9e19-4344-439f-9f55-52608e5fa516 tempest-VolumesNegativeTest-1145478151 tempest-VolumesNegativeTest-1145478151-project] Request method failure captured: Jul 23 21:33:38.881238 ncdv-master-1 devstack@n-api.service[131320]: request: DELETE /compute/v2.1/os-volumes/ad78829e-8b96-4fcf-8aed-c4227ea6ed8f HTTP/1.1 Jul 23 21:33:38.881238 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:33:38.881238 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:33:38.881238 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:33:38.881238 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:33:38.881238 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:33:38.881238 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:33:38.881238 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:33:38.881238 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:33:38.881238 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GkyO18ftS84cYFSGtMpL4AXdSYyJrD6n9nvTmhh-2wMWssIp6-MbUfH3lVuzZLssPXgH2xsZCfD2-YwQ3bbmV0d0V9e6Ra53LOtj6cUjrvxOG06oQHBhPkl-Qq1KK9QZzqike_ahV2l1MDzUrG2zSYCJeu60WkXTkqzIhOg_LiHajE Jul 23 21:33:38.881238 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:33:38.881238 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:33:38.881238 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:33:38.881238 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:33:38.881238 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:33:38.881238 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:33:38.881238 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: e416466bf1c742f5b56e651f847ca0be Jul 23 21:33:38.881238 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-VolumesNegativeTest-1145478151 Jul 23 21:33:38.881238 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:33:38.881238 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:33:38.881238 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e416466bf1c742f5b56e651f847ca0be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e416466bf1c742f5b56e651f847ca0be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e416466bf1c742f5b56e651f847ca0be", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e416466bf1c742f5b56e651f847ca0be"}]}] Jul 23 21:33:38.881238 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-VolumesNegativeTest-1145478151 Jul 23 21:33:38.881238 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: e416466bf1c742f5b56e651f847ca0be Jul 23 21:33:38.881238 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-VolumesNegativeTest-1145478151 Jul 23 21:33:38.881238 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-VolumesNegativeTest-1145478151-project Jul 23 21:33:38.881238 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:33:38.881238 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:33:38.881238 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 62a539d943a54052b2881de540073140 Jul 23 21:33:38.881238 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-VolumesNegativeTest-1145478151-project Jul 23 21:33:38.881238 ncdv-master-1 devstack@n-api.service[131320]: method: Jul 23 21:33:38.881238 ncdv-master-1 devstack@n-api.service[131320]: exception: Volume ad78829e-8b96-4fcf-8aed-c4227ea6ed8f could not be found. Jul 23 21:33:38.881238 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': 'ad78829e-8b96-4fcf-8aed-c4227ea6ed8f'} Jul 23 21:33:38.881238 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:33:38.881238 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:33:38.881238 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 23 21:33:38.881238 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 23 21:33:38.881238 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 23 21:33:38.881238 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 23 21:33:38.881238 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 23 21:33:38.881238 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 23 21:33:38.881238 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 23 21:33:38.881238 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 23 21:33:38.881238 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 23 21:33:38.881238 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 23 21:33:38.881238 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 23 21:33:38.881238 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 23 21:33:38.881238 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 23 21:33:38.881238 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 23 21:33:38.881238 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ad78829e-8b96-4fcf-8aed-c4227ea6ed8f could not be found. (HTTP 404) (Request-ID: req-b101fd8a-fe3b-430e-b31c-7bd254dc8d5e) Jul 23 21:33:38.881238 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:38.881238 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:33:38.881238 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:38.881238 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:33:38.881238 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 23 21:33:38.881238 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 23 21:33:38.881238 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 23 21:33:38.881238 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 23 21:33:38.881238 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 23 21:33:38.881238 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 23 21:33:38.881238 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 23 21:33:38.881238 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 23 21:33:38.881238 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 23 21:33:38.886171 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 23 21:33:38.886171 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 23 21:33:38.886171 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 23 21:33:38.886171 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 23 21:33:38.886171 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 23 21:33:38.886171 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 23 21:33:38.886171 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 23 21:33:38.886171 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 23 21:33:38.886171 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 23 21:33:38.886171 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 23 21:33:38.886171 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 23 21:33:38.886171 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 23 21:33:38.886171 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 23 21:33:38.886171 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ad78829e-8b96-4fcf-8aed-c4227ea6ed8f could not be found. Jul 23 21:33:38.886171 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:38.886171 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:33:38.886171 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:38.886171 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:33:38.886171 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:33:38.886171 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:33:38.886171 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:33:38.886171 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:33:38.886171 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:33:38.886171 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:33:38.886171 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:33:38.886171 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:33:38.886171 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 23 21:33:38.886171 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:33:38.886171 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ad78829e-8b96-4fcf-8aed-c4227ea6ed8f could not be found. Jul 23 21:33:38.886171 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:38.886171 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:33:38.886171 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:38.886171 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:33:38.886171 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:33:38.886171 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:33:38.886171 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:33:38.886171 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:33:38.886171 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ad78829e-8b96-4fcf-8aed-c4227ea6ed8f could not be found. Jul 23 21:33:38.886171 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:38.886171 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-877e9e19-4344-439f-9f55-52608e5fa516 tempest-VolumesNegativeTest-1145478151 tempest-VolumesNegativeTest-1145478151-project] Returning 404 to user: Volume ad78829e-8b96-4fcf-8aed-c4227ea6ed8f could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:33:38.886171 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-877e9e19-4344-439f-9f55-52608e5fa516 tempest-VolumesNegativeTest-1145478151 tempest-VolumesNegativeTest-1145478151-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/ad78829e-8b96-4fcf-8aed-c4227ea6ed8f" status: 404 len: 109 microversion: 2.1 time: 0.041059 Jul 23 21:33:38.886171 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2413/4911] 10.222.0.17 () {58 vars in 1247 bytes} [Sat Jul 23 21:33:38 2022] DELETE /compute/v2.1/os-volumes/ad78829e-8b96-4fcf-8aed-c4227ea6ed8f => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 23 21:33:38.892747 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-498f17a1-94f5-40fe-93eb-0936c27d2e03 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:38.893176 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ec06f00f-b292-45a4-9b8b-2d7bb5491128 tempest-VolumesNegativeTest-1145478151 tempest-VolumesNegativeTest-1145478151-project] Calling method '.version_select at 0x7f0b4674fe50>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:38.893405 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-498f17a1-94f5-40fe-93eb-0936c27d2e03 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:38.894623 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-498f17a1-94f5-40fe-93eb-0936c27d2e03 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:38.895289 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-498f17a1-94f5-40fe-93eb-0936c27d2e03 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:38.928711 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-ec06f00f-b292-45a4-9b8b-2d7bb5491128 tempest-VolumesNegativeTest-1145478151 tempest-VolumesNegativeTest-1145478151-project] HTTP exception thrown: Volume 1623e19d-f0f6-40e7-b915-9ef6544635d4 could not be found. Jul 23 21:33:38.931010 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ec06f00f-b292-45a4-9b8b-2d7bb5491128 tempest-VolumesNegativeTest-1145478151 tempest-VolumesNegativeTest-1145478151-project] Request method failure captured: Jul 23 21:33:38.931010 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/os-volumes/1623e19d-f0f6-40e7-b915-9ef6544635d4 HTTP/1.1 Jul 23 21:33:38.931010 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:33:38.931010 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:33:38.931010 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:33:38.931010 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:33:38.931010 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:33:38.931010 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:33:38.931010 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:33:38.931010 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:33:38.931010 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GkyO18ftS84cYFSGtMpL4AXdSYyJrD6n9nvTmhh-2wMWssIp6-MbUfH3lVuzZLssPXgH2xsZCfD2-YwQ3bbmV0d0V9e6Ra53LOtj6cUjrvxOG06oQHBhPkl-Qq1KK9QZzqike_ahV2l1MDzUrG2zSYCJeu60WkXTkqzIhOg_LiHajE Jul 23 21:33:38.931010 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:33:38.931010 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:33:38.931010 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:33:38.931010 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:33:38.931010 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:33:38.931010 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:33:38.931010 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: e416466bf1c742f5b56e651f847ca0be Jul 23 21:33:38.931010 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-VolumesNegativeTest-1145478151 Jul 23 21:33:38.931010 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:33:38.931010 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:33:38.931010 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e416466bf1c742f5b56e651f847ca0be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/e416466bf1c742f5b56e651f847ca0be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_e416466bf1c742f5b56e651f847ca0be", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/e416466bf1c742f5b56e651f847ca0be"}]}] Jul 23 21:33:38.931010 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-VolumesNegativeTest-1145478151 Jul 23 21:33:38.931010 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: e416466bf1c742f5b56e651f847ca0be Jul 23 21:33:38.931010 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-VolumesNegativeTest-1145478151 Jul 23 21:33:38.931010 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-VolumesNegativeTest-1145478151-project Jul 23 21:33:38.931010 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:33:38.931010 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:33:38.931010 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 62a539d943a54052b2881de540073140 Jul 23 21:33:38.931010 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-VolumesNegativeTest-1145478151-project Jul 23 21:33:38.931010 ncdv-master-1 devstack@n-api.service[131320]: method: Jul 23 21:33:38.931010 ncdv-master-1 devstack@n-api.service[131320]: exception: Volume 1623e19d-f0f6-40e7-b915-9ef6544635d4 could not be found. Jul 23 21:33:38.931010 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '1623e19d-f0f6-40e7-b915-9ef6544635d4'} Jul 23 21:33:38.931010 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:33:38.931010 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:33:38.931010 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 23 21:33:38.931010 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 23 21:33:38.931010 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 23 21:33:38.931010 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 23 21:33:38.931010 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 23 21:33:38.931010 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 23 21:33:38.931010 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 23 21:33:38.931010 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 23 21:33:38.931010 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 23 21:33:38.931010 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 23 21:33:38.931010 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 23 21:33:38.931010 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 23 21:33:38.931010 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 23 21:33:38.931010 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 23 21:33:38.931010 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1623e19d-f0f6-40e7-b915-9ef6544635d4 could not be found. (HTTP 404) (Request-ID: req-1af8e8c6-3586-48b8-b587-85b9f5333897) Jul 23 21:33:38.931010 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:38.931010 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:33:38.931010 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:38.931010 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:33:38.931010 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 23 21:33:38.931010 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 23 21:33:38.931010 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 23 21:33:38.931010 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 23 21:33:38.931010 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 23 21:33:38.931010 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 23 21:33:38.931010 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 23 21:33:38.931010 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 23 21:33:38.931010 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 23 21:33:38.936202 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 23 21:33:38.936202 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 23 21:33:38.936202 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 23 21:33:38.936202 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 23 21:33:38.936202 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 23 21:33:38.936202 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 23 21:33:38.936202 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 23 21:33:38.936202 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 23 21:33:38.936202 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 23 21:33:38.936202 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 23 21:33:38.936202 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 23 21:33:38.936202 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 23 21:33:38.936202 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 23 21:33:38.936202 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1623e19d-f0f6-40e7-b915-9ef6544635d4 could not be found. Jul 23 21:33:38.936202 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:38.936202 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:33:38.936202 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:38.936202 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:33:38.936202 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:33:38.936202 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:33:38.936202 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:33:38.936202 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:33:38.936202 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:33:38.936202 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:33:38.936202 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:33:38.936202 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:33:38.936202 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 23 21:33:38.936202 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:33:38.936202 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1623e19d-f0f6-40e7-b915-9ef6544635d4 could not be found. Jul 23 21:33:38.936202 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:38.936202 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:33:38.936202 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:38.936202 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:33:38.936202 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:33:38.936202 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:33:38.936202 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:33:38.936202 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:33:38.936202 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1623e19d-f0f6-40e7-b915-9ef6544635d4 could not be found. Jul 23 21:33:38.936202 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:38.936202 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ec06f00f-b292-45a4-9b8b-2d7bb5491128 tempest-VolumesNegativeTest-1145478151 tempest-VolumesNegativeTest-1145478151-project] Returning 404 to user: Volume 1623e19d-f0f6-40e7-b915-9ef6544635d4 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:33:38.936202 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ec06f00f-b292-45a4-9b8b-2d7bb5491128 tempest-VolumesNegativeTest-1145478151 tempest-VolumesNegativeTest-1145478151-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/1623e19d-f0f6-40e7-b915-9ef6544635d4" status: 404 len: 109 microversion: 2.1 time: 0.044959 Jul 23 21:33:38.936202 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2414/4912] 10.222.0.17 () {58 vars in 1244 bytes} [Sat Jul 23 21:33:38 2022] GET /compute/v2.1/os-volumes/1623e19d-f0f6-40e7-b915-9ef6544635d4 => generated 109 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 23 21:33:38.975973 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e0d2bd75-c82c-4266-9b36-c98232229381 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:38.977306 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e0d2bd75-c82c-4266-9b36-c98232229381 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:38.985448 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e0d2bd75-c82c-4266-9b36-c98232229381 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:38.986767 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e0d2bd75-c82c-4266-9b36-c98232229381 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:38.988051 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e0d2bd75-c82c-4266-9b36-c98232229381 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:38.988801 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e0d2bd75-c82c-4266-9b36-c98232229381 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:39.082809 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e0d2bd75-c82c-4266-9b36-c98232229381 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:39.094856 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e0d2bd75-c82c-4266-9b36-c98232229381 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:39.097495 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e0d2bd75-c82c-4266-9b36-c98232229381 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:39.099807 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e0d2bd75-c82c-4266-9b36-c98232229381 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.128605 Jul 23 21:33:39.112831 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2415/4913] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:33:38 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:33:39.122281 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0d8c96f0-9867-40bd-beca-2c779b5ea3d4 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:39.124475 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-0d8c96f0-9867-40bd-beca-2c779b5ea3d4 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] [instance: bdade0fb-93ef-41ad-8079-a26f353871f4] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:39.132436 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0d8c96f0-9867-40bd-beca-2c779b5ea3d4 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:39.133325 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0d8c96f0-9867-40bd-beca-2c779b5ea3d4 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:39.134596 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0d8c96f0-9867-40bd-beca-2c779b5ea3d4 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:39.135282 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0d8c96f0-9867-40bd-beca-2c779b5ea3d4 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:39.158939 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-498f17a1-94f5-40fe-93eb-0936c27d2e03 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47bdbd5d201c465a82540c1d8c0fdf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f1825873b0849ea98136c0979b251c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:39.168430 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-498f17a1-94f5-40fe-93eb-0936c27d2e03 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] 10.222.0.17 "GET /compute/v2.1/servers/f9976c66-cc8b-45a6-b7f1-182c2abeb0ac" status: 200 len: 1427 microversion: 2.1 time: 0.296329 Jul 23 21:33:39.189458 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2499/4914] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:33:38 2022] GET /compute/v2.1/servers/f9976c66-cc8b-45a6-b7f1-182c2abeb0ac => generated 1427 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:33:39.404892 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-0d8c96f0-9867-40bd-beca-2c779b5ea3d4 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc4aa131e63349b2aa8f37fdf6d2fe00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc1475019924837a8be47347f6bbd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:39.422426 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-0d8c96f0-9867-40bd-beca-2c779b5ea3d4 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] 10.222.0.17 "GET /compute/v2.1/servers/bdade0fb-93ef-41ad-8079-a26f353871f4" status: 200 len: 1362 microversion: 2.1 time: 0.304539 Jul 23 21:33:39.423145 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2416/4915] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:33:39 2022] GET /compute/v2.1/servers/bdade0fb-93ef-41ad-8079-a26f353871f4 => generated 1362 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:33:39.602103 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-afd9aa48-134f-48d4-84e9-5c83aece3605 tempest-VolumesGetTestJSON-617832461 tempest-VolumesGetTestJSON-617832461-project] Calling method '.version_select at 0x7f0b47115af0>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:39.651913 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-afd9aa48-134f-48d4-84e9-5c83aece3605 tempest-VolumesGetTestJSON-617832461 tempest-VolumesGetTestJSON-617832461-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/fc108528-d315-4d1a-a09e-998952ad9215" status: 200 len: 342 microversion: 2.1 time: 0.054068 Jul 23 21:33:39.652525 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2500/4916] 10.222.0.17 () {58 vars in 1244 bytes} [Sat Jul 23 21:33:39 2022] GET /compute/v2.1/os-volumes/fc108528-d315-4d1a-a09e-998952ad9215 => generated 342 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:33:39.667807 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-edefeb30-f2d4-471d-a420-aaa98d3dea0c tempest-VolumesGetTestJSON-617832461 tempest-VolumesGetTestJSON-617832461-project] Calling method '.version_select at 0x7f0b4674f310>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:39.713322 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-99d65d6d-2b24-4a13-8056-d5e02a96dd70 req-faa6f970-ee30-4d0c-a6c7-0a42c5051140 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdade0fb-93ef-41ad-8079-a26f353871f4", "name": "network-vif-plugged", "status": "completed", "tag": "34883282-1a78-4faa-8577-5453eeda82f5"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:33:39.723316 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-99d65d6d-2b24-4a13-8056-d5e02a96dd70 req-faa6f970-ee30-4d0c-a6c7-0a42c5051140 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:39.723984 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-99d65d6d-2b24-4a13-8056-d5e02a96dd70 req-faa6f970-ee30-4d0c-a6c7-0a42c5051140 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:39.735672 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-99d65d6d-2b24-4a13-8056-d5e02a96dd70 req-faa6f970-ee30-4d0c-a6c7-0a42c5051140 service nova] Creating event network-vif-plugged:34883282-1a78-4faa-8577-5453eeda82f5 for instance bdade0fb-93ef-41ad-8079-a26f353871f4 on nch2-master-1 Jul 23 21:33:39.742014 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-99d65d6d-2b24-4a13-8056-d5e02a96dd70 req-faa6f970-ee30-4d0c-a6c7-0a42c5051140 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032218 Jul 23 21:33:39.743392 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2501/4917] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:33:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:33:39.840555 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-edefeb30-f2d4-471d-a420-aaa98d3dea0c tempest-VolumesGetTestJSON-617832461 tempest-VolumesGetTestJSON-617832461-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/fc108528-d315-4d1a-a09e-998952ad9215" status: 202 len: 0 microversion: 2.1 time: 0.176816 Jul 23 21:33:39.844086 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2417/4918] 10.222.0.17 () {58 vars in 1247 bytes} [Sat Jul 23 21:33:39 2022] DELETE /compute/v2.1/os-volumes/fc108528-d315-4d1a-a09e-998952ad9215 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:33:39.850472 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-6ff7bb7f-81b6-4f23-b8e6-a60d5c2ae335 tempest-VolumesGetTestJSON-617832461 tempest-VolumesGetTestJSON-617832461-project] Calling method '.version_select at 0x7f0b473ad5e0>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:39.887455 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-6ff7bb7f-81b6-4f23-b8e6-a60d5c2ae335 tempest-VolumesGetTestJSON-617832461 tempest-VolumesGetTestJSON-617832461-project] HTTP exception thrown: Volume fc108528-d315-4d1a-a09e-998952ad9215 could not be found. Jul 23 21:33:39.888412 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-07f805ca-bfc9-4b97-91bc-2901dc805936 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:39.889263 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-07f805ca-bfc9-4b97-91bc-2901dc805936 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] [instance: 7cf33651-7d81-4943-8ec4-182097c73de0] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:39.891797 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-6ff7bb7f-81b6-4f23-b8e6-a60d5c2ae335 tempest-VolumesGetTestJSON-617832461 tempest-VolumesGetTestJSON-617832461-project] Request method failure captured: Jul 23 21:33:39.891797 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/os-volumes/fc108528-d315-4d1a-a09e-998952ad9215 HTTP/1.1 Jul 23 21:33:39.891797 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:33:39.891797 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:33:39.891797 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:33:39.891797 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:33:39.891797 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:33:39.891797 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:33:39.891797 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:33:39.891797 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:33:39.891797 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GkxocXHsDrs44HbjWvqZj2gtNwzJy3xJ8WB4O585ZDEs1WpYm17J-4Ncqt8yMjZ-qJXN7kzOaxhvNw0fu74eSebEQZdlqLWvAle9jJmfkFthS5nGx59IqLIfRuCUyYATkoSac7-26PZYQrjaQRTiru4Xc7bqGYOBGoDC-rjog5knRw Jul 23 21:33:39.891797 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:33:39.891797 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:33:39.891797 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:33:39.891797 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:33:39.891797 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:33:39.891797 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:33:39.891797 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 52dbc9317e564a6a8e238a99dbc0abf5 Jul 23 21:33:39.891797 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-VolumesGetTestJSON-617832461 Jul 23 21:33:39.891797 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:33:39.891797 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:33:39.891797 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/52dbc9317e564a6a8e238a99dbc0abf5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/52dbc9317e564a6a8e238a99dbc0abf5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_52dbc9317e564a6a8e238a99dbc0abf5", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/52dbc9317e564a6a8e238a99dbc0abf5"}]}] Jul 23 21:33:39.891797 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-VolumesGetTestJSON-617832461 Jul 23 21:33:39.891797 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 52dbc9317e564a6a8e238a99dbc0abf5 Jul 23 21:33:39.891797 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-VolumesGetTestJSON-617832461 Jul 23 21:33:39.891797 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-VolumesGetTestJSON-617832461-project Jul 23 21:33:39.891797 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:33:39.891797 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:33:39.891797 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 8765950120c54fb39cce94ef5170c11f Jul 23 21:33:39.891797 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-VolumesGetTestJSON-617832461-project Jul 23 21:33:39.891797 ncdv-master-1 devstack@n-api.service[131321]: method: Jul 23 21:33:39.891797 ncdv-master-1 devstack@n-api.service[131321]: exception: Volume fc108528-d315-4d1a-a09e-998952ad9215 could not be found. Jul 23 21:33:39.891797 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': 'fc108528-d315-4d1a-a09e-998952ad9215'} Jul 23 21:33:39.891797 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:33:39.891797 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:33:39.891797 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 23 21:33:39.891797 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 23 21:33:39.891797 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 23 21:33:39.891797 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 23 21:33:39.891797 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 23 21:33:39.891797 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 23 21:33:39.891797 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 23 21:33:39.891797 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 23 21:33:39.891797 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 23 21:33:39.891797 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 23 21:33:39.891797 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 23 21:33:39.891797 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 23 21:33:39.891797 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 23 21:33:39.891797 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 23 21:33:39.891797 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume fc108528-d315-4d1a-a09e-998952ad9215 could not be found. (HTTP 404) (Request-ID: req-6334d573-6db9-45fc-b461-fb329995374c) Jul 23 21:33:39.891797 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:33:39.891797 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:33:39.891797 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:33:39.891797 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:33:39.891797 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 23 21:33:39.891797 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 23 21:33:39.891797 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 23 21:33:39.891797 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 23 21:33:39.891797 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 23 21:33:39.891797 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 23 21:33:39.891797 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 23 21:33:39.891797 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 23 21:33:39.891797 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 23 21:33:39.895620 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 23 21:33:39.895620 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 23 21:33:39.895620 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 23 21:33:39.895620 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 23 21:33:39.895620 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 23 21:33:39.895620 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 23 21:33:39.895620 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 23 21:33:39.895620 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 23 21:33:39.895620 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 23 21:33:39.895620 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 23 21:33:39.895620 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 23 21:33:39.895620 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 23 21:33:39.895620 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 23 21:33:39.895620 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume fc108528-d315-4d1a-a09e-998952ad9215 could not be found. Jul 23 21:33:39.895620 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:33:39.895620 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:33:39.895620 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:33:39.895620 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:33:39.895620 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:33:39.895620 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:33:39.895620 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:33:39.895620 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:33:39.895620 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:33:39.895620 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:33:39.895620 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:33:39.895620 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:33:39.895620 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 23 21:33:39.895620 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:33:39.895620 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume fc108528-d315-4d1a-a09e-998952ad9215 could not be found. Jul 23 21:33:39.895620 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:33:39.895620 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:33:39.895620 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:33:39.895620 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:33:39.895620 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:33:39.895620 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:33:39.895620 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:33:39.895620 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:33:39.895620 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume fc108528-d315-4d1a-a09e-998952ad9215 could not be found. Jul 23 21:33:39.895620 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:33:39.895620 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-6ff7bb7f-81b6-4f23-b8e6-a60d5c2ae335 tempest-VolumesGetTestJSON-617832461 tempest-VolumesGetTestJSON-617832461-project] Returning 404 to user: Volume fc108528-d315-4d1a-a09e-998952ad9215 could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:33:39.895620 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-6ff7bb7f-81b6-4f23-b8e6-a60d5c2ae335 tempest-VolumesGetTestJSON-617832461 tempest-VolumesGetTestJSON-617832461-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/fc108528-d315-4d1a-a09e-998952ad9215" status: 404 len: 109 microversion: 2.1 time: 0.047679 Jul 23 21:33:39.895620 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2502/4919] 10.222.0.17 () {58 vars in 1244 bytes} [Sat Jul 23 21:33:39 2022] GET /compute/v2.1/os-volumes/fc108528-d315-4d1a-a09e-998952ad9215 => generated 109 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:33:39.907043 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-07f805ca-bfc9-4b97-91bc-2901dc805936 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:39.907771 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-07f805ca-bfc9-4b97-91bc-2901dc805936 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:39.908824 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-07f805ca-bfc9-4b97-91bc-2901dc805936 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:39.909497 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-07f805ca-bfc9-4b97-91bc-2901dc805936 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:39.930775 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=100 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:40.100205 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-07f805ca-bfc9-4b97-91bc-2901dc805936 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:40.111588 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-07f805ca-bfc9-4b97-91bc-2901dc805936 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:40.113267 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-07f805ca-bfc9-4b97-91bc-2901dc805936 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:40.114489 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-07f805ca-bfc9-4b97-91bc-2901dc805936 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] 10.222.0.17 "GET /compute/v2.1/servers/7cf33651-7d81-4943-8ec4-182097c73de0" status: 200 len: 1407 microversion: 2.20 time: 0.230243 Jul 23 21:33:40.117253 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2418/4920] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:33:39 2022] GET /compute/v2.1/servers/7cf33651-7d81-4943-8ec4-182097c73de0 => generated 1407 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:33:40.122636 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c6f0e749-38ec-444d-87b9-6425e722bee0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:40.123856 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-c6f0e749-38ec-444d-87b9-6425e722bee0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:40.132223 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c6f0e749-38ec-444d-87b9-6425e722bee0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:40.133061 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c6f0e749-38ec-444d-87b9-6425e722bee0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:40.134271 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c6f0e749-38ec-444d-87b9-6425e722bee0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:40.134721 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c6f0e749-38ec-444d-87b9-6425e722bee0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:40.207088 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c6f0e749-38ec-444d-87b9-6425e722bee0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:40.218290 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c6f0e749-38ec-444d-87b9-6425e722bee0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:40.219791 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c6f0e749-38ec-444d-87b9-6425e722bee0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:40.221166 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-c6f0e749-38ec-444d-87b9-6425e722bee0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.104374 Jul 23 21:33:40.221729 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2503/4921] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:33:40 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:33:40.305513 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-24631dfd-4f25-464f-a6d8-bf4c8a39edee tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:40.306606 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-24631dfd-4f25-464f-a6d8-bf4c8a39edee tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] [instance: f9976c66-cc8b-45a6-b7f1-182c2abeb0ac] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:40.314102 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-24631dfd-4f25-464f-a6d8-bf4c8a39edee tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:40.314789 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-24631dfd-4f25-464f-a6d8-bf4c8a39edee tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:40.315774 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-24631dfd-4f25-464f-a6d8-bf4c8a39edee tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:40.316436 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-24631dfd-4f25-464f-a6d8-bf4c8a39edee tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:40.440835 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-652abbe1-364c-4ba8-854c-e5d894fda2d1 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:40.441821 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-652abbe1-364c-4ba8-854c-e5d894fda2d1 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] [instance: bdade0fb-93ef-41ad-8079-a26f353871f4] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:40.448322 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-652abbe1-364c-4ba8-854c-e5d894fda2d1 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:40.448998 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-652abbe1-364c-4ba8-854c-e5d894fda2d1 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:40.449780 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-652abbe1-364c-4ba8-854c-e5d894fda2d1 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:40.450245 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-652abbe1-364c-4ba8-854c-e5d894fda2d1 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:40.501718 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-24631dfd-4f25-464f-a6d8-bf4c8a39edee tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47bdbd5d201c465a82540c1d8c0fdf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f1825873b0849ea98136c0979b251c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:40.510719 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-24631dfd-4f25-464f-a6d8-bf4c8a39edee tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] 10.222.0.17 "GET /compute/v2.1/servers/f9976c66-cc8b-45a6-b7f1-182c2abeb0ac" status: 200 len: 1606 microversion: 2.1 time: 0.209397 Jul 23 21:33:40.511592 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2419/4922] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:33:40 2022] GET /compute/v2.1/servers/f9976c66-cc8b-45a6-b7f1-182c2abeb0ac => generated 1606 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:33:40.531277 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-19f4a6fc-8d54-44b4-9773-7b825403fb12 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:40.532218 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-19f4a6fc-8d54-44b4-9773-7b825403fb12 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] [instance: f9976c66-cc8b-45a6-b7f1-182c2abeb0ac] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:40.539280 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-19f4a6fc-8d54-44b4-9773-7b825403fb12 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:40.539734 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-19f4a6fc-8d54-44b4-9773-7b825403fb12 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:40.540779 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-19f4a6fc-8d54-44b4-9773-7b825403fb12 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:40.541425 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-19f4a6fc-8d54-44b4-9773-7b825403fb12 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:40.605422 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-652abbe1-364c-4ba8-854c-e5d894fda2d1 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc4aa131e63349b2aa8f37fdf6d2fe00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc1475019924837a8be47347f6bbd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:40.616054 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-652abbe1-364c-4ba8-854c-e5d894fda2d1 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] 10.222.0.17 "GET /compute/v2.1/servers/bdade0fb-93ef-41ad-8079-a26f353871f4" status: 200 len: 1362 microversion: 2.1 time: 0.180434 Jul 23 21:33:40.625907 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2504/4923] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:33:40 2022] GET /compute/v2.1/servers/bdade0fb-93ef-41ad-8079-a26f353871f4 => generated 1362 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:33:40.723808 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-19f4a6fc-8d54-44b4-9773-7b825403fb12 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47bdbd5d201c465a82540c1d8c0fdf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f1825873b0849ea98136c0979b251c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:40.732708 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-19f4a6fc-8d54-44b4-9773-7b825403fb12 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] 10.222.0.17 "GET /compute/v2.1/servers/f9976c66-cc8b-45a6-b7f1-182c2abeb0ac" status: 200 len: 1606 microversion: 2.1 time: 0.209551 Jul 23 21:33:40.733520 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2420/4924] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:33:40 2022] GET /compute/v2.1/servers/f9976c66-cc8b-45a6-b7f1-182c2abeb0ac => generated 1606 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:33:40.749217 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-231b682e-e1d8-45a7-9b2f-0266cab94e15 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:40.750139 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-231b682e-e1d8-45a7-9b2f-0266cab94e15 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] [instance: f9976c66-cc8b-45a6-b7f1-182c2abeb0ac] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:40.764085 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-231b682e-e1d8-45a7-9b2f-0266cab94e15 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:40.764792 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-231b682e-e1d8-45a7-9b2f-0266cab94e15 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:40.765756 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-231b682e-e1d8-45a7-9b2f-0266cab94e15 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:40.766234 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-231b682e-e1d8-45a7-9b2f-0266cab94e15 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:40.944114 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-231b682e-e1d8-45a7-9b2f-0266cab94e15 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47bdbd5d201c465a82540c1d8c0fdf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f1825873b0849ea98136c0979b251c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:40.952093 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-231b682e-e1d8-45a7-9b2f-0266cab94e15 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] 10.222.0.17 "GET /compute/v2.1/servers/f9976c66-cc8b-45a6-b7f1-182c2abeb0ac" status: 200 len: 1606 microversion: 2.1 time: 0.206740 Jul 23 21:33:40.952811 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2505/4925] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:33:40 2022] GET /compute/v2.1/servers/f9976c66-cc8b-45a6-b7f1-182c2abeb0ac => generated 1606 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:33:41.133838 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b03f16f2-98eb-4314-91d6-2fef3d19baf7 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:41.134565 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b03f16f2-98eb-4314-91d6-2fef3d19baf7 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] [instance: 7cf33651-7d81-4943-8ec4-182097c73de0] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:41.143169 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b03f16f2-98eb-4314-91d6-2fef3d19baf7 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:41.143919 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b03f16f2-98eb-4314-91d6-2fef3d19baf7 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:41.144716 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b03f16f2-98eb-4314-91d6-2fef3d19baf7 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:41.145458 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b03f16f2-98eb-4314-91d6-2fef3d19baf7 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:41.244451 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-3d80fff1-39cd-45e0-89b8-4318e0038632 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:41.244451 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-3d80fff1-39cd-45e0-89b8-4318e0038632 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:41.250962 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3d80fff1-39cd-45e0-89b8-4318e0038632 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:41.251703 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3d80fff1-39cd-45e0-89b8-4318e0038632 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:41.252803 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3d80fff1-39cd-45e0-89b8-4318e0038632 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:41.253731 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3d80fff1-39cd-45e0-89b8-4318e0038632 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:41.359386 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-3d80fff1-39cd-45e0-89b8-4318e0038632 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:41.363292 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=100 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:41.372210 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b03f16f2-98eb-4314-91d6-2fef3d19baf7 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:41.378215 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-3d80fff1-39cd-45e0-89b8-4318e0038632 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:41.380593 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-3d80fff1-39cd-45e0-89b8-4318e0038632 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:41.381937 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-3d80fff1-39cd-45e0-89b8-4318e0038632 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.144308 Jul 23 21:33:41.383188 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2506/4926] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:33:41 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:33:41.384598 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b03f16f2-98eb-4314-91d6-2fef3d19baf7 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:41.389001 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b03f16f2-98eb-4314-91d6-2fef3d19baf7 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:41.392738 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b03f16f2-98eb-4314-91d6-2fef3d19baf7 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] 10.222.0.17 "GET /compute/v2.1/servers/7cf33651-7d81-4943-8ec4-182097c73de0" status: 200 len: 1407 microversion: 2.20 time: 0.263691 Jul 23 21:33:41.393924 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2421/4927] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:33:41 2022] GET /compute/v2.1/servers/7cf33651-7d81-4943-8ec4-182097c73de0 => generated 1407 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:33:41.639566 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-40c2cd83-aa90-45e3-92ce-a40b4df8ffd3 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:41.640915 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-40c2cd83-aa90-45e3-92ce-a40b4df8ffd3 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] [instance: bdade0fb-93ef-41ad-8079-a26f353871f4] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:41.651295 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-40c2cd83-aa90-45e3-92ce-a40b4df8ffd3 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:41.651925 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-40c2cd83-aa90-45e3-92ce-a40b4df8ffd3 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:41.653087 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-40c2cd83-aa90-45e3-92ce-a40b4df8ffd3 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:41.653655 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-40c2cd83-aa90-45e3-92ce-a40b4df8ffd3 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:41.864697 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-40c2cd83-aa90-45e3-92ce-a40b4df8ffd3 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc4aa131e63349b2aa8f37fdf6d2fe00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc1475019924837a8be47347f6bbd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:41.873398 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-40c2cd83-aa90-45e3-92ce-a40b4df8ffd3 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] 10.222.0.17 "GET /compute/v2.1/servers/bdade0fb-93ef-41ad-8079-a26f353871f4" status: 200 len: 1548 microversion: 2.1 time: 0.244637 Jul 23 21:33:41.874906 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2507/4928] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:33:41 2022] GET /compute/v2.1/servers/bdade0fb-93ef-41ad-8079-a26f353871f4 => generated 1548 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:33:41.890760 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-82d72d67-3f74-45df-86c7-5d572a5706bc tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:41.891278 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-82d72d67-3f74-45df-86c7-5d572a5706bc tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] [instance: bdade0fb-93ef-41ad-8079-a26f353871f4] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:41.900630 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-82d72d67-3f74-45df-86c7-5d572a5706bc tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:41.901100 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-82d72d67-3f74-45df-86c7-5d572a5706bc tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:41.901923 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-82d72d67-3f74-45df-86c7-5d572a5706bc tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:41.902576 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-82d72d67-3f74-45df-86c7-5d572a5706bc tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:42.334198 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-82d72d67-3f74-45df-86c7-5d572a5706bc tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] 10.222.0.17 "GET /compute/v2.1/servers/bdade0fb-93ef-41ad-8079-a26f353871f4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.447602 Jul 23 21:33:42.334818 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2422/4929] 10.222.0.17 () {58 vars in 1274 bytes} [Sat Jul 23 21:33:41 2022] GET /compute/v2.1/servers/bdade0fb-93ef-41ad-8079-a26f353871f4/os-interface => generated 284 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:33:42.401097 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-def3e982-eaf1-43f5-851b-9a10ea710d96 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:42.402343 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-def3e982-eaf1-43f5-851b-9a10ea710d96 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:42.412063 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1e3c0903-97ba-4e9f-8485-327278139282 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:42.412828 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1e3c0903-97ba-4e9f-8485-327278139282 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] [instance: 7cf33651-7d81-4943-8ec4-182097c73de0] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:42.415727 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell0:SELECT=4 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:42.421023 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-def3e982-eaf1-43f5-851b-9a10ea710d96 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:42.423426 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-def3e982-eaf1-43f5-851b-9a10ea710d96 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:42.424010 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1e3c0903-97ba-4e9f-8485-327278139282 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:42.424499 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1e3c0903-97ba-4e9f-8485-327278139282 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:42.425156 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-def3e982-eaf1-43f5-851b-9a10ea710d96 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:42.425296 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1e3c0903-97ba-4e9f-8485-327278139282 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:42.427594 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-def3e982-eaf1-43f5-851b-9a10ea710d96 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:42.430036 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1e3c0903-97ba-4e9f-8485-327278139282 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:42.574843 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-def3e982-eaf1-43f5-851b-9a10ea710d96 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:42.594441 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-def3e982-eaf1-43f5-851b-9a10ea710d96 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:42.596347 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-def3e982-eaf1-43f5-851b-9a10ea710d96 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:42.598968 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-def3e982-eaf1-43f5-851b-9a10ea710d96 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.201000 Jul 23 21:33:42.599585 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2508/4930] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:33:42 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:33:42.692819 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-1e3c0903-97ba-4e9f-8485-327278139282 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:42.702198 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-1e3c0903-97ba-4e9f-8485-327278139282 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:42.704485 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-1e3c0903-97ba-4e9f-8485-327278139282 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:42.705702 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1e3c0903-97ba-4e9f-8485-327278139282 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] 10.222.0.17 "GET /compute/v2.1/servers/7cf33651-7d81-4943-8ec4-182097c73de0" status: 200 len: 1407 microversion: 2.20 time: 0.298185 Jul 23 21:33:42.706379 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2423/4931] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:33:42 2022] GET /compute/v2.1/servers/7cf33651-7d81-4943-8ec4-182097c73de0 => generated 1407 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:33:43.620782 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-af4a0687-4776-4459-82ff-03cf48e5e994 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:43.622050 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-af4a0687-4776-4459-82ff-03cf48e5e994 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:43.624327 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell0:SELECT=20 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:43.627668 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:43.653347 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-af4a0687-4776-4459-82ff-03cf48e5e994 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:43.654612 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-af4a0687-4776-4459-82ff-03cf48e5e994 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:43.657981 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-af4a0687-4776-4459-82ff-03cf48e5e994 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:43.658696 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-af4a0687-4776-4459-82ff-03cf48e5e994 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:43.671389 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-252484f8-5ce0-4988-a02f-0b241e3d449a req-70459696-43cf-43b3-92ae-53c0bb7893f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cf33651-7d81-4943-8ec4-182097c73de0", "name": "network-vif-plugged", "status": "completed", "tag": "4a6fdacd-0c83-4f6d-a2bf-31fb7f27977d"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:33:43.690192 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-252484f8-5ce0-4988-a02f-0b241e3d449a req-70459696-43cf-43b3-92ae-53c0bb7893f8 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:43.691966 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-252484f8-5ce0-4988-a02f-0b241e3d449a req-70459696-43cf-43b3-92ae-53c0bb7893f8 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:43.732863 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-252484f8-5ce0-4988-a02f-0b241e3d449a req-70459696-43cf-43b3-92ae-53c0bb7893f8 service nova] Creating event network-vif-plugged:4a6fdacd-0c83-4f6d-a2bf-31fb7f27977d for instance 7cf33651-7d81-4943-8ec4-182097c73de0 on nch1-master-1 Jul 23 21:33:43.746189 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-252484f8-5ce0-4988-a02f-0b241e3d449a req-70459696-43cf-43b3-92ae-53c0bb7893f8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078952 Jul 23 21:33:43.747215 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2424/4932] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:33:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:33:43.760724 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-285dba62-bec3-4142-b09a-84ab1ce93071 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:43.761450 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-285dba62-bec3-4142-b09a-84ab1ce93071 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] [instance: 7cf33651-7d81-4943-8ec4-182097c73de0] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:43.778977 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-285dba62-bec3-4142-b09a-84ab1ce93071 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:43.779737 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-285dba62-bec3-4142-b09a-84ab1ce93071 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:43.783034 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-285dba62-bec3-4142-b09a-84ab1ce93071 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:43.783700 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-285dba62-bec3-4142-b09a-84ab1ce93071 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:43.850147 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-af4a0687-4776-4459-82ff-03cf48e5e994 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:43.865683 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-af4a0687-4776-4459-82ff-03cf48e5e994 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:43.875419 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-af4a0687-4776-4459-82ff-03cf48e5e994 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:43.886199 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-af4a0687-4776-4459-82ff-03cf48e5e994 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.270518 Jul 23 21:33:43.886961 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2509/4933] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:33:43 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:33:44.041691 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-285dba62-bec3-4142-b09a-84ab1ce93071 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:44.057653 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-285dba62-bec3-4142-b09a-84ab1ce93071 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:44.059222 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-285dba62-bec3-4142-b09a-84ab1ce93071 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:44.064693 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-285dba62-bec3-4142-b09a-84ab1ce93071 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] 10.222.0.17 "GET /compute/v2.1/servers/7cf33651-7d81-4943-8ec4-182097c73de0" status: 200 len: 1407 microversion: 2.20 time: 0.315939 Jul 23 21:33:44.077977 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2425/4934] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:33:43 2022] GET /compute/v2.1/servers/7cf33651-7d81-4943-8ec4-182097c73de0 => generated 1407 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:33:44.297607 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-6cf3b257-3598-4b94-b384-d880062d1871 req-0a9e0324-1f6f-47f6-9f2e-40bacb4646ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9976c66-cc8b-45a6-b7f1-182c2abeb0ac", "tag": "6423c43f-d175-49b4-bde9-bf2e2953e90c"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:33:44.313744 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-6cf3b257-3598-4b94-b384-d880062d1871 req-0a9e0324-1f6f-47f6-9f2e-40bacb4646ef service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:44.314329 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-6cf3b257-3598-4b94-b384-d880062d1871 req-0a9e0324-1f6f-47f6-9f2e-40bacb4646ef service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:44.343826 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-6cf3b257-3598-4b94-b384-d880062d1871 req-0a9e0324-1f6f-47f6-9f2e-40bacb4646ef service nova] Creating event network-changed:6423c43f-d175-49b4-bde9-bf2e2953e90c for instance f9976c66-cc8b-45a6-b7f1-182c2abeb0ac on nch1-master-1 Jul 23 21:33:44.345154 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-0bfe9894-e1f9-48cb-bb32-34636ee3da8e req-b7e2f550-e7f9-4a65-9d8a-122b6cf14646 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdade0fb-93ef-41ad-8079-a26f353871f4", "tag": "34883282-1a78-4faa-8577-5453eeda82f5"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:33:44.354562 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-0bfe9894-e1f9-48cb-bb32-34636ee3da8e req-b7e2f550-e7f9-4a65-9d8a-122b6cf14646 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:44.354999 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-0bfe9894-e1f9-48cb-bb32-34636ee3da8e req-b7e2f550-e7f9-4a65-9d8a-122b6cf14646 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:44.363954 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-6cf3b257-3598-4b94-b384-d880062d1871 req-0a9e0324-1f6f-47f6-9f2e-40bacb4646ef service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072992 Jul 23 21:33:44.364735 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2510/4935] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:33:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:33:44.377032 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-0bfe9894-e1f9-48cb-bb32-34636ee3da8e req-b7e2f550-e7f9-4a65-9d8a-122b6cf14646 service nova] Creating event network-changed:34883282-1a78-4faa-8577-5453eeda82f5 for instance bdade0fb-93ef-41ad-8079-a26f353871f4 on nch2-master-1 Jul 23 21:33:44.383986 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-0bfe9894-e1f9-48cb-bb32-34636ee3da8e req-b7e2f550-e7f9-4a65-9d8a-122b6cf14646 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046686 Jul 23 21:33:44.389330 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2426/4936] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:33:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:33:44.905495 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a0ff8f2d-3970-483c-afe2-7bcf8ac1b6f3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:44.906456 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-a0ff8f2d-3970-483c-afe2-7bcf8ac1b6f3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:44.934438 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a0ff8f2d-3970-483c-afe2-7bcf8ac1b6f3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:44.934895 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a0ff8f2d-3970-483c-afe2-7bcf8ac1b6f3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:44.935696 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a0ff8f2d-3970-483c-afe2-7bcf8ac1b6f3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:44.936141 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a0ff8f2d-3970-483c-afe2-7bcf8ac1b6f3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:45.086667 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e178d58e-f600-445d-a85c-95c36ce04790 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:45.087591 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e178d58e-f600-445d-a85c-95c36ce04790 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] [instance: 7cf33651-7d81-4943-8ec4-182097c73de0] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:45.091846 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-a0ff8f2d-3970-483c-afe2-7bcf8ac1b6f3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:45.111075 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-a0ff8f2d-3970-483c-afe2-7bcf8ac1b6f3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:45.119274 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-a0ff8f2d-3970-483c-afe2-7bcf8ac1b6f3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:45.120022 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e178d58e-f600-445d-a85c-95c36ce04790 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:45.120604 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e178d58e-f600-445d-a85c-95c36ce04790 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:45.121313 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e178d58e-f600-445d-a85c-95c36ce04790 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:45.121757 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e178d58e-f600-445d-a85c-95c36ce04790 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:45.125398 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-a0ff8f2d-3970-483c-afe2-7bcf8ac1b6f3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.222184 Jul 23 21:33:45.126136 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2511/4937] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:33:44 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:33:45.624599 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e178d58e-f600-445d-a85c-95c36ce04790 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:45.642648 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e178d58e-f600-445d-a85c-95c36ce04790 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:45.644538 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e178d58e-f600-445d-a85c-95c36ce04790 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:45.650113 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e178d58e-f600-445d-a85c-95c36ce04790 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] 10.222.0.17 "GET /compute/v2.1/servers/7cf33651-7d81-4943-8ec4-182097c73de0" status: 200 len: 1407 microversion: 2.20 time: 0.568108 Jul 23 21:33:45.651598 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2427/4938] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:33:45 2022] GET /compute/v2.1/servers/7cf33651-7d81-4943-8ec4-182097c73de0 => generated 1407 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:33:46.144120 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-f95d51fb-4281-4a1d-8fb8-87139656aef2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:46.144841 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-f95d51fb-4281-4a1d-8fb8-87139656aef2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:46.152197 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f95d51fb-4281-4a1d-8fb8-87139656aef2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:46.157473 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f95d51fb-4281-4a1d-8fb8-87139656aef2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:46.159004 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f95d51fb-4281-4a1d-8fb8-87139656aef2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:46.159531 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-f95d51fb-4281-4a1d-8fb8-87139656aef2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:46.272889 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-f95d51fb-4281-4a1d-8fb8-87139656aef2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:46.316224 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-f95d51fb-4281-4a1d-8fb8-87139656aef2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:46.318386 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-f95d51fb-4281-4a1d-8fb8-87139656aef2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:46.319917 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-f95d51fb-4281-4a1d-8fb8-87139656aef2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.179743 Jul 23 21:33:46.321108 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2512/4939] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:33:46 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:33:46.676358 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-15e4c0a9-2509-4adb-add9-78226ef70527 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:46.677148 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-15e4c0a9-2509-4adb-add9-78226ef70527 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] [instance: 7cf33651-7d81-4943-8ec4-182097c73de0] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:46.688804 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-15e4c0a9-2509-4adb-add9-78226ef70527 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:46.689804 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-15e4c0a9-2509-4adb-add9-78226ef70527 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:46.691024 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-15e4c0a9-2509-4adb-add9-78226ef70527 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:46.691765 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-15e4c0a9-2509-4adb-add9-78226ef70527 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:46.861621 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-15e4c0a9-2509-4adb-add9-78226ef70527 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:46.874540 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-15e4c0a9-2509-4adb-add9-78226ef70527 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:46.876882 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-15e4c0a9-2509-4adb-add9-78226ef70527 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:46.878188 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-15e4c0a9-2509-4adb-add9-78226ef70527 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] 10.222.0.17 "GET /compute/v2.1/servers/7cf33651-7d81-4943-8ec4-182097c73de0" status: 200 len: 1600 microversion: 2.20 time: 0.210008 Jul 23 21:33:46.879029 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2428/4940] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:33:46 2022] GET /compute/v2.1/servers/7cf33651-7d81-4943-8ec4-182097c73de0 => generated 1600 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:33:46.896624 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e11a1041-e24b-42a3-8fd6-db9f300f9295 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:46.897274 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-e11a1041-e24b-42a3-8fd6-db9f300f9295 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] [instance: 7cf33651-7d81-4943-8ec4-182097c73de0] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:46.904658 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e11a1041-e24b-42a3-8fd6-db9f300f9295 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:46.905335 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e11a1041-e24b-42a3-8fd6-db9f300f9295 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:46.906139 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e11a1041-e24b-42a3-8fd6-db9f300f9295 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:46.906582 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e11a1041-e24b-42a3-8fd6-db9f300f9295 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:46.999090 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-e11a1041-e24b-42a3-8fd6-db9f300f9295 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] 10.222.0.17 "GET /compute/v2.1/servers/7cf33651-7d81-4943-8ec4-182097c73de0/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.106513 Jul 23 21:33:46.999702 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2513/4941] 10.222.0.17 () {60 vars in 1315 bytes} [Sat Jul 23 21:33:46 2022] GET /compute/v2.1/servers/7cf33651-7d81-4943-8ec4-182097c73de0/os-interface => generated 285 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 23 21:33:47.339349 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b308662a-72f1-42cb-bcb2-da6ba77d8fcd tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:47.339986 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b308662a-72f1-42cb-bcb2-da6ba77d8fcd tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:47.346384 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b308662a-72f1-42cb-bcb2-da6ba77d8fcd tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:47.347356 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b308662a-72f1-42cb-bcb2-da6ba77d8fcd tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:47.348877 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b308662a-72f1-42cb-bcb2-da6ba77d8fcd tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:47.349950 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b308662a-72f1-42cb-bcb2-da6ba77d8fcd tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:47.435617 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b308662a-72f1-42cb-bcb2-da6ba77d8fcd tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:47.458437 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b308662a-72f1-42cb-bcb2-da6ba77d8fcd tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:47.463007 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b308662a-72f1-42cb-bcb2-da6ba77d8fcd tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:47.467557 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b308662a-72f1-42cb-bcb2-da6ba77d8fcd tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.132070 Jul 23 21:33:47.470835 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2429/4942] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:33:47 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:33:48.082874 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-171ea291-d22d-484b-a00b-2e4b15032929 req-bdc3f6a7-2097-4889-9b26-76a6f5a1f7a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cf33651-7d81-4943-8ec4-182097c73de0", "tag": "4a6fdacd-0c83-4f6d-a2bf-31fb7f27977d"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:33:48.092214 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-171ea291-d22d-484b-a00b-2e4b15032929 req-bdc3f6a7-2097-4889-9b26-76a6f5a1f7a2 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:48.092672 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-171ea291-d22d-484b-a00b-2e4b15032929 req-bdc3f6a7-2097-4889-9b26-76a6f5a1f7a2 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:48.112322 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-171ea291-d22d-484b-a00b-2e4b15032929 req-bdc3f6a7-2097-4889-9b26-76a6f5a1f7a2 service nova] Creating event network-changed:4a6fdacd-0c83-4f6d-a2bf-31fb7f27977d for instance 7cf33651-7d81-4943-8ec4-182097c73de0 on nch1-master-1 Jul 23 21:33:48.119193 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-171ea291-d22d-484b-a00b-2e4b15032929 req-bdc3f6a7-2097-4889-9b26-76a6f5a1f7a2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041112 Jul 23 21:33:48.119991 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2514/4943] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:33:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:33:48.488589 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6e90dd6e-8ca4-476e-a334-f30ce5742e8b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:48.489335 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6e90dd6e-8ca4-476e-a334-f30ce5742e8b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:48.500665 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6e90dd6e-8ca4-476e-a334-f30ce5742e8b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:48.501118 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6e90dd6e-8ca4-476e-a334-f30ce5742e8b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:48.501928 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6e90dd6e-8ca4-476e-a334-f30ce5742e8b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:48.502368 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6e90dd6e-8ca4-476e-a334-f30ce5742e8b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:48.602911 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6e90dd6e-8ca4-476e-a334-f30ce5742e8b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:48.616718 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6e90dd6e-8ca4-476e-a334-f30ce5742e8b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:48.619211 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6e90dd6e-8ca4-476e-a334-f30ce5742e8b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:48.620308 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6e90dd6e-8ca4-476e-a334-f30ce5742e8b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.137364 Jul 23 21:33:48.620897 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2430/4944] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:33:48 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:33:49.035437 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-58df5f75-50dd-4295-8492-503da07f9a85 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:49.036037 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-58df5f75-50dd-4295-8492-503da07f9a85 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] [instance: bbee3556-287f-42a5-a6a8-84356c840b67] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:49.046183 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-58df5f75-50dd-4295-8492-503da07f9a85 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:49.046857 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-58df5f75-50dd-4295-8492-503da07f9a85 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:49.047936 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-58df5f75-50dd-4295-8492-503da07f9a85 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:49.048563 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-58df5f75-50dd-4295-8492-503da07f9a85 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:49.079015 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-58df5f75-50dd-4295-8492-503da07f9a85 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] 10.222.0.17 "GET /compute/v2.1/servers/bbee3556-287f-42a5-a6a8-84356c840b67/ips" status: 200 len: 149 microversion: 2.1 time: 0.048317 Jul 23 21:33:49.085144 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2515/4945] 10.222.0.17 () {58 vars in 1247 bytes} [Sat Jul 23 21:33:49 2022] GET /compute/v2.1/servers/bbee3556-287f-42a5-a6a8-84356c840b67/ips => generated 149 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:33:49.642233 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-815690c5-9847-458b-a8dc-3a2947385b8d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:49.643469 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-815690c5-9847-458b-a8dc-3a2947385b8d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:49.654251 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-815690c5-9847-458b-a8dc-3a2947385b8d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:49.654953 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-815690c5-9847-458b-a8dc-3a2947385b8d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:49.655985 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-815690c5-9847-458b-a8dc-3a2947385b8d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:49.656803 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-815690c5-9847-458b-a8dc-3a2947385b8d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:49.725744 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-815690c5-9847-458b-a8dc-3a2947385b8d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:49.742133 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-815690c5-9847-458b-a8dc-3a2947385b8d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:49.744315 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-815690c5-9847-458b-a8dc-3a2947385b8d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:49.745579 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-815690c5-9847-458b-a8dc-3a2947385b8d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.108654 Jul 23 21:33:49.746656 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2431/4946] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:33:49 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:33:50.496122 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c68b9423-2e6f-4fea-aec5-ff1473c6d5f8 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:50.496616 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-c68b9423-2e6f-4fea-aec5-ff1473c6d5f8 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] [instance: bbee3556-287f-42a5-a6a8-84356c840b67] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:50.504039 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c68b9423-2e6f-4fea-aec5-ff1473c6d5f8 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:50.504486 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c68b9423-2e6f-4fea-aec5-ff1473c6d5f8 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:50.505257 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c68b9423-2e6f-4fea-aec5-ff1473c6d5f8 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:50.505698 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c68b9423-2e6f-4fea-aec5-ff1473c6d5f8 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:50.531537 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-c68b9423-2e6f-4fea-aec5-ff1473c6d5f8 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] [instance: bbee3556-287f-42a5-a6a8-84356c840b67] Going to try to terminate instance {{(pid=131321) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:33:50.624993 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-c68b9423-2e6f-4fea-aec5-ff1473c6d5f8 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] 10.222.0.17 "DELETE /compute/v2.1/servers/bbee3556-287f-42a5-a6a8-84356c840b67" status: 204 len: 0 microversion: 2.1 time: 0.133186 Jul 23 21:33:50.626252 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2516/4947] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:33:50 2022] DELETE /compute/v2.1/servers/bbee3556-287f-42a5-a6a8-84356c840b67 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:33:50.636099 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-546c58a6-025e-45e2-955c-aa19d3cc1c9a tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:50.636974 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-546c58a6-025e-45e2-955c-aa19d3cc1c9a tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] [instance: bbee3556-287f-42a5-a6a8-84356c840b67] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:50.640183 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:50.644524 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-546c58a6-025e-45e2-955c-aa19d3cc1c9a tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:50.645119 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-546c58a6-025e-45e2-955c-aa19d3cc1c9a tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:50.645706 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-546c58a6-025e-45e2-955c-aa19d3cc1c9a tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:50.646174 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-546c58a6-025e-45e2-955c-aa19d3cc1c9a tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:50.768857 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c33c8b68-7642-46c7-a9f8-51242a63510b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:50.770257 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-c33c8b68-7642-46c7-a9f8-51242a63510b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:50.781718 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c33c8b68-7642-46c7-a9f8-51242a63510b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:50.782812 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c33c8b68-7642-46c7-a9f8-51242a63510b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:50.783941 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c33c8b68-7642-46c7-a9f8-51242a63510b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:50.784726 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c33c8b68-7642-46c7-a9f8-51242a63510b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:50.804416 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-546c58a6-025e-45e2-955c-aa19d3cc1c9a tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b1e260651b4dffa7c1efe8e9d0f144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcf55bcaba04bf8ae8a9b2ac09e8d98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:50.813244 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-546c58a6-025e-45e2-955c-aa19d3cc1c9a tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] 10.222.0.17 "GET /compute/v2.1/servers/bbee3556-287f-42a5-a6a8-84356c840b67" status: 200 len: 1682 microversion: 2.1 time: 0.182283 Jul 23 21:33:50.814347 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2432/4948] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:33:50 2022] GET /compute/v2.1/servers/bbee3556-287f-42a5-a6a8-84356c840b67 => generated 1682 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:33:50.866877 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c33c8b68-7642-46c7-a9f8-51242a63510b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:50.878315 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c33c8b68-7642-46c7-a9f8-51242a63510b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:50.880129 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c33c8b68-7642-46c7-a9f8-51242a63510b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:50.881649 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-c33c8b68-7642-46c7-a9f8-51242a63510b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.121570 Jul 23 21:33:50.892716 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2517/4949] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:33:50 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:33:51.831516 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-edd6037b-38a6-4eb6-b81c-57a774dd4544 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:51.832344 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-edd6037b-38a6-4eb6-b81c-57a774dd4544 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] [instance: bbee3556-287f-42a5-a6a8-84356c840b67] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:51.839645 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-edd6037b-38a6-4eb6-b81c-57a774dd4544 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:51.840321 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-edd6037b-38a6-4eb6-b81c-57a774dd4544 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:51.841112 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-edd6037b-38a6-4eb6-b81c-57a774dd4544 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:51.841556 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-edd6037b-38a6-4eb6-b81c-57a774dd4544 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:51.900082 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-21981e5f-086e-43b2-9468-5994d6f1f601 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:51.900875 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-21981e5f-086e-43b2-9468-5994d6f1f601 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:51.908160 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-21981e5f-086e-43b2-9468-5994d6f1f601 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:51.908733 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-21981e5f-086e-43b2-9468-5994d6f1f601 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:51.909538 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-21981e5f-086e-43b2-9468-5994d6f1f601 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:51.910020 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-21981e5f-086e-43b2-9468-5994d6f1f601 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:51.990396 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-21981e5f-086e-43b2-9468-5994d6f1f601 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:52.000834 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-21981e5f-086e-43b2-9468-5994d6f1f601 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:52.002272 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-21981e5f-086e-43b2-9468-5994d6f1f601 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:52.003487 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-21981e5f-086e-43b2-9468-5994d6f1f601 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.108003 Jul 23 21:33:52.004067 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2518/4950] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:33:51 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:33:52.045442 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-edd6037b-38a6-4eb6-b81c-57a774dd4544 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b1e260651b4dffa7c1efe8e9d0f144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcf55bcaba04bf8ae8a9b2ac09e8d98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:52.053741 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-edd6037b-38a6-4eb6-b81c-57a774dd4544 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] 10.222.0.17 "GET /compute/v2.1/servers/bbee3556-287f-42a5-a6a8-84356c840b67" status: 200 len: 1682 microversion: 2.1 time: 0.226325 Jul 23 21:33:52.054524 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2433/4951] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:33:51 2022] GET /compute/v2.1/servers/bbee3556-287f-42a5-a6a8-84356c840b67 => generated 1682 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:33:53.022869 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-518121c6-a705-4d03-a7db-8a87d80d8510 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:53.024031 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-518121c6-a705-4d03-a7db-8a87d80d8510 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:53.032043 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-518121c6-a705-4d03-a7db-8a87d80d8510 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:53.032812 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-518121c6-a705-4d03-a7db-8a87d80d8510 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:53.033939 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-518121c6-a705-4d03-a7db-8a87d80d8510 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:53.034555 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-518121c6-a705-4d03-a7db-8a87d80d8510 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:53.074006 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-95a52fe4-6661-42e7-8a01-dca150408061 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:53.075533 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-95a52fe4-6661-42e7-8a01-dca150408061 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] [instance: bbee3556-287f-42a5-a6a8-84356c840b67] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:53.085646 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-95a52fe4-6661-42e7-8a01-dca150408061 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:53.086977 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-95a52fe4-6661-42e7-8a01-dca150408061 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:53.088145 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-95a52fe4-6661-42e7-8a01-dca150408061 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:53.089262 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-95a52fe4-6661-42e7-8a01-dca150408061 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:53.101608 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-518121c6-a705-4d03-a7db-8a87d80d8510 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:53.112913 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-518121c6-a705-4d03-a7db-8a87d80d8510 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:53.114932 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-518121c6-a705-4d03-a7db-8a87d80d8510 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:53.116504 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-518121c6-a705-4d03-a7db-8a87d80d8510 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.097704 Jul 23 21:33:53.119777 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2519/4952] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:33:53 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:33:53.214830 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-95a52fe4-6661-42e7-8a01-dca150408061 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37b1e260651b4dffa7c1efe8e9d0f144', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcf55bcaba04bf8ae8a9b2ac09e8d98', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:53.228299 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-95a52fe4-6661-42e7-8a01-dca150408061 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] 10.222.0.17 "GET /compute/v2.1/servers/bbee3556-287f-42a5-a6a8-84356c840b67" status: 200 len: 1614 microversion: 2.1 time: 0.160204 Jul 23 21:33:53.229453 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2434/4953] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:33:53 2022] GET /compute/v2.1/servers/bbee3556-287f-42a5-a6a8-84356c840b67 => generated 1614 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:33:53.483116 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-74a2f0c3-01f2-4b3d-bec7-b1d83416b319 req-f6033aad-57d5-4b15-b5ec-57694a32c28c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbee3556-287f-42a5-a6a8-84356c840b67", "name": "network-vif-deleted", "tag": "b588225a-63d8-48d9-a3c7-0823a9dd1533"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:33:53.495343 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-74a2f0c3-01f2-4b3d-bec7-b1d83416b319 req-f6033aad-57d5-4b15-b5ec-57694a32c28c service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:53.497647 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-74a2f0c3-01f2-4b3d-bec7-b1d83416b319 req-f6033aad-57d5-4b15-b5ec-57694a32c28c service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:53.537382 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-74a2f0c3-01f2-4b3d-bec7-b1d83416b319 req-f6033aad-57d5-4b15-b5ec-57694a32c28c service nova] Creating event network-vif-deleted:b588225a-63d8-48d9-a3c7-0823a9dd1533 for instance bbee3556-287f-42a5-a6a8-84356c840b67 on nch2-master-1 Jul 23 21:33:53.544692 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-74a2f0c3-01f2-4b3d-bec7-b1d83416b319 req-f6033aad-57d5-4b15-b5ec-57694a32c28c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065486 Jul 23 21:33:53.550654 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2520/4954] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:33:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:33:54.139689 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-231076d4-3c81-4333-9938-83da2bf435e5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:54.140304 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-231076d4-3c81-4333-9938-83da2bf435e5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:54.153479 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-231076d4-3c81-4333-9938-83da2bf435e5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:54.153959 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-231076d4-3c81-4333-9938-83da2bf435e5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:54.154930 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-231076d4-3c81-4333-9938-83da2bf435e5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:54.156076 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-231076d4-3c81-4333-9938-83da2bf435e5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:54.254657 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-8298ed75-44c8-4bef-9f78-efa588461cb3 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:54.255728 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-8298ed75-44c8-4bef-9f78-efa588461cb3 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] [instance: bbee3556-287f-42a5-a6a8-84356c840b67] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:54.264809 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-231076d4-3c81-4333-9938-83da2bf435e5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:54.266533 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8298ed75-44c8-4bef-9f78-efa588461cb3 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:54.267202 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8298ed75-44c8-4bef-9f78-efa588461cb3 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:54.268161 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8298ed75-44c8-4bef-9f78-efa588461cb3 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:54.269126 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8298ed75-44c8-4bef-9f78-efa588461cb3 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:54.281012 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-231076d4-3c81-4333-9938-83da2bf435e5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:54.283293 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-231076d4-3c81-4333-9938-83da2bf435e5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:54.285517 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-231076d4-3c81-4333-9938-83da2bf435e5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.149959 Jul 23 21:33:54.286864 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2435/4955] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:33:54 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:33:54.297266 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-8298ed75-44c8-4bef-9f78-efa588461cb3 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] HTTP exception thrown: Instance bbee3556-287f-42a5-a6a8-84356c840b67 could not be found. Jul 23 21:33:54.299341 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-8298ed75-44c8-4bef-9f78-efa588461cb3 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Request method failure captured: Jul 23 21:33:54.299341 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/servers/bbee3556-287f-42a5-a6a8-84356c840b67 HTTP/1.1 Jul 23 21:33:54.299341 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:33:54.299341 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:33:54.299341 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:33:54.299341 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:33:54.299341 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:33:54.299341 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:33:54.299341 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:33:54.299341 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:33:54.299341 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3Gh6HV9tIHJcoN46Wjr6EBasJhEuZbFRe23VWqvOs5i0B_4KLAGeVvnmZ6iexSHuUfOXTk6UOU6O-9Emh9fXdmyDDqxExiJefgV0tjF1ehtFmzTkKcDham_s0PhpTyidjx3XByPfr1uqB9BNvtB5vj0aHZ_s7b1yGmPK6uTOhFc95ZY Jul 23 21:33:54.299341 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:33:54.299341 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:33:54.299341 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:33:54.299341 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:33:54.299341 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:33:54.299341 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:33:54.299341 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: ebcf55bcaba04bf8ae8a9b2ac09e8d98 Jul 23 21:33:54.299341 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-AttachVolumeNegativeTest-319311902 Jul 23 21:33:54.299341 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:33:54.299341 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:33:54.299341 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ebcf55bcaba04bf8ae8a9b2ac09e8d98"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ebcf55bcaba04bf8ae8a9b2ac09e8d98"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ebcf55bcaba04bf8ae8a9b2ac09e8d98", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ebcf55bcaba04bf8ae8a9b2ac09e8d98"}]}] Jul 23 21:33:54.299341 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-AttachVolumeNegativeTest-319311902 Jul 23 21:33:54.299341 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: ebcf55bcaba04bf8ae8a9b2ac09e8d98 Jul 23 21:33:54.299341 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-319311902 Jul 23 21:33:54.299341 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-AttachVolumeNegativeTest-319311902-project Jul 23 21:33:54.299341 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:33:54.299341 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:33:54.299341 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 37b1e260651b4dffa7c1efe8e9d0f144 Jul 23 21:33:54.299341 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-AttachVolumeNegativeTest-319311902-project Jul 23 21:33:54.299341 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:33:54.299341 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance bbee3556-287f-42a5-a6a8-84356c840b67 could not be found. Jul 23 21:33:54.299341 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': 'bbee3556-287f-42a5-a6a8-84356c840b67'} Jul 23 21:33:54.299341 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:33:54.299341 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:33:54.299341 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:33:54.299341 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:33:54.299341 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:33:54.299341 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:33:54.299341 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:33:54.299341 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:33:54.299341 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:33:54.299341 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:33:54.299341 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbee3556-287f-42a5-a6a8-84356c840b67 could not be found. Jul 23 21:33:54.299341 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:33:54.299341 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:33:54.299341 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:33:54.299341 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:33:54.299341 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:33:54.299341 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:33:54.299341 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:33:54.299341 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:33:54.299341 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:33:54.299341 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:33:54.299341 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:33:54.299341 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:33:54.299341 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:33:54.299341 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:33:54.299341 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:33:54.299341 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:33:54.299341 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbee3556-287f-42a5-a6a8-84356c840b67 could not be found. Jul 23 21:33:54.299341 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:33:54.299341 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:33:54.299341 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:33:54.304325 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:33:54.304325 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:33:54.304325 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:33:54.304325 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:33:54.304325 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:33:54.304325 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbee3556-287f-42a5-a6a8-84356c840b67 could not be found. Jul 23 21:33:54.304325 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:33:54.305714 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-8298ed75-44c8-4bef-9f78-efa588461cb3 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Returning 404 to user: Instance bbee3556-287f-42a5-a6a8-84356c840b67 could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:33:54.306908 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-8298ed75-44c8-4bef-9f78-efa588461cb3 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] 10.222.0.17 "GET /compute/v2.1/servers/bbee3556-287f-42a5-a6a8-84356c840b67" status: 404 len: 111 microversion: 2.1 time: 0.063892 Jul 23 21:33:54.311568 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2521/4956] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:33:54 2022] GET /compute/v2.1/servers/bbee3556-287f-42a5-a6a8-84356c840b67 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 23 21:33:54.318119 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-17636d6f-ed3a-41e7-97f9-1890f7284ffa tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Calling method '.version_select at 0x7f0b4674f4c0>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:54.352097 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-17636d6f-ed3a-41e7-97f9-1890f7284ffa tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1454771714" status: 202 len: 0 microversion: 2.1 time: 0.039020 Jul 23 21:33:54.354673 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2436/4957] 10.222.0.17 () {58 vars in 1220 bytes} [Sat Jul 23 21:33:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1454771714 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:33:55.306135 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-299eabc9-2fa7-4499-ae57-ef7b5b25643c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:55.307362 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-299eabc9-2fa7-4499-ae57-ef7b5b25643c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:55.315702 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-299eabc9-2fa7-4499-ae57-ef7b5b25643c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:55.316806 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-299eabc9-2fa7-4499-ae57-ef7b5b25643c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:55.318106 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-299eabc9-2fa7-4499-ae57-ef7b5b25643c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:55.318719 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-299eabc9-2fa7-4499-ae57-ef7b5b25643c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:55.388355 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ccb1fc6d-4a66-4b57-b4e2-15a9d15703c3 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:55.388838 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ccb1fc6d-4a66-4b57-b4e2-15a9d15703c3 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] [instance: bbee3556-287f-42a5-a6a8-84356c840b67] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:55.396806 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ccb1fc6d-4a66-4b57-b4e2-15a9d15703c3 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:55.398002 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ccb1fc6d-4a66-4b57-b4e2-15a9d15703c3 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:55.399108 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ccb1fc6d-4a66-4b57-b4e2-15a9d15703c3 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:55.400058 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ccb1fc6d-4a66-4b57-b4e2-15a9d15703c3 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:55.403038 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-299eabc9-2fa7-4499-ae57-ef7b5b25643c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:55.412226 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-299eabc9-2fa7-4499-ae57-ef7b5b25643c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:55.413818 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-299eabc9-2fa7-4499-ae57-ef7b5b25643c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:55.416790 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-299eabc9-2fa7-4499-ae57-ef7b5b25643c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.116112 Jul 23 21:33:55.418516 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-ccb1fc6d-4a66-4b57-b4e2-15a9d15703c3 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] HTTP exception thrown: Instance bbee3556-287f-42a5-a6a8-84356c840b67 could not be found. Jul 23 21:33:55.420771 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ccb1fc6d-4a66-4b57-b4e2-15a9d15703c3 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Request method failure captured: Jul 23 21:33:55.420771 ncdv-master-1 devstack@n-api.service[131320]: request: DELETE /compute/v2.1/servers/bbee3556-287f-42a5-a6a8-84356c840b67 HTTP/1.1 Jul 23 21:33:55.420771 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:33:55.420771 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:33:55.420771 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:33:55.420771 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:33:55.420771 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:33:55.420771 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:33:55.420771 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:33:55.420771 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:33:55.420771 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3Gh6HV9tIHJcoN46Wjr6EBasJhEuZbFRe23VWqvOs5i0B_4KLAGeVvnmZ6iexSHuUfOXTk6UOU6O-9Emh9fXdmyDDqxExiJefgV0tjF1ehtFmzTkKcDham_s0PhpTyidjx3XByPfr1uqB9BNvtB5vj0aHZ_s7b1yGmPK6uTOhFc95ZY Jul 23 21:33:55.420771 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:33:55.420771 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:33:55.420771 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:33:55.420771 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:33:55.420771 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:33:55.420771 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:33:55.420771 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: ebcf55bcaba04bf8ae8a9b2ac09e8d98 Jul 23 21:33:55.420771 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-AttachVolumeNegativeTest-319311902 Jul 23 21:33:55.420771 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:33:55.420771 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:33:55.420771 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ebcf55bcaba04bf8ae8a9b2ac09e8d98"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ebcf55bcaba04bf8ae8a9b2ac09e8d98"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ebcf55bcaba04bf8ae8a9b2ac09e8d98", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ebcf55bcaba04bf8ae8a9b2ac09e8d98"}]}] Jul 23 21:33:55.420771 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-AttachVolumeNegativeTest-319311902 Jul 23 21:33:55.420771 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: ebcf55bcaba04bf8ae8a9b2ac09e8d98 Jul 23 21:33:55.420771 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-319311902 Jul 23 21:33:55.420771 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-AttachVolumeNegativeTest-319311902-project Jul 23 21:33:55.420771 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:33:55.420771 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:33:55.420771 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 37b1e260651b4dffa7c1efe8e9d0f144 Jul 23 21:33:55.420771 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-AttachVolumeNegativeTest-319311902-project Jul 23 21:33:55.420771 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:33:55.420771 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance bbee3556-287f-42a5-a6a8-84356c840b67 could not be found. Jul 23 21:33:55.420771 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': 'bbee3556-287f-42a5-a6a8-84356c840b67'} Jul 23 21:33:55.420771 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:33:55.420771 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:33:55.420771 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:33:55.420771 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:33:55.420771 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:33:55.420771 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:33:55.420771 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:33:55.420771 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:33:55.420771 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:33:55.420771 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:33:55.420771 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbee3556-287f-42a5-a6a8-84356c840b67 could not be found. Jul 23 21:33:55.420771 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:55.420771 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:33:55.420771 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:55.420771 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:33:55.420771 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:33:55.420771 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:33:55.420771 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:33:55.420771 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:33:55.420771 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:33:55.420771 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:33:55.420771 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 23 21:33:55.420771 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 23 21:33:55.420771 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 23 21:33:55.420771 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 23 21:33:55.420771 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:33:55.420771 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:33:55.420771 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:33:55.420771 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:33:55.425417 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbee3556-287f-42a5-a6a8-84356c840b67 could not be found. Jul 23 21:33:55.425417 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:55.425417 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:33:55.425417 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:55.425417 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:33:55.425417 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:33:55.425417 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:33:55.425417 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:33:55.425417 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:33:55.425417 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbee3556-287f-42a5-a6a8-84356c840b67 could not be found. Jul 23 21:33:55.425417 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:55.427940 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ccb1fc6d-4a66-4b57-b4e2-15a9d15703c3 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Returning 404 to user: Instance bbee3556-287f-42a5-a6a8-84356c840b67 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:33:55.429273 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2522/4958] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:33:55 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:33:55.429713 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ccb1fc6d-4a66-4b57-b4e2-15a9d15703c3 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] 10.222.0.17 "DELETE /compute/v2.1/servers/bbee3556-287f-42a5-a6a8-84356c840b67" status: 404 len: 111 microversion: 2.1 time: 0.048658 Jul 23 21:33:55.430433 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2437/4959] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:33:55 2022] DELETE /compute/v2.1/servers/bbee3556-287f-42a5-a6a8-84356c840b67 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:33:55.440312 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-07cb24e8-2659-4fa0-9326-1808f3de44d4 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:55.441751 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-07cb24e8-2659-4fa0-9326-1808f3de44d4 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] [instance: bbee3556-287f-42a5-a6a8-84356c840b67] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:55.448583 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-07cb24e8-2659-4fa0-9326-1808f3de44d4 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:55.449415 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-07cb24e8-2659-4fa0-9326-1808f3de44d4 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:55.450697 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-07cb24e8-2659-4fa0-9326-1808f3de44d4 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:55.451733 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-07cb24e8-2659-4fa0-9326-1808f3de44d4 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:55.466553 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-07cb24e8-2659-4fa0-9326-1808f3de44d4 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] HTTP exception thrown: Instance bbee3556-287f-42a5-a6a8-84356c840b67 could not be found. Jul 23 21:33:55.468219 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-07cb24e8-2659-4fa0-9326-1808f3de44d4 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Request method failure captured: Jul 23 21:33:55.468219 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/servers/bbee3556-287f-42a5-a6a8-84356c840b67 HTTP/1.1 Jul 23 21:33:55.468219 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:33:55.468219 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:33:55.468219 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:33:55.468219 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:33:55.468219 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:33:55.468219 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:33:55.468219 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:33:55.468219 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:33:55.468219 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3Gh6HV9tIHJcoN46Wjr6EBasJhEuZbFRe23VWqvOs5i0B_4KLAGeVvnmZ6iexSHuUfOXTk6UOU6O-9Emh9fXdmyDDqxExiJefgV0tjF1ehtFmzTkKcDham_s0PhpTyidjx3XByPfr1uqB9BNvtB5vj0aHZ_s7b1yGmPK6uTOhFc95ZY Jul 23 21:33:55.468219 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:33:55.468219 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:33:55.468219 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:33:55.468219 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:33:55.468219 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:33:55.468219 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:33:55.468219 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: ebcf55bcaba04bf8ae8a9b2ac09e8d98 Jul 23 21:33:55.468219 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-AttachVolumeNegativeTest-319311902 Jul 23 21:33:55.468219 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:33:55.468219 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:33:55.468219 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ebcf55bcaba04bf8ae8a9b2ac09e8d98"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ebcf55bcaba04bf8ae8a9b2ac09e8d98"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ebcf55bcaba04bf8ae8a9b2ac09e8d98", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ebcf55bcaba04bf8ae8a9b2ac09e8d98"}]}] Jul 23 21:33:55.468219 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-AttachVolumeNegativeTest-319311902 Jul 23 21:33:55.468219 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: ebcf55bcaba04bf8ae8a9b2ac09e8d98 Jul 23 21:33:55.468219 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-319311902 Jul 23 21:33:55.468219 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-AttachVolumeNegativeTest-319311902-project Jul 23 21:33:55.468219 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:33:55.468219 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:33:55.468219 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 37b1e260651b4dffa7c1efe8e9d0f144 Jul 23 21:33:55.468219 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-AttachVolumeNegativeTest-319311902-project Jul 23 21:33:55.468219 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:33:55.468219 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance bbee3556-287f-42a5-a6a8-84356c840b67 could not be found. Jul 23 21:33:55.468219 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': 'bbee3556-287f-42a5-a6a8-84356c840b67'} Jul 23 21:33:55.468219 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:33:55.468219 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:33:55.468219 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:33:55.468219 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:33:55.468219 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:33:55.468219 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:33:55.468219 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:33:55.468219 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:33:55.468219 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:33:55.468219 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:33:55.468219 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbee3556-287f-42a5-a6a8-84356c840b67 could not be found. Jul 23 21:33:55.468219 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:33:55.468219 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:33:55.468219 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:33:55.468219 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:33:55.468219 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:33:55.468219 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:33:55.468219 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:33:55.468219 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:33:55.468219 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:33:55.468219 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:33:55.468219 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:33:55.468219 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:33:55.468219 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:33:55.468219 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:33:55.468219 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:33:55.468219 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:33:55.468219 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbee3556-287f-42a5-a6a8-84356c840b67 could not be found. Jul 23 21:33:55.468219 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:33:55.468219 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:33:55.468219 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:33:55.472920 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:33:55.472920 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:33:55.472920 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:33:55.472920 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:33:55.472920 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:33:55.472920 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbee3556-287f-42a5-a6a8-84356c840b67 could not be found. Jul 23 21:33:55.472920 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:33:55.472920 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-07cb24e8-2659-4fa0-9326-1808f3de44d4 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Returning 404 to user: Instance bbee3556-287f-42a5-a6a8-84356c840b67 could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:33:55.472920 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-07cb24e8-2659-4fa0-9326-1808f3de44d4 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] 10.222.0.17 "GET /compute/v2.1/servers/bbee3556-287f-42a5-a6a8-84356c840b67" status: 404 len: 111 microversion: 2.1 time: 0.035823 Jul 23 21:33:55.472920 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2523/4960] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:33:55 2022] GET /compute/v2.1/servers/bbee3556-287f-42a5-a6a8-84356c840b67 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 23 21:33:55.645725 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5b5f32a8-1fc3-415a-bbaf-d5ae2f5cca6f tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:55.646260 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5b5f32a8-1fc3-415a-bbaf-d5ae2f5cca6f tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] [instance: f66b6134-b8aa-4df7-9905-b7488fe6bc85] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:55.652715 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5b5f32a8-1fc3-415a-bbaf-d5ae2f5cca6f tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:55.653162 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5b5f32a8-1fc3-415a-bbaf-d5ae2f5cca6f tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:55.654063 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5b5f32a8-1fc3-415a-bbaf-d5ae2f5cca6f tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:55.654675 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5b5f32a8-1fc3-415a-bbaf-d5ae2f5cca6f tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:55.668879 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-5b5f32a8-1fc3-415a-bbaf-d5ae2f5cca6f tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] HTTP exception thrown: Instance f66b6134-b8aa-4df7-9905-b7488fe6bc85 could not be found. Jul 23 21:33:55.670779 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5b5f32a8-1fc3-415a-bbaf-d5ae2f5cca6f tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Request method failure captured: Jul 23 21:33:55.670779 ncdv-master-1 devstack@n-api.service[131320]: request: DELETE /compute/v2.1/servers/f66b6134-b8aa-4df7-9905-b7488fe6bc85 HTTP/1.1 Jul 23 21:33:55.670779 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:33:55.670779 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:33:55.670779 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:33:55.670779 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:33:55.670779 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:33:55.670779 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:33:55.670779 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:33:55.670779 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:33:55.670779 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3Gh6HV9tIHJcoN46Wjr6EBasJhEuZbFRe23VWqvOs5i0B_4KLAGeVvnmZ6iexSHuUfOXTk6UOU6O-9Emh9fXdmyDDqxExiJefgV0tjF1ehtFmzTkKcDham_s0PhpTyidjx3XByPfr1uqB9BNvtB5vj0aHZ_s7b1yGmPK6uTOhFc95ZY Jul 23 21:33:55.670779 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:33:55.670779 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:33:55.670779 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:33:55.670779 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:33:55.670779 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:33:55.670779 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:33:55.670779 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: ebcf55bcaba04bf8ae8a9b2ac09e8d98 Jul 23 21:33:55.670779 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-AttachVolumeNegativeTest-319311902 Jul 23 21:33:55.670779 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:33:55.670779 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:33:55.670779 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ebcf55bcaba04bf8ae8a9b2ac09e8d98"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ebcf55bcaba04bf8ae8a9b2ac09e8d98"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ebcf55bcaba04bf8ae8a9b2ac09e8d98", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ebcf55bcaba04bf8ae8a9b2ac09e8d98"}]}] Jul 23 21:33:55.670779 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-AttachVolumeNegativeTest-319311902 Jul 23 21:33:55.670779 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: ebcf55bcaba04bf8ae8a9b2ac09e8d98 Jul 23 21:33:55.670779 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-319311902 Jul 23 21:33:55.670779 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-AttachVolumeNegativeTest-319311902-project Jul 23 21:33:55.670779 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:33:55.670779 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:33:55.670779 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 37b1e260651b4dffa7c1efe8e9d0f144 Jul 23 21:33:55.670779 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-AttachVolumeNegativeTest-319311902-project Jul 23 21:33:55.670779 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:33:55.670779 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance f66b6134-b8aa-4df7-9905-b7488fe6bc85 could not be found. Jul 23 21:33:55.670779 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': 'f66b6134-b8aa-4df7-9905-b7488fe6bc85'} Jul 23 21:33:55.670779 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:33:55.670779 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:33:55.670779 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:33:55.670779 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:33:55.670779 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:33:55.670779 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:33:55.670779 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:33:55.670779 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:33:55.670779 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:33:55.670779 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:33:55.670779 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f66b6134-b8aa-4df7-9905-b7488fe6bc85 could not be found. Jul 23 21:33:55.670779 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:55.670779 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:33:55.670779 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:55.670779 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:33:55.670779 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:33:55.670779 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:33:55.670779 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:33:55.670779 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:33:55.670779 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:33:55.670779 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:33:55.670779 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 23 21:33:55.670779 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 23 21:33:55.670779 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 23 21:33:55.670779 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 23 21:33:55.670779 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:33:55.670779 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:33:55.670779 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:33:55.670779 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:33:55.675549 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f66b6134-b8aa-4df7-9905-b7488fe6bc85 could not be found. Jul 23 21:33:55.675549 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:55.675549 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:33:55.675549 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:55.675549 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:33:55.675549 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:33:55.675549 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:33:55.675549 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:33:55.675549 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:33:55.675549 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f66b6134-b8aa-4df7-9905-b7488fe6bc85 could not be found. Jul 23 21:33:55.675549 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:55.675549 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5b5f32a8-1fc3-415a-bbaf-d5ae2f5cca6f tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Returning 404 to user: Instance f66b6134-b8aa-4df7-9905-b7488fe6bc85 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:33:55.675549 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5b5f32a8-1fc3-415a-bbaf-d5ae2f5cca6f tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] 10.222.0.17 "DELETE /compute/v2.1/servers/f66b6134-b8aa-4df7-9905-b7488fe6bc85" status: 404 len: 111 microversion: 2.1 time: 0.030513 Jul 23 21:33:55.675549 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2438/4961] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:33:55 2022] DELETE /compute/v2.1/servers/f66b6134-b8aa-4df7-9905-b7488fe6bc85 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:33:55.682213 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-43167344-9c28-4ed3-afbb-ef529cbe72b4 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:55.682754 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-43167344-9c28-4ed3-afbb-ef529cbe72b4 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] [instance: f66b6134-b8aa-4df7-9905-b7488fe6bc85] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:55.689391 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-43167344-9c28-4ed3-afbb-ef529cbe72b4 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:55.690222 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-43167344-9c28-4ed3-afbb-ef529cbe72b4 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:55.691335 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-43167344-9c28-4ed3-afbb-ef529cbe72b4 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:55.692018 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-43167344-9c28-4ed3-afbb-ef529cbe72b4 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:55.706703 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-43167344-9c28-4ed3-afbb-ef529cbe72b4 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] HTTP exception thrown: Instance f66b6134-b8aa-4df7-9905-b7488fe6bc85 could not be found. Jul 23 21:33:55.708552 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-43167344-9c28-4ed3-afbb-ef529cbe72b4 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Request method failure captured: Jul 23 21:33:55.708552 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/servers/f66b6134-b8aa-4df7-9905-b7488fe6bc85 HTTP/1.1 Jul 23 21:33:55.708552 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:33:55.708552 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:33:55.708552 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:33:55.708552 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:33:55.708552 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:33:55.708552 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:33:55.708552 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:33:55.708552 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:33:55.708552 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3Gh6HV9tIHJcoN46Wjr6EBasJhEuZbFRe23VWqvOs5i0B_4KLAGeVvnmZ6iexSHuUfOXTk6UOU6O-9Emh9fXdmyDDqxExiJefgV0tjF1ehtFmzTkKcDham_s0PhpTyidjx3XByPfr1uqB9BNvtB5vj0aHZ_s7b1yGmPK6uTOhFc95ZY Jul 23 21:33:55.708552 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:33:55.708552 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:33:55.708552 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:33:55.708552 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:33:55.708552 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:33:55.708552 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:33:55.708552 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: ebcf55bcaba04bf8ae8a9b2ac09e8d98 Jul 23 21:33:55.708552 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-AttachVolumeNegativeTest-319311902 Jul 23 21:33:55.708552 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:33:55.708552 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:33:55.708552 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ebcf55bcaba04bf8ae8a9b2ac09e8d98"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ebcf55bcaba04bf8ae8a9b2ac09e8d98"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ebcf55bcaba04bf8ae8a9b2ac09e8d98", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ebcf55bcaba04bf8ae8a9b2ac09e8d98"}]}] Jul 23 21:33:55.708552 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-AttachVolumeNegativeTest-319311902 Jul 23 21:33:55.708552 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: ebcf55bcaba04bf8ae8a9b2ac09e8d98 Jul 23 21:33:55.708552 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-319311902 Jul 23 21:33:55.708552 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-AttachVolumeNegativeTest-319311902-project Jul 23 21:33:55.708552 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:33:55.708552 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:33:55.708552 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 37b1e260651b4dffa7c1efe8e9d0f144 Jul 23 21:33:55.708552 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-AttachVolumeNegativeTest-319311902-project Jul 23 21:33:55.708552 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:33:55.708552 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance f66b6134-b8aa-4df7-9905-b7488fe6bc85 could not be found. Jul 23 21:33:55.708552 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': 'f66b6134-b8aa-4df7-9905-b7488fe6bc85'} Jul 23 21:33:55.708552 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:33:55.708552 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:33:55.708552 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:33:55.708552 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:33:55.708552 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:33:55.708552 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:33:55.708552 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:33:55.708552 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:33:55.708552 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:33:55.708552 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:33:55.708552 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f66b6134-b8aa-4df7-9905-b7488fe6bc85 could not be found. Jul 23 21:33:55.708552 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:33:55.708552 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:33:55.708552 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:33:55.708552 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:33:55.708552 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:33:55.708552 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:33:55.708552 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:33:55.708552 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:33:55.708552 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:33:55.708552 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:33:55.708552 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:33:55.708552 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:33:55.708552 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:33:55.708552 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:33:55.708552 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:33:55.708552 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:33:55.708552 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f66b6134-b8aa-4df7-9905-b7488fe6bc85 could not be found. Jul 23 21:33:55.708552 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:33:55.708552 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:33:55.708552 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:33:55.713258 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:33:55.713258 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:33:55.713258 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:33:55.713258 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:33:55.713258 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:33:55.713258 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f66b6134-b8aa-4df7-9905-b7488fe6bc85 could not be found. Jul 23 21:33:55.713258 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:33:55.713258 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-43167344-9c28-4ed3-afbb-ef529cbe72b4 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Returning 404 to user: Instance f66b6134-b8aa-4df7-9905-b7488fe6bc85 could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:33:55.713258 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-43167344-9c28-4ed3-afbb-ef529cbe72b4 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] 10.222.0.17 "GET /compute/v2.1/servers/f66b6134-b8aa-4df7-9905-b7488fe6bc85" status: 404 len: 111 microversion: 2.1 time: 0.032869 Jul 23 21:33:55.715419 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2524/4962] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:33:55 2022] GET /compute/v2.1/servers/f66b6134-b8aa-4df7-9905-b7488fe6bc85 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:33:55.887229 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3acf7118-ae7a-4aa3-b09e-38d3258672e0 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:55.887723 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-3acf7118-ae7a-4aa3-b09e-38d3258672e0 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] [instance: b90d9c54-1b5f-40db-acc6-67aaf46def15] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:55.895283 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3acf7118-ae7a-4aa3-b09e-38d3258672e0 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:55.895832 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3acf7118-ae7a-4aa3-b09e-38d3258672e0 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:55.896885 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3acf7118-ae7a-4aa3-b09e-38d3258672e0 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:55.897541 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3acf7118-ae7a-4aa3-b09e-38d3258672e0 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:55.901997 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=100 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:33:55.913038 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-3acf7118-ae7a-4aa3-b09e-38d3258672e0 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] HTTP exception thrown: Instance b90d9c54-1b5f-40db-acc6-67aaf46def15 could not be found. Jul 23 21:33:55.914660 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3acf7118-ae7a-4aa3-b09e-38d3258672e0 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Request method failure captured: Jul 23 21:33:55.914660 ncdv-master-1 devstack@n-api.service[131320]: request: DELETE /compute/v2.1/servers/b90d9c54-1b5f-40db-acc6-67aaf46def15 HTTP/1.1 Jul 23 21:33:55.914660 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:33:55.914660 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:33:55.914660 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:33:55.914660 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:33:55.914660 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:33:55.914660 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:33:55.914660 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:33:55.914660 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:33:55.914660 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3Gh6HV9tIHJcoN46Wjr6EBasJhEuZbFRe23VWqvOs5i0B_4KLAGeVvnmZ6iexSHuUfOXTk6UOU6O-9Emh9fXdmyDDqxExiJefgV0tjF1ehtFmzTkKcDham_s0PhpTyidjx3XByPfr1uqB9BNvtB5vj0aHZ_s7b1yGmPK6uTOhFc95ZY Jul 23 21:33:55.914660 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:33:55.914660 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:33:55.914660 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:33:55.914660 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:33:55.914660 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:33:55.914660 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:33:55.914660 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: ebcf55bcaba04bf8ae8a9b2ac09e8d98 Jul 23 21:33:55.914660 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-AttachVolumeNegativeTest-319311902 Jul 23 21:33:55.914660 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:33:55.914660 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:33:55.914660 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ebcf55bcaba04bf8ae8a9b2ac09e8d98"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ebcf55bcaba04bf8ae8a9b2ac09e8d98"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ebcf55bcaba04bf8ae8a9b2ac09e8d98", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ebcf55bcaba04bf8ae8a9b2ac09e8d98"}]}] Jul 23 21:33:55.914660 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-AttachVolumeNegativeTest-319311902 Jul 23 21:33:55.914660 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: ebcf55bcaba04bf8ae8a9b2ac09e8d98 Jul 23 21:33:55.914660 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-319311902 Jul 23 21:33:55.914660 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-AttachVolumeNegativeTest-319311902-project Jul 23 21:33:55.914660 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:33:55.914660 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:33:55.914660 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 37b1e260651b4dffa7c1efe8e9d0f144 Jul 23 21:33:55.914660 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-AttachVolumeNegativeTest-319311902-project Jul 23 21:33:55.914660 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:33:55.914660 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance b90d9c54-1b5f-40db-acc6-67aaf46def15 could not be found. Jul 23 21:33:55.914660 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': 'b90d9c54-1b5f-40db-acc6-67aaf46def15'} Jul 23 21:33:55.914660 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:33:55.914660 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:33:55.914660 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:33:55.914660 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:33:55.914660 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:33:55.914660 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:33:55.914660 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:33:55.914660 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:33:55.914660 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:33:55.914660 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:33:55.914660 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b90d9c54-1b5f-40db-acc6-67aaf46def15 could not be found. Jul 23 21:33:55.914660 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:55.914660 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:33:55.914660 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:55.914660 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:33:55.914660 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:33:55.914660 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:33:55.914660 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:33:55.914660 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:33:55.914660 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:33:55.914660 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:33:55.914660 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 23 21:33:55.914660 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 23 21:33:55.914660 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 23 21:33:55.914660 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 23 21:33:55.914660 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:33:55.914660 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:33:55.914660 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:33:55.914660 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:33:55.919399 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b90d9c54-1b5f-40db-acc6-67aaf46def15 could not be found. Jul 23 21:33:55.919399 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:55.919399 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:33:55.919399 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:55.919399 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:33:55.919399 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:33:55.919399 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:33:55.919399 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:33:55.919399 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:33:55.919399 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b90d9c54-1b5f-40db-acc6-67aaf46def15 could not be found. Jul 23 21:33:55.919399 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:33:55.919399 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3acf7118-ae7a-4aa3-b09e-38d3258672e0 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Returning 404 to user: Instance b90d9c54-1b5f-40db-acc6-67aaf46def15 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:33:55.919399 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-3acf7118-ae7a-4aa3-b09e-38d3258672e0 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] 10.222.0.17 "DELETE /compute/v2.1/servers/b90d9c54-1b5f-40db-acc6-67aaf46def15" status: 404 len: 111 microversion: 2.1 time: 0.033618 Jul 23 21:33:55.919399 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2439/4963] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:33:55 2022] DELETE /compute/v2.1/servers/b90d9c54-1b5f-40db-acc6-67aaf46def15 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:33:55.924622 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-6e188093-5a51-4aaa-a849-9714d2326b96 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:55.925241 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-6e188093-5a51-4aaa-a849-9714d2326b96 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] [instance: b90d9c54-1b5f-40db-acc6-67aaf46def15] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:55.932620 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6e188093-5a51-4aaa-a849-9714d2326b96 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:55.933078 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6e188093-5a51-4aaa-a849-9714d2326b96 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:55.934035 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6e188093-5a51-4aaa-a849-9714d2326b96 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:55.934326 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6e188093-5a51-4aaa-a849-9714d2326b96 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:55.950372 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-6e188093-5a51-4aaa-a849-9714d2326b96 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] HTTP exception thrown: Instance b90d9c54-1b5f-40db-acc6-67aaf46def15 could not be found. Jul 23 21:33:55.952368 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-6e188093-5a51-4aaa-a849-9714d2326b96 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Request method failure captured: Jul 23 21:33:55.952368 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/servers/b90d9c54-1b5f-40db-acc6-67aaf46def15 HTTP/1.1 Jul 23 21:33:55.952368 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:33:55.952368 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:33:55.952368 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:33:55.952368 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:33:55.952368 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:33:55.952368 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:33:55.952368 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:33:55.952368 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:33:55.952368 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3Gh6HV9tIHJcoN46Wjr6EBasJhEuZbFRe23VWqvOs5i0B_4KLAGeVvnmZ6iexSHuUfOXTk6UOU6O-9Emh9fXdmyDDqxExiJefgV0tjF1ehtFmzTkKcDham_s0PhpTyidjx3XByPfr1uqB9BNvtB5vj0aHZ_s7b1yGmPK6uTOhFc95ZY Jul 23 21:33:55.952368 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:33:55.952368 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:33:55.952368 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:33:55.952368 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:33:55.952368 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:33:55.952368 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:33:55.952368 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: ebcf55bcaba04bf8ae8a9b2ac09e8d98 Jul 23 21:33:55.952368 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-AttachVolumeNegativeTest-319311902 Jul 23 21:33:55.952368 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:33:55.952368 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:33:55.952368 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ebcf55bcaba04bf8ae8a9b2ac09e8d98"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ebcf55bcaba04bf8ae8a9b2ac09e8d98"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ebcf55bcaba04bf8ae8a9b2ac09e8d98", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ebcf55bcaba04bf8ae8a9b2ac09e8d98"}]}] Jul 23 21:33:55.952368 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-AttachVolumeNegativeTest-319311902 Jul 23 21:33:55.952368 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: ebcf55bcaba04bf8ae8a9b2ac09e8d98 Jul 23 21:33:55.952368 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-319311902 Jul 23 21:33:55.952368 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-AttachVolumeNegativeTest-319311902-project Jul 23 21:33:55.952368 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:33:55.952368 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:33:55.952368 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 37b1e260651b4dffa7c1efe8e9d0f144 Jul 23 21:33:55.952368 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-AttachVolumeNegativeTest-319311902-project Jul 23 21:33:55.952368 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:33:55.952368 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance b90d9c54-1b5f-40db-acc6-67aaf46def15 could not be found. Jul 23 21:33:55.952368 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': 'b90d9c54-1b5f-40db-acc6-67aaf46def15'} Jul 23 21:33:55.952368 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:33:55.952368 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:33:55.952368 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:33:55.952368 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:33:55.952368 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:33:55.952368 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:33:55.952368 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:33:55.952368 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:33:55.952368 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:33:55.952368 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:33:55.952368 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b90d9c54-1b5f-40db-acc6-67aaf46def15 could not be found. Jul 23 21:33:55.952368 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:33:55.952368 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:33:55.952368 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:33:55.952368 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:33:55.952368 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:33:55.952368 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:33:55.952368 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:33:55.952368 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:33:55.952368 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:33:55.952368 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:33:55.952368 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:33:55.952368 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:33:55.952368 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:33:55.952368 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:33:55.952368 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:33:55.952368 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:33:55.952368 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b90d9c54-1b5f-40db-acc6-67aaf46def15 could not be found. Jul 23 21:33:55.952368 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:33:55.952368 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:33:55.952368 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:33:55.957336 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:33:55.957336 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:33:55.957336 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:33:55.957336 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:33:55.957336 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:33:55.957336 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b90d9c54-1b5f-40db-acc6-67aaf46def15 could not be found. Jul 23 21:33:55.957336 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:33:55.958986 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-6e188093-5a51-4aaa-a849-9714d2326b96 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] Returning 404 to user: Instance b90d9c54-1b5f-40db-acc6-67aaf46def15 could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:33:55.959932 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-6e188093-5a51-4aaa-a849-9714d2326b96 tempest-AttachVolumeNegativeTest-319311902 tempest-AttachVolumeNegativeTest-319311902-project] 10.222.0.17 "GET /compute/v2.1/servers/b90d9c54-1b5f-40db-acc6-67aaf46def15" status: 404 len: 111 microversion: 2.1 time: 0.039269 Jul 23 21:33:55.960512 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2525/4964] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:33:55 2022] GET /compute/v2.1/servers/b90d9c54-1b5f-40db-acc6-67aaf46def15 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:33:56.436524 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-46d72a1b-972c-4d71-8c53-025c6997c095 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:56.438071 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-46d72a1b-972c-4d71-8c53-025c6997c095 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:56.444975 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-46d72a1b-972c-4d71-8c53-025c6997c095 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:56.445908 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-46d72a1b-972c-4d71-8c53-025c6997c095 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:56.446911 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-46d72a1b-972c-4d71-8c53-025c6997c095 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:56.447566 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-46d72a1b-972c-4d71-8c53-025c6997c095 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:56.525458 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-46d72a1b-972c-4d71-8c53-025c6997c095 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:56.536128 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-46d72a1b-972c-4d71-8c53-025c6997c095 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:56.538304 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-46d72a1b-972c-4d71-8c53-025c6997c095 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:56.539791 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-46d72a1b-972c-4d71-8c53-025c6997c095 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.108173 Jul 23 21:33:56.542647 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2440/4965] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:33:56 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:33:57.558308 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e0b8c085-e9f5-4259-bd1b-bac4ca19abe4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:57.563980 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-e0b8c085-e9f5-4259-bd1b-bac4ca19abe4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:57.576778 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e0b8c085-e9f5-4259-bd1b-bac4ca19abe4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:57.577274 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e0b8c085-e9f5-4259-bd1b-bac4ca19abe4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:57.578075 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e0b8c085-e9f5-4259-bd1b-bac4ca19abe4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:57.581235 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e0b8c085-e9f5-4259-bd1b-bac4ca19abe4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:57.669487 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-e0b8c085-e9f5-4259-bd1b-bac4ca19abe4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:57.694430 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-e0b8c085-e9f5-4259-bd1b-bac4ca19abe4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:57.699152 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-e0b8c085-e9f5-4259-bd1b-bac4ca19abe4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:57.701494 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-e0b8c085-e9f5-4259-bd1b-bac4ca19abe4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.147344 Jul 23 21:33:57.717843 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2526/4966] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:33:57 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:33:58.727221 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b7a07c89-3f84-4c35-8b95-e733df71d0ce tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:58.728059 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b7a07c89-3f84-4c35-8b95-e733df71d0ce tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:58.746600 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b7a07c89-3f84-4c35-8b95-e733df71d0ce tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:58.747419 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b7a07c89-3f84-4c35-8b95-e733df71d0ce tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:58.748254 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b7a07c89-3f84-4c35-8b95-e733df71d0ce tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:58.750875 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b7a07c89-3f84-4c35-8b95-e733df71d0ce tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:58.866914 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b7a07c89-3f84-4c35-8b95-e733df71d0ce tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:58.880346 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b7a07c89-3f84-4c35-8b95-e733df71d0ce tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:58.882663 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b7a07c89-3f84-4c35-8b95-e733df71d0ce tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:33:58.884020 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b7a07c89-3f84-4c35-8b95-e733df71d0ce tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.162349 Jul 23 21:33:58.885072 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2441/4967] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:33:58 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:33:59.904112 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-cb2b6886-4d52-4dec-8518-36eef6c609be tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:33:59.904724 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-cb2b6886-4d52-4dec-8518-36eef6c609be tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:33:59.913769 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cb2b6886-4d52-4dec-8518-36eef6c609be tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:59.914260 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cb2b6886-4d52-4dec-8518-36eef6c609be tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:59.915069 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cb2b6886-4d52-4dec-8518-36eef6c609be tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:33:59.915512 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cb2b6886-4d52-4dec-8518-36eef6c609be tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:33:59.965281 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:00.036794 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-cb2b6886-4d52-4dec-8518-36eef6c609be tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:00.051783 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-cb2b6886-4d52-4dec-8518-36eef6c609be tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:00.053797 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-cb2b6886-4d52-4dec-8518-36eef6c609be tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:00.055376 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-cb2b6886-4d52-4dec-8518-36eef6c609be tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.156322 Jul 23 21:34:00.056158 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2527/4968] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:33:59 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:34:01.084568 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ff56646c-e162-4624-8447-d893335a60f6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:34:01.085367 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ff56646c-e162-4624-8447-d893335a60f6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:34:01.097915 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ff56646c-e162-4624-8447-d893335a60f6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:01.099292 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ff56646c-e162-4624-8447-d893335a60f6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:01.101935 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ff56646c-e162-4624-8447-d893335a60f6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:01.103111 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ff56646c-e162-4624-8447-d893335a60f6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:01.191622 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ff56646c-e162-4624-8447-d893335a60f6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:01.206903 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ff56646c-e162-4624-8447-d893335a60f6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:01.208942 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ff56646c-e162-4624-8447-d893335a60f6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:01.211198 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ff56646c-e162-4624-8447-d893335a60f6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.138202 Jul 23 21:34:01.219258 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2442/4969] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:34:01 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:34:02.230561 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-76db29cb-cd84-4e42-81f6-52a7a3863cf8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:34:02.231166 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-76db29cb-cd84-4e42-81f6-52a7a3863cf8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:34:02.238215 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-76db29cb-cd84-4e42-81f6-52a7a3863cf8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:02.238673 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-76db29cb-cd84-4e42-81f6-52a7a3863cf8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:02.239461 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-76db29cb-cd84-4e42-81f6-52a7a3863cf8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:02.239906 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-76db29cb-cd84-4e42-81f6-52a7a3863cf8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:02.315053 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-76db29cb-cd84-4e42-81f6-52a7a3863cf8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:02.324818 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-76db29cb-cd84-4e42-81f6-52a7a3863cf8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:02.326973 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-76db29cb-cd84-4e42-81f6-52a7a3863cf8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:02.328854 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-76db29cb-cd84-4e42-81f6-52a7a3863cf8 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.102267 Jul 23 21:34:02.329629 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2528/4970] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:34:02 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:34:03.347632 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-003b12de-ec56-4b5c-af3a-15fa8368a42d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:34:03.348354 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-003b12de-ec56-4b5c-af3a-15fa8368a42d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:34:03.356141 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-003b12de-ec56-4b5c-af3a-15fa8368a42d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:03.356620 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-003b12de-ec56-4b5c-af3a-15fa8368a42d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:03.357356 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-003b12de-ec56-4b5c-af3a-15fa8368a42d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:03.357811 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-003b12de-ec56-4b5c-af3a-15fa8368a42d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:03.428310 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-003b12de-ec56-4b5c-af3a-15fa8368a42d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:03.439866 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-003b12de-ec56-4b5c-af3a-15fa8368a42d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:03.441374 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-003b12de-ec56-4b5c-af3a-15fa8368a42d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:03.442585 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-003b12de-ec56-4b5c-af3a-15fa8368a42d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.099030 Jul 23 21:34:03.443154 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2443/4971] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:34:03 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:34:04.461087 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-cb16655e-53f1-42ec-a909-2273a0a2d308 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:34:04.461698 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-cb16655e-53f1-42ec-a909-2273a0a2d308 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:34:04.469762 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cb16655e-53f1-42ec-a909-2273a0a2d308 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:04.470711 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cb16655e-53f1-42ec-a909-2273a0a2d308 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:04.472139 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cb16655e-53f1-42ec-a909-2273a0a2d308 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:04.472754 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cb16655e-53f1-42ec-a909-2273a0a2d308 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:04.546700 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-cb16655e-53f1-42ec-a909-2273a0a2d308 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:04.559631 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-cb16655e-53f1-42ec-a909-2273a0a2d308 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:04.561528 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-cb16655e-53f1-42ec-a909-2273a0a2d308 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:04.563195 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-cb16655e-53f1-42ec-a909-2273a0a2d308 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.106302 Jul 23 21:34:04.564678 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2529/4972] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:34:04 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:34:05.582490 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d766e976-42fd-4586-a18e-9bcbfb5b7503 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:34:05.583108 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d766e976-42fd-4586-a18e-9bcbfb5b7503 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:34:05.589840 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d766e976-42fd-4586-a18e-9bcbfb5b7503 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:05.591641 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d766e976-42fd-4586-a18e-9bcbfb5b7503 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:05.592439 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d766e976-42fd-4586-a18e-9bcbfb5b7503 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:05.593233 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d766e976-42fd-4586-a18e-9bcbfb5b7503 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:05.679042 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d766e976-42fd-4586-a18e-9bcbfb5b7503 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:05.692102 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d766e976-42fd-4586-a18e-9bcbfb5b7503 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:05.693827 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d766e976-42fd-4586-a18e-9bcbfb5b7503 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:05.695627 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d766e976-42fd-4586-a18e-9bcbfb5b7503 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.117034 Jul 23 21:34:05.696400 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2444/4973] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:34:05 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:34:06.716867 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d28d25ab-2438-44c1-bc3a-0924444b43d3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:34:06.716867 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-d28d25ab-2438-44c1-bc3a-0924444b43d3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:34:06.724255 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d28d25ab-2438-44c1-bc3a-0924444b43d3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:06.724930 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d28d25ab-2438-44c1-bc3a-0924444b43d3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:06.726264 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d28d25ab-2438-44c1-bc3a-0924444b43d3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:06.726828 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d28d25ab-2438-44c1-bc3a-0924444b43d3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:06.835527 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-d28d25ab-2438-44c1-bc3a-0924444b43d3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:06.857394 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-d28d25ab-2438-44c1-bc3a-0924444b43d3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:06.862274 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-d28d25ab-2438-44c1-bc3a-0924444b43d3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:06.868435 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-d28d25ab-2438-44c1-bc3a-0924444b43d3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.152386 Jul 23 21:34:06.878359 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2530/4974] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:34:06 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:34:07.889412 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6569a66e-ab56-4609-8f13-836158ee551a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:34:07.890458 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6569a66e-ab56-4609-8f13-836158ee551a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:34:07.899102 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6569a66e-ab56-4609-8f13-836158ee551a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:07.899560 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6569a66e-ab56-4609-8f13-836158ee551a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:07.900546 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6569a66e-ab56-4609-8f13-836158ee551a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:07.900996 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6569a66e-ab56-4609-8f13-836158ee551a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:07.975008 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6569a66e-ab56-4609-8f13-836158ee551a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:07.989608 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6569a66e-ab56-4609-8f13-836158ee551a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:07.991432 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6569a66e-ab56-4609-8f13-836158ee551a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:07.992644 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6569a66e-ab56-4609-8f13-836158ee551a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.107968 Jul 23 21:34:07.993488 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2445/4975] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:34:07 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:34:09.012945 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-47a87349-22b3-43d1-912c-e5ebf455691e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:34:09.013638 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-47a87349-22b3-43d1-912c-e5ebf455691e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:34:09.021774 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-47a87349-22b3-43d1-912c-e5ebf455691e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:09.022280 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-47a87349-22b3-43d1-912c-e5ebf455691e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:09.023065 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-47a87349-22b3-43d1-912c-e5ebf455691e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:09.023677 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-47a87349-22b3-43d1-912c-e5ebf455691e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:09.089699 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-47a87349-22b3-43d1-912c-e5ebf455691e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:09.099669 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-47a87349-22b3-43d1-912c-e5ebf455691e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:09.103326 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-47a87349-22b3-43d1-912c-e5ebf455691e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:09.104837 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-47a87349-22b3-43d1-912c-e5ebf455691e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.097439 Jul 23 21:34:09.105558 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2531/4976] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:34:09 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:34:10.129233 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8e985e8a-2cc3-4309-93d1-4e264549670f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:34:10.129920 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8e985e8a-2cc3-4309-93d1-4e264549670f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:34:10.136148 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8e985e8a-2cc3-4309-93d1-4e264549670f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:10.136603 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8e985e8a-2cc3-4309-93d1-4e264549670f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:10.137531 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8e985e8a-2cc3-4309-93d1-4e264549670f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:10.138037 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8e985e8a-2cc3-4309-93d1-4e264549670f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:10.217294 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8e985e8a-2cc3-4309-93d1-4e264549670f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:10.227437 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8e985e8a-2cc3-4309-93d1-4e264549670f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:10.228944 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8e985e8a-2cc3-4309-93d1-4e264549670f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:10.230333 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8e985e8a-2cc3-4309-93d1-4e264549670f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.108049 Jul 23 21:34:10.231245 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2446/4977] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:34:10 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:34:11.248787 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-6cf40d1f-b1b6-41cb-ab66-1e82fabe9708 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:34:11.249410 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-6cf40d1f-b1b6-41cb-ab66-1e82fabe9708 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:34:11.256871 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6cf40d1f-b1b6-41cb-ab66-1e82fabe9708 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:11.257627 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6cf40d1f-b1b6-41cb-ab66-1e82fabe9708 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:11.258622 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6cf40d1f-b1b6-41cb-ab66-1e82fabe9708 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:11.259659 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6cf40d1f-b1b6-41cb-ab66-1e82fabe9708 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:11.347653 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-6cf40d1f-b1b6-41cb-ab66-1e82fabe9708 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:11.360440 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-6cf40d1f-b1b6-41cb-ab66-1e82fabe9708 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:11.362890 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-6cf40d1f-b1b6-41cb-ab66-1e82fabe9708 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:11.365632 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-6cf40d1f-b1b6-41cb-ab66-1e82fabe9708 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.120332 Jul 23 21:34:11.367274 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2532/4978] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:34:11 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:34:12.384811 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-82f7f4e3-c449-4732-8869-642df0e4a221 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:34:12.385478 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-82f7f4e3-c449-4732-8869-642df0e4a221 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:34:12.392374 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-82f7f4e3-c449-4732-8869-642df0e4a221 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:12.392824 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-82f7f4e3-c449-4732-8869-642df0e4a221 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:12.393602 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-82f7f4e3-c449-4732-8869-642df0e4a221 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:12.394069 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-82f7f4e3-c449-4732-8869-642df0e4a221 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:12.465590 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-82f7f4e3-c449-4732-8869-642df0e4a221 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:12.476689 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-82f7f4e3-c449-4732-8869-642df0e4a221 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:12.478718 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-82f7f4e3-c449-4732-8869-642df0e4a221 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:12.480274 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-82f7f4e3-c449-4732-8869-642df0e4a221 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.099453 Jul 23 21:34:12.481639 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2447/4979] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:34:12 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:34:13.499949 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-9d51583e-7add-474c-96e4-d221ce2969d2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:34:13.501135 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-9d51583e-7add-474c-96e4-d221ce2969d2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:34:13.508669 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9d51583e-7add-474c-96e4-d221ce2969d2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:13.511273 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9d51583e-7add-474c-96e4-d221ce2969d2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:13.512109 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9d51583e-7add-474c-96e4-d221ce2969d2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:13.512559 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-9d51583e-7add-474c-96e4-d221ce2969d2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:13.602028 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-9d51583e-7add-474c-96e4-d221ce2969d2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:13.618047 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-9d51583e-7add-474c-96e4-d221ce2969d2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:13.620660 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-9d51583e-7add-474c-96e4-d221ce2969d2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:13.623766 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-9d51583e-7add-474c-96e4-d221ce2969d2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.127036 Jul 23 21:34:13.624837 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2533/4980] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:34:13 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:34:14.643213 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4979f219-cb1c-45bd-9b2d-1b9f061a8214 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:34:14.644230 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-4979f219-cb1c-45bd-9b2d-1b9f061a8214 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:34:14.651946 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4979f219-cb1c-45bd-9b2d-1b9f061a8214 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:14.652478 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4979f219-cb1c-45bd-9b2d-1b9f061a8214 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:14.653335 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4979f219-cb1c-45bd-9b2d-1b9f061a8214 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:14.654060 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4979f219-cb1c-45bd-9b2d-1b9f061a8214 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:14.723852 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-4979f219-cb1c-45bd-9b2d-1b9f061a8214 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:14.734902 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-4979f219-cb1c-45bd-9b2d-1b9f061a8214 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:14.737299 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-4979f219-cb1c-45bd-9b2d-1b9f061a8214 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:14.738624 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4979f219-cb1c-45bd-9b2d-1b9f061a8214 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.099635 Jul 23 21:34:14.749887 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2448/4981] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:34:14 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:34:15.760692 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-4a35cb10-8538-4165-be66-8582cb9b8fb1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:34:15.762134 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-4a35cb10-8538-4165-be66-8582cb9b8fb1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:34:15.765197 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:15.771085 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4a35cb10-8538-4165-be66-8582cb9b8fb1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:15.771829 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4a35cb10-8538-4165-be66-8582cb9b8fb1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:15.772836 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4a35cb10-8538-4165-be66-8582cb9b8fb1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:15.773479 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4a35cb10-8538-4165-be66-8582cb9b8fb1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:15.849427 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-4a35cb10-8538-4165-be66-8582cb9b8fb1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:15.860170 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-4a35cb10-8538-4165-be66-8582cb9b8fb1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:15.862164 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-4a35cb10-8538-4165-be66-8582cb9b8fb1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:15.863641 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-4a35cb10-8538-4165-be66-8582cb9b8fb1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.107597 Jul 23 21:34:15.864219 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2534/4982] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:34:15 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:34:16.883198 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d4c8dc77-7733-4a06-a46f-25d16b24efed tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:34:16.883809 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d4c8dc77-7733-4a06-a46f-25d16b24efed tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:34:16.891828 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d4c8dc77-7733-4a06-a46f-25d16b24efed tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:16.892272 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d4c8dc77-7733-4a06-a46f-25d16b24efed tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:16.893283 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d4c8dc77-7733-4a06-a46f-25d16b24efed tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:16.893890 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d4c8dc77-7733-4a06-a46f-25d16b24efed tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:16.977342 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d4c8dc77-7733-4a06-a46f-25d16b24efed tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:16.988942 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d4c8dc77-7733-4a06-a46f-25d16b24efed tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:16.991543 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d4c8dc77-7733-4a06-a46f-25d16b24efed tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:16.992993 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d4c8dc77-7733-4a06-a46f-25d16b24efed tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.114134 Jul 23 21:34:16.994701 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2449/4983] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:34:16 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:34:17.957660 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-06b3889a-18e3-45eb-aec4-806872113cbb tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:34:17.958315 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-06b3889a-18e3-45eb-aec4-806872113cbb tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] [instance: bdade0fb-93ef-41ad-8079-a26f353871f4] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:34:17.972857 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-06b3889a-18e3-45eb-aec4-806872113cbb tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:17.973321 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-06b3889a-18e3-45eb-aec4-806872113cbb tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:17.974206 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-06b3889a-18e3-45eb-aec4-806872113cbb tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:17.974629 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-06b3889a-18e3-45eb-aec4-806872113cbb tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:18.014543 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f72931f7-1b02-41b5-8ed1-eb6a018f079c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:34:18.016812 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f72931f7-1b02-41b5-8ed1-eb6a018f079c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:34:18.029010 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-06b3889a-18e3-45eb-aec4-806872113cbb tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] 10.222.0.17 "GET /compute/v2.1/servers/bdade0fb-93ef-41ad-8079-a26f353871f4/ips" status: 200 len: 146 microversion: 2.1 time: 0.078544 Jul 23 21:34:18.031006 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f72931f7-1b02-41b5-8ed1-eb6a018f079c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:18.031161 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2535/4984] 10.222.0.17 () {58 vars in 1247 bytes} [Sat Jul 23 21:34:17 2022] GET /compute/v2.1/servers/bdade0fb-93ef-41ad-8079-a26f353871f4/ips => generated 146 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:34:18.034103 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f72931f7-1b02-41b5-8ed1-eb6a018f079c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:18.035320 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f72931f7-1b02-41b5-8ed1-eb6a018f079c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:18.039189 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f72931f7-1b02-41b5-8ed1-eb6a018f079c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:18.195125 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f72931f7-1b02-41b5-8ed1-eb6a018f079c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:18.204685 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f72931f7-1b02-41b5-8ed1-eb6a018f079c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:18.210687 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f72931f7-1b02-41b5-8ed1-eb6a018f079c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:18.214996 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f72931f7-1b02-41b5-8ed1-eb6a018f079c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.205151 Jul 23 21:34:18.230272 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2450/4985] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:34:18 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:34:19.237301 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-417b2d43-609b-4388-9336-a52c8d8f6fdc tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:34:19.237930 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-417b2d43-609b-4388-9336-a52c8d8f6fdc tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:34:19.255669 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-417b2d43-609b-4388-9336-a52c8d8f6fdc tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:19.256128 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-417b2d43-609b-4388-9336-a52c8d8f6fdc tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:19.256931 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-417b2d43-609b-4388-9336-a52c8d8f6fdc tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:19.257376 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-417b2d43-609b-4388-9336-a52c8d8f6fdc tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:19.428522 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-417b2d43-609b-4388-9336-a52c8d8f6fdc tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:19.444869 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-417b2d43-609b-4388-9336-a52c8d8f6fdc tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:19.449890 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-417b2d43-609b-4388-9336-a52c8d8f6fdc tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:19.453679 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-417b2d43-609b-4388-9336-a52c8d8f6fdc tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.220211 Jul 23 21:34:19.454541 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2536/4986] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:34:19 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:34:19.622580 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0649091b-488f-4ddb-9812-65ba2ffaffa9 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:34:19.623649 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-0649091b-488f-4ddb-9812-65ba2ffaffa9 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] [instance: bdade0fb-93ef-41ad-8079-a26f353871f4] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:34:19.640235 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0649091b-488f-4ddb-9812-65ba2ffaffa9 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:19.640920 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0649091b-488f-4ddb-9812-65ba2ffaffa9 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:19.642336 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0649091b-488f-4ddb-9812-65ba2ffaffa9 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:19.642974 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0649091b-488f-4ddb-9812-65ba2ffaffa9 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:19.676167 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-0649091b-488f-4ddb-9812-65ba2ffaffa9 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] [instance: bdade0fb-93ef-41ad-8079-a26f353871f4] Going to try to terminate instance {{(pid=131320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:34:19.806160 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-0649091b-488f-4ddb-9812-65ba2ffaffa9 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] 10.222.0.17 "DELETE /compute/v2.1/servers/bdade0fb-93ef-41ad-8079-a26f353871f4" status: 204 len: 0 microversion: 2.1 time: 0.189185 Jul 23 21:34:19.807937 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2451/4987] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:34:19 2022] DELETE /compute/v2.1/servers/bdade0fb-93ef-41ad-8079-a26f353871f4 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:34:19.816743 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-440e4858-d556-43f9-8e9e-8b2a1feb9e38 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:34:19.819406 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-440e4858-d556-43f9-8e9e-8b2a1feb9e38 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] [instance: bdade0fb-93ef-41ad-8079-a26f353871f4] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:34:19.827528 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-440e4858-d556-43f9-8e9e-8b2a1feb9e38 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:19.828749 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-440e4858-d556-43f9-8e9e-8b2a1feb9e38 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:19.829772 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-440e4858-d556-43f9-8e9e-8b2a1feb9e38 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:19.830469 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-440e4858-d556-43f9-8e9e-8b2a1feb9e38 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:20.026728 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-440e4858-d556-43f9-8e9e-8b2a1feb9e38 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc4aa131e63349b2aa8f37fdf6d2fe00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc1475019924837a8be47347f6bbd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:20.035128 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-440e4858-d556-43f9-8e9e-8b2a1feb9e38 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] 10.222.0.17 "GET /compute/v2.1/servers/bdade0fb-93ef-41ad-8079-a26f353871f4" status: 200 len: 1673 microversion: 2.1 time: 0.222306 Jul 23 21:34:20.036044 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2537/4988] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:34:19 2022] GET /compute/v2.1/servers/bdade0fb-93ef-41ad-8079-a26f353871f4 => generated 1673 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:34:20.478306 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-7bdb8616-2e29-4088-88dc-efc2fe9b16f5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:34:20.479718 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-7bdb8616-2e29-4088-88dc-efc2fe9b16f5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:34:20.488434 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7bdb8616-2e29-4088-88dc-efc2fe9b16f5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:20.488900 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7bdb8616-2e29-4088-88dc-efc2fe9b16f5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:20.492943 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7bdb8616-2e29-4088-88dc-efc2fe9b16f5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:20.493591 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7bdb8616-2e29-4088-88dc-efc2fe9b16f5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:20.606761 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-7bdb8616-2e29-4088-88dc-efc2fe9b16f5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:20.624750 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-7bdb8616-2e29-4088-88dc-efc2fe9b16f5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:20.630100 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-7bdb8616-2e29-4088-88dc-efc2fe9b16f5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:20.631398 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-7bdb8616-2e29-4088-88dc-efc2fe9b16f5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.160896 Jul 23 21:34:20.632052 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2452/4989] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:34:20 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:34:20.798336 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-7b46754b-d076-41fe-9d6d-382cd956dc28 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:34:20.799987 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-7b46754b-d076-41fe-9d6d-382cd956dc28 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] [instance: f9976c66-cc8b-45a6-b7f1-182c2abeb0ac] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:34:20.808293 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7b46754b-d076-41fe-9d6d-382cd956dc28 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:20.808875 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7b46754b-d076-41fe-9d6d-382cd956dc28 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:20.810020 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7b46754b-d076-41fe-9d6d-382cd956dc28 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:20.810699 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7b46754b-d076-41fe-9d6d-382cd956dc28 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:20.852713 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-7b46754b-d076-41fe-9d6d-382cd956dc28 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] 10.222.0.17 "GET /compute/v2.1/servers/f9976c66-cc8b-45a6-b7f1-182c2abeb0ac/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.060687 Jul 23 21:34:20.853444 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2538/4990] 10.222.0.17 () {58 vars in 1292 bytes} [Sat Jul 23 21:34:20 2022] GET /compute/v2.1/servers/f9976c66-cc8b-45a6-b7f1-182c2abeb0ac/os-server-password => generated 116 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:34:21.053295 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ef419471-ae8e-4b0a-aab5-66257e3b4674 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:34:21.054466 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ef419471-ae8e-4b0a-aab5-66257e3b4674 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] [instance: bdade0fb-93ef-41ad-8079-a26f353871f4] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:34:21.058387 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:21.063667 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ef419471-ae8e-4b0a-aab5-66257e3b4674 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:21.064615 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ef419471-ae8e-4b0a-aab5-66257e3b4674 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:21.065620 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ef419471-ae8e-4b0a-aab5-66257e3b4674 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:21.066825 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ef419471-ae8e-4b0a-aab5-66257e3b4674 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:21.488004 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ef419471-ae8e-4b0a-aab5-66257e3b4674 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc4aa131e63349b2aa8f37fdf6d2fe00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc1475019924837a8be47347f6bbd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:21.496769 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ef419471-ae8e-4b0a-aab5-66257e3b4674 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] 10.222.0.17 "GET /compute/v2.1/servers/bdade0fb-93ef-41ad-8079-a26f353871f4" status: 200 len: 1673 microversion: 2.1 time: 0.447937 Jul 23 21:34:21.506542 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2453/4991] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:34:21 2022] GET /compute/v2.1/servers/bdade0fb-93ef-41ad-8079-a26f353871f4 => generated 1673 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:34:21.651447 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-67064438-e81b-4e25-bb37-d97c26061bc4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:34:21.652062 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-67064438-e81b-4e25-bb37-d97c26061bc4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:34:21.658873 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-67064438-e81b-4e25-bb37-d97c26061bc4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:21.659629 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-67064438-e81b-4e25-bb37-d97c26061bc4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:21.660594 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-67064438-e81b-4e25-bb37-d97c26061bc4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:21.661186 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-67064438-e81b-4e25-bb37-d97c26061bc4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:21.788996 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-67064438-e81b-4e25-bb37-d97c26061bc4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:21.805341 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-67064438-e81b-4e25-bb37-d97c26061bc4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:21.807735 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-67064438-e81b-4e25-bb37-d97c26061bc4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:21.810067 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-67064438-e81b-4e25-bb37-d97c26061bc4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.163048 Jul 23 21:34:21.811567 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2539/4992] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:34:21 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:34:22.117888 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a314e360-bbc4-49e9-a48e-47de7a098a19 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:34:22.118395 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a314e360-bbc4-49e9-a48e-47de7a098a19 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] [instance: 7cf33651-7d81-4943-8ec4-182097c73de0] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:34:22.131556 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a314e360-bbc4-49e9-a48e-47de7a098a19 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:22.132025 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a314e360-bbc4-49e9-a48e-47de7a098a19 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:22.132846 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a314e360-bbc4-49e9-a48e-47de7a098a19 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:22.133288 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a314e360-bbc4-49e9-a48e-47de7a098a19 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:22.211988 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a314e360-bbc4-49e9-a48e-47de7a098a19 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] 10.222.0.17 "GET /compute/v2.1/servers/7cf33651-7d81-4943-8ec4-182097c73de0/ips" status: 200 len: 153 microversion: 2.20 time: 0.098038 Jul 23 21:34:22.215262 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2454/4993] 10.222.0.17 () {60 vars in 1288 bytes} [Sat Jul 23 21:34:22 2022] GET /compute/v2.1/servers/7cf33651-7d81-4943-8ec4-182097c73de0/ips => generated 153 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 23 21:34:22.514259 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-90944954-3710-4712-ac29-edaeb7920cb7 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:34:22.515035 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-90944954-3710-4712-ac29-edaeb7920cb7 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] [instance: bdade0fb-93ef-41ad-8079-a26f353871f4] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:34:22.531112 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-90944954-3710-4712-ac29-edaeb7920cb7 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:22.532866 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-90944954-3710-4712-ac29-edaeb7920cb7 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:22.536518 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-90944954-3710-4712-ac29-edaeb7920cb7 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:22.537163 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-90944954-3710-4712-ac29-edaeb7920cb7 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:22.831832 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-97070da3-007e-4f50-bf95-d72a277f6342 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:34:22.832451 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-97070da3-007e-4f50-bf95-d72a277f6342 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:34:22.841152 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-97070da3-007e-4f50-bf95-d72a277f6342 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:22.841680 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-97070da3-007e-4f50-bf95-d72a277f6342 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:22.842539 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-97070da3-007e-4f50-bf95-d72a277f6342 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:22.842834 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-90944954-3710-4712-ac29-edaeb7920cb7 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc4aa131e63349b2aa8f37fdf6d2fe00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc1475019924837a8be47347f6bbd75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:22.843293 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-97070da3-007e-4f50-bf95-d72a277f6342 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:22.852652 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-90944954-3710-4712-ac29-edaeb7920cb7 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] 10.222.0.17 "GET /compute/v2.1/servers/bdade0fb-93ef-41ad-8079-a26f353871f4" status: 200 len: 1607 microversion: 2.1 time: 0.342450 Jul 23 21:34:22.857669 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2540/4994] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:34:22 2022] GET /compute/v2.1/servers/bdade0fb-93ef-41ad-8079-a26f353871f4 => generated 1607 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:34:22.875166 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:22.996897 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-97070da3-007e-4f50-bf95-d72a277f6342 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:23.007323 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-97070da3-007e-4f50-bf95-d72a277f6342 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:23.009919 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-97070da3-007e-4f50-bf95-d72a277f6342 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:23.011703 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-97070da3-007e-4f50-bf95-d72a277f6342 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.186739 Jul 23 21:34:23.015949 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2455/4995] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:34:22 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:34:23.850315 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b15fb9f8-d9b1-4f1c-af33-880877a1aca3 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:34:23.853342 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b15fb9f8-d9b1-4f1c-af33-880877a1aca3 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] [instance: 7cf33651-7d81-4943-8ec4-182097c73de0] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:34:23.866929 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-33c3473f-73cb-4cbd-bf41-239307fcc266 req-aae94bb0-729c-4655-99ce-d16f0c276a42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdade0fb-93ef-41ad-8079-a26f353871f4", "name": "network-vif-deleted", "tag": "34883282-1a78-4faa-8577-5453eeda82f5"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:34:23.877449 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b15fb9f8-d9b1-4f1c-af33-880877a1aca3 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:23.891488 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b15fb9f8-d9b1-4f1c-af33-880877a1aca3 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:23.892789 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b15fb9f8-d9b1-4f1c-af33-880877a1aca3 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:23.894892 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b15fb9f8-d9b1-4f1c-af33-880877a1aca3 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:23.905085 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-33c3473f-73cb-4cbd-bf41-239307fcc266 req-aae94bb0-729c-4655-99ce-d16f0c276a42 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:23.909424 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-33c3473f-73cb-4cbd-bf41-239307fcc266 req-aae94bb0-729c-4655-99ce-d16f0c276a42 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:23.950000 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b15fb9f8-d9b1-4f1c-af33-880877a1aca3 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] [instance: 7cf33651-7d81-4943-8ec4-182097c73de0] Going to try to terminate instance {{(pid=131320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:34:23.967774 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-33c3473f-73cb-4cbd-bf41-239307fcc266 req-aae94bb0-729c-4655-99ce-d16f0c276a42 service nova] Creating event network-vif-deleted:34883282-1a78-4faa-8577-5453eeda82f5 for instance bdade0fb-93ef-41ad-8079-a26f353871f4 on nch2-master-1 Jul 23 21:34:23.987321 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-33c3473f-73cb-4cbd-bf41-239307fcc266 req-aae94bb0-729c-4655-99ce-d16f0c276a42 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.682210 Jul 23 21:34:23.989465 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2541/4996] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:34:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:34:24.008199 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-daa8f56f-c5df-4efc-b85a-513802df6700 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:34:24.010448 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-daa8f56f-c5df-4efc-b85a-513802df6700 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] [instance: bdade0fb-93ef-41ad-8079-a26f353871f4] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:34:24.031447 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-daa8f56f-c5df-4efc-b85a-513802df6700 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:24.031910 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-daa8f56f-c5df-4efc-b85a-513802df6700 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:24.034102 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-daa8f56f-c5df-4efc-b85a-513802df6700 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:24.034768 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-daa8f56f-c5df-4efc-b85a-513802df6700 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:24.066284 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-daa8f56f-c5df-4efc-b85a-513802df6700 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] HTTP exception thrown: Instance bdade0fb-93ef-41ad-8079-a26f353871f4 could not be found. Jul 23 21:34:24.073422 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-daa8f56f-c5df-4efc-b85a-513802df6700 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Request method failure captured: Jul 23 21:34:24.073422 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/servers/bdade0fb-93ef-41ad-8079-a26f353871f4 HTTP/1.1 Jul 23 21:34:24.073422 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:34:24.073422 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:34:24.073422 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:34:24.073422 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:34:24.073422 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:34:24.073422 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:34:24.073422 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:34:24.073422 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:34:24.073422 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GjfgQOGWzElTWf002Ut_f1Wcr_yBFtwnVk83bWSqCFwGZa5EAK2XMph2qhSbMaq09HkgNJ-0CvfZnlqJEUNoBL04WEXaoyTbGoQipnQ6q1x_awVwLWZvN6-awWxn5KdGXNeWQd4_HLoUm0TybLuxA8tiZTb1I153m5qSexqZjpNZtg Jul 23 21:34:24.073422 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:34:24.073422 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:34:24.073422 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:34:24.073422 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:34:24.073422 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:34:24.073422 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:34:24.073422 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 6bc1475019924837a8be47347f6bbd75 Jul 23 21:34:24.073422 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-AttachVolumeTestJSON-1227491524 Jul 23 21:34:24.073422 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:34:24.073422 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:34:24.073422 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6bc1475019924837a8be47347f6bbd75"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6bc1475019924837a8be47347f6bbd75"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6bc1475019924837a8be47347f6bbd75", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6bc1475019924837a8be47347f6bbd75"}]}] Jul 23 21:34:24.073422 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-AttachVolumeTestJSON-1227491524 Jul 23 21:34:24.073422 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 6bc1475019924837a8be47347f6bbd75 Jul 23 21:34:24.073422 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1227491524 Jul 23 21:34:24.073422 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-AttachVolumeTestJSON-1227491524-project Jul 23 21:34:24.073422 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:34:24.073422 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:34:24.073422 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: bc4aa131e63349b2aa8f37fdf6d2fe00 Jul 23 21:34:24.073422 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-AttachVolumeTestJSON-1227491524-project Jul 23 21:34:24.073422 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:34:24.073422 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance bdade0fb-93ef-41ad-8079-a26f353871f4 could not be found. Jul 23 21:34:24.073422 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': 'bdade0fb-93ef-41ad-8079-a26f353871f4'} Jul 23 21:34:24.073422 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:34:24.073422 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:34:24.073422 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:34:24.073422 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:34:24.073422 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:34:24.073422 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:34:24.073422 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:34:24.073422 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:34:24.073422 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:34:24.073422 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:34:24.073422 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdade0fb-93ef-41ad-8079-a26f353871f4 could not be found. Jul 23 21:34:24.073422 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:34:24.073422 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:34:24.073422 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:34:24.073422 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:34:24.073422 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:34:24.073422 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:34:24.073422 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:34:24.073422 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:34:24.073422 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:34:24.073422 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:34:24.073422 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:34:24.073422 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:34:24.073422 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:34:24.073422 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:34:24.073422 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:34:24.073422 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:34:24.073422 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdade0fb-93ef-41ad-8079-a26f353871f4 could not be found. Jul 23 21:34:24.073422 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:34:24.073422 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:34:24.073422 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:34:24.077912 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:34:24.077912 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:34:24.077912 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:34:24.077912 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:34:24.077912 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:34:24.077912 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdade0fb-93ef-41ad-8079-a26f353871f4 could not be found. Jul 23 21:34:24.077912 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:34:24.079977 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-daa8f56f-c5df-4efc-b85a-513802df6700 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Returning 404 to user: Instance bdade0fb-93ef-41ad-8079-a26f353871f4 could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:34:24.081060 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-daa8f56f-c5df-4efc-b85a-513802df6700 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] 10.222.0.17 "GET /compute/v2.1/servers/bdade0fb-93ef-41ad-8079-a26f353871f4" status: 404 len: 111 microversion: 2.1 time: 0.090375 Jul 23 21:34:24.081895 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2542/4997] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:34:23 2022] GET /compute/v2.1/servers/bdade0fb-93ef-41ad-8079-a26f353871f4 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:34:24.097396 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-02b99e71-61a5-4c80-8a3d-ad403593e25c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:34:24.098488 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-02b99e71-61a5-4c80-8a3d-ad403593e25c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:34:24.111995 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-02b99e71-61a5-4c80-8a3d-ad403593e25c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:24.112818 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-02b99e71-61a5-4c80-8a3d-ad403593e25c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:24.115856 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-02b99e71-61a5-4c80-8a3d-ad403593e25c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:24.116633 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-02b99e71-61a5-4c80-8a3d-ad403593e25c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:24.136771 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b15fb9f8-d9b1-4f1c-af33-880877a1aca3 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] 10.222.0.17 "DELETE /compute/v2.1/servers/7cf33651-7d81-4943-8ec4-182097c73de0" status: 204 len: 0 microversion: 2.20 time: 0.290808 Jul 23 21:34:24.143245 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2456/4998] 10.222.0.17 () {60 vars in 1279 bytes} [Sat Jul 23 21:34:23 2022] DELETE /compute/v2.1/servers/7cf33651-7d81-4943-8ec4-182097c73de0 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 23 21:34:24.157728 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6a26fbf0-47e9-4079-8681-38d0a6142e57 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Calling method '.version_select at 0x7f0b466588b0>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:34:24.203829 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6a26fbf0-47e9-4079-8681-38d0a6142e57 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1155814123" status: 202 len: 0 microversion: 2.1 time: 0.057768 Jul 23 21:34:24.204429 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2457/4999] 10.222.0.17 () {58 vars in 1220 bytes} [Sat Jul 23 21:34:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1155814123 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:34:24.209515 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d486e92c-ba4b-4aa1-87ce-58c76a7570e7 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:34:24.210723 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d486e92c-ba4b-4aa1-87ce-58c76a7570e7 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] [instance: 7cf33651-7d81-4943-8ec4-182097c73de0] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:34:24.225470 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d486e92c-ba4b-4aa1-87ce-58c76a7570e7 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:24.225954 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d486e92c-ba4b-4aa1-87ce-58c76a7570e7 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:24.226751 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d486e92c-ba4b-4aa1-87ce-58c76a7570e7 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:24.227189 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d486e92c-ba4b-4aa1-87ce-58c76a7570e7 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:24.342097 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-02b99e71-61a5-4c80-8a3d-ad403593e25c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:24.354430 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-02b99e71-61a5-4c80-8a3d-ad403593e25c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:24.360691 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-02b99e71-61a5-4c80-8a3d-ad403593e25c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:24.363387 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-02b99e71-61a5-4c80-8a3d-ad403593e25c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.279504 Jul 23 21:34:24.364134 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2543/5000] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:34:24 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:34:24.792681 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d486e92c-ba4b-4aa1-87ce-58c76a7570e7 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:24.806329 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d486e92c-ba4b-4aa1-87ce-58c76a7570e7 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:24.809164 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d486e92c-ba4b-4aa1-87ce-58c76a7570e7 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:24.810691 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d486e92c-ba4b-4aa1-87ce-58c76a7570e7 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] 10.222.0.17 "GET /compute/v2.1/servers/7cf33651-7d81-4943-8ec4-182097c73de0" status: 200 len: 1725 microversion: 2.20 time: 0.605110 Jul 23 21:34:24.811544 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2458/5001] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:34:24 2022] GET /compute/v2.1/servers/7cf33651-7d81-4943-8ec4-182097c73de0 => generated 1725 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:34:25.383778 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-6791bda5-adf2-48ae-a867-bcb2d16dd4dd tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:34:25.384395 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-6791bda5-adf2-48ae-a867-bcb2d16dd4dd tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:34:25.407127 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6791bda5-adf2-48ae-a867-bcb2d16dd4dd tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:25.407637 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6791bda5-adf2-48ae-a867-bcb2d16dd4dd tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:25.408879 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6791bda5-adf2-48ae-a867-bcb2d16dd4dd tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:25.409804 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6791bda5-adf2-48ae-a867-bcb2d16dd4dd tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:25.645010 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-6791bda5-adf2-48ae-a867-bcb2d16dd4dd tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:25.660903 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-6791bda5-adf2-48ae-a867-bcb2d16dd4dd tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:25.674470 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-6791bda5-adf2-48ae-a867-bcb2d16dd4dd tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:25.676688 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-6791bda5-adf2-48ae-a867-bcb2d16dd4dd tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.297928 Jul 23 21:34:25.677815 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2544/5002] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:34:25 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:34:25.832456 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-14faf466-77e6-4e00-8f35-1ed0c5d28d6a tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:34:25.834572 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-14faf466-77e6-4e00-8f35-1ed0c5d28d6a tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] [instance: 7cf33651-7d81-4943-8ec4-182097c73de0] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:34:25.844582 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-14faf466-77e6-4e00-8f35-1ed0c5d28d6a tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:25.845042 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-14faf466-77e6-4e00-8f35-1ed0c5d28d6a tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:25.845827 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-14faf466-77e6-4e00-8f35-1ed0c5d28d6a tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:25.846327 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-14faf466-77e6-4e00-8f35-1ed0c5d28d6a tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:26.055003 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-14faf466-77e6-4e00-8f35-1ed0c5d28d6a tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:26.066217 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-14faf466-77e6-4e00-8f35-1ed0c5d28d6a tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:26.068109 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-14faf466-77e6-4e00-8f35-1ed0c5d28d6a tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:26.069633 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-14faf466-77e6-4e00-8f35-1ed0c5d28d6a tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] 10.222.0.17 "GET /compute/v2.1/servers/7cf33651-7d81-4943-8ec4-182097c73de0" status: 200 len: 1725 microversion: 2.20 time: 0.242728 Jul 23 21:34:26.070768 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2459/5003] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:34:25 2022] GET /compute/v2.1/servers/7cf33651-7d81-4943-8ec4-182097c73de0 => generated 1725 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:34:26.175405 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e71f1c73-db74-4a24-9ce6-4e8dfec53583 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:34:26.176186 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-e71f1c73-db74-4a24-9ce6-4e8dfec53583 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] [instance: bdade0fb-93ef-41ad-8079-a26f353871f4] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:34:26.187998 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e71f1c73-db74-4a24-9ce6-4e8dfec53583 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:26.188656 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e71f1c73-db74-4a24-9ce6-4e8dfec53583 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:26.189903 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e71f1c73-db74-4a24-9ce6-4e8dfec53583 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:26.190701 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e71f1c73-db74-4a24-9ce6-4e8dfec53583 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:26.211281 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-e71f1c73-db74-4a24-9ce6-4e8dfec53583 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] HTTP exception thrown: Instance bdade0fb-93ef-41ad-8079-a26f353871f4 could not be found. Jul 23 21:34:26.214182 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e71f1c73-db74-4a24-9ce6-4e8dfec53583 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Request method failure captured: Jul 23 21:34:26.214182 ncdv-master-1 devstack@n-api.service[131321]: request: DELETE /compute/v2.1/servers/bdade0fb-93ef-41ad-8079-a26f353871f4 HTTP/1.1 Jul 23 21:34:26.214182 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:34:26.214182 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:34:26.214182 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:34:26.214182 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:34:26.214182 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:34:26.214182 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:34:26.214182 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:34:26.214182 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:34:26.214182 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GjfgQOGWzElTWf002Ut_f1Wcr_yBFtwnVk83bWSqCFwGZa5EAK2XMph2qhSbMaq09HkgNJ-0CvfZnlqJEUNoBL04WEXaoyTbGoQipnQ6q1x_awVwLWZvN6-awWxn5KdGXNeWQd4_HLoUm0TybLuxA8tiZTb1I153m5qSexqZjpNZtg Jul 23 21:34:26.214182 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:34:26.214182 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:34:26.214182 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:34:26.214182 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:34:26.214182 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:34:26.214182 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:34:26.214182 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 6bc1475019924837a8be47347f6bbd75 Jul 23 21:34:26.214182 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-AttachVolumeTestJSON-1227491524 Jul 23 21:34:26.214182 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:34:26.214182 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:34:26.214182 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6bc1475019924837a8be47347f6bbd75"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6bc1475019924837a8be47347f6bbd75"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6bc1475019924837a8be47347f6bbd75", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6bc1475019924837a8be47347f6bbd75"}]}] Jul 23 21:34:26.214182 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-AttachVolumeTestJSON-1227491524 Jul 23 21:34:26.214182 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 6bc1475019924837a8be47347f6bbd75 Jul 23 21:34:26.214182 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1227491524 Jul 23 21:34:26.214182 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-AttachVolumeTestJSON-1227491524-project Jul 23 21:34:26.214182 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:34:26.214182 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:34:26.214182 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: bc4aa131e63349b2aa8f37fdf6d2fe00 Jul 23 21:34:26.214182 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-AttachVolumeTestJSON-1227491524-project Jul 23 21:34:26.214182 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:34:26.214182 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance bdade0fb-93ef-41ad-8079-a26f353871f4 could not be found. Jul 23 21:34:26.214182 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': 'bdade0fb-93ef-41ad-8079-a26f353871f4'} Jul 23 21:34:26.214182 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:34:26.214182 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:34:26.214182 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:34:26.214182 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:34:26.214182 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:34:26.214182 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:34:26.214182 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:34:26.214182 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:34:26.214182 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:34:26.214182 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:34:26.214182 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdade0fb-93ef-41ad-8079-a26f353871f4 could not be found. Jul 23 21:34:26.214182 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:34:26.214182 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:34:26.214182 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:34:26.214182 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:34:26.214182 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:34:26.214182 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:34:26.214182 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:34:26.214182 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:34:26.214182 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:34:26.214182 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:34:26.214182 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 23 21:34:26.214182 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 23 21:34:26.214182 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 23 21:34:26.214182 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 23 21:34:26.214182 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:34:26.214182 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:34:26.214182 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:34:26.214182 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:34:26.218965 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdade0fb-93ef-41ad-8079-a26f353871f4 could not be found. Jul 23 21:34:26.218965 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:34:26.218965 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:34:26.218965 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:34:26.218965 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:34:26.218965 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:34:26.218965 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:34:26.218965 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:34:26.218965 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:34:26.218965 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdade0fb-93ef-41ad-8079-a26f353871f4 could not be found. Jul 23 21:34:26.218965 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:34:26.218965 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e71f1c73-db74-4a24-9ce6-4e8dfec53583 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Returning 404 to user: Instance bdade0fb-93ef-41ad-8079-a26f353871f4 could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:34:26.218965 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-e71f1c73-db74-4a24-9ce6-4e8dfec53583 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] 10.222.0.17 "DELETE /compute/v2.1/servers/bdade0fb-93ef-41ad-8079-a26f353871f4" status: 404 len: 111 microversion: 2.1 time: 0.048094 Jul 23 21:34:26.220645 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2545/5004] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:34:26 2022] DELETE /compute/v2.1/servers/bdade0fb-93ef-41ad-8079-a26f353871f4 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:34:26.226703 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-62dce39e-f8aa-47e4-b757-efcf012eb623 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:34:26.227323 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-62dce39e-f8aa-47e4-b757-efcf012eb623 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] [instance: bdade0fb-93ef-41ad-8079-a26f353871f4] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:34:26.234251 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-62dce39e-f8aa-47e4-b757-efcf012eb623 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:26.234704 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-62dce39e-f8aa-47e4-b757-efcf012eb623 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:26.235495 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-62dce39e-f8aa-47e4-b757-efcf012eb623 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:26.235932 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-62dce39e-f8aa-47e4-b757-efcf012eb623 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:26.251722 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-62dce39e-f8aa-47e4-b757-efcf012eb623 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] HTTP exception thrown: Instance bdade0fb-93ef-41ad-8079-a26f353871f4 could not be found. Jul 23 21:34:26.254063 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-62dce39e-f8aa-47e4-b757-efcf012eb623 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Request method failure captured: Jul 23 21:34:26.254063 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/bdade0fb-93ef-41ad-8079-a26f353871f4 HTTP/1.1 Jul 23 21:34:26.254063 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:34:26.254063 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:34:26.254063 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:34:26.254063 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:34:26.254063 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:34:26.254063 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:34:26.254063 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:34:26.254063 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:34:26.254063 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GjfgQOGWzElTWf002Ut_f1Wcr_yBFtwnVk83bWSqCFwGZa5EAK2XMph2qhSbMaq09HkgNJ-0CvfZnlqJEUNoBL04WEXaoyTbGoQipnQ6q1x_awVwLWZvN6-awWxn5KdGXNeWQd4_HLoUm0TybLuxA8tiZTb1I153m5qSexqZjpNZtg Jul 23 21:34:26.254063 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:34:26.254063 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:34:26.254063 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:34:26.254063 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:34:26.254063 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:34:26.254063 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:34:26.254063 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 6bc1475019924837a8be47347f6bbd75 Jul 23 21:34:26.254063 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-AttachVolumeTestJSON-1227491524 Jul 23 21:34:26.254063 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:34:26.254063 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:34:26.254063 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6bc1475019924837a8be47347f6bbd75"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6bc1475019924837a8be47347f6bbd75"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6bc1475019924837a8be47347f6bbd75", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6bc1475019924837a8be47347f6bbd75"}]}] Jul 23 21:34:26.254063 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-AttachVolumeTestJSON-1227491524 Jul 23 21:34:26.254063 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 6bc1475019924837a8be47347f6bbd75 Jul 23 21:34:26.254063 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1227491524 Jul 23 21:34:26.254063 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-AttachVolumeTestJSON-1227491524-project Jul 23 21:34:26.254063 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:34:26.254063 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:34:26.254063 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: bc4aa131e63349b2aa8f37fdf6d2fe00 Jul 23 21:34:26.254063 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-AttachVolumeTestJSON-1227491524-project Jul 23 21:34:26.254063 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:34:26.254063 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance bdade0fb-93ef-41ad-8079-a26f353871f4 could not be found. Jul 23 21:34:26.254063 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': 'bdade0fb-93ef-41ad-8079-a26f353871f4'} Jul 23 21:34:26.254063 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:34:26.254063 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:34:26.254063 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:34:26.254063 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:34:26.254063 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:34:26.254063 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:34:26.254063 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:34:26.254063 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:34:26.254063 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:34:26.254063 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:34:26.254063 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdade0fb-93ef-41ad-8079-a26f353871f4 could not be found. Jul 23 21:34:26.254063 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:34:26.254063 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:34:26.254063 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:34:26.254063 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:34:26.254063 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:34:26.254063 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:34:26.254063 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:34:26.254063 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:34:26.254063 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:34:26.254063 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:34:26.254063 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:34:26.254063 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:34:26.254063 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:34:26.254063 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:34:26.254063 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:34:26.254063 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:34:26.254063 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdade0fb-93ef-41ad-8079-a26f353871f4 could not be found. Jul 23 21:34:26.254063 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:34:26.254063 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:34:26.254063 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:34:26.262163 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:34:26.262163 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:34:26.262163 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:34:26.262163 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:34:26.262163 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:34:26.262163 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdade0fb-93ef-41ad-8079-a26f353871f4 could not be found. Jul 23 21:34:26.262163 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:34:26.262163 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-62dce39e-f8aa-47e4-b757-efcf012eb623 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Returning 404 to user: Instance bdade0fb-93ef-41ad-8079-a26f353871f4 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:34:26.262163 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-62dce39e-f8aa-47e4-b757-efcf012eb623 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] 10.222.0.17 "GET /compute/v2.1/servers/bdade0fb-93ef-41ad-8079-a26f353871f4" status: 404 len: 111 microversion: 2.1 time: 0.033329 Jul 23 21:34:26.262163 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2460/5005] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:34:26 2022] GET /compute/v2.1/servers/bdade0fb-93ef-41ad-8079-a26f353871f4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:34:26.439096 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e17df1b4-f1f4-4c79-a48c-659419549ea5 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:34:26.439619 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-e17df1b4-f1f4-4c79-a48c-659419549ea5 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] [instance: b0bb14c2-15df-4440-9d9c-4c6598867dfe] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:34:26.447571 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e17df1b4-f1f4-4c79-a48c-659419549ea5 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:26.448038 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e17df1b4-f1f4-4c79-a48c-659419549ea5 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:26.448866 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e17df1b4-f1f4-4c79-a48c-659419549ea5 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:26.449592 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-e17df1b4-f1f4-4c79-a48c-659419549ea5 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:26.483767 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-e17df1b4-f1f4-4c79-a48c-659419549ea5 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] HTTP exception thrown: Instance b0bb14c2-15df-4440-9d9c-4c6598867dfe could not be found. Jul 23 21:34:26.485507 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e17df1b4-f1f4-4c79-a48c-659419549ea5 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Request method failure captured: Jul 23 21:34:26.485507 ncdv-master-1 devstack@n-api.service[131321]: request: DELETE /compute/v2.1/servers/b0bb14c2-15df-4440-9d9c-4c6598867dfe HTTP/1.1 Jul 23 21:34:26.485507 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:34:26.485507 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:34:26.485507 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:34:26.485507 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:34:26.485507 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:34:26.485507 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:34:26.485507 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:34:26.485507 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:34:26.485507 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GjfgQOGWzElTWf002Ut_f1Wcr_yBFtwnVk83bWSqCFwGZa5EAK2XMph2qhSbMaq09HkgNJ-0CvfZnlqJEUNoBL04WEXaoyTbGoQipnQ6q1x_awVwLWZvN6-awWxn5KdGXNeWQd4_HLoUm0TybLuxA8tiZTb1I153m5qSexqZjpNZtg Jul 23 21:34:26.485507 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:34:26.485507 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:34:26.485507 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:34:26.485507 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:34:26.485507 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:34:26.485507 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:34:26.485507 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 6bc1475019924837a8be47347f6bbd75 Jul 23 21:34:26.485507 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-AttachVolumeTestJSON-1227491524 Jul 23 21:34:26.485507 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:34:26.485507 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:34:26.485507 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6bc1475019924837a8be47347f6bbd75"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6bc1475019924837a8be47347f6bbd75"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6bc1475019924837a8be47347f6bbd75", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6bc1475019924837a8be47347f6bbd75"}]}] Jul 23 21:34:26.485507 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-AttachVolumeTestJSON-1227491524 Jul 23 21:34:26.485507 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 6bc1475019924837a8be47347f6bbd75 Jul 23 21:34:26.485507 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1227491524 Jul 23 21:34:26.485507 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-AttachVolumeTestJSON-1227491524-project Jul 23 21:34:26.485507 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:34:26.485507 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:34:26.485507 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: bc4aa131e63349b2aa8f37fdf6d2fe00 Jul 23 21:34:26.485507 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-AttachVolumeTestJSON-1227491524-project Jul 23 21:34:26.485507 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:34:26.485507 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance b0bb14c2-15df-4440-9d9c-4c6598867dfe could not be found. Jul 23 21:34:26.485507 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': 'b0bb14c2-15df-4440-9d9c-4c6598867dfe'} Jul 23 21:34:26.485507 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:34:26.485507 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:34:26.485507 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:34:26.485507 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:34:26.485507 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:34:26.485507 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:34:26.485507 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:34:26.485507 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:34:26.485507 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:34:26.485507 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:34:26.485507 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0bb14c2-15df-4440-9d9c-4c6598867dfe could not be found. Jul 23 21:34:26.485507 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:34:26.485507 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:34:26.485507 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:34:26.485507 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:34:26.485507 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:34:26.485507 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:34:26.485507 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:34:26.485507 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:34:26.485507 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:34:26.485507 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:34:26.485507 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 23 21:34:26.485507 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 23 21:34:26.485507 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 23 21:34:26.485507 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 23 21:34:26.485507 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:34:26.485507 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:34:26.485507 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:34:26.485507 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:34:26.494848 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0bb14c2-15df-4440-9d9c-4c6598867dfe could not be found. Jul 23 21:34:26.494848 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:34:26.494848 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:34:26.494848 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:34:26.494848 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:34:26.494848 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:34:26.494848 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:34:26.494848 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:34:26.494848 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:34:26.494848 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0bb14c2-15df-4440-9d9c-4c6598867dfe could not be found. Jul 23 21:34:26.494848 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:34:26.494848 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-e17df1b4-f1f4-4c79-a48c-659419549ea5 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Returning 404 to user: Instance b0bb14c2-15df-4440-9d9c-4c6598867dfe could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:34:26.494848 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-e17df1b4-f1f4-4c79-a48c-659419549ea5 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] 10.222.0.17 "DELETE /compute/v2.1/servers/b0bb14c2-15df-4440-9d9c-4c6598867dfe" status: 404 len: 111 microversion: 2.1 time: 0.053349 Jul 23 21:34:26.494848 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2546/5006] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:34:26 2022] DELETE /compute/v2.1/servers/b0bb14c2-15df-4440-9d9c-4c6598867dfe => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:34:26.497149 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-17e6f915-519e-49ce-995d-8d0522a270a5 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:34:26.497765 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-17e6f915-519e-49ce-995d-8d0522a270a5 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] [instance: b0bb14c2-15df-4440-9d9c-4c6598867dfe] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:34:26.507059 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-17e6f915-519e-49ce-995d-8d0522a270a5 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:26.507518 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-17e6f915-519e-49ce-995d-8d0522a270a5 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:26.508310 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-17e6f915-519e-49ce-995d-8d0522a270a5 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:26.508760 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-17e6f915-519e-49ce-995d-8d0522a270a5 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:26.524256 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-17e6f915-519e-49ce-995d-8d0522a270a5 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] HTTP exception thrown: Instance b0bb14c2-15df-4440-9d9c-4c6598867dfe could not be found. Jul 23 21:34:26.526082 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-17e6f915-519e-49ce-995d-8d0522a270a5 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Request method failure captured: Jul 23 21:34:26.526082 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/b0bb14c2-15df-4440-9d9c-4c6598867dfe HTTP/1.1 Jul 23 21:34:26.526082 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:34:26.526082 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:34:26.526082 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:34:26.526082 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:34:26.526082 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:34:26.526082 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:34:26.526082 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:34:26.526082 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:34:26.526082 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GjfgQOGWzElTWf002Ut_f1Wcr_yBFtwnVk83bWSqCFwGZa5EAK2XMph2qhSbMaq09HkgNJ-0CvfZnlqJEUNoBL04WEXaoyTbGoQipnQ6q1x_awVwLWZvN6-awWxn5KdGXNeWQd4_HLoUm0TybLuxA8tiZTb1I153m5qSexqZjpNZtg Jul 23 21:34:26.526082 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:34:26.526082 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:34:26.526082 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:34:26.526082 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:34:26.526082 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:34:26.526082 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:34:26.526082 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 6bc1475019924837a8be47347f6bbd75 Jul 23 21:34:26.526082 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-AttachVolumeTestJSON-1227491524 Jul 23 21:34:26.526082 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:34:26.526082 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:34:26.526082 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6bc1475019924837a8be47347f6bbd75"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6bc1475019924837a8be47347f6bbd75"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6bc1475019924837a8be47347f6bbd75", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6bc1475019924837a8be47347f6bbd75"}]}] Jul 23 21:34:26.526082 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-AttachVolumeTestJSON-1227491524 Jul 23 21:34:26.526082 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 6bc1475019924837a8be47347f6bbd75 Jul 23 21:34:26.526082 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1227491524 Jul 23 21:34:26.526082 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-AttachVolumeTestJSON-1227491524-project Jul 23 21:34:26.526082 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:34:26.526082 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:34:26.526082 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: bc4aa131e63349b2aa8f37fdf6d2fe00 Jul 23 21:34:26.526082 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-AttachVolumeTestJSON-1227491524-project Jul 23 21:34:26.526082 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:34:26.526082 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance b0bb14c2-15df-4440-9d9c-4c6598867dfe could not be found. Jul 23 21:34:26.526082 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': 'b0bb14c2-15df-4440-9d9c-4c6598867dfe'} Jul 23 21:34:26.526082 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:34:26.526082 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:34:26.526082 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:34:26.526082 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:34:26.526082 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:34:26.526082 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:34:26.526082 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:34:26.526082 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:34:26.526082 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:34:26.526082 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:34:26.526082 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0bb14c2-15df-4440-9d9c-4c6598867dfe could not be found. Jul 23 21:34:26.526082 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:34:26.526082 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:34:26.526082 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:34:26.526082 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:34:26.526082 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:34:26.526082 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:34:26.526082 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:34:26.526082 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:34:26.526082 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:34:26.526082 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:34:26.526082 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:34:26.526082 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:34:26.526082 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:34:26.526082 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:34:26.526082 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:34:26.526082 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:34:26.526082 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0bb14c2-15df-4440-9d9c-4c6598867dfe could not be found. Jul 23 21:34:26.526082 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:34:26.526082 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:34:26.526082 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:34:26.532291 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:34:26.532291 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:34:26.532291 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:34:26.532291 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:34:26.532291 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:34:26.532291 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0bb14c2-15df-4440-9d9c-4c6598867dfe could not be found. Jul 23 21:34:26.532291 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:34:26.532291 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-17e6f915-519e-49ce-995d-8d0522a270a5 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] Returning 404 to user: Instance b0bb14c2-15df-4440-9d9c-4c6598867dfe could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:34:26.532291 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-17e6f915-519e-49ce-995d-8d0522a270a5 tempest-AttachVolumeTestJSON-1227491524 tempest-AttachVolumeTestJSON-1227491524-project] 10.222.0.17 "GET /compute/v2.1/servers/b0bb14c2-15df-4440-9d9c-4c6598867dfe" status: 404 len: 111 microversion: 2.1 time: 0.034485 Jul 23 21:34:26.532291 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2461/5007] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:34:26 2022] GET /compute/v2.1/servers/b0bb14c2-15df-4440-9d9c-4c6598867dfe => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:34:26.698639 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-0e08969e-98c7-4163-9b24-6b1e188ebc92 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:34:26.699253 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-0e08969e-98c7-4163-9b24-6b1e188ebc92 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:34:26.705800 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0e08969e-98c7-4163-9b24-6b1e188ebc92 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:26.706525 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0e08969e-98c7-4163-9b24-6b1e188ebc92 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:26.707474 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0e08969e-98c7-4163-9b24-6b1e188ebc92 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:26.708090 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0e08969e-98c7-4163-9b24-6b1e188ebc92 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:26.755284 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=100 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:26.863498 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-0e08969e-98c7-4163-9b24-6b1e188ebc92 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:26.875332 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-0e08969e-98c7-4163-9b24-6b1e188ebc92 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:26.877130 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-0e08969e-98c7-4163-9b24-6b1e188ebc92 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:26.878382 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-0e08969e-98c7-4163-9b24-6b1e188ebc92 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.185338 Jul 23 21:34:26.890481 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2547/5008] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:34:26 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:34:27.089965 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-bf8e4e08-e9ce-41b2-8b7c-9ec48483fad2 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:34:27.090482 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-bf8e4e08-e9ce-41b2-8b7c-9ec48483fad2 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] [instance: 7cf33651-7d81-4943-8ec4-182097c73de0] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:34:27.106039 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bf8e4e08-e9ce-41b2-8b7c-9ec48483fad2 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:27.106577 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bf8e4e08-e9ce-41b2-8b7c-9ec48483fad2 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:27.107411 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bf8e4e08-e9ce-41b2-8b7c-9ec48483fad2 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:27.108127 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bf8e4e08-e9ce-41b2-8b7c-9ec48483fad2 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:27.631396 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-bf8e4e08-e9ce-41b2-8b7c-9ec48483fad2 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:27.647145 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-bf8e4e08-e9ce-41b2-8b7c-9ec48483fad2 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:27.650333 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-bf8e4e08-e9ce-41b2-8b7c-9ec48483fad2 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '048f5756139b4283b695c057647983ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49da2dec096c474199da94d7c7a83258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:27.653482 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-bf8e4e08-e9ce-41b2-8b7c-9ec48483fad2 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] 10.222.0.17 "GET /compute/v2.1/servers/7cf33651-7d81-4943-8ec4-182097c73de0" status: 200 len: 1725 microversion: 2.20 time: 0.568695 Jul 23 21:34:27.666396 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2462/5009] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:34:27 2022] GET /compute/v2.1/servers/7cf33651-7d81-4943-8ec4-182097c73de0 => generated 1725 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:34:27.902325 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0bee6c5b-45bc-4335-a071-cc02eb8d91ca tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:34:27.903745 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-0bee6c5b-45bc-4335-a071-cc02eb8d91ca tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:34:27.921834 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0bee6c5b-45bc-4335-a071-cc02eb8d91ca tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:27.922638 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0bee6c5b-45bc-4335-a071-cc02eb8d91ca tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:27.923715 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0bee6c5b-45bc-4335-a071-cc02eb8d91ca tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:27.924817 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0bee6c5b-45bc-4335-a071-cc02eb8d91ca tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:28.060236 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-0bee6c5b-45bc-4335-a071-cc02eb8d91ca tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:28.079634 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-0bee6c5b-45bc-4335-a071-cc02eb8d91ca tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:28.083214 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-0bee6c5b-45bc-4335-a071-cc02eb8d91ca tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:28.086556 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-0bee6c5b-45bc-4335-a071-cc02eb8d91ca tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.189972 Jul 23 21:34:28.099992 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2463/5010] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:34:27 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:34:28.157075 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [req-5b82c855-b5eb-4bc1-b93f-46f5800bdac5 req-3e3b7736-0103-4b10-884a-623181a7e555 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cf33651-7d81-4943-8ec4-182097c73de0", "name": "network-vif-deleted", "tag": "4a6fdacd-0c83-4f6d-a2bf-31fb7f27977d"}]} {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:34:28.168487 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-5b82c855-b5eb-4bc1-b93f-46f5800bdac5 req-3e3b7736-0103-4b10-884a-623181a7e555 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:28.169058 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [req-5b82c855-b5eb-4bc1-b93f-46f5800bdac5 req-3e3b7736-0103-4b10-884a-623181a7e555 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:28.183391 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.compute.server_external_events [req-5b82c855-b5eb-4bc1-b93f-46f5800bdac5 req-3e3b7736-0103-4b10-884a-623181a7e555 service nova] Creating event network-vif-deleted:4a6fdacd-0c83-4f6d-a2bf-31fb7f27977d for instance 7cf33651-7d81-4943-8ec4-182097c73de0 on nch1-master-1 Jul 23 21:34:28.189227 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [req-5b82c855-b5eb-4bc1-b93f-46f5800bdac5 req-3e3b7736-0103-4b10-884a-623181a7e555 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.385351 Jul 23 21:34:28.191203 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2548/5011] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:34:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:34:28.672566 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9a2704d8-ba50-413d-9b04-1bf527960bae tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:34:28.673154 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-9a2704d8-ba50-413d-9b04-1bf527960bae tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] [instance: 7cf33651-7d81-4943-8ec4-182097c73de0] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:34:28.687164 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9a2704d8-ba50-413d-9b04-1bf527960bae tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:28.688148 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9a2704d8-ba50-413d-9b04-1bf527960bae tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:28.689490 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9a2704d8-ba50-413d-9b04-1bf527960bae tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:28.692802 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9a2704d8-ba50-413d-9b04-1bf527960bae tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:28.715454 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-9a2704d8-ba50-413d-9b04-1bf527960bae tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] HTTP exception thrown: Instance 7cf33651-7d81-4943-8ec4-182097c73de0 could not be found. Jul 23 21:34:28.717677 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9a2704d8-ba50-413d-9b04-1bf527960bae tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Request method failure captured: Jul 23 21:34:28.717677 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/7cf33651-7d81-4943-8ec4-182097c73de0 HTTP/1.1 Jul 23 21:34:28.717677 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:34:28.717677 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:34:28.717677 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:34:28.717677 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:34:28.717677 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:34:28.717677 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:34:28.717677 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:34:28.717677 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:34:28.717677 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GjR_0O6GBCiuxjDMiEyfVqYI1YKbSgNPPzxoIkrVy_FrrUjrWzvyNvEkXtlLAGAMMOkrqI-Zveal9DamR6iACXxUi-dpsTsmcAkFx41oWYSzBCiL5Kch14hOD4rlvYY_pz_x10LAqvx_qIUvQaBJMJHMyRtqH48pEnd-OgJDqLi-YE Jul 23 21:34:28.717677 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:34:28.717677 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:34:28.717677 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:34:28.717677 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:34:28.717677 ncdv-master-1 devstack@n-api.service[131320]: X-Openstack-Nova-Api-Version: 2.20 Jul 23 21:34:28.717677 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:34:28.717677 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:34:28.717677 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 49da2dec096c474199da94d7c7a83258 Jul 23 21:34:28.717677 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1512806459 Jul 23 21:34:28.717677 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:34:28.717677 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:34:28.717677 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/49da2dec096c474199da94d7c7a83258"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/49da2dec096c474199da94d7c7a83258"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_49da2dec096c474199da94d7c7a83258", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/49da2dec096c474199da94d7c7a83258"}]}] Jul 23 21:34:28.717677 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1512806459 Jul 23 21:34:28.717677 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 49da2dec096c474199da94d7c7a83258 Jul 23 21:34:28.717677 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1512806459 Jul 23 21:34:28.717677 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-AttachVolumeShelveTestJSON-1512806459-project Jul 23 21:34:28.717677 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:34:28.717677 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:34:28.717677 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 048f5756139b4283b695c057647983ba Jul 23 21:34:28.717677 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1512806459-project Jul 23 21:34:28.717677 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:34:28.717677 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance 7cf33651-7d81-4943-8ec4-182097c73de0 could not be found. Jul 23 21:34:28.717677 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '7cf33651-7d81-4943-8ec4-182097c73de0'} Jul 23 21:34:28.717677 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:34:28.717677 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:34:28.717677 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:34:28.717677 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:34:28.717677 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:34:28.717677 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:34:28.717677 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:34:28.717677 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:34:28.717677 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:34:28.717677 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:34:28.717677 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7cf33651-7d81-4943-8ec4-182097c73de0 could not be found. Jul 23 21:34:28.717677 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:34:28.717677 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:34:28.717677 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:34:28.717677 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:34:28.717677 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:34:28.717677 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:34:28.717677 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:34:28.717677 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:34:28.717677 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:34:28.717677 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:34:28.717677 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:34:28.717677 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:34:28.717677 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:34:28.717677 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:34:28.717677 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:34:28.717677 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:34:28.717677 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7cf33651-7d81-4943-8ec4-182097c73de0 could not be found. Jul 23 21:34:28.717677 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:34:28.717677 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:34:28.722916 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:34:28.722916 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:34:28.722916 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:34:28.722916 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:34:28.722916 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:34:28.722916 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:34:28.722916 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7cf33651-7d81-4943-8ec4-182097c73de0 could not be found. Jul 23 21:34:28.722916 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:34:28.725013 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9a2704d8-ba50-413d-9b04-1bf527960bae tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Returning 404 to user: Instance 7cf33651-7d81-4943-8ec4-182097c73de0 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:34:28.726255 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9a2704d8-ba50-413d-9b04-1bf527960bae tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] 10.222.0.17 "GET /compute/v2.1/servers/7cf33651-7d81-4943-8ec4-182097c73de0" status: 404 len: 111 microversion: 2.20 time: 0.057596 Jul 23 21:34:28.727102 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2464/5012] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:34:28 2022] GET /compute/v2.1/servers/7cf33651-7d81-4943-8ec4-182097c73de0 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 23 21:34:28.737974 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-24d68bfa-67e3-4f09-8f52-96c2ab4de2ac tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Calling method '.version_select at 0x7f0b47dd4280>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:34:28.777221 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-24d68bfa-67e3-4f09-8f52-96c2ab4de2ac tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-312135291" status: 204 len: 0 microversion: 2.20 time: 0.044193 Jul 23 21:34:28.778718 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2549/5013] 10.222.0.17 () {60 vars in 1258 bytes} [Sat Jul 23 21:34:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-312135291 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 23 21:34:29.106759 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8ac44942-d611-4cff-83fd-72bcc29cdfd1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:34:29.107959 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8ac44942-d611-4cff-83fd-72bcc29cdfd1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:34:29.131835 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8ac44942-d611-4cff-83fd-72bcc29cdfd1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:29.133552 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8ac44942-d611-4cff-83fd-72bcc29cdfd1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:29.135153 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8ac44942-d611-4cff-83fd-72bcc29cdfd1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:29.136133 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8ac44942-d611-4cff-83fd-72bcc29cdfd1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:29.668254 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8ac44942-d611-4cff-83fd-72bcc29cdfd1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:29.686417 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8ac44942-d611-4cff-83fd-72bcc29cdfd1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:29.688010 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8ac44942-d611-4cff-83fd-72bcc29cdfd1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:29.689448 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8ac44942-d611-4cff-83fd-72bcc29cdfd1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.587914 Jul 23 21:34:29.693131 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2465/5014] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:34:29 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:34:30.713076 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-68b38c5d-10b9-4e3a-ae43-7481869b950c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:34:30.714023 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-68b38c5d-10b9-4e3a-ae43-7481869b950c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:34:30.729694 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-68b38c5d-10b9-4e3a-ae43-7481869b950c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:30.730452 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-68b38c5d-10b9-4e3a-ae43-7481869b950c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:30.736108 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-68b38c5d-10b9-4e3a-ae43-7481869b950c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:30.736837 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-68b38c5d-10b9-4e3a-ae43-7481869b950c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:30.802663 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2e63cc44-5d96-47c2-8ebb-40384a672eca tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:34:30.803537 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-2e63cc44-5d96-47c2-8ebb-40384a672eca tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] [instance: 7cf33651-7d81-4943-8ec4-182097c73de0] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:34:30.813042 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2e63cc44-5d96-47c2-8ebb-40384a672eca tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:30.815706 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2e63cc44-5d96-47c2-8ebb-40384a672eca tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:30.816845 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2e63cc44-5d96-47c2-8ebb-40384a672eca tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:30.817946 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2e63cc44-5d96-47c2-8ebb-40384a672eca tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:30.836979 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-2e63cc44-5d96-47c2-8ebb-40384a672eca tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] HTTP exception thrown: Instance 7cf33651-7d81-4943-8ec4-182097c73de0 could not be found. Jul 23 21:34:30.840755 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2e63cc44-5d96-47c2-8ebb-40384a672eca tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Request method failure captured: Jul 23 21:34:30.840755 ncdv-master-1 devstack@n-api.service[131320]: request: DELETE /compute/v2.1/servers/7cf33651-7d81-4943-8ec4-182097c73de0 HTTP/1.1 Jul 23 21:34:30.840755 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:34:30.840755 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:34:30.840755 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:34:30.840755 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:34:30.840755 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:34:30.840755 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:34:30.840755 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:34:30.840755 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:34:30.840755 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GjR_0O6GBCiuxjDMiEyfVqYI1YKbSgNPPzxoIkrVy_FrrUjrWzvyNvEkXtlLAGAMMOkrqI-Zveal9DamR6iACXxUi-dpsTsmcAkFx41oWYSzBCiL5Kch14hOD4rlvYY_pz_x10LAqvx_qIUvQaBJMJHMyRtqH48pEnd-OgJDqLi-YE Jul 23 21:34:30.840755 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:34:30.840755 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:34:30.840755 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:34:30.840755 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:34:30.840755 ncdv-master-1 devstack@n-api.service[131320]: X-Openstack-Nova-Api-Version: 2.20 Jul 23 21:34:30.840755 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:34:30.840755 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:34:30.840755 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 49da2dec096c474199da94d7c7a83258 Jul 23 21:34:30.840755 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1512806459 Jul 23 21:34:30.840755 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:34:30.840755 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:34:30.840755 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/49da2dec096c474199da94d7c7a83258"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/49da2dec096c474199da94d7c7a83258"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_49da2dec096c474199da94d7c7a83258", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/49da2dec096c474199da94d7c7a83258"}]}] Jul 23 21:34:30.840755 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1512806459 Jul 23 21:34:30.840755 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 49da2dec096c474199da94d7c7a83258 Jul 23 21:34:30.840755 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1512806459 Jul 23 21:34:30.840755 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-AttachVolumeShelveTestJSON-1512806459-project Jul 23 21:34:30.840755 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:34:30.840755 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:34:30.840755 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 048f5756139b4283b695c057647983ba Jul 23 21:34:30.840755 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1512806459-project Jul 23 21:34:30.840755 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:34:30.840755 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance 7cf33651-7d81-4943-8ec4-182097c73de0 could not be found. Jul 23 21:34:30.840755 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '7cf33651-7d81-4943-8ec4-182097c73de0'} Jul 23 21:34:30.840755 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:34:30.840755 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:34:30.840755 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:34:30.840755 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:34:30.840755 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:34:30.840755 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:34:30.840755 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:34:30.840755 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:34:30.840755 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:34:30.840755 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:34:30.840755 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7cf33651-7d81-4943-8ec4-182097c73de0 could not be found. Jul 23 21:34:30.840755 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:34:30.840755 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:34:30.840755 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:34:30.840755 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:34:30.840755 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:34:30.840755 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:34:30.840755 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:34:30.840755 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:34:30.840755 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:34:30.840755 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:34:30.840755 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 23 21:34:30.840755 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 23 21:34:30.840755 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 23 21:34:30.840755 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 23 21:34:30.840755 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:34:30.840755 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:34:30.840755 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:34:30.840755 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:34:30.844753 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7cf33651-7d81-4943-8ec4-182097c73de0 could not be found. Jul 23 21:34:30.844753 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:34:30.844753 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:34:30.844753 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:34:30.844753 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:34:30.844753 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:34:30.844753 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:34:30.844753 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:34:30.844753 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:34:30.844753 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7cf33651-7d81-4943-8ec4-182097c73de0 could not be found. Jul 23 21:34:30.844753 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:34:30.848024 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2e63cc44-5d96-47c2-8ebb-40384a672eca tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Returning 404 to user: Instance 7cf33651-7d81-4943-8ec4-182097c73de0 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:34:30.850042 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2e63cc44-5d96-47c2-8ebb-40384a672eca tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] 10.222.0.17 "DELETE /compute/v2.1/servers/7cf33651-7d81-4943-8ec4-182097c73de0" status: 404 len: 111 microversion: 2.20 time: 0.053276 Jul 23 21:34:30.851744 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2466/5015] 10.222.0.17 () {60 vars in 1279 bytes} [Sat Jul 23 21:34:30 2022] DELETE /compute/v2.1/servers/7cf33651-7d81-4943-8ec4-182097c73de0 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 23 21:34:30.874630 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4a3b4d0e-5519-4ffc-ac83-d4e36ce82015 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:34:30.875264 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-4a3b4d0e-5519-4ffc-ac83-d4e36ce82015 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] [instance: 7cf33651-7d81-4943-8ec4-182097c73de0] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:34:30.882069 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-68b38c5d-10b9-4e3a-ae43-7481869b950c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:30.895972 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-68b38c5d-10b9-4e3a-ae43-7481869b950c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:30.896640 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4a3b4d0e-5519-4ffc-ac83-d4e36ce82015 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:30.897602 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4a3b4d0e-5519-4ffc-ac83-d4e36ce82015 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:30.898861 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4a3b4d0e-5519-4ffc-ac83-d4e36ce82015 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:30.900386 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-68b38c5d-10b9-4e3a-ae43-7481869b950c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:30.901254 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4a3b4d0e-5519-4ffc-ac83-d4e36ce82015 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:30.904338 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-68b38c5d-10b9-4e3a-ae43-7481869b950c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.197114 Jul 23 21:34:30.911855 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2550/5016] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:34:30 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:34:30.925809 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-4a3b4d0e-5519-4ffc-ac83-d4e36ce82015 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] HTTP exception thrown: Instance 7cf33651-7d81-4943-8ec4-182097c73de0 could not be found. Jul 23 21:34:30.930424 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4a3b4d0e-5519-4ffc-ac83-d4e36ce82015 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Request method failure captured: Jul 23 21:34:30.930424 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/7cf33651-7d81-4943-8ec4-182097c73de0 HTTP/1.1 Jul 23 21:34:30.930424 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:34:30.930424 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:34:30.930424 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:34:30.930424 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:34:30.930424 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:34:30.930424 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:34:30.930424 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:34:30.930424 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:34:30.930424 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GjR_0O6GBCiuxjDMiEyfVqYI1YKbSgNPPzxoIkrVy_FrrUjrWzvyNvEkXtlLAGAMMOkrqI-Zveal9DamR6iACXxUi-dpsTsmcAkFx41oWYSzBCiL5Kch14hOD4rlvYY_pz_x10LAqvx_qIUvQaBJMJHMyRtqH48pEnd-OgJDqLi-YE Jul 23 21:34:30.930424 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:34:30.930424 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:34:30.930424 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:34:30.930424 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:34:30.930424 ncdv-master-1 devstack@n-api.service[131320]: X-Openstack-Nova-Api-Version: 2.20 Jul 23 21:34:30.930424 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:34:30.930424 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:34:30.930424 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 49da2dec096c474199da94d7c7a83258 Jul 23 21:34:30.930424 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1512806459 Jul 23 21:34:30.930424 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:34:30.930424 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:34:30.930424 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/49da2dec096c474199da94d7c7a83258"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/49da2dec096c474199da94d7c7a83258"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_49da2dec096c474199da94d7c7a83258", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/49da2dec096c474199da94d7c7a83258"}]}] Jul 23 21:34:30.930424 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1512806459 Jul 23 21:34:30.930424 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 49da2dec096c474199da94d7c7a83258 Jul 23 21:34:30.930424 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1512806459 Jul 23 21:34:30.930424 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-AttachVolumeShelveTestJSON-1512806459-project Jul 23 21:34:30.930424 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:34:30.930424 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:34:30.930424 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 048f5756139b4283b695c057647983ba Jul 23 21:34:30.930424 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1512806459-project Jul 23 21:34:30.930424 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:34:30.930424 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance 7cf33651-7d81-4943-8ec4-182097c73de0 could not be found. Jul 23 21:34:30.930424 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '7cf33651-7d81-4943-8ec4-182097c73de0'} Jul 23 21:34:30.930424 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:34:30.930424 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:34:30.930424 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:34:30.930424 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:34:30.930424 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:34:30.930424 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:34:30.930424 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:34:30.930424 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:34:30.930424 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:34:30.930424 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:34:30.930424 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7cf33651-7d81-4943-8ec4-182097c73de0 could not be found. Jul 23 21:34:30.930424 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:34:30.930424 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:34:30.930424 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:34:30.930424 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:34:30.930424 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:34:30.930424 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:34:30.930424 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:34:30.930424 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:34:30.930424 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:34:30.930424 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:34:30.930424 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:34:30.930424 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:34:30.930424 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:34:30.930424 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:34:30.930424 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:34:30.930424 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:34:30.930424 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7cf33651-7d81-4943-8ec4-182097c73de0 could not be found. Jul 23 21:34:30.930424 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:34:30.930424 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:34:30.935559 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:34:30.935559 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:34:30.935559 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:34:30.935559 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:34:30.935559 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:34:30.935559 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:34:30.935559 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7cf33651-7d81-4943-8ec4-182097c73de0 could not be found. Jul 23 21:34:30.935559 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:34:30.935559 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4a3b4d0e-5519-4ffc-ac83-d4e36ce82015 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Returning 404 to user: Instance 7cf33651-7d81-4943-8ec4-182097c73de0 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:34:30.937074 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4a3b4d0e-5519-4ffc-ac83-d4e36ce82015 tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] 10.222.0.17 "GET /compute/v2.1/servers/7cf33651-7d81-4943-8ec4-182097c73de0" status: 404 len: 111 microversion: 2.20 time: 0.070028 Jul 23 21:34:30.938077 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2467/5017] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:34:30 2022] GET /compute/v2.1/servers/7cf33651-7d81-4943-8ec4-182097c73de0 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 23 21:34:31.229335 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-81c62492-e83e-4347-babd-d16caa7420ab tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:34:31.229845 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-81c62492-e83e-4347-babd-d16caa7420ab tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] [instance: d6b9ea07-2ebd-4e1a-86f2-abb1bf581076] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:34:31.241641 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-81c62492-e83e-4347-babd-d16caa7420ab tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:31.242238 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-81c62492-e83e-4347-babd-d16caa7420ab tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:31.243027 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-81c62492-e83e-4347-babd-d16caa7420ab tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:31.245380 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-81c62492-e83e-4347-babd-d16caa7420ab tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:31.266724 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-81c62492-e83e-4347-babd-d16caa7420ab tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] HTTP exception thrown: Instance d6b9ea07-2ebd-4e1a-86f2-abb1bf581076 could not be found. Jul 23 21:34:31.270182 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-81c62492-e83e-4347-babd-d16caa7420ab tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Request method failure captured: Jul 23 21:34:31.270182 ncdv-master-1 devstack@n-api.service[131321]: request: DELETE /compute/v2.1/servers/d6b9ea07-2ebd-4e1a-86f2-abb1bf581076 HTTP/1.1 Jul 23 21:34:31.270182 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:34:31.270182 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:34:31.270182 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:34:31.270182 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:34:31.270182 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:34:31.270182 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:34:31.270182 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:34:31.270182 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:34:31.270182 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3GjR_0O6GBCiuxjDMiEyfVqYI1YKbSgNPPzxoIkrVy_FrrUjrWzvyNvEkXtlLAGAMMOkrqI-Zveal9DamR6iACXxUi-dpsTsmcAkFx41oWYSzBCiL5Kch14hOD4rlvYY_pz_x10LAqvx_qIUvQaBJMJHMyRtqH48pEnd-OgJDqLi-YE Jul 23 21:34:31.270182 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:34:31.270182 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:34:31.270182 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:34:31.270182 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:34:31.270182 ncdv-master-1 devstack@n-api.service[131321]: X-Openstack-Nova-Api-Version: 2.20 Jul 23 21:34:31.270182 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:34:31.270182 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:34:31.270182 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: 49da2dec096c474199da94d7c7a83258 Jul 23 21:34:31.270182 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1512806459 Jul 23 21:34:31.270182 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:34:31.270182 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:34:31.270182 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/49da2dec096c474199da94d7c7a83258"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/49da2dec096c474199da94d7c7a83258"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_49da2dec096c474199da94d7c7a83258", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/49da2dec096c474199da94d7c7a83258"}]}] Jul 23 21:34:31.270182 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1512806459 Jul 23 21:34:31.270182 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: 49da2dec096c474199da94d7c7a83258 Jul 23 21:34:31.270182 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1512806459 Jul 23 21:34:31.270182 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-AttachVolumeShelveTestJSON-1512806459-project Jul 23 21:34:31.270182 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:34:31.270182 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:34:31.270182 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: 048f5756139b4283b695c057647983ba Jul 23 21:34:31.270182 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1512806459-project Jul 23 21:34:31.270182 ncdv-master-1 devstack@n-api.service[131321]: method: > Jul 23 21:34:31.270182 ncdv-master-1 devstack@n-api.service[131321]: exception: Instance d6b9ea07-2ebd-4e1a-86f2-abb1bf581076 could not be found. Jul 23 21:34:31.270182 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': 'd6b9ea07-2ebd-4e1a-86f2-abb1bf581076'} Jul 23 21:34:31.270182 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:34:31.270182 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:34:31.270182 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:34:31.270182 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:34:31.270182 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:34:31.270182 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:34:31.270182 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:34:31.270182 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:34:31.270182 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:34:31.270182 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:34:31.270182 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6b9ea07-2ebd-4e1a-86f2-abb1bf581076 could not be found. Jul 23 21:34:31.270182 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:34:31.270182 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:34:31.270182 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:34:31.270182 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:34:31.270182 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:34:31.270182 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:34:31.270182 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:34:31.270182 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:34:31.270182 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:34:31.270182 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:34:31.270182 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 23 21:34:31.270182 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 23 21:34:31.270182 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 23 21:34:31.270182 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 23 21:34:31.270182 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:34:31.270182 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:34:31.270182 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:34:31.270182 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:34:31.274232 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6b9ea07-2ebd-4e1a-86f2-abb1bf581076 could not be found. Jul 23 21:34:31.274232 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:34:31.274232 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:34:31.274232 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:34:31.274232 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:34:31.274232 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:34:31.274232 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:34:31.274232 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:34:31.274232 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:34:31.274232 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6b9ea07-2ebd-4e1a-86f2-abb1bf581076 could not be found. Jul 23 21:34:31.274232 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:34:31.276378 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-81c62492-e83e-4347-babd-d16caa7420ab tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Returning 404 to user: Instance d6b9ea07-2ebd-4e1a-86f2-abb1bf581076 could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:34:31.277451 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-81c62492-e83e-4347-babd-d16caa7420ab tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d6b9ea07-2ebd-4e1a-86f2-abb1bf581076" status: 404 len: 111 microversion: 2.20 time: 0.053988 Jul 23 21:34:31.279297 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2551/5018] 10.222.0.17 () {60 vars in 1279 bytes} [Sat Jul 23 21:34:31 2022] DELETE /compute/v2.1/servers/d6b9ea07-2ebd-4e1a-86f2-abb1bf581076 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 23 21:34:31.288983 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e4d167f7-6d93-40ef-9b91-e4a25a86f88c tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:34:31.290699 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e4d167f7-6d93-40ef-9b91-e4a25a86f88c tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] [instance: d6b9ea07-2ebd-4e1a-86f2-abb1bf581076] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:34:31.300027 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e4d167f7-6d93-40ef-9b91-e4a25a86f88c tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:31.301019 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e4d167f7-6d93-40ef-9b91-e4a25a86f88c tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:31.302026 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e4d167f7-6d93-40ef-9b91-e4a25a86f88c tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:31.302583 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e4d167f7-6d93-40ef-9b91-e4a25a86f88c tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:31.324539 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-e4d167f7-6d93-40ef-9b91-e4a25a86f88c tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] HTTP exception thrown: Instance d6b9ea07-2ebd-4e1a-86f2-abb1bf581076 could not be found. Jul 23 21:34:31.327150 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e4d167f7-6d93-40ef-9b91-e4a25a86f88c tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Request method failure captured: Jul 23 21:34:31.327150 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/d6b9ea07-2ebd-4e1a-86f2-abb1bf581076 HTTP/1.1 Jul 23 21:34:31.327150 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:34:31.327150 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:34:31.327150 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:34:31.327150 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:34:31.327150 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:34:31.327150 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:34:31.327150 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:34:31.327150 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:34:31.327150 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GjR_0O6GBCiuxjDMiEyfVqYI1YKbSgNPPzxoIkrVy_FrrUjrWzvyNvEkXtlLAGAMMOkrqI-Zveal9DamR6iACXxUi-dpsTsmcAkFx41oWYSzBCiL5Kch14hOD4rlvYY_pz_x10LAqvx_qIUvQaBJMJHMyRtqH48pEnd-OgJDqLi-YE Jul 23 21:34:31.327150 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:34:31.327150 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:34:31.327150 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:34:31.327150 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:34:31.327150 ncdv-master-1 devstack@n-api.service[131320]: X-Openstack-Nova-Api-Version: 2.20 Jul 23 21:34:31.327150 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:34:31.327150 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:34:31.327150 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 49da2dec096c474199da94d7c7a83258 Jul 23 21:34:31.327150 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1512806459 Jul 23 21:34:31.327150 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:34:31.327150 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:34:31.327150 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/49da2dec096c474199da94d7c7a83258"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/49da2dec096c474199da94d7c7a83258"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_49da2dec096c474199da94d7c7a83258", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/49da2dec096c474199da94d7c7a83258"}]}] Jul 23 21:34:31.327150 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1512806459 Jul 23 21:34:31.327150 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 49da2dec096c474199da94d7c7a83258 Jul 23 21:34:31.327150 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1512806459 Jul 23 21:34:31.327150 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-AttachVolumeShelveTestJSON-1512806459-project Jul 23 21:34:31.327150 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:34:31.327150 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:34:31.327150 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 048f5756139b4283b695c057647983ba Jul 23 21:34:31.327150 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1512806459-project Jul 23 21:34:31.327150 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:34:31.327150 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance d6b9ea07-2ebd-4e1a-86f2-abb1bf581076 could not be found. Jul 23 21:34:31.327150 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': 'd6b9ea07-2ebd-4e1a-86f2-abb1bf581076'} Jul 23 21:34:31.327150 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:34:31.327150 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:34:31.327150 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:34:31.327150 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:34:31.327150 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:34:31.327150 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:34:31.327150 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:34:31.327150 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:34:31.327150 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:34:31.327150 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:34:31.327150 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6b9ea07-2ebd-4e1a-86f2-abb1bf581076 could not be found. Jul 23 21:34:31.327150 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:34:31.327150 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:34:31.327150 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:34:31.327150 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:34:31.327150 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:34:31.327150 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:34:31.327150 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:34:31.327150 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:34:31.327150 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:34:31.327150 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:34:31.327150 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:34:31.327150 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:34:31.327150 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:34:31.327150 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:34:31.327150 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:34:31.327150 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:34:31.327150 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6b9ea07-2ebd-4e1a-86f2-abb1bf581076 could not be found. Jul 23 21:34:31.327150 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:34:31.327150 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:34:31.332042 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:34:31.332042 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:34:31.332042 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:34:31.332042 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:34:31.332042 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:34:31.332042 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:34:31.332042 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6b9ea07-2ebd-4e1a-86f2-abb1bf581076 could not be found. Jul 23 21:34:31.332042 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:34:31.335953 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e4d167f7-6d93-40ef-9b91-e4a25a86f88c tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] Returning 404 to user: Instance d6b9ea07-2ebd-4e1a-86f2-abb1bf581076 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:34:31.337548 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e4d167f7-6d93-40ef-9b91-e4a25a86f88c tempest-AttachVolumeShelveTestJSON-1512806459 tempest-AttachVolumeShelveTestJSON-1512806459-project] 10.222.0.17 "GET /compute/v2.1/servers/d6b9ea07-2ebd-4e1a-86f2-abb1bf581076" status: 404 len: 111 microversion: 2.20 time: 0.054323 Jul 23 21:34:31.338713 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2468/5019] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:34:31 2022] GET /compute/v2.1/servers/d6b9ea07-2ebd-4e1a-86f2-abb1bf581076 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 23 21:34:31.949563 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-394a84e0-eecd-4f9b-9bea-a31dcf17dce3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:34:31.951388 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-394a84e0-eecd-4f9b-9bea-a31dcf17dce3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:34:31.984882 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-394a84e0-eecd-4f9b-9bea-a31dcf17dce3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:31.988945 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-394a84e0-eecd-4f9b-9bea-a31dcf17dce3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:31.990130 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-394a84e0-eecd-4f9b-9bea-a31dcf17dce3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:31.994252 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-394a84e0-eecd-4f9b-9bea-a31dcf17dce3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:32.155483 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-394a84e0-eecd-4f9b-9bea-a31dcf17dce3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:32.175830 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-394a84e0-eecd-4f9b-9bea-a31dcf17dce3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:32.177354 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-394a84e0-eecd-4f9b-9bea-a31dcf17dce3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:32.183491 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-394a84e0-eecd-4f9b-9bea-a31dcf17dce3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.261430 Jul 23 21:34:32.186241 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2552/5020] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:34:31 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:34:33.205408 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6544b0c1-ab25-4494-be7b-a94652a27a10 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:34:33.205986 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6544b0c1-ab25-4494-be7b-a94652a27a10 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:34:33.215896 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6544b0c1-ab25-4494-be7b-a94652a27a10 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:33.216742 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6544b0c1-ab25-4494-be7b-a94652a27a10 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:33.217912 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6544b0c1-ab25-4494-be7b-a94652a27a10 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:33.218711 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6544b0c1-ab25-4494-be7b-a94652a27a10 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:33.295242 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6544b0c1-ab25-4494-be7b-a94652a27a10 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:33.309011 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6544b0c1-ab25-4494-be7b-a94652a27a10 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:33.311113 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6544b0c1-ab25-4494-be7b-a94652a27a10 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:33.312559 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6544b0c1-ab25-4494-be7b-a94652a27a10 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.114345 Jul 23 21:34:33.313922 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2469/5021] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:34:33 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:34:34.331895 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-35160cb5-ea7a-492e-b94b-9eca54c2d9b5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:34:34.332506 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-35160cb5-ea7a-492e-b94b-9eca54c2d9b5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:34:34.342600 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-35160cb5-ea7a-492e-b94b-9eca54c2d9b5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:34.343056 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-35160cb5-ea7a-492e-b94b-9eca54c2d9b5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:34.343843 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-35160cb5-ea7a-492e-b94b-9eca54c2d9b5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:34.344281 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-35160cb5-ea7a-492e-b94b-9eca54c2d9b5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:34.462524 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-35160cb5-ea7a-492e-b94b-9eca54c2d9b5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:34.482494 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-35160cb5-ea7a-492e-b94b-9eca54c2d9b5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:34.484144 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-35160cb5-ea7a-492e-b94b-9eca54c2d9b5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:34.485392 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-35160cb5-ea7a-492e-b94b-9eca54c2d9b5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.157473 Jul 23 21:34:34.487113 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2553/5022] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:34:34 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:34:35.508689 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d3c2f7b0-4c1d-41d8-b9ae-9f25cae5ee8a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:34:35.509430 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d3c2f7b0-4c1d-41d8-b9ae-9f25cae5ee8a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:34:35.533261 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d3c2f7b0-4c1d-41d8-b9ae-9f25cae5ee8a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:35.533261 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d3c2f7b0-4c1d-41d8-b9ae-9f25cae5ee8a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:35.533261 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d3c2f7b0-4c1d-41d8-b9ae-9f25cae5ee8a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:35.533261 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d3c2f7b0-4c1d-41d8-b9ae-9f25cae5ee8a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:35.682047 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d3c2f7b0-4c1d-41d8-b9ae-9f25cae5ee8a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:35.697743 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d3c2f7b0-4c1d-41d8-b9ae-9f25cae5ee8a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:35.702727 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d3c2f7b0-4c1d-41d8-b9ae-9f25cae5ee8a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:35.705642 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d3c2f7b0-4c1d-41d8-b9ae-9f25cae5ee8a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.202530 Jul 23 21:34:35.706635 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2470/5023] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:34:35 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:34:36.233105 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-1e3d8e7c-8f21-4a9d-ab2e-fe716c63f8dc tempest-PortsAdminExtendedAttrsIpV6TestJSON-859817403 tempest-PortsAdminExtendedAttrsIpV6TestJSON-859817403-project-admin] Calling method '.version_select at 0x7f0b47cc4670>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:34:36.234055 ncdv-master-1 devstack@n-api.service[131321]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:34:36.234055 ncdv-master-1 devstack@n-api.service[131321]: warnings.warn(msg) Jul 23 21:34:36.235249 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1e3d8e7c-8f21-4a9d-ab2e-fe716c63f8dc tempest-PortsAdminExtendedAttrsIpV6TestJSON-859817403 tempest-PortsAdminExtendedAttrsIpV6TestJSON-859817403-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:36.235715 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1e3d8e7c-8f21-4a9d-ab2e-fe716c63f8dc tempest-PortsAdminExtendedAttrsIpV6TestJSON-859817403 tempest-PortsAdminExtendedAttrsIpV6TestJSON-859817403-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:36.258962 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1e3d8e7c-8f21-4a9d-ab2e-fe716c63f8dc tempest-PortsAdminExtendedAttrsIpV6TestJSON-859817403 tempest-PortsAdminExtendedAttrsIpV6TestJSON-859817403-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:36.259433 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1e3d8e7c-8f21-4a9d-ab2e-fe716c63f8dc tempest-PortsAdminExtendedAttrsIpV6TestJSON-859817403 tempest-PortsAdminExtendedAttrsIpV6TestJSON-859817403-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:36.282135 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1e3d8e7c-8f21-4a9d-ab2e-fe716c63f8dc tempest-PortsAdminExtendedAttrsIpV6TestJSON-859817403 tempest-PortsAdminExtendedAttrsIpV6TestJSON-859817403-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:36.282618 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1e3d8e7c-8f21-4a9d-ab2e-fe716c63f8dc tempest-PortsAdminExtendedAttrsIpV6TestJSON-859817403 tempest-PortsAdminExtendedAttrsIpV6TestJSON-859817403-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:36.289535 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-1e3d8e7c-8f21-4a9d-ab2e-fe716c63f8dc tempest-PortsAdminExtendedAttrsIpV6TestJSON-859817403 tempest-PortsAdminExtendedAttrsIpV6TestJSON-859817403-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.726840 Jul 23 21:34:36.295896 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2554/5024] 10.222.0.17 () {58 vars in 1145 bytes} [Sat Jul 23 21:34:35 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:34:36.734145 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-024d9850-a3dc-4c1f-9d8e-09be0b454fdb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:34:36.735550 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-024d9850-a3dc-4c1f-9d8e-09be0b454fdb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:34:36.744889 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-024d9850-a3dc-4c1f-9d8e-09be0b454fdb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:36.745357 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-024d9850-a3dc-4c1f-9d8e-09be0b454fdb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:36.746189 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-024d9850-a3dc-4c1f-9d8e-09be0b454fdb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:36.746815 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-024d9850-a3dc-4c1f-9d8e-09be0b454fdb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:36.836320 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-024d9850-a3dc-4c1f-9d8e-09be0b454fdb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:36.848663 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-024d9850-a3dc-4c1f-9d8e-09be0b454fdb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:36.850774 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-024d9850-a3dc-4c1f-9d8e-09be0b454fdb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:36.852723 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-024d9850-a3dc-4c1f-9d8e-09be0b454fdb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.128704 Jul 23 21:34:36.853582 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2471/5025] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:34:36 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:34:37.873503 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-167b660c-7928-49fe-b0b4-adf2a672c28b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:34:37.874396 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-167b660c-7928-49fe-b0b4-adf2a672c28b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:34:37.889986 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-167b660c-7928-49fe-b0b4-adf2a672c28b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:37.891155 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-167b660c-7928-49fe-b0b4-adf2a672c28b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:37.893579 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-167b660c-7928-49fe-b0b4-adf2a672c28b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:37.894093 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-167b660c-7928-49fe-b0b4-adf2a672c28b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:38.046770 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-167b660c-7928-49fe-b0b4-adf2a672c28b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:38.060588 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-167b660c-7928-49fe-b0b4-adf2a672c28b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:38.063193 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-167b660c-7928-49fe-b0b4-adf2a672c28b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:38.064876 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-167b660c-7928-49fe-b0b4-adf2a672c28b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.195942 Jul 23 21:34:38.074396 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2555/5026] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:34:37 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:34:39.086934 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d6e3f2bd-b913-4dec-a23a-19acb224b31b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:34:39.088753 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-d6e3f2bd-b913-4dec-a23a-19acb224b31b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:34:39.098592 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d6e3f2bd-b913-4dec-a23a-19acb224b31b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:39.099966 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d6e3f2bd-b913-4dec-a23a-19acb224b31b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:39.102062 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d6e3f2bd-b913-4dec-a23a-19acb224b31b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:39.102967 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d6e3f2bd-b913-4dec-a23a-19acb224b31b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:39.245634 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-d6e3f2bd-b913-4dec-a23a-19acb224b31b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:39.258545 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-d6e3f2bd-b913-4dec-a23a-19acb224b31b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:39.261615 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-d6e3f2bd-b913-4dec-a23a-19acb224b31b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:39.263061 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-d6e3f2bd-b913-4dec-a23a-19acb224b31b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.182432 Jul 23 21:34:39.264129 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2556/5027] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:34:39 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:34:39.392342 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b92ce337-a909-4b65-8a2a-d3c3fca6c4c0 tempest-VolumesSnapshotsTestJSON-1533761412 tempest-VolumesSnapshotsTestJSON-1533761412-project] Action: 'create', calling method: .version_select at 0x7f0b46cda160>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1249975075"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:34:39.914384 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b92ce337-a909-4b65-8a2a-d3c3fca6c4c0 tempest-VolumesSnapshotsTestJSON-1533761412 tempest-VolumesSnapshotsTestJSON-1533761412-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 200 len: 338 microversion: 2.1 time: 0.897654 Jul 23 21:34:39.915019 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2472/5028] 10.222.0.17 () {60 vars in 1154 bytes} [Sat Jul 23 21:34:39 2022] POST /compute/v2.1/os-volumes => generated 338 bytes in 899 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 23 21:34:39.926230 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-88782b92-3abe-4481-8eba-6bdd3ed2f2fa tempest-VolumesSnapshotsTestJSON-1533761412 tempest-VolumesSnapshotsTestJSON-1533761412-project] Calling method '.version_select at 0x7f0b47dd49d0>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:34:40.023070 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-88782b92-3abe-4481-8eba-6bdd3ed2f2fa tempest-VolumesSnapshotsTestJSON-1533761412 tempest-VolumesSnapshotsTestJSON-1533761412-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/2632ea0e-32de-4dc5-99e4-12c8d6daa898" status: 200 len: 338 microversion: 2.1 time: 0.100597 Jul 23 21:34:40.024045 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2557/5029] 10.222.0.17 () {58 vars in 1244 bytes} [Sat Jul 23 21:34:39 2022] GET /compute/v2.1/os-volumes/2632ea0e-32de-4dc5-99e4-12c8d6daa898 => generated 338 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:34:40.283211 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0173de33-851d-483d-953a-edd893ad45be tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:34:40.284204 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-0173de33-851d-483d-953a-edd893ad45be tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:34:40.292139 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0173de33-851d-483d-953a-edd893ad45be tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:40.292929 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0173de33-851d-483d-953a-edd893ad45be tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:40.293965 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0173de33-851d-483d-953a-edd893ad45be tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:40.294633 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0173de33-851d-483d-953a-edd893ad45be tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:40.381644 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-0173de33-851d-483d-953a-edd893ad45be tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:40.394899 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-0173de33-851d-483d-953a-edd893ad45be tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:40.397252 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-0173de33-851d-483d-953a-edd893ad45be tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:40.399641 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-0173de33-851d-483d-953a-edd893ad45be tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.121437 Jul 23 21:34:40.413045 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2473/5030] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:34:40 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:34:41.036753 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a21fc0f5-cf87-4c1d-90d2-e4a1cc8f692a tempest-VolumesSnapshotsTestJSON-1533761412 tempest-VolumesSnapshotsTestJSON-1533761412-project] Calling method '.version_select at 0x7f0b47f7de50>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:34:41.117524 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-a21fc0f5-cf87-4c1d-90d2-e4a1cc8f692a tempest-VolumesSnapshotsTestJSON-1533761412 tempest-VolumesSnapshotsTestJSON-1533761412-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/2632ea0e-32de-4dc5-99e4-12c8d6daa898" status: 200 len: 335 microversion: 2.1 time: 0.085419 Jul 23 21:34:41.118347 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2558/5031] 10.222.0.17 () {58 vars in 1244 bytes} [Sat Jul 23 21:34:41 2022] GET /compute/v2.1/os-volumes/2632ea0e-32de-4dc5-99e4-12c8d6daa898 => generated 335 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:34:41.141335 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d7b58d98-ad69-4a8b-bfe7-49e0bcbdf201 tempest-VolumesSnapshotsTestJSON-1533761412 tempest-VolumesSnapshotsTestJSON-1533761412-project] Calling method '.version_select at 0x7f0b46cda940>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:34:41.355495 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d7b58d98-ad69-4a8b-bfe7-49e0bcbdf201 tempest-VolumesSnapshotsTestJSON-1533761412 tempest-VolumesSnapshotsTestJSON-1533761412-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/2632ea0e-32de-4dc5-99e4-12c8d6daa898" status: 202 len: 0 microversion: 2.1 time: 0.218933 Jul 23 21:34:41.359828 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2474/5032] 10.222.0.17 () {58 vars in 1247 bytes} [Sat Jul 23 21:34:41 2022] DELETE /compute/v2.1/os-volumes/2632ea0e-32de-4dc5-99e4-12c8d6daa898 => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:34:41.364514 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-9df99a81-6aeb-4bfa-8f9e-acbdc1f2836a tempest-VolumesSnapshotsTestJSON-1533761412 tempest-VolumesSnapshotsTestJSON-1533761412-project] Calling method '.version_select at 0x7f0b47dde550>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:34:41.425526 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-79895d04-fadc-4ce3-8bfb-390bb8961b67 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:34:41.426173 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.wsgi [None req-9df99a81-6aeb-4bfa-8f9e-acbdc1f2836a tempest-VolumesSnapshotsTestJSON-1533761412 tempest-VolumesSnapshotsTestJSON-1533761412-project] HTTP exception thrown: Volume 2632ea0e-32de-4dc5-99e4-12c8d6daa898 could not be found. Jul 23 21:34:41.428877 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-79895d04-fadc-4ce3-8bfb-390bb8961b67 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:34:41.431355 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-9df99a81-6aeb-4bfa-8f9e-acbdc1f2836a tempest-VolumesSnapshotsTestJSON-1533761412 tempest-VolumesSnapshotsTestJSON-1533761412-project] Request method failure captured: Jul 23 21:34:41.431355 ncdv-master-1 devstack@n-api.service[131321]: request: GET /compute/v2.1/os-volumes/2632ea0e-32de-4dc5-99e4-12c8d6daa898 HTTP/1.1 Jul 23 21:34:41.431355 ncdv-master-1 devstack@n-api.service[131321]: Accept: application/json Jul 23 21:34:41.431355 ncdv-master-1 devstack@n-api.service[131321]: Accept-Encoding: identity Jul 23 21:34:41.431355 ncdv-master-1 devstack@n-api.service[131321]: Connection: close Jul 23 21:34:41.431355 ncdv-master-1 devstack@n-api.service[131321]: Content-Length: 0 Jul 23 21:34:41.431355 ncdv-master-1 devstack@n-api.service[131321]: Content-Type: application/json Jul 23 21:34:41.431355 ncdv-master-1 devstack@n-api.service[131321]: Host: 10.222.0.17 Jul 23 21:34:41.431355 ncdv-master-1 devstack@n-api.service[131321]: Openstack-System-Scope: None Jul 23 21:34:41.431355 ncdv-master-1 devstack@n-api.service[131321]: User-Agent: python-urllib3/1.26.9 Jul 23 21:34:41.431355 ncdv-master-1 devstack@n-api.service[131321]: X-Auth-Token: gAAAAABi3Glu6tHVvpu_qiiYzvwGLs4yC1EG5wq0KAsgwg1iXe5YUkvejNwVKTi8k0-c9nujD3HA2ii1YPvEUFbnlYHr4GyQ0OVOUb3x6Aeo-K__aLvMnAwgkGzn9lAz_CQMNCp7b4Gl6ju8AM6bzSlxlB71vck3ovsstz2uueBn6tsBVrddFoI Jul 23 21:34:41.431355 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Id: None Jul 23 21:34:41.431355 ncdv-master-1 devstack@n-api.service[131321]: X-Domain-Name: None Jul 23 21:34:41.431355 ncdv-master-1 devstack@n-api.service[131321]: X-Identity-Status: Confirmed Jul 23 21:34:41.431355 ncdv-master-1 devstack@n-api.service[131321]: X-Is-Admin-Project: True Jul 23 21:34:41.431355 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Id: default Jul 23 21:34:41.431355 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Domain-Name: Default Jul 23 21:34:41.431355 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Id: abe9428815bd479f96bb97e74e72337b Jul 23 21:34:41.431355 ncdv-master-1 devstack@n-api.service[131321]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1533761412 Jul 23 21:34:41.431355 ncdv-master-1 devstack@n-api.service[131321]: X-Role: reader,member Jul 23 21:34:41.431355 ncdv-master-1 devstack@n-api.service[131321]: X-Roles: reader,member Jul 23 21:34:41.431355 ncdv-master-1 devstack@n-api.service[131321]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/abe9428815bd479f96bb97e74e72337b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/abe9428815bd479f96bb97e74e72337b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_abe9428815bd479f96bb97e74e72337b", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/abe9428815bd479f96bb97e74e72337b"}]}] Jul 23 21:34:41.431355 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1533761412 Jul 23 21:34:41.431355 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Id: abe9428815bd479f96bb97e74e72337b Jul 23 21:34:41.431355 ncdv-master-1 devstack@n-api.service[131321]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1533761412 Jul 23 21:34:41.431355 ncdv-master-1 devstack@n-api.service[131321]: X-User: tempest-VolumesSnapshotsTestJSON-1533761412-project Jul 23 21:34:41.431355 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Id: default Jul 23 21:34:41.431355 ncdv-master-1 devstack@n-api.service[131321]: X-User-Domain-Name: Default Jul 23 21:34:41.431355 ncdv-master-1 devstack@n-api.service[131321]: X-User-Id: b81f706e95bd481394751229c7e658f2 Jul 23 21:34:41.431355 ncdv-master-1 devstack@n-api.service[131321]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1533761412-project Jul 23 21:34:41.431355 ncdv-master-1 devstack@n-api.service[131321]: method: Jul 23 21:34:41.431355 ncdv-master-1 devstack@n-api.service[131321]: exception: Volume 2632ea0e-32de-4dc5-99e4-12c8d6daa898 could not be found. Jul 23 21:34:41.431355 ncdv-master-1 devstack@n-api.service[131321]: action_args: {'id': '2632ea0e-32de-4dc5-99e4-12c8d6daa898'} Jul 23 21:34:41.431355 ncdv-master-1 devstack@n-api.service[131321]: {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:34:41.431355 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:34:41.431355 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 23 21:34:41.431355 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 23 21:34:41.431355 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 23 21:34:41.431355 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 23 21:34:41.431355 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 23 21:34:41.431355 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 23 21:34:41.431355 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 23 21:34:41.431355 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 23 21:34:41.431355 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 23 21:34:41.431355 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 23 21:34:41.431355 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 23 21:34:41.431355 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 23 21:34:41.431355 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 23 21:34:41.431355 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 23 21:34:41.431355 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2632ea0e-32de-4dc5-99e4-12c8d6daa898 could not be found. (HTTP 404) (Request-ID: req-3d233e2e-dec0-460a-bbef-d60ffb740379) Jul 23 21:34:41.431355 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:34:41.431355 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:34:41.431355 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:34:41.431355 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:34:41.431355 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 23 21:34:41.431355 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 23 21:34:41.431355 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 23 21:34:41.431355 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 23 21:34:41.431355 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 23 21:34:41.431355 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 23 21:34:41.431355 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 23 21:34:41.431355 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 23 21:34:41.431355 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 23 21:34:41.437548 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 23 21:34:41.437548 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 23 21:34:41.437548 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 23 21:34:41.437548 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 23 21:34:41.437548 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 23 21:34:41.437548 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 23 21:34:41.437548 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 23 21:34:41.437548 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 23 21:34:41.437548 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 23 21:34:41.437548 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 23 21:34:41.437548 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 23 21:34:41.437548 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 23 21:34:41.437548 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 23 21:34:41.437548 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2632ea0e-32de-4dc5-99e4-12c8d6daa898 could not be found. Jul 23 21:34:41.437548 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:34:41.437548 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:34:41.437548 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:34:41.437548 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:34:41.437548 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:34:41.437548 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:34:41.437548 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:34:41.437548 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:34:41.437548 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 23 21:34:41.437548 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 23 21:34:41.437548 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:34:41.437548 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:34:41.437548 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 23 21:34:41.437548 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:34:41.437548 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2632ea0e-32de-4dc5-99e4-12c8d6daa898 could not be found. Jul 23 21:34:41.437548 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:34:41.437548 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:34:41.437548 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:34:41.437548 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:34:41.437548 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:34:41.437548 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:34:41.437548 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:34:41.437548 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:34:41.437548 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2632ea0e-32de-4dc5-99e4-12c8d6daa898 could not be found. Jul 23 21:34:41.437548 ncdv-master-1 devstack@n-api.service[131321]: ERROR nova.api.openstack.wsgi Jul 23 21:34:41.437548 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-9df99a81-6aeb-4bfa-8f9e-acbdc1f2836a tempest-VolumesSnapshotsTestJSON-1533761412 tempest-VolumesSnapshotsTestJSON-1533761412-project] Returning 404 to user: Volume 2632ea0e-32de-4dc5-99e4-12c8d6daa898 could not be found. {{(pid=131321) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:34:41.437548 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-9df99a81-6aeb-4bfa-8f9e-acbdc1f2836a tempest-VolumesSnapshotsTestJSON-1533761412 tempest-VolumesSnapshotsTestJSON-1533761412-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/2632ea0e-32de-4dc5-99e4-12c8d6daa898" status: 404 len: 109 microversion: 2.1 time: 0.073258 Jul 23 21:34:41.447466 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2559/5033] 10.222.0.17 () {58 vars in 1244 bytes} [Sat Jul 23 21:34:41 2022] GET /compute/v2.1/os-volumes/2632ea0e-32de-4dc5-99e4-12c8d6daa898 => generated 109 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:34:41.465616 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-79895d04-fadc-4ce3-8bfb-390bb8961b67 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:41.466111 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-79895d04-fadc-4ce3-8bfb-390bb8961b67 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:41.470780 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-79895d04-fadc-4ce3-8bfb-390bb8961b67 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:41.471246 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-79895d04-fadc-4ce3-8bfb-390bb8961b67 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:41.545892 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-79895d04-fadc-4ce3-8bfb-390bb8961b67 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:41.557804 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-79895d04-fadc-4ce3-8bfb-390bb8961b67 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:41.560270 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-79895d04-fadc-4ce3-8bfb-390bb8961b67 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:41.561810 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-79895d04-fadc-4ce3-8bfb-390bb8961b67 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.145723 Jul 23 21:34:41.563130 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2475/5034] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:34:41 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:34:42.581910 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-6ec14f2a-aa04-4ee9-a045-8693f754c583 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:34:42.583964 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-6ec14f2a-aa04-4ee9-a045-8693f754c583 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:34:42.593494 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6ec14f2a-aa04-4ee9-a045-8693f754c583 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:42.595428 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6ec14f2a-aa04-4ee9-a045-8693f754c583 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:42.605122 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6ec14f2a-aa04-4ee9-a045-8693f754c583 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:42.606070 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6ec14f2a-aa04-4ee9-a045-8693f754c583 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:42.739615 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-6ec14f2a-aa04-4ee9-a045-8693f754c583 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:42.760768 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-6ec14f2a-aa04-4ee9-a045-8693f754c583 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:42.763744 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-6ec14f2a-aa04-4ee9-a045-8693f754c583 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:42.765979 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-6ec14f2a-aa04-4ee9-a045-8693f754c583 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.189147 Jul 23 21:34:42.767744 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2560/5035] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:34:42 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:34:43.787258 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8561385e-93f1-409d-a91f-03a0e561d070 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:34:43.788018 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8561385e-93f1-409d-a91f-03a0e561d070 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:34:43.796131 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8561385e-93f1-409d-a91f-03a0e561d070 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:43.796590 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8561385e-93f1-409d-a91f-03a0e561d070 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:43.797595 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8561385e-93f1-409d-a91f-03a0e561d070 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:43.798124 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8561385e-93f1-409d-a91f-03a0e561d070 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:43.873188 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8561385e-93f1-409d-a91f-03a0e561d070 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:43.883157 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8561385e-93f1-409d-a91f-03a0e561d070 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:43.884927 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8561385e-93f1-409d-a91f-03a0e561d070 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:43.886505 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8561385e-93f1-409d-a91f-03a0e561d070 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.104105 Jul 23 21:34:43.888972 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2476/5036] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:34:43 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:34:44.909630 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d9d3e0bf-5967-47d0-91b0-5e920b4a02d0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:34:44.912000 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-d9d3e0bf-5967-47d0-91b0-5e920b4a02d0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:34:44.921779 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d9d3e0bf-5967-47d0-91b0-5e920b4a02d0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:44.922696 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d9d3e0bf-5967-47d0-91b0-5e920b4a02d0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:44.924053 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d9d3e0bf-5967-47d0-91b0-5e920b4a02d0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:44.924936 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d9d3e0bf-5967-47d0-91b0-5e920b4a02d0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:45.008885 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-d9d3e0bf-5967-47d0-91b0-5e920b4a02d0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:45.021953 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-d9d3e0bf-5967-47d0-91b0-5e920b4a02d0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:45.024343 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-d9d3e0bf-5967-47d0-91b0-5e920b4a02d0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:45.026377 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-d9d3e0bf-5967-47d0-91b0-5e920b4a02d0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.124461 Jul 23 21:34:45.027146 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2561/5037] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:34:44 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:34:46.046753 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-60167a74-fef9-4883-8d1e-259347a56c21 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:34:46.049434 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-60167a74-fef9-4883-8d1e-259347a56c21 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:34:46.056828 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-60167a74-fef9-4883-8d1e-259347a56c21 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:46.057399 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-60167a74-fef9-4883-8d1e-259347a56c21 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:46.058295 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-60167a74-fef9-4883-8d1e-259347a56c21 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:46.058917 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-60167a74-fef9-4883-8d1e-259347a56c21 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:46.063738 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:46.139454 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-60167a74-fef9-4883-8d1e-259347a56c21 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:46.158774 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-60167a74-fef9-4883-8d1e-259347a56c21 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:46.159290 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-60167a74-fef9-4883-8d1e-259347a56c21 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:46.160854 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-60167a74-fef9-4883-8d1e-259347a56c21 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.119717 Jul 23 21:34:46.161819 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2477/5038] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:34:46 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:34:47.180815 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-fafe6042-40f7-4cec-84b8-e37fba168245 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:34:47.181289 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-fafe6042-40f7-4cec-84b8-e37fba168245 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:34:47.186480 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_api:SELECT=53,nova_api:DELETE=1 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:47.191427 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fafe6042-40f7-4cec-84b8-e37fba168245 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:47.191984 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fafe6042-40f7-4cec-84b8-e37fba168245 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:47.200187 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fafe6042-40f7-4cec-84b8-e37fba168245 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:47.200688 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fafe6042-40f7-4cec-84b8-e37fba168245 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:47.381326 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-fafe6042-40f7-4cec-84b8-e37fba168245 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:47.393788 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-fafe6042-40f7-4cec-84b8-e37fba168245 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:47.395840 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-fafe6042-40f7-4cec-84b8-e37fba168245 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:47.397427 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-fafe6042-40f7-4cec-84b8-e37fba168245 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.221144 Jul 23 21:34:47.409558 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2562/5039] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:34:47 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:34:47.786801 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e1135ceb-f844-4117-aab1-e0e2f5bf6f3e tempest-PortsAdminExtendedAttrsTestJSON-1679375008 tempest-PortsAdminExtendedAttrsTestJSON-1679375008-project-admin] Calling method '.version_select at 0x7f0b46b47310>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:34:47.788786 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:34:47.788786 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:34:47.790153 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e1135ceb-f844-4117-aab1-e0e2f5bf6f3e tempest-PortsAdminExtendedAttrsTestJSON-1679375008 tempest-PortsAdminExtendedAttrsTestJSON-1679375008-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:47.790835 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e1135ceb-f844-4117-aab1-e0e2f5bf6f3e tempest-PortsAdminExtendedAttrsTestJSON-1679375008 tempest-PortsAdminExtendedAttrsTestJSON-1679375008-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:47.841539 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e1135ceb-f844-4117-aab1-e0e2f5bf6f3e tempest-PortsAdminExtendedAttrsTestJSON-1679375008 tempest-PortsAdminExtendedAttrsTestJSON-1679375008-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:47.846741 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e1135ceb-f844-4117-aab1-e0e2f5bf6f3e tempest-PortsAdminExtendedAttrsTestJSON-1679375008 tempest-PortsAdminExtendedAttrsTestJSON-1679375008-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:47.883404 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e1135ceb-f844-4117-aab1-e0e2f5bf6f3e tempest-PortsAdminExtendedAttrsTestJSON-1679375008 tempest-PortsAdminExtendedAttrsTestJSON-1679375008-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:47.885582 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e1135ceb-f844-4117-aab1-e0e2f5bf6f3e tempest-PortsAdminExtendedAttrsTestJSON-1679375008 tempest-PortsAdminExtendedAttrsTestJSON-1679375008-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:47.898911 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e1135ceb-f844-4117-aab1-e0e2f5bf6f3e tempest-PortsAdminExtendedAttrsTestJSON-1679375008 tempest-PortsAdminExtendedAttrsTestJSON-1679375008-project-admin] 10.222.0.17 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.587212 Jul 23 21:34:47.899565 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2478/5040] 10.222.0.17 () {58 vars in 1145 bytes} [Sat Jul 23 21:34:47 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:34:48.420700 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-0fd73a94-ec17-46b8-8601-694a886e786f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:34:48.421211 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-0fd73a94-ec17-46b8-8601-694a886e786f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:34:48.443315 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0fd73a94-ec17-46b8-8601-694a886e786f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:48.444246 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0fd73a94-ec17-46b8-8601-694a886e786f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:48.445261 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0fd73a94-ec17-46b8-8601-694a886e786f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:48.445968 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0fd73a94-ec17-46b8-8601-694a886e786f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:48.548627 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-0fd73a94-ec17-46b8-8601-694a886e786f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:48.560506 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-0fd73a94-ec17-46b8-8601-694a886e786f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:48.567279 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-0fd73a94-ec17-46b8-8601-694a886e786f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:48.568609 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-0fd73a94-ec17-46b8-8601-694a886e786f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.153758 Jul 23 21:34:48.569133 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2563/5041] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:34:48 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:34:49.586497 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-823bdc10-acb0-41cd-b031-b0935ba7775b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:34:49.587120 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-823bdc10-acb0-41cd-b031-b0935ba7775b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:34:49.594312 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-823bdc10-acb0-41cd-b031-b0935ba7775b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:49.595421 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-823bdc10-acb0-41cd-b031-b0935ba7775b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:49.596393 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-823bdc10-acb0-41cd-b031-b0935ba7775b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:49.596996 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-823bdc10-acb0-41cd-b031-b0935ba7775b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:49.752293 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-823bdc10-acb0-41cd-b031-b0935ba7775b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:49.777930 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-823bdc10-acb0-41cd-b031-b0935ba7775b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:49.782651 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-823bdc10-acb0-41cd-b031-b0935ba7775b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:49.785732 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-823bdc10-acb0-41cd-b031-b0935ba7775b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.203208 Jul 23 21:34:49.787257 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2479/5042] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:34:49 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:34:50.806119 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-b69dc2a8-76e0-4d9c-b1dc-5dad2612376b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:34:50.806686 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-b69dc2a8-76e0-4d9c-b1dc-5dad2612376b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:34:50.817622 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b69dc2a8-76e0-4d9c-b1dc-5dad2612376b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:50.821427 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b69dc2a8-76e0-4d9c-b1dc-5dad2612376b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:50.829386 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b69dc2a8-76e0-4d9c-b1dc-5dad2612376b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:50.832983 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b69dc2a8-76e0-4d9c-b1dc-5dad2612376b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:50.984650 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-b69dc2a8-76e0-4d9c-b1dc-5dad2612376b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:50.994161 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-b69dc2a8-76e0-4d9c-b1dc-5dad2612376b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:51.007927 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-b69dc2a8-76e0-4d9c-b1dc-5dad2612376b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:51.009688 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-b69dc2a8-76e0-4d9c-b1dc-5dad2612376b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.208551 Jul 23 21:34:51.010478 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2564/5043] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:34:50 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:34:52.034354 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-28ff41f1-647a-47ac-9202-abf678df81f3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:34:52.035892 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-28ff41f1-647a-47ac-9202-abf678df81f3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:34:52.045469 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:52.048245 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-28ff41f1-647a-47ac-9202-abf678df81f3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:52.048699 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-28ff41f1-647a-47ac-9202-abf678df81f3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:52.049549 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-28ff41f1-647a-47ac-9202-abf678df81f3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:52.050165 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-28ff41f1-647a-47ac-9202-abf678df81f3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:52.209386 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-28ff41f1-647a-47ac-9202-abf678df81f3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:52.227588 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-28ff41f1-647a-47ac-9202-abf678df81f3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:52.235004 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-28ff41f1-647a-47ac-9202-abf678df81f3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:52.241167 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-28ff41f1-647a-47ac-9202-abf678df81f3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.209354 Jul 23 21:34:52.242731 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2480/5044] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:34:52 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:34:53.265268 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-6597dad9-d1a4-43e2-92d9-e14374ebcc27 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:34:53.266014 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-6597dad9-d1a4-43e2-92d9-e14374ebcc27 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:34:53.280992 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6597dad9-d1a4-43e2-92d9-e14374ebcc27 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:53.281917 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6597dad9-d1a4-43e2-92d9-e14374ebcc27 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:53.282911 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6597dad9-d1a4-43e2-92d9-e14374ebcc27 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:53.286499 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6597dad9-d1a4-43e2-92d9-e14374ebcc27 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:53.507985 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-6597dad9-d1a4-43e2-92d9-e14374ebcc27 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:53.523893 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-6597dad9-d1a4-43e2-92d9-e14374ebcc27 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:53.526971 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-6597dad9-d1a4-43e2-92d9-e14374ebcc27 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:53.529143 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-6597dad9-d1a4-43e2-92d9-e14374ebcc27 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.272030 Jul 23 21:34:53.535125 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2565/5045] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:34:53 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:34:54.548797 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-41eaa4cb-ef0e-4cde-bae6-a19235bd73d6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:34:54.550177 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-41eaa4cb-ef0e-4cde-bae6-a19235bd73d6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:34:54.557733 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-41eaa4cb-ef0e-4cde-bae6-a19235bd73d6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:54.558405 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-41eaa4cb-ef0e-4cde-bae6-a19235bd73d6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:54.559355 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-41eaa4cb-ef0e-4cde-bae6-a19235bd73d6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:54.560022 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-41eaa4cb-ef0e-4cde-bae6-a19235bd73d6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:54.695068 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-41eaa4cb-ef0e-4cde-bae6-a19235bd73d6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:54.712482 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-41eaa4cb-ef0e-4cde-bae6-a19235bd73d6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:54.717656 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-41eaa4cb-ef0e-4cde-bae6-a19235bd73d6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:54.719265 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-41eaa4cb-ef0e-4cde-bae6-a19235bd73d6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.174560 Jul 23 21:34:54.721452 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2481/5046] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:34:54 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:34:56.109188 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d8bf7688-54a2-4031-86c9-709a2547822d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:34:56.115981 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-d8bf7688-54a2-4031-86c9-709a2547822d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:34:56.141447 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d8bf7688-54a2-4031-86c9-709a2547822d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:56.142392 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d8bf7688-54a2-4031-86c9-709a2547822d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:56.145668 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d8bf7688-54a2-4031-86c9-709a2547822d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:56.148761 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d8bf7688-54a2-4031-86c9-709a2547822d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:56.314353 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-d8bf7688-54a2-4031-86c9-709a2547822d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:56.329049 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-d8bf7688-54a2-4031-86c9-709a2547822d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:56.331814 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-d8bf7688-54a2-4031-86c9-709a2547822d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:56.333531 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-d8bf7688-54a2-4031-86c9-709a2547822d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.597699 Jul 23 21:34:56.334234 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2566/5047] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:34:55 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:34:57.353121 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f670eeb1-bffa-49ab-9615-9606206bf9b1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:34:57.354302 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f670eeb1-bffa-49ab-9615-9606206bf9b1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:34:57.372813 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f670eeb1-bffa-49ab-9615-9606206bf9b1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:57.373275 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f670eeb1-bffa-49ab-9615-9606206bf9b1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:57.374101 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f670eeb1-bffa-49ab-9615-9606206bf9b1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:57.374543 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f670eeb1-bffa-49ab-9615-9606206bf9b1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:57.570994 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f670eeb1-bffa-49ab-9615-9606206bf9b1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:57.579592 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f670eeb1-bffa-49ab-9615-9606206bf9b1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:57.581101 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f670eeb1-bffa-49ab-9615-9606206bf9b1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:57.582423 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f670eeb1-bffa-49ab-9615-9606206bf9b1 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.233602 Jul 23 21:34:57.592762 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2482/5048] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:34:57 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:34:58.612365 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-63180d8b-2539-41e6-a774-1d09e17b75a3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:34:58.613067 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-63180d8b-2539-41e6-a774-1d09e17b75a3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:34:58.621170 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-63180d8b-2539-41e6-a774-1d09e17b75a3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:58.622237 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-63180d8b-2539-41e6-a774-1d09e17b75a3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:58.623274 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-63180d8b-2539-41e6-a774-1d09e17b75a3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:58.624070 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-63180d8b-2539-41e6-a774-1d09e17b75a3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:58.632320 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=87 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:34:58.828012 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-63180d8b-2539-41e6-a774-1d09e17b75a3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:58.852456 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-63180d8b-2539-41e6-a774-1d09e17b75a3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:58.854792 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-63180d8b-2539-41e6-a774-1d09e17b75a3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:34:58.856948 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-63180d8b-2539-41e6-a774-1d09e17b75a3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.249746 Jul 23 21:34:58.858085 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2567/5049] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:34:58 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:34:59.882526 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c0e1c4e9-492c-4194-93b9-9e11648b10ce tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:34:59.884985 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c0e1c4e9-492c-4194-93b9-9e11648b10ce tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:34:59.897287 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c0e1c4e9-492c-4194-93b9-9e11648b10ce tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:59.901057 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c0e1c4e9-492c-4194-93b9-9e11648b10ce tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:34:59.902518 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c0e1c4e9-492c-4194-93b9-9e11648b10ce tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:34:59.903776 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c0e1c4e9-492c-4194-93b9-9e11648b10ce tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:35:00.099569 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c0e1c4e9-492c-4194-93b9-9e11648b10ce tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:00.114643 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c0e1c4e9-492c-4194-93b9-9e11648b10ce tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:00.118563 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c0e1c4e9-492c-4194-93b9-9e11648b10ce tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:00.122197 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c0e1c4e9-492c-4194-93b9-9e11648b10ce tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.250131 Jul 23 21:35:00.135227 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2483/5050] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:34:59 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:35:01.142473 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-1355a775-c405-4521-83da-a37cb0eb617f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:35:01.143077 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-1355a775-c405-4521-83da-a37cb0eb617f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:35:01.155962 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1355a775-c405-4521-83da-a37cb0eb617f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:35:01.156715 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1355a775-c405-4521-83da-a37cb0eb617f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:35:01.157675 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1355a775-c405-4521-83da-a37cb0eb617f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:35:01.159761 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1355a775-c405-4521-83da-a37cb0eb617f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:35:01.279457 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-1355a775-c405-4521-83da-a37cb0eb617f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:01.290029 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-1355a775-c405-4521-83da-a37cb0eb617f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:01.292669 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-1355a775-c405-4521-83da-a37cb0eb617f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:01.294669 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-1355a775-c405-4521-83da-a37cb0eb617f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.156034 Jul 23 21:35:01.295887 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2568/5051] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:35:01 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:35:02.316975 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-73ad664f-8d72-43ef-a646-d4eaafdad54d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:35:02.317573 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-73ad664f-8d72-43ef-a646-d4eaafdad54d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:35:02.330242 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-73ad664f-8d72-43ef-a646-d4eaafdad54d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:35:02.331624 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-73ad664f-8d72-43ef-a646-d4eaafdad54d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:35:02.333950 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-73ad664f-8d72-43ef-a646-d4eaafdad54d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:35:02.334810 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-73ad664f-8d72-43ef-a646-d4eaafdad54d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:35:02.468073 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-73ad664f-8d72-43ef-a646-d4eaafdad54d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:02.482943 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-73ad664f-8d72-43ef-a646-d4eaafdad54d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:02.492430 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-73ad664f-8d72-43ef-a646-d4eaafdad54d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:02.496266 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-73ad664f-8d72-43ef-a646-d4eaafdad54d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.183332 Jul 23 21:35:02.499733 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2484/5052] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:35:02 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:35:03.518800 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-dd8428a7-06bf-407a-a03a-b4697be0ac6e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:35:03.519661 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-dd8428a7-06bf-407a-a03a-b4697be0ac6e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:35:03.532909 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-dd8428a7-06bf-407a-a03a-b4697be0ac6e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:35:03.533370 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-dd8428a7-06bf-407a-a03a-b4697be0ac6e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:35:03.539213 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-dd8428a7-06bf-407a-a03a-b4697be0ac6e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:35:03.540480 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-dd8428a7-06bf-407a-a03a-b4697be0ac6e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:35:03.887428 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-dd8428a7-06bf-407a-a03a-b4697be0ac6e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:03.900740 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-dd8428a7-06bf-407a-a03a-b4697be0ac6e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:03.904034 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-dd8428a7-06bf-407a-a03a-b4697be0ac6e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:03.905697 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-dd8428a7-06bf-407a-a03a-b4697be0ac6e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.391550 Jul 23 21:35:03.907198 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2569/5053] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:35:03 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:35:04.925940 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6a782ec6-e633-44a3-bd0b-847b3cc076dc tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:35:04.927329 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6a782ec6-e633-44a3-bd0b-847b3cc076dc tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:35:04.935924 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6a782ec6-e633-44a3-bd0b-847b3cc076dc tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:35:04.936655 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6a782ec6-e633-44a3-bd0b-847b3cc076dc tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:35:04.937993 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6a782ec6-e633-44a3-bd0b-847b3cc076dc tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:35:04.939078 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6a782ec6-e633-44a3-bd0b-847b3cc076dc tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:35:05.032949 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6a782ec6-e633-44a3-bd0b-847b3cc076dc tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:05.046198 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6a782ec6-e633-44a3-bd0b-847b3cc076dc tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:05.047699 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6a782ec6-e633-44a3-bd0b-847b3cc076dc tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:05.055113 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6a782ec6-e633-44a3-bd0b-847b3cc076dc tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.134267 Jul 23 21:35:05.055787 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2485/5054] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:35:04 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:35:06.073764 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-2eadc22f-814b-4933-a840-b763a1b91cb4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:35:06.074454 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-2eadc22f-814b-4933-a840-b763a1b91cb4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:35:06.095747 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2eadc22f-814b-4933-a840-b763a1b91cb4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:35:06.096208 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2eadc22f-814b-4933-a840-b763a1b91cb4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:35:06.097008 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2eadc22f-814b-4933-a840-b763a1b91cb4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:35:06.097531 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-2eadc22f-814b-4933-a840-b763a1b91cb4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:35:06.319214 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-2eadc22f-814b-4933-a840-b763a1b91cb4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:06.345846 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-2eadc22f-814b-4933-a840-b763a1b91cb4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:06.351988 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-2eadc22f-814b-4933-a840-b763a1b91cb4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:06.359163 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-2eadc22f-814b-4933-a840-b763a1b91cb4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.284371 Jul 23 21:35:06.361722 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2570/5055] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:35:06 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:35:07.379432 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3606c479-d65e-470b-888e-2aaab390a16b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:35:07.380651 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-3606c479-d65e-470b-888e-2aaab390a16b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:35:07.392212 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3606c479-d65e-470b-888e-2aaab390a16b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:35:07.393160 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3606c479-d65e-470b-888e-2aaab390a16b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:35:07.400364 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3606c479-d65e-470b-888e-2aaab390a16b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:35:07.400829 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3606c479-d65e-470b-888e-2aaab390a16b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:35:07.688082 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-3606c479-d65e-470b-888e-2aaab390a16b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:07.700466 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-3606c479-d65e-470b-888e-2aaab390a16b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:07.701894 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-3606c479-d65e-470b-888e-2aaab390a16b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:07.707448 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-3606c479-d65e-470b-888e-2aaab390a16b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.332144 Jul 23 21:35:07.710275 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2486/5056] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:35:07 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:35:08.729497 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c6baadcf-7853-4bd1-a4f6-bae8d7c252bf tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:35:08.730162 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-c6baadcf-7853-4bd1-a4f6-bae8d7c252bf tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:35:08.740525 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c6baadcf-7853-4bd1-a4f6-bae8d7c252bf tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:35:08.746549 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c6baadcf-7853-4bd1-a4f6-bae8d7c252bf tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:35:08.747677 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c6baadcf-7853-4bd1-a4f6-bae8d7c252bf tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:35:08.748293 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c6baadcf-7853-4bd1-a4f6-bae8d7c252bf tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:35:08.921386 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c6baadcf-7853-4bd1-a4f6-bae8d7c252bf tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:08.939109 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c6baadcf-7853-4bd1-a4f6-bae8d7c252bf tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:08.940910 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c6baadcf-7853-4bd1-a4f6-bae8d7c252bf tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:08.946333 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-c6baadcf-7853-4bd1-a4f6-bae8d7c252bf tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.219843 Jul 23 21:35:08.960627 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2571/5057] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:35:08 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:35:09.971252 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1e52f48f-f2d2-4f97-88e1-545217a60c23 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:35:09.984682 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1e52f48f-f2d2-4f97-88e1-545217a60c23 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:35:10.008943 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1e52f48f-f2d2-4f97-88e1-545217a60c23 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:35:10.009777 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1e52f48f-f2d2-4f97-88e1-545217a60c23 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:35:10.028208 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1e52f48f-f2d2-4f97-88e1-545217a60c23 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:35:10.043554 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1e52f48f-f2d2-4f97-88e1-545217a60c23 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:35:10.176314 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-1e52f48f-f2d2-4f97-88e1-545217a60c23 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:10.192525 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-1e52f48f-f2d2-4f97-88e1-545217a60c23 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:10.197962 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-1e52f48f-f2d2-4f97-88e1-545217a60c23 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:10.205888 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1e52f48f-f2d2-4f97-88e1-545217a60c23 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.242700 Jul 23 21:35:10.219786 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2487/5058] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:35:09 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:35:11.228124 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-1f7f3830-39f6-48c6-ba28-340a00795a01 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:35:11.229738 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-1f7f3830-39f6-48c6-ba28-340a00795a01 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:35:11.247036 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1f7f3830-39f6-48c6-ba28-340a00795a01 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:35:11.249315 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1f7f3830-39f6-48c6-ba28-340a00795a01 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:35:11.251295 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1f7f3830-39f6-48c6-ba28-340a00795a01 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:35:11.253611 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1f7f3830-39f6-48c6-ba28-340a00795a01 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:35:11.538517 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-1f7f3830-39f6-48c6-ba28-340a00795a01 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:11.570900 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-1f7f3830-39f6-48c6-ba28-340a00795a01 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:11.573838 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-1f7f3830-39f6-48c6-ba28-340a00795a01 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:11.578205 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-1f7f3830-39f6-48c6-ba28-340a00795a01 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.356905 Jul 23 21:35:11.599379 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2572/5059] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:35:11 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:35:12.596866 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2521d92f-a3bc-4d3f-aef0-95810ec74a7a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:35:12.597466 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-2521d92f-a3bc-4d3f-aef0-95810ec74a7a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:35:12.608920 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2521d92f-a3bc-4d3f-aef0-95810ec74a7a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:35:12.609837 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2521d92f-a3bc-4d3f-aef0-95810ec74a7a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:35:12.610823 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2521d92f-a3bc-4d3f-aef0-95810ec74a7a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:35:12.611416 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2521d92f-a3bc-4d3f-aef0-95810ec74a7a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:35:12.857344 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-2521d92f-a3bc-4d3f-aef0-95810ec74a7a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:12.874069 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-2521d92f-a3bc-4d3f-aef0-95810ec74a7a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:12.878182 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-2521d92f-a3bc-4d3f-aef0-95810ec74a7a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:12.879842 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2521d92f-a3bc-4d3f-aef0-95810ec74a7a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.287044 Jul 23 21:35:12.917384 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2488/5060] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:35:12 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:35:13.899686 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-6ba606c4-81c3-4d72-a5ac-707d78e0e86c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:35:13.900676 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-6ba606c4-81c3-4d72-a5ac-707d78e0e86c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:35:13.910924 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6ba606c4-81c3-4d72-a5ac-707d78e0e86c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:35:13.911382 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6ba606c4-81c3-4d72-a5ac-707d78e0e86c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:35:13.912264 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6ba606c4-81c3-4d72-a5ac-707d78e0e86c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:35:13.912695 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6ba606c4-81c3-4d72-a5ac-707d78e0e86c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:35:13.997646 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-6ba606c4-81c3-4d72-a5ac-707d78e0e86c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:14.007410 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-6ba606c4-81c3-4d72-a5ac-707d78e0e86c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:14.008908 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-6ba606c4-81c3-4d72-a5ac-707d78e0e86c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:14.010148 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-6ba606c4-81c3-4d72-a5ac-707d78e0e86c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.115317 Jul 23 21:35:14.021773 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2573/5061] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:35:13 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:35:15.031219 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4449fccc-0593-4f44-9fdb-7e1d413f84d0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:35:15.032154 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-4449fccc-0593-4f44-9fdb-7e1d413f84d0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:35:15.043429 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4449fccc-0593-4f44-9fdb-7e1d413f84d0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:35:15.044960 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4449fccc-0593-4f44-9fdb-7e1d413f84d0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:35:15.046068 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4449fccc-0593-4f44-9fdb-7e1d413f84d0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:35:15.046734 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4449fccc-0593-4f44-9fdb-7e1d413f84d0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:35:15.163665 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-4449fccc-0593-4f44-9fdb-7e1d413f84d0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:15.182910 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-4449fccc-0593-4f44-9fdb-7e1d413f84d0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:15.185742 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-4449fccc-0593-4f44-9fdb-7e1d413f84d0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:15.187508 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4449fccc-0593-4f44-9fdb-7e1d413f84d0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.162065 Jul 23 21:35:15.188182 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2489/5062] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:35:15 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:35:16.211215 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-0b7ad513-9849-4939-8ed8-d7236edc775f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:35:16.212432 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-0b7ad513-9849-4939-8ed8-d7236edc775f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:35:16.237513 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0b7ad513-9849-4939-8ed8-d7236edc775f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:35:16.238729 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0b7ad513-9849-4939-8ed8-d7236edc775f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:35:16.241414 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0b7ad513-9849-4939-8ed8-d7236edc775f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:35:16.241951 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-0b7ad513-9849-4939-8ed8-d7236edc775f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:35:16.493495 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-0b7ad513-9849-4939-8ed8-d7236edc775f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:16.506473 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-0b7ad513-9849-4939-8ed8-d7236edc775f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:16.508999 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-0b7ad513-9849-4939-8ed8-d7236edc775f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:16.510970 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-0b7ad513-9849-4939-8ed8-d7236edc775f tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.303572 Jul 23 21:35:16.522296 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2574/5063] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:35:16 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:35:17.533740 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1dd896de-3406-4c22-b895-d970764306db tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:35:17.535636 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1dd896de-3406-4c22-b895-d970764306db tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:35:17.543572 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1dd896de-3406-4c22-b895-d970764306db tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:35:17.544129 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1dd896de-3406-4c22-b895-d970764306db tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:35:17.545043 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1dd896de-3406-4c22-b895-d970764306db tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:35:17.545611 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1dd896de-3406-4c22-b895-d970764306db tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:35:17.575571 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=78 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:17.681435 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-1dd896de-3406-4c22-b895-d970764306db tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:17.711506 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-1dd896de-3406-4c22-b895-d970764306db tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:17.714698 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-1dd896de-3406-4c22-b895-d970764306db tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:17.717396 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1dd896de-3406-4c22-b895-d970764306db tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.191526 Jul 23 21:35:17.718469 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2490/5064] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:35:17 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:35:18.737694 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-cf914803-7553-4124-a33a-3a4072a7c1f7 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:35:18.738422 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-cf914803-7553-4124-a33a-3a4072a7c1f7 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:35:18.748299 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_api:SELECT=26 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:18.749985 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cf914803-7553-4124-a33a-3a4072a7c1f7 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:35:18.750448 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cf914803-7553-4124-a33a-3a4072a7c1f7 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:35:18.751407 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cf914803-7553-4124-a33a-3a4072a7c1f7 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:35:18.751853 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-cf914803-7553-4124-a33a-3a4072a7c1f7 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:35:18.921134 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-cf914803-7553-4124-a33a-3a4072a7c1f7 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:18.940755 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-cf914803-7553-4124-a33a-3a4072a7c1f7 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:18.942317 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-cf914803-7553-4124-a33a-3a4072a7c1f7 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:18.961439 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-cf914803-7553-4124-a33a-3a4072a7c1f7 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.227445 Jul 23 21:35:18.981488 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2575/5065] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:35:18 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:35:19.986573 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4f0a9cae-0b19-4dd2-b4ff-f5238c1041b5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:35:19.987182 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-4f0a9cae-0b19-4dd2-b4ff-f5238c1041b5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:35:19.997914 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4f0a9cae-0b19-4dd2-b4ff-f5238c1041b5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:35:20.002246 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4f0a9cae-0b19-4dd2-b4ff-f5238c1041b5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:35:20.003168 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4f0a9cae-0b19-4dd2-b4ff-f5238c1041b5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:35:20.004484 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4f0a9cae-0b19-4dd2-b4ff-f5238c1041b5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:35:20.171095 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-4f0a9cae-0b19-4dd2-b4ff-f5238c1041b5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:20.184451 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-4f0a9cae-0b19-4dd2-b4ff-f5238c1041b5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:20.185988 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-4f0a9cae-0b19-4dd2-b4ff-f5238c1041b5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:20.199040 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4f0a9cae-0b19-4dd2-b4ff-f5238c1041b5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.204687 Jul 23 21:35:20.214920 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2491/5066] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:35:19 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:35:21.218124 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-261b04d5-730f-4041-b312-d9a27753ddfa tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:35:21.218734 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-261b04d5-730f-4041-b312-d9a27753ddfa tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:35:21.231738 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-261b04d5-730f-4041-b312-d9a27753ddfa tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:35:21.232195 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-261b04d5-730f-4041-b312-d9a27753ddfa tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:35:21.232990 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-261b04d5-730f-4041-b312-d9a27753ddfa tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:35:21.236781 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-261b04d5-730f-4041-b312-d9a27753ddfa tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:35:21.410904 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-261b04d5-730f-4041-b312-d9a27753ddfa tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:21.422469 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-261b04d5-730f-4041-b312-d9a27753ddfa tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:21.424452 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-261b04d5-730f-4041-b312-d9a27753ddfa tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:21.426142 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-261b04d5-730f-4041-b312-d9a27753ddfa tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.212145 Jul 23 21:35:21.427075 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2576/5067] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:35:21 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:35:22.444754 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a11c86c4-e75f-48f4-bbfb-62dc81e9f6cb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:35:22.445369 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a11c86c4-e75f-48f4-bbfb-62dc81e9f6cb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:35:22.448216 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=24 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:22.461275 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a11c86c4-e75f-48f4-bbfb-62dc81e9f6cb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:35:22.462234 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a11c86c4-e75f-48f4-bbfb-62dc81e9f6cb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:35:22.463448 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a11c86c4-e75f-48f4-bbfb-62dc81e9f6cb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:35:22.464111 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a11c86c4-e75f-48f4-bbfb-62dc81e9f6cb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:35:22.699341 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a11c86c4-e75f-48f4-bbfb-62dc81e9f6cb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:22.726110 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a11c86c4-e75f-48f4-bbfb-62dc81e9f6cb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:22.731274 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a11c86c4-e75f-48f4-bbfb-62dc81e9f6cb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:22.732825 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a11c86c4-e75f-48f4-bbfb-62dc81e9f6cb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.292060 Jul 23 21:35:22.746918 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2492/5068] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:35:22 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:35:23.754758 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-114b87bb-d445-46a9-815e-7fcd50525de4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:35:23.756170 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-114b87bb-d445-46a9-815e-7fcd50525de4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:35:23.768640 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-114b87bb-d445-46a9-815e-7fcd50525de4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:35:23.772323 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-114b87bb-d445-46a9-815e-7fcd50525de4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:35:23.773144 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-114b87bb-d445-46a9-815e-7fcd50525de4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:35:23.773572 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-114b87bb-d445-46a9-815e-7fcd50525de4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:35:24.060881 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-114b87bb-d445-46a9-815e-7fcd50525de4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:24.088236 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-114b87bb-d445-46a9-815e-7fcd50525de4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:24.089791 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-114b87bb-d445-46a9-815e-7fcd50525de4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:24.091581 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-114b87bb-d445-46a9-815e-7fcd50525de4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.341674 Jul 23 21:35:24.108756 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2577/5069] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:35:23 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:35:25.124487 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8aa6a716-864b-44c1-be9d-e53397c54128 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:35:25.125282 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8aa6a716-864b-44c1-be9d-e53397c54128 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:35:25.140853 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8aa6a716-864b-44c1-be9d-e53397c54128 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:35:25.143290 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8aa6a716-864b-44c1-be9d-e53397c54128 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:35:25.144344 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8aa6a716-864b-44c1-be9d-e53397c54128 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:35:25.147915 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8aa6a716-864b-44c1-be9d-e53397c54128 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:35:25.368107 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8aa6a716-864b-44c1-be9d-e53397c54128 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:25.382471 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8aa6a716-864b-44c1-be9d-e53397c54128 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:25.385533 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8aa6a716-864b-44c1-be9d-e53397c54128 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:25.392993 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8aa6a716-864b-44c1-be9d-e53397c54128 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.280442 Jul 23 21:35:25.396693 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2493/5070] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:35:25 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:35:26.414670 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-697de14a-6271-497d-afd8-10b005b717b0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:35:26.415197 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-697de14a-6271-497d-afd8-10b005b717b0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:35:26.427456 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-697de14a-6271-497d-afd8-10b005b717b0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:35:26.427912 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-697de14a-6271-497d-afd8-10b005b717b0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:35:26.428701 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-697de14a-6271-497d-afd8-10b005b717b0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:35:26.429141 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-697de14a-6271-497d-afd8-10b005b717b0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:35:26.639492 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-697de14a-6271-497d-afd8-10b005b717b0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:26.649813 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-697de14a-6271-497d-afd8-10b005b717b0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:26.652679 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-697de14a-6271-497d-afd8-10b005b717b0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:26.660361 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-697de14a-6271-497d-afd8-10b005b717b0 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.249581 Jul 23 21:35:26.662861 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2578/5071] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:35:26 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:35:27.681149 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b44e8df1-4e0b-4765-a6d4-2831370f2b92 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:35:27.681762 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b44e8df1-4e0b-4765-a6d4-2831370f2b92 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:35:27.698977 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b44e8df1-4e0b-4765-a6d4-2831370f2b92 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:35:27.699706 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b44e8df1-4e0b-4765-a6d4-2831370f2b92 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:35:27.700634 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b44e8df1-4e0b-4765-a6d4-2831370f2b92 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:35:27.701162 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b44e8df1-4e0b-4765-a6d4-2831370f2b92 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:35:27.797009 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b44e8df1-4e0b-4765-a6d4-2831370f2b92 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:27.807644 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b44e8df1-4e0b-4765-a6d4-2831370f2b92 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:27.809643 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b44e8df1-4e0b-4765-a6d4-2831370f2b92 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:27.830702 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b44e8df1-4e0b-4765-a6d4-2831370f2b92 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.153322 Jul 23 21:35:27.834995 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2494/5072] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:35:27 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:35:28.853230 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-fb9b691c-6d76-4fa7-9b2f-3548c8bbb756 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:35:28.853832 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-fb9b691c-6d76-4fa7-9b2f-3548c8bbb756 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:35:28.861194 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fb9b691c-6d76-4fa7-9b2f-3548c8bbb756 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:35:28.861803 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fb9b691c-6d76-4fa7-9b2f-3548c8bbb756 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:35:28.862762 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fb9b691c-6d76-4fa7-9b2f-3548c8bbb756 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:35:28.863202 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fb9b691c-6d76-4fa7-9b2f-3548c8bbb756 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:35:28.886490 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=72 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:28.984658 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-fb9b691c-6d76-4fa7-9b2f-3548c8bbb756 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:28.995513 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-fb9b691c-6d76-4fa7-9b2f-3548c8bbb756 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:28.996926 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-fb9b691c-6d76-4fa7-9b2f-3548c8bbb756 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:28.998434 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-fb9b691c-6d76-4fa7-9b2f-3548c8bbb756 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.149169 Jul 23 21:35:29.001907 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2579/5073] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:35:28 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:35:30.027750 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f340c661-d1dd-4689-a941-77d2af49ed68 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:35:30.029511 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f340c661-d1dd-4689-a941-77d2af49ed68 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:35:30.056583 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f340c661-d1dd-4689-a941-77d2af49ed68 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:35:30.059124 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f340c661-d1dd-4689-a941-77d2af49ed68 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:35:30.062573 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f340c661-d1dd-4689-a941-77d2af49ed68 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:35:30.066212 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f340c661-d1dd-4689-a941-77d2af49ed68 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:35:30.193238 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f340c661-d1dd-4689-a941-77d2af49ed68 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:30.205279 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f340c661-d1dd-4689-a941-77d2af49ed68 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:30.207268 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f340c661-d1dd-4689-a941-77d2af49ed68 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:30.208436 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f340c661-d1dd-4689-a941-77d2af49ed68 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.193503 Jul 23 21:35:30.209294 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2495/5074] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:35:30 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:35:31.228639 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-467dc635-f1cc-457a-93b2-fbd13484a933 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:35:31.229877 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-467dc635-f1cc-457a-93b2-fbd13484a933 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:35:31.242983 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-467dc635-f1cc-457a-93b2-fbd13484a933 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:35:31.244224 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-467dc635-f1cc-457a-93b2-fbd13484a933 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:35:31.246810 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-467dc635-f1cc-457a-93b2-fbd13484a933 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:35:31.247597 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-467dc635-f1cc-457a-93b2-fbd13484a933 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:35:31.420266 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-467dc635-f1cc-457a-93b2-fbd13484a933 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:31.439867 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-467dc635-f1cc-457a-93b2-fbd13484a933 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:31.441415 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-467dc635-f1cc-457a-93b2-fbd13484a933 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:31.442687 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-467dc635-f1cc-457a-93b2-fbd13484a933 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.218099 Jul 23 21:35:31.448028 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2580/5075] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:35:31 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:35:32.461084 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-14990ab6-4412-40de-bfff-769dea252580 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:35:32.462306 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-14990ab6-4412-40de-bfff-769dea252580 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:35:32.474897 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-14990ab6-4412-40de-bfff-769dea252580 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:35:32.482346 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-14990ab6-4412-40de-bfff-769dea252580 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:35:32.483466 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-14990ab6-4412-40de-bfff-769dea252580 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:35:32.484082 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-14990ab6-4412-40de-bfff-769dea252580 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:35:32.664258 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-14990ab6-4412-40de-bfff-769dea252580 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:32.698446 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-14990ab6-4412-40de-bfff-769dea252580 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:32.701476 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-14990ab6-4412-40de-bfff-769dea252580 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:32.703180 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-14990ab6-4412-40de-bfff-769dea252580 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.246371 Jul 23 21:35:32.704860 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2496/5076] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:35:32 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:35:33.724321 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d34e368a-1116-4eea-b818-36d77abf359e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:35:33.724952 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-d34e368a-1116-4eea-b818-36d77abf359e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:35:33.739345 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d34e368a-1116-4eea-b818-36d77abf359e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:35:33.744772 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d34e368a-1116-4eea-b818-36d77abf359e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:35:33.746328 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d34e368a-1116-4eea-b818-36d77abf359e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:35:33.746946 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d34e368a-1116-4eea-b818-36d77abf359e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:35:34.068507 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-d34e368a-1116-4eea-b818-36d77abf359e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:34.088212 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-d34e368a-1116-4eea-b818-36d77abf359e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:34.094134 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-d34e368a-1116-4eea-b818-36d77abf359e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:34.100213 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-d34e368a-1116-4eea-b818-36d77abf359e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.377667 Jul 23 21:35:34.102215 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2581/5077] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:35:33 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:35:35.121209 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f9924941-b80d-4cd5-a926-f9eff54e1d89 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:35:35.122490 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f9924941-b80d-4cd5-a926-f9eff54e1d89 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:35:35.147668 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f9924941-b80d-4cd5-a926-f9eff54e1d89 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:35:35.148357 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f9924941-b80d-4cd5-a926-f9eff54e1d89 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:35:35.149430 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f9924941-b80d-4cd5-a926-f9eff54e1d89 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:35:35.150265 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f9924941-b80d-4cd5-a926-f9eff54e1d89 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:35:35.296427 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f9924941-b80d-4cd5-a926-f9eff54e1d89 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:35.312802 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f9924941-b80d-4cd5-a926-f9eff54e1d89 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:35.315898 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f9924941-b80d-4cd5-a926-f9eff54e1d89 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:35.317404 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f9924941-b80d-4cd5-a926-f9eff54e1d89 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.201636 Jul 23 21:35:35.321458 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2497/5078] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:35:35 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:35:36.345355 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-8b59094e-de56-4f66-a486-0d3251e8b0b4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:35:36.348167 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-8b59094e-de56-4f66-a486-0d3251e8b0b4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:35:36.373546 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8b59094e-de56-4f66-a486-0d3251e8b0b4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:35:36.374402 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8b59094e-de56-4f66-a486-0d3251e8b0b4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:35:36.375447 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8b59094e-de56-4f66-a486-0d3251e8b0b4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:35:36.378036 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-8b59094e-de56-4f66-a486-0d3251e8b0b4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:35:36.828731 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-8b59094e-de56-4f66-a486-0d3251e8b0b4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:36.839899 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-8b59094e-de56-4f66-a486-0d3251e8b0b4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:36.841831 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-8b59094e-de56-4f66-a486-0d3251e8b0b4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:36.843436 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-8b59094e-de56-4f66-a486-0d3251e8b0b4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.507573 Jul 23 21:35:36.857565 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2582/5079] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:35:36 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:35:37.865205 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e9e94788-b902-4ce4-9578-9a0082960d60 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:35:37.865974 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e9e94788-b902-4ce4-9578-9a0082960d60 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:35:37.873217 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e9e94788-b902-4ce4-9578-9a0082960d60 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:35:37.873747 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e9e94788-b902-4ce4-9578-9a0082960d60 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:35:37.874642 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e9e94788-b902-4ce4-9578-9a0082960d60 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:35:37.875161 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e9e94788-b902-4ce4-9578-9a0082960d60 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:35:38.100977 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e9e94788-b902-4ce4-9578-9a0082960d60 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:38.110975 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e9e94788-b902-4ce4-9578-9a0082960d60 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:38.112588 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e9e94788-b902-4ce4-9578-9a0082960d60 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:38.114095 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e9e94788-b902-4ce4-9578-9a0082960d60 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.253006 Jul 23 21:35:38.115483 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2498/5080] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:35:37 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:35:39.137984 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-5aba23e7-c0b3-4d9a-911a-dcc296b7972c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:35:39.141092 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-5aba23e7-c0b3-4d9a-911a-dcc296b7972c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:35:39.157306 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5aba23e7-c0b3-4d9a-911a-dcc296b7972c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:35:39.157778 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5aba23e7-c0b3-4d9a-911a-dcc296b7972c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:35:39.160780 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5aba23e7-c0b3-4d9a-911a-dcc296b7972c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:35:39.161470 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-5aba23e7-c0b3-4d9a-911a-dcc296b7972c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:35:39.411879 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-5aba23e7-c0b3-4d9a-911a-dcc296b7972c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:39.429642 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-5aba23e7-c0b3-4d9a-911a-dcc296b7972c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:39.436946 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-5aba23e7-c0b3-4d9a-911a-dcc296b7972c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:39.438445 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-5aba23e7-c0b3-4d9a-911a-dcc296b7972c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.308020 Jul 23 21:35:39.443529 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2583/5081] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:35:39 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:35:40.466851 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f0bc71f9-6a51-4582-a4b0-aee577e5f085 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:35:40.468636 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f0bc71f9-6a51-4582-a4b0-aee577e5f085 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:35:40.482395 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f0bc71f9-6a51-4582-a4b0-aee577e5f085 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:35:40.484488 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f0bc71f9-6a51-4582-a4b0-aee577e5f085 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:35:40.485601 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f0bc71f9-6a51-4582-a4b0-aee577e5f085 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:35:40.486314 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f0bc71f9-6a51-4582-a4b0-aee577e5f085 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:35:40.639377 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f0bc71f9-6a51-4582-a4b0-aee577e5f085 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:40.650579 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f0bc71f9-6a51-4582-a4b0-aee577e5f085 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:40.658254 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f0bc71f9-6a51-4582-a4b0-aee577e5f085 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:40.665143 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f0bc71f9-6a51-4582-a4b0-aee577e5f085 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.206369 Jul 23 21:35:40.665742 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2499/5082] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:35:40 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:35:41.683315 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-02079dce-46cf-486d-8d4f-64aa96c59164 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:35:41.684589 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-02079dce-46cf-486d-8d4f-64aa96c59164 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:35:41.696184 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-02079dce-46cf-486d-8d4f-64aa96c59164 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:35:41.699723 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-02079dce-46cf-486d-8d4f-64aa96c59164 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:35:41.704226 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-02079dce-46cf-486d-8d4f-64aa96c59164 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:35:41.704963 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-02079dce-46cf-486d-8d4f-64aa96c59164 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:35:41.871747 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-02079dce-46cf-486d-8d4f-64aa96c59164 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:41.882561 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-02079dce-46cf-486d-8d4f-64aa96c59164 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:41.886130 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-02079dce-46cf-486d-8d4f-64aa96c59164 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:41.888817 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-02079dce-46cf-486d-8d4f-64aa96c59164 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.208366 Jul 23 21:35:41.901342 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2584/5083] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:35:41 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:35:42.925019 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-bfb6d0fd-703d-4a8b-b191-054daef13202 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:35:42.927255 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-bfb6d0fd-703d-4a8b-b191-054daef13202 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:35:42.940895 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bfb6d0fd-703d-4a8b-b191-054daef13202 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:35:42.941993 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bfb6d0fd-703d-4a8b-b191-054daef13202 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:35:42.945126 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bfb6d0fd-703d-4a8b-b191-054daef13202 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:35:42.945559 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bfb6d0fd-703d-4a8b-b191-054daef13202 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:35:43.055150 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-bfb6d0fd-703d-4a8b-b191-054daef13202 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:43.070468 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-bfb6d0fd-703d-4a8b-b191-054daef13202 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:43.072268 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-bfb6d0fd-703d-4a8b-b191-054daef13202 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:43.077960 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-bfb6d0fd-703d-4a8b-b191-054daef13202 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.171628 Jul 23 21:35:43.084230 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2500/5084] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:35:42 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:35:44.097652 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-3bcd3e74-246c-4560-9f96-c89846a8edfb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:35:44.098460 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-3bcd3e74-246c-4560-9f96-c89846a8edfb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:35:44.111403 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3bcd3e74-246c-4560-9f96-c89846a8edfb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:35:44.116629 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3bcd3e74-246c-4560-9f96-c89846a8edfb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:35:44.119080 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3bcd3e74-246c-4560-9f96-c89846a8edfb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:35:44.119681 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3bcd3e74-246c-4560-9f96-c89846a8edfb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:35:44.500737 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-3bcd3e74-246c-4560-9f96-c89846a8edfb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:44.514256 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-3bcd3e74-246c-4560-9f96-c89846a8edfb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:44.516244 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-3bcd3e74-246c-4560-9f96-c89846a8edfb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:44.518447 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-3bcd3e74-246c-4560-9f96-c89846a8edfb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.425159 Jul 23 21:35:44.519430 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2585/5085] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:35:44 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:35:45.539500 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-efa5c4d1-4e2a-45a1-ab64-6ec755f213c5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:35:45.540119 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-efa5c4d1-4e2a-45a1-ab64-6ec755f213c5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:35:45.547809 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-efa5c4d1-4e2a-45a1-ab64-6ec755f213c5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:35:45.548452 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-efa5c4d1-4e2a-45a1-ab64-6ec755f213c5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:35:45.549686 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-efa5c4d1-4e2a-45a1-ab64-6ec755f213c5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:35:45.550534 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-efa5c4d1-4e2a-45a1-ab64-6ec755f213c5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:35:45.735337 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-efa5c4d1-4e2a-45a1-ab64-6ec755f213c5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:45.753751 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-efa5c4d1-4e2a-45a1-ab64-6ec755f213c5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:45.756457 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-efa5c4d1-4e2a-45a1-ab64-6ec755f213c5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:45.760278 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-efa5c4d1-4e2a-45a1-ab64-6ec755f213c5 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.223468 Jul 23 21:35:45.762130 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2501/5086] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:35:45 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:35:46.787544 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-6629557c-49b6-4067-9c52-05d24f2476cb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:35:46.789267 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-6629557c-49b6-4067-9c52-05d24f2476cb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:35:46.806264 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6629557c-49b6-4067-9c52-05d24f2476cb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:35:46.806925 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6629557c-49b6-4067-9c52-05d24f2476cb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:35:46.808850 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6629557c-49b6-4067-9c52-05d24f2476cb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:35:46.809582 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-6629557c-49b6-4067-9c52-05d24f2476cb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:35:46.983652 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-6629557c-49b6-4067-9c52-05d24f2476cb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:46.993967 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-6629557c-49b6-4067-9c52-05d24f2476cb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:46.995603 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-6629557c-49b6-4067-9c52-05d24f2476cb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:47.004986 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-6629557c-49b6-4067-9c52-05d24f2476cb tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.228029 Jul 23 21:35:47.005930 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2586/5087] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:35:46 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:35:48.027579 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-fef57368-79d2-4bdd-88bc-54725b67c66d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:35:48.028493 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-fef57368-79d2-4bdd-88bc-54725b67c66d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:35:48.037729 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fef57368-79d2-4bdd-88bc-54725b67c66d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:35:48.038837 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fef57368-79d2-4bdd-88bc-54725b67c66d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:35:48.039710 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fef57368-79d2-4bdd-88bc-54725b67c66d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:35:48.040412 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fef57368-79d2-4bdd-88bc-54725b67c66d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:35:48.092052 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=72 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:48.290641 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-fef57368-79d2-4bdd-88bc-54725b67c66d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:48.308905 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-fef57368-79d2-4bdd-88bc-54725b67c66d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:48.310491 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-fef57368-79d2-4bdd-88bc-54725b67c66d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:48.311728 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-fef57368-79d2-4bdd-88bc-54725b67c66d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.290733 Jul 23 21:35:48.329018 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2502/5088] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:35:48 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:35:49.347681 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-71f314de-2bf0-4992-ba5e-37a32435ff1e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:35:49.348293 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-71f314de-2bf0-4992-ba5e-37a32435ff1e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:35:49.352614 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_api:SELECT=24 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:49.362143 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-71f314de-2bf0-4992-ba5e-37a32435ff1e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:35:49.366298 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-71f314de-2bf0-4992-ba5e-37a32435ff1e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:35:49.367117 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-71f314de-2bf0-4992-ba5e-37a32435ff1e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:35:49.367616 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-71f314de-2bf0-4992-ba5e-37a32435ff1e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:35:49.532426 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-71f314de-2bf0-4992-ba5e-37a32435ff1e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:49.573812 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-71f314de-2bf0-4992-ba5e-37a32435ff1e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:49.595558 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-71f314de-2bf0-4992-ba5e-37a32435ff1e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:49.597799 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-71f314de-2bf0-4992-ba5e-37a32435ff1e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.254519 Jul 23 21:35:49.598882 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2587/5089] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:35:49 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:35:50.626548 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1aa8053e-043e-47f9-bf47-7f341bf751e3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:35:50.627241 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1aa8053e-043e-47f9-bf47-7f341bf751e3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:35:50.635248 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1aa8053e-043e-47f9-bf47-7f341bf751e3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:35:50.635714 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1aa8053e-043e-47f9-bf47-7f341bf751e3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:35:50.636588 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1aa8053e-043e-47f9-bf47-7f341bf751e3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:35:50.637040 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1aa8053e-043e-47f9-bf47-7f341bf751e3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:35:50.851982 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-1aa8053e-043e-47f9-bf47-7f341bf751e3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:50.866834 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-1aa8053e-043e-47f9-bf47-7f341bf751e3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:50.868739 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-1aa8053e-043e-47f9-bf47-7f341bf751e3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:50.870848 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1aa8053e-043e-47f9-bf47-7f341bf751e3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.257146 Jul 23 21:35:50.872156 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2503/5090] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:35:50 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:35:51.890513 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a0915c83-6f04-4f6f-b52e-8e79905d348a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:35:51.891196 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-a0915c83-6f04-4f6f-b52e-8e79905d348a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:35:51.907452 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a0915c83-6f04-4f6f-b52e-8e79905d348a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:35:51.908701 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a0915c83-6f04-4f6f-b52e-8e79905d348a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:35:51.916201 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a0915c83-6f04-4f6f-b52e-8e79905d348a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:35:51.917058 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a0915c83-6f04-4f6f-b52e-8e79905d348a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:35:52.064962 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-a0915c83-6f04-4f6f-b52e-8e79905d348a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:52.082990 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-a0915c83-6f04-4f6f-b52e-8e79905d348a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:52.086072 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-a0915c83-6f04-4f6f-b52e-8e79905d348a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:52.087556 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-a0915c83-6f04-4f6f-b52e-8e79905d348a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.201150 Jul 23 21:35:52.104094 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2588/5091] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:35:51 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:35:53.114158 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2060f81d-29d4-4cda-83ae-386009c5d3af tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:35:53.114562 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-2060f81d-29d4-4cda-83ae-386009c5d3af tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:35:53.120974 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=24 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:53.124917 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2060f81d-29d4-4cda-83ae-386009c5d3af tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:35:53.125402 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2060f81d-29d4-4cda-83ae-386009c5d3af tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:35:53.126279 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2060f81d-29d4-4cda-83ae-386009c5d3af tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:35:53.127038 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2060f81d-29d4-4cda-83ae-386009c5d3af tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:35:53.271816 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-2060f81d-29d4-4cda-83ae-386009c5d3af tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:53.293028 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-2060f81d-29d4-4cda-83ae-386009c5d3af tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:53.297749 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-2060f81d-29d4-4cda-83ae-386009c5d3af tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:53.299300 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2060f81d-29d4-4cda-83ae-386009c5d3af tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.191404 Jul 23 21:35:53.303130 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2504/5092] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:35:53 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:35:54.328470 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-bf787667-120c-40c7-b3ee-56d2b92e32ef tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:35:54.330369 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-bf787667-120c-40c7-b3ee-56d2b92e32ef tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:35:54.339556 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bf787667-120c-40c7-b3ee-56d2b92e32ef tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:35:54.340583 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bf787667-120c-40c7-b3ee-56d2b92e32ef tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:35:54.342183 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bf787667-120c-40c7-b3ee-56d2b92e32ef tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:35:54.342889 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bf787667-120c-40c7-b3ee-56d2b92e32ef tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:35:54.467371 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-bf787667-120c-40c7-b3ee-56d2b92e32ef tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:54.480130 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-bf787667-120c-40c7-b3ee-56d2b92e32ef tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:54.481679 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-bf787667-120c-40c7-b3ee-56d2b92e32ef tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:54.483912 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-bf787667-120c-40c7-b3ee-56d2b92e32ef tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.169146 Jul 23 21:35:54.485028 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2589/5093] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:35:54 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:35:55.503455 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e95f8596-a0e1-4d56-b44e-00d653475136 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:35:55.504779 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e95f8596-a0e1-4d56-b44e-00d653475136 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:35:55.511833 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e95f8596-a0e1-4d56-b44e-00d653475136 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:35:55.512629 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e95f8596-a0e1-4d56-b44e-00d653475136 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:35:55.513650 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e95f8596-a0e1-4d56-b44e-00d653475136 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:35:55.514360 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e95f8596-a0e1-4d56-b44e-00d653475136 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:35:55.692813 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e95f8596-a0e1-4d56-b44e-00d653475136 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:55.737774 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e95f8596-a0e1-4d56-b44e-00d653475136 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:55.741796 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e95f8596-a0e1-4d56-b44e-00d653475136 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:55.747908 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e95f8596-a0e1-4d56-b44e-00d653475136 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.247954 Jul 23 21:35:55.765156 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2505/5094] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:35:55 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:35:56.767739 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-fac383ff-4d4d-4c67-b14a-ed3a649a4906 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:35:56.768975 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-fac383ff-4d4d-4c67-b14a-ed3a649a4906 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:35:56.783817 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fac383ff-4d4d-4c67-b14a-ed3a649a4906 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:35:56.784579 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fac383ff-4d4d-4c67-b14a-ed3a649a4906 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:35:56.785560 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fac383ff-4d4d-4c67-b14a-ed3a649a4906 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:35:56.798780 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-fac383ff-4d4d-4c67-b14a-ed3a649a4906 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:35:56.933552 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-fac383ff-4d4d-4c67-b14a-ed3a649a4906 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:56.948773 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-fac383ff-4d4d-4c67-b14a-ed3a649a4906 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:56.950311 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-fac383ff-4d4d-4c67-b14a-ed3a649a4906 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:56.957564 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-fac383ff-4d4d-4c67-b14a-ed3a649a4906 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.193682 Jul 23 21:35:56.975195 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2590/5095] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:35:56 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:35:57.981040 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5f9ac435-29e7-4b78-abe0-7d1dbb0e1ec9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:35:57.981627 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5f9ac435-29e7-4b78-abe0-7d1dbb0e1ec9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:35:57.989247 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5f9ac435-29e7-4b78-abe0-7d1dbb0e1ec9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:35:57.990021 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5f9ac435-29e7-4b78-abe0-7d1dbb0e1ec9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:35:57.991149 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5f9ac435-29e7-4b78-abe0-7d1dbb0e1ec9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:35:57.991760 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5f9ac435-29e7-4b78-abe0-7d1dbb0e1ec9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:35:58.168462 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5f9ac435-29e7-4b78-abe0-7d1dbb0e1ec9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:58.179299 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5f9ac435-29e7-4b78-abe0-7d1dbb0e1ec9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:58.181092 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5f9ac435-29e7-4b78-abe0-7d1dbb0e1ec9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:58.183100 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5f9ac435-29e7-4b78-abe0-7d1dbb0e1ec9 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.206100 Jul 23 21:35:58.184170 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2506/5096] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:35:57 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:35:59.204006 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-bedc8b17-67e4-4f5e-9be0-cada208223f2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:35:59.205348 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-bedc8b17-67e4-4f5e-9be0-cada208223f2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:35:59.214030 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bedc8b17-67e4-4f5e-9be0-cada208223f2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:35:59.214761 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bedc8b17-67e4-4f5e-9be0-cada208223f2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:35:59.215760 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bedc8b17-67e4-4f5e-9be0-cada208223f2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:35:59.216381 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bedc8b17-67e4-4f5e-9be0-cada208223f2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:35:59.219700 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=72 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:35:59.309773 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-bedc8b17-67e4-4f5e-9be0-cada208223f2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:59.321734 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-bedc8b17-67e4-4f5e-9be0-cada208223f2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:59.323635 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-bedc8b17-67e4-4f5e-9be0-cada208223f2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:35:59.325017 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-bedc8b17-67e4-4f5e-9be0-cada208223f2 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.126085 Jul 23 21:35:59.325931 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2591/5097] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:35:59 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:36:00.348547 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-026ca18f-1905-4474-968d-541cec149b89 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:36:00.349980 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-026ca18f-1905-4474-968d-541cec149b89 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:36:00.359620 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-026ca18f-1905-4474-968d-541cec149b89 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:36:00.362125 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-026ca18f-1905-4474-968d-541cec149b89 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:36:00.363282 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-026ca18f-1905-4474-968d-541cec149b89 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:36:00.363977 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-026ca18f-1905-4474-968d-541cec149b89 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:36:00.703702 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-026ca18f-1905-4474-968d-541cec149b89 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:00.739047 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-026ca18f-1905-4474-968d-541cec149b89 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:00.740612 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-026ca18f-1905-4474-968d-541cec149b89 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:00.742238 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-026ca18f-1905-4474-968d-541cec149b89 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.401486 Jul 23 21:36:00.742847 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2507/5098] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:36:00 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:36:01.761413 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d0bb26fa-2dce-4e72-938b-78e54e1c590d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:36:01.762117 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-d0bb26fa-2dce-4e72-938b-78e54e1c590d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:36:01.771194 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d0bb26fa-2dce-4e72-938b-78e54e1c590d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:36:01.771820 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d0bb26fa-2dce-4e72-938b-78e54e1c590d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:36:01.772850 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d0bb26fa-2dce-4e72-938b-78e54e1c590d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:36:01.773648 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d0bb26fa-2dce-4e72-938b-78e54e1c590d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:36:01.947168 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-d0bb26fa-2dce-4e72-938b-78e54e1c590d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:01.957888 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-d0bb26fa-2dce-4e72-938b-78e54e1c590d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:01.959757 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-d0bb26fa-2dce-4e72-938b-78e54e1c590d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:01.961174 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-d0bb26fa-2dce-4e72-938b-78e54e1c590d tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.204412 Jul 23 21:36:01.962111 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2592/5099] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:36:01 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:36:02.980882 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-dbd98bcc-a9f4-4d6b-9cc4-075e56e40cc3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:36:02.981441 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-dbd98bcc-a9f4-4d6b-9cc4-075e56e40cc3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:36:02.993359 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dbd98bcc-a9f4-4d6b-9cc4-075e56e40cc3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:36:03.001254 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dbd98bcc-a9f4-4d6b-9cc4-075e56e40cc3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:36:03.002586 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dbd98bcc-a9f4-4d6b-9cc4-075e56e40cc3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:36:03.003048 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dbd98bcc-a9f4-4d6b-9cc4-075e56e40cc3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:36:03.142298 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-dbd98bcc-a9f4-4d6b-9cc4-075e56e40cc3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:03.203693 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-dbd98bcc-a9f4-4d6b-9cc4-075e56e40cc3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:03.206793 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-dbd98bcc-a9f4-4d6b-9cc4-075e56e40cc3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:03.209227 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-dbd98bcc-a9f4-4d6b-9cc4-075e56e40cc3 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.232129 Jul 23 21:36:03.210348 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2508/5100] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:36:02 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:36:04.231464 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-1af897e0-dbc9-43a7-841a-f8e09fc37781 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:36:04.232630 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-1af897e0-dbc9-43a7-841a-f8e09fc37781 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:36:04.242087 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1af897e0-dbc9-43a7-841a-f8e09fc37781 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:36:04.242672 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1af897e0-dbc9-43a7-841a-f8e09fc37781 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:36:04.243743 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1af897e0-dbc9-43a7-841a-f8e09fc37781 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:36:04.244902 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1af897e0-dbc9-43a7-841a-f8e09fc37781 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:36:04.376322 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-1af897e0-dbc9-43a7-841a-f8e09fc37781 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:04.388475 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-1af897e0-dbc9-43a7-841a-f8e09fc37781 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:04.390694 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-1af897e0-dbc9-43a7-841a-f8e09fc37781 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:04.392628 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-1af897e0-dbc9-43a7-841a-f8e09fc37781 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.168338 Jul 23 21:36:04.393780 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2593/5101] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:36:04 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:36:05.411935 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-67977840-e025-4f2b-822e-9462a63c049c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:36:05.412509 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-67977840-e025-4f2b-822e-9462a63c049c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:36:05.421631 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-67977840-e025-4f2b-822e-9462a63c049c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:36:05.422118 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-67977840-e025-4f2b-822e-9462a63c049c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:36:05.422913 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-67977840-e025-4f2b-822e-9462a63c049c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:36:05.423429 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-67977840-e025-4f2b-822e-9462a63c049c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:36:05.567378 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-67977840-e025-4f2b-822e-9462a63c049c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:05.604112 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-67977840-e025-4f2b-822e-9462a63c049c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:05.608352 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-67977840-e025-4f2b-822e-9462a63c049c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:05.613626 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-67977840-e025-4f2b-822e-9462a63c049c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.206537 Jul 23 21:36:05.620632 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2509/5102] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:36:05 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:36:06.647043 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-7ea238a3-7643-4ccd-bf6a-d0c16ee7c567 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:36:06.647701 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-7ea238a3-7643-4ccd-bf6a-d0c16ee7c567 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:36:06.665839 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7ea238a3-7643-4ccd-bf6a-d0c16ee7c567 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:36:06.666331 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7ea238a3-7643-4ccd-bf6a-d0c16ee7c567 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:36:06.667130 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7ea238a3-7643-4ccd-bf6a-d0c16ee7c567 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:36:06.667577 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-7ea238a3-7643-4ccd-bf6a-d0c16ee7c567 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:36:06.936041 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-7ea238a3-7643-4ccd-bf6a-d0c16ee7c567 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:06.949273 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-7ea238a3-7643-4ccd-bf6a-d0c16ee7c567 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:06.952569 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-7ea238a3-7643-4ccd-bf6a-d0c16ee7c567 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:06.958218 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-7ea238a3-7643-4ccd-bf6a-d0c16ee7c567 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.328729 Jul 23 21:36:06.960855 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2594/5103] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:36:06 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:36:07.983814 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6b7d8153-8848-4402-b54e-fa0139edfc4e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:36:07.985048 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6b7d8153-8848-4402-b54e-fa0139edfc4e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:36:07.994129 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6b7d8153-8848-4402-b54e-fa0139edfc4e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:36:07.995142 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6b7d8153-8848-4402-b54e-fa0139edfc4e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:36:07.996075 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6b7d8153-8848-4402-b54e-fa0139edfc4e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:36:07.996703 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6b7d8153-8848-4402-b54e-fa0139edfc4e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:36:08.133087 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6b7d8153-8848-4402-b54e-fa0139edfc4e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:08.143592 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6b7d8153-8848-4402-b54e-fa0139edfc4e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:08.145413 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6b7d8153-8848-4402-b54e-fa0139edfc4e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:08.146824 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6b7d8153-8848-4402-b54e-fa0139edfc4e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.168291 Jul 23 21:36:08.147869 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2510/5104] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:36:07 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:36:09.169248 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-ae9a7705-6e9c-449f-af87-103aa2301660 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:36:09.170138 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-ae9a7705-6e9c-449f-af87-103aa2301660 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:36:09.189626 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ae9a7705-6e9c-449f-af87-103aa2301660 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:36:09.190790 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ae9a7705-6e9c-449f-af87-103aa2301660 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:36:09.192119 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ae9a7705-6e9c-449f-af87-103aa2301660 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:36:09.195136 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-ae9a7705-6e9c-449f-af87-103aa2301660 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:36:09.397693 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ae9a7705-6e9c-449f-af87-103aa2301660 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:09.417075 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ae9a7705-6e9c-449f-af87-103aa2301660 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:09.419539 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-ae9a7705-6e9c-449f-af87-103aa2301660 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:09.420962 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-ae9a7705-6e9c-449f-af87-103aa2301660 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.258825 Jul 23 21:36:09.421622 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2595/5105] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:36:09 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:36:10.441243 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ee668115-8d6b-48dc-a98c-95c20c979071 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:36:10.441874 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ee668115-8d6b-48dc-a98c-95c20c979071 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:36:10.456888 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ee668115-8d6b-48dc-a98c-95c20c979071 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:36:10.457833 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ee668115-8d6b-48dc-a98c-95c20c979071 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:36:10.459564 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ee668115-8d6b-48dc-a98c-95c20c979071 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:36:10.460303 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ee668115-8d6b-48dc-a98c-95c20c979071 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:36:10.683565 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ee668115-8d6b-48dc-a98c-95c20c979071 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:10.702396 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ee668115-8d6b-48dc-a98c-95c20c979071 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:10.710208 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ee668115-8d6b-48dc-a98c-95c20c979071 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:10.711683 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ee668115-8d6b-48dc-a98c-95c20c979071 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.275656 Jul 23 21:36:10.717915 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2511/5106] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:36:10 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:36:11.733534 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c3fb87ec-34f5-4094-a77d-819686f59e29 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:36:11.734811 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-c3fb87ec-34f5-4094-a77d-819686f59e29 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:36:11.744857 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c3fb87ec-34f5-4094-a77d-819686f59e29 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:36:11.745693 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c3fb87ec-34f5-4094-a77d-819686f59e29 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:36:11.747086 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c3fb87ec-34f5-4094-a77d-819686f59e29 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:36:11.747762 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c3fb87ec-34f5-4094-a77d-819686f59e29 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:36:11.878072 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c3fb87ec-34f5-4094-a77d-819686f59e29 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:11.898339 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c3fb87ec-34f5-4094-a77d-819686f59e29 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:11.900788 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c3fb87ec-34f5-4094-a77d-819686f59e29 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:11.902492 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-c3fb87ec-34f5-4094-a77d-819686f59e29 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.173521 Jul 23 21:36:11.903534 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2596/5107] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:36:11 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:36:12.923922 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-7afc4cb8-b8bf-44ed-8a74-20536e78356e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:36:12.926460 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-7afc4cb8-b8bf-44ed-8a74-20536e78356e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:36:12.939198 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7afc4cb8-b8bf-44ed-8a74-20536e78356e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:36:12.940157 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7afc4cb8-b8bf-44ed-8a74-20536e78356e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:36:12.941073 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7afc4cb8-b8bf-44ed-8a74-20536e78356e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:36:12.941573 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7afc4cb8-b8bf-44ed-8a74-20536e78356e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:36:13.132285 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-7afc4cb8-b8bf-44ed-8a74-20536e78356e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:13.149193 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-7afc4cb8-b8bf-44ed-8a74-20536e78356e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:13.154223 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-7afc4cb8-b8bf-44ed-8a74-20536e78356e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:13.156662 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-7afc4cb8-b8bf-44ed-8a74-20536e78356e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.238437 Jul 23 21:36:13.157337 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2512/5108] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:36:12 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:36:14.176026 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-af8c74cf-7a87-4766-9fce-778af6eb5d8b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:36:14.182259 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-af8c74cf-7a87-4766-9fce-778af6eb5d8b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:36:14.206637 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-af8c74cf-7a87-4766-9fce-778af6eb5d8b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:36:14.207438 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-af8c74cf-7a87-4766-9fce-778af6eb5d8b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:36:14.208782 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-af8c74cf-7a87-4766-9fce-778af6eb5d8b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:36:14.209202 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-af8c74cf-7a87-4766-9fce-778af6eb5d8b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:36:14.308108 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-af8c74cf-7a87-4766-9fce-778af6eb5d8b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:14.319573 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-af8c74cf-7a87-4766-9fce-778af6eb5d8b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:14.323328 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-af8c74cf-7a87-4766-9fce-778af6eb5d8b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:14.324968 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-af8c74cf-7a87-4766-9fce-778af6eb5d8b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.153092 Jul 23 21:36:14.326291 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2597/5109] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:36:14 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:36:15.344787 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c3365805-ba71-4270-b09b-3ab6be11adfe tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:36:15.346480 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c3365805-ba71-4270-b09b-3ab6be11adfe tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:36:15.359250 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c3365805-ba71-4270-b09b-3ab6be11adfe tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:36:15.360933 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c3365805-ba71-4270-b09b-3ab6be11adfe tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:36:15.371739 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c3365805-ba71-4270-b09b-3ab6be11adfe tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:36:15.372475 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c3365805-ba71-4270-b09b-3ab6be11adfe tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:36:15.541495 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c3365805-ba71-4270-b09b-3ab6be11adfe tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:15.550692 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c3365805-ba71-4270-b09b-3ab6be11adfe tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:15.552264 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c3365805-ba71-4270-b09b-3ab6be11adfe tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:15.553493 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c3365805-ba71-4270-b09b-3ab6be11adfe tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.212895 Jul 23 21:36:15.564381 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2513/5110] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:36:15 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:36:16.576153 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-61457386-8190-45ea-b716-514aec3a33d6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:36:16.577822 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-61457386-8190-45ea-b716-514aec3a33d6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:36:16.591012 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-61457386-8190-45ea-b716-514aec3a33d6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:36:16.592350 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-61457386-8190-45ea-b716-514aec3a33d6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:36:16.595269 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-61457386-8190-45ea-b716-514aec3a33d6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:36:16.598290 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-61457386-8190-45ea-b716-514aec3a33d6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:36:16.748341 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-61457386-8190-45ea-b716-514aec3a33d6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:16.761504 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-61457386-8190-45ea-b716-514aec3a33d6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:16.763262 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-61457386-8190-45ea-b716-514aec3a33d6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:16.765579 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-61457386-8190-45ea-b716-514aec3a33d6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.196428 Jul 23 21:36:16.767168 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2598/5111] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:36:16 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:36:17.793924 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c8b5ba24-86ac-49d1-8e12-51d36391a966 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:36:17.795541 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c8b5ba24-86ac-49d1-8e12-51d36391a966 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:36:17.808091 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c8b5ba24-86ac-49d1-8e12-51d36391a966 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:36:17.808928 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c8b5ba24-86ac-49d1-8e12-51d36391a966 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:36:17.810295 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c8b5ba24-86ac-49d1-8e12-51d36391a966 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:36:17.811159 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c8b5ba24-86ac-49d1-8e12-51d36391a966 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:36:18.132454 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c8b5ba24-86ac-49d1-8e12-51d36391a966 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:18.140758 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=76 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:36:18.152480 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c8b5ba24-86ac-49d1-8e12-51d36391a966 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:18.154804 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c8b5ba24-86ac-49d1-8e12-51d36391a966 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:18.163001 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c8b5ba24-86ac-49d1-8e12-51d36391a966 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.379913 Jul 23 21:36:18.175027 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2514/5112] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:36:17 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:36:19.186058 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-56b882cb-2664-43ab-b095-1f59cbe69214 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:36:19.187402 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-56b882cb-2664-43ab-b095-1f59cbe69214 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:36:19.195344 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-56b882cb-2664-43ab-b095-1f59cbe69214 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:36:19.196299 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-56b882cb-2664-43ab-b095-1f59cbe69214 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:36:19.197390 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-56b882cb-2664-43ab-b095-1f59cbe69214 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:36:19.197919 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-56b882cb-2664-43ab-b095-1f59cbe69214 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:36:19.292597 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-56b882cb-2664-43ab-b095-1f59cbe69214 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:19.303428 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-56b882cb-2664-43ab-b095-1f59cbe69214 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:19.304944 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-56b882cb-2664-43ab-b095-1f59cbe69214 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:19.306415 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-56b882cb-2664-43ab-b095-1f59cbe69214 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.125509 Jul 23 21:36:19.307751 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2599/5113] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:36:19 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:36:20.326233 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e49c6cc4-0b74-4309-868e-168bb5a6b66c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:36:20.327397 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e49c6cc4-0b74-4309-868e-168bb5a6b66c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:36:20.334068 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e49c6cc4-0b74-4309-868e-168bb5a6b66c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:36:20.334697 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e49c6cc4-0b74-4309-868e-168bb5a6b66c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:36:20.335671 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e49c6cc4-0b74-4309-868e-168bb5a6b66c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:36:20.336466 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e49c6cc4-0b74-4309-868e-168bb5a6b66c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:36:20.487325 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e49c6cc4-0b74-4309-868e-168bb5a6b66c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:20.501297 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e49c6cc4-0b74-4309-868e-168bb5a6b66c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:20.502901 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e49c6cc4-0b74-4309-868e-168bb5a6b66c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:20.504674 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e49c6cc4-0b74-4309-868e-168bb5a6b66c tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.183955 Jul 23 21:36:20.506084 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2515/5114] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:36:20 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:36:21.524336 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-c36101ad-5a6b-4ca8-8813-c03e434c7f5b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:36:21.524965 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-c36101ad-5a6b-4ca8-8813-c03e434c7f5b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:36:21.531264 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_api:SELECT=26 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:36:21.533182 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c36101ad-5a6b-4ca8-8813-c03e434c7f5b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:36:21.533874 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c36101ad-5a6b-4ca8-8813-c03e434c7f5b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:36:21.534883 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c36101ad-5a6b-4ca8-8813-c03e434c7f5b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:36:21.535544 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-c36101ad-5a6b-4ca8-8813-c03e434c7f5b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:36:21.730407 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c36101ad-5a6b-4ca8-8813-c03e434c7f5b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:21.744637 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c36101ad-5a6b-4ca8-8813-c03e434c7f5b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:21.747112 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-c36101ad-5a6b-4ca8-8813-c03e434c7f5b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:21.752785 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-c36101ad-5a6b-4ca8-8813-c03e434c7f5b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.230392 Jul 23 21:36:21.752785 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2600/5115] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:36:21 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:36:22.774662 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d8f54089-a3d9-49aa-b41d-f2f1bfdcae22 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:36:22.775465 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d8f54089-a3d9-49aa-b41d-f2f1bfdcae22 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:36:22.785108 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d8f54089-a3d9-49aa-b41d-f2f1bfdcae22 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:36:22.786103 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d8f54089-a3d9-49aa-b41d-f2f1bfdcae22 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:36:22.787100 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d8f54089-a3d9-49aa-b41d-f2f1bfdcae22 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:36:22.787629 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d8f54089-a3d9-49aa-b41d-f2f1bfdcae22 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:36:23.129879 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d8f54089-a3d9-49aa-b41d-f2f1bfdcae22 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:23.154242 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d8f54089-a3d9-49aa-b41d-f2f1bfdcae22 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:23.159106 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d8f54089-a3d9-49aa-b41d-f2f1bfdcae22 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:23.160649 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d8f54089-a3d9-49aa-b41d-f2f1bfdcae22 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.390606 Jul 23 21:36:23.176357 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2516/5116] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:36:22 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:36:24.180651 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-1d71768f-895f-4e81-83d9-f8d2f8edeabc tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:36:24.181258 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-1d71768f-895f-4e81-83d9-f8d2f8edeabc tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:36:24.188642 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1d71768f-895f-4e81-83d9-f8d2f8edeabc tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:36:24.189371 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1d71768f-895f-4e81-83d9-f8d2f8edeabc tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:36:24.190367 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1d71768f-895f-4e81-83d9-f8d2f8edeabc tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:36:24.190986 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-1d71768f-895f-4e81-83d9-f8d2f8edeabc tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:36:24.680208 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-1d71768f-895f-4e81-83d9-f8d2f8edeabc tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:24.715797 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-1d71768f-895f-4e81-83d9-f8d2f8edeabc tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:24.720425 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-1d71768f-895f-4e81-83d9-f8d2f8edeabc tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:24.727086 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-1d71768f-895f-4e81-83d9-f8d2f8edeabc tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.547218 Jul 23 21:36:24.746730 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2601/5117] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:36:24 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:36:25.754493 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-df625915-fe0a-4b72-8b78-a7e18cb27916 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:36:25.755135 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-df625915-fe0a-4b72-8b78-a7e18cb27916 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:36:25.757898 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=26 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:36:25.782221 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-df625915-fe0a-4b72-8b78-a7e18cb27916 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:36:25.783673 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-df625915-fe0a-4b72-8b78-a7e18cb27916 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:36:25.785954 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-df625915-fe0a-4b72-8b78-a7e18cb27916 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:36:25.786410 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-df625915-fe0a-4b72-8b78-a7e18cb27916 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:36:26.067307 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-df625915-fe0a-4b72-8b78-a7e18cb27916 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:26.082830 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-df625915-fe0a-4b72-8b78-a7e18cb27916 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:26.097345 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-df625915-fe0a-4b72-8b78-a7e18cb27916 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:26.099253 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-df625915-fe0a-4b72-8b78-a7e18cb27916 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.351699 Jul 23 21:36:26.116948 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2517/5118] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:36:25 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:36:27.129613 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-b9be7773-6a92-42ea-aae0-e67980d97730 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:36:27.130296 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-b9be7773-6a92-42ea-aae0-e67980d97730 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:36:27.137772 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b9be7773-6a92-42ea-aae0-e67980d97730 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:36:27.138250 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b9be7773-6a92-42ea-aae0-e67980d97730 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:36:27.139883 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b9be7773-6a92-42ea-aae0-e67980d97730 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:36:27.140539 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-b9be7773-6a92-42ea-aae0-e67980d97730 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:36:27.260010 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-b9be7773-6a92-42ea-aae0-e67980d97730 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:27.298830 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-b9be7773-6a92-42ea-aae0-e67980d97730 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:27.300885 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-b9be7773-6a92-42ea-aae0-e67980d97730 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:27.302430 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-b9be7773-6a92-42ea-aae0-e67980d97730 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.176929 Jul 23 21:36:27.303876 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2602/5119] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:36:27 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:36:28.320936 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-94570c50-8275-4b37-ac66-d0089d35a870 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:36:28.321558 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-94570c50-8275-4b37-ac66-d0089d35a870 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:36:28.337589 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-94570c50-8275-4b37-ac66-d0089d35a870 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:36:28.338104 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-94570c50-8275-4b37-ac66-d0089d35a870 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:36:28.338916 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-94570c50-8275-4b37-ac66-d0089d35a870 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:36:28.339350 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-94570c50-8275-4b37-ac66-d0089d35a870 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:36:28.685023 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-94570c50-8275-4b37-ac66-d0089d35a870 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:28.700727 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-94570c50-8275-4b37-ac66-d0089d35a870 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:28.707324 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-94570c50-8275-4b37-ac66-d0089d35a870 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:28.713184 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-94570c50-8275-4b37-ac66-d0089d35a870 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.396199 Jul 23 21:36:28.713844 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2518/5120] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:36:28 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:36:29.735270 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-52c2dfd9-1636-4c9c-91e8-13772457de9e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:36:29.736031 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-52c2dfd9-1636-4c9c-91e8-13772457de9e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:36:29.752769 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-52c2dfd9-1636-4c9c-91e8-13772457de9e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:36:29.755027 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-52c2dfd9-1636-4c9c-91e8-13772457de9e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:36:29.756160 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-52c2dfd9-1636-4c9c-91e8-13772457de9e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:36:29.759603 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-52c2dfd9-1636-4c9c-91e8-13772457de9e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:36:29.775288 ncdv-master-1 devstack@n-api.service[131321]: DEBUG dbcounter [-] [131321] Writing DB stats nova_cell1:SELECT=72 {{(pid=131321) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:36:30.234473 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-52c2dfd9-1636-4c9c-91e8-13772457de9e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:30.248254 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-52c2dfd9-1636-4c9c-91e8-13772457de9e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:30.254769 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-52c2dfd9-1636-4c9c-91e8-13772457de9e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:30.256575 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-52c2dfd9-1636-4c9c-91e8-13772457de9e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.527681 Jul 23 21:36:30.258256 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2603/5121] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:36:29 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:36:31.276542 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8f04a90a-c286-40ba-a228-3ca9729d808a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:36:31.277174 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8f04a90a-c286-40ba-a228-3ca9729d808a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:36:31.284215 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8f04a90a-c286-40ba-a228-3ca9729d808a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:36:31.284677 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8f04a90a-c286-40ba-a228-3ca9729d808a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:36:31.285475 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8f04a90a-c286-40ba-a228-3ca9729d808a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:36:31.285952 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8f04a90a-c286-40ba-a228-3ca9729d808a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:36:31.512571 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8f04a90a-c286-40ba-a228-3ca9729d808a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:31.528325 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8f04a90a-c286-40ba-a228-3ca9729d808a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:31.529960 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8f04a90a-c286-40ba-a228-3ca9729d808a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:31.538639 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8f04a90a-c286-40ba-a228-3ca9729d808a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.266147 Jul 23 21:36:31.539912 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2519/5122] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:36:31 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:36:32.559097 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-a2807d7a-d4fa-46fa-8f26-9b3e2e50393e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:36:32.559732 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-a2807d7a-d4fa-46fa-8f26-9b3e2e50393e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:36:32.574052 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a2807d7a-d4fa-46fa-8f26-9b3e2e50393e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:36:32.575459 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a2807d7a-d4fa-46fa-8f26-9b3e2e50393e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:36:32.582784 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a2807d7a-d4fa-46fa-8f26-9b3e2e50393e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:36:32.583256 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-a2807d7a-d4fa-46fa-8f26-9b3e2e50393e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:36:32.870520 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-a2807d7a-d4fa-46fa-8f26-9b3e2e50393e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:32.890055 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-a2807d7a-d4fa-46fa-8f26-9b3e2e50393e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:32.893662 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-a2807d7a-d4fa-46fa-8f26-9b3e2e50393e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:32.897186 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-a2807d7a-d4fa-46fa-8f26-9b3e2e50393e tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.342171 Jul 23 21:36:32.907773 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2604/5123] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:36:32 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:36:33.927858 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-866b644f-6625-4a78-9e7d-c08e4e8de7ec tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:36:33.929477 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-866b644f-6625-4a78-9e7d-c08e4e8de7ec tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:36:33.941022 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-866b644f-6625-4a78-9e7d-c08e4e8de7ec tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:36:33.941804 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-866b644f-6625-4a78-9e7d-c08e4e8de7ec tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:36:33.944082 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-866b644f-6625-4a78-9e7d-c08e4e8de7ec tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:36:33.944778 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-866b644f-6625-4a78-9e7d-c08e4e8de7ec tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:36:34.029018 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-866b644f-6625-4a78-9e7d-c08e4e8de7ec tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:34.043321 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-866b644f-6625-4a78-9e7d-c08e4e8de7ec tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:34.045272 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-866b644f-6625-4a78-9e7d-c08e4e8de7ec tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:34.048070 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-866b644f-6625-4a78-9e7d-c08e4e8de7ec tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.128761 Jul 23 21:36:34.050086 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2520/5124] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:36:33 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:36:35.071957 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-d5157bb1-0bcf-4f5a-9128-4b8f44480149 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:36:35.073302 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-d5157bb1-0bcf-4f5a-9128-4b8f44480149 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:36:35.085910 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d5157bb1-0bcf-4f5a-9128-4b8f44480149 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:36:35.087318 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d5157bb1-0bcf-4f5a-9128-4b8f44480149 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:36:35.088305 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d5157bb1-0bcf-4f5a-9128-4b8f44480149 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:36:35.090038 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-d5157bb1-0bcf-4f5a-9128-4b8f44480149 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:36:35.348801 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-d5157bb1-0bcf-4f5a-9128-4b8f44480149 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:35.366117 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-d5157bb1-0bcf-4f5a-9128-4b8f44480149 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:35.369048 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-d5157bb1-0bcf-4f5a-9128-4b8f44480149 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:35.375803 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-d5157bb1-0bcf-4f5a-9128-4b8f44480149 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.307404 Jul 23 21:36:35.388176 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2605/5125] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:36:35 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:36:36.406360 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-10d1e7f0-0f7a-484a-a4f5-48a9f9bdd96b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:36:36.407076 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-10d1e7f0-0f7a-484a-a4f5-48a9f9bdd96b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:36:36.418026 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-10d1e7f0-0f7a-484a-a4f5-48a9f9bdd96b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:36:36.418585 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-10d1e7f0-0f7a-484a-a4f5-48a9f9bdd96b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:36:36.421704 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-10d1e7f0-0f7a-484a-a4f5-48a9f9bdd96b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:36:36.422326 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-10d1e7f0-0f7a-484a-a4f5-48a9f9bdd96b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:36:36.591453 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-10d1e7f0-0f7a-484a-a4f5-48a9f9bdd96b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:36.603023 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-10d1e7f0-0f7a-484a-a4f5-48a9f9bdd96b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:36.610910 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-10d1e7f0-0f7a-484a-a4f5-48a9f9bdd96b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:36.617320 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-10d1e7f0-0f7a-484a-a4f5-48a9f9bdd96b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.217266 Jul 23 21:36:36.620203 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2521/5126] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:36:36 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:36:37.644961 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-379d826c-b322-4219-a425-fc98ab5b44c6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:36:37.645583 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-379d826c-b322-4219-a425-fc98ab5b44c6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:36:37.655185 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-379d826c-b322-4219-a425-fc98ab5b44c6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:36:37.656094 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-379d826c-b322-4219-a425-fc98ab5b44c6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:36:37.657124 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-379d826c-b322-4219-a425-fc98ab5b44c6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:36:37.657725 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-379d826c-b322-4219-a425-fc98ab5b44c6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:36:37.847045 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-379d826c-b322-4219-a425-fc98ab5b44c6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:37.894265 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-379d826c-b322-4219-a425-fc98ab5b44c6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:37.896042 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-379d826c-b322-4219-a425-fc98ab5b44c6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:37.903582 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-379d826c-b322-4219-a425-fc98ab5b44c6 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.261384 Jul 23 21:36:37.904214 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2606/5127] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:36:37 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:36:38.923438 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-635a509a-5992-4277-89b5-f6442047578b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:36:38.924049 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-635a509a-5992-4277-89b5-f6442047578b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:36:38.941427 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-635a509a-5992-4277-89b5-f6442047578b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:36:38.942363 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-635a509a-5992-4277-89b5-f6442047578b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:36:38.943423 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-635a509a-5992-4277-89b5-f6442047578b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:36:38.943972 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-635a509a-5992-4277-89b5-f6442047578b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:36:39.132589 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-635a509a-5992-4277-89b5-f6442047578b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:39.145982 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-635a509a-5992-4277-89b5-f6442047578b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:39.150588 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-635a509a-5992-4277-89b5-f6442047578b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:39.154978 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-635a509a-5992-4277-89b5-f6442047578b tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.236089 Jul 23 21:36:39.172435 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2522/5128] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:36:38 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:36:40.174249 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-963132cf-8403-4096-985e-413410f347ea tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:36:40.175188 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-963132cf-8403-4096-985e-413410f347ea tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:36:40.185745 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-963132cf-8403-4096-985e-413410f347ea tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:36:40.186529 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-963132cf-8403-4096-985e-413410f347ea tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:36:40.187553 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-963132cf-8403-4096-985e-413410f347ea tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:36:40.188169 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-963132cf-8403-4096-985e-413410f347ea tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:36:40.321534 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-963132cf-8403-4096-985e-413410f347ea tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:40.335181 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-963132cf-8403-4096-985e-413410f347ea tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:40.339630 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-963132cf-8403-4096-985e-413410f347ea tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:40.345398 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-963132cf-8403-4096-985e-413410f347ea tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.174072 Jul 23 21:36:40.346229 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2607/5129] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:36:40 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:36:41.368430 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-010c4fda-3611-4ea7-8d08-e5db3a09cea4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:36:41.378213 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-010c4fda-3611-4ea7-8d08-e5db3a09cea4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:36:41.389007 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-010c4fda-3611-4ea7-8d08-e5db3a09cea4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:36:41.390946 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-010c4fda-3611-4ea7-8d08-e5db3a09cea4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:36:41.392728 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-010c4fda-3611-4ea7-8d08-e5db3a09cea4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:36:41.393433 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-010c4fda-3611-4ea7-8d08-e5db3a09cea4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:36:41.555136 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-010c4fda-3611-4ea7-8d08-e5db3a09cea4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:41.584222 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-010c4fda-3611-4ea7-8d08-e5db3a09cea4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:41.587932 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-010c4fda-3611-4ea7-8d08-e5db3a09cea4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:41.590077 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-010c4fda-3611-4ea7-8d08-e5db3a09cea4 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.228266 Jul 23 21:36:41.606427 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2523/5130] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:36:41 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:36:42.610898 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-16030c9b-85dc-4ca6-be17-cdca267cc566 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:36:42.612376 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-16030c9b-85dc-4ca6-be17-cdca267cc566 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:36:42.626101 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-16030c9b-85dc-4ca6-be17-cdca267cc566 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:36:42.630310 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-16030c9b-85dc-4ca6-be17-cdca267cc566 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:36:42.633574 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-16030c9b-85dc-4ca6-be17-cdca267cc566 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:36:42.634665 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-16030c9b-85dc-4ca6-be17-cdca267cc566 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:36:42.845022 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-16030c9b-85dc-4ca6-be17-cdca267cc566 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:42.860251 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-16030c9b-85dc-4ca6-be17-cdca267cc566 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:42.863549 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-16030c9b-85dc-4ca6-be17-cdca267cc566 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:42.865520 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-16030c9b-85dc-4ca6-be17-cdca267cc566 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.260427 Jul 23 21:36:42.866566 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2608/5131] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:36:42 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:36:43.884478 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-494e5bc8-22e5-4807-b2db-36b8c9bfcbbd tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:36:43.885089 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-494e5bc8-22e5-4807-b2db-36b8c9bfcbbd tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:36:43.892802 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-494e5bc8-22e5-4807-b2db-36b8c9bfcbbd tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:36:43.894874 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-494e5bc8-22e5-4807-b2db-36b8c9bfcbbd tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:36:43.895935 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-494e5bc8-22e5-4807-b2db-36b8c9bfcbbd tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:36:43.896549 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-494e5bc8-22e5-4807-b2db-36b8c9bfcbbd tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:36:44.045983 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-494e5bc8-22e5-4807-b2db-36b8c9bfcbbd tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:44.058062 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-494e5bc8-22e5-4807-b2db-36b8c9bfcbbd tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:44.061723 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-494e5bc8-22e5-4807-b2db-36b8c9bfcbbd tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:44.065935 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-494e5bc8-22e5-4807-b2db-36b8c9bfcbbd tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.183553 Jul 23 21:36:44.076274 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2524/5132] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:36:43 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:36:45.086663 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-4eb3c6e1-0d98-4256-85d9-06b741fc757a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:36:45.087948 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-4eb3c6e1-0d98-4256-85d9-06b741fc757a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:36:45.097631 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4eb3c6e1-0d98-4256-85d9-06b741fc757a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:36:45.098523 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4eb3c6e1-0d98-4256-85d9-06b741fc757a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:36:45.099415 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4eb3c6e1-0d98-4256-85d9-06b741fc757a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:36:45.099952 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-4eb3c6e1-0d98-4256-85d9-06b741fc757a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:36:45.196378 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-4eb3c6e1-0d98-4256-85d9-06b741fc757a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:45.206614 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-4eb3c6e1-0d98-4256-85d9-06b741fc757a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:45.208483 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-4eb3c6e1-0d98-4256-85d9-06b741fc757a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:45.209906 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-4eb3c6e1-0d98-4256-85d9-06b741fc757a tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.127340 Jul 23 21:36:45.210887 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2609/5133] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:36:45 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:36:46.230298 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0252c878-d8d0-4a4a-990e-62f31dc28c50 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:36:46.231176 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-0252c878-d8d0-4a4a-990e-62f31dc28c50 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:36:46.242856 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0252c878-d8d0-4a4a-990e-62f31dc28c50 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:36:46.243319 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0252c878-d8d0-4a4a-990e-62f31dc28c50 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:36:46.244189 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0252c878-d8d0-4a4a-990e-62f31dc28c50 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:36:46.244565 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0252c878-d8d0-4a4a-990e-62f31dc28c50 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:36:46.546244 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-0252c878-d8d0-4a4a-990e-62f31dc28c50 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:46.568744 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-0252c878-d8d0-4a4a-990e-62f31dc28c50 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:46.573885 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-0252c878-d8d0-4a4a-990e-62f31dc28c50 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:46.577684 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-0252c878-d8d0-4a4a-990e-62f31dc28c50 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.349656 Jul 23 21:36:46.580397 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2525/5134] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:36:46 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:36:47.600710 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-3d177ec0-c754-4836-b22d-f40c452c9657 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:36:47.606150 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-3d177ec0-c754-4836-b22d-f40c452c9657 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:36:47.626022 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3d177ec0-c754-4836-b22d-f40c452c9657 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:36:47.627265 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3d177ec0-c754-4836-b22d-f40c452c9657 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:36:47.630082 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3d177ec0-c754-4836-b22d-f40c452c9657 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:36:47.634946 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-3d177ec0-c754-4836-b22d-f40c452c9657 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:36:47.782088 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-3d177ec0-c754-4836-b22d-f40c452c9657 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:47.794203 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-3d177ec0-c754-4836-b22d-f40c452c9657 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:47.796350 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-3d177ec0-c754-4836-b22d-f40c452c9657 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:47.798166 ncdv-master-1 devstack@n-api.service[131321]: INFO nova.api.openstack.requestlog [None req-3d177ec0-c754-4836-b22d-f40c452c9657 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.203647 Jul 23 21:36:47.801019 ncdv-master-1 devstack@n-api.service[131321]: [pid: 131321|app: 0|req: 2610/5135] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:36:47 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:36:48.819663 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-89e20d4d-9cf4-438f-aa15-1fb830bca721 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:36:48.821066 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-89e20d4d-9cf4-438f-aa15-1fb830bca721 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:36:48.833034 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-89e20d4d-9cf4-438f-aa15-1fb830bca721 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:36:48.833939 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-89e20d4d-9cf4-438f-aa15-1fb830bca721 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:36:48.835566 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-89e20d4d-9cf4-438f-aa15-1fb830bca721 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:36:48.836237 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-89e20d4d-9cf4-438f-aa15-1fb830bca721 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:36:48.973083 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-89e20d4d-9cf4-438f-aa15-1fb830bca721 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:48.989047 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-89e20d4d-9cf4-438f-aa15-1fb830bca721 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:48.995346 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-89e20d4d-9cf4-438f-aa15-1fb830bca721 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:48.998258 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-89e20d4d-9cf4-438f-aa15-1fb830bca721 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.183697 Jul 23 21:36:48.999584 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2526/5136] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:36:48 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 23 21:36:49.854170 ncdv-master-1 devstack@n-api.service[131320]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 23 21:36:49.855234 ncdv-master-1 devstack@n-api.service[131320]: Sat Jul 23 21:36:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 23 21:36:50.017413 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.api.openstack.wsgi [None req-bc30ca07-04a4-4896-b2d0-5ffff9cfed58 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131321) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:36:50.018718 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.compute.api [None req-bc30ca07-04a4-4896-b2d0-5ffff9cfed58 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131321) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:36:50.029025 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bc30ca07-04a4-4896-b2d0-5ffff9cfed58 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:36:50.030265 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bc30ca07-04a4-4896-b2d0-5ffff9cfed58 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:36:50.031438 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bc30ca07-04a4-4896-b2d0-5ffff9cfed58 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:36:50.032580 ncdv-master-1 devstack@n-api.service[131321]: DEBUG oslo_concurrency.lockutils [None req-bc30ca07-04a4-4896-b2d0-5ffff9cfed58 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131321) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:36:50.153906 ncdv-master-1 devstack@n-api.service[131321]: DEBUG nova.policy [None req-bc30ca07-04a4-4896-b2d0-5ffff9cfed58 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131321) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:36:50.175793 ncdv-master-1 devstack@n-api.service[131321]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 23 21:36:50.178512 ncdv-master-1 devstack@n-api.service[131321]: Sat Jul 23 21:36:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d (ip 10.222.0.17) !!! Jul 23 21:36:59.609394 ncdv-master-1 devstack@n-api.service[131320]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 23 21:36:59.610000 ncdv-master-1 devstack@n-api.service[131320]: Sat Jul 23 21:36:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 23 21:37:50.075118 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=19 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:37:50.076561 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=73 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:37:50.081689 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f4e4ff7b-8bbc-43fa-95ef-8fb44aa92678 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:37:50.082389 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f4e4ff7b-8bbc-43fa-95ef-8fb44aa92678 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] [instance: 4d09f96e-8ea6-4838-8264-4535f77fa39d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:37:50.098357 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f4e4ff7b-8bbc-43fa-95ef-8fb44aa92678 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:37:50.099127 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f4e4ff7b-8bbc-43fa-95ef-8fb44aa92678 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:37:50.100072 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f4e4ff7b-8bbc-43fa-95ef-8fb44aa92678 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:37:50.100652 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f4e4ff7b-8bbc-43fa-95ef-8fb44aa92678 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:37:50.525750 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f4e4ff7b-8bbc-43fa-95ef-8fb44aa92678 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:37:50.540147 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f4e4ff7b-8bbc-43fa-95ef-8fb44aa92678 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:37:50.544147 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f4e4ff7b-8bbc-43fa-95ef-8fb44aa92678 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7578019c30174bc888279bf5009c0f4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31c41ae7265a4a629521b546a7231319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:37:50.545801 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f4e4ff7b-8bbc-43fa-95ef-8fb44aa92678 tempest-TaggedBootDevicesTest_v242-1302726931 tempest-TaggedBootDevicesTest_v242-1302726931-project] 10.222.0.17 "GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d" status: 200 len: 1604 microversion: 2.42 time: 0.472834 Jul 23 21:37:50.547820 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2527/5137] 10.222.0.17 () {60 vars in 1276 bytes} [Sat Jul 23 21:37:50 2022] GET /compute/v2.1/servers/4d09f96e-8ea6-4838-8264-4535f77fa39d => generated 1604 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 23 21:38:24.292800 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:38:24.294610 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=6 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:38:24.598337 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d2d79e06-b74c-4e67-8c86-4056c2ef7e45 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:38:24.598337 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d2d79e06-b74c-4e67-8c86-4056c2ef7e45 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] [instance: f9976c66-cc8b-45a6-b7f1-182c2abeb0ac] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:38:24.606778 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d2d79e06-b74c-4e67-8c86-4056c2ef7e45 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:38:24.607350 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d2d79e06-b74c-4e67-8c86-4056c2ef7e45 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:38:24.608236 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d2d79e06-b74c-4e67-8c86-4056c2ef7e45 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:38:24.608817 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d2d79e06-b74c-4e67-8c86-4056c2ef7e45 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:38:24.669075 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d2d79e06-b74c-4e67-8c86-4056c2ef7e45 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] [instance: f9976c66-cc8b-45a6-b7f1-182c2abeb0ac] Going to try to terminate instance {{(pid=131320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:38:24.779714 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d2d79e06-b74c-4e67-8c86-4056c2ef7e45 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] 10.222.0.17 "DELETE /compute/v2.1/servers/f9976c66-cc8b-45a6-b7f1-182c2abeb0ac" status: 204 len: 0 microversion: 2.1 time: 0.491114 Jul 23 21:38:24.782078 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2528/5138] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:38:24 2022] DELETE /compute/v2.1/servers/f9976c66-cc8b-45a6-b7f1-182c2abeb0ac => generated 0 bytes in 496 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 23 21:38:24.793017 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-18de75ab-4d50-49d1-b79d-478872152b80 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:38:24.794290 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-18de75ab-4d50-49d1-b79d-478872152b80 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] [instance: f9976c66-cc8b-45a6-b7f1-182c2abeb0ac] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:38:24.804317 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-18de75ab-4d50-49d1-b79d-478872152b80 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:38:24.805252 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-18de75ab-4d50-49d1-b79d-478872152b80 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:38:24.806355 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-18de75ab-4d50-49d1-b79d-478872152b80 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:38:24.807090 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-18de75ab-4d50-49d1-b79d-478872152b80 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:38:25.221919 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-18de75ab-4d50-49d1-b79d-478872152b80 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47bdbd5d201c465a82540c1d8c0fdf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f1825873b0849ea98136c0979b251c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:38:25.235528 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-18de75ab-4d50-49d1-b79d-478872152b80 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] 10.222.0.17 "GET /compute/v2.1/servers/f9976c66-cc8b-45a6-b7f1-182c2abeb0ac" status: 200 len: 1730 microversion: 2.1 time: 0.447356 Jul 23 21:38:25.236508 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2529/5139] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:38:24 2022] GET /compute/v2.1/servers/f9976c66-cc8b-45a6-b7f1-182c2abeb0ac => generated 1730 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:38:26.253048 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-68fa0e91-d738-4266-8ff3-7c1dc05bcad1 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:38:26.253668 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-68fa0e91-d738-4266-8ff3-7c1dc05bcad1 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] [instance: f9976c66-cc8b-45a6-b7f1-182c2abeb0ac] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:38:26.262745 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-68fa0e91-d738-4266-8ff3-7c1dc05bcad1 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:38:26.263431 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-68fa0e91-d738-4266-8ff3-7c1dc05bcad1 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:38:26.264391 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-68fa0e91-d738-4266-8ff3-7c1dc05bcad1 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:38:26.264976 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-68fa0e91-d738-4266-8ff3-7c1dc05bcad1 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:38:26.735508 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-68fa0e91-d738-4266-8ff3-7c1dc05bcad1 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47bdbd5d201c465a82540c1d8c0fdf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f1825873b0849ea98136c0979b251c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:38:26.752028 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-68fa0e91-d738-4266-8ff3-7c1dc05bcad1 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] 10.222.0.17 "GET /compute/v2.1/servers/f9976c66-cc8b-45a6-b7f1-182c2abeb0ac" status: 200 len: 1730 microversion: 2.1 time: 0.503161 Jul 23 21:38:26.752637 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2530/5140] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:38:26 2022] GET /compute/v2.1/servers/f9976c66-cc8b-45a6-b7f1-182c2abeb0ac => generated 1730 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:38:27.772053 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-7ea50b52-2863-473c-b2ba-55f4daa1fd91 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:38:27.774135 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-7ea50b52-2863-473c-b2ba-55f4daa1fd91 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] [instance: f9976c66-cc8b-45a6-b7f1-182c2abeb0ac] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:38:27.787201 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7ea50b52-2863-473c-b2ba-55f4daa1fd91 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:38:27.788138 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7ea50b52-2863-473c-b2ba-55f4daa1fd91 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:38:27.788993 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7ea50b52-2863-473c-b2ba-55f4daa1fd91 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:38:27.789432 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7ea50b52-2863-473c-b2ba-55f4daa1fd91 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:38:28.255841 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-7ea50b52-2863-473c-b2ba-55f4daa1fd91 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47bdbd5d201c465a82540c1d8c0fdf57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f1825873b0849ea98136c0979b251c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:38:28.266673 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-7ea50b52-2863-473c-b2ba-55f4daa1fd91 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] 10.222.0.17 "GET /compute/v2.1/servers/f9976c66-cc8b-45a6-b7f1-182c2abeb0ac" status: 200 len: 1662 microversion: 2.1 time: 0.501443 Jul 23 21:38:28.267620 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2531/5141] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:38:27 2022] GET /compute/v2.1/servers/f9976c66-cc8b-45a6-b7f1-182c2abeb0ac => generated 1662 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:38:28.750530 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-26f23751-951e-486a-82d3-1626fb205908 req-59ce2783-d5ed-421f-9d71-6206b7a29ae0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9976c66-cc8b-45a6-b7f1-182c2abeb0ac", "name": "network-vif-deleted", "tag": "6423c43f-d175-49b4-bde9-bf2e2953e90c"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:38:28.792099 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-26f23751-951e-486a-82d3-1626fb205908 req-59ce2783-d5ed-421f-9d71-6206b7a29ae0 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:38:28.793808 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-26f23751-951e-486a-82d3-1626fb205908 req-59ce2783-d5ed-421f-9d71-6206b7a29ae0 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:38:28.830256 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-26f23751-951e-486a-82d3-1626fb205908 req-59ce2783-d5ed-421f-9d71-6206b7a29ae0 service nova] Creating event network-vif-deleted:6423c43f-d175-49b4-bde9-bf2e2953e90c for instance f9976c66-cc8b-45a6-b7f1-182c2abeb0ac on nch1-master-1 Jul 23 21:38:28.841258 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-26f23751-951e-486a-82d3-1626fb205908 req-59ce2783-d5ed-421f-9d71-6206b7a29ae0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096343 Jul 23 21:38:28.843589 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2532/5142] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:38:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:38:29.461798 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5b13a471-b6b5-440d-83f0-da84a75dfa27 tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1373856430", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "networks": [{"uuid": "3858cf56-cd7c-471f-82dc-bd44d45fe502"}]}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:38:29.569904 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-5b13a471-b6b5-440d-83f0-da84a75dfa27 tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] validate_networks() for [('3858cf56-cd7c-471f-82dc-bd44d45fe502', None, None, None, None, None)] {{(pid=131320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:38:29.807779 ncdv-master-1 devstack@n-api.service[131320]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 23 21:38:29.808437 ncdv-master-1 devstack@n-api.service[131320]: Sat Jul 23 21:38:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.17) !!! Jul 23 21:38:30.209391 ncdv-master-1 devstack@n-api.service[131321]: Traceback (most recent call last): Jul 23 21:38:30.210041 ncdv-master-1 devstack@n-api.service[131321]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Jul 23 21:38:30.210041 ncdv-master-1 devstack@n-api.service[131321]: timer() Jul 23 21:38:30.210248 ncdv-master-1 devstack@n-api.service[131321]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Jul 23 21:38:30.210248 ncdv-master-1 devstack@n-api.service[131321]: cb(*args, **kw) Jul 23 21:38:30.210454 ncdv-master-1 devstack@n-api.service[131321]: File "/usr/local/lib/python3.8/dist-packages/eventlet/semaphore.py", line 147, in _do_acquire Jul 23 21:38:30.210454 ncdv-master-1 devstack@n-api.service[131321]: waiter.switch() Jul 23 21:38:30.210833 ncdv-master-1 devstack@n-api.service[131321]: greenlet.error: cannot switch to a different thread Jul 23 21:38:31.384108 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-5b13a471-b6b5-440d-83f0-da84a75dfa27 tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:38:31.387150 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-5b13a471-b6b5-440d-83f0-da84a75dfa27 tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:38:31.395339 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-5b13a471-b6b5-440d-83f0-da84a75dfa27 tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:38:31.398969 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-5b13a471-b6b5-440d-83f0-da84a75dfa27 tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:38:31.399715 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-5b13a471-b6b5-440d-83f0-da84a75dfa27 tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:38:31.422437 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5b13a471-b6b5-440d-83f0-da84a75dfa27 tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:38:31.425751 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5b13a471-b6b5-440d-83f0-da84a75dfa27 tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:38:31.428181 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5b13a471-b6b5-440d-83f0-da84a75dfa27 tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:38:31.430499 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5b13a471-b6b5-440d-83f0-da84a75dfa27 tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:38:31.464329 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-5b13a471-b6b5-440d-83f0-da84a75dfa27 tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] Getting quotas for project 20471be81d304644914d5b8b39f61da3. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:38:31.475859 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-5b13a471-b6b5-440d-83f0-da84a75dfa27 tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] Getting quotas for user e7b737394932432dbfadcd6cf26de29d and project 20471be81d304644914d5b8b39f61da3. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:38:31.496822 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5b13a471-b6b5-440d-83f0-da84a75dfa27 tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] Going to run 1 instances... {{(pid=131320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:38:31.503164 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5b13a471-b6b5-440d-83f0-da84a75dfa27 tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] [instance: 21eb2d6c-0a3a-4e6b-b242-a997008c024a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:38:31.585996 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5b13a471-b6b5-440d-83f0-da84a75dfa27 tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.397947 Jul 23 21:38:31.588549 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2533/5143] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:38:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 2400 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 23 21:38:31.596007 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-742365e1-febc-46c2-95e1-48ee2b468dc7 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:38:31.597393 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-742365e1-febc-46c2-95e1-48ee2b468dc7 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] [instance: f9976c66-cc8b-45a6-b7f1-182c2abeb0ac] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:38:31.635470 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-742365e1-febc-46c2-95e1-48ee2b468dc7 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:38:31.635942 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-742365e1-febc-46c2-95e1-48ee2b468dc7 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:38:31.656139 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-742365e1-febc-46c2-95e1-48ee2b468dc7 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:38:31.657082 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-742365e1-febc-46c2-95e1-48ee2b468dc7 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:38:31.694860 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-742365e1-febc-46c2-95e1-48ee2b468dc7 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] HTTP exception thrown: Instance f9976c66-cc8b-45a6-b7f1-182c2abeb0ac could not be found. Jul 23 21:38:31.702797 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-742365e1-febc-46c2-95e1-48ee2b468dc7 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Request method failure captured: Jul 23 21:38:31.702797 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/f9976c66-cc8b-45a6-b7f1-182c2abeb0ac HTTP/1.1 Jul 23 21:38:31.702797 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:38:31.702797 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:38:31.702797 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:38:31.702797 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:38:31.702797 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:38:31.702797 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:38:31.702797 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:38:31.702797 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:38:31.702797 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GkRabUZ-ieTk3i-hGIPW3S6Enk-8J5hzzs6DeKjN9s9ycpzCBoRXhWHsH9YZicoZ3xFipu9qnB6P2HdMAPMCnYEthC3RP7HEBVR3XZmtLolYduO82fidEdX1YxIs4ioW3hwj3FDZHqnGkNHnnsYg_fdR6QGsjIuNrg7OV8lhfIaTBQ Jul 23 21:38:31.702797 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:38:31.702797 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:38:31.702797 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:38:31.702797 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:38:31.702797 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:38:31.702797 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:38:31.702797 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 6f1825873b0849ea98136c0979b251c4 Jul 23 21:38:31.702797 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-TestServerBasicOps-985729679 Jul 23 21:38:31.702797 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:38:31.702797 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:38:31.702797 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6f1825873b0849ea98136c0979b251c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6f1825873b0849ea98136c0979b251c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6f1825873b0849ea98136c0979b251c4", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6f1825873b0849ea98136c0979b251c4"}]}] Jul 23 21:38:31.702797 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-TestServerBasicOps-985729679 Jul 23 21:38:31.702797 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 6f1825873b0849ea98136c0979b251c4 Jul 23 21:38:31.702797 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-TestServerBasicOps-985729679 Jul 23 21:38:31.702797 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-TestServerBasicOps-985729679-project Jul 23 21:38:31.702797 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:38:31.702797 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:38:31.702797 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 47bdbd5d201c465a82540c1d8c0fdf57 Jul 23 21:38:31.702797 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-TestServerBasicOps-985729679-project Jul 23 21:38:31.702797 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:38:31.702797 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance f9976c66-cc8b-45a6-b7f1-182c2abeb0ac could not be found. Jul 23 21:38:31.702797 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': 'f9976c66-cc8b-45a6-b7f1-182c2abeb0ac'} Jul 23 21:38:31.702797 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:38:31.702797 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:38:31.702797 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:38:31.702797 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:38:31.702797 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:38:31.702797 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:38:31.702797 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:38:31.702797 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:38:31.702797 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:38:31.702797 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:38:31.702797 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9976c66-cc8b-45a6-b7f1-182c2abeb0ac could not be found. Jul 23 21:38:31.702797 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:38:31.702797 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:38:31.702797 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:38:31.702797 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:38:31.702797 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:38:31.702797 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:38:31.702797 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:38:31.702797 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:38:31.702797 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:38:31.702797 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:38:31.702797 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:38:31.702797 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:38:31.702797 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:38:31.702797 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:38:31.702797 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:38:31.702797 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:38:31.702797 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9976c66-cc8b-45a6-b7f1-182c2abeb0ac could not be found. Jul 23 21:38:31.702797 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:38:31.702797 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:38:31.702797 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:38:31.707761 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:38:31.707761 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:38:31.707761 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:38:31.707761 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:38:31.707761 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:38:31.707761 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9976c66-cc8b-45a6-b7f1-182c2abeb0ac could not be found. Jul 23 21:38:31.707761 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:38:31.709159 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-742365e1-febc-46c2-95e1-48ee2b468dc7 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Returning 404 to user: Instance f9976c66-cc8b-45a6-b7f1-182c2abeb0ac could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:38:31.710328 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-742365e1-febc-46c2-95e1-48ee2b468dc7 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] 10.222.0.17 "GET /compute/v2.1/servers/f9976c66-cc8b-45a6-b7f1-182c2abeb0ac" status: 404 len: 111 microversion: 2.1 time: 0.120400 Jul 23 21:38:31.711702 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2534/5144] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:38:31 2022] GET /compute/v2.1/servers/f9976c66-cc8b-45a6-b7f1-182c2abeb0ac => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:38:31.717146 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-45f711ce-ef46-4204-af5d-918f2b3766bd tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:38:31.722600 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-45f711ce-ef46-4204-af5d-918f2b3766bd tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] [instance: 21eb2d6c-0a3a-4e6b-b242-a997008c024a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:38:31.873793 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-45f711ce-ef46-4204-af5d-918f2b3766bd tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7b737394932432dbfadcd6cf26de29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20471be81d304644914d5b8b39f61da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:38:31.892670 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-45f711ce-ef46-4204-af5d-918f2b3766bd tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] 10.222.0.17 "GET /compute/v2.1/servers/21eb2d6c-0a3a-4e6b-b242-a997008c024a" status: 200 len: 1214 microversion: 2.1 time: 0.179724 Jul 23 21:38:31.893625 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2535/5145] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:38:31 2022] GET /compute/v2.1/servers/21eb2d6c-0a3a-4e6b-b242-a997008c024a => generated 1214 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:38:32.845094 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8702deaa-4b93-4366-8cdb-1769eae66ab3 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:38:32.860096 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8702deaa-4b93-4366-8cdb-1769eae66ab3 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] [instance: f9976c66-cc8b-45a6-b7f1-182c2abeb0ac] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:38:32.871476 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8702deaa-4b93-4366-8cdb-1769eae66ab3 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:38:32.874829 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8702deaa-4b93-4366-8cdb-1769eae66ab3 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:38:32.875961 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8702deaa-4b93-4366-8cdb-1769eae66ab3 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:38:32.876719 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8702deaa-4b93-4366-8cdb-1769eae66ab3 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:38:32.911328 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-8702deaa-4b93-4366-8cdb-1769eae66ab3 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] HTTP exception thrown: Instance f9976c66-cc8b-45a6-b7f1-182c2abeb0ac could not be found. Jul 23 21:38:32.913678 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8702deaa-4b93-4366-8cdb-1769eae66ab3 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Request method failure captured: Jul 23 21:38:32.913678 ncdv-master-1 devstack@n-api.service[131320]: request: DELETE /compute/v2.1/servers/f9976c66-cc8b-45a6-b7f1-182c2abeb0ac HTTP/1.1 Jul 23 21:38:32.913678 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:38:32.913678 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:38:32.913678 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:38:32.913678 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:38:32.913678 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:38:32.913678 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:38:32.913678 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:38:32.913678 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:38:32.913678 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GkRabUZ-ieTk3i-hGIPW3S6Enk-8J5hzzs6DeKjN9s9ycpzCBoRXhWHsH9YZicoZ3xFipu9qnB6P2HdMAPMCnYEthC3RP7HEBVR3XZmtLolYduO82fidEdX1YxIs4ioW3hwj3FDZHqnGkNHnnsYg_fdR6QGsjIuNrg7OV8lhfIaTBQ Jul 23 21:38:32.913678 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:38:32.913678 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:38:32.913678 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:38:32.913678 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:38:32.913678 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:38:32.913678 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:38:32.913678 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 6f1825873b0849ea98136c0979b251c4 Jul 23 21:38:32.913678 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-TestServerBasicOps-985729679 Jul 23 21:38:32.913678 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:38:32.913678 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:38:32.913678 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6f1825873b0849ea98136c0979b251c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6f1825873b0849ea98136c0979b251c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6f1825873b0849ea98136c0979b251c4", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6f1825873b0849ea98136c0979b251c4"}]}] Jul 23 21:38:32.913678 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-TestServerBasicOps-985729679 Jul 23 21:38:32.913678 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 6f1825873b0849ea98136c0979b251c4 Jul 23 21:38:32.913678 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-TestServerBasicOps-985729679 Jul 23 21:38:32.913678 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-TestServerBasicOps-985729679-project Jul 23 21:38:32.913678 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:38:32.913678 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:38:32.913678 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 47bdbd5d201c465a82540c1d8c0fdf57 Jul 23 21:38:32.913678 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-TestServerBasicOps-985729679-project Jul 23 21:38:32.913678 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:38:32.913678 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance f9976c66-cc8b-45a6-b7f1-182c2abeb0ac could not be found. Jul 23 21:38:32.913678 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': 'f9976c66-cc8b-45a6-b7f1-182c2abeb0ac'} Jul 23 21:38:32.913678 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:38:32.913678 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:38:32.913678 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:38:32.913678 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:38:32.913678 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:38:32.913678 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:38:32.913678 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:38:32.913678 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:38:32.913678 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:38:32.913678 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:38:32.913678 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9976c66-cc8b-45a6-b7f1-182c2abeb0ac could not be found. Jul 23 21:38:32.913678 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:38:32.913678 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:38:32.913678 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:38:32.913678 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:38:32.913678 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:38:32.913678 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:38:32.913678 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:38:32.913678 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:38:32.913678 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:38:32.913678 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:38:32.913678 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 23 21:38:32.913678 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 23 21:38:32.913678 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 23 21:38:32.913678 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 23 21:38:32.913678 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:38:32.913678 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:38:32.913678 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:38:32.913678 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:38:32.913678 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9976c66-cc8b-45a6-b7f1-182c2abeb0ac could not be found. Jul 23 21:38:32.917516 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:38:32.917516 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:38:32.917516 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:38:32.917516 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:38:32.917516 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:38:32.917516 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:38:32.917516 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:38:32.917516 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:38:32.917516 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9976c66-cc8b-45a6-b7f1-182c2abeb0ac could not be found. Jul 23 21:38:32.917516 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:38:32.918845 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8702deaa-4b93-4366-8cdb-1769eae66ab3 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Returning 404 to user: Instance f9976c66-cc8b-45a6-b7f1-182c2abeb0ac could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:38:32.919991 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8702deaa-4b93-4366-8cdb-1769eae66ab3 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] 10.222.0.17 "DELETE /compute/v2.1/servers/f9976c66-cc8b-45a6-b7f1-182c2abeb0ac" status: 404 len: 111 microversion: 2.1 time: 0.081717 Jul 23 21:38:32.921279 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2536/5146] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:38:32 2022] DELETE /compute/v2.1/servers/f9976c66-cc8b-45a6-b7f1-182c2abeb0ac => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 23 21:38:32.926433 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-afc88b5c-f8bf-43b6-b55a-6f4086d4cc65 tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:38:32.927225 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-afc88b5c-f8bf-43b6-b55a-6f4086d4cc65 tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] [instance: 21eb2d6c-0a3a-4e6b-b242-a997008c024a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:38:33.006320 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-afc88b5c-f8bf-43b6-b55a-6f4086d4cc65 tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7b737394932432dbfadcd6cf26de29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20471be81d304644914d5b8b39f61da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:38:33.023179 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-afc88b5c-f8bf-43b6-b55a-6f4086d4cc65 tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] 10.222.0.17 "GET /compute/v2.1/servers/21eb2d6c-0a3a-4e6b-b242-a997008c024a" status: 200 len: 1214 microversion: 2.1 time: 0.098168 Jul 23 21:38:33.024005 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2537/5147] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:38:32 2022] GET /compute/v2.1/servers/21eb2d6c-0a3a-4e6b-b242-a997008c024a => generated 1214 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:38:33.038386 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-eaca08ef-3413-4664-9ad3-24298d888414 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:38:33.040580 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-eaca08ef-3413-4664-9ad3-24298d888414 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] [instance: f9976c66-cc8b-45a6-b7f1-182c2abeb0ac] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:38:33.054961 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-eaca08ef-3413-4664-9ad3-24298d888414 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:38:33.056070 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-eaca08ef-3413-4664-9ad3-24298d888414 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:38:33.058743 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-eaca08ef-3413-4664-9ad3-24298d888414 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:38:33.059422 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-eaca08ef-3413-4664-9ad3-24298d888414 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:38:33.091819 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-eaca08ef-3413-4664-9ad3-24298d888414 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] HTTP exception thrown: Instance f9976c66-cc8b-45a6-b7f1-182c2abeb0ac could not be found. Jul 23 21:38:33.094617 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-eaca08ef-3413-4664-9ad3-24298d888414 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Request method failure captured: Jul 23 21:38:33.094617 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/f9976c66-cc8b-45a6-b7f1-182c2abeb0ac HTTP/1.1 Jul 23 21:38:33.094617 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:38:33.094617 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:38:33.094617 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:38:33.094617 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:38:33.094617 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:38:33.094617 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:38:33.094617 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:38:33.094617 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:38:33.094617 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GkRabUZ-ieTk3i-hGIPW3S6Enk-8J5hzzs6DeKjN9s9ycpzCBoRXhWHsH9YZicoZ3xFipu9qnB6P2HdMAPMCnYEthC3RP7HEBVR3XZmtLolYduO82fidEdX1YxIs4ioW3hwj3FDZHqnGkNHnnsYg_fdR6QGsjIuNrg7OV8lhfIaTBQ Jul 23 21:38:33.094617 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:38:33.094617 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:38:33.094617 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:38:33.094617 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:38:33.094617 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:38:33.094617 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:38:33.094617 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 6f1825873b0849ea98136c0979b251c4 Jul 23 21:38:33.094617 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-TestServerBasicOps-985729679 Jul 23 21:38:33.094617 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:38:33.094617 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:38:33.094617 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6f1825873b0849ea98136c0979b251c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6f1825873b0849ea98136c0979b251c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6f1825873b0849ea98136c0979b251c4", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6f1825873b0849ea98136c0979b251c4"}]}] Jul 23 21:38:33.094617 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-TestServerBasicOps-985729679 Jul 23 21:38:33.094617 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 6f1825873b0849ea98136c0979b251c4 Jul 23 21:38:33.094617 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-TestServerBasicOps-985729679 Jul 23 21:38:33.094617 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-TestServerBasicOps-985729679-project Jul 23 21:38:33.094617 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:38:33.094617 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:38:33.094617 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 47bdbd5d201c465a82540c1d8c0fdf57 Jul 23 21:38:33.094617 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-TestServerBasicOps-985729679-project Jul 23 21:38:33.094617 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:38:33.094617 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance f9976c66-cc8b-45a6-b7f1-182c2abeb0ac could not be found. Jul 23 21:38:33.094617 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': 'f9976c66-cc8b-45a6-b7f1-182c2abeb0ac'} Jul 23 21:38:33.094617 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:38:33.094617 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:38:33.094617 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:38:33.094617 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:38:33.094617 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:38:33.094617 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:38:33.094617 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:38:33.094617 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:38:33.094617 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:38:33.094617 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:38:33.094617 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9976c66-cc8b-45a6-b7f1-182c2abeb0ac could not be found. Jul 23 21:38:33.094617 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:38:33.094617 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:38:33.094617 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:38:33.094617 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:38:33.094617 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:38:33.094617 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:38:33.094617 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:38:33.094617 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:38:33.094617 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:38:33.094617 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:38:33.094617 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:38:33.094617 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:38:33.094617 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:38:33.094617 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:38:33.094617 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:38:33.094617 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:38:33.094617 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9976c66-cc8b-45a6-b7f1-182c2abeb0ac could not be found. Jul 23 21:38:33.094617 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:38:33.094617 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:38:33.094617 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:38:33.098456 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:38:33.098456 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:38:33.098456 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:38:33.098456 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:38:33.098456 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:38:33.098456 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9976c66-cc8b-45a6-b7f1-182c2abeb0ac could not be found. Jul 23 21:38:33.098456 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:38:33.099442 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-eaca08ef-3413-4664-9ad3-24298d888414 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Returning 404 to user: Instance f9976c66-cc8b-45a6-b7f1-182c2abeb0ac could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:38:33.100425 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-eaca08ef-3413-4664-9ad3-24298d888414 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] 10.222.0.17 "GET /compute/v2.1/servers/f9976c66-cc8b-45a6-b7f1-182c2abeb0ac" status: 404 len: 111 microversion: 2.1 time: 0.074768 Jul 23 21:38:33.101431 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2538/5148] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:38:33 2022] GET /compute/v2.1/servers/f9976c66-cc8b-45a6-b7f1-182c2abeb0ac => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:38:33.849890 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6134de2c-b160-4d30-a6d9-924540f68398 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] Calling method '.version_select at 0x7f0b598bce50>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:38:33.888752 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6134de2c-b160-4d30-a6d9-924540f68398 tempest-TestServerBasicOps-985729679 tempest-TestServerBasicOps-985729679-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1799494003" status: 202 len: 0 microversion: 2.1 time: 0.042455 Jul 23 21:38:33.889703 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2539/5149] 10.222.0.17 () {58 vars in 1253 bytes} [Sat Jul 23 21:38:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1799494003 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:38:34.041478 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-56ea5a83-22a6-44c2-85cf-101aab25d92a tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:38:34.042192 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-56ea5a83-22a6-44c2-85cf-101aab25d92a tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] [instance: 21eb2d6c-0a3a-4e6b-b242-a997008c024a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:38:34.147166 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-56ea5a83-22a6-44c2-85cf-101aab25d92a tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7b737394932432dbfadcd6cf26de29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20471be81d304644914d5b8b39f61da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:38:34.168547 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-56ea5a83-22a6-44c2-85cf-101aab25d92a tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] 10.222.0.17 "GET /compute/v2.1/servers/21eb2d6c-0a3a-4e6b-b242-a997008c024a" status: 200 len: 1214 microversion: 2.1 time: 0.131503 Jul 23 21:38:34.169498 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2540/5150] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:38:34 2022] GET /compute/v2.1/servers/21eb2d6c-0a3a-4e6b-b242-a997008c024a => generated 1214 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:38:35.187287 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-921fff71-ea83-42e5-880c-5e5dfbdaac01 tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:38:35.188893 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-921fff71-ea83-42e5-880c-5e5dfbdaac01 tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] [instance: 21eb2d6c-0a3a-4e6b-b242-a997008c024a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:38:35.196374 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-921fff71-ea83-42e5-880c-5e5dfbdaac01 tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:38:35.201806 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-921fff71-ea83-42e5-880c-5e5dfbdaac01 tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:38:35.204626 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-921fff71-ea83-42e5-880c-5e5dfbdaac01 tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:38:35.205313 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-921fff71-ea83-42e5-880c-5e5dfbdaac01 tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:38:35.361416 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-921fff71-ea83-42e5-880c-5e5dfbdaac01 tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7b737394932432dbfadcd6cf26de29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20471be81d304644914d5b8b39f61da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:38:35.372959 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-921fff71-ea83-42e5-880c-5e5dfbdaac01 tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] 10.222.0.17 "GET /compute/v2.1/servers/21eb2d6c-0a3a-4e6b-b242-a997008c024a" status: 200 len: 1266 microversion: 2.1 time: 0.189354 Jul 23 21:38:35.374652 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2541/5151] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:38:35 2022] GET /compute/v2.1/servers/21eb2d6c-0a3a-4e6b-b242-a997008c024a => generated 1266 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:38:36.393660 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8d5222b9-ea2f-4f75-ba9c-c7cb73332de0 tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:38:36.394382 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8d5222b9-ea2f-4f75-ba9c-c7cb73332de0 tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] [instance: 21eb2d6c-0a3a-4e6b-b242-a997008c024a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:38:36.412218 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8d5222b9-ea2f-4f75-ba9c-c7cb73332de0 tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:38:36.413065 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8d5222b9-ea2f-4f75-ba9c-c7cb73332de0 tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:38:36.423920 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8d5222b9-ea2f-4f75-ba9c-c7cb73332de0 tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:38:36.425509 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8d5222b9-ea2f-4f75-ba9c-c7cb73332de0 tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:38:36.666495 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8d5222b9-ea2f-4f75-ba9c-c7cb73332de0 tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7b737394932432dbfadcd6cf26de29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20471be81d304644914d5b8b39f61da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:38:36.697522 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8d5222b9-ea2f-4f75-ba9c-c7cb73332de0 tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] 10.222.0.17 "GET /compute/v2.1/servers/21eb2d6c-0a3a-4e6b-b242-a997008c024a" status: 200 len: 1272 microversion: 2.1 time: 0.308024 Jul 23 21:38:36.699260 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2542/5152] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:38:36 2022] GET /compute/v2.1/servers/21eb2d6c-0a3a-4e6b-b242-a997008c024a => generated 1272 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:38:37.718026 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-023e7e12-df7b-4014-8c01-a279a418a56f tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:38:37.719666 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-023e7e12-df7b-4014-8c01-a279a418a56f tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] [instance: 21eb2d6c-0a3a-4e6b-b242-a997008c024a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:38:37.727280 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-023e7e12-df7b-4014-8c01-a279a418a56f tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:38:37.737635 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-023e7e12-df7b-4014-8c01-a279a418a56f tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:38:37.738889 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-023e7e12-df7b-4014-8c01-a279a418a56f tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:38:37.739540 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-023e7e12-df7b-4014-8c01-a279a418a56f tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:38:38.400010 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-023e7e12-df7b-4014-8c01-a279a418a56f tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7b737394932432dbfadcd6cf26de29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20471be81d304644914d5b8b39f61da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:38:38.446578 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-023e7e12-df7b-4014-8c01-a279a418a56f tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] 10.222.0.17 "GET /compute/v2.1/servers/21eb2d6c-0a3a-4e6b-b242-a997008c024a" status: 200 len: 1314 microversion: 2.1 time: 0.732945 Jul 23 21:38:38.447193 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2543/5153] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:38:37 2022] GET /compute/v2.1/servers/21eb2d6c-0a3a-4e6b-b242-a997008c024a => generated 1314 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:38:39.466167 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c3e788fd-7903-4abd-a8d7-1e392e71545b tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:38:39.467825 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c3e788fd-7903-4abd-a8d7-1e392e71545b tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] [instance: 21eb2d6c-0a3a-4e6b-b242-a997008c024a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:38:39.477603 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c3e788fd-7903-4abd-a8d7-1e392e71545b tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:38:39.485721 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c3e788fd-7903-4abd-a8d7-1e392e71545b tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:38:39.486975 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c3e788fd-7903-4abd-a8d7-1e392e71545b tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:38:39.487657 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c3e788fd-7903-4abd-a8d7-1e392e71545b tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:38:39.887367 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c3e788fd-7903-4abd-a8d7-1e392e71545b tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7b737394932432dbfadcd6cf26de29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20471be81d304644914d5b8b39f61da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:38:39.899018 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c3e788fd-7903-4abd-a8d7-1e392e71545b tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] 10.222.0.17 "GET /compute/v2.1/servers/21eb2d6c-0a3a-4e6b-b242-a997008c024a" status: 200 len: 1314 microversion: 2.1 time: 0.438745 Jul 23 21:38:39.904232 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2544/5154] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:38:39 2022] GET /compute/v2.1/servers/21eb2d6c-0a3a-4e6b-b242-a997008c024a => generated 1314 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:38:40.050660 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-8cc0e889-30be-4fb4-9861-932d7c3336c4 req-8966ceaf-b4b8-46f9-8b61-7fc3499fd166 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21eb2d6c-0a3a-4e6b-b242-a997008c024a", "tag": "635ed285-6ad3-47fe-975f-82e07c62fa47"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:38:40.070896 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-8cc0e889-30be-4fb4-9861-932d7c3336c4 req-8966ceaf-b4b8-46f9-8b61-7fc3499fd166 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:38:40.072997 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-8cc0e889-30be-4fb4-9861-932d7c3336c4 req-8966ceaf-b4b8-46f9-8b61-7fc3499fd166 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:38:40.111070 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-8cc0e889-30be-4fb4-9861-932d7c3336c4 req-8966ceaf-b4b8-46f9-8b61-7fc3499fd166 service nova] Creating event network-changed:635ed285-6ad3-47fe-975f-82e07c62fa47 for instance 21eb2d6c-0a3a-4e6b-b242-a997008c024a on nch1-master-1 Jul 23 21:38:40.117512 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-8cc0e889-30be-4fb4-9861-932d7c3336c4 req-8966ceaf-b4b8-46f9-8b61-7fc3499fd166 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070585 Jul 23 21:38:40.121421 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2545/5155] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:38:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:38:40.923988 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9b25f9fa-a69d-461d-b338-571d0a34d5e2 tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:38:40.925656 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-9b25f9fa-a69d-461d-b338-571d0a34d5e2 tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] [instance: 21eb2d6c-0a3a-4e6b-b242-a997008c024a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:38:40.934551 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9b25f9fa-a69d-461d-b338-571d0a34d5e2 tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:38:40.935235 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9b25f9fa-a69d-461d-b338-571d0a34d5e2 tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:38:40.936174 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9b25f9fa-a69d-461d-b338-571d0a34d5e2 tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:38:40.936932 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9b25f9fa-a69d-461d-b338-571d0a34d5e2 tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:38:41.450665 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:38:41.509805 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-9b25f9fa-a69d-461d-b338-571d0a34d5e2 tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7b737394932432dbfadcd6cf26de29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20471be81d304644914d5b8b39f61da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:38:41.519633 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9b25f9fa-a69d-461d-b338-571d0a34d5e2 tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] 10.222.0.17 "GET /compute/v2.1/servers/21eb2d6c-0a3a-4e6b-b242-a997008c024a" status: 200 len: 1314 microversion: 2.1 time: 0.600909 Jul 23 21:38:41.521899 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2546/5156] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:38:40 2022] GET /compute/v2.1/servers/21eb2d6c-0a3a-4e6b-b242-a997008c024a => generated 1314 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:38:42.538914 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-97bab335-f78c-4206-8369-ea0c9952a08b tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:38:42.539902 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-97bab335-f78c-4206-8369-ea0c9952a08b tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] [instance: 21eb2d6c-0a3a-4e6b-b242-a997008c024a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:38:42.547966 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-97bab335-f78c-4206-8369-ea0c9952a08b tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:38:42.549355 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-97bab335-f78c-4206-8369-ea0c9952a08b tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:38:42.550374 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-97bab335-f78c-4206-8369-ea0c9952a08b tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:38:42.550995 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-97bab335-f78c-4206-8369-ea0c9952a08b tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:38:42.968767 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-97bab335-f78c-4206-8369-ea0c9952a08b tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7b737394932432dbfadcd6cf26de29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20471be81d304644914d5b8b39f61da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:38:42.994578 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-97bab335-f78c-4206-8369-ea0c9952a08b tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] 10.222.0.17 "GET /compute/v2.1/servers/21eb2d6c-0a3a-4e6b-b242-a997008c024a" status: 200 len: 1314 microversion: 2.1 time: 0.461383 Jul 23 21:38:42.995273 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2547/5157] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:38:42 2022] GET /compute/v2.1/servers/21eb2d6c-0a3a-4e6b-b242-a997008c024a => generated 1314 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:38:44.012314 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c835b21b-73e4-4d26-89f8-84c12d70460e tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:38:44.012942 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c835b21b-73e4-4d26-89f8-84c12d70460e tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] [instance: 21eb2d6c-0a3a-4e6b-b242-a997008c024a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:38:44.026957 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c835b21b-73e4-4d26-89f8-84c12d70460e tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:38:44.027697 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c835b21b-73e4-4d26-89f8-84c12d70460e tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:38:44.028576 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c835b21b-73e4-4d26-89f8-84c12d70460e tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:38:44.029030 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c835b21b-73e4-4d26-89f8-84c12d70460e tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:38:44.155079 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=12 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:38:45.077003 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c835b21b-73e4-4d26-89f8-84c12d70460e tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7b737394932432dbfadcd6cf26de29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20471be81d304644914d5b8b39f61da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:38:45.110319 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c835b21b-73e4-4d26-89f8-84c12d70460e tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] 10.222.0.17 "GET /compute/v2.1/servers/21eb2d6c-0a3a-4e6b-b242-a997008c024a" status: 200 len: 1314 microversion: 2.1 time: 1.102202 Jul 23 21:38:45.113954 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2548/5158] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:38:44 2022] GET /compute/v2.1/servers/21eb2d6c-0a3a-4e6b-b242-a997008c024a => generated 1314 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:38:45.703183 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-5ead7d38-07c1-4709-9490-526ba3d4c3e1 req-d30a0533-4647-44ad-be67-90b104818cf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21eb2d6c-0a3a-4e6b-b242-a997008c024a", "name": "network-vif-plugged", "status": "completed", "tag": "635ed285-6ad3-47fe-975f-82e07c62fa47"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:38:45.712513 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-5ead7d38-07c1-4709-9490-526ba3d4c3e1 req-d30a0533-4647-44ad-be67-90b104818cf1 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:38:45.713181 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-5ead7d38-07c1-4709-9490-526ba3d4c3e1 req-d30a0533-4647-44ad-be67-90b104818cf1 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:38:45.725815 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-5ead7d38-07c1-4709-9490-526ba3d4c3e1 req-d30a0533-4647-44ad-be67-90b104818cf1 service nova] Creating event network-vif-plugged:635ed285-6ad3-47fe-975f-82e07c62fa47 for instance 21eb2d6c-0a3a-4e6b-b242-a997008c024a on nch1-master-1 Jul 23 21:38:45.731709 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-5ead7d38-07c1-4709-9490-526ba3d4c3e1 req-d30a0533-4647-44ad-be67-90b104818cf1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.287571 Jul 23 21:38:45.732801 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2549/5159] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:38:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:38:46.129199 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1c84640c-e43c-490d-9bba-f8168b2025ac tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:38:46.130615 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1c84640c-e43c-490d-9bba-f8168b2025ac tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] [instance: 21eb2d6c-0a3a-4e6b-b242-a997008c024a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:38:46.138307 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1c84640c-e43c-490d-9bba-f8168b2025ac tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:38:46.138780 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1c84640c-e43c-490d-9bba-f8168b2025ac tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:38:46.139575 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1c84640c-e43c-490d-9bba-f8168b2025ac tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:38:46.140023 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1c84640c-e43c-490d-9bba-f8168b2025ac tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:38:46.570669 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-1c84640c-e43c-490d-9bba-f8168b2025ac tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7b737394932432dbfadcd6cf26de29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20471be81d304644914d5b8b39f61da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:38:46.582562 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1c84640c-e43c-490d-9bba-f8168b2025ac tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] 10.222.0.17 "GET /compute/v2.1/servers/21eb2d6c-0a3a-4e6b-b242-a997008c024a" status: 200 len: 1314 microversion: 2.1 time: 0.458651 Jul 23 21:38:46.583552 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2550/5160] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:38:46 2022] GET /compute/v2.1/servers/21eb2d6c-0a3a-4e6b-b242-a997008c024a => generated 1314 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:38:47.602443 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f93468a2-a6aa-490c-873f-4f7401392499 tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:38:47.604617 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f93468a2-a6aa-490c-873f-4f7401392499 tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] [instance: 21eb2d6c-0a3a-4e6b-b242-a997008c024a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:38:47.626221 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f93468a2-a6aa-490c-873f-4f7401392499 tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:38:47.628075 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f93468a2-a6aa-490c-873f-4f7401392499 tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:38:47.647280 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f93468a2-a6aa-490c-873f-4f7401392499 tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:38:47.648831 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f93468a2-a6aa-490c-873f-4f7401392499 tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:38:47.710904 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:38:48.097745 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f93468a2-a6aa-490c-873f-4f7401392499 tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7b737394932432dbfadcd6cf26de29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20471be81d304644914d5b8b39f61da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:38:48.112508 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f93468a2-a6aa-490c-873f-4f7401392499 tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] 10.222.0.17 "GET /compute/v2.1/servers/21eb2d6c-0a3a-4e6b-b242-a997008c024a" status: 200 len: 1498 microversion: 2.1 time: 0.516797 Jul 23 21:38:48.124354 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2551/5161] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:38:47 2022] GET /compute/v2.1/servers/21eb2d6c-0a3a-4e6b-b242-a997008c024a => generated 1498 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:38:48.200814 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2774ebdd-73f1-4c28-b150-61f362e84c18 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:38:48.203243 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:38:48.203243 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:38:48.204781 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2774ebdd-73f1-4c28-b150-61f362e84c18 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:38:48.205344 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2774ebdd-73f1-4c28-b150-61f362e84c18 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:38:48.206340 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2774ebdd-73f1-4c28-b150-61f362e84c18 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:38:48.207585 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2774ebdd-73f1-4c28-b150-61f362e84c18 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:38:48.272630 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2774ebdd-73f1-4c28-b150-61f362e84c18 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] 10.222.0.17 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 613 microversion: 2.1 time: 0.153750 Jul 23 21:38:48.275414 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2552/5162] 10.222.0.17 () {58 vars in 1184 bytes} [Sat Jul 23 21:38:48 2022] GET /compute/v2.1/os-availability-zone/detail => generated 613 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:38:48.484032 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3ad73f88-6601-4c8f-bde9-c950b4958163 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1605831460", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "availability_zone": "nova:nch1-master-1", "networks": [{"uuid": "aa507485-ab51-4f16-bc54-0edba694a037"}]}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:38:48.570004 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-3ad73f88-6601-4c8f-bde9-c950b4958163 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] validate_networks() for [('aa507485-ab51-4f16-bc54-0edba694a037', None, None, None, None, None)] {{(pid=131320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:38:49.646427 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-3ad73f88-6601-4c8f-bde9-c950b4958163 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:38:49.647216 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-3ad73f88-6601-4c8f-bde9-c950b4958163 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:38:49.648159 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-3ad73f88-6601-4c8f-bde9-c950b4958163 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:38:49.649141 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-3ad73f88-6601-4c8f-bde9-c950b4958163 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:38:49.650134 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-3ad73f88-6601-4c8f-bde9-c950b4958163 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:38:49.671378 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3ad73f88-6601-4c8f-bde9-c950b4958163 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:38:49.672048 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3ad73f88-6601-4c8f-bde9-c950b4958163 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:38:49.673251 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3ad73f88-6601-4c8f-bde9-c950b4958163 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:38:49.674578 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3ad73f88-6601-4c8f-bde9-c950b4958163 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:38:49.719306 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-3ad73f88-6601-4c8f-bde9-c950b4958163 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Getting quotas for project 0c601305524f4bdb84548c52cfb8f05c. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:38:49.731514 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-3ad73f88-6601-4c8f-bde9-c950b4958163 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Getting quotas for user 698e4fa363ce4d94970c3aaffb47cef0 and project 0c601305524f4bdb84548c52cfb8f05c. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:38:49.764454 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-3ad73f88-6601-4c8f-bde9-c950b4958163 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Going to run 1 instances... {{(pid=131320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:38:49.768528 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-3ad73f88-6601-4c8f-bde9-c950b4958163 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] [instance: 7a27e053-473d-4bae-a379-1e11813e71cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:38:49.840843 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-3ad73f88-6601-4c8f-bde9-c950b4958163 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.361895 Jul 23 21:38:49.841833 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2553/5163] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:38:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1364 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 23 21:38:49.852494 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-fc5746c8-9435-49c2-ad67-1e5ce80d1892 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:38:49.853299 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-fc5746c8-9435-49c2-ad67-1e5ce80d1892 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] [instance: 7a27e053-473d-4bae-a379-1e11813e71cd] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:38:49.868258 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:38:49.984246 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-fc5746c8-9435-49c2-ad67-1e5ce80d1892 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/7a27e053-473d-4bae-a379-1e11813e71cd" status: 200 len: 1329 microversion: 2.1 time: 0.135741 Jul 23 21:38:49.984856 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2554/5164] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:38:49 2022] GET /compute/v2.1/servers/7a27e053-473d-4bae-a379-1e11813e71cd => generated 1329 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:38:49.993805 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6fca4d06-71b8-4c9c-abff-31232cf87338 tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:38:49.998229 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6fca4d06-71b8-4c9c-abff-31232cf87338 tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] [instance: 21eb2d6c-0a3a-4e6b-b242-a997008c024a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:38:50.011972 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6fca4d06-71b8-4c9c-abff-31232cf87338 tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:38:50.012439 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6fca4d06-71b8-4c9c-abff-31232cf87338 tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:38:50.015916 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6fca4d06-71b8-4c9c-abff-31232cf87338 tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:38:50.016381 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6fca4d06-71b8-4c9c-abff-31232cf87338 tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:38:50.069017 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6fca4d06-71b8-4c9c-abff-31232cf87338 tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] [instance: 21eb2d6c-0a3a-4e6b-b242-a997008c024a] Going to try to terminate instance {{(pid=131320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:38:50.236394 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6fca4d06-71b8-4c9c-abff-31232cf87338 tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] 10.222.0.17 "DELETE /compute/v2.1/servers/21eb2d6c-0a3a-4e6b-b242-a997008c024a" status: 204 len: 0 microversion: 2.1 time: 0.248856 Jul 23 21:38:50.239269 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2555/5165] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:38:49 2022] DELETE /compute/v2.1/servers/21eb2d6c-0a3a-4e6b-b242-a997008c024a => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:38:50.253667 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a86e2caa-8b52-4958-9966-5de5617b37df tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:38:50.256458 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a86e2caa-8b52-4958-9966-5de5617b37df tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] [instance: 21eb2d6c-0a3a-4e6b-b242-a997008c024a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:38:50.264810 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a86e2caa-8b52-4958-9966-5de5617b37df tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:38:50.265670 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a86e2caa-8b52-4958-9966-5de5617b37df tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:38:50.267238 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a86e2caa-8b52-4958-9966-5de5617b37df tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:38:50.268503 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a86e2caa-8b52-4958-9966-5de5617b37df tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:38:50.563041 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a86e2caa-8b52-4958-9966-5de5617b37df tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7b737394932432dbfadcd6cf26de29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20471be81d304644914d5b8b39f61da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:38:50.576272 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a86e2caa-8b52-4958-9966-5de5617b37df tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] 10.222.0.17 "GET /compute/v2.1/servers/21eb2d6c-0a3a-4e6b-b242-a997008c024a" status: 200 len: 1504 microversion: 2.1 time: 0.330343 Jul 23 21:38:50.577846 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2556/5166] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:38:50 2022] GET /compute/v2.1/servers/21eb2d6c-0a3a-4e6b-b242-a997008c024a => generated 1504 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:38:51.001826 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-91d926bc-57de-465d-82b5-ff23a740c157 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:38:51.004438 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-91d926bc-57de-465d-82b5-ff23a740c157 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] [instance: 7a27e053-473d-4bae-a379-1e11813e71cd] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:38:51.013502 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-91d926bc-57de-465d-82b5-ff23a740c157 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:38:51.014745 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-91d926bc-57de-465d-82b5-ff23a740c157 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:38:51.016285 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-91d926bc-57de-465d-82b5-ff23a740c157 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:38:51.016951 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-91d926bc-57de-465d-82b5-ff23a740c157 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:38:51.172844 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-91d926bc-57de-465d-82b5-ff23a740c157 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/7a27e053-473d-4bae-a379-1e11813e71cd" status: 200 len: 1346 microversion: 2.1 time: 0.175603 Jul 23 21:38:51.179024 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2557/5167] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:38:50 2022] GET /compute/v2.1/servers/7a27e053-473d-4bae-a379-1e11813e71cd => generated 1346 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:38:51.601910 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-759fcb07-526b-48d6-9e86-6ca0fc6ae138 tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:38:51.602787 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-759fcb07-526b-48d6-9e86-6ca0fc6ae138 tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] [instance: 21eb2d6c-0a3a-4e6b-b242-a997008c024a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:38:51.618798 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-759fcb07-526b-48d6-9e86-6ca0fc6ae138 tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:38:51.619250 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-759fcb07-526b-48d6-9e86-6ca0fc6ae138 tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:38:51.620073 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-759fcb07-526b-48d6-9e86-6ca0fc6ae138 tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:38:51.620512 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-759fcb07-526b-48d6-9e86-6ca0fc6ae138 tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:38:52.293050 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-759fcb07-526b-48d6-9e86-6ca0fc6ae138 tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7b737394932432dbfadcd6cf26de29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20471be81d304644914d5b8b39f61da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:38:52.309230 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-759fcb07-526b-48d6-9e86-6ca0fc6ae138 tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] 10.222.0.17 "GET /compute/v2.1/servers/21eb2d6c-0a3a-4e6b-b242-a997008c024a" status: 200 len: 1504 microversion: 2.1 time: 0.714995 Jul 23 21:38:52.310335 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2558/5168] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:38:51 2022] GET /compute/v2.1/servers/21eb2d6c-0a3a-4e6b-b242-a997008c024a => generated 1504 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:38:52.317585 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f014372f-c765-4465-8059-bfc37911cddb tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:38:52.321716 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f014372f-c765-4465-8059-bfc37911cddb tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] [instance: 7a27e053-473d-4bae-a379-1e11813e71cd] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:38:52.345179 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f014372f-c765-4465-8059-bfc37911cddb tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:38:52.347803 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f014372f-c765-4465-8059-bfc37911cddb tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:38:52.351416 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f014372f-c765-4465-8059-bfc37911cddb tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:38:52.354587 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f014372f-c765-4465-8059-bfc37911cddb tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:38:52.662562 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f014372f-c765-4465-8059-bfc37911cddb tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/7a27e053-473d-4bae-a379-1e11813e71cd" status: 200 len: 1424 microversion: 2.1 time: 0.346618 Jul 23 21:38:52.663503 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2559/5169] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:38:52 2022] GET /compute/v2.1/servers/7a27e053-473d-4bae-a379-1e11813e71cd => generated 1424 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:38:53.329218 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5fec8c7d-791f-40b6-9ff7-0698438a4e3c tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:38:53.331484 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5fec8c7d-791f-40b6-9ff7-0698438a4e3c tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] [instance: 21eb2d6c-0a3a-4e6b-b242-a997008c024a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:38:53.357076 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5fec8c7d-791f-40b6-9ff7-0698438a4e3c tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:38:53.360702 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5fec8c7d-791f-40b6-9ff7-0698438a4e3c tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:38:53.362441 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5fec8c7d-791f-40b6-9ff7-0698438a4e3c tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:38:53.363069 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5fec8c7d-791f-40b6-9ff7-0698438a4e3c tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:38:53.537570 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5fec8c7d-791f-40b6-9ff7-0698438a4e3c tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7b737394932432dbfadcd6cf26de29d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20471be81d304644914d5b8b39f61da3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:38:53.548873 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5fec8c7d-791f-40b6-9ff7-0698438a4e3c tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] 10.222.0.17 "GET /compute/v2.1/servers/21eb2d6c-0a3a-4e6b-b242-a997008c024a" status: 200 len: 1462 microversion: 2.1 time: 0.226908 Jul 23 21:38:53.550918 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2560/5170] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:38:53 2022] GET /compute/v2.1/servers/21eb2d6c-0a3a-4e6b-b242-a997008c024a => generated 1462 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:38:53.672043 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-b16749d1-4da1-4534-9659-f6fe35ec9343 req-a29f67a7-c37c-43dc-9c5c-8a4de78076cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21eb2d6c-0a3a-4e6b-b242-a997008c024a", "name": "network-vif-deleted", "tag": "635ed285-6ad3-47fe-975f-82e07c62fa47"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:38:53.688462 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-b16749d1-4da1-4534-9659-f6fe35ec9343 req-a29f67a7-c37c-43dc-9c5c-8a4de78076cd service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:38:53.690153 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-b16749d1-4da1-4534-9659-f6fe35ec9343 req-a29f67a7-c37c-43dc-9c5c-8a4de78076cd service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:38:53.727045 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-b16749d1-4da1-4534-9659-f6fe35ec9343 req-a29f67a7-c37c-43dc-9c5c-8a4de78076cd service nova] Creating event network-vif-deleted:635ed285-6ad3-47fe-975f-82e07c62fa47 for instance 21eb2d6c-0a3a-4e6b-b242-a997008c024a on nch1-master-1 Jul 23 21:38:53.741428 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-b16749d1-4da1-4534-9659-f6fe35ec9343 req-a29f67a7-c37c-43dc-9c5c-8a4de78076cd service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073484 Jul 23 21:38:53.747370 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2561/5171] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:38:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:38:53.758131 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a312ed1e-a1e1-486e-b700-12bce6d999fe tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:38:53.759224 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a312ed1e-a1e1-486e-b700-12bce6d999fe tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] [instance: 7a27e053-473d-4bae-a379-1e11813e71cd] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:38:53.776233 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a312ed1e-a1e1-486e-b700-12bce6d999fe tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:38:53.779489 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a312ed1e-a1e1-486e-b700-12bce6d999fe tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:38:53.780500 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a312ed1e-a1e1-486e-b700-12bce6d999fe tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:38:53.782405 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a312ed1e-a1e1-486e-b700-12bce6d999fe tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:38:54.407608 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a312ed1e-a1e1-486e-b700-12bce6d999fe tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/7a27e053-473d-4bae-a379-1e11813e71cd" status: 200 len: 1464 microversion: 2.1 time: 0.657070 Jul 23 21:38:54.409007 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2562/5172] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:38:53 2022] GET /compute/v2.1/servers/7a27e053-473d-4bae-a379-1e11813e71cd => generated 1464 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:38:54.568903 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-519a466f-4a9d-4f2d-bd79-9e1fe1e2249e tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:38:54.569808 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-519a466f-4a9d-4f2d-bd79-9e1fe1e2249e tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] [instance: 21eb2d6c-0a3a-4e6b-b242-a997008c024a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:38:54.583375 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-519a466f-4a9d-4f2d-bd79-9e1fe1e2249e tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:38:54.584872 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-519a466f-4a9d-4f2d-bd79-9e1fe1e2249e tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:38:54.585974 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-519a466f-4a9d-4f2d-bd79-9e1fe1e2249e tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:38:54.586762 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-519a466f-4a9d-4f2d-bd79-9e1fe1e2249e tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:38:54.611512 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-519a466f-4a9d-4f2d-bd79-9e1fe1e2249e tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] HTTP exception thrown: Instance 21eb2d6c-0a3a-4e6b-b242-a997008c024a could not be found. Jul 23 21:38:54.613503 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-519a466f-4a9d-4f2d-bd79-9e1fe1e2249e tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] Request method failure captured: Jul 23 21:38:54.613503 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/21eb2d6c-0a3a-4e6b-b242-a997008c024a HTTP/1.1 Jul 23 21:38:54.613503 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:38:54.613503 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:38:54.613503 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:38:54.613503 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:38:54.613503 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:38:54.613503 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:38:54.613503 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:38:54.613503 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:38:54.613503 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GpREm7BtrOb1P3fls4DjylO2udqvHFcOZxkqsGuods_kRKpM9BlCPmpEe18wJFqyTjP0WfCBNwdAq6CXItBbeBuTOAXdMh3So0zo7C4CIMM6MS69SAt3H-Q-J5QXiH6po7jgApKvfU5KujIjgoY_wxtleKNrqOQc6qCi_xu0qmzHgo Jul 23 21:38:54.613503 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:38:54.613503 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:38:54.613503 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:38:54.613503 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:38:54.613503 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:38:54.613503 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:38:54.613503 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 20471be81d304644914d5b8b39f61da3 Jul 23 21:38:54.613503 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-VolumesActionsTest-821932292 Jul 23 21:38:54.613503 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:38:54.613503 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:38:54.613503 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/20471be81d304644914d5b8b39f61da3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/20471be81d304644914d5b8b39f61da3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_20471be81d304644914d5b8b39f61da3", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/20471be81d304644914d5b8b39f61da3"}]}] Jul 23 21:38:54.613503 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-VolumesActionsTest-821932292 Jul 23 21:38:54.613503 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 20471be81d304644914d5b8b39f61da3 Jul 23 21:38:54.613503 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-VolumesActionsTest-821932292 Jul 23 21:38:54.613503 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-VolumesActionsTest-821932292-project Jul 23 21:38:54.613503 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:38:54.613503 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:38:54.613503 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: e7b737394932432dbfadcd6cf26de29d Jul 23 21:38:54.613503 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-VolumesActionsTest-821932292-project Jul 23 21:38:54.613503 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:38:54.613503 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance 21eb2d6c-0a3a-4e6b-b242-a997008c024a could not be found. Jul 23 21:38:54.613503 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '21eb2d6c-0a3a-4e6b-b242-a997008c024a'} Jul 23 21:38:54.613503 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:38:54.613503 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:38:54.613503 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:38:54.613503 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:38:54.613503 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:38:54.613503 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:38:54.613503 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:38:54.613503 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:38:54.613503 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:38:54.613503 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:38:54.613503 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21eb2d6c-0a3a-4e6b-b242-a997008c024a could not be found. Jul 23 21:38:54.613503 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:38:54.613503 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:38:54.613503 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:38:54.613503 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:38:54.613503 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:38:54.613503 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:38:54.613503 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:38:54.613503 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:38:54.613503 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:38:54.613503 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:38:54.613503 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:38:54.613503 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:38:54.613503 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:38:54.613503 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:38:54.613503 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:38:54.613503 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:38:54.613503 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21eb2d6c-0a3a-4e6b-b242-a997008c024a could not be found. Jul 23 21:38:54.613503 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:38:54.613503 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:38:54.613503 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:38:54.618270 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:38:54.618270 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:38:54.618270 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:38:54.618270 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:38:54.618270 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:38:54.618270 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21eb2d6c-0a3a-4e6b-b242-a997008c024a could not be found. Jul 23 21:38:54.618270 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:38:54.619517 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-519a466f-4a9d-4f2d-bd79-9e1fe1e2249e tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] Returning 404 to user: Instance 21eb2d6c-0a3a-4e6b-b242-a997008c024a could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:38:54.620928 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-519a466f-4a9d-4f2d-bd79-9e1fe1e2249e tempest-VolumesActionsTest-821932292 tempest-VolumesActionsTest-821932292-project] 10.222.0.17 "GET /compute/v2.1/servers/21eb2d6c-0a3a-4e6b-b242-a997008c024a" status: 404 len: 111 microversion: 2.1 time: 0.057058 Jul 23 21:38:54.626482 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2563/5173] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:38:54 2022] GET /compute/v2.1/servers/21eb2d6c-0a3a-4e6b-b242-a997008c024a => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 23 21:38:55.425700 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ed38cf18-1bcc-4295-900d-820784c8e7cd tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:38:55.427032 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ed38cf18-1bcc-4295-900d-820784c8e7cd tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] [instance: 7a27e053-473d-4bae-a379-1e11813e71cd] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:38:55.437565 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ed38cf18-1bcc-4295-900d-820784c8e7cd tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:38:55.438457 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ed38cf18-1bcc-4295-900d-820784c8e7cd tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:38:55.439530 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ed38cf18-1bcc-4295-900d-820784c8e7cd tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:38:55.440165 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ed38cf18-1bcc-4295-900d-820784c8e7cd tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:38:55.925531 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ed38cf18-1bcc-4295-900d-820784c8e7cd tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/7a27e053-473d-4bae-a379-1e11813e71cd" status: 200 len: 1464 microversion: 2.1 time: 0.503603 Jul 23 21:38:55.926454 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2564/5174] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:38:55 2022] GET /compute/v2.1/servers/7a27e053-473d-4bae-a379-1e11813e71cd => generated 1464 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:38:56.208333 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-06921874-6235-4eaa-985f-814146eec0c7 req-7f3efaa8-3d5b-4706-b062-b5b147703b5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a27e053-473d-4bae-a379-1e11813e71cd", "tag": "b5f842c9-adf5-4cff-a02c-8ff66246262a"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:38:56.222339 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-06921874-6235-4eaa-985f-814146eec0c7 req-7f3efaa8-3d5b-4706-b062-b5b147703b5d service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:38:56.229046 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-06921874-6235-4eaa-985f-814146eec0c7 req-7f3efaa8-3d5b-4706-b062-b5b147703b5d service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:38:56.245323 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-06921874-6235-4eaa-985f-814146eec0c7 req-7f3efaa8-3d5b-4706-b062-b5b147703b5d service nova] Creating event network-changed:b5f842c9-adf5-4cff-a02c-8ff66246262a for instance 7a27e053-473d-4bae-a379-1e11813e71cd on nch1-master-1 Jul 23 21:38:56.254365 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-06921874-6235-4eaa-985f-814146eec0c7 req-7f3efaa8-3d5b-4706-b062-b5b147703b5d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054999 Jul 23 21:38:56.255295 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2565/5175] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:38:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:38:56.948878 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-dd702a7a-738d-40b2-95c6-d6a344201af7 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:38:56.950775 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-dd702a7a-738d-40b2-95c6-d6a344201af7 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] [instance: 7a27e053-473d-4bae-a379-1e11813e71cd] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:38:56.958770 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dd702a7a-738d-40b2-95c6-d6a344201af7 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:38:56.959670 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dd702a7a-738d-40b2-95c6-d6a344201af7 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:38:56.961066 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dd702a7a-738d-40b2-95c6-d6a344201af7 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:38:56.961742 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dd702a7a-738d-40b2-95c6-d6a344201af7 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:38:57.203324 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-dd702a7a-738d-40b2-95c6-d6a344201af7 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/7a27e053-473d-4bae-a379-1e11813e71cd" status: 200 len: 1464 microversion: 2.1 time: 0.263813 Jul 23 21:38:57.204196 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2566/5176] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:38:56 2022] GET /compute/v2.1/servers/7a27e053-473d-4bae-a379-1e11813e71cd => generated 1464 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:38:58.221052 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c11fe0e6-186a-4302-8da8-2da856096fd1 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:38:58.221700 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c11fe0e6-186a-4302-8da8-2da856096fd1 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] [instance: 7a27e053-473d-4bae-a379-1e11813e71cd] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:38:58.229998 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c11fe0e6-186a-4302-8da8-2da856096fd1 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:38:58.230720 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c11fe0e6-186a-4302-8da8-2da856096fd1 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:38:58.231673 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c11fe0e6-186a-4302-8da8-2da856096fd1 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:38:58.232262 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c11fe0e6-186a-4302-8da8-2da856096fd1 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:38:58.453551 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c11fe0e6-186a-4302-8da8-2da856096fd1 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/7a27e053-473d-4bae-a379-1e11813e71cd" status: 200 len: 1464 microversion: 2.1 time: 0.236215 Jul 23 21:38:58.456628 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2567/5177] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:38:58 2022] GET /compute/v2.1/servers/7a27e053-473d-4bae-a379-1e11813e71cd => generated 1464 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:38:59.474642 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-7158b3d5-4557-459a-9a8d-574d842d465d tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:38:59.475293 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-7158b3d5-4557-459a-9a8d-574d842d465d tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] [instance: 7a27e053-473d-4bae-a379-1e11813e71cd] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:38:59.484893 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7158b3d5-4557-459a-9a8d-574d842d465d tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:38:59.485638 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7158b3d5-4557-459a-9a8d-574d842d465d tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:38:59.486834 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7158b3d5-4557-459a-9a8d-574d842d465d tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:38:59.491882 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7158b3d5-4557-459a-9a8d-574d842d465d tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:38:59.691778 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=4 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:38:59.767432 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-7158b3d5-4557-459a-9a8d-574d842d465d tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/7a27e053-473d-4bae-a379-1e11813e71cd" status: 200 len: 1464 microversion: 2.1 time: 0.297713 Jul 23 21:38:59.779071 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2568/5178] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:38:59 2022] GET /compute/v2.1/servers/7a27e053-473d-4bae-a379-1e11813e71cd => generated 1464 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:39:00.789490 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2f6f9072-0cf8-4c6c-a184-a606b77f93f4 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:39:00.791424 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-2f6f9072-0cf8-4c6c-a184-a606b77f93f4 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] [instance: 7a27e053-473d-4bae-a379-1e11813e71cd] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:39:00.800923 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=8 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:39:00.806632 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2f6f9072-0cf8-4c6c-a184-a606b77f93f4 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:39:00.808099 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2f6f9072-0cf8-4c6c-a184-a606b77f93f4 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:39:00.810231 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2f6f9072-0cf8-4c6c-a184-a606b77f93f4 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:39:00.811455 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2f6f9072-0cf8-4c6c-a184-a606b77f93f4 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:39:00.977786 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2f6f9072-0cf8-4c6c-a184-a606b77f93f4 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/7a27e053-473d-4bae-a379-1e11813e71cd" status: 200 len: 1464 microversion: 2.1 time: 0.196651 Jul 23 21:39:00.986424 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2569/5179] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:39:00 2022] GET /compute/v2.1/servers/7a27e053-473d-4bae-a379-1e11813e71cd => generated 1464 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:39:01.995972 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1c6eea2a-618b-482e-8ce9-770c2df1455b tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:39:01.996585 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1c6eea2a-618b-482e-8ce9-770c2df1455b tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] [instance: 7a27e053-473d-4bae-a379-1e11813e71cd] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:39:02.018226 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1c6eea2a-618b-482e-8ce9-770c2df1455b tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:39:02.018599 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1c6eea2a-618b-482e-8ce9-770c2df1455b tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:39:02.019716 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1c6eea2a-618b-482e-8ce9-770c2df1455b tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:39:02.020557 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1c6eea2a-618b-482e-8ce9-770c2df1455b tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:39:02.292215 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:39:02.298102 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1c6eea2a-618b-482e-8ce9-770c2df1455b tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/7a27e053-473d-4bae-a379-1e11813e71cd" status: 200 len: 1464 microversion: 2.1 time: 0.305861 Jul 23 21:39:02.298721 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2570/5180] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:39:01 2022] GET /compute/v2.1/servers/7a27e053-473d-4bae-a379-1e11813e71cd => generated 1464 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:39:02.914068 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-c085537d-732e-461b-9f71-608afe018403 req-e1b0a633-46d2-48c2-88d6-56d84c452750 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a27e053-473d-4bae-a379-1e11813e71cd", "name": "network-vif-plugged", "status": "completed", "tag": "b5f842c9-adf5-4cff-a02c-8ff66246262a"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:39:02.939263 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-c085537d-732e-461b-9f71-608afe018403 req-e1b0a633-46d2-48c2-88d6-56d84c452750 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:39:02.939815 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-c085537d-732e-461b-9f71-608afe018403 req-e1b0a633-46d2-48c2-88d6-56d84c452750 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:39:02.971436 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-c085537d-732e-461b-9f71-608afe018403 req-e1b0a633-46d2-48c2-88d6-56d84c452750 service nova] Creating event network-vif-plugged:b5f842c9-adf5-4cff-a02c-8ff66246262a for instance 7a27e053-473d-4bae-a379-1e11813e71cd on nch1-master-1 Jul 23 21:39:02.984289 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-c085537d-732e-461b-9f71-608afe018403 req-e1b0a633-46d2-48c2-88d6-56d84c452750 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072234 Jul 23 21:39:02.984997 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2571/5181] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:39:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:39:03.318560 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6774b953-45fe-4102-967e-9b4fa09f47c6 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:39:03.319421 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6774b953-45fe-4102-967e-9b4fa09f47c6 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] [instance: 7a27e053-473d-4bae-a379-1e11813e71cd] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:39:03.336194 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6774b953-45fe-4102-967e-9b4fa09f47c6 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:39:03.336194 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6774b953-45fe-4102-967e-9b4fa09f47c6 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:39:03.336845 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6774b953-45fe-4102-967e-9b4fa09f47c6 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:39:03.340031 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6774b953-45fe-4102-967e-9b4fa09f47c6 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:39:04.085493 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6774b953-45fe-4102-967e-9b4fa09f47c6 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/7a27e053-473d-4bae-a379-1e11813e71cd" status: 200 len: 1464 microversion: 2.1 time: 0.773416 Jul 23 21:39:04.096229 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2572/5182] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:39:03 2022] GET /compute/v2.1/servers/7a27e053-473d-4bae-a379-1e11813e71cd => generated 1464 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:39:05.107700 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2ab05837-1251-4c72-9926-578780555597 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:39:05.108421 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-2ab05837-1251-4c72-9926-578780555597 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] [instance: 7a27e053-473d-4bae-a379-1e11813e71cd] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:39:05.115101 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2ab05837-1251-4c72-9926-578780555597 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:39:05.115784 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2ab05837-1251-4c72-9926-578780555597 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:39:05.116583 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2ab05837-1251-4c72-9926-578780555597 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:39:05.117024 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2ab05837-1251-4c72-9926-578780555597 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:39:05.268120 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2ab05837-1251-4c72-9926-578780555597 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/7a27e053-473d-4bae-a379-1e11813e71cd" status: 200 len: 1647 microversion: 2.1 time: 0.166725 Jul 23 21:39:05.268709 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2573/5183] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:39:05 2022] GET /compute/v2.1/servers/7a27e053-473d-4bae-a379-1e11813e71cd => generated 1647 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:39:05.284676 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5a003b53-9202-486d-8901-09f6eff2646d tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:39:05.285290 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5a003b53-9202-486d-8901-09f6eff2646d tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] [instance: 7a27e053-473d-4bae-a379-1e11813e71cd] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:39:05.291614 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5a003b53-9202-486d-8901-09f6eff2646d tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:39:05.292060 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5a003b53-9202-486d-8901-09f6eff2646d tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:39:05.292860 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5a003b53-9202-486d-8901-09f6eff2646d tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:39:05.293490 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5a003b53-9202-486d-8901-09f6eff2646d tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:39:05.503487 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5a003b53-9202-486d-8901-09f6eff2646d tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/7a27e053-473d-4bae-a379-1e11813e71cd" status: 200 len: 1647 microversion: 2.1 time: 0.222573 Jul 23 21:39:05.507832 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2574/5184] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:39:05 2022] GET /compute/v2.1/servers/7a27e053-473d-4bae-a379-1e11813e71cd => generated 1647 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:39:05.522055 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0c6508e9-4651-48f1-98f8-3e622335307b tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:39:05.522728 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-0c6508e9-4651-48f1-98f8-3e622335307b tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] [instance: 7a27e053-473d-4bae-a379-1e11813e71cd] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:39:05.530657 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0c6508e9-4651-48f1-98f8-3e622335307b tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:39:05.531309 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0c6508e9-4651-48f1-98f8-3e622335307b tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:39:05.532258 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0c6508e9-4651-48f1-98f8-3e622335307b tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:39:05.532854 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0c6508e9-4651-48f1-98f8-3e622335307b tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:39:05.720977 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-0c6508e9-4651-48f1-98f8-3e622335307b tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/7a27e053-473d-4bae-a379-1e11813e71cd" status: 200 len: 1647 microversion: 2.1 time: 0.203960 Jul 23 21:39:05.722292 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2575/5185] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:39:05 2022] GET /compute/v2.1/servers/7a27e053-473d-4bae-a379-1e11813e71cd => generated 1647 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:39:05.887981 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-fee41b2f-d752-42cc-b01a-d3b2e931d95c tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-980595066", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "availability_zone": "nova:nch2-master-1", "networks": [{"uuid": "aa507485-ab51-4f16-bc54-0edba694a037"}]}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:39:05.954777 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-fee41b2f-d752-42cc-b01a-d3b2e931d95c tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] validate_networks() for [('aa507485-ab51-4f16-bc54-0edba694a037', None, None, None, None, None)] {{(pid=131320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:39:06.774298 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-fee41b2f-d752-42cc-b01a-d3b2e931d95c tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:39:06.776239 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-fee41b2f-d752-42cc-b01a-d3b2e931d95c tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:39:06.776717 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-fee41b2f-d752-42cc-b01a-d3b2e931d95c tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:39:06.777126 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-fee41b2f-d752-42cc-b01a-d3b2e931d95c tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:39:06.777700 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-fee41b2f-d752-42cc-b01a-d3b2e931d95c tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:39:06.789741 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fee41b2f-d752-42cc-b01a-d3b2e931d95c tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:39:06.790228 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fee41b2f-d752-42cc-b01a-d3b2e931d95c tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:39:06.791216 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fee41b2f-d752-42cc-b01a-d3b2e931d95c tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:39:06.791855 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fee41b2f-d752-42cc-b01a-d3b2e931d95c tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:39:06.827570 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-fee41b2f-d752-42cc-b01a-d3b2e931d95c tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Getting quotas for project 0c601305524f4bdb84548c52cfb8f05c. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:39:06.835595 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-fee41b2f-d752-42cc-b01a-d3b2e931d95c tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Getting quotas for user 698e4fa363ce4d94970c3aaffb47cef0 and project 0c601305524f4bdb84548c52cfb8f05c. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:39:06.861794 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-fee41b2f-d752-42cc-b01a-d3b2e931d95c tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Going to run 1 instances... {{(pid=131320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:39:06.865396 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-fee41b2f-d752-42cc-b01a-d3b2e931d95c tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] [instance: b3bec950-0c5f-4951-a65d-d09d0d5dfdd4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:39:06.942328 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-fee41b2f-d752-42cc-b01a-d3b2e931d95c tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.058957 Jul 23 21:39:06.944516 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2576/5186] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:39:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1062 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 23 21:39:06.956512 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9bb93c13-bfd8-4f8f-8994-8be3f320481b tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:39:06.957634 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-9bb93c13-bfd8-4f8f-8994-8be3f320481b tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] [instance: b3bec950-0c5f-4951-a65d-d09d0d5dfdd4] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:39:07.078820 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9bb93c13-bfd8-4f8f-8994-8be3f320481b tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/b3bec950-0c5f-4951-a65d-d09d0d5dfdd4" status: 200 len: 1328 microversion: 2.1 time: 0.128402 Jul 23 21:39:07.081362 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2577/5187] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:39:06 2022] GET /compute/v2.1/servers/b3bec950-0c5f-4951-a65d-d09d0d5dfdd4 => generated 1328 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:39:08.100967 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1d0783cd-cf4d-410c-8ccf-d293ad4d042d tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:39:08.108152 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1d0783cd-cf4d-410c-8ccf-d293ad4d042d tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] [instance: b3bec950-0c5f-4951-a65d-d09d0d5dfdd4] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:39:08.121384 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1d0783cd-cf4d-410c-8ccf-d293ad4d042d tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:39:08.122070 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1d0783cd-cf4d-410c-8ccf-d293ad4d042d tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:39:08.123030 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1d0783cd-cf4d-410c-8ccf-d293ad4d042d tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:39:08.123829 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1d0783cd-cf4d-410c-8ccf-d293ad4d042d tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:39:08.226432 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1d0783cd-cf4d-410c-8ccf-d293ad4d042d tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/b3bec950-0c5f-4951-a65d-d09d0d5dfdd4" status: 200 len: 1415 microversion: 2.1 time: 0.131672 Jul 23 21:39:08.227412 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2578/5188] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:39:08 2022] GET /compute/v2.1/servers/b3bec950-0c5f-4951-a65d-d09d0d5dfdd4 => generated 1415 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:39:09.245396 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-589c7f91-7abc-4c33-8f7b-b3f8e3ef8a70 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:39:09.247329 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-589c7f91-7abc-4c33-8f7b-b3f8e3ef8a70 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] [instance: b3bec950-0c5f-4951-a65d-d09d0d5dfdd4] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:39:09.256974 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-589c7f91-7abc-4c33-8f7b-b3f8e3ef8a70 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:39:09.258097 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-589c7f91-7abc-4c33-8f7b-b3f8e3ef8a70 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:39:09.259363 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-589c7f91-7abc-4c33-8f7b-b3f8e3ef8a70 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:39:09.260058 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-589c7f91-7abc-4c33-8f7b-b3f8e3ef8a70 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:39:09.479167 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-589c7f91-7abc-4c33-8f7b-b3f8e3ef8a70 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/b3bec950-0c5f-4951-a65d-d09d0d5dfdd4" status: 200 len: 1421 microversion: 2.1 time: 0.239090 Jul 23 21:39:09.479798 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2579/5189] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:39:09 2022] GET /compute/v2.1/servers/b3bec950-0c5f-4951-a65d-d09d0d5dfdd4 => generated 1421 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:39:10.496309 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-26f3b34e-b723-4f5a-819c-ee8f7f6180d6 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:39:10.496926 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-26f3b34e-b723-4f5a-819c-ee8f7f6180d6 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] [instance: b3bec950-0c5f-4951-a65d-d09d0d5dfdd4] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:39:10.510259 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-26f3b34e-b723-4f5a-819c-ee8f7f6180d6 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:39:10.510719 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-26f3b34e-b723-4f5a-819c-ee8f7f6180d6 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:39:10.511526 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-26f3b34e-b723-4f5a-819c-ee8f7f6180d6 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:39:10.511972 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-26f3b34e-b723-4f5a-819c-ee8f7f6180d6 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:39:11.237791 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-26f3b34e-b723-4f5a-819c-ee8f7f6180d6 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/b3bec950-0c5f-4951-a65d-d09d0d5dfdd4" status: 200 len: 1463 microversion: 2.1 time: 0.744754 Jul 23 21:39:11.247666 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2580/5190] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:39:10 2022] GET /compute/v2.1/servers/b3bec950-0c5f-4951-a65d-d09d0d5dfdd4 => generated 1463 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:39:12.262524 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d0e33e14-34a1-4c78-8ee7-8b2330ab8cdb tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:39:12.265225 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d0e33e14-34a1-4c78-8ee7-8b2330ab8cdb tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] [instance: b3bec950-0c5f-4951-a65d-d09d0d5dfdd4] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:39:12.288297 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d0e33e14-34a1-4c78-8ee7-8b2330ab8cdb tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:39:12.289203 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d0e33e14-34a1-4c78-8ee7-8b2330ab8cdb tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:39:12.290826 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d0e33e14-34a1-4c78-8ee7-8b2330ab8cdb tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:39:12.291776 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d0e33e14-34a1-4c78-8ee7-8b2330ab8cdb tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:39:13.036204 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d0e33e14-34a1-4c78-8ee7-8b2330ab8cdb tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/b3bec950-0c5f-4951-a65d-d09d0d5dfdd4" status: 200 len: 1463 microversion: 2.1 time: 0.783786 Jul 23 21:39:13.040354 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2581/5191] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:39:12 2022] GET /compute/v2.1/servers/b3bec950-0c5f-4951-a65d-d09d0d5dfdd4 => generated 1463 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:39:13.218946 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-35466c71-b6bb-46b7-b923-31ae88320388 req-319e6ed0-cae4-437f-ad31-eb7c5fdfe3d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3bec950-0c5f-4951-a65d-d09d0d5dfdd4", "tag": "91a10e00-bb7f-4be1-8c97-b82a07f5b3f3"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:39:13.238229 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-35466c71-b6bb-46b7-b923-31ae88320388 req-319e6ed0-cae4-437f-ad31-eb7c5fdfe3d2 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:39:13.238769 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-35466c71-b6bb-46b7-b923-31ae88320388 req-319e6ed0-cae4-437f-ad31-eb7c5fdfe3d2 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:39:13.261375 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-35466c71-b6bb-46b7-b923-31ae88320388 req-319e6ed0-cae4-437f-ad31-eb7c5fdfe3d2 service nova] Creating event network-changed:91a10e00-bb7f-4be1-8c97-b82a07f5b3f3 for instance b3bec950-0c5f-4951-a65d-d09d0d5dfdd4 on nch2-master-1 Jul 23 21:39:13.274439 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-35466c71-b6bb-46b7-b923-31ae88320388 req-319e6ed0-cae4-437f-ad31-eb7c5fdfe3d2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056214 Jul 23 21:39:13.275481 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2582/5192] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:39:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:39:14.057804 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-630e3bf3-d025-4eb0-a48d-d843252f63a8 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:39:14.058562 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-630e3bf3-d025-4eb0-a48d-d843252f63a8 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] [instance: b3bec950-0c5f-4951-a65d-d09d0d5dfdd4] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:39:14.065604 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-630e3bf3-d025-4eb0-a48d-d843252f63a8 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:39:14.066432 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-630e3bf3-d025-4eb0-a48d-d843252f63a8 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:39:14.067431 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-630e3bf3-d025-4eb0-a48d-d843252f63a8 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:39:14.068117 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-630e3bf3-d025-4eb0-a48d-d843252f63a8 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:39:14.451977 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-630e3bf3-d025-4eb0-a48d-d843252f63a8 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/b3bec950-0c5f-4951-a65d-d09d0d5dfdd4" status: 200 len: 1463 microversion: 2.1 time: 0.399222 Jul 23 21:39:14.452615 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2583/5193] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:39:14 2022] GET /compute/v2.1/servers/b3bec950-0c5f-4951-a65d-d09d0d5dfdd4 => generated 1463 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:39:15.469420 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5c4c4b7e-8817-4e7f-97e3-e27ee17cd3ab tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:39:15.470281 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5c4c4b7e-8817-4e7f-97e3-e27ee17cd3ab tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] [instance: b3bec950-0c5f-4951-a65d-d09d0d5dfdd4] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:39:15.477199 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5c4c4b7e-8817-4e7f-97e3-e27ee17cd3ab tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:39:15.477775 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5c4c4b7e-8817-4e7f-97e3-e27ee17cd3ab tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:39:15.478790 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5c4c4b7e-8817-4e7f-97e3-e27ee17cd3ab tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:39:15.479457 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5c4c4b7e-8817-4e7f-97e3-e27ee17cd3ab tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:39:16.026990 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5c4c4b7e-8817-4e7f-97e3-e27ee17cd3ab tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/b3bec950-0c5f-4951-a65d-d09d0d5dfdd4" status: 200 len: 1463 microversion: 2.1 time: 0.561388 Jul 23 21:39:16.028769 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2584/5194] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:39:15 2022] GET /compute/v2.1/servers/b3bec950-0c5f-4951-a65d-d09d0d5dfdd4 => generated 1463 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:39:17.043674 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c7159989-8179-4626-8344-bcfec7a05362 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:39:17.045001 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c7159989-8179-4626-8344-bcfec7a05362 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] [instance: b3bec950-0c5f-4951-a65d-d09d0d5dfdd4] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:39:17.049593 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:39:17.059149 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c7159989-8179-4626-8344-bcfec7a05362 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:39:17.072793 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c7159989-8179-4626-8344-bcfec7a05362 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:39:17.075210 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c7159989-8179-4626-8344-bcfec7a05362 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:39:17.075659 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c7159989-8179-4626-8344-bcfec7a05362 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:39:17.076532 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=8 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:39:17.627338 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c7159989-8179-4626-8344-bcfec7a05362 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/b3bec950-0c5f-4951-a65d-d09d0d5dfdd4" status: 200 len: 1463 microversion: 2.1 time: 0.587470 Jul 23 21:39:17.628893 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2585/5195] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:39:17 2022] GET /compute/v2.1/servers/b3bec950-0c5f-4951-a65d-d09d0d5dfdd4 => generated 1463 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:39:18.645350 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-438f8b8c-0dea-4268-a913-1b0a4cc91629 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:39:18.647014 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-438f8b8c-0dea-4268-a913-1b0a4cc91629 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] [instance: b3bec950-0c5f-4951-a65d-d09d0d5dfdd4] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:39:18.661169 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-438f8b8c-0dea-4268-a913-1b0a4cc91629 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:39:18.662162 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-438f8b8c-0dea-4268-a913-1b0a4cc91629 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:39:18.691454 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-438f8b8c-0dea-4268-a913-1b0a4cc91629 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:39:18.693306 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-438f8b8c-0dea-4268-a913-1b0a4cc91629 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:39:19.013180 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-438f8b8c-0dea-4268-a913-1b0a4cc91629 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/b3bec950-0c5f-4951-a65d-d09d0d5dfdd4" status: 200 len: 1463 microversion: 2.1 time: 0.371213 Jul 23 21:39:19.014693 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2586/5196] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:39:18 2022] GET /compute/v2.1/servers/b3bec950-0c5f-4951-a65d-d09d0d5dfdd4 => generated 1463 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:39:20.034472 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a11f6154-5569-4b71-8a13-a8594fd60aaa tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:39:20.036035 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a11f6154-5569-4b71-8a13-a8594fd60aaa tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] [instance: b3bec950-0c5f-4951-a65d-d09d0d5dfdd4] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:39:20.051589 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:39:20.054049 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a11f6154-5569-4b71-8a13-a8594fd60aaa tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:39:20.054716 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a11f6154-5569-4b71-8a13-a8594fd60aaa tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:39:20.055716 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a11f6154-5569-4b71-8a13-a8594fd60aaa tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:39:20.056571 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a11f6154-5569-4b71-8a13-a8594fd60aaa tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:39:20.376577 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a11f6154-5569-4b71-8a13-a8594fd60aaa tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/b3bec950-0c5f-4951-a65d-d09d0d5dfdd4" status: 200 len: 1463 microversion: 2.1 time: 0.347737 Jul 23 21:39:20.377718 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2587/5197] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:39:20 2022] GET /compute/v2.1/servers/b3bec950-0c5f-4951-a65d-d09d0d5dfdd4 => generated 1463 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:39:21.396102 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-15279e6b-8eff-43f2-8aa5-9a00bb90b536 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:39:21.397302 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-15279e6b-8eff-43f2-8aa5-9a00bb90b536 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] [instance: b3bec950-0c5f-4951-a65d-d09d0d5dfdd4] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:39:21.408048 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-15279e6b-8eff-43f2-8aa5-9a00bb90b536 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:39:21.410804 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-15279e6b-8eff-43f2-8aa5-9a00bb90b536 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:39:21.413611 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-15279e6b-8eff-43f2-8aa5-9a00bb90b536 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:39:21.417343 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-15279e6b-8eff-43f2-8aa5-9a00bb90b536 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:39:21.628036 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-15279e6b-8eff-43f2-8aa5-9a00bb90b536 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/b3bec950-0c5f-4951-a65d-d09d0d5dfdd4" status: 200 len: 1463 microversion: 2.1 time: 0.236730 Jul 23 21:39:21.631894 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2588/5198] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:39:21 2022] GET /compute/v2.1/servers/b3bec950-0c5f-4951-a65d-d09d0d5dfdd4 => generated 1463 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:39:21.828839 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-fbf6109f-dc85-4222-8402-b147abd94eb9 req-508f5924-f588-4dc3-a660-753688650bfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3bec950-0c5f-4951-a65d-d09d0d5dfdd4", "name": "network-vif-plugged", "status": "completed", "tag": "91a10e00-bb7f-4be1-8c97-b82a07f5b3f3"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:39:21.844623 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-fbf6109f-dc85-4222-8402-b147abd94eb9 req-508f5924-f588-4dc3-a660-753688650bfa service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:39:21.845074 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-fbf6109f-dc85-4222-8402-b147abd94eb9 req-508f5924-f588-4dc3-a660-753688650bfa service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:39:21.869645 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-fbf6109f-dc85-4222-8402-b147abd94eb9 req-508f5924-f588-4dc3-a660-753688650bfa service nova] Creating event network-vif-plugged:91a10e00-bb7f-4be1-8c97-b82a07f5b3f3 for instance b3bec950-0c5f-4951-a65d-d09d0d5dfdd4 on nch2-master-1 Jul 23 21:39:21.884436 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-fbf6109f-dc85-4222-8402-b147abd94eb9 req-508f5924-f588-4dc3-a660-753688650bfa service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067190 Jul 23 21:39:21.887966 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2589/5199] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:39:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:39:22.651930 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d03a31e2-589a-4ada-96fb-e502cea12d97 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:39:22.658402 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d03a31e2-589a-4ada-96fb-e502cea12d97 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] [instance: b3bec950-0c5f-4951-a65d-d09d0d5dfdd4] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:39:22.669087 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d03a31e2-589a-4ada-96fb-e502cea12d97 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:39:22.670070 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d03a31e2-589a-4ada-96fb-e502cea12d97 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:39:22.671310 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d03a31e2-589a-4ada-96fb-e502cea12d97 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:39:22.672583 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d03a31e2-589a-4ada-96fb-e502cea12d97 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:39:23.223323 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d03a31e2-589a-4ada-96fb-e502cea12d97 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/b3bec950-0c5f-4951-a65d-d09d0d5dfdd4" status: 200 len: 1463 microversion: 2.1 time: 0.579686 Jul 23 21:39:23.224935 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2590/5200] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:39:22 2022] GET /compute/v2.1/servers/b3bec950-0c5f-4951-a65d-d09d0d5dfdd4 => generated 1463 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:39:24.253946 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d086c1d8-a3ec-4a07-aa3c-660745107d67 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:39:24.255372 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d086c1d8-a3ec-4a07-aa3c-660745107d67 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] [instance: b3bec950-0c5f-4951-a65d-d09d0d5dfdd4] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:39:24.294684 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d086c1d8-a3ec-4a07-aa3c-660745107d67 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:39:24.295153 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d086c1d8-a3ec-4a07-aa3c-660745107d67 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:39:24.295975 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d086c1d8-a3ec-4a07-aa3c-660745107d67 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:39:24.296415 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d086c1d8-a3ec-4a07-aa3c-660745107d67 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:39:24.319528 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=100 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:39:24.767416 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d086c1d8-a3ec-4a07-aa3c-660745107d67 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/b3bec950-0c5f-4951-a65d-d09d0d5dfdd4" status: 200 len: 1647 microversion: 2.1 time: 0.518202 Jul 23 21:39:24.769114 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2591/5201] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:39:24 2022] GET /compute/v2.1/servers/b3bec950-0c5f-4951-a65d-d09d0d5dfdd4 => generated 1647 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:39:24.796431 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d60d42c9-8943-4e9b-a675-606d1b5242a8 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:39:24.797056 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d60d42c9-8943-4e9b-a675-606d1b5242a8 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] [instance: b3bec950-0c5f-4951-a65d-d09d0d5dfdd4] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:39:24.826286 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d60d42c9-8943-4e9b-a675-606d1b5242a8 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:39:24.826745 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d60d42c9-8943-4e9b-a675-606d1b5242a8 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:39:24.827650 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d60d42c9-8943-4e9b-a675-606d1b5242a8 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:39:24.832167 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d60d42c9-8943-4e9b-a675-606d1b5242a8 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:39:25.291637 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d60d42c9-8943-4e9b-a675-606d1b5242a8 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/b3bec950-0c5f-4951-a65d-d09d0d5dfdd4" status: 200 len: 1647 microversion: 2.1 time: 0.497152 Jul 23 21:39:25.292651 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2592/5202] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:39:24 2022] GET /compute/v2.1/servers/b3bec950-0c5f-4951-a65d-d09d0d5dfdd4 => generated 1647 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:39:25.308828 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2cba0beb-3598-4555-9c98-546d911c4bcd tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:39:25.309400 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-2cba0beb-3598-4555-9c98-546d911c4bcd tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] [instance: b3bec950-0c5f-4951-a65d-d09d0d5dfdd4] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:39:25.352308 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2cba0beb-3598-4555-9c98-546d911c4bcd tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:39:25.353145 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2cba0beb-3598-4555-9c98-546d911c4bcd tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:39:25.354101 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2cba0beb-3598-4555-9c98-546d911c4bcd tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:39:25.354580 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2cba0beb-3598-4555-9c98-546d911c4bcd tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:39:25.807170 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2cba0beb-3598-4555-9c98-546d911c4bcd tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/b3bec950-0c5f-4951-a65d-d09d0d5dfdd4" status: 200 len: 1647 microversion: 2.1 time: 0.500648 Jul 23 21:39:25.813466 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2593/5203] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:39:25 2022] GET /compute/v2.1/servers/b3bec950-0c5f-4951-a65d-d09d0d5dfdd4 => generated 1647 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:39:25.832851 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-288279bc-2541-48aa-badf-c5c50dac75a4 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:39:25.833367 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-288279bc-2541-48aa-badf-c5c50dac75a4 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] [instance: b3bec950-0c5f-4951-a65d-d09d0d5dfdd4] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:39:25.876606 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-288279bc-2541-48aa-badf-c5c50dac75a4 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:39:25.877389 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-288279bc-2541-48aa-badf-c5c50dac75a4 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:39:25.878368 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-288279bc-2541-48aa-badf-c5c50dac75a4 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:39:25.878981 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-288279bc-2541-48aa-badf-c5c50dac75a4 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:39:25.944379 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-288279bc-2541-48aa-badf-c5c50dac75a4 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] [instance: b3bec950-0c5f-4951-a65d-d09d0d5dfdd4] Going to try to terminate instance {{(pid=131320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:39:26.182539 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-288279bc-2541-48aa-badf-c5c50dac75a4 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] 10.222.0.17 "DELETE /compute/v2.1/servers/b3bec950-0c5f-4951-a65d-d09d0d5dfdd4" status: 204 len: 0 microversion: 2.1 time: 0.353647 Jul 23 21:39:26.183513 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2594/5204] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:39:25 2022] DELETE /compute/v2.1/servers/b3bec950-0c5f-4951-a65d-d09d0d5dfdd4 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:39:26.195223 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4365a748-a4f5-4abd-95fb-2fd426ffadd1 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:39:26.196211 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-4365a748-a4f5-4abd-95fb-2fd426ffadd1 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] [instance: b3bec950-0c5f-4951-a65d-d09d0d5dfdd4] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:39:26.217189 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4365a748-a4f5-4abd-95fb-2fd426ffadd1 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:39:26.218130 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4365a748-a4f5-4abd-95fb-2fd426ffadd1 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:39:26.219175 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4365a748-a4f5-4abd-95fb-2fd426ffadd1 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:39:26.219825 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4365a748-a4f5-4abd-95fb-2fd426ffadd1 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:39:26.537290 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4365a748-a4f5-4abd-95fb-2fd426ffadd1 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/b3bec950-0c5f-4951-a65d-d09d0d5dfdd4" status: 200 len: 1653 microversion: 2.1 time: 0.349067 Jul 23 21:39:26.537913 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2595/5205] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:39:26 2022] GET /compute/v2.1/servers/b3bec950-0c5f-4951-a65d-d09d0d5dfdd4 => generated 1653 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:39:27.555241 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d3f93063-75ef-43d2-96c0-15346d380f2b tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:39:27.560894 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d3f93063-75ef-43d2-96c0-15346d380f2b tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] [instance: b3bec950-0c5f-4951-a65d-d09d0d5dfdd4] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:39:27.590500 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d3f93063-75ef-43d2-96c0-15346d380f2b tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:39:27.596241 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d3f93063-75ef-43d2-96c0-15346d380f2b tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:39:27.597486 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d3f93063-75ef-43d2-96c0-15346d380f2b tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:39:27.599576 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d3f93063-75ef-43d2-96c0-15346d380f2b tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:39:28.696663 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d3f93063-75ef-43d2-96c0-15346d380f2b tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/b3bec950-0c5f-4951-a65d-d09d0d5dfdd4" status: 200 len: 1653 microversion: 2.1 time: 1.145452 Jul 23 21:39:28.697286 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2596/5206] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:39:27 2022] GET /compute/v2.1/servers/b3bec950-0c5f-4951-a65d-d09d0d5dfdd4 => generated 1653 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:39:29.302435 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-a46d2cf7-183f-43a3-81fb-ec31b82ca788 req-67dac93a-16f1-4838-94c5-a273923dff96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3bec950-0c5f-4951-a65d-d09d0d5dfdd4", "name": "network-vif-deleted", "tag": "91a10e00-bb7f-4be1-8c97-b82a07f5b3f3"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:39:29.318024 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-a46d2cf7-183f-43a3-81fb-ec31b82ca788 req-67dac93a-16f1-4838-94c5-a273923dff96 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:39:29.318490 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-a46d2cf7-183f-43a3-81fb-ec31b82ca788 req-67dac93a-16f1-4838-94c5-a273923dff96 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:39:29.341898 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-a46d2cf7-183f-43a3-81fb-ec31b82ca788 req-67dac93a-16f1-4838-94c5-a273923dff96 service nova] Creating event network-vif-deleted:91a10e00-bb7f-4be1-8c97-b82a07f5b3f3 for instance b3bec950-0c5f-4951-a65d-d09d0d5dfdd4 on nch2-master-1 Jul 23 21:39:29.349363 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-a46d2cf7-183f-43a3-81fb-ec31b82ca788 req-67dac93a-16f1-4838-94c5-a273923dff96 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.340815 Jul 23 21:39:29.351164 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2597/5207] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:39:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:39:29.716681 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-16cd4ad4-2235-4453-bc3d-f667a440e754 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:39:29.718249 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-16cd4ad4-2235-4453-bc3d-f667a440e754 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] [instance: b3bec950-0c5f-4951-a65d-d09d0d5dfdd4] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:39:29.747333 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-16cd4ad4-2235-4453-bc3d-f667a440e754 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:39:29.748090 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-16cd4ad4-2235-4453-bc3d-f667a440e754 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:39:29.749801 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-16cd4ad4-2235-4453-bc3d-f667a440e754 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:39:29.752385 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-16cd4ad4-2235-4453-bc3d-f667a440e754 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:39:29.776169 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-16cd4ad4-2235-4453-bc3d-f667a440e754 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] HTTP exception thrown: Instance b3bec950-0c5f-4951-a65d-d09d0d5dfdd4 could not be found. Jul 23 21:39:29.778631 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-16cd4ad4-2235-4453-bc3d-f667a440e754 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Request method failure captured: Jul 23 21:39:29.778631 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/b3bec950-0c5f-4951-a65d-d09d0d5dfdd4 HTTP/1.1 Jul 23 21:39:29.778631 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:39:29.778631 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:39:29.778631 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:39:29.778631 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:39:29.778631 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:39:29.778631 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:39:29.778631 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:39:29.778631 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:39:29.778631 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3Gpnadb7Dg3pkojv-kY7O_Pznu4M40ojDP6HEQ6JJgZ3hvhAJCcRiLq-bWlrpt2r5LuXdKJTietMSyoZHoy1SFkm_1IbSDForfQABmIk45tCzE17BF15nOfyN_yg4sN1ajuFWf-mOvoTMCY5UHfW6aEt79q3vm04YLrIAk374pUgezc Jul 23 21:39:29.778631 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:39:29.778631 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:39:29.778631 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:39:29.778631 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:39:29.778631 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:39:29.778631 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:39:29.778631 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 0c601305524f4bdb84548c52cfb8f05c Jul 23 21:39:29.778631 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-TestServerMultinode-1683541656 Jul 23 21:39:29.778631 ncdv-master-1 devstack@n-api.service[131320]: X-Role: admin,reader,member Jul 23 21:39:29.778631 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: admin,reader,member Jul 23 21:39:29.778631 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0c601305524f4bdb84548c52cfb8f05c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0c601305524f4bdb84548c52cfb8f05c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0c601305524f4bdb84548c52cfb8f05c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0c601305524f4bdb84548c52cfb8f05c"}]}] Jul 23 21:39:29.778631 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-TestServerMultinode-1683541656 Jul 23 21:39:29.778631 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 0c601305524f4bdb84548c52cfb8f05c Jul 23 21:39:29.778631 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-TestServerMultinode-1683541656 Jul 23 21:39:29.778631 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-TestServerMultinode-1683541656-project-admin Jul 23 21:39:29.778631 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:39:29.778631 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:39:29.778631 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 698e4fa363ce4d94970c3aaffb47cef0 Jul 23 21:39:29.778631 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-TestServerMultinode-1683541656-project-admin Jul 23 21:39:29.778631 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:39:29.778631 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance b3bec950-0c5f-4951-a65d-d09d0d5dfdd4 could not be found. Jul 23 21:39:29.778631 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': 'b3bec950-0c5f-4951-a65d-d09d0d5dfdd4'} Jul 23 21:39:29.778631 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:39:29.778631 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:39:29.778631 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:39:29.778631 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:39:29.778631 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:39:29.778631 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:39:29.778631 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:39:29.778631 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:39:29.778631 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:39:29.778631 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:39:29.778631 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3bec950-0c5f-4951-a65d-d09d0d5dfdd4 could not be found. Jul 23 21:39:29.778631 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:39:29.778631 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:39:29.778631 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:39:29.778631 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:39:29.778631 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:39:29.778631 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:39:29.778631 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:39:29.778631 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:39:29.778631 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:39:29.778631 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:39:29.778631 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:39:29.778631 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:39:29.778631 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:39:29.778631 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:39:29.778631 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:39:29.778631 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:39:29.778631 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3bec950-0c5f-4951-a65d-d09d0d5dfdd4 could not be found. Jul 23 21:39:29.778631 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:39:29.778631 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:39:29.778631 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:39:29.783053 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:39:29.783053 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:39:29.783053 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:39:29.783053 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:39:29.783053 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:39:29.783053 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3bec950-0c5f-4951-a65d-d09d0d5dfdd4 could not be found. Jul 23 21:39:29.783053 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:39:29.783053 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-16cd4ad4-2235-4453-bc3d-f667a440e754 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Returning 404 to user: Instance b3bec950-0c5f-4951-a65d-d09d0d5dfdd4 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:39:29.783053 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-16cd4ad4-2235-4453-bc3d-f667a440e754 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/b3bec950-0c5f-4951-a65d-d09d0d5dfdd4" status: 404 len: 111 microversion: 2.1 time: 0.068825 Jul 23 21:39:29.783053 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2598/5208] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:39:29 2022] GET /compute/v2.1/servers/b3bec950-0c5f-4951-a65d-d09d0d5dfdd4 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 23 21:39:29.790052 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1b3c0422-4e8d-46ce-a9ce-28b8e61f7920 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:39:29.790644 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1b3c0422-4e8d-46ce-a9ce-28b8e61f7920 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] [instance: 7a27e053-473d-4bae-a379-1e11813e71cd] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:39:29.798599 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1b3c0422-4e8d-46ce-a9ce-28b8e61f7920 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:39:29.799930 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1b3c0422-4e8d-46ce-a9ce-28b8e61f7920 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:39:29.800900 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1b3c0422-4e8d-46ce-a9ce-28b8e61f7920 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:39:29.801449 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1b3c0422-4e8d-46ce-a9ce-28b8e61f7920 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:39:29.843279 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1b3c0422-4e8d-46ce-a9ce-28b8e61f7920 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] [instance: 7a27e053-473d-4bae-a379-1e11813e71cd] Going to try to terminate instance {{(pid=131320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:39:29.941591 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1b3c0422-4e8d-46ce-a9ce-28b8e61f7920 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] 10.222.0.17 "DELETE /compute/v2.1/servers/7a27e053-473d-4bae-a379-1e11813e71cd" status: 204 len: 0 microversion: 2.1 time: 0.154162 Jul 23 21:39:29.943401 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2599/5209] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:39:29 2022] DELETE /compute/v2.1/servers/7a27e053-473d-4bae-a379-1e11813e71cd => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:39:29.954299 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2ae7f68d-571f-443f-94ec-da79d509a1e7 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:39:29.955004 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-2ae7f68d-571f-443f-94ec-da79d509a1e7 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] [instance: 7a27e053-473d-4bae-a379-1e11813e71cd] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:39:29.961211 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2ae7f68d-571f-443f-94ec-da79d509a1e7 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:39:29.961970 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2ae7f68d-571f-443f-94ec-da79d509a1e7 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:39:29.962884 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2ae7f68d-571f-443f-94ec-da79d509a1e7 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:39:29.963824 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2ae7f68d-571f-443f-94ec-da79d509a1e7 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:39:30.128437 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2ae7f68d-571f-443f-94ec-da79d509a1e7 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/7a27e053-473d-4bae-a379-1e11813e71cd" status: 200 len: 1653 microversion: 2.1 time: 0.180389 Jul 23 21:39:30.140636 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2600/5210] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:39:29 2022] GET /compute/v2.1/servers/7a27e053-473d-4bae-a379-1e11813e71cd => generated 1653 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:39:31.147928 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-69416c51-7406-4925-8f04-0f81d22e63bd tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:39:31.148558 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-69416c51-7406-4925-8f04-0f81d22e63bd tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] [instance: 7a27e053-473d-4bae-a379-1e11813e71cd] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:39:31.157971 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-69416c51-7406-4925-8f04-0f81d22e63bd tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:39:31.158433 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-69416c51-7406-4925-8f04-0f81d22e63bd tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:39:31.159234 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-69416c51-7406-4925-8f04-0f81d22e63bd tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:39:31.159683 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-69416c51-7406-4925-8f04-0f81d22e63bd tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:39:31.497618 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-69416c51-7406-4925-8f04-0f81d22e63bd tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/7a27e053-473d-4bae-a379-1e11813e71cd" status: 200 len: 1653 microversion: 2.1 time: 0.354512 Jul 23 21:39:31.513040 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2601/5211] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:39:31 2022] GET /compute/v2.1/servers/7a27e053-473d-4bae-a379-1e11813e71cd => generated 1653 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:39:32.519710 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-688634f1-cca3-4292-9f3f-40c3511143bf tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:39:32.520378 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-688634f1-cca3-4292-9f3f-40c3511143bf tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] [instance: 7a27e053-473d-4bae-a379-1e11813e71cd] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:39:32.534915 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-688634f1-cca3-4292-9f3f-40c3511143bf tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:39:32.535374 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-688634f1-cca3-4292-9f3f-40c3511143bf tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:39:32.536321 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-688634f1-cca3-4292-9f3f-40c3511143bf tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:39:32.536912 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-688634f1-cca3-4292-9f3f-40c3511143bf tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:39:32.744329 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-688634f1-cca3-4292-9f3f-40c3511143bf tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/7a27e053-473d-4bae-a379-1e11813e71cd" status: 200 len: 1611 microversion: 2.1 time: 0.228343 Jul 23 21:39:32.745406 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2602/5212] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:39:32 2022] GET /compute/v2.1/servers/7a27e053-473d-4bae-a379-1e11813e71cd => generated 1611 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:39:32.850287 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-962b6856-d2e4-4bb1-9ca0-103780f82e6f req-927c9131-124b-40d5-8882-b0b8cd55d18e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a27e053-473d-4bae-a379-1e11813e71cd", "name": "network-vif-deleted", "tag": "b5f842c9-adf5-4cff-a02c-8ff66246262a"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:39:32.882875 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-962b6856-d2e4-4bb1-9ca0-103780f82e6f req-927c9131-124b-40d5-8882-b0b8cd55d18e service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:39:32.884959 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-962b6856-d2e4-4bb1-9ca0-103780f82e6f req-927c9131-124b-40d5-8882-b0b8cd55d18e service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:39:33.000507 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-962b6856-d2e4-4bb1-9ca0-103780f82e6f req-927c9131-124b-40d5-8882-b0b8cd55d18e service nova] Creating event network-vif-deleted:b5f842c9-adf5-4cff-a02c-8ff66246262a for instance 7a27e053-473d-4bae-a379-1e11813e71cd on nch1-master-1 Jul 23 21:39:33.036255 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-962b6856-d2e4-4bb1-9ca0-103780f82e6f req-927c9131-124b-40d5-8882-b0b8cd55d18e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.203261 Jul 23 21:39:33.039491 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2603/5213] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:39:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:39:33.765606 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e24ce2d0-28a1-4bec-b1d4-9b125e784e10 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:39:33.766455 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e24ce2d0-28a1-4bec-b1d4-9b125e784e10 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] [instance: 7a27e053-473d-4bae-a379-1e11813e71cd] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:39:33.787868 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e24ce2d0-28a1-4bec-b1d4-9b125e784e10 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:39:33.788353 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e24ce2d0-28a1-4bec-b1d4-9b125e784e10 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:39:33.789274 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e24ce2d0-28a1-4bec-b1d4-9b125e784e10 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:39:33.790000 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e24ce2d0-28a1-4bec-b1d4-9b125e784e10 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:39:33.821690 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-e24ce2d0-28a1-4bec-b1d4-9b125e784e10 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] HTTP exception thrown: Instance 7a27e053-473d-4bae-a379-1e11813e71cd could not be found. Jul 23 21:39:33.827720 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e24ce2d0-28a1-4bec-b1d4-9b125e784e10 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Request method failure captured: Jul 23 21:39:33.827720 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/7a27e053-473d-4bae-a379-1e11813e71cd HTTP/1.1 Jul 23 21:39:33.827720 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:39:33.827720 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:39:33.827720 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:39:33.827720 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:39:33.827720 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:39:33.827720 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:39:33.827720 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:39:33.827720 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:39:33.827720 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3Gpnadb7Dg3pkojv-kY7O_Pznu4M40ojDP6HEQ6JJgZ3hvhAJCcRiLq-bWlrpt2r5LuXdKJTietMSyoZHoy1SFkm_1IbSDForfQABmIk45tCzE17BF15nOfyN_yg4sN1ajuFWf-mOvoTMCY5UHfW6aEt79q3vm04YLrIAk374pUgezc Jul 23 21:39:33.827720 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:39:33.827720 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:39:33.827720 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:39:33.827720 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:39:33.827720 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:39:33.827720 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:39:33.827720 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 0c601305524f4bdb84548c52cfb8f05c Jul 23 21:39:33.827720 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-TestServerMultinode-1683541656 Jul 23 21:39:33.827720 ncdv-master-1 devstack@n-api.service[131320]: X-Role: admin,reader,member Jul 23 21:39:33.827720 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: admin,reader,member Jul 23 21:39:33.827720 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0c601305524f4bdb84548c52cfb8f05c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/0c601305524f4bdb84548c52cfb8f05c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_0c601305524f4bdb84548c52cfb8f05c", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/0c601305524f4bdb84548c52cfb8f05c"}]}] Jul 23 21:39:33.827720 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-TestServerMultinode-1683541656 Jul 23 21:39:33.827720 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 0c601305524f4bdb84548c52cfb8f05c Jul 23 21:39:33.827720 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-TestServerMultinode-1683541656 Jul 23 21:39:33.827720 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-TestServerMultinode-1683541656-project-admin Jul 23 21:39:33.827720 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:39:33.827720 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:39:33.827720 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 698e4fa363ce4d94970c3aaffb47cef0 Jul 23 21:39:33.827720 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-TestServerMultinode-1683541656-project-admin Jul 23 21:39:33.827720 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:39:33.827720 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance 7a27e053-473d-4bae-a379-1e11813e71cd could not be found. Jul 23 21:39:33.827720 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '7a27e053-473d-4bae-a379-1e11813e71cd'} Jul 23 21:39:33.827720 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:39:33.827720 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:39:33.827720 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:39:33.827720 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:39:33.827720 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:39:33.827720 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:39:33.827720 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:39:33.827720 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:39:33.827720 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:39:33.827720 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:39:33.827720 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a27e053-473d-4bae-a379-1e11813e71cd could not be found. Jul 23 21:39:33.827720 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:39:33.827720 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:39:33.827720 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:39:33.827720 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:39:33.827720 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:39:33.827720 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:39:33.827720 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:39:33.827720 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:39:33.827720 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:39:33.827720 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:39:33.827720 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:39:33.827720 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:39:33.827720 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:39:33.827720 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:39:33.827720 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:39:33.827720 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:39:33.827720 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a27e053-473d-4bae-a379-1e11813e71cd could not be found. Jul 23 21:39:33.827720 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:39:33.827720 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:39:33.827720 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:39:33.832129 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:39:33.832129 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:39:33.832129 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:39:33.832129 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:39:33.832129 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:39:33.832129 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a27e053-473d-4bae-a379-1e11813e71cd could not be found. Jul 23 21:39:33.832129 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:39:33.832129 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e24ce2d0-28a1-4bec-b1d4-9b125e784e10 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] Returning 404 to user: Instance 7a27e053-473d-4bae-a379-1e11813e71cd could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:39:33.832129 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e24ce2d0-28a1-4bec-b1d4-9b125e784e10 tempest-TestServerMultinode-1683541656 tempest-TestServerMultinode-1683541656-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/7a27e053-473d-4bae-a379-1e11813e71cd" status: 404 len: 111 microversion: 2.1 time: 0.069622 Jul 23 21:39:33.832129 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2604/5214] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:39:33 2022] GET /compute/v2.1/servers/7a27e053-473d-4bae-a379-1e11813e71cd => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 23 21:40:30.955073 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:40:30.955828 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:40:31.129996 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9b192b80-458c-4919-b581-8455ade1b0f3 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Action: 'create', calling method: .version_select at 0x7f0b598bc0d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1075694193", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGMWRdPRSlqIPkMMxqWNG9LDVRTGfJjIZrYQ7avLiB4+6K+jI4jpe9DHtRQaKBChd/94w8NPk/h/9HmgOaFpRm/uZI77czBbnxHQ0Wy3oJfT/lwcrHva4NLdmmHIPJ0/OQ=="}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:40:31.145251 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-9b192b80-458c-4919-b581-8455ade1b0f3 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Getting quotas for project 36bd2862980e45849b0d3fc3f52a6926. Resources: {'key_pairs'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:40:31.150580 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-9b192b80-458c-4919-b581-8455ade1b0f3 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Getting quotas for user 96ade420fd324acfb57e4ac81bfece9e and project 36bd2862980e45849b0d3fc3f52a6926. Resources: {'key_pairs'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:40:31.178700 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9b192b80-458c-4919-b581-8455ade1b0f3 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.228795 Jul 23 21:40:31.179249 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2605/5215] 10.222.0.17 () {60 vars in 1158 bytes} [Sat Jul 23 21:40:30 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:40:37.815032 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8a4afd25-5497-492a-a477-112a4e503b4f tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1093352223", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "networks": [{"uuid": "61afae96-6084-4b81-8cb3-4d25483d7082"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1075694193", "security_groups": [{"name": "tempest-secgroup-smoke-597120400"}]}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:40:37.953081 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-8a4afd25-5497-492a-a477-112a4e503b4f tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] validate_networks() for [('61afae96-6084-4b81-8cb3-4d25483d7082', None, None, None, None, None)] {{(pid=131320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:40:38.489503 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-8a4afd25-5497-492a-a477-112a4e503b4f tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:40:38.490255 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-8a4afd25-5497-492a-a477-112a4e503b4f tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:40:38.490934 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-8a4afd25-5497-492a-a477-112a4e503b4f tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:40:38.491866 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-8a4afd25-5497-492a-a477-112a4e503b4f tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:40:38.492482 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-8a4afd25-5497-492a-a477-112a4e503b4f tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:40:38.502505 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8a4afd25-5497-492a-a477-112a4e503b4f tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:40:38.503320 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8a4afd25-5497-492a-a477-112a4e503b4f tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:40:38.504370 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8a4afd25-5497-492a-a477-112a4e503b4f tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:40:38.504979 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8a4afd25-5497-492a-a477-112a4e503b4f tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:40:38.525365 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-8a4afd25-5497-492a-a477-112a4e503b4f tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Getting quotas for project 36bd2862980e45849b0d3fc3f52a6926. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:40:38.540030 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-8a4afd25-5497-492a-a477-112a4e503b4f tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Getting quotas for user 96ade420fd324acfb57e4ac81bfece9e and project 36bd2862980e45849b0d3fc3f52a6926. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:40:38.555194 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8a4afd25-5497-492a-a477-112a4e503b4f tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Going to run 1 instances... {{(pid=131320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:40:38.558377 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8a4afd25-5497-492a-a477-112a4e503b4f tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: f3a59156-29ac-4bb7-b420-02a1f7d1697f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:40:38.609588 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8a4afd25-5497-492a-a477-112a4e503b4f tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.797963 Jul 23 21:40:38.610298 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2606/5216] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:40:37 2022] POST /compute/v2.1/servers => generated 405 bytes in 801 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 23 21:40:38.620878 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4e85bbbb-91d7-4066-b581-9bcaab2fce11 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:40:38.622172 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-4e85bbbb-91d7-4066-b581-9bcaab2fce11 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: f3a59156-29ac-4bb7-b420-02a1f7d1697f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:40:38.690500 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-4e85bbbb-91d7-4066-b581-9bcaab2fce11 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:40:38.700956 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4e85bbbb-91d7-4066-b581-9bcaab2fce11 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f" status: 200 len: 1267 microversion: 2.1 time: 0.084226 Jul 23 21:40:38.710893 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2607/5217] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:40:38 2022] GET /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f => generated 1267 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:40:39.718807 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-aefa422b-b960-4ddd-bc36-bf04c12ead52 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:40:39.719429 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-aefa422b-b960-4ddd-bc36-bf04c12ead52 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: f3a59156-29ac-4bb7-b420-02a1f7d1697f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:40:39.726844 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-aefa422b-b960-4ddd-bc36-bf04c12ead52 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:40:39.727311 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-aefa422b-b960-4ddd-bc36-bf04c12ead52 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:40:39.728097 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-aefa422b-b960-4ddd-bc36-bf04c12ead52 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:40:39.728546 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-aefa422b-b960-4ddd-bc36-bf04c12ead52 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:40:39.811871 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-aefa422b-b960-4ddd-bc36-bf04c12ead52 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:40:39.830871 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-aefa422b-b960-4ddd-bc36-bf04c12ead52 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f" status: 200 len: 1263 microversion: 2.1 time: 0.115748 Jul 23 21:40:39.831886 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2608/5218] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:40:39 2022] GET /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f => generated 1263 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:40:40.848732 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6a5d2c02-1a1f-4fee-8de2-07e4e32cdc32 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:40:40.850103 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6a5d2c02-1a1f-4fee-8de2-07e4e32cdc32 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: f3a59156-29ac-4bb7-b420-02a1f7d1697f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:40:40.858946 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6a5d2c02-1a1f-4fee-8de2-07e4e32cdc32 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:40:40.859583 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6a5d2c02-1a1f-4fee-8de2-07e4e32cdc32 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:40:40.860552 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6a5d2c02-1a1f-4fee-8de2-07e4e32cdc32 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:40:40.861149 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6a5d2c02-1a1f-4fee-8de2-07e4e32cdc32 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:40:40.956727 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6a5d2c02-1a1f-4fee-8de2-07e4e32cdc32 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:40:40.966056 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6a5d2c02-1a1f-4fee-8de2-07e4e32cdc32 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f" status: 200 len: 1325 microversion: 2.1 time: 0.121109 Jul 23 21:40:40.966883 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2609/5219] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:40:40 2022] GET /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f => generated 1325 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:40:41.990858 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-85d93ec7-0cd2-4ee4-b3f4-389b0169dd53 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:40:41.990858 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-85d93ec7-0cd2-4ee4-b3f4-389b0169dd53 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: f3a59156-29ac-4bb7-b420-02a1f7d1697f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:40:41.992922 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-85d93ec7-0cd2-4ee4-b3f4-389b0169dd53 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:40:41.993382 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-85d93ec7-0cd2-4ee4-b3f4-389b0169dd53 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:40:41.994492 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-85d93ec7-0cd2-4ee4-b3f4-389b0169dd53 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:40:41.994819 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-85d93ec7-0cd2-4ee4-b3f4-389b0169dd53 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:40:42.274274 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-85d93ec7-0cd2-4ee4-b3f4-389b0169dd53 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:40:42.282396 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-85d93ec7-0cd2-4ee4-b3f4-389b0169dd53 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f" status: 200 len: 1392 microversion: 2.1 time: 0.302519 Jul 23 21:40:42.292183 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2610/5220] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:40:41 2022] GET /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f => generated 1392 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:40:42.292183 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-3923a40d-050e-4b07-832f-2059682a8332 req-aebdc495-33f8-4004-866c-4d5d36799a49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3a59156-29ac-4bb7-b420-02a1f7d1697f", "tag": "c23541c7-006d-4bf7-a6c2-e099b0ef8a5f"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:40:42.296229 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-3923a40d-050e-4b07-832f-2059682a8332 req-aebdc495-33f8-4004-866c-4d5d36799a49 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:40:42.296783 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-3923a40d-050e-4b07-832f-2059682a8332 req-aebdc495-33f8-4004-866c-4d5d36799a49 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:40:42.308898 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-3923a40d-050e-4b07-832f-2059682a8332 req-aebdc495-33f8-4004-866c-4d5d36799a49 service nova] Creating event network-changed:c23541c7-006d-4bf7-a6c2-e099b0ef8a5f for instance f3a59156-29ac-4bb7-b420-02a1f7d1697f on nch1-master-1 Jul 23 21:40:42.315058 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-3923a40d-050e-4b07-832f-2059682a8332 req-aebdc495-33f8-4004-866c-4d5d36799a49 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030780 Jul 23 21:40:42.316031 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2611/5221] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:40:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:40:43.305711 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4d02d947-11ad-45e0-91c6-9ae38db4320b tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:40:43.306920 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-4d02d947-11ad-45e0-91c6-9ae38db4320b tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: f3a59156-29ac-4bb7-b420-02a1f7d1697f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:40:43.317757 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4d02d947-11ad-45e0-91c6-9ae38db4320b tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:40:43.318568 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4d02d947-11ad-45e0-91c6-9ae38db4320b tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:40:43.319834 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4d02d947-11ad-45e0-91c6-9ae38db4320b tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:40:43.320281 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4d02d947-11ad-45e0-91c6-9ae38db4320b tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:40:43.476035 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-4d02d947-11ad-45e0-91c6-9ae38db4320b tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:40:43.484198 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4d02d947-11ad-45e0-91c6-9ae38db4320b tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f" status: 200 len: 1392 microversion: 2.1 time: 0.187158 Jul 23 21:40:43.484799 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2612/5222] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:40:43 2022] GET /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f => generated 1392 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:40:44.505777 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d937999e-118a-41aa-a59b-e80aec94d2d3 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:40:44.506834 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d937999e-118a-41aa-a59b-e80aec94d2d3 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: f3a59156-29ac-4bb7-b420-02a1f7d1697f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:40:44.520947 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d937999e-118a-41aa-a59b-e80aec94d2d3 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:40:44.521914 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d937999e-118a-41aa-a59b-e80aec94d2d3 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:40:44.523151 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d937999e-118a-41aa-a59b-e80aec94d2d3 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:40:44.523593 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d937999e-118a-41aa-a59b-e80aec94d2d3 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:40:44.665783 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d937999e-118a-41aa-a59b-e80aec94d2d3 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:40:44.673638 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d937999e-118a-41aa-a59b-e80aec94d2d3 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f" status: 200 len: 1392 microversion: 2.1 time: 0.174482 Jul 23 21:40:44.674228 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2613/5223] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:40:44 2022] GET /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f => generated 1392 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:40:45.695654 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0fdf052c-486c-48e2-853e-4c7e3da992e8 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:40:45.696413 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-0fdf052c-486c-48e2-853e-4c7e3da992e8 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: f3a59156-29ac-4bb7-b420-02a1f7d1697f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:40:45.703576 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0fdf052c-486c-48e2-853e-4c7e3da992e8 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:40:45.704042 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0fdf052c-486c-48e2-853e-4c7e3da992e8 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:40:45.704826 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0fdf052c-486c-48e2-853e-4c7e3da992e8 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:40:45.705260 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0fdf052c-486c-48e2-853e-4c7e3da992e8 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:40:45.848611 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-0fdf052c-486c-48e2-853e-4c7e3da992e8 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:40:45.856574 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-0fdf052c-486c-48e2-853e-4c7e3da992e8 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f" status: 200 len: 1392 microversion: 2.1 time: 0.165099 Jul 23 21:40:45.857165 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2614/5224] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:40:45 2022] GET /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f => generated 1392 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:40:46.872449 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c8b88cdd-172e-4983-88aa-276f90b4e1b2 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:40:46.873331 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c8b88cdd-172e-4983-88aa-276f90b4e1b2 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: f3a59156-29ac-4bb7-b420-02a1f7d1697f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:40:46.881798 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c8b88cdd-172e-4983-88aa-276f90b4e1b2 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:40:46.882683 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c8b88cdd-172e-4983-88aa-276f90b4e1b2 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:40:46.884010 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c8b88cdd-172e-4983-88aa-276f90b4e1b2 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:40:46.884010 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c8b88cdd-172e-4983-88aa-276f90b4e1b2 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:40:47.027286 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c8b88cdd-172e-4983-88aa-276f90b4e1b2 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:40:47.034840 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c8b88cdd-172e-4983-88aa-276f90b4e1b2 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f" status: 200 len: 1392 microversion: 2.1 time: 0.166282 Jul 23 21:40:47.035392 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2615/5225] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:40:46 2022] GET /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f => generated 1392 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:40:47.392763 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-68f2f9c6-88ff-40a7-8d33-4219611eac7c req-8cc4ed14-6018-45dd-beec-392b50b96be7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3a59156-29ac-4bb7-b420-02a1f7d1697f", "name": "network-vif-plugged", "status": "completed", "tag": "c23541c7-006d-4bf7-a6c2-e099b0ef8a5f"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:40:47.402922 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-68f2f9c6-88ff-40a7-8d33-4219611eac7c req-8cc4ed14-6018-45dd-beec-392b50b96be7 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:40:47.403367 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-68f2f9c6-88ff-40a7-8d33-4219611eac7c req-8cc4ed14-6018-45dd-beec-392b50b96be7 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:40:47.415583 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-68f2f9c6-88ff-40a7-8d33-4219611eac7c req-8cc4ed14-6018-45dd-beec-392b50b96be7 service nova] Creating event network-vif-plugged:c23541c7-006d-4bf7-a6c2-e099b0ef8a5f for instance f3a59156-29ac-4bb7-b420-02a1f7d1697f on nch1-master-1 Jul 23 21:40:47.420499 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-68f2f9c6-88ff-40a7-8d33-4219611eac7c req-8cc4ed14-6018-45dd-beec-392b50b96be7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031590 Jul 23 21:40:47.421137 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2616/5226] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:40:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:40:48.053039 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-345431e5-9b37-40b9-990a-74f091df0556 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:40:48.053757 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-345431e5-9b37-40b9-990a-74f091df0556 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: f3a59156-29ac-4bb7-b420-02a1f7d1697f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:40:48.060473 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-345431e5-9b37-40b9-990a-74f091df0556 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:40:48.060927 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-345431e5-9b37-40b9-990a-74f091df0556 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:40:48.061701 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-345431e5-9b37-40b9-990a-74f091df0556 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:40:48.062172 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-345431e5-9b37-40b9-990a-74f091df0556 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:40:48.198312 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-345431e5-9b37-40b9-990a-74f091df0556 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:40:48.206063 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-345431e5-9b37-40b9-990a-74f091df0556 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f" status: 200 len: 1392 microversion: 2.1 time: 0.158242 Jul 23 21:40:48.206636 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2617/5227] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:40:48 2022] GET /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:40:49.225762 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5d201688-6c80-42cb-bcb4-a6ae628b0932 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:40:49.226729 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5d201688-6c80-42cb-bcb4-a6ae628b0932 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: f3a59156-29ac-4bb7-b420-02a1f7d1697f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:40:49.228792 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:40:49.229513 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=12 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:40:49.236565 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5d201688-6c80-42cb-bcb4-a6ae628b0932 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:40:49.237026 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5d201688-6c80-42cb-bcb4-a6ae628b0932 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:40:49.237917 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5d201688-6c80-42cb-bcb4-a6ae628b0932 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:40:49.238383 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5d201688-6c80-42cb-bcb4-a6ae628b0932 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:40:49.373485 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5d201688-6c80-42cb-bcb4-a6ae628b0932 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:40:49.383962 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5d201688-6c80-42cb-bcb4-a6ae628b0932 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f" status: 200 len: 1563 microversion: 2.1 time: 0.163471 Jul 23 21:40:49.384512 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2618/5228] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:40:49 2022] GET /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f => generated 1563 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:40:49.399654 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-39aec0b4-80c1-4749-a4d4-d9c0e1b839df tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:40:49.400290 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-39aec0b4-80c1-4749-a4d4-d9c0e1b839df tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: f3a59156-29ac-4bb7-b420-02a1f7d1697f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:40:49.406271 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-39aec0b4-80c1-4749-a4d4-d9c0e1b839df tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:40:49.406722 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-39aec0b4-80c1-4749-a4d4-d9c0e1b839df tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:40:49.407489 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-39aec0b4-80c1-4749-a4d4-d9c0e1b839df tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:40:49.407930 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-39aec0b4-80c1-4749-a4d4-d9c0e1b839df tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:40:49.550889 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-39aec0b4-80c1-4749-a4d4-d9c0e1b839df tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:40:49.558665 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-39aec0b4-80c1-4749-a4d4-d9c0e1b839df tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f" status: 200 len: 1563 microversion: 2.1 time: 0.162583 Jul 23 21:40:49.559245 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2619/5229] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:40:49 2022] GET /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f => generated 1563 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:40:51.542427 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-00767878-806a-42a1-a5fb-d86f2e588640 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:40:51.544008 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-00767878-806a-42a1-a5fb-d86f2e588640 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: f3a59156-29ac-4bb7-b420-02a1f7d1697f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:40:51.552233 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-00767878-806a-42a1-a5fb-d86f2e588640 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:40:51.553037 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-00767878-806a-42a1-a5fb-d86f2e588640 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:40:51.553908 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-00767878-806a-42a1-a5fb-d86f2e588640 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:40:51.554411 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-00767878-806a-42a1-a5fb-d86f2e588640 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:40:51.784724 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-00767878-806a-42a1-a5fb-d86f2e588640 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:40:51.798782 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-00767878-806a-42a1-a5fb-d86f2e588640 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f" status: 200 len: 1563 microversion: 2.1 time: 0.260722 Jul 23 21:40:51.799558 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2620/5230] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:40:51 2022] GET /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f => generated 1563 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:40:51.978998 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-5179dc31-e1a6-4ded-9def-c8a51191a5fa req-0b95b67b-96d4-4fba-946b-da7bd30679ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3a59156-29ac-4bb7-b420-02a1f7d1697f", "tag": "c23541c7-006d-4bf7-a6c2-e099b0ef8a5f"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:40:51.987073 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-5179dc31-e1a6-4ded-9def-c8a51191a5fa req-0b95b67b-96d4-4fba-946b-da7bd30679ab service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:40:51.987533 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-5179dc31-e1a6-4ded-9def-c8a51191a5fa req-0b95b67b-96d4-4fba-946b-da7bd30679ab service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:40:51.999280 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-5179dc31-e1a6-4ded-9def-c8a51191a5fa req-0b95b67b-96d4-4fba-946b-da7bd30679ab service nova] Creating event network-changed:c23541c7-006d-4bf7-a6c2-e099b0ef8a5f for instance f3a59156-29ac-4bb7-b420-02a1f7d1697f on nch1-master-1 Jul 23 21:40:52.004821 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-5179dc31-e1a6-4ded-9def-c8a51191a5fa req-0b95b67b-96d4-4fba-946b-da7bd30679ab service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.192604 Jul 23 21:40:52.005705 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2621/5231] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:40:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:41:00.650931 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3b4349c4-d68f-4d5b-b85f-b8011b762069 tempest-TestAggregatesBasicOps-348301034 tempest-TestAggregatesBasicOps-348301034-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-346280555", "availability_zone": "foo_zone"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:41:00.668223 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:41:00.668223 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:41:00.669198 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.objects.aggregate [None req-3b4349c4-d68f-4d5b-b85f-b8011b762069 tempest-TestAggregatesBasicOps-348301034 tempest-TestAggregatesBasicOps-348301034-project-admin] Generated uuid bdfcb3af-b1d4-46ca-9961-7b0ef3a6e20a for aggregate {{(pid=131320) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 23 21:41:00.699201 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-3b4349c4-d68f-4d5b-b85f-b8011b762069 tempest-TestAggregatesBasicOps-348301034 tempest-TestAggregatesBasicOps-348301034-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates" status: 200 len: 208 microversion: 2.1 time: 0.168115 Jul 23 21:41:00.700111 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2622/5232] 10.222.0.17 () {60 vars in 1163 bytes} [Sat Jul 23 21:41:00 2022] POST /compute/v2.1/os-aggregates => generated 208 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:41:00.712648 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ba90221f-2f73-4d7c-85c5-32fe1fabe158 tempest-TestAggregatesBasicOps-348301034 tempest-TestAggregatesBasicOps-348301034-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:41:00.714360 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:41:00.714360 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:41:00.742573 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ba90221f-2f73-4d7c-85c5-32fe1fabe158 tempest-TestAggregatesBasicOps-348301034 tempest-TestAggregatesBasicOps-348301034-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 318 microversion: 2.1 time: 0.035759 Jul 23 21:41:00.744224 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2623/5233] 10.222.0.17 () {60 vars in 1193 bytes} [Sat Jul 23 21:41:00 2022] POST /compute/v2.1/os-aggregates/19/action => generated 318 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:41:00.755607 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-246fe477-13f2-4de1-8551-f4c4d3f8bc7d tempest-TestAggregatesBasicOps-348301034 tempest-TestAggregatesBasicOps-348301034-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:41:00.757552 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:41:00.757552 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:41:00.760220 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-246fe477-13f2-4de1-8551-f4c4d3f8bc7d tempest-TestAggregatesBasicOps-348301034 tempest-TestAggregatesBasicOps-348301034-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:41:00.761156 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-246fe477-13f2-4de1-8551-f4c4d3f8bc7d tempest-TestAggregatesBasicOps-348301034 tempest-TestAggregatesBasicOps-348301034-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:41:00.762474 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-246fe477-13f2-4de1-8551-f4c4d3f8bc7d tempest-TestAggregatesBasicOps-348301034 tempest-TestAggregatesBasicOps-348301034-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:41:00.763150 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-246fe477-13f2-4de1-8551-f4c4d3f8bc7d tempest-TestAggregatesBasicOps-348301034 tempest-TestAggregatesBasicOps-348301034-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:41:00.793701 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-246fe477-13f2-4de1-8551-f4c4d3f8bc7d tempest-TestAggregatesBasicOps-348301034 tempest-TestAggregatesBasicOps-348301034-project-admin] 10.222.0.17 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.043078 Jul 23 21:41:00.794273 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2624/5234] 10.222.0.17 () {58 vars in 1175 bytes} [Sat Jul 23 21:41:00 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:41:00.805508 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1c6a2fac-48b1-4425-af39-45b01a10ea21 tempest-TestAggregatesBasicOps-348301034 tempest-TestAggregatesBasicOps-348301034-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:41:00.806397 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:41:00.806397 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:41:00.814307 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1c6a2fac-48b1-4425-af39-45b01a10ea21 tempest-TestAggregatesBasicOps-348301034 tempest-TestAggregatesBasicOps-348301034-project-admin] 10.222.0.17 "GET /compute/v2.1/os-aggregates" status: 200 len: 297 microversion: 2.1 time: 0.013568 Jul 23 21:41:00.815605 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2625/5235] 10.222.0.17 () {58 vars in 1142 bytes} [Sat Jul 23 21:41:00 2022] GET /compute/v2.1/os-aggregates => generated 297 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:41:00.825077 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e755a412-7f24-4a8b-8654-00a793148697 tempest-TestAggregatesBasicOps-348301034 tempest-TestAggregatesBasicOps-348301034-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:41:00.826629 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:41:00.826629 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:41:00.839872 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e755a412-7f24-4a8b-8654-00a793148697 tempest-TestAggregatesBasicOps-348301034 tempest-TestAggregatesBasicOps-348301034-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:41:00.840422 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e755a412-7f24-4a8b-8654-00a793148697 tempest-TestAggregatesBasicOps-348301034 tempest-TestAggregatesBasicOps-348301034-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:41:01.128272 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=8 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:41:01.142541 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e755a412-7f24-4a8b-8654-00a793148697 tempest-TestAggregatesBasicOps-348301034 tempest-TestAggregatesBasicOps-348301034-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 309 microversion: 2.1 time: 0.321043 Jul 23 21:41:01.143336 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2626/5236] 10.222.0.17 () {60 vars in 1193 bytes} [Sat Jul 23 21:41:00 2022] POST /compute/v2.1/os-aggregates/19/action => generated 309 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:41:01.160375 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-27030d4e-ce1b-4956-b399-6e9c7b88af07 tempest-TestAggregatesBasicOps-348301034 tempest-TestAggregatesBasicOps-348301034-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:41:01.161734 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:41:01.161734 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:41:01.173976 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-27030d4e-ce1b-4956-b399-6e9c7b88af07 tempest-TestAggregatesBasicOps-348301034 tempest-TestAggregatesBasicOps-348301034-project-admin] 10.222.0.17 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 309 microversion: 2.1 time: 0.017677 Jul 23 21:41:01.174854 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2627/5237] 10.222.0.17 () {58 vars in 1151 bytes} [Sat Jul 23 21:41:01 2022] GET /compute/v2.1/os-aggregates/19 => generated 309 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:41:01.185525 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b66a7a2c-60d3-4450-865d-80ed9e6e7f12 tempest-TestAggregatesBasicOps-348301034 tempest-TestAggregatesBasicOps-348301034-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-1387921047", "availability_zone": "foo_zone"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:41:01.262863 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:41:01.262863 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:41:01.307534 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b66a7a2c-60d3-4450-865d-80ed9e6e7f12 tempest-TestAggregatesBasicOps-348301034 tempest-TestAggregatesBasicOps-348301034-project-admin] 10.222.0.17 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 342 microversion: 2.1 time: 0.125985 Jul 23 21:41:01.308428 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2628/5238] 10.222.0.17 () {60 vars in 1172 bytes} [Sat Jul 23 21:41:01 2022] PUT /compute/v2.1/os-aggregates/19 => generated 342 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:41:01.320062 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c0f96c0e-3287-4238-a6e5-5e68b91b6a47 tempest-TestAggregatesBasicOps-348301034 tempest-TestAggregatesBasicOps-348301034-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:41:01.321303 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:41:01.321303 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:41:01.348084 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c0f96c0e-3287-4238-a6e5-5e68b91b6a47 tempest-TestAggregatesBasicOps-348301034 tempest-TestAggregatesBasicOps-348301034-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 356 microversion: 2.1 time: 0.031939 Jul 23 21:41:01.348746 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2629/5239] 10.222.0.17 () {60 vars in 1193 bytes} [Sat Jul 23 21:41:01 2022] POST /compute/v2.1/os-aggregates/19/action => generated 356 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:41:01.358796 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2828b3b5-ae71-466a-b6f3-59f06676c602 tempest-TestAggregatesBasicOps-348301034 tempest-TestAggregatesBasicOps-348301034-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:41:01.359491 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:41:01.359491 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:41:01.368182 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2828b3b5-ae71-466a-b6f3-59f06676c602 tempest-TestAggregatesBasicOps-348301034 tempest-TestAggregatesBasicOps-348301034-project-admin] 10.222.0.17 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 356 microversion: 2.1 time: 0.013100 Jul 23 21:41:01.368734 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2630/5240] 10.222.0.17 () {58 vars in 1151 bytes} [Sat Jul 23 21:41:01 2022] GET /compute/v2.1/os-aggregates/19 => generated 356 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:41:01.378143 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-14f4c78f-ce63-4f34-b68a-47acec40378a tempest-TestAggregatesBasicOps-348301034 tempest-TestAggregatesBasicOps-348301034-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:41:01.379384 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:41:01.379384 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:41:01.388893 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-14f4c78f-ce63-4f34-b68a-47acec40378a tempest-TestAggregatesBasicOps-348301034 tempest-TestAggregatesBasicOps-348301034-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:41:01.389331 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-14f4c78f-ce63-4f34-b68a-47acec40378a tempest-TestAggregatesBasicOps-348301034 tempest-TestAggregatesBasicOps-348301034-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:41:01.391226 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=81 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:41:01.507490 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-14f4c78f-ce63-4f34-b68a-47acec40378a tempest-TestAggregatesBasicOps-348301034 tempest-TestAggregatesBasicOps-348301034-project-admin] 10.222.0.17 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.132605 Jul 23 21:41:01.508288 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2631/5241] 10.222.0.17 () {60 vars in 1193 bytes} [Sat Jul 23 21:41:01 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:41:01.517988 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4e1bb512-6fa3-4f02-b566-2e5099e31e92 tempest-TestAggregatesBasicOps-348301034 tempest-TestAggregatesBasicOps-348301034-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:41:01.518737 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 21:41:01.518737 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 21:41:01.544501 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4e1bb512-6fa3-4f02-b566-2e5099e31e92 tempest-TestAggregatesBasicOps-348301034 tempest-TestAggregatesBasicOps-348301034-project-admin] 10.222.0.17 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.029962 Jul 23 21:41:01.545236 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2632/5242] 10.222.0.17 () {58 vars in 1154 bytes} [Sat Jul 23 21:41:01 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 23 21:41:12.253607 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5cde462f-8967-4cd4-bc4c-0bb2db730bed tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:41:12.256111 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5cde462f-8967-4cd4-bc4c-0bb2db730bed tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: f3a59156-29ac-4bb7-b420-02a1f7d1697f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:41:12.259149 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:41:12.260680 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=3 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:41:12.261623 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1,nova_api:INSERT=1,nova_api:DELETE=3 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:41:12.268228 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5cde462f-8967-4cd4-bc4c-0bb2db730bed tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:41:12.268957 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5cde462f-8967-4cd4-bc4c-0bb2db730bed tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:41:12.269998 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5cde462f-8967-4cd4-bc4c-0bb2db730bed tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:41:12.270440 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5cde462f-8967-4cd4-bc4c-0bb2db730bed tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:41:12.340554 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5cde462f-8967-4cd4-bc4c-0bb2db730bed tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "POST /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f/action" status: 200 len: 24570 microversion: 2.1 time: 0.091307 Jul 23 21:41:12.348847 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2633/5243] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:41:12 2022] POST /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f/action => generated 24570 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 23 21:41:23.418671 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-fd733277-afd0-475f-983e-1aa6ce2ee371 tempest-TestNetworkAdvancedServerOps-377287141 tempest-TestNetworkAdvancedServerOps-377287141-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:41:23.420246 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-fd733277-afd0-475f-983e-1aa6ce2ee371 tempest-TestNetworkAdvancedServerOps-377287141 tempest-TestNetworkAdvancedServerOps-377287141-project-admin] [instance: f3a59156-29ac-4bb7-b420-02a1f7d1697f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:41:23.429101 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=4 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:41:23.430365 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:41:23.432592 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fd733277-afd0-475f-983e-1aa6ce2ee371 tempest-TestNetworkAdvancedServerOps-377287141 tempest-TestNetworkAdvancedServerOps-377287141-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:41:23.433851 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fd733277-afd0-475f-983e-1aa6ce2ee371 tempest-TestNetworkAdvancedServerOps-377287141 tempest-TestNetworkAdvancedServerOps-377287141-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:41:23.435109 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fd733277-afd0-475f-983e-1aa6ce2ee371 tempest-TestNetworkAdvancedServerOps-377287141 tempest-TestNetworkAdvancedServerOps-377287141-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:41:23.435968 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fd733277-afd0-475f-983e-1aa6ce2ee371 tempest-TestNetworkAdvancedServerOps-377287141 tempest-TestNetworkAdvancedServerOps-377287141-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:41:23.802193 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-fd733277-afd0-475f-983e-1aa6ce2ee371 tempest-TestNetworkAdvancedServerOps-377287141 tempest-TestNetworkAdvancedServerOps-377287141-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f" status: 200 len: 1833 microversion: 2.1 time: 0.389501 Jul 23 21:41:23.804516 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2634/5244] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:41:23 2022] GET /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f => generated 1833 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:41:23.832433 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8b83751d-d13e-4af4-b998-aba2a034e586 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:41:23.833108 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8b83751d-d13e-4af4-b998-aba2a034e586 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: f3a59156-29ac-4bb7-b420-02a1f7d1697f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:41:23.840608 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8b83751d-d13e-4af4-b998-aba2a034e586 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:41:23.841160 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8b83751d-d13e-4af4-b998-aba2a034e586 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:41:23.842415 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8b83751d-d13e-4af4-b998-aba2a034e586 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:41:23.842862 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8b83751d-d13e-4af4-b998-aba2a034e586 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:41:24.019964 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8b83751d-d13e-4af4-b998-aba2a034e586 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:41:24.031034 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8b83751d-d13e-4af4-b998-aba2a034e586 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f" status: 200 len: 1682 microversion: 2.1 time: 0.203038 Jul 23 21:41:24.031562 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2635/5245] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:41:23 2022] GET /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f => generated 1682 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:41:24.139561 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1cb89381-72c9-4628-a3bc-78a028fdf869 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:41:24.140793 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1cb89381-72c9-4628-a3bc-78a028fdf869 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: f3a59156-29ac-4bb7-b420-02a1f7d1697f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:41:24.148905 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1cb89381-72c9-4628-a3bc-78a028fdf869 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:41:24.149567 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1cb89381-72c9-4628-a3bc-78a028fdf869 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:41:24.151071 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1cb89381-72c9-4628-a3bc-78a028fdf869 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:41:24.151667 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1cb89381-72c9-4628-a3bc-78a028fdf869 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:41:24.222134 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1cb89381-72c9-4628-a3bc-78a028fdf869 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "POST /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f/action" status: 200 len: 32643 microversion: 2.1 time: 0.086548 Jul 23 21:41:24.223521 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2636/5246] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:41:24 2022] POST /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f/action => generated 32643 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 23 21:41:24.426349 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3801b5c8-3e30-4eff-9f4e-368b7543ed2a tempest-TestNetworkAdvancedServerOps-377287141 tempest-TestNetworkAdvancedServerOps-377287141-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:41:24.427174 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-3801b5c8-3e30-4eff-9f4e-368b7543ed2a tempest-TestNetworkAdvancedServerOps-377287141 tempest-TestNetworkAdvancedServerOps-377287141-project-admin] [instance: f3a59156-29ac-4bb7-b420-02a1f7d1697f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:41:24.441303 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3801b5c8-3e30-4eff-9f4e-368b7543ed2a tempest-TestNetworkAdvancedServerOps-377287141 tempest-TestNetworkAdvancedServerOps-377287141-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:41:24.441813 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3801b5c8-3e30-4eff-9f4e-368b7543ed2a tempest-TestNetworkAdvancedServerOps-377287141 tempest-TestNetworkAdvancedServerOps-377287141-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:41:24.442811 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3801b5c8-3e30-4eff-9f4e-368b7543ed2a tempest-TestNetworkAdvancedServerOps-377287141 tempest-TestNetworkAdvancedServerOps-377287141-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:41:24.443401 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3801b5c8-3e30-4eff-9f4e-368b7543ed2a tempest-TestNetworkAdvancedServerOps-377287141 tempest-TestNetworkAdvancedServerOps-377287141-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:41:24.540931 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-3801b5c8-3e30-4eff-9f4e-368b7543ed2a tempest-TestNetworkAdvancedServerOps-377287141 tempest-TestNetworkAdvancedServerOps-377287141-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'b457c730ff32489a8d64d3f92ce95945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86dc934708144527824a9309b2cf068d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:41:24.542029 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-3801b5c8-3e30-4eff-9f4e-368b7543ed2a tempest-TestNetworkAdvancedServerOps-377287141 tempest-TestNetworkAdvancedServerOps-377287141-project-admin] [instance: f3a59156-29ac-4bb7-b420-02a1f7d1697f] flavor_id is None. Assuming migration. {{(pid=131320) resize /opt/stack/nova/nova/compute/api.py:4142}} Jul 23 21:41:24.542546 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-3801b5c8-3e30-4eff-9f4e-368b7543ed2a tempest-TestNetworkAdvancedServerOps-377287141 tempest-TestNetworkAdvancedServerOps-377287141-project-admin] [instance: f3a59156-29ac-4bb7-b420-02a1f7d1697f] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=131320) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 23 21:41:24.889551 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-3801b5c8-3e30-4eff-9f4e-368b7543ed2a tempest-TestNetworkAdvancedServerOps-377287141 tempest-TestNetworkAdvancedServerOps-377287141-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f/action" status: 202 len: 0 microversion: 2.1 time: 0.462105 Jul 23 21:41:24.893344 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2637/5247] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:41:24 2022] POST /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f/action => generated 0 bytes in 470 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:41:24.899319 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9113cea1-64e1-4a79-9728-7c01c4bc5390 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:41:24.900038 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-9113cea1-64e1-4a79-9728-7c01c4bc5390 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: f3a59156-29ac-4bb7-b420-02a1f7d1697f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:41:24.912954 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9113cea1-64e1-4a79-9728-7c01c4bc5390 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:41:24.913811 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9113cea1-64e1-4a79-9728-7c01c4bc5390 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:41:24.915074 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9113cea1-64e1-4a79-9728-7c01c4bc5390 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:41:24.915722 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9113cea1-64e1-4a79-9728-7c01c4bc5390 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:41:25.118004 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-9113cea1-64e1-4a79-9728-7c01c4bc5390 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:41:25.126601 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9113cea1-64e1-4a79-9728-7c01c4bc5390 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f" status: 200 len: 1691 microversion: 2.1 time: 0.231745 Jul 23 21:41:25.127684 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2638/5248] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:41:24 2022] GET /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f => generated 1691 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:41:26.145229 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5977b264-024c-4828-bb8e-223c90deaed0 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:41:26.150110 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5977b264-024c-4828-bb8e-223c90deaed0 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: f3a59156-29ac-4bb7-b420-02a1f7d1697f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:41:26.157197 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5977b264-024c-4828-bb8e-223c90deaed0 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:41:26.160286 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5977b264-024c-4828-bb8e-223c90deaed0 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:41:26.165613 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5977b264-024c-4828-bb8e-223c90deaed0 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:41:26.166483 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5977b264-024c-4828-bb8e-223c90deaed0 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:41:26.316839 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5977b264-024c-4828-bb8e-223c90deaed0 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:41:26.325482 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5977b264-024c-4828-bb8e-223c90deaed0 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f" status: 200 len: 1691 microversion: 2.1 time: 0.184581 Jul 23 21:41:26.326299 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2639/5249] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:41:26 2022] GET /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f => generated 1691 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:41:27.344070 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b3f5f6c2-e8bd-4e52-9df7-4f272bda22b4 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:41:27.344691 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b3f5f6c2-e8bd-4e52-9df7-4f272bda22b4 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: f3a59156-29ac-4bb7-b420-02a1f7d1697f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:41:27.351803 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b3f5f6c2-e8bd-4e52-9df7-4f272bda22b4 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:41:27.352252 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b3f5f6c2-e8bd-4e52-9df7-4f272bda22b4 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:41:27.353036 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b3f5f6c2-e8bd-4e52-9df7-4f272bda22b4 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:41:27.353473 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b3f5f6c2-e8bd-4e52-9df7-4f272bda22b4 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:41:27.566074 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b3f5f6c2-e8bd-4e52-9df7-4f272bda22b4 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:41:27.579694 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b3f5f6c2-e8bd-4e52-9df7-4f272bda22b4 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f" status: 200 len: 1691 microversion: 2.1 time: 0.240201 Jul 23 21:41:27.581035 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2640/5250] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:41:27 2022] GET /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f => generated 1691 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:41:28.600905 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-545f5189-1b28-4864-996a-2f3b26cc7c1e tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:41:28.601612 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-545f5189-1b28-4864-996a-2f3b26cc7c1e tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: f3a59156-29ac-4bb7-b420-02a1f7d1697f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:41:28.612096 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-545f5189-1b28-4864-996a-2f3b26cc7c1e tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:41:28.612533 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-545f5189-1b28-4864-996a-2f3b26cc7c1e tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:41:28.613314 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-545f5189-1b28-4864-996a-2f3b26cc7c1e tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:41:28.613757 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-545f5189-1b28-4864-996a-2f3b26cc7c1e tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:41:28.798141 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-545f5189-1b28-4864-996a-2f3b26cc7c1e tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:41:28.810765 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-545f5189-1b28-4864-996a-2f3b26cc7c1e tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f" status: 200 len: 1696 microversion: 2.1 time: 0.213639 Jul 23 21:41:28.830019 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2641/5251] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:41:28 2022] GET /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f => generated 1696 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:41:29.829181 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-37022d4b-05bc-4602-bb43-feb6c90377c8 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:41:29.829909 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-37022d4b-05bc-4602-bb43-feb6c90377c8 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: f3a59156-29ac-4bb7-b420-02a1f7d1697f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:41:29.839452 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-37022d4b-05bc-4602-bb43-feb6c90377c8 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:41:29.839911 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-37022d4b-05bc-4602-bb43-feb6c90377c8 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:41:29.841250 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-37022d4b-05bc-4602-bb43-feb6c90377c8 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:41:29.841758 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-37022d4b-05bc-4602-bb43-feb6c90377c8 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:41:29.998823 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-37022d4b-05bc-4602-bb43-feb6c90377c8 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:41:30.007524 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-37022d4b-05bc-4602-bb43-feb6c90377c8 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f" status: 200 len: 1696 microversion: 2.1 time: 0.182330 Jul 23 21:41:30.008248 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2642/5252] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:41:29 2022] GET /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f => generated 1696 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:41:31.026706 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-66263919-6ecf-458b-a121-adea7a324743 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:41:31.027370 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-66263919-6ecf-458b-a121-adea7a324743 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: f3a59156-29ac-4bb7-b420-02a1f7d1697f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:41:31.034451 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-66263919-6ecf-458b-a121-adea7a324743 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:41:31.034911 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-66263919-6ecf-458b-a121-adea7a324743 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:41:31.035696 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-66263919-6ecf-458b-a121-adea7a324743 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:41:31.036156 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-66263919-6ecf-458b-a121-adea7a324743 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:41:31.178872 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-66263919-6ecf-458b-a121-adea7a324743 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:41:31.190361 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-66263919-6ecf-458b-a121-adea7a324743 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f" status: 200 len: 1696 microversion: 2.1 time: 0.167250 Jul 23 21:41:31.191121 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2643/5253] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:41:31 2022] GET /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f => generated 1696 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:41:32.211228 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-63cd7bbf-2b3a-4fe3-b557-35e9e00aec37 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:41:32.211977 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-63cd7bbf-2b3a-4fe3-b557-35e9e00aec37 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: f3a59156-29ac-4bb7-b420-02a1f7d1697f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:41:32.221072 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-63cd7bbf-2b3a-4fe3-b557-35e9e00aec37 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:41:32.221643 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-63cd7bbf-2b3a-4fe3-b557-35e9e00aec37 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:41:32.222700 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-63cd7bbf-2b3a-4fe3-b557-35e9e00aec37 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:41:32.223262 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-63cd7bbf-2b3a-4fe3-b557-35e9e00aec37 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:41:32.373727 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-63cd7bbf-2b3a-4fe3-b557-35e9e00aec37 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:41:32.386147 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-63cd7bbf-2b3a-4fe3-b557-35e9e00aec37 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f" status: 200 len: 1696 microversion: 2.1 time: 0.180140 Jul 23 21:41:32.386977 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2644/5254] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:41:32 2022] GET /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f => generated 1696 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:41:33.408415 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a3bd6e5e-e49a-4ddc-970f-f79660da393d tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:41:33.409075 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a3bd6e5e-e49a-4ddc-970f-f79660da393d tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: f3a59156-29ac-4bb7-b420-02a1f7d1697f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:41:33.416377 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a3bd6e5e-e49a-4ddc-970f-f79660da393d tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:41:33.416831 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a3bd6e5e-e49a-4ddc-970f-f79660da393d tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:41:33.417611 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a3bd6e5e-e49a-4ddc-970f-f79660da393d tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:41:33.418123 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a3bd6e5e-e49a-4ddc-970f-f79660da393d tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:41:33.660916 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a3bd6e5e-e49a-4ddc-970f-f79660da393d tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:41:33.669198 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a3bd6e5e-e49a-4ddc-970f-f79660da393d tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f" status: 200 len: 1696 microversion: 2.1 time: 0.264765 Jul 23 21:41:33.669786 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2645/5255] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:41:33 2022] GET /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f => generated 1696 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:41:34.691185 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6ba397a5-1753-4b52-a30d-6b4cc79cda15 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:41:34.692282 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6ba397a5-1753-4b52-a30d-6b4cc79cda15 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: f3a59156-29ac-4bb7-b420-02a1f7d1697f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:41:34.703746 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6ba397a5-1753-4b52-a30d-6b4cc79cda15 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:41:34.704520 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6ba397a5-1753-4b52-a30d-6b4cc79cda15 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:41:34.705802 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6ba397a5-1753-4b52-a30d-6b4cc79cda15 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:41:34.706592 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6ba397a5-1753-4b52-a30d-6b4cc79cda15 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:41:34.843382 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6ba397a5-1753-4b52-a30d-6b4cc79cda15 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:41:34.851161 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6ba397a5-1753-4b52-a30d-6b4cc79cda15 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f" status: 200 len: 1696 microversion: 2.1 time: 0.166724 Jul 23 21:41:34.851863 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2646/5256] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:41:34 2022] GET /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f => generated 1696 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:41:35.868471 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-bc87bd94-c841-4320-84d6-de332cee57e6 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:41:35.869148 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-bc87bd94-c841-4320-84d6-de332cee57e6 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: f3a59156-29ac-4bb7-b420-02a1f7d1697f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:41:35.876418 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bc87bd94-c841-4320-84d6-de332cee57e6 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:41:35.876869 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bc87bd94-c841-4320-84d6-de332cee57e6 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:41:35.877697 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bc87bd94-c841-4320-84d6-de332cee57e6 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:41:35.878273 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bc87bd94-c841-4320-84d6-de332cee57e6 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:41:36.018177 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-bc87bd94-c841-4320-84d6-de332cee57e6 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:41:36.026257 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-bc87bd94-c841-4320-84d6-de332cee57e6 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f" status: 200 len: 1696 microversion: 2.1 time: 0.161743 Jul 23 21:41:36.026838 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2647/5257] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:41:35 2022] GET /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f => generated 1696 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:41:37.045661 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3b605ec3-e209-45a3-9ba5-305f56ed011a tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:41:37.046759 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-3b605ec3-e209-45a3-9ba5-305f56ed011a tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: f3a59156-29ac-4bb7-b420-02a1f7d1697f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:41:37.054537 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3b605ec3-e209-45a3-9ba5-305f56ed011a tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:41:37.054990 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3b605ec3-e209-45a3-9ba5-305f56ed011a tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:41:37.055768 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3b605ec3-e209-45a3-9ba5-305f56ed011a tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:41:37.056215 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3b605ec3-e209-45a3-9ba5-305f56ed011a tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:41:37.196389 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-3b605ec3-e209-45a3-9ba5-305f56ed011a tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:41:37.204546 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-3b605ec3-e209-45a3-9ba5-305f56ed011a tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f" status: 200 len: 1696 microversion: 2.1 time: 0.163732 Jul 23 21:41:37.205103 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2648/5258] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:41:37 2022] GET /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f => generated 1696 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:41:38.226647 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f022be10-7f9d-4e4d-934b-2f0713627be3 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:41:38.227711 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f022be10-7f9d-4e4d-934b-2f0713627be3 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: f3a59156-29ac-4bb7-b420-02a1f7d1697f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:41:38.239322 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f022be10-7f9d-4e4d-934b-2f0713627be3 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:41:38.240020 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f022be10-7f9d-4e4d-934b-2f0713627be3 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:41:38.241301 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f022be10-7f9d-4e4d-934b-2f0713627be3 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:41:38.242066 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f022be10-7f9d-4e4d-934b-2f0713627be3 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:41:38.246470 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:41:38.381133 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f022be10-7f9d-4e4d-934b-2f0713627be3 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:41:38.391435 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f022be10-7f9d-4e4d-934b-2f0713627be3 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f" status: 200 len: 1696 microversion: 2.1 time: 0.171325 Jul 23 21:41:38.392064 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2649/5259] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:41:38 2022] GET /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f => generated 1696 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:41:39.413028 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8e69432f-425f-43f7-978c-af46422cc773 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:41:39.414113 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8e69432f-425f-43f7-978c-af46422cc773 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: f3a59156-29ac-4bb7-b420-02a1f7d1697f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:41:39.422538 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8e69432f-425f-43f7-978c-af46422cc773 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:41:39.422942 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8e69432f-425f-43f7-978c-af46422cc773 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:41:39.423749 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8e69432f-425f-43f7-978c-af46422cc773 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:41:39.424214 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8e69432f-425f-43f7-978c-af46422cc773 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:41:39.563546 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8e69432f-425f-43f7-978c-af46422cc773 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:41:39.571711 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8e69432f-425f-43f7-978c-af46422cc773 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f" status: 200 len: 1696 microversion: 2.1 time: 0.165150 Jul 23 21:41:39.572348 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2650/5260] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:41:39 2022] GET /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f => generated 1696 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:41:40.589373 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-21a7e3c1-1565-4642-9d25-6418a69d6b3f tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:41:40.589979 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-21a7e3c1-1565-4642-9d25-6418a69d6b3f tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: f3a59156-29ac-4bb7-b420-02a1f7d1697f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:41:40.597783 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-21a7e3c1-1565-4642-9d25-6418a69d6b3f tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:41:40.598282 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-21a7e3c1-1565-4642-9d25-6418a69d6b3f tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:41:40.599050 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-21a7e3c1-1565-4642-9d25-6418a69d6b3f tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:41:40.599486 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-21a7e3c1-1565-4642-9d25-6418a69d6b3f tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:41:40.734541 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-21a7e3c1-1565-4642-9d25-6418a69d6b3f tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:41:40.745285 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-21a7e3c1-1565-4642-9d25-6418a69d6b3f tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f" status: 200 len: 1696 microversion: 2.1 time: 0.160097 Jul 23 21:41:40.745843 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2651/5261] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:41:40 2022] GET /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f => generated 1696 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:41:41.764954 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-aa2a7fc2-a097-4cca-bc49-293325e8ecbb tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:41:41.765553 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-aa2a7fc2-a097-4cca-bc49-293325e8ecbb tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: f3a59156-29ac-4bb7-b420-02a1f7d1697f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:41:41.772862 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-aa2a7fc2-a097-4cca-bc49-293325e8ecbb tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:41:41.773336 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-aa2a7fc2-a097-4cca-bc49-293325e8ecbb tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:41:41.774104 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-aa2a7fc2-a097-4cca-bc49-293325e8ecbb tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:41:41.774533 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-aa2a7fc2-a097-4cca-bc49-293325e8ecbb tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:41:41.912696 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-aa2a7fc2-a097-4cca-bc49-293325e8ecbb tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:41:41.920909 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-aa2a7fc2-a097-4cca-bc49-293325e8ecbb tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f" status: 200 len: 1696 microversion: 2.1 time: 0.159861 Jul 23 21:41:41.921514 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2652/5262] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:41:41 2022] GET /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f => generated 1696 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:41:42.938061 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2aae7fae-70af-40c2-a5bb-2a877413f0f2 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:41:42.938710 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-2aae7fae-70af-40c2-a5bb-2a877413f0f2 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: f3a59156-29ac-4bb7-b420-02a1f7d1697f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:41:42.946190 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2aae7fae-70af-40c2-a5bb-2a877413f0f2 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:41:42.946637 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2aae7fae-70af-40c2-a5bb-2a877413f0f2 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:41:42.947518 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2aae7fae-70af-40c2-a5bb-2a877413f0f2 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:41:42.947961 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2aae7fae-70af-40c2-a5bb-2a877413f0f2 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:41:43.088959 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-2aae7fae-70af-40c2-a5bb-2a877413f0f2 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:41:43.096806 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2aae7fae-70af-40c2-a5bb-2a877413f0f2 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f" status: 200 len: 1696 microversion: 2.1 time: 0.162903 Jul 23 21:41:43.097391 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2653/5263] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:41:42 2022] GET /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f => generated 1696 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:41:44.119295 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6fa078ca-df5a-49a2-be2c-eba9bd2e622b tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:41:44.120041 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6fa078ca-df5a-49a2-be2c-eba9bd2e622b tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: f3a59156-29ac-4bb7-b420-02a1f7d1697f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:41:44.128852 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6fa078ca-df5a-49a2-be2c-eba9bd2e622b tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:41:44.129366 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6fa078ca-df5a-49a2-be2c-eba9bd2e622b tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:41:44.130264 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6fa078ca-df5a-49a2-be2c-eba9bd2e622b tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:41:44.130760 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6fa078ca-df5a-49a2-be2c-eba9bd2e622b tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:41:44.270149 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6fa078ca-df5a-49a2-be2c-eba9bd2e622b tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:41:44.278176 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6fa078ca-df5a-49a2-be2c-eba9bd2e622b tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f" status: 200 len: 1696 microversion: 2.1 time: 0.166567 Jul 23 21:41:44.278759 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2654/5264] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:41:44 2022] GET /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f => generated 1696 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:41:45.297474 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-951a4957-1b6f-4b47-8f01-7ae6f55f242f tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:41:45.298309 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-951a4957-1b6f-4b47-8f01-7ae6f55f242f tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: f3a59156-29ac-4bb7-b420-02a1f7d1697f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:41:45.306794 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-951a4957-1b6f-4b47-8f01-7ae6f55f242f tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:41:45.307325 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-951a4957-1b6f-4b47-8f01-7ae6f55f242f tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:41:45.308225 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-951a4957-1b6f-4b47-8f01-7ae6f55f242f tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:41:45.308777 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-951a4957-1b6f-4b47-8f01-7ae6f55f242f tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:41:45.451785 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-951a4957-1b6f-4b47-8f01-7ae6f55f242f tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:41:45.461259 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-951a4957-1b6f-4b47-8f01-7ae6f55f242f tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f" status: 200 len: 1696 microversion: 2.1 time: 0.168496 Jul 23 21:41:45.461967 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2655/5265] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:41:45 2022] GET /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f => generated 1696 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:41:46.483106 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2b9f72ee-b420-4441-ad4d-0b20d8a0b668 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:41:46.484320 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-2b9f72ee-b420-4441-ad4d-0b20d8a0b668 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: f3a59156-29ac-4bb7-b420-02a1f7d1697f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:41:46.495070 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2b9f72ee-b420-4441-ad4d-0b20d8a0b668 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:41:46.495559 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2b9f72ee-b420-4441-ad4d-0b20d8a0b668 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:41:46.496332 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2b9f72ee-b420-4441-ad4d-0b20d8a0b668 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:41:46.496777 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2b9f72ee-b420-4441-ad4d-0b20d8a0b668 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:41:46.634540 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-2b9f72ee-b420-4441-ad4d-0b20d8a0b668 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:41:46.642728 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2b9f72ee-b420-4441-ad4d-0b20d8a0b668 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f" status: 200 len: 1696 microversion: 2.1 time: 0.166414 Jul 23 21:41:46.643337 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2656/5266] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:41:46 2022] GET /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f => generated 1696 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:41:47.665676 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-61b8acdf-dbc9-48cc-9b24-35bda54e5e27 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:41:47.666518 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-61b8acdf-dbc9-48cc-9b24-35bda54e5e27 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: f3a59156-29ac-4bb7-b420-02a1f7d1697f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:41:47.674023 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-61b8acdf-dbc9-48cc-9b24-35bda54e5e27 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:41:47.674475 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-61b8acdf-dbc9-48cc-9b24-35bda54e5e27 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:41:47.675243 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-61b8acdf-dbc9-48cc-9b24-35bda54e5e27 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:41:47.675678 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-61b8acdf-dbc9-48cc-9b24-35bda54e5e27 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:41:47.816195 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-61b8acdf-dbc9-48cc-9b24-35bda54e5e27 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:41:47.823987 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-61b8acdf-dbc9-48cc-9b24-35bda54e5e27 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f" status: 200 len: 1696 microversion: 2.1 time: 0.165029 Jul 23 21:41:47.824797 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2657/5267] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:41:47 2022] GET /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f => generated 1696 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:41:48.842882 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a0bfdf1f-7c2a-458a-b279-747dbc7a30b3 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:41:48.843484 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a0bfdf1f-7c2a-458a-b279-747dbc7a30b3 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: f3a59156-29ac-4bb7-b420-02a1f7d1697f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:41:48.850917 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a0bfdf1f-7c2a-458a-b279-747dbc7a30b3 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:41:48.851365 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a0bfdf1f-7c2a-458a-b279-747dbc7a30b3 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:41:48.852133 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a0bfdf1f-7c2a-458a-b279-747dbc7a30b3 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:41:48.852574 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a0bfdf1f-7c2a-458a-b279-747dbc7a30b3 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:41:48.994183 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a0bfdf1f-7c2a-458a-b279-747dbc7a30b3 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:41:49.005649 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a0bfdf1f-7c2a-458a-b279-747dbc7a30b3 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f" status: 200 len: 1696 microversion: 2.1 time: 0.166850 Jul 23 21:41:49.006379 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2658/5268] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:41:48 2022] GET /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f => generated 1696 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:41:50.023157 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-457587e0-6a1d-43db-b2a1-4c4debf8d11a tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:41:50.023838 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-457587e0-6a1d-43db-b2a1-4c4debf8d11a tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: f3a59156-29ac-4bb7-b420-02a1f7d1697f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:41:50.030531 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-457587e0-6a1d-43db-b2a1-4c4debf8d11a tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:41:50.030983 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-457587e0-6a1d-43db-b2a1-4c4debf8d11a tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:41:50.031758 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-457587e0-6a1d-43db-b2a1-4c4debf8d11a tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:41:50.032201 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-457587e0-6a1d-43db-b2a1-4c4debf8d11a tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:41:50.240411 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-457587e0-6a1d-43db-b2a1-4c4debf8d11a tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:41:50.248403 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-457587e0-6a1d-43db-b2a1-4c4debf8d11a tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f" status: 200 len: 1695 microversion: 2.1 time: 0.229193 Jul 23 21:41:50.249026 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2659/5269] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:41:50 2022] GET /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f => generated 1695 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:41:50.314539 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-eb6ae946-d011-4c02-8665-ba7deb4ae718 req-5b58e352-30e0-4c3b-9059-bff243486e82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3a59156-29ac-4bb7-b420-02a1f7d1697f", "name": "network-vif-unplugged", "status": "completed", "tag": "c23541c7-006d-4bf7-a6c2-e099b0ef8a5f"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:41:50.323503 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-eb6ae946-d011-4c02-8665-ba7deb4ae718 req-5b58e352-30e0-4c3b-9059-bff243486e82 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:41:50.324046 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-eb6ae946-d011-4c02-8665-ba7deb4ae718 req-5b58e352-30e0-4c3b-9059-bff243486e82 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:41:50.337361 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-eb6ae946-d011-4c02-8665-ba7deb4ae718 req-5b58e352-30e0-4c3b-9059-bff243486e82 service nova] Creating event network-vif-unplugged:c23541c7-006d-4bf7-a6c2-e099b0ef8a5f for instance f3a59156-29ac-4bb7-b420-02a1f7d1697f on nch2-master-1 Jul 23 21:41:50.342947 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [req-eb6ae946-d011-4c02-8665-ba7deb4ae718 req-5b58e352-30e0-4c3b-9059-bff243486e82 service nova] Instance f3a59156-29ac-4bb7-b420-02a1f7d1697f is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=131320) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 23 21:41:50.355155 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-eb6ae946-d011-4c02-8665-ba7deb4ae718 req-5b58e352-30e0-4c3b-9059-bff243486e82 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044341 Jul 23 21:41:50.356132 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2660/5270] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:41:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:41:51.266762 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-fc5a2608-9e00-47b5-8672-692119b483e3 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:41:51.267430 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-fc5a2608-9e00-47b5-8672-692119b483e3 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: f3a59156-29ac-4bb7-b420-02a1f7d1697f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:41:51.274729 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fc5a2608-9e00-47b5-8672-692119b483e3 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:41:51.275189 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fc5a2608-9e00-47b5-8672-692119b483e3 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:41:51.275962 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fc5a2608-9e00-47b5-8672-692119b483e3 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:41:51.276396 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fc5a2608-9e00-47b5-8672-692119b483e3 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:41:51.416601 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-fc5a2608-9e00-47b5-8672-692119b483e3 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:41:51.424505 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-fc5a2608-9e00-47b5-8672-692119b483e3 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f" status: 200 len: 1695 microversion: 2.1 time: 0.162123 Jul 23 21:41:51.425177 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2661/5271] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:41:51 2022] GET /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f => generated 1695 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:41:52.371261 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-032662ee-2e03-4efd-b5a0-30e9adec6f7c req-2278e132-81e8-4af5-803a-3baa8c00ee5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3a59156-29ac-4bb7-b420-02a1f7d1697f", "tag": "c23541c7-006d-4bf7-a6c2-e099b0ef8a5f"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:41:52.382873 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-032662ee-2e03-4efd-b5a0-30e9adec6f7c req-2278e132-81e8-4af5-803a-3baa8c00ee5a service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:41:52.383311 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-032662ee-2e03-4efd-b5a0-30e9adec6f7c req-2278e132-81e8-4af5-803a-3baa8c00ee5a service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:41:52.395455 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-032662ee-2e03-4efd-b5a0-30e9adec6f7c req-2278e132-81e8-4af5-803a-3baa8c00ee5a service nova] Creating event network-changed:c23541c7-006d-4bf7-a6c2-e099b0ef8a5f for instance f3a59156-29ac-4bb7-b420-02a1f7d1697f on nch2-master-1 Jul 23 21:41:52.401289 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [req-032662ee-2e03-4efd-b5a0-30e9adec6f7c req-2278e132-81e8-4af5-803a-3baa8c00ee5a service nova] Instance f3a59156-29ac-4bb7-b420-02a1f7d1697f is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=131320) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 23 21:41:52.412661 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-032662ee-2e03-4efd-b5a0-30e9adec6f7c req-2278e132-81e8-4af5-803a-3baa8c00ee5a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045782 Jul 23 21:41:52.413254 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2662/5272] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:41:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:41:52.442079 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-06663436-cc55-44d0-83e6-d270df0bf8d7 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:41:52.442786 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-06663436-cc55-44d0-83e6-d270df0bf8d7 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: f3a59156-29ac-4bb7-b420-02a1f7d1697f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:41:52.449209 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-06663436-cc55-44d0-83e6-d270df0bf8d7 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:41:52.449613 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-06663436-cc55-44d0-83e6-d270df0bf8d7 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:41:52.450413 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-06663436-cc55-44d0-83e6-d270df0bf8d7 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:41:52.450855 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-06663436-cc55-44d0-83e6-d270df0bf8d7 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:41:52.766281 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-06663436-cc55-44d0-83e6-d270df0bf8d7 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:41:52.775540 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-06663436-cc55-44d0-83e6-d270df0bf8d7 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f" status: 200 len: 1693 microversion: 2.1 time: 0.337493 Jul 23 21:41:52.785776 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2663/5273] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:41:52 2022] GET /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f => generated 1693 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:41:53.793210 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-59b08826-1d9b-48b9-9372-f671f8fe9b0a tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:41:53.793949 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-59b08826-1d9b-48b9-9372-f671f8fe9b0a tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: f3a59156-29ac-4bb7-b420-02a1f7d1697f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:41:53.796735 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=63 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:41:53.804723 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-59b08826-1d9b-48b9-9372-f671f8fe9b0a tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:41:53.804723 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-59b08826-1d9b-48b9-9372-f671f8fe9b0a tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:41:53.804996 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-59b08826-1d9b-48b9-9372-f671f8fe9b0a tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:41:53.805269 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-59b08826-1d9b-48b9-9372-f671f8fe9b0a tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:41:53.944974 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-59b08826-1d9b-48b9-9372-f671f8fe9b0a tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:41:53.953438 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-59b08826-1d9b-48b9-9372-f671f8fe9b0a tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f" status: 200 len: 1690 microversion: 2.1 time: 0.164338 Jul 23 21:41:53.954056 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2664/5274] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:41:53 2022] GET /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f => generated 1690 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:41:53.970259 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-68119c07-0224-4eb7-aaf0-84368100ebb5 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:41:53.970765 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-68119c07-0224-4eb7-aaf0-84368100ebb5 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: f3a59156-29ac-4bb7-b420-02a1f7d1697f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:41:53.977208 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-68119c07-0224-4eb7-aaf0-84368100ebb5 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:41:53.977661 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-68119c07-0224-4eb7-aaf0-84368100ebb5 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:41:53.978453 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-68119c07-0224-4eb7-aaf0-84368100ebb5 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:41:53.978891 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-68119c07-0224-4eb7-aaf0-84368100ebb5 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:41:54.017896 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=100 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:41:54.041316 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-68119c07-0224-4eb7-aaf0-84368100ebb5 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "POST /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f/action" status: 204 len: 0 microversion: 2.1 time: 0.074596 Jul 23 21:41:54.041964 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2665/5275] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:41:53 2022] POST /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f/action => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:41:54.050135 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5ba2a068-9d04-4a89-91f1-811ef71ff723 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:41:54.050824 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5ba2a068-9d04-4a89-91f1-811ef71ff723 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: f3a59156-29ac-4bb7-b420-02a1f7d1697f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:41:54.056989 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5ba2a068-9d04-4a89-91f1-811ef71ff723 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:41:54.057433 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5ba2a068-9d04-4a89-91f1-811ef71ff723 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:41:54.058355 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5ba2a068-9d04-4a89-91f1-811ef71ff723 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:41:54.058712 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5ba2a068-9d04-4a89-91f1-811ef71ff723 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:41:54.304480 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5ba2a068-9d04-4a89-91f1-811ef71ff723 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:41:54.312372 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5ba2a068-9d04-4a89-91f1-811ef71ff723 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f" status: 200 len: 1690 microversion: 2.1 time: 0.266071 Jul 23 21:41:54.321090 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2666/5276] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:41:54 2022] GET /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f => generated 1690 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:41:55.330225 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d3b2b0fa-be6d-4e74-a342-acb16982c8d7 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:41:55.330881 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d3b2b0fa-be6d-4e74-a342-acb16982c8d7 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: f3a59156-29ac-4bb7-b420-02a1f7d1697f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:41:55.338426 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d3b2b0fa-be6d-4e74-a342-acb16982c8d7 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:41:55.338889 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d3b2b0fa-be6d-4e74-a342-acb16982c8d7 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:41:55.339651 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d3b2b0fa-be6d-4e74-a342-acb16982c8d7 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:41:55.340179 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d3b2b0fa-be6d-4e74-a342-acb16982c8d7 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:41:55.499763 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d3b2b0fa-be6d-4e74-a342-acb16982c8d7 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:41:55.507682 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d3b2b0fa-be6d-4e74-a342-acb16982c8d7 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f" status: 200 len: 1682 microversion: 2.1 time: 0.181639 Jul 23 21:41:55.508691 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2667/5277] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:41:55 2022] GET /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f => generated 1682 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:41:57.105577 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-3ff2b65a-f033-44d5-879c-36c420624f6c req-7ba57d54-0de8-44b7-b3da-1158f0f7ad34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3a59156-29ac-4bb7-b420-02a1f7d1697f", "name": "network-vif-plugged", "status": "completed", "tag": "c23541c7-006d-4bf7-a6c2-e099b0ef8a5f"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:41:57.115691 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-3ff2b65a-f033-44d5-879c-36c420624f6c req-7ba57d54-0de8-44b7-b3da-1158f0f7ad34 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:41:57.116240 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-3ff2b65a-f033-44d5-879c-36c420624f6c req-7ba57d54-0de8-44b7-b3da-1158f0f7ad34 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:41:57.128516 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-3ff2b65a-f033-44d5-879c-36c420624f6c req-7ba57d54-0de8-44b7-b3da-1158f0f7ad34 service nova] Creating event network-vif-plugged:c23541c7-006d-4bf7-a6c2-e099b0ef8a5f for instance f3a59156-29ac-4bb7-b420-02a1f7d1697f on nch2-master-1 Jul 23 21:41:57.133403 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-3ff2b65a-f033-44d5-879c-36c420624f6c req-7ba57d54-0de8-44b7-b3da-1158f0f7ad34 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031707 Jul 23 21:41:57.134211 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2668/5278] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:41:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:42:17.728193 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=9 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:42:17.729004 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=15,nova_cell1:INSERT=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:42:17.734120 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b34abd6a-19b9-4812-8276-141ad0d5d3fd tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:42:17.735138 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b34abd6a-19b9-4812-8276-141ad0d5d3fd tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: f3a59156-29ac-4bb7-b420-02a1f7d1697f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:42:17.744174 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b34abd6a-19b9-4812-8276-141ad0d5d3fd tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:42:17.744955 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b34abd6a-19b9-4812-8276-141ad0d5d3fd tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:42:17.745730 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b34abd6a-19b9-4812-8276-141ad0d5d3fd tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:42:17.746193 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b34abd6a-19b9-4812-8276-141ad0d5d3fd tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:42:17.798457 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b34abd6a-19b9-4812-8276-141ad0d5d3fd tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "POST /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f/action" status: 200 len: 24574 microversion: 2.1 time: 0.072138 Jul 23 21:42:17.799109 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2669/5279] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:42:17 2022] POST /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f/action => generated 24574 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 23 21:42:24.117009 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6785b4a8-5dda-460e-a960-5fd38a9dc56b tempest-TestNetworkAdvancedServerOps-377287141 tempest-TestNetworkAdvancedServerOps-377287141-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:42:24.117679 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6785b4a8-5dda-460e-a960-5fd38a9dc56b tempest-TestNetworkAdvancedServerOps-377287141 tempest-TestNetworkAdvancedServerOps-377287141-project-admin] [instance: f3a59156-29ac-4bb7-b420-02a1f7d1697f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:42:24.125754 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6785b4a8-5dda-460e-a960-5fd38a9dc56b tempest-TestNetworkAdvancedServerOps-377287141 tempest-TestNetworkAdvancedServerOps-377287141-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:42:24.126250 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6785b4a8-5dda-460e-a960-5fd38a9dc56b tempest-TestNetworkAdvancedServerOps-377287141 tempest-TestNetworkAdvancedServerOps-377287141-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:42:24.127029 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6785b4a8-5dda-460e-a960-5fd38a9dc56b tempest-TestNetworkAdvancedServerOps-377287141 tempest-TestNetworkAdvancedServerOps-377287141-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:42:24.127476 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6785b4a8-5dda-460e-a960-5fd38a9dc56b tempest-TestNetworkAdvancedServerOps-377287141 tempest-TestNetworkAdvancedServerOps-377287141-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:42:24.260698 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6785b4a8-5dda-460e-a960-5fd38a9dc56b tempest-TestNetworkAdvancedServerOps-377287141 tempest-TestNetworkAdvancedServerOps-377287141-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f" status: 200 len: 1833 microversion: 2.1 time: 0.147870 Jul 23 21:42:24.261436 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2670/5280] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:42:24 2022] GET /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f => generated 1833 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:42:25.146203 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2546e28b-c00f-47fd-9b26-cd63791de123 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:42:25.151645 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-2546e28b-c00f-47fd-9b26-cd63791de123 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: f3a59156-29ac-4bb7-b420-02a1f7d1697f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:42:25.162353 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2546e28b-c00f-47fd-9b26-cd63791de123 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:42:25.165897 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2546e28b-c00f-47fd-9b26-cd63791de123 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:42:25.170381 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2546e28b-c00f-47fd-9b26-cd63791de123 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:42:25.170810 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2546e28b-c00f-47fd-9b26-cd63791de123 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:42:25.196773 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-2546e28b-c00f-47fd-9b26-cd63791de123 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: f3a59156-29ac-4bb7-b420-02a1f7d1697f] Going to try to terminate instance {{(pid=131320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:42:25.274543 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2546e28b-c00f-47fd-9b26-cd63791de123 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "DELETE /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f" status: 204 len: 0 microversion: 2.1 time: 0.132025 Jul 23 21:42:25.275143 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2671/5281] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:42:25 2022] DELETE /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:42:25.280437 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-a41f0748-6671-423b-8412-2900d6f9ea78 req-d10ca54e-a514-4572-a53c-93fb11b8ba6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3a59156-29ac-4bb7-b420-02a1f7d1697f", "tag": "c23541c7-006d-4bf7-a6c2-e099b0ef8a5f"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:42:25.288581 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-a41f0748-6671-423b-8412-2900d6f9ea78 req-d10ca54e-a514-4572-a53c-93fb11b8ba6f service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:42:25.289030 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-a41f0748-6671-423b-8412-2900d6f9ea78 req-d10ca54e-a514-4572-a53c-93fb11b8ba6f service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:42:25.300596 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-a41f0748-6671-423b-8412-2900d6f9ea78 req-d10ca54e-a514-4572-a53c-93fb11b8ba6f service nova] Creating event network-changed:c23541c7-006d-4bf7-a6c2-e099b0ef8a5f for instance f3a59156-29ac-4bb7-b420-02a1f7d1697f on nch2-master-1 Jul 23 21:42:25.305466 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-a41f0748-6671-423b-8412-2900d6f9ea78 req-d10ca54e-a514-4572-a53c-93fb11b8ba6f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029052 Jul 23 21:42:25.306090 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2672/5282] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:42:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:42:25.311094 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2ae92742-f8e8-48ba-8d5b-bb448d1d3eae tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:42:25.311783 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-2ae92742-f8e8-48ba-8d5b-bb448d1d3eae tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: f3a59156-29ac-4bb7-b420-02a1f7d1697f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:42:25.318057 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2ae92742-f8e8-48ba-8d5b-bb448d1d3eae tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:42:25.318505 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2ae92742-f8e8-48ba-8d5b-bb448d1d3eae tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:42:25.319272 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2ae92742-f8e8-48ba-8d5b-bb448d1d3eae tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:42:25.319714 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2ae92742-f8e8-48ba-8d5b-bb448d1d3eae tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:42:25.470666 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-2ae92742-f8e8-48ba-8d5b-bb448d1d3eae tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:42:25.479128 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2ae92742-f8e8-48ba-8d5b-bb448d1d3eae tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f" status: 200 len: 1688 microversion: 2.1 time: 0.171860 Jul 23 21:42:25.479736 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2673/5283] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:42:25 2022] GET /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f => generated 1688 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:42:26.497999 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-13968c4d-2243-40f3-98e2-a5ba1d8db100 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:42:26.498723 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-13968c4d-2243-40f3-98e2-a5ba1d8db100 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: f3a59156-29ac-4bb7-b420-02a1f7d1697f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:42:26.505842 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-13968c4d-2243-40f3-98e2-a5ba1d8db100 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:42:26.506341 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-13968c4d-2243-40f3-98e2-a5ba1d8db100 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:42:26.507117 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-13968c4d-2243-40f3-98e2-a5ba1d8db100 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:42:26.507565 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-13968c4d-2243-40f3-98e2-a5ba1d8db100 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:42:26.679065 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-13968c4d-2243-40f3-98e2-a5ba1d8db100 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:42:26.687204 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-13968c4d-2243-40f3-98e2-a5ba1d8db100 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f" status: 200 len: 1688 microversion: 2.1 time: 0.193284 Jul 23 21:42:26.687796 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2674/5284] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:42:26 2022] GET /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f => generated 1688 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:42:27.419160 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-675fd97a-83a9-4870-acbf-0c9b319dfbe7 req-e49ca885-4f82-41b9-b9b1-eab9aea19b17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3a59156-29ac-4bb7-b420-02a1f7d1697f", "name": "network-vif-deleted", "tag": "c23541c7-006d-4bf7-a6c2-e099b0ef8a5f"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:42:27.429927 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-675fd97a-83a9-4870-acbf-0c9b319dfbe7 req-e49ca885-4f82-41b9-b9b1-eab9aea19b17 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:42:27.430708 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-675fd97a-83a9-4870-acbf-0c9b319dfbe7 req-e49ca885-4f82-41b9-b9b1-eab9aea19b17 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:42:27.442895 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-675fd97a-83a9-4870-acbf-0c9b319dfbe7 req-e49ca885-4f82-41b9-b9b1-eab9aea19b17 service nova] Creating event network-vif-deleted:c23541c7-006d-4bf7-a6c2-e099b0ef8a5f for instance f3a59156-29ac-4bb7-b420-02a1f7d1697f on nch2-master-1 Jul 23 21:42:27.448053 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-675fd97a-83a9-4870-acbf-0c9b319dfbe7 req-e49ca885-4f82-41b9-b9b1-eab9aea19b17 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032693 Jul 23 21:42:27.448700 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2675/5285] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:42:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:42:27.706464 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5b32daf9-9799-4d89-81a5-cca02a13034e tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:42:27.707288 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5b32daf9-9799-4d89-81a5-cca02a13034e tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: f3a59156-29ac-4bb7-b420-02a1f7d1697f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:42:27.714223 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5b32daf9-9799-4d89-81a5-cca02a13034e tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:42:27.714636 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5b32daf9-9799-4d89-81a5-cca02a13034e tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:42:27.715471 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5b32daf9-9799-4d89-81a5-cca02a13034e tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:42:27.715942 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5b32daf9-9799-4d89-81a5-cca02a13034e tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:42:27.750271 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5b32daf9-9799-4d89-81a5-cca02a13034e tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:42:27.750745 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5b32daf9-9799-4d89-81a5-cca02a13034e tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:42:27.751197 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.objects.instance [None req-5b32daf9-9799-4d89-81a5-cca02a13034e tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lazy-loading 'fault' on Instance uuid f3a59156-29ac-4bb7-b420-02a1f7d1697f {{(pid=131320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:42:27.798656 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5b32daf9-9799-4d89-81a5-cca02a13034e tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:42:27.808111 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5b32daf9-9799-4d89-81a5-cca02a13034e tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f" status: 200 len: 1357 microversion: 2.1 time: 0.107095 Jul 23 21:42:27.809083 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2676/5286] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:42:27 2022] GET /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f => generated 1357 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:42:28.824967 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9d57e294-820f-4178-9d91-c9903ee8748c tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:42:28.825614 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-9d57e294-820f-4178-9d91-c9903ee8748c tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: f3a59156-29ac-4bb7-b420-02a1f7d1697f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:42:28.833500 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9d57e294-820f-4178-9d91-c9903ee8748c tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:42:28.833990 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9d57e294-820f-4178-9d91-c9903ee8748c tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:42:28.834748 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9d57e294-820f-4178-9d91-c9903ee8748c tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:42:28.835186 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9d57e294-820f-4178-9d91-c9903ee8748c tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:42:28.852603 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-9d57e294-820f-4178-9d91-c9903ee8748c tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] HTTP exception thrown: Instance f3a59156-29ac-4bb7-b420-02a1f7d1697f could not be found. Jul 23 21:42:28.855075 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9d57e294-820f-4178-9d91-c9903ee8748c tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Request method failure captured: Jul 23 21:42:28.855075 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f HTTP/1.1 Jul 23 21:42:28.855075 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:42:28.855075 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:42:28.855075 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:42:28.855075 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:42:28.855075 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:42:28.855075 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:42:28.855075 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:42:28.855075 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:42:28.855075 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GrOSfKcmvIg8CybJuZ211K2BCk2kV9XXJD4t1iLnpDMxE7Pkx25elWArE6eyR4tr0Iwox8ke0DWSoqvidEJT8OIHAfji6eadcJDPEeLIK5RaEi7u5O4vXMbwe3kSZZq8MYGsBh4KdQThoYiwMI-IDxUERCe5nBEmFyUK5SxchL_LMo Jul 23 21:42:28.855075 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:42:28.855075 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:42:28.855075 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:42:28.855075 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:42:28.855075 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:42:28.855075 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:42:28.855075 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 36bd2862980e45849b0d3fc3f52a6926 Jul 23 21:42:28.855075 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1607830774 Jul 23 21:42:28.855075 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:42:28.855075 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:42:28.855075 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/36bd2862980e45849b0d3fc3f52a6926"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/36bd2862980e45849b0d3fc3f52a6926"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_36bd2862980e45849b0d3fc3f52a6926", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/36bd2862980e45849b0d3fc3f52a6926"}]}] Jul 23 21:42:28.855075 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1607830774 Jul 23 21:42:28.855075 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 36bd2862980e45849b0d3fc3f52a6926 Jul 23 21:42:28.855075 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1607830774 Jul 23 21:42:28.855075 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-TestNetworkAdvancedServerOps-1607830774-project Jul 23 21:42:28.855075 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:42:28.855075 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:42:28.855075 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 96ade420fd324acfb57e4ac81bfece9e Jul 23 21:42:28.855075 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1607830774-project Jul 23 21:42:28.855075 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:42:28.855075 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance f3a59156-29ac-4bb7-b420-02a1f7d1697f could not be found. Jul 23 21:42:28.855075 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': 'f3a59156-29ac-4bb7-b420-02a1f7d1697f'} Jul 23 21:42:28.855075 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:42:28.855075 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:42:28.855075 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:42:28.855075 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:42:28.855075 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:42:28.855075 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:42:28.855075 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:42:28.855075 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:42:28.855075 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:42:28.855075 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:42:28.855075 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3a59156-29ac-4bb7-b420-02a1f7d1697f could not be found. Jul 23 21:42:28.855075 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:42:28.855075 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:42:28.855075 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:42:28.855075 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:42:28.855075 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:42:28.855075 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:42:28.855075 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:42:28.855075 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:42:28.855075 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:42:28.855075 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:42:28.855075 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:42:28.855075 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:42:28.855075 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:42:28.855075 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:42:28.855075 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:42:28.855075 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:42:28.855075 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3a59156-29ac-4bb7-b420-02a1f7d1697f could not be found. Jul 23 21:42:28.855075 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:42:28.855075 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:42:28.859478 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:42:28.859478 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:42:28.859478 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:42:28.859478 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:42:28.859478 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:42:28.859478 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:42:28.859478 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3a59156-29ac-4bb7-b420-02a1f7d1697f could not be found. Jul 23 21:42:28.859478 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:42:28.859478 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9d57e294-820f-4178-9d91-c9903ee8748c tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Returning 404 to user: Instance f3a59156-29ac-4bb7-b420-02a1f7d1697f could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:42:28.859478 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9d57e294-820f-4178-9d91-c9903ee8748c tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f" status: 404 len: 111 microversion: 2.1 time: 0.035724 Jul 23 21:42:28.859478 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2677/5287] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:42:28 2022] GET /compute/v2.1/servers/f3a59156-29ac-4bb7-b420-02a1f7d1697f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 23 21:42:32.236039 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f63a19b3-f83d-4fde-932b-ec125424f6be tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '.version_select at 0x7f0b598ad8b0>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:42:32.257304 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f63a19b3-f83d-4fde-932b-ec125424f6be tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1075694193" status: 202 len: 0 microversion: 2.1 time: 0.025275 Jul 23 21:42:32.262163 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2678/5288] 10.222.0.17 () {58 vars in 1283 bytes} [Sat Jul 23 21:42:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1075694193 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:42:32.290744 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-70b4729f-32e2-445a-888d-6bfdcb731b39 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Action: 'create', calling method: .version_select at 0x7f0b5998d4c0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1494844016", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLqK9adOaPov4wNbPg3XPmyxlXIGIp5ycW31Oc//18rv5BM++crS53IU1YH5IkSbAF3wM7u08DeB/GybMNTz2SNFeuBqvZtpcLjADjqfSFnbfFSAEJ9eZdcN+4rtILSGDg=="}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:42:32.307083 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-70b4729f-32e2-445a-888d-6bfdcb731b39 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Getting quotas for project 36bd2862980e45849b0d3fc3f52a6926. Resources: {'key_pairs'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:42:32.312465 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-70b4729f-32e2-445a-888d-6bfdcb731b39 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Getting quotas for user 96ade420fd324acfb57e4ac81bfece9e and project 36bd2862980e45849b0d3fc3f52a6926. Resources: {'key_pairs'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:42:32.340069 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-70b4729f-32e2-445a-888d-6bfdcb731b39 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.053047 Jul 23 21:42:32.340668 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2679/5289] 10.222.0.17 () {60 vars in 1158 bytes} [Sat Jul 23 21:42:32 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:42:38.133911 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-fa9ff792-f4b1-4e4f-8dff-40153fb97a1b tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-212036433", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "networks": [{"uuid": "301e4402-c885-4c7a-b483-8dc671bfaebd"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1494844016", "security_groups": [{"name": "tempest-secgroup-smoke-1089446384"}]}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:42:38.257939 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-fa9ff792-f4b1-4e4f-8dff-40153fb97a1b tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] validate_networks() for [('301e4402-c885-4c7a-b483-8dc671bfaebd', None, None, None, None, None)] {{(pid=131320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:42:38.648346 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-fa9ff792-f4b1-4e4f-8dff-40153fb97a1b tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:42:38.648751 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-fa9ff792-f4b1-4e4f-8dff-40153fb97a1b tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:42:38.649286 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-fa9ff792-f4b1-4e4f-8dff-40153fb97a1b tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:42:38.649658 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-fa9ff792-f4b1-4e4f-8dff-40153fb97a1b tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:42:38.650134 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-fa9ff792-f4b1-4e4f-8dff-40153fb97a1b tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:42:38.659669 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fa9ff792-f4b1-4e4f-8dff-40153fb97a1b tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:42:38.660120 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fa9ff792-f4b1-4e4f-8dff-40153fb97a1b tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:42:38.660915 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fa9ff792-f4b1-4e4f-8dff-40153fb97a1b tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:42:38.661382 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fa9ff792-f4b1-4e4f-8dff-40153fb97a1b tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:42:38.678990 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-fa9ff792-f4b1-4e4f-8dff-40153fb97a1b tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Getting quotas for project 36bd2862980e45849b0d3fc3f52a6926. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:42:38.684193 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-fa9ff792-f4b1-4e4f-8dff-40153fb97a1b tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Getting quotas for user 96ade420fd324acfb57e4ac81bfece9e and project 36bd2862980e45849b0d3fc3f52a6926. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:42:38.696563 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-fa9ff792-f4b1-4e4f-8dff-40153fb97a1b tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Going to run 1 instances... {{(pid=131320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:42:38.699032 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-fa9ff792-f4b1-4e4f-8dff-40153fb97a1b tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 57e82015-7043-4a42-94e5-c1a4901d670d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:42:38.746772 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-fa9ff792-f4b1-4e4f-8dff-40153fb97a1b tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.617969 Jul 23 21:42:38.747714 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2680/5290] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:42:38 2022] POST /compute/v2.1/servers => generated 406 bytes in 619 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 23 21:42:38.758366 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-75f2733b-3256-44de-af84-edcfa0d087ac tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:42:38.758975 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-75f2733b-3256-44de-af84-edcfa0d087ac tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 57e82015-7043-4a42-94e5-c1a4901d670d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:42:38.821827 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-75f2733b-3256-44de-af84-edcfa0d087ac tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:42:38.829385 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-75f2733b-3256-44de-af84-edcfa0d087ac tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/57e82015-7043-4a42-94e5-c1a4901d670d" status: 200 len: 1266 microversion: 2.1 time: 0.075180 Jul 23 21:42:38.842513 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2681/5291] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:42:38 2022] GET /compute/v2.1/servers/57e82015-7043-4a42-94e5-c1a4901d670d => generated 1266 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:42:39.853703 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-caeaa937-92da-412a-bf45-31164d676109 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:42:39.855498 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-caeaa937-92da-412a-bf45-31164d676109 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 57e82015-7043-4a42-94e5-c1a4901d670d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:42:39.866038 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-caeaa937-92da-412a-bf45-31164d676109 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:42:39.866890 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-caeaa937-92da-412a-bf45-31164d676109 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:42:39.867976 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-caeaa937-92da-412a-bf45-31164d676109 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:42:39.869314 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-caeaa937-92da-412a-bf45-31164d676109 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:42:39.954595 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-caeaa937-92da-412a-bf45-31164d676109 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:42:39.963033 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-caeaa937-92da-412a-bf45-31164d676109 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/57e82015-7043-4a42-94e5-c1a4901d670d" status: 200 len: 1324 microversion: 2.1 time: 0.115495 Jul 23 21:42:39.963823 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2682/5292] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:42:39 2022] GET /compute/v2.1/servers/57e82015-7043-4a42-94e5-c1a4901d670d => generated 1324 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:42:40.985174 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-28f7af20-4e67-4a53-8c20-43f990b10322 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:42:40.986653 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-28f7af20-4e67-4a53-8c20-43f990b10322 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 57e82015-7043-4a42-94e5-c1a4901d670d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:42:40.994819 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-28f7af20-4e67-4a53-8c20-43f990b10322 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:42:40.995749 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-28f7af20-4e67-4a53-8c20-43f990b10322 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:42:40.996812 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-28f7af20-4e67-4a53-8c20-43f990b10322 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:42:40.997410 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-28f7af20-4e67-4a53-8c20-43f990b10322 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:42:41.249120 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-28f7af20-4e67-4a53-8c20-43f990b10322 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:42:41.257495 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-28f7af20-4e67-4a53-8c20-43f990b10322 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/57e82015-7043-4a42-94e5-c1a4901d670d" status: 200 len: 1392 microversion: 2.1 time: 0.280288 Jul 23 21:42:41.258340 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2683/5293] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:42:40 2022] GET /compute/v2.1/servers/57e82015-7043-4a42-94e5-c1a4901d670d => generated 1392 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:42:41.361127 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-0f0a654f-c781-45a0-bd78-815e8063083e req-6c4798e2-06b3-4946-8e21-b2b9a2e9d332 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57e82015-7043-4a42-94e5-c1a4901d670d", "tag": "fa742ec9-a90e-4a44-8379-6282a7241878"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:42:41.376051 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-0f0a654f-c781-45a0-bd78-815e8063083e req-6c4798e2-06b3-4946-8e21-b2b9a2e9d332 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:42:41.376612 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-0f0a654f-c781-45a0-bd78-815e8063083e req-6c4798e2-06b3-4946-8e21-b2b9a2e9d332 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:42:41.398478 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-0f0a654f-c781-45a0-bd78-815e8063083e req-6c4798e2-06b3-4946-8e21-b2b9a2e9d332 service nova] Creating event network-changed:fa742ec9-a90e-4a44-8379-6282a7241878 for instance 57e82015-7043-4a42-94e5-c1a4901d670d on nch2-master-1 Jul 23 21:42:41.403529 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-0f0a654f-c781-45a0-bd78-815e8063083e req-6c4798e2-06b3-4946-8e21-b2b9a2e9d332 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046707 Jul 23 21:42:41.404465 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2684/5294] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:42:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:42:42.276656 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3c6ccfd4-63a2-4321-9daa-1ab837fb25bc tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:42:42.277377 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-3c6ccfd4-63a2-4321-9daa-1ab837fb25bc tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 57e82015-7043-4a42-94e5-c1a4901d670d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:42:42.287795 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3c6ccfd4-63a2-4321-9daa-1ab837fb25bc tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:42:42.288555 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3c6ccfd4-63a2-4321-9daa-1ab837fb25bc tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:42:42.289829 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3c6ccfd4-63a2-4321-9daa-1ab837fb25bc tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:42:42.290611 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3c6ccfd4-63a2-4321-9daa-1ab837fb25bc tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:42:42.443349 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-3c6ccfd4-63a2-4321-9daa-1ab837fb25bc tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:42:42.451303 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-3c6ccfd4-63a2-4321-9daa-1ab837fb25bc tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/57e82015-7043-4a42-94e5-c1a4901d670d" status: 200 len: 1392 microversion: 2.1 time: 0.179936 Jul 23 21:42:42.451860 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2685/5295] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:42:42 2022] GET /compute/v2.1/servers/57e82015-7043-4a42-94e5-c1a4901d670d => generated 1392 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:42:43.470747 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-92e7dc3f-f91e-49c5-8d85-96520c68a861 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:42:43.471353 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-92e7dc3f-f91e-49c5-8d85-96520c68a861 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 57e82015-7043-4a42-94e5-c1a4901d670d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:42:43.478821 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-92e7dc3f-f91e-49c5-8d85-96520c68a861 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:42:43.479277 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-92e7dc3f-f91e-49c5-8d85-96520c68a861 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:42:43.480049 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-92e7dc3f-f91e-49c5-8d85-96520c68a861 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:42:43.480491 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-92e7dc3f-f91e-49c5-8d85-96520c68a861 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:42:43.612675 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-92e7dc3f-f91e-49c5-8d85-96520c68a861 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:42:43.620424 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-92e7dc3f-f91e-49c5-8d85-96520c68a861 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/57e82015-7043-4a42-94e5-c1a4901d670d" status: 200 len: 1392 microversion: 2.1 time: 0.154029 Jul 23 21:42:43.621002 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2686/5296] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:42:43 2022] GET /compute/v2.1/servers/57e82015-7043-4a42-94e5-c1a4901d670d => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:42:44.641310 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d0c125ba-fd39-4a7b-b320-67b7765915b3 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:42:44.641991 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d0c125ba-fd39-4a7b-b320-67b7765915b3 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 57e82015-7043-4a42-94e5-c1a4901d670d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:42:44.652284 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d0c125ba-fd39-4a7b-b320-67b7765915b3 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:42:44.653035 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d0c125ba-fd39-4a7b-b320-67b7765915b3 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:42:44.654419 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d0c125ba-fd39-4a7b-b320-67b7765915b3 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:42:44.655126 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d0c125ba-fd39-4a7b-b320-67b7765915b3 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:42:44.795462 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d0c125ba-fd39-4a7b-b320-67b7765915b3 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:42:44.807042 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d0c125ba-fd39-4a7b-b320-67b7765915b3 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/57e82015-7043-4a42-94e5-c1a4901d670d" status: 200 len: 1392 microversion: 2.1 time: 0.171730 Jul 23 21:42:44.807805 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2687/5297] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:42:44 2022] GET /compute/v2.1/servers/57e82015-7043-4a42-94e5-c1a4901d670d => generated 1392 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:42:45.828198 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1f347aa6-ed4a-4f08-a005-d6b29b60c246 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:42:45.828790 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1f347aa6-ed4a-4f08-a005-d6b29b60c246 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 57e82015-7043-4a42-94e5-c1a4901d670d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:42:45.836653 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1f347aa6-ed4a-4f08-a005-d6b29b60c246 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:42:45.837198 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1f347aa6-ed4a-4f08-a005-d6b29b60c246 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:42:45.838048 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1f347aa6-ed4a-4f08-a005-d6b29b60c246 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:42:45.838488 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1f347aa6-ed4a-4f08-a005-d6b29b60c246 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:42:45.978193 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-1f347aa6-ed4a-4f08-a005-d6b29b60c246 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:42:45.985895 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1f347aa6-ed4a-4f08-a005-d6b29b60c246 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/57e82015-7043-4a42-94e5-c1a4901d670d" status: 200 len: 1392 microversion: 2.1 time: 0.163764 Jul 23 21:42:45.986505 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2688/5298] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:42:45 2022] GET /compute/v2.1/servers/57e82015-7043-4a42-94e5-c1a4901d670d => generated 1392 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:42:47.007374 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-14cb1c92-05bb-45af-ba77-df9f8f489a1d tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:42:47.008396 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-14cb1c92-05bb-45af-ba77-df9f8f489a1d tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 57e82015-7043-4a42-94e5-c1a4901d670d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:42:47.020277 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-14cb1c92-05bb-45af-ba77-df9f8f489a1d tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:42:47.021038 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-14cb1c92-05bb-45af-ba77-df9f8f489a1d tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:42:47.022341 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-14cb1c92-05bb-45af-ba77-df9f8f489a1d tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:42:47.023071 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-14cb1c92-05bb-45af-ba77-df9f8f489a1d tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:42:47.162577 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-14cb1c92-05bb-45af-ba77-df9f8f489a1d tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:42:47.169993 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-14cb1c92-05bb-45af-ba77-df9f8f489a1d tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/57e82015-7043-4a42-94e5-c1a4901d670d" status: 200 len: 1392 microversion: 2.1 time: 0.169248 Jul 23 21:42:47.170591 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2689/5299] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:42:46 2022] GET /compute/v2.1/servers/57e82015-7043-4a42-94e5-c1a4901d670d => generated 1392 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:42:47.304421 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-8dfe7ae7-22bc-488f-8500-177728beb9eb req-c22f78f8-57f1-4ead-99fb-e196ce13cf02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57e82015-7043-4a42-94e5-c1a4901d670d", "name": "network-vif-plugged", "status": "completed", "tag": "fa742ec9-a90e-4a44-8379-6282a7241878"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:42:47.313144 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-8dfe7ae7-22bc-488f-8500-177728beb9eb req-c22f78f8-57f1-4ead-99fb-e196ce13cf02 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:42:47.313620 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-8dfe7ae7-22bc-488f-8500-177728beb9eb req-c22f78f8-57f1-4ead-99fb-e196ce13cf02 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:42:47.319187 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:42:47.328948 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-8dfe7ae7-22bc-488f-8500-177728beb9eb req-c22f78f8-57f1-4ead-99fb-e196ce13cf02 service nova] Creating event network-vif-plugged:fa742ec9-a90e-4a44-8379-6282a7241878 for instance 57e82015-7043-4a42-94e5-c1a4901d670d on nch2-master-1 Jul 23 21:42:47.334433 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-8dfe7ae7-22bc-488f-8500-177728beb9eb req-c22f78f8-57f1-4ead-99fb-e196ce13cf02 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033759 Jul 23 21:42:47.335259 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2690/5300] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:42:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:42:48.191998 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c6c19ed1-605c-4f1d-a245-22e3a84ff580 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:42:48.193243 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c6c19ed1-605c-4f1d-a245-22e3a84ff580 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 57e82015-7043-4a42-94e5-c1a4901d670d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:42:48.198239 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:42:48.207466 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c6c19ed1-605c-4f1d-a245-22e3a84ff580 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:42:48.207994 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c6c19ed1-605c-4f1d-a245-22e3a84ff580 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:42:48.208773 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c6c19ed1-605c-4f1d-a245-22e3a84ff580 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:42:48.209213 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c6c19ed1-605c-4f1d-a245-22e3a84ff580 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:42:48.349209 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c6c19ed1-605c-4f1d-a245-22e3a84ff580 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:42:48.360484 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c6c19ed1-605c-4f1d-a245-22e3a84ff580 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/57e82015-7043-4a42-94e5-c1a4901d670d" status: 200 len: 1392 microversion: 2.1 time: 0.175756 Jul 23 21:42:48.361075 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2691/5301] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:42:48 2022] GET /compute/v2.1/servers/57e82015-7043-4a42-94e5-c1a4901d670d => generated 1392 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:42:49.378955 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-baf41206-c112-4d98-84ec-c728e9551a64 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:42:49.379571 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-baf41206-c112-4d98-84ec-c728e9551a64 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 57e82015-7043-4a42-94e5-c1a4901d670d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:42:49.381575 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:42:49.382405 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=12 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:42:49.389657 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-baf41206-c112-4d98-84ec-c728e9551a64 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:42:49.390255 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-baf41206-c112-4d98-84ec-c728e9551a64 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:42:49.391217 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-baf41206-c112-4d98-84ec-c728e9551a64 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:42:49.391703 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-baf41206-c112-4d98-84ec-c728e9551a64 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:42:49.535052 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-baf41206-c112-4d98-84ec-c728e9551a64 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:42:49.542867 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-baf41206-c112-4d98-84ec-c728e9551a64 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/57e82015-7043-4a42-94e5-c1a4901d670d" status: 200 len: 1564 microversion: 2.1 time: 0.169321 Jul 23 21:42:49.543457 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2692/5302] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:42:49 2022] GET /compute/v2.1/servers/57e82015-7043-4a42-94e5-c1a4901d670d => generated 1564 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:42:49.559010 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-810ac2cc-75dc-4b3b-96b5-2b3ada370c50 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:42:49.559612 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-810ac2cc-75dc-4b3b-96b5-2b3ada370c50 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 57e82015-7043-4a42-94e5-c1a4901d670d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:42:49.565916 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-810ac2cc-75dc-4b3b-96b5-2b3ada370c50 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:42:49.566368 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-810ac2cc-75dc-4b3b-96b5-2b3ada370c50 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:42:49.567967 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-810ac2cc-75dc-4b3b-96b5-2b3ada370c50 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:42:49.568440 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-810ac2cc-75dc-4b3b-96b5-2b3ada370c50 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:42:49.702997 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-810ac2cc-75dc-4b3b-96b5-2b3ada370c50 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:42:49.711250 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-810ac2cc-75dc-4b3b-96b5-2b3ada370c50 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/57e82015-7043-4a42-94e5-c1a4901d670d" status: 200 len: 1564 microversion: 2.1 time: 0.155859 Jul 23 21:42:49.711828 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2693/5303] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:42:49 2022] GET /compute/v2.1/servers/57e82015-7043-4a42-94e5-c1a4901d670d => generated 1564 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:42:51.727390 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9f6bdb11-a121-4b2b-8211-6cfb5fb447e3 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:42:51.728092 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-9f6bdb11-a121-4b2b-8211-6cfb5fb447e3 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 57e82015-7043-4a42-94e5-c1a4901d670d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:42:51.734961 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9f6bdb11-a121-4b2b-8211-6cfb5fb447e3 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:42:51.735411 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9f6bdb11-a121-4b2b-8211-6cfb5fb447e3 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:42:51.736187 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9f6bdb11-a121-4b2b-8211-6cfb5fb447e3 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:42:51.736626 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9f6bdb11-a121-4b2b-8211-6cfb5fb447e3 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:42:51.873602 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-9f6bdb11-a121-4b2b-8211-6cfb5fb447e3 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:42:51.881445 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9f6bdb11-a121-4b2b-8211-6cfb5fb447e3 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/57e82015-7043-4a42-94e5-c1a4901d670d" status: 200 len: 1564 microversion: 2.1 time: 0.159426 Jul 23 21:42:51.882059 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2694/5304] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:42:51 2022] GET /compute/v2.1/servers/57e82015-7043-4a42-94e5-c1a4901d670d => generated 1564 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:42:51.886766 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-10cb1a58-274f-4edb-9ac7-cb1e5cd011a8 req-f2af10cd-2608-42c6-97f9-7f1193d17267 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57e82015-7043-4a42-94e5-c1a4901d670d", "tag": "fa742ec9-a90e-4a44-8379-6282a7241878"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:42:51.895018 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-10cb1a58-274f-4edb-9ac7-cb1e5cd011a8 req-f2af10cd-2608-42c6-97f9-7f1193d17267 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:42:51.895463 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-10cb1a58-274f-4edb-9ac7-cb1e5cd011a8 req-f2af10cd-2608-42c6-97f9-7f1193d17267 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:42:51.906767 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-10cb1a58-274f-4edb-9ac7-cb1e5cd011a8 req-f2af10cd-2608-42c6-97f9-7f1193d17267 service nova] Creating event network-changed:fa742ec9-a90e-4a44-8379-6282a7241878 for instance 57e82015-7043-4a42-94e5-c1a4901d670d on nch2-master-1 Jul 23 21:42:51.911831 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-10cb1a58-274f-4edb-9ac7-cb1e5cd011a8 req-f2af10cd-2608-42c6-97f9-7f1193d17267 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028614 Jul 23 21:42:51.912595 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2695/5305] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:42:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:43:13.200028 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=9 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:43:13.200707 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=26 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:43:13.205811 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-afd21ba1-ee53-44fb-97fa-af9fb4cb36d5 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:43:13.206906 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-afd21ba1-ee53-44fb-97fa-af9fb4cb36d5 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 57e82015-7043-4a42-94e5-c1a4901d670d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:43:13.214271 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-afd21ba1-ee53-44fb-97fa-af9fb4cb36d5 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:43:13.214741 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-afd21ba1-ee53-44fb-97fa-af9fb4cb36d5 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:43:13.215548 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-afd21ba1-ee53-44fb-97fa-af9fb4cb36d5 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:43:13.216014 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-afd21ba1-ee53-44fb-97fa-af9fb4cb36d5 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:43:13.273278 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-afd21ba1-ee53-44fb-97fa-af9fb4cb36d5 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "POST /compute/v2.1/servers/57e82015-7043-4a42-94e5-c1a4901d670d/action" status: 200 len: 24566 microversion: 2.1 time: 0.075432 Jul 23 21:43:13.274139 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2696/5306] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:43:13 2022] POST /compute/v2.1/servers/57e82015-7043-4a42-94e5-c1a4901d670d/action => generated 24566 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 23 21:43:24.403076 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-249aedbc-56b7-4ea6-bd55-3761b404b085 tempest-TestNetworkAdvancedServerOps-377287141 tempest-TestNetworkAdvancedServerOps-377287141-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:43:24.404290 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-249aedbc-56b7-4ea6-bd55-3761b404b085 tempest-TestNetworkAdvancedServerOps-377287141 tempest-TestNetworkAdvancedServerOps-377287141-project-admin] [instance: 57e82015-7043-4a42-94e5-c1a4901d670d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:43:24.408935 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:43:24.410072 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=4 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:43:24.417512 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-249aedbc-56b7-4ea6-bd55-3761b404b085 tempest-TestNetworkAdvancedServerOps-377287141 tempest-TestNetworkAdvancedServerOps-377287141-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:43:24.417997 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-249aedbc-56b7-4ea6-bd55-3761b404b085 tempest-TestNetworkAdvancedServerOps-377287141 tempest-TestNetworkAdvancedServerOps-377287141-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:43:24.418776 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-249aedbc-56b7-4ea6-bd55-3761b404b085 tempest-TestNetworkAdvancedServerOps-377287141 tempest-TestNetworkAdvancedServerOps-377287141-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:43:24.419218 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-249aedbc-56b7-4ea6-bd55-3761b404b085 tempest-TestNetworkAdvancedServerOps-377287141 tempest-TestNetworkAdvancedServerOps-377287141-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:43:24.554826 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-249aedbc-56b7-4ea6-bd55-3761b404b085 tempest-TestNetworkAdvancedServerOps-377287141 tempest-TestNetworkAdvancedServerOps-377287141-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/57e82015-7043-4a42-94e5-c1a4901d670d" status: 200 len: 1834 microversion: 2.1 time: 0.158651 Jul 23 21:43:24.555486 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2697/5307] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:43:24 2022] GET /compute/v2.1/servers/57e82015-7043-4a42-94e5-c1a4901d670d => generated 1834 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:43:24.571301 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-69fd78aa-7c6f-4adf-bd71-05e7b67decac tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:43:24.571881 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-69fd78aa-7c6f-4adf-bd71-05e7b67decac tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 57e82015-7043-4a42-94e5-c1a4901d670d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:43:24.578166 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-69fd78aa-7c6f-4adf-bd71-05e7b67decac tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:43:24.579018 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-69fd78aa-7c6f-4adf-bd71-05e7b67decac tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:43:24.579785 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-69fd78aa-7c6f-4adf-bd71-05e7b67decac tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:43:24.580219 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-69fd78aa-7c6f-4adf-bd71-05e7b67decac tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:43:24.718003 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-69fd78aa-7c6f-4adf-bd71-05e7b67decac tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:43:24.729029 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-69fd78aa-7c6f-4adf-bd71-05e7b67decac tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/57e82015-7043-4a42-94e5-c1a4901d670d" status: 200 len: 1683 microversion: 2.1 time: 0.161205 Jul 23 21:43:24.729832 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2698/5308] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:43:24 2022] GET /compute/v2.1/servers/57e82015-7043-4a42-94e5-c1a4901d670d => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:43:24.824062 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c339e6ba-4003-4587-8dba-e1c6df2dfdc7 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:43:24.825015 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c339e6ba-4003-4587-8dba-e1c6df2dfdc7 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 57e82015-7043-4a42-94e5-c1a4901d670d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:43:24.832152 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c339e6ba-4003-4587-8dba-e1c6df2dfdc7 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:43:24.832614 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c339e6ba-4003-4587-8dba-e1c6df2dfdc7 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:43:24.833400 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c339e6ba-4003-4587-8dba-e1c6df2dfdc7 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:43:24.833905 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c339e6ba-4003-4587-8dba-e1c6df2dfdc7 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:43:25.035628 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c339e6ba-4003-4587-8dba-e1c6df2dfdc7 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "POST /compute/v2.1/servers/57e82015-7043-4a42-94e5-c1a4901d670d/action" status: 200 len: 32640 microversion: 2.1 time: 0.214863 Jul 23 21:43:25.036679 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2699/5309] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:43:24 2022] POST /compute/v2.1/servers/57e82015-7043-4a42-94e5-c1a4901d670d/action => generated 32640 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 23 21:43:25.218963 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-94e4d257-0144-4de1-87f8-ae783a414334 tempest-TestNetworkAdvancedServerOps-377287141 tempest-TestNetworkAdvancedServerOps-377287141-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:43:25.219915 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-94e4d257-0144-4de1-87f8-ae783a414334 tempest-TestNetworkAdvancedServerOps-377287141 tempest-TestNetworkAdvancedServerOps-377287141-project-admin] [instance: 57e82015-7043-4a42-94e5-c1a4901d670d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:43:25.228896 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-94e4d257-0144-4de1-87f8-ae783a414334 tempest-TestNetworkAdvancedServerOps-377287141 tempest-TestNetworkAdvancedServerOps-377287141-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:43:25.229341 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-94e4d257-0144-4de1-87f8-ae783a414334 tempest-TestNetworkAdvancedServerOps-377287141 tempest-TestNetworkAdvancedServerOps-377287141-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:43:25.230133 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-94e4d257-0144-4de1-87f8-ae783a414334 tempest-TestNetworkAdvancedServerOps-377287141 tempest-TestNetworkAdvancedServerOps-377287141-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:43:25.230569 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-94e4d257-0144-4de1-87f8-ae783a414334 tempest-TestNetworkAdvancedServerOps-377287141 tempest-TestNetworkAdvancedServerOps-377287141-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:43:25.259677 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-94e4d257-0144-4de1-87f8-ae783a414334 tempest-TestNetworkAdvancedServerOps-377287141 tempest-TestNetworkAdvancedServerOps-377287141-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'b457c730ff32489a8d64d3f92ce95945', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86dc934708144527824a9309b2cf068d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:43:25.260221 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-94e4d257-0144-4de1-87f8-ae783a414334 tempest-TestNetworkAdvancedServerOps-377287141 tempest-TestNetworkAdvancedServerOps-377287141-project-admin] [instance: 57e82015-7043-4a42-94e5-c1a4901d670d] flavor_id is None. Assuming migration. {{(pid=131320) resize /opt/stack/nova/nova/compute/api.py:4142}} Jul 23 21:43:25.260682 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-94e4d257-0144-4de1-87f8-ae783a414334 tempest-TestNetworkAdvancedServerOps-377287141 tempest-TestNetworkAdvancedServerOps-377287141-project-admin] [instance: 57e82015-7043-4a42-94e5-c1a4901d670d] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=131320) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 23 21:43:25.381452 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-94e4d257-0144-4de1-87f8-ae783a414334 tempest-TestNetworkAdvancedServerOps-377287141 tempest-TestNetworkAdvancedServerOps-377287141-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/57e82015-7043-4a42-94e5-c1a4901d670d/action" status: 202 len: 0 microversion: 2.1 time: 0.169365 Jul 23 21:43:25.382161 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2700/5310] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:43:25 2022] POST /compute/v2.1/servers/57e82015-7043-4a42-94e5-c1a4901d670d/action => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:43:25.390257 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-94fd9d8f-2d80-444b-8639-951ab4ce2461 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:43:25.390871 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-94fd9d8f-2d80-444b-8639-951ab4ce2461 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 57e82015-7043-4a42-94e5-c1a4901d670d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:43:25.397236 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-94fd9d8f-2d80-444b-8639-951ab4ce2461 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:43:25.397680 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-94fd9d8f-2d80-444b-8639-951ab4ce2461 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:43:25.398488 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-94fd9d8f-2d80-444b-8639-951ab4ce2461 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:43:25.398926 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-94fd9d8f-2d80-444b-8639-951ab4ce2461 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:43:25.542813 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-94fd9d8f-2d80-444b-8639-951ab4ce2461 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:43:25.550695 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-94fd9d8f-2d80-444b-8639-951ab4ce2461 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/57e82015-7043-4a42-94e5-c1a4901d670d" status: 200 len: 1692 microversion: 2.1 time: 0.164139 Jul 23 21:43:25.551261 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2701/5311] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:43:25 2022] GET /compute/v2.1/servers/57e82015-7043-4a42-94e5-c1a4901d670d => generated 1692 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:43:26.568939 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-079773b3-d093-4ed7-8781-3033180cf93d tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:43:26.569695 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-079773b3-d093-4ed7-8781-3033180cf93d tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 57e82015-7043-4a42-94e5-c1a4901d670d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:43:26.577006 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-079773b3-d093-4ed7-8781-3033180cf93d tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:43:26.577493 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-079773b3-d093-4ed7-8781-3033180cf93d tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:43:26.578307 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-079773b3-d093-4ed7-8781-3033180cf93d tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:43:26.579115 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-079773b3-d093-4ed7-8781-3033180cf93d tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:43:26.715992 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-079773b3-d093-4ed7-8781-3033180cf93d tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:43:26.724753 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-079773b3-d093-4ed7-8781-3033180cf93d tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/57e82015-7043-4a42-94e5-c1a4901d670d" status: 200 len: 1692 microversion: 2.1 time: 0.159901 Jul 23 21:43:26.725331 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2702/5312] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:43:26 2022] GET /compute/v2.1/servers/57e82015-7043-4a42-94e5-c1a4901d670d => generated 1692 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:43:27.744716 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-65adb763-3b7b-49ea-9211-c523a699ef30 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:43:27.745330 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-65adb763-3b7b-49ea-9211-c523a699ef30 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 57e82015-7043-4a42-94e5-c1a4901d670d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:43:27.752643 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-65adb763-3b7b-49ea-9211-c523a699ef30 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:43:27.753237 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-65adb763-3b7b-49ea-9211-c523a699ef30 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:43:27.753844 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-65adb763-3b7b-49ea-9211-c523a699ef30 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:43:27.754313 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-65adb763-3b7b-49ea-9211-c523a699ef30 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:43:27.891999 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-65adb763-3b7b-49ea-9211-c523a699ef30 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:43:27.899961 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-65adb763-3b7b-49ea-9211-c523a699ef30 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/57e82015-7043-4a42-94e5-c1a4901d670d" status: 200 len: 1697 microversion: 2.1 time: 0.160441 Jul 23 21:43:27.900516 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2703/5313] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:43:27 2022] GET /compute/v2.1/servers/57e82015-7043-4a42-94e5-c1a4901d670d => generated 1697 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:43:28.921274 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0adf33d3-9309-4ae8-9e3d-db7f40c7d14e tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:43:28.922393 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-0adf33d3-9309-4ae8-9e3d-db7f40c7d14e tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 57e82015-7043-4a42-94e5-c1a4901d670d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:43:28.934546 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0adf33d3-9309-4ae8-9e3d-db7f40c7d14e tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:43:28.935301 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0adf33d3-9309-4ae8-9e3d-db7f40c7d14e tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:43:28.936573 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0adf33d3-9309-4ae8-9e3d-db7f40c7d14e tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:43:28.937305 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0adf33d3-9309-4ae8-9e3d-db7f40c7d14e tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:43:29.089632 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-0adf33d3-9309-4ae8-9e3d-db7f40c7d14e tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:43:29.097782 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-0adf33d3-9309-4ae8-9e3d-db7f40c7d14e tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/57e82015-7043-4a42-94e5-c1a4901d670d" status: 200 len: 1697 microversion: 2.1 time: 0.183065 Jul 23 21:43:29.098523 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2704/5314] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:43:28 2022] GET /compute/v2.1/servers/57e82015-7043-4a42-94e5-c1a4901d670d => generated 1697 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:43:30.119581 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5861ccd9-8c65-497e-a90e-1a3c5281365b tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:43:30.120389 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5861ccd9-8c65-497e-a90e-1a3c5281365b tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 57e82015-7043-4a42-94e5-c1a4901d670d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:43:30.129423 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5861ccd9-8c65-497e-a90e-1a3c5281365b tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:43:30.130011 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5861ccd9-8c65-497e-a90e-1a3c5281365b tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:43:30.130996 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5861ccd9-8c65-497e-a90e-1a3c5281365b tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:43:30.131544 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5861ccd9-8c65-497e-a90e-1a3c5281365b tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:43:30.292647 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5861ccd9-8c65-497e-a90e-1a3c5281365b tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:43:30.302450 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5861ccd9-8c65-497e-a90e-1a3c5281365b tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/57e82015-7043-4a42-94e5-c1a4901d670d" status: 200 len: 1697 microversion: 2.1 time: 0.188423 Jul 23 21:43:30.303264 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2705/5315] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:43:30 2022] GET /compute/v2.1/servers/57e82015-7043-4a42-94e5-c1a4901d670d => generated 1697 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:43:31.329100 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-65d9651c-0950-4cbe-9938-89a5cd33250c tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:43:31.330285 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-65d9651c-0950-4cbe-9938-89a5cd33250c tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 57e82015-7043-4a42-94e5-c1a4901d670d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:43:31.339677 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-65d9651c-0950-4cbe-9938-89a5cd33250c tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:43:31.340128 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-65d9651c-0950-4cbe-9938-89a5cd33250c tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:43:31.340898 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-65d9651c-0950-4cbe-9938-89a5cd33250c tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:43:31.341335 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-65d9651c-0950-4cbe-9938-89a5cd33250c tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:43:31.674534 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-65d9651c-0950-4cbe-9938-89a5cd33250c tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:43:31.685012 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-65d9651c-0950-4cbe-9938-89a5cd33250c tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/57e82015-7043-4a42-94e5-c1a4901d670d" status: 200 len: 1697 microversion: 2.1 time: 0.362798 Jul 23 21:43:31.685598 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2706/5316] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:43:31 2022] GET /compute/v2.1/servers/57e82015-7043-4a42-94e5-c1a4901d670d => generated 1697 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:43:32.707105 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a9049267-6935-4131-8fab-0e1f01ee0cad tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:43:32.708243 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a9049267-6935-4131-8fab-0e1f01ee0cad tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 57e82015-7043-4a42-94e5-c1a4901d670d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:43:32.719789 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a9049267-6935-4131-8fab-0e1f01ee0cad tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:43:32.720534 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a9049267-6935-4131-8fab-0e1f01ee0cad tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:43:32.721796 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a9049267-6935-4131-8fab-0e1f01ee0cad tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:43:32.722573 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a9049267-6935-4131-8fab-0e1f01ee0cad tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:43:32.853878 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a9049267-6935-4131-8fab-0e1f01ee0cad tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:43:32.861695 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a9049267-6935-4131-8fab-0e1f01ee0cad tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/57e82015-7043-4a42-94e5-c1a4901d670d" status: 200 len: 1697 microversion: 2.1 time: 0.161618 Jul 23 21:43:32.862303 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2707/5317] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:43:32 2022] GET /compute/v2.1/servers/57e82015-7043-4a42-94e5-c1a4901d670d => generated 1697 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:43:33.879147 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f4c2fbeb-77c4-47b3-b539-9b99b0193c8c tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:43:33.879867 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f4c2fbeb-77c4-47b3-b539-9b99b0193c8c tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 57e82015-7043-4a42-94e5-c1a4901d670d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:43:33.887201 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f4c2fbeb-77c4-47b3-b539-9b99b0193c8c tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:43:33.887653 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f4c2fbeb-77c4-47b3-b539-9b99b0193c8c tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:43:33.888423 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f4c2fbeb-77c4-47b3-b539-9b99b0193c8c tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:43:33.888856 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f4c2fbeb-77c4-47b3-b539-9b99b0193c8c tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:43:34.119629 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f4c2fbeb-77c4-47b3-b539-9b99b0193c8c tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:43:34.127560 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f4c2fbeb-77c4-47b3-b539-9b99b0193c8c tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/57e82015-7043-4a42-94e5-c1a4901d670d" status: 200 len: 1697 microversion: 2.1 time: 0.252308 Jul 23 21:43:34.128153 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2708/5318] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:43:33 2022] GET /compute/v2.1/servers/57e82015-7043-4a42-94e5-c1a4901d670d => generated 1697 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:43:35.147524 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-fe951819-207e-4aef-baa7-c458c43f72aa tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:43:35.148196 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-fe951819-207e-4aef-baa7-c458c43f72aa tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 57e82015-7043-4a42-94e5-c1a4901d670d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:43:35.155514 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fe951819-207e-4aef-baa7-c458c43f72aa tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:43:35.155966 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fe951819-207e-4aef-baa7-c458c43f72aa tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:43:35.156742 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fe951819-207e-4aef-baa7-c458c43f72aa tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:43:35.157173 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fe951819-207e-4aef-baa7-c458c43f72aa tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:43:35.290796 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-fe951819-207e-4aef-baa7-c458c43f72aa tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:43:35.298703 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-fe951819-207e-4aef-baa7-c458c43f72aa tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/57e82015-7043-4a42-94e5-c1a4901d670d" status: 200 len: 1697 microversion: 2.1 time: 0.157969 Jul 23 21:43:35.299255 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2709/5319] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:43:35 2022] GET /compute/v2.1/servers/57e82015-7043-4a42-94e5-c1a4901d670d => generated 1697 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:43:36.318654 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-194bdbbc-fd53-4f74-9272-61b4b0aa5c54 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:43:36.319657 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-194bdbbc-fd53-4f74-9272-61b4b0aa5c54 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 57e82015-7043-4a42-94e5-c1a4901d670d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:43:36.328642 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-194bdbbc-fd53-4f74-9272-61b4b0aa5c54 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:43:36.329093 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-194bdbbc-fd53-4f74-9272-61b4b0aa5c54 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:43:36.329883 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-194bdbbc-fd53-4f74-9272-61b4b0aa5c54 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:43:36.330330 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-194bdbbc-fd53-4f74-9272-61b4b0aa5c54 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:43:36.475159 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-194bdbbc-fd53-4f74-9272-61b4b0aa5c54 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:43:36.483396 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-194bdbbc-fd53-4f74-9272-61b4b0aa5c54 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/57e82015-7043-4a42-94e5-c1a4901d670d" status: 200 len: 1697 microversion: 2.1 time: 0.170844 Jul 23 21:43:36.483985 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2710/5320] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:43:36 2022] GET /compute/v2.1/servers/57e82015-7043-4a42-94e5-c1a4901d670d => generated 1697 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:43:37.504856 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0de4aa26-507e-4344-8e0c-1ba145fd2a60 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:43:37.506192 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-0de4aa26-507e-4344-8e0c-1ba145fd2a60 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 57e82015-7043-4a42-94e5-c1a4901d670d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:43:37.517735 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0de4aa26-507e-4344-8e0c-1ba145fd2a60 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:43:37.518546 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0de4aa26-507e-4344-8e0c-1ba145fd2a60 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:43:37.519829 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0de4aa26-507e-4344-8e0c-1ba145fd2a60 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:43:37.520658 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0de4aa26-507e-4344-8e0c-1ba145fd2a60 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:43:37.658434 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-0de4aa26-507e-4344-8e0c-1ba145fd2a60 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:43:37.666483 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-0de4aa26-507e-4344-8e0c-1ba145fd2a60 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/57e82015-7043-4a42-94e5-c1a4901d670d" status: 200 len: 1697 microversion: 2.1 time: 0.168314 Jul 23 21:43:37.667378 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2711/5321] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:43:37 2022] GET /compute/v2.1/servers/57e82015-7043-4a42-94e5-c1a4901d670d => generated 1697 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:43:38.692182 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f950fb01-22f0-4ab8-b37e-bbf75e3bc130 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:43:38.693214 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f950fb01-22f0-4ab8-b37e-bbf75e3bc130 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 57e82015-7043-4a42-94e5-c1a4901d670d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:43:38.705041 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f950fb01-22f0-4ab8-b37e-bbf75e3bc130 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:43:38.705807 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f950fb01-22f0-4ab8-b37e-bbf75e3bc130 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:43:38.707123 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f950fb01-22f0-4ab8-b37e-bbf75e3bc130 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:43:38.707860 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f950fb01-22f0-4ab8-b37e-bbf75e3bc130 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:43:38.714704 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:43:38.847017 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f950fb01-22f0-4ab8-b37e-bbf75e3bc130 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:43:38.855348 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f950fb01-22f0-4ab8-b37e-bbf75e3bc130 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/57e82015-7043-4a42-94e5-c1a4901d670d" status: 200 len: 1697 microversion: 2.1 time: 0.170154 Jul 23 21:43:38.855925 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2712/5322] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:43:38 2022] GET /compute/v2.1/servers/57e82015-7043-4a42-94e5-c1a4901d670d => generated 1697 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:43:39.872899 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c3102be1-4902-4d2c-b995-b7a3e46db3ba tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:43:39.873546 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c3102be1-4902-4d2c-b995-b7a3e46db3ba tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 57e82015-7043-4a42-94e5-c1a4901d670d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:43:39.880896 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c3102be1-4902-4d2c-b995-b7a3e46db3ba tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:43:39.881348 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c3102be1-4902-4d2c-b995-b7a3e46db3ba tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:43:39.882180 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c3102be1-4902-4d2c-b995-b7a3e46db3ba tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:43:39.882620 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c3102be1-4902-4d2c-b995-b7a3e46db3ba tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:43:40.021342 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c3102be1-4902-4d2c-b995-b7a3e46db3ba tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:43:40.029032 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c3102be1-4902-4d2c-b995-b7a3e46db3ba tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/57e82015-7043-4a42-94e5-c1a4901d670d" status: 200 len: 1697 microversion: 2.1 time: 0.160122 Jul 23 21:43:40.029627 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2713/5323] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:43:39 2022] GET /compute/v2.1/servers/57e82015-7043-4a42-94e5-c1a4901d670d => generated 1697 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:43:41.050934 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-96468634-767a-4038-b1cd-4273099dd6fe tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:43:41.052084 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-96468634-767a-4038-b1cd-4273099dd6fe tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 57e82015-7043-4a42-94e5-c1a4901d670d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:43:41.062221 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-96468634-767a-4038-b1cd-4273099dd6fe tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:43:41.062746 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-96468634-767a-4038-b1cd-4273099dd6fe tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:43:41.063463 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-96468634-767a-4038-b1cd-4273099dd6fe tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:43:41.063912 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-96468634-767a-4038-b1cd-4273099dd6fe tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:43:41.197328 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-96468634-767a-4038-b1cd-4273099dd6fe tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:43:41.205670 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-96468634-767a-4038-b1cd-4273099dd6fe tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/57e82015-7043-4a42-94e5-c1a4901d670d" status: 200 len: 1697 microversion: 2.1 time: 0.161736 Jul 23 21:43:41.206260 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2714/5324] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:43:41 2022] GET /compute/v2.1/servers/57e82015-7043-4a42-94e5-c1a4901d670d => generated 1697 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:43:42.230939 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e764267a-eed4-4540-b2a5-e3ab90de8f4a tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:43:42.231809 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e764267a-eed4-4540-b2a5-e3ab90de8f4a tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 57e82015-7043-4a42-94e5-c1a4901d670d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:43:42.239275 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e764267a-eed4-4540-b2a5-e3ab90de8f4a tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:43:42.239740 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e764267a-eed4-4540-b2a5-e3ab90de8f4a tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:43:42.240521 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e764267a-eed4-4540-b2a5-e3ab90de8f4a tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:43:42.240967 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e764267a-eed4-4540-b2a5-e3ab90de8f4a tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:43:42.382175 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e764267a-eed4-4540-b2a5-e3ab90de8f4a tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:43:42.393674 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e764267a-eed4-4540-b2a5-e3ab90de8f4a tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/57e82015-7043-4a42-94e5-c1a4901d670d" status: 200 len: 1697 microversion: 2.1 time: 0.169490 Jul 23 21:43:42.394689 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2715/5325] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:43:42 2022] GET /compute/v2.1/servers/57e82015-7043-4a42-94e5-c1a4901d670d => generated 1697 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:43:43.415310 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-00e487a0-defe-4b37-9893-5a12045cee37 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:43:43.415986 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-00e487a0-defe-4b37-9893-5a12045cee37 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 57e82015-7043-4a42-94e5-c1a4901d670d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:43:43.424438 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-00e487a0-defe-4b37-9893-5a12045cee37 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:43:43.425153 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-00e487a0-defe-4b37-9893-5a12045cee37 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:43:43.426802 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-00e487a0-defe-4b37-9893-5a12045cee37 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:43:43.427450 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-00e487a0-defe-4b37-9893-5a12045cee37 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:43:43.567855 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-00e487a0-defe-4b37-9893-5a12045cee37 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:43:43.575640 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-00e487a0-defe-4b37-9893-5a12045cee37 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/57e82015-7043-4a42-94e5-c1a4901d670d" status: 200 len: 1697 microversion: 2.1 time: 0.164936 Jul 23 21:43:43.576233 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2716/5326] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:43:43 2022] GET /compute/v2.1/servers/57e82015-7043-4a42-94e5-c1a4901d670d => generated 1697 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:43:44.593324 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e94a6035-1ae4-487f-9ada-f37df93906dd tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:43:44.593964 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e94a6035-1ae4-487f-9ada-f37df93906dd tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 57e82015-7043-4a42-94e5-c1a4901d670d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:43:44.601207 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e94a6035-1ae4-487f-9ada-f37df93906dd tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:43:44.601775 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e94a6035-1ae4-487f-9ada-f37df93906dd tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:43:44.602624 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e94a6035-1ae4-487f-9ada-f37df93906dd tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:43:44.603100 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e94a6035-1ae4-487f-9ada-f37df93906dd tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:43:45.207918 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e94a6035-1ae4-487f-9ada-f37df93906dd tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:43:45.216351 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e94a6035-1ae4-487f-9ada-f37df93906dd tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/57e82015-7043-4a42-94e5-c1a4901d670d" status: 200 len: 1696 microversion: 2.1 time: 0.626873 Jul 23 21:43:45.216879 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2717/5327] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:43:44 2022] GET /compute/v2.1/servers/57e82015-7043-4a42-94e5-c1a4901d670d => generated 1696 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:43:45.221429 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-21eecc24-06e3-4080-b262-dc9bc114a445 req-42777aa5-1b51-44ba-b9f2-42f665d13f7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57e82015-7043-4a42-94e5-c1a4901d670d", "name": "network-vif-unplugged", "status": "completed", "tag": "fa742ec9-a90e-4a44-8379-6282a7241878"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:43:45.232068 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-21eecc24-06e3-4080-b262-dc9bc114a445 req-42777aa5-1b51-44ba-b9f2-42f665d13f7e service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:43:45.232512 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-21eecc24-06e3-4080-b262-dc9bc114a445 req-42777aa5-1b51-44ba-b9f2-42f665d13f7e service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:43:45.244839 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-21eecc24-06e3-4080-b262-dc9bc114a445 req-42777aa5-1b51-44ba-b9f2-42f665d13f7e service nova] Creating event network-vif-unplugged:fa742ec9-a90e-4a44-8379-6282a7241878 for instance 57e82015-7043-4a42-94e5-c1a4901d670d on nch1-master-1 Jul 23 21:43:45.250696 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [req-21eecc24-06e3-4080-b262-dc9bc114a445 req-42777aa5-1b51-44ba-b9f2-42f665d13f7e service nova] Instance 57e82015-7043-4a42-94e5-c1a4901d670d is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=131320) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 23 21:43:45.261580 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-21eecc24-06e3-4080-b262-dc9bc114a445 req-42777aa5-1b51-44ba-b9f2-42f665d13f7e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043540 Jul 23 21:43:45.262277 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2718/5328] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:43:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:43:46.239551 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-180bb355-b791-4708-b3c6-6d576d2e7a3a tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:43:46.240631 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-180bb355-b791-4708-b3c6-6d576d2e7a3a tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 57e82015-7043-4a42-94e5-c1a4901d670d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:43:46.250477 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-180bb355-b791-4708-b3c6-6d576d2e7a3a tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:43:46.251121 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-180bb355-b791-4708-b3c6-6d576d2e7a3a tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:43:46.251894 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-180bb355-b791-4708-b3c6-6d576d2e7a3a tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:43:46.252328 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-180bb355-b791-4708-b3c6-6d576d2e7a3a tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:43:46.392788 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-180bb355-b791-4708-b3c6-6d576d2e7a3a tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:43:46.400898 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-180bb355-b791-4708-b3c6-6d576d2e7a3a tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/57e82015-7043-4a42-94e5-c1a4901d670d" status: 200 len: 1694 microversion: 2.1 time: 0.169762 Jul 23 21:43:46.401482 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2719/5329] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:43:46 2022] GET /compute/v2.1/servers/57e82015-7043-4a42-94e5-c1a4901d670d => generated 1694 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:43:47.291510 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-aef28b23-75f2-4707-9e71-b1c545ce3d55 req-19260e7e-669d-4e01-ab39-b72cc9565409 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57e82015-7043-4a42-94e5-c1a4901d670d", "tag": "fa742ec9-a90e-4a44-8379-6282a7241878"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:43:47.301903 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-aef28b23-75f2-4707-9e71-b1c545ce3d55 req-19260e7e-669d-4e01-ab39-b72cc9565409 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:43:47.302355 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-aef28b23-75f2-4707-9e71-b1c545ce3d55 req-19260e7e-669d-4e01-ab39-b72cc9565409 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:43:47.314217 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-aef28b23-75f2-4707-9e71-b1c545ce3d55 req-19260e7e-669d-4e01-ab39-b72cc9565409 service nova] Creating event network-changed:fa742ec9-a90e-4a44-8379-6282a7241878 for instance 57e82015-7043-4a42-94e5-c1a4901d670d on nch1-master-1 Jul 23 21:43:47.319663 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [req-aef28b23-75f2-4707-9e71-b1c545ce3d55 req-19260e7e-669d-4e01-ab39-b72cc9565409 service nova] Instance 57e82015-7043-4a42-94e5-c1a4901d670d is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=131320) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 23 21:43:47.330875 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-aef28b23-75f2-4707-9e71-b1c545ce3d55 req-19260e7e-669d-4e01-ab39-b72cc9565409 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045725 Jul 23 21:43:47.331453 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2720/5330] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:43:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:43:47.419619 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9a500da6-cd13-4d8f-b223-b0b77591f4d5 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:43:47.420299 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-9a500da6-cd13-4d8f-b223-b0b77591f4d5 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 57e82015-7043-4a42-94e5-c1a4901d670d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:43:47.426656 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9a500da6-cd13-4d8f-b223-b0b77591f4d5 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:43:47.427110 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9a500da6-cd13-4d8f-b223-b0b77591f4d5 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:43:47.427889 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9a500da6-cd13-4d8f-b223-b0b77591f4d5 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:43:47.428332 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9a500da6-cd13-4d8f-b223-b0b77591f4d5 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:43:47.726679 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-9a500da6-cd13-4d8f-b223-b0b77591f4d5 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:43:47.734586 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9a500da6-cd13-4d8f-b223-b0b77591f4d5 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/57e82015-7043-4a42-94e5-c1a4901d670d" status: 200 len: 1694 microversion: 2.1 time: 0.319332 Jul 23 21:43:47.735472 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2721/5331] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:43:47 2022] GET /compute/v2.1/servers/57e82015-7043-4a42-94e5-c1a4901d670d => generated 1694 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:43:48.755808 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e6148e19-ede1-47c5-b5ac-8c9f9121b65d tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:43:48.756935 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e6148e19-ede1-47c5-b5ac-8c9f9121b65d tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 57e82015-7043-4a42-94e5-c1a4901d670d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:43:48.766405 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e6148e19-ede1-47c5-b5ac-8c9f9121b65d tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:43:48.766852 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e6148e19-ede1-47c5-b5ac-8c9f9121b65d tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:43:48.767619 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e6148e19-ede1-47c5-b5ac-8c9f9121b65d tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:43:48.768057 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e6148e19-ede1-47c5-b5ac-8c9f9121b65d tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:43:48.920323 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e6148e19-ede1-47c5-b5ac-8c9f9121b65d tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:43:48.928367 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e6148e19-ede1-47c5-b5ac-8c9f9121b65d tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/57e82015-7043-4a42-94e5-c1a4901d670d" status: 200 len: 1691 microversion: 2.1 time: 0.179163 Jul 23 21:43:48.929065 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2722/5332] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:43:48 2022] GET /compute/v2.1/servers/57e82015-7043-4a42-94e5-c1a4901d670d => generated 1691 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:43:48.944540 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0ee38973-c7ab-490f-aafb-436fe94a1915 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:43:48.945074 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-0ee38973-c7ab-490f-aafb-436fe94a1915 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 57e82015-7043-4a42-94e5-c1a4901d670d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:43:48.951327 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0ee38973-c7ab-490f-aafb-436fe94a1915 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:43:48.951778 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0ee38973-c7ab-490f-aafb-436fe94a1915 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:43:48.952899 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0ee38973-c7ab-490f-aafb-436fe94a1915 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:43:48.953343 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0ee38973-c7ab-490f-aafb-436fe94a1915 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:43:49.064275 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-0ee38973-c7ab-490f-aafb-436fe94a1915 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "POST /compute/v2.1/servers/57e82015-7043-4a42-94e5-c1a4901d670d/action" status: 202 len: 0 microversion: 2.1 time: 0.123186 Jul 23 21:43:49.064819 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2723/5333] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:43:48 2022] POST /compute/v2.1/servers/57e82015-7043-4a42-94e5-c1a4901d670d/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:43:49.073121 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b8981695-f8c2-4cb0-997a-6e3ea3aeab58 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:43:49.073827 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b8981695-f8c2-4cb0-997a-6e3ea3aeab58 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 57e82015-7043-4a42-94e5-c1a4901d670d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:43:49.080665 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b8981695-f8c2-4cb0-997a-6e3ea3aeab58 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:43:49.081121 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b8981695-f8c2-4cb0-997a-6e3ea3aeab58 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:43:49.081927 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b8981695-f8c2-4cb0-997a-6e3ea3aeab58 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:43:49.082441 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b8981695-f8c2-4cb0-997a-6e3ea3aeab58 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:43:49.285927 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b8981695-f8c2-4cb0-997a-6e3ea3aeab58 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:43:49.298984 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b8981695-f8c2-4cb0-997a-6e3ea3aeab58 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/57e82015-7043-4a42-94e5-c1a4901d670d" status: 200 len: 1690 microversion: 2.1 time: 0.229368 Jul 23 21:43:49.299660 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2724/5334] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:43:49 2022] GET /compute/v2.1/servers/57e82015-7043-4a42-94e5-c1a4901d670d => generated 1690 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:43:50.037038 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-6797154b-9264-4391-b42a-6dbd11de7d15 req-3dbf0461-711c-4c7a-81a9-085f2f16e1aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57e82015-7043-4a42-94e5-c1a4901d670d", "name": "network-vif-plugged", "status": "completed", "tag": "fa742ec9-a90e-4a44-8379-6282a7241878"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:43:50.045423 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-6797154b-9264-4391-b42a-6dbd11de7d15 req-3dbf0461-711c-4c7a-81a9-085f2f16e1aa service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:43:50.045916 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-6797154b-9264-4391-b42a-6dbd11de7d15 req-3dbf0461-711c-4c7a-81a9-085f2f16e1aa service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:43:50.057538 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-6797154b-9264-4391-b42a-6dbd11de7d15 req-3dbf0461-711c-4c7a-81a9-085f2f16e1aa service nova] Creating event network-vif-plugged:fa742ec9-a90e-4a44-8379-6282a7241878 for instance 57e82015-7043-4a42-94e5-c1a4901d670d on nch1-master-1 Jul 23 21:43:50.063064 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [req-6797154b-9264-4391-b42a-6dbd11de7d15 req-3dbf0461-711c-4c7a-81a9-085f2f16e1aa service nova] Instance 57e82015-7043-4a42-94e5-c1a4901d670d is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=131320) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 23 21:43:50.073582 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-6797154b-9264-4391-b42a-6dbd11de7d15 req-3dbf0461-711c-4c7a-81a9-085f2f16e1aa service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114002 Jul 23 21:43:50.074228 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2725/5335] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:43:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:43:50.321583 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-74e8f674-7f18-47e4-ad6e-5d8932ae2fca tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:43:50.322776 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-74e8f674-7f18-47e4-ad6e-5d8932ae2fca tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 57e82015-7043-4a42-94e5-c1a4901d670d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:43:50.330929 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-74e8f674-7f18-47e4-ad6e-5d8932ae2fca tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:43:50.331416 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-74e8f674-7f18-47e4-ad6e-5d8932ae2fca tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:43:50.332195 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-74e8f674-7f18-47e4-ad6e-5d8932ae2fca tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:43:50.332642 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-74e8f674-7f18-47e4-ad6e-5d8932ae2fca tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:43:50.470477 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-74e8f674-7f18-47e4-ad6e-5d8932ae2fca tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:43:50.478202 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-74e8f674-7f18-47e4-ad6e-5d8932ae2fca tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/57e82015-7043-4a42-94e5-c1a4901d670d" status: 200 len: 1690 microversion: 2.1 time: 0.163924 Jul 23 21:43:50.478753 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2726/5336] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:43:50 2022] GET /compute/v2.1/servers/57e82015-7043-4a42-94e5-c1a4901d670d => generated 1690 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:43:51.498938 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d0c10a3c-e681-474d-b86b-8053789eb9ee tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:43:51.499622 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d0c10a3c-e681-474d-b86b-8053789eb9ee tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 57e82015-7043-4a42-94e5-c1a4901d670d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:43:51.506724 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d0c10a3c-e681-474d-b86b-8053789eb9ee tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:43:51.507207 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d0c10a3c-e681-474d-b86b-8053789eb9ee tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:43:51.507980 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d0c10a3c-e681-474d-b86b-8053789eb9ee tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:43:51.508414 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d0c10a3c-e681-474d-b86b-8053789eb9ee tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:43:51.649119 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d0c10a3c-e681-474d-b86b-8053789eb9ee tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:43:51.657019 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d0c10a3c-e681-474d-b86b-8053789eb9ee tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/57e82015-7043-4a42-94e5-c1a4901d670d" status: 200 len: 1690 microversion: 2.1 time: 0.163840 Jul 23 21:43:51.662057 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2727/5337] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:43:51 2022] GET /compute/v2.1/servers/57e82015-7043-4a42-94e5-c1a4901d670d => generated 1690 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:43:52.255164 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-8d91e74a-1845-4127-8384-d3a0dedf7d5e req-fc89a812-bd39-4eea-b27e-2623cec3229d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57e82015-7043-4a42-94e5-c1a4901d670d", "name": "network-vif-unplugged", "status": "completed", "tag": "fa742ec9-a90e-4a44-8379-6282a7241878"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:43:52.263463 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-8d91e74a-1845-4127-8384-d3a0dedf7d5e req-fc89a812-bd39-4eea-b27e-2623cec3229d service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:43:52.263930 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-8d91e74a-1845-4127-8384-d3a0dedf7d5e req-fc89a812-bd39-4eea-b27e-2623cec3229d service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:43:52.266826 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:43:52.276915 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-8d91e74a-1845-4127-8384-d3a0dedf7d5e req-fc89a812-bd39-4eea-b27e-2623cec3229d service nova] Creating event network-vif-unplugged:fa742ec9-a90e-4a44-8379-6282a7241878 for instance 57e82015-7043-4a42-94e5-c1a4901d670d on nch2-master-1 Jul 23 21:43:52.283119 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [req-8d91e74a-1845-4127-8384-d3a0dedf7d5e req-fc89a812-bd39-4eea-b27e-2623cec3229d service nova] Instance 57e82015-7043-4a42-94e5-c1a4901d670d is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=131320) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 23 21:43:52.294030 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-8d91e74a-1845-4127-8384-d3a0dedf7d5e req-fc89a812-bd39-4eea-b27e-2623cec3229d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042662 Jul 23 21:43:52.294637 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2728/5338] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:43:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:43:52.676257 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2aad9700-3718-46c5-bc99-44fc4e724e6b tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:43:52.677918 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-2aad9700-3718-46c5-bc99-44fc4e724e6b tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 57e82015-7043-4a42-94e5-c1a4901d670d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:43:52.685439 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2aad9700-3718-46c5-bc99-44fc4e724e6b tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:43:52.685811 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2aad9700-3718-46c5-bc99-44fc4e724e6b tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:43:52.686628 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2aad9700-3718-46c5-bc99-44fc4e724e6b tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:43:52.687087 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2aad9700-3718-46c5-bc99-44fc4e724e6b tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:43:52.905161 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-2aad9700-3718-46c5-bc99-44fc4e724e6b tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:43:52.913826 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2aad9700-3718-46c5-bc99-44fc4e724e6b tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/57e82015-7043-4a42-94e5-c1a4901d670d" status: 200 len: 1690 microversion: 2.1 time: 0.243259 Jul 23 21:43:52.914391 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2729/5339] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:43:52 2022] GET /compute/v2.1/servers/57e82015-7043-4a42-94e5-c1a4901d670d => generated 1690 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:43:53.935389 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e75ad89c-1a8d-47c7-9bbb-cce85a5c9fe7 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:43:53.936160 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e75ad89c-1a8d-47c7-9bbb-cce85a5c9fe7 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 57e82015-7043-4a42-94e5-c1a4901d670d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:43:53.944773 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e75ad89c-1a8d-47c7-9bbb-cce85a5c9fe7 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:43:53.945299 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e75ad89c-1a8d-47c7-9bbb-cce85a5c9fe7 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:43:53.946223 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e75ad89c-1a8d-47c7-9bbb-cce85a5c9fe7 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:43:53.946742 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e75ad89c-1a8d-47c7-9bbb-cce85a5c9fe7 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:43:54.117679 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e75ad89c-1a8d-47c7-9bbb-cce85a5c9fe7 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:43:54.129355 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e75ad89c-1a8d-47c7-9bbb-cce85a5c9fe7 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/57e82015-7043-4a42-94e5-c1a4901d670d" status: 200 len: 1690 microversion: 2.1 time: 0.200160 Jul 23 21:43:54.130184 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2730/5340] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:43:53 2022] GET /compute/v2.1/servers/57e82015-7043-4a42-94e5-c1a4901d670d => generated 1690 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:43:54.314493 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-36f3e1ad-76d0-42fb-96c4-10a97c0ece97 req-079e614a-b04f-4d11-beff-c652f025a1fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57e82015-7043-4a42-94e5-c1a4901d670d", "tag": "fa742ec9-a90e-4a44-8379-6282a7241878"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:43:54.327690 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-36f3e1ad-76d0-42fb-96c4-10a97c0ece97 req-079e614a-b04f-4d11-beff-c652f025a1fd service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:43:54.328210 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-36f3e1ad-76d0-42fb-96c4-10a97c0ece97 req-079e614a-b04f-4d11-beff-c652f025a1fd service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:43:54.340426 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-36f3e1ad-76d0-42fb-96c4-10a97c0ece97 req-079e614a-b04f-4d11-beff-c652f025a1fd service nova] Creating event network-changed:fa742ec9-a90e-4a44-8379-6282a7241878 for instance 57e82015-7043-4a42-94e5-c1a4901d670d on nch2-master-1 Jul 23 21:43:54.346338 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [req-36f3e1ad-76d0-42fb-96c4-10a97c0ece97 req-079e614a-b04f-4d11-beff-c652f025a1fd service nova] Instance 57e82015-7043-4a42-94e5-c1a4901d670d is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=131320) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 23 21:43:54.357148 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-36f3e1ad-76d0-42fb-96c4-10a97c0ece97 req-079e614a-b04f-4d11-beff-c652f025a1fd service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048998 Jul 23 21:43:54.358061 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2731/5341] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:43:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:43:55.147286 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a4667989-7640-4c6a-aa82-4af090f07fff tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:43:55.147958 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a4667989-7640-4c6a-aa82-4af090f07fff tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 57e82015-7043-4a42-94e5-c1a4901d670d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:43:55.150907 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=77 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:43:55.156905 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a4667989-7640-4c6a-aa82-4af090f07fff tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:43:55.157361 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a4667989-7640-4c6a-aa82-4af090f07fff tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:43:55.158179 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a4667989-7640-4c6a-aa82-4af090f07fff tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:43:55.158637 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a4667989-7640-4c6a-aa82-4af090f07fff tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:43:55.489772 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a4667989-7640-4c6a-aa82-4af090f07fff tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:43:55.498264 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a4667989-7640-4c6a-aa82-4af090f07fff tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/57e82015-7043-4a42-94e5-c1a4901d670d" status: 200 len: 1683 microversion: 2.1 time: 0.355330 Jul 23 21:43:55.505968 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2732/5342] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:43:55 2022] GET /compute/v2.1/servers/57e82015-7043-4a42-94e5-c1a4901d670d => generated 1683 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:43:57.744424 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-1f5030f7-0bc5-44e8-b878-30b336f4f2d7 req-16032493-9a28-4558-b760-6f5cee26791f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57e82015-7043-4a42-94e5-c1a4901d670d", "name": "network-vif-plugged", "status": "completed", "tag": "fa742ec9-a90e-4a44-8379-6282a7241878"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:43:57.752652 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-1f5030f7-0bc5-44e8-b878-30b336f4f2d7 req-16032493-9a28-4558-b760-6f5cee26791f service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:43:57.753100 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-1f5030f7-0bc5-44e8-b878-30b336f4f2d7 req-16032493-9a28-4558-b760-6f5cee26791f service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:43:57.764442 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-1f5030f7-0bc5-44e8-b878-30b336f4f2d7 req-16032493-9a28-4558-b760-6f5cee26791f service nova] Creating event network-vif-plugged:fa742ec9-a90e-4a44-8379-6282a7241878 for instance 57e82015-7043-4a42-94e5-c1a4901d670d on nch2-master-1 Jul 23 21:43:57.769412 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-1f5030f7-0bc5-44e8-b878-30b336f4f2d7 req-16032493-9a28-4558-b760-6f5cee26791f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029770 Jul 23 21:43:57.770205 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2733/5343] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:43:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:44:19.723860 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=3 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:44:19.724565 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=27 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:44:19.728772 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8023a484-c989-4d4a-b772-1fc271a672e7 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:44:19.729782 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8023a484-c989-4d4a-b772-1fc271a672e7 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 57e82015-7043-4a42-94e5-c1a4901d670d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:44:19.737037 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8023a484-c989-4d4a-b772-1fc271a672e7 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:44:19.737486 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8023a484-c989-4d4a-b772-1fc271a672e7 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:44:19.738345 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8023a484-c989-4d4a-b772-1fc271a672e7 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:44:19.738736 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8023a484-c989-4d4a-b772-1fc271a672e7 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:44:19.793497 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8023a484-c989-4d4a-b772-1fc271a672e7 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "POST /compute/v2.1/servers/57e82015-7043-4a42-94e5-c1a4901d670d/action" status: 200 len: 63172 microversion: 2.1 time: 0.071450 Jul 23 21:44:19.794244 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2734/5344] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:44:19 2022] POST /compute/v2.1/servers/57e82015-7043-4a42-94e5-c1a4901d670d/action => generated 63172 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 23 21:44:26.088331 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d7c9004a-5684-49e8-915d-e0ede466a266 tempest-TestNetworkAdvancedServerOps-377287141 tempest-TestNetworkAdvancedServerOps-377287141-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:44:26.089448 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d7c9004a-5684-49e8-915d-e0ede466a266 tempest-TestNetworkAdvancedServerOps-377287141 tempest-TestNetworkAdvancedServerOps-377287141-project-admin] [instance: 57e82015-7043-4a42-94e5-c1a4901d670d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:44:26.101412 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d7c9004a-5684-49e8-915d-e0ede466a266 tempest-TestNetworkAdvancedServerOps-377287141 tempest-TestNetworkAdvancedServerOps-377287141-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:44:26.102260 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d7c9004a-5684-49e8-915d-e0ede466a266 tempest-TestNetworkAdvancedServerOps-377287141 tempest-TestNetworkAdvancedServerOps-377287141-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:44:26.104224 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d7c9004a-5684-49e8-915d-e0ede466a266 tempest-TestNetworkAdvancedServerOps-377287141 tempest-TestNetworkAdvancedServerOps-377287141-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:44:26.104224 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d7c9004a-5684-49e8-915d-e0ede466a266 tempest-TestNetworkAdvancedServerOps-377287141 tempest-TestNetworkAdvancedServerOps-377287141-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:44:26.241057 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d7c9004a-5684-49e8-915d-e0ede466a266 tempest-TestNetworkAdvancedServerOps-377287141 tempest-TestNetworkAdvancedServerOps-377287141-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/57e82015-7043-4a42-94e5-c1a4901d670d" status: 200 len: 1834 microversion: 2.1 time: 0.159702 Jul 23 21:44:26.241644 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2735/5345] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:44:26 2022] GET /compute/v2.1/servers/57e82015-7043-4a42-94e5-c1a4901d670d => generated 1834 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:44:27.139706 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4fb5b9f8-6de5-4a68-8f3f-f62e79661ef7 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:44:27.140399 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-4fb5b9f8-6de5-4a68-8f3f-f62e79661ef7 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 57e82015-7043-4a42-94e5-c1a4901d670d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:44:27.148955 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4fb5b9f8-6de5-4a68-8f3f-f62e79661ef7 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:44:27.149413 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4fb5b9f8-6de5-4a68-8f3f-f62e79661ef7 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:44:27.150279 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4fb5b9f8-6de5-4a68-8f3f-f62e79661ef7 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:44:27.150723 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4fb5b9f8-6de5-4a68-8f3f-f62e79661ef7 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:44:27.178655 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-4fb5b9f8-6de5-4a68-8f3f-f62e79661ef7 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 57e82015-7043-4a42-94e5-c1a4901d670d] Going to try to terminate instance {{(pid=131320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:44:27.266046 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4fb5b9f8-6de5-4a68-8f3f-f62e79661ef7 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "DELETE /compute/v2.1/servers/57e82015-7043-4a42-94e5-c1a4901d670d" status: 204 len: 0 microversion: 2.1 time: 0.130566 Jul 23 21:44:27.270676 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2736/5346] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:44:27 2022] DELETE /compute/v2.1/servers/57e82015-7043-4a42-94e5-c1a4901d670d => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:44:27.273491 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-bceec96a-a111-4878-b4a4-1d47581a6d3e req-a7757432-70ed-4c66-8433-aa2bb48110c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57e82015-7043-4a42-94e5-c1a4901d670d", "tag": "fa742ec9-a90e-4a44-8379-6282a7241878"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:44:27.282065 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-bceec96a-a111-4878-b4a4-1d47581a6d3e req-a7757432-70ed-4c66-8433-aa2bb48110c3 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:44:27.282514 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-bceec96a-a111-4878-b4a4-1d47581a6d3e req-a7757432-70ed-4c66-8433-aa2bb48110c3 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:44:27.296979 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-bceec96a-a111-4878-b4a4-1d47581a6d3e req-a7757432-70ed-4c66-8433-aa2bb48110c3 service nova] Creating event network-changed:fa742ec9-a90e-4a44-8379-6282a7241878 for instance 57e82015-7043-4a42-94e5-c1a4901d670d on nch2-master-1 Jul 23 21:44:27.301960 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-bceec96a-a111-4878-b4a4-1d47581a6d3e req-a7757432-70ed-4c66-8433-aa2bb48110c3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033025 Jul 23 21:44:27.302705 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2737/5347] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:44:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:44:27.307537 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-fe64436c-666e-4b50-9e71-e4aad798d0b2 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:44:27.308271 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-fe64436c-666e-4b50-9e71-e4aad798d0b2 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 57e82015-7043-4a42-94e5-c1a4901d670d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:44:27.314633 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fe64436c-666e-4b50-9e71-e4aad798d0b2 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:44:27.315091 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fe64436c-666e-4b50-9e71-e4aad798d0b2 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:44:27.315965 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fe64436c-666e-4b50-9e71-e4aad798d0b2 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:44:27.316409 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fe64436c-666e-4b50-9e71-e4aad798d0b2 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:44:27.453666 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-fe64436c-666e-4b50-9e71-e4aad798d0b2 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:44:27.461710 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-fe64436c-666e-4b50-9e71-e4aad798d0b2 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/57e82015-7043-4a42-94e5-c1a4901d670d" status: 200 len: 1689 microversion: 2.1 time: 0.157987 Jul 23 21:44:27.462512 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2738/5348] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:44:27 2022] GET /compute/v2.1/servers/57e82015-7043-4a42-94e5-c1a4901d670d => generated 1689 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:44:28.481119 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-79ef4375-4ff2-48be-b313-22d1bb43621d tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:44:28.481785 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-79ef4375-4ff2-48be-b313-22d1bb43621d tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 57e82015-7043-4a42-94e5-c1a4901d670d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:44:28.488763 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-79ef4375-4ff2-48be-b313-22d1bb43621d tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:44:28.489248 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-79ef4375-4ff2-48be-b313-22d1bb43621d tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:44:28.490148 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-79ef4375-4ff2-48be-b313-22d1bb43621d tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:44:28.490596 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-79ef4375-4ff2-48be-b313-22d1bb43621d tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:44:28.816074 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-79ef4375-4ff2-48be-b313-22d1bb43621d tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:44:28.824677 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-79ef4375-4ff2-48be-b313-22d1bb43621d tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/57e82015-7043-4a42-94e5-c1a4901d670d" status: 200 len: 1689 microversion: 2.1 time: 0.347850 Jul 23 21:44:28.825506 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2739/5349] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:44:28 2022] GET /compute/v2.1/servers/57e82015-7043-4a42-94e5-c1a4901d670d => generated 1689 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:44:29.378436 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-a9bf16bf-d3ec-4bdb-a147-940ab91f5c6a req-3e50007a-2a4b-47e9-8d88-8e8e67fa0778 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57e82015-7043-4a42-94e5-c1a4901d670d", "name": "network-vif-deleted", "tag": "fa742ec9-a90e-4a44-8379-6282a7241878"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:44:29.386811 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-a9bf16bf-d3ec-4bdb-a147-940ab91f5c6a req-3e50007a-2a4b-47e9-8d88-8e8e67fa0778 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:44:29.387256 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-a9bf16bf-d3ec-4bdb-a147-940ab91f5c6a req-3e50007a-2a4b-47e9-8d88-8e8e67fa0778 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:44:29.399792 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-a9bf16bf-d3ec-4bdb-a147-940ab91f5c6a req-3e50007a-2a4b-47e9-8d88-8e8e67fa0778 service nova] Creating event network-vif-deleted:fa742ec9-a90e-4a44-8379-6282a7241878 for instance 57e82015-7043-4a42-94e5-c1a4901d670d on nch2-master-1 Jul 23 21:44:29.404359 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-a9bf16bf-d3ec-4bdb-a147-940ab91f5c6a req-3e50007a-2a4b-47e9-8d88-8e8e67fa0778 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091679 Jul 23 21:44:29.405335 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2740/5350] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:44:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:44:29.843941 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-83c24e90-9397-45c3-9523-5be87e8a7831 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:44:29.844536 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-83c24e90-9397-45c3-9523-5be87e8a7831 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 57e82015-7043-4a42-94e5-c1a4901d670d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:44:29.851428 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-83c24e90-9397-45c3-9523-5be87e8a7831 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:44:29.851883 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-83c24e90-9397-45c3-9523-5be87e8a7831 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:44:29.852661 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-83c24e90-9397-45c3-9523-5be87e8a7831 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:44:29.853104 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-83c24e90-9397-45c3-9523-5be87e8a7831 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:44:29.866785 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-83c24e90-9397-45c3-9523-5be87e8a7831 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] HTTP exception thrown: Instance 57e82015-7043-4a42-94e5-c1a4901d670d could not be found. Jul 23 21:44:29.868473 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-83c24e90-9397-45c3-9523-5be87e8a7831 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Request method failure captured: Jul 23 21:44:29.868473 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/57e82015-7043-4a42-94e5-c1a4901d670d HTTP/1.1 Jul 23 21:44:29.868473 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:44:29.868473 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:44:29.868473 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:44:29.868473 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:44:29.868473 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:44:29.868473 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:44:29.868473 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:44:29.868473 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:44:29.868473 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GrOSfKcmvIg8CybJuZ211K2BCk2kV9XXJD4t1iLnpDMxE7Pkx25elWArE6eyR4tr0Iwox8ke0DWSoqvidEJT8OIHAfji6eadcJDPEeLIK5RaEi7u5O4vXMbwe3kSZZq8MYGsBh4KdQThoYiwMI-IDxUERCe5nBEmFyUK5SxchL_LMo Jul 23 21:44:29.868473 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:44:29.868473 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:44:29.868473 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:44:29.868473 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:44:29.868473 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:44:29.868473 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:44:29.868473 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 36bd2862980e45849b0d3fc3f52a6926 Jul 23 21:44:29.868473 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1607830774 Jul 23 21:44:29.868473 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:44:29.868473 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:44:29.868473 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/36bd2862980e45849b0d3fc3f52a6926"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/36bd2862980e45849b0d3fc3f52a6926"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_36bd2862980e45849b0d3fc3f52a6926", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/36bd2862980e45849b0d3fc3f52a6926"}]}] Jul 23 21:44:29.868473 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1607830774 Jul 23 21:44:29.868473 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 36bd2862980e45849b0d3fc3f52a6926 Jul 23 21:44:29.868473 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1607830774 Jul 23 21:44:29.868473 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-TestNetworkAdvancedServerOps-1607830774-project Jul 23 21:44:29.868473 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:44:29.868473 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:44:29.868473 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 96ade420fd324acfb57e4ac81bfece9e Jul 23 21:44:29.868473 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1607830774-project Jul 23 21:44:29.868473 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:44:29.868473 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance 57e82015-7043-4a42-94e5-c1a4901d670d could not be found. Jul 23 21:44:29.868473 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '57e82015-7043-4a42-94e5-c1a4901d670d'} Jul 23 21:44:29.868473 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:44:29.868473 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:44:29.868473 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:44:29.868473 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:44:29.868473 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:44:29.868473 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:44:29.868473 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:44:29.868473 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:44:29.868473 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:44:29.868473 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:44:29.868473 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57e82015-7043-4a42-94e5-c1a4901d670d could not be found. Jul 23 21:44:29.868473 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:44:29.868473 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:44:29.868473 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:44:29.868473 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:44:29.868473 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:44:29.868473 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:44:29.868473 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:44:29.868473 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:44:29.868473 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:44:29.868473 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:44:29.868473 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:44:29.868473 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:44:29.868473 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:44:29.868473 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:44:29.868473 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:44:29.868473 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:44:29.868473 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57e82015-7043-4a42-94e5-c1a4901d670d could not be found. Jul 23 21:44:29.868473 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:44:29.868473 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:44:29.873116 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:44:29.873116 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:44:29.873116 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:44:29.873116 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:44:29.873116 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:44:29.873116 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:44:29.873116 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57e82015-7043-4a42-94e5-c1a4901d670d could not be found. Jul 23 21:44:29.873116 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:44:29.873116 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-83c24e90-9397-45c3-9523-5be87e8a7831 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Returning 404 to user: Instance 57e82015-7043-4a42-94e5-c1a4901d670d could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:44:29.873116 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-83c24e90-9397-45c3-9523-5be87e8a7831 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/57e82015-7043-4a42-94e5-c1a4901d670d" status: 404 len: 111 microversion: 2.1 time: 0.031327 Jul 23 21:44:29.873116 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2741/5351] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:44:29 2022] GET /compute/v2.1/servers/57e82015-7043-4a42-94e5-c1a4901d670d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:44:33.578795 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-58c7279e-5cf3-40d6-b839-b20649a44990 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '.version_select at 0x7f0b46bb8280>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:44:33.598071 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-58c7279e-5cf3-40d6-b839-b20649a44990 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1494844016" status: 202 len: 0 microversion: 2.1 time: 0.029472 Jul 23 21:44:33.599314 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2742/5352] 10.222.0.17 () {58 vars in 1283 bytes} [Sat Jul 23 21:44:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1494844016 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 23 21:44:33.639401 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-7976a248-3ffb-4cbb-aca0-18f12b475d37 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Action: 'create', calling method: .version_select at 0x7f0b4658a550>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-434634966", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEeeniYTkDfkbLjw280FVEJlPYVTD+5/IYnUt2WTDes9ULqA1SIeItUdrlscHL9kegW5juqJXVUVjs+CLxxtrSND8Ga+39u3vh4eVC3+tcYzv1RylQxpQa6QspZhFYqFFw=="}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:44:33.654163 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-7976a248-3ffb-4cbb-aca0-18f12b475d37 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Getting quotas for project 36bd2862980e45849b0d3fc3f52a6926. Resources: {'key_pairs'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:44:33.659170 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-7976a248-3ffb-4cbb-aca0-18f12b475d37 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Getting quotas for user 96ade420fd324acfb57e4ac81bfece9e and project 36bd2862980e45849b0d3fc3f52a6926. Resources: {'key_pairs'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:44:33.683176 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-7976a248-3ffb-4cbb-aca0-18f12b475d37 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.048128 Jul 23 21:44:33.683760 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2743/5353] 10.222.0.17 () {60 vars in 1158 bytes} [Sat Jul 23 21:44:33 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:44:39.015153 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c91ccdca-4e9a-47b0-8f36-759c1f37c864 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2031071269", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "networks": [{"uuid": "9ea0020f-1357-4da4-af2f-2034c6013245"}], "key_name": "tempest-TestNetworkAdvancedServerOps-434634966", "security_groups": [{"name": "tempest-secgroup-smoke-1425106935"}]}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:44:39.129905 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-c91ccdca-4e9a-47b0-8f36-759c1f37c864 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] validate_networks() for [('9ea0020f-1357-4da4-af2f-2034c6013245', None, None, None, None, None)] {{(pid=131320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:44:39.616957 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-c91ccdca-4e9a-47b0-8f36-759c1f37c864 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:44:39.617484 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-c91ccdca-4e9a-47b0-8f36-759c1f37c864 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:44:39.618228 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-c91ccdca-4e9a-47b0-8f36-759c1f37c864 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:44:39.618890 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-c91ccdca-4e9a-47b0-8f36-759c1f37c864 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:44:39.619556 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-c91ccdca-4e9a-47b0-8f36-759c1f37c864 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:44:39.634884 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c91ccdca-4e9a-47b0-8f36-759c1f37c864 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:44:39.636507 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c91ccdca-4e9a-47b0-8f36-759c1f37c864 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:44:39.637682 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c91ccdca-4e9a-47b0-8f36-759c1f37c864 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:44:39.638530 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c91ccdca-4e9a-47b0-8f36-759c1f37c864 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:44:39.661369 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-c91ccdca-4e9a-47b0-8f36-759c1f37c864 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Getting quotas for project 36bd2862980e45849b0d3fc3f52a6926. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:44:39.668411 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-c91ccdca-4e9a-47b0-8f36-759c1f37c864 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Getting quotas for user 96ade420fd324acfb57e4ac81bfece9e and project 36bd2862980e45849b0d3fc3f52a6926. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:44:39.688519 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c91ccdca-4e9a-47b0-8f36-759c1f37c864 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Going to run 1 instances... {{(pid=131320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:44:39.692908 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c91ccdca-4e9a-47b0-8f36-759c1f37c864 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 88bf9c0c-a369-4e47-bdf6-79bf59610fba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:44:39.764236 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c91ccdca-4e9a-47b0-8f36-759c1f37c864 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.754521 Jul 23 21:44:39.765386 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2744/5354] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:44:39 2022] POST /compute/v2.1/servers => generated 406 bytes in 756 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 23 21:44:39.775530 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-533b8ec5-d9be-4d4b-8678-e5088d15c5b9 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:44:39.776447 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-533b8ec5-d9be-4d4b-8678-e5088d15c5b9 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 88bf9c0c-a369-4e47-bdf6-79bf59610fba] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:44:39.858197 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-533b8ec5-d9be-4d4b-8678-e5088d15c5b9 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:44:39.873054 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-533b8ec5-d9be-4d4b-8678-e5088d15c5b9 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/88bf9c0c-a369-4e47-bdf6-79bf59610fba" status: 200 len: 1266 microversion: 2.1 time: 0.101227 Jul 23 21:44:39.874390 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2745/5355] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:44:39 2022] GET /compute/v2.1/servers/88bf9c0c-a369-4e47-bdf6-79bf59610fba => generated 1266 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:44:40.891745 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-aa28664d-a5f6-472b-9d0c-d06e6c6f7194 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:44:40.892492 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-aa28664d-a5f6-472b-9d0c-d06e6c6f7194 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 88bf9c0c-a369-4e47-bdf6-79bf59610fba] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:44:40.900747 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-aa28664d-a5f6-472b-9d0c-d06e6c6f7194 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:44:40.904695 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-aa28664d-a5f6-472b-9d0c-d06e6c6f7194 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:44:40.905588 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-aa28664d-a5f6-472b-9d0c-d06e6c6f7194 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:44:40.906107 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-aa28664d-a5f6-472b-9d0c-d06e6c6f7194 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:44:41.055260 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-aa28664d-a5f6-472b-9d0c-d06e6c6f7194 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:44:41.064932 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-aa28664d-a5f6-472b-9d0c-d06e6c6f7194 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/88bf9c0c-a369-4e47-bdf6-79bf59610fba" status: 200 len: 1318 microversion: 2.1 time: 0.177630 Jul 23 21:44:41.066161 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2746/5356] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:44:40 2022] GET /compute/v2.1/servers/88bf9c0c-a369-4e47-bdf6-79bf59610fba => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:44:42.082787 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3bba0593-72ad-4ec7-9e1d-4ab23d7c9486 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:44:42.083435 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-3bba0593-72ad-4ec7-9e1d-4ab23d7c9486 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 88bf9c0c-a369-4e47-bdf6-79bf59610fba] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:44:42.095292 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3bba0593-72ad-4ec7-9e1d-4ab23d7c9486 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:44:42.095732 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3bba0593-72ad-4ec7-9e1d-4ab23d7c9486 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:44:42.096543 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3bba0593-72ad-4ec7-9e1d-4ab23d7c9486 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:44:42.097200 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3bba0593-72ad-4ec7-9e1d-4ab23d7c9486 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:44:42.323522 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-3bba0593-72ad-4ec7-9e1d-4ab23d7c9486 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:44:42.331846 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-3bba0593-72ad-4ec7-9e1d-4ab23d7c9486 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/88bf9c0c-a369-4e47-bdf6-79bf59610fba" status: 200 len: 1392 microversion: 2.1 time: 0.253390 Jul 23 21:44:42.332425 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2747/5357] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:44:42 2022] GET /compute/v2.1/servers/88bf9c0c-a369-4e47-bdf6-79bf59610fba => generated 1392 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:44:42.679660 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-2f71a6a1-2079-4cd6-b5c7-f0d2c867204c req-d4dbaa62-d8b1-40d4-b9ef-a24b8debf120 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88bf9c0c-a369-4e47-bdf6-79bf59610fba", "tag": "8b152ebc-3dab-45b2-b138-594776b8447c"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:44:42.689937 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-2f71a6a1-2079-4cd6-b5c7-f0d2c867204c req-d4dbaa62-d8b1-40d4-b9ef-a24b8debf120 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:44:42.690897 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-2f71a6a1-2079-4cd6-b5c7-f0d2c867204c req-d4dbaa62-d8b1-40d4-b9ef-a24b8debf120 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:44:42.714645 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-2f71a6a1-2079-4cd6-b5c7-f0d2c867204c req-d4dbaa62-d8b1-40d4-b9ef-a24b8debf120 service nova] Creating event network-changed:8b152ebc-3dab-45b2-b138-594776b8447c for instance 88bf9c0c-a369-4e47-bdf6-79bf59610fba on nch1-master-1 Jul 23 21:44:42.719890 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-2f71a6a1-2079-4cd6-b5c7-f0d2c867204c req-d4dbaa62-d8b1-40d4-b9ef-a24b8debf120 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044471 Jul 23 21:44:42.720644 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2748/5358] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:44:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:44:43.350933 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8b3960b4-3377-4f2a-9a1c-c7e60352d0ae tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:44:43.351648 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8b3960b4-3377-4f2a-9a1c-c7e60352d0ae tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 88bf9c0c-a369-4e47-bdf6-79bf59610fba] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:44:43.358668 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8b3960b4-3377-4f2a-9a1c-c7e60352d0ae tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:44:43.359115 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8b3960b4-3377-4f2a-9a1c-c7e60352d0ae tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:44:43.359889 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8b3960b4-3377-4f2a-9a1c-c7e60352d0ae tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:44:43.360322 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8b3960b4-3377-4f2a-9a1c-c7e60352d0ae tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:44:43.497173 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8b3960b4-3377-4f2a-9a1c-c7e60352d0ae tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:44:43.508691 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8b3960b4-3377-4f2a-9a1c-c7e60352d0ae tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/88bf9c0c-a369-4e47-bdf6-79bf59610fba" status: 200 len: 1392 microversion: 2.1 time: 0.162577 Jul 23 21:44:43.509435 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2749/5359] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:44:43 2022] GET /compute/v2.1/servers/88bf9c0c-a369-4e47-bdf6-79bf59610fba => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:44:44.529551 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1f417289-05d8-4c25-a406-61aaa8ca7dbf tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:44:44.530313 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1f417289-05d8-4c25-a406-61aaa8ca7dbf tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 88bf9c0c-a369-4e47-bdf6-79bf59610fba] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:44:44.537658 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1f417289-05d8-4c25-a406-61aaa8ca7dbf tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:44:44.538204 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1f417289-05d8-4c25-a406-61aaa8ca7dbf tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:44:44.538989 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1f417289-05d8-4c25-a406-61aaa8ca7dbf tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:44:44.539427 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1f417289-05d8-4c25-a406-61aaa8ca7dbf tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:44:44.909542 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-1f417289-05d8-4c25-a406-61aaa8ca7dbf tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:44:44.917908 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1f417289-05d8-4c25-a406-61aaa8ca7dbf tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/88bf9c0c-a369-4e47-bdf6-79bf59610fba" status: 200 len: 1392 microversion: 2.1 time: 0.392324 Jul 23 21:44:44.918495 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2750/5360] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:44:44 2022] GET /compute/v2.1/servers/88bf9c0c-a369-4e47-bdf6-79bf59610fba => generated 1392 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:44:45.938726 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d89884a7-a86f-41c5-bc81-c2104a2bf6e6 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:44:45.939723 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d89884a7-a86f-41c5-bc81-c2104a2bf6e6 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 88bf9c0c-a369-4e47-bdf6-79bf59610fba] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:44:45.947477 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d89884a7-a86f-41c5-bc81-c2104a2bf6e6 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:44:45.947928 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d89884a7-a86f-41c5-bc81-c2104a2bf6e6 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:44:45.948699 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d89884a7-a86f-41c5-bc81-c2104a2bf6e6 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:44:45.949132 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d89884a7-a86f-41c5-bc81-c2104a2bf6e6 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:44:46.105410 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d89884a7-a86f-41c5-bc81-c2104a2bf6e6 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:44:46.113447 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d89884a7-a86f-41c5-bc81-c2104a2bf6e6 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/88bf9c0c-a369-4e47-bdf6-79bf59610fba" status: 200 len: 1392 microversion: 2.1 time: 0.181250 Jul 23 21:44:46.114019 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2751/5361] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:44:45 2022] GET /compute/v2.1/servers/88bf9c0c-a369-4e47-bdf6-79bf59610fba => generated 1392 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:44:47.134796 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8f16ede0-df50-4c4e-a4b5-32dc766d0a78 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:44:47.136054 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8f16ede0-df50-4c4e-a4b5-32dc766d0a78 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 88bf9c0c-a369-4e47-bdf6-79bf59610fba] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:44:47.145855 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8f16ede0-df50-4c4e-a4b5-32dc766d0a78 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:44:47.146331 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8f16ede0-df50-4c4e-a4b5-32dc766d0a78 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:44:47.147101 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8f16ede0-df50-4c4e-a4b5-32dc766d0a78 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:44:47.147540 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8f16ede0-df50-4c4e-a4b5-32dc766d0a78 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:44:47.283539 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8f16ede0-df50-4c4e-a4b5-32dc766d0a78 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:44:47.295031 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8f16ede0-df50-4c4e-a4b5-32dc766d0a78 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/88bf9c0c-a369-4e47-bdf6-79bf59610fba" status: 200 len: 1392 microversion: 2.1 time: 0.166599 Jul 23 21:44:47.295790 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2752/5362] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:44:47 2022] GET /compute/v2.1/servers/88bf9c0c-a369-4e47-bdf6-79bf59610fba => generated 1392 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:44:48.231945 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-d3849437-ff60-425e-a29a-0987f0556eed req-e0ce609c-03cc-4b00-8c6d-b2f693ecb7b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88bf9c0c-a369-4e47-bdf6-79bf59610fba", "name": "network-vif-plugged", "status": "completed", "tag": "8b152ebc-3dab-45b2-b138-594776b8447c"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:44:48.241427 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-d3849437-ff60-425e-a29a-0987f0556eed req-e0ce609c-03cc-4b00-8c6d-b2f693ecb7b4 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:44:48.241908 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-d3849437-ff60-425e-a29a-0987f0556eed req-e0ce609c-03cc-4b00-8c6d-b2f693ecb7b4 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:44:48.254507 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-d3849437-ff60-425e-a29a-0987f0556eed req-e0ce609c-03cc-4b00-8c6d-b2f693ecb7b4 service nova] Creating event network-vif-plugged:8b152ebc-3dab-45b2-b138-594776b8447c for instance 88bf9c0c-a369-4e47-bdf6-79bf59610fba on nch1-master-1 Jul 23 21:44:48.259636 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-d3849437-ff60-425e-a29a-0987f0556eed req-e0ce609c-03cc-4b00-8c6d-b2f693ecb7b4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031663 Jul 23 21:44:48.260260 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2753/5363] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:44:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:44:48.313446 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-503131e1-1e1c-4bea-b7de-706a8b297380 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:44:48.314400 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-503131e1-1e1c-4bea-b7de-706a8b297380 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 88bf9c0c-a369-4e47-bdf6-79bf59610fba] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:44:48.322075 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-503131e1-1e1c-4bea-b7de-706a8b297380 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:44:48.322521 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-503131e1-1e1c-4bea-b7de-706a8b297380 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:44:48.323289 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-503131e1-1e1c-4bea-b7de-706a8b297380 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:44:48.323726 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-503131e1-1e1c-4bea-b7de-706a8b297380 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:44:48.510686 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-503131e1-1e1c-4bea-b7de-706a8b297380 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:44:48.518774 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-503131e1-1e1c-4bea-b7de-706a8b297380 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/88bf9c0c-a369-4e47-bdf6-79bf59610fba" status: 200 len: 1392 microversion: 2.1 time: 0.209619 Jul 23 21:44:48.519362 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2754/5364] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:44:48 2022] GET /compute/v2.1/servers/88bf9c0c-a369-4e47-bdf6-79bf59610fba => generated 1392 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:44:49.539096 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-43516194-e203-4bea-8fae-0b43fad9a00e tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:44:49.539831 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-43516194-e203-4bea-8fae-0b43fad9a00e tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 88bf9c0c-a369-4e47-bdf6-79bf59610fba] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:44:49.550465 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-43516194-e203-4bea-8fae-0b43fad9a00e tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:44:49.550908 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-43516194-e203-4bea-8fae-0b43fad9a00e tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:44:49.551666 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-43516194-e203-4bea-8fae-0b43fad9a00e tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:44:49.552103 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-43516194-e203-4bea-8fae-0b43fad9a00e tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:44:49.651214 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:44:49.698007 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-43516194-e203-4bea-8fae-0b43fad9a00e tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:44:49.710186 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-43516194-e203-4bea-8fae-0b43fad9a00e tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/88bf9c0c-a369-4e47-bdf6-79bf59610fba" status: 200 len: 1392 microversion: 2.1 time: 0.176813 Jul 23 21:44:49.710901 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2755/5365] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:44:49 2022] GET /compute/v2.1/servers/88bf9c0c-a369-4e47-bdf6-79bf59610fba => generated 1392 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:44:50.734399 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c0e7a11c-deb1-4343-bc7f-62a24c13da90 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:44:50.735433 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c0e7a11c-deb1-4343-bc7f-62a24c13da90 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 88bf9c0c-a369-4e47-bdf6-79bf59610fba] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:44:50.738409 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=12 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:44:50.741288 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:44:50.750231 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c0e7a11c-deb1-4343-bc7f-62a24c13da90 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:44:50.750988 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c0e7a11c-deb1-4343-bc7f-62a24c13da90 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:44:50.752293 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c0e7a11c-deb1-4343-bc7f-62a24c13da90 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:44:50.753025 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c0e7a11c-deb1-4343-bc7f-62a24c13da90 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:44:50.756996 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:44:50.907790 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c0e7a11c-deb1-4343-bc7f-62a24c13da90 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:44:50.916050 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c0e7a11c-deb1-4343-bc7f-62a24c13da90 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/88bf9c0c-a369-4e47-bdf6-79bf59610fba" status: 200 len: 1565 microversion: 2.1 time: 0.188227 Jul 23 21:44:50.916678 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2756/5366] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:44:50 2022] GET /compute/v2.1/servers/88bf9c0c-a369-4e47-bdf6-79bf59610fba => generated 1565 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:44:50.932459 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-50694e20-a08f-44ae-8bb2-b1b10d04c281 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:44:50.933100 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-50694e20-a08f-44ae-8bb2-b1b10d04c281 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 88bf9c0c-a369-4e47-bdf6-79bf59610fba] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:44:50.939337 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-50694e20-a08f-44ae-8bb2-b1b10d04c281 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:44:50.939799 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-50694e20-a08f-44ae-8bb2-b1b10d04c281 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:44:50.940567 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-50694e20-a08f-44ae-8bb2-b1b10d04c281 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:44:50.941010 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-50694e20-a08f-44ae-8bb2-b1b10d04c281 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:44:51.071535 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-50694e20-a08f-44ae-8bb2-b1b10d04c281 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:44:51.080179 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-50694e20-a08f-44ae-8bb2-b1b10d04c281 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/88bf9c0c-a369-4e47-bdf6-79bf59610fba" status: 200 len: 1565 microversion: 2.1 time: 0.151431 Jul 23 21:44:51.080770 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2757/5367] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:44:50 2022] GET /compute/v2.1/servers/88bf9c0c-a369-4e47-bdf6-79bf59610fba => generated 1565 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:44:53.076631 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ec857447-2850-4556-9072-966f49014832 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:44:53.077455 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ec857447-2850-4556-9072-966f49014832 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 88bf9c0c-a369-4e47-bdf6-79bf59610fba] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:44:53.085000 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ec857447-2850-4556-9072-966f49014832 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:44:53.085533 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ec857447-2850-4556-9072-966f49014832 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:44:53.086431 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ec857447-2850-4556-9072-966f49014832 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:44:53.086951 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ec857447-2850-4556-9072-966f49014832 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:44:53.220695 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ec857447-2850-4556-9072-966f49014832 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:44:53.231317 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ec857447-2850-4556-9072-966f49014832 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/88bf9c0c-a369-4e47-bdf6-79bf59610fba" status: 200 len: 1565 microversion: 2.1 time: 0.159364 Jul 23 21:44:53.231966 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2758/5368] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:44:53 2022] GET /compute/v2.1/servers/88bf9c0c-a369-4e47-bdf6-79bf59610fba => generated 1565 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:44:53.236307 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-c1bb4990-2b52-44b1-b217-a53a66d5f4b6 req-4bec90b9-7d5a-4363-9457-e89e868bc942 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88bf9c0c-a369-4e47-bdf6-79bf59610fba", "tag": "8b152ebc-3dab-45b2-b138-594776b8447c"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:44:53.244462 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-c1bb4990-2b52-44b1-b217-a53a66d5f4b6 req-4bec90b9-7d5a-4363-9457-e89e868bc942 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:44:53.244913 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-c1bb4990-2b52-44b1-b217-a53a66d5f4b6 req-4bec90b9-7d5a-4363-9457-e89e868bc942 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:44:53.256382 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-c1bb4990-2b52-44b1-b217-a53a66d5f4b6 req-4bec90b9-7d5a-4363-9457-e89e868bc942 service nova] Creating event network-changed:8b152ebc-3dab-45b2-b138-594776b8447c for instance 88bf9c0c-a369-4e47-bdf6-79bf59610fba on nch1-master-1 Jul 23 21:44:53.261418 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-c1bb4990-2b52-44b1-b217-a53a66d5f4b6 req-4bec90b9-7d5a-4363-9457-e89e868bc942 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028358 Jul 23 21:44:53.262257 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2759/5369] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:44:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:45:14.520227 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=7 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:45:14.521045 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=19 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:45:14.525226 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a943e439-58fe-4bb5-9bd8-f3d54e6df3b8 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:45:14.526279 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a943e439-58fe-4bb5-9bd8-f3d54e6df3b8 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 88bf9c0c-a369-4e47-bdf6-79bf59610fba] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:45:14.533415 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a943e439-58fe-4bb5-9bd8-f3d54e6df3b8 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:45:14.533855 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a943e439-58fe-4bb5-9bd8-f3d54e6df3b8 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:45:14.534636 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a943e439-58fe-4bb5-9bd8-f3d54e6df3b8 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:45:14.535074 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a943e439-58fe-4bb5-9bd8-f3d54e6df3b8 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:45:14.599477 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a943e439-58fe-4bb5-9bd8-f3d54e6df3b8 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "POST /compute/v2.1/servers/88bf9c0c-a369-4e47-bdf6-79bf59610fba/action" status: 200 len: 24569 microversion: 2.1 time: 0.081199 Jul 23 21:45:14.600117 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2760/5370] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:45:14 2022] POST /compute/v2.1/servers/88bf9c0c-a369-4e47-bdf6-79bf59610fba/action => generated 24569 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 23 21:45:21.042079 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-793a2d19-5ad8-4b78-9054-2d796544e5c6 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:45:21.043634 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-793a2d19-5ad8-4b78-9054-2d796544e5c6 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 88bf9c0c-a369-4e47-bdf6-79bf59610fba] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:45:21.055640 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-793a2d19-5ad8-4b78-9054-2d796544e5c6 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:45:21.056430 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-793a2d19-5ad8-4b78-9054-2d796544e5c6 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:45:21.057698 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-793a2d19-5ad8-4b78-9054-2d796544e5c6 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:45:21.058491 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-793a2d19-5ad8-4b78-9054-2d796544e5c6 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:45:21.204072 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-793a2d19-5ad8-4b78-9054-2d796544e5c6 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:45:21.212272 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-793a2d19-5ad8-4b78-9054-2d796544e5c6 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/88bf9c0c-a369-4e47-bdf6-79bf59610fba" status: 200 len: 1684 microversion: 2.1 time: 0.177942 Jul 23 21:45:21.213126 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2761/5371] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:45:21 2022] GET /compute/v2.1/servers/88bf9c0c-a369-4e47-bdf6-79bf59610fba => generated 1684 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:45:21.325956 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c271f398-b8e0-4ba1-9f1f-1290bc09eb7f tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:45:21.326968 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c271f398-b8e0-4ba1-9f1f-1290bc09eb7f tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 88bf9c0c-a369-4e47-bdf6-79bf59610fba] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:45:21.333978 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c271f398-b8e0-4ba1-9f1f-1290bc09eb7f tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:45:21.334405 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c271f398-b8e0-4ba1-9f1f-1290bc09eb7f tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:45:21.335164 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c271f398-b8e0-4ba1-9f1f-1290bc09eb7f tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:45:21.335593 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c271f398-b8e0-4ba1-9f1f-1290bc09eb7f tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:45:21.400013 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c271f398-b8e0-4ba1-9f1f-1290bc09eb7f tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "POST /compute/v2.1/servers/88bf9c0c-a369-4e47-bdf6-79bf59610fba/action" status: 200 len: 32644 microversion: 2.1 time: 0.078118 Jul 23 21:45:21.400531 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2762/5372] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:45:21 2022] POST /compute/v2.1/servers/88bf9c0c-a369-4e47-bdf6-79bf59610fba/action => generated 32644 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 23 21:45:21.570532 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c3469bc0-4bb0-4b2c-867d-5e5f186597e2 tempest-TestNetworkAdvancedServerOps-377287141 tempest-TestNetworkAdvancedServerOps-377287141-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:45:21.571697 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c3469bc0-4bb0-4b2c-867d-5e5f186597e2 tempest-TestNetworkAdvancedServerOps-377287141 tempest-TestNetworkAdvancedServerOps-377287141-project-admin] [instance: 88bf9c0c-a369-4e47-bdf6-79bf59610fba] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:45:21.581572 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c3469bc0-4bb0-4b2c-867d-5e5f186597e2 tempest-TestNetworkAdvancedServerOps-377287141 tempest-TestNetworkAdvancedServerOps-377287141-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:45:21.582202 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c3469bc0-4bb0-4b2c-867d-5e5f186597e2 tempest-TestNetworkAdvancedServerOps-377287141 tempest-TestNetworkAdvancedServerOps-377287141-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:45:21.582828 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c3469bc0-4bb0-4b2c-867d-5e5f186597e2 tempest-TestNetworkAdvancedServerOps-377287141 tempest-TestNetworkAdvancedServerOps-377287141-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:45:21.583266 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c3469bc0-4bb0-4b2c-867d-5e5f186597e2 tempest-TestNetworkAdvancedServerOps-377287141 tempest-TestNetworkAdvancedServerOps-377287141-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:45:21.718699 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c3469bc0-4bb0-4b2c-867d-5e5f186597e2 tempest-TestNetworkAdvancedServerOps-377287141 tempest-TestNetworkAdvancedServerOps-377287141-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/88bf9c0c-a369-4e47-bdf6-79bf59610fba" status: 200 len: 1835 microversion: 2.1 time: 0.156012 Jul 23 21:45:21.719248 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2763/5373] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:45:21 2022] GET /compute/v2.1/servers/88bf9c0c-a369-4e47-bdf6-79bf59610fba => generated 1835 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:45:21.741977 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-56c12124-2709-4ee0-8cc9-6a04845a9f4d tempest-TestNetworkAdvancedServerOps-377287141 tempest-TestNetworkAdvancedServerOps-377287141-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:45:21.743120 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-56c12124-2709-4ee0-8cc9-6a04845a9f4d tempest-TestNetworkAdvancedServerOps-377287141 tempest-TestNetworkAdvancedServerOps-377287141-project-admin] [instance: 88bf9c0c-a369-4e47-bdf6-79bf59610fba] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:45:21.749656 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-56c12124-2709-4ee0-8cc9-6a04845a9f4d tempest-TestNetworkAdvancedServerOps-377287141 tempest-TestNetworkAdvancedServerOps-377287141-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:45:21.750140 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-56c12124-2709-4ee0-8cc9-6a04845a9f4d tempest-TestNetworkAdvancedServerOps-377287141 tempest-TestNetworkAdvancedServerOps-377287141-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:45:21.750927 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-56c12124-2709-4ee0-8cc9-6a04845a9f4d tempest-TestNetworkAdvancedServerOps-377287141 tempest-TestNetworkAdvancedServerOps-377287141-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:45:21.751337 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-56c12124-2709-4ee0-8cc9-6a04845a9f4d tempest-TestNetworkAdvancedServerOps-377287141 tempest-TestNetworkAdvancedServerOps-377287141-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:45:21.776880 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.objects.instance [None req-56c12124-2709-4ee0-8cc9-6a04845a9f4d tempest-TestNetworkAdvancedServerOps-377287141 tempest-TestNetworkAdvancedServerOps-377287141-project-admin] Lazy-loading 'flavor' on Instance uuid 88bf9c0c-a369-4e47-bdf6-79bf59610fba {{(pid=131320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 21:45:21.788948 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-56c12124-2709-4ee0-8cc9-6a04845a9f4d tempest-TestNetworkAdvancedServerOps-377287141 tempest-TestNetworkAdvancedServerOps-377287141-project-admin] [instance: 88bf9c0c-a369-4e47-bdf6-79bf59610fba] Going to try to live migrate instance to another host {{(pid=131320) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 23 21:45:23.106401 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-56c12124-2709-4ee0-8cc9-6a04845a9f4d tempest-TestNetworkAdvancedServerOps-377287141 tempest-TestNetworkAdvancedServerOps-377287141-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/88bf9c0c-a369-4e47-bdf6-79bf59610fba/action" status: 202 len: 0 microversion: 2.1 time: 1.368181 Jul 23 21:45:23.107112 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2764/5374] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:45:21 2022] POST /compute/v2.1/servers/88bf9c0c-a369-4e47-bdf6-79bf59610fba/action => generated 0 bytes in 1370 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:45:23.116576 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-dc240b12-a14c-485f-8a3b-60845c8daa78 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:45:23.117171 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-dc240b12-a14c-485f-8a3b-60845c8daa78 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 88bf9c0c-a369-4e47-bdf6-79bf59610fba] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:45:23.125380 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dc240b12-a14c-485f-8a3b-60845c8daa78 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:45:23.125821 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dc240b12-a14c-485f-8a3b-60845c8daa78 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:45:23.126649 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dc240b12-a14c-485f-8a3b-60845c8daa78 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:45:23.127095 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dc240b12-a14c-485f-8a3b-60845c8daa78 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:45:23.262900 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-dc240b12-a14c-485f-8a3b-60845c8daa78 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:45:23.270646 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-dc240b12-a14c-485f-8a3b-60845c8daa78 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/88bf9c0c-a369-4e47-bdf6-79bf59610fba" status: 200 len: 1694 microversion: 2.1 time: 0.158174 Jul 23 21:45:23.271211 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2765/5375] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:45:23 2022] GET /compute/v2.1/servers/88bf9c0c-a369-4e47-bdf6-79bf59610fba => generated 1694 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:45:24.202626 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-3b221e62-aafc-48a3-b134-d3d07f0e7032 req-ebb32567-64f3-4af2-bd90-5c4aab61bc1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88bf9c0c-a369-4e47-bdf6-79bf59610fba", "name": "network-vif-unplugged", "status": "completed", "tag": "8b152ebc-3dab-45b2-b138-594776b8447c"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:45:24.213173 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-3b221e62-aafc-48a3-b134-d3d07f0e7032 req-ebb32567-64f3-4af2-bd90-5c4aab61bc1f service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:45:24.213628 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-3b221e62-aafc-48a3-b134-d3d07f0e7032 req-ebb32567-64f3-4af2-bd90-5c4aab61bc1f service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:45:24.225073 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-3b221e62-aafc-48a3-b134-d3d07f0e7032 req-ebb32567-64f3-4af2-bd90-5c4aab61bc1f service nova] Creating event network-vif-unplugged:8b152ebc-3dab-45b2-b138-594776b8447c for instance 88bf9c0c-a369-4e47-bdf6-79bf59610fba on nch1-master-1 Jul 23 21:45:24.230274 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-3b221e62-aafc-48a3-b134-d3d07f0e7032 req-ebb32567-64f3-4af2-bd90-5c4aab61bc1f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032400 Jul 23 21:45:24.231290 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2766/5376] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:45:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:45:24.289806 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-7278c3be-ae74-4e47-96f9-3ba43d2e3b79 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:45:24.290546 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-7278c3be-ae74-4e47-96f9-3ba43d2e3b79 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 88bf9c0c-a369-4e47-bdf6-79bf59610fba] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:45:24.301547 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7278c3be-ae74-4e47-96f9-3ba43d2e3b79 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:45:24.302462 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7278c3be-ae74-4e47-96f9-3ba43d2e3b79 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:45:24.303115 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7278c3be-ae74-4e47-96f9-3ba43d2e3b79 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:45:24.303657 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7278c3be-ae74-4e47-96f9-3ba43d2e3b79 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:45:24.509063 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-7278c3be-ae74-4e47-96f9-3ba43d2e3b79 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:45:24.517708 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-7278c3be-ae74-4e47-96f9-3ba43d2e3b79 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/88bf9c0c-a369-4e47-bdf6-79bf59610fba" status: 200 len: 1694 microversion: 2.1 time: 0.232304 Jul 23 21:45:24.518339 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2767/5377] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:45:24 2022] GET /compute/v2.1/servers/88bf9c0c-a369-4e47-bdf6-79bf59610fba => generated 1694 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:45:25.539320 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d69a7b5e-047a-487a-aafa-b16862193f7a tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:45:25.540381 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d69a7b5e-047a-487a-aafa-b16862193f7a tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 88bf9c0c-a369-4e47-bdf6-79bf59610fba] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:45:25.552185 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d69a7b5e-047a-487a-aafa-b16862193f7a tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:45:25.552946 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d69a7b5e-047a-487a-aafa-b16862193f7a tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:45:25.554298 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d69a7b5e-047a-487a-aafa-b16862193f7a tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:45:25.555028 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d69a7b5e-047a-487a-aafa-b16862193f7a tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:45:25.695813 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d69a7b5e-047a-487a-aafa-b16862193f7a tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:45:25.707502 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d69a7b5e-047a-487a-aafa-b16862193f7a tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/88bf9c0c-a369-4e47-bdf6-79bf59610fba" status: 200 len: 1694 microversion: 2.1 time: 0.174827 Jul 23 21:45:25.708332 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2768/5378] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:45:25 2022] GET /compute/v2.1/servers/88bf9c0c-a369-4e47-bdf6-79bf59610fba => generated 1694 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:45:26.250395 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-f0f476ab-61dd-4900-9718-1b20b3539234 req-30aee1c5-c7ca-4229-8dcc-fb99b09e0f0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88bf9c0c-a369-4e47-bdf6-79bf59610fba", "tag": "8b152ebc-3dab-45b2-b138-594776b8447c"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:45:26.258959 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-f0f476ab-61dd-4900-9718-1b20b3539234 req-30aee1c5-c7ca-4229-8dcc-fb99b09e0f0e service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:45:26.259400 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-f0f476ab-61dd-4900-9718-1b20b3539234 req-30aee1c5-c7ca-4229-8dcc-fb99b09e0f0e service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:45:26.273252 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-f0f476ab-61dd-4900-9718-1b20b3539234 req-30aee1c5-c7ca-4229-8dcc-fb99b09e0f0e service nova] Creating event network-changed:8b152ebc-3dab-45b2-b138-594776b8447c for instance 88bf9c0c-a369-4e47-bdf6-79bf59610fba on nch1-master-1 Jul 23 21:45:26.278547 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-f0f476ab-61dd-4900-9718-1b20b3539234 req-30aee1c5-c7ca-4229-8dcc-fb99b09e0f0e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033160 Jul 23 21:45:26.279218 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2769/5379] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:45:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:45:26.728628 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3a275ec4-2e9a-4833-b968-2937fb5b27ba tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:45:26.729299 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-3a275ec4-2e9a-4833-b968-2937fb5b27ba tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 88bf9c0c-a369-4e47-bdf6-79bf59610fba] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:45:26.736803 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3a275ec4-2e9a-4833-b968-2937fb5b27ba tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:45:26.737297 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3a275ec4-2e9a-4833-b968-2937fb5b27ba tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:45:26.738106 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3a275ec4-2e9a-4833-b968-2937fb5b27ba tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:45:26.738537 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3a275ec4-2e9a-4833-b968-2937fb5b27ba tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:45:26.922336 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-3a275ec4-2e9a-4833-b968-2937fb5b27ba tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:45:26.933103 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-3a275ec4-2e9a-4833-b968-2937fb5b27ba tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/88bf9c0c-a369-4e47-bdf6-79bf59610fba" status: 200 len: 1694 microversion: 2.1 time: 0.208773 Jul 23 21:45:26.942636 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2770/5380] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:45:26 2022] GET /compute/v2.1/servers/88bf9c0c-a369-4e47-bdf6-79bf59610fba => generated 1694 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:45:27.951189 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-fd310f2f-d624-40ec-a6db-1f769698f369 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:45:27.951765 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-fd310f2f-d624-40ec-a6db-1f769698f369 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 88bf9c0c-a369-4e47-bdf6-79bf59610fba] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:45:27.959782 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fd310f2f-d624-40ec-a6db-1f769698f369 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:45:27.960233 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fd310f2f-d624-40ec-a6db-1f769698f369 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:45:27.961009 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fd310f2f-d624-40ec-a6db-1f769698f369 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:45:27.961442 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fd310f2f-d624-40ec-a6db-1f769698f369 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:45:28.092865 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-fd310f2f-d624-40ec-a6db-1f769698f369 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:45:28.101571 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-fd310f2f-d624-40ec-a6db-1f769698f369 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/88bf9c0c-a369-4e47-bdf6-79bf59610fba" status: 200 len: 1694 microversion: 2.1 time: 0.154753 Jul 23 21:45:28.105196 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2771/5381] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:45:27 2022] GET /compute/v2.1/servers/88bf9c0c-a369-4e47-bdf6-79bf59610fba => generated 1694 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:45:29.126040 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-09b9708f-ff25-46ac-b66b-d7b040222b2d tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:45:29.127095 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-09b9708f-ff25-46ac-b66b-d7b040222b2d tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 88bf9c0c-a369-4e47-bdf6-79bf59610fba] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:45:29.138885 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-09b9708f-ff25-46ac-b66b-d7b040222b2d tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:45:29.139326 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-09b9708f-ff25-46ac-b66b-d7b040222b2d tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:45:29.140109 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-09b9708f-ff25-46ac-b66b-d7b040222b2d tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:45:29.140580 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-09b9708f-ff25-46ac-b66b-d7b040222b2d tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:45:29.290797 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-09b9708f-ff25-46ac-b66b-d7b040222b2d tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:45:29.301828 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-09b9708f-ff25-46ac-b66b-d7b040222b2d tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/88bf9c0c-a369-4e47-bdf6-79bf59610fba" status: 200 len: 1694 microversion: 2.1 time: 0.182183 Jul 23 21:45:29.302735 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2772/5382] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:45:29 2022] GET /compute/v2.1/servers/88bf9c0c-a369-4e47-bdf6-79bf59610fba => generated 1694 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:45:29.933378 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-98db8836-e8e6-4db4-9473-35634c29585c req-1552fc7c-db79-4a80-8d9b-f48bd16d2c80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88bf9c0c-a369-4e47-bdf6-79bf59610fba", "name": "network-vif-unplugged", "status": "completed", "tag": "8b152ebc-3dab-45b2-b138-594776b8447c"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:45:29.941838 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-98db8836-e8e6-4db4-9473-35634c29585c req-1552fc7c-db79-4a80-8d9b-f48bd16d2c80 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:45:29.942398 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-98db8836-e8e6-4db4-9473-35634c29585c req-1552fc7c-db79-4a80-8d9b-f48bd16d2c80 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:45:29.954421 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-98db8836-e8e6-4db4-9473-35634c29585c req-1552fc7c-db79-4a80-8d9b-f48bd16d2c80 service nova] Creating event network-vif-unplugged:8b152ebc-3dab-45b2-b138-594776b8447c for instance 88bf9c0c-a369-4e47-bdf6-79bf59610fba on nch1-master-1 Jul 23 21:45:29.959729 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-98db8836-e8e6-4db4-9473-35634c29585c req-1552fc7c-db79-4a80-8d9b-f48bd16d2c80 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030023 Jul 23 21:45:29.960337 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2773/5383] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:45:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:45:30.321983 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-edbfe6ba-2fdd-4aba-a739-c0f9ee06652e tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:45:30.322651 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-edbfe6ba-2fdd-4aba-a739-c0f9ee06652e tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 88bf9c0c-a369-4e47-bdf6-79bf59610fba] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:45:30.330531 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-edbfe6ba-2fdd-4aba-a739-c0f9ee06652e tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:45:30.330916 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-edbfe6ba-2fdd-4aba-a739-c0f9ee06652e tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:45:30.331689 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-edbfe6ba-2fdd-4aba-a739-c0f9ee06652e tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:45:30.332098 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-edbfe6ba-2fdd-4aba-a739-c0f9ee06652e tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:45:30.539544 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-edbfe6ba-2fdd-4aba-a739-c0f9ee06652e tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:45:30.547824 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-edbfe6ba-2fdd-4aba-a739-c0f9ee06652e tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/88bf9c0c-a369-4e47-bdf6-79bf59610fba" status: 200 len: 1694 microversion: 2.1 time: 0.230133 Jul 23 21:45:30.548402 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2774/5384] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:45:30 2022] GET /compute/v2.1/servers/88bf9c0c-a369-4e47-bdf6-79bf59610fba => generated 1694 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:45:31.621718 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e56e3191-0b50-42b3-b0e8-56f2e20fef68 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:45:31.622350 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e56e3191-0b50-42b3-b0e8-56f2e20fef68 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 88bf9c0c-a369-4e47-bdf6-79bf59610fba] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:45:31.628963 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e56e3191-0b50-42b3-b0e8-56f2e20fef68 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:45:31.629416 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e56e3191-0b50-42b3-b0e8-56f2e20fef68 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:45:31.630214 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e56e3191-0b50-42b3-b0e8-56f2e20fef68 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:45:31.630651 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e56e3191-0b50-42b3-b0e8-56f2e20fef68 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:45:31.779024 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e56e3191-0b50-42b3-b0e8-56f2e20fef68 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:45:31.786915 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e56e3191-0b50-42b3-b0e8-56f2e20fef68 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/88bf9c0c-a369-4e47-bdf6-79bf59610fba" status: 200 len: 1684 microversion: 2.1 time: 0.224598 Jul 23 21:45:31.787500 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2775/5385] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:45:31 2022] GET /compute/v2.1/servers/88bf9c0c-a369-4e47-bdf6-79bf59610fba => generated 1684 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:45:31.803032 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-80beddd6-d13a-474b-84e5-0a1328e588a2 tempest-TestNetworkAdvancedServerOps-377287141 tempest-TestNetworkAdvancedServerOps-377287141-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:45:31.803632 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-80beddd6-d13a-474b-84e5-0a1328e588a2 tempest-TestNetworkAdvancedServerOps-377287141 tempest-TestNetworkAdvancedServerOps-377287141-project-admin] [instance: 88bf9c0c-a369-4e47-bdf6-79bf59610fba] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:45:31.809730 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-80beddd6-d13a-474b-84e5-0a1328e588a2 tempest-TestNetworkAdvancedServerOps-377287141 tempest-TestNetworkAdvancedServerOps-377287141-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:45:31.810238 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-80beddd6-d13a-474b-84e5-0a1328e588a2 tempest-TestNetworkAdvancedServerOps-377287141 tempest-TestNetworkAdvancedServerOps-377287141-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:45:31.811003 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-80beddd6-d13a-474b-84e5-0a1328e588a2 tempest-TestNetworkAdvancedServerOps-377287141 tempest-TestNetworkAdvancedServerOps-377287141-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:45:31.811456 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-80beddd6-d13a-474b-84e5-0a1328e588a2 tempest-TestNetworkAdvancedServerOps-377287141 tempest-TestNetworkAdvancedServerOps-377287141-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:45:31.951014 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-80beddd6-d13a-474b-84e5-0a1328e588a2 tempest-TestNetworkAdvancedServerOps-377287141 tempest-TestNetworkAdvancedServerOps-377287141-project-admin] 10.222.0.17 "GET /compute/v2.1/servers/88bf9c0c-a369-4e47-bdf6-79bf59610fba" status: 200 len: 1835 microversion: 2.1 time: 0.151436 Jul 23 21:45:31.951610 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2776/5386] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:45:31 2022] GET /compute/v2.1/servers/88bf9c0c-a369-4e47-bdf6-79bf59610fba => generated 1835 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:45:31.968033 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-baac7d02-b8ba-43b2-ac84-4f3a9f902dac tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:45:31.968639 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-baac7d02-b8ba-43b2-ac84-4f3a9f902dac tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 88bf9c0c-a369-4e47-bdf6-79bf59610fba] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:45:31.974812 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-baac7d02-b8ba-43b2-ac84-4f3a9f902dac tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:45:31.975267 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-baac7d02-b8ba-43b2-ac84-4f3a9f902dac tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:45:31.976039 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-baac7d02-b8ba-43b2-ac84-4f3a9f902dac tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:45:31.976482 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-baac7d02-b8ba-43b2-ac84-4f3a9f902dac tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:45:31.994876 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:45:32.130455 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-baac7d02-b8ba-43b2-ac84-4f3a9f902dac tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:45:32.153979 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-baac7d02-b8ba-43b2-ac84-4f3a9f902dac tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/88bf9c0c-a369-4e47-bdf6-79bf59610fba" status: 200 len: 1684 microversion: 2.1 time: 0.178028 Jul 23 21:45:32.153979 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2777/5387] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:45:31 2022] GET /compute/v2.1/servers/88bf9c0c-a369-4e47-bdf6-79bf59610fba => generated 1684 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:45:32.235514 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-cc0abed1-171e-4076-90b9-6aebda270cbd tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:45:32.236614 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-cc0abed1-171e-4076-90b9-6aebda270cbd tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 88bf9c0c-a369-4e47-bdf6-79bf59610fba] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:45:32.243673 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cc0abed1-171e-4076-90b9-6aebda270cbd tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:45:32.244442 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cc0abed1-171e-4076-90b9-6aebda270cbd tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:45:32.244993 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cc0abed1-171e-4076-90b9-6aebda270cbd tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:45:32.245471 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cc0abed1-171e-4076-90b9-6aebda270cbd tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:45:32.297464 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-cc0abed1-171e-4076-90b9-6aebda270cbd tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "POST /compute/v2.1/servers/88bf9c0c-a369-4e47-bdf6-79bf59610fba/action" status: 200 len: 38523 microversion: 2.1 time: 0.065709 Jul 23 21:45:32.298432 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2778/5388] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:45:32 2022] POST /compute/v2.1/servers/88bf9c0c-a369-4e47-bdf6-79bf59610fba/action => generated 38523 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 23 21:45:33.294220 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e356cc04-ea15-4a50-b832-c039a8fe03aa tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:45:33.294920 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e356cc04-ea15-4a50-b832-c039a8fe03aa tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 88bf9c0c-a369-4e47-bdf6-79bf59610fba] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:45:33.302848 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e356cc04-ea15-4a50-b832-c039a8fe03aa tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:45:33.303307 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e356cc04-ea15-4a50-b832-c039a8fe03aa tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:45:33.304102 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e356cc04-ea15-4a50-b832-c039a8fe03aa tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:45:33.304544 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e356cc04-ea15-4a50-b832-c039a8fe03aa tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:45:33.331284 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e356cc04-ea15-4a50-b832-c039a8fe03aa tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 88bf9c0c-a369-4e47-bdf6-79bf59610fba] Going to try to terminate instance {{(pid=131320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:45:33.415569 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e356cc04-ea15-4a50-b832-c039a8fe03aa tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "DELETE /compute/v2.1/servers/88bf9c0c-a369-4e47-bdf6-79bf59610fba" status: 204 len: 0 microversion: 2.1 time: 0.125613 Jul 23 21:45:33.416485 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2779/5389] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:45:33 2022] DELETE /compute/v2.1/servers/88bf9c0c-a369-4e47-bdf6-79bf59610fba => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:45:33.421546 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-d1b2c3fe-c191-4972-be54-d93c4d06531b req-0dfcaa81-5481-45f7-beb3-a782e595908c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88bf9c0c-a369-4e47-bdf6-79bf59610fba", "tag": "8b152ebc-3dab-45b2-b138-594776b8447c"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:45:33.429596 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-d1b2c3fe-c191-4972-be54-d93c4d06531b req-0dfcaa81-5481-45f7-beb3-a782e595908c service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:45:33.430084 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-d1b2c3fe-c191-4972-be54-d93c4d06531b req-0dfcaa81-5481-45f7-beb3-a782e595908c service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:45:33.441401 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-d1b2c3fe-c191-4972-be54-d93c4d06531b req-0dfcaa81-5481-45f7-beb3-a782e595908c service nova] Creating event network-changed:8b152ebc-3dab-45b2-b138-594776b8447c for instance 88bf9c0c-a369-4e47-bdf6-79bf59610fba on nch2-master-1 Jul 23 21:45:33.446301 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-d1b2c3fe-c191-4972-be54-d93c4d06531b req-0dfcaa81-5481-45f7-beb3-a782e595908c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028810 Jul 23 21:45:33.446847 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2780/5390] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:45:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:45:33.455512 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-11739f1b-5dac-43d2-8c1a-4de962ed7d68 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:45:33.456207 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-11739f1b-5dac-43d2-8c1a-4de962ed7d68 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 88bf9c0c-a369-4e47-bdf6-79bf59610fba] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:45:33.462393 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-11739f1b-5dac-43d2-8c1a-4de962ed7d68 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:45:33.462840 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-11739f1b-5dac-43d2-8c1a-4de962ed7d68 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:45:33.463602 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-11739f1b-5dac-43d2-8c1a-4de962ed7d68 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:45:33.464056 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-11739f1b-5dac-43d2-8c1a-4de962ed7d68 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:45:33.604267 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-11739f1b-5dac-43d2-8c1a-4de962ed7d68 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:45:33.613164 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-11739f1b-5dac-43d2-8c1a-4de962ed7d68 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/88bf9c0c-a369-4e47-bdf6-79bf59610fba" status: 200 len: 1690 microversion: 2.1 time: 0.162044 Jul 23 21:45:33.614082 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2781/5391] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:45:33 2022] GET /compute/v2.1/servers/88bf9c0c-a369-4e47-bdf6-79bf59610fba => generated 1690 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:45:34.631466 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-01425cff-7815-4845-a9df-a63390e679e4 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:45:34.632136 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-01425cff-7815-4845-a9df-a63390e679e4 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 88bf9c0c-a369-4e47-bdf6-79bf59610fba] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:45:34.639526 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-01425cff-7815-4845-a9df-a63390e679e4 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:45:34.639983 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-01425cff-7815-4845-a9df-a63390e679e4 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:45:34.640771 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-01425cff-7815-4845-a9df-a63390e679e4 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:45:34.641210 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-01425cff-7815-4845-a9df-a63390e679e4 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:45:34.878786 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-01425cff-7815-4845-a9df-a63390e679e4 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:45:34.889058 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-01425cff-7815-4845-a9df-a63390e679e4 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/88bf9c0c-a369-4e47-bdf6-79bf59610fba" status: 200 len: 1690 microversion: 2.1 time: 0.261436 Jul 23 21:45:34.898866 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2782/5392] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:45:34 2022] GET /compute/v2.1/servers/88bf9c0c-a369-4e47-bdf6-79bf59610fba => generated 1690 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:45:34.898866 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-739d3c3f-429c-4ed3-9538-fde9058280e8 req-c627579f-8174-42d2-9e4b-b0b41ff18a1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88bf9c0c-a369-4e47-bdf6-79bf59610fba", "name": "network-vif-deleted", "tag": "8b152ebc-3dab-45b2-b138-594776b8447c"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:45:34.903182 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-739d3c3f-429c-4ed3-9538-fde9058280e8 req-c627579f-8174-42d2-9e4b-b0b41ff18a1a service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:45:34.903664 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-739d3c3f-429c-4ed3-9538-fde9058280e8 req-c627579f-8174-42d2-9e4b-b0b41ff18a1a service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:45:34.916201 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-739d3c3f-429c-4ed3-9538-fde9058280e8 req-c627579f-8174-42d2-9e4b-b0b41ff18a1a service nova] Creating event network-vif-deleted:8b152ebc-3dab-45b2-b138-594776b8447c for instance 88bf9c0c-a369-4e47-bdf6-79bf59610fba on nch2-master-1 Jul 23 21:45:34.920950 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-739d3c3f-429c-4ed3-9538-fde9058280e8 req-c627579f-8174-42d2-9e4b-b0b41ff18a1a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029596 Jul 23 21:45:34.921509 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2783/5393] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:45:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:45:35.907938 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6fe43999-01c4-4c84-85eb-f7a7ad64a905 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:45:35.908644 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6fe43999-01c4-4c84-85eb-f7a7ad64a905 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 88bf9c0c-a369-4e47-bdf6-79bf59610fba] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:45:35.916744 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6fe43999-01c4-4c84-85eb-f7a7ad64a905 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:45:35.917198 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6fe43999-01c4-4c84-85eb-f7a7ad64a905 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:45:35.918029 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6fe43999-01c4-4c84-85eb-f7a7ad64a905 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:45:35.918450 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6fe43999-01c4-4c84-85eb-f7a7ad64a905 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:45:35.935398 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-6fe43999-01c4-4c84-85eb-f7a7ad64a905 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] HTTP exception thrown: Instance 88bf9c0c-a369-4e47-bdf6-79bf59610fba could not be found. Jul 23 21:45:35.937174 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6fe43999-01c4-4c84-85eb-f7a7ad64a905 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Request method failure captured: Jul 23 21:45:35.937174 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/88bf9c0c-a369-4e47-bdf6-79bf59610fba HTTP/1.1 Jul 23 21:45:35.937174 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:45:35.937174 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:45:35.937174 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:45:35.937174 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:45:35.937174 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:45:35.937174 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:45:35.937174 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:45:35.937174 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:45:35.937174 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GrOSfKcmvIg8CybJuZ211K2BCk2kV9XXJD4t1iLnpDMxE7Pkx25elWArE6eyR4tr0Iwox8ke0DWSoqvidEJT8OIHAfji6eadcJDPEeLIK5RaEi7u5O4vXMbwe3kSZZq8MYGsBh4KdQThoYiwMI-IDxUERCe5nBEmFyUK5SxchL_LMo Jul 23 21:45:35.937174 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:45:35.937174 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:45:35.937174 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:45:35.937174 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:45:35.937174 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:45:35.937174 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:45:35.937174 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 36bd2862980e45849b0d3fc3f52a6926 Jul 23 21:45:35.937174 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1607830774 Jul 23 21:45:35.937174 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:45:35.937174 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:45:35.937174 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/36bd2862980e45849b0d3fc3f52a6926"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/36bd2862980e45849b0d3fc3f52a6926"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_36bd2862980e45849b0d3fc3f52a6926", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/36bd2862980e45849b0d3fc3f52a6926"}]}] Jul 23 21:45:35.937174 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1607830774 Jul 23 21:45:35.937174 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 36bd2862980e45849b0d3fc3f52a6926 Jul 23 21:45:35.937174 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1607830774 Jul 23 21:45:35.937174 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-TestNetworkAdvancedServerOps-1607830774-project Jul 23 21:45:35.937174 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:45:35.937174 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:45:35.937174 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 96ade420fd324acfb57e4ac81bfece9e Jul 23 21:45:35.937174 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1607830774-project Jul 23 21:45:35.937174 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:45:35.937174 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance 88bf9c0c-a369-4e47-bdf6-79bf59610fba could not be found. Jul 23 21:45:35.937174 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '88bf9c0c-a369-4e47-bdf6-79bf59610fba'} Jul 23 21:45:35.937174 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:45:35.937174 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:45:35.937174 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:45:35.937174 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:45:35.937174 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:45:35.937174 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:45:35.937174 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:45:35.937174 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:45:35.937174 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:45:35.937174 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:45:35.937174 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88bf9c0c-a369-4e47-bdf6-79bf59610fba could not be found. Jul 23 21:45:35.937174 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:45:35.937174 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:45:35.937174 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:45:35.937174 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:45:35.937174 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:45:35.937174 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:45:35.937174 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:45:35.937174 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:45:35.937174 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:45:35.937174 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:45:35.937174 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:45:35.937174 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:45:35.937174 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:45:35.937174 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:45:35.937174 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:45:35.937174 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:45:35.937174 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88bf9c0c-a369-4e47-bdf6-79bf59610fba could not be found. Jul 23 21:45:35.937174 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:45:35.937174 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:45:35.941642 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:45:35.941642 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:45:35.941642 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:45:35.941642 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:45:35.941642 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:45:35.941642 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:45:35.941642 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88bf9c0c-a369-4e47-bdf6-79bf59610fba could not be found. Jul 23 21:45:35.941642 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:45:35.941642 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6fe43999-01c4-4c84-85eb-f7a7ad64a905 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Returning 404 to user: Instance 88bf9c0c-a369-4e47-bdf6-79bf59610fba could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:45:35.941642 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6fe43999-01c4-4c84-85eb-f7a7ad64a905 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/88bf9c0c-a369-4e47-bdf6-79bf59610fba" status: 404 len: 111 microversion: 2.1 time: 0.035249 Jul 23 21:45:35.941642 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2784/5394] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:45:35 2022] GET /compute/v2.1/servers/88bf9c0c-a369-4e47-bdf6-79bf59610fba => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:45:38.981381 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b560591c-e380-40ca-a950-0c3e18e385fd tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '.version_select at 0x7f0b598c9040>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:45:39.018614 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b560591c-e380-40ca-a950-0c3e18e385fd tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-434634966" status: 202 len: 0 microversion: 2.1 time: 0.041135 Jul 23 21:45:39.022766 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2785/5395] 10.222.0.17 () {58 vars in 1280 bytes} [Sat Jul 23 21:45:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-434634966 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:45:39.049109 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1cf3dc3b-0db6-43e2-9be2-3d5ec0c9d252 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Action: 'create', calling method: .version_select at 0x7f0b4659e700>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-636155688", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI7anqjWAnnXOx8qxUdLTGR9UkOazRpO+MKMOTtrEwClv6GoeNv2SHCE7WFE1mYBDKJ1RHmmdlLHwvEPYr6nSoCjXAZT1TlBTFhLA+Vkq2vCymM3M5QKJDgc2mbvAJiNIg=="}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:45:39.065056 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-1cf3dc3b-0db6-43e2-9be2-3d5ec0c9d252 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Getting quotas for project 36bd2862980e45849b0d3fc3f52a6926. Resources: {'key_pairs'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:45:39.070505 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-1cf3dc3b-0db6-43e2-9be2-3d5ec0c9d252 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Getting quotas for user 96ade420fd324acfb57e4ac81bfece9e and project 36bd2862980e45849b0d3fc3f52a6926. Resources: {'key_pairs'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:45:39.095748 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1cf3dc3b-0db6-43e2-9be2-3d5ec0c9d252 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.050582 Jul 23 21:45:39.096526 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2786/5396] 10.222.0.17 () {60 vars in 1158 bytes} [Sat Jul 23 21:45:39 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:45:45.286177 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-84b0a8e0-4a02-43ea-9e8b-af6bd7da2099 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-81952769", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "networks": [{"uuid": "2123cab7-f680-4d2d-bd87-507f657ac6d7"}], "key_name": "tempest-TestNetworkAdvancedServerOps-636155688", "security_groups": [{"name": "tempest-secgroup-smoke-2125580283"}]}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:45:45.296321 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:45:45.423328 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-84b0a8e0-4a02-43ea-9e8b-af6bd7da2099 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] validate_networks() for [('2123cab7-f680-4d2d-bd87-507f657ac6d7', None, None, None, None, None)] {{(pid=131320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:45:45.811364 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-84b0a8e0-4a02-43ea-9e8b-af6bd7da2099 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:45:45.811796 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-84b0a8e0-4a02-43ea-9e8b-af6bd7da2099 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:45:45.812729 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-84b0a8e0-4a02-43ea-9e8b-af6bd7da2099 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:45:45.813315 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-84b0a8e0-4a02-43ea-9e8b-af6bd7da2099 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:45:45.813999 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-84b0a8e0-4a02-43ea-9e8b-af6bd7da2099 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:45:45.824146 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-84b0a8e0-4a02-43ea-9e8b-af6bd7da2099 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:45:45.824891 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-84b0a8e0-4a02-43ea-9e8b-af6bd7da2099 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:45:45.825710 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-84b0a8e0-4a02-43ea-9e8b-af6bd7da2099 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:45:45.826163 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-84b0a8e0-4a02-43ea-9e8b-af6bd7da2099 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:45:45.845519 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-84b0a8e0-4a02-43ea-9e8b-af6bd7da2099 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Getting quotas for project 36bd2862980e45849b0d3fc3f52a6926. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:45:45.851043 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-84b0a8e0-4a02-43ea-9e8b-af6bd7da2099 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Getting quotas for user 96ade420fd324acfb57e4ac81bfece9e and project 36bd2862980e45849b0d3fc3f52a6926. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:45:45.863960 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-84b0a8e0-4a02-43ea-9e8b-af6bd7da2099 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Going to run 1 instances... {{(pid=131320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:45:45.866574 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-84b0a8e0-4a02-43ea-9e8b-af6bd7da2099 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:45:45.915715 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-84b0a8e0-4a02-43ea-9e8b-af6bd7da2099 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.633590 Jul 23 21:45:45.916548 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2787/5397] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:45:45 2022] POST /compute/v2.1/servers => generated 406 bytes in 635 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 23 21:45:45.926706 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c3ca399a-61d2-4535-9f18-6533255083ce tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:45:45.927323 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c3ca399a-61d2-4535-9f18-6533255083ce tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:45:45.996469 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c3ca399a-61d2-4535-9f18-6533255083ce tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:45:46.003572 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c3ca399a-61d2-4535-9f18-6533255083ce tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f" status: 200 len: 1264 microversion: 2.1 time: 0.080811 Jul 23 21:45:46.014936 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2788/5398] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:45:45 2022] GET /compute/v2.1/servers/20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f => generated 1264 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:45:47.022521 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6282b760-9882-47b1-baac-38099d512da8 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:45:47.024286 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6282b760-9882-47b1-baac-38099d512da8 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:45:47.056470 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6282b760-9882-47b1-baac-38099d512da8 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:45:47.057336 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6282b760-9882-47b1-baac-38099d512da8 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:45:47.058394 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6282b760-9882-47b1-baac-38099d512da8 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:45:47.059069 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6282b760-9882-47b1-baac-38099d512da8 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:45:47.152275 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6282b760-9882-47b1-baac-38099d512da8 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:45:47.161779 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6282b760-9882-47b1-baac-38099d512da8 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f" status: 200 len: 1324 microversion: 2.1 time: 0.143159 Jul 23 21:45:47.162569 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2789/5399] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:45:47 2022] GET /compute/v2.1/servers/20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f => generated 1324 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:45:48.184015 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ee8f7cdc-8f32-4a1f-b575-d640118314cc tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:45:48.189390 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ee8f7cdc-8f32-4a1f-b575-d640118314cc tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:45:48.196892 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ee8f7cdc-8f32-4a1f-b575-d640118314cc tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:45:48.197657 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ee8f7cdc-8f32-4a1f-b575-d640118314cc tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:45:48.198908 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ee8f7cdc-8f32-4a1f-b575-d640118314cc tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:45:48.199721 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ee8f7cdc-8f32-4a1f-b575-d640118314cc tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:45:48.439853 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ee8f7cdc-8f32-4a1f-b575-d640118314cc tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:45:48.450448 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ee8f7cdc-8f32-4a1f-b575-d640118314cc tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f" status: 200 len: 1390 microversion: 2.1 time: 0.270143 Jul 23 21:45:48.451852 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2790/5400] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:45:48 2022] GET /compute/v2.1/servers/20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f => generated 1390 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:45:48.660666 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-49aaab09-e776-46a8-ab3c-54e3ae74d444 req-f8c2873f-b41e-4f66-938a-bbcb65b4280f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f", "tag": "88374142-866c-4d7d-8cb0-e93cab261fe3"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:45:48.685241 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-49aaab09-e776-46a8-ab3c-54e3ae74d444 req-f8c2873f-b41e-4f66-938a-bbcb65b4280f service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:45:48.686112 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-49aaab09-e776-46a8-ab3c-54e3ae74d444 req-f8c2873f-b41e-4f66-938a-bbcb65b4280f service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:45:48.700254 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-49aaab09-e776-46a8-ab3c-54e3ae74d444 req-f8c2873f-b41e-4f66-938a-bbcb65b4280f service nova] Creating event network-changed:88374142-866c-4d7d-8cb0-e93cab261fe3 for instance 20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f on nch1-master-1 Jul 23 21:45:48.706541 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-49aaab09-e776-46a8-ab3c-54e3ae74d444 req-f8c2873f-b41e-4f66-938a-bbcb65b4280f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049536 Jul 23 21:45:48.707155 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2791/5401] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:45:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:45:49.469941 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-db90c29e-6ab8-4236-aa12-703b137ad3d8 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:45:49.470575 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-db90c29e-6ab8-4236-aa12-703b137ad3d8 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:45:49.478143 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-db90c29e-6ab8-4236-aa12-703b137ad3d8 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:45:49.478581 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-db90c29e-6ab8-4236-aa12-703b137ad3d8 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:45:49.479364 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-db90c29e-6ab8-4236-aa12-703b137ad3d8 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:45:49.479792 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-db90c29e-6ab8-4236-aa12-703b137ad3d8 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:45:49.623514 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-db90c29e-6ab8-4236-aa12-703b137ad3d8 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:45:49.631442 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-db90c29e-6ab8-4236-aa12-703b137ad3d8 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f" status: 200 len: 1390 microversion: 2.1 time: 0.166889 Jul 23 21:45:49.632021 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2792/5402] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:45:49 2022] GET /compute/v2.1/servers/20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f => generated 1390 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:45:50.651683 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a11f8b95-6d36-47ea-b78e-146a91821c84 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:45:50.652531 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a11f8b95-6d36-47ea-b78e-146a91821c84 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:45:50.663336 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a11f8b95-6d36-47ea-b78e-146a91821c84 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:45:50.664020 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a11f8b95-6d36-47ea-b78e-146a91821c84 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:45:50.665221 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a11f8b95-6d36-47ea-b78e-146a91821c84 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:45:50.665893 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a11f8b95-6d36-47ea-b78e-146a91821c84 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:45:50.801846 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a11f8b95-6d36-47ea-b78e-146a91821c84 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:45:50.809831 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a11f8b95-6d36-47ea-b78e-146a91821c84 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f" status: 200 len: 1390 microversion: 2.1 time: 0.164232 Jul 23 21:45:50.810686 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2793/5403] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:45:50 2022] GET /compute/v2.1/servers/20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f => generated 1390 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:45:51.826711 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-232ec2e3-c199-44fb-bcba-d6bd5f81991c tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:45:51.827285 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-232ec2e3-c199-44fb-bcba-d6bd5f81991c tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:45:51.834819 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-232ec2e3-c199-44fb-bcba-d6bd5f81991c tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:45:51.835270 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-232ec2e3-c199-44fb-bcba-d6bd5f81991c tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:45:51.836058 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-232ec2e3-c199-44fb-bcba-d6bd5f81991c tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:45:51.836501 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-232ec2e3-c199-44fb-bcba-d6bd5f81991c tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:45:51.977939 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-232ec2e3-c199-44fb-bcba-d6bd5f81991c tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:45:51.988366 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-232ec2e3-c199-44fb-bcba-d6bd5f81991c tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f" status: 200 len: 1390 microversion: 2.1 time: 0.166073 Jul 23 21:45:51.988960 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2794/5404] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:45:51 2022] GET /compute/v2.1/servers/20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f => generated 1390 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:45:52.501642 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-c1c374df-437a-4c00-a86b-93c9ca9b5a3a req-71081bb5-b332-48f4-9ef4-8def70c6bac2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f", "name": "network-vif-plugged", "status": "completed", "tag": "88374142-866c-4d7d-8cb0-e93cab261fe3"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:45:52.510860 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-c1c374df-437a-4c00-a86b-93c9ca9b5a3a req-71081bb5-b332-48f4-9ef4-8def70c6bac2 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:45:52.511866 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-c1c374df-437a-4c00-a86b-93c9ca9b5a3a req-71081bb5-b332-48f4-9ef4-8def70c6bac2 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:45:52.523476 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-c1c374df-437a-4c00-a86b-93c9ca9b5a3a req-71081bb5-b332-48f4-9ef4-8def70c6bac2 service nova] Creating event network-vif-plugged:88374142-866c-4d7d-8cb0-e93cab261fe3 for instance 20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f on nch1-master-1 Jul 23 21:45:52.528553 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-c1c374df-437a-4c00-a86b-93c9ca9b5a3a req-71081bb5-b332-48f4-9ef4-8def70c6bac2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030894 Jul 23 21:45:52.529222 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2795/5405] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:45:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:45:53.010120 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-cd97e5ce-91fa-4e5e-a61f-cea9fb04d9ac tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:45:53.011146 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-cd97e5ce-91fa-4e5e-a61f-cea9fb04d9ac tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:45:53.019371 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cd97e5ce-91fa-4e5e-a61f-cea9fb04d9ac tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:45:53.019829 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cd97e5ce-91fa-4e5e-a61f-cea9fb04d9ac tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:45:53.020591 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cd97e5ce-91fa-4e5e-a61f-cea9fb04d9ac tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:45:53.021028 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cd97e5ce-91fa-4e5e-a61f-cea9fb04d9ac tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:45:53.164768 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-cd97e5ce-91fa-4e5e-a61f-cea9fb04d9ac tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:45:53.172894 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-cd97e5ce-91fa-4e5e-a61f-cea9fb04d9ac tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f" status: 200 len: 1390 microversion: 2.1 time: 0.170574 Jul 23 21:45:53.173384 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2796/5406] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:45:53 2022] GET /compute/v2.1/servers/20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f => generated 1390 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:45:54.194181 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-440e41cc-6162-4f46-b400-32efb450a14c tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:45:54.195159 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-440e41cc-6162-4f46-b400-32efb450a14c tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:45:54.207365 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-440e41cc-6162-4f46-b400-32efb450a14c tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:45:54.208114 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-440e41cc-6162-4f46-b400-32efb450a14c tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:45:54.209405 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-440e41cc-6162-4f46-b400-32efb450a14c tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:45:54.210202 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-440e41cc-6162-4f46-b400-32efb450a14c tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:45:54.360350 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-440e41cc-6162-4f46-b400-32efb450a14c tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:45:54.368726 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-440e41cc-6162-4f46-b400-32efb450a14c tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f" status: 200 len: 1562 microversion: 2.1 time: 0.181242 Jul 23 21:45:54.369480 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2797/5407] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:45:54 2022] GET /compute/v2.1/servers/20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f => generated 1562 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:45:54.384722 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-979b68fe-8b50-4710-95a9-602f596eca1b tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:45:54.385332 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-979b68fe-8b50-4710-95a9-602f596eca1b tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:45:54.391720 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-979b68fe-8b50-4710-95a9-602f596eca1b tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:45:54.392250 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-979b68fe-8b50-4710-95a9-602f596eca1b tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:45:54.393035 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-979b68fe-8b50-4710-95a9-602f596eca1b tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:45:54.393474 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-979b68fe-8b50-4710-95a9-602f596eca1b tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:45:54.537812 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-979b68fe-8b50-4710-95a9-602f596eca1b tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:45:54.545557 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-979b68fe-8b50-4710-95a9-602f596eca1b tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f" status: 200 len: 1562 microversion: 2.1 time: 0.164424 Jul 23 21:45:54.546171 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2798/5408] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:45:54 2022] GET /compute/v2.1/servers/20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f => generated 1562 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:45:56.172099 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ab23faac-8f90-4129-88ce-055311eb80b5 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:45:56.172730 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ab23faac-8f90-4129-88ce-055311eb80b5 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:45:56.175688 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:45:56.176668 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=12 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:45:56.182961 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ab23faac-8f90-4129-88ce-055311eb80b5 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:45:56.183415 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ab23faac-8f90-4129-88ce-055311eb80b5 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:45:56.184219 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ab23faac-8f90-4129-88ce-055311eb80b5 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:45:56.184655 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ab23faac-8f90-4129-88ce-055311eb80b5 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:45:56.318565 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ab23faac-8f90-4129-88ce-055311eb80b5 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:45:56.322883 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:45:56.328208 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ab23faac-8f90-4129-88ce-055311eb80b5 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f" status: 200 len: 1562 microversion: 2.1 time: 0.160710 Jul 23 21:45:56.328797 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2799/5409] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:45:56 2022] GET /compute/v2.1/servers/20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f => generated 1562 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:45:56.333720 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-756369ca-5c6e-4e48-8ba3-e3c80e265d60 req-eefcdcdb-e890-4d82-8996-e7652d3563c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f", "tag": "88374142-866c-4d7d-8cb0-e93cab261fe3"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:45:56.343055 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-756369ca-5c6e-4e48-8ba3-e3c80e265d60 req-eefcdcdb-e890-4d82-8996-e7652d3563c9 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:45:56.343539 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-756369ca-5c6e-4e48-8ba3-e3c80e265d60 req-eefcdcdb-e890-4d82-8996-e7652d3563c9 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:45:56.357841 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-756369ca-5c6e-4e48-8ba3-e3c80e265d60 req-eefcdcdb-e890-4d82-8996-e7652d3563c9 service nova] Creating event network-changed:88374142-866c-4d7d-8cb0-e93cab261fe3 for instance 20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f on nch1-master-1 Jul 23 21:45:56.363047 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-756369ca-5c6e-4e48-8ba3-e3c80e265d60 req-eefcdcdb-e890-4d82-8996-e7652d3563c9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033111 Jul 23 21:45:56.364006 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2800/5410] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:45:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:46:17.631909 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2119edf3-128e-43a5-aae7-8d6d4339ddde tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:46:17.633684 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-2119edf3-128e-43a5-aae7-8d6d4339ddde tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:46:17.638080 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:46:17.646930 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2119edf3-128e-43a5-aae7-8d6d4339ddde tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:46:17.647386 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2119edf3-128e-43a5-aae7-8d6d4339ddde tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:46:17.648172 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2119edf3-128e-43a5-aae7-8d6d4339ddde tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:46:17.648609 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2119edf3-128e-43a5-aae7-8d6d4339ddde tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:46:17.715796 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2119edf3-128e-43a5-aae7-8d6d4339ddde tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "POST /compute/v2.1/servers/20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f/action" status: 200 len: 24568 microversion: 2.1 time: 0.091512 Jul 23 21:46:17.716435 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2801/5411] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:46:17 2022] POST /compute/v2.1/servers/20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f/action => generated 24568 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 23 21:46:28.766110 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-79755377-d4b7-40af-874a-e19faa11f77e tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:46:28.768559 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-79755377-d4b7-40af-874a-e19faa11f77e tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:46:28.773338 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:46:28.774455 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=6 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:46:28.784347 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-79755377-d4b7-40af-874a-e19faa11f77e tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:46:28.784810 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-79755377-d4b7-40af-874a-e19faa11f77e tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:46:28.785592 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-79755377-d4b7-40af-874a-e19faa11f77e tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:46:28.786063 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-79755377-d4b7-40af-874a-e19faa11f77e tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:46:28.866454 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-79755377-d4b7-40af-874a-e19faa11f77e tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:46:28.866921 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-79755377-d4b7-40af-874a-e19faa11f77e tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:46:28.867400 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-79755377-d4b7-40af-874a-e19faa11f77e tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:46:28.867822 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-79755377-d4b7-40af-874a-e19faa11f77e tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:46:28.868249 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-79755377-d4b7-40af-874a-e19faa11f77e tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:46:28.931825 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-79755377-d4b7-40af-874a-e19faa11f77e tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:46:28.938020 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-79755377-d4b7-40af-874a-e19faa11f77e tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:46:28.938483 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-79755377-d4b7-40af-874a-e19faa11f77e tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:46:28.939271 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-79755377-d4b7-40af-874a-e19faa11f77e tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:46:28.939715 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-79755377-d4b7-40af-874a-e19faa11f77e tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:46:28.972244 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-79755377-d4b7-40af-874a-e19faa11f77e tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "POST /compute/v2.1/servers/20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f/action" status: 202 len: 1136 microversion: 2.1 time: 0.213276 Jul 23 21:46:28.972893 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2802/5412] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:46:28 2022] POST /compute/v2.1/servers/20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f/action => generated 1136 bytes in 215 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 23 21:46:28.988203 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d1280e9c-8d04-40ef-a16d-34b0bb80d630 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:46:28.988845 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d1280e9c-8d04-40ef-a16d-34b0bb80d630 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:46:28.996092 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d1280e9c-8d04-40ef-a16d-34b0bb80d630 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:46:28.996555 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d1280e9c-8d04-40ef-a16d-34b0bb80d630 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:46:28.997576 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d1280e9c-8d04-40ef-a16d-34b0bb80d630 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:46:28.998139 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d1280e9c-8d04-40ef-a16d-34b0bb80d630 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:46:29.141646 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d1280e9c-8d04-40ef-a16d-34b0bb80d630 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:46:29.149536 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d1280e9c-8d04-40ef-a16d-34b0bb80d630 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f" status: 200 len: 1690 microversion: 2.1 time: 0.165969 Jul 23 21:46:29.150108 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2803/5413] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:46:28 2022] GET /compute/v2.1/servers/20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f => generated 1690 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:46:30.171954 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f6dbc59b-037b-438c-bffe-4e750c7f61c5 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:46:30.173021 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f6dbc59b-037b-438c-bffe-4e750c7f61c5 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:46:30.184037 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f6dbc59b-037b-438c-bffe-4e750c7f61c5 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:46:30.184490 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f6dbc59b-037b-438c-bffe-4e750c7f61c5 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:46:30.185266 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f6dbc59b-037b-438c-bffe-4e750c7f61c5 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:46:30.185697 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f6dbc59b-037b-438c-bffe-4e750c7f61c5 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:46:30.332492 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f6dbc59b-037b-438c-bffe-4e750c7f61c5 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:46:30.340623 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f6dbc59b-037b-438c-bffe-4e750c7f61c5 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f" status: 200 len: 1690 microversion: 2.1 time: 0.175477 Jul 23 21:46:30.341211 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2804/5414] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:46:30 2022] GET /compute/v2.1/servers/20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f => generated 1690 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:46:31.362093 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e40a888c-69fd-4a2a-8dc1-3aeb99c06f50 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:46:31.363164 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e40a888c-69fd-4a2a-8dc1-3aeb99c06f50 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:46:31.375050 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e40a888c-69fd-4a2a-8dc1-3aeb99c06f50 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:46:31.375804 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e40a888c-69fd-4a2a-8dc1-3aeb99c06f50 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:46:31.377116 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e40a888c-69fd-4a2a-8dc1-3aeb99c06f50 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:46:31.377845 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e40a888c-69fd-4a2a-8dc1-3aeb99c06f50 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:46:31.512040 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e40a888c-69fd-4a2a-8dc1-3aeb99c06f50 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:46:31.520298 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e40a888c-69fd-4a2a-8dc1-3aeb99c06f50 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f" status: 200 len: 1690 microversion: 2.1 time: 0.164855 Jul 23 21:46:31.520869 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2805/5415] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:46:31 2022] GET /compute/v2.1/servers/20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f => generated 1690 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:46:32.541848 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4b9228cc-bb66-477d-ad74-0075ccf4a781 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:46:32.542956 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-4b9228cc-bb66-477d-ad74-0075ccf4a781 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:46:32.554670 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4b9228cc-bb66-477d-ad74-0075ccf4a781 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:46:32.555423 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4b9228cc-bb66-477d-ad74-0075ccf4a781 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:46:32.556694 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4b9228cc-bb66-477d-ad74-0075ccf4a781 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:46:32.557429 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4b9228cc-bb66-477d-ad74-0075ccf4a781 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:46:32.705358 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-4b9228cc-bb66-477d-ad74-0075ccf4a781 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:46:32.713208 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4b9228cc-bb66-477d-ad74-0075ccf4a781 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f" status: 200 len: 1690 microversion: 2.1 time: 0.177882 Jul 23 21:46:32.713769 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2806/5416] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:46:32 2022] GET /compute/v2.1/servers/20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f => generated 1690 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:46:33.733899 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ea1ee94d-8349-48a0-9a9b-f37218c96ebd tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:46:33.734635 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ea1ee94d-8349-48a0-9a9b-f37218c96ebd tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:46:33.741851 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ea1ee94d-8349-48a0-9a9b-f37218c96ebd tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:46:33.742324 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ea1ee94d-8349-48a0-9a9b-f37218c96ebd tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:46:33.743086 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ea1ee94d-8349-48a0-9a9b-f37218c96ebd tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:46:33.743526 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ea1ee94d-8349-48a0-9a9b-f37218c96ebd tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:46:33.876529 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ea1ee94d-8349-48a0-9a9b-f37218c96ebd tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:46:33.884349 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ea1ee94d-8349-48a0-9a9b-f37218c96ebd tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f" status: 200 len: 1690 microversion: 2.1 time: 0.156053 Jul 23 21:46:33.884915 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2807/5417] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:46:33 2022] GET /compute/v2.1/servers/20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f => generated 1690 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:46:34.902260 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5b666efb-6483-4e6f-a013-ae75f347e36a tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:46:34.902943 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5b666efb-6483-4e6f-a013-ae75f347e36a tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:46:34.909901 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5b666efb-6483-4e6f-a013-ae75f347e36a tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:46:34.910363 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5b666efb-6483-4e6f-a013-ae75f347e36a tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:46:34.911144 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5b666efb-6483-4e6f-a013-ae75f347e36a tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:46:34.911587 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5b666efb-6483-4e6f-a013-ae75f347e36a tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:46:35.047767 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5b666efb-6483-4e6f-a013-ae75f347e36a tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:46:35.055562 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5b666efb-6483-4e6f-a013-ae75f347e36a tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f" status: 200 len: 1690 microversion: 2.1 time: 0.157395 Jul 23 21:46:35.056037 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2808/5418] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:46:34 2022] GET /compute/v2.1/servers/20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f => generated 1690 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:46:36.075402 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5a595e37-2294-460a-afee-769e08f46bf1 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:46:36.076079 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5a595e37-2294-460a-afee-769e08f46bf1 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:46:36.088191 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5a595e37-2294-460a-afee-769e08f46bf1 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:46:36.089036 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5a595e37-2294-460a-afee-769e08f46bf1 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:46:36.090316 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5a595e37-2294-460a-afee-769e08f46bf1 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:46:36.090971 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5a595e37-2294-460a-afee-769e08f46bf1 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:46:36.247679 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5a595e37-2294-460a-afee-769e08f46bf1 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:46:36.255764 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5a595e37-2294-460a-afee-769e08f46bf1 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f" status: 200 len: 1690 microversion: 2.1 time: 0.186097 Jul 23 21:46:36.256356 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2809/5419] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:46:36 2022] GET /compute/v2.1/servers/20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f => generated 1690 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:46:37.277326 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4d585eec-8461-484c-8efc-5af423e594b8 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:46:37.278484 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-4d585eec-8461-484c-8efc-5af423e594b8 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:46:37.290174 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4d585eec-8461-484c-8efc-5af423e594b8 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:46:37.291068 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4d585eec-8461-484c-8efc-5af423e594b8 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:46:37.292367 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4d585eec-8461-484c-8efc-5af423e594b8 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:46:37.293089 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4d585eec-8461-484c-8efc-5af423e594b8 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:46:37.432223 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-4d585eec-8461-484c-8efc-5af423e594b8 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:46:37.443530 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4d585eec-8461-484c-8efc-5af423e594b8 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f" status: 200 len: 1690 microversion: 2.1 time: 0.172366 Jul 23 21:46:37.444314 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2810/5420] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:46:37 2022] GET /compute/v2.1/servers/20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f => generated 1690 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:46:38.468740 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-854c8f4e-dc15-4724-9162-636bc1f8180a tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:46:38.469808 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-854c8f4e-dc15-4724-9162-636bc1f8180a tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:46:38.477481 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-854c8f4e-dc15-4724-9162-636bc1f8180a tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:46:38.477987 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-854c8f4e-dc15-4724-9162-636bc1f8180a tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:46:38.478804 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-854c8f4e-dc15-4724-9162-636bc1f8180a tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:46:38.479261 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-854c8f4e-dc15-4724-9162-636bc1f8180a tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:46:38.638316 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-854c8f4e-dc15-4724-9162-636bc1f8180a tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:46:38.648725 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-854c8f4e-dc15-4724-9162-636bc1f8180a tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f" status: 200 len: 1690 microversion: 2.1 time: 0.186531 Jul 23 21:46:38.649283 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2811/5421] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:46:38 2022] GET /compute/v2.1/servers/20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f => generated 1690 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:46:39.674056 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-edffe12e-4875-4fda-acd0-d34c19e4749a tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:46:39.674709 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-edffe12e-4875-4fda-acd0-d34c19e4749a tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:46:39.682191 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-edffe12e-4875-4fda-acd0-d34c19e4749a tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:46:39.682652 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-edffe12e-4875-4fda-acd0-d34c19e4749a tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:46:39.683437 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-edffe12e-4875-4fda-acd0-d34c19e4749a tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:46:39.683884 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-edffe12e-4875-4fda-acd0-d34c19e4749a tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:46:39.829515 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-edffe12e-4875-4fda-acd0-d34c19e4749a tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:46:39.837452 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-edffe12e-4875-4fda-acd0-d34c19e4749a tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f" status: 200 len: 1690 microversion: 2.1 time: 0.169327 Jul 23 21:46:39.838032 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2812/5422] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:46:39 2022] GET /compute/v2.1/servers/20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f => generated 1690 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:46:40.855143 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-319961fb-adf6-49d7-8c4e-03303deaf78a tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:46:40.855782 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-319961fb-adf6-49d7-8c4e-03303deaf78a tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:46:40.863927 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-319961fb-adf6-49d7-8c4e-03303deaf78a tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:46:40.864375 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-319961fb-adf6-49d7-8c4e-03303deaf78a tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:46:40.865172 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-319961fb-adf6-49d7-8c4e-03303deaf78a tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:46:40.865608 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-319961fb-adf6-49d7-8c4e-03303deaf78a tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:46:41.009457 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-319961fb-adf6-49d7-8c4e-03303deaf78a tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:46:41.017532 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-319961fb-adf6-49d7-8c4e-03303deaf78a tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f" status: 200 len: 1690 microversion: 2.1 time: 0.166320 Jul 23 21:46:41.018150 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2813/5423] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:46:40 2022] GET /compute/v2.1/servers/20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f => generated 1690 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:46:42.039438 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4848fbe9-64a6-4140-82c9-14ed633cdd2d tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:46:42.040515 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-4848fbe9-64a6-4140-82c9-14ed633cdd2d tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:46:42.052490 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4848fbe9-64a6-4140-82c9-14ed633cdd2d tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:46:42.053318 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4848fbe9-64a6-4140-82c9-14ed633cdd2d tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:46:42.054653 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4848fbe9-64a6-4140-82c9-14ed633cdd2d tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:46:42.055415 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4848fbe9-64a6-4140-82c9-14ed633cdd2d tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:46:42.195812 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-4848fbe9-64a6-4140-82c9-14ed633cdd2d tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:46:42.204255 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4848fbe9-64a6-4140-82c9-14ed633cdd2d tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f" status: 200 len: 1690 microversion: 2.1 time: 0.171644 Jul 23 21:46:42.204828 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2814/5424] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:46:42 2022] GET /compute/v2.1/servers/20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f => generated 1690 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:46:43.226392 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5e5ce514-c94c-4af4-861c-ca1c6771caa1 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:46:43.227428 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5e5ce514-c94c-4af4-861c-ca1c6771caa1 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:46:43.238825 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5e5ce514-c94c-4af4-861c-ca1c6771caa1 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:46:43.239282 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5e5ce514-c94c-4af4-861c-ca1c6771caa1 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:46:43.240075 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5e5ce514-c94c-4af4-861c-ca1c6771caa1 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:46:43.240525 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5e5ce514-c94c-4af4-861c-ca1c6771caa1 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:46:43.398971 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5e5ce514-c94c-4af4-861c-ca1c6771caa1 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:46:43.406898 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5e5ce514-c94c-4af4-861c-ca1c6771caa1 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f" status: 200 len: 1690 microversion: 2.1 time: 0.187300 Jul 23 21:46:43.407471 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2815/5425] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:46:43 2022] GET /compute/v2.1/servers/20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f => generated 1690 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:46:44.424305 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5f01d572-ff58-40e6-bd68-c01b5d98757f tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:46:44.424966 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5f01d572-ff58-40e6-bd68-c01b5d98757f tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:46:44.432411 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5f01d572-ff58-40e6-bd68-c01b5d98757f tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:46:44.432927 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5f01d572-ff58-40e6-bd68-c01b5d98757f tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:46:44.433705 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5f01d572-ff58-40e6-bd68-c01b5d98757f tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:46:44.434176 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5f01d572-ff58-40e6-bd68-c01b5d98757f tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:46:44.452424 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:46:44.571741 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5f01d572-ff58-40e6-bd68-c01b5d98757f tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:46:44.580146 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5f01d572-ff58-40e6-bd68-c01b5d98757f tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f" status: 200 len: 1690 microversion: 2.1 time: 0.159776 Jul 23 21:46:44.580733 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2816/5426] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:46:44 2022] GET /compute/v2.1/servers/20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f => generated 1690 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:46:45.601455 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1f8ac9a9-ae63-4109-a1ce-1e37537f7103 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:46:45.602572 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1f8ac9a9-ae63-4109-a1ce-1e37537f7103 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:46:45.614034 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1f8ac9a9-ae63-4109-a1ce-1e37537f7103 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:46:45.614489 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1f8ac9a9-ae63-4109-a1ce-1e37537f7103 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:46:45.615283 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1f8ac9a9-ae63-4109-a1ce-1e37537f7103 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:46:45.615695 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1f8ac9a9-ae63-4109-a1ce-1e37537f7103 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:46:45.752755 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-1f8ac9a9-ae63-4109-a1ce-1e37537f7103 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:46:45.760581 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1f8ac9a9-ae63-4109-a1ce-1e37537f7103 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f" status: 200 len: 1690 microversion: 2.1 time: 0.165606 Jul 23 21:46:45.761166 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2817/5427] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:46:45 2022] GET /compute/v2.1/servers/20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f => generated 1690 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:46:46.782241 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8052ed4f-0f3d-4a98-af99-2f12326fcc6e tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:46:46.783379 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8052ed4f-0f3d-4a98-af99-2f12326fcc6e tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:46:46.792137 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8052ed4f-0f3d-4a98-af99-2f12326fcc6e tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:46:46.792592 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8052ed4f-0f3d-4a98-af99-2f12326fcc6e tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:46:46.793375 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8052ed4f-0f3d-4a98-af99-2f12326fcc6e tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:46:46.793831 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8052ed4f-0f3d-4a98-af99-2f12326fcc6e tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:46:46.937404 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8052ed4f-0f3d-4a98-af99-2f12326fcc6e tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:46:46.946598 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8052ed4f-0f3d-4a98-af99-2f12326fcc6e tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f" status: 200 len: 1696 microversion: 2.1 time: 0.170619 Jul 23 21:46:46.947293 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2818/5428] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:46:46 2022] GET /compute/v2.1/servers/20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f => generated 1696 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:46:47.964782 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-bb5d63cf-61b4-4d11-92c1-16c36b3c3f68 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:46:47.965394 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-bb5d63cf-61b4-4d11-92c1-16c36b3c3f68 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:46:47.974456 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bb5d63cf-61b4-4d11-92c1-16c36b3c3f68 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:46:47.974931 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bb5d63cf-61b4-4d11-92c1-16c36b3c3f68 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:46:47.975724 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bb5d63cf-61b4-4d11-92c1-16c36b3c3f68 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:46:47.976205 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bb5d63cf-61b4-4d11-92c1-16c36b3c3f68 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:46:48.113327 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-bb5d63cf-61b4-4d11-92c1-16c36b3c3f68 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:46:48.121811 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-bb5d63cf-61b4-4d11-92c1-16c36b3c3f68 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f" status: 200 len: 1696 microversion: 2.1 time: 0.160980 Jul 23 21:46:48.122422 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2819/5429] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:46:47 2022] GET /compute/v2.1/servers/20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f => generated 1696 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:46:49.139104 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a019e641-1ccc-41a8-985a-bc3e2a5d25bc tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:46:49.139761 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a019e641-1ccc-41a8-985a-bc3e2a5d25bc tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:46:49.147142 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a019e641-1ccc-41a8-985a-bc3e2a5d25bc tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:46:49.147599 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a019e641-1ccc-41a8-985a-bc3e2a5d25bc tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:46:49.148377 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a019e641-1ccc-41a8-985a-bc3e2a5d25bc tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:46:49.148822 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a019e641-1ccc-41a8-985a-bc3e2a5d25bc tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:46:49.282195 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a019e641-1ccc-41a8-985a-bc3e2a5d25bc tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:46:49.290405 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a019e641-1ccc-41a8-985a-bc3e2a5d25bc tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f" status: 200 len: 1681 microversion: 2.1 time: 0.155113 Jul 23 21:46:49.290971 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2820/5430] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:46:49 2022] GET /compute/v2.1/servers/20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:46:50.921628 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-2bf00d80-9e12-4548-8e0e-454910368f98 req-7f9a5c37-d6e4-4cf7-9136-8e68f244f041 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f", "name": "network-vif-plugged", "status": "completed", "tag": "88374142-866c-4d7d-8cb0-e93cab261fe3"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:46:50.931022 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-2bf00d80-9e12-4548-8e0e-454910368f98 req-7f9a5c37-d6e4-4cf7-9136-8e68f244f041 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:46:50.931481 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-2bf00d80-9e12-4548-8e0e-454910368f98 req-7f9a5c37-d6e4-4cf7-9136-8e68f244f041 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:46:50.942759 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-2bf00d80-9e12-4548-8e0e-454910368f98 req-7f9a5c37-d6e4-4cf7-9136-8e68f244f041 service nova] Creating event network-vif-plugged:88374142-866c-4d7d-8cb0-e93cab261fe3 for instance 20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f on nch1-master-1 Jul 23 21:46:50.947776 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-2bf00d80-9e12-4548-8e0e-454910368f98 req-7f9a5c37-d6e4-4cf7-9136-8e68f244f041 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030040 Jul 23 21:46:50.948365 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2821/5431] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:46:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:47:13.518046 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=44 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:47:13.518780 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=28 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:47:13.523142 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d99f88f1-cf40-4d09-99fb-fd00a77d8be2 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:47:13.524160 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d99f88f1-cf40-4d09-99fb-fd00a77d8be2 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:47:13.531296 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d99f88f1-cf40-4d09-99fb-fd00a77d8be2 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:47:13.531749 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d99f88f1-cf40-4d09-99fb-fd00a77d8be2 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:47:13.532518 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d99f88f1-cf40-4d09-99fb-fd00a77d8be2 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:47:13.532956 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d99f88f1-cf40-4d09-99fb-fd00a77d8be2 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:47:13.597656 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d99f88f1-cf40-4d09-99fb-fd00a77d8be2 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "POST /compute/v2.1/servers/20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f/action" status: 200 len: 24571 microversion: 2.1 time: 0.081585 Jul 23 21:47:13.598702 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2822/5432] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:47:13 2022] POST /compute/v2.1/servers/20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f/action => generated 24571 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 23 21:47:20.785582 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-70f794b6-d75f-4e3f-831f-7b5380a94a91 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:47:20.786484 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-70f794b6-d75f-4e3f-831f-7b5380a94a91 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:47:20.795105 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-70f794b6-d75f-4e3f-831f-7b5380a94a91 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:47:20.795636 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-70f794b6-d75f-4e3f-831f-7b5380a94a91 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:47:20.796572 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-70f794b6-d75f-4e3f-831f-7b5380a94a91 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:47:20.797080 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-70f794b6-d75f-4e3f-831f-7b5380a94a91 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:47:20.823955 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-70f794b6-d75f-4e3f-831f-7b5380a94a91 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f] Going to try to terminate instance {{(pid=131320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 21:47:20.916547 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-70f794b6-d75f-4e3f-831f-7b5380a94a91 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "DELETE /compute/v2.1/servers/20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f" status: 204 len: 0 microversion: 2.1 time: 0.134646 Jul 23 21:47:20.917426 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2823/5433] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 21:47:20 2022] DELETE /compute/v2.1/servers/20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 21:47:20.996560 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-12f029e9-e72a-4b30-a5c5-0df419ef788d req-05dcd1c2-615d-43ae-863e-ac5a1340b56f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f", "tag": "88374142-866c-4d7d-8cb0-e93cab261fe3"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:47:21.005627 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-12f029e9-e72a-4b30-a5c5-0df419ef788d req-05dcd1c2-615d-43ae-863e-ac5a1340b56f service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:47:21.006116 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-12f029e9-e72a-4b30-a5c5-0df419ef788d req-05dcd1c2-615d-43ae-863e-ac5a1340b56f service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:47:21.016410 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-12f029e9-e72a-4b30-a5c5-0df419ef788d req-05dcd1c2-615d-43ae-863e-ac5a1340b56f service nova] Creating event network-changed:88374142-866c-4d7d-8cb0-e93cab261fe3 for instance 20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f on nch1-master-1 Jul 23 21:47:21.021635 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-12f029e9-e72a-4b30-a5c5-0df419ef788d req-05dcd1c2-615d-43ae-863e-ac5a1340b56f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102378 Jul 23 21:47:21.022356 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2824/5434] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:47:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:47:21.027754 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-7de7594c-a235-4424-a446-533c2b52640e tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:47:21.028494 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-7de7594c-a235-4424-a446-533c2b52640e tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:47:21.034978 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7de7594c-a235-4424-a446-533c2b52640e tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:47:21.035439 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7de7594c-a235-4424-a446-533c2b52640e tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:47:21.036217 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7de7594c-a235-4424-a446-533c2b52640e tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:47:21.036664 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7de7594c-a235-4424-a446-533c2b52640e tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:47:21.177744 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-7de7594c-a235-4424-a446-533c2b52640e tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:47:21.184844 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-7de7594c-a235-4424-a446-533c2b52640e tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f" status: 200 len: 1687 microversion: 2.1 time: 0.161211 Jul 23 21:47:21.185536 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2825/5435] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:47:21 2022] GET /compute/v2.1/servers/20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f => generated 1687 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:47:22.202788 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-984957b5-e27d-4397-8107-df665e963276 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:47:22.203520 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-984957b5-e27d-4397-8107-df665e963276 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:47:22.212594 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-984957b5-e27d-4397-8107-df665e963276 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:47:22.213043 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-984957b5-e27d-4397-8107-df665e963276 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:47:22.213831 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-984957b5-e27d-4397-8107-df665e963276 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:47:22.214296 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-984957b5-e27d-4397-8107-df665e963276 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:47:22.445850 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-984957b5-e27d-4397-8107-df665e963276 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96ade420fd324acfb57e4ac81bfece9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36bd2862980e45849b0d3fc3f52a6926', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:47:22.456194 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-984957b5-e27d-4397-8107-df665e963276 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f" status: 200 len: 1687 microversion: 2.1 time: 0.257258 Jul 23 21:47:22.457009 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2826/5436] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:47:22 2022] GET /compute/v2.1/servers/20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f => generated 1687 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:47:23.037525 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-ac3e90c8-ca3c-487e-be62-be3d7cdabcb8 req-1f891394-c3a7-4802-ae9d-2a504383ada6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f", "name": "network-vif-deleted", "tag": "88374142-866c-4d7d-8cb0-e93cab261fe3"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:47:23.047001 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-ac3e90c8-ca3c-487e-be62-be3d7cdabcb8 req-1f891394-c3a7-4802-ae9d-2a504383ada6 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:47:23.047399 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-ac3e90c8-ca3c-487e-be62-be3d7cdabcb8 req-1f891394-c3a7-4802-ae9d-2a504383ada6 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:47:23.059340 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-ac3e90c8-ca3c-487e-be62-be3d7cdabcb8 req-1f891394-c3a7-4802-ae9d-2a504383ada6 service nova] Creating event network-vif-deleted:88374142-866c-4d7d-8cb0-e93cab261fe3 for instance 20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f on nch1-master-1 Jul 23 21:47:23.064223 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-ac3e90c8-ca3c-487e-be62-be3d7cdabcb8 req-1f891394-c3a7-4802-ae9d-2a504383ada6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030528 Jul 23 21:47:23.064808 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2827/5437] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:47:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:47:23.475171 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-11f646fb-cfa2-4f02-af89-108a10a59776 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:47:23.475818 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-11f646fb-cfa2-4f02-af89-108a10a59776 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] [instance: 20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:47:23.482454 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-11f646fb-cfa2-4f02-af89-108a10a59776 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:47:23.482909 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-11f646fb-cfa2-4f02-af89-108a10a59776 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:47:23.483682 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-11f646fb-cfa2-4f02-af89-108a10a59776 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:47:23.484122 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-11f646fb-cfa2-4f02-af89-108a10a59776 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:47:23.497697 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-11f646fb-cfa2-4f02-af89-108a10a59776 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] HTTP exception thrown: Instance 20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f could not be found. Jul 23 21:47:23.499385 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-11f646fb-cfa2-4f02-af89-108a10a59776 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Request method failure captured: Jul 23 21:47:23.499385 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f HTTP/1.1 Jul 23 21:47:23.499385 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:47:23.499385 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:47:23.499385 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:47:23.499385 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 21:47:23.499385 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:47:23.499385 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:47:23.499385 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:47:23.499385 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:47:23.499385 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3GrOSfKcmvIg8CybJuZ211K2BCk2kV9XXJD4t1iLnpDMxE7Pkx25elWArE6eyR4tr0Iwox8ke0DWSoqvidEJT8OIHAfji6eadcJDPEeLIK5RaEi7u5O4vXMbwe3kSZZq8MYGsBh4KdQThoYiwMI-IDxUERCe5nBEmFyUK5SxchL_LMo Jul 23 21:47:23.499385 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:47:23.499385 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:47:23.499385 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:47:23.499385 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:47:23.499385 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:47:23.499385 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:47:23.499385 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 36bd2862980e45849b0d3fc3f52a6926 Jul 23 21:47:23.499385 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1607830774 Jul 23 21:47:23.499385 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:47:23.499385 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:47:23.499385 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/36bd2862980e45849b0d3fc3f52a6926"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/36bd2862980e45849b0d3fc3f52a6926"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_36bd2862980e45849b0d3fc3f52a6926", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/36bd2862980e45849b0d3fc3f52a6926"}]}] Jul 23 21:47:23.499385 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1607830774 Jul 23 21:47:23.499385 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 36bd2862980e45849b0d3fc3f52a6926 Jul 23 21:47:23.499385 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1607830774 Jul 23 21:47:23.499385 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-TestNetworkAdvancedServerOps-1607830774-project Jul 23 21:47:23.499385 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:47:23.499385 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:47:23.499385 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 96ade420fd324acfb57e4ac81bfece9e Jul 23 21:47:23.499385 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1607830774-project Jul 23 21:47:23.499385 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:47:23.499385 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance 20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f could not be found. Jul 23 21:47:23.499385 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f'} Jul 23 21:47:23.499385 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:47:23.499385 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:47:23.499385 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 21:47:23.499385 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 21:47:23.499385 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 21:47:23.499385 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 21:47:23.499385 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 21:47:23.499385 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 21:47:23.499385 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 21:47:23.499385 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 21:47:23.499385 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f could not be found. Jul 23 21:47:23.499385 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:47:23.499385 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:47:23.499385 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:47:23.499385 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:47:23.499385 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:47:23.499385 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:47:23.499385 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:47:23.499385 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:47:23.499385 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:47:23.499385 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:47:23.499385 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 21:47:23.499385 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 21:47:23.499385 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 21:47:23.499385 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 21:47:23.499385 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 21:47:23.499385 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 21:47:23.499385 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f could not be found. Jul 23 21:47:23.499385 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:47:23.499385 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:47:23.504361 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:47:23.504361 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:47:23.504361 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:47:23.504361 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:47:23.504361 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:47:23.504361 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:47:23.504361 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f could not be found. Jul 23 21:47:23.504361 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:47:23.504361 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-11f646fb-cfa2-4f02-af89-108a10a59776 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Returning 404 to user: Instance 20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:47:23.504361 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-11f646fb-cfa2-4f02-af89-108a10a59776 tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "GET /compute/v2.1/servers/20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f" status: 404 len: 111 microversion: 2.1 time: 0.030671 Jul 23 21:47:23.504361 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2828/5438] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:47:23 2022] GET /compute/v2.1/servers/20ccc85f-2c67-4582-8f3e-cf5c9f45ff0f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 21:47:26.824234 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-87c11ec0-7484-425e-a81e-c1d32b62eb7c tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] Calling method '.version_select at 0x7f0b598efa60>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:47:26.858782 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-87c11ec0-7484-425e-a81e-c1d32b62eb7c tempest-TestNetworkAdvancedServerOps-1607830774 tempest-TestNetworkAdvancedServerOps-1607830774-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-636155688" status: 202 len: 0 microversion: 2.1 time: 0.040305 Jul 23 21:47:26.859578 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2829/5439] 10.222.0.17 () {58 vars in 1280 bytes} [Sat Jul 23 21:47:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-636155688 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:48:29.835986 ncdv-master-1 devstack@n-api.service[131320]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 23 21:48:29.836636 ncdv-master-1 devstack@n-api.service[131320]: Sat Jul 23 21:48:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 23 21:50:09.878142 ncdv-master-1 devstack@n-api.service[131320]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 23 21:50:09.878890 ncdv-master-1 devstack@n-api.service[131320]: Sat Jul 23 21:50:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 23 21:50:19.638349 ncdv-master-1 devstack@n-api.service[131320]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 23 21:50:19.639353 ncdv-master-1 devstack@n-api.service[131320]: Sat Jul 23 21:50:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 23 21:51:49.844871 ncdv-master-1 devstack@n-api.service[131320]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 23 21:51:49.845467 ncdv-master-1 devstack@n-api.service[131320]: Sat Jul 23 21:51:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 23 21:53:29.887181 ncdv-master-1 devstack@n-api.service[131320]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 23 21:53:29.888296 ncdv-master-1 devstack@n-api.service[131320]: Sat Jul 23 21:53:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 23 21:53:39.651472 ncdv-master-1 devstack@n-api.service[131320]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 23 21:53:39.652161 ncdv-master-1 devstack@n-api.service[131320]: Sat Jul 23 21:53:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 23 21:55:09.854829 ncdv-master-1 devstack@n-api.service[131320]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 23 21:55:09.855534 ncdv-master-1 devstack@n-api.service[131320]: Sat Jul 23 21:55:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 23 21:56:03.183112 ncdv-master-1 devstack@n-api.service[131320]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f00542ad-3110-4bfe-937f-f2bf8408f43a] AMQP server on 10.222.0.17:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 23 21:56:03.184001 ncdv-master-1 devstack@n-api.service[131320]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7bb808cf-dbe0-4ba5-ad7e-371257d030a5] AMQP server on 10.222.0.17:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 23 21:56:03.184552 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:56:03.185916 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:56:03.347706 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8c869b90-31f6-4e03-933d-1d43aaa7e5c5 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Action: 'create', calling method: .version_select at 0x7f0b464d5160>, body: {"keypair": {"name": "tempest-keypair-2057660710", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMpipOymxBhx8TQErG6OAUigRIdBHsBonTyiC/5Ds6ZnLURLQev2mSEPAKbLzhs0fKGa6sqABKm53xqffAackA7eoUJuMT+FqxND7XSIcCAy3k0YyyRaPJ/Rd7oB1YsCig=="}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:56:03.365484 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-8c869b90-31f6-4e03-933d-1d43aaa7e5c5 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Getting quotas for project 7f624e0dec4a4f64b1d3580e60867c41. Resources: {'key_pairs'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:56:03.371244 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-8c869b90-31f6-4e03-933d-1d43aaa7e5c5 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Getting quotas for user b5408fb2f4044c6d88527222b190230d and project 7f624e0dec4a4f64b1d3580e60867c41. Resources: {'key_pairs'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:56:03.406060 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8c869b90-31f6-4e03-933d-1d43aaa7e5c5 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.221369 Jul 23 21:56:03.406961 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2830/5440] 10.222.0.17 () {60 vars in 1158 bytes} [Sat Jul 23 21:56:03 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:56:04.733534 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6a715784-b072-4ce1-a236-01dc91b81f17 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1787572080", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6770b9e7-826f-46ba-879d-e25a87aab2e5"}], "security_groups": [{"name": "tempest-securitygroup--2082655633"}], "key_name": "tempest-keypair-2057660710", "user_data": "}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:56:04.754838 ncdv-master-1 devstack@n-api.service[131320]: INFO oslo.messaging._drivers.impl_rabbit [-] [7bb808cf-dbe0-4ba5-ad7e-371257d030a5] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 53716. Jul 23 21:56:04.756567 ncdv-master-1 devstack@n-api.service[131320]: INFO oslo.messaging._drivers.impl_rabbit [-] [f00542ad-3110-4bfe-937f-f2bf8408f43a] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 53714. Jul 23 21:56:04.972752 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-6a715784-b072-4ce1-a236-01dc91b81f17 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] validate_networks() for [('6770b9e7-826f-46ba-879d-e25a87aab2e5', None, None, None, None, None)] {{(pid=131320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:56:05.799802 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-6a715784-b072-4ce1-a236-01dc91b81f17 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:56:05.800400 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-6a715784-b072-4ce1-a236-01dc91b81f17 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:56:05.800876 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-6a715784-b072-4ce1-a236-01dc91b81f17 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:56:05.801355 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-6a715784-b072-4ce1-a236-01dc91b81f17 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:56:05.801846 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-6a715784-b072-4ce1-a236-01dc91b81f17 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:56:05.811390 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6a715784-b072-4ce1-a236-01dc91b81f17 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:56:05.811849 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6a715784-b072-4ce1-a236-01dc91b81f17 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:56:05.812890 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6a715784-b072-4ce1-a236-01dc91b81f17 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:56:05.813333 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6a715784-b072-4ce1-a236-01dc91b81f17 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:56:05.832894 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-6a715784-b072-4ce1-a236-01dc91b81f17 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Getting quotas for project 7f624e0dec4a4f64b1d3580e60867c41. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:56:05.838807 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-6a715784-b072-4ce1-a236-01dc91b81f17 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Getting quotas for user b5408fb2f4044c6d88527222b190230d and project 7f624e0dec4a4f64b1d3580e60867c41. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:56:05.852192 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6a715784-b072-4ce1-a236-01dc91b81f17 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Going to run 1 instances... {{(pid=131320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:56:05.854573 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6a715784-b072-4ce1-a236-01dc91b81f17 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:56:05.902917 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6a715784-b072-4ce1-a236-01dc91b81f17 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.175462 Jul 23 21:56:05.906168 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2831/5441] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:56:04 2022] POST /compute/v2.1/servers => generated 409 bytes in 1179 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 23 21:56:05.915020 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e36b8f51-a26d-4161-a678-3493df2311bb tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:56:05.915638 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e36b8f51-a26d-4161-a678-3493df2311bb tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:56:05.976886 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e36b8f51-a26d-4161-a678-3493df2311bb tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:56:05.983922 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e36b8f51-a26d-4161-a678-3493df2311bb tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1239 microversion: 2.1 time: 0.073417 Jul 23 21:56:05.984887 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2832/5442] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:56:05 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1239 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:56:07.001485 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-fbc12a82-261a-4604-aacf-049e6e214ab0 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:56:07.002128 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-fbc12a82-261a-4604-aacf-049e6e214ab0 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:56:07.011130 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fbc12a82-261a-4604-aacf-049e6e214ab0 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:56:07.011573 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fbc12a82-261a-4604-aacf-049e6e214ab0 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:56:07.012368 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fbc12a82-261a-4604-aacf-049e6e214ab0 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:56:07.012813 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fbc12a82-261a-4604-aacf-049e6e214ab0 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:56:07.077525 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-fbc12a82-261a-4604-aacf-049e6e214ab0 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:56:07.085892 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-fbc12a82-261a-4604-aacf-049e6e214ab0 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1291 microversion: 2.1 time: 0.088431 Jul 23 21:56:07.086758 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2833/5443] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:56:06 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1291 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:56:08.105545 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d01a0ab7-23e5-4cdd-9329-245ae00bbdff tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:56:08.106246 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d01a0ab7-23e5-4cdd-9329-245ae00bbdff tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:56:08.113686 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d01a0ab7-23e5-4cdd-9329-245ae00bbdff tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:56:08.114252 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d01a0ab7-23e5-4cdd-9329-245ae00bbdff tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:56:08.115250 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d01a0ab7-23e5-4cdd-9329-245ae00bbdff tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:56:08.115710 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d01a0ab7-23e5-4cdd-9329-245ae00bbdff tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:56:08.330448 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d01a0ab7-23e5-4cdd-9329-245ae00bbdff tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:56:08.338874 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d01a0ab7-23e5-4cdd-9329-245ae00bbdff tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1365 microversion: 2.1 time: 0.238677 Jul 23 21:56:08.339483 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2834/5444] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:56:08 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1365 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:56:08.742144 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-655f667a-bbfe-42e3-a49b-89535fd05357 req-5f37c597-2a64-44b8-aeda-e33dfab77b36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c96aa13-cbff-4245-a45b-418f131a0841", "tag": "a5aede91-0293-4461-849f-3a91ad088518"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:56:08.752054 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-655f667a-bbfe-42e3-a49b-89535fd05357 req-5f37c597-2a64-44b8-aeda-e33dfab77b36 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:56:08.752560 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-655f667a-bbfe-42e3-a49b-89535fd05357 req-5f37c597-2a64-44b8-aeda-e33dfab77b36 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:56:09.054317 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-655f667a-bbfe-42e3-a49b-89535fd05357 req-5f37c597-2a64-44b8-aeda-e33dfab77b36 service nova] Creating event network-changed:a5aede91-0293-4461-849f-3a91ad088518 for instance 9c96aa13-cbff-4245-a45b-418f131a0841 on nch2-master-1 Jul 23 21:56:09.060455 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-655f667a-bbfe-42e3-a49b-89535fd05357 req-5f37c597-2a64-44b8-aeda-e33dfab77b36 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.403302 Jul 23 21:56:09.061078 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2835/5445] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:56:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:56:09.363419 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-58f40d4c-bc8f-4868-a686-e95ebf065052 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:56:09.364415 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-58f40d4c-bc8f-4868-a686-e95ebf065052 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:56:09.375196 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-58f40d4c-bc8f-4868-a686-e95ebf065052 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:56:09.375977 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-58f40d4c-bc8f-4868-a686-e95ebf065052 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:56:09.377268 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-58f40d4c-bc8f-4868-a686-e95ebf065052 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:56:09.378077 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-58f40d4c-bc8f-4868-a686-e95ebf065052 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:56:09.524930 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-58f40d4c-bc8f-4868-a686-e95ebf065052 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:56:09.533261 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-58f40d4c-bc8f-4868-a686-e95ebf065052 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1365 microversion: 2.1 time: 0.178587 Jul 23 21:56:09.533842 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2836/5446] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:56:09 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1365 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:56:10.555876 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-59d3b780-5ed0-46a5-8589-efc29aaa3c31 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:56:10.556527 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-59d3b780-5ed0-46a5-8589-efc29aaa3c31 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:56:10.563784 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-59d3b780-5ed0-46a5-8589-efc29aaa3c31 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:56:10.564243 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-59d3b780-5ed0-46a5-8589-efc29aaa3c31 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:56:10.565050 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-59d3b780-5ed0-46a5-8589-efc29aaa3c31 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:56:10.565496 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-59d3b780-5ed0-46a5-8589-efc29aaa3c31 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:56:10.703137 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-59d3b780-5ed0-46a5-8589-efc29aaa3c31 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:56:10.711275 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-59d3b780-5ed0-46a5-8589-efc29aaa3c31 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1365 microversion: 2.1 time: 0.161847 Jul 23 21:56:10.711877 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2837/5447] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:56:10 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:56:11.729219 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-de2b1e21-6049-4856-ba3b-9addc7e593df tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:56:11.729926 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-de2b1e21-6049-4856-ba3b-9addc7e593df tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:56:11.737201 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-de2b1e21-6049-4856-ba3b-9addc7e593df tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:56:11.737663 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-de2b1e21-6049-4856-ba3b-9addc7e593df tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:56:11.738487 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-de2b1e21-6049-4856-ba3b-9addc7e593df tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:56:11.738934 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-de2b1e21-6049-4856-ba3b-9addc7e593df tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:56:11.872005 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-de2b1e21-6049-4856-ba3b-9addc7e593df tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:56:11.880017 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-de2b1e21-6049-4856-ba3b-9addc7e593df tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1365 microversion: 2.1 time: 0.154993 Jul 23 21:56:11.880697 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2838/5448] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:56:11 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:56:12.900771 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9720c806-336d-4f3b-8f07-967e2fa0050b tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:56:12.901434 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-9720c806-336d-4f3b-8f07-967e2fa0050b tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:56:12.909667 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9720c806-336d-4f3b-8f07-967e2fa0050b tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:56:12.910220 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9720c806-336d-4f3b-8f07-967e2fa0050b tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:56:12.911098 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9720c806-336d-4f3b-8f07-967e2fa0050b tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:56:12.911594 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9720c806-336d-4f3b-8f07-967e2fa0050b tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:56:13.064600 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-9720c806-336d-4f3b-8f07-967e2fa0050b tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:56:13.073002 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9720c806-336d-4f3b-8f07-967e2fa0050b tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1365 microversion: 2.1 time: 0.178717 Jul 23 21:56:13.073957 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2839/5449] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:56:12 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1365 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:56:13.240655 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-b06ecbc3-bc2b-4976-8ef0-25ea4ea2d47a req-ee1d4e95-7b45-4a55-9bc2-f9df0de23c3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c96aa13-cbff-4245-a45b-418f131a0841", "name": "network-vif-plugged", "status": "completed", "tag": "a5aede91-0293-4461-849f-3a91ad088518"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:56:13.249135 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-b06ecbc3-bc2b-4976-8ef0-25ea4ea2d47a req-ee1d4e95-7b45-4a55-9bc2-f9df0de23c3f service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:56:13.249616 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-b06ecbc3-bc2b-4976-8ef0-25ea4ea2d47a req-ee1d4e95-7b45-4a55-9bc2-f9df0de23c3f service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:56:13.261124 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-b06ecbc3-bc2b-4976-8ef0-25ea4ea2d47a req-ee1d4e95-7b45-4a55-9bc2-f9df0de23c3f service nova] Creating event network-vif-plugged:a5aede91-0293-4461-849f-3a91ad088518 for instance 9c96aa13-cbff-4245-a45b-418f131a0841 on nch2-master-1 Jul 23 21:56:13.266138 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-b06ecbc3-bc2b-4976-8ef0-25ea4ea2d47a req-ee1d4e95-7b45-4a55-9bc2-f9df0de23c3f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094033 Jul 23 21:56:13.266765 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2840/5450] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:56:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:56:14.097206 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-37da9db2-0636-4788-9d9a-dd171a56ea6f tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:56:14.098397 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-37da9db2-0636-4788-9d9a-dd171a56ea6f tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:56:14.109000 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-37da9db2-0636-4788-9d9a-dd171a56ea6f tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:56:14.109752 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-37da9db2-0636-4788-9d9a-dd171a56ea6f tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:56:14.111077 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-37da9db2-0636-4788-9d9a-dd171a56ea6f tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:56:14.111814 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-37da9db2-0636-4788-9d9a-dd171a56ea6f tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:56:14.252532 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-37da9db2-0636-4788-9d9a-dd171a56ea6f tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:56:14.260588 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-37da9db2-0636-4788-9d9a-dd171a56ea6f tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1365 microversion: 2.1 time: 0.172270 Jul 23 21:56:14.261246 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2841/5451] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:56:14 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:56:15.283272 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6fff9cc9-e01d-4fdf-94c7-48e9b575231e tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:56:15.284358 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6fff9cc9-e01d-4fdf-94c7-48e9b575231e tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:56:15.294041 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6fff9cc9-e01d-4fdf-94c7-48e9b575231e tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:56:15.294501 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6fff9cc9-e01d-4fdf-94c7-48e9b575231e tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:56:15.295275 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6fff9cc9-e01d-4fdf-94c7-48e9b575231e tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:56:15.295720 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6fff9cc9-e01d-4fdf-94c7-48e9b575231e tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:56:15.430422 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6fff9cc9-e01d-4fdf-94c7-48e9b575231e tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:56:15.438416 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6fff9cc9-e01d-4fdf-94c7-48e9b575231e tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1552 microversion: 2.1 time: 0.161681 Jul 23 21:56:15.439018 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2842/5452] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:56:15 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1552 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:56:15.454482 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-80ab6fa3-cfa0-45ab-9880-e6cacac8038d tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:56:15.454982 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-80ab6fa3-cfa0-45ab-9880-e6cacac8038d tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:56:15.461161 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-80ab6fa3-cfa0-45ab-9880-e6cacac8038d tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:56:15.461617 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-80ab6fa3-cfa0-45ab-9880-e6cacac8038d tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:56:15.462424 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-80ab6fa3-cfa0-45ab-9880-e6cacac8038d tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:56:15.462864 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-80ab6fa3-cfa0-45ab-9880-e6cacac8038d tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:56:15.541420 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-80ab6fa3-cfa0-45ab-9880-e6cacac8038d tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090003 Jul 23 21:56:15.542356 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2843/5453] 10.222.0.17 () {58 vars in 1274 bytes} [Sat Jul 23 21:56:15 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:56:16.532442 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:56:16.533276 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=12 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:56:16.538018 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-59041d10-a64d-41b5-b442-b1e56c3921bc req-9941b416-43ca-4cb7-8082-841d14d0a3a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c96aa13-cbff-4245-a45b-418f131a0841", "tag": "a5aede91-0293-4461-849f-3a91ad088518"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:56:16.547222 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-59041d10-a64d-41b5-b442-b1e56c3921bc req-9941b416-43ca-4cb7-8082-841d14d0a3a1 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:56:16.547670 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-59041d10-a64d-41b5-b442-b1e56c3921bc req-9941b416-43ca-4cb7-8082-841d14d0a3a1 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:56:16.559233 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-59041d10-a64d-41b5-b442-b1e56c3921bc req-9941b416-43ca-4cb7-8082-841d14d0a3a1 service nova] Creating event network-changed:a5aede91-0293-4461-849f-3a91ad088518 for instance 9c96aa13-cbff-4245-a45b-418f131a0841 on nch2-master-1 Jul 23 21:56:16.564338 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-59041d10-a64d-41b5-b442-b1e56c3921bc req-9941b416-43ca-4cb7-8082-841d14d0a3a1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032624 Jul 23 21:56:16.564954 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2844/5454] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:56:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:56:52.726611 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=4 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:56:52.727485 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=60 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:56:52.731886 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-608b2edf-730d-436e-a7eb-5143690411a2 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:56:52.732616 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-608b2edf-730d-436e-a7eb-5143690411a2 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:56:52.740645 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-608b2edf-730d-436e-a7eb-5143690411a2 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:56:52.741108 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-608b2edf-730d-436e-a7eb-5143690411a2 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:56:52.741908 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-608b2edf-730d-436e-a7eb-5143690411a2 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:56:52.742378 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-608b2edf-730d-436e-a7eb-5143690411a2 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:56:52.887492 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-608b2edf-730d-436e-a7eb-5143690411a2 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:56:52.895535 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-608b2edf-730d-436e-a7eb-5143690411a2 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1670 microversion: 2.1 time: 0.171066 Jul 23 21:56:52.896080 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2845/5455] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:56:52 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1670 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:56:52.911629 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a4e9330a-ad0e-4c46-b9ae-cd739f14802c tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:56:52.912239 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a4e9330a-ad0e-4c46-b9ae-cd739f14802c tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:56:52.918118 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a4e9330a-ad0e-4c46-b9ae-cd739f14802c tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:56:52.918583 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a4e9330a-ad0e-4c46-b9ae-cd739f14802c tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:56:52.919366 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a4e9330a-ad0e-4c46-b9ae-cd739f14802c tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:56:52.919821 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a4e9330a-ad0e-4c46-b9ae-cd739f14802c tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:56:53.066554 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a4e9330a-ad0e-4c46-b9ae-cd739f14802c tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:56:53.079615 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a4e9330a-ad0e-4c46-b9ae-cd739f14802c tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1670 microversion: 2.1 time: 0.171224 Jul 23 21:56:53.080510 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2846/5456] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:56:52 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1670 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:56:53.096858 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0957dc96-120c-4f5d-a1b6-59615e70c493 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:56:53.097473 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-0957dc96-120c-4f5d-a1b6-59615e70c493 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:56:53.103624 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0957dc96-120c-4f5d-a1b6-59615e70c493 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:56:53.104083 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0957dc96-120c-4f5d-a1b6-59615e70c493 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:56:53.104868 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0957dc96-120c-4f5d-a1b6-59615e70c493 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:56:53.105318 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0957dc96-120c-4f5d-a1b6-59615e70c493 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:56:53.238638 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-0957dc96-120c-4f5d-a1b6-59615e70c493 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:56:53.246368 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-0957dc96-120c-4f5d-a1b6-59615e70c493 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1670 microversion: 2.1 time: 0.153747 Jul 23 21:56:53.246951 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2847/5457] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:56:53 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1670 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:56:53.262841 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-12a9fbae-f678-418a-b14f-950298b78d13 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1502073442"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:56:53.264002 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-12a9fbae-f678-418a-b14f-950298b78d13 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:56:53.270252 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-12a9fbae-f678-418a-b14f-950298b78d13 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:56:53.270718 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-12a9fbae-f678-418a-b14f-950298b78d13 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:56:53.271506 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-12a9fbae-f678-418a-b14f-950298b78d13 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:56:53.271980 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-12a9fbae-f678-418a-b14f-950298b78d13 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:56:53.573992 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-12a9fbae-f678-418a-b14f-950298b78d13 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "POST /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841/action" status: 202 len: 0 microversion: 2.1 time: 0.314785 Jul 23 21:56:53.574686 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2848/5458] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:56:53 2022] POST /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841/action => generated 0 bytes in 316 msecs (HTTP/1.1 202) 10 headers in 456 bytes (2 switches on core 0) Jul 23 21:56:59.512206 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-87464f9e-4fdc-4182-b8d7-7efcf22e792a req-c6847853-e237-4cb0-bc28-cdc9d1499b7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c96aa13-cbff-4245-a45b-418f131a0841", "name": "network-vif-plugged", "status": "completed", "tag": "a5aede91-0293-4461-849f-3a91ad088518"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:56:59.537300 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-87464f9e-4fdc-4182-b8d7-7efcf22e792a req-c6847853-e237-4cb0-bc28-cdc9d1499b7c service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:56:59.537887 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-87464f9e-4fdc-4182-b8d7-7efcf22e792a req-c6847853-e237-4cb0-bc28-cdc9d1499b7c service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:56:59.581030 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-87464f9e-4fdc-4182-b8d7-7efcf22e792a req-c6847853-e237-4cb0-bc28-cdc9d1499b7c service nova] Creating event network-vif-plugged:a5aede91-0293-4461-849f-3a91ad088518 for instance 9c96aa13-cbff-4245-a45b-418f131a0841 on nch2-master-1 Jul 23 21:56:59.587200 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-87464f9e-4fdc-4182-b8d7-7efcf22e792a req-c6847853-e237-4cb0-bc28-cdc9d1499b7c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079771 Jul 23 21:56:59.588263 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2849/5459] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:56:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:57:05.940304 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-db92d026-1bed-4193-b2aa-45417c62378d tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:57:05.940999 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-db92d026-1bed-4193-b2aa-45417c62378d tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:57:05.947999 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-db92d026-1bed-4193-b2aa-45417c62378d tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:05.948454 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-db92d026-1bed-4193-b2aa-45417c62378d tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:05.949273 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-db92d026-1bed-4193-b2aa-45417c62378d tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:05.949883 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-db92d026-1bed-4193-b2aa-45417c62378d tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:06.089630 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-db92d026-1bed-4193-b2aa-45417c62378d tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:57:06.101424 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-db92d026-1bed-4193-b2aa-45417c62378d tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1683 microversion: 2.1 time: 0.165310 Jul 23 21:57:06.102207 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2850/5460] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:57:05 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1683 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:57:07.126570 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c9cfb7c7-af44-4071-9e14-b92679179eac tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:57:07.127607 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c9cfb7c7-af44-4071-9e14-b92679179eac tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:57:07.139399 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c9cfb7c7-af44-4071-9e14-b92679179eac tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:07.140154 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c9cfb7c7-af44-4071-9e14-b92679179eac tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:07.141406 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c9cfb7c7-af44-4071-9e14-b92679179eac tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:07.141852 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c9cfb7c7-af44-4071-9e14-b92679179eac tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:07.282846 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c9cfb7c7-af44-4071-9e14-b92679179eac tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:57:07.291050 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c9cfb7c7-af44-4071-9e14-b92679179eac tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1670 microversion: 2.1 time: 0.171217 Jul 23 21:57:07.291591 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2851/5461] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:57:07 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1670 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:57:07.307168 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-13aa387c-2e55-4f43-9eb6-31f4b2d6ba1c tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-1150391623"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:57:07.308248 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-13aa387c-2e55-4f43-9eb6-31f4b2d6ba1c tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:57:07.314594 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-13aa387c-2e55-4f43-9eb6-31f4b2d6ba1c tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:07.315050 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-13aa387c-2e55-4f43-9eb6-31f4b2d6ba1c tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:07.315817 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-13aa387c-2e55-4f43-9eb6-31f4b2d6ba1c tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:07.316262 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-13aa387c-2e55-4f43-9eb6-31f4b2d6ba1c tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:07.601476 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-13aa387c-2e55-4f43-9eb6-31f4b2d6ba1c tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "POST /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841/action" status: 202 len: 0 microversion: 2.1 time: 0.297605 Jul 23 21:57:07.602248 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2852/5462] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:57:07 2022] POST /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841/action => generated 0 bytes in 299 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Jul 23 21:57:09.520153 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-cdde06da-8440-4e4f-8682-8eba554f87ea req-8ed75080-581b-4bad-babd-7f21cc850e59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c96aa13-cbff-4245-a45b-418f131a0841", "name": "network-vif-unplugged", "status": "completed", "tag": "a5aede91-0293-4461-849f-3a91ad088518"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:57:09.529372 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-cdde06da-8440-4e4f-8682-8eba554f87ea req-8ed75080-581b-4bad-babd-7f21cc850e59 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:09.529892 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-cdde06da-8440-4e4f-8682-8eba554f87ea req-8ed75080-581b-4bad-babd-7f21cc850e59 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:09.542828 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-cdde06da-8440-4e4f-8682-8eba554f87ea req-8ed75080-581b-4bad-babd-7f21cc850e59 service nova] Creating event network-vif-unplugged:a5aede91-0293-4461-849f-3a91ad088518 for instance 9c96aa13-cbff-4245-a45b-418f131a0841 on nch2-master-1 Jul 23 21:57:09.547757 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-cdde06da-8440-4e4f-8682-8eba554f87ea req-8ed75080-581b-4bad-babd-7f21cc850e59 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032625 Jul 23 21:57:09.548379 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2853/5463] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:57:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:57:13.595459 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-80fdfb1e-14a1-47ff-8615-86b0dec736db req-137914ac-355c-411d-be5a-ffe815187654 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c96aa13-cbff-4245-a45b-418f131a0841", "name": "network-vif-plugged", "status": "completed", "tag": "a5aede91-0293-4461-849f-3a91ad088518"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:57:13.609296 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-80fdfb1e-14a1-47ff-8615-86b0dec736db req-137914ac-355c-411d-be5a-ffe815187654 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:13.609755 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-80fdfb1e-14a1-47ff-8615-86b0dec736db req-137914ac-355c-411d-be5a-ffe815187654 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:13.623673 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-80fdfb1e-14a1-47ff-8615-86b0dec736db req-137914ac-355c-411d-be5a-ffe815187654 service nova] Creating event network-vif-plugged:a5aede91-0293-4461-849f-3a91ad088518 for instance 9c96aa13-cbff-4245-a45b-418f131a0841 on nch2-master-1 Jul 23 21:57:13.629509 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-80fdfb1e-14a1-47ff-8615-86b0dec736db req-137914ac-355c-411d-be5a-ffe815187654 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039403 Jul 23 21:57:13.630947 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2854/5464] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:57:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:57:21.071653 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-15a3aed0-42e7-4fc1-b45d-fcb606fe3280 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:57:21.072281 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-15a3aed0-42e7-4fc1-b45d-fcb606fe3280 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:57:21.079842 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-15a3aed0-42e7-4fc1-b45d-fcb606fe3280 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:21.080298 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-15a3aed0-42e7-4fc1-b45d-fcb606fe3280 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:21.081068 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-15a3aed0-42e7-4fc1-b45d-fcb606fe3280 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:21.081504 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-15a3aed0-42e7-4fc1-b45d-fcb606fe3280 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:21.217264 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-15a3aed0-42e7-4fc1-b45d-fcb606fe3280 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:57:21.225892 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-15a3aed0-42e7-4fc1-b45d-fcb606fe3280 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1670 microversion: 2.1 time: 0.158623 Jul 23 21:57:21.226484 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2855/5465] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:57:21 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1670 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:57:21.242217 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-92f494e2-b2fe-4869-9eb6-32428376282f tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-361519416"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:57:21.243306 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-92f494e2-b2fe-4869-9eb6-32428376282f tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:57:21.249353 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-92f494e2-b2fe-4869-9eb6-32428376282f tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:21.249802 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-92f494e2-b2fe-4869-9eb6-32428376282f tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:21.250599 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-92f494e2-b2fe-4869-9eb6-32428376282f tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:21.251034 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-92f494e2-b2fe-4869-9eb6-32428376282f tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:21.538306 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-92f494e2-b2fe-4869-9eb6-32428376282f tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "POST /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841/action" status: 202 len: 0 microversion: 2.1 time: 0.299444 Jul 23 21:57:21.538992 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2856/5466] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:57:21 2022] POST /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841/action => generated 0 bytes in 301 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Jul 23 21:57:21.548029 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6b5a1b32-da8c-4bd4-b07c-03596a202b4d tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:57:21.548741 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6b5a1b32-da8c-4bd4-b07c-03596a202b4d tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:57:21.555764 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6b5a1b32-da8c-4bd4-b07c-03596a202b4d tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:21.556227 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6b5a1b32-da8c-4bd4-b07c-03596a202b4d tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:21.557017 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6b5a1b32-da8c-4bd4-b07c-03596a202b4d tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:21.557464 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6b5a1b32-da8c-4bd4-b07c-03596a202b4d tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:21.690526 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6b5a1b32-da8c-4bd4-b07c-03596a202b4d tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:57:21.698572 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6b5a1b32-da8c-4bd4-b07c-03596a202b4d tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1680 microversion: 2.1 time: 0.154778 Jul 23 21:57:21.699155 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2857/5467] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:57:21 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:57:22.715692 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5e42631d-b735-4f8b-b5c5-c22bf4f63ce1 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:57:22.716421 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5e42631d-b735-4f8b-b5c5-c22bf4f63ce1 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:57:22.723910 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5e42631d-b735-4f8b-b5c5-c22bf4f63ce1 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:22.724368 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5e42631d-b735-4f8b-b5c5-c22bf4f63ce1 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:22.725142 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5e42631d-b735-4f8b-b5c5-c22bf4f63ce1 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:22.725583 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5e42631d-b735-4f8b-b5c5-c22bf4f63ce1 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:22.741345 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:57:22.860165 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5e42631d-b735-4f8b-b5c5-c22bf4f63ce1 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:57:22.868146 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5e42631d-b735-4f8b-b5c5-c22bf4f63ce1 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1680 microversion: 2.1 time: 0.156532 Jul 23 21:57:22.868728 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2858/5468] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:57:22 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:57:23.580397 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-03c10f18-dedd-4aeb-b57e-f77b91d9f10a req-c5dd091a-a870-44bd-ab91-c343ba5f6b99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c96aa13-cbff-4245-a45b-418f131a0841", "name": "network-vif-unplugged", "status": "completed", "tag": "a5aede91-0293-4461-849f-3a91ad088518"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:57:23.583843 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=29 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:57:23.590972 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-03c10f18-dedd-4aeb-b57e-f77b91d9f10a req-c5dd091a-a870-44bd-ab91-c343ba5f6b99 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:23.591450 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-03c10f18-dedd-4aeb-b57e-f77b91d9f10a req-c5dd091a-a870-44bd-ab91-c343ba5f6b99 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:23.604809 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-03c10f18-dedd-4aeb-b57e-f77b91d9f10a req-c5dd091a-a870-44bd-ab91-c343ba5f6b99 service nova] Creating event network-vif-unplugged:a5aede91-0293-4461-849f-3a91ad088518 for instance 9c96aa13-cbff-4245-a45b-418f131a0841 on nch2-master-1 Jul 23 21:57:23.609691 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-03c10f18-dedd-4aeb-b57e-f77b91d9f10a req-c5dd091a-a870-44bd-ab91-c343ba5f6b99 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033382 Jul 23 21:57:23.610447 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2859/5469] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:57:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:57:23.891293 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2ccfb47a-8a94-47a8-b7f8-fc22ba802a51 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:57:23.892383 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-2ccfb47a-8a94-47a8-b7f8-fc22ba802a51 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:57:23.903231 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2ccfb47a-8a94-47a8-b7f8-fc22ba802a51 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:23.903985 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2ccfb47a-8a94-47a8-b7f8-fc22ba802a51 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:23.905256 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2ccfb47a-8a94-47a8-b7f8-fc22ba802a51 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:23.906032 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2ccfb47a-8a94-47a8-b7f8-fc22ba802a51 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:24.052582 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-2ccfb47a-8a94-47a8-b7f8-fc22ba802a51 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:57:24.064341 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2ccfb47a-8a94-47a8-b7f8-fc22ba802a51 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1688 microversion: 2.1 time: 0.181552 Jul 23 21:57:24.065147 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2860/5470] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:57:23 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1688 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:57:25.084298 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-098d6c61-44cd-426f-95e1-35ba5fc66a09 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:57:25.084976 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-098d6c61-44cd-426f-95e1-35ba5fc66a09 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:57:25.092396 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-098d6c61-44cd-426f-95e1-35ba5fc66a09 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:25.092857 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-098d6c61-44cd-426f-95e1-35ba5fc66a09 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:25.093652 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-098d6c61-44cd-426f-95e1-35ba5fc66a09 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:25.094886 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-098d6c61-44cd-426f-95e1-35ba5fc66a09 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:25.239201 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-098d6c61-44cd-426f-95e1-35ba5fc66a09 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:57:25.246913 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-098d6c61-44cd-426f-95e1-35ba5fc66a09 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1688 microversion: 2.1 time: 0.167702 Jul 23 21:57:25.247493 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2861/5471] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:57:25 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1688 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:57:26.264249 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-08f1881f-e3c8-4a6e-9e21-f7bb9c4f441a tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:57:26.266196 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-08f1881f-e3c8-4a6e-9e21-f7bb9c4f441a tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:57:26.273596 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-08f1881f-e3c8-4a6e-9e21-f7bb9c4f441a tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:26.274333 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-08f1881f-e3c8-4a6e-9e21-f7bb9c4f441a tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:26.275324 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-08f1881f-e3c8-4a6e-9e21-f7bb9c4f441a tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:26.276151 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-08f1881f-e3c8-4a6e-9e21-f7bb9c4f441a tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:26.422966 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-08f1881f-e3c8-4a6e-9e21-f7bb9c4f441a tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:57:26.432238 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-08f1881f-e3c8-4a6e-9e21-f7bb9c4f441a tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1683 microversion: 2.1 time: 0.172103 Jul 23 21:57:26.439849 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2862/5472] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:57:26 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1683 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:57:27.452185 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c8cf309b-cef8-42d0-9abc-57527f88dd7f tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:57:27.452986 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c8cf309b-cef8-42d0-9abc-57527f88dd7f tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:57:27.460716 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c8cf309b-cef8-42d0-9abc-57527f88dd7f tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:27.461840 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c8cf309b-cef8-42d0-9abc-57527f88dd7f tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:27.462810 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c8cf309b-cef8-42d0-9abc-57527f88dd7f tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:27.463254 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c8cf309b-cef8-42d0-9abc-57527f88dd7f tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:27.617321 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c8cf309b-cef8-42d0-9abc-57527f88dd7f tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:57:27.627837 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c8cf309b-cef8-42d0-9abc-57527f88dd7f tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1683 microversion: 2.1 time: 0.179535 Jul 23 21:57:27.628688 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2863/5473] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:57:27 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1683 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:57:27.697587 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-55886555-96b1-4b95-baa4-14925742bf29 req-14c2ea4a-0e48-477a-89bc-c811d8c7a65b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c96aa13-cbff-4245-a45b-418f131a0841", "name": "network-vif-plugged", "status": "completed", "tag": "a5aede91-0293-4461-849f-3a91ad088518"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:57:27.706043 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-55886555-96b1-4b95-baa4-14925742bf29 req-14c2ea4a-0e48-477a-89bc-c811d8c7a65b service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:27.706516 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-55886555-96b1-4b95-baa4-14925742bf29 req-14c2ea4a-0e48-477a-89bc-c811d8c7a65b service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:27.720494 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-55886555-96b1-4b95-baa4-14925742bf29 req-14c2ea4a-0e48-477a-89bc-c811d8c7a65b service nova] Creating event network-vif-plugged:a5aede91-0293-4461-849f-3a91ad088518 for instance 9c96aa13-cbff-4245-a45b-418f131a0841 on nch2-master-1 Jul 23 21:57:27.724451 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-55886555-96b1-4b95-baa4-14925742bf29 req-14c2ea4a-0e48-477a-89bc-c811d8c7a65b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031426 Jul 23 21:57:27.725441 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2864/5474] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:57:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:57:28.646281 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ab1b437c-bba1-40de-98a1-fc387ce7321b tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:57:28.647002 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ab1b437c-bba1-40de-98a1-fc387ce7321b tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:57:28.653692 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ab1b437c-bba1-40de-98a1-fc387ce7321b tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:28.654442 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ab1b437c-bba1-40de-98a1-fc387ce7321b tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:28.655612 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ab1b437c-bba1-40de-98a1-fc387ce7321b tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:28.656064 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ab1b437c-bba1-40de-98a1-fc387ce7321b tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:28.796468 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ab1b437c-bba1-40de-98a1-fc387ce7321b tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:57:28.804585 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ab1b437c-bba1-40de-98a1-fc387ce7321b tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1683 microversion: 2.1 time: 0.163600 Jul 23 21:57:28.814746 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2865/5475] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:57:28 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1683 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:57:29.830988 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-486411c5-a30e-4185-907e-b21ca162d8a6 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:57:29.831783 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-486411c5-a30e-4185-907e-b21ca162d8a6 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:57:29.839445 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-486411c5-a30e-4185-907e-b21ca162d8a6 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:29.840015 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-486411c5-a30e-4185-907e-b21ca162d8a6 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:29.840797 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-486411c5-a30e-4185-907e-b21ca162d8a6 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:29.841246 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-486411c5-a30e-4185-907e-b21ca162d8a6 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:30.348717 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-486411c5-a30e-4185-907e-b21ca162d8a6 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:57:30.356801 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-486411c5-a30e-4185-907e-b21ca162d8a6 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1683 microversion: 2.1 time: 0.538513 Jul 23 21:57:30.366921 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2866/5476] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:57:29 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1683 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:57:31.374372 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1c2a38c7-fb55-4ec3-bae9-42edfd9b110f tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:57:31.375072 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1c2a38c7-fb55-4ec3-bae9-42edfd9b110f tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:57:31.382504 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1c2a38c7-fb55-4ec3-bae9-42edfd9b110f tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:31.385182 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1c2a38c7-fb55-4ec3-bae9-42edfd9b110f tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:31.386016 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1c2a38c7-fb55-4ec3-bae9-42edfd9b110f tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:31.386645 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1c2a38c7-fb55-4ec3-bae9-42edfd9b110f tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:31.528288 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-1c2a38c7-fb55-4ec3-bae9-42edfd9b110f tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:57:31.537455 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1c2a38c7-fb55-4ec3-bae9-42edfd9b110f tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1683 microversion: 2.1 time: 0.167067 Jul 23 21:57:31.538132 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2867/5477] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:57:31 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1683 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:57:32.555192 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-36d44973-71ad-4ef2-8e7b-bf45e7fb4b5e tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:57:32.555887 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-36d44973-71ad-4ef2-8e7b-bf45e7fb4b5e tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:57:32.563716 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-36d44973-71ad-4ef2-8e7b-bf45e7fb4b5e tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:32.564214 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-36d44973-71ad-4ef2-8e7b-bf45e7fb4b5e tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:32.565028 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-36d44973-71ad-4ef2-8e7b-bf45e7fb4b5e tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:32.565518 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-36d44973-71ad-4ef2-8e7b-bf45e7fb4b5e tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:32.712659 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-36d44973-71ad-4ef2-8e7b-bf45e7fb4b5e tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:57:32.721482 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-36d44973-71ad-4ef2-8e7b-bf45e7fb4b5e tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1683 microversion: 2.1 time: 0.170188 Jul 23 21:57:32.722671 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2868/5478] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:57:32 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1683 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:57:33.739016 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d2d86bae-5caf-46e9-b6f6-ce3e9fe35649 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:57:33.740595 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d2d86bae-5caf-46e9-b6f6-ce3e9fe35649 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:57:33.750275 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d2d86bae-5caf-46e9-b6f6-ce3e9fe35649 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:33.751060 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d2d86bae-5caf-46e9-b6f6-ce3e9fe35649 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:33.752047 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d2d86bae-5caf-46e9-b6f6-ce3e9fe35649 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:33.752491 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d2d86bae-5caf-46e9-b6f6-ce3e9fe35649 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:33.915507 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d2d86bae-5caf-46e9-b6f6-ce3e9fe35649 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:57:33.926917 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d2d86bae-5caf-46e9-b6f6-ce3e9fe35649 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1683 microversion: 2.1 time: 0.191861 Jul 23 21:57:33.928168 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2869/5479] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:57:33 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1683 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:57:34.945474 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-70651927-27a6-4791-8d0d-dfcd4e2983ef tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:57:34.946140 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-70651927-27a6-4791-8d0d-dfcd4e2983ef tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:57:34.953435 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-70651927-27a6-4791-8d0d-dfcd4e2983ef tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:34.953909 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-70651927-27a6-4791-8d0d-dfcd4e2983ef tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:34.954725 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-70651927-27a6-4791-8d0d-dfcd4e2983ef tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:34.955159 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-70651927-27a6-4791-8d0d-dfcd4e2983ef tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:35.094793 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-70651927-27a6-4791-8d0d-dfcd4e2983ef tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:57:35.102975 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-70651927-27a6-4791-8d0d-dfcd4e2983ef tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1670 microversion: 2.1 time: 0.161960 Jul 23 21:57:35.103873 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2870/5480] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:57:34 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1670 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:57:35.209601 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b9316638-ca71-4caf-8d74-8f551ebbe385 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:57:35.210253 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b9316638-ca71-4caf-8d74-8f551ebbe385 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:57:35.216716 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b9316638-ca71-4caf-8d74-8f551ebbe385 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:35.217180 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b9316638-ca71-4caf-8d74-8f551ebbe385 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:35.217985 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b9316638-ca71-4caf-8d74-8f551ebbe385 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:35.218438 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b9316638-ca71-4caf-8d74-8f551ebbe385 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:35.347234 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b9316638-ca71-4caf-8d74-8f551ebbe385 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:57:35.355414 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b9316638-ca71-4caf-8d74-8f551ebbe385 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1670 microversion: 2.1 time: 0.150396 Jul 23 21:57:35.355930 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2871/5481] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:57:35 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1670 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:57:36.216995 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e5d37b95-92ad-49e9-8226-3e327f07310a tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:57:36.217671 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e5d37b95-92ad-49e9-8226-3e327f07310a tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:57:36.225460 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e5d37b95-92ad-49e9-8226-3e327f07310a tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:36.225984 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e5d37b95-92ad-49e9-8226-3e327f07310a tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:36.226766 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e5d37b95-92ad-49e9-8226-3e327f07310a tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:36.227201 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e5d37b95-92ad-49e9-8226-3e327f07310a tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:36.375662 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e5d37b95-92ad-49e9-8226-3e327f07310a tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:57:36.388194 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e5d37b95-92ad-49e9-8226-3e327f07310a tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1670 microversion: 2.1 time: 0.175069 Jul 23 21:57:36.388779 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2872/5482] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:57:36 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1670 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:57:36.404496 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-13019cd0-2d84-406e-ab10-cce1691d9af9 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:57:36.405102 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-13019cd0-2d84-406e-ab10-cce1691d9af9 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:57:36.411427 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-13019cd0-2d84-406e-ab10-cce1691d9af9 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:36.411875 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-13019cd0-2d84-406e-ab10-cce1691d9af9 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:36.412644 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-13019cd0-2d84-406e-ab10-cce1691d9af9 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:36.413083 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-13019cd0-2d84-406e-ab10-cce1691d9af9 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:36.550771 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-13019cd0-2d84-406e-ab10-cce1691d9af9 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:57:36.558948 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-13019cd0-2d84-406e-ab10-cce1691d9af9 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1670 microversion: 2.1 time: 0.158151 Jul 23 21:57:36.559524 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2873/5483] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:57:36 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1670 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:57:36.574887 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-db33289f-77e8-42b8-9657-c43d47c9c8a2 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:57:36.575511 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-db33289f-77e8-42b8-9657-c43d47c9c8a2 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:57:36.581535 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-db33289f-77e8-42b8-9657-c43d47c9c8a2 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:36.582107 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-db33289f-77e8-42b8-9657-c43d47c9c8a2 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:36.582891 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-db33289f-77e8-42b8-9657-c43d47c9c8a2 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:36.583339 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-db33289f-77e8-42b8-9657-c43d47c9c8a2 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:36.712856 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-db33289f-77e8-42b8-9657-c43d47c9c8a2 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:57:36.724931 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-db33289f-77e8-42b8-9657-c43d47c9c8a2 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1670 microversion: 2.1 time: 0.153527 Jul 23 21:57:36.725638 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2874/5484] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:57:36 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1670 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:57:36.745110 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ecb03fab-31dc-49af-8715-6ca47054e699 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:57:36.746104 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ecb03fab-31dc-49af-8715-6ca47054e699 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:57:36.752108 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ecb03fab-31dc-49af-8715-6ca47054e699 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:36.752534 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ecb03fab-31dc-49af-8715-6ca47054e699 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:36.753323 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ecb03fab-31dc-49af-8715-6ca47054e699 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:36.753829 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ecb03fab-31dc-49af-8715-6ca47054e699 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:36.807088 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:57:36.832519 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ecb03fab-31dc-49af-8715-6ca47054e699 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "POST /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841/action" status: 202 len: 0 microversion: 2.1 time: 0.090842 Jul 23 21:57:36.833201 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2875/5485] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:57:36 2022] POST /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:57:36.841599 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-53c8ced8-11bb-46d5-b2b9-c22c9aa79372 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:57:36.842347 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-53c8ced8-11bb-46d5-b2b9-c22c9aa79372 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:57:36.849314 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-53c8ced8-11bb-46d5-b2b9-c22c9aa79372 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:36.849709 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-53c8ced8-11bb-46d5-b2b9-c22c9aa79372 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:36.850959 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-53c8ced8-11bb-46d5-b2b9-c22c9aa79372 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:36.851422 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-53c8ced8-11bb-46d5-b2b9-c22c9aa79372 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:37.071129 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-53c8ced8-11bb-46d5-b2b9-c22c9aa79372 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:57:37.079116 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-53c8ced8-11bb-46d5-b2b9-c22c9aa79372 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1672 microversion: 2.1 time: 0.241424 Jul 23 21:57:37.079756 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2876/5486] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:57:36 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1672 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:57:37.698994 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-f6db9b13-c582-49d7-9a79-f4be830d51f6 req-28ab6d87-84a5-4530-96c7-dc45dec00ee6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c96aa13-cbff-4245-a45b-418f131a0841", "name": "network-vif-unplugged", "status": "completed", "tag": "a5aede91-0293-4461-849f-3a91ad088518"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:57:37.708703 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-f6db9b13-c582-49d7-9a79-f4be830d51f6 req-28ab6d87-84a5-4530-96c7-dc45dec00ee6 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:37.709164 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-f6db9b13-c582-49d7-9a79-f4be830d51f6 req-28ab6d87-84a5-4530-96c7-dc45dec00ee6 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:37.723831 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-f6db9b13-c582-49d7-9a79-f4be830d51f6 req-28ab6d87-84a5-4530-96c7-dc45dec00ee6 service nova] Creating event network-vif-unplugged:a5aede91-0293-4461-849f-3a91ad088518 for instance 9c96aa13-cbff-4245-a45b-418f131a0841 on nch2-master-1 Jul 23 21:57:37.728797 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-f6db9b13-c582-49d7-9a79-f4be830d51f6 req-28ab6d87-84a5-4530-96c7-dc45dec00ee6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033558 Jul 23 21:57:37.729453 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2877/5487] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:57:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:57:38.097967 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e0f4f08f-78b6-4eff-a7e6-504d3d4441fd tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:57:38.098682 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e0f4f08f-78b6-4eff-a7e6-504d3d4441fd tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:57:38.105590 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e0f4f08f-78b6-4eff-a7e6-504d3d4441fd tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:38.106096 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e0f4f08f-78b6-4eff-a7e6-504d3d4441fd tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:38.106891 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e0f4f08f-78b6-4eff-a7e6-504d3d4441fd tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:38.107344 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e0f4f08f-78b6-4eff-a7e6-504d3d4441fd tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:38.248347 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e0f4f08f-78b6-4eff-a7e6-504d3d4441fd tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:57:38.259962 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e0f4f08f-78b6-4eff-a7e6-504d3d4441fd tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1670 microversion: 2.1 time: 0.166438 Jul 23 21:57:38.260683 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2878/5488] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:57:38 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1670 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:57:38.279351 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-983b03eb-d66f-4d0c-88b0-394aa68f2b80 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:57:38.280340 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-983b03eb-d66f-4d0c-88b0-394aa68f2b80 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:57:38.286758 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-983b03eb-d66f-4d0c-88b0-394aa68f2b80 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:38.287224 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-983b03eb-d66f-4d0c-88b0-394aa68f2b80 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:38.288010 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-983b03eb-d66f-4d0c-88b0-394aa68f2b80 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:38.288460 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-983b03eb-d66f-4d0c-88b0-394aa68f2b80 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:38.336978 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-983b03eb-d66f-4d0c-88b0-394aa68f2b80 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "POST /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841/action" status: 200 len: 145 microversion: 2.1 time: 0.061168 Jul 23 21:57:38.337635 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2879/5489] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:57:38 2022] POST /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841/action => generated 145 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:57:38.347537 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-dd7cec0c-913a-4b4c-a88f-f52030a3a5b6 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:57:38.348313 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-dd7cec0c-913a-4b4c-a88f-f52030a3a5b6 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:57:38.355636 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dd7cec0c-913a-4b4c-a88f-f52030a3a5b6 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:38.356099 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dd7cec0c-913a-4b4c-a88f-f52030a3a5b6 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:38.356876 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dd7cec0c-913a-4b4c-a88f-f52030a3a5b6 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:38.357521 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dd7cec0c-913a-4b4c-a88f-f52030a3a5b6 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:38.500128 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-dd7cec0c-913a-4b4c-a88f-f52030a3a5b6 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:57:38.512174 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-dd7cec0c-913a-4b4c-a88f-f52030a3a5b6 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1670 microversion: 2.1 time: 0.168880 Jul 23 21:57:38.512995 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2880/5490] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:57:38 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1670 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:57:38.531675 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a50b37b0-1056-4da9-9f98-d9a135c391a4 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:57:38.532290 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a50b37b0-1056-4da9-9f98-d9a135c391a4 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:57:38.538510 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a50b37b0-1056-4da9-9f98-d9a135c391a4 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:38.538972 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a50b37b0-1056-4da9-9f98-d9a135c391a4 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:38.539747 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a50b37b0-1056-4da9-9f98-d9a135c391a4 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:38.540203 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a50b37b0-1056-4da9-9f98-d9a135c391a4 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:38.678733 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a50b37b0-1056-4da9-9f98-d9a135c391a4 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:57:38.686498 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a50b37b0-1056-4da9-9f98-d9a135c391a4 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1670 microversion: 2.1 time: 0.158610 Jul 23 21:57:38.687086 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2881/5491] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:57:38 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1670 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:57:38.702333 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ccf0a9a4-3b44-467a-b48f-c182595283f1 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:57:38.702978 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ccf0a9a4-3b44-467a-b48f-c182595283f1 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:57:38.709346 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ccf0a9a4-3b44-467a-b48f-c182595283f1 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:38.709786 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ccf0a9a4-3b44-467a-b48f-c182595283f1 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:38.710613 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ccf0a9a4-3b44-467a-b48f-c182595283f1 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:38.711027 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ccf0a9a4-3b44-467a-b48f-c182595283f1 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:38.847485 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ccf0a9a4-3b44-467a-b48f-c182595283f1 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:57:38.855567 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ccf0a9a4-3b44-467a-b48f-c182595283f1 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1670 microversion: 2.1 time: 0.156777 Jul 23 21:57:38.856152 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2882/5492] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:57:38 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1670 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:57:38.871249 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b782c37f-0eb7-4ad3-a1d3-63de10f70304 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:57:38.871807 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b782c37f-0eb7-4ad3-a1d3-63de10f70304 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:57:38.878308 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b782c37f-0eb7-4ad3-a1d3-63de10f70304 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:38.878791 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b782c37f-0eb7-4ad3-a1d3-63de10f70304 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:38.879634 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b782c37f-0eb7-4ad3-a1d3-63de10f70304 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:38.880084 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b782c37f-0eb7-4ad3-a1d3-63de10f70304 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:39.017886 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b782c37f-0eb7-4ad3-a1d3-63de10f70304 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:57:39.026094 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b782c37f-0eb7-4ad3-a1d3-63de10f70304 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1670 microversion: 2.1 time: 0.158484 Jul 23 21:57:39.026690 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2883/5493] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:57:38 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1670 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:57:39.084029 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a64b3451-9dc6-4a19-b90a-d4f3094a3a38 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-352863135", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "networks": [{"uuid": "6770b9e7-826f-46ba-879d-e25a87aab2e5"}]}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:57:39.136431 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-a64b3451-9dc6-4a19-b90a-d4f3094a3a38 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] validate_networks() for [('6770b9e7-826f-46ba-879d-e25a87aab2e5', None, None, None, None, None)] {{(pid=131320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:57:39.525378 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-a64b3451-9dc6-4a19-b90a-d4f3094a3a38 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:57:39.525806 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-a64b3451-9dc6-4a19-b90a-d4f3094a3a38 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:57:39.526324 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-a64b3451-9dc6-4a19-b90a-d4f3094a3a38 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:57:39.526735 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-a64b3451-9dc6-4a19-b90a-d4f3094a3a38 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:57:39.527144 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-a64b3451-9dc6-4a19-b90a-d4f3094a3a38 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:57:39.537356 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a64b3451-9dc6-4a19-b90a-d4f3094a3a38 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:39.537810 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a64b3451-9dc6-4a19-b90a-d4f3094a3a38 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:39.538645 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a64b3451-9dc6-4a19-b90a-d4f3094a3a38 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:39.539082 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a64b3451-9dc6-4a19-b90a-d4f3094a3a38 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:39.556144 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-a64b3451-9dc6-4a19-b90a-d4f3094a3a38 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Getting quotas for project 7f624e0dec4a4f64b1d3580e60867c41. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:57:39.561847 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-a64b3451-9dc6-4a19-b90a-d4f3094a3a38 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Getting quotas for user b5408fb2f4044c6d88527222b190230d and project 7f624e0dec4a4f64b1d3580e60867c41. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:57:39.575393 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a64b3451-9dc6-4a19-b90a-d4f3094a3a38 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Going to run 1 instances... {{(pid=131320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:57:39.577691 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a64b3451-9dc6-4a19-b90a-d4f3094a3a38 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: a91bf2ce-9a7f-461c-93d4-baaa04d10d53] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:57:39.630478 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a64b3451-9dc6-4a19-b90a-d4f3094a3a38 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.550228 Jul 23 21:57:39.631135 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2884/5494] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:57:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 552 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 23 21:57:39.641158 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ae16edb9-6aa2-4c3f-acb9-8e5c732143a9 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:57:39.641876 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ae16edb9-6aa2-4c3f-acb9-8e5c732143a9 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: a91bf2ce-9a7f-461c-93d4-baaa04d10d53] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:57:39.701012 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ae16edb9-6aa2-4c3f-acb9-8e5c732143a9 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:57:39.711506 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ae16edb9-6aa2-4c3f-acb9-8e5c732143a9 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/a91bf2ce-9a7f-461c-93d4-baaa04d10d53" status: 200 len: 1214 microversion: 2.1 time: 0.074217 Jul 23 21:57:39.712890 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2885/5495] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:57:39 2022] GET /compute/v2.1/servers/a91bf2ce-9a7f-461c-93d4-baaa04d10d53 => generated 1214 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:57:40.729353 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6d1332bd-0ce0-4b45-b147-353def3746ba tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:57:40.730822 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6d1332bd-0ce0-4b45-b147-353def3746ba tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: a91bf2ce-9a7f-461c-93d4-baaa04d10d53] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:57:40.739143 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6d1332bd-0ce0-4b45-b147-353def3746ba tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:40.739699 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6d1332bd-0ce0-4b45-b147-353def3746ba tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:40.740647 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6d1332bd-0ce0-4b45-b147-353def3746ba tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:40.741467 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6d1332bd-0ce0-4b45-b147-353def3746ba tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:40.808097 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6d1332bd-0ce0-4b45-b147-353def3746ba tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:57:40.817622 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6d1332bd-0ce0-4b45-b147-353def3746ba tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/a91bf2ce-9a7f-461c-93d4-baaa04d10d53" status: 200 len: 1284 microversion: 2.1 time: 0.092294 Jul 23 21:57:40.822016 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2886/5496] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:57:40 2022] GET /compute/v2.1/servers/a91bf2ce-9a7f-461c-93d4-baaa04d10d53 => generated 1284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:57:41.835255 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c58084ea-fa56-467b-a8de-55941350ea53 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:57:41.835951 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c58084ea-fa56-467b-a8de-55941350ea53 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: a91bf2ce-9a7f-461c-93d4-baaa04d10d53] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:57:41.842743 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c58084ea-fa56-467b-a8de-55941350ea53 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:41.843201 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c58084ea-fa56-467b-a8de-55941350ea53 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:41.845054 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c58084ea-fa56-467b-a8de-55941350ea53 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:41.845831 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c58084ea-fa56-467b-a8de-55941350ea53 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:41.990241 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c58084ea-fa56-467b-a8de-55941350ea53 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:57:41.999146 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c58084ea-fa56-467b-a8de-55941350ea53 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/a91bf2ce-9a7f-461c-93d4-baaa04d10d53" status: 200 len: 1314 microversion: 2.1 time: 0.167912 Jul 23 21:57:41.999853 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2887/5497] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:57:41 2022] GET /compute/v2.1/servers/a91bf2ce-9a7f-461c-93d4-baaa04d10d53 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:57:42.534170 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-a7a97141-4b52-4990-b23d-24d613b4fa6e req-d432831c-7d1f-4eb4-8fef-a03b3021c63c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a91bf2ce-9a7f-461c-93d4-baaa04d10d53", "tag": "3e8f2862-57a4-4750-afcf-2d739b0a48c2"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:57:42.543712 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-a7a97141-4b52-4990-b23d-24d613b4fa6e req-d432831c-7d1f-4eb4-8fef-a03b3021c63c service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:42.544161 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-a7a97141-4b52-4990-b23d-24d613b4fa6e req-d432831c-7d1f-4eb4-8fef-a03b3021c63c service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:42.556103 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-a7a97141-4b52-4990-b23d-24d613b4fa6e req-d432831c-7d1f-4eb4-8fef-a03b3021c63c service nova] Creating event network-changed:3e8f2862-57a4-4750-afcf-2d739b0a48c2 for instance a91bf2ce-9a7f-461c-93d4-baaa04d10d53 on nch1-master-1 Jul 23 21:57:42.561276 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-a7a97141-4b52-4990-b23d-24d613b4fa6e req-d432831c-7d1f-4eb4-8fef-a03b3021c63c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118232 Jul 23 21:57:42.561922 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2888/5498] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:57:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:57:43.018684 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2f37ce9e-b2b8-4fd1-8ba4-c0d1917b6d1f tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:57:43.019409 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-2f37ce9e-b2b8-4fd1-8ba4-c0d1917b6d1f tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: a91bf2ce-9a7f-461c-93d4-baaa04d10d53] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:57:43.025918 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2f37ce9e-b2b8-4fd1-8ba4-c0d1917b6d1f tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:43.026416 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2f37ce9e-b2b8-4fd1-8ba4-c0d1917b6d1f tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:43.027186 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2f37ce9e-b2b8-4fd1-8ba4-c0d1917b6d1f tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:43.027624 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2f37ce9e-b2b8-4fd1-8ba4-c0d1917b6d1f tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:43.177609 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-2f37ce9e-b2b8-4fd1-8ba4-c0d1917b6d1f tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:57:43.186306 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2f37ce9e-b2b8-4fd1-8ba4-c0d1917b6d1f tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/a91bf2ce-9a7f-461c-93d4-baaa04d10d53" status: 200 len: 1314 microversion: 2.1 time: 0.172810 Jul 23 21:57:43.186881 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2889/5499] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:57:43 2022] GET /compute/v2.1/servers/a91bf2ce-9a7f-461c-93d4-baaa04d10d53 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:57:44.205004 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-10edf061-948b-4e15-b293-cc53552cab5b tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:57:44.205708 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-10edf061-948b-4e15-b293-cc53552cab5b tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: a91bf2ce-9a7f-461c-93d4-baaa04d10d53] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:57:44.212834 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-10edf061-948b-4e15-b293-cc53552cab5b tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:44.213288 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-10edf061-948b-4e15-b293-cc53552cab5b tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:44.214101 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-10edf061-948b-4e15-b293-cc53552cab5b tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:44.214542 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-10edf061-948b-4e15-b293-cc53552cab5b tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:44.343878 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-10edf061-948b-4e15-b293-cc53552cab5b tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:57:44.352374 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-10edf061-948b-4e15-b293-cc53552cab5b tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/a91bf2ce-9a7f-461c-93d4-baaa04d10d53" status: 200 len: 1314 microversion: 2.1 time: 0.151450 Jul 23 21:57:44.352984 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2890/5500] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:57:44 2022] GET /compute/v2.1/servers/a91bf2ce-9a7f-461c-93d4-baaa04d10d53 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:57:45.369056 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0b14b7d7-90fe-4beb-b79b-cef44da3ef08 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:57:45.369641 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-0b14b7d7-90fe-4beb-b79b-cef44da3ef08 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: a91bf2ce-9a7f-461c-93d4-baaa04d10d53] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:57:45.377237 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0b14b7d7-90fe-4beb-b79b-cef44da3ef08 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:45.377727 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0b14b7d7-90fe-4beb-b79b-cef44da3ef08 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:45.378570 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0b14b7d7-90fe-4beb-b79b-cef44da3ef08 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:45.379019 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0b14b7d7-90fe-4beb-b79b-cef44da3ef08 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:45.527147 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-0b14b7d7-90fe-4beb-b79b-cef44da3ef08 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:57:45.535494 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-0b14b7d7-90fe-4beb-b79b-cef44da3ef08 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/a91bf2ce-9a7f-461c-93d4-baaa04d10d53" status: 200 len: 1314 microversion: 2.1 time: 0.170391 Jul 23 21:57:45.536054 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2891/5501] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:57:45 2022] GET /compute/v2.1/servers/a91bf2ce-9a7f-461c-93d4-baaa04d10d53 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:57:46.555232 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e1d9fae2-64b3-4d4b-8ebc-ac8227d8a745 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:57:46.556003 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e1d9fae2-64b3-4d4b-8ebc-ac8227d8a745 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: a91bf2ce-9a7f-461c-93d4-baaa04d10d53] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:57:46.564771 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e1d9fae2-64b3-4d4b-8ebc-ac8227d8a745 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:46.565231 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e1d9fae2-64b3-4d4b-8ebc-ac8227d8a745 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:46.566324 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e1d9fae2-64b3-4d4b-8ebc-ac8227d8a745 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:46.566848 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e1d9fae2-64b3-4d4b-8ebc-ac8227d8a745 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:46.707167 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e1d9fae2-64b3-4d4b-8ebc-ac8227d8a745 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:57:46.714942 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e1d9fae2-64b3-4d4b-8ebc-ac8227d8a745 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/a91bf2ce-9a7f-461c-93d4-baaa04d10d53" status: 200 len: 1314 microversion: 2.1 time: 0.165483 Jul 23 21:57:46.715543 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2892/5502] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:57:46 2022] GET /compute/v2.1/servers/a91bf2ce-9a7f-461c-93d4-baaa04d10d53 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:57:47.735712 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-712a8c7d-a7d7-4e9b-89ac-eb92290c5319 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:57:47.736681 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-712a8c7d-a7d7-4e9b-89ac-eb92290c5319 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: a91bf2ce-9a7f-461c-93d4-baaa04d10d53] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:57:47.746639 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-712a8c7d-a7d7-4e9b-89ac-eb92290c5319 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:47.747303 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-712a8c7d-a7d7-4e9b-89ac-eb92290c5319 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:47.748402 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-712a8c7d-a7d7-4e9b-89ac-eb92290c5319 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:47.749031 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-712a8c7d-a7d7-4e9b-89ac-eb92290c5319 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:47.888902 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-712a8c7d-a7d7-4e9b-89ac-eb92290c5319 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:57:47.897742 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-712a8c7d-a7d7-4e9b-89ac-eb92290c5319 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/a91bf2ce-9a7f-461c-93d4-baaa04d10d53" status: 200 len: 1314 microversion: 2.1 time: 0.167937 Jul 23 21:57:47.898373 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2893/5503] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:57:47 2022] GET /compute/v2.1/servers/a91bf2ce-9a7f-461c-93d4-baaa04d10d53 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:57:47.994740 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-1f811512-937c-44d6-a2e5-f97a10c80dc2 req-a5e0874a-6142-43dd-90de-2fb511b23979 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a91bf2ce-9a7f-461c-93d4-baaa04d10d53", "name": "network-vif-plugged", "status": "completed", "tag": "3e8f2862-57a4-4750-afcf-2d739b0a48c2"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:57:48.003427 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-1f811512-937c-44d6-a2e5-f97a10c80dc2 req-a5e0874a-6142-43dd-90de-2fb511b23979 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:48.003966 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-1f811512-937c-44d6-a2e5-f97a10c80dc2 req-a5e0874a-6142-43dd-90de-2fb511b23979 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:48.016792 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-1f811512-937c-44d6-a2e5-f97a10c80dc2 req-a5e0874a-6142-43dd-90de-2fb511b23979 service nova] Creating event network-vif-plugged:3e8f2862-57a4-4750-afcf-2d739b0a48c2 for instance a91bf2ce-9a7f-461c-93d4-baaa04d10d53 on nch1-master-1 Jul 23 21:57:48.021822 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-1f811512-937c-44d6-a2e5-f97a10c80dc2 req-a5e0874a-6142-43dd-90de-2fb511b23979 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031037 Jul 23 21:57:48.022424 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2894/5504] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:57:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:57:48.920082 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9b2d821d-69cf-4f15-bffd-e0cc2122ced7 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:57:48.921205 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-9b2d821d-69cf-4f15-bffd-e0cc2122ced7 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: a91bf2ce-9a7f-461c-93d4-baaa04d10d53] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:57:48.931715 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9b2d821d-69cf-4f15-bffd-e0cc2122ced7 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:48.932166 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9b2d821d-69cf-4f15-bffd-e0cc2122ced7 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:48.932940 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9b2d821d-69cf-4f15-bffd-e0cc2122ced7 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:48.933377 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9b2d821d-69cf-4f15-bffd-e0cc2122ced7 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:49.068383 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-9b2d821d-69cf-4f15-bffd-e0cc2122ced7 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:57:49.076864 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9b2d821d-69cf-4f15-bffd-e0cc2122ced7 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/a91bf2ce-9a7f-461c-93d4-baaa04d10d53" status: 200 len: 1314 microversion: 2.1 time: 0.163900 Jul 23 21:57:49.077383 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2895/5505] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:57:48 2022] GET /compute/v2.1/servers/a91bf2ce-9a7f-461c-93d4-baaa04d10d53 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:57:50.104400 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8b850b0f-d6b5-413a-aa05-f673b9a83629 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:57:50.105392 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8b850b0f-d6b5-413a-aa05-f673b9a83629 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: a91bf2ce-9a7f-461c-93d4-baaa04d10d53] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:57:50.108388 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:57:50.109477 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=8 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:57:50.119486 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8b850b0f-d6b5-413a-aa05-f673b9a83629 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:50.120209 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8b850b0f-d6b5-413a-aa05-f673b9a83629 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:50.121396 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8b850b0f-d6b5-413a-aa05-f673b9a83629 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:50.122116 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8b850b0f-d6b5-413a-aa05-f673b9a83629 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:50.126339 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:57:50.260570 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8b850b0f-d6b5-413a-aa05-f673b9a83629 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:57:50.271930 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8b850b0f-d6b5-413a-aa05-f673b9a83629 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/a91bf2ce-9a7f-461c-93d4-baaa04d10d53" status: 200 len: 1501 microversion: 2.1 time: 0.173811 Jul 23 21:57:50.272518 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2896/5506] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:57:50 2022] GET /compute/v2.1/servers/a91bf2ce-9a7f-461c-93d4-baaa04d10d53 => generated 1501 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:57:50.288264 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-edfffcd7-ee3f-4458-9972-1a816801d78a tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:57:50.294532 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-edfffcd7-ee3f-4458-9972-1a816801d78a tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:50.294985 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-edfffcd7-ee3f-4458-9972-1a816801d78a tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:50.317485 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-edfffcd7-ee3f-4458-9972-1a816801d78a tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: a91bf2ce-9a7f-461c-93d4-baaa04d10d53] Going to try to stop instance {{(pid=131320) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 23 21:57:50.371921 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-edfffcd7-ee3f-4458-9972-1a816801d78a tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "POST /compute/v2.1/servers/a91bf2ce-9a7f-461c-93d4-baaa04d10d53/action" status: 202 len: 0 microversion: 2.1 time: 0.087098 Jul 23 21:57:50.372760 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2897/5507] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:57:50 2022] POST /compute/v2.1/servers/a91bf2ce-9a7f-461c-93d4-baaa04d10d53/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 23 21:57:50.381559 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9fc6e77b-1129-4526-a45c-cb8f7e5234dc tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:57:50.382433 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-9fc6e77b-1129-4526-a45c-cb8f7e5234dc tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: a91bf2ce-9a7f-461c-93d4-baaa04d10d53] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:57:50.389067 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9fc6e77b-1129-4526-a45c-cb8f7e5234dc tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:50.389494 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9fc6e77b-1129-4526-a45c-cb8f7e5234dc tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:50.390309 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9fc6e77b-1129-4526-a45c-cb8f7e5234dc tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:50.390734 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9fc6e77b-1129-4526-a45c-cb8f7e5234dc tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:50.534811 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-9fc6e77b-1129-4526-a45c-cb8f7e5234dc tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:57:50.543144 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9fc6e77b-1129-4526-a45c-cb8f7e5234dc tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/a91bf2ce-9a7f-461c-93d4-baaa04d10d53" status: 200 len: 1511 microversion: 2.1 time: 0.165666 Jul 23 21:57:50.543675 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2898/5508] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:57:50 2022] GET /compute/v2.1/servers/a91bf2ce-9a7f-461c-93d4-baaa04d10d53 => generated 1511 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:57:51.564967 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6e7d4697-843a-4df2-a1d2-a4ba770c6dca tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:57:51.566069 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6e7d4697-843a-4df2-a1d2-a4ba770c6dca tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: a91bf2ce-9a7f-461c-93d4-baaa04d10d53] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:57:51.574417 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6e7d4697-843a-4df2-a1d2-a4ba770c6dca tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:51.574874 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6e7d4697-843a-4df2-a1d2-a4ba770c6dca tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:51.575646 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6e7d4697-843a-4df2-a1d2-a4ba770c6dca tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:51.576085 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6e7d4697-843a-4df2-a1d2-a4ba770c6dca tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:51.709349 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6e7d4697-843a-4df2-a1d2-a4ba770c6dca tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:57:51.717077 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6e7d4697-843a-4df2-a1d2-a4ba770c6dca tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/a91bf2ce-9a7f-461c-93d4-baaa04d10d53" status: 200 len: 1511 microversion: 2.1 time: 0.158826 Jul 23 21:57:51.717677 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2899/5509] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:57:51 2022] GET /compute/v2.1/servers/a91bf2ce-9a7f-461c-93d4-baaa04d10d53 => generated 1511 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:57:52.735272 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6c085069-c214-46c8-8df7-0b81f0be7efc tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:57:52.735982 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6c085069-c214-46c8-8df7-0b81f0be7efc tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: a91bf2ce-9a7f-461c-93d4-baaa04d10d53] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:57:52.744038 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6c085069-c214-46c8-8df7-0b81f0be7efc tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:52.744638 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6c085069-c214-46c8-8df7-0b81f0be7efc tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:52.745536 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6c085069-c214-46c8-8df7-0b81f0be7efc tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:52.746422 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6c085069-c214-46c8-8df7-0b81f0be7efc tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:52.886600 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6c085069-c214-46c8-8df7-0b81f0be7efc tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:57:52.894637 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6c085069-c214-46c8-8df7-0b81f0be7efc tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/a91bf2ce-9a7f-461c-93d4-baaa04d10d53" status: 200 len: 1511 microversion: 2.1 time: 0.163401 Jul 23 21:57:52.895554 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2900/5510] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:57:52 2022] GET /compute/v2.1/servers/a91bf2ce-9a7f-461c-93d4-baaa04d10d53 => generated 1511 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:57:53.916072 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-69d0ba69-ec56-4b49-9907-f8a7ee08ce33 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:57:53.917075 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-69d0ba69-ec56-4b49-9907-f8a7ee08ce33 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: a91bf2ce-9a7f-461c-93d4-baaa04d10d53] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:57:53.921733 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:57:53.930297 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-69d0ba69-ec56-4b49-9907-f8a7ee08ce33 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:53.930757 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-69d0ba69-ec56-4b49-9907-f8a7ee08ce33 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:53.931544 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-69d0ba69-ec56-4b49-9907-f8a7ee08ce33 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:53.931995 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-69d0ba69-ec56-4b49-9907-f8a7ee08ce33 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:54.064140 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-69d0ba69-ec56-4b49-9907-f8a7ee08ce33 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:57:54.072029 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-69d0ba69-ec56-4b49-9907-f8a7ee08ce33 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/a91bf2ce-9a7f-461c-93d4-baaa04d10d53" status: 200 len: 1511 microversion: 2.1 time: 0.162578 Jul 23 21:57:54.072548 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2901/5511] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:57:53 2022] GET /compute/v2.1/servers/a91bf2ce-9a7f-461c-93d4-baaa04d10d53 => generated 1511 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:57:55.094763 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-dafc9d60-34fb-48a2-943e-236981516b6e tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:57:55.095776 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-dafc9d60-34fb-48a2-943e-236981516b6e tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: a91bf2ce-9a7f-461c-93d4-baaa04d10d53] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:57:55.105044 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dafc9d60-34fb-48a2-943e-236981516b6e tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:55.105523 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dafc9d60-34fb-48a2-943e-236981516b6e tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:55.106341 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dafc9d60-34fb-48a2-943e-236981516b6e tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:55.106784 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dafc9d60-34fb-48a2-943e-236981516b6e tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:55.237911 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-dafc9d60-34fb-48a2-943e-236981516b6e tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:57:55.245843 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-dafc9d60-34fb-48a2-943e-236981516b6e tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/a91bf2ce-9a7f-461c-93d4-baaa04d10d53" status: 200 len: 1511 microversion: 2.1 time: 0.158234 Jul 23 21:57:55.246460 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2902/5512] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:57:55 2022] GET /compute/v2.1/servers/a91bf2ce-9a7f-461c-93d4-baaa04d10d53 => generated 1511 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:57:56.266555 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5e495756-0a23-4013-90da-bf6b7baed619 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:57:56.267403 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5e495756-0a23-4013-90da-bf6b7baed619 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: a91bf2ce-9a7f-461c-93d4-baaa04d10d53] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:57:56.276725 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5e495756-0a23-4013-90da-bf6b7baed619 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:56.277198 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5e495756-0a23-4013-90da-bf6b7baed619 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:56.278059 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5e495756-0a23-4013-90da-bf6b7baed619 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:56.278513 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5e495756-0a23-4013-90da-bf6b7baed619 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:56.429375 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5e495756-0a23-4013-90da-bf6b7baed619 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:57:56.437551 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5e495756-0a23-4013-90da-bf6b7baed619 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/a91bf2ce-9a7f-461c-93d4-baaa04d10d53" status: 200 len: 1511 microversion: 2.1 time: 0.177520 Jul 23 21:57:56.438184 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2903/5513] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:57:56 2022] GET /compute/v2.1/servers/a91bf2ce-9a7f-461c-93d4-baaa04d10d53 => generated 1511 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:57:57.454316 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8c5f20e1-0c15-4823-a107-613a23ca4e9e tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:57:57.455023 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8c5f20e1-0c15-4823-a107-613a23ca4e9e tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: a91bf2ce-9a7f-461c-93d4-baaa04d10d53] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:57:57.462656 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8c5f20e1-0c15-4823-a107-613a23ca4e9e tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:57.463124 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8c5f20e1-0c15-4823-a107-613a23ca4e9e tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:57.463897 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8c5f20e1-0c15-4823-a107-613a23ca4e9e tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:57.464350 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8c5f20e1-0c15-4823-a107-613a23ca4e9e tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:57.607817 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8c5f20e1-0c15-4823-a107-613a23ca4e9e tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:57:57.616053 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8c5f20e1-0c15-4823-a107-613a23ca4e9e tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/a91bf2ce-9a7f-461c-93d4-baaa04d10d53" status: 200 len: 1511 microversion: 2.1 time: 0.165808 Jul 23 21:57:57.616633 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2904/5514] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:57:57 2022] GET /compute/v2.1/servers/a91bf2ce-9a7f-461c-93d4-baaa04d10d53 => generated 1511 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:57:58.634890 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-60aff362-dae8-4025-baac-6928cc23e065 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:57:58.635787 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-60aff362-dae8-4025-baac-6928cc23e065 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: a91bf2ce-9a7f-461c-93d4-baaa04d10d53] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:57:58.645296 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-60aff362-dae8-4025-baac-6928cc23e065 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:58.645911 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-60aff362-dae8-4025-baac-6928cc23e065 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:58.646974 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-60aff362-dae8-4025-baac-6928cc23e065 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:58.647670 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-60aff362-dae8-4025-baac-6928cc23e065 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:58.788300 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-60aff362-dae8-4025-baac-6928cc23e065 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:57:58.796375 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-60aff362-dae8-4025-baac-6928cc23e065 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/a91bf2ce-9a7f-461c-93d4-baaa04d10d53" status: 200 len: 1511 microversion: 2.1 time: 0.166917 Jul 23 21:57:58.796954 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2905/5515] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:57:58 2022] GET /compute/v2.1/servers/a91bf2ce-9a7f-461c-93d4-baaa04d10d53 => generated 1511 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:57:59.814522 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b4e6460a-d82f-470a-8249-9eaf0eac7f29 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:57:59.815245 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b4e6460a-d82f-470a-8249-9eaf0eac7f29 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: a91bf2ce-9a7f-461c-93d4-baaa04d10d53] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:57:59.822804 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b4e6460a-d82f-470a-8249-9eaf0eac7f29 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:59.823297 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b4e6460a-d82f-470a-8249-9eaf0eac7f29 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:59.824096 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b4e6460a-d82f-470a-8249-9eaf0eac7f29 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:57:59.824703 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b4e6460a-d82f-470a-8249-9eaf0eac7f29 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:57:59.963288 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b4e6460a-d82f-470a-8249-9eaf0eac7f29 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:57:59.971579 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b4e6460a-d82f-470a-8249-9eaf0eac7f29 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/a91bf2ce-9a7f-461c-93d4-baaa04d10d53" status: 200 len: 1511 microversion: 2.1 time: 0.161279 Jul 23 21:57:59.972347 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2906/5516] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:57:59 2022] GET /compute/v2.1/servers/a91bf2ce-9a7f-461c-93d4-baaa04d10d53 => generated 1511 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:58:00.991660 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-40e90b0a-6600-431a-996a-0dbde35f53b4 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:58:00.992509 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-40e90b0a-6600-431a-996a-0dbde35f53b4 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: a91bf2ce-9a7f-461c-93d4-baaa04d10d53] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:58:01.002641 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-40e90b0a-6600-431a-996a-0dbde35f53b4 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:01.003311 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-40e90b0a-6600-431a-996a-0dbde35f53b4 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:01.004472 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-40e90b0a-6600-431a-996a-0dbde35f53b4 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:01.005057 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-40e90b0a-6600-431a-996a-0dbde35f53b4 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:01.143689 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-40e90b0a-6600-431a-996a-0dbde35f53b4 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:58:01.156067 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-40e90b0a-6600-431a-996a-0dbde35f53b4 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/a91bf2ce-9a7f-461c-93d4-baaa04d10d53" status: 200 len: 1511 microversion: 2.1 time: 0.169616 Jul 23 21:58:01.156889 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2907/5517] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:58:00 2022] GET /compute/v2.1/servers/a91bf2ce-9a7f-461c-93d4-baaa04d10d53 => generated 1511 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:58:02.179867 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b892d244-ba5e-44ba-85f0-d07bf29dc125 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:58:02.180519 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b892d244-ba5e-44ba-85f0-d07bf29dc125 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: a91bf2ce-9a7f-461c-93d4-baaa04d10d53] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:58:02.187839 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b892d244-ba5e-44ba-85f0-d07bf29dc125 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:02.188310 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b892d244-ba5e-44ba-85f0-d07bf29dc125 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:02.189100 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b892d244-ba5e-44ba-85f0-d07bf29dc125 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:02.189550 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b892d244-ba5e-44ba-85f0-d07bf29dc125 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:02.337841 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b892d244-ba5e-44ba-85f0-d07bf29dc125 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:58:02.346096 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b892d244-ba5e-44ba-85f0-d07bf29dc125 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/a91bf2ce-9a7f-461c-93d4-baaa04d10d53" status: 200 len: 1511 microversion: 2.1 time: 0.172572 Jul 23 21:58:02.346710 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2908/5518] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:58:02 2022] GET /compute/v2.1/servers/a91bf2ce-9a7f-461c-93d4-baaa04d10d53 => generated 1511 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:58:03.367338 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-7fcf84b5-3584-47e2-b2aa-da57316c190c tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:58:03.368415 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-7fcf84b5-3584-47e2-b2aa-da57316c190c tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: a91bf2ce-9a7f-461c-93d4-baaa04d10d53] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:58:03.380369 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7fcf84b5-3584-47e2-b2aa-da57316c190c tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:03.381132 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7fcf84b5-3584-47e2-b2aa-da57316c190c tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:03.382439 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7fcf84b5-3584-47e2-b2aa-da57316c190c tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:03.382887 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7fcf84b5-3584-47e2-b2aa-da57316c190c tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:03.521572 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-7fcf84b5-3584-47e2-b2aa-da57316c190c tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:58:03.531741 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-7fcf84b5-3584-47e2-b2aa-da57316c190c tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/a91bf2ce-9a7f-461c-93d4-baaa04d10d53" status: 200 len: 1511 microversion: 2.1 time: 0.171188 Jul 23 21:58:03.532328 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2909/5519] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:58:03 2022] GET /compute/v2.1/servers/a91bf2ce-9a7f-461c-93d4-baaa04d10d53 => generated 1511 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:58:04.553059 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4f88baef-1cd4-4d1d-a7e2-3f9f477abe73 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:58:04.554233 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-4f88baef-1cd4-4d1d-a7e2-3f9f477abe73 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: a91bf2ce-9a7f-461c-93d4-baaa04d10d53] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:58:04.562367 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4f88baef-1cd4-4d1d-a7e2-3f9f477abe73 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:04.562878 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4f88baef-1cd4-4d1d-a7e2-3f9f477abe73 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:04.563741 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4f88baef-1cd4-4d1d-a7e2-3f9f477abe73 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:04.564236 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4f88baef-1cd4-4d1d-a7e2-3f9f477abe73 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:04.719723 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-4f88baef-1cd4-4d1d-a7e2-3f9f477abe73 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:58:04.727894 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4f88baef-1cd4-4d1d-a7e2-3f9f477abe73 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/a91bf2ce-9a7f-461c-93d4-baaa04d10d53" status: 200 len: 1511 microversion: 2.1 time: 0.181774 Jul 23 21:58:04.728484 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2910/5520] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:58:04 2022] GET /compute/v2.1/servers/a91bf2ce-9a7f-461c-93d4-baaa04d10d53 => generated 1511 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:58:05.749718 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d03cbd36-7779-4a03-82d5-1ddf4de9cc3d tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:58:05.750778 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d03cbd36-7779-4a03-82d5-1ddf4de9cc3d tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: a91bf2ce-9a7f-461c-93d4-baaa04d10d53] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:58:05.760190 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d03cbd36-7779-4a03-82d5-1ddf4de9cc3d tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:05.760650 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d03cbd36-7779-4a03-82d5-1ddf4de9cc3d tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:05.761438 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d03cbd36-7779-4a03-82d5-1ddf4de9cc3d tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:05.761904 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d03cbd36-7779-4a03-82d5-1ddf4de9cc3d tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:05.894651 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d03cbd36-7779-4a03-82d5-1ddf4de9cc3d tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:58:05.897908 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:58:05.904605 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d03cbd36-7779-4a03-82d5-1ddf4de9cc3d tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/a91bf2ce-9a7f-461c-93d4-baaa04d10d53" status: 200 len: 1511 microversion: 2.1 time: 0.161942 Jul 23 21:58:05.905210 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2911/5521] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:58:05 2022] GET /compute/v2.1/servers/a91bf2ce-9a7f-461c-93d4-baaa04d10d53 => generated 1511 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:58:06.926529 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-47aa5ce9-2ba8-41ca-b787-0f8165f097fd tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:58:06.927571 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-47aa5ce9-2ba8-41ca-b787-0f8165f097fd tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: a91bf2ce-9a7f-461c-93d4-baaa04d10d53] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:58:06.937023 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-47aa5ce9-2ba8-41ca-b787-0f8165f097fd tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:06.937511 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-47aa5ce9-2ba8-41ca-b787-0f8165f097fd tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:06.938314 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-47aa5ce9-2ba8-41ca-b787-0f8165f097fd tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:06.938753 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-47aa5ce9-2ba8-41ca-b787-0f8165f097fd tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:07.082007 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-47aa5ce9-2ba8-41ca-b787-0f8165f097fd tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:58:07.094112 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-47aa5ce9-2ba8-41ca-b787-0f8165f097fd tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/a91bf2ce-9a7f-461c-93d4-baaa04d10d53" status: 200 len: 1511 microversion: 2.1 time: 0.174361 Jul 23 21:58:07.095206 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2912/5522] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:58:06 2022] GET /compute/v2.1/servers/a91bf2ce-9a7f-461c-93d4-baaa04d10d53 => generated 1511 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:58:08.116479 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-91f18222-d56a-4fd9-b8fd-fcdf921b053d tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:58:08.117141 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-91f18222-d56a-4fd9-b8fd-fcdf921b053d tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: a91bf2ce-9a7f-461c-93d4-baaa04d10d53] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:58:08.124669 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-91f18222-d56a-4fd9-b8fd-fcdf921b053d tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:08.125132 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-91f18222-d56a-4fd9-b8fd-fcdf921b053d tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:08.125896 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-91f18222-d56a-4fd9-b8fd-fcdf921b053d tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:08.126476 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-91f18222-d56a-4fd9-b8fd-fcdf921b053d tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:08.265423 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-91f18222-d56a-4fd9-b8fd-fcdf921b053d tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:58:08.273814 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-91f18222-d56a-4fd9-b8fd-fcdf921b053d tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/a91bf2ce-9a7f-461c-93d4-baaa04d10d53" status: 200 len: 1511 microversion: 2.1 time: 0.164388 Jul 23 21:58:08.274430 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2913/5523] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:58:08 2022] GET /compute/v2.1/servers/a91bf2ce-9a7f-461c-93d4-baaa04d10d53 => generated 1511 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:58:09.295406 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-312b1d3d-6f1e-4309-a6ba-35504d38aa60 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:58:09.296464 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-312b1d3d-6f1e-4309-a6ba-35504d38aa60 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: a91bf2ce-9a7f-461c-93d4-baaa04d10d53] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:58:09.308165 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-312b1d3d-6f1e-4309-a6ba-35504d38aa60 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:09.308927 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-312b1d3d-6f1e-4309-a6ba-35504d38aa60 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:09.310266 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-312b1d3d-6f1e-4309-a6ba-35504d38aa60 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:09.310992 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-312b1d3d-6f1e-4309-a6ba-35504d38aa60 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:09.451502 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-312b1d3d-6f1e-4309-a6ba-35504d38aa60 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:58:09.461667 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-312b1d3d-6f1e-4309-a6ba-35504d38aa60 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/a91bf2ce-9a7f-461c-93d4-baaa04d10d53" status: 200 len: 1511 microversion: 2.1 time: 0.172721 Jul 23 21:58:09.462328 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2914/5524] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:58:09 2022] GET /compute/v2.1/servers/a91bf2ce-9a7f-461c-93d4-baaa04d10d53 => generated 1511 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:58:10.483771 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-79548541-5364-46d5-947a-452067c18400 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:58:10.484880 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-79548541-5364-46d5-947a-452067c18400 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: a91bf2ce-9a7f-461c-93d4-baaa04d10d53] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:58:10.494929 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-79548541-5364-46d5-947a-452067c18400 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:10.495392 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-79548541-5364-46d5-947a-452067c18400 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:10.496182 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-79548541-5364-46d5-947a-452067c18400 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:10.496667 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-79548541-5364-46d5-947a-452067c18400 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:10.637989 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-79548541-5364-46d5-947a-452067c18400 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:58:10.646483 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-79548541-5364-46d5-947a-452067c18400 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/a91bf2ce-9a7f-461c-93d4-baaa04d10d53" status: 200 len: 1511 microversion: 2.1 time: 0.169392 Jul 23 21:58:10.647103 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2915/5525] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:58:10 2022] GET /compute/v2.1/servers/a91bf2ce-9a7f-461c-93d4-baaa04d10d53 => generated 1511 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:58:11.667288 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d78ad2be-d696-4353-954c-68daa5815744 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:58:11.668121 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d78ad2be-d696-4353-954c-68daa5815744 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: a91bf2ce-9a7f-461c-93d4-baaa04d10d53] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:58:11.677623 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d78ad2be-d696-4353-954c-68daa5815744 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:11.678248 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d78ad2be-d696-4353-954c-68daa5815744 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:11.679232 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d78ad2be-d696-4353-954c-68daa5815744 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:11.679794 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d78ad2be-d696-4353-954c-68daa5815744 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:11.823400 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d78ad2be-d696-4353-954c-68daa5815744 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:58:11.831379 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d78ad2be-d696-4353-954c-68daa5815744 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/a91bf2ce-9a7f-461c-93d4-baaa04d10d53" status: 200 len: 1511 microversion: 2.1 time: 0.169811 Jul 23 21:58:11.832087 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2916/5526] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:58:11 2022] GET /compute/v2.1/servers/a91bf2ce-9a7f-461c-93d4-baaa04d10d53 => generated 1511 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:58:12.851703 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3583bdf4-7147-4114-be54-7247a5055ebb tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:58:12.852331 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-3583bdf4-7147-4114-be54-7247a5055ebb tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: a91bf2ce-9a7f-461c-93d4-baaa04d10d53] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:58:12.862610 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3583bdf4-7147-4114-be54-7247a5055ebb tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:12.863196 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3583bdf4-7147-4114-be54-7247a5055ebb tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:12.864287 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3583bdf4-7147-4114-be54-7247a5055ebb tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:12.864863 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3583bdf4-7147-4114-be54-7247a5055ebb tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:13.002417 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-3583bdf4-7147-4114-be54-7247a5055ebb tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:58:13.010835 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-3583bdf4-7147-4114-be54-7247a5055ebb tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/a91bf2ce-9a7f-461c-93d4-baaa04d10d53" status: 200 len: 1511 microversion: 2.1 time: 0.165308 Jul 23 21:58:13.011426 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2917/5527] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:58:12 2022] GET /compute/v2.1/servers/a91bf2ce-9a7f-461c-93d4-baaa04d10d53 => generated 1511 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:58:14.033944 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-725529d7-1480-43f6-a7df-010071a32710 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:58:14.035039 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-725529d7-1480-43f6-a7df-010071a32710 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: a91bf2ce-9a7f-461c-93d4-baaa04d10d53] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:58:14.044067 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-725529d7-1480-43f6-a7df-010071a32710 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:14.044524 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-725529d7-1480-43f6-a7df-010071a32710 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:14.045294 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-725529d7-1480-43f6-a7df-010071a32710 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:14.045736 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-725529d7-1480-43f6-a7df-010071a32710 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:14.180798 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-725529d7-1480-43f6-a7df-010071a32710 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:58:14.191188 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-725529d7-1480-43f6-a7df-010071a32710 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/a91bf2ce-9a7f-461c-93d4-baaa04d10d53" status: 200 len: 1511 microversion: 2.1 time: 0.163574 Jul 23 21:58:14.192215 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2918/5528] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:58:14 2022] GET /compute/v2.1/servers/a91bf2ce-9a7f-461c-93d4-baaa04d10d53 => generated 1511 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:58:15.216312 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8c78e512-b71f-4fc9-81eb-29b7c45fdbd2 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:58:15.216969 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8c78e512-b71f-4fc9-81eb-29b7c45fdbd2 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: a91bf2ce-9a7f-461c-93d4-baaa04d10d53] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:58:15.225307 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8c78e512-b71f-4fc9-81eb-29b7c45fdbd2 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:15.225772 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8c78e512-b71f-4fc9-81eb-29b7c45fdbd2 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:15.226663 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8c78e512-b71f-4fc9-81eb-29b7c45fdbd2 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:15.227116 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8c78e512-b71f-4fc9-81eb-29b7c45fdbd2 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:15.373395 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8c78e512-b71f-4fc9-81eb-29b7c45fdbd2 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:58:15.383490 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8c78e512-b71f-4fc9-81eb-29b7c45fdbd2 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/a91bf2ce-9a7f-461c-93d4-baaa04d10d53" status: 200 len: 1511 microversion: 2.1 time: 0.171767 Jul 23 21:58:15.384089 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2919/5529] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:58:15 2022] GET /compute/v2.1/servers/a91bf2ce-9a7f-461c-93d4-baaa04d10d53 => generated 1511 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:58:16.405140 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-bd976993-015c-48b0-bc92-979868be196d tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:58:16.406256 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-bd976993-015c-48b0-bc92-979868be196d tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: a91bf2ce-9a7f-461c-93d4-baaa04d10d53] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:58:16.418080 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bd976993-015c-48b0-bc92-979868be196d tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:16.418838 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bd976993-015c-48b0-bc92-979868be196d tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:16.420118 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bd976993-015c-48b0-bc92-979868be196d tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:16.420850 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bd976993-015c-48b0-bc92-979868be196d tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:16.553507 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-bd976993-015c-48b0-bc92-979868be196d tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:58:16.561607 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-bd976993-015c-48b0-bc92-979868be196d tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/a91bf2ce-9a7f-461c-93d4-baaa04d10d53" status: 200 len: 1488 microversion: 2.1 time: 0.163172 Jul 23 21:58:16.562233 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2920/5530] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:58:16 2022] GET /compute/v2.1/servers/a91bf2ce-9a7f-461c-93d4-baaa04d10d53 => generated 1488 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:58:16.577754 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b578aab2-d037-4ecd-b549-61251f925b90 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:58:16.578760 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b578aab2-d037-4ecd-b549-61251f925b90 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:58:16.584933 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b578aab2-d037-4ecd-b549-61251f925b90 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:16.585368 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b578aab2-d037-4ecd-b549-61251f925b90 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:16.586309 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b578aab2-d037-4ecd-b549-61251f925b90 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:16.586746 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b578aab2-d037-4ecd-b549-61251f925b90 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:16.635909 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b578aab2-d037-4ecd-b549-61251f925b90 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "POST /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841/action" status: 200 len: 162 microversion: 2.1 time: 0.061542 Jul 23 21:58:16.636527 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2921/5531] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:58:16 2022] POST /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841/action => generated 162 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:58:16.645725 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-10366f22-5f93-4e8a-afac-0df86a40a97b tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:58:16.646448 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-10366f22-5f93-4e8a-afac-0df86a40a97b tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:58:16.653608 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-10366f22-5f93-4e8a-afac-0df86a40a97b tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:16.654087 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-10366f22-5f93-4e8a-afac-0df86a40a97b tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:16.654852 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-10366f22-5f93-4e8a-afac-0df86a40a97b tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:16.655359 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-10366f22-5f93-4e8a-afac-0df86a40a97b tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:16.793379 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-10366f22-5f93-4e8a-afac-0df86a40a97b tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:58:16.805090 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-10366f22-5f93-4e8a-afac-0df86a40a97b tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1670 microversion: 2.1 time: 0.162361 Jul 23 21:58:16.805885 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2922/5532] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:58:16 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1670 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:58:16.828660 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-044ed736-8ce6-40b3-888b-be99ec683582 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:58:16.829275 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-044ed736-8ce6-40b3-888b-be99ec683582 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:58:16.835472 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-044ed736-8ce6-40b3-888b-be99ec683582 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:16.835919 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-044ed736-8ce6-40b3-888b-be99ec683582 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:16.836734 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-044ed736-8ce6-40b3-888b-be99ec683582 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:16.837266 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-044ed736-8ce6-40b3-888b-be99ec683582 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:16.975306 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-044ed736-8ce6-40b3-888b-be99ec683582 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:58:16.983307 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-044ed736-8ce6-40b3-888b-be99ec683582 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1670 microversion: 2.1 time: 0.158532 Jul 23 21:58:16.983894 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2923/5533] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:58:16 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1670 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:58:16.999204 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c1e557dc-8665-4c95-a957-91e14a9adfaa tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:58:16.999815 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c1e557dc-8665-4c95-a957-91e14a9adfaa tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:58:17.005890 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c1e557dc-8665-4c95-a957-91e14a9adfaa tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:17.006369 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c1e557dc-8665-4c95-a957-91e14a9adfaa tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:17.007156 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c1e557dc-8665-4c95-a957-91e14a9adfaa tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:17.007685 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c1e557dc-8665-4c95-a957-91e14a9adfaa tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:17.144936 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c1e557dc-8665-4c95-a957-91e14a9adfaa tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:58:17.154287 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c1e557dc-8665-4c95-a957-91e14a9adfaa tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1670 microversion: 2.1 time: 0.158667 Jul 23 21:58:17.154872 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2924/5534] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:58:16 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1670 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:58:17.169960 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c5db332a-ba2f-4a91-94c5-1a901dd3053d tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:58:17.170565 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c5db332a-ba2f-4a91-94c5-1a901dd3053d tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:58:17.177041 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c5db332a-ba2f-4a91-94c5-1a901dd3053d tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:17.177431 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c5db332a-ba2f-4a91-94c5-1a901dd3053d tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:17.178241 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c5db332a-ba2f-4a91-94c5-1a901dd3053d tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:17.178684 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c5db332a-ba2f-4a91-94c5-1a901dd3053d tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:17.317912 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c5db332a-ba2f-4a91-94c5-1a901dd3053d tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:58:17.325831 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c5db332a-ba2f-4a91-94c5-1a901dd3053d tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1670 microversion: 2.1 time: 0.159418 Jul 23 21:58:17.326435 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2925/5535] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:58:17 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1670 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:58:17.385830 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e76b7cd2-a922-4088-8849-652f831527ab tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-451640754", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "networks": [{"uuid": "6770b9e7-826f-46ba-879d-e25a87aab2e5"}]}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:58:17.437891 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-e76b7cd2-a922-4088-8849-652f831527ab tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] validate_networks() for [('6770b9e7-826f-46ba-879d-e25a87aab2e5', None, None, None, None, None)] {{(pid=131320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 21:58:17.826059 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-e76b7cd2-a922-4088-8849-652f831527ab tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 21:58:17.826486 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-e76b7cd2-a922-4088-8849-652f831527ab tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 21:58:17.826965 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-e76b7cd2-a922-4088-8849-652f831527ab tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 21:58:17.827379 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-e76b7cd2-a922-4088-8849-652f831527ab tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 21:58:17.827795 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-e76b7cd2-a922-4088-8849-652f831527ab tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 21:58:17.837433 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e76b7cd2-a922-4088-8849-652f831527ab tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:17.837911 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e76b7cd2-a922-4088-8849-652f831527ab tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:17.839029 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e76b7cd2-a922-4088-8849-652f831527ab tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:17.839471 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e76b7cd2-a922-4088-8849-652f831527ab tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:17.861893 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-e76b7cd2-a922-4088-8849-652f831527ab tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Getting quotas for project 7f624e0dec4a4f64b1d3580e60867c41. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 21:58:17.867430 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-e76b7cd2-a922-4088-8849-652f831527ab tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Getting quotas for user b5408fb2f4044c6d88527222b190230d and project 7f624e0dec4a4f64b1d3580e60867c41. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 21:58:17.880663 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e76b7cd2-a922-4088-8849-652f831527ab tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Going to run 1 instances... {{(pid=131320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 21:58:17.883032 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e76b7cd2-a922-4088-8849-652f831527ab tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 0eab1f9e-5c32-4bce-8043-2570445e9762] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 21:58:17.947129 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e76b7cd2-a922-4088-8849-652f831527ab tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.565207 Jul 23 21:58:17.947789 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2926/5536] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 21:58:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 567 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 23 21:58:17.957816 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4f9a1f8e-87b8-44eb-b5a8-b6dc30c1d76b tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:58:17.958449 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-4f9a1f8e-87b8-44eb-b5a8-b6dc30c1d76b tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 0eab1f9e-5c32-4bce-8043-2570445e9762] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:58:18.012341 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-4f9a1f8e-87b8-44eb-b5a8-b6dc30c1d76b tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:58:18.019238 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4f9a1f8e-87b8-44eb-b5a8-b6dc30c1d76b tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/0eab1f9e-5c32-4bce-8043-2570445e9762" status: 200 len: 1214 microversion: 2.1 time: 0.065191 Jul 23 21:58:18.019826 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2927/5537] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:58:17 2022] GET /compute/v2.1/servers/0eab1f9e-5c32-4bce-8043-2570445e9762 => generated 1214 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:58:19.036641 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ff2a5a6a-f129-495f-8075-65cf931334ac tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:58:19.037345 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ff2a5a6a-f129-495f-8075-65cf931334ac tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 0eab1f9e-5c32-4bce-8043-2570445e9762] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:58:19.090473 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ff2a5a6a-f129-495f-8075-65cf931334ac tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:58:19.098135 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ff2a5a6a-f129-495f-8075-65cf931334ac tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/0eab1f9e-5c32-4bce-8043-2570445e9762" status: 200 len: 1214 microversion: 2.1 time: 0.065542 Jul 23 21:58:19.098728 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2928/5538] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:58:19 2022] GET /compute/v2.1/servers/0eab1f9e-5c32-4bce-8043-2570445e9762 => generated 1214 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:58:20.115678 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-411968e9-0315-4a90-b1ed-7d4791747540 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:58:20.116397 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-411968e9-0315-4a90-b1ed-7d4791747540 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 0eab1f9e-5c32-4bce-8043-2570445e9762] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:58:20.170191 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-411968e9-0315-4a90-b1ed-7d4791747540 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:58:20.177825 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-411968e9-0315-4a90-b1ed-7d4791747540 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/0eab1f9e-5c32-4bce-8043-2570445e9762" status: 200 len: 1214 microversion: 2.1 time: 0.066270 Jul 23 21:58:20.178618 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2929/5539] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:58:20 2022] GET /compute/v2.1/servers/0eab1f9e-5c32-4bce-8043-2570445e9762 => generated 1214 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:58:21.199267 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-cea406e3-9a7a-4274-8d28-374a83eba378 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:58:21.200303 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-cea406e3-9a7a-4274-8d28-374a83eba378 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 0eab1f9e-5c32-4bce-8043-2570445e9762] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:58:21.262393 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-cea406e3-9a7a-4274-8d28-374a83eba378 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:58:21.269678 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-cea406e3-9a7a-4274-8d28-374a83eba378 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/0eab1f9e-5c32-4bce-8043-2570445e9762" status: 200 len: 1214 microversion: 2.1 time: 0.077213 Jul 23 21:58:21.270314 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2930/5540] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:58:21 2022] GET /compute/v2.1/servers/0eab1f9e-5c32-4bce-8043-2570445e9762 => generated 1214 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:58:22.290996 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2c127e13-eccd-47b3-b1e3-3826d2def0ad tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:58:22.291855 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-2c127e13-eccd-47b3-b1e3-3826d2def0ad tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 0eab1f9e-5c32-4bce-8043-2570445e9762] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:58:22.301702 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2c127e13-eccd-47b3-b1e3-3826d2def0ad tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:22.302301 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2c127e13-eccd-47b3-b1e3-3826d2def0ad tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:22.303256 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2c127e13-eccd-47b3-b1e3-3826d2def0ad tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:22.303803 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2c127e13-eccd-47b3-b1e3-3826d2def0ad tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:22.369507 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-2c127e13-eccd-47b3-b1e3-3826d2def0ad tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:58:22.377587 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2c127e13-eccd-47b3-b1e3-3826d2def0ad tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/0eab1f9e-5c32-4bce-8043-2570445e9762" status: 200 len: 1218 microversion: 2.1 time: 0.093230 Jul 23 21:58:22.378208 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2931/5541] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:58:22 2022] GET /compute/v2.1/servers/0eab1f9e-5c32-4bce-8043-2570445e9762 => generated 1218 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:58:23.393910 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9075d7f4-f32a-44ef-a8ca-caf517a5203e tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:58:23.394565 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-9075d7f4-f32a-44ef-a8ca-caf517a5203e tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 0eab1f9e-5c32-4bce-8043-2570445e9762] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:58:23.402292 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9075d7f4-f32a-44ef-a8ca-caf517a5203e tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:23.402753 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9075d7f4-f32a-44ef-a8ca-caf517a5203e tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:23.403543 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9075d7f4-f32a-44ef-a8ca-caf517a5203e tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:23.403988 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9075d7f4-f32a-44ef-a8ca-caf517a5203e tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:23.484650 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-9075d7f4-f32a-44ef-a8ca-caf517a5203e tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:58:23.495515 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9075d7f4-f32a-44ef-a8ca-caf517a5203e tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/0eab1f9e-5c32-4bce-8043-2570445e9762" status: 200 len: 1272 microversion: 2.1 time: 0.105291 Jul 23 21:58:23.495900 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2932/5542] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:58:23 2022] GET /compute/v2.1/servers/0eab1f9e-5c32-4bce-8043-2570445e9762 => generated 1272 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:58:24.325056 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-adb41491-2f21-4882-99d8-01fadb098a49 req-a5b4708d-88eb-44c7-b124-5776e4e981e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0eab1f9e-5c32-4bce-8043-2570445e9762", "tag": "75325559-53a9-4b31-bfca-61c51848723d"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:58:24.332779 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:58:24.335021 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-adb41491-2f21-4882-99d8-01fadb098a49 req-a5b4708d-88eb-44c7-b124-5776e4e981e4 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:24.335618 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-adb41491-2f21-4882-99d8-01fadb098a49 req-a5b4708d-88eb-44c7-b124-5776e4e981e4 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:24.373619 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-adb41491-2f21-4882-99d8-01fadb098a49 req-a5b4708d-88eb-44c7-b124-5776e4e981e4 service nova] Creating event network-changed:75325559-53a9-4b31-bfca-61c51848723d for instance 0eab1f9e-5c32-4bce-8043-2570445e9762 on nch2-master-1 Jul 23 21:58:24.379140 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-adb41491-2f21-4882-99d8-01fadb098a49 req-a5b4708d-88eb-44c7-b124-5776e4e981e4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057890 Jul 23 21:58:24.380078 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2933/5543] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:58:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 21:58:24.515067 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3e27a88d-4ef6-4af2-811e-a1190191854e tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:58:24.515906 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-3e27a88d-4ef6-4af2-811e-a1190191854e tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 0eab1f9e-5c32-4bce-8043-2570445e9762] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:58:24.522630 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3e27a88d-4ef6-4af2-811e-a1190191854e tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:24.523163 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3e27a88d-4ef6-4af2-811e-a1190191854e tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:24.524013 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3e27a88d-4ef6-4af2-811e-a1190191854e tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:24.524570 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3e27a88d-4ef6-4af2-811e-a1190191854e tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:24.527503 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=100 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:58:24.763332 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-3e27a88d-4ef6-4af2-811e-a1190191854e tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:58:24.771407 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-3e27a88d-4ef6-4af2-811e-a1190191854e tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/0eab1f9e-5c32-4bce-8043-2570445e9762" status: 200 len: 1314 microversion: 2.1 time: 0.262415 Jul 23 21:58:24.772226 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2934/5544] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:58:24 2022] GET /compute/v2.1/servers/0eab1f9e-5c32-4bce-8043-2570445e9762 => generated 1314 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:58:25.789095 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-cc00f13d-37f6-4ba7-ae75-933c4a000852 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:58:25.789850 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-cc00f13d-37f6-4ba7-ae75-933c4a000852 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 0eab1f9e-5c32-4bce-8043-2570445e9762] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:58:25.797903 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cc00f13d-37f6-4ba7-ae75-933c4a000852 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:25.798433 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cc00f13d-37f6-4ba7-ae75-933c4a000852 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:25.799314 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cc00f13d-37f6-4ba7-ae75-933c4a000852 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:25.799845 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cc00f13d-37f6-4ba7-ae75-933c4a000852 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:25.932237 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-cc00f13d-37f6-4ba7-ae75-933c4a000852 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:58:25.940327 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-cc00f13d-37f6-4ba7-ae75-933c4a000852 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/0eab1f9e-5c32-4bce-8043-2570445e9762" status: 200 len: 1314 microversion: 2.1 time: 0.155252 Jul 23 21:58:25.940924 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2935/5545] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:58:25 2022] GET /compute/v2.1/servers/0eab1f9e-5c32-4bce-8043-2570445e9762 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:58:26.958662 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1899ccb5-591a-440c-b40f-e72aa017069c tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:58:26.959452 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1899ccb5-591a-440c-b40f-e72aa017069c tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 0eab1f9e-5c32-4bce-8043-2570445e9762] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:58:26.966861 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1899ccb5-591a-440c-b40f-e72aa017069c tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:26.967322 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1899ccb5-591a-440c-b40f-e72aa017069c tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:26.968095 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1899ccb5-591a-440c-b40f-e72aa017069c tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:26.968533 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1899ccb5-591a-440c-b40f-e72aa017069c tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:27.105367 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-1899ccb5-591a-440c-b40f-e72aa017069c tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:58:27.116774 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1899ccb5-591a-440c-b40f-e72aa017069c tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/0eab1f9e-5c32-4bce-8043-2570445e9762" status: 200 len: 1314 microversion: 2.1 time: 0.161839 Jul 23 21:58:27.117566 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2936/5546] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:58:26 2022] GET /compute/v2.1/servers/0eab1f9e-5c32-4bce-8043-2570445e9762 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:58:28.136155 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-badfa3b3-5836-483d-a493-4698256cada4 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:58:28.136868 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-badfa3b3-5836-483d-a493-4698256cada4 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 0eab1f9e-5c32-4bce-8043-2570445e9762] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:58:28.138963 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:58:28.145702 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-badfa3b3-5836-483d-a493-4698256cada4 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:28.146203 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-badfa3b3-5836-483d-a493-4698256cada4 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:28.146996 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-badfa3b3-5836-483d-a493-4698256cada4 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:28.147458 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-badfa3b3-5836-483d-a493-4698256cada4 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:28.278635 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-badfa3b3-5836-483d-a493-4698256cada4 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:58:28.286431 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-badfa3b3-5836-483d-a493-4698256cada4 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/0eab1f9e-5c32-4bce-8043-2570445e9762" status: 200 len: 1314 microversion: 2.1 time: 0.155660 Jul 23 21:58:28.287016 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2937/5547] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:58:28 2022] GET /compute/v2.1/servers/0eab1f9e-5c32-4bce-8043-2570445e9762 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:58:29.308259 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2cb6a946-5207-4f25-9f91-5afb5b7f277e tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:58:29.309344 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-2cb6a946-5207-4f25-9f91-5afb5b7f277e tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 0eab1f9e-5c32-4bce-8043-2570445e9762] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:58:29.321154 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2cb6a946-5207-4f25-9f91-5afb5b7f277e tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:29.321966 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2cb6a946-5207-4f25-9f91-5afb5b7f277e tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:29.323280 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2cb6a946-5207-4f25-9f91-5afb5b7f277e tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:29.324064 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2cb6a946-5207-4f25-9f91-5afb5b7f277e tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:29.465641 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-2cb6a946-5207-4f25-9f91-5afb5b7f277e tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:58:29.473769 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2cb6a946-5207-4f25-9f91-5afb5b7f277e tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/0eab1f9e-5c32-4bce-8043-2570445e9762" status: 200 len: 1314 microversion: 2.1 time: 0.172350 Jul 23 21:58:29.474394 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2938/5548] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:58:29 2022] GET /compute/v2.1/servers/0eab1f9e-5c32-4bce-8043-2570445e9762 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:58:29.902506 ncdv-master-1 devstack@n-api.service[131320]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 23 21:58:29.903276 ncdv-master-1 devstack@n-api.service[131320]: Sat Jul 23 21:58:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 23 21:58:29.928113 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-2683da07-97bd-4f13-b37a-3310e52f9adf req-b2704996-6905-4aaa-9dec-2b40fdff0288 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0eab1f9e-5c32-4bce-8043-2570445e9762", "name": "network-vif-plugged", "status": "completed", "tag": "75325559-53a9-4b31-bfca-61c51848723d"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:58:29.936675 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-2683da07-97bd-4f13-b37a-3310e52f9adf req-b2704996-6905-4aaa-9dec-2b40fdff0288 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:29.937145 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-2683da07-97bd-4f13-b37a-3310e52f9adf req-b2704996-6905-4aaa-9dec-2b40fdff0288 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:29.949337 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-2683da07-97bd-4f13-b37a-3310e52f9adf req-b2704996-6905-4aaa-9dec-2b40fdff0288 service nova] Creating event network-vif-plugged:75325559-53a9-4b31-bfca-61c51848723d for instance 0eab1f9e-5c32-4bce-8043-2570445e9762 on nch2-master-1 Jul 23 21:58:29.954061 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-2683da07-97bd-4f13-b37a-3310e52f9adf req-b2704996-6905-4aaa-9dec-2b40fdff0288 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029672 Jul 23 21:58:29.954652 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2939/5549] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 21:58:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 21:58:30.492826 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f9708858-419b-4a37-aad0-6171b2d85f96 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:58:30.493649 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f9708858-419b-4a37-aad0-6171b2d85f96 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 0eab1f9e-5c32-4bce-8043-2570445e9762] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:58:30.503881 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f9708858-419b-4a37-aad0-6171b2d85f96 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:30.504333 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f9708858-419b-4a37-aad0-6171b2d85f96 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:30.505109 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f9708858-419b-4a37-aad0-6171b2d85f96 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:30.505573 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f9708858-419b-4a37-aad0-6171b2d85f96 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:30.643191 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f9708858-419b-4a37-aad0-6171b2d85f96 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:58:30.651132 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f9708858-419b-4a37-aad0-6171b2d85f96 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/0eab1f9e-5c32-4bce-8043-2570445e9762" status: 200 len: 1314 microversion: 2.1 time: 0.163616 Jul 23 21:58:30.651716 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2940/5550] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:58:30 2022] GET /compute/v2.1/servers/0eab1f9e-5c32-4bce-8043-2570445e9762 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:58:31.672307 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-7bac7873-ce39-48a0-a96f-b9e0f733af6c tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:58:31.673107 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-7bac7873-ce39-48a0-a96f-b9e0f733af6c tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 0eab1f9e-5c32-4bce-8043-2570445e9762] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:58:31.675408 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=14 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:58:31.683453 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7bac7873-ce39-48a0-a96f-b9e0f733af6c tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:31.684038 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7bac7873-ce39-48a0-a96f-b9e0f733af6c tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:31.684958 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7bac7873-ce39-48a0-a96f-b9e0f733af6c tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:31.685549 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7bac7873-ce39-48a0-a96f-b9e0f733af6c tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:31.824626 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-7bac7873-ce39-48a0-a96f-b9e0f733af6c tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:58:31.832957 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-7bac7873-ce39-48a0-a96f-b9e0f733af6c tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/0eab1f9e-5c32-4bce-8043-2570445e9762" status: 200 len: 1501 microversion: 2.1 time: 0.167101 Jul 23 21:58:31.833568 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2941/5551] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:58:31 2022] GET /compute/v2.1/servers/0eab1f9e-5c32-4bce-8043-2570445e9762 => generated 1501 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:58:31.850058 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0f909caf-6e86-4965-8216-5d83f75239ce tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:58:31.851003 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-0f909caf-6e86-4965-8216-5d83f75239ce tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 0eab1f9e-5c32-4bce-8043-2570445e9762] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:58:31.857116 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0f909caf-6e86-4965-8216-5d83f75239ce tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:31.857570 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0f909caf-6e86-4965-8216-5d83f75239ce tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:31.858472 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0f909caf-6e86-4965-8216-5d83f75239ce tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:31.858915 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0f909caf-6e86-4965-8216-5d83f75239ce tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:31.894816 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-0f909caf-6e86-4965-8216-5d83f75239ce tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "POST /compute/v2.1/servers/0eab1f9e-5c32-4bce-8043-2570445e9762/action" status: 200 len: 14 microversion: 2.1 time: 0.048342 Jul 23 21:58:31.895423 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2942/5552] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:58:31 2022] POST /compute/v2.1/servers/0eab1f9e-5c32-4bce-8043-2570445e9762/action => generated 14 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 23 21:58:32.909834 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-114711ed-2ac5-404d-8d29-119c9388a5b5 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:58:32.911292 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-114711ed-2ac5-404d-8d29-119c9388a5b5 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 0eab1f9e-5c32-4bce-8043-2570445e9762] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:58:32.921409 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-114711ed-2ac5-404d-8d29-119c9388a5b5 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:32.922090 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-114711ed-2ac5-404d-8d29-119c9388a5b5 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:32.923179 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-114711ed-2ac5-404d-8d29-119c9388a5b5 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:32.923801 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-114711ed-2ac5-404d-8d29-119c9388a5b5 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:32.964929 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-114711ed-2ac5-404d-8d29-119c9388a5b5 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "POST /compute/v2.1/servers/0eab1f9e-5c32-4bce-8043-2570445e9762/action" status: 200 len: 14 microversion: 2.1 time: 0.061073 Jul 23 21:58:32.968512 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2943/5553] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:58:32 2022] POST /compute/v2.1/servers/0eab1f9e-5c32-4bce-8043-2570445e9762/action => generated 14 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 23 21:58:33.977430 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-453da0e6-1bcd-4ecc-ae26-3727d49953e7 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:58:33.978626 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-453da0e6-1bcd-4ecc-ae26-3727d49953e7 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 0eab1f9e-5c32-4bce-8043-2570445e9762] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:58:33.986566 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-453da0e6-1bcd-4ecc-ae26-3727d49953e7 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:33.987014 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-453da0e6-1bcd-4ecc-ae26-3727d49953e7 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:33.987797 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-453da0e6-1bcd-4ecc-ae26-3727d49953e7 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:33.988243 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-453da0e6-1bcd-4ecc-ae26-3727d49953e7 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:34.026597 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-453da0e6-1bcd-4ecc-ae26-3727d49953e7 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "POST /compute/v2.1/servers/0eab1f9e-5c32-4bce-8043-2570445e9762/action" status: 200 len: 14 microversion: 2.1 time: 0.053531 Jul 23 21:58:34.029809 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2944/5554] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:58:33 2022] POST /compute/v2.1/servers/0eab1f9e-5c32-4bce-8043-2570445e9762/action => generated 14 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 23 21:58:35.042567 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4b46b4c5-e901-4e1f-a038-222c006befc9 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:58:35.044229 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-4b46b4c5-e901-4e1f-a038-222c006befc9 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 0eab1f9e-5c32-4bce-8043-2570445e9762] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:58:35.056309 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4b46b4c5-e901-4e1f-a038-222c006befc9 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:35.057062 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4b46b4c5-e901-4e1f-a038-222c006befc9 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:35.058352 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4b46b4c5-e901-4e1f-a038-222c006befc9 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:35.059122 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4b46b4c5-e901-4e1f-a038-222c006befc9 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:35.097427 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4b46b4c5-e901-4e1f-a038-222c006befc9 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "POST /compute/v2.1/servers/0eab1f9e-5c32-4bce-8043-2570445e9762/action" status: 200 len: 14 microversion: 2.1 time: 0.062281 Jul 23 21:58:35.097980 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2945/5555] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:58:35 2022] POST /compute/v2.1/servers/0eab1f9e-5c32-4bce-8043-2570445e9762/action => generated 14 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 23 21:58:36.111987 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f7ec54ae-e0e9-45e5-ad3c-7237919822c5 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:58:36.113056 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f7ec54ae-e0e9-45e5-ad3c-7237919822c5 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 0eab1f9e-5c32-4bce-8043-2570445e9762] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:58:36.121042 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f7ec54ae-e0e9-45e5-ad3c-7237919822c5 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:36.121535 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f7ec54ae-e0e9-45e5-ad3c-7237919822c5 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:36.122808 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f7ec54ae-e0e9-45e5-ad3c-7237919822c5 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:36.123265 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f7ec54ae-e0e9-45e5-ad3c-7237919822c5 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:36.164153 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f7ec54ae-e0e9-45e5-ad3c-7237919822c5 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "POST /compute/v2.1/servers/0eab1f9e-5c32-4bce-8043-2570445e9762/action" status: 200 len: 14 microversion: 2.1 time: 0.057456 Jul 23 21:58:36.164771 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2946/5556] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:58:36 2022] POST /compute/v2.1/servers/0eab1f9e-5c32-4bce-8043-2570445e9762/action => generated 14 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 23 21:58:37.179039 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ddb44b01-9bfb-4f70-99a7-a5dde140ad4b tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:58:37.180281 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ddb44b01-9bfb-4f70-99a7-a5dde140ad4b tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 0eab1f9e-5c32-4bce-8043-2570445e9762] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:58:37.189443 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ddb44b01-9bfb-4f70-99a7-a5dde140ad4b tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:37.189901 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ddb44b01-9bfb-4f70-99a7-a5dde140ad4b tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:37.190703 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ddb44b01-9bfb-4f70-99a7-a5dde140ad4b tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:37.191157 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ddb44b01-9bfb-4f70-99a7-a5dde140ad4b tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:37.228737 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ddb44b01-9bfb-4f70-99a7-a5dde140ad4b tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "POST /compute/v2.1/servers/0eab1f9e-5c32-4bce-8043-2570445e9762/action" status: 200 len: 14 microversion: 2.1 time: 0.055591 Jul 23 21:58:37.229348 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2947/5557] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:58:37 2022] POST /compute/v2.1/servers/0eab1f9e-5c32-4bce-8043-2570445e9762/action => generated 14 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 23 21:58:38.245252 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a14349b9-dd94-45b0-853b-58aeba02d51c tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:58:38.246820 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a14349b9-dd94-45b0-853b-58aeba02d51c tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 0eab1f9e-5c32-4bce-8043-2570445e9762] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:58:38.256129 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a14349b9-dd94-45b0-853b-58aeba02d51c tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:38.256584 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a14349b9-dd94-45b0-853b-58aeba02d51c tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:38.257359 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a14349b9-dd94-45b0-853b-58aeba02d51c tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:38.257804 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a14349b9-dd94-45b0-853b-58aeba02d51c tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:38.295843 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a14349b9-dd94-45b0-853b-58aeba02d51c tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "POST /compute/v2.1/servers/0eab1f9e-5c32-4bce-8043-2570445e9762/action" status: 200 len: 14 microversion: 2.1 time: 0.057898 Jul 23 21:58:38.296485 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2948/5558] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:58:38 2022] POST /compute/v2.1/servers/0eab1f9e-5c32-4bce-8043-2570445e9762/action => generated 14 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 23 21:58:39.312403 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1a64f824-5e75-4360-941d-aa1110bab126 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:58:39.314100 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1a64f824-5e75-4360-941d-aa1110bab126 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 0eab1f9e-5c32-4bce-8043-2570445e9762] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:58:39.326051 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1a64f824-5e75-4360-941d-aa1110bab126 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:39.326805 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1a64f824-5e75-4360-941d-aa1110bab126 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:39.328077 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1a64f824-5e75-4360-941d-aa1110bab126 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:39.328803 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1a64f824-5e75-4360-941d-aa1110bab126 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:39.367297 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1a64f824-5e75-4360-941d-aa1110bab126 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "POST /compute/v2.1/servers/0eab1f9e-5c32-4bce-8043-2570445e9762/action" status: 200 len: 14 microversion: 2.1 time: 0.061670 Jul 23 21:58:39.368184 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2949/5559] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:58:39 2022] POST /compute/v2.1/servers/0eab1f9e-5c32-4bce-8043-2570445e9762/action => generated 14 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 23 21:58:40.380653 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-abd2af6c-8749-443f-b029-94d22ee5ff0d tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:58:40.381585 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-abd2af6c-8749-443f-b029-94d22ee5ff0d tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 0eab1f9e-5c32-4bce-8043-2570445e9762] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:58:40.389480 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-abd2af6c-8749-443f-b029-94d22ee5ff0d tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:40.389955 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-abd2af6c-8749-443f-b029-94d22ee5ff0d tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:40.390835 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-abd2af6c-8749-443f-b029-94d22ee5ff0d tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:40.391278 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-abd2af6c-8749-443f-b029-94d22ee5ff0d tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:40.427833 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-abd2af6c-8749-443f-b029-94d22ee5ff0d tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "POST /compute/v2.1/servers/0eab1f9e-5c32-4bce-8043-2570445e9762/action" status: 200 len: 14 microversion: 2.1 time: 0.052164 Jul 23 21:58:40.428459 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2950/5560] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:58:40 2022] POST /compute/v2.1/servers/0eab1f9e-5c32-4bce-8043-2570445e9762/action => generated 14 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 23 21:58:41.445361 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-140aa16c-f1e2-41f4-9b3d-3053ad99915f tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:58:41.447084 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-140aa16c-f1e2-41f4-9b3d-3053ad99915f tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 0eab1f9e-5c32-4bce-8043-2570445e9762] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:58:41.457677 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-140aa16c-f1e2-41f4-9b3d-3053ad99915f tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:41.458175 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-140aa16c-f1e2-41f4-9b3d-3053ad99915f tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:41.458960 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-140aa16c-f1e2-41f4-9b3d-3053ad99915f tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:41.459403 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-140aa16c-f1e2-41f4-9b3d-3053ad99915f tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:41.497911 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-140aa16c-f1e2-41f4-9b3d-3053ad99915f tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "POST /compute/v2.1/servers/0eab1f9e-5c32-4bce-8043-2570445e9762/action" status: 200 len: 14 microversion: 2.1 time: 0.059997 Jul 23 21:58:41.498546 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2951/5561] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:58:41 2022] POST /compute/v2.1/servers/0eab1f9e-5c32-4bce-8043-2570445e9762/action => generated 14 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 23 21:58:42.514314 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-bc41326b-938d-4e63-af64-34e22beb954b tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:58:42.515976 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-bc41326b-938d-4e63-af64-34e22beb954b tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 0eab1f9e-5c32-4bce-8043-2570445e9762] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:58:42.528272 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bc41326b-938d-4e63-af64-34e22beb954b tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:42.529028 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bc41326b-938d-4e63-af64-34e22beb954b tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:42.530371 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bc41326b-938d-4e63-af64-34e22beb954b tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:42.531116 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bc41326b-938d-4e63-af64-34e22beb954b tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:42.573350 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-bc41326b-938d-4e63-af64-34e22beb954b tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "POST /compute/v2.1/servers/0eab1f9e-5c32-4bce-8043-2570445e9762/action" status: 200 len: 14 microversion: 2.1 time: 0.066270 Jul 23 21:58:42.574002 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2952/5562] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:58:42 2022] POST /compute/v2.1/servers/0eab1f9e-5c32-4bce-8043-2570445e9762/action => generated 14 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 23 21:58:43.586212 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b5b0e478-4835-4e39-8dcb-caa89be6426e tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:58:43.587351 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b5b0e478-4835-4e39-8dcb-caa89be6426e tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 0eab1f9e-5c32-4bce-8043-2570445e9762] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:58:43.596421 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b5b0e478-4835-4e39-8dcb-caa89be6426e tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:43.596925 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b5b0e478-4835-4e39-8dcb-caa89be6426e tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:43.597791 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b5b0e478-4835-4e39-8dcb-caa89be6426e tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:43.598321 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b5b0e478-4835-4e39-8dcb-caa89be6426e tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:43.650547 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b5b0e478-4835-4e39-8dcb-caa89be6426e tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "POST /compute/v2.1/servers/0eab1f9e-5c32-4bce-8043-2570445e9762/action" status: 200 len: 8204 microversion: 2.1 time: 0.068913 Jul 23 21:58:43.651122 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2953/5563] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:58:43 2022] POST /compute/v2.1/servers/0eab1f9e-5c32-4bce-8043-2570445e9762/action => generated 8204 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:58:43.660781 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4fe4107b-bc58-4791-b4f5-ba151c351770 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:58:43.661487 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-4fe4107b-bc58-4791-b4f5-ba151c351770 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:58:43.668962 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4fe4107b-bc58-4791-b4f5-ba151c351770 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:43.669419 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4fe4107b-bc58-4791-b4f5-ba151c351770 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:43.670236 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4fe4107b-bc58-4791-b4f5-ba151c351770 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:43.670685 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4fe4107b-bc58-4791-b4f5-ba151c351770 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:43.820235 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-4fe4107b-bc58-4791-b4f5-ba151c351770 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:58:43.830359 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4fe4107b-bc58-4791-b4f5-ba151c351770 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1670 microversion: 2.1 time: 0.173609 Jul 23 21:58:43.830954 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2954/5564] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:58:43 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1670 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:58:43.850548 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6968bb08-de87-4ddd-9e1e-9d43825474ec tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:58:43.853097 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6968bb08-de87-4ddd-9e1e-9d43825474ec tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:58:43.859304 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6968bb08-de87-4ddd-9e1e-9d43825474ec tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:43.859764 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6968bb08-de87-4ddd-9e1e-9d43825474ec tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:43.860567 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6968bb08-de87-4ddd-9e1e-9d43825474ec tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:43.861059 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6968bb08-de87-4ddd-9e1e-9d43825474ec tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:43.876259 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=100 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:58:43.993597 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6968bb08-de87-4ddd-9e1e-9d43825474ec tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:58:44.006725 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6968bb08-de87-4ddd-9e1e-9d43825474ec tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1670 microversion: 2.1 time: 0.159363 Jul 23 21:58:44.007333 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2955/5565] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:58:43 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1670 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:58:44.022806 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ee15748d-787c-48c4-884b-1298e86e4402 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:58:44.023413 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ee15748d-787c-48c4-884b-1298e86e4402 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:58:44.030138 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ee15748d-787c-48c4-884b-1298e86e4402 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:44.030597 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ee15748d-787c-48c4-884b-1298e86e4402 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:44.031377 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ee15748d-787c-48c4-884b-1298e86e4402 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:44.031825 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ee15748d-787c-48c4-884b-1298e86e4402 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:44.178319 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ee15748d-787c-48c4-884b-1298e86e4402 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:58:44.186119 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ee15748d-787c-48c4-884b-1298e86e4402 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1670 microversion: 2.1 time: 0.166952 Jul 23 21:58:44.186705 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2956/5566] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:58:44 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1670 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:58:44.201920 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-721a16f0-3b8b-4ad2-90e7-2071e0aa87b7 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:58:44.202461 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-721a16f0-3b8b-4ad2-90e7-2071e0aa87b7 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:58:44.208995 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-721a16f0-3b8b-4ad2-90e7-2071e0aa87b7 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:44.209456 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-721a16f0-3b8b-4ad2-90e7-2071e0aa87b7 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:44.210271 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-721a16f0-3b8b-4ad2-90e7-2071e0aa87b7 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:44.210717 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-721a16f0-3b8b-4ad2-90e7-2071e0aa87b7 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:44.355070 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-721a16f0-3b8b-4ad2-90e7-2071e0aa87b7 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:58:44.363738 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-721a16f0-3b8b-4ad2-90e7-2071e0aa87b7 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1670 microversion: 2.1 time: 0.165530 Jul 23 21:58:44.364359 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2957/5567] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:58:44 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1670 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:58:44.380166 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f78f07b0-be02-44e1-8cb9-bc815ab7e438 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:58:44.380823 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f78f07b0-be02-44e1-8cb9-bc815ab7e438 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:58:44.387583 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f78f07b0-be02-44e1-8cb9-bc815ab7e438 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:44.388040 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f78f07b0-be02-44e1-8cb9-bc815ab7e438 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:44.388826 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f78f07b0-be02-44e1-8cb9-bc815ab7e438 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:44.389264 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f78f07b0-be02-44e1-8cb9-bc815ab7e438 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:44.440552 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f78f07b0-be02-44e1-8cb9-bc815ab7e438 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Locking {{(pid=131320) lock /opt/stack/nova/nova/compute/api.py:4700}} Jul 23 21:58:44.505885 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f78f07b0-be02-44e1-8cb9-bc815ab7e438 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "POST /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841/action" status: 202 len: 0 microversion: 2.1 time: 0.129062 Jul 23 21:58:44.506717 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2958/5568] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:58:44 2022] POST /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:58:44.514764 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-25d42271-8028-4c90-911e-29abfee4b3c4 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:58:44.515389 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-25d42271-8028-4c90-911e-29abfee4b3c4 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:58:44.521502 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-25d42271-8028-4c90-911e-29abfee4b3c4 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:44.521993 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-25d42271-8028-4c90-911e-29abfee4b3c4 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:44.522774 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-25d42271-8028-4c90-911e-29abfee4b3c4 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:44.523220 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-25d42271-8028-4c90-911e-29abfee4b3c4 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:44.657811 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-25d42271-8028-4c90-911e-29abfee4b3c4 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:58:44.665668 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-25d42271-8028-4c90-911e-29abfee4b3c4 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1670 microversion: 2.1 time: 0.154573 Jul 23 21:58:44.666290 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2959/5569] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:58:44 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1670 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:58:44.681930 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-66ab97a6-d8bf-4488-95e9-17c22f4a1490 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:58:44.688251 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-66ab97a6-d8bf-4488-95e9-17c22f4a1490 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:44.688715 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-66ab97a6-d8bf-4488-95e9-17c22f4a1490 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:44.712466 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-66ab97a6-d8bf-4488-95e9-17c22f4a1490 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] HTTP exception thrown: Instance 9c96aa13-cbff-4245-a45b-418f131a0841 is locked Jul 23 21:58:44.714124 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-66ab97a6-d8bf-4488-95e9-17c22f4a1490 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Request method failure captured: Jul 23 21:58:44.714124 ncdv-master-1 devstack@n-api.service[131320]: request: POST /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841/action HTTP/1.1 Jul 23 21:58:44.714124 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 21:58:44.714124 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 21:58:44.714124 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 21:58:44.714124 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 15 Jul 23 21:58:44.714124 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 21:58:44.714124 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 21:58:44.714124 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 21:58:44.714124 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 21:58:44.714124 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3G5zenNQoGAgOnzvIlJaai-gziA5yMme9kZwxxrq2OwWiDMLl-dUF-XE3626KKfhD-N8cY1a9u6XXCRLdMFVsisJNTfK5xVs8wz60dDWCP6QSNbyt-jy1AKDyGzSQRBdVEEWeoKMqkilvA_v0S2vWwpnaqGtSJ3eyd-XByOeDDg16TA Jul 23 21:58:44.714124 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 21:58:44.714124 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 21:58:44.714124 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 21:58:44.714124 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 21:58:44.714124 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 21:58:44.714124 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 21:58:44.714124 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 7f624e0dec4a4f64b1d3580e60867c41 Jul 23 21:58:44.714124 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServerActionsTestJSON-140818405 Jul 23 21:58:44.714124 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 21:58:44.714124 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 21:58:44.714124 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7f624e0dec4a4f64b1d3580e60867c41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7f624e0dec4a4f64b1d3580e60867c41"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_7f624e0dec4a4f64b1d3580e60867c41", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/7f624e0dec4a4f64b1d3580e60867c41"}]}] Jul 23 21:58:44.714124 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServerActionsTestJSON-140818405 Jul 23 21:58:44.714124 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 7f624e0dec4a4f64b1d3580e60867c41 Jul 23 21:58:44.714124 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServerActionsTestJSON-140818405 Jul 23 21:58:44.714124 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServerActionsTestJSON-140818405-project Jul 23 21:58:44.714124 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 21:58:44.714124 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 21:58:44.714124 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: b5408fb2f4044c6d88527222b190230d Jul 23 21:58:44.714124 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServerActionsTestJSON-140818405-project Jul 23 21:58:44.714124 ncdv-master-1 devstack@n-api.service[131320]: Jul 23 21:58:44.714124 ncdv-master-1 devstack@n-api.service[131320]: {"os-stop": {}} Jul 23 21:58:44.714124 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 21:58:44.714124 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance 9c96aa13-cbff-4245-a45b-418f131a0841 is locked Jul 23 21:58:44.714124 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '9c96aa13-cbff-4245-a45b-418f131a0841', 'body': {'os-stop': {}}} Jul 23 21:58:44.714124 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 21:58:44.714124 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:58:44.714124 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1446, in _stop_server Jul 23 21:58:44.714124 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Jul 23 21:58:44.714124 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 237, in inner Jul 23 21:58:44.714124 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Jul 23 21:58:44.714124 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 9c96aa13-cbff-4245-a45b-418f131a0841 is locked Jul 23 21:58:44.714124 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:58:44.714124 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:58:44.714124 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:58:44.714124 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:58:44.714124 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:58:44.714124 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:58:44.714124 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 21:58:44.714124 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 21:58:44.714124 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 21:58:44.714124 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 21:58:44.714124 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1448, in _stop_server Jul 23 21:58:44.714124 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Jul 23 21:58:44.714124 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 9c96aa13-cbff-4245-a45b-418f131a0841 is locked Jul 23 21:58:44.714124 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:58:44.714124 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 21:58:44.714124 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:58:44.714124 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 21:58:44.714124 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 21:58:44.714124 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 21:58:44.714124 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 21:58:44.714124 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 21:58:44.714124 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c96aa13-cbff-4245-a45b-418f131a0841 is locked Jul 23 21:58:44.714124 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 21:58:44.718728 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-66ab97a6-d8bf-4488-95e9-17c22f4a1490 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Returning 409 to user: Instance 9c96aa13-cbff-4245-a45b-418f131a0841 is locked {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 21:58:44.718728 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-66ab97a6-d8bf-4488-95e9-17c22f4a1490 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "POST /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841/action" status: 409 len: 107 microversion: 2.1 time: 0.037419 Jul 23 21:58:44.718728 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2960/5570] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:58:44 2022] POST /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841/action => generated 107 bytes in 38 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 23 21:58:44.725401 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8eaeb958-31e5-446c-b7d8-a2800bbd9421 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:58:44.726229 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8eaeb958-31e5-446c-b7d8-a2800bbd9421 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:58:44.738652 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8eaeb958-31e5-446c-b7d8-a2800bbd9421 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:44.739696 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8eaeb958-31e5-446c-b7d8-a2800bbd9421 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:44.740589 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8eaeb958-31e5-446c-b7d8-a2800bbd9421 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:44.741194 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8eaeb958-31e5-446c-b7d8-a2800bbd9421 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:44.792035 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8eaeb958-31e5-446c-b7d8-a2800bbd9421 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Unlocking {{(pid=131320) unlock /opt/stack/nova/nova/compute/api.py:4729}} Jul 23 21:58:44.842953 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8eaeb958-31e5-446c-b7d8-a2800bbd9421 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "POST /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841/action" status: 202 len: 0 microversion: 2.1 time: 0.121798 Jul 23 21:58:44.844481 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2961/5571] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:58:44 2022] POST /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:58:44.852308 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8dba429c-b82c-424c-b116-d59343d82e03 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:58:44.858181 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8dba429c-b82c-424c-b116-d59343d82e03 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:44.858632 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8dba429c-b82c-424c-b116-d59343d82e03 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:44.880772 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8dba429c-b82c-424c-b116-d59343d82e03 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Going to try to stop instance {{(pid=131320) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 23 21:58:44.928624 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8dba429c-b82c-424c-b116-d59343d82e03 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "POST /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841/action" status: 202 len: 0 microversion: 2.1 time: 0.079753 Jul 23 21:58:44.929275 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2962/5572] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:58:44 2022] POST /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 23 21:58:44.937680 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-97e04022-1f13-4340-813b-7a5cf04cd9cd tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:58:44.938538 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-97e04022-1f13-4340-813b-7a5cf04cd9cd tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:58:44.945458 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-97e04022-1f13-4340-813b-7a5cf04cd9cd tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:44.945922 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-97e04022-1f13-4340-813b-7a5cf04cd9cd tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:44.946653 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-97e04022-1f13-4340-813b-7a5cf04cd9cd tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:44.947150 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-97e04022-1f13-4340-813b-7a5cf04cd9cd tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:45.089978 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-97e04022-1f13-4340-813b-7a5cf04cd9cd tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:58:45.100429 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-97e04022-1f13-4340-813b-7a5cf04cd9cd tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1680 microversion: 2.1 time: 0.166737 Jul 23 21:58:45.101019 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2963/5573] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:58:44 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1680 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:58:46.122073 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e2968f6c-3691-4773-bde5-46cc8ce49945 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:58:46.123124 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e2968f6c-3691-4773-bde5-46cc8ce49945 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:58:46.131851 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e2968f6c-3691-4773-bde5-46cc8ce49945 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:46.132308 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e2968f6c-3691-4773-bde5-46cc8ce49945 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:46.133081 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e2968f6c-3691-4773-bde5-46cc8ce49945 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:46.133525 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e2968f6c-3691-4773-bde5-46cc8ce49945 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:46.267456 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e2968f6c-3691-4773-bde5-46cc8ce49945 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:58:46.275250 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e2968f6c-3691-4773-bde5-46cc8ce49945 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1680 microversion: 2.1 time: 0.159946 Jul 23 21:58:46.275837 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2964/5574] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:58:46 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:58:47.293072 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-35abd8fb-46bb-4891-b3b7-96848d456d19 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:58:47.293752 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-35abd8fb-46bb-4891-b3b7-96848d456d19 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:58:47.301166 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-35abd8fb-46bb-4891-b3b7-96848d456d19 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:47.301635 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-35abd8fb-46bb-4891-b3b7-96848d456d19 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:47.302476 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-35abd8fb-46bb-4891-b3b7-96848d456d19 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:47.302926 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-35abd8fb-46bb-4891-b3b7-96848d456d19 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:47.468247 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-35abd8fb-46bb-4891-b3b7-96848d456d19 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:58:47.476774 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-35abd8fb-46bb-4891-b3b7-96848d456d19 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1680 microversion: 2.1 time: 0.187878 Jul 23 21:58:47.477403 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2965/5575] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:58:47 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1680 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:58:48.498669 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c7cc8c22-ad80-4446-8fc6-c8d8244cb03c tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:58:48.499795 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c7cc8c22-ad80-4446-8fc6-c8d8244cb03c tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:58:48.507976 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c7cc8c22-ad80-4446-8fc6-c8d8244cb03c tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:48.508427 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c7cc8c22-ad80-4446-8fc6-c8d8244cb03c tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:48.509192 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c7cc8c22-ad80-4446-8fc6-c8d8244cb03c tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:48.509627 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c7cc8c22-ad80-4446-8fc6-c8d8244cb03c tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:48.524666 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=5,nova_cell1:UPDATE=9 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:58:48.640972 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c7cc8c22-ad80-4446-8fc6-c8d8244cb03c tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:58:48.649253 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c7cc8c22-ad80-4446-8fc6-c8d8244cb03c tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1680 microversion: 2.1 time: 0.157298 Jul 23 21:58:48.649836 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2966/5576] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:58:48 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:58:49.670435 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-73452741-f335-46c6-9ad7-dd61d2c563b5 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:58:49.671387 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-73452741-f335-46c6-9ad7-dd61d2c563b5 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:58:49.679672 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-73452741-f335-46c6-9ad7-dd61d2c563b5 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:49.680129 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-73452741-f335-46c6-9ad7-dd61d2c563b5 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:49.680904 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-73452741-f335-46c6-9ad7-dd61d2c563b5 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:49.681351 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-73452741-f335-46c6-9ad7-dd61d2c563b5 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:49.818218 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-73452741-f335-46c6-9ad7-dd61d2c563b5 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:58:49.826488 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-73452741-f335-46c6-9ad7-dd61d2c563b5 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1680 microversion: 2.1 time: 0.162660 Jul 23 21:58:49.827079 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2967/5577] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:58:49 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:58:50.844630 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8a80354a-1cef-4db7-bb65-3c0b02f3dec6 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:58:50.845284 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8a80354a-1cef-4db7-bb65-3c0b02f3dec6 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:58:50.852726 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8a80354a-1cef-4db7-bb65-3c0b02f3dec6 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:50.853183 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8a80354a-1cef-4db7-bb65-3c0b02f3dec6 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:50.853999 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8a80354a-1cef-4db7-bb65-3c0b02f3dec6 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:50.854443 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8a80354a-1cef-4db7-bb65-3c0b02f3dec6 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:50.985506 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8a80354a-1cef-4db7-bb65-3c0b02f3dec6 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:58:50.997198 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8a80354a-1cef-4db7-bb65-3c0b02f3dec6 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1680 microversion: 2.1 time: 0.156749 Jul 23 21:58:50.998052 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2968/5578] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:58:50 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:58:52.017375 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a438d5cd-5a38-48af-9eca-0199fee451c3 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:58:52.018109 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a438d5cd-5a38-48af-9eca-0199fee451c3 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:58:52.025759 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a438d5cd-5a38-48af-9eca-0199fee451c3 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:52.026258 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a438d5cd-5a38-48af-9eca-0199fee451c3 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:52.027040 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a438d5cd-5a38-48af-9eca-0199fee451c3 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:52.027488 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a438d5cd-5a38-48af-9eca-0199fee451c3 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:52.168780 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a438d5cd-5a38-48af-9eca-0199fee451c3 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:58:52.176514 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a438d5cd-5a38-48af-9eca-0199fee451c3 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1680 microversion: 2.1 time: 0.165355 Jul 23 21:58:52.177092 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2969/5579] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:58:52 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1680 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:58:53.201765 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-afe25f5a-725b-4a26-9ecf-cadc3dc79479 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:58:53.202974 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-afe25f5a-725b-4a26-9ecf-cadc3dc79479 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:58:53.211705 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-afe25f5a-725b-4a26-9ecf-cadc3dc79479 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:53.212155 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-afe25f5a-725b-4a26-9ecf-cadc3dc79479 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:53.212926 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-afe25f5a-725b-4a26-9ecf-cadc3dc79479 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:53.213371 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-afe25f5a-725b-4a26-9ecf-cadc3dc79479 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:53.348109 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-afe25f5a-725b-4a26-9ecf-cadc3dc79479 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:58:53.360229 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-afe25f5a-725b-4a26-9ecf-cadc3dc79479 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1680 microversion: 2.1 time: 0.164728 Jul 23 21:58:53.361000 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2970/5580] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:58:53 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1680 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:58:54.383047 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-95da2752-aaab-4e19-a44d-b1f4fe265d7c tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:58:54.384147 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-95da2752-aaab-4e19-a44d-b1f4fe265d7c tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:58:54.396104 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-95da2752-aaab-4e19-a44d-b1f4fe265d7c tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:54.396873 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-95da2752-aaab-4e19-a44d-b1f4fe265d7c tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:54.398202 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-95da2752-aaab-4e19-a44d-b1f4fe265d7c tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:54.398941 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-95da2752-aaab-4e19-a44d-b1f4fe265d7c tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:54.540047 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-95da2752-aaab-4e19-a44d-b1f4fe265d7c tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:58:54.548273 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-95da2752-aaab-4e19-a44d-b1f4fe265d7c tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1680 microversion: 2.1 time: 0.172155 Jul 23 21:58:54.548862 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2971/5581] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:58:54 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1680 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:58:55.568980 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d8dacc32-475e-46a4-8ae6-c684656ee8ea tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:58:55.570063 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d8dacc32-475e-46a4-8ae6-c684656ee8ea tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:58:55.574425 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=78 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:58:55.583514 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d8dacc32-475e-46a4-8ae6-c684656ee8ea tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:55.583800 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d8dacc32-475e-46a4-8ae6-c684656ee8ea tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:55.584661 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d8dacc32-475e-46a4-8ae6-c684656ee8ea tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:55.585000 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d8dacc32-475e-46a4-8ae6-c684656ee8ea tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:55.734546 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d8dacc32-475e-46a4-8ae6-c684656ee8ea tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:58:55.742672 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d8dacc32-475e-46a4-8ae6-c684656ee8ea tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1657 microversion: 2.1 time: 0.180501 Jul 23 21:58:55.743252 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2972/5582] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:58:55 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1657 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:58:55.759088 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-46f7a300-85c8-43cc-bf73-9f79018eb7c4 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:58:55.766583 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-46f7a300-85c8-43cc-bf73-9f79018eb7c4 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:55.767036 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-46f7a300-85c8-43cc-bf73-9f79018eb7c4 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:55.791624 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-46f7a300-85c8-43cc-bf73-9f79018eb7c4 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Going to try to start instance {{(pid=131320) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 23 21:58:55.836461 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-46f7a300-85c8-43cc-bf73-9f79018eb7c4 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "POST /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841/action" status: 202 len: 0 microversion: 2.1 time: 0.080888 Jul 23 21:58:55.837081 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2973/5583] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:58:55 2022] POST /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:58:55.846111 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4d8a7c63-2cf0-4f21-9654-e73a0918c3b8 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:58:55.846822 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-4d8a7c63-2cf0-4f21-9654-e73a0918c3b8 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:58:55.853378 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4d8a7c63-2cf0-4f21-9654-e73a0918c3b8 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:55.853922 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4d8a7c63-2cf0-4f21-9654-e73a0918c3b8 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:55.854944 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4d8a7c63-2cf0-4f21-9654-e73a0918c3b8 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:55.855343 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4d8a7c63-2cf0-4f21-9654-e73a0918c3b8 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:56.027665 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-4d8a7c63-2cf0-4f21-9654-e73a0918c3b8 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:58:56.035924 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4d8a7c63-2cf0-4f21-9654-e73a0918c3b8 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1666 microversion: 2.1 time: 0.194129 Jul 23 21:58:56.036516 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2974/5584] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:58:55 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1666 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:58:57.055288 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-20164eb0-22c5-496e-9e39-7a99dc161d06 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:58:57.056914 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-20164eb0-22c5-496e-9e39-7a99dc161d06 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:58:57.064980 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-20164eb0-22c5-496e-9e39-7a99dc161d06 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:57.065445 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-20164eb0-22c5-496e-9e39-7a99dc161d06 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:57.066304 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-20164eb0-22c5-496e-9e39-7a99dc161d06 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:57.066766 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-20164eb0-22c5-496e-9e39-7a99dc161d06 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:57.209482 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-20164eb0-22c5-496e-9e39-7a99dc161d06 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:58:57.217374 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-20164eb0-22c5-496e-9e39-7a99dc161d06 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1670 microversion: 2.1 time: 0.167755 Jul 23 21:58:57.217974 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2975/5585] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:58:57 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1670 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:58:57.234038 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-194cb1d9-09be-495d-9e94-4300d67ca0aa tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:58:57.234642 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-194cb1d9-09be-495d-9e94-4300d67ca0aa tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:58:57.240543 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-194cb1d9-09be-495d-9e94-4300d67ca0aa tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:57.240984 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-194cb1d9-09be-495d-9e94-4300d67ca0aa tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:57.241765 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-194cb1d9-09be-495d-9e94-4300d67ca0aa tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:57.242211 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-194cb1d9-09be-495d-9e94-4300d67ca0aa tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:57.380964 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-194cb1d9-09be-495d-9e94-4300d67ca0aa tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:58:57.389264 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-194cb1d9-09be-495d-9e94-4300d67ca0aa tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1670 microversion: 2.1 time: 0.158720 Jul 23 21:58:57.389878 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2976/5586] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:58:57 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1670 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:58:57.405592 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c15509af-3e38-412d-810c-34738a8db720 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:58:57.406090 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c15509af-3e38-412d-810c-34738a8db720 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:58:57.412586 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c15509af-3e38-412d-810c-34738a8db720 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:57.413093 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c15509af-3e38-412d-810c-34738a8db720 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:57.414321 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c15509af-3e38-412d-810c-34738a8db720 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:57.414321 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c15509af-3e38-412d-810c-34738a8db720 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:57.459008 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c15509af-3e38-412d-810c-34738a8db720 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Unlocking {{(pid=131320) unlock /opt/stack/nova/nova/compute/api.py:4729}} Jul 23 21:58:57.505216 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c15509af-3e38-412d-810c-34738a8db720 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "POST /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841/action" status: 202 len: 0 microversion: 2.1 time: 0.103531 Jul 23 21:58:57.507705 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2977/5587] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:58:57 2022] POST /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:58:57.517588 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-689d84ab-23f8-47dc-8b03-679a265d9da3 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:58:57.518539 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-689d84ab-23f8-47dc-8b03-679a265d9da3 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:58:57.527240 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-689d84ab-23f8-47dc-8b03-679a265d9da3 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:57.527886 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-689d84ab-23f8-47dc-8b03-679a265d9da3 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:57.528893 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-689d84ab-23f8-47dc-8b03-679a265d9da3 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:57.529461 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-689d84ab-23f8-47dc-8b03-679a265d9da3 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:57.673530 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-689d84ab-23f8-47dc-8b03-679a265d9da3 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:58:57.681589 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-689d84ab-23f8-47dc-8b03-679a265d9da3 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1670 microversion: 2.1 time: 0.168997 Jul 23 21:58:57.682196 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2978/5588] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:58:57 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1670 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:58:57.702688 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d5930884-44dd-4bb2-b8c3-d34ce1d65817 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:58:57.703488 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d5930884-44dd-4bb2-b8c3-d34ce1d65817 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:58:57.710004 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d5930884-44dd-4bb2-b8c3-d34ce1d65817 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:57.710448 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d5930884-44dd-4bb2-b8c3-d34ce1d65817 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:57.711211 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d5930884-44dd-4bb2-b8c3-d34ce1d65817 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:57.711648 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d5930884-44dd-4bb2-b8c3-d34ce1d65817 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:57.730349 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:58:57.852240 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d5930884-44dd-4bb2-b8c3-d34ce1d65817 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:58:57.860330 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d5930884-44dd-4bb2-b8c3-d34ce1d65817 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1670 microversion: 2.1 time: 0.161287 Jul 23 21:58:57.860916 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2979/5589] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:58:57 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1670 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:58:57.876363 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-bca72bf3-b42f-4294-9349-7a282ef55cf1 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:58:57.876978 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-bca72bf3-b42f-4294-9349-7a282ef55cf1 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:58:57.883047 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bca72bf3-b42f-4294-9349-7a282ef55cf1 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:57.883510 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bca72bf3-b42f-4294-9349-7a282ef55cf1 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:57.884318 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bca72bf3-b42f-4294-9349-7a282ef55cf1 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:57.884775 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bca72bf3-b42f-4294-9349-7a282ef55cf1 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:58.023425 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-bca72bf3-b42f-4294-9349-7a282ef55cf1 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:58:58.031794 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-bca72bf3-b42f-4294-9349-7a282ef55cf1 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1670 microversion: 2.1 time: 0.158965 Jul 23 21:58:58.032381 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2980/5590] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:58:57 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1670 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:58:58.047818 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a85d2d13-8948-48f0-b198-c6a63568001a tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:58:58.048364 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a85d2d13-8948-48f0-b198-c6a63568001a tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:58:58.054495 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a85d2d13-8948-48f0-b198-c6a63568001a tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:58.054955 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a85d2d13-8948-48f0-b198-c6a63568001a tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:58.055734 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a85d2d13-8948-48f0-b198-c6a63568001a tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:58.056310 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a85d2d13-8948-48f0-b198-c6a63568001a tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:58.126760 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a85d2d13-8948-48f0-b198-c6a63568001a tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "POST /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841/action" status: 202 len: 0 microversion: 2.1 time: 0.082355 Jul 23 21:58:58.127409 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2981/5591] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:58:58 2022] POST /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:58:58.135812 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-704c476b-91b2-424b-a53c-2d0f2ab535db tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:58:58.136520 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-704c476b-91b2-424b-a53c-2d0f2ab535db tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:58:58.142999 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-704c476b-91b2-424b-a53c-2d0f2ab535db tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:58.143459 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-704c476b-91b2-424b-a53c-2d0f2ab535db tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:58.144243 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-704c476b-91b2-424b-a53c-2d0f2ab535db tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:58.144688 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-704c476b-91b2-424b-a53c-2d0f2ab535db tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:58.283791 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-704c476b-91b2-424b-a53c-2d0f2ab535db tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:58:58.291980 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-704c476b-91b2-424b-a53c-2d0f2ab535db tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1675 microversion: 2.1 time: 0.160147 Jul 23 21:58:58.292594 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2982/5592] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:58:58 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1675 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:58:59.313668 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0d601655-43e9-46de-b925-a52273942b67 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:58:59.314518 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-0d601655-43e9-46de-b925-a52273942b67 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:58:59.324392 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0d601655-43e9-46de-b925-a52273942b67 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:59.325101 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0d601655-43e9-46de-b925-a52273942b67 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:59.326411 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0d601655-43e9-46de-b925-a52273942b67 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:59.327111 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0d601655-43e9-46de-b925-a52273942b67 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:59.473898 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-0d601655-43e9-46de-b925-a52273942b67 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:58:59.481948 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-0d601655-43e9-46de-b925-a52273942b67 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1655 microversion: 2.1 time: 0.174582 Jul 23 21:58:59.482498 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2983/5593] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:58:59 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1655 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:58:59.498427 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4f11827a-0f35-4672-9d8e-68a4f5403a00 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:58:59.498966 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-4f11827a-0f35-4672-9d8e-68a4f5403a00 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:58:59.504858 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4f11827a-0f35-4672-9d8e-68a4f5403a00 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:59.505318 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4f11827a-0f35-4672-9d8e-68a4f5403a00 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:59.506113 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4f11827a-0f35-4672-9d8e-68a4f5403a00 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:59.506557 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4f11827a-0f35-4672-9d8e-68a4f5403a00 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:59.579315 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4f11827a-0f35-4672-9d8e-68a4f5403a00 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "POST /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841/action" status: 202 len: 0 microversion: 2.1 time: 0.084095 Jul 23 21:58:59.579926 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2984/5594] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:58:59 2022] POST /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:58:59.592968 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ff330b29-cfc6-4ab2-8113-76cad5ecf742 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:58:59.594446 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ff330b29-cfc6-4ab2-8113-76cad5ecf742 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:58:59.604138 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ff330b29-cfc6-4ab2-8113-76cad5ecf742 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:59.604851 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ff330b29-cfc6-4ab2-8113-76cad5ecf742 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:59.606077 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ff330b29-cfc6-4ab2-8113-76cad5ecf742 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:58:59.606738 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ff330b29-cfc6-4ab2-8113-76cad5ecf742 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:58:59.761579 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ff330b29-cfc6-4ab2-8113-76cad5ecf742 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:58:59.769598 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ff330b29-cfc6-4ab2-8113-76cad5ecf742 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1662 microversion: 2.1 time: 0.183375 Jul 23 21:58:59.779887 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2985/5595] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:58:59 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1662 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:59:00.790073 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f4bd7bb3-cea7-4971-a5b4-4eb6ca0a0e7d tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:59:00.790800 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f4bd7bb3-cea7-4971-a5b4-4eb6ca0a0e7d tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:59:00.801497 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f4bd7bb3-cea7-4971-a5b4-4eb6ca0a0e7d tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:59:00.801984 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f4bd7bb3-cea7-4971-a5b4-4eb6ca0a0e7d tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:59:00.802746 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f4bd7bb3-cea7-4971-a5b4-4eb6ca0a0e7d tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:59:00.803193 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f4bd7bb3-cea7-4971-a5b4-4eb6ca0a0e7d tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:59:00.939656 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f4bd7bb3-cea7-4971-a5b4-4eb6ca0a0e7d tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:59:00.947579 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f4bd7bb3-cea7-4971-a5b4-4eb6ca0a0e7d tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1670 microversion: 2.1 time: 0.163969 Jul 23 21:59:00.948171 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2986/5596] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:59:00 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1670 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:59:00.964312 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c32eee97-6137-4b8a-b08f-4d2672ccee84 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:59:00.964938 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c32eee97-6137-4b8a-b08f-4d2672ccee84 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:59:00.971490 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c32eee97-6137-4b8a-b08f-4d2672ccee84 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:59:00.971951 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c32eee97-6137-4b8a-b08f-4d2672ccee84 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:59:00.972728 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c32eee97-6137-4b8a-b08f-4d2672ccee84 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:59:00.973171 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c32eee97-6137-4b8a-b08f-4d2672ccee84 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:59:01.110676 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c32eee97-6137-4b8a-b08f-4d2672ccee84 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:59:01.121519 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c32eee97-6137-4b8a-b08f-4d2672ccee84 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1670 microversion: 2.1 time: 0.160851 Jul 23 21:59:01.122380 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2987/5597] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:59:00 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1670 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:59:01.141461 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f6fd73ea-8892-4c8c-9950-9aa639d4e86f tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:59:01.142103 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f6fd73ea-8892-4c8c-9950-9aa639d4e86f tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:59:01.148719 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f6fd73ea-8892-4c8c-9950-9aa639d4e86f tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:59:01.149176 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f6fd73ea-8892-4c8c-9950-9aa639d4e86f tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:59:01.149954 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f6fd73ea-8892-4c8c-9950-9aa639d4e86f tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:59:01.150429 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f6fd73ea-8892-4c8c-9950-9aa639d4e86f tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:59:01.292458 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f6fd73ea-8892-4c8c-9950-9aa639d4e86f tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:59:01.300522 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f6fd73ea-8892-4c8c-9950-9aa639d4e86f tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1670 microversion: 2.1 time: 0.162730 Jul 23 21:59:01.301107 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2988/5598] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:59:01 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1670 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 21:59:01.316293 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-adbbb430-df27-4e91-86d2-573d81b0a789 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:59:01.317025 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-adbbb430-df27-4e91-86d2-573d81b0a789 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:59:01.323337 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-adbbb430-df27-4e91-86d2-573d81b0a789 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:59:01.323787 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-adbbb430-df27-4e91-86d2-573d81b0a789 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:59:01.324557 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-adbbb430-df27-4e91-86d2-573d81b0a789 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:59:01.324993 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-adbbb430-df27-4e91-86d2-573d81b0a789 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:59:01.464448 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-adbbb430-df27-4e91-86d2-573d81b0a789 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:59:01.472670 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-adbbb430-df27-4e91-86d2-573d81b0a789 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1670 microversion: 2.1 time: 0.159980 Jul 23 21:59:01.473226 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2989/5599] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:59:01 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1670 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:59:01.488513 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0bd51082-71b7-4aa6-add2-418cb28c7f17 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:59:01.489169 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-0bd51082-71b7-4aa6-add2-418cb28c7f17 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:59:01.495220 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0bd51082-71b7-4aa6-add2-418cb28c7f17 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:59:01.495684 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0bd51082-71b7-4aa6-add2-418cb28c7f17 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:59:01.496461 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0bd51082-71b7-4aa6-add2-418cb28c7f17 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:59:01.496908 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0bd51082-71b7-4aa6-add2-418cb28c7f17 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:59:01.638517 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-0bd51082-71b7-4aa6-add2-418cb28c7f17 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:59:01.646716 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-0bd51082-71b7-4aa6-add2-418cb28c7f17 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1670 microversion: 2.1 time: 0.161861 Jul 23 21:59:01.647302 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2990/5600] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:59:01 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1670 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:59:01.662693 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ddca7408-618f-43e8-bd76-9917531b00f8 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:59:01.663312 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ddca7408-618f-43e8-bd76-9917531b00f8 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:59:01.669534 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ddca7408-618f-43e8-bd76-9917531b00f8 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:59:01.670030 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ddca7408-618f-43e8-bd76-9917531b00f8 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:59:01.670821 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ddca7408-618f-43e8-bd76-9917531b00f8 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:59:01.671268 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ddca7408-618f-43e8-bd76-9917531b00f8 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:59:01.804665 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ddca7408-618f-43e8-bd76-9917531b00f8 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:59:01.812766 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ddca7408-618f-43e8-bd76-9917531b00f8 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1670 microversion: 2.1 time: 0.153831 Jul 23 21:59:01.813351 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2991/5601] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:59:01 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1670 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:59:32.728049 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-66e80f96-d6f5-4175-8db0-fd4cdee46f53 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 21:59:32.729049 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-66e80f96-d6f5-4175-8db0-fd4cdee46f53 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:59:32.733133 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=39 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:59:32.733808 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 21:59:32.745719 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-66e80f96-d6f5-4175-8db0-fd4cdee46f53 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:59:32.746470 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-66e80f96-d6f5-4175-8db0-fd4cdee46f53 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:59:32.747567 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-66e80f96-d6f5-4175-8db0-fd4cdee46f53 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:59:32.748071 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-66e80f96-d6f5-4175-8db0-fd4cdee46f53 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:59:32.830493 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-66e80f96-d6f5-4175-8db0-fd4cdee46f53 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "POST /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841/action" status: 202 len: 0 microversion: 2.1 time: 0.106404 Jul 23 21:59:32.831191 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2992/5602] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 21:59:32 2022] POST /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 21:59:32.839484 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f64ccffe-699e-4b0e-9bf4-845850ebd865 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:59:32.840185 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f64ccffe-699e-4b0e-9bf4-845850ebd865 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:59:32.847054 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f64ccffe-699e-4b0e-9bf4-845850ebd865 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:59:32.847549 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f64ccffe-699e-4b0e-9bf4-845850ebd865 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:59:32.848303 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f64ccffe-699e-4b0e-9bf4-845850ebd865 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:59:32.848796 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f64ccffe-699e-4b0e-9bf4-845850ebd865 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:59:33.071710 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f64ccffe-699e-4b0e-9bf4-845850ebd865 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:59:33.079993 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f64ccffe-699e-4b0e-9bf4-845850ebd865 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1672 microversion: 2.1 time: 0.244472 Jul 23 21:59:33.080555 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2993/5603] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:59:32 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1672 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 21:59:34.099486 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-16533034-2aab-44f2-8692-747ca8f195d3 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 21:59:34.100147 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-16533034-2aab-44f2-8692-747ca8f195d3 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 21:59:34.107177 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-16533034-2aab-44f2-8692-747ca8f195d3 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:59:34.107630 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-16533034-2aab-44f2-8692-747ca8f195d3 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:59:34.108490 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-16533034-2aab-44f2-8692-747ca8f195d3 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 21:59:34.108981 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-16533034-2aab-44f2-8692-747ca8f195d3 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 21:59:34.241493 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-16533034-2aab-44f2-8692-747ca8f195d3 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 21:59:34.249364 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-16533034-2aab-44f2-8692-747ca8f195d3 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1670 microversion: 2.1 time: 0.153911 Jul 23 21:59:34.249964 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2994/5604] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 21:59:34 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1670 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:00:06.303398 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-cafe8eb2-3dea-45f9-a4e7-7b9b76ac5d9e tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:00:06.304506 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-cafe8eb2-3dea-45f9-a4e7-7b9b76ac5d9e tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:00:06.308217 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=6 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:00:06.309299 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:00:06.319377 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cafe8eb2-3dea-45f9-a4e7-7b9b76ac5d9e tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:06.319838 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cafe8eb2-3dea-45f9-a4e7-7b9b76ac5d9e tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:06.320677 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cafe8eb2-3dea-45f9-a4e7-7b9b76ac5d9e tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:06.321108 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cafe8eb2-3dea-45f9-a4e7-7b9b76ac5d9e tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:06.457634 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-cafe8eb2-3dea-45f9-a4e7-7b9b76ac5d9e tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:00:06.469842 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-cafe8eb2-3dea-45f9-a4e7-7b9b76ac5d9e tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1670 microversion: 2.1 time: 0.173027 Jul 23 22:00:06.470644 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2995/5605] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:00:06 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1670 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:00:06.488549 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4c41509c-57fc-4ea5-a709-7e069b36776f tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:00:06.489160 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-4c41509c-57fc-4ea5-a709-7e069b36776f tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:00:06.495419 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4c41509c-57fc-4ea5-a709-7e069b36776f tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:06.495874 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4c41509c-57fc-4ea5-a709-7e069b36776f tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:06.496638 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4c41509c-57fc-4ea5-a709-7e069b36776f tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:06.497052 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4c41509c-57fc-4ea5-a709-7e069b36776f tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:06.633990 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-4c41509c-57fc-4ea5-a709-7e069b36776f tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:00:06.645481 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4c41509c-57fc-4ea5-a709-7e069b36776f tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1670 microversion: 2.1 time: 0.160273 Jul 23 22:00:06.646110 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2996/5606] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:00:06 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1670 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:00:06.661395 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-67c8cfbc-3501-41c1-812b-e52a1e159c58 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:00:06.662038 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-67c8cfbc-3501-41c1-812b-e52a1e159c58 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:00:06.668195 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-67c8cfbc-3501-41c1-812b-e52a1e159c58 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:06.668647 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-67c8cfbc-3501-41c1-812b-e52a1e159c58 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:06.669419 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-67c8cfbc-3501-41c1-812b-e52a1e159c58 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:06.669907 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-67c8cfbc-3501-41c1-812b-e52a1e159c58 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:06.804223 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-67c8cfbc-3501-41c1-812b-e52a1e159c58 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:00:06.812283 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-67c8cfbc-3501-41c1-812b-e52a1e159c58 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1670 microversion: 2.1 time: 0.154541 Jul 23 22:00:06.812887 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2997/5607] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:00:06 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1670 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:00:06.828424 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-48c94239-dc04-4481-8b23-0bba2f7b9f55 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:00:06.829002 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-48c94239-dc04-4481-8b23-0bba2f7b9f55 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:00:06.835372 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-48c94239-dc04-4481-8b23-0bba2f7b9f55 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:06.835862 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-48c94239-dc04-4481-8b23-0bba2f7b9f55 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:06.836626 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-48c94239-dc04-4481-8b23-0bba2f7b9f55 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:06.837140 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-48c94239-dc04-4481-8b23-0bba2f7b9f55 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:06.983377 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-48c94239-dc04-4481-8b23-0bba2f7b9f55 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:00:06.991250 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-48c94239-dc04-4481-8b23-0bba2f7b9f55 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1670 microversion: 2.1 time: 0.166699 Jul 23 22:00:06.991816 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2998/5608] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:00:06 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1670 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:00:07.062863 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d6819fe6-9700-49a4-851c-b9c5a4feb158 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-125851295", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "networks": [{"uuid": "6770b9e7-826f-46ba-879d-e25a87aab2e5"}]}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:00:07.115461 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-d6819fe6-9700-49a4-851c-b9c5a4feb158 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] validate_networks() for [('6770b9e7-826f-46ba-879d-e25a87aab2e5', None, None, None, None, None)] {{(pid=131320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 22:00:07.520294 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-d6819fe6-9700-49a4-851c-b9c5a4feb158 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 22:00:07.520945 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-d6819fe6-9700-49a4-851c-b9c5a4feb158 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 22:00:07.521217 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-d6819fe6-9700-49a4-851c-b9c5a4feb158 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 22:00:07.521659 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-d6819fe6-9700-49a4-851c-b9c5a4feb158 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 22:00:07.522129 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-d6819fe6-9700-49a4-851c-b9c5a4feb158 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 22:00:07.531680 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d6819fe6-9700-49a4-851c-b9c5a4feb158 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:07.532158 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d6819fe6-9700-49a4-851c-b9c5a4feb158 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:07.532958 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d6819fe6-9700-49a4-851c-b9c5a4feb158 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:07.533408 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d6819fe6-9700-49a4-851c-b9c5a4feb158 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:07.550585 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-d6819fe6-9700-49a4-851c-b9c5a4feb158 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Getting quotas for project 7f624e0dec4a4f64b1d3580e60867c41. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 22:00:07.556101 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-d6819fe6-9700-49a4-851c-b9c5a4feb158 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Getting quotas for user b5408fb2f4044c6d88527222b190230d and project 7f624e0dec4a4f64b1d3580e60867c41. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 22:00:07.568548 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d6819fe6-9700-49a4-851c-b9c5a4feb158 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Going to run 1 instances... {{(pid=131320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 22:00:07.570899 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d6819fe6-9700-49a4-851c-b9c5a4feb158 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 2ae0714c-5e4b-4c64-b23c-0a0a9e6a4609] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 22:00:07.627483 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d6819fe6-9700-49a4-851c-b9c5a4feb158 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.567302 Jul 23 22:00:07.628193 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 2999/5609] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 22:00:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 570 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 23 22:00:07.638255 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d2f20280-97d3-434b-8c70-d1eb4675d89b tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:00:07.638850 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d2f20280-97d3-434b-8c70-d1eb4675d89b tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 2ae0714c-5e4b-4c64-b23c-0a0a9e6a4609] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:00:07.692118 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d2f20280-97d3-434b-8c70-d1eb4675d89b tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:00:07.699080 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d2f20280-97d3-434b-8c70-d1eb4675d89b tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/2ae0714c-5e4b-4c64-b23c-0a0a9e6a4609" status: 200 len: 1214 microversion: 2.1 time: 0.064674 Jul 23 22:00:07.699667 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3000/5610] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:00:07 2022] GET /compute/v2.1/servers/2ae0714c-5e4b-4c64-b23c-0a0a9e6a4609 => generated 1214 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:00:08.718061 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5b275c69-cf7c-4ee8-8b0e-bf50a382d931 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:00:08.719152 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5b275c69-cf7c-4ee8-8b0e-bf50a382d931 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 2ae0714c-5e4b-4c64-b23c-0a0a9e6a4609] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:00:08.727315 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5b275c69-cf7c-4ee8-8b0e-bf50a382d931 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:08.727805 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5b275c69-cf7c-4ee8-8b0e-bf50a382d931 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:08.728723 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5b275c69-cf7c-4ee8-8b0e-bf50a382d931 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:08.729175 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5b275c69-cf7c-4ee8-8b0e-bf50a382d931 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:08.794460 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5b275c69-cf7c-4ee8-8b0e-bf50a382d931 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:00:08.802566 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5b275c69-cf7c-4ee8-8b0e-bf50a382d931 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/2ae0714c-5e4b-4c64-b23c-0a0a9e6a4609" status: 200 len: 1284 microversion: 2.1 time: 0.090276 Jul 23 22:00:08.803242 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3001/5611] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:00:08 2022] GET /compute/v2.1/servers/2ae0714c-5e4b-4c64-b23c-0a0a9e6a4609 => generated 1284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:00:09.821007 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-fe903c7d-7472-4895-938c-8354ced2ff2a tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:00:09.822384 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-fe903c7d-7472-4895-938c-8354ced2ff2a tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 2ae0714c-5e4b-4c64-b23c-0a0a9e6a4609] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:00:09.831024 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fe903c7d-7472-4895-938c-8354ced2ff2a tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:09.831570 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fe903c7d-7472-4895-938c-8354ced2ff2a tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:09.832595 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fe903c7d-7472-4895-938c-8354ced2ff2a tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:09.833260 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fe903c7d-7472-4895-938c-8354ced2ff2a tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:09.980037 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-fe903c7d-7472-4895-938c-8354ced2ff2a tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:00:09.999645 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-fe903c7d-7472-4895-938c-8354ced2ff2a tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/2ae0714c-5e4b-4c64-b23c-0a0a9e6a4609" status: 200 len: 1314 microversion: 2.1 time: 0.182873 Jul 23 22:00:10.001317 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3002/5612] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:00:09 2022] GET /compute/v2.1/servers/2ae0714c-5e4b-4c64-b23c-0a0a9e6a4609 => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:00:10.006409 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-036a9ca0-691e-4ace-bc00-04cea9abf784 req-2c2293f7-9b06-4b45-9ac0-9f08bf67291a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ae0714c-5e4b-4c64-b23c-0a0a9e6a4609", "tag": "2d41063e-a18d-4d71-bbe1-099835fea2dd"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:00:10.016316 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-036a9ca0-691e-4ace-bc00-04cea9abf784 req-2c2293f7-9b06-4b45-9ac0-9f08bf67291a service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:10.017367 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-036a9ca0-691e-4ace-bc00-04cea9abf784 req-2c2293f7-9b06-4b45-9ac0-9f08bf67291a service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:10.030302 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-036a9ca0-691e-4ace-bc00-04cea9abf784 req-2c2293f7-9b06-4b45-9ac0-9f08bf67291a service nova] Creating event network-changed:2d41063e-a18d-4d71-bbe1-099835fea2dd for instance 2ae0714c-5e4b-4c64-b23c-0a0a9e6a4609 on nch1-master-1 Jul 23 22:00:10.035652 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-036a9ca0-691e-4ace-bc00-04cea9abf784 req-2c2293f7-9b06-4b45-9ac0-9f08bf67291a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032757 Jul 23 22:00:10.036300 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3003/5613] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:00:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:00:11.024346 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2a6706d5-bdbf-4345-95c9-e1807baf9bdd tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:00:11.025488 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-2a6706d5-bdbf-4345-95c9-e1807baf9bdd tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 2ae0714c-5e4b-4c64-b23c-0a0a9e6a4609] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:00:11.036687 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2a6706d5-bdbf-4345-95c9-e1807baf9bdd tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:11.037318 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2a6706d5-bdbf-4345-95c9-e1807baf9bdd tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:11.038149 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2a6706d5-bdbf-4345-95c9-e1807baf9bdd tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:11.038605 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2a6706d5-bdbf-4345-95c9-e1807baf9bdd tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:11.171065 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-2a6706d5-bdbf-4345-95c9-e1807baf9bdd tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:00:11.179505 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2a6706d5-bdbf-4345-95c9-e1807baf9bdd tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/2ae0714c-5e4b-4c64-b23c-0a0a9e6a4609" status: 200 len: 1314 microversion: 2.1 time: 0.163790 Jul 23 22:00:11.180085 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3004/5614] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:00:11 2022] GET /compute/v2.1/servers/2ae0714c-5e4b-4c64-b23c-0a0a9e6a4609 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:00:12.206051 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e27025fc-f1dd-4fe3-aedf-9f7a0c30c578 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:00:12.207317 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e27025fc-f1dd-4fe3-aedf-9f7a0c30c578 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 2ae0714c-5e4b-4c64-b23c-0a0a9e6a4609] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:00:12.215249 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e27025fc-f1dd-4fe3-aedf-9f7a0c30c578 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:12.215698 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e27025fc-f1dd-4fe3-aedf-9f7a0c30c578 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:12.216503 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e27025fc-f1dd-4fe3-aedf-9f7a0c30c578 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:12.216933 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e27025fc-f1dd-4fe3-aedf-9f7a0c30c578 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:12.359469 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e27025fc-f1dd-4fe3-aedf-9f7a0c30c578 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:00:12.367814 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e27025fc-f1dd-4fe3-aedf-9f7a0c30c578 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/2ae0714c-5e4b-4c64-b23c-0a0a9e6a4609" status: 200 len: 1314 microversion: 2.1 time: 0.168509 Jul 23 22:00:12.368391 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3005/5615] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:00:12 2022] GET /compute/v2.1/servers/2ae0714c-5e4b-4c64-b23c-0a0a9e6a4609 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:00:13.392238 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0fbe12df-2c70-4135-872a-a53bd8695585 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:00:13.393077 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-0fbe12df-2c70-4135-872a-a53bd8695585 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 2ae0714c-5e4b-4c64-b23c-0a0a9e6a4609] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:00:13.401672 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0fbe12df-2c70-4135-872a-a53bd8695585 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:13.402171 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0fbe12df-2c70-4135-872a-a53bd8695585 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:13.402952 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0fbe12df-2c70-4135-872a-a53bd8695585 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:13.403391 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0fbe12df-2c70-4135-872a-a53bd8695585 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:13.536072 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-0fbe12df-2c70-4135-872a-a53bd8695585 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:00:13.546173 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-0fbe12df-2c70-4135-872a-a53bd8695585 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/2ae0714c-5e4b-4c64-b23c-0a0a9e6a4609" status: 200 len: 1314 microversion: 2.1 time: 0.159330 Jul 23 22:00:13.546764 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3006/5616] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:00:13 2022] GET /compute/v2.1/servers/2ae0714c-5e4b-4c64-b23c-0a0a9e6a4609 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:00:14.564372 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-67e20f0a-c8cc-4f8c-93e0-2b6cd5bb77c0 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:00:14.565001 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-67e20f0a-c8cc-4f8c-93e0-2b6cd5bb77c0 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 2ae0714c-5e4b-4c64-b23c-0a0a9e6a4609] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:00:14.573037 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-67e20f0a-c8cc-4f8c-93e0-2b6cd5bb77c0 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:14.573500 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-67e20f0a-c8cc-4f8c-93e0-2b6cd5bb77c0 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:14.574405 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-67e20f0a-c8cc-4f8c-93e0-2b6cd5bb77c0 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:14.574780 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-67e20f0a-c8cc-4f8c-93e0-2b6cd5bb77c0 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:14.715571 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-67e20f0a-c8cc-4f8c-93e0-2b6cd5bb77c0 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:00:14.723913 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-67e20f0a-c8cc-4f8c-93e0-2b6cd5bb77c0 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/2ae0714c-5e4b-4c64-b23c-0a0a9e6a4609" status: 200 len: 1314 microversion: 2.1 time: 0.163848 Jul 23 22:00:14.724492 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3007/5617] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:00:14 2022] GET /compute/v2.1/servers/2ae0714c-5e4b-4c64-b23c-0a0a9e6a4609 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:00:15.745245 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6b7af160-708f-4381-b39f-ab2e84480f8c tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:00:15.746347 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6b7af160-708f-4381-b39f-ab2e84480f8c tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 2ae0714c-5e4b-4c64-b23c-0a0a9e6a4609] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:00:15.757931 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6b7af160-708f-4381-b39f-ab2e84480f8c tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:15.758729 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6b7af160-708f-4381-b39f-ab2e84480f8c tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:15.760017 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6b7af160-708f-4381-b39f-ab2e84480f8c tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:15.760764 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6b7af160-708f-4381-b39f-ab2e84480f8c tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:15.898697 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6b7af160-708f-4381-b39f-ab2e84480f8c tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:00:15.907227 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6b7af160-708f-4381-b39f-ab2e84480f8c tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/2ae0714c-5e4b-4c64-b23c-0a0a9e6a4609" status: 200 len: 1314 microversion: 2.1 time: 0.168945 Jul 23 22:00:15.907853 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3008/5618] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:00:15 2022] GET /compute/v2.1/servers/2ae0714c-5e4b-4c64-b23c-0a0a9e6a4609 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:00:16.540871 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-0e5a40ad-6cb8-44c9-aecd-93ad7527f6be req-9bd09aa7-6e14-4962-b3df-ab7afaccda3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ae0714c-5e4b-4c64-b23c-0a0a9e6a4609", "name": "network-vif-plugged", "status": "completed", "tag": "2d41063e-a18d-4d71-bbe1-099835fea2dd"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:00:16.550194 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-0e5a40ad-6cb8-44c9-aecd-93ad7527f6be req-9bd09aa7-6e14-4962-b3df-ab7afaccda3d service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:16.550688 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-0e5a40ad-6cb8-44c9-aecd-93ad7527f6be req-9bd09aa7-6e14-4962-b3df-ab7afaccda3d service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:16.563363 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-0e5a40ad-6cb8-44c9-aecd-93ad7527f6be req-9bd09aa7-6e14-4962-b3df-ab7afaccda3d service nova] Creating event network-vif-plugged:2d41063e-a18d-4d71-bbe1-099835fea2dd for instance 2ae0714c-5e4b-4c64-b23c-0a0a9e6a4609 on nch1-master-1 Jul 23 22:00:16.568230 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-0e5a40ad-6cb8-44c9-aecd-93ad7527f6be req-9bd09aa7-6e14-4962-b3df-ab7afaccda3d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031265 Jul 23 22:00:16.568906 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3009/5619] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:00:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 22:00:16.930259 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3c6e346c-b919-488b-9282-d3317da09798 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:00:16.931418 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-3c6e346c-b919-488b-9282-d3317da09798 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 2ae0714c-5e4b-4c64-b23c-0a0a9e6a4609] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:00:16.942182 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3c6e346c-b919-488b-9282-d3317da09798 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:16.942941 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3c6e346c-b919-488b-9282-d3317da09798 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:16.944237 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3c6e346c-b919-488b-9282-d3317da09798 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:16.944975 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3c6e346c-b919-488b-9282-d3317da09798 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:17.084431 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-3c6e346c-b919-488b-9282-d3317da09798 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:00:17.092635 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-3c6e346c-b919-488b-9282-d3317da09798 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/2ae0714c-5e4b-4c64-b23c-0a0a9e6a4609" status: 200 len: 1314 microversion: 2.1 time: 0.170981 Jul 23 22:00:17.093214 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3010/5620] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:00:16 2022] GET /compute/v2.1/servers/2ae0714c-5e4b-4c64-b23c-0a0a9e6a4609 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:00:18.114656 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-bd43a2f8-955d-4eb1-bd41-631dfa8790f4 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:00:18.115748 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-bd43a2f8-955d-4eb1-bd41-631dfa8790f4 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 2ae0714c-5e4b-4c64-b23c-0a0a9e6a4609] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:00:18.118830 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:00:18.119990 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=8 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:00:18.131221 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bd43a2f8-955d-4eb1-bd41-631dfa8790f4 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:18.131995 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bd43a2f8-955d-4eb1-bd41-631dfa8790f4 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:18.133284 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bd43a2f8-955d-4eb1-bd41-631dfa8790f4 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:18.134081 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bd43a2f8-955d-4eb1-bd41-631dfa8790f4 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:18.275173 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-bd43a2f8-955d-4eb1-bd41-631dfa8790f4 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:00:18.283131 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-bd43a2f8-955d-4eb1-bd41-631dfa8790f4 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/2ae0714c-5e4b-4c64-b23c-0a0a9e6a4609" status: 200 len: 1500 microversion: 2.1 time: 0.175232 Jul 23 22:00:18.283725 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3011/5621] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:00:18 2022] GET /compute/v2.1/servers/2ae0714c-5e4b-4c64-b23c-0a0a9e6a4609 => generated 1500 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:00:18.299398 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b8fa08d3-2781-4518-8159-d3cc2ec8a2f2 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:00:18.299936 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b8fa08d3-2781-4518-8159-d3cc2ec8a2f2 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 2ae0714c-5e4b-4c64-b23c-0a0a9e6a4609] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:00:18.305977 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b8fa08d3-2781-4518-8159-d3cc2ec8a2f2 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:18.306443 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b8fa08d3-2781-4518-8159-d3cc2ec8a2f2 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:18.307217 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b8fa08d3-2781-4518-8159-d3cc2ec8a2f2 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:18.307663 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b8fa08d3-2781-4518-8159-d3cc2ec8a2f2 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:18.462982 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.network.security_group_api [None req-b8fa08d3-2781-4518-8159-d3cc2ec8a2f2 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Removing security group 6fa3e155-e42d-4ba6-81ba-68051da70038 from port 2d41063e-a18d-4d71-bbe1-099835fea2dd Jul 23 22:00:18.789186 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b8fa08d3-2781-4518-8159-d3cc2ec8a2f2 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "POST /compute/v2.1/servers/2ae0714c-5e4b-4c64-b23c-0a0a9e6a4609/action" status: 202 len: 0 microversion: 2.1 time: 0.493341 Jul 23 22:00:18.790006 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3012/5622] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 22:00:18 2022] POST /compute/v2.1/servers/2ae0714c-5e4b-4c64-b23c-0a0a9e6a4609/action => generated 0 bytes in 495 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 22:00:18.798131 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-fc2a27db-b8d0-42ae-8b6b-535a75092af9 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:00:18.798922 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-fc2a27db-b8d0-42ae-8b6b-535a75092af9 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 2ae0714c-5e4b-4c64-b23c-0a0a9e6a4609] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:00:18.807987 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fc2a27db-b8d0-42ae-8b6b-535a75092af9 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:18.808455 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fc2a27db-b8d0-42ae-8b6b-535a75092af9 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:18.809391 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fc2a27db-b8d0-42ae-8b6b-535a75092af9 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:18.809989 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fc2a27db-b8d0-42ae-8b6b-535a75092af9 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:18.909706 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-fc2a27db-b8d0-42ae-8b6b-535a75092af9 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:00:18.918451 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-fc2a27db-b8d0-42ae-8b6b-535a75092af9 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/2ae0714c-5e4b-4c64-b23c-0a0a9e6a4609" status: 200 len: 1458 microversion: 2.1 time: 0.123498 Jul 23 22:00:18.919437 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3013/5623] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:00:18 2022] GET /compute/v2.1/servers/2ae0714c-5e4b-4c64-b23c-0a0a9e6a4609 => generated 1458 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:00:18.924219 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-cc2a1b97-906c-4a3c-b3dd-1dad41dfedfe req-510a2ee8-cecd-4355-8545-57673ebf4967 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ae0714c-5e4b-4c64-b23c-0a0a9e6a4609", "tag": "2d41063e-a18d-4d71-bbe1-099835fea2dd"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:00:18.933149 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-cc2a1b97-906c-4a3c-b3dd-1dad41dfedfe req-510a2ee8-cecd-4355-8545-57673ebf4967 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:18.933654 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-cc2a1b97-906c-4a3c-b3dd-1dad41dfedfe req-510a2ee8-cecd-4355-8545-57673ebf4967 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:18.945708 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-cc2a1b97-906c-4a3c-b3dd-1dad41dfedfe req-510a2ee8-cecd-4355-8545-57673ebf4967 service nova] Creating event network-changed:2d41063e-a18d-4d71-bbe1-099835fea2dd for instance 2ae0714c-5e4b-4c64-b23c-0a0a9e6a4609 on nch1-master-1 Jul 23 22:00:18.950977 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-cc2a1b97-906c-4a3c-b3dd-1dad41dfedfe req-510a2ee8-cecd-4355-8545-57673ebf4967 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030270 Jul 23 22:00:18.952162 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3014/5624] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:00:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:00:18.957420 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b35ceeca-c461-4c04-b277-2c94c155cc2c tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:00:18.958158 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b35ceeca-c461-4c04-b277-2c94c155cc2c tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:00:18.964997 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b35ceeca-c461-4c04-b277-2c94c155cc2c tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:18.965455 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b35ceeca-c461-4c04-b277-2c94c155cc2c tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:18.966282 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b35ceeca-c461-4c04-b277-2c94c155cc2c tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:18.966724 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b35ceeca-c461-4c04-b277-2c94c155cc2c tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:18.988569 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=100 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:00:19.129805 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b35ceeca-c461-4c04-b277-2c94c155cc2c tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:00:19.138566 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b35ceeca-c461-4c04-b277-2c94c155cc2c tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1670 microversion: 2.1 time: 0.185198 Jul 23 22:00:19.139167 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3015/5625] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:00:18 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1670 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:00:19.158230 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-87b16501-4ab8-4d61-a615-ee0b3c67e248 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:00:19.158903 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-87b16501-4ab8-4d61-a615-ee0b3c67e248 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:00:19.165068 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-87b16501-4ab8-4d61-a615-ee0b3c67e248 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:19.165521 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-87b16501-4ab8-4d61-a615-ee0b3c67e248 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:19.166320 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-87b16501-4ab8-4d61-a615-ee0b3c67e248 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:19.166758 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-87b16501-4ab8-4d61-a615-ee0b3c67e248 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:19.301124 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-87b16501-4ab8-4d61-a615-ee0b3c67e248 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:00:19.309155 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-87b16501-4ab8-4d61-a615-ee0b3c67e248 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1670 microversion: 2.1 time: 0.154803 Jul 23 22:00:19.309742 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3016/5626] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:00:19 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1670 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:00:19.325172 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c7304e23-b02f-4e2b-8338-2977795e206b tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:00:19.325782 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c7304e23-b02f-4e2b-8338-2977795e206b tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:00:19.332267 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c7304e23-b02f-4e2b-8338-2977795e206b tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:19.332723 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c7304e23-b02f-4e2b-8338-2977795e206b tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:19.333495 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c7304e23-b02f-4e2b-8338-2977795e206b tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:19.333959 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c7304e23-b02f-4e2b-8338-2977795e206b tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:19.472540 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c7304e23-b02f-4e2b-8338-2977795e206b tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:00:19.480387 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c7304e23-b02f-4e2b-8338-2977795e206b tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1670 microversion: 2.1 time: 0.158948 Jul 23 22:00:19.481041 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3017/5627] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:00:19 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1670 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:00:19.497510 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6950e620-e22c-40ec-b9b2-e167f49faf62 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:00:19.498153 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6950e620-e22c-40ec-b9b2-e167f49faf62 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:00:19.504493 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6950e620-e22c-40ec-b9b2-e167f49faf62 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:19.504946 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6950e620-e22c-40ec-b9b2-e167f49faf62 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:19.505722 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6950e620-e22c-40ec-b9b2-e167f49faf62 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:19.506194 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6950e620-e22c-40ec-b9b2-e167f49faf62 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:19.637850 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6950e620-e22c-40ec-b9b2-e167f49faf62 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:00:19.645884 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6950e620-e22c-40ec-b9b2-e167f49faf62 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1670 microversion: 2.1 time: 0.152442 Jul 23 22:00:19.646484 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3018/5628] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:00:19 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1670 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:00:19.702546 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-85bb7f0d-0607-4ce9-bb1c-86ab7881c55f tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1398363327", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "networks": [{"uuid": "6770b9e7-826f-46ba-879d-e25a87aab2e5"}]}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:00:19.760554 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-85bb7f0d-0607-4ce9-bb1c-86ab7881c55f tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] validate_networks() for [('6770b9e7-826f-46ba-879d-e25a87aab2e5', None, None, None, None, None)] {{(pid=131320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 22:00:20.497067 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-85bb7f0d-0607-4ce9-bb1c-86ab7881c55f tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 22:00:20.497657 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-85bb7f0d-0607-4ce9-bb1c-86ab7881c55f tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 22:00:20.498270 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-85bb7f0d-0607-4ce9-bb1c-86ab7881c55f tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 22:00:20.498880 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-85bb7f0d-0607-4ce9-bb1c-86ab7881c55f tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 22:00:20.499408 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-85bb7f0d-0607-4ce9-bb1c-86ab7881c55f tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 22:00:20.513566 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-85bb7f0d-0607-4ce9-bb1c-86ab7881c55f tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:20.514268 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-85bb7f0d-0607-4ce9-bb1c-86ab7881c55f tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:20.515086 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-85bb7f0d-0607-4ce9-bb1c-86ab7881c55f tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:20.515534 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-85bb7f0d-0607-4ce9-bb1c-86ab7881c55f tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:20.533108 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-85bb7f0d-0607-4ce9-bb1c-86ab7881c55f tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Getting quotas for project 7f624e0dec4a4f64b1d3580e60867c41. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 22:00:20.538701 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-85bb7f0d-0607-4ce9-bb1c-86ab7881c55f tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Getting quotas for user b5408fb2f4044c6d88527222b190230d and project 7f624e0dec4a4f64b1d3580e60867c41. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 22:00:20.551696 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-85bb7f0d-0607-4ce9-bb1c-86ab7881c55f tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Going to run 1 instances... {{(pid=131320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 22:00:20.554062 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-85bb7f0d-0607-4ce9-bb1c-86ab7881c55f tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 8c21d818-d5ad-4c50-a7ca-a2831cdc6b60] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 22:00:20.599259 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-85bb7f0d-0607-4ce9-bb1c-86ab7881c55f tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.900903 Jul 23 22:00:20.599922 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3019/5629] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 22:00:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 902 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 23 22:00:20.610276 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1ab1cf90-4861-4a00-87d7-66d6776f439a tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:00:20.610933 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1ab1cf90-4861-4a00-87d7-66d6776f439a tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 8c21d818-d5ad-4c50-a7ca-a2831cdc6b60] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:00:20.674356 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-1ab1cf90-4861-4a00-87d7-66d6776f439a tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:00:20.681424 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1ab1cf90-4861-4a00-87d7-66d6776f439a tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/8c21d818-d5ad-4c50-a7ca-a2831cdc6b60" status: 200 len: 1215 microversion: 2.1 time: 0.075158 Jul 23 22:00:20.682034 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3020/5630] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:00:20 2022] GET /compute/v2.1/servers/8c21d818-d5ad-4c50-a7ca-a2831cdc6b60 => generated 1215 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:00:21.699985 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ecc32849-56f9-4f7d-af59-e56ebd06d8d4 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:00:21.700671 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ecc32849-56f9-4f7d-af59-e56ebd06d8d4 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 8c21d818-d5ad-4c50-a7ca-a2831cdc6b60] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:00:21.708256 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ecc32849-56f9-4f7d-af59-e56ebd06d8d4 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:21.708713 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ecc32849-56f9-4f7d-af59-e56ebd06d8d4 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:21.709588 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ecc32849-56f9-4f7d-af59-e56ebd06d8d4 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:21.710069 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ecc32849-56f9-4f7d-af59-e56ebd06d8d4 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:21.787529 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ecc32849-56f9-4f7d-af59-e56ebd06d8d4 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:00:21.795309 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ecc32849-56f9-4f7d-af59-e56ebd06d8d4 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/8c21d818-d5ad-4c50-a7ca-a2831cdc6b60" status: 200 len: 1273 microversion: 2.1 time: 0.099647 Jul 23 22:00:21.795922 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3021/5631] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:00:21 2022] GET /compute/v2.1/servers/8c21d818-d5ad-4c50-a7ca-a2831cdc6b60 => generated 1273 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:00:22.812759 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2b2a3c73-35a0-48a0-903e-dc75ee8ffa14 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:00:22.814869 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-2b2a3c73-35a0-48a0-903e-dc75ee8ffa14 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 8c21d818-d5ad-4c50-a7ca-a2831cdc6b60] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:00:22.823236 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2b2a3c73-35a0-48a0-903e-dc75ee8ffa14 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:22.823773 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2b2a3c73-35a0-48a0-903e-dc75ee8ffa14 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:22.824616 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2b2a3c73-35a0-48a0-903e-dc75ee8ffa14 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:22.825261 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2b2a3c73-35a0-48a0-903e-dc75ee8ffa14 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:23.118872 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-2b2a3c73-35a0-48a0-903e-dc75ee8ffa14 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:00:23.126707 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2b2a3c73-35a0-48a0-903e-dc75ee8ffa14 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/8c21d818-d5ad-4c50-a7ca-a2831cdc6b60" status: 200 len: 1315 microversion: 2.1 time: 0.317931 Jul 23 22:00:23.127330 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3022/5632] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:00:22 2022] GET /compute/v2.1/servers/8c21d818-d5ad-4c50-a7ca-a2831cdc6b60 => generated 1315 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:00:23.132458 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-934ab4d8-dde0-43f7-ad36-9a7926b5bdd3 req-9b062f13-22ae-4b2a-94e3-980cd86d5a04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c21d818-d5ad-4c50-a7ca-a2831cdc6b60", "tag": "a788d24e-c212-4180-ab21-a2ffd84939a1"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:00:23.140672 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-934ab4d8-dde0-43f7-ad36-9a7926b5bdd3 req-9b062f13-22ae-4b2a-94e3-980cd86d5a04 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:23.141105 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-934ab4d8-dde0-43f7-ad36-9a7926b5bdd3 req-9b062f13-22ae-4b2a-94e3-980cd86d5a04 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:23.152129 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-934ab4d8-dde0-43f7-ad36-9a7926b5bdd3 req-9b062f13-22ae-4b2a-94e3-980cd86d5a04 service nova] Creating event network-changed:a788d24e-c212-4180-ab21-a2ffd84939a1 for instance 8c21d818-d5ad-4c50-a7ca-a2831cdc6b60 on nch2-master-1 Jul 23 22:00:23.156987 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-934ab4d8-dde0-43f7-ad36-9a7926b5bdd3 req-9b062f13-22ae-4b2a-94e3-980cd86d5a04 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028590 Jul 23 22:00:23.157603 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3023/5633] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:00:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:00:24.150287 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f25920db-d292-4353-a9d6-d23aab664137 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:00:24.151324 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f25920db-d292-4353-a9d6-d23aab664137 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 8c21d818-d5ad-4c50-a7ca-a2831cdc6b60] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:00:24.162141 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f25920db-d292-4353-a9d6-d23aab664137 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:24.162900 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f25920db-d292-4353-a9d6-d23aab664137 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:24.164199 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f25920db-d292-4353-a9d6-d23aab664137 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:24.164887 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f25920db-d292-4353-a9d6-d23aab664137 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:24.403378 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f25920db-d292-4353-a9d6-d23aab664137 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:00:24.411424 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f25920db-d292-4353-a9d6-d23aab664137 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/8c21d818-d5ad-4c50-a7ca-a2831cdc6b60" status: 200 len: 1315 microversion: 2.1 time: 0.269909 Jul 23 22:00:24.412028 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3024/5634] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:00:24 2022] GET /compute/v2.1/servers/8c21d818-d5ad-4c50-a7ca-a2831cdc6b60 => generated 1315 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:00:25.433198 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6388c71e-2d8a-4d0c-98a3-4810af9c0db8 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:00:25.434395 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6388c71e-2d8a-4d0c-98a3-4810af9c0db8 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 8c21d818-d5ad-4c50-a7ca-a2831cdc6b60] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:00:25.442425 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6388c71e-2d8a-4d0c-98a3-4810af9c0db8 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:25.442889 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6388c71e-2d8a-4d0c-98a3-4810af9c0db8 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:25.443692 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6388c71e-2d8a-4d0c-98a3-4810af9c0db8 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:25.444134 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6388c71e-2d8a-4d0c-98a3-4810af9c0db8 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:25.573147 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6388c71e-2d8a-4d0c-98a3-4810af9c0db8 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:00:25.581427 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6388c71e-2d8a-4d0c-98a3-4810af9c0db8 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/8c21d818-d5ad-4c50-a7ca-a2831cdc6b60" status: 200 len: 1315 microversion: 2.1 time: 0.155192 Jul 23 22:00:25.582050 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3025/5635] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:00:25 2022] GET /compute/v2.1/servers/8c21d818-d5ad-4c50-a7ca-a2831cdc6b60 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:00:26.598617 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8c68af37-16e0-42dd-a5d3-1f4ac51267a2 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:00:26.599325 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8c68af37-16e0-42dd-a5d3-1f4ac51267a2 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 8c21d818-d5ad-4c50-a7ca-a2831cdc6b60] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:00:26.607196 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8c68af37-16e0-42dd-a5d3-1f4ac51267a2 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:26.607775 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8c68af37-16e0-42dd-a5d3-1f4ac51267a2 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:26.608566 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8c68af37-16e0-42dd-a5d3-1f4ac51267a2 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:26.609027 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8c68af37-16e0-42dd-a5d3-1f4ac51267a2 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:26.743709 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8c68af37-16e0-42dd-a5d3-1f4ac51267a2 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:00:26.751804 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8c68af37-16e0-42dd-a5d3-1f4ac51267a2 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/8c21d818-d5ad-4c50-a7ca-a2831cdc6b60" status: 200 len: 1315 microversion: 2.1 time: 0.157142 Jul 23 22:00:26.752406 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3026/5636] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:00:26 2022] GET /compute/v2.1/servers/8c21d818-d5ad-4c50-a7ca-a2831cdc6b60 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:00:27.772855 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f6466caa-d7c1-4ecf-a4d2-6b856fdf48d0 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:00:27.774050 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f6466caa-d7c1-4ecf-a4d2-6b856fdf48d0 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 8c21d818-d5ad-4c50-a7ca-a2831cdc6b60] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:00:27.783456 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f6466caa-d7c1-4ecf-a4d2-6b856fdf48d0 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:27.783915 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f6466caa-d7c1-4ecf-a4d2-6b856fdf48d0 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:27.784696 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f6466caa-d7c1-4ecf-a4d2-6b856fdf48d0 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:27.785138 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f6466caa-d7c1-4ecf-a4d2-6b856fdf48d0 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:27.925499 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f6466caa-d7c1-4ecf-a4d2-6b856fdf48d0 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:00:27.937166 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f6466caa-d7c1-4ecf-a4d2-6b856fdf48d0 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/8c21d818-d5ad-4c50-a7ca-a2831cdc6b60" status: 200 len: 1315 microversion: 2.1 time: 0.170606 Jul 23 22:00:27.937993 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3027/5637] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:00:27 2022] GET /compute/v2.1/servers/8c21d818-d5ad-4c50-a7ca-a2831cdc6b60 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:00:28.429450 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-6d88e26b-1d13-42ac-8515-f15cbebd910b req-6881b1f3-d820-4a4e-9ba7-ac2dc348ae61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c21d818-d5ad-4c50-a7ca-a2831cdc6b60", "name": "network-vif-plugged", "status": "completed", "tag": "a788d24e-c212-4180-ab21-a2ffd84939a1"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:00:28.434274 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:00:28.438521 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-6d88e26b-1d13-42ac-8515-f15cbebd910b req-6881b1f3-d820-4a4e-9ba7-ac2dc348ae61 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:28.438964 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-6d88e26b-1d13-42ac-8515-f15cbebd910b req-6881b1f3-d820-4a4e-9ba7-ac2dc348ae61 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:28.451722 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-6d88e26b-1d13-42ac-8515-f15cbebd910b req-6881b1f3-d820-4a4e-9ba7-ac2dc348ae61 service nova] Creating event network-vif-plugged:a788d24e-c212-4180-ab21-a2ffd84939a1 for instance 8c21d818-d5ad-4c50-a7ca-a2831cdc6b60 on nch2-master-1 Jul 23 22:00:28.456529 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-6d88e26b-1d13-42ac-8515-f15cbebd910b req-6881b1f3-d820-4a4e-9ba7-ac2dc348ae61 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030815 Jul 23 22:00:28.457194 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3028/5638] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:00:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 22:00:28.960931 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9ca1c69d-4037-40be-9152-5f30ef1258e7 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:00:28.962131 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-9ca1c69d-4037-40be-9152-5f30ef1258e7 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 8c21d818-d5ad-4c50-a7ca-a2831cdc6b60] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:00:28.971056 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9ca1c69d-4037-40be-9152-5f30ef1258e7 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:28.971511 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9ca1c69d-4037-40be-9152-5f30ef1258e7 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:28.972342 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9ca1c69d-4037-40be-9152-5f30ef1258e7 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:28.972735 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9ca1c69d-4037-40be-9152-5f30ef1258e7 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:29.104977 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-9ca1c69d-4037-40be-9152-5f30ef1258e7 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:00:29.112719 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9ca1c69d-4037-40be-9152-5f30ef1258e7 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/8c21d818-d5ad-4c50-a7ca-a2831cdc6b60" status: 200 len: 1315 microversion: 2.1 time: 0.160515 Jul 23 22:00:29.113324 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3029/5639] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:00:28 2022] GET /compute/v2.1/servers/8c21d818-d5ad-4c50-a7ca-a2831cdc6b60 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:00:30.133939 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-290b8141-f937-43c7-912a-cdb33c644c62 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:00:30.135221 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-290b8141-f937-43c7-912a-cdb33c644c62 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 8c21d818-d5ad-4c50-a7ca-a2831cdc6b60] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:00:30.144383 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-290b8141-f937-43c7-912a-cdb33c644c62 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:30.144852 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-290b8141-f937-43c7-912a-cdb33c644c62 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:30.145661 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-290b8141-f937-43c7-912a-cdb33c644c62 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:30.146151 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-290b8141-f937-43c7-912a-cdb33c644c62 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:30.276726 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-290b8141-f937-43c7-912a-cdb33c644c62 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:00:30.284537 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-290b8141-f937-43c7-912a-cdb33c644c62 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/8c21d818-d5ad-4c50-a7ca-a2831cdc6b60" status: 200 len: 1501 microversion: 2.1 time: 0.157215 Jul 23 22:00:30.285120 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3030/5640] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:00:30 2022] GET /compute/v2.1/servers/8c21d818-d5ad-4c50-a7ca-a2831cdc6b60 => generated 1501 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:00:30.300928 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-62f5e0a9-a585-4b04-8f38-1345201bf913 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:00:30.301479 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-62f5e0a9-a585-4b04-8f38-1345201bf913 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 8c21d818-d5ad-4c50-a7ca-a2831cdc6b60] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:00:30.307549 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-62f5e0a9-a585-4b04-8f38-1345201bf913 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:30.308129 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-62f5e0a9-a585-4b04-8f38-1345201bf913 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:30.308984 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-62f5e0a9-a585-4b04-8f38-1345201bf913 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:30.309419 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-62f5e0a9-a585-4b04-8f38-1345201bf913 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:30.379914 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-62f5e0a9-a585-4b04-8f38-1345201bf913 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "POST /compute/v2.1/servers/8c21d818-d5ad-4c50-a7ca-a2831cdc6b60/action" status: 202 len: 0 microversion: 2.1 time: 0.082434 Jul 23 22:00:30.380588 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3031/5641] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 22:00:30 2022] POST /compute/v2.1/servers/8c21d818-d5ad-4c50-a7ca-a2831cdc6b60/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 22:00:30.389194 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-bdb90c0d-90c3-4224-ba90-809628f20497 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:00:30.389833 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-bdb90c0d-90c3-4224-ba90-809628f20497 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 8c21d818-d5ad-4c50-a7ca-a2831cdc6b60] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:00:30.396499 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bdb90c0d-90c3-4224-ba90-809628f20497 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:30.396973 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bdb90c0d-90c3-4224-ba90-809628f20497 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:30.397855 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bdb90c0d-90c3-4224-ba90-809628f20497 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:30.398336 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bdb90c0d-90c3-4224-ba90-809628f20497 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:30.522063 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:00:30.534952 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-bdb90c0d-90c3-4224-ba90-809628f20497 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:00:30.542620 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-bdb90c0d-90c3-4224-ba90-809628f20497 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/8c21d818-d5ad-4c50-a7ca-a2831cdc6b60" status: 200 len: 1506 microversion: 2.1 time: 0.157630 Jul 23 22:00:30.546246 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3032/5642] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:00:30 2022] GET /compute/v2.1/servers/8c21d818-d5ad-4c50-a7ca-a2831cdc6b60 => generated 1506 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:00:31.564205 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-eefc9ddf-ac70-4c8e-9d82-6d91e3e4f6fa tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:00:31.565276 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-eefc9ddf-ac70-4c8e-9d82-6d91e3e4f6fa tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 8c21d818-d5ad-4c50-a7ca-a2831cdc6b60] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:00:31.568331 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=8 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:00:31.578604 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-eefc9ddf-ac70-4c8e-9d82-6d91e3e4f6fa tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:31.579069 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-eefc9ddf-ac70-4c8e-9d82-6d91e3e4f6fa tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:31.579872 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-eefc9ddf-ac70-4c8e-9d82-6d91e3e4f6fa tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:31.580308 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-eefc9ddf-ac70-4c8e-9d82-6d91e3e4f6fa tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:31.722451 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-eefc9ddf-ac70-4c8e-9d82-6d91e3e4f6fa tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:00:31.730898 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-eefc9ddf-ac70-4c8e-9d82-6d91e3e4f6fa tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/8c21d818-d5ad-4c50-a7ca-a2831cdc6b60" status: 200 len: 1486 microversion: 2.1 time: 0.173410 Jul 23 22:00:31.731487 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3033/5643] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:00:31 2022] GET /compute/v2.1/servers/8c21d818-d5ad-4c50-a7ca-a2831cdc6b60 => generated 1486 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:00:31.747256 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-72aaa79b-aba0-43db-b3be-e00b6aeb8958 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:00:31.747806 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-72aaa79b-aba0-43db-b3be-e00b6aeb8958 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 8c21d818-d5ad-4c50-a7ca-a2831cdc6b60] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:00:31.753807 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-72aaa79b-aba0-43db-b3be-e00b6aeb8958 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:31.754294 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-72aaa79b-aba0-43db-b3be-e00b6aeb8958 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:31.755075 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-72aaa79b-aba0-43db-b3be-e00b6aeb8958 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:31.755521 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-72aaa79b-aba0-43db-b3be-e00b6aeb8958 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:31.759373 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:00:31.784660 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.objects.instance [None req-72aaa79b-aba0-43db-b3be-e00b6aeb8958 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lazy-loading 'flavor' on Instance uuid 8c21d818-d5ad-4c50-a7ca-a2831cdc6b60 {{(pid=131320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 22:00:32.060462 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-72aaa79b-aba0-43db-b3be-e00b6aeb8958 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "POST /compute/v2.1/servers/8c21d818-d5ad-4c50-a7ca-a2831cdc6b60/action" status: 202 len: 0 microversion: 2.1 time: 0.316664 Jul 23 22:00:32.061105 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3034/5644] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 22:00:31 2022] POST /compute/v2.1/servers/8c21d818-d5ad-4c50-a7ca-a2831cdc6b60/action => generated 0 bytes in 318 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 22:00:32.069685 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ef817a88-f009-4a44-8e03-88ea2de8400b tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:00:32.070422 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ef817a88-f009-4a44-8e03-88ea2de8400b tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 8c21d818-d5ad-4c50-a7ca-a2831cdc6b60] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:00:32.077172 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ef817a88-f009-4a44-8e03-88ea2de8400b tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:32.077669 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ef817a88-f009-4a44-8e03-88ea2de8400b tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:32.078470 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ef817a88-f009-4a44-8e03-88ea2de8400b tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:32.078969 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ef817a88-f009-4a44-8e03-88ea2de8400b tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:32.220995 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ef817a88-f009-4a44-8e03-88ea2de8400b tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:00:32.228904 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ef817a88-f009-4a44-8e03-88ea2de8400b tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/8c21d818-d5ad-4c50-a7ca-a2831cdc6b60" status: 200 len: 1492 microversion: 2.1 time: 0.163214 Jul 23 22:00:32.229486 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3035/5645] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:00:32 2022] GET /compute/v2.1/servers/8c21d818-d5ad-4c50-a7ca-a2831cdc6b60 => generated 1492 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:00:33.250652 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8d4115b3-925c-4a8e-8b07-1ff5c587b9e7 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:00:33.251385 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8d4115b3-925c-4a8e-8b07-1ff5c587b9e7 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 8c21d818-d5ad-4c50-a7ca-a2831cdc6b60] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:00:33.259602 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8d4115b3-925c-4a8e-8b07-1ff5c587b9e7 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:33.260114 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8d4115b3-925c-4a8e-8b07-1ff5c587b9e7 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:33.260989 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8d4115b3-925c-4a8e-8b07-1ff5c587b9e7 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:33.261485 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8d4115b3-925c-4a8e-8b07-1ff5c587b9e7 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:33.406635 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8d4115b3-925c-4a8e-8b07-1ff5c587b9e7 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:00:33.417645 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8d4115b3-925c-4a8e-8b07-1ff5c587b9e7 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/8c21d818-d5ad-4c50-a7ca-a2831cdc6b60" status: 200 len: 1513 microversion: 2.1 time: 0.173501 Jul 23 22:00:33.418402 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3036/5646] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:00:33 2022] GET /compute/v2.1/servers/8c21d818-d5ad-4c50-a7ca-a2831cdc6b60 => generated 1513 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:00:34.435982 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-21b8068e-7d29-4692-a23d-8060a687c40f tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:00:34.436639 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-21b8068e-7d29-4692-a23d-8060a687c40f tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 8c21d818-d5ad-4c50-a7ca-a2831cdc6b60] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:00:34.443761 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-21b8068e-7d29-4692-a23d-8060a687c40f tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:34.444214 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-21b8068e-7d29-4692-a23d-8060a687c40f tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:34.445231 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-21b8068e-7d29-4692-a23d-8060a687c40f tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:34.445672 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-21b8068e-7d29-4692-a23d-8060a687c40f tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:34.582840 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-21b8068e-7d29-4692-a23d-8060a687c40f tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:00:34.593750 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-21b8068e-7d29-4692-a23d-8060a687c40f tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/8c21d818-d5ad-4c50-a7ca-a2831cdc6b60" status: 200 len: 1508 microversion: 2.1 time: 0.160383 Jul 23 22:00:34.604669 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3037/5647] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:00:34 2022] GET /compute/v2.1/servers/8c21d818-d5ad-4c50-a7ca-a2831cdc6b60 => generated 1508 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:00:35.612982 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-359bd215-2dad-4fe4-9e5d-7f546e5e3078 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:00:35.613667 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-359bd215-2dad-4fe4-9e5d-7f546e5e3078 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 8c21d818-d5ad-4c50-a7ca-a2831cdc6b60] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:00:35.621520 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-359bd215-2dad-4fe4-9e5d-7f546e5e3078 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:35.622026 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-359bd215-2dad-4fe4-9e5d-7f546e5e3078 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:35.622825 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-359bd215-2dad-4fe4-9e5d-7f546e5e3078 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:35.623307 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-359bd215-2dad-4fe4-9e5d-7f546e5e3078 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:35.766872 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-359bd215-2dad-4fe4-9e5d-7f546e5e3078 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:00:35.775033 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-359bd215-2dad-4fe4-9e5d-7f546e5e3078 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/8c21d818-d5ad-4c50-a7ca-a2831cdc6b60" status: 200 len: 1508 microversion: 2.1 time: 0.166368 Jul 23 22:00:35.775740 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3038/5648] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:00:35 2022] GET /compute/v2.1/servers/8c21d818-d5ad-4c50-a7ca-a2831cdc6b60 => generated 1508 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:00:36.458435 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-958ec910-5a1c-4f76-8f78-cbd450c86b03 req-a3e66346-d60d-415a-abb7-d6a34121fc27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c21d818-d5ad-4c50-a7ca-a2831cdc6b60", "name": "network-vif-plugged", "status": "completed", "tag": "a788d24e-c212-4180-ab21-a2ffd84939a1"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:00:36.475075 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-958ec910-5a1c-4f76-8f78-cbd450c86b03 req-a3e66346-d60d-415a-abb7-d6a34121fc27 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:36.477334 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-958ec910-5a1c-4f76-8f78-cbd450c86b03 req-a3e66346-d60d-415a-abb7-d6a34121fc27 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:36.491189 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-958ec910-5a1c-4f76-8f78-cbd450c86b03 req-a3e66346-d60d-415a-abb7-d6a34121fc27 service nova] Creating event network-vif-plugged:a788d24e-c212-4180-ab21-a2ffd84939a1 for instance 8c21d818-d5ad-4c50-a7ca-a2831cdc6b60 on nch2-master-1 Jul 23 22:00:36.504298 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-958ec910-5a1c-4f76-8f78-cbd450c86b03 req-a3e66346-d60d-415a-abb7-d6a34121fc27 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043560 Jul 23 22:00:36.512624 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3039/5649] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:00:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:00:36.793214 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-bab49194-fd49-47a6-8687-023c3b43c199 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:00:36.794030 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-bab49194-fd49-47a6-8687-023c3b43c199 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 8c21d818-d5ad-4c50-a7ca-a2831cdc6b60] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:00:36.805754 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bab49194-fd49-47a6-8687-023c3b43c199 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:36.806172 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bab49194-fd49-47a6-8687-023c3b43c199 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:36.806950 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bab49194-fd49-47a6-8687-023c3b43c199 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:36.807424 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bab49194-fd49-47a6-8687-023c3b43c199 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:36.952304 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-bab49194-fd49-47a6-8687-023c3b43c199 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:00:36.961107 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-bab49194-fd49-47a6-8687-023c3b43c199 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/8c21d818-d5ad-4c50-a7ca-a2831cdc6b60" status: 200 len: 1508 microversion: 2.1 time: 0.172262 Jul 23 22:00:36.961898 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3040/5650] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:00:36 2022] GET /compute/v2.1/servers/8c21d818-d5ad-4c50-a7ca-a2831cdc6b60 => generated 1508 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:00:37.982089 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f21d05c2-06ed-43e2-8f69-69f07938b7b1 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:00:37.982801 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f21d05c2-06ed-43e2-8f69-69f07938b7b1 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 8c21d818-d5ad-4c50-a7ca-a2831cdc6b60] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:00:37.993660 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f21d05c2-06ed-43e2-8f69-69f07938b7b1 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:37.994244 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f21d05c2-06ed-43e2-8f69-69f07938b7b1 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:37.995115 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f21d05c2-06ed-43e2-8f69-69f07938b7b1 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:37.995618 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f21d05c2-06ed-43e2-8f69-69f07938b7b1 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:38.149126 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f21d05c2-06ed-43e2-8f69-69f07938b7b1 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:00:38.157214 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f21d05c2-06ed-43e2-8f69-69f07938b7b1 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/8c21d818-d5ad-4c50-a7ca-a2831cdc6b60" status: 200 len: 1508 microversion: 2.1 time: 0.181148 Jul 23 22:00:38.166922 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3041/5651] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:00:37 2022] GET /compute/v2.1/servers/8c21d818-d5ad-4c50-a7ca-a2831cdc6b60 => generated 1508 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:00:39.175034 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ece6dcf5-232c-4fe0-b49f-171c69742015 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:00:39.175684 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ece6dcf5-232c-4fe0-b49f-171c69742015 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 8c21d818-d5ad-4c50-a7ca-a2831cdc6b60] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:00:39.183258 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ece6dcf5-232c-4fe0-b49f-171c69742015 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:39.184017 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ece6dcf5-232c-4fe0-b49f-171c69742015 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:39.185028 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ece6dcf5-232c-4fe0-b49f-171c69742015 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:39.185466 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ece6dcf5-232c-4fe0-b49f-171c69742015 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:39.333096 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ece6dcf5-232c-4fe0-b49f-171c69742015 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:00:39.340895 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ece6dcf5-232c-4fe0-b49f-171c69742015 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/8c21d818-d5ad-4c50-a7ca-a2831cdc6b60" status: 200 len: 1508 microversion: 2.1 time: 0.170255 Jul 23 22:00:39.348606 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3042/5652] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:00:39 2022] GET /compute/v2.1/servers/8c21d818-d5ad-4c50-a7ca-a2831cdc6b60 => generated 1508 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:00:40.358956 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3707eaa3-e145-4a68-b902-be46e3e72d45 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:00:40.359930 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-3707eaa3-e145-4a68-b902-be46e3e72d45 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 8c21d818-d5ad-4c50-a7ca-a2831cdc6b60] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:00:40.368155 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3707eaa3-e145-4a68-b902-be46e3e72d45 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:40.368632 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3707eaa3-e145-4a68-b902-be46e3e72d45 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:40.369462 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3707eaa3-e145-4a68-b902-be46e3e72d45 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:40.369957 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3707eaa3-e145-4a68-b902-be46e3e72d45 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:40.517941 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-3707eaa3-e145-4a68-b902-be46e3e72d45 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:00:40.526611 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-3707eaa3-e145-4a68-b902-be46e3e72d45 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/8c21d818-d5ad-4c50-a7ca-a2831cdc6b60" status: 200 len: 1508 microversion: 2.1 time: 0.171845 Jul 23 22:00:40.537275 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3043/5653] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:00:40 2022] GET /compute/v2.1/servers/8c21d818-d5ad-4c50-a7ca-a2831cdc6b60 => generated 1508 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:00:41.543513 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ada53c41-9f0b-49e7-a73a-f573827ecdc7 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:00:41.544197 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ada53c41-9f0b-49e7-a73a-f573827ecdc7 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 8c21d818-d5ad-4c50-a7ca-a2831cdc6b60] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:00:41.553349 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ada53c41-9f0b-49e7-a73a-f573827ecdc7 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:41.554200 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ada53c41-9f0b-49e7-a73a-f573827ecdc7 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:41.555234 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ada53c41-9f0b-49e7-a73a-f573827ecdc7 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:41.555853 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ada53c41-9f0b-49e7-a73a-f573827ecdc7 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:41.701285 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ada53c41-9f0b-49e7-a73a-f573827ecdc7 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:00:41.710038 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ada53c41-9f0b-49e7-a73a-f573827ecdc7 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/8c21d818-d5ad-4c50-a7ca-a2831cdc6b60" status: 200 len: 1508 microversion: 2.1 time: 0.170355 Jul 23 22:00:41.718683 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3044/5654] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:00:41 2022] GET /compute/v2.1/servers/8c21d818-d5ad-4c50-a7ca-a2831cdc6b60 => generated 1508 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:00:42.727890 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-cb6ffc25-6bea-42f8-b2cd-ea69f93520d7 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:00:42.728573 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-cb6ffc25-6bea-42f8-b2cd-ea69f93520d7 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 8c21d818-d5ad-4c50-a7ca-a2831cdc6b60] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:00:42.735996 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cb6ffc25-6bea-42f8-b2cd-ea69f93520d7 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:42.736561 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cb6ffc25-6bea-42f8-b2cd-ea69f93520d7 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:42.737352 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cb6ffc25-6bea-42f8-b2cd-ea69f93520d7 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:42.738684 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cb6ffc25-6bea-42f8-b2cd-ea69f93520d7 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:42.910179 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-cb6ffc25-6bea-42f8-b2cd-ea69f93520d7 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:00:42.918941 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-cb6ffc25-6bea-42f8-b2cd-ea69f93520d7 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/8c21d818-d5ad-4c50-a7ca-a2831cdc6b60" status: 200 len: 1508 microversion: 2.1 time: 0.194963 Jul 23 22:00:42.919613 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3045/5655] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:00:42 2022] GET /compute/v2.1/servers/8c21d818-d5ad-4c50-a7ca-a2831cdc6b60 => generated 1508 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:00:43.936245 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c331ea92-585b-494e-94c2-67471e3e470a tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:00:43.936961 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c331ea92-585b-494e-94c2-67471e3e470a tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 8c21d818-d5ad-4c50-a7ca-a2831cdc6b60] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:00:43.944502 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c331ea92-585b-494e-94c2-67471e3e470a tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:43.944968 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c331ea92-585b-494e-94c2-67471e3e470a tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:43.945754 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c331ea92-585b-494e-94c2-67471e3e470a tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:43.946267 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c331ea92-585b-494e-94c2-67471e3e470a tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:44.103703 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c331ea92-585b-494e-94c2-67471e3e470a tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:00:44.117491 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c331ea92-585b-494e-94c2-67471e3e470a tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/8c21d818-d5ad-4c50-a7ca-a2831cdc6b60" status: 200 len: 1505 microversion: 2.1 time: 0.185233 Jul 23 22:00:44.118163 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3046/5656] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:00:43 2022] GET /compute/v2.1/servers/8c21d818-d5ad-4c50-a7ca-a2831cdc6b60 => generated 1505 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:00:45.141472 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6cec061a-e8dd-4816-be52-2ade0961c573 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:00:45.142608 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6cec061a-e8dd-4816-be52-2ade0961c573 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 8c21d818-d5ad-4c50-a7ca-a2831cdc6b60] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:00:45.154651 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6cec061a-e8dd-4816-be52-2ade0961c573 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:45.155417 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6cec061a-e8dd-4816-be52-2ade0961c573 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:45.156846 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6cec061a-e8dd-4816-be52-2ade0961c573 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:45.157324 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6cec061a-e8dd-4816-be52-2ade0961c573 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:45.295929 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6cec061a-e8dd-4816-be52-2ade0961c573 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:00:45.303961 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6cec061a-e8dd-4816-be52-2ade0961c573 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/8c21d818-d5ad-4c50-a7ca-a2831cdc6b60" status: 200 len: 1505 microversion: 2.1 time: 0.169340 Jul 23 22:00:45.304558 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3047/5657] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:00:45 2022] GET /compute/v2.1/servers/8c21d818-d5ad-4c50-a7ca-a2831cdc6b60 => generated 1505 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:00:46.324890 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b37b4e8e-2ecf-4fb0-884b-232c4eff1893 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:00:46.325599 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b37b4e8e-2ecf-4fb0-884b-232c4eff1893 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 8c21d818-d5ad-4c50-a7ca-a2831cdc6b60] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:00:46.332970 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b37b4e8e-2ecf-4fb0-884b-232c4eff1893 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:46.333426 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b37b4e8e-2ecf-4fb0-884b-232c4eff1893 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:46.334263 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b37b4e8e-2ecf-4fb0-884b-232c4eff1893 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:46.334703 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b37b4e8e-2ecf-4fb0-884b-232c4eff1893 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:46.467103 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b37b4e8e-2ecf-4fb0-884b-232c4eff1893 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:00:46.475664 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b37b4e8e-2ecf-4fb0-884b-232c4eff1893 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/8c21d818-d5ad-4c50-a7ca-a2831cdc6b60" status: 200 len: 1448 microversion: 2.1 time: 0.154796 Jul 23 22:00:46.476227 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3048/5658] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:00:46 2022] GET /compute/v2.1/servers/8c21d818-d5ad-4c50-a7ca-a2831cdc6b60 => generated 1448 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:00:46.480652 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-d2e751dd-02e8-487a-826f-852221871c0b req-5c9174e6-c948-4572-8b0c-e42fa732ffd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c21d818-d5ad-4c50-a7ca-a2831cdc6b60", "name": "network-vif-unplugged", "status": "completed", "tag": "a788d24e-c212-4180-ab21-a2ffd84939a1"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:00:46.489163 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-d2e751dd-02e8-487a-826f-852221871c0b req-5c9174e6-c948-4572-8b0c-e42fa732ffd1 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:46.489614 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-d2e751dd-02e8-487a-826f-852221871c0b req-5c9174e6-c948-4572-8b0c-e42fa732ffd1 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:46.500782 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.compute.server_external_events [req-d2e751dd-02e8-487a-826f-852221871c0b req-5c9174e6-c948-4572-8b0c-e42fa732ffd1 service nova] Unable to find a host for instance 8c21d818-d5ad-4c50-a7ca-a2831cdc6b60. Dropping event network-vif-unplugged {{(pid=131320) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 23 22:00:46.501648 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-d2e751dd-02e8-487a-826f-852221871c0b req-5c9174e6-c948-4572-8b0c-e42fa732ffd1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.024502 Jul 23 22:00:46.502246 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3049/5659] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:00:46 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 25 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 23 22:00:46.506736 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b1e072d2-3049-417a-a687-f1a574ea48e4 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:00:46.507340 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b1e072d2-3049-417a-a687-f1a574ea48e4 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:00:46.513054 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b1e072d2-3049-417a-a687-f1a574ea48e4 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:46.513603 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b1e072d2-3049-417a-a687-f1a574ea48e4 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:46.514413 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b1e072d2-3049-417a-a687-f1a574ea48e4 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:46.514857 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b1e072d2-3049-417a-a687-f1a574ea48e4 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:46.519082 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:00:46.650243 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b1e072d2-3049-417a-a687-f1a574ea48e4 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:00:46.658395 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b1e072d2-3049-417a-a687-f1a574ea48e4 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1670 microversion: 2.1 time: 0.155083 Jul 23 22:00:46.658991 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3050/5660] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:00:46 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1670 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:00:46.679073 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-decc3e93-a04b-41d6-87b3-d3518a630948 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:00:46.679684 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-decc3e93-a04b-41d6-87b3-d3518a630948 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:00:46.685994 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-decc3e93-a04b-41d6-87b3-d3518a630948 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:46.686451 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-decc3e93-a04b-41d6-87b3-d3518a630948 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:46.687220 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-decc3e93-a04b-41d6-87b3-d3518a630948 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:46.687659 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-decc3e93-a04b-41d6-87b3-d3518a630948 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:46.819119 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-decc3e93-a04b-41d6-87b3-d3518a630948 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:00:46.828161 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-decc3e93-a04b-41d6-87b3-d3518a630948 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1670 microversion: 2.1 time: 0.152803 Jul 23 22:00:46.828161 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3051/5661] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:00:46 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1670 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:00:46.846396 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-efc1b981-ea4d-4c1d-b814-ba1a58db9112 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:00:46.847008 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-efc1b981-ea4d-4c1d-b814-ba1a58db9112 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:00:46.853236 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-efc1b981-ea4d-4c1d-b814-ba1a58db9112 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:46.853616 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-efc1b981-ea4d-4c1d-b814-ba1a58db9112 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:46.854427 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-efc1b981-ea4d-4c1d-b814-ba1a58db9112 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:46.854864 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-efc1b981-ea4d-4c1d-b814-ba1a58db9112 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:46.999348 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-efc1b981-ea4d-4c1d-b814-ba1a58db9112 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:00:47.010823 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-efc1b981-ea4d-4c1d-b814-ba1a58db9112 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1670 microversion: 2.1 time: 0.169853 Jul 23 22:00:47.011595 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3052/5662] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:00:46 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1670 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:00:47.029149 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8e6019cf-9073-4e45-b4a2-6c828868e7d3 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:00:47.029773 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8e6019cf-9073-4e45-b4a2-6c828868e7d3 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:00:47.035990 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8e6019cf-9073-4e45-b4a2-6c828868e7d3 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:47.036458 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8e6019cf-9073-4e45-b4a2-6c828868e7d3 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:47.037273 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8e6019cf-9073-4e45-b4a2-6c828868e7d3 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:47.037723 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8e6019cf-9073-4e45-b4a2-6c828868e7d3 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:47.168396 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8e6019cf-9073-4e45-b4a2-6c828868e7d3 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:00:47.176795 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8e6019cf-9073-4e45-b4a2-6c828868e7d3 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1670 microversion: 2.1 time: 0.151622 Jul 23 22:00:47.177408 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3053/5663] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:00:47 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1670 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:00:47.193007 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-741bbb42-5401-47bd-987d-a3c109a673a4 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:00:47.199268 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-741bbb42-5401-47bd-987d-a3c109a673a4 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:47.199730 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-741bbb42-5401-47bd-987d-a3c109a673a4 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:47.223218 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-741bbb42-5401-47bd-987d-a3c109a673a4 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Going to try to stop instance {{(pid=131320) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 23 22:00:47.271818 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-741bbb42-5401-47bd-987d-a3c109a673a4 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "POST /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841/action" status: 202 len: 0 microversion: 2.1 time: 0.082373 Jul 23 22:00:47.272500 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3054/5664] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 22:00:47 2022] POST /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 22:00:47.280838 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-87c89b30-4b4c-4035-8f49-721b88808fe8 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:00:47.281564 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-87c89b30-4b4c-4035-8f49-721b88808fe8 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:00:47.287925 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-87c89b30-4b4c-4035-8f49-721b88808fe8 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:47.288479 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-87c89b30-4b4c-4035-8f49-721b88808fe8 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:47.289305 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-87c89b30-4b4c-4035-8f49-721b88808fe8 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:47.289739 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-87c89b30-4b4c-4035-8f49-721b88808fe8 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:47.428732 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-87c89b30-4b4c-4035-8f49-721b88808fe8 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:00:47.439797 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-87c89b30-4b4c-4035-8f49-721b88808fe8 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1680 microversion: 2.1 time: 0.162948 Jul 23 22:00:47.440394 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3055/5665] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:00:47 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:00:48.460936 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5a75c182-a082-49de-a125-d6f5e4d3e0e8 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:00:48.461999 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5a75c182-a082-49de-a125-d6f5e4d3e0e8 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:00:48.474336 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5a75c182-a082-49de-a125-d6f5e4d3e0e8 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:48.475097 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5a75c182-a082-49de-a125-d6f5e4d3e0e8 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:48.476385 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5a75c182-a082-49de-a125-d6f5e4d3e0e8 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:48.477122 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5a75c182-a082-49de-a125-d6f5e4d3e0e8 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:48.614283 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5a75c182-a082-49de-a125-d6f5e4d3e0e8 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:00:48.622360 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5a75c182-a082-49de-a125-d6f5e4d3e0e8 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1680 microversion: 2.1 time: 0.168135 Jul 23 22:00:48.622918 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3056/5666] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:00:48 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1680 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:00:49.640744 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a8973cad-93a8-4513-9eed-dbc1b7bf200a tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:00:49.641416 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a8973cad-93a8-4513-9eed-dbc1b7bf200a tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:00:49.648707 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a8973cad-93a8-4513-9eed-dbc1b7bf200a tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:49.649166 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a8973cad-93a8-4513-9eed-dbc1b7bf200a tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:49.649981 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a8973cad-93a8-4513-9eed-dbc1b7bf200a tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:49.650464 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a8973cad-93a8-4513-9eed-dbc1b7bf200a tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:49.846725 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a8973cad-93a8-4513-9eed-dbc1b7bf200a tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:00:49.855289 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a8973cad-93a8-4513-9eed-dbc1b7bf200a tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1680 microversion: 2.1 time: 0.218516 Jul 23 22:00:49.855921 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3057/5667] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:00:49 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1680 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:00:50.872636 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9f8de035-7b93-46df-ac5c-ff02c7a05906 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:00:50.873329 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-9f8de035-7b93-46df-ac5c-ff02c7a05906 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:00:50.885753 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9f8de035-7b93-46df-ac5c-ff02c7a05906 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:50.886248 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9f8de035-7b93-46df-ac5c-ff02c7a05906 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:50.887029 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9f8de035-7b93-46df-ac5c-ff02c7a05906 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:50.887470 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9f8de035-7b93-46df-ac5c-ff02c7a05906 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:51.029754 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-9f8de035-7b93-46df-ac5c-ff02c7a05906 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:00:51.038178 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9f8de035-7b93-46df-ac5c-ff02c7a05906 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1680 microversion: 2.1 time: 0.169630 Jul 23 22:00:51.038804 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3058/5668] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:00:50 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1680 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:00:52.056281 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8e10916d-bb23-4ca6-9edc-20ad151f6c21 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:00:52.056775 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8e10916d-bb23-4ca6-9edc-20ad151f6c21 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:00:52.064103 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8e10916d-bb23-4ca6-9edc-20ad151f6c21 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:52.064573 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8e10916d-bb23-4ca6-9edc-20ad151f6c21 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:52.065390 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8e10916d-bb23-4ca6-9edc-20ad151f6c21 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:52.065834 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8e10916d-bb23-4ca6-9edc-20ad151f6c21 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:52.197149 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8e10916d-bb23-4ca6-9edc-20ad151f6c21 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:00:52.205704 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8e10916d-bb23-4ca6-9edc-20ad151f6c21 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1680 microversion: 2.1 time: 0.153623 Jul 23 22:00:52.206503 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3059/5669] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:00:52 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:00:53.229881 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9415143e-7534-4a8d-a20a-5d9235a82e17 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:00:53.230877 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-9415143e-7534-4a8d-a20a-5d9235a82e17 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:00:53.240454 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9415143e-7534-4a8d-a20a-5d9235a82e17 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:53.240917 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9415143e-7534-4a8d-a20a-5d9235a82e17 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:53.241710 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9415143e-7534-4a8d-a20a-5d9235a82e17 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:53.242196 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9415143e-7534-4a8d-a20a-5d9235a82e17 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:53.390943 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-9415143e-7534-4a8d-a20a-5d9235a82e17 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:00:53.399346 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9415143e-7534-4a8d-a20a-5d9235a82e17 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1680 microversion: 2.1 time: 0.176422 Jul 23 22:00:53.399920 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3060/5670] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:00:53 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1680 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:00:54.417093 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-114392fb-e2fe-4e28-b117-50eeb6d0b27e tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:00:54.417796 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-114392fb-e2fe-4e28-b117-50eeb6d0b27e tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:00:54.425508 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-114392fb-e2fe-4e28-b117-50eeb6d0b27e tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:54.425997 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-114392fb-e2fe-4e28-b117-50eeb6d0b27e tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:54.426778 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-114392fb-e2fe-4e28-b117-50eeb6d0b27e tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:54.427220 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-114392fb-e2fe-4e28-b117-50eeb6d0b27e tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:54.569039 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-114392fb-e2fe-4e28-b117-50eeb6d0b27e tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:00:54.577065 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-114392fb-e2fe-4e28-b117-50eeb6d0b27e tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1680 microversion: 2.1 time: 0.164011 Jul 23 22:00:54.577666 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3061/5671] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:00:54 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:00:55.595232 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-df9d9c81-4172-4522-8463-2f317657cc98 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:00:55.595981 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-df9d9c81-4172-4522-8463-2f317657cc98 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:00:55.603307 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-df9d9c81-4172-4522-8463-2f317657cc98 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:55.603756 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-df9d9c81-4172-4522-8463-2f317657cc98 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:55.604547 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-df9d9c81-4172-4522-8463-2f317657cc98 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:55.604960 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-df9d9c81-4172-4522-8463-2f317657cc98 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:55.736180 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-df9d9c81-4172-4522-8463-2f317657cc98 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:00:55.747164 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-df9d9c81-4172-4522-8463-2f317657cc98 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1680 microversion: 2.1 time: 0.156116 Jul 23 22:00:55.747946 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3062/5672] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:00:55 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:00:56.769552 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a13ce562-02a9-426b-9824-befa72988d27 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:00:56.770505 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a13ce562-02a9-426b-9824-befa72988d27 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:00:56.779637 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a13ce562-02a9-426b-9824-befa72988d27 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:56.780208 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a13ce562-02a9-426b-9824-befa72988d27 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:56.781181 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a13ce562-02a9-426b-9824-befa72988d27 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:56.781736 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a13ce562-02a9-426b-9824-befa72988d27 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:56.923962 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a13ce562-02a9-426b-9824-befa72988d27 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:00:56.932067 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a13ce562-02a9-426b-9824-befa72988d27 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1680 microversion: 2.1 time: 0.169054 Jul 23 22:00:56.932665 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3063/5673] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:00:56 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1680 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:00:57.953366 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-47cc0517-85a3-4b22-9115-e7ae08989940 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:00:57.954512 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-47cc0517-85a3-4b22-9115-e7ae08989940 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:00:57.966576 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-47cc0517-85a3-4b22-9115-e7ae08989940 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:57.967333 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-47cc0517-85a3-4b22-9115-e7ae08989940 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:57.969009 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-47cc0517-85a3-4b22-9115-e7ae08989940 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:57.969752 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-47cc0517-85a3-4b22-9115-e7ae08989940 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:58.100357 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-47cc0517-85a3-4b22-9115-e7ae08989940 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:00:58.108310 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-47cc0517-85a3-4b22-9115-e7ae08989940 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1657 microversion: 2.1 time: 0.161624 Jul 23 22:00:58.108910 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3064/5674] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:00:57 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1657 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:00:58.124426 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f232df5b-ec6a-4cc6-aa1a-772e18f06281 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:00:58.130734 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f232df5b-ec6a-4cc6-aa1a-772e18f06281 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:58.131205 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f232df5b-ec6a-4cc6-aa1a-772e18f06281 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:58.162354 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f232df5b-ec6a-4cc6-aa1a-772e18f06281 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Going to try to start instance {{(pid=131320) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 23 22:00:58.166684 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:00:58.207616 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f232df5b-ec6a-4cc6-aa1a-772e18f06281 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "POST /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841/action" status: 202 len: 0 microversion: 2.1 time: 0.086645 Jul 23 22:00:58.208211 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3065/5675] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 22:00:58 2022] POST /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 22:00:58.216842 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3d66b453-2afe-43bb-af77-30427fd9c726 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:00:58.217799 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-3d66b453-2afe-43bb-af77-30427fd9c726 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:00:58.224488 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3d66b453-2afe-43bb-af77-30427fd9c726 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:58.224921 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3d66b453-2afe-43bb-af77-30427fd9c726 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:58.225711 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3d66b453-2afe-43bb-af77-30427fd9c726 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:58.226176 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3d66b453-2afe-43bb-af77-30427fd9c726 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:58.449752 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-3d66b453-2afe-43bb-af77-30427fd9c726 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:00:58.458023 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-3d66b453-2afe-43bb-af77-30427fd9c726 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1666 microversion: 2.1 time: 0.245222 Jul 23 22:00:58.458613 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3066/5676] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:00:58 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1666 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:00:59.476524 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c0461d3e-2a35-4fb6-9e07-8e52eac38a44 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:00:59.477126 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c0461d3e-2a35-4fb6-9e07-8e52eac38a44 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:00:59.480094 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=77 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:00:59.486120 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c0461d3e-2a35-4fb6-9e07-8e52eac38a44 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:59.486582 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c0461d3e-2a35-4fb6-9e07-8e52eac38a44 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:59.487358 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c0461d3e-2a35-4fb6-9e07-8e52eac38a44 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:00:59.487799 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c0461d3e-2a35-4fb6-9e07-8e52eac38a44 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:00:59.624357 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c0461d3e-2a35-4fb6-9e07-8e52eac38a44 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:00:59.632379 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c0461d3e-2a35-4fb6-9e07-8e52eac38a44 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1666 microversion: 2.1 time: 0.159890 Jul 23 22:00:59.632961 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3067/5677] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:00:59 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1666 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:01:00.654562 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a17e6f3b-be8b-42c9-965a-755970df560b tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:01:00.655718 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a17e6f3b-be8b-42c9-965a-755970df560b tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:01:00.665101 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a17e6f3b-be8b-42c9-965a-755970df560b tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:00.665565 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a17e6f3b-be8b-42c9-965a-755970df560b tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:00.666395 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a17e6f3b-be8b-42c9-965a-755970df560b tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:00.666842 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a17e6f3b-be8b-42c9-965a-755970df560b tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:00.804986 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a17e6f3b-be8b-42c9-965a-755970df560b tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:01:00.813989 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a17e6f3b-be8b-42c9-965a-755970df560b tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1670 microversion: 2.1 time: 0.166108 Jul 23 22:01:00.814587 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3068/5678] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:01:00 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1670 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:01:00.830825 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1db0eb7b-402f-450c-9da4-35a1dfb87cca tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:01:00.831446 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1db0eb7b-402f-450c-9da4-35a1dfb87cca tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:01:00.837884 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1db0eb7b-402f-450c-9da4-35a1dfb87cca tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:00.838364 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1db0eb7b-402f-450c-9da4-35a1dfb87cca tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:00.839148 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1db0eb7b-402f-450c-9da4-35a1dfb87cca tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:00.839595 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1db0eb7b-402f-450c-9da4-35a1dfb87cca tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:00.973904 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-1db0eb7b-402f-450c-9da4-35a1dfb87cca tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:01:00.982445 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1db0eb7b-402f-450c-9da4-35a1dfb87cca tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1670 microversion: 2.1 time: 0.155426 Jul 23 22:01:00.983020 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3069/5679] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:01:00 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1670 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:01:01.000142 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-08706d0e-8cac-4464-aa4f-5f1028bef04e tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:01:01.000763 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-08706d0e-8cac-4464-aa4f-5f1028bef04e tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:01:01.006860 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-08706d0e-8cac-4464-aa4f-5f1028bef04e tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:01.007313 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-08706d0e-8cac-4464-aa4f-5f1028bef04e tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:01.008084 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-08706d0e-8cac-4464-aa4f-5f1028bef04e tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:01.008523 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-08706d0e-8cac-4464-aa4f-5f1028bef04e tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:01.147403 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-08706d0e-8cac-4464-aa4f-5f1028bef04e tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:01:01.159624 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-08706d0e-8cac-4464-aa4f-5f1028bef04e tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1670 microversion: 2.1 time: 0.162926 Jul 23 22:01:01.160394 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3070/5680] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:01:00 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1670 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:01:01.175790 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d2a7a65a-f4b8-4f2a-bc01-596338b4b3e4 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:01:01.176325 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d2a7a65a-f4b8-4f2a-bc01-596338b4b3e4 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:01:01.182067 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d2a7a65a-f4b8-4f2a-bc01-596338b4b3e4 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:01.182494 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d2a7a65a-f4b8-4f2a-bc01-596338b4b3e4 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:01.183250 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d2a7a65a-f4b8-4f2a-bc01-596338b4b3e4 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:01.183699 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d2a7a65a-f4b8-4f2a-bc01-596338b4b3e4 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:01.315377 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d2a7a65a-f4b8-4f2a-bc01-596338b4b3e4 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:01:01.323350 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d2a7a65a-f4b8-4f2a-bc01-596338b4b3e4 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1670 microversion: 2.1 time: 0.151135 Jul 23 22:01:01.323927 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3071/5681] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:01:01 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1670 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:01:01.338938 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-dc7d0dcf-6345-406c-b7a3-3cb4824d0421 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:01:01.339541 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-dc7d0dcf-6345-406c-b7a3-3cb4824d0421 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:01:01.346184 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dc7d0dcf-6345-406c-b7a3-3cb4824d0421 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:01.346635 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dc7d0dcf-6345-406c-b7a3-3cb4824d0421 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:01.347406 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dc7d0dcf-6345-406c-b7a3-3cb4824d0421 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:01.347846 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dc7d0dcf-6345-406c-b7a3-3cb4824d0421 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:01.481693 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-dc7d0dcf-6345-406c-b7a3-3cb4824d0421 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:01:01.492270 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-dc7d0dcf-6345-406c-b7a3-3cb4824d0421 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1670 microversion: 2.1 time: 0.156886 Jul 23 22:01:01.492842 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3072/5682] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:01:01 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1670 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:01:01.508866 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-02bed18a-466f-4704-8413-3a82f81c5727 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:01:01.509415 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-02bed18a-466f-4704-8413-3a82f81c5727 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:01:01.515859 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-02bed18a-466f-4704-8413-3a82f81c5727 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:01.516323 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-02bed18a-466f-4704-8413-3a82f81c5727 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:01.517096 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-02bed18a-466f-4704-8413-3a82f81c5727 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:01.517540 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-02bed18a-466f-4704-8413-3a82f81c5727 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:01.541134 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.objects.instance [None req-02bed18a-466f-4704-8413-3a82f81c5727 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lazy-loading 'flavor' on Instance uuid 9c96aa13-cbff-4245-a45b-418f131a0841 {{(pid=131320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 22:01:01.611066 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-02bed18a-466f-4704-8413-3a82f81c5727 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "POST /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841/action" status: 202 len: 0 microversion: 2.1 time: 0.105648 Jul 23 22:01:01.611772 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3073/5683] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 22:01:01 2022] POST /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 22:01:01.620469 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-04f73dde-0154-4f18-bf51-ab3949e3a2bc tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:01:01.621174 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-04f73dde-0154-4f18-bf51-ab3949e3a2bc tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:01:01.628170 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-04f73dde-0154-4f18-bf51-ab3949e3a2bc tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:01.628654 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-04f73dde-0154-4f18-bf51-ab3949e3a2bc tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:01.629494 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-04f73dde-0154-4f18-bf51-ab3949e3a2bc tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:01.629928 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-04f73dde-0154-4f18-bf51-ab3949e3a2bc tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:01.775313 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-04f73dde-0154-4f18-bf51-ab3949e3a2bc tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:01:01.786866 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-04f73dde-0154-4f18-bf51-ab3949e3a2bc tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1678 microversion: 2.1 time: 0.170186 Jul 23 22:01:01.787646 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3074/5684] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:01:01 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1678 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:01:02.868367 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a61eea96-453a-4f33-9ba5-394f90ee4c3d tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:01:02.869437 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a61eea96-453a-4f33-9ba5-394f90ee4c3d tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:01:02.877479 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a61eea96-453a-4f33-9ba5-394f90ee4c3d tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:02.877958 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a61eea96-453a-4f33-9ba5-394f90ee4c3d tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:02.878738 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a61eea96-453a-4f33-9ba5-394f90ee4c3d tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:02.879223 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a61eea96-453a-4f33-9ba5-394f90ee4c3d tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:03.016053 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a61eea96-453a-4f33-9ba5-394f90ee4c3d tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:01:03.024245 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a61eea96-453a-4f33-9ba5-394f90ee4c3d tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1661 microversion: 2.1 time: 0.222267 Jul 23 22:01:03.024805 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3075/5685] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:01:02 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1661 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:01:03.040598 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e0f16b6b-4327-4073-96ac-472f7667ccad tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:01:03.041180 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e0f16b6b-4327-4073-96ac-472f7667ccad tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:01:03.047568 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e0f16b6b-4327-4073-96ac-472f7667ccad tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:03.048060 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e0f16b6b-4327-4073-96ac-472f7667ccad tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:03.048995 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e0f16b6b-4327-4073-96ac-472f7667ccad tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:03.049398 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e0f16b6b-4327-4073-96ac-472f7667ccad tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:03.124621 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e0f16b6b-4327-4073-96ac-472f7667ccad tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "POST /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841/action" status: 202 len: 0 microversion: 2.1 time: 0.087398 Jul 23 22:01:03.125380 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3076/5686] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 22:01:03 2022] POST /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 22:01:03.134345 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-bdecadb2-3897-427b-aa10-884e9c7a4a73 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:01:03.135318 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-bdecadb2-3897-427b-aa10-884e9c7a4a73 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:01:03.142142 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bdecadb2-3897-427b-aa10-884e9c7a4a73 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:03.142693 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bdecadb2-3897-427b-aa10-884e9c7a4a73 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:03.143887 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bdecadb2-3897-427b-aa10-884e9c7a4a73 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:03.144371 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bdecadb2-3897-427b-aa10-884e9c7a4a73 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:03.365207 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-bdecadb2-3897-427b-aa10-884e9c7a4a73 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:01:03.373413 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-bdecadb2-3897-427b-aa10-884e9c7a4a73 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1667 microversion: 2.1 time: 0.243124 Jul 23 22:01:03.377466 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3077/5687] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:01:03 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1667 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:01:04.391482 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-68d12cd9-32ed-46be-b509-d7f0c6d74902 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:01:04.392205 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-68d12cd9-32ed-46be-b509-d7f0c6d74902 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:01:04.399557 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-68d12cd9-32ed-46be-b509-d7f0c6d74902 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:04.400021 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-68d12cd9-32ed-46be-b509-d7f0c6d74902 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:04.400813 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-68d12cd9-32ed-46be-b509-d7f0c6d74902 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:04.401238 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-68d12cd9-32ed-46be-b509-d7f0c6d74902 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:04.548375 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-68d12cd9-32ed-46be-b509-d7f0c6d74902 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:01:04.552120 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:01:04.557215 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-68d12cd9-32ed-46be-b509-d7f0c6d74902 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1670 microversion: 2.1 time: 0.170002 Jul 23 22:01:04.557808 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3078/5688] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:01:04 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1670 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:01:04.574059 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f5e1522f-1278-4032-9bc8-82a6bd6a4bd9 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:01:04.574673 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f5e1522f-1278-4032-9bc8-82a6bd6a4bd9 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:01:04.581164 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f5e1522f-1278-4032-9bc8-82a6bd6a4bd9 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:04.581625 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f5e1522f-1278-4032-9bc8-82a6bd6a4bd9 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:04.582462 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f5e1522f-1278-4032-9bc8-82a6bd6a4bd9 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:04.582956 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f5e1522f-1278-4032-9bc8-82a6bd6a4bd9 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:04.734430 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f5e1522f-1278-4032-9bc8-82a6bd6a4bd9 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:01:04.743927 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f5e1522f-1278-4032-9bc8-82a6bd6a4bd9 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1670 microversion: 2.1 time: 0.173884 Jul 23 22:01:04.744524 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3079/5689] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:01:04 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1670 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:01:04.760864 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-19448e75-8b59-4088-82e8-fe64e5c383a4 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:01:04.761371 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-19448e75-8b59-4088-82e8-fe64e5c383a4 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 8c21d818-d5ad-4c50-a7ca-a2831cdc6b60] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:01:04.768031 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-19448e75-8b59-4088-82e8-fe64e5c383a4 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:04.768492 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-19448e75-8b59-4088-82e8-fe64e5c383a4 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:04.769256 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-19448e75-8b59-4088-82e8-fe64e5c383a4 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:04.769727 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-19448e75-8b59-4088-82e8-fe64e5c383a4 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:04.795776 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-19448e75-8b59-4088-82e8-fe64e5c383a4 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 8c21d818-d5ad-4c50-a7ca-a2831cdc6b60] Going to try to terminate instance {{(pid=131320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 22:01:04.802084 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.compute.api [None req-19448e75-8b59-4088-82e8-fe64e5c383a4 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 8c21d818-d5ad-4c50-a7ca-a2831cdc6b60] Working on deleting snapshot 4e76b225-a2ed-44d3-bd42-ffaea830c4f9 from shelved instance... Jul 23 22:01:05.315161 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-19448e75-8b59-4088-82e8-fe64e5c383a4 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 8c21d818-d5ad-4c50-a7ca-a2831cdc6b60] Doing local delete in cell 4e90cb14-d4b2-4158-b8cf-a592a1314a7b(cell1) {{(pid=131320) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jul 23 22:01:05.315978 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-19448e75-8b59-4088-82e8-fe64e5c383a4 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:05.316540 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-19448e75-8b59-4088-82e8-fe64e5c383a4 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:05.316975 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.compute.api [None req-19448e75-8b59-4088-82e8-fe64e5c383a4 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 8c21d818-d5ad-4c50-a7ca-a2831cdc6b60] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Jul 23 22:01:05.323831 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-19448e75-8b59-4088-82e8-fe64e5c383a4 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 8c21d818-d5ad-4c50-a7ca-a2831cdc6b60] deallocate_for_instance() {{(pid=131320) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 23 22:01:05.834044 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-19448e75-8b59-4088-82e8-fe64e5c383a4 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 8c21d818-d5ad-4c50-a7ca-a2831cdc6b60] Updating instance_info_cache with network_info: [] {{(pid=131320) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 23 22:01:06.099407 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-19448e75-8b59-4088-82e8-fe64e5c383a4 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "DELETE /compute/v2.1/servers/8c21d818-d5ad-4c50-a7ca-a2831cdc6b60" status: 204 len: 0 microversion: 2.1 time: 1.342053 Jul 23 22:01:06.099901 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3080/5690] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 22:01:04 2022] DELETE /compute/v2.1/servers/8c21d818-d5ad-4c50-a7ca-a2831cdc6b60 => generated 0 bytes in 1343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 22:01:06.104383 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-ef0ee2c9-ae6d-4af0-b806-61be3de429fb req-89efd5ed-8427-41a2-a864-352affd6bd49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c21d818-d5ad-4c50-a7ca-a2831cdc6b60", "name": "network-vif-deleted", "tag": "a788d24e-c212-4180-ab21-a2ffd84939a1"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:01:06.112557 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-ef0ee2c9-ae6d-4af0-b806-61be3de429fb req-89efd5ed-8427-41a2-a864-352affd6bd49 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:06.113003 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-ef0ee2c9-ae6d-4af0-b806-61be3de429fb req-89efd5ed-8427-41a2-a864-352affd6bd49 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:06.127012 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.compute.server_external_events [req-ef0ee2c9-ae6d-4af0-b806-61be3de429fb req-89efd5ed-8427-41a2-a864-352affd6bd49 service nova] Unable to find a host for instance 8c21d818-d5ad-4c50-a7ca-a2831cdc6b60. Dropping event network-vif-deleted {{(pid=131320) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 23 22:01:06.127886 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-ef0ee2c9-ae6d-4af0-b806-61be3de429fb req-89efd5ed-8427-41a2-a864-352affd6bd49 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.027063 Jul 23 22:01:06.128469 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3081/5691] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:01:06 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 23 22:01:06.132838 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-23d0e4fa-3c07-41ec-bdee-795b8d77dfd9 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:01:06.133455 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-23d0e4fa-3c07-41ec-bdee-795b8d77dfd9 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 8c21d818-d5ad-4c50-a7ca-a2831cdc6b60] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:01:06.139101 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-23d0e4fa-3c07-41ec-bdee-795b8d77dfd9 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:06.139594 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-23d0e4fa-3c07-41ec-bdee-795b8d77dfd9 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:06.140444 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-23d0e4fa-3c07-41ec-bdee-795b8d77dfd9 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:06.140913 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-23d0e4fa-3c07-41ec-bdee-795b8d77dfd9 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:06.154523 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-23d0e4fa-3c07-41ec-bdee-795b8d77dfd9 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] HTTP exception thrown: Instance 8c21d818-d5ad-4c50-a7ca-a2831cdc6b60 could not be found. Jul 23 22:01:06.156169 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-23d0e4fa-3c07-41ec-bdee-795b8d77dfd9 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Request method failure captured: Jul 23 22:01:06.156169 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/8c21d818-d5ad-4c50-a7ca-a2831cdc6b60 HTTP/1.1 Jul 23 22:01:06.156169 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 22:01:06.156169 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 22:01:06.156169 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 22:01:06.156169 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 22:01:06.156169 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 22:01:06.156169 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 22:01:06.156169 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 22:01:06.156169 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 22:01:06.156169 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3G5zenNQoGAgOnzvIlJaai-gziA5yMme9kZwxxrq2OwWiDMLl-dUF-XE3626KKfhD-N8cY1a9u6XXCRLdMFVsisJNTfK5xVs8wz60dDWCP6QSNbyt-jy1AKDyGzSQRBdVEEWeoKMqkilvA_v0S2vWwpnaqGtSJ3eyd-XByOeDDg16TA Jul 23 22:01:06.156169 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 22:01:06.156169 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 22:01:06.156169 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 22:01:06.156169 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 22:01:06.156169 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 22:01:06.156169 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 22:01:06.156169 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 7f624e0dec4a4f64b1d3580e60867c41 Jul 23 22:01:06.156169 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServerActionsTestJSON-140818405 Jul 23 22:01:06.156169 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 22:01:06.156169 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 22:01:06.156169 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7f624e0dec4a4f64b1d3580e60867c41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7f624e0dec4a4f64b1d3580e60867c41"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_7f624e0dec4a4f64b1d3580e60867c41", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/7f624e0dec4a4f64b1d3580e60867c41"}]}] Jul 23 22:01:06.156169 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServerActionsTestJSON-140818405 Jul 23 22:01:06.156169 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 7f624e0dec4a4f64b1d3580e60867c41 Jul 23 22:01:06.156169 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServerActionsTestJSON-140818405 Jul 23 22:01:06.156169 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServerActionsTestJSON-140818405-project Jul 23 22:01:06.156169 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 22:01:06.156169 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 22:01:06.156169 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: b5408fb2f4044c6d88527222b190230d Jul 23 22:01:06.156169 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServerActionsTestJSON-140818405-project Jul 23 22:01:06.156169 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 22:01:06.156169 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance 8c21d818-d5ad-4c50-a7ca-a2831cdc6b60 could not be found. Jul 23 22:01:06.156169 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '8c21d818-d5ad-4c50-a7ca-a2831cdc6b60'} Jul 23 22:01:06.156169 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 22:01:06.156169 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:01:06.156169 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 22:01:06.156169 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 22:01:06.156169 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 22:01:06.156169 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 22:01:06.156169 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 22:01:06.156169 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 22:01:06.156169 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 22:01:06.156169 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 22:01:06.156169 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c21d818-d5ad-4c50-a7ca-a2831cdc6b60 could not be found. Jul 23 22:01:06.156169 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:01:06.156169 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:01:06.156169 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:01:06.156169 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:01:06.156169 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:01:06.156169 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:01:06.156169 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 22:01:06.156169 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 22:01:06.156169 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 22:01:06.156169 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 22:01:06.156169 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 22:01:06.156169 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 22:01:06.156169 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 22:01:06.156169 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 22:01:06.156169 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 22:01:06.156169 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 22:01:06.156169 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c21d818-d5ad-4c50-a7ca-a2831cdc6b60 could not be found. Jul 23 22:01:06.156169 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:01:06.156169 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:01:06.156169 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:01:06.161234 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:01:06.161234 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:01:06.161234 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:01:06.161234 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 22:01:06.161234 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 22:01:06.161234 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c21d818-d5ad-4c50-a7ca-a2831cdc6b60 could not be found. Jul 23 22:01:06.161234 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:01:06.161234 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-23d0e4fa-3c07-41ec-bdee-795b8d77dfd9 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Returning 404 to user: Instance 8c21d818-d5ad-4c50-a7ca-a2831cdc6b60 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 22:01:06.161234 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-23d0e4fa-3c07-41ec-bdee-795b8d77dfd9 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/8c21d818-d5ad-4c50-a7ca-a2831cdc6b60" status: 404 len: 111 microversion: 2.1 time: 0.028166 Jul 23 22:01:06.161234 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3082/5692] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:01:06 2022] GET /compute/v2.1/servers/8c21d818-d5ad-4c50-a7ca-a2831cdc6b60 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 22:01:06.165852 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d6c4638d-4994-4df4-b1ab-509c99e05e07 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:01:06.166503 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d6c4638d-4994-4df4-b1ab-509c99e05e07 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 2ae0714c-5e4b-4c64-b23c-0a0a9e6a4609] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:01:06.172436 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d6c4638d-4994-4df4-b1ab-509c99e05e07 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:06.172899 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d6c4638d-4994-4df4-b1ab-509c99e05e07 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:06.173678 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d6c4638d-4994-4df4-b1ab-509c99e05e07 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:06.174153 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d6c4638d-4994-4df4-b1ab-509c99e05e07 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:06.198929 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d6c4638d-4994-4df4-b1ab-509c99e05e07 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 2ae0714c-5e4b-4c64-b23c-0a0a9e6a4609] Going to try to terminate instance {{(pid=131320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 22:01:06.294034 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d6c4638d-4994-4df4-b1ab-509c99e05e07 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "DELETE /compute/v2.1/servers/2ae0714c-5e4b-4c64-b23c-0a0a9e6a4609" status: 204 len: 0 microversion: 2.1 time: 0.131408 Jul 23 22:01:06.294812 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3083/5693] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 22:01:06 2022] DELETE /compute/v2.1/servers/2ae0714c-5e4b-4c64-b23c-0a0a9e6a4609 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 22:01:06.304136 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ef4aa81c-14d6-4f28-afbc-b8037b9bcee4 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:01:06.304868 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ef4aa81c-14d6-4f28-afbc-b8037b9bcee4 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 2ae0714c-5e4b-4c64-b23c-0a0a9e6a4609] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:01:06.312480 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ef4aa81c-14d6-4f28-afbc-b8037b9bcee4 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:06.312943 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ef4aa81c-14d6-4f28-afbc-b8037b9bcee4 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:06.313727 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ef4aa81c-14d6-4f28-afbc-b8037b9bcee4 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:06.314633 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ef4aa81c-14d6-4f28-afbc-b8037b9bcee4 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:06.407078 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ef4aa81c-14d6-4f28-afbc-b8037b9bcee4 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:01:06.415185 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ef4aa81c-14d6-4f28-afbc-b8037b9bcee4 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/2ae0714c-5e4b-4c64-b23c-0a0a9e6a4609" status: 200 len: 1464 microversion: 2.1 time: 0.115731 Jul 23 22:01:06.415763 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3084/5694] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:01:06 2022] GET /compute/v2.1/servers/2ae0714c-5e4b-4c64-b23c-0a0a9e6a4609 => generated 1464 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:01:07.436816 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-74fe1036-4602-437b-8200-85334b76478a tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:01:07.438094 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-74fe1036-4602-437b-8200-85334b76478a tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 2ae0714c-5e4b-4c64-b23c-0a0a9e6a4609] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:01:07.447141 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-74fe1036-4602-437b-8200-85334b76478a tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:07.447600 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-74fe1036-4602-437b-8200-85334b76478a tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:07.448392 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-74fe1036-4602-437b-8200-85334b76478a tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:07.448838 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-74fe1036-4602-437b-8200-85334b76478a tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:07.533532 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-74fe1036-4602-437b-8200-85334b76478a tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:01:07.542602 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-74fe1036-4602-437b-8200-85334b76478a tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/2ae0714c-5e4b-4c64-b23c-0a0a9e6a4609" status: 200 len: 1464 microversion: 2.1 time: 0.112407 Jul 23 22:01:07.543223 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3085/5695] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:01:07 2022] GET /compute/v2.1/servers/2ae0714c-5e4b-4c64-b23c-0a0a9e6a4609 => generated 1464 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:01:08.472175 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-04347aaf-91fb-4b47-84f6-5b5acaea1048 req-f18ba155-15b5-41c1-8476-3f1c798325c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ae0714c-5e4b-4c64-b23c-0a0a9e6a4609", "name": "network-vif-deleted", "tag": "2d41063e-a18d-4d71-bbe1-099835fea2dd"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:01:08.482567 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-04347aaf-91fb-4b47-84f6-5b5acaea1048 req-f18ba155-15b5-41c1-8476-3f1c798325c5 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:08.483019 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-04347aaf-91fb-4b47-84f6-5b5acaea1048 req-f18ba155-15b5-41c1-8476-3f1c798325c5 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:08.495220 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-04347aaf-91fb-4b47-84f6-5b5acaea1048 req-f18ba155-15b5-41c1-8476-3f1c798325c5 service nova] Creating event network-vif-deleted:2d41063e-a18d-4d71-bbe1-099835fea2dd for instance 2ae0714c-5e4b-4c64-b23c-0a0a9e6a4609 on nch1-master-1 Jul 23 22:01:08.500128 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-04347aaf-91fb-4b47-84f6-5b5acaea1048 req-f18ba155-15b5-41c1-8476-3f1c798325c5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032069 Jul 23 22:01:08.500755 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3086/5696] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:01:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:01:08.561364 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-bade6b07-5dd7-4abf-9bae-64b0b13ee0b9 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:01:08.562416 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-bade6b07-5dd7-4abf-9bae-64b0b13ee0b9 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 2ae0714c-5e4b-4c64-b23c-0a0a9e6a4609] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:01:08.569898 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bade6b07-5dd7-4abf-9bae-64b0b13ee0b9 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:08.570523 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bade6b07-5dd7-4abf-9bae-64b0b13ee0b9 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:08.571573 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bade6b07-5dd7-4abf-9bae-64b0b13ee0b9 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:08.572230 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bade6b07-5dd7-4abf-9bae-64b0b13ee0b9 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:08.646383 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-bade6b07-5dd7-4abf-9bae-64b0b13ee0b9 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:01:08.654738 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-bade6b07-5dd7-4abf-9bae-64b0b13ee0b9 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/2ae0714c-5e4b-4c64-b23c-0a0a9e6a4609" status: 200 len: 1299 microversion: 2.1 time: 0.098127 Jul 23 22:01:08.655320 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3087/5697] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:01:08 2022] GET /compute/v2.1/servers/2ae0714c-5e4b-4c64-b23c-0a0a9e6a4609 => generated 1299 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:01:09.676586 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d16f66e4-899c-4d47-828c-f2bdffb31aaa tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:01:09.677766 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d16f66e4-899c-4d47-828c-f2bdffb31aaa tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 2ae0714c-5e4b-4c64-b23c-0a0a9e6a4609] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:01:09.685645 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d16f66e4-899c-4d47-828c-f2bdffb31aaa tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:09.686136 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d16f66e4-899c-4d47-828c-f2bdffb31aaa tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:09.686907 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d16f66e4-899c-4d47-828c-f2bdffb31aaa tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:09.687350 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d16f66e4-899c-4d47-828c-f2bdffb31aaa tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:09.701566 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-d16f66e4-899c-4d47-828c-f2bdffb31aaa tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] HTTP exception thrown: Instance 2ae0714c-5e4b-4c64-b23c-0a0a9e6a4609 could not be found. Jul 23 22:01:09.703260 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d16f66e4-899c-4d47-828c-f2bdffb31aaa tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Request method failure captured: Jul 23 22:01:09.703260 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/2ae0714c-5e4b-4c64-b23c-0a0a9e6a4609 HTTP/1.1 Jul 23 22:01:09.703260 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 22:01:09.703260 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 22:01:09.703260 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 22:01:09.703260 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 22:01:09.703260 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 22:01:09.703260 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 22:01:09.703260 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 22:01:09.703260 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 22:01:09.703260 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3G5zenNQoGAgOnzvIlJaai-gziA5yMme9kZwxxrq2OwWiDMLl-dUF-XE3626KKfhD-N8cY1a9u6XXCRLdMFVsisJNTfK5xVs8wz60dDWCP6QSNbyt-jy1AKDyGzSQRBdVEEWeoKMqkilvA_v0S2vWwpnaqGtSJ3eyd-XByOeDDg16TA Jul 23 22:01:09.703260 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 22:01:09.703260 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 22:01:09.703260 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 22:01:09.703260 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 22:01:09.703260 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 22:01:09.703260 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 22:01:09.703260 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 7f624e0dec4a4f64b1d3580e60867c41 Jul 23 22:01:09.703260 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServerActionsTestJSON-140818405 Jul 23 22:01:09.703260 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 22:01:09.703260 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 22:01:09.703260 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7f624e0dec4a4f64b1d3580e60867c41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7f624e0dec4a4f64b1d3580e60867c41"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_7f624e0dec4a4f64b1d3580e60867c41", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/7f624e0dec4a4f64b1d3580e60867c41"}]}] Jul 23 22:01:09.703260 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServerActionsTestJSON-140818405 Jul 23 22:01:09.703260 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 7f624e0dec4a4f64b1d3580e60867c41 Jul 23 22:01:09.703260 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServerActionsTestJSON-140818405 Jul 23 22:01:09.703260 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServerActionsTestJSON-140818405-project Jul 23 22:01:09.703260 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 22:01:09.703260 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 22:01:09.703260 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: b5408fb2f4044c6d88527222b190230d Jul 23 22:01:09.703260 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServerActionsTestJSON-140818405-project Jul 23 22:01:09.703260 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 22:01:09.703260 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance 2ae0714c-5e4b-4c64-b23c-0a0a9e6a4609 could not be found. Jul 23 22:01:09.703260 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '2ae0714c-5e4b-4c64-b23c-0a0a9e6a4609'} Jul 23 22:01:09.703260 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 22:01:09.703260 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:01:09.703260 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 22:01:09.703260 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 22:01:09.703260 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 22:01:09.703260 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 22:01:09.703260 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 22:01:09.703260 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 22:01:09.703260 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 22:01:09.703260 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 22:01:09.703260 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ae0714c-5e4b-4c64-b23c-0a0a9e6a4609 could not be found. Jul 23 22:01:09.703260 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:01:09.703260 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:01:09.703260 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:01:09.703260 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:01:09.703260 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:01:09.703260 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:01:09.703260 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 22:01:09.703260 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 22:01:09.703260 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 22:01:09.703260 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 22:01:09.703260 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 22:01:09.703260 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 22:01:09.703260 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 22:01:09.703260 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 22:01:09.703260 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 22:01:09.703260 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 22:01:09.703260 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ae0714c-5e4b-4c64-b23c-0a0a9e6a4609 could not be found. Jul 23 22:01:09.703260 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:01:09.703260 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:01:09.703260 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:01:09.708326 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:01:09.708326 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:01:09.708326 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:01:09.708326 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 22:01:09.708326 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 22:01:09.708326 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ae0714c-5e4b-4c64-b23c-0a0a9e6a4609 could not be found. Jul 23 22:01:09.708326 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:01:09.708326 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d16f66e4-899c-4d47-828c-f2bdffb31aaa tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Returning 404 to user: Instance 2ae0714c-5e4b-4c64-b23c-0a0a9e6a4609 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 22:01:09.708326 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d16f66e4-899c-4d47-828c-f2bdffb31aaa tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/2ae0714c-5e4b-4c64-b23c-0a0a9e6a4609" status: 404 len: 111 microversion: 2.1 time: 0.034893 Jul 23 22:01:09.708326 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3088/5698] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:01:09 2022] GET /compute/v2.1/servers/2ae0714c-5e4b-4c64-b23c-0a0a9e6a4609 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 22:01:09.712905 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-bcdb3ab6-0bee-4548-aaa2-8b42d2ee7ef9 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:01:09.713407 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-bcdb3ab6-0bee-4548-aaa2-8b42d2ee7ef9 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 0eab1f9e-5c32-4bce-8043-2570445e9762] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:01:09.719585 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bcdb3ab6-0bee-4548-aaa2-8b42d2ee7ef9 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:09.720072 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bcdb3ab6-0bee-4548-aaa2-8b42d2ee7ef9 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:09.720831 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bcdb3ab6-0bee-4548-aaa2-8b42d2ee7ef9 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:09.721336 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bcdb3ab6-0bee-4548-aaa2-8b42d2ee7ef9 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:09.750293 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-bcdb3ab6-0bee-4548-aaa2-8b42d2ee7ef9 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 0eab1f9e-5c32-4bce-8043-2570445e9762] Going to try to terminate instance {{(pid=131320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 22:01:09.763809 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:01:09.830941 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-bcdb3ab6-0bee-4548-aaa2-8b42d2ee7ef9 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0eab1f9e-5c32-4bce-8043-2570445e9762" status: 204 len: 0 microversion: 2.1 time: 0.121195 Jul 23 22:01:09.832069 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3089/5699] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 22:01:09 2022] DELETE /compute/v2.1/servers/0eab1f9e-5c32-4bce-8043-2570445e9762 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 22:01:09.841484 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f0e12c43-3e29-4d6f-ac6b-4a13093748be tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:01:09.842410 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f0e12c43-3e29-4d6f-ac6b-4a13093748be tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 0eab1f9e-5c32-4bce-8043-2570445e9762] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:01:09.848995 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f0e12c43-3e29-4d6f-ac6b-4a13093748be tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:09.849586 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f0e12c43-3e29-4d6f-ac6b-4a13093748be tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:09.850514 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f0e12c43-3e29-4d6f-ac6b-4a13093748be tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:09.850996 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f0e12c43-3e29-4d6f-ac6b-4a13093748be tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:09.985111 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f0e12c43-3e29-4d6f-ac6b-4a13093748be tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:01:09.992934 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f0e12c43-3e29-4d6f-ac6b-4a13093748be tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/0eab1f9e-5c32-4bce-8043-2570445e9762" status: 200 len: 1507 microversion: 2.1 time: 0.156554 Jul 23 22:01:09.993512 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3090/5700] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:01:09 2022] GET /compute/v2.1/servers/0eab1f9e-5c32-4bce-8043-2570445e9762 => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:01:11.010471 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4639111f-44aa-4efc-942f-5a78df0540b5 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:01:11.011175 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-4639111f-44aa-4efc-942f-5a78df0540b5 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 0eab1f9e-5c32-4bce-8043-2570445e9762] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:01:11.018517 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4639111f-44aa-4efc-942f-5a78df0540b5 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:11.018967 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4639111f-44aa-4efc-942f-5a78df0540b5 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:11.019735 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4639111f-44aa-4efc-942f-5a78df0540b5 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:11.020172 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4639111f-44aa-4efc-942f-5a78df0540b5 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:11.217528 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-4639111f-44aa-4efc-942f-5a78df0540b5 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:01:11.226130 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4639111f-44aa-4efc-942f-5a78df0540b5 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/0eab1f9e-5c32-4bce-8043-2570445e9762" status: 200 len: 1507 microversion: 2.1 time: 0.219496 Jul 23 22:01:11.226968 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3091/5701] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:01:11 2022] GET /compute/v2.1/servers/0eab1f9e-5c32-4bce-8043-2570445e9762 => generated 1507 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:01:11.672900 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-df6070ef-c8e6-4d3f-8367-0aa76b4ba6a6 req-ce3fbc63-6847-4277-8a4d-fe29d5dedde5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0eab1f9e-5c32-4bce-8043-2570445e9762", "name": "network-vif-deleted", "tag": "75325559-53a9-4b31-bfca-61c51848723d"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:01:11.682642 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-df6070ef-c8e6-4d3f-8367-0aa76b4ba6a6 req-ce3fbc63-6847-4277-8a4d-fe29d5dedde5 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:11.682807 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-df6070ef-c8e6-4d3f-8367-0aa76b4ba6a6 req-ce3fbc63-6847-4277-8a4d-fe29d5dedde5 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:11.695809 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-df6070ef-c8e6-4d3f-8367-0aa76b4ba6a6 req-ce3fbc63-6847-4277-8a4d-fe29d5dedde5 service nova] Creating event network-vif-deleted:75325559-53a9-4b31-bfca-61c51848723d for instance 0eab1f9e-5c32-4bce-8043-2570445e9762 on nch2-master-1 Jul 23 22:01:11.701348 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-df6070ef-c8e6-4d3f-8367-0aa76b4ba6a6 req-ce3fbc63-6847-4277-8a4d-fe29d5dedde5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095508 Jul 23 22:01:11.702087 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3092/5702] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:01:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:01:12.245339 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8bae5366-9ebe-447b-ae14-ab39efa8a5fb tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:01:12.246046 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8bae5366-9ebe-447b-ae14-ab39efa8a5fb tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 0eab1f9e-5c32-4bce-8043-2570445e9762] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:01:12.252730 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8bae5366-9ebe-447b-ae14-ab39efa8a5fb tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:12.253195 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8bae5366-9ebe-447b-ae14-ab39efa8a5fb tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:12.254004 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8bae5366-9ebe-447b-ae14-ab39efa8a5fb tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:12.254436 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8bae5366-9ebe-447b-ae14-ab39efa8a5fb tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:12.268200 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-8bae5366-9ebe-447b-ae14-ab39efa8a5fb tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] HTTP exception thrown: Instance 0eab1f9e-5c32-4bce-8043-2570445e9762 could not be found. Jul 23 22:01:12.269833 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8bae5366-9ebe-447b-ae14-ab39efa8a5fb tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Request method failure captured: Jul 23 22:01:12.269833 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/0eab1f9e-5c32-4bce-8043-2570445e9762 HTTP/1.1 Jul 23 22:01:12.269833 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 22:01:12.269833 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 22:01:12.269833 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 22:01:12.269833 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 22:01:12.269833 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 22:01:12.269833 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 22:01:12.269833 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 22:01:12.269833 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 22:01:12.269833 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3G5zenNQoGAgOnzvIlJaai-gziA5yMme9kZwxxrq2OwWiDMLl-dUF-XE3626KKfhD-N8cY1a9u6XXCRLdMFVsisJNTfK5xVs8wz60dDWCP6QSNbyt-jy1AKDyGzSQRBdVEEWeoKMqkilvA_v0S2vWwpnaqGtSJ3eyd-XByOeDDg16TA Jul 23 22:01:12.269833 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 22:01:12.269833 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 22:01:12.269833 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 22:01:12.269833 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 22:01:12.269833 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 22:01:12.269833 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 22:01:12.269833 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 7f624e0dec4a4f64b1d3580e60867c41 Jul 23 22:01:12.269833 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServerActionsTestJSON-140818405 Jul 23 22:01:12.269833 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 22:01:12.269833 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 22:01:12.269833 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7f624e0dec4a4f64b1d3580e60867c41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7f624e0dec4a4f64b1d3580e60867c41"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_7f624e0dec4a4f64b1d3580e60867c41", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/7f624e0dec4a4f64b1d3580e60867c41"}]}] Jul 23 22:01:12.269833 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServerActionsTestJSON-140818405 Jul 23 22:01:12.269833 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 7f624e0dec4a4f64b1d3580e60867c41 Jul 23 22:01:12.269833 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServerActionsTestJSON-140818405 Jul 23 22:01:12.269833 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServerActionsTestJSON-140818405-project Jul 23 22:01:12.269833 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 22:01:12.269833 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 22:01:12.269833 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: b5408fb2f4044c6d88527222b190230d Jul 23 22:01:12.269833 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServerActionsTestJSON-140818405-project Jul 23 22:01:12.269833 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 22:01:12.269833 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance 0eab1f9e-5c32-4bce-8043-2570445e9762 could not be found. Jul 23 22:01:12.269833 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '0eab1f9e-5c32-4bce-8043-2570445e9762'} Jul 23 22:01:12.269833 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 22:01:12.269833 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:01:12.269833 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 22:01:12.269833 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 22:01:12.269833 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 22:01:12.269833 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 22:01:12.269833 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 22:01:12.269833 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 22:01:12.269833 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 22:01:12.269833 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 22:01:12.269833 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0eab1f9e-5c32-4bce-8043-2570445e9762 could not be found. Jul 23 22:01:12.269833 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:01:12.269833 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:01:12.269833 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:01:12.269833 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:01:12.269833 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:01:12.269833 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:01:12.269833 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 22:01:12.269833 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 22:01:12.269833 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 22:01:12.269833 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 22:01:12.269833 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 22:01:12.269833 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 22:01:12.269833 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 22:01:12.269833 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 22:01:12.269833 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 22:01:12.269833 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 22:01:12.269833 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0eab1f9e-5c32-4bce-8043-2570445e9762 could not be found. Jul 23 22:01:12.269833 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:01:12.269833 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:01:12.269833 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:01:12.275076 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:01:12.275076 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:01:12.275076 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:01:12.275076 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 22:01:12.275076 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 22:01:12.275076 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0eab1f9e-5c32-4bce-8043-2570445e9762 could not be found. Jul 23 22:01:12.275076 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:01:12.275076 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8bae5366-9ebe-447b-ae14-ab39efa8a5fb tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Returning 404 to user: Instance 0eab1f9e-5c32-4bce-8043-2570445e9762 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 22:01:12.275076 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8bae5366-9ebe-447b-ae14-ab39efa8a5fb tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/0eab1f9e-5c32-4bce-8043-2570445e9762" status: 404 len: 111 microversion: 2.1 time: 0.031341 Jul 23 22:01:12.275076 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3093/5703] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:01:12 2022] GET /compute/v2.1/servers/0eab1f9e-5c32-4bce-8043-2570445e9762 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 22:01:12.279516 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-fcf98b27-87b8-495f-bac1-f4477fe8d583 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:01:12.280006 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-fcf98b27-87b8-495f-bac1-f4477fe8d583 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: a91bf2ce-9a7f-461c-93d4-baaa04d10d53] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:01:12.286217 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fcf98b27-87b8-495f-bac1-f4477fe8d583 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:12.286676 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fcf98b27-87b8-495f-bac1-f4477fe8d583 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:12.287481 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fcf98b27-87b8-495f-bac1-f4477fe8d583 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:12.288051 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fcf98b27-87b8-495f-bac1-f4477fe8d583 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:12.314071 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-fcf98b27-87b8-495f-bac1-f4477fe8d583 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: a91bf2ce-9a7f-461c-93d4-baaa04d10d53] Going to try to terminate instance {{(pid=131320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 22:01:12.398329 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-fcf98b27-87b8-495f-bac1-f4477fe8d583 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "DELETE /compute/v2.1/servers/a91bf2ce-9a7f-461c-93d4-baaa04d10d53" status: 204 len: 0 microversion: 2.1 time: 0.121646 Jul 23 22:01:12.399288 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3094/5704] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 22:01:12 2022] DELETE /compute/v2.1/servers/a91bf2ce-9a7f-461c-93d4-baaa04d10d53 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 23 22:01:12.408877 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-08136159-3124-442d-a4d9-238823dd1c86 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:01:12.409510 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-08136159-3124-442d-a4d9-238823dd1c86 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: a91bf2ce-9a7f-461c-93d4-baaa04d10d53] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:01:12.416214 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-08136159-3124-442d-a4d9-238823dd1c86 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:12.416666 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-08136159-3124-442d-a4d9-238823dd1c86 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:12.417461 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-08136159-3124-442d-a4d9-238823dd1c86 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:12.417925 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-08136159-3124-442d-a4d9-238823dd1c86 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:12.552166 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-08136159-3124-442d-a4d9-238823dd1c86 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:01:12.560323 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-08136159-3124-442d-a4d9-238823dd1c86 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/a91bf2ce-9a7f-461c-93d4-baaa04d10d53" status: 200 len: 1494 microversion: 2.1 time: 0.155630 Jul 23 22:01:12.560899 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3095/5705] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:01:12 2022] GET /compute/v2.1/servers/a91bf2ce-9a7f-461c-93d4-baaa04d10d53 => generated 1494 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:01:13.582273 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c6a293af-9d67-491a-a7c2-acd60809a3c1 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:01:13.582991 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c6a293af-9d67-491a-a7c2-acd60809a3c1 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: a91bf2ce-9a7f-461c-93d4-baaa04d10d53] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:01:13.590630 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c6a293af-9d67-491a-a7c2-acd60809a3c1 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:13.591090 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c6a293af-9d67-491a-a7c2-acd60809a3c1 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:13.591849 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c6a293af-9d67-491a-a7c2-acd60809a3c1 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:13.592300 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c6a293af-9d67-491a-a7c2-acd60809a3c1 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:13.728028 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c6a293af-9d67-491a-a7c2-acd60809a3c1 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:01:13.736201 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c6a293af-9d67-491a-a7c2-acd60809a3c1 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/a91bf2ce-9a7f-461c-93d4-baaa04d10d53" status: 200 len: 1494 microversion: 2.1 time: 0.157923 Jul 23 22:01:13.736997 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3096/5706] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:01:13 2022] GET /compute/v2.1/servers/a91bf2ce-9a7f-461c-93d4-baaa04d10d53 => generated 1494 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:01:14.171570 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-13abca2a-4b9b-4af9-bad2-dc7455c1904d req-ae5a5d1a-a6d6-4f00-b61c-4388f6245b27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a91bf2ce-9a7f-461c-93d4-baaa04d10d53", "name": "network-vif-deleted", "tag": "3e8f2862-57a4-4750-afcf-2d739b0a48c2"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:01:14.180973 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-13abca2a-4b9b-4af9-bad2-dc7455c1904d req-ae5a5d1a-a6d6-4f00-b61c-4388f6245b27 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:14.181430 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-13abca2a-4b9b-4af9-bad2-dc7455c1904d req-ae5a5d1a-a6d6-4f00-b61c-4388f6245b27 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:14.200081 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-13abca2a-4b9b-4af9-bad2-dc7455c1904d req-ae5a5d1a-a6d6-4f00-b61c-4388f6245b27 service nova] Creating event network-vif-deleted:3e8f2862-57a4-4750-afcf-2d739b0a48c2 for instance a91bf2ce-9a7f-461c-93d4-baaa04d10d53 on nch1-master-1 Jul 23 22:01:14.205599 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-13abca2a-4b9b-4af9-bad2-dc7455c1904d req-ae5a5d1a-a6d6-4f00-b61c-4388f6245b27 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038237 Jul 23 22:01:14.206445 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3097/5707] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:01:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 22:01:14.754580 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b767cc24-e24d-47f4-a1e5-baf371945e6e tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:01:14.755287 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b767cc24-e24d-47f4-a1e5-baf371945e6e tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: a91bf2ce-9a7f-461c-93d4-baaa04d10d53] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:01:14.761754 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b767cc24-e24d-47f4-a1e5-baf371945e6e tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:14.762255 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b767cc24-e24d-47f4-a1e5-baf371945e6e tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:14.763042 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b767cc24-e24d-47f4-a1e5-baf371945e6e tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:14.763488 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b767cc24-e24d-47f4-a1e5-baf371945e6e tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:14.777181 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-b767cc24-e24d-47f4-a1e5-baf371945e6e tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] HTTP exception thrown: Instance a91bf2ce-9a7f-461c-93d4-baaa04d10d53 could not be found. Jul 23 22:01:14.778899 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b767cc24-e24d-47f4-a1e5-baf371945e6e tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Request method failure captured: Jul 23 22:01:14.778899 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/a91bf2ce-9a7f-461c-93d4-baaa04d10d53 HTTP/1.1 Jul 23 22:01:14.778899 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 22:01:14.778899 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 22:01:14.778899 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 22:01:14.778899 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 22:01:14.778899 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 22:01:14.778899 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 22:01:14.778899 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 22:01:14.778899 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 22:01:14.778899 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3G5zenNQoGAgOnzvIlJaai-gziA5yMme9kZwxxrq2OwWiDMLl-dUF-XE3626KKfhD-N8cY1a9u6XXCRLdMFVsisJNTfK5xVs8wz60dDWCP6QSNbyt-jy1AKDyGzSQRBdVEEWeoKMqkilvA_v0S2vWwpnaqGtSJ3eyd-XByOeDDg16TA Jul 23 22:01:14.778899 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 22:01:14.778899 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 22:01:14.778899 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 22:01:14.778899 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 22:01:14.778899 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 22:01:14.778899 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 22:01:14.778899 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 7f624e0dec4a4f64b1d3580e60867c41 Jul 23 22:01:14.778899 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServerActionsTestJSON-140818405 Jul 23 22:01:14.778899 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 22:01:14.778899 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 22:01:14.778899 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7f624e0dec4a4f64b1d3580e60867c41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7f624e0dec4a4f64b1d3580e60867c41"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_7f624e0dec4a4f64b1d3580e60867c41", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/7f624e0dec4a4f64b1d3580e60867c41"}]}] Jul 23 22:01:14.778899 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServerActionsTestJSON-140818405 Jul 23 22:01:14.778899 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 7f624e0dec4a4f64b1d3580e60867c41 Jul 23 22:01:14.778899 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServerActionsTestJSON-140818405 Jul 23 22:01:14.778899 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServerActionsTestJSON-140818405-project Jul 23 22:01:14.778899 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 22:01:14.778899 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 22:01:14.778899 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: b5408fb2f4044c6d88527222b190230d Jul 23 22:01:14.778899 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServerActionsTestJSON-140818405-project Jul 23 22:01:14.778899 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 22:01:14.778899 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance a91bf2ce-9a7f-461c-93d4-baaa04d10d53 could not be found. Jul 23 22:01:14.778899 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': 'a91bf2ce-9a7f-461c-93d4-baaa04d10d53'} Jul 23 22:01:14.778899 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 22:01:14.778899 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:01:14.778899 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 22:01:14.778899 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 22:01:14.778899 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 22:01:14.778899 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 22:01:14.778899 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 22:01:14.778899 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 22:01:14.778899 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 22:01:14.778899 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 22:01:14.778899 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a91bf2ce-9a7f-461c-93d4-baaa04d10d53 could not be found. Jul 23 22:01:14.778899 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:01:14.778899 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:01:14.778899 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:01:14.778899 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:01:14.778899 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:01:14.778899 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:01:14.778899 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 22:01:14.778899 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 22:01:14.778899 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 22:01:14.778899 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 22:01:14.778899 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 22:01:14.778899 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 22:01:14.778899 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 22:01:14.778899 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 22:01:14.778899 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 22:01:14.778899 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 22:01:14.778899 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a91bf2ce-9a7f-461c-93d4-baaa04d10d53 could not be found. Jul 23 22:01:14.778899 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:01:14.778899 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:01:14.778899 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:01:14.783722 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:01:14.783722 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:01:14.783722 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:01:14.783722 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 22:01:14.783722 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 22:01:14.783722 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a91bf2ce-9a7f-461c-93d4-baaa04d10d53 could not be found. Jul 23 22:01:14.783722 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:01:14.783722 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b767cc24-e24d-47f4-a1e5-baf371945e6e tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Returning 404 to user: Instance a91bf2ce-9a7f-461c-93d4-baaa04d10d53 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 22:01:14.783722 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b767cc24-e24d-47f4-a1e5-baf371945e6e tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/a91bf2ce-9a7f-461c-93d4-baaa04d10d53" status: 404 len: 111 microversion: 2.1 time: 0.031214 Jul 23 22:01:14.783722 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3098/5708] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:01:14 2022] GET /compute/v2.1/servers/a91bf2ce-9a7f-461c-93d4-baaa04d10d53 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 22:01:14.788548 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-30746b08-2600-4d27-9607-94da63cff835 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:01:14.789048 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-30746b08-2600-4d27-9607-94da63cff835 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:01:14.795100 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-30746b08-2600-4d27-9607-94da63cff835 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:14.795564 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-30746b08-2600-4d27-9607-94da63cff835 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:14.796337 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-30746b08-2600-4d27-9607-94da63cff835 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:14.796787 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-30746b08-2600-4d27-9607-94da63cff835 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:14.822874 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-30746b08-2600-4d27-9607-94da63cff835 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Going to try to terminate instance {{(pid=131320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 22:01:14.910087 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-30746b08-2600-4d27-9607-94da63cff835 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "DELETE /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 204 len: 0 microversion: 2.1 time: 0.124786 Jul 23 22:01:14.910709 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3099/5709] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 22:01:14 2022] DELETE /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 23 22:01:14.919527 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-dfe28266-74cb-4797-8f88-4ca7768de5f7 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:01:14.920241 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-dfe28266-74cb-4797-8f88-4ca7768de5f7 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:01:14.926319 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dfe28266-74cb-4797-8f88-4ca7768de5f7 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:14.926789 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dfe28266-74cb-4797-8f88-4ca7768de5f7 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:14.927573 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dfe28266-74cb-4797-8f88-4ca7768de5f7 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:14.928026 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dfe28266-74cb-4797-8f88-4ca7768de5f7 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:15.065347 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-dfe28266-74cb-4797-8f88-4ca7768de5f7 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:01:15.073347 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-dfe28266-74cb-4797-8f88-4ca7768de5f7 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1676 microversion: 2.1 time: 0.158068 Jul 23 22:01:15.073963 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3100/5710] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:01:14 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:01:16.095564 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e60cb924-ef03-42cd-a9a1-c7cc4e7003da tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:01:16.096501 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e60cb924-ef03-42cd-a9a1-c7cc4e7003da tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:01:16.101139 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=5 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:01:16.107516 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e60cb924-ef03-42cd-a9a1-c7cc4e7003da tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:16.107981 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e60cb924-ef03-42cd-a9a1-c7cc4e7003da tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:16.108774 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e60cb924-ef03-42cd-a9a1-c7cc4e7003da tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:16.109228 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e60cb924-ef03-42cd-a9a1-c7cc4e7003da tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:16.250366 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e60cb924-ef03-42cd-a9a1-c7cc4e7003da tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:01:16.260634 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e60cb924-ef03-42cd-a9a1-c7cc4e7003da tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1676 microversion: 2.1 time: 0.172352 Jul 23 22:01:16.261250 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3101/5711] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:01:16 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1676 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:01:17.278364 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8b395e32-5fe7-4ddc-b649-d00794b1841b tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:01:17.279050 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8b395e32-5fe7-4ddc-b649-d00794b1841b tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:01:17.286424 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8b395e32-5fe7-4ddc-b649-d00794b1841b tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:17.286881 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8b395e32-5fe7-4ddc-b649-d00794b1841b tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:17.288127 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8b395e32-5fe7-4ddc-b649-d00794b1841b tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:17.288567 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8b395e32-5fe7-4ddc-b649-d00794b1841b tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:17.533016 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8b395e32-5fe7-4ddc-b649-d00794b1841b tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5408fb2f4044c6d88527222b190230d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f624e0dec4a4f64b1d3580e60867c41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:01:17.541307 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8b395e32-5fe7-4ddc-b649-d00794b1841b tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 200 len: 1676 microversion: 2.1 time: 0.266971 Jul 23 22:01:17.541965 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3102/5712] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:01:17 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 1676 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:01:18.098394 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-94e8dd1c-0642-4b57-9962-c1ba48289781 req-d527aee5-1702-450d-aefa-d6eb9ad1bc84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c96aa13-cbff-4245-a45b-418f131a0841", "name": "network-vif-deleted", "tag": "a5aede91-0293-4461-849f-3a91ad088518"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:01:18.107175 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-94e8dd1c-0642-4b57-9962-c1ba48289781 req-d527aee5-1702-450d-aefa-d6eb9ad1bc84 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:18.107730 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-94e8dd1c-0642-4b57-9962-c1ba48289781 req-d527aee5-1702-450d-aefa-d6eb9ad1bc84 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:18.119764 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-94e8dd1c-0642-4b57-9962-c1ba48289781 req-d527aee5-1702-450d-aefa-d6eb9ad1bc84 service nova] Creating event network-vif-deleted:a5aede91-0293-4461-849f-3a91ad088518 for instance 9c96aa13-cbff-4245-a45b-418f131a0841 on nch2-master-1 Jul 23 22:01:18.125097 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-94e8dd1c-0642-4b57-9962-c1ba48289781 req-d527aee5-1702-450d-aefa-d6eb9ad1bc84 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030344 Jul 23 22:01:18.125991 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3103/5713] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:01:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:01:18.561265 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-103857bf-a1f2-41d2-9cad-c2680c2b5e06 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:01:18.562935 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-103857bf-a1f2-41d2-9cad-c2680c2b5e06 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] [instance: 9c96aa13-cbff-4245-a45b-418f131a0841] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:01:18.569837 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-103857bf-a1f2-41d2-9cad-c2680c2b5e06 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:18.570450 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-103857bf-a1f2-41d2-9cad-c2680c2b5e06 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:18.571433 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-103857bf-a1f2-41d2-9cad-c2680c2b5e06 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:18.572101 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-103857bf-a1f2-41d2-9cad-c2680c2b5e06 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:18.586233 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-103857bf-a1f2-41d2-9cad-c2680c2b5e06 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] HTTP exception thrown: Instance 9c96aa13-cbff-4245-a45b-418f131a0841 could not be found. Jul 23 22:01:18.588110 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-103857bf-a1f2-41d2-9cad-c2680c2b5e06 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Request method failure captured: Jul 23 22:01:18.588110 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 HTTP/1.1 Jul 23 22:01:18.588110 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 22:01:18.588110 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 22:01:18.588110 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 22:01:18.588110 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 22:01:18.588110 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 22:01:18.588110 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 22:01:18.588110 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 22:01:18.588110 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 22:01:18.588110 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3G5zenNQoGAgOnzvIlJaai-gziA5yMme9kZwxxrq2OwWiDMLl-dUF-XE3626KKfhD-N8cY1a9u6XXCRLdMFVsisJNTfK5xVs8wz60dDWCP6QSNbyt-jy1AKDyGzSQRBdVEEWeoKMqkilvA_v0S2vWwpnaqGtSJ3eyd-XByOeDDg16TA Jul 23 22:01:18.588110 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 22:01:18.588110 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 22:01:18.588110 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 22:01:18.588110 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 22:01:18.588110 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 22:01:18.588110 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 22:01:18.588110 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 7f624e0dec4a4f64b1d3580e60867c41 Jul 23 22:01:18.588110 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServerActionsTestJSON-140818405 Jul 23 22:01:18.588110 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 22:01:18.588110 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 22:01:18.588110 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7f624e0dec4a4f64b1d3580e60867c41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7f624e0dec4a4f64b1d3580e60867c41"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_7f624e0dec4a4f64b1d3580e60867c41", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/7f624e0dec4a4f64b1d3580e60867c41"}]}] Jul 23 22:01:18.588110 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServerActionsTestJSON-140818405 Jul 23 22:01:18.588110 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 7f624e0dec4a4f64b1d3580e60867c41 Jul 23 22:01:18.588110 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServerActionsTestJSON-140818405 Jul 23 22:01:18.588110 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServerActionsTestJSON-140818405-project Jul 23 22:01:18.588110 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 22:01:18.588110 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 22:01:18.588110 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: b5408fb2f4044c6d88527222b190230d Jul 23 22:01:18.588110 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServerActionsTestJSON-140818405-project Jul 23 22:01:18.588110 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 22:01:18.588110 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance 9c96aa13-cbff-4245-a45b-418f131a0841 could not be found. Jul 23 22:01:18.588110 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '9c96aa13-cbff-4245-a45b-418f131a0841'} Jul 23 22:01:18.588110 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 22:01:18.588110 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:01:18.588110 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 22:01:18.588110 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 22:01:18.588110 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 22:01:18.588110 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 22:01:18.588110 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 22:01:18.588110 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 22:01:18.588110 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 22:01:18.588110 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 22:01:18.588110 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c96aa13-cbff-4245-a45b-418f131a0841 could not be found. Jul 23 22:01:18.588110 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:01:18.588110 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:01:18.588110 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:01:18.588110 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:01:18.588110 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:01:18.588110 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:01:18.588110 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 22:01:18.588110 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 22:01:18.588110 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 22:01:18.588110 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 22:01:18.588110 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 22:01:18.588110 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 22:01:18.588110 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 22:01:18.588110 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 22:01:18.588110 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 22:01:18.588110 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 22:01:18.588110 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c96aa13-cbff-4245-a45b-418f131a0841 could not be found. Jul 23 22:01:18.588110 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:01:18.588110 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:01:18.588110 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:01:18.592362 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:01:18.592362 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:01:18.592362 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:01:18.592362 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 22:01:18.592362 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 22:01:18.592362 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c96aa13-cbff-4245-a45b-418f131a0841 could not be found. Jul 23 22:01:18.592362 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:01:18.592362 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-103857bf-a1f2-41d2-9cad-c2680c2b5e06 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Returning 404 to user: Instance 9c96aa13-cbff-4245-a45b-418f131a0841 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 22:01:18.592362 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-103857bf-a1f2-41d2-9cad-c2680c2b5e06 tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841" status: 404 len: 111 microversion: 2.1 time: 0.034232 Jul 23 22:01:18.594448 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3104/5714] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:01:18 2022] GET /compute/v2.1/servers/9c96aa13-cbff-4245-a45b-418f131a0841 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 23 22:01:18.599045 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-98517809-a3e4-4163-a7aa-920085fbcddc tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] Calling method '.version_select at 0x7f0b4779a8b0>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:01:18.619691 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-98517809-a3e4-4163-a7aa-920085fbcddc tempest-ServerActionsTestJSON-140818405 tempest-ServerActionsTestJSON-140818405-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2057660710" status: 202 len: 0 microversion: 2.1 time: 0.024093 Jul 23 22:01:18.620203 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3105/5715] 10.222.0.17 () {58 vars in 1220 bytes} [Sat Jul 23 22:01:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2057660710 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 22:01:27.927328 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-27ca26d7-6af4-4d08-bec8-aa32e44a78d0 tempest-ServerGroup264TestJSON-516060215 tempest-ServerGroup264TestJSON-516060215-project] Action: 'create', calling method: .version_select at 0x7f0b47fc43a0>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:01:27.946300 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-27ca26d7-6af4-4d08-bec8-aa32e44a78d0 tempest-ServerGroup264TestJSON-516060215 tempest-ServerGroup264TestJSON-516060215-project] Getting quotas for project 5a1e48bc49cd4a3996dd57c72ad2266f. Resources: {'server_groups'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 22:01:27.953667 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-27ca26d7-6af4-4d08-bec8-aa32e44a78d0 tempest-ServerGroup264TestJSON-516060215 tempest-ServerGroup264TestJSON-516060215-project] Getting quotas for user 38b5e24cb177465a97ed2fc983e68f70 and project 5a1e48bc49cd4a3996dd57c72ad2266f. Resources: {'server_groups'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 22:01:28.005685 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-27ca26d7-6af4-4d08-bec8-aa32e44a78d0 tempest-ServerGroup264TestJSON-516060215 tempest-ServerGroup264TestJSON-516060215-project] Getting quotas for project 5a1e48bc49cd4a3996dd57c72ad2266f. Resources: {'server_groups'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 22:01:28.011550 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-27ca26d7-6af4-4d08-bec8-aa32e44a78d0 tempest-ServerGroup264TestJSON-516060215 tempest-ServerGroup264TestJSON-516060215-project] Getting quotas for user 38b5e24cb177465a97ed2fc983e68f70 and project 5a1e48bc49cd4a3996dd57c72ad2266f. Resources: {'server_groups'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 22:01:28.025963 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-27ca26d7-6af4-4d08-bec8-aa32e44a78d0 tempest-ServerGroup264TestJSON-516060215 tempest-ServerGroup264TestJSON-516060215-project] 10.222.0.17 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.248883 Jul 23 22:01:28.031557 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3106/5716] 10.222.0.17 () {62 vars in 1213 bytes} [Sat Jul 23 22:01:27 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 23 22:01:28.036979 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-88d5df5b-966a-45e8-ac44-1a8a2a28a20a tempest-ServerGroup264TestJSON-516060215 tempest-ServerGroup264TestJSON-516060215-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:01:28.051893 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-88d5df5b-966a-45e8-ac44-1a8a2a28a20a tempest-ServerGroup264TestJSON-516060215 tempest-ServerGroup264TestJSON-516060215-project] 10.222.0.17 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.018900 Jul 23 22:01:28.057060 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3107/5717] 10.222.0.17 () {60 vars in 1192 bytes} [Sat Jul 23 22:01:28 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 23 22:01:28.063378 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9b3cdd77-dc57-4a79-a352-cd0b414aaa82 tempest-ServerGroup264TestJSON-516060215 tempest-ServerGroup264TestJSON-516060215-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:01:28.072802 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9b3cdd77-dc57-4a79-a352-cd0b414aaa82 tempest-ServerGroup264TestJSON-516060215 tempest-ServerGroup264TestJSON-516060215-project] 10.222.0.17 "GET /compute/v2.1/os-server-groups/fd145fde-c0a9-4dc2-9153-9f9f866c351b" status: 200 len: 235 microversion: 2.64 time: 0.013671 Jul 23 22:01:28.073854 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3108/5718] 10.222.0.17 () {60 vars in 1303 bytes} [Sat Jul 23 22:01:28 2022] GET /compute/v2.1/os-server-groups/fd145fde-c0a9-4dc2-9153-9f9f866c351b => generated 235 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 23 22:01:28.083935 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-453ce3bb-bd5a-4599-8e83-f1a478f7f0e8 tempest-ServerGroup264TestJSON-516060215 tempest-ServerGroup264TestJSON-516060215-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:01:28.112691 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-453ce3bb-bd5a-4599-8e83-f1a478f7f0e8 tempest-ServerGroup264TestJSON-516060215 tempest-ServerGroup264TestJSON-516060215-project] 10.222.0.17 "DELETE /compute/v2.1/os-server-groups/fd145fde-c0a9-4dc2-9153-9f9f866c351b" status: 204 len: 0 microversion: 2.64 time: 0.032617 Jul 23 22:01:28.113512 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3109/5719] 10.222.0.17 () {60 vars in 1306 bytes} [Sat Jul 23 22:01:28 2022] DELETE /compute/v2.1/os-server-groups/fd145fde-c0a9-4dc2-9153-9f9f866c351b => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 23 22:01:28.122698 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-dd88e67f-d195-46be-ae08-ed575e0b6621 tempest-ServerGroup264TestJSON-516060215 tempest-ServerGroup264TestJSON-516060215-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:01:28.130328 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-dd88e67f-d195-46be-ae08-ed575e0b6621 tempest-ServerGroup264TestJSON-516060215 tempest-ServerGroup264TestJSON-516060215-project] HTTP exception thrown: Instance group fd145fde-c0a9-4dc2-9153-9f9f866c351b could not be found. Jul 23 22:01:28.146839 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-dd88e67f-d195-46be-ae08-ed575e0b6621 tempest-ServerGroup264TestJSON-516060215 tempest-ServerGroup264TestJSON-516060215-project] Request method failure captured: Jul 23 22:01:28.146839 ncdv-master-1 devstack@n-api.service[131320]: request: DELETE /compute/v2.1/os-server-groups/fd145fde-c0a9-4dc2-9153-9f9f866c351b HTTP/1.1 Jul 23 22:01:28.146839 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 22:01:28.146839 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 22:01:28.146839 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 22:01:28.146839 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 22:01:28.146839 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 22:01:28.146839 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 22:01:28.146839 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 22:01:28.146839 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 22:01:28.146839 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3G-3-zTPKqVbpKRmbOgv7yr2GfVHD_s-kuOEWLf_yaA4ezZsDcESDi3GTfSV4Ezx-e9N7dfpDCAzLucyw2e_V2jS7S5TjScvDcafZC4vIBojRoogVLaKqdEsy7Npdmx09NL1LYjVQdux0a1L02nvFHuf4g40_le-2IMpPUBDu5jV39U Jul 23 22:01:28.146839 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 22:01:28.146839 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 22:01:28.146839 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 22:01:28.146839 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 22:01:28.146839 ncdv-master-1 devstack@n-api.service[131320]: X-Openstack-Nova-Api-Version: 2.64 Jul 23 22:01:28.146839 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 22:01:28.146839 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 22:01:28.146839 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 5a1e48bc49cd4a3996dd57c72ad2266f Jul 23 22:01:28.146839 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServerGroup264TestJSON-516060215 Jul 23 22:01:28.146839 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 22:01:28.146839 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 22:01:28.146839 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5a1e48bc49cd4a3996dd57c72ad2266f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5a1e48bc49cd4a3996dd57c72ad2266f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_5a1e48bc49cd4a3996dd57c72ad2266f", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/5a1e48bc49cd4a3996dd57c72ad2266f"}]}] Jul 23 22:01:28.146839 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServerGroup264TestJSON-516060215 Jul 23 22:01:28.146839 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 5a1e48bc49cd4a3996dd57c72ad2266f Jul 23 22:01:28.146839 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServerGroup264TestJSON-516060215 Jul 23 22:01:28.146839 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServerGroup264TestJSON-516060215-project Jul 23 22:01:28.146839 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 22:01:28.146839 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 22:01:28.146839 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 38b5e24cb177465a97ed2fc983e68f70 Jul 23 22:01:28.146839 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServerGroup264TestJSON-516060215-project Jul 23 22:01:28.146839 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 22:01:28.146839 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance group fd145fde-c0a9-4dc2-9153-9f9f866c351b could not be found. Jul 23 22:01:28.146839 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': 'fd145fde-c0a9-4dc2-9153-9f9f866c351b'} Jul 23 22:01:28.146839 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 22:01:28.146839 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:01:28.146839 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 23 22:01:28.146839 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 23 22:01:28.146839 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 23 22:01:28.146839 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 23 22:01:28.146839 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 23 22:01:28.146839 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 23 22:01:28.146839 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 23 22:01:28.146839 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 23 22:01:28.146839 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 23 22:01:28.146839 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 23 22:01:28.146839 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group fd145fde-c0a9-4dc2-9153-9f9f866c351b could not be found. Jul 23 22:01:28.146839 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:01:28.146839 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:01:28.146839 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:01:28.146839 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:01:28.146839 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:01:28.146839 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:01:28.146839 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 22:01:28.146839 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 22:01:28.146839 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 22:01:28.146839 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 22:01:28.146839 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 23 22:01:28.146839 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 23 22:01:28.146839 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group fd145fde-c0a9-4dc2-9153-9f9f866c351b could not be found. Jul 23 22:01:28.146839 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:01:28.146839 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:01:28.146839 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:01:28.146839 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:01:28.152374 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:01:28.152374 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:01:28.152374 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 22:01:28.152374 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 22:01:28.152374 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group fd145fde-c0a9-4dc2-9153-9f9f866c351b could not be found. Jul 23 22:01:28.152374 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:01:28.152374 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-dd88e67f-d195-46be-ae08-ed575e0b6621 tempest-ServerGroup264TestJSON-516060215 tempest-ServerGroup264TestJSON-516060215-project] Returning 404 to user: Instance group fd145fde-c0a9-4dc2-9153-9f9f866c351b could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 22:01:28.152374 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-dd88e67f-d195-46be-ae08-ed575e0b6621 tempest-ServerGroup264TestJSON-516060215 tempest-ServerGroup264TestJSON-516060215-project] 10.222.0.17 "DELETE /compute/v2.1/os-server-groups/fd145fde-c0a9-4dc2-9153-9f9f866c351b" status: 404 len: 117 microversion: 2.64 time: 0.030015 Jul 23 22:01:28.152374 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3110/5720] 10.222.0.17 () {60 vars in 1306 bytes} [Sat Jul 23 22:01:28 2022] DELETE /compute/v2.1/os-server-groups/fd145fde-c0a9-4dc2-9153-9f9f866c351b => generated 117 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 23 22:01:36.818696 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:01:36.964264 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0f4dbfba-418c-4cae-a0a6-7873d957507b tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Action: 'create', calling method: .version_select at 0x7f0b467d6f70>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-241735073", "policies": ["affinity"]}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:01:36.980917 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-0f4dbfba-418c-4cae-a0a6-7873d957507b tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Getting quotas for project 85920446208748ee806840fe4b2b9414. Resources: {'server_groups'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 22:01:36.987390 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-0f4dbfba-418c-4cae-a0a6-7873d957507b tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Getting quotas for user 98e4e707d5684b82b6548010a3d94263 and project 85920446208748ee806840fe4b2b9414. Resources: {'server_groups'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 22:01:37.032584 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-0f4dbfba-418c-4cae-a0a6-7873d957507b tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Getting quotas for project 85920446208748ee806840fe4b2b9414. Resources: {'server_groups'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 22:01:37.038496 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-0f4dbfba-418c-4cae-a0a6-7873d957507b tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Getting quotas for user 98e4e707d5684b82b6548010a3d94263 and project 85920446208748ee806840fe4b2b9414. Resources: {'server_groups'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 22:01:37.053589 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-0f4dbfba-418c-4cae-a0a6-7873d957507b tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] 10.222.0.17 "POST /compute/v2.1/os-server-groups" status: 200 len: 183 microversion: 2.1 time: 0.239866 Jul 23 22:01:37.054230 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3111/5721] 10.222.0.17 () {60 vars in 1173 bytes} [Sat Jul 23 22:01:36 2022] POST /compute/v2.1/os-server-groups => generated 183 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:01:37.064388 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4170a779-01cb-453a-8183-056f6f4c75f0 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Action: 'create', calling method: .version_select at 0x7f0b598c93a0>, body: {"server_group": {"name": "tempest-server-group-981361648", "policies": ["affinity"]}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:01:37.081698 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-4170a779-01cb-453a-8183-056f6f4c75f0 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Getting quotas for project 85920446208748ee806840fe4b2b9414. Resources: {'server_groups'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 22:01:37.087241 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-4170a779-01cb-453a-8183-056f6f4c75f0 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Getting quotas for user 98e4e707d5684b82b6548010a3d94263 and project 85920446208748ee806840fe4b2b9414. Resources: {'server_groups'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 22:01:37.125102 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=4,nova_api:INSERT=6 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:01:37.132632 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-4170a779-01cb-453a-8183-056f6f4c75f0 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Getting quotas for project 85920446208748ee806840fe4b2b9414. Resources: {'server_groups'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 22:01:37.139121 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-4170a779-01cb-453a-8183-056f6f4c75f0 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Getting quotas for user 98e4e707d5684b82b6548010a3d94263 and project 85920446208748ee806840fe4b2b9414. Resources: {'server_groups'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 22:01:37.152758 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4170a779-01cb-453a-8183-056f6f4c75f0 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] 10.222.0.17 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.092153 Jul 23 22:01:37.158423 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3112/5722] 10.222.0.17 () {60 vars in 1172 bytes} [Sat Jul 23 22:01:37 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 22:01:37.163676 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-677ec193-08af-48ed-a248-29737427c705 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Action: 'create', calling method: .version_select at 0x7f0b467d6dc0>, body: {"server_group": {"name": "tempest-server-group-981361648", "policies": ["affinity"]}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:01:37.180168 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-677ec193-08af-48ed-a248-29737427c705 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Getting quotas for project 85920446208748ee806840fe4b2b9414. Resources: {'server_groups'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 22:01:37.185723 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-677ec193-08af-48ed-a248-29737427c705 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Getting quotas for user 98e4e707d5684b82b6548010a3d94263 and project 85920446208748ee806840fe4b2b9414. Resources: {'server_groups'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 22:01:37.252250 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-677ec193-08af-48ed-a248-29737427c705 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Getting quotas for project 85920446208748ee806840fe4b2b9414. Resources: {'server_groups'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 22:01:37.257238 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-677ec193-08af-48ed-a248-29737427c705 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Getting quotas for user 98e4e707d5684b82b6548010a3d94263 and project 85920446208748ee806840fe4b2b9414. Resources: {'server_groups'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 22:01:37.269897 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-677ec193-08af-48ed-a248-29737427c705 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] 10.222.0.17 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.110231 Jul 23 22:01:37.271594 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3113/5723] 10.222.0.17 () {60 vars in 1172 bytes} [Sat Jul 23 22:01:37 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:01:37.281476 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4563fc43-ea2b-4a93-932c-441e28e60a02 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:01:37.307288 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4563fc43-ea2b-4a93-932c-441e28e60a02 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] 10.222.0.17 "DELETE /compute/v2.1/os-server-groups/406e6cd4-3087-4430-9603-9c397687c3a2" status: 204 len: 0 microversion: 2.1 time: 0.029766 Jul 23 22:01:37.307891 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3114/5724] 10.222.0.17 () {58 vars in 1265 bytes} [Sat Jul 23 22:01:37 2022] DELETE /compute/v2.1/os-server-groups/406e6cd4-3087-4430-9603-9c397687c3a2 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 22:01:37.315671 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2038aca1-2ac0-48bc-a77d-3781edae297b tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:01:37.325812 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2038aca1-2ac0-48bc-a77d-3781edae297b tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] 10.222.0.17 "GET /compute/v2.1/os-server-groups" status: 200 len: 333 microversion: 2.1 time: 0.013678 Jul 23 22:01:37.326794 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3115/5725] 10.222.0.17 () {58 vars in 1151 bytes} [Sat Jul 23 22:01:37 2022] GET /compute/v2.1/os-server-groups => generated 333 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 22:01:37.336633 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d9ee817e-ab52-4765-a94b-b815f6ed5f56 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:01:37.363145 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d9ee817e-ab52-4765-a94b-b815f6ed5f56 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] 10.222.0.17 "DELETE /compute/v2.1/os-server-groups/29b1a191-401c-47dc-b8e2-85261c7c31a0" status: 204 len: 0 microversion: 2.1 time: 0.030452 Jul 23 22:01:37.363866 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3116/5726] 10.222.0.17 () {58 vars in 1265 bytes} [Sat Jul 23 22:01:37 2022] DELETE /compute/v2.1/os-server-groups/29b1a191-401c-47dc-b8e2-85261c7c31a0 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 23 22:01:37.371853 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-84e46cce-788f-4f18-b157-b2f1c5f72c0b tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:01:37.381015 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-84e46cce-788f-4f18-b157-b2f1c5f72c0b tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] 10.222.0.17 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.012868 Jul 23 22:01:37.381785 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3117/5727] 10.222.0.17 () {58 vars in 1151 bytes} [Sat Jul 23 22:01:37 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 22:01:37.392884 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8f8d96f4-984c-4091-ab64-83a49e9d96b0 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Action: 'create', calling method: .version_select at 0x7f0b47d08670>, body: {"server_group": {"name": "tempest-server-group-729910580", "policies": ["affinity"]}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:01:37.408885 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-8f8d96f4-984c-4091-ab64-83a49e9d96b0 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Getting quotas for project 85920446208748ee806840fe4b2b9414. Resources: {'server_groups'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 22:01:37.414809 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-8f8d96f4-984c-4091-ab64-83a49e9d96b0 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Getting quotas for user 98e4e707d5684b82b6548010a3d94263 and project 85920446208748ee806840fe4b2b9414. Resources: {'server_groups'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 22:01:37.456236 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-8f8d96f4-984c-4091-ab64-83a49e9d96b0 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Getting quotas for project 85920446208748ee806840fe4b2b9414. Resources: {'server_groups'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 22:01:37.461459 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-8f8d96f4-984c-4091-ab64-83a49e9d96b0 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Getting quotas for user 98e4e707d5684b82b6548010a3d94263 and project 85920446208748ee806840fe4b2b9414. Resources: {'server_groups'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 22:01:37.475018 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8f8d96f4-984c-4091-ab64-83a49e9d96b0 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] 10.222.0.17 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.085905 Jul 23 22:01:37.480419 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3118/5728] 10.222.0.17 () {60 vars in 1172 bytes} [Sat Jul 23 22:01:37 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:01:37.485985 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0e832bd8-af26-4c1d-9e15-5634832c14c8 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:01:37.515332 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-0e832bd8-af26-4c1d-9e15-5634832c14c8 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] 10.222.0.17 "DELETE /compute/v2.1/os-server-groups/ca810552-4db9-4cfa-aef8-0c37d5e220f8" status: 204 len: 0 microversion: 2.1 time: 0.033540 Jul 23 22:01:37.516632 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3119/5729] 10.222.0.17 () {58 vars in 1265 bytes} [Sat Jul 23 22:01:37 2022] DELETE /compute/v2.1/os-server-groups/ca810552-4db9-4cfa-aef8-0c37d5e220f8 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 22:01:37.526578 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2b6b4937-d5ff-4b00-94bf-3cd4758d48ba tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:01:37.542378 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2b6b4937-d5ff-4b00-94bf-3cd4758d48ba tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] 10.222.0.17 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.021534 Jul 23 22:01:37.543260 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3120/5730] 10.222.0.17 () {58 vars in 1151 bytes} [Sat Jul 23 22:01:37 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 22:01:37.554173 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9bcc67af-1543-4086-9a53-c08a0b5b221e tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Action: 'create', calling method: .version_select at 0x7f0b464823a0>, body: {"server_group": {"name": "tempest-server-group-441129296", "policies": ["anti-affinity"]}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:01:37.570571 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-9bcc67af-1543-4086-9a53-c08a0b5b221e tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Getting quotas for project 85920446208748ee806840fe4b2b9414. Resources: {'server_groups'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 22:01:37.577337 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-9bcc67af-1543-4086-9a53-c08a0b5b221e tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Getting quotas for user 98e4e707d5684b82b6548010a3d94263 and project 85920446208748ee806840fe4b2b9414. Resources: {'server_groups'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 22:01:37.587758 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=4,nova_api:DELETE=9 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:01:37.622169 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-9bcc67af-1543-4086-9a53-c08a0b5b221e tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Getting quotas for project 85920446208748ee806840fe4b2b9414. Resources: {'server_groups'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 22:01:37.627364 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-9bcc67af-1543-4086-9a53-c08a0b5b221e tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Getting quotas for user 98e4e707d5684b82b6548010a3d94263 and project 85920446208748ee806840fe4b2b9414. Resources: {'server_groups'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 22:01:37.640875 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9bcc67af-1543-4086-9a53-c08a0b5b221e tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] 10.222.0.17 "POST /compute/v2.1/os-server-groups" status: 200 len: 168 microversion: 2.1 time: 0.090580 Jul 23 22:01:37.641816 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3121/5731] 10.222.0.17 () {60 vars in 1172 bytes} [Sat Jul 23 22:01:37 2022] POST /compute/v2.1/os-server-groups => generated 168 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:01:37.652720 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c5060897-6f32-4cbe-8e1f-040787b78c3c tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:01:37.680414 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c5060897-6f32-4cbe-8e1f-040787b78c3c tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] 10.222.0.17 "DELETE /compute/v2.1/os-server-groups/304a189c-fcaa-4340-9af2-aba6ac1a16b4" status: 204 len: 0 microversion: 2.1 time: 0.032918 Jul 23 22:01:37.681350 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3122/5732] 10.222.0.17 () {58 vars in 1265 bytes} [Sat Jul 23 22:01:37 2022] DELETE /compute/v2.1/os-server-groups/304a189c-fcaa-4340-9af2-aba6ac1a16b4 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 22:01:37.689808 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-77d863d5-57d2-42ff-bcd7-4fde528bbf06 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:01:37.700226 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-77d863d5-57d2-42ff-bcd7-4fde528bbf06 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] 10.222.0.17 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.014551 Jul 23 22:01:37.701011 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3123/5733] 10.222.0.17 () {58 vars in 1151 bytes} [Sat Jul 23 22:01:37 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 22:01:37.761382 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-633ce0ac-e006-4482-a033-a8955b07197c tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-422036779", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "networks": [{"uuid": "1e2d2199-aefc-46c2-9609-62a932650b6f"}]}, "os:scheduler_hints": {"group": "88e7a769-e6ba-4833-8e84-6d61bcecdfee"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:01:37.835133 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-633ce0ac-e006-4482-a033-a8955b07197c tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] validate_networks() for [('1e2d2199-aefc-46c2-9609-62a932650b6f', None, None, None, None, None)] {{(pid=131320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 22:01:38.309424 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-633ce0ac-e006-4482-a033-a8955b07197c tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 22:01:38.309848 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-633ce0ac-e006-4482-a033-a8955b07197c tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 22:01:38.310353 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-633ce0ac-e006-4482-a033-a8955b07197c tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 22:01:38.310763 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-633ce0ac-e006-4482-a033-a8955b07197c tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 22:01:38.311210 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-633ce0ac-e006-4482-a033-a8955b07197c tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 22:01:38.326645 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-633ce0ac-e006-4482-a033-a8955b07197c tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:38.327144 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-633ce0ac-e006-4482-a033-a8955b07197c tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:38.328061 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-633ce0ac-e006-4482-a033-a8955b07197c tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:38.328536 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-633ce0ac-e006-4482-a033-a8955b07197c tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:38.347910 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-633ce0ac-e006-4482-a033-a8955b07197c tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Getting quotas for project 85920446208748ee806840fe4b2b9414. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 22:01:38.353686 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-633ce0ac-e006-4482-a033-a8955b07197c tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Getting quotas for user 98e4e707d5684b82b6548010a3d94263 and project 85920446208748ee806840fe4b2b9414. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 22:01:38.366623 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-633ce0ac-e006-4482-a033-a8955b07197c tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Going to run 1 instances... {{(pid=131320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 22:01:38.369049 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-633ce0ac-e006-4482-a033-a8955b07197c tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] [instance: 8460f48b-54ae-4922-ab9a-cd91b18aced2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 22:01:38.423713 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-633ce0ac-e006-4482-a033-a8955b07197c tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Getting quotas for project 85920446208748ee806840fe4b2b9414. Resources: {'server_group_members'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 22:01:38.431620 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-633ce0ac-e006-4482-a033-a8955b07197c tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Getting quotas for user 98e4e707d5684b82b6548010a3d94263 and project 85920446208748ee806840fe4b2b9414. Resources: {'server_group_members'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 22:01:38.468832 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-633ce0ac-e006-4482-a033-a8955b07197c tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Getting quotas for project 85920446208748ee806840fe4b2b9414. Resources: {'server_group_members'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 22:01:38.474198 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-633ce0ac-e006-4482-a033-a8955b07197c tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Getting quotas for user 98e4e707d5684b82b6548010a3d94263 and project 85920446208748ee806840fe4b2b9414. Resources: {'server_group_members'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 22:01:38.501128 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-633ce0ac-e006-4482-a033-a8955b07197c tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.744383 Jul 23 22:01:38.501822 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3124/5734] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 22:01:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 746 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 23 22:01:38.511959 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-64a0a294-eeae-4bca-8250-300be95ee477 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:01:38.512598 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-64a0a294-eeae-4bca-8250-300be95ee477 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] [instance: 8460f48b-54ae-4922-ab9a-cd91b18aced2] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:01:38.572151 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-64a0a294-eeae-4bca-8250-300be95ee477 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e4e707d5684b82b6548010a3d94263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85920446208748ee806840fe4b2b9414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:01:38.580003 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-64a0a294-eeae-4bca-8250-300be95ee477 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] 10.222.0.17 "GET /compute/v2.1/servers/8460f48b-54ae-4922-ab9a-cd91b18aced2" status: 200 len: 1212 microversion: 2.1 time: 0.071994 Jul 23 22:01:38.580619 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3125/5735] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:01:38 2022] GET /compute/v2.1/servers/8460f48b-54ae-4922-ab9a-cd91b18aced2 => generated 1212 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:01:39.604591 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-db59f9fc-c5ec-4a18-be65-0e26ed312ac9 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:01:39.605448 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-db59f9fc-c5ec-4a18-be65-0e26ed312ac9 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] [instance: 8460f48b-54ae-4922-ab9a-cd91b18aced2] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:01:39.614926 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-db59f9fc-c5ec-4a18-be65-0e26ed312ac9 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:39.616404 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-db59f9fc-c5ec-4a18-be65-0e26ed312ac9 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:39.617439 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-db59f9fc-c5ec-4a18-be65-0e26ed312ac9 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:39.618696 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-db59f9fc-c5ec-4a18-be65-0e26ed312ac9 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:39.711081 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-db59f9fc-c5ec-4a18-be65-0e26ed312ac9 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e4e707d5684b82b6548010a3d94263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85920446208748ee806840fe4b2b9414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:01:39.725393 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-db59f9fc-c5ec-4a18-be65-0e26ed312ac9 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] 10.222.0.17 "GET /compute/v2.1/servers/8460f48b-54ae-4922-ab9a-cd91b18aced2" status: 200 len: 1264 microversion: 2.1 time: 0.131258 Jul 23 22:01:39.726865 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3126/5736] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:01:39 2022] GET /compute/v2.1/servers/8460f48b-54ae-4922-ab9a-cd91b18aced2 => generated 1264 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:01:40.744522 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e4021860-1821-4ab0-83d8-71fa57a831e3 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:01:40.745429 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e4021860-1821-4ab0-83d8-71fa57a831e3 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] [instance: 8460f48b-54ae-4922-ab9a-cd91b18aced2] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:01:40.753279 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e4021860-1821-4ab0-83d8-71fa57a831e3 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:40.753797 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e4021860-1821-4ab0-83d8-71fa57a831e3 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:40.754894 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e4021860-1821-4ab0-83d8-71fa57a831e3 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:40.755412 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e4021860-1821-4ab0-83d8-71fa57a831e3 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:40.907304 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e4021860-1821-4ab0-83d8-71fa57a831e3 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e4e707d5684b82b6548010a3d94263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85920446208748ee806840fe4b2b9414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:01:40.915767 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e4021860-1821-4ab0-83d8-71fa57a831e3 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] 10.222.0.17 "GET /compute/v2.1/servers/8460f48b-54ae-4922-ab9a-cd91b18aced2" status: 200 len: 1312 microversion: 2.1 time: 0.175594 Jul 23 22:01:40.916658 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3127/5737] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:01:40 2022] GET /compute/v2.1/servers/8460f48b-54ae-4922-ab9a-cd91b18aced2 => generated 1312 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:01:41.239188 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-7253ac3a-3730-436d-b5c7-b7e4125946b4 req-b5b55a6a-d08c-4878-be19-c66b4d8d4616 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8460f48b-54ae-4922-ab9a-cd91b18aced2", "tag": "0973426a-318b-4fb6-9390-fb750cafa957"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:01:41.249514 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-7253ac3a-3730-436d-b5c7-b7e4125946b4 req-b5b55a6a-d08c-4878-be19-c66b4d8d4616 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:41.250107 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-7253ac3a-3730-436d-b5c7-b7e4125946b4 req-b5b55a6a-d08c-4878-be19-c66b4d8d4616 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:41.275260 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-7253ac3a-3730-436d-b5c7-b7e4125946b4 req-b5b55a6a-d08c-4878-be19-c66b4d8d4616 service nova] Creating event network-changed:0973426a-318b-4fb6-9390-fb750cafa957 for instance 8460f48b-54ae-4922-ab9a-cd91b18aced2 on nch1-master-1 Jul 23 22:01:41.281574 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-7253ac3a-3730-436d-b5c7-b7e4125946b4 req-b5b55a6a-d08c-4878-be19-c66b4d8d4616 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048697 Jul 23 22:01:41.282777 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3128/5738] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:01:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 22:01:41.936326 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-70408bfb-edc4-4e24-ab30-6e7af1747af9 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:01:41.937021 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-70408bfb-edc4-4e24-ab30-6e7af1747af9 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] [instance: 8460f48b-54ae-4922-ab9a-cd91b18aced2] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:01:41.945356 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-70408bfb-edc4-4e24-ab30-6e7af1747af9 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:41.945945 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-70408bfb-edc4-4e24-ab30-6e7af1747af9 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:41.946829 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-70408bfb-edc4-4e24-ab30-6e7af1747af9 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:41.947314 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-70408bfb-edc4-4e24-ab30-6e7af1747af9 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:42.080164 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-70408bfb-edc4-4e24-ab30-6e7af1747af9 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e4e707d5684b82b6548010a3d94263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85920446208748ee806840fe4b2b9414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:01:42.088415 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-70408bfb-edc4-4e24-ab30-6e7af1747af9 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] 10.222.0.17 "GET /compute/v2.1/servers/8460f48b-54ae-4922-ab9a-cd91b18aced2" status: 200 len: 1312 microversion: 2.1 time: 0.157120 Jul 23 22:01:42.088969 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3129/5739] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:01:41 2022] GET /compute/v2.1/servers/8460f48b-54ae-4922-ab9a-cd91b18aced2 => generated 1312 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:01:43.109779 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b5edb4d7-43a4-4d81-a8da-1af9f590ddd5 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:01:43.110508 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b5edb4d7-43a4-4d81-a8da-1af9f590ddd5 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] [instance: 8460f48b-54ae-4922-ab9a-cd91b18aced2] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:01:43.117492 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b5edb4d7-43a4-4d81-a8da-1af9f590ddd5 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:43.117976 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b5edb4d7-43a4-4d81-a8da-1af9f590ddd5 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:43.118738 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b5edb4d7-43a4-4d81-a8da-1af9f590ddd5 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:43.119182 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b5edb4d7-43a4-4d81-a8da-1af9f590ddd5 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:43.257040 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b5edb4d7-43a4-4d81-a8da-1af9f590ddd5 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e4e707d5684b82b6548010a3d94263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85920446208748ee806840fe4b2b9414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:01:43.265075 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b5edb4d7-43a4-4d81-a8da-1af9f590ddd5 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] 10.222.0.17 "GET /compute/v2.1/servers/8460f48b-54ae-4922-ab9a-cd91b18aced2" status: 200 len: 1312 microversion: 2.1 time: 0.159171 Jul 23 22:01:43.265655 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3130/5740] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:01:43 2022] GET /compute/v2.1/servers/8460f48b-54ae-4922-ab9a-cd91b18aced2 => generated 1312 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:01:44.288515 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c0309e6e-a942-4127-bb5f-79f88c4d67a8 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:01:44.289593 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c0309e6e-a942-4127-bb5f-79f88c4d67a8 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] [instance: 8460f48b-54ae-4922-ab9a-cd91b18aced2] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:01:44.303469 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c0309e6e-a942-4127-bb5f-79f88c4d67a8 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:44.304238 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c0309e6e-a942-4127-bb5f-79f88c4d67a8 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:44.305508 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c0309e6e-a942-4127-bb5f-79f88c4d67a8 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:44.306289 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c0309e6e-a942-4127-bb5f-79f88c4d67a8 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:44.440417 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c0309e6e-a942-4127-bb5f-79f88c4d67a8 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e4e707d5684b82b6548010a3d94263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85920446208748ee806840fe4b2b9414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:01:44.448546 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c0309e6e-a942-4127-bb5f-79f88c4d67a8 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] 10.222.0.17 "GET /compute/v2.1/servers/8460f48b-54ae-4922-ab9a-cd91b18aced2" status: 200 len: 1312 microversion: 2.1 time: 0.166635 Jul 23 22:01:44.449124 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3131/5741] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:01:44 2022] GET /compute/v2.1/servers/8460f48b-54ae-4922-ab9a-cd91b18aced2 => generated 1312 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:01:45.473142 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3b05ce0d-b49a-4d96-8623-743d0adf5f52 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:01:45.473900 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-3b05ce0d-b49a-4d96-8623-743d0adf5f52 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] [instance: 8460f48b-54ae-4922-ab9a-cd91b18aced2] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:01:45.481663 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3b05ce0d-b49a-4d96-8623-743d0adf5f52 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:45.482223 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3b05ce0d-b49a-4d96-8623-743d0adf5f52 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:45.483509 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3b05ce0d-b49a-4d96-8623-743d0adf5f52 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:45.483955 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3b05ce0d-b49a-4d96-8623-743d0adf5f52 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:45.622302 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-3b05ce0d-b49a-4d96-8623-743d0adf5f52 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e4e707d5684b82b6548010a3d94263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85920446208748ee806840fe4b2b9414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:01:45.630365 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-3b05ce0d-b49a-4d96-8623-743d0adf5f52 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] 10.222.0.17 "GET /compute/v2.1/servers/8460f48b-54ae-4922-ab9a-cd91b18aced2" status: 200 len: 1312 microversion: 2.1 time: 0.161192 Jul 23 22:01:45.630939 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3132/5742] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:01:45 2022] GET /compute/v2.1/servers/8460f48b-54ae-4922-ab9a-cd91b18aced2 => generated 1312 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:01:46.652370 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0a66829a-6033-48f9-b6bb-3fa3f9d076c4 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:01:46.653148 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-0a66829a-6033-48f9-b6bb-3fa3f9d076c4 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] [instance: 8460f48b-54ae-4922-ab9a-cd91b18aced2] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:01:46.661594 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0a66829a-6033-48f9-b6bb-3fa3f9d076c4 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:46.662180 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0a66829a-6033-48f9-b6bb-3fa3f9d076c4 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:46.663109 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0a66829a-6033-48f9-b6bb-3fa3f9d076c4 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:46.663639 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0a66829a-6033-48f9-b6bb-3fa3f9d076c4 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:46.806573 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-0a66829a-6033-48f9-b6bb-3fa3f9d076c4 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e4e707d5684b82b6548010a3d94263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85920446208748ee806840fe4b2b9414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:01:46.815689 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-0a66829a-6033-48f9-b6bb-3fa3f9d076c4 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] 10.222.0.17 "GET /compute/v2.1/servers/8460f48b-54ae-4922-ab9a-cd91b18aced2" status: 200 len: 1312 microversion: 2.1 time: 0.170036 Jul 23 22:01:46.816286 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3133/5743] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:01:46 2022] GET /compute/v2.1/servers/8460f48b-54ae-4922-ab9a-cd91b18aced2 => generated 1312 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:01:47.142996 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-5674576d-76e1-4209-9f31-cbbb0999f311 req-1eace6b3-1a33-4b14-9fef-c3c0fa804d56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8460f48b-54ae-4922-ab9a-cd91b18aced2", "name": "network-vif-plugged", "status": "completed", "tag": "0973426a-318b-4fb6-9390-fb750cafa957"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:01:47.151222 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-5674576d-76e1-4209-9f31-cbbb0999f311 req-1eace6b3-1a33-4b14-9fef-c3c0fa804d56 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:47.151794 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-5674576d-76e1-4209-9f31-cbbb0999f311 req-1eace6b3-1a33-4b14-9fef-c3c0fa804d56 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:47.162689 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-5674576d-76e1-4209-9f31-cbbb0999f311 req-1eace6b3-1a33-4b14-9fef-c3c0fa804d56 service nova] Creating event network-vif-plugged:0973426a-318b-4fb6-9390-fb750cafa957 for instance 8460f48b-54ae-4922-ab9a-cd91b18aced2 on nch1-master-1 Jul 23 22:01:47.167581 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-5674576d-76e1-4209-9f31-cbbb0999f311 req-1eace6b3-1a33-4b14-9fef-c3c0fa804d56 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094674 Jul 23 22:01:47.168193 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3134/5744] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:01:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:01:47.836150 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ae9ece7c-915e-4287-836d-f0475d580131 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:01:47.837600 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ae9ece7c-915e-4287-836d-f0475d580131 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] [instance: 8460f48b-54ae-4922-ab9a-cd91b18aced2] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:01:47.844959 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ae9ece7c-915e-4287-836d-f0475d580131 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:47.845603 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ae9ece7c-915e-4287-836d-f0475d580131 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:47.846716 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ae9ece7c-915e-4287-836d-f0475d580131 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:47.847397 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ae9ece7c-915e-4287-836d-f0475d580131 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:47.979054 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ae9ece7c-915e-4287-836d-f0475d580131 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e4e707d5684b82b6548010a3d94263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85920446208748ee806840fe4b2b9414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:01:47.988174 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ae9ece7c-915e-4287-836d-f0475d580131 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] 10.222.0.17 "GET /compute/v2.1/servers/8460f48b-54ae-4922-ab9a-cd91b18aced2" status: 200 len: 1312 microversion: 2.1 time: 0.157854 Jul 23 22:01:47.989065 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3135/5745] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:01:47 2022] GET /compute/v2.1/servers/8460f48b-54ae-4922-ab9a-cd91b18aced2 => generated 1312 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:01:49.009266 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ec1fec28-aec0-49d4-8a3e-fb4d09c3574e tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:01:49.010332 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ec1fec28-aec0-49d4-8a3e-fb4d09c3574e tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] [instance: 8460f48b-54ae-4922-ab9a-cd91b18aced2] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:01:49.012761 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:01:49.013557 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=64 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:01:49.020224 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ec1fec28-aec0-49d4-8a3e-fb4d09c3574e tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:49.020681 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ec1fec28-aec0-49d4-8a3e-fb4d09c3574e tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:49.021461 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ec1fec28-aec0-49d4-8a3e-fb4d09c3574e tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:49.021927 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ec1fec28-aec0-49d4-8a3e-fb4d09c3574e tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:49.183882 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ec1fec28-aec0-49d4-8a3e-fb4d09c3574e tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e4e707d5684b82b6548010a3d94263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85920446208748ee806840fe4b2b9414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:01:49.191965 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ec1fec28-aec0-49d4-8a3e-fb4d09c3574e tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] 10.222.0.17 "GET /compute/v2.1/servers/8460f48b-54ae-4922-ab9a-cd91b18aced2" status: 200 len: 1497 microversion: 2.1 time: 0.189232 Jul 23 22:01:49.192574 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3136/5746] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:01:49 2022] GET /compute/v2.1/servers/8460f48b-54ae-4922-ab9a-cd91b18aced2 => generated 1497 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:01:49.208184 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3b052e99-aac7-424a-bf03-83717f465749 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:01:49.221725 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.compute.server_groups [None req-3b052e99-aac7-424a-bf03-83717f465749 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Querying cell 4e90cb14-d4b2-4158-b8cf-a592a1314a7b(cell1) for 1 instances {{(pid=131320) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 23 22:01:49.222750 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3b052e99-aac7-424a-bf03-83717f465749 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:49.223170 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3b052e99-aac7-424a-bf03-83717f465749 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:49.240865 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-3b052e99-aac7-424a-bf03-83717f465749 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] 10.222.0.17 "GET /compute/v2.1/os-server-groups/88e7a769-e6ba-4833-8e84-6d61bcecdfee" status: 200 len: 221 microversion: 2.1 time: 0.036222 Jul 23 22:01:49.241416 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3137/5747] 10.222.0.17 () {58 vars in 1262 bytes} [Sat Jul 23 22:01:49 2022] GET /compute/v2.1/os-server-groups/88e7a769-e6ba-4833-8e84-6d61bcecdfee => generated 221 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:01:49.253348 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1211b6cb-6b0d-4f16-84fe-a47f0026b363 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:01:49.253849 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1211b6cb-6b0d-4f16-84fe-a47f0026b363 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] [instance: 8460f48b-54ae-4922-ab9a-cd91b18aced2] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:01:49.255513 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:01:49.261316 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1211b6cb-6b0d-4f16-84fe-a47f0026b363 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:49.261703 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1211b6cb-6b0d-4f16-84fe-a47f0026b363 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:49.262499 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1211b6cb-6b0d-4f16-84fe-a47f0026b363 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:49.262938 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1211b6cb-6b0d-4f16-84fe-a47f0026b363 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:49.289232 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1211b6cb-6b0d-4f16-84fe-a47f0026b363 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] [instance: 8460f48b-54ae-4922-ab9a-cd91b18aced2] Going to try to terminate instance {{(pid=131320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 22:01:49.367884 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1211b6cb-6b0d-4f16-84fe-a47f0026b363 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] 10.222.0.17 "DELETE /compute/v2.1/servers/8460f48b-54ae-4922-ab9a-cd91b18aced2" status: 204 len: 0 microversion: 2.1 time: 0.117761 Jul 23 22:01:49.368644 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3138/5748] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 22:01:49 2022] DELETE /compute/v2.1/servers/8460f48b-54ae-4922-ab9a-cd91b18aced2 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 22:01:49.377801 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-203d08fc-6ec3-447c-8f34-72f1838ad06f tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:01:49.378551 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-203d08fc-6ec3-447c-8f34-72f1838ad06f tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] [instance: 8460f48b-54ae-4922-ab9a-cd91b18aced2] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:01:49.384659 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-203d08fc-6ec3-447c-8f34-72f1838ad06f tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:49.385139 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-203d08fc-6ec3-447c-8f34-72f1838ad06f tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:49.385919 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-203d08fc-6ec3-447c-8f34-72f1838ad06f tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:49.386403 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-203d08fc-6ec3-447c-8f34-72f1838ad06f tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:49.520566 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-203d08fc-6ec3-447c-8f34-72f1838ad06f tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e4e707d5684b82b6548010a3d94263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85920446208748ee806840fe4b2b9414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:01:49.528729 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-203d08fc-6ec3-447c-8f34-72f1838ad06f tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] 10.222.0.17 "GET /compute/v2.1/servers/8460f48b-54ae-4922-ab9a-cd91b18aced2" status: 200 len: 1503 microversion: 2.1 time: 0.155108 Jul 23 22:01:49.530807 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3139/5749] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:01:49 2022] GET /compute/v2.1/servers/8460f48b-54ae-4922-ab9a-cd91b18aced2 => generated 1503 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:01:50.546625 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-82429392-d70c-4465-9e4f-2976b62d8eba tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:01:50.547478 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-82429392-d70c-4465-9e4f-2976b62d8eba tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] [instance: 8460f48b-54ae-4922-ab9a-cd91b18aced2] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:01:50.554691 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-82429392-d70c-4465-9e4f-2976b62d8eba tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:50.555121 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-82429392-d70c-4465-9e4f-2976b62d8eba tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:50.555912 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-82429392-d70c-4465-9e4f-2976b62d8eba tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:50.556342 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-82429392-d70c-4465-9e4f-2976b62d8eba tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:50.685276 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-82429392-d70c-4465-9e4f-2976b62d8eba tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98e4e707d5684b82b6548010a3d94263', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85920446208748ee806840fe4b2b9414', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:01:50.693484 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-82429392-d70c-4465-9e4f-2976b62d8eba tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] 10.222.0.17 "GET /compute/v2.1/servers/8460f48b-54ae-4922-ab9a-cd91b18aced2" status: 200 len: 1503 microversion: 2.1 time: 0.150946 Jul 23 22:01:50.694221 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3140/5750] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:01:50 2022] GET /compute/v2.1/servers/8460f48b-54ae-4922-ab9a-cd91b18aced2 => generated 1503 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:01:51.204910 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-082c8c0d-7163-4d53-af3a-c52e74f356ae req-31cced09-f7a9-48d7-bc0c-f30ec24f6003 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8460f48b-54ae-4922-ab9a-cd91b18aced2", "name": "network-vif-deleted", "tag": "0973426a-318b-4fb6-9390-fb750cafa957"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:01:51.217245 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-082c8c0d-7163-4d53-af3a-c52e74f356ae req-31cced09-f7a9-48d7-bc0c-f30ec24f6003 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:51.218105 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-082c8c0d-7163-4d53-af3a-c52e74f356ae req-31cced09-f7a9-48d7-bc0c-f30ec24f6003 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:51.233502 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-082c8c0d-7163-4d53-af3a-c52e74f356ae req-31cced09-f7a9-48d7-bc0c-f30ec24f6003 service nova] Creating event network-vif-deleted:0973426a-318b-4fb6-9390-fb750cafa957 for instance 8460f48b-54ae-4922-ab9a-cd91b18aced2 on nch1-master-1 Jul 23 22:01:51.240701 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-082c8c0d-7163-4d53-af3a-c52e74f356ae req-31cced09-f7a9-48d7-bc0c-f30ec24f6003 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039928 Jul 23 22:01:51.241331 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3141/5751] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:01:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:01:51.712026 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9cabdb3d-e2ab-458c-86a2-896d9424fdf0 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:01:51.713138 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-9cabdb3d-e2ab-458c-86a2-896d9424fdf0 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] [instance: 8460f48b-54ae-4922-ab9a-cd91b18aced2] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:01:51.721986 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9cabdb3d-e2ab-458c-86a2-896d9424fdf0 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:51.722623 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9cabdb3d-e2ab-458c-86a2-896d9424fdf0 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:51.723463 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9cabdb3d-e2ab-458c-86a2-896d9424fdf0 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:51.723912 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9cabdb3d-e2ab-458c-86a2-896d9424fdf0 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:51.739638 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-9cabdb3d-e2ab-458c-86a2-896d9424fdf0 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] HTTP exception thrown: Instance 8460f48b-54ae-4922-ab9a-cd91b18aced2 could not be found. Jul 23 22:01:51.741316 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9cabdb3d-e2ab-458c-86a2-896d9424fdf0 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Request method failure captured: Jul 23 22:01:51.741316 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/8460f48b-54ae-4922-ab9a-cd91b18aced2 HTTP/1.1 Jul 23 22:01:51.741316 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 22:01:51.741316 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 22:01:51.741316 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 22:01:51.741316 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 22:01:51.741316 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 22:01:51.741316 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 22:01:51.741316 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 22:01:51.741316 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 22:01:51.741316 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3G_A9wkH_Vr8jZ0yDmwfOELbD33scLeI23FGmTDZRwAlTx7BRkrFG-XS1JghHrkdU5xOsiDKVD8IxZ2VXFsI8YB3OSzopNZwovrE-ZopYRn8fusLUpu-V3taChTKlst8chqQCHXu5wsdie8weea9cW6QIjbke9ezH8B0eWYodZ8SF5w Jul 23 22:01:51.741316 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 22:01:51.741316 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 22:01:51.741316 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 22:01:51.741316 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 22:01:51.741316 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 22:01:51.741316 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 22:01:51.741316 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 85920446208748ee806840fe4b2b9414 Jul 23 22:01:51.741316 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServerGroupTestJSON-383247118 Jul 23 22:01:51.741316 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 22:01:51.741316 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 22:01:51.741316 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/85920446208748ee806840fe4b2b9414"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/85920446208748ee806840fe4b2b9414"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_85920446208748ee806840fe4b2b9414", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/85920446208748ee806840fe4b2b9414"}]}] Jul 23 22:01:51.741316 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServerGroupTestJSON-383247118 Jul 23 22:01:51.741316 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 85920446208748ee806840fe4b2b9414 Jul 23 22:01:51.741316 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServerGroupTestJSON-383247118 Jul 23 22:01:51.741316 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServerGroupTestJSON-383247118-project Jul 23 22:01:51.741316 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 22:01:51.741316 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 22:01:51.741316 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 98e4e707d5684b82b6548010a3d94263 Jul 23 22:01:51.741316 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServerGroupTestJSON-383247118-project Jul 23 22:01:51.741316 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 22:01:51.741316 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance 8460f48b-54ae-4922-ab9a-cd91b18aced2 could not be found. Jul 23 22:01:51.741316 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '8460f48b-54ae-4922-ab9a-cd91b18aced2'} Jul 23 22:01:51.741316 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 22:01:51.741316 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:01:51.741316 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 22:01:51.741316 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 22:01:51.741316 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 22:01:51.741316 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 22:01:51.741316 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 22:01:51.741316 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 22:01:51.741316 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 22:01:51.741316 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 22:01:51.741316 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8460f48b-54ae-4922-ab9a-cd91b18aced2 could not be found. Jul 23 22:01:51.741316 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:01:51.741316 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:01:51.741316 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:01:51.741316 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:01:51.741316 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:01:51.741316 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:01:51.741316 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 22:01:51.741316 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 22:01:51.741316 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 22:01:51.741316 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 22:01:51.741316 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 22:01:51.741316 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 22:01:51.741316 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 22:01:51.741316 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 22:01:51.741316 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 22:01:51.741316 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 22:01:51.741316 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8460f48b-54ae-4922-ab9a-cd91b18aced2 could not be found. Jul 23 22:01:51.741316 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:01:51.741316 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:01:51.741316 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:01:51.746087 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:01:51.746087 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:01:51.746087 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:01:51.746087 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 22:01:51.746087 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 22:01:51.746087 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8460f48b-54ae-4922-ab9a-cd91b18aced2 could not be found. Jul 23 22:01:51.746087 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:01:51.746087 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9cabdb3d-e2ab-458c-86a2-896d9424fdf0 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Returning 404 to user: Instance 8460f48b-54ae-4922-ab9a-cd91b18aced2 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 22:01:51.746087 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9cabdb3d-e2ab-458c-86a2-896d9424fdf0 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] 10.222.0.17 "GET /compute/v2.1/servers/8460f48b-54ae-4922-ab9a-cd91b18aced2" status: 404 len: 111 microversion: 2.1 time: 0.035249 Jul 23 22:01:51.746087 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3142/5752] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:01:51 2022] GET /compute/v2.1/servers/8460f48b-54ae-4922-ab9a-cd91b18aced2 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 23 22:01:51.755865 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6f7b1e97-80ba-42ab-a36a-1154dff03b18 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:01:51.770709 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.compute.server_groups [None req-6f7b1e97-80ba-42ab-a36a-1154dff03b18 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Querying cell 4e90cb14-d4b2-4158-b8cf-a592a1314a7b(cell1) for 1 instances {{(pid=131320) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 23 22:01:51.771503 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6f7b1e97-80ba-42ab-a36a-1154dff03b18 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:51.771965 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6f7b1e97-80ba-42ab-a36a-1154dff03b18 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:51.782594 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6f7b1e97-80ba-42ab-a36a-1154dff03b18 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] 10.222.0.17 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.031347 Jul 23 22:01:51.783193 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3143/5753] 10.222.0.17 () {58 vars in 1151 bytes} [Sat Jul 23 22:01:51 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:01:51.793718 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-df216dce-eef1-4d0f-a75e-f13399734c6b tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:01:51.807460 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.compute.server_groups [None req-df216dce-eef1-4d0f-a75e-f13399734c6b tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Querying cell 4e90cb14-d4b2-4158-b8cf-a592a1314a7b(cell1) for 1 instances {{(pid=131320) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 23 22:01:51.808407 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-df216dce-eef1-4d0f-a75e-f13399734c6b tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:51.808856 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-df216dce-eef1-4d0f-a75e-f13399734c6b tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:51.813693 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:01:51.824488 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-df216dce-eef1-4d0f-a75e-f13399734c6b tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] 10.222.0.17 "GET /compute/v2.1/os-server-groups/88e7a769-e6ba-4833-8e84-6d61bcecdfee" status: 200 len: 183 microversion: 2.1 time: 0.034299 Jul 23 22:01:51.825069 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3144/5754] 10.222.0.17 () {58 vars in 1262 bytes} [Sat Jul 23 22:01:51 2022] GET /compute/v2.1/os-server-groups/88e7a769-e6ba-4833-8e84-6d61bcecdfee => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:01:51.840191 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b2fa58f3-b403-4723-a03e-becb0446bb50 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:01:51.840714 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b2fa58f3-b403-4723-a03e-becb0446bb50 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] [instance: 8460f48b-54ae-4922-ab9a-cd91b18aced2] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:01:51.848020 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b2fa58f3-b403-4723-a03e-becb0446bb50 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:51.848467 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b2fa58f3-b403-4723-a03e-becb0446bb50 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:51.849222 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b2fa58f3-b403-4723-a03e-becb0446bb50 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:51.849652 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b2fa58f3-b403-4723-a03e-becb0446bb50 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:51.863050 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-b2fa58f3-b403-4723-a03e-becb0446bb50 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] HTTP exception thrown: Instance 8460f48b-54ae-4922-ab9a-cd91b18aced2 could not be found. Jul 23 22:01:51.864607 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b2fa58f3-b403-4723-a03e-becb0446bb50 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Request method failure captured: Jul 23 22:01:51.864607 ncdv-master-1 devstack@n-api.service[131320]: request: DELETE /compute/v2.1/servers/8460f48b-54ae-4922-ab9a-cd91b18aced2 HTTP/1.1 Jul 23 22:01:51.864607 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 22:01:51.864607 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 22:01:51.864607 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 22:01:51.864607 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 22:01:51.864607 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 22:01:51.864607 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 22:01:51.864607 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 22:01:51.864607 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 22:01:51.864607 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3G_A9wkH_Vr8jZ0yDmwfOELbD33scLeI23FGmTDZRwAlTx7BRkrFG-XS1JghHrkdU5xOsiDKVD8IxZ2VXFsI8YB3OSzopNZwovrE-ZopYRn8fusLUpu-V3taChTKlst8chqQCHXu5wsdie8weea9cW6QIjbke9ezH8B0eWYodZ8SF5w Jul 23 22:01:51.864607 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 22:01:51.864607 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 22:01:51.864607 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 22:01:51.864607 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 22:01:51.864607 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 22:01:51.864607 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 22:01:51.864607 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 85920446208748ee806840fe4b2b9414 Jul 23 22:01:51.864607 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServerGroupTestJSON-383247118 Jul 23 22:01:51.864607 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 22:01:51.864607 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 22:01:51.864607 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/85920446208748ee806840fe4b2b9414"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/85920446208748ee806840fe4b2b9414"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_85920446208748ee806840fe4b2b9414", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/85920446208748ee806840fe4b2b9414"}]}] Jul 23 22:01:51.864607 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServerGroupTestJSON-383247118 Jul 23 22:01:51.864607 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 85920446208748ee806840fe4b2b9414 Jul 23 22:01:51.864607 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServerGroupTestJSON-383247118 Jul 23 22:01:51.864607 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServerGroupTestJSON-383247118-project Jul 23 22:01:51.864607 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 22:01:51.864607 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 22:01:51.864607 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 98e4e707d5684b82b6548010a3d94263 Jul 23 22:01:51.864607 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServerGroupTestJSON-383247118-project Jul 23 22:01:51.864607 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 22:01:51.864607 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance 8460f48b-54ae-4922-ab9a-cd91b18aced2 could not be found. Jul 23 22:01:51.864607 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '8460f48b-54ae-4922-ab9a-cd91b18aced2'} Jul 23 22:01:51.864607 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 22:01:51.864607 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:01:51.864607 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 22:01:51.864607 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 22:01:51.864607 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 22:01:51.864607 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 22:01:51.864607 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 22:01:51.864607 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 22:01:51.864607 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 22:01:51.864607 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 22:01:51.864607 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8460f48b-54ae-4922-ab9a-cd91b18aced2 could not be found. Jul 23 22:01:51.864607 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:01:51.864607 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:01:51.864607 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:01:51.864607 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:01:51.864607 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:01:51.864607 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:01:51.864607 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 22:01:51.864607 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 22:01:51.864607 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 22:01:51.864607 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 22:01:51.864607 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 23 22:01:51.864607 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 23 22:01:51.864607 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 23 22:01:51.864607 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 23 22:01:51.864607 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 22:01:51.864607 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 22:01:51.864607 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 22:01:51.864607 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 22:01:51.864607 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8460f48b-54ae-4922-ab9a-cd91b18aced2 could not be found. Jul 23 22:01:51.869586 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:01:51.869586 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:01:51.869586 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:01:51.869586 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:01:51.869586 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:01:51.869586 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:01:51.869586 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 22:01:51.869586 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 22:01:51.869586 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8460f48b-54ae-4922-ab9a-cd91b18aced2 could not be found. Jul 23 22:01:51.869586 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:01:51.869586 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b2fa58f3-b403-4723-a03e-becb0446bb50 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Returning 404 to user: Instance 8460f48b-54ae-4922-ab9a-cd91b18aced2 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 22:01:51.869586 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b2fa58f3-b403-4723-a03e-becb0446bb50 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] 10.222.0.17 "DELETE /compute/v2.1/servers/8460f48b-54ae-4922-ab9a-cd91b18aced2" status: 404 len: 111 microversion: 2.1 time: 0.031107 Jul 23 22:01:51.869586 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3145/5755] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 22:01:51 2022] DELETE /compute/v2.1/servers/8460f48b-54ae-4922-ab9a-cd91b18aced2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 22:01:51.874439 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4f7f32cf-12f1-4200-8d32-0cc0e62600f0 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:01:51.875084 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-4f7f32cf-12f1-4200-8d32-0cc0e62600f0 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] [instance: 8460f48b-54ae-4922-ab9a-cd91b18aced2] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:01:51.881077 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4f7f32cf-12f1-4200-8d32-0cc0e62600f0 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:51.881529 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4f7f32cf-12f1-4200-8d32-0cc0e62600f0 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:51.882311 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4f7f32cf-12f1-4200-8d32-0cc0e62600f0 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:01:51.882749 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4f7f32cf-12f1-4200-8d32-0cc0e62600f0 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:01:51.896103 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-4f7f32cf-12f1-4200-8d32-0cc0e62600f0 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] HTTP exception thrown: Instance 8460f48b-54ae-4922-ab9a-cd91b18aced2 could not be found. Jul 23 22:01:51.897594 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4f7f32cf-12f1-4200-8d32-0cc0e62600f0 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Request method failure captured: Jul 23 22:01:51.897594 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/8460f48b-54ae-4922-ab9a-cd91b18aced2 HTTP/1.1 Jul 23 22:01:51.897594 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 22:01:51.897594 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 22:01:51.897594 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 22:01:51.897594 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 22:01:51.897594 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 22:01:51.897594 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 22:01:51.897594 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 22:01:51.897594 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 22:01:51.897594 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3G_A9wkH_Vr8jZ0yDmwfOELbD33scLeI23FGmTDZRwAlTx7BRkrFG-XS1JghHrkdU5xOsiDKVD8IxZ2VXFsI8YB3OSzopNZwovrE-ZopYRn8fusLUpu-V3taChTKlst8chqQCHXu5wsdie8weea9cW6QIjbke9ezH8B0eWYodZ8SF5w Jul 23 22:01:51.897594 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 22:01:51.897594 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 22:01:51.897594 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 22:01:51.897594 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 22:01:51.897594 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 22:01:51.897594 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 22:01:51.897594 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 85920446208748ee806840fe4b2b9414 Jul 23 22:01:51.897594 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServerGroupTestJSON-383247118 Jul 23 22:01:51.897594 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 22:01:51.897594 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 22:01:51.897594 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/85920446208748ee806840fe4b2b9414"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/85920446208748ee806840fe4b2b9414"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_85920446208748ee806840fe4b2b9414", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/85920446208748ee806840fe4b2b9414"}]}] Jul 23 22:01:51.897594 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServerGroupTestJSON-383247118 Jul 23 22:01:51.897594 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 85920446208748ee806840fe4b2b9414 Jul 23 22:01:51.897594 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServerGroupTestJSON-383247118 Jul 23 22:01:51.897594 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServerGroupTestJSON-383247118-project Jul 23 22:01:51.897594 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 22:01:51.897594 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 22:01:51.897594 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 98e4e707d5684b82b6548010a3d94263 Jul 23 22:01:51.897594 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServerGroupTestJSON-383247118-project Jul 23 22:01:51.897594 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 22:01:51.897594 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance 8460f48b-54ae-4922-ab9a-cd91b18aced2 could not be found. Jul 23 22:01:51.897594 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '8460f48b-54ae-4922-ab9a-cd91b18aced2'} Jul 23 22:01:51.897594 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 22:01:51.897594 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:01:51.897594 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 22:01:51.897594 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 22:01:51.897594 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 22:01:51.897594 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 22:01:51.897594 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 22:01:51.897594 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 22:01:51.897594 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 22:01:51.897594 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 22:01:51.897594 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8460f48b-54ae-4922-ab9a-cd91b18aced2 could not be found. Jul 23 22:01:51.897594 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:01:51.897594 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:01:51.897594 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:01:51.897594 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:01:51.897594 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:01:51.897594 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:01:51.897594 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 22:01:51.897594 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 22:01:51.897594 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 22:01:51.897594 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 22:01:51.897594 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 22:01:51.897594 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 22:01:51.897594 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 22:01:51.897594 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 22:01:51.897594 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 22:01:51.897594 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 22:01:51.897594 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8460f48b-54ae-4922-ab9a-cd91b18aced2 could not be found. Jul 23 22:01:51.897594 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:01:51.897594 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:01:51.897594 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:01:51.902548 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:01:51.902548 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:01:51.902548 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:01:51.902548 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 22:01:51.902548 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 22:01:51.902548 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8460f48b-54ae-4922-ab9a-cd91b18aced2 could not be found. Jul 23 22:01:51.902548 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:01:51.902548 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4f7f32cf-12f1-4200-8d32-0cc0e62600f0 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Returning 404 to user: Instance 8460f48b-54ae-4922-ab9a-cd91b18aced2 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 22:01:51.902548 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4f7f32cf-12f1-4200-8d32-0cc0e62600f0 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] 10.222.0.17 "GET /compute/v2.1/servers/8460f48b-54ae-4922-ab9a-cd91b18aced2" status: 404 len: 111 microversion: 2.1 time: 0.028214 Jul 23 22:01:51.902548 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3146/5756] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:01:51 2022] GET /compute/v2.1/servers/8460f48b-54ae-4922-ab9a-cd91b18aced2 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 23 22:01:51.907283 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6867b1d0-6c5a-4be9-ad31-804908d2bd3d tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:01:51.912818 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-6867b1d0-6c5a-4be9-ad31-804908d2bd3d tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] HTTP exception thrown: Instance group 304a189c-fcaa-4340-9af2-aba6ac1a16b4 could not be found. Jul 23 22:01:51.914289 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6867b1d0-6c5a-4be9-ad31-804908d2bd3d tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Request method failure captured: Jul 23 22:01:51.914289 ncdv-master-1 devstack@n-api.service[131320]: request: DELETE /compute/v2.1/os-server-groups/304a189c-fcaa-4340-9af2-aba6ac1a16b4 HTTP/1.1 Jul 23 22:01:51.914289 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 22:01:51.914289 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 22:01:51.914289 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 22:01:51.914289 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 22:01:51.914289 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 22:01:51.914289 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 22:01:51.914289 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 22:01:51.914289 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 22:01:51.914289 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3G_A9wkH_Vr8jZ0yDmwfOELbD33scLeI23FGmTDZRwAlTx7BRkrFG-XS1JghHrkdU5xOsiDKVD8IxZ2VXFsI8YB3OSzopNZwovrE-ZopYRn8fusLUpu-V3taChTKlst8chqQCHXu5wsdie8weea9cW6QIjbke9ezH8B0eWYodZ8SF5w Jul 23 22:01:51.914289 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 22:01:51.914289 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 22:01:51.914289 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 22:01:51.914289 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 22:01:51.914289 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 22:01:51.914289 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 22:01:51.914289 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 85920446208748ee806840fe4b2b9414 Jul 23 22:01:51.914289 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServerGroupTestJSON-383247118 Jul 23 22:01:51.914289 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 22:01:51.914289 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 22:01:51.914289 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/85920446208748ee806840fe4b2b9414"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/85920446208748ee806840fe4b2b9414"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_85920446208748ee806840fe4b2b9414", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/85920446208748ee806840fe4b2b9414"}]}] Jul 23 22:01:51.914289 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServerGroupTestJSON-383247118 Jul 23 22:01:51.914289 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 85920446208748ee806840fe4b2b9414 Jul 23 22:01:51.914289 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServerGroupTestJSON-383247118 Jul 23 22:01:51.914289 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServerGroupTestJSON-383247118-project Jul 23 22:01:51.914289 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 22:01:51.914289 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 22:01:51.914289 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 98e4e707d5684b82b6548010a3d94263 Jul 23 22:01:51.914289 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServerGroupTestJSON-383247118-project Jul 23 22:01:51.914289 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 22:01:51.914289 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance group 304a189c-fcaa-4340-9af2-aba6ac1a16b4 could not be found. Jul 23 22:01:51.914289 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '304a189c-fcaa-4340-9af2-aba6ac1a16b4'} Jul 23 22:01:51.914289 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 22:01:51.914289 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:01:51.914289 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 23 22:01:51.914289 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 23 22:01:51.914289 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 23 22:01:51.914289 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 23 22:01:51.914289 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 23 22:01:51.914289 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 23 22:01:51.914289 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 23 22:01:51.914289 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 23 22:01:51.914289 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 23 22:01:51.914289 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 23 22:01:51.914289 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 304a189c-fcaa-4340-9af2-aba6ac1a16b4 could not be found. Jul 23 22:01:51.914289 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:01:51.914289 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:01:51.914289 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:01:51.914289 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:01:51.914289 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:01:51.914289 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:01:51.914289 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 22:01:51.914289 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 22:01:51.914289 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 22:01:51.914289 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 22:01:51.914289 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 23 22:01:51.914289 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 23 22:01:51.914289 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 304a189c-fcaa-4340-9af2-aba6ac1a16b4 could not be found. Jul 23 22:01:51.914289 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:01:51.914289 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:01:51.914289 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:01:51.914289 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:01:51.919115 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:01:51.919115 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:01:51.919115 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 22:01:51.919115 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 22:01:51.919115 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 304a189c-fcaa-4340-9af2-aba6ac1a16b4 could not be found. Jul 23 22:01:51.919115 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:01:51.919115 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6867b1d0-6c5a-4be9-ad31-804908d2bd3d tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Returning 404 to user: Instance group 304a189c-fcaa-4340-9af2-aba6ac1a16b4 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 22:01:51.919115 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6867b1d0-6c5a-4be9-ad31-804908d2bd3d tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] 10.222.0.17 "DELETE /compute/v2.1/os-server-groups/304a189c-fcaa-4340-9af2-aba6ac1a16b4" status: 404 len: 117 microversion: 2.1 time: 0.011698 Jul 23 22:01:51.919115 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3147/5757] 10.222.0.17 () {58 vars in 1265 bytes} [Sat Jul 23 22:01:51 2022] DELETE /compute/v2.1/os-server-groups/304a189c-fcaa-4340-9af2-aba6ac1a16b4 => generated 117 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 23 22:01:51.923027 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-85010c2d-5b9a-4420-a50d-7c42cc130daa tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:01:51.929270 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-85010c2d-5b9a-4420-a50d-7c42cc130daa tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] HTTP exception thrown: Instance group ca810552-4db9-4cfa-aef8-0c37d5e220f8 could not be found. Jul 23 22:01:51.930747 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-85010c2d-5b9a-4420-a50d-7c42cc130daa tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Request method failure captured: Jul 23 22:01:51.930747 ncdv-master-1 devstack@n-api.service[131320]: request: DELETE /compute/v2.1/os-server-groups/ca810552-4db9-4cfa-aef8-0c37d5e220f8 HTTP/1.1 Jul 23 22:01:51.930747 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 22:01:51.930747 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 22:01:51.930747 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 22:01:51.930747 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 22:01:51.930747 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 22:01:51.930747 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 22:01:51.930747 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 22:01:51.930747 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 22:01:51.930747 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3G_A9wkH_Vr8jZ0yDmwfOELbD33scLeI23FGmTDZRwAlTx7BRkrFG-XS1JghHrkdU5xOsiDKVD8IxZ2VXFsI8YB3OSzopNZwovrE-ZopYRn8fusLUpu-V3taChTKlst8chqQCHXu5wsdie8weea9cW6QIjbke9ezH8B0eWYodZ8SF5w Jul 23 22:01:51.930747 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 22:01:51.930747 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 22:01:51.930747 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 22:01:51.930747 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 22:01:51.930747 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 22:01:51.930747 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 22:01:51.930747 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 85920446208748ee806840fe4b2b9414 Jul 23 22:01:51.930747 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServerGroupTestJSON-383247118 Jul 23 22:01:51.930747 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 22:01:51.930747 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 22:01:51.930747 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/85920446208748ee806840fe4b2b9414"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/85920446208748ee806840fe4b2b9414"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_85920446208748ee806840fe4b2b9414", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/85920446208748ee806840fe4b2b9414"}]}] Jul 23 22:01:51.930747 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServerGroupTestJSON-383247118 Jul 23 22:01:51.930747 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 85920446208748ee806840fe4b2b9414 Jul 23 22:01:51.930747 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServerGroupTestJSON-383247118 Jul 23 22:01:51.930747 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServerGroupTestJSON-383247118-project Jul 23 22:01:51.930747 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 22:01:51.930747 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 22:01:51.930747 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 98e4e707d5684b82b6548010a3d94263 Jul 23 22:01:51.930747 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServerGroupTestJSON-383247118-project Jul 23 22:01:51.930747 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 22:01:51.930747 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance group ca810552-4db9-4cfa-aef8-0c37d5e220f8 could not be found. Jul 23 22:01:51.930747 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': 'ca810552-4db9-4cfa-aef8-0c37d5e220f8'} Jul 23 22:01:51.930747 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 22:01:51.930747 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:01:51.930747 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 23 22:01:51.930747 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 23 22:01:51.930747 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 23 22:01:51.930747 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 23 22:01:51.930747 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 23 22:01:51.930747 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 23 22:01:51.930747 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 23 22:01:51.930747 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 23 22:01:51.930747 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 23 22:01:51.930747 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 23 22:01:51.930747 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group ca810552-4db9-4cfa-aef8-0c37d5e220f8 could not be found. Jul 23 22:01:51.930747 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:01:51.930747 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:01:51.930747 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:01:51.930747 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:01:51.930747 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:01:51.930747 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:01:51.930747 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 22:01:51.930747 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 22:01:51.930747 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 22:01:51.930747 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 22:01:51.930747 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 23 22:01:51.930747 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 23 22:01:51.930747 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group ca810552-4db9-4cfa-aef8-0c37d5e220f8 could not be found. Jul 23 22:01:51.930747 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:01:51.930747 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:01:51.930747 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:01:51.930747 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:01:51.935520 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:01:51.935520 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:01:51.935520 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 22:01:51.935520 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 22:01:51.935520 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group ca810552-4db9-4cfa-aef8-0c37d5e220f8 could not be found. Jul 23 22:01:51.935520 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:01:51.935520 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-85010c2d-5b9a-4420-a50d-7c42cc130daa tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Returning 404 to user: Instance group ca810552-4db9-4cfa-aef8-0c37d5e220f8 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 22:01:51.935520 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-85010c2d-5b9a-4420-a50d-7c42cc130daa tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] 10.222.0.17 "DELETE /compute/v2.1/os-server-groups/ca810552-4db9-4cfa-aef8-0c37d5e220f8" status: 404 len: 117 microversion: 2.1 time: 0.012330 Jul 23 22:01:51.935520 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3148/5758] 10.222.0.17 () {58 vars in 1265 bytes} [Sat Jul 23 22:01:51 2022] DELETE /compute/v2.1/os-server-groups/ca810552-4db9-4cfa-aef8-0c37d5e220f8 => generated 117 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 22:01:51.939883 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9855dc2a-cfaa-4ed5-b5fe-0cfe08a62ac4 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:01:51.945674 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-9855dc2a-cfaa-4ed5-b5fe-0cfe08a62ac4 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] HTTP exception thrown: Instance group 29b1a191-401c-47dc-b8e2-85261c7c31a0 could not be found. Jul 23 22:01:51.947198 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9855dc2a-cfaa-4ed5-b5fe-0cfe08a62ac4 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Request method failure captured: Jul 23 22:01:51.947198 ncdv-master-1 devstack@n-api.service[131320]: request: DELETE /compute/v2.1/os-server-groups/29b1a191-401c-47dc-b8e2-85261c7c31a0 HTTP/1.1 Jul 23 22:01:51.947198 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 22:01:51.947198 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 22:01:51.947198 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 22:01:51.947198 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 22:01:51.947198 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 22:01:51.947198 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 22:01:51.947198 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 22:01:51.947198 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 22:01:51.947198 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3G_A9wkH_Vr8jZ0yDmwfOELbD33scLeI23FGmTDZRwAlTx7BRkrFG-XS1JghHrkdU5xOsiDKVD8IxZ2VXFsI8YB3OSzopNZwovrE-ZopYRn8fusLUpu-V3taChTKlst8chqQCHXu5wsdie8weea9cW6QIjbke9ezH8B0eWYodZ8SF5w Jul 23 22:01:51.947198 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 22:01:51.947198 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 22:01:51.947198 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 22:01:51.947198 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 22:01:51.947198 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 22:01:51.947198 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 22:01:51.947198 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 85920446208748ee806840fe4b2b9414 Jul 23 22:01:51.947198 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServerGroupTestJSON-383247118 Jul 23 22:01:51.947198 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 22:01:51.947198 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 22:01:51.947198 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/85920446208748ee806840fe4b2b9414"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/85920446208748ee806840fe4b2b9414"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_85920446208748ee806840fe4b2b9414", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/85920446208748ee806840fe4b2b9414"}]}] Jul 23 22:01:51.947198 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServerGroupTestJSON-383247118 Jul 23 22:01:51.947198 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 85920446208748ee806840fe4b2b9414 Jul 23 22:01:51.947198 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServerGroupTestJSON-383247118 Jul 23 22:01:51.947198 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServerGroupTestJSON-383247118-project Jul 23 22:01:51.947198 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 22:01:51.947198 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 22:01:51.947198 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 98e4e707d5684b82b6548010a3d94263 Jul 23 22:01:51.947198 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServerGroupTestJSON-383247118-project Jul 23 22:01:51.947198 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 22:01:51.947198 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance group 29b1a191-401c-47dc-b8e2-85261c7c31a0 could not be found. Jul 23 22:01:51.947198 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '29b1a191-401c-47dc-b8e2-85261c7c31a0'} Jul 23 22:01:51.947198 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 22:01:51.947198 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:01:51.947198 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 23 22:01:51.947198 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 23 22:01:51.947198 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 23 22:01:51.947198 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 23 22:01:51.947198 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 23 22:01:51.947198 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 23 22:01:51.947198 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 23 22:01:51.947198 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 23 22:01:51.947198 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 23 22:01:51.947198 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 23 22:01:51.947198 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 29b1a191-401c-47dc-b8e2-85261c7c31a0 could not be found. Jul 23 22:01:51.947198 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:01:51.947198 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:01:51.947198 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:01:51.947198 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:01:51.947198 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:01:51.947198 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:01:51.947198 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 22:01:51.947198 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 22:01:51.947198 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 22:01:51.947198 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 22:01:51.947198 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 23 22:01:51.947198 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 23 22:01:51.947198 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 29b1a191-401c-47dc-b8e2-85261c7c31a0 could not be found. Jul 23 22:01:51.947198 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:01:51.947198 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:01:51.947198 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:01:51.947198 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:01:51.952564 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:01:51.952564 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:01:51.952564 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 22:01:51.952564 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 22:01:51.952564 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 29b1a191-401c-47dc-b8e2-85261c7c31a0 could not be found. Jul 23 22:01:51.952564 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:01:51.952564 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9855dc2a-cfaa-4ed5-b5fe-0cfe08a62ac4 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Returning 404 to user: Instance group 29b1a191-401c-47dc-b8e2-85261c7c31a0 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 22:01:51.952564 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9855dc2a-cfaa-4ed5-b5fe-0cfe08a62ac4 tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] 10.222.0.17 "DELETE /compute/v2.1/os-server-groups/29b1a191-401c-47dc-b8e2-85261c7c31a0" status: 404 len: 117 microversion: 2.1 time: 0.012235 Jul 23 22:01:51.952564 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3149/5759] 10.222.0.17 () {58 vars in 1265 bytes} [Sat Jul 23 22:01:51 2022] DELETE /compute/v2.1/os-server-groups/29b1a191-401c-47dc-b8e2-85261c7c31a0 => generated 117 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 23 22:01:51.956098 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5a7cd7b8-9c5d-49aa-b562-9cf9edbf37ba tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:01:51.962622 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-5a7cd7b8-9c5d-49aa-b562-9cf9edbf37ba tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] HTTP exception thrown: Instance group 406e6cd4-3087-4430-9603-9c397687c3a2 could not be found. Jul 23 22:01:51.964201 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5a7cd7b8-9c5d-49aa-b562-9cf9edbf37ba tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Request method failure captured: Jul 23 22:01:51.964201 ncdv-master-1 devstack@n-api.service[131320]: request: DELETE /compute/v2.1/os-server-groups/406e6cd4-3087-4430-9603-9c397687c3a2 HTTP/1.1 Jul 23 22:01:51.964201 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 22:01:51.964201 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 22:01:51.964201 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 22:01:51.964201 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 22:01:51.964201 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 22:01:51.964201 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 22:01:51.964201 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 22:01:51.964201 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 22:01:51.964201 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3G_A9wkH_Vr8jZ0yDmwfOELbD33scLeI23FGmTDZRwAlTx7BRkrFG-XS1JghHrkdU5xOsiDKVD8IxZ2VXFsI8YB3OSzopNZwovrE-ZopYRn8fusLUpu-V3taChTKlst8chqQCHXu5wsdie8weea9cW6QIjbke9ezH8B0eWYodZ8SF5w Jul 23 22:01:51.964201 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 22:01:51.964201 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 22:01:51.964201 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 22:01:51.964201 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 22:01:51.964201 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 22:01:51.964201 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 22:01:51.964201 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 85920446208748ee806840fe4b2b9414 Jul 23 22:01:51.964201 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServerGroupTestJSON-383247118 Jul 23 22:01:51.964201 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 22:01:51.964201 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 22:01:51.964201 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/85920446208748ee806840fe4b2b9414"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/85920446208748ee806840fe4b2b9414"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_85920446208748ee806840fe4b2b9414", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/85920446208748ee806840fe4b2b9414"}]}] Jul 23 22:01:51.964201 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServerGroupTestJSON-383247118 Jul 23 22:01:51.964201 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 85920446208748ee806840fe4b2b9414 Jul 23 22:01:51.964201 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServerGroupTestJSON-383247118 Jul 23 22:01:51.964201 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServerGroupTestJSON-383247118-project Jul 23 22:01:51.964201 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 22:01:51.964201 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 22:01:51.964201 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 98e4e707d5684b82b6548010a3d94263 Jul 23 22:01:51.964201 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServerGroupTestJSON-383247118-project Jul 23 22:01:51.964201 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 22:01:51.964201 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance group 406e6cd4-3087-4430-9603-9c397687c3a2 could not be found. Jul 23 22:01:51.964201 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '406e6cd4-3087-4430-9603-9c397687c3a2'} Jul 23 22:01:51.964201 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 22:01:51.964201 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:01:51.964201 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 23 22:01:51.964201 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 23 22:01:51.964201 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 23 22:01:51.964201 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 23 22:01:51.964201 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 23 22:01:51.964201 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 23 22:01:51.964201 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 23 22:01:51.964201 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 23 22:01:51.964201 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 23 22:01:51.964201 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 23 22:01:51.964201 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 406e6cd4-3087-4430-9603-9c397687c3a2 could not be found. Jul 23 22:01:51.964201 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:01:51.964201 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:01:51.964201 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:01:51.964201 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:01:51.964201 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:01:51.964201 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:01:51.964201 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 22:01:51.964201 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 22:01:51.964201 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 22:01:51.964201 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 22:01:51.964201 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 23 22:01:51.964201 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 23 22:01:51.964201 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 406e6cd4-3087-4430-9603-9c397687c3a2 could not be found. Jul 23 22:01:51.964201 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:01:51.964201 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:01:51.964201 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:01:51.964201 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:01:51.969604 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:01:51.969604 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:01:51.969604 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 22:01:51.969604 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 22:01:51.969604 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 406e6cd4-3087-4430-9603-9c397687c3a2 could not be found. Jul 23 22:01:51.969604 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:01:51.969604 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5a7cd7b8-9c5d-49aa-b562-9cf9edbf37ba tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Returning 404 to user: Instance group 406e6cd4-3087-4430-9603-9c397687c3a2 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 22:01:51.969604 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5a7cd7b8-9c5d-49aa-b562-9cf9edbf37ba tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] 10.222.0.17 "DELETE /compute/v2.1/os-server-groups/406e6cd4-3087-4430-9603-9c397687c3a2" status: 404 len: 117 microversion: 2.1 time: 0.012821 Jul 23 22:01:51.969604 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3150/5760] 10.222.0.17 () {58 vars in 1265 bytes} [Sat Jul 23 22:01:51 2022] DELETE /compute/v2.1/os-server-groups/406e6cd4-3087-4430-9603-9c397687c3a2 => generated 117 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 23 22:01:51.973349 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-eb1bd171-7abe-4296-b491-afed0351595b tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:01:52.002109 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-eb1bd171-7abe-4296-b491-afed0351595b tempest-ServerGroupTestJSON-383247118 tempest-ServerGroupTestJSON-383247118-project] 10.222.0.17 "DELETE /compute/v2.1/os-server-groups/88e7a769-e6ba-4833-8e84-6d61bcecdfee" status: 204 len: 0 microversion: 2.1 time: 0.031973 Jul 23 22:01:52.002749 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3151/5761] 10.222.0.17 () {58 vars in 1265 bytes} [Sat Jul 23 22:01:51 2022] DELETE /compute/v2.1/os-server-groups/88e7a769-e6ba-4833-8e84-6d61bcecdfee => generated 0 bytes in 33 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 23 22:02:00.146031 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1bbb0da9-a51c-4734-a78b-8b073d93306b tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-1040158547", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "networks": [{"uuid": "f1ebd558-6a41-479d-948d-35cb46799144"}]}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:02:00.198652 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-1bbb0da9-a51c-4734-a78b-8b073d93306b tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] validate_networks() for [('f1ebd558-6a41-479d-948d-35cb46799144', None, None, None, None, None)] {{(pid=131320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 22:02:00.573409 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-1bbb0da9-a51c-4734-a78b-8b073d93306b tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 22:02:00.574177 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-1bbb0da9-a51c-4734-a78b-8b073d93306b tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 22:02:00.574670 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-1bbb0da9-a51c-4734-a78b-8b073d93306b tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 22:02:00.575096 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-1bbb0da9-a51c-4734-a78b-8b073d93306b tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 22:02:00.575514 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-1bbb0da9-a51c-4734-a78b-8b073d93306b tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 22:02:00.588542 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1bbb0da9-a51c-4734-a78b-8b073d93306b tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:02:00.589213 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1bbb0da9-a51c-4734-a78b-8b073d93306b tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:02:00.590364 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1bbb0da9-a51c-4734-a78b-8b073d93306b tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:02:00.590901 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1bbb0da9-a51c-4734-a78b-8b073d93306b tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:02:00.610189 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-1bbb0da9-a51c-4734-a78b-8b073d93306b tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] Getting quotas for project 67a499777d904b1884cfba632bb2a8c6. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 22:02:00.615668 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-1bbb0da9-a51c-4734-a78b-8b073d93306b tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] Getting quotas for user a3d16a88a1e243cdb465ce67f556e784 and project 67a499777d904b1884cfba632bb2a8c6. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 22:02:00.629458 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1bbb0da9-a51c-4734-a78b-8b073d93306b tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] Going to run 1 instances... {{(pid=131320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 22:02:00.631861 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1bbb0da9-a51c-4734-a78b-8b073d93306b tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] [instance: b8073ef8-969d-4b33-b3ab-a02ecb44e199] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 22:02:00.678660 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1bbb0da9-a51c-4734-a78b-8b073d93306b tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.652464 Jul 23 22:02:00.679508 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3152/5762] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 22:02:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 654 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 23 22:02:00.689455 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5551ca35-bcd2-45b4-8460-36866cc3a4e9 tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:02:00.690098 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5551ca35-bcd2-45b4-8460-36866cc3a4e9 tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] [instance: b8073ef8-969d-4b33-b3ab-a02ecb44e199] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:02:00.743670 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5551ca35-bcd2-45b4-8460-36866cc3a4e9 tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d16a88a1e243cdb465ce67f556e784', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a499777d904b1884cfba632bb2a8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:02:00.750672 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5551ca35-bcd2-45b4-8460-36866cc3a4e9 tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] 10.222.0.17 "GET /compute/v2.1/servers/b8073ef8-969d-4b33-b3ab-a02ecb44e199" status: 200 len: 1216 microversion: 2.1 time: 0.065031 Jul 23 22:02:00.751240 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3153/5763] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:02:00 2022] GET /compute/v2.1/servers/b8073ef8-969d-4b33-b3ab-a02ecb44e199 => generated 1216 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:02:01.767694 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-35aff13a-34ae-4862-bc72-51596cf484a1 tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:02:01.768382 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-35aff13a-34ae-4862-bc72-51596cf484a1 tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] [instance: b8073ef8-969d-4b33-b3ab-a02ecb44e199] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:02:01.776960 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-35aff13a-34ae-4862-bc72-51596cf484a1 tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:02:01.777729 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-35aff13a-34ae-4862-bc72-51596cf484a1 tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:02:01.779247 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-35aff13a-34ae-4862-bc72-51596cf484a1 tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:02:01.779903 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-35aff13a-34ae-4862-bc72-51596cf484a1 tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:02:01.878638 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-35aff13a-34ae-4862-bc72-51596cf484a1 tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d16a88a1e243cdb465ce67f556e784', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a499777d904b1884cfba632bb2a8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:02:01.887675 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-35aff13a-34ae-4862-bc72-51596cf484a1 tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] 10.222.0.17 "GET /compute/v2.1/servers/b8073ef8-969d-4b33-b3ab-a02ecb44e199" status: 200 len: 1276 microversion: 2.1 time: 0.123931 Jul 23 22:02:01.889192 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3154/5764] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:02:01 2022] GET /compute/v2.1/servers/b8073ef8-969d-4b33-b3ab-a02ecb44e199 => generated 1276 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:02:02.905557 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-dc211c2c-56a2-4eb0-bad8-3c8b7221e904 tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:02:02.906508 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-dc211c2c-56a2-4eb0-bad8-3c8b7221e904 tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] [instance: b8073ef8-969d-4b33-b3ab-a02ecb44e199] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:02:02.914791 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dc211c2c-56a2-4eb0-bad8-3c8b7221e904 tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:02:02.915327 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dc211c2c-56a2-4eb0-bad8-3c8b7221e904 tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:02:02.916196 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dc211c2c-56a2-4eb0-bad8-3c8b7221e904 tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:02:02.916791 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dc211c2c-56a2-4eb0-bad8-3c8b7221e904 tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:02:03.117155 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-dc211c2c-56a2-4eb0-bad8-3c8b7221e904 tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d16a88a1e243cdb465ce67f556e784', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a499777d904b1884cfba632bb2a8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:02:03.125725 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-dc211c2c-56a2-4eb0-bad8-3c8b7221e904 tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] 10.222.0.17 "GET /compute/v2.1/servers/b8073ef8-969d-4b33-b3ab-a02ecb44e199" status: 200 len: 1316 microversion: 2.1 time: 0.224538 Jul 23 22:02:03.126665 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3155/5765] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:02:02 2022] GET /compute/v2.1/servers/b8073ef8-969d-4b33-b3ab-a02ecb44e199 => generated 1316 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:02:03.782729 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-f2361d2f-d115-4807-9413-957d35d80d69 req-8dc04758-bf8a-402f-8d43-59c7597d7275 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8073ef8-969d-4b33-b3ab-a02ecb44e199", "tag": "7fdbebb1-4b5b-4df6-adaf-f3cd64b73aa2"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:02:03.800550 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-f2361d2f-d115-4807-9413-957d35d80d69 req-8dc04758-bf8a-402f-8d43-59c7597d7275 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:02:03.801014 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-f2361d2f-d115-4807-9413-957d35d80d69 req-8dc04758-bf8a-402f-8d43-59c7597d7275 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:02:03.838692 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-f2361d2f-d115-4807-9413-957d35d80d69 req-8dc04758-bf8a-402f-8d43-59c7597d7275 service nova] Creating event network-changed:7fdbebb1-4b5b-4df6-adaf-f3cd64b73aa2 for instance b8073ef8-969d-4b33-b3ab-a02ecb44e199 on nch2-master-1 Jul 23 22:02:03.851648 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-f2361d2f-d115-4807-9413-957d35d80d69 req-8dc04758-bf8a-402f-8d43-59c7597d7275 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073048 Jul 23 22:02:03.852606 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3156/5766] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:02:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 22:02:04.143901 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9ccb4772-67b4-4c43-a57a-4c36db01a4f2 tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:02:04.144609 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-9ccb4772-67b4-4c43-a57a-4c36db01a4f2 tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] [instance: b8073ef8-969d-4b33-b3ab-a02ecb44e199] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:02:04.152025 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9ccb4772-67b4-4c43-a57a-4c36db01a4f2 tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:02:04.152454 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9ccb4772-67b4-4c43-a57a-4c36db01a4f2 tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:02:04.153232 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9ccb4772-67b4-4c43-a57a-4c36db01a4f2 tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:02:04.153717 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9ccb4772-67b4-4c43-a57a-4c36db01a4f2 tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:02:04.342189 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-9ccb4772-67b4-4c43-a57a-4c36db01a4f2 tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d16a88a1e243cdb465ce67f556e784', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a499777d904b1884cfba632bb2a8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:02:04.350384 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9ccb4772-67b4-4c43-a57a-4c36db01a4f2 tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] 10.222.0.17 "GET /compute/v2.1/servers/b8073ef8-969d-4b33-b3ab-a02ecb44e199" status: 200 len: 1316 microversion: 2.1 time: 0.210842 Jul 23 22:02:04.350994 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3157/5767] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:02:04 2022] GET /compute/v2.1/servers/b8073ef8-969d-4b33-b3ab-a02ecb44e199 => generated 1316 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:02:05.368089 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ac2807f1-6f80-48e6-98a2-d63fe875ef7f tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:02:05.368778 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ac2807f1-6f80-48e6-98a2-d63fe875ef7f tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] [instance: b8073ef8-969d-4b33-b3ab-a02ecb44e199] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:02:05.375352 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ac2807f1-6f80-48e6-98a2-d63fe875ef7f tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:02:05.375840 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ac2807f1-6f80-48e6-98a2-d63fe875ef7f tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:02:05.376628 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ac2807f1-6f80-48e6-98a2-d63fe875ef7f tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:02:05.377092 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ac2807f1-6f80-48e6-98a2-d63fe875ef7f tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:02:05.586475 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ac2807f1-6f80-48e6-98a2-d63fe875ef7f tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d16a88a1e243cdb465ce67f556e784', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a499777d904b1884cfba632bb2a8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:02:05.594857 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ac2807f1-6f80-48e6-98a2-d63fe875ef7f tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] 10.222.0.17 "GET /compute/v2.1/servers/b8073ef8-969d-4b33-b3ab-a02ecb44e199" status: 200 len: 1316 microversion: 2.1 time: 0.231629 Jul 23 22:02:05.595595 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3158/5768] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:02:05 2022] GET /compute/v2.1/servers/b8073ef8-969d-4b33-b3ab-a02ecb44e199 => generated 1316 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:02:06.612718 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0a4c5f21-3e72-46ef-b928-cfc6e4d6ceb1 tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:02:06.613481 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-0a4c5f21-3e72-46ef-b928-cfc6e4d6ceb1 tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] [instance: b8073ef8-969d-4b33-b3ab-a02ecb44e199] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:02:06.621104 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0a4c5f21-3e72-46ef-b928-cfc6e4d6ceb1 tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:02:06.621575 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0a4c5f21-3e72-46ef-b928-cfc6e4d6ceb1 tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:02:06.622429 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0a4c5f21-3e72-46ef-b928-cfc6e4d6ceb1 tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:02:06.622886 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0a4c5f21-3e72-46ef-b928-cfc6e4d6ceb1 tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:02:06.762731 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-0a4c5f21-3e72-46ef-b928-cfc6e4d6ceb1 tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d16a88a1e243cdb465ce67f556e784', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a499777d904b1884cfba632bb2a8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:02:06.771221 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-0a4c5f21-3e72-46ef-b928-cfc6e4d6ceb1 tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] 10.222.0.17 "GET /compute/v2.1/servers/b8073ef8-969d-4b33-b3ab-a02ecb44e199" status: 200 len: 1316 microversion: 2.1 time: 0.162365 Jul 23 22:02:06.771834 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3159/5769] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:02:06 2022] GET /compute/v2.1/servers/b8073ef8-969d-4b33-b3ab-a02ecb44e199 => generated 1316 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:02:07.791982 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b7cdab83-f31f-41a4-9916-de9c7354eab8 tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:02:07.793064 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b7cdab83-f31f-41a4-9916-de9c7354eab8 tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] [instance: b8073ef8-969d-4b33-b3ab-a02ecb44e199] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:02:07.801480 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b7cdab83-f31f-41a4-9916-de9c7354eab8 tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:02:07.802005 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b7cdab83-f31f-41a4-9916-de9c7354eab8 tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:02:07.802826 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b7cdab83-f31f-41a4-9916-de9c7354eab8 tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:02:07.803298 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b7cdab83-f31f-41a4-9916-de9c7354eab8 tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:02:07.942597 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b7cdab83-f31f-41a4-9916-de9c7354eab8 tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d16a88a1e243cdb465ce67f556e784', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a499777d904b1884cfba632bb2a8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:02:07.953422 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b7cdab83-f31f-41a4-9916-de9c7354eab8 tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] 10.222.0.17 "GET /compute/v2.1/servers/b8073ef8-969d-4b33-b3ab-a02ecb44e199" status: 200 len: 1316 microversion: 2.1 time: 0.168123 Jul 23 22:02:07.954043 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3160/5770] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:02:07 2022] GET /compute/v2.1/servers/b8073ef8-969d-4b33-b3ab-a02ecb44e199 => generated 1316 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:02:08.847374 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-29bc9a70-98cb-42af-ab0b-8552ad49b73c req-4c801d46-f3ed-4bb7-90dd-3b52a34bc0cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8073ef8-969d-4b33-b3ab-a02ecb44e199", "name": "network-vif-plugged", "status": "completed", "tag": "7fdbebb1-4b5b-4df6-adaf-f3cd64b73aa2"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:02:08.857024 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-29bc9a70-98cb-42af-ab0b-8552ad49b73c req-4c801d46-f3ed-4bb7-90dd-3b52a34bc0cc service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:02:08.857478 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-29bc9a70-98cb-42af-ab0b-8552ad49b73c req-4c801d46-f3ed-4bb7-90dd-3b52a34bc0cc service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:02:08.868932 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-29bc9a70-98cb-42af-ab0b-8552ad49b73c req-4c801d46-f3ed-4bb7-90dd-3b52a34bc0cc service nova] Creating event network-vif-plugged:7fdbebb1-4b5b-4df6-adaf-f3cd64b73aa2 for instance b8073ef8-969d-4b33-b3ab-a02ecb44e199 on nch2-master-1 Jul 23 22:02:08.874106 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-29bc9a70-98cb-42af-ab0b-8552ad49b73c req-4c801d46-f3ed-4bb7-90dd-3b52a34bc0cc service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030443 Jul 23 22:02:08.874899 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3161/5771] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:02:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:02:08.971375 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d22bf1cd-55bf-4fd1-91e6-d57887e3d208 tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:02:08.971977 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d22bf1cd-55bf-4fd1-91e6-d57887e3d208 tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] [instance: b8073ef8-969d-4b33-b3ab-a02ecb44e199] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:02:08.979011 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d22bf1cd-55bf-4fd1-91e6-d57887e3d208 tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:02:08.979476 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d22bf1cd-55bf-4fd1-91e6-d57887e3d208 tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:02:08.980342 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d22bf1cd-55bf-4fd1-91e6-d57887e3d208 tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:02:08.980787 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d22bf1cd-55bf-4fd1-91e6-d57887e3d208 tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:02:09.122862 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d22bf1cd-55bf-4fd1-91e6-d57887e3d208 tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d16a88a1e243cdb465ce67f556e784', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a499777d904b1884cfba632bb2a8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:02:09.130876 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d22bf1cd-55bf-4fd1-91e6-d57887e3d208 tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] 10.222.0.17 "GET /compute/v2.1/servers/b8073ef8-969d-4b33-b3ab-a02ecb44e199" status: 200 len: 1316 microversion: 2.1 time: 0.164510 Jul 23 22:02:09.131494 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3162/5772] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:02:08 2022] GET /compute/v2.1/servers/b8073ef8-969d-4b33-b3ab-a02ecb44e199 => generated 1316 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:02:10.148144 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d4899e56-f68c-4c89-80bf-80ccbe2cb68b tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:02:10.148840 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d4899e56-f68c-4c89-80bf-80ccbe2cb68b tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] [instance: b8073ef8-969d-4b33-b3ab-a02ecb44e199] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:02:10.156135 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d4899e56-f68c-4c89-80bf-80ccbe2cb68b tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:02:10.156589 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d4899e56-f68c-4c89-80bf-80ccbe2cb68b tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:02:10.157365 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d4899e56-f68c-4c89-80bf-80ccbe2cb68b tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:02:10.157802 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d4899e56-f68c-4c89-80bf-80ccbe2cb68b tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:02:10.297133 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d4899e56-f68c-4c89-80bf-80ccbe2cb68b tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d16a88a1e243cdb465ce67f556e784', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a499777d904b1884cfba632bb2a8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:02:10.308773 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d4899e56-f68c-4c89-80bf-80ccbe2cb68b tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] 10.222.0.17 "GET /compute/v2.1/servers/b8073ef8-969d-4b33-b3ab-a02ecb44e199" status: 200 len: 1504 microversion: 2.1 time: 0.164357 Jul 23 22:02:10.309653 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3163/5773] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:02:10 2022] GET /compute/v2.1/servers/b8073ef8-969d-4b33-b3ab-a02ecb44e199 => generated 1504 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:02:10.333900 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b7754651-cc3d-47c0-8679-de2e52d5a065 tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:02:10.334662 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b7754651-cc3d-47c0-8679-de2e52d5a065 tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] [instance: b8073ef8-969d-4b33-b3ab-a02ecb44e199] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:02:10.344178 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b7754651-cc3d-47c0-8679-de2e52d5a065 tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:02:10.344712 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b7754651-cc3d-47c0-8679-de2e52d5a065 tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:02:10.345482 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b7754651-cc3d-47c0-8679-de2e52d5a065 tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:02:10.345994 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b7754651-cc3d-47c0-8679-de2e52d5a065 tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:02:10.426365 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b7754651-cc3d-47c0-8679-de2e52d5a065 tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] 10.222.0.17 "DELETE /compute/v2.1/servers/b8073ef8-969d-4b33-b3ab-a02ecb44e199/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.098199 Jul 23 22:02:10.427052 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3164/5774] 10.222.0.17 () {58 vars in 1295 bytes} [Sat Jul 23 22:02:10 2022] DELETE /compute/v2.1/servers/b8073ef8-969d-4b33-b3ab-a02ecb44e199/os-server-password => generated 0 bytes in 100 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 23 22:02:10.437214 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-56a8c949-c380-4cd4-b0ae-a8f1f1edaa06 tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:02:10.437710 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-56a8c949-c380-4cd4-b0ae-a8f1f1edaa06 tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] [instance: b8073ef8-969d-4b33-b3ab-a02ecb44e199] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:02:10.443885 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-56a8c949-c380-4cd4-b0ae-a8f1f1edaa06 tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:02:10.444349 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-56a8c949-c380-4cd4-b0ae-a8f1f1edaa06 tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:02:10.445127 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-56a8c949-c380-4cd4-b0ae-a8f1f1edaa06 tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:02:10.445559 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-56a8c949-c380-4cd4-b0ae-a8f1f1edaa06 tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:02:10.469164 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-56a8c949-c380-4cd4-b0ae-a8f1f1edaa06 tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] 10.222.0.17 "GET /compute/v2.1/servers/b8073ef8-969d-4b33-b3ab-a02ecb44e199/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.035775 Jul 23 22:02:10.469749 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3165/5775] 10.222.0.17 () {58 vars in 1292 bytes} [Sat Jul 23 22:02:10 2022] GET /compute/v2.1/servers/b8073ef8-969d-4b33-b3ab-a02ecb44e199/os-server-password => generated 16 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 23 22:02:10.480517 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1bc4e819-87ae-4cee-b6d3-eedf2bb0a4c9 tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:02:10.481018 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1bc4e819-87ae-4cee-b6d3-eedf2bb0a4c9 tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] [instance: b8073ef8-969d-4b33-b3ab-a02ecb44e199] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:02:10.487366 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1bc4e819-87ae-4cee-b6d3-eedf2bb0a4c9 tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:02:10.487815 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1bc4e819-87ae-4cee-b6d3-eedf2bb0a4c9 tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:02:10.488608 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1bc4e819-87ae-4cee-b6d3-eedf2bb0a4c9 tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:02:10.489048 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1bc4e819-87ae-4cee-b6d3-eedf2bb0a4c9 tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:02:10.515113 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1bc4e819-87ae-4cee-b6d3-eedf2bb0a4c9 tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] [instance: b8073ef8-969d-4b33-b3ab-a02ecb44e199] Going to try to terminate instance {{(pid=131320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 22:02:10.598345 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:02:10.607111 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1bc4e819-87ae-4cee-b6d3-eedf2bb0a4c9 tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] 10.222.0.17 "DELETE /compute/v2.1/servers/b8073ef8-969d-4b33-b3ab-a02ecb44e199" status: 204 len: 0 microversion: 2.1 time: 0.129608 Jul 23 22:02:10.608061 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3166/5776] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 22:02:10 2022] DELETE /compute/v2.1/servers/b8073ef8-969d-4b33-b3ab-a02ecb44e199 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 22:02:10.617547 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-22aa1ec4-3fec-4fd9-b03a-dabe548156de tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:02:10.618278 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-22aa1ec4-3fec-4fd9-b03a-dabe548156de tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] [instance: b8073ef8-969d-4b33-b3ab-a02ecb44e199] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:02:10.624920 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-22aa1ec4-3fec-4fd9-b03a-dabe548156de tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:02:10.625370 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-22aa1ec4-3fec-4fd9-b03a-dabe548156de tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:02:10.626187 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-22aa1ec4-3fec-4fd9-b03a-dabe548156de tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:02:10.626628 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-22aa1ec4-3fec-4fd9-b03a-dabe548156de tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:02:10.747779 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=8 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:02:10.770194 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-22aa1ec4-3fec-4fd9-b03a-dabe548156de tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d16a88a1e243cdb465ce67f556e784', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a499777d904b1884cfba632bb2a8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:02:10.780650 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-22aa1ec4-3fec-4fd9-b03a-dabe548156de tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] 10.222.0.17 "GET /compute/v2.1/servers/b8073ef8-969d-4b33-b3ab-a02ecb44e199" status: 200 len: 1510 microversion: 2.1 time: 0.167342 Jul 23 22:02:10.781247 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3167/5777] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:02:10 2022] GET /compute/v2.1/servers/b8073ef8-969d-4b33-b3ab-a02ecb44e199 => generated 1510 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:02:11.802293 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6dcc7283-fbb7-4ad3-9d56-48690410eca0 tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:02:11.803425 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6dcc7283-fbb7-4ad3-9d56-48690410eca0 tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] [instance: b8073ef8-969d-4b33-b3ab-a02ecb44e199] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:02:11.813519 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6dcc7283-fbb7-4ad3-9d56-48690410eca0 tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:02:11.814021 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6dcc7283-fbb7-4ad3-9d56-48690410eca0 tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:02:11.814804 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6dcc7283-fbb7-4ad3-9d56-48690410eca0 tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:02:11.815247 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6dcc7283-fbb7-4ad3-9d56-48690410eca0 tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:02:11.819488 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=5 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:02:12.041423 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6dcc7283-fbb7-4ad3-9d56-48690410eca0 tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3d16a88a1e243cdb465ce67f556e784', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a499777d904b1884cfba632bb2a8c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:02:12.049496 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6dcc7283-fbb7-4ad3-9d56-48690410eca0 tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] 10.222.0.17 "GET /compute/v2.1/servers/b8073ef8-969d-4b33-b3ab-a02ecb44e199" status: 200 len: 1510 microversion: 2.1 time: 0.253974 Jul 23 22:02:12.050127 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3168/5778] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:02:11 2022] GET /compute/v2.1/servers/b8073ef8-969d-4b33-b3ab-a02ecb44e199 => generated 1510 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:02:12.419962 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-04cee54d-b617-45cb-82e2-dea2d358c18f req-ebf2615f-f9ae-4940-935c-c65cc55b7976 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8073ef8-969d-4b33-b3ab-a02ecb44e199", "name": "network-vif-deleted", "tag": "7fdbebb1-4b5b-4df6-adaf-f3cd64b73aa2"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:02:12.425351 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:DELETE=3,nova_api:INSERT=3 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:02:12.444938 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-04cee54d-b617-45cb-82e2-dea2d358c18f req-ebf2615f-f9ae-4940-935c-c65cc55b7976 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:02:12.445375 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-04cee54d-b617-45cb-82e2-dea2d358c18f req-ebf2615f-f9ae-4940-935c-c65cc55b7976 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:02:12.459392 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-04cee54d-b617-45cb-82e2-dea2d358c18f req-ebf2615f-f9ae-4940-935c-c65cc55b7976 service nova] Creating event network-vif-deleted:7fdbebb1-4b5b-4df6-adaf-f3cd64b73aa2 for instance b8073ef8-969d-4b33-b3ab-a02ecb44e199 on nch2-master-1 Jul 23 22:02:12.464527 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-04cee54d-b617-45cb-82e2-dea2d358c18f req-ebf2615f-f9ae-4940-935c-c65cc55b7976 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057217 Jul 23 22:02:12.465227 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3169/5779] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:02:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:02:13.073703 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9ab13611-b2eb-488a-8530-aa173c76a2f3 tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:02:13.074950 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-9ab13611-b2eb-488a-8530-aa173c76a2f3 tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] [instance: b8073ef8-969d-4b33-b3ab-a02ecb44e199] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:02:13.082101 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9ab13611-b2eb-488a-8530-aa173c76a2f3 tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:02:13.082557 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9ab13611-b2eb-488a-8530-aa173c76a2f3 tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:02:13.083294 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9ab13611-b2eb-488a-8530-aa173c76a2f3 tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:02:13.083758 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9ab13611-b2eb-488a-8530-aa173c76a2f3 tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:02:13.100724 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-9ab13611-b2eb-488a-8530-aa173c76a2f3 tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] HTTP exception thrown: Instance b8073ef8-969d-4b33-b3ab-a02ecb44e199 could not be found. Jul 23 22:02:13.102419 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9ab13611-b2eb-488a-8530-aa173c76a2f3 tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] Request method failure captured: Jul 23 22:02:13.102419 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/b8073ef8-969d-4b33-b3ab-a02ecb44e199 HTTP/1.1 Jul 23 22:02:13.102419 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 22:02:13.102419 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 22:02:13.102419 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 22:02:13.102419 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 22:02:13.102419 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 22:02:13.102419 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 22:02:13.102419 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 22:02:13.102419 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 22:02:13.102419 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3G_XV9GgMn1nQMtIQ_Xhrq4MEZAJ55IRsyL3A7sT_go_HT5_ZislzibIquu_wNw3xHvUl_VPDPQoGGXcEQxjZlmUSO9TQ89YbE9bYNY1n735_aCqIawAAXEollmhVTLiNgSiKkob1d9fYBPXjWAbyx7ahyvrc5MoInlbi0--Y1hmSOY Jul 23 22:02:13.102419 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 22:02:13.102419 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 22:02:13.102419 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 22:02:13.102419 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 22:02:13.102419 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 22:02:13.102419 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 22:02:13.102419 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 67a499777d904b1884cfba632bb2a8c6 Jul 23 22:02:13.102419 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServerPasswordTestJSON-191834462 Jul 23 22:02:13.102419 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 22:02:13.102419 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 22:02:13.102419 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/67a499777d904b1884cfba632bb2a8c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/67a499777d904b1884cfba632bb2a8c6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_67a499777d904b1884cfba632bb2a8c6", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/67a499777d904b1884cfba632bb2a8c6"}]}] Jul 23 22:02:13.102419 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServerPasswordTestJSON-191834462 Jul 23 22:02:13.102419 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 67a499777d904b1884cfba632bb2a8c6 Jul 23 22:02:13.102419 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServerPasswordTestJSON-191834462 Jul 23 22:02:13.102419 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServerPasswordTestJSON-191834462-project Jul 23 22:02:13.102419 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 22:02:13.102419 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 22:02:13.102419 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: a3d16a88a1e243cdb465ce67f556e784 Jul 23 22:02:13.102419 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServerPasswordTestJSON-191834462-project Jul 23 22:02:13.102419 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 22:02:13.102419 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance b8073ef8-969d-4b33-b3ab-a02ecb44e199 could not be found. Jul 23 22:02:13.102419 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': 'b8073ef8-969d-4b33-b3ab-a02ecb44e199'} Jul 23 22:02:13.102419 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 22:02:13.102419 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:02:13.102419 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 22:02:13.102419 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 22:02:13.102419 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 22:02:13.102419 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 22:02:13.102419 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 22:02:13.102419 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 22:02:13.102419 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 22:02:13.102419 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 22:02:13.102419 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8073ef8-969d-4b33-b3ab-a02ecb44e199 could not be found. Jul 23 22:02:13.102419 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:02:13.102419 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:02:13.102419 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:02:13.102419 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:02:13.102419 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:02:13.102419 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:02:13.102419 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 22:02:13.102419 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 22:02:13.102419 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 22:02:13.102419 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 22:02:13.102419 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 22:02:13.102419 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 22:02:13.102419 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 22:02:13.102419 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 22:02:13.102419 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 22:02:13.102419 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 22:02:13.102419 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8073ef8-969d-4b33-b3ab-a02ecb44e199 could not be found. Jul 23 22:02:13.102419 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:02:13.102419 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:02:13.102419 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:02:13.107101 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:02:13.107101 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:02:13.107101 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:02:13.107101 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 22:02:13.107101 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 22:02:13.107101 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8073ef8-969d-4b33-b3ab-a02ecb44e199 could not be found. Jul 23 22:02:13.107101 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:02:13.107101 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9ab13611-b2eb-488a-8530-aa173c76a2f3 tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] Returning 404 to user: Instance b8073ef8-969d-4b33-b3ab-a02ecb44e199 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 22:02:13.107101 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9ab13611-b2eb-488a-8530-aa173c76a2f3 tempest-ServerPasswordTestJSON-191834462 tempest-ServerPasswordTestJSON-191834462-project] 10.222.0.17 "GET /compute/v2.1/servers/b8073ef8-969d-4b33-b3ab-a02ecb44e199" status: 404 len: 111 microversion: 2.1 time: 0.039142 Jul 23 22:02:13.107101 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3170/5780] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:02:13 2022] GET /compute/v2.1/servers/b8073ef8-969d-4b33-b3ab-a02ecb44e199 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 22:02:17.238484 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f36cfca7-2a44-4f58-8b5a-c2dbf910259d tempest-ExtensionsTest-694384853 tempest-ExtensionsTest-694384853-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:02:17.240076 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f36cfca7-2a44-4f58-8b5a-c2dbf910259d tempest-ExtensionsTest-694384853 tempest-ExtensionsTest-694384853-project] 10.222.0.17 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.145269 Jul 23 22:02:17.240613 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3171/5781] 10.222.0.17 () {58 vars in 1169 bytes} [Sat Jul 23 22:02:17 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:02:17.250304 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f15ab3f5-6cd9-4d8b-a625-5a4c8cfc3ee0 tempest-ExtensionsTest-694384853 tempest-ExtensionsTest-694384853-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:02:17.252317 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f15ab3f5-6cd9-4d8b-a625-5a4c8cfc3ee0 tempest-ExtensionsTest-694384853 tempest-ExtensionsTest-694384853-project] 10.222.0.17 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.005380 Jul 23 22:02:17.252868 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3172/5782] 10.222.0.17 () {58 vars in 1133 bytes} [Sat Jul 23 22:02:17 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 23 22:02:19.134815 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ead126c6-44cd-421e-8f18-7ed93570e806 tempest-QuotasTestJSON-1065858816 tempest-QuotasTestJSON-1065858816-project] Calling method '.version_select at 0x7f0b4651faf0>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:02:19.195825 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ead126c6-44cd-421e-8f18-7ed93570e806 tempest-QuotasTestJSON-1065858816 tempest-QuotasTestJSON-1065858816-project] 10.222.0.17 "GET /compute/v2.1/os-quota-sets/ac148c26c08f40d993564ef1a30313dc/defaults" status: 200 len: 371 microversion: 2.1 time: 0.183996 Jul 23 22:02:19.196395 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3173/5783] 10.222.0.17 () {58 vars in 1268 bytes} [Sat Jul 23 22:02:19 2022] GET /compute/v2.1/os-quota-sets/ac148c26c08f40d993564ef1a30313dc/defaults => generated 371 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:02:19.206914 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e794c41b-bc22-4aa6-b901-926de704b598 tempest-QuotasTestJSON-1065858816 tempest-QuotasTestJSON-1065858816-project] Calling method '.version_select at 0x7f0b4651fa60>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:02:19.280866 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e794c41b-bc22-4aa6-b901-926de704b598 tempest-QuotasTestJSON-1065858816 tempest-QuotasTestJSON-1065858816-project] 10.222.0.17 "GET /compute/v2.1/os-quota-sets/ac148c26c08f40d993564ef1a30313dc" status: 200 len: 371 microversion: 2.1 time: 0.077075 Jul 23 22:02:19.281513 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3174/5784] 10.222.0.17 () {58 vars in 1241 bytes} [Sat Jul 23 22:02:19 2022] GET /compute/v2.1/os-quota-sets/ac148c26c08f40d993564ef1a30313dc => generated 371 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 22:02:19.293516 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-fdf0135e-4d30-4c25-b360-1ef3ed667c14 tempest-QuotasTestJSON-1065858816 tempest-QuotasTestJSON-1065858816-project] Calling method '.version_select at 0x7f0b464d5160>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:02:19.351291 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-fdf0135e-4d30-4c25-b360-1ef3ed667c14 tempest-QuotasTestJSON-1065858816 tempest-QuotasTestJSON-1065858816-project] 10.222.0.17 "GET /compute/v2.1/os-quota-sets/ac148c26c08f40d993564ef1a30313dc/defaults" status: 200 len: 371 microversion: 2.1 time: 0.061396 Jul 23 22:02:19.351923 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3175/5785] 10.222.0.17 () {58 vars in 1268 bytes} [Sat Jul 23 22:02:19 2022] GET /compute/v2.1/os-quota-sets/ac148c26c08f40d993564ef1a30313dc/defaults => generated 371 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 22:02:19.363524 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-98342397-d5dd-43d2-879d-be4b21eaf52d tempest-QuotasTestJSON-1065858816 tempest-QuotasTestJSON-1065858816-project] Calling method '.version_select at 0x7f0b47dc2160>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:02:19.437829 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-98342397-d5dd-43d2-879d-be4b21eaf52d tempest-QuotasTestJSON-1065858816 tempest-QuotasTestJSON-1065858816-project] 10.222.0.17 "GET /compute/v2.1/os-quota-sets/ac148c26c08f40d993564ef1a30313dc" status: 200 len: 371 microversion: 2.1 time: 0.077759 Jul 23 22:02:19.438457 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3176/5786] 10.222.0.17 () {58 vars in 1241 bytes} [Sat Jul 23 22:02:19 2022] GET /compute/v2.1/os-quota-sets/ac148c26c08f40d993564ef1a30313dc => generated 371 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:02:19.451196 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ab2f2c81-26b1-44c9-a781-90ebe5022689 tempest-QuotasTestJSON-1065858816 tempest-QuotasTestJSON-1065858816-project] Calling method '.version_select at 0x7f0b598c9790>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:02:19.539726 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ab2f2c81-26b1-44c9-a781-90ebe5022689 tempest-QuotasTestJSON-1065858816 tempest-QuotasTestJSON-1065858816-project] 10.222.0.17 "GET /compute/v2.1/os-quota-sets/ac148c26c08f40d993564ef1a30313dc?user_id=c3fe4d81f4b24a619e04d8be00a94f79" status: 200 len: 371 microversion: 2.1 time: 0.094596 Jul 23 22:02:19.540298 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3177/5787] 10.222.0.17 () {58 vars in 1322 bytes} [Sat Jul 23 22:02:19 2022] GET /compute/v2.1/os-quota-sets/ac148c26c08f40d993564ef1a30313dc?user_id=c3fe4d81f4b24a619e04d8be00a94f79 => generated 371 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:05:05.573747 ncdv-master-1 devstack@n-api.service[131320]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7bb808cf-dbe0-4ba5-ad7e-371257d030a5] AMQP server on 10.222.0.17:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 23 22:05:05.575020 ncdv-master-1 devstack@n-api.service[131320]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f00542ad-3110-4bfe-937f-f2bf8408f43a] AMQP server on 10.222.0.17:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 23 22:05:05.576111 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=8 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:05:05.577287 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=8 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:05:05.577724 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=21 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:05:05.582345 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-cda5f004-2e1c-44d6-92f8-16ddbb9cb5d0 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Action: 'create', calling method: .version_select at 0x7f0b59a53430>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1581527810", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNDWZ5fOwpSonoOBlGWBnRA9qkPnWdpq7yERhF1o6CtpM6hsycAB8+uGnGv/imx498mKV4Nori8k3Fj7hEWvsD463BlE3cwFNckqaMMyI5feS2hxp8I5ghJF5G6gHoFOPQ=="}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:05:05.599411 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-cda5f004-2e1c-44d6-92f8-16ddbb9cb5d0 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Getting quotas for project 1d1919be84b04d4c9306ef33015632a0. Resources: {'key_pairs'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 22:05:05.606654 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-cda5f004-2e1c-44d6-92f8-16ddbb9cb5d0 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Getting quotas for user 5ce861b0f93142849eb235b3df8b9aa0 and project 1d1919be84b04d4c9306ef33015632a0. Resources: {'key_pairs'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 22:05:05.620654 ncdv-master-1 devstack@n-api.service[131320]: ERROR oslo.messaging._drivers.impl_rabbit [None req-cda5f004-2e1c-44d6-92f8-16ddbb9cb5d0 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] [cf0c7d1a-7f69-4e77-94fd-9da62dd62de0] AMQP server on 10.222.0.17:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 23 22:05:06.587460 ncdv-master-1 devstack@n-api.service[131320]: INFO oslo.messaging._drivers.impl_rabbit [-] [7bb808cf-dbe0-4ba5-ad7e-371257d030a5] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 57594. Jul 23 22:05:06.589217 ncdv-master-1 devstack@n-api.service[131320]: INFO oslo.messaging._drivers.impl_rabbit [-] [f00542ad-3110-4bfe-937f-f2bf8408f43a] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 57596. Jul 23 22:05:06.629028 ncdv-master-1 devstack@n-api.service[131320]: INFO oslo.messaging._drivers.impl_rabbit [None req-cda5f004-2e1c-44d6-92f8-16ddbb9cb5d0 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] [cf0c7d1a-7f69-4e77-94fd-9da62dd62de0] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 57598. Jul 23 22:05:06.648777 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-cda5f004-2e1c-44d6-92f8-16ddbb9cb5d0 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 1.077147 Jul 23 22:05:06.650110 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3178/5788] 10.222.0.17 () {60 vars in 1158 bytes} [Sat Jul 23 22:05:05 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:05:07.871439 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-dcc3c3df-f529-4b39-b831-6c23ebbd22af tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1750566033", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "networks": [{"uuid": "55d4a513-5013-4b59-92a9-908cb7fffc2f"}], "key_name": "tempest-TestNetworkBasicOps-1581527810", "security_groups": [{"name": "tempest-secgroup-smoke-1123452158"}]}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:05:07.991810 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-dcc3c3df-f529-4b39-b831-6c23ebbd22af tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] validate_networks() for [('55d4a513-5013-4b59-92a9-908cb7fffc2f', None, None, None, None, None)] {{(pid=131320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 22:05:08.375498 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-dcc3c3df-f529-4b39-b831-6c23ebbd22af tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 22:05:08.375985 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-dcc3c3df-f529-4b39-b831-6c23ebbd22af tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 22:05:08.376649 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-dcc3c3df-f529-4b39-b831-6c23ebbd22af tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 22:05:08.377336 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-dcc3c3df-f529-4b39-b831-6c23ebbd22af tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 22:05:08.378040 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-dcc3c3df-f529-4b39-b831-6c23ebbd22af tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 22:05:08.390111 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dcc3c3df-f529-4b39-b831-6c23ebbd22af tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:05:08.390603 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dcc3c3df-f529-4b39-b831-6c23ebbd22af tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:05:08.391401 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dcc3c3df-f529-4b39-b831-6c23ebbd22af tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:05:08.391841 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dcc3c3df-f529-4b39-b831-6c23ebbd22af tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:05:08.408944 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-dcc3c3df-f529-4b39-b831-6c23ebbd22af tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Getting quotas for project 1d1919be84b04d4c9306ef33015632a0. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 22:05:08.414436 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-dcc3c3df-f529-4b39-b831-6c23ebbd22af tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Getting quotas for user 5ce861b0f93142849eb235b3df8b9aa0 and project 1d1919be84b04d4c9306ef33015632a0. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 22:05:08.427138 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-dcc3c3df-f529-4b39-b831-6c23ebbd22af tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Going to run 1 instances... {{(pid=131320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 22:05:08.429379 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-dcc3c3df-f529-4b39-b831-6c23ebbd22af tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] [instance: 908a0170-e519-456d-ae93-20f21ed5bf38] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 22:05:08.496222 ncdv-master-1 devstack@n-api.service[131320]: ERROR oslo.messaging._drivers.impl_rabbit [None req-dcc3c3df-f529-4b39-b831-6c23ebbd22af tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] [ec3a315f-d81d-4403-94eb-fb8283efd68c] AMQP server on 10.222.0.17:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 23 22:05:09.509432 ncdv-master-1 devstack@n-api.service[131320]: INFO oslo.messaging._drivers.impl_rabbit [None req-dcc3c3df-f529-4b39-b831-6c23ebbd22af tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] [ec3a315f-d81d-4403-94eb-fb8283efd68c] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 57632. Jul 23 22:05:09.517425 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-dcc3c3df-f529-4b39-b831-6c23ebbd22af tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.650687 Jul 23 22:05:09.518545 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3179/5789] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 22:05:07 2022] POST /compute/v2.1/servers => generated 406 bytes in 1653 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 23 22:05:09.531380 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2d406799-45bd-4a50-b9ed-2c8e04fa36e2 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:05:09.532017 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-2d406799-45bd-4a50-b9ed-2c8e04fa36e2 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] [instance: 908a0170-e519-456d-ae93-20f21ed5bf38] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:05:09.588506 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-2d406799-45bd-4a50-b9ed-2c8e04fa36e2 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce861b0f93142849eb235b3df8b9aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1919be84b04d4c9306ef33015632a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:05:09.595973 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2d406799-45bd-4a50-b9ed-2c8e04fa36e2 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] 10.222.0.17 "GET /compute/v2.1/servers/908a0170-e519-456d-ae93-20f21ed5bf38" status: 200 len: 1249 microversion: 2.1 time: 0.068441 Jul 23 22:05:09.596849 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3180/5790] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:05:09 2022] GET /compute/v2.1/servers/908a0170-e519-456d-ae93-20f21ed5bf38 => generated 1249 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:05:10.613210 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c49dde90-204e-4fa6-a079-40ec15d48fae tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:05:10.613945 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c49dde90-204e-4fa6-a079-40ec15d48fae tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] [instance: 908a0170-e519-456d-ae93-20f21ed5bf38] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:05:10.621667 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c49dde90-204e-4fa6-a079-40ec15d48fae tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:05:10.622394 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c49dde90-204e-4fa6-a079-40ec15d48fae tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:05:10.623182 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c49dde90-204e-4fa6-a079-40ec15d48fae tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:05:10.623619 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c49dde90-204e-4fa6-a079-40ec15d48fae tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:05:10.720359 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c49dde90-204e-4fa6-a079-40ec15d48fae tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce861b0f93142849eb235b3df8b9aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1919be84b04d4c9306ef33015632a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:05:10.728217 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c49dde90-204e-4fa6-a079-40ec15d48fae tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] 10.222.0.17 "GET /compute/v2.1/servers/908a0170-e519-456d-ae93-20f21ed5bf38" status: 200 len: 1309 microversion: 2.1 time: 0.119301 Jul 23 22:05:10.728798 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3181/5791] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:05:10 2022] GET /compute/v2.1/servers/908a0170-e519-456d-ae93-20f21ed5bf38 => generated 1309 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:05:11.745048 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-fc7b9924-b73b-4a22-ade8-b45df384bf90 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:05:11.745747 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-fc7b9924-b73b-4a22-ade8-b45df384bf90 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] [instance: 908a0170-e519-456d-ae93-20f21ed5bf38] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:05:11.752915 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fc7b9924-b73b-4a22-ade8-b45df384bf90 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:05:11.753490 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fc7b9924-b73b-4a22-ade8-b45df384bf90 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:05:11.754359 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fc7b9924-b73b-4a22-ade8-b45df384bf90 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:05:11.754747 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fc7b9924-b73b-4a22-ade8-b45df384bf90 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:05:11.989557 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-fc7b9924-b73b-4a22-ade8-b45df384bf90 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce861b0f93142849eb235b3df8b9aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1919be84b04d4c9306ef33015632a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:05:11.998016 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-fc7b9924-b73b-4a22-ade8-b45df384bf90 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] 10.222.0.17 "GET /compute/v2.1/servers/908a0170-e519-456d-ae93-20f21ed5bf38" status: 200 len: 1375 microversion: 2.1 time: 0.256897 Jul 23 22:05:11.998690 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3182/5792] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:05:11 2022] GET /compute/v2.1/servers/908a0170-e519-456d-ae93-20f21ed5bf38 => generated 1375 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:05:12.132644 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-2ef60ad3-e253-4942-bc25-5c2cb5615d8b req-0bd514ae-c65f-49d6-9066-e9436422b8eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "908a0170-e519-456d-ae93-20f21ed5bf38", "tag": "7ee0cbc4-d6f4-492c-9756-344dfb97d512"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:05:12.143764 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-2ef60ad3-e253-4942-bc25-5c2cb5615d8b req-0bd514ae-c65f-49d6-9066-e9436422b8eb service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:05:12.144377 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-2ef60ad3-e253-4942-bc25-5c2cb5615d8b req-0bd514ae-c65f-49d6-9066-e9436422b8eb service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:05:12.167688 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-2ef60ad3-e253-4942-bc25-5c2cb5615d8b req-0bd514ae-c65f-49d6-9066-e9436422b8eb service nova] Creating event network-changed:7ee0cbc4-d6f4-492c-9756-344dfb97d512 for instance 908a0170-e519-456d-ae93-20f21ed5bf38 on nch2-master-1 Jul 23 22:05:12.171890 ncdv-master-1 devstack@n-api.service[131320]: ERROR oslo.messaging._drivers.impl_rabbit [req-2ef60ad3-e253-4942-bc25-5c2cb5615d8b req-0bd514ae-c65f-49d6-9066-e9436422b8eb service nova] [52d86cf3-3726-4b6e-a876-09291aaac202] AMQP server on 10.222.0.17:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 23 22:05:13.179469 ncdv-master-1 devstack@n-api.service[131320]: INFO oslo.messaging._drivers.impl_rabbit [req-2ef60ad3-e253-4942-bc25-5c2cb5615d8b req-0bd514ae-c65f-49d6-9066-e9436422b8eb service nova] [52d86cf3-3726-4b6e-a876-09291aaac202] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 57656. Jul 23 22:05:13.182951 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-2ef60ad3-e253-4942-bc25-5c2cb5615d8b req-0bd514ae-c65f-49d6-9066-e9436422b8eb service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.054382 Jul 23 22:05:13.183684 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3183/5793] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:05:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 22:05:13.188990 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1d583891-e098-4dfb-a667-09b93851966b tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:05:13.189694 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1d583891-e098-4dfb-a667-09b93851966b tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] [instance: 908a0170-e519-456d-ae93-20f21ed5bf38] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:05:13.196426 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1d583891-e098-4dfb-a667-09b93851966b tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:05:13.196914 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1d583891-e098-4dfb-a667-09b93851966b tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:05:13.197683 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1d583891-e098-4dfb-a667-09b93851966b tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:05:13.198166 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1d583891-e098-4dfb-a667-09b93851966b tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:05:13.334318 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-1d583891-e098-4dfb-a667-09b93851966b tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce861b0f93142849eb235b3df8b9aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1919be84b04d4c9306ef33015632a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:05:13.342687 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1d583891-e098-4dfb-a667-09b93851966b tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] 10.222.0.17 "GET /compute/v2.1/servers/908a0170-e519-456d-ae93-20f21ed5bf38" status: 200 len: 1375 microversion: 2.1 time: 0.157861 Jul 23 22:05:13.343271 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3184/5794] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:05:13 2022] GET /compute/v2.1/servers/908a0170-e519-456d-ae93-20f21ed5bf38 => generated 1375 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:05:14.364455 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5da14cb8-598f-44a6-9a0d-52ae928252e0 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:05:14.365591 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5da14cb8-598f-44a6-9a0d-52ae928252e0 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] [instance: 908a0170-e519-456d-ae93-20f21ed5bf38] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:05:14.378163 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5da14cb8-598f-44a6-9a0d-52ae928252e0 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:05:14.379015 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5da14cb8-598f-44a6-9a0d-52ae928252e0 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:05:14.380275 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5da14cb8-598f-44a6-9a0d-52ae928252e0 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:05:14.381006 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5da14cb8-598f-44a6-9a0d-52ae928252e0 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:05:14.527036 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5da14cb8-598f-44a6-9a0d-52ae928252e0 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce861b0f93142849eb235b3df8b9aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1919be84b04d4c9306ef33015632a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:05:14.535200 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5da14cb8-598f-44a6-9a0d-52ae928252e0 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] 10.222.0.17 "GET /compute/v2.1/servers/908a0170-e519-456d-ae93-20f21ed5bf38" status: 200 len: 1375 microversion: 2.1 time: 0.177544 Jul 23 22:05:14.535751 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3185/5795] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:05:14 2022] GET /compute/v2.1/servers/908a0170-e519-456d-ae93-20f21ed5bf38 => generated 1375 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:05:15.552424 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f8ecc4a1-8464-4cfa-9a12-37cdef252e71 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:05:15.553130 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f8ecc4a1-8464-4cfa-9a12-37cdef252e71 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] [instance: 908a0170-e519-456d-ae93-20f21ed5bf38] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:05:15.560876 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f8ecc4a1-8464-4cfa-9a12-37cdef252e71 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:05:15.561341 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f8ecc4a1-8464-4cfa-9a12-37cdef252e71 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:05:15.562148 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f8ecc4a1-8464-4cfa-9a12-37cdef252e71 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:05:15.562924 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f8ecc4a1-8464-4cfa-9a12-37cdef252e71 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:05:15.704356 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f8ecc4a1-8464-4cfa-9a12-37cdef252e71 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce861b0f93142849eb235b3df8b9aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1919be84b04d4c9306ef33015632a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:05:15.712082 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f8ecc4a1-8464-4cfa-9a12-37cdef252e71 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] 10.222.0.17 "GET /compute/v2.1/servers/908a0170-e519-456d-ae93-20f21ed5bf38" status: 200 len: 1375 microversion: 2.1 time: 0.163658 Jul 23 22:05:15.712674 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3186/5796] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:05:15 2022] GET /compute/v2.1/servers/908a0170-e519-456d-ae93-20f21ed5bf38 => generated 1375 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:05:16.732840 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-37051058-ac2c-4af9-a1e9-6d355f5c8d54 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:05:16.733998 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-37051058-ac2c-4af9-a1e9-6d355f5c8d54 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] [instance: 908a0170-e519-456d-ae93-20f21ed5bf38] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:05:16.745694 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-37051058-ac2c-4af9-a1e9-6d355f5c8d54 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:05:16.746487 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-37051058-ac2c-4af9-a1e9-6d355f5c8d54 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:05:16.747503 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-37051058-ac2c-4af9-a1e9-6d355f5c8d54 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:05:16.747947 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-37051058-ac2c-4af9-a1e9-6d355f5c8d54 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:05:16.895460 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-37051058-ac2c-4af9-a1e9-6d355f5c8d54 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce861b0f93142849eb235b3df8b9aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1919be84b04d4c9306ef33015632a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:05:16.903513 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-37051058-ac2c-4af9-a1e9-6d355f5c8d54 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] 10.222.0.17 "GET /compute/v2.1/servers/908a0170-e519-456d-ae93-20f21ed5bf38" status: 200 len: 1375 microversion: 2.1 time: 0.177418 Jul 23 22:05:16.904094 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3187/5797] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:05:16 2022] GET /compute/v2.1/servers/908a0170-e519-456d-ae93-20f21ed5bf38 => generated 1375 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:05:17.641675 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-638da5ee-5b19-4c47-9ecc-595b53e0d8fe req-4a650ab8-3de3-4315-9af0-cf3852138ac4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "908a0170-e519-456d-ae93-20f21ed5bf38", "name": "network-vif-plugged", "status": "completed", "tag": "7ee0cbc4-d6f4-492c-9756-344dfb97d512"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:05:17.649959 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-638da5ee-5b19-4c47-9ecc-595b53e0d8fe req-4a650ab8-3de3-4315-9af0-cf3852138ac4 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:05:17.650421 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-638da5ee-5b19-4c47-9ecc-595b53e0d8fe req-4a650ab8-3de3-4315-9af0-cf3852138ac4 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:05:17.661832 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-638da5ee-5b19-4c47-9ecc-595b53e0d8fe req-4a650ab8-3de3-4315-9af0-cf3852138ac4 service nova] Creating event network-vif-plugged:7ee0cbc4-d6f4-492c-9756-344dfb97d512 for instance 908a0170-e519-456d-ae93-20f21ed5bf38 on nch2-master-1 Jul 23 22:05:17.666687 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-638da5ee-5b19-4c47-9ecc-595b53e0d8fe req-4a650ab8-3de3-4315-9af0-cf3852138ac4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028802 Jul 23 22:05:17.667466 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3188/5798] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:05:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:05:17.923835 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4ca4b725-f66a-4971-95c2-a54f9be56f54 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:05:17.924532 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-4ca4b725-f66a-4971-95c2-a54f9be56f54 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] [instance: 908a0170-e519-456d-ae93-20f21ed5bf38] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:05:17.931360 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4ca4b725-f66a-4971-95c2-a54f9be56f54 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:05:17.931812 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4ca4b725-f66a-4971-95c2-a54f9be56f54 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:05:17.932552 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4ca4b725-f66a-4971-95c2-a54f9be56f54 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:05:17.933008 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4ca4b725-f66a-4971-95c2-a54f9be56f54 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:05:18.070285 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-4ca4b725-f66a-4971-95c2-a54f9be56f54 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce861b0f93142849eb235b3df8b9aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1919be84b04d4c9306ef33015632a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:05:18.078264 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4ca4b725-f66a-4971-95c2-a54f9be56f54 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] 10.222.0.17 "GET /compute/v2.1/servers/908a0170-e519-456d-ae93-20f21ed5bf38" status: 200 len: 1375 microversion: 2.1 time: 0.159941 Jul 23 22:05:18.078847 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3189/5799] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:05:17 2022] GET /compute/v2.1/servers/908a0170-e519-456d-ae93-20f21ed5bf38 => generated 1375 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:05:19.100293 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-597ab483-4989-46ab-86e2-3a03793f9e65 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:05:19.101384 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-597ab483-4989-46ab-86e2-3a03793f9e65 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] [instance: 908a0170-e519-456d-ae93-20f21ed5bf38] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:05:19.104488 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:05:19.115286 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-597ab483-4989-46ab-86e2-3a03793f9e65 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:05:19.116044 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-597ab483-4989-46ab-86e2-3a03793f9e65 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:05:19.117334 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-597ab483-4989-46ab-86e2-3a03793f9e65 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:05:19.118142 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-597ab483-4989-46ab-86e2-3a03793f9e65 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:05:19.262909 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-597ab483-4989-46ab-86e2-3a03793f9e65 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce861b0f93142849eb235b3df8b9aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1919be84b04d4c9306ef33015632a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:05:19.274769 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-597ab483-4989-46ab-86e2-3a03793f9e65 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] 10.222.0.17 "GET /compute/v2.1/servers/908a0170-e519-456d-ae93-20f21ed5bf38" status: 200 len: 1547 microversion: 2.1 time: 0.180788 Jul 23 22:05:19.275540 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3190/5800] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:05:19 2022] GET /compute/v2.1/servers/908a0170-e519-456d-ae93-20f21ed5bf38 => generated 1547 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:05:19.291775 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-bc2a01ea-a2c4-4e59-a35f-908778bc1086 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:05:19.292391 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-bc2a01ea-a2c4-4e59-a35f-908778bc1086 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] [instance: 908a0170-e519-456d-ae93-20f21ed5bf38] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:05:19.298237 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bc2a01ea-a2c4-4e59-a35f-908778bc1086 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:05:19.298686 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bc2a01ea-a2c4-4e59-a35f-908778bc1086 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:05:19.299458 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bc2a01ea-a2c4-4e59-a35f-908778bc1086 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:05:19.299902 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bc2a01ea-a2c4-4e59-a35f-908778bc1086 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:05:19.435887 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-bc2a01ea-a2c4-4e59-a35f-908778bc1086 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce861b0f93142849eb235b3df8b9aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1919be84b04d4c9306ef33015632a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:05:19.447794 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-bc2a01ea-a2c4-4e59-a35f-908778bc1086 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] 10.222.0.17 "GET /compute/v2.1/servers/908a0170-e519-456d-ae93-20f21ed5bf38" status: 200 len: 1547 microversion: 2.1 time: 0.159225 Jul 23 22:05:19.448639 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3191/5801] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:05:19 2022] GET /compute/v2.1/servers/908a0170-e519-456d-ae93-20f21ed5bf38 => generated 1547 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:05:21.228602 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-da4e9676-620d-4213-a3c3-71a160490a88 req-064aac60-91e0-4f64-bd68-983c96abc254 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "908a0170-e519-456d-ae93-20f21ed5bf38", "tag": "7ee0cbc4-d6f4-492c-9756-344dfb97d512"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:05:21.232881 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=12 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:05:21.239860 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-da4e9676-620d-4213-a3c3-71a160490a88 req-064aac60-91e0-4f64-bd68-983c96abc254 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:05:21.240587 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-da4e9676-620d-4213-a3c3-71a160490a88 req-064aac60-91e0-4f64-bd68-983c96abc254 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:05:21.252769 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-da4e9676-620d-4213-a3c3-71a160490a88 req-064aac60-91e0-4f64-bd68-983c96abc254 service nova] Creating event network-changed:7ee0cbc4-d6f4-492c-9756-344dfb97d512 for instance 908a0170-e519-456d-ae93-20f21ed5bf38 on nch2-master-1 Jul 23 22:05:21.257807 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-da4e9676-620d-4213-a3c3-71a160490a88 req-064aac60-91e0-4f64-bd68-983c96abc254 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033053 Jul 23 22:05:21.258442 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3192/5802] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:05:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:05:43.545077 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=4 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:05:43.545890 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=62 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:05:43.550043 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5df5ba83-f125-4020-a7e0-750872e534ff tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:05:43.551067 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5df5ba83-f125-4020-a7e0-750872e534ff tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] [instance: 908a0170-e519-456d-ae93-20f21ed5bf38] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:05:43.558284 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5df5ba83-f125-4020-a7e0-750872e534ff tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:05:43.558730 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5df5ba83-f125-4020-a7e0-750872e534ff tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:05:43.559492 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5df5ba83-f125-4020-a7e0-750872e534ff tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:05:43.559929 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5df5ba83-f125-4020-a7e0-750872e534ff tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:05:43.616856 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5df5ba83-f125-4020-a7e0-750872e534ff tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] 10.222.0.17 "POST /compute/v2.1/servers/908a0170-e519-456d-ae93-20f21ed5bf38/action" status: 200 len: 24567 microversion: 2.1 time: 0.073773 Jul 23 22:05:43.617494 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3193/5803] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 22:05:43 2022] POST /compute/v2.1/servers/908a0170-e519-456d-ae93-20f21ed5bf38/action => generated 24567 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 23 22:05:58.124543 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-15721658-ee73-43ae-b0c3-d159f027de1e tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Action: 'create', calling method: .version_select at 0x7f0b4658af70>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-123280309", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEIFTTTRCcFWsFhd5piPqSNEorq99/uVy2EYBQ904LIcX1MALafe7sCUZZ3o+rUJQTvyPMrEHK1UJT5kAlqR/csRz2Df/hCjyeiUNY6hXXfT/UHGaWpBfcwSzggp5sJbaA=="}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:05:58.126605 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:05:58.128047 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=4 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:05:58.139431 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-15721658-ee73-43ae-b0c3-d159f027de1e tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Getting quotas for project 1d1919be84b04d4c9306ef33015632a0. Resources: {'key_pairs'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 22:05:58.145642 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-15721658-ee73-43ae-b0c3-d159f027de1e tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Getting quotas for user 5ce861b0f93142849eb235b3df8b9aa0 and project 1d1919be84b04d4c9306ef33015632a0. Resources: {'key_pairs'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 22:05:58.174337 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-15721658-ee73-43ae-b0c3-d159f027de1e tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.059882 Jul 23 22:05:58.175234 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3194/5804] 10.222.0.17 () {60 vars in 1158 bytes} [Sat Jul 23 22:05:58 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 22:05:59.222300 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-99bb947b-c14b-45b4-b2a7-8c183d27f992 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-2035207634", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "networks": [{"uuid": "43da88a2-145f-4221-af24-aeaaa90210a5"}], "key_name": "tempest-TestNetworkBasicOps-123280309", "security_groups": [{"name": "tempest-secgroup-smoke-1766296816"}]}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:05:59.326472 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-99bb947b-c14b-45b4-b2a7-8c183d27f992 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] validate_networks() for [('43da88a2-145f-4221-af24-aeaaa90210a5', None, None, None, None, None)] {{(pid=131320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 22:05:59.748743 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-99bb947b-c14b-45b4-b2a7-8c183d27f992 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 22:05:59.749026 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-99bb947b-c14b-45b4-b2a7-8c183d27f992 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 22:05:59.749556 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-99bb947b-c14b-45b4-b2a7-8c183d27f992 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 22:05:59.750065 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-99bb947b-c14b-45b4-b2a7-8c183d27f992 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 22:05:59.750743 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-99bb947b-c14b-45b4-b2a7-8c183d27f992 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 22:05:59.762028 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-99bb947b-c14b-45b4-b2a7-8c183d27f992 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:05:59.762557 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-99bb947b-c14b-45b4-b2a7-8c183d27f992 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:05:59.763423 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-99bb947b-c14b-45b4-b2a7-8c183d27f992 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:05:59.764001 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-99bb947b-c14b-45b4-b2a7-8c183d27f992 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:05:59.787184 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-99bb947b-c14b-45b4-b2a7-8c183d27f992 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Getting quotas for project 1d1919be84b04d4c9306ef33015632a0. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 22:05:59.793074 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-99bb947b-c14b-45b4-b2a7-8c183d27f992 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Getting quotas for user 5ce861b0f93142849eb235b3df8b9aa0 and project 1d1919be84b04d4c9306ef33015632a0. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 22:05:59.806278 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-99bb947b-c14b-45b4-b2a7-8c183d27f992 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Going to run 1 instances... {{(pid=131320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 22:05:59.808725 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-99bb947b-c14b-45b4-b2a7-8c183d27f992 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] [instance: 83f2ee9b-0e5d-460e-8b40-562e6c4c3752] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 22:05:59.864278 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-99bb947b-c14b-45b4-b2a7-8c183d27f992 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.646837 Jul 23 22:05:59.864947 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3195/5805] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 22:05:59 2022] POST /compute/v2.1/servers => generated 406 bytes in 648 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 23 22:05:59.874844 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6fe97ff4-c896-477c-8a8a-a11d97d44014 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:05:59.875920 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6fe97ff4-c896-477c-8a8a-a11d97d44014 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] [instance: 83f2ee9b-0e5d-460e-8b40-562e6c4c3752] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:05:59.945543 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6fe97ff4-c896-477c-8a8a-a11d97d44014 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce861b0f93142849eb235b3df8b9aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1919be84b04d4c9306ef33015632a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:05:59.953166 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6fe97ff4-c896-477c-8a8a-a11d97d44014 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] 10.222.0.17 "GET /compute/v2.1/servers/83f2ee9b-0e5d-460e-8b40-562e6c4c3752" status: 200 len: 1248 microversion: 2.1 time: 0.081926 Jul 23 22:05:59.953624 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3196/5806] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:05:59 2022] GET /compute/v2.1/servers/83f2ee9b-0e5d-460e-8b40-562e6c4c3752 => generated 1248 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:06:00.971250 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9119904d-85ac-4d11-9309-9fe2a0e70db3 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:06:00.971937 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-9119904d-85ac-4d11-9309-9fe2a0e70db3 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] [instance: 83f2ee9b-0e5d-460e-8b40-562e6c4c3752] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:06:00.980150 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9119904d-85ac-4d11-9309-9fe2a0e70db3 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:06:00.980898 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9119904d-85ac-4d11-9309-9fe2a0e70db3 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:06:00.981704 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9119904d-85ac-4d11-9309-9fe2a0e70db3 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:06:00.982358 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9119904d-85ac-4d11-9309-9fe2a0e70db3 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:06:01.050905 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-9119904d-85ac-4d11-9309-9fe2a0e70db3 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce861b0f93142849eb235b3df8b9aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1919be84b04d4c9306ef33015632a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:06:01.059091 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9119904d-85ac-4d11-9309-9fe2a0e70db3 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] 10.222.0.17 "GET /compute/v2.1/servers/83f2ee9b-0e5d-460e-8b40-562e6c4c3752" status: 200 len: 1318 microversion: 2.1 time: 0.092223 Jul 23 22:06:01.059683 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3197/5807] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:06:00 2022] GET /compute/v2.1/servers/83f2ee9b-0e5d-460e-8b40-562e6c4c3752 => generated 1318 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:06:02.076826 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f994d282-f6d8-48cd-8af1-3bdf69d9c10e tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:06:02.077461 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f994d282-f6d8-48cd-8af1-3bdf69d9c10e tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] [instance: 83f2ee9b-0e5d-460e-8b40-562e6c4c3752] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:06:02.085241 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f994d282-f6d8-48cd-8af1-3bdf69d9c10e tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:06:02.085691 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f994d282-f6d8-48cd-8af1-3bdf69d9c10e tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:06:02.087067 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f994d282-f6d8-48cd-8af1-3bdf69d9c10e tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:06:02.087736 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f994d282-f6d8-48cd-8af1-3bdf69d9c10e tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:06:02.225438 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f994d282-f6d8-48cd-8af1-3bdf69d9c10e tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce861b0f93142849eb235b3df8b9aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1919be84b04d4c9306ef33015632a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:06:02.233432 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f994d282-f6d8-48cd-8af1-3bdf69d9c10e tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] 10.222.0.17 "GET /compute/v2.1/servers/83f2ee9b-0e5d-460e-8b40-562e6c4c3752" status: 200 len: 1374 microversion: 2.1 time: 0.160763 Jul 23 22:06:02.234040 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3198/5808] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:06:02 2022] GET /compute/v2.1/servers/83f2ee9b-0e5d-460e-8b40-562e6c4c3752 => generated 1374 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:06:02.868753 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-793f49cd-6053-4cfa-8254-bd3802909adc req-b7803863-7055-40fd-b67a-c2fdc64dfa0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83f2ee9b-0e5d-460e-8b40-562e6c4c3752", "tag": "dd1ebe9a-41c8-43db-b22a-630187be1494"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:06:02.877350 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-793f49cd-6053-4cfa-8254-bd3802909adc req-b7803863-7055-40fd-b67a-c2fdc64dfa0d service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:06:02.877802 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-793f49cd-6053-4cfa-8254-bd3802909adc req-b7803863-7055-40fd-b67a-c2fdc64dfa0d service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:06:02.889620 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-793f49cd-6053-4cfa-8254-bd3802909adc req-b7803863-7055-40fd-b67a-c2fdc64dfa0d service nova] Creating event network-changed:dd1ebe9a-41c8-43db-b22a-630187be1494 for instance 83f2ee9b-0e5d-460e-8b40-562e6c4c3752 on nch1-master-1 Jul 23 22:06:02.895166 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-793f49cd-6053-4cfa-8254-bd3802909adc req-b7803863-7055-40fd-b67a-c2fdc64dfa0d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.192796 Jul 23 22:06:02.896146 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3199/5809] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:06:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:06:03.251660 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d27ade7f-2c8c-4122-9832-e6c8149c3c3d tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:06:03.252314 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d27ade7f-2c8c-4122-9832-e6c8149c3c3d tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] [instance: 83f2ee9b-0e5d-460e-8b40-562e6c4c3752] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:06:03.259684 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d27ade7f-2c8c-4122-9832-e6c8149c3c3d tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:06:03.260137 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d27ade7f-2c8c-4122-9832-e6c8149c3c3d tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:06:03.260881 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d27ade7f-2c8c-4122-9832-e6c8149c3c3d tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:06:03.261338 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d27ade7f-2c8c-4122-9832-e6c8149c3c3d tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:06:03.409540 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d27ade7f-2c8c-4122-9832-e6c8149c3c3d tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce861b0f93142849eb235b3df8b9aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1919be84b04d4c9306ef33015632a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:06:03.417411 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d27ade7f-2c8c-4122-9832-e6c8149c3c3d tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] 10.222.0.17 "GET /compute/v2.1/servers/83f2ee9b-0e5d-460e-8b40-562e6c4c3752" status: 200 len: 1374 microversion: 2.1 time: 0.170221 Jul 23 22:06:03.418046 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3200/5810] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:06:03 2022] GET /compute/v2.1/servers/83f2ee9b-0e5d-460e-8b40-562e6c4c3752 => generated 1374 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:06:04.434866 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-50909b00-8ec2-462c-8988-a1574aa90940 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:06:04.435563 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-50909b00-8ec2-462c-8988-a1574aa90940 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] [instance: 83f2ee9b-0e5d-460e-8b40-562e6c4c3752] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:06:04.442980 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-50909b00-8ec2-462c-8988-a1574aa90940 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:06:04.443435 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-50909b00-8ec2-462c-8988-a1574aa90940 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:06:04.444166 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-50909b00-8ec2-462c-8988-a1574aa90940 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:06:04.444634 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-50909b00-8ec2-462c-8988-a1574aa90940 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:06:04.575336 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-50909b00-8ec2-462c-8988-a1574aa90940 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce861b0f93142849eb235b3df8b9aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1919be84b04d4c9306ef33015632a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:06:04.583596 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-50909b00-8ec2-462c-8988-a1574aa90940 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] 10.222.0.17 "GET /compute/v2.1/servers/83f2ee9b-0e5d-460e-8b40-562e6c4c3752" status: 200 len: 1374 microversion: 2.1 time: 0.152746 Jul 23 22:06:04.584258 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3201/5811] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:06:04 2022] GET /compute/v2.1/servers/83f2ee9b-0e5d-460e-8b40-562e6c4c3752 => generated 1374 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:06:05.604869 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3af66b0a-5d10-4264-ab3a-fc6fb8b0e436 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:06:05.606010 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-3af66b0a-5d10-4264-ab3a-fc6fb8b0e436 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] [instance: 83f2ee9b-0e5d-460e-8b40-562e6c4c3752] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:06:05.617748 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3af66b0a-5d10-4264-ab3a-fc6fb8b0e436 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:06:05.618593 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3af66b0a-5d10-4264-ab3a-fc6fb8b0e436 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:06:05.619863 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3af66b0a-5d10-4264-ab3a-fc6fb8b0e436 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:06:05.620593 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3af66b0a-5d10-4264-ab3a-fc6fb8b0e436 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:06:05.836326 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-3af66b0a-5d10-4264-ab3a-fc6fb8b0e436 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce861b0f93142849eb235b3df8b9aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1919be84b04d4c9306ef33015632a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:06:05.844745 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-3af66b0a-5d10-4264-ab3a-fc6fb8b0e436 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] 10.222.0.17 "GET /compute/v2.1/servers/83f2ee9b-0e5d-460e-8b40-562e6c4c3752" status: 200 len: 1374 microversion: 2.1 time: 0.246485 Jul 23 22:06:05.845340 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3202/5812] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:06:05 2022] GET /compute/v2.1/servers/83f2ee9b-0e5d-460e-8b40-562e6c4c3752 => generated 1374 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:06:06.862228 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c0a9409a-f253-4b8c-9921-02c5182533d3 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:06:06.862904 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c0a9409a-f253-4b8c-9921-02c5182533d3 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] [instance: 83f2ee9b-0e5d-460e-8b40-562e6c4c3752] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:06:06.870001 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c0a9409a-f253-4b8c-9921-02c5182533d3 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:06:06.870458 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c0a9409a-f253-4b8c-9921-02c5182533d3 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:06:06.871235 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c0a9409a-f253-4b8c-9921-02c5182533d3 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:06:06.871682 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c0a9409a-f253-4b8c-9921-02c5182533d3 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:06:07.006893 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c0a9409a-f253-4b8c-9921-02c5182533d3 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce861b0f93142849eb235b3df8b9aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1919be84b04d4c9306ef33015632a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:06:07.015569 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c0a9409a-f253-4b8c-9921-02c5182533d3 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] 10.222.0.17 "GET /compute/v2.1/servers/83f2ee9b-0e5d-460e-8b40-562e6c4c3752" status: 200 len: 1374 microversion: 2.1 time: 0.157528 Jul 23 22:06:07.016182 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3203/5813] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:06:06 2022] GET /compute/v2.1/servers/83f2ee9b-0e5d-460e-8b40-562e6c4c3752 => generated 1374 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:06:08.033807 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-677f48ec-cf79-483f-90b7-f1632abe7dc7 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:06:08.034658 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-677f48ec-cf79-483f-90b7-f1632abe7dc7 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] [instance: 83f2ee9b-0e5d-460e-8b40-562e6c4c3752] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:06:08.043221 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-677f48ec-cf79-483f-90b7-f1632abe7dc7 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:06:08.043756 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-677f48ec-cf79-483f-90b7-f1632abe7dc7 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:06:08.044657 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-677f48ec-cf79-483f-90b7-f1632abe7dc7 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:06:08.045135 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-677f48ec-cf79-483f-90b7-f1632abe7dc7 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:06:08.186928 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-677f48ec-cf79-483f-90b7-f1632abe7dc7 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce861b0f93142849eb235b3df8b9aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1919be84b04d4c9306ef33015632a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:06:08.194756 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-677f48ec-cf79-483f-90b7-f1632abe7dc7 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] 10.222.0.17 "GET /compute/v2.1/servers/83f2ee9b-0e5d-460e-8b40-562e6c4c3752" status: 200 len: 1374 microversion: 2.1 time: 0.165567 Jul 23 22:06:08.195376 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3204/5814] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:06:08 2022] GET /compute/v2.1/servers/83f2ee9b-0e5d-460e-8b40-562e6c4c3752 => generated 1374 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:06:08.415491 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-5f2fc1df-5c87-4cdf-aa0c-34568a3f0fb3 req-9d92fa77-9d44-40f5-846a-87ecb8d46eff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83f2ee9b-0e5d-460e-8b40-562e6c4c3752", "name": "network-vif-plugged", "status": "completed", "tag": "dd1ebe9a-41c8-43db-b22a-630187be1494"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:06:08.424334 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-5f2fc1df-5c87-4cdf-aa0c-34568a3f0fb3 req-9d92fa77-9d44-40f5-846a-87ecb8d46eff service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:06:08.424885 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-5f2fc1df-5c87-4cdf-aa0c-34568a3f0fb3 req-9d92fa77-9d44-40f5-846a-87ecb8d46eff service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:06:08.437284 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-5f2fc1df-5c87-4cdf-aa0c-34568a3f0fb3 req-9d92fa77-9d44-40f5-846a-87ecb8d46eff service nova] Creating event network-vif-plugged:dd1ebe9a-41c8-43db-b22a-630187be1494 for instance 83f2ee9b-0e5d-460e-8b40-562e6c4c3752 on nch1-master-1 Jul 23 22:06:08.442620 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-5f2fc1df-5c87-4cdf-aa0c-34568a3f0fb3 req-9d92fa77-9d44-40f5-846a-87ecb8d46eff service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031431 Jul 23 22:06:08.443225 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3205/5815] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:06:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:06:09.218220 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2b0ee4e7-8e71-465b-98d4-59868089f71b tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:06:09.219287 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-2b0ee4e7-8e71-465b-98d4-59868089f71b tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] [instance: 83f2ee9b-0e5d-460e-8b40-562e6c4c3752] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:06:09.226669 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2b0ee4e7-8e71-465b-98d4-59868089f71b tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:06:09.227116 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2b0ee4e7-8e71-465b-98d4-59868089f71b tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:06:09.227880 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2b0ee4e7-8e71-465b-98d4-59868089f71b tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:06:09.228317 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2b0ee4e7-8e71-465b-98d4-59868089f71b tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:06:09.371252 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-2b0ee4e7-8e71-465b-98d4-59868089f71b tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce861b0f93142849eb235b3df8b9aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1919be84b04d4c9306ef33015632a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:06:09.379269 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2b0ee4e7-8e71-465b-98d4-59868089f71b tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] 10.222.0.17 "GET /compute/v2.1/servers/83f2ee9b-0e5d-460e-8b40-562e6c4c3752" status: 200 len: 1374 microversion: 2.1 time: 0.170010 Jul 23 22:06:09.379853 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3206/5816] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:06:09 2022] GET /compute/v2.1/servers/83f2ee9b-0e5d-460e-8b40-562e6c4c3752 => generated 1374 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:06:10.400499 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2c18826a-fa99-439c-a6a9-e799b0da1ded tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:06:10.401494 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-2c18826a-fa99-439c-a6a9-e799b0da1ded tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] [instance: 83f2ee9b-0e5d-460e-8b40-562e6c4c3752] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:06:10.404592 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:06:10.405710 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=12 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:06:10.416816 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2c18826a-fa99-439c-a6a9-e799b0da1ded tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:06:10.417684 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2c18826a-fa99-439c-a6a9-e799b0da1ded tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:06:10.419015 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2c18826a-fa99-439c-a6a9-e799b0da1ded tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:06:10.419756 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2c18826a-fa99-439c-a6a9-e799b0da1ded tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:06:10.561903 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-2c18826a-fa99-439c-a6a9-e799b0da1ded tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce861b0f93142849eb235b3df8b9aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1919be84b04d4c9306ef33015632a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:06:10.570691 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2c18826a-fa99-439c-a6a9-e799b0da1ded tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] 10.222.0.17 "GET /compute/v2.1/servers/83f2ee9b-0e5d-460e-8b40-562e6c4c3752" status: 200 len: 1547 microversion: 2.1 time: 0.176766 Jul 23 22:06:10.571281 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3207/5817] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:06:10 2022] GET /compute/v2.1/servers/83f2ee9b-0e5d-460e-8b40-562e6c4c3752 => generated 1547 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:06:10.587020 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4dbeaa0a-6f5e-48fe-ad97-de5735194e0e tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:06:10.587630 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-4dbeaa0a-6f5e-48fe-ad97-de5735194e0e tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] [instance: 83f2ee9b-0e5d-460e-8b40-562e6c4c3752] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:06:10.594113 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4dbeaa0a-6f5e-48fe-ad97-de5735194e0e tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:06:10.594573 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4dbeaa0a-6f5e-48fe-ad97-de5735194e0e tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:06:10.595407 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4dbeaa0a-6f5e-48fe-ad97-de5735194e0e tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:06:10.595852 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4dbeaa0a-6f5e-48fe-ad97-de5735194e0e tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:06:10.731178 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-4dbeaa0a-6f5e-48fe-ad97-de5735194e0e tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce861b0f93142849eb235b3df8b9aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1919be84b04d4c9306ef33015632a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:06:10.742628 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4dbeaa0a-6f5e-48fe-ad97-de5735194e0e tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] 10.222.0.17 "GET /compute/v2.1/servers/83f2ee9b-0e5d-460e-8b40-562e6c4c3752" status: 200 len: 1547 microversion: 2.1 time: 0.158804 Jul 23 22:06:10.743346 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3208/5818] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:06:10 2022] GET /compute/v2.1/servers/83f2ee9b-0e5d-460e-8b40-562e6c4c3752 => generated 1547 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:06:36.313022 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1858e842-4a7e-43a5-8b14-d7b753beb26e tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:06:36.313622 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1858e842-4a7e-43a5-8b14-d7b753beb26e tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] [instance: 83f2ee9b-0e5d-460e-8b40-562e6c4c3752] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:06:36.317595 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=4 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:06:36.318268 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=66 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:06:36.322078 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1858e842-4a7e-43a5-8b14-d7b753beb26e tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:06:36.322524 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1858e842-4a7e-43a5-8b14-d7b753beb26e tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:06:36.323394 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1858e842-4a7e-43a5-8b14-d7b753beb26e tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:06:36.323711 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1858e842-4a7e-43a5-8b14-d7b753beb26e tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:06:36.350967 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1858e842-4a7e-43a5-8b14-d7b753beb26e tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] [instance: 83f2ee9b-0e5d-460e-8b40-562e6c4c3752] Going to try to terminate instance {{(pid=131320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 22:06:36.429849 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1858e842-4a7e-43a5-8b14-d7b753beb26e tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] 10.222.0.17 "DELETE /compute/v2.1/servers/83f2ee9b-0e5d-460e-8b40-562e6c4c3752" status: 204 len: 0 microversion: 2.1 time: 0.120436 Jul 23 22:06:36.431005 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3209/5819] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 22:06:36 2022] DELETE /compute/v2.1/servers/83f2ee9b-0e5d-460e-8b40-562e6c4c3752 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 22:06:36.439269 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b955cd2a-0b6c-4ed7-a89d-fdb73f8b671f tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:06:36.439952 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b955cd2a-0b6c-4ed7-a89d-fdb73f8b671f tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] [instance: 83f2ee9b-0e5d-460e-8b40-562e6c4c3752] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:06:36.446135 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b955cd2a-0b6c-4ed7-a89d-fdb73f8b671f tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:06:36.446596 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b955cd2a-0b6c-4ed7-a89d-fdb73f8b671f tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:06:36.447385 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b955cd2a-0b6c-4ed7-a89d-fdb73f8b671f tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:06:36.447832 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b955cd2a-0b6c-4ed7-a89d-fdb73f8b671f tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:06:36.583507 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b955cd2a-0b6c-4ed7-a89d-fdb73f8b671f tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce861b0f93142849eb235b3df8b9aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1919be84b04d4c9306ef33015632a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:06:36.591163 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b955cd2a-0b6c-4ed7-a89d-fdb73f8b671f tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] 10.222.0.17 "GET /compute/v2.1/servers/83f2ee9b-0e5d-460e-8b40-562e6c4c3752" status: 200 len: 1553 microversion: 2.1 time: 0.156043 Jul 23 22:06:36.591757 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3210/5820] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:06:36 2022] GET /compute/v2.1/servers/83f2ee9b-0e5d-460e-8b40-562e6c4c3752 => generated 1553 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:06:37.610125 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-00237475-1522-464c-ae6b-6b62297e3e67 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:06:37.610792 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-00237475-1522-464c-ae6b-6b62297e3e67 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] [instance: 83f2ee9b-0e5d-460e-8b40-562e6c4c3752] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:06:37.618152 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-00237475-1522-464c-ae6b-6b62297e3e67 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:06:37.618617 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-00237475-1522-464c-ae6b-6b62297e3e67 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:06:37.619401 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-00237475-1522-464c-ae6b-6b62297e3e67 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:06:37.619845 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-00237475-1522-464c-ae6b-6b62297e3e67 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:06:37.766429 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-00237475-1522-464c-ae6b-6b62297e3e67 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce861b0f93142849eb235b3df8b9aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1919be84b04d4c9306ef33015632a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:06:37.774297 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-00237475-1522-464c-ae6b-6b62297e3e67 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] 10.222.0.17 "GET /compute/v2.1/servers/83f2ee9b-0e5d-460e-8b40-562e6c4c3752" status: 200 len: 1553 microversion: 2.1 time: 0.169519 Jul 23 22:06:37.774874 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3211/5821] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:06:37 2022] GET /compute/v2.1/servers/83f2ee9b-0e5d-460e-8b40-562e6c4c3752 => generated 1553 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:06:38.392263 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-fe5e57b3-a3ee-434b-b3c5-71d1a082bd37 req-849f0d82-216a-49bd-b67b-8abb23598a39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83f2ee9b-0e5d-460e-8b40-562e6c4c3752", "name": "network-vif-deleted", "tag": "dd1ebe9a-41c8-43db-b22a-630187be1494"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:06:38.400734 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-fe5e57b3-a3ee-434b-b3c5-71d1a082bd37 req-849f0d82-216a-49bd-b67b-8abb23598a39 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:06:38.401182 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-fe5e57b3-a3ee-434b-b3c5-71d1a082bd37 req-849f0d82-216a-49bd-b67b-8abb23598a39 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:06:38.412657 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-fe5e57b3-a3ee-434b-b3c5-71d1a082bd37 req-849f0d82-216a-49bd-b67b-8abb23598a39 service nova] Creating event network-vif-deleted:dd1ebe9a-41c8-43db-b22a-630187be1494 for instance 83f2ee9b-0e5d-460e-8b40-562e6c4c3752 on nch1-master-1 Jul 23 22:06:38.417732 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-fe5e57b3-a3ee-434b-b3c5-71d1a082bd37 req-849f0d82-216a-49bd-b67b-8abb23598a39 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029277 Jul 23 22:06:38.418454 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3212/5822] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:06:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:06:38.793291 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0eaba906-8937-44a1-870e-27c5b6514a0b tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:06:38.794001 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-0eaba906-8937-44a1-870e-27c5b6514a0b tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] [instance: 83f2ee9b-0e5d-460e-8b40-562e6c4c3752] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:06:38.800852 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0eaba906-8937-44a1-870e-27c5b6514a0b tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:06:38.801303 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0eaba906-8937-44a1-870e-27c5b6514a0b tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:06:38.802105 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0eaba906-8937-44a1-870e-27c5b6514a0b tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:06:38.802689 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0eaba906-8937-44a1-870e-27c5b6514a0b tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:06:38.839337 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0eaba906-8937-44a1-870e-27c5b6514a0b tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:06:38.839796 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0eaba906-8937-44a1-870e-27c5b6514a0b tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:06:38.840256 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.objects.instance [None req-0eaba906-8937-44a1-870e-27c5b6514a0b tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lazy-loading 'fault' on Instance uuid 83f2ee9b-0e5d-460e-8b40-562e6c4c3752 {{(pid=131320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 22:06:38.884627 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-0eaba906-8937-44a1-870e-27c5b6514a0b tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce861b0f93142849eb235b3df8b9aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1919be84b04d4c9306ef33015632a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:06:38.892679 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-0eaba906-8937-44a1-870e-27c5b6514a0b tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] 10.222.0.17 "GET /compute/v2.1/servers/83f2ee9b-0e5d-460e-8b40-562e6c4c3752" status: 200 len: 1338 microversion: 2.1 time: 0.104576 Jul 23 22:06:38.893241 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3213/5823] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:06:38 2022] GET /compute/v2.1/servers/83f2ee9b-0e5d-460e-8b40-562e6c4c3752 => generated 1338 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:06:39.909959 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-faa70ce2-e287-4ca7-a5ea-eb0016029c7b tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:06:39.910610 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-faa70ce2-e287-4ca7-a5ea-eb0016029c7b tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] [instance: 83f2ee9b-0e5d-460e-8b40-562e6c4c3752] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:06:39.917821 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-faa70ce2-e287-4ca7-a5ea-eb0016029c7b tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:06:39.918309 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-faa70ce2-e287-4ca7-a5ea-eb0016029c7b tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:06:39.919151 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-faa70ce2-e287-4ca7-a5ea-eb0016029c7b tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:06:39.919507 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-faa70ce2-e287-4ca7-a5ea-eb0016029c7b tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:06:39.935181 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-faa70ce2-e287-4ca7-a5ea-eb0016029c7b tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] HTTP exception thrown: Instance 83f2ee9b-0e5d-460e-8b40-562e6c4c3752 could not be found. Jul 23 22:06:39.936812 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-faa70ce2-e287-4ca7-a5ea-eb0016029c7b tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Request method failure captured: Jul 23 22:06:39.936812 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/83f2ee9b-0e5d-460e-8b40-562e6c4c3752 HTTP/1.1 Jul 23 22:06:39.936812 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 22:06:39.936812 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 22:06:39.936812 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 22:06:39.936812 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 22:06:39.936812 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 22:06:39.936812 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 22:06:39.936812 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 22:06:39.936812 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 22:06:39.936812 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3HCLa_eAqIicbWhTmt5RuUQv6IAUNPtVTnhsGYb2H_sE7PnvLf6hS2arO_CWKFMbiGvcAUdmd0CHAVSP2nwpHctzO9WV0OKQtnB9ui2MaNRFUm44JM3azQepQCUcYDOKmiQiDyUGH0VinwO0YO203J7uz-yZ8rbcAZZrniT5f40hkQY Jul 23 22:06:39.936812 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 22:06:39.936812 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 22:06:39.936812 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 22:06:39.936812 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 22:06:39.936812 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 22:06:39.936812 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 22:06:39.936812 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 1d1919be84b04d4c9306ef33015632a0 Jul 23 22:06:39.936812 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-TestNetworkBasicOps-579612114 Jul 23 22:06:39.936812 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 22:06:39.936812 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 22:06:39.936812 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1d1919be84b04d4c9306ef33015632a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1d1919be84b04d4c9306ef33015632a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1d1919be84b04d4c9306ef33015632a0", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1d1919be84b04d4c9306ef33015632a0"}]}] Jul 23 22:06:39.936812 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-TestNetworkBasicOps-579612114 Jul 23 22:06:39.936812 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 1d1919be84b04d4c9306ef33015632a0 Jul 23 22:06:39.936812 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-TestNetworkBasicOps-579612114 Jul 23 22:06:39.936812 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-TestNetworkBasicOps-579612114-project Jul 23 22:06:39.936812 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 22:06:39.936812 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 22:06:39.936812 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 5ce861b0f93142849eb235b3df8b9aa0 Jul 23 22:06:39.936812 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-TestNetworkBasicOps-579612114-project Jul 23 22:06:39.936812 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 22:06:39.936812 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance 83f2ee9b-0e5d-460e-8b40-562e6c4c3752 could not be found. Jul 23 22:06:39.936812 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '83f2ee9b-0e5d-460e-8b40-562e6c4c3752'} Jul 23 22:06:39.936812 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 22:06:39.936812 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:06:39.936812 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 22:06:39.936812 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 22:06:39.936812 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 22:06:39.936812 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 22:06:39.936812 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 22:06:39.936812 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 22:06:39.936812 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 22:06:39.936812 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 22:06:39.936812 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83f2ee9b-0e5d-460e-8b40-562e6c4c3752 could not be found. Jul 23 22:06:39.936812 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:06:39.936812 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:06:39.936812 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:06:39.936812 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:06:39.936812 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:06:39.936812 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:06:39.936812 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 22:06:39.936812 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 22:06:39.936812 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 22:06:39.936812 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 22:06:39.936812 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 22:06:39.936812 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 22:06:39.936812 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 22:06:39.936812 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 22:06:39.936812 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 22:06:39.936812 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 22:06:39.936812 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83f2ee9b-0e5d-460e-8b40-562e6c4c3752 could not be found. Jul 23 22:06:39.936812 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:06:39.936812 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:06:39.936812 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:06:39.942578 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:06:39.942578 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:06:39.942578 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:06:39.942578 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 22:06:39.942578 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 22:06:39.942578 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83f2ee9b-0e5d-460e-8b40-562e6c4c3752 could not be found. Jul 23 22:06:39.942578 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:06:39.942578 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-faa70ce2-e287-4ca7-a5ea-eb0016029c7b tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Returning 404 to user: Instance 83f2ee9b-0e5d-460e-8b40-562e6c4c3752 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 22:06:39.942578 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-faa70ce2-e287-4ca7-a5ea-eb0016029c7b tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] 10.222.0.17 "GET /compute/v2.1/servers/83f2ee9b-0e5d-460e-8b40-562e6c4c3752" status: 404 len: 111 microversion: 2.1 time: 0.032300 Jul 23 22:06:39.942578 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3214/5824] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:06:39 2022] GET /compute/v2.1/servers/83f2ee9b-0e5d-460e-8b40-562e6c4c3752 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 22:06:40.104640 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-95dfadef-f1a2-4449-af69-c15f9a9fd600 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Calling method '.version_select at 0x7f0b599cfe50>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:06:40.125523 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-95dfadef-f1a2-4449-af69-c15f9a9fd600 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-123280309" status: 202 len: 0 microversion: 2.1 time: 0.024796 Jul 23 22:06:40.126385 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3215/5825] 10.222.0.17 () {58 vars in 1253 bytes} [Sat Jul 23 22:06:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-123280309 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 23 22:06:42.142034 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ff65f3eb-2ccf-4f0a-8a92-528be4d82fc4 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:06:42.142670 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ff65f3eb-2ccf-4f0a-8a92-528be4d82fc4 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] [instance: 908a0170-e519-456d-ae93-20f21ed5bf38] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:06:42.150737 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ff65f3eb-2ccf-4f0a-8a92-528be4d82fc4 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:06:42.151199 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ff65f3eb-2ccf-4f0a-8a92-528be4d82fc4 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:06:42.151991 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ff65f3eb-2ccf-4f0a-8a92-528be4d82fc4 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:06:42.152435 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ff65f3eb-2ccf-4f0a-8a92-528be4d82fc4 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:06:42.177510 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ff65f3eb-2ccf-4f0a-8a92-528be4d82fc4 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] [instance: 908a0170-e519-456d-ae93-20f21ed5bf38] Going to try to terminate instance {{(pid=131320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 22:06:42.261349 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ff65f3eb-2ccf-4f0a-8a92-528be4d82fc4 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] 10.222.0.17 "DELETE /compute/v2.1/servers/908a0170-e519-456d-ae93-20f21ed5bf38" status: 204 len: 0 microversion: 2.1 time: 0.122840 Jul 23 22:06:42.262492 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3216/5826] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 22:06:42 2022] DELETE /compute/v2.1/servers/908a0170-e519-456d-ae93-20f21ed5bf38 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 22:06:42.268420 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-926dce98-c8a0-4beb-ba0d-2ceae981f22d req-43c76005-19d4-468f-9249-4979055786c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "908a0170-e519-456d-ae93-20f21ed5bf38", "tag": "7ee0cbc4-d6f4-492c-9756-344dfb97d512"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:06:42.277420 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-926dce98-c8a0-4beb-ba0d-2ceae981f22d req-43c76005-19d4-468f-9249-4979055786c6 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:06:42.277949 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-926dce98-c8a0-4beb-ba0d-2ceae981f22d req-43c76005-19d4-468f-9249-4979055786c6 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:06:42.289620 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-926dce98-c8a0-4beb-ba0d-2ceae981f22d req-43c76005-19d4-468f-9249-4979055786c6 service nova] Creating event network-changed:7ee0cbc4-d6f4-492c-9756-344dfb97d512 for instance 908a0170-e519-456d-ae93-20f21ed5bf38 on nch2-master-1 Jul 23 22:06:42.294601 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-926dce98-c8a0-4beb-ba0d-2ceae981f22d req-43c76005-19d4-468f-9249-4979055786c6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030738 Jul 23 22:06:42.295201 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3217/5827] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:06:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:06:42.300146 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d76bae92-009e-4327-abf9-82644af15ba9 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:06:42.300852 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d76bae92-009e-4327-abf9-82644af15ba9 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] [instance: 908a0170-e519-456d-ae93-20f21ed5bf38] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:06:42.307277 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d76bae92-009e-4327-abf9-82644af15ba9 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:06:42.307723 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d76bae92-009e-4327-abf9-82644af15ba9 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:06:42.308484 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d76bae92-009e-4327-abf9-82644af15ba9 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:06:42.308916 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d76bae92-009e-4327-abf9-82644af15ba9 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:06:42.444259 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d76bae92-009e-4327-abf9-82644af15ba9 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce861b0f93142849eb235b3df8b9aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1919be84b04d4c9306ef33015632a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:06:42.451860 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d76bae92-009e-4327-abf9-82644af15ba9 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] 10.222.0.17 "GET /compute/v2.1/servers/908a0170-e519-456d-ae93-20f21ed5bf38" status: 200 len: 1671 microversion: 2.1 time: 0.155523 Jul 23 22:06:42.452476 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3218/5828] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:06:42 2022] GET /compute/v2.1/servers/908a0170-e519-456d-ae93-20f21ed5bf38 => generated 1671 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:06:43.469854 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-15f0a2bf-7b8e-47fe-a411-d9a3608a2e8f tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:06:43.470510 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-15f0a2bf-7b8e-47fe-a411-d9a3608a2e8f tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] [instance: 908a0170-e519-456d-ae93-20f21ed5bf38] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:06:43.478164 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-15f0a2bf-7b8e-47fe-a411-d9a3608a2e8f tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:06:43.478613 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-15f0a2bf-7b8e-47fe-a411-d9a3608a2e8f tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:06:43.479494 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-15f0a2bf-7b8e-47fe-a411-d9a3608a2e8f tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:06:43.479934 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-15f0a2bf-7b8e-47fe-a411-d9a3608a2e8f tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:06:43.723905 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-15f0a2bf-7b8e-47fe-a411-d9a3608a2e8f tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce861b0f93142849eb235b3df8b9aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1919be84b04d4c9306ef33015632a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:06:43.732528 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-15f0a2bf-7b8e-47fe-a411-d9a3608a2e8f tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] 10.222.0.17 "GET /compute/v2.1/servers/908a0170-e519-456d-ae93-20f21ed5bf38" status: 200 len: 1671 microversion: 2.1 time: 0.266700 Jul 23 22:06:43.733717 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3219/5829] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:06:43 2022] GET /compute/v2.1/servers/908a0170-e519-456d-ae93-20f21ed5bf38 => generated 1671 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:06:44.310027 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-8061fbe9-7fe8-4b0e-be07-c468c18ab08e req-6d5b781f-bade-4322-a3cd-2f2085d84d29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "908a0170-e519-456d-ae93-20f21ed5bf38", "name": "network-vif-deleted", "tag": "7ee0cbc4-d6f4-492c-9756-344dfb97d512"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:06:44.318574 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-8061fbe9-7fe8-4b0e-be07-c468c18ab08e req-6d5b781f-bade-4322-a3cd-2f2085d84d29 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:06:44.318952 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-8061fbe9-7fe8-4b0e-be07-c468c18ab08e req-6d5b781f-bade-4322-a3cd-2f2085d84d29 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:06:44.330748 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-8061fbe9-7fe8-4b0e-be07-c468c18ab08e req-6d5b781f-bade-4322-a3cd-2f2085d84d29 service nova] Creating event network-vif-deleted:7ee0cbc4-d6f4-492c-9756-344dfb97d512 for instance 908a0170-e519-456d-ae93-20f21ed5bf38 on nch2-master-1 Jul 23 22:06:44.335688 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-8061fbe9-7fe8-4b0e-be07-c468c18ab08e req-6d5b781f-bade-4322-a3cd-2f2085d84d29 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029538 Jul 23 22:06:44.336287 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3220/5830] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:06:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 22:06:44.754538 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-72001ea1-9be8-438d-9d02-862153ec3f6a tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:06:44.755506 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-72001ea1-9be8-438d-9d02-862153ec3f6a tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] [instance: 908a0170-e519-456d-ae93-20f21ed5bf38] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:06:44.764212 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-72001ea1-9be8-438d-9d02-862153ec3f6a tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:06:44.764820 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-72001ea1-9be8-438d-9d02-862153ec3f6a tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:06:44.765847 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-72001ea1-9be8-438d-9d02-862153ec3f6a tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:06:44.766485 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-72001ea1-9be8-438d-9d02-862153ec3f6a tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:06:44.781734 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-72001ea1-9be8-438d-9d02-862153ec3f6a tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] HTTP exception thrown: Instance 908a0170-e519-456d-ae93-20f21ed5bf38 could not be found. Jul 23 22:06:44.783404 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-72001ea1-9be8-438d-9d02-862153ec3f6a tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Request method failure captured: Jul 23 22:06:44.783404 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/908a0170-e519-456d-ae93-20f21ed5bf38 HTTP/1.1 Jul 23 22:06:44.783404 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 22:06:44.783404 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 22:06:44.783404 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 22:06:44.783404 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 22:06:44.783404 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 22:06:44.783404 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 22:06:44.783404 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 22:06:44.783404 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 22:06:44.783404 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3HCLa_eAqIicbWhTmt5RuUQv6IAUNPtVTnhsGYb2H_sE7PnvLf6hS2arO_CWKFMbiGvcAUdmd0CHAVSP2nwpHctzO9WV0OKQtnB9ui2MaNRFUm44JM3azQepQCUcYDOKmiQiDyUGH0VinwO0YO203J7uz-yZ8rbcAZZrniT5f40hkQY Jul 23 22:06:44.783404 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 22:06:44.783404 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 22:06:44.783404 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 22:06:44.783404 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 22:06:44.783404 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 22:06:44.783404 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 22:06:44.783404 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 1d1919be84b04d4c9306ef33015632a0 Jul 23 22:06:44.783404 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-TestNetworkBasicOps-579612114 Jul 23 22:06:44.783404 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 22:06:44.783404 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 22:06:44.783404 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1d1919be84b04d4c9306ef33015632a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1d1919be84b04d4c9306ef33015632a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1d1919be84b04d4c9306ef33015632a0", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1d1919be84b04d4c9306ef33015632a0"}]}] Jul 23 22:06:44.783404 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-TestNetworkBasicOps-579612114 Jul 23 22:06:44.783404 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 1d1919be84b04d4c9306ef33015632a0 Jul 23 22:06:44.783404 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-TestNetworkBasicOps-579612114 Jul 23 22:06:44.783404 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-TestNetworkBasicOps-579612114-project Jul 23 22:06:44.783404 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 22:06:44.783404 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 22:06:44.783404 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 5ce861b0f93142849eb235b3df8b9aa0 Jul 23 22:06:44.783404 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-TestNetworkBasicOps-579612114-project Jul 23 22:06:44.783404 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 22:06:44.783404 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance 908a0170-e519-456d-ae93-20f21ed5bf38 could not be found. Jul 23 22:06:44.783404 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '908a0170-e519-456d-ae93-20f21ed5bf38'} Jul 23 22:06:44.783404 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 22:06:44.783404 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:06:44.783404 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 22:06:44.783404 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 22:06:44.783404 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 22:06:44.783404 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 22:06:44.783404 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 22:06:44.783404 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 22:06:44.783404 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 22:06:44.783404 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 22:06:44.783404 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 908a0170-e519-456d-ae93-20f21ed5bf38 could not be found. Jul 23 22:06:44.783404 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:06:44.783404 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:06:44.783404 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:06:44.783404 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:06:44.783404 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:06:44.783404 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:06:44.783404 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 22:06:44.783404 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 22:06:44.783404 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 22:06:44.783404 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 22:06:44.783404 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 22:06:44.783404 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 22:06:44.783404 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 22:06:44.783404 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 22:06:44.783404 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 22:06:44.783404 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 22:06:44.783404 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 908a0170-e519-456d-ae93-20f21ed5bf38 could not be found. Jul 23 22:06:44.783404 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:06:44.783404 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:06:44.783404 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:06:44.789022 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:06:44.789022 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:06:44.789022 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:06:44.789022 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 22:06:44.789022 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 22:06:44.789022 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 908a0170-e519-456d-ae93-20f21ed5bf38 could not be found. Jul 23 22:06:44.789022 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:06:44.789022 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-72001ea1-9be8-438d-9d02-862153ec3f6a tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Returning 404 to user: Instance 908a0170-e519-456d-ae93-20f21ed5bf38 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 22:06:44.789022 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-72001ea1-9be8-438d-9d02-862153ec3f6a tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] 10.222.0.17 "GET /compute/v2.1/servers/908a0170-e519-456d-ae93-20f21ed5bf38" status: 404 len: 111 microversion: 2.1 time: 0.037284 Jul 23 22:06:44.789022 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3221/5831] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:06:44 2022] GET /compute/v2.1/servers/908a0170-e519-456d-ae93-20f21ed5bf38 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 22:06:44.955880 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-09bf8792-3e30-4ec0-a8a7-909a95def2ef tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Calling method '.version_select at 0x7f0b54033670>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:06:44.981362 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-09bf8792-3e30-4ec0-a8a7-909a95def2ef tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1581527810" status: 202 len: 0 microversion: 2.1 time: 0.029496 Jul 23 22:06:44.982444 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3222/5832] 10.222.0.17 () {58 vars in 1256 bytes} [Sat Jul 23 22:06:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1581527810 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 22:06:53.091368 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e50ba73d-416c-4d42-9371-ad5f2fac1f25 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Action: 'create', calling method: .version_select at 0x7f0b464cc940>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-725834625", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKIoUr8l5a0l7WpJJQQdNv1OZJ0ViwBrsVyCGVpXSCjoLSWVpQ1hxAoyiMXfGkVMdzwhV1wT97Ei0RAz8cXhOSgD/Gz9WJIhuFDWPcDkkh5W1hAjxw1j6vlxTnuFkWE5Rg=="}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:06:53.110464 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-e50ba73d-416c-4d42-9371-ad5f2fac1f25 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Getting quotas for project 1d1919be84b04d4c9306ef33015632a0. Resources: {'key_pairs'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 22:06:53.116689 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-e50ba73d-416c-4d42-9371-ad5f2fac1f25 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Getting quotas for user 5ce861b0f93142849eb235b3df8b9aa0 and project 1d1919be84b04d4c9306ef33015632a0. Resources: {'key_pairs'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 22:06:53.148698 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e50ba73d-416c-4d42-9371-ad5f2fac1f25 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.061760 Jul 23 22:06:53.149605 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3223/5833] 10.222.0.17 () {60 vars in 1158 bytes} [Sat Jul 23 22:06:53 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:06:54.232486 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8c05e5cd-1424-46a7-aae2-c706d050b7bc tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-374375777", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "networks": [{"uuid": "ea2a375f-dee9-4ee5-8a62-7e5cbd566fea"}], "key_name": "tempest-TestNetworkBasicOps-725834625", "security_groups": [{"name": "tempest-secgroup-smoke-377047411"}]}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:06:54.348437 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-8c05e5cd-1424-46a7-aae2-c706d050b7bc tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] validate_networks() for [('ea2a375f-dee9-4ee5-8a62-7e5cbd566fea', None, None, None, None, None)] {{(pid=131320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 22:06:54.782222 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:06:54.817214 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-8c05e5cd-1424-46a7-aae2-c706d050b7bc tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 22:06:54.817679 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-8c05e5cd-1424-46a7-aae2-c706d050b7bc tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 22:06:54.818239 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-8c05e5cd-1424-46a7-aae2-c706d050b7bc tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 22:06:54.818811 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-8c05e5cd-1424-46a7-aae2-c706d050b7bc tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 22:06:54.819233 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-8c05e5cd-1424-46a7-aae2-c706d050b7bc tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 22:06:54.829172 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8c05e5cd-1424-46a7-aae2-c706d050b7bc tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:06:54.830113 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8c05e5cd-1424-46a7-aae2-c706d050b7bc tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:06:54.832258 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8c05e5cd-1424-46a7-aae2-c706d050b7bc tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:06:54.833469 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8c05e5cd-1424-46a7-aae2-c706d050b7bc tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:06:54.852737 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-8c05e5cd-1424-46a7-aae2-c706d050b7bc tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Getting quotas for project 1d1919be84b04d4c9306ef33015632a0. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 22:06:54.858267 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-8c05e5cd-1424-46a7-aae2-c706d050b7bc tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Getting quotas for user 5ce861b0f93142849eb235b3df8b9aa0 and project 1d1919be84b04d4c9306ef33015632a0. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 22:06:54.871549 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8c05e5cd-1424-46a7-aae2-c706d050b7bc tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Going to run 1 instances... {{(pid=131320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 22:06:54.874109 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8c05e5cd-1424-46a7-aae2-c706d050b7bc tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] [instance: 23fabf1c-dd79-4d5a-9e0a-9022f7ad5ea4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 22:06:54.922084 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8c05e5cd-1424-46a7-aae2-c706d050b7bc tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.693727 Jul 23 22:06:54.922736 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3224/5834] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 22:06:54 2022] POST /compute/v2.1/servers => generated 405 bytes in 695 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 23 22:06:54.933120 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-055090f6-e4ea-4cb9-9d03-641d38210372 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:06:54.933852 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-055090f6-e4ea-4cb9-9d03-641d38210372 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] [instance: 23fabf1c-dd79-4d5a-9e0a-9022f7ad5ea4] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:06:54.999089 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-055090f6-e4ea-4cb9-9d03-641d38210372 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce861b0f93142849eb235b3df8b9aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1919be84b04d4c9306ef33015632a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:06:55.006607 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-055090f6-e4ea-4cb9-9d03-641d38210372 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] 10.222.0.17 "GET /compute/v2.1/servers/23fabf1c-dd79-4d5a-9e0a-9022f7ad5ea4" status: 200 len: 1247 microversion: 2.1 time: 0.077583 Jul 23 22:06:55.007527 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3225/5835] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:06:54 2022] GET /compute/v2.1/servers/23fabf1c-dd79-4d5a-9e0a-9022f7ad5ea4 => generated 1247 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:06:56.024366 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e3b0b362-57ef-4a18-b285-89b9cd3809e6 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:06:56.025012 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e3b0b362-57ef-4a18-b285-89b9cd3809e6 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] [instance: 23fabf1c-dd79-4d5a-9e0a-9022f7ad5ea4] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:06:56.033103 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e3b0b362-57ef-4a18-b285-89b9cd3809e6 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:06:56.033574 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e3b0b362-57ef-4a18-b285-89b9cd3809e6 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:06:56.034577 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e3b0b362-57ef-4a18-b285-89b9cd3809e6 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:06:56.035013 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e3b0b362-57ef-4a18-b285-89b9cd3809e6 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:06:56.098255 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e3b0b362-57ef-4a18-b285-89b9cd3809e6 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce861b0f93142849eb235b3df8b9aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1919be84b04d4c9306ef33015632a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:06:56.105850 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e3b0b362-57ef-4a18-b285-89b9cd3809e6 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] 10.222.0.17 "GET /compute/v2.1/servers/23fabf1c-dd79-4d5a-9e0a-9022f7ad5ea4" status: 200 len: 1305 microversion: 2.1 time: 0.085833 Jul 23 22:06:56.106508 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3226/5836] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:06:56 2022] GET /compute/v2.1/servers/23fabf1c-dd79-4d5a-9e0a-9022f7ad5ea4 => generated 1305 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:06:57.123303 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1759d9c1-9a25-4045-8205-8a6e6ba2417a tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:06:57.124962 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1759d9c1-9a25-4045-8205-8a6e6ba2417a tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] [instance: 23fabf1c-dd79-4d5a-9e0a-9022f7ad5ea4] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:06:57.134518 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1759d9c1-9a25-4045-8205-8a6e6ba2417a tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:06:57.134977 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1759d9c1-9a25-4045-8205-8a6e6ba2417a tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:06:57.135926 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1759d9c1-9a25-4045-8205-8a6e6ba2417a tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:06:57.136374 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1759d9c1-9a25-4045-8205-8a6e6ba2417a tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:06:57.290344 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-1759d9c1-9a25-4045-8205-8a6e6ba2417a tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce861b0f93142849eb235b3df8b9aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1919be84b04d4c9306ef33015632a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:06:57.300496 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1759d9c1-9a25-4045-8205-8a6e6ba2417a tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] 10.222.0.17 "GET /compute/v2.1/servers/23fabf1c-dd79-4d5a-9e0a-9022f7ad5ea4" status: 200 len: 1372 microversion: 2.1 time: 0.181161 Jul 23 22:06:57.301106 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3227/5837] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:06:57 2022] GET /compute/v2.1/servers/23fabf1c-dd79-4d5a-9e0a-9022f7ad5ea4 => generated 1372 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:06:57.315651 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-f575f6b6-523e-4ba9-b0a7-b2b485e62825 req-3719feb1-a25e-4685-8084-29b879171180 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23fabf1c-dd79-4d5a-9e0a-9022f7ad5ea4", "tag": "126ea4fd-a303-42f1-a248-e84bc9c4c8e3"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:06:57.324051 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-f575f6b6-523e-4ba9-b0a7-b2b485e62825 req-3719feb1-a25e-4685-8084-29b879171180 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:06:57.324507 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-f575f6b6-523e-4ba9-b0a7-b2b485e62825 req-3719feb1-a25e-4685-8084-29b879171180 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:06:57.336106 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-f575f6b6-523e-4ba9-b0a7-b2b485e62825 req-3719feb1-a25e-4685-8084-29b879171180 service nova] Creating event network-changed:126ea4fd-a303-42f1-a248-e84bc9c4c8e3 for instance 23fabf1c-dd79-4d5a-9e0a-9022f7ad5ea4 on nch2-master-1 Jul 23 22:06:57.341665 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-f575f6b6-523e-4ba9-b0a7-b2b485e62825 req-3719feb1-a25e-4685-8084-29b879171180 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029882 Jul 23 22:06:57.342860 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3228/5838] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:06:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:06:58.323168 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-86b5e347-8e6a-439c-a1af-5cc2de48034b tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:06:58.324350 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-86b5e347-8e6a-439c-a1af-5cc2de48034b tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] [instance: 23fabf1c-dd79-4d5a-9e0a-9022f7ad5ea4] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:06:58.336238 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-86b5e347-8e6a-439c-a1af-5cc2de48034b tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:06:58.336409 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-86b5e347-8e6a-439c-a1af-5cc2de48034b tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:06:58.337215 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-86b5e347-8e6a-439c-a1af-5cc2de48034b tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:06:58.338041 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-86b5e347-8e6a-439c-a1af-5cc2de48034b tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:06:58.482607 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-86b5e347-8e6a-439c-a1af-5cc2de48034b tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce861b0f93142849eb235b3df8b9aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1919be84b04d4c9306ef33015632a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:06:58.491063 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-86b5e347-8e6a-439c-a1af-5cc2de48034b tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] 10.222.0.17 "GET /compute/v2.1/servers/23fabf1c-dd79-4d5a-9e0a-9022f7ad5ea4" status: 200 len: 1372 microversion: 2.1 time: 0.175195 Jul 23 22:06:58.491687 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3229/5839] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:06:58 2022] GET /compute/v2.1/servers/23fabf1c-dd79-4d5a-9e0a-9022f7ad5ea4 => generated 1372 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:06:59.512714 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2352ed23-db4f-4047-a082-bcdfb858f4f8 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:06:59.513818 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-2352ed23-db4f-4047-a082-bcdfb858f4f8 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] [instance: 23fabf1c-dd79-4d5a-9e0a-9022f7ad5ea4] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:06:59.525402 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2352ed23-db4f-4047-a082-bcdfb858f4f8 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:06:59.526206 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2352ed23-db4f-4047-a082-bcdfb858f4f8 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:06:59.527465 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2352ed23-db4f-4047-a082-bcdfb858f4f8 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:06:59.528203 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2352ed23-db4f-4047-a082-bcdfb858f4f8 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:06:59.665973 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-2352ed23-db4f-4047-a082-bcdfb858f4f8 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce861b0f93142849eb235b3df8b9aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1919be84b04d4c9306ef33015632a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:06:59.674923 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2352ed23-db4f-4047-a082-bcdfb858f4f8 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] 10.222.0.17 "GET /compute/v2.1/servers/23fabf1c-dd79-4d5a-9e0a-9022f7ad5ea4" status: 200 len: 1372 microversion: 2.1 time: 0.168969 Jul 23 22:06:59.675504 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3230/5840] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:06:59 2022] GET /compute/v2.1/servers/23fabf1c-dd79-4d5a-9e0a-9022f7ad5ea4 => generated 1372 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:07:00.695150 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4522baa1-5818-4aca-9b48-f324b816e064 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:07:00.695812 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-4522baa1-5818-4aca-9b48-f324b816e064 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] [instance: 23fabf1c-dd79-4d5a-9e0a-9022f7ad5ea4] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:07:00.703120 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4522baa1-5818-4aca-9b48-f324b816e064 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:07:00.703578 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4522baa1-5818-4aca-9b48-f324b816e064 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:07:00.704343 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4522baa1-5818-4aca-9b48-f324b816e064 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:07:00.704777 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4522baa1-5818-4aca-9b48-f324b816e064 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:07:00.838163 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-4522baa1-5818-4aca-9b48-f324b816e064 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce861b0f93142849eb235b3df8b9aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1919be84b04d4c9306ef33015632a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:07:00.845886 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4522baa1-5818-4aca-9b48-f324b816e064 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] 10.222.0.17 "GET /compute/v2.1/servers/23fabf1c-dd79-4d5a-9e0a-9022f7ad5ea4" status: 200 len: 1372 microversion: 2.1 time: 0.156746 Jul 23 22:07:00.846430 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3231/5841] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:07:00 2022] GET /compute/v2.1/servers/23fabf1c-dd79-4d5a-9e0a-9022f7ad5ea4 => generated 1372 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:07:01.863460 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-de2a1ad0-31a4-4f94-8726-6626cbb5d98d tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:07:01.864076 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-de2a1ad0-31a4-4f94-8726-6626cbb5d98d tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] [instance: 23fabf1c-dd79-4d5a-9e0a-9022f7ad5ea4] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:07:01.871440 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-de2a1ad0-31a4-4f94-8726-6626cbb5d98d tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:07:01.871916 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-de2a1ad0-31a4-4f94-8726-6626cbb5d98d tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:07:01.872679 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-de2a1ad0-31a4-4f94-8726-6626cbb5d98d tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:07:01.873114 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-de2a1ad0-31a4-4f94-8726-6626cbb5d98d tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:07:02.011986 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-de2a1ad0-31a4-4f94-8726-6626cbb5d98d tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce861b0f93142849eb235b3df8b9aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1919be84b04d4c9306ef33015632a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:07:02.020663 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-de2a1ad0-31a4-4f94-8726-6626cbb5d98d tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] 10.222.0.17 "GET /compute/v2.1/servers/23fabf1c-dd79-4d5a-9e0a-9022f7ad5ea4" status: 200 len: 1372 microversion: 2.1 time: 0.161247 Jul 23 22:07:02.021232 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3232/5842] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:07:01 2022] GET /compute/v2.1/servers/23fabf1c-dd79-4d5a-9e0a-9022f7ad5ea4 => generated 1372 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:07:03.038606 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e3a8428b-d066-42bc-acda-5fd7d4731560 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:07:03.039340 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e3a8428b-d066-42bc-acda-5fd7d4731560 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] [instance: 23fabf1c-dd79-4d5a-9e0a-9022f7ad5ea4] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:07:03.046582 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e3a8428b-d066-42bc-acda-5fd7d4731560 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:07:03.047034 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e3a8428b-d066-42bc-acda-5fd7d4731560 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:07:03.047809 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e3a8428b-d066-42bc-acda-5fd7d4731560 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:07:03.048242 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e3a8428b-d066-42bc-acda-5fd7d4731560 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:07:03.188418 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e3a8428b-d066-42bc-acda-5fd7d4731560 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce861b0f93142849eb235b3df8b9aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1919be84b04d4c9306ef33015632a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:07:03.196198 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e3a8428b-d066-42bc-acda-5fd7d4731560 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] 10.222.0.17 "GET /compute/v2.1/servers/23fabf1c-dd79-4d5a-9e0a-9022f7ad5ea4" status: 200 len: 1372 microversion: 2.1 time: 0.161738 Jul 23 22:07:03.196779 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3233/5843] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:07:03 2022] GET /compute/v2.1/servers/23fabf1c-dd79-4d5a-9e0a-9022f7ad5ea4 => generated 1372 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:07:04.237334 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-d2599b20-e7eb-4824-a5c8-a809b8f0e0a9 req-0d124d49-d925-4a2f-8898-8efd20f42289 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23fabf1c-dd79-4d5a-9e0a-9022f7ad5ea4", "name": "network-vif-plugged", "status": "completed", "tag": "126ea4fd-a303-42f1-a248-e84bc9c4c8e3"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:07:04.246342 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-d2599b20-e7eb-4824-a5c8-a809b8f0e0a9 req-0d124d49-d925-4a2f-8898-8efd20f42289 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:07:04.246798 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-d2599b20-e7eb-4824-a5c8-a809b8f0e0a9 req-0d124d49-d925-4a2f-8898-8efd20f42289 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:07:04.257937 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-d2599b20-e7eb-4824-a5c8-a809b8f0e0a9 req-0d124d49-d925-4a2f-8898-8efd20f42289 service nova] Creating event network-vif-plugged:126ea4fd-a303-42f1-a248-e84bc9c4c8e3 for instance 23fabf1c-dd79-4d5a-9e0a-9022f7ad5ea4 on nch2-master-1 Jul 23 22:07:04.263076 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-d2599b20-e7eb-4824-a5c8-a809b8f0e0a9 req-0d124d49-d925-4a2f-8898-8efd20f42289 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097167 Jul 23 22:07:04.263652 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3234/5844] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:07:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:07:04.269152 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-570ea2fd-4f84-425b-b09d-511aafe8d700 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:07:04.269879 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-570ea2fd-4f84-425b-b09d-511aafe8d700 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] [instance: 23fabf1c-dd79-4d5a-9e0a-9022f7ad5ea4] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:07:04.274780 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:07:04.279075 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-570ea2fd-4f84-425b-b09d-511aafe8d700 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:07:04.279524 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-570ea2fd-4f84-425b-b09d-511aafe8d700 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:07:04.280317 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-570ea2fd-4f84-425b-b09d-511aafe8d700 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:07:04.280757 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-570ea2fd-4f84-425b-b09d-511aafe8d700 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:07:04.428079 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-570ea2fd-4f84-425b-b09d-511aafe8d700 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce861b0f93142849eb235b3df8b9aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1919be84b04d4c9306ef33015632a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:07:04.436317 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-570ea2fd-4f84-425b-b09d-511aafe8d700 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] 10.222.0.17 "GET /compute/v2.1/servers/23fabf1c-dd79-4d5a-9e0a-9022f7ad5ea4" status: 200 len: 1372 microversion: 2.1 time: 0.171217 Jul 23 22:07:04.437041 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3235/5845] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:07:04 2022] GET /compute/v2.1/servers/23fabf1c-dd79-4d5a-9e0a-9022f7ad5ea4 => generated 1372 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:07:05.454915 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3afcc424-c204-4173-93f2-ac97f942f446 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:07:05.455591 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-3afcc424-c204-4173-93f2-ac97f942f446 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] [instance: 23fabf1c-dd79-4d5a-9e0a-9022f7ad5ea4] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:07:05.457675 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:07:05.458408 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=12 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:07:05.466042 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3afcc424-c204-4173-93f2-ac97f942f446 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:07:05.466626 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3afcc424-c204-4173-93f2-ac97f942f446 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:07:05.467355 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3afcc424-c204-4173-93f2-ac97f942f446 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:07:05.467880 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3afcc424-c204-4173-93f2-ac97f942f446 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:07:05.602510 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-3afcc424-c204-4173-93f2-ac97f942f446 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce861b0f93142849eb235b3df8b9aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1919be84b04d4c9306ef33015632a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:07:05.610090 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-3afcc424-c204-4173-93f2-ac97f942f446 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] 10.222.0.17 "GET /compute/v2.1/servers/23fabf1c-dd79-4d5a-9e0a-9022f7ad5ea4" status: 200 len: 1372 microversion: 2.1 time: 0.160031 Jul 23 22:07:05.610674 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3236/5846] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:07:05 2022] GET /compute/v2.1/servers/23fabf1c-dd79-4d5a-9e0a-9022f7ad5ea4 => generated 1372 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:07:06.631403 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-30b4e12d-862e-431a-8dc5-b7667fbbcba4 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:07:06.632545 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-30b4e12d-862e-431a-8dc5-b7667fbbcba4 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] [instance: 23fabf1c-dd79-4d5a-9e0a-9022f7ad5ea4] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:07:06.643025 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-30b4e12d-862e-431a-8dc5-b7667fbbcba4 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:07:06.643785 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-30b4e12d-862e-431a-8dc5-b7667fbbcba4 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:07:06.645051 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-30b4e12d-862e-431a-8dc5-b7667fbbcba4 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:07:06.645793 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-30b4e12d-862e-431a-8dc5-b7667fbbcba4 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:07:06.782190 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-30b4e12d-862e-431a-8dc5-b7667fbbcba4 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce861b0f93142849eb235b3df8b9aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1919be84b04d4c9306ef33015632a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:07:06.790392 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-30b4e12d-862e-431a-8dc5-b7667fbbcba4 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] 10.222.0.17 "GET /compute/v2.1/servers/23fabf1c-dd79-4d5a-9e0a-9022f7ad5ea4" status: 200 len: 1544 microversion: 2.1 time: 0.166010 Jul 23 22:07:06.790986 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3237/5847] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:07:06 2022] GET /compute/v2.1/servers/23fabf1c-dd79-4d5a-9e0a-9022f7ad5ea4 => generated 1544 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:07:06.806330 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-64700957-8637-4a18-9ab1-fb43b66c91fc tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:07:06.806933 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-64700957-8637-4a18-9ab1-fb43b66c91fc tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] [instance: 23fabf1c-dd79-4d5a-9e0a-9022f7ad5ea4] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:07:06.812979 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-64700957-8637-4a18-9ab1-fb43b66c91fc tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:07:06.813402 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-64700957-8637-4a18-9ab1-fb43b66c91fc tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:07:06.814238 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-64700957-8637-4a18-9ab1-fb43b66c91fc tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:07:06.814675 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-64700957-8637-4a18-9ab1-fb43b66c91fc tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:07:06.947470 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-64700957-8637-4a18-9ab1-fb43b66c91fc tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce861b0f93142849eb235b3df8b9aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1919be84b04d4c9306ef33015632a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:07:06.959735 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-64700957-8637-4a18-9ab1-fb43b66c91fc tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] 10.222.0.17 "GET /compute/v2.1/servers/23fabf1c-dd79-4d5a-9e0a-9022f7ad5ea4" status: 200 len: 1544 microversion: 2.1 time: 0.156654 Jul 23 22:07:06.960589 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3238/5848] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:07:06 2022] GET /compute/v2.1/servers/23fabf1c-dd79-4d5a-9e0a-9022f7ad5ea4 => generated 1544 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:07:08.994082 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-dc6ebd0f-4ccc-4072-ba0a-53feeccc3019 req-4de34728-404d-42f6-b9fd-8966ad1161fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23fabf1c-dd79-4d5a-9e0a-9022f7ad5ea4", "tag": "126ea4fd-a303-42f1-a248-e84bc9c4c8e3"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:07:09.002890 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-dc6ebd0f-4ccc-4072-ba0a-53feeccc3019 req-4de34728-404d-42f6-b9fd-8966ad1161fa service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:07:09.003437 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-dc6ebd0f-4ccc-4072-ba0a-53feeccc3019 req-4de34728-404d-42f6-b9fd-8966ad1161fa service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:07:09.015937 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-dc6ebd0f-4ccc-4072-ba0a-53feeccc3019 req-4de34728-404d-42f6-b9fd-8966ad1161fa service nova] Creating event network-changed:126ea4fd-a303-42f1-a248-e84bc9c4c8e3 for instance 23fabf1c-dd79-4d5a-9e0a-9022f7ad5ea4 on nch2-master-1 Jul 23 22:07:09.022026 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-dc6ebd0f-4ccc-4072-ba0a-53feeccc3019 req-4de34728-404d-42f6-b9fd-8966ad1161fa service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098371 Jul 23 22:07:09.022996 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3239/5849] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:07:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:07:31.250618 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-888f2217-c3cc-4a23-9703-b14da2ad5fe6 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:07:31.251545 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-888f2217-c3cc-4a23-9703-b14da2ad5fe6 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] [instance: 23fabf1c-dd79-4d5a-9e0a-9022f7ad5ea4] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:07:31.254733 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=8 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:07:31.255379 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=74 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:07:31.261475 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-888f2217-c3cc-4a23-9703-b14da2ad5fe6 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:07:31.261958 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-888f2217-c3cc-4a23-9703-b14da2ad5fe6 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:07:31.262701 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-888f2217-c3cc-4a23-9703-b14da2ad5fe6 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:07:31.263133 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-888f2217-c3cc-4a23-9703-b14da2ad5fe6 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:07:31.316202 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-888f2217-c3cc-4a23-9703-b14da2ad5fe6 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] 10.222.0.17 "POST /compute/v2.1/servers/23fabf1c-dd79-4d5a-9e0a-9022f7ad5ea4/action" status: 200 len: 24576 microversion: 2.1 time: 0.071056 Jul 23 22:07:31.316848 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3240/5850] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 22:07:31 2022] POST /compute/v2.1/servers/23fabf1c-dd79-4d5a-9e0a-9022f7ad5ea4/action => generated 24576 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 23 22:07:37.809515 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9cf8872f-60bf-4977-9a5f-ea836277d0d7 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:07:37.810612 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-9cf8872f-60bf-4977-9a5f-ea836277d0d7 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] [instance: 23fabf1c-dd79-4d5a-9e0a-9022f7ad5ea4] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:07:37.818353 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9cf8872f-60bf-4977-9a5f-ea836277d0d7 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:07:37.818834 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9cf8872f-60bf-4977-9a5f-ea836277d0d7 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:07:37.819624 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9cf8872f-60bf-4977-9a5f-ea836277d0d7 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:07:37.820067 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9cf8872f-60bf-4977-9a5f-ea836277d0d7 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:07:37.874086 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9cf8872f-60bf-4977-9a5f-ea836277d0d7 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] 10.222.0.17 "POST /compute/v2.1/servers/23fabf1c-dd79-4d5a-9e0a-9022f7ad5ea4/action" status: 200 len: 32644 microversion: 2.1 time: 0.068924 Jul 23 22:07:37.874991 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3241/5851] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 22:07:37 2022] POST /compute/v2.1/servers/23fabf1c-dd79-4d5a-9e0a-9022f7ad5ea4/action => generated 32644 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 23 22:07:38.880172 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-61b3132b-6290-450f-95b8-af426c67c369 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:07:38.880898 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-61b3132b-6290-450f-95b8-af426c67c369 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] [instance: 23fabf1c-dd79-4d5a-9e0a-9022f7ad5ea4] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:07:38.888840 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-61b3132b-6290-450f-95b8-af426c67c369 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:07:38.889293 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-61b3132b-6290-450f-95b8-af426c67c369 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:07:38.890137 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-61b3132b-6290-450f-95b8-af426c67c369 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:07:38.890572 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-61b3132b-6290-450f-95b8-af426c67c369 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:07:38.915600 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-61b3132b-6290-450f-95b8-af426c67c369 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] [instance: 23fabf1c-dd79-4d5a-9e0a-9022f7ad5ea4] Going to try to terminate instance {{(pid=131320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 22:07:38.995150 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-61b3132b-6290-450f-95b8-af426c67c369 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] 10.222.0.17 "DELETE /compute/v2.1/servers/23fabf1c-dd79-4d5a-9e0a-9022f7ad5ea4" status: 204 len: 0 microversion: 2.1 time: 0.119314 Jul 23 22:07:38.999420 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3242/5852] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 22:07:38 2022] DELETE /compute/v2.1/servers/23fabf1c-dd79-4d5a-9e0a-9022f7ad5ea4 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 23 22:07:39.001220 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-58694220-9970-4445-8a20-aff8de785941 req-1da67ecb-6229-4805-96ae-eeb7ec5ed349 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23fabf1c-dd79-4d5a-9e0a-9022f7ad5ea4", "tag": "126ea4fd-a303-42f1-a248-e84bc9c4c8e3"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:07:39.009606 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-58694220-9970-4445-8a20-aff8de785941 req-1da67ecb-6229-4805-96ae-eeb7ec5ed349 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:07:39.010065 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-58694220-9970-4445-8a20-aff8de785941 req-1da67ecb-6229-4805-96ae-eeb7ec5ed349 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:07:39.022105 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-58694220-9970-4445-8a20-aff8de785941 req-1da67ecb-6229-4805-96ae-eeb7ec5ed349 service nova] Creating event network-changed:126ea4fd-a303-42f1-a248-e84bc9c4c8e3 for instance 23fabf1c-dd79-4d5a-9e0a-9022f7ad5ea4 on nch2-master-1 Jul 23 22:07:39.026920 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-58694220-9970-4445-8a20-aff8de785941 req-1da67ecb-6229-4805-96ae-eeb7ec5ed349 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029814 Jul 23 22:07:39.027523 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3243/5853] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:07:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:07:39.035824 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8db99d24-f2f3-417d-bf3f-ce820f4ee56a tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:07:39.036531 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8db99d24-f2f3-417d-bf3f-ce820f4ee56a tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] [instance: 23fabf1c-dd79-4d5a-9e0a-9022f7ad5ea4] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:07:39.043029 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8db99d24-f2f3-417d-bf3f-ce820f4ee56a tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:07:39.043476 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8db99d24-f2f3-417d-bf3f-ce820f4ee56a tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:07:39.044247 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8db99d24-f2f3-417d-bf3f-ce820f4ee56a tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:07:39.044727 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8db99d24-f2f3-417d-bf3f-ce820f4ee56a tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:07:39.180854 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8db99d24-f2f3-417d-bf3f-ce820f4ee56a tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce861b0f93142849eb235b3df8b9aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1919be84b04d4c9306ef33015632a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:07:39.188924 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8db99d24-f2f3-417d-bf3f-ce820f4ee56a tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] 10.222.0.17 "GET /compute/v2.1/servers/23fabf1c-dd79-4d5a-9e0a-9022f7ad5ea4" status: 200 len: 1668 microversion: 2.1 time: 0.157454 Jul 23 22:07:39.189509 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3244/5854] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:07:39 2022] GET /compute/v2.1/servers/23fabf1c-dd79-4d5a-9e0a-9022f7ad5ea4 => generated 1668 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:07:40.207233 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-859b163f-fc1e-4245-a2cb-e9a3f1675bb4 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:07:40.207970 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-859b163f-fc1e-4245-a2cb-e9a3f1675bb4 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] [instance: 23fabf1c-dd79-4d5a-9e0a-9022f7ad5ea4] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:07:40.215670 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-859b163f-fc1e-4245-a2cb-e9a3f1675bb4 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:07:40.216097 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-859b163f-fc1e-4245-a2cb-e9a3f1675bb4 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:07:40.216972 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-859b163f-fc1e-4245-a2cb-e9a3f1675bb4 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:07:40.217408 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-859b163f-fc1e-4245-a2cb-e9a3f1675bb4 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:07:40.351563 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-859b163f-fc1e-4245-a2cb-e9a3f1675bb4 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ce861b0f93142849eb235b3df8b9aa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d1919be84b04d4c9306ef33015632a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:07:40.359704 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-859b163f-fc1e-4245-a2cb-e9a3f1675bb4 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] 10.222.0.17 "GET /compute/v2.1/servers/23fabf1c-dd79-4d5a-9e0a-9022f7ad5ea4" status: 200 len: 1668 microversion: 2.1 time: 0.156454 Jul 23 22:07:40.360362 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3245/5855] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:07:40 2022] GET /compute/v2.1/servers/23fabf1c-dd79-4d5a-9e0a-9022f7ad5ea4 => generated 1668 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:07:40.853324 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-295f2b14-a140-41fe-956b-5fdc42b8cc6c req-6b8d0ba4-7c01-43ff-9bdc-bec528e6b852 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23fabf1c-dd79-4d5a-9e0a-9022f7ad5ea4", "name": "network-vif-deleted", "tag": "126ea4fd-a303-42f1-a248-e84bc9c4c8e3"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:07:40.862243 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-295f2b14-a140-41fe-956b-5fdc42b8cc6c req-6b8d0ba4-7c01-43ff-9bdc-bec528e6b852 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:07:40.862706 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-295f2b14-a140-41fe-956b-5fdc42b8cc6c req-6b8d0ba4-7c01-43ff-9bdc-bec528e6b852 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:07:40.882848 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-295f2b14-a140-41fe-956b-5fdc42b8cc6c req-6b8d0ba4-7c01-43ff-9bdc-bec528e6b852 service nova] Creating event network-vif-deleted:126ea4fd-a303-42f1-a248-e84bc9c4c8e3 for instance 23fabf1c-dd79-4d5a-9e0a-9022f7ad5ea4 on nch2-master-1 Jul 23 22:07:40.887886 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-295f2b14-a140-41fe-956b-5fdc42b8cc6c req-6b8d0ba4-7c01-43ff-9bdc-bec528e6b852 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038440 Jul 23 22:07:40.889413 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3246/5856] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:07:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 22:07:41.378788 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a02caad4-0070-4362-935d-40fe73fd03b6 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:07:41.379449 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a02caad4-0070-4362-935d-40fe73fd03b6 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] [instance: 23fabf1c-dd79-4d5a-9e0a-9022f7ad5ea4] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:07:41.385843 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a02caad4-0070-4362-935d-40fe73fd03b6 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:07:41.386327 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a02caad4-0070-4362-935d-40fe73fd03b6 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:07:41.387093 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a02caad4-0070-4362-935d-40fe73fd03b6 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:07:41.387525 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a02caad4-0070-4362-935d-40fe73fd03b6 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:07:41.404093 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-a02caad4-0070-4362-935d-40fe73fd03b6 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] HTTP exception thrown: Instance 23fabf1c-dd79-4d5a-9e0a-9022f7ad5ea4 could not be found. Jul 23 22:07:41.405724 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a02caad4-0070-4362-935d-40fe73fd03b6 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Request method failure captured: Jul 23 22:07:41.405724 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/23fabf1c-dd79-4d5a-9e0a-9022f7ad5ea4 HTTP/1.1 Jul 23 22:07:41.405724 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 22:07:41.405724 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 22:07:41.405724 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 22:07:41.405724 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 22:07:41.405724 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 22:07:41.405724 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 22:07:41.405724 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 22:07:41.405724 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 22:07:41.405724 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3HCLa_eAqIicbWhTmt5RuUQv6IAUNPtVTnhsGYb2H_sE7PnvLf6hS2arO_CWKFMbiGvcAUdmd0CHAVSP2nwpHctzO9WV0OKQtnB9ui2MaNRFUm44JM3azQepQCUcYDOKmiQiDyUGH0VinwO0YO203J7uz-yZ8rbcAZZrniT5f40hkQY Jul 23 22:07:41.405724 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 22:07:41.405724 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 22:07:41.405724 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 22:07:41.405724 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 22:07:41.405724 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 22:07:41.405724 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 22:07:41.405724 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 1d1919be84b04d4c9306ef33015632a0 Jul 23 22:07:41.405724 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-TestNetworkBasicOps-579612114 Jul 23 22:07:41.405724 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 22:07:41.405724 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 22:07:41.405724 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1d1919be84b04d4c9306ef33015632a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1d1919be84b04d4c9306ef33015632a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1d1919be84b04d4c9306ef33015632a0", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1d1919be84b04d4c9306ef33015632a0"}]}] Jul 23 22:07:41.405724 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-TestNetworkBasicOps-579612114 Jul 23 22:07:41.405724 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 1d1919be84b04d4c9306ef33015632a0 Jul 23 22:07:41.405724 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-TestNetworkBasicOps-579612114 Jul 23 22:07:41.405724 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-TestNetworkBasicOps-579612114-project Jul 23 22:07:41.405724 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 22:07:41.405724 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 22:07:41.405724 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 5ce861b0f93142849eb235b3df8b9aa0 Jul 23 22:07:41.405724 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-TestNetworkBasicOps-579612114-project Jul 23 22:07:41.405724 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 22:07:41.405724 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance 23fabf1c-dd79-4d5a-9e0a-9022f7ad5ea4 could not be found. Jul 23 22:07:41.405724 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '23fabf1c-dd79-4d5a-9e0a-9022f7ad5ea4'} Jul 23 22:07:41.405724 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 22:07:41.405724 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:07:41.405724 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 22:07:41.405724 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 22:07:41.405724 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 22:07:41.405724 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 22:07:41.405724 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 22:07:41.405724 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 22:07:41.405724 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 22:07:41.405724 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 22:07:41.405724 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23fabf1c-dd79-4d5a-9e0a-9022f7ad5ea4 could not be found. Jul 23 22:07:41.405724 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:07:41.405724 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:07:41.405724 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:07:41.405724 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:07:41.405724 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:07:41.405724 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:07:41.405724 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 22:07:41.405724 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 22:07:41.405724 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 22:07:41.405724 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 22:07:41.405724 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 22:07:41.405724 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 22:07:41.405724 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 22:07:41.405724 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 22:07:41.405724 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 22:07:41.405724 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 22:07:41.405724 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23fabf1c-dd79-4d5a-9e0a-9022f7ad5ea4 could not be found. Jul 23 22:07:41.405724 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:07:41.405724 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:07:41.405724 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:07:41.411195 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:07:41.411195 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:07:41.411195 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:07:41.411195 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 22:07:41.411195 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 22:07:41.411195 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23fabf1c-dd79-4d5a-9e0a-9022f7ad5ea4 could not be found. Jul 23 22:07:41.411195 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:07:41.411195 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a02caad4-0070-4362-935d-40fe73fd03b6 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Returning 404 to user: Instance 23fabf1c-dd79-4d5a-9e0a-9022f7ad5ea4 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 22:07:41.411195 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a02caad4-0070-4362-935d-40fe73fd03b6 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] 10.222.0.17 "GET /compute/v2.1/servers/23fabf1c-dd79-4d5a-9e0a-9022f7ad5ea4" status: 404 len: 111 microversion: 2.1 time: 0.033441 Jul 23 22:07:41.411195 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3247/5857] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:07:41 2022] GET /compute/v2.1/servers/23fabf1c-dd79-4d5a-9e0a-9022f7ad5ea4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 22:07:41.582544 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-926a5c91-23de-4d3f-84db-3c5f39fbb542 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] Calling method '.version_select at 0x7f0b464a2f70>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:07:41.608564 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-926a5c91-23de-4d3f-84db-3c5f39fbb542 tempest-TestNetworkBasicOps-579612114 tempest-TestNetworkBasicOps-579612114-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-725834625" status: 202 len: 0 microversion: 2.1 time: 0.029850 Jul 23 22:07:41.609311 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3248/5858] 10.222.0.17 () {58 vars in 1253 bytes} [Sat Jul 23 22:07:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-725834625 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 23 22:07:48.715029 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5ff394b4-3c97-4791-9bea-4aeea57c125e tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-100491674", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "networks": [{"uuid": "69c5f41f-b6d7-4415-89a6-d8841ece0ef6"}]}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:07:48.770785 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-5ff394b4-3c97-4791-9bea-4aeea57c125e tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] validate_networks() for [('69c5f41f-b6d7-4415-89a6-d8841ece0ef6', None, None, None, None, None)] {{(pid=131320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 22:07:49.171394 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-5ff394b4-3c97-4791-9bea-4aeea57c125e tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 22:07:49.171823 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-5ff394b4-3c97-4791-9bea-4aeea57c125e tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 22:07:49.172299 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-5ff394b4-3c97-4791-9bea-4aeea57c125e tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 22:07:49.172736 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-5ff394b4-3c97-4791-9bea-4aeea57c125e tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 22:07:49.173130 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-5ff394b4-3c97-4791-9bea-4aeea57c125e tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 22:07:49.182658 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5ff394b4-3c97-4791-9bea-4aeea57c125e tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:07:49.183114 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5ff394b4-3c97-4791-9bea-4aeea57c125e tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:07:49.183915 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5ff394b4-3c97-4791-9bea-4aeea57c125e tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:07:49.184356 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5ff394b4-3c97-4791-9bea-4aeea57c125e tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:07:49.201428 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-5ff394b4-3c97-4791-9bea-4aeea57c125e tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Getting quotas for project 960e6d7d52ec40ca82fefcfad3075776. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 22:07:49.206913 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-5ff394b4-3c97-4791-9bea-4aeea57c125e tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Getting quotas for user c39ae90b08e14ad8a0e66643f63013b4 and project 960e6d7d52ec40ca82fefcfad3075776. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 22:07:49.220004 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5ff394b4-3c97-4791-9bea-4aeea57c125e tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Going to run 1 instances... {{(pid=131320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 22:07:49.222352 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5ff394b4-3c97-4791-9bea-4aeea57c125e tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] [instance: 4649f844-68c3-4baa-8ca2-7bee21c7915a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 22:07:49.268820 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5ff394b4-3c97-4791-9bea-4aeea57c125e tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.690798 Jul 23 22:07:49.269469 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3249/5859] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 22:07:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 692 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 23 22:07:49.279752 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-cad4f58d-8d11-439b-8156-2cd9eb710202 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:07:49.280365 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-cad4f58d-8d11-439b-8156-2cd9eb710202 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] [instance: 4649f844-68c3-4baa-8ca2-7bee21c7915a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:07:49.336069 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-cad4f58d-8d11-439b-8156-2cd9eb710202 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39ae90b08e14ad8a0e66643f63013b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960e6d7d52ec40ca82fefcfad3075776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:07:49.343895 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-cad4f58d-8d11-439b-8156-2cd9eb710202 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] 10.222.0.17 "GET /compute/v2.1/servers/4649f844-68c3-4baa-8ca2-7bee21c7915a" status: 200 len: 1214 microversion: 2.1 time: 0.067873 Jul 23 22:07:49.344649 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3250/5860] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:07:49 2022] GET /compute/v2.1/servers/4649f844-68c3-4baa-8ca2-7bee21c7915a => generated 1214 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:07:50.361262 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-024a11e1-6908-44b0-810a-814efdc66955 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:07:50.362202 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-024a11e1-6908-44b0-810a-814efdc66955 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] [instance: 4649f844-68c3-4baa-8ca2-7bee21c7915a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:07:50.370629 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-024a11e1-6908-44b0-810a-814efdc66955 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:07:50.371116 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-024a11e1-6908-44b0-810a-814efdc66955 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:07:50.371886 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-024a11e1-6908-44b0-810a-814efdc66955 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:07:50.372320 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-024a11e1-6908-44b0-810a-814efdc66955 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:07:50.440157 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-024a11e1-6908-44b0-810a-814efdc66955 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39ae90b08e14ad8a0e66643f63013b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960e6d7d52ec40ca82fefcfad3075776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:07:50.448113 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-024a11e1-6908-44b0-810a-814efdc66955 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] 10.222.0.17 "GET /compute/v2.1/servers/4649f844-68c3-4baa-8ca2-7bee21c7915a" status: 200 len: 1274 microversion: 2.1 time: 0.090783 Jul 23 22:07:50.449129 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3251/5861] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:07:50 2022] GET /compute/v2.1/servers/4649f844-68c3-4baa-8ca2-7bee21c7915a => generated 1274 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:07:51.465268 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b5c5c7a1-5778-4e1a-8de3-44bb062ac661 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:07:51.466021 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b5c5c7a1-5778-4e1a-8de3-44bb062ac661 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] [instance: 4649f844-68c3-4baa-8ca2-7bee21c7915a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:07:51.473273 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b5c5c7a1-5778-4e1a-8de3-44bb062ac661 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:07:51.473726 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b5c5c7a1-5778-4e1a-8de3-44bb062ac661 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:07:51.474533 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b5c5c7a1-5778-4e1a-8de3-44bb062ac661 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:07:51.474966 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b5c5c7a1-5778-4e1a-8de3-44bb062ac661 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:07:51.605880 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b5c5c7a1-5778-4e1a-8de3-44bb062ac661 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39ae90b08e14ad8a0e66643f63013b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960e6d7d52ec40ca82fefcfad3075776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:07:51.613730 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b5c5c7a1-5778-4e1a-8de3-44bb062ac661 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] 10.222.0.17 "GET /compute/v2.1/servers/4649f844-68c3-4baa-8ca2-7bee21c7915a" status: 200 len: 1314 microversion: 2.1 time: 0.152781 Jul 23 22:07:51.614519 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3252/5862] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:07:51 2022] GET /compute/v2.1/servers/4649f844-68c3-4baa-8ca2-7bee21c7915a => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:07:51.648620 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-8034b0f6-f65c-4711-a6d6-a79147c86960 req-0de6c6c2-eff3-414c-92a6-7b6ae22b81ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4649f844-68c3-4baa-8ca2-7bee21c7915a", "tag": "f4764e34-523b-418e-9515-0b511e2ac7f7"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:07:51.662597 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-8034b0f6-f65c-4711-a6d6-a79147c86960 req-0de6c6c2-eff3-414c-92a6-7b6ae22b81ae service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:07:51.664065 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-8034b0f6-f65c-4711-a6d6-a79147c86960 req-0de6c6c2-eff3-414c-92a6-7b6ae22b81ae service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:07:51.683371 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-8034b0f6-f65c-4711-a6d6-a79147c86960 req-0de6c6c2-eff3-414c-92a6-7b6ae22b81ae service nova] Creating event network-changed:f4764e34-523b-418e-9515-0b511e2ac7f7 for instance 4649f844-68c3-4baa-8ca2-7bee21c7915a on nch2-master-1 Jul 23 22:07:51.689508 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-8034b0f6-f65c-4711-a6d6-a79147c86960 req-0de6c6c2-eff3-414c-92a6-7b6ae22b81ae service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044147 Jul 23 22:07:51.690285 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3253/5863] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:07:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:07:52.636502 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-aa04910d-d304-4567-a383-b2dafb975029 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:07:52.638319 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-aa04910d-d304-4567-a383-b2dafb975029 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] [instance: 4649f844-68c3-4baa-8ca2-7bee21c7915a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:07:52.645911 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-aa04910d-d304-4567-a383-b2dafb975029 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:07:52.646277 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-aa04910d-d304-4567-a383-b2dafb975029 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:07:52.647048 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-aa04910d-d304-4567-a383-b2dafb975029 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:07:52.647484 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-aa04910d-d304-4567-a383-b2dafb975029 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:07:52.784086 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-aa04910d-d304-4567-a383-b2dafb975029 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39ae90b08e14ad8a0e66643f63013b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960e6d7d52ec40ca82fefcfad3075776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:07:52.792201 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-aa04910d-d304-4567-a383-b2dafb975029 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] 10.222.0.17 "GET /compute/v2.1/servers/4649f844-68c3-4baa-8ca2-7bee21c7915a" status: 200 len: 1314 microversion: 2.1 time: 0.162940 Jul 23 22:07:52.792784 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3254/5864] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:07:52 2022] GET /compute/v2.1/servers/4649f844-68c3-4baa-8ca2-7bee21c7915a => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:07:53.826271 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-72d96b94-f266-494b-97c6-ad4532c0ec3f tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:07:53.826919 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-72d96b94-f266-494b-97c6-ad4532c0ec3f tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] [instance: 4649f844-68c3-4baa-8ca2-7bee21c7915a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:07:53.838190 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-72d96b94-f266-494b-97c6-ad4532c0ec3f tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:07:53.838808 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-72d96b94-f266-494b-97c6-ad4532c0ec3f tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:07:53.839958 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-72d96b94-f266-494b-97c6-ad4532c0ec3f tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:07:53.840551 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-72d96b94-f266-494b-97c6-ad4532c0ec3f tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:07:53.980670 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-72d96b94-f266-494b-97c6-ad4532c0ec3f tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39ae90b08e14ad8a0e66643f63013b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960e6d7d52ec40ca82fefcfad3075776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:07:53.988592 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-72d96b94-f266-494b-97c6-ad4532c0ec3f tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] 10.222.0.17 "GET /compute/v2.1/servers/4649f844-68c3-4baa-8ca2-7bee21c7915a" status: 200 len: 1314 microversion: 2.1 time: 0.176349 Jul 23 22:07:53.989176 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3255/5865] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:07:53 2022] GET /compute/v2.1/servers/4649f844-68c3-4baa-8ca2-7bee21c7915a => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:07:55.015212 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4af4043d-c98d-42f4-b87f-391eb26ff884 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:07:55.016308 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-4af4043d-c98d-42f4-b87f-391eb26ff884 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] [instance: 4649f844-68c3-4baa-8ca2-7bee21c7915a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:07:55.028040 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4af4043d-c98d-42f4-b87f-391eb26ff884 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:07:55.028912 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4af4043d-c98d-42f4-b87f-391eb26ff884 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:07:55.029718 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4af4043d-c98d-42f4-b87f-391eb26ff884 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:07:55.030182 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4af4043d-c98d-42f4-b87f-391eb26ff884 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:07:55.167641 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-4af4043d-c98d-42f4-b87f-391eb26ff884 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39ae90b08e14ad8a0e66643f63013b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960e6d7d52ec40ca82fefcfad3075776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:07:55.179348 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4af4043d-c98d-42f4-b87f-391eb26ff884 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] 10.222.0.17 "GET /compute/v2.1/servers/4649f844-68c3-4baa-8ca2-7bee21c7915a" status: 200 len: 1314 microversion: 2.1 time: 0.170451 Jul 23 22:07:55.180025 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3256/5866] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:07:55 2022] GET /compute/v2.1/servers/4649f844-68c3-4baa-8ca2-7bee21c7915a => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:07:56.200834 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e5a016c6-b132-42d8-bec0-26618c768a63 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:07:56.201534 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e5a016c6-b132-42d8-bec0-26618c768a63 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] [instance: 4649f844-68c3-4baa-8ca2-7bee21c7915a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:07:56.208998 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e5a016c6-b132-42d8-bec0-26618c768a63 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:07:56.209456 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e5a016c6-b132-42d8-bec0-26618c768a63 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:07:56.210261 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e5a016c6-b132-42d8-bec0-26618c768a63 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:07:56.210703 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e5a016c6-b132-42d8-bec0-26618c768a63 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:07:56.344866 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e5a016c6-b132-42d8-bec0-26618c768a63 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39ae90b08e14ad8a0e66643f63013b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960e6d7d52ec40ca82fefcfad3075776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:07:56.352546 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e5a016c6-b132-42d8-bec0-26618c768a63 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] 10.222.0.17 "GET /compute/v2.1/servers/4649f844-68c3-4baa-8ca2-7bee21c7915a" status: 200 len: 1314 microversion: 2.1 time: 0.158364 Jul 23 22:07:56.353127 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3257/5867] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:07:56 2022] GET /compute/v2.1/servers/4649f844-68c3-4baa-8ca2-7bee21c7915a => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:07:57.372880 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-18d5ced5-b781-464a-9693-14adc5aaa4e4 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:07:57.373773 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-18d5ced5-b781-464a-9693-14adc5aaa4e4 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] [instance: 4649f844-68c3-4baa-8ca2-7bee21c7915a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:07:57.382670 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-18d5ced5-b781-464a-9693-14adc5aaa4e4 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:07:57.383242 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-18d5ced5-b781-464a-9693-14adc5aaa4e4 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:07:57.384198 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-18d5ced5-b781-464a-9693-14adc5aaa4e4 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:07:57.384748 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-18d5ced5-b781-464a-9693-14adc5aaa4e4 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:07:57.534916 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-18d5ced5-b781-464a-9693-14adc5aaa4e4 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39ae90b08e14ad8a0e66643f63013b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960e6d7d52ec40ca82fefcfad3075776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:07:57.550398 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-18d5ced5-b781-464a-9693-14adc5aaa4e4 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] 10.222.0.17 "GET /compute/v2.1/servers/4649f844-68c3-4baa-8ca2-7bee21c7915a" status: 200 len: 1314 microversion: 2.1 time: 0.183753 Jul 23 22:07:57.551038 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3258/5868] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:07:57 2022] GET /compute/v2.1/servers/4649f844-68c3-4baa-8ca2-7bee21c7915a => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:07:58.366637 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-900a6400-327a-4980-b074-6ca0e1e21a68 req-934ff6f4-501d-4bb3-bcd2-55558ffb11a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4649f844-68c3-4baa-8ca2-7bee21c7915a", "name": "network-vif-plugged", "status": "completed", "tag": "f4764e34-523b-418e-9515-0b511e2ac7f7"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:07:58.376150 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-900a6400-327a-4980-b074-6ca0e1e21a68 req-934ff6f4-501d-4bb3-bcd2-55558ffb11a0 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:07:58.376867 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-900a6400-327a-4980-b074-6ca0e1e21a68 req-934ff6f4-501d-4bb3-bcd2-55558ffb11a0 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:07:58.388534 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-900a6400-327a-4980-b074-6ca0e1e21a68 req-934ff6f4-501d-4bb3-bcd2-55558ffb11a0 service nova] Creating event network-vif-plugged:f4764e34-523b-418e-9515-0b511e2ac7f7 for instance 4649f844-68c3-4baa-8ca2-7bee21c7915a on nch2-master-1 Jul 23 22:07:58.393443 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-900a6400-327a-4980-b074-6ca0e1e21a68 req-934ff6f4-501d-4bb3-bcd2-55558ffb11a0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030680 Jul 23 22:07:58.394082 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3259/5869] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:07:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 22:07:58.577540 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-744bbaae-2856-4a0d-8668-a6cf5bba3e36 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:07:58.578388 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-744bbaae-2856-4a0d-8668-a6cf5bba3e36 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] [instance: 4649f844-68c3-4baa-8ca2-7bee21c7915a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:07:58.585190 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-744bbaae-2856-4a0d-8668-a6cf5bba3e36 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:07:58.585646 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-744bbaae-2856-4a0d-8668-a6cf5bba3e36 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:07:58.587128 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-744bbaae-2856-4a0d-8668-a6cf5bba3e36 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:07:58.587727 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-744bbaae-2856-4a0d-8668-a6cf5bba3e36 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:07:58.726373 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-744bbaae-2856-4a0d-8668-a6cf5bba3e36 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39ae90b08e14ad8a0e66643f63013b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960e6d7d52ec40ca82fefcfad3075776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:07:58.734333 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-744bbaae-2856-4a0d-8668-a6cf5bba3e36 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] 10.222.0.17 "GET /compute/v2.1/servers/4649f844-68c3-4baa-8ca2-7bee21c7915a" status: 200 len: 1314 microversion: 2.1 time: 0.162952 Jul 23 22:07:58.734918 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3260/5870] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:07:58 2022] GET /compute/v2.1/servers/4649f844-68c3-4baa-8ca2-7bee21c7915a => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:07:59.752354 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-800b5dc8-b314-41ef-bab3-560706d13966 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:07:59.753015 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-800b5dc8-b314-41ef-bab3-560706d13966 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] [instance: 4649f844-68c3-4baa-8ca2-7bee21c7915a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:07:59.755099 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:07:59.755886 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=8 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:07:59.762992 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-800b5dc8-b314-41ef-bab3-560706d13966 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:07:59.763457 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-800b5dc8-b314-41ef-bab3-560706d13966 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:07:59.764359 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-800b5dc8-b314-41ef-bab3-560706d13966 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:07:59.764807 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-800b5dc8-b314-41ef-bab3-560706d13966 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:07:59.785065 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:07:59.901853 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-800b5dc8-b314-41ef-bab3-560706d13966 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39ae90b08e14ad8a0e66643f63013b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960e6d7d52ec40ca82fefcfad3075776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:07:59.910408 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-800b5dc8-b314-41ef-bab3-560706d13966 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] 10.222.0.17 "GET /compute/v2.1/servers/4649f844-68c3-4baa-8ca2-7bee21c7915a" status: 200 len: 1500 microversion: 2.1 time: 0.162785 Jul 23 22:07:59.911030 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3261/5871] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:07:59 2022] GET /compute/v2.1/servers/4649f844-68c3-4baa-8ca2-7bee21c7915a => generated 1500 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:07:59.927250 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a3ee7b68-5b33-40e1-97c2-744ce3aa8e26 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:07:59.927865 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a3ee7b68-5b33-40e1-97c2-744ce3aa8e26 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] [instance: 4649f844-68c3-4baa-8ca2-7bee21c7915a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:07:59.934217 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a3ee7b68-5b33-40e1-97c2-744ce3aa8e26 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:07:59.934674 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a3ee7b68-5b33-40e1-97c2-744ce3aa8e26 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:07:59.935453 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a3ee7b68-5b33-40e1-97c2-744ce3aa8e26 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:07:59.935901 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a3ee7b68-5b33-40e1-97c2-744ce3aa8e26 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:08:00.074582 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a3ee7b68-5b33-40e1-97c2-744ce3aa8e26 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39ae90b08e14ad8a0e66643f63013b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960e6d7d52ec40ca82fefcfad3075776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:08:00.082883 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a3ee7b68-5b33-40e1-97c2-744ce3aa8e26 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] 10.222.0.17 "GET /compute/v2.1/servers/4649f844-68c3-4baa-8ca2-7bee21c7915a" status: 200 len: 1500 microversion: 2.1 time: 0.159700 Jul 23 22:08:00.083473 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3262/5872] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:07:59 2022] GET /compute/v2.1/servers/4649f844-68c3-4baa-8ca2-7bee21c7915a => generated 1500 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:08:00.106454 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-61021c22-e393-4858-b7d9-c734aa0b1cff tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:08:00.107164 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-61021c22-e393-4858-b7d9-c734aa0b1cff tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] [instance: 4649f844-68c3-4baa-8ca2-7bee21c7915a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:08:00.116168 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-61021c22-e393-4858-b7d9-c734aa0b1cff tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:08:00.116748 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-61021c22-e393-4858-b7d9-c734aa0b1cff tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:08:00.117834 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-61021c22-e393-4858-b7d9-c734aa0b1cff tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:08:00.118470 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-61021c22-e393-4858-b7d9-c734aa0b1cff tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:08:00.145166 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.objects.instance [None req-61021c22-e393-4858-b7d9-c734aa0b1cff tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lazy-loading 'flavor' on Instance uuid 4649f844-68c3-4baa-8ca2-7bee21c7915a {{(pid=131320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 22:08:00.221218 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-61021c22-e393-4858-b7d9-c734aa0b1cff tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] 10.222.0.17 "POST /compute/v2.1/servers/4649f844-68c3-4baa-8ca2-7bee21c7915a/action" status: 202 len: 0 microversion: 2.1 time: 0.124646 Jul 23 22:08:00.221975 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3263/5873] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 22:08:00 2022] POST /compute/v2.1/servers/4649f844-68c3-4baa-8ca2-7bee21c7915a/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 23 22:08:00.230610 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b8e42253-f59b-4254-b796-cc241c54ca51 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:08:00.231289 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b8e42253-f59b-4254-b796-cc241c54ca51 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] [instance: 4649f844-68c3-4baa-8ca2-7bee21c7915a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:08:00.237728 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b8e42253-f59b-4254-b796-cc241c54ca51 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:08:00.238212 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b8e42253-f59b-4254-b796-cc241c54ca51 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:08:00.238978 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b8e42253-f59b-4254-b796-cc241c54ca51 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:08:00.239416 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b8e42253-f59b-4254-b796-cc241c54ca51 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:08:00.370049 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b8e42253-f59b-4254-b796-cc241c54ca51 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39ae90b08e14ad8a0e66643f63013b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960e6d7d52ec40ca82fefcfad3075776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:08:00.377713 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b8e42253-f59b-4254-b796-cc241c54ca51 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] 10.222.0.17 "GET /compute/v2.1/servers/4649f844-68c3-4baa-8ca2-7bee21c7915a" status: 200 len: 1508 microversion: 2.1 time: 0.151126 Jul 23 22:08:00.378318 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3264/5874] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:08:00 2022] GET /compute/v2.1/servers/4649f844-68c3-4baa-8ca2-7bee21c7915a => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:08:01.395562 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a8fd80e2-df40-4748-9239-0c98f7737a51 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:08:01.396286 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a8fd80e2-df40-4748-9239-0c98f7737a51 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] [instance: 4649f844-68c3-4baa-8ca2-7bee21c7915a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:08:01.399208 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:08:01.404917 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a8fd80e2-df40-4748-9239-0c98f7737a51 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:08:01.405374 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a8fd80e2-df40-4748-9239-0c98f7737a51 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:08:01.406178 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a8fd80e2-df40-4748-9239-0c98f7737a51 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:08:01.406619 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a8fd80e2-df40-4748-9239-0c98f7737a51 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:08:01.543418 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a8fd80e2-df40-4748-9239-0c98f7737a51 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39ae90b08e14ad8a0e66643f63013b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960e6d7d52ec40ca82fefcfad3075776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:08:01.551729 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a8fd80e2-df40-4748-9239-0c98f7737a51 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] 10.222.0.17 "GET /compute/v2.1/servers/4649f844-68c3-4baa-8ca2-7bee21c7915a" status: 200 len: 1491 microversion: 2.1 time: 0.160284 Jul 23 22:08:01.552302 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3265/5875] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:08:01 2022] GET /compute/v2.1/servers/4649f844-68c3-4baa-8ca2-7bee21c7915a => generated 1491 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:08:01.568373 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-aa97cf1a-7560-4991-96da-db5b5d21b498 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:08:01.568901 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-aa97cf1a-7560-4991-96da-db5b5d21b498 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] [instance: 4649f844-68c3-4baa-8ca2-7bee21c7915a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:08:01.574945 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-aa97cf1a-7560-4991-96da-db5b5d21b498 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:08:01.575403 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-aa97cf1a-7560-4991-96da-db5b5d21b498 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:08:01.576171 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-aa97cf1a-7560-4991-96da-db5b5d21b498 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:08:01.576616 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-aa97cf1a-7560-4991-96da-db5b5d21b498 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:08:01.644079 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-aa97cf1a-7560-4991-96da-db5b5d21b498 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] 10.222.0.17 "POST /compute/v2.1/servers/4649f844-68c3-4baa-8ca2-7bee21c7915a/action" status: 202 len: 0 microversion: 2.1 time: 0.079169 Jul 23 22:08:01.644926 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3266/5876] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 22:08:01 2022] POST /compute/v2.1/servers/4649f844-68c3-4baa-8ca2-7bee21c7915a/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 22:08:01.654065 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1097ea52-987f-41cb-9d81-29d216f8292b tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:08:01.655221 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1097ea52-987f-41cb-9d81-29d216f8292b tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] [instance: 4649f844-68c3-4baa-8ca2-7bee21c7915a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:08:01.665421 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1097ea52-987f-41cb-9d81-29d216f8292b tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:08:01.665915 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1097ea52-987f-41cb-9d81-29d216f8292b tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:08:01.666728 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1097ea52-987f-41cb-9d81-29d216f8292b tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:08:01.667170 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1097ea52-987f-41cb-9d81-29d216f8292b tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:08:01.806150 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-1097ea52-987f-41cb-9d81-29d216f8292b tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39ae90b08e14ad8a0e66643f63013b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960e6d7d52ec40ca82fefcfad3075776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:08:01.814047 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1097ea52-987f-41cb-9d81-29d216f8292b tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] 10.222.0.17 "GET /compute/v2.1/servers/4649f844-68c3-4baa-8ca2-7bee21c7915a" status: 200 len: 1497 microversion: 2.1 time: 0.164732 Jul 23 22:08:01.814883 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3267/5877] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:08:01 2022] GET /compute/v2.1/servers/4649f844-68c3-4baa-8ca2-7bee21c7915a => generated 1497 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:08:02.832071 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ec669a39-1318-41db-bb47-87181a0b14b6 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:08:02.832771 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ec669a39-1318-41db-bb47-87181a0b14b6 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] [instance: 4649f844-68c3-4baa-8ca2-7bee21c7915a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:08:02.840286 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ec669a39-1318-41db-bb47-87181a0b14b6 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:08:02.841104 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ec669a39-1318-41db-bb47-87181a0b14b6 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:08:02.841910 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ec669a39-1318-41db-bb47-87181a0b14b6 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:08:02.842369 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ec669a39-1318-41db-bb47-87181a0b14b6 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:08:02.974190 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ec669a39-1318-41db-bb47-87181a0b14b6 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39ae90b08e14ad8a0e66643f63013b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960e6d7d52ec40ca82fefcfad3075776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:08:02.982617 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ec669a39-1318-41db-bb47-87181a0b14b6 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] 10.222.0.17 "GET /compute/v2.1/servers/4649f844-68c3-4baa-8ca2-7bee21c7915a" status: 200 len: 1500 microversion: 2.1 time: 0.154613 Jul 23 22:08:02.983183 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3268/5878] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:08:02 2022] GET /compute/v2.1/servers/4649f844-68c3-4baa-8ca2-7bee21c7915a => generated 1500 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:08:02.999389 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0edce36b-de53-46ad-a211-5ab68309f80c tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:08:03.000652 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-0edce36b-de53-46ad-a211-5ab68309f80c tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] [instance: 4649f844-68c3-4baa-8ca2-7bee21c7915a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:08:03.010484 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0edce36b-de53-46ad-a211-5ab68309f80c tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:08:03.010937 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0edce36b-de53-46ad-a211-5ab68309f80c tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:08:03.011728 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0edce36b-de53-46ad-a211-5ab68309f80c tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:08:03.012163 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0edce36b-de53-46ad-a211-5ab68309f80c tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:08:03.037980 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.objects.instance [None req-0edce36b-de53-46ad-a211-5ab68309f80c tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lazy-loading 'flavor' on Instance uuid 4649f844-68c3-4baa-8ca2-7bee21c7915a {{(pid=131320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 22:08:03.108130 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-0edce36b-de53-46ad-a211-5ab68309f80c tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] 10.222.0.17 "POST /compute/v2.1/servers/4649f844-68c3-4baa-8ca2-7bee21c7915a/action" status: 202 len: 0 microversion: 2.1 time: 0.112221 Jul 23 22:08:03.108685 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3269/5879] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 22:08:02 2022] POST /compute/v2.1/servers/4649f844-68c3-4baa-8ca2-7bee21c7915a/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 22:08:03.117343 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e2a8d63b-6ad4-4db7-95db-59a08e9ac0fa tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:08:03.118085 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e2a8d63b-6ad4-4db7-95db-59a08e9ac0fa tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] [instance: 4649f844-68c3-4baa-8ca2-7bee21c7915a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:08:03.124665 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e2a8d63b-6ad4-4db7-95db-59a08e9ac0fa tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:08:03.125222 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e2a8d63b-6ad4-4db7-95db-59a08e9ac0fa tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:08:03.126068 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e2a8d63b-6ad4-4db7-95db-59a08e9ac0fa tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:08:03.126656 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e2a8d63b-6ad4-4db7-95db-59a08e9ac0fa tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:08:03.272964 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e2a8d63b-6ad4-4db7-95db-59a08e9ac0fa tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39ae90b08e14ad8a0e66643f63013b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960e6d7d52ec40ca82fefcfad3075776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:08:03.280814 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e2a8d63b-6ad4-4db7-95db-59a08e9ac0fa tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] 10.222.0.17 "GET /compute/v2.1/servers/4649f844-68c3-4baa-8ca2-7bee21c7915a" status: 200 len: 1508 microversion: 2.1 time: 0.167577 Jul 23 22:08:03.281399 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3270/5880] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:08:03 2022] GET /compute/v2.1/servers/4649f844-68c3-4baa-8ca2-7bee21c7915a => generated 1508 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:08:04.305762 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-08607c45-e1ed-4e29-9459-e8e7c908cc4d tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:08:04.306691 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-08607c45-e1ed-4e29-9459-e8e7c908cc4d tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] [instance: 4649f844-68c3-4baa-8ca2-7bee21c7915a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:08:04.316366 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-08607c45-e1ed-4e29-9459-e8e7c908cc4d tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:08:04.316908 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-08607c45-e1ed-4e29-9459-e8e7c908cc4d tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:08:04.317983 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-08607c45-e1ed-4e29-9459-e8e7c908cc4d tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:08:04.318597 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-08607c45-e1ed-4e29-9459-e8e7c908cc4d tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:08:04.453457 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-08607c45-e1ed-4e29-9459-e8e7c908cc4d tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39ae90b08e14ad8a0e66643f63013b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960e6d7d52ec40ca82fefcfad3075776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:08:04.461971 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-08607c45-e1ed-4e29-9459-e8e7c908cc4d tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] 10.222.0.17 "GET /compute/v2.1/servers/4649f844-68c3-4baa-8ca2-7bee21c7915a" status: 200 len: 1491 microversion: 2.1 time: 0.160962 Jul 23 22:08:04.462516 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3271/5881] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:08:04 2022] GET /compute/v2.1/servers/4649f844-68c3-4baa-8ca2-7bee21c7915a => generated 1491 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:08:04.478366 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0d349b22-659b-459e-b4ca-e7eb331991e4 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:08:04.478932 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-0d349b22-659b-459e-b4ca-e7eb331991e4 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] [instance: 4649f844-68c3-4baa-8ca2-7bee21c7915a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:08:04.485029 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0d349b22-659b-459e-b4ca-e7eb331991e4 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:08:04.485480 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0d349b22-659b-459e-b4ca-e7eb331991e4 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:08:04.486292 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0d349b22-659b-459e-b4ca-e7eb331991e4 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:08:04.486725 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0d349b22-659b-459e-b4ca-e7eb331991e4 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:08:04.545898 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:08:04.557310 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-0d349b22-659b-459e-b4ca-e7eb331991e4 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] 10.222.0.17 "POST /compute/v2.1/servers/4649f844-68c3-4baa-8ca2-7bee21c7915a/action" status: 202 len: 0 microversion: 2.1 time: 0.082333 Jul 23 22:08:04.557899 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3272/5882] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 22:08:04 2022] POST /compute/v2.1/servers/4649f844-68c3-4baa-8ca2-7bee21c7915a/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 22:08:04.567586 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5e6e13f9-81ab-4af8-90cf-4871af7262a6 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:08:04.568297 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5e6e13f9-81ab-4af8-90cf-4871af7262a6 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] [instance: 4649f844-68c3-4baa-8ca2-7bee21c7915a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:08:04.574982 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5e6e13f9-81ab-4af8-90cf-4871af7262a6 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:08:04.575446 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5e6e13f9-81ab-4af8-90cf-4871af7262a6 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:08:04.576229 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5e6e13f9-81ab-4af8-90cf-4871af7262a6 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:08:04.576676 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5e6e13f9-81ab-4af8-90cf-4871af7262a6 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:08:04.717501 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5e6e13f9-81ab-4af8-90cf-4871af7262a6 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39ae90b08e14ad8a0e66643f63013b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960e6d7d52ec40ca82fefcfad3075776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:08:04.725487 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5e6e13f9-81ab-4af8-90cf-4871af7262a6 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] 10.222.0.17 "GET /compute/v2.1/servers/4649f844-68c3-4baa-8ca2-7bee21c7915a" status: 200 len: 1497 microversion: 2.1 time: 0.162498 Jul 23 22:08:04.726138 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3273/5883] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:08:04 2022] GET /compute/v2.1/servers/4649f844-68c3-4baa-8ca2-7bee21c7915a => generated 1497 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:08:05.743183 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9d4fddc8-f85a-4112-aa61-1af791299f2a tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:08:05.744216 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-9d4fddc8-f85a-4112-aa61-1af791299f2a tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] [instance: 4649f844-68c3-4baa-8ca2-7bee21c7915a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:08:05.752001 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9d4fddc8-f85a-4112-aa61-1af791299f2a tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:08:05.752446 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9d4fddc8-f85a-4112-aa61-1af791299f2a tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:08:05.753321 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9d4fddc8-f85a-4112-aa61-1af791299f2a tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:08:05.753767 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9d4fddc8-f85a-4112-aa61-1af791299f2a tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:08:05.888769 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-9d4fddc8-f85a-4112-aa61-1af791299f2a tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39ae90b08e14ad8a0e66643f63013b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960e6d7d52ec40ca82fefcfad3075776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:08:05.896824 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9d4fddc8-f85a-4112-aa61-1af791299f2a tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] 10.222.0.17 "GET /compute/v2.1/servers/4649f844-68c3-4baa-8ca2-7bee21c7915a" status: 200 len: 1500 microversion: 2.1 time: 0.157582 Jul 23 22:08:05.897420 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3274/5884] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:08:05 2022] GET /compute/v2.1/servers/4649f844-68c3-4baa-8ca2-7bee21c7915a => generated 1500 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:08:05.913450 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d3b1a0dd-1bb8-4b84-b882-8e27b660f525 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:08:05.913987 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d3b1a0dd-1bb8-4b84-b882-8e27b660f525 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] [instance: 4649f844-68c3-4baa-8ca2-7bee21c7915a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:08:05.920504 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d3b1a0dd-1bb8-4b84-b882-8e27b660f525 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:08:05.920971 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d3b1a0dd-1bb8-4b84-b882-8e27b660f525 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:08:05.921754 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d3b1a0dd-1bb8-4b84-b882-8e27b660f525 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:08:05.922288 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d3b1a0dd-1bb8-4b84-b882-8e27b660f525 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:08:05.947942 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d3b1a0dd-1bb8-4b84-b882-8e27b660f525 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] [instance: 4649f844-68c3-4baa-8ca2-7bee21c7915a] Going to try to terminate instance {{(pid=131320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 22:08:06.035971 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d3b1a0dd-1bb8-4b84-b882-8e27b660f525 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] 10.222.0.17 "DELETE /compute/v2.1/servers/4649f844-68c3-4baa-8ca2-7bee21c7915a" status: 204 len: 0 microversion: 2.1 time: 0.126187 Jul 23 22:08:06.036553 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3275/5885] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 22:08:05 2022] DELETE /compute/v2.1/servers/4649f844-68c3-4baa-8ca2-7bee21c7915a => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 23 22:08:06.045235 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-afc903a7-db08-4a9b-b618-25df988118be tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:08:06.045993 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-afc903a7-db08-4a9b-b618-25df988118be tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] [instance: 4649f844-68c3-4baa-8ca2-7bee21c7915a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:08:06.052551 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-afc903a7-db08-4a9b-b618-25df988118be tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:08:06.052976 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-afc903a7-db08-4a9b-b618-25df988118be tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:08:06.053759 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-afc903a7-db08-4a9b-b618-25df988118be tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:08:06.054270 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-afc903a7-db08-4a9b-b618-25df988118be tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:08:06.192153 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-afc903a7-db08-4a9b-b618-25df988118be tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39ae90b08e14ad8a0e66643f63013b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960e6d7d52ec40ca82fefcfad3075776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:08:06.199986 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-afc903a7-db08-4a9b-b618-25df988118be tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] 10.222.0.17 "GET /compute/v2.1/servers/4649f844-68c3-4baa-8ca2-7bee21c7915a" status: 200 len: 1506 microversion: 2.1 time: 0.158822 Jul 23 22:08:06.200567 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3276/5886] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:08:06 2022] GET /compute/v2.1/servers/4649f844-68c3-4baa-8ca2-7bee21c7915a => generated 1506 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:08:07.228324 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4c9382a9-6caa-4a0b-82ab-d84a39de388b tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:08:07.229358 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-4c9382a9-6caa-4a0b-82ab-d84a39de388b tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] [instance: 4649f844-68c3-4baa-8ca2-7bee21c7915a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:08:07.239796 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4c9382a9-6caa-4a0b-82ab-d84a39de388b tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:08:07.240238 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4c9382a9-6caa-4a0b-82ab-d84a39de388b tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:08:07.241008 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4c9382a9-6caa-4a0b-82ab-d84a39de388b tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:08:07.241447 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4c9382a9-6caa-4a0b-82ab-d84a39de388b tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:08:07.374797 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-4c9382a9-6caa-4a0b-82ab-d84a39de388b tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39ae90b08e14ad8a0e66643f63013b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960e6d7d52ec40ca82fefcfad3075776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:08:07.382478 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4c9382a9-6caa-4a0b-82ab-d84a39de388b tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] 10.222.0.17 "GET /compute/v2.1/servers/4649f844-68c3-4baa-8ca2-7bee21c7915a" status: 200 len: 1506 microversion: 2.1 time: 0.161230 Jul 23 22:08:07.383055 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3277/5887] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:08:07 2022] GET /compute/v2.1/servers/4649f844-68c3-4baa-8ca2-7bee21c7915a => generated 1506 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:08:08.251257 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-5671ad6a-e56f-43e2-8ea6-9545fad13e10 req-e2661e83-b903-41f3-86bd-60ca70985111 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4649f844-68c3-4baa-8ca2-7bee21c7915a", "name": "network-vif-deleted", "tag": "f4764e34-523b-418e-9515-0b511e2ac7f7"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:08:08.260740 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-5671ad6a-e56f-43e2-8ea6-9545fad13e10 req-e2661e83-b903-41f3-86bd-60ca70985111 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:08:08.261175 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-5671ad6a-e56f-43e2-8ea6-9545fad13e10 req-e2661e83-b903-41f3-86bd-60ca70985111 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:08:08.273511 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-5671ad6a-e56f-43e2-8ea6-9545fad13e10 req-e2661e83-b903-41f3-86bd-60ca70985111 service nova] Creating event network-vif-deleted:f4764e34-523b-418e-9515-0b511e2ac7f7 for instance 4649f844-68c3-4baa-8ca2-7bee21c7915a on nch2-master-1 Jul 23 22:08:08.278597 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-5671ad6a-e56f-43e2-8ea6-9545fad13e10 req-e2661e83-b903-41f3-86bd-60ca70985111 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030787 Jul 23 22:08:08.279215 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3278/5888] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:08:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:08:08.401427 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d730644c-9f35-40ee-a506-937277c9fd2b tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:08:08.402282 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d730644c-9f35-40ee-a506-937277c9fd2b tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] [instance: 4649f844-68c3-4baa-8ca2-7bee21c7915a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:08:08.409268 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d730644c-9f35-40ee-a506-937277c9fd2b tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:08:08.409653 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d730644c-9f35-40ee-a506-937277c9fd2b tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:08:08.410579 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d730644c-9f35-40ee-a506-937277c9fd2b tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:08:08.411021 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d730644c-9f35-40ee-a506-937277c9fd2b tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:08:08.443446 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d730644c-9f35-40ee-a506-937277c9fd2b tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:08:08.443900 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d730644c-9f35-40ee-a506-937277c9fd2b tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:08:08.444361 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.objects.instance [None req-d730644c-9f35-40ee-a506-937277c9fd2b tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lazy-loading 'fault' on Instance uuid 4649f844-68c3-4baa-8ca2-7bee21c7915a {{(pid=131320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 22:08:08.486916 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d730644c-9f35-40ee-a506-937277c9fd2b tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39ae90b08e14ad8a0e66643f63013b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960e6d7d52ec40ca82fefcfad3075776', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:08:08.494959 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d730644c-9f35-40ee-a506-937277c9fd2b tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] 10.222.0.17 "GET /compute/v2.1/servers/4649f844-68c3-4baa-8ca2-7bee21c7915a" status: 200 len: 1304 microversion: 2.1 time: 0.098225 Jul 23 22:08:08.495553 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3279/5889] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:08:08 2022] GET /compute/v2.1/servers/4649f844-68c3-4baa-8ca2-7bee21c7915a => generated 1304 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:08:09.515827 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-07aa1208-cdfc-4a44-8bcd-d8e41cfc5484 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:08:09.516944 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-07aa1208-cdfc-4a44-8bcd-d8e41cfc5484 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] [instance: 4649f844-68c3-4baa-8ca2-7bee21c7915a] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:08:09.525633 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-07aa1208-cdfc-4a44-8bcd-d8e41cfc5484 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:08:09.526123 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-07aa1208-cdfc-4a44-8bcd-d8e41cfc5484 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:08:09.526926 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-07aa1208-cdfc-4a44-8bcd-d8e41cfc5484 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:08:09.527366 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-07aa1208-cdfc-4a44-8bcd-d8e41cfc5484 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:08:09.541043 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-07aa1208-cdfc-4a44-8bcd-d8e41cfc5484 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] HTTP exception thrown: Instance 4649f844-68c3-4baa-8ca2-7bee21c7915a could not be found. Jul 23 22:08:09.542729 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-07aa1208-cdfc-4a44-8bcd-d8e41cfc5484 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Request method failure captured: Jul 23 22:08:09.542729 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/4649f844-68c3-4baa-8ca2-7bee21c7915a HTTP/1.1 Jul 23 22:08:09.542729 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 22:08:09.542729 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 22:08:09.542729 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 22:08:09.542729 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 22:08:09.542729 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 22:08:09.542729 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 22:08:09.542729 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 22:08:09.542729 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 22:08:09.542729 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3HEzI5O9jIl5lhs-NG89HoITV4tkBACgaIaoPML76lB0BxE6NQEKM9GlUdk1QWlD1sv_QDzSeKWdqxJ06nVkTP4TboFKFNn_ThYWsNu0_QTm1NrWZDcopjbPnrgoFmsDeI8j6nViOCrteQLn1YjEd-pXUEZWlBM3JHdZ25LPAnVCeQ4 Jul 23 22:08:09.542729 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 22:08:09.542729 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 22:08:09.542729 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 22:08:09.542729 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 22:08:09.542729 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 22:08:09.542729 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 22:08:09.542729 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 960e6d7d52ec40ca82fefcfad3075776 Jul 23 22:08:09.542729 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-TestServerAdvancedOps-2055764870 Jul 23 22:08:09.542729 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 22:08:09.542729 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 22:08:09.542729 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/960e6d7d52ec40ca82fefcfad3075776"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/960e6d7d52ec40ca82fefcfad3075776"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_960e6d7d52ec40ca82fefcfad3075776", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/960e6d7d52ec40ca82fefcfad3075776"}]}] Jul 23 22:08:09.542729 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-TestServerAdvancedOps-2055764870 Jul 23 22:08:09.542729 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 960e6d7d52ec40ca82fefcfad3075776 Jul 23 22:08:09.542729 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-TestServerAdvancedOps-2055764870 Jul 23 22:08:09.542729 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-TestServerAdvancedOps-2055764870-project Jul 23 22:08:09.542729 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 22:08:09.542729 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 22:08:09.542729 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: c39ae90b08e14ad8a0e66643f63013b4 Jul 23 22:08:09.542729 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-TestServerAdvancedOps-2055764870-project Jul 23 22:08:09.542729 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 22:08:09.542729 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance 4649f844-68c3-4baa-8ca2-7bee21c7915a could not be found. Jul 23 22:08:09.542729 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '4649f844-68c3-4baa-8ca2-7bee21c7915a'} Jul 23 22:08:09.542729 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 22:08:09.542729 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:08:09.542729 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 22:08:09.542729 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 22:08:09.542729 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 22:08:09.542729 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 22:08:09.542729 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 22:08:09.542729 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 22:08:09.542729 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 22:08:09.542729 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 22:08:09.542729 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4649f844-68c3-4baa-8ca2-7bee21c7915a could not be found. Jul 23 22:08:09.542729 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:08:09.542729 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:08:09.542729 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:08:09.542729 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:08:09.542729 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:08:09.542729 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:08:09.542729 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 22:08:09.542729 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 22:08:09.542729 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 22:08:09.542729 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 22:08:09.542729 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 22:08:09.542729 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 22:08:09.542729 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 22:08:09.542729 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 22:08:09.542729 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 22:08:09.542729 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 22:08:09.542729 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4649f844-68c3-4baa-8ca2-7bee21c7915a could not be found. Jul 23 22:08:09.542729 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:08:09.542729 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:08:09.542729 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:08:09.548478 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:08:09.548478 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:08:09.548478 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:08:09.548478 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 22:08:09.548478 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 22:08:09.548478 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4649f844-68c3-4baa-8ca2-7bee21c7915a could not be found. Jul 23 22:08:09.548478 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:08:09.548478 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-07aa1208-cdfc-4a44-8bcd-d8e41cfc5484 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] Returning 404 to user: Instance 4649f844-68c3-4baa-8ca2-7bee21c7915a could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 22:08:09.548478 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-07aa1208-cdfc-4a44-8bcd-d8e41cfc5484 tempest-TestServerAdvancedOps-2055764870 tempest-TestServerAdvancedOps-2055764870-project] 10.222.0.17 "GET /compute/v2.1/servers/4649f844-68c3-4baa-8ca2-7bee21c7915a" status: 404 len: 111 microversion: 2.1 time: 0.035391 Jul 23 22:08:09.548478 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3280/5890] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:08:09 2022] GET /compute/v2.1/servers/4649f844-68c3-4baa-8ca2-7bee21c7915a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 23 22:08:24.857678 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-fc662d0d-71d9-4a29-b481-b138272df581 tempest-TestVolumeBootPattern-1199428530 tempest-TestVolumeBootPattern-1199428530-project] Action: 'create', calling method: .version_select at 0x7f0b47e7d820>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1921948872", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFF8jUPTg2N4aWnwS8Q2qoN66anTu+1TLOimQSyfRM1A5wG8SuGianaB6BGZB+SA97dynF7ZxccXQZ3KJoVBsnsaxORMBfTbR07RsIPFQ3/D6r5O/rFPV0BI9ySmjuS6Ug=="}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:08:24.863804 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:08:24.864830 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:08:24.886274 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-fc662d0d-71d9-4a29-b481-b138272df581 tempest-TestVolumeBootPattern-1199428530 tempest-TestVolumeBootPattern-1199428530-project] Getting quotas for project 2c90e4831ffd42c9b0fc070521d8277e. Resources: {'key_pairs'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 22:08:24.894707 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-fc662d0d-71d9-4a29-b481-b138272df581 tempest-TestVolumeBootPattern-1199428530 tempest-TestVolumeBootPattern-1199428530-project] Getting quotas for user 8f94ed62a87a484b989f98f823ecd61f and project 2c90e4831ffd42c9b0fc070521d8277e. Resources: {'key_pairs'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 22:08:24.921963 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-fc662d0d-71d9-4a29-b481-b138272df581 tempest-TestVolumeBootPattern-1199428530 tempest-TestVolumeBootPattern-1199428530-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.072867 Jul 23 22:08:24.922722 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3281/5891] 10.222.0.17 () {60 vars in 1158 bytes} [Sat Jul 23 22:08:24 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 22:08:27.981325 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-fc5abf2a-b8d9-4e2f-9b7d-d6615ac70ab4 tempest-TestVolumeBootPattern-1199428530 tempest-TestVolumeBootPattern-1199428530-project] Calling method '.version_select at 0x7f0b46463b80>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:08:28.001716 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-fc5abf2a-b8d9-4e2f-9b7d-d6615ac70ab4 tempest-TestVolumeBootPattern-1199428530 tempest-TestVolumeBootPattern-1199428530-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1921948872" status: 202 len: 0 microversion: 2.1 time: 0.025186 Jul 23 22:08:28.002686 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3282/5892] 10.222.0.17 () {58 vars in 1262 bytes} [Sat Jul 23 22:08:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1921948872 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 23 22:08:46.153231 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=4 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:08:46.154151 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=14,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:08:46.274878 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-439b0479-4939-40b6-ba6b-3a2e98570987 tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-3484044", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:08:46.324038 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-439b0479-4939-40b6-ba6b-3a2e98570987 tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] validate_networks() for None {{(pid=131320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 22:08:46.943164 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-439b0479-4939-40b6-ba6b-3a2e98570987 tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 22:08:46.943593 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-439b0479-4939-40b6-ba6b-3a2e98570987 tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 22:08:46.944073 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-439b0479-4939-40b6-ba6b-3a2e98570987 tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 22:08:46.944478 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-439b0479-4939-40b6-ba6b-3a2e98570987 tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 22:08:46.944983 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-439b0479-4939-40b6-ba6b-3a2e98570987 tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 22:08:46.954496 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-439b0479-4939-40b6-ba6b-3a2e98570987 tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:08:46.954972 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-439b0479-4939-40b6-ba6b-3a2e98570987 tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:08:46.955768 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-439b0479-4939-40b6-ba6b-3a2e98570987 tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:08:46.956197 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-439b0479-4939-40b6-ba6b-3a2e98570987 tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:08:46.974236 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-439b0479-4939-40b6-ba6b-3a2e98570987 tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] Getting quotas for project 43fd816b6f2f40fd8255b789bc0bcb4f. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 22:08:46.979945 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-439b0479-4939-40b6-ba6b-3a2e98570987 tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] Getting quotas for user 4f2d11138f934d9c964d3a68bcba60cc and project 43fd816b6f2f40fd8255b789bc0bcb4f. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 22:08:46.992997 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-439b0479-4939-40b6-ba6b-3a2e98570987 tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] Going to run 1 instances... {{(pid=131320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 22:08:46.995299 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-439b0479-4939-40b6-ba6b-3a2e98570987 tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] [instance: f169ecaa-b406-4dd2-a282-f66ea6de4ab4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 22:08:47.047483 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-439b0479-4939-40b6-ba6b-3a2e98570987 tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.896028 Jul 23 22:08:47.048153 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3283/5893] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 22:08:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 897 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 23 22:08:47.058563 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6d540f74-14d5-4ae2-a280-51afa84d3f44 tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:08:47.059174 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6d540f74-14d5-4ae2-a280-51afa84d3f44 tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] [instance: f169ecaa-b406-4dd2-a282-f66ea6de4ab4] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:08:47.118410 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6d540f74-14d5-4ae2-a280-51afa84d3f44 tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f2d11138f934d9c964d3a68bcba60cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43fd816b6f2f40fd8255b789bc0bcb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:08:47.126115 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6d540f74-14d5-4ae2-a280-51afa84d3f44 tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] 10.222.0.17 "GET /compute/v2.1/servers/f169ecaa-b406-4dd2-a282-f66ea6de4ab4" status: 200 len: 1219 microversion: 2.1 time: 0.071171 Jul 23 22:08:47.126694 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3284/5894] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:08:47 2022] GET /compute/v2.1/servers/f169ecaa-b406-4dd2-a282-f66ea6de4ab4 => generated 1219 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:08:48.149240 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-aef65902-7f63-4b71-96ec-ce5389aee66d tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:08:48.150497 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-aef65902-7f63-4b71-96ec-ce5389aee66d tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] [instance: f169ecaa-b406-4dd2-a282-f66ea6de4ab4] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:08:48.163945 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-aef65902-7f63-4b71-96ec-ce5389aee66d tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:08:48.165113 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-aef65902-7f63-4b71-96ec-ce5389aee66d tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:08:48.166594 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-aef65902-7f63-4b71-96ec-ce5389aee66d tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:08:48.167226 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-aef65902-7f63-4b71-96ec-ce5389aee66d tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:08:48.258587 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-aef65902-7f63-4b71-96ec-ce5389aee66d tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f2d11138f934d9c964d3a68bcba60cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43fd816b6f2f40fd8255b789bc0bcb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:08:48.266779 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-aef65902-7f63-4b71-96ec-ce5389aee66d tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] 10.222.0.17 "GET /compute/v2.1/servers/f169ecaa-b406-4dd2-a282-f66ea6de4ab4" status: 200 len: 1279 microversion: 2.1 time: 0.125324 Jul 23 22:08:48.267374 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3285/5895] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:08:48 2022] GET /compute/v2.1/servers/f169ecaa-b406-4dd2-a282-f66ea6de4ab4 => generated 1279 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:08:49.286187 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4fbd10c6-e063-4a52-8f58-6a054a62f62f tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:08:49.287047 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-4fbd10c6-e063-4a52-8f58-6a054a62f62f tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] [instance: f169ecaa-b406-4dd2-a282-f66ea6de4ab4] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:08:49.294396 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4fbd10c6-e063-4a52-8f58-6a054a62f62f tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:08:49.294881 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4fbd10c6-e063-4a52-8f58-6a054a62f62f tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:08:49.296643 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4fbd10c6-e063-4a52-8f58-6a054a62f62f tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:08:49.297273 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4fbd10c6-e063-4a52-8f58-6a054a62f62f tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:08:49.437705 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-4fbd10c6-e063-4a52-8f58-6a054a62f62f tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f2d11138f934d9c964d3a68bcba60cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43fd816b6f2f40fd8255b789bc0bcb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:08:49.445454 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4fbd10c6-e063-4a52-8f58-6a054a62f62f tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] 10.222.0.17 "GET /compute/v2.1/servers/f169ecaa-b406-4dd2-a282-f66ea6de4ab4" status: 200 len: 1319 microversion: 2.1 time: 0.164665 Jul 23 22:08:49.446463 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3286/5896] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:08:49 2022] GET /compute/v2.1/servers/f169ecaa-b406-4dd2-a282-f66ea6de4ab4 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:08:49.861555 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-1d787d11-8c96-4368-8b35-585735b53e4e req-1a3f9f4f-c87c-4839-bb49-be7492cb93e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f169ecaa-b406-4dd2-a282-f66ea6de4ab4", "tag": "51cd6c1e-8b73-497c-bc76-1b4988ec189d"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:08:49.872147 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-1d787d11-8c96-4368-8b35-585735b53e4e req-1a3f9f4f-c87c-4839-bb49-be7492cb93e8 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:08:49.872573 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-1d787d11-8c96-4368-8b35-585735b53e4e req-1a3f9f4f-c87c-4839-bb49-be7492cb93e8 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:08:49.896090 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-1d787d11-8c96-4368-8b35-585735b53e4e req-1a3f9f4f-c87c-4839-bb49-be7492cb93e8 service nova] Creating event network-changed:51cd6c1e-8b73-497c-bc76-1b4988ec189d for instance f169ecaa-b406-4dd2-a282-f66ea6de4ab4 on nch2-master-1 Jul 23 22:08:49.904912 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-1d787d11-8c96-4368-8b35-585735b53e4e req-1a3f9f4f-c87c-4839-bb49-be7492cb93e8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046128 Jul 23 22:08:49.905538 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3287/5897] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:08:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:08:50.468016 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ff66b1d2-e622-4e4b-b7a9-c8e7da1ea237 tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:08:50.468688 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ff66b1d2-e622-4e4b-b7a9-c8e7da1ea237 tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] [instance: f169ecaa-b406-4dd2-a282-f66ea6de4ab4] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:08:50.477450 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ff66b1d2-e622-4e4b-b7a9-c8e7da1ea237 tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:08:50.478239 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ff66b1d2-e622-4e4b-b7a9-c8e7da1ea237 tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:08:50.479529 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ff66b1d2-e622-4e4b-b7a9-c8e7da1ea237 tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:08:50.480258 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ff66b1d2-e622-4e4b-b7a9-c8e7da1ea237 tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:08:50.626154 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ff66b1d2-e622-4e4b-b7a9-c8e7da1ea237 tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f2d11138f934d9c964d3a68bcba60cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43fd816b6f2f40fd8255b789bc0bcb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:08:50.634180 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ff66b1d2-e622-4e4b-b7a9-c8e7da1ea237 tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] 10.222.0.17 "GET /compute/v2.1/servers/f169ecaa-b406-4dd2-a282-f66ea6de4ab4" status: 200 len: 1319 microversion: 2.1 time: 0.174384 Jul 23 22:08:50.634761 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3288/5898] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:08:50 2022] GET /compute/v2.1/servers/f169ecaa-b406-4dd2-a282-f66ea6de4ab4 => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:08:51.654922 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d1d93a11-8592-4868-8831-14c0faa15915 tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:08:51.655961 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d1d93a11-8592-4868-8831-14c0faa15915 tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] [instance: f169ecaa-b406-4dd2-a282-f66ea6de4ab4] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:08:51.667639 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d1d93a11-8592-4868-8831-14c0faa15915 tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:08:51.668405 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d1d93a11-8592-4868-8831-14c0faa15915 tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:08:51.669727 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d1d93a11-8592-4868-8831-14c0faa15915 tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:08:51.670542 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d1d93a11-8592-4868-8831-14c0faa15915 tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:08:51.808081 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d1d93a11-8592-4868-8831-14c0faa15915 tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f2d11138f934d9c964d3a68bcba60cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43fd816b6f2f40fd8255b789bc0bcb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:08:51.816099 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d1d93a11-8592-4868-8831-14c0faa15915 tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] 10.222.0.17 "GET /compute/v2.1/servers/f169ecaa-b406-4dd2-a282-f66ea6de4ab4" status: 200 len: 1319 microversion: 2.1 time: 0.167747 Jul 23 22:08:51.816834 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3289/5899] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:08:51 2022] GET /compute/v2.1/servers/f169ecaa-b406-4dd2-a282-f66ea6de4ab4 => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:08:52.837458 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f380ad3d-915d-4530-9afd-4ba75516fbb4 tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:08:52.838734 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f380ad3d-915d-4530-9afd-4ba75516fbb4 tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] [instance: f169ecaa-b406-4dd2-a282-f66ea6de4ab4] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:08:52.849477 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f380ad3d-915d-4530-9afd-4ba75516fbb4 tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:08:52.849963 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f380ad3d-915d-4530-9afd-4ba75516fbb4 tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:08:52.850741 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f380ad3d-915d-4530-9afd-4ba75516fbb4 tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:08:52.851183 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f380ad3d-915d-4530-9afd-4ba75516fbb4 tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:08:52.991587 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f380ad3d-915d-4530-9afd-4ba75516fbb4 tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f2d11138f934d9c964d3a68bcba60cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43fd816b6f2f40fd8255b789bc0bcb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:08:52.999169 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f380ad3d-915d-4530-9afd-4ba75516fbb4 tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] 10.222.0.17 "GET /compute/v2.1/servers/f169ecaa-b406-4dd2-a282-f66ea6de4ab4" status: 200 len: 1319 microversion: 2.1 time: 0.168881 Jul 23 22:08:52.999745 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3290/5900] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:08:52 2022] GET /compute/v2.1/servers/f169ecaa-b406-4dd2-a282-f66ea6de4ab4 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:08:54.020436 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-02c60852-f723-48f0-9ed9-89cd9a9ff6f1 tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:08:54.021378 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-02c60852-f723-48f0-9ed9-89cd9a9ff6f1 tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] [instance: f169ecaa-b406-4dd2-a282-f66ea6de4ab4] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:08:54.033413 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-02c60852-f723-48f0-9ed9-89cd9a9ff6f1 tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:08:54.034247 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-02c60852-f723-48f0-9ed9-89cd9a9ff6f1 tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:08:54.035559 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-02c60852-f723-48f0-9ed9-89cd9a9ff6f1 tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:08:54.036416 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-02c60852-f723-48f0-9ed9-89cd9a9ff6f1 tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:08:54.178993 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-02c60852-f723-48f0-9ed9-89cd9a9ff6f1 tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f2d11138f934d9c964d3a68bcba60cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43fd816b6f2f40fd8255b789bc0bcb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:08:54.186793 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-02c60852-f723-48f0-9ed9-89cd9a9ff6f1 tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] 10.222.0.17 "GET /compute/v2.1/servers/f169ecaa-b406-4dd2-a282-f66ea6de4ab4" status: 200 len: 1319 microversion: 2.1 time: 0.172966 Jul 23 22:08:54.187364 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3291/5901] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:08:54 2022] GET /compute/v2.1/servers/f169ecaa-b406-4dd2-a282-f66ea6de4ab4 => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:08:55.211080 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-742b5800-8b88-4447-846a-e1efcc1476b2 tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:08:55.211729 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-742b5800-8b88-4447-846a-e1efcc1476b2 tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] [instance: f169ecaa-b406-4dd2-a282-f66ea6de4ab4] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:08:55.219390 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-742b5800-8b88-4447-846a-e1efcc1476b2 tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:08:55.219841 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-742b5800-8b88-4447-846a-e1efcc1476b2 tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:08:55.220652 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-742b5800-8b88-4447-846a-e1efcc1476b2 tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:08:55.221092 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-742b5800-8b88-4447-846a-e1efcc1476b2 tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:08:55.352123 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-742b5800-8b88-4447-846a-e1efcc1476b2 tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f2d11138f934d9c964d3a68bcba60cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43fd816b6f2f40fd8255b789bc0bcb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:08:55.360202 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-742b5800-8b88-4447-846a-e1efcc1476b2 tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] 10.222.0.17 "GET /compute/v2.1/servers/f169ecaa-b406-4dd2-a282-f66ea6de4ab4" status: 200 len: 1319 microversion: 2.1 time: 0.158420 Jul 23 22:08:55.360813 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3292/5902] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:08:55 2022] GET /compute/v2.1/servers/f169ecaa-b406-4dd2-a282-f66ea6de4ab4 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:08:56.379211 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a0eaa213-218c-4e18-8412-ea6bfde2ea9f tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:08:56.379816 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a0eaa213-218c-4e18-8412-ea6bfde2ea9f tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] [instance: f169ecaa-b406-4dd2-a282-f66ea6de4ab4] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:08:56.387458 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a0eaa213-218c-4e18-8412-ea6bfde2ea9f tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:08:56.387885 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a0eaa213-218c-4e18-8412-ea6bfde2ea9f tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:08:56.388682 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a0eaa213-218c-4e18-8412-ea6bfde2ea9f tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:08:56.389175 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a0eaa213-218c-4e18-8412-ea6bfde2ea9f tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:08:56.528561 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a0eaa213-218c-4e18-8412-ea6bfde2ea9f tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f2d11138f934d9c964d3a68bcba60cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43fd816b6f2f40fd8255b789bc0bcb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:08:56.536712 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a0eaa213-218c-4e18-8412-ea6bfde2ea9f tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] 10.222.0.17 "GET /compute/v2.1/servers/f169ecaa-b406-4dd2-a282-f66ea6de4ab4" status: 200 len: 1319 microversion: 2.1 time: 0.161499 Jul 23 22:08:56.537352 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3293/5903] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:08:56 2022] GET /compute/v2.1/servers/f169ecaa-b406-4dd2-a282-f66ea6de4ab4 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:08:56.701338 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-83ec8141-2616-4bad-a38c-3d4b862f4853 req-ac30b879-3825-4769-8cb0-68d26b665feb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f169ecaa-b406-4dd2-a282-f66ea6de4ab4", "name": "network-vif-plugged", "status": "completed", "tag": "51cd6c1e-8b73-497c-bc76-1b4988ec189d"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:08:56.709935 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-83ec8141-2616-4bad-a38c-3d4b862f4853 req-ac30b879-3825-4769-8cb0-68d26b665feb service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:08:56.710978 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-83ec8141-2616-4bad-a38c-3d4b862f4853 req-ac30b879-3825-4769-8cb0-68d26b665feb service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:08:56.724669 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-83ec8141-2616-4bad-a38c-3d4b862f4853 req-ac30b879-3825-4769-8cb0-68d26b665feb service nova] Creating event network-vif-plugged:51cd6c1e-8b73-497c-bc76-1b4988ec189d for instance f169ecaa-b406-4dd2-a282-f66ea6de4ab4 on nch2-master-1 Jul 23 22:08:56.729543 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-83ec8141-2616-4bad-a38c-3d4b862f4853 req-ac30b879-3825-4769-8cb0-68d26b665feb service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032043 Jul 23 22:08:56.730243 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3294/5904] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:08:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 22:08:57.553777 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:08:57.555031 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=8 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:08:57.561507 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-7af17e59-e1ca-46f2-8512-be84f12c2fd8 tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:08:57.562493 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-7af17e59-e1ca-46f2-8512-be84f12c2fd8 tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] [instance: f169ecaa-b406-4dd2-a282-f66ea6de4ab4] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:08:57.571929 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7af17e59-e1ca-46f2-8512-be84f12c2fd8 tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:08:57.572536 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7af17e59-e1ca-46f2-8512-be84f12c2fd8 tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:08:57.573552 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7af17e59-e1ca-46f2-8512-be84f12c2fd8 tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:08:57.574185 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7af17e59-e1ca-46f2-8512-be84f12c2fd8 tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:08:57.718509 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-7af17e59-e1ca-46f2-8512-be84f12c2fd8 tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f2d11138f934d9c964d3a68bcba60cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43fd816b6f2f40fd8255b789bc0bcb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:08:57.726477 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-7af17e59-e1ca-46f2-8512-be84f12c2fd8 tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] 10.222.0.17 "GET /compute/v2.1/servers/f169ecaa-b406-4dd2-a282-f66ea6de4ab4" status: 200 len: 1319 microversion: 2.1 time: 0.174422 Jul 23 22:08:57.727058 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3295/5905] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:08:57 2022] GET /compute/v2.1/servers/f169ecaa-b406-4dd2-a282-f66ea6de4ab4 => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:08:58.747949 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-70969e2a-268e-4bbd-9fd0-96501f8067f6 tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:08:58.748631 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-70969e2a-268e-4bbd-9fd0-96501f8067f6 tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] [instance: f169ecaa-b406-4dd2-a282-f66ea6de4ab4] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:08:58.758875 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-70969e2a-268e-4bbd-9fd0-96501f8067f6 tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:08:58.759332 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-70969e2a-268e-4bbd-9fd0-96501f8067f6 tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:08:58.760104 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-70969e2a-268e-4bbd-9fd0-96501f8067f6 tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:08:58.760603 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-70969e2a-268e-4bbd-9fd0-96501f8067f6 tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:08:58.899583 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-70969e2a-268e-4bbd-9fd0-96501f8067f6 tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f2d11138f934d9c964d3a68bcba60cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43fd816b6f2f40fd8255b789bc0bcb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:08:58.907959 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-70969e2a-268e-4bbd-9fd0-96501f8067f6 tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] 10.222.0.17 "GET /compute/v2.1/servers/f169ecaa-b406-4dd2-a282-f66ea6de4ab4" status: 200 len: 1469 microversion: 2.1 time: 0.168416 Jul 23 22:08:58.908542 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3296/5906] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:08:58 2022] GET /compute/v2.1/servers/f169ecaa-b406-4dd2-a282-f66ea6de4ab4 => generated 1469 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:08:58.978974 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0d8fcf84-2248-4f2d-bbf5-74c2e737c5bc tempest-ServersAdminNegativeTestJSON-916764799 tempest-ServersAdminNegativeTestJSON-916764799-project-admin] Calling method '.version_select at 0x7f0b46494d30>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:08:59.051065 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-0d8fcf84-2248-4f2d-bbf5-74c2e737c5bc tempest-ServersAdminNegativeTestJSON-916764799 tempest-ServersAdminNegativeTestJSON-916764799-project-admin] 10.222.0.17 "GET /compute/v2.1/os-quota-sets/eed1bc3623834e359fd56a6dfe73e3ff" status: 200 len: 371 microversion: 2.1 time: 0.128390 Jul 23 22:08:59.051654 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3297/5907] 10.222.0.17 () {58 vars in 1241 bytes} [Sat Jul 23 22:08:58 2022] GET /compute/v2.1/os-quota-sets/eed1bc3623834e359fd56a6dfe73e3ff => generated 371 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:08:59.061907 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5b12e9b1-3371-4732-be0d-ff83843b2f40 tempest-ServersAdminNegativeTestJSON-916764799 tempest-ServersAdminNegativeTestJSON-916764799-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1365564281", "id": 762671179, "os-flavor-access:is_public": "True"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:08:59.063605 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 22:08:59.063605 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 22:08:59.084130 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5b12e9b1-3371-4732-be0d-ff83843b2f40 tempest-ServersAdminNegativeTestJSON-916764799 tempest-ServersAdminNegativeTestJSON-916764799-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.025458 Jul 23 22:08:59.084677 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3298/5908] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 22:08:59 2022] POST /compute/v2.1/flavors => generated 435 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 22:08:59.096615 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3bfcf960-0a88-4c35-9260-497a85a074fc tempest-ServersAdminNegativeTestJSON-916764799 tempest-ServersAdminNegativeTestJSON-916764799-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "762671179"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:08:59.097605 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-3bfcf960-0a88-4c35-9260-497a85a074fc tempest-ServersAdminNegativeTestJSON-916764799 tempest-ServersAdminNegativeTestJSON-916764799-project-admin] [instance: f169ecaa-b406-4dd2-a282-f66ea6de4ab4] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:08:59.104931 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3bfcf960-0a88-4c35-9260-497a85a074fc tempest-ServersAdminNegativeTestJSON-916764799 tempest-ServersAdminNegativeTestJSON-916764799-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:08:59.105387 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3bfcf960-0a88-4c35-9260-497a85a074fc tempest-ServersAdminNegativeTestJSON-916764799 tempest-ServersAdminNegativeTestJSON-916764799-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:08:59.106209 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3bfcf960-0a88-4c35-9260-497a85a074fc tempest-ServersAdminNegativeTestJSON-916764799 tempest-ServersAdminNegativeTestJSON-916764799-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:08:59.106653 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3bfcf960-0a88-4c35-9260-497a85a074fc tempest-ServersAdminNegativeTestJSON-916764799 tempest-ServersAdminNegativeTestJSON-916764799-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:08:59.194380 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-3bfcf960-0a88-4c35-9260-497a85a074fc tempest-ServersAdminNegativeTestJSON-916764799 tempest-ServersAdminNegativeTestJSON-916764799-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '553940f818364b1780306b0f4280301d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed1bc3623834e359fd56a6dfe73e3ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:08:59.200788 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-3bfcf960-0a88-4c35-9260-497a85a074fc tempest-ServersAdminNegativeTestJSON-916764799 tempest-ServersAdminNegativeTestJSON-916764799-project-admin] [instance: f169ecaa-b406-4dd2-a282-f66ea6de4ab4] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1365564281 {{(pid=131320) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 23 22:08:59.207442 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3bfcf960-0a88-4c35-9260-497a85a074fc tempest-ServersAdminNegativeTestJSON-916764799 tempest-ServersAdminNegativeTestJSON-916764799-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:08:59.207893 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3bfcf960-0a88-4c35-9260-497a85a074fc tempest-ServersAdminNegativeTestJSON-916764799 tempest-ServersAdminNegativeTestJSON-916764799-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:08:59.208683 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3bfcf960-0a88-4c35-9260-497a85a074fc tempest-ServersAdminNegativeTestJSON-916764799 tempest-ServersAdminNegativeTestJSON-916764799-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:08:59.209123 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3bfcf960-0a88-4c35-9260-497a85a074fc tempest-ServersAdminNegativeTestJSON-916764799 tempest-ServersAdminNegativeTestJSON-916764799-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:08:59.229983 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-3bfcf960-0a88-4c35-9260-497a85a074fc tempest-ServersAdminNegativeTestJSON-916764799 tempest-ServersAdminNegativeTestJSON-916764799-project-admin] Getting quotas for project 43fd816b6f2f40fd8255b789bc0bcb4f. Resources: {'ram', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 22:08:59.235221 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-3bfcf960-0a88-4c35-9260-497a85a074fc tempest-ServersAdminNegativeTestJSON-916764799 tempest-ServersAdminNegativeTestJSON-916764799-project-admin] Getting quotas for user 4f2d11138f934d9c964d3a68bcba60cc and project 43fd816b6f2f40fd8255b789bc0bcb4f. Resources: {'ram', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 22:08:59.247906 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.compute.api [None req-3bfcf960-0a88-4c35-9260-497a85a074fc tempest-ServersAdminNegativeTestJSON-916764799 tempest-ServersAdminNegativeTestJSON-916764799-project-admin] ram quota exceeded for eed1bc3623834e359fd56a6dfe73e3ff, tried to resize instance. Jul 23 22:08:59.248443 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-3bfcf960-0a88-4c35-9260-497a85a074fc tempest-ServersAdminNegativeTestJSON-916764799 tempest-ServersAdminNegativeTestJSON-916764799-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 23 22:08:59.250523 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3bfcf960-0a88-4c35-9260-497a85a074fc tempest-ServersAdminNegativeTestJSON-916764799 tempest-ServersAdminNegativeTestJSON-916764799-project-admin] Request method failure captured: Jul 23 22:08:59.250523 ncdv-master-1 devstack@n-api.service[131320]: request: POST /compute/v2.1/servers/f169ecaa-b406-4dd2-a282-f66ea6de4ab4/action HTTP/1.1 Jul 23 22:08:59.250523 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 22:08:59.250523 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 22:08:59.250523 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 22:08:59.250523 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 38 Jul 23 22:08:59.250523 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 22:08:59.250523 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 22:08:59.250523 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 22:08:59.250523 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 22:08:59.250523 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3HFtmv2jjgiSZqTZp-RuP-7NztLY5KXSsSQ1K64guKH_vIAUMNbD3EYJpEYF2l0lHiYhlvMBBTjyLfWChGnSQajdDILMTZN-yA7MCOwUYUIngGFC5cgWMdcGO0GsAP5SAnwpu2BY3znSygzBgRZHTOGYm7_D7h0g97L41kDUvaX-aqQ Jul 23 22:08:59.250523 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 22:08:59.250523 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 22:08:59.250523 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 22:08:59.250523 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 22:08:59.250523 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 22:08:59.250523 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 22:08:59.250523 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: eed1bc3623834e359fd56a6dfe73e3ff Jul 23 22:08:59.250523 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-916764799 Jul 23 22:08:59.250523 ncdv-master-1 devstack@n-api.service[131320]: X-Role: admin,reader,member Jul 23 22:08:59.250523 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: admin,reader,member Jul 23 22:08:59.250523 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/eed1bc3623834e359fd56a6dfe73e3ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/eed1bc3623834e359fd56a6dfe73e3ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_eed1bc3623834e359fd56a6dfe73e3ff", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/eed1bc3623834e359fd56a6dfe73e3ff"}]}] Jul 23 22:08:59.250523 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServersAdminNegativeTestJSON-916764799 Jul 23 22:08:59.250523 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: eed1bc3623834e359fd56a6dfe73e3ff Jul 23 22:08:59.250523 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-916764799 Jul 23 22:08:59.250523 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServersAdminNegativeTestJSON-916764799-project-admin Jul 23 22:08:59.250523 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 22:08:59.250523 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 22:08:59.250523 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 553940f818364b1780306b0f4280301d Jul 23 22:08:59.250523 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServersAdminNegativeTestJSON-916764799-project-admin Jul 23 22:08:59.250523 ncdv-master-1 devstack@n-api.service[131320]: Jul 23 22:08:59.250523 ncdv-master-1 devstack@n-api.service[131320]: {"resize": {"flavorRef": "762671179"}} Jul 23 22:08:59.250523 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 22:08:59.250523 ncdv-master-1 devstack@n-api.service[131320]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 23 22:08:59.250523 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': 'f169ecaa-b406-4dd2-a282-f66ea6de4ab4', 'body': {'resize': {'flavorRef': '762671179'}}} Jul 23 22:08:59.250523 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 22:08:59.250523 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:08:59.250523 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3821, in _check_quota_for_upsize Jul 23 22:08:59.250523 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Jul 23 22:08:59.250523 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 23 22:08:59.250523 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 23 22:08:59.250523 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 23 22:08:59.250523 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc Jul 23 22:08:59.250523 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 23 22:08:59.250523 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 23 22:08:59.250523 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 23 22:08:59.250523 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 23 22:08:59.250523 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 23 22:08:59.250523 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 23 22:08:59.250523 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 23 22:08:59.250523 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 23 22:08:59.250523 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Jul 23 22:08:59.250523 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 23 22:08:59.250523 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Jul 23 22:08:59.250523 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:08:59.250523 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:08:59.250523 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:08:59.250523 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:08:59.250523 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Jul 23 22:08:59.250523 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Jul 23 22:08:59.250523 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 23 22:08:59.250523 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 23 22:08:59.250523 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 23 22:08:59.254019 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 23 22:08:59.254019 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 23 22:08:59.254019 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 23 22:08:59.254019 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 23 22:08:59.254019 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 23 22:08:59.254019 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 23 22:08:59.254019 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 23 22:08:59.254019 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 23 22:08:59.254019 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 23 22:08:59.254019 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 23 22:08:59.254019 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 23 22:08:59.254019 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4190, in resize Jul 23 22:08:59.254019 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Jul 23 22:08:59.254019 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3839, in _check_quota_for_upsize Jul 23 22:08:59.254019 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 23 22:08:59.254019 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 23 22:08:59.254019 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:08:59.254019 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:08:59.254019 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:08:59.254019 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:08:59.254019 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:08:59.254019 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:08:59.254019 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 22:08:59.254019 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 22:08:59.254019 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 22:08:59.254019 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 22:08:59.254019 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 22:08:59.254019 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 22:08:59.254019 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jul 23 22:08:59.254019 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 23 22:08:59.254019 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Jul 23 22:08:59.254019 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 23 22:08:59.254019 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 23 22:08:59.254019 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:08:59.254019 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:08:59.254019 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:08:59.254019 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:08:59.254019 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:08:59.254019 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:08:59.254019 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 22:08:59.254019 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 22:08:59.254019 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 23 22:08:59.254019 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:08:59.254019 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3bfcf960-0a88-4c35-9260-497a85a074fc tempest-ServersAdminNegativeTestJSON-916764799 tempest-ServersAdminNegativeTestJSON-916764799-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 22:08:59.254019 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-3bfcf960-0a88-4c35-9260-497a85a074fc tempest-ServersAdminNegativeTestJSON-916764799 tempest-ServersAdminNegativeTestJSON-916764799-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/f169ecaa-b406-4dd2-a282-f66ea6de4ab4/action" status: 403 len: 118 microversion: 2.1 time: 0.159106 Jul 23 22:08:59.254019 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3299/5909] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 22:08:59 2022] POST /compute/v2.1/servers/f169ecaa-b406-4dd2-a282-f66ea6de4ab4/action => generated 118 bytes in 160 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 23 22:08:59.260844 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-64ed5979-0236-42ce-9124-18ba56bcbac4 tempest-ServersAdminNegativeTestJSON-916764799 tempest-ServersAdminNegativeTestJSON-916764799-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:08:59.261607 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 22:08:59.261607 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 22:08:59.278906 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-64ed5979-0236-42ce-9124-18ba56bcbac4 tempest-ServersAdminNegativeTestJSON-916764799 tempest-ServersAdminNegativeTestJSON-916764799-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/762671179" status: 202 len: 0 microversion: 2.1 time: 0.021562 Jul 23 22:08:59.279431 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3300/5910] 10.222.0.17 () {58 vars in 1157 bytes} [Sat Jul 23 22:08:59 2022] DELETE /compute/v2.1/flavors/762671179 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 23 22:08:59.286835 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f2d81bc1-da51-4fd9-bdef-ee5380ca9124 tempest-ServersAdminNegativeTestJSON-916764799 tempest-ServersAdminNegativeTestJSON-916764799-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:08:59.304832 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f2d81bc1-da51-4fd9-bdef-ee5380ca9124 tempest-ServersAdminNegativeTestJSON-916764799 tempest-ServersAdminNegativeTestJSON-916764799-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.021287 Jul 23 22:08:59.305368 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3301/5911] 10.222.0.17 () {58 vars in 1145 bytes} [Sat Jul 23 22:08:59 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:08:59.321017 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-56a66eaa-4218-42b0-ba3e-b6a2750f4df1 tempest-ServersAdminNegativeTestJSON-916764799 tempest-ServersAdminNegativeTestJSON-916764799-project-admin] Calling method '.version_select at 0x7f0b464a2820>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:08:59.390906 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-56a66eaa-4218-42b0-ba3e-b6a2750f4df1 tempest-ServersAdminNegativeTestJSON-916764799 tempest-ServersAdminNegativeTestJSON-916764799-project-admin] 10.222.0.17 "GET /compute/v2.1/os-quota-sets/eed1bc3623834e359fd56a6dfe73e3ff" status: 200 len: 371 microversion: 2.1 time: 0.073149 Jul 23 22:08:59.391479 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3302/5912] 10.222.0.17 () {58 vars in 1241 bytes} [Sat Jul 23 22:08:59 2022] GET /compute/v2.1/os-quota-sets/eed1bc3623834e359fd56a6dfe73e3ff => generated 371 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:08:59.401494 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4af3a203-dc5b-4d8c-a14b-456b841a069e tempest-ServersAdminNegativeTestJSON-916764799 tempest-ServersAdminNegativeTestJSON-916764799-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-43650225", "id": 307263435, "os-flavor-access:is_public": "True"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:08:59.403013 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 22:08:59.403013 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 22:08:59.419329 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4af3a203-dc5b-4d8c-a14b-456b841a069e tempest-ServersAdminNegativeTestJSON-916764799 tempest-ServersAdminNegativeTestJSON-916764799-project-admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 432 microversion: 2.1 time: 0.021348 Jul 23 22:08:59.419942 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3303/5913] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 22:08:59 2022] POST /compute/v2.1/flavors => generated 432 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 22:08:59.430256 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-74054100-471c-4680-a80d-5b4297e26cf9 tempest-ServersAdminNegativeTestJSON-916764799 tempest-ServersAdminNegativeTestJSON-916764799-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "307263435"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:08:59.431201 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-74054100-471c-4680-a80d-5b4297e26cf9 tempest-ServersAdminNegativeTestJSON-916764799 tempest-ServersAdminNegativeTestJSON-916764799-project-admin] [instance: f169ecaa-b406-4dd2-a282-f66ea6de4ab4] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:08:59.436974 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-74054100-471c-4680-a80d-5b4297e26cf9 tempest-ServersAdminNegativeTestJSON-916764799 tempest-ServersAdminNegativeTestJSON-916764799-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:08:59.437436 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-74054100-471c-4680-a80d-5b4297e26cf9 tempest-ServersAdminNegativeTestJSON-916764799 tempest-ServersAdminNegativeTestJSON-916764799-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:08:59.438239 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-74054100-471c-4680-a80d-5b4297e26cf9 tempest-ServersAdminNegativeTestJSON-916764799 tempest-ServersAdminNegativeTestJSON-916764799-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:08:59.438681 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-74054100-471c-4680-a80d-5b4297e26cf9 tempest-ServersAdminNegativeTestJSON-916764799 tempest-ServersAdminNegativeTestJSON-916764799-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:08:59.469696 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-74054100-471c-4680-a80d-5b4297e26cf9 tempest-ServersAdminNegativeTestJSON-916764799 tempest-ServersAdminNegativeTestJSON-916764799-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '553940f818364b1780306b0f4280301d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eed1bc3623834e359fd56a6dfe73e3ff', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:08:59.476307 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-74054100-471c-4680-a80d-5b4297e26cf9 tempest-ServersAdminNegativeTestJSON-916764799 tempest-ServersAdminNegativeTestJSON-916764799-project-admin] [instance: f169ecaa-b406-4dd2-a282-f66ea6de4ab4] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-43650225 {{(pid=131320) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 23 22:08:59.483002 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-74054100-471c-4680-a80d-5b4297e26cf9 tempest-ServersAdminNegativeTestJSON-916764799 tempest-ServersAdminNegativeTestJSON-916764799-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:08:59.483457 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-74054100-471c-4680-a80d-5b4297e26cf9 tempest-ServersAdminNegativeTestJSON-916764799 tempest-ServersAdminNegativeTestJSON-916764799-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:08:59.484275 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-74054100-471c-4680-a80d-5b4297e26cf9 tempest-ServersAdminNegativeTestJSON-916764799 tempest-ServersAdminNegativeTestJSON-916764799-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:08:59.484721 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-74054100-471c-4680-a80d-5b4297e26cf9 tempest-ServersAdminNegativeTestJSON-916764799 tempest-ServersAdminNegativeTestJSON-916764799-project-admin] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:08:59.504620 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-74054100-471c-4680-a80d-5b4297e26cf9 tempest-ServersAdminNegativeTestJSON-916764799 tempest-ServersAdminNegativeTestJSON-916764799-project-admin] Getting quotas for project 43fd816b6f2f40fd8255b789bc0bcb4f. Resources: {'ram', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 22:08:59.510191 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-74054100-471c-4680-a80d-5b4297e26cf9 tempest-ServersAdminNegativeTestJSON-916764799 tempest-ServersAdminNegativeTestJSON-916764799-project-admin] Getting quotas for user 4f2d11138f934d9c964d3a68bcba60cc and project 43fd816b6f2f40fd8255b789bc0bcb4f. Resources: {'ram', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 22:08:59.522424 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.compute.api [None req-74054100-471c-4680-a80d-5b4297e26cf9 tempest-ServersAdminNegativeTestJSON-916764799 tempest-ServersAdminNegativeTestJSON-916764799-project-admin] cores quota exceeded for eed1bc3623834e359fd56a6dfe73e3ff, tried to resize instance. Jul 23 22:08:59.523019 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-74054100-471c-4680-a80d-5b4297e26cf9 tempest-ServersAdminNegativeTestJSON-916764799 tempest-ServersAdminNegativeTestJSON-916764799-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 23 22:08:59.524985 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-74054100-471c-4680-a80d-5b4297e26cf9 tempest-ServersAdminNegativeTestJSON-916764799 tempest-ServersAdminNegativeTestJSON-916764799-project-admin] Request method failure captured: Jul 23 22:08:59.524985 ncdv-master-1 devstack@n-api.service[131320]: request: POST /compute/v2.1/servers/f169ecaa-b406-4dd2-a282-f66ea6de4ab4/action HTTP/1.1 Jul 23 22:08:59.524985 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 22:08:59.524985 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 22:08:59.524985 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 22:08:59.524985 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 38 Jul 23 22:08:59.524985 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 22:08:59.524985 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 22:08:59.524985 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 22:08:59.524985 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 22:08:59.524985 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3HFtmv2jjgiSZqTZp-RuP-7NztLY5KXSsSQ1K64guKH_vIAUMNbD3EYJpEYF2l0lHiYhlvMBBTjyLfWChGnSQajdDILMTZN-yA7MCOwUYUIngGFC5cgWMdcGO0GsAP5SAnwpu2BY3znSygzBgRZHTOGYm7_D7h0g97L41kDUvaX-aqQ Jul 23 22:08:59.524985 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 22:08:59.524985 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 22:08:59.524985 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 22:08:59.524985 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 22:08:59.524985 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 22:08:59.524985 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 22:08:59.524985 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: eed1bc3623834e359fd56a6dfe73e3ff Jul 23 22:08:59.524985 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-916764799 Jul 23 22:08:59.524985 ncdv-master-1 devstack@n-api.service[131320]: X-Role: admin,reader,member Jul 23 22:08:59.524985 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: admin,reader,member Jul 23 22:08:59.524985 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/eed1bc3623834e359fd56a6dfe73e3ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/eed1bc3623834e359fd56a6dfe73e3ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_eed1bc3623834e359fd56a6dfe73e3ff", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/eed1bc3623834e359fd56a6dfe73e3ff"}]}] Jul 23 22:08:59.524985 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServersAdminNegativeTestJSON-916764799 Jul 23 22:08:59.524985 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: eed1bc3623834e359fd56a6dfe73e3ff Jul 23 22:08:59.524985 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-916764799 Jul 23 22:08:59.524985 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServersAdminNegativeTestJSON-916764799-project-admin Jul 23 22:08:59.524985 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 22:08:59.524985 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 22:08:59.524985 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 553940f818364b1780306b0f4280301d Jul 23 22:08:59.524985 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServersAdminNegativeTestJSON-916764799-project-admin Jul 23 22:08:59.524985 ncdv-master-1 devstack@n-api.service[131320]: Jul 23 22:08:59.524985 ncdv-master-1 devstack@n-api.service[131320]: {"resize": {"flavorRef": "307263435"}} Jul 23 22:08:59.524985 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 22:08:59.524985 ncdv-master-1 devstack@n-api.service[131320]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 23 22:08:59.524985 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': 'f169ecaa-b406-4dd2-a282-f66ea6de4ab4', 'body': {'resize': {'flavorRef': '307263435'}}} Jul 23 22:08:59.524985 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 22:08:59.524985 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:08:59.524985 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3821, in _check_quota_for_upsize Jul 23 22:08:59.524985 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Jul 23 22:08:59.524985 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 23 22:08:59.524985 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 23 22:08:59.524985 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 23 22:08:59.524985 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc Jul 23 22:08:59.524985 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 23 22:08:59.524985 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 23 22:08:59.524985 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 23 22:08:59.524985 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 23 22:08:59.524985 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 23 22:08:59.524985 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 23 22:08:59.524985 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 23 22:08:59.524985 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 23 22:08:59.524985 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Jul 23 22:08:59.524985 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 23 22:08:59.524985 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Jul 23 22:08:59.524985 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:08:59.524985 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:08:59.524985 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:08:59.524985 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:08:59.524985 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Jul 23 22:08:59.524985 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Jul 23 22:08:59.524985 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 23 22:08:59.524985 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 23 22:08:59.524985 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 23 22:08:59.528162 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 23 22:08:59.528162 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 23 22:08:59.528162 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 23 22:08:59.528162 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 23 22:08:59.528162 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 23 22:08:59.528162 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 23 22:08:59.528162 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 23 22:08:59.528162 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 23 22:08:59.528162 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 23 22:08:59.528162 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 23 22:08:59.528162 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 23 22:08:59.528162 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4190, in resize Jul 23 22:08:59.528162 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Jul 23 22:08:59.528162 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3839, in _check_quota_for_upsize Jul 23 22:08:59.528162 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 23 22:08:59.528162 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 23 22:08:59.528162 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:08:59.528162 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:08:59.528162 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:08:59.528162 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:08:59.528162 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:08:59.528162 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:08:59.528162 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 22:08:59.528162 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 22:08:59.528162 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 22:08:59.528162 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 22:08:59.528162 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 22:08:59.528162 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 22:08:59.528162 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jul 23 22:08:59.528162 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 23 22:08:59.528162 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Jul 23 22:08:59.528162 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 23 22:08:59.528162 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 23 22:08:59.528162 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:08:59.528162 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:08:59.528162 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:08:59.528162 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:08:59.528162 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:08:59.528162 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:08:59.528162 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 22:08:59.528162 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 22:08:59.528162 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 23 22:08:59.528162 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:08:59.528162 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-74054100-471c-4680-a80d-5b4297e26cf9 tempest-ServersAdminNegativeTestJSON-916764799 tempest-ServersAdminNegativeTestJSON-916764799-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 22:08:59.528162 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-74054100-471c-4680-a80d-5b4297e26cf9 tempest-ServersAdminNegativeTestJSON-916764799 tempest-ServersAdminNegativeTestJSON-916764799-project-admin] 10.222.0.17 "POST /compute/v2.1/servers/f169ecaa-b406-4dd2-a282-f66ea6de4ab4/action" status: 403 len: 113 microversion: 2.1 time: 0.099698 Jul 23 22:08:59.528162 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3304/5914] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 22:08:59 2022] POST /compute/v2.1/servers/f169ecaa-b406-4dd2-a282-f66ea6de4ab4/action => generated 113 bytes in 101 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 23 22:08:59.534988 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2400fc38-3d11-4729-b0e9-65d22a37dd03 tempest-ServersAdminNegativeTestJSON-916764799 tempest-ServersAdminNegativeTestJSON-916764799-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:08:59.535738 ncdv-master-1 devstack@n-api.service[131320]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 23 22:08:59.535738 ncdv-master-1 devstack@n-api.service[131320]: warnings.warn(msg) Jul 23 22:08:59.546556 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=5,nova_api:DELETE=6 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:08:59.555021 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2400fc38-3d11-4729-b0e9-65d22a37dd03 tempest-ServersAdminNegativeTestJSON-916764799 tempest-ServersAdminNegativeTestJSON-916764799-project-admin] 10.222.0.17 "DELETE /compute/v2.1/flavors/307263435" status: 202 len: 0 microversion: 2.1 time: 0.023451 Jul 23 22:08:59.555584 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3305/5915] 10.222.0.17 () {58 vars in 1157 bytes} [Sat Jul 23 22:08:59 2022] DELETE /compute/v2.1/flavors/307263435 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 22:08:59.563269 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-7c331548-0131-4120-a44d-36613ed3833c tempest-ServersAdminNegativeTestJSON-916764799 tempest-ServersAdminNegativeTestJSON-916764799-project-admin] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:08:59.582088 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-7c331548-0131-4120-a44d-36613ed3833c tempest-ServersAdminNegativeTestJSON-916764799 tempest-ServersAdminNegativeTestJSON-916764799-project-admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.022338 Jul 23 22:08:59.582618 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3306/5916] 10.222.0.17 () {58 vars in 1145 bytes} [Sat Jul 23 22:08:59 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:08:59.599467 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-dac9a071-3099-4336-8716-1b15d3793440 tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:08:59.599941 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-dac9a071-3099-4336-8716-1b15d3793440 tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] [instance: f169ecaa-b406-4dd2-a282-f66ea6de4ab4] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:08:59.606050 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dac9a071-3099-4336-8716-1b15d3793440 tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:08:59.606503 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dac9a071-3099-4336-8716-1b15d3793440 tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:08:59.607269 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dac9a071-3099-4336-8716-1b15d3793440 tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:08:59.607707 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dac9a071-3099-4336-8716-1b15d3793440 tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:08:59.632279 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-dac9a071-3099-4336-8716-1b15d3793440 tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] [instance: f169ecaa-b406-4dd2-a282-f66ea6de4ab4] Going to try to terminate instance {{(pid=131320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 22:08:59.645834 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=100 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:08:59.712633 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-dac9a071-3099-4336-8716-1b15d3793440 tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] 10.222.0.17 "DELETE /compute/v2.1/servers/f169ecaa-b406-4dd2-a282-f66ea6de4ab4" status: 204 len: 0 microversion: 2.1 time: 0.116315 Jul 23 22:08:59.713307 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3307/5917] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 22:08:59 2022] DELETE /compute/v2.1/servers/f169ecaa-b406-4dd2-a282-f66ea6de4ab4 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 23 22:08:59.722101 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f1289d5d-2666-4553-9cc7-ce757942df3f tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:08:59.722808 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f1289d5d-2666-4553-9cc7-ce757942df3f tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] [instance: f169ecaa-b406-4dd2-a282-f66ea6de4ab4] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:08:59.730367 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f1289d5d-2666-4553-9cc7-ce757942df3f tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:08:59.730929 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f1289d5d-2666-4553-9cc7-ce757942df3f tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:08:59.731776 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f1289d5d-2666-4553-9cc7-ce757942df3f tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:08:59.732313 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f1289d5d-2666-4553-9cc7-ce757942df3f tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:08:59.873304 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f1289d5d-2666-4553-9cc7-ce757942df3f tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f2d11138f934d9c964d3a68bcba60cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43fd816b6f2f40fd8255b789bc0bcb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:08:59.881583 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f1289d5d-2666-4553-9cc7-ce757942df3f tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] 10.222.0.17 "GET /compute/v2.1/servers/f169ecaa-b406-4dd2-a282-f66ea6de4ab4" status: 200 len: 1475 microversion: 2.1 time: 0.163641 Jul 23 22:08:59.882299 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3308/5918] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:08:59 2022] GET /compute/v2.1/servers/f169ecaa-b406-4dd2-a282-f66ea6de4ab4 => generated 1475 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:09:00.899481 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8af5b7e5-6048-4763-b548-f449aaa190e1 tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:09:00.900092 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8af5b7e5-6048-4763-b548-f449aaa190e1 tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] [instance: f169ecaa-b406-4dd2-a282-f66ea6de4ab4] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:09:00.907606 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8af5b7e5-6048-4763-b548-f449aaa190e1 tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:09:00.908060 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8af5b7e5-6048-4763-b548-f449aaa190e1 tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:09:00.908839 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8af5b7e5-6048-4763-b548-f449aaa190e1 tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:09:00.909268 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8af5b7e5-6048-4763-b548-f449aaa190e1 tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:09:01.045503 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8af5b7e5-6048-4763-b548-f449aaa190e1 tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f2d11138f934d9c964d3a68bcba60cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43fd816b6f2f40fd8255b789bc0bcb4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:09:01.053470 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8af5b7e5-6048-4763-b548-f449aaa190e1 tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] 10.222.0.17 "GET /compute/v2.1/servers/f169ecaa-b406-4dd2-a282-f66ea6de4ab4" status: 200 len: 1475 microversion: 2.1 time: 0.157964 Jul 23 22:09:01.054122 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3309/5919] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:09:00 2022] GET /compute/v2.1/servers/f169ecaa-b406-4dd2-a282-f66ea6de4ab4 => generated 1475 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:09:01.429831 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-1e42e91d-ec37-4923-8cb9-8e8a8719efbd req-412b928b-021d-4004-8a7d-513169a89005 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f169ecaa-b406-4dd2-a282-f66ea6de4ab4", "name": "network-vif-deleted", "tag": "51cd6c1e-8b73-497c-bc76-1b4988ec189d"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:09:01.441889 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-1e42e91d-ec37-4923-8cb9-8e8a8719efbd req-412b928b-021d-4004-8a7d-513169a89005 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:09:01.442440 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-1e42e91d-ec37-4923-8cb9-8e8a8719efbd req-412b928b-021d-4004-8a7d-513169a89005 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:09:01.461353 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-1e42e91d-ec37-4923-8cb9-8e8a8719efbd req-412b928b-021d-4004-8a7d-513169a89005 service nova] Creating event network-vif-deleted:51cd6c1e-8b73-497c-bc76-1b4988ec189d for instance f169ecaa-b406-4dd2-a282-f66ea6de4ab4 on nch2-master-1 Jul 23 22:09:01.466269 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-1e42e91d-ec37-4923-8cb9-8e8a8719efbd req-412b928b-021d-4004-8a7d-513169a89005 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040555 Jul 23 22:09:01.466871 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3310/5920] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:09:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 22:09:02.072486 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-600a3fab-c56e-47db-bd03-90ee9fd7d363 tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:09:02.073299 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-600a3fab-c56e-47db-bd03-90ee9fd7d363 tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] [instance: f169ecaa-b406-4dd2-a282-f66ea6de4ab4] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:09:02.082149 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-600a3fab-c56e-47db-bd03-90ee9fd7d363 tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:09:02.082681 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-600a3fab-c56e-47db-bd03-90ee9fd7d363 tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:09:02.083573 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-600a3fab-c56e-47db-bd03-90ee9fd7d363 tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:09:02.084066 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-600a3fab-c56e-47db-bd03-90ee9fd7d363 tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:09:02.098309 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-600a3fab-c56e-47db-bd03-90ee9fd7d363 tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] HTTP exception thrown: Instance f169ecaa-b406-4dd2-a282-f66ea6de4ab4 could not be found. Jul 23 22:09:02.099927 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-600a3fab-c56e-47db-bd03-90ee9fd7d363 tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] Request method failure captured: Jul 23 22:09:02.099927 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/f169ecaa-b406-4dd2-a282-f66ea6de4ab4 HTTP/1.1 Jul 23 22:09:02.099927 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 22:09:02.099927 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 22:09:02.099927 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 22:09:02.099927 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 22:09:02.099927 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 22:09:02.099927 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 22:09:02.099927 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 22:09:02.099927 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 22:09:02.099927 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3HFtA2jadDBzPuKme5o5a0a3bzg-TlYo9dCtjbkinhITbT_fe-VPBVwq2G6nVnds3yqtefVCJr6W_j2JNOW4QPTsPoe6XtAm9osSuTzF7lXxR55dshe-iNR_jCo7MYQ27okmQ79GP5wM1URFOgqACvjA1fIZ5oGJUy4NQkVIncn_Z24 Jul 23 22:09:02.099927 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 22:09:02.099927 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 22:09:02.099927 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 22:09:02.099927 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 22:09:02.099927 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 22:09:02.099927 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 22:09:02.099927 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 43fd816b6f2f40fd8255b789bc0bcb4f Jul 23 22:09:02.099927 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-522399696 Jul 23 22:09:02.099927 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 22:09:02.099927 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 22:09:02.099927 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/43fd816b6f2f40fd8255b789bc0bcb4f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/43fd816b6f2f40fd8255b789bc0bcb4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_43fd816b6f2f40fd8255b789bc0bcb4f", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/43fd816b6f2f40fd8255b789bc0bcb4f"}]}] Jul 23 22:09:02.099927 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServersAdminNegativeTestJSON-522399696 Jul 23 22:09:02.099927 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 43fd816b6f2f40fd8255b789bc0bcb4f Jul 23 22:09:02.099927 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-522399696 Jul 23 22:09:02.099927 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServersAdminNegativeTestJSON-522399696-project Jul 23 22:09:02.099927 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 22:09:02.099927 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 22:09:02.099927 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 4f2d11138f934d9c964d3a68bcba60cc Jul 23 22:09:02.099927 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServersAdminNegativeTestJSON-522399696-project Jul 23 22:09:02.099927 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 22:09:02.099927 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance f169ecaa-b406-4dd2-a282-f66ea6de4ab4 could not be found. Jul 23 22:09:02.099927 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': 'f169ecaa-b406-4dd2-a282-f66ea6de4ab4'} Jul 23 22:09:02.099927 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 22:09:02.099927 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:09:02.099927 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 22:09:02.099927 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 22:09:02.099927 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 22:09:02.099927 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 22:09:02.099927 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 22:09:02.099927 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 22:09:02.099927 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 22:09:02.099927 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 22:09:02.099927 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f169ecaa-b406-4dd2-a282-f66ea6de4ab4 could not be found. Jul 23 22:09:02.099927 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:09:02.099927 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:09:02.099927 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:09:02.099927 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:09:02.099927 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:09:02.099927 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:09:02.099927 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 22:09:02.099927 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 22:09:02.099927 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 22:09:02.099927 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 22:09:02.099927 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 22:09:02.099927 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 22:09:02.099927 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 22:09:02.099927 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 22:09:02.099927 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 22:09:02.099927 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 22:09:02.099927 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f169ecaa-b406-4dd2-a282-f66ea6de4ab4 could not be found. Jul 23 22:09:02.099927 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:09:02.099927 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:09:02.099927 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:09:02.103183 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:09:02.103183 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:09:02.103183 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:09:02.103183 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 22:09:02.103183 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 22:09:02.103183 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f169ecaa-b406-4dd2-a282-f66ea6de4ab4 could not be found. Jul 23 22:09:02.103183 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:09:02.103183 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-600a3fab-c56e-47db-bd03-90ee9fd7d363 tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] Returning 404 to user: Instance f169ecaa-b406-4dd2-a282-f66ea6de4ab4 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 22:09:02.103183 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-600a3fab-c56e-47db-bd03-90ee9fd7d363 tempest-ServersAdminNegativeTestJSON-522399696 tempest-ServersAdminNegativeTestJSON-522399696-project] 10.222.0.17 "GET /compute/v2.1/servers/f169ecaa-b406-4dd2-a282-f66ea6de4ab4" status: 404 len: 111 microversion: 2.1 time: 0.033902 Jul 23 22:09:02.103183 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3311/5921] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:09:02 2022] GET /compute/v2.1/servers/f169ecaa-b406-4dd2-a282-f66ea6de4ab4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 22:09:08.323947 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b03fc144-8ac4-42ee-a72f-cecc5befbb47 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1672483918", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "networks": [{"uuid": "93f566ba-96ab-47dd-ae6b-7e4f198792ed"}]}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:09:08.375907 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-b03fc144-8ac4-42ee-a72f-cecc5befbb47 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] validate_networks() for [('93f566ba-96ab-47dd-ae6b-7e4f198792ed', None, None, None, None, None)] {{(pid=131320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 22:09:08.762945 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-b03fc144-8ac4-42ee-a72f-cecc5befbb47 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 22:09:08.763364 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-b03fc144-8ac4-42ee-a72f-cecc5befbb47 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 22:09:08.763871 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-b03fc144-8ac4-42ee-a72f-cecc5befbb47 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 22:09:08.764271 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-b03fc144-8ac4-42ee-a72f-cecc5befbb47 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 22:09:08.764684 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-b03fc144-8ac4-42ee-a72f-cecc5befbb47 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 22:09:08.775153 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b03fc144-8ac4-42ee-a72f-cecc5befbb47 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:09:08.775602 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b03fc144-8ac4-42ee-a72f-cecc5befbb47 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:09:08.776392 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b03fc144-8ac4-42ee-a72f-cecc5befbb47 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:09:08.776827 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b03fc144-8ac4-42ee-a72f-cecc5befbb47 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:09:08.795593 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-b03fc144-8ac4-42ee-a72f-cecc5befbb47 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Getting quotas for project 62de2e01319a49feb262b98ca4a23a7b. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 22:09:08.801407 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-b03fc144-8ac4-42ee-a72f-cecc5befbb47 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Getting quotas for user cfb9e87eb6734c4ea35a0fdf4cd3b397 and project 62de2e01319a49feb262b98ca4a23a7b. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 22:09:08.817333 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b03fc144-8ac4-42ee-a72f-cecc5befbb47 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Going to run 1 instances... {{(pid=131320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 22:09:08.819768 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b03fc144-8ac4-42ee-a72f-cecc5befbb47 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] [instance: dcda4567-df17-4b5b-bfbc-3945f2985df0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 22:09:08.875908 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b03fc144-8ac4-42ee-a72f-cecc5befbb47 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.679280 Jul 23 22:09:08.876636 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3312/5922] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 22:09:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 681 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 23 22:09:08.887196 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-539d34ba-fe57-45f1-917a-7a3352d8d964 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:09:08.887846 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-539d34ba-fe57-45f1-917a-7a3352d8d964 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] [instance: dcda4567-df17-4b5b-bfbc-3945f2985df0] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:09:08.949248 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-539d34ba-fe57-45f1-917a-7a3352d8d964 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb9e87eb6734c4ea35a0fdf4cd3b397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62de2e01319a49feb262b98ca4a23a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:09:08.960346 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-539d34ba-fe57-45f1-917a-7a3352d8d964 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] 10.222.0.17 "GET /compute/v2.1/servers/dcda4567-df17-4b5b-bfbc-3945f2985df0" status: 200 len: 1215 microversion: 2.1 time: 0.076846 Jul 23 22:09:08.960935 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3313/5923] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:09:08 2022] GET /compute/v2.1/servers/dcda4567-df17-4b5b-bfbc-3945f2985df0 => generated 1215 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:09:09.979251 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-07f93963-e94b-4d87-8215-2489257f5534 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:09:09.983218 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-07f93963-e94b-4d87-8215-2489257f5534 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] [instance: dcda4567-df17-4b5b-bfbc-3945f2985df0] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:09:09.994405 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-07f93963-e94b-4d87-8215-2489257f5534 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:09:09.995678 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-07f93963-e94b-4d87-8215-2489257f5534 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:09:09.997012 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-07f93963-e94b-4d87-8215-2489257f5534 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:09:09.997541 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-07f93963-e94b-4d87-8215-2489257f5534 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:09:10.082581 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-07f93963-e94b-4d87-8215-2489257f5534 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb9e87eb6734c4ea35a0fdf4cd3b397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62de2e01319a49feb262b98ca4a23a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:09:10.091743 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-07f93963-e94b-4d87-8215-2489257f5534 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] 10.222.0.17 "GET /compute/v2.1/servers/dcda4567-df17-4b5b-bfbc-3945f2985df0" status: 200 len: 1275 microversion: 2.1 time: 0.118145 Jul 23 22:09:10.092338 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3314/5924] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:09:09 2022] GET /compute/v2.1/servers/dcda4567-df17-4b5b-bfbc-3945f2985df0 => generated 1275 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:09:11.110890 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0587883d-711f-4808-a32a-61825b44a331 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:09:11.112171 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-0587883d-711f-4808-a32a-61825b44a331 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] [instance: dcda4567-df17-4b5b-bfbc-3945f2985df0] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:09:11.125388 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0587883d-711f-4808-a32a-61825b44a331 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:09:11.125844 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0587883d-711f-4808-a32a-61825b44a331 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:09:11.127000 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0587883d-711f-4808-a32a-61825b44a331 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:09:11.128216 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0587883d-711f-4808-a32a-61825b44a331 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:09:11.347720 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-0587883d-711f-4808-a32a-61825b44a331 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb9e87eb6734c4ea35a0fdf4cd3b397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62de2e01319a49feb262b98ca4a23a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:09:11.356730 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-0587883d-711f-4808-a32a-61825b44a331 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] 10.222.0.17 "GET /compute/v2.1/servers/dcda4567-df17-4b5b-bfbc-3945f2985df0" status: 200 len: 1315 microversion: 2.1 time: 0.250797 Jul 23 22:09:11.357774 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3315/5925] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:09:11 2022] GET /compute/v2.1/servers/dcda4567-df17-4b5b-bfbc-3945f2985df0 => generated 1315 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:09:11.456013 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-a8afa649-8344-4937-bc12-adad5334d56a req-f140e7dc-e6d2-4ca4-ab43-46e26b386c9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcda4567-df17-4b5b-bfbc-3945f2985df0", "tag": "0437285c-cc34-4c78-9bf7-e975064c4835"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:09:11.491226 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-a8afa649-8344-4937-bc12-adad5334d56a req-f140e7dc-e6d2-4ca4-ab43-46e26b386c9b service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:09:11.492638 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-a8afa649-8344-4937-bc12-adad5334d56a req-f140e7dc-e6d2-4ca4-ab43-46e26b386c9b service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:09:11.508490 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-a8afa649-8344-4937-bc12-adad5334d56a req-f140e7dc-e6d2-4ca4-ab43-46e26b386c9b service nova] Creating event network-changed:0437285c-cc34-4c78-9bf7-e975064c4835 for instance dcda4567-df17-4b5b-bfbc-3945f2985df0 on nch2-master-1 Jul 23 22:09:11.522367 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-a8afa649-8344-4937-bc12-adad5334d56a req-f140e7dc-e6d2-4ca4-ab43-46e26b386c9b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070341 Jul 23 22:09:11.523864 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3316/5926] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:09:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 22:09:12.375458 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-fcf96c85-bb7c-4564-b685-4766f5f09dc5 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:09:12.376160 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-fcf96c85-bb7c-4564-b685-4766f5f09dc5 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] [instance: dcda4567-df17-4b5b-bfbc-3945f2985df0] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:09:12.384577 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fcf96c85-bb7c-4564-b685-4766f5f09dc5 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:09:12.385252 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fcf96c85-bb7c-4564-b685-4766f5f09dc5 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:09:12.386188 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fcf96c85-bb7c-4564-b685-4766f5f09dc5 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:09:12.386702 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fcf96c85-bb7c-4564-b685-4766f5f09dc5 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:09:12.522623 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-fcf96c85-bb7c-4564-b685-4766f5f09dc5 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb9e87eb6734c4ea35a0fdf4cd3b397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62de2e01319a49feb262b98ca4a23a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:09:12.530551 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-fcf96c85-bb7c-4564-b685-4766f5f09dc5 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] 10.222.0.17 "GET /compute/v2.1/servers/dcda4567-df17-4b5b-bfbc-3945f2985df0" status: 200 len: 1315 microversion: 2.1 time: 0.159423 Jul 23 22:09:12.531115 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3317/5927] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:09:12 2022] GET /compute/v2.1/servers/dcda4567-df17-4b5b-bfbc-3945f2985df0 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:09:13.552029 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2f2cfd27-c0b4-4fcc-b6e1-e9cc1ea89899 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:09:13.553007 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-2f2cfd27-c0b4-4fcc-b6e1-e9cc1ea89899 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] [instance: dcda4567-df17-4b5b-bfbc-3945f2985df0] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:09:13.564844 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2f2cfd27-c0b4-4fcc-b6e1-e9cc1ea89899 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:09:13.565666 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2f2cfd27-c0b4-4fcc-b6e1-e9cc1ea89899 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:09:13.567021 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2f2cfd27-c0b4-4fcc-b6e1-e9cc1ea89899 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:09:13.567729 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2f2cfd27-c0b4-4fcc-b6e1-e9cc1ea89899 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:09:13.716368 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-2f2cfd27-c0b4-4fcc-b6e1-e9cc1ea89899 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb9e87eb6734c4ea35a0fdf4cd3b397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62de2e01319a49feb262b98ca4a23a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:09:13.724116 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2f2cfd27-c0b4-4fcc-b6e1-e9cc1ea89899 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] 10.222.0.17 "GET /compute/v2.1/servers/dcda4567-df17-4b5b-bfbc-3945f2985df0" status: 200 len: 1315 microversion: 2.1 time: 0.178769 Jul 23 22:09:13.724676 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3318/5928] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:09:13 2022] GET /compute/v2.1/servers/dcda4567-df17-4b5b-bfbc-3945f2985df0 => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:09:14.741803 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e10abd28-425a-4d0a-836a-3e99b43f85b9 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:09:14.742565 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e10abd28-425a-4d0a-836a-3e99b43f85b9 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] [instance: dcda4567-df17-4b5b-bfbc-3945f2985df0] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:09:14.750248 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e10abd28-425a-4d0a-836a-3e99b43f85b9 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:09:14.750701 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e10abd28-425a-4d0a-836a-3e99b43f85b9 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:09:14.751478 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e10abd28-425a-4d0a-836a-3e99b43f85b9 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:09:14.751911 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e10abd28-425a-4d0a-836a-3e99b43f85b9 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:09:14.887993 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e10abd28-425a-4d0a-836a-3e99b43f85b9 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb9e87eb6734c4ea35a0fdf4cd3b397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62de2e01319a49feb262b98ca4a23a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:09:14.896055 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e10abd28-425a-4d0a-836a-3e99b43f85b9 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] 10.222.0.17 "GET /compute/v2.1/servers/dcda4567-df17-4b5b-bfbc-3945f2985df0" status: 200 len: 1315 microversion: 2.1 time: 0.159049 Jul 23 22:09:14.896651 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3319/5929] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:09:14 2022] GET /compute/v2.1/servers/dcda4567-df17-4b5b-bfbc-3945f2985df0 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:09:15.913831 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-825ecbd9-577d-4f4f-a719-ee8ef40d0dd8 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:09:15.914513 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-825ecbd9-577d-4f4f-a719-ee8ef40d0dd8 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] [instance: dcda4567-df17-4b5b-bfbc-3945f2985df0] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:09:15.922079 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-825ecbd9-577d-4f4f-a719-ee8ef40d0dd8 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:09:15.922532 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-825ecbd9-577d-4f4f-a719-ee8ef40d0dd8 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:09:15.923309 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-825ecbd9-577d-4f4f-a719-ee8ef40d0dd8 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:09:15.924108 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-825ecbd9-577d-4f4f-a719-ee8ef40d0dd8 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:09:16.065006 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-825ecbd9-577d-4f4f-a719-ee8ef40d0dd8 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb9e87eb6734c4ea35a0fdf4cd3b397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62de2e01319a49feb262b98ca4a23a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:09:16.072978 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-825ecbd9-577d-4f4f-a719-ee8ef40d0dd8 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] 10.222.0.17 "GET /compute/v2.1/servers/dcda4567-df17-4b5b-bfbc-3945f2985df0" status: 200 len: 1315 microversion: 2.1 time: 0.163763 Jul 23 22:09:16.073622 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3320/5930] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:09:15 2022] GET /compute/v2.1/servers/dcda4567-df17-4b5b-bfbc-3945f2985df0 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:09:16.660334 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-5d8074ba-0fd6-4e82-8485-2f1cf2f0b50a req-e58ef060-2e7f-41ab-b4dd-f7f28f460f0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcda4567-df17-4b5b-bfbc-3945f2985df0", "name": "network-vif-plugged", "status": "completed", "tag": "0437285c-cc34-4c78-9bf7-e975064c4835"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:09:16.669565 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-5d8074ba-0fd6-4e82-8485-2f1cf2f0b50a req-e58ef060-2e7f-41ab-b4dd-f7f28f460f0a service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:09:16.670121 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-5d8074ba-0fd6-4e82-8485-2f1cf2f0b50a req-e58ef060-2e7f-41ab-b4dd-f7f28f460f0a service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:09:16.682593 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-5d8074ba-0fd6-4e82-8485-2f1cf2f0b50a req-e58ef060-2e7f-41ab-b4dd-f7f28f460f0a service nova] Creating event network-vif-plugged:0437285c-cc34-4c78-9bf7-e975064c4835 for instance dcda4567-df17-4b5b-bfbc-3945f2985df0 on nch2-master-1 Jul 23 22:09:16.687637 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-5d8074ba-0fd6-4e82-8485-2f1cf2f0b50a req-e58ef060-2e7f-41ab-b4dd-f7f28f460f0a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031093 Jul 23 22:09:16.688456 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3321/5931] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:09:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:09:17.091082 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-671a6771-1924-40ea-bb1d-61ae3af2a084 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:09:17.091763 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-671a6771-1924-40ea-bb1d-61ae3af2a084 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] [instance: dcda4567-df17-4b5b-bfbc-3945f2985df0] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:09:17.099472 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-671a6771-1924-40ea-bb1d-61ae3af2a084 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:09:17.099913 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-671a6771-1924-40ea-bb1d-61ae3af2a084 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:09:17.100691 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-671a6771-1924-40ea-bb1d-61ae3af2a084 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:09:17.101115 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-671a6771-1924-40ea-bb1d-61ae3af2a084 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:09:17.235228 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-671a6771-1924-40ea-bb1d-61ae3af2a084 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb9e87eb6734c4ea35a0fdf4cd3b397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62de2e01319a49feb262b98ca4a23a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:09:17.246221 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-671a6771-1924-40ea-bb1d-61ae3af2a084 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] 10.222.0.17 "GET /compute/v2.1/servers/dcda4567-df17-4b5b-bfbc-3945f2985df0" status: 200 len: 1315 microversion: 2.1 time: 0.159295 Jul 23 22:09:17.246977 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3322/5932] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:09:17 2022] GET /compute/v2.1/servers/dcda4567-df17-4b5b-bfbc-3945f2985df0 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:09:18.272121 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-7f855245-e842-4e60-b64f-4429ca6d0d1f tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:09:18.273151 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-7f855245-e842-4e60-b64f-4429ca6d0d1f tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] [instance: dcda4567-df17-4b5b-bfbc-3945f2985df0] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:09:18.282201 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7f855245-e842-4e60-b64f-4429ca6d0d1f tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:09:18.282654 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7f855245-e842-4e60-b64f-4429ca6d0d1f tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:09:18.283419 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7f855245-e842-4e60-b64f-4429ca6d0d1f tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:09:18.283855 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7f855245-e842-4e60-b64f-4429ca6d0d1f tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:09:18.444305 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-7f855245-e842-4e60-b64f-4429ca6d0d1f tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb9e87eb6734c4ea35a0fdf4cd3b397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62de2e01319a49feb262b98ca4a23a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:09:18.452067 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-7f855245-e842-4e60-b64f-4429ca6d0d1f tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] 10.222.0.17 "GET /compute/v2.1/servers/dcda4567-df17-4b5b-bfbc-3945f2985df0" status: 200 len: 1503 microversion: 2.1 time: 0.186551 Jul 23 22:09:18.452639 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3323/5933] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:09:18 2022] GET /compute/v2.1/servers/dcda4567-df17-4b5b-bfbc-3945f2985df0 => generated 1503 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:09:18.468686 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-327fc3ca-1979-45a5-a172-e528171c9488 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:09:18.469651 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-327fc3ca-1979-45a5-a172-e528171c9488 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] [instance: dcda4567-df17-4b5b-bfbc-3945f2985df0] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:09:18.475862 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-327fc3ca-1979-45a5-a172-e528171c9488 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:09:18.476321 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-327fc3ca-1979-45a5-a172-e528171c9488 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:09:18.477099 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-327fc3ca-1979-45a5-a172-e528171c9488 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:09:18.477539 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-327fc3ca-1979-45a5-a172-e528171c9488 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:09:18.505426 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-327fc3ca-1979-45a5-a172-e528171c9488 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'cfb9e87eb6734c4ea35a0fdf4cd3b397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62de2e01319a49feb262b98ca4a23a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:09:18.511284 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-327fc3ca-1979-45a5-a172-e528171c9488 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] [instance: dcda4567-df17-4b5b-bfbc-3945f2985df0] Old instance type m1.heat2, new instance type m1.heat {{(pid=131320) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 23 22:09:18.520787 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-327fc3ca-1979-45a5-a172-e528171c9488 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 22:09:18.521374 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-327fc3ca-1979-45a5-a172-e528171c9488 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 22:09:18.521916 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-327fc3ca-1979-45a5-a172-e528171c9488 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 22:09:18.522674 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-327fc3ca-1979-45a5-a172-e528171c9488 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 22:09:18.523261 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-327fc3ca-1979-45a5-a172-e528171c9488 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 22:09:18.595899 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-327fc3ca-1979-45a5-a172-e528171c9488 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] 10.222.0.17 "POST /compute/v2.1/servers/dcda4567-df17-4b5b-bfbc-3945f2985df0/action" status: 202 len: 0 microversion: 2.1 time: 0.130933 Jul 23 22:09:18.596513 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3324/5934] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 22:09:18 2022] POST /compute/v2.1/servers/dcda4567-df17-4b5b-bfbc-3945f2985df0/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 22:09:18.604358 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d3bfe0f7-5c05-44bd-acf6-3b19de6666f8 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:09:18.604982 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d3bfe0f7-5c05-44bd-acf6-3b19de6666f8 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] [instance: dcda4567-df17-4b5b-bfbc-3945f2985df0] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:09:18.611274 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d3bfe0f7-5c05-44bd-acf6-3b19de6666f8 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:09:18.611724 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d3bfe0f7-5c05-44bd-acf6-3b19de6666f8 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:09:18.612499 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d3bfe0f7-5c05-44bd-acf6-3b19de6666f8 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:09:18.612941 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d3bfe0f7-5c05-44bd-acf6-3b19de6666f8 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:09:18.786024 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=8 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:09:18.793880 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d3bfe0f7-5c05-44bd-acf6-3b19de6666f8 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb9e87eb6734c4ea35a0fdf4cd3b397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62de2e01319a49feb262b98ca4a23a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:09:18.801554 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d3bfe0f7-5c05-44bd-acf6-3b19de6666f8 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] 10.222.0.17 "GET /compute/v2.1/servers/dcda4567-df17-4b5b-bfbc-3945f2985df0" status: 200 len: 1512 microversion: 2.1 time: 0.200790 Jul 23 22:09:18.802197 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3325/5935] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:09:18 2022] GET /compute/v2.1/servers/dcda4567-df17-4b5b-bfbc-3945f2985df0 => generated 1512 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:09:19.819473 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d173642c-fe25-4ece-b539-852ce5c6de35 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:09:19.820046 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d173642c-fe25-4ece-b539-852ce5c6de35 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] [instance: dcda4567-df17-4b5b-bfbc-3945f2985df0] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:09:19.822048 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=12 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:09:19.828773 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d173642c-fe25-4ece-b539-852ce5c6de35 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:09:19.829226 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d173642c-fe25-4ece-b539-852ce5c6de35 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:09:19.830037 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d173642c-fe25-4ece-b539-852ce5c6de35 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:09:19.830494 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d173642c-fe25-4ece-b539-852ce5c6de35 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:09:19.834966 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:09:19.974224 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d173642c-fe25-4ece-b539-852ce5c6de35 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb9e87eb6734c4ea35a0fdf4cd3b397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62de2e01319a49feb262b98ca4a23a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:09:19.982304 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d173642c-fe25-4ece-b539-852ce5c6de35 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] 10.222.0.17 "GET /compute/v2.1/servers/dcda4567-df17-4b5b-bfbc-3945f2985df0" status: 200 len: 1512 microversion: 2.1 time: 0.166775 Jul 23 22:09:19.983303 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3326/5936] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:09:19 2022] GET /compute/v2.1/servers/dcda4567-df17-4b5b-bfbc-3945f2985df0 => generated 1512 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:09:21.003198 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d7f6485c-ad3f-4e50-a966-8461628e6251 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:09:21.003880 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d7f6485c-ad3f-4e50-a966-8461628e6251 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] [instance: dcda4567-df17-4b5b-bfbc-3945f2985df0] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:09:21.011054 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d7f6485c-ad3f-4e50-a966-8461628e6251 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:09:21.011510 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d7f6485c-ad3f-4e50-a966-8461628e6251 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:09:21.012363 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d7f6485c-ad3f-4e50-a966-8461628e6251 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:09:21.012805 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d7f6485c-ad3f-4e50-a966-8461628e6251 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:09:21.146735 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d7f6485c-ad3f-4e50-a966-8461628e6251 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb9e87eb6734c4ea35a0fdf4cd3b397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62de2e01319a49feb262b98ca4a23a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:09:21.154765 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d7f6485c-ad3f-4e50-a966-8461628e6251 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] 10.222.0.17 "GET /compute/v2.1/servers/dcda4567-df17-4b5b-bfbc-3945f2985df0" status: 200 len: 1517 microversion: 2.1 time: 0.155713 Jul 23 22:09:21.155382 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3327/5937] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:09:20 2022] GET /compute/v2.1/servers/dcda4567-df17-4b5b-bfbc-3945f2985df0 => generated 1517 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:09:22.176698 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b9bcbf6f-2569-4547-90b4-bc8ef8f5acef tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:09:22.177330 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b9bcbf6f-2569-4547-90b4-bc8ef8f5acef tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] [instance: dcda4567-df17-4b5b-bfbc-3945f2985df0] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:09:22.187151 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b9bcbf6f-2569-4547-90b4-bc8ef8f5acef tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:09:22.187601 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b9bcbf6f-2569-4547-90b4-bc8ef8f5acef tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:09:22.188336 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b9bcbf6f-2569-4547-90b4-bc8ef8f5acef tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:09:22.188798 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b9bcbf6f-2569-4547-90b4-bc8ef8f5acef tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:09:22.318172 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b9bcbf6f-2569-4547-90b4-bc8ef8f5acef tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb9e87eb6734c4ea35a0fdf4cd3b397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62de2e01319a49feb262b98ca4a23a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:09:22.326209 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b9bcbf6f-2569-4547-90b4-bc8ef8f5acef tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] 10.222.0.17 "GET /compute/v2.1/servers/dcda4567-df17-4b5b-bfbc-3945f2985df0" status: 200 len: 1517 microversion: 2.1 time: 0.155816 Jul 23 22:09:22.326791 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3328/5938] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:09:22 2022] GET /compute/v2.1/servers/dcda4567-df17-4b5b-bfbc-3945f2985df0 => generated 1517 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:09:23.346775 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-86f40ad3-9735-4877-92af-5da366837fc8 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:09:23.347588 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-86f40ad3-9735-4877-92af-5da366837fc8 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] [instance: dcda4567-df17-4b5b-bfbc-3945f2985df0] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:09:23.357191 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-86f40ad3-9735-4877-92af-5da366837fc8 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:09:23.357800 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-86f40ad3-9735-4877-92af-5da366837fc8 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:09:23.358870 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-86f40ad3-9735-4877-92af-5da366837fc8 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:09:23.359461 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-86f40ad3-9735-4877-92af-5da366837fc8 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:09:23.505223 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-86f40ad3-9735-4877-92af-5da366837fc8 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb9e87eb6734c4ea35a0fdf4cd3b397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62de2e01319a49feb262b98ca4a23a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:09:23.516998 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-86f40ad3-9735-4877-92af-5da366837fc8 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] 10.222.0.17 "GET /compute/v2.1/servers/dcda4567-df17-4b5b-bfbc-3945f2985df0" status: 200 len: 1517 microversion: 2.1 time: 0.175411 Jul 23 22:09:23.517845 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3329/5939] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:09:23 2022] GET /compute/v2.1/servers/dcda4567-df17-4b5b-bfbc-3945f2985df0 => generated 1517 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:09:24.539138 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d49b129f-efc9-4569-9657-6c76fc6101c7 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:09:24.539848 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d49b129f-efc9-4569-9657-6c76fc6101c7 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] [instance: dcda4567-df17-4b5b-bfbc-3945f2985df0] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:09:24.547712 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d49b129f-efc9-4569-9657-6c76fc6101c7 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:09:24.548169 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d49b129f-efc9-4569-9657-6c76fc6101c7 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:09:24.548942 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d49b129f-efc9-4569-9657-6c76fc6101c7 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:09:24.549384 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d49b129f-efc9-4569-9657-6c76fc6101c7 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:09:24.681832 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d49b129f-efc9-4569-9657-6c76fc6101c7 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb9e87eb6734c4ea35a0fdf4cd3b397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62de2e01319a49feb262b98ca4a23a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:09:24.693249 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d49b129f-efc9-4569-9657-6c76fc6101c7 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] 10.222.0.17 "GET /compute/v2.1/servers/dcda4567-df17-4b5b-bfbc-3945f2985df0" status: 200 len: 1517 microversion: 2.1 time: 0.158169 Jul 23 22:09:24.694051 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3330/5940] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:09:24 2022] GET /compute/v2.1/servers/dcda4567-df17-4b5b-bfbc-3945f2985df0 => generated 1517 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:09:25.715221 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-337ed05c-5673-4f46-9a8a-e4788c6e75ae tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:09:25.716364 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-337ed05c-5673-4f46-9a8a-e4788c6e75ae tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] [instance: dcda4567-df17-4b5b-bfbc-3945f2985df0] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:09:25.723674 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-337ed05c-5673-4f46-9a8a-e4788c6e75ae tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:09:25.724136 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-337ed05c-5673-4f46-9a8a-e4788c6e75ae tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:09:25.724912 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-337ed05c-5673-4f46-9a8a-e4788c6e75ae tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:09:25.725357 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-337ed05c-5673-4f46-9a8a-e4788c6e75ae tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:09:25.862548 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-337ed05c-5673-4f46-9a8a-e4788c6e75ae tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb9e87eb6734c4ea35a0fdf4cd3b397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62de2e01319a49feb262b98ca4a23a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:09:25.870201 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-337ed05c-5673-4f46-9a8a-e4788c6e75ae tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] 10.222.0.17 "GET /compute/v2.1/servers/dcda4567-df17-4b5b-bfbc-3945f2985df0" status: 200 len: 1517 microversion: 2.1 time: 0.161908 Jul 23 22:09:25.870776 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3331/5941] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:09:25 2022] GET /compute/v2.1/servers/dcda4567-df17-4b5b-bfbc-3945f2985df0 => generated 1517 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:09:26.891095 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-cde2880f-0f66-4fad-b0e1-44a756bbd2ed tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:09:26.892085 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-cde2880f-0f66-4fad-b0e1-44a756bbd2ed tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] [instance: dcda4567-df17-4b5b-bfbc-3945f2985df0] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:09:26.904001 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cde2880f-0f66-4fad-b0e1-44a756bbd2ed tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:09:26.904818 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cde2880f-0f66-4fad-b0e1-44a756bbd2ed tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:09:26.906126 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cde2880f-0f66-4fad-b0e1-44a756bbd2ed tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:09:26.907147 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cde2880f-0f66-4fad-b0e1-44a756bbd2ed tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:09:27.050148 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-cde2880f-0f66-4fad-b0e1-44a756bbd2ed tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb9e87eb6734c4ea35a0fdf4cd3b397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62de2e01319a49feb262b98ca4a23a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:09:27.057907 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-cde2880f-0f66-4fad-b0e1-44a756bbd2ed tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] 10.222.0.17 "GET /compute/v2.1/servers/dcda4567-df17-4b5b-bfbc-3945f2985df0" status: 200 len: 1517 microversion: 2.1 time: 0.173151 Jul 23 22:09:27.058516 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3332/5942] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:09:26 2022] GET /compute/v2.1/servers/dcda4567-df17-4b5b-bfbc-3945f2985df0 => generated 1517 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:09:28.075458 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6a7a56a1-94f4-4cf9-b88a-2b03ee4fc15e tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:09:28.076082 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6a7a56a1-94f4-4cf9-b88a-2b03ee4fc15e tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] [instance: dcda4567-df17-4b5b-bfbc-3945f2985df0] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:09:28.083351 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6a7a56a1-94f4-4cf9-b88a-2b03ee4fc15e tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:09:28.083815 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6a7a56a1-94f4-4cf9-b88a-2b03ee4fc15e tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:09:28.084953 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6a7a56a1-94f4-4cf9-b88a-2b03ee4fc15e tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:09:28.085396 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6a7a56a1-94f4-4cf9-b88a-2b03ee4fc15e tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:09:28.499029 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6a7a56a1-94f4-4cf9-b88a-2b03ee4fc15e tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb9e87eb6734c4ea35a0fdf4cd3b397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62de2e01319a49feb262b98ca4a23a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:09:28.507014 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6a7a56a1-94f4-4cf9-b88a-2b03ee4fc15e tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] 10.222.0.17 "GET /compute/v2.1/servers/dcda4567-df17-4b5b-bfbc-3945f2985df0" status: 200 len: 1517 microversion: 2.1 time: 0.435680 Jul 23 22:09:28.507602 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3333/5943] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:09:28 2022] GET /compute/v2.1/servers/dcda4567-df17-4b5b-bfbc-3945f2985df0 => generated 1517 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:09:29.528796 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-be66b207-c325-4426-9b64-cc4932522c1b tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:09:29.529407 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-be66b207-c325-4426-9b64-cc4932522c1b tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] [instance: dcda4567-df17-4b5b-bfbc-3945f2985df0] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:09:29.536654 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-be66b207-c325-4426-9b64-cc4932522c1b tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:09:29.537196 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-be66b207-c325-4426-9b64-cc4932522c1b tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:09:29.538012 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-be66b207-c325-4426-9b64-cc4932522c1b tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:09:29.538460 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-be66b207-c325-4426-9b64-cc4932522c1b tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:09:29.677043 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-be66b207-c325-4426-9b64-cc4932522c1b tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb9e87eb6734c4ea35a0fdf4cd3b397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62de2e01319a49feb262b98ca4a23a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:09:29.685021 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-be66b207-c325-4426-9b64-cc4932522c1b tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] 10.222.0.17 "GET /compute/v2.1/servers/dcda4567-df17-4b5b-bfbc-3945f2985df0" status: 200 len: 1517 microversion: 2.1 time: 0.160246 Jul 23 22:09:29.685599 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3334/5944] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:09:29 2022] GET /compute/v2.1/servers/dcda4567-df17-4b5b-bfbc-3945f2985df0 => generated 1517 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:09:30.705732 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-61bc4620-24cd-4db2-9a5d-5237687d6996 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:09:30.706606 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-61bc4620-24cd-4db2-9a5d-5237687d6996 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] [instance: dcda4567-df17-4b5b-bfbc-3945f2985df0] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:09:30.710307 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:09:30.723964 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-61bc4620-24cd-4db2-9a5d-5237687d6996 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:09:30.724634 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-61bc4620-24cd-4db2-9a5d-5237687d6996 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:09:30.725841 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-61bc4620-24cd-4db2-9a5d-5237687d6996 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:09:30.726678 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-61bc4620-24cd-4db2-9a5d-5237687d6996 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:09:30.868244 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-61bc4620-24cd-4db2-9a5d-5237687d6996 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb9e87eb6734c4ea35a0fdf4cd3b397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62de2e01319a49feb262b98ca4a23a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:09:30.877978 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-61bc4620-24cd-4db2-9a5d-5237687d6996 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] 10.222.0.17 "GET /compute/v2.1/servers/dcda4567-df17-4b5b-bfbc-3945f2985df0" status: 200 len: 1517 microversion: 2.1 time: 0.177856 Jul 23 22:09:30.878534 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3335/5945] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:09:30 2022] GET /compute/v2.1/servers/dcda4567-df17-4b5b-bfbc-3945f2985df0 => generated 1517 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:09:31.895803 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-66991a69-b9e3-4ed0-abd1-1d4455e4fe27 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:09:31.896420 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-66991a69-b9e3-4ed0-abd1-1d4455e4fe27 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] [instance: dcda4567-df17-4b5b-bfbc-3945f2985df0] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:09:31.903871 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-66991a69-b9e3-4ed0-abd1-1d4455e4fe27 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:09:31.904323 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-66991a69-b9e3-4ed0-abd1-1d4455e4fe27 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:09:31.905097 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-66991a69-b9e3-4ed0-abd1-1d4455e4fe27 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:09:31.905535 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-66991a69-b9e3-4ed0-abd1-1d4455e4fe27 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:09:32.054625 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-66991a69-b9e3-4ed0-abd1-1d4455e4fe27 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb9e87eb6734c4ea35a0fdf4cd3b397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62de2e01319a49feb262b98ca4a23a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:09:32.062644 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-66991a69-b9e3-4ed0-abd1-1d4455e4fe27 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] 10.222.0.17 "GET /compute/v2.1/servers/dcda4567-df17-4b5b-bfbc-3945f2985df0" status: 200 len: 1517 microversion: 2.1 time: 0.170896 Jul 23 22:09:32.063220 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3336/5946] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:09:31 2022] GET /compute/v2.1/servers/dcda4567-df17-4b5b-bfbc-3945f2985df0 => generated 1517 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:09:33.082872 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f703c397-1382-41f7-b1a2-a6a66359b6b3 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:09:33.083486 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f703c397-1382-41f7-b1a2-a6a66359b6b3 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] [instance: dcda4567-df17-4b5b-bfbc-3945f2985df0] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:09:33.094200 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f703c397-1382-41f7-b1a2-a6a66359b6b3 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:09:33.094669 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f703c397-1382-41f7-b1a2-a6a66359b6b3 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:09:33.095444 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f703c397-1382-41f7-b1a2-a6a66359b6b3 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:09:33.095853 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f703c397-1382-41f7-b1a2-a6a66359b6b3 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:09:33.236119 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f703c397-1382-41f7-b1a2-a6a66359b6b3 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb9e87eb6734c4ea35a0fdf4cd3b397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62de2e01319a49feb262b98ca4a23a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:09:33.244042 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f703c397-1382-41f7-b1a2-a6a66359b6b3 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] 10.222.0.17 "GET /compute/v2.1/servers/dcda4567-df17-4b5b-bfbc-3945f2985df0" status: 200 len: 1517 microversion: 2.1 time: 0.167681 Jul 23 22:09:33.244617 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3337/5947] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:09:33 2022] GET /compute/v2.1/servers/dcda4567-df17-4b5b-bfbc-3945f2985df0 => generated 1517 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:09:34.264725 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6ed21c9c-c73c-44e4-b1eb-465ac42ad503 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:09:34.265716 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6ed21c9c-c73c-44e4-b1eb-465ac42ad503 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] [instance: dcda4567-df17-4b5b-bfbc-3945f2985df0] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:09:34.273074 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6ed21c9c-c73c-44e4-b1eb-465ac42ad503 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:09:34.273468 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6ed21c9c-c73c-44e4-b1eb-465ac42ad503 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:09:34.274291 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6ed21c9c-c73c-44e4-b1eb-465ac42ad503 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:09:34.274739 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6ed21c9c-c73c-44e4-b1eb-465ac42ad503 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:09:34.415080 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6ed21c9c-c73c-44e4-b1eb-465ac42ad503 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb9e87eb6734c4ea35a0fdf4cd3b397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62de2e01319a49feb262b98ca4a23a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:09:34.422886 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6ed21c9c-c73c-44e4-b1eb-465ac42ad503 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] 10.222.0.17 "GET /compute/v2.1/servers/dcda4567-df17-4b5b-bfbc-3945f2985df0" status: 200 len: 1517 microversion: 2.1 time: 0.164818 Jul 23 22:09:34.423470 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3338/5948] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:09:34 2022] GET /compute/v2.1/servers/dcda4567-df17-4b5b-bfbc-3945f2985df0 => generated 1517 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:09:35.449040 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-39bf7af4-fd56-45ac-b279-6006993ec11b tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:09:35.450119 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-39bf7af4-fd56-45ac-b279-6006993ec11b tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] [instance: dcda4567-df17-4b5b-bfbc-3945f2985df0] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:09:35.462167 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-39bf7af4-fd56-45ac-b279-6006993ec11b tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:09:35.462926 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-39bf7af4-fd56-45ac-b279-6006993ec11b tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:09:35.464191 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-39bf7af4-fd56-45ac-b279-6006993ec11b tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:09:35.464925 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-39bf7af4-fd56-45ac-b279-6006993ec11b tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:09:35.601233 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-39bf7af4-fd56-45ac-b279-6006993ec11b tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb9e87eb6734c4ea35a0fdf4cd3b397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62de2e01319a49feb262b98ca4a23a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:09:35.613096 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-39bf7af4-fd56-45ac-b279-6006993ec11b tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] 10.222.0.17 "GET /compute/v2.1/servers/dcda4567-df17-4b5b-bfbc-3945f2985df0" status: 200 len: 1517 microversion: 2.1 time: 0.170291 Jul 23 22:09:35.613895 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3339/5949] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:09:35 2022] GET /compute/v2.1/servers/dcda4567-df17-4b5b-bfbc-3945f2985df0 => generated 1517 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:09:36.639353 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-fe257970-abce-44b8-9278-7b6c39b9720b tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:09:36.640468 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-fe257970-abce-44b8-9278-7b6c39b9720b tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] [instance: dcda4567-df17-4b5b-bfbc-3945f2985df0] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:09:36.647740 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fe257970-abce-44b8-9278-7b6c39b9720b tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:09:36.648198 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fe257970-abce-44b8-9278-7b6c39b9720b tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:09:36.648972 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fe257970-abce-44b8-9278-7b6c39b9720b tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:09:36.649408 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fe257970-abce-44b8-9278-7b6c39b9720b tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:09:36.780999 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-fe257970-abce-44b8-9278-7b6c39b9720b tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb9e87eb6734c4ea35a0fdf4cd3b397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62de2e01319a49feb262b98ca4a23a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:09:36.789129 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-fe257970-abce-44b8-9278-7b6c39b9720b tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] 10.222.0.17 "GET /compute/v2.1/servers/dcda4567-df17-4b5b-bfbc-3945f2985df0" status: 200 len: 1517 microversion: 2.1 time: 0.156801 Jul 23 22:09:36.789703 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3340/5950] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:09:36 2022] GET /compute/v2.1/servers/dcda4567-df17-4b5b-bfbc-3945f2985df0 => generated 1517 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:09:37.807841 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-09249466-f793-4fec-a105-5842f4651095 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:09:37.808507 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-09249466-f793-4fec-a105-5842f4651095 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] [instance: dcda4567-df17-4b5b-bfbc-3945f2985df0] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:09:37.816438 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-09249466-f793-4fec-a105-5842f4651095 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:09:37.817156 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-09249466-f793-4fec-a105-5842f4651095 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:09:37.817701 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-09249466-f793-4fec-a105-5842f4651095 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:09:37.818288 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-09249466-f793-4fec-a105-5842f4651095 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:09:37.957271 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-09249466-f793-4fec-a105-5842f4651095 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb9e87eb6734c4ea35a0fdf4cd3b397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62de2e01319a49feb262b98ca4a23a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:09:37.965455 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-09249466-f793-4fec-a105-5842f4651095 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] 10.222.0.17 "GET /compute/v2.1/servers/dcda4567-df17-4b5b-bfbc-3945f2985df0" status: 200 len: 1517 microversion: 2.1 time: 0.162308 Jul 23 22:09:37.966049 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3341/5951] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:09:37 2022] GET /compute/v2.1/servers/dcda4567-df17-4b5b-bfbc-3945f2985df0 => generated 1517 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:09:38.991471 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ff98cf18-6911-4928-930a-d70d9f90e54e tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:09:38.992431 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ff98cf18-6911-4928-930a-d70d9f90e54e tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] [instance: dcda4567-df17-4b5b-bfbc-3945f2985df0] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:09:39.002611 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ff98cf18-6911-4928-930a-d70d9f90e54e tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:09:39.003074 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ff98cf18-6911-4928-930a-d70d9f90e54e tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:09:39.003866 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ff98cf18-6911-4928-930a-d70d9f90e54e tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:09:39.004306 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ff98cf18-6911-4928-930a-d70d9f90e54e tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:09:39.135390 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ff98cf18-6911-4928-930a-d70d9f90e54e tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb9e87eb6734c4ea35a0fdf4cd3b397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62de2e01319a49feb262b98ca4a23a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:09:39.138898 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=100 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:09:39.144177 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ff98cf18-6911-4928-930a-d70d9f90e54e tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] 10.222.0.17 "GET /compute/v2.1/servers/dcda4567-df17-4b5b-bfbc-3945f2985df0" status: 200 len: 1517 microversion: 2.1 time: 0.158963 Jul 23 22:09:39.144760 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3342/5952] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:09:38 2022] GET /compute/v2.1/servers/dcda4567-df17-4b5b-bfbc-3945f2985df0 => generated 1517 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:09:40.170029 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9f7886e6-3c1b-42a1-a4ca-1098393cd35c tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:09:40.170983 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-9f7886e6-3c1b-42a1-a4ca-1098393cd35c tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] [instance: dcda4567-df17-4b5b-bfbc-3945f2985df0] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:09:40.179407 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9f7886e6-3c1b-42a1-a4ca-1098393cd35c tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:09:40.179870 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9f7886e6-3c1b-42a1-a4ca-1098393cd35c tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:09:40.180653 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9f7886e6-3c1b-42a1-a4ca-1098393cd35c tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:09:40.181114 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9f7886e6-3c1b-42a1-a4ca-1098393cd35c tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:09:40.324862 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-9f7886e6-3c1b-42a1-a4ca-1098393cd35c tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb9e87eb6734c4ea35a0fdf4cd3b397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62de2e01319a49feb262b98ca4a23a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:09:40.333157 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9f7886e6-3c1b-42a1-a4ca-1098393cd35c tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] 10.222.0.17 "GET /compute/v2.1/servers/dcda4567-df17-4b5b-bfbc-3945f2985df0" status: 200 len: 1517 microversion: 2.1 time: 0.169969 Jul 23 22:09:40.333738 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3343/5953] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:09:40 2022] GET /compute/v2.1/servers/dcda4567-df17-4b5b-bfbc-3945f2985df0 => generated 1517 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:09:41.355442 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-45e1a336-ba53-4bf9-ba68-0226a72c052a tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:09:41.356467 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-45e1a336-ba53-4bf9-ba68-0226a72c052a tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] [instance: dcda4567-df17-4b5b-bfbc-3945f2985df0] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:09:41.368152 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-45e1a336-ba53-4bf9-ba68-0226a72c052a tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:09:41.368902 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-45e1a336-ba53-4bf9-ba68-0226a72c052a tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:09:41.370227 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-45e1a336-ba53-4bf9-ba68-0226a72c052a tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:09:41.370969 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-45e1a336-ba53-4bf9-ba68-0226a72c052a tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:09:41.506461 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-45e1a336-ba53-4bf9-ba68-0226a72c052a tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb9e87eb6734c4ea35a0fdf4cd3b397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62de2e01319a49feb262b98ca4a23a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:09:41.514114 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-45e1a336-ba53-4bf9-ba68-0226a72c052a tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] 10.222.0.17 "GET /compute/v2.1/servers/dcda4567-df17-4b5b-bfbc-3945f2985df0" status: 200 len: 1517 microversion: 2.1 time: 0.165389 Jul 23 22:09:41.514695 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3344/5954] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:09:41 2022] GET /compute/v2.1/servers/dcda4567-df17-4b5b-bfbc-3945f2985df0 => generated 1517 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:09:42.540975 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-55cb19f9-73ab-458e-b7ef-49b060325823 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:09:42.542092 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-55cb19f9-73ab-458e-b7ef-49b060325823 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] [instance: dcda4567-df17-4b5b-bfbc-3945f2985df0] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:09:42.551925 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-55cb19f9-73ab-458e-b7ef-49b060325823 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:09:42.552382 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-55cb19f9-73ab-458e-b7ef-49b060325823 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:09:42.553149 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-55cb19f9-73ab-458e-b7ef-49b060325823 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:09:42.553590 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-55cb19f9-73ab-458e-b7ef-49b060325823 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:09:42.685422 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-55cb19f9-73ab-458e-b7ef-49b060325823 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb9e87eb6734c4ea35a0fdf4cd3b397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62de2e01319a49feb262b98ca4a23a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:09:42.693677 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-55cb19f9-73ab-458e-b7ef-49b060325823 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] 10.222.0.17 "GET /compute/v2.1/servers/dcda4567-df17-4b5b-bfbc-3945f2985df0" status: 200 len: 1517 microversion: 2.1 time: 0.159511 Jul 23 22:09:42.694297 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3345/5955] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:09:42 2022] GET /compute/v2.1/servers/dcda4567-df17-4b5b-bfbc-3945f2985df0 => generated 1517 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:09:43.719355 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4dc1911f-3d88-4e68-b14f-b49008bf16c2 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:09:43.720551 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-4dc1911f-3d88-4e68-b14f-b49008bf16c2 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] [instance: dcda4567-df17-4b5b-bfbc-3945f2985df0] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:09:43.728284 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4dc1911f-3d88-4e68-b14f-b49008bf16c2 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:09:43.728737 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4dc1911f-3d88-4e68-b14f-b49008bf16c2 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:09:43.729522 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4dc1911f-3d88-4e68-b14f-b49008bf16c2 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:09:43.729997 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4dc1911f-3d88-4e68-b14f-b49008bf16c2 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:09:43.867566 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-4dc1911f-3d88-4e68-b14f-b49008bf16c2 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb9e87eb6734c4ea35a0fdf4cd3b397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62de2e01319a49feb262b98ca4a23a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:09:43.879441 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4dc1911f-3d88-4e68-b14f-b49008bf16c2 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] 10.222.0.17 "GET /compute/v2.1/servers/dcda4567-df17-4b5b-bfbc-3945f2985df0" status: 200 len: 1517 microversion: 2.1 time: 0.166644 Jul 23 22:09:43.880250 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3346/5956] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:09:43 2022] GET /compute/v2.1/servers/dcda4567-df17-4b5b-bfbc-3945f2985df0 => generated 1517 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:09:44.898482 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5f8ec60d-82a7-44af-88f3-18b74828831e tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:09:44.899106 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5f8ec60d-82a7-44af-88f3-18b74828831e tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] [instance: dcda4567-df17-4b5b-bfbc-3945f2985df0] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:09:44.906284 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5f8ec60d-82a7-44af-88f3-18b74828831e tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:09:44.906739 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5f8ec60d-82a7-44af-88f3-18b74828831e tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:09:44.907512 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5f8ec60d-82a7-44af-88f3-18b74828831e tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:09:44.907953 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5f8ec60d-82a7-44af-88f3-18b74828831e tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:09:45.045147 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5f8ec60d-82a7-44af-88f3-18b74828831e tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb9e87eb6734c4ea35a0fdf4cd3b397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62de2e01319a49feb262b98ca4a23a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:09:45.053284 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5f8ec60d-82a7-44af-88f3-18b74828831e tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] 10.222.0.17 "GET /compute/v2.1/servers/dcda4567-df17-4b5b-bfbc-3945f2985df0" status: 200 len: 1517 microversion: 2.1 time: 0.158964 Jul 23 22:09:45.054010 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3347/5957] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:09:44 2022] GET /compute/v2.1/servers/dcda4567-df17-4b5b-bfbc-3945f2985df0 => generated 1517 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:09:46.074283 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4e195a17-0bc9-4213-a977-cea9f8f798ef tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:09:46.075165 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-4e195a17-0bc9-4213-a977-cea9f8f798ef tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] [instance: dcda4567-df17-4b5b-bfbc-3945f2985df0] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:09:46.085281 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4e195a17-0bc9-4213-a977-cea9f8f798ef tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:09:46.085748 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4e195a17-0bc9-4213-a977-cea9f8f798ef tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:09:46.086567 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4e195a17-0bc9-4213-a977-cea9f8f798ef tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:09:46.087012 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4e195a17-0bc9-4213-a977-cea9f8f798ef tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:09:46.222050 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-4e195a17-0bc9-4213-a977-cea9f8f798ef tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb9e87eb6734c4ea35a0fdf4cd3b397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62de2e01319a49feb262b98ca4a23a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:09:46.229740 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4e195a17-0bc9-4213-a977-cea9f8f798ef tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] 10.222.0.17 "GET /compute/v2.1/servers/dcda4567-df17-4b5b-bfbc-3945f2985df0" status: 200 len: 1517 microversion: 2.1 time: 0.162373 Jul 23 22:09:46.230351 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3348/5958] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:09:46 2022] GET /compute/v2.1/servers/dcda4567-df17-4b5b-bfbc-3945f2985df0 => generated 1517 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:09:47.251063 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-258f332b-4a08-4b47-bbb5-aaa100f728b1 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:09:47.252183 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-258f332b-4a08-4b47-bbb5-aaa100f728b1 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] [instance: dcda4567-df17-4b5b-bfbc-3945f2985df0] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:09:47.259827 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-258f332b-4a08-4b47-bbb5-aaa100f728b1 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:09:47.260316 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-258f332b-4a08-4b47-bbb5-aaa100f728b1 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:09:47.261075 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-258f332b-4a08-4b47-bbb5-aaa100f728b1 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:09:47.261529 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-258f332b-4a08-4b47-bbb5-aaa100f728b1 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:09:47.398494 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-258f332b-4a08-4b47-bbb5-aaa100f728b1 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb9e87eb6734c4ea35a0fdf4cd3b397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62de2e01319a49feb262b98ca4a23a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:09:47.409805 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-258f332b-4a08-4b47-bbb5-aaa100f728b1 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] 10.222.0.17 "GET /compute/v2.1/servers/dcda4567-df17-4b5b-bfbc-3945f2985df0" status: 200 len: 1517 microversion: 2.1 time: 0.165431 Jul 23 22:09:47.410437 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3349/5959] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:09:47 2022] GET /compute/v2.1/servers/dcda4567-df17-4b5b-bfbc-3945f2985df0 => generated 1517 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:09:48.300410 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-d263566c-e84a-4035-aa0b-8b154a49683e req-f392ab45-569a-4e21-8da0-e74488e655dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcda4567-df17-4b5b-bfbc-3945f2985df0", "name": "network-vif-unplugged", "status": "completed", "tag": "0437285c-cc34-4c78-9bf7-e975064c4835"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:09:48.310132 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-d263566c-e84a-4035-aa0b-8b154a49683e req-f392ab45-569a-4e21-8da0-e74488e655dc service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:09:48.310601 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-d263566c-e84a-4035-aa0b-8b154a49683e req-f392ab45-569a-4e21-8da0-e74488e655dc service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:09:48.322937 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-d263566c-e84a-4035-aa0b-8b154a49683e req-f392ab45-569a-4e21-8da0-e74488e655dc service nova] Creating event network-vif-unplugged:0437285c-cc34-4c78-9bf7-e975064c4835 for instance dcda4567-df17-4b5b-bfbc-3945f2985df0 on nch1-master-1 Jul 23 22:09:48.328697 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [req-d263566c-e84a-4035-aa0b-8b154a49683e req-f392ab45-569a-4e21-8da0-e74488e655dc service nova] Instance dcda4567-df17-4b5b-bfbc-3945f2985df0 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=131320) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 23 22:09:48.340636 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-d263566c-e84a-4035-aa0b-8b154a49683e req-f392ab45-569a-4e21-8da0-e74488e655dc service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044214 Jul 23 22:09:48.341450 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3350/5960] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:09:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:09:48.428586 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b8231a0e-b954-4b58-8c22-2ca6dc581cca tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:09:48.429383 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b8231a0e-b954-4b58-8c22-2ca6dc581cca tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] [instance: dcda4567-df17-4b5b-bfbc-3945f2985df0] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:09:48.436449 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b8231a0e-b954-4b58-8c22-2ca6dc581cca tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:09:48.437087 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b8231a0e-b954-4b58-8c22-2ca6dc581cca tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:09:48.437904 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b8231a0e-b954-4b58-8c22-2ca6dc581cca tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:09:48.438355 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b8231a0e-b954-4b58-8c22-2ca6dc581cca tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:09:48.583129 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b8231a0e-b954-4b58-8c22-2ca6dc581cca tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb9e87eb6734c4ea35a0fdf4cd3b397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62de2e01319a49feb262b98ca4a23a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:09:48.591677 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b8231a0e-b954-4b58-8c22-2ca6dc581cca tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] 10.222.0.17 "GET /compute/v2.1/servers/dcda4567-df17-4b5b-bfbc-3945f2985df0" status: 200 len: 1516 microversion: 2.1 time: 0.167660 Jul 23 22:09:48.592291 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3351/5961] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:09:48 2022] GET /compute/v2.1/servers/dcda4567-df17-4b5b-bfbc-3945f2985df0 => generated 1516 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:09:49.612066 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f48f0ccc-78a9-448a-aa82-1461e18f84cc tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:09:49.612918 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f48f0ccc-78a9-448a-aa82-1461e18f84cc tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] [instance: dcda4567-df17-4b5b-bfbc-3945f2985df0] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:09:49.623058 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f48f0ccc-78a9-448a-aa82-1461e18f84cc tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:09:49.623722 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f48f0ccc-78a9-448a-aa82-1461e18f84cc tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:09:49.624804 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f48f0ccc-78a9-448a-aa82-1461e18f84cc tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:09:49.625423 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f48f0ccc-78a9-448a-aa82-1461e18f84cc tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:09:49.766528 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f48f0ccc-78a9-448a-aa82-1461e18f84cc tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb9e87eb6734c4ea35a0fdf4cd3b397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62de2e01319a49feb262b98ca4a23a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:09:49.774653 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f48f0ccc-78a9-448a-aa82-1461e18f84cc tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] 10.222.0.17 "GET /compute/v2.1/servers/dcda4567-df17-4b5b-bfbc-3945f2985df0" status: 200 len: 1514 microversion: 2.1 time: 0.168246 Jul 23 22:09:49.775234 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3352/5962] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:09:49 2022] GET /compute/v2.1/servers/dcda4567-df17-4b5b-bfbc-3945f2985df0 => generated 1514 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:09:50.355375 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-a3af01f3-425a-4e0f-9614-e638e364ae94 req-7cf5e8f1-d969-41bd-8564-163c5887eb0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcda4567-df17-4b5b-bfbc-3945f2985df0", "tag": "0437285c-cc34-4c78-9bf7-e975064c4835"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:09:50.363927 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-a3af01f3-425a-4e0f-9614-e638e364ae94 req-7cf5e8f1-d969-41bd-8564-163c5887eb0d service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:09:50.364369 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-a3af01f3-425a-4e0f-9614-e638e364ae94 req-7cf5e8f1-d969-41bd-8564-163c5887eb0d service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:09:50.376169 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-a3af01f3-425a-4e0f-9614-e638e364ae94 req-7cf5e8f1-d969-41bd-8564-163c5887eb0d service nova] Creating event network-changed:0437285c-cc34-4c78-9bf7-e975064c4835 for instance dcda4567-df17-4b5b-bfbc-3945f2985df0 on nch1-master-1 Jul 23 22:09:50.382048 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [req-a3af01f3-425a-4e0f-9614-e638e364ae94 req-7cf5e8f1-d969-41bd-8564-163c5887eb0d service nova] Instance dcda4567-df17-4b5b-bfbc-3945f2985df0 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=131320) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 23 22:09:50.392714 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-a3af01f3-425a-4e0f-9614-e638e364ae94 req-7cf5e8f1-d969-41bd-8564-163c5887eb0d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041155 Jul 23 22:09:50.393300 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3353/5963] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:09:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:09:50.795757 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-83bd0618-f201-4b04-9e89-83f23f8e8add tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:09:50.796667 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-83bd0618-f201-4b04-9e89-83f23f8e8add tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] [instance: dcda4567-df17-4b5b-bfbc-3945f2985df0] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:09:50.805535 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-83bd0618-f201-4b04-9e89-83f23f8e8add tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:09:50.806025 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-83bd0618-f201-4b04-9e89-83f23f8e8add tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:09:50.806817 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-83bd0618-f201-4b04-9e89-83f23f8e8add tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:09:50.807255 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-83bd0618-f201-4b04-9e89-83f23f8e8add tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:09:50.947429 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-83bd0618-f201-4b04-9e89-83f23f8e8add tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb9e87eb6734c4ea35a0fdf4cd3b397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62de2e01319a49feb262b98ca4a23a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:09:50.955539 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-83bd0618-f201-4b04-9e89-83f23f8e8add tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] 10.222.0.17 "GET /compute/v2.1/servers/dcda4567-df17-4b5b-bfbc-3945f2985df0" status: 200 len: 1514 microversion: 2.1 time: 0.165907 Jul 23 22:09:50.956425 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3354/5964] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:09:50 2022] GET /compute/v2.1/servers/dcda4567-df17-4b5b-bfbc-3945f2985df0 => generated 1514 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:09:51.976283 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-74b5852a-4a6c-40fd-9f6d-af30dbcf4cf1 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:09:51.976972 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-74b5852a-4a6c-40fd-9f6d-af30dbcf4cf1 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] [instance: dcda4567-df17-4b5b-bfbc-3945f2985df0] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:09:51.984340 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-74b5852a-4a6c-40fd-9f6d-af30dbcf4cf1 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:09:51.984795 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-74b5852a-4a6c-40fd-9f6d-af30dbcf4cf1 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:09:51.985623 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-74b5852a-4a6c-40fd-9f6d-af30dbcf4cf1 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:09:51.986099 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-74b5852a-4a6c-40fd-9f6d-af30dbcf4cf1 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:09:52.140362 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-74b5852a-4a6c-40fd-9f6d-af30dbcf4cf1 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb9e87eb6734c4ea35a0fdf4cd3b397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62de2e01319a49feb262b98ca4a23a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:09:52.148948 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-74b5852a-4a6c-40fd-9f6d-af30dbcf4cf1 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] 10.222.0.17 "GET /compute/v2.1/servers/dcda4567-df17-4b5b-bfbc-3945f2985df0" status: 200 len: 1511 microversion: 2.1 time: 0.177739 Jul 23 22:09:52.149531 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3355/5965] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:09:51 2022] GET /compute/v2.1/servers/dcda4567-df17-4b5b-bfbc-3945f2985df0 => generated 1511 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:09:52.165037 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d4e776ed-d847-45fb-ac7a-13d290897286 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:09:52.165536 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d4e776ed-d847-45fb-ac7a-13d290897286 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] [instance: dcda4567-df17-4b5b-bfbc-3945f2985df0] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:09:52.171425 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d4e776ed-d847-45fb-ac7a-13d290897286 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:09:52.171879 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d4e776ed-d847-45fb-ac7a-13d290897286 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:09:52.172649 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d4e776ed-d847-45fb-ac7a-13d290897286 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:09:52.173121 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d4e776ed-d847-45fb-ac7a-13d290897286 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:09:52.199962 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d4e776ed-d847-45fb-ac7a-13d290897286 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] [instance: dcda4567-df17-4b5b-bfbc-3945f2985df0] Going to try to terminate instance {{(pid=131320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 22:09:52.252750 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.compute.api [None req-d4e776ed-d847-45fb-ac7a-13d290897286 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] [instance: dcda4567-df17-4b5b-bfbc-3945f2985df0] Found an unconfirmed migration during delete, id: 16, status: finished Jul 23 22:09:53.621551 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d4e776ed-d847-45fb-ac7a-13d290897286 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] 10.222.0.17 "DELETE /compute/v2.1/servers/dcda4567-df17-4b5b-bfbc-3945f2985df0" status: 204 len: 0 microversion: 2.1 time: 1.459712 Jul 23 22:09:53.622367 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3356/5966] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 22:09:52 2022] DELETE /compute/v2.1/servers/dcda4567-df17-4b5b-bfbc-3945f2985df0 => generated 0 bytes in 1461 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 22:09:53.627382 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-d18f542b-5c8e-4289-869e-f3957a79b36a req-8de85f15-1e06-4da8-a722-7884f894d891 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcda4567-df17-4b5b-bfbc-3945f2985df0", "name": "network-vif-plugged", "status": "completed", "tag": "0437285c-cc34-4c78-9bf7-e975064c4835"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:09:53.636305 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-d18f542b-5c8e-4289-869e-f3957a79b36a req-8de85f15-1e06-4da8-a722-7884f894d891 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:09:53.636755 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-d18f542b-5c8e-4289-869e-f3957a79b36a req-8de85f15-1e06-4da8-a722-7884f894d891 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:09:53.647907 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-d18f542b-5c8e-4289-869e-f3957a79b36a req-8de85f15-1e06-4da8-a722-7884f894d891 service nova] Creating event network-vif-plugged:0437285c-cc34-4c78-9bf7-e975064c4835 for instance dcda4567-df17-4b5b-bfbc-3945f2985df0 on nch1-master-1 Jul 23 22:09:53.653000 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-d18f542b-5c8e-4289-869e-f3957a79b36a req-8de85f15-1e06-4da8-a722-7884f894d891 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029407 Jul 23 22:09:53.653532 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3357/5967] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:09:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:09:53.658520 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-280f19e5-bc0d-45fe-84e1-af0b2c682f4e tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:09:53.659223 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-280f19e5-bc0d-45fe-84e1-af0b2c682f4e tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] [instance: dcda4567-df17-4b5b-bfbc-3945f2985df0] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:09:53.665952 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-280f19e5-bc0d-45fe-84e1-af0b2c682f4e tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:09:53.666408 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-280f19e5-bc0d-45fe-84e1-af0b2c682f4e tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:09:53.667176 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-280f19e5-bc0d-45fe-84e1-af0b2c682f4e tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:09:53.667625 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-280f19e5-bc0d-45fe-84e1-af0b2c682f4e tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:09:53.687947 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:09:53.806836 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-280f19e5-bc0d-45fe-84e1-af0b2c682f4e tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb9e87eb6734c4ea35a0fdf4cd3b397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62de2e01319a49feb262b98ca4a23a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:09:53.815972 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-280f19e5-bc0d-45fe-84e1-af0b2c682f4e tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] 10.222.0.17 "GET /compute/v2.1/servers/dcda4567-df17-4b5b-bfbc-3945f2985df0" status: 200 len: 1503 microversion: 2.1 time: 0.161275 Jul 23 22:09:53.822565 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3358/5968] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:09:53 2022] GET /compute/v2.1/servers/dcda4567-df17-4b5b-bfbc-3945f2985df0 => generated 1503 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:09:54.834331 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f8e806f2-4e6b-4d4a-924d-9de74778a97d tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:09:54.835002 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f8e806f2-4e6b-4d4a-924d-9de74778a97d tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] [instance: dcda4567-df17-4b5b-bfbc-3945f2985df0] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:09:54.842628 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f8e806f2-4e6b-4d4a-924d-9de74778a97d tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:09:54.843089 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f8e806f2-4e6b-4d4a-924d-9de74778a97d tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:09:54.843869 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f8e806f2-4e6b-4d4a-924d-9de74778a97d tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:09:54.844312 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f8e806f2-4e6b-4d4a-924d-9de74778a97d tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:09:54.980596 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f8e806f2-4e6b-4d4a-924d-9de74778a97d tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfb9e87eb6734c4ea35a0fdf4cd3b397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62de2e01319a49feb262b98ca4a23a7b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:09:54.989349 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f8e806f2-4e6b-4d4a-924d-9de74778a97d tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] 10.222.0.17 "GET /compute/v2.1/servers/dcda4567-df17-4b5b-bfbc-3945f2985df0" status: 200 len: 1503 microversion: 2.1 time: 0.159380 Jul 23 22:09:54.989959 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3359/5969] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:09:54 2022] GET /compute/v2.1/servers/dcda4567-df17-4b5b-bfbc-3945f2985df0 => generated 1503 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:09:55.463822 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-92db7cde-f41a-4dd7-a487-9e52255555c9 req-b55b31bc-0783-4d87-98ce-dfac928360be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcda4567-df17-4b5b-bfbc-3945f2985df0", "name": "network-vif-deleted", "tag": "0437285c-cc34-4c78-9bf7-e975064c4835"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:09:55.475076 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-92db7cde-f41a-4dd7-a487-9e52255555c9 req-b55b31bc-0783-4d87-98ce-dfac928360be service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:09:55.475516 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-92db7cde-f41a-4dd7-a487-9e52255555c9 req-b55b31bc-0783-4d87-98ce-dfac928360be service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:09:55.487260 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-92db7cde-f41a-4dd7-a487-9e52255555c9 req-b55b31bc-0783-4d87-98ce-dfac928360be service nova] Creating event network-vif-deleted:0437285c-cc34-4c78-9bf7-e975064c4835 for instance dcda4567-df17-4b5b-bfbc-3945f2985df0 on nch1-master-1 Jul 23 22:09:55.492118 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-92db7cde-f41a-4dd7-a487-9e52255555c9 req-b55b31bc-0783-4d87-98ce-dfac928360be service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032204 Jul 23 22:09:55.492740 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3360/5970] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:09:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 22:09:56.014260 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0f475112-ac16-4adb-9514-09ba35931e93 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:09:56.015395 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-0f475112-ac16-4adb-9514-09ba35931e93 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] [instance: dcda4567-df17-4b5b-bfbc-3945f2985df0] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:09:56.024262 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0f475112-ac16-4adb-9514-09ba35931e93 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:09:56.024718 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0f475112-ac16-4adb-9514-09ba35931e93 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:09:56.025500 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0f475112-ac16-4adb-9514-09ba35931e93 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:09:56.026020 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0f475112-ac16-4adb-9514-09ba35931e93 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:09:56.039823 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-0f475112-ac16-4adb-9514-09ba35931e93 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] HTTP exception thrown: Instance dcda4567-df17-4b5b-bfbc-3945f2985df0 could not be found. Jul 23 22:09:56.041502 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0f475112-ac16-4adb-9514-09ba35931e93 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Request method failure captured: Jul 23 22:09:56.041502 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/dcda4567-df17-4b5b-bfbc-3945f2985df0 HTTP/1.1 Jul 23 22:09:56.041502 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 22:09:56.041502 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 22:09:56.041502 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 22:09:56.041502 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 22:09:56.041502 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 22:09:56.041502 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 22:09:56.041502 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 22:09:56.041502 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 22:09:56.041502 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3HGEsxAE2u4dD38OKGpOQmdP9dkC-K7d2A6gAdSa6SUMvi4HcAs_-mNHfD_rbyN1VAHrFsDV4dawWC6DfsBfgdIkXF3P5w2aVOiJpwvzoxHvp1a82jp3taVfhyXpIkEHEmmCFdkP5EyomDfRvTgqpWExg1nWW20G77kWbxCgfJIZmuE Jul 23 22:09:56.041502 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 22:09:56.041502 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 22:09:56.041502 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 22:09:56.041502 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 22:09:56.041502 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 22:09:56.041502 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 22:09:56.041502 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 62de2e01319a49feb262b98ca4a23a7b Jul 23 22:09:56.041502 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-DeleteServersTestJSON-1893310596 Jul 23 22:09:56.041502 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 22:09:56.041502 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 22:09:56.041502 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/62de2e01319a49feb262b98ca4a23a7b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/62de2e01319a49feb262b98ca4a23a7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_62de2e01319a49feb262b98ca4a23a7b", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/62de2e01319a49feb262b98ca4a23a7b"}]}] Jul 23 22:09:56.041502 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-DeleteServersTestJSON-1893310596 Jul 23 22:09:56.041502 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 62de2e01319a49feb262b98ca4a23a7b Jul 23 22:09:56.041502 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-DeleteServersTestJSON-1893310596 Jul 23 22:09:56.041502 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-DeleteServersTestJSON-1893310596-project Jul 23 22:09:56.041502 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 22:09:56.041502 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 22:09:56.041502 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: cfb9e87eb6734c4ea35a0fdf4cd3b397 Jul 23 22:09:56.041502 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-DeleteServersTestJSON-1893310596-project Jul 23 22:09:56.041502 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 22:09:56.041502 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance dcda4567-df17-4b5b-bfbc-3945f2985df0 could not be found. Jul 23 22:09:56.041502 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': 'dcda4567-df17-4b5b-bfbc-3945f2985df0'} Jul 23 22:09:56.041502 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 22:09:56.041502 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:09:56.041502 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 22:09:56.041502 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 22:09:56.041502 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 22:09:56.041502 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 22:09:56.041502 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 22:09:56.041502 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 22:09:56.041502 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 22:09:56.041502 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 22:09:56.041502 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcda4567-df17-4b5b-bfbc-3945f2985df0 could not be found. Jul 23 22:09:56.041502 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:09:56.041502 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:09:56.041502 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:09:56.041502 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:09:56.041502 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:09:56.041502 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:09:56.041502 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 22:09:56.041502 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 22:09:56.041502 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 22:09:56.041502 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 22:09:56.041502 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 22:09:56.041502 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 22:09:56.041502 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 22:09:56.041502 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 22:09:56.041502 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 22:09:56.041502 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 22:09:56.041502 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcda4567-df17-4b5b-bfbc-3945f2985df0 could not be found. Jul 23 22:09:56.041502 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:09:56.041502 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:09:56.041502 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:09:56.045443 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:09:56.045443 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:09:56.045443 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:09:56.045443 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 22:09:56.045443 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 22:09:56.045443 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcda4567-df17-4b5b-bfbc-3945f2985df0 could not be found. Jul 23 22:09:56.045443 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:09:56.045443 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0f475112-ac16-4adb-9514-09ba35931e93 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Returning 404 to user: Instance dcda4567-df17-4b5b-bfbc-3945f2985df0 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 22:09:56.045443 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-0f475112-ac16-4adb-9514-09ba35931e93 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] 10.222.0.17 "GET /compute/v2.1/servers/dcda4567-df17-4b5b-bfbc-3945f2985df0" status: 404 len: 111 microversion: 2.1 time: 0.037494 Jul 23 22:09:56.046751 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3361/5971] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:09:56 2022] GET /compute/v2.1/servers/dcda4567-df17-4b5b-bfbc-3945f2985df0 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 22:09:56.057444 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1e6cba45-7c69-49ea-b701-5f09b44db176 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:09:56.057981 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1e6cba45-7c69-49ea-b701-5f09b44db176 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] [instance: dcda4567-df17-4b5b-bfbc-3945f2985df0] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:09:56.064014 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1e6cba45-7c69-49ea-b701-5f09b44db176 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:09:56.064471 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1e6cba45-7c69-49ea-b701-5f09b44db176 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:09:56.065235 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1e6cba45-7c69-49ea-b701-5f09b44db176 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:09:56.065673 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1e6cba45-7c69-49ea-b701-5f09b44db176 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:09:56.079354 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-1e6cba45-7c69-49ea-b701-5f09b44db176 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] HTTP exception thrown: Instance dcda4567-df17-4b5b-bfbc-3945f2985df0 could not be found. Jul 23 22:09:56.080896 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1e6cba45-7c69-49ea-b701-5f09b44db176 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Request method failure captured: Jul 23 22:09:56.080896 ncdv-master-1 devstack@n-api.service[131320]: request: DELETE /compute/v2.1/servers/dcda4567-df17-4b5b-bfbc-3945f2985df0 HTTP/1.1 Jul 23 22:09:56.080896 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 22:09:56.080896 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 22:09:56.080896 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 22:09:56.080896 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 22:09:56.080896 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 22:09:56.080896 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 22:09:56.080896 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 22:09:56.080896 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 22:09:56.080896 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3HGEsxAE2u4dD38OKGpOQmdP9dkC-K7d2A6gAdSa6SUMvi4HcAs_-mNHfD_rbyN1VAHrFsDV4dawWC6DfsBfgdIkXF3P5w2aVOiJpwvzoxHvp1a82jp3taVfhyXpIkEHEmmCFdkP5EyomDfRvTgqpWExg1nWW20G77kWbxCgfJIZmuE Jul 23 22:09:56.080896 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 22:09:56.080896 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 22:09:56.080896 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 22:09:56.080896 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 22:09:56.080896 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 22:09:56.080896 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 22:09:56.080896 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 62de2e01319a49feb262b98ca4a23a7b Jul 23 22:09:56.080896 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-DeleteServersTestJSON-1893310596 Jul 23 22:09:56.080896 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 22:09:56.080896 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 22:09:56.080896 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/62de2e01319a49feb262b98ca4a23a7b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/62de2e01319a49feb262b98ca4a23a7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_62de2e01319a49feb262b98ca4a23a7b", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/62de2e01319a49feb262b98ca4a23a7b"}]}] Jul 23 22:09:56.080896 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-DeleteServersTestJSON-1893310596 Jul 23 22:09:56.080896 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 62de2e01319a49feb262b98ca4a23a7b Jul 23 22:09:56.080896 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-DeleteServersTestJSON-1893310596 Jul 23 22:09:56.080896 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-DeleteServersTestJSON-1893310596-project Jul 23 22:09:56.080896 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 22:09:56.080896 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 22:09:56.080896 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: cfb9e87eb6734c4ea35a0fdf4cd3b397 Jul 23 22:09:56.080896 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-DeleteServersTestJSON-1893310596-project Jul 23 22:09:56.080896 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 22:09:56.080896 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance dcda4567-df17-4b5b-bfbc-3945f2985df0 could not be found. Jul 23 22:09:56.080896 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': 'dcda4567-df17-4b5b-bfbc-3945f2985df0'} Jul 23 22:09:56.080896 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 22:09:56.080896 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:09:56.080896 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 22:09:56.080896 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 22:09:56.080896 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 22:09:56.080896 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 22:09:56.080896 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 22:09:56.080896 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 22:09:56.080896 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 22:09:56.080896 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 22:09:56.080896 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcda4567-df17-4b5b-bfbc-3945f2985df0 could not be found. Jul 23 22:09:56.080896 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:09:56.080896 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:09:56.080896 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:09:56.080896 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:09:56.080896 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:09:56.080896 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:09:56.080896 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 22:09:56.080896 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 22:09:56.080896 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 22:09:56.080896 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 22:09:56.080896 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 23 22:09:56.080896 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 23 22:09:56.080896 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 23 22:09:56.080896 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 23 22:09:56.080896 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 22:09:56.080896 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 22:09:56.080896 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 22:09:56.080896 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 22:09:56.085048 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcda4567-df17-4b5b-bfbc-3945f2985df0 could not be found. Jul 23 22:09:56.085048 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:09:56.085048 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:09:56.085048 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:09:56.085048 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:09:56.085048 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:09:56.085048 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:09:56.085048 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 22:09:56.085048 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 22:09:56.085048 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcda4567-df17-4b5b-bfbc-3945f2985df0 could not be found. Jul 23 22:09:56.085048 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:09:56.085048 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1e6cba45-7c69-49ea-b701-5f09b44db176 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Returning 404 to user: Instance dcda4567-df17-4b5b-bfbc-3945f2985df0 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 22:09:56.085048 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1e6cba45-7c69-49ea-b701-5f09b44db176 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] 10.222.0.17 "DELETE /compute/v2.1/servers/dcda4567-df17-4b5b-bfbc-3945f2985df0" status: 404 len: 111 microversion: 2.1 time: 0.029221 Jul 23 22:09:56.085048 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3362/5972] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 22:09:56 2022] DELETE /compute/v2.1/servers/dcda4567-df17-4b5b-bfbc-3945f2985df0 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 22:09:56.090635 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3ef1ba18-1bad-4725-8b6f-dbf7d2eb4a59 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:09:56.091229 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-3ef1ba18-1bad-4725-8b6f-dbf7d2eb4a59 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] [instance: dcda4567-df17-4b5b-bfbc-3945f2985df0] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:09:56.096930 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3ef1ba18-1bad-4725-8b6f-dbf7d2eb4a59 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:09:56.097382 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3ef1ba18-1bad-4725-8b6f-dbf7d2eb4a59 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:09:56.098174 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3ef1ba18-1bad-4725-8b6f-dbf7d2eb4a59 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:09:56.098614 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3ef1ba18-1bad-4725-8b6f-dbf7d2eb4a59 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:09:56.111890 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-3ef1ba18-1bad-4725-8b6f-dbf7d2eb4a59 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] HTTP exception thrown: Instance dcda4567-df17-4b5b-bfbc-3945f2985df0 could not be found. Jul 23 22:09:56.113375 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3ef1ba18-1bad-4725-8b6f-dbf7d2eb4a59 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Request method failure captured: Jul 23 22:09:56.113375 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/dcda4567-df17-4b5b-bfbc-3945f2985df0 HTTP/1.1 Jul 23 22:09:56.113375 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 22:09:56.113375 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 22:09:56.113375 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 22:09:56.113375 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 22:09:56.113375 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 22:09:56.113375 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 22:09:56.113375 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 22:09:56.113375 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 22:09:56.113375 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3HGEsxAE2u4dD38OKGpOQmdP9dkC-K7d2A6gAdSa6SUMvi4HcAs_-mNHfD_rbyN1VAHrFsDV4dawWC6DfsBfgdIkXF3P5w2aVOiJpwvzoxHvp1a82jp3taVfhyXpIkEHEmmCFdkP5EyomDfRvTgqpWExg1nWW20G77kWbxCgfJIZmuE Jul 23 22:09:56.113375 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 22:09:56.113375 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 22:09:56.113375 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 22:09:56.113375 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 22:09:56.113375 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 22:09:56.113375 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 22:09:56.113375 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 62de2e01319a49feb262b98ca4a23a7b Jul 23 22:09:56.113375 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-DeleteServersTestJSON-1893310596 Jul 23 22:09:56.113375 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 22:09:56.113375 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 22:09:56.113375 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/62de2e01319a49feb262b98ca4a23a7b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/62de2e01319a49feb262b98ca4a23a7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_62de2e01319a49feb262b98ca4a23a7b", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/62de2e01319a49feb262b98ca4a23a7b"}]}] Jul 23 22:09:56.113375 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-DeleteServersTestJSON-1893310596 Jul 23 22:09:56.113375 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 62de2e01319a49feb262b98ca4a23a7b Jul 23 22:09:56.113375 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-DeleteServersTestJSON-1893310596 Jul 23 22:09:56.113375 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-DeleteServersTestJSON-1893310596-project Jul 23 22:09:56.113375 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 22:09:56.113375 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 22:09:56.113375 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: cfb9e87eb6734c4ea35a0fdf4cd3b397 Jul 23 22:09:56.113375 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-DeleteServersTestJSON-1893310596-project Jul 23 22:09:56.113375 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 22:09:56.113375 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance dcda4567-df17-4b5b-bfbc-3945f2985df0 could not be found. Jul 23 22:09:56.113375 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': 'dcda4567-df17-4b5b-bfbc-3945f2985df0'} Jul 23 22:09:56.113375 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 22:09:56.113375 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:09:56.113375 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 22:09:56.113375 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 22:09:56.113375 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 22:09:56.113375 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 22:09:56.113375 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 22:09:56.113375 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 22:09:56.113375 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 22:09:56.113375 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 22:09:56.113375 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcda4567-df17-4b5b-bfbc-3945f2985df0 could not be found. Jul 23 22:09:56.113375 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:09:56.113375 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:09:56.113375 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:09:56.113375 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:09:56.113375 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:09:56.113375 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:09:56.113375 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 22:09:56.113375 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 22:09:56.113375 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 22:09:56.113375 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 22:09:56.113375 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 22:09:56.113375 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 22:09:56.113375 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 22:09:56.113375 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 22:09:56.113375 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 22:09:56.113375 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 22:09:56.113375 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcda4567-df17-4b5b-bfbc-3945f2985df0 could not be found. Jul 23 22:09:56.113375 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:09:56.113375 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:09:56.113375 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:09:56.117189 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:09:56.117189 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:09:56.117189 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:09:56.117189 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 22:09:56.117189 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 22:09:56.117189 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcda4567-df17-4b5b-bfbc-3945f2985df0 could not be found. Jul 23 22:09:56.117189 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:09:56.117189 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3ef1ba18-1bad-4725-8b6f-dbf7d2eb4a59 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] Returning 404 to user: Instance dcda4567-df17-4b5b-bfbc-3945f2985df0 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 22:09:56.117189 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-3ef1ba18-1bad-4725-8b6f-dbf7d2eb4a59 tempest-DeleteServersTestJSON-1893310596 tempest-DeleteServersTestJSON-1893310596-project] 10.222.0.17 "GET /compute/v2.1/servers/dcda4567-df17-4b5b-bfbc-3945f2985df0" status: 404 len: 111 microversion: 2.1 time: 0.027608 Jul 23 22:09:56.117189 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3363/5973] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:09:56 2022] GET /compute/v2.1/servers/dcda4567-df17-4b5b-bfbc-3945f2985df0 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 22:10:04.904528 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c885c3e8-b781-4c47-a7d4-1d80091b770c tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1950540184", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "networks": [{"uuid": "2341dfec-6875-4269-acf3-b45bc1fda127"}]}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:10:04.911503 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:10:04.959570 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-c885c3e8-b781-4c47-a7d4-1d80091b770c tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] validate_networks() for [('2341dfec-6875-4269-acf3-b45bc1fda127', None, None, None, None, None)] {{(pid=131320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 22:10:05.329523 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-c885c3e8-b781-4c47-a7d4-1d80091b770c tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 22:10:05.330013 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-c885c3e8-b781-4c47-a7d4-1d80091b770c tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 22:10:05.334190 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-c885c3e8-b781-4c47-a7d4-1d80091b770c tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 22:10:05.334631 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-c885c3e8-b781-4c47-a7d4-1d80091b770c tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 22:10:05.335072 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-c885c3e8-b781-4c47-a7d4-1d80091b770c tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 22:10:05.344857 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c885c3e8-b781-4c47-a7d4-1d80091b770c tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:05.345352 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c885c3e8-b781-4c47-a7d4-1d80091b770c tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:05.346126 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c885c3e8-b781-4c47-a7d4-1d80091b770c tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:05.346556 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c885c3e8-b781-4c47-a7d4-1d80091b770c tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:05.364683 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-c885c3e8-b781-4c47-a7d4-1d80091b770c tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Getting quotas for project ffd080cbf1b24a55b60c5035cb102a12. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 22:10:05.370540 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-c885c3e8-b781-4c47-a7d4-1d80091b770c tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Getting quotas for user 834c51a542834eebb2815f7fceeda333 and project ffd080cbf1b24a55b60c5035cb102a12. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 22:10:05.384063 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c885c3e8-b781-4c47-a7d4-1d80091b770c tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Going to run 1 instances... {{(pid=131320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 22:10:05.386467 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c885c3e8-b781-4c47-a7d4-1d80091b770c tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 4ed5b675-0efa-4ee6-81ff-f2161790e410] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 22:10:05.436697 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c885c3e8-b781-4c47-a7d4-1d80091b770c tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.657644 Jul 23 22:10:05.437447 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3364/5974] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 22:10:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 659 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 23 22:10:05.447266 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3e5b1126-e3e4-4f66-a824-a3380bc4ac2a tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:10:05.447869 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-3e5b1126-e3e4-4f66-a824-a3380bc4ac2a tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 4ed5b675-0efa-4ee6-81ff-f2161790e410] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:10:05.507749 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-3e5b1126-e3e4-4f66-a824-a3380bc4ac2a tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834c51a542834eebb2815f7fceeda333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd080cbf1b24a55b60c5035cb102a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:10:05.515857 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-3e5b1126-e3e4-4f66-a824-a3380bc4ac2a tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "GET /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410" status: 200 len: 1218 microversion: 2.1 time: 0.072259 Jul 23 22:10:05.516504 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3365/5975] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:10:05 2022] GET /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410 => generated 1218 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:10:06.532845 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-997af036-30a5-420c-adb7-dfbbb2a222ae tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:10:06.533458 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-997af036-30a5-420c-adb7-dfbbb2a222ae tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 4ed5b675-0efa-4ee6-81ff-f2161790e410] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:10:06.542409 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-997af036-30a5-420c-adb7-dfbbb2a222ae tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:06.543066 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-997af036-30a5-420c-adb7-dfbbb2a222ae tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:06.544034 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-997af036-30a5-420c-adb7-dfbbb2a222ae tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:06.544630 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-997af036-30a5-420c-adb7-dfbbb2a222ae tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:06.609551 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-997af036-30a5-420c-adb7-dfbbb2a222ae tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834c51a542834eebb2815f7fceeda333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd080cbf1b24a55b60c5035cb102a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:10:06.617406 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-997af036-30a5-420c-adb7-dfbbb2a222ae tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "GET /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410" status: 200 len: 1276 microversion: 2.1 time: 0.088464 Jul 23 22:10:06.618012 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3366/5976] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:10:06 2022] GET /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410 => generated 1276 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:10:07.634602 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5fb0ce93-a1dd-43f1-8b58-71a3519302a9 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:10:07.636119 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5fb0ce93-a1dd-43f1-8b58-71a3519302a9 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 4ed5b675-0efa-4ee6-81ff-f2161790e410] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:10:07.643839 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5fb0ce93-a1dd-43f1-8b58-71a3519302a9 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:07.644288 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5fb0ce93-a1dd-43f1-8b58-71a3519302a9 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:07.645088 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5fb0ce93-a1dd-43f1-8b58-71a3519302a9 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:07.645566 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5fb0ce93-a1dd-43f1-8b58-71a3519302a9 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:07.815319 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5fb0ce93-a1dd-43f1-8b58-71a3519302a9 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834c51a542834eebb2815f7fceeda333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd080cbf1b24a55b60c5035cb102a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:10:07.834508 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5fb0ce93-a1dd-43f1-8b58-71a3519302a9 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "GET /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410" status: 200 len: 1318 microversion: 2.1 time: 0.203673 Jul 23 22:10:07.845035 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3367/5977] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:10:07 2022] GET /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410 => generated 1318 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:10:08.295038 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-151b3dff-76cf-4d2c-93e8-ce78390877ec req-357d5a34-f83b-46c3-bfa0-6a7598431cb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ed5b675-0efa-4ee6-81ff-f2161790e410", "tag": "17fc4834-0500-4721-8b58-15ae341fc950"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:10:08.303991 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-151b3dff-76cf-4d2c-93e8-ce78390877ec req-357d5a34-f83b-46c3-bfa0-6a7598431cb6 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:08.304447 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-151b3dff-76cf-4d2c-93e8-ce78390877ec req-357d5a34-f83b-46c3-bfa0-6a7598431cb6 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:08.325390 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-151b3dff-76cf-4d2c-93e8-ce78390877ec req-357d5a34-f83b-46c3-bfa0-6a7598431cb6 service nova] Creating event network-changed:17fc4834-0500-4721-8b58-15ae341fc950 for instance 4ed5b675-0efa-4ee6-81ff-f2161790e410 on nch2-master-1 Jul 23 22:10:08.331350 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-151b3dff-76cf-4d2c-93e8-ce78390877ec req-357d5a34-f83b-46c3-bfa0-6a7598431cb6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040106 Jul 23 22:10:08.332356 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3368/5978] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:10:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 22:10:08.852976 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5ef695a5-84c8-4d7f-b274-ac8fc0b2f14f tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:10:08.853657 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5ef695a5-84c8-4d7f-b274-ac8fc0b2f14f tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 4ed5b675-0efa-4ee6-81ff-f2161790e410] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:10:08.860553 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5ef695a5-84c8-4d7f-b274-ac8fc0b2f14f tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:08.861009 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5ef695a5-84c8-4d7f-b274-ac8fc0b2f14f tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:08.861788 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5ef695a5-84c8-4d7f-b274-ac8fc0b2f14f tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:08.862266 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5ef695a5-84c8-4d7f-b274-ac8fc0b2f14f tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:08.996437 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5ef695a5-84c8-4d7f-b274-ac8fc0b2f14f tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834c51a542834eebb2815f7fceeda333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd080cbf1b24a55b60c5035cb102a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:10:09.006043 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5ef695a5-84c8-4d7f-b274-ac8fc0b2f14f tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "GET /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410" status: 200 len: 1318 microversion: 2.1 time: 0.158390 Jul 23 22:10:09.006871 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3369/5979] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:10:08 2022] GET /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:10:10.024920 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6f12f6d7-0401-40c0-8804-f08d713928d0 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:10:10.025542 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6f12f6d7-0401-40c0-8804-f08d713928d0 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 4ed5b675-0efa-4ee6-81ff-f2161790e410] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:10:10.032699 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6f12f6d7-0401-40c0-8804-f08d713928d0 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:10.033432 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6f12f6d7-0401-40c0-8804-f08d713928d0 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:10.034360 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6f12f6d7-0401-40c0-8804-f08d713928d0 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:10.034815 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6f12f6d7-0401-40c0-8804-f08d713928d0 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:10.186558 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6f12f6d7-0401-40c0-8804-f08d713928d0 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834c51a542834eebb2815f7fceeda333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd080cbf1b24a55b60c5035cb102a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:10:10.194842 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6f12f6d7-0401-40c0-8804-f08d713928d0 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "GET /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410" status: 200 len: 1318 microversion: 2.1 time: 0.173979 Jul 23 22:10:10.195417 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3370/5980] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:10:10 2022] GET /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410 => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:10:11.213772 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-896bbfbd-63e2-4a4e-9e30-0be5229321b8 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:10:11.214801 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-896bbfbd-63e2-4a4e-9e30-0be5229321b8 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 4ed5b675-0efa-4ee6-81ff-f2161790e410] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:10:11.224364 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-896bbfbd-63e2-4a4e-9e30-0be5229321b8 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:11.225001 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-896bbfbd-63e2-4a4e-9e30-0be5229321b8 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:11.226109 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-896bbfbd-63e2-4a4e-9e30-0be5229321b8 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:11.226694 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-896bbfbd-63e2-4a4e-9e30-0be5229321b8 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:11.367326 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-896bbfbd-63e2-4a4e-9e30-0be5229321b8 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834c51a542834eebb2815f7fceeda333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd080cbf1b24a55b60c5035cb102a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:10:11.375675 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-896bbfbd-63e2-4a4e-9e30-0be5229321b8 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "GET /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410" status: 200 len: 1318 microversion: 2.1 time: 0.167335 Jul 23 22:10:11.376262 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3371/5981] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:10:11 2022] GET /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:10:12.398020 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3baa44cf-63ec-4f16-bb74-149add0cdbde tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:10:12.399075 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-3baa44cf-63ec-4f16-bb74-149add0cdbde tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 4ed5b675-0efa-4ee6-81ff-f2161790e410] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:10:12.410664 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3baa44cf-63ec-4f16-bb74-149add0cdbde tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:12.411410 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3baa44cf-63ec-4f16-bb74-149add0cdbde tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:12.412682 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3baa44cf-63ec-4f16-bb74-149add0cdbde tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:12.413412 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3baa44cf-63ec-4f16-bb74-149add0cdbde tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:12.556737 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-3baa44cf-63ec-4f16-bb74-149add0cdbde tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834c51a542834eebb2815f7fceeda333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd080cbf1b24a55b60c5035cb102a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:10:12.564688 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-3baa44cf-63ec-4f16-bb74-149add0cdbde tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "GET /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410" status: 200 len: 1318 microversion: 2.1 time: 0.173803 Jul 23 22:10:12.565242 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3372/5982] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:10:12 2022] GET /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410 => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:10:13.585844 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f3ea5595-53b3-4dcd-81d1-d4727c4d0bb4 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:10:13.586975 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f3ea5595-53b3-4dcd-81d1-d4727c4d0bb4 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 4ed5b675-0efa-4ee6-81ff-f2161790e410] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:10:13.594546 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f3ea5595-53b3-4dcd-81d1-d4727c4d0bb4 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:13.595001 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f3ea5595-53b3-4dcd-81d1-d4727c4d0bb4 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:13.595881 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f3ea5595-53b3-4dcd-81d1-d4727c4d0bb4 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:13.596327 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f3ea5595-53b3-4dcd-81d1-d4727c4d0bb4 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:13.736370 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f3ea5595-53b3-4dcd-81d1-d4727c4d0bb4 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834c51a542834eebb2815f7fceeda333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd080cbf1b24a55b60c5035cb102a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:10:13.744466 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f3ea5595-53b3-4dcd-81d1-d4727c4d0bb4 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "GET /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410" status: 200 len: 1318 microversion: 2.1 time: 0.165700 Jul 23 22:10:13.745061 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3373/5983] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:10:13 2022] GET /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:10:14.763466 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2203b970-45d4-4ef4-9dbc-e8357ef76a77 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:10:14.764059 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-2203b970-45d4-4ef4-9dbc-e8357ef76a77 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 4ed5b675-0efa-4ee6-81ff-f2161790e410] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:10:14.772339 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2203b970-45d4-4ef4-9dbc-e8357ef76a77 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:14.772798 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2203b970-45d4-4ef4-9dbc-e8357ef76a77 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:14.773614 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2203b970-45d4-4ef4-9dbc-e8357ef76a77 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:14.774098 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2203b970-45d4-4ef4-9dbc-e8357ef76a77 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:14.913412 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-2203b970-45d4-4ef4-9dbc-e8357ef76a77 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834c51a542834eebb2815f7fceeda333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd080cbf1b24a55b60c5035cb102a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:10:14.921139 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2203b970-45d4-4ef4-9dbc-e8357ef76a77 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "GET /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410" status: 200 len: 1318 microversion: 2.1 time: 0.162415 Jul 23 22:10:14.921729 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3374/5984] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:10:14 2022] GET /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:10:14.935273 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-d70224a3-5cf9-4b2f-9ab9-900db6f816f0 req-06a235da-6827-4b8b-842d-640bdd7c4e6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ed5b675-0efa-4ee6-81ff-f2161790e410", "name": "network-vif-plugged", "status": "completed", "tag": "17fc4834-0500-4721-8b58-15ae341fc950"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:10:14.943802 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-d70224a3-5cf9-4b2f-9ab9-900db6f816f0 req-06a235da-6827-4b8b-842d-640bdd7c4e6f service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:14.944452 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-d70224a3-5cf9-4b2f-9ab9-900db6f816f0 req-06a235da-6827-4b8b-842d-640bdd7c4e6f service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:14.955921 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-d70224a3-5cf9-4b2f-9ab9-900db6f816f0 req-06a235da-6827-4b8b-842d-640bdd7c4e6f service nova] Creating event network-vif-plugged:17fc4834-0500-4721-8b58-15ae341fc950 for instance 4ed5b675-0efa-4ee6-81ff-f2161790e410 on nch2-master-1 Jul 23 22:10:14.961216 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-d70224a3-5cf9-4b2f-9ab9-900db6f816f0 req-06a235da-6827-4b8b-842d-640bdd7c4e6f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029721 Jul 23 22:10:14.961818 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3375/5985] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:10:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:10:15.938448 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:10:15.939745 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=8 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:10:15.947676 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2ad5c988-2939-4f34-9130-101fd7ac176e tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:10:15.948632 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-2ad5c988-2939-4f34-9130-101fd7ac176e tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 4ed5b675-0efa-4ee6-81ff-f2161790e410] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:10:15.955871 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2ad5c988-2939-4f34-9130-101fd7ac176e tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:15.956317 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2ad5c988-2939-4f34-9130-101fd7ac176e tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:15.957080 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2ad5c988-2939-4f34-9130-101fd7ac176e tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:15.957514 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2ad5c988-2939-4f34-9130-101fd7ac176e tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:16.097434 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-2ad5c988-2939-4f34-9130-101fd7ac176e tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834c51a542834eebb2815f7fceeda333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd080cbf1b24a55b60c5035cb102a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:10:16.105310 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2ad5c988-2939-4f34-9130-101fd7ac176e tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "GET /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410" status: 200 len: 1318 microversion: 2.1 time: 0.168715 Jul 23 22:10:16.105914 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3376/5986] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:10:15 2022] GET /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:10:17.122989 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-af9d4be0-9ec4-414f-b53b-a8a25ca0b868 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:10:17.123567 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-af9d4be0-9ec4-414f-b53b-a8a25ca0b868 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 4ed5b675-0efa-4ee6-81ff-f2161790e410] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:10:17.131216 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-af9d4be0-9ec4-414f-b53b-a8a25ca0b868 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:17.131668 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-af9d4be0-9ec4-414f-b53b-a8a25ca0b868 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:17.132438 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-af9d4be0-9ec4-414f-b53b-a8a25ca0b868 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:17.132882 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-af9d4be0-9ec4-414f-b53b-a8a25ca0b868 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:17.279790 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-af9d4be0-9ec4-414f-b53b-a8a25ca0b868 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834c51a542834eebb2815f7fceeda333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd080cbf1b24a55b60c5035cb102a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:10:17.288095 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-af9d4be0-9ec4-414f-b53b-a8a25ca0b868 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "GET /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410" status: 200 len: 1507 microversion: 2.1 time: 0.169178 Jul 23 22:10:17.288688 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3377/5987] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:10:17 2022] GET /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410 => generated 1507 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:10:17.304164 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-395f12a4-0689-4100-817c-2c9c0948b8a6 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:10:17.304779 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-395f12a4-0689-4100-817c-2c9c0948b8a6 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 4ed5b675-0efa-4ee6-81ff-f2161790e410] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:10:17.311084 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-395f12a4-0689-4100-817c-2c9c0948b8a6 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:17.311544 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-395f12a4-0689-4100-817c-2c9c0948b8a6 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:17.312326 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-395f12a4-0689-4100-817c-2c9c0948b8a6 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:17.312773 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-395f12a4-0689-4100-817c-2c9c0948b8a6 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:17.445887 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-395f12a4-0689-4100-817c-2c9c0948b8a6 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834c51a542834eebb2815f7fceeda333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd080cbf1b24a55b60c5035cb102a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:10:17.454017 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-395f12a4-0689-4100-817c-2c9c0948b8a6 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "GET /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410" status: 200 len: 1507 microversion: 2.1 time: 0.153439 Jul 23 22:10:17.454610 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3378/5988] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:10:17 2022] GET /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410 => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:10:17.470324 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-41c44812-ab40-425d-8b50-60311754920f tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:10:17.471428 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-41c44812-ab40-425d-8b50-60311754920f tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 4ed5b675-0efa-4ee6-81ff-f2161790e410] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:10:17.477426 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-41c44812-ab40-425d-8b50-60311754920f tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:17.477982 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-41c44812-ab40-425d-8b50-60311754920f tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:17.478760 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-41c44812-ab40-425d-8b50-60311754920f tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:17.479210 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-41c44812-ab40-425d-8b50-60311754920f tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:17.549274 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-41c44812-ab40-425d-8b50-60311754920f tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "PUT /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410" status: 200 len: 1079 microversion: 2.1 time: 0.082136 Jul 23 22:10:17.550191 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3379/5989] 10.222.0.17 () {60 vars in 1255 bytes} [Sat Jul 23 22:10:17 2022] PUT /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410 => generated 1079 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:10:17.571295 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-57c9416a-7af4-4789-9fe6-b3a26c94c4c5 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:10:17.572160 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-57c9416a-7af4-4789-9fe6-b3a26c94c4c5 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 4ed5b675-0efa-4ee6-81ff-f2161790e410] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:10:17.579169 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-57c9416a-7af4-4789-9fe6-b3a26c94c4c5 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:17.579623 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-57c9416a-7af4-4789-9fe6-b3a26c94c4c5 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:17.580395 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-57c9416a-7af4-4789-9fe6-b3a26c94c4c5 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:17.580831 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-57c9416a-7af4-4789-9fe6-b3a26c94c4c5 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:17.585235 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:10:17.713009 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-57c9416a-7af4-4789-9fe6-b3a26c94c4c5 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834c51a542834eebb2815f7fceeda333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd080cbf1b24a55b60c5035cb102a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:10:17.724362 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-57c9416a-7af4-4789-9fe6-b3a26c94c4c5 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "GET /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410" status: 200 len: 1505 microversion: 2.1 time: 0.158858 Jul 23 22:10:17.725394 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3380/5990] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:10:17 2022] GET /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410 => generated 1505 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:10:17.740712 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-68d08297-86a9-4f0a-8ced-ffc495352378 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:10:17.741316 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-68d08297-86a9-4f0a-8ced-ffc495352378 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 4ed5b675-0efa-4ee6-81ff-f2161790e410] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:10:17.747386 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-68d08297-86a9-4f0a-8ced-ffc495352378 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:17.747844 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-68d08297-86a9-4f0a-8ced-ffc495352378 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:17.748605 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-68d08297-86a9-4f0a-8ced-ffc495352378 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:17.749043 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-68d08297-86a9-4f0a-8ced-ffc495352378 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:17.886951 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-68d08297-86a9-4f0a-8ced-ffc495352378 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834c51a542834eebb2815f7fceeda333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd080cbf1b24a55b60c5035cb102a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:10:17.895234 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-68d08297-86a9-4f0a-8ced-ffc495352378 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "GET /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410" status: 200 len: 1505 microversion: 2.1 time: 0.158200 Jul 23 22:10:17.895823 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3381/5991] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:10:17 2022] GET /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410 => generated 1505 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:10:17.911309 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b94cb703-bd6d-409b-9a5b-4b2467840b80 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:10:17.912235 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b94cb703-bd6d-409b-9a5b-4b2467840b80 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 4ed5b675-0efa-4ee6-81ff-f2161790e410] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:10:17.918402 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b94cb703-bd6d-409b-9a5b-4b2467840b80 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:17.918864 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b94cb703-bd6d-409b-9a5b-4b2467840b80 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:17.919621 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b94cb703-bd6d-409b-9a5b-4b2467840b80 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:17.920081 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b94cb703-bd6d-409b-9a5b-4b2467840b80 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:17.954083 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b94cb703-bd6d-409b-9a5b-4b2467840b80 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '834c51a542834eebb2815f7fceeda333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd080cbf1b24a55b60c5035cb102a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:10:17.963541 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b94cb703-bd6d-409b-9a5b-4b2467840b80 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 4ed5b675-0efa-4ee6-81ff-f2161790e410] Old instance type m1.heat2, new instance type m1.heat {{(pid=131320) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 23 22:10:17.970677 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-b94cb703-bd6d-409b-9a5b-4b2467840b80 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 22:10:17.971104 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-b94cb703-bd6d-409b-9a5b-4b2467840b80 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 22:10:17.971580 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-b94cb703-bd6d-409b-9a5b-4b2467840b80 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 22:10:17.971987 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-b94cb703-bd6d-409b-9a5b-4b2467840b80 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 22:10:17.972422 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-b94cb703-bd6d-409b-9a5b-4b2467840b80 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 22:10:18.039890 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b94cb703-bd6d-409b-9a5b-4b2467840b80 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "POST /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410/action" status: 202 len: 0 microversion: 2.1 time: 0.132244 Jul 23 22:10:18.040525 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3382/5992] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 22:10:17 2022] POST /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 22:10:18.048546 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a7864907-3cdf-484c-bbdd-3d2b506b7088 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:10:18.049153 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a7864907-3cdf-484c-bbdd-3d2b506b7088 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 4ed5b675-0efa-4ee6-81ff-f2161790e410] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:10:18.055380 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a7864907-3cdf-484c-bbdd-3d2b506b7088 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:18.055830 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a7864907-3cdf-484c-bbdd-3d2b506b7088 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:18.056602 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a7864907-3cdf-484c-bbdd-3d2b506b7088 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:18.057059 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a7864907-3cdf-484c-bbdd-3d2b506b7088 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:18.217466 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a7864907-3cdf-484c-bbdd-3d2b506b7088 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834c51a542834eebb2815f7fceeda333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd080cbf1b24a55b60c5035cb102a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:10:18.225103 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a7864907-3cdf-484c-bbdd-3d2b506b7088 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "GET /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410" status: 200 len: 1516 microversion: 2.1 time: 0.180239 Jul 23 22:10:18.225665 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3383/5993] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:10:18 2022] GET /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410 => generated 1516 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:10:19.243970 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-7419ded5-05e0-4de2-bc14-385ab71fd217 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:10:19.244625 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-7419ded5-05e0-4de2-bc14-385ab71fd217 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 4ed5b675-0efa-4ee6-81ff-f2161790e410] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:10:19.252002 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7419ded5-05e0-4de2-bc14-385ab71fd217 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:19.252460 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7419ded5-05e0-4de2-bc14-385ab71fd217 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:19.253237 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7419ded5-05e0-4de2-bc14-385ab71fd217 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:19.253679 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7419ded5-05e0-4de2-bc14-385ab71fd217 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:19.393698 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-7419ded5-05e0-4de2-bc14-385ab71fd217 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834c51a542834eebb2815f7fceeda333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd080cbf1b24a55b60c5035cb102a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:10:19.404657 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-7419ded5-05e0-4de2-bc14-385ab71fd217 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "GET /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410" status: 200 len: 1516 microversion: 2.1 time: 0.164656 Jul 23 22:10:19.405236 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3384/5994] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:10:19 2022] GET /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410 => generated 1516 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:10:20.426769 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3f66d4d5-8d83-41b0-bdf5-8ac96f6374f9 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:10:20.427952 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-3f66d4d5-8d83-41b0-bdf5-8ac96f6374f9 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 4ed5b675-0efa-4ee6-81ff-f2161790e410] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:10:20.439505 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3f66d4d5-8d83-41b0-bdf5-8ac96f6374f9 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:20.440275 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3f66d4d5-8d83-41b0-bdf5-8ac96f6374f9 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:20.441598 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3f66d4d5-8d83-41b0-bdf5-8ac96f6374f9 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:20.442388 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3f66d4d5-8d83-41b0-bdf5-8ac96f6374f9 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:20.580348 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-3f66d4d5-8d83-41b0-bdf5-8ac96f6374f9 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834c51a542834eebb2815f7fceeda333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd080cbf1b24a55b60c5035cb102a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:10:20.588973 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-3f66d4d5-8d83-41b0-bdf5-8ac96f6374f9 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "GET /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410" status: 200 len: 1521 microversion: 2.1 time: 0.168964 Jul 23 22:10:20.589542 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3385/5995] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:10:20 2022] GET /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:10:21.607435 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e51bac7a-d8b0-42e8-be1b-d9122c67f817 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:10:21.610720 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e51bac7a-d8b0-42e8-be1b-d9122c67f817 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 4ed5b675-0efa-4ee6-81ff-f2161790e410] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:10:21.615183 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e51bac7a-d8b0-42e8-be1b-d9122c67f817 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:21.616258 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e51bac7a-d8b0-42e8-be1b-d9122c67f817 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:21.616400 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e51bac7a-d8b0-42e8-be1b-d9122c67f817 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:21.616856 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e51bac7a-d8b0-42e8-be1b-d9122c67f817 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:21.759176 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e51bac7a-d8b0-42e8-be1b-d9122c67f817 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834c51a542834eebb2815f7fceeda333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd080cbf1b24a55b60c5035cb102a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:10:21.767525 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e51bac7a-d8b0-42e8-be1b-d9122c67f817 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "GET /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410" status: 200 len: 1521 microversion: 2.1 time: 0.165219 Jul 23 22:10:21.768097 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3386/5996] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:10:21 2022] GET /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:10:22.789151 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e0200b7b-da11-4ef6-8a2f-d18719a23299 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:10:22.790194 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e0200b7b-da11-4ef6-8a2f-d18719a23299 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 4ed5b675-0efa-4ee6-81ff-f2161790e410] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:10:22.798668 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e0200b7b-da11-4ef6-8a2f-d18719a23299 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:22.799119 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e0200b7b-da11-4ef6-8a2f-d18719a23299 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:22.799861 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e0200b7b-da11-4ef6-8a2f-d18719a23299 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:22.800323 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e0200b7b-da11-4ef6-8a2f-d18719a23299 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:22.938312 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e0200b7b-da11-4ef6-8a2f-d18719a23299 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834c51a542834eebb2815f7fceeda333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd080cbf1b24a55b60c5035cb102a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:10:22.947117 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e0200b7b-da11-4ef6-8a2f-d18719a23299 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "GET /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410" status: 200 len: 1521 microversion: 2.1 time: 0.164432 Jul 23 22:10:22.947930 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3387/5997] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:10:22 2022] GET /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:10:23.967852 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8fab123d-72ac-49fe-a510-3cfd353d921e tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:10:23.968548 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8fab123d-72ac-49fe-a510-3cfd353d921e tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 4ed5b675-0efa-4ee6-81ff-f2161790e410] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:10:23.976579 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8fab123d-72ac-49fe-a510-3cfd353d921e tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:23.977031 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8fab123d-72ac-49fe-a510-3cfd353d921e tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:23.977818 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8fab123d-72ac-49fe-a510-3cfd353d921e tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:23.978294 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8fab123d-72ac-49fe-a510-3cfd353d921e tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:24.120124 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8fab123d-72ac-49fe-a510-3cfd353d921e tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834c51a542834eebb2815f7fceeda333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd080cbf1b24a55b60c5035cb102a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:10:24.128255 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8fab123d-72ac-49fe-a510-3cfd353d921e tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "GET /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410" status: 200 len: 1521 microversion: 2.1 time: 0.165521 Jul 23 22:10:24.128832 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3388/5998] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:10:23 2022] GET /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:10:25.150013 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e3197030-80f4-41b5-9236-0990de83ea49 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:10:25.151023 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e3197030-80f4-41b5-9236-0990de83ea49 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 4ed5b675-0efa-4ee6-81ff-f2161790e410] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:10:25.162851 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e3197030-80f4-41b5-9236-0990de83ea49 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:25.163620 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e3197030-80f4-41b5-9236-0990de83ea49 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:25.164903 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e3197030-80f4-41b5-9236-0990de83ea49 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:25.165642 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e3197030-80f4-41b5-9236-0990de83ea49 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:25.318270 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e3197030-80f4-41b5-9236-0990de83ea49 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834c51a542834eebb2815f7fceeda333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd080cbf1b24a55b60c5035cb102a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:10:25.326344 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e3197030-80f4-41b5-9236-0990de83ea49 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "GET /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410" status: 200 len: 1521 microversion: 2.1 time: 0.183098 Jul 23 22:10:25.326923 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3389/5999] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:10:25 2022] GET /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410 => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:10:26.347966 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-65381bed-dbbc-47fa-97f4-0ec995296b02 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:10:26.348992 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-65381bed-dbbc-47fa-97f4-0ec995296b02 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 4ed5b675-0efa-4ee6-81ff-f2161790e410] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:10:26.359571 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-65381bed-dbbc-47fa-97f4-0ec995296b02 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:26.360029 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-65381bed-dbbc-47fa-97f4-0ec995296b02 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:26.360791 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-65381bed-dbbc-47fa-97f4-0ec995296b02 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:26.361229 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-65381bed-dbbc-47fa-97f4-0ec995296b02 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:26.500462 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-65381bed-dbbc-47fa-97f4-0ec995296b02 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834c51a542834eebb2815f7fceeda333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd080cbf1b24a55b60c5035cb102a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:10:26.508273 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-65381bed-dbbc-47fa-97f4-0ec995296b02 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "GET /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410" status: 200 len: 1521 microversion: 2.1 time: 0.167113 Jul 23 22:10:26.508857 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3390/6000] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:10:26 2022] GET /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:10:27.528828 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-735713bd-f6e8-4154-950a-1d627126d4b2 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:10:27.529915 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-735713bd-f6e8-4154-950a-1d627126d4b2 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 4ed5b675-0efa-4ee6-81ff-f2161790e410] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:10:27.538006 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-735713bd-f6e8-4154-950a-1d627126d4b2 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:27.538528 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-735713bd-f6e8-4154-950a-1d627126d4b2 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:27.539352 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-735713bd-f6e8-4154-950a-1d627126d4b2 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:27.539826 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-735713bd-f6e8-4154-950a-1d627126d4b2 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:27.679730 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-735713bd-f6e8-4154-950a-1d627126d4b2 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834c51a542834eebb2815f7fceeda333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd080cbf1b24a55b60c5035cb102a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:10:27.687822 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-735713bd-f6e8-4154-950a-1d627126d4b2 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "GET /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410" status: 200 len: 1521 microversion: 2.1 time: 0.165704 Jul 23 22:10:27.688439 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3391/6001] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:10:27 2022] GET /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:10:28.706184 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8c6b8a64-2f68-4e3c-af11-db47f23df680 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:10:28.706953 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8c6b8a64-2f68-4e3c-af11-db47f23df680 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 4ed5b675-0efa-4ee6-81ff-f2161790e410] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:10:28.716979 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8c6b8a64-2f68-4e3c-af11-db47f23df680 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:28.717586 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8c6b8a64-2f68-4e3c-af11-db47f23df680 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:28.718667 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8c6b8a64-2f68-4e3c-af11-db47f23df680 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:28.719252 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8c6b8a64-2f68-4e3c-af11-db47f23df680 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:28.857724 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8c6b8a64-2f68-4e3c-af11-db47f23df680 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834c51a542834eebb2815f7fceeda333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd080cbf1b24a55b60c5035cb102a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:10:28.865791 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8c6b8a64-2f68-4e3c-af11-db47f23df680 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "GET /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410" status: 200 len: 1521 microversion: 2.1 time: 0.164680 Jul 23 22:10:28.866638 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3392/6002] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:10:28 2022] GET /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:10:29.885675 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d88b33c2-b75a-4972-85d3-2528981a8361 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:10:29.886663 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d88b33c2-b75a-4972-85d3-2528981a8361 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 4ed5b675-0efa-4ee6-81ff-f2161790e410] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:10:29.897768 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d88b33c2-b75a-4972-85d3-2528981a8361 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:29.898483 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d88b33c2-b75a-4972-85d3-2528981a8361 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:29.899698 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d88b33c2-b75a-4972-85d3-2528981a8361 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:29.900382 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d88b33c2-b75a-4972-85d3-2528981a8361 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:30.038834 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d88b33c2-b75a-4972-85d3-2528981a8361 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834c51a542834eebb2815f7fceeda333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd080cbf1b24a55b60c5035cb102a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:10:30.046870 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d88b33c2-b75a-4972-85d3-2528981a8361 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "GET /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410" status: 200 len: 1521 microversion: 2.1 time: 0.167357 Jul 23 22:10:30.047426 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3393/6003] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:10:29 2022] GET /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:10:31.068743 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4974746a-fbc9-4700-8294-3e52ee9a3f13 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:10:31.069423 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-4974746a-fbc9-4700-8294-3e52ee9a3f13 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 4ed5b675-0efa-4ee6-81ff-f2161790e410] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:10:31.077188 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4974746a-fbc9-4700-8294-3e52ee9a3f13 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:31.077580 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4974746a-fbc9-4700-8294-3e52ee9a3f13 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:31.078390 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4974746a-fbc9-4700-8294-3e52ee9a3f13 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:31.078833 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4974746a-fbc9-4700-8294-3e52ee9a3f13 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:31.223975 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-4974746a-fbc9-4700-8294-3e52ee9a3f13 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834c51a542834eebb2815f7fceeda333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd080cbf1b24a55b60c5035cb102a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:10:31.231940 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4974746a-fbc9-4700-8294-3e52ee9a3f13 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "GET /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410" status: 200 len: 1521 microversion: 2.1 time: 0.167298 Jul 23 22:10:31.232497 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3394/6004] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:10:31 2022] GET /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:10:32.258327 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4c5b415a-296a-4b6e-864c-a96b07bbe670 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:10:32.259441 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-4c5b415a-296a-4b6e-864c-a96b07bbe670 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 4ed5b675-0efa-4ee6-81ff-f2161790e410] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:10:32.271246 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4c5b415a-296a-4b6e-864c-a96b07bbe670 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:32.272015 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4c5b415a-296a-4b6e-864c-a96b07bbe670 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:32.273291 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4c5b415a-296a-4b6e-864c-a96b07bbe670 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:32.274084 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4c5b415a-296a-4b6e-864c-a96b07bbe670 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:32.295819 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:10:32.418215 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-4c5b415a-296a-4b6e-864c-a96b07bbe670 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834c51a542834eebb2815f7fceeda333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd080cbf1b24a55b60c5035cb102a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:10:32.426296 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4c5b415a-296a-4b6e-864c-a96b07bbe670 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "GET /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410" status: 200 len: 1521 microversion: 2.1 time: 0.174587 Jul 23 22:10:32.426891 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3395/6005] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:10:32 2022] GET /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:10:33.448069 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-63309a39-8162-4a23-b9fb-2fb1f518aea0 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:10:33.449133 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-63309a39-8162-4a23-b9fb-2fb1f518aea0 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 4ed5b675-0efa-4ee6-81ff-f2161790e410] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:10:33.461458 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-63309a39-8162-4a23-b9fb-2fb1f518aea0 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:33.462304 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-63309a39-8162-4a23-b9fb-2fb1f518aea0 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:33.463609 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-63309a39-8162-4a23-b9fb-2fb1f518aea0 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:33.464363 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-63309a39-8162-4a23-b9fb-2fb1f518aea0 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:33.602823 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-63309a39-8162-4a23-b9fb-2fb1f518aea0 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834c51a542834eebb2815f7fceeda333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd080cbf1b24a55b60c5035cb102a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:10:33.610603 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-63309a39-8162-4a23-b9fb-2fb1f518aea0 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "GET /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410" status: 200 len: 1521 microversion: 2.1 time: 0.169174 Jul 23 22:10:33.611186 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3396/6006] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:10:33 2022] GET /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:10:34.633181 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-dbb36c0d-de96-44c7-a38c-8afc1e238735 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:10:34.634380 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-dbb36c0d-de96-44c7-a38c-8afc1e238735 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 4ed5b675-0efa-4ee6-81ff-f2161790e410] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:10:34.644970 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dbb36c0d-de96-44c7-a38c-8afc1e238735 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:34.645438 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dbb36c0d-de96-44c7-a38c-8afc1e238735 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:34.646262 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dbb36c0d-de96-44c7-a38c-8afc1e238735 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:34.646713 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dbb36c0d-de96-44c7-a38c-8afc1e238735 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:34.785758 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-dbb36c0d-de96-44c7-a38c-8afc1e238735 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834c51a542834eebb2815f7fceeda333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd080cbf1b24a55b60c5035cb102a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:10:34.793604 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-dbb36c0d-de96-44c7-a38c-8afc1e238735 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "GET /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410" status: 200 len: 1521 microversion: 2.1 time: 0.167301 Jul 23 22:10:34.794256 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3397/6007] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:10:34 2022] GET /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:10:35.815195 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4857fa5f-780e-4dab-834a-dbffac77c6b3 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:10:35.815889 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-4857fa5f-780e-4dab-834a-dbffac77c6b3 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 4ed5b675-0efa-4ee6-81ff-f2161790e410] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:10:35.818973 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:10:35.824262 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4857fa5f-780e-4dab-834a-dbffac77c6b3 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:35.824713 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4857fa5f-780e-4dab-834a-dbffac77c6b3 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:35.825511 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4857fa5f-780e-4dab-834a-dbffac77c6b3 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:35.825973 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4857fa5f-780e-4dab-834a-dbffac77c6b3 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:35.963674 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-4857fa5f-780e-4dab-834a-dbffac77c6b3 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834c51a542834eebb2815f7fceeda333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd080cbf1b24a55b60c5035cb102a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:10:35.971779 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4857fa5f-780e-4dab-834a-dbffac77c6b3 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "GET /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410" status: 200 len: 1521 microversion: 2.1 time: 0.162966 Jul 23 22:10:35.972376 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3398/6008] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:10:35 2022] GET /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:10:36.994524 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-78c2666d-9fc0-4023-822b-ce9eddf43184 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:10:36.995219 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-78c2666d-9fc0-4023-822b-ce9eddf43184 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 4ed5b675-0efa-4ee6-81ff-f2161790e410] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:10:37.002571 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-78c2666d-9fc0-4023-822b-ce9eddf43184 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:37.003104 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-78c2666d-9fc0-4023-822b-ce9eddf43184 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:37.003971 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-78c2666d-9fc0-4023-822b-ce9eddf43184 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:37.004465 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-78c2666d-9fc0-4023-822b-ce9eddf43184 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:37.142141 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-78c2666d-9fc0-4023-822b-ce9eddf43184 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834c51a542834eebb2815f7fceeda333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd080cbf1b24a55b60c5035cb102a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:10:37.150124 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-78c2666d-9fc0-4023-822b-ce9eddf43184 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "GET /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410" status: 200 len: 1521 microversion: 2.1 time: 0.160269 Jul 23 22:10:37.150708 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3399/6009] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:10:36 2022] GET /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:10:38.171623 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0714a9f7-7207-4354-adaf-9ebd2b8b4785 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:10:38.172615 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-0714a9f7-7207-4354-adaf-9ebd2b8b4785 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 4ed5b675-0efa-4ee6-81ff-f2161790e410] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:10:38.184055 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0714a9f7-7207-4354-adaf-9ebd2b8b4785 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:38.184819 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0714a9f7-7207-4354-adaf-9ebd2b8b4785 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:38.186143 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0714a9f7-7207-4354-adaf-9ebd2b8b4785 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:38.186935 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0714a9f7-7207-4354-adaf-9ebd2b8b4785 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:38.336350 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-0714a9f7-7207-4354-adaf-9ebd2b8b4785 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834c51a542834eebb2815f7fceeda333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd080cbf1b24a55b60c5035cb102a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:10:38.344511 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-0714a9f7-7207-4354-adaf-9ebd2b8b4785 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "GET /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410" status: 200 len: 1521 microversion: 2.1 time: 0.179790 Jul 23 22:10:38.345114 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3400/6010] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:10:38 2022] GET /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410 => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:10:39.365185 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1f7c6a99-e4b0-4380-bb82-617d365f6d3f tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:10:39.365942 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1f7c6a99-e4b0-4380-bb82-617d365f6d3f tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 4ed5b675-0efa-4ee6-81ff-f2161790e410] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:10:39.377062 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1f7c6a99-e4b0-4380-bb82-617d365f6d3f tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:39.377623 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1f7c6a99-e4b0-4380-bb82-617d365f6d3f tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:39.378576 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1f7c6a99-e4b0-4380-bb82-617d365f6d3f tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:39.379158 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1f7c6a99-e4b0-4380-bb82-617d365f6d3f tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:39.529624 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-1f7c6a99-e4b0-4380-bb82-617d365f6d3f tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834c51a542834eebb2815f7fceeda333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd080cbf1b24a55b60c5035cb102a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:10:39.537764 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1f7c6a99-e4b0-4380-bb82-617d365f6d3f tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "GET /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410" status: 200 len: 1521 microversion: 2.1 time: 0.178795 Jul 23 22:10:39.538413 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3401/6011] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:10:39 2022] GET /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:10:40.558951 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0bb5b90b-e695-4629-a007-cd4ae81dfd1c tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:10:40.560037 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-0bb5b90b-e695-4629-a007-cd4ae81dfd1c tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 4ed5b675-0efa-4ee6-81ff-f2161790e410] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:10:40.571867 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0bb5b90b-e695-4629-a007-cd4ae81dfd1c tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:40.572631 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0bb5b90b-e695-4629-a007-cd4ae81dfd1c tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:40.573921 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0bb5b90b-e695-4629-a007-cd4ae81dfd1c tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:40.574697 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0bb5b90b-e695-4629-a007-cd4ae81dfd1c tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:40.721566 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-0bb5b90b-e695-4629-a007-cd4ae81dfd1c tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834c51a542834eebb2815f7fceeda333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd080cbf1b24a55b60c5035cb102a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:10:40.730312 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-0bb5b90b-e695-4629-a007-cd4ae81dfd1c tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "GET /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410" status: 200 len: 1521 microversion: 2.1 time: 0.177936 Jul 23 22:10:40.730872 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3402/6012] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:10:40 2022] GET /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:10:41.751936 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-57a7c75f-0933-4783-bab5-051a80e49035 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:10:41.753007 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-57a7c75f-0933-4783-bab5-051a80e49035 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 4ed5b675-0efa-4ee6-81ff-f2161790e410] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:10:41.760593 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-57a7c75f-0933-4783-bab5-051a80e49035 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:41.761045 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-57a7c75f-0933-4783-bab5-051a80e49035 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:41.761813 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-57a7c75f-0933-4783-bab5-051a80e49035 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:41.762294 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-57a7c75f-0933-4783-bab5-051a80e49035 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:41.898314 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-57a7c75f-0933-4783-bab5-051a80e49035 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834c51a542834eebb2815f7fceeda333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd080cbf1b24a55b60c5035cb102a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:10:41.906039 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-57a7c75f-0933-4783-bab5-051a80e49035 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "GET /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410" status: 200 len: 1521 microversion: 2.1 time: 0.160609 Jul 23 22:10:41.906622 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3403/6013] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:10:41 2022] GET /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:10:42.923710 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9284644e-7317-4c04-8664-0c848c35160d tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:10:42.924353 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-9284644e-7317-4c04-8664-0c848c35160d tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 4ed5b675-0efa-4ee6-81ff-f2161790e410] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:10:42.931937 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9284644e-7317-4c04-8664-0c848c35160d tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:42.932387 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9284644e-7317-4c04-8664-0c848c35160d tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:42.933159 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9284644e-7317-4c04-8664-0c848c35160d tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:42.933603 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9284644e-7317-4c04-8664-0c848c35160d tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:43.065516 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-9284644e-7317-4c04-8664-0c848c35160d tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834c51a542834eebb2815f7fceeda333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd080cbf1b24a55b60c5035cb102a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:10:43.073439 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9284644e-7317-4c04-8664-0c848c35160d tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "GET /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410" status: 200 len: 1521 microversion: 2.1 time: 0.153677 Jul 23 22:10:43.073984 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3404/6014] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:10:42 2022] GET /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:10:44.091243 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-569ecccb-f947-41e8-b0fb-a881e4dddf4d tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:10:44.091868 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-569ecccb-f947-41e8-b0fb-a881e4dddf4d tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 4ed5b675-0efa-4ee6-81ff-f2161790e410] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:10:44.099617 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-569ecccb-f947-41e8-b0fb-a881e4dddf4d tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:44.100082 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-569ecccb-f947-41e8-b0fb-a881e4dddf4d tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:44.100865 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-569ecccb-f947-41e8-b0fb-a881e4dddf4d tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:44.101311 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-569ecccb-f947-41e8-b0fb-a881e4dddf4d tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:44.239827 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-569ecccb-f947-41e8-b0fb-a881e4dddf4d tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834c51a542834eebb2815f7fceeda333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd080cbf1b24a55b60c5035cb102a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:10:44.248263 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-569ecccb-f947-41e8-b0fb-a881e4dddf4d tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "GET /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410" status: 200 len: 1521 microversion: 2.1 time: 0.161103 Jul 23 22:10:44.248931 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3405/6015] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:10:44 2022] GET /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:10:45.270301 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b94ed2e8-1c4c-48ed-b906-8f4ff837e8a8 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:10:45.271387 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b94ed2e8-1c4c-48ed-b906-8f4ff837e8a8 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 4ed5b675-0efa-4ee6-81ff-f2161790e410] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:10:45.283228 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b94ed2e8-1c4c-48ed-b906-8f4ff837e8a8 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:45.283979 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b94ed2e8-1c4c-48ed-b906-8f4ff837e8a8 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:45.285247 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b94ed2e8-1c4c-48ed-b906-8f4ff837e8a8 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:45.286025 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b94ed2e8-1c4c-48ed-b906-8f4ff837e8a8 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:45.426169 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b94ed2e8-1c4c-48ed-b906-8f4ff837e8a8 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834c51a542834eebb2815f7fceeda333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd080cbf1b24a55b60c5035cb102a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:10:45.437608 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b94ed2e8-1c4c-48ed-b906-8f4ff837e8a8 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "GET /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410" status: 200 len: 1521 microversion: 2.1 time: 0.173684 Jul 23 22:10:45.438335 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3406/6016] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:10:45 2022] GET /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:10:46.459890 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a3f4b035-646b-406c-8b9a-ab1d20bcee87 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:10:46.460968 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a3f4b035-646b-406c-8b9a-ab1d20bcee87 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 4ed5b675-0efa-4ee6-81ff-f2161790e410] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:10:46.469631 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a3f4b035-646b-406c-8b9a-ab1d20bcee87 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:46.470209 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a3f4b035-646b-406c-8b9a-ab1d20bcee87 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:46.471122 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a3f4b035-646b-406c-8b9a-ab1d20bcee87 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:46.471646 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a3f4b035-646b-406c-8b9a-ab1d20bcee87 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:46.608730 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a3f4b035-646b-406c-8b9a-ab1d20bcee87 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834c51a542834eebb2815f7fceeda333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd080cbf1b24a55b60c5035cb102a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:10:46.616729 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a3f4b035-646b-406c-8b9a-ab1d20bcee87 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "GET /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410" status: 200 len: 1521 microversion: 2.1 time: 0.163894 Jul 23 22:10:46.617400 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3407/6017] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:10:46 2022] GET /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:10:47.300911 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-9a59f25a-c2cc-4cd9-8b6a-0f4a32816d01 req-6c2d7cbc-1d6c-444a-b98a-17d7c1cac6a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ed5b675-0efa-4ee6-81ff-f2161790e410", "name": "network-vif-unplugged", "status": "completed", "tag": "17fc4834-0500-4721-8b58-15ae341fc950"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:10:47.309968 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-9a59f25a-c2cc-4cd9-8b6a-0f4a32816d01 req-6c2d7cbc-1d6c-444a-b98a-17d7c1cac6a1 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:47.310457 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-9a59f25a-c2cc-4cd9-8b6a-0f4a32816d01 req-6c2d7cbc-1d6c-444a-b98a-17d7c1cac6a1 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:47.323370 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-9a59f25a-c2cc-4cd9-8b6a-0f4a32816d01 req-6c2d7cbc-1d6c-444a-b98a-17d7c1cac6a1 service nova] Creating event network-vif-unplugged:17fc4834-0500-4721-8b58-15ae341fc950 for instance 4ed5b675-0efa-4ee6-81ff-f2161790e410 on nch1-master-1 Jul 23 22:10:47.328772 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [req-9a59f25a-c2cc-4cd9-8b6a-0f4a32816d01 req-6c2d7cbc-1d6c-444a-b98a-17d7c1cac6a1 service nova] Instance 4ed5b675-0efa-4ee6-81ff-f2161790e410 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=131320) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 23 22:10:47.340449 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-9a59f25a-c2cc-4cd9-8b6a-0f4a32816d01 req-6c2d7cbc-1d6c-444a-b98a-17d7c1cac6a1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043385 Jul 23 22:10:47.341383 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3408/6018] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:10:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:10:47.635754 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-51eedc7d-7a30-4053-b8a6-9e869749fce7 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:10:47.636470 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-51eedc7d-7a30-4053-b8a6-9e869749fce7 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 4ed5b675-0efa-4ee6-81ff-f2161790e410] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:10:47.643198 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-51eedc7d-7a30-4053-b8a6-9e869749fce7 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:47.643656 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-51eedc7d-7a30-4053-b8a6-9e869749fce7 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:47.644452 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-51eedc7d-7a30-4053-b8a6-9e869749fce7 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:47.644891 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-51eedc7d-7a30-4053-b8a6-9e869749fce7 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:47.796057 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-51eedc7d-7a30-4053-b8a6-9e869749fce7 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834c51a542834eebb2815f7fceeda333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd080cbf1b24a55b60c5035cb102a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:10:47.804228 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-51eedc7d-7a30-4053-b8a6-9e869749fce7 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "GET /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410" status: 200 len: 1520 microversion: 2.1 time: 0.173722 Jul 23 22:10:47.804820 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3409/6019] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:10:47 2022] GET /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410 => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:10:48.822093 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4e4e40b7-5d90-4f80-8024-0ec42873ae66 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:10:48.822667 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-4e4e40b7-5d90-4f80-8024-0ec42873ae66 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 4ed5b675-0efa-4ee6-81ff-f2161790e410] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:10:48.830128 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4e4e40b7-5d90-4f80-8024-0ec42873ae66 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:48.830585 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4e4e40b7-5d90-4f80-8024-0ec42873ae66 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:48.831360 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4e4e40b7-5d90-4f80-8024-0ec42873ae66 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:48.831802 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4e4e40b7-5d90-4f80-8024-0ec42873ae66 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:48.984240 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-4e4e40b7-5d90-4f80-8024-0ec42873ae66 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834c51a542834eebb2815f7fceeda333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd080cbf1b24a55b60c5035cb102a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:10:48.992148 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4e4e40b7-5d90-4f80-8024-0ec42873ae66 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "GET /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410" status: 200 len: 1518 microversion: 2.1 time: 0.174027 Jul 23 22:10:48.992727 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3410/6020] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:10:48 2022] GET /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410 => generated 1518 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:10:49.358501 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-4a4ad3a6-64e1-4a8c-868e-c661590464c1 req-e097ca86-b680-4f96-b59d-18d7c830f7a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ed5b675-0efa-4ee6-81ff-f2161790e410", "tag": "17fc4834-0500-4721-8b58-15ae341fc950"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:10:49.367307 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-4a4ad3a6-64e1-4a8c-868e-c661590464c1 req-e097ca86-b680-4f96-b59d-18d7c830f7a5 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:49.367757 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-4a4ad3a6-64e1-4a8c-868e-c661590464c1 req-e097ca86-b680-4f96-b59d-18d7c830f7a5 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:49.379760 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-4a4ad3a6-64e1-4a8c-868e-c661590464c1 req-e097ca86-b680-4f96-b59d-18d7c830f7a5 service nova] Creating event network-changed:17fc4834-0500-4721-8b58-15ae341fc950 for instance 4ed5b675-0efa-4ee6-81ff-f2161790e410 on nch1-master-1 Jul 23 22:10:49.385591 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [req-4a4ad3a6-64e1-4a8c-868e-c661590464c1 req-e097ca86-b680-4f96-b59d-18d7c830f7a5 service nova] Instance 4ed5b675-0efa-4ee6-81ff-f2161790e410 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=131320) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 23 22:10:49.396486 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-4a4ad3a6-64e1-4a8c-868e-c661590464c1 req-e097ca86-b680-4f96-b59d-18d7c830f7a5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041757 Jul 23 22:10:49.397142 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3411/6021] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:10:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:10:50.012445 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c3bacf52-d4a0-4fc5-84ca-05c8e31ae8e3 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:10:50.013367 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c3bacf52-d4a0-4fc5-84ca-05c8e31ae8e3 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 4ed5b675-0efa-4ee6-81ff-f2161790e410] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:10:50.020135 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c3bacf52-d4a0-4fc5-84ca-05c8e31ae8e3 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:50.020590 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c3bacf52-d4a0-4fc5-84ca-05c8e31ae8e3 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:50.021412 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c3bacf52-d4a0-4fc5-84ca-05c8e31ae8e3 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:50.021834 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c3bacf52-d4a0-4fc5-84ca-05c8e31ae8e3 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:50.171095 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c3bacf52-d4a0-4fc5-84ca-05c8e31ae8e3 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834c51a542834eebb2815f7fceeda333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd080cbf1b24a55b60c5035cb102a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:10:50.174841 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=100 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:10:50.179846 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c3bacf52-d4a0-4fc5-84ca-05c8e31ae8e3 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "GET /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410" status: 200 len: 1515 microversion: 2.1 time: 0.172782 Jul 23 22:10:50.180448 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3412/6022] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:10:50 2022] GET /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410 => generated 1515 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:10:50.196524 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9135f32f-6587-4255-87b5-9f60bbfbbd72 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:10:50.197243 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-9135f32f-6587-4255-87b5-9f60bbfbbd72 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 4ed5b675-0efa-4ee6-81ff-f2161790e410] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:10:50.204416 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9135f32f-6587-4255-87b5-9f60bbfbbd72 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:50.204874 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9135f32f-6587-4255-87b5-9f60bbfbbd72 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:50.205653 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9135f32f-6587-4255-87b5-9f60bbfbbd72 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:50.206128 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9135f32f-6587-4255-87b5-9f60bbfbbd72 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:50.267759 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9135f32f-6587-4255-87b5-9f60bbfbbd72 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "POST /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410/action" status: 204 len: 0 microversion: 2.1 time: 0.075317 Jul 23 22:10:50.268561 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3413/6023] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 22:10:50 2022] POST /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410/action => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 22:10:50.277934 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c55d6651-6370-485b-8bcd-1df187b6ae1c tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:10:50.278694 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c55d6651-6370-485b-8bcd-1df187b6ae1c tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 4ed5b675-0efa-4ee6-81ff-f2161790e410] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:10:50.285068 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c55d6651-6370-485b-8bcd-1df187b6ae1c tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:50.285523 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c55d6651-6370-485b-8bcd-1df187b6ae1c tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:50.286342 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c55d6651-6370-485b-8bcd-1df187b6ae1c tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:50.286789 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c55d6651-6370-485b-8bcd-1df187b6ae1c tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:50.429916 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c55d6651-6370-485b-8bcd-1df187b6ae1c tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834c51a542834eebb2815f7fceeda333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd080cbf1b24a55b60c5035cb102a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:10:50.439578 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c55d6651-6370-485b-8bcd-1df187b6ae1c tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "GET /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410" status: 200 len: 1515 microversion: 2.1 time: 0.166546 Jul 23 22:10:50.440363 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3414/6024] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:10:50 2022] GET /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410 => generated 1515 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:10:51.459393 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-bc9c2586-c981-4f77-a2b0-96691c80e94f tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:10:51.460055 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-bc9c2586-c981-4f77-a2b0-96691c80e94f tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 4ed5b675-0efa-4ee6-81ff-f2161790e410] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:10:51.469777 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bc9c2586-c981-4f77-a2b0-96691c80e94f tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:51.470308 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bc9c2586-c981-4f77-a2b0-96691c80e94f tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:51.471266 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bc9c2586-c981-4f77-a2b0-96691c80e94f tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:51.471711 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bc9c2586-c981-4f77-a2b0-96691c80e94f tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:51.617641 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-bc9c2586-c981-4f77-a2b0-96691c80e94f tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834c51a542834eebb2815f7fceeda333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd080cbf1b24a55b60c5035cb102a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:10:51.626927 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-bc9c2586-c981-4f77-a2b0-96691c80e94f tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "GET /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410" status: 200 len: 1507 microversion: 2.1 time: 0.173794 Jul 23 22:10:51.627672 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3415/6025] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:10:51 2022] GET /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410 => generated 1507 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:10:51.644010 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ec5d8c08-4507-4d7d-a23c-5978e832866e tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:10:51.644627 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ec5d8c08-4507-4d7d-a23c-5978e832866e tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 4ed5b675-0efa-4ee6-81ff-f2161790e410] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:10:51.651035 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ec5d8c08-4507-4d7d-a23c-5978e832866e tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:51.651488 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ec5d8c08-4507-4d7d-a23c-5978e832866e tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:51.652259 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ec5d8c08-4507-4d7d-a23c-5978e832866e tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:51.652701 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ec5d8c08-4507-4d7d-a23c-5978e832866e tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:51.786690 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ec5d8c08-4507-4d7d-a23c-5978e832866e tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834c51a542834eebb2815f7fceeda333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd080cbf1b24a55b60c5035cb102a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:10:51.797587 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ec5d8c08-4507-4d7d-a23c-5978e832866e tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "GET /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410" status: 200 len: 1507 microversion: 2.1 time: 0.157261 Jul 23 22:10:51.798244 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3416/6026] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:10:51 2022] GET /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410 => generated 1507 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:10:51.819111 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2ad447e1-6b34-41c8-ac61-8f8e69811cdd tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Action: 'create', calling method: .version_select at 0x7f0b46b69820>, body: {"keypair": {"name": "tempest-keypair-2039220180", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA44byoVV28f7yZmSz28Jk2VchsUK0XPmdoWAAbq663NYPEo79A7afVK8jGl23zar63Yvwt81R2o6tPUwYhPi9Jhff6TT5GpNCEHaiiJ8ldbOdcwKBqHP5OMg8fJkSmcFA=="}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:10:51.835701 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-2ad447e1-6b34-41c8-ac61-8f8e69811cdd tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Getting quotas for project ffd080cbf1b24a55b60c5035cb102a12. Resources: {'key_pairs'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 22:10:51.841309 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-2ad447e1-6b34-41c8-ac61-8f8e69811cdd tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Getting quotas for user 834c51a542834eebb2815f7fceeda333 and project ffd080cbf1b24a55b60c5035cb102a12. Resources: {'key_pairs'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 22:10:51.867838 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2ad447e1-6b34-41c8-ac61-8f8e69811cdd tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.052383 Jul 23 22:10:51.868368 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3417/6027] 10.222.0.17 () {60 vars in 1158 bytes} [Sat Jul 23 22:10:51 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:10:53.079356 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-18bcefa5-d3b5-418e-a83e-924c4b6a56bd tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:10:53.079978 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-18bcefa5-d3b5-418e-a83e-924c4b6a56bd tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 4ed5b675-0efa-4ee6-81ff-f2161790e410] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:10:53.088642 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-18bcefa5-d3b5-418e-a83e-924c4b6a56bd tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:53.089107 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-18bcefa5-d3b5-418e-a83e-924c4b6a56bd tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:53.089936 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-18bcefa5-d3b5-418e-a83e-924c4b6a56bd tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:53.090422 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-18bcefa5-d3b5-418e-a83e-924c4b6a56bd tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:53.244748 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-18bcefa5-d3b5-418e-a83e-924c4b6a56bd tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834c51a542834eebb2815f7fceeda333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd080cbf1b24a55b60c5035cb102a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:10:53.253109 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-18bcefa5-d3b5-418e-a83e-924c4b6a56bd tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "GET /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410" status: 200 len: 1507 microversion: 2.1 time: 0.177841 Jul 23 22:10:53.253746 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3418/6028] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:10:53 2022] GET /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410 => generated 1507 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:10:53.269373 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8ea3b638-f4bf-46c1-8d67-2ab0dd2523f5 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:10:53.269895 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8ea3b638-f4bf-46c1-8d67-2ab0dd2523f5 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 4ed5b675-0efa-4ee6-81ff-f2161790e410] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:10:53.276358 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8ea3b638-f4bf-46c1-8d67-2ab0dd2523f5 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:53.276813 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8ea3b638-f4bf-46c1-8d67-2ab0dd2523f5 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:53.277580 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8ea3b638-f4bf-46c1-8d67-2ab0dd2523f5 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:53.278063 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8ea3b638-f4bf-46c1-8d67-2ab0dd2523f5 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:53.303823 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8ea3b638-f4bf-46c1-8d67-2ab0dd2523f5 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 4ed5b675-0efa-4ee6-81ff-f2161790e410] Going to try to terminate instance {{(pid=131320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 22:10:53.391653 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8ea3b638-f4bf-46c1-8d67-2ab0dd2523f5 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "DELETE /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410" status: 204 len: 0 microversion: 2.1 time: 0.125546 Jul 23 22:10:53.392700 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3419/6029] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 22:10:53 2022] DELETE /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 22:10:53.449314 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-25e8ccac-94f4-4eaf-b8ed-c530561e02c8 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1461254430", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "networks": [{"uuid": "2341dfec-6875-4269-acf3-b45bc1fda127"}]}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:10:53.501089 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-25e8ccac-94f4-4eaf-b8ed-c530561e02c8 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] validate_networks() for [('2341dfec-6875-4269-acf3-b45bc1fda127', None, None, None, None, None)] {{(pid=131320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 22:10:53.883122 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-25e8ccac-94f4-4eaf-b8ed-c530561e02c8 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 22:10:53.883546 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-25e8ccac-94f4-4eaf-b8ed-c530561e02c8 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 22:10:53.884020 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-25e8ccac-94f4-4eaf-b8ed-c530561e02c8 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 22:10:53.884429 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-25e8ccac-94f4-4eaf-b8ed-c530561e02c8 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 22:10:53.884839 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-25e8ccac-94f4-4eaf-b8ed-c530561e02c8 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 22:10:53.894279 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-25e8ccac-94f4-4eaf-b8ed-c530561e02c8 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:53.894730 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-25e8ccac-94f4-4eaf-b8ed-c530561e02c8 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:53.895520 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-25e8ccac-94f4-4eaf-b8ed-c530561e02c8 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:53.895957 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-25e8ccac-94f4-4eaf-b8ed-c530561e02c8 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:53.912840 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-25e8ccac-94f4-4eaf-b8ed-c530561e02c8 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Getting quotas for project ffd080cbf1b24a55b60c5035cb102a12. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 22:10:53.918568 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-25e8ccac-94f4-4eaf-b8ed-c530561e02c8 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Getting quotas for user 834c51a542834eebb2815f7fceeda333 and project ffd080cbf1b24a55b60c5035cb102a12. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 22:10:53.931491 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-25e8ccac-94f4-4eaf-b8ed-c530561e02c8 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Going to run 1 instances... {{(pid=131320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 22:10:53.933876 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-25e8ccac-94f4-4eaf-b8ed-c530561e02c8 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 1ebd041d-69cf-4717-9371-fbc1d01ee568] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 22:10:53.982055 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-25e8ccac-94f4-4eaf-b8ed-c530561e02c8 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.537372 Jul 23 22:10:53.982638 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3420/6030] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 22:10:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 539 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 23 22:10:53.987252 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-9ce461b6-f3e8-4d63-a1c3-4066d6af0c6f req-6b7b3a93-9987-468a-9b37-a57bed337606 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ed5b675-0efa-4ee6-81ff-f2161790e410", "name": "network-vif-plugged", "status": "completed", "tag": "17fc4834-0500-4721-8b58-15ae341fc950"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:10:53.998724 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-9ce461b6-f3e8-4d63-a1c3-4066d6af0c6f req-6b7b3a93-9987-468a-9b37-a57bed337606 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:53.999175 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-9ce461b6-f3e8-4d63-a1c3-4066d6af0c6f req-6b7b3a93-9987-468a-9b37-a57bed337606 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:54.011143 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-9ce461b6-f3e8-4d63-a1c3-4066d6af0c6f req-6b7b3a93-9987-468a-9b37-a57bed337606 service nova] Creating event network-vif-plugged:17fc4834-0500-4721-8b58-15ae341fc950 for instance 4ed5b675-0efa-4ee6-81ff-f2161790e410 on nch1-master-1 Jul 23 22:10:54.015834 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-9ce461b6-f3e8-4d63-a1c3-4066d6af0c6f req-6b7b3a93-9987-468a-9b37-a57bed337606 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031971 Jul 23 22:10:54.016451 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3421/6031] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:10:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:10:54.021753 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-7b9e4369-2d7e-4901-af6b-9332e5f98adf tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:10:54.022486 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-7b9e4369-2d7e-4901-af6b-9332e5f98adf tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 1ebd041d-69cf-4717-9371-fbc1d01ee568] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:10:54.078335 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-7b9e4369-2d7e-4901-af6b-9332e5f98adf tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834c51a542834eebb2815f7fceeda333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd080cbf1b24a55b60c5035cb102a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:10:54.087263 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-7b9e4369-2d7e-4901-af6b-9332e5f98adf tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "GET /compute/v2.1/servers/1ebd041d-69cf-4717-9371-fbc1d01ee568" status: 200 len: 1218 microversion: 2.1 time: 0.069662 Jul 23 22:10:54.087858 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3422/6032] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:10:54 2022] GET /compute/v2.1/servers/1ebd041d-69cf-4717-9371-fbc1d01ee568 => generated 1218 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:10:55.105000 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5ccafc08-297b-48f0-87b3-54816fb9c987 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:10:55.105665 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5ccafc08-297b-48f0-87b3-54816fb9c987 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 1ebd041d-69cf-4717-9371-fbc1d01ee568] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:10:55.114469 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5ccafc08-297b-48f0-87b3-54816fb9c987 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:55.114940 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5ccafc08-297b-48f0-87b3-54816fb9c987 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:55.115756 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5ccafc08-297b-48f0-87b3-54816fb9c987 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:55.116162 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5ccafc08-297b-48f0-87b3-54816fb9c987 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:55.181905 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5ccafc08-297b-48f0-87b3-54816fb9c987 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834c51a542834eebb2815f7fceeda333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd080cbf1b24a55b60c5035cb102a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:10:55.190098 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5ccafc08-297b-48f0-87b3-54816fb9c987 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "GET /compute/v2.1/servers/1ebd041d-69cf-4717-9371-fbc1d01ee568" status: 200 len: 1276 microversion: 2.1 time: 0.089186 Jul 23 22:10:55.190916 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3423/6033] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:10:55 2022] GET /compute/v2.1/servers/1ebd041d-69cf-4717-9371-fbc1d01ee568 => generated 1276 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:10:55.992740 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-1ce12494-0b0b-46a7-9349-4cb4e8d4d02f req-eae6bb52-93da-4542-85b8-644a1f748256 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ed5b675-0efa-4ee6-81ff-f2161790e410", "name": "network-vif-deleted", "tag": "17fc4834-0500-4721-8b58-15ae341fc950"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:10:56.001504 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-1ce12494-0b0b-46a7-9349-4cb4e8d4d02f req-eae6bb52-93da-4542-85b8-644a1f748256 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:56.002064 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-1ce12494-0b0b-46a7-9349-4cb4e8d4d02f req-eae6bb52-93da-4542-85b8-644a1f748256 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:56.013839 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-1ce12494-0b0b-46a7-9349-4cb4e8d4d02f req-eae6bb52-93da-4542-85b8-644a1f748256 service nova] Creating event network-vif-deleted:17fc4834-0500-4721-8b58-15ae341fc950 for instance 4ed5b675-0efa-4ee6-81ff-f2161790e410 on nch1-master-1 Jul 23 22:10:56.018989 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-1ce12494-0b0b-46a7-9349-4cb4e8d4d02f req-eae6bb52-93da-4542-85b8-644a1f748256 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030348 Jul 23 22:10:56.020033 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3424/6034] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:10:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:10:56.209195 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8f43d40e-c84e-468f-bb7e-51e8e585247e tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:10:56.211488 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8f43d40e-c84e-468f-bb7e-51e8e585247e tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 1ebd041d-69cf-4717-9371-fbc1d01ee568] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:10:56.219261 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8f43d40e-c84e-468f-bb7e-51e8e585247e tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:56.219842 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8f43d40e-c84e-468f-bb7e-51e8e585247e tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:56.220760 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8f43d40e-c84e-468f-bb7e-51e8e585247e tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:56.221300 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8f43d40e-c84e-468f-bb7e-51e8e585247e tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:56.382579 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8f43d40e-c84e-468f-bb7e-51e8e585247e tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834c51a542834eebb2815f7fceeda333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd080cbf1b24a55b60c5035cb102a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:10:56.394049 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8f43d40e-c84e-468f-bb7e-51e8e585247e tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "GET /compute/v2.1/servers/1ebd041d-69cf-4717-9371-fbc1d01ee568" status: 200 len: 1318 microversion: 2.1 time: 0.189481 Jul 23 22:10:56.394976 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3425/6035] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:10:56 2022] GET /compute/v2.1/servers/1ebd041d-69cf-4717-9371-fbc1d01ee568 => generated 1318 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:10:57.411476 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-005f7b58-e1cc-45cf-8907-a982c9defabe tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:10:57.412096 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-005f7b58-e1cc-45cf-8907-a982c9defabe tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 1ebd041d-69cf-4717-9371-fbc1d01ee568] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:10:57.419391 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-005f7b58-e1cc-45cf-8907-a982c9defabe tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:57.419888 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-005f7b58-e1cc-45cf-8907-a982c9defabe tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:57.420696 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-005f7b58-e1cc-45cf-8907-a982c9defabe tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:57.421144 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-005f7b58-e1cc-45cf-8907-a982c9defabe tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:57.552330 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-005f7b58-e1cc-45cf-8907-a982c9defabe tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834c51a542834eebb2815f7fceeda333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd080cbf1b24a55b60c5035cb102a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:10:57.560384 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-005f7b58-e1cc-45cf-8907-a982c9defabe tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "GET /compute/v2.1/servers/1ebd041d-69cf-4717-9371-fbc1d01ee568" status: 200 len: 1318 microversion: 2.1 time: 0.153011 Jul 23 22:10:57.560981 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3426/6036] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:10:57 2022] GET /compute/v2.1/servers/1ebd041d-69cf-4717-9371-fbc1d01ee568 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:10:58.053682 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-5ecb97fe-0cc9-4489-af1d-54a03f1f0a71 req-94b52426-6d7b-424e-9270-2a75248b775c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ebd041d-69cf-4717-9371-fbc1d01ee568", "tag": "35a5e6c2-6f59-4d78-a032-dff385e13f1c"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:10:58.067313 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-5ecb97fe-0cc9-4489-af1d-54a03f1f0a71 req-94b52426-6d7b-424e-9270-2a75248b775c service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:58.068150 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-5ecb97fe-0cc9-4489-af1d-54a03f1f0a71 req-94b52426-6d7b-424e-9270-2a75248b775c service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:58.080052 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-5ecb97fe-0cc9-4489-af1d-54a03f1f0a71 req-94b52426-6d7b-424e-9270-2a75248b775c service nova] Creating event network-changed:35a5e6c2-6f59-4d78-a032-dff385e13f1c for instance 1ebd041d-69cf-4717-9371-fbc1d01ee568 on nch2-master-1 Jul 23 22:10:58.085348 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-5ecb97fe-0cc9-4489-af1d-54a03f1f0a71 req-94b52426-6d7b-424e-9270-2a75248b775c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038216 Jul 23 22:10:58.086046 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3427/6037] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:10:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:10:58.579030 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-47970914-4b0a-4826-8f41-42cba3ad1577 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:10:58.579691 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-47970914-4b0a-4826-8f41-42cba3ad1577 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 1ebd041d-69cf-4717-9371-fbc1d01ee568] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:10:58.586800 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-47970914-4b0a-4826-8f41-42cba3ad1577 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:58.587225 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-47970914-4b0a-4826-8f41-42cba3ad1577 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:58.588037 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-47970914-4b0a-4826-8f41-42cba3ad1577 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:58.588494 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-47970914-4b0a-4826-8f41-42cba3ad1577 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:58.727392 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-47970914-4b0a-4826-8f41-42cba3ad1577 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834c51a542834eebb2815f7fceeda333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd080cbf1b24a55b60c5035cb102a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:10:58.738157 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-47970914-4b0a-4826-8f41-42cba3ad1577 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "GET /compute/v2.1/servers/1ebd041d-69cf-4717-9371-fbc1d01ee568" status: 200 len: 1318 microversion: 2.1 time: 0.164177 Jul 23 22:10:58.738927 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3428/6038] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:10:58 2022] GET /compute/v2.1/servers/1ebd041d-69cf-4717-9371-fbc1d01ee568 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:10:59.756311 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-80c68937-2143-40f2-a69d-0867f8f75942 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:10:59.756918 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-80c68937-2143-40f2-a69d-0867f8f75942 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 1ebd041d-69cf-4717-9371-fbc1d01ee568] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:10:59.764447 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-80c68937-2143-40f2-a69d-0867f8f75942 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:59.764906 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-80c68937-2143-40f2-a69d-0867f8f75942 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:59.765675 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-80c68937-2143-40f2-a69d-0867f8f75942 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:10:59.766153 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-80c68937-2143-40f2-a69d-0867f8f75942 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:10:59.901114 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-80c68937-2143-40f2-a69d-0867f8f75942 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834c51a542834eebb2815f7fceeda333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd080cbf1b24a55b60c5035cb102a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:10:59.909259 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-80c68937-2143-40f2-a69d-0867f8f75942 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "GET /compute/v2.1/servers/1ebd041d-69cf-4717-9371-fbc1d01ee568" status: 200 len: 1318 microversion: 2.1 time: 0.156997 Jul 23 22:10:59.909845 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3429/6039] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:10:59 2022] GET /compute/v2.1/servers/1ebd041d-69cf-4717-9371-fbc1d01ee568 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:11:00.930776 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4baa77c1-f5cb-4fa9-8594-1583e72ee4aa tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:11:00.931583 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-4baa77c1-f5cb-4fa9-8594-1583e72ee4aa tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 1ebd041d-69cf-4717-9371-fbc1d01ee568] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:11:00.941405 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4baa77c1-f5cb-4fa9-8594-1583e72ee4aa tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:00.942068 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4baa77c1-f5cb-4fa9-8594-1583e72ee4aa tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:00.943108 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4baa77c1-f5cb-4fa9-8594-1583e72ee4aa tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:00.943709 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4baa77c1-f5cb-4fa9-8594-1583e72ee4aa tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:01.085171 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-4baa77c1-f5cb-4fa9-8594-1583e72ee4aa tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834c51a542834eebb2815f7fceeda333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd080cbf1b24a55b60c5035cb102a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:11:01.093027 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4baa77c1-f5cb-4fa9-8594-1583e72ee4aa tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "GET /compute/v2.1/servers/1ebd041d-69cf-4717-9371-fbc1d01ee568" status: 200 len: 1318 microversion: 2.1 time: 0.169108 Jul 23 22:11:01.093604 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3430/6040] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:11:00 2022] GET /compute/v2.1/servers/1ebd041d-69cf-4717-9371-fbc1d01ee568 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:11:02.114838 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-12e5d5cc-5cbb-455b-971b-8f6e810bb904 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:11:02.115972 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-12e5d5cc-5cbb-455b-971b-8f6e810bb904 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 1ebd041d-69cf-4717-9371-fbc1d01ee568] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:11:02.124645 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-12e5d5cc-5cbb-455b-971b-8f6e810bb904 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:02.125174 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-12e5d5cc-5cbb-455b-971b-8f6e810bb904 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:02.125996 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-12e5d5cc-5cbb-455b-971b-8f6e810bb904 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:02.126489 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-12e5d5cc-5cbb-455b-971b-8f6e810bb904 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:02.143307 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:11:02.264943 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-12e5d5cc-5cbb-455b-971b-8f6e810bb904 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834c51a542834eebb2815f7fceeda333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd080cbf1b24a55b60c5035cb102a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:11:02.272887 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-12e5d5cc-5cbb-455b-971b-8f6e810bb904 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "GET /compute/v2.1/servers/1ebd041d-69cf-4717-9371-fbc1d01ee568" status: 200 len: 1318 microversion: 2.1 time: 0.164985 Jul 23 22:11:02.273503 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3431/6041] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:11:02 2022] GET /compute/v2.1/servers/1ebd041d-69cf-4717-9371-fbc1d01ee568 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:11:03.209732 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-b2ca1f5b-2f12-4617-a9d1-d3ec2541d5d4 req-546f0b20-0d53-4bf4-b218-5d086a4ffbf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ebd041d-69cf-4717-9371-fbc1d01ee568", "name": "network-vif-plugged", "status": "completed", "tag": "35a5e6c2-6f59-4d78-a032-dff385e13f1c"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:11:03.215472 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:11:03.220404 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-b2ca1f5b-2f12-4617-a9d1-d3ec2541d5d4 req-546f0b20-0d53-4bf4-b218-5d086a4ffbf3 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:03.220861 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-b2ca1f5b-2f12-4617-a9d1-d3ec2541d5d4 req-546f0b20-0d53-4bf4-b218-5d086a4ffbf3 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:03.233089 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-b2ca1f5b-2f12-4617-a9d1-d3ec2541d5d4 req-546f0b20-0d53-4bf4-b218-5d086a4ffbf3 service nova] Creating event network-vif-plugged:35a5e6c2-6f59-4d78-a032-dff385e13f1c for instance 1ebd041d-69cf-4717-9371-fbc1d01ee568 on nch2-master-1 Jul 23 22:11:03.238423 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-b2ca1f5b-2f12-4617-a9d1-d3ec2541d5d4 req-546f0b20-0d53-4bf4-b218-5d086a4ffbf3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032988 Jul 23 22:11:03.239053 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3432/6042] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:11:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 22:11:03.291969 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-98a7c998-bba9-4157-8060-ad27bd18bdef tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:11:03.292680 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-98a7c998-bba9-4157-8060-ad27bd18bdef tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 1ebd041d-69cf-4717-9371-fbc1d01ee568] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:11:03.298985 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-98a7c998-bba9-4157-8060-ad27bd18bdef tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:03.299434 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-98a7c998-bba9-4157-8060-ad27bd18bdef tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:03.300195 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-98a7c998-bba9-4157-8060-ad27bd18bdef tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:03.300633 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-98a7c998-bba9-4157-8060-ad27bd18bdef tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:03.437732 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-98a7c998-bba9-4157-8060-ad27bd18bdef tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834c51a542834eebb2815f7fceeda333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd080cbf1b24a55b60c5035cb102a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:11:03.445515 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-98a7c998-bba9-4157-8060-ad27bd18bdef tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "GET /compute/v2.1/servers/1ebd041d-69cf-4717-9371-fbc1d01ee568" status: 200 len: 1318 microversion: 2.1 time: 0.158303 Jul 23 22:11:03.446221 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3433/6043] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:11:03 2022] GET /compute/v2.1/servers/1ebd041d-69cf-4717-9371-fbc1d01ee568 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:11:04.465965 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3f142920-050e-40dc-821e-81597acdcacf tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:11:04.466647 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-3f142920-050e-40dc-821e-81597acdcacf tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 1ebd041d-69cf-4717-9371-fbc1d01ee568] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:11:04.468693 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:11:04.469412 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=12 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:11:04.476115 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3f142920-050e-40dc-821e-81597acdcacf tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:04.476579 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3f142920-050e-40dc-821e-81597acdcacf tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:04.477370 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3f142920-050e-40dc-821e-81597acdcacf tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:04.477807 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3f142920-050e-40dc-821e-81597acdcacf tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:04.612874 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-3f142920-050e-40dc-821e-81597acdcacf tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834c51a542834eebb2815f7fceeda333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd080cbf1b24a55b60c5035cb102a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:11:04.621160 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-3f142920-050e-40dc-821e-81597acdcacf tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "GET /compute/v2.1/servers/1ebd041d-69cf-4717-9371-fbc1d01ee568" status: 200 len: 1318 microversion: 2.1 time: 0.160192 Jul 23 22:11:04.621761 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3434/6044] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:11:04 2022] GET /compute/v2.1/servers/1ebd041d-69cf-4717-9371-fbc1d01ee568 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:11:05.641840 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-338de30e-5171-49f1-805e-d218137050a3 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:11:05.643088 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-338de30e-5171-49f1-805e-d218137050a3 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 1ebd041d-69cf-4717-9371-fbc1d01ee568] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:11:05.655232 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-338de30e-5171-49f1-805e-d218137050a3 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:05.656008 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-338de30e-5171-49f1-805e-d218137050a3 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:05.657289 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-338de30e-5171-49f1-805e-d218137050a3 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:05.658077 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-338de30e-5171-49f1-805e-d218137050a3 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:05.875542 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-338de30e-5171-49f1-805e-d218137050a3 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834c51a542834eebb2815f7fceeda333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd080cbf1b24a55b60c5035cb102a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:11:05.883419 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-338de30e-5171-49f1-805e-d218137050a3 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "GET /compute/v2.1/servers/1ebd041d-69cf-4717-9371-fbc1d01ee568" status: 200 len: 1507 microversion: 2.1 time: 0.248373 Jul 23 22:11:05.884009 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3435/6045] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:11:05 2022] GET /compute/v2.1/servers/1ebd041d-69cf-4717-9371-fbc1d01ee568 => generated 1507 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:11:05.901568 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f2ba3c7d-4b06-42ea-9d4a-12816380554d tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:11:05.902176 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f2ba3c7d-4b06-42ea-9d4a-12816380554d tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 1ebd041d-69cf-4717-9371-fbc1d01ee568] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:11:05.908074 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f2ba3c7d-4b06-42ea-9d4a-12816380554d tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:05.908528 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f2ba3c7d-4b06-42ea-9d4a-12816380554d tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:05.909299 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f2ba3c7d-4b06-42ea-9d4a-12816380554d tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:05.909733 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f2ba3c7d-4b06-42ea-9d4a-12816380554d tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:06.043012 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f2ba3c7d-4b06-42ea-9d4a-12816380554d tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834c51a542834eebb2815f7fceeda333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd080cbf1b24a55b60c5035cb102a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:11:06.051070 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f2ba3c7d-4b06-42ea-9d4a-12816380554d tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "GET /compute/v2.1/servers/1ebd041d-69cf-4717-9371-fbc1d01ee568" status: 200 len: 1507 microversion: 2.1 time: 0.154935 Jul 23 22:11:06.051662 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3436/6046] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:11:05 2022] GET /compute/v2.1/servers/1ebd041d-69cf-4717-9371-fbc1d01ee568 => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:11:06.067001 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-95c73a48-5c2b-45e5-affc-ca3d9d5f5136 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:11:06.067993 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-95c73a48-5c2b-45e5-affc-ca3d9d5f5136 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 1ebd041d-69cf-4717-9371-fbc1d01ee568] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:11:06.073800 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-95c73a48-5c2b-45e5-affc-ca3d9d5f5136 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:06.074295 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-95c73a48-5c2b-45e5-affc-ca3d9d5f5136 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:06.075075 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-95c73a48-5c2b-45e5-affc-ca3d9d5f5136 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:06.075520 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-95c73a48-5c2b-45e5-affc-ca3d9d5f5136 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:06.106863 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-95c73a48-5c2b-45e5-affc-ca3d9d5f5136 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '834c51a542834eebb2815f7fceeda333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd080cbf1b24a55b60c5035cb102a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:11:06.112865 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-95c73a48-5c2b-45e5-affc-ca3d9d5f5136 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 1ebd041d-69cf-4717-9371-fbc1d01ee568] Old instance type m1.heat2, new instance type m1.heat {{(pid=131320) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 23 22:11:06.119438 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-95c73a48-5c2b-45e5-affc-ca3d9d5f5136 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 22:11:06.119837 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-95c73a48-5c2b-45e5-affc-ca3d9d5f5136 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 22:11:06.120347 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-95c73a48-5c2b-45e5-affc-ca3d9d5f5136 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 22:11:06.120767 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-95c73a48-5c2b-45e5-affc-ca3d9d5f5136 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 22:11:06.121178 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-95c73a48-5c2b-45e5-affc-ca3d9d5f5136 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 22:11:06.186689 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-95c73a48-5c2b-45e5-affc-ca3d9d5f5136 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "POST /compute/v2.1/servers/1ebd041d-69cf-4717-9371-fbc1d01ee568/action" status: 202 len: 0 microversion: 2.1 time: 0.123181 Jul 23 22:11:06.187211 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3437/6047] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 22:11:06 2022] POST /compute/v2.1/servers/1ebd041d-69cf-4717-9371-fbc1d01ee568/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 22:11:06.195053 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4dcc6dd9-8a2d-4d06-bf88-fffe142d47f6 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:11:06.195666 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-4dcc6dd9-8a2d-4d06-bf88-fffe142d47f6 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 1ebd041d-69cf-4717-9371-fbc1d01ee568] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:11:06.201832 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4dcc6dd9-8a2d-4d06-bf88-fffe142d47f6 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:06.202319 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4dcc6dd9-8a2d-4d06-bf88-fffe142d47f6 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:06.203089 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4dcc6dd9-8a2d-4d06-bf88-fffe142d47f6 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:06.203532 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4dcc6dd9-8a2d-4d06-bf88-fffe142d47f6 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:06.360320 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-4dcc6dd9-8a2d-4d06-bf88-fffe142d47f6 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834c51a542834eebb2815f7fceeda333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd080cbf1b24a55b60c5035cb102a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:11:06.368384 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4dcc6dd9-8a2d-4d06-bf88-fffe142d47f6 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "GET /compute/v2.1/servers/1ebd041d-69cf-4717-9371-fbc1d01ee568" status: 200 len: 1514 microversion: 2.1 time: 0.176949 Jul 23 22:11:06.369113 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3438/6048] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:11:06 2022] GET /compute/v2.1/servers/1ebd041d-69cf-4717-9371-fbc1d01ee568 => generated 1514 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:11:07.389291 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a413a11e-e5d6-405e-bbe4-049f827a11ce tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:11:07.390066 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a413a11e-e5d6-405e-bbe4-049f827a11ce tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 1ebd041d-69cf-4717-9371-fbc1d01ee568] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:11:07.397706 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a413a11e-e5d6-405e-bbe4-049f827a11ce tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:07.398285 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a413a11e-e5d6-405e-bbe4-049f827a11ce tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:07.399202 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a413a11e-e5d6-405e-bbe4-049f827a11ce tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:07.399724 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a413a11e-e5d6-405e-bbe4-049f827a11ce tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:07.541437 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a413a11e-e5d6-405e-bbe4-049f827a11ce tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834c51a542834eebb2815f7fceeda333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd080cbf1b24a55b60c5035cb102a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:11:07.549303 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a413a11e-e5d6-405e-bbe4-049f827a11ce tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "GET /compute/v2.1/servers/1ebd041d-69cf-4717-9371-fbc1d01ee568" status: 200 len: 1514 microversion: 2.1 time: 0.165550 Jul 23 22:11:07.550086 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3439/6049] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:11:07 2022] GET /compute/v2.1/servers/1ebd041d-69cf-4717-9371-fbc1d01ee568 => generated 1514 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:11:08.567699 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6534d547-1ba8-42b5-bcf7-7430488d947c tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:11:08.568397 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6534d547-1ba8-42b5-bcf7-7430488d947c tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 1ebd041d-69cf-4717-9371-fbc1d01ee568] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:11:08.575940 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6534d547-1ba8-42b5-bcf7-7430488d947c tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:08.576404 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6534d547-1ba8-42b5-bcf7-7430488d947c tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:08.577177 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6534d547-1ba8-42b5-bcf7-7430488d947c tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:08.577622 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6534d547-1ba8-42b5-bcf7-7430488d947c tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:08.713669 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6534d547-1ba8-42b5-bcf7-7430488d947c tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834c51a542834eebb2815f7fceeda333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd080cbf1b24a55b60c5035cb102a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:11:08.721712 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6534d547-1ba8-42b5-bcf7-7430488d947c tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "GET /compute/v2.1/servers/1ebd041d-69cf-4717-9371-fbc1d01ee568" status: 200 len: 1519 microversion: 2.1 time: 0.158079 Jul 23 22:11:08.722321 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3440/6050] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:11:08 2022] GET /compute/v2.1/servers/1ebd041d-69cf-4717-9371-fbc1d01ee568 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:11:09.743614 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d525c345-4fcf-4f86-8f1c-bc4597bea737 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:11:09.744669 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d525c345-4fcf-4f86-8f1c-bc4597bea737 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 1ebd041d-69cf-4717-9371-fbc1d01ee568] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:11:09.756439 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d525c345-4fcf-4f86-8f1c-bc4597bea737 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:09.757195 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d525c345-4fcf-4f86-8f1c-bc4597bea737 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:09.758521 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d525c345-4fcf-4f86-8f1c-bc4597bea737 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:09.759256 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d525c345-4fcf-4f86-8f1c-bc4597bea737 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:09.895955 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d525c345-4fcf-4f86-8f1c-bc4597bea737 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834c51a542834eebb2815f7fceeda333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd080cbf1b24a55b60c5035cb102a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:11:09.904244 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d525c345-4fcf-4f86-8f1c-bc4597bea737 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "GET /compute/v2.1/servers/1ebd041d-69cf-4717-9371-fbc1d01ee568" status: 200 len: 1519 microversion: 2.1 time: 0.167207 Jul 23 22:11:09.904818 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3441/6051] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:11:09 2022] GET /compute/v2.1/servers/1ebd041d-69cf-4717-9371-fbc1d01ee568 => generated 1519 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:11:10.924825 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c14c5ec3-66c7-4550-87d0-a3f0178f8337 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:11:10.925905 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c14c5ec3-66c7-4550-87d0-a3f0178f8337 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 1ebd041d-69cf-4717-9371-fbc1d01ee568] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:11:10.936058 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c14c5ec3-66c7-4550-87d0-a3f0178f8337 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:10.936511 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c14c5ec3-66c7-4550-87d0-a3f0178f8337 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:10.937290 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c14c5ec3-66c7-4550-87d0-a3f0178f8337 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:10.937728 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c14c5ec3-66c7-4550-87d0-a3f0178f8337 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:11.080819 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c14c5ec3-66c7-4550-87d0-a3f0178f8337 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834c51a542834eebb2815f7fceeda333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd080cbf1b24a55b60c5035cb102a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:11:11.088855 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c14c5ec3-66c7-4550-87d0-a3f0178f8337 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "GET /compute/v2.1/servers/1ebd041d-69cf-4717-9371-fbc1d01ee568" status: 200 len: 1519 microversion: 2.1 time: 0.170655 Jul 23 22:11:11.089474 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3442/6052] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:11:10 2022] GET /compute/v2.1/servers/1ebd041d-69cf-4717-9371-fbc1d01ee568 => generated 1519 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:11:12.108504 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9e77e522-63a0-4f51-a3b1-117afa762859 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:11:12.109271 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-9e77e522-63a0-4f51-a3b1-117afa762859 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 1ebd041d-69cf-4717-9371-fbc1d01ee568] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:11:12.118437 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9e77e522-63a0-4f51-a3b1-117afa762859 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:12.119007 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9e77e522-63a0-4f51-a3b1-117afa762859 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:12.119965 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9e77e522-63a0-4f51-a3b1-117afa762859 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:12.120512 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9e77e522-63a0-4f51-a3b1-117afa762859 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:12.266838 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-9e77e522-63a0-4f51-a3b1-117afa762859 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834c51a542834eebb2815f7fceeda333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd080cbf1b24a55b60c5035cb102a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:11:12.277902 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9e77e522-63a0-4f51-a3b1-117afa762859 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "GET /compute/v2.1/servers/1ebd041d-69cf-4717-9371-fbc1d01ee568" status: 200 len: 1519 microversion: 2.1 time: 0.174591 Jul 23 22:11:12.278532 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3443/6053] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:11:12 2022] GET /compute/v2.1/servers/1ebd041d-69cf-4717-9371-fbc1d01ee568 => generated 1519 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:11:13.297030 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-62d4a264-ba77-47e5-8594-52ccdb28c685 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:11:13.297764 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-62d4a264-ba77-47e5-8594-52ccdb28c685 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 1ebd041d-69cf-4717-9371-fbc1d01ee568] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:11:13.305350 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-62d4a264-ba77-47e5-8594-52ccdb28c685 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:13.305840 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-62d4a264-ba77-47e5-8594-52ccdb28c685 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:13.306673 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-62d4a264-ba77-47e5-8594-52ccdb28c685 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:13.307151 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-62d4a264-ba77-47e5-8594-52ccdb28c685 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:13.445372 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-62d4a264-ba77-47e5-8594-52ccdb28c685 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834c51a542834eebb2815f7fceeda333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd080cbf1b24a55b60c5035cb102a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:11:13.453359 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-62d4a264-ba77-47e5-8594-52ccdb28c685 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "GET /compute/v2.1/servers/1ebd041d-69cf-4717-9371-fbc1d01ee568" status: 200 len: 1519 microversion: 2.1 time: 0.161261 Jul 23 22:11:13.453981 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3444/6054] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:11:13 2022] GET /compute/v2.1/servers/1ebd041d-69cf-4717-9371-fbc1d01ee568 => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:11:14.473217 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-eb7dcc41-5ae3-4dc1-b1c2-32ac8fce5c93 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:11:14.474131 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-eb7dcc41-5ae3-4dc1-b1c2-32ac8fce5c93 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 1ebd041d-69cf-4717-9371-fbc1d01ee568] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:11:14.483217 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-eb7dcc41-5ae3-4dc1-b1c2-32ac8fce5c93 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:14.483798 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-eb7dcc41-5ae3-4dc1-b1c2-32ac8fce5c93 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:14.484755 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-eb7dcc41-5ae3-4dc1-b1c2-32ac8fce5c93 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:14.485313 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-eb7dcc41-5ae3-4dc1-b1c2-32ac8fce5c93 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:14.622367 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-eb7dcc41-5ae3-4dc1-b1c2-32ac8fce5c93 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834c51a542834eebb2815f7fceeda333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd080cbf1b24a55b60c5035cb102a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:11:14.630398 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-eb7dcc41-5ae3-4dc1-b1c2-32ac8fce5c93 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "GET /compute/v2.1/servers/1ebd041d-69cf-4717-9371-fbc1d01ee568" status: 200 len: 1519 microversion: 2.1 time: 0.162196 Jul 23 22:11:14.630981 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3445/6055] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:11:14 2022] GET /compute/v2.1/servers/1ebd041d-69cf-4717-9371-fbc1d01ee568 => generated 1519 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:11:15.649108 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-104c9590-41fa-427c-b4ff-6161225c1681 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:11:15.649933 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-104c9590-41fa-427c-b4ff-6161225c1681 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 1ebd041d-69cf-4717-9371-fbc1d01ee568] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:11:15.658667 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-104c9590-41fa-427c-b4ff-6161225c1681 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:15.659209 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-104c9590-41fa-427c-b4ff-6161225c1681 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:15.660124 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-104c9590-41fa-427c-b4ff-6161225c1681 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:15.660645 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-104c9590-41fa-427c-b4ff-6161225c1681 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:15.800281 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-104c9590-41fa-427c-b4ff-6161225c1681 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834c51a542834eebb2815f7fceeda333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd080cbf1b24a55b60c5035cb102a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:11:15.811204 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-104c9590-41fa-427c-b4ff-6161225c1681 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "GET /compute/v2.1/servers/1ebd041d-69cf-4717-9371-fbc1d01ee568" status: 200 len: 1519 microversion: 2.1 time: 0.166756 Jul 23 22:11:15.811792 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3446/6056] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:11:15 2022] GET /compute/v2.1/servers/1ebd041d-69cf-4717-9371-fbc1d01ee568 => generated 1519 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:11:16.833021 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-be60ed0b-002f-4ada-87d4-82f46f795dcd tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:11:16.834116 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-be60ed0b-002f-4ada-87d4-82f46f795dcd tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 1ebd041d-69cf-4717-9371-fbc1d01ee568] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:11:16.844029 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-be60ed0b-002f-4ada-87d4-82f46f795dcd tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:16.844484 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-be60ed0b-002f-4ada-87d4-82f46f795dcd tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:16.845253 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-be60ed0b-002f-4ada-87d4-82f46f795dcd tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:16.845702 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-be60ed0b-002f-4ada-87d4-82f46f795dcd tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:16.860831 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:11:16.987490 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-be60ed0b-002f-4ada-87d4-82f46f795dcd tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834c51a542834eebb2815f7fceeda333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd080cbf1b24a55b60c5035cb102a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:11:16.997803 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-be60ed0b-002f-4ada-87d4-82f46f795dcd tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "GET /compute/v2.1/servers/1ebd041d-69cf-4717-9371-fbc1d01ee568" status: 200 len: 1519 microversion: 2.1 time: 0.171782 Jul 23 22:11:16.998432 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3447/6057] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:11:16 2022] GET /compute/v2.1/servers/1ebd041d-69cf-4717-9371-fbc1d01ee568 => generated 1519 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:11:18.019719 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-bbe5b8af-14aa-45b4-9852-061353eab127 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:11:18.020741 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-bbe5b8af-14aa-45b4-9852-061353eab127 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 1ebd041d-69cf-4717-9371-fbc1d01ee568] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:11:18.032695 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bbe5b8af-14aa-45b4-9852-061353eab127 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:18.033474 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bbe5b8af-14aa-45b4-9852-061353eab127 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:18.034808 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bbe5b8af-14aa-45b4-9852-061353eab127 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:18.035527 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bbe5b8af-14aa-45b4-9852-061353eab127 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:18.170132 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-bbe5b8af-14aa-45b4-9852-061353eab127 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834c51a542834eebb2815f7fceeda333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd080cbf1b24a55b60c5035cb102a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:11:18.177894 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-bbe5b8af-14aa-45b4-9852-061353eab127 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "GET /compute/v2.1/servers/1ebd041d-69cf-4717-9371-fbc1d01ee568" status: 200 len: 1519 microversion: 2.1 time: 0.164977 Jul 23 22:11:18.178464 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3448/6058] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:11:18 2022] GET /compute/v2.1/servers/1ebd041d-69cf-4717-9371-fbc1d01ee568 => generated 1519 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:11:19.200148 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b41f8b6c-53a8-4777-84f8-2feb2519e5db tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:11:19.201065 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b41f8b6c-53a8-4777-84f8-2feb2519e5db tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 1ebd041d-69cf-4717-9371-fbc1d01ee568] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:11:19.213076 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b41f8b6c-53a8-4777-84f8-2feb2519e5db tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:19.213809 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b41f8b6c-53a8-4777-84f8-2feb2519e5db tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:19.215076 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b41f8b6c-53a8-4777-84f8-2feb2519e5db tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:19.215839 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b41f8b6c-53a8-4777-84f8-2feb2519e5db tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:19.363412 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b41f8b6c-53a8-4777-84f8-2feb2519e5db tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834c51a542834eebb2815f7fceeda333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd080cbf1b24a55b60c5035cb102a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:11:19.372947 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b41f8b6c-53a8-4777-84f8-2feb2519e5db tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "GET /compute/v2.1/servers/1ebd041d-69cf-4717-9371-fbc1d01ee568" status: 200 len: 1519 microversion: 2.1 time: 0.179795 Jul 23 22:11:19.373545 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3449/6059] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:11:19 2022] GET /compute/v2.1/servers/1ebd041d-69cf-4717-9371-fbc1d01ee568 => generated 1519 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:11:20.394919 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-aea3aa5f-17aa-4b5f-9eea-c1be0d83d37b tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:11:20.395973 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-aea3aa5f-17aa-4b5f-9eea-c1be0d83d37b tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 1ebd041d-69cf-4717-9371-fbc1d01ee568] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:11:20.406412 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-aea3aa5f-17aa-4b5f-9eea-c1be0d83d37b tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:20.406871 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-aea3aa5f-17aa-4b5f-9eea-c1be0d83d37b tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:20.407655 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-aea3aa5f-17aa-4b5f-9eea-c1be0d83d37b tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:20.408109 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-aea3aa5f-17aa-4b5f-9eea-c1be0d83d37b tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:20.540250 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-aea3aa5f-17aa-4b5f-9eea-c1be0d83d37b tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834c51a542834eebb2815f7fceeda333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd080cbf1b24a55b60c5035cb102a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:11:20.551832 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-aea3aa5f-17aa-4b5f-9eea-c1be0d83d37b tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "GET /compute/v2.1/servers/1ebd041d-69cf-4717-9371-fbc1d01ee568" status: 200 len: 1519 microversion: 2.1 time: 0.163394 Jul 23 22:11:20.552403 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3450/6060] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:11:20 2022] GET /compute/v2.1/servers/1ebd041d-69cf-4717-9371-fbc1d01ee568 => generated 1519 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:11:21.575981 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-44acfa3f-f292-45aa-b47f-b5deb9695dea tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:11:21.576735 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-44acfa3f-f292-45aa-b47f-b5deb9695dea tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 1ebd041d-69cf-4717-9371-fbc1d01ee568] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:11:21.585242 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-44acfa3f-f292-45aa-b47f-b5deb9695dea tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:21.585751 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-44acfa3f-f292-45aa-b47f-b5deb9695dea tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:21.586646 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-44acfa3f-f292-45aa-b47f-b5deb9695dea tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:21.587137 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-44acfa3f-f292-45aa-b47f-b5deb9695dea tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:21.724759 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-44acfa3f-f292-45aa-b47f-b5deb9695dea tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834c51a542834eebb2815f7fceeda333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd080cbf1b24a55b60c5035cb102a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:11:21.732813 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-44acfa3f-f292-45aa-b47f-b5deb9695dea tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "GET /compute/v2.1/servers/1ebd041d-69cf-4717-9371-fbc1d01ee568" status: 200 len: 1519 microversion: 2.1 time: 0.163598 Jul 23 22:11:21.733370 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3451/6061] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:11:21 2022] GET /compute/v2.1/servers/1ebd041d-69cf-4717-9371-fbc1d01ee568 => generated 1519 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:11:22.754455 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3010b322-ece5-4991-8caf-0893c130dcf8 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:11:22.755438 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-3010b322-ece5-4991-8caf-0893c130dcf8 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 1ebd041d-69cf-4717-9371-fbc1d01ee568] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:11:22.767410 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3010b322-ece5-4991-8caf-0893c130dcf8 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:22.768162 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3010b322-ece5-4991-8caf-0893c130dcf8 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:22.769420 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3010b322-ece5-4991-8caf-0893c130dcf8 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:22.770198 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3010b322-ece5-4991-8caf-0893c130dcf8 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:22.921327 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-3010b322-ece5-4991-8caf-0893c130dcf8 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834c51a542834eebb2815f7fceeda333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd080cbf1b24a55b60c5035cb102a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:11:22.929348 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-3010b322-ece5-4991-8caf-0893c130dcf8 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "GET /compute/v2.1/servers/1ebd041d-69cf-4717-9371-fbc1d01ee568" status: 200 len: 1519 microversion: 2.1 time: 0.181638 Jul 23 22:11:22.929991 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3452/6062] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:11:22 2022] GET /compute/v2.1/servers/1ebd041d-69cf-4717-9371-fbc1d01ee568 => generated 1519 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:11:23.951204 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b110cbeb-8dec-4cf3-88e3-8515f679513c tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:11:23.951882 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b110cbeb-8dec-4cf3-88e3-8515f679513c tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 1ebd041d-69cf-4717-9371-fbc1d01ee568] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:11:23.960430 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b110cbeb-8dec-4cf3-88e3-8515f679513c tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:23.960932 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b110cbeb-8dec-4cf3-88e3-8515f679513c tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:23.961787 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b110cbeb-8dec-4cf3-88e3-8515f679513c tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:23.962306 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b110cbeb-8dec-4cf3-88e3-8515f679513c tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:24.098808 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b110cbeb-8dec-4cf3-88e3-8515f679513c tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834c51a542834eebb2815f7fceeda333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd080cbf1b24a55b60c5035cb102a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:11:24.106976 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b110cbeb-8dec-4cf3-88e3-8515f679513c tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "GET /compute/v2.1/servers/1ebd041d-69cf-4717-9371-fbc1d01ee568" status: 200 len: 1519 microversion: 2.1 time: 0.162556 Jul 23 22:11:24.107562 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3453/6063] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:11:23 2022] GET /compute/v2.1/servers/1ebd041d-69cf-4717-9371-fbc1d01ee568 => generated 1519 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:11:25.129218 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-27a96522-cc58-4730-b6f6-d4bc08de37cc tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:11:25.130235 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-27a96522-cc58-4730-b6f6-d4bc08de37cc tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 1ebd041d-69cf-4717-9371-fbc1d01ee568] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:11:25.142087 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-27a96522-cc58-4730-b6f6-d4bc08de37cc tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:25.142846 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-27a96522-cc58-4730-b6f6-d4bc08de37cc tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:25.144115 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-27a96522-cc58-4730-b6f6-d4bc08de37cc tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:25.144844 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-27a96522-cc58-4730-b6f6-d4bc08de37cc tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:25.289139 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-27a96522-cc58-4730-b6f6-d4bc08de37cc tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834c51a542834eebb2815f7fceeda333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd080cbf1b24a55b60c5035cb102a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:11:25.298252 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-27a96522-cc58-4730-b6f6-d4bc08de37cc tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "GET /compute/v2.1/servers/1ebd041d-69cf-4717-9371-fbc1d01ee568" status: 200 len: 1519 microversion: 2.1 time: 0.175927 Jul 23 22:11:25.298823 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3454/6064] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:11:25 2022] GET /compute/v2.1/servers/1ebd041d-69cf-4717-9371-fbc1d01ee568 => generated 1519 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:11:26.320223 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ec23786f-a173-4670-910b-e84188b0256b tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:11:26.321289 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ec23786f-a173-4670-910b-e84188b0256b tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 1ebd041d-69cf-4717-9371-fbc1d01ee568] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:11:26.330511 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ec23786f-a173-4670-910b-e84188b0256b tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:26.330970 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ec23786f-a173-4670-910b-e84188b0256b tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:26.332087 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ec23786f-a173-4670-910b-e84188b0256b tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:26.332562 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ec23786f-a173-4670-910b-e84188b0256b tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:26.478527 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ec23786f-a173-4670-910b-e84188b0256b tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834c51a542834eebb2815f7fceeda333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd080cbf1b24a55b60c5035cb102a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:11:26.486522 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ec23786f-a173-4670-910b-e84188b0256b tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "GET /compute/v2.1/servers/1ebd041d-69cf-4717-9371-fbc1d01ee568" status: 200 len: 1519 microversion: 2.1 time: 0.173013 Jul 23 22:11:26.487086 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3455/6065] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:11:26 2022] GET /compute/v2.1/servers/1ebd041d-69cf-4717-9371-fbc1d01ee568 => generated 1519 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:11:27.504183 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-86eb325f-64a7-46ba-83cd-60b0ec223f91 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:11:27.504871 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-86eb325f-64a7-46ba-83cd-60b0ec223f91 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 1ebd041d-69cf-4717-9371-fbc1d01ee568] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:11:27.512178 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-86eb325f-64a7-46ba-83cd-60b0ec223f91 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:27.512640 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-86eb325f-64a7-46ba-83cd-60b0ec223f91 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:27.513418 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-86eb325f-64a7-46ba-83cd-60b0ec223f91 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:27.513879 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-86eb325f-64a7-46ba-83cd-60b0ec223f91 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:27.733379 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-86eb325f-64a7-46ba-83cd-60b0ec223f91 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834c51a542834eebb2815f7fceeda333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd080cbf1b24a55b60c5035cb102a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:11:27.741144 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-86eb325f-64a7-46ba-83cd-60b0ec223f91 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "GET /compute/v2.1/servers/1ebd041d-69cf-4717-9371-fbc1d01ee568" status: 200 len: 1519 microversion: 2.1 time: 0.241010 Jul 23 22:11:27.741695 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3456/6066] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:11:27 2022] GET /compute/v2.1/servers/1ebd041d-69cf-4717-9371-fbc1d01ee568 => generated 1519 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:11:28.760866 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-bec4e588-37c0-4325-af53-a0fc9abba6d0 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:11:28.761714 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-bec4e588-37c0-4325-af53-a0fc9abba6d0 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 1ebd041d-69cf-4717-9371-fbc1d01ee568] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:11:28.771343 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bec4e588-37c0-4325-af53-a0fc9abba6d0 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:28.771950 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bec4e588-37c0-4325-af53-a0fc9abba6d0 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:28.773017 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bec4e588-37c0-4325-af53-a0fc9abba6d0 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:28.773600 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bec4e588-37c0-4325-af53-a0fc9abba6d0 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:28.992351 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-bec4e588-37c0-4325-af53-a0fc9abba6d0 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834c51a542834eebb2815f7fceeda333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd080cbf1b24a55b60c5035cb102a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:11:29.000774 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-bec4e588-37c0-4325-af53-a0fc9abba6d0 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "GET /compute/v2.1/servers/1ebd041d-69cf-4717-9371-fbc1d01ee568" status: 200 len: 1519 microversion: 2.1 time: 0.245268 Jul 23 22:11:29.001364 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3457/6067] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:11:28 2022] GET /compute/v2.1/servers/1ebd041d-69cf-4717-9371-fbc1d01ee568 => generated 1519 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:11:30.018565 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-7e6c8716-abc3-449b-a0d0-61047eccc11c tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:11:30.019220 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-7e6c8716-abc3-449b-a0d0-61047eccc11c tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 1ebd041d-69cf-4717-9371-fbc1d01ee568] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:11:30.026638 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7e6c8716-abc3-449b-a0d0-61047eccc11c tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:30.027106 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7e6c8716-abc3-449b-a0d0-61047eccc11c tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:30.027825 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7e6c8716-abc3-449b-a0d0-61047eccc11c tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:30.028298 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7e6c8716-abc3-449b-a0d0-61047eccc11c tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:30.162686 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-7e6c8716-abc3-449b-a0d0-61047eccc11c tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834c51a542834eebb2815f7fceeda333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd080cbf1b24a55b60c5035cb102a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:11:30.174363 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-7e6c8716-abc3-449b-a0d0-61047eccc11c tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "GET /compute/v2.1/servers/1ebd041d-69cf-4717-9371-fbc1d01ee568" status: 200 len: 1519 microversion: 2.1 time: 0.159564 Jul 23 22:11:30.175180 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3458/6068] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:11:30 2022] GET /compute/v2.1/servers/1ebd041d-69cf-4717-9371-fbc1d01ee568 => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:11:31.200869 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-fa508472-f182-4c49-a90b-bf567a9592b4 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:11:31.201979 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-fa508472-f182-4c49-a90b-bf567a9592b4 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 1ebd041d-69cf-4717-9371-fbc1d01ee568] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:11:31.210002 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fa508472-f182-4c49-a90b-bf567a9592b4 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:31.210462 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fa508472-f182-4c49-a90b-bf567a9592b4 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:31.211246 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fa508472-f182-4c49-a90b-bf567a9592b4 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:31.211702 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fa508472-f182-4c49-a90b-bf567a9592b4 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:31.349293 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-fa508472-f182-4c49-a90b-bf567a9592b4 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834c51a542834eebb2815f7fceeda333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd080cbf1b24a55b60c5035cb102a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:11:31.357653 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-fa508472-f182-4c49-a90b-bf567a9592b4 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "GET /compute/v2.1/servers/1ebd041d-69cf-4717-9371-fbc1d01ee568" status: 200 len: 1519 microversion: 2.1 time: 0.164079 Jul 23 22:11:31.358375 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3459/6069] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:11:31 2022] GET /compute/v2.1/servers/1ebd041d-69cf-4717-9371-fbc1d01ee568 => generated 1519 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:11:32.378696 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d5e874a9-5251-47bd-b1a4-018c39abd863 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:11:32.379516 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d5e874a9-5251-47bd-b1a4-018c39abd863 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 1ebd041d-69cf-4717-9371-fbc1d01ee568] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:11:32.389167 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d5e874a9-5251-47bd-b1a4-018c39abd863 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:32.389789 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d5e874a9-5251-47bd-b1a4-018c39abd863 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:32.390922 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d5e874a9-5251-47bd-b1a4-018c39abd863 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:32.391518 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d5e874a9-5251-47bd-b1a4-018c39abd863 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:32.537901 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d5e874a9-5251-47bd-b1a4-018c39abd863 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834c51a542834eebb2815f7fceeda333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd080cbf1b24a55b60c5035cb102a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:11:32.546027 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d5e874a9-5251-47bd-b1a4-018c39abd863 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "GET /compute/v2.1/servers/1ebd041d-69cf-4717-9371-fbc1d01ee568" status: 200 len: 1519 microversion: 2.1 time: 0.173098 Jul 23 22:11:32.546614 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3460/6070] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:11:32 2022] GET /compute/v2.1/servers/1ebd041d-69cf-4717-9371-fbc1d01ee568 => generated 1519 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:11:33.567935 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-039fad34-6b26-4f7e-8f2a-499ce9e26502 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:11:33.568663 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-039fad34-6b26-4f7e-8f2a-499ce9e26502 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 1ebd041d-69cf-4717-9371-fbc1d01ee568] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:11:33.571777 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=62 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:11:33.577844 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-039fad34-6b26-4f7e-8f2a-499ce9e26502 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:33.578326 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-039fad34-6b26-4f7e-8f2a-499ce9e26502 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:33.579120 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-039fad34-6b26-4f7e-8f2a-499ce9e26502 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:33.579574 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-039fad34-6b26-4f7e-8f2a-499ce9e26502 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:33.727049 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-039fad34-6b26-4f7e-8f2a-499ce9e26502 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834c51a542834eebb2815f7fceeda333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd080cbf1b24a55b60c5035cb102a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:11:33.735074 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-039fad34-6b26-4f7e-8f2a-499ce9e26502 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "GET /compute/v2.1/servers/1ebd041d-69cf-4717-9371-fbc1d01ee568" status: 200 len: 1519 microversion: 2.1 time: 0.172082 Jul 23 22:11:33.735659 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3461/6071] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:11:33 2022] GET /compute/v2.1/servers/1ebd041d-69cf-4717-9371-fbc1d01ee568 => generated 1519 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:11:34.756381 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-7393bdba-54c3-4886-afe5-1d8f7c0f7214 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:11:34.757433 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-7393bdba-54c3-4886-afe5-1d8f7c0f7214 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 1ebd041d-69cf-4717-9371-fbc1d01ee568] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:11:34.765224 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7393bdba-54c3-4886-afe5-1d8f7c0f7214 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:34.765687 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7393bdba-54c3-4886-afe5-1d8f7c0f7214 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:34.766517 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7393bdba-54c3-4886-afe5-1d8f7c0f7214 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:34.766969 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7393bdba-54c3-4886-afe5-1d8f7c0f7214 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:34.903841 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-7393bdba-54c3-4886-afe5-1d8f7c0f7214 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834c51a542834eebb2815f7fceeda333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd080cbf1b24a55b60c5035cb102a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:11:34.912051 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-7393bdba-54c3-4886-afe5-1d8f7c0f7214 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "GET /compute/v2.1/servers/1ebd041d-69cf-4717-9371-fbc1d01ee568" status: 200 len: 1519 microversion: 2.1 time: 0.161047 Jul 23 22:11:34.912628 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3462/6072] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:11:34 2022] GET /compute/v2.1/servers/1ebd041d-69cf-4717-9371-fbc1d01ee568 => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:11:35.599070 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-4e03ea81-00c8-4d58-af76-b689a0b22ffb req-b0344934-6dd7-4bf8-95a8-d0593da57e61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ebd041d-69cf-4717-9371-fbc1d01ee568", "name": "network-vif-unplugged", "status": "completed", "tag": "35a5e6c2-6f59-4d78-a032-dff385e13f1c"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:11:35.610914 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-4e03ea81-00c8-4d58-af76-b689a0b22ffb req-b0344934-6dd7-4bf8-95a8-d0593da57e61 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:35.611367 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-4e03ea81-00c8-4d58-af76-b689a0b22ffb req-b0344934-6dd7-4bf8-95a8-d0593da57e61 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:35.624058 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-4e03ea81-00c8-4d58-af76-b689a0b22ffb req-b0344934-6dd7-4bf8-95a8-d0593da57e61 service nova] Creating event network-vif-unplugged:35a5e6c2-6f59-4d78-a032-dff385e13f1c for instance 1ebd041d-69cf-4717-9371-fbc1d01ee568 on nch1-master-1 Jul 23 22:11:35.629934 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [req-4e03ea81-00c8-4d58-af76-b689a0b22ffb req-b0344934-6dd7-4bf8-95a8-d0593da57e61 service nova] Instance 1ebd041d-69cf-4717-9371-fbc1d01ee568 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=131320) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 23 22:11:35.642380 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-4e03ea81-00c8-4d58-af76-b689a0b22ffb req-b0344934-6dd7-4bf8-95a8-d0593da57e61 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.120540 Jul 23 22:11:35.643778 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3463/6073] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:11:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:11:35.931781 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5980b89b-fba9-40e9-93f4-fc7db92ed64b tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:11:35.933254 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5980b89b-fba9-40e9-93f4-fc7db92ed64b tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 1ebd041d-69cf-4717-9371-fbc1d01ee568] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:11:35.940140 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5980b89b-fba9-40e9-93f4-fc7db92ed64b tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:35.940610 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5980b89b-fba9-40e9-93f4-fc7db92ed64b tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:35.941396 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5980b89b-fba9-40e9-93f4-fc7db92ed64b tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:35.941838 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5980b89b-fba9-40e9-93f4-fc7db92ed64b tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:35.958568 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=100 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:11:36.081249 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5980b89b-fba9-40e9-93f4-fc7db92ed64b tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834c51a542834eebb2815f7fceeda333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd080cbf1b24a55b60c5035cb102a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:11:36.089431 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5980b89b-fba9-40e9-93f4-fc7db92ed64b tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "GET /compute/v2.1/servers/1ebd041d-69cf-4717-9371-fbc1d01ee568" status: 200 len: 1518 microversion: 2.1 time: 0.163110 Jul 23 22:11:36.090055 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3464/6074] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:11:35 2022] GET /compute/v2.1/servers/1ebd041d-69cf-4717-9371-fbc1d01ee568 => generated 1518 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:11:37.115014 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-18c995c4-822c-4d30-a54b-5cac4df6cfac tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:11:37.116367 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-18c995c4-822c-4d30-a54b-5cac4df6cfac tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 1ebd041d-69cf-4717-9371-fbc1d01ee568] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:11:37.126668 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-18c995c4-822c-4d30-a54b-5cac4df6cfac tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:37.127142 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-18c995c4-822c-4d30-a54b-5cac4df6cfac tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:37.127895 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-18c995c4-822c-4d30-a54b-5cac4df6cfac tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:37.128330 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-18c995c4-822c-4d30-a54b-5cac4df6cfac tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:37.267844 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-18c995c4-822c-4d30-a54b-5cac4df6cfac tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834c51a542834eebb2815f7fceeda333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd080cbf1b24a55b60c5035cb102a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:11:37.276025 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-18c995c4-822c-4d30-a54b-5cac4df6cfac tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "GET /compute/v2.1/servers/1ebd041d-69cf-4717-9371-fbc1d01ee568" status: 200 len: 1516 microversion: 2.1 time: 0.171301 Jul 23 22:11:37.276616 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3465/6075] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:11:37 2022] GET /compute/v2.1/servers/1ebd041d-69cf-4717-9371-fbc1d01ee568 => generated 1516 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:11:37.661447 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-6852d177-8aa8-4e49-b81c-af4158d42296 req-ddb04e81-3ece-4809-9c09-29f1323dab82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ebd041d-69cf-4717-9371-fbc1d01ee568", "tag": "35a5e6c2-6f59-4d78-a032-dff385e13f1c"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:11:37.671120 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-6852d177-8aa8-4e49-b81c-af4158d42296 req-ddb04e81-3ece-4809-9c09-29f1323dab82 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:37.671635 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-6852d177-8aa8-4e49-b81c-af4158d42296 req-ddb04e81-3ece-4809-9c09-29f1323dab82 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:37.685269 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-6852d177-8aa8-4e49-b81c-af4158d42296 req-ddb04e81-3ece-4809-9c09-29f1323dab82 service nova] Creating event network-changed:35a5e6c2-6f59-4d78-a032-dff385e13f1c for instance 1ebd041d-69cf-4717-9371-fbc1d01ee568 on nch1-master-1 Jul 23 22:11:37.691263 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [req-6852d177-8aa8-4e49-b81c-af4158d42296 req-ddb04e81-3ece-4809-9c09-29f1323dab82 service nova] Instance 1ebd041d-69cf-4717-9371-fbc1d01ee568 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=131320) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 23 22:11:37.701897 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-6852d177-8aa8-4e49-b81c-af4158d42296 req-ddb04e81-3ece-4809-9c09-29f1323dab82 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044721 Jul 23 22:11:37.702506 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3466/6076] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:11:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:11:38.294378 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d75c378a-a30f-4794-9f10-f0845d9853ad tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:11:38.295137 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d75c378a-a30f-4794-9f10-f0845d9853ad tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 1ebd041d-69cf-4717-9371-fbc1d01ee568] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:11:38.302051 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d75c378a-a30f-4794-9f10-f0845d9853ad tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:38.302510 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d75c378a-a30f-4794-9f10-f0845d9853ad tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:38.303293 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d75c378a-a30f-4794-9f10-f0845d9853ad tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:38.303736 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d75c378a-a30f-4794-9f10-f0845d9853ad tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:38.440864 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d75c378a-a30f-4794-9f10-f0845d9853ad tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834c51a542834eebb2815f7fceeda333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd080cbf1b24a55b60c5035cb102a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:11:38.448691 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d75c378a-a30f-4794-9f10-f0845d9853ad tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "GET /compute/v2.1/servers/1ebd041d-69cf-4717-9371-fbc1d01ee568" status: 200 len: 1513 microversion: 2.1 time: 0.159628 Jul 23 22:11:38.449313 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3467/6077] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:11:38 2022] GET /compute/v2.1/servers/1ebd041d-69cf-4717-9371-fbc1d01ee568 => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:11:38.465527 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-97adcbd1-959a-40ba-bcc4-4d4582e656fc tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:11:38.466090 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-97adcbd1-959a-40ba-bcc4-4d4582e656fc tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 1ebd041d-69cf-4717-9371-fbc1d01ee568] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:11:38.472583 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-97adcbd1-959a-40ba-bcc4-4d4582e656fc tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:38.473050 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-97adcbd1-959a-40ba-bcc4-4d4582e656fc tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:38.473811 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-97adcbd1-959a-40ba-bcc4-4d4582e656fc tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:38.474286 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-97adcbd1-959a-40ba-bcc4-4d4582e656fc tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:38.534820 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-97adcbd1-959a-40ba-bcc4-4d4582e656fc tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "POST /compute/v2.1/servers/1ebd041d-69cf-4717-9371-fbc1d01ee568/action" status: 204 len: 0 microversion: 2.1 time: 0.072822 Jul 23 22:11:38.535735 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3468/6078] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 22:11:38 2022] POST /compute/v2.1/servers/1ebd041d-69cf-4717-9371-fbc1d01ee568/action => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 22:11:38.544678 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-72cd94c3-907a-4f34-8ca6-58477aa132e8 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:11:38.545396 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-72cd94c3-907a-4f34-8ca6-58477aa132e8 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 1ebd041d-69cf-4717-9371-fbc1d01ee568] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:11:38.553384 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-72cd94c3-907a-4f34-8ca6-58477aa132e8 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:38.553840 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-72cd94c3-907a-4f34-8ca6-58477aa132e8 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:38.554680 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-72cd94c3-907a-4f34-8ca6-58477aa132e8 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:38.555637 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-72cd94c3-907a-4f34-8ca6-58477aa132e8 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:38.689243 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-72cd94c3-907a-4f34-8ca6-58477aa132e8 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834c51a542834eebb2815f7fceeda333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd080cbf1b24a55b60c5035cb102a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:11:38.697154 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-72cd94c3-907a-4f34-8ca6-58477aa132e8 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "GET /compute/v2.1/servers/1ebd041d-69cf-4717-9371-fbc1d01ee568" status: 200 len: 1513 microversion: 2.1 time: 0.157040 Jul 23 22:11:38.697733 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3469/6079] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:11:38 2022] GET /compute/v2.1/servers/1ebd041d-69cf-4717-9371-fbc1d01ee568 => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:11:39.714961 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ac2a768c-695b-4ea2-b66b-23f1ee224ab3 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:11:39.715698 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ac2a768c-695b-4ea2-b66b-23f1ee224ab3 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 1ebd041d-69cf-4717-9371-fbc1d01ee568] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:11:39.722984 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ac2a768c-695b-4ea2-b66b-23f1ee224ab3 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:39.723523 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ac2a768c-695b-4ea2-b66b-23f1ee224ab3 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:39.724373 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ac2a768c-695b-4ea2-b66b-23f1ee224ab3 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:39.724910 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ac2a768c-695b-4ea2-b66b-23f1ee224ab3 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:39.868852 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ac2a768c-695b-4ea2-b66b-23f1ee224ab3 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834c51a542834eebb2815f7fceeda333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd080cbf1b24a55b60c5035cb102a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:11:39.878541 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ac2a768c-695b-4ea2-b66b-23f1ee224ab3 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "GET /compute/v2.1/servers/1ebd041d-69cf-4717-9371-fbc1d01ee568" status: 200 len: 1505 microversion: 2.1 time: 0.167563 Jul 23 22:11:39.879124 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3470/6080] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:11:39 2022] GET /compute/v2.1/servers/1ebd041d-69cf-4717-9371-fbc1d01ee568 => generated 1505 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:11:39.894688 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a535b56d-e7d6-4453-bf4b-f7b40a6e9d0f tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:11:39.895317 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a535b56d-e7d6-4453-bf4b-f7b40a6e9d0f tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 1ebd041d-69cf-4717-9371-fbc1d01ee568] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:11:39.901182 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a535b56d-e7d6-4453-bf4b-f7b40a6e9d0f tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:39.901637 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a535b56d-e7d6-4453-bf4b-f7b40a6e9d0f tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:39.902461 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a535b56d-e7d6-4453-bf4b-f7b40a6e9d0f tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:39.902940 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a535b56d-e7d6-4453-bf4b-f7b40a6e9d0f tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:40.039211 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a535b56d-e7d6-4453-bf4b-f7b40a6e9d0f tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834c51a542834eebb2815f7fceeda333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd080cbf1b24a55b60c5035cb102a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:11:40.047414 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a535b56d-e7d6-4453-bf4b-f7b40a6e9d0f tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "GET /compute/v2.1/servers/1ebd041d-69cf-4717-9371-fbc1d01ee568" status: 200 len: 1505 microversion: 2.1 time: 0.156425 Jul 23 22:11:40.048000 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3471/6081] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:11:39 2022] GET /compute/v2.1/servers/1ebd041d-69cf-4717-9371-fbc1d01ee568 => generated 1505 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:11:40.063272 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-069c52e7-e705-4e04-af1e-663aad2a0dcc tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:11:40.063882 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-069c52e7-e705-4e04-af1e-663aad2a0dcc tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 1ebd041d-69cf-4717-9371-fbc1d01ee568] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:11:40.070095 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-069c52e7-e705-4e04-af1e-663aad2a0dcc tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:40.070549 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-069c52e7-e705-4e04-af1e-663aad2a0dcc tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:40.071351 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-069c52e7-e705-4e04-af1e-663aad2a0dcc tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:40.071787 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-069c52e7-e705-4e04-af1e-663aad2a0dcc tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:40.203246 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-069c52e7-e705-4e04-af1e-663aad2a0dcc tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834c51a542834eebb2815f7fceeda333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd080cbf1b24a55b60c5035cb102a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:11:40.211642 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-069c52e7-e705-4e04-af1e-663aad2a0dcc tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "GET /compute/v2.1/servers/1ebd041d-69cf-4717-9371-fbc1d01ee568" status: 200 len: 1505 microversion: 2.1 time: 0.152039 Jul 23 22:11:40.212269 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3472/6082] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:11:40 2022] GET /compute/v2.1/servers/1ebd041d-69cf-4717-9371-fbc1d01ee568 => generated 1505 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:11:40.227926 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-058db270-fc02-4563-807c-a8197cbb68c5 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:11:40.228434 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-058db270-fc02-4563-807c-a8197cbb68c5 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 1ebd041d-69cf-4717-9371-fbc1d01ee568] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:11:40.234630 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-058db270-fc02-4563-807c-a8197cbb68c5 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:40.235086 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-058db270-fc02-4563-807c-a8197cbb68c5 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:40.235861 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-058db270-fc02-4563-807c-a8197cbb68c5 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:40.236332 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-058db270-fc02-4563-807c-a8197cbb68c5 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:40.261734 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-058db270-fc02-4563-807c-a8197cbb68c5 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 1ebd041d-69cf-4717-9371-fbc1d01ee568] Going to try to terminate instance {{(pid=131320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 22:11:40.346300 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-058db270-fc02-4563-807c-a8197cbb68c5 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "DELETE /compute/v2.1/servers/1ebd041d-69cf-4717-9371-fbc1d01ee568" status: 204 len: 0 microversion: 2.1 time: 0.121985 Jul 23 22:11:40.346998 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3473/6083] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 22:11:40 2022] DELETE /compute/v2.1/servers/1ebd041d-69cf-4717-9371-fbc1d01ee568 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 22:11:40.361714 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2acf09d9-c92e-41bd-87b7-9e4af3586b64 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:11:40.362348 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-2acf09d9-c92e-41bd-87b7-9e4af3586b64 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 1ebd041d-69cf-4717-9371-fbc1d01ee568] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:11:40.368588 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2acf09d9-c92e-41bd-87b7-9e4af3586b64 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:40.369046 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2acf09d9-c92e-41bd-87b7-9e4af3586b64 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:40.369801 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2acf09d9-c92e-41bd-87b7-9e4af3586b64 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:40.370268 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2acf09d9-c92e-41bd-87b7-9e4af3586b64 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:40.396448 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-2acf09d9-c92e-41bd-87b7-9e4af3586b64 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 1ebd041d-69cf-4717-9371-fbc1d01ee568] Going to try to terminate instance {{(pid=131320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 22:11:40.440563 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.compute.api [None req-2acf09d9-c92e-41bd-87b7-9e4af3586b64 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 1ebd041d-69cf-4717-9371-fbc1d01ee568] Instance is already in deleting state, ignoring this request Jul 23 22:11:40.441308 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2acf09d9-c92e-41bd-87b7-9e4af3586b64 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "DELETE /compute/v2.1/servers/1ebd041d-69cf-4717-9371-fbc1d01ee568" status: 204 len: 0 microversion: 2.1 time: 0.083815 Jul 23 22:11:40.441901 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3474/6084] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 22:11:40 2022] DELETE /compute/v2.1/servers/1ebd041d-69cf-4717-9371-fbc1d01ee568 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 22:11:40.449782 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-df751db9-2ce1-424e-882c-b5c4917206d3 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:11:40.450455 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-df751db9-2ce1-424e-882c-b5c4917206d3 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 1ebd041d-69cf-4717-9371-fbc1d01ee568] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:11:40.457023 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-df751db9-2ce1-424e-882c-b5c4917206d3 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:40.457475 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-df751db9-2ce1-424e-882c-b5c4917206d3 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:40.458274 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-df751db9-2ce1-424e-882c-b5c4917206d3 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:40.458713 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-df751db9-2ce1-424e-882c-b5c4917206d3 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:40.605119 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-df751db9-2ce1-424e-882c-b5c4917206d3 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834c51a542834eebb2815f7fceeda333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd080cbf1b24a55b60c5035cb102a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:11:40.613311 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-df751db9-2ce1-424e-882c-b5c4917206d3 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "GET /compute/v2.1/servers/1ebd041d-69cf-4717-9371-fbc1d01ee568" status: 200 len: 1511 microversion: 2.1 time: 0.167142 Jul 23 22:11:40.613929 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3475/6085] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:11:40 2022] GET /compute/v2.1/servers/1ebd041d-69cf-4717-9371-fbc1d01ee568 => generated 1511 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:11:41.631077 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-95acc05f-4d41-427f-9ba3-22e16a77f858 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:11:41.631701 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-95acc05f-4d41-427f-9ba3-22e16a77f858 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 1ebd041d-69cf-4717-9371-fbc1d01ee568] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:11:41.639069 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-95acc05f-4d41-427f-9ba3-22e16a77f858 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:41.639537 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-95acc05f-4d41-427f-9ba3-22e16a77f858 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:41.640326 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-95acc05f-4d41-427f-9ba3-22e16a77f858 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:41.640778 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-95acc05f-4d41-427f-9ba3-22e16a77f858 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:41.778890 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-95acc05f-4d41-427f-9ba3-22e16a77f858 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '834c51a542834eebb2815f7fceeda333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffd080cbf1b24a55b60c5035cb102a12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:11:41.787031 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-95acc05f-4d41-427f-9ba3-22e16a77f858 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "GET /compute/v2.1/servers/1ebd041d-69cf-4717-9371-fbc1d01ee568" status: 200 len: 1511 microversion: 2.1 time: 0.159890 Jul 23 22:11:41.787855 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3476/6086] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:11:41 2022] GET /compute/v2.1/servers/1ebd041d-69cf-4717-9371-fbc1d01ee568 => generated 1511 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:11:41.794039 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-3489c3d3-fa02-47e6-b182-c398ed4805e1 req-4697b71f-a0b4-46cb-ae67-f2369f9cae19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ebd041d-69cf-4717-9371-fbc1d01ee568", "name": "network-vif-plugged", "status": "completed", "tag": "35a5e6c2-6f59-4d78-a032-dff385e13f1c"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:11:41.804386 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-3489c3d3-fa02-47e6-b182-c398ed4805e1 req-4697b71f-a0b4-46cb-ae67-f2369f9cae19 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:41.804971 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-3489c3d3-fa02-47e6-b182-c398ed4805e1 req-4697b71f-a0b4-46cb-ae67-f2369f9cae19 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:41.813613 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:11:41.823475 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-3489c3d3-fa02-47e6-b182-c398ed4805e1 req-4697b71f-a0b4-46cb-ae67-f2369f9cae19 service nova] Creating event network-vif-plugged:35a5e6c2-6f59-4d78-a032-dff385e13f1c for instance 1ebd041d-69cf-4717-9371-fbc1d01ee568 on nch1-master-1 Jul 23 22:11:41.829300 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-3489c3d3-fa02-47e6-b182-c398ed4805e1 req-4697b71f-a0b4-46cb-ae67-f2369f9cae19 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039901 Jul 23 22:11:41.830342 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3477/6087] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:11:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:11:42.561892 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-df1172cc-529d-4b73-a8af-c75009366c45 req-38273cff-ef6c-40db-92a2-c0e7cff13f70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ebd041d-69cf-4717-9371-fbc1d01ee568", "name": "network-vif-deleted", "tag": "35a5e6c2-6f59-4d78-a032-dff385e13f1c"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:11:42.572826 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-df1172cc-529d-4b73-a8af-c75009366c45 req-38273cff-ef6c-40db-92a2-c0e7cff13f70 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:42.573270 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-df1172cc-529d-4b73-a8af-c75009366c45 req-38273cff-ef6c-40db-92a2-c0e7cff13f70 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:42.585878 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-df1172cc-529d-4b73-a8af-c75009366c45 req-38273cff-ef6c-40db-92a2-c0e7cff13f70 service nova] Creating event network-vif-deleted:35a5e6c2-6f59-4d78-a032-dff385e13f1c for instance 1ebd041d-69cf-4717-9371-fbc1d01ee568 on nch1-master-1 Jul 23 22:11:42.591295 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-df1172cc-529d-4b73-a8af-c75009366c45 req-38273cff-ef6c-40db-92a2-c0e7cff13f70 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033787 Jul 23 22:11:42.591952 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3478/6088] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:11:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:11:42.806803 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6e421ac6-f367-4acb-ad34-c410cd7c3908 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:11:42.807756 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6e421ac6-f367-4acb-ad34-c410cd7c3908 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 1ebd041d-69cf-4717-9371-fbc1d01ee568] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:11:42.814547 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6e421ac6-f367-4acb-ad34-c410cd7c3908 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:42.815037 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6e421ac6-f367-4acb-ad34-c410cd7c3908 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:42.815824 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6e421ac6-f367-4acb-ad34-c410cd7c3908 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:42.816722 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6e421ac6-f367-4acb-ad34-c410cd7c3908 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:42.831043 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-6e421ac6-f367-4acb-ad34-c410cd7c3908 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] HTTP exception thrown: Instance 1ebd041d-69cf-4717-9371-fbc1d01ee568 could not be found. Jul 23 22:11:42.833150 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6e421ac6-f367-4acb-ad34-c410cd7c3908 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Request method failure captured: Jul 23 22:11:42.833150 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/1ebd041d-69cf-4717-9371-fbc1d01ee568 HTTP/1.1 Jul 23 22:11:42.833150 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 22:11:42.833150 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 22:11:42.833150 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 22:11:42.833150 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 22:11:42.833150 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 22:11:42.833150 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 22:11:42.833150 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 22:11:42.833150 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 22:11:42.833150 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3HG8Ce-I84Vo4KSkoi-UExk1AoelIEV7MbAGueD4Z1IESEwKa3n0s8qMYNANPNDej3bpZOo9zqGnMmlR45hW4RZKbYJnJ9-FPsbyuhEfGPu7Xzc1vQyXP9BhfEnBXe2MjRE5Hj3YBGFz5eCLxE1fB-GxJlYUusNgkDDatqjUEsgl6bw Jul 23 22:11:42.833150 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 22:11:42.833150 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 22:11:42.833150 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 22:11:42.833150 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 22:11:42.833150 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 22:11:42.833150 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 22:11:42.833150 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: ffd080cbf1b24a55b60c5035cb102a12 Jul 23 22:11:42.833150 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1595851040 Jul 23 22:11:42.833150 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 22:11:42.833150 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 22:11:42.833150 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ffd080cbf1b24a55b60c5035cb102a12"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ffd080cbf1b24a55b60c5035cb102a12"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ffd080cbf1b24a55b60c5035cb102a12", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ffd080cbf1b24a55b60c5035cb102a12"}]}] Jul 23 22:11:42.833150 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServerDiskConfigTestJSON-1595851040 Jul 23 22:11:42.833150 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: ffd080cbf1b24a55b60c5035cb102a12 Jul 23 22:11:42.833150 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1595851040 Jul 23 22:11:42.833150 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServerDiskConfigTestJSON-1595851040-project Jul 23 22:11:42.833150 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 22:11:42.833150 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 22:11:42.833150 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 834c51a542834eebb2815f7fceeda333 Jul 23 22:11:42.833150 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServerDiskConfigTestJSON-1595851040-project Jul 23 22:11:42.833150 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 22:11:42.833150 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance 1ebd041d-69cf-4717-9371-fbc1d01ee568 could not be found. Jul 23 22:11:42.833150 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '1ebd041d-69cf-4717-9371-fbc1d01ee568'} Jul 23 22:11:42.833150 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 22:11:42.833150 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:11:42.833150 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 22:11:42.833150 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 22:11:42.833150 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 22:11:42.833150 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 22:11:42.833150 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 22:11:42.833150 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 22:11:42.833150 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 22:11:42.833150 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 22:11:42.833150 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ebd041d-69cf-4717-9371-fbc1d01ee568 could not be found. Jul 23 22:11:42.833150 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:11:42.833150 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:11:42.833150 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:11:42.833150 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:11:42.833150 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:11:42.833150 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:11:42.833150 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 22:11:42.833150 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 22:11:42.833150 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 22:11:42.833150 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 22:11:42.833150 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 22:11:42.833150 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 22:11:42.833150 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 22:11:42.833150 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 22:11:42.833150 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 22:11:42.833150 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 22:11:42.833150 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ebd041d-69cf-4717-9371-fbc1d01ee568 could not be found. Jul 23 22:11:42.833150 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:11:42.833150 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:11:42.833150 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:11:42.838030 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:11:42.838030 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:11:42.838030 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:11:42.838030 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 22:11:42.838030 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 22:11:42.838030 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ebd041d-69cf-4717-9371-fbc1d01ee568 could not be found. Jul 23 22:11:42.838030 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:11:42.838030 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6e421ac6-f367-4acb-ad34-c410cd7c3908 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Returning 404 to user: Instance 1ebd041d-69cf-4717-9371-fbc1d01ee568 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 22:11:42.838030 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6e421ac6-f367-4acb-ad34-c410cd7c3908 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "GET /compute/v2.1/servers/1ebd041d-69cf-4717-9371-fbc1d01ee568" status: 404 len: 111 microversion: 2.1 time: 0.033145 Jul 23 22:11:42.838030 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3479/6089] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:11:42 2022] GET /compute/v2.1/servers/1ebd041d-69cf-4717-9371-fbc1d01ee568 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 23 22:11:42.844731 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-80313a66-0ef2-434b-8cb8-8ab0ec791ac6 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Calling method '.version_select at 0x7f0b478e6700>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:11:42.866462 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-80313a66-0ef2-434b-8cb8-8ab0ec791ac6 tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2039220180" status: 202 len: 0 microversion: 2.1 time: 0.025640 Jul 23 22:11:42.867202 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3480/6090] 10.222.0.17 () {58 vars in 1220 bytes} [Sat Jul 23 22:11:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2039220180 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 22:11:43.475661 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3f88f095-f40d-465d-a547-10bdb4309f3c tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:11:43.476159 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-3f88f095-f40d-465d-a547-10bdb4309f3c tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 4ed5b675-0efa-4ee6-81ff-f2161790e410] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:11:43.482562 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3f88f095-f40d-465d-a547-10bdb4309f3c tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:43.483009 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3f88f095-f40d-465d-a547-10bdb4309f3c tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:43.483771 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3f88f095-f40d-465d-a547-10bdb4309f3c tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:43.484211 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3f88f095-f40d-465d-a547-10bdb4309f3c tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:43.497893 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-3f88f095-f40d-465d-a547-10bdb4309f3c tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] HTTP exception thrown: Instance 4ed5b675-0efa-4ee6-81ff-f2161790e410 could not be found. Jul 23 22:11:43.499459 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3f88f095-f40d-465d-a547-10bdb4309f3c tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Request method failure captured: Jul 23 22:11:43.499459 ncdv-master-1 devstack@n-api.service[131320]: request: DELETE /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410 HTTP/1.1 Jul 23 22:11:43.499459 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 22:11:43.499459 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 22:11:43.499459 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 22:11:43.499459 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 22:11:43.499459 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 22:11:43.499459 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 22:11:43.499459 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 22:11:43.499459 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 22:11:43.499459 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3HG8Ce-I84Vo4KSkoi-UExk1AoelIEV7MbAGueD4Z1IESEwKa3n0s8qMYNANPNDej3bpZOo9zqGnMmlR45hW4RZKbYJnJ9-FPsbyuhEfGPu7Xzc1vQyXP9BhfEnBXe2MjRE5Hj3YBGFz5eCLxE1fB-GxJlYUusNgkDDatqjUEsgl6bw Jul 23 22:11:43.499459 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 22:11:43.499459 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 22:11:43.499459 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 22:11:43.499459 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 22:11:43.499459 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 22:11:43.499459 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 22:11:43.499459 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: ffd080cbf1b24a55b60c5035cb102a12 Jul 23 22:11:43.499459 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1595851040 Jul 23 22:11:43.499459 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 22:11:43.499459 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 22:11:43.499459 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ffd080cbf1b24a55b60c5035cb102a12"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ffd080cbf1b24a55b60c5035cb102a12"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ffd080cbf1b24a55b60c5035cb102a12", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ffd080cbf1b24a55b60c5035cb102a12"}]}] Jul 23 22:11:43.499459 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServerDiskConfigTestJSON-1595851040 Jul 23 22:11:43.499459 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: ffd080cbf1b24a55b60c5035cb102a12 Jul 23 22:11:43.499459 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1595851040 Jul 23 22:11:43.499459 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServerDiskConfigTestJSON-1595851040-project Jul 23 22:11:43.499459 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 22:11:43.499459 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 22:11:43.499459 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 834c51a542834eebb2815f7fceeda333 Jul 23 22:11:43.499459 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServerDiskConfigTestJSON-1595851040-project Jul 23 22:11:43.499459 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 22:11:43.499459 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance 4ed5b675-0efa-4ee6-81ff-f2161790e410 could not be found. Jul 23 22:11:43.499459 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '4ed5b675-0efa-4ee6-81ff-f2161790e410'} Jul 23 22:11:43.499459 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 22:11:43.499459 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:11:43.499459 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 22:11:43.499459 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 22:11:43.499459 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 22:11:43.499459 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 22:11:43.499459 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 22:11:43.499459 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 22:11:43.499459 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 22:11:43.499459 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 22:11:43.499459 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ed5b675-0efa-4ee6-81ff-f2161790e410 could not be found. Jul 23 22:11:43.499459 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:11:43.499459 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:11:43.499459 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:11:43.499459 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:11:43.499459 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:11:43.499459 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:11:43.499459 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 22:11:43.499459 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 22:11:43.499459 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 22:11:43.499459 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 22:11:43.499459 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 23 22:11:43.499459 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 23 22:11:43.499459 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 23 22:11:43.499459 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 23 22:11:43.499459 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 22:11:43.499459 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 22:11:43.499459 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 22:11:43.499459 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 22:11:43.503331 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ed5b675-0efa-4ee6-81ff-f2161790e410 could not be found. Jul 23 22:11:43.503331 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:11:43.503331 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:11:43.503331 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:11:43.503331 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:11:43.503331 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:11:43.503331 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:11:43.503331 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 22:11:43.503331 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 22:11:43.503331 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ed5b675-0efa-4ee6-81ff-f2161790e410 could not be found. Jul 23 22:11:43.503331 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:11:43.503331 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3f88f095-f40d-465d-a547-10bdb4309f3c tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Returning 404 to user: Instance 4ed5b675-0efa-4ee6-81ff-f2161790e410 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 22:11:43.503331 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-3f88f095-f40d-465d-a547-10bdb4309f3c tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "DELETE /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410" status: 404 len: 111 microversion: 2.1 time: 0.029279 Jul 23 22:11:43.503331 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3481/6091] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 22:11:43 2022] DELETE /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 22:11:43.509135 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9745a759-a2e9-41a8-87df-3df8808d6cec tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:11:43.509764 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-9745a759-a2e9-41a8-87df-3df8808d6cec tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] [instance: 4ed5b675-0efa-4ee6-81ff-f2161790e410] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:11:43.515659 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9745a759-a2e9-41a8-87df-3df8808d6cec tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:43.516113 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9745a759-a2e9-41a8-87df-3df8808d6cec tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:43.516866 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9745a759-a2e9-41a8-87df-3df8808d6cec tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:43.517304 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9745a759-a2e9-41a8-87df-3df8808d6cec tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:43.530923 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-9745a759-a2e9-41a8-87df-3df8808d6cec tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] HTTP exception thrown: Instance 4ed5b675-0efa-4ee6-81ff-f2161790e410 could not be found. Jul 23 22:11:43.532563 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9745a759-a2e9-41a8-87df-3df8808d6cec tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Request method failure captured: Jul 23 22:11:43.532563 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410 HTTP/1.1 Jul 23 22:11:43.532563 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 22:11:43.532563 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 22:11:43.532563 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 22:11:43.532563 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 22:11:43.532563 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 22:11:43.532563 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 22:11:43.532563 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 22:11:43.532563 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 22:11:43.532563 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3HG8Ce-I84Vo4KSkoi-UExk1AoelIEV7MbAGueD4Z1IESEwKa3n0s8qMYNANPNDej3bpZOo9zqGnMmlR45hW4RZKbYJnJ9-FPsbyuhEfGPu7Xzc1vQyXP9BhfEnBXe2MjRE5Hj3YBGFz5eCLxE1fB-GxJlYUusNgkDDatqjUEsgl6bw Jul 23 22:11:43.532563 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 22:11:43.532563 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 22:11:43.532563 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 22:11:43.532563 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 22:11:43.532563 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 22:11:43.532563 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 22:11:43.532563 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: ffd080cbf1b24a55b60c5035cb102a12 Jul 23 22:11:43.532563 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1595851040 Jul 23 22:11:43.532563 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 22:11:43.532563 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 22:11:43.532563 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ffd080cbf1b24a55b60c5035cb102a12"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ffd080cbf1b24a55b60c5035cb102a12"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ffd080cbf1b24a55b60c5035cb102a12", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ffd080cbf1b24a55b60c5035cb102a12"}]}] Jul 23 22:11:43.532563 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServerDiskConfigTestJSON-1595851040 Jul 23 22:11:43.532563 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: ffd080cbf1b24a55b60c5035cb102a12 Jul 23 22:11:43.532563 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1595851040 Jul 23 22:11:43.532563 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServerDiskConfigTestJSON-1595851040-project Jul 23 22:11:43.532563 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 22:11:43.532563 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 22:11:43.532563 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 834c51a542834eebb2815f7fceeda333 Jul 23 22:11:43.532563 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServerDiskConfigTestJSON-1595851040-project Jul 23 22:11:43.532563 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 22:11:43.532563 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance 4ed5b675-0efa-4ee6-81ff-f2161790e410 could not be found. Jul 23 22:11:43.532563 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '4ed5b675-0efa-4ee6-81ff-f2161790e410'} Jul 23 22:11:43.532563 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 22:11:43.532563 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:11:43.532563 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 22:11:43.532563 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 22:11:43.532563 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 22:11:43.532563 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 22:11:43.532563 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 22:11:43.532563 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 22:11:43.532563 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 22:11:43.532563 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 22:11:43.532563 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ed5b675-0efa-4ee6-81ff-f2161790e410 could not be found. Jul 23 22:11:43.532563 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:11:43.532563 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:11:43.532563 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:11:43.532563 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:11:43.532563 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:11:43.532563 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:11:43.532563 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 22:11:43.532563 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 22:11:43.532563 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 22:11:43.532563 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 22:11:43.532563 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 22:11:43.532563 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 22:11:43.532563 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 22:11:43.532563 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 22:11:43.532563 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 22:11:43.532563 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 22:11:43.532563 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ed5b675-0efa-4ee6-81ff-f2161790e410 could not be found. Jul 23 22:11:43.532563 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:11:43.532563 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:11:43.532563 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:11:43.537047 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:11:43.537047 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:11:43.537047 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:11:43.537047 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 22:11:43.537047 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 22:11:43.537047 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ed5b675-0efa-4ee6-81ff-f2161790e410 could not be found. Jul 23 22:11:43.537047 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:11:43.537047 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9745a759-a2e9-41a8-87df-3df8808d6cec tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] Returning 404 to user: Instance 4ed5b675-0efa-4ee6-81ff-f2161790e410 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 22:11:43.537047 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9745a759-a2e9-41a8-87df-3df8808d6cec tempest-ServerDiskConfigTestJSON-1595851040 tempest-ServerDiskConfigTestJSON-1595851040-project] 10.222.0.17 "GET /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410" status: 404 len: 111 microversion: 2.1 time: 0.028476 Jul 23 22:11:43.537047 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3482/6092] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:11:43 2022] GET /compute/v2.1/servers/4ed5b675-0efa-4ee6-81ff-f2161790e410 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 22:11:52.333320 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-44fa0a40-ed34-41ff-a7e7-e9612866ec65 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Action: 'create', calling method: .version_select at 0x7f0b47ccd3a0>, body: {"keypair": {"name": "tempest-keypair-1953727802", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFH4IaTtfL99e69Djy4Mb6yYQSAoyKH2yzdTqAOTjw8MvtPdYMuY30ayY5G9XGpjHeY1vgFhiNh/JWQCXVZv74tUwbAVq2xlQDQu1cIbERp18SYbdMbLmVDO7IrKTVdffw=="}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:11:52.348351 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-44fa0a40-ed34-41ff-a7e7-e9612866ec65 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Getting quotas for project 5ca8bc0082894aa6b90a714ddc6a6790. Resources: {'key_pairs'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 22:11:52.353574 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-44fa0a40-ed34-41ff-a7e7-e9612866ec65 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Getting quotas for user 14820436f99c404b80194a1b985c76b1 and project 5ca8bc0082894aa6b90a714ddc6a6790. Resources: {'key_pairs'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 22:11:52.395545 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-44fa0a40-ed34-41ff-a7e7-e9612866ec65 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.183881 Jul 23 22:11:52.396170 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3483/6093] 10.222.0.17 () {60 vars in 1158 bytes} [Sat Jul 23 22:11:52 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 22:11:53.750255 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=8 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:11:53.755013 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-964c3f23-e086-4a15-b87e-02708f484497 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1753333085", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "710bdc98-a85f-4879-a272-9349d503f3f7"}], "security_groups": [{"name": "tempest-securitygroup--2070004119"}], "key_name": "tempest-keypair-1953727802", "user_data": "}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:11:53.867211 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-964c3f23-e086-4a15-b87e-02708f484497 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] validate_networks() for [('710bdc98-a85f-4879-a272-9349d503f3f7', None, None, None, None, None)] {{(pid=131320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 22:11:54.252927 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-964c3f23-e086-4a15-b87e-02708f484497 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 22:11:54.257085 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-964c3f23-e086-4a15-b87e-02708f484497 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 22:11:54.257814 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-964c3f23-e086-4a15-b87e-02708f484497 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 22:11:54.258407 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-964c3f23-e086-4a15-b87e-02708f484497 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 22:11:54.258835 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-964c3f23-e086-4a15-b87e-02708f484497 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 22:11:54.268498 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-964c3f23-e086-4a15-b87e-02708f484497 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:54.268956 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-964c3f23-e086-4a15-b87e-02708f484497 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:54.269765 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-964c3f23-e086-4a15-b87e-02708f484497 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:54.270245 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-964c3f23-e086-4a15-b87e-02708f484497 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:54.287841 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-964c3f23-e086-4a15-b87e-02708f484497 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Getting quotas for project 5ca8bc0082894aa6b90a714ddc6a6790. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 22:11:54.293592 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-964c3f23-e086-4a15-b87e-02708f484497 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Getting quotas for user 14820436f99c404b80194a1b985c76b1 and project 5ca8bc0082894aa6b90a714ddc6a6790. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 22:11:54.306593 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-964c3f23-e086-4a15-b87e-02708f484497 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Going to run 1 instances... {{(pid=131320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 22:11:54.308939 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-964c3f23-e086-4a15-b87e-02708f484497 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 0c5a7550-1f75-43a3-a365-25e83435bdaa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 22:11:54.356728 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-964c3f23-e086-4a15-b87e-02708f484497 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.608014 Jul 23 22:11:54.362407 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3484/6094] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 22:11:53 2022] POST /compute/v2.1/servers => generated 409 bytes in 610 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 23 22:11:54.368854 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-516f84c0-262d-4d71-8d5d-08cb77e8c6a1 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:11:54.369707 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-516f84c0-262d-4d71-8d5d-08cb77e8c6a1 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 0c5a7550-1f75-43a3-a365-25e83435bdaa] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:11:54.431743 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-516f84c0-262d-4d71-8d5d-08cb77e8c6a1 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:11:54.441609 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-516f84c0-262d-4d71-8d5d-08cb77e8c6a1 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/0c5a7550-1f75-43a3-a365-25e83435bdaa" status: 200 len: 1239 microversion: 2.1 time: 0.077513 Jul 23 22:11:54.442242 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3485/6095] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:11:54 2022] GET /compute/v2.1/servers/0c5a7550-1f75-43a3-a365-25e83435bdaa => generated 1239 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:11:55.459715 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-925c8712-791b-42a7-a070-7dabfc078c55 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:11:55.460378 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-925c8712-791b-42a7-a070-7dabfc078c55 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 0c5a7550-1f75-43a3-a365-25e83435bdaa] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:11:55.469079 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-925c8712-791b-42a7-a070-7dabfc078c55 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:55.469529 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-925c8712-791b-42a7-a070-7dabfc078c55 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:55.470620 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-925c8712-791b-42a7-a070-7dabfc078c55 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:55.471225 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-925c8712-791b-42a7-a070-7dabfc078c55 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:55.543825 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-925c8712-791b-42a7-a070-7dabfc078c55 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:11:55.552291 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-925c8712-791b-42a7-a070-7dabfc078c55 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/0c5a7550-1f75-43a3-a365-25e83435bdaa" status: 200 len: 1309 microversion: 2.1 time: 0.097047 Jul 23 22:11:55.552877 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3486/6096] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:11:55 2022] GET /compute/v2.1/servers/0c5a7550-1f75-43a3-a365-25e83435bdaa => generated 1309 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:11:56.569237 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c32d7de5-0d53-4686-b75b-aeb64beb8f1c tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:11:56.569951 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c32d7de5-0d53-4686-b75b-aeb64beb8f1c tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 0c5a7550-1f75-43a3-a365-25e83435bdaa] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:11:56.577657 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c32d7de5-0d53-4686-b75b-aeb64beb8f1c tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:56.578156 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c32d7de5-0d53-4686-b75b-aeb64beb8f1c tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:56.579041 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c32d7de5-0d53-4686-b75b-aeb64beb8f1c tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:56.579428 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c32d7de5-0d53-4686-b75b-aeb64beb8f1c tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:56.727823 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c32d7de5-0d53-4686-b75b-aeb64beb8f1c tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:11:56.737324 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c32d7de5-0d53-4686-b75b-aeb64beb8f1c tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/0c5a7550-1f75-43a3-a365-25e83435bdaa" status: 200 len: 1365 microversion: 2.1 time: 0.172094 Jul 23 22:11:56.738158 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3487/6097] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:11:56 2022] GET /compute/v2.1/servers/0c5a7550-1f75-43a3-a365-25e83435bdaa => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:11:56.829584 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-f428cecc-77d9-4d78-9632-997018c5b8a9 req-a43fa141-3dac-4ec9-b822-16a7cd8da422 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c5a7550-1f75-43a3-a365-25e83435bdaa", "tag": "b41fcd35-236a-4d59-a9f1-51da380c6b03"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:11:56.840397 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-f428cecc-77d9-4d78-9632-997018c5b8a9 req-a43fa141-3dac-4ec9-b822-16a7cd8da422 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:56.840906 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-f428cecc-77d9-4d78-9632-997018c5b8a9 req-a43fa141-3dac-4ec9-b822-16a7cd8da422 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:56.856327 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-f428cecc-77d9-4d78-9632-997018c5b8a9 req-a43fa141-3dac-4ec9-b822-16a7cd8da422 service nova] Creating event network-changed:b41fcd35-236a-4d59-a9f1-51da380c6b03 for instance 0c5a7550-1f75-43a3-a365-25e83435bdaa on nch2-master-1 Jul 23 22:11:56.862312 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-f428cecc-77d9-4d78-9632-997018c5b8a9 req-a43fa141-3dac-4ec9-b822-16a7cd8da422 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036732 Jul 23 22:11:56.862949 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3488/6098] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:11:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:11:57.759758 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-86455f0c-b7b4-4c4f-b744-534278d5d8dd tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:11:57.760912 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-86455f0c-b7b4-4c4f-b744-534278d5d8dd tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 0c5a7550-1f75-43a3-a365-25e83435bdaa] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:11:57.773147 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-86455f0c-b7b4-4c4f-b744-534278d5d8dd tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:57.773947 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-86455f0c-b7b4-4c4f-b744-534278d5d8dd tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:57.775227 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-86455f0c-b7b4-4c4f-b744-534278d5d8dd tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:57.775950 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-86455f0c-b7b4-4c4f-b744-534278d5d8dd tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:57.919455 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-86455f0c-b7b4-4c4f-b744-534278d5d8dd tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:11:57.927478 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-86455f0c-b7b4-4c4f-b744-534278d5d8dd tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/0c5a7550-1f75-43a3-a365-25e83435bdaa" status: 200 len: 1365 microversion: 2.1 time: 0.175034 Jul 23 22:11:57.928055 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3489/6099] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:11:57 2022] GET /compute/v2.1/servers/0c5a7550-1f75-43a3-a365-25e83435bdaa => generated 1365 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:11:58.949213 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-477f709f-4a75-4651-b33e-bc6aee420742 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:11:58.950216 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-477f709f-4a75-4651-b33e-bc6aee420742 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 0c5a7550-1f75-43a3-a365-25e83435bdaa] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:11:58.962416 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-477f709f-4a75-4651-b33e-bc6aee420742 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:58.963167 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-477f709f-4a75-4651-b33e-bc6aee420742 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:58.964440 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-477f709f-4a75-4651-b33e-bc6aee420742 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:11:58.965183 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-477f709f-4a75-4651-b33e-bc6aee420742 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:11:59.103540 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-477f709f-4a75-4651-b33e-bc6aee420742 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:11:59.111432 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-477f709f-4a75-4651-b33e-bc6aee420742 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/0c5a7550-1f75-43a3-a365-25e83435bdaa" status: 200 len: 1365 microversion: 2.1 time: 0.169159 Jul 23 22:11:59.112263 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3490/6100] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:11:58 2022] GET /compute/v2.1/servers/0c5a7550-1f75-43a3-a365-25e83435bdaa => generated 1365 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:12:00.133025 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5844f384-abcf-49c7-9f6a-564f5c608a18 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:12:00.134176 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5844f384-abcf-49c7-9f6a-564f5c608a18 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 0c5a7550-1f75-43a3-a365-25e83435bdaa] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:12:00.144905 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5844f384-abcf-49c7-9f6a-564f5c608a18 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:12:00.145365 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5844f384-abcf-49c7-9f6a-564f5c608a18 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:12:00.146184 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5844f384-abcf-49c7-9f6a-564f5c608a18 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:12:00.146629 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5844f384-abcf-49c7-9f6a-564f5c608a18 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:12:00.282785 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5844f384-abcf-49c7-9f6a-564f5c608a18 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:12:00.294232 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5844f384-abcf-49c7-9f6a-564f5c608a18 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/0c5a7550-1f75-43a3-a365-25e83435bdaa" status: 200 len: 1365 microversion: 2.1 time: 0.167747 Jul 23 22:12:00.294983 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3491/6101] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:12:00 2022] GET /compute/v2.1/servers/0c5a7550-1f75-43a3-a365-25e83435bdaa => generated 1365 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:12:01.312862 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e23e2bc8-75bd-43ac-b4e7-c01e9dcd7d92 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:12:01.313503 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e23e2bc8-75bd-43ac-b4e7-c01e9dcd7d92 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 0c5a7550-1f75-43a3-a365-25e83435bdaa] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:12:01.320645 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e23e2bc8-75bd-43ac-b4e7-c01e9dcd7d92 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:12:01.320939 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e23e2bc8-75bd-43ac-b4e7-c01e9dcd7d92 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:12:01.321817 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e23e2bc8-75bd-43ac-b4e7-c01e9dcd7d92 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:12:01.322394 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e23e2bc8-75bd-43ac-b4e7-c01e9dcd7d92 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:12:01.458766 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e23e2bc8-75bd-43ac-b4e7-c01e9dcd7d92 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:12:01.467181 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e23e2bc8-75bd-43ac-b4e7-c01e9dcd7d92 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/0c5a7550-1f75-43a3-a365-25e83435bdaa" status: 200 len: 1365 microversion: 2.1 time: 0.158347 Jul 23 22:12:01.476761 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3492/6102] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:12:01 2022] GET /compute/v2.1/servers/0c5a7550-1f75-43a3-a365-25e83435bdaa => generated 1365 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:12:01.538137 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-d2b65d4e-75b4-4f5e-a5e4-ddffe73888ba req-6d041995-b301-4fc5-8786-cb0b0c93e264 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c5a7550-1f75-43a3-a365-25e83435bdaa", "name": "network-vif-plugged", "status": "completed", "tag": "b41fcd35-236a-4d59-a9f1-51da380c6b03"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:12:01.542300 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:12:01.549091 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-d2b65d4e-75b4-4f5e-a5e4-ddffe73888ba req-6d041995-b301-4fc5-8786-cb0b0c93e264 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:12:01.549648 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-d2b65d4e-75b4-4f5e-a5e4-ddffe73888ba req-6d041995-b301-4fc5-8786-cb0b0c93e264 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:12:01.561962 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-d2b65d4e-75b4-4f5e-a5e4-ddffe73888ba req-6d041995-b301-4fc5-8786-cb0b0c93e264 service nova] Creating event network-vif-plugged:b41fcd35-236a-4d59-a9f1-51da380c6b03 for instance 0c5a7550-1f75-43a3-a365-25e83435bdaa on nch2-master-1 Jul 23 22:12:01.567572 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-d2b65d4e-75b4-4f5e-a5e4-ddffe73888ba req-6d041995-b301-4fc5-8786-cb0b0c93e264 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083440 Jul 23 22:12:01.568163 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3493/6103] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:12:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 22:12:02.490653 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e99d53d3-dbfe-40fd-acc5-efe5b3855e10 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:12:02.491310 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e99d53d3-dbfe-40fd-acc5-efe5b3855e10 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 0c5a7550-1f75-43a3-a365-25e83435bdaa] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:12:02.498178 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e99d53d3-dbfe-40fd-acc5-efe5b3855e10 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:12:02.498666 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e99d53d3-dbfe-40fd-acc5-efe5b3855e10 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:12:02.499436 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e99d53d3-dbfe-40fd-acc5-efe5b3855e10 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:12:02.499901 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e99d53d3-dbfe-40fd-acc5-efe5b3855e10 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:12:02.632168 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e99d53d3-dbfe-40fd-acc5-efe5b3855e10 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:12:02.640333 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e99d53d3-dbfe-40fd-acc5-efe5b3855e10 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/0c5a7550-1f75-43a3-a365-25e83435bdaa" status: 200 len: 1365 microversion: 2.1 time: 0.158044 Jul 23 22:12:02.640907 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3494/6104] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:12:02 2022] GET /compute/v2.1/servers/0c5a7550-1f75-43a3-a365-25e83435bdaa => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:12:03.661302 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-87718ca4-7d6c-4d81-805f-62c573c08276 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:12:03.662421 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-87718ca4-7d6c-4d81-805f-62c573c08276 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 0c5a7550-1f75-43a3-a365-25e83435bdaa] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:12:03.674202 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-87718ca4-7d6c-4d81-805f-62c573c08276 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:12:03.674964 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-87718ca4-7d6c-4d81-805f-62c573c08276 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:12:03.676205 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-87718ca4-7d6c-4d81-805f-62c573c08276 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:12:03.676980 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-87718ca4-7d6c-4d81-805f-62c573c08276 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:12:03.822777 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-87718ca4-7d6c-4d81-805f-62c573c08276 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:12:03.830812 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-87718ca4-7d6c-4d81-805f-62c573c08276 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/0c5a7550-1f75-43a3-a365-25e83435bdaa" status: 200 len: 1551 microversion: 2.1 time: 0.176162 Jul 23 22:12:03.831750 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3495/6105] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:12:03 2022] GET /compute/v2.1/servers/0c5a7550-1f75-43a3-a365-25e83435bdaa => generated 1551 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:12:03.848996 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3974400b-efd7-4ed5-9a0a-527bf8d34c80 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:12:03.849523 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-3974400b-efd7-4ed5-9a0a-527bf8d34c80 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 0c5a7550-1f75-43a3-a365-25e83435bdaa] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:12:03.855546 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3974400b-efd7-4ed5-9a0a-527bf8d34c80 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:12:03.856002 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3974400b-efd7-4ed5-9a0a-527bf8d34c80 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:12:03.856767 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3974400b-efd7-4ed5-9a0a-527bf8d34c80 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:12:03.857204 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3974400b-efd7-4ed5-9a0a-527bf8d34c80 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:12:03.935717 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-3974400b-efd7-4ed5-9a0a-527bf8d34c80 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/0c5a7550-1f75-43a3-a365-25e83435bdaa/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090354 Jul 23 22:12:03.936452 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3496/6106] 10.222.0.17 () {58 vars in 1274 bytes} [Sat Jul 23 22:12:03 2022] GET /compute/v2.1/servers/0c5a7550-1f75-43a3-a365-25e83435bdaa/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:12:04.914079 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:12:04.915020 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=12 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:12:04.968703 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-70539b90-5078-4d03-8159-1efb05789480 req-6a86c45e-5feb-49d8-b4a4-061dafa01548 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c5a7550-1f75-43a3-a365-25e83435bdaa", "tag": "b41fcd35-236a-4d59-a9f1-51da380c6b03"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:12:04.976902 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-70539b90-5078-4d03-8159-1efb05789480 req-6a86c45e-5feb-49d8-b4a4-061dafa01548 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:12:04.977286 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-70539b90-5078-4d03-8159-1efb05789480 req-6a86c45e-5feb-49d8-b4a4-061dafa01548 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:12:04.988626 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-70539b90-5078-4d03-8159-1efb05789480 req-6a86c45e-5feb-49d8-b4a4-061dafa01548 service nova] Creating event network-changed:b41fcd35-236a-4d59-a9f1-51da380c6b03 for instance 0c5a7550-1f75-43a3-a365-25e83435bdaa on nch2-master-1 Jul 23 22:12:04.993685 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-70539b90-5078-4d03-8159-1efb05789480 req-6a86c45e-5feb-49d8-b4a4-061dafa01548 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080347 Jul 23 22:12:04.994459 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3497/6107] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:12:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:12:41.297597 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=9 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:12:41.298360 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=60 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:12:41.302547 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e3f78d11-25ed-40ed-b59a-b8f0fcf78149 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:12:41.303254 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e3f78d11-25ed-40ed-b59a-b8f0fcf78149 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 0c5a7550-1f75-43a3-a365-25e83435bdaa] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:12:41.313301 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e3f78d11-25ed-40ed-b59a-b8f0fcf78149 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:12:41.313761 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e3f78d11-25ed-40ed-b59a-b8f0fcf78149 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:12:41.314566 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e3f78d11-25ed-40ed-b59a-b8f0fcf78149 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:12:41.315007 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e3f78d11-25ed-40ed-b59a-b8f0fcf78149 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:12:41.454410 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e3f78d11-25ed-40ed-b59a-b8f0fcf78149 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:12:41.463025 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e3f78d11-25ed-40ed-b59a-b8f0fcf78149 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/0c5a7550-1f75-43a3-a365-25e83435bdaa" status: 200 len: 1669 microversion: 2.1 time: 0.169033 Jul 23 22:12:41.463611 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3498/6108] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:12:41 2022] GET /compute/v2.1/servers/0c5a7550-1f75-43a3-a365-25e83435bdaa => generated 1669 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:12:41.479410 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e58c11a2-4aca-4d38-a5ff-377b97750903 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:12:41.480002 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e58c11a2-4aca-4d38-a5ff-377b97750903 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 0c5a7550-1f75-43a3-a365-25e83435bdaa] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:12:41.489281 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e58c11a2-4aca-4d38-a5ff-377b97750903 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:12:41.489783 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e58c11a2-4aca-4d38-a5ff-377b97750903 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:12:41.490608 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e58c11a2-4aca-4d38-a5ff-377b97750903 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:12:41.491084 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e58c11a2-4aca-4d38-a5ff-377b97750903 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:12:41.629136 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e58c11a2-4aca-4d38-a5ff-377b97750903 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:12:41.637248 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e58c11a2-4aca-4d38-a5ff-377b97750903 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/0c5a7550-1f75-43a3-a365-25e83435bdaa" status: 200 len: 1669 microversion: 2.1 time: 0.161437 Jul 23 22:12:41.637803 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3499/6109] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:12:41 2022] GET /compute/v2.1/servers/0c5a7550-1f75-43a3-a365-25e83435bdaa => generated 1669 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:12:41.653614 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4397d02a-4610-42fd-b775-7ab7a7839ec4 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:12:41.654250 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-4397d02a-4610-42fd-b775-7ab7a7839ec4 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 0c5a7550-1f75-43a3-a365-25e83435bdaa] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:12:41.662629 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4397d02a-4610-42fd-b775-7ab7a7839ec4 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:12:41.663378 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4397d02a-4610-42fd-b775-7ab7a7839ec4 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:12:41.664613 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4397d02a-4610-42fd-b775-7ab7a7839ec4 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:12:41.665336 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4397d02a-4610-42fd-b775-7ab7a7839ec4 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:12:41.810799 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-4397d02a-4610-42fd-b775-7ab7a7839ec4 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:12:41.819175 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4397d02a-4610-42fd-b775-7ab7a7839ec4 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/0c5a7550-1f75-43a3-a365-25e83435bdaa" status: 200 len: 1669 microversion: 2.1 time: 0.169025 Jul 23 22:12:41.819803 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3500/6110] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:12:41 2022] GET /compute/v2.1/servers/0c5a7550-1f75-43a3-a365-25e83435bdaa => generated 1669 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:12:41.835961 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-02613f01-1e57-47b0-9afa-bbbb000480fa tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:12:41.836872 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-02613f01-1e57-47b0-9afa-bbbb000480fa tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 0c5a7550-1f75-43a3-a365-25e83435bdaa] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:12:41.843283 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-02613f01-1e57-47b0-9afa-bbbb000480fa tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:12:41.843833 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-02613f01-1e57-47b0-9afa-bbbb000480fa tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:12:41.844603 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-02613f01-1e57-47b0-9afa-bbbb000480fa tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:12:41.845048 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-02613f01-1e57-47b0-9afa-bbbb000480fa tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:12:41.873437 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-02613f01-1e57-47b0-9afa-bbbb000480fa tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:12:41.879770 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-02613f01-1e57-47b0-9afa-bbbb000480fa tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 0c5a7550-1f75-43a3-a365-25e83435bdaa] Old instance type m1.heat2, new instance type m1.heat {{(pid=131320) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 23 22:12:41.886384 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-02613f01-1e57-47b0-9afa-bbbb000480fa tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 22:12:41.886810 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-02613f01-1e57-47b0-9afa-bbbb000480fa tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 22:12:41.887293 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-02613f01-1e57-47b0-9afa-bbbb000480fa tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 22:12:41.887716 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-02613f01-1e57-47b0-9afa-bbbb000480fa tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 22:12:41.888136 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-02613f01-1e57-47b0-9afa-bbbb000480fa tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 22:12:41.954237 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-02613f01-1e57-47b0-9afa-bbbb000480fa tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "POST /compute/v2.1/servers/0c5a7550-1f75-43a3-a365-25e83435bdaa/action" status: 202 len: 0 microversion: 2.1 time: 0.122183 Jul 23 22:12:41.954873 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3501/6111] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 22:12:41 2022] POST /compute/v2.1/servers/0c5a7550-1f75-43a3-a365-25e83435bdaa/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 22:12:41.963009 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6c61dd1b-ab6c-4236-90b2-43b5efa17b25 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:12:41.963626 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6c61dd1b-ab6c-4236-90b2-43b5efa17b25 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 0c5a7550-1f75-43a3-a365-25e83435bdaa] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:12:41.969696 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6c61dd1b-ab6c-4236-90b2-43b5efa17b25 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:12:41.970184 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6c61dd1b-ab6c-4236-90b2-43b5efa17b25 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:12:41.970972 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6c61dd1b-ab6c-4236-90b2-43b5efa17b25 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:12:41.971416 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6c61dd1b-ab6c-4236-90b2-43b5efa17b25 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:12:42.109772 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6c61dd1b-ab6c-4236-90b2-43b5efa17b25 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:12:42.117612 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6c61dd1b-ab6c-4236-90b2-43b5efa17b25 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/0c5a7550-1f75-43a3-a365-25e83435bdaa" status: 200 len: 1678 microversion: 2.1 time: 0.158232 Jul 23 22:12:42.118197 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3502/6112] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:12:41 2022] GET /compute/v2.1/servers/0c5a7550-1f75-43a3-a365-25e83435bdaa => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:12:43.137272 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ddf5d7f0-689d-4713-878f-dbfc5026e9d5 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:12:43.138002 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ddf5d7f0-689d-4713-878f-dbfc5026e9d5 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 0c5a7550-1f75-43a3-a365-25e83435bdaa] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:12:43.147689 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ddf5d7f0-689d-4713-878f-dbfc5026e9d5 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:12:43.148160 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ddf5d7f0-689d-4713-878f-dbfc5026e9d5 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:12:43.148953 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ddf5d7f0-689d-4713-878f-dbfc5026e9d5 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:12:43.149524 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ddf5d7f0-689d-4713-878f-dbfc5026e9d5 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:12:43.290641 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ddf5d7f0-689d-4713-878f-dbfc5026e9d5 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:12:43.298760 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ddf5d7f0-689d-4713-878f-dbfc5026e9d5 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/0c5a7550-1f75-43a3-a365-25e83435bdaa" status: 200 len: 1678 microversion: 2.1 time: 0.167842 Jul 23 22:12:43.299343 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3503/6113] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:12:43 2022] GET /compute/v2.1/servers/0c5a7550-1f75-43a3-a365-25e83435bdaa => generated 1678 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:12:44.320925 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8e599d73-5bf7-43eb-ab96-e6a7d95f5edd tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:12:44.322077 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8e599d73-5bf7-43eb-ab96-e6a7d95f5edd tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 0c5a7550-1f75-43a3-a365-25e83435bdaa] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:12:44.332475 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8e599d73-5bf7-43eb-ab96-e6a7d95f5edd tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:12:44.332941 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8e599d73-5bf7-43eb-ab96-e6a7d95f5edd tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:12:44.333724 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8e599d73-5bf7-43eb-ab96-e6a7d95f5edd tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:12:44.334205 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8e599d73-5bf7-43eb-ab96-e6a7d95f5edd tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:12:44.472941 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8e599d73-5bf7-43eb-ab96-e6a7d95f5edd tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:12:44.480762 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8e599d73-5bf7-43eb-ab96-e6a7d95f5edd tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/0c5a7550-1f75-43a3-a365-25e83435bdaa" status: 200 len: 1683 microversion: 2.1 time: 0.166503 Jul 23 22:12:44.481347 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3504/6114] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:12:44 2022] GET /compute/v2.1/servers/0c5a7550-1f75-43a3-a365-25e83435bdaa => generated 1683 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:12:45.502303 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e7d30bc5-109c-426d-a37b-e55dbc7ee786 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:12:45.503246 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e7d30bc5-109c-426d-a37b-e55dbc7ee786 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 0c5a7550-1f75-43a3-a365-25e83435bdaa] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:12:45.510702 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e7d30bc5-109c-426d-a37b-e55dbc7ee786 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:12:45.511186 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e7d30bc5-109c-426d-a37b-e55dbc7ee786 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:12:45.511961 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e7d30bc5-109c-426d-a37b-e55dbc7ee786 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:12:45.512399 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e7d30bc5-109c-426d-a37b-e55dbc7ee786 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:12:45.655470 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e7d30bc5-109c-426d-a37b-e55dbc7ee786 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:12:45.663656 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e7d30bc5-109c-426d-a37b-e55dbc7ee786 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/0c5a7550-1f75-43a3-a365-25e83435bdaa" status: 200 len: 1683 microversion: 2.1 time: 0.168015 Jul 23 22:12:45.664233 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3505/6115] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:12:45 2022] GET /compute/v2.1/servers/0c5a7550-1f75-43a3-a365-25e83435bdaa => generated 1683 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:12:46.685604 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-cd259ace-52bc-437f-81be-694975f5b1ed tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:12:46.686774 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-cd259ace-52bc-437f-81be-694975f5b1ed tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 0c5a7550-1f75-43a3-a365-25e83435bdaa] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:12:46.698846 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cd259ace-52bc-437f-81be-694975f5b1ed tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:12:46.699612 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cd259ace-52bc-437f-81be-694975f5b1ed tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:12:46.700888 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cd259ace-52bc-437f-81be-694975f5b1ed tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:12:46.701627 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cd259ace-52bc-437f-81be-694975f5b1ed tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:12:46.837105 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-cd259ace-52bc-437f-81be-694975f5b1ed tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:12:46.845137 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-cd259ace-52bc-437f-81be-694975f5b1ed tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/0c5a7550-1f75-43a3-a365-25e83435bdaa" status: 200 len: 1683 microversion: 2.1 time: 0.166399 Jul 23 22:12:46.845729 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3506/6116] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:12:46 2022] GET /compute/v2.1/servers/0c5a7550-1f75-43a3-a365-25e83435bdaa => generated 1683 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:12:47.862882 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-413eaf2d-475b-4c0b-af6a-44ba1fcf4688 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:12:47.863586 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-413eaf2d-475b-4c0b-af6a-44ba1fcf4688 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 0c5a7550-1f75-43a3-a365-25e83435bdaa] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:12:47.871083 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-413eaf2d-475b-4c0b-af6a-44ba1fcf4688 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:12:47.871536 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-413eaf2d-475b-4c0b-af6a-44ba1fcf4688 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:12:47.872323 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-413eaf2d-475b-4c0b-af6a-44ba1fcf4688 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:12:47.872759 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-413eaf2d-475b-4c0b-af6a-44ba1fcf4688 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:12:48.010914 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-413eaf2d-475b-4c0b-af6a-44ba1fcf4688 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:12:48.018899 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-413eaf2d-475b-4c0b-af6a-44ba1fcf4688 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/0c5a7550-1f75-43a3-a365-25e83435bdaa" status: 200 len: 1683 microversion: 2.1 time: 0.160026 Jul 23 22:12:48.019578 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3507/6117] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:12:47 2022] GET /compute/v2.1/servers/0c5a7550-1f75-43a3-a365-25e83435bdaa => generated 1683 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:12:49.036375 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-cdecde2f-bc5f-4ee4-8ea4-752ec4cc4472 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:12:49.037076 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-cdecde2f-bc5f-4ee4-8ea4-752ec4cc4472 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 0c5a7550-1f75-43a3-a365-25e83435bdaa] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:12:49.045013 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cdecde2f-bc5f-4ee4-8ea4-752ec4cc4472 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:12:49.045461 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cdecde2f-bc5f-4ee4-8ea4-752ec4cc4472 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:12:49.046392 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cdecde2f-bc5f-4ee4-8ea4-752ec4cc4472 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:12:49.046830 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cdecde2f-bc5f-4ee4-8ea4-752ec4cc4472 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:12:49.180512 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-cdecde2f-bc5f-4ee4-8ea4-752ec4cc4472 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:12:49.188298 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-cdecde2f-bc5f-4ee4-8ea4-752ec4cc4472 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/0c5a7550-1f75-43a3-a365-25e83435bdaa" status: 200 len: 1683 microversion: 2.1 time: 0.155890 Jul 23 22:12:49.188880 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3508/6118] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:12:49 2022] GET /compute/v2.1/servers/0c5a7550-1f75-43a3-a365-25e83435bdaa => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:12:50.210531 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9ae91d02-892a-4a3a-be52-3d59b1d1cf46 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:12:50.211560 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-9ae91d02-892a-4a3a-be52-3d59b1d1cf46 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 0c5a7550-1f75-43a3-a365-25e83435bdaa] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:12:50.223241 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9ae91d02-892a-4a3a-be52-3d59b1d1cf46 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:12:50.223990 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9ae91d02-892a-4a3a-be52-3d59b1d1cf46 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:12:50.225252 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9ae91d02-892a-4a3a-be52-3d59b1d1cf46 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:12:50.226025 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9ae91d02-892a-4a3a-be52-3d59b1d1cf46 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:12:50.372852 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-9ae91d02-892a-4a3a-be52-3d59b1d1cf46 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:12:50.380644 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9ae91d02-892a-4a3a-be52-3d59b1d1cf46 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/0c5a7550-1f75-43a3-a365-25e83435bdaa" status: 200 len: 1683 microversion: 2.1 time: 0.177441 Jul 23 22:12:50.381240 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3509/6119] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:12:50 2022] GET /compute/v2.1/servers/0c5a7550-1f75-43a3-a365-25e83435bdaa => generated 1683 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:12:51.402380 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-643c7ec6-34be-461b-8932-bb8a86a956cb tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:12:51.403418 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-643c7ec6-34be-461b-8932-bb8a86a956cb tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 0c5a7550-1f75-43a3-a365-25e83435bdaa] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:12:51.413925 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-643c7ec6-34be-461b-8932-bb8a86a956cb tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:12:51.414417 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-643c7ec6-34be-461b-8932-bb8a86a956cb tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:12:51.415186 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-643c7ec6-34be-461b-8932-bb8a86a956cb tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:12:51.415622 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-643c7ec6-34be-461b-8932-bb8a86a956cb tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:12:51.557215 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-643c7ec6-34be-461b-8932-bb8a86a956cb tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:12:51.565309 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-643c7ec6-34be-461b-8932-bb8a86a956cb tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/0c5a7550-1f75-43a3-a365-25e83435bdaa" status: 200 len: 1683 microversion: 2.1 time: 0.169902 Jul 23 22:12:51.565901 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3510/6120] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:12:51 2022] GET /compute/v2.1/servers/0c5a7550-1f75-43a3-a365-25e83435bdaa => generated 1683 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:12:52.586190 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e3a12184-2030-4ee0-bc91-e254c7f8a19f tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:12:52.586901 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e3a12184-2030-4ee0-bc91-e254c7f8a19f tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 0c5a7550-1f75-43a3-a365-25e83435bdaa] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:12:52.595237 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e3a12184-2030-4ee0-bc91-e254c7f8a19f tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:12:52.595741 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e3a12184-2030-4ee0-bc91-e254c7f8a19f tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:12:52.596580 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e3a12184-2030-4ee0-bc91-e254c7f8a19f tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:12:52.597499 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e3a12184-2030-4ee0-bc91-e254c7f8a19f tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:12:52.732702 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e3a12184-2030-4ee0-bc91-e254c7f8a19f tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:12:52.741306 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e3a12184-2030-4ee0-bc91-e254c7f8a19f tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/0c5a7550-1f75-43a3-a365-25e83435bdaa" status: 200 len: 1683 microversion: 2.1 time: 0.160580 Jul 23 22:12:52.741894 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3511/6121] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:12:52 2022] GET /compute/v2.1/servers/0c5a7550-1f75-43a3-a365-25e83435bdaa => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:12:53.763045 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6e40b54e-ba47-4bc2-a8b4-28279f27e3cc tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:12:53.764116 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6e40b54e-ba47-4bc2-a8b4-28279f27e3cc tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 0c5a7550-1f75-43a3-a365-25e83435bdaa] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:12:53.775933 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6e40b54e-ba47-4bc2-a8b4-28279f27e3cc tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:12:53.776690 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6e40b54e-ba47-4bc2-a8b4-28279f27e3cc tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:12:53.777967 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6e40b54e-ba47-4bc2-a8b4-28279f27e3cc tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:12:53.778730 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6e40b54e-ba47-4bc2-a8b4-28279f27e3cc tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:12:53.920917 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6e40b54e-ba47-4bc2-a8b4-28279f27e3cc tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:12:53.928731 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6e40b54e-ba47-4bc2-a8b4-28279f27e3cc tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/0c5a7550-1f75-43a3-a365-25e83435bdaa" status: 200 len: 1683 microversion: 2.1 time: 0.172436 Jul 23 22:12:53.929320 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3512/6122] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:12:53 2022] GET /compute/v2.1/servers/0c5a7550-1f75-43a3-a365-25e83435bdaa => generated 1683 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:12:54.948859 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-11b3a70f-7cdf-4bd9-a964-cff0065f2acc tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:12:54.949781 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-11b3a70f-7cdf-4bd9-a964-cff0065f2acc tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 0c5a7550-1f75-43a3-a365-25e83435bdaa] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:12:54.960256 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-11b3a70f-7cdf-4bd9-a964-cff0065f2acc tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:12:54.960738 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-11b3a70f-7cdf-4bd9-a964-cff0065f2acc tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:12:54.961481 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-11b3a70f-7cdf-4bd9-a964-cff0065f2acc tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:12:54.961947 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-11b3a70f-7cdf-4bd9-a964-cff0065f2acc tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:12:54.965969 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:12:55.094603 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-11b3a70f-7cdf-4bd9-a964-cff0065f2acc tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:12:55.102358 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-11b3a70f-7cdf-4bd9-a964-cff0065f2acc tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/0c5a7550-1f75-43a3-a365-25e83435bdaa" status: 200 len: 1683 microversion: 2.1 time: 0.159183 Jul 23 22:12:55.102907 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3513/6123] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:12:54 2022] GET /compute/v2.1/servers/0c5a7550-1f75-43a3-a365-25e83435bdaa => generated 1683 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:12:56.123312 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1fa7cd71-abf1-453e-9a96-3dceeec5be32 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:12:56.123917 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1fa7cd71-abf1-453e-9a96-3dceeec5be32 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 0c5a7550-1f75-43a3-a365-25e83435bdaa] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:12:56.131710 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1fa7cd71-abf1-453e-9a96-3dceeec5be32 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:12:56.132130 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1fa7cd71-abf1-453e-9a96-3dceeec5be32 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:12:56.132975 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1fa7cd71-abf1-453e-9a96-3dceeec5be32 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:12:56.133413 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1fa7cd71-abf1-453e-9a96-3dceeec5be32 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:12:56.276336 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-1fa7cd71-abf1-453e-9a96-3dceeec5be32 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:12:56.284455 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1fa7cd71-abf1-453e-9a96-3dceeec5be32 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/0c5a7550-1f75-43a3-a365-25e83435bdaa" status: 200 len: 1682 microversion: 2.1 time: 0.165155 Jul 23 22:12:56.285329 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3514/6124] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:12:56 2022] GET /compute/v2.1/servers/0c5a7550-1f75-43a3-a365-25e83435bdaa => generated 1682 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:12:56.993571 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-23f58de9-5e58-4551-bfb1-a59ec24d244a req-09474dc6-cff1-481b-b24c-6bb8288a3f1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c5a7550-1f75-43a3-a365-25e83435bdaa", "name": "network-vif-unplugged", "status": "completed", "tag": "b41fcd35-236a-4d59-a9f1-51da380c6b03"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:12:57.003187 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-23f58de9-5e58-4551-bfb1-a59ec24d244a req-09474dc6-cff1-481b-b24c-6bb8288a3f1a service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:12:57.003642 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-23f58de9-5e58-4551-bfb1-a59ec24d244a req-09474dc6-cff1-481b-b24c-6bb8288a3f1a service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:12:57.021670 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-23f58de9-5e58-4551-bfb1-a59ec24d244a req-09474dc6-cff1-481b-b24c-6bb8288a3f1a service nova] Creating event network-vif-unplugged:b41fcd35-236a-4d59-a9f1-51da380c6b03 for instance 0c5a7550-1f75-43a3-a365-25e83435bdaa on nch1-master-1 Jul 23 22:12:57.029002 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [req-23f58de9-5e58-4551-bfb1-a59ec24d244a req-09474dc6-cff1-481b-b24c-6bb8288a3f1a service nova] Instance 0c5a7550-1f75-43a3-a365-25e83435bdaa is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=131320) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 23 22:12:57.041074 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-23f58de9-5e58-4551-bfb1-a59ec24d244a req-09474dc6-cff1-481b-b24c-6bb8288a3f1a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.132013 Jul 23 22:12:57.042050 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3515/6125] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:12:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 22:12:57.304342 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-190c0ca3-3a1e-4d33-8636-764a181fcc7d tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:12:57.305043 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-190c0ca3-3a1e-4d33-8636-764a181fcc7d tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 0c5a7550-1f75-43a3-a365-25e83435bdaa] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:12:57.311532 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-190c0ca3-3a1e-4d33-8636-764a181fcc7d tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:12:57.312003 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-190c0ca3-3a1e-4d33-8636-764a181fcc7d tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:12:57.312763 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-190c0ca3-3a1e-4d33-8636-764a181fcc7d tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:12:57.313202 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-190c0ca3-3a1e-4d33-8636-764a181fcc7d tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:12:57.459854 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-190c0ca3-3a1e-4d33-8636-764a181fcc7d tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:12:57.468081 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-190c0ca3-3a1e-4d33-8636-764a181fcc7d tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/0c5a7550-1f75-43a3-a365-25e83435bdaa" status: 200 len: 1682 microversion: 2.1 time: 0.169022 Jul 23 22:12:57.479074 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3516/6126] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:12:57 2022] GET /compute/v2.1/servers/0c5a7550-1f75-43a3-a365-25e83435bdaa => generated 1682 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:12:58.490783 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-516b8b2f-0f48-41b3-a61c-cc2259173559 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:12:58.491856 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-516b8b2f-0f48-41b3-a61c-cc2259173559 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 0c5a7550-1f75-43a3-a365-25e83435bdaa] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:12:58.499874 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-516b8b2f-0f48-41b3-a61c-cc2259173559 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:12:58.500387 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-516b8b2f-0f48-41b3-a61c-cc2259173559 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:12:58.501251 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-516b8b2f-0f48-41b3-a61c-cc2259173559 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:12:58.501743 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-516b8b2f-0f48-41b3-a61c-cc2259173559 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:12:58.640629 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-516b8b2f-0f48-41b3-a61c-cc2259173559 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:12:58.648532 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-516b8b2f-0f48-41b3-a61c-cc2259173559 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/0c5a7550-1f75-43a3-a365-25e83435bdaa" status: 200 len: 1680 microversion: 2.1 time: 0.164476 Jul 23 22:12:58.649131 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3517/6127] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:12:58 2022] GET /compute/v2.1/servers/0c5a7550-1f75-43a3-a365-25e83435bdaa => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:12:59.062185 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-1e0b19b5-91d7-4ddb-9817-23b62d40be0a req-c3d740de-b9b8-43df-99c0-77c47652059e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c5a7550-1f75-43a3-a365-25e83435bdaa", "tag": "b41fcd35-236a-4d59-a9f1-51da380c6b03"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:12:59.073437 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-1e0b19b5-91d7-4ddb-9817-23b62d40be0a req-c3d740de-b9b8-43df-99c0-77c47652059e service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:12:59.073820 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-1e0b19b5-91d7-4ddb-9817-23b62d40be0a req-c3d740de-b9b8-43df-99c0-77c47652059e service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:12:59.086288 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-1e0b19b5-91d7-4ddb-9817-23b62d40be0a req-c3d740de-b9b8-43df-99c0-77c47652059e service nova] Creating event network-changed:b41fcd35-236a-4d59-a9f1-51da380c6b03 for instance 0c5a7550-1f75-43a3-a365-25e83435bdaa on nch1-master-1 Jul 23 22:12:59.092066 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [req-1e0b19b5-91d7-4ddb-9817-23b62d40be0a req-c3d740de-b9b8-43df-99c0-77c47652059e service nova] Instance 0c5a7550-1f75-43a3-a365-25e83435bdaa is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=131320) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 23 22:12:59.102929 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-1e0b19b5-91d7-4ddb-9817-23b62d40be0a req-c3d740de-b9b8-43df-99c0-77c47652059e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047034 Jul 23 22:12:59.103569 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3518/6128] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:12:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 22:12:59.668337 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-95d9b142-e186-4846-8bab-ea6fe4cfc7f9 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:12:59.668988 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-95d9b142-e186-4846-8bab-ea6fe4cfc7f9 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 0c5a7550-1f75-43a3-a365-25e83435bdaa] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:12:59.675471 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-95d9b142-e186-4846-8bab-ea6fe4cfc7f9 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:12:59.675896 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-95d9b142-e186-4846-8bab-ea6fe4cfc7f9 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:12:59.676690 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-95d9b142-e186-4846-8bab-ea6fe4cfc7f9 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:12:59.677124 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-95d9b142-e186-4846-8bab-ea6fe4cfc7f9 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:12:59.821967 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-95d9b142-e186-4846-8bab-ea6fe4cfc7f9 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:12:59.831307 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-95d9b142-e186-4846-8bab-ea6fe4cfc7f9 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/0c5a7550-1f75-43a3-a365-25e83435bdaa" status: 200 len: 1677 microversion: 2.1 time: 0.168534 Jul 23 22:12:59.831898 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3519/6129] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:12:59 2022] GET /compute/v2.1/servers/0c5a7550-1f75-43a3-a365-25e83435bdaa => generated 1677 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:12:59.848478 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d34909ef-57cc-4c6d-924b-33c3a6b96b7d tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:12:59.849326 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d34909ef-57cc-4c6d-924b-33c3a6b96b7d tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 0c5a7550-1f75-43a3-a365-25e83435bdaa] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:12:59.855974 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d34909ef-57cc-4c6d-924b-33c3a6b96b7d tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:12:59.856431 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d34909ef-57cc-4c6d-924b-33c3a6b96b7d tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:12:59.857202 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d34909ef-57cc-4c6d-924b-33c3a6b96b7d tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:12:59.857652 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d34909ef-57cc-4c6d-924b-33c3a6b96b7d tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:12:59.923158 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d34909ef-57cc-4c6d-924b-33c3a6b96b7d tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "POST /compute/v2.1/servers/0c5a7550-1f75-43a3-a365-25e83435bdaa/action" status: 204 len: 0 microversion: 2.1 time: 0.077676 Jul 23 22:12:59.923936 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3520/6130] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 22:12:59 2022] POST /compute/v2.1/servers/0c5a7550-1f75-43a3-a365-25e83435bdaa/action => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 23 22:12:59.933923 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4660b9e5-b86f-4ae1-a4ce-90105ecd8aa2 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:12:59.934724 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-4660b9e5-b86f-4ae1-a4ce-90105ecd8aa2 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 0c5a7550-1f75-43a3-a365-25e83435bdaa] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:12:59.941305 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4660b9e5-b86f-4ae1-a4ce-90105ecd8aa2 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:12:59.941762 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4660b9e5-b86f-4ae1-a4ce-90105ecd8aa2 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:12:59.942581 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4660b9e5-b86f-4ae1-a4ce-90105ecd8aa2 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:12:59.943020 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4660b9e5-b86f-4ae1-a4ce-90105ecd8aa2 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:13:00.095726 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-4660b9e5-b86f-4ae1-a4ce-90105ecd8aa2 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:13:00.104525 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4660b9e5-b86f-4ae1-a4ce-90105ecd8aa2 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/0c5a7550-1f75-43a3-a365-25e83435bdaa" status: 200 len: 1677 microversion: 2.1 time: 0.174869 Jul 23 22:13:00.105910 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3521/6131] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:12:59 2022] GET /compute/v2.1/servers/0c5a7550-1f75-43a3-a365-25e83435bdaa => generated 1677 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:13:01.124898 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c8490769-5041-4c40-9af7-f95c4405bfc2 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:13:01.125529 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c8490769-5041-4c40-9af7-f95c4405bfc2 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 0c5a7550-1f75-43a3-a365-25e83435bdaa] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:13:01.134868 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c8490769-5041-4c40-9af7-f95c4405bfc2 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:13:01.135358 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c8490769-5041-4c40-9af7-f95c4405bfc2 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:13:01.136132 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c8490769-5041-4c40-9af7-f95c4405bfc2 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:13:01.136608 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c8490769-5041-4c40-9af7-f95c4405bfc2 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:13:01.609168 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c8490769-5041-4c40-9af7-f95c4405bfc2 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:13:01.619399 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c8490769-5041-4c40-9af7-f95c4405bfc2 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/0c5a7550-1f75-43a3-a365-25e83435bdaa" status: 200 len: 1669 microversion: 2.1 time: 0.499907 Jul 23 22:13:01.620013 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3522/6132] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:13:01 2022] GET /compute/v2.1/servers/0c5a7550-1f75-43a3-a365-25e83435bdaa => generated 1669 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:13:01.635773 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a9584beb-f1b2-424f-8c13-26d6e06c51a0 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:13:01.636388 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a9584beb-f1b2-424f-8c13-26d6e06c51a0 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 0c5a7550-1f75-43a3-a365-25e83435bdaa] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:13:01.642415 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a9584beb-f1b2-424f-8c13-26d6e06c51a0 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:13:01.642874 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a9584beb-f1b2-424f-8c13-26d6e06c51a0 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:13:01.643688 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a9584beb-f1b2-424f-8c13-26d6e06c51a0 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:13:01.644138 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a9584beb-f1b2-424f-8c13-26d6e06c51a0 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:13:01.784097 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a9584beb-f1b2-424f-8c13-26d6e06c51a0 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:13:01.793127 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a9584beb-f1b2-424f-8c13-26d6e06c51a0 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/0c5a7550-1f75-43a3-a365-25e83435bdaa" status: 200 len: 1669 microversion: 2.1 time: 0.160887 Jul 23 22:13:01.793686 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3523/6133] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:13:01 2022] GET /compute/v2.1/servers/0c5a7550-1f75-43a3-a365-25e83435bdaa => generated 1669 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:13:01.809210 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b1799672-a7e7-48b7-ae8a-f9900273491b tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:13:01.809984 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b1799672-a7e7-48b7-ae8a-f9900273491b tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 0c5a7550-1f75-43a3-a365-25e83435bdaa] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:13:01.816355 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b1799672-a7e7-48b7-ae8a-f9900273491b tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:13:01.816809 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b1799672-a7e7-48b7-ae8a-f9900273491b tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:13:01.817582 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b1799672-a7e7-48b7-ae8a-f9900273491b tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:13:01.818034 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b1799672-a7e7-48b7-ae8a-f9900273491b tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:13:01.962640 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b1799672-a7e7-48b7-ae8a-f9900273491b tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:13:01.970896 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b1799672-a7e7-48b7-ae8a-f9900273491b tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/0c5a7550-1f75-43a3-a365-25e83435bdaa" status: 200 len: 1669 microversion: 2.1 time: 0.165361 Jul 23 22:13:01.971479 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3524/6134] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:13:01 2022] GET /compute/v2.1/servers/0c5a7550-1f75-43a3-a365-25e83435bdaa => generated 1669 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:13:01.986718 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-7324cd08-9056-45f9-b0f3-c7a13a28a0e5 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:13:01.987218 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-7324cd08-9056-45f9-b0f3-c7a13a28a0e5 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 0c5a7550-1f75-43a3-a365-25e83435bdaa] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:13:01.993544 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7324cd08-9056-45f9-b0f3-c7a13a28a0e5 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:13:01.994029 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7324cd08-9056-45f9-b0f3-c7a13a28a0e5 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:13:01.994774 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7324cd08-9056-45f9-b0f3-c7a13a28a0e5 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:13:01.995212 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7324cd08-9056-45f9-b0f3-c7a13a28a0e5 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:13:02.020481 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-7324cd08-9056-45f9-b0f3-c7a13a28a0e5 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 0c5a7550-1f75-43a3-a365-25e83435bdaa] Going to try to terminate instance {{(pid=131320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 22:13:02.101177 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-7324cd08-9056-45f9-b0f3-c7a13a28a0e5 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0c5a7550-1f75-43a3-a365-25e83435bdaa" status: 204 len: 0 microversion: 2.1 time: 0.117543 Jul 23 22:13:02.101794 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3525/6135] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 22:13:01 2022] DELETE /compute/v2.1/servers/0c5a7550-1f75-43a3-a365-25e83435bdaa => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 22:13:02.111128 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-366a68df-5f6f-4042-9d1b-4b38ee09b9a8 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:13:02.112066 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-366a68df-5f6f-4042-9d1b-4b38ee09b9a8 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 0c5a7550-1f75-43a3-a365-25e83435bdaa] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:13:02.118574 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-366a68df-5f6f-4042-9d1b-4b38ee09b9a8 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:13:02.119022 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-366a68df-5f6f-4042-9d1b-4b38ee09b9a8 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:13:02.119791 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-366a68df-5f6f-4042-9d1b-4b38ee09b9a8 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:13:02.120227 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-366a68df-5f6f-4042-9d1b-4b38ee09b9a8 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:13:02.253506 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-366a68df-5f6f-4042-9d1b-4b38ee09b9a8 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:13:02.261543 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-366a68df-5f6f-4042-9d1b-4b38ee09b9a8 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/0c5a7550-1f75-43a3-a365-25e83435bdaa" status: 200 len: 1675 microversion: 2.1 time: 0.154954 Jul 23 22:13:02.262162 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3526/6136] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:13:02 2022] GET /compute/v2.1/servers/0c5a7550-1f75-43a3-a365-25e83435bdaa => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:13:02.266726 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-bf865816-bb2a-4180-a2f3-8e2ab4488881 req-b11f449e-a45b-4e3f-ac35-5568b8b34561 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c5a7550-1f75-43a3-a365-25e83435bdaa", "name": "network-vif-plugged", "status": "completed", "tag": "b41fcd35-236a-4d59-a9f1-51da380c6b03"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:13:02.274565 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-bf865816-bb2a-4180-a2f3-8e2ab4488881 req-b11f449e-a45b-4e3f-ac35-5568b8b34561 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:13:02.274962 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-bf865816-bb2a-4180-a2f3-8e2ab4488881 req-b11f449e-a45b-4e3f-ac35-5568b8b34561 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:13:02.286490 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-bf865816-bb2a-4180-a2f3-8e2ab4488881 req-b11f449e-a45b-4e3f-ac35-5568b8b34561 service nova] Creating event network-vif-plugged:b41fcd35-236a-4d59-a9f1-51da380c6b03 for instance 0c5a7550-1f75-43a3-a365-25e83435bdaa on nch1-master-1 Jul 23 22:13:02.291549 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-bf865816-bb2a-4180-a2f3-8e2ab4488881 req-b11f449e-a45b-4e3f-ac35-5568b8b34561 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028262 Jul 23 22:13:02.292240 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3527/6137] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:13:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:13:03.280600 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4fb87a1a-c4e5-4b87-9bfa-0eebefc9cfe6 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:13:03.281266 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-4fb87a1a-c4e5-4b87-9bfa-0eebefc9cfe6 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 0c5a7550-1f75-43a3-a365-25e83435bdaa] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:13:03.288141 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4fb87a1a-c4e5-4b87-9bfa-0eebefc9cfe6 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:13:03.288593 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4fb87a1a-c4e5-4b87-9bfa-0eebefc9cfe6 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:13:03.289355 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4fb87a1a-c4e5-4b87-9bfa-0eebefc9cfe6 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:13:03.289793 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4fb87a1a-c4e5-4b87-9bfa-0eebefc9cfe6 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:13:03.304730 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:13:03.427591 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-4fb87a1a-c4e5-4b87-9bfa-0eebefc9cfe6 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:13:03.439181 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4fb87a1a-c4e5-4b87-9bfa-0eebefc9cfe6 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/0c5a7550-1f75-43a3-a365-25e83435bdaa" status: 200 len: 1675 microversion: 2.1 time: 0.163592 Jul 23 22:13:03.439924 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3528/6138] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:13:03 2022] GET /compute/v2.1/servers/0c5a7550-1f75-43a3-a365-25e83435bdaa => generated 1675 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:13:04.371348 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-5889907d-ba13-42d6-b55c-abf5b6e89687 req-c218bbd0-a64b-489d-b213-f728ee709e9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c5a7550-1f75-43a3-a365-25e83435bdaa", "name": "network-vif-deleted", "tag": "b41fcd35-236a-4d59-a9f1-51da380c6b03"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:13:04.380964 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-5889907d-ba13-42d6-b55c-abf5b6e89687 req-c218bbd0-a64b-489d-b213-f728ee709e9c service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:13:04.381477 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-5889907d-ba13-42d6-b55c-abf5b6e89687 req-c218bbd0-a64b-489d-b213-f728ee709e9c service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:13:04.393352 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-5889907d-ba13-42d6-b55c-abf5b6e89687 req-c218bbd0-a64b-489d-b213-f728ee709e9c service nova] Creating event network-vif-deleted:b41fcd35-236a-4d59-a9f1-51da380c6b03 for instance 0c5a7550-1f75-43a3-a365-25e83435bdaa on nch1-master-1 Jul 23 22:13:04.398426 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-5889907d-ba13-42d6-b55c-abf5b6e89687 req-c218bbd0-a64b-489d-b213-f728ee709e9c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030887 Jul 23 22:13:04.399044 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3529/6139] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:13:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 22:13:04.459418 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ee92a55c-0ab2-41a3-ad0d-8a88f9c4c389 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:13:04.460513 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ee92a55c-0ab2-41a3-ad0d-8a88f9c4c389 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 0c5a7550-1f75-43a3-a365-25e83435bdaa] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:13:04.467300 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ee92a55c-0ab2-41a3-ad0d-8a88f9c4c389 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:13:04.467808 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ee92a55c-0ab2-41a3-ad0d-8a88f9c4c389 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:13:04.468884 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ee92a55c-0ab2-41a3-ad0d-8a88f9c4c389 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:13:04.469447 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ee92a55c-0ab2-41a3-ad0d-8a88f9c4c389 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:13:04.502837 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ee92a55c-0ab2-41a3-ad0d-8a88f9c4c389 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:13:04.503365 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ee92a55c-0ab2-41a3-ad0d-8a88f9c4c389 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:13:04.503857 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.objects.instance [None req-ee92a55c-0ab2-41a3-ad0d-8a88f9c4c389 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lazy-loading 'fault' on Instance uuid 0c5a7550-1f75-43a3-a365-25e83435bdaa {{(pid=131320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 22:13:04.557052 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ee92a55c-0ab2-41a3-ad0d-8a88f9c4c389 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:13:04.565523 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ee92a55c-0ab2-41a3-ad0d-8a88f9c4c389 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/0c5a7550-1f75-43a3-a365-25e83435bdaa" status: 200 len: 1329 microversion: 2.1 time: 0.110921 Jul 23 22:13:04.566154 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3530/6140] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:13:04 2022] GET /compute/v2.1/servers/0c5a7550-1f75-43a3-a365-25e83435bdaa => generated 1329 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:13:05.587774 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-59e01eae-9c48-402c-9918-e15d7edc9a29 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:13:05.588791 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-59e01eae-9c48-402c-9918-e15d7edc9a29 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 0c5a7550-1f75-43a3-a365-25e83435bdaa] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:13:05.600634 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-59e01eae-9c48-402c-9918-e15d7edc9a29 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:13:05.601095 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-59e01eae-9c48-402c-9918-e15d7edc9a29 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:13:05.601898 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-59e01eae-9c48-402c-9918-e15d7edc9a29 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:13:05.602348 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-59e01eae-9c48-402c-9918-e15d7edc9a29 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:13:05.618763 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-59e01eae-9c48-402c-9918-e15d7edc9a29 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] HTTP exception thrown: Instance 0c5a7550-1f75-43a3-a365-25e83435bdaa could not be found. Jul 23 22:13:05.620424 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-59e01eae-9c48-402c-9918-e15d7edc9a29 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Request method failure captured: Jul 23 22:13:05.620424 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/0c5a7550-1f75-43a3-a365-25e83435bdaa HTTP/1.1 Jul 23 22:13:05.620424 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 22:13:05.620424 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 22:13:05.620424 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 22:13:05.620424 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 22:13:05.620424 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 22:13:05.620424 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 22:13:05.620424 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 22:13:05.620424 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 22:13:05.620424 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3HIoewFR0SqpqLrj5I-sN7pNyjXsXXtQLkybI9vB6YsXdCaJ6oH3gw_3sQK2MiiJxU-U9GJtkTNRyRtiyWB74IsJErQO0QMayat2E8l_KlQxoCwZvuOOv2BFlgI59GiCbRO0itRDUcJc1lBv1Mjh_3cnjoEC2YbTi0_IAE5AJlU7TS0 Jul 23 22:13:05.620424 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 22:13:05.620424 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 22:13:05.620424 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 22:13:05.620424 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 22:13:05.620424 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 22:13:05.620424 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 22:13:05.620424 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 5ca8bc0082894aa6b90a714ddc6a6790 Jul 23 22:13:05.620424 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServerActionsTestJSON-1436267344 Jul 23 22:13:05.620424 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 22:13:05.620424 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 22:13:05.620424 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5ca8bc0082894aa6b90a714ddc6a6790"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5ca8bc0082894aa6b90a714ddc6a6790"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_5ca8bc0082894aa6b90a714ddc6a6790", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/5ca8bc0082894aa6b90a714ddc6a6790"}]}] Jul 23 22:13:05.620424 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServerActionsTestJSON-1436267344 Jul 23 22:13:05.620424 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 5ca8bc0082894aa6b90a714ddc6a6790 Jul 23 22:13:05.620424 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServerActionsTestJSON-1436267344 Jul 23 22:13:05.620424 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServerActionsTestJSON-1436267344-project Jul 23 22:13:05.620424 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 22:13:05.620424 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 22:13:05.620424 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 14820436f99c404b80194a1b985c76b1 Jul 23 22:13:05.620424 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServerActionsTestJSON-1436267344-project Jul 23 22:13:05.620424 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 22:13:05.620424 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance 0c5a7550-1f75-43a3-a365-25e83435bdaa could not be found. Jul 23 22:13:05.620424 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '0c5a7550-1f75-43a3-a365-25e83435bdaa'} Jul 23 22:13:05.620424 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 22:13:05.620424 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:13:05.620424 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 22:13:05.620424 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 22:13:05.620424 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 22:13:05.620424 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 22:13:05.620424 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 22:13:05.620424 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 22:13:05.620424 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 22:13:05.620424 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 22:13:05.620424 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c5a7550-1f75-43a3-a365-25e83435bdaa could not be found. Jul 23 22:13:05.620424 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:13:05.620424 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:13:05.620424 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:13:05.620424 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:13:05.620424 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:13:05.620424 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:13:05.620424 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 22:13:05.620424 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 22:13:05.620424 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 22:13:05.620424 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 22:13:05.620424 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 22:13:05.620424 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 22:13:05.620424 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 22:13:05.620424 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 22:13:05.620424 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 22:13:05.620424 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 22:13:05.620424 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c5a7550-1f75-43a3-a365-25e83435bdaa could not be found. Jul 23 22:13:05.620424 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:13:05.620424 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:13:05.620424 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:13:05.624947 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:13:05.624947 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:13:05.624947 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:13:05.624947 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 22:13:05.624947 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 22:13:05.624947 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c5a7550-1f75-43a3-a365-25e83435bdaa could not be found. Jul 23 22:13:05.624947 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:13:05.624947 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-59e01eae-9c48-402c-9918-e15d7edc9a29 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Returning 404 to user: Instance 0c5a7550-1f75-43a3-a365-25e83435bdaa could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 22:13:05.624947 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-59e01eae-9c48-402c-9918-e15d7edc9a29 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/0c5a7550-1f75-43a3-a365-25e83435bdaa" status: 404 len: 111 microversion: 2.1 time: 0.040864 Jul 23 22:13:05.624947 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3531/6141] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:13:05 2022] GET /compute/v2.1/servers/0c5a7550-1f75-43a3-a365-25e83435bdaa => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 22:13:05.634584 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e9b97de5-5f6c-4043-899a-423c5f68dba8 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:13:05.635190 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e9b97de5-5f6c-4043-899a-423c5f68dba8 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 0c5a7550-1f75-43a3-a365-25e83435bdaa] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:13:05.641543 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e9b97de5-5f6c-4043-899a-423c5f68dba8 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:13:05.642055 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e9b97de5-5f6c-4043-899a-423c5f68dba8 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:13:05.642944 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e9b97de5-5f6c-4043-899a-423c5f68dba8 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:13:05.643381 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e9b97de5-5f6c-4043-899a-423c5f68dba8 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:13:05.657205 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-e9b97de5-5f6c-4043-899a-423c5f68dba8 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] HTTP exception thrown: Instance 0c5a7550-1f75-43a3-a365-25e83435bdaa could not be found. Jul 23 22:13:05.658766 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e9b97de5-5f6c-4043-899a-423c5f68dba8 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Request method failure captured: Jul 23 22:13:05.658766 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/0c5a7550-1f75-43a3-a365-25e83435bdaa HTTP/1.1 Jul 23 22:13:05.658766 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 22:13:05.658766 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 22:13:05.658766 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 22:13:05.658766 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 22:13:05.658766 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 22:13:05.658766 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 22:13:05.658766 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 22:13:05.658766 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 22:13:05.658766 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3HIoewFR0SqpqLrj5I-sN7pNyjXsXXtQLkybI9vB6YsXdCaJ6oH3gw_3sQK2MiiJxU-U9GJtkTNRyRtiyWB74IsJErQO0QMayat2E8l_KlQxoCwZvuOOv2BFlgI59GiCbRO0itRDUcJc1lBv1Mjh_3cnjoEC2YbTi0_IAE5AJlU7TS0 Jul 23 22:13:05.658766 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 22:13:05.658766 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 22:13:05.658766 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 22:13:05.658766 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 22:13:05.658766 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 22:13:05.658766 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 22:13:05.658766 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 5ca8bc0082894aa6b90a714ddc6a6790 Jul 23 22:13:05.658766 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServerActionsTestJSON-1436267344 Jul 23 22:13:05.658766 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 22:13:05.658766 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 22:13:05.658766 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5ca8bc0082894aa6b90a714ddc6a6790"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5ca8bc0082894aa6b90a714ddc6a6790"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_5ca8bc0082894aa6b90a714ddc6a6790", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/5ca8bc0082894aa6b90a714ddc6a6790"}]}] Jul 23 22:13:05.658766 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServerActionsTestJSON-1436267344 Jul 23 22:13:05.658766 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 5ca8bc0082894aa6b90a714ddc6a6790 Jul 23 22:13:05.658766 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServerActionsTestJSON-1436267344 Jul 23 22:13:05.658766 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServerActionsTestJSON-1436267344-project Jul 23 22:13:05.658766 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 22:13:05.658766 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 22:13:05.658766 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 14820436f99c404b80194a1b985c76b1 Jul 23 22:13:05.658766 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServerActionsTestJSON-1436267344-project Jul 23 22:13:05.658766 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 22:13:05.658766 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance 0c5a7550-1f75-43a3-a365-25e83435bdaa could not be found. Jul 23 22:13:05.658766 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '0c5a7550-1f75-43a3-a365-25e83435bdaa'} Jul 23 22:13:05.658766 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 22:13:05.658766 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:13:05.658766 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 22:13:05.658766 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 22:13:05.658766 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 22:13:05.658766 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 22:13:05.658766 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 22:13:05.658766 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 22:13:05.658766 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 22:13:05.658766 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 22:13:05.658766 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c5a7550-1f75-43a3-a365-25e83435bdaa could not be found. Jul 23 22:13:05.658766 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:13:05.658766 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:13:05.658766 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:13:05.658766 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:13:05.658766 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:13:05.658766 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:13:05.658766 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 22:13:05.658766 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 22:13:05.658766 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 22:13:05.658766 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 22:13:05.658766 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 22:13:05.658766 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 22:13:05.658766 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 22:13:05.658766 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 22:13:05.658766 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 22:13:05.658766 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 22:13:05.658766 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c5a7550-1f75-43a3-a365-25e83435bdaa could not be found. Jul 23 22:13:05.658766 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:13:05.658766 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:13:05.658766 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:13:05.662226 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:13:05.662226 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:13:05.662226 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:13:05.662226 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 22:13:05.662226 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 22:13:05.662226 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c5a7550-1f75-43a3-a365-25e83435bdaa could not be found. Jul 23 22:13:05.662226 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:13:05.662226 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e9b97de5-5f6c-4043-899a-423c5f68dba8 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Returning 404 to user: Instance 0c5a7550-1f75-43a3-a365-25e83435bdaa could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 22:13:05.662226 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e9b97de5-5f6c-4043-899a-423c5f68dba8 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/0c5a7550-1f75-43a3-a365-25e83435bdaa" status: 404 len: 111 microversion: 2.1 time: 0.029366 Jul 23 22:13:05.662226 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3532/6142] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:13:05 2022] GET /compute/v2.1/servers/0c5a7550-1f75-43a3-a365-25e83435bdaa => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 22:13:05.709890 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9eaeae6f-d3db-426a-9e78-8883237a7e06 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-653869116", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "networks": [{"uuid": "710bdc98-a85f-4879-a272-9349d503f3f7"}], "security_groups": [{"name": "tempest-securitygroup--2070004119"}], "key_name": "tempest-keypair-1953727802", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:13:05.817555 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-9eaeae6f-d3db-426a-9e78-8883237a7e06 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] validate_networks() for [('710bdc98-a85f-4879-a272-9349d503f3f7', None, None, None, None, None)] {{(pid=131320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 22:13:06.291797 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-9eaeae6f-d3db-426a-9e78-8883237a7e06 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 22:13:06.292222 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-9eaeae6f-d3db-426a-9e78-8883237a7e06 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 22:13:06.292704 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-9eaeae6f-d3db-426a-9e78-8883237a7e06 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 22:13:06.293121 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-9eaeae6f-d3db-426a-9e78-8883237a7e06 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 22:13:06.293535 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-9eaeae6f-d3db-426a-9e78-8883237a7e06 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 22:13:06.307670 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9eaeae6f-d3db-426a-9e78-8883237a7e06 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:13:06.308123 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9eaeae6f-d3db-426a-9e78-8883237a7e06 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:13:06.308929 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9eaeae6f-d3db-426a-9e78-8883237a7e06 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:13:06.309403 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9eaeae6f-d3db-426a-9e78-8883237a7e06 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:13:06.330315 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-9eaeae6f-d3db-426a-9e78-8883237a7e06 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Getting quotas for project 5ca8bc0082894aa6b90a714ddc6a6790. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 22:13:06.336060 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-9eaeae6f-d3db-426a-9e78-8883237a7e06 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Getting quotas for user 14820436f99c404b80194a1b985c76b1 and project 5ca8bc0082894aa6b90a714ddc6a6790. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 22:13:06.349891 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-9eaeae6f-d3db-426a-9e78-8883237a7e06 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Going to run 1 instances... {{(pid=131320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 22:13:06.352347 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-9eaeae6f-d3db-426a-9e78-8883237a7e06 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 8eb3cba5-d03f-4320-acfb-820bcec3f7a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 22:13:06.378995 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:13:06.399952 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9eaeae6f-d3db-426a-9e78-8883237a7e06 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.694059 Jul 23 22:13:06.400789 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3533/6143] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 22:13:05 2022] POST /compute/v2.1/servers => generated 406 bytes in 695 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 23 22:13:06.410693 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4053dfa1-68bf-4d21-ade4-607bf7e38e8f tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:13:06.411303 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-4053dfa1-68bf-4d21-ade4-607bf7e38e8f tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 8eb3cba5-d03f-4320-acfb-820bcec3f7a9] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:13:06.466563 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-4053dfa1-68bf-4d21-ade4-607bf7e38e8f tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:13:06.473784 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4053dfa1-68bf-4d21-ade4-607bf7e38e8f tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/8eb3cba5-d03f-4320-acfb-820bcec3f7a9" status: 200 len: 1238 microversion: 2.1 time: 0.066936 Jul 23 22:13:06.474374 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3534/6144] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:13:06 2022] GET /compute/v2.1/servers/8eb3cba5-d03f-4320-acfb-820bcec3f7a9 => generated 1238 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:13:07.491943 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0f719ab0-031b-4b16-b270-50f429b9bf7b tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:13:07.492846 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-0f719ab0-031b-4b16-b270-50f429b9bf7b tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 8eb3cba5-d03f-4320-acfb-820bcec3f7a9] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:13:07.500869 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0f719ab0-031b-4b16-b270-50f429b9bf7b tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:13:07.501281 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0f719ab0-031b-4b16-b270-50f429b9bf7b tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:13:07.502225 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0f719ab0-031b-4b16-b270-50f429b9bf7b tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:13:07.502732 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0f719ab0-031b-4b16-b270-50f429b9bf7b tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:13:07.568286 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-0f719ab0-031b-4b16-b270-50f429b9bf7b tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:13:07.576911 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-0f719ab0-031b-4b16-b270-50f429b9bf7b tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/8eb3cba5-d03f-4320-acfb-820bcec3f7a9" status: 200 len: 1298 microversion: 2.1 time: 0.089228 Jul 23 22:13:07.577731 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3535/6145] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:13:07 2022] GET /compute/v2.1/servers/8eb3cba5-d03f-4320-acfb-820bcec3f7a9 => generated 1298 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:13:08.596795 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-643c1ff5-57bf-4aad-83d8-82c41ffc7d85 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:13:08.602284 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-643c1ff5-57bf-4aad-83d8-82c41ffc7d85 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 8eb3cba5-d03f-4320-acfb-820bcec3f7a9] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:13:08.613016 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-643c1ff5-57bf-4aad-83d8-82c41ffc7d85 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:13:08.613700 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-643c1ff5-57bf-4aad-83d8-82c41ffc7d85 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:13:08.615495 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-643c1ff5-57bf-4aad-83d8-82c41ffc7d85 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:13:08.615950 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-643c1ff5-57bf-4aad-83d8-82c41ffc7d85 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:13:08.765230 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-643c1ff5-57bf-4aad-83d8-82c41ffc7d85 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:13:08.773046 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-643c1ff5-57bf-4aad-83d8-82c41ffc7d85 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/8eb3cba5-d03f-4320-acfb-820bcec3f7a9" status: 200 len: 1364 microversion: 2.1 time: 0.180840 Jul 23 22:13:08.776832 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3536/6146] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:13:08 2022] GET /compute/v2.1/servers/8eb3cba5-d03f-4320-acfb-820bcec3f7a9 => generated 1364 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:13:09.302458 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-051df235-da76-45ef-91bc-81338257152b req-b0dc202c-83be-4880-b920-15d07a89c10e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8eb3cba5-d03f-4320-acfb-820bcec3f7a9", "tag": "0829f91c-a8e5-4ed2-9d7c-31722b07c3ef"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:13:09.316309 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-051df235-da76-45ef-91bc-81338257152b req-b0dc202c-83be-4880-b920-15d07a89c10e service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:13:09.316895 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-051df235-da76-45ef-91bc-81338257152b req-b0dc202c-83be-4880-b920-15d07a89c10e service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:13:09.330792 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-051df235-da76-45ef-91bc-81338257152b req-b0dc202c-83be-4880-b920-15d07a89c10e service nova] Creating event network-changed:0829f91c-a8e5-4ed2-9d7c-31722b07c3ef for instance 8eb3cba5-d03f-4320-acfb-820bcec3f7a9 on nch1-master-1 Jul 23 22:13:09.338426 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-051df235-da76-45ef-91bc-81338257152b req-b0dc202c-83be-4880-b920-15d07a89c10e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039616 Jul 23 22:13:09.339537 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3537/6147] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:13:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:13:09.792766 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-bdcbaa67-5297-4673-8100-d472f6938cb0 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:13:09.793487 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-bdcbaa67-5297-4673-8100-d472f6938cb0 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 8eb3cba5-d03f-4320-acfb-820bcec3f7a9] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:13:09.800086 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bdcbaa67-5297-4673-8100-d472f6938cb0 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:13:09.800544 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bdcbaa67-5297-4673-8100-d472f6938cb0 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:13:09.801332 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bdcbaa67-5297-4673-8100-d472f6938cb0 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:13:09.801777 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bdcbaa67-5297-4673-8100-d472f6938cb0 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:13:09.936671 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-bdcbaa67-5297-4673-8100-d472f6938cb0 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:13:09.947490 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-bdcbaa67-5297-4673-8100-d472f6938cb0 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/8eb3cba5-d03f-4320-acfb-820bcec3f7a9" status: 200 len: 1364 microversion: 2.1 time: 0.159963 Jul 23 22:13:09.948091 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3538/6148] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:13:09 2022] GET /compute/v2.1/servers/8eb3cba5-d03f-4320-acfb-820bcec3f7a9 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:13:10.965903 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c4de0bf8-7636-43ab-ada2-81a1a7f21e4f tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:13:10.966780 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c4de0bf8-7636-43ab-ada2-81a1a7f21e4f tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 8eb3cba5-d03f-4320-acfb-820bcec3f7a9] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:13:10.974655 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c4de0bf8-7636-43ab-ada2-81a1a7f21e4f tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:13:10.975188 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c4de0bf8-7636-43ab-ada2-81a1a7f21e4f tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:13:10.975977 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c4de0bf8-7636-43ab-ada2-81a1a7f21e4f tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:13:10.976422 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c4de0bf8-7636-43ab-ada2-81a1a7f21e4f tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:13:11.120255 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c4de0bf8-7636-43ab-ada2-81a1a7f21e4f tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:13:11.132214 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c4de0bf8-7636-43ab-ada2-81a1a7f21e4f tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/8eb3cba5-d03f-4320-acfb-820bcec3f7a9" status: 200 len: 1364 microversion: 2.1 time: 0.169957 Jul 23 22:13:11.133001 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3539/6149] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:13:10 2022] GET /compute/v2.1/servers/8eb3cba5-d03f-4320-acfb-820bcec3f7a9 => generated 1364 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:13:12.150931 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5be2e7fa-6617-4498-b1e8-9fa86e79b09a tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:13:12.151544 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5be2e7fa-6617-4498-b1e8-9fa86e79b09a tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 8eb3cba5-d03f-4320-acfb-820bcec3f7a9] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:13:12.158793 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5be2e7fa-6617-4498-b1e8-9fa86e79b09a tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:13:12.159252 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5be2e7fa-6617-4498-b1e8-9fa86e79b09a tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:13:12.160045 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5be2e7fa-6617-4498-b1e8-9fa86e79b09a tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:13:12.160486 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5be2e7fa-6617-4498-b1e8-9fa86e79b09a tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:13:12.296923 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5be2e7fa-6617-4498-b1e8-9fa86e79b09a tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:13:12.304884 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5be2e7fa-6617-4498-b1e8-9fa86e79b09a tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/8eb3cba5-d03f-4320-acfb-820bcec3f7a9" status: 200 len: 1364 microversion: 2.1 time: 0.158418 Jul 23 22:13:12.305445 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3540/6150] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:13:12 2022] GET /compute/v2.1/servers/8eb3cba5-d03f-4320-acfb-820bcec3f7a9 => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:13:13.324637 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-dbc8fa26-b2a7-4251-bce9-071152be756f tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:13:13.325669 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-dbc8fa26-b2a7-4251-bce9-071152be756f tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 8eb3cba5-d03f-4320-acfb-820bcec3f7a9] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:13:13.336707 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dbc8fa26-b2a7-4251-bce9-071152be756f tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:13:13.337144 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dbc8fa26-b2a7-4251-bce9-071152be756f tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:13:13.337932 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dbc8fa26-b2a7-4251-bce9-071152be756f tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:13:13.338400 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dbc8fa26-b2a7-4251-bce9-071152be756f tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:13:13.470663 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-dbc8fa26-b2a7-4251-bce9-071152be756f tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:13:13.482603 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-dbc8fa26-b2a7-4251-bce9-071152be756f tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/8eb3cba5-d03f-4320-acfb-820bcec3f7a9" status: 200 len: 1364 microversion: 2.1 time: 0.163086 Jul 23 22:13:13.483432 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3541/6151] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:13:13 2022] GET /compute/v2.1/servers/8eb3cba5-d03f-4320-acfb-820bcec3f7a9 => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:13:14.231004 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-36cbdf1c-fc01-453b-a2ab-1e1b77e8ebd7 req-ee2c8594-a53d-4907-b558-4835a53c5ae7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8eb3cba5-d03f-4320-acfb-820bcec3f7a9", "name": "network-vif-plugged", "status": "completed", "tag": "0829f91c-a8e5-4ed2-9d7c-31722b07c3ef"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:13:14.242916 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-36cbdf1c-fc01-453b-a2ab-1e1b77e8ebd7 req-ee2c8594-a53d-4907-b558-4835a53c5ae7 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:13:14.243436 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-36cbdf1c-fc01-453b-a2ab-1e1b77e8ebd7 req-ee2c8594-a53d-4907-b558-4835a53c5ae7 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:13:14.256008 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-36cbdf1c-fc01-453b-a2ab-1e1b77e8ebd7 req-ee2c8594-a53d-4907-b558-4835a53c5ae7 service nova] Creating event network-vif-plugged:0829f91c-a8e5-4ed2-9d7c-31722b07c3ef for instance 8eb3cba5-d03f-4320-acfb-820bcec3f7a9 on nch1-master-1 Jul 23 22:13:14.260897 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-36cbdf1c-fc01-453b-a2ab-1e1b77e8ebd7 req-ee2c8594-a53d-4907-b558-4835a53c5ae7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033771 Jul 23 22:13:14.261498 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3542/6152] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:13:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:13:14.501531 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-49bb32dd-6acc-460e-933a-2ae5c5b88ffb tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:13:14.502319 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-49bb32dd-6acc-460e-933a-2ae5c5b88ffb tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 8eb3cba5-d03f-4320-acfb-820bcec3f7a9] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:13:14.510123 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-49bb32dd-6acc-460e-933a-2ae5c5b88ffb tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:13:14.510574 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-49bb32dd-6acc-460e-933a-2ae5c5b88ffb tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:13:14.511373 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-49bb32dd-6acc-460e-933a-2ae5c5b88ffb tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:13:14.511811 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-49bb32dd-6acc-460e-933a-2ae5c5b88ffb tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:13:14.660715 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-49bb32dd-6acc-460e-933a-2ae5c5b88ffb tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:13:14.669894 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-49bb32dd-6acc-460e-933a-2ae5c5b88ffb tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/8eb3cba5-d03f-4320-acfb-820bcec3f7a9" status: 200 len: 1364 microversion: 2.1 time: 0.172706 Jul 23 22:13:14.670471 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3543/6153] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:13:14 2022] GET /compute/v2.1/servers/8eb3cba5-d03f-4320-acfb-820bcec3f7a9 => generated 1364 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:13:15.688226 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ff4019d6-49d8-4633-8007-ee482b078b57 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:13:15.688917 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ff4019d6-49d8-4633-8007-ee482b078b57 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 8eb3cba5-d03f-4320-acfb-820bcec3f7a9] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:13:15.696547 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ff4019d6-49d8-4633-8007-ee482b078b57 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:13:15.697033 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ff4019d6-49d8-4633-8007-ee482b078b57 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:13:15.697906 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ff4019d6-49d8-4633-8007-ee482b078b57 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:13:15.698402 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ff4019d6-49d8-4633-8007-ee482b078b57 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:13:15.837151 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ff4019d6-49d8-4633-8007-ee482b078b57 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:13:15.845697 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ff4019d6-49d8-4633-8007-ee482b078b57 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/8eb3cba5-d03f-4320-acfb-820bcec3f7a9" status: 200 len: 1550 microversion: 2.1 time: 0.161682 Jul 23 22:13:15.846429 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3544/6154] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:13:15 2022] GET /compute/v2.1/servers/8eb3cba5-d03f-4320-acfb-820bcec3f7a9 => generated 1550 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:13:15.865377 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b8e9b731-b4ca-44ef-bb24-30a10c9148d1 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:13:15.865974 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b8e9b731-b4ca-44ef-bb24-30a10c9148d1 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 8eb3cba5-d03f-4320-acfb-820bcec3f7a9] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:13:15.881207 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b8e9b731-b4ca-44ef-bb24-30a10c9148d1 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:13:15.881665 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b8e9b731-b4ca-44ef-bb24-30a10c9148d1 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:13:15.882476 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b8e9b731-b4ca-44ef-bb24-30a10c9148d1 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:13:15.882919 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b8e9b731-b4ca-44ef-bb24-30a10c9148d1 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:13:15.979956 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b8e9b731-b4ca-44ef-bb24-30a10c9148d1 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/8eb3cba5-d03f-4320-acfb-820bcec3f7a9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.120281 Jul 23 22:13:15.980770 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3545/6155] 10.222.0.17 () {58 vars in 1274 bytes} [Sat Jul 23 22:13:15 2022] GET /compute/v2.1/servers/8eb3cba5-d03f-4320-acfb-820bcec3f7a9/os-interface => generated 284 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:13:17.087520 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:13:17.088347 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=8 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:13:17.093051 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-7736f0bc-7961-4ace-b41f-778b43d37e0a req-a51947bf-eb28-4c32-a2f9-e209586bdb10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8eb3cba5-d03f-4320-acfb-820bcec3f7a9", "tag": "0829f91c-a8e5-4ed2-9d7c-31722b07c3ef"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:13:17.102286 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-7736f0bc-7961-4ace-b41f-778b43d37e0a req-a51947bf-eb28-4c32-a2f9-e209586bdb10 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:13:17.102727 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-7736f0bc-7961-4ace-b41f-778b43d37e0a req-a51947bf-eb28-4c32-a2f9-e209586bdb10 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:13:17.114171 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-7736f0bc-7961-4ace-b41f-778b43d37e0a req-a51947bf-eb28-4c32-a2f9-e209586bdb10 service nova] Creating event network-changed:0829f91c-a8e5-4ed2-9d7c-31722b07c3ef for instance 8eb3cba5-d03f-4320-acfb-820bcec3f7a9 on nch1-master-1 Jul 23 22:13:17.124462 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-7736f0bc-7961-4ace-b41f-778b43d37e0a req-a51947bf-eb28-4c32-a2f9-e209586bdb10 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037364 Jul 23 22:13:17.125202 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3546/6156] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:13:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 22:13:54.358562 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=28 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:13:54.359425 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=77 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:13:54.364098 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1a5323a3-b6f4-4b14-9302-b04d575f874f tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:13:54.371407 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1a5323a3-b6f4-4b14-9302-b04d575f874f tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:13:54.371841 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1a5323a3-b6f4-4b14-9302-b04d575f874f tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:13:54.395927 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1a5323a3-b6f4-4b14-9302-b04d575f874f tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 8eb3cba5-d03f-4320-acfb-820bcec3f7a9] Going to try to stop instance {{(pid=131320) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 23 22:13:54.444910 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1a5323a3-b6f4-4b14-9302-b04d575f874f tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "POST /compute/v2.1/servers/8eb3cba5-d03f-4320-acfb-820bcec3f7a9/action" status: 202 len: 0 microversion: 2.1 time: 0.088218 Jul 23 22:13:54.445523 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3547/6157] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 22:13:54 2022] POST /compute/v2.1/servers/8eb3cba5-d03f-4320-acfb-820bcec3f7a9/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 22:13:54.454817 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6495d20b-7d17-492f-a551-4a392d63e758 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:13:54.455508 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6495d20b-7d17-492f-a551-4a392d63e758 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 8eb3cba5-d03f-4320-acfb-820bcec3f7a9] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:13:54.462047 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6495d20b-7d17-492f-a551-4a392d63e758 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:13:54.462505 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6495d20b-7d17-492f-a551-4a392d63e758 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:13:54.463286 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6495d20b-7d17-492f-a551-4a392d63e758 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:13:54.463775 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6495d20b-7d17-492f-a551-4a392d63e758 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:13:54.607501 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6495d20b-7d17-492f-a551-4a392d63e758 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:13:54.615275 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6495d20b-7d17-492f-a551-4a392d63e758 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/8eb3cba5-d03f-4320-acfb-820bcec3f7a9" status: 200 len: 1678 microversion: 2.1 time: 0.164959 Jul 23 22:13:54.615790 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3548/6158] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:13:54 2022] GET /compute/v2.1/servers/8eb3cba5-d03f-4320-acfb-820bcec3f7a9 => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:13:55.635988 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2da73fb3-adc0-4e4a-8603-f4028e9de37e tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:13:55.636782 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-2da73fb3-adc0-4e4a-8603-f4028e9de37e tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 8eb3cba5-d03f-4320-acfb-820bcec3f7a9] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:13:55.646020 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2da73fb3-adc0-4e4a-8603-f4028e9de37e tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:13:55.646587 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2da73fb3-adc0-4e4a-8603-f4028e9de37e tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:13:55.647559 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2da73fb3-adc0-4e4a-8603-f4028e9de37e tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:13:55.648077 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2da73fb3-adc0-4e4a-8603-f4028e9de37e tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:13:55.790044 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-2da73fb3-adc0-4e4a-8603-f4028e9de37e tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:13:55.798378 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2da73fb3-adc0-4e4a-8603-f4028e9de37e tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/8eb3cba5-d03f-4320-acfb-820bcec3f7a9" status: 200 len: 1678 microversion: 2.1 time: 0.167536 Jul 23 22:13:55.799312 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3549/6159] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:13:55 2022] GET /compute/v2.1/servers/8eb3cba5-d03f-4320-acfb-820bcec3f7a9 => generated 1678 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:13:56.823101 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-dc00d38d-0618-4190-a003-9aaed96449e4 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:13:56.826259 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-dc00d38d-0618-4190-a003-9aaed96449e4 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 8eb3cba5-d03f-4320-acfb-820bcec3f7a9] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:13:56.837712 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dc00d38d-0618-4190-a003-9aaed96449e4 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:13:56.838196 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dc00d38d-0618-4190-a003-9aaed96449e4 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:13:56.838984 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dc00d38d-0618-4190-a003-9aaed96449e4 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:13:56.839423 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dc00d38d-0618-4190-a003-9aaed96449e4 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:13:56.982565 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-dc00d38d-0618-4190-a003-9aaed96449e4 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:13:56.990253 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-dc00d38d-0618-4190-a003-9aaed96449e4 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/8eb3cba5-d03f-4320-acfb-820bcec3f7a9" status: 200 len: 1678 microversion: 2.1 time: 0.176807 Jul 23 22:13:56.990869 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3550/6160] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:13:56 2022] GET /compute/v2.1/servers/8eb3cba5-d03f-4320-acfb-820bcec3f7a9 => generated 1678 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:13:58.011585 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0f236e3f-0901-4e0d-861d-42c040588463 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:13:58.012529 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-0f236e3f-0901-4e0d-861d-42c040588463 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 8eb3cba5-d03f-4320-acfb-820bcec3f7a9] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:13:58.024395 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0f236e3f-0901-4e0d-861d-42c040588463 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:13:58.024855 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0f236e3f-0901-4e0d-861d-42c040588463 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:13:58.025628 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0f236e3f-0901-4e0d-861d-42c040588463 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:13:58.026113 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0f236e3f-0901-4e0d-861d-42c040588463 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:13:58.167257 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-0f236e3f-0901-4e0d-861d-42c040588463 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:13:58.175594 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-0f236e3f-0901-4e0d-861d-42c040588463 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/8eb3cba5-d03f-4320-acfb-820bcec3f7a9" status: 200 len: 1678 microversion: 2.1 time: 0.170619 Jul 23 22:13:58.176232 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3551/6161] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:13:58 2022] GET /compute/v2.1/servers/8eb3cba5-d03f-4320-acfb-820bcec3f7a9 => generated 1678 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:13:59.197772 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3b04e21b-81e3-43ea-9da1-790ac63749b8 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:13:59.198569 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-3b04e21b-81e3-43ea-9da1-790ac63749b8 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 8eb3cba5-d03f-4320-acfb-820bcec3f7a9] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:13:59.206493 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3b04e21b-81e3-43ea-9da1-790ac63749b8 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:13:59.206949 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3b04e21b-81e3-43ea-9da1-790ac63749b8 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:13:59.207729 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3b04e21b-81e3-43ea-9da1-790ac63749b8 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:13:59.208210 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3b04e21b-81e3-43ea-9da1-790ac63749b8 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:13:59.345719 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-3b04e21b-81e3-43ea-9da1-790ac63749b8 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:13:59.353538 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-3b04e21b-81e3-43ea-9da1-790ac63749b8 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/8eb3cba5-d03f-4320-acfb-820bcec3f7a9" status: 200 len: 1678 microversion: 2.1 time: 0.162139 Jul 23 22:13:59.354268 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3552/6162] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:13:59 2022] GET /compute/v2.1/servers/8eb3cba5-d03f-4320-acfb-820bcec3f7a9 => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:14:00.375698 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a82fc11f-6274-4e93-b610-b9ddd05aa819 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:14:00.376798 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a82fc11f-6274-4e93-b610-b9ddd05aa819 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 8eb3cba5-d03f-4320-acfb-820bcec3f7a9] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:14:00.388567 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a82fc11f-6274-4e93-b610-b9ddd05aa819 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:14:00.389322 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a82fc11f-6274-4e93-b610-b9ddd05aa819 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:14:00.390670 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a82fc11f-6274-4e93-b610-b9ddd05aa819 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:14:00.391458 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a82fc11f-6274-4e93-b610-b9ddd05aa819 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:14:00.529384 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a82fc11f-6274-4e93-b610-b9ddd05aa819 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:14:00.537546 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a82fc11f-6274-4e93-b610-b9ddd05aa819 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/8eb3cba5-d03f-4320-acfb-820bcec3f7a9" status: 200 len: 1678 microversion: 2.1 time: 0.168774 Jul 23 22:14:00.538218 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3553/6163] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:14:00 2022] GET /compute/v2.1/servers/8eb3cba5-d03f-4320-acfb-820bcec3f7a9 => generated 1678 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:14:01.559621 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5c00099c-bcbc-4fb8-8ca1-78075bb239aa tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:14:01.560722 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5c00099c-bcbc-4fb8-8ca1-78075bb239aa tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 8eb3cba5-d03f-4320-acfb-820bcec3f7a9] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:14:01.572546 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5c00099c-bcbc-4fb8-8ca1-78075bb239aa tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:14:01.573022 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5c00099c-bcbc-4fb8-8ca1-78075bb239aa tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:14:01.573847 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5c00099c-bcbc-4fb8-8ca1-78075bb239aa tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:14:01.574327 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5c00099c-bcbc-4fb8-8ca1-78075bb239aa tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:14:01.728947 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5c00099c-bcbc-4fb8-8ca1-78075bb239aa tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:14:01.736958 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5c00099c-bcbc-4fb8-8ca1-78075bb239aa tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/8eb3cba5-d03f-4320-acfb-820bcec3f7a9" status: 200 len: 1678 microversion: 2.1 time: 0.184044 Jul 23 22:14:01.737558 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3554/6164] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:14:01 2022] GET /compute/v2.1/servers/8eb3cba5-d03f-4320-acfb-820bcec3f7a9 => generated 1678 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:14:02.758990 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-7dd6503c-054f-4760-9c76-5664796b8cd5 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:14:02.760029 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-7dd6503c-054f-4760-9c76-5664796b8cd5 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 8eb3cba5-d03f-4320-acfb-820bcec3f7a9] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:14:02.771650 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7dd6503c-054f-4760-9c76-5664796b8cd5 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:14:02.772396 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7dd6503c-054f-4760-9c76-5664796b8cd5 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:14:02.773659 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7dd6503c-054f-4760-9c76-5664796b8cd5 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:14:02.774434 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7dd6503c-054f-4760-9c76-5664796b8cd5 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:14:02.921332 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-7dd6503c-054f-4760-9c76-5664796b8cd5 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:14:02.929152 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-7dd6503c-054f-4760-9c76-5664796b8cd5 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/8eb3cba5-d03f-4320-acfb-820bcec3f7a9" status: 200 len: 1678 microversion: 2.1 time: 0.176847 Jul 23 22:14:02.929705 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3555/6165] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:14:02 2022] GET /compute/v2.1/servers/8eb3cba5-d03f-4320-acfb-820bcec3f7a9 => generated 1678 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:14:03.946883 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f35bd2bc-3133-421c-bd14-80e00e989760 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:14:03.947473 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f35bd2bc-3133-421c-bd14-80e00e989760 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 8eb3cba5-d03f-4320-acfb-820bcec3f7a9] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:14:03.955274 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f35bd2bc-3133-421c-bd14-80e00e989760 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:14:03.955716 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f35bd2bc-3133-421c-bd14-80e00e989760 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:14:03.956482 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f35bd2bc-3133-421c-bd14-80e00e989760 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:14:03.956922 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f35bd2bc-3133-421c-bd14-80e00e989760 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:14:04.090650 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f35bd2bc-3133-421c-bd14-80e00e989760 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:14:04.099043 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f35bd2bc-3133-421c-bd14-80e00e989760 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/8eb3cba5-d03f-4320-acfb-820bcec3f7a9" status: 200 len: 1678 microversion: 2.1 time: 0.156159 Jul 23 22:14:04.099639 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3556/6166] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:14:03 2022] GET /compute/v2.1/servers/8eb3cba5-d03f-4320-acfb-820bcec3f7a9 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:14:05.117100 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1b3f8a00-0946-48e7-9be9-6cb233962e81 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:14:05.117711 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1b3f8a00-0946-48e7-9be9-6cb233962e81 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 8eb3cba5-d03f-4320-acfb-820bcec3f7a9] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:14:05.125283 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1b3f8a00-0946-48e7-9be9-6cb233962e81 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:14:05.125740 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1b3f8a00-0946-48e7-9be9-6cb233962e81 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:14:05.126530 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1b3f8a00-0946-48e7-9be9-6cb233962e81 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:14:05.127009 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1b3f8a00-0946-48e7-9be9-6cb233962e81 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:14:05.268748 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-1b3f8a00-0946-48e7-9be9-6cb233962e81 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:14:05.276700 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1b3f8a00-0946-48e7-9be9-6cb233962e81 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/8eb3cba5-d03f-4320-acfb-820bcec3f7a9" status: 200 len: 1655 microversion: 2.1 time: 0.163678 Jul 23 22:14:05.277292 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3557/6167] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:14:05 2022] GET /compute/v2.1/servers/8eb3cba5-d03f-4320-acfb-820bcec3f7a9 => generated 1655 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:14:05.293522 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-7536d7ef-ef40-4574-84a9-5020748f6fcf tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:14:05.294536 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-7536d7ef-ef40-4574-84a9-5020748f6fcf tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 8eb3cba5-d03f-4320-acfb-820bcec3f7a9] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:14:05.300662 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7536d7ef-ef40-4574-84a9-5020748f6fcf tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:14:05.301075 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7536d7ef-ef40-4574-84a9-5020748f6fcf tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:14:05.301902 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7536d7ef-ef40-4574-84a9-5020748f6fcf tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:14:05.302341 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7536d7ef-ef40-4574-84a9-5020748f6fcf tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:14:05.331460 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-7536d7ef-ef40-4574-84a9-5020748f6fcf tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:14:05.338180 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-7536d7ef-ef40-4574-84a9-5020748f6fcf tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 8eb3cba5-d03f-4320-acfb-820bcec3f7a9] Old instance type m1.heat2, new instance type m1.heat {{(pid=131320) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 23 22:14:05.345005 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-7536d7ef-ef40-4574-84a9-5020748f6fcf tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 22:14:05.345378 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-7536d7ef-ef40-4574-84a9-5020748f6fcf tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 22:14:05.345896 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-7536d7ef-ef40-4574-84a9-5020748f6fcf tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 22:14:05.346301 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-7536d7ef-ef40-4574-84a9-5020748f6fcf tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 22:14:05.346719 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-7536d7ef-ef40-4574-84a9-5020748f6fcf tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 22:14:05.411738 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-7536d7ef-ef40-4574-84a9-5020748f6fcf tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "POST /compute/v2.1/servers/8eb3cba5-d03f-4320-acfb-820bcec3f7a9/action" status: 202 len: 0 microversion: 2.1 time: 0.122005 Jul 23 22:14:05.415648 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3558/6168] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 22:14:05 2022] POST /compute/v2.1/servers/8eb3cba5-d03f-4320-acfb-820bcec3f7a9/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 23 22:14:05.420693 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-734c306d-f65d-482b-93e1-f7a557f2eb06 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:14:05.421313 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-734c306d-f65d-482b-93e1-f7a557f2eb06 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 8eb3cba5-d03f-4320-acfb-820bcec3f7a9] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:14:05.427875 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-734c306d-f65d-482b-93e1-f7a557f2eb06 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:14:05.428328 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-734c306d-f65d-482b-93e1-f7a557f2eb06 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:14:05.429096 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-734c306d-f65d-482b-93e1-f7a557f2eb06 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:14:05.429538 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-734c306d-f65d-482b-93e1-f7a557f2eb06 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:14:05.592455 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-734c306d-f65d-482b-93e1-f7a557f2eb06 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:14:05.601202 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-734c306d-f65d-482b-93e1-f7a557f2eb06 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/8eb3cba5-d03f-4320-acfb-820bcec3f7a9" status: 200 len: 1678 microversion: 2.1 time: 0.184271 Jul 23 22:14:05.601940 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3559/6169] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:14:05 2022] GET /compute/v2.1/servers/8eb3cba5-d03f-4320-acfb-820bcec3f7a9 => generated 1678 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:14:06.623173 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-123f76bc-38ad-46ba-9e72-244df92ffd60 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:14:06.624239 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-123f76bc-38ad-46ba-9e72-244df92ffd60 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 8eb3cba5-d03f-4320-acfb-820bcec3f7a9] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:14:06.635214 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-123f76bc-38ad-46ba-9e72-244df92ffd60 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:14:06.636083 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-123f76bc-38ad-46ba-9e72-244df92ffd60 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:14:06.636982 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-123f76bc-38ad-46ba-9e72-244df92ffd60 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:14:06.637415 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-123f76bc-38ad-46ba-9e72-244df92ffd60 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:14:06.777821 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-123f76bc-38ad-46ba-9e72-244df92ffd60 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:14:06.788582 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-123f76bc-38ad-46ba-9e72-244df92ffd60 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/8eb3cba5-d03f-4320-acfb-820bcec3f7a9" status: 200 len: 1678 microversion: 2.1 time: 0.171652 Jul 23 22:14:06.789430 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3560/6170] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:14:06 2022] GET /compute/v2.1/servers/8eb3cba5-d03f-4320-acfb-820bcec3f7a9 => generated 1678 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:14:07.810981 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e32e4308-82ba-4c08-b79c-d18b703855c5 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:14:07.812321 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e32e4308-82ba-4c08-b79c-d18b703855c5 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 8eb3cba5-d03f-4320-acfb-820bcec3f7a9] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:14:07.823884 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e32e4308-82ba-4c08-b79c-d18b703855c5 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:14:07.824645 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e32e4308-82ba-4c08-b79c-d18b703855c5 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:14:07.825928 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e32e4308-82ba-4c08-b79c-d18b703855c5 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:14:07.826709 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e32e4308-82ba-4c08-b79c-d18b703855c5 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:14:07.834048 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:14:07.967859 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e32e4308-82ba-4c08-b79c-d18b703855c5 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:14:07.977337 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e32e4308-82ba-4c08-b79c-d18b703855c5 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/8eb3cba5-d03f-4320-acfb-820bcec3f7a9" status: 200 len: 1683 microversion: 2.1 time: 0.172958 Jul 23 22:14:07.977946 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3561/6171] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:14:07 2022] GET /compute/v2.1/servers/8eb3cba5-d03f-4320-acfb-820bcec3f7a9 => generated 1683 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:14:08.999390 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6cc8a6bf-5f84-49c0-808a-0913136563b0 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:14:09.000454 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6cc8a6bf-5f84-49c0-808a-0913136563b0 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 8eb3cba5-d03f-4320-acfb-820bcec3f7a9] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:14:09.011872 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6cc8a6bf-5f84-49c0-808a-0913136563b0 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:14:09.012333 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6cc8a6bf-5f84-49c0-808a-0913136563b0 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:14:09.013105 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6cc8a6bf-5f84-49c0-808a-0913136563b0 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:14:09.013544 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6cc8a6bf-5f84-49c0-808a-0913136563b0 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:14:09.154435 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6cc8a6bf-5f84-49c0-808a-0913136563b0 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:14:09.166242 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6cc8a6bf-5f84-49c0-808a-0913136563b0 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/8eb3cba5-d03f-4320-acfb-820bcec3f7a9" status: 200 len: 1683 microversion: 2.1 time: 0.173220 Jul 23 22:14:09.167039 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3562/6172] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:14:08 2022] GET /compute/v2.1/servers/8eb3cba5-d03f-4320-acfb-820bcec3f7a9 => generated 1683 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:14:09.921088 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-3f833ccb-37ca-4771-8c15-34d5a2337581 req-cad413dd-4473-47a6-9386-40260bb5c052 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8eb3cba5-d03f-4320-acfb-820bcec3f7a9", "name": "network-vif-unplugged", "status": "completed", "tag": "0829f91c-a8e5-4ed2-9d7c-31722b07c3ef"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:14:09.929680 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-3f833ccb-37ca-4771-8c15-34d5a2337581 req-cad413dd-4473-47a6-9386-40260bb5c052 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:14:09.930168 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-3f833ccb-37ca-4771-8c15-34d5a2337581 req-cad413dd-4473-47a6-9386-40260bb5c052 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:14:09.942604 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-3f833ccb-37ca-4771-8c15-34d5a2337581 req-cad413dd-4473-47a6-9386-40260bb5c052 service nova] Creating event network-vif-unplugged:0829f91c-a8e5-4ed2-9d7c-31722b07c3ef for instance 8eb3cba5-d03f-4320-acfb-820bcec3f7a9 on nch2-master-1 Jul 23 22:14:09.948230 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [req-3f833ccb-37ca-4771-8c15-34d5a2337581 req-cad413dd-4473-47a6-9386-40260bb5c052 service nova] Instance 8eb3cba5-d03f-4320-acfb-820bcec3f7a9 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=131320) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 23 22:14:09.959563 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-3f833ccb-37ca-4771-8c15-34d5a2337581 req-cad413dd-4473-47a6-9386-40260bb5c052 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042373 Jul 23 22:14:09.960511 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3563/6173] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:14:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 22:14:10.186241 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-feecaec8-5d62-40e1-879d-9e15c508db75 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:14:10.186961 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-feecaec8-5d62-40e1-879d-9e15c508db75 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 8eb3cba5-d03f-4320-acfb-820bcec3f7a9] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:14:10.194170 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-feecaec8-5d62-40e1-879d-9e15c508db75 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:14:10.194925 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-feecaec8-5d62-40e1-879d-9e15c508db75 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:14:10.195780 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-feecaec8-5d62-40e1-879d-9e15c508db75 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:14:10.196511 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-feecaec8-5d62-40e1-879d-9e15c508db75 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:14:10.335429 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-feecaec8-5d62-40e1-879d-9e15c508db75 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:14:10.343607 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-feecaec8-5d62-40e1-879d-9e15c508db75 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/8eb3cba5-d03f-4320-acfb-820bcec3f7a9" status: 200 len: 1682 microversion: 2.1 time: 0.162800 Jul 23 22:14:10.354290 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3564/6174] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:14:10 2022] GET /compute/v2.1/servers/8eb3cba5-d03f-4320-acfb-820bcec3f7a9 => generated 1682 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:14:11.362226 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-97a2dfc8-95ff-4541-b7e1-e8126871cbb1 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:14:11.362910 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-97a2dfc8-95ff-4541-b7e1-e8126871cbb1 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 8eb3cba5-d03f-4320-acfb-820bcec3f7a9] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:14:11.370201 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-97a2dfc8-95ff-4541-b7e1-e8126871cbb1 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:14:11.370647 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-97a2dfc8-95ff-4541-b7e1-e8126871cbb1 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:14:11.371446 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-97a2dfc8-95ff-4541-b7e1-e8126871cbb1 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:14:11.372145 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-97a2dfc8-95ff-4541-b7e1-e8126871cbb1 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:14:11.511396 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-97a2dfc8-95ff-4541-b7e1-e8126871cbb1 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:14:11.519547 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-97a2dfc8-95ff-4541-b7e1-e8126871cbb1 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/8eb3cba5-d03f-4320-acfb-820bcec3f7a9" status: 200 len: 1680 microversion: 2.1 time: 0.161431 Jul 23 22:14:11.520136 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3565/6175] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:14:11 2022] GET /compute/v2.1/servers/8eb3cba5-d03f-4320-acfb-820bcec3f7a9 => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:14:11.979008 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-923a1a48-385f-4ded-8abd-7d17792eb32b req-ebf54c42-20b0-4b8d-a351-95ff39337571 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8eb3cba5-d03f-4320-acfb-820bcec3f7a9", "tag": "0829f91c-a8e5-4ed2-9d7c-31722b07c3ef"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:14:11.987794 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-923a1a48-385f-4ded-8abd-7d17792eb32b req-ebf54c42-20b0-4b8d-a351-95ff39337571 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:14:11.988253 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-923a1a48-385f-4ded-8abd-7d17792eb32b req-ebf54c42-20b0-4b8d-a351-95ff39337571 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:14:12.000248 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-923a1a48-385f-4ded-8abd-7d17792eb32b req-ebf54c42-20b0-4b8d-a351-95ff39337571 service nova] Creating event network-changed:0829f91c-a8e5-4ed2-9d7c-31722b07c3ef for instance 8eb3cba5-d03f-4320-acfb-820bcec3f7a9 on nch2-master-1 Jul 23 22:14:12.005899 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [req-923a1a48-385f-4ded-8abd-7d17792eb32b req-ebf54c42-20b0-4b8d-a351-95ff39337571 service nova] Instance 8eb3cba5-d03f-4320-acfb-820bcec3f7a9 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=131320) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 23 22:14:12.016521 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-923a1a48-385f-4ded-8abd-7d17792eb32b req-ebf54c42-20b0-4b8d-a351-95ff39337571 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043661 Jul 23 22:14:12.017110 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3566/6176] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:14:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:14:12.539277 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0b350075-b3c9-437f-abbc-13a649b188d1 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:14:12.540156 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-0b350075-b3c9-437f-abbc-13a649b188d1 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 8eb3cba5-d03f-4320-acfb-820bcec3f7a9] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:14:12.547867 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0b350075-b3c9-437f-abbc-13a649b188d1 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:14:12.548321 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0b350075-b3c9-437f-abbc-13a649b188d1 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:14:12.549110 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0b350075-b3c9-437f-abbc-13a649b188d1 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:14:12.549546 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0b350075-b3c9-437f-abbc-13a649b188d1 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:14:12.692906 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-0b350075-b3c9-437f-abbc-13a649b188d1 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:14:12.701048 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-0b350075-b3c9-437f-abbc-13a649b188d1 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/8eb3cba5-d03f-4320-acfb-820bcec3f7a9" status: 200 len: 1676 microversion: 2.1 time: 0.167357 Jul 23 22:14:12.701643 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3567/6177] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:14:12 2022] GET /compute/v2.1/servers/8eb3cba5-d03f-4320-acfb-820bcec3f7a9 => generated 1676 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:14:12.718374 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9fbb764c-16b2-4f61-8269-97ae0ad6db75 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:14:12.719084 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-9fbb764c-16b2-4f61-8269-97ae0ad6db75 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 8eb3cba5-d03f-4320-acfb-820bcec3f7a9] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:14:12.725375 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9fbb764c-16b2-4f61-8269-97ae0ad6db75 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:14:12.725921 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9fbb764c-16b2-4f61-8269-97ae0ad6db75 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:14:12.726751 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9fbb764c-16b2-4f61-8269-97ae0ad6db75 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:14:12.727280 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9fbb764c-16b2-4f61-8269-97ae0ad6db75 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:14:12.788744 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9fbb764c-16b2-4f61-8269-97ae0ad6db75 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "POST /compute/v2.1/servers/8eb3cba5-d03f-4320-acfb-820bcec3f7a9/action" status: 204 len: 0 microversion: 2.1 time: 0.074009 Jul 23 22:14:12.789700 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3568/6178] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 22:14:12 2022] POST /compute/v2.1/servers/8eb3cba5-d03f-4320-acfb-820bcec3f7a9/action => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 22:14:12.799776 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-81dcf3e6-7af2-423d-92b5-122dd87927eb tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:14:12.800583 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-81dcf3e6-7af2-423d-92b5-122dd87927eb tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 8eb3cba5-d03f-4320-acfb-820bcec3f7a9] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:14:12.807614 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-81dcf3e6-7af2-423d-92b5-122dd87927eb tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:14:12.808073 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-81dcf3e6-7af2-423d-92b5-122dd87927eb tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:14:12.808857 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-81dcf3e6-7af2-423d-92b5-122dd87927eb tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:14:12.814390 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-81dcf3e6-7af2-423d-92b5-122dd87927eb tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:14:12.950965 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-81dcf3e6-7af2-423d-92b5-122dd87927eb tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:14:12.959366 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-81dcf3e6-7af2-423d-92b5-122dd87927eb tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/8eb3cba5-d03f-4320-acfb-820bcec3f7a9" status: 200 len: 1676 microversion: 2.1 time: 0.165473 Jul 23 22:14:12.960037 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3569/6179] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:14:12 2022] GET /compute/v2.1/servers/8eb3cba5-d03f-4320-acfb-820bcec3f7a9 => generated 1676 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:14:13.980835 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-56e4e6fd-c74c-4258-aacb-8f7942bacd8a tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:14:13.981763 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-56e4e6fd-c74c-4258-aacb-8f7942bacd8a tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 8eb3cba5-d03f-4320-acfb-820bcec3f7a9] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:14:13.993714 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-56e4e6fd-c74c-4258-aacb-8f7942bacd8a tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:14:13.994441 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-56e4e6fd-c74c-4258-aacb-8f7942bacd8a tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:14:13.995669 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-56e4e6fd-c74c-4258-aacb-8f7942bacd8a tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:14:13.996088 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-56e4e6fd-c74c-4258-aacb-8f7942bacd8a tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:14:14.148616 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-56e4e6fd-c74c-4258-aacb-8f7942bacd8a tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:14:14.157180 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-56e4e6fd-c74c-4258-aacb-8f7942bacd8a tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/8eb3cba5-d03f-4320-acfb-820bcec3f7a9" status: 200 len: 1676 microversion: 2.1 time: 0.182632 Jul 23 22:14:14.157897 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3570/6180] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:14:13 2022] GET /compute/v2.1/servers/8eb3cba5-d03f-4320-acfb-820bcec3f7a9 => generated 1676 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:14:15.175160 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e7e7aa63-660e-43c9-ac55-376b98272855 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:14:15.175830 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e7e7aa63-660e-43c9-ac55-376b98272855 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 8eb3cba5-d03f-4320-acfb-820bcec3f7a9] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:14:15.185462 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e7e7aa63-660e-43c9-ac55-376b98272855 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:14:15.185919 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e7e7aa63-660e-43c9-ac55-376b98272855 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:14:15.186723 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e7e7aa63-660e-43c9-ac55-376b98272855 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:14:15.187162 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e7e7aa63-660e-43c9-ac55-376b98272855 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:14:15.331563 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e7e7aa63-660e-43c9-ac55-376b98272855 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:14:15.339716 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e7e7aa63-660e-43c9-ac55-376b98272855 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/8eb3cba5-d03f-4320-acfb-820bcec3f7a9" status: 200 len: 1655 microversion: 2.1 time: 0.168703 Jul 23 22:14:15.340313 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3571/6181] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:14:15 2022] GET /compute/v2.1/servers/8eb3cba5-d03f-4320-acfb-820bcec3f7a9 => generated 1655 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:14:15.355746 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-cd4bfed0-a5c3-4f75-b84e-b61ba00cce37 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:14:15.356313 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-cd4bfed0-a5c3-4f75-b84e-b61ba00cce37 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 8eb3cba5-d03f-4320-acfb-820bcec3f7a9] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:14:15.362474 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cd4bfed0-a5c3-4f75-b84e-b61ba00cce37 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:14:15.362920 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cd4bfed0-a5c3-4f75-b84e-b61ba00cce37 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:14:15.363681 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cd4bfed0-a5c3-4f75-b84e-b61ba00cce37 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:14:15.364114 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cd4bfed0-a5c3-4f75-b84e-b61ba00cce37 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:14:15.504374 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-cd4bfed0-a5c3-4f75-b84e-b61ba00cce37 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:14:15.515610 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-cd4bfed0-a5c3-4f75-b84e-b61ba00cce37 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/8eb3cba5-d03f-4320-acfb-820bcec3f7a9" status: 200 len: 1655 microversion: 2.1 time: 0.163380 Jul 23 22:14:15.516443 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3572/6182] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:14:15 2022] GET /compute/v2.1/servers/8eb3cba5-d03f-4320-acfb-820bcec3f7a9 => generated 1655 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:14:15.534574 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e281dd57-c7a8-45d9-a8f3-d7492fa726cd tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:14:15.540710 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e281dd57-c7a8-45d9-a8f3-d7492fa726cd tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:14:15.541168 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e281dd57-c7a8-45d9-a8f3-d7492fa726cd tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:14:15.564195 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e281dd57-c7a8-45d9-a8f3-d7492fa726cd tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 8eb3cba5-d03f-4320-acfb-820bcec3f7a9] Going to try to start instance {{(pid=131320) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 23 22:14:15.612257 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e281dd57-c7a8-45d9-a8f3-d7492fa726cd tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "POST /compute/v2.1/servers/8eb3cba5-d03f-4320-acfb-820bcec3f7a9/action" status: 202 len: 0 microversion: 2.1 time: 0.081269 Jul 23 22:14:15.612872 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3573/6183] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 22:14:15 2022] POST /compute/v2.1/servers/8eb3cba5-d03f-4320-acfb-820bcec3f7a9/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 22:14:15.621439 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6cbca3d6-a271-4705-b4b8-08aa07a24ec3 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:14:15.622257 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6cbca3d6-a271-4705-b4b8-08aa07a24ec3 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 8eb3cba5-d03f-4320-acfb-820bcec3f7a9] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:14:15.629150 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6cbca3d6-a271-4705-b4b8-08aa07a24ec3 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:14:15.629615 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6cbca3d6-a271-4705-b4b8-08aa07a24ec3 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:14:15.630483 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6cbca3d6-a271-4705-b4b8-08aa07a24ec3 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:14:15.630977 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6cbca3d6-a271-4705-b4b8-08aa07a24ec3 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:14:15.766138 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6cbca3d6-a271-4705-b4b8-08aa07a24ec3 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:14:15.773942 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6cbca3d6-a271-4705-b4b8-08aa07a24ec3 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/8eb3cba5-d03f-4320-acfb-820bcec3f7a9" status: 200 len: 1664 microversion: 2.1 time: 0.156507 Jul 23 22:14:15.774540 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3574/6184] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:14:15 2022] GET /compute/v2.1/servers/8eb3cba5-d03f-4320-acfb-820bcec3f7a9 => generated 1664 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:14:16.171671 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-0b9858a7-8f74-4380-837b-1fb1bf9f96b0 req-cb711348-ef1f-4d34-bc66-3afce7da662e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8eb3cba5-d03f-4320-acfb-820bcec3f7a9", "name": "network-vif-plugged", "status": "completed", "tag": "0829f91c-a8e5-4ed2-9d7c-31722b07c3ef"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:14:16.180808 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-0b9858a7-8f74-4380-837b-1fb1bf9f96b0 req-cb711348-ef1f-4d34-bc66-3afce7da662e service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:14:16.181398 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-0b9858a7-8f74-4380-837b-1fb1bf9f96b0 req-cb711348-ef1f-4d34-bc66-3afce7da662e service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:14:16.193808 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-0b9858a7-8f74-4380-837b-1fb1bf9f96b0 req-cb711348-ef1f-4d34-bc66-3afce7da662e service nova] Creating event network-vif-plugged:0829f91c-a8e5-4ed2-9d7c-31722b07c3ef for instance 8eb3cba5-d03f-4320-acfb-820bcec3f7a9 on nch2-master-1 Jul 23 22:14:16.198516 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-0b9858a7-8f74-4380-837b-1fb1bf9f96b0 req-cb711348-ef1f-4d34-bc66-3afce7da662e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030611 Jul 23 22:14:16.199644 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3575/6185] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:14:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 22:14:16.794040 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d1519e4b-27d4-4578-b695-419f97cbc13e tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:14:16.794957 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d1519e4b-27d4-4578-b695-419f97cbc13e tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 8eb3cba5-d03f-4320-acfb-820bcec3f7a9] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:14:16.803161 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d1519e4b-27d4-4578-b695-419f97cbc13e tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:14:16.803759 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d1519e4b-27d4-4578-b695-419f97cbc13e tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:14:16.804693 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d1519e4b-27d4-4578-b695-419f97cbc13e tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:14:16.805246 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d1519e4b-27d4-4578-b695-419f97cbc13e tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:14:16.943801 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d1519e4b-27d4-4578-b695-419f97cbc13e tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:14:16.956008 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d1519e4b-27d4-4578-b695-419f97cbc13e tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/8eb3cba5-d03f-4320-acfb-820bcec3f7a9" status: 200 len: 1668 microversion: 2.1 time: 0.167094 Jul 23 22:14:16.956813 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3576/6186] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:14:16 2022] GET /compute/v2.1/servers/8eb3cba5-d03f-4320-acfb-820bcec3f7a9 => generated 1668 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:14:16.975074 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2fc579c9-ed2d-495a-8fd7-719377d8466e tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:14:16.975574 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-2fc579c9-ed2d-495a-8fd7-719377d8466e tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 8eb3cba5-d03f-4320-acfb-820bcec3f7a9] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:14:16.981567 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2fc579c9-ed2d-495a-8fd7-719377d8466e tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:14:16.982078 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2fc579c9-ed2d-495a-8fd7-719377d8466e tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:14:16.982847 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2fc579c9-ed2d-495a-8fd7-719377d8466e tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:14:16.983292 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2fc579c9-ed2d-495a-8fd7-719377d8466e tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:14:16.985984 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:14:17.010799 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-2fc579c9-ed2d-495a-8fd7-719377d8466e tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 8eb3cba5-d03f-4320-acfb-820bcec3f7a9] Going to try to terminate instance {{(pid=131320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 22:14:17.089294 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2fc579c9-ed2d-495a-8fd7-719377d8466e tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "DELETE /compute/v2.1/servers/8eb3cba5-d03f-4320-acfb-820bcec3f7a9" status: 204 len: 0 microversion: 2.1 time: 0.117306 Jul 23 22:14:17.089734 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3577/6187] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 22:14:16 2022] DELETE /compute/v2.1/servers/8eb3cba5-d03f-4320-acfb-820bcec3f7a9 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 22:14:17.098400 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4f1d9b23-4859-4df4-9616-1e285746f168 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:14:17.099099 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-4f1d9b23-4859-4df4-9616-1e285746f168 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 8eb3cba5-d03f-4320-acfb-820bcec3f7a9] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:14:17.105076 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4f1d9b23-4859-4df4-9616-1e285746f168 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:14:17.105520 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4f1d9b23-4859-4df4-9616-1e285746f168 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:14:17.106321 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4f1d9b23-4859-4df4-9616-1e285746f168 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:14:17.106757 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4f1d9b23-4859-4df4-9616-1e285746f168 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:14:17.246111 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-4f1d9b23-4859-4df4-9616-1e285746f168 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:14:17.253922 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4f1d9b23-4859-4df4-9616-1e285746f168 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/8eb3cba5-d03f-4320-acfb-820bcec3f7a9" status: 200 len: 1674 microversion: 2.1 time: 0.159679 Jul 23 22:14:17.256540 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3578/6188] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:14:17 2022] GET /compute/v2.1/servers/8eb3cba5-d03f-4320-acfb-820bcec3f7a9 => generated 1674 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:14:18.275370 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-77ebde33-4d60-4445-ade2-0d7513fb1201 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:14:18.276279 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-77ebde33-4d60-4445-ade2-0d7513fb1201 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 8eb3cba5-d03f-4320-acfb-820bcec3f7a9] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:14:18.284187 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-77ebde33-4d60-4445-ade2-0d7513fb1201 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:14:18.284644 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-77ebde33-4d60-4445-ade2-0d7513fb1201 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:14:18.285417 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-77ebde33-4d60-4445-ade2-0d7513fb1201 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:14:18.285841 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-77ebde33-4d60-4445-ade2-0d7513fb1201 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:14:18.420904 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-77ebde33-4d60-4445-ade2-0d7513fb1201 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:14:18.429348 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-77ebde33-4d60-4445-ade2-0d7513fb1201 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/8eb3cba5-d03f-4320-acfb-820bcec3f7a9" status: 200 len: 1674 microversion: 2.1 time: 0.159602 Jul 23 22:14:18.429964 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3579/6189] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:14:18 2022] GET /compute/v2.1/servers/8eb3cba5-d03f-4320-acfb-820bcec3f7a9 => generated 1674 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:14:19.447145 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-401dcb4b-e6c1-4af8-8023-9e76ece2a44f tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:14:19.448441 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-401dcb4b-e6c1-4af8-8023-9e76ece2a44f tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 8eb3cba5-d03f-4320-acfb-820bcec3f7a9] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:14:19.455866 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-401dcb4b-e6c1-4af8-8023-9e76ece2a44f tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:14:19.456462 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-401dcb4b-e6c1-4af8-8023-9e76ece2a44f tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:14:19.457258 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-401dcb4b-e6c1-4af8-8023-9e76ece2a44f tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:14:19.457692 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-401dcb4b-e6c1-4af8-8023-9e76ece2a44f tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:14:19.524261 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-401dcb4b-e6c1-4af8-8023-9e76ece2a44f tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:14:19.532226 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-401dcb4b-e6c1-4af8-8023-9e76ece2a44f tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/8eb3cba5-d03f-4320-acfb-820bcec3f7a9" status: 200 len: 1606 microversion: 2.1 time: 0.089211 Jul 23 22:14:19.534015 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3580/6190] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:14:19 2022] GET /compute/v2.1/servers/8eb3cba5-d03f-4320-acfb-820bcec3f7a9 => generated 1606 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:14:19.538601 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-539cc9ac-d964-4fa2-856f-3a4980dc5939 req-3f60301c-e696-422b-bf01-2f685b5fadc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8eb3cba5-d03f-4320-acfb-820bcec3f7a9", "name": "network-vif-deleted", "tag": "0829f91c-a8e5-4ed2-9d7c-31722b07c3ef"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:14:19.546601 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-539cc9ac-d964-4fa2-856f-3a4980dc5939 req-3f60301c-e696-422b-bf01-2f685b5fadc6 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:14:19.547049 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-539cc9ac-d964-4fa2-856f-3a4980dc5939 req-3f60301c-e696-422b-bf01-2f685b5fadc6 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:14:19.559149 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-539cc9ac-d964-4fa2-856f-3a4980dc5939 req-3f60301c-e696-422b-bf01-2f685b5fadc6 service nova] Creating event network-vif-deleted:0829f91c-a8e5-4ed2-9d7c-31722b07c3ef for instance 8eb3cba5-d03f-4320-acfb-820bcec3f7a9 on nch2-master-1 Jul 23 22:14:19.564080 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-539cc9ac-d964-4fa2-856f-3a4980dc5939 req-3f60301c-e696-422b-bf01-2f685b5fadc6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028950 Jul 23 22:14:19.565051 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3581/6191] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:14:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:14:20.551598 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c75d44be-8f80-4092-8cc6-00a5c48127d4 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:14:20.552307 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c75d44be-8f80-4092-8cc6-00a5c48127d4 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 8eb3cba5-d03f-4320-acfb-820bcec3f7a9] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:14:20.558860 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c75d44be-8f80-4092-8cc6-00a5c48127d4 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:14:20.559438 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c75d44be-8f80-4092-8cc6-00a5c48127d4 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:14:20.560206 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c75d44be-8f80-4092-8cc6-00a5c48127d4 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:14:20.560640 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c75d44be-8f80-4092-8cc6-00a5c48127d4 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:14:20.574183 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-c75d44be-8f80-4092-8cc6-00a5c48127d4 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] HTTP exception thrown: Instance 8eb3cba5-d03f-4320-acfb-820bcec3f7a9 could not be found. Jul 23 22:14:20.575806 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c75d44be-8f80-4092-8cc6-00a5c48127d4 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Request method failure captured: Jul 23 22:14:20.575806 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/8eb3cba5-d03f-4320-acfb-820bcec3f7a9 HTTP/1.1 Jul 23 22:14:20.575806 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 22:14:20.575806 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 22:14:20.575806 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 22:14:20.575806 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 22:14:20.575806 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 22:14:20.575806 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 22:14:20.575806 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 22:14:20.575806 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 22:14:20.575806 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3HIoewFR0SqpqLrj5I-sN7pNyjXsXXtQLkybI9vB6YsXdCaJ6oH3gw_3sQK2MiiJxU-U9GJtkTNRyRtiyWB74IsJErQO0QMayat2E8l_KlQxoCwZvuOOv2BFlgI59GiCbRO0itRDUcJc1lBv1Mjh_3cnjoEC2YbTi0_IAE5AJlU7TS0 Jul 23 22:14:20.575806 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 22:14:20.575806 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 22:14:20.575806 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 22:14:20.575806 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 22:14:20.575806 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 22:14:20.575806 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 22:14:20.575806 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 5ca8bc0082894aa6b90a714ddc6a6790 Jul 23 22:14:20.575806 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServerActionsTestJSON-1436267344 Jul 23 22:14:20.575806 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 22:14:20.575806 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 22:14:20.575806 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5ca8bc0082894aa6b90a714ddc6a6790"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5ca8bc0082894aa6b90a714ddc6a6790"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_5ca8bc0082894aa6b90a714ddc6a6790", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/5ca8bc0082894aa6b90a714ddc6a6790"}]}] Jul 23 22:14:20.575806 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServerActionsTestJSON-1436267344 Jul 23 22:14:20.575806 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 5ca8bc0082894aa6b90a714ddc6a6790 Jul 23 22:14:20.575806 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServerActionsTestJSON-1436267344 Jul 23 22:14:20.575806 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServerActionsTestJSON-1436267344-project Jul 23 22:14:20.575806 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 22:14:20.575806 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 22:14:20.575806 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 14820436f99c404b80194a1b985c76b1 Jul 23 22:14:20.575806 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServerActionsTestJSON-1436267344-project Jul 23 22:14:20.575806 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 22:14:20.575806 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance 8eb3cba5-d03f-4320-acfb-820bcec3f7a9 could not be found. Jul 23 22:14:20.575806 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '8eb3cba5-d03f-4320-acfb-820bcec3f7a9'} Jul 23 22:14:20.575806 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 22:14:20.575806 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:14:20.575806 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 22:14:20.575806 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 22:14:20.575806 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 22:14:20.575806 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 22:14:20.575806 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 22:14:20.575806 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 22:14:20.575806 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 22:14:20.575806 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 22:14:20.575806 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8eb3cba5-d03f-4320-acfb-820bcec3f7a9 could not be found. Jul 23 22:14:20.575806 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:14:20.575806 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:14:20.575806 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:14:20.575806 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:14:20.575806 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:14:20.575806 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:14:20.575806 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 22:14:20.575806 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 22:14:20.575806 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 22:14:20.575806 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 22:14:20.575806 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 22:14:20.575806 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 22:14:20.575806 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 22:14:20.575806 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 22:14:20.575806 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 22:14:20.575806 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 22:14:20.575806 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8eb3cba5-d03f-4320-acfb-820bcec3f7a9 could not be found. Jul 23 22:14:20.575806 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:14:20.575806 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:14:20.575806 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:14:20.580156 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:14:20.580156 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:14:20.580156 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:14:20.580156 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 22:14:20.580156 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 22:14:20.580156 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8eb3cba5-d03f-4320-acfb-820bcec3f7a9 could not be found. Jul 23 22:14:20.580156 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:14:20.580156 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c75d44be-8f80-4092-8cc6-00a5c48127d4 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Returning 404 to user: Instance 8eb3cba5-d03f-4320-acfb-820bcec3f7a9 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 22:14:20.580156 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c75d44be-8f80-4092-8cc6-00a5c48127d4 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/8eb3cba5-d03f-4320-acfb-820bcec3f7a9" status: 404 len: 111 microversion: 2.1 time: 0.031013 Jul 23 22:14:20.580156 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3582/6192] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:14:20 2022] GET /compute/v2.1/servers/8eb3cba5-d03f-4320-acfb-820bcec3f7a9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 22:14:20.593505 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-eda5182c-7887-471b-ad50-455ca13d9c35 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:14:20.594136 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-eda5182c-7887-471b-ad50-455ca13d9c35 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 8eb3cba5-d03f-4320-acfb-820bcec3f7a9] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:14:20.600032 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-eda5182c-7887-471b-ad50-455ca13d9c35 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:14:20.600481 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-eda5182c-7887-471b-ad50-455ca13d9c35 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:14:20.601232 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-eda5182c-7887-471b-ad50-455ca13d9c35 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:14:20.601672 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-eda5182c-7887-471b-ad50-455ca13d9c35 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:14:20.615263 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-eda5182c-7887-471b-ad50-455ca13d9c35 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] HTTP exception thrown: Instance 8eb3cba5-d03f-4320-acfb-820bcec3f7a9 could not be found. Jul 23 22:14:20.616774 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-eda5182c-7887-471b-ad50-455ca13d9c35 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Request method failure captured: Jul 23 22:14:20.616774 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/8eb3cba5-d03f-4320-acfb-820bcec3f7a9 HTTP/1.1 Jul 23 22:14:20.616774 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 22:14:20.616774 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 22:14:20.616774 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 22:14:20.616774 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 22:14:20.616774 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 22:14:20.616774 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 22:14:20.616774 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 22:14:20.616774 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 22:14:20.616774 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3HIoewFR0SqpqLrj5I-sN7pNyjXsXXtQLkybI9vB6YsXdCaJ6oH3gw_3sQK2MiiJxU-U9GJtkTNRyRtiyWB74IsJErQO0QMayat2E8l_KlQxoCwZvuOOv2BFlgI59GiCbRO0itRDUcJc1lBv1Mjh_3cnjoEC2YbTi0_IAE5AJlU7TS0 Jul 23 22:14:20.616774 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 22:14:20.616774 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 22:14:20.616774 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 22:14:20.616774 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 22:14:20.616774 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 22:14:20.616774 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 22:14:20.616774 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 5ca8bc0082894aa6b90a714ddc6a6790 Jul 23 22:14:20.616774 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServerActionsTestJSON-1436267344 Jul 23 22:14:20.616774 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 22:14:20.616774 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 22:14:20.616774 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5ca8bc0082894aa6b90a714ddc6a6790"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5ca8bc0082894aa6b90a714ddc6a6790"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_5ca8bc0082894aa6b90a714ddc6a6790", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/5ca8bc0082894aa6b90a714ddc6a6790"}]}] Jul 23 22:14:20.616774 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServerActionsTestJSON-1436267344 Jul 23 22:14:20.616774 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 5ca8bc0082894aa6b90a714ddc6a6790 Jul 23 22:14:20.616774 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServerActionsTestJSON-1436267344 Jul 23 22:14:20.616774 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServerActionsTestJSON-1436267344-project Jul 23 22:14:20.616774 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 22:14:20.616774 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 22:14:20.616774 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 14820436f99c404b80194a1b985c76b1 Jul 23 22:14:20.616774 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServerActionsTestJSON-1436267344-project Jul 23 22:14:20.616774 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 22:14:20.616774 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance 8eb3cba5-d03f-4320-acfb-820bcec3f7a9 could not be found. Jul 23 22:14:20.616774 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '8eb3cba5-d03f-4320-acfb-820bcec3f7a9'} Jul 23 22:14:20.616774 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 22:14:20.616774 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:14:20.616774 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 22:14:20.616774 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 22:14:20.616774 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 22:14:20.616774 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 22:14:20.616774 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 22:14:20.616774 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 22:14:20.616774 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 22:14:20.616774 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 22:14:20.616774 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8eb3cba5-d03f-4320-acfb-820bcec3f7a9 could not be found. Jul 23 22:14:20.616774 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:14:20.616774 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:14:20.616774 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:14:20.616774 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:14:20.616774 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:14:20.616774 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:14:20.616774 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 22:14:20.616774 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 22:14:20.616774 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 22:14:20.616774 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 22:14:20.616774 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 22:14:20.616774 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 22:14:20.616774 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 22:14:20.616774 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 22:14:20.616774 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 22:14:20.616774 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 22:14:20.616774 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8eb3cba5-d03f-4320-acfb-820bcec3f7a9 could not be found. Jul 23 22:14:20.616774 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:14:20.616774 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:14:20.616774 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:14:20.620590 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:14:20.620590 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:14:20.620590 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:14:20.620590 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 22:14:20.620590 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 22:14:20.620590 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8eb3cba5-d03f-4320-acfb-820bcec3f7a9 could not be found. Jul 23 22:14:20.620590 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:14:20.620590 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-eda5182c-7887-471b-ad50-455ca13d9c35 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Returning 404 to user: Instance 8eb3cba5-d03f-4320-acfb-820bcec3f7a9 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 22:14:20.620590 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-eda5182c-7887-471b-ad50-455ca13d9c35 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/8eb3cba5-d03f-4320-acfb-820bcec3f7a9" status: 404 len: 111 microversion: 2.1 time: 0.028383 Jul 23 22:14:20.620590 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3583/6193] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:14:20 2022] GET /compute/v2.1/servers/8eb3cba5-d03f-4320-acfb-820bcec3f7a9 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 23 22:14:20.667520 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2c9b1c2b-8598-499e-8327-3e6906feee89 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2015733667", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "networks": [{"uuid": "710bdc98-a85f-4879-a272-9349d503f3f7"}], "security_groups": [{"name": "tempest-securitygroup--2070004119"}], "key_name": "tempest-keypair-1953727802", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:14:20.777000 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-2c9b1c2b-8598-499e-8327-3e6906feee89 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] validate_networks() for [('710bdc98-a85f-4879-a272-9349d503f3f7', None, None, None, None, None)] {{(pid=131320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 22:14:21.158076 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-2c9b1c2b-8598-499e-8327-3e6906feee89 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 22:14:21.158748 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-2c9b1c2b-8598-499e-8327-3e6906feee89 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 22:14:21.159542 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-2c9b1c2b-8598-499e-8327-3e6906feee89 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 22:14:21.160196 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-2c9b1c2b-8598-499e-8327-3e6906feee89 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 22:14:21.160799 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-2c9b1c2b-8598-499e-8327-3e6906feee89 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 22:14:21.175440 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2c9b1c2b-8598-499e-8327-3e6906feee89 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:14:21.176135 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2c9b1c2b-8598-499e-8327-3e6906feee89 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:14:21.177320 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2c9b1c2b-8598-499e-8327-3e6906feee89 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:14:21.177935 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2c9b1c2b-8598-499e-8327-3e6906feee89 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:14:21.198532 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-2c9b1c2b-8598-499e-8327-3e6906feee89 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Getting quotas for project 5ca8bc0082894aa6b90a714ddc6a6790. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 22:14:21.204566 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-2c9b1c2b-8598-499e-8327-3e6906feee89 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Getting quotas for user 14820436f99c404b80194a1b985c76b1 and project 5ca8bc0082894aa6b90a714ddc6a6790. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 22:14:21.218201 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-2c9b1c2b-8598-499e-8327-3e6906feee89 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Going to run 1 instances... {{(pid=131320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 22:14:21.220532 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-2c9b1c2b-8598-499e-8327-3e6906feee89 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 753bfb35-eedb-435a-bf77-0eb788089251] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 22:14:21.231845 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:14:21.268438 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2c9b1c2b-8598-499e-8327-3e6906feee89 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.604844 Jul 23 22:14:21.269087 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3584/6194] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 22:14:20 2022] POST /compute/v2.1/servers => generated 406 bytes in 606 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 23 22:14:21.279191 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ed3cb731-0b09-469d-8c82-36df4ec35e8e tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:14:21.279799 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ed3cb731-0b09-469d-8c82-36df4ec35e8e tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 753bfb35-eedb-435a-bf77-0eb788089251] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:14:21.336852 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ed3cb731-0b09-469d-8c82-36df4ec35e8e tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:14:21.343758 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ed3cb731-0b09-469d-8c82-36df4ec35e8e tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/753bfb35-eedb-435a-bf77-0eb788089251" status: 200 len: 1239 microversion: 2.1 time: 0.068553 Jul 23 22:14:21.344680 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3585/6195] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:14:21 2022] GET /compute/v2.1/servers/753bfb35-eedb-435a-bf77-0eb788089251 => generated 1239 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:14:22.361688 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9e2ac84b-b834-490c-8fbe-3be8a7b75833 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:14:22.362452 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-9e2ac84b-b834-490c-8fbe-3be8a7b75833 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 753bfb35-eedb-435a-bf77-0eb788089251] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:14:22.371125 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9e2ac84b-b834-490c-8fbe-3be8a7b75833 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:14:22.371587 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9e2ac84b-b834-490c-8fbe-3be8a7b75833 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:14:22.372372 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9e2ac84b-b834-490c-8fbe-3be8a7b75833 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:14:22.373036 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9e2ac84b-b834-490c-8fbe-3be8a7b75833 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:14:22.437081 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-9e2ac84b-b834-490c-8fbe-3be8a7b75833 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:14:22.444765 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9e2ac84b-b834-490c-8fbe-3be8a7b75833 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/753bfb35-eedb-435a-bf77-0eb788089251" status: 200 len: 1309 microversion: 2.1 time: 0.087352 Jul 23 22:14:22.445564 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3586/6196] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:14:22 2022] GET /compute/v2.1/servers/753bfb35-eedb-435a-bf77-0eb788089251 => generated 1309 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:14:23.463545 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d7d68f38-53f1-4992-9a2c-6730aeef6093 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:14:23.464167 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d7d68f38-53f1-4992-9a2c-6730aeef6093 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 753bfb35-eedb-435a-bf77-0eb788089251] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:14:23.472368 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d7d68f38-53f1-4992-9a2c-6730aeef6093 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:14:23.473023 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d7d68f38-53f1-4992-9a2c-6730aeef6093 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:14:23.473815 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d7d68f38-53f1-4992-9a2c-6730aeef6093 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:14:23.474282 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d7d68f38-53f1-4992-9a2c-6730aeef6093 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:14:23.625123 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d7d68f38-53f1-4992-9a2c-6730aeef6093 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:14:23.633447 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d7d68f38-53f1-4992-9a2c-6730aeef6093 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/753bfb35-eedb-435a-bf77-0eb788089251" status: 200 len: 1365 microversion: 2.1 time: 0.174638 Jul 23 22:14:23.634175 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3587/6197] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:14:23 2022] GET /compute/v2.1/servers/753bfb35-eedb-435a-bf77-0eb788089251 => generated 1365 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:14:23.750159 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-2e192aeb-f65f-441e-ab88-b9b569869e04 req-81b0a209-0a5f-43ef-b99c-8ba76c2243b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "753bfb35-eedb-435a-bf77-0eb788089251", "tag": "14cfbd5f-56ab-475f-8368-0ba584b79574"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:14:23.758365 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-2e192aeb-f65f-441e-ab88-b9b569869e04 req-81b0a209-0a5f-43ef-b99c-8ba76c2243b9 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:14:23.758800 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-2e192aeb-f65f-441e-ab88-b9b569869e04 req-81b0a209-0a5f-43ef-b99c-8ba76c2243b9 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:14:23.772444 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-2e192aeb-f65f-441e-ab88-b9b569869e04 req-81b0a209-0a5f-43ef-b99c-8ba76c2243b9 service nova] Creating event network-changed:14cfbd5f-56ab-475f-8368-0ba584b79574 for instance 753bfb35-eedb-435a-bf77-0eb788089251 on nch1-master-1 Jul 23 22:14:23.789321 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-2e192aeb-f65f-441e-ab88-b9b569869e04 req-81b0a209-0a5f-43ef-b99c-8ba76c2243b9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042643 Jul 23 22:14:23.789985 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3588/6198] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:14:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:14:24.658638 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5f03fa6c-0329-4a80-901b-b816e6a9e024 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:14:24.659756 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5f03fa6c-0329-4a80-901b-b816e6a9e024 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 753bfb35-eedb-435a-bf77-0eb788089251] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:14:24.670938 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5f03fa6c-0329-4a80-901b-b816e6a9e024 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:14:24.671813 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5f03fa6c-0329-4a80-901b-b816e6a9e024 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:14:24.672614 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5f03fa6c-0329-4a80-901b-b816e6a9e024 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:14:24.673064 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5f03fa6c-0329-4a80-901b-b816e6a9e024 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:14:24.816328 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5f03fa6c-0329-4a80-901b-b816e6a9e024 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:14:24.824383 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5f03fa6c-0329-4a80-901b-b816e6a9e024 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/753bfb35-eedb-435a-bf77-0eb788089251" status: 200 len: 1365 microversion: 2.1 time: 0.174587 Jul 23 22:14:24.824977 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3589/6199] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:14:24 2022] GET /compute/v2.1/servers/753bfb35-eedb-435a-bf77-0eb788089251 => generated 1365 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:14:25.843124 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4e961d38-c7be-4a2a-a936-4becd6e3ed01 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:14:25.843836 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-4e961d38-c7be-4a2a-a936-4becd6e3ed01 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 753bfb35-eedb-435a-bf77-0eb788089251] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:14:25.851237 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4e961d38-c7be-4a2a-a936-4becd6e3ed01 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:14:25.851695 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4e961d38-c7be-4a2a-a936-4becd6e3ed01 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:14:25.852467 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4e961d38-c7be-4a2a-a936-4becd6e3ed01 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:14:25.852908 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4e961d38-c7be-4a2a-a936-4becd6e3ed01 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:14:26.000236 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-4e961d38-c7be-4a2a-a936-4becd6e3ed01 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:14:26.008255 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4e961d38-c7be-4a2a-a936-4becd6e3ed01 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/753bfb35-eedb-435a-bf77-0eb788089251" status: 200 len: 1365 microversion: 2.1 time: 0.169178 Jul 23 22:14:26.008846 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3590/6200] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:14:25 2022] GET /compute/v2.1/servers/753bfb35-eedb-435a-bf77-0eb788089251 => generated 1365 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:14:27.028736 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-7e215f5c-bad0-4c25-8229-a7b5bb8cdca4 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:14:27.029450 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-7e215f5c-bad0-4c25-8229-a7b5bb8cdca4 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 753bfb35-eedb-435a-bf77-0eb788089251] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:14:27.037036 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7e215f5c-bad0-4c25-8229-a7b5bb8cdca4 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:14:27.037490 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7e215f5c-bad0-4c25-8229-a7b5bb8cdca4 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:14:27.038326 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7e215f5c-bad0-4c25-8229-a7b5bb8cdca4 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:14:27.038763 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7e215f5c-bad0-4c25-8229-a7b5bb8cdca4 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:14:27.190141 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-7e215f5c-bad0-4c25-8229-a7b5bb8cdca4 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:14:27.197583 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-7e215f5c-bad0-4c25-8229-a7b5bb8cdca4 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/753bfb35-eedb-435a-bf77-0eb788089251" status: 200 len: 1365 microversion: 2.1 time: 0.172952 Jul 23 22:14:27.198236 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3591/6201] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:14:27 2022] GET /compute/v2.1/servers/753bfb35-eedb-435a-bf77-0eb788089251 => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:14:28.219528 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4c156cfe-c812-41f4-887a-401e81e99bf2 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:14:28.220522 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-4c156cfe-c812-41f4-887a-401e81e99bf2 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 753bfb35-eedb-435a-bf77-0eb788089251] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:14:28.232179 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4c156cfe-c812-41f4-887a-401e81e99bf2 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:14:28.232932 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4c156cfe-c812-41f4-887a-401e81e99bf2 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:14:28.234441 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4c156cfe-c812-41f4-887a-401e81e99bf2 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:14:28.234902 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4c156cfe-c812-41f4-887a-401e81e99bf2 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:14:28.375043 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-4c156cfe-c812-41f4-887a-401e81e99bf2 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:14:28.382732 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4c156cfe-c812-41f4-887a-401e81e99bf2 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/753bfb35-eedb-435a-bf77-0eb788089251" status: 200 len: 1365 microversion: 2.1 time: 0.169908 Jul 23 22:14:28.383314 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3592/6202] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:14:28 2022] GET /compute/v2.1/servers/753bfb35-eedb-435a-bf77-0eb788089251 => generated 1365 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:14:28.645693 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-b8e44025-edc8-464c-8cbc-bd3e83715da1 req-a9ef5d71-8279-48a2-a057-d4b9d5b6de7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "753bfb35-eedb-435a-bf77-0eb788089251", "name": "network-vif-plugged", "status": "completed", "tag": "14cfbd5f-56ab-475f-8368-0ba584b79574"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:14:28.654412 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-b8e44025-edc8-464c-8cbc-bd3e83715da1 req-a9ef5d71-8279-48a2-a057-d4b9d5b6de7d service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:14:28.654878 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-b8e44025-edc8-464c-8cbc-bd3e83715da1 req-a9ef5d71-8279-48a2-a057-d4b9d5b6de7d service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:14:28.667220 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-b8e44025-edc8-464c-8cbc-bd3e83715da1 req-a9ef5d71-8279-48a2-a057-d4b9d5b6de7d service nova] Creating event network-vif-plugged:14cfbd5f-56ab-475f-8368-0ba584b79574 for instance 753bfb35-eedb-435a-bf77-0eb788089251 on nch1-master-1 Jul 23 22:14:28.672002 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-b8e44025-edc8-464c-8cbc-bd3e83715da1 req-a9ef5d71-8279-48a2-a057-d4b9d5b6de7d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030180 Jul 23 22:14:28.672885 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3593/6203] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:14:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 22:14:29.406666 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6346fc72-8c29-4513-89b1-940c1784aa38 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:14:29.407372 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6346fc72-8c29-4513-89b1-940c1784aa38 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 753bfb35-eedb-435a-bf77-0eb788089251] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:14:29.414628 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6346fc72-8c29-4513-89b1-940c1784aa38 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:14:29.415080 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6346fc72-8c29-4513-89b1-940c1784aa38 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:14:29.415874 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6346fc72-8c29-4513-89b1-940c1784aa38 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:14:29.416316 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6346fc72-8c29-4513-89b1-940c1784aa38 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:14:29.560797 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6346fc72-8c29-4513-89b1-940c1784aa38 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:14:29.569636 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6346fc72-8c29-4513-89b1-940c1784aa38 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/753bfb35-eedb-435a-bf77-0eb788089251" status: 200 len: 1365 microversion: 2.1 time: 0.171333 Jul 23 22:14:29.570266 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3594/6204] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:14:29 2022] GET /compute/v2.1/servers/753bfb35-eedb-435a-bf77-0eb788089251 => generated 1365 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:14:30.588212 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8bcef731-2565-4c68-bf4a-6b469a87e8e8 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:14:30.588912 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8bcef731-2565-4c68-bf4a-6b469a87e8e8 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 753bfb35-eedb-435a-bf77-0eb788089251] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:14:30.596518 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8bcef731-2565-4c68-bf4a-6b469a87e8e8 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:14:30.596961 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8bcef731-2565-4c68-bf4a-6b469a87e8e8 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:14:30.597724 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8bcef731-2565-4c68-bf4a-6b469a87e8e8 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:14:30.598212 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8bcef731-2565-4c68-bf4a-6b469a87e8e8 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:14:30.730557 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8bcef731-2565-4c68-bf4a-6b469a87e8e8 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:14:30.738434 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8bcef731-2565-4c68-bf4a-6b469a87e8e8 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/753bfb35-eedb-435a-bf77-0eb788089251" status: 200 len: 1551 microversion: 2.1 time: 0.154234 Jul 23 22:14:30.739014 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3595/6205] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:14:30 2022] GET /compute/v2.1/servers/753bfb35-eedb-435a-bf77-0eb788089251 => generated 1551 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:14:30.762898 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-589bfc11-fd44-4bcb-a9d8-a8aa4116b50f tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:14:30.763394 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-589bfc11-fd44-4bcb-a9d8-a8aa4116b50f tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 753bfb35-eedb-435a-bf77-0eb788089251] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:14:30.769803 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-589bfc11-fd44-4bcb-a9d8-a8aa4116b50f tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:14:30.770304 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-589bfc11-fd44-4bcb-a9d8-a8aa4116b50f tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:14:30.771061 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-589bfc11-fd44-4bcb-a9d8-a8aa4116b50f tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:14:30.771502 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-589bfc11-fd44-4bcb-a9d8-a8aa4116b50f tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:14:30.856990 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-589bfc11-fd44-4bcb-a9d8-a8aa4116b50f tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/753bfb35-eedb-435a-bf77-0eb788089251/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099608 Jul 23 22:14:30.857614 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3596/6206] 10.222.0.17 () {58 vars in 1274 bytes} [Sat Jul 23 22:14:30 2022] GET /compute/v2.1/servers/753bfb35-eedb-435a-bf77-0eb788089251/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 22:14:31.821647 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:14:31.823939 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=8 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:14:31.830275 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-8379a487-460d-4a09-aa57-eb76a90a729d req-fc0139d1-8002-4177-baca-4b88dd17970d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "753bfb35-eedb-435a-bf77-0eb788089251", "tag": "14cfbd5f-56ab-475f-8368-0ba584b79574"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:14:31.839409 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-8379a487-460d-4a09-aa57-eb76a90a729d req-fc0139d1-8002-4177-baca-4b88dd17970d service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:14:31.839888 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-8379a487-460d-4a09-aa57-eb76a90a729d req-fc0139d1-8002-4177-baca-4b88dd17970d service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:14:31.851397 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-8379a487-460d-4a09-aa57-eb76a90a729d req-fc0139d1-8002-4177-baca-4b88dd17970d service nova] Creating event network-changed:14cfbd5f-56ab-475f-8368-0ba584b79574 for instance 753bfb35-eedb-435a-bf77-0eb788089251 on nch1-master-1 Jul 23 22:14:31.856366 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-8379a487-460d-4a09-aa57-eb76a90a729d req-fc0139d1-8002-4177-baca-4b88dd17970d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035432 Jul 23 22:14:31.856959 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3597/6207] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:14:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:15:04.727265 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=28 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:15:04.728604 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:15:04.736039 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-93ccd88d-a832-4aae-9e0c-f4fff6a93cb8 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:15:04.737924 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-93ccd88d-a832-4aae-9e0c-f4fff6a93cb8 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 753bfb35-eedb-435a-bf77-0eb788089251] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:15:04.756027 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-93ccd88d-a832-4aae-9e0c-f4fff6a93cb8 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:04.756488 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-93ccd88d-a832-4aae-9e0c-f4fff6a93cb8 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:04.757273 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-93ccd88d-a832-4aae-9e0c-f4fff6a93cb8 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:04.757721 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-93ccd88d-a832-4aae-9e0c-f4fff6a93cb8 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:04.787869 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-93ccd88d-a832-4aae-9e0c-f4fff6a93cb8 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:15:04.794092 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-93ccd88d-a832-4aae-9e0c-f4fff6a93cb8 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 753bfb35-eedb-435a-bf77-0eb788089251] Old instance type m1.heat2, new instance type m1.heat {{(pid=131320) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 23 22:15:04.800659 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-93ccd88d-a832-4aae-9e0c-f4fff6a93cb8 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 22:15:04.801150 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-93ccd88d-a832-4aae-9e0c-f4fff6a93cb8 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 22:15:04.801638 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-93ccd88d-a832-4aae-9e0c-f4fff6a93cb8 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 22:15:04.802102 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-93ccd88d-a832-4aae-9e0c-f4fff6a93cb8 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 22:15:04.802527 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-93ccd88d-a832-4aae-9e0c-f4fff6a93cb8 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 22:15:04.874355 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-93ccd88d-a832-4aae-9e0c-f4fff6a93cb8 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "POST /compute/v2.1/servers/753bfb35-eedb-435a-bf77-0eb788089251/action" status: 202 len: 0 microversion: 2.1 time: 0.150810 Jul 23 22:15:04.874998 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3598/6208] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 22:15:04 2022] POST /compute/v2.1/servers/753bfb35-eedb-435a-bf77-0eb788089251/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 22:15:04.883245 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-eac73966-b5b7-4cbf-8db6-819a6aea2095 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:15:04.883865 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-eac73966-b5b7-4cbf-8db6-819a6aea2095 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 753bfb35-eedb-435a-bf77-0eb788089251] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:15:04.890255 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-eac73966-b5b7-4cbf-8db6-819a6aea2095 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:04.890712 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-eac73966-b5b7-4cbf-8db6-819a6aea2095 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:04.891527 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-eac73966-b5b7-4cbf-8db6-819a6aea2095 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:04.891968 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-eac73966-b5b7-4cbf-8db6-819a6aea2095 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:05.052418 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-eac73966-b5b7-4cbf-8db6-819a6aea2095 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:15:05.060547 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-eac73966-b5b7-4cbf-8db6-819a6aea2095 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/753bfb35-eedb-435a-bf77-0eb788089251" status: 200 len: 1678 microversion: 2.1 time: 0.181323 Jul 23 22:15:05.061151 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3599/6209] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:15:04 2022] GET /compute/v2.1/servers/753bfb35-eedb-435a-bf77-0eb788089251 => generated 1678 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:15:06.081420 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8cdebbc9-216b-43f1-890e-514060267c5f tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:15:06.082162 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8cdebbc9-216b-43f1-890e-514060267c5f tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 753bfb35-eedb-435a-bf77-0eb788089251] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:15:06.090063 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8cdebbc9-216b-43f1-890e-514060267c5f tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:06.090570 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8cdebbc9-216b-43f1-890e-514060267c5f tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:06.091431 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8cdebbc9-216b-43f1-890e-514060267c5f tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:06.091933 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8cdebbc9-216b-43f1-890e-514060267c5f tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:06.231623 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8cdebbc9-216b-43f1-890e-514060267c5f tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:15:06.239675 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8cdebbc9-216b-43f1-890e-514060267c5f tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/753bfb35-eedb-435a-bf77-0eb788089251" status: 200 len: 1678 microversion: 2.1 time: 0.163265 Jul 23 22:15:06.240264 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3600/6210] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:15:06 2022] GET /compute/v2.1/servers/753bfb35-eedb-435a-bf77-0eb788089251 => generated 1678 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:15:07.261668 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-17e36e69-f55d-4434-ac5e-b48a4d5d873f tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:15:07.262768 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-17e36e69-f55d-4434-ac5e-b48a4d5d873f tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 753bfb35-eedb-435a-bf77-0eb788089251] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:15:07.273400 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-17e36e69-f55d-4434-ac5e-b48a4d5d873f tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:07.273834 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-17e36e69-f55d-4434-ac5e-b48a4d5d873f tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:07.274642 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-17e36e69-f55d-4434-ac5e-b48a4d5d873f tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:07.275090 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-17e36e69-f55d-4434-ac5e-b48a4d5d873f tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:07.420955 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-17e36e69-f55d-4434-ac5e-b48a4d5d873f tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:15:07.428913 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-17e36e69-f55d-4434-ac5e-b48a4d5d873f tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/753bfb35-eedb-435a-bf77-0eb788089251" status: 200 len: 1683 microversion: 2.1 time: 0.173969 Jul 23 22:15:07.429530 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3601/6211] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:15:07 2022] GET /compute/v2.1/servers/753bfb35-eedb-435a-bf77-0eb788089251 => generated 1683 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:15:08.449095 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-43ebcb8c-1d7f-49c5-ab83-b53340f39a9d tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:15:08.450003 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-43ebcb8c-1d7f-49c5-ab83-b53340f39a9d tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 753bfb35-eedb-435a-bf77-0eb788089251] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:15:08.459856 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-43ebcb8c-1d7f-49c5-ab83-b53340f39a9d tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:08.460467 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-43ebcb8c-1d7f-49c5-ab83-b53340f39a9d tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:08.461508 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-43ebcb8c-1d7f-49c5-ab83-b53340f39a9d tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:08.462158 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-43ebcb8c-1d7f-49c5-ab83-b53340f39a9d tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:08.597295 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-43ebcb8c-1d7f-49c5-ab83-b53340f39a9d tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:15:08.606069 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-43ebcb8c-1d7f-49c5-ab83-b53340f39a9d tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/753bfb35-eedb-435a-bf77-0eb788089251" status: 200 len: 1683 microversion: 2.1 time: 0.162466 Jul 23 22:15:08.607077 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3602/6212] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:15:08 2022] GET /compute/v2.1/servers/753bfb35-eedb-435a-bf77-0eb788089251 => generated 1683 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:15:09.631676 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a2e3e6ec-ffd3-455d-b10b-a2fd5e5bc536 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:15:09.632745 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a2e3e6ec-ffd3-455d-b10b-a2fd5e5bc536 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 753bfb35-eedb-435a-bf77-0eb788089251] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:15:09.640776 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a2e3e6ec-ffd3-455d-b10b-a2fd5e5bc536 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:09.641211 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a2e3e6ec-ffd3-455d-b10b-a2fd5e5bc536 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:09.642041 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a2e3e6ec-ffd3-455d-b10b-a2fd5e5bc536 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:09.642481 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a2e3e6ec-ffd3-455d-b10b-a2fd5e5bc536 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:09.776607 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a2e3e6ec-ffd3-455d-b10b-a2fd5e5bc536 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:15:09.784474 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a2e3e6ec-ffd3-455d-b10b-a2fd5e5bc536 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/753bfb35-eedb-435a-bf77-0eb788089251" status: 200 len: 1683 microversion: 2.1 time: 0.159504 Jul 23 22:15:09.785050 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3603/6213] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:15:09 2022] GET /compute/v2.1/servers/753bfb35-eedb-435a-bf77-0eb788089251 => generated 1683 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:15:09.926929 ncdv-master-1 devstack@n-api.service[131320]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 23 22:15:09.927279 ncdv-master-1 devstack@n-api.service[131320]: Sat Jul 23 22:15:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 23 22:15:10.805933 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-546be569-819f-4dd5-ada0-4b5f7c75e88f tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:15:10.806681 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-546be569-819f-4dd5-ada0-4b5f7c75e88f tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 753bfb35-eedb-435a-bf77-0eb788089251] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:15:10.814387 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-546be569-819f-4dd5-ada0-4b5f7c75e88f tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:10.814864 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-546be569-819f-4dd5-ada0-4b5f7c75e88f tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:10.815679 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-546be569-819f-4dd5-ada0-4b5f7c75e88f tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:10.816198 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-546be569-819f-4dd5-ada0-4b5f7c75e88f tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:10.967986 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-546be569-819f-4dd5-ada0-4b5f7c75e88f tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:15:10.979315 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-546be569-819f-4dd5-ada0-4b5f7c75e88f tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/753bfb35-eedb-435a-bf77-0eb788089251" status: 200 len: 1683 microversion: 2.1 time: 0.179474 Jul 23 22:15:10.979957 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3604/6214] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:15:10 2022] GET /compute/v2.1/servers/753bfb35-eedb-435a-bf77-0eb788089251 => generated 1683 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:15:12.000808 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-25a867b3-77fa-482b-a54a-cd6bf7a8ea8b tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:15:12.001397 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-25a867b3-77fa-482b-a54a-cd6bf7a8ea8b tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 753bfb35-eedb-435a-bf77-0eb788089251] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:15:12.011507 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-25a867b3-77fa-482b-a54a-cd6bf7a8ea8b tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:12.011964 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-25a867b3-77fa-482b-a54a-cd6bf7a8ea8b tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:12.012736 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-25a867b3-77fa-482b-a54a-cd6bf7a8ea8b tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:12.013171 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-25a867b3-77fa-482b-a54a-cd6bf7a8ea8b tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:12.148780 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-25a867b3-77fa-482b-a54a-cd6bf7a8ea8b tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:15:12.156468 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-25a867b3-77fa-482b-a54a-cd6bf7a8ea8b tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/753bfb35-eedb-435a-bf77-0eb788089251" status: 200 len: 1683 microversion: 2.1 time: 0.159733 Jul 23 22:15:12.157043 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3605/6215] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:15:11 2022] GET /compute/v2.1/servers/753bfb35-eedb-435a-bf77-0eb788089251 => generated 1683 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:15:13.178326 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a0672fb7-ff56-429f-9e35-0efbeea5deb7 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:15:13.179256 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a0672fb7-ff56-429f-9e35-0efbeea5deb7 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 753bfb35-eedb-435a-bf77-0eb788089251] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:15:13.188029 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a0672fb7-ff56-429f-9e35-0efbeea5deb7 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:13.188505 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a0672fb7-ff56-429f-9e35-0efbeea5deb7 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:13.189313 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a0672fb7-ff56-429f-9e35-0efbeea5deb7 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:13.189776 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a0672fb7-ff56-429f-9e35-0efbeea5deb7 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:13.341742 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a0672fb7-ff56-429f-9e35-0efbeea5deb7 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:15:13.349442 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a0672fb7-ff56-429f-9e35-0efbeea5deb7 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/753bfb35-eedb-435a-bf77-0eb788089251" status: 200 len: 1683 microversion: 2.1 time: 0.178043 Jul 23 22:15:13.350029 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3606/6216] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:15:13 2022] GET /compute/v2.1/servers/753bfb35-eedb-435a-bf77-0eb788089251 => generated 1683 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:15:14.368009 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d2ee87ae-9b50-4a79-8511-ccc42eebc39b tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:15:14.368700 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d2ee87ae-9b50-4a79-8511-ccc42eebc39b tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 753bfb35-eedb-435a-bf77-0eb788089251] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:15:14.376123 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d2ee87ae-9b50-4a79-8511-ccc42eebc39b tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:14.376574 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d2ee87ae-9b50-4a79-8511-ccc42eebc39b tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:14.377343 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d2ee87ae-9b50-4a79-8511-ccc42eebc39b tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:14.377781 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d2ee87ae-9b50-4a79-8511-ccc42eebc39b tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:14.511064 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d2ee87ae-9b50-4a79-8511-ccc42eebc39b tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:15:14.522254 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d2ee87ae-9b50-4a79-8511-ccc42eebc39b tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/753bfb35-eedb-435a-bf77-0eb788089251" status: 200 len: 1683 microversion: 2.1 time: 0.157972 Jul 23 22:15:14.523025 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3607/6217] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:15:14 2022] GET /compute/v2.1/servers/753bfb35-eedb-435a-bf77-0eb788089251 => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:15:15.541115 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-61879a65-76c0-420f-8c1f-52408a53b7c1 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:15:15.541837 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-61879a65-76c0-420f-8c1f-52408a53b7c1 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 753bfb35-eedb-435a-bf77-0eb788089251] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:15:15.549605 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-61879a65-76c0-420f-8c1f-52408a53b7c1 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:15.550079 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-61879a65-76c0-420f-8c1f-52408a53b7c1 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:15.550870 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-61879a65-76c0-420f-8c1f-52408a53b7c1 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:15.551306 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-61879a65-76c0-420f-8c1f-52408a53b7c1 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:15.689475 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-61879a65-76c0-420f-8c1f-52408a53b7c1 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:15:15.697359 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-61879a65-76c0-420f-8c1f-52408a53b7c1 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/753bfb35-eedb-435a-bf77-0eb788089251" status: 200 len: 1683 microversion: 2.1 time: 0.160890 Jul 23 22:15:15.697958 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3608/6218] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:15:15 2022] GET /compute/v2.1/servers/753bfb35-eedb-435a-bf77-0eb788089251 => generated 1683 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:15:16.717142 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-632d0472-960a-4965-81ba-c8dc789c0c32 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:15:16.717840 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-632d0472-960a-4965-81ba-c8dc789c0c32 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 753bfb35-eedb-435a-bf77-0eb788089251] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:15:16.725406 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-632d0472-960a-4965-81ba-c8dc789c0c32 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:16.725880 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-632d0472-960a-4965-81ba-c8dc789c0c32 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:16.726682 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-632d0472-960a-4965-81ba-c8dc789c0c32 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:16.727126 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-632d0472-960a-4965-81ba-c8dc789c0c32 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:16.871309 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-632d0472-960a-4965-81ba-c8dc789c0c32 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:15:16.879174 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-632d0472-960a-4965-81ba-c8dc789c0c32 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/753bfb35-eedb-435a-bf77-0eb788089251" status: 200 len: 1683 microversion: 2.1 time: 0.167269 Jul 23 22:15:16.879762 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3609/6219] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:15:16 2022] GET /compute/v2.1/servers/753bfb35-eedb-435a-bf77-0eb788089251 => generated 1683 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:15:17.900851 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-19c4cd43-f7a6-4a44-936d-dcc85feef632 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:15:17.901913 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-19c4cd43-f7a6-4a44-936d-dcc85feef632 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 753bfb35-eedb-435a-bf77-0eb788089251] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:15:17.913722 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-19c4cd43-f7a6-4a44-936d-dcc85feef632 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:17.914531 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-19c4cd43-f7a6-4a44-936d-dcc85feef632 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:17.915874 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-19c4cd43-f7a6-4a44-936d-dcc85feef632 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:17.916613 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-19c4cd43-f7a6-4a44-936d-dcc85feef632 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:18.050492 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-19c4cd43-f7a6-4a44-936d-dcc85feef632 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:15:18.062175 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-19c4cd43-f7a6-4a44-936d-dcc85feef632 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/753bfb35-eedb-435a-bf77-0eb788089251" status: 200 len: 1683 microversion: 2.1 time: 0.167583 Jul 23 22:15:18.062908 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3610/6220] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:15:17 2022] GET /compute/v2.1/servers/753bfb35-eedb-435a-bf77-0eb788089251 => generated 1683 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:15:19.087374 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-eed221e2-5ac1-437d-a446-603d3dc6fd7c tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:15:19.088339 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-eed221e2-5ac1-437d-a446-603d3dc6fd7c tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 753bfb35-eedb-435a-bf77-0eb788089251] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:15:19.096282 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-eed221e2-5ac1-437d-a446-603d3dc6fd7c tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:19.096738 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-eed221e2-5ac1-437d-a446-603d3dc6fd7c tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:19.097512 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-eed221e2-5ac1-437d-a446-603d3dc6fd7c tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:19.097994 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-eed221e2-5ac1-437d-a446-603d3dc6fd7c tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:19.242921 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-eed221e2-5ac1-437d-a446-603d3dc6fd7c tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:15:19.250999 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-eed221e2-5ac1-437d-a446-603d3dc6fd7c tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/753bfb35-eedb-435a-bf77-0eb788089251" status: 200 len: 1683 microversion: 2.1 time: 0.170439 Jul 23 22:15:19.251570 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3611/6221] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:15:19 2022] GET /compute/v2.1/servers/753bfb35-eedb-435a-bf77-0eb788089251 => generated 1683 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:15:20.268833 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b602b221-38bd-4b2f-9ad6-96ed88f227e5 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:15:20.269474 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b602b221-38bd-4b2f-9ad6-96ed88f227e5 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 753bfb35-eedb-435a-bf77-0eb788089251] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:15:20.276941 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b602b221-38bd-4b2f-9ad6-96ed88f227e5 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:20.277375 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b602b221-38bd-4b2f-9ad6-96ed88f227e5 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:20.278191 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b602b221-38bd-4b2f-9ad6-96ed88f227e5 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:20.278636 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b602b221-38bd-4b2f-9ad6-96ed88f227e5 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:20.413782 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b602b221-38bd-4b2f-9ad6-96ed88f227e5 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:15:20.425220 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b602b221-38bd-4b2f-9ad6-96ed88f227e5 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/753bfb35-eedb-435a-bf77-0eb788089251" status: 200 len: 1683 microversion: 2.1 time: 0.160168 Jul 23 22:15:20.426051 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3612/6222] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:15:20 2022] GET /compute/v2.1/servers/753bfb35-eedb-435a-bf77-0eb788089251 => generated 1683 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:15:21.449039 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-54df7beb-5729-4f6f-806a-2e92a63c446a tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:15:21.450225 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-54df7beb-5729-4f6f-806a-2e92a63c446a tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 753bfb35-eedb-435a-bf77-0eb788089251] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:15:21.458159 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-54df7beb-5729-4f6f-806a-2e92a63c446a tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:21.458612 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-54df7beb-5729-4f6f-806a-2e92a63c446a tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:21.459389 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-54df7beb-5729-4f6f-806a-2e92a63c446a tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:21.459828 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-54df7beb-5729-4f6f-806a-2e92a63c446a tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:21.463807 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:15:21.597972 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-54df7beb-5729-4f6f-806a-2e92a63c446a tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:15:21.605976 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-54df7beb-5729-4f6f-806a-2e92a63c446a tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/753bfb35-eedb-435a-bf77-0eb788089251" status: 200 len: 1683 microversion: 2.1 time: 0.163664 Jul 23 22:15:21.606647 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3613/6223] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:15:21 2022] GET /compute/v2.1/servers/753bfb35-eedb-435a-bf77-0eb788089251 => generated 1683 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:15:22.628446 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-deef2d73-26e1-432b-93b8-72453a859209 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:15:22.629552 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-deef2d73-26e1-432b-93b8-72453a859209 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 753bfb35-eedb-435a-bf77-0eb788089251] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:15:22.641319 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-deef2d73-26e1-432b-93b8-72453a859209 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:22.642150 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-deef2d73-26e1-432b-93b8-72453a859209 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:22.643434 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-deef2d73-26e1-432b-93b8-72453a859209 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:22.644175 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-deef2d73-26e1-432b-93b8-72453a859209 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:22.781256 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-deef2d73-26e1-432b-93b8-72453a859209 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:15:22.789215 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-deef2d73-26e1-432b-93b8-72453a859209 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/753bfb35-eedb-435a-bf77-0eb788089251" status: 200 len: 1683 microversion: 2.1 time: 0.167558 Jul 23 22:15:22.789819 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3614/6224] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:15:22 2022] GET /compute/v2.1/servers/753bfb35-eedb-435a-bf77-0eb788089251 => generated 1683 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:15:23.808893 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-db0c208e-c44c-4ed0-ae76-fac7d5187e09 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:15:23.809739 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-db0c208e-c44c-4ed0-ae76-fac7d5187e09 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 753bfb35-eedb-435a-bf77-0eb788089251] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:15:23.819729 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-db0c208e-c44c-4ed0-ae76-fac7d5187e09 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:23.820335 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-db0c208e-c44c-4ed0-ae76-fac7d5187e09 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:23.821399 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-db0c208e-c44c-4ed0-ae76-fac7d5187e09 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:23.822009 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-db0c208e-c44c-4ed0-ae76-fac7d5187e09 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:23.961692 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-db0c208e-c44c-4ed0-ae76-fac7d5187e09 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:15:23.970383 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-db0c208e-c44c-4ed0-ae76-fac7d5187e09 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/753bfb35-eedb-435a-bf77-0eb788089251" status: 200 len: 1683 microversion: 2.1 time: 0.166250 Jul 23 22:15:23.970712 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3615/6225] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:15:23 2022] GET /compute/v2.1/servers/753bfb35-eedb-435a-bf77-0eb788089251 => generated 1683 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:15:24.496222 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-782a7fd7-74cf-4d27-b9f7-7d7fc94d66d6 req-3751120c-8c3d-49c2-84fa-09aca5d7ba8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "753bfb35-eedb-435a-bf77-0eb788089251", "name": "network-vif-unplugged", "status": "completed", "tag": "14cfbd5f-56ab-475f-8368-0ba584b79574"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:15:24.507556 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-782a7fd7-74cf-4d27-b9f7-7d7fc94d66d6 req-3751120c-8c3d-49c2-84fa-09aca5d7ba8b service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:24.507985 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-782a7fd7-74cf-4d27-b9f7-7d7fc94d66d6 req-3751120c-8c3d-49c2-84fa-09aca5d7ba8b service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:24.520584 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-782a7fd7-74cf-4d27-b9f7-7d7fc94d66d6 req-3751120c-8c3d-49c2-84fa-09aca5d7ba8b service nova] Creating event network-vif-unplugged:14cfbd5f-56ab-475f-8368-0ba584b79574 for instance 753bfb35-eedb-435a-bf77-0eb788089251 on nch2-master-1 Jul 23 22:15:24.526025 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [req-782a7fd7-74cf-4d27-b9f7-7d7fc94d66d6 req-3751120c-8c3d-49c2-84fa-09aca5d7ba8b service nova] Instance 753bfb35-eedb-435a-bf77-0eb788089251 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=131320) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 23 22:15:24.536991 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-782a7fd7-74cf-4d27-b9f7-7d7fc94d66d6 req-3751120c-8c3d-49c2-84fa-09aca5d7ba8b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045576 Jul 23 22:15:24.537605 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3616/6226] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:15:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:15:24.989601 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-16dfe9f5-e5a1-4d47-8edc-c4a16f84beba tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:15:24.990274 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-16dfe9f5-e5a1-4d47-8edc-c4a16f84beba tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 753bfb35-eedb-435a-bf77-0eb788089251] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:15:24.997632 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-16dfe9f5-e5a1-4d47-8edc-c4a16f84beba tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:24.998232 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-16dfe9f5-e5a1-4d47-8edc-c4a16f84beba tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:24.999012 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-16dfe9f5-e5a1-4d47-8edc-c4a16f84beba tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:24.999450 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-16dfe9f5-e5a1-4d47-8edc-c4a16f84beba tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:25.134362 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-16dfe9f5-e5a1-4d47-8edc-c4a16f84beba tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:15:25.144962 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-16dfe9f5-e5a1-4d47-8edc-c4a16f84beba tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/753bfb35-eedb-435a-bf77-0eb788089251" status: 200 len: 1682 microversion: 2.1 time: 0.160348 Jul 23 22:15:25.156506 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3617/6227] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:15:24 2022] GET /compute/v2.1/servers/753bfb35-eedb-435a-bf77-0eb788089251 => generated 1682 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:15:26.167429 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-67c20817-7342-4754-af99-0680eba8518b tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:15:26.168417 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-67c20817-7342-4754-af99-0680eba8518b tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 753bfb35-eedb-435a-bf77-0eb788089251] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:15:26.176569 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-67c20817-7342-4754-af99-0680eba8518b tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:26.177000 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-67c20817-7342-4754-af99-0680eba8518b tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:26.177784 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-67c20817-7342-4754-af99-0680eba8518b tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:26.178245 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-67c20817-7342-4754-af99-0680eba8518b tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:26.312195 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-67c20817-7342-4754-af99-0680eba8518b tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:15:26.320101 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-67c20817-7342-4754-af99-0680eba8518b tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/753bfb35-eedb-435a-bf77-0eb788089251" status: 200 len: 1680 microversion: 2.1 time: 0.159420 Jul 23 22:15:26.320676 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3618/6228] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:15:26 2022] GET /compute/v2.1/servers/753bfb35-eedb-435a-bf77-0eb788089251 => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:15:26.564040 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-6373d3a8-2d0f-40e9-b407-4f2f7533c65e req-efb8e71b-a091-4a2b-b5ed-ec65052934a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "753bfb35-eedb-435a-bf77-0eb788089251", "tag": "14cfbd5f-56ab-475f-8368-0ba584b79574"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:15:26.572634 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-6373d3a8-2d0f-40e9-b407-4f2f7533c65e req-efb8e71b-a091-4a2b-b5ed-ec65052934a0 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:26.573171 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-6373d3a8-2d0f-40e9-b407-4f2f7533c65e req-efb8e71b-a091-4a2b-b5ed-ec65052934a0 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:26.585573 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-6373d3a8-2d0f-40e9-b407-4f2f7533c65e req-efb8e71b-a091-4a2b-b5ed-ec65052934a0 service nova] Creating event network-changed:14cfbd5f-56ab-475f-8368-0ba584b79574 for instance 753bfb35-eedb-435a-bf77-0eb788089251 on nch2-master-1 Jul 23 22:15:26.591316 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [req-6373d3a8-2d0f-40e9-b407-4f2f7533c65e req-efb8e71b-a091-4a2b-b5ed-ec65052934a0 service nova] Instance 753bfb35-eedb-435a-bf77-0eb788089251 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=131320) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 23 22:15:26.602410 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-6373d3a8-2d0f-40e9-b407-4f2f7533c65e req-efb8e71b-a091-4a2b-b5ed-ec65052934a0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042609 Jul 23 22:15:26.603002 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3619/6229] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:15:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:15:27.340530 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-000a4fae-a4fa-4fe2-9956-3b6c04fda7fa tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:15:27.342170 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-000a4fae-a4fa-4fe2-9956-3b6c04fda7fa tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 753bfb35-eedb-435a-bf77-0eb788089251] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:15:27.348764 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-000a4fae-a4fa-4fe2-9956-3b6c04fda7fa tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:27.349219 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-000a4fae-a4fa-4fe2-9956-3b6c04fda7fa tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:27.350021 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-000a4fae-a4fa-4fe2-9956-3b6c04fda7fa tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:27.350458 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-000a4fae-a4fa-4fe2-9956-3b6c04fda7fa tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:27.488309 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-000a4fae-a4fa-4fe2-9956-3b6c04fda7fa tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:15:27.496302 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-000a4fae-a4fa-4fe2-9956-3b6c04fda7fa tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/753bfb35-eedb-435a-bf77-0eb788089251" status: 200 len: 1677 microversion: 2.1 time: 0.160986 Jul 23 22:15:27.496895 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3620/6230] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:15:27 2022] GET /compute/v2.1/servers/753bfb35-eedb-435a-bf77-0eb788089251 => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:15:27.513469 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-7badc953-f35e-4ce5-bb4e-e689d4aceea1 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:15:27.514174 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-7badc953-f35e-4ce5-bb4e-e689d4aceea1 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 753bfb35-eedb-435a-bf77-0eb788089251] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:15:27.520510 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7badc953-f35e-4ce5-bb4e-e689d4aceea1 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:27.520960 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7badc953-f35e-4ce5-bb4e-e689d4aceea1 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:27.521729 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7badc953-f35e-4ce5-bb4e-e689d4aceea1 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:27.522202 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7badc953-f35e-4ce5-bb4e-e689d4aceea1 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:27.560452 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7badc953-f35e-4ce5-bb4e-e689d4aceea1 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:27.560917 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7badc953-f35e-4ce5-bb4e-e689d4aceea1 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:27.561740 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7badc953-f35e-4ce5-bb4e-e689d4aceea1 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:27.562220 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7badc953-f35e-4ce5-bb4e-e689d4aceea1 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:27.592828 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-7badc953-f35e-4ce5-bb4e-e689d4aceea1 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Getting quotas for project 5ca8bc0082894aa6b90a714ddc6a6790. Resources: {'ram', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 22:15:27.598410 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-7badc953-f35e-4ce5-bb4e-e689d4aceea1 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Getting quotas for user 14820436f99c404b80194a1b985c76b1 and project 5ca8bc0082894aa6b90a714ddc6a6790. Resources: {'ram', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 22:15:27.711820 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-7badc953-f35e-4ce5-bb4e-e689d4aceea1 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "POST /compute/v2.1/servers/753bfb35-eedb-435a-bf77-0eb788089251/action" status: 202 len: 0 microversion: 2.1 time: 0.202022 Jul 23 22:15:27.712386 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3621/6231] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 22:15:27 2022] POST /compute/v2.1/servers/753bfb35-eedb-435a-bf77-0eb788089251/action => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 23 22:15:27.721300 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-365ddeae-2920-48ca-b3b6-86975bab7631 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:15:27.722026 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-365ddeae-2920-48ca-b3b6-86975bab7631 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 753bfb35-eedb-435a-bf77-0eb788089251] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:15:27.728671 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-365ddeae-2920-48ca-b3b6-86975bab7631 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:27.729127 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-365ddeae-2920-48ca-b3b6-86975bab7631 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:27.729922 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-365ddeae-2920-48ca-b3b6-86975bab7631 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:27.730519 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-365ddeae-2920-48ca-b3b6-86975bab7631 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:27.866781 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-365ddeae-2920-48ca-b3b6-86975bab7631 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:15:27.874756 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-365ddeae-2920-48ca-b3b6-86975bab7631 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/753bfb35-eedb-435a-bf77-0eb788089251" status: 200 len: 1676 microversion: 2.1 time: 0.157650 Jul 23 22:15:27.875346 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3622/6232] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:15:27 2022] GET /compute/v2.1/servers/753bfb35-eedb-435a-bf77-0eb788089251 => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:15:28.896298 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-44cbae28-3825-4bb1-8096-76e5fd41901e tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:15:28.896983 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-44cbae28-3825-4bb1-8096-76e5fd41901e tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 753bfb35-eedb-435a-bf77-0eb788089251] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:15:28.907046 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-44cbae28-3825-4bb1-8096-76e5fd41901e tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:28.907504 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-44cbae28-3825-4bb1-8096-76e5fd41901e tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:28.908287 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-44cbae28-3825-4bb1-8096-76e5fd41901e tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:28.908732 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-44cbae28-3825-4bb1-8096-76e5fd41901e tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:29.064763 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-44cbae28-3825-4bb1-8096-76e5fd41901e tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:15:29.072889 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-44cbae28-3825-4bb1-8096-76e5fd41901e tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/753bfb35-eedb-435a-bf77-0eb788089251" status: 200 len: 1676 microversion: 2.1 time: 0.183019 Jul 23 22:15:29.073411 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3623/6233] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:15:28 2022] GET /compute/v2.1/servers/753bfb35-eedb-435a-bf77-0eb788089251 => generated 1676 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:15:30.091106 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5ad60f1f-8dc2-4f27-b607-da4078de0b02 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:15:30.092069 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5ad60f1f-8dc2-4f27-b607-da4078de0b02 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 753bfb35-eedb-435a-bf77-0eb788089251] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:15:30.100023 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5ad60f1f-8dc2-4f27-b607-da4078de0b02 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:30.100553 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5ad60f1f-8dc2-4f27-b607-da4078de0b02 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:30.101339 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5ad60f1f-8dc2-4f27-b607-da4078de0b02 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:30.101784 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5ad60f1f-8dc2-4f27-b607-da4078de0b02 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:30.239535 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5ad60f1f-8dc2-4f27-b607-da4078de0b02 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:15:30.247357 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5ad60f1f-8dc2-4f27-b607-da4078de0b02 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/753bfb35-eedb-435a-bf77-0eb788089251" status: 200 len: 1676 microversion: 2.1 time: 0.160274 Jul 23 22:15:30.248340 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3624/6234] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:15:30 2022] GET /compute/v2.1/servers/753bfb35-eedb-435a-bf77-0eb788089251 => generated 1676 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:15:30.498231 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-efac0bc4-4fb3-4c21-96e3-52d8d6871bf0 req-6c1de9c7-6d63-41e6-a21f-7cf381519fd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "753bfb35-eedb-435a-bf77-0eb788089251", "name": "network-vif-plugged", "status": "completed", "tag": "14cfbd5f-56ab-475f-8368-0ba584b79574"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:15:30.507053 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-efac0bc4-4fb3-4c21-96e3-52d8d6871bf0 req-6c1de9c7-6d63-41e6-a21f-7cf381519fd1 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:30.507702 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-efac0bc4-4fb3-4c21-96e3-52d8d6871bf0 req-6c1de9c7-6d63-41e6-a21f-7cf381519fd1 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:30.520049 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-efac0bc4-4fb3-4c21-96e3-52d8d6871bf0 req-6c1de9c7-6d63-41e6-a21f-7cf381519fd1 service nova] Creating event network-vif-plugged:14cfbd5f-56ab-475f-8368-0ba584b79574 for instance 753bfb35-eedb-435a-bf77-0eb788089251 on nch1-master-1 Jul 23 22:15:30.525885 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [req-efac0bc4-4fb3-4c21-96e3-52d8d6871bf0 req-6c1de9c7-6d63-41e6-a21f-7cf381519fd1 service nova] Instance 753bfb35-eedb-435a-bf77-0eb788089251 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=131320) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 23 22:15:30.537348 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-efac0bc4-4fb3-4c21-96e3-52d8d6871bf0 req-6c1de9c7-6d63-41e6-a21f-7cf381519fd1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042856 Jul 23 22:15:30.537965 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3625/6235] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:15:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 22:15:31.266296 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-07cc0d1a-ba7e-4ea3-b1e0-a802c4160499 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:15:31.267020 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-07cc0d1a-ba7e-4ea3-b1e0-a802c4160499 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 753bfb35-eedb-435a-bf77-0eb788089251] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:15:31.274034 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-07cc0d1a-ba7e-4ea3-b1e0-a802c4160499 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:31.274490 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-07cc0d1a-ba7e-4ea3-b1e0-a802c4160499 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:31.275258 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-07cc0d1a-ba7e-4ea3-b1e0-a802c4160499 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:31.275691 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-07cc0d1a-ba7e-4ea3-b1e0-a802c4160499 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:31.417386 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-07cc0d1a-ba7e-4ea3-b1e0-a802c4160499 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:15:31.428127 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-07cc0d1a-ba7e-4ea3-b1e0-a802c4160499 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/753bfb35-eedb-435a-bf77-0eb788089251" status: 200 len: 1676 microversion: 2.1 time: 0.166859 Jul 23 22:15:31.429514 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3626/6236] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:15:31 2022] GET /compute/v2.1/servers/753bfb35-eedb-435a-bf77-0eb788089251 => generated 1676 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:15:31.434653 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-4af91909-6063-48f1-b119-df1e9f812051 req-5fcd6518-d8eb-43fd-8b3b-b4d4ef3d0ed7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "753bfb35-eedb-435a-bf77-0eb788089251", "name": "network-vif-unplugged", "status": "completed", "tag": "14cfbd5f-56ab-475f-8368-0ba584b79574"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:15:31.444365 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-4af91909-6063-48f1-b119-df1e9f812051 req-5fcd6518-d8eb-43fd-8b3b-b4d4ef3d0ed7 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:31.445135 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-4af91909-6063-48f1-b119-df1e9f812051 req-5fcd6518-d8eb-43fd-8b3b-b4d4ef3d0ed7 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:31.457870 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-4af91909-6063-48f1-b119-df1e9f812051 req-5fcd6518-d8eb-43fd-8b3b-b4d4ef3d0ed7 service nova] Creating event network-vif-unplugged:14cfbd5f-56ab-475f-8368-0ba584b79574 for instance 753bfb35-eedb-435a-bf77-0eb788089251 on nch1-master-1 Jul 23 22:15:31.463835 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [req-4af91909-6063-48f1-b119-df1e9f812051 req-5fcd6518-d8eb-43fd-8b3b-b4d4ef3d0ed7 service nova] Instance 753bfb35-eedb-435a-bf77-0eb788089251 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=131320) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 23 22:15:31.474889 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-4af91909-6063-48f1-b119-df1e9f812051 req-5fcd6518-d8eb-43fd-8b3b-b4d4ef3d0ed7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043773 Jul 23 22:15:31.475521 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3627/6237] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:15:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:15:32.452978 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-acf2b44a-6182-4c5c-afdb-f95360e9ec52 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:15:32.454126 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-acf2b44a-6182-4c5c-afdb-f95360e9ec52 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 753bfb35-eedb-435a-bf77-0eb788089251] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:15:32.465110 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-acf2b44a-6182-4c5c-afdb-f95360e9ec52 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:32.465913 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-acf2b44a-6182-4c5c-afdb-f95360e9ec52 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:32.467079 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-acf2b44a-6182-4c5c-afdb-f95360e9ec52 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:32.467533 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-acf2b44a-6182-4c5c-afdb-f95360e9ec52 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:32.471665 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:15:32.942383 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-acf2b44a-6182-4c5c-afdb-f95360e9ec52 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:15:32.950426 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-acf2b44a-6182-4c5c-afdb-f95360e9ec52 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/753bfb35-eedb-435a-bf77-0eb788089251" status: 200 len: 1676 microversion: 2.1 time: 0.506587 Jul 23 22:15:32.951445 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3628/6238] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:15:32 2022] GET /compute/v2.1/servers/753bfb35-eedb-435a-bf77-0eb788089251 => generated 1676 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:15:33.497430 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-68cd69df-667a-40fe-b8f1-6c09bc4c707e req-a040d357-ef05-4469-9c00-3258a8b18677 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "753bfb35-eedb-435a-bf77-0eb788089251", "tag": "14cfbd5f-56ab-475f-8368-0ba584b79574"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:15:33.512337 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-68cd69df-667a-40fe-b8f1-6c09bc4c707e req-a040d357-ef05-4469-9c00-3258a8b18677 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:33.513503 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-68cd69df-667a-40fe-b8f1-6c09bc4c707e req-a040d357-ef05-4469-9c00-3258a8b18677 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:33.525557 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-68cd69df-667a-40fe-b8f1-6c09bc4c707e req-a040d357-ef05-4469-9c00-3258a8b18677 service nova] Creating event network-changed:14cfbd5f-56ab-475f-8368-0ba584b79574 for instance 753bfb35-eedb-435a-bf77-0eb788089251 on nch1-master-1 Jul 23 22:15:33.531342 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [req-68cd69df-667a-40fe-b8f1-6c09bc4c707e req-a040d357-ef05-4469-9c00-3258a8b18677 service nova] Instance 753bfb35-eedb-435a-bf77-0eb788089251 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=131320) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 23 22:15:33.541991 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-68cd69df-667a-40fe-b8f1-6c09bc4c707e req-a040d357-ef05-4469-9c00-3258a8b18677 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050978 Jul 23 22:15:33.542650 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3629/6239] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:15:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:15:33.969426 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-722d139f-8848-49ba-b3f5-b6a7c9413e1e tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:15:33.970167 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-722d139f-8848-49ba-b3f5-b6a7c9413e1e tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 753bfb35-eedb-435a-bf77-0eb788089251] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:15:33.977154 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-722d139f-8848-49ba-b3f5-b6a7c9413e1e tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:33.977568 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-722d139f-8848-49ba-b3f5-b6a7c9413e1e tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:33.978549 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-722d139f-8848-49ba-b3f5-b6a7c9413e1e tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:33.979143 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-722d139f-8848-49ba-b3f5-b6a7c9413e1e tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:34.111509 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-722d139f-8848-49ba-b3f5-b6a7c9413e1e tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:15:34.119367 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-722d139f-8848-49ba-b3f5-b6a7c9413e1e tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/753bfb35-eedb-435a-bf77-0eb788089251" status: 200 len: 1669 microversion: 2.1 time: 0.154533 Jul 23 22:15:34.119934 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3630/6240] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:15:33 2022] GET /compute/v2.1/servers/753bfb35-eedb-435a-bf77-0eb788089251 => generated 1669 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:15:34.135929 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-76ada97d-5099-4096-ac0a-2613e62d9c0f tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:15:34.136547 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-76ada97d-5099-4096-ac0a-2613e62d9c0f tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 753bfb35-eedb-435a-bf77-0eb788089251] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:15:34.143006 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-76ada97d-5099-4096-ac0a-2613e62d9c0f tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:34.143455 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-76ada97d-5099-4096-ac0a-2613e62d9c0f tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:34.144246 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-76ada97d-5099-4096-ac0a-2613e62d9c0f tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:34.144686 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-76ada97d-5099-4096-ac0a-2613e62d9c0f tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:34.279087 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-76ada97d-5099-4096-ac0a-2613e62d9c0f tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:15:34.287030 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-76ada97d-5099-4096-ac0a-2613e62d9c0f tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/753bfb35-eedb-435a-bf77-0eb788089251" status: 200 len: 1669 microversion: 2.1 time: 0.154933 Jul 23 22:15:34.287615 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3631/6241] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:15:34 2022] GET /compute/v2.1/servers/753bfb35-eedb-435a-bf77-0eb788089251 => generated 1669 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:15:34.303174 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b8758beb-a7e3-40f7-b24b-92441b5279b6 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:15:34.303778 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b8758beb-a7e3-40f7-b24b-92441b5279b6 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 753bfb35-eedb-435a-bf77-0eb788089251] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:15:34.309725 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b8758beb-a7e3-40f7-b24b-92441b5279b6 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:34.310313 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b8758beb-a7e3-40f7-b24b-92441b5279b6 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:34.311076 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b8758beb-a7e3-40f7-b24b-92441b5279b6 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:34.311512 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b8758beb-a7e3-40f7-b24b-92441b5279b6 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:34.451560 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b8758beb-a7e3-40f7-b24b-92441b5279b6 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:15:34.459180 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b8758beb-a7e3-40f7-b24b-92441b5279b6 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/753bfb35-eedb-435a-bf77-0eb788089251" status: 200 len: 1669 microversion: 2.1 time: 0.159783 Jul 23 22:15:34.459765 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3632/6242] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:15:34 2022] GET /compute/v2.1/servers/753bfb35-eedb-435a-bf77-0eb788089251 => generated 1669 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:15:34.475223 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-fcdd52e7-1bb7-4bb0-af95-046ae03341cb tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:15:34.475722 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-fcdd52e7-1bb7-4bb0-af95-046ae03341cb tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 753bfb35-eedb-435a-bf77-0eb788089251] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:15:34.481836 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fcdd52e7-1bb7-4bb0-af95-046ae03341cb tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:34.482392 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fcdd52e7-1bb7-4bb0-af95-046ae03341cb tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:34.483165 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fcdd52e7-1bb7-4bb0-af95-046ae03341cb tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:34.483603 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fcdd52e7-1bb7-4bb0-af95-046ae03341cb tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:34.512191 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-fcdd52e7-1bb7-4bb0-af95-046ae03341cb tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 753bfb35-eedb-435a-bf77-0eb788089251] Going to try to terminate instance {{(pid=131320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 22:15:34.596829 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-fcdd52e7-1bb7-4bb0-af95-046ae03341cb tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "DELETE /compute/v2.1/servers/753bfb35-eedb-435a-bf77-0eb788089251" status: 204 len: 0 microversion: 2.1 time: 0.124414 Jul 23 22:15:34.597994 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3633/6243] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 22:15:34 2022] DELETE /compute/v2.1/servers/753bfb35-eedb-435a-bf77-0eb788089251 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 23 22:15:34.607061 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-27966044-a860-4055-bb3d-e4102c1d6b6c tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:15:34.607759 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-27966044-a860-4055-bb3d-e4102c1d6b6c tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 753bfb35-eedb-435a-bf77-0eb788089251] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:15:34.614189 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-27966044-a860-4055-bb3d-e4102c1d6b6c tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:34.614641 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-27966044-a860-4055-bb3d-e4102c1d6b6c tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:34.615406 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-27966044-a860-4055-bb3d-e4102c1d6b6c tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:34.615839 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-27966044-a860-4055-bb3d-e4102c1d6b6c tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:34.750013 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-27966044-a860-4055-bb3d-e4102c1d6b6c tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:15:34.758179 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-27966044-a860-4055-bb3d-e4102c1d6b6c tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/753bfb35-eedb-435a-bf77-0eb788089251" status: 200 len: 1675 microversion: 2.1 time: 0.155401 Jul 23 22:15:34.758737 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3634/6244] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:15:34 2022] GET /compute/v2.1/servers/753bfb35-eedb-435a-bf77-0eb788089251 => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:15:35.777923 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8c0e6c6d-7779-4f85-9233-fa25ac85fc76 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:15:35.779770 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8c0e6c6d-7779-4f85-9233-fa25ac85fc76 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 753bfb35-eedb-435a-bf77-0eb788089251] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:15:35.783683 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:15:35.791344 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8c0e6c6d-7779-4f85-9233-fa25ac85fc76 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:35.791955 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8c0e6c6d-7779-4f85-9233-fa25ac85fc76 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:35.793035 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8c0e6c6d-7779-4f85-9233-fa25ac85fc76 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:35.793604 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8c0e6c6d-7779-4f85-9233-fa25ac85fc76 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:35.931335 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8c0e6c6d-7779-4f85-9233-fa25ac85fc76 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:15:35.939280 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8c0e6c6d-7779-4f85-9233-fa25ac85fc76 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/753bfb35-eedb-435a-bf77-0eb788089251" status: 200 len: 1675 microversion: 2.1 time: 0.166616 Jul 23 22:15:35.939872 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3635/6245] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:15:35 2022] GET /compute/v2.1/servers/753bfb35-eedb-435a-bf77-0eb788089251 => generated 1675 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:15:36.769106 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-4498ea75-e681-4cee-9be0-840a27b61bcf req-f3fca2d2-b226-4ed1-a96f-f9aad901d662 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "753bfb35-eedb-435a-bf77-0eb788089251", "name": "network-vif-deleted", "tag": "14cfbd5f-56ab-475f-8368-0ba584b79574"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:15:36.778378 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-4498ea75-e681-4cee-9be0-840a27b61bcf req-f3fca2d2-b226-4ed1-a96f-f9aad901d662 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:36.779079 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-4498ea75-e681-4cee-9be0-840a27b61bcf req-f3fca2d2-b226-4ed1-a96f-f9aad901d662 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:36.790798 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-4498ea75-e681-4cee-9be0-840a27b61bcf req-f3fca2d2-b226-4ed1-a96f-f9aad901d662 service nova] Creating event network-vif-deleted:14cfbd5f-56ab-475f-8368-0ba584b79574 for instance 753bfb35-eedb-435a-bf77-0eb788089251 on nch1-master-1 Jul 23 22:15:36.796682 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-4498ea75-e681-4cee-9be0-840a27b61bcf req-f3fca2d2-b226-4ed1-a96f-f9aad901d662 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032099 Jul 23 22:15:36.797438 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3636/6246] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:15:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:15:36.958034 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4c73389d-3a8b-44b8-8c34-48e6c6f16df0 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:15:36.958754 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-4c73389d-3a8b-44b8-8c34-48e6c6f16df0 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 753bfb35-eedb-435a-bf77-0eb788089251] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:15:36.967371 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4c73389d-3a8b-44b8-8c34-48e6c6f16df0 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:36.967831 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4c73389d-3a8b-44b8-8c34-48e6c6f16df0 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:36.968626 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4c73389d-3a8b-44b8-8c34-48e6c6f16df0 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:36.969065 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4c73389d-3a8b-44b8-8c34-48e6c6f16df0 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:37.000749 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4c73389d-3a8b-44b8-8c34-48e6c6f16df0 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:37.001204 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4c73389d-3a8b-44b8-8c34-48e6c6f16df0 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:37.001673 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.objects.instance [None req-4c73389d-3a8b-44b8-8c34-48e6c6f16df0 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lazy-loading 'fault' on Instance uuid 753bfb35-eedb-435a-bf77-0eb788089251 {{(pid=131320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 22:15:37.043164 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-4c73389d-3a8b-44b8-8c34-48e6c6f16df0 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:15:37.051226 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4c73389d-3a8b-44b8-8c34-48e6c6f16df0 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/753bfb35-eedb-435a-bf77-0eb788089251" status: 200 len: 1329 microversion: 2.1 time: 0.097612 Jul 23 22:15:37.051805 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3637/6247] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:15:36 2022] GET /compute/v2.1/servers/753bfb35-eedb-435a-bf77-0eb788089251 => generated 1329 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:15:38.073738 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-99de1b6d-dab9-4768-9c09-36aeb80320fd tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:15:38.074833 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-99de1b6d-dab9-4768-9c09-36aeb80320fd tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 753bfb35-eedb-435a-bf77-0eb788089251] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:15:38.078015 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=3 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:15:38.084551 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-99de1b6d-dab9-4768-9c09-36aeb80320fd tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:38.085001 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-99de1b6d-dab9-4768-9c09-36aeb80320fd tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:38.085769 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-99de1b6d-dab9-4768-9c09-36aeb80320fd tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:38.086301 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-99de1b6d-dab9-4768-9c09-36aeb80320fd tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:38.100091 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-99de1b6d-dab9-4768-9c09-36aeb80320fd tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] HTTP exception thrown: Instance 753bfb35-eedb-435a-bf77-0eb788089251 could not be found. Jul 23 22:15:38.101747 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-99de1b6d-dab9-4768-9c09-36aeb80320fd tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Request method failure captured: Jul 23 22:15:38.101747 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/753bfb35-eedb-435a-bf77-0eb788089251 HTTP/1.1 Jul 23 22:15:38.101747 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 22:15:38.101747 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 22:15:38.101747 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 22:15:38.101747 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 22:15:38.101747 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 22:15:38.101747 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 22:15:38.101747 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 22:15:38.101747 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 22:15:38.101747 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3HIoewFR0SqpqLrj5I-sN7pNyjXsXXtQLkybI9vB6YsXdCaJ6oH3gw_3sQK2MiiJxU-U9GJtkTNRyRtiyWB74IsJErQO0QMayat2E8l_KlQxoCwZvuOOv2BFlgI59GiCbRO0itRDUcJc1lBv1Mjh_3cnjoEC2YbTi0_IAE5AJlU7TS0 Jul 23 22:15:38.101747 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 22:15:38.101747 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 22:15:38.101747 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 22:15:38.101747 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 22:15:38.101747 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 22:15:38.101747 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 22:15:38.101747 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 5ca8bc0082894aa6b90a714ddc6a6790 Jul 23 22:15:38.101747 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServerActionsTestJSON-1436267344 Jul 23 22:15:38.101747 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 22:15:38.101747 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 22:15:38.101747 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5ca8bc0082894aa6b90a714ddc6a6790"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5ca8bc0082894aa6b90a714ddc6a6790"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_5ca8bc0082894aa6b90a714ddc6a6790", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/5ca8bc0082894aa6b90a714ddc6a6790"}]}] Jul 23 22:15:38.101747 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServerActionsTestJSON-1436267344 Jul 23 22:15:38.101747 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 5ca8bc0082894aa6b90a714ddc6a6790 Jul 23 22:15:38.101747 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServerActionsTestJSON-1436267344 Jul 23 22:15:38.101747 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServerActionsTestJSON-1436267344-project Jul 23 22:15:38.101747 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 22:15:38.101747 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 22:15:38.101747 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 14820436f99c404b80194a1b985c76b1 Jul 23 22:15:38.101747 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServerActionsTestJSON-1436267344-project Jul 23 22:15:38.101747 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 22:15:38.101747 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance 753bfb35-eedb-435a-bf77-0eb788089251 could not be found. Jul 23 22:15:38.101747 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '753bfb35-eedb-435a-bf77-0eb788089251'} Jul 23 22:15:38.101747 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 22:15:38.101747 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:15:38.101747 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 22:15:38.101747 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 22:15:38.101747 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 22:15:38.101747 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 22:15:38.101747 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 22:15:38.101747 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 22:15:38.101747 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 22:15:38.101747 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 22:15:38.101747 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 753bfb35-eedb-435a-bf77-0eb788089251 could not be found. Jul 23 22:15:38.101747 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:15:38.101747 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:15:38.101747 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:15:38.101747 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:15:38.101747 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:15:38.101747 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:15:38.101747 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 22:15:38.101747 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 22:15:38.101747 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 22:15:38.101747 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 22:15:38.101747 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 22:15:38.101747 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 22:15:38.101747 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 22:15:38.101747 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 22:15:38.101747 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 22:15:38.101747 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 22:15:38.101747 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 753bfb35-eedb-435a-bf77-0eb788089251 could not be found. Jul 23 22:15:38.101747 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:15:38.101747 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:15:38.101747 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:15:38.105974 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:15:38.105974 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:15:38.105974 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:15:38.105974 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 22:15:38.105974 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 22:15:38.105974 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 753bfb35-eedb-435a-bf77-0eb788089251 could not be found. Jul 23 22:15:38.105974 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:15:38.105974 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-99de1b6d-dab9-4768-9c09-36aeb80320fd tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Returning 404 to user: Instance 753bfb35-eedb-435a-bf77-0eb788089251 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 22:15:38.105974 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-99de1b6d-dab9-4768-9c09-36aeb80320fd tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/753bfb35-eedb-435a-bf77-0eb788089251" status: 404 len: 111 microversion: 2.1 time: 0.036680 Jul 23 22:15:38.105974 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3638/6248] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:15:38 2022] GET /compute/v2.1/servers/753bfb35-eedb-435a-bf77-0eb788089251 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 22:15:38.119047 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c87d4344-5772-4380-9e0e-81febea3539c tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:15:38.119653 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c87d4344-5772-4380-9e0e-81febea3539c tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 753bfb35-eedb-435a-bf77-0eb788089251] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:15:38.126023 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c87d4344-5772-4380-9e0e-81febea3539c tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:38.126481 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c87d4344-5772-4380-9e0e-81febea3539c tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:38.127243 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c87d4344-5772-4380-9e0e-81febea3539c tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:38.127681 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c87d4344-5772-4380-9e0e-81febea3539c tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:38.141189 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-c87d4344-5772-4380-9e0e-81febea3539c tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] HTTP exception thrown: Instance 753bfb35-eedb-435a-bf77-0eb788089251 could not be found. Jul 23 22:15:38.142780 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c87d4344-5772-4380-9e0e-81febea3539c tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Request method failure captured: Jul 23 22:15:38.142780 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/753bfb35-eedb-435a-bf77-0eb788089251 HTTP/1.1 Jul 23 22:15:38.142780 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 22:15:38.142780 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 22:15:38.142780 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 22:15:38.142780 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 22:15:38.142780 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 22:15:38.142780 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 22:15:38.142780 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 22:15:38.142780 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 22:15:38.142780 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3HIoewFR0SqpqLrj5I-sN7pNyjXsXXtQLkybI9vB6YsXdCaJ6oH3gw_3sQK2MiiJxU-U9GJtkTNRyRtiyWB74IsJErQO0QMayat2E8l_KlQxoCwZvuOOv2BFlgI59GiCbRO0itRDUcJc1lBv1Mjh_3cnjoEC2YbTi0_IAE5AJlU7TS0 Jul 23 22:15:38.142780 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 22:15:38.142780 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 22:15:38.142780 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 22:15:38.142780 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 22:15:38.142780 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 22:15:38.142780 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 22:15:38.142780 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 5ca8bc0082894aa6b90a714ddc6a6790 Jul 23 22:15:38.142780 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServerActionsTestJSON-1436267344 Jul 23 22:15:38.142780 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 22:15:38.142780 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 22:15:38.142780 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5ca8bc0082894aa6b90a714ddc6a6790"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5ca8bc0082894aa6b90a714ddc6a6790"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_5ca8bc0082894aa6b90a714ddc6a6790", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/5ca8bc0082894aa6b90a714ddc6a6790"}]}] Jul 23 22:15:38.142780 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServerActionsTestJSON-1436267344 Jul 23 22:15:38.142780 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 5ca8bc0082894aa6b90a714ddc6a6790 Jul 23 22:15:38.142780 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServerActionsTestJSON-1436267344 Jul 23 22:15:38.142780 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServerActionsTestJSON-1436267344-project Jul 23 22:15:38.142780 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 22:15:38.142780 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 22:15:38.142780 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 14820436f99c404b80194a1b985c76b1 Jul 23 22:15:38.142780 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServerActionsTestJSON-1436267344-project Jul 23 22:15:38.142780 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 22:15:38.142780 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance 753bfb35-eedb-435a-bf77-0eb788089251 could not be found. Jul 23 22:15:38.142780 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '753bfb35-eedb-435a-bf77-0eb788089251'} Jul 23 22:15:38.142780 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 22:15:38.142780 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:15:38.142780 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 22:15:38.142780 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 22:15:38.142780 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 22:15:38.142780 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 22:15:38.142780 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 22:15:38.142780 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 22:15:38.142780 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 22:15:38.142780 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 22:15:38.142780 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 753bfb35-eedb-435a-bf77-0eb788089251 could not be found. Jul 23 22:15:38.142780 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:15:38.142780 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:15:38.142780 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:15:38.142780 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:15:38.142780 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:15:38.142780 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:15:38.142780 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 22:15:38.142780 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 22:15:38.142780 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 22:15:38.142780 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 22:15:38.142780 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 22:15:38.142780 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 22:15:38.142780 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 22:15:38.142780 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 22:15:38.142780 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 22:15:38.142780 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 22:15:38.142780 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 753bfb35-eedb-435a-bf77-0eb788089251 could not be found. Jul 23 22:15:38.142780 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:15:38.142780 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:15:38.142780 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:15:38.146712 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:15:38.146712 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:15:38.146712 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:15:38.146712 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 22:15:38.146712 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 22:15:38.146712 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 753bfb35-eedb-435a-bf77-0eb788089251 could not be found. Jul 23 22:15:38.146712 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:15:38.146712 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c87d4344-5772-4380-9e0e-81febea3539c tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Returning 404 to user: Instance 753bfb35-eedb-435a-bf77-0eb788089251 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 22:15:38.146712 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c87d4344-5772-4380-9e0e-81febea3539c tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/753bfb35-eedb-435a-bf77-0eb788089251" status: 404 len: 111 microversion: 2.1 time: 0.028867 Jul 23 22:15:38.146712 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3639/6249] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:15:38 2022] GET /compute/v2.1/servers/753bfb35-eedb-435a-bf77-0eb788089251 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 22:15:38.193661 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8d33cafd-d5b8-40a3-a098-e97c16d008cc tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-265609228", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "networks": [{"uuid": "710bdc98-a85f-4879-a272-9349d503f3f7"}], "security_groups": [{"name": "tempest-securitygroup--2070004119"}], "key_name": "tempest-keypair-1953727802", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:15:38.311553 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-8d33cafd-d5b8-40a3-a098-e97c16d008cc tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] validate_networks() for [('710bdc98-a85f-4879-a272-9349d503f3f7', None, None, None, None, None)] {{(pid=131320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 22:15:38.692191 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-8d33cafd-d5b8-40a3-a098-e97c16d008cc tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 22:15:38.692653 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-8d33cafd-d5b8-40a3-a098-e97c16d008cc tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 22:15:38.693181 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-8d33cafd-d5b8-40a3-a098-e97c16d008cc tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 22:15:38.693597 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-8d33cafd-d5b8-40a3-a098-e97c16d008cc tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 22:15:38.694018 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-8d33cafd-d5b8-40a3-a098-e97c16d008cc tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 22:15:38.704557 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8d33cafd-d5b8-40a3-a098-e97c16d008cc tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:38.705010 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8d33cafd-d5b8-40a3-a098-e97c16d008cc tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:38.705833 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8d33cafd-d5b8-40a3-a098-e97c16d008cc tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:38.706315 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8d33cafd-d5b8-40a3-a098-e97c16d008cc tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:38.723878 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-8d33cafd-d5b8-40a3-a098-e97c16d008cc tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Getting quotas for project 5ca8bc0082894aa6b90a714ddc6a6790. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 22:15:38.729385 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-8d33cafd-d5b8-40a3-a098-e97c16d008cc tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Getting quotas for user 14820436f99c404b80194a1b985c76b1 and project 5ca8bc0082894aa6b90a714ddc6a6790. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 22:15:38.742990 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8d33cafd-d5b8-40a3-a098-e97c16d008cc tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Going to run 1 instances... {{(pid=131320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 22:15:38.745274 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8d33cafd-d5b8-40a3-a098-e97c16d008cc tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 5cd84109-0ec5-44be-ab76-43ae158bf4c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 22:15:38.794840 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8d33cafd-d5b8-40a3-a098-e97c16d008cc tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.604975 Jul 23 22:15:38.795491 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3640/6250] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 22:15:38 2022] POST /compute/v2.1/servers => generated 406 bytes in 606 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 23 22:15:38.806146 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-83879481-f1a4-4276-9f57-8edaf7196097 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:15:38.806146 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-83879481-f1a4-4276-9f57-8edaf7196097 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 5cd84109-0ec5-44be-ab76-43ae158bf4c7] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:15:38.860918 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-83879481-f1a4-4276-9f57-8edaf7196097 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:15:38.868753 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-83879481-f1a4-4276-9f57-8edaf7196097 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/5cd84109-0ec5-44be-ab76-43ae158bf4c7" status: 200 len: 1238 microversion: 2.1 time: 0.067077 Jul 23 22:15:38.869393 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3641/6251] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:15:38 2022] GET /compute/v2.1/servers/5cd84109-0ec5-44be-ab76-43ae158bf4c7 => generated 1238 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:15:39.886492 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-963aa373-9986-40b6-975f-00064d1bf1dc tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:15:39.887147 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-963aa373-9986-40b6-975f-00064d1bf1dc tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 5cd84109-0ec5-44be-ab76-43ae158bf4c7] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:15:39.895837 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-963aa373-9986-40b6-975f-00064d1bf1dc tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:39.896286 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-963aa373-9986-40b6-975f-00064d1bf1dc tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:39.897066 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-963aa373-9986-40b6-975f-00064d1bf1dc tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:39.897505 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-963aa373-9986-40b6-975f-00064d1bf1dc tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:39.960976 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-963aa373-9986-40b6-975f-00064d1bf1dc tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:15:39.968947 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-963aa373-9986-40b6-975f-00064d1bf1dc tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/5cd84109-0ec5-44be-ab76-43ae158bf4c7" status: 200 len: 1296 microversion: 2.1 time: 0.086398 Jul 23 22:15:39.979215 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3642/6252] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:15:39 2022] GET /compute/v2.1/servers/5cd84109-0ec5-44be-ab76-43ae158bf4c7 => generated 1296 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:15:40.987449 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b1520add-d961-4f55-9a0f-e987bb3dea8a tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:15:40.988106 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b1520add-d961-4f55-9a0f-e987bb3dea8a tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 5cd84109-0ec5-44be-ab76-43ae158bf4c7] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:15:40.995709 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b1520add-d961-4f55-9a0f-e987bb3dea8a tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:40.996247 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b1520add-d961-4f55-9a0f-e987bb3dea8a tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:40.997219 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b1520add-d961-4f55-9a0f-e987bb3dea8a tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:40.997880 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b1520add-d961-4f55-9a0f-e987bb3dea8a tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:41.158810 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b1520add-d961-4f55-9a0f-e987bb3dea8a tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:15:41.167668 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b1520add-d961-4f55-9a0f-e987bb3dea8a tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/5cd84109-0ec5-44be-ab76-43ae158bf4c7" status: 200 len: 1364 microversion: 2.1 time: 0.184232 Jul 23 22:15:41.180178 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3643/6253] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:15:40 2022] GET /compute/v2.1/servers/5cd84109-0ec5-44be-ab76-43ae158bf4c7 => generated 1364 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:15:41.185635 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-51b9453b-7eeb-4281-aa55-cb6b1620a12f req-b4f448bc-75af-47a8-863a-0f067ef6dbbf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cd84109-0ec5-44be-ab76-43ae158bf4c7", "tag": "bcf6b344-286a-42ae-88a4-1d76377a204c"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:15:41.194520 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-51b9453b-7eeb-4281-aa55-cb6b1620a12f req-b4f448bc-75af-47a8-863a-0f067ef6dbbf service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:41.194967 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-51b9453b-7eeb-4281-aa55-cb6b1620a12f req-b4f448bc-75af-47a8-863a-0f067ef6dbbf service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:41.207380 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-51b9453b-7eeb-4281-aa55-cb6b1620a12f req-b4f448bc-75af-47a8-863a-0f067ef6dbbf service nova] Creating event network-changed:bcf6b344-286a-42ae-88a4-1d76377a204c for instance 5cd84109-0ec5-44be-ab76-43ae158bf4c7 on nch2-master-1 Jul 23 22:15:41.215263 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-51b9453b-7eeb-4281-aa55-cb6b1620a12f req-b4f448bc-75af-47a8-863a-0f067ef6dbbf service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033612 Jul 23 22:15:41.215941 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3644/6254] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:15:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:15:42.189889 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-20e4774c-936f-4513-971b-9c6fee36b45a tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:15:42.190539 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-20e4774c-936f-4513-971b-9c6fee36b45a tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 5cd84109-0ec5-44be-ab76-43ae158bf4c7] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:15:42.197442 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-20e4774c-936f-4513-971b-9c6fee36b45a tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:42.197897 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-20e4774c-936f-4513-971b-9c6fee36b45a tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:42.198710 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-20e4774c-936f-4513-971b-9c6fee36b45a tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:42.199124 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-20e4774c-936f-4513-971b-9c6fee36b45a tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:42.340609 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-20e4774c-936f-4513-971b-9c6fee36b45a tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:15:42.348464 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-20e4774c-936f-4513-971b-9c6fee36b45a tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/5cd84109-0ec5-44be-ab76-43ae158bf4c7" status: 200 len: 1364 microversion: 2.1 time: 0.165306 Jul 23 22:15:42.349038 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3645/6255] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:15:42 2022] GET /compute/v2.1/servers/5cd84109-0ec5-44be-ab76-43ae158bf4c7 => generated 1364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:15:43.370621 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8386e9cb-2d6e-4b94-8656-b5af07a23c72 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:15:43.371681 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8386e9cb-2d6e-4b94-8656-b5af07a23c72 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 5cd84109-0ec5-44be-ab76-43ae158bf4c7] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:15:43.384561 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8386e9cb-2d6e-4b94-8656-b5af07a23c72 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:43.385319 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8386e9cb-2d6e-4b94-8656-b5af07a23c72 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:43.386648 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8386e9cb-2d6e-4b94-8656-b5af07a23c72 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:43.387383 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8386e9cb-2d6e-4b94-8656-b5af07a23c72 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:43.519635 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8386e9cb-2d6e-4b94-8656-b5af07a23c72 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:15:43.527565 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8386e9cb-2d6e-4b94-8656-b5af07a23c72 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/5cd84109-0ec5-44be-ab76-43ae158bf4c7" status: 200 len: 1364 microversion: 2.1 time: 0.163695 Jul 23 22:15:43.528120 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3646/6256] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:15:43 2022] GET /compute/v2.1/servers/5cd84109-0ec5-44be-ab76-43ae158bf4c7 => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:15:44.545352 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-fedfc05d-2f97-46a9-8096-f46327e7f525 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:15:44.546095 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-fedfc05d-2f97-46a9-8096-f46327e7f525 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 5cd84109-0ec5-44be-ab76-43ae158bf4c7] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:15:44.554033 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fedfc05d-2f97-46a9-8096-f46327e7f525 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:44.554633 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fedfc05d-2f97-46a9-8096-f46327e7f525 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:44.555437 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fedfc05d-2f97-46a9-8096-f46327e7f525 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:44.555890 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fedfc05d-2f97-46a9-8096-f46327e7f525 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:44.575851 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:15:44.700937 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-fedfc05d-2f97-46a9-8096-f46327e7f525 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:15:44.708868 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-fedfc05d-2f97-46a9-8096-f46327e7f525 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/5cd84109-0ec5-44be-ab76-43ae158bf4c7" status: 200 len: 1364 microversion: 2.1 time: 0.167873 Jul 23 22:15:44.709463 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3647/6257] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:15:44 2022] GET /compute/v2.1/servers/5cd84109-0ec5-44be-ab76-43ae158bf4c7 => generated 1364 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:15:45.729399 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0fb93232-b798-4e3f-a80a-dc133afaf45d tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:15:45.730447 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-0fb93232-b798-4e3f-a80a-dc133afaf45d tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 5cd84109-0ec5-44be-ab76-43ae158bf4c7] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:15:45.739260 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0fb93232-b798-4e3f-a80a-dc133afaf45d tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:45.739723 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0fb93232-b798-4e3f-a80a-dc133afaf45d tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:45.740510 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0fb93232-b798-4e3f-a80a-dc133afaf45d tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:45.740961 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0fb93232-b798-4e3f-a80a-dc133afaf45d tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:45.876144 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-0fb93232-b798-4e3f-a80a-dc133afaf45d tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:15:45.888178 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-0fb93232-b798-4e3f-a80a-dc133afaf45d tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/5cd84109-0ec5-44be-ab76-43ae158bf4c7" status: 200 len: 1364 microversion: 2.1 time: 0.164859 Jul 23 22:15:45.888788 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3648/6258] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:15:45 2022] GET /compute/v2.1/servers/5cd84109-0ec5-44be-ab76-43ae158bf4c7 => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:15:46.629224 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-0bb3310b-7826-473b-bd5f-45d440e06fb8 req-e80df7eb-b3a0-4473-84a4-1bb3781ce619 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cd84109-0ec5-44be-ab76-43ae158bf4c7", "name": "network-vif-plugged", "status": "completed", "tag": "bcf6b344-286a-42ae-88a4-1d76377a204c"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:15:46.638646 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-0bb3310b-7826-473b-bd5f-45d440e06fb8 req-e80df7eb-b3a0-4473-84a4-1bb3781ce619 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:46.639154 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-0bb3310b-7826-473b-bd5f-45d440e06fb8 req-e80df7eb-b3a0-4473-84a4-1bb3781ce619 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:46.652183 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-0bb3310b-7826-473b-bd5f-45d440e06fb8 req-e80df7eb-b3a0-4473-84a4-1bb3781ce619 service nova] Creating event network-vif-plugged:bcf6b344-286a-42ae-88a4-1d76377a204c for instance 5cd84109-0ec5-44be-ab76-43ae158bf4c7 on nch2-master-1 Jul 23 22:15:46.657761 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-0bb3310b-7826-473b-bd5f-45d440e06fb8 req-e80df7eb-b3a0-4473-84a4-1bb3781ce619 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032435 Jul 23 22:15:46.658695 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3649/6259] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:15:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:15:46.911250 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9255ecd8-648d-412e-b7d2-3ce12c8a203c tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:15:46.912425 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-9255ecd8-648d-412e-b7d2-3ce12c8a203c tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 5cd84109-0ec5-44be-ab76-43ae158bf4c7] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:15:46.923673 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9255ecd8-648d-412e-b7d2-3ce12c8a203c tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:46.924121 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9255ecd8-648d-412e-b7d2-3ce12c8a203c tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:46.925218 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9255ecd8-648d-412e-b7d2-3ce12c8a203c tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:46.925659 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9255ecd8-648d-412e-b7d2-3ce12c8a203c tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:47.061912 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-9255ecd8-648d-412e-b7d2-3ce12c8a203c tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:15:47.074340 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9255ecd8-648d-412e-b7d2-3ce12c8a203c tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/5cd84109-0ec5-44be-ab76-43ae158bf4c7" status: 200 len: 1364 microversion: 2.1 time: 0.169616 Jul 23 22:15:47.075106 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3650/6260] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:15:46 2022] GET /compute/v2.1/servers/5cd84109-0ec5-44be-ab76-43ae158bf4c7 => generated 1364 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:15:48.096738 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9aabaf46-163e-4766-b6a9-dcb97fd16937 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:15:48.097353 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-9aabaf46-163e-4766-b6a9-dcb97fd16937 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 5cd84109-0ec5-44be-ab76-43ae158bf4c7] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:15:48.104685 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9aabaf46-163e-4766-b6a9-dcb97fd16937 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:48.105132 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9aabaf46-163e-4766-b6a9-dcb97fd16937 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:48.105907 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9aabaf46-163e-4766-b6a9-dcb97fd16937 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:48.106369 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9aabaf46-163e-4766-b6a9-dcb97fd16937 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:48.237795 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-9aabaf46-163e-4766-b6a9-dcb97fd16937 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:15:48.245447 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9aabaf46-163e-4766-b6a9-dcb97fd16937 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/5cd84109-0ec5-44be-ab76-43ae158bf4c7" status: 200 len: 1551 microversion: 2.1 time: 0.154370 Jul 23 22:15:48.246062 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3651/6261] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:15:48 2022] GET /compute/v2.1/servers/5cd84109-0ec5-44be-ab76-43ae158bf4c7 => generated 1551 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:15:48.262428 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-13622308-cb7b-4b39-8ff5-7deb86667143 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:15:48.262927 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-13622308-cb7b-4b39-8ff5-7deb86667143 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 5cd84109-0ec5-44be-ab76-43ae158bf4c7] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:15:48.269418 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-13622308-cb7b-4b39-8ff5-7deb86667143 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:48.269903 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-13622308-cb7b-4b39-8ff5-7deb86667143 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:48.270668 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-13622308-cb7b-4b39-8ff5-7deb86667143 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:48.271102 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-13622308-cb7b-4b39-8ff5-7deb86667143 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:48.357928 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-13622308-cb7b-4b39-8ff5-7deb86667143 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/5cd84109-0ec5-44be-ab76-43ae158bf4c7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.098884 Jul 23 22:15:48.358876 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3652/6262] 10.222.0.17 () {58 vars in 1274 bytes} [Sat Jul 23 22:15:48 2022] GET /compute/v2.1/servers/5cd84109-0ec5-44be-ab76-43ae158bf4c7/os-interface => generated 285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:15:49.313188 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:15:49.314489 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=8 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:15:49.321385 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-507fd98c-a01f-48c9-bd1d-bc9fb5349af0 req-2cfb81f9-619f-457d-a3c6-dbff5e483019 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cd84109-0ec5-44be-ab76-43ae158bf4c7", "tag": "bcf6b344-286a-42ae-88a4-1d76377a204c"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:15:49.331391 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-507fd98c-a01f-48c9-bd1d-bc9fb5349af0 req-2cfb81f9-619f-457d-a3c6-dbff5e483019 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:15:49.331837 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-507fd98c-a01f-48c9-bd1d-bc9fb5349af0 req-2cfb81f9-619f-457d-a3c6-dbff5e483019 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:15:49.344258 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-507fd98c-a01f-48c9-bd1d-bc9fb5349af0 req-2cfb81f9-619f-457d-a3c6-dbff5e483019 service nova] Creating event network-changed:bcf6b344-286a-42ae-88a4-1d76377a204c for instance 5cd84109-0ec5-44be-ab76-43ae158bf4c7 on nch2-master-1 Jul 23 22:15:49.349507 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-507fd98c-a01f-48c9-bd1d-bc9fb5349af0 req-2cfb81f9-619f-457d-a3c6-dbff5e483019 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039795 Jul 23 22:15:49.350196 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3653/6263] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:15:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:16:23.780297 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ae3e0c72-a316-4c3c-a99e-e81efab0a525 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:16:23.780987 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ae3e0c72-a316-4c3c-a99e-e81efab0a525 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 5cd84109-0ec5-44be-ab76-43ae158bf4c7] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:16:23.783408 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:16:23.784169 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=28 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:16:23.790971 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ae3e0c72-a316-4c3c-a99e-e81efab0a525 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:16:23.791429 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ae3e0c72-a316-4c3c-a99e-e81efab0a525 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:16:23.792228 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ae3e0c72-a316-4c3c-a99e-e81efab0a525 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:16:23.792685 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ae3e0c72-a316-4c3c-a99e-e81efab0a525 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:16:23.933284 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ae3e0c72-a316-4c3c-a99e-e81efab0a525 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:16:23.944375 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ae3e0c72-a316-4c3c-a99e-e81efab0a525 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/5cd84109-0ec5-44be-ab76-43ae158bf4c7" status: 200 len: 1669 microversion: 2.1 time: 0.168288 Jul 23 22:16:23.945107 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3654/6264] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:16:23 2022] GET /compute/v2.1/servers/5cd84109-0ec5-44be-ab76-43ae158bf4c7 => generated 1669 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:16:24.101480 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f2f42260-a14d-4e3a-8588-e68c64152e3a tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:16:24.102023 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f2f42260-a14d-4e3a-8588-e68c64152e3a tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 5cd84109-0ec5-44be-ab76-43ae158bf4c7] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:16:24.108364 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f2f42260-a14d-4e3a-8588-e68c64152e3a tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:16:24.108826 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f2f42260-a14d-4e3a-8588-e68c64152e3a tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:16:24.109596 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f2f42260-a14d-4e3a-8588-e68c64152e3a tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:16:24.110075 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f2f42260-a14d-4e3a-8588-e68c64152e3a tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:16:24.135495 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f2f42260-a14d-4e3a-8588-e68c64152e3a tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 5cd84109-0ec5-44be-ab76-43ae158bf4c7] Going to try to terminate instance {{(pid=131320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 22:16:24.216980 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f2f42260-a14d-4e3a-8588-e68c64152e3a tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "DELETE /compute/v2.1/servers/5cd84109-0ec5-44be-ab76-43ae158bf4c7" status: 204 len: 0 microversion: 2.1 time: 0.119191 Jul 23 22:16:24.217794 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3655/6265] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 22:16:24 2022] DELETE /compute/v2.1/servers/5cd84109-0ec5-44be-ab76-43ae158bf4c7 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 22:16:24.226091 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1211a691-3260-4f24-8558-667d90feb61a tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:16:24.226794 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1211a691-3260-4f24-8558-667d90feb61a tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 5cd84109-0ec5-44be-ab76-43ae158bf4c7] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:16:24.233067 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1211a691-3260-4f24-8558-667d90feb61a tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:16:24.233530 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1211a691-3260-4f24-8558-667d90feb61a tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:16:24.234407 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1211a691-3260-4f24-8558-667d90feb61a tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:16:24.234778 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1211a691-3260-4f24-8558-667d90feb61a tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:16:24.372536 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-1211a691-3260-4f24-8558-667d90feb61a tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:16:24.380328 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1211a691-3260-4f24-8558-667d90feb61a tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/5cd84109-0ec5-44be-ab76-43ae158bf4c7" status: 200 len: 1675 microversion: 2.1 time: 0.158421 Jul 23 22:16:24.380919 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3656/6266] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:16:24 2022] GET /compute/v2.1/servers/5cd84109-0ec5-44be-ab76-43ae158bf4c7 => generated 1675 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:16:25.398162 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c031661a-339d-4cc9-b5f7-782a34821b7c tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:16:25.398858 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c031661a-339d-4cc9-b5f7-782a34821b7c tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 5cd84109-0ec5-44be-ab76-43ae158bf4c7] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:16:25.406409 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c031661a-339d-4cc9-b5f7-782a34821b7c tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:16:25.406893 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c031661a-339d-4cc9-b5f7-782a34821b7c tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:16:25.407684 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c031661a-339d-4cc9-b5f7-782a34821b7c tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:16:25.408117 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c031661a-339d-4cc9-b5f7-782a34821b7c tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:16:25.539676 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c031661a-339d-4cc9-b5f7-782a34821b7c tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:16:25.547800 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c031661a-339d-4cc9-b5f7-782a34821b7c tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/5cd84109-0ec5-44be-ab76-43ae158bf4c7" status: 200 len: 1675 microversion: 2.1 time: 0.153720 Jul 23 22:16:25.548389 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3657/6267] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:16:25 2022] GET /compute/v2.1/servers/5cd84109-0ec5-44be-ab76-43ae158bf4c7 => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:16:26.377346 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-4dbd8fa8-ecd6-4d31-92f9-1c39e32fd89b req-d3085972-cfe3-487e-8b75-b447bcfc104d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cd84109-0ec5-44be-ab76-43ae158bf4c7", "name": "network-vif-deleted", "tag": "bcf6b344-286a-42ae-88a4-1d76377a204c"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:16:26.387219 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-4dbd8fa8-ecd6-4d31-92f9-1c39e32fd89b req-d3085972-cfe3-487e-8b75-b447bcfc104d service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:16:26.388270 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-4dbd8fa8-ecd6-4d31-92f9-1c39e32fd89b req-d3085972-cfe3-487e-8b75-b447bcfc104d service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:16:26.401832 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-4dbd8fa8-ecd6-4d31-92f9-1c39e32fd89b req-d3085972-cfe3-487e-8b75-b447bcfc104d service nova] Creating event network-vif-deleted:bcf6b344-286a-42ae-88a4-1d76377a204c for instance 5cd84109-0ec5-44be-ab76-43ae158bf4c7 on nch2-master-1 Jul 23 22:16:26.407882 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-4dbd8fa8-ecd6-4d31-92f9-1c39e32fd89b req-d3085972-cfe3-487e-8b75-b447bcfc104d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034065 Jul 23 22:16:26.409062 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3658/6268] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:16:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:16:26.566734 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e6820548-7c3b-470b-9472-2325b4283894 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:16:26.567540 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e6820548-7c3b-470b-9472-2325b4283894 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 5cd84109-0ec5-44be-ab76-43ae158bf4c7] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:16:26.577100 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e6820548-7c3b-470b-9472-2325b4283894 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:16:26.577551 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e6820548-7c3b-470b-9472-2325b4283894 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:16:26.578374 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e6820548-7c3b-470b-9472-2325b4283894 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:16:26.578976 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e6820548-7c3b-470b-9472-2325b4283894 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:16:26.614305 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e6820548-7c3b-470b-9472-2325b4283894 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:16:26.614744 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e6820548-7c3b-470b-9472-2325b4283894 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:16:26.615199 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.objects.instance [None req-e6820548-7c3b-470b-9472-2325b4283894 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lazy-loading 'fault' on Instance uuid 5cd84109-0ec5-44be-ab76-43ae158bf4c7 {{(pid=131320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 22:16:26.660108 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e6820548-7c3b-470b-9472-2325b4283894 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14820436f99c404b80194a1b985c76b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ca8bc0082894aa6b90a714ddc6a6790', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:16:26.667700 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e6820548-7c3b-470b-9472-2325b4283894 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/5cd84109-0ec5-44be-ab76-43ae158bf4c7" status: 200 len: 1328 microversion: 2.1 time: 0.106614 Jul 23 22:16:26.668611 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3659/6269] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:16:26 2022] GET /compute/v2.1/servers/5cd84109-0ec5-44be-ab76-43ae158bf4c7 => generated 1328 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:16:27.688791 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5848bca8-1e98-429e-b032-81fbadc2cf49 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:16:27.689933 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5848bca8-1e98-429e-b032-81fbadc2cf49 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 5cd84109-0ec5-44be-ab76-43ae158bf4c7] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:16:27.701360 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5848bca8-1e98-429e-b032-81fbadc2cf49 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:16:27.701811 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5848bca8-1e98-429e-b032-81fbadc2cf49 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:16:27.702621 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5848bca8-1e98-429e-b032-81fbadc2cf49 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:16:27.703059 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5848bca8-1e98-429e-b032-81fbadc2cf49 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:16:27.716872 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-5848bca8-1e98-429e-b032-81fbadc2cf49 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] HTTP exception thrown: Instance 5cd84109-0ec5-44be-ab76-43ae158bf4c7 could not be found. Jul 23 22:16:27.718571 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5848bca8-1e98-429e-b032-81fbadc2cf49 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Request method failure captured: Jul 23 22:16:27.718571 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/5cd84109-0ec5-44be-ab76-43ae158bf4c7 HTTP/1.1 Jul 23 22:16:27.718571 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 22:16:27.718571 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 22:16:27.718571 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 22:16:27.718571 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 22:16:27.718571 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 22:16:27.718571 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 22:16:27.718571 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 22:16:27.718571 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 22:16:27.718571 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3HIoewFR0SqpqLrj5I-sN7pNyjXsXXtQLkybI9vB6YsXdCaJ6oH3gw_3sQK2MiiJxU-U9GJtkTNRyRtiyWB74IsJErQO0QMayat2E8l_KlQxoCwZvuOOv2BFlgI59GiCbRO0itRDUcJc1lBv1Mjh_3cnjoEC2YbTi0_IAE5AJlU7TS0 Jul 23 22:16:27.718571 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 22:16:27.718571 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 22:16:27.718571 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 22:16:27.718571 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 22:16:27.718571 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 22:16:27.718571 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 22:16:27.718571 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 5ca8bc0082894aa6b90a714ddc6a6790 Jul 23 22:16:27.718571 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServerActionsTestJSON-1436267344 Jul 23 22:16:27.718571 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 22:16:27.718571 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 22:16:27.718571 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5ca8bc0082894aa6b90a714ddc6a6790"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5ca8bc0082894aa6b90a714ddc6a6790"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_5ca8bc0082894aa6b90a714ddc6a6790", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/5ca8bc0082894aa6b90a714ddc6a6790"}]}] Jul 23 22:16:27.718571 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServerActionsTestJSON-1436267344 Jul 23 22:16:27.718571 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 5ca8bc0082894aa6b90a714ddc6a6790 Jul 23 22:16:27.718571 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServerActionsTestJSON-1436267344 Jul 23 22:16:27.718571 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServerActionsTestJSON-1436267344-project Jul 23 22:16:27.718571 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 22:16:27.718571 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 22:16:27.718571 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 14820436f99c404b80194a1b985c76b1 Jul 23 22:16:27.718571 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServerActionsTestJSON-1436267344-project Jul 23 22:16:27.718571 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 22:16:27.718571 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance 5cd84109-0ec5-44be-ab76-43ae158bf4c7 could not be found. Jul 23 22:16:27.718571 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '5cd84109-0ec5-44be-ab76-43ae158bf4c7'} Jul 23 22:16:27.718571 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 22:16:27.718571 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:16:27.718571 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 22:16:27.718571 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 22:16:27.718571 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 22:16:27.718571 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 22:16:27.718571 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 22:16:27.718571 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 22:16:27.718571 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 22:16:27.718571 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 22:16:27.718571 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5cd84109-0ec5-44be-ab76-43ae158bf4c7 could not be found. Jul 23 22:16:27.718571 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:16:27.718571 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:16:27.718571 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:16:27.718571 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:16:27.718571 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:16:27.718571 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:16:27.718571 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 22:16:27.718571 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 22:16:27.718571 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 22:16:27.718571 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 22:16:27.718571 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 22:16:27.718571 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 22:16:27.718571 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 22:16:27.718571 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 22:16:27.718571 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 22:16:27.718571 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 22:16:27.718571 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5cd84109-0ec5-44be-ab76-43ae158bf4c7 could not be found. Jul 23 22:16:27.718571 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:16:27.718571 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:16:27.718571 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:16:27.722284 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:16:27.722284 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:16:27.722284 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:16:27.722284 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 22:16:27.722284 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 22:16:27.722284 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5cd84109-0ec5-44be-ab76-43ae158bf4c7 could not be found. Jul 23 22:16:27.722284 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:16:27.722284 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5848bca8-1e98-429e-b032-81fbadc2cf49 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Returning 404 to user: Instance 5cd84109-0ec5-44be-ab76-43ae158bf4c7 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 22:16:27.722284 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5848bca8-1e98-429e-b032-81fbadc2cf49 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/5cd84109-0ec5-44be-ab76-43ae158bf4c7" status: 404 len: 111 microversion: 2.1 time: 0.037835 Jul 23 22:16:27.722284 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3660/6270] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:16:27 2022] GET /compute/v2.1/servers/5cd84109-0ec5-44be-ab76-43ae158bf4c7 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 22:16:27.728162 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-34ef4826-0cc2-4fb8-8b50-827f9a801480 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:16:27.728655 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-34ef4826-0cc2-4fb8-8b50-827f9a801480 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 753bfb35-eedb-435a-bf77-0eb788089251] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:16:27.734645 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-34ef4826-0cc2-4fb8-8b50-827f9a801480 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:16:27.735126 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-34ef4826-0cc2-4fb8-8b50-827f9a801480 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:16:27.735880 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-34ef4826-0cc2-4fb8-8b50-827f9a801480 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:16:27.736316 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-34ef4826-0cc2-4fb8-8b50-827f9a801480 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:16:27.749709 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-34ef4826-0cc2-4fb8-8b50-827f9a801480 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] HTTP exception thrown: Instance 753bfb35-eedb-435a-bf77-0eb788089251 could not be found. Jul 23 22:16:27.751256 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-34ef4826-0cc2-4fb8-8b50-827f9a801480 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Request method failure captured: Jul 23 22:16:27.751256 ncdv-master-1 devstack@n-api.service[131320]: request: DELETE /compute/v2.1/servers/753bfb35-eedb-435a-bf77-0eb788089251 HTTP/1.1 Jul 23 22:16:27.751256 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 22:16:27.751256 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 22:16:27.751256 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 22:16:27.751256 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 22:16:27.751256 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 22:16:27.751256 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 22:16:27.751256 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 22:16:27.751256 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 22:16:27.751256 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3HIoewFR0SqpqLrj5I-sN7pNyjXsXXtQLkybI9vB6YsXdCaJ6oH3gw_3sQK2MiiJxU-U9GJtkTNRyRtiyWB74IsJErQO0QMayat2E8l_KlQxoCwZvuOOv2BFlgI59GiCbRO0itRDUcJc1lBv1Mjh_3cnjoEC2YbTi0_IAE5AJlU7TS0 Jul 23 22:16:27.751256 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 22:16:27.751256 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 22:16:27.751256 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 22:16:27.751256 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 22:16:27.751256 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 22:16:27.751256 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 22:16:27.751256 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 5ca8bc0082894aa6b90a714ddc6a6790 Jul 23 22:16:27.751256 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServerActionsTestJSON-1436267344 Jul 23 22:16:27.751256 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 22:16:27.751256 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 22:16:27.751256 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5ca8bc0082894aa6b90a714ddc6a6790"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5ca8bc0082894aa6b90a714ddc6a6790"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_5ca8bc0082894aa6b90a714ddc6a6790", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/5ca8bc0082894aa6b90a714ddc6a6790"}]}] Jul 23 22:16:27.751256 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServerActionsTestJSON-1436267344 Jul 23 22:16:27.751256 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 5ca8bc0082894aa6b90a714ddc6a6790 Jul 23 22:16:27.751256 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServerActionsTestJSON-1436267344 Jul 23 22:16:27.751256 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServerActionsTestJSON-1436267344-project Jul 23 22:16:27.751256 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 22:16:27.751256 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 22:16:27.751256 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 14820436f99c404b80194a1b985c76b1 Jul 23 22:16:27.751256 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServerActionsTestJSON-1436267344-project Jul 23 22:16:27.751256 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 22:16:27.751256 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance 753bfb35-eedb-435a-bf77-0eb788089251 could not be found. Jul 23 22:16:27.751256 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '753bfb35-eedb-435a-bf77-0eb788089251'} Jul 23 22:16:27.751256 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 22:16:27.751256 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:16:27.751256 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 22:16:27.751256 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 22:16:27.751256 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 22:16:27.751256 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 22:16:27.751256 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 22:16:27.751256 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 22:16:27.751256 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 22:16:27.751256 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 22:16:27.751256 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 753bfb35-eedb-435a-bf77-0eb788089251 could not be found. Jul 23 22:16:27.751256 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:16:27.751256 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:16:27.751256 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:16:27.751256 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:16:27.751256 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:16:27.751256 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:16:27.751256 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 22:16:27.751256 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 22:16:27.751256 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 22:16:27.751256 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 22:16:27.751256 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 23 22:16:27.751256 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 23 22:16:27.751256 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 23 22:16:27.751256 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 23 22:16:27.751256 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 22:16:27.751256 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 22:16:27.751256 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 22:16:27.751256 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 22:16:27.754973 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 753bfb35-eedb-435a-bf77-0eb788089251 could not be found. Jul 23 22:16:27.754973 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:16:27.754973 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:16:27.754973 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:16:27.754973 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:16:27.754973 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:16:27.754973 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:16:27.754973 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 22:16:27.754973 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 22:16:27.754973 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 753bfb35-eedb-435a-bf77-0eb788089251 could not be found. Jul 23 22:16:27.754973 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:16:27.754973 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-34ef4826-0cc2-4fb8-8b50-827f9a801480 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Returning 404 to user: Instance 753bfb35-eedb-435a-bf77-0eb788089251 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 22:16:27.754973 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-34ef4826-0cc2-4fb8-8b50-827f9a801480 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "DELETE /compute/v2.1/servers/753bfb35-eedb-435a-bf77-0eb788089251" status: 404 len: 111 microversion: 2.1 time: 0.027993 Jul 23 22:16:27.754973 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3661/6271] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 22:16:27 2022] DELETE /compute/v2.1/servers/753bfb35-eedb-435a-bf77-0eb788089251 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 23 22:16:27.760834 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-17a2e8be-453c-476a-9585-5adc7ea8f7c6 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:16:27.761444 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-17a2e8be-453c-476a-9585-5adc7ea8f7c6 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 753bfb35-eedb-435a-bf77-0eb788089251] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:16:27.767394 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-17a2e8be-453c-476a-9585-5adc7ea8f7c6 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:16:27.767845 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-17a2e8be-453c-476a-9585-5adc7ea8f7c6 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:16:27.768596 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-17a2e8be-453c-476a-9585-5adc7ea8f7c6 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:16:27.769034 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-17a2e8be-453c-476a-9585-5adc7ea8f7c6 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:16:27.782689 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-17a2e8be-453c-476a-9585-5adc7ea8f7c6 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] HTTP exception thrown: Instance 753bfb35-eedb-435a-bf77-0eb788089251 could not be found. Jul 23 22:16:27.784183 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-17a2e8be-453c-476a-9585-5adc7ea8f7c6 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Request method failure captured: Jul 23 22:16:27.784183 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/753bfb35-eedb-435a-bf77-0eb788089251 HTTP/1.1 Jul 23 22:16:27.784183 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 22:16:27.784183 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 22:16:27.784183 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 22:16:27.784183 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 22:16:27.784183 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 22:16:27.784183 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 22:16:27.784183 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 22:16:27.784183 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 22:16:27.784183 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3HIoewFR0SqpqLrj5I-sN7pNyjXsXXtQLkybI9vB6YsXdCaJ6oH3gw_3sQK2MiiJxU-U9GJtkTNRyRtiyWB74IsJErQO0QMayat2E8l_KlQxoCwZvuOOv2BFlgI59GiCbRO0itRDUcJc1lBv1Mjh_3cnjoEC2YbTi0_IAE5AJlU7TS0 Jul 23 22:16:27.784183 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 22:16:27.784183 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 22:16:27.784183 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 22:16:27.784183 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 22:16:27.784183 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 22:16:27.784183 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 22:16:27.784183 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 5ca8bc0082894aa6b90a714ddc6a6790 Jul 23 22:16:27.784183 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServerActionsTestJSON-1436267344 Jul 23 22:16:27.784183 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 22:16:27.784183 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 22:16:27.784183 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5ca8bc0082894aa6b90a714ddc6a6790"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5ca8bc0082894aa6b90a714ddc6a6790"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_5ca8bc0082894aa6b90a714ddc6a6790", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/5ca8bc0082894aa6b90a714ddc6a6790"}]}] Jul 23 22:16:27.784183 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServerActionsTestJSON-1436267344 Jul 23 22:16:27.784183 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 5ca8bc0082894aa6b90a714ddc6a6790 Jul 23 22:16:27.784183 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServerActionsTestJSON-1436267344 Jul 23 22:16:27.784183 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServerActionsTestJSON-1436267344-project Jul 23 22:16:27.784183 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 22:16:27.784183 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 22:16:27.784183 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 14820436f99c404b80194a1b985c76b1 Jul 23 22:16:27.784183 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServerActionsTestJSON-1436267344-project Jul 23 22:16:27.784183 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 22:16:27.784183 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance 753bfb35-eedb-435a-bf77-0eb788089251 could not be found. Jul 23 22:16:27.784183 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '753bfb35-eedb-435a-bf77-0eb788089251'} Jul 23 22:16:27.784183 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 22:16:27.784183 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:16:27.784183 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 22:16:27.784183 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 22:16:27.784183 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 22:16:27.784183 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 22:16:27.784183 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 22:16:27.784183 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 22:16:27.784183 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 22:16:27.784183 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 22:16:27.784183 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 753bfb35-eedb-435a-bf77-0eb788089251 could not be found. Jul 23 22:16:27.784183 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:16:27.784183 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:16:27.784183 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:16:27.784183 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:16:27.784183 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:16:27.784183 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:16:27.784183 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 22:16:27.784183 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 22:16:27.784183 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 22:16:27.784183 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 22:16:27.784183 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 22:16:27.784183 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 22:16:27.784183 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 22:16:27.784183 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 22:16:27.784183 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 22:16:27.784183 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 22:16:27.784183 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 753bfb35-eedb-435a-bf77-0eb788089251 could not be found. Jul 23 22:16:27.784183 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:16:27.784183 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:16:27.784183 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:16:27.788353 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:16:27.788353 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:16:27.788353 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:16:27.788353 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 22:16:27.788353 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 22:16:27.788353 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 753bfb35-eedb-435a-bf77-0eb788089251 could not be found. Jul 23 22:16:27.788353 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:16:27.788353 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-17a2e8be-453c-476a-9585-5adc7ea8f7c6 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Returning 404 to user: Instance 753bfb35-eedb-435a-bf77-0eb788089251 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 22:16:27.788353 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-17a2e8be-453c-476a-9585-5adc7ea8f7c6 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/753bfb35-eedb-435a-bf77-0eb788089251" status: 404 len: 111 microversion: 2.1 time: 0.028326 Jul 23 22:16:27.788353 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3662/6272] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:16:27 2022] GET /compute/v2.1/servers/753bfb35-eedb-435a-bf77-0eb788089251 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 22:16:27.793559 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-fbb33e17-ed7a-481e-be9b-ed7d92caeebd tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:16:27.794081 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-fbb33e17-ed7a-481e-be9b-ed7d92caeebd tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 8eb3cba5-d03f-4320-acfb-820bcec3f7a9] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:16:27.799889 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fbb33e17-ed7a-481e-be9b-ed7d92caeebd tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:16:27.800336 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fbb33e17-ed7a-481e-be9b-ed7d92caeebd tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:16:27.801089 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fbb33e17-ed7a-481e-be9b-ed7d92caeebd tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:16:27.801519 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fbb33e17-ed7a-481e-be9b-ed7d92caeebd tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:16:27.815052 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-fbb33e17-ed7a-481e-be9b-ed7d92caeebd tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] HTTP exception thrown: Instance 8eb3cba5-d03f-4320-acfb-820bcec3f7a9 could not be found. Jul 23 22:16:27.816940 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-fbb33e17-ed7a-481e-be9b-ed7d92caeebd tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Request method failure captured: Jul 23 22:16:27.816940 ncdv-master-1 devstack@n-api.service[131320]: request: DELETE /compute/v2.1/servers/8eb3cba5-d03f-4320-acfb-820bcec3f7a9 HTTP/1.1 Jul 23 22:16:27.816940 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 22:16:27.816940 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 22:16:27.816940 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 22:16:27.816940 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 22:16:27.816940 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 22:16:27.816940 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 22:16:27.816940 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 22:16:27.816940 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 22:16:27.816940 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3HIoewFR0SqpqLrj5I-sN7pNyjXsXXtQLkybI9vB6YsXdCaJ6oH3gw_3sQK2MiiJxU-U9GJtkTNRyRtiyWB74IsJErQO0QMayat2E8l_KlQxoCwZvuOOv2BFlgI59GiCbRO0itRDUcJc1lBv1Mjh_3cnjoEC2YbTi0_IAE5AJlU7TS0 Jul 23 22:16:27.816940 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 22:16:27.816940 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 22:16:27.816940 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 22:16:27.816940 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 22:16:27.816940 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 22:16:27.816940 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 22:16:27.816940 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 5ca8bc0082894aa6b90a714ddc6a6790 Jul 23 22:16:27.816940 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServerActionsTestJSON-1436267344 Jul 23 22:16:27.816940 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 22:16:27.816940 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 22:16:27.816940 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5ca8bc0082894aa6b90a714ddc6a6790"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5ca8bc0082894aa6b90a714ddc6a6790"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_5ca8bc0082894aa6b90a714ddc6a6790", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/5ca8bc0082894aa6b90a714ddc6a6790"}]}] Jul 23 22:16:27.816940 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServerActionsTestJSON-1436267344 Jul 23 22:16:27.816940 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 5ca8bc0082894aa6b90a714ddc6a6790 Jul 23 22:16:27.816940 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServerActionsTestJSON-1436267344 Jul 23 22:16:27.816940 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServerActionsTestJSON-1436267344-project Jul 23 22:16:27.816940 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 22:16:27.816940 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 22:16:27.816940 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 14820436f99c404b80194a1b985c76b1 Jul 23 22:16:27.816940 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServerActionsTestJSON-1436267344-project Jul 23 22:16:27.816940 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 22:16:27.816940 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance 8eb3cba5-d03f-4320-acfb-820bcec3f7a9 could not be found. Jul 23 22:16:27.816940 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '8eb3cba5-d03f-4320-acfb-820bcec3f7a9'} Jul 23 22:16:27.816940 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 22:16:27.816940 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:16:27.816940 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 22:16:27.816940 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 22:16:27.816940 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 22:16:27.816940 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 22:16:27.816940 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 22:16:27.816940 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 22:16:27.816940 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 22:16:27.816940 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 22:16:27.816940 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8eb3cba5-d03f-4320-acfb-820bcec3f7a9 could not be found. Jul 23 22:16:27.816940 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:16:27.816940 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:16:27.816940 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:16:27.816940 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:16:27.816940 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:16:27.816940 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:16:27.816940 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 22:16:27.816940 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 22:16:27.816940 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 22:16:27.816940 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 22:16:27.816940 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 23 22:16:27.816940 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 23 22:16:27.816940 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 23 22:16:27.816940 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 23 22:16:27.816940 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 22:16:27.816940 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 22:16:27.816940 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 22:16:27.816940 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 22:16:27.820266 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8eb3cba5-d03f-4320-acfb-820bcec3f7a9 could not be found. Jul 23 22:16:27.820266 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:16:27.820266 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:16:27.820266 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:16:27.820266 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:16:27.820266 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:16:27.820266 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:16:27.820266 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 22:16:27.820266 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 22:16:27.820266 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8eb3cba5-d03f-4320-acfb-820bcec3f7a9 could not be found. Jul 23 22:16:27.820266 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:16:27.820266 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-fbb33e17-ed7a-481e-be9b-ed7d92caeebd tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Returning 404 to user: Instance 8eb3cba5-d03f-4320-acfb-820bcec3f7a9 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 22:16:27.820266 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-fbb33e17-ed7a-481e-be9b-ed7d92caeebd tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "DELETE /compute/v2.1/servers/8eb3cba5-d03f-4320-acfb-820bcec3f7a9" status: 404 len: 111 microversion: 2.1 time: 0.027989 Jul 23 22:16:27.820266 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3663/6273] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 22:16:27 2022] DELETE /compute/v2.1/servers/8eb3cba5-d03f-4320-acfb-820bcec3f7a9 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 23 22:16:27.826800 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e269d457-bf3c-442c-b1fb-2580b494bbb6 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:16:27.827400 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e269d457-bf3c-442c-b1fb-2580b494bbb6 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 8eb3cba5-d03f-4320-acfb-820bcec3f7a9] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:16:27.833830 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e269d457-bf3c-442c-b1fb-2580b494bbb6 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:16:27.834307 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e269d457-bf3c-442c-b1fb-2580b494bbb6 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:16:27.835073 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e269d457-bf3c-442c-b1fb-2580b494bbb6 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:16:27.835510 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e269d457-bf3c-442c-b1fb-2580b494bbb6 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:16:27.849371 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-e269d457-bf3c-442c-b1fb-2580b494bbb6 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] HTTP exception thrown: Instance 8eb3cba5-d03f-4320-acfb-820bcec3f7a9 could not be found. Jul 23 22:16:27.850910 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e269d457-bf3c-442c-b1fb-2580b494bbb6 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Request method failure captured: Jul 23 22:16:27.850910 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/8eb3cba5-d03f-4320-acfb-820bcec3f7a9 HTTP/1.1 Jul 23 22:16:27.850910 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 22:16:27.850910 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 22:16:27.850910 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 22:16:27.850910 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 22:16:27.850910 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 22:16:27.850910 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 22:16:27.850910 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 22:16:27.850910 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 22:16:27.850910 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3HIoewFR0SqpqLrj5I-sN7pNyjXsXXtQLkybI9vB6YsXdCaJ6oH3gw_3sQK2MiiJxU-U9GJtkTNRyRtiyWB74IsJErQO0QMayat2E8l_KlQxoCwZvuOOv2BFlgI59GiCbRO0itRDUcJc1lBv1Mjh_3cnjoEC2YbTi0_IAE5AJlU7TS0 Jul 23 22:16:27.850910 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 22:16:27.850910 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 22:16:27.850910 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 22:16:27.850910 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 22:16:27.850910 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 22:16:27.850910 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 22:16:27.850910 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 5ca8bc0082894aa6b90a714ddc6a6790 Jul 23 22:16:27.850910 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServerActionsTestJSON-1436267344 Jul 23 22:16:27.850910 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 22:16:27.850910 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 22:16:27.850910 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5ca8bc0082894aa6b90a714ddc6a6790"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5ca8bc0082894aa6b90a714ddc6a6790"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_5ca8bc0082894aa6b90a714ddc6a6790", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/5ca8bc0082894aa6b90a714ddc6a6790"}]}] Jul 23 22:16:27.850910 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServerActionsTestJSON-1436267344 Jul 23 22:16:27.850910 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 5ca8bc0082894aa6b90a714ddc6a6790 Jul 23 22:16:27.850910 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServerActionsTestJSON-1436267344 Jul 23 22:16:27.850910 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServerActionsTestJSON-1436267344-project Jul 23 22:16:27.850910 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 22:16:27.850910 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 22:16:27.850910 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 14820436f99c404b80194a1b985c76b1 Jul 23 22:16:27.850910 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServerActionsTestJSON-1436267344-project Jul 23 22:16:27.850910 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 22:16:27.850910 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance 8eb3cba5-d03f-4320-acfb-820bcec3f7a9 could not be found. Jul 23 22:16:27.850910 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '8eb3cba5-d03f-4320-acfb-820bcec3f7a9'} Jul 23 22:16:27.850910 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 22:16:27.850910 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:16:27.850910 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 22:16:27.850910 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 22:16:27.850910 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 22:16:27.850910 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 22:16:27.850910 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 22:16:27.850910 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 22:16:27.850910 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 22:16:27.850910 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 22:16:27.850910 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8eb3cba5-d03f-4320-acfb-820bcec3f7a9 could not be found. Jul 23 22:16:27.850910 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:16:27.850910 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:16:27.850910 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:16:27.850910 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:16:27.850910 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:16:27.850910 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:16:27.850910 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 22:16:27.850910 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 22:16:27.850910 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 22:16:27.850910 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 22:16:27.850910 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 22:16:27.850910 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 22:16:27.850910 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 22:16:27.850910 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 22:16:27.850910 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 22:16:27.850910 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 22:16:27.850910 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8eb3cba5-d03f-4320-acfb-820bcec3f7a9 could not be found. Jul 23 22:16:27.850910 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:16:27.850910 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:16:27.850910 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:16:27.855123 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:16:27.855123 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:16:27.855123 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:16:27.855123 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 22:16:27.855123 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 22:16:27.855123 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8eb3cba5-d03f-4320-acfb-820bcec3f7a9 could not be found. Jul 23 22:16:27.855123 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:16:27.855123 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e269d457-bf3c-442c-b1fb-2580b494bbb6 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Returning 404 to user: Instance 8eb3cba5-d03f-4320-acfb-820bcec3f7a9 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 22:16:27.855123 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e269d457-bf3c-442c-b1fb-2580b494bbb6 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/8eb3cba5-d03f-4320-acfb-820bcec3f7a9" status: 404 len: 111 microversion: 2.1 time: 0.029425 Jul 23 22:16:27.855123 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3664/6274] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:16:27 2022] GET /compute/v2.1/servers/8eb3cba5-d03f-4320-acfb-820bcec3f7a9 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 22:16:27.860267 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a38d6e4a-bce9-4e44-bdfa-94cde8aa08f2 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:16:27.860749 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a38d6e4a-bce9-4e44-bdfa-94cde8aa08f2 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 0c5a7550-1f75-43a3-a365-25e83435bdaa] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:16:27.866680 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a38d6e4a-bce9-4e44-bdfa-94cde8aa08f2 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:16:27.867123 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a38d6e4a-bce9-4e44-bdfa-94cde8aa08f2 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:16:27.867902 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a38d6e4a-bce9-4e44-bdfa-94cde8aa08f2 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:16:27.868304 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a38d6e4a-bce9-4e44-bdfa-94cde8aa08f2 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:16:27.883592 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-a38d6e4a-bce9-4e44-bdfa-94cde8aa08f2 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] HTTP exception thrown: Instance 0c5a7550-1f75-43a3-a365-25e83435bdaa could not be found. Jul 23 22:16:27.885111 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a38d6e4a-bce9-4e44-bdfa-94cde8aa08f2 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Request method failure captured: Jul 23 22:16:27.885111 ncdv-master-1 devstack@n-api.service[131320]: request: DELETE /compute/v2.1/servers/0c5a7550-1f75-43a3-a365-25e83435bdaa HTTP/1.1 Jul 23 22:16:27.885111 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 22:16:27.885111 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 22:16:27.885111 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 22:16:27.885111 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 22:16:27.885111 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 22:16:27.885111 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 22:16:27.885111 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 22:16:27.885111 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 22:16:27.885111 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3HIoewFR0SqpqLrj5I-sN7pNyjXsXXtQLkybI9vB6YsXdCaJ6oH3gw_3sQK2MiiJxU-U9GJtkTNRyRtiyWB74IsJErQO0QMayat2E8l_KlQxoCwZvuOOv2BFlgI59GiCbRO0itRDUcJc1lBv1Mjh_3cnjoEC2YbTi0_IAE5AJlU7TS0 Jul 23 22:16:27.885111 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 22:16:27.885111 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 22:16:27.885111 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 22:16:27.885111 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 22:16:27.885111 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 22:16:27.885111 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 22:16:27.885111 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 5ca8bc0082894aa6b90a714ddc6a6790 Jul 23 22:16:27.885111 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServerActionsTestJSON-1436267344 Jul 23 22:16:27.885111 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 22:16:27.885111 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 22:16:27.885111 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5ca8bc0082894aa6b90a714ddc6a6790"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5ca8bc0082894aa6b90a714ddc6a6790"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_5ca8bc0082894aa6b90a714ddc6a6790", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/5ca8bc0082894aa6b90a714ddc6a6790"}]}] Jul 23 22:16:27.885111 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServerActionsTestJSON-1436267344 Jul 23 22:16:27.885111 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 5ca8bc0082894aa6b90a714ddc6a6790 Jul 23 22:16:27.885111 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServerActionsTestJSON-1436267344 Jul 23 22:16:27.885111 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServerActionsTestJSON-1436267344-project Jul 23 22:16:27.885111 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 22:16:27.885111 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 22:16:27.885111 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 14820436f99c404b80194a1b985c76b1 Jul 23 22:16:27.885111 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServerActionsTestJSON-1436267344-project Jul 23 22:16:27.885111 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 22:16:27.885111 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance 0c5a7550-1f75-43a3-a365-25e83435bdaa could not be found. Jul 23 22:16:27.885111 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '0c5a7550-1f75-43a3-a365-25e83435bdaa'} Jul 23 22:16:27.885111 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 22:16:27.885111 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:16:27.885111 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 22:16:27.885111 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 22:16:27.885111 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 22:16:27.885111 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 22:16:27.885111 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 22:16:27.885111 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 22:16:27.885111 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 22:16:27.885111 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 22:16:27.885111 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c5a7550-1f75-43a3-a365-25e83435bdaa could not be found. Jul 23 22:16:27.885111 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:16:27.885111 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:16:27.885111 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:16:27.885111 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:16:27.885111 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:16:27.885111 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:16:27.885111 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 22:16:27.885111 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 22:16:27.885111 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 22:16:27.885111 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 22:16:27.885111 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 23 22:16:27.885111 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 23 22:16:27.885111 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 23 22:16:27.885111 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 23 22:16:27.885111 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 22:16:27.885111 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 22:16:27.885111 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 22:16:27.885111 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 22:16:27.889225 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c5a7550-1f75-43a3-a365-25e83435bdaa could not be found. Jul 23 22:16:27.889225 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:16:27.889225 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:16:27.889225 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:16:27.889225 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:16:27.889225 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:16:27.889225 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:16:27.889225 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 22:16:27.889225 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 22:16:27.889225 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c5a7550-1f75-43a3-a365-25e83435bdaa could not be found. Jul 23 22:16:27.889225 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:16:27.889225 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a38d6e4a-bce9-4e44-bdfa-94cde8aa08f2 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Returning 404 to user: Instance 0c5a7550-1f75-43a3-a365-25e83435bdaa could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 22:16:27.889225 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a38d6e4a-bce9-4e44-bdfa-94cde8aa08f2 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0c5a7550-1f75-43a3-a365-25e83435bdaa" status: 404 len: 111 microversion: 2.1 time: 0.029686 Jul 23 22:16:27.889225 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3665/6275] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 22:16:27 2022] DELETE /compute/v2.1/servers/0c5a7550-1f75-43a3-a365-25e83435bdaa => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 23 22:16:27.894325 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8b4d51ef-59ad-4a6f-925a-64701981f766 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:16:27.894927 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8b4d51ef-59ad-4a6f-925a-64701981f766 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] [instance: 0c5a7550-1f75-43a3-a365-25e83435bdaa] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:16:27.901098 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8b4d51ef-59ad-4a6f-925a-64701981f766 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:16:27.901547 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8b4d51ef-59ad-4a6f-925a-64701981f766 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:16:27.902450 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8b4d51ef-59ad-4a6f-925a-64701981f766 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:16:27.902889 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8b4d51ef-59ad-4a6f-925a-64701981f766 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:16:27.916735 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-8b4d51ef-59ad-4a6f-925a-64701981f766 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] HTTP exception thrown: Instance 0c5a7550-1f75-43a3-a365-25e83435bdaa could not be found. Jul 23 22:16:27.918288 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8b4d51ef-59ad-4a6f-925a-64701981f766 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Request method failure captured: Jul 23 22:16:27.918288 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/0c5a7550-1f75-43a3-a365-25e83435bdaa HTTP/1.1 Jul 23 22:16:27.918288 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 22:16:27.918288 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 22:16:27.918288 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 22:16:27.918288 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 22:16:27.918288 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 22:16:27.918288 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 22:16:27.918288 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 22:16:27.918288 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 22:16:27.918288 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3HIoewFR0SqpqLrj5I-sN7pNyjXsXXtQLkybI9vB6YsXdCaJ6oH3gw_3sQK2MiiJxU-U9GJtkTNRyRtiyWB74IsJErQO0QMayat2E8l_KlQxoCwZvuOOv2BFlgI59GiCbRO0itRDUcJc1lBv1Mjh_3cnjoEC2YbTi0_IAE5AJlU7TS0 Jul 23 22:16:27.918288 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 22:16:27.918288 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 22:16:27.918288 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 22:16:27.918288 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 22:16:27.918288 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 22:16:27.918288 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 22:16:27.918288 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 5ca8bc0082894aa6b90a714ddc6a6790 Jul 23 22:16:27.918288 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServerActionsTestJSON-1436267344 Jul 23 22:16:27.918288 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 22:16:27.918288 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 22:16:27.918288 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5ca8bc0082894aa6b90a714ddc6a6790"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/5ca8bc0082894aa6b90a714ddc6a6790"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_5ca8bc0082894aa6b90a714ddc6a6790", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/5ca8bc0082894aa6b90a714ddc6a6790"}]}] Jul 23 22:16:27.918288 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServerActionsTestJSON-1436267344 Jul 23 22:16:27.918288 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 5ca8bc0082894aa6b90a714ddc6a6790 Jul 23 22:16:27.918288 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServerActionsTestJSON-1436267344 Jul 23 22:16:27.918288 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServerActionsTestJSON-1436267344-project Jul 23 22:16:27.918288 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 22:16:27.918288 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 22:16:27.918288 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 14820436f99c404b80194a1b985c76b1 Jul 23 22:16:27.918288 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServerActionsTestJSON-1436267344-project Jul 23 22:16:27.918288 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 22:16:27.918288 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance 0c5a7550-1f75-43a3-a365-25e83435bdaa could not be found. Jul 23 22:16:27.918288 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '0c5a7550-1f75-43a3-a365-25e83435bdaa'} Jul 23 22:16:27.918288 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 22:16:27.918288 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:16:27.918288 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 22:16:27.918288 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 22:16:27.918288 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 22:16:27.918288 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 22:16:27.918288 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 22:16:27.918288 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 22:16:27.918288 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 22:16:27.918288 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 22:16:27.918288 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c5a7550-1f75-43a3-a365-25e83435bdaa could not be found. Jul 23 22:16:27.918288 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:16:27.918288 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:16:27.918288 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:16:27.918288 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:16:27.918288 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:16:27.918288 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:16:27.918288 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 22:16:27.918288 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 22:16:27.918288 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 22:16:27.918288 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 22:16:27.918288 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 22:16:27.918288 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 22:16:27.918288 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 22:16:27.918288 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 22:16:27.918288 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 22:16:27.918288 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 22:16:27.918288 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c5a7550-1f75-43a3-a365-25e83435bdaa could not be found. Jul 23 22:16:27.918288 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:16:27.918288 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:16:27.918288 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:16:27.922197 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:16:27.922197 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:16:27.922197 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:16:27.922197 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 22:16:27.922197 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 22:16:27.922197 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c5a7550-1f75-43a3-a365-25e83435bdaa could not be found. Jul 23 22:16:27.922197 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:16:27.922197 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8b4d51ef-59ad-4a6f-925a-64701981f766 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Returning 404 to user: Instance 0c5a7550-1f75-43a3-a365-25e83435bdaa could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 22:16:27.922197 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8b4d51ef-59ad-4a6f-925a-64701981f766 tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "GET /compute/v2.1/servers/0c5a7550-1f75-43a3-a365-25e83435bdaa" status: 404 len: 111 microversion: 2.1 time: 0.028752 Jul 23 22:16:27.922197 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3666/6276] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:16:27 2022] GET /compute/v2.1/servers/0c5a7550-1f75-43a3-a365-25e83435bdaa => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 23 22:16:27.927788 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-80df4a9e-6dae-42a9-b16c-63b34f759fed tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] Calling method '.version_select at 0x7f0b46fd49d0>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:16:27.952374 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-80df4a9e-6dae-42a9-b16c-63b34f759fed tempest-ServerActionsTestJSON-1436267344 tempest-ServerActionsTestJSON-1436267344-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1953727802" status: 202 len: 0 microversion: 2.1 time: 0.027922 Jul 23 22:16:27.952869 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3667/6277] 10.222.0.17 () {58 vars in 1220 bytes} [Sat Jul 23 22:16:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1953727802 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 22:16:37.601202 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ff875511-7c42-4d28-a879-808467920765 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1648601450", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "networks": [{"uuid": "7d061013-8538-46dc-8e98-578cf4be11fd"}]}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:16:37.800354 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-ff875511-7c42-4d28-a879-808467920765 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] validate_networks() for [('7d061013-8538-46dc-8e98-578cf4be11fd', None, None, None, None, None)] {{(pid=131320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 22:16:37.907935 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:16:38.191473 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-ff875511-7c42-4d28-a879-808467920765 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 22:16:38.191906 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-ff875511-7c42-4d28-a879-808467920765 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 22:16:38.192404 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-ff875511-7c42-4d28-a879-808467920765 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 22:16:38.193113 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-ff875511-7c42-4d28-a879-808467920765 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 22:16:38.193534 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-ff875511-7c42-4d28-a879-808467920765 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 22:16:38.203057 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ff875511-7c42-4d28-a879-808467920765 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:16:38.203509 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ff875511-7c42-4d28-a879-808467920765 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:16:38.204313 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ff875511-7c42-4d28-a879-808467920765 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:16:38.204751 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ff875511-7c42-4d28-a879-808467920765 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:16:38.221660 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-ff875511-7c42-4d28-a879-808467920765 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Getting quotas for project c9d7e3d863d84f04b2396946162934bf. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 22:16:38.227056 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-ff875511-7c42-4d28-a879-808467920765 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Getting quotas for user 9a11c0f61b4b45498c79dae845c4b3ce and project c9d7e3d863d84f04b2396946162934bf. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 22:16:38.239845 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ff875511-7c42-4d28-a879-808467920765 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Going to run 1 instances... {{(pid=131320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 22:16:38.242186 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ff875511-7c42-4d28-a879-808467920765 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] [instance: 298f07cc-b077-4ded-be45-cb90c6b24d07] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 22:16:38.287467 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ff875511-7c42-4d28-a879-808467920765 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.838485 Jul 23 22:16:38.288463 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3668/6278] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 22:16:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 840 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 23 22:16:38.298384 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5db1f298-6fe0-4c61-963a-5b20b2f8d146 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:16:38.299076 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5db1f298-6fe0-4c61-963a-5b20b2f8d146 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] [instance: 298f07cc-b077-4ded-be45-cb90c6b24d07] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:16:38.360788 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5db1f298-6fe0-4c61-963a-5b20b2f8d146 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a11c0f61b4b45498c79dae845c4b3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7e3d863d84f04b2396946162934bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:16:38.371166 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5db1f298-6fe0-4c61-963a-5b20b2f8d146 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] 10.222.0.17 "GET /compute/v2.1/servers/298f07cc-b077-4ded-be45-cb90c6b24d07" status: 200 len: 1217 microversion: 2.1 time: 0.076741 Jul 23 22:16:38.374091 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3669/6279] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:16:38 2022] GET /compute/v2.1/servers/298f07cc-b077-4ded-be45-cb90c6b24d07 => generated 1217 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:16:39.393528 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4fe66b72-8d9f-4e19-8930-2702c12f9244 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:16:39.395070 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-4fe66b72-8d9f-4e19-8930-2702c12f9244 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] [instance: 298f07cc-b077-4ded-be45-cb90c6b24d07] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:16:39.417477 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4fe66b72-8d9f-4e19-8930-2702c12f9244 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:16:39.418315 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4fe66b72-8d9f-4e19-8930-2702c12f9244 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:16:39.419681 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4fe66b72-8d9f-4e19-8930-2702c12f9244 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:16:39.420539 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4fe66b72-8d9f-4e19-8930-2702c12f9244 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:16:39.570994 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-4fe66b72-8d9f-4e19-8930-2702c12f9244 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a11c0f61b4b45498c79dae845c4b3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7e3d863d84f04b2396946162934bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:16:39.582813 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4fe66b72-8d9f-4e19-8930-2702c12f9244 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] 10.222.0.17 "GET /compute/v2.1/servers/298f07cc-b077-4ded-be45-cb90c6b24d07" status: 200 len: 1277 microversion: 2.1 time: 0.194017 Jul 23 22:16:39.585316 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3670/6280] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:16:39 2022] GET /compute/v2.1/servers/298f07cc-b077-4ded-be45-cb90c6b24d07 => generated 1277 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:16:40.603206 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f28875ca-9a1c-40a0-a3df-8e346801fc96 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:16:40.604528 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f28875ca-9a1c-40a0-a3df-8e346801fc96 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] [instance: 298f07cc-b077-4ded-be45-cb90c6b24d07] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:16:40.611723 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f28875ca-9a1c-40a0-a3df-8e346801fc96 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:16:40.612172 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f28875ca-9a1c-40a0-a3df-8e346801fc96 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:16:40.613153 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f28875ca-9a1c-40a0-a3df-8e346801fc96 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:16:40.613764 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f28875ca-9a1c-40a0-a3df-8e346801fc96 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:16:40.756192 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f28875ca-9a1c-40a0-a3df-8e346801fc96 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a11c0f61b4b45498c79dae845c4b3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7e3d863d84f04b2396946162934bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:16:40.765157 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f28875ca-9a1c-40a0-a3df-8e346801fc96 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] 10.222.0.17 "GET /compute/v2.1/servers/298f07cc-b077-4ded-be45-cb90c6b24d07" status: 200 len: 1317 microversion: 2.1 time: 0.166074 Jul 23 22:16:40.775582 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3671/6281] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:16:40 2022] GET /compute/v2.1/servers/298f07cc-b077-4ded-be45-cb90c6b24d07 => generated 1317 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:16:41.046392 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-62bb1172-df9c-4a77-a9dc-e0e77f92690a req-df0da3d4-0fc7-4f7e-826b-0ef9a6e088b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "298f07cc-b077-4ded-be45-cb90c6b24d07", "tag": "d4b40c24-4373-4440-93e6-a53d4729d33b"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:16:41.063619 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-62bb1172-df9c-4a77-a9dc-e0e77f92690a req-df0da3d4-0fc7-4f7e-826b-0ef9a6e088b2 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:16:41.064790 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-62bb1172-df9c-4a77-a9dc-e0e77f92690a req-df0da3d4-0fc7-4f7e-826b-0ef9a6e088b2 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:16:41.086626 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-62bb1172-df9c-4a77-a9dc-e0e77f92690a req-df0da3d4-0fc7-4f7e-826b-0ef9a6e088b2 service nova] Creating event network-changed:d4b40c24-4373-4440-93e6-a53d4729d33b for instance 298f07cc-b077-4ded-be45-cb90c6b24d07 on nch2-master-1 Jul 23 22:16:41.092483 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-62bb1172-df9c-4a77-a9dc-e0e77f92690a req-df0da3d4-0fc7-4f7e-826b-0ef9a6e088b2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050611 Jul 23 22:16:41.093114 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3672/6282] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:16:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:16:41.783629 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9864ddc6-b431-49a2-abe6-f9f9746721f8 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:16:41.784320 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-9864ddc6-b431-49a2-abe6-f9f9746721f8 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] [instance: 298f07cc-b077-4ded-be45-cb90c6b24d07] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:16:41.791417 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9864ddc6-b431-49a2-abe6-f9f9746721f8 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:16:41.791873 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9864ddc6-b431-49a2-abe6-f9f9746721f8 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:16:41.792663 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9864ddc6-b431-49a2-abe6-f9f9746721f8 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:16:41.793104 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9864ddc6-b431-49a2-abe6-f9f9746721f8 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:16:41.928215 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-9864ddc6-b431-49a2-abe6-f9f9746721f8 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a11c0f61b4b45498c79dae845c4b3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7e3d863d84f04b2396946162934bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:16:41.939490 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9864ddc6-b431-49a2-abe6-f9f9746721f8 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] 10.222.0.17 "GET /compute/v2.1/servers/298f07cc-b077-4ded-be45-cb90c6b24d07" status: 200 len: 1317 microversion: 2.1 time: 0.161129 Jul 23 22:16:41.940346 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3673/6283] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:16:41 2022] GET /compute/v2.1/servers/298f07cc-b077-4ded-be45-cb90c6b24d07 => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:16:42.964115 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f52c40f1-7794-40dc-b9c7-6a61d87b30bc tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:16:42.965068 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f52c40f1-7794-40dc-b9c7-6a61d87b30bc tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] [instance: 298f07cc-b077-4ded-be45-cb90c6b24d07] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:16:42.973061 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f52c40f1-7794-40dc-b9c7-6a61d87b30bc tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:16:42.973518 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f52c40f1-7794-40dc-b9c7-6a61d87b30bc tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:16:42.974329 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f52c40f1-7794-40dc-b9c7-6a61d87b30bc tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:16:42.974769 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f52c40f1-7794-40dc-b9c7-6a61d87b30bc tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:16:43.105741 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f52c40f1-7794-40dc-b9c7-6a61d87b30bc tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a11c0f61b4b45498c79dae845c4b3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7e3d863d84f04b2396946162934bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:16:43.113622 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f52c40f1-7794-40dc-b9c7-6a61d87b30bc tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] 10.222.0.17 "GET /compute/v2.1/servers/298f07cc-b077-4ded-be45-cb90c6b24d07" status: 200 len: 1317 microversion: 2.1 time: 0.156403 Jul 23 22:16:43.114227 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3674/6284] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:16:42 2022] GET /compute/v2.1/servers/298f07cc-b077-4ded-be45-cb90c6b24d07 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:16:44.130733 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-db9e9816-ed23-4be2-921a-093d21e41664 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:16:44.131465 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-db9e9816-ed23-4be2-921a-093d21e41664 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] [instance: 298f07cc-b077-4ded-be45-cb90c6b24d07] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:16:44.139140 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-db9e9816-ed23-4be2-921a-093d21e41664 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:16:44.139593 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-db9e9816-ed23-4be2-921a-093d21e41664 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:16:44.140374 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-db9e9816-ed23-4be2-921a-093d21e41664 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:16:44.140818 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-db9e9816-ed23-4be2-921a-093d21e41664 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:16:44.289237 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-db9e9816-ed23-4be2-921a-093d21e41664 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a11c0f61b4b45498c79dae845c4b3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7e3d863d84f04b2396946162934bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:16:44.298646 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-db9e9816-ed23-4be2-921a-093d21e41664 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] 10.222.0.17 "GET /compute/v2.1/servers/298f07cc-b077-4ded-be45-cb90c6b24d07" status: 200 len: 1317 microversion: 2.1 time: 0.171959 Jul 23 22:16:44.299235 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3675/6285] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:16:44 2022] GET /compute/v2.1/servers/298f07cc-b077-4ded-be45-cb90c6b24d07 => generated 1317 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:16:45.319411 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-63088b29-c03b-487f-8164-e1fb1d5b82cf tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:16:45.320474 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-63088b29-c03b-487f-8164-e1fb1d5b82cf tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] [instance: 298f07cc-b077-4ded-be45-cb90c6b24d07] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:16:45.332480 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-63088b29-c03b-487f-8164-e1fb1d5b82cf tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:16:45.333222 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-63088b29-c03b-487f-8164-e1fb1d5b82cf tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:16:45.334541 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-63088b29-c03b-487f-8164-e1fb1d5b82cf tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:16:45.335269 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-63088b29-c03b-487f-8164-e1fb1d5b82cf tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:16:45.480698 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-63088b29-c03b-487f-8164-e1fb1d5b82cf tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a11c0f61b4b45498c79dae845c4b3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7e3d863d84f04b2396946162934bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:16:45.489720 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-63088b29-c03b-487f-8164-e1fb1d5b82cf tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] 10.222.0.17 "GET /compute/v2.1/servers/298f07cc-b077-4ded-be45-cb90c6b24d07" status: 200 len: 1317 microversion: 2.1 time: 0.176903 Jul 23 22:16:45.490344 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3676/6286] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:16:45 2022] GET /compute/v2.1/servers/298f07cc-b077-4ded-be45-cb90c6b24d07 => generated 1317 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:16:46.512111 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-7c08ea14-38b5-46cc-bc2d-8edf79ac9c00 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:16:46.512797 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-7c08ea14-38b5-46cc-bc2d-8edf79ac9c00 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] [instance: 298f07cc-b077-4ded-be45-cb90c6b24d07] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:16:46.523406 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7c08ea14-38b5-46cc-bc2d-8edf79ac9c00 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:16:46.524034 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7c08ea14-38b5-46cc-bc2d-8edf79ac9c00 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:16:46.525240 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7c08ea14-38b5-46cc-bc2d-8edf79ac9c00 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:16:46.525848 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7c08ea14-38b5-46cc-bc2d-8edf79ac9c00 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:16:46.663776 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-7c08ea14-38b5-46cc-bc2d-8edf79ac9c00 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a11c0f61b4b45498c79dae845c4b3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7e3d863d84f04b2396946162934bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:16:46.671590 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-7c08ea14-38b5-46cc-bc2d-8edf79ac9c00 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] 10.222.0.17 "GET /compute/v2.1/servers/298f07cc-b077-4ded-be45-cb90c6b24d07" status: 200 len: 1317 microversion: 2.1 time: 0.165907 Jul 23 22:16:46.672296 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3677/6287] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:16:46 2022] GET /compute/v2.1/servers/298f07cc-b077-4ded-be45-cb90c6b24d07 => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:16:46.895135 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-4fff089d-772f-4af2-b27e-03d2cd7af5b2 req-ee54aff3-018d-4168-ba77-6796b7abd315 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "298f07cc-b077-4ded-be45-cb90c6b24d07", "name": "network-vif-plugged", "status": "completed", "tag": "d4b40c24-4373-4440-93e6-a53d4729d33b"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:16:46.903812 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-4fff089d-772f-4af2-b27e-03d2cd7af5b2 req-ee54aff3-018d-4168-ba77-6796b7abd315 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:16:46.904274 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-4fff089d-772f-4af2-b27e-03d2cd7af5b2 req-ee54aff3-018d-4168-ba77-6796b7abd315 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:16:46.916035 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-4fff089d-772f-4af2-b27e-03d2cd7af5b2 req-ee54aff3-018d-4168-ba77-6796b7abd315 service nova] Creating event network-vif-plugged:d4b40c24-4373-4440-93e6-a53d4729d33b for instance 298f07cc-b077-4ded-be45-cb90c6b24d07 on nch2-master-1 Jul 23 22:16:46.921154 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-4fff089d-772f-4af2-b27e-03d2cd7af5b2 req-ee54aff3-018d-4168-ba77-6796b7abd315 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029839 Jul 23 22:16:46.921749 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3678/6288] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:16:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:16:47.695363 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4a914207-9966-4383-9cfc-fbc852452c21 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:16:47.696449 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-4a914207-9966-4383-9cfc-fbc852452c21 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] [instance: 298f07cc-b077-4ded-be45-cb90c6b24d07] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:16:47.705504 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4a914207-9966-4383-9cfc-fbc852452c21 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:16:47.705998 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4a914207-9966-4383-9cfc-fbc852452c21 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:16:47.706778 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4a914207-9966-4383-9cfc-fbc852452c21 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:16:47.707220 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4a914207-9966-4383-9cfc-fbc852452c21 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:16:47.839748 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-4a914207-9966-4383-9cfc-fbc852452c21 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a11c0f61b4b45498c79dae845c4b3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7e3d863d84f04b2396946162934bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:16:47.847585 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4a914207-9966-4383-9cfc-fbc852452c21 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] 10.222.0.17 "GET /compute/v2.1/servers/298f07cc-b077-4ded-be45-cb90c6b24d07" status: 200 len: 1317 microversion: 2.1 time: 0.160958 Jul 23 22:16:47.848203 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3679/6289] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:16:47 2022] GET /compute/v2.1/servers/298f07cc-b077-4ded-be45-cb90c6b24d07 => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:16:48.865247 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-bc395941-8101-416c-b3bc-a8ca1ffdc1c0 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:16:48.865929 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-bc395941-8101-416c-b3bc-a8ca1ffdc1c0 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] [instance: 298f07cc-b077-4ded-be45-cb90c6b24d07] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:16:48.867876 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:16:48.868581 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=8 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:16:48.875824 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bc395941-8101-416c-b3bc-a8ca1ffdc1c0 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:16:48.876302 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bc395941-8101-416c-b3bc-a8ca1ffdc1c0 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:16:48.877072 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bc395941-8101-416c-b3bc-a8ca1ffdc1c0 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:16:48.877510 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bc395941-8101-416c-b3bc-a8ca1ffdc1c0 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:16:49.015763 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-bc395941-8101-416c-b3bc-a8ca1ffdc1c0 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a11c0f61b4b45498c79dae845c4b3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7e3d863d84f04b2396946162934bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:16:49.023742 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-bc395941-8101-416c-b3bc-a8ca1ffdc1c0 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] 10.222.0.17 "GET /compute/v2.1/servers/298f07cc-b077-4ded-be45-cb90c6b24d07" status: 200 len: 1506 microversion: 2.1 time: 0.162712 Jul 23 22:16:49.024294 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3680/6290] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:16:48 2022] GET /compute/v2.1/servers/298f07cc-b077-4ded-be45-cb90c6b24d07 => generated 1506 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:16:49.085227 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6b766c5f-e496-4d71-a288-e6a5aaa241a8 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-768448613", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "networks": [{"uuid": "7d061013-8538-46dc-8e98-578cf4be11fd"}]}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:16:49.138852 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-6b766c5f-e496-4d71-a288-e6a5aaa241a8 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] validate_networks() for [('7d061013-8538-46dc-8e98-578cf4be11fd', None, None, None, None, None)] {{(pid=131320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 22:16:49.530043 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-6b766c5f-e496-4d71-a288-e6a5aaa241a8 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 22:16:49.530473 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-6b766c5f-e496-4d71-a288-e6a5aaa241a8 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 22:16:49.530981 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-6b766c5f-e496-4d71-a288-e6a5aaa241a8 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 22:16:49.531388 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-6b766c5f-e496-4d71-a288-e6a5aaa241a8 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 22:16:49.531832 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-6b766c5f-e496-4d71-a288-e6a5aaa241a8 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 22:16:49.541990 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6b766c5f-e496-4d71-a288-e6a5aaa241a8 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:16:49.542437 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6b766c5f-e496-4d71-a288-e6a5aaa241a8 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:16:49.543230 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6b766c5f-e496-4d71-a288-e6a5aaa241a8 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:16:49.543669 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6b766c5f-e496-4d71-a288-e6a5aaa241a8 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:16:49.560253 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-6b766c5f-e496-4d71-a288-e6a5aaa241a8 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Getting quotas for project c9d7e3d863d84f04b2396946162934bf. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 22:16:49.565586 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-6b766c5f-e496-4d71-a288-e6a5aaa241a8 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Getting quotas for user 9a11c0f61b4b45498c79dae845c4b3ce and project c9d7e3d863d84f04b2396946162934bf. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 22:16:49.579102 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6b766c5f-e496-4d71-a288-e6a5aaa241a8 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Going to run 1 instances... {{(pid=131320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 22:16:49.581376 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6b766c5f-e496-4d71-a288-e6a5aaa241a8 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] [instance: 94ff653c-ae36-4595-92e8-4fd6dfaa3922] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 22:16:49.629510 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6b766c5f-e496-4d71-a288-e6a5aaa241a8 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.550361 Jul 23 22:16:49.630195 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3681/6291] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 22:16:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 552 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 23 22:16:49.640571 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9d5717ba-1794-4d63-8a67-851723e59744 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:16:49.641213 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-9d5717ba-1794-4d63-8a67-851723e59744 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] [instance: 94ff653c-ae36-4595-92e8-4fd6dfaa3922] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:16:49.648832 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:16:49.695944 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-9d5717ba-1794-4d63-8a67-851723e59744 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a11c0f61b4b45498c79dae845c4b3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7e3d863d84f04b2396946162934bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:16:49.707280 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9d5717ba-1794-4d63-8a67-851723e59744 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] 10.222.0.17 "GET /compute/v2.1/servers/94ff653c-ae36-4595-92e8-4fd6dfaa3922" status: 200 len: 1216 microversion: 2.1 time: 0.070512 Jul 23 22:16:49.708052 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3682/6292] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:16:49 2022] GET /compute/v2.1/servers/94ff653c-ae36-4595-92e8-4fd6dfaa3922 => generated 1216 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:16:50.724597 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9890920f-bed0-4f87-baf0-5427618114ff tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:16:50.725250 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-9890920f-bed0-4f87-baf0-5427618114ff tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] [instance: 94ff653c-ae36-4595-92e8-4fd6dfaa3922] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:16:50.733205 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9890920f-bed0-4f87-baf0-5427618114ff tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:16:50.733730 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9890920f-bed0-4f87-baf0-5427618114ff tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:16:50.734648 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9890920f-bed0-4f87-baf0-5427618114ff tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:16:50.735157 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9890920f-bed0-4f87-baf0-5427618114ff tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:16:50.803450 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-9890920f-bed0-4f87-baf0-5427618114ff tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a11c0f61b4b45498c79dae845c4b3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7e3d863d84f04b2396946162934bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:16:50.811367 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9890920f-bed0-4f87-baf0-5427618114ff tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] 10.222.0.17 "GET /compute/v2.1/servers/94ff653c-ae36-4595-92e8-4fd6dfaa3922" status: 200 len: 1274 microversion: 2.1 time: 0.091373 Jul 23 22:16:50.811955 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3683/6293] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:16:50 2022] GET /compute/v2.1/servers/94ff653c-ae36-4595-92e8-4fd6dfaa3922 => generated 1274 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:16:51.830418 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a584f20c-f182-46df-97af-7e9089274634 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:16:51.831057 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a584f20c-f182-46df-97af-7e9089274634 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] [instance: 94ff653c-ae36-4595-92e8-4fd6dfaa3922] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:16:51.838548 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a584f20c-f182-46df-97af-7e9089274634 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:16:51.839008 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a584f20c-f182-46df-97af-7e9089274634 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:16:51.839804 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a584f20c-f182-46df-97af-7e9089274634 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:16:51.840247 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a584f20c-f182-46df-97af-7e9089274634 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:16:52.003025 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a584f20c-f182-46df-97af-7e9089274634 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a11c0f61b4b45498c79dae845c4b3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7e3d863d84f04b2396946162934bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:16:52.017650 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a584f20c-f182-46df-97af-7e9089274634 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] 10.222.0.17 "GET /compute/v2.1/servers/94ff653c-ae36-4595-92e8-4fd6dfaa3922" status: 200 len: 1316 microversion: 2.1 time: 0.191446 Jul 23 22:16:52.018634 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3684/6294] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:16:51 2022] GET /compute/v2.1/servers/94ff653c-ae36-4595-92e8-4fd6dfaa3922 => generated 1316 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:16:52.024074 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-adc4109a-5c97-40fd-9a87-561a80cee761 req-ff04d5d6-49ee-4705-a7b0-1674342750f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94ff653c-ae36-4595-92e8-4fd6dfaa3922", "tag": "b6559ba2-64f8-42a3-9bd5-286c00e2daa0"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:16:52.045399 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-adc4109a-5c97-40fd-9a87-561a80cee761 req-ff04d5d6-49ee-4705-a7b0-1674342750f2 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:16:52.046587 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-adc4109a-5c97-40fd-9a87-561a80cee761 req-ff04d5d6-49ee-4705-a7b0-1674342750f2 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:16:52.061646 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-adc4109a-5c97-40fd-9a87-561a80cee761 req-ff04d5d6-49ee-4705-a7b0-1674342750f2 service nova] Creating event network-changed:b6559ba2-64f8-42a3-9bd5-286c00e2daa0 for instance 94ff653c-ae36-4595-92e8-4fd6dfaa3922 on nch1-master-1 Jul 23 22:16:52.069770 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-adc4109a-5c97-40fd-9a87-561a80cee761 req-ff04d5d6-49ee-4705-a7b0-1674342750f2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049679 Jul 23 22:16:52.071511 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3685/6295] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:16:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:16:53.041631 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b7424099-77c9-438c-8e0a-5ab2f0484123 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:16:53.043103 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b7424099-77c9-438c-8e0a-5ab2f0484123 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] [instance: 94ff653c-ae36-4595-92e8-4fd6dfaa3922] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:16:53.051574 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b7424099-77c9-438c-8e0a-5ab2f0484123 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:16:53.052032 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b7424099-77c9-438c-8e0a-5ab2f0484123 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:16:53.052812 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b7424099-77c9-438c-8e0a-5ab2f0484123 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:16:53.053257 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b7424099-77c9-438c-8e0a-5ab2f0484123 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:16:53.187806 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b7424099-77c9-438c-8e0a-5ab2f0484123 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a11c0f61b4b45498c79dae845c4b3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7e3d863d84f04b2396946162934bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:16:53.195621 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b7424099-77c9-438c-8e0a-5ab2f0484123 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] 10.222.0.17 "GET /compute/v2.1/servers/94ff653c-ae36-4595-92e8-4fd6dfaa3922" status: 200 len: 1316 microversion: 2.1 time: 0.162679 Jul 23 22:16:53.196207 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3686/6296] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:16:53 2022] GET /compute/v2.1/servers/94ff653c-ae36-4595-92e8-4fd6dfaa3922 => generated 1316 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:16:54.219678 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8a3d4d9a-a187-4f84-8d4d-53e45ac0596a tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:16:54.220641 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8a3d4d9a-a187-4f84-8d4d-53e45ac0596a tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] [instance: 94ff653c-ae36-4595-92e8-4fd6dfaa3922] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:16:54.232657 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8a3d4d9a-a187-4f84-8d4d-53e45ac0596a tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:16:54.233423 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8a3d4d9a-a187-4f84-8d4d-53e45ac0596a tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:16:54.234775 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8a3d4d9a-a187-4f84-8d4d-53e45ac0596a tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:16:54.235519 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8a3d4d9a-a187-4f84-8d4d-53e45ac0596a tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:16:54.377235 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8a3d4d9a-a187-4f84-8d4d-53e45ac0596a tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a11c0f61b4b45498c79dae845c4b3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7e3d863d84f04b2396946162934bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:16:54.385160 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8a3d4d9a-a187-4f84-8d4d-53e45ac0596a tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] 10.222.0.17 "GET /compute/v2.1/servers/94ff653c-ae36-4595-92e8-4fd6dfaa3922" status: 200 len: 1316 microversion: 2.1 time: 0.172581 Jul 23 22:16:54.385720 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3687/6297] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:16:54 2022] GET /compute/v2.1/servers/94ff653c-ae36-4595-92e8-4fd6dfaa3922 => generated 1316 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:16:55.404525 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2a10db6e-f853-4c6a-9db6-5ffafd7efea9 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:16:55.405181 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-2a10db6e-f853-4c6a-9db6-5ffafd7efea9 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] [instance: 94ff653c-ae36-4595-92e8-4fd6dfaa3922] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:16:55.413155 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2a10db6e-f853-4c6a-9db6-5ffafd7efea9 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:16:55.413610 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2a10db6e-f853-4c6a-9db6-5ffafd7efea9 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:16:55.414591 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2a10db6e-f853-4c6a-9db6-5ffafd7efea9 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:16:55.415016 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2a10db6e-f853-4c6a-9db6-5ffafd7efea9 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:16:55.556270 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-2a10db6e-f853-4c6a-9db6-5ffafd7efea9 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a11c0f61b4b45498c79dae845c4b3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7e3d863d84f04b2396946162934bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:16:55.566628 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2a10db6e-f853-4c6a-9db6-5ffafd7efea9 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] 10.222.0.17 "GET /compute/v2.1/servers/94ff653c-ae36-4595-92e8-4fd6dfaa3922" status: 200 len: 1316 microversion: 2.1 time: 0.166635 Jul 23 22:16:55.567290 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3688/6298] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:16:55 2022] GET /compute/v2.1/servers/94ff653c-ae36-4595-92e8-4fd6dfaa3922 => generated 1316 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:16:56.588668 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1e566a13-422c-4088-8371-6ca88c6b2ab0 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:16:56.589732 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1e566a13-422c-4088-8371-6ca88c6b2ab0 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] [instance: 94ff653c-ae36-4595-92e8-4fd6dfaa3922] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:16:56.598161 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1e566a13-422c-4088-8371-6ca88c6b2ab0 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:16:56.598622 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1e566a13-422c-4088-8371-6ca88c6b2ab0 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:16:56.599396 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1e566a13-422c-4088-8371-6ca88c6b2ab0 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:16:56.599842 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1e566a13-422c-4088-8371-6ca88c6b2ab0 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:16:56.732686 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-1e566a13-422c-4088-8371-6ca88c6b2ab0 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a11c0f61b4b45498c79dae845c4b3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7e3d863d84f04b2396946162934bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:16:56.736310 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=100 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:16:56.741029 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1e566a13-422c-4088-8371-6ca88c6b2ab0 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] 10.222.0.17 "GET /compute/v2.1/servers/94ff653c-ae36-4595-92e8-4fd6dfaa3922" status: 200 len: 1316 microversion: 2.1 time: 0.159050 Jul 23 22:16:56.741612 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3689/6299] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:16:56 2022] GET /compute/v2.1/servers/94ff653c-ae36-4595-92e8-4fd6dfaa3922 => generated 1316 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:16:57.504785 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-b443d537-0e29-47e5-81f3-40fd85f48323 req-a5062fcf-ce0f-48a2-a708-3b1f0bec8b9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94ff653c-ae36-4595-92e8-4fd6dfaa3922", "name": "network-vif-plugged", "status": "completed", "tag": "b6559ba2-64f8-42a3-9bd5-286c00e2daa0"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:16:57.513219 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-b443d537-0e29-47e5-81f3-40fd85f48323 req-a5062fcf-ce0f-48a2-a708-3b1f0bec8b9c service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:16:57.513666 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-b443d537-0e29-47e5-81f3-40fd85f48323 req-a5062fcf-ce0f-48a2-a708-3b1f0bec8b9c service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:16:57.525215 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-b443d537-0e29-47e5-81f3-40fd85f48323 req-a5062fcf-ce0f-48a2-a708-3b1f0bec8b9c service nova] Creating event network-vif-plugged:b6559ba2-64f8-42a3-9bd5-286c00e2daa0 for instance 94ff653c-ae36-4595-92e8-4fd6dfaa3922 on nch1-master-1 Jul 23 22:16:57.530168 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-b443d537-0e29-47e5-81f3-40fd85f48323 req-a5062fcf-ce0f-48a2-a708-3b1f0bec8b9c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029434 Jul 23 22:16:57.530784 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3690/6300] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:16:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:16:57.767712 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-63525621-9f81-4215-a320-09c6a06e8fe6 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:16:57.768441 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-63525621-9f81-4215-a320-09c6a06e8fe6 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] [instance: 94ff653c-ae36-4595-92e8-4fd6dfaa3922] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:16:57.778330 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-63525621-9f81-4215-a320-09c6a06e8fe6 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:16:57.778948 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-63525621-9f81-4215-a320-09c6a06e8fe6 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:16:57.779969 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-63525621-9f81-4215-a320-09c6a06e8fe6 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:16:57.780417 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-63525621-9f81-4215-a320-09c6a06e8fe6 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:16:57.921030 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-63525621-9f81-4215-a320-09c6a06e8fe6 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a11c0f61b4b45498c79dae845c4b3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7e3d863d84f04b2396946162934bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:16:57.928769 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-63525621-9f81-4215-a320-09c6a06e8fe6 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] 10.222.0.17 "GET /compute/v2.1/servers/94ff653c-ae36-4595-92e8-4fd6dfaa3922" status: 200 len: 1316 microversion: 2.1 time: 0.169300 Jul 23 22:16:57.929358 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3691/6301] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:16:57 2022] GET /compute/v2.1/servers/94ff653c-ae36-4595-92e8-4fd6dfaa3922 => generated 1316 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:16:58.951124 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-65f5359f-9f68-4fb1-80a0-f4c8264c3bf7 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:16:58.952098 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-65f5359f-9f68-4fb1-80a0-f4c8264c3bf7 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] [instance: 94ff653c-ae36-4595-92e8-4fd6dfaa3922] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:16:58.959911 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-65f5359f-9f68-4fb1-80a0-f4c8264c3bf7 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:16:58.960368 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-65f5359f-9f68-4fb1-80a0-f4c8264c3bf7 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:16:58.961156 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-65f5359f-9f68-4fb1-80a0-f4c8264c3bf7 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:16:58.961605 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-65f5359f-9f68-4fb1-80a0-f4c8264c3bf7 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:16:59.092758 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-65f5359f-9f68-4fb1-80a0-f4c8264c3bf7 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a11c0f61b4b45498c79dae845c4b3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7e3d863d84f04b2396946162934bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:16:59.100635 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-65f5359f-9f68-4fb1-80a0-f4c8264c3bf7 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] 10.222.0.17 "GET /compute/v2.1/servers/94ff653c-ae36-4595-92e8-4fd6dfaa3922" status: 200 len: 1505 microversion: 2.1 time: 0.156912 Jul 23 22:16:59.101223 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3692/6302] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:16:58 2022] GET /compute/v2.1/servers/94ff653c-ae36-4595-92e8-4fd6dfaa3922 => generated 1505 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:16:59.123239 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-230b07bc-d25f-4303-88c8-86bae1d2ccaf tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:16:59.123791 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-230b07bc-d25f-4303-88c8-86bae1d2ccaf tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] [instance: 94ff653c-ae36-4595-92e8-4fd6dfaa3922] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:16:59.131314 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-230b07bc-d25f-4303-88c8-86bae1d2ccaf tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:16:59.131780 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-230b07bc-d25f-4303-88c8-86bae1d2ccaf tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:16:59.132555 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-230b07bc-d25f-4303-88c8-86bae1d2ccaf tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:16:59.133002 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-230b07bc-d25f-4303-88c8-86bae1d2ccaf tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:16:59.158790 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-230b07bc-d25f-4303-88c8-86bae1d2ccaf tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] [instance: 94ff653c-ae36-4595-92e8-4fd6dfaa3922] Going to try to terminate instance {{(pid=131320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 22:16:59.239724 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-230b07bc-d25f-4303-88c8-86bae1d2ccaf tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] 10.222.0.17 "DELETE /compute/v2.1/servers/94ff653c-ae36-4595-92e8-4fd6dfaa3922" status: 204 len: 0 microversion: 2.1 time: 0.120979 Jul 23 22:16:59.240383 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3693/6303] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 22:16:59 2022] DELETE /compute/v2.1/servers/94ff653c-ae36-4595-92e8-4fd6dfaa3922 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 22:16:59.249226 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-288a543a-228f-4b04-a052-4be48f7dad1e tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:16:59.250127 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-288a543a-228f-4b04-a052-4be48f7dad1e tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] [instance: 94ff653c-ae36-4595-92e8-4fd6dfaa3922] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:16:59.256338 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-288a543a-228f-4b04-a052-4be48f7dad1e tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:16:59.256794 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-288a543a-228f-4b04-a052-4be48f7dad1e tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:16:59.257571 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-288a543a-228f-4b04-a052-4be48f7dad1e tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:16:59.258086 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-288a543a-228f-4b04-a052-4be48f7dad1e tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:16:59.407549 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-288a543a-228f-4b04-a052-4be48f7dad1e tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a11c0f61b4b45498c79dae845c4b3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7e3d863d84f04b2396946162934bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:16:59.416505 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-288a543a-228f-4b04-a052-4be48f7dad1e tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] 10.222.0.17 "GET /compute/v2.1/servers/94ff653c-ae36-4595-92e8-4fd6dfaa3922" status: 200 len: 1511 microversion: 2.1 time: 0.171408 Jul 23 22:16:59.417092 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3694/6304] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:16:59 2022] GET /compute/v2.1/servers/94ff653c-ae36-4595-92e8-4fd6dfaa3922 => generated 1511 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:17:00.438132 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a5ca9357-0b1f-4022-9fed-577a75a777d6 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:17:00.439185 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a5ca9357-0b1f-4022-9fed-577a75a777d6 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] [instance: 94ff653c-ae36-4595-92e8-4fd6dfaa3922] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:17:00.442166 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:17:00.443466 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=8 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:17:00.453942 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a5ca9357-0b1f-4022-9fed-577a75a777d6 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:17:00.454390 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a5ca9357-0b1f-4022-9fed-577a75a777d6 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:17:00.455169 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a5ca9357-0b1f-4022-9fed-577a75a777d6 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:17:00.455604 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a5ca9357-0b1f-4022-9fed-577a75a777d6 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:17:00.599969 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a5ca9357-0b1f-4022-9fed-577a75a777d6 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a11c0f61b4b45498c79dae845c4b3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7e3d863d84f04b2396946162934bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:17:00.609978 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a5ca9357-0b1f-4022-9fed-577a75a777d6 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] 10.222.0.17 "GET /compute/v2.1/servers/94ff653c-ae36-4595-92e8-4fd6dfaa3922" status: 200 len: 1511 microversion: 2.1 time: 0.178488 Jul 23 22:17:00.610739 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3695/6305] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:17:00 2022] GET /compute/v2.1/servers/94ff653c-ae36-4595-92e8-4fd6dfaa3922 => generated 1511 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:17:01.333454 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-d3d4832e-34dc-4691-a6cb-34d8720d5510 req-740e1977-baef-4d5e-a517-244af697bc89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94ff653c-ae36-4595-92e8-4fd6dfaa3922", "name": "network-vif-deleted", "tag": "b6559ba2-64f8-42a3-9bd5-286c00e2daa0"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:17:01.343208 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-d3d4832e-34dc-4691-a6cb-34d8720d5510 req-740e1977-baef-4d5e-a517-244af697bc89 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:17:01.343882 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-d3d4832e-34dc-4691-a6cb-34d8720d5510 req-740e1977-baef-4d5e-a517-244af697bc89 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:17:01.357433 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-d3d4832e-34dc-4691-a6cb-34d8720d5510 req-740e1977-baef-4d5e-a517-244af697bc89 service nova] Creating event network-vif-deleted:b6559ba2-64f8-42a3-9bd5-286c00e2daa0 for instance 94ff653c-ae36-4595-92e8-4fd6dfaa3922 on nch1-master-1 Jul 23 22:17:01.363369 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-d3d4832e-34dc-4691-a6cb-34d8720d5510 req-740e1977-baef-4d5e-a517-244af697bc89 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033771 Jul 23 22:17:01.364366 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3696/6306] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:17:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 22:17:01.629313 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-7616c556-d888-44d4-a0e0-0021547885d8 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:17:01.630006 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-7616c556-d888-44d4-a0e0-0021547885d8 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] [instance: 94ff653c-ae36-4595-92e8-4fd6dfaa3922] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:17:01.637831 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7616c556-d888-44d4-a0e0-0021547885d8 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:17:01.638312 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7616c556-d888-44d4-a0e0-0021547885d8 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:17:01.639087 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7616c556-d888-44d4-a0e0-0021547885d8 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:17:01.639530 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7616c556-d888-44d4-a0e0-0021547885d8 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:17:01.670985 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7616c556-d888-44d4-a0e0-0021547885d8 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:17:01.671439 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7616c556-d888-44d4-a0e0-0021547885d8 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:17:01.671895 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.objects.instance [None req-7616c556-d888-44d4-a0e0-0021547885d8 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lazy-loading 'fault' on Instance uuid 94ff653c-ae36-4595-92e8-4fd6dfaa3922 {{(pid=131320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 22:17:01.716086 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-7616c556-d888-44d4-a0e0-0021547885d8 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a11c0f61b4b45498c79dae845c4b3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7e3d863d84f04b2396946162934bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:17:01.724254 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-7616c556-d888-44d4-a0e0-0021547885d8 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] 10.222.0.17 "GET /compute/v2.1/servers/94ff653c-ae36-4595-92e8-4fd6dfaa3922" status: 200 len: 1306 microversion: 2.1 time: 0.099628 Jul 23 22:17:01.724826 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3697/6307] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:17:01 2022] GET /compute/v2.1/servers/94ff653c-ae36-4595-92e8-4fd6dfaa3922 => generated 1306 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:17:02.745090 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a40e120c-f72f-41b3-8e32-cf2950ed8e56 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:17:02.746275 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a40e120c-f72f-41b3-8e32-cf2950ed8e56 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] [instance: 94ff653c-ae36-4595-92e8-4fd6dfaa3922] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:17:02.757956 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a40e120c-f72f-41b3-8e32-cf2950ed8e56 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:17:02.758768 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a40e120c-f72f-41b3-8e32-cf2950ed8e56 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:17:02.760042 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a40e120c-f72f-41b3-8e32-cf2950ed8e56 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:17:02.760789 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a40e120c-f72f-41b3-8e32-cf2950ed8e56 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:17:02.776649 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-a40e120c-f72f-41b3-8e32-cf2950ed8e56 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] HTTP exception thrown: Instance 94ff653c-ae36-4595-92e8-4fd6dfaa3922 could not be found. Jul 23 22:17:02.778355 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a40e120c-f72f-41b3-8e32-cf2950ed8e56 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Request method failure captured: Jul 23 22:17:02.778355 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/94ff653c-ae36-4595-92e8-4fd6dfaa3922 HTTP/1.1 Jul 23 22:17:02.778355 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 22:17:02.778355 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 22:17:02.778355 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 22:17:02.778355 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 22:17:02.778355 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 22:17:02.778355 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 22:17:02.778355 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 22:17:02.778355 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 22:17:02.778355 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3HNFf0qmeCFYHTvnzWmbnBSQTxmO58_-hprYTGuicCLmLOGCifll0sbdUnGKRVsHGUsz2CoNe9deiDvWNLzIopR676XX3otNh876mKLqScb4bfSWyG9uuuPn6AIJ8Xs7qyNdKxl_gMN6nrYSQUANZDWHlsuedtTyV6WMWpirtRggf_M Jul 23 22:17:02.778355 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 22:17:02.778355 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 22:17:02.778355 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 22:17:02.778355 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 22:17:02.778355 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 22:17:02.778355 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 22:17:02.778355 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: c9d7e3d863d84f04b2396946162934bf Jul 23 22:17:02.778355 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServersNegativeTestJSON-1647544680 Jul 23 22:17:02.778355 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 22:17:02.778355 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 22:17:02.778355 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c9d7e3d863d84f04b2396946162934bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c9d7e3d863d84f04b2396946162934bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c9d7e3d863d84f04b2396946162934bf", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c9d7e3d863d84f04b2396946162934bf"}]}] Jul 23 22:17:02.778355 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServersNegativeTestJSON-1647544680 Jul 23 22:17:02.778355 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: c9d7e3d863d84f04b2396946162934bf Jul 23 22:17:02.778355 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1647544680 Jul 23 22:17:02.778355 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServersNegativeTestJSON-1647544680-project Jul 23 22:17:02.778355 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 22:17:02.778355 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 22:17:02.778355 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 9a11c0f61b4b45498c79dae845c4b3ce Jul 23 22:17:02.778355 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServersNegativeTestJSON-1647544680-project Jul 23 22:17:02.778355 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 22:17:02.778355 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance 94ff653c-ae36-4595-92e8-4fd6dfaa3922 could not be found. Jul 23 22:17:02.778355 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '94ff653c-ae36-4595-92e8-4fd6dfaa3922'} Jul 23 22:17:02.778355 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 22:17:02.778355 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:17:02.778355 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 22:17:02.778355 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 22:17:02.778355 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 22:17:02.778355 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 22:17:02.778355 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 22:17:02.778355 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 22:17:02.778355 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 22:17:02.778355 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 22:17:02.778355 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94ff653c-ae36-4595-92e8-4fd6dfaa3922 could not be found. Jul 23 22:17:02.778355 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:17:02.778355 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:17:02.778355 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:17:02.778355 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:17:02.778355 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:17:02.778355 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:17:02.778355 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 22:17:02.778355 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 22:17:02.778355 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 22:17:02.778355 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 22:17:02.778355 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 22:17:02.778355 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 22:17:02.778355 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 22:17:02.778355 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 22:17:02.778355 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 22:17:02.778355 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 22:17:02.778355 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94ff653c-ae36-4595-92e8-4fd6dfaa3922 could not be found. Jul 23 22:17:02.778355 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:17:02.778355 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:17:02.778355 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:17:02.783106 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:17:02.783106 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:17:02.783106 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:17:02.783106 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 22:17:02.783106 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 22:17:02.783106 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94ff653c-ae36-4595-92e8-4fd6dfaa3922 could not be found. Jul 23 22:17:02.783106 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:17:02.783106 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a40e120c-f72f-41b3-8e32-cf2950ed8e56 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Returning 404 to user: Instance 94ff653c-ae36-4595-92e8-4fd6dfaa3922 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 22:17:02.783106 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a40e120c-f72f-41b3-8e32-cf2950ed8e56 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] 10.222.0.17 "GET /compute/v2.1/servers/94ff653c-ae36-4595-92e8-4fd6dfaa3922" status: 404 len: 111 microversion: 2.1 time: 0.041461 Jul 23 22:17:02.783106 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3698/6308] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:17:02 2022] GET /compute/v2.1/servers/94ff653c-ae36-4595-92e8-4fd6dfaa3922 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 22:17:02.788572 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f968daad-0294-4e95-bc77-9518119807d2 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:17:02.789183 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f968daad-0294-4e95-bc77-9518119807d2 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] [instance: 298f07cc-b077-4ded-be45-cb90c6b24d07] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:17:02.795160 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f968daad-0294-4e95-bc77-9518119807d2 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:17:02.795613 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f968daad-0294-4e95-bc77-9518119807d2 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:17:02.796362 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f968daad-0294-4e95-bc77-9518119807d2 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:17:02.796850 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f968daad-0294-4e95-bc77-9518119807d2 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:17:02.927034 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f968daad-0294-4e95-bc77-9518119807d2 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a11c0f61b4b45498c79dae845c4b3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7e3d863d84f04b2396946162934bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:17:02.935223 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f968daad-0294-4e95-bc77-9518119807d2 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] 10.222.0.17 "GET /compute/v2.1/servers/298f07cc-b077-4ded-be45-cb90c6b24d07" status: 200 len: 1506 microversion: 2.1 time: 0.150193 Jul 23 22:17:02.935777 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3699/6309] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:17:02 2022] GET /compute/v2.1/servers/298f07cc-b077-4ded-be45-cb90c6b24d07 => generated 1506 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:17:02.951619 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a477d30f-62e4-4d74-b52c-5c3e258bc393 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:17:02.952583 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a477d30f-62e4-4d74-b52c-5c3e258bc393 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] [instance: 656e0bc4-ec99-40f0-b3ec-0cd6ba49b27e] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:17:02.958388 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-a477d30f-62e4-4d74-b52c-5c3e258bc393 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] HTTP exception thrown: Instance 656e0bc4-ec99-40f0-b3ec-0cd6ba49b27e could not be found. Jul 23 22:17:02.959946 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a477d30f-62e4-4d74-b52c-5c3e258bc393 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Request method failure captured: Jul 23 22:17:02.959946 ncdv-master-1 devstack@n-api.service[131320]: request: POST /compute/v2.1/servers/656e0bc4-ec99-40f0-b3ec-0cd6ba49b27e/action HTTP/1.1 Jul 23 22:17:02.959946 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 22:17:02.959946 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 22:17:02.959946 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 22:17:02.959946 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 32 Jul 23 22:17:02.959946 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 22:17:02.959946 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 22:17:02.959946 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 22:17:02.959946 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 22:17:02.959946 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3HNFf0qmeCFYHTvnzWmbnBSQTxmO58_-hprYTGuicCLmLOGCifll0sbdUnGKRVsHGUsz2CoNe9deiDvWNLzIopR676XX3otNh876mKLqScb4bfSWyG9uuuPn6AIJ8Xs7qyNdKxl_gMN6nrYSQUANZDWHlsuedtTyV6WMWpirtRggf_M Jul 23 22:17:02.959946 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 22:17:02.959946 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 22:17:02.959946 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 22:17:02.959946 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 22:17:02.959946 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 22:17:02.959946 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 22:17:02.959946 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: c9d7e3d863d84f04b2396946162934bf Jul 23 22:17:02.959946 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServersNegativeTestJSON-1647544680 Jul 23 22:17:02.959946 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 22:17:02.959946 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 22:17:02.959946 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c9d7e3d863d84f04b2396946162934bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c9d7e3d863d84f04b2396946162934bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c9d7e3d863d84f04b2396946162934bf", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c9d7e3d863d84f04b2396946162934bf"}]}] Jul 23 22:17:02.959946 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServersNegativeTestJSON-1647544680 Jul 23 22:17:02.959946 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: c9d7e3d863d84f04b2396946162934bf Jul 23 22:17:02.959946 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1647544680 Jul 23 22:17:02.959946 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServersNegativeTestJSON-1647544680-project Jul 23 22:17:02.959946 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 22:17:02.959946 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 22:17:02.959946 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 9a11c0f61b4b45498c79dae845c4b3ce Jul 23 22:17:02.959946 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServersNegativeTestJSON-1647544680-project Jul 23 22:17:02.959946 ncdv-master-1 devstack@n-api.service[131320]: Jul 23 22:17:02.959946 ncdv-master-1 devstack@n-api.service[131320]: {"resize": {"flavorRef": "452"}} Jul 23 22:17:02.959946 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 22:17:02.959946 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance 656e0bc4-ec99-40f0-b3ec-0cd6ba49b27e could not be found. Jul 23 22:17:02.959946 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '656e0bc4-ec99-40f0-b3ec-0cd6ba49b27e', 'body': {'resize': {'flavorRef': '452'}}} Jul 23 22:17:02.959946 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 22:17:02.959946 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:17:02.959946 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 22:17:02.959946 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 22:17:02.959946 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 22:17:02.959946 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 22:17:02.959946 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 23 22:17:02.959946 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 23 22:17:02.959946 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 656e0bc4-ec99-40f0-b3ec-0cd6ba49b27e could not be found. Jul 23 22:17:02.959946 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:17:02.959946 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:17:02.959946 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:17:02.959946 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:17:02.959946 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:17:02.959946 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:17:02.959946 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 22:17:02.959946 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 22:17:02.959946 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 22:17:02.959946 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 22:17:02.959946 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 22:17:02.959946 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 22:17:02.959946 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jul 23 22:17:02.959946 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 23 22:17:02.959946 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Jul 23 22:17:02.959946 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Jul 23 22:17:02.959946 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 22:17:02.959946 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 22:17:02.959946 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 22:17:02.959946 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 22:17:02.964446 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 656e0bc4-ec99-40f0-b3ec-0cd6ba49b27e could not be found. Jul 23 22:17:02.964446 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:17:02.964446 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:17:02.964446 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:17:02.964446 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:17:02.964446 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:17:02.964446 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:17:02.964446 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 22:17:02.964446 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 22:17:02.964446 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 656e0bc4-ec99-40f0-b3ec-0cd6ba49b27e could not be found. Jul 23 22:17:02.964446 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:17:02.964446 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a477d30f-62e4-4d74-b52c-5c3e258bc393 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Returning 404 to user: Instance 656e0bc4-ec99-40f0-b3ec-0cd6ba49b27e could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 22:17:02.964446 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a477d30f-62e4-4d74-b52c-5c3e258bc393 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] 10.222.0.17 "POST /compute/v2.1/servers/656e0bc4-ec99-40f0-b3ec-0cd6ba49b27e/action" status: 404 len: 111 microversion: 2.1 time: 0.013656 Jul 23 22:17:02.964446 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3700/6310] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 22:17:02 2022] POST /compute/v2.1/servers/656e0bc4-ec99-40f0-b3ec-0cd6ba49b27e/action => generated 111 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 22:17:02.968999 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ca90095b-a8cf-4c36-ba8d-f3d703f6fdeb tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:17:02.969595 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ca90095b-a8cf-4c36-ba8d-f3d703f6fdeb tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] [instance: 298f07cc-b077-4ded-be45-cb90c6b24d07] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:17:02.976417 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ca90095b-a8cf-4c36-ba8d-f3d703f6fdeb tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:17:02.976868 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ca90095b-a8cf-4c36-ba8d-f3d703f6fdeb tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:17:02.977628 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ca90095b-a8cf-4c36-ba8d-f3d703f6fdeb tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:17:02.978112 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ca90095b-a8cf-4c36-ba8d-f3d703f6fdeb tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:17:03.115333 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ca90095b-a8cf-4c36-ba8d-f3d703f6fdeb tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a11c0f61b4b45498c79dae845c4b3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7e3d863d84f04b2396946162934bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:17:03.123412 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ca90095b-a8cf-4c36-ba8d-f3d703f6fdeb tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] 10.222.0.17 "GET /compute/v2.1/servers/298f07cc-b077-4ded-be45-cb90c6b24d07" status: 200 len: 1506 microversion: 2.1 time: 0.157806 Jul 23 22:17:03.123999 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3701/6311] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:17:02 2022] GET /compute/v2.1/servers/298f07cc-b077-4ded-be45-cb90c6b24d07 => generated 1506 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:17:03.146175 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-37e4260c-c630-4244-a5bc-cc3d5abccff7 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:17:03.146791 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-37e4260c-c630-4244-a5bc-cc3d5abccff7 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] [instance: 298f07cc-b077-4ded-be45-cb90c6b24d07] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:17:03.153227 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-37e4260c-c630-4244-a5bc-cc3d5abccff7 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:17:03.153680 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-37e4260c-c630-4244-a5bc-cc3d5abccff7 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:17:03.154483 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-37e4260c-c630-4244-a5bc-cc3d5abccff7 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:17:03.154927 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-37e4260c-c630-4244-a5bc-cc3d5abccff7 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:17:03.292196 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-37e4260c-c630-4244-a5bc-cc3d5abccff7 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a11c0f61b4b45498c79dae845c4b3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7e3d863d84f04b2396946162934bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:17:03.300175 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-37e4260c-c630-4244-a5bc-cc3d5abccff7 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] 10.222.0.17 "GET /compute/v2.1/servers/298f07cc-b077-4ded-be45-cb90c6b24d07" status: 200 len: 1506 microversion: 2.1 time: 0.157866 Jul 23 22:17:03.300773 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3702/6312] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:17:03 2022] GET /compute/v2.1/servers/298f07cc-b077-4ded-be45-cb90c6b24d07 => generated 1506 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:17:03.316623 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-80d29ab9-eee5-486b-bbf8-aadf0beca21e tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "aa243a0f-68e4-4a58-a760-a05f84aae35c"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:17:03.317554 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-80d29ab9-eee5-486b-bbf8-aadf0beca21e tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] [instance: 298f07cc-b077-4ded-be45-cb90c6b24d07] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:17:03.324280 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-80d29ab9-eee5-486b-bbf8-aadf0beca21e tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:17:03.324725 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-80d29ab9-eee5-486b-bbf8-aadf0beca21e tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:17:03.325524 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-80d29ab9-eee5-486b-bbf8-aadf0beca21e tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:17:03.325983 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-80d29ab9-eee5-486b-bbf8-aadf0beca21e tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:17:03.354790 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-80d29ab9-eee5-486b-bbf8-aadf0beca21e tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '9a11c0f61b4b45498c79dae845c4b3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7e3d863d84f04b2396946162934bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:17:03.360414 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-80d29ab9-eee5-486b-bbf8-aadf0beca21e tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] HTTP exception thrown: Flavor aa243a0f-68e4-4a58-a760-a05f84aae35c could not be found. Jul 23 22:17:03.362273 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-80d29ab9-eee5-486b-bbf8-aadf0beca21e tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Request method failure captured: Jul 23 22:17:03.362273 ncdv-master-1 devstack@n-api.service[131320]: request: POST /compute/v2.1/servers/298f07cc-b077-4ded-be45-cb90c6b24d07/action HTTP/1.1 Jul 23 22:17:03.362273 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 22:17:03.362273 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 22:17:03.362273 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 22:17:03.362273 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 65 Jul 23 22:17:03.362273 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 22:17:03.362273 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 22:17:03.362273 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 22:17:03.362273 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 22:17:03.362273 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3HNFf0qmeCFYHTvnzWmbnBSQTxmO58_-hprYTGuicCLmLOGCifll0sbdUnGKRVsHGUsz2CoNe9deiDvWNLzIopR676XX3otNh876mKLqScb4bfSWyG9uuuPn6AIJ8Xs7qyNdKxl_gMN6nrYSQUANZDWHlsuedtTyV6WMWpirtRggf_M Jul 23 22:17:03.362273 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 22:17:03.362273 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 22:17:03.362273 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 22:17:03.362273 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 22:17:03.362273 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 22:17:03.362273 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 22:17:03.362273 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: c9d7e3d863d84f04b2396946162934bf Jul 23 22:17:03.362273 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServersNegativeTestJSON-1647544680 Jul 23 22:17:03.362273 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 22:17:03.362273 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 22:17:03.362273 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c9d7e3d863d84f04b2396946162934bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c9d7e3d863d84f04b2396946162934bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c9d7e3d863d84f04b2396946162934bf", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c9d7e3d863d84f04b2396946162934bf"}]}] Jul 23 22:17:03.362273 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServersNegativeTestJSON-1647544680 Jul 23 22:17:03.362273 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: c9d7e3d863d84f04b2396946162934bf Jul 23 22:17:03.362273 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1647544680 Jul 23 22:17:03.362273 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServersNegativeTestJSON-1647544680-project Jul 23 22:17:03.362273 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 22:17:03.362273 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 22:17:03.362273 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 9a11c0f61b4b45498c79dae845c4b3ce Jul 23 22:17:03.362273 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServersNegativeTestJSON-1647544680-project Jul 23 22:17:03.362273 ncdv-master-1 devstack@n-api.service[131320]: Jul 23 22:17:03.362273 ncdv-master-1 devstack@n-api.service[131320]: {"resize": {"flavorRef": "aa243a0f-68e4-4a58-a760-a05f84aae35c"}} Jul 23 22:17:03.362273 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 22:17:03.362273 ncdv-master-1 devstack@n-api.service[131320]: exception: Flavor aa243a0f-68e4-4a58-a760-a05f84aae35c could not be found. Jul 23 22:17:03.362273 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '298f07cc-b077-4ded-be45-cb90c6b24d07', 'body': {'resize': {'flavorRef': 'aa243a0f-68e4-4a58-a760-a05f84aae35c'}}} Jul 23 22:17:03.362273 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 22:17:03.362273 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:17:03.362273 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Jul 23 22:17:03.362273 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Jul 23 22:17:03.362273 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 23 22:17:03.362273 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 23 22:17:03.362273 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 23 22:17:03.362273 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 23 22:17:03.362273 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 23 22:17:03.362273 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 23 22:17:03.362273 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 23 22:17:03.362273 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 23 22:17:03.362273 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 23 22:17:03.362273 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 23 22:17:03.362273 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 23 22:17:03.362273 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 23 22:17:03.362273 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 23 22:17:03.362273 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 23 22:17:03.362273 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4146, in resize Jul 23 22:17:03.362273 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Jul 23 22:17:03.362273 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 23 22:17:03.362273 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 23 22:17:03.362273 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 23 22:17:03.362273 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 23 22:17:03.362273 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 23 22:17:03.362273 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 23 22:17:03.362273 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 23 22:17:03.366861 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 22:17:03.366861 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 23 22:17:03.366861 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 23 22:17:03.366861 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor aa243a0f-68e4-4a58-a760-a05f84aae35c could not be found. Jul 23 22:17:03.366861 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:17:03.366861 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:17:03.366861 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:17:03.366861 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:17:03.366861 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:17:03.366861 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:17:03.366861 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 22:17:03.366861 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 22:17:03.366861 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 22:17:03.366861 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 22:17:03.366861 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 23 22:17:03.366861 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 23 22:17:03.366861 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jul 23 22:17:03.366861 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 23 22:17:03.366861 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Jul 23 22:17:03.366861 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 23 22:17:03.366861 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor aa243a0f-68e4-4a58-a760-a05f84aae35c could not be found. Jul 23 22:17:03.366861 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:17:03.366861 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:17:03.366861 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:17:03.366861 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:17:03.366861 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:17:03.366861 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:17:03.366861 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 22:17:03.366861 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 22:17:03.366861 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor aa243a0f-68e4-4a58-a760-a05f84aae35c could not be found. Jul 23 22:17:03.366861 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:17:03.366861 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-80d29ab9-eee5-486b-bbf8-aadf0beca21e tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Returning 400 to user: Flavor aa243a0f-68e4-4a58-a760-a05f84aae35c could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 22:17:03.366861 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-80d29ab9-eee5-486b-bbf8-aadf0beca21e tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] 10.222.0.17 "POST /compute/v2.1/servers/298f07cc-b077-4ded-be45-cb90c6b24d07/action" status: 400 len: 107 microversion: 2.1 time: 0.051058 Jul 23 22:17:03.366861 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3703/6313] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 22:17:03 2022] POST /compute/v2.1/servers/298f07cc-b077-4ded-be45-cb90c6b24d07/action => generated 107 bytes in 52 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 23 22:17:03.372170 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-624f19cf-0331-408b-ba7c-1c149dadba7f tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:17:03.372769 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-624f19cf-0331-408b-ba7c-1c149dadba7f tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] [instance: 298f07cc-b077-4ded-be45-cb90c6b24d07] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:17:03.378677 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-624f19cf-0331-408b-ba7c-1c149dadba7f tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:17:03.379131 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-624f19cf-0331-408b-ba7c-1c149dadba7f tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:17:03.379888 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-624f19cf-0331-408b-ba7c-1c149dadba7f tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:17:03.380330 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-624f19cf-0331-408b-ba7c-1c149dadba7f tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:17:03.523927 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-624f19cf-0331-408b-ba7c-1c149dadba7f tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a11c0f61b4b45498c79dae845c4b3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7e3d863d84f04b2396946162934bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:17:03.535678 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-624f19cf-0331-408b-ba7c-1c149dadba7f tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] 10.222.0.17 "GET /compute/v2.1/servers/298f07cc-b077-4ded-be45-cb90c6b24d07" status: 200 len: 1506 microversion: 2.1 time: 0.166703 Jul 23 22:17:03.536467 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3704/6314] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:17:03 2022] GET /compute/v2.1/servers/298f07cc-b077-4ded-be45-cb90c6b24d07 => generated 1506 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:17:03.553072 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b94c4cbb-d190-4734-bbb8-76e321fc14db tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:17:03.553673 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b94c4cbb-d190-4734-bbb8-76e321fc14db tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] [instance: 298f07cc-b077-4ded-be45-cb90c6b24d07] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:17:03.560097 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b94c4cbb-d190-4734-bbb8-76e321fc14db tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:17:03.560554 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b94c4cbb-d190-4734-bbb8-76e321fc14db tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:17:03.561321 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b94c4cbb-d190-4734-bbb8-76e321fc14db tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:17:03.561762 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b94c4cbb-d190-4734-bbb8-76e321fc14db tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:17:03.694207 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b94c4cbb-d190-4734-bbb8-76e321fc14db tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a11c0f61b4b45498c79dae845c4b3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7e3d863d84f04b2396946162934bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:17:03.702693 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b94c4cbb-d190-4734-bbb8-76e321fc14db tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] 10.222.0.17 "GET /compute/v2.1/servers/298f07cc-b077-4ded-be45-cb90c6b24d07" status: 200 len: 1506 microversion: 2.1 time: 0.153247 Jul 23 22:17:03.703319 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3705/6315] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:17:03 2022] GET /compute/v2.1/servers/298f07cc-b077-4ded-be45-cb90c6b24d07 => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:17:03.718841 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ad5f7580-aaa9-4cdc-a120-77e7d02d5646 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:17:03.721119 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ad5f7580-aaa9-4cdc-a120-77e7d02d5646 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Request method failure captured: Jul 23 22:17:03.721119 ncdv-master-1 devstack@n-api.service[131320]: request: POST /compute/v2.1/servers/298f07cc-b077-4ded-be45-cb90c6b24d07/action HTTP/1.1 Jul 23 22:17:03.721119 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 22:17:03.721119 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 22:17:03.721119 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 22:17:03.721119 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 29 Jul 23 22:17:03.721119 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 22:17:03.721119 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 22:17:03.721119 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 22:17:03.721119 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 22:17:03.721119 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3HNFf0qmeCFYHTvnzWmbnBSQTxmO58_-hprYTGuicCLmLOGCifll0sbdUnGKRVsHGUsz2CoNe9deiDvWNLzIopR676XX3otNh876mKLqScb4bfSWyG9uuuPn6AIJ8Xs7qyNdKxl_gMN6nrYSQUANZDWHlsuedtTyV6WMWpirtRggf_M Jul 23 22:17:03.721119 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 22:17:03.721119 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 22:17:03.721119 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 22:17:03.721119 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 22:17:03.721119 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 22:17:03.721119 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 22:17:03.721119 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: c9d7e3d863d84f04b2396946162934bf Jul 23 22:17:03.721119 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServersNegativeTestJSON-1647544680 Jul 23 22:17:03.721119 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 22:17:03.721119 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 22:17:03.721119 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c9d7e3d863d84f04b2396946162934bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c9d7e3d863d84f04b2396946162934bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c9d7e3d863d84f04b2396946162934bf", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c9d7e3d863d84f04b2396946162934bf"}]}] Jul 23 22:17:03.721119 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServersNegativeTestJSON-1647544680 Jul 23 22:17:03.721119 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: c9d7e3d863d84f04b2396946162934bf Jul 23 22:17:03.721119 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1647544680 Jul 23 22:17:03.721119 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServersNegativeTestJSON-1647544680-project Jul 23 22:17:03.721119 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 22:17:03.721119 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 22:17:03.721119 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 9a11c0f61b4b45498c79dae845c4b3ce Jul 23 22:17:03.721119 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServersNegativeTestJSON-1647544680-project Jul 23 22:17:03.721119 ncdv-master-1 devstack@n-api.service[131320]: Jul 23 22:17:03.721119 ncdv-master-1 devstack@n-api.service[131320]: {"resize": {"flavorRef": ""}} Jul 23 22:17:03.721119 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 22:17:03.721119 ncdv-master-1 devstack@n-api.service[131320]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Jul 23 22:17:03.721119 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '298f07cc-b077-4ded-be45-cb90c6b24d07', 'body': {'resize': {'flavorRef': ''}}} Jul 23 22:17:03.721119 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 22:17:03.721119 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:17:03.721119 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 23 22:17:03.721119 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 23 22:17:03.721119 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 23 22:17:03.721119 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise error Jul 23 22:17:03.721119 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 23 22:17:03.721119 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:17:03.721119 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Jul 23 22:17:03.721119 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Jul 23 22:17:03.721119 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:17:03.721119 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi On instance['resize']: Jul 23 22:17:03.721119 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi '' Jul 23 22:17:03.721119 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:17:03.721119 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:17:03.721119 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:17:03.721119 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:17:03.721119 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:17:03.721119 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:17:03.721119 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 22:17:03.721119 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 22:17:03.721119 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 22:17:03.721119 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 22:17:03.721119 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 23 22:17:03.721119 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 23 22:17:03.721119 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 23 22:17:03.721119 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 23 22:17:03.721119 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 23 22:17:03.721119 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 23 22:17:03.721119 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Jul 23 22:17:03.721119 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:17:03.721119 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:17:03.726094 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:17:03.726094 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:17:03.726094 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:17:03.726094 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:17:03.726094 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 23 22:17:03.726094 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 23 22:17:03.726094 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Jul 23 22:17:03.726094 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:17:03.726094 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ad5f7580-aaa9-4cdc-a120-77e7d02d5646 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 22:17:03.726094 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ad5f7580-aaa9-4cdc-a120-77e7d02d5646 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] 10.222.0.17 "POST /compute/v2.1/servers/298f07cc-b077-4ded-be45-cb90c6b24d07/action" status: 400 len: 113 microversion: 2.1 time: 0.007363 Jul 23 22:17:03.726094 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3706/6316] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 22:17:03 2022] POST /compute/v2.1/servers/298f07cc-b077-4ded-be45-cb90c6b24d07/action => generated 113 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 23 22:17:03.729820 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-81a1fb6d-b7cc-4600-89c9-b1b8262a259c tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:17:03.730434 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-81a1fb6d-b7cc-4600-89c9-b1b8262a259c tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] [instance: 298f07cc-b077-4ded-be45-cb90c6b24d07] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:17:03.737668 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-81a1fb6d-b7cc-4600-89c9-b1b8262a259c tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:17:03.738165 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-81a1fb6d-b7cc-4600-89c9-b1b8262a259c tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:17:03.738954 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-81a1fb6d-b7cc-4600-89c9-b1b8262a259c tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:17:03.739394 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-81a1fb6d-b7cc-4600-89c9-b1b8262a259c tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:17:03.875736 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-81a1fb6d-b7cc-4600-89c9-b1b8262a259c tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a11c0f61b4b45498c79dae845c4b3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7e3d863d84f04b2396946162934bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:17:03.883481 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-81a1fb6d-b7cc-4600-89c9-b1b8262a259c tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] 10.222.0.17 "GET /compute/v2.1/servers/298f07cc-b077-4ded-be45-cb90c6b24d07" status: 200 len: 1506 microversion: 2.1 time: 0.156849 Jul 23 22:17:03.884058 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3707/6317] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:17:03 2022] GET /compute/v2.1/servers/298f07cc-b077-4ded-be45-cb90c6b24d07 => generated 1506 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:17:03.903990 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-afcf9f9d-99b4-4751-a4eb-5d5482d42a37 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:17:03.904460 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-afcf9f9d-99b4-4751-a4eb-5d5482d42a37 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] [instance: 94ff653c-ae36-4595-92e8-4fd6dfaa3922] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:17:03.910966 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-afcf9f9d-99b4-4751-a4eb-5d5482d42a37 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:17:03.911451 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-afcf9f9d-99b4-4751-a4eb-5d5482d42a37 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:17:03.912226 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-afcf9f9d-99b4-4751-a4eb-5d5482d42a37 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:17:03.912672 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-afcf9f9d-99b4-4751-a4eb-5d5482d42a37 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:17:03.926565 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-afcf9f9d-99b4-4751-a4eb-5d5482d42a37 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] HTTP exception thrown: Instance 94ff653c-ae36-4595-92e8-4fd6dfaa3922 could not be found. Jul 23 22:17:03.928131 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-afcf9f9d-99b4-4751-a4eb-5d5482d42a37 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Request method failure captured: Jul 23 22:17:03.928131 ncdv-master-1 devstack@n-api.service[131320]: request: DELETE /compute/v2.1/servers/94ff653c-ae36-4595-92e8-4fd6dfaa3922 HTTP/1.1 Jul 23 22:17:03.928131 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 22:17:03.928131 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 22:17:03.928131 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 22:17:03.928131 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 22:17:03.928131 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 22:17:03.928131 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 22:17:03.928131 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 22:17:03.928131 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 22:17:03.928131 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3HNFf0qmeCFYHTvnzWmbnBSQTxmO58_-hprYTGuicCLmLOGCifll0sbdUnGKRVsHGUsz2CoNe9deiDvWNLzIopR676XX3otNh876mKLqScb4bfSWyG9uuuPn6AIJ8Xs7qyNdKxl_gMN6nrYSQUANZDWHlsuedtTyV6WMWpirtRggf_M Jul 23 22:17:03.928131 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 22:17:03.928131 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 22:17:03.928131 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 22:17:03.928131 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 22:17:03.928131 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 22:17:03.928131 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 22:17:03.928131 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: c9d7e3d863d84f04b2396946162934bf Jul 23 22:17:03.928131 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServersNegativeTestJSON-1647544680 Jul 23 22:17:03.928131 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 22:17:03.928131 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 22:17:03.928131 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c9d7e3d863d84f04b2396946162934bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c9d7e3d863d84f04b2396946162934bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c9d7e3d863d84f04b2396946162934bf", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c9d7e3d863d84f04b2396946162934bf"}]}] Jul 23 22:17:03.928131 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServersNegativeTestJSON-1647544680 Jul 23 22:17:03.928131 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: c9d7e3d863d84f04b2396946162934bf Jul 23 22:17:03.928131 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1647544680 Jul 23 22:17:03.928131 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServersNegativeTestJSON-1647544680-project Jul 23 22:17:03.928131 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 22:17:03.928131 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 22:17:03.928131 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 9a11c0f61b4b45498c79dae845c4b3ce Jul 23 22:17:03.928131 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServersNegativeTestJSON-1647544680-project Jul 23 22:17:03.928131 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 22:17:03.928131 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance 94ff653c-ae36-4595-92e8-4fd6dfaa3922 could not be found. Jul 23 22:17:03.928131 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '94ff653c-ae36-4595-92e8-4fd6dfaa3922'} Jul 23 22:17:03.928131 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 22:17:03.928131 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:17:03.928131 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 22:17:03.928131 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 22:17:03.928131 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 22:17:03.928131 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 22:17:03.928131 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 22:17:03.928131 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 22:17:03.928131 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 22:17:03.928131 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 22:17:03.928131 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94ff653c-ae36-4595-92e8-4fd6dfaa3922 could not be found. Jul 23 22:17:03.928131 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:17:03.928131 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:17:03.928131 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:17:03.928131 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:17:03.928131 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:17:03.928131 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:17:03.928131 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 22:17:03.928131 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 22:17:03.928131 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 22:17:03.928131 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 22:17:03.928131 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 23 22:17:03.928131 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 23 22:17:03.928131 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 23 22:17:03.928131 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 23 22:17:03.928131 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 22:17:03.928131 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 22:17:03.928131 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 22:17:03.928131 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 22:17:03.932501 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94ff653c-ae36-4595-92e8-4fd6dfaa3922 could not be found. Jul 23 22:17:03.932501 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:17:03.932501 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:17:03.932501 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:17:03.932501 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:17:03.932501 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:17:03.932501 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:17:03.932501 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 22:17:03.932501 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 22:17:03.932501 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94ff653c-ae36-4595-92e8-4fd6dfaa3922 could not be found. Jul 23 22:17:03.932501 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:17:03.932501 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-afcf9f9d-99b4-4751-a4eb-5d5482d42a37 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Returning 404 to user: Instance 94ff653c-ae36-4595-92e8-4fd6dfaa3922 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 22:17:03.932501 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-afcf9f9d-99b4-4751-a4eb-5d5482d42a37 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] 10.222.0.17 "DELETE /compute/v2.1/servers/94ff653c-ae36-4595-92e8-4fd6dfaa3922" status: 404 len: 111 microversion: 2.1 time: 0.029290 Jul 23 22:17:03.932501 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3708/6318] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 22:17:03 2022] DELETE /compute/v2.1/servers/94ff653c-ae36-4595-92e8-4fd6dfaa3922 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 22:17:03.937433 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-fe08f1e7-4e37-4ec0-833a-3f9501abd3a6 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:17:03.938106 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-fe08f1e7-4e37-4ec0-833a-3f9501abd3a6 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] [instance: 94ff653c-ae36-4595-92e8-4fd6dfaa3922] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:17:03.943825 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fe08f1e7-4e37-4ec0-833a-3f9501abd3a6 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:17:03.944289 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fe08f1e7-4e37-4ec0-833a-3f9501abd3a6 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:17:03.945083 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fe08f1e7-4e37-4ec0-833a-3f9501abd3a6 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:17:03.945516 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fe08f1e7-4e37-4ec0-833a-3f9501abd3a6 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:17:03.959429 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-fe08f1e7-4e37-4ec0-833a-3f9501abd3a6 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] HTTP exception thrown: Instance 94ff653c-ae36-4595-92e8-4fd6dfaa3922 could not be found. Jul 23 22:17:03.960944 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-fe08f1e7-4e37-4ec0-833a-3f9501abd3a6 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Request method failure captured: Jul 23 22:17:03.960944 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/94ff653c-ae36-4595-92e8-4fd6dfaa3922 HTTP/1.1 Jul 23 22:17:03.960944 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 22:17:03.960944 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 22:17:03.960944 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 22:17:03.960944 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 22:17:03.960944 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 22:17:03.960944 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 22:17:03.960944 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 22:17:03.960944 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 22:17:03.960944 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3HNFf0qmeCFYHTvnzWmbnBSQTxmO58_-hprYTGuicCLmLOGCifll0sbdUnGKRVsHGUsz2CoNe9deiDvWNLzIopR676XX3otNh876mKLqScb4bfSWyG9uuuPn6AIJ8Xs7qyNdKxl_gMN6nrYSQUANZDWHlsuedtTyV6WMWpirtRggf_M Jul 23 22:17:03.960944 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 22:17:03.960944 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 22:17:03.960944 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 22:17:03.960944 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 22:17:03.960944 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 22:17:03.960944 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 22:17:03.960944 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: c9d7e3d863d84f04b2396946162934bf Jul 23 22:17:03.960944 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServersNegativeTestJSON-1647544680 Jul 23 22:17:03.960944 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 22:17:03.960944 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 22:17:03.960944 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c9d7e3d863d84f04b2396946162934bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c9d7e3d863d84f04b2396946162934bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c9d7e3d863d84f04b2396946162934bf", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c9d7e3d863d84f04b2396946162934bf"}]}] Jul 23 22:17:03.960944 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServersNegativeTestJSON-1647544680 Jul 23 22:17:03.960944 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: c9d7e3d863d84f04b2396946162934bf Jul 23 22:17:03.960944 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1647544680 Jul 23 22:17:03.960944 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServersNegativeTestJSON-1647544680-project Jul 23 22:17:03.960944 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 22:17:03.960944 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 22:17:03.960944 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 9a11c0f61b4b45498c79dae845c4b3ce Jul 23 22:17:03.960944 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServersNegativeTestJSON-1647544680-project Jul 23 22:17:03.960944 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 22:17:03.960944 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance 94ff653c-ae36-4595-92e8-4fd6dfaa3922 could not be found. Jul 23 22:17:03.960944 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '94ff653c-ae36-4595-92e8-4fd6dfaa3922'} Jul 23 22:17:03.960944 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 22:17:03.960944 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:17:03.960944 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 22:17:03.960944 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 22:17:03.960944 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 22:17:03.960944 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 22:17:03.960944 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 22:17:03.960944 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 22:17:03.960944 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 22:17:03.960944 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 22:17:03.960944 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94ff653c-ae36-4595-92e8-4fd6dfaa3922 could not be found. Jul 23 22:17:03.960944 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:17:03.960944 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:17:03.960944 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:17:03.960944 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:17:03.960944 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:17:03.960944 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:17:03.960944 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 22:17:03.960944 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 22:17:03.960944 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 22:17:03.960944 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 22:17:03.960944 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 22:17:03.960944 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 22:17:03.960944 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 22:17:03.960944 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 22:17:03.960944 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 22:17:03.960944 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 22:17:03.960944 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94ff653c-ae36-4595-92e8-4fd6dfaa3922 could not be found. Jul 23 22:17:03.960944 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:17:03.960944 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:17:03.960944 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:17:03.965611 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:17:03.965611 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:17:03.965611 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:17:03.965611 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 22:17:03.965611 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 22:17:03.965611 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94ff653c-ae36-4595-92e8-4fd6dfaa3922 could not be found. Jul 23 22:17:03.965611 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:17:03.965611 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-fe08f1e7-4e37-4ec0-833a-3f9501abd3a6 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Returning 404 to user: Instance 94ff653c-ae36-4595-92e8-4fd6dfaa3922 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 22:17:03.965611 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-fe08f1e7-4e37-4ec0-833a-3f9501abd3a6 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] 10.222.0.17 "GET /compute/v2.1/servers/94ff653c-ae36-4595-92e8-4fd6dfaa3922" status: 404 len: 111 microversion: 2.1 time: 0.028361 Jul 23 22:17:03.966373 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3709/6319] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:17:03 2022] GET /compute/v2.1/servers/94ff653c-ae36-4595-92e8-4fd6dfaa3922 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 23 22:17:03.970391 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-cefbbd7c-7799-4fe6-bb4a-5387555514a9 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:17:03.970884 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-cefbbd7c-7799-4fe6-bb4a-5387555514a9 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] [instance: 298f07cc-b077-4ded-be45-cb90c6b24d07] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:17:03.976610 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cefbbd7c-7799-4fe6-bb4a-5387555514a9 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:17:03.977065 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cefbbd7c-7799-4fe6-bb4a-5387555514a9 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:17:03.977838 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cefbbd7c-7799-4fe6-bb4a-5387555514a9 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:17:03.978309 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cefbbd7c-7799-4fe6-bb4a-5387555514a9 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:17:03.982396 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:17:04.004962 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-cefbbd7c-7799-4fe6-bb4a-5387555514a9 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] [instance: 298f07cc-b077-4ded-be45-cb90c6b24d07] Going to try to terminate instance {{(pid=131320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 22:17:04.084917 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-cefbbd7c-7799-4fe6-bb4a-5387555514a9 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] 10.222.0.17 "DELETE /compute/v2.1/servers/298f07cc-b077-4ded-be45-cb90c6b24d07" status: 204 len: 0 microversion: 2.1 time: 0.117802 Jul 23 22:17:04.085624 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3710/6320] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 22:17:03 2022] DELETE /compute/v2.1/servers/298f07cc-b077-4ded-be45-cb90c6b24d07 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 22:17:04.094572 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-876a91d8-7601-4721-b62b-b9e7e4713d43 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:17:04.095286 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-876a91d8-7601-4721-b62b-b9e7e4713d43 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] [instance: 298f07cc-b077-4ded-be45-cb90c6b24d07] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:17:04.101441 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-876a91d8-7601-4721-b62b-b9e7e4713d43 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:17:04.101972 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-876a91d8-7601-4721-b62b-b9e7e4713d43 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:17:04.102794 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-876a91d8-7601-4721-b62b-b9e7e4713d43 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:17:04.103244 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-876a91d8-7601-4721-b62b-b9e7e4713d43 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:17:04.246350 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-876a91d8-7601-4721-b62b-b9e7e4713d43 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a11c0f61b4b45498c79dae845c4b3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7e3d863d84f04b2396946162934bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:17:04.254114 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-876a91d8-7601-4721-b62b-b9e7e4713d43 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] 10.222.0.17 "GET /compute/v2.1/servers/298f07cc-b077-4ded-be45-cb90c6b24d07" status: 200 len: 1512 microversion: 2.1 time: 0.163771 Jul 23 22:17:04.254698 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3711/6321] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:17:04 2022] GET /compute/v2.1/servers/298f07cc-b077-4ded-be45-cb90c6b24d07 => generated 1512 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:17:05.278981 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-bf766a53-7e4f-46f7-8490-e6d79b0eb605 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:17:05.279976 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-bf766a53-7e4f-46f7-8490-e6d79b0eb605 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] [instance: 298f07cc-b077-4ded-be45-cb90c6b24d07] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:17:05.288216 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bf766a53-7e4f-46f7-8490-e6d79b0eb605 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:17:05.288669 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bf766a53-7e4f-46f7-8490-e6d79b0eb605 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:17:05.289448 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bf766a53-7e4f-46f7-8490-e6d79b0eb605 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:17:05.289904 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bf766a53-7e4f-46f7-8490-e6d79b0eb605 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:17:05.425452 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-bf766a53-7e4f-46f7-8490-e6d79b0eb605 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a11c0f61b4b45498c79dae845c4b3ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9d7e3d863d84f04b2396946162934bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:17:05.433466 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-bf766a53-7e4f-46f7-8490-e6d79b0eb605 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] 10.222.0.17 "GET /compute/v2.1/servers/298f07cc-b077-4ded-be45-cb90c6b24d07" status: 200 len: 1512 microversion: 2.1 time: 0.160721 Jul 23 22:17:05.434110 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3712/6322] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:17:05 2022] GET /compute/v2.1/servers/298f07cc-b077-4ded-be45-cb90c6b24d07 => generated 1512 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:17:05.892870 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-dd20ce34-a3fd-4776-b12b-9172a490f5ec req-a227b849-1281-4a80-bfd4-8bb9c8cf4f0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "298f07cc-b077-4ded-be45-cb90c6b24d07", "name": "network-vif-deleted", "tag": "d4b40c24-4373-4440-93e6-a53d4729d33b"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:17:05.903233 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-dd20ce34-a3fd-4776-b12b-9172a490f5ec req-a227b849-1281-4a80-bfd4-8bb9c8cf4f0e service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:17:05.904469 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-dd20ce34-a3fd-4776-b12b-9172a490f5ec req-a227b849-1281-4a80-bfd4-8bb9c8cf4f0e service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:17:05.917078 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-dd20ce34-a3fd-4776-b12b-9172a490f5ec req-a227b849-1281-4a80-bfd4-8bb9c8cf4f0e service nova] Creating event network-vif-deleted:d4b40c24-4373-4440-93e6-a53d4729d33b for instance 298f07cc-b077-4ded-be45-cb90c6b24d07 on nch2-master-1 Jul 23 22:17:05.923272 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-dd20ce34-a3fd-4776-b12b-9172a490f5ec req-a227b849-1281-4a80-bfd4-8bb9c8cf4f0e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034114 Jul 23 22:17:05.923919 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3713/6323] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:17:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:17:06.456322 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-bfdfd18b-5557-4149-b7d3-5c79c44534e8 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:17:06.457024 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-bfdfd18b-5557-4149-b7d3-5c79c44534e8 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] [instance: 298f07cc-b077-4ded-be45-cb90c6b24d07] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:17:06.464364 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bfdfd18b-5557-4149-b7d3-5c79c44534e8 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:17:06.464816 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bfdfd18b-5557-4149-b7d3-5c79c44534e8 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:17:06.465585 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bfdfd18b-5557-4149-b7d3-5c79c44534e8 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:17:06.466058 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bfdfd18b-5557-4149-b7d3-5c79c44534e8 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:17:06.479668 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-bfdfd18b-5557-4149-b7d3-5c79c44534e8 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] HTTP exception thrown: Instance 298f07cc-b077-4ded-be45-cb90c6b24d07 could not be found. Jul 23 22:17:06.481288 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-bfdfd18b-5557-4149-b7d3-5c79c44534e8 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Request method failure captured: Jul 23 22:17:06.481288 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/298f07cc-b077-4ded-be45-cb90c6b24d07 HTTP/1.1 Jul 23 22:17:06.481288 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 22:17:06.481288 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 22:17:06.481288 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 22:17:06.481288 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 22:17:06.481288 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 22:17:06.481288 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 22:17:06.481288 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 22:17:06.481288 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 22:17:06.481288 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3HNFf0qmeCFYHTvnzWmbnBSQTxmO58_-hprYTGuicCLmLOGCifll0sbdUnGKRVsHGUsz2CoNe9deiDvWNLzIopR676XX3otNh876mKLqScb4bfSWyG9uuuPn6AIJ8Xs7qyNdKxl_gMN6nrYSQUANZDWHlsuedtTyV6WMWpirtRggf_M Jul 23 22:17:06.481288 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 22:17:06.481288 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 22:17:06.481288 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 22:17:06.481288 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 22:17:06.481288 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 22:17:06.481288 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 22:17:06.481288 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: c9d7e3d863d84f04b2396946162934bf Jul 23 22:17:06.481288 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-ServersNegativeTestJSON-1647544680 Jul 23 22:17:06.481288 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 22:17:06.481288 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 22:17:06.481288 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c9d7e3d863d84f04b2396946162934bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c9d7e3d863d84f04b2396946162934bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c9d7e3d863d84f04b2396946162934bf", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c9d7e3d863d84f04b2396946162934bf"}]}] Jul 23 22:17:06.481288 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-ServersNegativeTestJSON-1647544680 Jul 23 22:17:06.481288 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: c9d7e3d863d84f04b2396946162934bf Jul 23 22:17:06.481288 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1647544680 Jul 23 22:17:06.481288 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-ServersNegativeTestJSON-1647544680-project Jul 23 22:17:06.481288 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 22:17:06.481288 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 22:17:06.481288 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 9a11c0f61b4b45498c79dae845c4b3ce Jul 23 22:17:06.481288 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-ServersNegativeTestJSON-1647544680-project Jul 23 22:17:06.481288 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 22:17:06.481288 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance 298f07cc-b077-4ded-be45-cb90c6b24d07 could not be found. Jul 23 22:17:06.481288 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '298f07cc-b077-4ded-be45-cb90c6b24d07'} Jul 23 22:17:06.481288 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 22:17:06.481288 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:17:06.481288 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 22:17:06.481288 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 22:17:06.481288 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 22:17:06.481288 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 22:17:06.481288 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 22:17:06.481288 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 22:17:06.481288 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 22:17:06.481288 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 22:17:06.481288 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 298f07cc-b077-4ded-be45-cb90c6b24d07 could not be found. Jul 23 22:17:06.481288 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:17:06.481288 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:17:06.481288 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:17:06.481288 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:17:06.481288 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:17:06.481288 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:17:06.481288 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 22:17:06.481288 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 22:17:06.481288 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 22:17:06.481288 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 22:17:06.481288 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 22:17:06.481288 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 22:17:06.481288 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 22:17:06.481288 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 22:17:06.481288 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 22:17:06.481288 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 22:17:06.481288 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 298f07cc-b077-4ded-be45-cb90c6b24d07 could not be found. Jul 23 22:17:06.481288 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:17:06.481288 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:17:06.481288 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:17:06.485160 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:17:06.485160 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:17:06.485160 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:17:06.485160 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 22:17:06.485160 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 22:17:06.485160 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 298f07cc-b077-4ded-be45-cb90c6b24d07 could not be found. Jul 23 22:17:06.485160 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:17:06.485160 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-bfdfd18b-5557-4149-b7d3-5c79c44534e8 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] Returning 404 to user: Instance 298f07cc-b077-4ded-be45-cb90c6b24d07 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 22:17:06.485160 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-bfdfd18b-5557-4149-b7d3-5c79c44534e8 tempest-ServersNegativeTestJSON-1647544680 tempest-ServersNegativeTestJSON-1647544680-project] 10.222.0.17 "GET /compute/v2.1/servers/298f07cc-b077-4ded-be45-cb90c6b24d07" status: 404 len: 111 microversion: 2.1 time: 0.033377 Jul 23 22:17:06.485160 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3714/6324] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:17:06 2022] GET /compute/v2.1/servers/298f07cc-b077-4ded-be45-cb90c6b24d07 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 22:17:47.990405 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e9651589-b4df-440f-8606-1ca1dd39d1b7 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Action: 'create', calling method: .version_select at 0x7f0b59925040>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-171551447", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMUJXrQyg1uYKyuxNqN8DVXIYyYXt4PVBRMcJM8TOnd0gBgsq3PT0/VXQtDZ9DVfT/WneTQerk+40LSKcvpmDZ1EQGNi/5NIQ18yobAe5Nku4kgX8BIJp2vflawDNWtlRQ=="}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:17:47.995427 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:17:47.996088 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:17:48.010731 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-e9651589-b4df-440f-8606-1ca1dd39d1b7 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Getting quotas for project ca0dd3e44fa14488a171994ee34ebdc8. Resources: {'key_pairs'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 22:17:48.016456 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-e9651589-b4df-440f-8606-1ca1dd39d1b7 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Getting quotas for user 4e7399a71fa0499f8a305c8f79a0be97 and project ca0dd3e44fa14488a171994ee34ebdc8. Resources: {'key_pairs'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 22:17:48.042857 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e9651589-b4df-440f-8606-1ca1dd39d1b7 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.056267 Jul 23 22:17:48.043868 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3715/6325] 10.222.0.17 () {60 vars in 1158 bytes} [Sat Jul 23 22:17:47 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:17:48.100014 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-79c54244-a78c-4244-a4f6-e45789dcfb45 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1213159864", "imageRef": "209e57f5-445a-46bc-9b16-8bdafe46280f", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-171551447", "networks": [{"uuid": "d2216893-28aa-4281-aaae-e941197924b3"}]}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:17:48.157436 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-79c54244-a78c-4244-a4f6-e45789dcfb45 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] validate_networks() for [('d2216893-28aa-4281-aaae-e941197924b3', None, None, None, None, None)] {{(pid=131320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 22:17:48.568623 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-79c54244-a78c-4244-a4f6-e45789dcfb45 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 22:17:48.569043 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-79c54244-a78c-4244-a4f6-e45789dcfb45 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 22:17:48.569518 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-79c54244-a78c-4244-a4f6-e45789dcfb45 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 22:17:48.569961 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-79c54244-a78c-4244-a4f6-e45789dcfb45 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 22:17:48.570374 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-79c54244-a78c-4244-a4f6-e45789dcfb45 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 22:17:48.580758 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-79c54244-a78c-4244-a4f6-e45789dcfb45 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:17:48.581207 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-79c54244-a78c-4244-a4f6-e45789dcfb45 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:17:48.582121 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-79c54244-a78c-4244-a4f6-e45789dcfb45 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:17:48.582566 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-79c54244-a78c-4244-a4f6-e45789dcfb45 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:17:48.601542 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-79c54244-a78c-4244-a4f6-e45789dcfb45 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Getting quotas for project ca0dd3e44fa14488a171994ee34ebdc8. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 22:17:48.607436 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-79c54244-a78c-4244-a4f6-e45789dcfb45 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Getting quotas for user 4e7399a71fa0499f8a305c8f79a0be97 and project ca0dd3e44fa14488a171994ee34ebdc8. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 22:17:48.620659 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-79c54244-a78c-4244-a4f6-e45789dcfb45 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Going to run 1 instances... {{(pid=131320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 22:17:48.622932 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-79c54244-a78c-4244-a4f6-e45789dcfb45 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] [instance: b58a923e-a080-4959-9d06-9e6d69845a6d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='209e57f5-445a-46bc-9b16-8bdafe46280f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 22:17:48.669228 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-79c54244-a78c-4244-a4f6-e45789dcfb45 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.573679 Jul 23 22:17:48.669920 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3716/6326] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 22:17:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 575 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 23 22:17:48.679735 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-eb510b77-890d-4398-b1d1-5ad95e9e07b5 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:17:48.680393 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-eb510b77-890d-4398-b1d1-5ad95e9e07b5 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] [instance: b58a923e-a080-4959-9d06-9e6d69845a6d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:17:48.738383 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-eb510b77-890d-4398-b1d1-5ad95e9e07b5 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7399a71fa0499f8a305c8f79a0be97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0dd3e44fa14488a171994ee34ebdc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:17:48.745157 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-eb510b77-890d-4398-b1d1-5ad95e9e07b5 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] 10.222.0.17 "GET /compute/v2.1/servers/b58a923e-a080-4959-9d06-9e6d69845a6d" status: 200 len: 1258 microversion: 2.1 time: 0.069243 Jul 23 22:17:48.746134 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3717/6327] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:17:48 2022] GET /compute/v2.1/servers/b58a923e-a080-4959-9d06-9e6d69845a6d => generated 1258 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:17:49.762043 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3ca0c0ba-c237-4a82-97eb-ee487c0bbbba tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:17:49.762672 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-3ca0c0ba-c237-4a82-97eb-ee487c0bbbba tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] [instance: b58a923e-a080-4959-9d06-9e6d69845a6d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:17:49.770931 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3ca0c0ba-c237-4a82-97eb-ee487c0bbbba tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:17:49.771366 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3ca0c0ba-c237-4a82-97eb-ee487c0bbbba tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:17:49.772147 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3ca0c0ba-c237-4a82-97eb-ee487c0bbbba tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:17:49.772569 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3ca0c0ba-c237-4a82-97eb-ee487c0bbbba tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:17:49.838993 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-3ca0c0ba-c237-4a82-97eb-ee487c0bbbba tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7399a71fa0499f8a305c8f79a0be97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0dd3e44fa14488a171994ee34ebdc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:17:49.847050 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-3ca0c0ba-c237-4a82-97eb-ee487c0bbbba tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] 10.222.0.17 "GET /compute/v2.1/servers/b58a923e-a080-4959-9d06-9e6d69845a6d" status: 200 len: 1328 microversion: 2.1 time: 0.089190 Jul 23 22:17:49.847652 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3718/6328] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:17:49 2022] GET /compute/v2.1/servers/b58a923e-a080-4959-9d06-9e6d69845a6d => generated 1328 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:17:50.864306 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2a99fa86-ecc8-4d47-bef5-c810baf53634 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:17:50.865003 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-2a99fa86-ecc8-4d47-bef5-c810baf53634 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] [instance: b58a923e-a080-4959-9d06-9e6d69845a6d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:17:50.873666 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2a99fa86-ecc8-4d47-bef5-c810baf53634 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:17:50.874141 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2a99fa86-ecc8-4d47-bef5-c810baf53634 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:17:50.875152 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2a99fa86-ecc8-4d47-bef5-c810baf53634 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:17:50.875773 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2a99fa86-ecc8-4d47-bef5-c810baf53634 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:17:51.036007 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-2a99fa86-ecc8-4d47-bef5-c810baf53634 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7399a71fa0499f8a305c8f79a0be97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0dd3e44fa14488a171994ee34ebdc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:17:51.045517 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2a99fa86-ecc8-4d47-bef5-c810baf53634 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] 10.222.0.17 "GET /compute/v2.1/servers/b58a923e-a080-4959-9d06-9e6d69845a6d" status: 200 len: 1358 microversion: 2.1 time: 0.185110 Jul 23 22:17:51.057344 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3719/6329] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:17:50 2022] GET /compute/v2.1/servers/b58a923e-a080-4959-9d06-9e6d69845a6d => generated 1358 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:17:52.075136 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5fe0cd95-663f-45fc-a514-2916134486ac tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:17:52.075754 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5fe0cd95-663f-45fc-a514-2916134486ac tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] [instance: b58a923e-a080-4959-9d06-9e6d69845a6d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:17:52.083343 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5fe0cd95-663f-45fc-a514-2916134486ac tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:17:52.083781 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5fe0cd95-663f-45fc-a514-2916134486ac tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:17:52.084767 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5fe0cd95-663f-45fc-a514-2916134486ac tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:17:52.085207 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5fe0cd95-663f-45fc-a514-2916134486ac tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:17:52.242011 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5fe0cd95-663f-45fc-a514-2916134486ac tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7399a71fa0499f8a305c8f79a0be97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0dd3e44fa14488a171994ee34ebdc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:17:52.252880 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5fe0cd95-663f-45fc-a514-2916134486ac tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] 10.222.0.17 "GET /compute/v2.1/servers/b58a923e-a080-4959-9d06-9e6d69845a6d" status: 200 len: 1358 microversion: 2.1 time: 0.182106 Jul 23 22:17:52.253478 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3720/6330] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:17:52 2022] GET /compute/v2.1/servers/b58a923e-a080-4959-9d06-9e6d69845a6d => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:17:53.277164 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ead9f181-4c14-4d4c-b25c-fabff6c41b87 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:17:53.277164 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ead9f181-4c14-4d4c-b25c-fabff6c41b87 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] [instance: b58a923e-a080-4959-9d06-9e6d69845a6d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:17:53.288220 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ead9f181-4c14-4d4c-b25c-fabff6c41b87 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:17:53.288800 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ead9f181-4c14-4d4c-b25c-fabff6c41b87 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:17:53.289597 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ead9f181-4c14-4d4c-b25c-fabff6c41b87 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:17:53.290066 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ead9f181-4c14-4d4c-b25c-fabff6c41b87 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:17:53.439963 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ead9f181-4c14-4d4c-b25c-fabff6c41b87 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7399a71fa0499f8a305c8f79a0be97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0dd3e44fa14488a171994ee34ebdc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:17:53.449072 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ead9f181-4c14-4d4c-b25c-fabff6c41b87 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] 10.222.0.17 "GET /compute/v2.1/servers/b58a923e-a080-4959-9d06-9e6d69845a6d" status: 200 len: 1358 microversion: 2.1 time: 0.182764 Jul 23 22:17:53.455413 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3721/6331] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:17:53 2022] GET /compute/v2.1/servers/b58a923e-a080-4959-9d06-9e6d69845a6d => generated 1358 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:17:54.466855 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-99f292d9-47d2-4604-9fa4-51b9cd8f64be tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:17:54.467551 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-99f292d9-47d2-4604-9fa4-51b9cd8f64be tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] [instance: b58a923e-a080-4959-9d06-9e6d69845a6d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:17:54.475145 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-99f292d9-47d2-4604-9fa4-51b9cd8f64be tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:17:54.475602 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-99f292d9-47d2-4604-9fa4-51b9cd8f64be tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:17:54.476475 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-99f292d9-47d2-4604-9fa4-51b9cd8f64be tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:17:54.477040 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-99f292d9-47d2-4604-9fa4-51b9cd8f64be tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:17:54.619800 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-99f292d9-47d2-4604-9fa4-51b9cd8f64be tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7399a71fa0499f8a305c8f79a0be97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0dd3e44fa14488a171994ee34ebdc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:17:54.637548 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-99f292d9-47d2-4604-9fa4-51b9cd8f64be tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] 10.222.0.17 "GET /compute/v2.1/servers/b58a923e-a080-4959-9d06-9e6d69845a6d" status: 200 len: 1358 microversion: 2.1 time: 0.174654 Jul 23 22:17:54.638353 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3722/6332] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:17:54 2022] GET /compute/v2.1/servers/b58a923e-a080-4959-9d06-9e6d69845a6d => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:17:55.656336 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a22cf838-f5c3-4e45-b9fd-f277188a4091 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:17:55.657056 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a22cf838-f5c3-4e45-b9fd-f277188a4091 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] [instance: b58a923e-a080-4959-9d06-9e6d69845a6d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:17:55.665533 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a22cf838-f5c3-4e45-b9fd-f277188a4091 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:17:55.665994 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a22cf838-f5c3-4e45-b9fd-f277188a4091 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:17:55.666795 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a22cf838-f5c3-4e45-b9fd-f277188a4091 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:17:55.667390 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a22cf838-f5c3-4e45-b9fd-f277188a4091 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:17:55.835364 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a22cf838-f5c3-4e45-b9fd-f277188a4091 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7399a71fa0499f8a305c8f79a0be97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0dd3e44fa14488a171994ee34ebdc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:17:55.843681 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a22cf838-f5c3-4e45-b9fd-f277188a4091 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] 10.222.0.17 "GET /compute/v2.1/servers/b58a923e-a080-4959-9d06-9e6d69845a6d" status: 200 len: 1358 microversion: 2.1 time: 0.192241 Jul 23 22:17:55.845121 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3723/6333] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:17:55 2022] GET /compute/v2.1/servers/b58a923e-a080-4959-9d06-9e6d69845a6d => generated 1358 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:17:56.861088 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-438ca3f3-a7bd-4ea6-a537-9550ac40b9d6 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:17:56.861772 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-438ca3f3-a7bd-4ea6-a537-9550ac40b9d6 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] [instance: b58a923e-a080-4959-9d06-9e6d69845a6d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:17:56.869201 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-438ca3f3-a7bd-4ea6-a537-9550ac40b9d6 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:17:56.869680 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-438ca3f3-a7bd-4ea6-a537-9550ac40b9d6 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:17:56.870512 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-438ca3f3-a7bd-4ea6-a537-9550ac40b9d6 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:17:56.870950 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-438ca3f3-a7bd-4ea6-a537-9550ac40b9d6 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:17:57.008706 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-438ca3f3-a7bd-4ea6-a537-9550ac40b9d6 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7399a71fa0499f8a305c8f79a0be97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0dd3e44fa14488a171994ee34ebdc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:17:57.016644 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-438ca3f3-a7bd-4ea6-a537-9550ac40b9d6 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] 10.222.0.17 "GET /compute/v2.1/servers/b58a923e-a080-4959-9d06-9e6d69845a6d" status: 200 len: 1358 microversion: 2.1 time: 0.159661 Jul 23 22:17:57.017200 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3724/6334] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:17:56 2022] GET /compute/v2.1/servers/b58a923e-a080-4959-9d06-9e6d69845a6d => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:17:58.165512 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-1c4f3efb-47ef-4d62-b59d-7352a8cdfb94 req-f72c2915-1e42-4baa-a6f6-1ad970c40958 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b58a923e-a080-4959-9d06-9e6d69845a6d", "tag": "4229b63c-0eda-4be0-9b89-51e7f9be7f9f"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:17:58.174255 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-1c4f3efb-47ef-4d62-b59d-7352a8cdfb94 req-f72c2915-1e42-4baa-a6f6-1ad970c40958 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:17:58.174707 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-1c4f3efb-47ef-4d62-b59d-7352a8cdfb94 req-f72c2915-1e42-4baa-a6f6-1ad970c40958 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:17:58.186708 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-1c4f3efb-47ef-4d62-b59d-7352a8cdfb94 req-f72c2915-1e42-4baa-a6f6-1ad970c40958 service nova] Creating event network-changed:4229b63c-0eda-4be0-9b89-51e7f9be7f9f for instance b58a923e-a080-4959-9d06-9e6d69845a6d on nch2-master-1 Jul 23 22:17:58.192098 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-1c4f3efb-47ef-4d62-b59d-7352a8cdfb94 req-f72c2915-1e42-4baa-a6f6-1ad970c40958 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.184214 Jul 23 22:17:58.192775 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3725/6335] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:17:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 22:17:58.198736 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5f8ae64e-1317-43b3-9af3-69e62f5ece56 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:17:58.199444 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5f8ae64e-1317-43b3-9af3-69e62f5ece56 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] [instance: b58a923e-a080-4959-9d06-9e6d69845a6d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:17:58.206395 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5f8ae64e-1317-43b3-9af3-69e62f5ece56 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:17:58.206883 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5f8ae64e-1317-43b3-9af3-69e62f5ece56 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:17:58.207677 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5f8ae64e-1317-43b3-9af3-69e62f5ece56 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:17:58.208117 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5f8ae64e-1317-43b3-9af3-69e62f5ece56 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:17:58.345641 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5f8ae64e-1317-43b3-9af3-69e62f5ece56 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7399a71fa0499f8a305c8f79a0be97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0dd3e44fa14488a171994ee34ebdc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:17:58.353432 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5f8ae64e-1317-43b3-9af3-69e62f5ece56 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] 10.222.0.17 "GET /compute/v2.1/servers/b58a923e-a080-4959-9d06-9e6d69845a6d" status: 200 len: 1358 microversion: 2.1 time: 0.159346 Jul 23 22:17:58.354047 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3726/6336] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:17:58 2022] GET /compute/v2.1/servers/b58a923e-a080-4959-9d06-9e6d69845a6d => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:17:59.372884 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-014d55aa-86f2-4d38-9994-bb466be3ea50 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:17:59.373565 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-014d55aa-86f2-4d38-9994-bb466be3ea50 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] [instance: b58a923e-a080-4959-9d06-9e6d69845a6d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:17:59.378998 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:17:59.379801 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=12 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:17:59.382765 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-014d55aa-86f2-4d38-9994-bb466be3ea50 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:17:59.383222 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-014d55aa-86f2-4d38-9994-bb466be3ea50 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:17:59.384064 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-014d55aa-86f2-4d38-9994-bb466be3ea50 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:17:59.384509 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-014d55aa-86f2-4d38-9994-bb466be3ea50 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:17:59.517567 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-014d55aa-86f2-4d38-9994-bb466be3ea50 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7399a71fa0499f8a305c8f79a0be97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0dd3e44fa14488a171994ee34ebdc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:17:59.525257 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-014d55aa-86f2-4d38-9994-bb466be3ea50 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] 10.222.0.17 "GET /compute/v2.1/servers/b58a923e-a080-4959-9d06-9e6d69845a6d" status: 200 len: 1358 microversion: 2.1 time: 0.158309 Jul 23 22:17:59.525829 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3727/6337] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:17:59 2022] GET /compute/v2.1/servers/b58a923e-a080-4959-9d06-9e6d69845a6d => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:18:00.546816 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b9837aaf-11c3-40d1-9b62-976402dec6d6 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:18:00.547887 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b9837aaf-11c3-40d1-9b62-976402dec6d6 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] [instance: b58a923e-a080-4959-9d06-9e6d69845a6d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:18:00.556512 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b9837aaf-11c3-40d1-9b62-976402dec6d6 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:18:00.557020 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b9837aaf-11c3-40d1-9b62-976402dec6d6 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:18:00.557966 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b9837aaf-11c3-40d1-9b62-976402dec6d6 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:18:00.558486 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b9837aaf-11c3-40d1-9b62-976402dec6d6 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:18:00.701305 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b9837aaf-11c3-40d1-9b62-976402dec6d6 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7399a71fa0499f8a305c8f79a0be97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0dd3e44fa14488a171994ee34ebdc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:18:00.709212 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b9837aaf-11c3-40d1-9b62-976402dec6d6 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] 10.222.0.17 "GET /compute/v2.1/servers/b58a923e-a080-4959-9d06-9e6d69845a6d" status: 200 len: 1358 microversion: 2.1 time: 0.169134 Jul 23 22:18:00.709803 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3728/6338] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:18:00 2022] GET /compute/v2.1/servers/b58a923e-a080-4959-9d06-9e6d69845a6d => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:18:01.731597 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-12fca139-a8ca-4805-9a05-0f5fa064c719 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:18:01.732591 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-12fca139-a8ca-4805-9a05-0f5fa064c719 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] [instance: b58a923e-a080-4959-9d06-9e6d69845a6d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:18:01.744505 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-12fca139-a8ca-4805-9a05-0f5fa064c719 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:18:01.745311 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-12fca139-a8ca-4805-9a05-0f5fa064c719 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:18:01.746677 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-12fca139-a8ca-4805-9a05-0f5fa064c719 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:18:01.747414 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-12fca139-a8ca-4805-9a05-0f5fa064c719 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:18:01.879860 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-12fca139-a8ca-4805-9a05-0f5fa064c719 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7399a71fa0499f8a305c8f79a0be97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0dd3e44fa14488a171994ee34ebdc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:18:01.887845 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-12fca139-a8ca-4805-9a05-0f5fa064c719 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] 10.222.0.17 "GET /compute/v2.1/servers/b58a923e-a080-4959-9d06-9e6d69845a6d" status: 200 len: 1358 microversion: 2.1 time: 0.162990 Jul 23 22:18:01.888436 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3729/6339] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:18:01 2022] GET /compute/v2.1/servers/b58a923e-a080-4959-9d06-9e6d69845a6d => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:18:02.908595 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-74e44462-7b4b-4743-8fbd-20c49a67973c tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:18:02.909196 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-74e44462-7b4b-4743-8fbd-20c49a67973c tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] [instance: b58a923e-a080-4959-9d06-9e6d69845a6d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:18:02.916673 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-74e44462-7b4b-4743-8fbd-20c49a67973c tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:18:02.917136 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-74e44462-7b4b-4743-8fbd-20c49a67973c tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:18:02.917979 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-74e44462-7b4b-4743-8fbd-20c49a67973c tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:18:02.918424 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-74e44462-7b4b-4743-8fbd-20c49a67973c tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:18:03.050226 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-74e44462-7b4b-4743-8fbd-20c49a67973c tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7399a71fa0499f8a305c8f79a0be97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0dd3e44fa14488a171994ee34ebdc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:18:03.059798 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-74e44462-7b4b-4743-8fbd-20c49a67973c tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] 10.222.0.17 "GET /compute/v2.1/servers/b58a923e-a080-4959-9d06-9e6d69845a6d" status: 200 len: 1358 microversion: 2.1 time: 0.156851 Jul 23 22:18:03.060584 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3730/6340] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:18:02 2022] GET /compute/v2.1/servers/b58a923e-a080-4959-9d06-9e6d69845a6d => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:18:03.218120 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-c3c1a681-dcd8-45d5-a154-887a64c94a63 req-2c86e5d2-e95e-4ce5-b157-ebabb3a66a27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b58a923e-a080-4959-9d06-9e6d69845a6d", "name": "network-vif-plugged", "status": "completed", "tag": "4229b63c-0eda-4be0-9b89-51e7f9be7f9f"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:18:03.227390 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-c3c1a681-dcd8-45d5-a154-887a64c94a63 req-2c86e5d2-e95e-4ce5-b157-ebabb3a66a27 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:18:03.227833 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-c3c1a681-dcd8-45d5-a154-887a64c94a63 req-2c86e5d2-e95e-4ce5-b157-ebabb3a66a27 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:18:03.238929 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-c3c1a681-dcd8-45d5-a154-887a64c94a63 req-2c86e5d2-e95e-4ce5-b157-ebabb3a66a27 service nova] Creating event network-vif-plugged:4229b63c-0eda-4be0-9b89-51e7f9be7f9f for instance b58a923e-a080-4959-9d06-9e6d69845a6d on nch2-master-1 Jul 23 22:18:03.243834 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-c3c1a681-dcd8-45d5-a154-887a64c94a63 req-2c86e5d2-e95e-4ce5-b157-ebabb3a66a27 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085390 Jul 23 22:18:03.244431 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3731/6341] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:18:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:18:04.081491 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d99f4c8e-77e1-4870-97ae-264f19633f26 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:18:04.082220 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d99f4c8e-77e1-4870-97ae-264f19633f26 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] [instance: b58a923e-a080-4959-9d06-9e6d69845a6d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:18:04.090325 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d99f4c8e-77e1-4870-97ae-264f19633f26 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:18:04.090774 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d99f4c8e-77e1-4870-97ae-264f19633f26 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:18:04.091611 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d99f4c8e-77e1-4870-97ae-264f19633f26 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:18:04.092048 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d99f4c8e-77e1-4870-97ae-264f19633f26 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:18:04.227223 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d99f4c8e-77e1-4870-97ae-264f19633f26 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7399a71fa0499f8a305c8f79a0be97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0dd3e44fa14488a171994ee34ebdc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:18:04.235498 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d99f4c8e-77e1-4870-97ae-264f19633f26 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] 10.222.0.17 "GET /compute/v2.1/servers/b58a923e-a080-4959-9d06-9e6d69845a6d" status: 200 len: 1358 microversion: 2.1 time: 0.160250 Jul 23 22:18:04.236052 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3732/6342] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:18:04 2022] GET /compute/v2.1/servers/b58a923e-a080-4959-9d06-9e6d69845a6d => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:18:05.252209 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6a50f69c-a770-4f11-9061-c17d6d24324d tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:18:05.252848 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6a50f69c-a770-4f11-9061-c17d6d24324d tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] [instance: b58a923e-a080-4959-9d06-9e6d69845a6d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:18:05.260316 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6a50f69c-a770-4f11-9061-c17d6d24324d tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:18:05.260771 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6a50f69c-a770-4f11-9061-c17d6d24324d tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:18:05.261575 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6a50f69c-a770-4f11-9061-c17d6d24324d tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:18:05.262040 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6a50f69c-a770-4f11-9061-c17d6d24324d tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:18:05.392426 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6a50f69c-a770-4f11-9061-c17d6d24324d tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7399a71fa0499f8a305c8f79a0be97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0dd3e44fa14488a171994ee34ebdc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:18:05.400376 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6a50f69c-a770-4f11-9061-c17d6d24324d tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] 10.222.0.17 "GET /compute/v2.1/servers/b58a923e-a080-4959-9d06-9e6d69845a6d" status: 200 len: 1547 microversion: 2.1 time: 0.152271 Jul 23 22:18:05.400953 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3733/6343] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:18:05 2022] GET /compute/v2.1/servers/b58a923e-a080-4959-9d06-9e6d69845a6d => generated 1547 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:18:05.416284 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5e69f991-cd4e-432d-89ad-02cf76870442 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:18:05.416918 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5e69f991-cd4e-432d-89ad-02cf76870442 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] [instance: b58a923e-a080-4959-9d06-9e6d69845a6d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:18:05.422718 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5e69f991-cd4e-432d-89ad-02cf76870442 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:18:05.423164 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5e69f991-cd4e-432d-89ad-02cf76870442 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:18:05.423932 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5e69f991-cd4e-432d-89ad-02cf76870442 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:18:05.424354 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5e69f991-cd4e-432d-89ad-02cf76870442 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:18:05.563496 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5e69f991-cd4e-432d-89ad-02cf76870442 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7399a71fa0499f8a305c8f79a0be97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0dd3e44fa14488a171994ee34ebdc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:18:05.571289 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5e69f991-cd4e-432d-89ad-02cf76870442 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] 10.222.0.17 "GET /compute/v2.1/servers/b58a923e-a080-4959-9d06-9e6d69845a6d" status: 200 len: 1547 microversion: 2.1 time: 0.158491 Jul 23 22:18:05.572204 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3734/6344] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:18:05 2022] GET /compute/v2.1/servers/b58a923e-a080-4959-9d06-9e6d69845a6d => generated 1547 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:18:05.587636 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e9463ec6-fed0-4dfc-bb6b-b97933f7058f tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:18:05.590767 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e9463ec6-fed0-4dfc-bb6b-b97933f7058f tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4e7399a71fa0499f8a305c8f79a0be97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0dd3e44fa14488a171994ee34ebdc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:18:05.591551 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e9463ec6-fed0-4dfc-bb6b-b97933f7058f tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Searching by: {'deleted': False, 'project_id': 'ca0dd3e44fa14488a171994ee34ebdc8'} {{(pid=131320) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 23 22:18:05.597073 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e9463ec6-fed0-4dfc-bb6b-b97933f7058f tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:18:05.597518 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e9463ec6-fed0-4dfc-bb6b-b97933f7058f tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:18:05.598343 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e9463ec6-fed0-4dfc-bb6b-b97933f7058f tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:18:05.598777 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e9463ec6-fed0-4dfc-bb6b-b97933f7058f tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:18:05.623841 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.multi_cell_list [None req-e9463ec6-fed0-4dfc-bb6b-b97933f7058f tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131320) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 23 22:18:05.626486 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=100 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:18:05.654555 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e9463ec6-fed0-4dfc-bb6b-b97933f7058f tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] 10.222.0.17 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.070478 Jul 23 22:18:05.655193 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3735/6345] 10.222.0.17 () {58 vars in 1124 bytes} [Sat Jul 23 22:18:05 2022] GET /compute/v2.1/servers => generated 343 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:18:05.667041 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-dd61d3d9-ca7e-4bb9-a221-8a6e73b6b0ea tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:18:05.667793 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-dd61d3d9-ca7e-4bb9-a221-8a6e73b6b0ea tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] [instance: b58a923e-a080-4959-9d06-9e6d69845a6d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:18:05.674857 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dd61d3d9-ca7e-4bb9-a221-8a6e73b6b0ea tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:18:05.675314 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dd61d3d9-ca7e-4bb9-a221-8a6e73b6b0ea tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:18:05.676175 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dd61d3d9-ca7e-4bb9-a221-8a6e73b6b0ea tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:18:05.676716 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dd61d3d9-ca7e-4bb9-a221-8a6e73b6b0ea tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:18:05.817102 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-dd61d3d9-ca7e-4bb9-a221-8a6e73b6b0ea tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7399a71fa0499f8a305c8f79a0be97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0dd3e44fa14488a171994ee34ebdc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:18:05.824833 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-dd61d3d9-ca7e-4bb9-a221-8a6e73b6b0ea tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] 10.222.0.17 "GET /compute/v2.1/servers/b58a923e-a080-4959-9d06-9e6d69845a6d" status: 200 len: 1547 microversion: 2.1 time: 0.163036 Jul 23 22:18:05.825459 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3736/6346] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:18:05 2022] GET /compute/v2.1/servers/b58a923e-a080-4959-9d06-9e6d69845a6d => generated 1547 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:18:07.373750 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8fe21b6d-096c-42b3-91b0-656010b23013 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:18:07.374416 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8fe21b6d-096c-42b3-91b0-656010b23013 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] [instance: b58a923e-a080-4959-9d06-9e6d69845a6d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:18:07.381661 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8fe21b6d-096c-42b3-91b0-656010b23013 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:18:07.382166 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8fe21b6d-096c-42b3-91b0-656010b23013 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:18:07.382939 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8fe21b6d-096c-42b3-91b0-656010b23013 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:18:07.383388 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8fe21b6d-096c-42b3-91b0-656010b23013 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:18:07.407993 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8fe21b6d-096c-42b3-91b0-656010b23013 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] [instance: b58a923e-a080-4959-9d06-9e6d69845a6d] Going to try to terminate instance {{(pid=131320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 22:18:07.488319 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8fe21b6d-096c-42b3-91b0-656010b23013 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] 10.222.0.17 "DELETE /compute/v2.1/servers/b58a923e-a080-4959-9d06-9e6d69845a6d" status: 204 len: 0 microversion: 2.1 time: 0.119940 Jul 23 22:18:07.489142 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3737/6347] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 22:18:07 2022] DELETE /compute/v2.1/servers/b58a923e-a080-4959-9d06-9e6d69845a6d => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 22:18:07.500933 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5c486770-cae7-4cb7-bf12-5fa474297beb tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:18:07.501635 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5c486770-cae7-4cb7-bf12-5fa474297beb tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] [instance: b58a923e-a080-4959-9d06-9e6d69845a6d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:18:07.507962 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5c486770-cae7-4cb7-bf12-5fa474297beb tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:18:07.508405 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5c486770-cae7-4cb7-bf12-5fa474297beb tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:18:07.509168 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5c486770-cae7-4cb7-bf12-5fa474297beb tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:18:07.509600 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5c486770-cae7-4cb7-bf12-5fa474297beb tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:18:07.638235 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5c486770-cae7-4cb7-bf12-5fa474297beb tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7399a71fa0499f8a305c8f79a0be97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0dd3e44fa14488a171994ee34ebdc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:18:07.646256 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5c486770-cae7-4cb7-bf12-5fa474297beb tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] 10.222.0.17 "GET /compute/v2.1/servers/b58a923e-a080-4959-9d06-9e6d69845a6d" status: 200 len: 1553 microversion: 2.1 time: 0.150017 Jul 23 22:18:07.646824 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3738/6348] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:18:07 2022] GET /compute/v2.1/servers/b58a923e-a080-4959-9d06-9e6d69845a6d => generated 1553 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:18:08.667936 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5217d997-4a5d-4701-9237-a437c5324f9c tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:18:08.669010 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5217d997-4a5d-4701-9237-a437c5324f9c tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] [instance: b58a923e-a080-4959-9d06-9e6d69845a6d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:18:08.677808 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5217d997-4a5d-4701-9237-a437c5324f9c tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:18:08.678320 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5217d997-4a5d-4701-9237-a437c5324f9c tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:18:08.679128 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5217d997-4a5d-4701-9237-a437c5324f9c tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:18:08.679572 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5217d997-4a5d-4701-9237-a437c5324f9c tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:18:08.815138 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5217d997-4a5d-4701-9237-a437c5324f9c tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7399a71fa0499f8a305c8f79a0be97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0dd3e44fa14488a171994ee34ebdc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:18:08.824376 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5217d997-4a5d-4701-9237-a437c5324f9c tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] 10.222.0.17 "GET /compute/v2.1/servers/b58a923e-a080-4959-9d06-9e6d69845a6d" status: 200 len: 1553 microversion: 2.1 time: 0.162950 Jul 23 22:18:08.829924 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3739/6349] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:18:08 2022] GET /compute/v2.1/servers/b58a923e-a080-4959-9d06-9e6d69845a6d => generated 1553 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:18:09.280057 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-9ad73317-cc75-4422-b170-7a2b007dcbf6 req-9a9c3cef-bfcf-4a12-b99e-24f6256a29fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b58a923e-a080-4959-9d06-9e6d69845a6d", "name": "network-vif-deleted", "tag": "4229b63c-0eda-4be0-9b89-51e7f9be7f9f"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:18:09.293433 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-9ad73317-cc75-4422-b170-7a2b007dcbf6 req-9a9c3cef-bfcf-4a12-b99e-24f6256a29fa service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:18:09.293906 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-9ad73317-cc75-4422-b170-7a2b007dcbf6 req-9a9c3cef-bfcf-4a12-b99e-24f6256a29fa service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:18:09.306059 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-9ad73317-cc75-4422-b170-7a2b007dcbf6 req-9a9c3cef-bfcf-4a12-b99e-24f6256a29fa service nova] Creating event network-vif-deleted:4229b63c-0eda-4be0-9b89-51e7f9be7f9f for instance b58a923e-a080-4959-9d06-9e6d69845a6d on nch2-master-1 Jul 23 22:18:09.311339 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-9ad73317-cc75-4422-b170-7a2b007dcbf6 req-9a9c3cef-bfcf-4a12-b99e-24f6256a29fa service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037205 Jul 23 22:18:09.312031 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3740/6350] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:18:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:18:09.842656 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-281abb53-224e-4875-bb5c-f586d4b1d5cb tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:18:09.843367 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-281abb53-224e-4875-bb5c-f586d4b1d5cb tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] [instance: b58a923e-a080-4959-9d06-9e6d69845a6d] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:18:09.850412 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-281abb53-224e-4875-bb5c-f586d4b1d5cb tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:18:09.850874 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-281abb53-224e-4875-bb5c-f586d4b1d5cb tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:18:09.851656 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-281abb53-224e-4875-bb5c-f586d4b1d5cb tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:18:09.852092 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-281abb53-224e-4875-bb5c-f586d4b1d5cb tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:18:09.865826 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-281abb53-224e-4875-bb5c-f586d4b1d5cb tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] HTTP exception thrown: Instance b58a923e-a080-4959-9d06-9e6d69845a6d could not be found. Jul 23 22:18:09.867491 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-281abb53-224e-4875-bb5c-f586d4b1d5cb tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Request method failure captured: Jul 23 22:18:09.867491 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/b58a923e-a080-4959-9d06-9e6d69845a6d HTTP/1.1 Jul 23 22:18:09.867491 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 22:18:09.867491 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 22:18:09.867491 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 22:18:09.867491 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 22:18:09.867491 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 22:18:09.867491 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 22:18:09.867491 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 22:18:09.867491 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 22:18:09.867491 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3HN96QsrOsdRIuG-o1W6Uy7h6FdmiQOWOLbxWgl8VRo8PYzyaB9BTa6YZLMQBOgX0ZLiP6n0QO_gtsyMU8-bCGBD1LCh4V9z8qL2ezQNUam16-oW4CXj07UYNbvPvl3cwJXkCBv7uifGbbLVE5leFvQQ6r0eB57fq_bFALxjfvvb0mw Jul 23 22:18:09.867491 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 22:18:09.867491 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 22:18:09.867491 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 22:18:09.867491 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 22:18:09.867491 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 22:18:09.867491 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 22:18:09.867491 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: ca0dd3e44fa14488a171994ee34ebdc8 Jul 23 22:18:09.867491 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-TestMinimumBasicScenario-1035013710 Jul 23 22:18:09.867491 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 22:18:09.867491 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 22:18:09.867491 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ca0dd3e44fa14488a171994ee34ebdc8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ca0dd3e44fa14488a171994ee34ebdc8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ca0dd3e44fa14488a171994ee34ebdc8", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ca0dd3e44fa14488a171994ee34ebdc8"}]}] Jul 23 22:18:09.867491 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-TestMinimumBasicScenario-1035013710 Jul 23 22:18:09.867491 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: ca0dd3e44fa14488a171994ee34ebdc8 Jul 23 22:18:09.867491 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1035013710 Jul 23 22:18:09.867491 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-TestMinimumBasicScenario-1035013710-project Jul 23 22:18:09.867491 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 22:18:09.867491 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 22:18:09.867491 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 4e7399a71fa0499f8a305c8f79a0be97 Jul 23 22:18:09.867491 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-TestMinimumBasicScenario-1035013710-project Jul 23 22:18:09.867491 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 22:18:09.867491 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance b58a923e-a080-4959-9d06-9e6d69845a6d could not be found. Jul 23 22:18:09.867491 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': 'b58a923e-a080-4959-9d06-9e6d69845a6d'} Jul 23 22:18:09.867491 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 22:18:09.867491 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:18:09.867491 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 22:18:09.867491 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 22:18:09.867491 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 22:18:09.867491 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 22:18:09.867491 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 22:18:09.867491 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 22:18:09.867491 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 22:18:09.867491 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 22:18:09.867491 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b58a923e-a080-4959-9d06-9e6d69845a6d could not be found. Jul 23 22:18:09.867491 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:18:09.867491 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:18:09.867491 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:18:09.867491 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:18:09.867491 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:18:09.867491 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:18:09.867491 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 22:18:09.867491 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 22:18:09.867491 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 22:18:09.867491 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 22:18:09.867491 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 22:18:09.867491 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 22:18:09.867491 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 22:18:09.867491 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 22:18:09.867491 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 22:18:09.867491 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 22:18:09.867491 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b58a923e-a080-4959-9d06-9e6d69845a6d could not be found. Jul 23 22:18:09.867491 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:18:09.867491 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:18:09.867491 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:18:09.871950 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:18:09.871950 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:18:09.871950 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:18:09.871950 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 22:18:09.871950 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 22:18:09.871950 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b58a923e-a080-4959-9d06-9e6d69845a6d could not be found. Jul 23 22:18:09.871950 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:18:09.871950 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-281abb53-224e-4875-bb5c-f586d4b1d5cb tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Returning 404 to user: Instance b58a923e-a080-4959-9d06-9e6d69845a6d could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 22:18:09.871950 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-281abb53-224e-4875-bb5c-f586d4b1d5cb tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] 10.222.0.17 "GET /compute/v2.1/servers/b58a923e-a080-4959-9d06-9e6d69845a6d" status: 404 len: 111 microversion: 2.1 time: 0.031712 Jul 23 22:18:09.871950 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3741/6351] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:18:09 2022] GET /compute/v2.1/servers/b58a923e-a080-4959-9d06-9e6d69845a6d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 22:18:09.877347 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e4ea5cea-5eb2-403d-9bb0-1b858d6c8226 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Calling method '.version_select at 0x7f0b464cc670>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:18:09.901647 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e4ea5cea-5eb2-403d-9bb0-1b858d6c8226 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-171551447" status: 202 len: 0 microversion: 2.1 time: 0.027331 Jul 23 22:18:09.902223 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3742/6352] 10.222.0.17 () {58 vars in 1268 bytes} [Sat Jul 23 22:18:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-171551447 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 23 22:18:18.695232 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:18:18.699810 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f06d84c4-a438-46bb-ab77-f1e592f5ea1b tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Action: 'create', calling method: .version_select at 0x7f0b46589a60>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-248092488", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHY7x+QUUg5pVJk66FcV7bUMxtnE1mHRN45p5+8jhbeWfEmqOcIXwQ4pcd0xIcPhJHvHm0k9jU5rFmraS7SZjob7i8r4zDZ3fD8ZOUNyMyh5Cd4ZUN1dai8ZK7LBnPeW8w=="}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:18:18.703825 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:18:18.718145 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-f06d84c4-a438-46bb-ab77-f1e592f5ea1b tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Getting quotas for project ca0dd3e44fa14488a171994ee34ebdc8. Resources: {'key_pairs'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 22:18:18.723746 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-f06d84c4-a438-46bb-ab77-f1e592f5ea1b tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Getting quotas for user 4e7399a71fa0499f8a305c8f79a0be97 and project ca0dd3e44fa14488a171994ee34ebdc8. Resources: {'key_pairs'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 22:18:18.748443 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f06d84c4-a438-46bb-ab77-f1e592f5ea1b tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.055144 Jul 23 22:18:18.749044 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3743/6353] 10.222.0.17 () {60 vars in 1158 bytes} [Sat Jul 23 22:18:18 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:18:18.801023 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c39d07e1-997f-4007-b6d2-08ea1799e371 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1185585704", "imageRef": "186d1b88-3d29-4264-bef0-80d9bc182a48", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-248092488", "networks": [{"uuid": "d2216893-28aa-4281-aaae-e941197924b3"}]}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:18:18.853847 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-c39d07e1-997f-4007-b6d2-08ea1799e371 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] validate_networks() for [('d2216893-28aa-4281-aaae-e941197924b3', None, None, None, None, None)] {{(pid=131320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 22:18:19.329839 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-c39d07e1-997f-4007-b6d2-08ea1799e371 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 22:18:19.330293 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-c39d07e1-997f-4007-b6d2-08ea1799e371 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 22:18:19.330770 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-c39d07e1-997f-4007-b6d2-08ea1799e371 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 22:18:19.331177 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-c39d07e1-997f-4007-b6d2-08ea1799e371 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 22:18:19.331583 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-c39d07e1-997f-4007-b6d2-08ea1799e371 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 22:18:19.341593 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c39d07e1-997f-4007-b6d2-08ea1799e371 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:18:19.342078 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c39d07e1-997f-4007-b6d2-08ea1799e371 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:18:19.342877 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c39d07e1-997f-4007-b6d2-08ea1799e371 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:18:19.343307 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c39d07e1-997f-4007-b6d2-08ea1799e371 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:18:19.361234 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-c39d07e1-997f-4007-b6d2-08ea1799e371 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Getting quotas for project ca0dd3e44fa14488a171994ee34ebdc8. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 22:18:19.366858 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-c39d07e1-997f-4007-b6d2-08ea1799e371 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Getting quotas for user 4e7399a71fa0499f8a305c8f79a0be97 and project ca0dd3e44fa14488a171994ee34ebdc8. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 22:18:19.380437 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c39d07e1-997f-4007-b6d2-08ea1799e371 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Going to run 1 instances... {{(pid=131320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 22:18:19.382620 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c39d07e1-997f-4007-b6d2-08ea1799e371 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] [instance: 6e9e953e-026d-45f8-917d-7e54b181beea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='186d1b88-3d29-4264-bef0-80d9bc182a48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 22:18:19.429133 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c39d07e1-997f-4007-b6d2-08ea1799e371 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.633930 Jul 23 22:18:19.429791 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3744/6354] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 22:18:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 636 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 23 22:18:19.439825 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d9254e69-d9ac-495f-8424-54a2f0cf0298 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:18:19.440440 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d9254e69-d9ac-495f-8424-54a2f0cf0298 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] [instance: 6e9e953e-026d-45f8-917d-7e54b181beea] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:18:19.497027 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d9254e69-d9ac-495f-8424-54a2f0cf0298 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7399a71fa0499f8a305c8f79a0be97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0dd3e44fa14488a171994ee34ebdc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:18:19.503959 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d9254e69-d9ac-495f-8424-54a2f0cf0298 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] 10.222.0.17 "GET /compute/v2.1/servers/6e9e953e-026d-45f8-917d-7e54b181beea" status: 200 len: 1258 microversion: 2.1 time: 0.068048 Jul 23 22:18:19.504740 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3745/6355] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:18:19 2022] GET /compute/v2.1/servers/6e9e953e-026d-45f8-917d-7e54b181beea => generated 1258 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:18:20.520806 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f0df913d-654d-4b8a-a785-9c3252805c37 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:18:20.521501 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f0df913d-654d-4b8a-a785-9c3252805c37 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] [instance: 6e9e953e-026d-45f8-917d-7e54b181beea] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:18:20.532136 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f0df913d-654d-4b8a-a785-9c3252805c37 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:18:20.532568 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f0df913d-654d-4b8a-a785-9c3252805c37 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:18:20.533355 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f0df913d-654d-4b8a-a785-9c3252805c37 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:18:20.533798 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f0df913d-654d-4b8a-a785-9c3252805c37 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:18:20.599212 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f0df913d-654d-4b8a-a785-9c3252805c37 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7399a71fa0499f8a305c8f79a0be97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0dd3e44fa14488a171994ee34ebdc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:18:20.607098 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f0df913d-654d-4b8a-a785-9c3252805c37 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] 10.222.0.17 "GET /compute/v2.1/servers/6e9e953e-026d-45f8-917d-7e54b181beea" status: 200 len: 1328 microversion: 2.1 time: 0.090152 Jul 23 22:18:20.607779 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3746/6356] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:18:20 2022] GET /compute/v2.1/servers/6e9e953e-026d-45f8-917d-7e54b181beea => generated 1328 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:18:21.624623 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-199e7f5c-720f-43ef-ba56-127b12bb08b4 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:18:21.625320 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-199e7f5c-720f-43ef-ba56-127b12bb08b4 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] [instance: 6e9e953e-026d-45f8-917d-7e54b181beea] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:18:21.632421 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-199e7f5c-720f-43ef-ba56-127b12bb08b4 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:18:21.632850 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-199e7f5c-720f-43ef-ba56-127b12bb08b4 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:18:21.633816 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-199e7f5c-720f-43ef-ba56-127b12bb08b4 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:18:21.634464 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-199e7f5c-720f-43ef-ba56-127b12bb08b4 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:18:21.777110 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-199e7f5c-720f-43ef-ba56-127b12bb08b4 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7399a71fa0499f8a305c8f79a0be97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0dd3e44fa14488a171994ee34ebdc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:18:21.785217 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-199e7f5c-720f-43ef-ba56-127b12bb08b4 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] 10.222.0.17 "GET /compute/v2.1/servers/6e9e953e-026d-45f8-917d-7e54b181beea" status: 200 len: 1358 microversion: 2.1 time: 0.164537 Jul 23 22:18:21.793178 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3747/6357] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:18:21 2022] GET /compute/v2.1/servers/6e9e953e-026d-45f8-917d-7e54b181beea => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:18:22.811057 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-06a8ab6a-4e7a-440b-9e22-8b59245ee33a tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:18:22.812659 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-06a8ab6a-4e7a-440b-9e22-8b59245ee33a tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] [instance: 6e9e953e-026d-45f8-917d-7e54b181beea] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:18:22.822403 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-06a8ab6a-4e7a-440b-9e22-8b59245ee33a tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:18:22.822853 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-06a8ab6a-4e7a-440b-9e22-8b59245ee33a tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:18:22.823790 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-06a8ab6a-4e7a-440b-9e22-8b59245ee33a tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:18:22.824231 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-06a8ab6a-4e7a-440b-9e22-8b59245ee33a tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:18:22.976151 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-06a8ab6a-4e7a-440b-9e22-8b59245ee33a tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7399a71fa0499f8a305c8f79a0be97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0dd3e44fa14488a171994ee34ebdc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:18:22.985347 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-06a8ab6a-4e7a-440b-9e22-8b59245ee33a tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] 10.222.0.17 "GET /compute/v2.1/servers/6e9e953e-026d-45f8-917d-7e54b181beea" status: 200 len: 1358 microversion: 2.1 time: 0.179134 Jul 23 22:18:22.986303 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3748/6358] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:18:22 2022] GET /compute/v2.1/servers/6e9e953e-026d-45f8-917d-7e54b181beea => generated 1358 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:18:24.002860 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-98bc7e8d-af25-4e01-9426-821c2eb798bd tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:18:24.003750 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-98bc7e8d-af25-4e01-9426-821c2eb798bd tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] [instance: 6e9e953e-026d-45f8-917d-7e54b181beea] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:18:24.011089 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-98bc7e8d-af25-4e01-9426-821c2eb798bd tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:18:24.011626 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-98bc7e8d-af25-4e01-9426-821c2eb798bd tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:18:24.012657 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-98bc7e8d-af25-4e01-9426-821c2eb798bd tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:18:24.013156 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-98bc7e8d-af25-4e01-9426-821c2eb798bd tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:18:24.161330 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-98bc7e8d-af25-4e01-9426-821c2eb798bd tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7399a71fa0499f8a305c8f79a0be97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0dd3e44fa14488a171994ee34ebdc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:18:24.169445 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-98bc7e8d-af25-4e01-9426-821c2eb798bd tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] 10.222.0.17 "GET /compute/v2.1/servers/6e9e953e-026d-45f8-917d-7e54b181beea" status: 200 len: 1358 microversion: 2.1 time: 0.170882 Jul 23 22:18:24.170063 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3749/6359] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:18:23 2022] GET /compute/v2.1/servers/6e9e953e-026d-45f8-917d-7e54b181beea => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:18:25.188824 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-618ae3ea-08fe-4516-a229-296c156880a5 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:18:25.189505 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-618ae3ea-08fe-4516-a229-296c156880a5 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] [instance: 6e9e953e-026d-45f8-917d-7e54b181beea] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:18:25.197460 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-618ae3ea-08fe-4516-a229-296c156880a5 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:18:25.198000 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-618ae3ea-08fe-4516-a229-296c156880a5 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:18:25.198940 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-618ae3ea-08fe-4516-a229-296c156880a5 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:18:25.199444 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-618ae3ea-08fe-4516-a229-296c156880a5 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:18:25.341616 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-618ae3ea-08fe-4516-a229-296c156880a5 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7399a71fa0499f8a305c8f79a0be97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0dd3e44fa14488a171994ee34ebdc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:18:25.349468 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-618ae3ea-08fe-4516-a229-296c156880a5 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] 10.222.0.17 "GET /compute/v2.1/servers/6e9e953e-026d-45f8-917d-7e54b181beea" status: 200 len: 1358 microversion: 2.1 time: 0.165153 Jul 23 22:18:25.354293 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3750/6360] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:18:25 2022] GET /compute/v2.1/servers/6e9e953e-026d-45f8-917d-7e54b181beea => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:18:26.367367 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ff3df381-fc38-404c-bd4d-5ab50a91105c tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:18:26.368078 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ff3df381-fc38-404c-bd4d-5ab50a91105c tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] [instance: 6e9e953e-026d-45f8-917d-7e54b181beea] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:18:26.375644 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ff3df381-fc38-404c-bd4d-5ab50a91105c tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:18:26.376211 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ff3df381-fc38-404c-bd4d-5ab50a91105c tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:18:26.377105 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ff3df381-fc38-404c-bd4d-5ab50a91105c tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:18:26.377618 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ff3df381-fc38-404c-bd4d-5ab50a91105c tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:18:26.521321 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ff3df381-fc38-404c-bd4d-5ab50a91105c tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7399a71fa0499f8a305c8f79a0be97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0dd3e44fa14488a171994ee34ebdc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:18:26.529676 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ff3df381-fc38-404c-bd4d-5ab50a91105c tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] 10.222.0.17 "GET /compute/v2.1/servers/6e9e953e-026d-45f8-917d-7e54b181beea" status: 200 len: 1358 microversion: 2.1 time: 0.166341 Jul 23 22:18:26.538089 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3751/6361] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:18:26 2022] GET /compute/v2.1/servers/6e9e953e-026d-45f8-917d-7e54b181beea => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:18:27.547169 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3f2fab8f-6def-4639-b457-539bfebeab38 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:18:27.547903 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-3f2fab8f-6def-4639-b457-539bfebeab38 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] [instance: 6e9e953e-026d-45f8-917d-7e54b181beea] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:18:27.555288 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3f2fab8f-6def-4639-b457-539bfebeab38 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:18:27.555810 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3f2fab8f-6def-4639-b457-539bfebeab38 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:18:27.556633 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3f2fab8f-6def-4639-b457-539bfebeab38 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:18:27.557084 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3f2fab8f-6def-4639-b457-539bfebeab38 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:18:27.699236 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-3f2fab8f-6def-4639-b457-539bfebeab38 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7399a71fa0499f8a305c8f79a0be97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0dd3e44fa14488a171994ee34ebdc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:18:27.707127 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-3f2fab8f-6def-4639-b457-539bfebeab38 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] 10.222.0.17 "GET /compute/v2.1/servers/6e9e953e-026d-45f8-917d-7e54b181beea" status: 200 len: 1358 microversion: 2.1 time: 0.164172 Jul 23 22:18:27.707768 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3752/6362] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:18:27 2022] GET /compute/v2.1/servers/6e9e953e-026d-45f8-917d-7e54b181beea => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:18:28.724547 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1e7788f4-43eb-4d16-a23a-544b3515aecd tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:18:28.725326 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1e7788f4-43eb-4d16-a23a-544b3515aecd tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] [instance: 6e9e953e-026d-45f8-917d-7e54b181beea] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:18:28.732725 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1e7788f4-43eb-4d16-a23a-544b3515aecd tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:18:28.733319 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1e7788f4-43eb-4d16-a23a-544b3515aecd tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:18:28.734152 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1e7788f4-43eb-4d16-a23a-544b3515aecd tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:18:28.734755 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1e7788f4-43eb-4d16-a23a-544b3515aecd tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:18:28.878980 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-1e7788f4-43eb-4d16-a23a-544b3515aecd tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7399a71fa0499f8a305c8f79a0be97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0dd3e44fa14488a171994ee34ebdc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:18:28.887585 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1e7788f4-43eb-4d16-a23a-544b3515aecd tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] 10.222.0.17 "GET /compute/v2.1/servers/6e9e953e-026d-45f8-917d-7e54b181beea" status: 200 len: 1358 microversion: 2.1 time: 0.166945 Jul 23 22:18:28.897554 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3753/6363] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:18:28 2022] GET /compute/v2.1/servers/6e9e953e-026d-45f8-917d-7e54b181beea => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:18:29.076332 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-77da2657-2c3a-407a-abe9-37d673960332 req-027acfa4-5fac-4c4b-bc5c-e29746e64200 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e9e953e-026d-45f8-917d-7e54b181beea", "tag": "f9b87574-aa3a-4c15-8ae4-0ad9c68cd455"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:18:29.086130 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-77da2657-2c3a-407a-abe9-37d673960332 req-027acfa4-5fac-4c4b-bc5c-e29746e64200 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:18:29.086880 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-77da2657-2c3a-407a-abe9-37d673960332 req-027acfa4-5fac-4c4b-bc5c-e29746e64200 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:18:29.101200 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-77da2657-2c3a-407a-abe9-37d673960332 req-027acfa4-5fac-4c4b-bc5c-e29746e64200 service nova] Creating event network-changed:f9b87574-aa3a-4c15-8ae4-0ad9c68cd455 for instance 6e9e953e-026d-45f8-917d-7e54b181beea on nch2-master-1 Jul 23 22:18:29.108403 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-77da2657-2c3a-407a-abe9-37d673960332 req-027acfa4-5fac-4c4b-bc5c-e29746e64200 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039740 Jul 23 22:18:29.112096 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3754/6364] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:18:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:18:29.902197 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:18:29.903440 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=12 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:18:29.908838 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-96c23154-feee-4a9a-a299-5a3306ace6a6 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:18:29.909578 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-96c23154-feee-4a9a-a299-5a3306ace6a6 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] [instance: 6e9e953e-026d-45f8-917d-7e54b181beea] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:18:29.916668 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-96c23154-feee-4a9a-a299-5a3306ace6a6 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:18:29.917120 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-96c23154-feee-4a9a-a299-5a3306ace6a6 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:18:29.917907 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-96c23154-feee-4a9a-a299-5a3306ace6a6 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:18:29.918344 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-96c23154-feee-4a9a-a299-5a3306ace6a6 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:18:30.054686 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-96c23154-feee-4a9a-a299-5a3306ace6a6 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7399a71fa0499f8a305c8f79a0be97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0dd3e44fa14488a171994ee34ebdc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:18:30.058258 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:18:30.063348 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-96c23154-feee-4a9a-a299-5a3306ace6a6 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] 10.222.0.17 "GET /compute/v2.1/servers/6e9e953e-026d-45f8-917d-7e54b181beea" status: 200 len: 1358 microversion: 2.1 time: 0.162163 Jul 23 22:18:30.063928 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3755/6365] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:18:29 2022] GET /compute/v2.1/servers/6e9e953e-026d-45f8-917d-7e54b181beea => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:18:31.081384 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-96861ec9-e332-4515-b52f-dc8d1d043dd3 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:18:31.082105 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-96861ec9-e332-4515-b52f-dc8d1d043dd3 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] [instance: 6e9e953e-026d-45f8-917d-7e54b181beea] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:18:31.090268 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-96861ec9-e332-4515-b52f-dc8d1d043dd3 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:18:31.090738 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-96861ec9-e332-4515-b52f-dc8d1d043dd3 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:18:31.091556 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-96861ec9-e332-4515-b52f-dc8d1d043dd3 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:18:31.092029 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-96861ec9-e332-4515-b52f-dc8d1d043dd3 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:18:31.220377 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-96861ec9-e332-4515-b52f-dc8d1d043dd3 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7399a71fa0499f8a305c8f79a0be97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0dd3e44fa14488a171994ee34ebdc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:18:31.228309 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-96861ec9-e332-4515-b52f-dc8d1d043dd3 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] 10.222.0.17 "GET /compute/v2.1/servers/6e9e953e-026d-45f8-917d-7e54b181beea" status: 200 len: 1358 microversion: 2.1 time: 0.151457 Jul 23 22:18:31.228867 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3756/6366] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:18:31 2022] GET /compute/v2.1/servers/6e9e953e-026d-45f8-917d-7e54b181beea => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:18:32.252554 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2660148a-5ca8-4e35-801d-b4eeb1fcb0fe tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:18:32.253481 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-2660148a-5ca8-4e35-801d-b4eeb1fcb0fe tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] [instance: 6e9e953e-026d-45f8-917d-7e54b181beea] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:18:32.261700 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2660148a-5ca8-4e35-801d-b4eeb1fcb0fe tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:18:32.262240 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2660148a-5ca8-4e35-801d-b4eeb1fcb0fe tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:18:32.263091 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2660148a-5ca8-4e35-801d-b4eeb1fcb0fe tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:18:32.263577 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2660148a-5ca8-4e35-801d-b4eeb1fcb0fe tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:18:32.402007 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-2660148a-5ca8-4e35-801d-b4eeb1fcb0fe tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7399a71fa0499f8a305c8f79a0be97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0dd3e44fa14488a171994ee34ebdc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:18:32.409736 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2660148a-5ca8-4e35-801d-b4eeb1fcb0fe tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] 10.222.0.17 "GET /compute/v2.1/servers/6e9e953e-026d-45f8-917d-7e54b181beea" status: 200 len: 1358 microversion: 2.1 time: 0.163828 Jul 23 22:18:32.410344 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3757/6367] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:18:32 2022] GET /compute/v2.1/servers/6e9e953e-026d-45f8-917d-7e54b181beea => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:18:33.426886 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-43f9dd00-70f8-4728-9e55-56ccfc5ab47b tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:18:33.427498 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-43f9dd00-70f8-4728-9e55-56ccfc5ab47b tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] [instance: 6e9e953e-026d-45f8-917d-7e54b181beea] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:18:33.434956 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-43f9dd00-70f8-4728-9e55-56ccfc5ab47b tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:18:33.435414 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-43f9dd00-70f8-4728-9e55-56ccfc5ab47b tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:18:33.436187 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-43f9dd00-70f8-4728-9e55-56ccfc5ab47b tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:18:33.436604 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-43f9dd00-70f8-4728-9e55-56ccfc5ab47b tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:18:33.577816 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-43f9dd00-70f8-4728-9e55-56ccfc5ab47b tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7399a71fa0499f8a305c8f79a0be97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0dd3e44fa14488a171994ee34ebdc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:18:33.585969 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-43f9dd00-70f8-4728-9e55-56ccfc5ab47b tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] 10.222.0.17 "GET /compute/v2.1/servers/6e9e953e-026d-45f8-917d-7e54b181beea" status: 200 len: 1358 microversion: 2.1 time: 0.163110 Jul 23 22:18:33.586565 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3758/6368] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:18:33 2022] GET /compute/v2.1/servers/6e9e953e-026d-45f8-917d-7e54b181beea => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:18:34.606635 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3c698eac-a158-4f60-945e-ccc036ee6c29 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:18:34.607727 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-3c698eac-a158-4f60-945e-ccc036ee6c29 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] [instance: 6e9e953e-026d-45f8-917d-7e54b181beea] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:18:34.617684 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3c698eac-a158-4f60-945e-ccc036ee6c29 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:18:34.618170 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3c698eac-a158-4f60-945e-ccc036ee6c29 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:18:34.618934 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3c698eac-a158-4f60-945e-ccc036ee6c29 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:18:34.619371 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3c698eac-a158-4f60-945e-ccc036ee6c29 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:18:34.748802 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-3c698eac-a158-4f60-945e-ccc036ee6c29 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7399a71fa0499f8a305c8f79a0be97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0dd3e44fa14488a171994ee34ebdc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:18:34.756440 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-3c698eac-a158-4f60-945e-ccc036ee6c29 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] 10.222.0.17 "GET /compute/v2.1/servers/6e9e953e-026d-45f8-917d-7e54b181beea" status: 200 len: 1358 microversion: 2.1 time: 0.156462 Jul 23 22:18:34.757030 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3759/6369] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:18:34 2022] GET /compute/v2.1/servers/6e9e953e-026d-45f8-917d-7e54b181beea => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:18:35.304175 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-3ae90ba6-29ac-4d0e-aa38-071ff67bb146 req-9bf431b4-9537-40bb-b7ac-1e24f4e099ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e9e953e-026d-45f8-917d-7e54b181beea", "name": "network-vif-plugged", "status": "completed", "tag": "f9b87574-aa3a-4c15-8ae4-0ad9c68cd455"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:18:35.313962 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-3ae90ba6-29ac-4d0e-aa38-071ff67bb146 req-9bf431b4-9537-40bb-b7ac-1e24f4e099ce service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:18:35.314450 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-3ae90ba6-29ac-4d0e-aa38-071ff67bb146 req-9bf431b4-9537-40bb-b7ac-1e24f4e099ce service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:18:35.326780 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-3ae90ba6-29ac-4d0e-aa38-071ff67bb146 req-9bf431b4-9537-40bb-b7ac-1e24f4e099ce service nova] Creating event network-vif-plugged:f9b87574-aa3a-4c15-8ae4-0ad9c68cd455 for instance 6e9e953e-026d-45f8-917d-7e54b181beea on nch2-master-1 Jul 23 22:18:35.331986 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-3ae90ba6-29ac-4d0e-aa38-071ff67bb146 req-9bf431b4-9537-40bb-b7ac-1e24f4e099ce service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031646 Jul 23 22:18:35.332606 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3760/6370] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:18:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:18:35.778461 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-bc72bd4a-c880-4937-8a37-8ec146224f78 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:18:35.779281 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-bc72bd4a-c880-4937-8a37-8ec146224f78 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] [instance: 6e9e953e-026d-45f8-917d-7e54b181beea] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:18:35.787745 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bc72bd4a-c880-4937-8a37-8ec146224f78 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:18:35.788198 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bc72bd4a-c880-4937-8a37-8ec146224f78 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:18:35.788974 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bc72bd4a-c880-4937-8a37-8ec146224f78 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:18:35.789417 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bc72bd4a-c880-4937-8a37-8ec146224f78 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:18:35.925695 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-bc72bd4a-c880-4937-8a37-8ec146224f78 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7399a71fa0499f8a305c8f79a0be97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0dd3e44fa14488a171994ee34ebdc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:18:35.937390 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-bc72bd4a-c880-4937-8a37-8ec146224f78 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] 10.222.0.17 "GET /compute/v2.1/servers/6e9e953e-026d-45f8-917d-7e54b181beea" status: 200 len: 1358 microversion: 2.1 time: 0.165154 Jul 23 22:18:35.938201 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3761/6371] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:18:35 2022] GET /compute/v2.1/servers/6e9e953e-026d-45f8-917d-7e54b181beea => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:18:36.959502 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-040a3f47-deea-4382-8b28-0a38d631ff63 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:18:36.960230 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-040a3f47-deea-4382-8b28-0a38d631ff63 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] [instance: 6e9e953e-026d-45f8-917d-7e54b181beea] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:18:36.968211 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-040a3f47-deea-4382-8b28-0a38d631ff63 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:18:36.968752 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-040a3f47-deea-4382-8b28-0a38d631ff63 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:18:36.969689 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-040a3f47-deea-4382-8b28-0a38d631ff63 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:18:36.970374 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-040a3f47-deea-4382-8b28-0a38d631ff63 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:18:37.106749 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-040a3f47-deea-4382-8b28-0a38d631ff63 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7399a71fa0499f8a305c8f79a0be97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0dd3e44fa14488a171994ee34ebdc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:18:37.114467 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-040a3f47-deea-4382-8b28-0a38d631ff63 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] 10.222.0.17 "GET /compute/v2.1/servers/6e9e953e-026d-45f8-917d-7e54b181beea" status: 200 len: 1547 microversion: 2.1 time: 0.161428 Jul 23 22:18:37.115124 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3762/6372] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:18:36 2022] GET /compute/v2.1/servers/6e9e953e-026d-45f8-917d-7e54b181beea => generated 1547 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:18:37.130351 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4ed28c8b-6d3e-4586-b0b8-f85314b374a6 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:18:37.130955 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-4ed28c8b-6d3e-4586-b0b8-f85314b374a6 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] [instance: 6e9e953e-026d-45f8-917d-7e54b181beea] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:18:37.137026 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4ed28c8b-6d3e-4586-b0b8-f85314b374a6 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:18:37.137480 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4ed28c8b-6d3e-4586-b0b8-f85314b374a6 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:18:37.138278 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4ed28c8b-6d3e-4586-b0b8-f85314b374a6 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:18:37.138718 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4ed28c8b-6d3e-4586-b0b8-f85314b374a6 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:18:37.271929 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-4ed28c8b-6d3e-4586-b0b8-f85314b374a6 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7399a71fa0499f8a305c8f79a0be97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0dd3e44fa14488a171994ee34ebdc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:18:37.279697 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4ed28c8b-6d3e-4586-b0b8-f85314b374a6 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] 10.222.0.17 "GET /compute/v2.1/servers/6e9e953e-026d-45f8-917d-7e54b181beea" status: 200 len: 1547 microversion: 2.1 time: 0.152859 Jul 23 22:18:37.280305 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3763/6373] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:18:37 2022] GET /compute/v2.1/servers/6e9e953e-026d-45f8-917d-7e54b181beea => generated 1547 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:18:37.295405 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-914e4512-47a5-4b7e-b121-2082e350cfb7 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:18:37.298798 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-914e4512-47a5-4b7e-b121-2082e350cfb7 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4e7399a71fa0499f8a305c8f79a0be97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0dd3e44fa14488a171994ee34ebdc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:18:37.299573 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-914e4512-47a5-4b7e-b121-2082e350cfb7 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Searching by: {'deleted': False, 'project_id': 'ca0dd3e44fa14488a171994ee34ebdc8'} {{(pid=131320) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 23 22:18:37.305230 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-914e4512-47a5-4b7e-b121-2082e350cfb7 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:18:37.305694 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-914e4512-47a5-4b7e-b121-2082e350cfb7 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:18:37.306582 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-914e4512-47a5-4b7e-b121-2082e350cfb7 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:18:37.307025 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-914e4512-47a5-4b7e-b121-2082e350cfb7 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:18:37.335378 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.multi_cell_list [None req-914e4512-47a5-4b7e-b121-2082e350cfb7 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=131320) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 23 22:18:37.363475 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-914e4512-47a5-4b7e-b121-2082e350cfb7 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] 10.222.0.17 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.071468 Jul 23 22:18:37.364014 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3764/6374] 10.222.0.17 () {58 vars in 1124 bytes} [Sat Jul 23 22:18:37 2022] GET /compute/v2.1/servers => generated 343 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:18:37.374383 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d967ac7f-7579-4494-9b13-ee05b921a351 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:18:37.374995 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d967ac7f-7579-4494-9b13-ee05b921a351 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] [instance: 6e9e953e-026d-45f8-917d-7e54b181beea] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:18:37.382035 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d967ac7f-7579-4494-9b13-ee05b921a351 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:18:37.382502 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d967ac7f-7579-4494-9b13-ee05b921a351 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:18:37.383284 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d967ac7f-7579-4494-9b13-ee05b921a351 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:18:37.383721 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d967ac7f-7579-4494-9b13-ee05b921a351 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:18:37.534595 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d967ac7f-7579-4494-9b13-ee05b921a351 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7399a71fa0499f8a305c8f79a0be97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0dd3e44fa14488a171994ee34ebdc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:18:37.542613 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d967ac7f-7579-4494-9b13-ee05b921a351 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] 10.222.0.17 "GET /compute/v2.1/servers/6e9e953e-026d-45f8-917d-7e54b181beea" status: 200 len: 1547 microversion: 2.1 time: 0.172033 Jul 23 22:18:37.543384 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3765/6375] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:18:37 2022] GET /compute/v2.1/servers/6e9e953e-026d-45f8-917d-7e54b181beea => generated 1547 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:18:39.030739 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-793e89ee-6040-4676-9e84-3782ffad5ec3 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:18:39.031378 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-793e89ee-6040-4676-9e84-3782ffad5ec3 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] [instance: 6e9e953e-026d-45f8-917d-7e54b181beea] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:18:39.038758 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-793e89ee-6040-4676-9e84-3782ffad5ec3 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:18:39.039219 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-793e89ee-6040-4676-9e84-3782ffad5ec3 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:18:39.039983 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-793e89ee-6040-4676-9e84-3782ffad5ec3 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:18:39.040428 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-793e89ee-6040-4676-9e84-3782ffad5ec3 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:18:39.067616 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-793e89ee-6040-4676-9e84-3782ffad5ec3 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] [instance: 6e9e953e-026d-45f8-917d-7e54b181beea] Going to try to terminate instance {{(pid=131320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 22:18:39.146141 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-793e89ee-6040-4676-9e84-3782ffad5ec3 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] 10.222.0.17 "DELETE /compute/v2.1/servers/6e9e953e-026d-45f8-917d-7e54b181beea" status: 204 len: 0 microversion: 2.1 time: 0.118669 Jul 23 22:18:39.146703 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3766/6376] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 22:18:39 2022] DELETE /compute/v2.1/servers/6e9e953e-026d-45f8-917d-7e54b181beea => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 23 22:18:39.155300 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b504c04f-e9e9-4a38-ae86-ff6b98b9c500 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:18:39.155993 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b504c04f-e9e9-4a38-ae86-ff6b98b9c500 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] [instance: 6e9e953e-026d-45f8-917d-7e54b181beea] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:18:39.162209 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b504c04f-e9e9-4a38-ae86-ff6b98b9c500 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:18:39.162656 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b504c04f-e9e9-4a38-ae86-ff6b98b9c500 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:18:39.163414 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b504c04f-e9e9-4a38-ae86-ff6b98b9c500 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:18:39.163853 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b504c04f-e9e9-4a38-ae86-ff6b98b9c500 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:18:39.300462 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b504c04f-e9e9-4a38-ae86-ff6b98b9c500 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7399a71fa0499f8a305c8f79a0be97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0dd3e44fa14488a171994ee34ebdc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:18:39.308780 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b504c04f-e9e9-4a38-ae86-ff6b98b9c500 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] 10.222.0.17 "GET /compute/v2.1/servers/6e9e953e-026d-45f8-917d-7e54b181beea" status: 200 len: 1553 microversion: 2.1 time: 0.157559 Jul 23 22:18:39.309338 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3767/6377] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:18:39 2022] GET /compute/v2.1/servers/6e9e953e-026d-45f8-917d-7e54b181beea => generated 1553 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:18:40.330965 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a0119d84-d942-4ae4-ae23-4207b8ea7d94 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:18:40.332116 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a0119d84-d942-4ae4-ae23-4207b8ea7d94 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] [instance: 6e9e953e-026d-45f8-917d-7e54b181beea] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:18:40.343900 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a0119d84-d942-4ae4-ae23-4207b8ea7d94 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:18:40.344555 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a0119d84-d942-4ae4-ae23-4207b8ea7d94 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:18:40.345821 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a0119d84-d942-4ae4-ae23-4207b8ea7d94 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:18:40.346605 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a0119d84-d942-4ae4-ae23-4207b8ea7d94 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:18:40.481563 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a0119d84-d942-4ae4-ae23-4207b8ea7d94 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e7399a71fa0499f8a305c8f79a0be97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0dd3e44fa14488a171994ee34ebdc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:18:40.489468 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a0119d84-d942-4ae4-ae23-4207b8ea7d94 tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] 10.222.0.17 "GET /compute/v2.1/servers/6e9e953e-026d-45f8-917d-7e54b181beea" status: 200 len: 1553 microversion: 2.1 time: 0.165184 Jul 23 22:18:40.490119 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3768/6378] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:18:40 2022] GET /compute/v2.1/servers/6e9e953e-026d-45f8-917d-7e54b181beea => generated 1553 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:18:40.889597 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-64cacf7b-d764-4af6-8965-071476ad80e0 req-43c2c260-73e2-418f-a7a4-d37fe45c8b04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e9e953e-026d-45f8-917d-7e54b181beea", "name": "network-vif-deleted", "tag": "f9b87574-aa3a-4c15-8ae4-0ad9c68cd455"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:18:40.900141 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-64cacf7b-d764-4af6-8965-071476ad80e0 req-43c2c260-73e2-418f-a7a4-d37fe45c8b04 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:18:40.900564 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-64cacf7b-d764-4af6-8965-071476ad80e0 req-43c2c260-73e2-418f-a7a4-d37fe45c8b04 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:18:40.913642 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-64cacf7b-d764-4af6-8965-071476ad80e0 req-43c2c260-73e2-418f-a7a4-d37fe45c8b04 service nova] Creating event network-vif-deleted:f9b87574-aa3a-4c15-8ae4-0ad9c68cd455 for instance 6e9e953e-026d-45f8-917d-7e54b181beea on nch2-master-1 Jul 23 22:18:40.919265 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-64cacf7b-d764-4af6-8965-071476ad80e0 req-43c2c260-73e2-418f-a7a4-d37fe45c8b04 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034610 Jul 23 22:18:40.920280 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3769/6379] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:18:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 22:18:41.512335 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-bda186c0-0321-42bb-b5a7-549de6bc556e tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:18:41.513549 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-bda186c0-0321-42bb-b5a7-549de6bc556e tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] [instance: 6e9e953e-026d-45f8-917d-7e54b181beea] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:18:41.524954 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bda186c0-0321-42bb-b5a7-549de6bc556e tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:18:41.525405 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bda186c0-0321-42bb-b5a7-549de6bc556e tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:18:41.526210 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bda186c0-0321-42bb-b5a7-549de6bc556e tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:18:41.526644 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bda186c0-0321-42bb-b5a7-549de6bc556e tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:18:41.540308 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-bda186c0-0321-42bb-b5a7-549de6bc556e tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] HTTP exception thrown: Instance 6e9e953e-026d-45f8-917d-7e54b181beea could not be found. Jul 23 22:18:41.541955 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-bda186c0-0321-42bb-b5a7-549de6bc556e tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Request method failure captured: Jul 23 22:18:41.541955 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/6e9e953e-026d-45f8-917d-7e54b181beea HTTP/1.1 Jul 23 22:18:41.541955 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 22:18:41.541955 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 22:18:41.541955 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 22:18:41.541955 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 22:18:41.541955 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 22:18:41.541955 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 22:18:41.541955 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 22:18:41.541955 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 22:18:41.541955 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3HN96QsrOsdRIuG-o1W6Uy7h6FdmiQOWOLbxWgl8VRo8PYzyaB9BTa6YZLMQBOgX0ZLiP6n0QO_gtsyMU8-bCGBD1LCh4V9z8qL2ezQNUam16-oW4CXj07UYNbvPvl3cwJXkCBv7uifGbbLVE5leFvQQ6r0eB57fq_bFALxjfvvb0mw Jul 23 22:18:41.541955 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 22:18:41.541955 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 22:18:41.541955 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 22:18:41.541955 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 22:18:41.541955 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 22:18:41.541955 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 22:18:41.541955 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: ca0dd3e44fa14488a171994ee34ebdc8 Jul 23 22:18:41.541955 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-TestMinimumBasicScenario-1035013710 Jul 23 22:18:41.541955 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 22:18:41.541955 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 22:18:41.541955 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ca0dd3e44fa14488a171994ee34ebdc8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ca0dd3e44fa14488a171994ee34ebdc8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ca0dd3e44fa14488a171994ee34ebdc8", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ca0dd3e44fa14488a171994ee34ebdc8"}]}] Jul 23 22:18:41.541955 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-TestMinimumBasicScenario-1035013710 Jul 23 22:18:41.541955 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: ca0dd3e44fa14488a171994ee34ebdc8 Jul 23 22:18:41.541955 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1035013710 Jul 23 22:18:41.541955 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-TestMinimumBasicScenario-1035013710-project Jul 23 22:18:41.541955 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 22:18:41.541955 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 22:18:41.541955 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 4e7399a71fa0499f8a305c8f79a0be97 Jul 23 22:18:41.541955 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-TestMinimumBasicScenario-1035013710-project Jul 23 22:18:41.541955 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 22:18:41.541955 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance 6e9e953e-026d-45f8-917d-7e54b181beea could not be found. Jul 23 22:18:41.541955 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '6e9e953e-026d-45f8-917d-7e54b181beea'} Jul 23 22:18:41.541955 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 22:18:41.541955 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:18:41.541955 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 22:18:41.541955 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 22:18:41.541955 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 22:18:41.541955 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 22:18:41.541955 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 22:18:41.541955 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 22:18:41.541955 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 22:18:41.541955 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 22:18:41.541955 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e9e953e-026d-45f8-917d-7e54b181beea could not be found. Jul 23 22:18:41.541955 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:18:41.541955 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:18:41.541955 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:18:41.541955 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:18:41.541955 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:18:41.541955 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:18:41.541955 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 22:18:41.541955 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 22:18:41.541955 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 22:18:41.541955 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 22:18:41.541955 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 22:18:41.541955 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 22:18:41.541955 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 22:18:41.541955 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 22:18:41.541955 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 22:18:41.541955 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 22:18:41.541955 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e9e953e-026d-45f8-917d-7e54b181beea could not be found. Jul 23 22:18:41.541955 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:18:41.541955 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:18:41.541955 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:18:41.546226 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:18:41.546226 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:18:41.546226 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:18:41.546226 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 22:18:41.546226 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 22:18:41.546226 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e9e953e-026d-45f8-917d-7e54b181beea could not be found. Jul 23 22:18:41.546226 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:18:41.546226 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-bda186c0-0321-42bb-b5a7-549de6bc556e tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Returning 404 to user: Instance 6e9e953e-026d-45f8-917d-7e54b181beea could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 22:18:41.546226 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-bda186c0-0321-42bb-b5a7-549de6bc556e tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] 10.222.0.17 "GET /compute/v2.1/servers/6e9e953e-026d-45f8-917d-7e54b181beea" status: 404 len: 111 microversion: 2.1 time: 0.038435 Jul 23 22:18:41.546226 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3770/6380] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:18:41 2022] GET /compute/v2.1/servers/6e9e953e-026d-45f8-917d-7e54b181beea => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 23 22:18:41.551916 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-487f5c81-2573-44d2-950a-b582f4965b6e tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] Calling method '.version_select at 0x7f0b598c91f0>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:18:41.573007 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-487f5c81-2573-44d2-950a-b582f4965b6e tempest-TestMinimumBasicScenario-1035013710 tempest-TestMinimumBasicScenario-1035013710-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-248092488" status: 202 len: 0 microversion: 2.1 time: 0.024698 Jul 23 22:18:41.573577 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3771/6381] 10.222.0.17 () {58 vars in 1268 bytes} [Sat Jul 23 22:18:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-248092488 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 22:18:50.444192 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:18:50.606823 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-93426b3f-2d52-4b08-855b-1f9abb6a4119 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Action: 'create', calling method: .version_select at 0x7f0b466639d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2028054889", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJnpyaMxRSwpAGjLpoYVamSZhQkVh5UFrIO0KRJknusK15Uzn4/ODQ+3DIPQT5O4oxGhIFjC0UZNsUgysqe5cIVJh8KxGBlC4UyZcyofnksWWaLxY78H71rzQOlLoyw1A=="}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:18:50.610806 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:18:50.625887 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-93426b3f-2d52-4b08-855b-1f9abb6a4119 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Getting quotas for project a14b865dcbd14987870351ce4e45aaac. Resources: {'key_pairs'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 22:18:50.631450 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-93426b3f-2d52-4b08-855b-1f9abb6a4119 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Getting quotas for user a686380934d042b4a078eb60e9bb6712 and project a14b865dcbd14987870351ce4e45aaac. Resources: {'key_pairs'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 22:18:50.657704 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-93426b3f-2d52-4b08-855b-1f9abb6a4119 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.215335 Jul 23 22:18:50.658335 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3772/6382] 10.222.0.17 () {60 vars in 1158 bytes} [Sat Jul 23 22:18:50 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:18:56.937020 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:18:56.941884 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-fda49ee9-1bf8-4a8d-9c2d-681c9464c9ff tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-628200201", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "networks": [{"uuid": "e5b76009-70d3-4306-89b1-10e74614ef61"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2028054889", "security_groups": [{"name": "tempest-secgroup-smoke-1106493283"}]}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:18:57.056357 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-fda49ee9-1bf8-4a8d-9c2d-681c9464c9ff tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] validate_networks() for [('e5b76009-70d3-4306-89b1-10e74614ef61', None, None, None, None, None)] {{(pid=131320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 22:18:57.836844 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-fda49ee9-1bf8-4a8d-9c2d-681c9464c9ff tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 22:18:57.837273 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-fda49ee9-1bf8-4a8d-9c2d-681c9464c9ff tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 22:18:57.837756 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-fda49ee9-1bf8-4a8d-9c2d-681c9464c9ff tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 22:18:57.838215 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-fda49ee9-1bf8-4a8d-9c2d-681c9464c9ff tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 22:18:57.838634 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-fda49ee9-1bf8-4a8d-9c2d-681c9464c9ff tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 22:18:57.847718 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fda49ee9-1bf8-4a8d-9c2d-681c9464c9ff tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:18:57.848174 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fda49ee9-1bf8-4a8d-9c2d-681c9464c9ff tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:18:57.848973 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fda49ee9-1bf8-4a8d-9c2d-681c9464c9ff tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:18:57.849439 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fda49ee9-1bf8-4a8d-9c2d-681c9464c9ff tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:18:57.866351 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-fda49ee9-1bf8-4a8d-9c2d-681c9464c9ff tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Getting quotas for project a14b865dcbd14987870351ce4e45aaac. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 22:18:57.871726 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-fda49ee9-1bf8-4a8d-9c2d-681c9464c9ff tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Getting quotas for user a686380934d042b4a078eb60e9bb6712 and project a14b865dcbd14987870351ce4e45aaac. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 22:18:57.883911 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-fda49ee9-1bf8-4a8d-9c2d-681c9464c9ff tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Going to run 1 instances... {{(pid=131320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 22:18:57.886269 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-fda49ee9-1bf8-4a8d-9c2d-681c9464c9ff tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: f04b3d11-3f92-4f25-87fe-09a27feb1033] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 22:18:57.933912 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-fda49ee9-1bf8-4a8d-9c2d-681c9464c9ff tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.998466 Jul 23 22:18:57.935196 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3773/6383] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 22:18:56 2022] POST /compute/v2.1/servers => generated 406 bytes in 1000 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 23 22:18:57.945131 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-81ae04b9-3300-450f-86bb-6e1d59e6689b tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:18:57.946631 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-81ae04b9-3300-450f-86bb-6e1d59e6689b tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: f04b3d11-3f92-4f25-87fe-09a27feb1033] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:18:58.005450 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-81ae04b9-3300-450f-86bb-6e1d59e6689b tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:18:58.013600 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-81ae04b9-3300-450f-86bb-6e1d59e6689b tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/f04b3d11-3f92-4f25-87fe-09a27feb1033" status: 200 len: 1266 microversion: 2.1 time: 0.072312 Jul 23 22:18:58.014339 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3774/6384] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:18:57 2022] GET /compute/v2.1/servers/f04b3d11-3f92-4f25-87fe-09a27feb1033 => generated 1266 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:18:59.036961 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-871bef74-a31b-4438-b502-ad502f7fb66c tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:18:59.037667 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-871bef74-a31b-4438-b502-ad502f7fb66c tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: f04b3d11-3f92-4f25-87fe-09a27feb1033] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:18:59.046598 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-871bef74-a31b-4438-b502-ad502f7fb66c tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:18:59.047295 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-871bef74-a31b-4438-b502-ad502f7fb66c tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:18:59.048965 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-871bef74-a31b-4438-b502-ad502f7fb66c tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:18:59.049766 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-871bef74-a31b-4438-b502-ad502f7fb66c tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:18:59.132430 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-871bef74-a31b-4438-b502-ad502f7fb66c tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:18:59.141166 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-871bef74-a31b-4438-b502-ad502f7fb66c tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/f04b3d11-3f92-4f25-87fe-09a27feb1033" status: 200 len: 1326 microversion: 2.1 time: 0.112834 Jul 23 22:18:59.142231 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3775/6385] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:18:59 2022] GET /compute/v2.1/servers/f04b3d11-3f92-4f25-87fe-09a27feb1033 => generated 1326 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:19:00.158235 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e493b124-4e10-44fa-890f-8dcbba78ca7d tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:19:00.159000 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e493b124-4e10-44fa-890f-8dcbba78ca7d tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: f04b3d11-3f92-4f25-87fe-09a27feb1033] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:19:00.166847 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e493b124-4e10-44fa-890f-8dcbba78ca7d tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:19:00.167399 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e493b124-4e10-44fa-890f-8dcbba78ca7d tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:19:00.168192 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e493b124-4e10-44fa-890f-8dcbba78ca7d tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:19:00.168632 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e493b124-4e10-44fa-890f-8dcbba78ca7d tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:19:00.332207 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e493b124-4e10-44fa-890f-8dcbba78ca7d tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:19:00.340898 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e493b124-4e10-44fa-890f-8dcbba78ca7d tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/f04b3d11-3f92-4f25-87fe-09a27feb1033" status: 200 len: 1392 microversion: 2.1 time: 0.186614 Jul 23 22:19:00.342142 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3776/6386] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:19:00 2022] GET /compute/v2.1/servers/f04b3d11-3f92-4f25-87fe-09a27feb1033 => generated 1392 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:19:00.503574 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-57c53fe8-72dd-4229-b0e2-e6c44c393903 req-5d177f82-d29b-4332-8e1b-663b81a55f90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f04b3d11-3f92-4f25-87fe-09a27feb1033", "tag": "4cca344b-5a37-4188-a711-67a9809ee66a"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:19:00.519256 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-57c53fe8-72dd-4229-b0e2-e6c44c393903 req-5d177f82-d29b-4332-8e1b-663b81a55f90 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:19:00.519971 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-57c53fe8-72dd-4229-b0e2-e6c44c393903 req-5d177f82-d29b-4332-8e1b-663b81a55f90 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:19:00.539808 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-57c53fe8-72dd-4229-b0e2-e6c44c393903 req-5d177f82-d29b-4332-8e1b-663b81a55f90 service nova] Creating event network-changed:4cca344b-5a37-4188-a711-67a9809ee66a for instance f04b3d11-3f92-4f25-87fe-09a27feb1033 on nch2-master-1 Jul 23 22:19:00.545225 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-57c53fe8-72dd-4229-b0e2-e6c44c393903 req-5d177f82-d29b-4332-8e1b-663b81a55f90 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047189 Jul 23 22:19:00.545805 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3777/6387] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:19:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:19:01.361767 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-399fb559-a94c-46b0-b7db-9cb44e4ce2ca tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:19:01.362688 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-399fb559-a94c-46b0-b7db-9cb44e4ce2ca tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: f04b3d11-3f92-4f25-87fe-09a27feb1033] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:19:01.371261 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-399fb559-a94c-46b0-b7db-9cb44e4ce2ca tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:19:01.371654 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-399fb559-a94c-46b0-b7db-9cb44e4ce2ca tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:19:01.372603 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-399fb559-a94c-46b0-b7db-9cb44e4ce2ca tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:19:01.373152 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-399fb559-a94c-46b0-b7db-9cb44e4ce2ca tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:19:01.516368 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-399fb559-a94c-46b0-b7db-9cb44e4ce2ca tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:19:01.527662 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-399fb559-a94c-46b0-b7db-9cb44e4ce2ca tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/f04b3d11-3f92-4f25-87fe-09a27feb1033" status: 200 len: 1392 microversion: 2.1 time: 0.172269 Jul 23 22:19:01.528334 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3778/6388] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:19:01 2022] GET /compute/v2.1/servers/f04b3d11-3f92-4f25-87fe-09a27feb1033 => generated 1392 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:19:02.552979 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c5868f7c-d16c-49ec-a8e5-c3da658585e4 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:19:02.555149 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c5868f7c-d16c-49ec-a8e5-c3da658585e4 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: f04b3d11-3f92-4f25-87fe-09a27feb1033] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:19:02.562801 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c5868f7c-d16c-49ec-a8e5-c3da658585e4 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:19:02.563286 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c5868f7c-d16c-49ec-a8e5-c3da658585e4 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:19:02.564086 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c5868f7c-d16c-49ec-a8e5-c3da658585e4 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:19:02.564520 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c5868f7c-d16c-49ec-a8e5-c3da658585e4 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:19:02.709355 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c5868f7c-d16c-49ec-a8e5-c3da658585e4 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:19:02.720730 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c5868f7c-d16c-49ec-a8e5-c3da658585e4 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/f04b3d11-3f92-4f25-87fe-09a27feb1033" status: 200 len: 1392 microversion: 2.1 time: 0.174110 Jul 23 22:19:02.721477 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3779/6389] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:19:02 2022] GET /compute/v2.1/servers/f04b3d11-3f92-4f25-87fe-09a27feb1033 => generated 1392 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:19:03.738051 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-bfcf91fb-8ead-4408-a2ad-ef80cab73636 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:19:03.738762 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-bfcf91fb-8ead-4408-a2ad-ef80cab73636 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: f04b3d11-3f92-4f25-87fe-09a27feb1033] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:19:03.746014 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bfcf91fb-8ead-4408-a2ad-ef80cab73636 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:19:03.746461 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bfcf91fb-8ead-4408-a2ad-ef80cab73636 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:19:03.747279 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bfcf91fb-8ead-4408-a2ad-ef80cab73636 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:19:03.747722 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bfcf91fb-8ead-4408-a2ad-ef80cab73636 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:19:03.883026 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-bfcf91fb-8ead-4408-a2ad-ef80cab73636 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:19:03.890723 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-bfcf91fb-8ead-4408-a2ad-ef80cab73636 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/f04b3d11-3f92-4f25-87fe-09a27feb1033" status: 200 len: 1392 microversion: 2.1 time: 0.156652 Jul 23 22:19:03.891310 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3780/6390] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:19:03 2022] GET /compute/v2.1/servers/f04b3d11-3f92-4f25-87fe-09a27feb1033 => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:19:04.911486 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5f429966-e097-42e3-8d3a-7c5ce8d00f86 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:19:04.912494 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5f429966-e097-42e3-8d3a-7c5ce8d00f86 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: f04b3d11-3f92-4f25-87fe-09a27feb1033] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:19:04.921664 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5f429966-e097-42e3-8d3a-7c5ce8d00f86 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:19:04.922147 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5f429966-e097-42e3-8d3a-7c5ce8d00f86 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:19:04.922924 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5f429966-e097-42e3-8d3a-7c5ce8d00f86 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:19:04.923360 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5f429966-e097-42e3-8d3a-7c5ce8d00f86 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:19:05.077613 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5f429966-e097-42e3-8d3a-7c5ce8d00f86 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:19:05.085373 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5f429966-e097-42e3-8d3a-7c5ce8d00f86 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/f04b3d11-3f92-4f25-87fe-09a27feb1033" status: 200 len: 1392 microversion: 2.1 time: 0.180447 Jul 23 22:19:05.085988 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3781/6391] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:19:04 2022] GET /compute/v2.1/servers/f04b3d11-3f92-4f25-87fe-09a27feb1033 => generated 1392 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:19:05.443770 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-c2d12d5b-43f3-4410-95af-f336e52a7aa2 req-971efc88-9622-47f8-a7fc-49693fb17742 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f04b3d11-3f92-4f25-87fe-09a27feb1033", "name": "network-vif-plugged", "status": "completed", "tag": "4cca344b-5a37-4188-a711-67a9809ee66a"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:19:05.452974 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-c2d12d5b-43f3-4410-95af-f336e52a7aa2 req-971efc88-9622-47f8-a7fc-49693fb17742 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:19:05.453445 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-c2d12d5b-43f3-4410-95af-f336e52a7aa2 req-971efc88-9622-47f8-a7fc-49693fb17742 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:19:05.468070 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-c2d12d5b-43f3-4410-95af-f336e52a7aa2 req-971efc88-9622-47f8-a7fc-49693fb17742 service nova] Creating event network-vif-plugged:4cca344b-5a37-4188-a711-67a9809ee66a for instance f04b3d11-3f92-4f25-87fe-09a27feb1033 on nch2-master-1 Jul 23 22:19:05.473026 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-c2d12d5b-43f3-4410-95af-f336e52a7aa2 req-971efc88-9622-47f8-a7fc-49693fb17742 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033209 Jul 23 22:19:05.473820 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3782/6392] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:19:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:19:06.108484 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6de42eac-d163-40c6-9a15-8a3c763abe1b tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:19:06.109656 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6de42eac-d163-40c6-9a15-8a3c763abe1b tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: f04b3d11-3f92-4f25-87fe-09a27feb1033] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:19:06.120382 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6de42eac-d163-40c6-9a15-8a3c763abe1b tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:19:06.120834 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6de42eac-d163-40c6-9a15-8a3c763abe1b tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:19:06.121605 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6de42eac-d163-40c6-9a15-8a3c763abe1b tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:19:06.122048 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6de42eac-d163-40c6-9a15-8a3c763abe1b tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:19:06.260857 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6de42eac-d163-40c6-9a15-8a3c763abe1b tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:19:06.272392 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6de42eac-d163-40c6-9a15-8a3c763abe1b tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/f04b3d11-3f92-4f25-87fe-09a27feb1033" status: 200 len: 1392 microversion: 2.1 time: 0.172294 Jul 23 22:19:06.273228 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3783/6393] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:19:06 2022] GET /compute/v2.1/servers/f04b3d11-3f92-4f25-87fe-09a27feb1033 => generated 1392 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:19:07.293209 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4d5d9734-45c7-47ee-bbcb-7bfa4396a2dc tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:19:07.293925 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-4d5d9734-45c7-47ee-bbcb-7bfa4396a2dc tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: f04b3d11-3f92-4f25-87fe-09a27feb1033] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:19:07.304051 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4d5d9734-45c7-47ee-bbcb-7bfa4396a2dc tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:19:07.304831 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4d5d9734-45c7-47ee-bbcb-7bfa4396a2dc tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:19:07.306153 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4d5d9734-45c7-47ee-bbcb-7bfa4396a2dc tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:19:07.306848 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4d5d9734-45c7-47ee-bbcb-7bfa4396a2dc tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:19:07.446382 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-4d5d9734-45c7-47ee-bbcb-7bfa4396a2dc tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:19:07.454233 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4d5d9734-45c7-47ee-bbcb-7bfa4396a2dc tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/f04b3d11-3f92-4f25-87fe-09a27feb1033" status: 200 len: 1564 microversion: 2.1 time: 0.166710 Jul 23 22:19:07.454829 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3784/6394] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:19:07 2022] GET /compute/v2.1/servers/f04b3d11-3f92-4f25-87fe-09a27feb1033 => generated 1564 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:19:07.479571 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2cff5003-1c40-4a0c-a427-d341be154c12 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:19:07.480576 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-2cff5003-1c40-4a0c-a427-d341be154c12 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: f04b3d11-3f92-4f25-87fe-09a27feb1033] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:19:07.489706 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2cff5003-1c40-4a0c-a427-d341be154c12 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:19:07.490377 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2cff5003-1c40-4a0c-a427-d341be154c12 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:19:07.491465 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2cff5003-1c40-4a0c-a427-d341be154c12 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:19:07.492018 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2cff5003-1c40-4a0c-a427-d341be154c12 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:19:07.640235 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-2cff5003-1c40-4a0c-a427-d341be154c12 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:19:07.648108 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2cff5003-1c40-4a0c-a427-d341be154c12 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/f04b3d11-3f92-4f25-87fe-09a27feb1033" status: 200 len: 1564 microversion: 2.1 time: 0.174601 Jul 23 22:19:07.648686 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3785/6395] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:19:07 2022] GET /compute/v2.1/servers/f04b3d11-3f92-4f25-87fe-09a27feb1033 => generated 1564 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:19:09.314689 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-26ac0d63-2416-455b-bbbd-f26bc94e36e1 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:19:09.315348 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-26ac0d63-2416-455b-bbbd-f26bc94e36e1 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: f04b3d11-3f92-4f25-87fe-09a27feb1033] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:19:09.317577 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:19:09.318370 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=12 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:19:09.326011 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-26ac0d63-2416-455b-bbbd-f26bc94e36e1 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:19:09.326470 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-26ac0d63-2416-455b-bbbd-f26bc94e36e1 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:19:09.327255 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-26ac0d63-2416-455b-bbbd-f26bc94e36e1 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:19:09.327735 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-26ac0d63-2416-455b-bbbd-f26bc94e36e1 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:19:09.464132 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-26ac0d63-2416-455b-bbbd-f26bc94e36e1 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:19:09.471786 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-26ac0d63-2416-455b-bbbd-f26bc94e36e1 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/f04b3d11-3f92-4f25-87fe-09a27feb1033" status: 200 len: 1564 microversion: 2.1 time: 0.161254 Jul 23 22:19:09.472589 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3786/6396] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:19:09 2022] GET /compute/v2.1/servers/f04b3d11-3f92-4f25-87fe-09a27feb1033 => generated 1564 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:19:09.539367 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-09cd2ca8-97d1-42e5-8d62-fc47f987998d req-003e1e06-351e-4b61-9e16-2d2c2c3b97b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f04b3d11-3f92-4f25-87fe-09a27feb1033", "tag": "4cca344b-5a37-4188-a711-67a9809ee66a"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:19:09.548389 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-09cd2ca8-97d1-42e5-8d62-fc47f987998d req-003e1e06-351e-4b61-9e16-2d2c2c3b97b4 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:19:09.548833 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-09cd2ca8-97d1-42e5-8d62-fc47f987998d req-003e1e06-351e-4b61-9e16-2d2c2c3b97b4 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:19:09.560464 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-09cd2ca8-97d1-42e5-8d62-fc47f987998d req-003e1e06-351e-4b61-9e16-2d2c2c3b97b4 service nova] Creating event network-changed:4cca344b-5a37-4188-a711-67a9809ee66a for instance f04b3d11-3f92-4f25-87fe-09a27feb1033 on nch2-master-1 Jul 23 22:19:09.567128 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-09cd2ca8-97d1-42e5-8d62-fc47f987998d req-003e1e06-351e-4b61-9e16-2d2c2c3b97b4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093302 Jul 23 22:19:09.568119 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3787/6397] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:19:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:19:32.747800 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-62a86dbd-2816-4165-a080-a8b542ff5eed tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:19:32.748844 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-62a86dbd-2816-4165-a080-a8b542ff5eed tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: f04b3d11-3f92-4f25-87fe-09a27feb1033] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:19:32.751992 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=4 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:19:32.752651 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=68 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:19:32.758755 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-62a86dbd-2816-4165-a080-a8b542ff5eed tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:19:32.759204 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-62a86dbd-2816-4165-a080-a8b542ff5eed tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:19:32.759974 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-62a86dbd-2816-4165-a080-a8b542ff5eed tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:19:32.760414 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-62a86dbd-2816-4165-a080-a8b542ff5eed tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:19:32.811137 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-62a86dbd-2816-4165-a080-a8b542ff5eed tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "POST /compute/v2.1/servers/f04b3d11-3f92-4f25-87fe-09a27feb1033/action" status: 200 len: 24571 microversion: 2.1 time: 0.067478 Jul 23 22:19:32.811758 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3788/6398] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 22:19:32 2022] POST /compute/v2.1/servers/f04b3d11-3f92-4f25-87fe-09a27feb1033/action => generated 24571 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 23 22:19:39.297845 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-34c73fef-d3d9-4bec-9dcb-72afe4444eaf tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:19:39.298974 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-34c73fef-d3d9-4bec-9dcb-72afe4444eaf tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: f04b3d11-3f92-4f25-87fe-09a27feb1033] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:19:39.308895 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-34c73fef-d3d9-4bec-9dcb-72afe4444eaf tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:19:39.309313 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-34c73fef-d3d9-4bec-9dcb-72afe4444eaf tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:19:39.310156 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-34c73fef-d3d9-4bec-9dcb-72afe4444eaf tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:19:39.310601 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-34c73fef-d3d9-4bec-9dcb-72afe4444eaf tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:19:39.381844 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-34c73fef-d3d9-4bec-9dcb-72afe4444eaf tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "POST /compute/v2.1/servers/f04b3d11-3f92-4f25-87fe-09a27feb1033/action" status: 202 len: 0 microversion: 2.1 time: 0.091504 Jul 23 22:19:39.382578 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3789/6399] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 22:19:39 2022] POST /compute/v2.1/servers/f04b3d11-3f92-4f25-87fe-09a27feb1033/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 22:19:39.391815 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9440146a-d747-436b-aedb-3121c8f647fb tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:19:39.392516 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-9440146a-d747-436b-aedb-3121c8f647fb tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: f04b3d11-3f92-4f25-87fe-09a27feb1033] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:19:39.399481 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9440146a-d747-436b-aedb-3121c8f647fb tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:19:39.399969 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9440146a-d747-436b-aedb-3121c8f647fb tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:19:39.400856 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9440146a-d747-436b-aedb-3121c8f647fb tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:19:39.401386 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9440146a-d747-436b-aedb-3121c8f647fb tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:19:39.554456 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-9440146a-d747-436b-aedb-3121c8f647fb tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:19:39.563055 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9440146a-d747-436b-aedb-3121c8f647fb tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/f04b3d11-3f92-4f25-87fe-09a27feb1033" status: 200 len: 1687 microversion: 2.1 time: 0.175456 Jul 23 22:19:39.563655 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3790/6400] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:19:39 2022] GET /compute/v2.1/servers/f04b3d11-3f92-4f25-87fe-09a27feb1033 => generated 1687 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:19:40.584720 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-eb3d2890-b53a-4f79-bacd-ddaa0c32e795 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:19:40.585855 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-eb3d2890-b53a-4f79-bacd-ddaa0c32e795 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: f04b3d11-3f92-4f25-87fe-09a27feb1033] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:19:40.594320 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-eb3d2890-b53a-4f79-bacd-ddaa0c32e795 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:19:40.594780 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-eb3d2890-b53a-4f79-bacd-ddaa0c32e795 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:19:40.595561 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-eb3d2890-b53a-4f79-bacd-ddaa0c32e795 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:19:40.596006 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-eb3d2890-b53a-4f79-bacd-ddaa0c32e795 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:19:40.732374 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-eb3d2890-b53a-4f79-bacd-ddaa0c32e795 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:19:40.740401 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-eb3d2890-b53a-4f79-bacd-ddaa0c32e795 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/f04b3d11-3f92-4f25-87fe-09a27feb1033" status: 200 len: 1667 microversion: 2.1 time: 0.162288 Jul 23 22:19:40.740987 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3791/6401] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:19:40 2022] GET /compute/v2.1/servers/f04b3d11-3f92-4f25-87fe-09a27feb1033 => generated 1667 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:19:41.832853 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9dd5a717-ee84-4342-82b6-6ed00948f7fe tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:19:41.833831 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-9dd5a717-ee84-4342-82b6-6ed00948f7fe tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: f04b3d11-3f92-4f25-87fe-09a27feb1033] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:19:41.840974 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9dd5a717-ee84-4342-82b6-6ed00948f7fe tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:19:41.841426 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9dd5a717-ee84-4342-82b6-6ed00948f7fe tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:19:41.842214 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9dd5a717-ee84-4342-82b6-6ed00948f7fe tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:19:41.842654 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9dd5a717-ee84-4342-82b6-6ed00948f7fe tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:19:41.890608 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9dd5a717-ee84-4342-82b6-6ed00948f7fe tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "POST /compute/v2.1/servers/f04b3d11-3f92-4f25-87fe-09a27feb1033/action" status: 200 len: 32645 microversion: 2.1 time: 0.062379 Jul 23 22:19:41.891246 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3792/6402] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 22:19:41 2022] POST /compute/v2.1/servers/f04b3d11-3f92-4f25-87fe-09a27feb1033/action => generated 32645 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 23 22:19:41.902647 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-253dba92-c9c8-4fd3-a9d4-e2eb25523563 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:19:41.903265 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-253dba92-c9c8-4fd3-a9d4-e2eb25523563 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: f04b3d11-3f92-4f25-87fe-09a27feb1033] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:19:41.910550 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-253dba92-c9c8-4fd3-a9d4-e2eb25523563 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:19:41.911001 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-253dba92-c9c8-4fd3-a9d4-e2eb25523563 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:19:41.911758 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-253dba92-c9c8-4fd3-a9d4-e2eb25523563 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:19:41.912197 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-253dba92-c9c8-4fd3-a9d4-e2eb25523563 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:19:41.982992 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-253dba92-c9c8-4fd3-a9d4-e2eb25523563 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "POST /compute/v2.1/servers/f04b3d11-3f92-4f25-87fe-09a27feb1033/action" status: 202 len: 0 microversion: 2.1 time: 0.083667 Jul 23 22:19:41.983848 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3793/6403] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 22:19:41 2022] POST /compute/v2.1/servers/f04b3d11-3f92-4f25-87fe-09a27feb1033/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 22:19:41.992326 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0a56b1d3-dfdd-4bfc-abaf-8ba462f78017 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:19:41.993037 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-0a56b1d3-dfdd-4bfc-abaf-8ba462f78017 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: f04b3d11-3f92-4f25-87fe-09a27feb1033] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:19:42.000487 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0a56b1d3-dfdd-4bfc-abaf-8ba462f78017 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:19:42.000940 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0a56b1d3-dfdd-4bfc-abaf-8ba462f78017 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:19:42.001737 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0a56b1d3-dfdd-4bfc-abaf-8ba462f78017 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:19:42.002204 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0a56b1d3-dfdd-4bfc-abaf-8ba462f78017 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:19:42.151001 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-0a56b1d3-dfdd-4bfc-abaf-8ba462f78017 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:19:42.166338 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-0a56b1d3-dfdd-4bfc-abaf-8ba462f78017 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/f04b3d11-3f92-4f25-87fe-09a27feb1033" status: 200 len: 1674 microversion: 2.1 time: 0.177860 Jul 23 22:19:42.166955 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3794/6404] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:19:41 2022] GET /compute/v2.1/servers/f04b3d11-3f92-4f25-87fe-09a27feb1033 => generated 1674 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:19:43.184594 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a8d4a738-982f-4812-b5f5-dc5e4be6e4f6 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:19:43.185312 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a8d4a738-982f-4812-b5f5-dc5e4be6e4f6 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: f04b3d11-3f92-4f25-87fe-09a27feb1033] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:19:43.192775 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a8d4a738-982f-4812-b5f5-dc5e4be6e4f6 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:19:43.193201 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a8d4a738-982f-4812-b5f5-dc5e4be6e4f6 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:19:43.194008 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a8d4a738-982f-4812-b5f5-dc5e4be6e4f6 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:19:43.194809 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a8d4a738-982f-4812-b5f5-dc5e4be6e4f6 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:19:43.342158 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a8d4a738-982f-4812-b5f5-dc5e4be6e4f6 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:19:43.350213 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a8d4a738-982f-4812-b5f5-dc5e4be6e4f6 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/f04b3d11-3f92-4f25-87fe-09a27feb1033" status: 200 len: 1682 microversion: 2.1 time: 0.169614 Jul 23 22:19:43.350795 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3795/6405] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:19:43 2022] GET /compute/v2.1/servers/f04b3d11-3f92-4f25-87fe-09a27feb1033 => generated 1682 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:19:43.441808 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-20acece3-f683-4578-9117-03356e9f96e9 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:19:43.442769 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-20acece3-f683-4578-9117-03356e9f96e9 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: f04b3d11-3f92-4f25-87fe-09a27feb1033] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:19:43.450037 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-20acece3-f683-4578-9117-03356e9f96e9 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:19:43.450482 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-20acece3-f683-4578-9117-03356e9f96e9 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:19:43.451245 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-20acece3-f683-4578-9117-03356e9f96e9 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:19:43.451795 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-20acece3-f683-4578-9117-03356e9f96e9 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:19:43.507139 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-20acece3-f683-4578-9117-03356e9f96e9 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "POST /compute/v2.1/servers/f04b3d11-3f92-4f25-87fe-09a27feb1033/action" status: 200 len: 35943 microversion: 2.1 time: 0.069228 Jul 23 22:19:43.507818 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3796/6406] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 22:19:43 2022] POST /compute/v2.1/servers/f04b3d11-3f92-4f25-87fe-09a27feb1033/action => generated 35943 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 23 22:19:44.879940 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-48f8dbc8-258c-41da-b037-1bf078e20356 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:19:44.880595 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-48f8dbc8-258c-41da-b037-1bf078e20356 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: f04b3d11-3f92-4f25-87fe-09a27feb1033] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:19:44.888536 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-48f8dbc8-258c-41da-b037-1bf078e20356 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:19:44.889032 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-48f8dbc8-258c-41da-b037-1bf078e20356 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:19:44.889894 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-48f8dbc8-258c-41da-b037-1bf078e20356 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:19:44.890437 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-48f8dbc8-258c-41da-b037-1bf078e20356 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:19:44.917193 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-48f8dbc8-258c-41da-b037-1bf078e20356 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: f04b3d11-3f92-4f25-87fe-09a27feb1033] Going to try to terminate instance {{(pid=131320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 22:19:44.997651 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-48f8dbc8-258c-41da-b037-1bf078e20356 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "DELETE /compute/v2.1/servers/f04b3d11-3f92-4f25-87fe-09a27feb1033" status: 204 len: 0 microversion: 2.1 time: 0.121618 Jul 23 22:19:44.998508 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3797/6407] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 22:19:44 2022] DELETE /compute/v2.1/servers/f04b3d11-3f92-4f25-87fe-09a27feb1033 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 23 22:19:45.004117 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-05212e14-d013-4a0a-809f-b3156f66dfdd req-5b62750e-58d6-4882-b963-66f2853e0c70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f04b3d11-3f92-4f25-87fe-09a27feb1033", "tag": "4cca344b-5a37-4188-a711-67a9809ee66a"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:19:45.013042 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-05212e14-d013-4a0a-809f-b3156f66dfdd req-5b62750e-58d6-4882-b963-66f2853e0c70 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:19:45.013501 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-05212e14-d013-4a0a-809f-b3156f66dfdd req-5b62750e-58d6-4882-b963-66f2853e0c70 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:19:45.024973 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-05212e14-d013-4a0a-809f-b3156f66dfdd req-5b62750e-58d6-4882-b963-66f2853e0c70 service nova] Creating event network-changed:4cca344b-5a37-4188-a711-67a9809ee66a for instance f04b3d11-3f92-4f25-87fe-09a27feb1033 on nch2-master-1 Jul 23 22:19:45.030008 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-05212e14-d013-4a0a-809f-b3156f66dfdd req-5b62750e-58d6-4882-b963-66f2853e0c70 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030011 Jul 23 22:19:45.030596 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3798/6408] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:19:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:19:45.035975 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e17b0e31-c894-4cb8-8034-71ca9e0ea332 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:19:45.036655 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e17b0e31-c894-4cb8-8034-71ca9e0ea332 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: f04b3d11-3f92-4f25-87fe-09a27feb1033] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:19:45.042987 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e17b0e31-c894-4cb8-8034-71ca9e0ea332 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:19:45.043456 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e17b0e31-c894-4cb8-8034-71ca9e0ea332 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:19:45.044224 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e17b0e31-c894-4cb8-8034-71ca9e0ea332 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:19:45.044664 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e17b0e31-c894-4cb8-8034-71ca9e0ea332 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:19:45.181908 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e17b0e31-c894-4cb8-8034-71ca9e0ea332 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:19:45.190181 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e17b0e31-c894-4cb8-8034-71ca9e0ea332 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/f04b3d11-3f92-4f25-87fe-09a27feb1033" status: 200 len: 1688 microversion: 2.1 time: 0.158396 Jul 23 22:19:45.190768 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3799/6409] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:19:45 2022] GET /compute/v2.1/servers/f04b3d11-3f92-4f25-87fe-09a27feb1033 => generated 1688 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:19:46.212857 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9cdbb6d5-bc44-45a0-adf1-69f8bb5159c5 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:19:46.213838 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-9cdbb6d5-bc44-45a0-adf1-69f8bb5159c5 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: f04b3d11-3f92-4f25-87fe-09a27feb1033] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:19:46.225919 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9cdbb6d5-bc44-45a0-adf1-69f8bb5159c5 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:19:46.226701 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9cdbb6d5-bc44-45a0-adf1-69f8bb5159c5 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:19:46.227972 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9cdbb6d5-bc44-45a0-adf1-69f8bb5159c5 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:19:46.228706 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9cdbb6d5-bc44-45a0-adf1-69f8bb5159c5 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:19:46.380393 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-9cdbb6d5-bc44-45a0-adf1-69f8bb5159c5 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:19:46.388465 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9cdbb6d5-bc44-45a0-adf1-69f8bb5159c5 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/f04b3d11-3f92-4f25-87fe-09a27feb1033" status: 200 len: 1688 microversion: 2.1 time: 0.182019 Jul 23 22:19:46.389072 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3800/6410] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:19:46 2022] GET /compute/v2.1/servers/f04b3d11-3f92-4f25-87fe-09a27feb1033 => generated 1688 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:19:47.107305 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-97a80c23-18a1-4fb0-a929-7304258962d4 req-5d69a0cd-47d6-4d05-873e-0f12ba864fd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f04b3d11-3f92-4f25-87fe-09a27feb1033", "name": "network-vif-deleted", "tag": "4cca344b-5a37-4188-a711-67a9809ee66a"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:19:47.115844 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-97a80c23-18a1-4fb0-a929-7304258962d4 req-5d69a0cd-47d6-4d05-873e-0f12ba864fd5 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:19:47.116304 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-97a80c23-18a1-4fb0-a929-7304258962d4 req-5d69a0cd-47d6-4d05-873e-0f12ba864fd5 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:19:47.127761 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-97a80c23-18a1-4fb0-a929-7304258962d4 req-5d69a0cd-47d6-4d05-873e-0f12ba864fd5 service nova] Creating event network-vif-deleted:4cca344b-5a37-4188-a711-67a9809ee66a for instance f04b3d11-3f92-4f25-87fe-09a27feb1033 on nch2-master-1 Jul 23 22:19:47.132596 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-97a80c23-18a1-4fb0-a929-7304258962d4 req-5d69a0cd-47d6-4d05-873e-0f12ba864fd5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029035 Jul 23 22:19:47.133197 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3801/6411] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:19:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 22:19:47.407741 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e4a6b56d-c822-4218-9fba-53bc7bedd5b5 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:19:47.408548 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e4a6b56d-c822-4218-9fba-53bc7bedd5b5 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: f04b3d11-3f92-4f25-87fe-09a27feb1033] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:19:47.417701 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e4a6b56d-c822-4218-9fba-53bc7bedd5b5 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:19:47.418185 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e4a6b56d-c822-4218-9fba-53bc7bedd5b5 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:19:47.418977 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e4a6b56d-c822-4218-9fba-53bc7bedd5b5 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:19:47.419566 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e4a6b56d-c822-4218-9fba-53bc7bedd5b5 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:19:47.456337 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e4a6b56d-c822-4218-9fba-53bc7bedd5b5 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:19:47.456802 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e4a6b56d-c822-4218-9fba-53bc7bedd5b5 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:19:47.457241 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.objects.instance [None req-e4a6b56d-c822-4218-9fba-53bc7bedd5b5 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lazy-loading 'fault' on Instance uuid f04b3d11-3f92-4f25-87fe-09a27feb1033 {{(pid=131320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 22:19:47.503131 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e4a6b56d-c822-4218-9fba-53bc7bedd5b5 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:19:47.506977 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:19:47.513092 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e4a6b56d-c822-4218-9fba-53bc7bedd5b5 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/f04b3d11-3f92-4f25-87fe-09a27feb1033" status: 200 len: 1356 microversion: 2.1 time: 0.110111 Jul 23 22:19:47.513992 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3802/6412] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:19:47 2022] GET /compute/v2.1/servers/f04b3d11-3f92-4f25-87fe-09a27feb1033 => generated 1356 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:19:48.537210 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0449164c-9a3f-4ca3-82c5-8b26a6104c20 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:19:48.538305 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-0449164c-9a3f-4ca3-82c5-8b26a6104c20 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: f04b3d11-3f92-4f25-87fe-09a27feb1033] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:19:48.549180 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0449164c-9a3f-4ca3-82c5-8b26a6104c20 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:19:48.549633 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0449164c-9a3f-4ca3-82c5-8b26a6104c20 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:19:48.550438 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0449164c-9a3f-4ca3-82c5-8b26a6104c20 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:19:48.550875 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0449164c-9a3f-4ca3-82c5-8b26a6104c20 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:19:48.567758 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-0449164c-9a3f-4ca3-82c5-8b26a6104c20 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] HTTP exception thrown: Instance f04b3d11-3f92-4f25-87fe-09a27feb1033 could not be found. Jul 23 22:19:48.569770 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0449164c-9a3f-4ca3-82c5-8b26a6104c20 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Request method failure captured: Jul 23 22:19:48.569770 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/f04b3d11-3f92-4f25-87fe-09a27feb1033 HTTP/1.1 Jul 23 22:19:48.569770 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 22:19:48.569770 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 22:19:48.569770 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 22:19:48.569770 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 22:19:48.569770 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 22:19:48.569770 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 22:19:48.569770 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 22:19:48.569770 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 22:19:48.569770 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3HPJGU05HbBTEvLxfT4BhGztnBRWhLwkU8QutIkTRTvVibf-V1mkLz3byZWX90Z2v50VOJRv9MqhrAotUJSfT2hBQ8C_NuI2cZ3sL6bxRnPnmAfb7udSijYdHU5_chgf6SP2LARXnPx77YiG880S5DV74F87lCIERZhTyKn6pgRdpVQ Jul 23 22:19:48.569770 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 22:19:48.569770 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 22:19:48.569770 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 22:19:48.569770 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 22:19:48.569770 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 22:19:48.569770 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 22:19:48.569770 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: a14b865dcbd14987870351ce4e45aaac Jul 23 22:19:48.569770 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1025071309 Jul 23 22:19:48.569770 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 22:19:48.569770 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 22:19:48.569770 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a14b865dcbd14987870351ce4e45aaac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a14b865dcbd14987870351ce4e45aaac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a14b865dcbd14987870351ce4e45aaac", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a14b865dcbd14987870351ce4e45aaac"}]}] Jul 23 22:19:48.569770 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1025071309 Jul 23 22:19:48.569770 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: a14b865dcbd14987870351ce4e45aaac Jul 23 22:19:48.569770 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1025071309 Jul 23 22:19:48.569770 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-TestNetworkAdvancedServerOps-1025071309-project Jul 23 22:19:48.569770 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 22:19:48.569770 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 22:19:48.569770 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: a686380934d042b4a078eb60e9bb6712 Jul 23 22:19:48.569770 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1025071309-project Jul 23 22:19:48.569770 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 22:19:48.569770 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance f04b3d11-3f92-4f25-87fe-09a27feb1033 could not be found. Jul 23 22:19:48.569770 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': 'f04b3d11-3f92-4f25-87fe-09a27feb1033'} Jul 23 22:19:48.569770 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 22:19:48.569770 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:19:48.569770 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 22:19:48.569770 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 22:19:48.569770 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 22:19:48.569770 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 22:19:48.569770 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 22:19:48.569770 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 22:19:48.569770 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 22:19:48.569770 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 22:19:48.569770 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f04b3d11-3f92-4f25-87fe-09a27feb1033 could not be found. Jul 23 22:19:48.569770 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:19:48.569770 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:19:48.569770 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:19:48.569770 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:19:48.569770 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:19:48.569770 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:19:48.569770 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 22:19:48.569770 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 22:19:48.569770 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 22:19:48.569770 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 22:19:48.569770 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 22:19:48.569770 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 22:19:48.569770 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 22:19:48.569770 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 22:19:48.569770 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 22:19:48.569770 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 22:19:48.569770 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f04b3d11-3f92-4f25-87fe-09a27feb1033 could not be found. Jul 23 22:19:48.569770 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:19:48.569770 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:19:48.574045 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:19:48.574045 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:19:48.574045 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:19:48.574045 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:19:48.574045 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 22:19:48.574045 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 22:19:48.574045 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f04b3d11-3f92-4f25-87fe-09a27feb1033 could not be found. Jul 23 22:19:48.574045 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:19:48.574045 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0449164c-9a3f-4ca3-82c5-8b26a6104c20 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Returning 404 to user: Instance f04b3d11-3f92-4f25-87fe-09a27feb1033 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 22:19:48.574045 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-0449164c-9a3f-4ca3-82c5-8b26a6104c20 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/f04b3d11-3f92-4f25-87fe-09a27feb1033" status: 404 len: 111 microversion: 2.1 time: 0.042155 Jul 23 22:19:48.574045 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3803/6413] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:19:48 2022] GET /compute/v2.1/servers/f04b3d11-3f92-4f25-87fe-09a27feb1033 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 22:19:51.553834 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-742f75e6-5fa7-4243-bbca-e1c90a1122e7 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '.version_select at 0x7f0b46489dc0>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:19:51.578031 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-742f75e6-5fa7-4243-bbca-e1c90a1122e7 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2028054889" status: 202 len: 0 microversion: 2.1 time: 0.028102 Jul 23 22:19:51.579007 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3804/6414] 10.222.0.17 () {58 vars in 1283 bytes} [Sat Jul 23 22:19:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2028054889 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 22:19:51.604878 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f18e471d-df3a-4108-810d-cf2959471487 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Action: 'create', calling method: .version_select at 0x7f0b4656e3a0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-157725703", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB4+X5uqcU3HUHNLPXs+FBGwXshOGHZSv0w0FlLOg0xco1r8G3XVpxwKSDGMGh8znPnn5S7yuKENXcPo8CeG4iw6eNGXWq3luqdhc5dB4nxDjHwSqqSyr2camu648cB1FA=="}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:19:51.620914 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-f18e471d-df3a-4108-810d-cf2959471487 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Getting quotas for project a14b865dcbd14987870351ce4e45aaac. Resources: {'key_pairs'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 22:19:51.626157 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-f18e471d-df3a-4108-810d-cf2959471487 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Getting quotas for user a686380934d042b4a078eb60e9bb6712 and project a14b865dcbd14987870351ce4e45aaac. Resources: {'key_pairs'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 22:19:51.650593 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f18e471d-df3a-4108-810d-cf2959471487 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.050268 Jul 23 22:19:51.651194 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3805/6415] 10.222.0.17 () {60 vars in 1158 bytes} [Sat Jul 23 22:19:51 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 22:19:57.233011 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-89152b1a-2cf8-4b80-bb67-0893a862919a tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1481714675", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "networks": [{"uuid": "16882a09-c2ba-4130-b6f6-cc632dfc5f0a"}], "key_name": "tempest-TestNetworkAdvancedServerOps-157725703", "security_groups": [{"name": "tempest-secgroup-smoke-1653104439"}]}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:19:57.359150 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-89152b1a-2cf8-4b80-bb67-0893a862919a tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] validate_networks() for [('16882a09-c2ba-4130-b6f6-cc632dfc5f0a', None, None, None, None, None)] {{(pid=131320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 22:19:58.145231 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-89152b1a-2cf8-4b80-bb67-0893a862919a tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 22:19:58.145944 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-89152b1a-2cf8-4b80-bb67-0893a862919a tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 22:19:58.146486 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-89152b1a-2cf8-4b80-bb67-0893a862919a tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 22:19:58.146897 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-89152b1a-2cf8-4b80-bb67-0893a862919a tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 22:19:58.147312 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-89152b1a-2cf8-4b80-bb67-0893a862919a tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 22:19:58.158210 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-89152b1a-2cf8-4b80-bb67-0893a862919a tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:19:58.158664 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-89152b1a-2cf8-4b80-bb67-0893a862919a tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:19:58.159665 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-89152b1a-2cf8-4b80-bb67-0893a862919a tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:19:58.160107 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-89152b1a-2cf8-4b80-bb67-0893a862919a tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:19:58.179636 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-89152b1a-2cf8-4b80-bb67-0893a862919a tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Getting quotas for project a14b865dcbd14987870351ce4e45aaac. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 22:19:58.185266 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-89152b1a-2cf8-4b80-bb67-0893a862919a tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Getting quotas for user a686380934d042b4a078eb60e9bb6712 and project a14b865dcbd14987870351ce4e45aaac. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 22:19:58.198877 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-89152b1a-2cf8-4b80-bb67-0893a862919a tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Going to run 1 instances... {{(pid=131320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 22:19:58.201351 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-89152b1a-2cf8-4b80-bb67-0893a862919a tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 122f6fed-b23e-4ed5-a054-9d5bc4751b5c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 22:19:58.249030 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-89152b1a-2cf8-4b80-bb67-0893a862919a tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.021356 Jul 23 22:19:58.254743 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3806/6416] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 22:19:57 2022] POST /compute/v2.1/servers => generated 406 bytes in 1023 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 23 22:19:58.259623 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-27d90cda-fec0-4551-9d0e-e5671b91e73a tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:19:58.260239 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-27d90cda-fec0-4551-9d0e-e5671b91e73a tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 122f6fed-b23e-4ed5-a054-9d5bc4751b5c] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:19:58.318773 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-27d90cda-fec0-4551-9d0e-e5671b91e73a tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:19:58.327520 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-27d90cda-fec0-4551-9d0e-e5671b91e73a tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/122f6fed-b23e-4ed5-a054-9d5bc4751b5c" status: 200 len: 1266 microversion: 2.1 time: 0.071589 Jul 23 22:19:58.328111 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3807/6417] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:19:58 2022] GET /compute/v2.1/servers/122f6fed-b23e-4ed5-a054-9d5bc4751b5c => generated 1266 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:19:59.346593 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-91fb1cbe-5a34-4e81-afe8-bfa60213ed18 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:19:59.348066 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-91fb1cbe-5a34-4e81-afe8-bfa60213ed18 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 122f6fed-b23e-4ed5-a054-9d5bc4751b5c] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:19:59.356647 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-91fb1cbe-5a34-4e81-afe8-bfa60213ed18 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:19:59.357243 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-91fb1cbe-5a34-4e81-afe8-bfa60213ed18 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:19:59.358206 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-91fb1cbe-5a34-4e81-afe8-bfa60213ed18 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:19:59.358745 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-91fb1cbe-5a34-4e81-afe8-bfa60213ed18 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:19:59.435739 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-91fb1cbe-5a34-4e81-afe8-bfa60213ed18 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:19:59.445015 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-91fb1cbe-5a34-4e81-afe8-bfa60213ed18 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/122f6fed-b23e-4ed5-a054-9d5bc4751b5c" status: 200 len: 1324 microversion: 2.1 time: 0.104031 Jul 23 22:19:59.446058 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3808/6418] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:19:59 2022] GET /compute/v2.1/servers/122f6fed-b23e-4ed5-a054-9d5bc4751b5c => generated 1324 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:20:00.463341 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4301e39a-689d-4cd9-ac23-d6bfa427f0ae tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:20:00.463979 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-4301e39a-689d-4cd9-ac23-d6bfa427f0ae tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 122f6fed-b23e-4ed5-a054-9d5bc4751b5c] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:20:00.472082 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4301e39a-689d-4cd9-ac23-d6bfa427f0ae tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:20:00.472534 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4301e39a-689d-4cd9-ac23-d6bfa427f0ae tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:20:00.473327 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4301e39a-689d-4cd9-ac23-d6bfa427f0ae tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:20:00.473772 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4301e39a-689d-4cd9-ac23-d6bfa427f0ae tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:20:00.704013 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-4301e39a-689d-4cd9-ac23-d6bfa427f0ae tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:20:00.713256 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4301e39a-689d-4cd9-ac23-d6bfa427f0ae tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/122f6fed-b23e-4ed5-a054-9d5bc4751b5c" status: 200 len: 1392 microversion: 2.1 time: 0.253990 Jul 23 22:20:00.714257 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3809/6419] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:20:00 2022] GET /compute/v2.1/servers/122f6fed-b23e-4ed5-a054-9d5bc4751b5c => generated 1392 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:20:00.839110 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-290dc763-eb98-4610-aaf5-98f93b0fb0de req-46b68f82-d256-4690-bcea-ef2a01c15510 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "122f6fed-b23e-4ed5-a054-9d5bc4751b5c", "tag": "8c6d3b57-613f-4f1e-885a-2f96cae0f9bd"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:20:00.850038 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-290dc763-eb98-4610-aaf5-98f93b0fb0de req-46b68f82-d256-4690-bcea-ef2a01c15510 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:20:00.850694 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-290dc763-eb98-4610-aaf5-98f93b0fb0de req-46b68f82-d256-4690-bcea-ef2a01c15510 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:20:00.863726 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-290dc763-eb98-4610-aaf5-98f93b0fb0de req-46b68f82-d256-4690-bcea-ef2a01c15510 service nova] Creating event network-changed:8c6d3b57-613f-4f1e-885a-2f96cae0f9bd for instance 122f6fed-b23e-4ed5-a054-9d5bc4751b5c on nch2-master-1 Jul 23 22:20:00.869596 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-290dc763-eb98-4610-aaf5-98f93b0fb0de req-46b68f82-d256-4690-bcea-ef2a01c15510 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034271 Jul 23 22:20:00.870423 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3810/6420] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:20:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 22:20:01.732671 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e0fc56de-68de-4c8c-8083-f3ef541a07c4 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:20:01.733385 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e0fc56de-68de-4c8c-8083-f3ef541a07c4 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 122f6fed-b23e-4ed5-a054-9d5bc4751b5c] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:20:01.740184 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e0fc56de-68de-4c8c-8083-f3ef541a07c4 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:20:01.740644 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e0fc56de-68de-4c8c-8083-f3ef541a07c4 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:20:01.741386 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e0fc56de-68de-4c8c-8083-f3ef541a07c4 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:20:01.741892 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e0fc56de-68de-4c8c-8083-f3ef541a07c4 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:20:01.879509 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e0fc56de-68de-4c8c-8083-f3ef541a07c4 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:20:01.890978 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e0fc56de-68de-4c8c-8083-f3ef541a07c4 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/122f6fed-b23e-4ed5-a054-9d5bc4751b5c" status: 200 len: 1392 microversion: 2.1 time: 0.163486 Jul 23 22:20:01.891495 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3811/6421] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:20:01 2022] GET /compute/v2.1/servers/122f6fed-b23e-4ed5-a054-9d5bc4751b5c => generated 1392 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:20:02.912312 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d7a1d7a4-6323-47ff-a7e1-aa2f213825ea tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:20:02.913336 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d7a1d7a4-6323-47ff-a7e1-aa2f213825ea tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 122f6fed-b23e-4ed5-a054-9d5bc4751b5c] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:20:02.917740 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:20:02.924479 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d7a1d7a4-6323-47ff-a7e1-aa2f213825ea tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:20:02.924931 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d7a1d7a4-6323-47ff-a7e1-aa2f213825ea tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:20:02.925710 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d7a1d7a4-6323-47ff-a7e1-aa2f213825ea tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:20:02.926188 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d7a1d7a4-6323-47ff-a7e1-aa2f213825ea tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:20:03.069076 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d7a1d7a4-6323-47ff-a7e1-aa2f213825ea tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:20:03.077545 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d7a1d7a4-6323-47ff-a7e1-aa2f213825ea tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/122f6fed-b23e-4ed5-a054-9d5bc4751b5c" status: 200 len: 1392 microversion: 2.1 time: 0.171962 Jul 23 22:20:03.078172 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3812/6422] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:20:02 2022] GET /compute/v2.1/servers/122f6fed-b23e-4ed5-a054-9d5bc4751b5c => generated 1392 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:20:04.095031 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-70b16129-a3b3-4ff6-bc70-c52b95f97ddb tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:20:04.095687 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-70b16129-a3b3-4ff6-bc70-c52b95f97ddb tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 122f6fed-b23e-4ed5-a054-9d5bc4751b5c] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:20:04.103944 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-70b16129-a3b3-4ff6-bc70-c52b95f97ddb tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:20:04.104421 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-70b16129-a3b3-4ff6-bc70-c52b95f97ddb tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:20:04.105198 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-70b16129-a3b3-4ff6-bc70-c52b95f97ddb tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:20:04.105646 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-70b16129-a3b3-4ff6-bc70-c52b95f97ddb tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:20:04.248811 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-70b16129-a3b3-4ff6-bc70-c52b95f97ddb tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:20:04.260694 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-70b16129-a3b3-4ff6-bc70-c52b95f97ddb tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/122f6fed-b23e-4ed5-a054-9d5bc4751b5c" status: 200 len: 1392 microversion: 2.1 time: 0.169453 Jul 23 22:20:04.261585 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3813/6423] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:20:04 2022] GET /compute/v2.1/servers/122f6fed-b23e-4ed5-a054-9d5bc4751b5c => generated 1392 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:20:05.282686 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6ce360d6-e3d6-4452-86dd-82317256434e tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:20:05.283563 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6ce360d6-e3d6-4452-86dd-82317256434e tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 122f6fed-b23e-4ed5-a054-9d5bc4751b5c] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:20:05.293243 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6ce360d6-e3d6-4452-86dd-82317256434e tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:20:05.293850 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6ce360d6-e3d6-4452-86dd-82317256434e tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:20:05.294926 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6ce360d6-e3d6-4452-86dd-82317256434e tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:20:05.295520 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6ce360d6-e3d6-4452-86dd-82317256434e tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:20:05.433042 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6ce360d6-e3d6-4452-86dd-82317256434e tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:20:05.441209 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6ce360d6-e3d6-4452-86dd-82317256434e tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/122f6fed-b23e-4ed5-a054-9d5bc4751b5c" status: 200 len: 1392 microversion: 2.1 time: 0.164671 Jul 23 22:20:05.441803 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3814/6424] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:20:05 2022] GET /compute/v2.1/servers/122f6fed-b23e-4ed5-a054-9d5bc4751b5c => generated 1392 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:20:05.682998 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-ac2b57ea-b4be-43bc-b35a-db47962fc8f7 req-8a21c1d8-bc1c-4cb2-879a-8f855a03f997 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "122f6fed-b23e-4ed5-a054-9d5bc4751b5c", "name": "network-vif-plugged", "status": "completed", "tag": "8c6d3b57-613f-4f1e-885a-2f96cae0f9bd"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:20:05.691770 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-ac2b57ea-b4be-43bc-b35a-db47962fc8f7 req-8a21c1d8-bc1c-4cb2-879a-8f855a03f997 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:20:05.692240 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-ac2b57ea-b4be-43bc-b35a-db47962fc8f7 req-8a21c1d8-bc1c-4cb2-879a-8f855a03f997 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:20:05.704733 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-ac2b57ea-b4be-43bc-b35a-db47962fc8f7 req-8a21c1d8-bc1c-4cb2-879a-8f855a03f997 service nova] Creating event network-vif-plugged:8c6d3b57-613f-4f1e-885a-2f96cae0f9bd for instance 122f6fed-b23e-4ed5-a054-9d5bc4751b5c on nch2-master-1 Jul 23 22:20:05.710200 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-ac2b57ea-b4be-43bc-b35a-db47962fc8f7 req-8a21c1d8-bc1c-4cb2-879a-8f855a03f997 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030866 Jul 23 22:20:05.710991 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3815/6425] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:20:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:20:06.464777 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-70644eb0-fc9c-4fb5-b76c-ab64be6e77c3 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:20:06.465492 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-70644eb0-fc9c-4fb5-b76c-ab64be6e77c3 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 122f6fed-b23e-4ed5-a054-9d5bc4751b5c] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:20:06.475747 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-70644eb0-fc9c-4fb5-b76c-ab64be6e77c3 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:20:06.476364 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-70644eb0-fc9c-4fb5-b76c-ab64be6e77c3 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:20:06.477528 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-70644eb0-fc9c-4fb5-b76c-ab64be6e77c3 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:20:06.478088 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-70644eb0-fc9c-4fb5-b76c-ab64be6e77c3 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:20:06.630931 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-70644eb0-fc9c-4fb5-b76c-ab64be6e77c3 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:20:06.638842 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-70644eb0-fc9c-4fb5-b76c-ab64be6e77c3 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/122f6fed-b23e-4ed5-a054-9d5bc4751b5c" status: 200 len: 1392 microversion: 2.1 time: 0.182408 Jul 23 22:20:06.639579 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3816/6426] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:20:06 2022] GET /compute/v2.1/servers/122f6fed-b23e-4ed5-a054-9d5bc4751b5c => generated 1392 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:20:07.659638 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f22060df-25fb-4f82-a682-538a00581b2a tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:20:07.660974 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f22060df-25fb-4f82-a682-538a00581b2a tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 122f6fed-b23e-4ed5-a054-9d5bc4751b5c] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:20:07.672469 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f22060df-25fb-4f82-a682-538a00581b2a tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:20:07.673352 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f22060df-25fb-4f82-a682-538a00581b2a tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:20:07.674734 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f22060df-25fb-4f82-a682-538a00581b2a tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:20:07.675416 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f22060df-25fb-4f82-a682-538a00581b2a tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:20:07.820316 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f22060df-25fb-4f82-a682-538a00581b2a tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:20:07.828316 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f22060df-25fb-4f82-a682-538a00581b2a tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/122f6fed-b23e-4ed5-a054-9d5bc4751b5c" status: 200 len: 1563 microversion: 2.1 time: 0.174874 Jul 23 22:20:07.828899 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3817/6427] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:20:07 2022] GET /compute/v2.1/servers/122f6fed-b23e-4ed5-a054-9d5bc4751b5c => generated 1563 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:20:07.844217 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2c116d1b-a319-4312-9363-96bec472ebbc tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:20:07.844820 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-2c116d1b-a319-4312-9363-96bec472ebbc tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 122f6fed-b23e-4ed5-a054-9d5bc4751b5c] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:20:07.850879 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2c116d1b-a319-4312-9363-96bec472ebbc tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:20:07.851326 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2c116d1b-a319-4312-9363-96bec472ebbc tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:20:07.852086 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2c116d1b-a319-4312-9363-96bec472ebbc tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:20:07.852525 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2c116d1b-a319-4312-9363-96bec472ebbc tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:20:07.990529 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-2c116d1b-a319-4312-9363-96bec472ebbc tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:20:08.002774 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2c116d1b-a319-4312-9363-96bec472ebbc tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/122f6fed-b23e-4ed5-a054-9d5bc4751b5c" status: 200 len: 1563 microversion: 2.1 time: 0.161784 Jul 23 22:20:08.003625 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3818/6428] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:20:07 2022] GET /compute/v2.1/servers/122f6fed-b23e-4ed5-a054-9d5bc4751b5c => generated 1563 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:20:09.667726 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-ae4e8c9e-4d96-4438-903f-4f3626752a5c req-e8ea1d0f-70fa-4213-b454-01e3421420b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "122f6fed-b23e-4ed5-a054-9d5bc4751b5c", "tag": "8c6d3b57-613f-4f1e-885a-2f96cae0f9bd"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:20:09.671564 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:20:09.672394 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=12 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:20:09.681229 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-ae4e8c9e-4d96-4438-903f-4f3626752a5c req-e8ea1d0f-70fa-4213-b454-01e3421420b9 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:20:09.682329 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-ae4e8c9e-4d96-4438-903f-4f3626752a5c req-e8ea1d0f-70fa-4213-b454-01e3421420b9 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:20:09.697521 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-ae4e8c9e-4d96-4438-903f-4f3626752a5c req-e8ea1d0f-70fa-4213-b454-01e3421420b9 service nova] Creating event network-changed:8c6d3b57-613f-4f1e-885a-2f96cae0f9bd for instance 122f6fed-b23e-4ed5-a054-9d5bc4751b5c on nch2-master-1 Jul 23 22:20:09.702609 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-ae4e8c9e-4d96-4438-903f-4f3626752a5c req-e8ea1d0f-70fa-4213-b454-01e3421420b9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038500 Jul 23 22:20:09.703491 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3819/6429] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:20:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:20:09.708493 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e0a1153f-04cc-45d9-ac3e-406a323df68c tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:20:09.709186 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e0a1153f-04cc-45d9-ac3e-406a323df68c tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 122f6fed-b23e-4ed5-a054-9d5bc4751b5c] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:20:09.715539 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e0a1153f-04cc-45d9-ac3e-406a323df68c tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:20:09.715989 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e0a1153f-04cc-45d9-ac3e-406a323df68c tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:20:09.716774 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e0a1153f-04cc-45d9-ac3e-406a323df68c tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:20:09.717224 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e0a1153f-04cc-45d9-ac3e-406a323df68c tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:20:09.932028 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e0a1153f-04cc-45d9-ac3e-406a323df68c tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:20:09.940770 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e0a1153f-04cc-45d9-ac3e-406a323df68c tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/122f6fed-b23e-4ed5-a054-9d5bc4751b5c" status: 200 len: 1563 microversion: 2.1 time: 0.236339 Jul 23 22:20:09.953395 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3820/6430] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:20:09 2022] GET /compute/v2.1/servers/122f6fed-b23e-4ed5-a054-9d5bc4751b5c => generated 1563 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:20:31.231011 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-85190700-fe97-4063-b6d3-ca822034fa34 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:20:31.231850 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-85190700-fe97-4063-b6d3-ca822034fa34 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 122f6fed-b23e-4ed5-a054-9d5bc4751b5c] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:20:31.235022 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=17 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:20:31.235654 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=70 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:20:31.242653 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-85190700-fe97-4063-b6d3-ca822034fa34 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:20:31.243108 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-85190700-fe97-4063-b6d3-ca822034fa34 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:20:31.243890 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-85190700-fe97-4063-b6d3-ca822034fa34 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:20:31.244335 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-85190700-fe97-4063-b6d3-ca822034fa34 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:20:31.295247 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-85190700-fe97-4063-b6d3-ca822034fa34 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "POST /compute/v2.1/servers/122f6fed-b23e-4ed5-a054-9d5bc4751b5c/action" status: 200 len: 24575 microversion: 2.1 time: 0.068172 Jul 23 22:20:31.295880 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3821/6431] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 22:20:31 2022] POST /compute/v2.1/servers/122f6fed-b23e-4ed5-a054-9d5bc4751b5c/action => generated 24575 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 23 22:20:42.432918 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-24ae9c2e-09f7-4161-a7a4-ed5d9b9f8196 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:20:42.433890 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-24ae9c2e-09f7-4161-a7a4-ed5d9b9f8196 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 122f6fed-b23e-4ed5-a054-9d5bc4751b5c] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:20:42.436475 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:20:42.437139 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=4 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:20:42.443027 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-24ae9c2e-09f7-4161-a7a4-ed5d9b9f8196 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:20:42.443484 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-24ae9c2e-09f7-4161-a7a4-ed5d9b9f8196 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:20:42.444264 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-24ae9c2e-09f7-4161-a7a4-ed5d9b9f8196 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:20:42.444708 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-24ae9c2e-09f7-4161-a7a4-ed5d9b9f8196 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:20:42.525652 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-24ae9c2e-09f7-4161-a7a4-ed5d9b9f8196 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "POST /compute/v2.1/servers/122f6fed-b23e-4ed5-a054-9d5bc4751b5c/action" status: 202 len: 0 microversion: 2.1 time: 0.097364 Jul 23 22:20:42.526340 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3822/6432] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 22:20:42 2022] POST /compute/v2.1/servers/122f6fed-b23e-4ed5-a054-9d5bc4751b5c/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 22:20:42.534816 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-903c520b-8958-43e9-a56f-8fe3b3fd2223 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:20:42.535512 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-903c520b-8958-43e9-a56f-8fe3b3fd2223 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 122f6fed-b23e-4ed5-a054-9d5bc4751b5c] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:20:42.541776 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-903c520b-8958-43e9-a56f-8fe3b3fd2223 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:20:42.542299 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-903c520b-8958-43e9-a56f-8fe3b3fd2223 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:20:42.543148 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-903c520b-8958-43e9-a56f-8fe3b3fd2223 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:20:42.543572 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-903c520b-8958-43e9-a56f-8fe3b3fd2223 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:20:42.757328 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-903c520b-8958-43e9-a56f-8fe3b3fd2223 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:20:42.765587 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-903c520b-8958-43e9-a56f-8fe3b3fd2223 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/122f6fed-b23e-4ed5-a054-9d5bc4751b5c" status: 200 len: 1673 microversion: 2.1 time: 0.234743 Jul 23 22:20:42.766438 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3823/6433] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:20:42 2022] GET /compute/v2.1/servers/122f6fed-b23e-4ed5-a054-9d5bc4751b5c => generated 1673 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:20:43.787993 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9e76a12a-5c53-4655-acab-5f8bf0349671 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:20:43.789232 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-9e76a12a-5c53-4655-acab-5f8bf0349671 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 122f6fed-b23e-4ed5-a054-9d5bc4751b5c] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:20:43.800924 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9e76a12a-5c53-4655-acab-5f8bf0349671 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:20:43.801682 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9e76a12a-5c53-4655-acab-5f8bf0349671 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:20:43.803044 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9e76a12a-5c53-4655-acab-5f8bf0349671 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:20:43.803835 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9e76a12a-5c53-4655-acab-5f8bf0349671 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:20:44.291679 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-9e76a12a-5c53-4655-acab-5f8bf0349671 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:20:44.299500 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9e76a12a-5c53-4655-acab-5f8bf0349671 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/122f6fed-b23e-4ed5-a054-9d5bc4751b5c" status: 200 len: 1678 microversion: 2.1 time: 0.518134 Jul 23 22:20:44.300085 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3824/6434] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:20:43 2022] GET /compute/v2.1/servers/122f6fed-b23e-4ed5-a054-9d5bc4751b5c => generated 1678 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:20:45.327591 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4c34b1a0-6da5-4fc0-93bc-66bde743a8b9 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:20:45.328651 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-4c34b1a0-6da5-4fc0-93bc-66bde743a8b9 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 122f6fed-b23e-4ed5-a054-9d5bc4751b5c] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:20:45.340006 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4c34b1a0-6da5-4fc0-93bc-66bde743a8b9 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:20:45.340454 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4c34b1a0-6da5-4fc0-93bc-66bde743a8b9 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:20:45.341231 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4c34b1a0-6da5-4fc0-93bc-66bde743a8b9 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:20:45.341669 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4c34b1a0-6da5-4fc0-93bc-66bde743a8b9 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:20:45.476326 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-4c34b1a0-6da5-4fc0-93bc-66bde743a8b9 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:20:45.484233 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4c34b1a0-6da5-4fc0-93bc-66bde743a8b9 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/122f6fed-b23e-4ed5-a054-9d5bc4751b5c" status: 200 len: 1678 microversion: 2.1 time: 0.163674 Jul 23 22:20:45.484818 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3825/6435] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:20:45 2022] GET /compute/v2.1/servers/122f6fed-b23e-4ed5-a054-9d5bc4751b5c => generated 1678 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:20:46.505926 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c638f735-08fb-40a9-be09-9fcc4e0f2a43 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:20:46.507017 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c638f735-08fb-40a9-be09-9fcc4e0f2a43 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 122f6fed-b23e-4ed5-a054-9d5bc4751b5c] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:20:46.515916 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c638f735-08fb-40a9-be09-9fcc4e0f2a43 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:20:46.516362 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c638f735-08fb-40a9-be09-9fcc4e0f2a43 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:20:46.517132 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c638f735-08fb-40a9-be09-9fcc4e0f2a43 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:20:46.517567 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c638f735-08fb-40a9-be09-9fcc4e0f2a43 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:20:46.664925 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c638f735-08fb-40a9-be09-9fcc4e0f2a43 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:20:46.675668 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c638f735-08fb-40a9-be09-9fcc4e0f2a43 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/122f6fed-b23e-4ed5-a054-9d5bc4751b5c" status: 200 len: 1678 microversion: 2.1 time: 0.176341 Jul 23 22:20:46.676255 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3826/6436] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:20:46 2022] GET /compute/v2.1/servers/122f6fed-b23e-4ed5-a054-9d5bc4751b5c => generated 1678 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:20:47.693579 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6bcb407a-e050-4d5a-beb2-2de170fd25e6 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:20:47.694296 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6bcb407a-e050-4d5a-beb2-2de170fd25e6 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 122f6fed-b23e-4ed5-a054-9d5bc4751b5c] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:20:47.701892 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6bcb407a-e050-4d5a-beb2-2de170fd25e6 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:20:47.702332 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6bcb407a-e050-4d5a-beb2-2de170fd25e6 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:20:47.703472 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6bcb407a-e050-4d5a-beb2-2de170fd25e6 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:20:47.704094 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6bcb407a-e050-4d5a-beb2-2de170fd25e6 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:20:47.837612 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6bcb407a-e050-4d5a-beb2-2de170fd25e6 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:20:47.845634 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6bcb407a-e050-4d5a-beb2-2de170fd25e6 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/122f6fed-b23e-4ed5-a054-9d5bc4751b5c" status: 200 len: 1678 microversion: 2.1 time: 0.156059 Jul 23 22:20:47.846270 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3827/6437] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:20:47 2022] GET /compute/v2.1/servers/122f6fed-b23e-4ed5-a054-9d5bc4751b5c => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:20:48.863048 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d3939b6c-17c4-4a5a-9f95-2d3ade4e7e41 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:20:48.863654 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d3939b6c-17c4-4a5a-9f95-2d3ade4e7e41 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 122f6fed-b23e-4ed5-a054-9d5bc4751b5c] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:20:48.871447 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d3939b6c-17c4-4a5a-9f95-2d3ade4e7e41 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:20:48.871913 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d3939b6c-17c4-4a5a-9f95-2d3ade4e7e41 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:20:48.872756 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d3939b6c-17c4-4a5a-9f95-2d3ade4e7e41 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:20:48.873215 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d3939b6c-17c4-4a5a-9f95-2d3ade4e7e41 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:20:49.008318 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d3939b6c-17c4-4a5a-9f95-2d3ade4e7e41 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:20:49.016203 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d3939b6c-17c4-4a5a-9f95-2d3ade4e7e41 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/122f6fed-b23e-4ed5-a054-9d5bc4751b5c" status: 200 len: 1678 microversion: 2.1 time: 0.157103 Jul 23 22:20:49.016789 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3828/6438] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:20:48 2022] GET /compute/v2.1/servers/122f6fed-b23e-4ed5-a054-9d5bc4751b5c => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:20:50.038165 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ab2fb90c-62b4-4183-bc57-0799294939a3 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:20:50.039305 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ab2fb90c-62b4-4183-bc57-0799294939a3 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 122f6fed-b23e-4ed5-a054-9d5bc4751b5c] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:20:50.049100 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ab2fb90c-62b4-4183-bc57-0799294939a3 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:20:50.049633 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ab2fb90c-62b4-4183-bc57-0799294939a3 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:20:50.050559 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ab2fb90c-62b4-4183-bc57-0799294939a3 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:20:50.050988 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ab2fb90c-62b4-4183-bc57-0799294939a3 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:20:50.197547 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ab2fb90c-62b4-4183-bc57-0799294939a3 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:20:50.205389 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ab2fb90c-62b4-4183-bc57-0799294939a3 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/122f6fed-b23e-4ed5-a054-9d5bc4751b5c" status: 200 len: 1678 microversion: 2.1 time: 0.173915 Jul 23 22:20:50.205972 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3829/6439] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:20:50 2022] GET /compute/v2.1/servers/122f6fed-b23e-4ed5-a054-9d5bc4751b5c => generated 1678 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:20:51.227265 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8ccbde0d-3290-43db-a149-40a4b2aa288b tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:20:51.228358 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8ccbde0d-3290-43db-a149-40a4b2aa288b tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 122f6fed-b23e-4ed5-a054-9d5bc4751b5c] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:20:51.240407 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8ccbde0d-3290-43db-a149-40a4b2aa288b tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:20:51.241186 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8ccbde0d-3290-43db-a149-40a4b2aa288b tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:20:51.242531 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8ccbde0d-3290-43db-a149-40a4b2aa288b tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:20:51.243273 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8ccbde0d-3290-43db-a149-40a4b2aa288b tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:20:51.382896 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8ccbde0d-3290-43db-a149-40a4b2aa288b tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:20:51.391312 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8ccbde0d-3290-43db-a149-40a4b2aa288b tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/122f6fed-b23e-4ed5-a054-9d5bc4751b5c" status: 200 len: 1678 microversion: 2.1 time: 0.170846 Jul 23 22:20:51.391900 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3830/6440] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:20:51 2022] GET /compute/v2.1/servers/122f6fed-b23e-4ed5-a054-9d5bc4751b5c => generated 1678 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:20:52.409115 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b2879201-32e0-424f-9d1c-6c1afd5fadaa tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:20:52.409927 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b2879201-32e0-424f-9d1c-6c1afd5fadaa tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 122f6fed-b23e-4ed5-a054-9d5bc4751b5c] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:20:52.416810 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b2879201-32e0-424f-9d1c-6c1afd5fadaa tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:20:52.417263 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b2879201-32e0-424f-9d1c-6c1afd5fadaa tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:20:52.418055 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b2879201-32e0-424f-9d1c-6c1afd5fadaa tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:20:52.418489 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b2879201-32e0-424f-9d1c-6c1afd5fadaa tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:20:52.572735 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b2879201-32e0-424f-9d1c-6c1afd5fadaa tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:20:52.584251 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b2879201-32e0-424f-9d1c-6c1afd5fadaa tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/122f6fed-b23e-4ed5-a054-9d5bc4751b5c" status: 200 len: 1678 microversion: 2.1 time: 0.178860 Jul 23 22:20:52.585014 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3831/6441] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:20:52 2022] GET /compute/v2.1/servers/122f6fed-b23e-4ed5-a054-9d5bc4751b5c => generated 1678 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:20:53.606021 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-88d55c55-63ce-4d1a-96a9-dc077844c488 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:20:53.607049 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-88d55c55-63ce-4d1a-96a9-dc077844c488 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 122f6fed-b23e-4ed5-a054-9d5bc4751b5c] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:20:53.615381 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-88d55c55-63ce-4d1a-96a9-dc077844c488 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:20:53.615834 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-88d55c55-63ce-4d1a-96a9-dc077844c488 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:20:53.616603 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-88d55c55-63ce-4d1a-96a9-dc077844c488 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:20:53.617044 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-88d55c55-63ce-4d1a-96a9-dc077844c488 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:20:53.761131 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-88d55c55-63ce-4d1a-96a9-dc077844c488 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:20:53.769329 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-88d55c55-63ce-4d1a-96a9-dc077844c488 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/122f6fed-b23e-4ed5-a054-9d5bc4751b5c" status: 200 len: 1678 microversion: 2.1 time: 0.169991 Jul 23 22:20:53.769927 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3832/6442] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:20:53 2022] GET /compute/v2.1/servers/122f6fed-b23e-4ed5-a054-9d5bc4751b5c => generated 1678 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:20:54.787525 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-23553d51-7fe8-4dfa-b54c-d4dee0573c6c tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:20:54.788281 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-23553d51-7fe8-4dfa-b54c-d4dee0573c6c tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 122f6fed-b23e-4ed5-a054-9d5bc4751b5c] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:20:54.798385 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-23553d51-7fe8-4dfa-b54c-d4dee0573c6c tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:20:54.798984 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-23553d51-7fe8-4dfa-b54c-d4dee0573c6c tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:20:54.800091 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-23553d51-7fe8-4dfa-b54c-d4dee0573c6c tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:20:54.800701 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-23553d51-7fe8-4dfa-b54c-d4dee0573c6c tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:20:54.938143 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-23553d51-7fe8-4dfa-b54c-d4dee0573c6c tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:20:54.946727 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-23553d51-7fe8-4dfa-b54c-d4dee0573c6c tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/122f6fed-b23e-4ed5-a054-9d5bc4751b5c" status: 200 len: 1678 microversion: 2.1 time: 0.164431 Jul 23 22:20:54.947300 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3833/6443] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:20:54 2022] GET /compute/v2.1/servers/122f6fed-b23e-4ed5-a054-9d5bc4751b5c => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:20:55.967959 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e923db75-7eb0-4be7-a42b-5b6d572404d5 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:20:55.968945 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e923db75-7eb0-4be7-a42b-5b6d572404d5 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 122f6fed-b23e-4ed5-a054-9d5bc4751b5c] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:20:55.980504 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e923db75-7eb0-4be7-a42b-5b6d572404d5 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:20:55.981262 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e923db75-7eb0-4be7-a42b-5b6d572404d5 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:20:55.982576 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e923db75-7eb0-4be7-a42b-5b6d572404d5 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:20:55.983305 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e923db75-7eb0-4be7-a42b-5b6d572404d5 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:20:56.116790 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e923db75-7eb0-4be7-a42b-5b6d572404d5 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:20:56.125348 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e923db75-7eb0-4be7-a42b-5b6d572404d5 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/122f6fed-b23e-4ed5-a054-9d5bc4751b5c" status: 200 len: 1678 microversion: 2.1 time: 0.164192 Jul 23 22:20:56.126112 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3834/6444] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:20:55 2022] GET /compute/v2.1/servers/122f6fed-b23e-4ed5-a054-9d5bc4751b5c => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:20:57.145147 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-132b4c41-624a-40e3-9c41-d731c1698fd7 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:20:57.145856 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-132b4c41-624a-40e3-9c41-d731c1698fd7 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 122f6fed-b23e-4ed5-a054-9d5bc4751b5c] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:20:57.154252 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-132b4c41-624a-40e3-9c41-d731c1698fd7 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:20:57.154788 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-132b4c41-624a-40e3-9c41-d731c1698fd7 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:20:57.155699 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-132b4c41-624a-40e3-9c41-d731c1698fd7 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:20:57.156204 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-132b4c41-624a-40e3-9c41-d731c1698fd7 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:20:57.293622 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-132b4c41-624a-40e3-9c41-d731c1698fd7 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:20:57.302055 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-132b4c41-624a-40e3-9c41-d731c1698fd7 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/122f6fed-b23e-4ed5-a054-9d5bc4751b5c" status: 200 len: 1678 microversion: 2.1 time: 0.161785 Jul 23 22:20:57.302642 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3835/6445] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:20:57 2022] GET /compute/v2.1/servers/122f6fed-b23e-4ed5-a054-9d5bc4751b5c => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:20:58.324327 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c20aed58-b458-48cf-b27c-22dec16f6541 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:20:58.325364 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c20aed58-b458-48cf-b27c-22dec16f6541 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 122f6fed-b23e-4ed5-a054-9d5bc4751b5c] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:20:58.333891 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c20aed58-b458-48cf-b27c-22dec16f6541 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:20:58.334354 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c20aed58-b458-48cf-b27c-22dec16f6541 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:20:58.335124 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c20aed58-b458-48cf-b27c-22dec16f6541 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:20:58.335560 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c20aed58-b458-48cf-b27c-22dec16f6541 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:20:58.479439 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c20aed58-b458-48cf-b27c-22dec16f6541 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:20:58.487697 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c20aed58-b458-48cf-b27c-22dec16f6541 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/122f6fed-b23e-4ed5-a054-9d5bc4751b5c" status: 200 len: 1678 microversion: 2.1 time: 0.170488 Jul 23 22:20:58.488280 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3836/6446] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:20:58 2022] GET /compute/v2.1/servers/122f6fed-b23e-4ed5-a054-9d5bc4751b5c => generated 1678 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:20:59.509113 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5b6fbd95-e86d-4c84-823f-e1978f2e55b5 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:20:59.510224 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5b6fbd95-e86d-4c84-823f-e1978f2e55b5 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 122f6fed-b23e-4ed5-a054-9d5bc4751b5c] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:20:59.522514 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5b6fbd95-e86d-4c84-823f-e1978f2e55b5 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:20:59.523269 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5b6fbd95-e86d-4c84-823f-e1978f2e55b5 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:20:59.524541 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5b6fbd95-e86d-4c84-823f-e1978f2e55b5 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:20:59.525266 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5b6fbd95-e86d-4c84-823f-e1978f2e55b5 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:20:59.546375 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:20:59.664833 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5b6fbd95-e86d-4c84-823f-e1978f2e55b5 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:20:59.672837 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5b6fbd95-e86d-4c84-823f-e1978f2e55b5 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/122f6fed-b23e-4ed5-a054-9d5bc4751b5c" status: 200 len: 1681 microversion: 2.1 time: 0.170114 Jul 23 22:20:59.673908 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3837/6447] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:20:59 2022] GET /compute/v2.1/servers/122f6fed-b23e-4ed5-a054-9d5bc4751b5c => generated 1681 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:21:23.885313 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-547bfe8f-aea3-4198-ab2d-1c9963c2931e tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:21:23.886285 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-547bfe8f-aea3-4198-ab2d-1c9963c2931e tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 122f6fed-b23e-4ed5-a054-9d5bc4751b5c] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:21:23.888777 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=32 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:21:23.889433 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:21:23.895476 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-547bfe8f-aea3-4198-ab2d-1c9963c2931e tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:21:23.895922 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-547bfe8f-aea3-4198-ab2d-1c9963c2931e tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:21:23.896697 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-547bfe8f-aea3-4198-ab2d-1c9963c2931e tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:21:23.897125 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-547bfe8f-aea3-4198-ab2d-1c9963c2931e tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:21:23.954516 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-547bfe8f-aea3-4198-ab2d-1c9963c2931e tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "POST /compute/v2.1/servers/122f6fed-b23e-4ed5-a054-9d5bc4751b5c/action" status: 200 len: 69010 microversion: 2.1 time: 0.073097 Jul 23 22:21:23.955180 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3838/6448] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 22:21:23 2022] POST /compute/v2.1/servers/122f6fed-b23e-4ed5-a054-9d5bc4751b5c/action => generated 69010 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 23 22:21:31.071145 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-662fff72-5066-4247-9ebd-1c0500ceeb8b tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:21:31.072177 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-662fff72-5066-4247-9ebd-1c0500ceeb8b tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 122f6fed-b23e-4ed5-a054-9d5bc4751b5c] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:21:31.079993 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-662fff72-5066-4247-9ebd-1c0500ceeb8b tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:21:31.080436 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-662fff72-5066-4247-9ebd-1c0500ceeb8b tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:21:31.081215 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-662fff72-5066-4247-9ebd-1c0500ceeb8b tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:21:31.081657 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-662fff72-5066-4247-9ebd-1c0500ceeb8b tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:21:31.108842 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-662fff72-5066-4247-9ebd-1c0500ceeb8b tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 122f6fed-b23e-4ed5-a054-9d5bc4751b5c] Going to try to terminate instance {{(pid=131320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 22:21:31.189307 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-662fff72-5066-4247-9ebd-1c0500ceeb8b tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "DELETE /compute/v2.1/servers/122f6fed-b23e-4ed5-a054-9d5bc4751b5c" status: 204 len: 0 microversion: 2.1 time: 0.122131 Jul 23 22:21:31.189946 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3839/6449] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 22:21:31 2022] DELETE /compute/v2.1/servers/122f6fed-b23e-4ed5-a054-9d5bc4751b5c => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 22:21:31.195174 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-3f636ea3-eb89-45c6-b1f0-05c8e85abd86 req-73f02299-46a5-4793-b2b3-3ef91e67de53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "122f6fed-b23e-4ed5-a054-9d5bc4751b5c", "tag": "8c6d3b57-613f-4f1e-885a-2f96cae0f9bd"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:21:31.203889 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-3f636ea3-eb89-45c6-b1f0-05c8e85abd86 req-73f02299-46a5-4793-b2b3-3ef91e67de53 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:21:31.204416 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-3f636ea3-eb89-45c6-b1f0-05c8e85abd86 req-73f02299-46a5-4793-b2b3-3ef91e67de53 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:21:31.215632 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-3f636ea3-eb89-45c6-b1f0-05c8e85abd86 req-73f02299-46a5-4793-b2b3-3ef91e67de53 service nova] Creating event network-changed:8c6d3b57-613f-4f1e-885a-2f96cae0f9bd for instance 122f6fed-b23e-4ed5-a054-9d5bc4751b5c on nch2-master-1 Jul 23 22:21:31.220539 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-3f636ea3-eb89-45c6-b1f0-05c8e85abd86 req-73f02299-46a5-4793-b2b3-3ef91e67de53 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029186 Jul 23 22:21:31.221149 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3840/6450] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:21:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:21:31.226537 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-dc8d2c7d-0148-43d2-a323-a588512aabb0 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:21:31.227242 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-dc8d2c7d-0148-43d2-a323-a588512aabb0 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 122f6fed-b23e-4ed5-a054-9d5bc4751b5c] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:21:31.233567 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dc8d2c7d-0148-43d2-a323-a588512aabb0 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:21:31.234072 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dc8d2c7d-0148-43d2-a323-a588512aabb0 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:21:31.234852 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dc8d2c7d-0148-43d2-a323-a588512aabb0 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:21:31.235295 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dc8d2c7d-0148-43d2-a323-a588512aabb0 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:21:31.368540 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-dc8d2c7d-0148-43d2-a323-a588512aabb0 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:21:31.376575 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-dc8d2c7d-0148-43d2-a323-a588512aabb0 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/122f6fed-b23e-4ed5-a054-9d5bc4751b5c" status: 200 len: 1687 microversion: 2.1 time: 0.154285 Jul 23 22:21:31.377167 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3841/6451] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:21:31 2022] GET /compute/v2.1/servers/122f6fed-b23e-4ed5-a054-9d5bc4751b5c => generated 1687 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:21:32.394262 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-dacf960f-38f6-487d-9703-0228d3455558 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:21:32.394922 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-dacf960f-38f6-487d-9703-0228d3455558 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 122f6fed-b23e-4ed5-a054-9d5bc4751b5c] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:21:32.401835 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dacf960f-38f6-487d-9703-0228d3455558 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:21:32.402312 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dacf960f-38f6-487d-9703-0228d3455558 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:21:32.403100 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dacf960f-38f6-487d-9703-0228d3455558 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:21:32.403532 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-dacf960f-38f6-487d-9703-0228d3455558 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:21:32.558988 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-dacf960f-38f6-487d-9703-0228d3455558 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:21:32.567740 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-dacf960f-38f6-487d-9703-0228d3455558 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/122f6fed-b23e-4ed5-a054-9d5bc4751b5c" status: 200 len: 1687 microversion: 2.1 time: 0.177511 Jul 23 22:21:32.568318 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3842/6452] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:21:32 2022] GET /compute/v2.1/servers/122f6fed-b23e-4ed5-a054-9d5bc4751b5c => generated 1687 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:21:33.172080 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-c8de52dd-0506-40bf-991e-75b3cbd26e53 req-df671f9e-b3d2-4ba1-90c1-8bead30bdd87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "122f6fed-b23e-4ed5-a054-9d5bc4751b5c", "name": "network-vif-deleted", "tag": "8c6d3b57-613f-4f1e-885a-2f96cae0f9bd"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:21:33.180783 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-c8de52dd-0506-40bf-991e-75b3cbd26e53 req-df671f9e-b3d2-4ba1-90c1-8bead30bdd87 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:21:33.181240 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-c8de52dd-0506-40bf-991e-75b3cbd26e53 req-df671f9e-b3d2-4ba1-90c1-8bead30bdd87 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:21:33.192695 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-c8de52dd-0506-40bf-991e-75b3cbd26e53 req-df671f9e-b3d2-4ba1-90c1-8bead30bdd87 service nova] Creating event network-vif-deleted:8c6d3b57-613f-4f1e-885a-2f96cae0f9bd for instance 122f6fed-b23e-4ed5-a054-9d5bc4751b5c on nch2-master-1 Jul 23 22:21:33.198161 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-c8de52dd-0506-40bf-991e-75b3cbd26e53 req-df671f9e-b3d2-4ba1-90c1-8bead30bdd87 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029800 Jul 23 22:21:33.198750 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3843/6453] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:21:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 22:21:33.588855 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5955ab8b-a57f-485c-99d5-95ecd5122439 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:21:33.589590 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5955ab8b-a57f-485c-99d5-95ecd5122439 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 122f6fed-b23e-4ed5-a054-9d5bc4751b5c] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:21:33.597022 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5955ab8b-a57f-485c-99d5-95ecd5122439 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:21:33.597448 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5955ab8b-a57f-485c-99d5-95ecd5122439 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:21:33.598508 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5955ab8b-a57f-485c-99d5-95ecd5122439 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:21:33.598949 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5955ab8b-a57f-485c-99d5-95ecd5122439 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:21:33.632433 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5955ab8b-a57f-485c-99d5-95ecd5122439 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:21:33.632889 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5955ab8b-a57f-485c-99d5-95ecd5122439 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:21:33.633352 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.objects.instance [None req-5955ab8b-a57f-485c-99d5-95ecd5122439 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lazy-loading 'fault' on Instance uuid 122f6fed-b23e-4ed5-a054-9d5bc4751b5c {{(pid=131320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 22:21:33.675303 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5955ab8b-a57f-485c-99d5-95ecd5122439 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:21:33.682264 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5955ab8b-a57f-485c-99d5-95ecd5122439 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/122f6fed-b23e-4ed5-a054-9d5bc4751b5c" status: 200 len: 1356 microversion: 2.1 time: 0.098498 Jul 23 22:21:33.682873 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3844/6454] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:21:33 2022] GET /compute/v2.1/servers/122f6fed-b23e-4ed5-a054-9d5bc4751b5c => generated 1356 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:21:34.700382 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f0767a6a-afce-43bc-bf2a-20be70bd2be7 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:21:34.701091 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f0767a6a-afce-43bc-bf2a-20be70bd2be7 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 122f6fed-b23e-4ed5-a054-9d5bc4751b5c] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:21:34.708881 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f0767a6a-afce-43bc-bf2a-20be70bd2be7 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:21:34.709348 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f0767a6a-afce-43bc-bf2a-20be70bd2be7 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:21:34.710169 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f0767a6a-afce-43bc-bf2a-20be70bd2be7 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:21:34.710617 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f0767a6a-afce-43bc-bf2a-20be70bd2be7 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:21:34.727857 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-f0767a6a-afce-43bc-bf2a-20be70bd2be7 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] HTTP exception thrown: Instance 122f6fed-b23e-4ed5-a054-9d5bc4751b5c could not be found. Jul 23 22:21:34.729507 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f0767a6a-afce-43bc-bf2a-20be70bd2be7 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Request method failure captured: Jul 23 22:21:34.729507 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/122f6fed-b23e-4ed5-a054-9d5bc4751b5c HTTP/1.1 Jul 23 22:21:34.729507 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 22:21:34.729507 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 22:21:34.729507 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 22:21:34.729507 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 22:21:34.729507 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 22:21:34.729507 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 22:21:34.729507 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 22:21:34.729507 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 22:21:34.729507 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3HPJGU05HbBTEvLxfT4BhGztnBRWhLwkU8QutIkTRTvVibf-V1mkLz3byZWX90Z2v50VOJRv9MqhrAotUJSfT2hBQ8C_NuI2cZ3sL6bxRnPnmAfb7udSijYdHU5_chgf6SP2LARXnPx77YiG880S5DV74F87lCIERZhTyKn6pgRdpVQ Jul 23 22:21:34.729507 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 22:21:34.729507 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 22:21:34.729507 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 22:21:34.729507 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 22:21:34.729507 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 22:21:34.729507 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 22:21:34.729507 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: a14b865dcbd14987870351ce4e45aaac Jul 23 22:21:34.729507 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1025071309 Jul 23 22:21:34.729507 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 22:21:34.729507 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 22:21:34.729507 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a14b865dcbd14987870351ce4e45aaac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a14b865dcbd14987870351ce4e45aaac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a14b865dcbd14987870351ce4e45aaac", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a14b865dcbd14987870351ce4e45aaac"}]}] Jul 23 22:21:34.729507 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1025071309 Jul 23 22:21:34.729507 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: a14b865dcbd14987870351ce4e45aaac Jul 23 22:21:34.729507 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1025071309 Jul 23 22:21:34.729507 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-TestNetworkAdvancedServerOps-1025071309-project Jul 23 22:21:34.729507 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 22:21:34.729507 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 22:21:34.729507 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: a686380934d042b4a078eb60e9bb6712 Jul 23 22:21:34.729507 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1025071309-project Jul 23 22:21:34.729507 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 22:21:34.729507 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance 122f6fed-b23e-4ed5-a054-9d5bc4751b5c could not be found. Jul 23 22:21:34.729507 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '122f6fed-b23e-4ed5-a054-9d5bc4751b5c'} Jul 23 22:21:34.729507 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 22:21:34.729507 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:21:34.729507 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 22:21:34.729507 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 22:21:34.729507 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 22:21:34.729507 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 22:21:34.729507 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 22:21:34.729507 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 22:21:34.729507 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 22:21:34.729507 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 22:21:34.729507 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 122f6fed-b23e-4ed5-a054-9d5bc4751b5c could not be found. Jul 23 22:21:34.729507 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:21:34.729507 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:21:34.729507 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:21:34.729507 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:21:34.729507 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:21:34.729507 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:21:34.729507 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 22:21:34.729507 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 22:21:34.729507 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 22:21:34.729507 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 22:21:34.729507 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 22:21:34.729507 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 22:21:34.729507 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 22:21:34.729507 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 22:21:34.729507 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 22:21:34.729507 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 22:21:34.729507 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 122f6fed-b23e-4ed5-a054-9d5bc4751b5c could not be found. Jul 23 22:21:34.729507 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:21:34.729507 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:21:34.734080 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:21:34.734080 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:21:34.734080 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:21:34.734080 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:21:34.734080 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 22:21:34.734080 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 22:21:34.734080 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 122f6fed-b23e-4ed5-a054-9d5bc4751b5c could not be found. Jul 23 22:21:34.734080 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:21:34.734080 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f0767a6a-afce-43bc-bf2a-20be70bd2be7 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Returning 404 to user: Instance 122f6fed-b23e-4ed5-a054-9d5bc4751b5c could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 22:21:34.734080 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f0767a6a-afce-43bc-bf2a-20be70bd2be7 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/122f6fed-b23e-4ed5-a054-9d5bc4751b5c" status: 404 len: 111 microversion: 2.1 time: 0.034911 Jul 23 22:21:34.734080 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3845/6455] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:21:34 2022] GET /compute/v2.1/servers/122f6fed-b23e-4ed5-a054-9d5bc4751b5c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 22:21:38.328367 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-97b0ee0b-f38d-4473-a428-270e71da0f3f tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '.version_select at 0x7f0b4645e0d0>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:21:38.365932 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-97b0ee0b-f38d-4473-a428-270e71da0f3f tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-157725703" status: 202 len: 0 microversion: 2.1 time: 0.046596 Jul 23 22:21:38.366886 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3846/6456] 10.222.0.17 () {58 vars in 1280 bytes} [Sat Jul 23 22:21:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-157725703 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 22:21:38.396843 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-bcd47601-f9be-4928-a2a1-55300ea800cd tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Action: 'create', calling method: .version_select at 0x7f0b464634c0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1031106255", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBME8qYkD35fOj66qzrPMTUTaRk1fera/MOhI6+f90jPu4vg18yfpatOB1KVDJlMTuqyGe0+OaIGkPJkuEFuPOtcOVAZgOZgWwAWyGpZCQgaijaunAtnl0531ihEIxooPFg=="}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:21:38.414191 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-bcd47601-f9be-4928-a2a1-55300ea800cd tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Getting quotas for project a14b865dcbd14987870351ce4e45aaac. Resources: {'key_pairs'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 22:21:38.419520 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-bcd47601-f9be-4928-a2a1-55300ea800cd tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Getting quotas for user a686380934d042b4a078eb60e9bb6712 and project a14b865dcbd14987870351ce4e45aaac. Resources: {'key_pairs'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 22:21:38.443233 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-bcd47601-f9be-4928-a2a1-55300ea800cd tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.050779 Jul 23 22:21:38.444158 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3847/6457] 10.222.0.17 () {60 vars in 1158 bytes} [Sat Jul 23 22:21:38 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:21:43.762179 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-bd21f85c-7476-4169-933e-4a720a66164f tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-113077287", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "networks": [{"uuid": "eabf7752-79bf-405a-a082-f4facb53465b"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1031106255", "security_groups": [{"name": "tempest-secgroup-smoke-2071751157"}]}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:21:44.041445 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-bd21f85c-7476-4169-933e-4a720a66164f tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] validate_networks() for [('eabf7752-79bf-405a-a082-f4facb53465b', None, None, None, None, None)] {{(pid=131320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 22:21:44.715326 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:21:44.932519 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-bd21f85c-7476-4169-933e-4a720a66164f tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 22:21:44.933090 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-bd21f85c-7476-4169-933e-4a720a66164f tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 22:21:44.933590 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-bd21f85c-7476-4169-933e-4a720a66164f tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 22:21:44.934198 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-bd21f85c-7476-4169-933e-4a720a66164f tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 22:21:44.934761 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-bd21f85c-7476-4169-933e-4a720a66164f tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 22:21:44.948235 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bd21f85c-7476-4169-933e-4a720a66164f tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:21:44.948916 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bd21f85c-7476-4169-933e-4a720a66164f tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:21:44.949898 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bd21f85c-7476-4169-933e-4a720a66164f tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:21:44.950493 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bd21f85c-7476-4169-933e-4a720a66164f tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:21:44.969447 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-bd21f85c-7476-4169-933e-4a720a66164f tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Getting quotas for project a14b865dcbd14987870351ce4e45aaac. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 22:21:44.975232 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-bd21f85c-7476-4169-933e-4a720a66164f tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Getting quotas for user a686380934d042b4a078eb60e9bb6712 and project a14b865dcbd14987870351ce4e45aaac. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 22:21:44.997515 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-bd21f85c-7476-4169-933e-4a720a66164f tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Going to run 1 instances... {{(pid=131320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 22:21:45.002112 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-bd21f85c-7476-4169-933e-4a720a66164f tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 00332b3c-7fac-48af-a9ee-b6af2624773b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 22:21:45.065744 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-bd21f85c-7476-4169-933e-4a720a66164f tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.309832 Jul 23 22:21:45.066654 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3848/6458] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 22:21:43 2022] POST /compute/v2.1/servers => generated 406 bytes in 1312 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 23 22:21:45.077213 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-92b28bfa-ac25-432b-99b5-9187622b01c6 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:21:45.077826 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-92b28bfa-ac25-432b-99b5-9187622b01c6 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 00332b3c-7fac-48af-a9ee-b6af2624773b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:21:45.144530 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-92b28bfa-ac25-432b-99b5-9187622b01c6 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:21:45.152031 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-92b28bfa-ac25-432b-99b5-9187622b01c6 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/00332b3c-7fac-48af-a9ee-b6af2624773b" status: 200 len: 1266 microversion: 2.1 time: 0.078537 Jul 23 22:21:45.152748 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3849/6459] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:21:45 2022] GET /compute/v2.1/servers/00332b3c-7fac-48af-a9ee-b6af2624773b => generated 1266 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:21:46.170366 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f241801a-7481-4878-8be1-ebf36e367dc9 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:21:46.171091 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f241801a-7481-4878-8be1-ebf36e367dc9 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 00332b3c-7fac-48af-a9ee-b6af2624773b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:21:46.260799 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f241801a-7481-4878-8be1-ebf36e367dc9 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:21:46.268150 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f241801a-7481-4878-8be1-ebf36e367dc9 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/00332b3c-7fac-48af-a9ee-b6af2624773b" status: 200 len: 1266 microversion: 2.1 time: 0.102117 Jul 23 22:21:46.268820 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3850/6460] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:21:46 2022] GET /compute/v2.1/servers/00332b3c-7fac-48af-a9ee-b6af2624773b => generated 1266 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:21:47.285010 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a5d8a4ff-1c37-470d-a4ae-59fcb59578d4 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:21:47.285590 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a5d8a4ff-1c37-470d-a4ae-59fcb59578d4 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 00332b3c-7fac-48af-a9ee-b6af2624773b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:21:47.343956 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a5d8a4ff-1c37-470d-a4ae-59fcb59578d4 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:21:47.350975 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a5d8a4ff-1c37-470d-a4ae-59fcb59578d4 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/00332b3c-7fac-48af-a9ee-b6af2624773b" status: 200 len: 1266 microversion: 2.1 time: 0.069872 Jul 23 22:21:47.351550 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3851/6461] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:21:47 2022] GET /compute/v2.1/servers/00332b3c-7fac-48af-a9ee-b6af2624773b => generated 1266 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:21:48.367689 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-03962685-431b-4d90-9f1a-ab77a3bcdf41 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:21:48.368382 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-03962685-431b-4d90-9f1a-ab77a3bcdf41 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 00332b3c-7fac-48af-a9ee-b6af2624773b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:21:48.422354 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-03962685-431b-4d90-9f1a-ab77a3bcdf41 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:21:48.429584 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-03962685-431b-4d90-9f1a-ab77a3bcdf41 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/00332b3c-7fac-48af-a9ee-b6af2624773b" status: 200 len: 1266 microversion: 2.1 time: 0.065809 Jul 23 22:21:48.430225 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3852/6462] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:21:48 2022] GET /compute/v2.1/servers/00332b3c-7fac-48af-a9ee-b6af2624773b => generated 1266 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:21:49.451616 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-eb8ba8cc-8ddc-4287-ab97-981811c3d5ee tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:21:49.452669 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-eb8ba8cc-8ddc-4287-ab97-981811c3d5ee tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 00332b3c-7fac-48af-a9ee-b6af2624773b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:21:49.460095 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-eb8ba8cc-8ddc-4287-ab97-981811c3d5ee tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:21:49.460550 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-eb8ba8cc-8ddc-4287-ab97-981811c3d5ee tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:21:49.461325 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-eb8ba8cc-8ddc-4287-ab97-981811c3d5ee tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:21:49.461768 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-eb8ba8cc-8ddc-4287-ab97-981811c3d5ee tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:21:49.525426 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-eb8ba8cc-8ddc-4287-ab97-981811c3d5ee tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:21:49.533196 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-eb8ba8cc-8ddc-4287-ab97-981811c3d5ee tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/00332b3c-7fac-48af-a9ee-b6af2624773b" status: 200 len: 1270 microversion: 2.1 time: 0.088729 Jul 23 22:21:49.533780 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3853/6463] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:21:49 2022] GET /compute/v2.1/servers/00332b3c-7fac-48af-a9ee-b6af2624773b => generated 1270 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:21:50.549794 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-bc00554e-df3b-48f1-98ff-9d5240fb5471 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:21:50.550508 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-bc00554e-df3b-48f1-98ff-9d5240fb5471 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 00332b3c-7fac-48af-a9ee-b6af2624773b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:21:50.557784 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bc00554e-df3b-48f1-98ff-9d5240fb5471 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:21:50.558664 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bc00554e-df3b-48f1-98ff-9d5240fb5471 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:21:50.559298 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bc00554e-df3b-48f1-98ff-9d5240fb5471 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:21:50.559735 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bc00554e-df3b-48f1-98ff-9d5240fb5471 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:21:50.622225 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-bc00554e-df3b-48f1-98ff-9d5240fb5471 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:21:50.629990 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-bc00554e-df3b-48f1-98ff-9d5240fb5471 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/00332b3c-7fac-48af-a9ee-b6af2624773b" status: 200 len: 1324 microversion: 2.1 time: 0.084204 Jul 23 22:21:50.630812 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3854/6464] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:21:50 2022] GET /compute/v2.1/servers/00332b3c-7fac-48af-a9ee-b6af2624773b => generated 1324 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:21:51.629575 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-0c5dcee5-6157-43f4-8b8f-31e6c898ca68 req-f81b5a86-2d1a-4b03-8a55-a3a3f1c7ed9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00332b3c-7fac-48af-a9ee-b6af2624773b", "tag": "8319545d-8b82-48b0-a564-7355654d0404"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:21:51.642188 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-0c5dcee5-6157-43f4-8b8f-31e6c898ca68 req-f81b5a86-2d1a-4b03-8a55-a3a3f1c7ed9c service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:21:51.642841 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-0c5dcee5-6157-43f4-8b8f-31e6c898ca68 req-f81b5a86-2d1a-4b03-8a55-a3a3f1c7ed9c service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:21:51.656125 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-0c5dcee5-6157-43f4-8b8f-31e6c898ca68 req-f81b5a86-2d1a-4b03-8a55-a3a3f1c7ed9c service nova] Creating event network-changed:8319545d-8b82-48b0-a564-7355654d0404 for instance 00332b3c-7fac-48af-a9ee-b6af2624773b on nch1-master-1 Jul 23 22:21:51.675668 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-0c5dcee5-6157-43f4-8b8f-31e6c898ca68 req-f81b5a86-2d1a-4b03-8a55-a3a3f1c7ed9c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050505 Jul 23 22:21:51.676384 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3855/6465] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:21:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 22:21:51.681781 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-346e6dce-a21c-4861-8ccf-a3f93508fe27 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:21:51.682794 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-346e6dce-a21c-4861-8ccf-a3f93508fe27 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 00332b3c-7fac-48af-a9ee-b6af2624773b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:21:51.690143 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-346e6dce-a21c-4861-8ccf-a3f93508fe27 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:21:51.690860 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-346e6dce-a21c-4861-8ccf-a3f93508fe27 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:21:51.691719 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-346e6dce-a21c-4861-8ccf-a3f93508fe27 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:21:51.692236 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-346e6dce-a21c-4861-8ccf-a3f93508fe27 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:21:51.836163 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-346e6dce-a21c-4861-8ccf-a3f93508fe27 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:21:51.844063 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-346e6dce-a21c-4861-8ccf-a3f93508fe27 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/00332b3c-7fac-48af-a9ee-b6af2624773b" status: 200 len: 1392 microversion: 2.1 time: 0.166324 Jul 23 22:21:51.844726 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3856/6466] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:21:51 2022] GET /compute/v2.1/servers/00332b3c-7fac-48af-a9ee-b6af2624773b => generated 1392 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:21:52.861675 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-77437d8f-54d4-46fb-9e04-a39f558a08e6 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:21:52.862311 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-77437d8f-54d4-46fb-9e04-a39f558a08e6 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 00332b3c-7fac-48af-a9ee-b6af2624773b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:21:52.869787 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-77437d8f-54d4-46fb-9e04-a39f558a08e6 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:21:52.870342 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-77437d8f-54d4-46fb-9e04-a39f558a08e6 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:21:52.871130 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-77437d8f-54d4-46fb-9e04-a39f558a08e6 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:21:52.871571 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-77437d8f-54d4-46fb-9e04-a39f558a08e6 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:21:53.018110 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-77437d8f-54d4-46fb-9e04-a39f558a08e6 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:21:53.025823 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-77437d8f-54d4-46fb-9e04-a39f558a08e6 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/00332b3c-7fac-48af-a9ee-b6af2624773b" status: 200 len: 1392 microversion: 2.1 time: 0.168154 Jul 23 22:21:53.026419 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3857/6467] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:21:52 2022] GET /compute/v2.1/servers/00332b3c-7fac-48af-a9ee-b6af2624773b => generated 1392 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:21:54.043936 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-548a2bee-c954-4f74-bdc4-26b5081d3b51 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:21:54.044583 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-548a2bee-c954-4f74-bdc4-26b5081d3b51 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 00332b3c-7fac-48af-a9ee-b6af2624773b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:21:54.047458 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:21:54.053773 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-548a2bee-c954-4f74-bdc4-26b5081d3b51 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:21:54.054273 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-548a2bee-c954-4f74-bdc4-26b5081d3b51 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:21:54.055056 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-548a2bee-c954-4f74-bdc4-26b5081d3b51 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:21:54.055499 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-548a2bee-c954-4f74-bdc4-26b5081d3b51 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:21:54.192507 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-548a2bee-c954-4f74-bdc4-26b5081d3b51 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:21:54.200791 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-548a2bee-c954-4f74-bdc4-26b5081d3b51 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/00332b3c-7fac-48af-a9ee-b6af2624773b" status: 200 len: 1392 microversion: 2.1 time: 0.160861 Jul 23 22:21:54.201384 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3858/6468] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:21:54 2022] GET /compute/v2.1/servers/00332b3c-7fac-48af-a9ee-b6af2624773b => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:21:55.218436 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-cde66dfc-f875-4bfc-9fd1-4232afa47d81 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:21:55.219110 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-cde66dfc-f875-4bfc-9fd1-4232afa47d81 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 00332b3c-7fac-48af-a9ee-b6af2624773b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:21:55.220985 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:21:55.228659 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cde66dfc-f875-4bfc-9fd1-4232afa47d81 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:21:55.229116 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cde66dfc-f875-4bfc-9fd1-4232afa47d81 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:21:55.229902 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cde66dfc-f875-4bfc-9fd1-4232afa47d81 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:21:55.230379 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cde66dfc-f875-4bfc-9fd1-4232afa47d81 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:21:55.366897 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-cde66dfc-f875-4bfc-9fd1-4232afa47d81 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:21:55.378372 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-cde66dfc-f875-4bfc-9fd1-4232afa47d81 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/00332b3c-7fac-48af-a9ee-b6af2624773b" status: 200 len: 1392 microversion: 2.1 time: 0.163560 Jul 23 22:21:55.379162 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3859/6469] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:21:55 2022] GET /compute/v2.1/servers/00332b3c-7fac-48af-a9ee-b6af2624773b => generated 1392 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:21:56.401038 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5bd368b0-01ef-445b-be12-702834507b88 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:21:56.401735 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5bd368b0-01ef-445b-be12-702834507b88 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 00332b3c-7fac-48af-a9ee-b6af2624773b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:21:56.409183 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5bd368b0-01ef-445b-be12-702834507b88 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:21:56.409824 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5bd368b0-01ef-445b-be12-702834507b88 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:21:56.410576 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5bd368b0-01ef-445b-be12-702834507b88 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:21:56.411070 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5bd368b0-01ef-445b-be12-702834507b88 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:21:56.553114 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5bd368b0-01ef-445b-be12-702834507b88 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:21:56.560844 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5bd368b0-01ef-445b-be12-702834507b88 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/00332b3c-7fac-48af-a9ee-b6af2624773b" status: 200 len: 1392 microversion: 2.1 time: 0.163860 Jul 23 22:21:56.561439 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3860/6470] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:21:56 2022] GET /compute/v2.1/servers/00332b3c-7fac-48af-a9ee-b6af2624773b => generated 1392 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:21:56.716588 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-3b663d1a-12a0-4e7a-b0f6-b0795b423bbc req-030334db-97c0-4ee3-82ea-253a18df034a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00332b3c-7fac-48af-a9ee-b6af2624773b", "name": "network-vif-plugged", "status": "completed", "tag": "8319545d-8b82-48b0-a564-7355654d0404"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:21:56.725185 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-3b663d1a-12a0-4e7a-b0f6-b0795b423bbc req-030334db-97c0-4ee3-82ea-253a18df034a service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:21:56.725501 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-3b663d1a-12a0-4e7a-b0f6-b0795b423bbc req-030334db-97c0-4ee3-82ea-253a18df034a service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:21:56.736878 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-3b663d1a-12a0-4e7a-b0f6-b0795b423bbc req-030334db-97c0-4ee3-82ea-253a18df034a service nova] Creating event network-vif-plugged:8319545d-8b82-48b0-a564-7355654d0404 for instance 00332b3c-7fac-48af-a9ee-b6af2624773b on nch1-master-1 Jul 23 22:21:56.742088 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-3b663d1a-12a0-4e7a-b0f6-b0795b423bbc req-030334db-97c0-4ee3-82ea-253a18df034a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029273 Jul 23 22:21:56.742868 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3861/6471] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:21:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:21:57.584505 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-51aa4f3c-40c5-4d51-8896-e654e028f283 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:21:57.585322 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-51aa4f3c-40c5-4d51-8896-e654e028f283 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 00332b3c-7fac-48af-a9ee-b6af2624773b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:21:57.593931 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-51aa4f3c-40c5-4d51-8896-e654e028f283 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:21:57.594433 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-51aa4f3c-40c5-4d51-8896-e654e028f283 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:21:57.595396 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-51aa4f3c-40c5-4d51-8896-e654e028f283 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:21:57.595975 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-51aa4f3c-40c5-4d51-8896-e654e028f283 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:21:57.735129 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-51aa4f3c-40c5-4d51-8896-e654e028f283 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:21:57.747544 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-51aa4f3c-40c5-4d51-8896-e654e028f283 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/00332b3c-7fac-48af-a9ee-b6af2624773b" status: 200 len: 1392 microversion: 2.1 time: 0.170873 Jul 23 22:21:57.748337 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3862/6472] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:21:57 2022] GET /compute/v2.1/servers/00332b3c-7fac-48af-a9ee-b6af2624773b => generated 1392 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:21:58.769116 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e7714d5f-9213-4105-abbc-9f7bcb74f9fe tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:21:58.770172 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e7714d5f-9213-4105-abbc-9f7bcb74f9fe tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 00332b3c-7fac-48af-a9ee-b6af2624773b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:21:58.773323 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=18 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:21:58.785899 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e7714d5f-9213-4105-abbc-9f7bcb74f9fe tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:21:58.786372 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e7714d5f-9213-4105-abbc-9f7bcb74f9fe tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:21:58.787158 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e7714d5f-9213-4105-abbc-9f7bcb74f9fe tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:21:58.787639 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e7714d5f-9213-4105-abbc-9f7bcb74f9fe tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:21:58.931535 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e7714d5f-9213-4105-abbc-9f7bcb74f9fe tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:21:58.939711 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e7714d5f-9213-4105-abbc-9f7bcb74f9fe tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/00332b3c-7fac-48af-a9ee-b6af2624773b" status: 200 len: 1564 microversion: 2.1 time: 0.177479 Jul 23 22:21:58.940300 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3863/6473] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:21:58 2022] GET /compute/v2.1/servers/00332b3c-7fac-48af-a9ee-b6af2624773b => generated 1564 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:21:58.955904 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d457379e-ec6a-4a02-b5c7-85c74fb6a48b tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:21:58.956506 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d457379e-ec6a-4a02-b5c7-85c74fb6a48b tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 00332b3c-7fac-48af-a9ee-b6af2624773b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:21:58.962946 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d457379e-ec6a-4a02-b5c7-85c74fb6a48b tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:21:58.963404 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d457379e-ec6a-4a02-b5c7-85c74fb6a48b tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:21:58.964225 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d457379e-ec6a-4a02-b5c7-85c74fb6a48b tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:21:58.964659 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d457379e-ec6a-4a02-b5c7-85c74fb6a48b tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:21:59.105041 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d457379e-ec6a-4a02-b5c7-85c74fb6a48b tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:21:59.113591 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d457379e-ec6a-4a02-b5c7-85c74fb6a48b tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/00332b3c-7fac-48af-a9ee-b6af2624773b" status: 200 len: 1564 microversion: 2.1 time: 0.160807 Jul 23 22:21:59.114411 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3864/6474] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:21:58 2022] GET /compute/v2.1/servers/00332b3c-7fac-48af-a9ee-b6af2624773b => generated 1564 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:22:00.799884 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c3a777ff-0b52-48ab-9e66-5e5dcee98e66 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:22:00.800531 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c3a777ff-0b52-48ab-9e66-5e5dcee98e66 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 00332b3c-7fac-48af-a9ee-b6af2624773b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:22:00.807742 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c3a777ff-0b52-48ab-9e66-5e5dcee98e66 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:22:00.808197 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c3a777ff-0b52-48ab-9e66-5e5dcee98e66 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:22:00.809080 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c3a777ff-0b52-48ab-9e66-5e5dcee98e66 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:22:00.809494 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c3a777ff-0b52-48ab-9e66-5e5dcee98e66 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:22:00.944258 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c3a777ff-0b52-48ab-9e66-5e5dcee98e66 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:22:00.952677 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c3a777ff-0b52-48ab-9e66-5e5dcee98e66 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/00332b3c-7fac-48af-a9ee-b6af2624773b" status: 200 len: 1564 microversion: 2.1 time: 0.157249 Jul 23 22:22:00.953260 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3865/6475] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:22:00 2022] GET /compute/v2.1/servers/00332b3c-7fac-48af-a9ee-b6af2624773b => generated 1564 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:22:00.958077 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-2371d62e-9232-4a92-83ee-828f6486fe3e req-b44be408-9863-426a-a27a-655eedcaec59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00332b3c-7fac-48af-a9ee-b6af2624773b", "tag": "8319545d-8b82-48b0-a564-7355654d0404"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:22:00.966582 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-2371d62e-9232-4a92-83ee-828f6486fe3e req-b44be408-9863-426a-a27a-655eedcaec59 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:22:00.967034 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-2371d62e-9232-4a92-83ee-828f6486fe3e req-b44be408-9863-426a-a27a-655eedcaec59 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:22:00.978705 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-2371d62e-9232-4a92-83ee-828f6486fe3e req-b44be408-9863-426a-a27a-655eedcaec59 service nova] Creating event network-changed:8319545d-8b82-48b0-a564-7355654d0404 for instance 00332b3c-7fac-48af-a9ee-b6af2624773b on nch1-master-1 Jul 23 22:22:00.983853 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-2371d62e-9232-4a92-83ee-828f6486fe3e req-b44be408-9863-426a-a27a-655eedcaec59 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029505 Jul 23 22:22:00.984771 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3866/6476] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:22:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:22:22.226219 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-315add96-c8d3-454f-ba71-a6be8fe934e3 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:22:22.227378 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-315add96-c8d3-454f-ba71-a6be8fe934e3 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 00332b3c-7fac-48af-a9ee-b6af2624773b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:22:22.230398 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=17 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:22:22.231056 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=74 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:22:22.237218 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-315add96-c8d3-454f-ba71-a6be8fe934e3 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:22:22.237672 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-315add96-c8d3-454f-ba71-a6be8fe934e3 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:22:22.238484 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-315add96-c8d3-454f-ba71-a6be8fe934e3 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:22:22.238911 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-315add96-c8d3-454f-ba71-a6be8fe934e3 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:22:22.302518 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-315add96-c8d3-454f-ba71-a6be8fe934e3 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "POST /compute/v2.1/servers/00332b3c-7fac-48af-a9ee-b6af2624773b/action" status: 200 len: 24570 microversion: 2.1 time: 0.080505 Jul 23 22:22:22.303145 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3867/6477] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 22:22:22 2022] POST /compute/v2.1/servers/00332b3c-7fac-48af-a9ee-b6af2624773b/action => generated 24570 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 23 22:22:33.368157 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-cdc3cc13-47a5-4a26-970f-b9217fa14cd9 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:22:33.369239 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-cdc3cc13-47a5-4a26-970f-b9217fa14cd9 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 00332b3c-7fac-48af-a9ee-b6af2624773b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:22:33.372324 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:22:33.372985 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=4 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:22:33.379952 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cdc3cc13-47a5-4a26-970f-b9217fa14cd9 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:22:33.380419 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cdc3cc13-47a5-4a26-970f-b9217fa14cd9 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:22:33.381266 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cdc3cc13-47a5-4a26-970f-b9217fa14cd9 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:22:33.381714 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cdc3cc13-47a5-4a26-970f-b9217fa14cd9 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:22:33.422936 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-cdc3cc13-47a5-4a26-970f-b9217fa14cd9 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:22:33.429475 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-cdc3cc13-47a5-4a26-970f-b9217fa14cd9 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 00332b3c-7fac-48af-a9ee-b6af2624773b] Old instance type m1.heat2, new instance type m1.heat {{(pid=131320) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 23 22:22:33.435833 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-cdc3cc13-47a5-4a26-970f-b9217fa14cd9 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 22:22:33.436257 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-cdc3cc13-47a5-4a26-970f-b9217fa14cd9 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 22:22:33.436821 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-cdc3cc13-47a5-4a26-970f-b9217fa14cd9 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 22:22:33.437247 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-cdc3cc13-47a5-4a26-970f-b9217fa14cd9 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 22:22:33.437663 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-cdc3cc13-47a5-4a26-970f-b9217fa14cd9 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 22:22:33.504480 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-cdc3cc13-47a5-4a26-970f-b9217fa14cd9 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "POST /compute/v2.1/servers/00332b3c-7fac-48af-a9ee-b6af2624773b/action" status: 202 len: 0 microversion: 2.1 time: 0.140750 Jul 23 22:22:33.508497 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3868/6478] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 22:22:33 2022] POST /compute/v2.1/servers/00332b3c-7fac-48af-a9ee-b6af2624773b/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 22:22:33.513376 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0de98fb2-3194-42a3-96f6-f886f77690f6 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:22:33.514144 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-0de98fb2-3194-42a3-96f6-f886f77690f6 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 00332b3c-7fac-48af-a9ee-b6af2624773b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:22:33.522246 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0de98fb2-3194-42a3-96f6-f886f77690f6 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:22:33.522703 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0de98fb2-3194-42a3-96f6-f886f77690f6 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:22:33.523452 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0de98fb2-3194-42a3-96f6-f886f77690f6 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:22:33.523891 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0de98fb2-3194-42a3-96f6-f886f77690f6 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:22:33.672233 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-0de98fb2-3194-42a3-96f6-f886f77690f6 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:22:33.680004 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-0de98fb2-3194-42a3-96f6-f886f77690f6 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/00332b3c-7fac-48af-a9ee-b6af2624773b" status: 200 len: 1692 microversion: 2.1 time: 0.170475 Jul 23 22:22:33.680792 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3869/6479] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:22:33 2022] GET /compute/v2.1/servers/00332b3c-7fac-48af-a9ee-b6af2624773b => generated 1692 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:22:34.698615 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-52b5d77b-75a1-4652-a9c5-e5898cbcfe7c tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:22:34.699267 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-52b5d77b-75a1-4652-a9c5-e5898cbcfe7c tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 00332b3c-7fac-48af-a9ee-b6af2624773b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:22:34.706727 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-52b5d77b-75a1-4652-a9c5-e5898cbcfe7c tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:22:34.707174 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-52b5d77b-75a1-4652-a9c5-e5898cbcfe7c tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:22:34.707949 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-52b5d77b-75a1-4652-a9c5-e5898cbcfe7c tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:22:34.708426 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-52b5d77b-75a1-4652-a9c5-e5898cbcfe7c tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:22:34.846196 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-52b5d77b-75a1-4652-a9c5-e5898cbcfe7c tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:22:34.853951 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-52b5d77b-75a1-4652-a9c5-e5898cbcfe7c tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/00332b3c-7fac-48af-a9ee-b6af2624773b" status: 200 len: 1692 microversion: 2.1 time: 0.159885 Jul 23 22:22:34.854534 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3870/6480] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:22:34 2022] GET /compute/v2.1/servers/00332b3c-7fac-48af-a9ee-b6af2624773b => generated 1692 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:22:35.871902 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-573a87ec-3edc-49b9-9ad0-15a9af5155c4 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:22:35.872650 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-573a87ec-3edc-49b9-9ad0-15a9af5155c4 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 00332b3c-7fac-48af-a9ee-b6af2624773b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:22:35.880164 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-573a87ec-3edc-49b9-9ad0-15a9af5155c4 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:22:35.880667 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-573a87ec-3edc-49b9-9ad0-15a9af5155c4 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:22:35.881410 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-573a87ec-3edc-49b9-9ad0-15a9af5155c4 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:22:35.881895 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-573a87ec-3edc-49b9-9ad0-15a9af5155c4 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:22:36.023993 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-573a87ec-3edc-49b9-9ad0-15a9af5155c4 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:22:36.031832 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-573a87ec-3edc-49b9-9ad0-15a9af5155c4 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/00332b3c-7fac-48af-a9ee-b6af2624773b" status: 200 len: 1697 microversion: 2.1 time: 0.163916 Jul 23 22:22:36.032414 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3871/6481] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:22:35 2022] GET /compute/v2.1/servers/00332b3c-7fac-48af-a9ee-b6af2624773b => generated 1697 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:22:37.054025 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8173196f-5cc9-45c2-aae4-7d1411ca6042 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:22:37.055072 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8173196f-5cc9-45c2-aae4-7d1411ca6042 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 00332b3c-7fac-48af-a9ee-b6af2624773b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:22:37.066705 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8173196f-5cc9-45c2-aae4-7d1411ca6042 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:22:37.067512 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8173196f-5cc9-45c2-aae4-7d1411ca6042 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:22:37.068793 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8173196f-5cc9-45c2-aae4-7d1411ca6042 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:22:37.069531 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8173196f-5cc9-45c2-aae4-7d1411ca6042 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:22:37.212467 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8173196f-5cc9-45c2-aae4-7d1411ca6042 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:22:37.220332 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8173196f-5cc9-45c2-aae4-7d1411ca6042 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/00332b3c-7fac-48af-a9ee-b6af2624773b" status: 200 len: 1697 microversion: 2.1 time: 0.172825 Jul 23 22:22:37.220885 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3872/6482] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:22:37 2022] GET /compute/v2.1/servers/00332b3c-7fac-48af-a9ee-b6af2624773b => generated 1697 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:22:38.243508 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4b24afb9-ddd1-47d6-99a5-2ab9795fc8f2 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:22:38.244536 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-4b24afb9-ddd1-47d6-99a5-2ab9795fc8f2 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 00332b3c-7fac-48af-a9ee-b6af2624773b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:22:38.253782 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4b24afb9-ddd1-47d6-99a5-2ab9795fc8f2 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:22:38.254272 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4b24afb9-ddd1-47d6-99a5-2ab9795fc8f2 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:22:38.255056 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4b24afb9-ddd1-47d6-99a5-2ab9795fc8f2 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:22:38.255501 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4b24afb9-ddd1-47d6-99a5-2ab9795fc8f2 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:22:38.401664 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-4b24afb9-ddd1-47d6-99a5-2ab9795fc8f2 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:22:38.409429 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4b24afb9-ddd1-47d6-99a5-2ab9795fc8f2 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/00332b3c-7fac-48af-a9ee-b6af2624773b" status: 200 len: 1697 microversion: 2.1 time: 0.172751 Jul 23 22:22:38.410073 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3873/6483] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:22:38 2022] GET /compute/v2.1/servers/00332b3c-7fac-48af-a9ee-b6af2624773b => generated 1697 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:22:39.434546 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ae3e2ae4-73d1-4eea-a72e-7e60ce29e317 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:22:39.435665 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ae3e2ae4-73d1-4eea-a72e-7e60ce29e317 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 00332b3c-7fac-48af-a9ee-b6af2624773b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:22:39.443605 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ae3e2ae4-73d1-4eea-a72e-7e60ce29e317 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:22:39.444094 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ae3e2ae4-73d1-4eea-a72e-7e60ce29e317 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:22:39.444856 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ae3e2ae4-73d1-4eea-a72e-7e60ce29e317 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:22:39.445292 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ae3e2ae4-73d1-4eea-a72e-7e60ce29e317 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:22:39.580133 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ae3e2ae4-73d1-4eea-a72e-7e60ce29e317 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:22:39.587830 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ae3e2ae4-73d1-4eea-a72e-7e60ce29e317 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/00332b3c-7fac-48af-a9ee-b6af2624773b" status: 200 len: 1697 microversion: 2.1 time: 0.160033 Jul 23 22:22:39.588408 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3874/6484] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:22:39 2022] GET /compute/v2.1/servers/00332b3c-7fac-48af-a9ee-b6af2624773b => generated 1697 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:22:40.609424 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ecc25013-4001-4515-ab84-1d1bd6e49ded tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:22:40.610271 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ecc25013-4001-4515-ab84-1d1bd6e49ded tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 00332b3c-7fac-48af-a9ee-b6af2624773b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:22:40.618793 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ecc25013-4001-4515-ab84-1d1bd6e49ded tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:22:40.619351 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ecc25013-4001-4515-ab84-1d1bd6e49ded tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:22:40.620245 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ecc25013-4001-4515-ab84-1d1bd6e49ded tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:22:40.620757 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ecc25013-4001-4515-ab84-1d1bd6e49ded tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:22:40.756606 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ecc25013-4001-4515-ab84-1d1bd6e49ded tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:22:40.764250 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ecc25013-4001-4515-ab84-1d1bd6e49ded tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/00332b3c-7fac-48af-a9ee-b6af2624773b" status: 200 len: 1697 microversion: 2.1 time: 0.161345 Jul 23 22:22:40.764881 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3875/6485] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:22:40 2022] GET /compute/v2.1/servers/00332b3c-7fac-48af-a9ee-b6af2624773b => generated 1697 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:22:41.782541 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1f9eb9f5-d44d-4c4c-a6a8-c99db5fcbf8f tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:22:41.783261 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1f9eb9f5-d44d-4c4c-a6a8-c99db5fcbf8f tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 00332b3c-7fac-48af-a9ee-b6af2624773b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:22:41.790685 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1f9eb9f5-d44d-4c4c-a6a8-c99db5fcbf8f tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:22:41.791143 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1f9eb9f5-d44d-4c4c-a6a8-c99db5fcbf8f tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:22:41.791914 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1f9eb9f5-d44d-4c4c-a6a8-c99db5fcbf8f tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:22:41.792363 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1f9eb9f5-d44d-4c4c-a6a8-c99db5fcbf8f tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:22:42.211294 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-1f9eb9f5-d44d-4c4c-a6a8-c99db5fcbf8f tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:22:42.219700 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1f9eb9f5-d44d-4c4c-a6a8-c99db5fcbf8f tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/00332b3c-7fac-48af-a9ee-b6af2624773b" status: 200 len: 1697 microversion: 2.1 time: 0.441251 Jul 23 22:22:42.220256 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3876/6486] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:22:41 2022] GET /compute/v2.1/servers/00332b3c-7fac-48af-a9ee-b6af2624773b => generated 1697 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:22:43.246455 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e8381609-34d7-44c8-b14b-2f7518ef030d tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:22:43.247516 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e8381609-34d7-44c8-b14b-2f7518ef030d tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 00332b3c-7fac-48af-a9ee-b6af2624773b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:22:43.255590 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e8381609-34d7-44c8-b14b-2f7518ef030d tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:22:43.256046 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e8381609-34d7-44c8-b14b-2f7518ef030d tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:22:43.256829 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e8381609-34d7-44c8-b14b-2f7518ef030d tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:22:43.257275 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e8381609-34d7-44c8-b14b-2f7518ef030d tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:22:43.404848 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e8381609-34d7-44c8-b14b-2f7518ef030d tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:22:43.413053 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e8381609-34d7-44c8-b14b-2f7518ef030d tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/00332b3c-7fac-48af-a9ee-b6af2624773b" status: 200 len: 1697 microversion: 2.1 time: 0.173287 Jul 23 22:22:43.413628 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3877/6487] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:22:43 2022] GET /compute/v2.1/servers/00332b3c-7fac-48af-a9ee-b6af2624773b => generated 1697 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:22:44.431107 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-56a89993-6df8-47df-a74f-d62442605a0a tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:22:44.431683 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-56a89993-6df8-47df-a74f-d62442605a0a tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 00332b3c-7fac-48af-a9ee-b6af2624773b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:22:44.439206 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-56a89993-6df8-47df-a74f-d62442605a0a tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:22:44.439657 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-56a89993-6df8-47df-a74f-d62442605a0a tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:22:44.440431 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-56a89993-6df8-47df-a74f-d62442605a0a tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:22:44.440871 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-56a89993-6df8-47df-a74f-d62442605a0a tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:22:44.574500 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-56a89993-6df8-47df-a74f-d62442605a0a tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:22:44.582610 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-56a89993-6df8-47df-a74f-d62442605a0a tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/00332b3c-7fac-48af-a9ee-b6af2624773b" status: 200 len: 1697 microversion: 2.1 time: 0.155792 Jul 23 22:22:44.583196 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3878/6488] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:22:44 2022] GET /compute/v2.1/servers/00332b3c-7fac-48af-a9ee-b6af2624773b => generated 1697 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:22:45.603856 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-939e1de3-05a5-4627-b45c-9233805fe6eb tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:22:45.604945 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-939e1de3-05a5-4627-b45c-9233805fe6eb tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 00332b3c-7fac-48af-a9ee-b6af2624773b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:22:45.616842 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-939e1de3-05a5-4627-b45c-9233805fe6eb tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:22:45.617571 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-939e1de3-05a5-4627-b45c-9233805fe6eb tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:22:45.618958 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-939e1de3-05a5-4627-b45c-9233805fe6eb tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:22:45.619708 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-939e1de3-05a5-4627-b45c-9233805fe6eb tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:22:45.768204 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-939e1de3-05a5-4627-b45c-9233805fe6eb tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:22:45.780061 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-939e1de3-05a5-4627-b45c-9233805fe6eb tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/00332b3c-7fac-48af-a9ee-b6af2624773b" status: 200 len: 1697 microversion: 2.1 time: 0.180961 Jul 23 22:22:45.780061 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3879/6489] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:22:45 2022] GET /compute/v2.1/servers/00332b3c-7fac-48af-a9ee-b6af2624773b => generated 1697 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:22:46.799586 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-aaaf1291-88c0-42fd-bb14-1300d2e36d27 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:22:46.800467 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-aaaf1291-88c0-42fd-bb14-1300d2e36d27 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 00332b3c-7fac-48af-a9ee-b6af2624773b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:22:46.810021 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-aaaf1291-88c0-42fd-bb14-1300d2e36d27 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:22:46.810634 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-aaaf1291-88c0-42fd-bb14-1300d2e36d27 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:22:46.811661 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-aaaf1291-88c0-42fd-bb14-1300d2e36d27 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:22:46.812252 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-aaaf1291-88c0-42fd-bb14-1300d2e36d27 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:22:46.951106 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-aaaf1291-88c0-42fd-bb14-1300d2e36d27 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:22:46.962877 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-aaaf1291-88c0-42fd-bb14-1300d2e36d27 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/00332b3c-7fac-48af-a9ee-b6af2624773b" status: 200 len: 1697 microversion: 2.1 time: 0.169177 Jul 23 22:22:46.963770 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3880/6490] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:22:46 2022] GET /compute/v2.1/servers/00332b3c-7fac-48af-a9ee-b6af2624773b => generated 1697 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:22:47.985052 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-627e085d-a8f5-4b67-b782-ce78a37c70e8 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:22:47.986200 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-627e085d-a8f5-4b67-b782-ce78a37c70e8 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 00332b3c-7fac-48af-a9ee-b6af2624773b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:22:47.997836 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-627e085d-a8f5-4b67-b782-ce78a37c70e8 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:22:47.998654 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-627e085d-a8f5-4b67-b782-ce78a37c70e8 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:22:47.999856 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-627e085d-a8f5-4b67-b782-ce78a37c70e8 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:22:48.000300 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-627e085d-a8f5-4b67-b782-ce78a37c70e8 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:22:48.150371 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-627e085d-a8f5-4b67-b782-ce78a37c70e8 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:22:48.158361 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-627e085d-a8f5-4b67-b782-ce78a37c70e8 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/00332b3c-7fac-48af-a9ee-b6af2624773b" status: 200 len: 1697 microversion: 2.1 time: 0.179878 Jul 23 22:22:48.158934 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3881/6491] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:22:47 2022] GET /compute/v2.1/servers/00332b3c-7fac-48af-a9ee-b6af2624773b => generated 1697 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:22:49.180280 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-874eb344-67b0-4c0b-819f-4f7dc4f382b1 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:22:49.181290 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-874eb344-67b0-4c0b-819f-4f7dc4f382b1 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 00332b3c-7fac-48af-a9ee-b6af2624773b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:22:49.190942 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-874eb344-67b0-4c0b-819f-4f7dc4f382b1 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:22:49.191401 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-874eb344-67b0-4c0b-819f-4f7dc4f382b1 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:22:49.192178 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-874eb344-67b0-4c0b-819f-4f7dc4f382b1 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:22:49.192622 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-874eb344-67b0-4c0b-819f-4f7dc4f382b1 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:22:49.343403 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-874eb344-67b0-4c0b-819f-4f7dc4f382b1 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:22:49.351248 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-874eb344-67b0-4c0b-819f-4f7dc4f382b1 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/00332b3c-7fac-48af-a9ee-b6af2624773b" status: 200 len: 1697 microversion: 2.1 time: 0.177821 Jul 23 22:22:49.351841 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3882/6492] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:22:49 2022] GET /compute/v2.1/servers/00332b3c-7fac-48af-a9ee-b6af2624773b => generated 1697 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:22:50.372826 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-cf3b0344-1a7f-4ec5-b900-f3bb3849569d tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:22:50.374016 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-cf3b0344-1a7f-4ec5-b900-f3bb3849569d tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 00332b3c-7fac-48af-a9ee-b6af2624773b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:22:50.385907 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cf3b0344-1a7f-4ec5-b900-f3bb3849569d tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:22:50.386667 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cf3b0344-1a7f-4ec5-b900-f3bb3849569d tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:22:50.388005 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cf3b0344-1a7f-4ec5-b900-f3bb3849569d tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:22:50.388742 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cf3b0344-1a7f-4ec5-b900-f3bb3849569d tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:22:50.393988 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:22:50.527371 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-cf3b0344-1a7f-4ec5-b900-f3bb3849569d tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:22:50.535330 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-cf3b0344-1a7f-4ec5-b900-f3bb3849569d tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/00332b3c-7fac-48af-a9ee-b6af2624773b" status: 200 len: 1697 microversion: 2.1 time: 0.169116 Jul 23 22:22:50.535933 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3883/6493] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:22:50 2022] GET /compute/v2.1/servers/00332b3c-7fac-48af-a9ee-b6af2624773b => generated 1697 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:22:51.556970 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-bf010fe7-a175-4a69-9c0d-c5387aca93f0 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:22:51.558185 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-bf010fe7-a175-4a69-9c0d-c5387aca93f0 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 00332b3c-7fac-48af-a9ee-b6af2624773b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:22:51.567674 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bf010fe7-a175-4a69-9c0d-c5387aca93f0 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:22:51.568132 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bf010fe7-a175-4a69-9c0d-c5387aca93f0 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:22:51.568906 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bf010fe7-a175-4a69-9c0d-c5387aca93f0 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:22:51.569350 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bf010fe7-a175-4a69-9c0d-c5387aca93f0 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:22:51.707245 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-bf010fe7-a175-4a69-9c0d-c5387aca93f0 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:22:51.715452 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-bf010fe7-a175-4a69-9c0d-c5387aca93f0 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/00332b3c-7fac-48af-a9ee-b6af2624773b" status: 200 len: 1697 microversion: 2.1 time: 0.165045 Jul 23 22:22:51.716039 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3884/6494] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:22:51 2022] GET /compute/v2.1/servers/00332b3c-7fac-48af-a9ee-b6af2624773b => generated 1697 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:22:52.735184 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5433219a-3841-4c47-8f9a-3604f6995616 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:22:52.736159 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5433219a-3841-4c47-8f9a-3604f6995616 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 00332b3c-7fac-48af-a9ee-b6af2624773b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:22:52.744217 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5433219a-3841-4c47-8f9a-3604f6995616 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:22:52.744664 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5433219a-3841-4c47-8f9a-3604f6995616 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:22:52.745473 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5433219a-3841-4c47-8f9a-3604f6995616 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:22:52.745975 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5433219a-3841-4c47-8f9a-3604f6995616 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:22:52.888102 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5433219a-3841-4c47-8f9a-3604f6995616 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:22:52.896177 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5433219a-3841-4c47-8f9a-3604f6995616 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/00332b3c-7fac-48af-a9ee-b6af2624773b" status: 200 len: 1697 microversion: 2.1 time: 0.166972 Jul 23 22:22:52.896764 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3885/6495] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:22:52 2022] GET /compute/v2.1/servers/00332b3c-7fac-48af-a9ee-b6af2624773b => generated 1697 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:22:53.341416 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-74e0bd18-b053-43b7-99e4-18021e667db5 req-aedfb981-a560-42a2-968e-595852755d7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00332b3c-7fac-48af-a9ee-b6af2624773b", "name": "network-vif-unplugged", "status": "completed", "tag": "8319545d-8b82-48b0-a564-7355654d0404"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:22:53.350731 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-74e0bd18-b053-43b7-99e4-18021e667db5 req-aedfb981-a560-42a2-968e-595852755d7c service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:22:53.351186 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-74e0bd18-b053-43b7-99e4-18021e667db5 req-aedfb981-a560-42a2-968e-595852755d7c service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:22:53.367362 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-74e0bd18-b053-43b7-99e4-18021e667db5 req-aedfb981-a560-42a2-968e-595852755d7c service nova] Creating event network-vif-unplugged:8319545d-8b82-48b0-a564-7355654d0404 for instance 00332b3c-7fac-48af-a9ee-b6af2624773b on nch2-master-1 Jul 23 22:22:53.373370 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [req-74e0bd18-b053-43b7-99e4-18021e667db5 req-aedfb981-a560-42a2-968e-595852755d7c service nova] Instance 00332b3c-7fac-48af-a9ee-b6af2624773b is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=131320) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 23 22:22:53.384753 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-74e0bd18-b053-43b7-99e4-18021e667db5 req-aedfb981-a560-42a2-968e-595852755d7c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047189 Jul 23 22:22:53.385552 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3886/6496] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:22:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:22:53.913337 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ed2ee37a-b3e4-45be-9e5e-9f5947c8c274 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:22:53.919251 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ed2ee37a-b3e4-45be-9e5e-9f5947c8c274 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 00332b3c-7fac-48af-a9ee-b6af2624773b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:22:53.929691 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ed2ee37a-b3e4-45be-9e5e-9f5947c8c274 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:22:53.930458 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ed2ee37a-b3e4-45be-9e5e-9f5947c8c274 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:22:53.931431 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ed2ee37a-b3e4-45be-9e5e-9f5947c8c274 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:22:53.932069 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ed2ee37a-b3e4-45be-9e5e-9f5947c8c274 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:22:54.089169 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ed2ee37a-b3e4-45be-9e5e-9f5947c8c274 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:22:54.097031 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ed2ee37a-b3e4-45be-9e5e-9f5947c8c274 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/00332b3c-7fac-48af-a9ee-b6af2624773b" status: 200 len: 1696 microversion: 2.1 time: 0.188025 Jul 23 22:22:54.097626 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3887/6497] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:22:53 2022] GET /compute/v2.1/servers/00332b3c-7fac-48af-a9ee-b6af2624773b => generated 1696 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:22:55.119844 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-add18d15-f1c9-4ea7-a6d5-0e7c0b3e8e5b tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:22:55.120886 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-add18d15-f1c9-4ea7-a6d5-0e7c0b3e8e5b tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 00332b3c-7fac-48af-a9ee-b6af2624773b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:22:55.135308 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-add18d15-f1c9-4ea7-a6d5-0e7c0b3e8e5b tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:22:55.136073 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-add18d15-f1c9-4ea7-a6d5-0e7c0b3e8e5b tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:22:55.137407 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-add18d15-f1c9-4ea7-a6d5-0e7c0b3e8e5b tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:22:55.138238 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-add18d15-f1c9-4ea7-a6d5-0e7c0b3e8e5b tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:22:55.281847 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-add18d15-f1c9-4ea7-a6d5-0e7c0b3e8e5b tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:22:55.289909 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-add18d15-f1c9-4ea7-a6d5-0e7c0b3e8e5b tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/00332b3c-7fac-48af-a9ee-b6af2624773b" status: 200 len: 1694 microversion: 2.1 time: 0.177158 Jul 23 22:22:55.290515 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3888/6498] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:22:55 2022] GET /compute/v2.1/servers/00332b3c-7fac-48af-a9ee-b6af2624773b => generated 1694 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:22:55.407626 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-fe146e1a-21d1-4caa-b60a-2ce438b692c0 req-c7389dc8-35de-4dbc-b113-23644f68bc38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00332b3c-7fac-48af-a9ee-b6af2624773b", "tag": "8319545d-8b82-48b0-a564-7355654d0404"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:22:55.416483 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-fe146e1a-21d1-4caa-b60a-2ce438b692c0 req-c7389dc8-35de-4dbc-b113-23644f68bc38 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:22:55.416929 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-fe146e1a-21d1-4caa-b60a-2ce438b692c0 req-c7389dc8-35de-4dbc-b113-23644f68bc38 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:22:55.431612 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-fe146e1a-21d1-4caa-b60a-2ce438b692c0 req-c7389dc8-35de-4dbc-b113-23644f68bc38 service nova] Creating event network-changed:8319545d-8b82-48b0-a564-7355654d0404 for instance 00332b3c-7fac-48af-a9ee-b6af2624773b on nch2-master-1 Jul 23 22:22:55.437325 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [req-fe146e1a-21d1-4caa-b60a-2ce438b692c0 req-c7389dc8-35de-4dbc-b113-23644f68bc38 service nova] Instance 00332b3c-7fac-48af-a9ee-b6af2624773b is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=131320) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 23 22:22:55.448635 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-fe146e1a-21d1-4caa-b60a-2ce438b692c0 req-c7389dc8-35de-4dbc-b113-23644f68bc38 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046940 Jul 23 22:22:55.449252 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3889/6499] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:22:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:22:56.309617 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5bead546-357c-4464-99af-c69b0305fe7f tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:22:56.310630 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5bead546-357c-4464-99af-c69b0305fe7f tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 00332b3c-7fac-48af-a9ee-b6af2624773b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:22:56.317516 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5bead546-357c-4464-99af-c69b0305fe7f tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:22:56.318266 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5bead546-357c-4464-99af-c69b0305fe7f tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:22:56.319453 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5bead546-357c-4464-99af-c69b0305fe7f tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:22:56.320097 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5bead546-357c-4464-99af-c69b0305fe7f tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:22:56.469057 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5bead546-357c-4464-99af-c69b0305fe7f tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:22:56.478013 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5bead546-357c-4464-99af-c69b0305fe7f tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/00332b3c-7fac-48af-a9ee-b6af2624773b" status: 200 len: 1691 microversion: 2.1 time: 0.173781 Jul 23 22:22:56.478656 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3890/6500] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:22:56 2022] GET /compute/v2.1/servers/00332b3c-7fac-48af-a9ee-b6af2624773b => generated 1691 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:22:56.498120 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-77d7981e-bcff-4d59-8f49-e58a5c65d9f5 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:22:56.498790 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-77d7981e-bcff-4d59-8f49-e58a5c65d9f5 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 00332b3c-7fac-48af-a9ee-b6af2624773b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:22:56.507459 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-77d7981e-bcff-4d59-8f49-e58a5c65d9f5 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:22:56.508092 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-77d7981e-bcff-4d59-8f49-e58a5c65d9f5 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:22:56.509292 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-77d7981e-bcff-4d59-8f49-e58a5c65d9f5 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:22:56.509920 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-77d7981e-bcff-4d59-8f49-e58a5c65d9f5 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:22:56.572859 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-77d7981e-bcff-4d59-8f49-e58a5c65d9f5 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "POST /compute/v2.1/servers/00332b3c-7fac-48af-a9ee-b6af2624773b/action" status: 204 len: 0 microversion: 2.1 time: 0.078659 Jul 23 22:22:56.573877 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3891/6501] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 22:22:56 2022] POST /compute/v2.1/servers/00332b3c-7fac-48af-a9ee-b6af2624773b/action => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 22:22:56.582410 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-764a9bc9-e6e8-4bc8-8902-efc09f5973d0 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:22:56.583122 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-764a9bc9-e6e8-4bc8-8902-efc09f5973d0 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 00332b3c-7fac-48af-a9ee-b6af2624773b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:22:56.589536 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-764a9bc9-e6e8-4bc8-8902-efc09f5973d0 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:22:56.590074 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-764a9bc9-e6e8-4bc8-8902-efc09f5973d0 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:22:56.590806 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-764a9bc9-e6e8-4bc8-8902-efc09f5973d0 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:22:56.591277 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-764a9bc9-e6e8-4bc8-8902-efc09f5973d0 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:22:56.733965 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-764a9bc9-e6e8-4bc8-8902-efc09f5973d0 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:22:56.742062 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-764a9bc9-e6e8-4bc8-8902-efc09f5973d0 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/00332b3c-7fac-48af-a9ee-b6af2624773b" status: 200 len: 1691 microversion: 2.1 time: 0.163725 Jul 23 22:22:56.742686 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3892/6502] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:22:56 2022] GET /compute/v2.1/servers/00332b3c-7fac-48af-a9ee-b6af2624773b => generated 1691 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:22:56.758381 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-959fd672-7044-49d9-a6df-7ba1027d9dde tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:22:56.759248 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-959fd672-7044-49d9-a6df-7ba1027d9dde tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 00332b3c-7fac-48af-a9ee-b6af2624773b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:22:56.765582 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-959fd672-7044-49d9-a6df-7ba1027d9dde tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:22:56.766323 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-959fd672-7044-49d9-a6df-7ba1027d9dde tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:22:56.767177 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-959fd672-7044-49d9-a6df-7ba1027d9dde tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:22:56.767786 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-959fd672-7044-49d9-a6df-7ba1027d9dde tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:22:56.907314 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-959fd672-7044-49d9-a6df-7ba1027d9dde tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:22:56.916053 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-959fd672-7044-49d9-a6df-7ba1027d9dde tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/00332b3c-7fac-48af-a9ee-b6af2624773b" status: 200 len: 1691 microversion: 2.1 time: 0.161500 Jul 23 22:22:56.917236 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3893/6503] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:22:56 2022] GET /compute/v2.1/servers/00332b3c-7fac-48af-a9ee-b6af2624773b => generated 1691 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:22:57.933890 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-95ceaac9-aaef-4549-9c81-69cfb160edfa tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:22:57.934578 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-95ceaac9-aaef-4549-9c81-69cfb160edfa tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 00332b3c-7fac-48af-a9ee-b6af2624773b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:22:57.941746 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-95ceaac9-aaef-4549-9c81-69cfb160edfa tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:22:57.942268 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-95ceaac9-aaef-4549-9c81-69cfb160edfa tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:22:57.943054 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-95ceaac9-aaef-4549-9c81-69cfb160edfa tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:22:57.943679 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-95ceaac9-aaef-4549-9c81-69cfb160edfa tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:22:58.088882 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-95ceaac9-aaef-4549-9c81-69cfb160edfa tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:22:58.103797 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-95ceaac9-aaef-4549-9c81-69cfb160edfa tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/00332b3c-7fac-48af-a9ee-b6af2624773b" status: 200 len: 1683 microversion: 2.1 time: 0.173730 Jul 23 22:22:58.104451 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3894/6504] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:22:57 2022] GET /compute/v2.1/servers/00332b3c-7fac-48af-a9ee-b6af2624773b => generated 1683 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:22:58.402424 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-9a39e534-2beb-4466-a77e-b4880b649564 req-09e6ce91-0ea9-47df-a970-bf76585ee08b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00332b3c-7fac-48af-a9ee-b6af2624773b", "name": "network-vif-plugged", "status": "completed", "tag": "8319545d-8b82-48b0-a564-7355654d0404"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:22:58.411769 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-9a39e534-2beb-4466-a77e-b4880b649564 req-09e6ce91-0ea9-47df-a970-bf76585ee08b service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:22:58.412269 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-9a39e534-2beb-4466-a77e-b4880b649564 req-09e6ce91-0ea9-47df-a970-bf76585ee08b service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:22:58.425205 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-9a39e534-2beb-4466-a77e-b4880b649564 req-09e6ce91-0ea9-47df-a970-bf76585ee08b service nova] Creating event network-vif-plugged:8319545d-8b82-48b0-a564-7355654d0404 for instance 00332b3c-7fac-48af-a9ee-b6af2624773b on nch2-master-1 Jul 23 22:22:58.430225 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-9a39e534-2beb-4466-a77e-b4880b649564 req-09e6ce91-0ea9-47df-a970-bf76585ee08b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031650 Jul 23 22:22:58.431017 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3895/6505] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:22:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:23:20.318109 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-079bd2a5-3f21-4539-8588-f39d6dc1cdcf tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:23:20.319158 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-079bd2a5-3f21-4539-8588-f39d6dc1cdcf tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 00332b3c-7fac-48af-a9ee-b6af2624773b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:23:20.321849 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=60 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:23:20.322530 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:23:20.330077 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-079bd2a5-3f21-4539-8588-f39d6dc1cdcf tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:23:20.330443 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-079bd2a5-3f21-4539-8588-f39d6dc1cdcf tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:23:20.331220 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-079bd2a5-3f21-4539-8588-f39d6dc1cdcf tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:23:20.331659 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-079bd2a5-3f21-4539-8588-f39d6dc1cdcf tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:23:20.387942 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-079bd2a5-3f21-4539-8588-f39d6dc1cdcf tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "POST /compute/v2.1/servers/00332b3c-7fac-48af-a9ee-b6af2624773b/action" status: 200 len: 24574 microversion: 2.1 time: 0.074108 Jul 23 22:23:20.388602 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3896/6506] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 22:23:20 2022] POST /compute/v2.1/servers/00332b3c-7fac-48af-a9ee-b6af2624773b/action => generated 24574 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 23 22:23:27.861906 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-22477b14-0f0a-48ee-ac21-59f669e3f2ed tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:23:27.862566 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-22477b14-0f0a-48ee-ac21-59f669e3f2ed tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 00332b3c-7fac-48af-a9ee-b6af2624773b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:23:27.870863 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-22477b14-0f0a-48ee-ac21-59f669e3f2ed tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:23:27.871403 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-22477b14-0f0a-48ee-ac21-59f669e3f2ed tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:23:27.872268 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-22477b14-0f0a-48ee-ac21-59f669e3f2ed tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:23:27.872823 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-22477b14-0f0a-48ee-ac21-59f669e3f2ed tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:23:27.899101 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-22477b14-0f0a-48ee-ac21-59f669e3f2ed tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 00332b3c-7fac-48af-a9ee-b6af2624773b] Going to try to terminate instance {{(pid=131320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 22:23:27.981666 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-22477b14-0f0a-48ee-ac21-59f669e3f2ed tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "DELETE /compute/v2.1/servers/00332b3c-7fac-48af-a9ee-b6af2624773b" status: 204 len: 0 microversion: 2.1 time: 0.123800 Jul 23 22:23:27.982206 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3897/6507] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 22:23:27 2022] DELETE /compute/v2.1/servers/00332b3c-7fac-48af-a9ee-b6af2624773b => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 22:23:28.043060 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-c7526ef7-0849-45e9-9cfc-80eff97236da req-8540f6e4-815b-4010-b5c2-b122d4f314d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00332b3c-7fac-48af-a9ee-b6af2624773b", "tag": "8319545d-8b82-48b0-a564-7355654d0404"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:23:28.052793 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-c7526ef7-0849-45e9-9cfc-80eff97236da req-8540f6e4-815b-4010-b5c2-b122d4f314d0 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:23:28.053245 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-c7526ef7-0849-45e9-9cfc-80eff97236da req-8540f6e4-815b-4010-b5c2-b122d4f314d0 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:23:28.063901 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-c7526ef7-0849-45e9-9cfc-80eff97236da req-8540f6e4-815b-4010-b5c2-b122d4f314d0 service nova] Creating event network-changed:8319545d-8b82-48b0-a564-7355654d0404 for instance 00332b3c-7fac-48af-a9ee-b6af2624773b on nch2-master-1 Jul 23 22:23:28.069266 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-c7526ef7-0849-45e9-9cfc-80eff97236da req-8540f6e4-815b-4010-b5c2-b122d4f314d0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085692 Jul 23 22:23:28.069907 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3898/6508] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:23:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:23:28.075953 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-7b6e3484-535a-4384-9616-6f61842591cf tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:23:28.076686 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-7b6e3484-535a-4384-9616-6f61842591cf tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 00332b3c-7fac-48af-a9ee-b6af2624773b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:23:28.083243 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7b6e3484-535a-4384-9616-6f61842591cf tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:23:28.083698 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7b6e3484-535a-4384-9616-6f61842591cf tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:23:28.084494 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7b6e3484-535a-4384-9616-6f61842591cf tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:23:28.084978 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7b6e3484-535a-4384-9616-6f61842591cf tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:23:28.222339 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-7b6e3484-535a-4384-9616-6f61842591cf tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:23:28.230179 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-7b6e3484-535a-4384-9616-6f61842591cf tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/00332b3c-7fac-48af-a9ee-b6af2624773b" status: 200 len: 1689 microversion: 2.1 time: 0.159120 Jul 23 22:23:28.230755 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3899/6509] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:23:28 2022] GET /compute/v2.1/servers/00332b3c-7fac-48af-a9ee-b6af2624773b => generated 1689 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:23:29.248457 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ad568cc7-a6cb-4288-a2d6-9aa2c81b45bc tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:23:29.249117 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ad568cc7-a6cb-4288-a2d6-9aa2c81b45bc tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 00332b3c-7fac-48af-a9ee-b6af2624773b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:23:29.256637 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ad568cc7-a6cb-4288-a2d6-9aa2c81b45bc tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:23:29.257096 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ad568cc7-a6cb-4288-a2d6-9aa2c81b45bc tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:23:29.257901 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ad568cc7-a6cb-4288-a2d6-9aa2c81b45bc tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:23:29.258351 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ad568cc7-a6cb-4288-a2d6-9aa2c81b45bc tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:23:29.455388 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ad568cc7-a6cb-4288-a2d6-9aa2c81b45bc tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:23:29.466092 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ad568cc7-a6cb-4288-a2d6-9aa2c81b45bc tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/00332b3c-7fac-48af-a9ee-b6af2624773b" status: 200 len: 1689 microversion: 2.1 time: 0.221568 Jul 23 22:23:29.466696 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3900/6510] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:23:29 2022] GET /compute/v2.1/servers/00332b3c-7fac-48af-a9ee-b6af2624773b => generated 1689 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:23:29.855142 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-f4a66779-3d42-4e23-a4ab-f3bb4fd1cac2 req-eb535b3f-0f66-431d-b5fa-1beaebde0a02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00332b3c-7fac-48af-a9ee-b6af2624773b", "name": "network-vif-deleted", "tag": "8319545d-8b82-48b0-a564-7355654d0404"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:23:29.864733 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-f4a66779-3d42-4e23-a4ab-f3bb4fd1cac2 req-eb535b3f-0f66-431d-b5fa-1beaebde0a02 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:23:29.865190 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-f4a66779-3d42-4e23-a4ab-f3bb4fd1cac2 req-eb535b3f-0f66-431d-b5fa-1beaebde0a02 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:23:29.877141 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-f4a66779-3d42-4e23-a4ab-f3bb4fd1cac2 req-eb535b3f-0f66-431d-b5fa-1beaebde0a02 service nova] Creating event network-vif-deleted:8319545d-8b82-48b0-a564-7355654d0404 for instance 00332b3c-7fac-48af-a9ee-b6af2624773b on nch2-master-1 Jul 23 22:23:29.882579 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-f4a66779-3d42-4e23-a4ab-f3bb4fd1cac2 req-eb535b3f-0f66-431d-b5fa-1beaebde0a02 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031411 Jul 23 22:23:29.883190 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3901/6511] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:23:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:23:30.490162 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6ebe6c02-1e9d-4411-b2ca-13e29ca063b7 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:23:30.491157 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6ebe6c02-1e9d-4411-b2ca-13e29ca063b7 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 00332b3c-7fac-48af-a9ee-b6af2624773b] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:23:30.502114 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6ebe6c02-1e9d-4411-b2ca-13e29ca063b7 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:23:30.502889 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6ebe6c02-1e9d-4411-b2ca-13e29ca063b7 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:23:30.504191 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6ebe6c02-1e9d-4411-b2ca-13e29ca063b7 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:23:30.504974 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6ebe6c02-1e9d-4411-b2ca-13e29ca063b7 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:23:30.519604 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-6ebe6c02-1e9d-4411-b2ca-13e29ca063b7 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] HTTP exception thrown: Instance 00332b3c-7fac-48af-a9ee-b6af2624773b could not be found. Jul 23 22:23:30.521320 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6ebe6c02-1e9d-4411-b2ca-13e29ca063b7 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Request method failure captured: Jul 23 22:23:30.521320 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/00332b3c-7fac-48af-a9ee-b6af2624773b HTTP/1.1 Jul 23 22:23:30.521320 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 22:23:30.521320 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 22:23:30.521320 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 22:23:30.521320 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 22:23:30.521320 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 22:23:30.521320 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 22:23:30.521320 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 22:23:30.521320 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 22:23:30.521320 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3HPJGU05HbBTEvLxfT4BhGztnBRWhLwkU8QutIkTRTvVibf-V1mkLz3byZWX90Z2v50VOJRv9MqhrAotUJSfT2hBQ8C_NuI2cZ3sL6bxRnPnmAfb7udSijYdHU5_chgf6SP2LARXnPx77YiG880S5DV74F87lCIERZhTyKn6pgRdpVQ Jul 23 22:23:30.521320 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 22:23:30.521320 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 22:23:30.521320 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 22:23:30.521320 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 22:23:30.521320 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 22:23:30.521320 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 22:23:30.521320 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: a14b865dcbd14987870351ce4e45aaac Jul 23 22:23:30.521320 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1025071309 Jul 23 22:23:30.521320 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 22:23:30.521320 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 22:23:30.521320 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a14b865dcbd14987870351ce4e45aaac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a14b865dcbd14987870351ce4e45aaac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a14b865dcbd14987870351ce4e45aaac", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a14b865dcbd14987870351ce4e45aaac"}]}] Jul 23 22:23:30.521320 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1025071309 Jul 23 22:23:30.521320 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: a14b865dcbd14987870351ce4e45aaac Jul 23 22:23:30.521320 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1025071309 Jul 23 22:23:30.521320 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-TestNetworkAdvancedServerOps-1025071309-project Jul 23 22:23:30.521320 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 22:23:30.521320 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 22:23:30.521320 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: a686380934d042b4a078eb60e9bb6712 Jul 23 22:23:30.521320 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1025071309-project Jul 23 22:23:30.521320 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 22:23:30.521320 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance 00332b3c-7fac-48af-a9ee-b6af2624773b could not be found. Jul 23 22:23:30.521320 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '00332b3c-7fac-48af-a9ee-b6af2624773b'} Jul 23 22:23:30.521320 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 22:23:30.521320 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:23:30.521320 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 22:23:30.521320 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 22:23:30.521320 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 22:23:30.521320 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 22:23:30.521320 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 22:23:30.521320 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 22:23:30.521320 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 22:23:30.521320 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 22:23:30.521320 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00332b3c-7fac-48af-a9ee-b6af2624773b could not be found. Jul 23 22:23:30.521320 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:23:30.521320 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:23:30.521320 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:23:30.521320 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:23:30.521320 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:23:30.521320 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:23:30.521320 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 22:23:30.521320 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 22:23:30.521320 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 22:23:30.521320 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 22:23:30.521320 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 22:23:30.521320 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 22:23:30.521320 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 22:23:30.521320 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 22:23:30.521320 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 22:23:30.521320 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 22:23:30.521320 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00332b3c-7fac-48af-a9ee-b6af2624773b could not be found. Jul 23 22:23:30.521320 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:23:30.521320 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:23:30.525697 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:23:30.525697 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:23:30.525697 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:23:30.525697 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:23:30.525697 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 22:23:30.525697 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 22:23:30.525697 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00332b3c-7fac-48af-a9ee-b6af2624773b could not be found. Jul 23 22:23:30.525697 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:23:30.525697 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6ebe6c02-1e9d-4411-b2ca-13e29ca063b7 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Returning 404 to user: Instance 00332b3c-7fac-48af-a9ee-b6af2624773b could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 22:23:30.525697 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6ebe6c02-1e9d-4411-b2ca-13e29ca063b7 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/00332b3c-7fac-48af-a9ee-b6af2624773b" status: 404 len: 111 microversion: 2.1 time: 0.040990 Jul 23 22:23:30.525697 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3902/6512] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:23:30 2022] GET /compute/v2.1/servers/00332b3c-7fac-48af-a9ee-b6af2624773b => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 22:23:33.540308 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f3ef2565-2980-4676-9fef-0f51c6f2e92c tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '.version_select at 0x7f0b477f45e0>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:23:33.564689 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f3ef2565-2980-4676-9fef-0f51c6f2e92c tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1031106255" status: 202 len: 0 microversion: 2.1 time: 0.028554 Jul 23 22:23:33.565716 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3903/6513] 10.222.0.17 () {58 vars in 1283 bytes} [Sat Jul 23 22:23:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1031106255 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 23 22:23:33.593739 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5b294449-ce1d-4210-9a5a-6fdbb1f3850d tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Action: 'create', calling method: .version_select at 0x7f0b477f4700>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-387300973", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUhHzYyLpP99GEKtUzcWha7LIfkXTMFeFPRI6+mO/jBHZ+DD0li4sKru1xe8QkAAZ/aqNvIa5L2qS71lgjjH8eTXvLt+PzNG+BlzMqlL8BDtw4RzMi6QgRWR88h/meJOA=="}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:23:33.609558 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-5b294449-ce1d-4210-9a5a-6fdbb1f3850d tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Getting quotas for project a14b865dcbd14987870351ce4e45aaac. Resources: {'key_pairs'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 22:23:33.614948 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-5b294449-ce1d-4210-9a5a-6fdbb1f3850d tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Getting quotas for user a686380934d042b4a078eb60e9bb6712 and project a14b865dcbd14987870351ce4e45aaac. Resources: {'key_pairs'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 22:23:33.643334 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5b294449-ce1d-4210-9a5a-6fdbb1f3850d tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.054068 Jul 23 22:23:33.644265 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3904/6514] 10.222.0.17 () {60 vars in 1158 bytes} [Sat Jul 23 22:23:33 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 22:23:39.480945 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b7b18032-8626-4586-9e79-3f55ca1a43e0 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-497159436", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "networks": [{"uuid": "5ddd64a6-37a5-4eab-a35e-35b16ba7ea62"}], "key_name": "tempest-TestNetworkAdvancedServerOps-387300973", "security_groups": [{"name": "tempest-secgroup-smoke-936952378"}]}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:23:39.599508 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-b7b18032-8626-4586-9e79-3f55ca1a43e0 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] validate_networks() for [('5ddd64a6-37a5-4eab-a35e-35b16ba7ea62', None, None, None, None, None)] {{(pid=131320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 22:23:40.431636 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-b7b18032-8626-4586-9e79-3f55ca1a43e0 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 22:23:40.432126 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-b7b18032-8626-4586-9e79-3f55ca1a43e0 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 22:23:40.432697 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-b7b18032-8626-4586-9e79-3f55ca1a43e0 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 22:23:40.433176 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-b7b18032-8626-4586-9e79-3f55ca1a43e0 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 22:23:40.433651 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-b7b18032-8626-4586-9e79-3f55ca1a43e0 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 22:23:40.443054 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b7b18032-8626-4586-9e79-3f55ca1a43e0 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:23:40.443573 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b7b18032-8626-4586-9e79-3f55ca1a43e0 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:23:40.444521 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b7b18032-8626-4586-9e79-3f55ca1a43e0 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:23:40.444965 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b7b18032-8626-4586-9e79-3f55ca1a43e0 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:23:40.462932 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-b7b18032-8626-4586-9e79-3f55ca1a43e0 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Getting quotas for project a14b865dcbd14987870351ce4e45aaac. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 22:23:40.468494 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-b7b18032-8626-4586-9e79-3f55ca1a43e0 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Getting quotas for user a686380934d042b4a078eb60e9bb6712 and project a14b865dcbd14987870351ce4e45aaac. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 22:23:40.482426 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b7b18032-8626-4586-9e79-3f55ca1a43e0 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Going to run 1 instances... {{(pid=131320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 22:23:40.484745 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b7b18032-8626-4586-9e79-3f55ca1a43e0 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 038b7ba5-fad9-4216-ae8e-b42f78aec29e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 22:23:40.533723 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b7b18032-8626-4586-9e79-3f55ca1a43e0 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.058109 Jul 23 22:23:40.539543 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3905/6515] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 22:23:39 2022] POST /compute/v2.1/servers => generated 405 bytes in 1060 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 23 22:23:40.544734 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e9e06607-4a01-40c5-8b0e-bf4dbf06ea40 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:23:40.545916 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e9e06607-4a01-40c5-8b0e-bf4dbf06ea40 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 038b7ba5-fad9-4216-ae8e-b42f78aec29e] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:23:40.633495 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e9e06607-4a01-40c5-8b0e-bf4dbf06ea40 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:23:40.642726 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e9e06607-4a01-40c5-8b0e-bf4dbf06ea40 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/038b7ba5-fad9-4216-ae8e-b42f78aec29e" status: 200 len: 1265 microversion: 2.1 time: 0.101717 Jul 23 22:23:40.643750 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3906/6516] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:23:40 2022] GET /compute/v2.1/servers/038b7ba5-fad9-4216-ae8e-b42f78aec29e => generated 1265 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:23:41.660853 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-cb627d3d-a096-4962-ba61-fe6a5be8e4a8 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:23:41.662419 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-cb627d3d-a096-4962-ba61-fe6a5be8e4a8 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 038b7ba5-fad9-4216-ae8e-b42f78aec29e] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:23:41.672308 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cb627d3d-a096-4962-ba61-fe6a5be8e4a8 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:23:41.672695 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cb627d3d-a096-4962-ba61-fe6a5be8e4a8 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:23:41.673708 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cb627d3d-a096-4962-ba61-fe6a5be8e4a8 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:23:41.674204 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cb627d3d-a096-4962-ba61-fe6a5be8e4a8 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:23:41.760446 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-cb627d3d-a096-4962-ba61-fe6a5be8e4a8 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:23:41.768852 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-cb627d3d-a096-4962-ba61-fe6a5be8e4a8 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/038b7ba5-fad9-4216-ae8e-b42f78aec29e" status: 200 len: 1335 microversion: 2.1 time: 0.111980 Jul 23 22:23:41.769775 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3907/6517] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:23:41 2022] GET /compute/v2.1/servers/038b7ba5-fad9-4216-ae8e-b42f78aec29e => generated 1335 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:23:42.786586 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-675d8149-6adb-4d06-b851-e91c70172beb tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:23:42.787256 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-675d8149-6adb-4d06-b851-e91c70172beb tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 038b7ba5-fad9-4216-ae8e-b42f78aec29e] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:23:42.795920 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-675d8149-6adb-4d06-b851-e91c70172beb tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:23:42.796358 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-675d8149-6adb-4d06-b851-e91c70172beb tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:23:42.797453 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-675d8149-6adb-4d06-b851-e91c70172beb tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:23:42.797952 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-675d8149-6adb-4d06-b851-e91c70172beb tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:23:42.949350 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-675d8149-6adb-4d06-b851-e91c70172beb tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:23:42.957366 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-675d8149-6adb-4d06-b851-e91c70172beb tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/038b7ba5-fad9-4216-ae8e-b42f78aec29e" status: 200 len: 1390 microversion: 2.1 time: 0.174705 Jul 23 22:23:42.957985 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3908/6518] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:23:42 2022] GET /compute/v2.1/servers/038b7ba5-fad9-4216-ae8e-b42f78aec29e => generated 1390 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:23:43.119046 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-5a0cc943-e2f2-4da4-a25a-11b5b97075dc req-ac718f4c-89a1-4970-9bb1-d943d4200476 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "038b7ba5-fad9-4216-ae8e-b42f78aec29e", "tag": "a2577441-6d47-4571-ac0b-7026c44bf9c8"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:23:43.158565 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-5a0cc943-e2f2-4da4-a25a-11b5b97075dc req-ac718f4c-89a1-4970-9bb1-d943d4200476 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:23:43.158941 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-5a0cc943-e2f2-4da4-a25a-11b5b97075dc req-ac718f4c-89a1-4970-9bb1-d943d4200476 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:23:43.171577 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-5a0cc943-e2f2-4da4-a25a-11b5b97075dc req-ac718f4c-89a1-4970-9bb1-d943d4200476 service nova] Creating event network-changed:a2577441-6d47-4571-ac0b-7026c44bf9c8 for instance 038b7ba5-fad9-4216-ae8e-b42f78aec29e on nch1-master-1 Jul 23 22:23:43.177493 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-5a0cc943-e2f2-4da4-a25a-11b5b97075dc req-ac718f4c-89a1-4970-9bb1-d943d4200476 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070872 Jul 23 22:23:43.178433 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3909/6519] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:23:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 22:23:43.976398 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-46a5727b-c87d-49c7-bd66-31ad4d5ff8c1 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:23:43.977181 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-46a5727b-c87d-49c7-bd66-31ad4d5ff8c1 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 038b7ba5-fad9-4216-ae8e-b42f78aec29e] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:23:43.984034 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-46a5727b-c87d-49c7-bd66-31ad4d5ff8c1 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:23:43.984488 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-46a5727b-c87d-49c7-bd66-31ad4d5ff8c1 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:23:43.985260 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-46a5727b-c87d-49c7-bd66-31ad4d5ff8c1 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:23:43.985699 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-46a5727b-c87d-49c7-bd66-31ad4d5ff8c1 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:23:44.137697 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-46a5727b-c87d-49c7-bd66-31ad4d5ff8c1 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:23:44.149525 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-46a5727b-c87d-49c7-bd66-31ad4d5ff8c1 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/038b7ba5-fad9-4216-ae8e-b42f78aec29e" status: 200 len: 1390 microversion: 2.1 time: 0.178375 Jul 23 22:23:44.150382 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3910/6520] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:23:43 2022] GET /compute/v2.1/servers/038b7ba5-fad9-4216-ae8e-b42f78aec29e => generated 1390 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:23:45.166334 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b26ad220-e4e6-437b-bcbf-308dab5853ed tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:23:45.166956 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b26ad220-e4e6-437b-bcbf-308dab5853ed tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 038b7ba5-fad9-4216-ae8e-b42f78aec29e] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:23:45.174163 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b26ad220-e4e6-437b-bcbf-308dab5853ed tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:23:45.174620 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b26ad220-e4e6-437b-bcbf-308dab5853ed tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:23:45.175356 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b26ad220-e4e6-437b-bcbf-308dab5853ed tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:23:45.175831 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b26ad220-e4e6-437b-bcbf-308dab5853ed tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:23:45.308861 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b26ad220-e4e6-437b-bcbf-308dab5853ed tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:23:45.316930 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b26ad220-e4e6-437b-bcbf-308dab5853ed tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/038b7ba5-fad9-4216-ae8e-b42f78aec29e" status: 200 len: 1390 microversion: 2.1 time: 0.154676 Jul 23 22:23:45.317514 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3911/6521] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:23:45 2022] GET /compute/v2.1/servers/038b7ba5-fad9-4216-ae8e-b42f78aec29e => generated 1390 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:23:46.338825 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-23503f65-843f-43d3-a425-1f44cf8cf292 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:23:46.339402 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-23503f65-843f-43d3-a425-1f44cf8cf292 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 038b7ba5-fad9-4216-ae8e-b42f78aec29e] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:23:46.347004 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-23503f65-843f-43d3-a425-1f44cf8cf292 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:23:46.347464 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-23503f65-843f-43d3-a425-1f44cf8cf292 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:23:46.348257 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-23503f65-843f-43d3-a425-1f44cf8cf292 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:23:46.348703 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-23503f65-843f-43d3-a425-1f44cf8cf292 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:23:46.495428 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-23503f65-843f-43d3-a425-1f44cf8cf292 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:23:46.503338 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-23503f65-843f-43d3-a425-1f44cf8cf292 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/038b7ba5-fad9-4216-ae8e-b42f78aec29e" status: 200 len: 1390 microversion: 2.1 time: 0.171246 Jul 23 22:23:46.503930 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3912/6522] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:23:46 2022] GET /compute/v2.1/servers/038b7ba5-fad9-4216-ae8e-b42f78aec29e => generated 1390 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:23:47.521308 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-53110732-8f1a-42cd-bf88-3bc762f02d4c tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:23:47.522102 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-53110732-8f1a-42cd-bf88-3bc762f02d4c tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 038b7ba5-fad9-4216-ae8e-b42f78aec29e] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:23:47.530593 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-53110732-8f1a-42cd-bf88-3bc762f02d4c tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:23:47.531129 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-53110732-8f1a-42cd-bf88-3bc762f02d4c tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:23:47.532035 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-53110732-8f1a-42cd-bf88-3bc762f02d4c tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:23:47.532558 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-53110732-8f1a-42cd-bf88-3bc762f02d4c tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:23:47.672569 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-53110732-8f1a-42cd-bf88-3bc762f02d4c tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:23:47.680205 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-53110732-8f1a-42cd-bf88-3bc762f02d4c tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/038b7ba5-fad9-4216-ae8e-b42f78aec29e" status: 200 len: 1390 microversion: 2.1 time: 0.163607 Jul 23 22:23:47.680779 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3913/6523] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:23:47 2022] GET /compute/v2.1/servers/038b7ba5-fad9-4216-ae8e-b42f78aec29e => generated 1390 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:23:48.702163 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c3568c36-739b-4601-a0ae-fb7af8665fde tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:23:48.703235 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c3568c36-739b-4601-a0ae-fb7af8665fde tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 038b7ba5-fad9-4216-ae8e-b42f78aec29e] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:23:48.714434 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c3568c36-739b-4601-a0ae-fb7af8665fde tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:23:48.714892 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c3568c36-739b-4601-a0ae-fb7af8665fde tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:23:48.715676 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c3568c36-739b-4601-a0ae-fb7af8665fde tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:23:48.716123 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c3568c36-739b-4601-a0ae-fb7af8665fde tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:23:48.858031 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c3568c36-739b-4601-a0ae-fb7af8665fde tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:23:48.866047 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c3568c36-739b-4601-a0ae-fb7af8665fde tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/038b7ba5-fad9-4216-ae8e-b42f78aec29e" status: 200 len: 1390 microversion: 2.1 time: 0.170919 Jul 23 22:23:48.866645 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3914/6524] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:23:48 2022] GET /compute/v2.1/servers/038b7ba5-fad9-4216-ae8e-b42f78aec29e => generated 1390 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:23:49.366562 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-6a506cfd-bcc8-4993-b0a4-afdea9ee5010 req-c8dc781f-ff98-4bea-aa66-2bd91aa8c88e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "038b7ba5-fad9-4216-ae8e-b42f78aec29e", "name": "network-vif-plugged", "status": "completed", "tag": "a2577441-6d47-4571-ac0b-7026c44bf9c8"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:23:49.375130 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-6a506cfd-bcc8-4993-b0a4-afdea9ee5010 req-c8dc781f-ff98-4bea-aa66-2bd91aa8c88e service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:23:49.375580 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-6a506cfd-bcc8-4993-b0a4-afdea9ee5010 req-c8dc781f-ff98-4bea-aa66-2bd91aa8c88e service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:23:49.387072 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-6a506cfd-bcc8-4993-b0a4-afdea9ee5010 req-c8dc781f-ff98-4bea-aa66-2bd91aa8c88e service nova] Creating event network-vif-plugged:a2577441-6d47-4571-ac0b-7026c44bf9c8 for instance 038b7ba5-fad9-4216-ae8e-b42f78aec29e on nch1-master-1 Jul 23 22:23:49.392090 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-6a506cfd-bcc8-4993-b0a4-afdea9ee5010 req-c8dc781f-ff98-4bea-aa66-2bd91aa8c88e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086788 Jul 23 22:23:49.392826 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3915/6525] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:23:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:23:49.936531 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-12ae2dae-40a1-4f23-9f43-573f213a2731 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:23:49.937340 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-12ae2dae-40a1-4f23-9f43-573f213a2731 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 038b7ba5-fad9-4216-ae8e-b42f78aec29e] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:23:49.945244 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-12ae2dae-40a1-4f23-9f43-573f213a2731 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:23:49.945707 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-12ae2dae-40a1-4f23-9f43-573f213a2731 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:23:49.946558 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-12ae2dae-40a1-4f23-9f43-573f213a2731 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:23:49.947018 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-12ae2dae-40a1-4f23-9f43-573f213a2731 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:23:50.087764 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-12ae2dae-40a1-4f23-9f43-573f213a2731 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:23:50.095659 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-12ae2dae-40a1-4f23-9f43-573f213a2731 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/038b7ba5-fad9-4216-ae8e-b42f78aec29e" status: 200 len: 1390 microversion: 2.1 time: 0.216395 Jul 23 22:23:50.096242 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3916/6526] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:23:49 2022] GET /compute/v2.1/servers/038b7ba5-fad9-4216-ae8e-b42f78aec29e => generated 1390 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:23:51.122331 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-15bd77fa-ff6c-4ede-b2fb-ba35d012b154 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:23:51.123401 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-15bd77fa-ff6c-4ede-b2fb-ba35d012b154 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 038b7ba5-fad9-4216-ae8e-b42f78aec29e] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:23:51.126728 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:23:51.128056 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=12 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:23:51.130438 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:23:51.140657 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-15bd77fa-ff6c-4ede-b2fb-ba35d012b154 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:23:51.141134 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-15bd77fa-ff6c-4ede-b2fb-ba35d012b154 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:23:51.142018 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-15bd77fa-ff6c-4ede-b2fb-ba35d012b154 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:23:51.142471 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-15bd77fa-ff6c-4ede-b2fb-ba35d012b154 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:23:51.146114 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:23:51.282061 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-15bd77fa-ff6c-4ede-b2fb-ba35d012b154 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:23:51.289994 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-15bd77fa-ff6c-4ede-b2fb-ba35d012b154 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/038b7ba5-fad9-4216-ae8e-b42f78aec29e" status: 200 len: 1562 microversion: 2.1 time: 0.174599 Jul 23 22:23:51.290548 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3917/6527] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:23:51 2022] GET /compute/v2.1/servers/038b7ba5-fad9-4216-ae8e-b42f78aec29e => generated 1562 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:23:51.306452 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5968223c-29da-4b39-b81c-bf93bb0a1270 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:23:51.307060 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5968223c-29da-4b39-b81c-bf93bb0a1270 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 038b7ba5-fad9-4216-ae8e-b42f78aec29e] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:23:51.313200 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5968223c-29da-4b39-b81c-bf93bb0a1270 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:23:51.313656 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5968223c-29da-4b39-b81c-bf93bb0a1270 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:23:51.314478 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5968223c-29da-4b39-b81c-bf93bb0a1270 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:23:51.314931 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5968223c-29da-4b39-b81c-bf93bb0a1270 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:23:51.449110 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5968223c-29da-4b39-b81c-bf93bb0a1270 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:23:51.457383 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5968223c-29da-4b39-b81c-bf93bb0a1270 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/038b7ba5-fad9-4216-ae8e-b42f78aec29e" status: 200 len: 1562 microversion: 2.1 time: 0.154480 Jul 23 22:23:51.457988 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3918/6528] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:23:51 2022] GET /compute/v2.1/servers/038b7ba5-fad9-4216-ae8e-b42f78aec29e => generated 1562 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:23:53.092532 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-da7eeddf-c8a2-48dc-a9c4-74db413e2601 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:23:53.093492 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-da7eeddf-c8a2-48dc-a9c4-74db413e2601 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 038b7ba5-fad9-4216-ae8e-b42f78aec29e] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:23:53.101014 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-da7eeddf-c8a2-48dc-a9c4-74db413e2601 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:23:53.101559 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-da7eeddf-c8a2-48dc-a9c4-74db413e2601 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:23:53.102475 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-da7eeddf-c8a2-48dc-a9c4-74db413e2601 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:23:53.102956 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-da7eeddf-c8a2-48dc-a9c4-74db413e2601 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:23:53.242600 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-da7eeddf-c8a2-48dc-a9c4-74db413e2601 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:23:53.250863 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-da7eeddf-c8a2-48dc-a9c4-74db413e2601 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/038b7ba5-fad9-4216-ae8e-b42f78aec29e" status: 200 len: 1562 microversion: 2.1 time: 0.162475 Jul 23 22:23:53.251487 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3919/6529] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:23:53 2022] GET /compute/v2.1/servers/038b7ba5-fad9-4216-ae8e-b42f78aec29e => generated 1562 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:23:53.260492 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-b4125176-1ba9-4b27-859d-7b7f56ad053d req-acce5b19-dc65-49de-994d-b209d22223ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "038b7ba5-fad9-4216-ae8e-b42f78aec29e", "tag": "a2577441-6d47-4571-ac0b-7026c44bf9c8"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:23:53.268586 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-b4125176-1ba9-4b27-859d-7b7f56ad053d req-acce5b19-dc65-49de-994d-b209d22223ee service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:23:53.269013 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-b4125176-1ba9-4b27-859d-7b7f56ad053d req-acce5b19-dc65-49de-994d-b209d22223ee service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:23:53.280223 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-b4125176-1ba9-4b27-859d-7b7f56ad053d req-acce5b19-dc65-49de-994d-b209d22223ee service nova] Creating event network-changed:a2577441-6d47-4571-ac0b-7026c44bf9c8 for instance 038b7ba5-fad9-4216-ae8e-b42f78aec29e on nch1-master-1 Jul 23 22:23:53.285431 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-b4125176-1ba9-4b27-859d-7b7f56ad053d req-acce5b19-dc65-49de-994d-b209d22223ee service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032736 Jul 23 22:23:53.286371 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3920/6530] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:23:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:24:14.533530 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=7 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:24:14.534342 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=19 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:24:14.540430 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9a0755ed-812e-4031-9b2d-4466aa697e7e tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:24:14.541941 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-9a0755ed-812e-4031-9b2d-4466aa697e7e tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 038b7ba5-fad9-4216-ae8e-b42f78aec29e] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:24:14.552228 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9a0755ed-812e-4031-9b2d-4466aa697e7e tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:24:14.552623 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9a0755ed-812e-4031-9b2d-4466aa697e7e tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:24:14.553407 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9a0755ed-812e-4031-9b2d-4466aa697e7e tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:24:14.553879 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9a0755ed-812e-4031-9b2d-4466aa697e7e tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:24:14.622937 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9a0755ed-812e-4031-9b2d-4466aa697e7e tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "POST /compute/v2.1/servers/038b7ba5-fad9-4216-ae8e-b42f78aec29e/action" status: 200 len: 24537 microversion: 2.1 time: 0.092275 Jul 23 22:24:14.624039 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3921/6531] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 22:24:14 2022] POST /compute/v2.1/servers/038b7ba5-fad9-4216-ae8e-b42f78aec29e/action => generated 24537 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 23 22:24:25.603469 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ef542567-43fc-4264-8d2c-9b6e9e1a864c tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:24:25.606520 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:24:25.607185 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=4 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:24:25.613318 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ef542567-43fc-4264-8d2c-9b6e9e1a864c tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:24:25.613793 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ef542567-43fc-4264-8d2c-9b6e9e1a864c tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:24:25.638352 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ef542567-43fc-4264-8d2c-9b6e9e1a864c tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 038b7ba5-fad9-4216-ae8e-b42f78aec29e] Going to try to stop instance {{(pid=131320) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 23 22:24:25.687318 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ef542567-43fc-4264-8d2c-9b6e9e1a864c tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "POST /compute/v2.1/servers/038b7ba5-fad9-4216-ae8e-b42f78aec29e/action" status: 202 len: 0 microversion: 2.1 time: 0.089063 Jul 23 22:24:25.688140 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3922/6532] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 22:24:25 2022] POST /compute/v2.1/servers/038b7ba5-fad9-4216-ae8e-b42f78aec29e/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 22:24:25.697602 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-fb146352-1194-4486-8bc4-9d7374f4a600 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:24:25.698333 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-fb146352-1194-4486-8bc4-9d7374f4a600 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 038b7ba5-fad9-4216-ae8e-b42f78aec29e] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:24:25.705065 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fb146352-1194-4486-8bc4-9d7374f4a600 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:24:25.705495 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fb146352-1194-4486-8bc4-9d7374f4a600 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:24:25.706318 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fb146352-1194-4486-8bc4-9d7374f4a600 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:24:25.706737 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fb146352-1194-4486-8bc4-9d7374f4a600 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:24:25.847466 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-fb146352-1194-4486-8bc4-9d7374f4a600 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:24:25.855674 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-fb146352-1194-4486-8bc4-9d7374f4a600 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/038b7ba5-fad9-4216-ae8e-b42f78aec29e" status: 200 len: 1691 microversion: 2.1 time: 0.162574 Jul 23 22:24:25.856176 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3923/6533] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:24:25 2022] GET /compute/v2.1/servers/038b7ba5-fad9-4216-ae8e-b42f78aec29e => generated 1691 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:24:26.878241 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1d34b15d-3b4e-4491-95c1-01d23cf8911a tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:24:26.879262 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1d34b15d-3b4e-4491-95c1-01d23cf8911a tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 038b7ba5-fad9-4216-ae8e-b42f78aec29e] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:24:26.891208 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1d34b15d-3b4e-4491-95c1-01d23cf8911a tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:24:26.892008 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1d34b15d-3b4e-4491-95c1-01d23cf8911a tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:24:26.893205 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1d34b15d-3b4e-4491-95c1-01d23cf8911a tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:24:26.893965 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1d34b15d-3b4e-4491-95c1-01d23cf8911a tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:24:27.029471 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-1d34b15d-3b4e-4491-95c1-01d23cf8911a tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:24:27.037797 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1d34b15d-3b4e-4491-95c1-01d23cf8911a tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/038b7ba5-fad9-4216-ae8e-b42f78aec29e" status: 200 len: 1691 microversion: 2.1 time: 0.166266 Jul 23 22:24:27.038515 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3924/6534] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:24:26 2022] GET /compute/v2.1/servers/038b7ba5-fad9-4216-ae8e-b42f78aec29e => generated 1691 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:24:28.061696 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-197b58cf-e139-4021-932b-28e52cbd2776 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:24:28.062840 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-197b58cf-e139-4021-932b-28e52cbd2776 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 038b7ba5-fad9-4216-ae8e-b42f78aec29e] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:24:28.075313 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-197b58cf-e139-4021-932b-28e52cbd2776 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:24:28.075967 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-197b58cf-e139-4021-932b-28e52cbd2776 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:24:28.077258 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-197b58cf-e139-4021-932b-28e52cbd2776 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:24:28.078040 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-197b58cf-e139-4021-932b-28e52cbd2776 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:24:28.224878 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-197b58cf-e139-4021-932b-28e52cbd2776 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:24:28.236609 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-197b58cf-e139-4021-932b-28e52cbd2776 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/038b7ba5-fad9-4216-ae8e-b42f78aec29e" status: 200 len: 1691 microversion: 2.1 time: 0.181314 Jul 23 22:24:28.237360 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3925/6535] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:24:28 2022] GET /compute/v2.1/servers/038b7ba5-fad9-4216-ae8e-b42f78aec29e => generated 1691 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:24:29.259082 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b82e69cf-8c2b-4703-92b8-095c2bd0aeb7 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:24:29.259941 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b82e69cf-8c2b-4703-92b8-095c2bd0aeb7 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 038b7ba5-fad9-4216-ae8e-b42f78aec29e] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:24:29.268460 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b82e69cf-8c2b-4703-92b8-095c2bd0aeb7 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:24:29.269003 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b82e69cf-8c2b-4703-92b8-095c2bd0aeb7 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:24:29.269940 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b82e69cf-8c2b-4703-92b8-095c2bd0aeb7 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:24:29.270482 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b82e69cf-8c2b-4703-92b8-095c2bd0aeb7 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:24:29.417197 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b82e69cf-8c2b-4703-92b8-095c2bd0aeb7 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:24:29.428997 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b82e69cf-8c2b-4703-92b8-095c2bd0aeb7 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/038b7ba5-fad9-4216-ae8e-b42f78aec29e" status: 200 len: 1691 microversion: 2.1 time: 0.174484 Jul 23 22:24:29.429834 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3926/6536] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:24:29 2022] GET /compute/v2.1/servers/038b7ba5-fad9-4216-ae8e-b42f78aec29e => generated 1691 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:24:30.451567 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-314b1495-cf3a-4f18-b128-d4cfd430cfe6 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:24:30.452567 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-314b1495-cf3a-4f18-b128-d4cfd430cfe6 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 038b7ba5-fad9-4216-ae8e-b42f78aec29e] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:24:30.463056 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-314b1495-cf3a-4f18-b128-d4cfd430cfe6 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:24:30.463517 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-314b1495-cf3a-4f18-b128-d4cfd430cfe6 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:24:30.464306 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-314b1495-cf3a-4f18-b128-d4cfd430cfe6 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:24:30.464756 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-314b1495-cf3a-4f18-b128-d4cfd430cfe6 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:24:30.607293 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-314b1495-cf3a-4f18-b128-d4cfd430cfe6 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:24:30.615231 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-314b1495-cf3a-4f18-b128-d4cfd430cfe6 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/038b7ba5-fad9-4216-ae8e-b42f78aec29e" status: 200 len: 1691 microversion: 2.1 time: 0.170899 Jul 23 22:24:30.615860 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3927/6537] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:24:30 2022] GET /compute/v2.1/servers/038b7ba5-fad9-4216-ae8e-b42f78aec29e => generated 1691 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:24:31.636992 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-63ddb7fd-ba27-4c3a-a2d6-1bd49159f668 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:24:31.638258 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-63ddb7fd-ba27-4c3a-a2d6-1bd49159f668 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 038b7ba5-fad9-4216-ae8e-b42f78aec29e] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:24:31.649840 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-63ddb7fd-ba27-4c3a-a2d6-1bd49159f668 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:24:31.650657 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-63ddb7fd-ba27-4c3a-a2d6-1bd49159f668 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:24:31.651941 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-63ddb7fd-ba27-4c3a-a2d6-1bd49159f668 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:24:31.652685 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-63ddb7fd-ba27-4c3a-a2d6-1bd49159f668 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:24:31.797681 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-63ddb7fd-ba27-4c3a-a2d6-1bd49159f668 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:24:31.805787 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-63ddb7fd-ba27-4c3a-a2d6-1bd49159f668 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/038b7ba5-fad9-4216-ae8e-b42f78aec29e" status: 200 len: 1691 microversion: 2.1 time: 0.175626 Jul 23 22:24:31.806433 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3928/6538] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:24:31 2022] GET /compute/v2.1/servers/038b7ba5-fad9-4216-ae8e-b42f78aec29e => generated 1691 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:24:32.825804 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d432c98c-b005-4a5f-93e2-9309de7121b5 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:24:32.826441 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d432c98c-b005-4a5f-93e2-9309de7121b5 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 038b7ba5-fad9-4216-ae8e-b42f78aec29e] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:24:32.833893 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d432c98c-b005-4a5f-93e2-9309de7121b5 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:24:32.834371 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d432c98c-b005-4a5f-93e2-9309de7121b5 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:24:32.835147 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d432c98c-b005-4a5f-93e2-9309de7121b5 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:24:32.835605 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d432c98c-b005-4a5f-93e2-9309de7121b5 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:24:32.970959 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d432c98c-b005-4a5f-93e2-9309de7121b5 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:24:32.979234 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d432c98c-b005-4a5f-93e2-9309de7121b5 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/038b7ba5-fad9-4216-ae8e-b42f78aec29e" status: 200 len: 1691 microversion: 2.1 time: 0.158269 Jul 23 22:24:32.979828 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3929/6539] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:24:32 2022] GET /compute/v2.1/servers/038b7ba5-fad9-4216-ae8e-b42f78aec29e => generated 1691 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:24:34.001163 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-fba1ec18-7f7f-4259-82c5-1d4f4e8b5b44 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:24:34.002299 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-fba1ec18-7f7f-4259-82c5-1d4f4e8b5b44 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 038b7ba5-fad9-4216-ae8e-b42f78aec29e] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:24:34.014273 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fba1ec18-7f7f-4259-82c5-1d4f4e8b5b44 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:24:34.015042 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fba1ec18-7f7f-4259-82c5-1d4f4e8b5b44 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:24:34.016325 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fba1ec18-7f7f-4259-82c5-1d4f4e8b5b44 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:24:34.017073 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fba1ec18-7f7f-4259-82c5-1d4f4e8b5b44 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:24:34.167056 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-fba1ec18-7f7f-4259-82c5-1d4f4e8b5b44 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:24:34.175556 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-fba1ec18-7f7f-4259-82c5-1d4f4e8b5b44 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/038b7ba5-fad9-4216-ae8e-b42f78aec29e" status: 200 len: 1691 microversion: 2.1 time: 0.181395 Jul 23 22:24:34.176152 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3930/6540] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:24:33 2022] GET /compute/v2.1/servers/038b7ba5-fad9-4216-ae8e-b42f78aec29e => generated 1691 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:24:35.201358 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-bf46a00e-6f0d-4f32-8bb2-435adf97b5a4 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:24:35.202409 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-bf46a00e-6f0d-4f32-8bb2-435adf97b5a4 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 038b7ba5-fad9-4216-ae8e-b42f78aec29e] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:24:35.213779 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bf46a00e-6f0d-4f32-8bb2-435adf97b5a4 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:24:35.214277 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bf46a00e-6f0d-4f32-8bb2-435adf97b5a4 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:24:35.215062 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bf46a00e-6f0d-4f32-8bb2-435adf97b5a4 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:24:35.215542 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bf46a00e-6f0d-4f32-8bb2-435adf97b5a4 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:24:35.349159 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-bf46a00e-6f0d-4f32-8bb2-435adf97b5a4 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:24:35.360981 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-bf46a00e-6f0d-4f32-8bb2-435adf97b5a4 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/038b7ba5-fad9-4216-ae8e-b42f78aec29e" status: 200 len: 1691 microversion: 2.1 time: 0.166797 Jul 23 22:24:35.361841 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3931/6541] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:24:35 2022] GET /compute/v2.1/servers/038b7ba5-fad9-4216-ae8e-b42f78aec29e => generated 1691 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:24:36.384949 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-23bf77c2-c0b3-4675-ba1c-57cafaf5b92a tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:24:36.385606 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-23bf77c2-c0b3-4675-ba1c-57cafaf5b92a tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 038b7ba5-fad9-4216-ae8e-b42f78aec29e] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:24:36.393602 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-23bf77c2-c0b3-4675-ba1c-57cafaf5b92a tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:24:36.394154 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-23bf77c2-c0b3-4675-ba1c-57cafaf5b92a tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:24:36.394979 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-23bf77c2-c0b3-4675-ba1c-57cafaf5b92a tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:24:36.395449 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-23bf77c2-c0b3-4675-ba1c-57cafaf5b92a tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:24:36.534886 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-23bf77c2-c0b3-4675-ba1c-57cafaf5b92a tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:24:36.543380 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-23bf77c2-c0b3-4675-ba1c-57cafaf5b92a tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/038b7ba5-fad9-4216-ae8e-b42f78aec29e" status: 200 len: 1691 microversion: 2.1 time: 0.165208 Jul 23 22:24:36.543972 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3932/6542] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:24:36 2022] GET /compute/v2.1/servers/038b7ba5-fad9-4216-ae8e-b42f78aec29e => generated 1691 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:24:37.564936 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-50f4b905-2dac-400c-b13d-b5bed17eb9e5 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:24:37.566065 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-50f4b905-2dac-400c-b13d-b5bed17eb9e5 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 038b7ba5-fad9-4216-ae8e-b42f78aec29e] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:24:37.577911 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-50f4b905-2dac-400c-b13d-b5bed17eb9e5 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:24:37.578686 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-50f4b905-2dac-400c-b13d-b5bed17eb9e5 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:24:37.579986 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-50f4b905-2dac-400c-b13d-b5bed17eb9e5 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:24:37.580724 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-50f4b905-2dac-400c-b13d-b5bed17eb9e5 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:24:37.724489 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-50f4b905-2dac-400c-b13d-b5bed17eb9e5 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:24:37.732558 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-50f4b905-2dac-400c-b13d-b5bed17eb9e5 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/038b7ba5-fad9-4216-ae8e-b42f78aec29e" status: 200 len: 1691 microversion: 2.1 time: 0.174364 Jul 23 22:24:37.733369 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3933/6543] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:24:37 2022] GET /compute/v2.1/servers/038b7ba5-fad9-4216-ae8e-b42f78aec29e => generated 1691 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:24:38.750046 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a329cf80-41e2-48e7-a24f-19058a646015 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:24:38.750777 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a329cf80-41e2-48e7-a24f-19058a646015 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 038b7ba5-fad9-4216-ae8e-b42f78aec29e] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:24:38.758002 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a329cf80-41e2-48e7-a24f-19058a646015 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:24:38.758478 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a329cf80-41e2-48e7-a24f-19058a646015 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:24:38.759260 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a329cf80-41e2-48e7-a24f-19058a646015 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:24:38.759803 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a329cf80-41e2-48e7-a24f-19058a646015 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:24:38.903946 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a329cf80-41e2-48e7-a24f-19058a646015 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:24:38.915972 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a329cf80-41e2-48e7-a24f-19058a646015 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/038b7ba5-fad9-4216-ae8e-b42f78aec29e" status: 200 len: 1691 microversion: 2.1 time: 0.169799 Jul 23 22:24:38.916621 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3934/6544] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:24:38 2022] GET /compute/v2.1/servers/038b7ba5-fad9-4216-ae8e-b42f78aec29e => generated 1691 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:24:39.937708 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1bcf828e-3796-4709-8af7-58ddb0f2c9e5 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:24:39.938804 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1bcf828e-3796-4709-8af7-58ddb0f2c9e5 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 038b7ba5-fad9-4216-ae8e-b42f78aec29e] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:24:39.951059 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1bcf828e-3796-4709-8af7-58ddb0f2c9e5 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:24:39.951827 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1bcf828e-3796-4709-8af7-58ddb0f2c9e5 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:24:39.953110 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1bcf828e-3796-4709-8af7-58ddb0f2c9e5 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:24:39.953853 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1bcf828e-3796-4709-8af7-58ddb0f2c9e5 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:24:40.101792 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-1bcf828e-3796-4709-8af7-58ddb0f2c9e5 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:24:40.110223 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1bcf828e-3796-4709-8af7-58ddb0f2c9e5 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/038b7ba5-fad9-4216-ae8e-b42f78aec29e" status: 200 len: 1691 microversion: 2.1 time: 0.179220 Jul 23 22:24:40.110848 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3935/6545] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:24:39 2022] GET /compute/v2.1/servers/038b7ba5-fad9-4216-ae8e-b42f78aec29e => generated 1691 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:24:41.128327 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b7bbf86f-014f-4394-9aa4-4d9942311e09 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:24:41.129155 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b7bbf86f-014f-4394-9aa4-4d9942311e09 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 038b7ba5-fad9-4216-ae8e-b42f78aec29e] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:24:41.137180 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b7bbf86f-014f-4394-9aa4-4d9942311e09 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:24:41.137639 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b7bbf86f-014f-4394-9aa4-4d9942311e09 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:24:41.138471 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b7bbf86f-014f-4394-9aa4-4d9942311e09 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:24:41.138930 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b7bbf86f-014f-4394-9aa4-4d9942311e09 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:24:41.274352 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b7bbf86f-014f-4394-9aa4-4d9942311e09 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:24:41.282171 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b7bbf86f-014f-4394-9aa4-4d9942311e09 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/038b7ba5-fad9-4216-ae8e-b42f78aec29e" status: 200 len: 1668 microversion: 2.1 time: 0.158060 Jul 23 22:24:41.282728 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3936/6546] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:24:41 2022] GET /compute/v2.1/servers/038b7ba5-fad9-4216-ae8e-b42f78aec29e => generated 1668 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:24:42.384123 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-eccfa889-413d-4094-a692-a4f13500d12e tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:24:42.386399 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-eccfa889-413d-4094-a692-a4f13500d12e tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 038b7ba5-fad9-4216-ae8e-b42f78aec29e] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:24:42.394024 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-eccfa889-413d-4094-a692-a4f13500d12e tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:24:42.394481 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-eccfa889-413d-4094-a692-a4f13500d12e tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:24:42.395254 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-eccfa889-413d-4094-a692-a4f13500d12e tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:24:42.395693 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-eccfa889-413d-4094-a692-a4f13500d12e tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:24:42.413195 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:24:42.454777 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-eccfa889-413d-4094-a692-a4f13500d12e tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "POST /compute/v2.1/servers/038b7ba5-fad9-4216-ae8e-b42f78aec29e/action" status: 200 len: 38444 microversion: 2.1 time: 0.079599 Jul 23 22:24:42.455441 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3937/6547] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 22:24:42 2022] POST /compute/v2.1/servers/038b7ba5-fad9-4216-ae8e-b42f78aec29e/action => generated 38444 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 23 22:24:42.466955 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-7bd1779b-ad5d-48ce-88aa-04c7c4a1fba5 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:24:42.474352 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7bd1779b-ad5d-48ce-88aa-04c7c4a1fba5 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:24:42.474814 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7bd1779b-ad5d-48ce-88aa-04c7c4a1fba5 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:24:42.498207 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-7bd1779b-ad5d-48ce-88aa-04c7c4a1fba5 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 038b7ba5-fad9-4216-ae8e-b42f78aec29e] Going to try to start instance {{(pid=131320) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 23 22:24:42.544250 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-7bd1779b-ad5d-48ce-88aa-04c7c4a1fba5 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "POST /compute/v2.1/servers/038b7ba5-fad9-4216-ae8e-b42f78aec29e/action" status: 202 len: 0 microversion: 2.1 time: 0.081120 Jul 23 22:24:42.544952 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3938/6548] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 22:24:42 2022] POST /compute/v2.1/servers/038b7ba5-fad9-4216-ae8e-b42f78aec29e/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 22:24:42.554205 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-013a5adc-4337-496d-aa05-686d3216e650 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:24:42.554915 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-013a5adc-4337-496d-aa05-686d3216e650 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 038b7ba5-fad9-4216-ae8e-b42f78aec29e] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:24:42.561630 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-013a5adc-4337-496d-aa05-686d3216e650 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:24:42.562153 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-013a5adc-4337-496d-aa05-686d3216e650 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:24:42.562905 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-013a5adc-4337-496d-aa05-686d3216e650 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:24:42.563351 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-013a5adc-4337-496d-aa05-686d3216e650 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:24:42.705735 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-013a5adc-4337-496d-aa05-686d3216e650 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:24:42.714399 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-013a5adc-4337-496d-aa05-686d3216e650 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/038b7ba5-fad9-4216-ae8e-b42f78aec29e" status: 200 len: 1677 microversion: 2.1 time: 0.164745 Jul 23 22:24:42.715008 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3939/6549] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:24:42 2022] GET /compute/v2.1/servers/038b7ba5-fad9-4216-ae8e-b42f78aec29e => generated 1677 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:24:43.732760 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f8e414eb-3c2d-40a9-9985-f6e8847b7d58 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:24:43.733459 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f8e414eb-3c2d-40a9-9985-f6e8847b7d58 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 038b7ba5-fad9-4216-ae8e-b42f78aec29e] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:24:43.740595 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f8e414eb-3c2d-40a9-9985-f6e8847b7d58 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:24:43.741060 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f8e414eb-3c2d-40a9-9985-f6e8847b7d58 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:24:43.741843 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f8e414eb-3c2d-40a9-9985-f6e8847b7d58 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:24:43.742319 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f8e414eb-3c2d-40a9-9985-f6e8847b7d58 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:24:43.882358 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f8e414eb-3c2d-40a9-9985-f6e8847b7d58 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:24:43.890387 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f8e414eb-3c2d-40a9-9985-f6e8847b7d58 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/038b7ba5-fad9-4216-ae8e-b42f78aec29e" status: 200 len: 1681 microversion: 2.1 time: 0.161675 Jul 23 22:24:43.890967 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3940/6550] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:24:43 2022] GET /compute/v2.1/servers/038b7ba5-fad9-4216-ae8e-b42f78aec29e => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:25:08.122182 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-00066ea7-2e4a-4397-88a3-551330d83127 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:25:08.123658 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-00066ea7-2e4a-4397-88a3-551330d83127 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 038b7ba5-fad9-4216-ae8e-b42f78aec29e] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:25:08.127163 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=38 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:25:08.127837 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:25:08.134019 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-00066ea7-2e4a-4397-88a3-551330d83127 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:25:08.134524 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-00066ea7-2e4a-4397-88a3-551330d83127 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:25:08.135349 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-00066ea7-2e4a-4397-88a3-551330d83127 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:25:08.135822 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-00066ea7-2e4a-4397-88a3-551330d83127 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:25:08.202881 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-00066ea7-2e4a-4397-88a3-551330d83127 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "POST /compute/v2.1/servers/038b7ba5-fad9-4216-ae8e-b42f78aec29e/action" status: 200 len: 62987 microversion: 2.1 time: 0.087726 Jul 23 22:25:08.203548 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3941/6551] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 22:25:08 2022] POST /compute/v2.1/servers/038b7ba5-fad9-4216-ae8e-b42f78aec29e/action => generated 62987 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 23 22:25:15.250060 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-bf7776b4-6ad3-4743-ade0-931e01c7122e tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:25:15.250701 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-bf7776b4-6ad3-4743-ade0-931e01c7122e tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 038b7ba5-fad9-4216-ae8e-b42f78aec29e] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:25:15.257974 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bf7776b4-6ad3-4743-ade0-931e01c7122e tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:25:15.258427 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bf7776b4-6ad3-4743-ade0-931e01c7122e tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:25:15.259201 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bf7776b4-6ad3-4743-ade0-931e01c7122e tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:25:15.259638 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bf7776b4-6ad3-4743-ade0-931e01c7122e tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:25:15.285835 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-bf7776b4-6ad3-4743-ade0-931e01c7122e tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 038b7ba5-fad9-4216-ae8e-b42f78aec29e] Going to try to terminate instance {{(pid=131320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 22:25:15.366165 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-bf7776b4-6ad3-4743-ade0-931e01c7122e tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "DELETE /compute/v2.1/servers/038b7ba5-fad9-4216-ae8e-b42f78aec29e" status: 204 len: 0 microversion: 2.1 time: 0.119561 Jul 23 22:25:15.366869 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3942/6552] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 22:25:15 2022] DELETE /compute/v2.1/servers/038b7ba5-fad9-4216-ae8e-b42f78aec29e => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 23 22:25:15.372459 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-e6595d8b-697d-45e3-b456-05899093f421 req-769b9e78-b1ea-476c-a4d6-6a0aac34e6ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "038b7ba5-fad9-4216-ae8e-b42f78aec29e", "tag": "a2577441-6d47-4571-ac0b-7026c44bf9c8"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:25:15.380594 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-e6595d8b-697d-45e3-b456-05899093f421 req-769b9e78-b1ea-476c-a4d6-6a0aac34e6ee service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:25:15.381054 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-e6595d8b-697d-45e3-b456-05899093f421 req-769b9e78-b1ea-476c-a4d6-6a0aac34e6ee service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:25:15.392479 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-e6595d8b-697d-45e3-b456-05899093f421 req-769b9e78-b1ea-476c-a4d6-6a0aac34e6ee service nova] Creating event network-changed:a2577441-6d47-4571-ac0b-7026c44bf9c8 for instance 038b7ba5-fad9-4216-ae8e-b42f78aec29e on nch1-master-1 Jul 23 22:25:15.397468 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-e6595d8b-697d-45e3-b456-05899093f421 req-769b9e78-b1ea-476c-a4d6-6a0aac34e6ee service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028840 Jul 23 22:25:15.398088 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3943/6553] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:25:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:25:15.403461 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-35f9ee7e-3f42-4e0d-8eb9-768c8afced53 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:25:15.404177 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-35f9ee7e-3f42-4e0d-8eb9-768c8afced53 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 038b7ba5-fad9-4216-ae8e-b42f78aec29e] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:25:15.410596 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-35f9ee7e-3f42-4e0d-8eb9-768c8afced53 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:25:15.411049 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-35f9ee7e-3f42-4e0d-8eb9-768c8afced53 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:25:15.411818 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-35f9ee7e-3f42-4e0d-8eb9-768c8afced53 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:25:15.412256 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-35f9ee7e-3f42-4e0d-8eb9-768c8afced53 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:25:15.547458 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-35f9ee7e-3f42-4e0d-8eb9-768c8afced53 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:25:15.555216 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-35f9ee7e-3f42-4e0d-8eb9-768c8afced53 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/038b7ba5-fad9-4216-ae8e-b42f78aec29e" status: 200 len: 1687 microversion: 2.1 time: 0.156007 Jul 23 22:25:15.556009 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3944/6554] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:25:15 2022] GET /compute/v2.1/servers/038b7ba5-fad9-4216-ae8e-b42f78aec29e => generated 1687 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:25:16.577454 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f4f4b7a2-f8af-46f5-bfe8-0a605e61684d tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:25:16.578627 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f4f4b7a2-f8af-46f5-bfe8-0a605e61684d tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 038b7ba5-fad9-4216-ae8e-b42f78aec29e] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:25:16.590618 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f4f4b7a2-f8af-46f5-bfe8-0a605e61684d tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:25:16.591285 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f4f4b7a2-f8af-46f5-bfe8-0a605e61684d tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:25:16.592578 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f4f4b7a2-f8af-46f5-bfe8-0a605e61684d tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:25:16.593325 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f4f4b7a2-f8af-46f5-bfe8-0a605e61684d tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:25:16.735984 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f4f4b7a2-f8af-46f5-bfe8-0a605e61684d tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:25:16.744431 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f4f4b7a2-f8af-46f5-bfe8-0a605e61684d tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/038b7ba5-fad9-4216-ae8e-b42f78aec29e" status: 200 len: 1687 microversion: 2.1 time: 0.174067 Jul 23 22:25:16.745031 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3945/6555] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:25:16 2022] GET /compute/v2.1/servers/038b7ba5-fad9-4216-ae8e-b42f78aec29e => generated 1687 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:25:17.575042 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-218692f8-5a30-4982-8cb6-e17a2d511425 req-d8e2111c-479b-4a70-bbeb-dbd3941f34a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "038b7ba5-fad9-4216-ae8e-b42f78aec29e", "name": "network-vif-deleted", "tag": "a2577441-6d47-4571-ac0b-7026c44bf9c8"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:25:17.585369 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-218692f8-5a30-4982-8cb6-e17a2d511425 req-d8e2111c-479b-4a70-bbeb-dbd3941f34a3 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:25:17.586046 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-218692f8-5a30-4982-8cb6-e17a2d511425 req-d8e2111c-479b-4a70-bbeb-dbd3941f34a3 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:25:17.600594 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-218692f8-5a30-4982-8cb6-e17a2d511425 req-d8e2111c-479b-4a70-bbeb-dbd3941f34a3 service nova] Creating event network-vif-deleted:a2577441-6d47-4571-ac0b-7026c44bf9c8 for instance 038b7ba5-fad9-4216-ae8e-b42f78aec29e on nch1-master-1 Jul 23 22:25:17.606088 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-218692f8-5a30-4982-8cb6-e17a2d511425 req-d8e2111c-479b-4a70-bbeb-dbd3941f34a3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089683 Jul 23 22:25:17.606718 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3946/6556] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:25:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 22:25:17.762551 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-80021b76-53e7-4d12-8a9d-62f8f225e6d6 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:25:17.763278 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-80021b76-53e7-4d12-8a9d-62f8f225e6d6 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 038b7ba5-fad9-4216-ae8e-b42f78aec29e] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:25:17.769951 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-80021b76-53e7-4d12-8a9d-62f8f225e6d6 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:25:17.770419 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-80021b76-53e7-4d12-8a9d-62f8f225e6d6 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:25:17.771174 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-80021b76-53e7-4d12-8a9d-62f8f225e6d6 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:25:17.771600 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-80021b76-53e7-4d12-8a9d-62f8f225e6d6 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:25:17.804353 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-80021b76-53e7-4d12-8a9d-62f8f225e6d6 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:25:17.804803 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-80021b76-53e7-4d12-8a9d-62f8f225e6d6 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:25:17.805261 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.objects.instance [None req-80021b76-53e7-4d12-8a9d-62f8f225e6d6 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lazy-loading 'fault' on Instance uuid 038b7ba5-fad9-4216-ae8e-b42f78aec29e {{(pid=131320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 22:25:17.856489 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-80021b76-53e7-4d12-8a9d-62f8f225e6d6 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:25:17.864418 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-80021b76-53e7-4d12-8a9d-62f8f225e6d6 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/038b7ba5-fad9-4216-ae8e-b42f78aec29e" status: 200 len: 1355 microversion: 2.1 time: 0.106269 Jul 23 22:25:17.865013 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3947/6557] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:25:17 2022] GET /compute/v2.1/servers/038b7ba5-fad9-4216-ae8e-b42f78aec29e => generated 1355 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:25:18.886190 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b0e80627-9c15-4c56-a63e-95894284d083 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:25:18.887072 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b0e80627-9c15-4c56-a63e-95894284d083 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 038b7ba5-fad9-4216-ae8e-b42f78aec29e] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:25:18.896229 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b0e80627-9c15-4c56-a63e-95894284d083 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:25:18.896688 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b0e80627-9c15-4c56-a63e-95894284d083 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:25:18.897492 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b0e80627-9c15-4c56-a63e-95894284d083 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:25:18.897964 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b0e80627-9c15-4c56-a63e-95894284d083 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:25:18.911962 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-b0e80627-9c15-4c56-a63e-95894284d083 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] HTTP exception thrown: Instance 038b7ba5-fad9-4216-ae8e-b42f78aec29e could not be found. Jul 23 22:25:18.913615 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b0e80627-9c15-4c56-a63e-95894284d083 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Request method failure captured: Jul 23 22:25:18.913615 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/038b7ba5-fad9-4216-ae8e-b42f78aec29e HTTP/1.1 Jul 23 22:25:18.913615 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 22:25:18.913615 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 22:25:18.913615 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 22:25:18.913615 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 22:25:18.913615 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 22:25:18.913615 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 22:25:18.913615 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 22:25:18.913615 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 22:25:18.913615 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3HPJGU05HbBTEvLxfT4BhGztnBRWhLwkU8QutIkTRTvVibf-V1mkLz3byZWX90Z2v50VOJRv9MqhrAotUJSfT2hBQ8C_NuI2cZ3sL6bxRnPnmAfb7udSijYdHU5_chgf6SP2LARXnPx77YiG880S5DV74F87lCIERZhTyKn6pgRdpVQ Jul 23 22:25:18.913615 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 22:25:18.913615 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 22:25:18.913615 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 22:25:18.913615 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 22:25:18.913615 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 22:25:18.913615 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 22:25:18.913615 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: a14b865dcbd14987870351ce4e45aaac Jul 23 22:25:18.913615 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1025071309 Jul 23 22:25:18.913615 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 22:25:18.913615 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 22:25:18.913615 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a14b865dcbd14987870351ce4e45aaac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a14b865dcbd14987870351ce4e45aaac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a14b865dcbd14987870351ce4e45aaac", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a14b865dcbd14987870351ce4e45aaac"}]}] Jul 23 22:25:18.913615 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1025071309 Jul 23 22:25:18.913615 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: a14b865dcbd14987870351ce4e45aaac Jul 23 22:25:18.913615 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1025071309 Jul 23 22:25:18.913615 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-TestNetworkAdvancedServerOps-1025071309-project Jul 23 22:25:18.913615 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 22:25:18.913615 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 22:25:18.913615 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: a686380934d042b4a078eb60e9bb6712 Jul 23 22:25:18.913615 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1025071309-project Jul 23 22:25:18.913615 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 22:25:18.913615 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance 038b7ba5-fad9-4216-ae8e-b42f78aec29e could not be found. Jul 23 22:25:18.913615 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '038b7ba5-fad9-4216-ae8e-b42f78aec29e'} Jul 23 22:25:18.913615 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 22:25:18.913615 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:25:18.913615 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 22:25:18.913615 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 22:25:18.913615 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 22:25:18.913615 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 22:25:18.913615 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 22:25:18.913615 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 22:25:18.913615 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 22:25:18.913615 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 22:25:18.913615 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 038b7ba5-fad9-4216-ae8e-b42f78aec29e could not be found. Jul 23 22:25:18.913615 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:25:18.913615 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:25:18.913615 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:25:18.913615 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:25:18.913615 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:25:18.913615 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:25:18.913615 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 22:25:18.913615 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 22:25:18.913615 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 22:25:18.913615 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 22:25:18.913615 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 22:25:18.913615 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 22:25:18.913615 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 22:25:18.913615 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 22:25:18.913615 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 22:25:18.913615 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 22:25:18.913615 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 038b7ba5-fad9-4216-ae8e-b42f78aec29e could not be found. Jul 23 22:25:18.913615 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:25:18.913615 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:25:18.917839 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:25:18.917839 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:25:18.917839 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:25:18.917839 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:25:18.917839 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 22:25:18.917839 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 22:25:18.917839 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 038b7ba5-fad9-4216-ae8e-b42f78aec29e could not be found. Jul 23 22:25:18.917839 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:25:18.917839 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b0e80627-9c15-4c56-a63e-95894284d083 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Returning 404 to user: Instance 038b7ba5-fad9-4216-ae8e-b42f78aec29e could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 22:25:18.917839 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b0e80627-9c15-4c56-a63e-95894284d083 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/038b7ba5-fad9-4216-ae8e-b42f78aec29e" status: 404 len: 111 microversion: 2.1 time: 0.034739 Jul 23 22:25:18.917839 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3948/6558] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:25:18 2022] GET /compute/v2.1/servers/038b7ba5-fad9-4216-ae8e-b42f78aec29e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 22:25:22.322612 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f3397480-320b-4d62-b7f9-e3592fb14a31 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '.version_select at 0x7f0b46431c10>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:25:22.342801 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f3397480-320b-4d62-b7f9-e3592fb14a31 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-387300973" status: 202 len: 0 microversion: 2.1 time: 0.024095 Jul 23 22:25:22.343397 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3949/6559] 10.222.0.17 () {58 vars in 1280 bytes} [Sat Jul 23 22:25:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-387300973 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 23 22:25:22.382943 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-7deb0b98-7d69-4610-a2e8-2a4095f53526 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Action: 'create', calling method: .version_select at 0x7f0b4656e790>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1556865015", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHLTLq5bBcM09vkKx+k23OYR9uDpILqCy6gfTDjfNqQ/oe0byPp2DVZy6j1+8N9OyvpoXS01nDnbO8en7IcY0ysEjY5ZqT9ZaMv5ffZ18o13Zy1YA2vNnlj8UqIdAA0dDQ=="}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:25:22.398271 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-7deb0b98-7d69-4610-a2e8-2a4095f53526 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Getting quotas for project a14b865dcbd14987870351ce4e45aaac. Resources: {'key_pairs'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 22:25:22.403444 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-7deb0b98-7d69-4610-a2e8-2a4095f53526 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Getting quotas for user a686380934d042b4a078eb60e9bb6712 and project a14b865dcbd14987870351ce4e45aaac. Resources: {'key_pairs'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 22:25:22.427448 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-7deb0b98-7d69-4610-a2e8-2a4095f53526 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.048743 Jul 23 22:25:22.428041 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3950/6560] 10.222.0.17 () {60 vars in 1158 bytes} [Sat Jul 23 22:25:22 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:25:28.095565 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-cf1e316e-151e-4262-9fc0-ee833afe70eb tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1883330128", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "networks": [{"uuid": "5dd9abd5-2359-4548-b035-8b81d294ce95"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1556865015", "security_groups": [{"name": "tempest-secgroup-smoke-99886361"}]}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:25:28.224544 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-cf1e316e-151e-4262-9fc0-ee833afe70eb tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] validate_networks() for [('5dd9abd5-2359-4548-b035-8b81d294ce95', None, None, None, None, None)] {{(pid=131320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 22:25:28.724266 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-cf1e316e-151e-4262-9fc0-ee833afe70eb tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 22:25:28.724706 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-cf1e316e-151e-4262-9fc0-ee833afe70eb tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 22:25:28.725195 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-cf1e316e-151e-4262-9fc0-ee833afe70eb tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 22:25:28.725892 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-cf1e316e-151e-4262-9fc0-ee833afe70eb tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 22:25:28.726463 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-cf1e316e-151e-4262-9fc0-ee833afe70eb tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 22:25:28.747345 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cf1e316e-151e-4262-9fc0-ee833afe70eb tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:25:28.748094 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cf1e316e-151e-4262-9fc0-ee833afe70eb tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:25:28.752327 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cf1e316e-151e-4262-9fc0-ee833afe70eb tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:25:28.753055 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cf1e316e-151e-4262-9fc0-ee833afe70eb tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:25:28.777020 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-cf1e316e-151e-4262-9fc0-ee833afe70eb tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Getting quotas for project a14b865dcbd14987870351ce4e45aaac. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 22:25:28.783224 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-cf1e316e-151e-4262-9fc0-ee833afe70eb tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Getting quotas for user a686380934d042b4a078eb60e9bb6712 and project a14b865dcbd14987870351ce4e45aaac. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 22:25:28.796954 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-cf1e316e-151e-4262-9fc0-ee833afe70eb tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Going to run 1 instances... {{(pid=131320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 22:25:28.799405 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-cf1e316e-151e-4262-9fc0-ee833afe70eb tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 3c63d001-073a-4d59-af36-3a550bdc4ba2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 22:25:28.849976 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-cf1e316e-151e-4262-9fc0-ee833afe70eb tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.758461 Jul 23 22:25:28.855586 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3951/6561] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 22:25:28 2022] POST /compute/v2.1/servers => generated 404 bytes in 760 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 23 22:25:28.866674 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0f098f2e-2547-4af8-b607-e8cef060634a tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:25:28.867310 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-0f098f2e-2547-4af8-b607-e8cef060634a tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 3c63d001-073a-4d59-af36-3a550bdc4ba2] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:25:28.940035 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-0f098f2e-2547-4af8-b607-e8cef060634a tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:25:28.949092 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-0f098f2e-2547-4af8-b607-e8cef060634a tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/3c63d001-073a-4d59-af36-3a550bdc4ba2" status: 200 len: 1267 microversion: 2.1 time: 0.090379 Jul 23 22:25:28.950748 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3952/6562] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:25:28 2022] GET /compute/v2.1/servers/3c63d001-073a-4d59-af36-3a550bdc4ba2 => generated 1267 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:25:29.966873 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c3de7a46-320a-4daa-b5c5-962a61021e39 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:25:29.967556 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c3de7a46-320a-4daa-b5c5-962a61021e39 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 3c63d001-073a-4d59-af36-3a550bdc4ba2] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:25:29.975546 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c3de7a46-320a-4daa-b5c5-962a61021e39 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:25:29.976299 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c3de7a46-320a-4daa-b5c5-962a61021e39 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:25:29.977245 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c3de7a46-320a-4daa-b5c5-962a61021e39 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:25:29.977840 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c3de7a46-320a-4daa-b5c5-962a61021e39 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:25:30.069126 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c3de7a46-320a-4daa-b5c5-962a61021e39 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:25:30.080089 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c3de7a46-320a-4daa-b5c5-962a61021e39 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/3c63d001-073a-4d59-af36-3a550bdc4ba2" status: 200 len: 1327 microversion: 2.1 time: 0.117187 Jul 23 22:25:30.080804 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3953/6563] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:25:29 2022] GET /compute/v2.1/servers/3c63d001-073a-4d59-af36-3a550bdc4ba2 => generated 1327 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:25:31.097301 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-7b38a3eb-f1df-40b9-b7de-dd53f1d8cb58 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:25:31.097968 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-7b38a3eb-f1df-40b9-b7de-dd53f1d8cb58 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 3c63d001-073a-4d59-af36-3a550bdc4ba2] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:25:31.105526 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7b38a3eb-f1df-40b9-b7de-dd53f1d8cb58 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:25:31.106273 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7b38a3eb-f1df-40b9-b7de-dd53f1d8cb58 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:25:31.107123 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7b38a3eb-f1df-40b9-b7de-dd53f1d8cb58 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:25:31.107566 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7b38a3eb-f1df-40b9-b7de-dd53f1d8cb58 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:25:31.322263 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-7b38a3eb-f1df-40b9-b7de-dd53f1d8cb58 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:25:31.331423 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-7b38a3eb-f1df-40b9-b7de-dd53f1d8cb58 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/3c63d001-073a-4d59-af36-3a550bdc4ba2" status: 200 len: 1391 microversion: 2.1 time: 0.238417 Jul 23 22:25:31.332165 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3954/6564] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:25:31 2022] GET /compute/v2.1/servers/3c63d001-073a-4d59-af36-3a550bdc4ba2 => generated 1391 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:25:31.517775 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-0d29b865-605d-4d08-8d30-6705532b72d5 req-405e10dd-cf3b-429f-b2ac-5ae6e8d5d65a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c63d001-073a-4d59-af36-3a550bdc4ba2", "tag": "41fa2b66-afdc-4595-9c01-e1da7f78165a"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:25:31.527506 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-0d29b865-605d-4d08-8d30-6705532b72d5 req-405e10dd-cf3b-429f-b2ac-5ae6e8d5d65a service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:25:31.527968 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-0d29b865-605d-4d08-8d30-6705532b72d5 req-405e10dd-cf3b-429f-b2ac-5ae6e8d5d65a service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:25:31.543328 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-0d29b865-605d-4d08-8d30-6705532b72d5 req-405e10dd-cf3b-429f-b2ac-5ae6e8d5d65a service nova] Creating event network-changed:41fa2b66-afdc-4595-9c01-e1da7f78165a for instance 3c63d001-073a-4d59-af36-3a550bdc4ba2 on nch2-master-1 Jul 23 22:25:31.548531 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-0d29b865-605d-4d08-8d30-6705532b72d5 req-405e10dd-cf3b-429f-b2ac-5ae6e8d5d65a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035052 Jul 23 22:25:31.549129 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3955/6565] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:25:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:25:32.355340 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f2a71821-dbe1-4b88-9e76-01915c1c1000 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:25:32.356546 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f2a71821-dbe1-4b88-9e76-01915c1c1000 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 3c63d001-073a-4d59-af36-3a550bdc4ba2] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:25:32.365792 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f2a71821-dbe1-4b88-9e76-01915c1c1000 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:25:32.366281 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f2a71821-dbe1-4b88-9e76-01915c1c1000 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:25:32.367066 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f2a71821-dbe1-4b88-9e76-01915c1c1000 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:25:32.367502 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f2a71821-dbe1-4b88-9e76-01915c1c1000 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:25:32.512650 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f2a71821-dbe1-4b88-9e76-01915c1c1000 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:25:32.520602 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f2a71821-dbe1-4b88-9e76-01915c1c1000 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/3c63d001-073a-4d59-af36-3a550bdc4ba2" status: 200 len: 1391 microversion: 2.1 time: 0.173835 Jul 23 22:25:32.521153 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3956/6566] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:25:32 2022] GET /compute/v2.1/servers/3c63d001-073a-4d59-af36-3a550bdc4ba2 => generated 1391 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:25:33.538371 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-aa4bd8dc-2085-416c-ae4a-bed009c21d3e tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:25:33.539037 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-aa4bd8dc-2085-416c-ae4a-bed009c21d3e tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 3c63d001-073a-4d59-af36-3a550bdc4ba2] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:25:33.546624 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-aa4bd8dc-2085-416c-ae4a-bed009c21d3e tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:25:33.547092 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-aa4bd8dc-2085-416c-ae4a-bed009c21d3e tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:25:33.547906 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-aa4bd8dc-2085-416c-ae4a-bed009c21d3e tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:25:33.548333 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-aa4bd8dc-2085-416c-ae4a-bed009c21d3e tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:25:33.688963 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-aa4bd8dc-2085-416c-ae4a-bed009c21d3e tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:25:33.696916 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-aa4bd8dc-2085-416c-ae4a-bed009c21d3e tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/3c63d001-073a-4d59-af36-3a550bdc4ba2" status: 200 len: 1391 microversion: 2.1 time: 0.162793 Jul 23 22:25:33.697519 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3957/6567] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:25:33 2022] GET /compute/v2.1/servers/3c63d001-073a-4d59-af36-3a550bdc4ba2 => generated 1391 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:25:34.717938 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-29771b7e-f3f3-46f6-bd85-f92ec29f89bd tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:25:34.718631 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-29771b7e-f3f3-46f6-bd85-f92ec29f89bd tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 3c63d001-073a-4d59-af36-3a550bdc4ba2] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:25:34.729003 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-29771b7e-f3f3-46f6-bd85-f92ec29f89bd tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:25:34.729576 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-29771b7e-f3f3-46f6-bd85-f92ec29f89bd tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:25:34.730617 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-29771b7e-f3f3-46f6-bd85-f92ec29f89bd tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:25:34.731238 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-29771b7e-f3f3-46f6-bd85-f92ec29f89bd tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:25:34.868750 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-29771b7e-f3f3-46f6-bd85-f92ec29f89bd tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:25:34.876791 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-29771b7e-f3f3-46f6-bd85-f92ec29f89bd tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/3c63d001-073a-4d59-af36-3a550bdc4ba2" status: 200 len: 1391 microversion: 2.1 time: 0.165225 Jul 23 22:25:34.877371 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3958/6568] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:25:34 2022] GET /compute/v2.1/servers/3c63d001-073a-4d59-af36-3a550bdc4ba2 => generated 1391 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:25:35.219037 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-24023378-d2ea-4b8c-a006-223dad06b7a7 req-bd97c1a7-c2bb-4461-b2c9-e5904c80e996 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c63d001-073a-4d59-af36-3a550bdc4ba2", "name": "network-vif-plugged", "status": "completed", "tag": "41fa2b66-afdc-4595-9c01-e1da7f78165a"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:25:35.228805 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-24023378-d2ea-4b8c-a006-223dad06b7a7 req-bd97c1a7-c2bb-4461-b2c9-e5904c80e996 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:25:35.229471 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-24023378-d2ea-4b8c-a006-223dad06b7a7 req-bd97c1a7-c2bb-4461-b2c9-e5904c80e996 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:25:35.241795 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-24023378-d2ea-4b8c-a006-223dad06b7a7 req-bd97c1a7-c2bb-4461-b2c9-e5904c80e996 service nova] Creating event network-vif-plugged:41fa2b66-afdc-4595-9c01-e1da7f78165a for instance 3c63d001-073a-4d59-af36-3a550bdc4ba2 on nch2-master-1 Jul 23 22:25:35.246881 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-24023378-d2ea-4b8c-a006-223dad06b7a7 req-bd97c1a7-c2bb-4461-b2c9-e5904c80e996 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031720 Jul 23 22:25:35.247489 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3959/6569] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:25:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:25:35.895807 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-721a4e12-cf21-4fbc-a156-8dc682a35d22 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:25:35.896587 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-721a4e12-cf21-4fbc-a156-8dc682a35d22 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 3c63d001-073a-4d59-af36-3a550bdc4ba2] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:25:35.903494 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-721a4e12-cf21-4fbc-a156-8dc682a35d22 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:25:35.903945 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-721a4e12-cf21-4fbc-a156-8dc682a35d22 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:25:35.904722 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-721a4e12-cf21-4fbc-a156-8dc682a35d22 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:25:35.905198 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-721a4e12-cf21-4fbc-a156-8dc682a35d22 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:25:36.039832 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-721a4e12-cf21-4fbc-a156-8dc682a35d22 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:25:36.047783 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-721a4e12-cf21-4fbc-a156-8dc682a35d22 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/3c63d001-073a-4d59-af36-3a550bdc4ba2" status: 200 len: 1391 microversion: 2.1 time: 0.157226 Jul 23 22:25:36.048356 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3960/6570] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:25:35 2022] GET /compute/v2.1/servers/3c63d001-073a-4d59-af36-3a550bdc4ba2 => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:25:37.069201 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3ea8febb-bda7-4a0b-a1cf-309533fe2de3 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:25:37.070272 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-3ea8febb-bda7-4a0b-a1cf-309533fe2de3 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 3c63d001-073a-4d59-af36-3a550bdc4ba2] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:25:37.081964 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3ea8febb-bda7-4a0b-a1cf-309533fe2de3 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:25:37.082454 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3ea8febb-bda7-4a0b-a1cf-309533fe2de3 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:25:37.083229 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3ea8febb-bda7-4a0b-a1cf-309533fe2de3 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:25:37.083677 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3ea8febb-bda7-4a0b-a1cf-309533fe2de3 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:25:37.225181 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-3ea8febb-bda7-4a0b-a1cf-309533fe2de3 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:25:37.232798 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-3ea8febb-bda7-4a0b-a1cf-309533fe2de3 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/3c63d001-073a-4d59-af36-3a550bdc4ba2" status: 200 len: 1562 microversion: 2.1 time: 0.170218 Jul 23 22:25:37.233370 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3961/6571] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:25:37 2022] GET /compute/v2.1/servers/3c63d001-073a-4d59-af36-3a550bdc4ba2 => generated 1562 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:25:37.248607 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-969397f7-a407-4f32-9e87-b4ee6b9a3e06 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:25:37.249210 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-969397f7-a407-4f32-9e87-b4ee6b9a3e06 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 3c63d001-073a-4d59-af36-3a550bdc4ba2] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:25:37.255122 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-969397f7-a407-4f32-9e87-b4ee6b9a3e06 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:25:37.255580 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-969397f7-a407-4f32-9e87-b4ee6b9a3e06 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:25:37.256344 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-969397f7-a407-4f32-9e87-b4ee6b9a3e06 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:25:37.256789 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-969397f7-a407-4f32-9e87-b4ee6b9a3e06 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:25:37.398677 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-969397f7-a407-4f32-9e87-b4ee6b9a3e06 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:25:37.402289 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:25:37.407084 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-969397f7-a407-4f32-9e87-b4ee6b9a3e06 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/3c63d001-073a-4d59-af36-3a550bdc4ba2" status: 200 len: 1562 microversion: 2.1 time: 0.162031 Jul 23 22:25:37.407700 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3962/6572] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:25:37 2022] GET /compute/v2.1/servers/3c63d001-073a-4d59-af36-3a550bdc4ba2 => generated 1562 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:25:39.378038 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4407427d-3e10-4b6f-b29b-bad517b65c5a tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:25:39.378670 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-4407427d-3e10-4b6f-b29b-bad517b65c5a tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 3c63d001-073a-4d59-af36-3a550bdc4ba2] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:25:39.381685 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:25:39.382390 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=12 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:25:39.383472 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:25:39.389428 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4407427d-3e10-4b6f-b29b-bad517b65c5a tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:25:39.389994 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4407427d-3e10-4b6f-b29b-bad517b65c5a tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:25:39.390810 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4407427d-3e10-4b6f-b29b-bad517b65c5a tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:25:39.391255 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4407427d-3e10-4b6f-b29b-bad517b65c5a tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:25:39.530931 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-4407427d-3e10-4b6f-b29b-bad517b65c5a tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:25:39.538953 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4407427d-3e10-4b6f-b29b-bad517b65c5a tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/3c63d001-073a-4d59-af36-3a550bdc4ba2" status: 200 len: 1562 microversion: 2.1 time: 0.164989 Jul 23 22:25:39.539501 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3963/6573] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:25:39 2022] GET /compute/v2.1/servers/3c63d001-073a-4d59-af36-3a550bdc4ba2 => generated 1562 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:25:39.543950 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-0134bbdb-6b33-427e-bd15-30384c20ced8 req-58f218de-c7d9-469f-9fa1-f84cc14d1147 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c63d001-073a-4d59-af36-3a550bdc4ba2", "tag": "41fa2b66-afdc-4595-9c01-e1da7f78165a"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:25:39.551921 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-0134bbdb-6b33-427e-bd15-30384c20ced8 req-58f218de-c7d9-469f-9fa1-f84cc14d1147 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:25:39.552487 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-0134bbdb-6b33-427e-bd15-30384c20ced8 req-58f218de-c7d9-469f-9fa1-f84cc14d1147 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:25:39.567289 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-0134bbdb-6b33-427e-bd15-30384c20ced8 req-58f218de-c7d9-469f-9fa1-f84cc14d1147 service nova] Creating event network-changed:41fa2b66-afdc-4595-9c01-e1da7f78165a for instance 3c63d001-073a-4d59-af36-3a550bdc4ba2 on nch2-master-1 Jul 23 22:25:39.572462 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-0134bbdb-6b33-427e-bd15-30384c20ced8 req-58f218de-c7d9-469f-9fa1-f84cc14d1147 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031842 Jul 23 22:25:39.573222 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3964/6574] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:25:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:26:00.850061 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=3 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:26:00.850814 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=8 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:26:00.855513 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-acf1f006-4a99-4312-abe9-7003765f2694 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:26:00.856534 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-acf1f006-4a99-4312-abe9-7003765f2694 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 3c63d001-073a-4d59-af36-3a550bdc4ba2] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:26:00.863664 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-acf1f006-4a99-4312-abe9-7003765f2694 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:26:00.864120 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-acf1f006-4a99-4312-abe9-7003765f2694 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:26:00.864893 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-acf1f006-4a99-4312-abe9-7003765f2694 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:26:00.865347 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-acf1f006-4a99-4312-abe9-7003765f2694 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:26:00.916788 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-acf1f006-4a99-4312-abe9-7003765f2694 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "POST /compute/v2.1/servers/3c63d001-073a-4d59-af36-3a550bdc4ba2/action" status: 200 len: 24552 microversion: 2.1 time: 0.068768 Jul 23 22:26:00.917423 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3965/6575] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 22:26:00 2022] POST /compute/v2.1/servers/3c63d001-073a-4d59-af36-3a550bdc4ba2/action => generated 24552 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 23 22:26:11.965994 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e0adb5de-abef-4250-b53c-cd8da672e92d tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:26:11.966758 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e0adb5de-abef-4250-b53c-cd8da672e92d tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 3c63d001-073a-4d59-af36-3a550bdc4ba2] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:26:11.969489 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:26:11.970206 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=4 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:26:11.977008 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e0adb5de-abef-4250-b53c-cd8da672e92d tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:26:11.977495 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e0adb5de-abef-4250-b53c-cd8da672e92d tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:26:11.978405 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e0adb5de-abef-4250-b53c-cd8da672e92d tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:26:11.978864 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e0adb5de-abef-4250-b53c-cd8da672e92d tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:26:12.002823 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.objects.instance [None req-e0adb5de-abef-4250-b53c-cd8da672e92d tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lazy-loading 'flavor' on Instance uuid 3c63d001-073a-4d59-af36-3a550bdc4ba2 {{(pid=131320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 22:26:12.104442 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e0adb5de-abef-4250-b53c-cd8da672e92d tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "POST /compute/v2.1/servers/3c63d001-073a-4d59-af36-3a550bdc4ba2/action" status: 202 len: 0 microversion: 2.1 time: 0.143847 Jul 23 22:26:12.105077 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3966/6576] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 22:26:11 2022] POST /compute/v2.1/servers/3c63d001-073a-4d59-af36-3a550bdc4ba2/action => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 22:26:12.113644 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-cc82552b-299b-42e5-bf44-8cf8fc2bfd74 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:26:12.114512 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-cc82552b-299b-42e5-bf44-8cf8fc2bfd74 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 3c63d001-073a-4d59-af36-3a550bdc4ba2] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:26:12.121068 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cc82552b-299b-42e5-bf44-8cf8fc2bfd74 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:26:12.121579 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cc82552b-299b-42e5-bf44-8cf8fc2bfd74 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:26:12.122434 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cc82552b-299b-42e5-bf44-8cf8fc2bfd74 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:26:12.122874 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-cc82552b-299b-42e5-bf44-8cf8fc2bfd74 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:26:12.267539 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-cc82552b-299b-42e5-bf44-8cf8fc2bfd74 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:26:12.275280 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-cc82552b-299b-42e5-bf44-8cf8fc2bfd74 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/3c63d001-073a-4d59-af36-3a550bdc4ba2" status: 200 len: 1689 microversion: 2.1 time: 0.165616 Jul 23 22:26:12.275878 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3967/6577] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:26:12 2022] GET /compute/v2.1/servers/3c63d001-073a-4d59-af36-3a550bdc4ba2 => generated 1689 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:26:13.292995 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d93ab94d-d740-4436-a443-09422d3b9ca1 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:26:13.293678 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d93ab94d-d740-4436-a443-09422d3b9ca1 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 3c63d001-073a-4d59-af36-3a550bdc4ba2] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:26:13.301128 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d93ab94d-d740-4436-a443-09422d3b9ca1 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:26:13.301562 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d93ab94d-d740-4436-a443-09422d3b9ca1 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:26:13.302420 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d93ab94d-d740-4436-a443-09422d3b9ca1 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:26:13.303645 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d93ab94d-d740-4436-a443-09422d3b9ca1 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:26:13.457463 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d93ab94d-d740-4436-a443-09422d3b9ca1 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:26:13.467324 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d93ab94d-d740-4436-a443-09422d3b9ca1 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/3c63d001-073a-4d59-af36-3a550bdc4ba2" status: 200 len: 1672 microversion: 2.1 time: 0.178417 Jul 23 22:26:13.467879 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3968/6578] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:26:13 2022] GET /compute/v2.1/servers/3c63d001-073a-4d59-af36-3a550bdc4ba2 => generated 1672 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:26:14.574209 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0d050e92-66da-49dc-b3bb-424d357a9f07 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:26:14.575543 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-0d050e92-66da-49dc-b3bb-424d357a9f07 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 3c63d001-073a-4d59-af36-3a550bdc4ba2] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:26:14.582989 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0d050e92-66da-49dc-b3bb-424d357a9f07 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:26:14.583450 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0d050e92-66da-49dc-b3bb-424d357a9f07 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:26:14.584240 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0d050e92-66da-49dc-b3bb-424d357a9f07 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:26:14.584686 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0d050e92-66da-49dc-b3bb-424d357a9f07 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:26:14.634277 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-0d050e92-66da-49dc-b3bb-424d357a9f07 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "POST /compute/v2.1/servers/3c63d001-073a-4d59-af36-3a550bdc4ba2/action" status: 200 len: 38362 microversion: 2.1 time: 0.065380 Jul 23 22:26:14.634806 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3969/6579] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 22:26:14 2022] POST /compute/v2.1/servers/3c63d001-073a-4d59-af36-3a550bdc4ba2/action => generated 38362 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 23 22:26:14.646513 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ac2d574e-e779-4803-83d9-f5a7555d8872 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:26:14.647201 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ac2d574e-e779-4803-83d9-f5a7555d8872 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 3c63d001-073a-4d59-af36-3a550bdc4ba2] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:26:14.654936 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ac2d574e-e779-4803-83d9-f5a7555d8872 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:26:14.655401 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ac2d574e-e779-4803-83d9-f5a7555d8872 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:26:14.656187 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ac2d574e-e779-4803-83d9-f5a7555d8872 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:26:14.656634 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ac2d574e-e779-4803-83d9-f5a7555d8872 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:26:14.732284 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ac2d574e-e779-4803-83d9-f5a7555d8872 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "POST /compute/v2.1/servers/3c63d001-073a-4d59-af36-3a550bdc4ba2/action" status: 202 len: 0 microversion: 2.1 time: 0.089215 Jul 23 22:26:14.733570 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3970/6580] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 22:26:14 2022] POST /compute/v2.1/servers/3c63d001-073a-4d59-af36-3a550bdc4ba2/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 22:26:14.742278 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e4404fba-3d25-4416-87c5-2e4c2c6b515b tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:26:14.743158 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e4404fba-3d25-4416-87c5-2e4c2c6b515b tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 3c63d001-073a-4d59-af36-3a550bdc4ba2] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:26:14.750064 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e4404fba-3d25-4416-87c5-2e4c2c6b515b tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:26:14.750567 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e4404fba-3d25-4416-87c5-2e4c2c6b515b tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:26:14.751392 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e4404fba-3d25-4416-87c5-2e4c2c6b515b tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:26:14.751796 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e4404fba-3d25-4416-87c5-2e4c2c6b515b tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:26:14.984115 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e4404fba-3d25-4416-87c5-2e4c2c6b515b tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:26:14.992749 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e4404fba-3d25-4416-87c5-2e4c2c6b515b tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/3c63d001-073a-4d59-af36-3a550bdc4ba2" status: 200 len: 1678 microversion: 2.1 time: 0.254607 Jul 23 22:26:14.993343 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3971/6581] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:26:14 2022] GET /compute/v2.1/servers/3c63d001-073a-4d59-af36-3a550bdc4ba2 => generated 1678 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:26:16.015619 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ec07b595-d54e-495f-a974-31dfafdca54d tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:26:16.016708 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ec07b595-d54e-495f-a974-31dfafdca54d tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 3c63d001-073a-4d59-af36-3a550bdc4ba2] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:26:16.028651 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ec07b595-d54e-495f-a974-31dfafdca54d tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:26:16.029440 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ec07b595-d54e-495f-a974-31dfafdca54d tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:26:16.030809 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ec07b595-d54e-495f-a974-31dfafdca54d tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:26:16.031627 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ec07b595-d54e-495f-a974-31dfafdca54d tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:26:16.176926 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ec07b595-d54e-495f-a974-31dfafdca54d tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:26:16.184992 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ec07b595-d54e-495f-a974-31dfafdca54d tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/3c63d001-073a-4d59-af36-3a550bdc4ba2" status: 200 len: 1678 microversion: 2.1 time: 0.176272 Jul 23 22:26:16.185572 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3972/6582] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:26:16 2022] GET /compute/v2.1/servers/3c63d001-073a-4d59-af36-3a550bdc4ba2 => generated 1678 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:26:17.207220 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f4ed093c-b380-481f-8e86-874552228299 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:26:17.208231 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f4ed093c-b380-481f-8e86-874552228299 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 3c63d001-073a-4d59-af36-3a550bdc4ba2] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:26:17.217254 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f4ed093c-b380-481f-8e86-874552228299 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:26:17.217823 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f4ed093c-b380-481f-8e86-874552228299 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:26:17.218628 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f4ed093c-b380-481f-8e86-874552228299 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:26:17.219089 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f4ed093c-b380-481f-8e86-874552228299 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:26:17.364817 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f4ed093c-b380-481f-8e86-874552228299 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:26:17.372836 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f4ed093c-b380-481f-8e86-874552228299 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/3c63d001-073a-4d59-af36-3a550bdc4ba2" status: 200 len: 1681 microversion: 2.1 time: 0.172834 Jul 23 22:26:17.373400 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3973/6583] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:26:17 2022] GET /compute/v2.1/servers/3c63d001-073a-4d59-af36-3a550bdc4ba2 => generated 1681 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:26:17.473672 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5aba1205-ced6-45ef-a86f-3bb5a1bfd125 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:26:17.474999 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5aba1205-ced6-45ef-a86f-3bb5a1bfd125 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 3c63d001-073a-4d59-af36-3a550bdc4ba2] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:26:17.482848 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5aba1205-ced6-45ef-a86f-3bb5a1bfd125 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:26:17.483305 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5aba1205-ced6-45ef-a86f-3bb5a1bfd125 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:26:17.484087 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5aba1205-ced6-45ef-a86f-3bb5a1bfd125 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:26:17.484525 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5aba1205-ced6-45ef-a86f-3bb5a1bfd125 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:26:17.525484 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5aba1205-ced6-45ef-a86f-3bb5a1bfd125 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "POST /compute/v2.1/servers/3c63d001-073a-4d59-af36-3a550bdc4ba2/action" status: 200 len: 38362 microversion: 2.1 time: 0.057518 Jul 23 22:26:17.526144 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3974/6584] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 22:26:17 2022] POST /compute/v2.1/servers/3c63d001-073a-4d59-af36-3a550bdc4ba2/action => generated 38362 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 23 22:26:18.542913 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a6edd6b8-badf-41eb-ab11-3bb309680958 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:26:18.543538 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a6edd6b8-badf-41eb-ab11-3bb309680958 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 3c63d001-073a-4d59-af36-3a550bdc4ba2] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:26:18.551267 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a6edd6b8-badf-41eb-ab11-3bb309680958 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:26:18.551722 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a6edd6b8-badf-41eb-ab11-3bb309680958 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:26:18.552504 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a6edd6b8-badf-41eb-ab11-3bb309680958 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:26:18.552943 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a6edd6b8-badf-41eb-ab11-3bb309680958 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:26:18.579860 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a6edd6b8-badf-41eb-ab11-3bb309680958 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 3c63d001-073a-4d59-af36-3a550bdc4ba2] Going to try to terminate instance {{(pid=131320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 22:26:18.662640 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a6edd6b8-badf-41eb-ab11-3bb309680958 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "DELETE /compute/v2.1/servers/3c63d001-073a-4d59-af36-3a550bdc4ba2" status: 204 len: 0 microversion: 2.1 time: 0.123610 Jul 23 22:26:18.663586 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3975/6585] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 22:26:18 2022] DELETE /compute/v2.1/servers/3c63d001-073a-4d59-af36-3a550bdc4ba2 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 22:26:18.672269 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-a657fdf4-f9d5-4543-8a28-46ce40bd7ba1 req-7de9596d-4cc6-4d3c-a58c-c2a7054232e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c63d001-073a-4d59-af36-3a550bdc4ba2", "tag": "41fa2b66-afdc-4595-9c01-e1da7f78165a"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:26:18.680471 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-a657fdf4-f9d5-4543-8a28-46ce40bd7ba1 req-7de9596d-4cc6-4d3c-a58c-c2a7054232e6 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:26:18.680928 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-a657fdf4-f9d5-4543-8a28-46ce40bd7ba1 req-7de9596d-4cc6-4d3c-a58c-c2a7054232e6 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:26:18.696053 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-a657fdf4-f9d5-4543-8a28-46ce40bd7ba1 req-7de9596d-4cc6-4d3c-a58c-c2a7054232e6 service nova] Creating event network-changed:41fa2b66-afdc-4595-9c01-e1da7f78165a for instance 3c63d001-073a-4d59-af36-3a550bdc4ba2 on nch2-master-1 Jul 23 22:26:18.701247 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-a657fdf4-f9d5-4543-8a28-46ce40bd7ba1 req-7de9596d-4cc6-4d3c-a58c-c2a7054232e6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033093 Jul 23 22:26:18.701845 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3976/6586] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:26:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:26:18.706969 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-daaeea6a-ccc9-43ae-878c-e4768d2790fb tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:26:18.707683 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-daaeea6a-ccc9-43ae-878c-e4768d2790fb tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 3c63d001-073a-4d59-af36-3a550bdc4ba2] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:26:18.714086 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-daaeea6a-ccc9-43ae-878c-e4768d2790fb tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:26:18.714546 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-daaeea6a-ccc9-43ae-878c-e4768d2790fb tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:26:18.715349 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-daaeea6a-ccc9-43ae-878c-e4768d2790fb tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:26:18.715792 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-daaeea6a-ccc9-43ae-878c-e4768d2790fb tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:26:18.853182 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-daaeea6a-ccc9-43ae-878c-e4768d2790fb tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:26:18.861473 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-daaeea6a-ccc9-43ae-878c-e4768d2790fb tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/3c63d001-073a-4d59-af36-3a550bdc4ba2" status: 200 len: 1687 microversion: 2.1 time: 0.158340 Jul 23 22:26:18.862294 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3977/6587] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:26:18 2022] GET /compute/v2.1/servers/3c63d001-073a-4d59-af36-3a550bdc4ba2 => generated 1687 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:26:19.884200 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-66ac6d9b-5a2f-49f0-b2e7-ea83f938a9e0 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:26:19.885174 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-66ac6d9b-5a2f-49f0-b2e7-ea83f938a9e0 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 3c63d001-073a-4d59-af36-3a550bdc4ba2] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:26:19.896741 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-66ac6d9b-5a2f-49f0-b2e7-ea83f938a9e0 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:26:19.897518 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-66ac6d9b-5a2f-49f0-b2e7-ea83f938a9e0 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:26:19.898868 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-66ac6d9b-5a2f-49f0-b2e7-ea83f938a9e0 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:26:19.899620 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-66ac6d9b-5a2f-49f0-b2e7-ea83f938a9e0 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:26:20.119522 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-66ac6d9b-5a2f-49f0-b2e7-ea83f938a9e0 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:26:20.129802 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-66ac6d9b-5a2f-49f0-b2e7-ea83f938a9e0 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/3c63d001-073a-4d59-af36-3a550bdc4ba2" status: 200 len: 1687 microversion: 2.1 time: 0.252367 Jul 23 22:26:20.130418 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3978/6588] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:26:19 2022] GET /compute/v2.1/servers/3c63d001-073a-4d59-af36-3a550bdc4ba2 => generated 1687 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:26:20.947877 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-76ab8864-5732-49e9-9731-21e9c9eae678 req-349385df-8365-4c6a-9110-254f4fd17591 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c63d001-073a-4d59-af36-3a550bdc4ba2", "name": "network-vif-deleted", "tag": "41fa2b66-afdc-4595-9c01-e1da7f78165a"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:26:20.959491 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-76ab8864-5732-49e9-9731-21e9c9eae678 req-349385df-8365-4c6a-9110-254f4fd17591 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:26:20.959949 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-76ab8864-5732-49e9-9731-21e9c9eae678 req-349385df-8365-4c6a-9110-254f4fd17591 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:26:20.971788 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-76ab8864-5732-49e9-9731-21e9c9eae678 req-349385df-8365-4c6a-9110-254f4fd17591 service nova] Creating event network-vif-deleted:41fa2b66-afdc-4595-9c01-e1da7f78165a for instance 3c63d001-073a-4d59-af36-3a550bdc4ba2 on nch2-master-1 Jul 23 22:26:20.977453 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-76ab8864-5732-49e9-9731-21e9c9eae678 req-349385df-8365-4c6a-9110-254f4fd17591 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033375 Jul 23 22:26:20.978094 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3979/6589] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:26:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 22:26:21.155701 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4835c87d-03f8-43f2-ab7d-bb3d52a75ea0 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:26:21.156695 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-4835c87d-03f8-43f2-ab7d-bb3d52a75ea0 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 3c63d001-073a-4d59-af36-3a550bdc4ba2] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:26:21.167184 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4835c87d-03f8-43f2-ab7d-bb3d52a75ea0 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:26:21.167882 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4835c87d-03f8-43f2-ab7d-bb3d52a75ea0 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:26:21.168653 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4835c87d-03f8-43f2-ab7d-bb3d52a75ea0 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:26:21.169099 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4835c87d-03f8-43f2-ab7d-bb3d52a75ea0 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:26:21.173206 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:26:21.204312 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4835c87d-03f8-43f2-ab7d-bb3d52a75ea0 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:26:21.204788 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4835c87d-03f8-43f2-ab7d-bb3d52a75ea0 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:26:21.205239 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.objects.instance [None req-4835c87d-03f8-43f2-ab7d-bb3d52a75ea0 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lazy-loading 'fault' on Instance uuid 3c63d001-073a-4d59-af36-3a550bdc4ba2 {{(pid=131320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 22:26:21.249161 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-4835c87d-03f8-43f2-ab7d-bb3d52a75ea0 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a686380934d042b4a078eb60e9bb6712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14b865dcbd14987870351ce4e45aaac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:26:21.257384 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4835c87d-03f8-43f2-ab7d-bb3d52a75ea0 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/3c63d001-073a-4d59-af36-3a550bdc4ba2" status: 200 len: 1357 microversion: 2.1 time: 0.110071 Jul 23 22:26:21.258188 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3980/6590] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:26:21 2022] GET /compute/v2.1/servers/3c63d001-073a-4d59-af36-3a550bdc4ba2 => generated 1357 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:26:22.279528 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6f0eb517-6881-4607-b681-fe4cec6f763b tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:26:22.280734 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6f0eb517-6881-4607-b681-fe4cec6f763b tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] [instance: 3c63d001-073a-4d59-af36-3a550bdc4ba2] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:26:22.292715 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6f0eb517-6881-4607-b681-fe4cec6f763b tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:26:22.293473 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6f0eb517-6881-4607-b681-fe4cec6f763b tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:26:22.294809 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6f0eb517-6881-4607-b681-fe4cec6f763b tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:26:22.295542 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6f0eb517-6881-4607-b681-fe4cec6f763b tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:26:22.314347 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-6f0eb517-6881-4607-b681-fe4cec6f763b tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] HTTP exception thrown: Instance 3c63d001-073a-4d59-af36-3a550bdc4ba2 could not be found. Jul 23 22:26:22.316006 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6f0eb517-6881-4607-b681-fe4cec6f763b tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Request method failure captured: Jul 23 22:26:22.316006 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/3c63d001-073a-4d59-af36-3a550bdc4ba2 HTTP/1.1 Jul 23 22:26:22.316006 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 22:26:22.316006 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 22:26:22.316006 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 22:26:22.316006 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 22:26:22.316006 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 22:26:22.316006 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 22:26:22.316006 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 22:26:22.316006 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 22:26:22.316006 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3HPJGU05HbBTEvLxfT4BhGztnBRWhLwkU8QutIkTRTvVibf-V1mkLz3byZWX90Z2v50VOJRv9MqhrAotUJSfT2hBQ8C_NuI2cZ3sL6bxRnPnmAfb7udSijYdHU5_chgf6SP2LARXnPx77YiG880S5DV74F87lCIERZhTyKn6pgRdpVQ Jul 23 22:26:22.316006 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 22:26:22.316006 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 22:26:22.316006 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 22:26:22.316006 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 22:26:22.316006 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 22:26:22.316006 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 22:26:22.316006 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: a14b865dcbd14987870351ce4e45aaac Jul 23 22:26:22.316006 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1025071309 Jul 23 22:26:22.316006 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 22:26:22.316006 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 22:26:22.316006 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a14b865dcbd14987870351ce4e45aaac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/a14b865dcbd14987870351ce4e45aaac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_a14b865dcbd14987870351ce4e45aaac", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/a14b865dcbd14987870351ce4e45aaac"}]}] Jul 23 22:26:22.316006 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1025071309 Jul 23 22:26:22.316006 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: a14b865dcbd14987870351ce4e45aaac Jul 23 22:26:22.316006 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1025071309 Jul 23 22:26:22.316006 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-TestNetworkAdvancedServerOps-1025071309-project Jul 23 22:26:22.316006 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 22:26:22.316006 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 22:26:22.316006 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: a686380934d042b4a078eb60e9bb6712 Jul 23 22:26:22.316006 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1025071309-project Jul 23 22:26:22.316006 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 22:26:22.316006 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance 3c63d001-073a-4d59-af36-3a550bdc4ba2 could not be found. Jul 23 22:26:22.316006 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': '3c63d001-073a-4d59-af36-3a550bdc4ba2'} Jul 23 22:26:22.316006 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 22:26:22.316006 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:26:22.316006 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 22:26:22.316006 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 22:26:22.316006 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 22:26:22.316006 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 22:26:22.316006 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 22:26:22.316006 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 22:26:22.316006 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 22:26:22.316006 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 22:26:22.316006 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c63d001-073a-4d59-af36-3a550bdc4ba2 could not be found. Jul 23 22:26:22.316006 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:26:22.316006 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:26:22.316006 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:26:22.316006 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:26:22.316006 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:26:22.316006 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:26:22.316006 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 22:26:22.316006 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 22:26:22.316006 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 22:26:22.316006 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 22:26:22.316006 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 22:26:22.316006 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 22:26:22.316006 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 22:26:22.316006 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 22:26:22.316006 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 22:26:22.316006 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 22:26:22.316006 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c63d001-073a-4d59-af36-3a550bdc4ba2 could not be found. Jul 23 22:26:22.316006 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:26:22.316006 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:26:22.320805 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:26:22.320805 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:26:22.320805 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:26:22.320805 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:26:22.320805 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 22:26:22.320805 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 22:26:22.320805 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c63d001-073a-4d59-af36-3a550bdc4ba2 could not be found. Jul 23 22:26:22.320805 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:26:22.320805 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6f0eb517-6881-4607-b681-fe4cec6f763b tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Returning 404 to user: Instance 3c63d001-073a-4d59-af36-3a550bdc4ba2 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 22:26:22.320805 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6f0eb517-6881-4607-b681-fe4cec6f763b tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "GET /compute/v2.1/servers/3c63d001-073a-4d59-af36-3a550bdc4ba2" status: 404 len: 111 microversion: 2.1 time: 0.044801 Jul 23 22:26:22.320805 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3981/6591] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:26:22 2022] GET /compute/v2.1/servers/3c63d001-073a-4d59-af36-3a550bdc4ba2 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 22:26:25.695826 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-21c43ae9-bab1-4e31-924c-1ca517b9ad14 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] Calling method '.version_select at 0x7f0b46484c10>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:26:25.725100 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-21c43ae9-bab1-4e31-924c-1ca517b9ad14 tempest-TestNetworkAdvancedServerOps-1025071309 tempest-TestNetworkAdvancedServerOps-1025071309-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1556865015" status: 202 len: 0 microversion: 2.1 time: 0.033277 Jul 23 22:26:25.725703 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3982/6592] 10.222.0.17 () {58 vars in 1283 bytes} [Sat Jul 23 22:26:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1556865015 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 23 22:26:37.218166 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=8 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:26:37.219196 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:26:37.383791 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-7a1111b9-97fd-4576-944e-aa9424c568f1 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Action: 'create', calling method: .version_select at 0x7f0b477723a0>, body: {"keypair": {"name": "tempest-TestShelveInstance-229113962", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLInSmN7wu5vSZC05cVEOXBWRupacvVGOStz/tZWy3PikuM5RVD0+R3e5Ti7yPgmgfUrY3tiCUQWN5H3ixzFtNHJa5YjP22GY455RmHBBpw4WkAyWOC2Pb2kU0s4q/xFrA=="}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:26:37.399693 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-7a1111b9-97fd-4576-944e-aa9424c568f1 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Getting quotas for project b45dbfa8603541f686c9b2e0bf291dd7. Resources: {'key_pairs'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 22:26:37.405282 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-7a1111b9-97fd-4576-944e-aa9424c568f1 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Getting quotas for user c72a610b85c64df7ab471c6ee1d68dcd and project b45dbfa8603541f686c9b2e0bf291dd7. Resources: {'key_pairs'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 22:26:37.433566 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-7a1111b9-97fd-4576-944e-aa9424c568f1 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.222259 Jul 23 22:26:37.434287 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3983/6593] 10.222.0.17 () {60 vars in 1158 bytes} [Sat Jul 23 22:26:37 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 22:26:38.429184 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-67fdb5b1-ad91-4ca7-8f19-9d43447cddf2 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1929254312", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-229113962", "security_groups": [{"name": "tempest-secgroup-smoke-277114904"}], "networks": [{"uuid": "91c454a1-698f-498c-8012-a0aa7c2e62bf"}]}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:26:38.549772 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-67fdb5b1-ad91-4ca7-8f19-9d43447cddf2 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] validate_networks() for [('91c454a1-698f-498c-8012-a0aa7c2e62bf', None, None, None, None, None)] {{(pid=131320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 22:26:38.945404 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-67fdb5b1-ad91-4ca7-8f19-9d43447cddf2 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 22:26:38.945833 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-67fdb5b1-ad91-4ca7-8f19-9d43447cddf2 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 22:26:38.946350 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-67fdb5b1-ad91-4ca7-8f19-9d43447cddf2 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 22:26:38.946764 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-67fdb5b1-ad91-4ca7-8f19-9d43447cddf2 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 22:26:38.947237 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-67fdb5b1-ad91-4ca7-8f19-9d43447cddf2 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 22:26:38.957453 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-67fdb5b1-ad91-4ca7-8f19-9d43447cddf2 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:26:38.957940 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-67fdb5b1-ad91-4ca7-8f19-9d43447cddf2 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:26:38.958748 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-67fdb5b1-ad91-4ca7-8f19-9d43447cddf2 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:26:38.959190 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-67fdb5b1-ad91-4ca7-8f19-9d43447cddf2 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:26:38.976165 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-67fdb5b1-ad91-4ca7-8f19-9d43447cddf2 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Getting quotas for project b45dbfa8603541f686c9b2e0bf291dd7. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 22:26:38.981918 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-67fdb5b1-ad91-4ca7-8f19-9d43447cddf2 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Getting quotas for user c72a610b85c64df7ab471c6ee1d68dcd and project b45dbfa8603541f686c9b2e0bf291dd7. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 22:26:38.994830 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-67fdb5b1-ad91-4ca7-8f19-9d43447cddf2 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Going to run 1 instances... {{(pid=131320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 22:26:38.997224 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-67fdb5b1-ad91-4ca7-8f19-9d43447cddf2 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] [instance: f76e640c-0d54-4edc-aa13-fbbdd6307c38] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 22:26:39.045277 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-67fdb5b1-ad91-4ca7-8f19-9d43447cddf2 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.620750 Jul 23 22:26:39.046613 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3984/6594] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 22:26:38 2022] POST /compute/v2.1/servers => generated 405 bytes in 623 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 23 22:26:39.057129 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-52f9fa8b-e117-4a0c-9332-85e43e70617b tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:26:39.058131 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-52f9fa8b-e117-4a0c-9332-85e43e70617b tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] [instance: f76e640c-0d54-4edc-aa13-fbbdd6307c38] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:26:39.112845 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-52f9fa8b-e117-4a0c-9332-85e43e70617b tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a610b85c64df7ab471c6ee1d68dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45dbfa8603541f686c9b2e0bf291dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:26:39.119599 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-52f9fa8b-e117-4a0c-9332-85e43e70617b tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] 10.222.0.17 "GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38" status: 200 len: 1246 microversion: 2.1 time: 0.066820 Jul 23 22:26:39.120182 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3985/6595] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:26:39 2022] GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38 => generated 1246 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:26:40.143097 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5858acf4-f95f-4466-aeba-0d20d4a1b890 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:26:40.143863 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5858acf4-f95f-4466-aeba-0d20d4a1b890 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] [instance: f76e640c-0d54-4edc-aa13-fbbdd6307c38] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:26:40.245095 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5858acf4-f95f-4466-aeba-0d20d4a1b890 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a610b85c64df7ab471c6ee1d68dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45dbfa8603541f686c9b2e0bf291dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:26:40.252987 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5858acf4-f95f-4466-aeba-0d20d4a1b890 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] 10.222.0.17 "GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38" status: 200 len: 1246 microversion: 2.1 time: 0.120124 Jul 23 22:26:40.253758 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3986/6596] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:26:40 2022] GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38 => generated 1246 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:26:41.269567 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-fc7278c0-37c2-40ce-b65d-4399c8986ad8 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:26:41.270272 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-fc7278c0-37c2-40ce-b65d-4399c8986ad8 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] [instance: f76e640c-0d54-4edc-aa13-fbbdd6307c38] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:26:41.329815 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-fc7278c0-37c2-40ce-b65d-4399c8986ad8 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a610b85c64df7ab471c6ee1d68dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45dbfa8603541f686c9b2e0bf291dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:26:41.336927 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-fc7278c0-37c2-40ce-b65d-4399c8986ad8 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] 10.222.0.17 "GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38" status: 200 len: 1246 microversion: 2.1 time: 0.071423 Jul 23 22:26:41.337508 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3987/6597] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:26:41 2022] GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38 => generated 1246 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:26:42.354689 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-fa49cfa6-be3e-4ec3-adf5-ba984818d0ba tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:26:42.355382 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-fa49cfa6-be3e-4ec3-adf5-ba984818d0ba tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] [instance: f76e640c-0d54-4edc-aa13-fbbdd6307c38] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:26:42.413310 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-fa49cfa6-be3e-4ec3-adf5-ba984818d0ba tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a610b85c64df7ab471c6ee1d68dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45dbfa8603541f686c9b2e0bf291dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:26:42.428212 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-fa49cfa6-be3e-4ec3-adf5-ba984818d0ba tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] 10.222.0.17 "GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38" status: 200 len: 1246 microversion: 2.1 time: 0.077513 Jul 23 22:26:42.428937 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3988/6598] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:26:42 2022] GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38 => generated 1246 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:26:43.447010 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-fbb4f458-09a8-47ef-8858-e9f1fe277752 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:26:43.447796 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-fbb4f458-09a8-47ef-8858-e9f1fe277752 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] [instance: f76e640c-0d54-4edc-aa13-fbbdd6307c38] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:26:43.455968 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fbb4f458-09a8-47ef-8858-e9f1fe277752 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:26:43.456427 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fbb4f458-09a8-47ef-8858-e9f1fe277752 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:26:43.457206 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fbb4f458-09a8-47ef-8858-e9f1fe277752 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:26:43.457651 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fbb4f458-09a8-47ef-8858-e9f1fe277752 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:26:43.521045 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-fbb4f458-09a8-47ef-8858-e9f1fe277752 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a610b85c64df7ab471c6ee1d68dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45dbfa8603541f686c9b2e0bf291dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:26:43.529663 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-fbb4f458-09a8-47ef-8858-e9f1fe277752 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] 10.222.0.17 "GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38" status: 200 len: 1250 microversion: 2.1 time: 0.087659 Jul 23 22:26:43.530335 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3989/6599] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:26:43 2022] GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38 => generated 1250 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:26:44.551943 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f442399d-6293-4e07-8675-e3b9f8718bc9 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:26:44.552614 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f442399d-6293-4e07-8675-e3b9f8718bc9 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] [instance: f76e640c-0d54-4edc-aa13-fbbdd6307c38] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:26:44.559991 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f442399d-6293-4e07-8675-e3b9f8718bc9 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:26:44.560481 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f442399d-6293-4e07-8675-e3b9f8718bc9 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:26:44.561258 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f442399d-6293-4e07-8675-e3b9f8718bc9 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:26:44.561702 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f442399d-6293-4e07-8675-e3b9f8718bc9 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:26:44.774095 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f442399d-6293-4e07-8675-e3b9f8718bc9 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a610b85c64df7ab471c6ee1d68dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45dbfa8603541f686c9b2e0bf291dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:26:44.782008 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f442399d-6293-4e07-8675-e3b9f8718bc9 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] 10.222.0.17 "GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38" status: 200 len: 1304 microversion: 2.1 time: 0.234008 Jul 23 22:26:44.782617 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3990/6600] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:26:44 2022] GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38 => generated 1304 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:26:45.576196 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-f654abaa-efd0-44d4-88db-1ca0404c0438 req-f18e8d56-8e67-42a8-a317-d71b4e0ffa92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f76e640c-0d54-4edc-aa13-fbbdd6307c38", "tag": "69867935-142e-4ba1-81be-d81fb8eaf436"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:26:45.596138 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-f654abaa-efd0-44d4-88db-1ca0404c0438 req-f18e8d56-8e67-42a8-a317-d71b4e0ffa92 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:26:45.596591 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-f654abaa-efd0-44d4-88db-1ca0404c0438 req-f18e8d56-8e67-42a8-a317-d71b4e0ffa92 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:26:45.609227 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-f654abaa-efd0-44d4-88db-1ca0404c0438 req-f18e8d56-8e67-42a8-a317-d71b4e0ffa92 service nova] Creating event network-changed:69867935-142e-4ba1-81be-d81fb8eaf436 for instance f76e640c-0d54-4edc-aa13-fbbdd6307c38 on nch1-master-1 Jul 23 22:26:45.614232 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-f654abaa-efd0-44d4-88db-1ca0404c0438 req-f18e8d56-8e67-42a8-a317-d71b4e0ffa92 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042077 Jul 23 22:26:45.615417 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3991/6601] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:26:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:26:45.800173 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-7df11b5f-ac6b-49c1-bc30-26b6e582ede8 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:26:45.800842 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-7df11b5f-ac6b-49c1-bc30-26b6e582ede8 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] [instance: f76e640c-0d54-4edc-aa13-fbbdd6307c38] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:26:45.808069 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7df11b5f-ac6b-49c1-bc30-26b6e582ede8 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:26:45.808793 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7df11b5f-ac6b-49c1-bc30-26b6e582ede8 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:26:45.810099 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7df11b5f-ac6b-49c1-bc30-26b6e582ede8 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:26:45.810718 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7df11b5f-ac6b-49c1-bc30-26b6e582ede8 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:26:46.052298 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-7df11b5f-ac6b-49c1-bc30-26b6e582ede8 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a610b85c64df7ab471c6ee1d68dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45dbfa8603541f686c9b2e0bf291dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:26:46.060497 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-7df11b5f-ac6b-49c1-bc30-26b6e582ede8 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] 10.222.0.17 "GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38" status: 200 len: 1371 microversion: 2.1 time: 0.264479 Jul 23 22:26:46.061008 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3992/6602] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:26:45 2022] GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38 => generated 1371 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:26:47.077367 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f1555765-6525-4b8e-ab8b-76bd5aec2253 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:26:47.078120 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f1555765-6525-4b8e-ab8b-76bd5aec2253 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] [instance: f76e640c-0d54-4edc-aa13-fbbdd6307c38] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:26:47.085095 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f1555765-6525-4b8e-ab8b-76bd5aec2253 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:26:47.085635 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f1555765-6525-4b8e-ab8b-76bd5aec2253 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:26:47.086526 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f1555765-6525-4b8e-ab8b-76bd5aec2253 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:26:47.087043 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f1555765-6525-4b8e-ab8b-76bd5aec2253 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:26:47.310094 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f1555765-6525-4b8e-ab8b-76bd5aec2253 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a610b85c64df7ab471c6ee1d68dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45dbfa8603541f686c9b2e0bf291dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:26:47.318212 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f1555765-6525-4b8e-ab8b-76bd5aec2253 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] 10.222.0.17 "GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38" status: 200 len: 1371 microversion: 2.1 time: 0.245281 Jul 23 22:26:47.318803 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3993/6603] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:26:47 2022] GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38 => generated 1371 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:26:48.340520 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-850bbff0-ee6b-4097-8d81-e3ee6de05a06 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:26:48.341260 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-850bbff0-ee6b-4097-8d81-e3ee6de05a06 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] [instance: f76e640c-0d54-4edc-aa13-fbbdd6307c38] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:26:48.348819 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-850bbff0-ee6b-4097-8d81-e3ee6de05a06 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:26:48.349276 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-850bbff0-ee6b-4097-8d81-e3ee6de05a06 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:26:48.350100 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-850bbff0-ee6b-4097-8d81-e3ee6de05a06 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:26:48.350558 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-850bbff0-ee6b-4097-8d81-e3ee6de05a06 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:26:48.491978 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-850bbff0-ee6b-4097-8d81-e3ee6de05a06 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a610b85c64df7ab471c6ee1d68dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45dbfa8603541f686c9b2e0bf291dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:26:48.500253 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-850bbff0-ee6b-4097-8d81-e3ee6de05a06 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] 10.222.0.17 "GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38" status: 200 len: 1371 microversion: 2.1 time: 0.166765 Jul 23 22:26:48.500852 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3994/6604] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:26:48 2022] GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38 => generated 1371 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:26:49.522214 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-43154291-b846-4abf-b541-9c4c86d0f66c tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:26:49.523249 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-43154291-b846-4abf-b541-9c4c86d0f66c tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] [instance: f76e640c-0d54-4edc-aa13-fbbdd6307c38] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:26:49.526397 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:26:49.537378 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-43154291-b846-4abf-b541-9c4c86d0f66c tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:26:49.538199 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-43154291-b846-4abf-b541-9c4c86d0f66c tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:26:49.539510 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-43154291-b846-4abf-b541-9c4c86d0f66c tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:26:49.540268 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-43154291-b846-4abf-b541-9c4c86d0f66c tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:26:49.680413 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-43154291-b846-4abf-b541-9c4c86d0f66c tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a610b85c64df7ab471c6ee1d68dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45dbfa8603541f686c9b2e0bf291dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:26:49.688240 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-43154291-b846-4abf-b541-9c4c86d0f66c tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] 10.222.0.17 "GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38" status: 200 len: 1371 microversion: 2.1 time: 0.172709 Jul 23 22:26:49.688842 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3995/6605] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:26:49 2022] GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38 => generated 1371 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:26:50.075036 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-26b1f64d-479c-4dae-a4a1-652facc8f234 req-ad320624-24ca-4e8f-9e44-33ebbf91013d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f76e640c-0d54-4edc-aa13-fbbdd6307c38", "name": "network-vif-plugged", "status": "completed", "tag": "69867935-142e-4ba1-81be-d81fb8eaf436"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:26:50.083684 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-26b1f64d-479c-4dae-a4a1-652facc8f234 req-ad320624-24ca-4e8f-9e44-33ebbf91013d service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:26:50.084193 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-26b1f64d-479c-4dae-a4a1-652facc8f234 req-ad320624-24ca-4e8f-9e44-33ebbf91013d service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:26:50.096845 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-26b1f64d-479c-4dae-a4a1-652facc8f234 req-ad320624-24ca-4e8f-9e44-33ebbf91013d service nova] Creating event network-vif-plugged:69867935-142e-4ba1-81be-d81fb8eaf436 for instance f76e640c-0d54-4edc-aa13-fbbdd6307c38 on nch1-master-1 Jul 23 22:26:50.102167 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-26b1f64d-479c-4dae-a4a1-652facc8f234 req-ad320624-24ca-4e8f-9e44-33ebbf91013d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031285 Jul 23 22:26:50.102954 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3996/6606] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:26:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:26:50.706094 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0b81f739-8d00-4b55-b8a6-a34d6be4046d tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:26:50.706745 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-0b81f739-8d00-4b55-b8a6-a34d6be4046d tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] [instance: f76e640c-0d54-4edc-aa13-fbbdd6307c38] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:26:50.714544 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0b81f739-8d00-4b55-b8a6-a34d6be4046d tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:26:50.715084 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0b81f739-8d00-4b55-b8a6-a34d6be4046d tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:26:50.715901 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0b81f739-8d00-4b55-b8a6-a34d6be4046d tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:26:50.716346 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0b81f739-8d00-4b55-b8a6-a34d6be4046d tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:26:50.851019 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-0b81f739-8d00-4b55-b8a6-a34d6be4046d tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a610b85c64df7ab471c6ee1d68dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45dbfa8603541f686c9b2e0bf291dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:26:50.859068 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-0b81f739-8d00-4b55-b8a6-a34d6be4046d tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] 10.222.0.17 "GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38" status: 200 len: 1371 microversion: 2.1 time: 0.157551 Jul 23 22:26:50.859647 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3997/6607] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:26:50 2022] GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38 => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:26:51.880711 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1e78cd09-9565-402e-87fa-575cf8051eb9 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:26:51.881749 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1e78cd09-9565-402e-87fa-575cf8051eb9 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] [instance: f76e640c-0d54-4edc-aa13-fbbdd6307c38] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:26:51.891164 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1e78cd09-9565-402e-87fa-575cf8051eb9 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:26:51.891615 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1e78cd09-9565-402e-87fa-575cf8051eb9 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:26:51.892386 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1e78cd09-9565-402e-87fa-575cf8051eb9 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:26:51.892825 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1e78cd09-9565-402e-87fa-575cf8051eb9 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:26:52.025020 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-1e78cd09-9565-402e-87fa-575cf8051eb9 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a610b85c64df7ab471c6ee1d68dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45dbfa8603541f686c9b2e0bf291dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:26:52.036803 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1e78cd09-9565-402e-87fa-575cf8051eb9 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] 10.222.0.17 "GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38" status: 200 len: 1556 microversion: 2.1 time: 0.162353 Jul 23 22:26:52.037391 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3998/6608] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:26:51 2022] GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38 => generated 1556 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:26:52.054869 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b47b5bc1-8f8a-4343-93e1-868f5b2cef7e tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:26:52.055476 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b47b5bc1-8f8a-4343-93e1-868f5b2cef7e tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] [instance: f76e640c-0d54-4edc-aa13-fbbdd6307c38] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:26:52.061714 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b47b5bc1-8f8a-4343-93e1-868f5b2cef7e tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:26:52.062198 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b47b5bc1-8f8a-4343-93e1-868f5b2cef7e tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:26:52.062973 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b47b5bc1-8f8a-4343-93e1-868f5b2cef7e tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:26:52.063417 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b47b5bc1-8f8a-4343-93e1-868f5b2cef7e tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:26:52.205507 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b47b5bc1-8f8a-4343-93e1-868f5b2cef7e tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a610b85c64df7ab471c6ee1d68dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45dbfa8603541f686c9b2e0bf291dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:26:52.213820 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b47b5bc1-8f8a-4343-93e1-868f5b2cef7e tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] 10.222.0.17 "GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38" status: 200 len: 1556 microversion: 2.1 time: 0.162524 Jul 23 22:26:52.214445 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 3999/6609] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:26:52 2022] GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38 => generated 1556 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:26:54.247716 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-4b15f8ad-5a90-4737-a24a-0182aeb19969 req-16a7c1d9-db8d-4757-b9d0-f2d1be7d097a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f76e640c-0d54-4edc-aa13-fbbdd6307c38", "tag": "69867935-142e-4ba1-81be-d81fb8eaf436"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:26:54.251470 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=18 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:26:54.258475 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-4b15f8ad-5a90-4737-a24a-0182aeb19969 req-16a7c1d9-db8d-4757-b9d0-f2d1be7d097a service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:26:54.259870 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-4b15f8ad-5a90-4737-a24a-0182aeb19969 req-16a7c1d9-db8d-4757-b9d0-f2d1be7d097a service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:26:54.272231 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-4b15f8ad-5a90-4737-a24a-0182aeb19969 req-16a7c1d9-db8d-4757-b9d0-f2d1be7d097a service nova] Creating event network-changed:69867935-142e-4ba1-81be-d81fb8eaf436 for instance f76e640c-0d54-4edc-aa13-fbbdd6307c38 on nch1-master-1 Jul 23 22:26:54.277599 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-4b15f8ad-5a90-4737-a24a-0182aeb19969 req-16a7c1d9-db8d-4757-b9d0-f2d1be7d097a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033640 Jul 23 22:26:54.278385 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4000/6610] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:26:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 22:28:48.466456 ncdv-master-1 devstack@n-api.service[131320]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f00542ad-3110-4bfe-937f-f2bf8408f43a] AMQP server on 10.222.0.17:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jul 23 22:28:48.467631 ncdv-master-1 devstack@n-api.service[131320]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7bb808cf-dbe0-4ba5-ad7e-371257d030a5] AMQP server on 10.222.0.17:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 23 22:28:48.468317 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=4 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:28:48.469123 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=62 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:28:48.473681 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4e2c90dd-f32a-450d-914d-560eabc95278 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:28:48.474343 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-4e2c90dd-f32a-450d-914d-560eabc95278 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] [instance: f76e640c-0d54-4edc-aa13-fbbdd6307c38] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:28:48.482077 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4e2c90dd-f32a-450d-914d-560eabc95278 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:28:48.482529 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4e2c90dd-f32a-450d-914d-560eabc95278 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:28:48.483292 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4e2c90dd-f32a-450d-914d-560eabc95278 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:28:48.483730 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4e2c90dd-f32a-450d-914d-560eabc95278 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:28:48.507409 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.objects.instance [None req-4e2c90dd-f32a-450d-914d-560eabc95278 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lazy-loading 'flavor' on Instance uuid f76e640c-0d54-4edc-aa13-fbbdd6307c38 {{(pid=131320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 22:28:48.768634 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4e2c90dd-f32a-450d-914d-560eabc95278 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] 10.222.0.17 "POST /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38/action" status: 202 len: 0 microversion: 2.1 time: 0.307148 Jul 23 22:28:48.769317 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4001/6611] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 22:28:48 2022] POST /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38/action => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 22:28:48.778853 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f9dd1523-3cd5-4b9d-8cb7-909fcc01b378 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:28:48.779553 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f9dd1523-3cd5-4b9d-8cb7-909fcc01b378 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] [instance: f76e640c-0d54-4edc-aa13-fbbdd6307c38] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:28:48.786484 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f9dd1523-3cd5-4b9d-8cb7-909fcc01b378 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:28:48.786957 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f9dd1523-3cd5-4b9d-8cb7-909fcc01b378 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:28:48.787816 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f9dd1523-3cd5-4b9d-8cb7-909fcc01b378 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:28:48.788321 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f9dd1523-3cd5-4b9d-8cb7-909fcc01b378 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:28:48.938499 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f9dd1523-3cd5-4b9d-8cb7-909fcc01b378 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a610b85c64df7ab471c6ee1d68dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45dbfa8603541f686c9b2e0bf291dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:28:48.946596 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f9dd1523-3cd5-4b9d-8cb7-909fcc01b378 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] 10.222.0.17 "GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38" status: 200 len: 1681 microversion: 2.1 time: 0.172573 Jul 23 22:28:48.947179 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4002/6612] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:28:48 2022] GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38 => generated 1681 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:28:49.969019 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b1a3fc85-d5cb-42b8-a7fd-7822840dccd0 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:28:49.970109 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b1a3fc85-d5cb-42b8-a7fd-7822840dccd0 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] [instance: f76e640c-0d54-4edc-aa13-fbbdd6307c38] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:28:49.986119 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b1a3fc85-d5cb-42b8-a7fd-7822840dccd0 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:28:49.986871 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b1a3fc85-d5cb-42b8-a7fd-7822840dccd0 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:28:49.988158 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b1a3fc85-d5cb-42b8-a7fd-7822840dccd0 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:28:49.988987 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b1a3fc85-d5cb-42b8-a7fd-7822840dccd0 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:28:49.999482 ncdv-master-1 devstack@n-api.service[131320]: INFO oslo.messaging._drivers.impl_rabbit [-] [7bb808cf-dbe0-4ba5-ad7e-371257d030a5] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 33872. Jul 23 22:28:50.010340 ncdv-master-1 devstack@n-api.service[131320]: INFO oslo.messaging._drivers.impl_rabbit [-] [f00542ad-3110-4bfe-937f-f2bf8408f43a] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 33870. Jul 23 22:28:50.129269 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b1a3fc85-d5cb-42b8-a7fd-7822840dccd0 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a610b85c64df7ab471c6ee1d68dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45dbfa8603541f686c9b2e0bf291dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:28:50.137022 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b1a3fc85-d5cb-42b8-a7fd-7822840dccd0 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] 10.222.0.17 "GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38" status: 200 len: 1681 microversion: 2.1 time: 0.174762 Jul 23 22:28:50.137641 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4003/6613] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:28:49 2022] GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38 => generated 1681 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:28:51.159731 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9ce80c4a-c1d9-48c2-a133-00a802bcfba7 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:28:51.160745 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-9ce80c4a-c1d9-48c2-a133-00a802bcfba7 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] [instance: f76e640c-0d54-4edc-aa13-fbbdd6307c38] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:28:51.171556 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9ce80c4a-c1d9-48c2-a133-00a802bcfba7 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:28:51.172019 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9ce80c4a-c1d9-48c2-a133-00a802bcfba7 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:28:51.172804 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9ce80c4a-c1d9-48c2-a133-00a802bcfba7 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:28:51.173240 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9ce80c4a-c1d9-48c2-a133-00a802bcfba7 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:28:51.315006 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-9ce80c4a-c1d9-48c2-a133-00a802bcfba7 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a610b85c64df7ab471c6ee1d68dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45dbfa8603541f686c9b2e0bf291dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:28:51.327659 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9ce80c4a-c1d9-48c2-a133-00a802bcfba7 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] 10.222.0.17 "GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38" status: 200 len: 1681 microversion: 2.1 time: 0.175345 Jul 23 22:28:51.328333 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4004/6614] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:28:51 2022] GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38 => generated 1681 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:28:52.349610 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-94f2d55d-7c7e-482a-bea1-e0bf5696c5f7 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:28:52.350744 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-94f2d55d-7c7e-482a-bea1-e0bf5696c5f7 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] [instance: f76e640c-0d54-4edc-aa13-fbbdd6307c38] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:28:52.360742 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-94f2d55d-7c7e-482a-bea1-e0bf5696c5f7 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:28:52.361202 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-94f2d55d-7c7e-482a-bea1-e0bf5696c5f7 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:28:52.361980 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-94f2d55d-7c7e-482a-bea1-e0bf5696c5f7 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:28:52.362427 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-94f2d55d-7c7e-482a-bea1-e0bf5696c5f7 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:28:52.493164 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-94f2d55d-7c7e-482a-bea1-e0bf5696c5f7 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a610b85c64df7ab471c6ee1d68dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45dbfa8603541f686c9b2e0bf291dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:28:52.501071 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-94f2d55d-7c7e-482a-bea1-e0bf5696c5f7 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] 10.222.0.17 "GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38" status: 200 len: 1681 microversion: 2.1 time: 0.158105 Jul 23 22:28:52.501670 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4005/6615] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:28:52 2022] GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:28:53.525375 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5531d243-ab41-4859-aab6-0c689aa98f9e tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:28:53.526948 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5531d243-ab41-4859-aab6-0c689aa98f9e tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] [instance: f76e640c-0d54-4edc-aa13-fbbdd6307c38] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:28:53.535207 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5531d243-ab41-4859-aab6-0c689aa98f9e tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:28:53.535670 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5531d243-ab41-4859-aab6-0c689aa98f9e tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:28:53.536460 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5531d243-ab41-4859-aab6-0c689aa98f9e tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:28:53.539026 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5531d243-ab41-4859-aab6-0c689aa98f9e tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:28:53.672719 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5531d243-ab41-4859-aab6-0c689aa98f9e tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a610b85c64df7ab471c6ee1d68dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45dbfa8603541f686c9b2e0bf291dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:28:53.680582 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5531d243-ab41-4859-aab6-0c689aa98f9e tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] 10.222.0.17 "GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38" status: 200 len: 1681 microversion: 2.1 time: 0.163357 Jul 23 22:28:53.681161 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4006/6616] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:28:53 2022] GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38 => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:28:54.702437 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-775ca693-d989-4596-8f57-79dff3b0afe2 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:28:54.703172 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-775ca693-d989-4596-8f57-79dff3b0afe2 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] [instance: f76e640c-0d54-4edc-aa13-fbbdd6307c38] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:28:54.711240 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-775ca693-d989-4596-8f57-79dff3b0afe2 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:28:54.711748 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-775ca693-d989-4596-8f57-79dff3b0afe2 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:28:54.712613 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-775ca693-d989-4596-8f57-79dff3b0afe2 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:28:54.713103 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-775ca693-d989-4596-8f57-79dff3b0afe2 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:28:54.855803 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-775ca693-d989-4596-8f57-79dff3b0afe2 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a610b85c64df7ab471c6ee1d68dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45dbfa8603541f686c9b2e0bf291dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:28:54.863807 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-775ca693-d989-4596-8f57-79dff3b0afe2 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] 10.222.0.17 "GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38" status: 200 len: 1681 microversion: 2.1 time: 0.168310 Jul 23 22:28:54.864404 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4007/6617] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:28:54 2022] GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38 => generated 1681 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:28:55.888718 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-eacb4dd4-7fd9-4cef-a500-f2f896e57758 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:28:55.889497 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-eacb4dd4-7fd9-4cef-a500-f2f896e57758 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] [instance: f76e640c-0d54-4edc-aa13-fbbdd6307c38] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:28:55.899012 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-eacb4dd4-7fd9-4cef-a500-f2f896e57758 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:28:55.899615 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-eacb4dd4-7fd9-4cef-a500-f2f896e57758 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:28:55.900650 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-eacb4dd4-7fd9-4cef-a500-f2f896e57758 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:28:55.901235 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-eacb4dd4-7fd9-4cef-a500-f2f896e57758 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:28:56.045590 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-eacb4dd4-7fd9-4cef-a500-f2f896e57758 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a610b85c64df7ab471c6ee1d68dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45dbfa8603541f686c9b2e0bf291dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:28:56.053493 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-eacb4dd4-7fd9-4cef-a500-f2f896e57758 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] 10.222.0.17 "GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38" status: 200 len: 1681 microversion: 2.1 time: 0.170228 Jul 23 22:28:56.054139 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4008/6618] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:28:55 2022] GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38 => generated 1681 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:28:57.073795 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f74e541c-af2a-4226-950a-8d9a1d695242 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:28:57.074491 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f74e541c-af2a-4226-950a-8d9a1d695242 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] [instance: f76e640c-0d54-4edc-aa13-fbbdd6307c38] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:28:57.081968 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f74e541c-af2a-4226-950a-8d9a1d695242 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:28:57.082417 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f74e541c-af2a-4226-950a-8d9a1d695242 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:28:57.083234 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f74e541c-af2a-4226-950a-8d9a1d695242 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:28:57.083673 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f74e541c-af2a-4226-950a-8d9a1d695242 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:28:57.234128 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f74e541c-af2a-4226-950a-8d9a1d695242 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a610b85c64df7ab471c6ee1d68dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45dbfa8603541f686c9b2e0bf291dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:28:57.242008 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f74e541c-af2a-4226-950a-8d9a1d695242 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] 10.222.0.17 "GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38" status: 200 len: 1681 microversion: 2.1 time: 0.174203 Jul 23 22:28:57.242616 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4009/6619] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:28:57 2022] GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38 => generated 1681 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:28:58.263051 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-93398026-586f-4ef4-a889-3cb3cdc18eda tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:28:58.264104 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-93398026-586f-4ef4-a889-3cb3cdc18eda tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] [instance: f76e640c-0d54-4edc-aa13-fbbdd6307c38] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:28:58.275811 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-93398026-586f-4ef4-a889-3cb3cdc18eda tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:28:58.276593 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-93398026-586f-4ef4-a889-3cb3cdc18eda tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:28:58.277910 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-93398026-586f-4ef4-a889-3cb3cdc18eda tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:28:58.278666 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-93398026-586f-4ef4-a889-3cb3cdc18eda tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:28:58.410382 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-93398026-586f-4ef4-a889-3cb3cdc18eda tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a610b85c64df7ab471c6ee1d68dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45dbfa8603541f686c9b2e0bf291dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:28:58.422671 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-93398026-586f-4ef4-a889-3cb3cdc18eda tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] 10.222.0.17 "GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38" status: 200 len: 1681 microversion: 2.1 time: 0.166174 Jul 23 22:28:58.423267 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4010/6620] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:28:58 2022] GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38 => generated 1681 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:28:59.445886 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-79a77d6e-ee00-4421-97fb-e8b54e66c8fb tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:28:59.446964 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-79a77d6e-ee00-4421-97fb-e8b54e66c8fb tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] [instance: f76e640c-0d54-4edc-aa13-fbbdd6307c38] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:28:59.456575 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-79a77d6e-ee00-4421-97fb-e8b54e66c8fb tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:28:59.457043 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-79a77d6e-ee00-4421-97fb-e8b54e66c8fb tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:28:59.457821 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-79a77d6e-ee00-4421-97fb-e8b54e66c8fb tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:28:59.458298 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-79a77d6e-ee00-4421-97fb-e8b54e66c8fb tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:28:59.594396 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-79a77d6e-ee00-4421-97fb-e8b54e66c8fb tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a610b85c64df7ab471c6ee1d68dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45dbfa8603541f686c9b2e0bf291dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:28:59.602118 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-79a77d6e-ee00-4421-97fb-e8b54e66c8fb tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] 10.222.0.17 "GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38" status: 200 len: 1702 microversion: 2.1 time: 0.163023 Jul 23 22:28:59.602732 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4011/6621] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:28:59 2022] GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38 => generated 1702 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:29:00.620222 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b8ef056b-0440-40c9-8aee-8dc06dc30b80 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:29:00.621044 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b8ef056b-0440-40c9-8aee-8dc06dc30b80 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] [instance: f76e640c-0d54-4edc-aa13-fbbdd6307c38] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:29:00.628270 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b8ef056b-0440-40c9-8aee-8dc06dc30b80 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:29:00.628713 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b8ef056b-0440-40c9-8aee-8dc06dc30b80 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:29:00.629494 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b8ef056b-0440-40c9-8aee-8dc06dc30b80 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:29:00.629966 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b8ef056b-0440-40c9-8aee-8dc06dc30b80 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:29:00.767987 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b8ef056b-0440-40c9-8aee-8dc06dc30b80 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a610b85c64df7ab471c6ee1d68dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45dbfa8603541f686c9b2e0bf291dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:29:00.779884 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b8ef056b-0440-40c9-8aee-8dc06dc30b80 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] 10.222.0.17 "GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38" status: 200 len: 1702 microversion: 2.1 time: 0.163345 Jul 23 22:29:00.780764 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4012/6622] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:29:00 2022] GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38 => generated 1702 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:29:01.801724 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1e4d2391-9c75-42b3-847d-a345d5459dec tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:29:01.802334 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1e4d2391-9c75-42b3-847d-a345d5459dec tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] [instance: f76e640c-0d54-4edc-aa13-fbbdd6307c38] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:29:01.809531 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1e4d2391-9c75-42b3-847d-a345d5459dec tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:29:01.810044 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1e4d2391-9c75-42b3-847d-a345d5459dec tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:29:01.810888 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1e4d2391-9c75-42b3-847d-a345d5459dec tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:29:01.811586 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1e4d2391-9c75-42b3-847d-a345d5459dec tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:29:01.947016 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-1e4d2391-9c75-42b3-847d-a345d5459dec tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a610b85c64df7ab471c6ee1d68dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45dbfa8603541f686c9b2e0bf291dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:29:01.955705 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1e4d2391-9c75-42b3-847d-a345d5459dec tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] 10.222.0.17 "GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38" status: 200 len: 1697 microversion: 2.1 time: 0.157902 Jul 23 22:29:01.956322 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4013/6623] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:29:01 2022] GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38 => generated 1697 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:29:02.715691 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-f1e4c7f3-1d6c-4bbc-a4bd-c99422031271 req-c5e72ac1-a77f-4bbd-8812-59a0d33c874e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f76e640c-0d54-4edc-aa13-fbbdd6307c38", "name": "network-vif-plugged", "status": "completed", "tag": "69867935-142e-4ba1-81be-d81fb8eaf436"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:29:02.728721 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-f1e4c7f3-1d6c-4bbc-a4bd-c99422031271 req-c5e72ac1-a77f-4bbd-8812-59a0d33c874e service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:29:02.729281 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-f1e4c7f3-1d6c-4bbc-a4bd-c99422031271 req-c5e72ac1-a77f-4bbd-8812-59a0d33c874e service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:29:02.741460 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-f1e4c7f3-1d6c-4bbc-a4bd-c99422031271 req-c5e72ac1-a77f-4bbd-8812-59a0d33c874e service nova] Creating event network-vif-plugged:69867935-142e-4ba1-81be-d81fb8eaf436 for instance f76e640c-0d54-4edc-aa13-fbbdd6307c38 on nch1-master-1 Jul 23 22:29:02.749843 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-f1e4c7f3-1d6c-4bbc-a4bd-c99422031271 req-c5e72ac1-a77f-4bbd-8812-59a0d33c874e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122236 Jul 23 22:29:02.750560 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4014/6624] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:29:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 22:29:02.975016 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-45fc7924-3da1-40f5-8edd-315db9b065ff tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:29:02.976559 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-45fc7924-3da1-40f5-8edd-315db9b065ff tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] [instance: f76e640c-0d54-4edc-aa13-fbbdd6307c38] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:29:02.984309 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-45fc7924-3da1-40f5-8edd-315db9b065ff tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:29:02.985009 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-45fc7924-3da1-40f5-8edd-315db9b065ff tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:29:02.985803 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-45fc7924-3da1-40f5-8edd-315db9b065ff tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:29:02.986530 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-45fc7924-3da1-40f5-8edd-315db9b065ff tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:29:03.136912 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-45fc7924-3da1-40f5-8edd-315db9b065ff tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a610b85c64df7ab471c6ee1d68dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45dbfa8603541f686c9b2e0bf291dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:29:03.146035 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-45fc7924-3da1-40f5-8edd-315db9b065ff tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] 10.222.0.17 "GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38" status: 200 len: 1697 microversion: 2.1 time: 0.175348 Jul 23 22:29:03.147425 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4015/6625] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:29:02 2022] GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38 => generated 1697 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:29:04.167511 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3779b559-0cf2-4ba4-a209-227bc2ec024a tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:29:04.169212 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-3779b559-0cf2-4ba4-a209-227bc2ec024a tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] [instance: f76e640c-0d54-4edc-aa13-fbbdd6307c38] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:29:04.176988 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3779b559-0cf2-4ba4-a209-227bc2ec024a tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:29:04.177418 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3779b559-0cf2-4ba4-a209-227bc2ec024a tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:29:04.178232 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3779b559-0cf2-4ba4-a209-227bc2ec024a tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:29:04.178879 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3779b559-0cf2-4ba4-a209-227bc2ec024a tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:29:04.183787 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:29:04.341365 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-3779b559-0cf2-4ba4-a209-227bc2ec024a tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a610b85c64df7ab471c6ee1d68dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45dbfa8603541f686c9b2e0bf291dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:29:04.349552 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-3779b559-0cf2-4ba4-a209-227bc2ec024a tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] 10.222.0.17 "GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38" status: 200 len: 1697 microversion: 2.1 time: 0.186497 Jul 23 22:29:04.358994 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4016/6626] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:29:04 2022] GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38 => generated 1697 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:29:05.367491 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2bbc9da8-2fcc-487b-8b46-777dbd1ba089 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:29:05.368174 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-2bbc9da8-2fcc-487b-8b46-777dbd1ba089 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] [instance: f76e640c-0d54-4edc-aa13-fbbdd6307c38] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:29:05.375967 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2bbc9da8-2fcc-487b-8b46-777dbd1ba089 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:29:05.376776 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2bbc9da8-2fcc-487b-8b46-777dbd1ba089 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:29:05.377993 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2bbc9da8-2fcc-487b-8b46-777dbd1ba089 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:29:05.378642 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2bbc9da8-2fcc-487b-8b46-777dbd1ba089 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:29:05.529427 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-2bbc9da8-2fcc-487b-8b46-777dbd1ba089 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a610b85c64df7ab471c6ee1d68dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45dbfa8603541f686c9b2e0bf291dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:29:05.539554 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2bbc9da8-2fcc-487b-8b46-777dbd1ba089 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] 10.222.0.17 "GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38" status: 200 len: 1697 microversion: 2.1 time: 0.176161 Jul 23 22:29:05.540337 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4017/6627] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:29:05 2022] GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38 => generated 1697 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:29:06.557396 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-fed691e1-71a4-44f4-98db-353008b136af tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:29:06.558247 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-fed691e1-71a4-44f4-98db-353008b136af tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] [instance: f76e640c-0d54-4edc-aa13-fbbdd6307c38] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:29:06.565904 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fed691e1-71a4-44f4-98db-353008b136af tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:29:06.566457 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fed691e1-71a4-44f4-98db-353008b136af tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:29:06.567704 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fed691e1-71a4-44f4-98db-353008b136af tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:29:06.568199 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fed691e1-71a4-44f4-98db-353008b136af tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:29:06.714760 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-fed691e1-71a4-44f4-98db-353008b136af tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a610b85c64df7ab471c6ee1d68dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45dbfa8603541f686c9b2e0bf291dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:29:06.723292 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-fed691e1-71a4-44f4-98db-353008b136af tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] 10.222.0.17 "GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38" status: 200 len: 1697 microversion: 2.1 time: 0.170276 Jul 23 22:29:06.726481 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4018/6628] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:29:06 2022] GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38 => generated 1697 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:29:07.742230 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ddcb369a-4b94-4023-9539-147e0aad93d1 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:29:07.742887 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ddcb369a-4b94-4023-9539-147e0aad93d1 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] [instance: f76e640c-0d54-4edc-aa13-fbbdd6307c38] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:29:07.751032 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ddcb369a-4b94-4023-9539-147e0aad93d1 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:29:07.751550 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ddcb369a-4b94-4023-9539-147e0aad93d1 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:29:07.752499 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ddcb369a-4b94-4023-9539-147e0aad93d1 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:29:07.753052 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ddcb369a-4b94-4023-9539-147e0aad93d1 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:29:07.903902 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-ddcb369a-4b94-4023-9539-147e0aad93d1 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a610b85c64df7ab471c6ee1d68dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45dbfa8603541f686c9b2e0bf291dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:29:07.912041 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ddcb369a-4b94-4023-9539-147e0aad93d1 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] 10.222.0.17 "GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38" status: 200 len: 1697 microversion: 2.1 time: 0.174004 Jul 23 22:29:07.912641 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4019/6629] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:29:07 2022] GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38 => generated 1697 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:29:08.929588 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a220bbd6-e01a-4024-a523-733d269ded17 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:29:08.930287 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a220bbd6-e01a-4024-a523-733d269ded17 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] [instance: f76e640c-0d54-4edc-aa13-fbbdd6307c38] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:29:08.937677 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a220bbd6-e01a-4024-a523-733d269ded17 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:29:08.938166 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a220bbd6-e01a-4024-a523-733d269ded17 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:29:08.938946 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a220bbd6-e01a-4024-a523-733d269ded17 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:29:08.939390 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a220bbd6-e01a-4024-a523-733d269ded17 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:29:09.089929 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a220bbd6-e01a-4024-a523-733d269ded17 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a610b85c64df7ab471c6ee1d68dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45dbfa8603541f686c9b2e0bf291dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:29:09.100082 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a220bbd6-e01a-4024-a523-733d269ded17 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] 10.222.0.17 "GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38" status: 200 len: 1697 microversion: 2.1 time: 0.174433 Jul 23 22:29:09.109760 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4020/6630] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:29:08 2022] GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38 => generated 1697 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:29:10.118410 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-7efa5c3a-839c-419c-9cf9-d962a921a7aa tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:29:10.119096 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-7efa5c3a-839c-419c-9cf9-d962a921a7aa tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] [instance: f76e640c-0d54-4edc-aa13-fbbdd6307c38] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:29:10.127476 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7efa5c3a-839c-419c-9cf9-d962a921a7aa tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:29:10.127919 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7efa5c3a-839c-419c-9cf9-d962a921a7aa tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:29:10.128739 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7efa5c3a-839c-419c-9cf9-d962a921a7aa tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:29:10.129173 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7efa5c3a-839c-419c-9cf9-d962a921a7aa tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:29:10.302828 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-7efa5c3a-839c-419c-9cf9-d962a921a7aa tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a610b85c64df7ab471c6ee1d68dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45dbfa8603541f686c9b2e0bf291dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:29:10.310622 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-7efa5c3a-839c-419c-9cf9-d962a921a7aa tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] 10.222.0.17 "GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38" status: 200 len: 1697 microversion: 2.1 time: 0.196815 Jul 23 22:29:10.311446 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4021/6631] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:29:10 2022] GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38 => generated 1697 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:29:11.332799 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-aba9dab8-de4b-4afc-98a2-6bc6aa1064a9 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:29:11.333836 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-aba9dab8-de4b-4afc-98a2-6bc6aa1064a9 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] [instance: f76e640c-0d54-4edc-aa13-fbbdd6307c38] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:29:11.345719 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-aba9dab8-de4b-4afc-98a2-6bc6aa1064a9 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:29:11.346549 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-aba9dab8-de4b-4afc-98a2-6bc6aa1064a9 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:29:11.347833 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-aba9dab8-de4b-4afc-98a2-6bc6aa1064a9 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:29:11.348573 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-aba9dab8-de4b-4afc-98a2-6bc6aa1064a9 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:29:11.491793 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-aba9dab8-de4b-4afc-98a2-6bc6aa1064a9 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a610b85c64df7ab471c6ee1d68dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45dbfa8603541f686c9b2e0bf291dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:29:11.499596 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-aba9dab8-de4b-4afc-98a2-6bc6aa1064a9 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] 10.222.0.17 "GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38" status: 200 len: 1697 microversion: 2.1 time: 0.173556 Jul 23 22:29:11.500160 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4022/6632] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:29:11 2022] GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38 => generated 1697 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:29:12.517971 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e5ffdc49-015d-4ea9-a0e1-e8f9c4e892b1 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:29:12.518656 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e5ffdc49-015d-4ea9-a0e1-e8f9c4e892b1 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] [instance: f76e640c-0d54-4edc-aa13-fbbdd6307c38] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:29:12.526757 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e5ffdc49-015d-4ea9-a0e1-e8f9c4e892b1 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:29:12.527263 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e5ffdc49-015d-4ea9-a0e1-e8f9c4e892b1 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:29:12.528116 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e5ffdc49-015d-4ea9-a0e1-e8f9c4e892b1 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:29:12.528606 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e5ffdc49-015d-4ea9-a0e1-e8f9c4e892b1 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:29:12.667710 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e5ffdc49-015d-4ea9-a0e1-e8f9c4e892b1 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a610b85c64df7ab471c6ee1d68dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45dbfa8603541f686c9b2e0bf291dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:29:12.675864 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e5ffdc49-015d-4ea9-a0e1-e8f9c4e892b1 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] 10.222.0.17 "GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38" status: 200 len: 1679 microversion: 2.1 time: 0.162392 Jul 23 22:29:12.676473 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4023/6633] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:29:12 2022] GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38 => generated 1679 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:29:13.696494 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-853e2770-3423-45a2-abc5-e481fae68dee tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:29:13.697206 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-853e2770-3423-45a2-abc5-e481fae68dee tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] [instance: f76e640c-0d54-4edc-aa13-fbbdd6307c38] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:29:13.706602 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-853e2770-3423-45a2-abc5-e481fae68dee tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:29:13.707063 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-853e2770-3423-45a2-abc5-e481fae68dee tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:29:13.707837 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-853e2770-3423-45a2-abc5-e481fae68dee tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:29:13.708287 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-853e2770-3423-45a2-abc5-e481fae68dee tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:29:13.848846 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-853e2770-3423-45a2-abc5-e481fae68dee tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a610b85c64df7ab471c6ee1d68dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45dbfa8603541f686c9b2e0bf291dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:29:13.860387 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-853e2770-3423-45a2-abc5-e481fae68dee tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] 10.222.0.17 "GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38" status: 200 len: 1682 microversion: 2.1 time: 0.170034 Jul 23 22:29:13.861145 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4024/6634] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:29:13 2022] GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38 => generated 1682 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:29:13.879760 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c1163bb5-55d4-4359-a60b-7f2cb2781ec1 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:29:13.880383 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c1163bb5-55d4-4359-a60b-7f2cb2781ec1 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] [instance: f76e640c-0d54-4edc-aa13-fbbdd6307c38] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:29:13.889665 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c1163bb5-55d4-4359-a60b-7f2cb2781ec1 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:29:13.890440 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c1163bb5-55d4-4359-a60b-7f2cb2781ec1 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:29:13.891591 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c1163bb5-55d4-4359-a60b-7f2cb2781ec1 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:29:13.892185 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c1163bb5-55d4-4359-a60b-7f2cb2781ec1 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:29:14.046291 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c1163bb5-55d4-4359-a60b-7f2cb2781ec1 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] 10.222.0.17 "POST /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38/action" status: 202 len: 0 microversion: 2.1 time: 0.172145 Jul 23 22:29:14.046706 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4025/6635] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 22:29:13 2022] POST /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38/action => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 23 22:29:14.055114 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c44af409-b4bb-4fee-9620-2d6119c8939d tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:29:14.055734 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c44af409-b4bb-4fee-9620-2d6119c8939d tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] [instance: f76e640c-0d54-4edc-aa13-fbbdd6307c38] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:29:14.062624 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c44af409-b4bb-4fee-9620-2d6119c8939d tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:29:14.063088 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c44af409-b4bb-4fee-9620-2d6119c8939d tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:29:14.063877 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c44af409-b4bb-4fee-9620-2d6119c8939d tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:29:14.064321 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c44af409-b4bb-4fee-9620-2d6119c8939d tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:29:14.200235 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c44af409-b4bb-4fee-9620-2d6119c8939d tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a610b85c64df7ab471c6ee1d68dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45dbfa8603541f686c9b2e0bf291dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:29:14.208317 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c44af409-b4bb-4fee-9620-2d6119c8939d tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] 10.222.0.17 "GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38" status: 200 len: 1630 microversion: 2.1 time: 0.157280 Jul 23 22:29:14.208891 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4026/6636] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:29:14 2022] GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38 => generated 1630 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:29:14.608717 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-d64ded9e-1468-4459-8f58-d5926e8783e0 req-60efd7a8-23c2-412b-a76c-2e25ddcd21e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f76e640c-0d54-4edc-aa13-fbbdd6307c38", "name": "network-vif-unplugged", "status": "completed", "tag": "69867935-142e-4ba1-81be-d81fb8eaf436"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:29:14.619963 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-d64ded9e-1468-4459-8f58-d5926e8783e0 req-60efd7a8-23c2-412b-a76c-2e25ddcd21e7 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:29:14.620653 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-d64ded9e-1468-4459-8f58-d5926e8783e0 req-60efd7a8-23c2-412b-a76c-2e25ddcd21e7 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:29:14.637018 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.compute.server_external_events [req-d64ded9e-1468-4459-8f58-d5926e8783e0 req-60efd7a8-23c2-412b-a76c-2e25ddcd21e7 service nova] Unable to find a host for instance f76e640c-0d54-4edc-aa13-fbbdd6307c38. Dropping event network-vif-unplugged {{(pid=131320) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 23 22:29:14.638245 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-d64ded9e-1468-4459-8f58-d5926e8783e0 req-60efd7a8-23c2-412b-a76c-2e25ddcd21e7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.034346 Jul 23 22:29:14.639120 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4027/6637] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:29:14 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 36 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 23 22:29:15.230453 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9d6d6a8e-2a4a-4d58-aa3c-e40f2c91d5f3 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:29:15.231456 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-9d6d6a8e-2a4a-4d58-aa3c-e40f2c91d5f3 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] [instance: f76e640c-0d54-4edc-aa13-fbbdd6307c38] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:29:15.243446 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9d6d6a8e-2a4a-4d58-aa3c-e40f2c91d5f3 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:29:15.244212 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9d6d6a8e-2a4a-4d58-aa3c-e40f2c91d5f3 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:29:15.245749 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9d6d6a8e-2a4a-4d58-aa3c-e40f2c91d5f3 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:29:15.246550 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9d6d6a8e-2a4a-4d58-aa3c-e40f2c91d5f3 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:29:15.384514 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-9d6d6a8e-2a4a-4d58-aa3c-e40f2c91d5f3 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a610b85c64df7ab471c6ee1d68dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45dbfa8603541f686c9b2e0bf291dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:29:15.392390 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9d6d6a8e-2a4a-4d58-aa3c-e40f2c91d5f3 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] 10.222.0.17 "GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38" status: 200 len: 1688 microversion: 2.1 time: 0.168800 Jul 23 22:29:15.393017 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4028/6638] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:29:15 2022] GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38 => generated 1688 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:29:16.199279 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-9562a5ba-bfd0-4680-8a35-0b3bf7424463 req-62ce377b-1d06-4a39-9f93-34957e041c39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f76e640c-0d54-4edc-aa13-fbbdd6307c38", "tag": "69867935-142e-4ba1-81be-d81fb8eaf436"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:29:16.210320 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-9562a5ba-bfd0-4680-8a35-0b3bf7424463 req-62ce377b-1d06-4a39-9f93-34957e041c39 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:29:16.211524 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-9562a5ba-bfd0-4680-8a35-0b3bf7424463 req-62ce377b-1d06-4a39-9f93-34957e041c39 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:29:16.226171 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-9562a5ba-bfd0-4680-8a35-0b3bf7424463 req-62ce377b-1d06-4a39-9f93-34957e041c39 service nova] Creating event network-changed:69867935-142e-4ba1-81be-d81fb8eaf436 for instance f76e640c-0d54-4edc-aa13-fbbdd6307c38 on nch2-master-1 Jul 23 22:29:16.231919 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-9562a5ba-bfd0-4680-8a35-0b3bf7424463 req-62ce377b-1d06-4a39-9f93-34957e041c39 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095738 Jul 23 22:29:16.233548 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4029/6639] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:29:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:29:16.412708 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1441c5ab-2f44-4b1c-917c-74009ea55e9f tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:29:16.413420 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1441c5ab-2f44-4b1c-917c-74009ea55e9f tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] [instance: f76e640c-0d54-4edc-aa13-fbbdd6307c38] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:29:16.421218 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1441c5ab-2f44-4b1c-917c-74009ea55e9f tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:29:16.421681 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1441c5ab-2f44-4b1c-917c-74009ea55e9f tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:29:16.422751 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1441c5ab-2f44-4b1c-917c-74009ea55e9f tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:29:16.423203 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1441c5ab-2f44-4b1c-917c-74009ea55e9f tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:29:16.671766 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-1441c5ab-2f44-4b1c-917c-74009ea55e9f tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a610b85c64df7ab471c6ee1d68dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45dbfa8603541f686c9b2e0bf291dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:29:16.679889 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1441c5ab-2f44-4b1c-917c-74009ea55e9f tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] 10.222.0.17 "GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38" status: 200 len: 1688 microversion: 2.1 time: 0.272853 Jul 23 22:29:16.680483 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4030/6640] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:29:16 2022] GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38 => generated 1688 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:29:17.696716 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b0ff16b5-59d5-4470-8203-e1cc10029cae tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:29:17.697414 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b0ff16b5-59d5-4470-8203-e1cc10029cae tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] [instance: f76e640c-0d54-4edc-aa13-fbbdd6307c38] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:29:17.705025 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b0ff16b5-59d5-4470-8203-e1cc10029cae tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:29:17.705472 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b0ff16b5-59d5-4470-8203-e1cc10029cae tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:29:17.706281 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b0ff16b5-59d5-4470-8203-e1cc10029cae tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:29:17.706690 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b0ff16b5-59d5-4470-8203-e1cc10029cae tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:29:17.867089 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b0ff16b5-59d5-4470-8203-e1cc10029cae tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a610b85c64df7ab471c6ee1d68dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45dbfa8603541f686c9b2e0bf291dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:29:17.874915 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b0ff16b5-59d5-4470-8203-e1cc10029cae tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] 10.222.0.17 "GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38" status: 200 len: 1688 microversion: 2.1 time: 0.182156 Jul 23 22:29:17.875572 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4031/6641] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:29:17 2022] GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38 => generated 1688 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:29:18.893107 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5c9369e7-0502-4cef-9223-d12323af135b tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:29:18.894834 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5c9369e7-0502-4cef-9223-d12323af135b tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] [instance: f76e640c-0d54-4edc-aa13-fbbdd6307c38] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:29:18.897735 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=65 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:29:18.903322 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5c9369e7-0502-4cef-9223-d12323af135b tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:29:18.903774 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5c9369e7-0502-4cef-9223-d12323af135b tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:29:18.904552 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5c9369e7-0502-4cef-9223-d12323af135b tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:29:18.904992 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5c9369e7-0502-4cef-9223-d12323af135b tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:29:19.047448 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5c9369e7-0502-4cef-9223-d12323af135b tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a610b85c64df7ab471c6ee1d68dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45dbfa8603541f686c9b2e0bf291dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:29:19.055335 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5c9369e7-0502-4cef-9223-d12323af135b tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] 10.222.0.17 "GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38" status: 200 len: 1688 microversion: 2.1 time: 0.166474 Jul 23 22:29:19.055920 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4032/6642] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:29:18 2022] GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38 => generated 1688 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:29:20.078521 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-73507f26-b041-474c-aeb7-67c84e718a49 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:29:20.080772 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-73507f26-b041-474c-aeb7-67c84e718a49 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] [instance: f76e640c-0d54-4edc-aa13-fbbdd6307c38] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:29:20.088708 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-73507f26-b041-474c-aeb7-67c84e718a49 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:29:20.089283 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-73507f26-b041-474c-aeb7-67c84e718a49 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:29:20.090240 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-73507f26-b041-474c-aeb7-67c84e718a49 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:29:20.090808 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-73507f26-b041-474c-aeb7-67c84e718a49 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:29:20.095732 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:29:20.259372 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-73507f26-b041-474c-aeb7-67c84e718a49 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a610b85c64df7ab471c6ee1d68dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45dbfa8603541f686c9b2e0bf291dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:29:20.268129 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-73507f26-b041-474c-aeb7-67c84e718a49 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] 10.222.0.17 "GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38" status: 200 len: 1688 microversion: 2.1 time: 0.196833 Jul 23 22:29:20.268727 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4033/6643] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:29:20 2022] GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38 => generated 1688 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:29:21.286205 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-374f8381-4516-4455-a2cb-f1f1da6d98be tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:29:21.286880 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-374f8381-4516-4455-a2cb-f1f1da6d98be tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] [instance: f76e640c-0d54-4edc-aa13-fbbdd6307c38] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:29:21.294516 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-374f8381-4516-4455-a2cb-f1f1da6d98be tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:29:21.295002 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-374f8381-4516-4455-a2cb-f1f1da6d98be tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:29:21.295782 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-374f8381-4516-4455-a2cb-f1f1da6d98be tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:29:21.296222 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-374f8381-4516-4455-a2cb-f1f1da6d98be tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:29:21.446275 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-374f8381-4516-4455-a2cb-f1f1da6d98be tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a610b85c64df7ab471c6ee1d68dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45dbfa8603541f686c9b2e0bf291dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:29:21.456504 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-374f8381-4516-4455-a2cb-f1f1da6d98be tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] 10.222.0.17 "GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38" status: 200 len: 1688 microversion: 2.1 time: 0.174293 Jul 23 22:29:21.466441 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4034/6644] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:29:21 2022] GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38 => generated 1688 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:29:22.474658 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-b6987805-8fd0-432d-8c37-cbb3c178ac59 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:29:22.475385 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-b6987805-8fd0-432d-8c37-cbb3c178ac59 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] [instance: f76e640c-0d54-4edc-aa13-fbbdd6307c38] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:29:22.482617 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b6987805-8fd0-432d-8c37-cbb3c178ac59 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:29:22.483070 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b6987805-8fd0-432d-8c37-cbb3c178ac59 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:29:22.483847 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b6987805-8fd0-432d-8c37-cbb3c178ac59 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:29:22.484285 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-b6987805-8fd0-432d-8c37-cbb3c178ac59 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:29:22.647687 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-b6987805-8fd0-432d-8c37-cbb3c178ac59 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a610b85c64df7ab471c6ee1d68dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45dbfa8603541f686c9b2e0bf291dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:29:22.661503 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-b6987805-8fd0-432d-8c37-cbb3c178ac59 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] 10.222.0.17 "GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38" status: 200 len: 1688 microversion: 2.1 time: 0.190687 Jul 23 22:29:22.663368 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4035/6645] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:29:22 2022] GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38 => generated 1688 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:29:23.681468 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-937bc2f8-3cd2-47c3-8d88-a57bd806f384 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:29:23.682994 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-937bc2f8-3cd2-47c3-8d88-a57bd806f384 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] [instance: f76e640c-0d54-4edc-aa13-fbbdd6307c38] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:29:23.691169 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-937bc2f8-3cd2-47c3-8d88-a57bd806f384 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:29:23.691733 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-937bc2f8-3cd2-47c3-8d88-a57bd806f384 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:29:23.693171 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-937bc2f8-3cd2-47c3-8d88-a57bd806f384 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:29:23.693616 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-937bc2f8-3cd2-47c3-8d88-a57bd806f384 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:29:23.842576 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-937bc2f8-3cd2-47c3-8d88-a57bd806f384 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a610b85c64df7ab471c6ee1d68dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45dbfa8603541f686c9b2e0bf291dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:29:23.850426 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-937bc2f8-3cd2-47c3-8d88-a57bd806f384 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] 10.222.0.17 "GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38" status: 200 len: 1688 microversion: 2.1 time: 0.173896 Jul 23 22:29:23.851022 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4036/6646] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:29:23 2022] GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38 => generated 1688 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:29:24.874209 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-bc1903b0-1518-4967-ad65-93127669701a tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:29:24.879195 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-bc1903b0-1518-4967-ad65-93127669701a tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] [instance: f76e640c-0d54-4edc-aa13-fbbdd6307c38] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:29:24.894836 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bc1903b0-1518-4967-ad65-93127669701a tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:29:24.895933 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bc1903b0-1518-4967-ad65-93127669701a tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:29:24.898336 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bc1903b0-1518-4967-ad65-93127669701a tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:29:24.899362 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bc1903b0-1518-4967-ad65-93127669701a tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:29:25.056290 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-bc1903b0-1518-4967-ad65-93127669701a tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a610b85c64df7ab471c6ee1d68dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45dbfa8603541f686c9b2e0bf291dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:29:25.064060 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-bc1903b0-1518-4967-ad65-93127669701a tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] 10.222.0.17 "GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38" status: 200 len: 1688 microversion: 2.1 time: 0.199575 Jul 23 22:29:25.064673 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4037/6647] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:29:24 2022] GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38 => generated 1688 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:29:26.085782 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-1b93dc18-4869-42d5-b215-2339eba90564 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:29:26.086764 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-1b93dc18-4869-42d5-b215-2339eba90564 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] [instance: f76e640c-0d54-4edc-aa13-fbbdd6307c38] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:29:26.096985 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1b93dc18-4869-42d5-b215-2339eba90564 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:29:26.097573 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1b93dc18-4869-42d5-b215-2339eba90564 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:29:26.098752 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1b93dc18-4869-42d5-b215-2339eba90564 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:29:26.099499 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-1b93dc18-4869-42d5-b215-2339eba90564 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:29:26.281423 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-1b93dc18-4869-42d5-b215-2339eba90564 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a610b85c64df7ab471c6ee1d68dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45dbfa8603541f686c9b2e0bf291dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:29:26.293357 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-1b93dc18-4869-42d5-b215-2339eba90564 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] 10.222.0.17 "GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38" status: 200 len: 1688 microversion: 2.1 time: 0.213800 Jul 23 22:29:26.294198 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4038/6648] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:29:26 2022] GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38 => generated 1688 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:29:27.311173 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-aa48d366-ca4f-4653-bb87-1b219f63f113 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:29:27.312298 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-aa48d366-ca4f-4653-bb87-1b219f63f113 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] [instance: f76e640c-0d54-4edc-aa13-fbbdd6307c38] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:29:27.319973 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-aa48d366-ca4f-4653-bb87-1b219f63f113 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:29:27.320439 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-aa48d366-ca4f-4653-bb87-1b219f63f113 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:29:27.321237 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-aa48d366-ca4f-4653-bb87-1b219f63f113 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:29:27.321748 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-aa48d366-ca4f-4653-bb87-1b219f63f113 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:29:27.622615 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-aa48d366-ca4f-4653-bb87-1b219f63f113 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a610b85c64df7ab471c6ee1d68dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45dbfa8603541f686c9b2e0bf291dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:29:27.630839 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-aa48d366-ca4f-4653-bb87-1b219f63f113 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] 10.222.0.17 "GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38" status: 200 len: 1688 microversion: 2.1 time: 0.323722 Jul 23 22:29:27.631438 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4039/6649] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:29:27 2022] GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38 => generated 1688 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:29:28.648541 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f3db68a8-85f7-47ad-82a2-530dad2ceba4 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:29:28.649294 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f3db68a8-85f7-47ad-82a2-530dad2ceba4 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] [instance: f76e640c-0d54-4edc-aa13-fbbdd6307c38] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:29:28.657183 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f3db68a8-85f7-47ad-82a2-530dad2ceba4 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:29:28.657660 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f3db68a8-85f7-47ad-82a2-530dad2ceba4 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:29:28.658770 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f3db68a8-85f7-47ad-82a2-530dad2ceba4 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:29:28.659707 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f3db68a8-85f7-47ad-82a2-530dad2ceba4 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:29:28.807134 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f3db68a8-85f7-47ad-82a2-530dad2ceba4 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a610b85c64df7ab471c6ee1d68dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45dbfa8603541f686c9b2e0bf291dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:29:28.815058 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f3db68a8-85f7-47ad-82a2-530dad2ceba4 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] 10.222.0.17 "GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38" status: 200 len: 1688 microversion: 2.1 time: 0.170937 Jul 23 22:29:28.815745 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4040/6650] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:29:28 2022] GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38 => generated 1688 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:29:29.833106 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4566afcf-924c-44d6-aaa6-551ac83fb775 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:29:29.833734 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-4566afcf-924c-44d6-aaa6-551ac83fb775 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] [instance: f76e640c-0d54-4edc-aa13-fbbdd6307c38] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:29:29.841004 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4566afcf-924c-44d6-aaa6-551ac83fb775 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:29:29.841471 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4566afcf-924c-44d6-aaa6-551ac83fb775 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:29:29.842288 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4566afcf-924c-44d6-aaa6-551ac83fb775 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:29:29.842736 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4566afcf-924c-44d6-aaa6-551ac83fb775 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:29:29.974719 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-4566afcf-924c-44d6-aaa6-551ac83fb775 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a610b85c64df7ab471c6ee1d68dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45dbfa8603541f686c9b2e0bf291dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:29:29.982495 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4566afcf-924c-44d6-aaa6-551ac83fb775 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] 10.222.0.17 "GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38" status: 200 len: 1688 microversion: 2.1 time: 0.153509 Jul 23 22:29:29.983064 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4041/6651] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:29:29 2022] GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38 => generated 1688 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:29:31.004668 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-647aad5d-9209-40f8-a82c-763b962caaa7 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:29:31.005711 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-647aad5d-9209-40f8-a82c-763b962caaa7 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] [instance: f76e640c-0d54-4edc-aa13-fbbdd6307c38] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:29:31.017649 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-647aad5d-9209-40f8-a82c-763b962caaa7 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:29:31.018466 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-647aad5d-9209-40f8-a82c-763b962caaa7 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:29:31.019757 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-647aad5d-9209-40f8-a82c-763b962caaa7 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:29:31.020491 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-647aad5d-9209-40f8-a82c-763b962caaa7 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:29:31.163977 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-647aad5d-9209-40f8-a82c-763b962caaa7 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a610b85c64df7ab471c6ee1d68dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45dbfa8603541f686c9b2e0bf291dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:29:31.172244 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-647aad5d-9209-40f8-a82c-763b962caaa7 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] 10.222.0.17 "GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38" status: 200 len: 1688 microversion: 2.1 time: 0.174508 Jul 23 22:29:31.172807 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4042/6652] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:29:30 2022] GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38 => generated 1688 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:29:32.195029 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d50ca621-1b34-45d2-81f0-ab6b0d076e33 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:29:32.196099 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d50ca621-1b34-45d2-81f0-ab6b0d076e33 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] [instance: f76e640c-0d54-4edc-aa13-fbbdd6307c38] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:29:32.203698 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d50ca621-1b34-45d2-81f0-ab6b0d076e33 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:29:32.204176 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d50ca621-1b34-45d2-81f0-ab6b0d076e33 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:29:32.204954 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d50ca621-1b34-45d2-81f0-ab6b0d076e33 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:29:32.205369 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d50ca621-1b34-45d2-81f0-ab6b0d076e33 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:29:32.340217 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d50ca621-1b34-45d2-81f0-ab6b0d076e33 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a610b85c64df7ab471c6ee1d68dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45dbfa8603541f686c9b2e0bf291dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:29:32.350671 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d50ca621-1b34-45d2-81f0-ab6b0d076e33 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] 10.222.0.17 "GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38" status: 200 len: 1688 microversion: 2.1 time: 0.159675 Jul 23 22:29:32.351237 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4043/6653] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:29:32 2022] GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38 => generated 1688 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:29:32.356702 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-893569fe-008a-433f-8113-1af4ecb75c0d req-98e28622-a12e-4704-9554-ce070a32834a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f76e640c-0d54-4edc-aa13-fbbdd6307c38", "name": "network-vif-plugged", "status": "completed", "tag": "69867935-142e-4ba1-81be-d81fb8eaf436"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:29:32.364967 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-893569fe-008a-433f-8113-1af4ecb75c0d req-98e28622-a12e-4704-9554-ce070a32834a service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:29:32.365417 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-893569fe-008a-433f-8113-1af4ecb75c0d req-98e28622-a12e-4704-9554-ce070a32834a service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:29:32.376542 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-893569fe-008a-433f-8113-1af4ecb75c0d req-98e28622-a12e-4704-9554-ce070a32834a service nova] Creating event network-vif-plugged:69867935-142e-4ba1-81be-d81fb8eaf436 for instance f76e640c-0d54-4edc-aa13-fbbdd6307c38 on nch2-master-1 Jul 23 22:29:32.381887 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-893569fe-008a-433f-8113-1af4ecb75c0d req-98e28622-a12e-4704-9554-ce070a32834a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028608 Jul 23 22:29:32.382550 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4044/6654] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:29:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:29:33.373621 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d864f94a-611d-4686-8566-11617b496533 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:29:33.374809 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d864f94a-611d-4686-8566-11617b496533 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] [instance: f76e640c-0d54-4edc-aa13-fbbdd6307c38] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:29:33.383487 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d864f94a-611d-4686-8566-11617b496533 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:29:33.383946 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d864f94a-611d-4686-8566-11617b496533 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:29:33.384727 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d864f94a-611d-4686-8566-11617b496533 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:29:33.385175 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d864f94a-611d-4686-8566-11617b496533 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:29:33.544435 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d864f94a-611d-4686-8566-11617b496533 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a610b85c64df7ab471c6ee1d68dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45dbfa8603541f686c9b2e0bf291dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:29:33.552560 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d864f94a-611d-4686-8566-11617b496533 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] 10.222.0.17 "GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38" status: 200 len: 1688 microversion: 2.1 time: 0.187451 Jul 23 22:29:33.553147 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4045/6655] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:29:33 2022] GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38 => generated 1688 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:29:34.569549 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8148666b-8354-4f16-9a73-d3a9acd344f9 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:29:34.570932 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8148666b-8354-4f16-9a73-d3a9acd344f9 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] [instance: f76e640c-0d54-4edc-aa13-fbbdd6307c38] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:29:34.578749 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8148666b-8354-4f16-9a73-d3a9acd344f9 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:29:34.579204 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8148666b-8354-4f16-9a73-d3a9acd344f9 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:29:34.579981 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8148666b-8354-4f16-9a73-d3a9acd344f9 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:29:34.580422 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8148666b-8354-4f16-9a73-d3a9acd344f9 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:29:34.726812 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8148666b-8354-4f16-9a73-d3a9acd344f9 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a610b85c64df7ab471c6ee1d68dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45dbfa8603541f686c9b2e0bf291dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:29:34.734674 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8148666b-8354-4f16-9a73-d3a9acd344f9 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] 10.222.0.17 "GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38" status: 200 len: 1675 microversion: 2.1 time: 0.169088 Jul 23 22:29:34.735257 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4046/6656] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:29:34 2022] GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38 => generated 1675 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:30:45.132640 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c42e6b0c-8182-47f8-ac5b-bdc528785c51 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:30:45.133253 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c42e6b0c-8182-47f8-ac5b-bdc528785c51 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] [instance: f76e640c-0d54-4edc-aa13-fbbdd6307c38] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:30:45.135996 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=29 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:30:45.136664 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=78 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:30:45.143010 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c42e6b0c-8182-47f8-ac5b-bdc528785c51 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:30:45.143472 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c42e6b0c-8182-47f8-ac5b-bdc528785c51 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:30:45.144270 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c42e6b0c-8182-47f8-ac5b-bdc528785c51 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:30:45.144708 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c42e6b0c-8182-47f8-ac5b-bdc528785c51 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:30:45.170520 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c42e6b0c-8182-47f8-ac5b-bdc528785c51 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] [instance: f76e640c-0d54-4edc-aa13-fbbdd6307c38] Going to try to terminate instance {{(pid=131320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 22:30:45.253328 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c42e6b0c-8182-47f8-ac5b-bdc528785c51 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] 10.222.0.17 "DELETE /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38" status: 204 len: 0 microversion: 2.1 time: 0.125176 Jul 23 22:30:45.254046 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4047/6657] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 22:30:45 2022] DELETE /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 23 22:30:45.315805 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-5b2f38ce-2fcf-456a-a0f1-ecb6ae0e3904 req-dc00565b-e709-4e09-af0c-0bdab52b88f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f76e640c-0d54-4edc-aa13-fbbdd6307c38", "tag": "69867935-142e-4ba1-81be-d81fb8eaf436"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:30:45.324837 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-5b2f38ce-2fcf-456a-a0f1-ecb6ae0e3904 req-dc00565b-e709-4e09-af0c-0bdab52b88f9 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:30:45.325288 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-5b2f38ce-2fcf-456a-a0f1-ecb6ae0e3904 req-dc00565b-e709-4e09-af0c-0bdab52b88f9 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:30:45.337314 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-5b2f38ce-2fcf-456a-a0f1-ecb6ae0e3904 req-dc00565b-e709-4e09-af0c-0bdab52b88f9 service nova] Creating event network-changed:69867935-142e-4ba1-81be-d81fb8eaf436 for instance f76e640c-0d54-4edc-aa13-fbbdd6307c38 on nch2-master-1 Jul 23 22:30:45.342361 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-5b2f38ce-2fcf-456a-a0f1-ecb6ae0e3904 req-dc00565b-e709-4e09-af0c-0bdab52b88f9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086988 Jul 23 22:30:45.342958 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4048/6658] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:30:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:30:45.348091 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-41195625-2543-46de-bf92-0e9e3497991c tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:30:45.348795 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-41195625-2543-46de-bf92-0e9e3497991c tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] [instance: f76e640c-0d54-4edc-aa13-fbbdd6307c38] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:30:45.355241 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-41195625-2543-46de-bf92-0e9e3497991c tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:30:45.355703 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-41195625-2543-46de-bf92-0e9e3497991c tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:30:45.356484 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-41195625-2543-46de-bf92-0e9e3497991c tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:30:45.356928 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-41195625-2543-46de-bf92-0e9e3497991c tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:30:45.492109 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-41195625-2543-46de-bf92-0e9e3497991c tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a610b85c64df7ab471c6ee1d68dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45dbfa8603541f686c9b2e0bf291dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:30:45.500109 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-41195625-2543-46de-bf92-0e9e3497991c tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] 10.222.0.17 "GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38" status: 200 len: 1681 microversion: 2.1 time: 0.155962 Jul 23 22:30:45.500680 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4049/6659] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:30:45 2022] GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:30:46.518136 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e497fa41-fb0e-4d0d-a93e-1daafce914d3 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:30:46.518817 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e497fa41-fb0e-4d0d-a93e-1daafce914d3 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] [instance: f76e640c-0d54-4edc-aa13-fbbdd6307c38] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:30:46.526560 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e497fa41-fb0e-4d0d-a93e-1daafce914d3 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:30:46.527014 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e497fa41-fb0e-4d0d-a93e-1daafce914d3 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:30:46.527789 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e497fa41-fb0e-4d0d-a93e-1daafce914d3 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:30:46.528230 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-e497fa41-fb0e-4d0d-a93e-1daafce914d3 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:30:46.767942 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e497fa41-fb0e-4d0d-a93e-1daafce914d3 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a610b85c64df7ab471c6ee1d68dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b45dbfa8603541f686c9b2e0bf291dd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:30:46.776105 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e497fa41-fb0e-4d0d-a93e-1daafce914d3 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] 10.222.0.17 "GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38" status: 200 len: 1681 microversion: 2.1 time: 0.261846 Jul 23 22:30:46.776614 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4050/6660] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:30:46 2022] GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38 => generated 1681 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:30:47.043977 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-5d610c44-df47-46c0-b93f-39032eab0f9f req-0fe0c3db-63d0-463a-be84-591414fd0815 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f76e640c-0d54-4edc-aa13-fbbdd6307c38", "name": "network-vif-deleted", "tag": "69867935-142e-4ba1-81be-d81fb8eaf436"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:30:47.053083 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-5d610c44-df47-46c0-b93f-39032eab0f9f req-0fe0c3db-63d0-463a-be84-591414fd0815 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:30:47.053534 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-5d610c44-df47-46c0-b93f-39032eab0f9f req-0fe0c3db-63d0-463a-be84-591414fd0815 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:30:47.065926 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-5d610c44-df47-46c0-b93f-39032eab0f9f req-0fe0c3db-63d0-463a-be84-591414fd0815 service nova] Creating event network-vif-deleted:69867935-142e-4ba1-81be-d81fb8eaf436 for instance f76e640c-0d54-4edc-aa13-fbbdd6307c38 on nch2-master-1 Jul 23 22:30:47.070875 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-5d610c44-df47-46c0-b93f-39032eab0f9f req-0fe0c3db-63d0-463a-be84-591414fd0815 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030644 Jul 23 22:30:47.071555 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4051/6661] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:30:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 22:30:47.795233 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ac7e4d9a-3ee6-4490-b805-57e13eef2174 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:30:47.796028 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ac7e4d9a-3ee6-4490-b805-57e13eef2174 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] [instance: f76e640c-0d54-4edc-aa13-fbbdd6307c38] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:30:47.803699 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ac7e4d9a-3ee6-4490-b805-57e13eef2174 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:30:47.804285 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ac7e4d9a-3ee6-4490-b805-57e13eef2174 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:30:47.805106 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ac7e4d9a-3ee6-4490-b805-57e13eef2174 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:30:47.805547 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ac7e4d9a-3ee6-4490-b805-57e13eef2174 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:30:47.819788 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-ac7e4d9a-3ee6-4490-b805-57e13eef2174 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] HTTP exception thrown: Instance f76e640c-0d54-4edc-aa13-fbbdd6307c38 could not be found. Jul 23 22:30:47.821475 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ac7e4d9a-3ee6-4490-b805-57e13eef2174 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Request method failure captured: Jul 23 22:30:47.821475 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38 HTTP/1.1 Jul 23 22:30:47.821475 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 22:30:47.821475 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 22:30:47.821475 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 22:30:47.821475 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 22:30:47.821475 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 22:30:47.821475 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 22:30:47.821475 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 22:30:47.821475 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 22:30:47.821475 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3HWX2lqWBiEbGs0jGekOh5Sz93XVkM9-T9uWie9JqMoCd7G_8EoDyE8T0DlTaE-eIZuJeD4cMwiQRGshBrToRuemv3BmRMUvGeVUl2pWaKBg5LtaMBBb_2LdeYCtUpYFzp1zwa5At9Fj5QahSntx4OXBBdDXHvaxfO_I3WifYB8x-1k Jul 23 22:30:47.821475 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 22:30:47.821475 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 22:30:47.821475 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 22:30:47.821475 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 22:30:47.821475 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 22:30:47.821475 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 22:30:47.821475 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: b45dbfa8603541f686c9b2e0bf291dd7 Jul 23 22:30:47.821475 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-TestShelveInstance-945555474 Jul 23 22:30:47.821475 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 22:30:47.821475 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 22:30:47.821475 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b45dbfa8603541f686c9b2e0bf291dd7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/b45dbfa8603541f686c9b2e0bf291dd7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_b45dbfa8603541f686c9b2e0bf291dd7", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/b45dbfa8603541f686c9b2e0bf291dd7"}]}] Jul 23 22:30:47.821475 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-TestShelveInstance-945555474 Jul 23 22:30:47.821475 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: b45dbfa8603541f686c9b2e0bf291dd7 Jul 23 22:30:47.821475 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-TestShelveInstance-945555474 Jul 23 22:30:47.821475 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-TestShelveInstance-945555474-project Jul 23 22:30:47.821475 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 22:30:47.821475 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 22:30:47.821475 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: c72a610b85c64df7ab471c6ee1d68dcd Jul 23 22:30:47.821475 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-TestShelveInstance-945555474-project Jul 23 22:30:47.821475 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 22:30:47.821475 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance f76e640c-0d54-4edc-aa13-fbbdd6307c38 could not be found. Jul 23 22:30:47.821475 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': 'f76e640c-0d54-4edc-aa13-fbbdd6307c38'} Jul 23 22:30:47.821475 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 22:30:47.821475 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:30:47.821475 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 22:30:47.821475 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 22:30:47.821475 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 22:30:47.821475 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 22:30:47.821475 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 22:30:47.821475 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 22:30:47.821475 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 22:30:47.821475 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 22:30:47.821475 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f76e640c-0d54-4edc-aa13-fbbdd6307c38 could not be found. Jul 23 22:30:47.821475 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:30:47.821475 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:30:47.821475 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:30:47.821475 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:30:47.821475 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:30:47.821475 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:30:47.821475 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 22:30:47.821475 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 22:30:47.821475 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 22:30:47.821475 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 22:30:47.821475 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 22:30:47.821475 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 22:30:47.821475 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 22:30:47.821475 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 22:30:47.821475 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 22:30:47.821475 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 22:30:47.821475 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f76e640c-0d54-4edc-aa13-fbbdd6307c38 could not be found. Jul 23 22:30:47.821475 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:30:47.821475 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:30:47.821475 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:30:47.826408 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:30:47.826408 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:30:47.826408 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:30:47.826408 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 22:30:47.826408 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 22:30:47.826408 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f76e640c-0d54-4edc-aa13-fbbdd6307c38 could not be found. Jul 23 22:30:47.826408 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:30:47.826408 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ac7e4d9a-3ee6-4490-b805-57e13eef2174 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Returning 404 to user: Instance f76e640c-0d54-4edc-aa13-fbbdd6307c38 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 22:30:47.826408 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ac7e4d9a-3ee6-4490-b805-57e13eef2174 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] 10.222.0.17 "GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38" status: 404 len: 111 microversion: 2.1 time: 0.033545 Jul 23 22:30:47.826958 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4052/6662] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:30:47 2022] GET /compute/v2.1/servers/f76e640c-0d54-4edc-aa13-fbbdd6307c38 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 22:30:47.994377 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-394f4208-b284-464e-8e3a-594d90028546 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Calling method '.version_select at 0x7f0b5404c940>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:30:48.017381 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-394f4208-b284-464e-8e3a-594d90028546 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-229113962" status: 202 len: 0 microversion: 2.1 time: 0.027487 Jul 23 22:30:48.021937 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4053/6663] 10.222.0.17 () {58 vars in 1250 bytes} [Sat Jul 23 22:30:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-229113962 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 23 22:30:48.041478 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5330594a-0a17-4134-baef-8ceb3bb2a6d4 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Action: 'create', calling method: .version_select at 0x7f0b47f34700>, body: {"keypair": {"name": "tempest-TestShelveInstance-2000246137", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPK36cz80YhFMssTu3SLSU4iz7A4KcEdam9mI3yBggCqb+msCKrcZNk/f4MiGxI1mEDd5DEo0YVOywQ+3z6AKhDodXAQvfckjpgdrWRv+r2W+bUKaSC8f9+u2kl77/LZPw=="}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:30:48.057261 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-5330594a-0a17-4134-baef-8ceb3bb2a6d4 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Getting quotas for project b45dbfa8603541f686c9b2e0bf291dd7. Resources: {'key_pairs'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 22:30:48.062559 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-5330594a-0a17-4134-baef-8ceb3bb2a6d4 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Getting quotas for user c72a610b85c64df7ab471c6ee1d68dcd and project b45dbfa8603541f686c9b2e0bf291dd7. Resources: {'key_pairs'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 22:30:48.088489 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5330594a-0a17-4134-baef-8ceb3bb2a6d4 tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.050923 Jul 23 22:30:48.089109 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4054/6664] 10.222.0.17 () {60 vars in 1158 bytes} [Sat Jul 23 22:30:48 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 22:30:50.913026 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-58ca3e6d-e084-461e-acf8-b3c5875c5f2f tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] Calling method '.version_select at 0x7f0b5998d160>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:30:50.932962 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-58ca3e6d-e084-461e-acf8-b3c5875c5f2f tempest-TestShelveInstance-945555474 tempest-TestShelveInstance-945555474-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2000246137" status: 202 len: 0 microversion: 2.1 time: 0.024873 Jul 23 22:30:50.940256 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4055/6665] 10.222.0.17 () {58 vars in 1253 bytes} [Sat Jul 23 22:30:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2000246137 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 23 22:31:08.451774 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:31:08.453133 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=4 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:31:08.454011 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:31:08.662312 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e141bad3-3bdb-4ffa-bed8-dd5703a6c05c tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Action: 'create', calling method: .version_select at 0x7f0b47bdf160>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-847712247", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH9DgJkTRdrL+O8LFBag1UnW4BTqYe7IM/+cVWqq96b1r/w6u7tlv2WEPe7/th32JYGLkd6yLWT7hKx+ofPqDr5yilX+LC8+miBo2uggLLXG86wjoPINNFZ6cTI6jp64Gg=="}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:31:08.677546 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-e141bad3-3bdb-4ffa-bed8-dd5703a6c05c tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Getting quotas for project 4ab318d1c967420cbac48456436e90c5. Resources: {'key_pairs'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 22:31:08.683965 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-e141bad3-3bdb-4ffa-bed8-dd5703a6c05c tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Getting quotas for user 94052639b2b5416aa2cd97854deae6b2 and project 4ab318d1c967420cbac48456436e90c5. Resources: {'key_pairs'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 22:31:08.714514 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e141bad3-3bdb-4ffa-bed8-dd5703a6c05c tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.268734 Jul 23 22:31:08.715380 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4056/6666] 10.222.0.17 () {60 vars in 1158 bytes} [Sat Jul 23 22:31:08 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:31:09.872016 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8aeb9a4e-b777-40c1-b861-78cde2c82f43 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1354345098", "imageRef": "b27b20aa-ef1b-4dd1-989e-321af6343d6a", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-847712247", "security_groups": [{"name": "tempest-secgroup-smoke-114796690"}], "networks": [{"uuid": "02f2117f-a768-4ebc-84bb-81783f9cc04c"}]}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:31:09.984643 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-8aeb9a4e-b777-40c1-b861-78cde2c82f43 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] validate_networks() for [('02f2117f-a768-4ebc-84bb-81783f9cc04c', None, None, None, None, None)] {{(pid=131320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 22:31:10.372356 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-8aeb9a4e-b777-40c1-b861-78cde2c82f43 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 22:31:10.372791 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-8aeb9a4e-b777-40c1-b861-78cde2c82f43 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 22:31:10.373272 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-8aeb9a4e-b777-40c1-b861-78cde2c82f43 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 22:31:10.373686 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-8aeb9a4e-b777-40c1-b861-78cde2c82f43 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 22:31:10.374130 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-8aeb9a4e-b777-40c1-b861-78cde2c82f43 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 22:31:10.383443 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8aeb9a4e-b777-40c1-b861-78cde2c82f43 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:31:10.383895 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8aeb9a4e-b777-40c1-b861-78cde2c82f43 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:31:10.384698 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8aeb9a4e-b777-40c1-b861-78cde2c82f43 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:31:10.385139 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8aeb9a4e-b777-40c1-b861-78cde2c82f43 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:31:10.402869 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-8aeb9a4e-b777-40c1-b861-78cde2c82f43 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Getting quotas for project 4ab318d1c967420cbac48456436e90c5. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 22:31:10.408314 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-8aeb9a4e-b777-40c1-b861-78cde2c82f43 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Getting quotas for user 94052639b2b5416aa2cd97854deae6b2 and project 4ab318d1c967420cbac48456436e90c5. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 22:31:10.420969 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8aeb9a4e-b777-40c1-b861-78cde2c82f43 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Going to run 1 instances... {{(pid=131320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 22:31:10.423334 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8aeb9a4e-b777-40c1-b861-78cde2c82f43 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] [instance: fd589087-ba84-4a9d-a54c-72248385994f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b27b20aa-ef1b-4dd1-989e-321af6343d6a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 22:31:10.469693 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8aeb9a4e-b777-40c1-b861-78cde2c82f43 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.602480 Jul 23 22:31:10.475686 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4057/6667] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 22:31:09 2022] POST /compute/v2.1/servers => generated 405 bytes in 604 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 23 22:31:10.480495 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3974a06c-3bf7-478c-97dc-c90f75c95c33 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:31:10.481127 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-3974a06c-3bf7-478c-97dc-c90f75c95c33 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] [instance: fd589087-ba84-4a9d-a54c-72248385994f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:31:10.534995 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-3974a06c-3bf7-478c-97dc-c90f75c95c33 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94052639b2b5416aa2cd97854deae6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ab318d1c967420cbac48456436e90c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:31:10.542294 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-3974a06c-3bf7-478c-97dc-c90f75c95c33 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] 10.222.0.17 "GET /compute/v2.1/servers/fd589087-ba84-4a9d-a54c-72248385994f" status: 200 len: 1248 microversion: 2.1 time: 0.065544 Jul 23 22:31:10.543108 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4058/6668] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:31:10 2022] GET /compute/v2.1/servers/fd589087-ba84-4a9d-a54c-72248385994f => generated 1248 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:31:11.560292 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2a2d7072-cd4e-4ef6-83f4-a9de81dd7c21 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:31:11.561738 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-2a2d7072-cd4e-4ef6-83f4-a9de81dd7c21 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] [instance: fd589087-ba84-4a9d-a54c-72248385994f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:31:11.629505 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-2a2d7072-cd4e-4ef6-83f4-a9de81dd7c21 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94052639b2b5416aa2cd97854deae6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ab318d1c967420cbac48456436e90c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:31:11.646881 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2a2d7072-cd4e-4ef6-83f4-a9de81dd7c21 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] 10.222.0.17 "GET /compute/v2.1/servers/fd589087-ba84-4a9d-a54c-72248385994f" status: 200 len: 1248 microversion: 2.1 time: 0.090883 Jul 23 22:31:11.647935 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4059/6669] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:31:11 2022] GET /compute/v2.1/servers/fd589087-ba84-4a9d-a54c-72248385994f => generated 1248 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:31:12.664356 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-e7c0d773-d892-4781-81d6-26bd21946500 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:31:12.665019 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-e7c0d773-d892-4781-81d6-26bd21946500 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] [instance: fd589087-ba84-4a9d-a54c-72248385994f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:31:12.730903 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-e7c0d773-d892-4781-81d6-26bd21946500 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94052639b2b5416aa2cd97854deae6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ab318d1c967420cbac48456436e90c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:31:12.738874 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-e7c0d773-d892-4781-81d6-26bd21946500 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] 10.222.0.17 "GET /compute/v2.1/servers/fd589087-ba84-4a9d-a54c-72248385994f" status: 200 len: 1248 microversion: 2.1 time: 0.078558 Jul 23 22:31:12.739641 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4060/6670] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:31:12 2022] GET /compute/v2.1/servers/fd589087-ba84-4a9d-a54c-72248385994f => generated 1248 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:31:13.762596 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-14647149-f28f-403d-93a0-33d4ed550430 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:31:13.763293 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-14647149-f28f-403d-93a0-33d4ed550430 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] [instance: fd589087-ba84-4a9d-a54c-72248385994f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:31:13.818436 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-14647149-f28f-403d-93a0-33d4ed550430 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94052639b2b5416aa2cd97854deae6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ab318d1c967420cbac48456436e90c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:31:13.826691 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-14647149-f28f-403d-93a0-33d4ed550430 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] 10.222.0.17 "GET /compute/v2.1/servers/fd589087-ba84-4a9d-a54c-72248385994f" status: 200 len: 1248 microversion: 2.1 time: 0.071835 Jul 23 22:31:13.827323 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4061/6671] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:31:13 2022] GET /compute/v2.1/servers/fd589087-ba84-4a9d-a54c-72248385994f => generated 1248 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:31:14.844320 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5203fa7e-1dec-4d9f-9ffb-318d49d1b6ca tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:31:14.844996 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5203fa7e-1dec-4d9f-9ffb-318d49d1b6ca tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] [instance: fd589087-ba84-4a9d-a54c-72248385994f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:31:14.852569 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5203fa7e-1dec-4d9f-9ffb-318d49d1b6ca tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:31:14.853029 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5203fa7e-1dec-4d9f-9ffb-318d49d1b6ca tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:31:14.853970 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5203fa7e-1dec-4d9f-9ffb-318d49d1b6ca tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:31:14.854418 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5203fa7e-1dec-4d9f-9ffb-318d49d1b6ca tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:31:14.919292 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5203fa7e-1dec-4d9f-9ffb-318d49d1b6ca tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94052639b2b5416aa2cd97854deae6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ab318d1c967420cbac48456436e90c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:31:14.927742 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5203fa7e-1dec-4d9f-9ffb-318d49d1b6ca tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] 10.222.0.17 "GET /compute/v2.1/servers/fd589087-ba84-4a9d-a54c-72248385994f" status: 200 len: 1252 microversion: 2.1 time: 0.087412 Jul 23 22:31:14.928329 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4062/6672] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:31:14 2022] GET /compute/v2.1/servers/fd589087-ba84-4a9d-a54c-72248385994f => generated 1252 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:31:15.945103 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-fa54cbd5-de2f-48de-a081-8e166a43dc4b tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:31:15.945777 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-fa54cbd5-de2f-48de-a081-8e166a43dc4b tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] [instance: fd589087-ba84-4a9d-a54c-72248385994f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:31:15.953698 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fa54cbd5-de2f-48de-a081-8e166a43dc4b tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:31:15.954202 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fa54cbd5-de2f-48de-a081-8e166a43dc4b tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:31:15.955133 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fa54cbd5-de2f-48de-a081-8e166a43dc4b tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:31:15.955580 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fa54cbd5-de2f-48de-a081-8e166a43dc4b tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:31:16.031339 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-fa54cbd5-de2f-48de-a081-8e166a43dc4b tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94052639b2b5416aa2cd97854deae6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ab318d1c967420cbac48456436e90c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:31:16.039428 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-fa54cbd5-de2f-48de-a081-8e166a43dc4b tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] 10.222.0.17 "GET /compute/v2.1/servers/fd589087-ba84-4a9d-a54c-72248385994f" status: 200 len: 1306 microversion: 2.1 time: 0.098522 Jul 23 22:31:16.040013 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4063/6673] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:31:15 2022] GET /compute/v2.1/servers/fd589087-ba84-4a9d-a54c-72248385994f => generated 1306 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:31:17.058471 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4efa4cfa-65c2-4bab-897a-6772261ad199 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:31:17.059888 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-4efa4cfa-65c2-4bab-897a-6772261ad199 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] [instance: fd589087-ba84-4a9d-a54c-72248385994f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:31:17.067704 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4efa4cfa-65c2-4bab-897a-6772261ad199 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:31:17.068191 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4efa4cfa-65c2-4bab-897a-6772261ad199 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:31:17.068974 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4efa4cfa-65c2-4bab-897a-6772261ad199 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:31:17.069411 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4efa4cfa-65c2-4bab-897a-6772261ad199 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:31:17.348762 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-4efa4cfa-65c2-4bab-897a-6772261ad199 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94052639b2b5416aa2cd97854deae6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ab318d1c967420cbac48456436e90c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:31:17.359187 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4efa4cfa-65c2-4bab-897a-6772261ad199 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] 10.222.0.17 "GET /compute/v2.1/servers/fd589087-ba84-4a9d-a54c-72248385994f" status: 200 len: 1373 microversion: 2.1 time: 0.304849 Jul 23 22:31:17.360069 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4064/6674] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:31:17 2022] GET /compute/v2.1/servers/fd589087-ba84-4a9d-a54c-72248385994f => generated 1373 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:31:17.364625 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-a19d6f9b-fc0f-4dce-88d2-f4602bfc5fbf req-c99530b3-29cd-40d8-845c-3193dbe7d934 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd589087-ba84-4a9d-a54c-72248385994f", "tag": "5e61afc4-3017-4d25-a36f-c4d31d879b88"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:31:17.372781 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-a19d6f9b-fc0f-4dce-88d2-f4602bfc5fbf req-c99530b3-29cd-40d8-845c-3193dbe7d934 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:31:17.373232 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-a19d6f9b-fc0f-4dce-88d2-f4602bfc5fbf req-c99530b3-29cd-40d8-845c-3193dbe7d934 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:31:17.384326 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-a19d6f9b-fc0f-4dce-88d2-f4602bfc5fbf req-c99530b3-29cd-40d8-845c-3193dbe7d934 service nova] Creating event network-changed:5e61afc4-3017-4d25-a36f-c4d31d879b88 for instance fd589087-ba84-4a9d-a54c-72248385994f on nch1-master-1 Jul 23 22:31:17.389264 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-a19d6f9b-fc0f-4dce-88d2-f4602bfc5fbf req-c99530b3-29cd-40d8-845c-3193dbe7d934 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027926 Jul 23 22:31:17.390044 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4065/6675] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:31:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:31:18.382752 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-2c08dbdc-5058-48f2-8f90-bdafb0dff440 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:31:18.383426 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-2c08dbdc-5058-48f2-8f90-bdafb0dff440 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] [instance: fd589087-ba84-4a9d-a54c-72248385994f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:31:18.390662 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2c08dbdc-5058-48f2-8f90-bdafb0dff440 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:31:18.391107 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2c08dbdc-5058-48f2-8f90-bdafb0dff440 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:31:18.391879 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2c08dbdc-5058-48f2-8f90-bdafb0dff440 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:31:18.392323 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-2c08dbdc-5058-48f2-8f90-bdafb0dff440 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:31:18.568531 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-2c08dbdc-5058-48f2-8f90-bdafb0dff440 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94052639b2b5416aa2cd97854deae6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ab318d1c967420cbac48456436e90c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:31:18.577602 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-2c08dbdc-5058-48f2-8f90-bdafb0dff440 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] 10.222.0.17 "GET /compute/v2.1/servers/fd589087-ba84-4a9d-a54c-72248385994f" status: 200 len: 1373 microversion: 2.1 time: 0.203052 Jul 23 22:31:18.578240 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4066/6676] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:31:18 2022] GET /compute/v2.1/servers/fd589087-ba84-4a9d-a54c-72248385994f => generated 1373 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:31:19.596391 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8abf1dd8-dcc2-4580-808e-e97f9eb89ce9 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:31:19.596996 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8abf1dd8-dcc2-4580-808e-e97f9eb89ce9 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] [instance: fd589087-ba84-4a9d-a54c-72248385994f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:31:19.604517 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8abf1dd8-dcc2-4580-808e-e97f9eb89ce9 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:31:19.604981 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8abf1dd8-dcc2-4580-808e-e97f9eb89ce9 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:31:19.605753 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8abf1dd8-dcc2-4580-808e-e97f9eb89ce9 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:31:19.606228 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8abf1dd8-dcc2-4580-808e-e97f9eb89ce9 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:31:19.749231 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8abf1dd8-dcc2-4580-808e-e97f9eb89ce9 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94052639b2b5416aa2cd97854deae6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ab318d1c967420cbac48456436e90c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:31:19.757135 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8abf1dd8-dcc2-4580-808e-e97f9eb89ce9 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] 10.222.0.17 "GET /compute/v2.1/servers/fd589087-ba84-4a9d-a54c-72248385994f" status: 200 len: 1373 microversion: 2.1 time: 0.165642 Jul 23 22:31:19.757743 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4067/6677] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:31:19 2022] GET /compute/v2.1/servers/fd589087-ba84-4a9d-a54c-72248385994f => generated 1373 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:31:20.775831 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-0c0f0413-3c44-4788-a3d9-09e59c32f95f tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:31:20.776492 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-0c0f0413-3c44-4788-a3d9-09e59c32f95f tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] [instance: fd589087-ba84-4a9d-a54c-72248385994f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:31:20.778892 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:31:20.784688 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0c0f0413-3c44-4788-a3d9-09e59c32f95f tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:31:20.785139 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0c0f0413-3c44-4788-a3d9-09e59c32f95f tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:31:20.785901 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0c0f0413-3c44-4788-a3d9-09e59c32f95f tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:31:20.786378 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-0c0f0413-3c44-4788-a3d9-09e59c32f95f tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:31:20.925657 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-0c0f0413-3c44-4788-a3d9-09e59c32f95f tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94052639b2b5416aa2cd97854deae6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ab318d1c967420cbac48456436e90c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:31:20.933778 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-0c0f0413-3c44-4788-a3d9-09e59c32f95f tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] 10.222.0.17 "GET /compute/v2.1/servers/fd589087-ba84-4a9d-a54c-72248385994f" status: 200 len: 1373 microversion: 2.1 time: 0.162777 Jul 23 22:31:20.934413 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4068/6678] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:31:20 2022] GET /compute/v2.1/servers/fd589087-ba84-4a9d-a54c-72248385994f => generated 1373 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:31:21.159360 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-b3ed078d-3859-40ce-9a31-87ecdb8a7b45 req-578a1798-e64b-41b5-a7d7-993f68dfa30d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd589087-ba84-4a9d-a54c-72248385994f", "name": "network-vif-plugged", "status": "completed", "tag": "5e61afc4-3017-4d25-a36f-c4d31d879b88"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:31:21.168084 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-b3ed078d-3859-40ce-9a31-87ecdb8a7b45 req-578a1798-e64b-41b5-a7d7-993f68dfa30d service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:31:21.168538 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-b3ed078d-3859-40ce-9a31-87ecdb8a7b45 req-578a1798-e64b-41b5-a7d7-993f68dfa30d service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:31:21.180663 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-b3ed078d-3859-40ce-9a31-87ecdb8a7b45 req-578a1798-e64b-41b5-a7d7-993f68dfa30d service nova] Creating event network-vif-plugged:5e61afc4-3017-4d25-a36f-c4d31d879b88 for instance fd589087-ba84-4a9d-a54c-72248385994f on nch1-master-1 Jul 23 22:31:21.185701 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-b3ed078d-3859-40ce-9a31-87ecdb8a7b45 req-578a1798-e64b-41b5-a7d7-993f68dfa30d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030266 Jul 23 22:31:21.186346 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4069/6679] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:31:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:31:21.958174 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-89f534da-8d99-468d-b482-522e19eb7c7d tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:31:21.959186 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-89f534da-8d99-468d-b482-522e19eb7c7d tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] [instance: fd589087-ba84-4a9d-a54c-72248385994f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:31:21.970061 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-89f534da-8d99-468d-b482-522e19eb7c7d tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:31:21.970807 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-89f534da-8d99-468d-b482-522e19eb7c7d tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:31:21.972113 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-89f534da-8d99-468d-b482-522e19eb7c7d tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:31:21.972907 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-89f534da-8d99-468d-b482-522e19eb7c7d tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:31:22.111971 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-89f534da-8d99-468d-b482-522e19eb7c7d tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94052639b2b5416aa2cd97854deae6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ab318d1c967420cbac48456436e90c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:31:22.120187 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-89f534da-8d99-468d-b482-522e19eb7c7d tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] 10.222.0.17 "GET /compute/v2.1/servers/fd589087-ba84-4a9d-a54c-72248385994f" status: 200 len: 1373 microversion: 2.1 time: 0.171205 Jul 23 22:31:22.120784 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4070/6680] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:31:21 2022] GET /compute/v2.1/servers/fd589087-ba84-4a9d-a54c-72248385994f => generated 1373 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:31:23.146154 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-769a3301-401c-43d8-8bd7-dca29db72b02 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:31:23.147122 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-769a3301-401c-43d8-8bd7-dca29db72b02 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] [instance: fd589087-ba84-4a9d-a54c-72248385994f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:31:23.158828 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-769a3301-401c-43d8-8bd7-dca29db72b02 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:31:23.159578 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-769a3301-401c-43d8-8bd7-dca29db72b02 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:31:23.160840 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-769a3301-401c-43d8-8bd7-dca29db72b02 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:31:23.161582 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-769a3301-401c-43d8-8bd7-dca29db72b02 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:31:23.301645 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-769a3301-401c-43d8-8bd7-dca29db72b02 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94052639b2b5416aa2cd97854deae6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ab318d1c967420cbac48456436e90c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:31:23.310083 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-769a3301-401c-43d8-8bd7-dca29db72b02 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] 10.222.0.17 "GET /compute/v2.1/servers/fd589087-ba84-4a9d-a54c-72248385994f" status: 200 len: 1557 microversion: 2.1 time: 0.170557 Jul 23 22:31:23.310641 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4071/6681] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:31:23 2022] GET /compute/v2.1/servers/fd589087-ba84-4a9d-a54c-72248385994f => generated 1557 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:31:23.326433 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-eeb383ff-234e-41f7-bcd7-9f0147246669 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:31:23.327075 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-eeb383ff-234e-41f7-bcd7-9f0147246669 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] [instance: fd589087-ba84-4a9d-a54c-72248385994f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:31:23.332994 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-eeb383ff-234e-41f7-bcd7-9f0147246669 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:31:23.333448 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-eeb383ff-234e-41f7-bcd7-9f0147246669 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:31:23.334258 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-eeb383ff-234e-41f7-bcd7-9f0147246669 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:31:23.334697 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-eeb383ff-234e-41f7-bcd7-9f0147246669 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:31:23.479766 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-eeb383ff-234e-41f7-bcd7-9f0147246669 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94052639b2b5416aa2cd97854deae6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ab318d1c967420cbac48456436e90c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:31:23.490466 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-eeb383ff-234e-41f7-bcd7-9f0147246669 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] 10.222.0.17 "GET /compute/v2.1/servers/fd589087-ba84-4a9d-a54c-72248385994f" status: 200 len: 1557 microversion: 2.1 time: 0.167690 Jul 23 22:31:23.491369 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4072/6682] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:31:23 2022] GET /compute/v2.1/servers/fd589087-ba84-4a9d-a54c-72248385994f => generated 1557 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:31:25.234969 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-c9227ff6-8b96-4f2f-bc23-b28256f6594f req-a3709cc5-f1c0-40c1-a523-c8b5d61f1ddc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd589087-ba84-4a9d-a54c-72248385994f", "tag": "5e61afc4-3017-4d25-a36f-c4d31d879b88"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:31:25.238797 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=18 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:31:25.246312 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-c9227ff6-8b96-4f2f-bc23-b28256f6594f req-a3709cc5-f1c0-40c1-a523-c8b5d61f1ddc service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:31:25.246838 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-c9227ff6-8b96-4f2f-bc23-b28256f6594f req-a3709cc5-f1c0-40c1-a523-c8b5d61f1ddc service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:31:25.258703 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-c9227ff6-8b96-4f2f-bc23-b28256f6594f req-a3709cc5-f1c0-40c1-a523-c8b5d61f1ddc service nova] Creating event network-changed:5e61afc4-3017-4d25-a36f-c4d31d879b88 for instance fd589087-ba84-4a9d-a54c-72248385994f on nch1-master-1 Jul 23 22:31:25.263835 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-c9227ff6-8b96-4f2f-bc23-b28256f6594f req-a3709cc5-f1c0-40c1-a523-c8b5d61f1ddc service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032683 Jul 23 22:31:25.264444 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4073/6683] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:31:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 22:33:20.741234 ncdv-master-1 devstack@n-api.service[131320]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f00542ad-3110-4bfe-937f-f2bf8408f43a] AMQP server on 10.222.0.17:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 23 22:33:20.742914 ncdv-master-1 devstack@n-api.service[131320]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7bb808cf-dbe0-4ba5-ad7e-371257d030a5] AMQP server on 10.222.0.17:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 23 22:33:20.749416 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-244d0f86-af15-40a6-9ab6-0d3c17635948 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1210370403"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:33:20.750609 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-244d0f86-af15-40a6-9ab6-0d3c17635948 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] [instance: fd589087-ba84-4a9d-a54c-72248385994f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:33:20.752805 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=4 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:33:20.753669 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=62 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:33:20.760085 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-244d0f86-af15-40a6-9ab6-0d3c17635948 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:33:20.760591 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-244d0f86-af15-40a6-9ab6-0d3c17635948 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:33:20.761374 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-244d0f86-af15-40a6-9ab6-0d3c17635948 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:33:20.761818 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-244d0f86-af15-40a6-9ab6-0d3c17635948 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:33:21.192982 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-244d0f86-af15-40a6-9ab6-0d3c17635948 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] 10.222.0.17 "POST /compute/v2.1/servers/fd589087-ba84-4a9d-a54c-72248385994f/action" status: 202 len: 0 microversion: 2.1 time: 0.455933 Jul 23 22:33:21.193632 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4074/6684] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 22:33:20 2022] POST /compute/v2.1/servers/fd589087-ba84-4a9d-a54c-72248385994f/action => generated 0 bytes in 458 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 23 22:33:25.827664 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-3052572e-8a8e-4dc7-858d-e539409104fb req-652bfc55-aaa5-4c34-affb-b9dbc62a58f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd589087-ba84-4a9d-a54c-72248385994f", "name": "network-vif-plugged", "status": "completed", "tag": "5e61afc4-3017-4d25-a36f-c4d31d879b88"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:33:25.841512 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-3052572e-8a8e-4dc7-858d-e539409104fb req-652bfc55-aaa5-4c34-affb-b9dbc62a58f2 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:33:25.841985 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-3052572e-8a8e-4dc7-858d-e539409104fb req-652bfc55-aaa5-4c34-affb-b9dbc62a58f2 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:33:25.860821 ncdv-master-1 devstack@n-api.service[131320]: INFO oslo.messaging._drivers.impl_rabbit [-] [f00542ad-3110-4bfe-937f-f2bf8408f43a] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 34504. Jul 23 22:33:25.869671 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-3052572e-8a8e-4dc7-858d-e539409104fb req-652bfc55-aaa5-4c34-affb-b9dbc62a58f2 service nova] Creating event network-vif-plugged:5e61afc4-3017-4d25-a36f-c4d31d879b88 for instance fd589087-ba84-4a9d-a54c-72248385994f on nch1-master-1 Jul 23 22:33:25.874971 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-3052572e-8a8e-4dc7-858d-e539409104fb req-652bfc55-aaa5-4c34-affb-b9dbc62a58f2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051301 Jul 23 22:33:25.876273 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4075/6685] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:33:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:33:29.956620 ncdv-master-1 devstack@n-api.service[131320]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 23 22:33:29.957615 ncdv-master-1 devstack@n-api.service[131320]: Sat Jul 23 22:33:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 23 22:33:34.749536 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-abee7b51-8f5b-47bb-aad4-e28d785b3ec4 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-277236274", "imageRef": "fd525a04-74d1-4aef-8470-01a19b74ca79", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-847712247", "security_groups": [{"name": "tempest-secgroup-smoke-114796690"}], "networks": [{"uuid": "02f2117f-a768-4ebc-84bb-81783f9cc04c"}]}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:33:34.770261 ncdv-master-1 devstack@n-api.service[131320]: INFO oslo.messaging._drivers.impl_rabbit [-] [7bb808cf-dbe0-4ba5-ad7e-371257d030a5] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 34506. Jul 23 22:33:34.861240 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.network.neutron [None req-abee7b51-8f5b-47bb-aad4-e28d785b3ec4 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] validate_networks() for [('02f2117f-a768-4ebc-84bb-81783f9cc04c', None, None, None, None, None)] {{(pid=131320) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 23 22:33:35.250788 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-abee7b51-8f5b-47bb-aad4-e28d785b3ec4 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Flavor limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 23 22:33:35.251479 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-abee7b51-8f5b-47bb-aad4-e28d785b3ec4 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Image limits 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 23 22:33:35.252667 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-abee7b51-8f5b-47bb-aad4-e28d785b3ec4 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Flavor pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 23 22:33:35.253598 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-abee7b51-8f5b-47bb-aad4-e28d785b3ec4 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Image pref 0:0:0 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 23 22:33:35.254113 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.virt.hardware [None req-abee7b51-8f5b-47bb-aad4-e28d785b3ec4 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=131320) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 23 22:33:35.266279 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-abee7b51-8f5b-47bb-aad4-e28d785b3ec4 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:33:35.266847 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-abee7b51-8f5b-47bb-aad4-e28d785b3ec4 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:33:35.268050 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-abee7b51-8f5b-47bb-aad4-e28d785b3ec4 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:33:35.268754 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-abee7b51-8f5b-47bb-aad4-e28d785b3ec4 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:33:35.286064 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-abee7b51-8f5b-47bb-aad4-e28d785b3ec4 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Getting quotas for project 4ab318d1c967420cbac48456436e90c5. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 23 22:33:35.291551 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.quota [None req-abee7b51-8f5b-47bb-aad4-e28d785b3ec4 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Getting quotas for user 94052639b2b5416aa2cd97854deae6b2 and project 4ab318d1c967420cbac48456436e90c5. Resources: {'ram', 'instances', 'cores'} {{(pid=131320) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 23 22:33:35.304304 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-abee7b51-8f5b-47bb-aad4-e28d785b3ec4 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Going to run 1 instances... {{(pid=131320) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 23 22:33:35.306828 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-abee7b51-8f5b-47bb-aad4-e28d785b3ec4 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] [instance: f67d2034-98cc-49cb-b4cb-4be80b418e94] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fd525a04-74d1-4aef-8470-01a19b74ca79',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=131320) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 23 22:33:35.353664 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-abee7b51-8f5b-47bb-aad4-e28d785b3ec4 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.608493 Jul 23 22:33:35.354387 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4076/6686] 10.222.0.17 () {60 vars in 1146 bytes} [Sat Jul 23 22:33:34 2022] POST /compute/v2.1/servers => generated 405 bytes in 610 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 23 22:33:35.364219 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9b6b7b40-f1b5-4a0e-bd15-3c0fabce58cc tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:33:35.364812 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-9b6b7b40-f1b5-4a0e-bd15-3c0fabce58cc tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] [instance: f67d2034-98cc-49cb-b4cb-4be80b418e94] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:33:35.420372 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-9b6b7b40-f1b5-4a0e-bd15-3c0fabce58cc tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94052639b2b5416aa2cd97854deae6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ab318d1c967420cbac48456436e90c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:33:35.427342 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9b6b7b40-f1b5-4a0e-bd15-3c0fabce58cc tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] 10.222.0.17 "GET /compute/v2.1/servers/f67d2034-98cc-49cb-b4cb-4be80b418e94" status: 200 len: 1247 microversion: 2.1 time: 0.066906 Jul 23 22:33:35.427889 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4077/6687] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:33:35 2022] GET /compute/v2.1/servers/f67d2034-98cc-49cb-b4cb-4be80b418e94 => generated 1247 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:33:36.444137 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-d93249dc-95cb-424d-8518-ab68399debb3 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:33:36.445181 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-d93249dc-95cb-424d-8518-ab68399debb3 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] [instance: f67d2034-98cc-49cb-b4cb-4be80b418e94] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:33:36.453824 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d93249dc-95cb-424d-8518-ab68399debb3 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:33:36.454845 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d93249dc-95cb-424d-8518-ab68399debb3 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:33:36.456896 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d93249dc-95cb-424d-8518-ab68399debb3 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:33:36.457402 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-d93249dc-95cb-424d-8518-ab68399debb3 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:33:36.528353 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-d93249dc-95cb-424d-8518-ab68399debb3 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94052639b2b5416aa2cd97854deae6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ab318d1c967420cbac48456436e90c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:33:36.536158 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-d93249dc-95cb-424d-8518-ab68399debb3 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] 10.222.0.17 "GET /compute/v2.1/servers/f67d2034-98cc-49cb-b4cb-4be80b418e94" status: 200 len: 1317 microversion: 2.1 time: 0.096576 Jul 23 22:33:36.536721 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4078/6688] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:33:36 2022] GET /compute/v2.1/servers/f67d2034-98cc-49cb-b4cb-4be80b418e94 => generated 1317 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:33:37.553266 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-91e427d1-922e-46d4-b2e0-06b91896112e tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:33:37.553990 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-91e427d1-922e-46d4-b2e0-06b91896112e tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] [instance: f67d2034-98cc-49cb-b4cb-4be80b418e94] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:33:37.561583 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-91e427d1-922e-46d4-b2e0-06b91896112e tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:33:37.562294 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-91e427d1-922e-46d4-b2e0-06b91896112e tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:33:37.563301 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-91e427d1-922e-46d4-b2e0-06b91896112e tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:33:37.563793 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-91e427d1-922e-46d4-b2e0-06b91896112e tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:33:37.713732 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-91e427d1-922e-46d4-b2e0-06b91896112e tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94052639b2b5416aa2cd97854deae6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ab318d1c967420cbac48456436e90c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:33:37.721587 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-91e427d1-922e-46d4-b2e0-06b91896112e tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] 10.222.0.17 "GET /compute/v2.1/servers/f67d2034-98cc-49cb-b4cb-4be80b418e94" status: 200 len: 1372 microversion: 2.1 time: 0.172378 Jul 23 22:33:37.722220 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4079/6689] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:33:37 2022] GET /compute/v2.1/servers/f67d2034-98cc-49cb-b4cb-4be80b418e94 => generated 1372 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:33:37.846623 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-bb06b303-e347-4808-a2d7-e7a345094429 req-a2793114-f461-4966-8756-1e803386f6b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd589087-ba84-4a9d-a54c-72248385994f", "name": "network-vif-unplugged", "status": "completed", "tag": "5e61afc4-3017-4d25-a36f-c4d31d879b88"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:33:37.856991 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-bb06b303-e347-4808-a2d7-e7a345094429 req-a2793114-f461-4966-8756-1e803386f6b0 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:33:37.857698 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-bb06b303-e347-4808-a2d7-e7a345094429 req-a2793114-f461-4966-8756-1e803386f6b0 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:33:37.870838 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-bb06b303-e347-4808-a2d7-e7a345094429 req-a2793114-f461-4966-8756-1e803386f6b0 service nova] Creating event network-vif-unplugged:5e61afc4-3017-4d25-a36f-c4d31d879b88 for instance fd589087-ba84-4a9d-a54c-72248385994f on nch1-master-1 Jul 23 22:33:37.876970 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-bb06b303-e347-4808-a2d7-e7a345094429 req-a2793114-f461-4966-8756-1e803386f6b0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035596 Jul 23 22:33:37.877819 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4080/6690] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:33:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 22:33:38.740828 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-bc0620f0-94c5-4f78-8b54-a560731a8a09 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:33:38.741507 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-bc0620f0-94c5-4f78-8b54-a560731a8a09 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] [instance: f67d2034-98cc-49cb-b4cb-4be80b418e94] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:33:38.749426 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bc0620f0-94c5-4f78-8b54-a560731a8a09 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:33:38.749901 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bc0620f0-94c5-4f78-8b54-a560731a8a09 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:33:38.750723 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bc0620f0-94c5-4f78-8b54-a560731a8a09 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:33:38.751245 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-bc0620f0-94c5-4f78-8b54-a560731a8a09 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:33:38.916724 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-bc0620f0-94c5-4f78-8b54-a560731a8a09 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94052639b2b5416aa2cd97854deae6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ab318d1c967420cbac48456436e90c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:33:38.931564 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-bc0620f0-94c5-4f78-8b54-a560731a8a09 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] 10.222.0.17 "GET /compute/v2.1/servers/f67d2034-98cc-49cb-b4cb-4be80b418e94" status: 200 len: 1372 microversion: 2.1 time: 0.195899 Jul 23 22:33:38.933059 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4081/6691] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:33:38 2022] GET /compute/v2.1/servers/f67d2034-98cc-49cb-b4cb-4be80b418e94 => generated 1372 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:33:39.950415 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-fb932da7-688a-4405-b838-4082e44d2753 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:33:39.951196 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-fb932da7-688a-4405-b838-4082e44d2753 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] [instance: f67d2034-98cc-49cb-b4cb-4be80b418e94] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:33:39.958460 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fb932da7-688a-4405-b838-4082e44d2753 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:33:39.958923 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fb932da7-688a-4405-b838-4082e44d2753 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:33:39.959744 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fb932da7-688a-4405-b838-4082e44d2753 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:33:39.960186 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-fb932da7-688a-4405-b838-4082e44d2753 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:33:40.104432 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-fb932da7-688a-4405-b838-4082e44d2753 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94052639b2b5416aa2cd97854deae6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ab318d1c967420cbac48456436e90c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:33:40.112772 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-fb932da7-688a-4405-b838-4082e44d2753 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] 10.222.0.17 "GET /compute/v2.1/servers/f67d2034-98cc-49cb-b4cb-4be80b418e94" status: 200 len: 1372 microversion: 2.1 time: 0.167876 Jul 23 22:33:40.122634 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4082/6692] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:33:39 2022] GET /compute/v2.1/servers/f67d2034-98cc-49cb-b4cb-4be80b418e94 => generated 1372 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:33:41.130484 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-756b681c-2c83-4385-be3d-78e58251439d tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:33:41.131228 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-756b681c-2c83-4385-be3d-78e58251439d tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] [instance: f67d2034-98cc-49cb-b4cb-4be80b418e94] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:33:41.138198 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-756b681c-2c83-4385-be3d-78e58251439d tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:33:41.138650 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-756b681c-2c83-4385-be3d-78e58251439d tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:33:41.139433 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-756b681c-2c83-4385-be3d-78e58251439d tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:33:41.139861 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-756b681c-2c83-4385-be3d-78e58251439d tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:33:41.284656 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-756b681c-2c83-4385-be3d-78e58251439d tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94052639b2b5416aa2cd97854deae6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ab318d1c967420cbac48456436e90c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:33:41.295926 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-756b681c-2c83-4385-be3d-78e58251439d tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] 10.222.0.17 "GET /compute/v2.1/servers/f67d2034-98cc-49cb-b4cb-4be80b418e94" status: 200 len: 1372 microversion: 2.1 time: 0.169923 Jul 23 22:33:41.296530 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4083/6693] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:33:41 2022] GET /compute/v2.1/servers/f67d2034-98cc-49cb-b4cb-4be80b418e94 => generated 1372 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:33:42.314371 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-8f1c5649-9d90-4faf-804f-ae2957b7d4fd tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:33:42.315099 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-8f1c5649-9d90-4faf-804f-ae2957b7d4fd tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] [instance: f67d2034-98cc-49cb-b4cb-4be80b418e94] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:33:42.322906 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8f1c5649-9d90-4faf-804f-ae2957b7d4fd tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:33:42.323537 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8f1c5649-9d90-4faf-804f-ae2957b7d4fd tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:33:42.324334 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8f1c5649-9d90-4faf-804f-ae2957b7d4fd tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:33:42.324775 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-8f1c5649-9d90-4faf-804f-ae2957b7d4fd tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:33:42.498580 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-8f1c5649-9d90-4faf-804f-ae2957b7d4fd tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94052639b2b5416aa2cd97854deae6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ab318d1c967420cbac48456436e90c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:33:42.507353 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-8f1c5649-9d90-4faf-804f-ae2957b7d4fd tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] 10.222.0.17 "GET /compute/v2.1/servers/f67d2034-98cc-49cb-b4cb-4be80b418e94" status: 200 len: 1372 microversion: 2.1 time: 0.198444 Jul 23 22:33:42.507956 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4084/6694] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:33:42 2022] GET /compute/v2.1/servers/f67d2034-98cc-49cb-b4cb-4be80b418e94 => generated 1372 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:33:43.528133 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-5cdaa19e-f95c-4a2d-a9f2-77853aca734a tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:33:43.530475 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-5cdaa19e-f95c-4a2d-a9f2-77853aca734a tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] [instance: f67d2034-98cc-49cb-b4cb-4be80b418e94] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:33:43.539439 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5cdaa19e-f95c-4a2d-a9f2-77853aca734a tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:33:43.540327 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5cdaa19e-f95c-4a2d-a9f2-77853aca734a tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:33:43.541231 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5cdaa19e-f95c-4a2d-a9f2-77853aca734a tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:33:43.541765 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-5cdaa19e-f95c-4a2d-a9f2-77853aca734a tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:33:43.685076 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-5cdaa19e-f95c-4a2d-a9f2-77853aca734a tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94052639b2b5416aa2cd97854deae6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ab318d1c967420cbac48456436e90c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:33:43.692947 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-5cdaa19e-f95c-4a2d-a9f2-77853aca734a tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] 10.222.0.17 "GET /compute/v2.1/servers/f67d2034-98cc-49cb-b4cb-4be80b418e94" status: 200 len: 1372 microversion: 2.1 time: 0.172218 Jul 23 22:33:43.697929 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4085/6695] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:33:43 2022] GET /compute/v2.1/servers/f67d2034-98cc-49cb-b4cb-4be80b418e94 => generated 1372 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:33:44.711058 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-735bdc83-28d1-4c1f-857d-b73603db2c54 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:33:44.711894 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-735bdc83-28d1-4c1f-857d-b73603db2c54 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] [instance: f67d2034-98cc-49cb-b4cb-4be80b418e94] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:33:44.719040 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-735bdc83-28d1-4c1f-857d-b73603db2c54 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:33:44.719495 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-735bdc83-28d1-4c1f-857d-b73603db2c54 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:33:44.720283 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-735bdc83-28d1-4c1f-857d-b73603db2c54 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:33:44.720719 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-735bdc83-28d1-4c1f-857d-b73603db2c54 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:33:44.860637 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-735bdc83-28d1-4c1f-857d-b73603db2c54 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94052639b2b5416aa2cd97854deae6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ab318d1c967420cbac48456436e90c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:33:44.869683 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-735bdc83-28d1-4c1f-857d-b73603db2c54 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] 10.222.0.17 "GET /compute/v2.1/servers/f67d2034-98cc-49cb-b4cb-4be80b418e94" status: 200 len: 1372 microversion: 2.1 time: 0.162486 Jul 23 22:33:44.870361 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4086/6696] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:33:44 2022] GET /compute/v2.1/servers/f67d2034-98cc-49cb-b4cb-4be80b418e94 => generated 1372 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:33:45.043820 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-5440ac1b-60f4-4287-9b90-7d1cfd441c1a req-62a80152-87f1-4a8a-9dfb-f43e87866900 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f67d2034-98cc-49cb-b4cb-4be80b418e94", "tag": "49842218-201a-49c1-a08e-ab3c150674b1"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:33:45.057492 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-5440ac1b-60f4-4287-9b90-7d1cfd441c1a req-62a80152-87f1-4a8a-9dfb-f43e87866900 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:33:45.066714 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-5440ac1b-60f4-4287-9b90-7d1cfd441c1a req-62a80152-87f1-4a8a-9dfb-f43e87866900 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:33:45.079517 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-5440ac1b-60f4-4287-9b90-7d1cfd441c1a req-62a80152-87f1-4a8a-9dfb-f43e87866900 service nova] Creating event network-changed:49842218-201a-49c1-a08e-ab3c150674b1 for instance f67d2034-98cc-49cb-b4cb-4be80b418e94 on nch2-master-1 Jul 23 22:33:45.084725 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-5440ac1b-60f4-4287-9b90-7d1cfd441c1a req-62a80152-87f1-4a8a-9dfb-f43e87866900 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045773 Jul 23 22:33:45.085851 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4087/6697] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:33:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 22:33:45.885808 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=2 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:33:45.886802 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell0:SELECT=8 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:33:45.892050 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c6cc251a-8db2-417b-9916-b579e2fe17bd tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:33:45.892772 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c6cc251a-8db2-417b-9916-b579e2fe17bd tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] [instance: f67d2034-98cc-49cb-b4cb-4be80b418e94] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:33:45.900029 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c6cc251a-8db2-417b-9916-b579e2fe17bd tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:33:45.900496 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c6cc251a-8db2-417b-9916-b579e2fe17bd tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:33:45.901296 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c6cc251a-8db2-417b-9916-b579e2fe17bd tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:33:45.901797 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c6cc251a-8db2-417b-9916-b579e2fe17bd tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:33:46.045657 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c6cc251a-8db2-417b-9916-b579e2fe17bd tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94052639b2b5416aa2cd97854deae6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ab318d1c967420cbac48456436e90c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:33:46.053738 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c6cc251a-8db2-417b-9916-b579e2fe17bd tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] 10.222.0.17 "GET /compute/v2.1/servers/f67d2034-98cc-49cb-b4cb-4be80b418e94" status: 200 len: 1372 microversion: 2.1 time: 0.169164 Jul 23 22:33:46.054372 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4088/6698] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:33:45 2022] GET /compute/v2.1/servers/f67d2034-98cc-49cb-b4cb-4be80b418e94 => generated 1372 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:33:47.076705 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-7b667bae-41fa-4ed6-9473-35b94cd58e97 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:33:47.077352 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-7b667bae-41fa-4ed6-9473-35b94cd58e97 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] [instance: f67d2034-98cc-49cb-b4cb-4be80b418e94] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:33:47.084799 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7b667bae-41fa-4ed6-9473-35b94cd58e97 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:33:47.085266 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7b667bae-41fa-4ed6-9473-35b94cd58e97 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:33:47.086093 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7b667bae-41fa-4ed6-9473-35b94cd58e97 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:33:47.086567 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-7b667bae-41fa-4ed6-9473-35b94cd58e97 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:33:47.229293 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-7b667bae-41fa-4ed6-9473-35b94cd58e97 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94052639b2b5416aa2cd97854deae6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ab318d1c967420cbac48456436e90c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:33:47.240882 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-7b667bae-41fa-4ed6-9473-35b94cd58e97 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] 10.222.0.17 "GET /compute/v2.1/servers/f67d2034-98cc-49cb-b4cb-4be80b418e94" status: 200 len: 1372 microversion: 2.1 time: 0.168320 Jul 23 22:33:47.241630 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4089/6699] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:33:47 2022] GET /compute/v2.1/servers/f67d2034-98cc-49cb-b4cb-4be80b418e94 => generated 1372 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:33:48.261248 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-00feef6b-4f77-4406-bb0c-deacd7382cc2 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:33:48.262109 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-00feef6b-4f77-4406-bb0c-deacd7382cc2 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] [instance: f67d2034-98cc-49cb-b4cb-4be80b418e94] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:33:48.271038 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-00feef6b-4f77-4406-bb0c-deacd7382cc2 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:33:48.271602 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-00feef6b-4f77-4406-bb0c-deacd7382cc2 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:33:48.272556 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-00feef6b-4f77-4406-bb0c-deacd7382cc2 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:33:48.273104 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-00feef6b-4f77-4406-bb0c-deacd7382cc2 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:33:48.422081 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-00feef6b-4f77-4406-bb0c-deacd7382cc2 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94052639b2b5416aa2cd97854deae6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ab318d1c967420cbac48456436e90c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:33:48.432212 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-00feef6b-4f77-4406-bb0c-deacd7382cc2 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] 10.222.0.17 "GET /compute/v2.1/servers/f67d2034-98cc-49cb-b4cb-4be80b418e94" status: 200 len: 1372 microversion: 2.1 time: 0.176234 Jul 23 22:33:48.432860 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4090/6700] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:33:48 2022] GET /compute/v2.1/servers/f67d2034-98cc-49cb-b4cb-4be80b418e94 => generated 1372 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:33:49.453273 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9559ea77-4beb-4bea-98b7-094bbc2b9006 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:33:49.454065 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-9559ea77-4beb-4bea-98b7-094bbc2b9006 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] [instance: f67d2034-98cc-49cb-b4cb-4be80b418e94] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:33:49.461006 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9559ea77-4beb-4bea-98b7-094bbc2b9006 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:33:49.461377 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9559ea77-4beb-4bea-98b7-094bbc2b9006 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:33:49.462202 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9559ea77-4beb-4bea-98b7-094bbc2b9006 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:33:49.462751 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9559ea77-4beb-4bea-98b7-094bbc2b9006 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:33:49.614855 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-9559ea77-4beb-4bea-98b7-094bbc2b9006 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94052639b2b5416aa2cd97854deae6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ab318d1c967420cbac48456436e90c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:33:49.625362 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9559ea77-4beb-4bea-98b7-094bbc2b9006 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] 10.222.0.17 "GET /compute/v2.1/servers/f67d2034-98cc-49cb-b4cb-4be80b418e94" status: 200 len: 1372 microversion: 2.1 time: 0.175852 Jul 23 22:33:49.626168 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4091/6701] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:33:49 2022] GET /compute/v2.1/servers/f67d2034-98cc-49cb-b4cb-4be80b418e94 => generated 1372 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:33:50.649671 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6c414159-2e22-47c4-a186-a88b52a9b4a1 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:33:50.650623 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6c414159-2e22-47c4-a186-a88b52a9b4a1 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] [instance: f67d2034-98cc-49cb-b4cb-4be80b418e94] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:33:50.658079 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6c414159-2e22-47c4-a186-a88b52a9b4a1 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:33:50.658530 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6c414159-2e22-47c4-a186-a88b52a9b4a1 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:33:50.659304 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6c414159-2e22-47c4-a186-a88b52a9b4a1 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:33:50.659734 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6c414159-2e22-47c4-a186-a88b52a9b4a1 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:33:50.802784 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-6c414159-2e22-47c4-a186-a88b52a9b4a1 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94052639b2b5416aa2cd97854deae6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ab318d1c967420cbac48456436e90c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:33:50.805062 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:33:50.812122 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6c414159-2e22-47c4-a186-a88b52a9b4a1 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] 10.222.0.17 "GET /compute/v2.1/servers/f67d2034-98cc-49cb-b4cb-4be80b418e94" status: 200 len: 1372 microversion: 2.1 time: 0.168987 Jul 23 22:33:50.812752 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4092/6702] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:33:50 2022] GET /compute/v2.1/servers/f67d2034-98cc-49cb-b4cb-4be80b418e94 => generated 1372 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:33:51.386665 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-ec1db419-98f4-429f-957f-8320c42c7470 req-fe46909c-0b36-4df0-8623-701b3578c74b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f67d2034-98cc-49cb-b4cb-4be80b418e94", "name": "network-vif-plugged", "status": "completed", "tag": "49842218-201a-49c1-a08e-ab3c150674b1"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:33:51.391357 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:33:51.396638 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-ec1db419-98f4-429f-957f-8320c42c7470 req-fe46909c-0b36-4df0-8623-701b3578c74b service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:33:51.397264 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-ec1db419-98f4-429f-957f-8320c42c7470 req-fe46909c-0b36-4df0-8623-701b3578c74b service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:33:51.410097 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-ec1db419-98f4-429f-957f-8320c42c7470 req-fe46909c-0b36-4df0-8623-701b3578c74b service nova] Creating event network-vif-plugged:49842218-201a-49c1-a08e-ab3c150674b1 for instance f67d2034-98cc-49cb-b4cb-4be80b418e94 on nch2-master-1 Jul 23 22:33:51.415121 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-ec1db419-98f4-429f-957f-8320c42c7470 req-fe46909c-0b36-4df0-8623-701b3578c74b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033059 Jul 23 22:33:51.415723 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4093/6703] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:33:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 22:33:51.830712 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-66749d82-6121-4e33-9561-6f3546913c8c tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:33:51.831509 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-66749d82-6121-4e33-9561-6f3546913c8c tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] [instance: f67d2034-98cc-49cb-b4cb-4be80b418e94] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:33:51.838541 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-66749d82-6121-4e33-9561-6f3546913c8c tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:33:51.838997 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-66749d82-6121-4e33-9561-6f3546913c8c tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:33:51.839772 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-66749d82-6121-4e33-9561-6f3546913c8c tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:33:51.840220 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-66749d82-6121-4e33-9561-6f3546913c8c tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:33:51.974226 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-66749d82-6121-4e33-9561-6f3546913c8c tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94052639b2b5416aa2cd97854deae6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ab318d1c967420cbac48456436e90c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:33:51.982008 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-66749d82-6121-4e33-9561-6f3546913c8c tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] 10.222.0.17 "GET /compute/v2.1/servers/f67d2034-98cc-49cb-b4cb-4be80b418e94" status: 200 len: 1372 microversion: 2.1 time: 0.156523 Jul 23 22:33:51.982589 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4094/6704] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:33:51 2022] GET /compute/v2.1/servers/f67d2034-98cc-49cb-b4cb-4be80b418e94 => generated 1372 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:33:53.002229 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f101b409-3770-4177-ae3f-3443afda775c tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:33:53.002945 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f101b409-3770-4177-ae3f-3443afda775c tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] [instance: f67d2034-98cc-49cb-b4cb-4be80b418e94] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:33:53.010219 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f101b409-3770-4177-ae3f-3443afda775c tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:33:53.010679 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f101b409-3770-4177-ae3f-3443afda775c tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:33:53.011455 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f101b409-3770-4177-ae3f-3443afda775c tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:33:53.011902 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f101b409-3770-4177-ae3f-3443afda775c tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:33:53.148249 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-f101b409-3770-4177-ae3f-3443afda775c tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94052639b2b5416aa2cd97854deae6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ab318d1c967420cbac48456436e90c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:33:53.156438 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f101b409-3770-4177-ae3f-3443afda775c tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] 10.222.0.17 "GET /compute/v2.1/servers/f67d2034-98cc-49cb-b4cb-4be80b418e94" status: 200 len: 1556 microversion: 2.1 time: 0.159237 Jul 23 22:33:53.157041 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4095/6705] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:33:52 2022] GET /compute/v2.1/servers/f67d2034-98cc-49cb-b4cb-4be80b418e94 => generated 1556 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:33:53.172735 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-9a047700-1f83-40c4-8ab5-6492bf138d9e tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:33:53.173281 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-9a047700-1f83-40c4-8ab5-6492bf138d9e tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] [instance: f67d2034-98cc-49cb-b4cb-4be80b418e94] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:33:53.179236 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9a047700-1f83-40c4-8ab5-6492bf138d9e tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:33:53.179697 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9a047700-1f83-40c4-8ab5-6492bf138d9e tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:33:53.180474 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9a047700-1f83-40c4-8ab5-6492bf138d9e tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:33:53.180925 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-9a047700-1f83-40c4-8ab5-6492bf138d9e tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:33:53.318676 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-9a047700-1f83-40c4-8ab5-6492bf138d9e tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94052639b2b5416aa2cd97854deae6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ab318d1c967420cbac48456436e90c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:33:53.326827 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-9a047700-1f83-40c4-8ab5-6492bf138d9e tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] 10.222.0.17 "GET /compute/v2.1/servers/f67d2034-98cc-49cb-b4cb-4be80b418e94" status: 200 len: 1556 microversion: 2.1 time: 0.157786 Jul 23 22:33:53.327413 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4096/6706] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:33:53 2022] GET /compute/v2.1/servers/f67d2034-98cc-49cb-b4cb-4be80b418e94 => generated 1556 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:33:55.346013 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-02138aaa-f728-4184-94a0-c588d6b456a5 req-3198c010-1f45-40b4-abba-034ee0537467 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f67d2034-98cc-49cb-b4cb-4be80b418e94", "tag": "49842218-201a-49c1-a08e-ab3c150674b1"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:33:55.355243 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-02138aaa-f728-4184-94a0-c588d6b456a5 req-3198c010-1f45-40b4-abba-034ee0537467 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:33:55.355722 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-02138aaa-f728-4184-94a0-c588d6b456a5 req-3198c010-1f45-40b4-abba-034ee0537467 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:33:55.367374 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-02138aaa-f728-4184-94a0-c588d6b456a5 req-3198c010-1f45-40b4-abba-034ee0537467 service nova] Creating event network-changed:49842218-201a-49c1-a08e-ab3c150674b1 for instance f67d2034-98cc-49cb-b4cb-4be80b418e94 on nch2-master-1 Jul 23 22:33:55.372500 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-02138aaa-f728-4184-94a0-c588d6b456a5 req-3198c010-1f45-40b4-abba-034ee0537467 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030403 Jul 23 22:33:55.373420 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4097/6707] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:33:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:35:22.792885 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_api:SELECT=9 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:35:22.794508 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=23 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:35:22.802233 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-ee127eed-3e5c-44c7-9195-55ff7859b510 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1633403829"}} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:35:22.804145 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-ee127eed-3e5c-44c7-9195-55ff7859b510 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] [instance: f67d2034-98cc-49cb-b4cb-4be80b418e94] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:35:22.811289 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ee127eed-3e5c-44c7-9195-55ff7859b510 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:35:22.811737 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ee127eed-3e5c-44c7-9195-55ff7859b510 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:35:22.812515 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ee127eed-3e5c-44c7-9195-55ff7859b510 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:35:22.812952 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-ee127eed-3e5c-44c7-9195-55ff7859b510 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:35:23.103656 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-ee127eed-3e5c-44c7-9195-55ff7859b510 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] 10.222.0.17 "POST /compute/v2.1/servers/f67d2034-98cc-49cb-b4cb-4be80b418e94/action" status: 202 len: 0 microversion: 2.1 time: 0.315477 Jul 23 22:35:23.104316 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4098/6708] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Jul 23 22:35:22 2022] POST /compute/v2.1/servers/f67d2034-98cc-49cb-b4cb-4be80b418e94/action => generated 0 bytes in 318 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 23 22:35:28.164395 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-eee72634-f533-4f8c-a1eb-9eb40b0d150e req-9e77bcf5-6fca-4d04-ae53-24c1bce37134 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f67d2034-98cc-49cb-b4cb-4be80b418e94", "name": "network-vif-plugged", "status": "completed", "tag": "49842218-201a-49c1-a08e-ab3c150674b1"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:35:28.175729 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-eee72634-f533-4f8c-a1eb-9eb40b0d150e req-9e77bcf5-6fca-4d04-ae53-24c1bce37134 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:35:28.176477 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-eee72634-f533-4f8c-a1eb-9eb40b0d150e req-9e77bcf5-6fca-4d04-ae53-24c1bce37134 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:35:28.191969 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-eee72634-f533-4f8c-a1eb-9eb40b0d150e req-9e77bcf5-6fca-4d04-ae53-24c1bce37134 service nova] Creating event network-vif-plugged:49842218-201a-49c1-a08e-ab3c150674b1 for instance f67d2034-98cc-49cb-b4cb-4be80b418e94 on nch2-master-1 Jul 23 22:35:28.197509 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-eee72634-f533-4f8c-a1eb-9eb40b0d150e req-9e77bcf5-6fca-4d04-ae53-24c1bce37134 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100248 Jul 23 22:35:28.200397 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4099/6709] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:35:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:35:36.816501 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-de7fef67-f903-4910-9210-8d2537d2c92a tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:35:36.817164 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-de7fef67-f903-4910-9210-8d2537d2c92a tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] [instance: f67d2034-98cc-49cb-b4cb-4be80b418e94] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:35:36.824170 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-de7fef67-f903-4910-9210-8d2537d2c92a tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:35:36.824634 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-de7fef67-f903-4910-9210-8d2537d2c92a tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:35:36.825398 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-de7fef67-f903-4910-9210-8d2537d2c92a tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:35:36.825827 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-de7fef67-f903-4910-9210-8d2537d2c92a tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:35:36.851807 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-de7fef67-f903-4910-9210-8d2537d2c92a tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] [instance: f67d2034-98cc-49cb-b4cb-4be80b418e94] Going to try to terminate instance {{(pid=131320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 22:35:36.932935 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-de7fef67-f903-4910-9210-8d2537d2c92a tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] 10.222.0.17 "DELETE /compute/v2.1/servers/f67d2034-98cc-49cb-b4cb-4be80b418e94" status: 204 len: 0 microversion: 2.1 time: 0.121668 Jul 23 22:35:36.933586 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4100/6710] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 22:35:36 2022] DELETE /compute/v2.1/servers/f67d2034-98cc-49cb-b4cb-4be80b418e94 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 22:35:36.938862 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-23417e62-2d89-44c4-940d-f742fa7b73cd req-c866f482-83cd-48ab-bf56-69fbcbd87aa9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f67d2034-98cc-49cb-b4cb-4be80b418e94", "tag": "49842218-201a-49c1-a08e-ab3c150674b1"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:35:36.947614 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-23417e62-2d89-44c4-940d-f742fa7b73cd req-c866f482-83cd-48ab-bf56-69fbcbd87aa9 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:35:36.948068 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-23417e62-2d89-44c4-940d-f742fa7b73cd req-c866f482-83cd-48ab-bf56-69fbcbd87aa9 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:35:36.959466 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-23417e62-2d89-44c4-940d-f742fa7b73cd req-c866f482-83cd-48ab-bf56-69fbcbd87aa9 service nova] Creating event network-changed:49842218-201a-49c1-a08e-ab3c150674b1 for instance f67d2034-98cc-49cb-b4cb-4be80b418e94 on nch2-master-1 Jul 23 22:35:36.964401 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-23417e62-2d89-44c4-940d-f742fa7b73cd req-c866f482-83cd-48ab-bf56-69fbcbd87aa9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029485 Jul 23 22:35:36.965236 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4101/6711] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:35:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:35:36.970195 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-c5360578-873b-48a5-9c29-24f3bac90c95 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:35:36.970917 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-c5360578-873b-48a5-9c29-24f3bac90c95 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] [instance: f67d2034-98cc-49cb-b4cb-4be80b418e94] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:35:36.977145 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c5360578-873b-48a5-9c29-24f3bac90c95 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:35:36.977650 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c5360578-873b-48a5-9c29-24f3bac90c95 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:35:36.978441 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c5360578-873b-48a5-9c29-24f3bac90c95 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:35:36.978887 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-c5360578-873b-48a5-9c29-24f3bac90c95 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:35:37.119821 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-c5360578-873b-48a5-9c29-24f3bac90c95 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94052639b2b5416aa2cd97854deae6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ab318d1c967420cbac48456436e90c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:35:37.127657 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-c5360578-873b-48a5-9c29-24f3bac90c95 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] 10.222.0.17 "GET /compute/v2.1/servers/f67d2034-98cc-49cb-b4cb-4be80b418e94" status: 200 len: 1680 microversion: 2.1 time: 0.161518 Jul 23 22:35:37.128280 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4102/6712] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:35:36 2022] GET /compute/v2.1/servers/f67d2034-98cc-49cb-b4cb-4be80b418e94 => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:35:38.115071 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-106ef853-6daf-4b0a-ae49-e16459ea158c req-d6e4ac93-e3d5-449a-a7f5-af8ef3677243 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f67d2034-98cc-49cb-b4cb-4be80b418e94", "name": "network-vif-unplugged", "status": "completed", "tag": "49842218-201a-49c1-a08e-ab3c150674b1"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:35:38.124274 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-106ef853-6daf-4b0a-ae49-e16459ea158c req-d6e4ac93-e3d5-449a-a7f5-af8ef3677243 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:35:38.124844 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-106ef853-6daf-4b0a-ae49-e16459ea158c req-d6e4ac93-e3d5-449a-a7f5-af8ef3677243 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:35:38.136903 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-106ef853-6daf-4b0a-ae49-e16459ea158c req-d6e4ac93-e3d5-449a-a7f5-af8ef3677243 service nova] Creating event network-vif-unplugged:49842218-201a-49c1-a08e-ab3c150674b1 for instance f67d2034-98cc-49cb-b4cb-4be80b418e94 on nch2-master-1 Jul 23 22:35:38.142509 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-106ef853-6daf-4b0a-ae49-e16459ea158c req-d6e4ac93-e3d5-449a-a7f5-af8ef3677243 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031378 Jul 23 22:35:38.143402 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4103/6713] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:35:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:35:38.148318 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-81a9074c-309d-454f-88ff-b08a0b53fea8 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:35:38.149068 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-81a9074c-309d-454f-88ff-b08a0b53fea8 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] [instance: f67d2034-98cc-49cb-b4cb-4be80b418e94] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:35:38.155819 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-81a9074c-309d-454f-88ff-b08a0b53fea8 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:35:38.156258 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-81a9074c-309d-454f-88ff-b08a0b53fea8 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:35:38.157033 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-81a9074c-309d-454f-88ff-b08a0b53fea8 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:35:38.157506 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-81a9074c-309d-454f-88ff-b08a0b53fea8 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:35:38.293771 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-81a9074c-309d-454f-88ff-b08a0b53fea8 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94052639b2b5416aa2cd97854deae6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ab318d1c967420cbac48456436e90c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:35:38.301760 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-81a9074c-309d-454f-88ff-b08a0b53fea8 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] 10.222.0.17 "GET /compute/v2.1/servers/f67d2034-98cc-49cb-b4cb-4be80b418e94" status: 200 len: 1680 microversion: 2.1 time: 0.157325 Jul 23 22:35:38.302646 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4104/6714] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:35:38 2022] GET /compute/v2.1/servers/f67d2034-98cc-49cb-b4cb-4be80b418e94 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:35:38.979405 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-3b7e287c-d1da-45a8-9ace-ca313eda650e req-e679566e-227c-45be-acd1-3c9d3c690f38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f67d2034-98cc-49cb-b4cb-4be80b418e94", "name": "network-vif-deleted", "tag": "49842218-201a-49c1-a08e-ab3c150674b1"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:35:38.987841 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-3b7e287c-d1da-45a8-9ace-ca313eda650e req-e679566e-227c-45be-acd1-3c9d3c690f38 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:35:38.988574 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-3b7e287c-d1da-45a8-9ace-ca313eda650e req-e679566e-227c-45be-acd1-3c9d3c690f38 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:35:38.999691 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-3b7e287c-d1da-45a8-9ace-ca313eda650e req-e679566e-227c-45be-acd1-3c9d3c690f38 service nova] Creating event network-vif-deleted:49842218-201a-49c1-a08e-ab3c150674b1 for instance f67d2034-98cc-49cb-b4cb-4be80b418e94 on nch2-master-1 Jul 23 22:35:39.005093 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-3b7e287c-d1da-45a8-9ace-ca313eda650e req-e679566e-227c-45be-acd1-3c9d3c690f38 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029604 Jul 23 22:35:39.005996 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4105/6715] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:35:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 23 22:35:39.322095 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-058073aa-78fd-455a-8102-73008d3186fc tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:35:39.323534 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-058073aa-78fd-455a-8102-73008d3186fc tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] [instance: f67d2034-98cc-49cb-b4cb-4be80b418e94] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:35:39.331677 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-058073aa-78fd-455a-8102-73008d3186fc tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:35:39.332306 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-058073aa-78fd-455a-8102-73008d3186fc tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:35:39.333275 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-058073aa-78fd-455a-8102-73008d3186fc tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:35:39.333697 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-058073aa-78fd-455a-8102-73008d3186fc tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:35:39.367538 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-058073aa-78fd-455a-8102-73008d3186fc tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:35:39.368204 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-058073aa-78fd-455a-8102-73008d3186fc tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:35:39.368593 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.objects.instance [None req-058073aa-78fd-455a-8102-73008d3186fc tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lazy-loading 'fault' on Instance uuid f67d2034-98cc-49cb-b4cb-4be80b418e94 {{(pid=131320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 22:35:39.411209 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-058073aa-78fd-455a-8102-73008d3186fc tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94052639b2b5416aa2cd97854deae6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ab318d1c967420cbac48456436e90c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:35:39.418102 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-058073aa-78fd-455a-8102-73008d3186fc tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] 10.222.0.17 "GET /compute/v2.1/servers/f67d2034-98cc-49cb-b4cb-4be80b418e94" status: 200 len: 1337 microversion: 2.1 time: 0.101736 Jul 23 22:35:39.418733 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4106/6716] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:35:39 2022] GET /compute/v2.1/servers/f67d2034-98cc-49cb-b4cb-4be80b418e94 => generated 1337 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 23 22:35:40.439688 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4e00dda3-3ff2-47c9-aa17-28bccc8baaab tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:35:40.440785 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-4e00dda3-3ff2-47c9-aa17-28bccc8baaab tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] [instance: f67d2034-98cc-49cb-b4cb-4be80b418e94] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:35:40.450457 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4e00dda3-3ff2-47c9-aa17-28bccc8baaab tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:35:40.450907 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4e00dda3-3ff2-47c9-aa17-28bccc8baaab tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:35:40.451703 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4e00dda3-3ff2-47c9-aa17-28bccc8baaab tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:35:40.452119 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-4e00dda3-3ff2-47c9-aa17-28bccc8baaab tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:35:40.465825 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-4e00dda3-3ff2-47c9-aa17-28bccc8baaab tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] HTTP exception thrown: Instance f67d2034-98cc-49cb-b4cb-4be80b418e94 could not be found. Jul 23 22:35:40.467530 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4e00dda3-3ff2-47c9-aa17-28bccc8baaab tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Request method failure captured: Jul 23 22:35:40.467530 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/f67d2034-98cc-49cb-b4cb-4be80b418e94 HTTP/1.1 Jul 23 22:35:40.467530 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 22:35:40.467530 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 22:35:40.467530 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 22:35:40.467530 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 22:35:40.467530 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 22:35:40.467530 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 22:35:40.467530 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 22:35:40.467530 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 22:35:40.467530 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3HanqZcf9coNggFAVY_ivUe_l9XZC_q-B3wY4H4SZjnumlJTj989wrCULUWxLRdD4v-UQ8c3e-P4Ens7d_rN0LOz2Ifuc4R8cpSMf6nHwOVop5dvavY3i4woI7A7h-dP0exzSAHbZfbD9fUcQBlqf392CqALuW3C_3ZasC6XbDiRrRk Jul 23 22:35:40.467530 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 22:35:40.467530 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 22:35:40.467530 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 22:35:40.467530 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 22:35:40.467530 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 22:35:40.467530 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 22:35:40.467530 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 4ab318d1c967420cbac48456436e90c5 Jul 23 22:35:40.467530 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-TestSnapshotPattern-105336955 Jul 23 22:35:40.467530 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 22:35:40.467530 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 22:35:40.467530 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4ab318d1c967420cbac48456436e90c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4ab318d1c967420cbac48456436e90c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4ab318d1c967420cbac48456436e90c5", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4ab318d1c967420cbac48456436e90c5"}]}] Jul 23 22:35:40.467530 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-TestSnapshotPattern-105336955 Jul 23 22:35:40.467530 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 4ab318d1c967420cbac48456436e90c5 Jul 23 22:35:40.467530 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-TestSnapshotPattern-105336955 Jul 23 22:35:40.467530 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-TestSnapshotPattern-105336955-project Jul 23 22:35:40.467530 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 22:35:40.467530 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 22:35:40.467530 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 94052639b2b5416aa2cd97854deae6b2 Jul 23 22:35:40.467530 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-TestSnapshotPattern-105336955-project Jul 23 22:35:40.467530 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 22:35:40.467530 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance f67d2034-98cc-49cb-b4cb-4be80b418e94 could not be found. Jul 23 22:35:40.467530 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': 'f67d2034-98cc-49cb-b4cb-4be80b418e94'} Jul 23 22:35:40.467530 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 22:35:40.467530 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:35:40.467530 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 22:35:40.467530 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 22:35:40.467530 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 22:35:40.467530 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 22:35:40.467530 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 22:35:40.467530 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 22:35:40.467530 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 22:35:40.467530 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 22:35:40.467530 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f67d2034-98cc-49cb-b4cb-4be80b418e94 could not be found. Jul 23 22:35:40.467530 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:35:40.467530 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:35:40.467530 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:35:40.467530 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:35:40.467530 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:35:40.467530 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:35:40.467530 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 22:35:40.467530 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 22:35:40.467530 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 22:35:40.467530 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 22:35:40.467530 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 22:35:40.467530 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 22:35:40.467530 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 22:35:40.467530 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 22:35:40.467530 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 22:35:40.467530 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 22:35:40.467530 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f67d2034-98cc-49cb-b4cb-4be80b418e94 could not be found. Jul 23 22:35:40.467530 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:35:40.467530 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:35:40.467530 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:35:40.472306 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:35:40.472306 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:35:40.472306 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:35:40.472306 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 22:35:40.472306 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 22:35:40.472306 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f67d2034-98cc-49cb-b4cb-4be80b418e94 could not be found. Jul 23 22:35:40.472306 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:35:40.472306 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-4e00dda3-3ff2-47c9-aa17-28bccc8baaab tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Returning 404 to user: Instance f67d2034-98cc-49cb-b4cb-4be80b418e94 could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 22:35:40.472306 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-4e00dda3-3ff2-47c9-aa17-28bccc8baaab tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] 10.222.0.17 "GET /compute/v2.1/servers/f67d2034-98cc-49cb-b4cb-4be80b418e94" status: 404 len: 111 microversion: 2.1 time: 0.035972 Jul 23 22:35:40.472306 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4107/6717] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:35:40 2022] GET /compute/v2.1/servers/f67d2034-98cc-49cb-b4cb-4be80b418e94 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 22:35:41.896263 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-f4d06682-cb8f-4724-9315-2df331e6aefc tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:35:41.896879 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f4d06682-cb8f-4724-9315-2df331e6aefc tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] [instance: fd589087-ba84-4a9d-a54c-72248385994f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:35:41.904613 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f4d06682-cb8f-4724-9315-2df331e6aefc tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:35:41.905133 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f4d06682-cb8f-4724-9315-2df331e6aefc tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:35:41.906020 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f4d06682-cb8f-4724-9315-2df331e6aefc tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:35:41.906559 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-f4d06682-cb8f-4724-9315-2df331e6aefc tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:35:41.932827 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-f4d06682-cb8f-4724-9315-2df331e6aefc tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] [instance: fd589087-ba84-4a9d-a54c-72248385994f] Going to try to terminate instance {{(pid=131320) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 23 22:35:42.014492 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-f4d06682-cb8f-4724-9315-2df331e6aefc tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] 10.222.0.17 "DELETE /compute/v2.1/servers/fd589087-ba84-4a9d-a54c-72248385994f" status: 204 len: 0 microversion: 2.1 time: 0.122329 Jul 23 22:35:42.015541 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4108/6718] 10.222.0.17 () {58 vars in 1238 bytes} [Sat Jul 23 22:35:41 2022] DELETE /compute/v2.1/servers/fd589087-ba84-4a9d-a54c-72248385994f => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 23 22:35:42.081736 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-89e5de73-8663-4569-855d-71c744a366a5 req-c37f5d2f-3d3d-4d16-9de5-0cd7febf215a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd589087-ba84-4a9d-a54c-72248385994f", "tag": "5e61afc4-3017-4d25-a36f-c4d31d879b88"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:35:42.090839 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-89e5de73-8663-4569-855d-71c744a366a5 req-c37f5d2f-3d3d-4d16-9de5-0cd7febf215a service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:35:42.091290 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-89e5de73-8663-4569-855d-71c744a366a5 req-c37f5d2f-3d3d-4d16-9de5-0cd7febf215a service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:35:42.103528 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-89e5de73-8663-4569-855d-71c744a366a5 req-c37f5d2f-3d3d-4d16-9de5-0cd7febf215a service nova] Creating event network-changed:5e61afc4-3017-4d25-a36f-c4d31d879b88 for instance fd589087-ba84-4a9d-a54c-72248385994f on nch1-master-1 Jul 23 22:35:42.108602 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-89e5de73-8663-4569-855d-71c744a366a5 req-c37f5d2f-3d3d-4d16-9de5-0cd7febf215a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091512 Jul 23 22:35:42.109221 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4109/6719] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:35:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:35:42.114369 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-a2fd4139-cacd-4d78-a0f3-d79bf65da527 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:35:42.115075 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-a2fd4139-cacd-4d78-a0f3-d79bf65da527 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] [instance: fd589087-ba84-4a9d-a54c-72248385994f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:35:42.121630 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a2fd4139-cacd-4d78-a0f3-d79bf65da527 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:35:42.122125 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a2fd4139-cacd-4d78-a0f3-d79bf65da527 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:35:42.122956 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a2fd4139-cacd-4d78-a0f3-d79bf65da527 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:35:42.123394 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-a2fd4139-cacd-4d78-a0f3-d79bf65da527 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:35:42.259777 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-a2fd4139-cacd-4d78-a0f3-d79bf65da527 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94052639b2b5416aa2cd97854deae6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ab318d1c967420cbac48456436e90c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:35:42.267618 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-a2fd4139-cacd-4d78-a0f3-d79bf65da527 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] 10.222.0.17 "GET /compute/v2.1/servers/fd589087-ba84-4a9d-a54c-72248385994f" status: 200 len: 1681 microversion: 2.1 time: 0.157231 Jul 23 22:35:42.268188 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4110/6720] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:35:42 2022] GET /compute/v2.1/servers/fd589087-ba84-4a9d-a54c-72248385994f => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:35:43.285385 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-3101f339-3e70-483b-8a2e-e282756ebfb7 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:35:43.286714 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-3101f339-3e70-483b-8a2e-e282756ebfb7 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] [instance: fd589087-ba84-4a9d-a54c-72248385994f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:35:43.294741 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3101f339-3e70-483b-8a2e-e282756ebfb7 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:35:43.295190 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3101f339-3e70-483b-8a2e-e282756ebfb7 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:35:43.295958 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3101f339-3e70-483b-8a2e-e282756ebfb7 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:35:43.296397 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-3101f339-3e70-483b-8a2e-e282756ebfb7 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:35:43.505556 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-3101f339-3e70-483b-8a2e-e282756ebfb7 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94052639b2b5416aa2cd97854deae6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ab318d1c967420cbac48456436e90c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:35:43.514197 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-3101f339-3e70-483b-8a2e-e282756ebfb7 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] 10.222.0.17 "GET /compute/v2.1/servers/fd589087-ba84-4a9d-a54c-72248385994f" status: 200 len: 1681 microversion: 2.1 time: 0.232694 Jul 23 22:35:43.514911 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4111/6721] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:35:43 2022] GET /compute/v2.1/servers/fd589087-ba84-4a9d-a54c-72248385994f => generated 1681 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:35:44.127519 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [req-84809422-d279-4d45-8f10-ade97b391a0e req-189dac8c-6df1-432f-b5f9-270e9a9aeb42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd589087-ba84-4a9d-a54c-72248385994f", "name": "network-vif-deleted", "tag": "5e61afc4-3017-4d25-a36f-c4d31d879b88"}]} {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 23 22:35:44.138200 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-84809422-d279-4d45-8f10-ade97b391a0e req-189dac8c-6df1-432f-b5f9-270e9a9aeb42 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:35:44.138659 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [req-84809422-d279-4d45-8f10-ade97b391a0e req-189dac8c-6df1-432f-b5f9-270e9a9aeb42 service nova] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:35:44.150057 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.compute.server_external_events [req-84809422-d279-4d45-8f10-ade97b391a0e req-189dac8c-6df1-432f-b5f9-270e9a9aeb42 service nova] Creating event network-vif-deleted:5e61afc4-3017-4d25-a36f-c4d31d879b88 for instance fd589087-ba84-4a9d-a54c-72248385994f on nch1-master-1 Jul 23 22:35:44.155078 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [req-84809422-d279-4d45-8f10-ade97b391a0e req-189dac8c-6df1-432f-b5f9-270e9a9aeb42 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033951 Jul 23 22:35:44.155677 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4112/6722] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Jul 23 22:35:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 23 22:35:44.544780 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-aebbd13e-de74-46cf-842a-6b40976f126b tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:35:44.545498 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-aebbd13e-de74-46cf-842a-6b40976f126b tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] [instance: fd589087-ba84-4a9d-a54c-72248385994f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:35:44.552151 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-aebbd13e-de74-46cf-842a-6b40976f126b tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:35:44.552612 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-aebbd13e-de74-46cf-842a-6b40976f126b tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:35:44.553385 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-aebbd13e-de74-46cf-842a-6b40976f126b tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:35:44.553829 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-aebbd13e-de74-46cf-842a-6b40976f126b tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:35:44.586853 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-aebbd13e-de74-46cf-842a-6b40976f126b tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:35:44.587303 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-aebbd13e-de74-46cf-842a-6b40976f126b tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:35:44.587923 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.objects.instance [None req-aebbd13e-de74-46cf-842a-6b40976f126b tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lazy-loading 'fault' on Instance uuid fd589087-ba84-4a9d-a54c-72248385994f {{(pid=131320) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 23 22:35:44.631933 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.policy [None req-aebbd13e-de74-46cf-842a-6b40976f126b tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94052639b2b5416aa2cd97854deae6b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ab318d1c967420cbac48456436e90c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=131320) authorize /opt/stack/nova/nova/policy.py:199}} Jul 23 22:35:44.635661 ncdv-master-1 devstack@n-api.service[131320]: DEBUG dbcounter [-] [131320] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=131320) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 23 22:35:44.641790 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-aebbd13e-de74-46cf-842a-6b40976f126b tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] 10.222.0.17 "GET /compute/v2.1/servers/fd589087-ba84-4a9d-a54c-72248385994f" status: 200 len: 1338 microversion: 2.1 time: 0.102193 Jul 23 22:35:44.642445 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4113/6723] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:35:44 2022] GET /compute/v2.1/servers/fd589087-ba84-4a9d-a54c-72248385994f => generated 1338 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 23 22:35:45.659703 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6bfc769a-c600-4be7-8333-a65bab7bad3a tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Calling method '>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:35:45.660426 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.compute.api [None req-6bfc769a-c600-4be7-8333-a65bab7bad3a tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] [instance: fd589087-ba84-4a9d-a54c-72248385994f] Fetching instance by UUID {{(pid=131320) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 23 22:35:45.668009 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6bfc769a-c600-4be7-8333-a65bab7bad3a tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:35:45.668460 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6bfc769a-c600-4be7-8333-a65bab7bad3a tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:35:45.669245 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6bfc769a-c600-4be7-8333-a65bab7bad3a tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 23 22:35:45.669683 ncdv-master-1 devstack@n-api.service[131320]: DEBUG oslo_concurrency.lockutils [None req-6bfc769a-c600-4be7-8333-a65bab7bad3a tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Lock "4e90cb14-d4b2-4158-b8cf-a592a1314a7b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=131320) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 23 22:35:45.684857 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.wsgi [None req-6bfc769a-c600-4be7-8333-a65bab7bad3a tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] HTTP exception thrown: Instance fd589087-ba84-4a9d-a54c-72248385994f could not be found. Jul 23 22:35:45.686619 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6bfc769a-c600-4be7-8333-a65bab7bad3a tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Request method failure captured: Jul 23 22:35:45.686619 ncdv-master-1 devstack@n-api.service[131320]: request: GET /compute/v2.1/servers/fd589087-ba84-4a9d-a54c-72248385994f HTTP/1.1 Jul 23 22:35:45.686619 ncdv-master-1 devstack@n-api.service[131320]: Accept: application/json Jul 23 22:35:45.686619 ncdv-master-1 devstack@n-api.service[131320]: Accept-Encoding: identity Jul 23 22:35:45.686619 ncdv-master-1 devstack@n-api.service[131320]: Connection: close Jul 23 22:35:45.686619 ncdv-master-1 devstack@n-api.service[131320]: Content-Length: 0 Jul 23 22:35:45.686619 ncdv-master-1 devstack@n-api.service[131320]: Content-Type: application/json Jul 23 22:35:45.686619 ncdv-master-1 devstack@n-api.service[131320]: Host: 10.222.0.17 Jul 23 22:35:45.686619 ncdv-master-1 devstack@n-api.service[131320]: Openstack-System-Scope: None Jul 23 22:35:45.686619 ncdv-master-1 devstack@n-api.service[131320]: User-Agent: python-urllib3/1.26.9 Jul 23 22:35:45.686619 ncdv-master-1 devstack@n-api.service[131320]: X-Auth-Token: gAAAAABi3HanqZcf9coNggFAVY_ivUe_l9XZC_q-B3wY4H4SZjnumlJTj989wrCULUWxLRdD4v-UQ8c3e-P4Ens7d_rN0LOz2Ifuc4R8cpSMf6nHwOVop5dvavY3i4woI7A7h-dP0exzSAHbZfbD9fUcQBlqf392CqALuW3C_3ZasC6XbDiRrRk Jul 23 22:35:45.686619 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Id: None Jul 23 22:35:45.686619 ncdv-master-1 devstack@n-api.service[131320]: X-Domain-Name: None Jul 23 22:35:45.686619 ncdv-master-1 devstack@n-api.service[131320]: X-Identity-Status: Confirmed Jul 23 22:35:45.686619 ncdv-master-1 devstack@n-api.service[131320]: X-Is-Admin-Project: True Jul 23 22:35:45.686619 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Id: default Jul 23 22:35:45.686619 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Domain-Name: Default Jul 23 22:35:45.686619 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Id: 4ab318d1c967420cbac48456436e90c5 Jul 23 22:35:45.686619 ncdv-master-1 devstack@n-api.service[131320]: X-Project-Name: tempest-TestSnapshotPattern-105336955 Jul 23 22:35:45.686619 ncdv-master-1 devstack@n-api.service[131320]: X-Role: reader,member Jul 23 22:35:45.686619 ncdv-master-1 devstack@n-api.service[131320]: X-Roles: reader,member Jul 23 22:35:45.686619 ncdv-master-1 devstack@n-api.service[131320]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4ab318d1c967420cbac48456436e90c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4ab318d1c967420cbac48456436e90c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4ab318d1c967420cbac48456436e90c5", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4ab318d1c967420cbac48456436e90c5"}]}] Jul 23 22:35:45.686619 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant: tempest-TestSnapshotPattern-105336955 Jul 23 22:35:45.686619 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Id: 4ab318d1c967420cbac48456436e90c5 Jul 23 22:35:45.686619 ncdv-master-1 devstack@n-api.service[131320]: X-Tenant-Name: tempest-TestSnapshotPattern-105336955 Jul 23 22:35:45.686619 ncdv-master-1 devstack@n-api.service[131320]: X-User: tempest-TestSnapshotPattern-105336955-project Jul 23 22:35:45.686619 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Id: default Jul 23 22:35:45.686619 ncdv-master-1 devstack@n-api.service[131320]: X-User-Domain-Name: Default Jul 23 22:35:45.686619 ncdv-master-1 devstack@n-api.service[131320]: X-User-Id: 94052639b2b5416aa2cd97854deae6b2 Jul 23 22:35:45.686619 ncdv-master-1 devstack@n-api.service[131320]: X-User-Name: tempest-TestSnapshotPattern-105336955-project Jul 23 22:35:45.686619 ncdv-master-1 devstack@n-api.service[131320]: method: > Jul 23 22:35:45.686619 ncdv-master-1 devstack@n-api.service[131320]: exception: Instance fd589087-ba84-4a9d-a54c-72248385994f could not be found. Jul 23 22:35:45.686619 ncdv-master-1 devstack@n-api.service[131320]: action_args: {'id': 'fd589087-ba84-4a9d-a54c-72248385994f'} Jul 23 22:35:45.686619 ncdv-master-1 devstack@n-api.service[131320]: {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 23 22:35:45.686619 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:35:45.686619 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 23 22:35:45.686619 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 23 22:35:45.686619 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 23 22:35:45.686619 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 23 22:35:45.686619 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 23 22:35:45.686619 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 23 22:35:45.686619 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 23 22:35:45.686619 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 23 22:35:45.686619 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd589087-ba84-4a9d-a54c-72248385994f could not be found. Jul 23 22:35:45.686619 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:35:45.686619 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:35:45.686619 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:35:45.686619 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:35:45.686619 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:35:45.686619 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:35:45.686619 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 23 22:35:45.686619 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 23 22:35:45.686619 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 23 22:35:45.686619 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 23 22:35:45.686619 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 23 22:35:45.686619 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 23 22:35:45.686619 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 23 22:35:45.686619 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 23 22:35:45.686619 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 23 22:35:45.686619 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 23 22:35:45.686619 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd589087-ba84-4a9d-a54c-72248385994f could not be found. Jul 23 22:35:45.686619 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:35:45.686619 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 23 22:35:45.686619 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:35:45.691366 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 23 22:35:45.691366 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 23 22:35:45.691366 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 23 22:35:45.691366 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 23 22:35:45.691366 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 23 22:35:45.691366 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd589087-ba84-4a9d-a54c-72248385994f could not be found. Jul 23 22:35:45.691366 ncdv-master-1 devstack@n-api.service[131320]: ERROR nova.api.openstack.wsgi Jul 23 22:35:45.691366 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-6bfc769a-c600-4be7-8333-a65bab7bad3a tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Returning 404 to user: Instance fd589087-ba84-4a9d-a54c-72248385994f could not be found. {{(pid=131320) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 23 22:35:45.691366 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-6bfc769a-c600-4be7-8333-a65bab7bad3a tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] 10.222.0.17 "GET /compute/v2.1/servers/fd589087-ba84-4a9d-a54c-72248385994f" status: 404 len: 111 microversion: 2.1 time: 0.032477 Jul 23 22:35:45.691366 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4114/6724] 10.222.0.17 () {58 vars in 1235 bytes} [Sat Jul 23 22:35:45 2022] GET /compute/v2.1/servers/fd589087-ba84-4a9d-a54c-72248385994f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 23 22:35:45.855893 ncdv-master-1 devstack@n-api.service[131320]: DEBUG nova.api.openstack.wsgi [None req-91f57473-eec2-41a4-9bac-0e6a573bf071 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] Calling method '.version_select at 0x7f0b599d8c10>' {{(pid=131320) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 23 22:35:45.879313 ncdv-master-1 devstack@n-api.service[131320]: INFO nova.api.openstack.requestlog [None req-91f57473-eec2-41a4-9bac-0e6a573bf071 tempest-TestSnapshotPattern-105336955 tempest-TestSnapshotPattern-105336955-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-847712247" status: 202 len: 0 microversion: 2.1 time: 0.027318 Jul 23 22:35:45.880045 ncdv-master-1 devstack@n-api.service[131320]: [pid: 131320|app: 0|req: 4115/6725] 10.222.0.17 () {58 vars in 1253 bytes} [Sat Jul 23 22:35:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-847712247 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 23 22:36:49.909629 ncdv-master-1 devstack@n-api.service[131320]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 23 22:36:49.910742 ncdv-master-1 devstack@n-api.service[131320]: Sat Jul 23 22:36:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 23 22:38:29.969606 ncdv-master-1 devstack@n-api.service[131320]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 23 22:38:29.970923 ncdv-master-1 devstack@n-api.service[131320]: Sat Jul 23 22:38:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 23 22:38:39.710296 ncdv-master-1 devstack@n-api.service[131320]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 23 22:38:39.711568 ncdv-master-1 devstack@n-api.service[131320]: Sat Jul 23 22:38:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 23 22:40:09.922615 ncdv-master-1 devstack@n-api.service[131320]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 23 22:40:09.924041 ncdv-master-1 devstack@n-api.service[131320]: Sat Jul 23 22:40:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 23 22:41:49.980568 ncdv-master-1 devstack@n-api.service[131320]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 23 22:41:49.981415 ncdv-master-1 devstack@n-api.service[131320]: Sat Jul 23 22:41:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 23 22:41:59.723358 ncdv-master-1 devstack@n-api.service[131320]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 23 22:41:59.724045 ncdv-master-1 devstack@n-api.service[131320]: Sat Jul 23 22:41:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 23 22:43:29.934131 ncdv-master-1 devstack@n-api.service[131320]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 23 22:43:29.934131 ncdv-master-1 devstack@n-api.service[131320]: Sat Jul 23 22:43:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!